2023-07-21T21:49:37.124 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-21T21:49:37.125 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --name rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347723 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} --verbose -- /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347723/orig.config.yaml 2023-07-21T21:49:37.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T21:49:47.275 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347723 branch: wip-rishabh-2023Jul13-base-2 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} email: null first_in_suite: false job_id: '7347723' kernel: client: branch: testing flavor: default kdb: true sha1: c685da6f56cc77f2cfb9c4221be3960522616caf ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-2023Jul13-base-2 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023Jul13-base-2 sha1: bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023Jul13-base-2 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOUszSwimgYtFS7cen54X1lzfsN292TP9qlmFs5yWykObaLJVp3uB03mmulOtz7nQBgqRP24rq8z1EUFjDSnTKM= smithi161.front.sepia.ceph.com: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHmz7LX6eLJUvaM/jSQToke5Y4YCbIL+2S4t0PpfaYWE tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 79491cb69dd37a1eafb93b3471998174bdfa2fd9 timestamp: 2023-07-21_21:30:53 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-21T21:49:47.275 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa; will attempt to use it 2023-07-21T21:49:47.276 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks 2023-07-21T21:49:47.276 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-21T21:49:47.278 INFO:teuthology.task.internal:Checking packages... 2023-07-21T21:49:47.306 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea' 2023-07-21T21:49:47.306 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-21T21:49:47.307 INFO:teuthology.packaging:ref: None 2023-07-21T21:49:47.307 INFO:teuthology.packaging:tag: None 2023-07-21T21:49:47.307 INFO:teuthology.packaging:branch: wip-rishabh-2023Jul13-base-2 2023-07-21T21:49:47.307 INFO:teuthology.packaging:sha1: bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea 2023-07-21T21:49:47.308 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-2023Jul13-base-2 2023-07-21T21:49:52.897 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4735-gbffe049d-1jammy 2023-07-21T21:49:52.898 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-21T21:49:52.907 INFO:teuthology.task.internal:no buildpackages task found 2023-07-21T21:49:52.907 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-21T21:49:52.921 INFO:teuthology.task.internal:Saving configuration 2023-07-21T21:49:52.937 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-21T21:49:52.946 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T21:49:57.274 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347723', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 21:41:45.983887', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKNCSSwf+ptAXnrMUoucHtTDjwHncIKVF8AdR2+ikTE1'} 2023-07-21T21:50:02.307 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347723', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 21:41:45.987518', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHmz7LX6eLJUvaM/jSQToke5Y4YCbIL+2S4t0PpfaYWE'} 2023-07-21T21:50:02.307 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-21T21:50:02.323 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-07-21T21:50:02.323 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-07-21T21:50:02.323 INFO:teuthology.run_tasks:Running task console_log... 2023-07-21T21:50:12.415 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3982a75550>, signals=[15]) 2023-07-21T21:50:12.417 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-21T21:50:12.428 INFO:teuthology.task.internal:Opening connections... 2023-07-21T21:50:12.428 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T21:50:12.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:50:12.508 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2023-07-21T21:50:12.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:50:12.585 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-21T21:50:12.594 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2023-07-21T21:50:12.682 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2023-07-21T21:50:12.683 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-07-21T21:50:12.729 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-21T21:50:12.729 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Ubuntu" 2023-07-21T21:50:12.729 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="22.04" 2023-07-21T21:50:12.729 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-21T21:50:12.730 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_CODENAME=jammy 2023-07-21T21:50:12.730 INFO:teuthology.orchestra.run.smithi006.stdout:ID=ubuntu 2023-07-21T21:50:12.730 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE=debian 2023-07-21T21:50:12.730 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-21T21:50:12.730 INFO:teuthology.orchestra.run.smithi006.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-21T21:50:12.730 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-21T21:50:12.731 INFO:teuthology.orchestra.run.smithi006.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-21T21:50:12.731 INFO:teuthology.orchestra.run.smithi006.stdout:UBUNTU_CODENAME=jammy 2023-07-21T21:50:12.732 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-07-21T21:50:17.761 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-07-21T21:50:17.766 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-07-21T21:50:17.767 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-07-21T21:50:17.813 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-21T21:50:17.813 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2023-07-21T21:50:17.814 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="22.04" 2023-07-21T21:50:17.814 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-21T21:50:17.814 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=jammy 2023-07-21T21:50:17.814 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2023-07-21T21:50:17.814 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2023-07-21T21:50:17.814 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-21T21:50:17.815 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-21T21:50:17.815 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-21T21:50:17.815 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-21T21:50:17.815 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=jammy 2023-07-21T21:50:17.815 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-07-21T21:50:22.843 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-21T21:50:22.858 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-21T21:50:22.875 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-21T21:50:22.876 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2023-07-21T21:50:22.878 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2023-07-21T21:50:22.884 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-21T21:50:22.890 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-21T21:50:22.891 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2023-07-21T21:50:22.927 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2023-07-21T21:50:22.941 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-21T21:50:26.278 INFO:teuthology.run_tasks:Running task kernel... 2023-07-21T21:50:26.302 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'} 2023-07-21T21:50:26.303 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-07-21T21:50:26.304 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-07-21T21:50:26.304 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-21T21:50:26.305 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-21T21:50:26.309 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T21:50:26.310 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-07-21T21:50:26.313 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T21:50:26.314 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-07-21T21:50:27.023 DEBUG:teuthology.task.kernel:sha1 for client.1 is c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:50:27.024 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "c685da6f56cc77f2cfb9c4221be3960522616caf"... 2023-07-21T21:50:27.024 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2023-07-21T21:50:27.029 INFO:teuthology.orchestra.run.smithi161.stdout:5.15.0-56-generic 2023-07-21T21:50:27.030 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:50:27.030 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-21T21:50:27.031 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-07-21T21:50:27.031 DEBUG:teuthology.orchestra.run.smithi161:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-07-21T21:50:27.033 DEBUG:teuthology.task.kernel:sha1 for client.0 is c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:50:27.034 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "c685da6f56cc77f2cfb9c4221be3960522616caf"... 2023-07-21T21:50:27.034 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2023-07-21T21:50:27.039 INFO:teuthology.orchestra.run.smithi006.stdout:5.15.0-56-generic 2023-07-21T21:50:27.039 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:50:27.040 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-21T21:50:27.040 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-07-21T21:50:27.040 DEBUG:teuthology.orchestra.run.smithi006:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-07-21T21:50:27.093 INFO:teuthology.orchestra.run.smithi161.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-07-21T21:50:27.107 INFO:teuthology.orchestra.run.smithi006.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-07-21T21:50:27.230 INFO:teuthology.orchestra.run.smithi161.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-07-21T21:50:27.230 INFO:teuthology.orchestra.run.smithi161.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-07-21T21:50:27.230 INFO:teuthology.orchestra.run.smithi161.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-07-21T21:50:27.231 INFO:teuthology.orchestra.run.smithi161.stderr:hint: 2023-07-21T21:50:27.231 INFO:teuthology.orchestra.run.smithi161.stderr:hint: git config --global init.defaultBranch 2023-07-21T21:50:27.231 INFO:teuthology.orchestra.run.smithi161.stderr:hint: 2023-07-21T21:50:27.231 INFO:teuthology.orchestra.run.smithi161.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-07-21T21:50:27.231 INFO:teuthology.orchestra.run.smithi161.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-07-21T21:50:27.232 INFO:teuthology.orchestra.run.smithi161.stderr:hint: 2023-07-21T21:50:27.232 INFO:teuthology.orchestra.run.smithi161.stderr:hint: git branch -m 2023-07-21T21:50:27.232 INFO:teuthology.orchestra.run.smithi161.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-07-21T21:50:27.234 DEBUG:teuthology.orchestra.run.smithi161:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-07-21T21:50:27.244 INFO:teuthology.orchestra.run.smithi006.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-07-21T21:50:27.245 INFO:teuthology.orchestra.run.smithi006.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-07-21T21:50:27.245 INFO:teuthology.orchestra.run.smithi006.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-07-21T21:50:27.246 INFO:teuthology.orchestra.run.smithi006.stderr:hint: 2023-07-21T21:50:27.246 INFO:teuthology.orchestra.run.smithi006.stderr:hint: git config --global init.defaultBranch 2023-07-21T21:50:27.246 INFO:teuthology.orchestra.run.smithi006.stderr:hint: 2023-07-21T21:50:27.247 INFO:teuthology.orchestra.run.smithi006.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-07-21T21:50:27.247 INFO:teuthology.orchestra.run.smithi006.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-07-21T21:50:27.247 INFO:teuthology.orchestra.run.smithi006.stderr:hint: 2023-07-21T21:50:27.247 INFO:teuthology.orchestra.run.smithi006.stderr:hint: git branch -m 2023-07-21T21:50:27.248 INFO:teuthology.orchestra.run.smithi006.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-07-21T21:50:27.249 DEBUG:teuthology.orchestra.run.smithi006:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-07-21T21:50:27.301 DEBUG:teuthology.orchestra.run.smithi161:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-07-21T21:50:27.315 DEBUG:teuthology.orchestra.run.smithi006:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-07-21T21:50:27.355 DEBUG:teuthology.orchestra.run.smithi161:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-07-21T21:50:27.372 DEBUG:teuthology.orchestra.run.smithi006:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-07-21T21:58:25.556 INFO:teuthology.orchestra.run.smithi006.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-07-21T21:58:25.557 INFO:teuthology.orchestra.run.smithi006.stderr: * [new branch] main -> origin/main 2023-07-21T21:58:25.585 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20190312 -> 20190312 2023-07-21T21:58:25.585 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20190416 -> 20190416 2023-07-21T21:58:25.585 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20190514 -> 20190514 2023-07-21T21:58:25.585 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20190618 -> 20190618 2023-07-21T21:58:25.585 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20190717 -> 20190717 2023-07-21T21:58:25.586 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20190815 -> 20190815 2023-07-21T21:58:25.587 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20190923 -> 20190923 2023-07-21T21:58:25.587 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20191022 -> 20191022 2023-07-21T21:58:25.587 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20191215 -> 20191215 2023-07-21T21:58:25.587 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20200122 -> 20200122 2023-07-21T21:58:25.587 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20200316 -> 20200316 2023-07-21T21:58:25.587 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20200421 -> 20200421 2023-07-21T21:58:25.588 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20200519 -> 20200519 2023-07-21T21:58:25.588 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20200619 -> 20200619 2023-07-21T21:58:25.588 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20200721 -> 20200721 2023-07-21T21:58:25.591 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20200817 -> 20200817 2023-07-21T21:58:25.591 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20200918 -> 20200918 2023-07-21T21:58:25.591 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20201022 -> 20201022 2023-07-21T21:58:25.591 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20201118 -> 20201118 2023-07-21T21:58:25.592 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20201218 -> 20201218 2023-07-21T21:58:25.592 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20210208 -> 20210208 2023-07-21T21:58:25.592 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20210315 -> 20210315 2023-07-21T21:58:25.592 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20210511 -> 20210511 2023-07-21T21:58:25.593 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20210716 -> 20210716 2023-07-21T21:58:25.593 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20210818 -> 20210818 2023-07-21T21:58:25.593 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20210919 -> 20210919 2023-07-21T21:58:25.593 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20211027 -> 20211027 2023-07-21T21:58:25.594 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20211216 -> 20211216 2023-07-21T21:58:25.594 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20220209 -> 20220209 2023-07-21T21:58:25.594 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20220310 -> 20220310 2023-07-21T21:58:25.594 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20220411 -> 20220411 2023-07-21T21:58:25.595 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20220509 -> 20220509 2023-07-21T21:58:25.595 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20220610 -> 20220610 2023-07-21T21:58:25.595 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20220708 -> 20220708 2023-07-21T21:58:25.595 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20220815 -> 20220815 2023-07-21T21:58:25.595 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20220913 -> 20220913 2023-07-21T21:58:25.596 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20221012 -> 20221012 2023-07-21T21:58:25.596 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20221109 -> 20221109 2023-07-21T21:58:25.596 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20221214 -> 20221214 2023-07-21T21:58:25.596 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20230117 -> 20230117 2023-07-21T21:58:25.596 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20230210 -> 20230210 2023-07-21T21:58:25.596 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20230310 -> 20230310 2023-07-21T21:58:25.596 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20230404 -> 20230404 2023-07-21T21:58:25.597 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20230515 -> 20230515 2023-07-21T21:58:25.597 INFO:teuthology.orchestra.run.smithi006.stderr: * [new tag] 20230625 -> 20230625 2023-07-21T21:58:29.022 INFO:teuthology.orchestra.run.smithi006.stderr:Updating files: 47% (1422/2977) Updating files: 48% (1429/2977) Updating files: 49% (1459/2977) Updating files: 50% (1489/2977) Updating files: 51% (1519/2977) Updating files: 52% (1549/2977) Updating files: 53% (1578/2977) Updating files: 54% (1608/2977) Updating files: 55% (1638/2977) Updating files: 56% (1668/2977) Updating files: 57% (1697/2977) Updating files: 58% (1727/2977) Updating files: 59% (1757/2977) Updating files: 60% (1787/2977) Updating files: 61% (1816/2977) Updating files: 62% (1846/2977) Updating files: 63% (1876/2977) Updating files: 64% (1906/2977) Updating files: 65% (1936/2977) Updating files: 65% (1952/2977) Updating files: 66% (1965/2977) Updating files: 67% (1995/2977) Updating files: 68% (2025/2977) Updating files: 69% (2055/2977) Updating files: 70% (2084/2977) Updating files: 71% (2114/2977) Updating files: 72% (2144/2977) Updating files: 73% (2174/2977) Updating files: 74% (2203/2977) Updating files: 75% (2233/2977) Updating files: 76% (2263/2977) Updating files: 77% (2293/2977) Updating files: 78% (2323/2977) Updating files: 79% (2352/2977) Updating files: 80% (2382/2977) Updating files: 81% (2412/2977) Updating files: 81% (2429/2977) Updating files: 82% (2442/2977) Updating files: 83% (2471/2977) Updating files: 84% (2501/2977) Updating files: 85% (2531/2977) Updating files: 86% (2561/2977) Updating files: 87% (2590/2977) Updating files: 88% (2620/2977) Updating files: 89% (2650/2977) Updating files: 90% (2680/2977) Updating files: 91% (2710/2977) Updating files: 92% (2739/2977) Updating files: 93% (2769/2977) Updating files: 94% (2799/2977) Updating files: 95% (2829/2977) Updating files: 96% (2858/2977) Updating files: 97% (2888/2977) Updating files: 98% (2918/2977) Updating files: 99% (2948/2977) Updating files: 100% (2977/2977) Updating files: 100% (2977/2977), done. 2023-07-21T21:58:29.027 INFO:teuthology.orchestra.run.smithi006.stdout:HEAD is now at d3f66064 Partially revert "amdgpu: DMCUB updates for DCN 3.1.4 and 3.1.5" 2023-07-21T21:58:29.046 INFO:teuthology.task.kernel:Downloading kernel c685da6f56cc77f2cfb9c4221be3960522616caf on client.0... 2023-07-21T21:58:29.047 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:58:29.599 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/ 2023-07-21T21:58:29.599 DEBUG:teuthology.orchestra.run.smithi006:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc1-gc685da6f56cc_6.5.0-rc1-gc685da6f56cc-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/ --input-file=- 2023-07-21T21:58:29.602 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi006.front.sepia.ceph.com to complete... 2023-07-21T21:58:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21 21:58:33 URL:https://4.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/linux-image-6.5.0-rc1-gc685da6f56cc_6.5.0-rc1-gc685da6f56cc-1_amd64.deb [38851756/38851756] -> "/tmp/linux-image.deb" [1] 2023-07-21T21:58:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:FINISHED --2023-07-21 21:58:33-- 2023-07-21T21:58:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:Total wall clock time: 4.3s 2023-07-21T21:58:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:Downloaded: 1 files, 37M in 3.8s (9.82 MB/s) 2023-07-21T21:58:33.919 INFO:teuthology.task.kernel:Installing kernel c685da6f56cc77f2cfb9c4221be3960522616caf on client.0... 2023-07-21T21:58:33.920 DEBUG:teuthology.orchestra.run.smithi006:> sudo dpkg -i /tmp/linux-image.deb 2023-07-21T21:58:34.168 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package linux-image-6.5.0-rc1-gc685da6f56cc. 2023-07-21T21:58:36.190 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-07-21T21:58:36.194 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-07-21T21:58:36.347 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking linux-image-6.5.0-rc1-gc685da6f56cc (6.5.0-rc1-gc685da6f56cc-1) ... 2023-07-21T21:58:39.803 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up linux-image-6.5.0-rc1-gc685da6f56cc (6.5.0-rc1-gc685da6f56cc-1) ... 2023-07-21T21:58:39.913 INFO:teuthology.orchestra.run.smithi006.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:58:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:Sourcing file `/etc/default/grub' 2023-07-21T21:58:59.994 INFO:teuthology.orchestra.run.smithi006.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-21T21:59:00.023 INFO:teuthology.orchestra.run.smithi006.stderr:Generating grub configuration file ... 2023-07-21T21:59:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:59:00.384 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:59:00.685 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-21T21:59:00.701 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-21T21:59:00.766 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-21T21:59:00.771 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-21T21:59:00.956 INFO:teuthology.orchestra.run.smithi006.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-21T21:59:00.956 INFO:teuthology.orchestra.run.smithi006.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-21T21:59:00.957 INFO:teuthology.orchestra.run.smithi006.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-21T21:59:00.993 INFO:teuthology.orchestra.run.smithi006.stderr:done 2023-07-21T21:59:01.186 DEBUG:teuthology.orchestra.run.smithi006:> dpkg-deb -c /tmp/linux-image.deb 2023-07-21T21:59:01.194 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./ 2023-07-21T21:59:01.194 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./boot/ 2023-07-21T21:59:01.194 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 4380308 2023-07-20 11:52 ./boot/System.map-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:59:01.207 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 168433 2023-07-20 11:52 ./boot/config-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:59:01.207 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11280224 2023-07-20 11:52 ./boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:59:01.227 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./etc/ 2023-07-21T21:59:01.227 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./etc/kernel/ 2023-07-21T21:59:01.228 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./etc/kernel/postinst.d/ 2023-07-21T21:59:01.228 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./etc/kernel/postrm.d/ 2023-07-21T21:59:01.228 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./etc/kernel/preinst.d/ 2023-07-21T21:59:01.228 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./etc/kernel/prerm.d/ 2023-07-21T21:59:01.228 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/ 2023-07-21T21:59:01.228 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/ 2023-07-21T21:59:01.229 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/ 2023-07-21T21:59:01.229 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/ 2023-07-21T21:59:01.229 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/ 2023-07-21T21:59:01.229 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/ 2023-07-21T21:59:01.229 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/ 2023-07-21T21:59:01.229 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 490385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/aesni-intel.ko 2023-07-21T21:59:01.231 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-21T21:59:01.231 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-21T21:59:01.231 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-21T21:59:01.232 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 93113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-21T21:59:01.232 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 106729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-21T21:59:01.232 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 152241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-21T21:59:01.232 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-21T21:59:01.232 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13777 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-21T21:59:01.232 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 83889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-21T21:59:01.232 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-21T21:59:01.233 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-21T21:59:01.233 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-21T21:59:01.233 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-21T21:59:01.233 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-21T21:59:01.233 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-21T21:59:01.233 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 58585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-21T21:59:01.233 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-21T21:59:01.234 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-21T21:59:01.234 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-21T21:59:01.234 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/ 2023-07-21T21:59:01.234 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/ 2023-07-21T21:59:01.234 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce/ 2023-07-21T21:59:01.234 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-21T21:59:01.234 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13281 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpuid.ko 2023-07-21T21:59:01.234 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/msr.ko 2023-07-21T21:59:01.235 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/ 2023-07-21T21:59:01.235 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 348417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-21T21:59:01.235 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 972641 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-21T21:59:01.235 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 2273145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm.ko 2023-07-21T21:59:01.237 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ 2023-07-21T21:59:01.238 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/af_alg.ko 2023-07-21T21:59:01.241 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/algif_hash.ko 2023-07-21T21:59:01.241 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/algif_skcipher.ko 2023-07-21T21:59:01.241 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ansi_cprng.ko 2023-07-21T21:59:01.241 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19641 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/anubis.ko 2023-07-21T21:59:01.241 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/arc4.ko 2023-07-21T21:59:01.241 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/asymmetric_keys/ 2023-07-21T21:59:01.242 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-07-21T21:59:01.242 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/ 2023-07-21T21:59:01.242 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_memcpy.ko 2023-07-21T21:59:01.242 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_pq.ko 2023-07-21T21:59:01.242 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-21T21:59:01.242 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_tx.ko 2023-07-21T21:59:01.242 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_xor.ko 2023-07-21T21:59:01.243 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/raid6test.ko 2023-07-21T21:59:01.243 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authenc.ko 2023-07-21T21:59:01.243 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22641 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authencesn.ko 2023-07-21T21:59:01.243 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blake2b_generic.ko 2023-07-21T21:59:01.243 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_common.ko 2023-07-21T21:59:01.243 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_generic.ko 2023-07-21T21:59:01.243 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/camellia_generic.ko 2023-07-21T21:59:01.244 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast5_generic.ko 2023-07-21T21:59:01.244 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast6_generic.ko 2023-07-21T21:59:01.244 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast_common.ko 2023-07-21T21:59:01.244 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ccm.ko 2023-07-21T21:59:01.244 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14769 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cmac.ko 2023-07-21T21:59:01.244 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crc32_generic.ko 2023-07-21T21:59:01.244 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 46961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cryptd.ko 2023-07-21T21:59:01.245 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_engine.ko 2023-07-21T21:59:01.245 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_simd.ko 2023-07-21T21:59:01.245 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_user.ko 2023-07-21T21:59:01.245 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cts.ko 2023-07-21T21:59:01.245 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/des_generic.ko 2023-07-21T21:59:01.245 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/dh_generic.ko 2023-07-21T21:59:01.246 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/echainiv.ko 2023-07-21T21:59:01.246 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/essiv.ko 2023-07-21T21:59:01.246 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/fcrypt.ko 2023-07-21T21:59:01.246 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/khazad.ko 2023-07-21T21:59:01.246 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lrw.ko 2023-07-21T21:59:01.246 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11513 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4.ko 2023-07-21T21:59:01.246 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4hc.ko 2023-07-21T21:59:01.247 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11761 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/md4.ko 2023-07-21T21:59:01.247 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/michael_mic.ko 2023-07-21T21:59:01.247 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcbc.ko 2023-07-21T21:59:01.247 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcrypt.ko 2023-07-21T21:59:01.247 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/rmd160.ko 2023-07-21T21:59:01.247 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/seed.ko 2023-07-21T21:59:01.247 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/serpent_generic.ko 2023-07-21T21:59:01.247 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 149193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tcrypt.ko 2023-07-21T21:59:01.248 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tea.ko 2023-07-21T21:59:01.248 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28777 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_common.ko 2023-07-21T21:59:01.248 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_generic.ko 2023-07-21T21:59:01.248 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/vmac.ko 2023-07-21T21:59:01.248 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/wp512.ko 2023-07-21T21:59:01.248 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xcbc.ko 2023-07-21T21:59:01.248 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xor.ko 2023-07-21T21:59:01.249 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xts.ko 2023-07-21T21:59:01.249 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xxhash_generic.ko 2023-07-21T21:59:01.249 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ 2023-07-21T21:59:01.249 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/ 2023-07-21T21:59:01.249 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_extlog.ko 2023-07-21T21:59:01.249 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-21T21:59:01.249 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_pad.ko 2023-07-21T21:59:01.249 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/apei/ 2023-07-21T21:59:01.250 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/apei/einj.ko 2023-07-21T21:59:01.250 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/ec_sys.ko 2023-07-21T21:59:01.250 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/platform_profile.ko 2023-07-21T21:59:01.250 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbs.ko 2023-07-21T21:59:01.250 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbshc.ko 2023-07-21T21:59:01.250 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 100401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/video.ko 2023-07-21T21:59:01.250 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ 2023-07-21T21:59:01.250 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/acard-ahci.ko 2023-07-21T21:59:01.251 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 88625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ahci.ko 2023-07-21T21:59:01.251 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ahci_platform.ko 2023-07-21T21:59:01.251 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 87841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/libahci.ko 2023-07-21T21:59:01.263 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/libahci_platform.ko 2023-07-21T21:59:01.263 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17009 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_acpi.ko 2023-07-21T21:59:01.263 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ali.ko 2023-07-21T21:59:01.263 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_amd.ko 2023-07-21T21:59:01.263 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_artop.ko 2023-07-21T21:59:01.263 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atiixp.ko 2023-07-21T21:59:01.264 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atp867x.ko 2023-07-21T21:59:01.264 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd640.ko 2023-07-21T21:59:01.264 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd64x.ko 2023-07-21T21:59:01.264 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cypress.ko 2023-07-21T21:59:01.264 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_efar.ko 2023-07-21T21:59:01.264 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt366.ko 2023-07-21T21:59:01.264 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt37x.ko 2023-07-21T21:59:01.265 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-21T21:59:01.265 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-21T21:59:01.265 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it8213.ko 2023-07-21T21:59:01.265 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it821x.ko 2023-07-21T21:59:01.265 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_jmicron.ko 2023-07-21T21:59:01.265 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_legacy.ko 2023-07-21T21:59:01.265 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_marvell.ko 2023-07-21T21:59:01.265 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_mpiix.ko 2023-07-21T21:59:01.266 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_netcell.ko 2023-07-21T21:59:01.266 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ninja32.ko 2023-07-21T21:59:01.266 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87410.ko 2023-07-21T21:59:01.266 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87415.ko 2023-07-21T21:59:01.266 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_oldpiix.ko 2023-07-21T21:59:01.266 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_opti.ko 2023-07-21T21:59:01.266 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_optidma.ko 2023-07-21T21:59:01.267 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pcmcia.ko 2023-07-21T21:59:01.267 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-21T21:59:01.267 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-21T21:59:01.267 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_piccolo.ko 2023-07-21T21:59:01.267 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_radisys.ko 2023-07-21T21:59:01.267 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_rdc.ko 2023-07-21T21:59:01.267 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_rz1000.ko 2023-07-21T21:59:01.267 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sch.ko 2023-07-21T21:59:01.268 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_serverworks.ko 2023-07-21T21:59:01.268 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sil680.ko 2023-07-21T21:59:01.268 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sl82c105.ko 2023-07-21T21:59:01.268 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_triflex.ko 2023-07-21T21:59:01.268 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_via.ko 2023-07-21T21:59:01.268 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pdc_adma.ko 2023-07-21T21:59:01.268 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_inic162x.ko 2023-07-21T21:59:01.269 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 83225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_mv.ko 2023-07-21T21:59:01.269 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 70537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_nv.ko 2023-07-21T21:59:01.269 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37369 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_promise.ko 2023-07-21T21:59:01.269 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_qstor.ko 2023-07-21T21:59:01.269 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil.ko 2023-07-21T21:59:01.269 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil24.ko 2023-07-21T21:59:01.270 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sis.ko 2023-07-21T21:59:01.270 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_svw.ko 2023-07-21T21:59:01.270 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sx4.ko 2023-07-21T21:59:01.270 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_uli.ko 2023-07-21T21:59:01.270 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_via.ko 2023-07-21T21:59:01.270 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_vsc.ko 2023-07-21T21:59:01.270 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay/ 2023-07-21T21:59:01.271 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay/ks0108.ko 2023-07-21T21:59:01.271 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma/ 2023-07-21T21:59:01.271 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 124457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma/bcma.ko 2023-07-21T21:59:01.271 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/ 2023-07-21T21:59:01.271 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe/ 2023-07-21T21:59:01.271 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 113705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe/aoe.ko 2023-07-21T21:59:01.271 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd/ 2023-07-21T21:59:01.271 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 968433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd/drbd.ko 2023-07-21T21:59:01.272 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 173201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/floppy.ko 2023-07-21T21:59:01.272 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx/ 2023-07-21T21:59:01.272 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 94297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-21T21:59:01.272 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 115345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/nbd.ko 2023-07-21T21:59:01.272 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk/ 2023-07-21T21:59:01.272 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 110361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk/null_blk.ko 2023-07-21T21:59:01.272 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 98225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/pktcdvd.ko 2023-07-21T21:59:01.273 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 257529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/rbd.ko 2023-07-21T21:59:01.273 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback/ 2023-07-21T21:59:01.273 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 98129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-21T21:59:01.273 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram/ 2023-07-21T21:59:01.273 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 60201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram/zram.ko 2023-07-21T21:59:01.273 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ 2023-07-21T21:59:01.273 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/applicom.ko 2023-07-21T21:59:01.273 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12009 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hangcheck-timer.ko 2023-07-21T21:59:01.274 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/ 2023-07-21T21:59:01.274 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-21T21:59:01.274 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-21T21:59:01.274 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-21T21:59:01.274 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/via-rng.ko 2023-07-21T21:59:01.274 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15633 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-21T21:59:01.274 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ 2023-07-21T21:59:01.275 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-21T21:59:01.275 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 150665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-21T21:59:01.275 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-21T21:59:01.275 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 139057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-21T21:59:01.275 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 70833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-21T21:59:01.275 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-21T21:59:01.275 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/lp.ko 2023-07-21T21:59:01.275 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave/ 2023-07-21T21:59:01.276 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 84121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave/mwave.ko 2023-07-21T21:59:01.276 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/nvram.ko 2023-07-21T21:59:01.276 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ppdev.ko 2023-07-21T21:59:01.276 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tlclk.ko 2023-07-21T21:59:01.276 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/ 2023-07-21T21:59:01.276 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-21T21:59:01.276 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-07-21T21:59:01.277 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-07-21T21:59:01.277 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-07-21T21:59:01.277 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-21T21:59:01.277 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-21T21:59:01.277 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-07-21T21:59:01.277 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/ 2023-07-21T21:59:01.277 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_class.ko 2023-07-21T21:59:01.278 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_core.ko 2023-07-21T21:59:01.278 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-07-21T21:59:01.278 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/ 2023-07-21T21:59:01.278 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-palmas.ko 2023-07-21T21:59:01.278 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-si5351.ko 2023-07-21T21:59:01.278 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-twl6040.ko 2023-07-21T21:59:01.278 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-wm831x.ko 2023-07-21T21:59:01.278 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/ 2023-07-21T21:59:01.279 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-21T21:59:01.279 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-21T21:59:01.279 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-21T21:59:01.279 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ 2023-07-21T21:59:01.279 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ 2023-07-21T21:59:01.279 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 70785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-21T21:59:01.279 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 234473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp.ko 2023-07-21T21:59:01.279 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/ 2023-07-21T21:59:01.280 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/ 2023-07-21T21:59:01.280 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common/ 2023-07-21T21:59:01.280 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 408489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-21T21:59:01.280 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-07-21T21:59:01.280 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-21T21:59:01.280 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-aes.ko 2023-07-21T21:59:01.280 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-sha.ko 2023-07-21T21:59:01.281 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio/ 2023-07-21T21:59:01.281 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 68937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-21T21:59:01.281 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca/ 2023-07-21T21:59:01.281 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca/dca.ko 2023-07-21T21:59:01.281 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ 2023-07-21T21:59:01.281 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw/ 2023-07-21T21:59:01.281 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-21T21:59:01.282 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat/ 2023-07-21T21:59:01.282 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 122641 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-21T21:59:01.282 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/ 2023-07-21T21:59:01.282 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 80273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/amd64_edac.ko 2023-07-21T21:59:01.282 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35769 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/e752x_edac.ko 2023-07-21T21:59:01.282 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 63617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/edac_mce_amd.ko 2023-07-21T21:59:01.282 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3000_edac.ko 2023-07-21T21:59:01.282 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3200_edac.ko 2023-07-21T21:59:01.283 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5100_edac.ko 2023-07-21T21:59:01.283 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5400_edac.ko 2023-07-21T21:59:01.283 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7300_edac.ko 2023-07-21T21:59:01.283 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 52025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7core_edac.ko 2023-07-21T21:59:01.283 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i82975x_edac.ko 2023-07-21T21:59:01.283 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/ie31200_edac.ko 2023-07-21T21:59:01.283 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 56809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/sb_edac.ko 2023-07-21T21:59:01.283 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/x38_edac.ko 2023-07-21T21:59:01.284 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/ 2023-07-21T21:59:01.284 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-gpio.ko 2023-07-21T21:59:01.284 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max14577.ko 2023-07-21T21:59:01.284 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max77693.ko 2023-07-21T21:59:01.284 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max8997.ko 2023-07-21T21:59:01.284 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-palmas.ko 2023-07-21T21:59:01.284 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-rt8973a.ko 2023-07-21T21:59:01.285 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-sm5502.ko 2023-07-21T21:59:01.285 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/ 2023-07-21T21:59:01.285 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/dmi-sysfs.ko 2023-07-21T21:59:01.285 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/efi/ 2023-07-21T21:59:01.285 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/efi/efi-pstore.ko 2023-07-21T21:59:01.285 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-21T21:59:01.285 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/ 2023-07-21T21:59:01.285 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-adp5520.ko 2023-07-21T21:59:01.286 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-amd8111.ko 2023-07-21T21:59:01.286 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-arizona.ko 2023-07-21T21:59:01.286 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-da9052.ko 2023-07-21T21:59:01.286 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-da9055.ko 2023-07-21T21:59:01.286 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-dln2.ko 2023-07-21T21:59:01.286 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 77849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-f7188x.ko 2023-07-21T21:59:01.286 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-generic.ko 2023-07-21T21:59:01.286 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-ich.ko 2023-07-21T21:59:01.287 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-07-21T21:59:01.287 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-kempld.ko 2023-07-21T21:59:01.287 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-lp3943.ko 2023-07-21T21:59:01.287 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max7300.ko 2023-07-21T21:59:01.287 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max730x.ko 2023-07-21T21:59:01.287 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max732x.ko 2023-07-21T21:59:01.287 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-07-21T21:59:01.288 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 46761 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-pca953x.ko 2023-07-21T21:59:01.288 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-pcf857x.ko 2023-07-21T21:59:01.288 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14377 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-rdc321x.ko 2023-07-21T21:59:01.288 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-sch.ko 2023-07-21T21:59:01.288 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-sch311x.ko 2023-07-21T21:59:01.288 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-tps65912.ko 2023-07-21T21:59:01.288 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-twl4030.ko 2023-07-21T21:59:01.288 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-twl6040.ko 2023-07-21T21:59:01.289 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-21T21:59:01.289 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-vx855.ko 2023-07-21T21:59:01.289 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16281 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm831x.ko 2023-07-21T21:59:01.289 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm8350.ko 2023-07-21T21:59:01.289 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm8994.ko 2023-07-21T21:59:01.289 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/ 2023-07-21T21:59:01.289 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-a4tech.ko 2023-07-21T21:59:01.289 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-apple.ko 2023-07-21T21:59:01.290 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-appleir.ko 2023-07-21T21:59:01.290 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8353 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-aureal.ko 2023-07-21T21:59:01.290 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-axff.ko 2023-07-21T21:59:01.290 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-belkin.ko 2023-07-21T21:59:01.290 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cherry.ko 2023-07-21T21:59:01.290 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-chicony.ko 2023-07-21T21:59:01.290 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 59145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cp2112.ko 2023-07-21T21:59:01.291 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cypress.ko 2023-07-21T21:59:01.291 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-dr.ko 2023-07-21T21:59:01.291 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elecom.ko 2023-07-21T21:59:01.291 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elo.ko 2023-07-21T21:59:01.291 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-emsff.ko 2023-07-21T21:59:01.291 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ezkey.ko 2023-07-21T21:59:01.291 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gaff.ko 2023-07-21T21:59:01.292 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-generic.ko 2023-07-21T21:59:01.292 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gt683r.ko 2023-07-21T21:59:01.292 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gyration.ko 2023-07-21T21:59:01.292 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-21T21:59:01.292 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-21T21:59:01.292 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtekff.ko 2023-07-21T21:59:01.292 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-hyperv.ko 2023-07-21T21:59:01.292 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-icade.ko 2023-07-21T21:59:01.293 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-kensington.ko 2023-07-21T21:59:01.293 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-keytouch.ko 2023-07-21T21:59:01.293 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-kye.ko 2023-07-21T21:59:01.293 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lcpower.ko 2023-07-21T21:59:01.293 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-led.ko 2023-07-21T21:59:01.293 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lenovo.ko 2023-07-21T21:59:01.293 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30761 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lg-g15.ko 2023-07-21T21:59:01.293 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 57809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-21T21:59:01.294 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 100897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-21T21:59:01.294 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 80993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech.ko 2023-07-21T21:59:01.294 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-magicmouse.ko 2023-07-21T21:59:01.294 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-microsoft.ko 2023-07-21T21:59:01.294 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-monterey.ko 2023-07-21T21:59:01.294 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-multitouch.ko 2023-07-21T21:59:01.294 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ntrig.ko 2023-07-21T21:59:01.295 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ortek.ko 2023-07-21T21:59:01.295 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-penmount.ko 2023-07-21T21:59:01.295 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-petalynx.ko 2023-07-21T21:59:01.295 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 72937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-picolcd.ko 2023-07-21T21:59:01.295 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-pl.ko 2023-07-21T21:59:01.295 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-plantronics.ko 2023-07-21T21:59:01.295 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-primax.ko 2023-07-21T21:59:01.295 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-rmi.ko 2023-07-21T21:59:01.296 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20761 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-21T21:59:01.296 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-common.ko 2023-07-21T21:59:01.296 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-21T21:59:01.296 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-21T21:59:01.296 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-21T21:59:01.296 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-21T21:59:01.296 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-21T21:59:01.297 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-21T21:59:01.297 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-21T21:59:01.297 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-21T21:59:01.297 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-21T21:59:01.297 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat.ko 2023-07-21T21:59:01.297 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-saitek.ko 2023-07-21T21:59:01.297 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-samsung.ko 2023-07-21T21:59:01.297 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-21T21:59:01.298 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sjoy.ko 2023-07-21T21:59:01.298 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sony.ko 2023-07-21T21:59:01.298 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-speedlink.ko 2023-07-21T21:59:01.298 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-steelseries.ko 2023-07-21T21:59:01.298 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sunplus.ko 2023-07-21T21:59:01.298 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-21T21:59:01.298 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tivo.ko 2023-07-21T21:59:01.299 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tmff.ko 2023-07-21T21:59:01.299 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-topseed.ko 2023-07-21T21:59:01.299 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-twinhan.ko 2023-07-21T21:59:01.299 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 71457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-uclogic.ko 2023-07-21T21:59:01.299 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-waltop.ko 2023-07-21T21:59:01.299 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 143585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-wiimote.ko 2023-07-21T21:59:01.299 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-xinmo.ko 2023-07-21T21:59:01.299 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zpff.ko 2023-07-21T21:59:01.300 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zydacron.ko 2023-07-21T21:59:01.300 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 267713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid.ko 2023-07-21T21:59:01.300 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/uhid.ko 2023-07-21T21:59:01.300 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/ 2023-07-21T21:59:01.300 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 125721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbhid.ko 2023-07-21T21:59:01.300 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbkbd.ko 2023-07-21T21:59:01.300 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbmouse.ko 2023-07-21T21:59:01.301 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 217401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/wacom.ko 2023-07-21T21:59:01.301 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/ 2023-07-21T21:59:01.301 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 63497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_balloon.ko 2023-07-21T21:59:01.327 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 89609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_utils.ko 2023-07-21T21:59:01.328 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 301449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_vmbus.ko 2023-07-21T21:59:01.328 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ 2023-07-21T21:59:01.328 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 66593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru.ko 2023-07-21T21:59:01.328 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 61393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru3.ko 2023-07-21T21:59:01.328 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-21T21:59:01.329 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7414.ko 2023-07-21T21:59:01.329 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7418.ko 2023-07-21T21:59:01.329 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adc128d818.ko 2023-07-21T21:59:01.329 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1025.ko 2023-07-21T21:59:01.329 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 97977 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1026.ko 2023-07-21T21:59:01.329 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1029.ko 2023-07-21T21:59:01.329 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 45553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1031.ko 2023-07-21T21:59:01.330 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm9240.ko 2023-07-21T21:59:01.330 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14769 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ads7828.ko 2023-07-21T21:59:01.330 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10769 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7410.ko 2023-07-21T21:59:01.330 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7411.ko 2023-07-21T21:59:01.330 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 74433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7462.ko 2023-07-21T21:59:01.330 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7470.ko 2023-07-21T21:59:01.330 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 67929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7475.ko 2023-07-21T21:59:01.330 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7x10.ko 2023-07-21T21:59:01.331 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/amc6821.ko 2023-07-21T21:59:01.331 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 55265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/applesmc.ko 2023-07-21T21:59:01.331 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asb100.ko 2023-07-21T21:59:01.331 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 58617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asc7621.ko 2023-07-21T21:59:01.331 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-21T21:59:01.331 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/atxp1.ko 2023-07-21T21:59:01.331 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28281 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/coretemp.ko 2023-07-21T21:59:01.332 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/da9052-hwmon.ko 2023-07-21T21:59:01.332 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/da9055-hwmon.ko 2023-07-21T21:59:01.332 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-21T21:59:01.332 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 99601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dme1737.ko 2023-07-21T21:59:01.332 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds1621.ko 2023-07-21T21:59:01.332 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds620.ko 2023-07-21T21:59:01.332 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29777 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc1403.ko 2023-07-21T21:59:01.332 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc2103.ko 2023-07-21T21:59:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc6w201.ko 2023-07-21T21:59:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 66985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71805f.ko 2023-07-21T21:59:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 94457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71882fg.ko 2023-07-21T21:59:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f75375s.ko 2023-07-21T21:59:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fam15h_power.ko 2023-07-21T21:59:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 55433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fschmd.ko 2023-07-21T21:59:01.333 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g760a.ko 2023-07-21T21:59:01.334 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g762.ko 2023-07-21T21:59:01.334 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 46801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl518sm.ko 2023-07-21T21:59:01.334 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 45529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl520sm.ko 2023-07-21T21:59:01.334 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/hih6130.ko 2023-07-21T21:59:01.334 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-21T21:59:01.334 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5500_temp.ko 2023-07-21T21:59:01.334 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5k_amb.ko 2023-07-21T21:59:01.334 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmaem.ko 2023-07-21T21:59:01.335 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmpex.ko 2023-07-21T21:59:01.335 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina209.ko 2023-07-21T21:59:01.335 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina2xx.ko 2023-07-21T21:59:01.335 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 129217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/it87.ko 2023-07-21T21:59:01.335 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/jc42.ko 2023-07-21T21:59:01.335 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k10temp.ko 2023-07-21T21:59:01.335 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k8temp.ko 2023-07-21T21:59:01.335 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lineage-pem.ko 2023-07-21T21:59:01.336 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 48601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm63.ko 2023-07-21T21:59:01.336 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16761 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm73.ko 2023-07-21T21:59:01.336 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36777 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm75.ko 2023-07-21T21:59:01.336 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm77.ko 2023-07-21T21:59:01.336 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm78.ko 2023-07-21T21:59:01.336 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm80.ko 2023-07-21T21:59:01.336 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm83.ko 2023-07-21T21:59:01.337 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 72833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm85.ko 2023-07-21T21:59:01.337 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 46153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm87.ko 2023-07-21T21:59:01.337 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm90.ko 2023-07-21T21:59:01.337 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm92.ko 2023-07-21T21:59:01.337 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 108841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm93.ko 2023-07-21T21:59:01.337 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95234.ko 2023-07-21T21:59:01.337 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95241.ko 2023-07-21T21:59:01.338 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95245.ko 2023-07-21T21:59:01.338 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc2945.ko 2023-07-21T21:59:01.338 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4151.ko 2023-07-21T21:59:01.338 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4215.ko 2023-07-21T21:59:01.338 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4222.ko 2023-07-21T21:59:01.338 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4245.ko 2023-07-21T21:59:01.338 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4260.ko 2023-07-21T21:59:01.338 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4261.ko 2023-07-21T21:59:01.339 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max16065.ko 2023-07-21T21:59:01.339 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1619.ko 2023-07-21T21:59:01.339 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24353 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1668.ko 2023-07-21T21:59:01.339 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max197.ko 2023-07-21T21:59:01.339 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6639.ko 2023-07-21T21:59:01.339 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6650.ko 2023-07-21T21:59:01.339 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35777 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6697.ko 2023-07-21T21:59:01.339 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/mc13783-adc.ko 2023-07-21T21:59:01.340 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/mcp3021.ko 2023-07-21T21:59:01.340 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-07-21T21:59:01.340 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6683.ko 2023-07-21T21:59:01.340 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 116737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775-core.ko 2023-07-21T21:59:01.340 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 60705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775.ko 2023-07-21T21:59:01.340 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 59737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct7802.ko 2023-07-21T21:59:01.340 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 82337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87360.ko 2023-07-21T21:59:01.341 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 54433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87427.ko 2023-07-21T21:59:01.341 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pcf8591.ko 2023-07-21T21:59:01.341 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ 2023-07-21T21:59:01.341 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21353 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-21T21:59:01.341 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-21T21:59:01.341 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-21T21:59:01.341 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-21T21:59:01.341 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-21T21:59:01.342 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-21T21:59:01.342 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-21T21:59:01.342 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 81841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-21T21:59:01.342 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-21T21:59:01.342 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-21T21:59:01.342 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-21T21:59:01.342 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-21T21:59:01.343 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/powr1220.ko 2023-07-21T21:59:01.343 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5627.ko 2023-07-21T21:59:01.343 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5636.ko 2023-07-21T21:59:01.343 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-21T21:59:01.343 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht15.ko 2023-07-21T21:59:01.343 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht21.ko 2023-07-21T21:59:01.343 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/shtc1.ko 2023-07-21T21:59:01.343 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sis5595.ko 2023-07-21T21:59:01.344 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smm665.ko 2023-07-21T21:59:01.344 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47b397.ko 2023-07-21T21:59:01.344 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m1.ko 2023-07-21T21:59:01.344 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m192.ko 2023-07-21T21:59:01.344 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/thmc50.ko 2023-07-21T21:59:01.344 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp102.ko 2023-07-21T21:59:01.344 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp103.ko 2023-07-21T21:59:01.345 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp401.ko 2023-07-21T21:59:01.345 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp421.ko 2023-07-21T21:59:01.345 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via-cputemp.ko 2023-07-21T21:59:01.345 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via686a.ko 2023-07-21T21:59:01.345 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 52457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt1211.ko 2023-07-21T21:59:01.345 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt8231.ko 2023-07-21T21:59:01.345 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 57513 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627ehf.ko 2023-07-21T21:59:01.345 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 78873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627hf.ko 2023-07-21T21:59:01.346 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 71345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83781d.ko 2023-07-21T21:59:01.346 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 63289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83791d.ko 2023-07-21T21:59:01.346 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 71321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83792d.ko 2023-07-21T21:59:01.346 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 101457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83793.ko 2023-07-21T21:59:01.346 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 119505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83795.ko 2023-07-21T21:59:01.346 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l785ts.ko 2023-07-21T21:59:01.346 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l786ng.ko 2023-07-21T21:59:01.347 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-07-21T21:59:01.347 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-07-21T21:59:01.347 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/ 2023-07-21T21:59:01.347 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/ 2023-07-21T21:59:01.347 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-21T21:59:01.347 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-21T21:59:01.347 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/ 2023-07-21T21:59:01.348 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-07-21T21:59:01.348 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-07-21T21:59:01.348 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27777 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-07-21T21:59:01.348 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-21T21:59:01.348 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-21T21:59:01.348 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-21T21:59:01.348 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-07-21T21:59:01.348 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 6929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-21T21:59:01.349 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-07-21T21:59:01.349 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 48553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-21T21:59:01.349 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23905 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-21T21:59:01.349 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-21T21:59:01.349 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-21T21:59:01.349 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-07-21T21:59:01.349 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-07-21T21:59:01.350 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 62729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-21T21:59:01.350 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-21T21:59:01.350 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-21T21:59:01.350 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17369 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-07-21T21:59:01.350 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-21T21:59:01.350 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-21T21:59:01.350 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-07-21T21:59:01.350 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-21T21:59:01.351 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-21T21:59:01.351 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-21T21:59:01.351 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-07-21T21:59:01.351 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-21T21:59:01.351 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-21T21:59:01.351 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-07-21T21:59:01.351 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-07-21T21:59:01.351 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-21T21:59:01.352 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-07-21T21:59:01.352 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-21T21:59:01.352 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-21T21:59:01.352 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-21T21:59:01.352 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-21T21:59:01.352 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-07-21T21:59:01.352 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-mux.ko 2023-07-21T21:59:01.353 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-smbus.ko 2023-07-21T21:59:01.353 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-stub.ko 2023-07-21T21:59:01.353 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/ 2023-07-21T21:59:01.353 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-07-21T21:59:01.353 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-07-21T21:59:01.353 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-07-21T21:59:01.353 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ 2023-07-21T21:59:01.353 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ 2023-07-21T21:59:01.354 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 273641 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-21T21:59:01.354 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 876913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_core.ko 2023-07-21T21:59:01.354 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 69321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-21T21:59:01.354 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 324145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-21T21:59:01.354 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 97961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-21T21:59:01.354 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 279321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-21T21:59:01.354 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 66177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-21T21:59:01.355 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ 2023-07-21T21:59:01.355 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4/ 2023-07-21T21:59:01.355 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 492561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-21T21:59:01.355 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4/ 2023-07-21T21:59:01.355 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 419217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-21T21:59:01.355 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5/ 2023-07-21T21:59:01.355 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 739705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-21T21:59:01.355 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca/ 2023-07-21T21:59:01.356 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 296649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-21T21:59:01.356 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ocrdma/ 2023-07-21T21:59:01.356 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 153681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-07-21T21:59:01.356 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/usnic/ 2023-07-21T21:59:01.356 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 169017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-07-21T21:59:01.356 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ 2023-07-21T21:59:01.356 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib/ 2023-07-21T21:59:01.357 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 263177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-21T21:59:01.357 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser/ 2023-07-21T21:59:01.357 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 100225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-21T21:59:01.357 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert/ 2023-07-21T21:59:01.357 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 111993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-21T21:59:01.357 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp/ 2023-07-21T21:59:01.357 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 129081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-21T21:59:01.357 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt/ 2023-07-21T21:59:01.358 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 129553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-21T21:59:01.358 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/ 2023-07-21T21:59:01.358 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/evbug.ko 2023-07-21T21:59:01.358 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/ff-memless.ko 2023-07-21T21:59:01.358 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/ 2023-07-21T21:59:01.358 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-21T21:59:01.358 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-21T21:59:01.358 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/gameport.ko 2023-07-21T21:59:01.359 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/lightning.ko 2023-07-21T21:59:01.359 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/ns558.ko 2023-07-21T21:59:01.359 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/joydev.ko 2023-07-21T21:59:01.359 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/ 2023-07-21T21:59:01.359 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-07-21T21:59:01.359 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-07-21T21:59:01.359 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26905 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-07-21T21:59:01.360 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24761 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-07-21T21:59:01.360 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-21T21:59:01.360 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-07-21T21:59:01.360 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lkkbd.ko 2023-07-21T21:59:01.360 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lm8323.ko 2023-07-21T21:59:01.360 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lm8333.ko 2023-07-21T21:59:01.360 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-07-21T21:59:01.360 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-07-21T21:59:01.361 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-07-21T21:59:01.361 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-07-21T21:59:01.361 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/newtonkbd.ko 2023-07-21T21:59:01.361 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-07-21T21:59:01.361 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/qt1070.ko 2023-07-21T21:59:01.361 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/qt2160.ko 2023-07-21T21:59:01.361 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-07-21T21:59:01.362 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/stowaway.ko 2023-07-21T21:59:01.362 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/sunkbd.ko 2023-07-21T21:59:01.362 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-07-21T21:59:01.362 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-07-21T21:59:01.362 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-07-21T21:59:01.362 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/xtkbd.ko 2023-07-21T21:59:01.362 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/matrix-keymap.ko 2023-07-21T21:59:01.362 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/ 2023-07-21T21:59:01.363 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/appletouch.ko 2023-07-21T21:59:01.363 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/bcm5974.ko 2023-07-21T21:59:01.363 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 123681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/cyapatp.ko 2023-07-21T21:59:01.363 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 89449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-21T21:59:01.363 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/gpio_mouse.ko 2023-07-21T21:59:01.363 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 335849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/psmouse.ko 2023-07-21T21:59:01.363 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/sermouse.ko 2023-07-21T21:59:01.363 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-21T21:59:01.364 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-21T21:59:01.364 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-21T21:59:01.364 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4/ 2023-07-21T21:59:01.364 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 109849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-21T21:59:01.364 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ 2023-07-21T21:59:01.364 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/altera_ps2.ko 2023-07-21T21:59:01.364 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/arc_ps2.ko 2023-07-21T21:59:01.365 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ct82c710.ko 2023-07-21T21:59:01.365 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-21T21:59:01.365 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/parkbd.ko 2023-07-21T21:59:01.365 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/pcips2.ko 2023-07-21T21:59:01.365 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ps2mult.ko 2023-07-21T21:59:01.365 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/serio_raw.ko 2023-07-21T21:59:01.365 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17977 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/serport.ko 2023-07-21T21:59:01.365 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/sparse-keymap.ko 2023-07-21T21:59:01.366 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/ 2023-07-21T21:59:01.366 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd/ 2023-07-21T21:59:01.366 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-21T21:59:01.366 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/ 2023-07-21T21:59:01.366 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-88pm860x.ko 2023-07-21T21:59:01.366 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-adp5520.ko 2023-07-21T21:59:01.366 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 59753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-bd2802.ko 2023-07-21T21:59:01.367 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-blinkm.ko 2023-07-21T21:59:01.367 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-da903x.ko 2023-07-21T21:59:01.367 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-da9052.ko 2023-07-21T21:59:01.367 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-gpio.ko 2023-07-21T21:59:01.367 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3530.ko 2023-07-21T21:59:01.367 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3533.ko 2023-07-21T21:59:01.367 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19353 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm355x.ko 2023-07-21T21:59:01.367 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3642.ko 2023-07-21T21:59:01.368 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lp3944.ko 2023-07-21T21:59:01.368 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lp8788.ko 2023-07-21T21:59:01.368 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-max8997.ko 2023-07-21T21:59:01.368 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-mc13783.ko 2023-07-21T21:59:01.368 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-menf21bmc.ko 2023-07-21T21:59:01.368 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca9532.ko 2023-07-21T21:59:01.368 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca955x.ko 2023-07-21T21:59:01.369 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca963x.ko 2023-07-21T21:59:01.369 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-ss4200.ko 2023-07-21T21:59:01.369 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-tca6507.ko 2023-07-21T21:59:01.369 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-wm831x-status.ko 2023-07-21T21:59:01.369 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-wm8350.ko 2023-07-21T21:59:01.369 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ 2023-07-21T21:59:01.369 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-21T21:59:01.369 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-21T21:59:01.370 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-21T21:59:01.370 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-21T21:59:01.370 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-21T21:59:01.370 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-21T21:59:01.370 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-21T21:59:01.370 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-21T21:59:01.370 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/ 2023-07-21T21:59:01.370 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache/ 2023-07-21T21:59:01.371 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 655473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache/bcache.ko 2023-07-21T21:59:01.371 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-bio-prison.ko 2023-07-21T21:59:01.371 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 89601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-bufio.ko 2023-07-21T21:59:01.371 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache-smq.ko 2023-07-21T21:59:01.371 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 155993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache.ko 2023-07-21T21:59:01.371 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 107049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-crypt.ko 2023-07-21T21:59:01.371 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-delay.ko 2023-07-21T21:59:01.371 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-era.ko 2023-07-21T21:59:01.372 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-flakey.ko 2023-07-21T21:59:01.372 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-log-userspace.ko 2023-07-21T21:59:01.372 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-log.ko 2023-07-21T21:59:01.372 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-mirror.ko 2023-07-21T21:59:01.372 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 78017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-multipath.ko 2023-07-21T21:59:01.372 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-queue-length.ko 2023-07-21T21:59:01.372 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 70769 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-raid.ko 2023-07-21T21:59:01.373 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-region-hash.ko 2023-07-21T21:59:01.373 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-round-robin.ko 2023-07-21T21:59:01.373 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-service-time.ko 2023-07-21T21:59:01.373 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 109593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-snapshot.ko 2023-07-21T21:59:01.373 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-switch.ko 2023-07-21T21:59:01.373 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 181585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-thin-pool.ko 2023-07-21T21:59:01.373 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-verity.ko 2023-07-21T21:59:01.374 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-zero.ko 2023-07-21T21:59:01.374 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/faulty.ko 2023-07-21T21:59:01.374 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/linear.ko 2023-07-21T21:59:01.374 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/multipath.ko 2023-07-21T21:59:01.374 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data/ 2023-07-21T21:59:01.374 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 199937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-21T21:59:01.374 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid0.ko 2023-07-21T21:59:01.374 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 112609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid1.ko 2023-07-21T21:59:01.375 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 160553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid10.ko 2023-07-21T21:59:01.375 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 396153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid456.ko 2023-07-21T21:59:01.375 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/ 2023-07-21T21:59:01.375 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/ 2023-07-21T21:59:01.375 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 178113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptbase.ko 2023-07-21T21:59:01.375 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 63385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptctl.ko 2023-07-21T21:59:01.375 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptfc.ko 2023-07-21T21:59:01.376 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptlan.ko 2023-07-21T21:59:01.376 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 123305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptsas.ko 2023-07-21T21:59:01.376 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 79017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptscsih.ko 2023-07-21T21:59:01.376 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptspi.ko 2023-07-21T21:59:01.376 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/ 2023-07-21T21:59:01.376 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm800.ko 2023-07-21T21:59:01.376 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12761 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm805.ko 2023-07-21T21:59:01.376 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm80x.ko 2023-07-21T21:59:01.377 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/arizona-i2c.ko 2023-07-21T21:59:01.377 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 123721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/arizona.ko 2023-07-21T21:59:01.377 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/bcm590xx.ko 2023-07-21T21:59:01.377 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/cros_ec_dev.ko 2023-07-21T21:59:01.377 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/dln2.ko 2023-07-21T21:59:01.377 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/janz-cmodio.ko 2023-07-21T21:59:01.377 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/kempld-core.ko 2023-07-21T21:59:01.378 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lm3533-core.ko 2023-07-21T21:59:01.378 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-07-21T21:59:01.378 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13009 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lp3943.ko 2023-07-21T21:59:01.378 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 54569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_ich.ko 2023-07-21T21:59:01.378 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_sch.ko 2023-07-21T21:59:01.378 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/max8907.ko 2023-07-21T21:59:01.378 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/mc13xxx-core.ko 2023-07-21T21:59:01.378 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-07-21T21:59:01.379 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/menf21bmc.ko 2023-07-21T21:59:01.379 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633-adc.ko 2023-07-21T21:59:01.379 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633-gpio.ko 2023-07-21T21:59:01.379 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633.ko 2023-07-21T21:59:01.379 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-07-21T21:59:01.379 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/retu-mfd.ko 2023-07-21T21:59:01.379 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 80425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/si476x-core.ko 2023-07-21T21:59:01.379 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 48441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/sm501.ko 2023-07-21T21:59:01.380 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-07-21T21:59:01.380 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/tps65010.ko 2023-07-21T21:59:01.380 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/tps6507x.ko 2023-07-21T21:59:01.380 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/viperboard.ko 2023-07-21T21:59:01.380 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/vx855.ko 2023-07-21T21:59:01.380 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/wl1273-core.ko 2023-07-21T21:59:01.380 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/wm8994.ko 2023-07-21T21:59:01.381 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ 2023-07-21T21:59:01.381 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-07-21T21:59:01.381 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 48489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ad525x_dpot.ko 2023-07-21T21:59:01.381 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl/ 2023-07-21T21:59:01.381 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 46585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-21T21:59:01.381 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds9802als.ko 2023-07-21T21:59:01.381 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds990x.ko 2023-07-21T21:59:01.382 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 45593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/bh1770glc.ko 2023-07-21T21:59:01.382 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/ 2023-07-21T21:59:01.382 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-07-21T21:59:01.382 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/core.ko 2023-07-21T21:59:01.382 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710/ 2023-07-21T21:59:01.382 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710/cb710.ko 2023-07-21T21:59:01.382 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ds1682.ko 2023-07-21T21:59:01.382 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/dummy-irq.ko 2023-07-21T21:59:01.383 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/echo/ 2023-07-21T21:59:01.383 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/echo/echo.ko 2023-07-21T21:59:01.383 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/ 2023-07-21T21:59:01.383 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/at24.ko 2023-07-21T21:59:01.383 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-21T21:59:01.383 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14769 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-21T21:59:01.383 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/max6875.ko 2023-07-21T21:59:01.383 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/enclosure.ko 2023-07-21T21:59:01.384 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/genwqe/ 2023-07-21T21:59:01.384 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 152137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-07-21T21:59:01.384 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/hmc6352.ko 2023-07-21T21:59:01.384 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/hpilo.ko 2023-07-21T21:59:01.384 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ibmasm/ 2023-07-21T21:59:01.384 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 72601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-07-21T21:59:01.384 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ics932s401.ko 2023-07-21T21:59:01.385 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29003.ko 2023-07-21T21:59:01.385 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29020.ko 2023-07-21T21:59:01.385 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/ 2023-07-21T21:59:01.385 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-21T21:59:01.385 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-21T21:59:01.385 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/ 2023-07-21T21:59:01.385 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 125209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-me.ko 2023-07-21T21:59:01.385 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 56521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-txe.ko 2023-07-21T21:59:01.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 309857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei.ko 2023-07-21T21:59:01.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/phantom.ko 2023-07-21T21:59:01.386 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ti-st/ 2023-07-21T21:59:01.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 74905 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ti-st/st_drv.ko 2023-07-21T21:59:01.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_7xx1.ko 2023-07-21T21:59:01.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_core.ko 2023-07-21T21:59:01.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tsl2550.ko 2023-07-21T21:59:01.386 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 48673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_balloon.ko 2023-07-21T21:59:01.387 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci/ 2023-07-21T21:59:01.387 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 183857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-21T21:59:01.387 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ 2023-07-21T21:59:01.387 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding/ 2023-07-21T21:59:01.387 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 487801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding/bonding.ko 2023-07-21T21:59:01.387 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/ 2023-07-21T21:59:01.387 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53/ 2023-07-21T21:59:01.388 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 106009 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-21T21:59:01.388 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40281 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-21T21:59:01.388 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-21T21:59:01.388 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx/ 2023-07-21T21:59:01.388 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 452481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-21T21:59:01.388 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dummy.ko 2023-07-21T21:59:01.388 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/eql.ko 2023-07-21T21:59:01.388 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ 2023-07-21T21:59:01.389 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/ 2023-07-21T21:59:01.389 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 45785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-21T21:59:01.389 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-21T21:59:01.389 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 130489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-21T21:59:01.389 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 68785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-21T21:59:01.389 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/ 2023-07-21T21:59:01.389 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-21T21:59:01.389 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 59689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-21T21:59:01.390 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-21T21:59:01.390 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 99113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-21T21:59:01.390 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec/ 2023-07-21T21:59:01.390 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 54521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-21T21:59:01.390 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere/ 2023-07-21T21:59:01.390 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 69145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-21T21:59:01.390 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon/ 2023-07-21T21:59:01.391 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 59521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-21T21:59:01.391 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera/ 2023-07-21T21:59:01.391 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-21T21:59:01.391 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/ 2023-07-21T21:59:01.391 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 54545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-21T21:59:01.391 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-21T21:59:01.391 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 87345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-21T21:59:01.391 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/ 2023-07-21T21:59:01.392 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx/ 2023-07-21T21:59:01.392 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 97321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-21T21:59:01.392 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-07-21T21:59:01.392 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 104585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-21T21:59:01.392 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-07-21T21:59:01.392 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 90257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-21T21:59:01.392 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/ 2023-07-21T21:59:01.393 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 81505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-21T21:59:01.393 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 69713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-21T21:59:01.393 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/ 2023-07-21T21:59:01.393 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 78401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-21T21:59:01.393 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 176881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-21T21:59:01.393 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-07-21T21:59:01.393 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1422209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-21T21:59:01.393 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 128377 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-21T21:59:01.394 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet/ 2023-07-21T21:59:01.394 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 132289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-21T21:59:01.394 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 312145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-21T21:59:01.394 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/ 2023-07-21T21:59:01.394 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna/ 2023-07-21T21:59:01.394 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 323601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-21T21:59:01.394 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/ 2023-07-21T21:59:01.394 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-07-21T21:59:01.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 193433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-21T21:59:01.395 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-07-21T21:59:01.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 347641 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-21T21:59:01.395 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-07-21T21:59:01.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1044145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-21T21:59:01.395 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-07-21T21:59:01.395 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 166113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-21T21:59:01.395 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-07-21T21:59:01.396 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-21T21:59:01.396 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/ 2023-07-21T21:59:01.396 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic/ 2023-07-21T21:59:01.396 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 204329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-21T21:59:01.396 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/ 2023-07-21T21:59:01.396 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/ 2023-07-21T21:59:01.396 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 69449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-21T21:59:01.397 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 61489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-21T21:59:01.397 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 141161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-21T21:59:01.397 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-21T21:59:01.397 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 62865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-21T21:59:01.397 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-21T21:59:01.397 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/ 2023-07-21T21:59:01.397 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 60873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-21T21:59:01.397 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 62833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-21T21:59:01.398 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 45721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dnet.ko 2023-07-21T21:59:01.398 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ec_bhf.ko 2023-07-21T21:59:01.398 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/ 2023-07-21T21:59:01.398 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet/ 2023-07-21T21:59:01.398 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 281329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-21T21:59:01.398 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ethoc.ko 2023-07-21T21:59:01.398 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fealnx.ko 2023-07-21T21:59:01.398 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fujitsu/ 2023-07-21T21:59:01.399 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 45281 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-07-21T21:59:01.438 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ 2023-07-21T21:59:01.439 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 90465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-21T21:59:01.439 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000/ 2023-07-21T21:59:01.439 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 295713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-21T21:59:01.439 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e/ 2023-07-21T21:59:01.439 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 584249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-21T21:59:01.439 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k/ 2023-07-21T21:59:01.439 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 246321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-21T21:59:01.440 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e/ 2023-07-21T21:59:01.440 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 923969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-21T21:59:01.440 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf/ 2023-07-21T21:59:01.440 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 298097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-21T21:59:01.440 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb/ 2023-07-21T21:59:01.440 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 514889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-21T21:59:01.440 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf/ 2023-07-21T21:59:01.440 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 93593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-21T21:59:01.441 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-07-21T21:59:01.441 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 734297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-21T21:59:01.441 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-07-21T21:59:01.441 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 151841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-21T21:59:01.441 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 86921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/jme.ko 2023-07-21T21:59:01.441 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/ 2023-07-21T21:59:01.441 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20977 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-21T21:59:01.442 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 102385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-21T21:59:01.442 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 122681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-21T21:59:01.442 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/ 2023-07-21T21:59:01.442 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-07-21T21:59:01.442 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 727433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-21T21:59:01.442 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 280513 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-21T21:59:01.442 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-07-21T21:59:01.442 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-07-21T21:59:01.443 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1095817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-21T21:59:01.443 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ 2023-07-21T21:59:01.443 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-07-21T21:59:01.443 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-07-21T21:59:01.443 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-07-21T21:59:01.443 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 95665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-21T21:59:01.443 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/ 2023-07-21T21:59:01.444 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-07-21T21:59:01.444 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 108809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-21T21:59:01.444 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/ 2023-07-21T21:59:01.444 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 73377 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-21T21:59:01.444 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-21T21:59:01.444 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion/ 2023-07-21T21:59:01.444 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 150905 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-21T21:59:01.444 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia/ 2023-07-21T21:59:01.445 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 136785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-21T21:59:01.445 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/ 2023-07-21T21:59:01.445 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-21T21:59:01.445 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 43145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-21T21:59:01.445 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/ 2023-07-21T21:59:01.445 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-07-21T21:59:01.445 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 227113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-21T21:59:01.446 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 87081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-21T21:59:01.446 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-07-21T21:59:01.446 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 671393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-21T21:59:01.446 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc/ 2023-07-21T21:59:01.446 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 43017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-21T21:59:01.446 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/ 2023-07-21T21:59:01.446 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 67385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-21T21:59:01.446 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 83921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-21T21:59:01.447 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-21T21:59:01.447 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 190089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-21T21:59:01.447 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/ 2023-07-21T21:59:01.447 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-07-21T21:59:01.447 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 104241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-07-21T21:59:01.447 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc/ 2023-07-21T21:59:01.447 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 952881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-21T21:59:01.447 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan/ 2023-07-21T21:59:01.448 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-21T21:59:01.448 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/ 2023-07-21T21:59:01.448 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 54809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-21T21:59:01.448 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 63273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-21T21:59:01.448 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/ 2023-07-21T21:59:01.448 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 61537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-21T21:59:01.448 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 67129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-21T21:59:01.449 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 73345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-21T21:59:01.449 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 68209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-21T21:59:01.449 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/ 2023-07-21T21:59:01.449 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-07-21T21:59:01.449 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-07-21T21:59:01.449 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-21T21:59:01.449 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20769 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-07-21T21:59:01.449 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 481681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-21T21:59:01.450 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/ 2023-07-21T21:59:01.450 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 103321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-21T21:59:01.450 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 166121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-21T21:59:01.450 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 66473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-21T21:59:01.450 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 78737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-21T21:59:01.450 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti/ 2023-07-21T21:59:01.450 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-21T21:59:01.450 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti/ 2023-07-21T21:59:01.451 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 86465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-21T21:59:01.451 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/ 2023-07-21T21:59:01.451 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 80257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-21T21:59:01.451 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 83681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-21T21:59:01.451 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/ 2023-07-21T21:59:01.451 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 46241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-21T21:59:01.452 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-21T21:59:01.452 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom/ 2023-07-21T21:59:01.452 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 60041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-21T21:59:01.452 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/ 2023-07-21T21:59:01.452 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/defxx.ko 2023-07-21T21:59:01.452 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/skfp/ 2023-07-21T21:59:01.452 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 216977 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/skfp/skfp.ko 2023-07-21T21:59:01.452 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 77401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/geneve.ko 2023-07-21T21:59:01.453 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv/ 2023-07-21T21:59:01.453 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 235593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-21T21:59:01.453 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154/ 2023-07-21T21:59:01.453 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-21T21:59:01.453 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ifb.ko 2023-07-21T21:59:01.453 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan/ 2023-07-21T21:59:01.453 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 83737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-21T21:59:01.454 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 62065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvlan.ko 2023-07-21T21:59:01.454 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvtap.ko 2023-07-21T21:59:01.454 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/ 2023-07-21T21:59:01.454 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-21T21:59:01.454 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-21T21:59:01.454 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-gpio.ko 2023-07-21T21:59:01.454 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-21T21:59:01.454 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio.ko 2023-07-21T21:59:01.455 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20513 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mii.ko 2023-07-21T21:59:01.455 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/netconsole.ko 2023-07-21T21:59:01.455 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/nlmon.ko 2023-07-21T21:59:01.455 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/ 2023-07-21T21:59:01.455 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-21T21:59:01.455 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-21T21:59:01.455 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/ 2023-07-21T21:59:01.455 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/amd.ko 2023-07-21T21:59:01.456 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-21T21:59:01.456 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 43273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-21T21:59:01.456 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm87xx.ko 2023-07-21T21:59:01.456 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/broadcom.ko 2023-07-21T21:59:01.456 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/cicada.ko 2023-07-21T21:59:01.456 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/davicom.ko 2023-07-21T21:59:01.456 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/et1011c.ko 2023-07-21T21:59:01.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24905 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/icplus.ko 2023-07-21T21:59:01.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/lxt.ko 2023-07-21T21:59:01.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 78185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/marvell.ko 2023-07-21T21:59:01.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 75713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/micrel.ko 2023-07-21T21:59:01.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/national.ko 2023-07-21T21:59:01.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 97265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/phylink.ko 2023-07-21T21:59:01.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/qsemi.ko 2023-07-21T21:59:01.457 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/realtek.ko 2023-07-21T21:59:01.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/smsc.ko 2023-07-21T21:59:01.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/ste10Xp.ko 2023-07-21T21:59:01.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/vitesse.ko 2023-07-21T21:59:01.458 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/plip/ 2023-07-21T21:59:01.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 43465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/plip/plip.ko 2023-07-21T21:59:01.458 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ 2023-07-21T21:59:01.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-21T21:59:01.458 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_async.ko 2023-07-21T21:59:01.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-21T21:59:01.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-21T21:59:01.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-21T21:59:01.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppoe.ko 2023-07-21T21:59:01.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppox.ko 2023-07-21T21:59:01.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pptp.ko 2023-07-21T21:59:01.459 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/sb1000.ko 2023-07-21T21:59:01.459 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/ 2023-07-21T21:59:01.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42513 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/slip.ko 2023-07-21T21:59:01.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/sungem_phy.ko 2023-07-21T21:59:01.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 64889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/tap.ko 2023-07-21T21:59:01.460 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/ 2023-07-21T21:59:01.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 105961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team.ko 2023-07-21T21:59:01.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-21T21:59:01.460 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-21T21:59:01.461 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-21T21:59:01.461 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9641 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_random.ko 2023-07-21T21:59:01.461 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-21T21:59:01.461 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 88193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/veth.ko 2023-07-21T21:59:01.461 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3/ 2023-07-21T21:59:01.461 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 120497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-21T21:59:01.461 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan/ 2023-07-21T21:59:01.461 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 290665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan/vxlan.ko 2023-07-21T21:59:01.462 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback/ 2023-07-21T21:59:01.462 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 143801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-21T21:59:01.462 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb/ 2023-07-21T21:59:01.462 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb/ntb.ko 2023-07-21T21:59:01.462 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/ 2023-07-21T21:59:01.462 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/ 2023-07-21T21:59:01.462 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 266561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme-core.ko 2023-07-21T21:59:01.462 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 101937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme.ko 2023-07-21T21:59:01.463 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/ 2023-07-21T21:59:01.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 133817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport.ko 2023-07-21T21:59:01.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_cs.ko 2023-07-21T21:59:01.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 84337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_pc.ko 2023-07-21T21:59:01.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_serial.ko 2023-07-21T21:59:01.463 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/ 2023-07-21T21:59:01.463 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/ 2023-07-21T21:59:01.463 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25009 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-21T21:59:01.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-07-21T21:59:01.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-07-21T21:59:01.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/pci-stub.ko 2023-07-21T21:59:01.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47377 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/xen-pcifront.ko 2023-07-21T21:59:01.464 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/ 2023-07-21T21:59:01.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/i82092.ko 2023-07-21T21:59:01.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 145785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia.ko 2023-07-21T21:59:01.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 62081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia_core.ko 2023-07-21T21:59:01.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-07-21T21:59:01.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pd6729.ko 2023-07-21T21:59:01.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 112913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-21T21:59:01.465 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/ 2023-07-21T21:59:01.465 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/broadcom/ 2023-07-21T21:59:01.465 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-07-21T21:59:01.465 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/samsung/ 2023-07-21T21:59:01.466 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-07-21T21:59:01.466 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/ 2023-07-21T21:59:01.466 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel/ 2023-07-21T21:59:01.466 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 71521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-21T21:59:01.466 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/ 2023-07-21T21:59:01.466 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/ 2023-07-21T21:59:01.466 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-07-21T21:59:01.466 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec.ko 2023-07-21T21:59:01.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-07-21T21:59:01.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-07-21T21:59:01.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-07-21T21:59:01.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-07-21T21:59:01.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-07-21T21:59:01.467 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/ 2023-07-21T21:59:01.467 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 67097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-21T21:59:01.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acerhdf.ko 2023-07-21T21:59:01.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-21T21:59:01.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 59665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-21T21:59:01.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-21T21:59:01.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 106873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-21T21:59:01.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-21T21:59:01.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-21T21:59:01.468 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-21T21:59:01.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-21T21:59:01.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-21T21:59:01.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/hdaps.ko 2023-07-21T21:59:01.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/ibm_rtl.ko 2023-07-21T21:59:01.469 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/ 2023-07-21T21:59:01.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-21T21:59:01.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-07-21T21:59:01.469 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 43521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel_ips.ko 2023-07-21T21:59:01.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-21T21:59:01.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10377 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-21T21:59:01.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-21T21:59:01.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-21T21:59:01.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-21T21:59:01.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-21T21:59:01.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-21T21:59:01.470 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-21T21:59:01.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-21T21:59:01.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 57665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi.ko 2023-07-21T21:59:01.471 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/ 2023-07-21T21:59:01.471 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ 2023-07-21T21:59:01.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/88pm860x_battery.ko 2023-07-21T21:59:01.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/88pm860x_charger.ko 2023-07-21T21:59:01.471 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 55057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq2415x_charger.ko 2023-07-21T21:59:01.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq24190_charger.ko 2023-07-21T21:59:01.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq24735-charger.ko 2023-07-21T21:59:01.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-07-21T21:59:01.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/da9030_battery.ko 2023-07-21T21:59:01.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/da9052-battery.ko 2023-07-21T21:59:01.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29281 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2760_battery.ko 2023-07-21T21:59:01.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2780_battery.ko 2023-07-21T21:59:01.472 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23353 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2781_battery.ko 2023-07-21T21:59:01.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2782_battery.ko 2023-07-21T21:59:01.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20353 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/gpio-charger.ko 2023-07-21T21:59:01.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/isp1704_charger.ko 2023-07-21T21:59:01.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/lp8727_charger.ko 2023-07-21T21:59:01.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max14577_charger.ko 2023-07-21T21:59:01.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max17040_battery.ko 2023-07-21T21:59:01.473 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max17042_battery.ko 2023-07-21T21:59:01.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max8903_charger.ko 2023-07-21T21:59:01.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max8925_power.ko 2023-07-21T21:59:01.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/pcf50633-charger.ko 2023-07-21T21:59:01.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38009 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/sbs-battery.ko 2023-07-21T21:59:01.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/test_power.ko 2023-07-21T21:59:01.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/tps65090-charger.ko 2023-07-21T21:59:01.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm831x_backup.ko 2023-07-21T21:59:01.474 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm831x_power.ko 2023-07-21T21:59:01.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm8350_power.ko 2023-07-21T21:59:01.475 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/ 2023-07-21T21:59:01.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 57737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-21T21:59:01.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-21T21:59:01.475 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/ 2023-07-21T21:59:01.475 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/ 2023-07-21T21:59:01.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-21T21:59:01.475 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-21T21:59:01.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps_parport.ko 2023-07-21T21:59:01.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/pps_core.ko 2023-07-21T21:59:01.476 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ 2023-07-21T21:59:01.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 66385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp.ko 2023-07-21T21:59:01.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp_kvm.ko 2023-07-21T21:59:01.476 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/ 2023-07-21T21:59:01.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-88pm80x.ko 2023-07-21T21:59:01.476 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-88pm860x.ko 2023-07-21T21:59:01.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-21T21:59:01.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-21T21:59:01.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9052.ko 2023-07-21T21:59:01.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9055.ko 2023-07-21T21:59:01.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9063.ko 2023-07-21T21:59:01.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-21T21:59:01.477 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 68577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-21T21:59:01.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-21T21:59:01.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-21T21:59:01.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-21T21:59:01.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-21T21:59:01.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13369 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-21T21:59:01.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-21T21:59:01.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-21T21:59:01.478 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-em3027.ko 2023-07-21T21:59:01.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-21T21:59:01.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-21T21:59:01.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-21T21:59:01.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-lp8788.ko 2023-07-21T21:59:01.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-21T21:59:01.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-21T21:59:01.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-21T21:59:01.479 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t86.ko 2023-07-21T21:59:01.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11633 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max6900.ko 2023-07-21T21:59:01.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8907.ko 2023-07-21T21:59:01.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8925.ko 2023-07-21T21:59:01.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8997.ko 2023-07-21T21:59:01.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8998.ko 2023-07-21T21:59:01.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18513 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-07-21T21:59:01.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-21T21:59:01.480 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-palmas.ko 2023-07-21T21:59:01.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-21T21:59:01.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17977 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf50633.ko 2023-07-21T21:59:01.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-21T21:59:01.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-21T21:59:01.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-21T21:59:01.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-21T21:59:01.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rc5t583.ko 2023-07-21T21:59:01.481 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-21T21:59:01.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-21T21:59:01.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-21T21:59:01.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-21T21:59:01.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-21T21:59:01.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-s35390a.ko 2023-07-21T21:59:01.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-21T21:59:01.482 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-tps6586x.ko 2023-07-21T21:59:01.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-tps65910.ko 2023-07-21T21:59:01.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-wm831x.ko 2023-07-21T21:59:01.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-wm8350.ko 2023-07-21T21:59:01.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-x1205.ko 2023-07-21T21:59:01.483 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ 2023-07-21T21:59:01.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 77617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-9xxx.ko 2023-07-21T21:59:01.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 57665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-sas.ko 2023-07-21T21:59:01.483 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 55169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-xxxx.ko 2023-07-21T21:59:01.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 135169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/BusLogic.ko 2023-07-21T21:59:01.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/a100u2w.ko 2023-07-21T21:59:01.484 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid/ 2023-07-21T21:59:01.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 272353 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-21T21:59:01.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 100617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/advansys.ko 2023-07-21T21:59:01.484 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/ 2023-07-21T21:59:01.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 356265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-21T21:59:01.484 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 295801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-21T21:59:01.485 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic94xx/ 2023-07-21T21:59:01.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 189321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-07-21T21:59:01.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/am53c974.ko 2023-07-21T21:59:01.485 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr/ 2023-07-21T21:59:01.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 106569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-21T21:59:01.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/atp870u.ko 2023-07-21T21:59:01.485 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi/ 2023-07-21T21:59:01.485 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 246897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-21T21:59:01.486 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa/ 2023-07-21T21:59:01.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1172185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa/bfa.ko 2023-07-21T21:59:01.486 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc/ 2023-07-21T21:59:01.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 237169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-21T21:59:01.486 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i/ 2023-07-21T21:59:01.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 115393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-21T21:59:01.486 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ch.ko 2023-07-21T21:59:01.487 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor/ 2023-07-21T21:59:01.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 308889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-21T21:59:01.487 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/ 2023-07-21T21:59:01.487 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-07-21T21:59:01.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 76193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-21T21:59:01.487 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-07-21T21:59:01.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 101449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-21T21:59:01.487 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 146785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-21T21:59:01.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 75529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dc395x.ko 2023-07-21T21:59:01.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dmx3191d.ko 2023-07-21T21:59:01.488 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r/ 2023-07-21T21:59:01.488 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 212401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-21T21:59:01.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 60489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esp_scsi.ko 2023-07-21T21:59:01.494 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/ 2023-07-21T21:59:01.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 78289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-21T21:59:01.494 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 158193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-21T21:59:01.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fdomain.ko 2023-07-21T21:59:01.495 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic/ 2023-07-21T21:59:01.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 261913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic/fnic.ko 2023-07-21T21:59:01.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 201793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hpsa.ko 2023-07-21T21:59:01.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hptiop.ko 2023-07-21T21:59:01.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hv_storvsc.ko 2023-07-21T21:59:01.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/imm.ko 2023-07-21T21:59:01.495 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/initio.ko 2023-07-21T21:59:01.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 266521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ipr.ko 2023-07-21T21:59:01.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 101881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ips.ko 2023-07-21T21:59:01.496 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci/ 2023-07-21T21:59:01.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 317249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci/isci.ko 2023-07-21T21:59:01.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-21T21:59:01.496 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 52897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-21T21:59:01.496 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc/ 2023-07-21T21:59:01.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 314961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc/libfc.ko 2023-07-21T21:59:01.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 145569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi.ko 2023-07-21T21:59:01.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-21T21:59:01.497 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas/ 2023-07-21T21:59:01.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 217209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas/libsas.ko 2023-07-21T21:59:01.497 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc/ 2023-07-21T21:59:01.497 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 2192449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-21T21:59:01.497 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/ 2023-07-21T21:59:01.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 73545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-21T21:59:01.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-21T21:59:01.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 310729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-21T21:59:01.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 84697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid.ko 2023-07-21T21:59:01.498 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas/ 2023-07-21T21:59:01.498 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 659577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-21T21:59:01.498 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas/ 2023-07-21T21:59:01.499 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 119929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-21T21:59:01.499 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 78153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvumi.ko 2023-07-21T21:59:01.499 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/ 2023-07-21T21:59:01.499 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 81601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-07-21T21:59:01.499 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-07-21T21:59:01.499 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-07-21T21:59:01.499 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-07-21T21:59:01.500 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001/ 2023-07-21T21:59:01.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 364257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-21T21:59:01.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 123489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pmcraid.ko 2023-07-21T21:59:01.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ppa.ko 2023-07-21T21:59:01.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 55345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla1280.ko 2023-07-21T21:59:01.500 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/ 2023-07-21T21:59:01.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1860025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-21T21:59:01.500 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 85313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-21T21:59:01.501 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx/ 2023-07-21T21:59:01.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 558865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-21T21:59:01.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qlogicfas408.ko 2023-07-21T21:59:01.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/raid_class.ko 2023-07-21T21:59:01.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 238801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_debug.ko 2023-07-21T21:59:01.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 173921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-21T21:59:01.501 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 278865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-21T21:59:01.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 97705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-21T21:59:01.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 73881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-21T21:59:01.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-21T21:59:01.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ses.ko 2023-07-21T21:59:01.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 115849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/st.ko 2023-07-21T21:59:01.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 46825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/stex.ko 2023-07-21T21:59:01.502 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2/ 2023-07-21T21:59:01.502 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 162121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-21T21:59:01.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/virtio_scsi.ko 2023-07-21T21:59:01.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-21T21:59:01.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/wd719x.ko 2023-07-21T21:59:01.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/xen-scsifront.ko 2023-07-21T21:59:01.503 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb/ 2023-07-21T21:59:01.503 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 129417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb/ssb.ko 2023-07-21T21:59:01.503 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/ 2023-07-21T21:59:01.504 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi/ 2023-07-21T21:59:01.504 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 739089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-21T21:59:01.504 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback/ 2023-07-21T21:59:01.504 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-21T21:59:01.504 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_file.ko 2023-07-21T21:59:01.504 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_iblock.ko 2023-07-21T21:59:01.504 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 931721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_mod.ko 2023-07-21T21:59:01.505 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_pscsi.ko 2023-07-21T21:59:01.505 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 122545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_user.ko 2023-07-21T21:59:01.505 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc/ 2023-07-21T21:59:01.505 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 75641 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-21T21:59:01.505 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/ 2023-07-21T21:59:01.505 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/ 2023-07-21T21:59:01.505 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/ 2023-07-21T21:59:01.505 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-21T21:59:01.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-21T21:59:01.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-21T21:59:01.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-21T21:59:01.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-21T21:59:01.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-21T21:59:01.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-21T21:59:01.506 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20281 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-21T21:59:01.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-21T21:59:01.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-21T21:59:01.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-21T21:59:01.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-21T21:59:01.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-07-21T21:59:01.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-21T21:59:01.507 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-21T21:59:01.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-21T21:59:01.508 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ 2023-07-21T21:59:01.508 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless/ 2023-07-21T21:59:01.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 78073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-21T21:59:01.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 57881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/moxa.ko 2023-07-21T21:59:01.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 50793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/mxser.ko 2023-07-21T21:59:01.508 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 107545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_gsm.ko 2023-07-21T21:59:01.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_hdlc.ko 2023-07-21T21:59:01.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 68137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/nozomi.ko 2023-07-21T21:59:01.509 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/ 2023-07-21T21:59:01.509 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/ 2023-07-21T21:59:01.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-07-21T21:59:01.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 59497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-21T21:59:01.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-07-21T21:59:01.509 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/altera_uart.ko 2023-07-21T21:59:01.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/arc_uart.ko 2023-07-21T21:59:01.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 72193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-07-21T21:59:01.510 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm/ 2023-07-21T21:59:01.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 103017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-21T21:59:01.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/rp2.ko 2023-07-21T21:59:01.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 52073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/sc16is7xx.ko 2023-07-21T21:59:01.510 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 100185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/synclink_gt.ko 2023-07-21T21:59:01.511 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/ 2023-07-21T21:59:01.511 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core/ 2023-07-21T21:59:01.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 536617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-21T21:59:01.511 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ 2023-07-21T21:59:01.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28377 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-21T21:59:01.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-07-21T21:59:01.511 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/ 2023-07-21T21:59:01.511 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio.ko 2023-07-21T21:59:01.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_aec.ko 2023-07-21T21:59:01.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11281 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_cif.ko 2023-07-21T21:59:01.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_dmem_genirq.ko 2023-07-21T21:59:01.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_mf624.ko 2023-07-21T21:59:01.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_netx.ko 2023-07-21T21:59:01.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_pci_generic.ko 2023-07-21T21:59:01.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-07-21T21:59:01.512 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13633 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_sercos3.ko 2023-07-21T21:59:01.513 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/ 2023-07-21T21:59:01.513 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/c67x00/ 2023-07-21T21:59:01.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 73273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/c67x00/c67x00.ko 2023-07-21T21:59:01.513 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ 2023-07-21T21:59:01.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 143785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-07-21T21:59:01.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-07-21T21:59:01.513 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-07-21T21:59:01.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-07-21T21:59:01.514 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/ 2023-07-21T21:59:01.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 85457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-acm.ko 2023-07-21T21:59:01.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-21T21:59:01.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usblp.ko 2023-07-21T21:59:01.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 89833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usbtmc.ko 2023-07-21T21:59:01.514 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/common/ 2023-07-21T21:59:01.514 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/common/ulpi.ko 2023-07-21T21:59:01.515 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc2/ 2023-07-21T21:59:01.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-07-21T21:59:01.515 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/ 2023-07-21T21:59:01.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-07-21T21:59:01.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-07-21T21:59:01.515 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 445801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3.ko 2023-07-21T21:59:01.515 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/ 2023-07-21T21:59:01.515 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/ 2023-07-21T21:59:01.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 60089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/u_ether.ko 2023-07-21T21:59:01.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/u_serial.ko 2023-07-21T21:59:01.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-07-21T21:59:01.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-07-21T21:59:01.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-07-21T21:59:01.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-07-21T21:59:01.516 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 92377 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-07-21T21:59:01.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-07-21T21:59:01.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 122073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-07-21T21:59:01.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 57921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-07-21T21:59:01.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-07-21T21:59:01.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-07-21T21:59:01.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 57705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-07-21T21:59:01.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 85841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-07-21T21:59:01.517 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-07-21T21:59:01.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 58433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-07-21T21:59:01.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 67337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-07-21T21:59:01.518 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/ 2023-07-21T21:59:01.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-07-21T21:59:01.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-07-21T21:59:01.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-07-21T21:59:01.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-07-21T21:59:01.518 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-07-21T21:59:01.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-07-21T21:59:01.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-07-21T21:59:01.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16977 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-07-21T21:59:01.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-07-21T21:59:01.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-07-21T21:59:01.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-07-21T21:59:01.519 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-07-21T21:59:01.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 62153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-07-21T21:59:01.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-07-21T21:59:01.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 161233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/libcomposite.ko 2023-07-21T21:59:01.520 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/ 2023-07-21T21:59:01.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-07-21T21:59:01.520 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/bdc/ 2023-07-21T21:59:01.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 157665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-07-21T21:59:01.520 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-07-21T21:59:01.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 52993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-07-21T21:59:01.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 69689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-07-21T21:59:01.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 56009 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-07-21T21:59:01.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 76033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/net2272.ko 2023-07-21T21:59:01.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 75057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/net2280.ko 2023-07-21T21:59:01.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 73153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-07-21T21:59:01.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 65793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-07-21T21:59:01.521 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 66073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-07-21T21:59:01.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 81489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-07-21T21:59:01.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 156033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-07-21T21:59:01.522 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/ 2023-07-21T21:59:01.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/bcma-hcd.ko 2023-07-21T21:59:01.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 80097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/isp116x-hcd.ko 2023-07-21T21:59:01.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 87337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-07-21T21:59:01.522 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 78849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-07-21T21:59:01.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-21T21:59:01.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/sl811_cs.ko 2023-07-21T21:59:01.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/ssb-hcd.ko 2023-07-21T21:59:01.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-07-21T21:59:01.523 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/ 2023-07-21T21:59:01.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/mdc800.ko 2023-07-21T21:59:01.523 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/microtek.ko 2023-07-21T21:59:01.523 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ 2023-07-21T21:59:01.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/adutux.ko 2023-07-21T21:59:01.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/appledisplay.ko 2023-07-21T21:59:01.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-07-21T21:59:01.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/cytherm.ko 2023-07-21T21:59:01.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ehset.ko 2023-07-21T21:59:01.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi26.ko 2023-07-21T21:59:01.524 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi62.ko 2023-07-21T21:59:01.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ezusb.ko 2023-07-21T21:59:01.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/idmouse.ko 2023-07-21T21:59:01.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/iowarrior.ko 2023-07-21T21:59:01.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-21T21:59:01.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ldusb.ko 2023-07-21T21:59:01.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/legousbtower.ko 2023-07-21T21:59:01.525 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/lvstest.ko 2023-07-21T21:59:01.526 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga/ 2023-07-21T21:59:01.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 64841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-21T21:59:01.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-21T21:59:01.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usb3503.ko 2023-07-21T21:59:01.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usblcd.ko 2023-07-21T21:59:01.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-21T21:59:01.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 70873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usbtest.ko 2023-07-21T21:59:01.526 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/uss720.ko 2023-07-21T21:59:01.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/yurex.ko 2023-07-21T21:59:01.527 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/mon/ 2023-07-21T21:59:01.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 73185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/mon/usbmon.ko 2023-07-21T21:59:01.527 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/musb/ 2023-07-21T21:59:01.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 301521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/musb/musb_hdrc.ko 2023-07-21T21:59:01.527 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/ 2023-07-21T21:59:01.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-generic.ko 2023-07-21T21:59:01.527 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-07-21T21:59:01.528 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-isp1301.ko 2023-07-21T21:59:01.528 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-tahvo.ko 2023-07-21T21:59:01.528 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ 2023-07-21T21:59:01.528 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/aircable.ko 2023-07-21T21:59:01.528 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ark3116.ko 2023-07-21T21:59:01.528 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-21T21:59:01.528 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ch341.ko 2023-07-21T21:59:01.529 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 70209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cp210x.ko 2023-07-21T21:59:01.529 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cyberjack.ko 2023-07-21T21:59:01.529 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 57937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-21T21:59:01.529 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-21T21:59:01.529 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/empeg.ko 2023-07-21T21:59:01.529 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 43897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/f81232.ko 2023-07-21T21:59:01.529 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 175145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-21T21:59:01.529 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 52713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-21T21:59:01.530 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 137105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-21T21:59:01.530 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 124673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_ti.ko 2023-07-21T21:59:01.530 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 67769 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipaq.ko 2023-07-21T21:59:01.530 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipw.ko 2023-07-21T21:59:01.530 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ir-usb.ko 2023-07-21T21:59:01.530 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 57937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-21T21:59:01.530 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 107417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan.ko 2023-07-21T21:59:01.530 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-21T21:59:01.531 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-21T21:59:01.531 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-21T21:59:01.531 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mct_u232.ko 2023-07-21T21:59:01.531 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/metro-usb.ko 2023-07-21T21:59:01.531 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 66489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7720.ko 2023-07-21T21:59:01.531 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 78113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7840.ko 2023-07-21T21:59:01.531 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 56593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mxuport.ko 2023-07-21T21:59:01.531 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/navman.ko 2023-07-21T21:59:01.532 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/omninet.ko 2023-07-21T21:59:01.532 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24281 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/opticon.ko 2023-07-21T21:59:01.532 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 189729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/option.ko 2023-07-21T21:59:01.532 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38905 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/oti6858.ko 2023-07-21T21:59:01.532 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 54313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/pl2303.ko 2023-07-21T21:59:01.532 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcaux.ko 2023-07-21T21:59:01.532 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcserial.ko 2023-07-21T21:59:01.533 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/quatech2.ko 2023-07-21T21:59:01.533 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/safe_serial.ko 2023-07-21T21:59:01.533 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 51297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/sierra.ko 2023-07-21T21:59:01.533 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-21T21:59:01.533 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ssu100.ko 2023-07-21T21:59:01.533 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/symbolserial.ko 2023-07-21T21:59:01.533 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 61337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-21T21:59:01.533 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-21T21:59:01.534 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_debug.ko 2023-07-21T21:59:01.534 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-21T21:59:01.534 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 125505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usbserial.ko 2023-07-21T21:59:01.534 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/visor.ko 2023-07-21T21:59:01.534 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/whiteheat.ko 2023-07-21T21:59:01.534 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/wishbone-serial.ko 2023-07-21T21:59:01.534 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-21T21:59:01.534 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ 2023-07-21T21:59:01.535 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 52913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/uas.ko 2023-07-21T21:59:01.535 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-21T21:59:01.535 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-21T21:59:01.535 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-21T21:59:01.535 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-21T21:59:01.535 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-21T21:59:01.535 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19769 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-21T21:59:01.536 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-21T21:59:01.536 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-karma.ko 2023-07-21T21:59:01.536 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-21T21:59:01.536 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-21T21:59:01.536 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28905 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-21T21:59:01.536 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-21T21:59:01.536 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-21T21:59:01.536 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 180017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/usb-storage.ko 2023-07-21T21:59:01.537 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/ 2023-07-21T21:59:01.537 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 67457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-21T21:59:01.537 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 71345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-21T21:59:01.537 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 105401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-21T21:59:01.537 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/ 2023-07-21T21:59:01.537 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/ 2023-07-21T21:59:01.537 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 153697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-21T21:59:01.537 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-21T21:59:01.538 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 100569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio.ko 2023-07-21T21:59:01.538 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 75137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-21T21:59:01.538 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/ 2023-07-21T21:59:01.538 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 113889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost.ko 2023-07-21T21:59:01.538 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-21T21:59:01.538 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 58137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_net.ko 2023-07-21T21:59:01.538 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 86521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_scsi.ko 2023-07-21T21:59:01.538 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/ 2023-07-21T21:59:01.539 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/ 2023-07-21T21:59:01.539 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-07-21T21:59:01.539 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/aat2870_bl.ko 2023-07-21T21:59:01.539 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp5520_bl.ko 2023-07-21T21:59:01.539 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp8860_bl.ko 2023-07-21T21:59:01.539 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp8870_bl.ko 2023-07-21T21:59:01.539 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/apple_bl.ko 2023-07-21T21:59:01.540 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16777 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/as3711_bl.ko 2023-07-21T21:59:01.540 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/bd6107.ko 2023-07-21T21:59:01.540 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/da903x_bl.ko 2023-07-21T21:59:01.540 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/da9052_bl.ko 2023-07-21T21:59:01.540 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/gpio_backlight.ko 2023-07-21T21:59:01.540 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14769 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/kb3886_bl.ko 2023-07-21T21:59:01.541 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lcd.ko 2023-07-21T21:59:01.541 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lm3533_bl.ko 2023-07-21T21:59:01.541 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lm3639_bl.ko 2023-07-21T21:59:01.541 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lv5207lp.ko 2023-07-21T21:59:01.541 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/max8925_bl.ko 2023-07-21T21:59:01.541 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/pandora_bl.ko 2023-07-21T21:59:01.541 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-07-21T21:59:01.542 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-21T21:59:01.542 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/wm831x_bl.ko 2023-07-21T21:59:01.542 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/ 2023-07-21T21:59:01.542 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ 2023-07-21T21:59:01.542 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2482.ko 2023-07-21T21:59:01.542 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2490.ko 2023-07-21T21:59:01.542 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/matrox_w1.ko 2023-07-21T21:59:01.542 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/w1-gpio.ko 2023-07-21T21:59:01.543 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/ 2023-07-21T21:59:01.543 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-21T21:59:01.543 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-21T21:59:01.543 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-21T21:59:01.543 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-21T21:59:01.543 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-21T21:59:01.543 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-21T21:59:01.543 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-21T21:59:01.544 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-21T21:59:01.544 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-21T21:59:01.544 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-21T21:59:01.544 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 56425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-21T21:59:01.544 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 102657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/wire.ko 2023-07-21T21:59:01.544 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ 2023-07-21T21:59:01.544 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/acquirewdt.ko 2023-07-21T21:59:01.545 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19977 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/advantechwdt.ko 2023-07-21T21:59:01.545 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-21T21:59:01.545 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-21T21:59:01.545 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/cpu5wdt.ko 2023-07-21T21:59:01.545 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9052_wdt.ko 2023-07-21T21:59:01.545 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12777 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9055_wdt.ko 2023-07-21T21:59:01.545 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9063_wdt.ko 2023-07-21T21:59:01.545 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/dw_wdt.ko 2023-07-21T21:59:01.546 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/eurotechwdt.ko 2023-07-21T21:59:01.546 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-21T21:59:01.546 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/hpwdt.ko 2023-07-21T21:59:01.546 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/i6300esb.ko 2023-07-21T21:59:01.546 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-21T21:59:01.546 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-21T21:59:01.546 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ib700wdt.ko 2023-07-21T21:59:01.546 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ibmasr.ko 2023-07-21T21:59:01.547 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-21T21:59:01.547 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-21T21:59:01.547 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it87_wdt.ko 2023-07-21T21:59:01.547 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/kempld_wdt.ko 2023-07-21T21:59:01.547 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/machzwd.ko 2023-07-21T21:59:01.547 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/mena21_wdt.ko 2023-07-21T21:59:01.547 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-07-21T21:59:01.548 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/nv_tco.ko 2023-07-21T21:59:01.548 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-07-21T21:59:01.548 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pc87413_wdt.ko 2023-07-21T21:59:01.548 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-21T21:59:01.548 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-21T21:59:01.548 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/retu_wdt.ko 2023-07-21T21:59:01.548 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-07-21T21:59:01.548 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-07-21T21:59:01.549 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-21T21:59:01.549 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sc1200wdt.ko 2023-07-21T21:59:01.549 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-21T21:59:01.549 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-07-21T21:59:01.549 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/softdog.ko 2023-07-21T21:59:01.549 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-21T21:59:01.549 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/twl4030_wdt.ko 2023-07-21T21:59:01.550 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/via_wdt.ko 2023-07-21T21:59:01.550 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-21T21:59:01.550 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-21T21:59:01.550 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-21T21:59:01.550 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wafer5823wdt.ko 2023-07-21T21:59:01.550 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wdt_pci.ko 2023-07-21T21:59:01.550 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wm831x_wdt.ko 2023-07-21T21:59:01.550 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wm8350_wdt.ko 2023-07-21T21:59:01.551 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/xen_wdt.ko 2023-07-21T21:59:01.551 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/ 2023-07-21T21:59:01.551 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-evtchn.ko 2023-07-21T21:59:01.551 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntalloc.ko 2023-07-21T21:59:01.551 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntdev.ko 2023-07-21T21:59:01.551 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback/ 2023-07-21T21:59:01.551 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 176417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-21T21:59:01.551 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-privcmd.ko 2023-07-21T21:59:01.552 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 71321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-scsiback.ko 2023-07-21T21:59:01.552 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs/ 2023-07-21T21:59:01.552 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-21T21:59:01.552 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ 2023-07-21T21:59:01.552 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p/ 2023-07-21T21:59:01.552 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 165697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p/9p.ko 2023-07-21T21:59:01.552 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/adfs/ 2023-07-21T21:59:01.552 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 60881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/adfs/adfs.ko 2023-07-21T21:59:01.553 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs/ 2023-07-21T21:59:01.553 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 162617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs/affs.ko 2023-07-21T21:59:01.553 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/afs/ 2023-07-21T21:59:01.553 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 931937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/afs/kafs.ko 2023-07-21T21:59:01.553 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/autofs/ 2023-07-21T21:59:01.553 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 100937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/autofs/autofs4.ko 2023-07-21T21:59:01.553 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs/ 2023-07-21T21:59:01.553 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 64481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs/befs.ko 2023-07-21T21:59:01.554 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/bfs/ 2023-07-21T21:59:01.554 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/bfs/bfs.ko 2023-07-21T21:59:01.554 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/binfmt_misc.ko 2023-07-21T21:59:01.554 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs/ 2023-07-21T21:59:01.554 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 3468681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs/btrfs.ko 2023-07-21T21:59:01.554 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles/ 2023-07-21T21:59:01.554 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 305745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles/cachefiles.ko 2023-07-21T21:59:01.584 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph/ 2023-07-21T21:59:01.584 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1312545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph/ceph.ko 2023-07-21T21:59:01.584 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda/ 2023-07-21T21:59:01.584 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 100321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda/coda.ko 2023-07-21T21:59:01.584 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/configfs/ 2023-07-21T21:59:01.584 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 108073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/configfs/configfs.ko 2023-07-21T21:59:01.585 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs/ 2023-07-21T21:59:01.585 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs/cramfs.ko 2023-07-21T21:59:01.585 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm/ 2023-07-21T21:59:01.585 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 633825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm/dlm.ko 2023-07-21T21:59:01.585 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/efs/ 2023-07-21T21:59:01.585 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/efs/efs.ko 2023-07-21T21:59:01.585 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs/ 2023-07-21T21:59:01.586 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1500513 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs/f2fs.ko 2023-07-21T21:59:01.586 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/ 2023-07-21T21:59:01.586 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/msdos.ko 2023-07-21T21:59:01.586 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/freevxfs/ 2023-07-21T21:59:01.586 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/freevxfs/freevxfs.ko 2023-07-21T21:59:01.586 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache/ 2023-07-21T21:59:01.586 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 226505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache/fscache.ko 2023-07-21T21:59:01.586 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/ 2023-07-21T21:59:01.587 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/cuse.ko 2023-07-21T21:59:01.587 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2/ 2023-07-21T21:59:01.587 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1226249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2/gfs2.ko 2023-07-21T21:59:01.587 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs/ 2023-07-21T21:59:01.587 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 141241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs/hfs.ko 2023-07-21T21:59:01.587 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus/ 2023-07-21T21:59:01.587 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 221553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus/hfsplus.ko 2023-07-21T21:59:01.587 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hpfs/ 2023-07-21T21:59:01.588 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 193577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hpfs/hpfs.ko 2023-07-21T21:59:01.588 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs/ 2023-07-21T21:59:01.588 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 74393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs/isofs.ko 2023-07-21T21:59:01.588 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs/ 2023-07-21T21:59:01.588 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 420745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs/jfs.ko 2023-07-21T21:59:01.588 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd/ 2023-07-21T21:59:01.588 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 279041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd/lockd.ko 2023-07-21T21:59:01.588 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix/ 2023-07-21T21:59:01.589 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 87897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix/minix.ko 2023-07-21T21:59:01.589 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs/ 2023-07-21T21:59:01.589 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 124697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs/netfs.ko 2023-07-21T21:59:01.589 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/ 2023-07-21T21:59:01.589 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout/ 2023-07-21T21:59:01.589 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 81521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-21T21:59:01.589 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout/ 2023-07-21T21:59:01.590 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 59425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-21T21:59:01.590 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout/ 2023-07-21T21:59:01.590 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 117705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-21T21:59:01.590 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1053889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfs.ko 2023-07-21T21:59:01.590 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 66089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv2.ko 2023-07-21T21:59:01.590 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 119801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv3.ko 2023-07-21T21:59:01.590 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 2041809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv4.ko 2023-07-21T21:59:01.590 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/ 2023-07-21T21:59:01.591 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/grace.ko 2023-07-21T21:59:01.591 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/nfs_acl.ko 2023-07-21T21:59:01.591 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd/ 2023-07-21T21:59:01.591 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1504993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd/nfsd.ko 2023-07-21T21:59:01.591 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2/ 2023-07-21T21:59:01.591 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 591417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2/nilfs2.ko 2023-07-21T21:59:01.591 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/ 2023-07-21T21:59:01.591 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-celtic.ko 2023-07-21T21:59:01.592 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-centeuro.ko 2023-07-21T21:59:01.592 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-croatian.ko 2023-07-21T21:59:01.592 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-cyrillic.ko 2023-07-21T21:59:01.592 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-gaelic.ko 2023-07-21T21:59:01.592 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-greek.ko 2023-07-21T21:59:01.592 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-iceland.ko 2023-07-21T21:59:01.592 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-inuit.ko 2023-07-21T21:59:01.592 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-roman.ko 2023-07-21T21:59:01.593 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-romanian.ko 2023-07-21T21:59:01.593 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-turkish.ko 2023-07-21T21:59:01.593 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_ascii.ko 2023-07-21T21:59:01.593 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1250.ko 2023-07-21T21:59:01.593 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1251.ko 2023-07-21T21:59:01.593 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1255.ko 2023-07-21T21:59:01.593 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp737.ko 2023-07-21T21:59:01.594 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp775.ko 2023-07-21T21:59:01.594 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp850.ko 2023-07-21T21:59:01.594 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp852.ko 2023-07-21T21:59:01.594 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp855.ko 2023-07-21T21:59:01.594 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp857.ko 2023-07-21T21:59:01.594 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp860.ko 2023-07-21T21:59:01.594 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp861.ko 2023-07-21T21:59:01.594 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp862.ko 2023-07-21T21:59:01.595 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp863.ko 2023-07-21T21:59:01.595 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp864.ko 2023-07-21T21:59:01.595 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp865.ko 2023-07-21T21:59:01.595 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp866.ko 2023-07-21T21:59:01.595 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp869.ko 2023-07-21T21:59:01.595 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp874.ko 2023-07-21T21:59:01.595 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 94137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp932.ko 2023-07-21T21:59:01.595 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 142673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp936.ko 2023-07-21T21:59:01.596 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 165745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp949.ko 2023-07-21T21:59:01.596 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 118121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp950.ko 2023-07-21T21:59:01.596 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_euc-jp.ko 2023-07-21T21:59:01.596 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-1.ko 2023-07-21T21:59:01.596 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-13.ko 2023-07-21T21:59:01.596 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-14.ko 2023-07-21T21:59:01.596 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-15.ko 2023-07-21T21:59:01.597 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-2.ko 2023-07-21T21:59:01.597 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-3.ko 2023-07-21T21:59:01.597 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-4.ko 2023-07-21T21:59:01.597 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-5.ko 2023-07-21T21:59:01.597 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-6.ko 2023-07-21T21:59:01.597 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-7.ko 2023-07-21T21:59:01.597 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-9.ko 2023-07-21T21:59:01.597 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-r.ko 2023-07-21T21:59:01.598 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-ru.ko 2023-07-21T21:59:01.598 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-u.ko 2023-07-21T21:59:01.598 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_utf8.ko 2023-07-21T21:59:01.598 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ntfs/ 2023-07-21T21:59:01.598 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 219073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ntfs/ntfs.ko 2023-07-21T21:59:01.598 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ 2023-07-21T21:59:01.598 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster/ 2023-07-21T21:59:01.598 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 244177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-21T21:59:01.599 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm/ 2023-07-21T21:59:01.599 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 440785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-21T21:59:01.599 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs/ 2023-07-21T21:59:01.599 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-21T21:59:01.599 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 2589569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2.ko 2023-07-21T21:59:01.599 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17905 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-21T21:59:01.599 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-21T21:59:01.599 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-21T21:59:01.600 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/omfs/ 2023-07-21T21:59:01.600 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 52569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/omfs/omfs.ko 2023-07-21T21:59:01.600 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs/ 2023-07-21T21:59:01.600 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 336473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs/overlay.ko 2023-07-21T21:59:01.600 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore/ 2023-07-21T21:59:01.600 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 54609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore/ramoops.ko 2023-07-21T21:59:01.600 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx4/ 2023-07-21T21:59:01.601 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx4/qnx4.ko 2023-07-21T21:59:01.601 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx6/ 2023-07-21T21:59:01.601 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 46649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx6/qnx6.ko 2023-07-21T21:59:01.601 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/ 2023-07-21T21:59:01.601 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_tree.ko 2023-07-21T21:59:01.601 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_v1.ko 2023-07-21T21:59:01.601 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_v2.ko 2023-07-21T21:59:01.601 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs/ 2023-07-21T21:59:01.602 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 530697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs/reiserfs.ko 2023-07-21T21:59:01.602 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs/ 2023-07-21T21:59:01.602 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs/romfs.ko 2023-07-21T21:59:01.602 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/ 2023-07-21T21:59:01.602 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client/ 2023-07-21T21:59:01.602 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 2658777 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client/cifs.ko 2023-07-21T21:59:01.602 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/ 2023-07-21T21:59:01.602 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_arc4.ko 2023-07-21T21:59:01.603 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_md4.ko 2023-07-21T21:59:01.603 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs/ 2023-07-21T21:59:01.603 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 134313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs/squashfs.ko 2023-07-21T21:59:01.603 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv/ 2023-07-21T21:59:01.603 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 89737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv/sysv.ko 2023-07-21T21:59:01.603 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf/ 2023-07-21T21:59:01.603 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 248049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf/udf.ko 2023-07-21T21:59:01.604 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs/ 2023-07-21T21:59:01.604 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 160857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs/ufs.ko 2023-07-21T21:59:01.604 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs/ 2023-07-21T21:59:01.604 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 3998129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs/xfs.ko 2023-07-21T21:59:01.604 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/ 2023-07-21T21:59:01.604 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/locking/ 2023-07-21T21:59:01.604 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 74865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/locking/locktorture.ko 2023-07-21T21:59:01.604 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/time/ 2023-07-21T21:59:01.605 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/time/test_udelay.ko 2023-07-21T21:59:01.605 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 58473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/torture.ko 2023-07-21T21:59:01.605 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ 2023-07-21T21:59:01.605 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 6833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc-itu-t.ko 2023-07-21T21:59:01.605 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 6529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc7.ko 2023-07-21T21:59:01.605 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc8.ko 2023-07-21T21:59:01.605 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/ 2023-07-21T21:59:01.605 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libarc4.ko 2023-07-21T21:59:01.606 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libdes.ko 2023-07-21T21:59:01.606 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/interval_tree_test.ko 2023-07-21T21:59:01.606 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/libcrc32c.ko 2023-07-21T21:59:01.606 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lru_cache.ko 2023-07-21T21:59:01.606 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/ 2023-07-21T21:59:01.606 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4_compress.ko 2023-07-21T21:59:01.606 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22633 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4hc_compress.ko 2023-07-21T21:59:01.606 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math/ 2023-07-21T21:59:01.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 6617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math/cordic.ko 2023-07-21T21:59:01.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/memory-notifier-error-inject.ko 2023-07-21T21:59:01.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/notifier-error-inject.ko 2023-07-21T21:59:01.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/percpu_test.ko 2023-07-21T21:59:01.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/pm-notifier-error-inject.ko 2023-07-21T21:59:01.607 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6/ 2023-07-21T21:59:01.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 143433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6/raid6_pq.ko 2023-07-21T21:59:01.607 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/rbtree_test.ko 2023-07-21T21:59:01.608 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon/ 2023-07-21T21:59:01.608 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-21T21:59:01.608 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test-kstrtox.ko 2023-07-21T21:59:01.608 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test-string_helpers.ko 2023-07-21T21:59:01.608 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 4760825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_bpf.ko 2023-07-21T21:59:01.608 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_firmware.ko 2023-07-21T21:59:01.608 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 6369 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_module.ko 2023-07-21T21:59:01.609 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_user_copy.ko 2023-07-21T21:59:01.609 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_bm.ko 2023-07-21T21:59:01.609 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_fsm.ko 2023-07-21T21:59:01.609 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_kmp.ko 2023-07-21T21:59:01.609 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/xz/ 2023-07-21T21:59:01.609 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/xz/xz_dec_test.ko 2023-07-21T21:59:01.609 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm/ 2023-07-21T21:59:01.609 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm/hwpoison-inject.ko 2023-07-21T21:59:01.610 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ 2023-07-21T21:59:01.610 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/ 2023-07-21T21:59:01.610 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 55737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/6lowpan.ko 2023-07-21T21:59:01.610 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_dest.ko 2023-07-21T21:59:01.610 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_fragment.ko 2023-07-21T21:59:01.610 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_hop.ko 2023-07-21T21:59:01.610 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 6985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-21T21:59:01.610 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_mobility.ko 2023-07-21T21:59:01.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_routing.ko 2023-07-21T21:59:01.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_udp.ko 2023-07-21T21:59:01.611 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/ 2023-07-21T21:59:01.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/garp.ko 2023-07-21T21:59:01.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/mrp.ko 2023-07-21T21:59:01.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/p8022.ko 2023-07-21T21:59:01.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/psnap.ko 2023-07-21T21:59:01.611 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/stp.ko 2023-07-21T21:59:01.612 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q/ 2023-07-21T21:59:01.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 81017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q/8021q.ko 2023-07-21T21:59:01.612 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/ 2023-07-21T21:59:01.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 198417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet.ko 2023-07-21T21:59:01.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_fd.ko 2023-07-21T21:59:01.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_rdma.ko 2023-07-21T21:59:01.612 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_virtio.ko 2023-07-21T21:59:01.613 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv/ 2023-07-21T21:59:01.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 652553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv/batman-adv.ko 2023-07-21T21:59:01.613 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/ 2023-07-21T21:59:01.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 63825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/br_netfilter.ko 2023-07-21T21:59:01.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 772505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/bridge.ko 2023-07-21T21:59:01.613 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ 2023-07-21T21:59:01.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-21T21:59:01.613 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-21T21:59:01.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-21T21:59:01.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-21T21:59:01.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-21T21:59:01.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-21T21:59:01.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-21T21:59:01.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-21T21:59:01.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-21T21:59:01.614 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-21T21:59:01.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-21T21:59:01.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-21T21:59:01.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-21T21:59:01.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-21T21:59:01.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-21T21:59:01.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-21T21:59:01.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-21T21:59:01.615 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-21T21:59:01.616 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-21T21:59:01.616 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-21T21:59:01.616 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 55937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtables.ko 2023-07-21T21:59:01.616 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-21T21:59:01.616 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-21T21:59:01.616 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph/ 2023-07-21T21:59:01.616 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1046417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph/libceph.ko 2023-07-21T21:59:01.617 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/ 2023-07-21T21:59:01.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 124793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/pktgen.ko 2023-07-21T21:59:01.617 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/ 2023-07-21T21:59:01.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 194321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp.ko 2023-07-21T21:59:01.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_diag.ko 2023-07-21T21:59:01.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 56945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv4.ko 2023-07-21T21:59:01.617 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 59457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv6.ko 2023-07-21T21:59:01.617 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/ 2023-07-21T21:59:01.618 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 390297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/dsa_core.ko 2023-07-21T21:59:01.618 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_brcm.ko 2023-07-21T21:59:01.618 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_dsa.ko 2023-07-21T21:59:01.618 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_none.ko 2023-07-21T21:59:01.618 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_trailer.ko 2023-07-21T21:59:01.618 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/hsr/ 2023-07-21T21:59:01.618 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 100257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/hsr/hsr.ko 2023-07-21T21:59:01.618 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ 2023-07-21T21:59:01.619 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan/ 2023-07-21T21:59:01.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 45169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-21T21:59:01.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 254601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154.ko 2023-07-21T21:59:01.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-21T21:59:01.619 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ 2023-07-21T21:59:01.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ah4.ko 2023-07-21T21:59:01.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/esp4.ko 2023-07-21T21:59:01.619 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 48345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/fou.ko 2023-07-21T21:59:01.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/gre.ko 2023-07-21T21:59:01.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 48529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/inet_diag.ko 2023-07-21T21:59:01.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 60529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_gre.ko 2023-07-21T21:59:01.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 61281 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_tunnel.ko 2023-07-21T21:59:01.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34369 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_vti.ko 2023-07-21T21:59:01.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipcomp.ko 2023-07-21T21:59:01.620 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipip.ko 2023-07-21T21:59:01.620 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ 2023-07-21T21:59:01.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-21T21:59:01.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-21T21:59:01.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-21T21:59:01.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ip_tables.ko 2023-07-21T21:59:01.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-21T21:59:01.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-07-21T21:59:01.621 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-21T21:59:01.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-21T21:59:01.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-21T21:59:01.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-07-21T21:59:01.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-21T21:59:01.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-21T21:59:01.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-21T21:59:01.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-21T21:59:01.622 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-21T21:59:01.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-21T21:59:01.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-21T21:59:01.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-21T21:59:01.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-21T21:59:01.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-07-21T21:59:01.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-21T21:59:01.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-21T21:59:01.623 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-21T21:59:01.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-21T21:59:01.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9009 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-21T21:59:01.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_bic.ko 2023-07-21T21:59:01.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_dctcp.ko 2023-07-21T21:59:01.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_diag.ko 2023-07-21T21:59:01.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_highspeed.ko 2023-07-21T21:59:01.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_htcp.ko 2023-07-21T21:59:01.624 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_hybla.ko 2023-07-21T21:59:01.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_illinois.ko 2023-07-21T21:59:01.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_lp.ko 2023-07-21T21:59:01.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_scalable.ko 2023-07-21T21:59:01.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_vegas.ko 2023-07-21T21:59:01.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_veno.ko 2023-07-21T21:59:01.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_westwood.ko 2023-07-21T21:59:01.625 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_yeah.ko 2023-07-21T21:59:01.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tunnel4.ko 2023-07-21T21:59:01.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_diag.ko 2023-07-21T21:59:01.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 41577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_tunnel.ko 2023-07-21T21:59:01.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-21T21:59:01.626 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ 2023-07-21T21:59:01.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ah6.ko 2023-07-21T21:59:01.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/esp6.ko 2023-07-21T21:59:01.626 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/fou6.ko 2023-07-21T21:59:01.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 80793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_gre.ko 2023-07-21T21:59:01.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 92817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_tunnel.ko 2023-07-21T21:59:01.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-21T21:59:01.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 54001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_vti.ko 2023-07-21T21:59:01.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ipcomp6.ko 2023-07-21T21:59:01.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/mip6.ko 2023-07-21T21:59:01.627 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ 2023-07-21T21:59:01.627 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 42209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-21T21:59:01.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-07-21T21:59:01.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-21T21:59:01.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-21T21:59:01.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-21T21:59:01.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-21T21:59:01.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-21T21:59:01.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-21T21:59:01.628 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-21T21:59:01.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-21T21:59:01.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-21T21:59:01.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-21T21:59:01.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-21T21:59:01.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-21T21:59:01.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-21T21:59:01.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-21T21:59:01.629 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-21T21:59:01.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-21T21:59:01.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-21T21:59:01.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-21T21:59:01.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-21T21:59:01.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-21T21:59:01.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9633 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-21T21:59:01.630 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-21T21:59:01.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9009 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-21T21:59:01.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 73161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/sit.ko 2023-07-21T21:59:01.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/tunnel6.ko 2023-07-21T21:59:01.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-21T21:59:01.631 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key/ 2023-07-21T21:59:01.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 82929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key/af_key.ko 2023-07-21T21:59:01.631 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/ 2023-07-21T21:59:01.631 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 125873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_core.ko 2023-07-21T21:59:01.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-21T21:59:01.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 25865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_eth.ko 2023-07-21T21:59:01.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip.ko 2023-07-21T21:59:01.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip6.ko 2023-07-21T21:59:01.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_netlink.ko 2023-07-21T21:59:01.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 53153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ppp.ko 2023-07-21T21:59:01.632 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/lapb/ 2023-07-21T21:59:01.632 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 48065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/lapb/lapb.ko 2023-07-21T21:59:01.633 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/ 2023-07-21T21:59:01.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/llc.ko 2023-07-21T21:59:01.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 267017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/llc2.ko 2023-07-21T21:59:01.633 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154/ 2023-07-21T21:59:01.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 291041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154/mac802154.ko 2023-07-21T21:59:01.633 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls/ 2023-07-21T21:59:01.633 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls/mpls_gso.ko 2023-07-21T21:59:01.633 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ 2023-07-21T21:59:01.634 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ 2023-07-21T21:59:01.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 119649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set.ko 2023-07-21T21:59:01.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-21T21:59:01.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-21T21:59:01.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-21T21:59:01.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 102033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-21T21:59:01.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 103121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-21T21:59:01.634 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 104593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-21T21:59:01.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 105129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-21T21:59:01.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 114393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-21T21:59:01.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 61161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-21T21:59:01.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 111161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-21T21:59:01.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 114673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-21T21:59:01.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 114329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-21T21:59:01.635 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 113217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-21T21:59:01.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 116217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-21T21:59:01.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-21T21:59:01.636 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ 2023-07-21T21:59:01.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 412481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-21T21:59:01.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-21T21:59:01.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-21T21:59:01.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-21T21:59:01.636 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17905 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-21T21:59:01.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-21T21:59:01.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-21T21:59:01.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-21T21:59:01.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-21T21:59:01.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-21T21:59:01.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-21T21:59:01.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-21T21:59:01.637 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-21T21:59:01.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-21T21:59:01.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 48897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conncount.ko 2023-07-21T21:59:01.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 408689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack.ko 2023-07-21T21:59:01.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-21T21:59:01.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-21T21:59:01.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33761 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-21T21:59:01.638 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 118145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-21T21:59:01.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-21T21:59:01.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-21T21:59:01.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 108393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-21T21:59:01.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-21T21:59:01.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-21T21:59:01.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 66641 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-21T21:59:01.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-21T21:59:01.639 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-21T21:59:01.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-21T21:59:01.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 88513 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table.ko 2023-07-21T21:59:01.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-21T21:59:01.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_log_syslog.ko 2023-07-21T21:59:01.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 95353 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat.ko 2023-07-21T21:59:01.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-21T21:59:01.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-21T21:59:01.640 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_irc.ko 2023-07-21T21:59:01.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_sip.ko 2023-07-21T21:59:01.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-21T21:59:01.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 44025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-21T21:59:01.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 592185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_tables.ko 2023-07-21T21:59:01.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 43873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink.ko 2023-07-21T21:59:01.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-21T21:59:01.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-07-21T21:59:01.641 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 39905 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_log.ko 2023-07-21T21:59:01.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-21T21:59:01.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 49673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-21T21:59:01.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_chain_nat.ko 2023-07-21T21:59:01.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_compat.ko 2023-07-21T21:59:01.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 40721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_ct.ko 2023-07-21T21:59:01.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-21T21:59:01.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fib.ko 2023-07-21T21:59:01.642 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-21T21:59:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_hash.ko 2023-07-21T21:59:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_limit.ko 2023-07-21T21:59:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_log.ko 2023-07-21T21:59:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_masq.ko 2023-07-21T21:59:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_nat.ko 2023-07-21T21:59:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_numgen.ko 2023-07-21T21:59:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_osf.ko 2023-07-21T21:59:01.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_queue.ko 2023-07-21T21:59:01.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_redir.ko 2023-07-21T21:59:01.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject.ko 2023-07-21T21:59:01.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject_inet.ko 2023-07-21T21:59:01.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_socket.ko 2023-07-21T21:59:01.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_synproxy.ko 2023-07-21T21:59:01.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_tproxy.ko 2023-07-21T21:59:01.644 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 89329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/x_tables.ko 2023-07-21T21:59:01.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_AUDIT.ko 2023-07-21T21:59:01.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9633 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-21T21:59:01.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-21T21:59:01.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-21T21:59:01.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 18169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CT.ko 2023-07-21T21:59:01.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_DSCP.ko 2023-07-21T21:59:01.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HL.ko 2023-07-21T21:59:01.645 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HMARK.ko 2023-07-21T21:59:01.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 38857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-21T21:59:01.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LED.ko 2023-07-21T21:59:01.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LOG.ko 2023-07-21T21:59:01.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-21T21:59:01.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NETMAP.ko 2023-07-21T21:59:01.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFLOG.ko 2023-07-21T21:59:01.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-21T21:59:01.646 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_RATEEST.ko 2023-07-21T21:59:01.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-21T21:59:01.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 14337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_SECMARK.ko 2023-07-21T21:59:01.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-21T21:59:01.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-21T21:59:01.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17369 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TEE.ko 2023-07-21T21:59:01.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TPROXY.ko 2023-07-21T21:59:01.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TRACE.ko 2023-07-21T21:59:01.647 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_addrtype.ko 2023-07-21T21:59:01.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_bpf.ko 2023-07-21T21:59:01.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cgroup.ko 2023-07-21T21:59:01.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cluster.ko 2023-07-21T21:59:01.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_comment.ko 2023-07-21T21:59:01.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connbytes.ko 2023-07-21T21:59:01.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlabel.ko 2023-07-21T21:59:01.648 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlimit.ko 2023-07-21T21:59:01.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connmark.ko 2023-07-21T21:59:01.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_conntrack.ko 2023-07-21T21:59:01.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cpu.ko 2023-07-21T21:59:01.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dccp.ko 2023-07-21T21:59:01.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_devgroup.ko 2023-07-21T21:59:01.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dscp.ko 2023-07-21T21:59:01.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ecn.ko 2023-07-21T21:59:01.649 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_esp.ko 2023-07-21T21:59:01.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 43457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hashlimit.ko 2023-07-21T21:59:01.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_helper.ko 2023-07-21T21:59:01.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hl.ko 2023-07-21T21:59:01.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipcomp.ko 2023-07-21T21:59:01.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_iprange.ko 2023-07-21T21:59:01.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipvs.ko 2023-07-21T21:59:01.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_l2tp.ko 2023-07-21T21:59:01.650 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_length.ko 2023-07-21T21:59:01.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_limit.ko 2023-07-21T21:59:01.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mac.ko 2023-07-21T21:59:01.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8641 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mark.ko 2023-07-21T21:59:01.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_multiport.ko 2023-07-21T21:59:01.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nat.ko 2023-07-21T21:59:01.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nfacct.ko 2023-07-21T21:59:01.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_osf.ko 2023-07-21T21:59:01.651 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_owner.ko 2023-07-21T21:59:01.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_physdev.ko 2023-07-21T21:59:01.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7633 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_pkttype.ko 2023-07-21T21:59:01.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_policy.ko 2023-07-21T21:59:01.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_quota.ko 2023-07-21T21:59:01.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_rateest.ko 2023-07-21T21:59:01.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_realm.ko 2023-07-21T21:59:01.652 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_recent.ko 2023-07-21T21:59:01.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_sctp.ko 2023-07-21T21:59:01.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 30089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_set.ko 2023-07-21T21:59:01.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_socket.ko 2023-07-21T21:59:01.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_state.ko 2023-07-21T21:59:01.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_statistic.ko 2023-07-21T21:59:01.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_string.ko 2023-07-21T21:59:01.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 8553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_tcpmss.ko 2023-07-21T21:59:01.653 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15777 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_tcpudp.ko 2023-07-21T21:59:01.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_time.ko 2023-07-21T21:59:01.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_u32.ko 2023-07-21T21:59:01.654 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink/ 2023-07-21T21:59:01.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink/netlink_diag.ko 2023-07-21T21:59:01.654 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh/ 2023-07-21T21:59:01.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 12425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh/nsh.ko 2023-07-21T21:59:01.654 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/ 2023-07-21T21:59:01.654 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 379545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/openvswitch.ko 2023-07-21T21:59:01.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-geneve.ko 2023-07-21T21:59:01.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-gre.ko 2023-07-21T21:59:01.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 11793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-vxlan.ko 2023-07-21T21:59:01.655 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet/ 2023-07-21T21:59:01.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet/af_packet_diag.ko 2023-07-21T21:59:01.655 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/ 2023-07-21T21:59:01.655 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 109961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/phonet.ko 2023-07-21T21:59:01.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 54761 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/pn_pep.ko 2023-07-21T21:59:01.656 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/ 2023-07-21T21:59:01.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 252825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds.ko 2023-07-21T21:59:01.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 165081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_rdma.ko 2023-07-21T21:59:01.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 67241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_tcp.ko 2023-07-21T21:59:01.656 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rxrpc/ 2023-07-21T21:59:01.656 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 820137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rxrpc/rxrpc.ko 2023-07-21T21:59:01.657 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/ 2023-07-21T21:59:01.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_csum.ko 2023-07-21T21:59:01.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_gact.ko 2023-07-21T21:59:01.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_ipt.ko 2023-07-21T21:59:01.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 34057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_mirred.ko 2023-07-21T21:59:01.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_nat.ko 2023-07-21T21:59:01.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 43817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_pedit.ko 2023-07-21T21:59:01.657 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_police.ko 2023-07-21T21:59:01.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_simple.ko 2023-07-21T21:59:01.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36353 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_skbedit.ko 2023-07-21T21:59:01.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 36057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_vlan.ko 2023-07-21T21:59:01.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_basic.ko 2023-07-21T21:59:01.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_bpf.ko 2023-07-21T21:59:01.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_cgroup.ko 2023-07-21T21:59:01.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31377 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_flow.ko 2023-07-21T21:59:01.658 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_fw.ko 2023-07-21T21:59:01.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 37953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_route.ko 2023-07-21T21:59:01.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 59217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_u32.ko 2023-07-21T21:59:01.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_cmp.ko 2023-07-21T21:59:01.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 13457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_ipset.ko 2023-07-21T21:59:01.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_meta.ko 2023-07-21T21:59:01.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_nbyte.ko 2023-07-21T21:59:01.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_text.ko 2023-07-21T21:59:01.659 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_u32.ko 2023-07-21T21:59:01.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 21649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_choke.ko 2023-07-21T21:59:01.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_codel.ko 2023-07-21T21:59:01.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_drr.ko 2023-07-21T21:59:01.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 33609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_fq.ko 2023-07-21T21:59:01.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_fq_codel.ko 2023-07-21T21:59:01.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_gred.ko 2023-07-21T21:59:01.660 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 48409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hfsc.ko 2023-07-21T21:59:01.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hhf.ko 2023-07-21T21:59:01.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 65793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_htb.ko 2023-07-21T21:59:01.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 16065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_ingress.ko 2023-07-21T21:59:01.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 29809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio.ko 2023-07-21T21:59:01.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio_lib.ko 2023-07-21T21:59:01.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_multiq.ko 2023-07-21T21:59:01.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 35601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_netem.ko 2023-07-21T21:59:01.661 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_pie.ko 2023-07-21T21:59:01.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_plug.ko 2023-07-21T21:59:01.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 24729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_prio.ko 2023-07-21T21:59:01.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 47617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_qfq.ko 2023-07-21T21:59:01.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 32953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_red.ko 2023-07-21T21:59:01.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 26881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfb.ko 2023-07-21T21:59:01.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 31425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfq.ko 2023-07-21T21:59:01.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 28897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_tbf.ko 2023-07-21T21:59:01.662 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 27729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_teql.ko 2023-07-21T21:59:01.663 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/ 2023-07-21T21:59:01.663 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 930369 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp.ko 2023-07-21T21:59:01.663 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 19033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp_diag.ko 2023-07-21T21:59:01.663 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/ 2023-07-21T21:59:01.663 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/ 2023-07-21T21:59:01.663 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 335569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-21T21:59:01.663 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 61833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-21T21:59:01.663 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 1514649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/sunrpc.ko 2023-07-21T21:59:01.664 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma/ 2023-07-21T21:59:01.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 707401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-21T21:59:01.664 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/ 2023-07-21T21:59:01.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/diag.ko 2023-07-21T21:59:01.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 862233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/tipc.ko 2023-07-21T21:59:01.664 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix/ 2023-07-21T21:59:01.664 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix/unix_diag.ko 2023-07-21T21:59:01.664 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/ 2023-07-21T21:59:01.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 84841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-21T21:59:01.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 68033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-21T21:59:01.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 95985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock.ko 2023-07-21T21:59:01.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 10705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-21T21:59:01.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 17521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-21T21:59:01.665 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/x25/ 2023-07-21T21:59:01.665 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 125097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/x25/x25.ko 2023-07-21T21:59:01.666 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/ 2023-07-21T21:59:01.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 22657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_algo.ko 2023-07-21T21:59:01.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 20705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-21T21:59:01.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 102265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_user.ko 2023-07-21T21:59:01.666 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/ 2023-07-21T21:59:01.666 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib/ 2023-07-21T21:59:01.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 15513 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib/irqbypass.ko 2023-07-21T21:59:01.666 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 638200 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias 2023-07-21T21:59:01.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 623896 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias.bin 2023-07-21T21:59:01.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 7656 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin 2023-07-21T21:59:01.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 23361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.alias.bin 2023-07-21T21:59:01.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 9821 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.bin 2023-07-21T21:59:01.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 69903 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.modinfo 2023-07-21T21:59:01.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 146449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep 2023-07-21T21:59:01.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 232695 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep.bin 2023-07-21T21:59:01.667 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 210 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.devname 2023-07-21T21:59:01.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 72754 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.order 2023-07-21T21:59:01.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 879 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.softdep 2023-07-21T21:59:01.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 252883 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols 2023-07-21T21:59:01.668 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 307884 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols.bin 2023-07-21T21:59:01.668 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./usr/ 2023-07-21T21:59:01.668 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./usr/share/ 2023-07-21T21:59:01.668 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./usr/share/doc/ 2023-07-21T21:59:01.668 INFO:teuthology.orchestra.run.smithi006.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/ 2023-07-21T21:59:01.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 174 2023-07-20 11:52 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/changelog.Debian.gz 2023-07-21T21:59:01.669 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-r--r-- root/root 691 2023-07-20 11:52 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/copyright 2023-07-21T21:59:01.670 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:59:01.670 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:59:01.671 DEBUG:teuthology.orchestra.run.smithi006:> egrep '(submenu|menuentry.*6.5.0-rc1-gc685da6f56cc).*{' /boot/grub/grub.cfg 2023-07-21T21:59:01.678 INFO:teuthology.orchestra.run.smithi006.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-21T21:59:01.678 INFO:teuthology.orchestra.run.smithi006.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-gc685da6f56cc-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-21T21:59:01.678 INFO:teuthology.orchestra.run.smithi006.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-gc685da6f56cc-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-21T21:59:01.679 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-07-21T21:59:01.679 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:59:01.679 DEBUG:teuthology.orchestra.run.smithi006:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-07-21T21:59:01.723 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi006.front.sepia.ceph.com to complete... 2023-07-21T21:59:02.151 INFO:teuthology.orchestra.run.smithi006.stderr:Sourcing file `/etc/default/grub' 2023-07-21T21:59:02.152 INFO:teuthology.orchestra.run.smithi006.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-21T21:59:02.176 INFO:teuthology.orchestra.run.smithi006.stderr:Generating grub configuration file ... 2023-07-21T21:59:02.376 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:59:02.382 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:59:02.629 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-21T21:59:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-21T21:59:02.680 INFO:teuthology.orchestra.run.smithi006.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-21T21:59:02.686 INFO:teuthology.orchestra.run.smithi006.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-21T21:59:02.807 INFO:teuthology.orchestra.run.smithi006.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-21T21:59:02.807 INFO:teuthology.orchestra.run.smithi006.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-21T21:59:02.807 INFO:teuthology.orchestra.run.smithi006.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-21T21:59:02.826 INFO:teuthology.orchestra.run.smithi006.stderr:done 2023-07-21T21:59:16.118 INFO:teuthology.orchestra.run.smithi161.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-07-21T21:59:16.118 INFO:teuthology.orchestra.run.smithi161.stderr: * [new branch] main -> origin/main 2023-07-21T21:59:16.145 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190312 -> 20190312 2023-07-21T21:59:16.146 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190416 -> 20190416 2023-07-21T21:59:16.146 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190514 -> 20190514 2023-07-21T21:59:16.146 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190618 -> 20190618 2023-07-21T21:59:16.146 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190717 -> 20190717 2023-07-21T21:59:16.147 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190815 -> 20190815 2023-07-21T21:59:16.148 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20190923 -> 20190923 2023-07-21T21:59:16.148 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20191022 -> 20191022 2023-07-21T21:59:16.148 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20191215 -> 20191215 2023-07-21T21:59:16.148 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200122 -> 20200122 2023-07-21T21:59:16.148 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200316 -> 20200316 2023-07-21T21:59:16.148 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200421 -> 20200421 2023-07-21T21:59:16.148 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200519 -> 20200519 2023-07-21T21:59:16.149 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200619 -> 20200619 2023-07-21T21:59:16.149 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200721 -> 20200721 2023-07-21T21:59:16.149 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200817 -> 20200817 2023-07-21T21:59:16.149 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20200918 -> 20200918 2023-07-21T21:59:16.149 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20201022 -> 20201022 2023-07-21T21:59:16.149 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20201118 -> 20201118 2023-07-21T21:59:16.151 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20201218 -> 20201218 2023-07-21T21:59:16.151 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20210208 -> 20210208 2023-07-21T21:59:16.151 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20210315 -> 20210315 2023-07-21T21:59:16.152 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20210511 -> 20210511 2023-07-21T21:59:16.152 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20210716 -> 20210716 2023-07-21T21:59:16.152 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20210818 -> 20210818 2023-07-21T21:59:16.152 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20210919 -> 20210919 2023-07-21T21:59:16.153 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20211027 -> 20211027 2023-07-21T21:59:16.153 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20211216 -> 20211216 2023-07-21T21:59:16.153 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220209 -> 20220209 2023-07-21T21:59:16.153 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220310 -> 20220310 2023-07-21T21:59:16.153 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220411 -> 20220411 2023-07-21T21:59:16.154 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220509 -> 20220509 2023-07-21T21:59:16.154 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220610 -> 20220610 2023-07-21T21:59:16.154 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220708 -> 20220708 2023-07-21T21:59:16.154 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220815 -> 20220815 2023-07-21T21:59:16.154 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20220913 -> 20220913 2023-07-21T21:59:16.154 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20221012 -> 20221012 2023-07-21T21:59:16.154 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20221109 -> 20221109 2023-07-21T21:59:16.155 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20221214 -> 20221214 2023-07-21T21:59:16.155 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230117 -> 20230117 2023-07-21T21:59:16.155 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230210 -> 20230210 2023-07-21T21:59:16.155 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230310 -> 20230310 2023-07-21T21:59:16.155 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230404 -> 20230404 2023-07-21T21:59:16.156 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230515 -> 20230515 2023-07-21T21:59:16.156 INFO:teuthology.orchestra.run.smithi161.stderr: * [new tag] 20230625 -> 20230625 2023-07-21T21:59:19.405 INFO:teuthology.orchestra.run.smithi161.stderr:Updating files: 50% (1505/2977) Updating files: 51% (1519/2977) Updating files: 52% (1549/2977) Updating files: 53% (1578/2977) Updating files: 54% (1608/2977) Updating files: 55% (1638/2977) Updating files: 56% (1668/2977) Updating files: 57% (1697/2977) Updating files: 58% (1727/2977) Updating files: 59% (1757/2977) Updating files: 60% (1787/2977) Updating files: 61% (1816/2977) Updating files: 62% (1846/2977) Updating files: 63% (1876/2977) Updating files: 64% (1906/2977) Updating files: 65% (1936/2977) Updating files: 65% (1955/2977) Updating files: 66% (1965/2977) Updating files: 67% (1995/2977) Updating files: 68% (2025/2977) Updating files: 69% (2055/2977) Updating files: 70% (2084/2977) Updating files: 71% (2114/2977) Updating files: 72% (2144/2977) Updating files: 73% (2174/2977) Updating files: 74% (2203/2977) Updating files: 75% (2233/2977) Updating files: 76% (2263/2977) Updating files: 77% (2293/2977) Updating files: 78% (2323/2977) Updating files: 79% (2352/2977) Updating files: 80% (2382/2977) Updating files: 81% (2412/2977) Updating files: 82% (2442/2977) Updating files: 82% (2448/2977) Updating files: 83% (2471/2977) Updating files: 84% (2501/2977) Updating files: 85% (2531/2977) Updating files: 86% (2561/2977) Updating files: 87% (2590/2977) Updating files: 88% (2620/2977) Updating files: 89% (2650/2977) Updating files: 90% (2680/2977) Updating files: 91% (2710/2977) Updating files: 92% (2739/2977) Updating files: 93% (2769/2977) Updating files: 94% (2799/2977) Updating files: 95% (2829/2977) Updating files: 96% (2858/2977) Updating files: 97% (2888/2977) Updating files: 98% (2918/2977) Updating files: 99% (2948/2977) Updating files: 100% (2977/2977) Updating files: 100% (2977/2977), done. 2023-07-21T21:59:19.409 INFO:teuthology.orchestra.run.smithi161.stdout:HEAD is now at d3f66064 Partially revert "amdgpu: DMCUB updates for DCN 3.1.4 and 3.1.5" 2023-07-21T21:59:19.427 INFO:teuthology.task.kernel:Downloading kernel c685da6f56cc77f2cfb9c4221be3960522616caf on client.1... 2023-07-21T21:59:19.428 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:59:25.115 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/ 2023-07-21T21:59:25.115 DEBUG:teuthology.orchestra.run.smithi161:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc1-gc685da6f56cc_6.5.0-rc1-gc685da6f56cc-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/ --input-file=- 2023-07-21T21:59:25.118 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi161.front.sepia.ceph.com to complete... 2023-07-21T21:59:32.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21 21:59:32 URL:https://4.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/jammy/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/linux-image-6.5.0-rc1-gc685da6f56cc_6.5.0-rc1-gc685da6f56cc-1_amd64.deb [38851756/38851756] -> "/tmp/linux-image.deb" [1] 2023-07-21T21:59:32.105 INFO:teuthology.orchestra.run.smithi161.stderr:FINISHED --2023-07-21 21:59:32-- 2023-07-21T21:59:32.105 INFO:teuthology.orchestra.run.smithi161.stderr:Total wall clock time: 7.0s 2023-07-21T21:59:32.105 INFO:teuthology.orchestra.run.smithi161.stderr:Downloaded: 1 files, 37M in 6.5s (5.72 MB/s) 2023-07-21T21:59:32.107 INFO:teuthology.task.kernel:Installing kernel c685da6f56cc77f2cfb9c4221be3960522616caf on client.1... 2023-07-21T21:59:32.108 DEBUG:teuthology.orchestra.run.smithi161:> sudo dpkg -i /tmp/linux-image.deb 2023-07-21T21:59:32.400 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package linux-image-6.5.0-rc1-gc685da6f56cc. 2023-07-21T21:59:33.928 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-07-21T21:59:33.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-07-21T21:59:33.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:59:34.423 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-07-21T21:59:34.428 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-07-21T21:59:34.600 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking linux-image-6.5.0-rc1-gc685da6f56cc (6.5.0-rc1-gc685da6f56cc-1) ... 2023-07-21T21:59:37.957 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up linux-image-6.5.0-rc1-gc685da6f56cc (6.5.0-rc1-gc685da6f56cc-1) ... 2023-07-21T21:59:38.068 INFO:teuthology.orchestra.run.smithi161.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:59:52.432 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-07-21T21:59:57.915 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub' 2023-07-21T21:59:57.924 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-21T21:59:57.953 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2023-07-21T21:59:58.288 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:59:58.308 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:59:58.613 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-21T21:59:58.622 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-21T21:59:58.692 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-21T21:59:58.698 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-21T21:59:58.868 INFO:teuthology.orchestra.run.smithi161.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-21T21:59:58.868 INFO:teuthology.orchestra.run.smithi161.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-21T21:59:58.868 INFO:teuthology.orchestra.run.smithi161.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-21T21:59:58.912 INFO:teuthology.orchestra.run.smithi161.stderr:done 2023-07-21T21:59:59.136 DEBUG:teuthology.orchestra.run.smithi161:> dpkg-deb -c /tmp/linux-image.deb 2023-07-21T21:59:59.143 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./ 2023-07-21T21:59:59.144 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./boot/ 2023-07-21T21:59:59.144 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 4380308 2023-07-20 11:52 ./boot/System.map-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:59:59.153 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 168433 2023-07-20 11:52 ./boot/config-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:59:59.154 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11280224 2023-07-20 11:52 ./boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:59:59.171 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./etc/ 2023-07-21T21:59:59.171 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./etc/kernel/ 2023-07-21T21:59:59.172 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./etc/kernel/postinst.d/ 2023-07-21T21:59:59.172 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./etc/kernel/postrm.d/ 2023-07-21T21:59:59.172 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./etc/kernel/preinst.d/ 2023-07-21T21:59:59.172 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./etc/kernel/prerm.d/ 2023-07-21T21:59:59.172 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/ 2023-07-21T21:59:59.172 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/ 2023-07-21T21:59:59.172 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/ 2023-07-21T21:59:59.173 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/ 2023-07-21T21:59:59.173 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/ 2023-07-21T21:59:59.173 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/ 2023-07-21T21:59:59.173 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/ 2023-07-21T21:59:59.173 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 490385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/aesni-intel.ko 2023-07-21T21:59:59.175 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-21T21:59:59.175 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-21T21:59:59.175 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-21T21:59:59.176 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 93113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-21T21:59:59.176 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 106729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-21T21:59:59.176 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 152241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-21T21:59:59.176 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-21T21:59:59.176 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13777 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-21T21:59:59.176 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 83889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-21T21:59:59.176 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-21T21:59:59.177 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-21T21:59:59.177 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-21T21:59:59.177 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-21T21:59:59.177 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-21T21:59:59.177 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-21T21:59:59.177 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-21T21:59:59.177 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-21T21:59:59.178 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-21T21:59:59.178 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-21T21:59:59.178 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/ 2023-07-21T21:59:59.178 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/ 2023-07-21T21:59:59.178 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce/ 2023-07-21T21:59:59.178 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-21T21:59:59.178 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13281 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpuid.ko 2023-07-21T21:59:59.178 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/msr.ko 2023-07-21T21:59:59.179 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/ 2023-07-21T21:59:59.179 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 348417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-21T21:59:59.179 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 972641 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-21T21:59:59.186 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 2273145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm.ko 2023-07-21T21:59:59.186 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ 2023-07-21T21:59:59.186 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/af_alg.ko 2023-07-21T21:59:59.186 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/algif_hash.ko 2023-07-21T21:59:59.186 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/algif_skcipher.ko 2023-07-21T21:59:59.187 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ansi_cprng.ko 2023-07-21T21:59:59.187 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19641 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/anubis.ko 2023-07-21T21:59:59.187 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/arc4.ko 2023-07-21T21:59:59.187 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/asymmetric_keys/ 2023-07-21T21:59:59.187 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-07-21T21:59:59.187 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/ 2023-07-21T21:59:59.187 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_memcpy.ko 2023-07-21T21:59:59.187 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_pq.ko 2023-07-21T21:59:59.188 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-21T21:59:59.188 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_tx.ko 2023-07-21T21:59:59.188 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_xor.ko 2023-07-21T21:59:59.188 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/raid6test.ko 2023-07-21T21:59:59.188 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authenc.ko 2023-07-21T21:59:59.188 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22641 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authencesn.ko 2023-07-21T21:59:59.188 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blake2b_generic.ko 2023-07-21T21:59:59.189 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_common.ko 2023-07-21T21:59:59.189 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_generic.ko 2023-07-21T21:59:59.189 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/camellia_generic.ko 2023-07-21T21:59:59.189 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast5_generic.ko 2023-07-21T21:59:59.189 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast6_generic.ko 2023-07-21T21:59:59.189 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast_common.ko 2023-07-21T21:59:59.189 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ccm.ko 2023-07-21T21:59:59.189 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14769 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cmac.ko 2023-07-21T21:59:59.190 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crc32_generic.ko 2023-07-21T21:59:59.190 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cryptd.ko 2023-07-21T21:59:59.190 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_engine.ko 2023-07-21T21:59:59.190 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_simd.ko 2023-07-21T21:59:59.190 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_user.ko 2023-07-21T21:59:59.190 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cts.ko 2023-07-21T21:59:59.190 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/des_generic.ko 2023-07-21T21:59:59.190 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/dh_generic.ko 2023-07-21T21:59:59.191 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/echainiv.ko 2023-07-21T21:59:59.191 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/essiv.ko 2023-07-21T21:59:59.191 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/fcrypt.ko 2023-07-21T21:59:59.191 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/khazad.ko 2023-07-21T21:59:59.191 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lrw.ko 2023-07-21T21:59:59.191 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11513 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4.ko 2023-07-21T21:59:59.191 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4hc.ko 2023-07-21T21:59:59.192 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11761 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/md4.ko 2023-07-21T21:59:59.192 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/michael_mic.ko 2023-07-21T21:59:59.192 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcbc.ko 2023-07-21T21:59:59.192 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcrypt.ko 2023-07-21T21:59:59.192 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/rmd160.ko 2023-07-21T21:59:59.192 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/seed.ko 2023-07-21T21:59:59.192 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/serpent_generic.ko 2023-07-21T21:59:59.192 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 149193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tcrypt.ko 2023-07-21T21:59:59.193 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tea.ko 2023-07-21T21:59:59.193 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28777 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_common.ko 2023-07-21T21:59:59.193 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_generic.ko 2023-07-21T21:59:59.193 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/vmac.ko 2023-07-21T21:59:59.193 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/wp512.ko 2023-07-21T21:59:59.193 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xcbc.ko 2023-07-21T21:59:59.193 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xor.ko 2023-07-21T21:59:59.193 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xts.ko 2023-07-21T21:59:59.194 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xxhash_generic.ko 2023-07-21T21:59:59.194 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ 2023-07-21T21:59:59.194 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/ 2023-07-21T21:59:59.194 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_extlog.ko 2023-07-21T21:59:59.194 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-21T21:59:59.194 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_pad.ko 2023-07-21T21:59:59.194 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/apei/ 2023-07-21T21:59:59.194 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/apei/einj.ko 2023-07-21T21:59:59.195 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/ec_sys.ko 2023-07-21T21:59:59.195 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/platform_profile.ko 2023-07-21T21:59:59.195 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbs.ko 2023-07-21T21:59:59.195 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbshc.ko 2023-07-21T21:59:59.195 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 100401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/video.ko 2023-07-21T21:59:59.195 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ 2023-07-21T21:59:59.195 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/acard-ahci.ko 2023-07-21T21:59:59.196 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 88625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ahci.ko 2023-07-21T21:59:59.196 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ahci_platform.ko 2023-07-21T21:59:59.196 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 87841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/libahci.ko 2023-07-21T21:59:59.196 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/libahci_platform.ko 2023-07-21T21:59:59.196 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17009 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_acpi.ko 2023-07-21T21:59:59.196 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ali.ko 2023-07-21T21:59:59.196 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_amd.ko 2023-07-21T21:59:59.196 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_artop.ko 2023-07-21T21:59:59.197 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atiixp.ko 2023-07-21T21:59:59.197 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atp867x.ko 2023-07-21T21:59:59.197 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd640.ko 2023-07-21T21:59:59.197 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd64x.ko 2023-07-21T21:59:59.197 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cypress.ko 2023-07-21T21:59:59.197 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_efar.ko 2023-07-21T21:59:59.197 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt366.ko 2023-07-21T21:59:59.197 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt37x.ko 2023-07-21T21:59:59.198 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-21T21:59:59.198 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-21T21:59:59.198 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it8213.ko 2023-07-21T21:59:59.198 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it821x.ko 2023-07-21T21:59:59.198 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_jmicron.ko 2023-07-21T21:59:59.198 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_legacy.ko 2023-07-21T21:59:59.198 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_marvell.ko 2023-07-21T21:59:59.198 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_mpiix.ko 2023-07-21T21:59:59.199 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_netcell.ko 2023-07-21T21:59:59.199 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ninja32.ko 2023-07-21T21:59:59.199 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87410.ko 2023-07-21T21:59:59.199 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87415.ko 2023-07-21T21:59:59.199 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_oldpiix.ko 2023-07-21T21:59:59.199 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_opti.ko 2023-07-21T21:59:59.199 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_optidma.ko 2023-07-21T21:59:59.200 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pcmcia.ko 2023-07-21T21:59:59.200 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-21T21:59:59.200 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-21T21:59:59.200 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_piccolo.ko 2023-07-21T21:59:59.200 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_radisys.ko 2023-07-21T21:59:59.200 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_rdc.ko 2023-07-21T21:59:59.200 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_rz1000.ko 2023-07-21T21:59:59.200 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sch.ko 2023-07-21T21:59:59.201 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_serverworks.ko 2023-07-21T21:59:59.201 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sil680.ko 2023-07-21T21:59:59.201 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sl82c105.ko 2023-07-21T21:59:59.201 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_triflex.ko 2023-07-21T21:59:59.201 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_via.ko 2023-07-21T21:59:59.201 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pdc_adma.ko 2023-07-21T21:59:59.201 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_inic162x.ko 2023-07-21T21:59:59.201 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 83225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_mv.ko 2023-07-21T21:59:59.202 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_nv.ko 2023-07-21T21:59:59.202 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37369 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_promise.ko 2023-07-21T21:59:59.202 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_qstor.ko 2023-07-21T21:59:59.202 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil.ko 2023-07-21T21:59:59.202 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil24.ko 2023-07-21T21:59:59.202 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sis.ko 2023-07-21T21:59:59.202 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_svw.ko 2023-07-21T21:59:59.202 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sx4.ko 2023-07-21T21:59:59.203 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_uli.ko 2023-07-21T21:59:59.203 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_via.ko 2023-07-21T21:59:59.203 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_vsc.ko 2023-07-21T21:59:59.203 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay/ 2023-07-21T21:59:59.203 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay/ks0108.ko 2023-07-21T21:59:59.203 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma/ 2023-07-21T21:59:59.203 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 124457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma/bcma.ko 2023-07-21T21:59:59.203 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/ 2023-07-21T21:59:59.204 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe/ 2023-07-21T21:59:59.204 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 113705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe/aoe.ko 2023-07-21T21:59:59.204 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd/ 2023-07-21T21:59:59.204 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 968433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd/drbd.ko 2023-07-21T21:59:59.237 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 173201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/floppy.ko 2023-07-21T21:59:59.238 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx/ 2023-07-21T21:59:59.238 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 94297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-21T21:59:59.238 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 115345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/nbd.ko 2023-07-21T21:59:59.238 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk/ 2023-07-21T21:59:59.238 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 110361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk/null_blk.ko 2023-07-21T21:59:59.238 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 98225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/pktcdvd.ko 2023-07-21T21:59:59.238 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 257529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/rbd.ko 2023-07-21T21:59:59.239 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback/ 2023-07-21T21:59:59.239 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 98129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-21T21:59:59.239 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram/ 2023-07-21T21:59:59.239 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram/zram.ko 2023-07-21T21:59:59.239 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ 2023-07-21T21:59:59.239 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/applicom.ko 2023-07-21T21:59:59.239 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12009 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hangcheck-timer.ko 2023-07-21T21:59:59.239 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/ 2023-07-21T21:59:59.240 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-21T21:59:59.240 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-21T21:59:59.240 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-21T21:59:59.240 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/via-rng.ko 2023-07-21T21:59:59.240 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15633 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-21T21:59:59.240 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ 2023-07-21T21:59:59.240 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-21T21:59:59.241 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 150665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-21T21:59:59.241 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-21T21:59:59.241 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 139057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-21T21:59:59.241 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-21T21:59:59.241 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-21T21:59:59.241 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/lp.ko 2023-07-21T21:59:59.241 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave/ 2023-07-21T21:59:59.241 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 84121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave/mwave.ko 2023-07-21T21:59:59.242 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/nvram.ko 2023-07-21T21:59:59.242 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ppdev.ko 2023-07-21T21:59:59.242 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tlclk.ko 2023-07-21T21:59:59.242 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/ 2023-07-21T21:59:59.242 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-21T21:59:59.242 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-07-21T21:59:59.242 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-07-21T21:59:59.242 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-07-21T21:59:59.243 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-21T21:59:59.243 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-21T21:59:59.243 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-07-21T21:59:59.243 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/ 2023-07-21T21:59:59.243 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_class.ko 2023-07-21T21:59:59.243 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_core.ko 2023-07-21T21:59:59.243 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-07-21T21:59:59.243 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/ 2023-07-21T21:59:59.244 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-palmas.ko 2023-07-21T21:59:59.244 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-si5351.ko 2023-07-21T21:59:59.244 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-twl6040.ko 2023-07-21T21:59:59.244 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-wm831x.ko 2023-07-21T21:59:59.244 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/ 2023-07-21T21:59:59.244 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-21T21:59:59.244 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-21T21:59:59.245 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-21T21:59:59.245 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ 2023-07-21T21:59:59.245 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ 2023-07-21T21:59:59.245 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-21T21:59:59.245 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 234473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp.ko 2023-07-21T21:59:59.245 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/ 2023-07-21T21:59:59.245 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/ 2023-07-21T21:59:59.245 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common/ 2023-07-21T21:59:59.246 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 408489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-21T21:59:59.246 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-07-21T21:59:59.246 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-21T21:59:59.246 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-aes.ko 2023-07-21T21:59:59.246 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-sha.ko 2023-07-21T21:59:59.246 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio/ 2023-07-21T21:59:59.246 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 68937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-21T21:59:59.246 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca/ 2023-07-21T21:59:59.247 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca/dca.ko 2023-07-21T21:59:59.247 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ 2023-07-21T21:59:59.247 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw/ 2023-07-21T21:59:59.247 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-21T21:59:59.247 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat/ 2023-07-21T21:59:59.247 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 122641 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-21T21:59:59.247 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/ 2023-07-21T21:59:59.248 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 80273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/amd64_edac.ko 2023-07-21T21:59:59.248 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35769 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/e752x_edac.ko 2023-07-21T21:59:59.248 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 63617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/edac_mce_amd.ko 2023-07-21T21:59:59.248 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3000_edac.ko 2023-07-21T21:59:59.248 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3200_edac.ko 2023-07-21T21:59:59.248 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5100_edac.ko 2023-07-21T21:59:59.248 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5400_edac.ko 2023-07-21T21:59:59.248 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7300_edac.ko 2023-07-21T21:59:59.249 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7core_edac.ko 2023-07-21T21:59:59.249 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i82975x_edac.ko 2023-07-21T21:59:59.249 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/ie31200_edac.ko 2023-07-21T21:59:59.249 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 56809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/sb_edac.ko 2023-07-21T21:59:59.249 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/x38_edac.ko 2023-07-21T21:59:59.249 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/ 2023-07-21T21:59:59.249 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-gpio.ko 2023-07-21T21:59:59.249 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max14577.ko 2023-07-21T21:59:59.250 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max77693.ko 2023-07-21T21:59:59.250 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max8997.ko 2023-07-21T21:59:59.250 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-palmas.ko 2023-07-21T21:59:59.250 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-rt8973a.ko 2023-07-21T21:59:59.250 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-sm5502.ko 2023-07-21T21:59:59.250 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/ 2023-07-21T21:59:59.250 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/dmi-sysfs.ko 2023-07-21T21:59:59.250 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/efi/ 2023-07-21T21:59:59.251 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/efi/efi-pstore.ko 2023-07-21T21:59:59.251 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-21T21:59:59.251 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/ 2023-07-21T21:59:59.251 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-adp5520.ko 2023-07-21T21:59:59.251 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-amd8111.ko 2023-07-21T21:59:59.251 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-arizona.ko 2023-07-21T21:59:59.251 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-da9052.ko 2023-07-21T21:59:59.251 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-da9055.ko 2023-07-21T21:59:59.252 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-dln2.ko 2023-07-21T21:59:59.252 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 77849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-f7188x.ko 2023-07-21T21:59:59.252 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-generic.ko 2023-07-21T21:59:59.252 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-ich.ko 2023-07-21T21:59:59.252 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-07-21T21:59:59.252 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-kempld.ko 2023-07-21T21:59:59.252 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-lp3943.ko 2023-07-21T21:59:59.253 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max7300.ko 2023-07-21T21:59:59.253 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max730x.ko 2023-07-21T21:59:59.253 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max732x.ko 2023-07-21T21:59:59.253 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-07-21T21:59:59.253 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46761 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-pca953x.ko 2023-07-21T21:59:59.253 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-pcf857x.ko 2023-07-21T21:59:59.253 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14377 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-rdc321x.ko 2023-07-21T21:59:59.253 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-sch.ko 2023-07-21T21:59:59.254 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-sch311x.ko 2023-07-21T21:59:59.254 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-tps65912.ko 2023-07-21T21:59:59.254 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-twl4030.ko 2023-07-21T21:59:59.254 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-twl6040.ko 2023-07-21T21:59:59.254 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-21T21:59:59.254 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-vx855.ko 2023-07-21T21:59:59.254 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16281 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm831x.ko 2023-07-21T21:59:59.254 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm8350.ko 2023-07-21T21:59:59.255 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm8994.ko 2023-07-21T21:59:59.255 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/ 2023-07-21T21:59:59.255 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-a4tech.ko 2023-07-21T21:59:59.255 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-apple.ko 2023-07-21T21:59:59.255 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-appleir.ko 2023-07-21T21:59:59.255 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8353 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-aureal.ko 2023-07-21T21:59:59.255 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-axff.ko 2023-07-21T21:59:59.255 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-belkin.ko 2023-07-21T21:59:59.256 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cherry.ko 2023-07-21T21:59:59.256 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-chicony.ko 2023-07-21T21:59:59.256 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cp2112.ko 2023-07-21T21:59:59.256 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cypress.ko 2023-07-21T21:59:59.256 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-dr.ko 2023-07-21T21:59:59.256 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elecom.ko 2023-07-21T21:59:59.256 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elo.ko 2023-07-21T21:59:59.257 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-emsff.ko 2023-07-21T21:59:59.257 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ezkey.ko 2023-07-21T21:59:59.257 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gaff.ko 2023-07-21T21:59:59.257 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-generic.ko 2023-07-21T21:59:59.257 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gt683r.ko 2023-07-21T21:59:59.257 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gyration.ko 2023-07-21T21:59:59.257 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-21T21:59:59.257 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-21T21:59:59.258 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtekff.ko 2023-07-21T21:59:59.258 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-hyperv.ko 2023-07-21T21:59:59.258 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-icade.ko 2023-07-21T21:59:59.258 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-kensington.ko 2023-07-21T21:59:59.258 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-keytouch.ko 2023-07-21T21:59:59.258 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-kye.ko 2023-07-21T21:59:59.258 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lcpower.ko 2023-07-21T21:59:59.258 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-led.ko 2023-07-21T21:59:59.259 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lenovo.ko 2023-07-21T21:59:59.259 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30761 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lg-g15.ko 2023-07-21T21:59:59.259 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-21T21:59:59.259 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 100897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-21T21:59:59.259 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 80993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech.ko 2023-07-21T21:59:59.259 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-magicmouse.ko 2023-07-21T21:59:59.259 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-microsoft.ko 2023-07-21T21:59:59.260 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-monterey.ko 2023-07-21T21:59:59.260 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-multitouch.ko 2023-07-21T21:59:59.260 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ntrig.ko 2023-07-21T21:59:59.260 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ortek.ko 2023-07-21T21:59:59.260 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-penmount.ko 2023-07-21T21:59:59.260 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-petalynx.ko 2023-07-21T21:59:59.260 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 72937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-picolcd.ko 2023-07-21T21:59:59.260 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-pl.ko 2023-07-21T21:59:59.261 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-plantronics.ko 2023-07-21T21:59:59.261 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-primax.ko 2023-07-21T21:59:59.261 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-rmi.ko 2023-07-21T21:59:59.261 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20761 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-21T21:59:59.261 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-common.ko 2023-07-21T21:59:59.261 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-21T21:59:59.261 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-21T21:59:59.262 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-21T21:59:59.262 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-21T21:59:59.262 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-21T21:59:59.262 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-21T21:59:59.262 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-21T21:59:59.262 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-21T21:59:59.262 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-21T21:59:59.262 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat.ko 2023-07-21T21:59:59.263 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-saitek.ko 2023-07-21T21:59:59.263 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-samsung.ko 2023-07-21T21:59:59.263 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-21T21:59:59.263 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sjoy.ko 2023-07-21T21:59:59.263 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sony.ko 2023-07-21T21:59:59.263 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-speedlink.ko 2023-07-21T21:59:59.263 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-steelseries.ko 2023-07-21T21:59:59.263 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sunplus.ko 2023-07-21T21:59:59.264 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-21T21:59:59.264 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tivo.ko 2023-07-21T21:59:59.264 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tmff.ko 2023-07-21T21:59:59.264 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-topseed.ko 2023-07-21T21:59:59.264 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-twinhan.ko 2023-07-21T21:59:59.264 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 71457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-uclogic.ko 2023-07-21T21:59:59.264 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-waltop.ko 2023-07-21T21:59:59.265 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 143585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-wiimote.ko 2023-07-21T21:59:59.265 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-xinmo.ko 2023-07-21T21:59:59.265 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zpff.ko 2023-07-21T21:59:59.265 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zydacron.ko 2023-07-21T21:59:59.265 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 267713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid.ko 2023-07-21T21:59:59.265 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/uhid.ko 2023-07-21T21:59:59.265 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/ 2023-07-21T21:59:59.265 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 125721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbhid.ko 2023-07-21T21:59:59.266 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbkbd.ko 2023-07-21T21:59:59.266 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbmouse.ko 2023-07-21T21:59:59.266 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 217401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/wacom.ko 2023-07-21T21:59:59.266 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/ 2023-07-21T21:59:59.266 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 63497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_balloon.ko 2023-07-21T21:59:59.266 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 89609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_utils.ko 2023-07-21T21:59:59.266 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 301449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_vmbus.ko 2023-07-21T21:59:59.266 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ 2023-07-21T21:59:59.267 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru.ko 2023-07-21T21:59:59.267 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru3.ko 2023-07-21T21:59:59.267 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-21T21:59:59.267 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7414.ko 2023-07-21T21:59:59.267 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7418.ko 2023-07-21T21:59:59.267 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adc128d818.ko 2023-07-21T21:59:59.267 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1025.ko 2023-07-21T21:59:59.267 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 97977 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1026.ko 2023-07-21T21:59:59.268 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1029.ko 2023-07-21T21:59:59.268 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1031.ko 2023-07-21T21:59:59.268 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm9240.ko 2023-07-21T21:59:59.268 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14769 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ads7828.ko 2023-07-21T21:59:59.268 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10769 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7410.ko 2023-07-21T21:59:59.268 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7411.ko 2023-07-21T21:59:59.268 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 74433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7462.ko 2023-07-21T21:59:59.268 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7470.ko 2023-07-21T21:59:59.269 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7475.ko 2023-07-21T21:59:59.269 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7x10.ko 2023-07-21T21:59:59.269 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/amc6821.ko 2023-07-21T21:59:59.269 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/applesmc.ko 2023-07-21T21:59:59.269 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asb100.ko 2023-07-21T21:59:59.269 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asc7621.ko 2023-07-21T21:59:59.269 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-21T21:59:59.269 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/atxp1.ko 2023-07-21T21:59:59.270 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28281 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/coretemp.ko 2023-07-21T21:59:59.270 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/da9052-hwmon.ko 2023-07-21T21:59:59.270 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/da9055-hwmon.ko 2023-07-21T21:59:59.270 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-21T21:59:59.270 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 99601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dme1737.ko 2023-07-21T21:59:59.270 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds1621.ko 2023-07-21T21:59:59.270 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds620.ko 2023-07-21T21:59:59.271 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29777 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc1403.ko 2023-07-21T21:59:59.271 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc2103.ko 2023-07-21T21:59:59.271 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc6w201.ko 2023-07-21T21:59:59.271 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71805f.ko 2023-07-21T21:59:59.271 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 94457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71882fg.ko 2023-07-21T21:59:59.271 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f75375s.ko 2023-07-21T21:59:59.271 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fam15h_power.ko 2023-07-21T21:59:59.271 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fschmd.ko 2023-07-21T21:59:59.272 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g760a.ko 2023-07-21T21:59:59.272 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g762.ko 2023-07-21T21:59:59.272 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl518sm.ko 2023-07-21T21:59:59.272 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl520sm.ko 2023-07-21T21:59:59.272 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/hih6130.ko 2023-07-21T21:59:59.272 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-21T21:59:59.272 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5500_temp.ko 2023-07-21T21:59:59.272 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5k_amb.ko 2023-07-21T21:59:59.273 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmaem.ko 2023-07-21T21:59:59.273 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmpex.ko 2023-07-21T21:59:59.273 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina209.ko 2023-07-21T21:59:59.273 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina2xx.ko 2023-07-21T21:59:59.273 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 129217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/it87.ko 2023-07-21T21:59:59.273 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/jc42.ko 2023-07-21T21:59:59.273 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k10temp.ko 2023-07-21T21:59:59.273 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k8temp.ko 2023-07-21T21:59:59.274 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lineage-pem.ko 2023-07-21T21:59:59.274 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm63.ko 2023-07-21T21:59:59.274 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16761 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm73.ko 2023-07-21T21:59:59.274 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36777 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm75.ko 2023-07-21T21:59:59.274 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm77.ko 2023-07-21T21:59:59.274 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm78.ko 2023-07-21T21:59:59.274 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm80.ko 2023-07-21T21:59:59.274 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm83.ko 2023-07-21T21:59:59.275 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 72833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm85.ko 2023-07-21T21:59:59.275 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm87.ko 2023-07-21T21:59:59.275 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm90.ko 2023-07-21T21:59:59.275 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm92.ko 2023-07-21T21:59:59.275 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 108841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm93.ko 2023-07-21T21:59:59.275 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95234.ko 2023-07-21T21:59:59.275 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95241.ko 2023-07-21T21:59:59.276 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95245.ko 2023-07-21T21:59:59.276 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc2945.ko 2023-07-21T21:59:59.276 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4151.ko 2023-07-21T21:59:59.276 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4215.ko 2023-07-21T21:59:59.276 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4222.ko 2023-07-21T21:59:59.276 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4245.ko 2023-07-21T21:59:59.276 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4260.ko 2023-07-21T21:59:59.276 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4261.ko 2023-07-21T21:59:59.277 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max16065.ko 2023-07-21T21:59:59.277 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1619.ko 2023-07-21T21:59:59.277 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24353 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1668.ko 2023-07-21T21:59:59.277 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max197.ko 2023-07-21T21:59:59.277 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6639.ko 2023-07-21T21:59:59.277 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6650.ko 2023-07-21T21:59:59.277 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35777 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6697.ko 2023-07-21T21:59:59.277 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/mc13783-adc.ko 2023-07-21T21:59:59.278 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/mcp3021.ko 2023-07-21T21:59:59.278 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-07-21T21:59:59.278 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6683.ko 2023-07-21T21:59:59.278 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 116737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775-core.ko 2023-07-21T21:59:59.278 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775.ko 2023-07-21T21:59:59.278 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct7802.ko 2023-07-21T21:59:59.278 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 82337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87360.ko 2023-07-21T21:59:59.278 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87427.ko 2023-07-21T21:59:59.279 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pcf8591.ko 2023-07-21T21:59:59.279 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ 2023-07-21T21:59:59.279 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21353 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-21T21:59:59.279 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-21T21:59:59.279 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-21T21:59:59.279 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-21T21:59:59.279 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-21T21:59:59.279 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-21T21:59:59.280 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-21T21:59:59.280 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 81841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-21T21:59:59.280 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-21T21:59:59.280 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-21T21:59:59.280 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-21T21:59:59.280 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-21T21:59:59.280 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/powr1220.ko 2023-07-21T21:59:59.281 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5627.ko 2023-07-21T21:59:59.281 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5636.ko 2023-07-21T21:59:59.281 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-21T21:59:59.281 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht15.ko 2023-07-21T21:59:59.281 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht21.ko 2023-07-21T21:59:59.281 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/shtc1.ko 2023-07-21T21:59:59.281 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sis5595.ko 2023-07-21T21:59:59.281 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smm665.ko 2023-07-21T21:59:59.282 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47b397.ko 2023-07-21T21:59:59.282 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m1.ko 2023-07-21T21:59:59.282 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m192.ko 2023-07-21T21:59:59.282 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/thmc50.ko 2023-07-21T21:59:59.282 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp102.ko 2023-07-21T21:59:59.282 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp103.ko 2023-07-21T21:59:59.282 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp401.ko 2023-07-21T21:59:59.282 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp421.ko 2023-07-21T21:59:59.283 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via-cputemp.ko 2023-07-21T21:59:59.283 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via686a.ko 2023-07-21T21:59:59.283 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt1211.ko 2023-07-21T21:59:59.283 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt8231.ko 2023-07-21T21:59:59.283 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57513 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627ehf.ko 2023-07-21T21:59:59.283 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627hf.ko 2023-07-21T21:59:59.283 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 71345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83781d.ko 2023-07-21T21:59:59.283 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 63289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83791d.ko 2023-07-21T21:59:59.284 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 71321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83792d.ko 2023-07-21T21:59:59.284 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 101457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83793.ko 2023-07-21T21:59:59.284 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 119505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83795.ko 2023-07-21T21:59:59.284 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l785ts.ko 2023-07-21T21:59:59.284 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l786ng.ko 2023-07-21T21:59:59.284 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-07-21T21:59:59.284 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-07-21T21:59:59.285 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/ 2023-07-21T21:59:59.285 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/ 2023-07-21T21:59:59.285 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-21T21:59:59.285 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-21T21:59:59.285 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/ 2023-07-21T21:59:59.285 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-07-21T21:59:59.285 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-07-21T21:59:59.286 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27777 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-07-21T21:59:59.286 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-21T21:59:59.286 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-21T21:59:59.286 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-21T21:59:59.286 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-07-21T21:59:59.286 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-21T21:59:59.286 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-07-21T21:59:59.286 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-21T21:59:59.287 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23905 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-21T21:59:59.287 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-21T21:59:59.287 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-21T21:59:59.287 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-07-21T21:59:59.287 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-07-21T21:59:59.287 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 62729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-21T21:59:59.287 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-21T21:59:59.287 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-21T21:59:59.288 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17369 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-07-21T21:59:59.288 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-21T21:59:59.288 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-21T21:59:59.288 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-07-21T21:59:59.288 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-21T21:59:59.288 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-21T21:59:59.288 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-21T21:59:59.289 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-07-21T21:59:59.289 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-21T21:59:59.289 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-21T21:59:59.289 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-07-21T21:59:59.289 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-07-21T21:59:59.289 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-21T21:59:59.289 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-07-21T21:59:59.289 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-21T21:59:59.290 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-21T21:59:59.290 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-21T21:59:59.290 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-21T21:59:59.290 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-07-21T21:59:59.290 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-mux.ko 2023-07-21T21:59:59.290 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-smbus.ko 2023-07-21T21:59:59.290 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-stub.ko 2023-07-21T21:59:59.290 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/ 2023-07-21T21:59:59.291 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-07-21T21:59:59.291 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-07-21T21:59:59.291 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-07-21T21:59:59.291 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ 2023-07-21T21:59:59.291 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ 2023-07-21T21:59:59.291 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 273641 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-21T21:59:59.291 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 876913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_core.ko 2023-07-21T21:59:59.291 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 69321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-21T21:59:59.292 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 324145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-21T21:59:59.292 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 97961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-21T21:59:59.292 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 279321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-21T21:59:59.292 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-21T21:59:59.292 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ 2023-07-21T21:59:59.292 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4/ 2023-07-21T21:59:59.292 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 492561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-21T21:59:59.293 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4/ 2023-07-21T21:59:59.293 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 419217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-21T21:59:59.293 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5/ 2023-07-21T21:59:59.293 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 739705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-21T21:59:59.293 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca/ 2023-07-21T21:59:59.293 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 296649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-21T21:59:59.293 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ocrdma/ 2023-07-21T21:59:59.293 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 153681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-07-21T21:59:59.294 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/usnic/ 2023-07-21T21:59:59.294 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 169017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-07-21T21:59:59.294 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ 2023-07-21T21:59:59.294 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib/ 2023-07-21T21:59:59.294 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 263177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-21T21:59:59.294 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser/ 2023-07-21T21:59:59.294 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 100225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-21T21:59:59.294 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert/ 2023-07-21T21:59:59.295 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 111993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-21T21:59:59.295 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp/ 2023-07-21T21:59:59.295 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 129081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-21T21:59:59.295 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt/ 2023-07-21T21:59:59.295 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 129553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-21T21:59:59.295 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/ 2023-07-21T21:59:59.295 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/evbug.ko 2023-07-21T21:59:59.295 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/ff-memless.ko 2023-07-21T21:59:59.296 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/ 2023-07-21T21:59:59.296 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-21T21:59:59.296 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-21T21:59:59.296 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/gameport.ko 2023-07-21T21:59:59.296 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/lightning.ko 2023-07-21T21:59:59.296 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/ns558.ko 2023-07-21T21:59:59.296 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/joydev.ko 2023-07-21T21:59:59.296 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/ 2023-07-21T21:59:59.297 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-07-21T21:59:59.297 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-07-21T21:59:59.297 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26905 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-07-21T21:59:59.297 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24761 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-07-21T21:59:59.297 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-21T21:59:59.297 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-07-21T21:59:59.297 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lkkbd.ko 2023-07-21T21:59:59.298 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lm8323.ko 2023-07-21T21:59:59.298 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lm8333.ko 2023-07-21T21:59:59.298 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-07-21T21:59:59.298 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-07-21T21:59:59.298 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-07-21T21:59:59.298 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-07-21T21:59:59.298 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/newtonkbd.ko 2023-07-21T21:59:59.298 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-07-21T21:59:59.299 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/qt1070.ko 2023-07-21T21:59:59.299 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/qt2160.ko 2023-07-21T21:59:59.299 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-07-21T21:59:59.299 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/stowaway.ko 2023-07-21T21:59:59.299 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/sunkbd.ko 2023-07-21T21:59:59.299 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-07-21T21:59:59.299 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-07-21T21:59:59.299 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-07-21T21:59:59.300 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/xtkbd.ko 2023-07-21T21:59:59.300 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/matrix-keymap.ko 2023-07-21T21:59:59.300 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/ 2023-07-21T21:59:59.300 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/appletouch.ko 2023-07-21T21:59:59.300 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/bcm5974.ko 2023-07-21T21:59:59.300 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 123681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/cyapatp.ko 2023-07-21T21:59:59.300 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 89449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-21T21:59:59.300 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/gpio_mouse.ko 2023-07-21T21:59:59.301 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 335849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/psmouse.ko 2023-07-21T21:59:59.301 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/sermouse.ko 2023-07-21T21:59:59.301 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-21T21:59:59.301 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-21T21:59:59.301 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-21T21:59:59.301 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4/ 2023-07-21T21:59:59.301 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 109849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-21T21:59:59.302 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ 2023-07-21T21:59:59.302 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/altera_ps2.ko 2023-07-21T21:59:59.302 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/arc_ps2.ko 2023-07-21T21:59:59.302 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ct82c710.ko 2023-07-21T21:59:59.302 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-21T21:59:59.302 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/parkbd.ko 2023-07-21T21:59:59.302 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/pcips2.ko 2023-07-21T21:59:59.302 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ps2mult.ko 2023-07-21T21:59:59.303 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/serio_raw.ko 2023-07-21T21:59:59.303 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17977 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/serport.ko 2023-07-21T21:59:59.303 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/sparse-keymap.ko 2023-07-21T21:59:59.303 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/ 2023-07-21T21:59:59.303 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd/ 2023-07-21T21:59:59.303 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-21T21:59:59.303 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/ 2023-07-21T21:59:59.303 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-88pm860x.ko 2023-07-21T21:59:59.304 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-adp5520.ko 2023-07-21T21:59:59.304 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-bd2802.ko 2023-07-21T21:59:59.304 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-blinkm.ko 2023-07-21T21:59:59.304 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-da903x.ko 2023-07-21T21:59:59.304 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-da9052.ko 2023-07-21T21:59:59.304 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-gpio.ko 2023-07-21T21:59:59.304 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3530.ko 2023-07-21T21:59:59.304 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3533.ko 2023-07-21T21:59:59.305 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19353 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm355x.ko 2023-07-21T21:59:59.305 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3642.ko 2023-07-21T21:59:59.305 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lp3944.ko 2023-07-21T21:59:59.305 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lp8788.ko 2023-07-21T21:59:59.305 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-max8997.ko 2023-07-21T21:59:59.305 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-mc13783.ko 2023-07-21T21:59:59.305 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-menf21bmc.ko 2023-07-21T21:59:59.305 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca9532.ko 2023-07-21T21:59:59.306 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca955x.ko 2023-07-21T21:59:59.306 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca963x.ko 2023-07-21T21:59:59.306 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-ss4200.ko 2023-07-21T21:59:59.306 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-tca6507.ko 2023-07-21T21:59:59.306 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-wm831x-status.ko 2023-07-21T21:59:59.306 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-wm8350.ko 2023-07-21T21:59:59.306 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ 2023-07-21T21:59:59.306 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-21T21:59:59.307 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-21T21:59:59.307 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-21T21:59:59.307 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-21T21:59:59.307 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-21T21:59:59.307 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-21T21:59:59.307 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-21T21:59:59.307 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-21T21:59:59.308 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/ 2023-07-21T21:59:59.308 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache/ 2023-07-21T21:59:59.308 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 655473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache/bcache.ko 2023-07-21T21:59:59.308 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-bio-prison.ko 2023-07-21T21:59:59.308 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 89601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-bufio.ko 2023-07-21T21:59:59.308 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache-smq.ko 2023-07-21T21:59:59.308 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 155993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache.ko 2023-07-21T21:59:59.308 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 107049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-crypt.ko 2023-07-21T21:59:59.309 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-delay.ko 2023-07-21T21:59:59.309 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-era.ko 2023-07-21T21:59:59.309 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-flakey.ko 2023-07-21T21:59:59.309 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-log-userspace.ko 2023-07-21T21:59:59.309 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-log.ko 2023-07-21T21:59:59.309 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-mirror.ko 2023-07-21T21:59:59.309 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-multipath.ko 2023-07-21T21:59:59.309 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-queue-length.ko 2023-07-21T21:59:59.310 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70769 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-raid.ko 2023-07-21T21:59:59.310 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-region-hash.ko 2023-07-21T21:59:59.310 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-round-robin.ko 2023-07-21T21:59:59.310 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-service-time.ko 2023-07-21T21:59:59.310 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 109593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-snapshot.ko 2023-07-21T21:59:59.310 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-switch.ko 2023-07-21T21:59:59.310 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 181585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-thin-pool.ko 2023-07-21T21:59:59.310 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-verity.ko 2023-07-21T21:59:59.311 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-zero.ko 2023-07-21T21:59:59.311 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/faulty.ko 2023-07-21T21:59:59.311 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/linear.ko 2023-07-21T21:59:59.311 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/multipath.ko 2023-07-21T21:59:59.311 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data/ 2023-07-21T21:59:59.311 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 199937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-21T21:59:59.311 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid0.ko 2023-07-21T21:59:59.311 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 112609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid1.ko 2023-07-21T21:59:59.312 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 160553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid10.ko 2023-07-21T21:59:59.312 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 396153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid456.ko 2023-07-21T21:59:59.312 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/ 2023-07-21T21:59:59.312 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/ 2023-07-21T21:59:59.312 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 178113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptbase.ko 2023-07-21T21:59:59.312 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 63385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptctl.ko 2023-07-21T21:59:59.312 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptfc.ko 2023-07-21T21:59:59.313 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptlan.ko 2023-07-21T21:59:59.313 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 123305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptsas.ko 2023-07-21T21:59:59.313 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 79017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptscsih.ko 2023-07-21T21:59:59.313 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptspi.ko 2023-07-21T21:59:59.313 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/ 2023-07-21T21:59:59.313 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm800.ko 2023-07-21T21:59:59.313 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12761 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm805.ko 2023-07-21T21:59:59.313 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm80x.ko 2023-07-21T21:59:59.314 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/arizona-i2c.ko 2023-07-21T21:59:59.314 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 123721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/arizona.ko 2023-07-21T21:59:59.314 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/bcm590xx.ko 2023-07-21T21:59:59.314 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/cros_ec_dev.ko 2023-07-21T21:59:59.314 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/dln2.ko 2023-07-21T21:59:59.314 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/janz-cmodio.ko 2023-07-21T21:59:59.314 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/kempld-core.ko 2023-07-21T21:59:59.314 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lm3533-core.ko 2023-07-21T21:59:59.315 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-07-21T21:59:59.315 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13009 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lp3943.ko 2023-07-21T21:59:59.315 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_ich.ko 2023-07-21T21:59:59.315 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_sch.ko 2023-07-21T21:59:59.315 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/max8907.ko 2023-07-21T21:59:59.315 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/mc13xxx-core.ko 2023-07-21T21:59:59.315 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-07-21T21:59:59.315 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/menf21bmc.ko 2023-07-21T21:59:59.316 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633-adc.ko 2023-07-21T21:59:59.316 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633-gpio.ko 2023-07-21T21:59:59.316 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633.ko 2023-07-21T21:59:59.316 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-07-21T21:59:59.316 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/retu-mfd.ko 2023-07-21T21:59:59.316 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 80425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/si476x-core.ko 2023-07-21T21:59:59.316 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/sm501.ko 2023-07-21T21:59:59.316 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-07-21T21:59:59.317 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/tps65010.ko 2023-07-21T21:59:59.317 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/tps6507x.ko 2023-07-21T21:59:59.317 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/viperboard.ko 2023-07-21T21:59:59.317 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/vx855.ko 2023-07-21T21:59:59.317 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/wl1273-core.ko 2023-07-21T21:59:59.317 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/wm8994.ko 2023-07-21T21:59:59.317 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ 2023-07-21T21:59:59.318 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-07-21T21:59:59.318 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ad525x_dpot.ko 2023-07-21T21:59:59.318 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl/ 2023-07-21T21:59:59.318 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-21T21:59:59.318 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds9802als.ko 2023-07-21T21:59:59.318 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds990x.ko 2023-07-21T21:59:59.318 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/bh1770glc.ko 2023-07-21T21:59:59.318 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/ 2023-07-21T21:59:59.319 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-07-21T21:59:59.319 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/core.ko 2023-07-21T21:59:59.319 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710/ 2023-07-21T21:59:59.319 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710/cb710.ko 2023-07-21T21:59:59.319 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ds1682.ko 2023-07-21T21:59:59.319 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/dummy-irq.ko 2023-07-21T21:59:59.319 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/echo/ 2023-07-21T21:59:59.319 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/echo/echo.ko 2023-07-21T21:59:59.320 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/ 2023-07-21T21:59:59.320 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/at24.ko 2023-07-21T21:59:59.320 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-21T21:59:59.320 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14769 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-21T21:59:59.320 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/max6875.ko 2023-07-21T21:59:59.320 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/enclosure.ko 2023-07-21T21:59:59.320 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/genwqe/ 2023-07-21T21:59:59.320 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 152137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-07-21T21:59:59.321 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/hmc6352.ko 2023-07-21T21:59:59.321 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/hpilo.ko 2023-07-21T21:59:59.321 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ibmasm/ 2023-07-21T21:59:59.321 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 72601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-07-21T21:59:59.321 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ics932s401.ko 2023-07-21T21:59:59.321 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29003.ko 2023-07-21T21:59:59.321 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29020.ko 2023-07-21T21:59:59.321 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/ 2023-07-21T21:59:59.322 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-21T21:59:59.322 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-21T21:59:59.322 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/ 2023-07-21T21:59:59.322 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 125209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-me.ko 2023-07-21T21:59:59.322 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 56521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-txe.ko 2023-07-21T21:59:59.322 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 309857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei.ko 2023-07-21T21:59:59.322 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/phantom.ko 2023-07-21T21:59:59.322 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ti-st/ 2023-07-21T21:59:59.323 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 74905 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ti-st/st_drv.ko 2023-07-21T21:59:59.323 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_7xx1.ko 2023-07-21T21:59:59.323 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_core.ko 2023-07-21T21:59:59.323 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tsl2550.ko 2023-07-21T21:59:59.323 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_balloon.ko 2023-07-21T21:59:59.323 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci/ 2023-07-21T21:59:59.323 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 183857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-21T21:59:59.324 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ 2023-07-21T21:59:59.324 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding/ 2023-07-21T21:59:59.324 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 487801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding/bonding.ko 2023-07-21T21:59:59.324 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/ 2023-07-21T21:59:59.324 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53/ 2023-07-21T21:59:59.324 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 106009 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-21T21:59:59.324 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40281 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-21T21:59:59.324 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-21T21:59:59.325 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx/ 2023-07-21T21:59:59.325 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 452481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-21T21:59:59.367 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dummy.ko 2023-07-21T21:59:59.368 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/eql.ko 2023-07-21T21:59:59.368 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ 2023-07-21T21:59:59.368 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/ 2023-07-21T21:59:59.368 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-21T21:59:59.368 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-21T21:59:59.368 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 130489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-21T21:59:59.368 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 68785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-21T21:59:59.369 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/ 2023-07-21T21:59:59.369 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-21T21:59:59.369 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-21T21:59:59.369 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-21T21:59:59.369 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 99113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-21T21:59:59.369 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec/ 2023-07-21T21:59:59.369 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-21T21:59:59.369 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere/ 2023-07-21T21:59:59.370 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 69145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-21T21:59:59.370 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon/ 2023-07-21T21:59:59.370 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-21T21:59:59.370 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera/ 2023-07-21T21:59:59.370 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-21T21:59:59.370 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/ 2023-07-21T21:59:59.370 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-21T21:59:59.371 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-21T21:59:59.371 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 87345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-21T21:59:59.371 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/ 2023-07-21T21:59:59.371 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx/ 2023-07-21T21:59:59.371 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 97321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-21T21:59:59.371 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-07-21T21:59:59.371 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 104585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-21T21:59:59.371 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-07-21T21:59:59.372 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 90257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-21T21:59:59.372 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/ 2023-07-21T21:59:59.372 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 81505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-21T21:59:59.372 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 69713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-21T21:59:59.372 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/ 2023-07-21T21:59:59.372 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-21T21:59:59.372 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 176881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-21T21:59:59.373 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-07-21T21:59:59.373 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1422209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-21T21:59:59.373 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 128377 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-21T21:59:59.373 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet/ 2023-07-21T21:59:59.373 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 132289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-21T21:59:59.373 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 312145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-21T21:59:59.373 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/ 2023-07-21T21:59:59.373 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna/ 2023-07-21T21:59:59.374 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 323601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-21T21:59:59.374 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/ 2023-07-21T21:59:59.374 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-07-21T21:59:59.374 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 193433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-21T21:59:59.374 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-07-21T21:59:59.374 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 347641 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-21T21:59:59.374 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-07-21T21:59:59.374 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1044145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-21T21:59:59.375 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-07-21T21:59:59.375 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 166113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-21T21:59:59.375 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-07-21T21:59:59.375 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-21T21:59:59.375 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/ 2023-07-21T21:59:59.375 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic/ 2023-07-21T21:59:59.375 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 204329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-21T21:59:59.375 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/ 2023-07-21T21:59:59.376 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/ 2023-07-21T21:59:59.376 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 69449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-21T21:59:59.376 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-21T21:59:59.376 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 141161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-21T21:59:59.376 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-21T21:59:59.376 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 62865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-21T21:59:59.376 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-21T21:59:59.377 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/ 2023-07-21T21:59:59.377 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-21T21:59:59.377 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 62833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-21T21:59:59.377 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dnet.ko 2023-07-21T21:59:59.377 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ec_bhf.ko 2023-07-21T21:59:59.377 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/ 2023-07-21T21:59:59.377 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet/ 2023-07-21T21:59:59.378 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 281329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-21T21:59:59.378 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ethoc.ko 2023-07-21T21:59:59.378 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fealnx.ko 2023-07-21T21:59:59.378 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fujitsu/ 2023-07-21T21:59:59.378 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45281 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-07-21T21:59:59.378 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ 2023-07-21T21:59:59.378 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 90465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-21T21:59:59.378 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000/ 2023-07-21T21:59:59.379 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 295713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-21T21:59:59.379 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e/ 2023-07-21T21:59:59.379 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 584249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-21T21:59:59.379 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k/ 2023-07-21T21:59:59.379 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 246321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-21T21:59:59.379 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e/ 2023-07-21T21:59:59.379 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 923969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-21T21:59:59.379 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf/ 2023-07-21T21:59:59.380 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 298097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-21T21:59:59.380 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb/ 2023-07-21T21:59:59.380 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 514889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-21T21:59:59.380 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf/ 2023-07-21T21:59:59.380 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 93593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-21T21:59:59.380 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-07-21T21:59:59.380 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 734297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-21T21:59:59.381 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-07-21T21:59:59.381 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 151841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-21T21:59:59.381 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 86921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/jme.ko 2023-07-21T21:59:59.381 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/ 2023-07-21T21:59:59.381 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20977 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-21T21:59:59.381 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 102385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-21T21:59:59.381 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 122681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-21T21:59:59.381 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/ 2023-07-21T21:59:59.382 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-07-21T21:59:59.382 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 727433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-21T21:59:59.382 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 280513 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-21T21:59:59.382 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-07-21T21:59:59.382 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-07-21T21:59:59.382 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1095817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-21T21:59:59.382 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ 2023-07-21T21:59:59.382 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-07-21T21:59:59.383 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-07-21T21:59:59.383 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-07-21T21:59:59.383 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 95665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-21T21:59:59.383 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/ 2023-07-21T21:59:59.383 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-07-21T21:59:59.383 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 108809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-21T21:59:59.383 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/ 2023-07-21T21:59:59.383 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73377 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-21T21:59:59.384 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-21T21:59:59.384 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion/ 2023-07-21T21:59:59.384 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 150905 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-21T21:59:59.384 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia/ 2023-07-21T21:59:59.384 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 136785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-21T21:59:59.384 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/ 2023-07-21T21:59:59.384 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-21T21:59:59.385 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-21T21:59:59.385 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/ 2023-07-21T21:59:59.385 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-07-21T21:59:59.385 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 227113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-21T21:59:59.385 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 87081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-21T21:59:59.385 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-07-21T21:59:59.385 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 671393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-21T21:59:59.385 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc/ 2023-07-21T21:59:59.386 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-21T21:59:59.386 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/ 2023-07-21T21:59:59.386 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-21T21:59:59.386 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 83921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-21T21:59:59.386 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-21T21:59:59.386 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 190089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-21T21:59:59.386 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/ 2023-07-21T21:59:59.387 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-07-21T21:59:59.387 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 104241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-07-21T21:59:59.387 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc/ 2023-07-21T21:59:59.387 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 952881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-21T21:59:59.387 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan/ 2023-07-21T21:59:59.387 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-21T21:59:59.387 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/ 2023-07-21T21:59:59.387 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-21T21:59:59.388 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 63273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-21T21:59:59.388 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/ 2023-07-21T21:59:59.388 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-21T21:59:59.388 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-21T21:59:59.388 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-21T21:59:59.388 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 68209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-21T21:59:59.388 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/ 2023-07-21T21:59:59.388 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-07-21T21:59:59.389 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-07-21T21:59:59.389 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-21T21:59:59.389 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20769 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-07-21T21:59:59.389 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 481681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-21T21:59:59.389 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/ 2023-07-21T21:59:59.389 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 103321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-21T21:59:59.389 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 166121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-21T21:59:59.389 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-21T21:59:59.390 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-21T21:59:59.390 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti/ 2023-07-21T21:59:59.390 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-21T21:59:59.390 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti/ 2023-07-21T21:59:59.390 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 86465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-21T21:59:59.390 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/ 2023-07-21T21:59:59.390 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 80257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-21T21:59:59.391 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 83681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-21T21:59:59.391 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/ 2023-07-21T21:59:59.391 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-21T21:59:59.391 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-21T21:59:59.391 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom/ 2023-07-21T21:59:59.391 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-21T21:59:59.391 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/ 2023-07-21T21:59:59.391 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/defxx.ko 2023-07-21T21:59:59.392 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/skfp/ 2023-07-21T21:59:59.392 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 216977 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/skfp/skfp.ko 2023-07-21T21:59:59.392 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 77401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/geneve.ko 2023-07-21T21:59:59.392 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv/ 2023-07-21T21:59:59.392 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 235593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-21T21:59:59.392 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154/ 2023-07-21T21:59:59.392 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-21T21:59:59.392 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ifb.ko 2023-07-21T21:59:59.393 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan/ 2023-07-21T21:59:59.393 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 83737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-21T21:59:59.393 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 62065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvlan.ko 2023-07-21T21:59:59.393 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvtap.ko 2023-07-21T21:59:59.393 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/ 2023-07-21T21:59:59.393 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-21T21:59:59.393 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-21T21:59:59.394 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-gpio.ko 2023-07-21T21:59:59.394 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-21T21:59:59.394 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio.ko 2023-07-21T21:59:59.394 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20513 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mii.ko 2023-07-21T21:59:59.394 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/netconsole.ko 2023-07-21T21:59:59.394 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/nlmon.ko 2023-07-21T21:59:59.394 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/ 2023-07-21T21:59:59.394 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-21T21:59:59.395 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-21T21:59:59.395 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/ 2023-07-21T21:59:59.395 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/amd.ko 2023-07-21T21:59:59.395 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-21T21:59:59.395 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-21T21:59:59.395 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm87xx.ko 2023-07-21T21:59:59.395 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/broadcom.ko 2023-07-21T21:59:59.395 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/cicada.ko 2023-07-21T21:59:59.396 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/davicom.ko 2023-07-21T21:59:59.396 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/et1011c.ko 2023-07-21T21:59:59.396 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24905 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/icplus.ko 2023-07-21T21:59:59.396 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/lxt.ko 2023-07-21T21:59:59.396 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/marvell.ko 2023-07-21T21:59:59.396 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 75713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/micrel.ko 2023-07-21T21:59:59.396 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/national.ko 2023-07-21T21:59:59.396 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 97265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/phylink.ko 2023-07-21T21:59:59.397 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/qsemi.ko 2023-07-21T21:59:59.397 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/realtek.ko 2023-07-21T21:59:59.397 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/smsc.ko 2023-07-21T21:59:59.397 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/ste10Xp.ko 2023-07-21T21:59:59.397 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/vitesse.ko 2023-07-21T21:59:59.397 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/plip/ 2023-07-21T21:59:59.397 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/plip/plip.ko 2023-07-21T21:59:59.398 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ 2023-07-21T21:59:59.398 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-21T21:59:59.398 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_async.ko 2023-07-21T21:59:59.398 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-21T21:59:59.398 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-21T21:59:59.398 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-21T21:59:59.398 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppoe.ko 2023-07-21T21:59:59.398 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppox.ko 2023-07-21T21:59:59.399 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pptp.ko 2023-07-21T21:59:59.399 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/sb1000.ko 2023-07-21T21:59:59.399 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/ 2023-07-21T21:59:59.399 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42513 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/slip.ko 2023-07-21T21:59:59.399 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/sungem_phy.ko 2023-07-21T21:59:59.399 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 64889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/tap.ko 2023-07-21T21:59:59.399 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/ 2023-07-21T21:59:59.399 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 105961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team.ko 2023-07-21T21:59:59.400 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-21T21:59:59.400 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-21T21:59:59.400 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-21T21:59:59.400 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9641 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_random.ko 2023-07-21T21:59:59.400 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-21T21:59:59.400 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 88193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/veth.ko 2023-07-21T21:59:59.400 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3/ 2023-07-21T21:59:59.400 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 120497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-21T21:59:59.401 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan/ 2023-07-21T21:59:59.401 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 290665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan/vxlan.ko 2023-07-21T21:59:59.401 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback/ 2023-07-21T21:59:59.401 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 143801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-21T21:59:59.401 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb/ 2023-07-21T21:59:59.401 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb/ntb.ko 2023-07-21T21:59:59.401 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/ 2023-07-21T21:59:59.402 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/ 2023-07-21T21:59:59.402 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 266561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme-core.ko 2023-07-21T21:59:59.402 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 101937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme.ko 2023-07-21T21:59:59.402 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/ 2023-07-21T21:59:59.402 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 133817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport.ko 2023-07-21T21:59:59.402 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_cs.ko 2023-07-21T21:59:59.402 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 84337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_pc.ko 2023-07-21T21:59:59.402 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_serial.ko 2023-07-21T21:59:59.403 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/ 2023-07-21T21:59:59.403 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/ 2023-07-21T21:59:59.403 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25009 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-21T21:59:59.403 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-07-21T21:59:59.403 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-07-21T21:59:59.403 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/pci-stub.ko 2023-07-21T21:59:59.403 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47377 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/xen-pcifront.ko 2023-07-21T21:59:59.403 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/ 2023-07-21T21:59:59.404 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/i82092.ko 2023-07-21T21:59:59.404 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 145785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia.ko 2023-07-21T21:59:59.404 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 62081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia_core.ko 2023-07-21T21:59:59.404 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-07-21T21:59:59.404 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pd6729.ko 2023-07-21T21:59:59.404 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 112913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-21T21:59:59.404 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/ 2023-07-21T21:59:59.405 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/broadcom/ 2023-07-21T21:59:59.405 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-07-21T21:59:59.405 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/samsung/ 2023-07-21T21:59:59.405 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-07-21T21:59:59.405 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/ 2023-07-21T21:59:59.405 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel/ 2023-07-21T21:59:59.405 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 71521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-21T21:59:59.405 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/ 2023-07-21T21:59:59.406 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/ 2023-07-21T21:59:59.406 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-07-21T21:59:59.406 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec.ko 2023-07-21T21:59:59.406 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-07-21T21:59:59.406 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-07-21T21:59:59.406 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-07-21T21:59:59.406 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-07-21T21:59:59.406 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-07-21T21:59:59.407 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/ 2023-07-21T21:59:59.407 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-21T21:59:59.407 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acerhdf.ko 2023-07-21T21:59:59.407 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-21T21:59:59.407 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-21T21:59:59.407 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-21T21:59:59.407 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 106873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-21T21:59:59.407 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-21T21:59:59.408 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-21T21:59:59.408 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-21T21:59:59.408 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-21T21:59:59.408 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-21T21:59:59.408 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/hdaps.ko 2023-07-21T21:59:59.408 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/ibm_rtl.ko 2023-07-21T21:59:59.408 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/ 2023-07-21T21:59:59.409 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-21T21:59:59.409 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-07-21T21:59:59.409 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel_ips.ko 2023-07-21T21:59:59.409 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-21T21:59:59.409 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10377 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-21T21:59:59.409 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-21T21:59:59.409 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-21T21:59:59.409 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-21T21:59:59.410 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-21T21:59:59.410 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-21T21:59:59.410 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-21T21:59:59.410 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-21T21:59:59.410 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi.ko 2023-07-21T21:59:59.410 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/ 2023-07-21T21:59:59.410 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ 2023-07-21T21:59:59.410 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/88pm860x_battery.ko 2023-07-21T21:59:59.411 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/88pm860x_charger.ko 2023-07-21T21:59:59.411 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq2415x_charger.ko 2023-07-21T21:59:59.411 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq24190_charger.ko 2023-07-21T21:59:59.411 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq24735-charger.ko 2023-07-21T21:59:59.411 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-07-21T21:59:59.411 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/da9030_battery.ko 2023-07-21T21:59:59.411 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/da9052-battery.ko 2023-07-21T21:59:59.411 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29281 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2760_battery.ko 2023-07-21T21:59:59.412 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2780_battery.ko 2023-07-21T21:59:59.412 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23353 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2781_battery.ko 2023-07-21T21:59:59.412 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2782_battery.ko 2023-07-21T21:59:59.412 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20353 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/gpio-charger.ko 2023-07-21T21:59:59.412 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/isp1704_charger.ko 2023-07-21T21:59:59.412 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/lp8727_charger.ko 2023-07-21T21:59:59.412 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max14577_charger.ko 2023-07-21T21:59:59.413 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max17040_battery.ko 2023-07-21T21:59:59.413 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max17042_battery.ko 2023-07-21T21:59:59.413 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max8903_charger.ko 2023-07-21T21:59:59.413 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max8925_power.ko 2023-07-21T21:59:59.413 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/pcf50633-charger.ko 2023-07-21T21:59:59.413 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38009 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/sbs-battery.ko 2023-07-21T21:59:59.413 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/test_power.ko 2023-07-21T21:59:59.413 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/tps65090-charger.ko 2023-07-21T21:59:59.414 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm831x_backup.ko 2023-07-21T21:59:59.414 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm831x_power.ko 2023-07-21T21:59:59.414 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm8350_power.ko 2023-07-21T21:59:59.414 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/ 2023-07-21T21:59:59.414 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-21T21:59:59.414 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-21T21:59:59.414 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/ 2023-07-21T21:59:59.414 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/ 2023-07-21T21:59:59.415 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-21T21:59:59.415 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-21T21:59:59.415 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps_parport.ko 2023-07-21T21:59:59.415 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/pps_core.ko 2023-07-21T21:59:59.415 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ 2023-07-21T21:59:59.415 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp.ko 2023-07-21T21:59:59.415 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp_kvm.ko 2023-07-21T21:59:59.415 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/ 2023-07-21T21:59:59.416 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-88pm80x.ko 2023-07-21T21:59:59.416 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-88pm860x.ko 2023-07-21T21:59:59.416 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-21T21:59:59.416 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-21T21:59:59.416 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9052.ko 2023-07-21T21:59:59.416 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9055.ko 2023-07-21T21:59:59.416 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9063.ko 2023-07-21T21:59:59.417 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-21T21:59:59.417 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 68577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-21T21:59:59.417 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-21T21:59:59.417 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-21T21:59:59.417 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-21T21:59:59.417 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-21T21:59:59.417 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13369 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-21T21:59:59.417 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-21T21:59:59.418 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-21T21:59:59.418 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-em3027.ko 2023-07-21T21:59:59.418 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-21T21:59:59.418 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-21T21:59:59.418 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-21T21:59:59.418 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-lp8788.ko 2023-07-21T21:59:59.418 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-21T21:59:59.418 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-21T21:59:59.419 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-21T21:59:59.419 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t86.ko 2023-07-21T21:59:59.419 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11633 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max6900.ko 2023-07-21T21:59:59.419 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8907.ko 2023-07-21T21:59:59.419 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8925.ko 2023-07-21T21:59:59.419 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8997.ko 2023-07-21T21:59:59.419 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8998.ko 2023-07-21T21:59:59.419 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18513 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-07-21T21:59:59.420 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-21T21:59:59.420 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-palmas.ko 2023-07-21T21:59:59.420 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-21T21:59:59.420 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17977 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf50633.ko 2023-07-21T21:59:59.420 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-21T21:59:59.420 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-21T21:59:59.420 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-21T21:59:59.420 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-21T21:59:59.421 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rc5t583.ko 2023-07-21T21:59:59.421 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-21T21:59:59.421 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-21T21:59:59.421 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-21T21:59:59.421 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-21T21:59:59.421 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-21T21:59:59.421 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-s35390a.ko 2023-07-21T21:59:59.422 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-21T21:59:59.422 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-tps6586x.ko 2023-07-21T21:59:59.422 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-tps65910.ko 2023-07-21T21:59:59.422 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-wm831x.ko 2023-07-21T21:59:59.422 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-wm8350.ko 2023-07-21T21:59:59.422 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-x1205.ko 2023-07-21T21:59:59.422 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ 2023-07-21T21:59:59.422 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 77617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-9xxx.ko 2023-07-21T21:59:59.423 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-sas.ko 2023-07-21T21:59:59.423 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-xxxx.ko 2023-07-21T21:59:59.423 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 135169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/BusLogic.ko 2023-07-21T21:59:59.423 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/a100u2w.ko 2023-07-21T21:59:59.423 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid/ 2023-07-21T21:59:59.423 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 272353 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-21T21:59:59.423 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 100617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/advansys.ko 2023-07-21T21:59:59.423 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/ 2023-07-21T21:59:59.424 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 356265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-21T21:59:59.424 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 295801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-21T21:59:59.424 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic94xx/ 2023-07-21T21:59:59.424 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 189321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-07-21T21:59:59.424 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/am53c974.ko 2023-07-21T21:59:59.424 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr/ 2023-07-21T21:59:59.424 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 106569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-21T21:59:59.424 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/atp870u.ko 2023-07-21T21:59:59.425 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi/ 2023-07-21T21:59:59.425 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 246897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-21T21:59:59.425 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa/ 2023-07-21T21:59:59.425 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1172185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa/bfa.ko 2023-07-21T21:59:59.425 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc/ 2023-07-21T21:59:59.425 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 237169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-21T21:59:59.425 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i/ 2023-07-21T21:59:59.425 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 115393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-21T21:59:59.426 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ch.ko 2023-07-21T21:59:59.426 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor/ 2023-07-21T21:59:59.426 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 308889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-21T21:59:59.426 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/ 2023-07-21T21:59:59.426 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-07-21T21:59:59.426 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 76193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-21T21:59:59.426 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-07-21T21:59:59.427 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 101449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-21T21:59:59.427 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 146785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-21T21:59:59.427 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 75529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dc395x.ko 2023-07-21T21:59:59.427 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dmx3191d.ko 2023-07-21T21:59:59.427 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r/ 2023-07-21T21:59:59.427 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 212401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-21T21:59:59.427 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esp_scsi.ko 2023-07-21T21:59:59.427 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/ 2023-07-21T21:59:59.428 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-21T21:59:59.428 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 158193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-21T21:59:59.428 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fdomain.ko 2023-07-21T21:59:59.428 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic/ 2023-07-21T21:59:59.428 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 261913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic/fnic.ko 2023-07-21T21:59:59.428 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 201793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hpsa.ko 2023-07-21T21:59:59.428 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hptiop.ko 2023-07-21T21:59:59.428 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hv_storvsc.ko 2023-07-21T21:59:59.429 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/imm.ko 2023-07-21T21:59:59.429 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/initio.ko 2023-07-21T21:59:59.429 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 266521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ipr.ko 2023-07-21T21:59:59.429 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 101881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ips.ko 2023-07-21T21:59:59.429 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci/ 2023-07-21T21:59:59.429 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 317249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci/isci.ko 2023-07-21T21:59:59.429 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-21T21:59:59.430 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-21T21:59:59.430 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc/ 2023-07-21T21:59:59.430 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 314961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc/libfc.ko 2023-07-21T21:59:59.430 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 145569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi.ko 2023-07-21T21:59:59.430 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-21T21:59:59.430 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas/ 2023-07-21T21:59:59.430 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 217209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas/libsas.ko 2023-07-21T21:59:59.430 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc/ 2023-07-21T21:59:59.431 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 2192449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-21T21:59:59.431 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/ 2023-07-21T21:59:59.431 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-21T21:59:59.431 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-21T21:59:59.431 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 310729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-21T21:59:59.431 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 84697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid.ko 2023-07-21T21:59:59.431 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas/ 2023-07-21T21:59:59.431 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 659577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-21T21:59:59.432 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas/ 2023-07-21T21:59:59.432 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 119929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-21T21:59:59.432 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvumi.ko 2023-07-21T21:59:59.432 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/ 2023-07-21T21:59:59.432 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 81601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-07-21T21:59:59.432 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-07-21T21:59:59.432 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-07-21T21:59:59.432 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-07-21T21:59:59.433 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001/ 2023-07-21T21:59:59.433 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 364257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-21T21:59:59.433 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 123489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pmcraid.ko 2023-07-21T21:59:59.433 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ppa.ko 2023-07-21T21:59:59.433 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla1280.ko 2023-07-21T21:59:59.433 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/ 2023-07-21T21:59:59.433 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1860025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-21T21:59:59.433 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 85313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-21T21:59:59.434 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx/ 2023-07-21T21:59:59.434 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 558865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-21T21:59:59.434 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qlogicfas408.ko 2023-07-21T21:59:59.434 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/raid_class.ko 2023-07-21T21:59:59.434 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 238801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_debug.ko 2023-07-21T21:59:59.434 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 173921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-21T21:59:59.434 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 278865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-21T21:59:59.435 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 97705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-21T21:59:59.435 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-21T21:59:59.435 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-21T21:59:59.435 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ses.ko 2023-07-21T21:59:59.435 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 115849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/st.ko 2023-07-21T21:59:59.435 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/stex.ko 2023-07-21T21:59:59.435 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2/ 2023-07-21T21:59:59.435 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 162121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-21T21:59:59.436 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/virtio_scsi.ko 2023-07-21T21:59:59.436 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-21T21:59:59.436 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/wd719x.ko 2023-07-21T21:59:59.436 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/xen-scsifront.ko 2023-07-21T21:59:59.436 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb/ 2023-07-21T21:59:59.436 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 129417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb/ssb.ko 2023-07-21T21:59:59.436 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/ 2023-07-21T21:59:59.436 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi/ 2023-07-21T21:59:59.437 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 739089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-21T21:59:59.437 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback/ 2023-07-21T21:59:59.437 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-21T21:59:59.437 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_file.ko 2023-07-21T21:59:59.437 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_iblock.ko 2023-07-21T21:59:59.437 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 931721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_mod.ko 2023-07-21T21:59:59.437 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_pscsi.ko 2023-07-21T21:59:59.438 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 122545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_user.ko 2023-07-21T21:59:59.438 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc/ 2023-07-21T21:59:59.438 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 75641 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-21T21:59:59.438 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/ 2023-07-21T21:59:59.438 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/ 2023-07-21T21:59:59.438 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/ 2023-07-21T21:59:59.438 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-21T21:59:59.438 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-21T21:59:59.439 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-21T21:59:59.439 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-21T21:59:59.439 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-21T21:59:59.439 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-21T21:59:59.439 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-21T21:59:59.439 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20281 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-21T21:59:59.439 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-21T21:59:59.439 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-21T21:59:59.440 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-21T21:59:59.440 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-21T21:59:59.440 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-07-21T21:59:59.440 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-21T21:59:59.440 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-21T21:59:59.440 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-21T21:59:59.440 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ 2023-07-21T21:59:59.440 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless/ 2023-07-21T21:59:59.441 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-21T21:59:59.441 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/moxa.ko 2023-07-21T21:59:59.441 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 50793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/mxser.ko 2023-07-21T21:59:59.441 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 107545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_gsm.ko 2023-07-21T21:59:59.441 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_hdlc.ko 2023-07-21T21:59:59.441 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 68137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/nozomi.ko 2023-07-21T21:59:59.441 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/ 2023-07-21T21:59:59.442 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/ 2023-07-21T21:59:59.442 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-07-21T21:59:59.442 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-21T21:59:59.442 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-07-21T21:59:59.442 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/altera_uart.ko 2023-07-21T21:59:59.442 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/arc_uart.ko 2023-07-21T21:59:59.442 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 72193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-07-21T21:59:59.442 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm/ 2023-07-21T21:59:59.443 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 103017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-21T21:59:59.443 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/rp2.ko 2023-07-21T21:59:59.443 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/sc16is7xx.ko 2023-07-21T21:59:59.443 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 100185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/synclink_gt.ko 2023-07-21T21:59:59.443 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/ 2023-07-21T21:59:59.443 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core/ 2023-07-21T21:59:59.443 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 536617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-21T21:59:59.443 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ 2023-07-21T21:59:59.444 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28377 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-21T21:59:59.444 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-07-21T21:59:59.444 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/ 2023-07-21T21:59:59.444 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio.ko 2023-07-21T21:59:59.444 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_aec.ko 2023-07-21T21:59:59.444 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11281 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_cif.ko 2023-07-21T21:59:59.444 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_dmem_genirq.ko 2023-07-21T21:59:59.445 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_mf624.ko 2023-07-21T21:59:59.445 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_netx.ko 2023-07-21T21:59:59.445 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_pci_generic.ko 2023-07-21T21:59:59.445 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-07-21T21:59:59.445 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13633 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_sercos3.ko 2023-07-21T21:59:59.445 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/ 2023-07-21T21:59:59.445 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/c67x00/ 2023-07-21T21:59:59.445 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/c67x00/c67x00.ko 2023-07-21T21:59:59.446 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ 2023-07-21T21:59:59.446 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 143785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-07-21T21:59:59.446 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-07-21T21:59:59.446 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-07-21T21:59:59.446 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-07-21T21:59:59.446 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/ 2023-07-21T21:59:59.446 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 85457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-acm.ko 2023-07-21T21:59:59.446 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-21T21:59:59.447 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usblp.ko 2023-07-21T21:59:59.447 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 89833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usbtmc.ko 2023-07-21T21:59:59.447 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/common/ 2023-07-21T21:59:59.447 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/common/ulpi.ko 2023-07-21T21:59:59.447 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc2/ 2023-07-21T21:59:59.447 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-07-21T21:59:59.447 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/ 2023-07-21T21:59:59.447 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-07-21T21:59:59.448 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-07-21T21:59:59.448 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 445801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3.ko 2023-07-21T21:59:59.448 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/ 2023-07-21T21:59:59.448 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/ 2023-07-21T21:59:59.448 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/u_ether.ko 2023-07-21T21:59:59.448 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/u_serial.ko 2023-07-21T21:59:59.448 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-07-21T21:59:59.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-07-21T21:59:59.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-07-21T21:59:59.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-07-21T21:59:59.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 92377 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-07-21T21:59:59.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-07-21T21:59:59.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 122073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-07-21T21:59:59.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-07-21T21:59:59.449 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-07-21T21:59:59.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-07-21T21:59:59.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-07-21T21:59:59.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 85841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-07-21T21:59:59.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-07-21T21:59:59.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-07-21T21:59:59.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-07-21T21:59:59.450 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/ 2023-07-21T21:59:59.450 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-07-21T21:59:59.451 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-07-21T21:59:59.451 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-07-21T21:59:59.451 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-07-21T21:59:59.451 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-07-21T21:59:59.451 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-07-21T21:59:59.451 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-07-21T21:59:59.451 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16977 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-07-21T21:59:59.451 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-07-21T21:59:59.452 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-07-21T21:59:59.452 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-07-21T21:59:59.452 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-07-21T21:59:59.452 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 62153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-07-21T21:59:59.452 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15201 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-07-21T21:59:59.452 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 161233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/libcomposite.ko 2023-07-21T21:59:59.452 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/ 2023-07-21T21:59:59.452 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-07-21T21:59:59.453 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/bdc/ 2023-07-21T21:59:59.453 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 157665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-07-21T21:59:59.453 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-07-21T21:59:59.453 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-07-21T21:59:59.453 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 69689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-07-21T21:59:59.453 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 56009 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-07-21T21:59:59.453 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 76033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/net2272.ko 2023-07-21T21:59:59.454 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 75057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/net2280.ko 2023-07-21T21:59:59.454 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-07-21T21:59:59.454 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 65793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-07-21T21:59:59.454 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-07-21T21:59:59.454 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 81489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-07-21T21:59:59.454 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 156033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-07-21T21:59:59.454 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/ 2023-07-21T21:59:59.454 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/bcma-hcd.ko 2023-07-21T21:59:59.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 80097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/isp116x-hcd.ko 2023-07-21T21:59:59.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 87337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-07-21T21:59:59.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-07-21T21:59:59.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-21T21:59:59.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/sl811_cs.ko 2023-07-21T21:59:59.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/ssb-hcd.ko 2023-07-21T21:59:59.455 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-07-21T21:59:59.455 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/ 2023-07-21T21:59:59.456 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/mdc800.ko 2023-07-21T21:59:59.456 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/microtek.ko 2023-07-21T21:59:59.456 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ 2023-07-21T21:59:59.456 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/adutux.ko 2023-07-21T21:59:59.456 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/appledisplay.ko 2023-07-21T21:59:59.456 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-07-21T21:59:59.456 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/cytherm.ko 2023-07-21T21:59:59.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ehset.ko 2023-07-21T21:59:59.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi26.ko 2023-07-21T21:59:59.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi62.ko 2023-07-21T21:59:59.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ezusb.ko 2023-07-21T21:59:59.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/idmouse.ko 2023-07-21T21:59:59.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/iowarrior.ko 2023-07-21T21:59:59.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-21T21:59:59.457 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ldusb.ko 2023-07-21T21:59:59.458 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/legousbtower.ko 2023-07-21T21:59:59.458 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/lvstest.ko 2023-07-21T21:59:59.458 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga/ 2023-07-21T21:59:59.458 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 64841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-21T21:59:59.458 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-21T21:59:59.458 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usb3503.ko 2023-07-21T21:59:59.458 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usblcd.ko 2023-07-21T21:59:59.458 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-21T21:59:59.459 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usbtest.ko 2023-07-21T21:59:59.459 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/uss720.ko 2023-07-21T21:59:59.459 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/yurex.ko 2023-07-21T21:59:59.459 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/mon/ 2023-07-21T21:59:59.459 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/mon/usbmon.ko 2023-07-21T21:59:59.459 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/musb/ 2023-07-21T21:59:59.459 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 301521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/musb/musb_hdrc.ko 2023-07-21T21:59:59.459 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/ 2023-07-21T21:59:59.460 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-generic.ko 2023-07-21T21:59:59.460 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-07-21T21:59:59.460 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-isp1301.ko 2023-07-21T21:59:59.460 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-tahvo.ko 2023-07-21T21:59:59.460 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ 2023-07-21T21:59:59.460 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/aircable.ko 2023-07-21T21:59:59.460 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ark3116.ko 2023-07-21T21:59:59.460 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-21T21:59:59.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ch341.ko 2023-07-21T21:59:59.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 70209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cp210x.ko 2023-07-21T21:59:59.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cyberjack.ko 2023-07-21T21:59:59.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-21T21:59:59.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-21T21:59:59.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/empeg.ko 2023-07-21T21:59:59.461 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/f81232.ko 2023-07-21T21:59:59.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 175145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-21T21:59:59.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-21T21:59:59.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 137105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-21T21:59:59.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 124673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_ti.ko 2023-07-21T21:59:59.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67769 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipaq.ko 2023-07-21T21:59:59.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipw.ko 2023-07-21T21:59:59.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ir-usb.ko 2023-07-21T21:59:59.462 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 57937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-21T21:59:59.463 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 107417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan.ko 2023-07-21T21:59:59.463 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-21T21:59:59.463 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-21T21:59:59.463 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-21T21:59:59.463 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mct_u232.ko 2023-07-21T21:59:59.463 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/metro-usb.ko 2023-07-21T21:59:59.463 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7720.ko 2023-07-21T21:59:59.463 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 78113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7840.ko 2023-07-21T21:59:59.464 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 56593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mxuport.ko 2023-07-21T21:59:59.464 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/navman.ko 2023-07-21T21:59:59.464 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/omninet.ko 2023-07-21T21:59:59.464 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24281 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/opticon.ko 2023-07-21T21:59:59.464 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 189729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/option.ko 2023-07-21T21:59:59.464 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38905 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/oti6858.ko 2023-07-21T21:59:59.464 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/pl2303.ko 2023-07-21T21:59:59.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcaux.ko 2023-07-21T21:59:59.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcserial.ko 2023-07-21T21:59:59.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/quatech2.ko 2023-07-21T21:59:59.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/safe_serial.ko 2023-07-21T21:59:59.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 51297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/sierra.ko 2023-07-21T21:59:59.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-21T21:59:59.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ssu100.ko 2023-07-21T21:59:59.465 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/symbolserial.ko 2023-07-21T21:59:59.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-21T21:59:59.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-21T21:59:59.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_debug.ko 2023-07-21T21:59:59.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-21T21:59:59.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 125505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usbserial.ko 2023-07-21T21:59:59.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/visor.ko 2023-07-21T21:59:59.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/whiteheat.ko 2023-07-21T21:59:59.466 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/wishbone-serial.ko 2023-07-21T21:59:59.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-21T21:59:59.467 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ 2023-07-21T21:59:59.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/uas.ko 2023-07-21T21:59:59.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-21T21:59:59.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-21T21:59:59.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-21T21:59:59.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-21T21:59:59.467 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-21T21:59:59.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19769 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-21T21:59:59.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-21T21:59:59.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-karma.ko 2023-07-21T21:59:59.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-21T21:59:59.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-21T21:59:59.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28905 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-21T21:59:59.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-21T21:59:59.468 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-21T21:59:59.469 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 180017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/usb-storage.ko 2023-07-21T21:59:59.469 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/ 2023-07-21T21:59:59.469 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-21T21:59:59.469 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 71345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-21T21:59:59.469 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 105401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-21T21:59:59.469 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/ 2023-07-21T21:59:59.469 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/ 2023-07-21T21:59:59.470 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 153697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-21T21:59:59.470 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-21T21:59:59.470 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 100569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio.ko 2023-07-21T21:59:59.470 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 75137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-21T21:59:59.470 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/ 2023-07-21T21:59:59.470 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 113889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost.ko 2023-07-21T21:59:59.471 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-21T21:59:59.471 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_net.ko 2023-07-21T21:59:59.471 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 86521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_scsi.ko 2023-07-21T21:59:59.471 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/ 2023-07-21T21:59:59.471 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/ 2023-07-21T21:59:59.471 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-07-21T21:59:59.471 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/aat2870_bl.ko 2023-07-21T21:59:59.471 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp5520_bl.ko 2023-07-21T21:59:59.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp8860_bl.ko 2023-07-21T21:59:59.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp8870_bl.ko 2023-07-21T21:59:59.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/apple_bl.ko 2023-07-21T21:59:59.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16777 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/as3711_bl.ko 2023-07-21T21:59:59.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/bd6107.ko 2023-07-21T21:59:59.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/da903x_bl.ko 2023-07-21T21:59:59.472 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/da9052_bl.ko 2023-07-21T21:59:59.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/gpio_backlight.ko 2023-07-21T21:59:59.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14769 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/kb3886_bl.ko 2023-07-21T21:59:59.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lcd.ko 2023-07-21T21:59:59.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lm3533_bl.ko 2023-07-21T21:59:59.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lm3639_bl.ko 2023-07-21T21:59:59.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lv5207lp.ko 2023-07-21T21:59:59.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/max8925_bl.ko 2023-07-21T21:59:59.473 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/pandora_bl.ko 2023-07-21T21:59:59.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-07-21T21:59:59.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-21T21:59:59.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/wm831x_bl.ko 2023-07-21T21:59:59.474 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/ 2023-07-21T21:59:59.474 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ 2023-07-21T21:59:59.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2482.ko 2023-07-21T21:59:59.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2490.ko 2023-07-21T21:59:59.474 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/matrox_w1.ko 2023-07-21T21:59:59.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/w1-gpio.ko 2023-07-21T21:59:59.475 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/ 2023-07-21T21:59:59.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-21T21:59:59.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-21T21:59:59.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-21T21:59:59.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-21T21:59:59.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-21T21:59:59.475 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-21T21:59:59.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-21T21:59:59.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-21T21:59:59.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-21T21:59:59.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-21T21:59:59.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 56425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-21T21:59:59.476 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 102657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/wire.ko 2023-07-21T21:59:59.476 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ 2023-07-21T21:59:59.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/acquirewdt.ko 2023-07-21T21:59:59.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19977 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/advantechwdt.ko 2023-07-21T21:59:59.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-21T21:59:59.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-21T21:59:59.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/cpu5wdt.ko 2023-07-21T21:59:59.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9052_wdt.ko 2023-07-21T21:59:59.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12777 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9055_wdt.ko 2023-07-21T21:59:59.477 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9063_wdt.ko 2023-07-21T21:59:59.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/dw_wdt.ko 2023-07-21T21:59:59.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/eurotechwdt.ko 2023-07-21T21:59:59.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-21T21:59:59.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/hpwdt.ko 2023-07-21T21:59:59.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/i6300esb.ko 2023-07-21T21:59:59.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-21T21:59:59.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-21T21:59:59.478 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ib700wdt.ko 2023-07-21T21:59:59.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ibmasr.ko 2023-07-21T21:59:59.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-21T21:59:59.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-21T21:59:59.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it87_wdt.ko 2023-07-21T21:59:59.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/kempld_wdt.ko 2023-07-21T21:59:59.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/machzwd.ko 2023-07-21T21:59:59.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/mena21_wdt.ko 2023-07-21T21:59:59.479 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-07-21T21:59:59.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/nv_tco.ko 2023-07-21T21:59:59.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-07-21T21:59:59.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pc87413_wdt.ko 2023-07-21T21:59:59.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-21T21:59:59.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-21T21:59:59.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/retu_wdt.ko 2023-07-21T21:59:59.480 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-07-21T21:59:59.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-07-21T21:59:59.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-21T21:59:59.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sc1200wdt.ko 2023-07-21T21:59:59.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-21T21:59:59.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-07-21T21:59:59.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/softdog.ko 2023-07-21T21:59:59.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-21T21:59:59.481 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/twl4030_wdt.ko 2023-07-21T21:59:59.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/via_wdt.ko 2023-07-21T21:59:59.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-21T21:59:59.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-21T21:59:59.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-21T21:59:59.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wafer5823wdt.ko 2023-07-21T21:59:59.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wdt_pci.ko 2023-07-21T21:59:59.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wm831x_wdt.ko 2023-07-21T21:59:59.482 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wm8350_wdt.ko 2023-07-21T21:59:59.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/xen_wdt.ko 2023-07-21T21:59:59.483 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/ 2023-07-21T21:59:59.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-evtchn.ko 2023-07-21T21:59:59.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntalloc.ko 2023-07-21T21:59:59.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntdev.ko 2023-07-21T21:59:59.483 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback/ 2023-07-21T21:59:59.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 176417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-21T21:59:59.483 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-privcmd.ko 2023-07-21T21:59:59.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 71321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-scsiback.ko 2023-07-21T21:59:59.484 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs/ 2023-07-21T21:59:59.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-21T21:59:59.484 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ 2023-07-21T21:59:59.484 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p/ 2023-07-21T21:59:59.484 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 165697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p/9p.ko 2023-07-21T21:59:59.484 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/adfs/ 2023-07-21T21:59:59.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/adfs/adfs.ko 2023-07-21T21:59:59.485 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs/ 2023-07-21T21:59:59.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 162617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs/affs.ko 2023-07-21T21:59:59.485 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/afs/ 2023-07-21T21:59:59.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 931937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/afs/kafs.ko 2023-07-21T21:59:59.485 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/autofs/ 2023-07-21T21:59:59.485 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 100937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/autofs/autofs4.ko 2023-07-21T21:59:59.485 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs/ 2023-07-21T21:59:59.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 64481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs/befs.ko 2023-07-21T21:59:59.486 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/bfs/ 2023-07-21T21:59:59.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/bfs/bfs.ko 2023-07-21T21:59:59.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/binfmt_misc.ko 2023-07-21T21:59:59.486 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs/ 2023-07-21T21:59:59.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 3468681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs/btrfs.ko 2023-07-21T21:59:59.486 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles/ 2023-07-21T21:59:59.486 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 305745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles/cachefiles.ko 2023-07-21T21:59:59.487 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph/ 2023-07-21T21:59:59.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1312545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph/ceph.ko 2023-07-21T21:59:59.487 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda/ 2023-07-21T21:59:59.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 100321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda/coda.ko 2023-07-21T21:59:59.487 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/configfs/ 2023-07-21T21:59:59.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 108073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/configfs/configfs.ko 2023-07-21T21:59:59.487 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs/ 2023-07-21T21:59:59.487 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs/cramfs.ko 2023-07-21T21:59:59.488 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm/ 2023-07-21T21:59:59.488 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 633825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm/dlm.ko 2023-07-21T21:59:59.488 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/efs/ 2023-07-21T21:59:59.488 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/efs/efs.ko 2023-07-21T21:59:59.488 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs/ 2023-07-21T21:59:59.488 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1500513 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs/f2fs.ko 2023-07-21T21:59:59.488 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/ 2023-07-21T21:59:59.488 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/msdos.ko 2023-07-21T21:59:59.489 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/freevxfs/ 2023-07-21T21:59:59.489 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/freevxfs/freevxfs.ko 2023-07-21T21:59:59.489 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache/ 2023-07-21T21:59:59.489 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 226505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache/fscache.ko 2023-07-21T21:59:59.489 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/ 2023-07-21T21:59:59.489 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/cuse.ko 2023-07-21T21:59:59.489 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2/ 2023-07-21T21:59:59.490 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1226249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2/gfs2.ko 2023-07-21T21:59:59.490 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs/ 2023-07-21T21:59:59.490 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 141241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs/hfs.ko 2023-07-21T21:59:59.490 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus/ 2023-07-21T21:59:59.490 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 221553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus/hfsplus.ko 2023-07-21T21:59:59.490 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hpfs/ 2023-07-21T21:59:59.490 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 193577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hpfs/hpfs.ko 2023-07-21T21:59:59.490 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs/ 2023-07-21T21:59:59.491 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 74393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs/isofs.ko 2023-07-21T21:59:59.491 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs/ 2023-07-21T21:59:59.491 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 420745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs/jfs.ko 2023-07-21T21:59:59.491 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd/ 2023-07-21T21:59:59.491 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 279041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd/lockd.ko 2023-07-21T21:59:59.491 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix/ 2023-07-21T21:59:59.491 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 87897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix/minix.ko 2023-07-21T21:59:59.491 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs/ 2023-07-21T21:59:59.492 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 124697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs/netfs.ko 2023-07-21T21:59:59.492 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/ 2023-07-21T21:59:59.492 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout/ 2023-07-21T21:59:59.492 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 81521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-21T21:59:59.492 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout/ 2023-07-21T21:59:59.492 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-21T21:59:59.492 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout/ 2023-07-21T21:59:59.492 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 117705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-21T21:59:59.493 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1053889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfs.ko 2023-07-21T21:59:59.493 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv2.ko 2023-07-21T21:59:59.493 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 119801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv3.ko 2023-07-21T21:59:59.493 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 2041809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv4.ko 2023-07-21T21:59:59.493 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/ 2023-07-21T21:59:59.493 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/grace.ko 2023-07-21T21:59:59.493 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/nfs_acl.ko 2023-07-21T21:59:59.493 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd/ 2023-07-21T21:59:59.494 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1504993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd/nfsd.ko 2023-07-21T21:59:59.494 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2/ 2023-07-21T21:59:59.494 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 591417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2/nilfs2.ko 2023-07-21T21:59:59.494 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/ 2023-07-21T21:59:59.494 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-celtic.ko 2023-07-21T21:59:59.494 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-centeuro.ko 2023-07-21T21:59:59.494 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-croatian.ko 2023-07-21T21:59:59.495 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-cyrillic.ko 2023-07-21T21:59:59.495 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-gaelic.ko 2023-07-21T21:59:59.495 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-greek.ko 2023-07-21T21:59:59.495 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-iceland.ko 2023-07-21T21:59:59.495 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-inuit.ko 2023-07-21T21:59:59.495 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-roman.ko 2023-07-21T21:59:59.495 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-romanian.ko 2023-07-21T21:59:59.495 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-turkish.ko 2023-07-21T21:59:59.496 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_ascii.ko 2023-07-21T21:59:59.496 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1250.ko 2023-07-21T21:59:59.496 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1251.ko 2023-07-21T21:59:59.496 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1255.ko 2023-07-21T21:59:59.496 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp737.ko 2023-07-21T21:59:59.496 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp775.ko 2023-07-21T21:59:59.496 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp850.ko 2023-07-21T21:59:59.496 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp852.ko 2023-07-21T21:59:59.497 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp855.ko 2023-07-21T21:59:59.497 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp857.ko 2023-07-21T21:59:59.497 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp860.ko 2023-07-21T21:59:59.497 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp861.ko 2023-07-21T21:59:59.497 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp862.ko 2023-07-21T21:59:59.497 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp863.ko 2023-07-21T21:59:59.497 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp864.ko 2023-07-21T21:59:59.497 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp865.ko 2023-07-21T21:59:59.498 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp866.ko 2023-07-21T21:59:59.498 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp869.ko 2023-07-21T21:59:59.498 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp874.ko 2023-07-21T21:59:59.498 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 94137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp932.ko 2023-07-21T21:59:59.498 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 142673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp936.ko 2023-07-21T21:59:59.498 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 165745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp949.ko 2023-07-21T21:59:59.498 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 118121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp950.ko 2023-07-21T21:59:59.498 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_euc-jp.ko 2023-07-21T21:59:59.499 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-1.ko 2023-07-21T21:59:59.499 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-13.ko 2023-07-21T21:59:59.499 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-14.ko 2023-07-21T21:59:59.499 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-15.ko 2023-07-21T21:59:59.499 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-2.ko 2023-07-21T21:59:59.499 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-3.ko 2023-07-21T21:59:59.499 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-4.ko 2023-07-21T21:59:59.500 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-5.ko 2023-07-21T21:59:59.500 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-6.ko 2023-07-21T21:59:59.500 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-7.ko 2023-07-21T21:59:59.500 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-9.ko 2023-07-21T21:59:59.500 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-r.ko 2023-07-21T21:59:59.500 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-ru.ko 2023-07-21T21:59:59.500 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-u.ko 2023-07-21T21:59:59.500 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_utf8.ko 2023-07-21T21:59:59.501 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ntfs/ 2023-07-21T21:59:59.501 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 219073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ntfs/ntfs.ko 2023-07-21T21:59:59.501 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ 2023-07-21T21:59:59.501 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster/ 2023-07-21T21:59:59.501 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 244177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-21T21:59:59.501 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm/ 2023-07-21T21:59:59.501 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 440785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-21T21:59:59.501 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs/ 2023-07-21T21:59:59.502 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-21T21:59:59.502 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 2589569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2.ko 2023-07-21T21:59:59.524 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17905 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-21T21:59:59.524 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-21T21:59:59.524 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-21T21:59:59.524 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/omfs/ 2023-07-21T21:59:59.525 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 52569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/omfs/omfs.ko 2023-07-21T21:59:59.525 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs/ 2023-07-21T21:59:59.525 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 336473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs/overlay.ko 2023-07-21T21:59:59.525 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore/ 2023-07-21T21:59:59.525 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore/ramoops.ko 2023-07-21T21:59:59.525 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx4/ 2023-07-21T21:59:59.525 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx4/qnx4.ko 2023-07-21T21:59:59.526 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx6/ 2023-07-21T21:59:59.526 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 46649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx6/qnx6.ko 2023-07-21T21:59:59.526 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/ 2023-07-21T21:59:59.526 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_tree.ko 2023-07-21T21:59:59.526 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_v1.ko 2023-07-21T21:59:59.526 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_v2.ko 2023-07-21T21:59:59.526 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs/ 2023-07-21T21:59:59.526 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 530697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs/reiserfs.ko 2023-07-21T21:59:59.527 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs/ 2023-07-21T21:59:59.527 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs/romfs.ko 2023-07-21T21:59:59.527 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/ 2023-07-21T21:59:59.527 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client/ 2023-07-21T21:59:59.527 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 2658777 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client/cifs.ko 2023-07-21T21:59:59.527 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/ 2023-07-21T21:59:59.527 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_arc4.ko 2023-07-21T21:59:59.527 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_md4.ko 2023-07-21T21:59:59.528 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs/ 2023-07-21T21:59:59.528 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 134313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs/squashfs.ko 2023-07-21T21:59:59.528 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv/ 2023-07-21T21:59:59.528 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 89737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv/sysv.ko 2023-07-21T21:59:59.528 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf/ 2023-07-21T21:59:59.528 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 248049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf/udf.ko 2023-07-21T21:59:59.528 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs/ 2023-07-21T21:59:59.529 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 160857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs/ufs.ko 2023-07-21T21:59:59.529 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs/ 2023-07-21T21:59:59.529 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 3998129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs/xfs.ko 2023-07-21T21:59:59.529 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/ 2023-07-21T21:59:59.529 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/locking/ 2023-07-21T21:59:59.529 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 74865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/locking/locktorture.ko 2023-07-21T21:59:59.529 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/time/ 2023-07-21T21:59:59.529 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/time/test_udelay.ko 2023-07-21T21:59:59.530 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 58473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/torture.ko 2023-07-21T21:59:59.530 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ 2023-07-21T21:59:59.530 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc-itu-t.ko 2023-07-21T21:59:59.530 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc7.ko 2023-07-21T21:59:59.530 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc8.ko 2023-07-21T21:59:59.530 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/ 2023-07-21T21:59:59.530 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libarc4.ko 2023-07-21T21:59:59.530 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libdes.ko 2023-07-21T21:59:59.531 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/interval_tree_test.ko 2023-07-21T21:59:59.531 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/libcrc32c.ko 2023-07-21T21:59:59.531 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lru_cache.ko 2023-07-21T21:59:59.531 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/ 2023-07-21T21:59:59.531 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4_compress.ko 2023-07-21T21:59:59.531 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22633 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4hc_compress.ko 2023-07-21T21:59:59.531 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math/ 2023-07-21T21:59:59.531 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math/cordic.ko 2023-07-21T21:59:59.532 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/memory-notifier-error-inject.ko 2023-07-21T21:59:59.532 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/notifier-error-inject.ko 2023-07-21T21:59:59.532 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/percpu_test.ko 2023-07-21T21:59:59.532 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/pm-notifier-error-inject.ko 2023-07-21T21:59:59.532 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6/ 2023-07-21T21:59:59.532 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 143433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6/raid6_pq.ko 2023-07-21T21:59:59.532 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/rbtree_test.ko 2023-07-21T21:59:59.533 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon/ 2023-07-21T21:59:59.533 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-21T21:59:59.533 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test-kstrtox.ko 2023-07-21T21:59:59.533 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test-string_helpers.ko 2023-07-21T21:59:59.533 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 4760825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_bpf.ko 2023-07-21T21:59:59.533 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_firmware.ko 2023-07-21T21:59:59.533 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6369 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_module.ko 2023-07-21T21:59:59.533 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_user_copy.ko 2023-07-21T21:59:59.534 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_bm.ko 2023-07-21T21:59:59.534 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_fsm.ko 2023-07-21T21:59:59.534 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_kmp.ko 2023-07-21T21:59:59.534 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/xz/ 2023-07-21T21:59:59.534 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/xz/xz_dec_test.ko 2023-07-21T21:59:59.534 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm/ 2023-07-21T21:59:59.534 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm/hwpoison-inject.ko 2023-07-21T21:59:59.534 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ 2023-07-21T21:59:59.535 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/ 2023-07-21T21:59:59.535 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/6lowpan.ko 2023-07-21T21:59:59.535 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_dest.ko 2023-07-21T21:59:59.535 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_fragment.ko 2023-07-21T21:59:59.535 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_hop.ko 2023-07-21T21:59:59.535 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 6985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-21T21:59:59.535 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_mobility.ko 2023-07-21T21:59:59.535 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_routing.ko 2023-07-21T21:59:59.536 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_udp.ko 2023-07-21T21:59:59.536 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/ 2023-07-21T21:59:59.536 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/garp.ko 2023-07-21T21:59:59.536 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/mrp.ko 2023-07-21T21:59:59.536 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/p8022.ko 2023-07-21T21:59:59.536 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/psnap.ko 2023-07-21T21:59:59.536 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/stp.ko 2023-07-21T21:59:59.537 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q/ 2023-07-21T21:59:59.537 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 81017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q/8021q.ko 2023-07-21T21:59:59.537 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/ 2023-07-21T21:59:59.537 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 198417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet.ko 2023-07-21T21:59:59.537 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_fd.ko 2023-07-21T21:59:59.537 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_rdma.ko 2023-07-21T21:59:59.537 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_virtio.ko 2023-07-21T21:59:59.537 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv/ 2023-07-21T21:59:59.538 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 652553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv/batman-adv.ko 2023-07-21T21:59:59.538 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/ 2023-07-21T21:59:59.538 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 63825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/br_netfilter.ko 2023-07-21T21:59:59.538 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 772505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/bridge.ko 2023-07-21T21:59:59.538 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ 2023-07-21T21:59:59.538 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-21T21:59:59.538 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-21T21:59:59.538 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-21T21:59:59.539 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-21T21:59:59.539 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-21T21:59:59.539 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-21T21:59:59.539 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-21T21:59:59.539 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-21T21:59:59.539 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-21T21:59:59.539 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7585 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-21T21:59:59.540 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-21T21:59:59.540 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8385 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-21T21:59:59.540 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-21T21:59:59.540 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-21T21:59:59.540 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-21T21:59:59.540 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-21T21:59:59.540 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-21T21:59:59.540 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-21T21:59:59.541 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-21T21:59:59.541 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-21T21:59:59.541 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 55937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtables.ko 2023-07-21T21:59:59.541 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-21T21:59:59.541 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-21T21:59:59.541 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph/ 2023-07-21T21:59:59.541 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1046417 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph/libceph.ko 2023-07-21T21:59:59.541 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/ 2023-07-21T21:59:59.542 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 124793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/pktgen.ko 2023-07-21T21:59:59.542 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/ 2023-07-21T21:59:59.542 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 194321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp.ko 2023-07-21T21:59:59.542 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8665 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_diag.ko 2023-07-21T21:59:59.542 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 56945 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv4.ko 2023-07-21T21:59:59.542 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv6.ko 2023-07-21T21:59:59.542 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/ 2023-07-21T21:59:59.542 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 390297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/dsa_core.ko 2023-07-21T21:59:59.543 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_brcm.ko 2023-07-21T21:59:59.543 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_dsa.ko 2023-07-21T21:59:59.543 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_none.ko 2023-07-21T21:59:59.543 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_trailer.ko 2023-07-21T21:59:59.543 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/hsr/ 2023-07-21T21:59:59.543 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 100257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/hsr/hsr.ko 2023-07-21T21:59:59.543 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ 2023-07-21T21:59:59.544 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan/ 2023-07-21T21:59:59.544 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 45169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-21T21:59:59.544 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 254601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154.ko 2023-07-21T21:59:59.544 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-21T21:59:59.544 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ 2023-07-21T21:59:59.544 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ah4.ko 2023-07-21T21:59:59.544 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/esp4.ko 2023-07-21T21:59:59.544 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/fou.ko 2023-07-21T21:59:59.545 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/gre.ko 2023-07-21T21:59:59.545 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/inet_diag.ko 2023-07-21T21:59:59.545 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 60529 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_gre.ko 2023-07-21T21:59:59.545 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61281 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_tunnel.ko 2023-07-21T21:59:59.545 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34369 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_vti.ko 2023-07-21T21:59:59.545 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipcomp.ko 2023-07-21T21:59:59.545 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28889 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipip.ko 2023-07-21T21:59:59.545 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ 2023-07-21T21:59:59.546 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-21T21:59:59.546 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-21T21:59:59.546 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-21T21:59:59.546 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ip_tables.ko 2023-07-21T21:59:59.546 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-21T21:59:59.546 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-07-21T21:59:59.546 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-21T21:59:59.546 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-21T21:59:59.547 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-21T21:59:59.547 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-07-21T21:59:59.547 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-21T21:59:59.547 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-21T21:59:59.547 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-21T21:59:59.547 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-21T21:59:59.547 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-21T21:59:59.547 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-21T21:59:59.548 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-21T21:59:59.548 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-21T21:59:59.548 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-21T21:59:59.548 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20561 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-07-21T21:59:59.548 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-21T21:59:59.548 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15225 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-21T21:59:59.548 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-21T21:59:59.549 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-21T21:59:59.549 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9009 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-21T21:59:59.549 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_bic.ko 2023-07-21T21:59:59.549 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_dctcp.ko 2023-07-21T21:59:59.549 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_diag.ko 2023-07-21T21:59:59.549 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_highspeed.ko 2023-07-21T21:59:59.549 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_htcp.ko 2023-07-21T21:59:59.549 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_hybla.ko 2023-07-21T21:59:59.550 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_illinois.ko 2023-07-21T21:59:59.550 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_lp.ko 2023-07-21T21:59:59.550 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_scalable.ko 2023-07-21T21:59:59.550 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_vegas.ko 2023-07-21T21:59:59.550 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_veno.ko 2023-07-21T21:59:59.550 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_westwood.ko 2023-07-21T21:59:59.550 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_yeah.ko 2023-07-21T21:59:59.550 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tunnel4.ko 2023-07-21T21:59:59.551 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_diag.ko 2023-07-21T21:59:59.551 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 41577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_tunnel.ko 2023-07-21T21:59:59.551 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-21T21:59:59.551 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ 2023-07-21T21:59:59.551 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ah6.ko 2023-07-21T21:59:59.551 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/esp6.ko 2023-07-21T21:59:59.551 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/fou6.ko 2023-07-21T21:59:59.551 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 80793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_gre.ko 2023-07-21T21:59:59.552 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 92817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_tunnel.ko 2023-07-21T21:59:59.552 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-21T21:59:59.552 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_vti.ko 2023-07-21T21:59:59.552 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ipcomp6.ko 2023-07-21T21:59:59.552 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/mip6.ko 2023-07-21T21:59:59.552 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ 2023-07-21T21:59:59.552 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 42209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-21T21:59:59.553 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-07-21T21:59:59.553 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-21T21:59:59.553 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-21T21:59:59.553 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-21T21:59:59.553 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-21T21:59:59.553 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-21T21:59:59.553 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-21T21:59:59.553 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8913 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-21T21:59:59.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-21T21:59:59.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10937 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-21T21:59:59.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-21T21:59:59.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-21T21:59:59.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-21T21:59:59.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-21T21:59:59.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-21T21:59:59.554 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-21T21:59:59.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-21T21:59:59.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-21T21:59:59.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-21T21:59:59.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-21T21:59:59.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-21T21:59:59.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9633 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-21T21:59:59.555 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-21T21:59:59.556 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9009 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-21T21:59:59.556 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 73161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/sit.ko 2023-07-21T21:59:59.556 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24193 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/tunnel6.ko 2023-07-21T21:59:59.556 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23305 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-21T21:59:59.556 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key/ 2023-07-21T21:59:59.556 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 82929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key/af_key.ko 2023-07-21T21:59:59.556 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/ 2023-07-21T21:59:59.556 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 125873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_core.ko 2023-07-21T21:59:59.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-21T21:59:59.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 25865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_eth.ko 2023-07-21T21:59:59.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35049 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip.ko 2023-07-21T21:59:59.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip6.ko 2023-07-21T21:59:59.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_netlink.ko 2023-07-21T21:59:59.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 53153 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ppp.ko 2023-07-21T21:59:59.557 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/lapb/ 2023-07-21T21:59:59.557 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/lapb/lapb.ko 2023-07-21T21:59:59.558 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/ 2023-07-21T21:59:59.558 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/llc.ko 2023-07-21T21:59:59.558 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 267017 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/llc2.ko 2023-07-21T21:59:59.558 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154/ 2023-07-21T21:59:59.558 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 291041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154/mac802154.ko 2023-07-21T21:59:59.558 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls/ 2023-07-21T21:59:59.558 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls/mpls_gso.ko 2023-07-21T21:59:59.559 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ 2023-07-21T21:59:59.559 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ 2023-07-21T21:59:59.559 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 119649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set.ko 2023-07-21T21:59:59.559 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-21T21:59:59.559 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-21T21:59:59.559 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-21T21:59:59.559 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 102033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-21T21:59:59.559 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 103121 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-21T21:59:59.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 104593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-21T21:59:59.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 105129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-21T21:59:59.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 114393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-21T21:59:59.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-21T21:59:59.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 111161 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-21T21:59:59.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 114673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-21T21:59:59.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 114329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-21T21:59:59.560 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 113217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-21T21:59:59.561 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 116217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-21T21:59:59.561 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-21T21:59:59.561 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ 2023-07-21T21:59:59.561 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 412481 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-21T21:59:59.561 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-21T21:59:59.561 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-21T21:59:59.561 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-21T21:59:59.562 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17905 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-21T21:59:59.562 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-21T21:59:59.562 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-21T21:59:59.562 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-21T21:59:59.562 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10681 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-21T21:59:59.562 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-21T21:59:59.562 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-21T21:59:59.562 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-21T21:59:59.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7697 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-21T21:59:59.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10993 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-21T21:59:59.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conncount.ko 2023-07-21T21:59:59.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 408689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack.ko 2023-07-21T21:59:59.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-21T21:59:59.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10177 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-21T21:59:59.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33761 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-21T21:59:59.563 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 118145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-21T21:59:59.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-21T21:59:59.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-21T21:59:59.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 108393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-21T21:59:59.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-21T21:59:59.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-21T21:59:59.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 66641 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-21T21:59:59.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-21T21:59:59.564 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-21T21:59:59.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10113 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-21T21:59:59.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 88513 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table.ko 2023-07-21T21:59:59.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9593 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-21T21:59:59.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_log_syslog.ko 2023-07-21T21:59:59.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 95353 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat.ko 2023-07-21T21:59:59.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-21T21:59:59.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-21T21:59:59.565 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_irc.ko 2023-07-21T21:59:59.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28929 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_sip.ko 2023-07-21T21:59:59.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-21T21:59:59.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 44025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-21T21:59:59.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 592185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_tables.ko 2023-07-21T21:59:59.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink.ko 2023-07-21T21:59:59.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-21T21:59:59.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-07-21T21:59:59.566 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 39905 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_log.ko 2023-07-21T21:59:59.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22713 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-21T21:59:59.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 49673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-21T21:59:59.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_chain_nat.ko 2023-07-21T21:59:59.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_compat.ko 2023-07-21T21:59:59.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 40721 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_ct.ko 2023-07-21T21:59:59.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-21T21:59:59.567 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11345 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fib.ko 2023-07-21T21:59:59.568 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13745 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-21T21:59:59.568 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14185 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_hash.ko 2023-07-21T21:59:59.568 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_limit.ko 2023-07-21T21:59:59.568 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_log.ko 2023-07-21T21:59:59.568 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_masq.ko 2023-07-21T21:59:59.568 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_nat.ko 2023-07-21T21:59:59.568 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_numgen.ko 2023-07-21T21:59:59.568 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_osf.ko 2023-07-21T21:59:59.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_queue.ko 2023-07-21T21:59:59.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_redir.ko 2023-07-21T21:59:59.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject.ko 2023-07-21T21:59:59.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject_inet.ko 2023-07-21T21:59:59.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12737 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_socket.ko 2023-07-21T21:59:59.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20393 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_synproxy.ko 2023-07-21T21:59:59.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14849 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_tproxy.ko 2023-07-21T21:59:59.569 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 89329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/x_tables.ko 2023-07-21T21:59:59.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_AUDIT.ko 2023-07-21T21:59:59.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9633 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-21T21:59:59.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-21T21:59:59.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-21T21:59:59.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 18169 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CT.ko 2023-07-21T21:59:59.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10497 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_DSCP.ko 2023-07-21T21:59:59.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HL.ko 2023-07-21T21:59:59.570 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HMARK.ko 2023-07-21T21:59:59.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 38857 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-21T21:59:59.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13873 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LED.ko 2023-07-21T21:59:59.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11489 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LOG.ko 2023-07-21T21:59:59.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-21T21:59:59.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NETMAP.ko 2023-07-21T21:59:59.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFLOG.ko 2023-07-21T21:59:59.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13289 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-21T21:59:59.571 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19689 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_RATEEST.ko 2023-07-21T21:59:59.572 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-21T21:59:59.572 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 14337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_SECMARK.ko 2023-07-21T21:59:59.572 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-21T21:59:59.572 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-21T21:59:59.572 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17369 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TEE.ko 2023-07-21T21:59:59.572 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TPROXY.ko 2023-07-21T21:59:59.572 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TRACE.ko 2023-07-21T21:59:59.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_addrtype.ko 2023-07-21T21:59:59.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_bpf.ko 2023-07-21T21:59:59.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15577 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cgroup.ko 2023-07-21T21:59:59.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11209 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cluster.ko 2023-07-21T21:59:59.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_comment.ko 2023-07-21T21:59:59.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10465 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connbytes.ko 2023-07-21T21:59:59.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlabel.ko 2023-07-21T21:59:59.573 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlimit.ko 2023-07-21T21:59:59.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connmark.ko 2023-07-21T21:59:59.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_conntrack.ko 2023-07-21T21:59:59.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cpu.ko 2023-07-21T21:59:59.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dccp.ko 2023-07-21T21:59:59.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_devgroup.ko 2023-07-21T21:59:59.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8801 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dscp.ko 2023-07-21T21:59:59.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ecn.ko 2023-07-21T21:59:59.574 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_esp.ko 2023-07-21T21:59:59.575 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hashlimit.ko 2023-07-21T21:59:59.575 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_helper.ko 2023-07-21T21:59:59.575 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7865 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hl.ko 2023-07-21T21:59:59.575 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11921 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipcomp.ko 2023-07-21T21:59:59.575 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_iprange.ko 2023-07-21T21:59:59.575 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11785 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipvs.ko 2023-07-21T21:59:59.575 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16041 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_l2tp.ko 2023-07-21T21:59:59.575 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8001 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_length.ko 2023-07-21T21:59:59.576 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10273 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_limit.ko 2023-07-21T21:59:59.576 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mac.ko 2023-07-21T21:59:59.576 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8641 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mark.ko 2023-07-21T21:59:59.576 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_multiport.ko 2023-07-21T21:59:59.576 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nat.ko 2023-07-21T21:59:59.576 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nfacct.ko 2023-07-21T21:59:59.576 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8297 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_osf.ko 2023-07-21T21:59:59.576 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_owner.ko 2023-07-21T21:59:59.577 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_physdev.ko 2023-07-21T21:59:59.577 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7633 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_pkttype.ko 2023-07-21T21:59:59.577 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_policy.ko 2023-07-21T21:59:59.577 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_quota.ko 2023-07-21T21:59:59.577 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_rateest.ko 2023-07-21T21:59:59.577 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8257 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_realm.ko 2023-07-21T21:59:59.577 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_recent.ko 2023-07-21T21:59:59.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13329 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_sctp.ko 2023-07-21T21:59:59.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 30089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_set.ko 2023-07-21T21:59:59.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16089 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_socket.ko 2023-07-21T21:59:59.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9505 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_state.ko 2023-07-21T21:59:59.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9473 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_statistic.ko 2023-07-21T21:59:59.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_string.ko 2023-07-21T21:59:59.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 8553 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_tcpmss.ko 2023-07-21T21:59:59.578 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15777 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_tcpudp.ko 2023-07-21T21:59:59.579 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11129 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_time.ko 2023-07-21T21:59:59.579 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9105 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_u32.ko 2023-07-21T21:59:59.579 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink/ 2023-07-21T21:59:59.579 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13969 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink/netlink_diag.ko 2023-07-21T21:59:59.579 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh/ 2023-07-21T21:59:59.579 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 12425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh/nsh.ko 2023-07-21T21:59:59.579 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/ 2023-07-21T21:59:59.579 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 379545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/openvswitch.ko 2023-07-21T21:59:59.580 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10321 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-geneve.ko 2023-07-21T21:59:59.580 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-gre.ko 2023-07-21T21:59:59.580 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 11793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-vxlan.ko 2023-07-21T21:59:59.580 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet/ 2023-07-21T21:59:59.580 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet/af_packet_diag.ko 2023-07-21T21:59:59.580 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/ 2023-07-21T21:59:59.580 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 109961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/phonet.ko 2023-07-21T21:59:59.580 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 54761 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/pn_pep.ko 2023-07-21T21:59:59.581 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/ 2023-07-21T21:59:59.581 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 252825 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds.ko 2023-07-21T21:59:59.581 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 165081 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_rdma.ko 2023-07-21T21:59:59.581 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 67241 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_tcp.ko 2023-07-21T21:59:59.581 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rxrpc/ 2023-07-21T21:59:59.581 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 820137 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rxrpc/rxrpc.ko 2023-07-21T21:59:59.581 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/ 2023-07-21T21:59:59.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_csum.ko 2023-07-21T21:59:59.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23537 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_gact.ko 2023-07-21T21:59:59.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_ipt.ko 2023-07-21T21:59:59.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 34057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_mirred.ko 2023-07-21T21:59:59.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_nat.ko 2023-07-21T21:59:59.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 43817 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_pedit.ko 2023-07-21T21:59:59.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_police.ko 2023-07-21T21:59:59.582 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20313 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_simple.ko 2023-07-21T21:59:59.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36353 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_skbedit.ko 2023-07-21T21:59:59.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 36057 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_vlan.ko 2023-07-21T21:59:59.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26145 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_basic.ko 2023-07-21T21:59:59.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33673 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_bpf.ko 2023-07-21T21:59:59.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_cgroup.ko 2023-07-21T21:59:59.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31377 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_flow.ko 2023-07-21T21:59:59.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_fw.ko 2023-07-21T21:59:59.583 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 37953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_route.ko 2023-07-21T21:59:59.584 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 59217 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_u32.ko 2023-07-21T21:59:59.584 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7441 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_cmp.ko 2023-07-21T21:59:59.584 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 13457 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_ipset.ko 2023-07-21T21:59:59.584 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33337 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_meta.ko 2023-07-21T21:59:59.584 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_nbyte.ko 2023-07-21T21:59:59.584 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10625 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_text.ko 2023-07-21T21:59:59.584 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7249 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_u32.ko 2023-07-21T21:59:59.584 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 21649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_choke.ko 2023-07-21T21:59:59.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20961 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_codel.ko 2023-07-21T21:59:59.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33753 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_drr.ko 2023-07-21T21:59:59.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 33609 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_fq.ko 2023-07-21T21:59:59.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_fq_codel.ko 2023-07-21T21:59:59.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35433 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_gred.ko 2023-07-21T21:59:59.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 48409 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hfsc.ko 2023-07-21T21:59:59.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22073 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hhf.ko 2023-07-21T21:59:59.585 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 65793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_htb.ko 2023-07-21T21:59:59.586 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 16065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_ingress.ko 2023-07-21T21:59:59.586 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 29809 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio.ko 2023-07-21T21:59:59.586 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10793 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio_lib.ko 2023-07-21T21:59:59.586 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26065 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_multiq.ko 2023-07-21T21:59:59.586 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 35601 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_netem.ko 2023-07-21T21:59:59.586 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27545 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_pie.ko 2023-07-21T21:59:59.586 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_plug.ko 2023-07-21T21:59:59.586 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 24729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_prio.ko 2023-07-21T21:59:59.587 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 47617 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_qfq.ko 2023-07-21T21:59:59.587 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 32953 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_red.ko 2023-07-21T21:59:59.587 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 26881 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfb.ko 2023-07-21T21:59:59.587 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 31425 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfq.ko 2023-07-21T21:59:59.587 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 28897 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_tbf.ko 2023-07-21T21:59:59.587 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 27729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_teql.ko 2023-07-21T21:59:59.587 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/ 2023-07-21T21:59:59.588 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 930369 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp.ko 2023-07-21T21:59:59.588 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 19033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp_diag.ko 2023-07-21T21:59:59.588 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/ 2023-07-21T21:59:59.588 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/ 2023-07-21T21:59:59.588 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 335569 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-21T21:59:59.588 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 61833 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-21T21:59:59.588 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 1514649 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/sunrpc.ko 2023-07-21T21:59:59.588 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma/ 2023-07-21T21:59:59.589 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 707401 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-21T21:59:59.589 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/ 2023-07-21T21:59:59.589 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10025 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/diag.ko 2023-07-21T21:59:59.589 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 862233 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/tipc.ko 2023-07-21T21:59:59.589 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix/ 2023-07-21T21:59:59.589 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15729 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix/unix_diag.ko 2023-07-21T21:59:59.589 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/ 2023-07-21T21:59:59.589 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 84841 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-21T21:59:59.590 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 68033 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-21T21:59:59.590 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 95985 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock.ko 2023-07-21T21:59:59.590 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 10705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-21T21:59:59.590 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 17521 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-21T21:59:59.590 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/x25/ 2023-07-21T21:59:59.590 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 125097 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/x25/x25.ko 2023-07-21T21:59:59.590 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/ 2023-07-21T21:59:59.590 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 22657 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_algo.ko 2023-07-21T21:59:59.591 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 20705 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-21T21:59:59.591 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 102265 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_user.ko 2023-07-21T21:59:59.591 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/ 2023-07-21T21:59:59.591 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib/ 2023-07-21T21:59:59.591 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 15513 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib/irqbypass.ko 2023-07-21T21:59:59.591 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 638200 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias 2023-07-21T21:59:59.591 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 623896 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias.bin 2023-07-21T21:59:59.592 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 7656 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin 2023-07-21T21:59:59.592 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 23361 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.alias.bin 2023-07-21T21:59:59.592 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 9821 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.bin 2023-07-21T21:59:59.592 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 69903 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.modinfo 2023-07-21T21:59:59.592 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 146449 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep 2023-07-21T21:59:59.592 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 232695 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep.bin 2023-07-21T21:59:59.592 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 210 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.devname 2023-07-21T21:59:59.592 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 72754 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.order 2023-07-21T21:59:59.593 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 879 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.softdep 2023-07-21T21:59:59.593 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 252883 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols 2023-07-21T21:59:59.593 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 307884 2023-07-20 11:52 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols.bin 2023-07-21T21:59:59.593 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./usr/ 2023-07-21T21:59:59.593 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./usr/share/ 2023-07-21T21:59:59.593 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./usr/share/doc/ 2023-07-21T21:59:59.593 INFO:teuthology.orchestra.run.smithi161.stdout:drwxr-xr-x root/root 0 2023-07-20 11:52 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/ 2023-07-21T21:59:59.593 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 174 2023-07-20 11:52 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/changelog.Debian.gz 2023-07-21T21:59:59.594 INFO:teuthology.orchestra.run.smithi161.stdout:-rw-r--r-- root/root 691 2023-07-20 11:52 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/copyright 2023-07-21T21:59:59.595 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:59:59.595 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:59:59.595 DEBUG:teuthology.orchestra.run.smithi161:> egrep '(submenu|menuentry.*6.5.0-rc1-gc685da6f56cc).*{' /boot/grub/grub.cfg 2023-07-21T21:59:59.602 INFO:teuthology.orchestra.run.smithi161.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-21T21:59:59.602 INFO:teuthology.orchestra.run.smithi161.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-gc685da6f56cc-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-21T21:59:59.602 INFO:teuthology.orchestra.run.smithi161.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-gc685da6f56cc-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-21T21:59:59.603 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-07-21T21:59:59.603 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:59:59.603 DEBUG:teuthology.orchestra.run.smithi161:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-07-21T21:59:59.644 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi161.front.sepia.ceph.com to complete... 2023-07-21T22:00:00.114 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub' 2023-07-21T22:00:00.115 INFO:teuthology.orchestra.run.smithi161.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-21T22:00:00.131 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2023-07-21T22:00:00.373 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T22:00:00.379 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-21T22:00:00.658 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-21T22:00:00.663 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-21T22:00:00.703 INFO:teuthology.orchestra.run.smithi161.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-21T22:00:00.707 INFO:teuthology.orchestra.run.smithi161.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-21T22:00:00.832 INFO:teuthology.orchestra.run.smithi161.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-21T22:00:00.832 INFO:teuthology.orchestra.run.smithi161.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-21T22:00:00.832 INFO:teuthology.orchestra.run.smithi161.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-21T22:00:00.856 INFO:teuthology.orchestra.run.smithi161.stderr:done 2023-07-21T22:00:01.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-07-21T22:00:01.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:00:04.496 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.6 2023-07-21T22:00:16.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-07-21T22:00:16.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:00:32.024 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-07-21T22:00:32.024 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-07-21T22:00:32.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:00:53.314 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-07-21T22:00:54.029 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-07-21T22:00:54.030 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc1-gc685da6f56cc"... 2023-07-21T22:00:54.030 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2023-07-21T22:00:54.085 INFO:teuthology.orchestra.run.smithi006.stdout:6.5.0-rc1-gc685da6f56cc 2023-07-21T22:00:54.085 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-gc685da6f56cc vs 6.5.0-rc1-gc685da6f56cc 2023-07-21T22:00:54.085 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-21T22:00:54.086 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-21T22:00:55.087 DEBUG:teuthology.parallel:result is None 2023-07-21T22:00:55.408 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-07-21T22:01:04.410 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-07-21T22:01:04.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:01:12.464 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-07-21T22:01:24.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-07-21T22:01:24.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:02:01.226 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-07-21T22:02:01.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-07-21T22:02:01.817 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc1-gc685da6f56cc"... 2023-07-21T22:02:01.817 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2023-07-21T22:02:01.870 INFO:teuthology.orchestra.run.smithi161.stdout:6.5.0-rc1-gc685da6f56cc 2023-07-21T22:02:01.870 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-gc685da6f56cc vs 6.5.0-rc1-gc685da6f56cc 2023-07-21T22:02:01.870 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-21T22:02:01.871 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-21T22:02:02.871 DEBUG:teuthology.parallel:result is None 2023-07-21T22:02:02.872 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-21T22:02:02.879 INFO:teuthology.task.internal:Creating test directory... 2023-07-21T22:02:02.879 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-21T22:02:02.883 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-21T22:02:02.892 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-21T22:02:02.959 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-21T22:02:03.018 INFO:teuthology.task.internal:Creating archive directory... 2023-07-21T22:02:03.018 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-21T22:02:03.022 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-21T22:02:03.183 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-21T22:02:03.194 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-21T22:02:03.195 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-21T22:02:03.198 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-21T22:02:03.280 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T22:02:03.302 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T22:02:03.310 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T22:02:03.331 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T22:02:03.333 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-21T22:02:03.345 INFO:teuthology.task.internal:Configuring sudo... 2023-07-21T22:02:03.345 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-21T22:02:03.349 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-21T22:02:03.371 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-21T22:02:03.385 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-21T22:02:03.385 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-21T22:02:03.413 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-21T22:02:03.422 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-21T22:02:03.474 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-21T22:02:03.526 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:02:03.527 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-21T22:02:03.602 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-21T22:02:03.612 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-21T22:02:03.665 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:02:03.665 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-21T22:02:03.729 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2023-07-21T22:02:03.732 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2023-07-21T22:02:03.853 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-21T22:02:03.862 INFO:teuthology.task.internal:Starting timer... 2023-07-21T22:02:03.862 INFO:teuthology.run_tasks:Running task pcp... 2023-07-21T22:02:03.880 INFO:teuthology.run_tasks:Running task selinux... 2023-07-21T22:02:03.895 DEBUG:teuthology.task.selinux:Excluding smithi006: OS 'ubuntu' does not support SELinux 2023-07-21T22:02:03.895 DEBUG:teuthology.task.selinux:Excluding smithi161: OS 'ubuntu' does not support SELinux 2023-07-21T22:02:03.895 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-21T22:02:03.896 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-07-21T22:02:03.896 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-21T22:02:03.896 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-21T22:02:03.911 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-07-21T22:02:03.919 INFO:teuthology.repo_utils:Fetching main from origin 2023-07-21T22:02:09.206 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-21T22:02:09.224 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-21T22:02:09.225 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi161.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-21T22:11:22.160 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi161.front.sepia.ceph.com')] 2023-07-21T22:11:22.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-07-21T22:11:22.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:11:27.253 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-07-21T22:11:27.384 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-07-21T22:11:27.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-07-21T22:11:27.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:11:32.464 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-07-21T22:11:32.587 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-07-21T22:11:32.588 INFO:teuthology.run_tasks:Running task clock... 2023-07-21T22:11:32.598 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-21T22:11:32.599 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-21T22:11:32.599 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-21T22:11:32.603 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-21T22:11:32.604 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-21T22:11:32.646 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:32 ntpd[27282]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-07-21T22:11:32.647 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:32 ntpd[27282]: Command line: ntpd -gq 2023-07-21T22:11:32.647 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:32 ntpd[27282]: ---------------------------------------------------- 2023-07-21T22:11:32.647 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:32 ntpd[27282]: ntp-4 is maintained by Network Time Foundation, 2023-07-21T22:11:32.647 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:32 ntpd[27282]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-07-21T22:11:32.647 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:32 ntpd[27282]: corporation. Support and training for ntp-4 are 2023-07-21T22:11:32.647 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:32 ntpd[27282]: available at https://www.nwtime.org/support 2023-07-21T22:11:32.648 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:32 ntpd[27282]: ---------------------------------------------------- 2023-07-21T22:11:32.648 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:32 ntpd[27282]: proto: precision = 0.043 usec (-24) 2023-07-21T22:11:32.648 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:32 ntpd[27282]: basedate set to 2022-02-04 2023-07-21T22:11:32.648 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:32 ntpd[27282]: gps base set to 2022-02-06 (week 2196) 2023-07-21T22:11:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-21T22:11:32.649 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:32 ntpd[27282]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-21T22:11:32.649 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:32 ntpd[27282]: restrict ::: KOD does nothing without LIMITED. 2023-07-21T22:11:32.650 INFO:teuthology.orchestra.run.smithi006.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-21T22:11:32.650 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:32 ntpd[27282]: Listen and drop on 0 v6wildcard [::]:123 2023-07-21T22:11:32.651 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:32 ntpd[27282]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-21T22:11:32.651 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:32 ntpd[27282]: Listen normally on 2 lo 127.0.0.1:123 2023-07-21T22:11:32.651 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:32 ntpd[27282]: Listen normally on 3 ens1f0 172.21.15.6:123 2023-07-21T22:11:32.651 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:32 ntpd[27282]: Listen normally on 4 lo [::1]:123 2023-07-21T22:11:32.651 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:32 ntpd[27282]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15e4%4]:123 2023-07-21T22:11:32.651 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:32 ntpd[27282]: Listening on routing socket on fd #22 for interface updates 2023-07-21T22:11:32.675 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:32 ntpd[27447]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-07-21T22:11:32.675 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:32 ntpd[27447]: Command line: ntpd -gq 2023-07-21T22:11:32.675 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:32 ntpd[27447]: ---------------------------------------------------- 2023-07-21T22:11:32.676 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:32 ntpd[27447]: ntp-4 is maintained by Network Time Foundation, 2023-07-21T22:11:32.676 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:32 ntpd[27447]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-07-21T22:11:32.676 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:32 ntpd[27447]: corporation. Support and training for ntp-4 are 2023-07-21T22:11:32.676 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:32 ntpd[27447]: available at https://www.nwtime.org/support 2023-07-21T22:11:32.676 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:32 ntpd[27447]: ---------------------------------------------------- 2023-07-21T22:11:32.677 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:32 ntpd[27447]: proto: precision = 0.042 usec (-24) 2023-07-21T22:11:32.677 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:32 ntpd[27447]: basedate set to 2022-02-04 2023-07-21T22:11:32.677 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:32 ntpd[27447]: gps base set to 2022-02-06 (week 2196) 2023-07-21T22:11:32.677 INFO:teuthology.orchestra.run.smithi161.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-21T22:11:32.678 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:32 ntpd[27447]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-21T22:11:32.678 INFO:teuthology.orchestra.run.smithi161.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-21T22:11:32.679 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:32 ntpd[27447]: restrict ::: KOD does nothing without LIMITED. 2023-07-21T22:11:32.679 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:32 ntpd[27447]: Listen and drop on 0 v6wildcard [::]:123 2023-07-21T22:11:32.679 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:32 ntpd[27447]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-21T22:11:32.680 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:32 ntpd[27447]: Listen normally on 2 lo 127.0.0.1:123 2023-07-21T22:11:32.680 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:32 ntpd[27447]: Listen normally on 3 enp3s0f1 172.21.15.161:123 2023-07-21T22:11:32.680 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:32 ntpd[27447]: Listen normally on 4 lo [::1]:123 2023-07-21T22:11:32.680 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:32 ntpd[27447]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7251%5]:123 2023-07-21T22:11:32.680 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:32 ntpd[27447]: Listening on routing socket on fd #22 for interface updates 2023-07-21T22:11:33.675 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:33 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:33.676 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:33 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:33.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:33 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:33.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:33 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:33.678 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:33 ntpd[27447]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:11:33.678 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:33 ntpd[27447]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:11:34.647 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:34 ntpd[27282]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:34.647 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:34 ntpd[27282]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:34.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:34 ntpd[27282]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:34.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:34 ntpd[27282]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:34.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:34 ntpd[27282]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:11:34.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:34 ntpd[27282]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:11:34.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:34 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:34.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:34 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:34.678 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:34 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:34.678 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:34 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:34.678 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:34 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:34.678 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:34 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:34.679 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:34 ntpd[27447]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:11:34.679 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:34 ntpd[27447]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:11:34.679 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:34 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:34.680 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:34 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:34.680 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:34 ntpd[27447]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:11:34.680 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:34 ntpd[27447]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:11:35.676 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:35 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:35.676 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:35 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:35.676 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:35 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:35.676 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:35 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:35.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:35 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:35.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:35 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:35.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:35 ntpd[27447]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:11:35.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:35 ntpd[27447]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:11:36.647 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:36 ntpd[27282]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:36.647 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:36 ntpd[27282]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:36.647 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:36 ntpd[27282]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:36.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:36 ntpd[27282]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:36.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:36 ntpd[27282]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:11:36.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:36 ntpd[27282]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:11:36.676 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:36 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:36.676 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:36 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:36.676 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:36 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:36.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:36 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:36.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:36 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:36.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:36 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:36.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:36 ntpd[27447]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:11:36.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:36 ntpd[27447]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:11:36.678 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:36 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:36.678 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:36 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:36.678 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:36 ntpd[27447]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:11:36.678 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:36 ntpd[27447]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:11:37.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:37 ntpd[27282]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:37.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:37 ntpd[27282]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:37.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:37 ntpd[27282]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:37.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:37 ntpd[27282]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:37.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:37 ntpd[27282]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:37.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:37 ntpd[27282]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:37.649 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:37 ntpd[27282]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:37.649 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:37 ntpd[27282]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:37.649 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:37 ntpd[27282]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:11:37.649 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:37 ntpd[27282]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:11:37.649 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:37 ntpd[27282]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:37.649 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:37 ntpd[27282]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:37.649 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:37 ntpd[27282]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:11:37.650 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:37 ntpd[27282]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:11:37.676 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:37 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:37.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:37 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:37.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:37 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:37.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:37 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:37.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:37 ntpd[27447]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:11:37.678 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:37 ntpd[27447]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:11:38.647 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:38 ntpd[27282]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:38.647 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:38 ntpd[27282]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:38.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:38 ntpd[27282]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:38.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:38 ntpd[27282]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:38.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:38 ntpd[27282]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:11:38.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:38 ntpd[27282]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:11:38.676 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:38 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:38.676 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:38 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:38.676 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:38 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:38.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:38 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:38.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:38 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:38.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:38 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:38.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:38 ntpd[27447]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:11:38.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:38 ntpd[27447]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:11:38.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:38 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:38.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:38 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:38.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:38 ntpd[27447]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:11:38.678 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:38 ntpd[27447]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:11:39.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:39 ntpd[27282]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:39.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:39 ntpd[27282]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:39.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:39 ntpd[27282]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:39.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:39 ntpd[27282]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:39.649 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:39 ntpd[27282]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:39.649 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:39 ntpd[27282]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:39.649 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:39 ntpd[27282]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:11:39.649 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:39 ntpd[27282]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:11:39.649 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:39 ntpd[27282]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:39.649 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:39 ntpd[27282]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:39.649 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:39 ntpd[27282]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:11:39.649 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:39 ntpd[27282]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:11:39.675 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:39 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:39.676 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:39 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:39.676 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:39 ntpd[27447]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:39.676 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:39 ntpd[27447]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:39.676 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:39 ntpd[27447]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:11:39.676 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:39 ntpd[27447]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:11:39.677 INFO:teuthology.orchestra.run.smithi161.stdout:21 Jul 22:11:39 ntpd[27447]: ntpd: time slew -0.002382 s 2023-07-21T22:11:39.677 INFO:teuthology.orchestra.run.smithi161.stdout:ntpd: time slew -0.002382s 2023-07-21T22:11:39.677 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:39 ntpd[27447]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-21T22:11:39.678 INFO:teuthology.orchestra.run.smithi161.stderr:21 Jul 22:11:39 ntpd[27447]: can't open /var/log/ntpstats/loopstats.20230721: Permission denied 2023-07-21T22:11:39.787 INFO:teuthology.orchestra.run.smithi161.stdout: remote refid st t when poll reach delay offset jitter 2023-07-21T22:11:39.787 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================== 2023-07-21T22:11:39.788 INFO:teuthology.orchestra.run.smithi161.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-21T22:11:39.788 INFO:teuthology.orchestra.run.smithi161.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-21T22:11:39.788 INFO:teuthology.orchestra.run.smithi161.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-21T22:11:39.788 INFO:teuthology.orchestra.run.smithi161.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-21T22:11:40.647 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:40 ntpd[27282]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:40.647 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:40 ntpd[27282]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:40.647 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:40 ntpd[27282]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-21T22:11:40.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:40 ntpd[27282]: can't open /var/log/ntpstats/rawstats.20230721: Permission denied 2023-07-21T22:11:40.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:40 ntpd[27282]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-21T22:11:40.648 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:40 ntpd[27282]: can't open /var/log/ntpstats/peerstats.20230721: Permission denied 2023-07-21T22:11:40.648 INFO:teuthology.orchestra.run.smithi006.stdout:21 Jul 22:11:40 ntpd[27282]: ntpd: time slew +0.001218 s 2023-07-21T22:11:40.649 INFO:teuthology.orchestra.run.smithi006.stdout:ntpd: time slew +0.001218s 2023-07-21T22:11:40.649 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:40 ntpd[27282]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-21T22:11:40.649 INFO:teuthology.orchestra.run.smithi006.stderr:21 Jul 22:11:40 ntpd[27282]: can't open /var/log/ntpstats/loopstats.20230721: Permission denied 2023-07-21T22:11:40.749 INFO:teuthology.orchestra.run.smithi006.stdout: remote refid st t when poll reach delay offset jitter 2023-07-21T22:11:40.750 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================== 2023-07-21T22:11:40.750 INFO:teuthology.orchestra.run.smithi006.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-21T22:11:40.750 INFO:teuthology.orchestra.run.smithi006.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-21T22:11:40.751 INFO:teuthology.orchestra.run.smithi006.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-21T22:11:40.751 INFO:teuthology.orchestra.run.smithi006.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-21T22:11:40.752 INFO:teuthology.run_tasks:Running task install... 2023-07-21T22:11:40.769 DEBUG:teuthology.task.install:project ceph 2023-07-21T22:11:40.770 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea'}} 2023-07-21T22:11:40.770 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea'} 2023-07-21T22:11:40.770 INFO:teuthology.task.install:Using flavor: default 2023-07-21T22:11:40.780 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-21T22:11:40.780 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-21T22:11:40.781 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-key list | grep Ceph 2023-07-21T22:11:40.782 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-key list | grep Ceph 2023-07-21T22:11:40.895 INFO:teuthology.orchestra.run.smithi161.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-07-21T22:11:40.905 INFO:teuthology.orchestra.run.smithi006.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-07-21T22:11:40.949 INFO:teuthology.orchestra.run.smithi161.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-21T22:11:40.949 INFO:teuthology.orchestra.run.smithi161.stdout:uid [ unknown] Ceph.com (release key) 2023-07-21T22:11:40.950 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-07-21T22:11:40.951 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-07-21T22:11:40.951 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea 2023-07-21T22:11:45.958 INFO:teuthology.orchestra.run.smithi006.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-21T22:11:45.958 INFO:teuthology.orchestra.run.smithi006.stdout:uid [ unknown] Ceph.com (release key) 2023-07-21T22:11:45.958 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-07-21T22:11:45.959 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-07-21T22:11:45.959 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea 2023-07-21T22:11:51.441 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default/ 2023-07-21T22:11:51.441 INFO:teuthology.task.install.deb:Package version is 18.0.0-4735-gbffe049d-1jammy 2023-07-21T22:11:51.550 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default/ 2023-07-21T22:11:51.550 INFO:teuthology.task.install.deb:Package version is 18.0.0-4735-gbffe049d-1jammy 2023-07-21T22:11:51.990 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:11:51.991 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-21T22:11:52.013 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get update 2023-07-21T22:11:52.021 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:11:52.022 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-21T22:11:52.046 DEBUG:teuthology.orchestra.run.smithi006:> sudo apt-get update 2023-07-21T22:11:52.362 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-07-21T22:11:52.447 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-07-21T22:11:52.538 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-07-21T22:11:52.544 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-07-21T22:11:52.625 INFO:teuthology.orchestra.run.smithi161.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy InRelease 2023-07-21T22:11:52.650 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-07-21T22:11:52.652 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-07-21T22:11:52.661 INFO:teuthology.orchestra.run.smithi006.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy InRelease 2023-07-21T22:11:52.687 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-07-21T22:11:52.746 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-07-21T22:11:52.772 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-07-21T22:11:52.851 INFO:teuthology.orchestra.run.smithi006.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-07-21T22:11:52.867 INFO:teuthology.orchestra.run.smithi161.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy Release.gpg 2023-07-21T22:11:52.888 INFO:teuthology.orchestra.run.smithi006.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy Release.gpg 2023-07-21T22:11:52.986 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2023-07-21T22:11:53.012 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2023-07-21T22:11:53.118 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-07-21T22:11:53.151 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-07-21T22:11:53.225 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 28.5 kB in 1s (29.1 kB/s) 2023-07-21T22:11:53.262 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 28.5 kB in 1s (29.1 kB/s) 2023-07-21T22:11:54.096 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2023-07-21T22:11:54.113 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4735-gbffe049d-1jammy cephadm=18.0.0-4735-gbffe049d-1jammy ceph-mds=18.0.0-4735-gbffe049d-1jammy ceph-mgr=18.0.0-4735-gbffe049d-1jammy ceph-common=18.0.0-4735-gbffe049d-1jammy ceph-fuse=18.0.0-4735-gbffe049d-1jammy ceph-test=18.0.0-4735-gbffe049d-1jammy ceph-volume=18.0.0-4735-gbffe049d-1jammy radosgw=18.0.0-4735-gbffe049d-1jammy python3-rados=18.0.0-4735-gbffe049d-1jammy python3-rgw=18.0.0-4735-gbffe049d-1jammy python3-cephfs=18.0.0-4735-gbffe049d-1jammy python3-rbd=18.0.0-4735-gbffe049d-1jammy libcephfs2=18.0.0-4735-gbffe049d-1jammy libcephfs-dev=18.0.0-4735-gbffe049d-1jammy librados2=18.0.0-4735-gbffe049d-1jammy librbd1=18.0.0-4735-gbffe049d-1jammy rbd-fuse=18.0.0-4735-gbffe049d-1jammy python3-cephfs=18.0.0-4735-gbffe049d-1jammy cephfs-shell=18.0.0-4735-gbffe049d-1jammy cephfs-top=18.0.0-4735-gbffe049d-1jammy cephfs-mirror=18.0.0-4735-gbffe049d-1jammy 2023-07-21T22:11:54.180 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2023-07-21T22:11:54.188 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2023-07-21T22:11:54.197 DEBUG:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4735-gbffe049d-1jammy cephadm=18.0.0-4735-gbffe049d-1jammy ceph-mds=18.0.0-4735-gbffe049d-1jammy ceph-mgr=18.0.0-4735-gbffe049d-1jammy ceph-common=18.0.0-4735-gbffe049d-1jammy ceph-fuse=18.0.0-4735-gbffe049d-1jammy ceph-test=18.0.0-4735-gbffe049d-1jammy ceph-volume=18.0.0-4735-gbffe049d-1jammy radosgw=18.0.0-4735-gbffe049d-1jammy python3-rados=18.0.0-4735-gbffe049d-1jammy python3-rgw=18.0.0-4735-gbffe049d-1jammy python3-cephfs=18.0.0-4735-gbffe049d-1jammy python3-rbd=18.0.0-4735-gbffe049d-1jammy libcephfs2=18.0.0-4735-gbffe049d-1jammy libcephfs-dev=18.0.0-4735-gbffe049d-1jammy librados2=18.0.0-4735-gbffe049d-1jammy librbd1=18.0.0-4735-gbffe049d-1jammy rbd-fuse=18.0.0-4735-gbffe049d-1jammy python3-cephfs=18.0.0-4735-gbffe049d-1jammy cephfs-shell=18.0.0-4735-gbffe049d-1jammy cephfs-top=18.0.0-4735-gbffe049d-1jammy cephfs-mirror=18.0.0-4735-gbffe049d-1jammy 2023-07-21T22:11:54.274 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2023-07-21T22:11:54.344 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2023-07-21T22:11:54.345 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2023-07-21T22:11:54.433 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2023-07-21T22:11:54.434 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2023-07-21T22:11:54.488 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages were automatically installed and are no longer required: 2023-07-21T22:11:54.489 INFO:teuthology.orchestra.run.smithi161.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-21T22:11:54.490 INFO:teuthology.orchestra.run.smithi161.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-21T22:11:54.490 INFO:teuthology.orchestra.run.smithi161.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-21T22:11:54.491 INFO:teuthology.orchestra.run.smithi161.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-21T22:11:54.492 INFO:teuthology.orchestra.run.smithi161.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-21T22:11:54.492 INFO:teuthology.orchestra.run.smithi161.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-21T22:11:54.492 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2023-07-21T22:11:54.492 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-21T22:11:54.492 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-07-21T22:11:54.492 INFO:teuthology.orchestra.run.smithi161.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-21T22:11:54.493 INFO:teuthology.orchestra.run.smithi161.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-07-21T22:11:54.493 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-07-21T22:11:54.493 INFO:teuthology.orchestra.run.smithi161.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-07-21T22:11:54.493 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-07-21T22:11:54.493 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-07-21T22:11:54.493 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-07-21T22:11:54.493 INFO:teuthology.orchestra.run.smithi161.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-07-21T22:11:54.494 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-07-21T22:11:54.494 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-07-21T22:11:54.494 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-07-21T22:11:54.494 INFO:teuthology.orchestra.run.smithi161.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-07-21T22:11:54.494 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-07-21T22:11:54.494 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-07-21T22:11:54.495 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-07-21T22:11:54.495 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-07-21T22:11:54.495 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-07-21T22:11:54.495 INFO:teuthology.orchestra.run.smithi161.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-07-21T22:11:54.495 INFO:teuthology.orchestra.run.smithi161.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-07-21T22:11:54.495 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-07-21T22:11:54.495 INFO:teuthology.orchestra.run.smithi161.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-21T22:11:54.496 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2023-07-21T22:11:54.496 INFO:teuthology.orchestra.run.smithi161.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-07-21T22:11:54.496 INFO:teuthology.orchestra.run.smithi161.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-07-21T22:11:54.496 INFO:teuthology.orchestra.run.smithi161.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-07-21T22:11:54.496 INFO:teuthology.orchestra.run.smithi161.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-07-21T22:11:54.497 INFO:teuthology.orchestra.run.smithi161.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-07-21T22:11:54.497 INFO:teuthology.orchestra.run.smithi161.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-07-21T22:11:54.497 INFO:teuthology.orchestra.run.smithi161.stdout: python3-watchdog 2023-07-21T22:11:54.497 INFO:teuthology.orchestra.run.smithi161.stdout:Recommended packages: 2023-07-21T22:11:54.497 INFO:teuthology.orchestra.run.smithi161.stdout: btrfs-tools 2023-07-21T22:11:54.581 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages were automatically installed and are no longer required: 2023-07-21T22:11:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-21T22:11:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-21T22:11:54.581 INFO:teuthology.orchestra.run.smithi006.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-21T22:11:54.582 INFO:teuthology.orchestra.run.smithi006.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-21T22:11:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-21T22:11:54.583 INFO:teuthology.orchestra.run.smithi006.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-21T22:11:54.583 INFO:teuthology.orchestra.run.smithi006.stdout:The following additional packages will be installed: 2023-07-21T22:11:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-21T22:11:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-07-21T22:11:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-21T22:11:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-07-21T22:11:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-07-21T22:11:54.584 INFO:teuthology.orchestra.run.smithi006.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-07-21T22:11:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-07-21T22:11:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-07-21T22:11:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-07-21T22:11:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-07-21T22:11:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-07-21T22:11:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-07-21T22:11:54.585 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-07-21T22:11:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-07-21T22:11:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-07-21T22:11:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-07-21T22:11:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-07-21T22:11:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-07-21T22:11:54.586 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-07-21T22:11:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-07-21T22:11:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-07-21T22:11:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-07-21T22:11:54.587 INFO:teuthology.orchestra.run.smithi006.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-21T22:11:54.587 INFO:teuthology.orchestra.run.smithi006.stdout:Suggested packages: 2023-07-21T22:11:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-07-21T22:11:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-07-21T22:11:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-07-21T22:11:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-07-21T22:11:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-07-21T22:11:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-07-21T22:11:54.588 INFO:teuthology.orchestra.run.smithi006.stdout: python3-watchdog 2023-07-21T22:11:54.589 INFO:teuthology.orchestra.run.smithi006.stdout:Recommended packages: 2023-07-21T22:11:54.589 INFO:teuthology.orchestra.run.smithi006.stdout: btrfs-tools 2023-07-21T22:11:54.631 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2023-07-21T22:11:54.631 INFO:teuthology.orchestra.run.smithi161.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-21T22:11:54.631 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-21T22:11:54.631 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-21T22:11:54.632 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-07-21T22:11:54.632 INFO:teuthology.orchestra.run.smithi161.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-21T22:11:54.632 INFO:teuthology.orchestra.run.smithi161.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-07-21T22:11:54.632 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-07-21T22:11:54.633 INFO:teuthology.orchestra.run.smithi161.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-07-21T22:11:54.633 INFO:teuthology.orchestra.run.smithi161.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-07-21T22:11:54.633 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-07-21T22:11:54.633 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-07-21T22:11:54.634 INFO:teuthology.orchestra.run.smithi161.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-07-21T22:11:54.634 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-07-21T22:11:54.634 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-07-21T22:11:54.634 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-07-21T22:11:54.634 INFO:teuthology.orchestra.run.smithi161.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-07-21T22:11:54.634 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-07-21T22:11:54.635 INFO:teuthology.orchestra.run.smithi161.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-07-21T22:11:54.635 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-07-21T22:11:54.635 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-07-21T22:11:54.635 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-07-21T22:11:54.635 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-07-21T22:11:54.635 INFO:teuthology.orchestra.run.smithi161.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-07-21T22:11:54.635 INFO:teuthology.orchestra.run.smithi161.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-07-21T22:11:54.635 INFO:teuthology.orchestra.run.smithi161.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-07-21T22:11:54.636 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-07-21T22:11:54.636 INFO:teuthology.orchestra.run.smithi161.stdout: socat xmlstarlet 2023-07-21T22:11:54.732 INFO:teuthology.orchestra.run.smithi006.stdout:The following NEW packages will be installed: 2023-07-21T22:11:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-21T22:11:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-21T22:11:54.732 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-21T22:11:54.733 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-07-21T22:11:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-21T22:11:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-07-21T22:11:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-07-21T22:11:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-07-21T22:11:54.734 INFO:teuthology.orchestra.run.smithi006.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-07-21T22:11:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-07-21T22:11:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-07-21T22:11:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-07-21T22:11:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-07-21T22:11:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-07-21T22:11:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-07-21T22:11:54.735 INFO:teuthology.orchestra.run.smithi006.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-07-21T22:11:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-07-21T22:11:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-07-21T22:11:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-07-21T22:11:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-07-21T22:11:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-07-21T22:11:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-07-21T22:11:54.736 INFO:teuthology.orchestra.run.smithi006.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-07-21T22:11:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-07-21T22:11:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-07-21T22:11:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-07-21T22:11:54.737 INFO:teuthology.orchestra.run.smithi006.stdout: socat xmlstarlet 2023-07-21T22:11:55.002 INFO:teuthology.orchestra.run.smithi161.stdout:0 upgraded, 115 newly installed, 0 to remove and 210 not upgraded. 2023-07-21T22:11:55.002 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 183 MB of archives. 2023-07-21T22:11:55.003 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 820 MB of additional disk space will be used. 2023-07-21T22:11:55.003 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-07-21T22:11:55.003 INFO:teuthology.orchestra.run.smithi006.stdout:0 upgraded, 115 newly installed, 0 to remove and 210 not upgraded. 2023-07-21T22:11:55.003 INFO:teuthology.orchestra.run.smithi006.stdout:Need to get 183 MB of archives. 2023-07-21T22:11:55.003 INFO:teuthology.orchestra.run.smithi006.stdout:After this operation, 820 MB of additional disk space will be used. 2023-07-21T22:11:55.004 INFO:teuthology.orchestra.run.smithi006.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-07-21T22:11:55.121 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-07-21T22:11:55.122 INFO:teuthology.orchestra.run.smithi006.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-07-21T22:11:55.186 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-07-21T22:11:55.188 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-07-21T22:11:55.315 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4735-gbffe049d-1jammy [3,402 kB] 2023-07-21T22:11:55.409 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4735-gbffe049d-1jammy [3,402 kB] 2023-07-21T22:11:55.476 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-07-21T22:11:55.477 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-07-21T22:11:55.543 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-07-21T22:11:55.544 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-07-21T22:11:55.647 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-07-21T22:11:55.650 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-07-21T22:11:55.664 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-07-21T22:11:55.666 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-07-21T22:11:55.719 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-07-21T22:11:55.720 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-07-21T22:11:55.916 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-07-21T22:11:55.919 INFO:teuthology.orchestra.run.smithi006.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-07-21T22:11:55.931 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-07-21T22:11:55.933 INFO:teuthology.orchestra.run.smithi006.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-07-21T22:11:55.968 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-07-21T22:11:55.971 INFO:teuthology.orchestra.run.smithi006.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-07-21T22:11:55.991 INFO:teuthology.orchestra.run.smithi006.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-07-21T22:11:55.994 INFO:teuthology.orchestra.run.smithi006.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-07-21T22:11:56.152 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-07-21T22:11:56.373 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-07-21T22:11:56.386 INFO:teuthology.orchestra.run.smithi006.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4735-gbffe049d-1jammy [3,094 kB] 2023-07-21T22:11:56.390 INFO:teuthology.orchestra.run.smithi006.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-07-21T22:11:56.390 INFO:teuthology.orchestra.run.smithi006.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-07-21T22:11:56.391 INFO:teuthology.orchestra.run.smithi006.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-07-21T22:11:56.480 INFO:teuthology.orchestra.run.smithi006.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-07-21T22:11:56.480 INFO:teuthology.orchestra.run.smithi006.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-07-21T22:11:56.481 INFO:teuthology.orchestra.run.smithi006.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-07-21T22:11:56.481 INFO:teuthology.orchestra.run.smithi006.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-07-21T22:11:56.481 INFO:teuthology.orchestra.run.smithi006.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-07-21T22:11:56.482 INFO:teuthology.orchestra.run.smithi006.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-07-21T22:11:56.482 INFO:teuthology.orchestra.run.smithi006.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-07-21T22:11:56.570 INFO:teuthology.orchestra.run.smithi006.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-07-21T22:11:56.570 INFO:teuthology.orchestra.run.smithi006.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-07-21T22:11:56.571 INFO:teuthology.orchestra.run.smithi006.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-07-21T22:11:56.571 INFO:teuthology.orchestra.run.smithi006.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-07-21T22:11:56.658 INFO:teuthology.orchestra.run.smithi006.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-21T22:11:56.659 INFO:teuthology.orchestra.run.smithi006.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-07-21T22:11:56.660 INFO:teuthology.orchestra.run.smithi006.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-07-21T22:11:56.660 INFO:teuthology.orchestra.run.smithi006.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-07-21T22:11:56.661 INFO:teuthology.orchestra.run.smithi006.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-07-21T22:11:56.721 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4735-gbffe049d-1jammy [3,094 kB] 2023-07-21T22:11:56.753 INFO:teuthology.orchestra.run.smithi006.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-07-21T22:11:56.760 INFO:teuthology.orchestra.run.smithi006.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-07-21T22:11:56.761 INFO:teuthology.orchestra.run.smithi006.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-07-21T22:11:56.761 INFO:teuthology.orchestra.run.smithi006.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-07-21T22:11:56.761 INFO:teuthology.orchestra.run.smithi006.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-07-21T22:11:56.788 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-07-21T22:11:56.797 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-07-21T22:11:56.799 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-07-21T22:11:56.813 INFO:teuthology.orchestra.run.smithi006.stdout:Get:40 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4735-gbffe049d-1jammy [658 kB] 2023-07-21T22:11:56.815 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-07-21T22:11:56.816 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-07-21T22:11:56.818 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-07-21T22:11:56.819 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-07-21T22:11:56.824 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-07-21T22:11:56.824 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-07-21T22:11:56.852 INFO:teuthology.orchestra.run.smithi006.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-07-21T22:11:56.854 INFO:teuthology.orchestra.run.smithi006.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-07-21T22:11:56.855 INFO:teuthology.orchestra.run.smithi006.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-07-21T22:11:56.856 INFO:teuthology.orchestra.run.smithi006.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-07-21T22:11:56.857 INFO:teuthology.orchestra.run.smithi006.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-07-21T22:11:56.924 INFO:teuthology.orchestra.run.smithi006.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4735-gbffe049d-1jammy [345 kB] 2023-07-21T22:11:56.941 INFO:teuthology.orchestra.run.smithi006.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-07-21T22:11:56.942 INFO:teuthology.orchestra.run.smithi006.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-07-21T22:11:56.945 INFO:teuthology.orchestra.run.smithi006.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-07-21T22:11:57.026 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-07-21T22:11:57.033 INFO:teuthology.orchestra.run.smithi006.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4735-gbffe049d-1jammy [23.0 kB] 2023-07-21T22:11:57.034 INFO:teuthology.orchestra.run.smithi006.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4735-gbffe049d-1jammy [170 kB] 2023-07-21T22:11:57.036 INFO:teuthology.orchestra.run.smithi006.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4735-gbffe049d-1jammy [49.0 kB] 2023-07-21T22:11:57.036 INFO:teuthology.orchestra.run.smithi006.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4735-gbffe049d-1jammy [318 kB] 2023-07-21T22:11:57.044 INFO:teuthology.orchestra.run.smithi006.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4735-gbffe049d-1jammy [6,060 kB] 2023-07-21T22:11:57.103 INFO:teuthology.orchestra.run.smithi006.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-07-21T22:11:57.104 INFO:teuthology.orchestra.run.smithi006.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-07-21T22:11:57.106 INFO:teuthology.orchestra.run.smithi006.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-07-21T22:11:57.106 INFO:teuthology.orchestra.run.smithi006.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-21T22:11:57.107 INFO:teuthology.orchestra.run.smithi006.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-07-21T22:11:57.108 INFO:teuthology.orchestra.run.smithi006.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-07-21T22:11:57.320 INFO:teuthology.orchestra.run.smithi006.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-07-21T22:11:57.323 INFO:teuthology.orchestra.run.smithi006.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-07-21T22:11:57.323 INFO:teuthology.orchestra.run.smithi006.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-07-21T22:11:57.396 INFO:teuthology.orchestra.run.smithi006.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-07-21T22:11:57.396 INFO:teuthology.orchestra.run.smithi006.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-07-21T22:11:57.397 INFO:teuthology.orchestra.run.smithi006.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-07-21T22:11:57.397 INFO:teuthology.orchestra.run.smithi006.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-07-21T22:11:57.398 INFO:teuthology.orchestra.run.smithi006.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-07-21T22:11:57.398 INFO:teuthology.orchestra.run.smithi006.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-07-21T22:11:57.412 INFO:teuthology.orchestra.run.smithi006.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-07-21T22:11:57.489 INFO:teuthology.orchestra.run.smithi006.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-07-21T22:11:57.494 INFO:teuthology.orchestra.run.smithi006.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-07-21T22:11:57.496 INFO:teuthology.orchestra.run.smithi006.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-07-21T22:11:57.498 INFO:teuthology.orchestra.run.smithi006.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-07-21T22:11:57.499 INFO:teuthology.orchestra.run.smithi006.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-07-21T22:11:57.503 INFO:teuthology.orchestra.run.smithi006.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-07-21T22:11:57.507 INFO:teuthology.orchestra.run.smithi006.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-07-21T22:11:57.507 INFO:teuthology.orchestra.run.smithi006.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-07-21T22:11:57.512 INFO:teuthology.orchestra.run.smithi006.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-07-21T22:11:57.612 INFO:teuthology.orchestra.run.smithi006.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-07-21T22:11:57.612 INFO:teuthology.orchestra.run.smithi006.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-21T22:11:57.613 INFO:teuthology.orchestra.run.smithi006.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-07-21T22:11:57.613 INFO:teuthology.orchestra.run.smithi006.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-07-21T22:11:57.616 INFO:teuthology.orchestra.run.smithi006.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-07-21T22:11:57.617 INFO:teuthology.orchestra.run.smithi006.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-07-21T22:11:57.632 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-07-21T22:11:57.653 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-07-21T22:11:57.657 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-07-21T22:11:57.664 INFO:teuthology.orchestra.run.smithi161.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-07-21T22:11:57.693 INFO:teuthology.orchestra.run.smithi161.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-21T22:11:57.698 INFO:teuthology.orchestra.run.smithi161.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-07-21T22:11:57.702 INFO:teuthology.orchestra.run.smithi161.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-07-21T22:11:57.714 INFO:teuthology.orchestra.run.smithi006.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-07-21T22:11:57.715 INFO:teuthology.orchestra.run.smithi006.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-07-21T22:11:57.715 INFO:teuthology.orchestra.run.smithi006.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-07-21T22:11:57.717 INFO:teuthology.orchestra.run.smithi006.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-07-21T22:11:57.755 INFO:teuthology.orchestra.run.smithi161.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-07-21T22:11:57.775 INFO:teuthology.orchestra.run.smithi161.stdout:Get:34 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4735-gbffe049d-1jammy [658 kB] 2023-07-21T22:11:57.778 INFO:teuthology.orchestra.run.smithi161.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-07-21T22:11:57.785 INFO:teuthology.orchestra.run.smithi161.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-07-21T22:11:57.825 INFO:teuthology.orchestra.run.smithi006.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-07-21T22:11:58.091 INFO:teuthology.orchestra.run.smithi161.stdout:Get:37 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4735-gbffe049d-1jammy [345 kB] 2023-07-21T22:11:58.118 INFO:teuthology.orchestra.run.smithi161.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-07-21T22:11:58.209 INFO:teuthology.orchestra.run.smithi161.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4735-gbffe049d-1jammy [23.0 kB] 2023-07-21T22:11:58.210 INFO:teuthology.orchestra.run.smithi161.stdout:Get:40 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4735-gbffe049d-1jammy [170 kB] 2023-07-21T22:11:58.228 INFO:teuthology.orchestra.run.smithi161.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-07-21T22:11:58.318 INFO:teuthology.orchestra.run.smithi161.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4735-gbffe049d-1jammy [49.0 kB] 2023-07-21T22:11:58.318 INFO:teuthology.orchestra.run.smithi161.stdout:Get:43 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4735-gbffe049d-1jammy [318 kB] 2023-07-21T22:11:58.350 INFO:teuthology.orchestra.run.smithi161.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-07-21T22:11:58.402 INFO:teuthology.orchestra.run.smithi006.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4735-gbffe049d-1jammy [102 kB] 2023-07-21T22:11:58.403 INFO:teuthology.orchestra.run.smithi006.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4735-gbffe049d-1jammy [430 kB] 2023-07-21T22:11:58.424 INFO:teuthology.orchestra.run.smithi161.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-07-21T22:11:58.441 INFO:teuthology.orchestra.run.smithi161.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4735-gbffe049d-1jammy [6,060 kB] 2023-07-21T22:11:58.478 INFO:teuthology.orchestra.run.smithi006.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4735-gbffe049d-1jammy [22.3 MB] 2023-07-21T22:11:58.587 INFO:teuthology.orchestra.run.smithi161.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-07-21T22:11:58.697 INFO:teuthology.orchestra.run.smithi161.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-07-21T22:11:58.719 INFO:teuthology.orchestra.run.smithi161.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-07-21T22:11:58.763 INFO:teuthology.orchestra.run.smithi161.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-07-21T22:11:58.779 INFO:teuthology.orchestra.run.smithi161.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-07-21T22:11:58.840 INFO:teuthology.orchestra.run.smithi161.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-07-21T22:11:58.847 INFO:teuthology.orchestra.run.smithi161.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-07-21T22:11:59.090 INFO:teuthology.orchestra.run.smithi161.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-07-21T22:12:00.321 INFO:teuthology.orchestra.run.smithi161.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-07-21T22:12:00.322 INFO:teuthology.orchestra.run.smithi161.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-07-21T22:12:00.324 INFO:teuthology.orchestra.run.smithi161.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-07-21T22:12:00.324 INFO:teuthology.orchestra.run.smithi161.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-21T22:12:00.325 INFO:teuthology.orchestra.run.smithi161.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-07-21T22:12:00.326 INFO:teuthology.orchestra.run.smithi161.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-07-21T22:12:00.363 INFO:teuthology.orchestra.run.smithi161.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-07-21T22:12:00.366 INFO:teuthology.orchestra.run.smithi161.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-07-21T22:12:00.367 INFO:teuthology.orchestra.run.smithi161.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-07-21T22:12:00.459 INFO:teuthology.orchestra.run.smithi161.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-07-21T22:12:00.669 INFO:teuthology.orchestra.run.smithi161.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-07-21T22:12:00.961 INFO:teuthology.orchestra.run.smithi161.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-07-21T22:12:01.001 INFO:teuthology.orchestra.run.smithi161.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-07-21T22:12:01.035 INFO:teuthology.orchestra.run.smithi161.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-07-21T22:12:01.104 INFO:teuthology.orchestra.run.smithi161.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-07-21T22:12:01.127 INFO:teuthology.orchestra.run.smithi161.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-07-21T22:12:01.166 INFO:teuthology.orchestra.run.smithi161.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-07-21T22:12:01.167 INFO:teuthology.orchestra.run.smithi161.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4735-gbffe049d-1jammy [102 kB] 2023-07-21T22:12:01.290 INFO:teuthology.orchestra.run.smithi161.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4735-gbffe049d-1jammy [430 kB] 2023-07-21T22:12:01.341 INFO:teuthology.orchestra.run.smithi161.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-07-21T22:12:01.383 INFO:teuthology.orchestra.run.smithi161.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-07-21T22:12:01.419 INFO:teuthology.orchestra.run.smithi161.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-07-21T22:12:01.431 INFO:teuthology.orchestra.run.smithi161.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-07-21T22:12:01.559 INFO:teuthology.orchestra.run.smithi161.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4735-gbffe049d-1jammy [22.3 MB] 2023-07-21T22:12:01.744 INFO:teuthology.orchestra.run.smithi161.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-07-21T22:12:02.301 INFO:teuthology.orchestra.run.smithi161.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-07-21T22:12:02.309 INFO:teuthology.orchestra.run.smithi161.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-07-21T22:12:02.484 INFO:teuthology.orchestra.run.smithi161.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-07-21T22:12:02.538 INFO:teuthology.orchestra.run.smithi161.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-07-21T22:12:02.539 INFO:teuthology.orchestra.run.smithi161.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-21T22:12:02.547 INFO:teuthology.orchestra.run.smithi161.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-07-21T22:12:02.549 INFO:teuthology.orchestra.run.smithi161.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-07-21T22:12:02.561 INFO:teuthology.orchestra.run.smithi161.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-07-21T22:12:02.569 INFO:teuthology.orchestra.run.smithi161.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-07-21T22:12:02.655 INFO:teuthology.orchestra.run.smithi161.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-07-21T22:12:02.805 INFO:teuthology.orchestra.run.smithi161.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-07-21T22:12:02.982 INFO:teuthology.orchestra.run.smithi161.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-07-21T22:12:03.284 INFO:teuthology.orchestra.run.smithi161.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-07-21T22:12:03.316 INFO:teuthology.orchestra.run.smithi161.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-07-21T22:12:05.839 INFO:teuthology.orchestra.run.smithi006.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4735-gbffe049d-1jammy [6,825 kB] 2023-07-21T22:12:11.612 INFO:teuthology.orchestra.run.smithi006.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4735-gbffe049d-1jammy [226 kB] 2023-07-21T22:12:11.938 INFO:teuthology.orchestra.run.smithi006.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4735-gbffe049d-1jammy [114 kB] 2023-07-21T22:12:12.067 INFO:teuthology.orchestra.run.smithi006.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4735-gbffe049d-1jammy [1,469 kB] 2023-07-21T22:12:14.227 INFO:teuthology.orchestra.run.smithi006.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4735-gbffe049d-1jammy [9,880 kB] 2023-07-21T22:12:24.402 INFO:teuthology.orchestra.run.smithi006.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4735-gbffe049d-1jammy [31.5 MB] 2023-07-21T22:12:31.277 INFO:teuthology.orchestra.run.smithi161.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4735-gbffe049d-1jammy [6,825 kB] 2023-07-21T22:12:44.145 INFO:teuthology.orchestra.run.smithi161.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4735-gbffe049d-1jammy [226 kB] 2023-07-21T22:12:44.828 INFO:teuthology.orchestra.run.smithi161.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4735-gbffe049d-1jammy [114 kB] 2023-07-21T22:12:45.230 INFO:teuthology.orchestra.run.smithi161.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4735-gbffe049d-1jammy [1,469 kB] 2023-07-21T22:12:49.189 INFO:teuthology.orchestra.run.smithi161.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4735-gbffe049d-1jammy [9,880 kB] 2023-07-21T22:13:14.894 INFO:teuthology.orchestra.run.smithi161.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4735-gbffe049d-1jammy [31.5 MB] 2023-07-21T22:13:17.136 INFO:teuthology.orchestra.run.smithi006.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4735-gbffe049d-1jammy [3,596 B] 2023-07-21T22:13:17.137 INFO:teuthology.orchestra.run.smithi006.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4735-gbffe049d-1jammy [810 kB] 2023-07-21T22:13:17.735 INFO:teuthology.orchestra.run.smithi006.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4735-gbffe049d-1jammy [2,162 kB] 2023-07-21T22:13:18.890 INFO:teuthology.orchestra.run.smithi006.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4735-gbffe049d-1jammy [218 kB] 2023-07-21T22:13:18.976 INFO:teuthology.orchestra.run.smithi006.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4735-gbffe049d-1jammy [125 kB] 2023-07-21T22:13:19.000 INFO:teuthology.orchestra.run.smithi006.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4735-gbffe049d-1jammy [1,842 kB] 2023-07-21T22:13:19.637 INFO:teuthology.orchestra.run.smithi006.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4735-gbffe049d-1jammy [8,615 kB] 2023-07-21T22:13:22.837 INFO:teuthology.orchestra.run.smithi006.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4735-gbffe049d-1jammy [3,728 B] 2023-07-21T22:13:22.847 INFO:teuthology.orchestra.run.smithi006.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4735-gbffe049d-1jammy [47.5 MB] 2023-07-21T22:13:48.474 INFO:teuthology.orchestra.run.smithi161.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4735-gbffe049d-1jammy [3,596 B] 2023-07-21T22:13:48.484 INFO:teuthology.orchestra.run.smithi161.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4735-gbffe049d-1jammy [810 kB] 2023-07-21T22:13:49.518 INFO:teuthology.orchestra.run.smithi161.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4735-gbffe049d-1jammy [2,162 kB] 2023-07-21T22:13:54.317 INFO:teuthology.orchestra.run.smithi161.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4735-gbffe049d-1jammy [218 kB] 2023-07-21T22:13:55.564 INFO:teuthology.orchestra.run.smithi161.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4735-gbffe049d-1jammy [125 kB] 2023-07-21T22:13:56.545 INFO:teuthology.orchestra.run.smithi161.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4735-gbffe049d-1jammy [1,842 kB] 2023-07-21T22:14:05.127 INFO:teuthology.orchestra.run.smithi161.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4735-gbffe049d-1jammy [8,615 kB] 2023-07-21T22:14:17.138 INFO:teuthology.orchestra.run.smithi161.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4735-gbffe049d-1jammy [3,728 B] 2023-07-21T22:14:17.139 INFO:teuthology.orchestra.run.smithi161.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4735-gbffe049d-1jammy [47.5 MB] 2023-07-21T22:14:29.516 INFO:teuthology.orchestra.run.smithi006.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4735-gbffe049d-1jammy [231 kB] 2023-07-21T22:14:29.635 INFO:teuthology.orchestra.run.smithi006.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4735-gbffe049d-1jammy [217 kB] 2023-07-21T22:14:29.855 INFO:teuthology.orchestra.run.smithi006.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4735-gbffe049d-1jammy [23.8 kB] 2023-07-21T22:14:29.856 INFO:teuthology.orchestra.run.smithi006.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4735-gbffe049d-1jammy [13.2 kB] 2023-07-21T22:14:29.856 INFO:teuthology.orchestra.run.smithi006.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4735-gbffe049d-1jammy [28.3 kB] 2023-07-21T22:14:29.857 INFO:teuthology.orchestra.run.smithi006.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4735-gbffe049d-1jammy [12.0 MB] 2023-07-21T22:14:42.215 INFO:teuthology.orchestra.run.smithi006.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4735-gbffe049d-1jammy [82.1 kB] 2023-07-21T22:14:42.905 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 183 MB in 2min 48s (1,090 kB/s) 2023-07-21T22:14:43.085 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyperclip. 2023-07-21T22:14:43.158 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132932 files and directories currently installed.) 2023-07-21T22:14:43.161 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-07-21T22:14:43.209 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-07-21T22:14:43.562 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-21T22:14:43.576 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-07-21T22:14:43.629 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-21T22:14:43.956 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cmd2. 2023-07-21T22:14:43.971 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-07-21T22:14:44.039 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-07-21T22:14:44.392 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libfmt8:amd64. 2023-07-21T22:14:44.407 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-07-21T22:14:44.501 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-21T22:14:44.938 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-07-21T22:14:44.953 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-07-21T22:14:45.004 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-21T22:14:45.549 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-21T22:14:45.564 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-07-21T22:14:45.616 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-21T22:14:46.027 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-21T22:14:46.042 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-07-21T22:14:46.086 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-21T22:14:46.631 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-21T22:14:46.646 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-21T22:14:46.706 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-21T22:14:47.168 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-21T22:14:47.182 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-21T22:14:47.217 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-21T22:14:47.537 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-21T22:14:47.552 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-21T22:14:47.595 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-21T22:14:47.915 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-07-21T22:14:47.930 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-07-21T22:14:47.973 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-21T22:14:48.310 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librados2. 2023-07-21T22:14:48.325 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../011-librados2_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:14:48.368 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librados2 (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:14:48.779 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librbd1. 2023-07-21T22:14:48.794 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../012-librbd1_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:14:48.829 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librbd1 (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:14:49.249 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libcephfs2. 2023-07-21T22:14:49.264 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:14:49.307 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libcephfs2 (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:14:49.576 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rados. 2023-07-21T22:14:49.591 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:14:49.643 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rados (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:14:49.946 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-21T22:14:49.961 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4735-gbffe049d-1jammy_all.deb ... 2023-07-21T22:14:49.996 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-ceph-argparse (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:14:50.223 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cephfs. 2023-07-21T22:14:50.238 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:14:50.281 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cephfs (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:14:50.593 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-21T22:14:50.608 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4735-gbffe049d-1jammy_all.deb ... 2023-07-21T22:14:50.667 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-ceph-common (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:14:51.029 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-prettytable. 2023-07-21T22:14:51.044 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-07-21T22:14:51.087 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-07-21T22:14:51.323 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rbd. 2023-07-21T22:14:51.338 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:14:51.373 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rbd (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:14:51.759 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-21T22:14:51.774 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-07-21T22:14:51.826 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-21T22:14:52.179 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package librgw2. 2023-07-21T22:14:52.194 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../021-librgw2_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:14:52.229 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking librgw2 (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:14:52.657 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rgw. 2023-07-21T22:14:52.671 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:14:52.715 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rgw (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:14:53.043 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package liboath0:amd64. 2023-07-21T22:14:53.058 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-07-21T22:14:53.101 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-07-21T22:14:53.398 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libradosstriper1. 2023-07-21T22:14:53.413 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:14:53.447 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libradosstriper1 (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:14:53.859 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-common. 2023-07-21T22:14:53.874 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:14:53.917 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-common (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:14:55.031 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-base. 2023-07-21T22:14:55.046 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:14:55.099 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-base (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:14:55.944 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-07-21T22:14:55.959 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-07-21T22:14:55.994 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-07-21T22:14:56.263 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cheroot. 2023-07-21T22:14:56.278 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-07-21T22:14:56.321 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-21T22:14:56.632 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-07-21T22:14:56.648 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-07-21T22:14:56.724 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-07-21T22:14:57.027 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jaraco.text. 2023-07-21T22:14:57.042 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-07-21T22:14:57.085 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-07-21T22:14:57.347 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-07-21T22:14:57.362 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-07-21T22:14:57.396 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-07-21T22:14:57.641 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-tempora. 2023-07-21T22:14:57.656 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-07-21T22:14:57.699 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-07-21T22:14:58.043 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-portend. 2023-07-21T22:14:58.058 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-07-21T22:14:58.101 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-07-21T22:14:58.396 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-07-21T22:14:58.412 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-07-21T22:14:58.454 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-07-21T22:14:58.733 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-21T22:14:58.747 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-07-21T22:14:58.782 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-07-21T22:14:59.136 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-natsort. 2023-07-21T22:14:59.151 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-07-21T22:14:59.194 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-07-21T22:14:59.701 INFO:teuthology.orchestra.run.smithi161.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4735-gbffe049d-1jammy [231 kB] 2023-07-21T22:14:59.714 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-logutils. 2023-07-21T22:14:59.729 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-07-21T22:14:59.772 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-07-21T22:14:59.823 INFO:teuthology.orchestra.run.smithi161.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4735-gbffe049d-1jammy [217 kB] 2023-07-21T22:15:00.007 INFO:teuthology.orchestra.run.smithi161.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4735-gbffe049d-1jammy [23.8 kB] 2023-07-21T22:15:00.008 INFO:teuthology.orchestra.run.smithi161.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4735-gbffe049d-1jammy [13.2 kB] 2023-07-21T22:15:00.009 INFO:teuthology.orchestra.run.smithi161.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4735-gbffe049d-1jammy [28.3 kB] 2023-07-21T22:15:00.011 INFO:teuthology.orchestra.run.smithi161.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4735-gbffe049d-1jammy [12.0 MB] 2023-07-21T22:15:00.058 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-21T22:15:00.073 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-07-21T22:15:00.141 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-07-21T22:15:00.411 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-mako. 2023-07-21T22:15:00.425 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-07-21T22:15:00.460 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-21T22:15:00.789 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-21T22:15:00.804 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-21T22:15:00.847 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-21T22:15:01.158 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-21T22:15:01.174 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-07-21T22:15:01.250 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-07-21T22:15:01.536 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-webob. 2023-07-21T22:15:01.551 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-07-21T22:15:01.594 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-07-21T22:15:01.914 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-waitress. 2023-07-21T22:15:01.929 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-07-21T22:15:01.967 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-21T22:15:02.259 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-tempita. 2023-07-21T22:15:02.274 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-07-21T22:15:02.308 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-07-21T22:15:02.620 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-paste. 2023-07-21T22:15:02.635 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-07-21T22:15:02.677 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-07-21T22:15:02.964 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-21T22:15:02.980 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-07-21T22:15:03.014 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-07-21T22:15:03.317 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-21T22:15:03.332 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-07-21T22:15:03.375 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-07-21T22:15:03.711 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-webtest. 2023-07-21T22:15:03.727 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-07-21T22:15:03.770 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-07-21T22:15:04.039 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pecan. 2023-07-21T22:15:04.054 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-07-21T22:15:04.089 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-07-21T22:15:04.435 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-certifi. 2023-07-21T22:15:04.450 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-07-21T22:15:04.493 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-07-21T22:15:04.813 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-idna. 2023-07-21T22:15:04.828 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-07-21T22:15:04.871 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-idna (3.3-1) ... 2023-07-21T22:15:05.141 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-urllib3. 2023-07-21T22:15:05.156 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-07-21T22:15:05.199 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-07-21T22:15:05.519 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-requests. 2023-07-21T22:15:05.534 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-07-21T22:15:05.577 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-21T22:15:05.921 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-21T22:15:05.937 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-07-21T22:15:05.988 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-21T22:15:06.250 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-21T22:15:06.265 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4735-gbffe049d-1jammy_all.deb ... 2023-07-21T22:15:06.308 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:06.713 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-21T22:15:06.727 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:06.821 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:07.140 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-openssl. 2023-07-21T22:15:07.156 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-07-21T22:15:07.190 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-07-21T22:15:07.527 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr. 2023-07-21T22:15:07.542 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:07.585 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:07.954 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mon. 2023-07-21T22:15:07.970 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:08.013 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mon (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:08.775 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-osd. 2023-07-21T22:15:08.789 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:08.824 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-osd (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:10.070 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph. 2023-07-21T22:15:10.085 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../061-ceph_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:10.127 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:10.480 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-fuse. 2023-07-21T22:15:10.495 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:10.539 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-fuse (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:10.858 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mds. 2023-07-21T22:15:10.874 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:10.908 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mds (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:11.278 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package cephadm. 2023-07-21T22:15:11.293 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../064-cephadm_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:11.336 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking cephadm (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:11.689 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-21T22:15:11.705 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-07-21T22:15:11.747 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-07-21T22:15:12.034 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-babel-localedata. 2023-07-21T22:15:12.049 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-07-21T22:15:12.092 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-21T22:15:12.993 INFO:teuthology.orchestra.run.smithi161.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4735-gbffe049d-1jammy [82.1 kB] 2023-07-21T22:15:13.071 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-babel. 2023-07-21T22:15:13.086 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-07-21T22:15:13.130 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-07-21T22:15:13.441 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-jinja2. 2023-07-21T22:15:13.455 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-07-21T22:15:13.499 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-07-21T22:15:13.658 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 183 MB in 3min 18s (920 kB/s) 2023-07-21T22:15:13.790 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyperclip. 2023-07-21T22:15:13.860 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132932 files and directories currently installed.) 2023-07-21T22:15:13.864 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-07-21T22:15:13.869 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-21T22:15:13.883 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4735-gbffe049d-1jammy_all.deb ... 2023-07-21T22:15:13.905 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-07-21T22:15:13.927 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:14.166 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-21T22:15:14.179 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-07-21T22:15:14.216 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-21T22:15:14.281 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-21T22:15:14.295 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-07-21T22:15:14.339 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-07-21T22:15:14.493 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cmd2. 2023-07-21T22:15:14.507 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-07-21T22:15:14.551 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-07-21T22:15:14.600 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-21T22:15:14.614 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-07-21T22:15:14.650 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-21T22:15:14.863 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libfmt8:amd64. 2023-07-21T22:15:14.877 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-07-21T22:15:14.957 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-21T22:15:15.003 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-routes. 2023-07-21T22:15:15.017 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-07-21T22:15:15.061 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-07-21T22:15:15.293 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-07-21T22:15:15.308 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-07-21T22:15:15.351 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-21T22:15:15.365 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-21T22:15:15.379 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4735-gbffe049d-1jammy_all.deb ... 2023-07-21T22:15:15.423 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:15.688 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-21T22:15:15.702 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-07-21T22:15:15.779 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-21T22:15:15.826 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-07-21T22:15:15.840 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-07-21T22:15:15.885 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-21T22:15:16.074 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-21T22:15:16.089 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-07-21T22:15:16.132 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-21T22:15:16.396 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-joblib. 2023-07-21T22:15:16.411 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-07-21T22:15:16.446 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-07-21T22:15:16.552 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-21T22:15:16.567 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-21T22:15:16.619 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-21T22:15:16.808 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-07-21T22:15:16.823 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-07-21T22:15:16.866 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-07-21T22:15:17.030 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-21T22:15:17.044 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-21T22:15:17.088 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-21T22:15:17.144 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-sklearn. 2023-07-21T22:15:17.159 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-07-21T22:15:17.202 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-21T22:15:17.383 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-21T22:15:17.397 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-21T22:15:17.441 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-21T22:15:17.761 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-07-21T22:15:17.775 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-07-21T22:15:17.819 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-21T22:15:17.878 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-21T22:15:17.892 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4735-gbffe049d-1jammy_all.deb ... 2023-07-21T22:15:17.936 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:18.164 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librados2. 2023-07-21T22:15:18.178 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../011-librados2_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:18.222 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librados2 (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:18.783 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librbd1. 2023-07-21T22:15:18.797 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../012-librbd1_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:18.841 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librbd1 (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:18.872 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-cachetools. 2023-07-21T22:15:18.887 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-07-21T22:15:18.930 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-07-21T22:15:19.192 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-21T22:15:19.207 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-07-21T22:15:19.241 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-07-21T22:15:19.268 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs2. 2023-07-21T22:15:19.282 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:19.327 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs2 (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:19.536 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-21T22:15:19.552 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-07-21T22:15:19.604 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rados. 2023-07-21T22:15:19.612 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-07-21T22:15:19.618 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:19.663 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rados (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:19.888 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-rsa. 2023-07-21T22:15:19.904 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-07-21T22:15:19.939 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-rsa (4.8-1) ... 2023-07-21T22:15:19.965 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-21T22:15:19.980 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4735-gbffe049d-1jammy_all.deb ... 2023-07-21T22:15:20.015 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-ceph-argparse (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:20.292 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cephfs. 2023-07-21T22:15:20.307 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:20.344 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-google-auth. 2023-07-21T22:15:20.351 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cephfs (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:20.360 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-07-21T22:15:20.402 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-07-21T22:15:20.645 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-21T22:15:20.659 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4735-gbffe049d-1jammy_all.deb ... 2023-07-21T22:15:20.703 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-ceph-common (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:20.755 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-21T22:15:20.771 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-07-21T22:15:20.813 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-21T22:15:21.023 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-prettytable. 2023-07-21T22:15:21.037 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-07-21T22:15:21.081 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-07-21T22:15:21.083 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-websocket. 2023-07-21T22:15:21.098 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-07-21T22:15:21.133 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-07-21T22:15:21.325 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rbd. 2023-07-21T22:15:21.340 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:21.409 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rbd (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:21.445 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-21T22:15:21.461 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-07-21T22:15:21.511 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-21T22:15:21.719 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-21T22:15:21.734 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-07-21T22:15:21.778 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-21T22:15:22.097 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librgw2. 2023-07-21T22:15:22.112 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../021-librgw2_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:22.155 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librgw2 (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:22.175 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-21T22:15:22.190 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4735-gbffe049d-1jammy_all.deb ... 2023-07-21T22:15:22.225 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:22.494 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-21T22:15:22.508 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-07-21T22:15:22.552 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-21T22:15:22.658 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rgw. 2023-07-21T22:15:22.672 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:22.716 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rgw (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:22.880 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-21T22:15:22.895 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-07-21T22:15:22.939 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-21T22:15:23.002 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liboath0:amd64. 2023-07-21T22:15:23.016 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-07-21T22:15:23.052 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-07-21T22:15:23.241 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package jq. 2023-07-21T22:15:23.257 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-07-21T22:15:23.300 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-07-21T22:15:23.330 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libradosstriper1. 2023-07-21T22:15:23.344 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:23.388 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libradosstriper1 (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:23.510 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package socat. 2023-07-21T22:15:23.526 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-07-21T22:15:23.560 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-07-21T22:15:23.830 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package xmlstarlet. 2023-07-21T22:15:23.842 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-common. 2023-07-21T22:15:23.846 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-07-21T22:15:23.856 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:23.880 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-07-21T22:15:23.899 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-common (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:24.267 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-test. 2023-07-21T22:15:24.282 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:24.326 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-test (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:24.929 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-base. 2023-07-21T22:15:24.944 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:24.989 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-base (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:25.692 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-07-21T22:15:25.705 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-07-21T22:15:25.750 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-07-21T22:15:26.044 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cheroot. 2023-07-21T22:15:26.058 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-07-21T22:15:26.095 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-21T22:15:26.246 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ceph-volume. 2023-07-21T22:15:26.261 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4735-gbffe049d-1jammy_all.deb ... 2023-07-21T22:15:26.304 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ceph-volume (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:26.397 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-07-21T22:15:26.410 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-07-21T22:15:26.455 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-07-21T22:15:26.659 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package cephfs-mirror. 2023-07-21T22:15:26.674 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:26.709 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking cephfs-mirror (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:26.816 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.text. 2023-07-21T22:15:26.830 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-07-21T22:15:26.908 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-07-21T22:15:27.063 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-colorama. 2023-07-21T22:15:27.078 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-07-21T22:15:27.121 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-07-21T22:15:27.236 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-07-21T22:15:27.250 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-07-21T22:15:27.294 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-07-21T22:15:27.382 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package cephfs-shell. 2023-07-21T22:15:27.397 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4735-gbffe049d-1jammy_all.deb ... 2023-07-21T22:15:27.441 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking cephfs-shell (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:27.580 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-tempora. 2023-07-21T22:15:27.595 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-07-21T22:15:27.630 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-07-21T22:15:27.685 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package cephfs-top. 2023-07-21T22:15:27.700 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4735-gbffe049d-1jammy_all.deb ... 2023-07-21T22:15:27.735 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking cephfs-top (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:27.916 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-portend. 2023-07-21T22:15:27.931 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-07-21T22:15:27.971 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-21T22:15:27.987 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:28.008 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-07-21T22:15:28.029 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libcephfs-dev (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:28.336 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-07-21T22:15:28.351 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-07-21T22:15:28.382 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package nvme-cli. 2023-07-21T22:15:28.394 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-07-21T22:15:28.398 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-07-21T22:15:28.441 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-07-21T22:15:28.696 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-21T22:15:28.711 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-07-21T22:15:28.754 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-21T22:15:28.755 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-07-21T22:15:28.769 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-07-21T22:15:28.812 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-07-21T22:15:29.150 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-natsort. 2023-07-21T22:15:29.165 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-07-21T22:15:29.198 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-iniconfig. 2023-07-21T22:15:29.208 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-07-21T22:15:29.213 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-07-21T22:15:29.248 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-07-21T22:15:29.519 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-logutils. 2023-07-21T22:15:29.533 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-07-21T22:15:29.560 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pastescript. 2023-07-21T22:15:29.576 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-07-21T22:15:29.577 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-07-21T22:15:29.618 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-21T22:15:29.864 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-21T22:15:29.879 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-07-21T22:15:29.913 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-07-21T22:15:29.954 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pluggy. 2023-07-21T22:15:29.970 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-07-21T22:15:30.012 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-07-21T22:15:30.225 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-mako. 2023-07-21T22:15:30.239 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-07-21T22:15:30.283 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-21T22:15:30.365 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-psutil. 2023-07-21T22:15:30.381 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-07-21T22:15:30.423 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-07-21T22:15:30.619 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-21T22:15:30.634 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-21T22:15:30.677 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-21T22:15:30.743 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-py. 2023-07-21T22:15:30.759 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-07-21T22:15:30.801 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-py (1.10.0-1) ... 2023-07-21T22:15:30.980 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-21T22:15:30.995 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-07-21T22:15:31.038 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-07-21T22:15:31.130 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pygments. 2023-07-21T22:15:31.146 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-07-21T22:15:31.188 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-07-21T22:15:31.357 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webob. 2023-07-21T22:15:31.372 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-07-21T22:15:31.407 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-07-21T22:15:31.619 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-21T22:15:31.631 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-07-21T22:15:31.668 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-07-21T22:15:31.727 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-waitress. 2023-07-21T22:15:31.742 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-07-21T22:15:31.780 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-21T22:15:32.005 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-toml. 2023-07-21T22:15:32.017 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-07-21T22:15:32.054 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-07-21T22:15:32.063 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-tempita. 2023-07-21T22:15:32.078 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-07-21T22:15:32.121 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-07-21T22:15:32.398 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-pytest. 2023-07-21T22:15:32.412 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-07-21T22:15:32.457 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-07-21T22:15:32.491 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-paste. 2023-07-21T22:15:32.506 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-07-21T22:15:32.549 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-07-21T22:15:32.736 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package python3-simplejson. 2023-07-21T22:15:32.749 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-07-21T22:15:32.786 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-07-21T22:15:32.844 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-21T22:15:32.859 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-07-21T22:15:32.902 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-07-21T22:15:33.030 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-21T22:15:33.043 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-07-21T22:15:33.088 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-07-21T22:15:33.204 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-21T22:15:33.220 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-07-21T22:15:33.263 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-07-21T22:15:33.582 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webtest. 2023-07-21T22:15:33.597 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-07-21T22:15:33.640 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-07-21T22:15:33.833 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package radosgw. 2023-07-21T22:15:33.845 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../113-radosgw_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:33.883 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking radosgw (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:33.960 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pecan. 2023-07-21T22:15:33.975 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-07-21T22:15:34.018 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-07-21T22:15:34.423 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-certifi. 2023-07-21T22:15:34.438 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-07-21T22:15:34.489 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-07-21T22:15:34.570 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package rbd-fuse. 2023-07-21T22:15:34.583 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:34.653 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking rbd-fuse (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:34.909 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-idna. 2023-07-21T22:15:34.924 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-07-21T22:15:34.938 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-07-21T22:15:34.975 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-idna (3.3-1) ... 2023-07-21T22:15:35.199 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-21T22:15:35.320 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-urllib3. 2023-07-21T22:15:35.325 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-07-21T22:15:35.335 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-07-21T22:15:35.370 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-07-21T22:15:35.605 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-07-21T22:15:35.689 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-requests. 2023-07-21T22:15:35.704 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-07-21T22:15:35.781 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-21T22:15:36.078 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-07-21T22:15:36.100 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-21T22:15:36.116 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-07-21T22:15:36.150 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-21T22:15:36.445 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-21T22:15:36.460 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4735-gbffe049d-1jammy_all.deb ... 2023-07-21T22:15:36.503 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:36.668 INFO:teuthology.orchestra.run.smithi006.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-07-21T22:15:36.713 INFO:teuthology.orchestra.run.smithi006.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-07-21T22:15:36.769 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up cephadm (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:36.941 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-21T22:15:36.955 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:37.007 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:37.305 INFO:teuthology.orchestra.run.smithi006.stdout:Adding system user cephadm....done 2023-07-21T22:15:37.385 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-openssl. 2023-07-21T22:15:37.400 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-07-21T22:15:37.432 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-21T22:15:37.452 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-07-21T22:15:37.751 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-07-21T22:15:37.796 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr. 2023-07-21T22:15:37.811 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:37.854 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:38.043 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-07-21T22:15:38.170 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-07-21T22:15:38.324 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mon. 2023-07-21T22:15:38.339 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:38.390 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mon (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:38.429 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-21T22:15:38.688 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-07-21T22:15:38.789 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-py (1.10.0-1) ... 2023-07-21T22:15:39.099 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-07-21T22:15:39.294 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-osd. 2023-07-21T22:15:39.308 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:39.360 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-osd (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:39.652 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-07-21T22:15:39.927 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-07-21T22:15:40.195 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-07-21T22:15:40.463 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-07-21T22:15:40.547 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph. 2023-07-21T22:15:40.562 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../061-ceph_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:40.605 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:40.806 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-07-21T22:15:41.000 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-fuse. 2023-07-21T22:15:41.014 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:41.065 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-07-21T22:15:41.066 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-fuse (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:41.333 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-ceph-argparse (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:41.544 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mds. 2023-07-21T22:15:41.559 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:41.609 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-21T22:15:41.611 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mds (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:41.744 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-07-21T22:15:41.989 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephadm. 2023-07-21T22:15:42.004 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../064-cephadm_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:42.020 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-07-21T22:15:42.047 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephadm (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:42.271 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-21T22:15:42.380 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-07-21T22:15:42.416 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-21T22:15:42.432 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-07-21T22:15:42.483 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-07-21T22:15:42.764 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-21T22:15:42.811 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-babel-localedata. 2023-07-21T22:15:42.826 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-07-21T22:15:42.877 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-21T22:15:42.890 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-07-21T22:15:43.167 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-07-21T22:15:43.451 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-07-21T22:15:43.802 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-07-21T22:15:43.907 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-babel. 2023-07-21T22:15:43.921 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-07-21T22:15:43.967 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-07-21T22:15:44.318 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jinja2. 2023-07-21T22:15:44.333 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-07-21T22:15:44.377 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-07-21T22:15:44.513 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-07-21T22:15:44.688 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-21T22:15:44.703 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4735-gbffe049d-1jammy_all.deb ... 2023-07-21T22:15:44.771 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:44.780 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-07-21T22:15:44.931 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-07-21T22:15:45.057 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-21T22:15:45.074 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-21T22:15:45.090 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-07-21T22:15:45.124 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-07-21T22:15:45.377 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-21T22:15:45.383 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-07-21T22:15:45.393 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-07-21T22:15:45.435 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-21T22:15:45.755 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-routes. 2023-07-21T22:15:45.770 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-07-21T22:15:45.802 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-07-21T22:15:45.813 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-07-21T22:15:46.069 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-07-21T22:15:46.183 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-21T22:15:46.198 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4735-gbffe049d-1jammy_all.deb ... 2023-07-21T22:15:46.241 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:46.462 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-21T22:15:46.619 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-07-21T22:15:46.634 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-07-21T22:15:46.669 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-21T22:15:46.755 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-07-21T22:15:47.106 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-21T22:15:47.206 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-joblib. 2023-07-21T22:15:47.220 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-07-21T22:15:47.264 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-07-21T22:15:47.476 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-07-21T22:15:47.617 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-07-21T22:15:47.632 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-07-21T22:15:47.676 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-07-21T22:15:47.742 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-07-21T22:15:47.877 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-ceph-common (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:47.953 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sklearn. 2023-07-21T22:15:47.968 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-07-21T22:15:48.003 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-21T22:15:48.186 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-idna (3.3-1) ... 2023-07-21T22:15:48.562 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-21T22:15:48.678 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-21T22:15:48.693 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4735-gbffe049d-1jammy_all.deb ... 2023-07-21T22:15:48.728 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:49.843 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-21T22:15:49.847 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cachetools. 2023-07-21T22:15:49.863 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-07-21T22:15:49.897 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-07-21T22:15:49.977 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-toml (0.10.2-1) ... 2023-07-21T22:15:50.200 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-21T22:15:50.215 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-07-21T22:15:50.245 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-21T22:15:50.258 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-07-21T22:15:50.363 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-07-21T22:15:50.497 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-07-21T22:15:50.612 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-21T22:15:50.627 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-07-21T22:15:50.670 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-07-21T22:15:50.791 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-07-21T22:15:50.972 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rsa. 2023-07-21T22:15:50.987 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-07-21T22:15:51.022 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rsa (4.8-1) ... 2023-07-21T22:15:51.066 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-07-21T22:15:51.325 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-21T22:15:51.421 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-google-auth. 2023-07-21T22:15:51.436 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-07-21T22:15:51.443 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-21T22:15:51.504 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-07-21T22:15:51.577 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-07-21T22:15:51.824 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-21T22:15:51.839 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-07-21T22:15:51.882 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-21T22:15:51.896 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-07-21T22:15:52.139 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-07-21T22:15:52.160 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-websocket. 2023-07-21T22:15:52.176 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-07-21T22:15:52.210 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-07-21T22:15:52.398 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-07-21T22:15:52.505 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-21T22:15:52.521 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-07-21T22:15:52.596 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-21T22:15:52.649 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-21T22:15:52.942 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-07-21T22:15:53.201 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-21T22:15:53.244 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-21T22:15:53.258 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4735-gbffe049d-1jammy_all.deb ... 2023-07-21T22:15:53.302 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:53.311 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-07-21T22:15:53.596 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-21T22:15:53.603 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-21T22:15:53.610 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-07-21T22:15:53.647 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-21T22:15:53.721 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-21T22:15:53.999 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-21T22:15:54.014 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-07-21T22:15:54.022 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-07-21T22:15:54.057 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-21T22:15:54.310 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package jq. 2023-07-21T22:15:54.324 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-07-21T22:15:54.325 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-07-21T22:15:54.368 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-07-21T22:15:54.583 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-07-21T22:15:54.621 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package socat. 2023-07-21T22:15:54.636 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-07-21T22:15:54.679 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-07-21T22:15:54.965 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-07-21T22:15:55.007 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package xmlstarlet. 2023-07-21T22:15:55.023 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-07-21T22:15:55.066 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-07-21T22:15:55.253 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-21T22:15:55.379 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-07-21T22:15:55.420 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-test. 2023-07-21T22:15:55.428 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:55.469 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-test (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:55.788 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-07-21T22:15:56.131 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-portend (3.0.0-1) ... 2023-07-21T22:15:56.399 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-21T22:15:56.525 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-07-21T22:15:56.859 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-07-21T22:15:57.140 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-volume. 2023-07-21T22:15:57.151 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4735-gbffe049d-1jammy_all.deb ... 2023-07-21T22:15:57.190 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-volume (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:57.228 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-21T22:15:57.512 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-07-21T22:15:57.611 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephfs-mirror. 2023-07-21T22:15:57.621 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:57.638 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rsa (4.8-1) ... 2023-07-21T22:15:57.661 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephfs-mirror (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:57.922 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-07-21T22:15:57.973 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-colorama. 2023-07-21T22:15:57.986 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-07-21T22:15:58.023 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-07-21T22:15:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-21T22:15:58.342 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephfs-shell. 2023-07-21T22:15:58.353 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4735-gbffe049d-1jammy_all.deb ... 2023-07-21T22:15:58.400 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephfs-shell (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:58.466 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-07-21T22:15:58.662 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephfs-top. 2023-07-21T22:15:58.673 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4735-gbffe049d-1jammy_all.deb ... 2023-07-21T22:15:58.711 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephfs-top (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:58.868 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-21T22:15:58.939 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-21T22:15:58.950 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:15:58.989 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs-dev (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:59.169 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-07-21T22:15:59.392 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package nvme-cli. 2023-07-21T22:15:59.403 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-07-21T22:15:59.442 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-07-21T22:15:59.538 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-21T22:15:59.664 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librados2 (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:59.780 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-21T22:15:59.789 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librgw2 (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:15:59.790 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-07-21T22:15:59.831 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-07-21T22:16:00.001 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:00.119 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libcephfs2 (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:00.236 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libradosstriper1 (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:00.258 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-iniconfig. 2023-07-21T22:16:00.268 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-07-21T22:16:00.308 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-07-21T22:16:00.362 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-07-21T22:16:00.656 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up librbd1 (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:00.686 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pastescript. 2023-07-21T22:16:00.696 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-07-21T22:16:00.735 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-21T22:16:00.782 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-modules-core (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:00.908 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-fuse (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:01.039 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pluggy. 2023-07-21T22:16:01.050 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-07-21T22:16:01.089 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-07-21T22:16:01.126 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-21T22:16:01.126 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-21T22:16:01.375 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-psutil. 2023-07-21T22:16:01.386 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-07-21T22:16:01.425 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-07-21T22:16:01.785 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libcephfs-dev (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:01.786 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-py. 2023-07-21T22:16:01.797 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-07-21T22:16:01.836 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-py (1.10.0-1) ... 2023-07-21T22:16:01.936 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rados (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:02.053 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up cephfs-top (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:02.165 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pygments. 2023-07-21T22:16:02.175 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-07-21T22:16:02.179 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-21T22:16:02.214 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-07-21T22:16:02.668 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-21T22:16:02.679 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-07-21T22:16:02.719 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-07-21T22:16:03.029 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-toml. 2023-07-21T22:16:03.040 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-07-21T22:16:03.079 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-07-21T22:16:03.390 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pytest. 2023-07-21T22:16:03.401 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-07-21T22:16:03.440 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-07-21T22:16:03.529 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rbd (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:03.635 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up rbd-fuse (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:03.736 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-rgw (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:03.810 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-simplejson. 2023-07-21T22:16:03.821 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-07-21T22:16:03.860 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-07-21T22:16:03.862 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up python3-cephfs (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:04.022 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up cephfs-shell (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:04.138 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-21T22:16:04.147 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-common (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:04.148 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-07-21T22:16:04.187 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-07-21T22:16:04.692 INFO:teuthology.orchestra.run.smithi006.stdout:Adding group ceph....done 2023-07-21T22:16:04.983 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package radosgw. 2023-07-21T22:16:04.993 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../113-radosgw_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:16:05.041 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking radosgw (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:05.102 INFO:teuthology.orchestra.run.smithi006.stdout:Adding system user ceph....done 2023-07-21T22:16:05.288 INFO:teuthology.orchestra.run.smithi006.stdout:Setting system user ceph properties....done 2023-07-21T22:16:05.309 INFO:teuthology.orchestra.run.smithi006.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-21T22:16:05.457 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-21T22:16:05.669 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package rbd-fuse. 2023-07-21T22:16:05.678 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4735-gbffe049d-1jammy_amd64.deb ... 2023-07-21T22:16:05.727 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking rbd-fuse (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:05.874 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-21T22:16:06.048 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-07-21T22:16:06.308 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-21T22:16:06.433 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-07-21T22:16:06.532 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up cephfs-mirror (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:06.697 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-07-21T22:16:06.746 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-21T22:16:06.746 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-21T22:16:07.095 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-07-21T22:16:07.391 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-test (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:07.517 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up radosgw (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:07.694 INFO:teuthology.orchestra.run.smithi161.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-07-21T22:16:07.742 INFO:teuthology.orchestra.run.smithi161.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-07-21T22:16:07.773 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-21T22:16:07.773 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-21T22:16:07.793 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephadm (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:08.405 INFO:teuthology.orchestra.run.smithi161.stdout:Adding system user cephadm....done 2023-07-21T22:16:08.600 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-21T22:16:08.644 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-base (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:08.876 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-07-21T22:16:08.989 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-21T22:16:09.110 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-07-21T22:16:09.245 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-07-21T22:16:09.505 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-21T22:16:09.679 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mds (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:09.772 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-07-21T22:16:09.898 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-py (1.10.0-1) ... 2023-07-21T22:16:09.918 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-21T22:16:09.918 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-21T22:16:10.216 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-07-21T22:16:10.547 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:10.618 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-07-21T22:16:10.776 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-21T22:16:10.776 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-21T22:16:10.878 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-07-21T22:16:11.138 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-07-21T22:16:11.456 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-07-21T22:16:11.715 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-07-21T22:16:11.861 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-osd (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:11.983 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-07-21T22:16:12.191 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-21T22:16:12.191 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-21T22:16:12.242 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-ceph-argparse (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:12.501 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-21T22:16:12.660 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-07-21T22:16:12.830 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:12.928 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-07-21T22:16:12.997 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:13.148 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mon (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:13.188 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-21T22:16:13.314 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-07-21T22:16:13.366 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-21T22:16:13.367 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-21T22:16:13.707 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-21T22:16:13.808 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-07-21T22:16:13.983 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-cephadm (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:14.067 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-07-21T22:16:14.150 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:14.260 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-mgr-dashboard (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:14.343 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-07-21T22:16:14.394 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ceph-volume (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:14.496 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-21T22:16:14.653 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-07-21T22:16:15.380 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-07-21T22:16:15.622 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-21T22:16:15.648 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-07-21T22:16:15.773 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-07-21T22:16:15.925 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-21T22:16:16.097 INFO:teuthology.orchestra.run.smithi006.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-21T22:16:16.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-07-21T22:16:16.179 INFO:teuthology.orchestra.run.smithi006.stdout:Reading package lists... 2023-07-21T22:16:16.242 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-07-21T22:16:16.339 INFO:teuthology.orchestra.run.smithi006.stdout:Building dependency tree... 2023-07-21T22:16:16.340 INFO:teuthology.orchestra.run.smithi006.stdout:Reading state information... 2023-07-21T22:16:16.487 INFO:teuthology.orchestra.run.smithi006.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-07-21T22:16:16.488 INFO:teuthology.orchestra.run.smithi006.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-07-21T22:16:16.488 INFO:teuthology.orchestra.run.smithi006.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-07-21T22:16:16.488 INFO:teuthology.orchestra.run.smithi006.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-07-21T22:16:16.488 INFO:teuthology.orchestra.run.smithi006.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-07-21T22:16:16.488 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages were automatically installed and are no longer required: 2023-07-21T22:16:16.488 INFO:teuthology.orchestra.run.smithi006.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-21T22:16:16.489 INFO:teuthology.orchestra.run.smithi006.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-21T22:16:16.489 INFO:teuthology.orchestra.run.smithi006.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-21T22:16:16.489 INFO:teuthology.orchestra.run.smithi006.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-21T22:16:16.489 INFO:teuthology.orchestra.run.smithi006.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-21T22:16:16.489 INFO:teuthology.orchestra.run.smithi006.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-21T22:16:16.490 INFO:teuthology.orchestra.run.smithi006.stdout:The following additional packages will be installed: 2023-07-21T22:16:16.490 INFO:teuthology.orchestra.run.smithi006.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-07-21T22:16:16.490 INFO:teuthology.orchestra.run.smithi006.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-07-21T22:16:16.490 INFO:teuthology.orchestra.run.smithi006.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-07-21T22:16:16.491 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-07-21T22:16:16.491 INFO:teuthology.orchestra.run.smithi006.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-21T22:16:16.491 INFO:teuthology.orchestra.run.smithi006.stdout:Suggested packages: 2023-07-21T22:16:16.491 INFO:teuthology.orchestra.run.smithi006.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-07-21T22:16:16.491 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-07-21T22:16:16.491 INFO:teuthology.orchestra.run.smithi006.stdout: libengine-pkcs11-openssl 2023-07-21T22:16:16.536 INFO:teuthology.orchestra.run.smithi006.stdout:The following NEW packages will be installed: 2023-07-21T22:16:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-07-21T22:16:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-07-21T22:16:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-07-21T22:16:16.537 INFO:teuthology.orchestra.run.smithi006.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-07-21T22:16:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-07-21T22:16:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-07-21T22:16:16.538 INFO:teuthology.orchestra.run.smithi006.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-21T22:16:16.538 INFO:teuthology.orchestra.run.smithi006.stdout:The following packages will be upgraded: 2023-07-21T22:16:16.539 INFO:teuthology.orchestra.run.smithi006.stdout: libssl3 2023-07-21T22:16:16.635 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-07-21T22:16:16.773 INFO:teuthology.orchestra.run.smithi006.stdout:1 upgraded, 39 newly installed, 0 to remove and 209 not upgraded. 2023-07-21T22:16:16.774 INFO:teuthology.orchestra.run.smithi006.stdout:Need to get 54.6 MB of archives. 2023-07-21T22:16:16.774 INFO:teuthology.orchestra.run.smithi006.stdout:After this operation, 202 MB of additional disk space will be used. 2023-07-21T22:16:16.774 INFO:teuthology.orchestra.run.smithi006.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-07-21T22:16:16.878 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-07-21T22:16:17.329 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-21T22:16:17.386 INFO:teuthology.orchestra.run.smithi006.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-07-21T22:16:17.631 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-07-21T22:16:17.712 INFO:teuthology.orchestra.run.smithi006.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-07-21T22:16:17.753 INFO:teuthology.orchestra.run.smithi006.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-07-21T22:16:17.755 INFO:teuthology.orchestra.run.smithi006.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-07-21T22:16:17.762 INFO:teuthology.orchestra.run.smithi006.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-07-21T22:16:17.768 INFO:teuthology.orchestra.run.smithi006.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-07-21T22:16:17.770 INFO:teuthology.orchestra.run.smithi006.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-07-21T22:16:17.778 INFO:teuthology.orchestra.run.smithi006.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-07-21T22:16:17.784 INFO:teuthology.orchestra.run.smithi006.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-07-21T22:16:17.785 INFO:teuthology.orchestra.run.smithi006.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-07-21T22:16:17.813 INFO:teuthology.orchestra.run.smithi006.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-07-21T22:16:17.885 INFO:teuthology.orchestra.run.smithi006.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-07-21T22:16:17.932 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-21T22:16:18.283 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-07-21T22:16:18.551 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-07-21T22:16:18.651 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-ceph-common (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:18.793 INFO:teuthology.orchestra.run.smithi006.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-07-21T22:16:18.795 INFO:teuthology.orchestra.run.smithi006.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-07-21T22:16:18.796 INFO:teuthology.orchestra.run.smithi006.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-07-21T22:16:18.799 INFO:teuthology.orchestra.run.smithi006.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-07-21T22:16:18.799 INFO:teuthology.orchestra.run.smithi006.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-07-21T22:16:18.804 INFO:teuthology.orchestra.run.smithi006.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-07-21T22:16:18.805 INFO:teuthology.orchestra.run.smithi006.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-07-21T22:16:18.833 INFO:teuthology.orchestra.run.smithi006.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-07-21T22:16:18.833 INFO:teuthology.orchestra.run.smithi006.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-07-21T22:16:18.894 INFO:teuthology.orchestra.run.smithi006.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-07-21T22:16:18.937 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-idna (3.3-1) ... 2023-07-21T22:16:18.955 INFO:teuthology.orchestra.run.smithi006.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-07-21T22:16:18.977 INFO:teuthology.orchestra.run.smithi006.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-07-21T22:16:19.068 INFO:teuthology.orchestra.run.smithi006.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-07-21T22:16:19.151 INFO:teuthology.orchestra.run.smithi006.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-07-21T22:16:19.151 INFO:teuthology.orchestra.run.smithi006.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-07-21T22:16:19.152 INFO:teuthology.orchestra.run.smithi006.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-07-21T22:16:19.152 INFO:teuthology.orchestra.run.smithi006.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-07-21T22:16:19.200 INFO:teuthology.orchestra.run.smithi006.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-07-21T22:16:19.201 INFO:teuthology.orchestra.run.smithi006.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-07-21T22:16:19.288 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-21T22:16:19.591 INFO:teuthology.orchestra.run.smithi006.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-07-21T22:16:19.592 INFO:teuthology.orchestra.run.smithi006.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-07-21T22:16:19.592 INFO:teuthology.orchestra.run.smithi006.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-07-21T22:16:19.593 INFO:teuthology.orchestra.run.smithi006.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-07-21T22:16:19.593 INFO:teuthology.orchestra.run.smithi006.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-07-21T22:16:19.593 INFO:teuthology.orchestra.run.smithi006.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-07-21T22:16:19.636 INFO:teuthology.orchestra.run.smithi006.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-07-21T22:16:19.636 INFO:teuthology.orchestra.run.smithi006.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-07-21T22:16:20.030 INFO:teuthology.orchestra.run.smithi006.stdout:Preconfiguring packages ... 2023-07-21T22:16:20.184 INFO:teuthology.orchestra.run.smithi006.stdout:Fetched 54.6 MB in 3s (17.7 MB/s) 2023-07-21T22:16:20.337 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package flex. 2023-07-21T22:16:20.414 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139905 files and directories currently installed.) 2023-07-21T22:16:20.417 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-07-21T22:16:20.461 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking flex (2.6.4-8build2) ... 2023-07-21T22:16:20.610 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-21T22:16:20.744 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-toml (0.10.2-1) ... 2023-07-21T22:16:21.020 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-21T22:16:21.064 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-21T22:16:21.146 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-07-21T22:16:21.233 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-07-21T22:16:21.272 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-07-21T22:16:21.582 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-07-21T22:16:21.607 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-21T22:16:21.833 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-07-21T22:16:22.092 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-21T22:16:22.200 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package bison. 2023-07-21T22:16:22.218 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-21T22:16:22.278 INFO:teuthology.orchestra.run.smithi006.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139978 files and directories currently installed.) 2023-07-21T22:16:22.282 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-07-21T22:16:22.327 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-07-21T22:16:22.344 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-07-21T22:16:22.663 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-07-21T22:16:22.711 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-07-21T22:16:22.726 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-07-21T22:16:22.769 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-07-21T22:16:22.930 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-07-21T22:16:23.097 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package dump. 2023-07-21T22:16:23.113 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-07-21T22:16:23.189 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking dump (0.4b47-3) ... 2023-07-21T22:16:23.189 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-07-21T22:16:23.449 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-21T22:16:23.475 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package indent. 2023-07-21T22:16:23.492 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-07-21T22:16:23.534 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking indent (2.2.12-1build2) ... 2023-07-21T22:16:23.717 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-07-21T22:16:23.770 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-07-21T22:16:23.786 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-07-21T22:16:23.828 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-21T22:16:23.984 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-21T22:16:24.110 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-07-21T22:16:24.156 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-07-21T22:16:24.173 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-07-21T22:16:24.214 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-21T22:16:24.404 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-21T22:16:24.509 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-07-21T22:16:24.525 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-07-21T22:16:24.529 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-21T22:16:24.567 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-07-21T22:16:24.831 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-07-21T22:16:24.845 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libfl2:amd64. 2023-07-21T22:16:24.862 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-07-21T22:16:24.895 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-07-21T22:16:25.123 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-07-21T22:16:25.131 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-07-21T22:16:25.147 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-07-21T22:16:25.189 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-21T22:16:25.391 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-07-21T22:16:25.467 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libjson-perl. 2023-07-21T22:16:25.483 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-07-21T22:16:25.525 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-07-21T22:16:25.797 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-07-21T22:16:25.837 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libllvm14:amd64. 2023-07-21T22:16:25.853 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-07-21T22:16:25.895 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-21T22:16:26.077 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-21T22:16:26.211 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-07-21T22:16:26.605 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-07-21T22:16:26.872 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-portend (3.0.0-1) ... 2023-07-21T22:16:27.157 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-21T22:16:27.273 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-07-21T22:16:27.283 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-07-21T22:16:27.289 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T22:16:27.331 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-21T22:16:27.566 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libmbim-proxy. 2023-07-21T22:16:27.582 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T22:16:27.609 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-07-21T22:16:27.624 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-21T22:16:27.894 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-07-21T22:16:27.910 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-21T22:16:27.918 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-21T22:16:27.952 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-21T22:16:28.186 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-07-21T22:16:28.312 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rsa (4.8-1) ... 2023-07-21T22:16:28.321 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libndp0:amd64. 2023-07-21T22:16:28.338 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-07-21T22:16:28.380 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-21T22:16:28.588 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-07-21T22:16:28.707 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libnm0:amd64. 2023-07-21T22:16:28.724 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-07-21T22:16:28.765 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-21T22:16:28.856 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-21T22:16:29.068 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libpq5:amd64. 2023-07-21T22:16:29.084 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-21T22:16:29.118 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-21T22:16:29.132 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-07-21T22:16:29.496 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-07-21T22:16:29.513 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-21T22:16:29.517 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-21T22:16:29.554 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-21T22:16:29.810 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-07-21T22:16:29.848 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libqmi-proxy. 2023-07-21T22:16:29.865 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-21T22:16:29.906 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-21T22:16:30.142 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-07-21T22:16:30.159 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-21T22:16:30.162 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-21T22:16:30.192 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-21T22:16:30.321 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librados2 (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:30.431 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librgw2 (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:30.634 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:30.748 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-07-21T22:16:30.760 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs2 (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:30.764 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-07-21T22:16:30.806 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-07-21T22:16:30.886 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libradosstriper1 (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:31.012 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-07-21T22:16:31.134 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package modemmanager. 2023-07-21T22:16:31.150 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-21T22:16:31.184 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-21T22:16:31.305 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librbd1 (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:31.465 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-modules-core (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:31.591 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-fuse (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:31.821 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-21T22:16:31.821 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-21T22:16:31.823 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package network-manager. 2023-07-21T22:16:31.840 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-07-21T22:16:31.890 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-07-21T22:16:32.472 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package ppp. 2023-07-21T22:16:32.489 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-07-21T22:16:32.501 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs-dev (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:32.627 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rados (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:32.753 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephfs-top (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:32.847 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-07-21T22:16:32.879 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-21T22:16:33.177 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package pptp-linux. 2023-07-21T22:16:33.192 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-07-21T22:16:33.235 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-07-21T22:16:33.480 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package network-manager-pptp. 2023-07-21T22:16:33.495 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-07-21T22:16:33.530 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-07-21T22:16:33.833 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql-client-common. 2023-07-21T22:16:33.849 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-07-21T22:16:33.891 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql-client-common (238) ... 2023-07-21T22:16:34.175 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rbd (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:34.195 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql-client-14. 2023-07-21T22:16:34.211 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-21T22:16:34.253 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-21T22:16:34.301 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up rbd-fuse (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:34.427 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rgw (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:34.553 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cephfs (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:34.705 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephfs-shell (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:34.839 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-common (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:34.850 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql-common. 2023-07-21T22:16:34.869 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-07-21T22:16:34.961 INFO:teuthology.orchestra.run.smithi006.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-07-21T22:16:34.991 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql-common (238) ... 2023-07-21T22:16:35.416 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql-14. 2023-07-21T22:16:35.433 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-21T22:16:35.451 INFO:teuthology.orchestra.run.smithi161.stdout:Adding group ceph....done 2023-07-21T22:16:35.477 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-21T22:16:35.911 INFO:teuthology.orchestra.run.smithi161.stdout:Adding system user ceph....done 2023-07-21T22:16:36.072 INFO:teuthology.orchestra.run.smithi161.stdout:Setting system user ceph properties....done 2023-07-21T22:16:36.097 INFO:teuthology.orchestra.run.smithi161.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-21T22:16:36.233 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-21T22:16:36.561 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql. 2023-07-21T22:16:36.576 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-07-21T22:16:36.619 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql (14+238) ... 2023-07-21T22:16:36.627 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-21T22:16:36.863 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql-client. 2023-07-21T22:16:36.878 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-07-21T22:16:36.921 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql-client (14+238) ... 2023-07-21T22:16:37.299 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package postgresql-contrib. 2023-07-21T22:16:37.299 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephfs-mirror (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:37.315 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-07-21T22:16:37.357 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking postgresql-contrib (14+238) ... 2023-07-21T22:16:37.512 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-21T22:16:37.512 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-21T22:16:37.676 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package tcl8.6. 2023-07-21T22:16:37.693 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-07-21T22:16:37.734 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-21T22:16:38.004 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package tcl. 2023-07-21T22:16:38.020 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-07-21T22:16:38.058 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-07-21T22:16:38.150 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-test (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:38.301 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up radosgw (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:38.449 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package wpasupplicant. 2023-07-21T22:16:38.465 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-07-21T22:16:38.507 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-21T22:16:38.583 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-21T22:16:38.583 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-21T22:16:38.828 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-07-21T22:16:38.844 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-07-21T22:16:38.887 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-07-21T22:16:39.264 INFO:teuthology.orchestra.run.smithi006.stdout:Selecting previously unselected package usb-modeswitch. 2023-07-21T22:16:39.281 INFO:teuthology.orchestra.run.smithi006.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-07-21T22:16:39.339 INFO:teuthology.orchestra.run.smithi006.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-21T22:16:39.553 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-base (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:39.666 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql-client-common (238) ... 2023-07-21T22:16:39.862 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up flex (2.6.4-8build2) ... 2023-07-21T22:16:39.898 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-21T22:16:39.988 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-21T22:16:40.114 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-21T22:16:40.249 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-07-21T22:16:40.374 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-21T22:16:40.500 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-21T22:16:40.613 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mds (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:40.854 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-21T22:16:40.855 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-21T22:16:41.519 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:41.543 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-07-21T22:16:41.656 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-21T22:16:41.732 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-21T22:16:41.732 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-21T22:16:42.076 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-21T22:16:42.077 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-21T22:16:42.371 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-osd (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:42.739 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-21T22:16:42.740 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-21T22:16:42.759 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-07-21T22:16:42.877 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-21T22:16:43.011 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-07-21T22:16:43.137 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-07-21T22:16:43.263 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-07-21T22:16:43.389 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-21T22:16:43.397 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:43.515 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-07-21T22:16:43.573 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:43.716 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mon (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:43.934 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-21T22:16:43.935 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-21T22:16:44.171 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-21T22:16:44.296 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up dump (0.4b47-3) ... 2023-07-21T22:16:44.392 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-07-21T22:16:44.449 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-21T22:16:44.575 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-21T22:16:44.584 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-cephadm (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:44.701 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up tcl (8.6.11+1build2) ... 2023-07-21T22:16:44.760 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:44.868 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libjson-perl (4.04000-1) ... 2023-07-21T22:16:44.905 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-dashboard (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:44.994 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-07-21T22:16:45.067 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-07-21T22:16:45.072 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-volume (18.0.0-4735-gbffe049d-1jammy) ... 2023-07-21T22:16:45.137 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up indent (2.2.12-1build2) ... 2023-07-21T22:16:45.207 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-21T22:16:45.288 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-21T22:16:45.473 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-21T22:16:45.599 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-21T22:16:45.725 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-07-21T22:16:45.894 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql-client (14+238) ... 2023-07-21T22:16:46.011 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-07-21T22:16:46.375 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-21T22:16:46.867 INFO:teuthology.orchestra.run.smithi161.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-21T22:16:46.871 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-07-21T22:16:46.946 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2023-07-21T22:16:47.102 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2023-07-21T22:16:47.103 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2023-07-21T22:16:47.228 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:16:47.229 INFO:teuthology.orchestra.run.smithi006.stdout:The following network interfaces were found in /etc/network/interfaces 2023-07-21T22:16:47.229 INFO:teuthology.orchestra.run.smithi006.stdout:which means they are currently configured by ifupdown: 2023-07-21T22:16:47.229 INFO:teuthology.orchestra.run.smithi006.stdout:- ens1f0 2023-07-21T22:16:47.229 INFO:teuthology.orchestra.run.smithi006.stdout:If you want to manage those interfaces with NetworkManager instead 2023-07-21T22:16:47.229 INFO:teuthology.orchestra.run.smithi006.stdout:remove their configuration from /etc/network/interfaces. 2023-07-21T22:16:47.229 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:16:47.244 INFO:teuthology.orchestra.run.smithi161.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-07-21T22:16:47.244 INFO:teuthology.orchestra.run.smithi161.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-07-21T22:16:47.244 INFO:teuthology.orchestra.run.smithi161.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-07-21T22:16:47.245 INFO:teuthology.orchestra.run.smithi161.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-07-21T22:16:47.245 INFO:teuthology.orchestra.run.smithi161.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-07-21T22:16:47.245 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages were automatically installed and are no longer required: 2023-07-21T22:16:47.245 INFO:teuthology.orchestra.run.smithi161.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-21T22:16:47.245 INFO:teuthology.orchestra.run.smithi161.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-21T22:16:47.245 INFO:teuthology.orchestra.run.smithi161.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-21T22:16:47.245 INFO:teuthology.orchestra.run.smithi161.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-21T22:16:47.246 INFO:teuthology.orchestra.run.smithi161.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-21T22:16:47.246 INFO:teuthology.orchestra.run.smithi161.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-21T22:16:47.247 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2023-07-21T22:16:47.247 INFO:teuthology.orchestra.run.smithi161.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-07-21T22:16:47.247 INFO:teuthology.orchestra.run.smithi161.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-07-21T22:16:47.247 INFO:teuthology.orchestra.run.smithi161.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-07-21T22:16:47.247 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-07-21T22:16:47.247 INFO:teuthology.orchestra.run.smithi161.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-21T22:16:47.248 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2023-07-21T22:16:47.248 INFO:teuthology.orchestra.run.smithi161.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-07-21T22:16:47.248 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-07-21T22:16:47.248 INFO:teuthology.orchestra.run.smithi161.stdout: libengine-pkcs11-openssl 2023-07-21T22:16:47.292 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2023-07-21T22:16:47.292 INFO:teuthology.orchestra.run.smithi161.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-07-21T22:16:47.292 INFO:teuthology.orchestra.run.smithi161.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-07-21T22:16:47.293 INFO:teuthology.orchestra.run.smithi161.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-07-21T22:16:47.293 INFO:teuthology.orchestra.run.smithi161.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-07-21T22:16:47.293 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-07-21T22:16:47.293 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-07-21T22:16:47.293 INFO:teuthology.orchestra.run.smithi161.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-21T22:16:47.294 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages will be upgraded: 2023-07-21T22:16:47.294 INFO:teuthology.orchestra.run.smithi161.stdout: libssl3 2023-07-21T22:16:47.368 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-07-21T22:16:47.487 INFO:teuthology.orchestra.run.smithi161.stdout:1 upgraded, 39 newly installed, 0 to remove and 209 not upgraded. 2023-07-21T22:16:47.488 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 54.6 MB of archives. 2023-07-21T22:16:47.488 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 202 MB of additional disk space will be used. 2023-07-21T22:16:47.488 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-07-21T22:16:47.781 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-07-21T22:16:48.043 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-07-21T22:16:48.201 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-07-21T22:16:48.350 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-07-21T22:16:48.403 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-07-21T22:16:48.404 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-07-21T22:16:48.406 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-07-21T22:16:48.410 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-07-21T22:16:48.411 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-07-21T22:16:48.416 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-07-21T22:16:48.418 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-07-21T22:16:48.419 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-07-21T22:16:48.451 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-07-21T22:16:48.520 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-07-21T22:16:48.922 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-21T22:16:49.065 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-21T22:16:49.191 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-07-21T22:16:49.317 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql-common (238) ... 2023-07-21T22:16:49.381 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-07-21T22:16:49.383 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-07-21T22:16:49.384 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-07-21T22:16:49.387 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-07-21T22:16:49.387 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-07-21T22:16:49.392 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-07-21T22:16:49.394 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-07-21T22:16:49.403 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-07-21T22:16:49.403 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-07-21T22:16:49.499 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-07-21T22:16:49.580 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-07-21T22:16:49.593 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-07-21T22:16:49.692 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-07-21T22:16:49.696 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-07-21T22:16:49.697 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-07-21T22:16:49.698 INFO:teuthology.orchestra.run.smithi161.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-07-21T22:16:49.698 INFO:teuthology.orchestra.run.smithi161.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-07-21T22:16:49.712 INFO:teuthology.orchestra.run.smithi161.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-07-21T22:16:49.714 INFO:teuthology.orchestra.run.smithi161.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-07-21T22:16:50.239 INFO:teuthology.orchestra.run.smithi006.stdout:Adding user postgres to group ssl-cert 2023-07-21T22:16:50.341 INFO:teuthology.orchestra.run.smithi161.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-07-21T22:16:50.341 INFO:teuthology.orchestra.run.smithi161.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-07-21T22:16:50.341 INFO:teuthology.orchestra.run.smithi161.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-07-21T22:16:50.342 INFO:teuthology.orchestra.run.smithi161.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-07-21T22:16:50.342 INFO:teuthology.orchestra.run.smithi161.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-07-21T22:16:50.342 INFO:teuthology.orchestra.run.smithi161.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-07-21T22:16:50.357 INFO:teuthology.orchestra.run.smithi161.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-07-21T22:16:50.358 INFO:teuthology.orchestra.run.smithi161.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-07-21T22:16:50.515 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:16:50.515 INFO:teuthology.orchestra.run.smithi006.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-07-21T22:16:50.734 INFO:teuthology.orchestra.run.smithi161.stdout:Preconfiguring packages ... 2023-07-21T22:16:50.787 INFO:teuthology.orchestra.run.smithi006.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-07-21T22:16:50.787 INFO:teuthology.orchestra.run.smithi006.stdout:Removing obsolete dictionary files: 2023-07-21T22:16:50.894 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 54.6 MB in 3s (17.9 MB/s) 2023-07-21T22:16:51.048 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package flex. 2023-07-21T22:16:51.122 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139905 files and directories currently installed.) 2023-07-21T22:16:51.126 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-07-21T22:16:51.163 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking flex (2.6.4-8build2) ... 2023-07-21T22:16:51.530 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-07-21T22:16:51.749 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-21T22:16:51.927 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-07-21T22:16:52.026 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-21T22:16:52.369 INFO:teuthology.orchestra.run.smithi006.stdout:Creating new PostgreSQL cluster 14/main ... 2023-07-21T22:16:52.393 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-07-21T22:16:52.442 INFO:teuthology.orchestra.run.smithi006.stdout:The files belonging to this database system will be owned by user "postgres". 2023-07-21T22:16:52.442 INFO:teuthology.orchestra.run.smithi006.stdout:This user must also own the server process. 2023-07-21T22:16:52.442 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:16:52.442 INFO:teuthology.orchestra.run.smithi006.stdout:The database cluster will be initialized with locale "en_US". 2023-07-21T22:16:52.442 INFO:teuthology.orchestra.run.smithi006.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-07-21T22:16:52.443 INFO:teuthology.orchestra.run.smithi006.stdout:The default text search configuration will be set to "english". 2023-07-21T22:16:52.443 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:16:52.443 INFO:teuthology.orchestra.run.smithi006.stdout:Data page checksums are disabled. 2023-07-21T22:16:52.443 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:16:52.443 INFO:teuthology.orchestra.run.smithi006.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-07-21T22:16:52.444 INFO:teuthology.orchestra.run.smithi006.stdout:creating subdirectories ... ok 2023-07-21T22:16:52.444 INFO:teuthology.orchestra.run.smithi006.stdout:selecting dynamic shared memory implementation ... posix 2023-07-21T22:16:52.468 INFO:teuthology.orchestra.run.smithi006.stdout:selecting default max_connections ... 100 2023-07-21T22:16:52.504 INFO:teuthology.orchestra.run.smithi006.stdout:selecting default shared_buffers ... 128MB 2023-07-21T22:16:52.517 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-21T22:16:52.518 INFO:teuthology.orchestra.run.smithi006.stdout:selecting default time zone ... Etc/UTC 2023-07-21T22:16:52.518 INFO:teuthology.orchestra.run.smithi006.stdout:creating configuration files ... ok 2023-07-21T22:16:52.704 INFO:teuthology.orchestra.run.smithi006.stdout:running bootstrap script ... ok 2023-07-21T22:16:53.070 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package bison. 2023-07-21T22:16:53.144 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139978 files and directories currently installed.) 2023-07-21T22:16:53.147 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-07-21T22:16:53.197 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-07-21T22:16:53.353 INFO:teuthology.orchestra.run.smithi006.stdout:performing post-bootstrap initialization ... ok 2023-07-21T22:16:53.632 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-07-21T22:16:53.646 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-07-21T22:16:53.690 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-07-21T22:16:53.910 INFO:teuthology.orchestra.run.smithi006.stdout:syncing data to disk ... ok 2023-07-21T22:16:53.943 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package dump. 2023-07-21T22:16:53.957 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-07-21T22:16:54.004 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking dump (0.4b47-3) ... 2023-07-21T22:16:54.296 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package indent. 2023-07-21T22:16:54.311 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-07-21T22:16:54.355 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking indent (2.2.12-1build2) ... 2023-07-21T22:16:54.426 INFO:teuthology.orchestra.run.smithi006.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-07-21T22:16:54.649 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-07-21T22:16:54.664 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-07-21T22:16:54.707 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-21T22:16:54.985 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-07-21T22:16:55.001 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-07-21T22:16:55.036 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-21T22:16:55.288 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-07-21T22:16:55.304 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-07-21T22:16:55.346 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-07-21T22:16:55.708 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libfl2:amd64. 2023-07-21T22:16:55.724 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-07-21T22:16:55.758 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-07-21T22:16:56.010 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-07-21T22:16:56.026 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-07-21T22:16:56.069 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-21T22:16:56.330 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libjson-perl. 2023-07-21T22:16:56.345 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-07-21T22:16:56.388 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-07-21T22:16:56.699 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libllvm14:amd64. 2023-07-21T22:16:56.715 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-07-21T22:16:56.757 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-21T22:16:57.393 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-21T22:16:57.494 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql-contrib (14+238) ... 2023-07-21T22:16:57.603 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up postgresql (14+238) ... 2023-07-21T22:16:57.729 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-21T22:16:57.855 INFO:teuthology.orchestra.run.smithi006.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-21T22:16:58.102 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-07-21T22:16:58.117 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T22:16:58.152 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-21T22:16:58.158 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-07-21T22:16:58.158 INFO:teuthology.orchestra.run.smithi006.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-07-21T22:16:58.396 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libmbim-proxy. 2023-07-21T22:16:58.411 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-21T22:16:58.454 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-21T22:16:58.782 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-07-21T22:16:58.797 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-21T22:16:58.840 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-21T22:16:58.916 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-07-21T22:16:59.218 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libndp0:amd64. 2023-07-21T22:16:59.233 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-07-21T22:16:59.243 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-21T22:16:59.284 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-21T22:16:59.386 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-21T22:16:59.662 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libnm0:amd64. 2023-07-21T22:16:59.678 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-07-21T22:16:59.728 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-21T22:17:00.157 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libpq5:amd64. 2023-07-21T22:17:00.172 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-21T22:17:00.223 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-21T22:17:00.643 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-07-21T22:17:00.658 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-21T22:17:00.709 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-21T22:17:00.839 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-07-21T22:17:00.956 INFO:teuthology.orchestra.run.smithi006.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-07-21T22:17:01.054 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqmi-proxy. 2023-07-21T22:17:01.069 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-21T22:17:01.120 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-21T22:17:01.456 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-07-21T22:17:01.472 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-21T22:17:01.514 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-21T22:17:01.702 INFO:teuthology.orchestra.run.smithi006.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-21T22:17:01.706 DEBUG:teuthology.parallel:result is None 2023-07-21T22:17:02.034 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-07-21T22:17:02.049 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-07-21T22:17:02.093 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-07-21T22:17:02.412 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package modemmanager. 2023-07-21T22:17:02.427 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-21T22:17:02.462 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-21T22:17:03.060 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package network-manager. 2023-07-21T22:17:03.075 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-07-21T22:17:03.127 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-07-21T22:17:03.717 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ppp. 2023-07-21T22:17:03.733 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-07-21T22:17:04.078 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-07-21T22:17:04.405 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package pptp-linux. 2023-07-21T22:17:04.419 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-07-21T22:17:04.463 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-07-21T22:17:04.732 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package network-manager-pptp. 2023-07-21T22:17:04.747 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-07-21T22:17:04.791 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-07-21T22:17:05.085 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-client-common. 2023-07-21T22:17:05.099 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-07-21T22:17:05.143 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-client-common (238) ... 2023-07-21T22:17:05.447 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-client-14. 2023-07-21T22:17:05.462 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-21T22:17:05.506 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-21T22:17:06.093 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-common. 2023-07-21T22:17:06.108 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-07-21T22:17:06.169 INFO:teuthology.orchestra.run.smithi161.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-07-21T22:17:06.200 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-common (238) ... 2023-07-21T22:17:06.667 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-14. 2023-07-21T22:17:06.683 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-21T22:17:06.753 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-21T22:17:07.829 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql. 2023-07-21T22:17:07.843 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-07-21T22:17:07.878 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql (14+238) ... 2023-07-21T22:17:08.106 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-client. 2023-07-21T22:17:08.121 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-07-21T22:17:08.237 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-client (14+238) ... 2023-07-21T22:17:08.483 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-contrib. 2023-07-21T22:17:08.498 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-07-21T22:17:08.541 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-contrib (14+238) ... 2023-07-21T22:17:08.861 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package tcl8.6. 2023-07-21T22:17:08.876 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-07-21T22:17:08.944 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-21T22:17:09.213 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package tcl. 2023-07-21T22:17:09.229 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-07-21T22:17:09.268 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-07-21T22:17:09.625 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package wpasupplicant. 2023-07-21T22:17:09.644 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-07-21T22:17:09.683 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-21T22:17:10.062 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-07-21T22:17:10.078 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-07-21T22:17:10.120 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-07-21T22:17:10.507 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package usb-modeswitch. 2023-07-21T22:17:10.523 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-07-21T22:17:10.574 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-21T22:17:10.858 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-client-common (238) ... 2023-07-21T22:17:11.071 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up flex (2.6.4-8build2) ... 2023-07-21T22:17:11.248 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-21T22:17:11.373 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-21T22:17:11.500 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-07-21T22:17:11.634 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-21T22:17:11.735 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-21T22:17:13.093 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-07-21T22:17:13.191 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-21T22:17:13.587 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-21T22:17:13.588 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-21T22:17:14.311 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-07-21T22:17:14.457 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-21T22:17:14.588 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-07-21T22:17:14.722 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-07-21T22:17:14.848 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-07-21T22:17:14.974 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-21T22:17:15.109 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-07-21T22:17:16.287 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-21T22:17:16.505 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up dump (0.4b47-3) ... 2023-07-21T22:17:16.717 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-07-21T22:17:16.800 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-21T22:17:17.193 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-21T22:17:17.294 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up tcl (8.6.11+1build2) ... 2023-07-21T22:17:17.395 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libjson-perl (4.04000-1) ... 2023-07-21T22:17:17.513 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-07-21T22:17:17.603 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-07-21T22:17:17.681 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up indent (2.2.12-1build2) ... 2023-07-21T22:17:17.841 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-21T22:17:18.017 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-21T22:17:18.126 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-21T22:17:18.228 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-07-21T22:17:18.363 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-client (14+238) ... 2023-07-21T22:17:18.480 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-07-21T22:17:19.078 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:19.078 INFO:teuthology.orchestra.run.smithi161.stdout:The following network interfaces were found in /etc/network/interfaces 2023-07-21T22:17:19.078 INFO:teuthology.orchestra.run.smithi161.stdout:which means they are currently configured by ifupdown: 2023-07-21T22:17:19.078 INFO:teuthology.orchestra.run.smithi161.stdout:- enp3s0f1 2023-07-21T22:17:19.078 INFO:teuthology.orchestra.run.smithi161.stdout:If you want to manage those interfaces with NetworkManager instead 2023-07-21T22:17:19.079 INFO:teuthology.orchestra.run.smithi161.stdout:remove their configuration from /etc/network/interfaces. 2023-07-21T22:17:19.079 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:19.211 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-07-21T22:17:19.608 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-07-21T22:17:20.021 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-07-21T22:17:20.724 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-21T22:17:20.859 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-21T22:17:20.968 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-07-21T22:17:21.078 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-common (238) ... 2023-07-21T22:17:22.081 INFO:teuthology.orchestra.run.smithi161.stdout:Adding user postgres to group ssl-cert 2023-07-21T22:17:22.345 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:22.346 INFO:teuthology.orchestra.run.smithi161.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-07-21T22:17:22.612 INFO:teuthology.orchestra.run.smithi161.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-07-21T22:17:22.612 INFO:teuthology.orchestra.run.smithi161.stdout:Removing obsolete dictionary files: 2023-07-21T22:17:23.319 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-07-21T22:17:23.788 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-21T22:17:24.130 INFO:teuthology.orchestra.run.smithi161.stdout:Creating new PostgreSQL cluster 14/main ... 2023-07-21T22:17:24.157 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-07-21T22:17:24.206 INFO:teuthology.orchestra.run.smithi161.stdout:The files belonging to this database system will be owned by user "postgres". 2023-07-21T22:17:24.206 INFO:teuthology.orchestra.run.smithi161.stdout:This user must also own the server process. 2023-07-21T22:17:24.206 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:24.207 INFO:teuthology.orchestra.run.smithi161.stdout:The database cluster will be initialized with locale "en_US". 2023-07-21T22:17:24.207 INFO:teuthology.orchestra.run.smithi161.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-07-21T22:17:24.207 INFO:teuthology.orchestra.run.smithi161.stdout:The default text search configuration will be set to "english". 2023-07-21T22:17:24.207 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:24.207 INFO:teuthology.orchestra.run.smithi161.stdout:Data page checksums are disabled. 2023-07-21T22:17:24.207 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:24.207 INFO:teuthology.orchestra.run.smithi161.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-07-21T22:17:24.208 INFO:teuthology.orchestra.run.smithi161.stdout:creating subdirectories ... ok 2023-07-21T22:17:24.208 INFO:teuthology.orchestra.run.smithi161.stdout:selecting dynamic shared memory implementation ... posix 2023-07-21T22:17:24.231 INFO:teuthology.orchestra.run.smithi161.stdout:selecting default max_connections ... 100 2023-07-21T22:17:24.265 INFO:teuthology.orchestra.run.smithi161.stdout:selecting default shared_buffers ... 128MB 2023-07-21T22:17:24.279 INFO:teuthology.orchestra.run.smithi161.stdout:selecting default time zone ... Etc/UTC 2023-07-21T22:17:24.279 INFO:teuthology.orchestra.run.smithi161.stdout:creating configuration files ... ok 2023-07-21T22:17:24.459 INFO:teuthology.orchestra.run.smithi161.stdout:running bootstrap script ... ok 2023-07-21T22:17:25.087 INFO:teuthology.orchestra.run.smithi161.stdout:performing post-bootstrap initialization ... ok 2023-07-21T22:17:25.644 INFO:teuthology.orchestra.run.smithi161.stdout:syncing data to disk ... ok 2023-07-21T22:17:26.168 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-07-21T22:17:29.271 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-21T22:17:29.380 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-contrib (14+238) ... 2023-07-21T22:17:29.506 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql (14+238) ... 2023-07-21T22:17:29.632 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-21T22:17:29.758 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-21T22:17:30.019 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-07-21T22:17:30.019 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-07-21T22:17:30.810 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-07-21T22:17:31.146 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-21T22:17:31.306 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-21T22:17:32.465 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-07-21T22:17:32.565 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-07-21T22:17:33.231 INFO:teuthology.orchestra.run.smithi161.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-21T22:17:33.235 DEBUG:teuthology.parallel:result is None 2023-07-21T22:17:33.236 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea 2023-07-21T22:17:38.731 DEBUG:teuthology.orchestra.run.smithi006:> dpkg-query -W -f '${Version}' ceph 2023-07-21T22:17:38.756 INFO:teuthology.orchestra.run.smithi006.stdout:18.0.0-4735-gbffe049d-1jammy 2023-07-21T22:17:38.757 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4735-gbffe049d-1jammy 2023-07-21T22:17:38.757 INFO:teuthology.task.install:The correct ceph version 18.0.0-4735-gbffe049d-1jammy is installed. 2023-07-21T22:17:38.758 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea 2023-07-21T22:17:39.283 DEBUG:teuthology.orchestra.run.smithi161:> dpkg-query -W -f '${Version}' ceph 2023-07-21T22:17:39.308 INFO:teuthology.orchestra.run.smithi161.stdout:18.0.0-4735-gbffe049d-1jammy 2023-07-21T22:17:39.308 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4735-gbffe049d-1jammy 2023-07-21T22:17:39.309 INFO:teuthology.task.install:The correct ceph version 18.0.0-4735-gbffe049d-1jammy is installed. 2023-07-21T22:17:39.309 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-21T22:17:39.310 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:17:39.310 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-21T22:17:39.334 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:17:39.335 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-21T22:17:39.372 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-21T22:17:39.373 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:17:39.373 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2023-07-21T22:17:39.400 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-21T22:17:39.462 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:17:39.463 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2023-07-21T22:17:39.485 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-21T22:17:39.550 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-21T22:17:39.550 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:17:39.550 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-21T22:17:39.573 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-21T22:17:39.643 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:17:39.644 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-21T22:17:39.666 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-21T22:17:39.733 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-21T22:17:39.734 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:17:39.734 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/stdin-killer 2023-07-21T22:17:39.757 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-21T22:17:39.822 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:17:39.823 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/stdin-killer 2023-07-21T22:17:39.846 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-21T22:17:39.914 INFO:teuthology.run_tasks:Running task ceph... 2023-07-21T22:17:40.003 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-21T22:17:40.004 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /var/log/ceph 2023-07-21T22:17:40.007 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /var/log/ceph 2023-07-21T22:17:40.030 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-21T22:17:40.030 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-21T22:17:40.071 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-21T22:17:40.093 INFO:tasks.ceph:Creating extra log directories... 2023-07-21T22:17:40.094 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-21T22:17:40.135 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-21T22:17:40.167 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-21T22:17:40.168 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-21T22:17:40.168 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-21T22:17:40.169 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:17:40.169 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-21T22:17:40.205 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-21T22:17:40.306 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:17:40.306 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-21T22:17:40.316 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-21T22:17:40.414 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-21T22:17:40.414 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-21T22:17:40.415 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347723', 'branch': 'wip-rishabh-2023Jul13-base-2', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}', 'email': None, 'first_in_suite': False, 'job_id': '7347723', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023Jul13-base-2'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023Jul13-base-2', 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023Jul13-base-2', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi006.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOUszSwimgYtFS7cen54X1lzfsN292TP9qlmFs5yWykObaLJVp3uB03mmulOtz7nQBgqRP24rq8z1EUFjDSnTKM=', 'smithi161.front.sepia.ceph.com': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHmz7LX6eLJUvaM/jSQToke5Y4YCbIL+2S4t0PpfaYWE'}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '79491cb69dd37a1eafb93b3471998174bdfa2fd9', 'timestamp': '2023-07-21_21:30:53', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-21T22:17:40.416 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-21T22:17:40.421 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-21T22:17:40.431 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/run/ceph 2023-07-21T22:17:40.476 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/run/ceph 2023-07-21T22:17:40.498 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:17:40.498 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2023-07-21T22:17:40.546 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-21T22:17:40.546 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 2023-07-21T22:17:40.601 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-21T22:17:40.601 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:17:40.602 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 889 Links: 1 2023-07-21T22:17:40.602 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:17:40.602 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-07-21 22:07:37.156143554 +0000 2023-07-21T22:17:40.602 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-07-21 22:07:36.736156545 +0000 2023-07-21T22:17:40.602 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-07-21 22:07:36.736156545 +0000 2023-07-21T22:17:40.602 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2023-07-21 22:07:36.736156545 +0000 2023-07-21T22:17:40.603 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-21T22:17:40.669 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-07-21T22:17:40.669 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-07-21T22:17:40.669 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000374129 s, 1.4 MB/s 2023-07-21T22:17:40.670 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-21T22:17:40.727 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 2023-07-21T22:17:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-21T22:17:40.778 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:17:40.778 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 905 Links: 1 2023-07-21T22:17:40.778 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:17:40.778 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-07-21 22:07:37.448134522 +0000 2023-07-21T22:17:40.779 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-07-21 22:07:37.444134646 +0000 2023-07-21T22:17:40.779 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-07-21 22:07:37.444134646 +0000 2023-07-21T22:17:40.779 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2023-07-21 22:07:37.444134646 +0000 2023-07-21T22:17:40.779 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-21T22:17:40.844 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-07-21T22:17:40.845 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-07-21T22:17:40.845 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.00037611 s, 1.4 MB/s 2023-07-21T22:17:40.846 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-21T22:17:40.899 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 2023-07-21T22:17:40.950 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-21T22:17:40.950 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:17:40.951 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 924 Links: 1 2023-07-21T22:17:40.951 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:17:40.951 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-07-21 22:07:38.580100663 +0000 2023-07-21T22:17:40.951 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-07-21 22:07:38.192111889 +0000 2023-07-21T22:17:40.951 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-07-21 22:07:38.192111889 +0000 2023-07-21T22:17:40.951 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2023-07-21 22:07:38.192111889 +0000 2023-07-21T22:17:40.952 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-21T22:17:41.017 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-07-21T22:17:41.017 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-07-21T22:17:41.017 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000373994 s, 1.4 MB/s 2023-07-21T22:17:41.019 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-21T22:17:41.075 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 2023-07-21T22:17:41.130 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-21T22:17:41.130 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:17:41.130 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 5h/5d Inode: 942 Links: 1 2023-07-21T22:17:41.131 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:17:41.131 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-07-21 22:07:39.272080643 +0000 2023-07-21T22:17:41.131 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-07-21 22:07:38.828093488 +0000 2023-07-21T22:17:41.132 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-07-21 22:07:38.828093488 +0000 2023-07-21T22:17:41.132 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2023-07-21 22:07:38.828093488 +0000 2023-07-21T22:17:41.132 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-21T22:17:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-07-21T22:17:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-07-21T22:17:41.194 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000665716 s, 769 kB/s 2023-07-21T22:17:41.196 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-21T22:17:41.247 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-21T22:17:41.247 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:17:41.247 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2023-07-21T22:17:41.258 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-21T22:17:41.258 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 2023-07-21T22:17:41.309 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-21T22:17:41.310 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:17:41.310 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 888 Links: 1 2023-07-21T22:17:41.311 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:17:41.311 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-07-21 22:07:31.383640785 +0000 2023-07-21T22:17:41.311 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-07-21 22:07:30.963644535 +0000 2023-07-21T22:17:41.311 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-07-21 22:07:30.963644535 +0000 2023-07-21T22:17:41.312 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2023-07-21 22:07:30.963644535 +0000 2023-07-21T22:17:41.312 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-21T22:17:41.377 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-07-21T22:17:41.377 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-07-21T22:17:41.377 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000398797 s, 1.3 MB/s 2023-07-21T22:17:41.378 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-21T22:17:41.436 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 2023-07-21T22:17:41.489 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-21T22:17:41.490 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:17:41.490 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 904 Links: 1 2023-07-21T22:17:41.490 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:17:41.490 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-07-21 22:07:32.059634747 +0000 2023-07-21T22:17:41.490 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-07-21 22:07:31.631638570 +0000 2023-07-21T22:17:41.490 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-07-21 22:07:31.631638570 +0000 2023-07-21T22:17:41.491 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2023-07-21 22:07:31.631638570 +0000 2023-07-21T22:17:41.491 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-21T22:17:41.552 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-07-21T22:17:41.552 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-07-21T22:17:41.553 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000393968 s, 1.3 MB/s 2023-07-21T22:17:41.554 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-21T22:17:41.607 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 2023-07-21T22:17:41.661 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-21T22:17:41.662 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:17:41.662 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 922 Links: 1 2023-07-21T22:17:41.662 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:17:41.662 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-07-21 22:07:32.715628886 +0000 2023-07-21T22:17:41.663 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-07-21 22:07:32.323632388 +0000 2023-07-21T22:17:41.663 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-07-21 22:07:32.323632388 +0000 2023-07-21T22:17:41.663 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2023-07-21 22:07:32.323632388 +0000 2023-07-21T22:17:41.663 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-21T22:17:41.728 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-07-21T22:17:41.728 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-07-21T22:17:41.729 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000383836 s, 1.3 MB/s 2023-07-21T22:17:41.730 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-21T22:17:41.787 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 2023-07-21T22:17:41.841 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-21T22:17:41.842 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:17:41.842 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 937 Links: 1 2023-07-21T22:17:41.842 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:17:41.842 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-07-21 22:07:33.399622777 +0000 2023-07-21T22:17:41.842 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-07-21 22:07:32.971626600 +0000 2023-07-21T22:17:41.842 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-07-21 22:07:32.971626600 +0000 2023-07-21T22:17:41.843 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2023-07-21 22:07:32.971626600 +0000 2023-07-21T22:17:41.843 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-21T22:17:41.904 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-07-21T22:17:41.905 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-07-21T22:17:41.905 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000403994 s, 1.3 MB/s 2023-07-21T22:17:41.906 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-21T22:17:41.959 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-21T22:17:41.960 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-21T22:17:41.960 INFO:tasks.ceph:Generating config... 2023-07-21T22:17:41.961 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-21T22:17:41.961 INFO:tasks.ceph:[client] debug client = 20 2023-07-21T22:17:41.962 INFO:tasks.ceph:[client] debug ms = 1 2023-07-21T22:17:41.962 INFO:tasks.ceph:[client] pid file = 2023-07-21T22:17:41.962 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-21T22:17:41.962 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-21T22:17:41.962 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-21T22:17:41.963 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-21T22:17:41.963 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-21T22:17:41.963 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-21T22:17:41.964 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-21T22:17:41.964 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-21T22:17:41.964 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-21T22:17:41.964 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-21T22:17:41.965 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-21T22:17:41.965 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-21T22:17:41.965 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-21T22:17:41.965 INFO:tasks.ceph:[mgr] debug client = 20 2023-07-21T22:17:41.965 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-07-21T22:17:41.966 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-21T22:17:41.966 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-21T22:17:41.966 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-21T22:17:41.966 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-21T22:17:41.966 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-21T22:17:41.967 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-21T22:17:41.967 INFO:tasks.ceph:[osd] bdev async discard = True 2023-07-21T22:17:41.967 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-07-21T22:17:41.968 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-07-21T22:17:41.968 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-21T22:17:41.968 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-21T22:17:41.968 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-07-21T22:17:41.969 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-07-21T22:17:41.969 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-21T22:17:41.969 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-21T22:17:41.969 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-07-21T22:17:41.969 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-21T22:17:41.970 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-21T22:17:41.970 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-21T22:17:41.970 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-21T22:17:41.970 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-21T22:17:41.970 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-21T22:17:41.971 INFO:tasks.ceph:Setting up mon.a... 2023-07-21T22:17:41.971 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-21T22:17:42.019 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.keyring 2023-07-21T22:17:42.044 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-21T22:17:42.096 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-21T22:17:42.120 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.6'), ('mon.b', '172.21.15.161'), ('mon.c', '[v2:172.21.15.161:3301,v1:172.21.15.161:6790]')] 2023-07-21T22:17:42.120 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.6,172.21.15.161,[v2:172.21.15.161:3301,v1:172.21.15.161:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-21T22:17:42.122 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:17:42.122 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-21T22:17:42.169 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.6 --add b 172.21.15.161 --addv c '[v2:172.21.15.161:3301,v1:172.21.15.161:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:17:42.261 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:17:42.261 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: generated fsid f3073df4-6cd1-4503-bd2e-d3e98fa18bdf 2023-07-21T22:17:42.261 INFO:teuthology.orchestra.run.smithi006.stdout:setting min_mon_release = pacific 2023-07-21T22:17:42.261 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 0 2023-07-21T22:17:42.262 INFO:teuthology.orchestra.run.smithi006.stdout:fsid f3073df4-6cd1-4503-bd2e-d3e98fa18bdf 2023-07-21T22:17:42.262 INFO:teuthology.orchestra.run.smithi006.stdout:last_changed 2023-07-21T22:17:42.218427+0000 2023-07-21T22:17:42.262 INFO:teuthology.orchestra.run.smithi006.stdout:created 2023-07-21T22:17:42.218427+0000 2023-07-21T22:17:42.262 INFO:teuthology.orchestra.run.smithi006.stdout:min_mon_release 16 (pacific) 2023-07-21T22:17:42.262 INFO:teuthology.orchestra.run.smithi006.stdout:election_strategy: 1 2023-07-21T22:17:42.262 INFO:teuthology.orchestra.run.smithi006.stdout:0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2023-07-21T22:17:42.262 INFO:teuthology.orchestra.run.smithi006.stdout:1: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.b 2023-07-21T22:17:42.263 INFO:teuthology.orchestra.run.smithi006.stdout:2: [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] mon.c 2023-07-21T22:17:42.263 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-21T22:17:42.264 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-21T22:17:42.273 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f3073df4-6cd1-4503-bd2e-d3e98fa18bdf... 2023-07-21T22:17:42.274 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-21T22:17:42.320 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-21T22:17:42.363 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2023-07-21T22:17:42.363 INFO:teuthology.orchestra.run.smithi006.stdout: chdir = "" 2023-07-21T22:17:42.364 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-21T22:17:42.364 INFO:teuthology.orchestra.run.smithi006.stdout: auth supported = cephx 2023-07-21T22:17:42.364 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.365 INFO:teuthology.orchestra.run.smithi006.stdout: filestore xattr use omap = true 2023-07-21T22:17:42.365 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.365 INFO:teuthology.orchestra.run.smithi006.stdout: mon clock drift allowed = 1.000 2023-07-21T22:17:42.366 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.366 INFO:teuthology.orchestra.run.smithi006.stdout: osd crush chooseleaf type = 0 2023-07-21T22:17:42.366 INFO:teuthology.orchestra.run.smithi006.stdout: auth debug = true 2023-07-21T22:17:42.366 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.367 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on old message = true 2023-07-21T22:17:42.367 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on bug = true 2023-07-21T22:17:42.367 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.368 INFO:teuthology.orchestra.run.smithi006.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-21T22:17:42.368 INFO:teuthology.orchestra.run.smithi006.stdout: mon pg warn max object skew = 0 2023-07-21T22:17:42.368 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.369 INFO:teuthology.orchestra.run.smithi006.stdout: # disable pg_autoscaler by default for new pools 2023-07-21T22:17:42.369 INFO:teuthology.orchestra.run.smithi006.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-21T22:17:42.369 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.369 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default size = 2 2023-07-21T22:17:42.370 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.370 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow primary affinity = true 2023-07-21T22:17:42.371 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow pg remap = true 2023-07-21T22:17:42.371 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on legacy crush tunables = false 2023-07-21T22:17:42.371 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on crush straw calc version zero = false 2023-07-21T22:17:42.371 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on no sortbitwise = false 2023-07-21T22:17:42.372 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on osd down out interval zero = false 2023-07-21T22:17:42.372 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on too few osds = false 2023-07-21T22:17:42.372 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-21T22:17:42.372 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-21T22:17:42.372 INFO:teuthology.orchestra.run.smithi006.stdout: mon_allow_pool_size_one = true 2023-07-21T22:17:42.372 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.372 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-21T22:17:42.373 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.373 INFO:teuthology.orchestra.run.smithi006.stdout: osd default data pool replay window = 5 2023-07-21T22:17:42.373 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.373 INFO:teuthology.orchestra.run.smithi006.stdout: mon allow pool delete = true 2023-07-21T22:17:42.373 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.373 INFO:teuthology.orchestra.run.smithi006.stdout: mon cluster log file level = debug 2023-07-21T22:17:42.373 INFO:teuthology.orchestra.run.smithi006.stdout: debug asserts on shutdown = true 2023-07-21T22:17:42.373 INFO:teuthology.orchestra.run.smithi006.stdout: mon health detail to clog = false 2023-07-21T22:17:42.374 INFO:teuthology.orchestra.run.smithi006.stdout: mon host = "172.21.15.6,172.21.15.161,[v2:172.21.15.161:3301,v1:172.21.15.161:6790]" 2023-07-21T22:17:42.374 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on skipped message = False 2023-07-21T22:17:42.374 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = f3073df4-6cd1-4503-bd2e-d3e98fa18bdf 2023-07-21T22:17:42.374 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.374 INFO:teuthology.orchestra.run.smithi006.stdout:[osd] 2023-07-21T22:17:42.374 INFO:teuthology.orchestra.run.smithi006.stdout: osd journal size = 100 2023-07-21T22:17:42.374 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.375 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub load threshold = 5.0 2023-07-21T22:17:42.375 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub max interval = 600 2023-07-21T22:17:42.375 INFO:teuthology.orchestra.run.smithi006.stdout: osd mclock profile = high_recovery_ops 2023-07-21T22:17:42.375 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.375 INFO:teuthology.orchestra.run.smithi006.stdout: osd recover clone overlap = true 2023-07-21T22:17:42.375 INFO:teuthology.orchestra.run.smithi006.stdout: osd recovery max chunk = 1048576 2023-07-21T22:17:42.375 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.375 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug shutdown = true 2023-07-21T22:17:42.376 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug op order = true 2023-07-21T22:17:42.376 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug verify stray on activate = true 2023-07-21T22:17:42.376 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.376 INFO:teuthology.orchestra.run.smithi006.stdout: osd open classes on start = true 2023-07-21T22:17:42.376 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug pg log writeout = true 2023-07-21T22:17:42.376 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.377 INFO:teuthology.orchestra.run.smithi006.stdout: osd deep scrub update digest min age = 30 2023-07-21T22:17:42.377 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.377 INFO:teuthology.orchestra.run.smithi006.stdout: osd map max advance = 10 2023-07-21T22:17:42.377 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.377 INFO:teuthology.orchestra.run.smithi006.stdout: journal zero on create = true 2023-07-21T22:17:42.377 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.377 INFO:teuthology.orchestra.run.smithi006.stdout: filestore ondisk finisher threads = 3 2023-07-21T22:17:42.377 INFO:teuthology.orchestra.run.smithi006.stdout: filestore apply finisher threads = 3 2023-07-21T22:17:42.378 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.378 INFO:teuthology.orchestra.run.smithi006.stdout: bdev debug aio = true 2023-07-21T22:17:42.378 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug misdirected ops = true 2023-07-21T22:17:42.378 INFO:teuthology.orchestra.run.smithi006.stdout: bdev async discard = True 2023-07-21T22:17:42.378 INFO:teuthology.orchestra.run.smithi006.stdout: bdev enable discard = True 2023-07-21T22:17:42.378 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore allocator = bitmap 2023-07-21T22:17:42.378 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore block size = 96636764160 2023-07-21T22:17:42.378 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore fsck on mount = True 2023-07-21T22:17:42.379 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluefs = 1/20 2023-07-21T22:17:42.379 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluestore = 1/20 2023-07-21T22:17:42.379 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-07-21T22:17:42.379 INFO:teuthology.orchestra.run.smithi006.stdout: debug osd = 20 2023-07-21T22:17:42.379 INFO:teuthology.orchestra.run.smithi006.stdout: debug rocksdb = 4/10 2023-07-21T22:17:42.379 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd backfillfull_ratio = 0.85 2023-07-21T22:17:42.379 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd full ratio = 0.9 2023-07-21T22:17:42.380 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd nearfull ratio = 0.8 2023-07-21T22:17:42.380 INFO:teuthology.orchestra.run.smithi006.stdout: osd failsafe full ratio = 0.95 2023-07-21T22:17:42.380 INFO:teuthology.orchestra.run.smithi006.stdout: osd objectstore = bluestore 2023-07-21T22:17:42.380 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2023-07-21T22:17:42.380 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.380 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr] 2023-07-21T22:17:42.380 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-07-21T22:17:42.380 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgr = 20 2023-07-21T22:17:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2023-07-21T22:17:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2023-07-21T22:17:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2023-07-21T22:17:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2023-07-21T22:17:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: mgr/telemetry/nag = false 2023-07-21T22:17:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2023-07-21T22:17:42.381 INFO:teuthology.orchestra.run.smithi006.stdout: debug finisher = 20 2023-07-21T22:17:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.382 INFO:teuthology.orchestra.run.smithi006.stdout:[mon] 2023-07-21T22:17:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-07-21T22:17:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2023-07-21T22:17:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: debug paxos = 20 2023-07-21T22:17:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2023-07-21T22:17:42.382 INFO:teuthology.orchestra.run.smithi006.stdout: mon data avail warn = 5 2023-07-21T22:17:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: mon mgr mkfs grace = 240 2023-07-21T22:17:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2023-07-21T22:17:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd reporter subtree level = osd 2023-07-21T22:17:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd prime pg temp = true 2023-07-21T22:17:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2023-07-21T22:17:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.383 INFO:teuthology.orchestra.run.smithi006.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-21T22:17:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: auth mon ticket ttl = 660 # 11m 2023-07-21T22:17:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: auth service ticket ttl = 240 # 4m 2023-07-21T22:17:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: # don't complain about insecure global_id in the test suite 2023-07-21T22:17:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-21T22:17:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-21T22:17:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.384 INFO:teuthology.orchestra.run.smithi006.stdout: # 1m isn't quite enough 2023-07-21T22:17:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: mon_down_mkfs_grace = 2m 2023-07-21T22:17:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_filestore_osds = false 2023-07-21T22:17:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: mon op complaint time = 120 2023-07-21T22:17:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:17:42.385 INFO:teuthology.orchestra.run.smithi006.stdout:[client] 2023-07-21T22:17:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: rgw cache enabled = true 2023-07-21T22:17:42.385 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable ops log = true 2023-07-21T22:17:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable usage log = true 2023-07-21T22:17:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-21T22:17:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-21T22:17:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: client mount timeout = 600 2023-07-21T22:17:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2023-07-21T22:17:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-07-21T22:17:42.386 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = "" 2023-07-21T22:17:42.387 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2023-07-21T22:17:42.387 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2023-07-21T22:17:42.387 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.a] 2023-07-21T22:17:42.387 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.b] 2023-07-21T22:17:42.387 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.c] 2023-07-21T22:17:42.387 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2023-07-21T22:17:42.387 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2023-07-21T22:17:42.387 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2023-07-21T22:17:42.388 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2023-07-21T22:17:42.388 INFO:teuthology.orchestra.run.smithi006.stdout:[mds] 2023-07-21T22:17:42.388 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds = 20 2023-07-21T22:17:42.388 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds balancer = 20 2023-07-21T22:17:42.388 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-07-21T22:17:42.388 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug frag = True 2023-07-21T22:17:42.388 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug scatterstat = True 2023-07-21T22:17:42.389 INFO:teuthology.orchestra.run.smithi006.stdout: mds op complaint time = 180 2023-07-21T22:17:42.389 INFO:teuthology.orchestra.run.smithi006.stdout: mds verify scatter = True 2023-07-21T22:17:42.389 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2023-07-21T22:17:42.389 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2023-07-21T22:17:42.389 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2023-07-21T22:17:42.394 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2023-07-21T22:17:42.395 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2023-07-21T22:17:42.395 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-21T22:17:42.395 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2023-07-21T22:17:42.395 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.396 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2023-07-21T22:17:42.396 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.397 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2023-07-21T22:17:42.397 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.397 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2023-07-21T22:17:42.397 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2023-07-21T22:17:42.398 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.398 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2023-07-21T22:17:42.399 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2023-07-21T22:17:42.399 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.400 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-21T22:17:42.400 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2023-07-21T22:17:42.400 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.400 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2023-07-21T22:17:42.400 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-21T22:17:42.401 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.401 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2023-07-21T22:17:42.401 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.401 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2023-07-21T22:17:42.401 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2023-07-21T22:17:42.401 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2023-07-21T22:17:42.401 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2023-07-21T22:17:42.401 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2023-07-21T22:17:42.402 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2023-07-21T22:17:42.402 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2023-07-21T22:17:42.402 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-21T22:17:42.402 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-21T22:17:42.402 INFO:teuthology.orchestra.run.smithi161.stdout: mon_allow_pool_size_one = true 2023-07-21T22:17:42.402 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.403 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-21T22:17:42.403 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.403 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2023-07-21T22:17:42.403 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.403 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2023-07-21T22:17:42.403 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.403 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2023-07-21T22:17:42.403 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2023-07-21T22:17:42.404 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2023-07-21T22:17:42.404 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = "172.21.15.6,172.21.15.161,[v2:172.21.15.161:3301,v1:172.21.15.161:6790]" 2023-07-21T22:17:42.404 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on skipped message = False 2023-07-21T22:17:42.404 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = f3073df4-6cd1-4503-bd2e-d3e98fa18bdf 2023-07-21T22:17:42.405 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.405 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2023-07-21T22:17:42.406 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2023-07-21T22:17:42.406 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.406 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2023-07-21T22:17:42.406 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2023-07-21T22:17:42.407 INFO:teuthology.orchestra.run.smithi161.stdout: osd mclock profile = high_recovery_ops 2023-07-21T22:17:42.407 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.407 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2023-07-21T22:17:42.407 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2023-07-21T22:17:42.408 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.408 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2023-07-21T22:17:42.408 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2023-07-21T22:17:42.409 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2023-07-21T22:17:42.409 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.409 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2023-07-21T22:17:42.409 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2023-07-21T22:17:42.410 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.410 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2023-07-21T22:17:42.410 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.410 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2023-07-21T22:17:42.411 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.411 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2023-07-21T22:17:42.411 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.411 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2023-07-21T22:17:42.411 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2023-07-21T22:17:42.411 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.411 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2023-07-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2023-07-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi161.stdout: bdev async discard = True 2023-07-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi161.stdout: bdev enable discard = True 2023-07-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore allocator = bitmap 2023-07-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore block size = 96636764160 2023-07-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore fsck on mount = True 2023-07-21T22:17:42.412 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluefs = 1/20 2023-07-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluestore = 1/20 2023-07-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-07-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 20 2023-07-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi161.stdout: debug rocksdb = 4/10 2023-07-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd backfillfull_ratio = 0.85 2023-07-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd full ratio = 0.9 2023-07-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd nearfull ratio = 0.8 2023-07-21T22:17:42.413 INFO:teuthology.orchestra.run.smithi161.stdout: osd failsafe full ratio = 0.95 2023-07-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi161.stdout: osd objectstore = bluestore 2023-07-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2023-07-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2023-07-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-07-21T22:17:42.414 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2023-07-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2023-07-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2023-07-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2023-07-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2023-07-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2023-07-21T22:17:42.415 INFO:teuthology.orchestra.run.smithi161.stdout: debug client = 20 2023-07-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi161.stdout: debug finisher = 20 2023-07-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2023-07-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-07-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2023-07-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2023-07-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2023-07-21T22:17:42.416 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2023-07-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2023-07-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2023-07-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2023-07-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2023-07-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2023-07-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.417 INFO:teuthology.orchestra.run.smithi161.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi161.stdout: auth mon ticket ttl = 660 # 11m 2023-07-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi161.stdout: auth service ticket ttl = 240 # 4m 2023-07-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi161.stdout: # don't complain about insecure global_id in the test suite 2023-07-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.418 INFO:teuthology.orchestra.run.smithi161.stdout: # 1m isn't quite enough 2023-07-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi161.stdout: mon_down_mkfs_grace = 2m 2023-07-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_filestore_osds = false 2023-07-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi161.stdout: mon op complaint time = 120 2023-07-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-07-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2023-07-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2023-07-21T22:17:42.419 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2023-07-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2023-07-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi161.stdout: client mount timeout = 600 2023-07-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi161.stdout: debug client = 20 2023-07-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-07-21T22:17:42.420 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = "" 2023-07-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2023-07-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2023-07-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2023-07-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.b] 2023-07-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.c] 2023-07-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2023-07-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2023-07-21T22:17:42.421 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2023-07-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.d] 2023-07-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi161.stdout:[mds] 2023-07-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds = 20 2023-07-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds balancer = 20 2023-07-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-07-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug frag = True 2023-07-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug scatterstat = True 2023-07-21T22:17:42.422 INFO:teuthology.orchestra.run.smithi161.stdout: mds op complaint time = 180 2023-07-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi161.stdout: mds verify scatter = True 2023-07-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2023-07-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2023-07-21T22:17:42.423 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2023-07-21T22:17:42.424 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-21T22:17:42.424 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-21T22:17:42.496 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-21T22:17:42.497 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:17:42.497 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-21T22:17:42.506 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:17:42.507 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-21T22:17:42.556 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:17:42.556 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:17:42.557 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-21T22:17:42.557 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-21T22:17:42.630 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:17:42.631 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:17:42.680 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi161.front.sepia.ceph.com 2023-07-21T22:17:42.681 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:17:42.681 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-21T22:17:42.681 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-21T22:17:42.718 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:17:42.718 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:17:42.769 INFO:tasks.ceph:Setting up mon nodes... 2023-07-21T22:17:42.769 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-21T22:17:42.770 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-21T22:17:42.829 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-21T22:17:42.834 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-21T22:17:42.896 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-21T22:17:42.909 INFO:tasks.ceph:Setting up mds nodes... 2023-07-21T22:17:42.909 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-21T22:17:42.970 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-21T22:17:42.974 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-21T22:17:42.997 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-21T22:17:43.102 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-21T22:17:43.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-21T22:17:43.128 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-21T22:17:43.190 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-21T22:17:43.194 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-21T22:17:43.216 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-21T22:17:43.313 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-21T22:17:43.318 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-21T22:17:43.340 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-21T22:17:43.341 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-21T22:17:43.387 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-21T22:17:43.406 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-07-21T22:17:43.496 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-07-21T22:17:43.514 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-21T22:17:43.559 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-21T22:17:43.576 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-07-21T22:17:43.664 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-07-21T22:17:43.681 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-21T22:17:43.682 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-21T22:17:43.682 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-21T22:17:43.703 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-21T22:17:43.704 INFO:tasks.ceph:role: osd.0 2023-07-21T22:17:43.704 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:17:43.704 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-21T22:17:43.773 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T22:17:43.773 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T22:17:43.773 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T22:17:43.773 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-21T22:17:43.774 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T22:17:43.774 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-07-21T22:17:43.774 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T22:17:43.774 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T22:17:43.774 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T22:17:43.774 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T22:17:44.233 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-07-21T22:17:44.236 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-07-21T22:17:44.237 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-21T22:17:44.352 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-21T22:17:44.371 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T22:17:44.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:17:44.373 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-21T22:17:44.438 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-21T22:17:44.438 INFO:tasks.ceph:role: osd.1 2023-07-21T22:17:44.438 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:17:44.439 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-21T22:17:44.510 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T22:17:44.511 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T22:17:44.511 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T22:17:44.511 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-21T22:17:44.511 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T22:17:44.511 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-07-21T22:17:44.511 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T22:17:44.511 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T22:17:44.511 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T22:17:44.512 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T22:17:45.001 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-07-21T22:17:45.004 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-07-21T22:17:45.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-21T22:17:45.175 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-21T22:17:45.195 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T22:17:45.196 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:17:45.197 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-21T22:17:45.266 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-21T22:17:45.266 INFO:tasks.ceph:role: osd.2 2023-07-21T22:17:45.267 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:17:45.267 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-21T22:17:45.339 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T22:17:45.339 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T22:17:45.339 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T22:17:45.339 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-21T22:17:45.340 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T22:17:45.340 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-07-21T22:17:45.340 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T22:17:45.340 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T22:17:45.340 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T22:17:45.340 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T22:17:45.802 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-07-21T22:17:45.806 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-07-21T22:17:45.806 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-21T22:17:45.900 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-21T22:17:45.919 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T22:17:45.920 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:17:45.921 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-21T22:17:45.986 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-21T22:17:45.986 INFO:tasks.ceph:role: osd.3 2023-07-21T22:17:45.987 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:17:45.987 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-21T22:17:46.058 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T22:17:46.058 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T22:17:46.058 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T22:17:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-21T22:17:46.059 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T22:17:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-07-21T22:17:46.059 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T22:17:46.059 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T22:17:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T22:17:46.059 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T22:17:46.517 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-07-21T22:17:46.520 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-07-21T22:17:46.520 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-21T22:17:46.632 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-21T22:17:46.651 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T22:17:46.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:17:46.652 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:17:46.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:46.740+0000 7f1e19eed640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-21T22:17:46.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:46.744+0000 7f1e19eed640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-21T22:17:46.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:46.744+0000 7f1e19eed640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-21T22:17:46.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:46.744+0000 7f1e19eed640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-21T22:17:46.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:46.744+0000 7f1e19eed640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-21T22:17:46.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:46.748+0000 7f1e19eed640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-21T22:17:49.794 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-21T22:17:49.819 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:17:49.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:49.872+0000 7f064ec28640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-21T22:17:49.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:49.872+0000 7f064ec28640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-21T22:17:49.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:49.872+0000 7f064ec28640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-21T22:17:49.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:49.872+0000 7f064ec28640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-21T22:17:49.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:49.872+0000 7f064ec28640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-21T22:17:49.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:49.876+0000 7f064ec28640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-21T22:17:52.912 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-21T22:17:52.935 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:17:53.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:52.992+0000 7fd6bc765640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-21T22:17:53.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:52.996+0000 7fd6bc765640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-21T22:17:53.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:52.996+0000 7fd6bc765640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-21T22:17:53.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:52.996+0000 7fd6bc765640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-21T22:17:53.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:52.996+0000 7fd6bc765640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-21T22:17:53.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:52.996+0000 7fd6bc765640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-21T22:17:56.027 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-21T22:17:56.049 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:17:56.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:56.104+0000 7f73eafb0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-21T22:17:56.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:56.104+0000 7f73eafb0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-21T22:17:56.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:56.104+0000 7f73eafb0640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-21T22:17:56.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:56.104+0000 7f73eafb0640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-21T22:17:56.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:56.104+0000 7f73eafb0640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-21T22:17:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:17:56.108+0000 7f73eafb0640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-21T22:17:59.150 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-21T22:17:59.173 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-21T22:17:59.196 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-21T22:17:59.197 INFO:tasks.ceph:role: osd.4 2023-07-21T22:17:59.197 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com 2023-07-21T22:17:59.198 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-21T22:17:59.270 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T22:17:59.270 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T22:17:59.270 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T22:17:59.270 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-21T22:17:59.271 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T22:17:59.271 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-07-21T22:17:59.271 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T22:17:59.271 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T22:17:59.271 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T22:17:59.271 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T22:17:59.737 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-07-21T22:17:59.740 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-07-21T22:17:59.740 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-21T22:17:59.904 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-21T22:17:59.924 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T22:17:59.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:17:59.926 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-21T22:17:59.994 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-21T22:17:59.994 INFO:tasks.ceph:role: osd.5 2023-07-21T22:17:59.994 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com 2023-07-21T22:17:59.995 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-21T22:18:00.070 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T22:18:00.071 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T22:18:00.071 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T22:18:00.071 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-21T22:18:00.072 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T22:18:00.072 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-07-21T22:18:00.072 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T22:18:00.073 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T22:18:00.073 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T22:18:00.073 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T22:18:00.519 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-07-21T22:18:00.522 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-07-21T22:18:00.523 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-21T22:18:00.619 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-21T22:18:00.638 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T22:18:00.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:18:00.639 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-21T22:18:00.702 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-21T22:18:00.702 INFO:tasks.ceph:role: osd.6 2023-07-21T22:18:00.702 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com 2023-07-21T22:18:00.703 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-21T22:18:00.773 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-07-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T22:18:00.774 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T22:18:00.775 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T22:18:00.775 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T22:18:01.238 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-07-21T22:18:01.241 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-07-21T22:18:01.241 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-21T22:18:01.391 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-21T22:18:01.411 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T22:18:01.411 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:18:01.412 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-21T22:18:01.478 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-21T22:18:01.478 INFO:tasks.ceph:role: osd.7 2023-07-21T22:18:01.478 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com 2023-07-21T22:18:01.479 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-21T22:18:01.549 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-21T22:18:01.550 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-21T22:18:01.550 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-21T22:18:01.550 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-21T22:18:01.550 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-21T22:18:01.551 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-07-21T22:18:01.551 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-21T22:18:01.551 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-21T22:18:01.551 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-21T22:18:01.551 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-21T22:18:02.056 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-07-21T22:18:02.059 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-07-21T22:18:02.059 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-21T22:18:02.214 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-21T22:18:02.232 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2023-07-21T22:18:02.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:18:02.234 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:18:02.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:02.322+0000 7f3605da7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-21T22:18:02.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:02.326+0000 7f3605da7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-21T22:18:02.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:02.326+0000 7f3605da7640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-21T22:18:02.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:02.326+0000 7f3605da7640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-21T22:18:02.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:02.326+0000 7f3605da7640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-21T22:18:02.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:02.326+0000 7f3605da7640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-21T22:18:05.368 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-21T22:18:05.391 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:18:05.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:05.446+0000 7fb1b874a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-21T22:18:05.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:05.450+0000 7fb1b874a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-21T22:18:05.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:05.450+0000 7fb1b874a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-21T22:18:05.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:05.450+0000 7fb1b874a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-21T22:18:05.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:05.450+0000 7fb1b874a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-21T22:18:05.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:05.450+0000 7fb1b874a640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-21T22:18:08.480 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-21T22:18:08.502 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:18:08.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:08.554+0000 7f0e5dc80640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-21T22:18:08.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:08.554+0000 7f0e5dc80640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-21T22:18:08.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:08.554+0000 7f0e5dc80640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-21T22:18:08.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:08.554+0000 7f0e5dc80640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-21T22:18:08.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:08.554+0000 7f0e5dc80640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-21T22:18:08.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:08.558+0000 7f0e5dc80640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-21T22:18:10.417 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:18:10.422 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:18:11.591 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-21T22:18:11.613 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:18:11.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:11.670+0000 7fab4ab7c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-21T22:18:11.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:11.670+0000 7fab4ab7c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-21T22:18:11.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:11.670+0000 7fab4ab7c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-21T22:18:11.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:11.670+0000 7fab4ab7c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-21T22:18:11.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:11.670+0000 7fab4ab7c640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-21T22:18:11.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:11.670+0000 7fab4ab7c640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-21T22:18:14.711 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-21T22:18:14.732 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-21T22:18:14.733 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:18:14.733 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-21T22:18:14.757 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:18:14.757 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-21T22:18:14.823 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:18:14.823 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-21T22:18:14.887 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:18:14.887 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-21T22:18:14.950 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:18:14.951 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-21T22:18:15.014 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:18:15.015 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-21T22:18:15.078 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:18:15.079 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-21T22:18:15.142 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:18:15.142 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-21T22:18:15.164 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:18:15.165 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-21T22:18:15.229 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:18:15.230 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-21T22:18:15.293 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:18:15.294 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-21T22:18:15.361 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:18:15.361 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-21T22:18:15.425 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:18:15.425 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-21T22:18:15.490 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:18:15.491 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-21T22:18:15.553 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:18:15.554 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-21T22:18:15.563 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:18:15.564 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-07-21T22:18:15.617 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:18:15.618 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-21T22:18:15.627 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:18:15.627 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-07-21T22:18:15.676 INFO:tasks.ceph:Adding keys to all mons... 2023-07-21T22:18:15.677 DEBUG:teuthology.orchestra.run.smithi006:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-21T22:18:15.681 DEBUG:teuthology.orchestra.run.smithi161:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-21T22:18:15.724 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.y] 2023-07-21T22:18:15.724 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAGBLtkHhzpLhAAZTx4Vrc0Htk88104SzuAxQ== 2023-07-21T22:18:15.724 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2023-07-21T22:18:15.724 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAGBLtkHn5HNxAADk0AaSGwZfEj3SwNvEm8hw== 2023-07-21T22:18:15.724 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2023-07-21T22:18:15.725 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAHBLtkYtGXAxAAy+RDDBSvc1FeZq+eg23tRA== 2023-07-21T22:18:15.725 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.0] 2023-07-21T22:18:15.725 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAKBLtkPwZrLBAAQHZECi2zHST1MKYgGoa/Iw== 2023-07-21T22:18:15.725 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.1] 2023-07-21T22:18:15.725 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQANBLtkvwgwNBAApurMm8c3pSlX2r16Gli/Ag== 2023-07-21T22:18:15.725 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.2] 2023-07-21T22:18:15.725 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAQBLtkf2p1OxAAcKYw2RixFefYAwcfkGnOKQ== 2023-07-21T22:18:15.725 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.3] 2023-07-21T22:18:15.726 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAUBLtkQUl6BhAAXXT1ZK1h9aZEcp6qIHsLiA== 2023-07-21T22:18:15.726 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.x] 2023-07-21T22:18:15.726 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAGBLtkdobtMhAAQbwi3cvsrW9P0t3d52oEKw== 2023-07-21T22:18:15.726 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2023-07-21T22:18:15.726 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAHBLtkQFvXCBAANxf0/I2RQcHy4iYiydjkcg== 2023-07-21T22:18:15.726 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2023-07-21T22:18:15.726 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAHBLtkH+Y1EBAAl+qTqd+gFrB9LtJWwD5dgA== 2023-07-21T22:18:15.727 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.4] 2023-07-21T22:18:15.727 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAaBLtkc1VfExAAPzDz2k/c0qVePG9h1saQCw== 2023-07-21T22:18:15.727 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.5] 2023-07-21T22:18:15.727 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAdBLtkJ6fcGhAAglVSJIQS04WYBv4APhl57g== 2023-07-21T22:18:15.727 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.6] 2023-07-21T22:18:15.727 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAgBLtkPINGIRAAWKs1RNQIdhZYlDAzDgUkNw== 2023-07-21T22:18:15.727 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.7] 2023-07-21T22:18:15.727 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAjBLtk83MCKBAAZH2NhMBphVv4QkRzy+NDgg== 2023-07-21T22:18:15.728 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-07-21T22:18:15.728 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA== 2023-07-21T22:18:15.728 INFO:teuthology.orchestra.run.smithi006.stdout:[client.2] 2023-07-21T22:18:15.728 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAHBLtkd7wSGxAArvSYwe+k48vgRzb3fQAEAQ== 2023-07-21T22:18:15.728 INFO:teuthology.orchestra.run.smithi006.stdout:[client.1] 2023-07-21T22:18:15.728 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAHBLtkPVXTHhAAYmkzwAvqsfrowpAucTnlUQ== 2023-07-21T22:18:15.728 INFO:teuthology.orchestra.run.smithi006.stdout:[client.3] 2023-07-21T22:18:15.729 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAHBLtkoZ4YJRAAX4yh0Q1pR4wY7yEV6kg9QA== 2023-07-21T22:18:15.739 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.y] 2023-07-21T22:18:15.739 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAGBLtkHhzpLhAAZTx4Vrc0Htk88104SzuAxQ== 2023-07-21T22:18:15.739 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2023-07-21T22:18:15.739 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAGBLtkHn5HNxAADk0AaSGwZfEj3SwNvEm8hw== 2023-07-21T22:18:15.739 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2023-07-21T22:18:15.740 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAHBLtkYtGXAxAAy+RDDBSvc1FeZq+eg23tRA== 2023-07-21T22:18:15.740 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.0] 2023-07-21T22:18:15.740 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAKBLtkPwZrLBAAQHZECi2zHST1MKYgGoa/Iw== 2023-07-21T22:18:15.740 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.1] 2023-07-21T22:18:15.740 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQANBLtkvwgwNBAApurMm8c3pSlX2r16Gli/Ag== 2023-07-21T22:18:15.740 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.2] 2023-07-21T22:18:15.740 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAQBLtkf2p1OxAAcKYw2RixFefYAwcfkGnOKQ== 2023-07-21T22:18:15.741 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.3] 2023-07-21T22:18:15.741 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAUBLtkQUl6BhAAXXT1ZK1h9aZEcp6qIHsLiA== 2023-07-21T22:18:15.741 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.x] 2023-07-21T22:18:15.741 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAGBLtkdobtMhAAQbwi3cvsrW9P0t3d52oEKw== 2023-07-21T22:18:15.741 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2023-07-21T22:18:15.741 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAHBLtkQFvXCBAANxf0/I2RQcHy4iYiydjkcg== 2023-07-21T22:18:15.741 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.d] 2023-07-21T22:18:15.741 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAHBLtkH+Y1EBAAl+qTqd+gFrB9LtJWwD5dgA== 2023-07-21T22:18:15.742 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.4] 2023-07-21T22:18:15.742 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAaBLtkc1VfExAAPzDz2k/c0qVePG9h1saQCw== 2023-07-21T22:18:15.742 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.5] 2023-07-21T22:18:15.742 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAdBLtkJ6fcGhAAglVSJIQS04WYBv4APhl57g== 2023-07-21T22:18:15.742 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.6] 2023-07-21T22:18:15.742 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAgBLtkPINGIRAAWKs1RNQIdhZYlDAzDgUkNw== 2023-07-21T22:18:15.742 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.7] 2023-07-21T22:18:15.743 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAjBLtk83MCKBAAZH2NhMBphVv4QkRzy+NDgg== 2023-07-21T22:18:15.743 INFO:teuthology.orchestra.run.smithi161.stdout:[client.0] 2023-07-21T22:18:15.743 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA== 2023-07-21T22:18:15.743 INFO:teuthology.orchestra.run.smithi161.stdout:[client.2] 2023-07-21T22:18:15.743 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAHBLtkd7wSGxAArvSYwe+k48vgRzb3fQAEAQ== 2023-07-21T22:18:15.743 INFO:teuthology.orchestra.run.smithi161.stdout:[client.1] 2023-07-21T22:18:15.743 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAHBLtkPVXTHhAAYmkzwAvqsfrowpAucTnlUQ== 2023-07-21T22:18:15.744 INFO:teuthology.orchestra.run.smithi161.stdout:[client.3] 2023-07-21T22:18:15.744 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAHBLtkoZ4YJRAAX4yh0Q1pR4wY7yEV6kg9QA== 2023-07-21T22:18:15.745 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-21T22:18:15.780 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-21T22:18:15.848 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T22:18:15.852 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T22:18:15.911 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T22:18:15.915 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T22:18:15.972 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:18:15.976 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:18:16.031 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:18:16.035 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:18:16.089 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:18:16.093 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:18:16.148 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:18:16.152 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:18:16.206 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-21T22:18:16.210 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-21T22:18:16.264 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T22:18:16.268 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T22:18:16.325 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T22:18:16.329 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-21T22:18:16.387 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:18:16.390 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:18:16.444 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:18:16.449 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:18:16.505 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:18:16.509 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:18:16.565 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:18:16.569 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-21T22:18:16.625 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T22:18:16.629 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T22:18:16.687 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T22:18:16.691 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T22:18:16.749 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T22:18:16.754 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T22:18:16.813 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T22:18:16.818 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-21T22:18:16.876 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-21T22:18:16.876 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-21T22:18:16.897 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-21T22:18:17.013 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-21T22:18:17.035 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-21T22:18:17.056 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-21T22:18:17.174 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-21T22:18:17.195 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-21T22:18:17.256 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-21T22:18:17.374 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-21T22:18:17.395 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:18:17.399 DEBUG:teuthology.orchestra.run.smithi161:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-21T22:18:17.444 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-21T22:18:17.444 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-21T22:18:17.445 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-21T22:18:17.451 INFO:tasks.ceph.mon.a:Started 2023-07-21T22:18:17.451 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-21T22:18:17.452 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-21T22:18:17.487 INFO:tasks.ceph.mon.b:Started 2023-07-21T22:18:17.487 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-21T22:18:17.488 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-21T22:18:17.491 INFO:tasks.ceph.mon.c:Started 2023-07-21T22:18:17.492 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-21T22:18:17.492 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-21T22:18:17.492 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-21T22:18:17.496 INFO:tasks.ceph.mgr.y:Started 2023-07-21T22:18:17.496 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-21T22:18:17.497 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-21T22:18:17.501 INFO:tasks.ceph.mgr.x:Started 2023-07-21T22:18:17.501 INFO:tasks.ceph:Setting crush tunables to default 2023-07-21T22:18:17.502 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd crush tunables default 2023-07-21T22:18:17.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.600+0000 7f4f48b37640 1 Processor -- start 2023-07-21T22:18:17.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.600+0000 7f4f48b37640 1 -- start start 2023-07-21T22:18:17.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.600+0000 7f4f48b37640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f440cd670 0x7f4f440cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.600+0000 7f4f48b37640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4f44158df0 0x7f4f44159290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.600+0000 7f4f48b37640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f440b08d0 con 0x7f4f44156560 2023-07-21T22:18:17.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.600+0000 7f4f48b37640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f441597d0 con 0x7f4f440cd670 2023-07-21T22:18:17.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.600+0000 7f4f48b37640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f44159cb0 con 0x7f4f44158df0 2023-07-21T22:18:17.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.600+0000 7f4f3bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f440cd670 0x7f4f440cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.600+0000 7f4f4259c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4f44156560 0x7f4f440ccf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60960/0 (socket says 172.21.15.6:60960) 2023-07-21T22:18:17.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.600+0000 7f4f4259c640 1 -- 172.21.15.6:0/3956272364 learned_addr learned my addr 172.21.15.6:0/3956272364 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:17.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.600+0000 7f4f42d9d640 1 --2- 172.21.15.6:0/3956272364 >> v2:172.21.15.161:3300/0 conn(0x7f4f44158df0 0x7f4f44159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.600+0000 7f4f3bfff640 1 -- 172.21.15.6:0/3956272364 >> v2:172.21.15.6:3300/0 conn(0x7f4f440cd670 msgr2=0x7f4f440cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-21T22:18:17.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.600+0000 7f4f3bfff640 1 -- 172.21.15.6:0/3956272364 >> v2:172.21.15.6:3300/0 conn(0x7f4f440cd670 msgr2=0x7f4f440cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-21T22:18:17.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.600+0000 7f4f3bfff640 1 --2- 172.21.15.6:0/3956272364 >> v2:172.21.15.6:3300/0 conn(0x7f4f440cd670 0x7f4f440cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T22:18:17.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.600+0000 7f4f42d9d640 1 -- 172.21.15.6:0/3956272364 >> v2:172.21.15.161:3300/0 conn(0x7f4f44158df0 msgr2=0x7f4f44159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-21T22:18:17.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.600+0000 7f4f42d9d640 1 -- 172.21.15.6:0/3956272364 >> v2:172.21.15.161:3300/0 conn(0x7f4f44158df0 msgr2=0x7f4f44159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-21T22:18:17.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.600+0000 7f4f42d9d640 1 --2- 172.21.15.6:0/3956272364 >> v2:172.21.15.161:3300/0 conn(0x7f4f44158df0 0x7f4f44159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T22:18:17.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.600+0000 7f4f42d9d640 1 --2- 172.21.15.6:0/3956272364 >> v2:172.21.15.161:3300/0 conn(0x7f4f44158df0 0x7f4f44159290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:18:17.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.600+0000 7f4f3bfff640 1 --2- 172.21.15.6:0/3956272364 >> v2:172.21.15.6:3300/0 conn(0x7f4f440cd670 0x7f4f440cb3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:18:17.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f41d9b640 1 -- 172.21.15.6:0/3956272364 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314960192 0 0) 0x7f4f440b08d0 con 0x7f4f44156560 2023-07-21T22:18:17.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f41d9b640 1 -- 172.21.15.6:0/3956272364 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f24003530 con 0x7f4f44156560 2023-07-21T22:18:17.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f41d9b640 1 -- 172.21.15.6:0/3956272364 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 529910826 0 0) 0x7f4f24003530 con 0x7f4f44156560 2023-07-21T22:18:17.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f41d9b640 1 -- 172.21.15.6:0/3956272364 >> v2:172.21.15.161:3300/0 conn(0x7f4f44158df0 msgr2=0x7f4f44159290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:18:17.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f41d9b640 1 --2- 172.21.15.6:0/3956272364 >> v2:172.21.15.161:3300/0 conn(0x7f4f44158df0 0x7f4f44159290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f41d9b640 1 -- 172.21.15.6:0/3956272364 >> v2:172.21.15.6:3300/0 conn(0x7f4f440cd670 msgr2=0x7f4f440cb3e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:18:17.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f41d9b640 1 --2- 172.21.15.6:0/3956272364 >> v2:172.21.15.6:3300/0 conn(0x7f4f440cd670 0x7f4f440cb3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f41d9b640 1 -- 172.21.15.6:0/3956272364 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f441599d0 con 0x7f4f44156560 2023-07-21T22:18:17.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f41d9b640 1 -- 172.21.15.6:0/3956272364 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f4f34001680 con 0x7f4f44156560 2023-07-21T22:18:17.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f41d9b640 1 -- 172.21.15.6:0/3956272364 >> v1:172.21.15.6:6789/0 conn(0x7f4f44156560 legacy=0x7f4f440ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f41d9b640 1 --2- 172.21.15.6:0/3956272364 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f24003980 0x7f4f24003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f41d9b640 1 --2- 172.21.15.6:0/3956272364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f240047d0 0x7f4f24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f41d9b640 1 --2- 172.21.15.6:0/3956272364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f24005180 0x7f4f2400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f41d9b640 1 -- 172.21.15.6:0/3956272364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f441597d0 con 0x7f4f24005180 2023-07-21T22:18:17.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f41d9b640 1 -- 172.21.15.6:0/3956272364 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f44159cb0 con 0x7f4f240047d0 2023-07-21T22:18:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f41d9b640 1 -- 172.21.15.6:0/3956272364 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2400c060 con 0x7f4f24003980 2023-07-21T22:18:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f3bfff640 1 --2- 172.21.15.6:0/3956272364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f240047d0 0x7f4f24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f4259c640 1 --2- 172.21.15.6:0/3956272364 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f24003980 0x7f4f24003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f42d9d640 1 --2- 172.21.15.6:0/3956272364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f24005180 0x7f4f2400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f3bfff640 1 -- 172.21.15.6:0/3956272364 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f24003980 msgr2=0x7f4f24003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f3bfff640 1 --2- 172.21.15.6:0/3956272364 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f24003980 0x7f4f24003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f3bfff640 1 -- 172.21.15.6:0/3956272364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f24005180 msgr2=0x7f4f2400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f3bfff640 1 --2- 172.21.15.6:0/3956272364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f24005180 0x7f4f2400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f3bfff640 1 -- 172.21.15.6:0/3956272364 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f24003530 con 0x7f4f240047d0 2023-07-21T22:18:17.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f42d9d640 1 --2- 172.21.15.6:0/3956272364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f24005180 0x7f4f2400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:17.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.772+0000 7f4f42d9d640 1 -- 172.21.15.6:0/3956272364 reap_dead start 2023-07-21T22:18:17.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.776+0000 7f4f3bfff640 1 --2- 172.21.15.6:0/3956272364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f240047d0 0x7f4f24004c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c000ee0 tx=0x7f4f2c01c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fde2f0128481fbf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:17.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.776+0000 7f4f41d9b640 1 -- 172.21.15.6:0/3956272364 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c0aa680 con 0x7f4f240047d0 2023-07-21T22:18:17.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.780+0000 7f4f41d9b640 1 -- 172.21.15.6:0/3956272364 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c0aa7e0 con 0x7f4f240047d0 2023-07-21T22:18:17.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.780+0000 7f4f41d9b640 1 -- 172.21.15.6:0/3956272364 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c0aab90 con 0x7f4f240047d0 2023-07-21T22:18:17.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.780+0000 7f4f48b37640 1 -- 172.21.15.6:0/3956272364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f240047d0 msgr2=0x7f4f24004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.780+0000 7f4f48b37640 1 --2- 172.21.15.6:0/3956272364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f240047d0 0x7f4f24004c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c000ee0 tx=0x7f4f2c01c4d0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.780+0000 7f4f48b37640 1 -- 172.21.15.6:0/3956272364 shutdown_connections 2023-07-21T22:18:17.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.780+0000 7f4f48b37640 1 --2- 172.21.15.6:0/3956272364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f240047d0 0x7f4f24004c40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.780+0000 7f4f48b37640 1 -- 172.21.15.6:0/3956272364 >> 172.21.15.6:0/3956272364 conn(0x7f4f440afac0 msgr2=0x7f4f440afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:17.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.780+0000 7f4f48b37640 1 -- 172.21.15.6:0/3956272364 shutdown_connections 2023-07-21T22:18:17.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.780+0000 7f4f48b37640 1 -- 172.21.15.6:0/3956272364 wait complete. 2023-07-21T22:18:17.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f48b37640 1 Processor -- start 2023-07-21T22:18:17.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f48b37640 1 -- start start 2023-07-21T22:18:17.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f48b37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f240047d0 0x7f4f44159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f48b37640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f4415c960 0x7f4f440ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f48b37640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f4415cdd0 0x7f4f440ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f48b37640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4415a4a0 con 0x7f4f240047d0 2023-07-21T22:18:17.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f48b37640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4415b900 con 0x7f4f4415cdd0 2023-07-21T22:18:17.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f48b37640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4415bba0 con 0x7f4f4415c960 2023-07-21T22:18:17.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f4259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f240047d0 0x7f4f44159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f4259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f240047d0 0x7f4f44159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36284/0 (socket says 172.21.15.6:36284) 2023-07-21T22:18:17.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f4259c640 1 -- 172.21.15.6:0/2580933092 learned_addr learned my addr 172.21.15.6:0/2580933092 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:17.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f42d9d640 1 --2- 172.21.15.6:0/2580933092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f4415cdd0 0x7f4f440ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f3bfff640 1 --2- 172.21.15.6:0/2580933092 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f4415c960 0x7f4f440ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f4259c640 1 -- 172.21.15.6:0/2580933092 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f4415c960 msgr2=0x7f4f440ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f4259c640 1 --2- 172.21.15.6:0/2580933092 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f4415c960 0x7f4f440ae340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f4259c640 1 -- 172.21.15.6:0/2580933092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f4415cdd0 msgr2=0x7f4f440ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f4259c640 1 --2- 172.21.15.6:0/2580933092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f4415cdd0 0x7f4f440ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f4259c640 1 -- 172.21.15.6:0/2580933092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4415be80 con 0x7f4f240047d0 2023-07-21T22:18:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f4259c640 1 --2- 172.21.15.6:0/2580933092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f240047d0 0x7f4f44159e50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4f34007340 tx=0x7f4f34007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:17.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f3affd640 1 -- 172.21.15.6:0/2580933092 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34007770 con 0x7f4f240047d0 2023-07-21T22:18:17.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f3affd640 1 -- 172.21.15.6:0/2580933092 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3400f730 con 0x7f4f240047d0 2023-07-21T22:18:17.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f3affd640 1 -- 172.21.15.6:0/2580933092 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3400fae0 con 0x7f4f240047d0 2023-07-21T22:18:17.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f48b37640 1 -- 172.21.15.6:0/2580933092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4415c160 con 0x7f4f240047d0 2023-07-21T22:18:17.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f48b37640 1 -- 172.21.15.6:0/2580933092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f44143050 con 0x7f4f240047d0 2023-07-21T22:18:17.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f3affd640 1 -- 172.21.15.6:0/2580933092 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4f3401d460 con 0x7f4f240047d0 2023-07-21T22:18:17.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f3affd640 1 -- 172.21.15.6:0/2580933092 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4f340133f0 con 0x7f4f240047d0 2023-07-21T22:18:17.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.784+0000 7f4f48b37640 1 -- 172.21.15.6:0/2580933092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f440678d0 con 0x7f4f240047d0 2023-07-21T22:18:17.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.800+0000 7f4f3affd640 1 -- 172.21.15.6:0/2580933092 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f4f3401d8a0 con 0x7f4f240047d0 2023-07-21T22:18:17.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.860+0000 7f4f48b37640 1 -- 172.21.15.6:0/2580933092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f4f4415c610 con 0x7f4f240047d0 2023-07-21T22:18:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.864+0000 7f4f3affd640 1 -- 172.21.15.6:0/2580933092 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4f3401da40 con 0x7f4f240047d0 2023-07-21T22:18:17.912 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2023-07-21T22:18:17.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.864+0000 7f4f48b37640 1 -- 172.21.15.6:0/2580933092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f240047d0 msgr2=0x7f4f44159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.864+0000 7f4f48b37640 1 --2- 172.21.15.6:0/2580933092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f240047d0 0x7f4f44159e50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4f34007340 tx=0x7f4f34007430 comp rx=0 tx=0).stop 2023-07-21T22:18:17.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.864+0000 7f4f48b37640 1 -- 172.21.15.6:0/2580933092 shutdown_connections 2023-07-21T22:18:17.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.864+0000 7f4f48b37640 1 --2- 172.21.15.6:0/2580933092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f4415cdd0 0x7f4f440ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.864+0000 7f4f48b37640 1 --2- 172.21.15.6:0/2580933092 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f4415c960 0x7f4f440ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.864+0000 7f4f48b37640 1 --2- 172.21.15.6:0/2580933092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f240047d0 0x7f4f44159e50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.864+0000 7f4f48b37640 1 -- 172.21.15.6:0/2580933092 >> 172.21.15.6:0/2580933092 conn(0x7f4f440afac0 msgr2=0x7f4f440c8650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:17.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.868+0000 7f4f48b37640 1 -- 172.21.15.6:0/2580933092 shutdown_connections 2023-07-21T22:18:17.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:17.868+0000 7f4f48b37640 1 -- 172.21.15.6:0/2580933092 wait complete. 2023-07-21T22:18:17.933 INFO:tasks.ceph:check_enable_crimson: False 2023-07-21T22:18:17.933 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-21T22:18:17.933 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:18:17.934 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-21T22:18:17.955 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:18:17.955 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-21T22:18:18.021 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:18:18.021 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-21T22:18:18.042 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:17.996+0000 7f0cc7e2d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:18:18.062 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:18:18.063 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-21T22:18:18.071 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:18.026+0000 7f941d284180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:18:18.130 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:18:18.130 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-21T22:18:18.152 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:18:18.152 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-21T22:18:18.213 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:18:18.213 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-21T22:18:18.276 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:18:18.277 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-21T22:18:18.341 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 9ce560da-84c1-494d-bc1f-33760d20ecad 0 2023-07-21T22:18:18.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.478+0000 7fd8b5140640 1 Processor -- start 2023-07-21T22:18:18.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.478+0000 7fd8b5140640 1 -- start start 2023-07-21T22:18:18.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.478+0000 7fd8b5140640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd8b00d06b0 0x7fd8b00b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:18.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.478+0000 7fd8b5140640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8b0145430 0x7fd8b00b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:18.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.478+0000 7fd8b5140640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8b00b1f70 0x7fd8b00d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:18.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.478+0000 7fd8b5140640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b00b2410 con 0x7fd8b0145430 2023-07-21T22:18:18.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.478+0000 7fd8b5140640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b00b26f0 con 0x7fd8b00d06b0 2023-07-21T22:18:18.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.478+0000 7fd8b5140640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b00b29d0 con 0x7fd8b00b1f70 2023-07-21T22:18:18.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.478+0000 7fd8aed9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd8b00d06b0 0x7fd8b00b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:18.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.478+0000 7fd8af59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8b00b1f70 0x7fd8b00d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:18.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.478+0000 7fd8aed9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd8b00d06b0 0x7fd8b00b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39724/0 (socket says 172.21.15.161:39724) 2023-07-21T22:18:18.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.478+0000 7fd8aed9d640 1 -- 172.21.15.161:0/754067688 learned_addr learned my addr 172.21.15.161:0/754067688 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-07-21T22:18:18.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.478+0000 7fd8ae59c640 1 --2- 172.21.15.161:0/754067688 >> v2:172.21.15.6:3300/0 conn(0x7fd8b0145430 0x7fd8b00b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:18.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.478+0000 7fd8aed9d640 1 -- 172.21.15.161:0/754067688 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8b00b1f70 msgr2=0x7fd8b00d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:18.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.478+0000 7fd8aed9d640 1 --2- 172.21.15.161:0/754067688 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8b00b1f70 0x7fd8b00d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.478+0000 7fd8aed9d640 1 -- 172.21.15.161:0/754067688 >> v2:172.21.15.6:3300/0 conn(0x7fd8b0145430 msgr2=0x7fd8b00b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:18.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.478+0000 7fd8aed9d640 1 --2- 172.21.15.161:0/754067688 >> v2:172.21.15.6:3300/0 conn(0x7fd8b0145430 0x7fd8b00b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.478+0000 7fd8aed9d640 1 -- 172.21.15.161:0/754067688 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b00b2cb0 con 0x7fd8b00d06b0 2023-07-21T22:18:18.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.482+0000 7fd8aed9d640 1 --2- 172.21.15.161:0/754067688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8b00d06b0 0x7fd8b00b1a30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd8b008b420 tx=0x7fd8a001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88c8ca11c973b568 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:18.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.482+0000 7fd8add9b640 1 -- 172.21.15.161:0/754067688 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a00aa610 con 0x7fd8b00d06b0 2023-07-21T22:18:18.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.482+0000 7fd8add9b640 1 -- 172.21.15.161:0/754067688 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a00a6040 con 0x7fd8b00d06b0 2023-07-21T22:18:18.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.482+0000 7fd8add9b640 1 -- 172.21.15.161:0/754067688 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a00aa990 con 0x7fd8b00d06b0 2023-07-21T22:18:18.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.482+0000 7fd8b5140640 1 -- 172.21.15.161:0/754067688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8b00d06b0 msgr2=0x7fd8b00b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:18.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.482+0000 7fd8b5140640 1 --2- 172.21.15.161:0/754067688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8b00d06b0 0x7fd8b00b1a30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd8b008b420 tx=0x7fd8a001c4d0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.482+0000 7fd8b5140640 1 -- 172.21.15.161:0/754067688 shutdown_connections 2023-07-21T22:18:18.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.482+0000 7fd8b5140640 1 --2- 172.21.15.161:0/754067688 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8b00b1f70 0x7fd8b00d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.482+0000 7fd8b5140640 1 --2- 172.21.15.161:0/754067688 >> v2:172.21.15.6:3300/0 conn(0x7fd8b0145430 0x7fd8b00b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.482+0000 7fd8b5140640 1 --2- 172.21.15.161:0/754067688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8b00d06b0 0x7fd8b00b1a30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.482+0000 7fd8b5140640 1 -- 172.21.15.161:0/754067688 >> 172.21.15.161:0/754067688 conn(0x7fd8b00659d0 msgr2=0x7fd8b009b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:18.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.482+0000 7fd8b5140640 1 -- 172.21.15.161:0/754067688 shutdown_connections 2023-07-21T22:18:18.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.482+0000 7fd8b5140640 1 -- 172.21.15.161:0/754067688 wait complete. 2023-07-21T22:18:18.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8b5140640 1 Processor -- start 2023-07-21T22:18:18.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8b5140640 1 -- start start 2023-07-21T22:18:18.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8b5140640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8b00b1f70 0x7fd8b015b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:18.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8b5140640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8b00d06b0 0x7fd8b00c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:18.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8b5140640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8b00cb910 0x7fd8b00cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:18.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8b5140640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b00cc2f0 con 0x7fd8b00b1f70 2023-07-21T22:18:18.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8b5140640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b0152290 con 0x7fd8b00d06b0 2023-07-21T22:18:18.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8b5140640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b0152570 con 0x7fd8b00cb910 2023-07-21T22:18:18.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8ae59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8b00d06b0 0x7fd8b00c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:18.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8ae59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8b00d06b0 0x7fd8b00c4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39730/0 (socket says 172.21.15.161:39730) 2023-07-21T22:18:18.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8ae59c640 1 -- 172.21.15.161:0/1797214352 learned_addr learned my addr 172.21.15.161:0/1797214352 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-07-21T22:18:18.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8af59e640 1 --2- 172.21.15.161:0/1797214352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8b00cb910 0x7fd8b00cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:18.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8aed9d640 1 --2- 172.21.15.161:0/1797214352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8b00b1f70 0x7fd8b015b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:18.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8ae59c640 1 -- 172.21.15.161:0/1797214352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8b00cb910 msgr2=0x7fd8b00cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:18.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8ae59c640 1 --2- 172.21.15.161:0/1797214352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8b00cb910 0x7fd8b00cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8ae59c640 1 -- 172.21.15.161:0/1797214352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8b00b1f70 msgr2=0x7fd8b015b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:18.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8ae59c640 1 --2- 172.21.15.161:0/1797214352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8b00b1f70 0x7fd8b015b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8ae59c640 1 -- 172.21.15.161:0/1797214352 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a00094d0 con 0x7fd8b00d06b0 2023-07-21T22:18:18.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8af59e640 1 --2- 172.21.15.161:0/1797214352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8b00cb910 0x7fd8b00cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:18.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8ae59c640 1 --2- 172.21.15.161:0/1797214352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8b00d06b0 0x7fd8b00c4e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd8a400e930 tx=0x7fd8a400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:18.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8977fe640 1 -- 172.21.15.161:0/1797214352 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4009690 con 0x7fd8b00d06b0 2023-07-21T22:18:18.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8977fe640 1 -- 172.21.15.161:0/1797214352 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a400ca00 con 0x7fd8b00d06b0 2023-07-21T22:18:18.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8977fe640 1 -- 172.21.15.161:0/1797214352 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a400cd70 con 0x7fd8b00d06b0 2023-07-21T22:18:18.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.486+0000 7fd8b5140640 1 -- 172.21.15.161:0/1797214352 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b0152850 con 0x7fd8b00d06b0 2023-07-21T22:18:18.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.490+0000 7fd8b5140640 1 -- 172.21.15.161:0/1797214352 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b00c9420 con 0x7fd8b00d06b0 2023-07-21T22:18:18.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.490+0000 7fd8977fe640 1 -- 172.21.15.161:0/1797214352 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd8a4005ca0 con 0x7fd8b00d06b0 2023-07-21T22:18:18.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.490+0000 7fd8977fe640 1 -- 172.21.15.161:0/1797214352 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd8a4013880 con 0x7fd8b00d06b0 2023-07-21T22:18:18.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.490+0000 7fd8b5140640 1 -- 172.21.15.161:0/1797214352 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b0072e70 con 0x7fd8b00d06b0 2023-07-21T22:18:18.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.518+0000 7fd8977fe640 1 -- 172.21.15.161:0/1797214352 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fd8a4021060 con 0x7fd8b00d06b0 2023-07-21T22:18:18.620 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:18.572+0000 7f0cc7e2d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:18:18.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.586+0000 7fd8b5140640 1 -- 172.21.15.161:0/1797214352 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9ce560da-84c1-494d-bc1f-33760d20ecad", "id": 0} v 0) v1 -- 0x7fd8b00c95b0 con 0x7fd8b00d06b0 2023-07-21T22:18:18.633 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:18.590+0000 7f941d284180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:18:18.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.594+0000 7fd8977fe640 1 -- 172.21.15.161:0/1797214352 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9ce560da-84c1-494d-bc1f-33760d20ecad", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd8a4017070 con 0x7fd8b00d06b0 2023-07-21T22:18:18.637 INFO:teuthology.orchestra.run.smithi161.stdout:0 2023-07-21T22:18:18.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.594+0000 7fd8b5140640 1 -- 172.21.15.161:0/1797214352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8b00d06b0 msgr2=0x7fd8b00c4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:18.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.594+0000 7fd8b5140640 1 --2- 172.21.15.161:0/1797214352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8b00d06b0 0x7fd8b00c4e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd8a400e930 tx=0x7fd8a400edf0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.594+0000 7fd8b5140640 1 -- 172.21.15.161:0/1797214352 shutdown_connections 2023-07-21T22:18:18.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.594+0000 7fd8b5140640 1 --2- 172.21.15.161:0/1797214352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8b00cb910 0x7fd8b00cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.594+0000 7fd8b5140640 1 --2- 172.21.15.161:0/1797214352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8b00d06b0 0x7fd8b00c4e70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.594+0000 7fd8b5140640 1 --2- 172.21.15.161:0/1797214352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8b00b1f70 0x7fd8b015b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.594+0000 7fd8b5140640 1 -- 172.21.15.161:0/1797214352 >> 172.21.15.161:0/1797214352 conn(0x7fd8b00659d0 msgr2=0x7fd8b006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:18.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.594+0000 7fd8b5140640 1 -- 172.21.15.161:0/1797214352 shutdown_connections 2023-07-21T22:18:18.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.594+0000 7fd8b5140640 1 -- 172.21.15.161:0/1797214352 wait complete. 2023-07-21T22:18:18.656 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 3f855e10-abc8-4e13-a119-4e856e9897a3 1 2023-07-21T22:18:18.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.746+0000 7f6c84034640 1 Processor -- start 2023-07-21T22:18:18.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.750+0000 7f6c84034640 1 -- start start 2023-07-21T22:18:18.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.750+0000 7f6c84034640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c7c145430 0x7f6c7c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:18.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.750+0000 7f6c84034640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c7c0b39f0 0x7f6c7c0d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:18.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.750+0000 7f6c84034640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7c0b2140 con 0x7f6c7c0d06b0 2023-07-21T22:18:18.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.750+0000 7f6c84034640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7c0b2410 con 0x7f6c7c0b39f0 2023-07-21T22:18:18.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.750+0000 7f6c84034640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0b26f0 con 0x7f6c7c145430 2023-07-21T22:18:18.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.750+0000 7f6c81dd0640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6c7c0d06b0 0x7f6c7c0b1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:42030/0 (socket says 172.21.15.161:42030) 2023-07-21T22:18:18.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.750+0000 7f6c81dd0640 1 -- 172.21.15.161:0/953138474 learned_addr learned my addr 172.21.15.161:0/953138474 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-07-21T22:18:18.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.750+0000 7f6c815cf640 1 --2- 172.21.15.161:0/953138474 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c7c145430 0x7f6c7c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:18.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.750+0000 7f6c825d1640 1 --2- 172.21.15.161:0/953138474 >> v2:172.21.15.6:3300/0 conn(0x7f6c7c0b39f0 0x7f6c7c0d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:18.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.750+0000 7f6c80dce640 1 -- 172.21.15.161:0/953138474 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291882144 0 0) 0x7f6c7c0b2140 con 0x7f6c7c0d06b0 2023-07-21T22:18:18.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.750+0000 7f6c815cf640 1 -- 172.21.15.161:0/953138474 >> v2:172.21.15.6:3300/0 conn(0x7f6c7c0b39f0 msgr2=0x7f6c7c0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:18.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.750+0000 7f6c815cf640 1 --2- 172.21.15.161:0/953138474 >> v2:172.21.15.6:3300/0 conn(0x7f6c7c0b39f0 0x7f6c7c0d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.750+0000 7f6c815cf640 1 -- 172.21.15.161:0/953138474 >> v1:172.21.15.161:6789/0 conn(0x7f6c7c0d06b0 legacy=0x7f6c7c0b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:18.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.750+0000 7f6c815cf640 1 -- 172.21.15.161:0/953138474 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c0b29d0 con 0x7f6c7c145430 2023-07-21T22:18:18.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.754+0000 7f6c815cf640 1 --2- 172.21.15.161:0/953138474 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c7c145430 0x7f6c7c0b34b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c0097c0 tx=0x7f6c6c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68e0860b35801400 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:18.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.754+0000 7f6c80dce640 1 -- 172.21.15.161:0/953138474 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c0ad660 con 0x7f6c7c145430 2023-07-21T22:18:18.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.754+0000 7f6c80dce640 1 -- 172.21.15.161:0/953138474 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c0ad7c0 con 0x7f6c7c145430 2023-07-21T22:18:18.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.754+0000 7f6c80dce640 1 -- 172.21.15.161:0/953138474 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c0adb50 con 0x7f6c7c145430 2023-07-21T22:18:18.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.754+0000 7f6c84034640 1 -- 172.21.15.161:0/953138474 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c7c145430 msgr2=0x7f6c7c0b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:18.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.754+0000 7f6c84034640 1 --2- 172.21.15.161:0/953138474 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c7c145430 0x7f6c7c0b34b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c0097c0 tx=0x7f6c6c01c450 comp rx=0 tx=0).stop 2023-07-21T22:18:18.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.754+0000 7f6c84034640 1 -- 172.21.15.161:0/953138474 shutdown_connections 2023-07-21T22:18:18.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.754+0000 7f6c84034640 1 --2- 172.21.15.161:0/953138474 >> v2:172.21.15.6:3300/0 conn(0x7f6c7c0b39f0 0x7f6c7c0d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.754+0000 7f6c84034640 1 --2- 172.21.15.161:0/953138474 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c7c145430 0x7f6c7c0b34b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.754+0000 7f6c84034640 1 -- 172.21.15.161:0/953138474 >> 172.21.15.161:0/953138474 conn(0x7f6c7c0659d0 msgr2=0x7f6c7c09b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:18.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.754+0000 7f6c84034640 1 -- 172.21.15.161:0/953138474 shutdown_connections 2023-07-21T22:18:18.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.754+0000 7f6c84034640 1 -- 172.21.15.161:0/953138474 wait complete. 2023-07-21T22:18:18.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c84034640 1 Processor -- start 2023-07-21T22:18:18.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c84034640 1 -- start start 2023-07-21T22:18:18.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c84034640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c0b39f0 0x7f6c7c0c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:18.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c84034640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c7c0d06b0 0x7f6c7c1528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:18.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c84034640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c7c153410 0x7f6c7c152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:18.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c84034640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0c5300 con 0x7f6c7c0b39f0 2023-07-21T22:18:18.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c84034640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0c7ec0 con 0x7f6c7c0d06b0 2023-07-21T22:18:18.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c84034640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0b1c10 con 0x7f6c7c153410 2023-07-21T22:18:18.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c825d1640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c7c153410 0x7f6c7c152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:18.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c815cf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c7c0d06b0 0x7f6c7c1528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:18.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c815cf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c7c0d06b0 0x7f6c7c1528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39736/0 (socket says 172.21.15.161:39736) 2023-07-21T22:18:18.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c815cf640 1 -- 172.21.15.161:0/2597639964 learned_addr learned my addr 172.21.15.161:0/2597639964 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-07-21T22:18:18.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c81dd0640 1 --2- 172.21.15.161:0/2597639964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c0b39f0 0x7f6c7c0c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:18.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c815cf640 1 -- 172.21.15.161:0/2597639964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c7c153410 msgr2=0x7f6c7c152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:18.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c815cf640 1 --2- 172.21.15.161:0/2597639964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c7c153410 0x7f6c7c152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c815cf640 1 -- 172.21.15.161:0/2597639964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c0b39f0 msgr2=0x7f6c7c0c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:18.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c815cf640 1 --2- 172.21.15.161:0/2597639964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c0b39f0 0x7f6c7c0c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c815cf640 1 -- 172.21.15.161:0/2597639964 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c009420 con 0x7f6c7c0d06b0 2023-07-21T22:18:18.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c825d1640 1 --2- 172.21.15.161:0/2597639964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c7c153410 0x7f6c7c152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:18.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c81dd0640 1 --2- 172.21.15.161:0/2597639964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c0b39f0 0x7f6c7c0c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:18.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c815cf640 1 --2- 172.21.15.161:0/2597639964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c7c0d06b0 0x7f6c7c1528e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c01ab00 tx=0x7f6c6c0191f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:18.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c727fc640 1 -- 172.21.15.161:0/2597639964 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c004230 con 0x7f6c7c0d06b0 2023-07-21T22:18:18.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c727fc640 1 -- 172.21.15.161:0/2597639964 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c004390 con 0x7f6c7c0d06b0 2023-07-21T22:18:18.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c727fc640 1 -- 172.21.15.161:0/2597639964 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c003820 con 0x7f6c7c0d06b0 2023-07-21T22:18:18.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c84034640 1 -- 172.21.15.161:0/2597639964 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7c0b1ef0 con 0x7f6c7c0d06b0 2023-07-21T22:18:18.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c84034640 1 -- 172.21.15.161:0/2597639964 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7c0c4cb0 con 0x7f6c7c0d06b0 2023-07-21T22:18:18.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c727fc640 1 -- 172.21.15.161:0/2597639964 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6c6c0b4040 con 0x7f6c7c0d06b0 2023-07-21T22:18:18.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c727fc640 1 -- 172.21.15.161:0/2597639964 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f6c6c0b8af0 con 0x7f6c7c0d06b0 2023-07-21T22:18:18.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.758+0000 7f6c84034640 1 -- 172.21.15.161:0/2597639964 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7c072e70 con 0x7f6c7c0d06b0 2023-07-21T22:18:18.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.762+0000 7f6c727fc640 1 -- 172.21.15.161:0/2597639964 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f6c6c0c2070 con 0x7f6c7c0d06b0 2023-07-21T22:18:18.836 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:18.790+0000 7f941d284180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:18:18.848 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:18.800+0000 7f0cc7e2d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:18:18.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.830+0000 7f6c84034640 1 -- 172.21.15.161:0/2597639964 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3f855e10-abc8-4e13-a119-4e856e9897a3", "id": 1} v 0) v1 -- 0x7f6c7c0c54b0 con 0x7f6c7c0d06b0 2023-07-21T22:18:18.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.838+0000 7f6c727fc640 1 -- 172.21.15.161:0/2597639964 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3f855e10-abc8-4e13-a119-4e856e9897a3", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6c7c0c54b0 con 0x7f6c7c0d06b0 2023-07-21T22:18:18.883 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-07-21T22:18:18.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.838+0000 7f6c84034640 1 -- 172.21.15.161:0/2597639964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c7c0d06b0 msgr2=0x7f6c7c1528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:18.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.838+0000 7f6c84034640 1 --2- 172.21.15.161:0/2597639964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c7c0d06b0 0x7f6c7c1528e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c01ab00 tx=0x7f6c6c0191f0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.838+0000 7f6c84034640 1 -- 172.21.15.161:0/2597639964 shutdown_connections 2023-07-21T22:18:18.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.838+0000 7f6c84034640 1 --2- 172.21.15.161:0/2597639964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c7c153410 0x7f6c7c152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.838+0000 7f6c84034640 1 --2- 172.21.15.161:0/2597639964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c7c0d06b0 0x7f6c7c1528e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.838+0000 7f6c84034640 1 --2- 172.21.15.161:0/2597639964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c0b39f0 0x7f6c7c0c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:18.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.838+0000 7f6c84034640 1 -- 172.21.15.161:0/2597639964 >> 172.21.15.161:0/2597639964 conn(0x7f6c7c0659d0 msgr2=0x7f6c7c15c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:18.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.838+0000 7f6c84034640 1 -- 172.21.15.161:0/2597639964 shutdown_connections 2023-07-21T22:18:18.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.838+0000 7f6c84034640 1 -- 172.21.15.161:0/2597639964 wait complete. 2023-07-21T22:18:18.902 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new f840e3e0-4927-47ec-8916-a14bc9edaf44 2 2023-07-21T22:18:19.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.994+0000 7fb8f1396640 1 Processor -- start 2023-07-21T22:18:19.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.994+0000 7fb8f1396640 1 -- start start 2023-07-21T22:18:19.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.994+0000 7fb8f1396640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb8ec06cf10 0x7fb8ec15c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:19.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.994+0000 7fb8f1396640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8ec0cc000 0x7fb8ec0cc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:19.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.994+0000 7fb8f1396640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ec1586e0 con 0x7fb8ec0c85a0 2023-07-21T22:18:19.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.994+0000 7fb8f1396640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8ec1595a0 con 0x7fb8ec06cf10 2023-07-21T22:18:19.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.994+0000 7fb8f1396640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec15cc70 con 0x7fb8ec0cc000 2023-07-21T22:18:19.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.994+0000 7fb8eaffd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb8ec0c85a0 0x7fb8ec0c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:42044/0 (socket says 172.21.15.161:42044) 2023-07-21T22:18:19.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.994+0000 7fb8eaffd640 1 -- 172.21.15.161:0/475312517 learned_addr learned my addr 172.21.15.161:0/475312517 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-07-21T22:18:19.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.994+0000 7fb8eb7fe640 1 --2- 172.21.15.161:0/475312517 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8ec0cc000 0x7fb8ec0cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:19.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.994+0000 7fb8ea7fc640 1 --2- 172.21.15.161:0/475312517 >> v2:172.21.15.6:3300/0 conn(0x7fb8ec06cf10 0x7fb8ec15c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:19.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.994+0000 7fb8eb7fe640 1 -- 172.21.15.161:0/475312517 >> v2:172.21.15.6:3300/0 conn(0x7fb8ec06cf10 msgr2=0x7fb8ec15c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:19.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.994+0000 7fb8eb7fe640 1 --2- 172.21.15.161:0/475312517 >> v2:172.21.15.6:3300/0 conn(0x7fb8ec06cf10 0x7fb8ec15c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.994+0000 7fb8eb7fe640 1 -- 172.21.15.161:0/475312517 >> v1:172.21.15.161:6789/0 conn(0x7fb8ec0c85a0 legacy=0x7fb8ec0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.994+0000 7fb8e9ffb640 1 -- 172.21.15.161:0/475312517 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152454940 0 0) 0x7fb8dc001120 con 0x7fb8ec0c85a0 2023-07-21T22:18:19.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.994+0000 7fb8eb7fe640 1 -- 172.21.15.161:0/475312517 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ec1560a0 con 0x7fb8ec0cc000 2023-07-21T22:18:19.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.998+0000 7fb8eb7fe640 1 --2- 172.21.15.161:0/475312517 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8ec0cc000 0x7fb8ec0cc480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009d90 tx=0x7fb8e401d910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23dfc5f7e0fd8823 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:19.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.998+0000 7fb8e9ffb640 1 -- 172.21.15.161:0/475312517 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e40a69c0 con 0x7fb8ec0cc000 2023-07-21T22:18:19.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.998+0000 7fb8e9ffb640 1 -- 172.21.15.161:0/475312517 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e40a6b20 con 0x7fb8ec0cc000 2023-07-21T22:18:19.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.998+0000 7fb8e9ffb640 1 -- 172.21.15.161:0/475312517 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e40ae440 con 0x7fb8ec0cc000 2023-07-21T22:18:19.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.998+0000 7fb8f1396640 1 -- 172.21.15.161:0/475312517 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8ec0cc000 msgr2=0x7fb8ec0cc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.998+0000 7fb8f1396640 1 --2- 172.21.15.161:0/475312517 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8ec0cc000 0x7fb8ec0cc480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009d90 tx=0x7fb8e401d910 comp rx=0 tx=0).stop 2023-07-21T22:18:19.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.998+0000 7fb8f1396640 1 -- 172.21.15.161:0/475312517 shutdown_connections 2023-07-21T22:18:19.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.998+0000 7fb8f1396640 1 --2- 172.21.15.161:0/475312517 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8ec0cc000 0x7fb8ec0cc480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.998+0000 7fb8f1396640 1 --2- 172.21.15.161:0/475312517 >> v2:172.21.15.6:3300/0 conn(0x7fb8ec06cf10 0x7fb8ec15c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.998+0000 7fb8f1396640 1 -- 172.21.15.161:0/475312517 >> 172.21.15.161:0/475312517 conn(0x7fb8ec0afac0 msgr2=0x7fb8ec0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:19.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.998+0000 7fb8f1396640 1 -- 172.21.15.161:0/475312517 shutdown_connections 2023-07-21T22:18:19.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:18.998+0000 7fb8f1396640 1 -- 172.21.15.161:0/475312517 wait complete. 2023-07-21T22:18:19.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.002+0000 7fb8f1396640 1 Processor -- start 2023-07-21T22:18:19.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.002+0000 7fb8f1396640 1 -- start start 2023-07-21T22:18:19.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8f1396640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ec06cf10 0x7fb8ec0c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:19.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8f1396640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8ec0c85a0 0x7fb8ec161b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:19.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8f1396640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8ec0cc000 0x7fb8ec1620c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:19.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8f1396640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec0c7810 con 0x7fb8ec06cf10 2023-07-21T22:18:19.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8f1396640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec0c6b90 con 0x7fb8ec0c85a0 2023-07-21T22:18:19.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8f1396640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec0c6e70 con 0x7fb8ec0cc000 2023-07-21T22:18:19.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8ea7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8ec0c85a0 0x7fb8ec161b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:19.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8eaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ec06cf10 0x7fb8ec0c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:19.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8ea7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8ec0c85a0 0x7fb8ec161b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39740/0 (socket says 172.21.15.161:39740) 2023-07-21T22:18:19.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8eb7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8ec0cc000 0x7fb8ec1620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:19.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8ea7fc640 1 -- 172.21.15.161:0/2991254228 learned_addr learned my addr 172.21.15.161:0/2991254228 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-07-21T22:18:19.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8ea7fc640 1 -- 172.21.15.161:0/2991254228 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8ec0cc000 msgr2=0x7fb8ec1620c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8ea7fc640 1 --2- 172.21.15.161:0/2991254228 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8ec0cc000 0x7fb8ec1620c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8ea7fc640 1 -- 172.21.15.161:0/2991254228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ec06cf10 msgr2=0x7fb8ec0c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8ea7fc640 1 --2- 172.21.15.161:0/2991254228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ec06cf10 0x7fb8ec0c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8ea7fc640 1 -- 172.21.15.161:0/2991254228 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e4009a70 con 0x7fb8ec0c85a0 2023-07-21T22:18:19.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8eaffd640 1 --2- 172.21.15.161:0/2991254228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ec06cf10 0x7fb8ec0c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:19.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8ea7fc640 1 --2- 172.21.15.161:0/2991254228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8ec0c85a0 0x7fb8ec161b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000e930 tx=0x7fb8e000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:19.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8d37fe640 1 -- 172.21.15.161:0/2991254228 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e0009690 con 0x7fb8ec0c85a0 2023-07-21T22:18:19.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8d37fe640 1 -- 172.21.15.161:0/2991254228 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e000ca00 con 0x7fb8ec0c85a0 2023-07-21T22:18:19.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8f1396640 1 -- 172.21.15.161:0/2991254228 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ec0c7150 con 0x7fb8ec0c85a0 2023-07-21T22:18:19.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8d37fe640 1 -- 172.21.15.161:0/2991254228 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e000cd70 con 0x7fb8ec0c85a0 2023-07-21T22:18:19.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8f1396640 1 -- 172.21.15.161:0/2991254228 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ec0c6660 con 0x7fb8ec0c85a0 2023-07-21T22:18:19.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8d37fe640 1 -- 172.21.15.161:0/2991254228 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb8e0005ca0 con 0x7fb8ec0c85a0 2023-07-21T22:18:19.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8d37fe640 1 -- 172.21.15.161:0/2991254228 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fb8e0006440 con 0x7fb8ec0c85a0 2023-07-21T22:18:19.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.006+0000 7fb8f1396640 1 -- 172.21.15.161:0/2991254228 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ec0c9b40 con 0x7fb8ec0c85a0 2023-07-21T22:18:19.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.010+0000 7fb8d37fe640 1 -- 172.21.15.161:0/2991254228 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb8e0021060 con 0x7fb8ec0c85a0 2023-07-21T22:18:19.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.074+0000 7fb8f1396640 1 -- 172.21.15.161:0/2991254228 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f840e3e0-4927-47ec-8916-a14bc9edaf44", "id": 2} v 0) v1 -- 0x7fb8ec0c68e0 con 0x7fb8ec0c85a0 2023-07-21T22:18:19.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.082+0000 7fb8d37fe640 1 -- 172.21.15.161:0/2991254228 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f840e3e0-4927-47ec-8916-a14bc9edaf44", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb8e0029020 con 0x7fb8ec0c85a0 2023-07-21T22:18:19.128 INFO:teuthology.orchestra.run.smithi161.stdout:2 2023-07-21T22:18:19.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.086+0000 7fb8f1396640 1 -- 172.21.15.161:0/2991254228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8ec0c85a0 msgr2=0x7fb8ec161b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.086+0000 7fb8f1396640 1 --2- 172.21.15.161:0/2991254228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8ec0c85a0 0x7fb8ec161b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000e930 tx=0x7fb8e000edf0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.086+0000 7fb8f1396640 1 -- 172.21.15.161:0/2991254228 shutdown_connections 2023-07-21T22:18:19.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.086+0000 7fb8f1396640 1 --2- 172.21.15.161:0/2991254228 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8ec0cc000 0x7fb8ec1620c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.086+0000 7fb8f1396640 1 --2- 172.21.15.161:0/2991254228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8ec0c85a0 0x7fb8ec161b80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.086+0000 7fb8f1396640 1 --2- 172.21.15.161:0/2991254228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ec06cf10 0x7fb8ec0c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.086+0000 7fb8f1396640 1 -- 172.21.15.161:0/2991254228 >> 172.21.15.161:0/2991254228 conn(0x7fb8ec0afac0 msgr2=0x7fb8ec15bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:19.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.086+0000 7fb8f1396640 1 -- 172.21.15.161:0/2991254228 shutdown_connections 2023-07-21T22:18:19.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.086+0000 7fb8f1396640 1 -- 172.21.15.161:0/2991254228 wait complete. 2023-07-21T22:18:19.148 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new e48323c3-775a-4c9b-bbb1-a72389f82791 3 2023-07-21T22:18:19.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.238+0000 7fa97587b640 1 Processor -- start 2023-07-21T22:18:19.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.238+0000 7fa97587b640 1 -- start start 2023-07-21T22:18:19.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.242+0000 7fa97587b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa970156560 0x7fa9700cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:19.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.242+0000 7fa97587b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9700ccf60 0x7fa9700cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:19.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.242+0000 7fa97587b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9700b08d0 con 0x7fa970158df0 2023-07-21T22:18:19.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.242+0000 7fa97587b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9700cd8d0 con 0x7fa9700ccf60 2023-07-21T22:18:19.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.242+0000 7fa97587b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa970159cb0 con 0x7fa970156560 2023-07-21T22:18:19.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.242+0000 7fa96effd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa970156560 0x7fa9700cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:19.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.242+0000 7fa96effd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa970156560 0x7fa9700cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39750/0 (socket says 172.21.15.161:39750) 2023-07-21T22:18:19.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.242+0000 7fa96effd640 1 -- 172.21.15.161:0/1445355477 learned_addr learned my addr 172.21.15.161:0/1445355477 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-07-21T22:18:19.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.242+0000 7fa96e7fc640 1 --2- 172.21.15.161:0/1445355477 >> v2:172.21.15.6:3300/0 conn(0x7fa9700ccf60 0x7fa9700cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:19.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.242+0000 7fa96effd640 1 -- 172.21.15.161:0/1445355477 >> v2:172.21.15.6:3300/0 conn(0x7fa9700ccf60 msgr2=0x7fa9700cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:19.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.242+0000 7fa96effd640 1 --2- 172.21.15.161:0/1445355477 >> v2:172.21.15.6:3300/0 conn(0x7fa9700ccf60 0x7fa9700cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.242+0000 7fa96effd640 1 -- 172.21.15.161:0/1445355477 >> v1:172.21.15.6:6789/0 conn(0x7fa970158df0 legacy=0x7fa97006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.242+0000 7fa96effd640 1 -- 172.21.15.161:0/1445355477 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9701599d0 con 0x7fa970156560 2023-07-21T22:18:19.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.242+0000 7fa96e7fc640 1 --2- 172.21.15.161:0/1445355477 >> v2:172.21.15.6:3300/0 conn(0x7fa9700ccf60 0x7fa9700cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:19.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.246+0000 7fa96effd640 1 --2- 172.21.15.161:0/1445355477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa970156560 0x7fa9700cb3e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa9700cde30 tx=0x7fa96001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a270be52a5fdef29 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:19.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.246+0000 7fa96dffb640 1 -- 172.21.15.161:0/1445355477 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9600aa430 con 0x7fa970156560 2023-07-21T22:18:19.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.246+0000 7fa96dffb640 1 -- 172.21.15.161:0/1445355477 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9600aa590 con 0x7fa970156560 2023-07-21T22:18:19.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.246+0000 7fa96dffb640 1 -- 172.21.15.161:0/1445355477 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9600aa920 con 0x7fa970156560 2023-07-21T22:18:19.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.246+0000 7fa97587b640 1 -- 172.21.15.161:0/1445355477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa970156560 msgr2=0x7fa9700cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.246+0000 7fa97587b640 1 --2- 172.21.15.161:0/1445355477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa970156560 0x7fa9700cb3e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa9700cde30 tx=0x7fa96001c4d0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.246+0000 7fa97587b640 1 -- 172.21.15.161:0/1445355477 shutdown_connections 2023-07-21T22:18:19.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.246+0000 7fa97587b640 1 --2- 172.21.15.161:0/1445355477 >> v2:172.21.15.6:3300/0 conn(0x7fa9700ccf60 0x7fa9700cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.246+0000 7fa97587b640 1 --2- 172.21.15.161:0/1445355477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa970156560 0x7fa9700cb3e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.246+0000 7fa97587b640 1 -- 172.21.15.161:0/1445355477 >> 172.21.15.161:0/1445355477 conn(0x7fa9700afac0 msgr2=0x7fa9700afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:19.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.246+0000 7fa97587b640 1 -- 172.21.15.161:0/1445355477 shutdown_connections 2023-07-21T22:18:19.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.246+0000 7fa97587b640 1 -- 172.21.15.161:0/1445355477 wait complete. 2023-07-21T22:18:19.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.246+0000 7fa97587b640 1 Processor -- start 2023-07-21T22:18:19.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.246+0000 7fa97587b640 1 -- start start 2023-07-21T22:18:19.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa97587b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700ccf60 0x7fa97014efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa97587b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa970156560 0x7fa9701521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa97587b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa970158df0 0x7fa9700abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa97587b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa970159f20 con 0x7fa970158df0 2023-07-21T22:18:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa97587b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9700b29f0 con 0x7fa970156560 2023-07-21T22:18:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa97587b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9700b2150 con 0x7fa9700ccf60 2023-07-21T22:18:19.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa96effd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700ccf60 0x7fa97014efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:19.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa96e7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa970156560 0x7fa9701521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:19.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa96effd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700ccf60 0x7fa97014efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:58362/0 (socket says 172.21.15.161:58362) 2023-07-21T22:18:19.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa96e7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa970156560 0x7fa9701521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39756/0 (socket says 172.21.15.161:39756) 2023-07-21T22:18:19.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa96effd640 1 -- 172.21.15.161:0/706280992 learned_addr learned my addr 172.21.15.161:0/706280992 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-07-21T22:18:19.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa96f7fe640 1 --2- 172.21.15.161:0/706280992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa970158df0 0x7fa9700abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:19.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa96e7fc640 1 -- 172.21.15.161:0/706280992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700ccf60 msgr2=0x7fa97014efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa96e7fc640 1 --2- 172.21.15.161:0/706280992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700ccf60 0x7fa97014efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa96e7fc640 1 -- 172.21.15.161:0/706280992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa970158df0 msgr2=0x7fa9700abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa96e7fc640 1 --2- 172.21.15.161:0/706280992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa970158df0 0x7fa9700abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa96e7fc640 1 -- 172.21.15.161:0/706280992 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9600094d0 con 0x7fa970156560 2023-07-21T22:18:19.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa96effd640 1 --2- 172.21.15.161:0/706280992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700ccf60 0x7fa97014efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:19.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa96f7fe640 1 --2- 172.21.15.161:0/706280992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa970158df0 0x7fa9700abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:19.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa96e7fc640 1 --2- 172.21.15.161:0/706280992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa970156560 0x7fa9701521d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa96400e7e0 tx=0x7fa96400eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:19.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa957fff640 1 -- 172.21.15.161:0/706280992 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96400c6d0 con 0x7fa970156560 2023-07-21T22:18:19.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa957fff640 1 -- 172.21.15.161:0/706280992 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96400c830 con 0x7fa970156560 2023-07-21T22:18:19.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa97587b640 1 -- 172.21.15.161:0/706280992 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9700b2430 con 0x7fa970156560 2023-07-21T22:18:19.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa957fff640 1 -- 172.21.15.161:0/706280992 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96400cba0 con 0x7fa970156560 2023-07-21T22:18:19.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa97587b640 1 -- 172.21.15.161:0/706280992 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9700aba40 con 0x7fa970156560 2023-07-21T22:18:19.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa957fff640 1 -- 172.21.15.161:0/706280992 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa964004020 con 0x7fa970156560 2023-07-21T22:18:19.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa957fff640 1 -- 172.21.15.161:0/706280992 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fa964003d00 con 0x7fa970156560 2023-07-21T22:18:19.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.250+0000 7fa97587b640 1 -- 172.21.15.161:0/706280992 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9700678d0 con 0x7fa970156560 2023-07-21T22:18:19.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.254+0000 7fa957fff640 1 -- 172.21.15.161:0/706280992 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa964021060 con 0x7fa970156560 2023-07-21T22:18:19.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.318+0000 7fa97587b640 1 -- 172.21.15.161:0/706280992 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e48323c3-775a-4c9b-bbb1-a72389f82791", "id": 3} v 0) v1 -- 0x7fa9700cd420 con 0x7fa970156560 2023-07-21T22:18:19.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.326+0000 7fa957fff640 1 -- 172.21.15.161:0/706280992 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e48323c3-775a-4c9b-bbb1-a72389f82791", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa964029020 con 0x7fa970156560 2023-07-21T22:18:19.371 INFO:teuthology.orchestra.run.smithi161.stdout:3 2023-07-21T22:18:19.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.326+0000 7fa97587b640 1 -- 172.21.15.161:0/706280992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa970156560 msgr2=0x7fa9701521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.326+0000 7fa97587b640 1 --2- 172.21.15.161:0/706280992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa970156560 0x7fa9701521d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa96400e7e0 tx=0x7fa96400eca0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.326+0000 7fa97587b640 1 -- 172.21.15.161:0/706280992 shutdown_connections 2023-07-21T22:18:19.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.326+0000 7fa97587b640 1 --2- 172.21.15.161:0/706280992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa970158df0 0x7fa9700abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.326+0000 7fa97587b640 1 --2- 172.21.15.161:0/706280992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa970156560 0x7fa9701521d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.326+0000 7fa97587b640 1 --2- 172.21.15.161:0/706280992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700ccf60 0x7fa97014efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.326+0000 7fa97587b640 1 -- 172.21.15.161:0/706280992 >> 172.21.15.161:0/706280992 conn(0x7fa9700afac0 msgr2=0x7fa9700ada30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:19.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.326+0000 7fa97587b640 1 -- 172.21.15.161:0/706280992 shutdown_connections 2023-07-21T22:18:19.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.326+0000 7fa97587b640 1 -- 172.21.15.161:0/706280992 wait complete. 2023-07-21T22:18:19.392 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new b8627d99-2cb3-454a-b51d-898c7d22a607 4 2023-07-21T22:18:19.500 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:19.454+0000 7f941d284180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:18:19.516 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:19.468+0000 7f0cc7e2d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:18:19.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.486+0000 7feee0e93640 1 Processor -- start 2023-07-21T22:18:19.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.486+0000 7feee0e93640 1 -- start start 2023-07-21T22:18:19.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.486+0000 7feee0e93640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feedc0d06b0 0x7feedc0b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:19.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.486+0000 7feee0e93640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feedc0b2410 con 0x7feedc0b1f70 2023-07-21T22:18:19.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.486+0000 7feee0e93640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feedc0b26f0 con 0x7feedc145430 2023-07-21T22:18:19.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.486+0000 7feee0e93640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feedc0b29d0 con 0x7feedc0d06b0 2023-07-21T22:18:19.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.486+0000 7feeda59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feedc0d06b0 0x7feedc0b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:19.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.486+0000 7feeda59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feedc0d06b0 0x7feedc0b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39758/0 (socket says 172.21.15.161:39758) 2023-07-21T22:18:19.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.486+0000 7feeda59c640 1 -- 172.21.15.161:0/1633380451 learned_addr learned my addr 172.21.15.161:0/1633380451 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-07-21T22:18:19.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.486+0000 7feed9d9b640 1 --1- 172.21.15.161:0/1633380451 >> v1:172.21.15.161:6789/0 conn(0x7feedc145430 0x7feedc0b34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:42048/0 (socket says 172.21.15.161:42048) 2023-07-21T22:18:19.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.490+0000 7feeda59c640 1 -- 172.21.15.161:0/1633380451 >> v1:172.21.15.161:6789/0 conn(0x7feedc145430 legacy=0x7feedc0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.490+0000 7feeda59c640 1 -- 172.21.15.161:0/1633380451 >> v1:172.21.15.6:6789/0 conn(0x7feedc0b1f70 legacy=0x7feedc0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.490+0000 7feeda59c640 1 -- 172.21.15.161:0/1633380451 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc0b2cb0 con 0x7feedc0d06b0 2023-07-21T22:18:19.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.490+0000 7feed959a640 1 -- 172.21.15.161:0/1633380451 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4194085025 0 0) 0x7feedc0b26f0 con 0x7feedc145430 2023-07-21T22:18:19.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.490+0000 7feeda59c640 1 --2- 172.21.15.161:0/1633380451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feedc0d06b0 0x7feedc0b1a30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7feecc009870 tx=0x7feecc01cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2ae5d090005d7c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:19.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.490+0000 7feed959a640 1 -- 172.21.15.161:0/1633380451 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc0a95f0 con 0x7feedc0d06b0 2023-07-21T22:18:19.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.490+0000 7feed959a640 1 -- 172.21.15.161:0/1633380451 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feecc0a9750 con 0x7feedc0d06b0 2023-07-21T22:18:19.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.490+0000 7feed959a640 1 -- 172.21.15.161:0/1633380451 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc0a9ae0 con 0x7feedc0d06b0 2023-07-21T22:18:19.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.490+0000 7feee0e93640 1 -- 172.21.15.161:0/1633380451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feedc0d06b0 msgr2=0x7feedc0b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.490+0000 7feee0e93640 1 --2- 172.21.15.161:0/1633380451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feedc0d06b0 0x7feedc0b1a30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7feecc009870 tx=0x7feecc01cf70 comp rx=0 tx=0).stop 2023-07-21T22:18:19.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feee0e93640 1 -- 172.21.15.161:0/1633380451 shutdown_connections 2023-07-21T22:18:19.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feee0e93640 1 --2- 172.21.15.161:0/1633380451 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feedc0d06b0 0x7feedc0b1a30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feee0e93640 1 -- 172.21.15.161:0/1633380451 >> 172.21.15.161:0/1633380451 conn(0x7feedc0659d0 msgr2=0x7feedc09b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:19.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feee0e93640 1 -- 172.21.15.161:0/1633380451 shutdown_connections 2023-07-21T22:18:19.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feee0e93640 1 -- 172.21.15.161:0/1633380451 wait complete. 2023-07-21T22:18:19.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feee0e93640 1 Processor -- start 2023-07-21T22:18:19.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feee0e93640 1 -- start start 2023-07-21T22:18:19.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feee0e93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feedc0b1f70 0x7feedc15ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:19.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feee0e93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feedc0d06b0 0x7feedc0cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:19.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feee0e93640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feedc153f40 0x7feedc0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:19.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feee0e93640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feedc0b8250 con 0x7feedc0b1f70 2023-07-21T22:18:19.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feee0e93640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feedc0b0fb0 con 0x7feedc153f40 2023-07-21T22:18:19.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feee0e93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feedc0b0cd0 con 0x7feedc0d06b0 2023-07-21T22:18:19.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feedad9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feedc153f40 0x7feedc0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:19.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feed9d9b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feedc0d06b0 0x7feedc0cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:19.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feeda59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feedc0b1f70 0x7feedc15ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:19.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feed9d9b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feedc0d06b0 0x7feedc0cedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:58366/0 (socket says 172.21.15.161:58366) 2023-07-21T22:18:19.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feed9d9b640 1 -- 172.21.15.161:0/980924489 learned_addr learned my addr 172.21.15.161:0/980924489 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-07-21T22:18:19.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feedad9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feedc153f40 0x7feedc0cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39766/0 (socket says 172.21.15.161:39766) 2023-07-21T22:18:19.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feed9d9b640 1 -- 172.21.15.161:0/980924489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feedc153f40 msgr2=0x7feedc0cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feed9d9b640 1 --2- 172.21.15.161:0/980924489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feedc153f40 0x7feedc0cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feed9d9b640 1 -- 172.21.15.161:0/980924489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feedc0b1f70 msgr2=0x7feedc15ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feed9d9b640 1 --2- 172.21.15.161:0/980924489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feedc0b1f70 0x7feedc15ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.494+0000 7feed9d9b640 1 -- 172.21.15.161:0/980924489 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc0094d0 con 0x7feedc0d06b0 2023-07-21T22:18:19.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.498+0000 7feed9d9b640 1 --2- 172.21.15.161:0/980924489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feedc0d06b0 0x7feedc0cedf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7feed000c4a0 tx=0x7feed000c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:19.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.498+0000 7feecaffd640 1 -- 172.21.15.161:0/980924489 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed00074e0 con 0x7feedc0d06b0 2023-07-21T22:18:19.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.498+0000 7feecaffd640 1 -- 172.21.15.161:0/980924489 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed0007640 con 0x7feedc0d06b0 2023-07-21T22:18:19.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.498+0000 7feecaffd640 1 -- 172.21.15.161:0/980924489 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0004a30 con 0x7feedc0d06b0 2023-07-21T22:18:19.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.498+0000 7feee0e93640 1 -- 172.21.15.161:0/980924489 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feedc0b7c00 con 0x7feedc0d06b0 2023-07-21T22:18:19.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.498+0000 7feee0e93640 1 -- 172.21.15.161:0/980924489 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feedc0c56c0 con 0x7feedc0d06b0 2023-07-21T22:18:19.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.498+0000 7feecaffd640 1 -- 172.21.15.161:0/980924489 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7feed0012400 con 0x7feedc0d06b0 2023-07-21T22:18:19.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.498+0000 7feecaffd640 1 -- 172.21.15.161:0/980924489 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7feed0012bc0 con 0x7feedc0d06b0 2023-07-21T22:18:19.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.498+0000 7feee0e93640 1 -- 172.21.15.161:0/980924489 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feedc0b7a60 con 0x7feedc0d06b0 2023-07-21T22:18:19.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.502+0000 7feecaffd640 1 -- 172.21.15.161:0/980924489 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7feedc0b7a60 con 0x7feedc0d06b0 2023-07-21T22:18:19.567 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:19.522+0000 7f941d284180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:18:19.581 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:19.536+0000 7f0cc7e2d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:18:19.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.566+0000 7feee0e93640 1 -- 172.21.15.161:0/980924489 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b8627d99-2cb3-454a-b51d-898c7d22a607", "id": 4} v 0) v1 -- 0x7feedc0678d0 con 0x7feedc0d06b0 2023-07-21T22:18:19.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.574+0000 7feecaffd640 1 -- 172.21.15.161:0/980924489 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b8627d99-2cb3-454a-b51d-898c7d22a607", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7feed0018070 con 0x7feedc0d06b0 2023-07-21T22:18:19.619 INFO:teuthology.orchestra.run.smithi161.stdout:4 2023-07-21T22:18:19.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.574+0000 7feee0e93640 1 -- 172.21.15.161:0/980924489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feedc0d06b0 msgr2=0x7feedc0cedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.574+0000 7feee0e93640 1 --2- 172.21.15.161:0/980924489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feedc0d06b0 0x7feedc0cedf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7feed000c4a0 tx=0x7feed000c960 comp rx=0 tx=0).stop 2023-07-21T22:18:19.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.574+0000 7feee0e93640 1 -- 172.21.15.161:0/980924489 shutdown_connections 2023-07-21T22:18:19.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.574+0000 7feee0e93640 1 --2- 172.21.15.161:0/980924489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feedc153f40 0x7feedc0cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.574+0000 7feee0e93640 1 --2- 172.21.15.161:0/980924489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feedc0d06b0 0x7feedc0cedf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.574+0000 7feee0e93640 1 --2- 172.21.15.161:0/980924489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feedc0b1f70 0x7feedc15ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.574+0000 7feee0e93640 1 -- 172.21.15.161:0/980924489 >> 172.21.15.161:0/980924489 conn(0x7feedc0659d0 msgr2=0x7feedc0d22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:19.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.574+0000 7feee0e93640 1 -- 172.21.15.161:0/980924489 shutdown_connections 2023-07-21T22:18:19.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.574+0000 7feee0e93640 1 -- 172.21.15.161:0/980924489 wait complete. 2023-07-21T22:18:19.630 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:19.586+0000 7f941d284180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:18:19.638 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 8ee31a26-d2c9-4975-a11c-447ea07dd1ba 5 2023-07-21T22:18:19.645 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:19.600+0000 7f0cc7e2d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:18:19.721 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:19.678+0000 7f941d284180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:18:19.738 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:19.692+0000 7f0cc7e2d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:18:19.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.730+0000 7f933772c640 1 Processor -- start 2023-07-21T22:18:19.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.730+0000 7f933772c640 1 -- start start 2023-07-21T22:18:19.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.730+0000 7f933772c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93300d22e0 0x7f93300d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:19.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.730+0000 7f933772c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93300b2140 con 0x7f9330145430 2023-07-21T22:18:19.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.730+0000 7f933772c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93300b2410 con 0x7f93300d06b0 2023-07-21T22:18:19.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.730+0000 7f933772c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93300d2cc0 con 0x7f93300d22e0 2023-07-21T22:18:19.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.730+0000 7f93354c8640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f93300d06b0 0x7f93300b1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:42058/0 (socket says 172.21.15.161:42058) 2023-07-21T22:18:19.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.730+0000 7f93354c8640 1 -- 172.21.15.161:0/404184046 learned_addr learned my addr 172.21.15.161:0/404184046 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-07-21T22:18:19.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.730+0000 7f9335cc9640 1 --2- 172.21.15.161:0/404184046 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93300d22e0 0x7f93300d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:19.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.730+0000 7f9327fff640 1 -- 172.21.15.161:0/404184046 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187782591 0 0) 0x7f93300b2410 con 0x7f93300d06b0 2023-07-21T22:18:19.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.730+0000 7f9327fff640 1 -- 172.21.15.161:0/404184046 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f931c003530 con 0x7f93300d06b0 2023-07-21T22:18:19.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.730+0000 7f9335cc9640 1 -- 172.21.15.161:0/404184046 >> v1:172.21.15.161:6789/0 conn(0x7f93300d06b0 legacy=0x7f93300b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.730+0000 7f9335cc9640 1 -- 172.21.15.161:0/404184046 >> v1:172.21.15.6:6789/0 conn(0x7f9330145430 legacy=0x7f93300b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.730+0000 7f9327fff640 1 -- 172.21.15.161:0/404184046 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473209678 0 0) 0x7f93300b2140 con 0x7f9330145430 2023-07-21T22:18:19.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.730+0000 7f9335cc9640 1 -- 172.21.15.161:0/404184046 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93300b26f0 con 0x7f93300d22e0 2023-07-21T22:18:19.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.738+0000 7f9335cc9640 1 --2- 172.21.15.161:0/404184046 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93300d22e0 0x7f93300d2780 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9328009dc0 tx=0x7f932801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a7fb37c21c40b54 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:19.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.738+0000 7f9327fff640 1 -- 172.21.15.161:0/404184046 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93280a5a00 con 0x7f93300d22e0 2023-07-21T22:18:19.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.738+0000 7f9327fff640 1 -- 172.21.15.161:0/404184046 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93280a5b60 con 0x7f93300d22e0 2023-07-21T22:18:19.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.738+0000 7f9327fff640 1 -- 172.21.15.161:0/404184046 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93280ad440 con 0x7f93300d22e0 2023-07-21T22:18:19.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.738+0000 7f933772c640 1 -- 172.21.15.161:0/404184046 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93300d22e0 msgr2=0x7f93300d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.738+0000 7f933772c640 1 --2- 172.21.15.161:0/404184046 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93300d22e0 0x7f93300d2780 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9328009dc0 tx=0x7f932801c940 comp rx=0 tx=0).stop 2023-07-21T22:18:19.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.738+0000 7f933772c640 1 -- 172.21.15.161:0/404184046 shutdown_connections 2023-07-21T22:18:19.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.738+0000 7f933772c640 1 --2- 172.21.15.161:0/404184046 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93300d22e0 0x7f93300d2780 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.738+0000 7f933772c640 1 -- 172.21.15.161:0/404184046 >> 172.21.15.161:0/404184046 conn(0x7f93300659d0 msgr2=0x7f933009b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:19.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.738+0000 7f933772c640 1 -- 172.21.15.161:0/404184046 shutdown_connections 2023-07-21T22:18:19.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.738+0000 7f933772c640 1 -- 172.21.15.161:0/404184046 wait complete. 2023-07-21T22:18:19.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.738+0000 7f933772c640 1 Processor -- start 2023-07-21T22:18:19.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.738+0000 7f933772c640 1 -- start start 2023-07-21T22:18:19.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f933772c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93300d06b0 0x7f933006ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:19.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f933772c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93300d22e0 0x7f93300c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:19.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f933772c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9330153940 0x7f933015e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:19.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f933772c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93301534b0 con 0x7f9330153940 2023-07-21T22:18:19.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f933772c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933006b050 con 0x7f93300d06b0 2023-07-21T22:18:19.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f933772c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93301528a0 con 0x7f93300d22e0 2023-07-21T22:18:19.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f9334cc7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93300d22e0 0x7f93300c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:19.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f93354c8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93300d06b0 0x7f933006ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:19.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f9334cc7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93300d22e0 0x7f93300c5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:58374/0 (socket says 172.21.15.161:58374) 2023-07-21T22:18:19.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f93354c8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93300d06b0 0x7f933006ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39770/0 (socket says 172.21.15.161:39770) 2023-07-21T22:18:19.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f9334cc7640 1 -- 172.21.15.161:0/1557886904 learned_addr learned my addr 172.21.15.161:0/1557886904 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-07-21T22:18:19.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f9335cc9640 1 --2- 172.21.15.161:0/1557886904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9330153940 0x7f933015e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:19.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f93354c8640 1 -- 172.21.15.161:0/1557886904 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93300d22e0 msgr2=0x7f93300c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f93354c8640 1 --2- 172.21.15.161:0/1557886904 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93300d22e0 0x7f93300c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f93354c8640 1 -- 172.21.15.161:0/1557886904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9330153940 msgr2=0x7f933015e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f93354c8640 1 --2- 172.21.15.161:0/1557886904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9330153940 0x7f933015e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f93354c8640 1 -- 172.21.15.161:0/1557886904 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9328009a70 con 0x7f93300d06b0 2023-07-21T22:18:19.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f9334cc7640 1 --2- 172.21.15.161:0/1557886904 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93300d22e0 0x7f93300c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:19.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f93354c8640 1 --2- 172.21.15.161:0/1557886904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93300d06b0 0x7f933006ab10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f932c007fd0 tx=0x7f932c001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:19.789 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f941d284180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:18:19.790 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f9325ffb640 1 -- 172.21.15.161:0/1557886904 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c005cf0 con 0x7f93300d06b0 2023-07-21T22:18:19.790 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f9325ffb640 1 -- 172.21.15.161:0/1557886904 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c005e50 con 0x7f93300d06b0 2023-07-21T22:18:19.790 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f933772c640 1 -- 172.21.15.161:0/1557886904 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9330152b80 con 0x7f93300d06b0 2023-07-21T22:18:19.790 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f9325ffb640 1 -- 172.21.15.161:0/1557886904 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c007310 con 0x7f93300d06b0 2023-07-21T22:18:19.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f9325ffb640 1 -- 172.21.15.161:0/1557886904 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f932c012400 con 0x7f93300d06b0 2023-07-21T22:18:19.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f933772c640 1 -- 172.21.15.161:0/1557886904 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9330153140 con 0x7f93300d06b0 2023-07-21T22:18:19.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f9325ffb640 1 -- 172.21.15.161:0/1557886904 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f932c01b450 con 0x7f93300d06b0 2023-07-21T22:18:19.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.742+0000 7f933772c640 1 -- 172.21.15.161:0/1557886904 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93300678d0 con 0x7f93300d06b0 2023-07-21T22:18:19.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.746+0000 7f9325ffb640 1 -- 172.21.15.161:0/1557886904 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f932c017070 con 0x7f93300d06b0 2023-07-21T22:18:19.801 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:19.756+0000 7f0cc7e2d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:18:19.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.814+0000 7f933772c640 1 -- 172.21.15.161:0/1557886904 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8ee31a26-d2c9-4975-a11c-447ea07dd1ba", "id": 5} v 0) v1 -- 0x7f9330072420 con 0x7f93300d06b0 2023-07-21T22:18:19.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.818+0000 7f9325ffb640 1 -- 172.21.15.161:0/1557886904 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8ee31a26-d2c9-4975-a11c-447ea07dd1ba", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f932c0128e0 con 0x7f93300d06b0 2023-07-21T22:18:19.863 INFO:teuthology.orchestra.run.smithi161.stdout:5 2023-07-21T22:18:19.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.818+0000 7f933772c640 1 -- 172.21.15.161:0/1557886904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93300d06b0 msgr2=0x7f933006ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:19.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.818+0000 7f933772c640 1 --2- 172.21.15.161:0/1557886904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93300d06b0 0x7f933006ab10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f932c007fd0 tx=0x7f932c001e80 comp rx=0 tx=0).stop 2023-07-21T22:18:19.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.818+0000 7f933772c640 1 -- 172.21.15.161:0/1557886904 shutdown_connections 2023-07-21T22:18:19.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.818+0000 7f933772c640 1 --2- 172.21.15.161:0/1557886904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9330153940 0x7f933015e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.818+0000 7f933772c640 1 --2- 172.21.15.161:0/1557886904 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93300d22e0 0x7f93300c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.818+0000 7f933772c640 1 --2- 172.21.15.161:0/1557886904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93300d06b0 0x7f933006ab10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:19.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.818+0000 7f933772c640 1 -- 172.21.15.161:0/1557886904 >> 172.21.15.161:0/1557886904 conn(0x7f93300659d0 msgr2=0x7f9330157780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:19.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.818+0000 7f933772c640 1 -- 172.21.15.161:0/1557886904 shutdown_connections 2023-07-21T22:18:19.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.818+0000 7f933772c640 1 -- 172.21.15.161:0/1557886904 wait complete. 2023-07-21T22:18:19.880 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:19.834+0000 7f941d284180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:18:19.882 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new c7cde6d1-0eed-4f00-b78b-0e1473dce186 6 2023-07-21T22:18:19.894 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:19.848+0000 7f0cc7e2d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:18:19.943 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:19.898+0000 7f941d284180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:18:19.957 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:19.912+0000 7f0cc7e2d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:18:20.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.974+0000 7f9a07bd2640 1 Processor -- start 2023-07-21T22:18:20.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.974+0000 7f9a07bd2640 1 -- start start 2023-07-21T22:18:20.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.978+0000 7f9a07bd2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9a000cedf0 0x7f9a000cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:20.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.978+0000 7f9a07bd2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a000cf770 con 0x7f9a000b1d40 2023-07-21T22:18:20.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.978+0000 7f9a07bd2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a000af780 con 0x7f9a00145900 2023-07-21T22:18:20.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.978+0000 7f9a07bd2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a000d0b40 con 0x7f9a000cedf0 2023-07-21T22:18:20.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.978+0000 7f9a0616f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9a000cedf0 0x7f9a000cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:20.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.978+0000 7f9a0616f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9a000cedf0 0x7f9a000cf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39772/0 (socket says 172.21.15.161:39772) 2023-07-21T22:18:20.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.978+0000 7f9a0616f640 1 -- 172.21.15.161:0/3399463951 learned_addr learned my addr 172.21.15.161:0/3399463951 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-07-21T22:18:20.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.978+0000 7f9a0596e640 1 --1- 172.21.15.161:0/3399463951 >> v1:172.21.15.161:6789/0 conn(0x7f9a00145900 0x7f9a000af070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:42066/0 (socket says 172.21.15.161:42066) 2023-07-21T22:18:20.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.978+0000 7f9a0616f640 1 -- 172.21.15.161:0/3399463951 >> v1:172.21.15.161:6789/0 conn(0x7f9a00145900 legacy=0x7f9a000af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.978+0000 7f9a0616f640 1 -- 172.21.15.161:0/3399463951 >> v1:172.21.15.6:6789/0 conn(0x7f9a000b1d40 legacy=0x7f9a000d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.978+0000 7f9a0616f640 1 -- 172.21.15.161:0/3399463951 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a000b2200 con 0x7f9a000cedf0 2023-07-21T22:18:20.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.978+0000 7f9a0616f640 1 --2- 172.21.15.161:0/3399463951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a000cedf0 0x7f9a000cf230 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f99f8009e50 tx=0x7f99f801c750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=590b8eba27621359 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:20.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.978+0000 7f9a0496c640 1 -- 172.21.15.161:0/3399463951 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f80a55f0 con 0x7f9a000cedf0 2023-07-21T22:18:20.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a0496c640 1 -- 172.21.15.161:0/3399463951 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f80a5750 con 0x7f9a000cedf0 2023-07-21T22:18:20.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a0496c640 1 -- 172.21.15.161:0/3399463951 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f80a5ae0 con 0x7f9a000cedf0 2023-07-21T22:18:20.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a07bd2640 1 -- 172.21.15.161:0/3399463951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a000cedf0 msgr2=0x7f9a000cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a07bd2640 1 --2- 172.21.15.161:0/3399463951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a000cedf0 0x7f9a000cf230 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f99f8009e50 tx=0x7f99f801c750 comp rx=0 tx=0).stop 2023-07-21T22:18:20.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a07bd2640 1 -- 172.21.15.161:0/3399463951 shutdown_connections 2023-07-21T22:18:20.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a07bd2640 1 --2- 172.21.15.161:0/3399463951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a000cedf0 0x7f9a000cf230 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a07bd2640 1 -- 172.21.15.161:0/3399463951 >> 172.21.15.161:0/3399463951 conn(0x7f9a000659d0 msgr2=0x7f9a0009b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:20.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a07bd2640 1 -- 172.21.15.161:0/3399463951 shutdown_connections 2023-07-21T22:18:20.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a07bd2640 1 -- 172.21.15.161:0/3399463951 wait complete. 2023-07-21T22:18:20.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a07bd2640 1 Processor -- start 2023-07-21T22:18:20.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a07bd2640 1 -- start start 2023-07-21T22:18:20.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a07bd2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a000b1d40 0x7f9a0014cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:20.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a07bd2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a000cedf0 0x7f9a000c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:20.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a07bd2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a00145900 0x7f9a000b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:20.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a07bd2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a000c8e80 con 0x7f9a000cedf0 2023-07-21T22:18:20.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a07bd2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a000b6ea0 con 0x7f9a000b1d40 2023-07-21T22:18:20.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a07bd2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a000b7180 con 0x7f9a00145900 2023-07-21T22:18:20.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a0596e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a000b1d40 0x7f9a0014cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:20.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a0596e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a000b1d40 0x7f9a0014cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39774/0 (socket says 172.21.15.161:39774) 2023-07-21T22:18:20.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a0596e640 1 -- 172.21.15.161:0/4071780390 learned_addr learned my addr 172.21.15.161:0/4071780390 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-07-21T22:18:20.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a0516d640 1 --2- 172.21.15.161:0/4071780390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a000cedf0 0x7f9a000c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:20.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.982+0000 7f9a0616f640 1 --2- 172.21.15.161:0/4071780390 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a00145900 0x7f9a000b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:20.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.986+0000 7f9a0596e640 1 -- 172.21.15.161:0/4071780390 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a00145900 msgr2=0x7f9a000b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.986+0000 7f9a0596e640 1 --2- 172.21.15.161:0/4071780390 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a00145900 0x7f9a000b5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.986+0000 7f9a0596e640 1 -- 172.21.15.161:0/4071780390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a000cedf0 msgr2=0x7f9a000c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.986+0000 7f9a0596e640 1 --2- 172.21.15.161:0/4071780390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a000cedf0 0x7f9a000c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.986+0000 7f9a0596e640 1 -- 172.21.15.161:0/4071780390 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f8009b30 con 0x7f9a000b1d40 2023-07-21T22:18:20.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.986+0000 7f9a0616f640 1 --2- 172.21.15.161:0/4071780390 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a00145900 0x7f9a000b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:20.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.986+0000 7f9a0516d640 1 --2- 172.21.15.161:0/4071780390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a000cedf0 0x7f9a000c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:20.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.986+0000 7f9a0596e640 1 --2- 172.21.15.161:0/4071780390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a000b1d40 0x7f9a0014cd60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00c780 tx=0x7f99fc00cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:20.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.986+0000 7f99f67fc640 1 -- 172.21.15.161:0/4071780390 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0072d0 con 0x7f9a000b1d40 2023-07-21T22:18:20.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.986+0000 7f99f67fc640 1 -- 172.21.15.161:0/4071780390 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc007430 con 0x7f9a000b1d40 2023-07-21T22:18:20.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.986+0000 7f99f67fc640 1 -- 172.21.15.161:0/4071780390 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0047f0 con 0x7f9a000b1d40 2023-07-21T22:18:20.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.986+0000 7f9a07bd2640 1 -- 172.21.15.161:0/4071780390 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a000b7460 con 0x7f9a000b1d40 2023-07-21T22:18:20.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.986+0000 7f9a07bd2640 1 -- 172.21.15.161:0/4071780390 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a000b7a20 con 0x7f9a000b1d40 2023-07-21T22:18:20.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.986+0000 7f99f67fc640 1 -- 172.21.15.161:0/4071780390 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f99fc004c50 con 0x7f9a000b1d40 2023-07-21T22:18:20.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.986+0000 7f99f67fc640 1 -- 172.21.15.161:0/4071780390 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f99fc00ae10 con 0x7f9a000b1d40 2023-07-21T22:18:20.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.986+0000 7f9a07bd2640 1 -- 172.21.15.161:0/4071780390 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a000678d0 con 0x7f9a000b1d40 2023-07-21T22:18:20.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:19.990+0000 7f99f67fc640 1 -- 172.21.15.161:0/4071780390 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f99fc018070 con 0x7f9a000b1d40 2023-07-21T22:18:20.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.070+0000 7f9a07bd2640 1 -- 172.21.15.161:0/4071780390 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c7cde6d1-0eed-4f00-b78b-0e1473dce186", "id": 6} v 0) v1 -- 0x7f9a000c5860 con 0x7f9a000b1d40 2023-07-21T22:18:20.116 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:20.070+0000 7f941d284180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:18:20.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.074+0000 7f99f67fc640 1 -- 172.21.15.161:0/4071780390 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c7cde6d1-0eed-4f00-b78b-0e1473dce186", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f99fc00a6b0 con 0x7f9a000b1d40 2023-07-21T22:18:20.119 INFO:teuthology.orchestra.run.smithi161.stdout:6 2023-07-21T22:18:20.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.074+0000 7f9a07bd2640 1 -- 172.21.15.161:0/4071780390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a000b1d40 msgr2=0x7f9a0014cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.074+0000 7f9a07bd2640 1 --2- 172.21.15.161:0/4071780390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a000b1d40 0x7f9a0014cd60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00c780 tx=0x7f99fc00cc40 comp rx=0 tx=0).stop 2023-07-21T22:18:20.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.074+0000 7f9a07bd2640 1 -- 172.21.15.161:0/4071780390 shutdown_connections 2023-07-21T22:18:20.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.074+0000 7f9a07bd2640 1 --2- 172.21.15.161:0/4071780390 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a00145900 0x7f9a000b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.074+0000 7f9a07bd2640 1 --2- 172.21.15.161:0/4071780390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a000cedf0 0x7f9a000c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.074+0000 7f9a07bd2640 1 --2- 172.21.15.161:0/4071780390 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a000b1d40 0x7f9a0014cd60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.074+0000 7f9a07bd2640 1 -- 172.21.15.161:0/4071780390 >> 172.21.15.161:0/4071780390 conn(0x7f9a000659d0 msgr2=0x7f9a0015e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:20.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.074+0000 7f9a07bd2640 1 -- 172.21.15.161:0/4071780390 shutdown_connections 2023-07-21T22:18:20.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.074+0000 7f9a07bd2640 1 -- 172.21.15.161:0/4071780390 wait complete. 2023-07-21T22:18:20.123 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:20.072+0000 7f0cc7e2d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:18:20.139 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 929a10f2-4c08-4e2e-b60f-9a89bca9443e 7 2023-07-21T22:18:20.189 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:20.146+0000 7f941d284180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:18:20.191 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:20.144+0000 7f0cc7e2d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:18:20.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.230+0000 7fcdb2ad8640 1 Processor -- start 2023-07-21T22:18:20.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.230+0000 7fcdb2ad8640 1 -- start start 2023-07-21T22:18:20.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.230+0000 7fcdb2ad8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcdac0d06b0 0x7fcdac0b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:20.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.230+0000 7fcdb2ad8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdac0b2410 con 0x7fcdac0b1f70 2023-07-21T22:18:20.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.230+0000 7fcdb2ad8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdac0b26f0 con 0x7fcdac145430 2023-07-21T22:18:20.279 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.230+0000 7fcdb2ad8640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdac0b29d0 con 0x7fcdac0d06b0 2023-07-21T22:18:20.279 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.234+0000 7fcdb0874640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcdac0d06b0 0x7fcdac0b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:20.279 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.234+0000 7fcdb0874640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcdac0d06b0 0x7fcdac0b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39786/0 (socket says 172.21.15.161:39786) 2023-07-21T22:18:20.280 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.234+0000 7fcdb0874640 1 -- 172.21.15.161:0/2621436376 learned_addr learned my addr 172.21.15.161:0/2621436376 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-07-21T22:18:20.280 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.234+0000 7fcdabfff640 1 --1- 172.21.15.161:0/2621436376 >> v1:172.21.15.161:6789/0 conn(0x7fcdac145430 0x7fcdac0b34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:42068/0 (socket says 172.21.15.161:42068) 2023-07-21T22:18:20.280 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.234+0000 7fcdb0874640 1 -- 172.21.15.161:0/2621436376 >> v1:172.21.15.161:6789/0 conn(0x7fcdac145430 legacy=0x7fcdac0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.281 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.234+0000 7fcdb0874640 1 -- 172.21.15.161:0/2621436376 >> v1:172.21.15.6:6789/0 conn(0x7fcdac0b1f70 legacy=0x7fcdac0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.281 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.234+0000 7fcdb0874640 1 -- 172.21.15.161:0/2621436376 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac0b2cb0 con 0x7fcdac0d06b0 2023-07-21T22:18:20.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.238+0000 7fcdb0874640 1 --2- 172.21.15.161:0/2621436376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdac0d06b0 0x7fcdac0b1a30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009870 tx=0x7fcda001cf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5e35923aa589c4b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:20.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.238+0000 7fcdab7fe640 1 -- 172.21.15.161:0/2621436376 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda00a95f0 con 0x7fcdac0d06b0 2023-07-21T22:18:20.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.238+0000 7fcdab7fe640 1 -- 172.21.15.161:0/2621436376 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda00a9750 con 0x7fcdac0d06b0 2023-07-21T22:18:20.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.238+0000 7fcdab7fe640 1 -- 172.21.15.161:0/2621436376 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda00a9ae0 con 0x7fcdac0d06b0 2023-07-21T22:18:20.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.238+0000 7fcdb2ad8640 1 -- 172.21.15.161:0/2621436376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdac0d06b0 msgr2=0x7fcdac0b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.238+0000 7fcdb2ad8640 1 --2- 172.21.15.161:0/2621436376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdac0d06b0 0x7fcdac0b1a30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009870 tx=0x7fcda001cf70 comp rx=0 tx=0).stop 2023-07-21T22:18:20.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.238+0000 7fcdb2ad8640 1 -- 172.21.15.161:0/2621436376 shutdown_connections 2023-07-21T22:18:20.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.238+0000 7fcdb2ad8640 1 --2- 172.21.15.161:0/2621436376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdac0d06b0 0x7fcdac0b1a30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.238+0000 7fcdb2ad8640 1 -- 172.21.15.161:0/2621436376 >> 172.21.15.161:0/2621436376 conn(0x7fcdac0659d0 msgr2=0x7fcdac09b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:20.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.238+0000 7fcdb2ad8640 1 -- 172.21.15.161:0/2621436376 shutdown_connections 2023-07-21T22:18:20.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.238+0000 7fcdb2ad8640 1 -- 172.21.15.161:0/2621436376 wait complete. 2023-07-21T22:18:20.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.238+0000 7fcdb2ad8640 1 Processor -- start 2023-07-21T22:18:20.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdb2ad8640 1 -- start start 2023-07-21T22:18:20.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdb2ad8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdac0b1f70 0x7fcdac0c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdb2ad8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdac0d06b0 0x7fcdac0c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdb2ad8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdac15bab0 0x7fcdac15d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdb2ad8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac1523c0 con 0x7fcdac0b1f70 2023-07-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdb2ad8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac15bfb0 con 0x7fcdac0d06b0 2023-07-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdb2ad8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac151a90 con 0x7fcdac15bab0 2023-07-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdabfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdac0d06b0 0x7fcdac0c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:20.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdabfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdac0d06b0 0x7fcdac0c4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39790/0 (socket says 172.21.15.161:39790) 2023-07-21T22:18:20.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdabfff640 1 -- 172.21.15.161:0/359017261 learned_addr learned my addr 172.21.15.161:0/359017261 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-07-21T22:18:20.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdb0874640 1 --2- 172.21.15.161:0/359017261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdac0b1f70 0x7fcdac0c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:20.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdb1075640 1 --2- 172.21.15.161:0/359017261 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdac15bab0 0x7fcdac15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:20.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdabfff640 1 -- 172.21.15.161:0/359017261 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdac15bab0 msgr2=0x7fcdac15d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdabfff640 1 --2- 172.21.15.161:0/359017261 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdac15bab0 0x7fcdac15d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdabfff640 1 -- 172.21.15.161:0/359017261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdac0b1f70 msgr2=0x7fcdac0c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdabfff640 1 --2- 172.21.15.161:0/359017261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdac0b1f70 0x7fcdac0c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdabfff640 1 -- 172.21.15.161:0/359017261 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda00094d0 con 0x7fcdac0d06b0 2023-07-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdb0874640 1 --2- 172.21.15.161:0/359017261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdac0b1f70 0x7fcdac0c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdabfff640 1 --2- 172.21.15.161:0/359017261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdac0d06b0 0x7fcdac0c4670 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800c490 tx=0x7fcd9800c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcda97fa640 1 -- 172.21.15.161:0/359017261 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd98007480 con 0x7fcdac0d06b0 2023-07-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcda97fa640 1 -- 172.21.15.161:0/359017261 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd980075e0 con 0x7fcdac0d06b0 2023-07-21T22:18:20.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcda97fa640 1 -- 172.21.15.161:0/359017261 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd98004a10 con 0x7fcdac0d06b0 2023-07-21T22:18:20.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdb2ad8640 1 -- 172.21.15.161:0/359017261 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac151d70 con 0x7fcdac0d06b0 2023-07-21T22:18:20.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcdb2ad8640 1 -- 172.21.15.161:0/359017261 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac0c5140 con 0x7fcdac0d06b0 2023-07-21T22:18:20.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcda97fa640 1 -- 172.21.15.161:0/359017261 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcd98012440 con 0x7fcdac0d06b0 2023-07-21T22:18:20.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.242+0000 7fcda97fa640 1 -- 172.21.15.161:0/359017261 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fcd98012d50 con 0x7fcdac0d06b0 2023-07-21T22:18:20.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.246+0000 7fcdb2ad8640 1 -- 172.21.15.161:0/359017261 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac0678d0 con 0x7fcdac0d06b0 2023-07-21T22:18:20.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.246+0000 7fcda97fa640 1 -- 172.21.15.161:0/359017261 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fcd98018070 con 0x7fcdac0d06b0 2023-07-21T22:18:20.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.310+0000 7fcdb2ad8640 1 -- 172.21.15.161:0/359017261 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "929a10f2-4c08-4e2e-b60f-9a89bca9443e", "id": 7} v 0) v1 -- 0x7fcdac0d2e80 con 0x7fcdac0d06b0 2023-07-21T22:18:20.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.318+0000 7fcda97fa640 1 -- 172.21.15.161:0/359017261 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "929a10f2-4c08-4e2e-b60f-9a89bca9443e", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcd980126f0 con 0x7fcdac0d06b0 2023-07-21T22:18:20.363 INFO:teuthology.orchestra.run.smithi161.stdout:7 2023-07-21T22:18:20.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.318+0000 7fcdb2ad8640 1 -- 172.21.15.161:0/359017261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdac0d06b0 msgr2=0x7fcdac0c4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.318+0000 7fcdb2ad8640 1 --2- 172.21.15.161:0/359017261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdac0d06b0 0x7fcdac0c4670 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800c490 tx=0x7fcd9800c950 comp rx=0 tx=0).stop 2023-07-21T22:18:20.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.318+0000 7fcdb2ad8640 1 -- 172.21.15.161:0/359017261 shutdown_connections 2023-07-21T22:18:20.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.318+0000 7fcdb2ad8640 1 --2- 172.21.15.161:0/359017261 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdac15bab0 0x7fcdac15d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.318+0000 7fcdb2ad8640 1 --2- 172.21.15.161:0/359017261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdac0d06b0 0x7fcdac0c4670 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.318+0000 7fcdb2ad8640 1 --2- 172.21.15.161:0/359017261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdac0b1f70 0x7fcdac0c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.318+0000 7fcdb2ad8640 1 -- 172.21.15.161:0/359017261 >> 172.21.15.161:0/359017261 conn(0x7fcdac0659d0 msgr2=0x7fcdac06ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:20.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.318+0000 7fcdb2ad8640 1 -- 172.21.15.161:0/359017261 shutdown_connections 2023-07-21T22:18:20.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-07-21T22:18:20.318+0000 7fcdb2ad8640 1 -- 172.21.15.161:0/359017261 wait complete. 2023-07-21T22:18:20.380 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-21T22:18:20.381 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-21T22:18:20.385 INFO:tasks.ceph.osd.0:Started 2023-07-21T22:18:20.385 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-21T22:18:20.385 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-21T22:18:20.389 INFO:tasks.ceph.osd.1:Started 2023-07-21T22:18:20.389 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-21T22:18:20.389 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-21T22:18:20.392 INFO:tasks.ceph.osd.2:Started 2023-07-21T22:18:20.393 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-21T22:18:20.393 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-21T22:18:20.398 INFO:tasks.ceph.osd.3:Started 2023-07-21T22:18:20.398 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-21T22:18:20.398 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-21T22:18:20.402 INFO:tasks.ceph.osd.4:Started 2023-07-21T22:18:20.402 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-21T22:18:20.402 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-21T22:18:20.405 INFO:tasks.ceph.osd.5:Started 2023-07-21T22:18:20.405 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-21T22:18:20.406 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-21T22:18:20.409 INFO:tasks.ceph.osd.6:Started 2023-07-21T22:18:20.409 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-21T22:18:20.409 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-21T22:18:20.412 INFO:tasks.ceph.osd.7:Started 2023-07-21T22:18:20.413 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:18:20.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.564+0000 7fce4b89c640 1 Processor -- start 2023-07-21T22:18:20.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.564+0000 7fce4b89c640 1 -- start start 2023-07-21T22:18:20.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.564+0000 7fce4b89c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce4415fd60 0x7fce440d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:20.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.564+0000 7fce4b89c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fce440d1850 0x7fce440d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:20.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.564+0000 7fce4b89c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce440ccaf0 con 0x7fce440b7c70 2023-07-21T22:18:20.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.564+0000 7fce4b89c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce440d1190 con 0x7fce440d1850 2023-07-21T22:18:20.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.564+0000 7fce4b89c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce44160600 con 0x7fce4415fd60 2023-07-21T22:18:20.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.564+0000 7fce49638640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fce440b7c70 0x7fce4415f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60976/0 (socket says 172.21.15.6:60976) 2023-07-21T22:18:20.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.564+0000 7fce49638640 1 -- 172.21.15.6:0/759703915 learned_addr learned my addr 172.21.15.6:0/759703915 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:20.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.564+0000 7fce49e39640 1 --2- 172.21.15.6:0/759703915 >> v2:172.21.15.6:3300/0 conn(0x7fce440d1850 0x7fce440d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:20.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.564+0000 7fce48e37640 1 --2- 172.21.15.6:0/759703915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce4415fd60 0x7fce440d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:20.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.564+0000 7fce3bfff640 1 -- 172.21.15.6:0/759703915 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346133234 0 0) 0x7fce440ccaf0 con 0x7fce440b7c70 2023-07-21T22:18:20.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.564+0000 7fce3bfff640 1 -- 172.21.15.6:0/759703915 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce30003530 con 0x7fce440b7c70 2023-07-21T22:18:20.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.568+0000 7fce49e39640 1 -- 172.21.15.6:0/759703915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce4415fd60 msgr2=0x7fce440d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:20.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.568+0000 7fce49e39640 1 --2- 172.21.15.6:0/759703915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce4415fd60 0x7fce440d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.568+0000 7fce49e39640 1 -- 172.21.15.6:0/759703915 >> v1:172.21.15.6:6789/0 conn(0x7fce440b7c70 legacy=0x7fce4415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.568+0000 7fce49e39640 1 -- 172.21.15.6:0/759703915 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce44160320 con 0x7fce440d1850 2023-07-21T22:18:20.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.568+0000 7fce48e37640 1 --2- 172.21.15.6:0/759703915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce4415fd60 0x7fce440d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:20.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.568+0000 7fce49e39640 1 --2- 172.21.15.6:0/759703915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce440d1850 0x7fce440d1da0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fce3c009dc0 tx=0x7fce3c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abd3298cb95aac7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:20.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.568+0000 7fce3bfff640 1 -- 172.21.15.6:0/759703915 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c0a59e0 con 0x7fce440d1850 2023-07-21T22:18:20.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.568+0000 7fce3bfff640 1 -- 172.21.15.6:0/759703915 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3c0a5b40 con 0x7fce440d1850 2023-07-21T22:18:20.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.568+0000 7fce3bfff640 1 -- 172.21.15.6:0/759703915 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c0ad440 con 0x7fce440d1850 2023-07-21T22:18:20.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.568+0000 7fce4b89c640 1 -- 172.21.15.6:0/759703915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce440d1850 msgr2=0x7fce440d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.568+0000 7fce4b89c640 1 --2- 172.21.15.6:0/759703915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce440d1850 0x7fce440d1da0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fce3c009dc0 tx=0x7fce3c01c900 comp rx=0 tx=0).stop 2023-07-21T22:18:20.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.568+0000 7fce4b89c640 1 -- 172.21.15.6:0/759703915 shutdown_connections 2023-07-21T22:18:20.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.568+0000 7fce4b89c640 1 --2- 172.21.15.6:0/759703915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce440d1850 0x7fce440d1da0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.568+0000 7fce4b89c640 1 --2- 172.21.15.6:0/759703915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce4415fd60 0x7fce440d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.568+0000 7fce4b89c640 1 -- 172.21.15.6:0/759703915 >> 172.21.15.6:0/759703915 conn(0x7fce440650b0 msgr2=0x7fce440654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:20.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.572+0000 7fce4b89c640 1 -- 172.21.15.6:0/759703915 shutdown_connections 2023-07-21T22:18:20.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.572+0000 7fce4b89c640 1 -- 172.21.15.6:0/759703915 wait complete. 2023-07-21T22:18:20.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.572+0000 7fce4b89c640 1 Processor -- start 2023-07-21T22:18:20.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.572+0000 7fce4b89c640 1 -- start start 2023-07-21T22:18:20.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.572+0000 7fce4b89c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce440b7c70 0x7fce440b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:20.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.572+0000 7fce4b89c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce440d1850 0x7fce440cea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:20.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.572+0000 7fce4b89c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce4415fd60 0x7fce4414af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:20.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.572+0000 7fce4b89c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4415c4d0 con 0x7fce4415fd60 2023-07-21T22:18:20.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.572+0000 7fce4b89c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce440ce640 con 0x7fce440d1850 2023-07-21T22:18:20.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.572+0000 7fce4b89c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4414c810 con 0x7fce440b7c70 2023-07-21T22:18:20.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.572+0000 7fce49e39640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce4415fd60 0x7fce4414af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:20.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.572+0000 7fce49638640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce440b7c70 0x7fce440b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:20.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.572+0000 7fce49e39640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce4415fd60 0x7fce4414af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36310/0 (socket says 172.21.15.6:36310) 2023-07-21T22:18:20.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.572+0000 7fce49e39640 1 -- 172.21.15.6:0/332311482 learned_addr learned my addr 172.21.15.6:0/332311482 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:20.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.572+0000 7fce48e37640 1 --2- 172.21.15.6:0/332311482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce440d1850 0x7fce440cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:20.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.572+0000 7fce49e39640 1 -- 172.21.15.6:0/332311482 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce440b7c70 msgr2=0x7fce440b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.572+0000 7fce49e39640 1 --2- 172.21.15.6:0/332311482 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce440b7c70 0x7fce440b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.572+0000 7fce49e39640 1 -- 172.21.15.6:0/332311482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce440d1850 msgr2=0x7fce440cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.572+0000 7fce49e39640 1 --2- 172.21.15.6:0/332311482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce440d1850 0x7fce440cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.572+0000 7fce49e39640 1 -- 172.21.15.6:0/332311482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce34009420 con 0x7fce4415fd60 2023-07-21T22:18:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.576+0000 7fce49e39640 1 --2- 172.21.15.6:0/332311482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce4415fd60 0x7fce4414af40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fce3c01afb0 tx=0x7fce3c0196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:20.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.576+0000 7fce39ffb640 1 -- 172.21.15.6:0/332311482 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c004240 con 0x7fce4415fd60 2023-07-21T22:18:20.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.576+0000 7fce39ffb640 1 -- 172.21.15.6:0/332311482 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3c0043a0 con 0x7fce4415fd60 2023-07-21T22:18:20.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.576+0000 7fce39ffb640 1 -- 172.21.15.6:0/332311482 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c004730 con 0x7fce4415fd60 2023-07-21T22:18:20.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.576+0000 7fce4b89c640 1 -- 172.21.15.6:0/332311482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3c009a70 con 0x7fce4415fd60 2023-07-21T22:18:20.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.576+0000 7fce4b89c640 1 -- 172.21.15.6:0/332311482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce440b6060 con 0x7fce4415fd60 2023-07-21T22:18:20.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.576+0000 7fce39ffb640 1 -- 172.21.15.6:0/332311482 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fce3c0b4030 con 0x7fce4415fd60 2023-07-21T22:18:20.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.576+0000 7fce39ffb640 1 -- 172.21.15.6:0/332311482 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fce3c0c0e20 con 0x7fce4415fd60 2023-07-21T22:18:20.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.576+0000 7fce4b89c640 1 -- 172.21.15.6:0/332311482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce440ce7b0 con 0x7fce4415fd60 2023-07-21T22:18:20.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.580+0000 7fce39ffb640 1 -- 172.21.15.6:0/332311482 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fce440ce7b0 con 0x7fce4415fd60 2023-07-21T22:18:20.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.636+0000 7fce4b89c640 1 -- 172.21.15.6:0/332311482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce440678d0 con 0x7fce4415fd60 2023-07-21T22:18:20.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.636+0000 7fce39ffb640 1 -- 172.21.15.6:0/332311482 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fce3c0c5060 con 0x7fce4415fd60 2023-07-21T22:18:20.683 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:18:20.683 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":10,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:18:20.314356+0000","last_up_change":"0.000000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:18:20.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.636+0000 7fce4b89c640 1 -- 172.21.15.6:0/332311482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce4415fd60 msgr2=0x7fce4414af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.636+0000 7fce4b89c640 1 --2- 172.21.15.6:0/332311482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce4415fd60 0x7fce4414af40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fce3c01afb0 tx=0x7fce3c0196a0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.636+0000 7fce4b89c640 1 -- 172.21.15.6:0/332311482 shutdown_connections 2023-07-21T22:18:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.636+0000 7fce4b89c640 1 --2- 172.21.15.6:0/332311482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce4415fd60 0x7fce4414af40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.636+0000 7fce4b89c640 1 --2- 172.21.15.6:0/332311482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce440d1850 0x7fce440cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.636+0000 7fce4b89c640 1 --2- 172.21.15.6:0/332311482 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce440b7c70 0x7fce440b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.636+0000 7fce4b89c640 1 -- 172.21.15.6:0/332311482 >> 172.21.15.6:0/332311482 conn(0x7fce440650b0 msgr2=0x7fce440d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.636+0000 7fce4b89c640 1 -- 172.21.15.6:0/332311482 shutdown_connections 2023-07-21T22:18:20.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:20.636+0000 7fce4b89c640 1 -- 172.21.15.6:0/332311482 wait complete. 2023-07-21T22:18:20.703 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-21T22:18:20.703 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-21T22:18:20.798 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-21T22:18:20.752+0000 7f093a53c640 -1 Falling back to public interface 2023-07-21T22:18:20.801 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-21T22:18:20.756+0000 7f5d9d520640 -1 Falling back to public interface 2023-07-21T22:18:20.818 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-21T22:18:20.772+0000 7f2fd8804640 -1 Falling back to public interface 2023-07-21T22:18:20.830 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-21T22:18:20.784+0000 7f924dd96640 -1 Falling back to public interface 2023-07-21T22:18:20.840 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:18:20.840 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:18:20.840 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:18:20.854 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-07-21T22:18:20.810+0000 7f90b677c640 -1 Falling back to public interface 2023-07-21T22:18:20.877 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:20.834+0000 7f941d284180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:18:20.882 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:18:20.882 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:18:20.882 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:18:20.930 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:20.884+0000 7f0cc7e2d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:18:21.008 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:20.966+0000 7f941d284180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:18:21.058 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-07-21T22:18:21.014+0000 7f1c10056640 -1 Falling back to public interface 2023-07-21T22:18:21.061 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-07-21T22:18:21.018+0000 7f176919f640 -1 Falling back to public interface 2023-07-21T22:18:21.070 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:21.024+0000 7f0cc7e2d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:18:21.071 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-07-21T22:18:21.026+0000 7f9771880640 -1 Falling back to public interface 2023-07-21T22:18:21.202 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:21.158+0000 7f941d284180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:18:21.264 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:21.216+0000 7f0cc7e2d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:18:21.274 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:21.230+0000 7f941d284180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:18:21.354 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:21.308+0000 7f0cc7e2d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:18:21.410 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:21.366+0000 7f941d284180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:18:21.499 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:21.452+0000 7f0cc7e2d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:18:21.509 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-21T22:18:21.644 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.596+0000 7faee359e640 1 Processor -- start 2023-07-21T22:18:21.645 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.596+0000 7faee359e640 1 -- start start 2023-07-21T22:18:21.645 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.600+0000 7faee359e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faee40b3750 0x7faee40cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:21.645 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.600+0000 7faee359e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7faee40cc890 0x7faee40cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:21.646 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.600+0000 7faee359e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee40b3b20 con 0x7faee40d0350 2023-07-21T22:18:21.646 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.600+0000 7faee359e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee40cdcc0 con 0x7faee40cc890 2023-07-21T22:18:21.646 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.600+0000 7faee359e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee40d07d0 con 0x7faee40b3750 2023-07-21T22:18:21.647 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.600+0000 7faee259c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faee40b3750 0x7faee40cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:21.647 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.600+0000 7faedbfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7faee40cc890 0x7faee40cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:21.647 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.600+0000 7faee259c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faee40b3750 0x7faee40cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:60140/0 (socket says 172.21.15.6:60140) 2023-07-21T22:18:21.647 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.600+0000 7faee259c640 1 -- 172.21.15.6:0/909006547 learned_addr learned my addr 172.21.15.6:0/909006547 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:21.648 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.600+0000 7faedbfff640 1 --2- 172.21.15.6:0/909006547 >> v2:172.21.15.161:3300/0 conn(0x7faee40cc890 0x7faee40cfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:43030/0 (socket says 172.21.15.6:43030) 2023-07-21T22:18:21.648 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.600+0000 7faee2d9d640 1 --1- 172.21.15.6:0/909006547 >> v1:172.21.15.161:6789/0 conn(0x7faee40d0350 0x7faee40cec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:53398/0 (socket says 172.21.15.6:53398) 2023-07-21T22:18:21.648 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.600+0000 7faee259c640 1 -- 172.21.15.6:0/909006547 >> v2:172.21.15.161:3300/0 conn(0x7faee40cc890 msgr2=0x7faee40cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:21.648 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.600+0000 7faee259c640 1 --2- 172.21.15.6:0/909006547 >> v2:172.21.15.161:3300/0 conn(0x7faee40cc890 0x7faee40cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:21.648 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.600+0000 7faee259c640 1 -- 172.21.15.6:0/909006547 >> v1:172.21.15.161:6789/0 conn(0x7faee40d0350 legacy=0x7faee40cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:21.649 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.600+0000 7faee259c640 1 -- 172.21.15.6:0/909006547 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee40cdeb0 con 0x7faee40b3750 2023-07-21T22:18:21.649 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.600+0000 7faedbfff640 1 --2- 172.21.15.6:0/909006547 >> v2:172.21.15.161:3300/0 conn(0x7faee40cc890 0x7faee40cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:21.649 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.600+0000 7faee1d9b640 1 -- 172.21.15.6:0/909006547 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334017834 0 0) 0x7faee40b3b20 con 0x7faee40d0350 2023-07-21T22:18:21.649 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.604+0000 7faee259c640 1 --2- 172.21.15.6:0/909006547 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faee40b3750 0x7faee40cd780 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faed4006fd0 tx=0x7faed401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70839d225f75cf21 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:21.650 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.604+0000 7faee1d9b640 1 -- 172.21.15.6:0/909006547 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed40ac640 con 0x7faee40b3750 2023-07-21T22:18:21.650 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.604+0000 7faee1d9b640 1 -- 172.21.15.6:0/909006547 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed40ac7a0 con 0x7faee40b3750 2023-07-21T22:18:21.650 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.604+0000 7faee1d9b640 1 -- 172.21.15.6:0/909006547 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed40acb30 con 0x7faee40b3750 2023-07-21T22:18:21.651 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.604+0000 7faee359e640 1 -- 172.21.15.6:0/909006547 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faee40b3750 msgr2=0x7faee40cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:21.651 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.604+0000 7faee359e640 1 --2- 172.21.15.6:0/909006547 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faee40b3750 0x7faee40cd780 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faed4006fd0 tx=0x7faed401c400 comp rx=0 tx=0).stop 2023-07-21T22:18:21.652 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.604+0000 7faee359e640 1 -- 172.21.15.6:0/909006547 shutdown_connections 2023-07-21T22:18:21.652 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.604+0000 7faee359e640 1 --2- 172.21.15.6:0/909006547 >> v2:172.21.15.161:3300/0 conn(0x7faee40cc890 0x7faee40cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:21.652 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.604+0000 7faee359e640 1 --2- 172.21.15.6:0/909006547 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faee40b3750 0x7faee40cd780 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:21.652 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.604+0000 7faee359e640 1 -- 172.21.15.6:0/909006547 >> 172.21.15.6:0/909006547 conn(0x7faee409b4d0 msgr2=0x7faee40d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:21.652 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.604+0000 7faee359e640 1 -- 172.21.15.6:0/909006547 shutdown_connections 2023-07-21T22:18:21.652 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.604+0000 7faee359e640 1 -- 172.21.15.6:0/909006547 wait complete. 2023-07-21T22:18:21.653 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.604+0000 7faee359e640 1 Processor -- start 2023-07-21T22:18:21.654 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.604+0000 7faee359e640 1 -- start start 2023-07-21T22:18:21.654 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faee359e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faee40b3750 0x7faee406aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:21.654 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faee359e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faee40cc890 0x7faee4152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:21.654 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faee359e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faee40d0350 0x7faee4154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:21.654 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faee359e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee4159390 con 0x7faee40d0350 2023-07-21T22:18:21.654 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faee359e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee41549d0 con 0x7faee40cc890 2023-07-21T22:18:21.655 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faee359e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee4159bf0 con 0x7faee40b3750 2023-07-21T22:18:21.655 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faee2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faee40d0350 0x7faee4154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:21.655 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faee2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faee40d0350 0x7faee4154490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36314/0 (socket says 172.21.15.6:36314) 2023-07-21T22:18:21.655 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faee2d9d640 1 -- 172.21.15.6:0/2817754047 learned_addr learned my addr 172.21.15.6:0/2817754047 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:21.655 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faedbfff640 1 --2- 172.21.15.6:0/2817754047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faee40cc890 0x7faee4152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:21.655 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faee259c640 1 --2- 172.21.15.6:0/2817754047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faee40b3750 0x7faee406aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:21.657 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faee2d9d640 1 -- 172.21.15.6:0/2817754047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faee40b3750 msgr2=0x7faee406aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:21.657 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faee2d9d640 1 --2- 172.21.15.6:0/2817754047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faee40b3750 0x7faee406aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:21.657 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faee2d9d640 1 -- 172.21.15.6:0/2817754047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faee40cc890 msgr2=0x7faee4152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:21.658 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faee2d9d640 1 --2- 172.21.15.6:0/2817754047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faee40cc890 0x7faee4152890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:21.658 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faee2d9d640 1 -- 172.21.15.6:0/2817754047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc009420 con 0x7faee40d0350 2023-07-21T22:18:21.658 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faee2d9d640 1 --2- 172.21.15.6:0/2817754047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faee40d0350 0x7faee4154490 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faedc001570 tx=0x7faedc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:21.658 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faedaffd640 1 -- 172.21.15.6:0/2817754047 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc00a640 con 0x7faee40d0350 2023-07-21T22:18:21.659 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faedaffd640 1 -- 172.21.15.6:0/2817754047 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc00a7c0 con 0x7faee40d0350 2023-07-21T22:18:21.659 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faee359e640 1 -- 172.21.15.6:0/2817754047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed4009480 con 0x7faee40d0350 2023-07-21T22:18:21.659 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faedaffd640 1 -- 172.21.15.6:0/2817754047 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc00ab70 con 0x7faee40d0350 2023-07-21T22:18:21.660 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faee359e640 1 -- 172.21.15.6:0/2817754047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee41595a0 con 0x7faee40d0350 2023-07-21T22:18:21.660 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faedaffd640 1 -- 172.21.15.6:0/2817754047 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faedc0070d0 con 0x7faee40d0350 2023-07-21T22:18:21.660 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faedaffd640 1 -- 172.21.15.6:0/2817754047 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7faedc012ad0 con 0x7faee40d0350 2023-07-21T22:18:21.660 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.608+0000 7faee359e640 1 -- 172.21.15.6:0/2817754047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee4073920 con 0x7faee40d0350 2023-07-21T22:18:21.661 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.612+0000 7faedaffd640 1 -- 172.21.15.6:0/2817754047 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7faedc018070 con 0x7faee40d0350 2023-07-21T22:18:21.716 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.668+0000 7faee359e640 1 -- 172.21.15.6:0/2817754047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faee4159d30 con 0x7faee40d0350 2023-07-21T22:18:21.717 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.672+0000 7faedaffd640 1 -- 172.21.15.6:0/2817754047 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7faedc007560 con 0x7faee40d0350 2023-07-21T22:18:21.717 INFO:teuthology.misc.health.smithi006.stdout: 2023-07-21T22:18:21.717 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":10,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:18:20.314356+0000","last_up_change":"0.000000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:18:21.718 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.672+0000 7faee359e640 1 -- 172.21.15.6:0/2817754047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faee40d0350 msgr2=0x7faee4154490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:21.719 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.672+0000 7faee359e640 1 --2- 172.21.15.6:0/2817754047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faee40d0350 0x7faee4154490 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faedc001570 tx=0x7faedc00cca0 comp rx=0 tx=0).stop 2023-07-21T22:18:21.719 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.672+0000 7faee359e640 1 -- 172.21.15.6:0/2817754047 shutdown_connections 2023-07-21T22:18:21.719 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.672+0000 7faee359e640 1 --2- 172.21.15.6:0/2817754047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faee40d0350 0x7faee4154490 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:21.719 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.672+0000 7faee359e640 1 --2- 172.21.15.6:0/2817754047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faee40cc890 0x7faee4152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:21.720 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.672+0000 7faee359e640 1 --2- 172.21.15.6:0/2817754047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faee40b3750 0x7faee406aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:21.720 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.672+0000 7faee359e640 1 -- 172.21.15.6:0/2817754047 >> 172.21.15.6:0/2817754047 conn(0x7faee409b4d0 msgr2=0x7faee40d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:21.721 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.672+0000 7faee359e640 1 -- 172.21.15.6:0/2817754047 shutdown_connections 2023-07-21T22:18:21.721 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:21.672+0000 7faee359e640 1 -- 172.21.15.6:0/2817754047 wait complete. 2023-07-21T22:18:21.734 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-21T22:18:22.083 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:22.038+0000 7f941d284180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:18:22.169 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:22.126+0000 7f941d284180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:18:22.213 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:22.164+0000 7f0cc7e2d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:18:22.304 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:22.256+0000 7f0cc7e2d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:18:22.358 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:22.314+0000 7f941d284180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:18:22.443 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:22.398+0000 7f941d284180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:18:22.503 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:22.456+0000 7f0cc7e2d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:18:22.592 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:22.544+0000 7f0cc7e2d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:18:22.724 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:22.678+0000 7f941d284180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:18:22.792 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:22.746+0000 7f941d284180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:18:22.891 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:22.844+0000 7f0cc7e2d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:18:22.963 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:18:22.916+0000 7f0cc7e2d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:18:23.816 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:23.770+0000 7f93c4c42640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-21T22:18:23.816 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:18:23.770+0000 7f93c4c42640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-21T22:18:24.652 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-21T22:18:24.604+0000 7f924dd96640 -1 osd.3 0 log_to_monitors true 2023-07-21T22:18:24.739 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-21T22:18:24.692+0000 7f093a53c640 -1 osd.0 0 log_to_monitors true 2023-07-21T22:18:24.746 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-21T22:18:24.700+0000 7f5d9d520640 -1 osd.2 0 log_to_monitors true 2023-07-21T22:18:24.757 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-07-21T22:18:24.714+0000 7f90b677c640 -1 osd.6 0 log_to_monitors true 2023-07-21T22:18:24.765 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-21T22:18:24.720+0000 7f2fd8804640 -1 osd.1 0 log_to_monitors true 2023-07-21T22:18:25.028 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-07-21T22:18:24.982+0000 7f9771880640 -1 osd.4 0 log_to_monitors true 2023-07-21T22:18:25.078 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-07-21T22:18:25.034+0000 7f176919f640 -1 osd.7 0 log_to_monitors true 2023-07-21T22:18:25.128 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-07-21T22:18:25.082+0000 7f1c10056640 -1 osd.5 0 log_to_monitors true 2023-07-21T22:18:26.924 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-07-21T22:18:26.878+0000 7f90b1efe640 -1 osd.6 0 waiting for initial osdmap 2023-07-21T22:18:26.945 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-07-21T22:18:26.902+0000 7f90aa543640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:18:28.121 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-21T22:18:28.072+0000 7f2fd3f88640 -1 osd.1 0 waiting for initial osdmap 2023-07-21T22:18:28.121 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-21T22:18:28.076+0000 7f9249518640 -1 osd.3 0 waiting for initial osdmap 2023-07-21T22:18:28.157 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-21T22:18:28.112+0000 7f2fcc5cd640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:18:28.157 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-21T22:18:28.112+0000 7f9241b5d640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:18:28.212 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-21T22:18:28.164+0000 7f5d98ca4640 -1 osd.2 0 waiting for initial osdmap 2023-07-21T22:18:28.237 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-21T22:18:28.192+0000 7f5d912e9640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:18:28.256 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-21T22:18:28.208+0000 7f0935cbe640 -1 osd.0 0 waiting for initial osdmap 2023-07-21T22:18:28.281 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-21T22:18:28.236+0000 7f092e303640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:18:28.541 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-21T22:18:28.676 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.628+0000 7f71a3740640 1 Processor -- start 2023-07-21T22:18:28.676 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.628+0000 7f71a3740640 1 -- start start 2023-07-21T22:18:28.677 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.632+0000 7f71a3740640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f719c0ce600 0x7f719c160480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:28.678 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.632+0000 7f71a3740640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f719c06e4d0 0x7f719c15b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:28.678 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.632+0000 7f71a3740640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c15d4d0 con 0x7f719c070d00 2023-07-21T22:18:28.678 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.632+0000 7f71a3740640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c15c710 con 0x7f719c0ce600 2023-07-21T22:18:28.678 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.632+0000 7f71a3740640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c15c9f0 con 0x7f719c06e4d0 2023-07-21T22:18:28.678 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.632+0000 7f71a14dc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f719c070d00 0x7f719c0cdef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51792/0 (socket says 172.21.15.6:51792) 2023-07-21T22:18:28.678 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.632+0000 7f71a14dc640 1 -- 172.21.15.6:0/744031523 learned_addr learned my addr 172.21.15.6:0/744031523 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:28.679 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.632+0000 7f71a0cdb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f719c0ce600 0x7f719c160480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:28.679 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.632+0000 7f71a1cdd640 1 --2- 172.21.15.6:0/744031523 >> v2:172.21.15.161:3300/0 conn(0x7f719c06e4d0 0x7f719c15b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:28.680 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.632+0000 7f7193fff640 1 -- 172.21.15.6:0/744031523 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420654907 0 0) 0x7f719c15d4d0 con 0x7f719c070d00 2023-07-21T22:18:28.680 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.632+0000 7f7193fff640 1 -- 172.21.15.6:0/744031523 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7188003530 con 0x7f719c070d00 2023-07-21T22:18:28.680 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.632+0000 7f71a0cdb640 1 -- 172.21.15.6:0/744031523 >> v2:172.21.15.161:3300/0 conn(0x7f719c06e4d0 msgr2=0x7f719c15b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:28.680 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.632+0000 7f71a0cdb640 1 --2- 172.21.15.6:0/744031523 >> v2:172.21.15.161:3300/0 conn(0x7f719c06e4d0 0x7f719c15b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:28.680 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.632+0000 7f71a0cdb640 1 -- 172.21.15.6:0/744031523 >> v1:172.21.15.6:6789/0 conn(0x7f719c070d00 legacy=0x7f719c0cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:28.680 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.632+0000 7f71a0cdb640 1 -- 172.21.15.6:0/744031523 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c15ccd0 con 0x7f719c0ce600 2023-07-21T22:18:28.680 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.632+0000 7f71a1cdd640 1 --2- 172.21.15.6:0/744031523 >> v2:172.21.15.161:3300/0 conn(0x7f719c06e4d0 0x7f719c15b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:28.681 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.636+0000 7f71a0cdb640 1 --2- 172.21.15.6:0/744031523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f719c0ce600 0x7f719c160480 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f719c0c97e0 tx=0x7f718c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df58b192f2850314 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:28.682 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.636+0000 7f7193fff640 1 -- 172.21.15.6:0/744031523 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c0ab600 con 0x7f719c0ce600 2023-07-21T22:18:28.682 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.636+0000 7f7193fff640 1 -- 172.21.15.6:0/744031523 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c0a7050 con 0x7f719c0ce600 2023-07-21T22:18:28.682 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.636+0000 7f7193fff640 1 -- 172.21.15.6:0/744031523 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c0ab980 con 0x7f719c0ce600 2023-07-21T22:18:28.682 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.636+0000 7f71a3740640 1 -- 172.21.15.6:0/744031523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f719c0ce600 msgr2=0x7f719c160480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:28.682 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.636+0000 7f71a3740640 1 --2- 172.21.15.6:0/744031523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f719c0ce600 0x7f719c160480 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f719c0c97e0 tx=0x7f718c01c430 comp rx=0 tx=0).stop 2023-07-21T22:18:28.683 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.636+0000 7f71a3740640 1 -- 172.21.15.6:0/744031523 shutdown_connections 2023-07-21T22:18:28.683 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.636+0000 7f71a3740640 1 --2- 172.21.15.6:0/744031523 >> v2:172.21.15.161:3300/0 conn(0x7f719c06e4d0 0x7f719c15b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:28.683 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.636+0000 7f71a3740640 1 --2- 172.21.15.6:0/744031523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f719c0ce600 0x7f719c160480 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:28.683 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.636+0000 7f71a3740640 1 -- 172.21.15.6:0/744031523 >> 172.21.15.6:0/744031523 conn(0x7f719c0cc7d0 msgr2=0x7f719c0cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:28.683 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.636+0000 7f71a3740640 1 -- 172.21.15.6:0/744031523 shutdown_connections 2023-07-21T22:18:28.684 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.636+0000 7f71a3740640 1 -- 172.21.15.6:0/744031523 wait complete. 2023-07-21T22:18:28.684 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.636+0000 7f71a3740640 1 Processor -- start 2023-07-21T22:18:28.684 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.636+0000 7f71a3740640 1 -- start start 2023-07-21T22:18:28.685 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a3740640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f719c06e4d0 0x7f719c152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:28.686 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a3740640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f719c070d00 0x7f719c0adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:28.686 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a3740640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f719c0ce600 0x7f719c151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:28.686 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a3740640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c152ad0 con 0x7f719c0ce600 2023-07-21T22:18:28.686 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a3740640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c151ec0 con 0x7f719c070d00 2023-07-21T22:18:28.686 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a3740640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c1521a0 con 0x7f719c06e4d0 2023-07-21T22:18:28.686 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a1cdd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f719c0ce600 0x7f719c151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:28.686 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a1cdd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f719c0ce600 0x7f719c151670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52582/0 (socket says 172.21.15.6:52582) 2023-07-21T22:18:28.687 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a1cdd640 1 -- 172.21.15.6:0/3430685712 learned_addr learned my addr 172.21.15.6:0/3430685712 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:28.687 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a0cdb640 1 --2- 172.21.15.6:0/3430685712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f719c070d00 0x7f719c0adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:28.687 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a14dc640 1 --2- 172.21.15.6:0/3430685712 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f719c06e4d0 0x7f719c152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:28.687 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a1cdd640 1 -- 172.21.15.6:0/3430685712 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f719c06e4d0 msgr2=0x7f719c152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:28.687 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a1cdd640 1 --2- 172.21.15.6:0/3430685712 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f719c06e4d0 0x7f719c152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:28.687 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a1cdd640 1 -- 172.21.15.6:0/3430685712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f719c070d00 msgr2=0x7f719c0adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:28.687 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a1cdd640 1 --2- 172.21.15.6:0/3430685712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f719c070d00 0x7f719c0adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:28.688 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a1cdd640 1 -- 172.21.15.6:0/3430685712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718c009420 con 0x7f719c0ce600 2023-07-21T22:18:28.688 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a14dc640 1 --2- 172.21.15.6:0/3430685712 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f719c06e4d0 0x7f719c152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:28.689 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a1cdd640 1 --2- 172.21.15.6:0/3430685712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f719c0ce600 0x7f719c151670 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7194007df0 tx=0x7f719400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:28.689 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f7191ffb640 1 -- 172.21.15.6:0/3430685712 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71940039a0 con 0x7f719c0ce600 2023-07-21T22:18:28.689 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f7191ffb640 1 -- 172.21.15.6:0/3430685712 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719400f040 con 0x7f719c0ce600 2023-07-21T22:18:28.689 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f7191ffb640 1 -- 172.21.15.6:0/3430685712 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194003d40 con 0x7f719c0ce600 2023-07-21T22:18:28.689 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a3740640 1 -- 172.21.15.6:0/3430685712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719c152480 con 0x7f719c0ce600 2023-07-21T22:18:28.689 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a3740640 1 -- 172.21.15.6:0/3430685712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719c151bb0 con 0x7f719c0ce600 2023-07-21T22:18:28.689 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f71a3740640 1 -- 172.21.15.6:0/3430685712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c152c40 con 0x7f719c0ce600 2023-07-21T22:18:28.690 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.640+0000 7f7191ffb640 1 -- 172.21.15.6:0/3430685712 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7f7194004030 con 0x7f719c0ce600 2023-07-21T22:18:28.690 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.644+0000 7f7191ffb640 1 --2- 172.21.15.6:0/3430685712 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f71800661f0 0x7f71800686a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:28.690 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.644+0000 7f7191ffb640 1 -- 172.21.15.6:0/3430685712 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7f71940830d0 con 0x7f719c0ce600 2023-07-21T22:18:28.690 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.644+0000 7f71a14dc640 1 --2- 172.21.15.6:0/3430685712 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f71800661f0 0x7f71800686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:28.691 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.644+0000 7f71a14dc640 1 --2- 172.21.15.6:0/3430685712 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f71800661f0 0x7f71800686a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f71980011f0 tx=0x7f7198009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:28.694 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.648+0000 7f7191ffb640 1 -- 172.21.15.6:0/3430685712 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f71940514c0 con 0x7f719c0ce600 2023-07-21T22:18:28.829 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-07-21T22:18:28.786+0000 7f976d004640 -1 osd.4 0 waiting for initial osdmap 2023-07-21T22:18:28.853 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-07-21T22:18:28.810+0000 7f9765649640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:18:28.854 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.808+0000 7f71a3740640 1 -- 172.21.15.6:0/3430685712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f719c04d7d0 con 0x7f719c0ce600 2023-07-21T22:18:28.854 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.808+0000 7f7191ffb640 1 -- 172.21.15.6:0/3430685712 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7554 (secure 0 0 0) 0x7f719401a090 con 0x7f719c0ce600 2023-07-21T22:18:28.854 INFO:teuthology.misc.health.smithi006.stdout: 2023-07-21T22:18:28.855 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":14,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:18:27.830211+0000","last_up_change":"2023-07-21T22:18:27.830211+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:18:28.856 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.808+0000 7f71a3740640 1 -- 172.21.15.6:0/3430685712 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f71800661f0 msgr2=0x7f71800686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:28.856 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.808+0000 7f71a3740640 1 --2- 172.21.15.6:0/3430685712 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f71800661f0 0x7f71800686a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f71980011f0 tx=0x7f7198009040 comp rx=0 tx=0).stop 2023-07-21T22:18:28.857 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.808+0000 7f71a3740640 1 -- 172.21.15.6:0/3430685712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f719c0ce600 msgr2=0x7f719c151670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:28.857 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.808+0000 7f71a3740640 1 --2- 172.21.15.6:0/3430685712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f719c0ce600 0x7f719c151670 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7194007df0 tx=0x7f719400d4a0 comp rx=0 tx=0).stop 2023-07-21T22:18:28.857 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.808+0000 7f71a3740640 1 -- 172.21.15.6:0/3430685712 shutdown_connections 2023-07-21T22:18:28.857 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.808+0000 7f71a3740640 1 --2- 172.21.15.6:0/3430685712 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f71800661f0 0x7f71800686a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:28.857 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.808+0000 7f71a3740640 1 --2- 172.21.15.6:0/3430685712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f719c0ce600 0x7f719c151670 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:28.857 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.808+0000 7f71a3740640 1 --2- 172.21.15.6:0/3430685712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f719c070d00 0x7f719c0adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:28.857 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.808+0000 7f71a3740640 1 --2- 172.21.15.6:0/3430685712 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f719c06e4d0 0x7f719c152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:28.858 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.808+0000 7f71a3740640 1 -- 172.21.15.6:0/3430685712 >> 172.21.15.6:0/3430685712 conn(0x7f719c0cc7d0 msgr2=0x7f719c15d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:28.858 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.808+0000 7f71a3740640 1 -- 172.21.15.6:0/3430685712 shutdown_connections 2023-07-21T22:18:28.858 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:28.808+0000 7f71a3740640 1 -- 172.21.15.6:0/3430685712 wait complete. 2023-07-21T22:18:28.873 DEBUG:teuthology.misc:1 of 8 OSDs are up 2023-07-21T22:18:28.875 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-07-21T22:18:28.830+0000 7f1764921640 -1 osd.7 0 waiting for initial osdmap 2023-07-21T22:18:28.909 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-07-21T22:18:28.866+0000 7f175cf66640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:18:28.988 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-07-21T22:18:28.946+0000 7f1c0b7d8640 -1 osd.5 0 waiting for initial osdmap 2023-07-21T22:18:29.017 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-07-21T22:18:28.974+0000 7f1c03e1d640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:18:35.679 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-21T22:18:35.824 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.776+0000 7f1a10c76640 1 Processor -- start 2023-07-21T22:18:35.825 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.776+0000 7f1a10c76640 1 -- start start 2023-07-21T22:18:35.827 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.780+0000 7f1a10c76640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1a0c06c290 0x7f1a0c1635a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:35.827 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.780+0000 7f1a10c76640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0c0c8bc0 con 0x7f1a0c159080 2023-07-21T22:18:35.828 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.780+0000 7f1a10c76640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0c159b60 con 0x7f1a0c15c210 2023-07-21T22:18:35.828 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.780+0000 7f1a10c76640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0c15c6f0 con 0x7f1a0c06c290 2023-07-21T22:18:35.828 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.780+0000 7f1a0bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1a0c06c290 0x7f1a0c1635a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:35.828 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.780+0000 7f1a0b7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1a0c159080 0x7f1a0c159450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51804/0 (socket says 172.21.15.6:51804) 2023-07-21T22:18:35.829 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.780+0000 7f1a0b7fe640 1 -- 172.21.15.6:0/1592943472 learned_addr learned my addr 172.21.15.6:0/1592943472 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:35.829 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.780+0000 7f1a0bfff640 1 -- 172.21.15.6:0/1592943472 >> v1:172.21.15.161:6789/0 conn(0x7f1a0c15c210 legacy=0x7f1a0c06bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:35.829 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.780+0000 7f1a0bfff640 1 -- 172.21.15.6:0/1592943472 >> v1:172.21.15.6:6789/0 conn(0x7f1a0c159080 legacy=0x7f1a0c159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:35.830 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.780+0000 7f1a0a7fc640 1 -- 172.21.15.6:0/1592943472 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2320893775 0 0) 0x7f1a0c0c8bc0 con 0x7f1a0c159080 2023-07-21T22:18:35.830 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.780+0000 7f1a0bfff640 1 -- 172.21.15.6:0/1592943472 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c15c9d0 con 0x7f1a0c06c290 2023-07-21T22:18:35.831 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.784+0000 7f1a0bfff640 1 --2- 172.21.15.6:0/1592943472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a0c06c290 0x7f1a0c1635a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009d90 tx=0x7f1a0401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcf6bfcce392351 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:35.832 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.784+0000 7f1a0a7fc640 1 -- 172.21.15.6:0/1592943472 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a040a59e0 con 0x7f1a0c06c290 2023-07-21T22:18:35.832 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.784+0000 7f1a0a7fc640 1 -- 172.21.15.6:0/1592943472 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a040a5b40 con 0x7f1a0c06c290 2023-07-21T22:18:35.832 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.784+0000 7f1a0a7fc640 1 -- 172.21.15.6:0/1592943472 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a040ad440 con 0x7f1a0c06c290 2023-07-21T22:18:35.832 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.784+0000 7f1a10c76640 1 -- 172.21.15.6:0/1592943472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a0c06c290 msgr2=0x7f1a0c1635a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:35.833 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.784+0000 7f1a10c76640 1 --2- 172.21.15.6:0/1592943472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a0c06c290 0x7f1a0c1635a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009d90 tx=0x7f1a0401c920 comp rx=0 tx=0).stop 2023-07-21T22:18:35.833 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.784+0000 7f1a10c76640 1 -- 172.21.15.6:0/1592943472 shutdown_connections 2023-07-21T22:18:35.833 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.784+0000 7f1a10c76640 1 --2- 172.21.15.6:0/1592943472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a0c06c290 0x7f1a0c1635a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:35.833 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.784+0000 7f1a10c76640 1 -- 172.21.15.6:0/1592943472 >> 172.21.15.6:0/1592943472 conn(0x7f1a0c0ca7c0 msgr2=0x7f1a0c0cabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:35.833 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.784+0000 7f1a10c76640 1 -- 172.21.15.6:0/1592943472 shutdown_connections 2023-07-21T22:18:35.833 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.784+0000 7f1a10c76640 1 -- 172.21.15.6:0/1592943472 wait complete. 2023-07-21T22:18:35.835 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.784+0000 7f1a10c76640 1 Processor -- start 2023-07-21T22:18:35.835 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.784+0000 7f1a10c76640 1 -- start start 2023-07-21T22:18:35.835 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a10c76640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a0c06c290 0x7f1a0c14b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:35.835 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a10c76640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a0c159080 0x7f1a0c151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:35.835 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a10c76640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a0c15c210 0x7f1a0c151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:35.835 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a10c76640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0b1bc0 con 0x7f1a0c15c210 2023-07-21T22:18:35.836 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a10c76640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c14bb00 con 0x7f1a0c06c290 2023-07-21T22:18:35.836 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a10c76640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c070540 con 0x7f1a0c159080 2023-07-21T22:18:35.836 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a0bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a0c15c210 0x7f1a0c151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:35.836 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a0bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a0c15c210 0x7f1a0c151bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52606/0 (socket says 172.21.15.6:52606) 2023-07-21T22:18:35.837 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a0bfff640 1 -- 172.21.15.6:0/2335122932 learned_addr learned my addr 172.21.15.6:0/2335122932 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:35.837 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a0b7fe640 1 --2- 172.21.15.6:0/2335122932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a0c06c290 0x7f1a0c14b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:35.837 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a0affd640 1 --2- 172.21.15.6:0/2335122932 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a0c159080 0x7f1a0c151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:35.837 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a0bfff640 1 -- 172.21.15.6:0/2335122932 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a0c159080 msgr2=0x7f1a0c151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:35.838 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a0bfff640 1 --2- 172.21.15.6:0/2335122932 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a0c159080 0x7f1a0c151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:35.838 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a0bfff640 1 -- 172.21.15.6:0/2335122932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a0c06c290 msgr2=0x7f1a0c14b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:35.838 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a0bfff640 1 --2- 172.21.15.6:0/2335122932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a0c06c290 0x7f1a0c14b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:35.838 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a0bfff640 1 -- 172.21.15.6:0/2335122932 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a04009a70 con 0x7f1a0c15c210 2023-07-21T22:18:35.839 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a0affd640 1 --2- 172.21.15.6:0/2335122932 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a0c159080 0x7f1a0c151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:35.839 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a0b7fe640 1 --2- 172.21.15.6:0/2335122932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a0c06c290 0x7f1a0c14b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:35.839 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a0bfff640 1 --2- 172.21.15.6:0/2335122932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a0c15c210 0x7f1a0c151bd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a04019530 tx=0x7f1a040196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:35.840 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f19f3fff640 1 -- 172.21.15.6:0/2335122932 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a040adc80 con 0x7f1a0c15c210 2023-07-21T22:18:35.840 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f19f3fff640 1 -- 172.21.15.6:0/2335122932 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a040adde0 con 0x7f1a0c15c210 2023-07-21T22:18:35.840 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f19f3fff640 1 -- 172.21.15.6:0/2335122932 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a040b8620 con 0x7f1a0c15c210 2023-07-21T22:18:35.841 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a10c76640 1 -- 172.21.15.6:0/2335122932 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0c070820 con 0x7f1a0c15c210 2023-07-21T22:18:35.841 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a10c76640 1 -- 172.21.15.6:0/2335122932 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0c070de0 con 0x7f1a0c15c210 2023-07-21T22:18:35.842 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f1a10c76640 1 -- 172.21.15.6:0/2335122932 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a0c0b1d30 con 0x7f1a0c15c210 2023-07-21T22:18:35.842 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.788+0000 7f19f3fff640 1 -- 172.21.15.6:0/2335122932 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1a040b8780 con 0x7f1a0c15c210 2023-07-21T22:18:35.842 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.792+0000 7f19f3fff640 1 --2- 172.21.15.6:0/2335122932 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f19f8066280 0x7f19f8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:35.842 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.792+0000 7f19f3fff640 1 -- 172.21.15.6:0/2335122932 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1a0411f300 con 0x7f1a0c15c210 2023-07-21T22:18:35.842 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.792+0000 7f1a0b7fe640 1 --2- 172.21.15.6:0/2335122932 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f19f8066280 0x7f19f8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:35.843 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.792+0000 7f1a0b7fe640 1 --2- 172.21.15.6:0/2335122932 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f19f8066280 0x7f19f8068730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f19fc000f70 tx=0x7f19fc007c60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:35.843 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.796+0000 7f19f3fff640 1 -- 172.21.15.6:0/2335122932 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1a0c0b1d30 con 0x7f1a0c15c210 2023-07-21T22:18:36.002 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.956+0000 7f1a10c76640 1 -- 172.21.15.6:0/2335122932 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a0c0b1d00 con 0x7f1a0c15c210 2023-07-21T22:18:36.002 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.956+0000 7f19f3fff640 1 -- 172.21.15.6:0/2335122932 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12778 (secure 0 0 0) 0x7f1a040eccb0 con 0x7f1a0c15c210 2023-07-21T22:18:36.003 INFO:teuthology.misc.health.smithi006.stdout: 2023-07-21T22:18:36.003 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":19,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:18:33.119518+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:18:36.005 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.960+0000 7f1a10c76640 1 -- 172.21.15.6:0/2335122932 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f19f8066280 msgr2=0x7f19f8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:36.005 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.960+0000 7f1a10c76640 1 --2- 172.21.15.6:0/2335122932 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f19f8066280 0x7f19f8068730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f19fc000f70 tx=0x7f19fc007c60 comp rx=0 tx=0).stop 2023-07-21T22:18:36.005 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.960+0000 7f1a10c76640 1 -- 172.21.15.6:0/2335122932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a0c15c210 msgr2=0x7f1a0c151bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:36.005 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.960+0000 7f1a10c76640 1 --2- 172.21.15.6:0/2335122932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a0c15c210 0x7f1a0c151bd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a04019530 tx=0x7f1a040196c0 comp rx=0 tx=0).stop 2023-07-21T22:18:36.005 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.960+0000 7f1a10c76640 1 -- 172.21.15.6:0/2335122932 shutdown_connections 2023-07-21T22:18:36.006 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.960+0000 7f1a10c76640 1 --2- 172.21.15.6:0/2335122932 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f19f8066280 0x7f19f8068730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:36.006 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.960+0000 7f1a10c76640 1 --2- 172.21.15.6:0/2335122932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a0c15c210 0x7f1a0c151bd0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:36.006 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.960+0000 7f1a10c76640 1 --2- 172.21.15.6:0/2335122932 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a0c159080 0x7f1a0c151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:36.006 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.960+0000 7f1a10c76640 1 --2- 172.21.15.6:0/2335122932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a0c06c290 0x7f1a0c14b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:36.006 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.960+0000 7f1a10c76640 1 -- 172.21.15.6:0/2335122932 >> 172.21.15.6:0/2335122932 conn(0x7f1a0c0ca7c0 msgr2=0x7f1a0c156740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:36.006 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.960+0000 7f1a10c76640 1 -- 172.21.15.6:0/2335122932 shutdown_connections 2023-07-21T22:18:36.006 INFO:teuthology.misc.health.smithi006.stderr:2023-07-21T22:18:35.960+0000 7f1a10c76640 1 -- 172.21.15.6:0/2335122932 wait complete. 2023-07-21T22:18:36.022 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-21T22:18:36.023 INFO:tasks.ceph:Creating RBD pool 2023-07-21T22:18:36.023 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-21T22:18:36.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.116+0000 7fca6a9d2640 1 Processor -- start 2023-07-21T22:18:36.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.116+0000 7fca6a9d2640 1 -- start start 2023-07-21T22:18:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.120+0000 7fca6a9d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca6406ba20 0x7fca6406ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.120+0000 7fca6a9d2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fca6415bfd0 0x7fca6415c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.120+0000 7fca6a9d2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6415f6e0 con 0x7fca640b1a20 2023-07-21T22:18:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.120+0000 7fca6a9d2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca640cc450 con 0x7fca6415bfd0 2023-07-21T22:18:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.120+0000 7fca6a9d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca640b1f70 con 0x7fca6406ba20 2023-07-21T22:18:36.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.120+0000 7fca691cf640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fca640b1a20 0x7fca6406bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51810/0 (socket says 172.21.15.6:51810) 2023-07-21T22:18:36.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.120+0000 7fca691cf640 1 -- 172.21.15.6:0/2524094231 learned_addr learned my addr 172.21.15.6:0/2524094231 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:36.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.120+0000 7fca6a1d1640 1 --2- 172.21.15.6:0/2524094231 >> v2:172.21.15.161:3300/0 conn(0x7fca6415bfd0 0x7fca6415c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.120+0000 7fca699d0640 1 --2- 172.21.15.6:0/2524094231 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca6406ba20 0x7fca6406ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.120+0000 7fca689ce640 1 -- 172.21.15.6:0/2524094231 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997040116 0 0) 0x7fca6415f6e0 con 0x7fca640b1a20 2023-07-21T22:18:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.120+0000 7fca689ce640 1 -- 172.21.15.6:0/2524094231 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca50003530 con 0x7fca640b1a20 2023-07-21T22:18:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.120+0000 7fca6a1d1640 1 -- 172.21.15.6:0/2524094231 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca6406ba20 msgr2=0x7fca6406ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.120+0000 7fca6a1d1640 1 --2- 172.21.15.6:0/2524094231 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca6406ba20 0x7fca6406ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.120+0000 7fca6a1d1640 1 -- 172.21.15.6:0/2524094231 >> v1:172.21.15.6:6789/0 conn(0x7fca640b1a20 legacy=0x7fca6406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.120+0000 7fca6a1d1640 1 -- 172.21.15.6:0/2524094231 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca640b2250 con 0x7fca6415bfd0 2023-07-21T22:18:36.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.124+0000 7fca6a1d1640 1 --2- 172.21.15.6:0/2524094231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca6415bfd0 0x7fca6415c430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca5c009d90 tx=0x7fca5c01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbae00144a5a57b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:36.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.124+0000 7fca689ce640 1 -- 172.21.15.6:0/2524094231 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c0a5950 con 0x7fca6415bfd0 2023-07-21T22:18:36.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.124+0000 7fca689ce640 1 -- 172.21.15.6:0/2524094231 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5c0a5ab0 con 0x7fca6415bfd0 2023-07-21T22:18:36.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.124+0000 7fca689ce640 1 -- 172.21.15.6:0/2524094231 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c0a5e20 con 0x7fca6415bfd0 2023-07-21T22:18:36.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.124+0000 7fca6a9d2640 1 -- 172.21.15.6:0/2524094231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca6415bfd0 msgr2=0x7fca6415c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:36.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.124+0000 7fca6a9d2640 1 --2- 172.21.15.6:0/2524094231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca6415bfd0 0x7fca6415c430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca5c009d90 tx=0x7fca5c01c890 comp rx=0 tx=0).stop 2023-07-21T22:18:36.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.124+0000 7fca6a9d2640 1 -- 172.21.15.6:0/2524094231 shutdown_connections 2023-07-21T22:18:36.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.124+0000 7fca6a9d2640 1 --2- 172.21.15.6:0/2524094231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca6415bfd0 0x7fca6415c430 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:36.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.124+0000 7fca6a9d2640 1 --2- 172.21.15.6:0/2524094231 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca6406ba20 0x7fca6406ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:36.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.124+0000 7fca6a9d2640 1 -- 172.21.15.6:0/2524094231 >> 172.21.15.6:0/2524094231 conn(0x7fca640cffa0 msgr2=0x7fca640d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:36.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.124+0000 7fca6a9d2640 1 -- 172.21.15.6:0/2524094231 shutdown_connections 2023-07-21T22:18:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.124+0000 7fca6a9d2640 1 -- 172.21.15.6:0/2524094231 wait complete. 2023-07-21T22:18:36.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.124+0000 7fca6a9d2640 1 Processor -- start 2023-07-21T22:18:36.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.124+0000 7fca6a9d2640 1 -- start start 2023-07-21T22:18:36.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.124+0000 7fca6a9d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca6406ba20 0x7fca6414f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:36.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.124+0000 7fca6a9d2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca640b1a20 0x7fca6414d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:36.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.124+0000 7fca6a9d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca6415bfd0 0x7fca640b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:36.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.124+0000 7fca6a9d2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca640b0990 con 0x7fca6415bfd0 2023-07-21T22:18:36.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.124+0000 7fca6a9d2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca640b00a0 con 0x7fca640b1a20 2023-07-21T22:18:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.124+0000 7fca6a9d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca64157c50 con 0x7fca6406ba20 2023-07-21T22:18:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.128+0000 7fca6a1d1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca6415bfd0 0x7fca640b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.128+0000 7fca6a1d1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca6415bfd0 0x7fca640b0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52612/0 (socket says 172.21.15.6:52612) 2023-07-21T22:18:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.128+0000 7fca6a1d1640 1 -- 172.21.15.6:0/1380742529 learned_addr learned my addr 172.21.15.6:0/1380742529 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.128+0000 7fca691cf640 1 --2- 172.21.15.6:0/1380742529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca640b1a20 0x7fca6414d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:36.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.128+0000 7fca699d0640 1 --2- 172.21.15.6:0/1380742529 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca6406ba20 0x7fca6414f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:36.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.128+0000 7fca6a1d1640 1 -- 172.21.15.6:0/1380742529 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca6406ba20 msgr2=0x7fca6414f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:36.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.128+0000 7fca6a1d1640 1 --2- 172.21.15.6:0/1380742529 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca6406ba20 0x7fca6414f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.128+0000 7fca6a1d1640 1 -- 172.21.15.6:0/1380742529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca640b1a20 msgr2=0x7fca6414d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.128+0000 7fca6a1d1640 1 --2- 172.21.15.6:0/1380742529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca640b1a20 0x7fca6414d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.128+0000 7fca6a1d1640 1 -- 172.21.15.6:0/1380742529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c009a70 con 0x7fca6415bfd0 2023-07-21T22:18:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.128+0000 7fca699d0640 1 --2- 172.21.15.6:0/1380742529 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca6406ba20 0x7fca6414f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.128+0000 7fca6a1d1640 1 --2- 172.21.15.6:0/1380742529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca6415bfd0 0x7fca640b0e20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fca5c01a4c0 tx=0x7fca5c019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.128+0000 7fca5a7fc640 1 -- 172.21.15.6:0/1380742529 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c003db0 con 0x7fca6415bfd0 2023-07-21T22:18:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.128+0000 7fca5a7fc640 1 -- 172.21.15.6:0/1380742529 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5c0a58d0 con 0x7fca6415bfd0 2023-07-21T22:18:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.128+0000 7fca5a7fc640 1 -- 172.21.15.6:0/1380742529 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5c004260 con 0x7fca6415bfd0 2023-07-21T22:18:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.128+0000 7fca6a9d2640 1 -- 172.21.15.6:0/1380742529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca640b0340 con 0x7fca6415bfd0 2023-07-21T22:18:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.128+0000 7fca6a9d2640 1 -- 172.21.15.6:0/1380742529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca64151e20 con 0x7fca6415bfd0 2023-07-21T22:18:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.128+0000 7fca6a9d2640 1 -- 172.21.15.6:0/1380742529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca640b0b00 con 0x7fca6415bfd0 2023-07-21T22:18:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.128+0000 7fca5a7fc640 1 -- 172.21.15.6:0/1380742529 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fca5c0b4070 con 0x7fca6415bfd0 2023-07-21T22:18:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.128+0000 7fca5a7fc640 1 --2- 172.21.15.6:0/1380742529 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fca48066280 0x7fca48068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.132+0000 7fca5a7fc640 1 -- 172.21.15.6:0/1380742529 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fca5c11e710 con 0x7fca6415bfd0 2023-07-21T22:18:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.132+0000 7fca699d0640 1 --2- 172.21.15.6:0/1380742529 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fca48066280 0x7fca48068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:36.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.132+0000 7fca699d0640 1 --2- 172.21.15.6:0/1380742529 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fca48066280 0x7fca48068730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fca641f7e40 tx=0x7fca60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:36.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.132+0000 7fca5a7fc640 1 -- 172.21.15.6:0/1380742529 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fca5c0ec050 con 0x7fca6415bfd0 2023-07-21T22:18:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:36.292+0000 7fca6a9d2640 1 -- 172.21.15.6:0/1380742529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fca6404e020 con 0x7fca6415bfd0 2023-07-21T22:18:37.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.264+0000 7fca5a7fc640 1 -- 172.21.15.6:0/1380742529 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v20) v1 ==== 109+0+0 (secure 0 0 0) 0x7fca5c0ef670 con 0x7fca6415bfd0 2023-07-21T22:18:37.310 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'rbd' created 2023-07-21T22:18:37.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.264+0000 7fca6a9d2640 1 -- 172.21.15.6:0/1380742529 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fca48066280 msgr2=0x7fca48068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:37.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.264+0000 7fca6a9d2640 1 --2- 172.21.15.6:0/1380742529 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fca48066280 0x7fca48068730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fca641f7e40 tx=0x7fca60008040 comp rx=0 tx=0).stop 2023-07-21T22:18:37.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.264+0000 7fca6a9d2640 1 -- 172.21.15.6:0/1380742529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca6415bfd0 msgr2=0x7fca640b0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:37.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.264+0000 7fca6a9d2640 1 --2- 172.21.15.6:0/1380742529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca6415bfd0 0x7fca640b0e20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fca5c01a4c0 tx=0x7fca5c019630 comp rx=0 tx=0).stop 2023-07-21T22:18:37.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.268+0000 7fca6a9d2640 1 -- 172.21.15.6:0/1380742529 shutdown_connections 2023-07-21T22:18:37.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.268+0000 7fca6a9d2640 1 --2- 172.21.15.6:0/1380742529 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fca48066280 0x7fca48068730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:37.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.268+0000 7fca6a9d2640 1 --2- 172.21.15.6:0/1380742529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca6415bfd0 0x7fca640b0e20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:37.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.268+0000 7fca6a9d2640 1 --2- 172.21.15.6:0/1380742529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca640b1a20 0x7fca6414d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:37.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.268+0000 7fca6a9d2640 1 --2- 172.21.15.6:0/1380742529 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fca6406ba20 0x7fca6414f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:37.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.268+0000 7fca6a9d2640 1 -- 172.21.15.6:0/1380742529 >> 172.21.15.6:0/1380742529 conn(0x7fca640cffa0 msgr2=0x7fca6406d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:37.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.268+0000 7fca6a9d2640 1 -- 172.21.15.6:0/1380742529 shutdown_connections 2023-07-21T22:18:37.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.268+0000 7fca6a9d2640 1 -- 172.21.15.6:0/1380742529 wait complete. 2023-07-21T22:18:37.336 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-21T22:18:37.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.436+0000 7fd9bb619640 1 Processor -- start 2023-07-21T22:18:37.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.436+0000 7fd9bb619640 1 -- start start 2023-07-21T22:18:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.440+0000 7fd9bb619640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd9b4069430 0x7fd9b4069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.440+0000 7fd9bb619640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9b40af2b0 0x7fd9b415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.440+0000 7fd9bb619640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b4159d70 con 0x7fd9b4070f30 2023-07-21T22:18:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.440+0000 7fd9bb619640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b4069d40 con 0x7fd9b4069430 2023-07-21T22:18:37.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.440+0000 7fd9bb619640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b40c9c60 con 0x7fd9b40af2b0 2023-07-21T22:18:37.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.440+0000 7fd9b8bb4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd9b4070f30 0x7fd9b40ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41578/0 (socket says 172.21.15.6:41578) 2023-07-21T22:18:37.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.440+0000 7fd9b8bb4640 1 -- 172.21.15.6:0/944392195 learned_addr learned my addr 172.21.15.6:0/944392195 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:37.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.440+0000 7fd9b9bb6640 1 --2- 172.21.15.6:0/944392195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9b40af2b0 0x7fd9b415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.440+0000 7fd9b93b5640 1 --2- 172.21.15.6:0/944392195 >> v2:172.21.15.161:3300/0 conn(0x7fd9b4069430 0x7fd9b4069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.440+0000 7fd9abfff640 1 -- 172.21.15.6:0/944392195 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275370868 0 0) 0x7fd9a4001120 con 0x7fd9b4070f30 2023-07-21T22:18:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.440+0000 7fd9abfff640 1 -- 172.21.15.6:0/944392195 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9a0003530 con 0x7fd9b4070f30 2023-07-21T22:18:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.440+0000 7fd9b9bb6640 1 -- 172.21.15.6:0/944392195 >> v2:172.21.15.161:3300/0 conn(0x7fd9b4069430 msgr2=0x7fd9b4069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.440+0000 7fd9b9bb6640 1 --2- 172.21.15.6:0/944392195 >> v2:172.21.15.161:3300/0 conn(0x7fd9b4069430 0x7fd9b4069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.440+0000 7fd9b9bb6640 1 -- 172.21.15.6:0/944392195 >> v1:172.21.15.6:6789/0 conn(0x7fd9b4070f30 legacy=0x7fd9b40ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:37.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.440+0000 7fd9b9bb6640 1 -- 172.21.15.6:0/944392195 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b40c9f40 con 0x7fd9b40af2b0 2023-07-21T22:18:37.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.444+0000 7fd9b9bb6640 1 --2- 172.21.15.6:0/944392195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9b40af2b0 0x7fd9b415a1f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac009d90 tx=0x7fd9ac01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fb11a126989b511 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:37.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.444+0000 7fd9abfff640 1 -- 172.21.15.6:0/944392195 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac0a5920 con 0x7fd9b40af2b0 2023-07-21T22:18:37.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.444+0000 7fd9abfff640 1 -- 172.21.15.6:0/944392195 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ac0a5a80 con 0x7fd9b40af2b0 2023-07-21T22:18:37.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.444+0000 7fd9abfff640 1 -- 172.21.15.6:0/944392195 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac0a5df0 con 0x7fd9b40af2b0 2023-07-21T22:18:37.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.444+0000 7fd9bb619640 1 -- 172.21.15.6:0/944392195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9b40af2b0 msgr2=0x7fd9b415a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:37.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.444+0000 7fd9bb619640 1 --2- 172.21.15.6:0/944392195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9b40af2b0 0x7fd9b415a1f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac009d90 tx=0x7fd9ac01c950 comp rx=0 tx=0).stop 2023-07-21T22:18:37.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.444+0000 7fd9bb619640 1 -- 172.21.15.6:0/944392195 shutdown_connections 2023-07-21T22:18:37.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.444+0000 7fd9bb619640 1 --2- 172.21.15.6:0/944392195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9b40af2b0 0x7fd9b415a1f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:37.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.444+0000 7fd9bb619640 1 --2- 172.21.15.6:0/944392195 >> v2:172.21.15.161:3300/0 conn(0x7fd9b4069430 0x7fd9b4069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:37.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.444+0000 7fd9bb619640 1 -- 172.21.15.6:0/944392195 >> 172.21.15.6:0/944392195 conn(0x7fd9b40cde90 msgr2=0x7fd9b40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:37.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.444+0000 7fd9bb619640 1 -- 172.21.15.6:0/944392195 shutdown_connections 2023-07-21T22:18:37.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.444+0000 7fd9bb619640 1 -- 172.21.15.6:0/944392195 wait complete. 2023-07-21T22:18:37.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.444+0000 7fd9bb619640 1 Processor -- start 2023-07-21T22:18:37.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9bb619640 1 -- start start 2023-07-21T22:18:37.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9bb619640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9b4069430 0x7fd9b40c42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:37.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9bb619640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9b4070f30 0x7fd9b414a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:37.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9bb619640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9b40af2b0 0x7fd9b4158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:37.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9bb619640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b40c47f0 con 0x7fd9b4069430 2023-07-21T22:18:37.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9bb619640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b40c3210 con 0x7fd9b4070f30 2023-07-21T22:18:37.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9bb619640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b40c34f0 con 0x7fd9b40af2b0 2023-07-21T22:18:37.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9b93b5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9b4069430 0x7fd9b40c42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:37.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9b93b5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9b4069430 0x7fd9b40c42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54478/0 (socket says 172.21.15.6:54478) 2023-07-21T22:18:37.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9b93b5640 1 -- 172.21.15.6:0/4087359317 learned_addr learned my addr 172.21.15.6:0/4087359317 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:37.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9b8bb4640 1 --2- 172.21.15.6:0/4087359317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9b4070f30 0x7fd9b414a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:37.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9b9bb6640 1 --2- 172.21.15.6:0/4087359317 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9b40af2b0 0x7fd9b4158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:37.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9b93b5640 1 -- 172.21.15.6:0/4087359317 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9b40af2b0 msgr2=0x7fd9b4158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:37.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9b93b5640 1 --2- 172.21.15.6:0/4087359317 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9b40af2b0 0x7fd9b4158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:37.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9b93b5640 1 -- 172.21.15.6:0/4087359317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9b4070f30 msgr2=0x7fd9b414a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:37.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9b93b5640 1 --2- 172.21.15.6:0/4087359317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9b4070f30 0x7fd9b414a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:37.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9b93b5640 1 -- 172.21.15.6:0/4087359317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac009a70 con 0x7fd9b4069430 2023-07-21T22:18:37.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9b93b5640 1 --2- 172.21.15.6:0/4087359317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9b4069430 0x7fd9b40c42b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000e870 tx=0x7fd9b000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:37.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9a9ffb640 1 -- 172.21.15.6:0/4087359317 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0009510 con 0x7fd9b4069430 2023-07-21T22:18:37.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9a9ffb640 1 -- 172.21.15.6:0/4087359317 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b000eec0 con 0x7fd9b4069430 2023-07-21T22:18:37.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9bb619640 1 -- 172.21.15.6:0/4087359317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b40c37d0 con 0x7fd9b4069430 2023-07-21T22:18:37.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9a9ffb640 1 -- 172.21.15.6:0/4087359317 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b000cb40 con 0x7fd9b4069430 2023-07-21T22:18:37.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9bb619640 1 -- 172.21.15.6:0/4087359317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b40c3d90 con 0x7fd9b4069430 2023-07-21T22:18:37.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.448+0000 7fd9bb619640 1 -- 172.21.15.6:0/4087359317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b40678d0 con 0x7fd9b4069430 2023-07-21T22:18:37.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.452+0000 7fd9a9ffb640 1 -- 172.21.15.6:0/4087359317 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd9b000cca0 con 0x7fd9b4069430 2023-07-21T22:18:37.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.452+0000 7fd9a9ffb640 1 --2- 172.21.15.6:0/4087359317 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd998066280 0x7fd998068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:37.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.452+0000 7fd9a9ffb640 1 -- 172.21.15.6:0/4087359317 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fd9b00839e0 con 0x7fd9b4069430 2023-07-21T22:18:37.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.452+0000 7fd9b8bb4640 1 --2- 172.21.15.6:0/4087359317 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd998066280 0x7fd998068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:37.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.452+0000 7fd9b8bb4640 1 --2- 172.21.15.6:0/4087359317 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd998066280 0x7fd998068730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4156ba0 tx=0x7fd9a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:37.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.456+0000 7fd9a9ffb640 1 -- 172.21.15.6:0/4087359317 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd9b0051280 con 0x7fd9b4069430 2023-07-21T22:18:37.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:37.616+0000 7fd9bb619640 1 -- 172.21.15.6:0/4087359317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd9b40aeb80 con 0x7fd9b4069430 2023-07-21T22:18:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.268+0000 7fd9a9ffb640 1 -- 172.21.15.6:0/4087359317 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v21) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd9b00548a0 con 0x7fd9b4069430 2023-07-21T22:18:38.317 INFO:teuthology.orchestra.run.smithi006.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-21T22:18:38.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.272+0000 7fd9bb619640 1 -- 172.21.15.6:0/4087359317 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd998066280 msgr2=0x7fd998068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:38.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.272+0000 7fd9bb619640 1 --2- 172.21.15.6:0/4087359317 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd998066280 0x7fd998068730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4156ba0 tx=0x7fd9a4009040 comp rx=0 tx=0).stop 2023-07-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.272+0000 7fd9bb619640 1 -- 172.21.15.6:0/4087359317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9b4069430 msgr2=0x7fd9b40c42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.272+0000 7fd9bb619640 1 --2- 172.21.15.6:0/4087359317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9b4069430 0x7fd9b40c42b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000e870 tx=0x7fd9b000ec70 comp rx=0 tx=0).stop 2023-07-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.272+0000 7fd9bb619640 1 -- 172.21.15.6:0/4087359317 shutdown_connections 2023-07-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.272+0000 7fd9bb619640 1 --2- 172.21.15.6:0/4087359317 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9b40af2b0 0x7fd9b4158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.272+0000 7fd9bb619640 1 --2- 172.21.15.6:0/4087359317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9b4070f30 0x7fd9b414a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.272+0000 7fd9bb619640 1 --2- 172.21.15.6:0/4087359317 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd998066280 0x7fd998068730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.272+0000 7fd9bb619640 1 --2- 172.21.15.6:0/4087359317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9b4069430 0x7fd9b40c42b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.272+0000 7fd9bb619640 1 -- 172.21.15.6:0/4087359317 >> 172.21.15.6:0/4087359317 conn(0x7fd9b40cde90 msgr2=0x7fd9b406b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:38.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.272+0000 7fd9bb619640 1 -- 172.21.15.6:0/4087359317 shutdown_connections 2023-07-21T22:18:38.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.272+0000 7fd9bb619640 1 -- 172.21.15.6:0/4087359317 wait complete. 2023-07-21T22:18:38.344 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-21T22:18:38.345 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-21T22:18:38.345 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-21T22:18:38.349 INFO:tasks.ceph.mds.a:Started 2023-07-21T22:18:38.349 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-21T22:18:38.350 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-21T22:18:38.353 INFO:tasks.ceph.mds.c:Started 2023-07-21T22:18:38.353 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-21T22:18:38.353 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-21T22:18:38.357 INFO:tasks.ceph.mds.b:Started 2023-07-21T22:18:38.358 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-21T22:18:38.358 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-21T22:18:38.361 INFO:tasks.ceph.mds.d:Started 2023-07-21T22:18:38.362 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-21T22:18:38.363 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:18:38.452 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-07-21T22:18:38.453 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-21T22:18:38.467 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-07-21T22:18:38.468 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2023-07-21T22:18:38.472 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-07-21T22:18:38.426+0000 7f5da5148640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6836/0: (98) Address already in use 2023-07-21T22:18:38.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.468+0000 7f9a282d8640 1 Processor -- start 2023-07-21T22:18:38.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.468+0000 7f9a282d8640 1 -- start start 2023-07-21T22:18:38.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.472+0000 7f9a282d8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a200b7c70 0x7f9a200d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:38.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.472+0000 7f9a282d8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9a2015fd60 0x7f9a200d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:38.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.472+0000 7f9a282d8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a200ccaf0 con 0x7f9a200d1850 2023-07-21T22:18:38.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.472+0000 7f9a282d8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a200d1190 con 0x7f9a2015fd60 2023-07-21T22:18:38.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.472+0000 7f9a282d8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20160600 con 0x7f9a200b7c70 2023-07-21T22:18:38.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.472+0000 7f9a25873640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9a200d1850 0x7f9a2015f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41604/0 (socket says 172.21.15.6:41604) 2023-07-21T22:18:38.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.472+0000 7f9a25873640 1 -- 172.21.15.6:0/2812627236 learned_addr learned my addr 172.21.15.6:0/2812627236 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:38.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.472+0000 7f9a26875640 1 --2- 172.21.15.6:0/2812627236 >> v2:172.21.15.6:3300/0 conn(0x7f9a2015fd60 0x7f9a200d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:38.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.472+0000 7f9a26074640 1 --2- 172.21.15.6:0/2812627236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a200b7c70 0x7f9a200d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:38.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.472+0000 7f9a26875640 1 -- 172.21.15.6:0/2812627236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a200b7c70 msgr2=0x7f9a200d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:38.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.472+0000 7f9a26875640 1 --2- 172.21.15.6:0/2812627236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a200b7c70 0x7f9a200d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.472+0000 7f9a26875640 1 -- 172.21.15.6:0/2812627236 >> v1:172.21.15.6:6789/0 conn(0x7f9a200d1850 legacy=0x7f9a2015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:38.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.472+0000 7f9a26875640 1 -- 172.21.15.6:0/2812627236 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a20160320 con 0x7f9a2015fd60 2023-07-21T22:18:38.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.472+0000 7f9a25072640 1 -- 172.21.15.6:0/2812627236 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576763827 0 0) 0x7f9a200ccaf0 con 0x7f9a200d1850 2023-07-21T22:18:38.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.476+0000 7f9a26875640 1 --2- 172.21.15.6:0/2812627236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a2015fd60 0x7f9a200d1da0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009dc0 tx=0x7f9a1801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43533fba8fae2711 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:38.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.476+0000 7f9a25072640 1 -- 172.21.15.6:0/2812627236 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a180a59e0 con 0x7f9a2015fd60 2023-07-21T22:18:38.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.476+0000 7f9a25072640 1 -- 172.21.15.6:0/2812627236 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a180a5b40 con 0x7f9a2015fd60 2023-07-21T22:18:38.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.476+0000 7f9a25072640 1 -- 172.21.15.6:0/2812627236 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a180ad440 con 0x7f9a2015fd60 2023-07-21T22:18:38.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.476+0000 7f9a282d8640 1 -- 172.21.15.6:0/2812627236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a2015fd60 msgr2=0x7f9a200d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:38.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.476+0000 7f9a282d8640 1 --2- 172.21.15.6:0/2812627236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a2015fd60 0x7f9a200d1da0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009dc0 tx=0x7f9a1801c900 comp rx=0 tx=0).stop 2023-07-21T22:18:38.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.476+0000 7f9a282d8640 1 -- 172.21.15.6:0/2812627236 shutdown_connections 2023-07-21T22:18:38.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.476+0000 7f9a282d8640 1 --2- 172.21.15.6:0/2812627236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a2015fd60 0x7f9a200d1da0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.476+0000 7f9a282d8640 1 --2- 172.21.15.6:0/2812627236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a200b7c70 0x7f9a200d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.476+0000 7f9a282d8640 1 -- 172.21.15.6:0/2812627236 >> 172.21.15.6:0/2812627236 conn(0x7f9a200650b0 msgr2=0x7f9a200654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:38.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.476+0000 7f9a282d8640 1 -- 172.21.15.6:0/2812627236 shutdown_connections 2023-07-21T22:18:38.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.476+0000 7f9a282d8640 1 -- 172.21.15.6:0/2812627236 wait complete. 2023-07-21T22:18:38.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.476+0000 7f9a282d8640 1 Processor -- start 2023-07-21T22:18:38.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.476+0000 7f9a282d8640 1 -- start start 2023-07-21T22:18:38.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a282d8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a200b7c70 0x7f9a201515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:38.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a282d8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a200d1850 0x7f9a2015e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:38.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a282d8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a2015fd60 0x7f9a2015e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:38.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a282d8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20156220 con 0x7f9a200b7c70 2023-07-21T22:18:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a282d8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2015edd0 con 0x7f9a200d1850 2023-07-21T22:18:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a282d8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2015c2d0 con 0x7f9a2015fd60 2023-07-21T22:18:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a26074640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a200b7c70 0x7f9a201515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a26074640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a200b7c70 0x7f9a201515e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54522/0 (socket says 172.21.15.6:54522) 2023-07-21T22:18:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a26074640 1 -- 172.21.15.6:0/3924447305 learned_addr learned my addr 172.21.15.6:0/3924447305 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a25873640 1 --2- 172.21.15.6:0/3924447305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a200d1850 0x7f9a2015e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a26875640 1 --2- 172.21.15.6:0/3924447305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a2015fd60 0x7f9a2015e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a26074640 1 -- 172.21.15.6:0/3924447305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a2015fd60 msgr2=0x7f9a2015e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:38.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a26074640 1 --2- 172.21.15.6:0/3924447305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a2015fd60 0x7f9a2015e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a26074640 1 -- 172.21.15.6:0/3924447305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a200d1850 msgr2=0x7f9a2015e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:38.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a26074640 1 --2- 172.21.15.6:0/3924447305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a200d1850 0x7f9a2015e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a26074640 1 -- 172.21.15.6:0/3924447305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a18009a70 con 0x7f9a200b7c70 2023-07-21T22:18:38.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a26875640 1 --2- 172.21.15.6:0/3924447305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a2015fd60 0x7f9a2015e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:38.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a26074640 1 --2- 172.21.15.6:0/3924447305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a200b7c70 0x7f9a201515e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00e870 tx=0x7f9a1c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:38.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a16ffd640 1 -- 172.21.15.6:0/3924447305 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c009510 con 0x7f9a200b7c70 2023-07-21T22:18:38.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a16ffd640 1 -- 172.21.15.6:0/3924447305 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c00eec0 con 0x7f9a200b7c70 2023-07-21T22:18:38.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a16ffd640 1 -- 172.21.15.6:0/3924447305 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c00cb40 con 0x7f9a200b7c70 2023-07-21T22:18:38.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a282d8640 1 -- 172.21.15.6:0/3924447305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2015c5b0 con 0x7f9a200b7c70 2023-07-21T22:18:38.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a282d8640 1 -- 172.21.15.6:0/3924447305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2015cb70 con 0x7f9a200b7c70 2023-07-21T22:18:38.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a282d8640 1 -- 172.21.15.6:0/3924447305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a200b4300 con 0x7f9a200b7c70 2023-07-21T22:18:38.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.480+0000 7f9a16ffd640 1 -- 172.21.15.6:0/3924447305 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9a1c00cca0 con 0x7f9a200b7c70 2023-07-21T22:18:38.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.484+0000 7f9a16ffd640 1 --2- 172.21.15.6:0/3924447305 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a040662b0 0x7f9a04068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:38.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.484+0000 7f9a16ffd640 1 -- 172.21.15.6:0/3924447305 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9a1c083a40 con 0x7f9a200b7c70 2023-07-21T22:18:38.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.484+0000 7f9a25873640 1 --2- 172.21.15.6:0/3924447305 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a040662b0 0x7f9a04068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:38.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.484+0000 7f9a25873640 1 --2- 172.21.15.6:0/3924447305 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a040662b0 0x7f9a04068760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9a2015f130 tx=0x7f9a10007d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:38.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.488+0000 7f9a16ffd640 1 -- 172.21.15.6:0/3924447305 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a1c051200 con 0x7f9a200b7c70 2023-07-21T22:18:38.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.644+0000 7f9a282d8640 1 -- 172.21.15.6:0/3924447305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a200678d0 con 0x7f9a200b7c70 2023-07-21T22:18:38.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.644+0000 7f9a16ffd640 1 -- 172.21.15.6:0/3924447305 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+14577 (secure 0 0 0) 0x7f9a1c017090 con 0x7f9a200b7c70 2023-07-21T22:18:38.693 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:18:38.693 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:18:38.264116+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:18:38.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.648+0000 7f9a282d8640 1 -- 172.21.15.6:0/3924447305 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a040662b0 msgr2=0x7f9a04068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:38.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.648+0000 7f9a282d8640 1 --2- 172.21.15.6:0/3924447305 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a040662b0 0x7f9a04068760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9a2015f130 tx=0x7f9a10007d10 comp rx=0 tx=0).stop 2023-07-21T22:18:38.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.648+0000 7f9a282d8640 1 -- 172.21.15.6:0/3924447305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a200b7c70 msgr2=0x7f9a201515e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:38.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.648+0000 7f9a282d8640 1 --2- 172.21.15.6:0/3924447305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a200b7c70 0x7f9a201515e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00e870 tx=0x7f9a1c00ec70 comp rx=0 tx=0).stop 2023-07-21T22:18:38.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.648+0000 7f9a282d8640 1 -- 172.21.15.6:0/3924447305 shutdown_connections 2023-07-21T22:18:38.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.648+0000 7f9a282d8640 1 --2- 172.21.15.6:0/3924447305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a2015fd60 0x7f9a2015e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.648+0000 7f9a282d8640 1 --2- 172.21.15.6:0/3924447305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a200d1850 0x7f9a2015e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.648+0000 7f9a282d8640 1 --2- 172.21.15.6:0/3924447305 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a040662b0 0x7f9a04068760 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.648+0000 7f9a282d8640 1 --2- 172.21.15.6:0/3924447305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a200b7c70 0x7f9a201515e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.648+0000 7f9a282d8640 1 -- 172.21.15.6:0/3924447305 >> 172.21.15.6:0/3924447305 conn(0x7f9a200650b0 msgr2=0x7f9a200b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:38.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.648+0000 7f9a282d8640 1 -- 172.21.15.6:0/3924447305 shutdown_connections 2023-07-21T22:18:38.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.648+0000 7f9a282d8640 1 -- 172.21.15.6:0/3924447305 wait complete. 2023-07-21T22:18:38.713 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:18:38.714 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:18:38.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.816+0000 7fdf1580b640 1 Processor -- start 2023-07-21T22:18:38.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.816+0000 7fdf1580b640 1 -- start start 2023-07-21T22:18:38.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.816+0000 7fdf1580b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdf100aeb40 0x7fdf1015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:38.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.816+0000 7fdf1580b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf10159440 0x7fdf100c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:38.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.816+0000 7fdf1580b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf101532b0 con 0x7fdf100aef10 2023-07-21T22:18:38.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.816+0000 7fdf1580b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf100ca6f0 con 0x7fdf10159440 2023-07-21T22:18:38.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.816+0000 7fdf1580b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf101599d0 con 0x7fdf100aeb40 2023-07-21T22:18:38.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.816+0000 7fdf0f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf10159440 0x7fdf100c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:38.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.816+0000 7fdf0f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf10159440 0x7fdf100c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54524/0 (socket says 172.21.15.6:54524) 2023-07-21T22:18:38.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.816+0000 7fdf0f7fe640 1 -- 172.21.15.6:0/3098644115 learned_addr learned my addr 172.21.15.6:0/3098644115 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:38.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.816+0000 7fdf0effd640 1 --2- 172.21.15.6:0/3098644115 >> v2:172.21.15.161:3300/0 conn(0x7fdf100aeb40 0x7fdf1015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:38.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.820+0000 7fdf0f7fe640 1 -- 172.21.15.6:0/3098644115 >> v2:172.21.15.161:3300/0 conn(0x7fdf100aeb40 msgr2=0x7fdf1015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:38.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.820+0000 7fdf0f7fe640 1 --2- 172.21.15.6:0/3098644115 >> v2:172.21.15.161:3300/0 conn(0x7fdf100aeb40 0x7fdf1015cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.820+0000 7fdf0f7fe640 1 -- 172.21.15.6:0/3098644115 >> v1:172.21.15.161:6789/0 conn(0x7fdf100aef10 legacy=0x7fdf10158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:38.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.820+0000 7fdf0f7fe640 1 -- 172.21.15.6:0/3098644115 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf10159cb0 con 0x7fdf10159440 2023-07-21T22:18:38.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.820+0000 7fdf0f7fe640 1 --2- 172.21.15.6:0/3098644115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf10159440 0x7fdf100c88c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdf10071ad0 tx=0x7fdf0801c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee79b34035eb5740 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:38.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.820+0000 7fdf0e7fc640 1 -- 172.21.15.6:0/3098644115 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf080a5790 con 0x7fdf10159440 2023-07-21T22:18:38.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.820+0000 7fdf0e7fc640 1 -- 172.21.15.6:0/3098644115 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf080a58f0 con 0x7fdf10159440 2023-07-21T22:18:38.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.820+0000 7fdf0e7fc640 1 -- 172.21.15.6:0/3098644115 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf080a5c80 con 0x7fdf10159440 2023-07-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.820+0000 7fdf1580b640 1 -- 172.21.15.6:0/3098644115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf10159440 msgr2=0x7fdf100c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.820+0000 7fdf1580b640 1 --2- 172.21.15.6:0/3098644115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf10159440 0x7fdf100c88c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdf10071ad0 tx=0x7fdf0801c8d0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.820+0000 7fdf1580b640 1 -- 172.21.15.6:0/3098644115 shutdown_connections 2023-07-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.820+0000 7fdf1580b640 1 --2- 172.21.15.6:0/3098644115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf10159440 0x7fdf100c88c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.820+0000 7fdf1580b640 1 --2- 172.21.15.6:0/3098644115 >> v2:172.21.15.161:3300/0 conn(0x7fdf100aeb40 0x7fdf1015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.820+0000 7fdf1580b640 1 -- 172.21.15.6:0/3098644115 >> 172.21.15.6:0/3098644115 conn(0x7fdf100cde90 msgr2=0x7fdf100ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:38.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.820+0000 7fdf1580b640 1 -- 172.21.15.6:0/3098644115 shutdown_connections 2023-07-21T22:18:38.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.820+0000 7fdf1580b640 1 -- 172.21.15.6:0/3098644115 wait complete. 2023-07-21T22:18:38.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf1580b640 1 Processor -- start 2023-07-21T22:18:38.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf1580b640 1 -- start start 2023-07-21T22:18:38.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf1580b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf100aeb40 0x7fdf1014d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:38.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf1580b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf100aef10 0x7fdf10151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:38.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf1580b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf10159440 0x7fdf100b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:38.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf1580b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1014d540 con 0x7fdf100aef10 2023-07-21T22:18:38.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf1580b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1014df10 con 0x7fdf10159440 2023-07-21T22:18:38.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf1580b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf100b1880 con 0x7fdf100aeb40 2023-07-21T22:18:38.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf07fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf100aef10 0x7fdf10151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:38.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf0effd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf100aeb40 0x7fdf1014d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:38.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf0f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf10159440 0x7fdf100b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:38.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf07fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf100aef10 0x7fdf10151ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54530/0 (socket says 172.21.15.6:54530) 2023-07-21T22:18:38.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf0effd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf100aeb40 0x7fdf1014d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:54034/0 (socket says 172.21.15.6:54034) 2023-07-21T22:18:38.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf07fff640 1 -- 172.21.15.6:0/1750316709 learned_addr learned my addr 172.21.15.6:0/1750316709 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf07fff640 1 -- 172.21.15.6:0/1750316709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf100aeb40 msgr2=0x7fdf1014d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf07fff640 1 --2- 172.21.15.6:0/1750316709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf100aeb40 0x7fdf1014d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf07fff640 1 -- 172.21.15.6:0/1750316709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf10159440 msgr2=0x7fdf100b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf07fff640 1 --2- 172.21.15.6:0/1750316709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf10159440 0x7fdf100b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf07fff640 1 -- 172.21.15.6:0/1750316709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf08009b30 con 0x7fdf100aef10 2023-07-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf07fff640 1 --2- 172.21.15.6:0/1750316709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf100aef10 0x7fdf10151ba0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdef800c450 tx=0x7fdef800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf0cff9640 1 -- 172.21.15.6:0/1750316709 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef8012830 con 0x7fdf100aef10 2023-07-21T22:18:38.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf0cff9640 1 -- 172.21.15.6:0/1750316709 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef80129b0 con 0x7fdf100aef10 2023-07-21T22:18:38.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf0cff9640 1 -- 172.21.15.6:0/1750316709 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef8012d60 con 0x7fdf100aef10 2023-07-21T22:18:38.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.824+0000 7fdf1580b640 1 -- 172.21.15.6:0/1750316709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1014cef0 con 0x7fdf100aef10 2023-07-21T22:18:38.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.828+0000 7fdf1580b640 1 -- 172.21.15.6:0/1750316709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf100b1b60 con 0x7fdf100aef10 2023-07-21T22:18:38.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.828+0000 7fdf1580b640 1 -- 172.21.15.6:0/1750316709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1014d6f0 con 0x7fdf100aef10 2023-07-21T22:18:38.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.828+0000 7fdf0cff9640 1 -- 172.21.15.6:0/1750316709 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdef801c460 con 0x7fdf100aef10 2023-07-21T22:18:38.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.828+0000 7fdf0cff9640 1 --2- 172.21.15.6:0/1750316709 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fdef0066280 0x7fdef0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:38.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.828+0000 7fdf0cff9640 1 -- 172.21.15.6:0/1750316709 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdef8083760 con 0x7fdf100aef10 2023-07-21T22:18:38.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.828+0000 7fdf0effd640 1 --2- 172.21.15.6:0/1750316709 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fdef0066280 0x7fdef0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:38.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.828+0000 7fdf0effd640 1 --2- 172.21.15.6:0/1750316709 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fdef0066280 0x7fdef0068730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdf000079c0 tx=0x7fdf00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:38.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.832+0000 7fdf0cff9640 1 -- 172.21.15.6:0/1750316709 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdf1014d6f0 con 0x7fdf100aef10 2023-07-21T22:18:39.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.988+0000 7fdf1580b640 1 -- 172.21.15.6:0/1750316709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdf1014d6f0 con 0x7fdf100aef10 2023-07-21T22:18:39.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.988+0000 7fdf0cff9640 1 -- 172.21.15.6:0/1750316709 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdf1014d6f0 con 0x7fdf100aef10 2023-07-21T22:18:39.035 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:18:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.988+0000 7fdf1580b640 1 -- 172.21.15.6:0/1750316709 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fdef0066280 msgr2=0x7fdef0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.988+0000 7fdf1580b640 1 --2- 172.21.15.6:0/1750316709 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fdef0066280 0x7fdef0068730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdf000079c0 tx=0x7fdf00008040 comp rx=0 tx=0).stop 2023-07-21T22:18:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.988+0000 7fdf1580b640 1 -- 172.21.15.6:0/1750316709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf100aef10 msgr2=0x7fdf10151ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.988+0000 7fdf1580b640 1 --2- 172.21.15.6:0/1750316709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf100aef10 0x7fdf10151ba0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdef800c450 tx=0x7fdef800c910 comp rx=0 tx=0).stop 2023-07-21T22:18:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.988+0000 7fdf1580b640 1 -- 172.21.15.6:0/1750316709 shutdown_connections 2023-07-21T22:18:39.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.988+0000 7fdf1580b640 1 --2- 172.21.15.6:0/1750316709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf10159440 0x7fdf100b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.988+0000 7fdf1580b640 1 --2- 172.21.15.6:0/1750316709 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fdef0066280 0x7fdef0068730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.988+0000 7fdf1580b640 1 --2- 172.21.15.6:0/1750316709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf100aef10 0x7fdf10151ba0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.988+0000 7fdf1580b640 1 --2- 172.21.15.6:0/1750316709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf100aeb40 0x7fdf1014d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.992+0000 7fdf1580b640 1 -- 172.21.15.6:0/1750316709 >> 172.21.15.6:0/1750316709 conn(0x7fdf100cde90 msgr2=0x7fdf101505b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.992+0000 7fdf1580b640 1 -- 172.21.15.6:0/1750316709 shutdown_connections 2023-07-21T22:18:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:38.992+0000 7fdf1580b640 1 -- 172.21.15.6:0/1750316709 wait complete. 2023-07-21T22:18:39.056 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:18:39.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.156+0000 7f44c8a96640 1 Processor -- start 2023-07-21T22:18:39.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.156+0000 7f44c8a96640 1 -- start start 2023-07-21T22:18:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.156+0000 7f44c8a96640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f44c40cd830 0x7f44c40c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.156+0000 7f44c8a96640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c40695b0 con 0x7f44c40c3ac0 2023-07-21T22:18:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.156+0000 7f44c8a96640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c4069890 con 0x7f44c40af2b0 2023-07-21T22:18:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.156+0000 7f44c8a96640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c4069b70 con 0x7f44c40cd830 2023-07-21T22:18:39.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.156+0000 7f44c259c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f44c40c3ac0 0x7f44c40ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41612/0 (socket says 172.21.15.6:41612) 2023-07-21T22:18:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.156+0000 7f44c259c640 1 -- 172.21.15.6:0/1676693627 learned_addr learned my addr 172.21.15.6:0/1676693627 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:39.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.156+0000 7f44c2d9d640 1 --2- 172.21.15.6:0/1676693627 >> v2:172.21.15.161:3300/0 conn(0x7f44c40cd830 0x7f44c40c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.156+0000 7f44c1d9b640 1 -- 172.21.15.6:0/1676693627 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391782318 0 0) 0x7f44c40695b0 con 0x7f44c40c3ac0 2023-07-21T22:18:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.156+0000 7f44c1d9b640 1 -- 172.21.15.6:0/1676693627 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44b0003530 con 0x7f44c40c3ac0 2023-07-21T22:18:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.156+0000 7f44c1d9b640 1 -- 172.21.15.6:0/1676693627 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 161951453 0 0) 0x7f44c4069890 con 0x7f44c40af2b0 2023-07-21T22:18:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.156+0000 7f44c1d9b640 1 -- 172.21.15.6:0/1676693627 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44c40695b0 con 0x7f44c40af2b0 2023-07-21T22:18:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.156+0000 7f44c2d9d640 1 -- 172.21.15.6:0/1676693627 >> v1:172.21.15.161:6789/0 conn(0x7f44c40af2b0 legacy=0x7f44c40cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.156+0000 7f44c2d9d640 1 -- 172.21.15.6:0/1676693627 >> v1:172.21.15.6:6789/0 conn(0x7f44c40c3ac0 legacy=0x7f44c40ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.156+0000 7f44c2d9d640 1 -- 172.21.15.6:0/1676693627 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c4069e50 con 0x7f44c40cd830 2023-07-21T22:18:39.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.160+0000 7f44c2d9d640 1 --2- 172.21.15.6:0/1676693627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44c40cd830 0x7f44c40c2d30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f44bc009d90 tx=0x7f44bc01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f1601cf7f4b7f15 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:39.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.160+0000 7f44c1d9b640 1 -- 172.21.15.6:0/1676693627 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc0a5a30 con 0x7f44c40cd830 2023-07-21T22:18:39.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.160+0000 7f44c1d9b640 1 -- 172.21.15.6:0/1676693627 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44bc0a5b90 con 0x7f44c40cd830 2023-07-21T22:18:39.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.160+0000 7f44c1d9b640 1 -- 172.21.15.6:0/1676693627 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc0ad440 con 0x7f44c40cd830 2023-07-21T22:18:39.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.160+0000 7f44c8a96640 1 -- 172.21.15.6:0/1676693627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44c40cd830 msgr2=0x7f44c40c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.160+0000 7f44c8a96640 1 --2- 172.21.15.6:0/1676693627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44c40cd830 0x7f44c40c2d30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f44bc009d90 tx=0x7f44bc01c950 comp rx=0 tx=0).stop 2023-07-21T22:18:39.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.160+0000 7f44c8a96640 1 -- 172.21.15.6:0/1676693627 shutdown_connections 2023-07-21T22:18:39.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.160+0000 7f44c8a96640 1 --2- 172.21.15.6:0/1676693627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44c40cd830 0x7f44c40c2d30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.160+0000 7f44c8a96640 1 -- 172.21.15.6:0/1676693627 >> 172.21.15.6:0/1676693627 conn(0x7f44c40cde90 msgr2=0x7f44c40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:39.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.160+0000 7f44c8a96640 1 -- 172.21.15.6:0/1676693627 shutdown_connections 2023-07-21T22:18:39.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.160+0000 7f44c8a96640 1 -- 172.21.15.6:0/1676693627 wait complete. 2023-07-21T22:18:39.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44c8a96640 1 Processor -- start 2023-07-21T22:18:39.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44c8a96640 1 -- start start 2023-07-21T22:18:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44c8a96640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44c40af2b0 0x7f44c414cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44c8a96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c40c3ac0 0x7f44c4151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44c8a96640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44c40cd830 0x7f44c4158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44c8a96640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c4152030 con 0x7f44c40c3ac0 2023-07-21T22:18:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44c8a96640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c4152310 con 0x7f44c40af2b0 2023-07-21T22:18:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44c8a96640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c41525f0 con 0x7f44c40cd830 2023-07-21T22:18:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44bbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c40c3ac0 0x7f44c4151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44bbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c40c3ac0 0x7f44c4151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54536/0 (socket says 172.21.15.6:54536) 2023-07-21T22:18:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44bbfff640 1 -- 172.21.15.6:0/2018710485 learned_addr learned my addr 172.21.15.6:0/2018710485 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44c259c640 1 --2- 172.21.15.6:0/2018710485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44c40af2b0 0x7f44c414cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44c2d9d640 1 --2- 172.21.15.6:0/2018710485 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44c40cd830 0x7f44c4158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44bbfff640 1 -- 172.21.15.6:0/2018710485 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44c40cd830 msgr2=0x7f44c4158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44bbfff640 1 --2- 172.21.15.6:0/2018710485 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44c40cd830 0x7f44c4158630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44bbfff640 1 -- 172.21.15.6:0/2018710485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44c40af2b0 msgr2=0x7f44c414cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44bbfff640 1 --2- 172.21.15.6:0/2018710485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44c40af2b0 0x7f44c414cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44bbfff640 1 -- 172.21.15.6:0/2018710485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc009a70 con 0x7f44c40c3ac0 2023-07-21T22:18:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44bbfff640 1 --2- 172.21.15.6:0/2018710485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c40c3ac0 0x7f44c4151570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00c490 tx=0x7f44ac00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44baffd640 1 -- 172.21.15.6:0/2018710485 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0052d0 con 0x7f44c40c3ac0 2023-07-21T22:18:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44baffd640 1 -- 172.21.15.6:0/2018710485 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac005430 con 0x7f44c40c3ac0 2023-07-21T22:18:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44baffd640 1 -- 172.21.15.6:0/2018710485 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac012870 con 0x7f44c40c3ac0 2023-07-21T22:18:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44c8a96640 1 -- 172.21.15.6:0/2018710485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c41528d0 con 0x7f44c40c3ac0 2023-07-21T22:18:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.164+0000 7f44c8a96640 1 -- 172.21.15.6:0/2018710485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c41530d0 con 0x7f44c40c3ac0 2023-07-21T22:18:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.168+0000 7f44c8a96640 1 -- 172.21.15.6:0/2018710485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c40678d0 con 0x7f44c40c3ac0 2023-07-21T22:18:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.168+0000 7f44baffd640 1 -- 172.21.15.6:0/2018710485 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f44ac0129d0 con 0x7f44c40c3ac0 2023-07-21T22:18:39.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.168+0000 7f44baffd640 1 --2- 172.21.15.6:0/2018710485 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f44a4066280 0x7f44a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.168+0000 7f44baffd640 1 -- 172.21.15.6:0/2018710485 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f44ac0833f0 con 0x7f44c40c3ac0 2023-07-21T22:18:39.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.168+0000 7f44c259c640 1 --2- 172.21.15.6:0/2018710485 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f44a4066280 0x7f44a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.168+0000 7f44c259c640 1 --2- 172.21.15.6:0/2018710485 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f44a4066280 0x7f44a4068730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f44b40011f0 tx=0x7f44b4007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:39.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.172+0000 7f44baffd640 1 -- 172.21.15.6:0/2018710485 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44ac054790 con 0x7f44c40c3ac0 2023-07-21T22:18:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.332+0000 7f44c8a96640 1 -- 172.21.15.6:0/2018710485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f44c4152d80 con 0x7f44c40c3ac0 2023-07-21T22:18:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.332+0000 7f44baffd640 1 -- 172.21.15.6:0/2018710485 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f44ac054320 con 0x7f44c40c3ac0 2023-07-21T22:18:39.378 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:18:39.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.332+0000 7f44c8a96640 1 -- 172.21.15.6:0/2018710485 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f44a4066280 msgr2=0x7f44a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.332+0000 7f44c8a96640 1 --2- 172.21.15.6:0/2018710485 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f44a4066280 0x7f44a4068730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f44b40011f0 tx=0x7f44b4007d40 comp rx=0 tx=0).stop 2023-07-21T22:18:39.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.332+0000 7f44c8a96640 1 -- 172.21.15.6:0/2018710485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c40c3ac0 msgr2=0x7f44c4151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.332+0000 7f44c8a96640 1 --2- 172.21.15.6:0/2018710485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c40c3ac0 0x7f44c4151570 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00c490 tx=0x7f44ac00c950 comp rx=0 tx=0).stop 2023-07-21T22:18:39.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.332+0000 7f44c8a96640 1 -- 172.21.15.6:0/2018710485 shutdown_connections 2023-07-21T22:18:39.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.332+0000 7f44c8a96640 1 --2- 172.21.15.6:0/2018710485 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44c40cd830 0x7f44c4158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.332+0000 7f44c8a96640 1 --2- 172.21.15.6:0/2018710485 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f44a4066280 0x7f44a4068730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.332+0000 7f44c8a96640 1 --2- 172.21.15.6:0/2018710485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c40c3ac0 0x7f44c4151570 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.332+0000 7f44c8a96640 1 --2- 172.21.15.6:0/2018710485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44c40af2b0 0x7f44c414cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.332+0000 7f44c8a96640 1 -- 172.21.15.6:0/2018710485 >> 172.21.15.6:0/2018710485 conn(0x7f44c40cde90 msgr2=0x7f44c40709b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:39.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.332+0000 7f44c8a96640 1 -- 172.21.15.6:0/2018710485 shutdown_connections 2023-07-21T22:18:39.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.332+0000 7f44c8a96640 1 -- 172.21.15.6:0/2018710485 wait complete. 2023-07-21T22:18:39.399 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:18:39.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.500+0000 7f51e2bfa640 1 Processor -- start 2023-07-21T22:18:39.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.500+0000 7f51e2bfa640 1 -- start start 2023-07-21T22:18:39.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.500+0000 7f51e2bfa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51dc0b7c70 0x7f51dc0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.500+0000 7f51e2bfa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f51dc0d1850 0x7f51dc15f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.500+0000 7f51e2bfa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51dc0d1300 0x7f51dc15fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.500+0000 7f51e2bfa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51dc0d1190 con 0x7f51dc0b7c70 2023-07-21T22:18:39.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.500+0000 7f51e2bfa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51dc160600 con 0x7f51dc0d1850 2023-07-21T22:18:39.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.500+0000 7f51e2bfa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc1600d0 con 0x7f51dc0d1300 2023-07-21T22:18:39.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.500+0000 7f51e0996640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51dc0b7c70 0x7f51dc0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.500+0000 7f51e0996640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51dc0b7c70 0x7f51dc0d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54546/0 (socket says 172.21.15.6:54546) 2023-07-21T22:18:39.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.500+0000 7f51e0996640 1 -- 172.21.15.6:0/4013638031 learned_addr learned my addr 172.21.15.6:0/4013638031 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:39.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.500+0000 7f51e1197640 1 --2- 172.21.15.6:0/4013638031 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51dc0d1300 0x7f51dc15fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.500+0000 7f51dbfff640 1 --2- 172.21.15.6:0/4013638031 >> v2:172.21.15.161:3300/0 conn(0x7f51dc0d1850 0x7f51dc15f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.500+0000 7f51e0996640 1 -- 172.21.15.6:0/4013638031 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51dc0d1300 msgr2=0x7f51dc15fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:39.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.500+0000 7f51e0996640 1 --2- 172.21.15.6:0/4013638031 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51dc0d1300 0x7f51dc15fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.500+0000 7f51e0996640 1 -- 172.21.15.6:0/4013638031 >> v2:172.21.15.161:3300/0 conn(0x7f51dc0d1850 msgr2=0x7f51dc15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:39.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.500+0000 7f51e0996640 1 --2- 172.21.15.6:0/4013638031 >> v2:172.21.15.161:3300/0 conn(0x7f51dc0d1850 0x7f51dc15f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.500+0000 7f51e0996640 1 -- 172.21.15.6:0/4013638031 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc0ccaf0 con 0x7f51dc0b7c70 2023-07-21T22:18:39.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.504+0000 7f51e0996640 1 --2- 172.21.15.6:0/4013638031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51dc0b7c70 0x7f51dc0d0c50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0b1180 tx=0x7f51d001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7d1c26cb94e7d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:39.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.504+0000 7f51db7fe640 1 -- 172.21.15.6:0/4013638031 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d00ac600 con 0x7f51dc0b7c70 2023-07-21T22:18:39.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.504+0000 7f51db7fe640 1 -- 172.21.15.6:0/4013638031 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d00a8050 con 0x7f51dc0b7c70 2023-07-21T22:18:39.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.504+0000 7f51db7fe640 1 -- 172.21.15.6:0/4013638031 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d00ac980 con 0x7f51dc0b7c70 2023-07-21T22:18:39.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.504+0000 7f51e2bfa640 1 -- 172.21.15.6:0/4013638031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51dc0b7c70 msgr2=0x7f51dc0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.504+0000 7f51e2bfa640 1 --2- 172.21.15.6:0/4013638031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51dc0b7c70 0x7f51dc0d0c50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0b1180 tx=0x7f51d001c4d0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.504+0000 7f51e2bfa640 1 -- 172.21.15.6:0/4013638031 shutdown_connections 2023-07-21T22:18:39.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.504+0000 7f51e2bfa640 1 --2- 172.21.15.6:0/4013638031 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51dc0d1300 0x7f51dc15fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.504+0000 7f51e2bfa640 1 --2- 172.21.15.6:0/4013638031 >> v2:172.21.15.161:3300/0 conn(0x7f51dc0d1850 0x7f51dc15f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.504+0000 7f51e2bfa640 1 --2- 172.21.15.6:0/4013638031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51dc0b7c70 0x7f51dc0d0c50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.504+0000 7f51e2bfa640 1 -- 172.21.15.6:0/4013638031 >> 172.21.15.6:0/4013638031 conn(0x7f51dc0650b0 msgr2=0x7f51dc0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:39.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.504+0000 7f51e2bfa640 1 -- 172.21.15.6:0/4013638031 shutdown_connections 2023-07-21T22:18:39.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.504+0000 7f51e2bfa640 1 -- 172.21.15.6:0/4013638031 wait complete. 2023-07-21T22:18:39.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51e2bfa640 1 Processor -- start 2023-07-21T22:18:39.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51e2bfa640 1 -- start start 2023-07-21T22:18:39.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51e2bfa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51dc0b7c70 0x7f51dc159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51e2bfa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51dc0d1300 0x7f51dc15ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51e2bfa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51dc0d1850 0x7f51dc15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51e2bfa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc15a070 con 0x7f51dc0b7c70 2023-07-21T22:18:39.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51e2bfa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc15c460 con 0x7f51dc0d1300 2023-07-21T22:18:39.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51e2bfa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51dc15c740 con 0x7f51dc0d1850 2023-07-21T22:18:39.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51e0996640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51dc0b7c70 0x7f51dc159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51e0996640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51dc0b7c70 0x7f51dc159b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54552/0 (socket says 172.21.15.6:54552) 2023-07-21T22:18:39.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51e0996640 1 -- 172.21.15.6:0/68591785 learned_addr learned my addr 172.21.15.6:0/68591785 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:39.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51dbfff640 1 --2- 172.21.15.6:0/68591785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51dc0d1300 0x7f51dc15ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51e1197640 1 --2- 172.21.15.6:0/68591785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51dc0d1850 0x7f51dc15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51e0996640 1 -- 172.21.15.6:0/68591785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51dc0d1850 msgr2=0x7f51dc15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51e0996640 1 --2- 172.21.15.6:0/68591785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51dc0d1850 0x7f51dc15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51e0996640 1 -- 172.21.15.6:0/68591785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51dc0d1300 msgr2=0x7f51dc15ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51e0996640 1 --2- 172.21.15.6:0/68591785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51dc0d1300 0x7f51dc15ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51e0996640 1 -- 172.21.15.6:0/68591785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d00094d0 con 0x7f51dc0b7c70 2023-07-21T22:18:39.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51e0996640 1 --2- 172.21.15.6:0/68591785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51dc0b7c70 0x7f51dc159b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f51d001ab80 tx=0x7f51d001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:39.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51d97fa640 1 -- 172.21.15.6:0/68591785 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d00bd070 con 0x7f51dc0b7c70 2023-07-21T22:18:39.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51d97fa640 1 -- 172.21.15.6:0/68591785 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d00acd10 con 0x7f51dc0b7c70 2023-07-21T22:18:39.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51e2bfa640 1 -- 172.21.15.6:0/68591785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51dc15ca20 con 0x7f51dc0b7c70 2023-07-21T22:18:39.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51d97fa640 1 -- 172.21.15.6:0/68591785 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d00b7620 con 0x7f51dc0b7c70 2023-07-21T22:18:39.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.508+0000 7f51e2bfa640 1 -- 172.21.15.6:0/68591785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51dc15cfe0 con 0x7f51dc0b7c70 2023-07-21T22:18:39.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.512+0000 7f51e2bfa640 1 -- 172.21.15.6:0/68591785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51dc0678d0 con 0x7f51dc0b7c70 2023-07-21T22:18:39.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.512+0000 7f51d97fa640 1 -- 172.21.15.6:0/68591785 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f51d00b3040 con 0x7f51dc0b7c70 2023-07-21T22:18:39.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.512+0000 7f51d97fa640 1 --2- 172.21.15.6:0/68591785 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f51c0066280 0x7f51c0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.512+0000 7f51d97fa640 1 -- 172.21.15.6:0/68591785 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f51d011d3b0 con 0x7f51dc0b7c70 2023-07-21T22:18:39.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.512+0000 7f51dbfff640 1 --2- 172.21.15.6:0/68591785 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f51c0066280 0x7f51c0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.512+0000 7f51dbfff640 1 --2- 172.21.15.6:0/68591785 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f51c0066280 0x7f51c0068730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0c5a80 tx=0x7f51c8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:39.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.516+0000 7f51d97fa640 1 -- 172.21.15.6:0/68591785 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f51d00eaba0 con 0x7f51dc0b7c70 2023-07-21T22:18:39.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.704+0000 7f51e2bfa640 1 -- 172.21.15.6:0/68591785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51dc0cbb40 con 0x7f51dc0b7c70 2023-07-21T22:18:39.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.704+0000 7f51d97fa640 1 -- 172.21.15.6:0/68591785 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3515 (secure 0 0 0) 0x7f51d00ee1c0 con 0x7f51dc0b7c70 2023-07-21T22:18:39.752 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:18:39.752 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3109831689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3109831689},{"type":"v1","addr":"172.21.15.6:6834","nonce":3109831689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/937908788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":937908788},{"type":"v1","addr":"172.21.15.161:6836","nonce":937908788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/445360801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":445360801},{"type":"v1","addr":"172.21.15.6:6835","nonce":445360801}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/747850146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":747850146},{"type":"v1","addr":"172.21.15.161:6837","nonce":747850146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-21T22:18:39.753 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 3 2023-07-21T22:18:39.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.708+0000 7f51e2bfa640 1 -- 172.21.15.6:0/68591785 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f51c0066280 msgr2=0x7f51c0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.708+0000 7f51e2bfa640 1 --2- 172.21.15.6:0/68591785 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f51c0066280 0x7f51c0068730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0c5a80 tx=0x7f51c8009190 comp rx=0 tx=0).stop 2023-07-21T22:18:39.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.708+0000 7f51e2bfa640 1 -- 172.21.15.6:0/68591785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51dc0b7c70 msgr2=0x7f51dc159b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.708+0000 7f51e2bfa640 1 --2- 172.21.15.6:0/68591785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51dc0b7c70 0x7f51dc159b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f51d001ab80 tx=0x7f51d001ad10 comp rx=0 tx=0).stop 2023-07-21T22:18:39.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.708+0000 7f51e2bfa640 1 -- 172.21.15.6:0/68591785 shutdown_connections 2023-07-21T22:18:39.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.708+0000 7f51e2bfa640 1 --2- 172.21.15.6:0/68591785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51dc0d1850 0x7f51dc15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.708+0000 7f51e2bfa640 1 --2- 172.21.15.6:0/68591785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51dc0d1300 0x7f51dc15ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.708+0000 7f51e2bfa640 1 --2- 172.21.15.6:0/68591785 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f51c0066280 0x7f51c0068730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.708+0000 7f51e2bfa640 1 --2- 172.21.15.6:0/68591785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51dc0b7c70 0x7f51dc159b30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.708+0000 7f51e2bfa640 1 -- 172.21.15.6:0/68591785 >> 172.21.15.6:0/68591785 conn(0x7f51dc0650b0 msgr2=0x7f51dc0b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:39.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.708+0000 7f51e2bfa640 1 -- 172.21.15.6:0/68591785 shutdown_connections 2023-07-21T22:18:39.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.708+0000 7f51e2bfa640 1 -- 172.21.15.6:0/68591785 wait complete. 2023-07-21T22:18:39.773 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:18:39.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.872+0000 7fbdf8511640 1 Processor -- start 2023-07-21T22:18:39.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.872+0000 7fbdf8511640 1 -- start start 2023-07-21T22:18:39.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.872+0000 7fbdf8511640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbdf00d1850 0x7fbdf00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.872+0000 7fbdf8511640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf00ccaf0 con 0x7fbdf015fd60 2023-07-21T22:18:39.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.872+0000 7fbdf8511640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf0160320 con 0x7fbdf00b7c70 2023-07-21T22:18:39.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.872+0000 7fbdf8511640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf00d1190 con 0x7fbdf00d1850 2023-07-21T22:18:39.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.872+0000 7fbdf6aae640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbdf00d1850 0x7fbdf00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.872+0000 7fbdf5aac640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbdf015fd60 0x7fbdf00d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41618/0 (socket says 172.21.15.6:41618) 2023-07-21T22:18:39.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.872+0000 7fbdf5aac640 1 -- 172.21.15.6:0/606148646 learned_addr learned my addr 172.21.15.6:0/606148646 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:39.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.872+0000 7fbdf6aae640 1 -- 172.21.15.6:0/606148646 >> v1:172.21.15.161:6789/0 conn(0x7fbdf00b7c70 legacy=0x7fbdf015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.872+0000 7fbdf6aae640 1 -- 172.21.15.6:0/606148646 >> v1:172.21.15.6:6789/0 conn(0x7fbdf015fd60 legacy=0x7fbdf00d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.872+0000 7fbdf52ab640 1 -- 172.21.15.6:0/606148646 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206341623 0 0) 0x7fbdf0160320 con 0x7fbdf00b7c70 2023-07-21T22:18:39.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.872+0000 7fbdf6aae640 1 -- 172.21.15.6:0/606148646 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf00ccd90 con 0x7fbdf00d1850 2023-07-21T22:18:39.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.876+0000 7fbdf6aae640 1 --2- 172.21.15.6:0/606148646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf00d1850 0x7fbdf00d0c50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009d90 tx=0x7fbde801c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbccc3d4b1795f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:39.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.876+0000 7fbdf52ab640 1 -- 172.21.15.6:0/606148646 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde80a5840 con 0x7fbdf00d1850 2023-07-21T22:18:39.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.876+0000 7fbdf52ab640 1 -- 172.21.15.6:0/606148646 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde80a59a0 con 0x7fbdf00d1850 2023-07-21T22:18:39.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.876+0000 7fbdf52ab640 1 -- 172.21.15.6:0/606148646 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde80a5d30 con 0x7fbdf00d1850 2023-07-21T22:18:39.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.876+0000 7fbdf8511640 1 -- 172.21.15.6:0/606148646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf00d1850 msgr2=0x7fbdf00d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.876+0000 7fbdf8511640 1 --2- 172.21.15.6:0/606148646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf00d1850 0x7fbdf00d0c50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009d90 tx=0x7fbde801c7e0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.876+0000 7fbdf8511640 1 -- 172.21.15.6:0/606148646 shutdown_connections 2023-07-21T22:18:39.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.876+0000 7fbdf8511640 1 --2- 172.21.15.6:0/606148646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf00d1850 0x7fbdf00d0c50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.876+0000 7fbdf8511640 1 -- 172.21.15.6:0/606148646 >> 172.21.15.6:0/606148646 conn(0x7fbdf00650b0 msgr2=0x7fbdf00654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:39.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.876+0000 7fbdf8511640 1 -- 172.21.15.6:0/606148646 shutdown_connections 2023-07-21T22:18:39.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.876+0000 7fbdf8511640 1 -- 172.21.15.6:0/606148646 wait complete. 2023-07-21T22:18:39.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf8511640 1 Processor -- start 2023-07-21T22:18:39.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf8511640 1 -- start start 2023-07-21T22:18:39.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf8511640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdf00b7c70 0x7fbdf0156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf8511640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdf00d1850 0x7fbdf015e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf8511640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf015fd60 0x7fbdf00b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf8511640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf01f4550 con 0x7fbdf015fd60 2023-07-21T22:18:39.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf8511640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf01f4830 con 0x7fbdf00b7c70 2023-07-21T22:18:39.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf8511640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf01f4b10 con 0x7fbdf00d1850 2023-07-21T22:18:39.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf6aae640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf015fd60 0x7fbdf00b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf6aae640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf015fd60 0x7fbdf00b2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54568/0 (socket says 172.21.15.6:54568) 2023-07-21T22:18:39.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf6aae640 1 -- 172.21.15.6:0/340301522 learned_addr learned my addr 172.21.15.6:0/340301522 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:39.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf62ad640 1 --2- 172.21.15.6:0/340301522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdf00b7c70 0x7fbdf0156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf5aac640 1 --2- 172.21.15.6:0/340301522 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdf00d1850 0x7fbdf015e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf6aae640 1 -- 172.21.15.6:0/340301522 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdf00d1850 msgr2=0x7fbdf015e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf6aae640 1 --2- 172.21.15.6:0/340301522 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdf00d1850 0x7fbdf015e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf6aae640 1 -- 172.21.15.6:0/340301522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdf00b7c70 msgr2=0x7fbdf0156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf6aae640 1 --2- 172.21.15.6:0/340301522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdf00b7c70 0x7fbdf0156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf6aae640 1 -- 172.21.15.6:0/340301522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde8009a70 con 0x7fbdf015fd60 2023-07-21T22:18:39.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf5aac640 1 --2- 172.21.15.6:0/340301522 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdf00d1850 0x7fbdf015e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:39.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf62ad640 1 --2- 172.21.15.6:0/340301522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdf00b7c70 0x7fbdf0156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:39.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf6aae640 1 --2- 172.21.15.6:0/340301522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf015fd60 0x7fbdf00b2100 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbde801a410 tx=0x7fbde8019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:39.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbde6ffd640 1 -- 172.21.15.6:0/340301522 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde80adcd0 con 0x7fbdf015fd60 2023-07-21T22:18:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbde6ffd640 1 -- 172.21.15.6:0/340301522 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde80ade30 con 0x7fbdf015fd60 2023-07-21T22:18:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbde6ffd640 1 -- 172.21.15.6:0/340301522 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde80b9670 con 0x7fbdf015fd60 2023-07-21T22:18:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf8511640 1 -- 172.21.15.6:0/340301522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf01f4df0 con 0x7fbdf015fd60 2023-07-21T22:18:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf8511640 1 -- 172.21.15.6:0/340301522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf0157480 con 0x7fbdf015fd60 2023-07-21T22:18:39.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.880+0000 7fbdf8511640 1 -- 172.21.15.6:0/340301522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf00c9220 con 0x7fbdf015fd60 2023-07-21T22:18:39.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.884+0000 7fbde6ffd640 1 -- 172.21.15.6:0/340301522 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbde80b97d0 con 0x7fbdf015fd60 2023-07-21T22:18:39.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.884+0000 7fbde6ffd640 1 --2- 172.21.15.6:0/340301522 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbdd4066280 0x7fbdd4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.884+0000 7fbde6ffd640 1 -- 172.21.15.6:0/340301522 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbde811f2e0 con 0x7fbdf015fd60 2023-07-21T22:18:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.884+0000 7fbdf62ad640 1 --2- 172.21.15.6:0/340301522 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbdd4066280 0x7fbdd4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.884+0000 7fbdf62ad640 1 --2- 172.21.15.6:0/340301522 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbdd4066280 0x7fbdd4068730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbdec007b30 tx=0x7fbdec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:39.888+0000 7fbde6ffd640 1 -- 172.21.15.6:0/340301522 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbde80ecbf0 con 0x7fbdf015fd60 2023-07-21T22:18:40.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.044+0000 7fbdf8511640 1 -- 172.21.15.6:0/340301522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdf00c9220 con 0x7fbdf015fd60 2023-07-21T22:18:40.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.044+0000 7fbde6ffd640 1 -- 172.21.15.6:0/340301522 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+14564 (secure 0 0 0) 0x7fbde80f0210 con 0x7fbdf015fd60 2023-07-21T22:18:40.091 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:18:40.091 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":22,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:18:39.270349+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:18:40.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.048+0000 7fbdf8511640 1 -- 172.21.15.6:0/340301522 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbdd4066280 msgr2=0x7fbdd4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.048+0000 7fbdf8511640 1 --2- 172.21.15.6:0/340301522 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbdd4066280 0x7fbdd4068730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbdec007b30 tx=0x7fbdec009040 comp rx=0 tx=0).stop 2023-07-21T22:18:40.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.048+0000 7fbdf8511640 1 -- 172.21.15.6:0/340301522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf015fd60 msgr2=0x7fbdf00b2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.048+0000 7fbdf8511640 1 --2- 172.21.15.6:0/340301522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf015fd60 0x7fbdf00b2100 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbde801a410 tx=0x7fbde8019580 comp rx=0 tx=0).stop 2023-07-21T22:18:40.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.048+0000 7fbdf8511640 1 -- 172.21.15.6:0/340301522 shutdown_connections 2023-07-21T22:18:40.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.048+0000 7fbdf8511640 1 --2- 172.21.15.6:0/340301522 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbdd4066280 0x7fbdd4068730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.048+0000 7fbdf8511640 1 --2- 172.21.15.6:0/340301522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf015fd60 0x7fbdf00b2100 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.048+0000 7fbdf8511640 1 --2- 172.21.15.6:0/340301522 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdf00d1850 0x7fbdf015e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.048+0000 7fbdf8511640 1 --2- 172.21.15.6:0/340301522 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdf00b7c70 0x7fbdf0156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.048+0000 7fbdf8511640 1 -- 172.21.15.6:0/340301522 >> 172.21.15.6:0/340301522 conn(0x7fbdf00650b0 msgr2=0x7fbdf015b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:40.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.048+0000 7fbdf8511640 1 -- 172.21.15.6:0/340301522 shutdown_connections 2023-07-21T22:18:40.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.048+0000 7fbdf8511640 1 -- 172.21.15.6:0/340301522 wait complete. 2023-07-21T22:18:40.112 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:18:40.113 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:18:40.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.212+0000 7f5488493640 1 Processor -- start 2023-07-21T22:18:40.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.212+0000 7f5488493640 1 -- start start 2023-07-21T22:18:40.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.212+0000 7f5488493640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f54800cf2e0 0x7f54800cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.212+0000 7f5488493640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54800ca790 0x7f54800cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.212+0000 7f5488493640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54800d0920 con 0x7f548006a540 2023-07-21T22:18:40.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.212+0000 7f5488493640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548015bfd0 con 0x7f54800cf2e0 2023-07-21T22:18:40.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.212+0000 7f5488493640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54800cfd10 con 0x7f54800ca790 2023-07-21T22:18:40.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.216+0000 7f5485a2e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f54800cf2e0 0x7f54800cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.216+0000 7f5485a2e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f54800cf2e0 0x7f54800cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:44666/0 (socket says 172.21.15.6:44666) 2023-07-21T22:18:40.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.216+0000 7f5486a30640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54800ca790 0x7f54800cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.216+0000 7f5485a2e640 1 -- 172.21.15.6:0/3088053921 learned_addr learned my addr 172.21.15.6:0/3088053921 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:40.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.216+0000 7f548622f640 1 --1- 172.21.15.6:0/3088053921 >> v1:172.21.15.161:6789/0 conn(0x7f548006a540 0x7f548006a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:60008/0 (socket says 172.21.15.6:60008) 2023-07-21T22:18:40.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.216+0000 7f5485a2e640 1 -- 172.21.15.6:0/3088053921 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54800ca790 msgr2=0x7f54800cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:40.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.216+0000 7f5485a2e640 1 --2- 172.21.15.6:0/3088053921 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54800ca790 0x7f54800cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.216+0000 7f5485a2e640 1 -- 172.21.15.6:0/3088053921 >> v1:172.21.15.161:6789/0 conn(0x7f548006a540 legacy=0x7f548006a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.216+0000 7f5485a2e640 1 -- 172.21.15.6:0/3088053921 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54800cfff0 con 0x7f54800cf2e0 2023-07-21T22:18:40.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.216+0000 7f548522d640 1 -- 172.21.15.6:0/3088053921 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757371183 0 0) 0x7f54800d0920 con 0x7f548006a540 2023-07-21T22:18:40.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.216+0000 7f5485a2e640 1 --2- 172.21.15.6:0/3088053921 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54800cf2e0 0x7f54800cf710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5470009870 tx=0x7f547001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc838086c8cb0a95 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:40.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.216+0000 7f548522d640 1 -- 172.21.15.6:0/3088053921 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54700aa670 con 0x7f54800cf2e0 2023-07-21T22:18:40.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.216+0000 7f548522d640 1 -- 172.21.15.6:0/3088053921 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54700aa7d0 con 0x7f54800cf2e0 2023-07-21T22:18:40.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.216+0000 7f548522d640 1 -- 172.21.15.6:0/3088053921 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54700aab60 con 0x7f54800cf2e0 2023-07-21T22:18:40.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5488493640 1 -- 172.21.15.6:0/3088053921 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54800cf2e0 msgr2=0x7f54800cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5488493640 1 --2- 172.21.15.6:0/3088053921 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54800cf2e0 0x7f54800cf710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5470009870 tx=0x7f547001c510 comp rx=0 tx=0).stop 2023-07-21T22:18:40.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5488493640 1 -- 172.21.15.6:0/3088053921 shutdown_connections 2023-07-21T22:18:40.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5488493640 1 --2- 172.21.15.6:0/3088053921 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54800ca790 0x7f54800cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5488493640 1 --2- 172.21.15.6:0/3088053921 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54800cf2e0 0x7f54800cf710 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5488493640 1 -- 172.21.15.6:0/3088053921 >> 172.21.15.6:0/3088053921 conn(0x7f5480099490 msgr2=0x7f5480089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:40.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5488493640 1 -- 172.21.15.6:0/3088053921 shutdown_connections 2023-07-21T22:18:40.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5488493640 1 -- 172.21.15.6:0/3088053921 wait complete. 2023-07-21T22:18:40.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5488493640 1 Processor -- start 2023-07-21T22:18:40.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5488493640 1 -- start start 2023-07-21T22:18:40.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5488493640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f548006a540 0x7f548014cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5488493640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54800ca790 0x7f54801539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5488493640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54800cf2e0 0x7f5480153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5488493640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5480155340 con 0x7f54800ca790 2023-07-21T22:18:40.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5488493640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5480154730 con 0x7f548006a540 2023-07-21T22:18:40.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5488493640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5480154a10 con 0x7f54800cf2e0 2023-07-21T22:18:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5485a2e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54800ca790 0x7f54801539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5485a2e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54800ca790 0x7f54801539c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54570/0 (socket says 172.21.15.6:54570) 2023-07-21T22:18:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5485a2e640 1 -- 172.21.15.6:0/26297517 learned_addr learned my addr 172.21.15.6:0/26297517 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f548622f640 1 --2- 172.21.15.6:0/26297517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f548006a540 0x7f548014cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5486a30640 1 --2- 172.21.15.6:0/26297517 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54800cf2e0 0x7f5480153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5485a2e640 1 -- 172.21.15.6:0/26297517 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54800cf2e0 msgr2=0x7f5480153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5485a2e640 1 --2- 172.21.15.6:0/26297517 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54800cf2e0 0x7f5480153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5485a2e640 1 -- 172.21.15.6:0/26297517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f548006a540 msgr2=0x7f548014cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5485a2e640 1 --2- 172.21.15.6:0/26297517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f548006a540 0x7f548014cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5485a2e640 1 -- 172.21.15.6:0/26297517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54700094d0 con 0x7f54800ca790 2023-07-21T22:18:40.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5486a30640 1 --2- 172.21.15.6:0/26297517 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54800cf2e0 0x7f5480153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:40.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.220+0000 7f5485a2e640 1 --2- 172.21.15.6:0/26297517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54800ca790 0x7f54801539c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f54700ac040 tx=0x7f547001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:40.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.224+0000 7f5476ffd640 1 -- 172.21.15.6:0/26297517 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54700aad50 con 0x7f54800ca790 2023-07-21T22:18:40.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.224+0000 7f5476ffd640 1 -- 172.21.15.6:0/26297517 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54700b7070 con 0x7f54800ca790 2023-07-21T22:18:40.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.224+0000 7f5476ffd640 1 -- 172.21.15.6:0/26297517 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470004220 con 0x7f54800ca790 2023-07-21T22:18:40.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.224+0000 7f5488493640 1 -- 172.21.15.6:0/26297517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5480154cf0 con 0x7f54800ca790 2023-07-21T22:18:40.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.224+0000 7f5488493640 1 -- 172.21.15.6:0/26297517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5480154440 con 0x7f54800ca790 2023-07-21T22:18:40.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.224+0000 7f5488493640 1 -- 172.21.15.6:0/26297517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54801554b0 con 0x7f54800ca790 2023-07-21T22:18:40.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.224+0000 7f5476ffd640 1 -- 172.21.15.6:0/26297517 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5470004380 con 0x7f54800ca790 2023-07-21T22:18:40.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.224+0000 7f5476ffd640 1 --2- 172.21.15.6:0/26297517 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5464066280 0x7f5464068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.224+0000 7f5476ffd640 1 -- 172.21.15.6:0/26297517 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f547011dac0 con 0x7f54800ca790 2023-07-21T22:18:40.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.224+0000 7f548622f640 1 --2- 172.21.15.6:0/26297517 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5464066280 0x7f5464068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.228+0000 7f548622f640 1 --2- 172.21.15.6:0/26297517 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5464066280 0x7f5464068730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f547c007fd0 tx=0x7f547c007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:40.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.228+0000 7f5476ffd640 1 -- 172.21.15.6:0/26297517 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f54700eb1f0 con 0x7f54800ca790 2023-07-21T22:18:40.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.384+0000 7f5488493640 1 -- 172.21.15.6:0/26297517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5480154b50 con 0x7f54800ca790 2023-07-21T22:18:40.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.384+0000 7f5476ffd640 1 -- 172.21.15.6:0/26297517 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5480154b50 con 0x7f54800ca790 2023-07-21T22:18:40.431 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:18:40.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.388+0000 7f5488493640 1 -- 172.21.15.6:0/26297517 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5464066280 msgr2=0x7f5464068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.388+0000 7f5488493640 1 --2- 172.21.15.6:0/26297517 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5464066280 0x7f5464068730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f547c007fd0 tx=0x7f547c007d60 comp rx=0 tx=0).stop 2023-07-21T22:18:40.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.388+0000 7f5488493640 1 -- 172.21.15.6:0/26297517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54800ca790 msgr2=0x7f54801539c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.388+0000 7f5488493640 1 --2- 172.21.15.6:0/26297517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54800ca790 0x7f54801539c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f54700ac040 tx=0x7f547001ad50 comp rx=0 tx=0).stop 2023-07-21T22:18:40.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.388+0000 7f5488493640 1 -- 172.21.15.6:0/26297517 shutdown_connections 2023-07-21T22:18:40.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.388+0000 7f5488493640 1 --2- 172.21.15.6:0/26297517 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54800cf2e0 0x7f5480153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.388+0000 7f5488493640 1 --2- 172.21.15.6:0/26297517 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5464066280 0x7f5464068730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.388+0000 7f5488493640 1 --2- 172.21.15.6:0/26297517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54800ca790 0x7f54801539c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.388+0000 7f5488493640 1 --2- 172.21.15.6:0/26297517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f548006a540 0x7f548014cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.388+0000 7f5488493640 1 -- 172.21.15.6:0/26297517 >> 172.21.15.6:0/26297517 conn(0x7f5480099490 msgr2=0x7f54800b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:40.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.388+0000 7f5488493640 1 -- 172.21.15.6:0/26297517 shutdown_connections 2023-07-21T22:18:40.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.388+0000 7f5488493640 1 -- 172.21.15.6:0/26297517 wait complete. 2023-07-21T22:18:40.452 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:18:40.502 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:18:40.508 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:18:40.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.556+0000 7f596799d640 1 Processor -- start 2023-07-21T22:18:40.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.556+0000 7f596799d640 1 -- start start 2023-07-21T22:18:40.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.556+0000 7f596799d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f59600aeb40 0x7f596015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.556+0000 7f596799d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59600aef10 0x7f5960158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.556+0000 7f596799d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5960159270 0x7f59600c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.556+0000 7f596799d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59601532b0 con 0x7f5960159270 2023-07-21T22:18:40.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.556+0000 7f596799d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59600ca6f0 con 0x7f59600aeb40 2023-07-21T22:18:40.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.556+0000 7f596799d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59601599d0 con 0x7f59600aef10 2023-07-21T22:18:40.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.556+0000 7f5965f3a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5960159270 0x7f59600c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.556+0000 7f5965f3a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5960159270 0x7f59600c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54582/0 (socket says 172.21.15.6:54582) 2023-07-21T22:18:40.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.556+0000 7f5965f3a640 1 -- 172.21.15.6:0/1959521949 learned_addr learned my addr 172.21.15.6:0/1959521949 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:40.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.556+0000 7f5964f38640 1 --2- 172.21.15.6:0/1959521949 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59600aef10 0x7f5960158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.556+0000 7f5965739640 1 --2- 172.21.15.6:0/1959521949 >> v2:172.21.15.161:3300/0 conn(0x7f59600aeb40 0x7f596015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.556+0000 7f5965f3a640 1 -- 172.21.15.6:0/1959521949 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59600aef10 msgr2=0x7f5960158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:40.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.556+0000 7f5965f3a640 1 --2- 172.21.15.6:0/1959521949 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59600aef10 0x7f5960158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.556+0000 7f5965f3a640 1 -- 172.21.15.6:0/1959521949 >> v2:172.21.15.161:3300/0 conn(0x7f59600aeb40 msgr2=0x7f596015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.556+0000 7f5965f3a640 1 --2- 172.21.15.6:0/1959521949 >> v2:172.21.15.161:3300/0 conn(0x7f59600aeb40 0x7f596015cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.556+0000 7f5965f3a640 1 -- 172.21.15.6:0/1959521949 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5960159cb0 con 0x7f5960159270 2023-07-21T22:18:40.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.560+0000 7f5965f3a640 1 --2- 172.21.15.6:0/1959521949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5960159270 0x7f59600c88c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5960071ad0 tx=0x7f595801eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97580465c9b733c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:40.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.560+0000 7f5957fff640 1 -- 172.21.15.6:0/1959521949 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59580a79b0 con 0x7f5960159270 2023-07-21T22:18:40.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.560+0000 7f5957fff640 1 -- 172.21.15.6:0/1959521949 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59580a7b10 con 0x7f5960159270 2023-07-21T22:18:40.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.560+0000 7f5957fff640 1 -- 172.21.15.6:0/1959521949 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59580a7ea0 con 0x7f5960159270 2023-07-21T22:18:40.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.560+0000 7f596799d640 1 -- 172.21.15.6:0/1959521949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5960159270 msgr2=0x7f59600c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.560+0000 7f596799d640 1 --2- 172.21.15.6:0/1959521949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5960159270 0x7f59600c88c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5960071ad0 tx=0x7f595801eb20 comp rx=0 tx=0).stop 2023-07-21T22:18:40.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.560+0000 7f596799d640 1 -- 172.21.15.6:0/1959521949 shutdown_connections 2023-07-21T22:18:40.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.560+0000 7f596799d640 1 --2- 172.21.15.6:0/1959521949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5960159270 0x7f59600c88c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.560+0000 7f596799d640 1 --2- 172.21.15.6:0/1959521949 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59600aef10 0x7f5960158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.560+0000 7f596799d640 1 --2- 172.21.15.6:0/1959521949 >> v2:172.21.15.161:3300/0 conn(0x7f59600aeb40 0x7f596015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.560+0000 7f596799d640 1 -- 172.21.15.6:0/1959521949 >> 172.21.15.6:0/1959521949 conn(0x7f59600cde90 msgr2=0x7f59600ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:40.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.560+0000 7f596799d640 1 -- 172.21.15.6:0/1959521949 shutdown_connections 2023-07-21T22:18:40.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.560+0000 7f596799d640 1 -- 172.21.15.6:0/1959521949 wait complete. 2023-07-21T22:18:40.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f596799d640 1 Processor -- start 2023-07-21T22:18:40.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f596799d640 1 -- start start 2023-07-21T22:18:40.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f596799d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59600aeb40 0x7f596014daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f596799d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59600aef10 0x7f5960157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f596799d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5960159270 0x7f59601547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f596799d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596014dfe0 con 0x7f59600aeb40 2023-07-21T22:18:40.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f596799d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5960161970 con 0x7f5960159270 2023-07-21T22:18:40.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f596799d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5960161c10 con 0x7f59600aef10 2023-07-21T22:18:40.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f5965739640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59600aeb40 0x7f596014daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f5965739640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59600aeb40 0x7f596014daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54592/0 (socket says 172.21.15.6:54592) 2023-07-21T22:18:40.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f5965739640 1 -- 172.21.15.6:0/2766613138 learned_addr learned my addr 172.21.15.6:0/2766613138 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:40.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f5965f3a640 1 --2- 172.21.15.6:0/2766613138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5960159270 0x7f59601547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f5964f38640 1 --2- 172.21.15.6:0/2766613138 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59600aef10 0x7f5960157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f5965739640 1 -- 172.21.15.6:0/2766613138 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59600aef10 msgr2=0x7f5960157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f5965739640 1 --2- 172.21.15.6:0/2766613138 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59600aef10 0x7f5960157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f5965739640 1 -- 172.21.15.6:0/2766613138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5960159270 msgr2=0x7f59601547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f5965739640 1 --2- 172.21.15.6:0/2766613138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5960159270 0x7f59601547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f5965739640 1 -- 172.21.15.6:0/2766613138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5958009b30 con 0x7f59600aeb40 2023-07-21T22:18:40.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f5964f38640 1 --2- 172.21.15.6:0/2766613138 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59600aef10 0x7f5960157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:40.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f5965739640 1 --2- 172.21.15.6:0/2766613138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59600aeb40 0x7f596014daa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f595c00e930 tx=0x7f595c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:40.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f5955ffb640 1 -- 172.21.15.6:0/2766613138 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c009690 con 0x7f59600aeb40 2023-07-21T22:18:40.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f5955ffb640 1 -- 172.21.15.6:0/2766613138 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595c00ca00 con 0x7f59600aeb40 2023-07-21T22:18:40.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f596799d640 1 -- 172.21.15.6:0/2766613138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5960161ef0 con 0x7f59600aeb40 2023-07-21T22:18:40.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f5955ffb640 1 -- 172.21.15.6:0/2766613138 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c00cd70 con 0x7f59600aeb40 2023-07-21T22:18:40.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.564+0000 7f596799d640 1 -- 172.21.15.6:0/2766613138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59601580e0 con 0x7f59600aeb40 2023-07-21T22:18:40.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.568+0000 7f596799d640 1 -- 172.21.15.6:0/2766613138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59600678d0 con 0x7f59600aeb40 2023-07-21T22:18:40.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.568+0000 7f5955ffb640 1 -- 172.21.15.6:0/2766613138 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f595c013470 con 0x7f59600aeb40 2023-07-21T22:18:40.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.568+0000 7f5955ffb640 1 --2- 172.21.15.6:0/2766613138 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5944066280 0x7f5944068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.568+0000 7f5955ffb640 1 -- 172.21.15.6:0/2766613138 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f595c083bf0 con 0x7f59600aeb40 2023-07-21T22:18:40.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.568+0000 7f5964f38640 1 --2- 172.21.15.6:0/2766613138 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5944066280 0x7f5944068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.568+0000 7f5964f38640 1 --2- 172.21.15.6:0/2766613138 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5944066280 0x7f5944068730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f59601577c0 tx=0x7f5950008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:40.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.572+0000 7f5955ffb640 1 -- 172.21.15.6:0/2766613138 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f595c051490 con 0x7f59600aeb40 2023-07-21T22:18:40.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.728+0000 7f596799d640 1 -- 172.21.15.6:0/2766613138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f59600c2ee0 con 0x7f59600aeb40 2023-07-21T22:18:40.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.728+0000 7f5955ffb640 1 -- 172.21.15.6:0/2766613138 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f595c0170a0 con 0x7f59600aeb40 2023-07-21T22:18:40.776 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:18:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.732+0000 7f596799d640 1 -- 172.21.15.6:0/2766613138 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5944066280 msgr2=0x7f5944068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.732+0000 7f596799d640 1 --2- 172.21.15.6:0/2766613138 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5944066280 0x7f5944068730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f59601577c0 tx=0x7f5950008040 comp rx=0 tx=0).stop 2023-07-21T22:18:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.732+0000 7f596799d640 1 -- 172.21.15.6:0/2766613138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59600aeb40 msgr2=0x7f596014daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.732+0000 7f596799d640 1 --2- 172.21.15.6:0/2766613138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59600aeb40 0x7f596014daa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f595c00e930 tx=0x7f595c00edf0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.732+0000 7f596799d640 1 -- 172.21.15.6:0/2766613138 shutdown_connections 2023-07-21T22:18:40.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.732+0000 7f596799d640 1 --2- 172.21.15.6:0/2766613138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5960159270 0x7f59601547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.732+0000 7f596799d640 1 --2- 172.21.15.6:0/2766613138 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59600aef10 0x7f5960157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.732+0000 7f596799d640 1 --2- 172.21.15.6:0/2766613138 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5944066280 0x7f5944068730 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.732+0000 7f596799d640 1 --2- 172.21.15.6:0/2766613138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59600aeb40 0x7f596014daa0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.732+0000 7f596799d640 1 -- 172.21.15.6:0/2766613138 >> 172.21.15.6:0/2766613138 conn(0x7f59600cde90 msgr2=0x7f5960152a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:40.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.732+0000 7f596799d640 1 -- 172.21.15.6:0/2766613138 shutdown_connections 2023-07-21T22:18:40.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.732+0000 7f596799d640 1 -- 172.21.15.6:0/2766613138 wait complete. 2023-07-21T22:18:40.798 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T22:18:40.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.896+0000 7ff349ed5640 1 Processor -- start 2023-07-21T22:18:40.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.896+0000 7ff349ed5640 1 -- start start 2023-07-21T22:18:40.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.896+0000 7ff349ed5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440b7a10 0x7ff34406a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.896+0000 7ff349ed5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3440cf2e0 con 0x7ff3440cee90 2023-07-21T22:18:40.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.896+0000 7ff349ed5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3440ccee0 con 0x7ff3440b42c0 2023-07-21T22:18:40.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.896+0000 7ff349ed5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440cff30 con 0x7ff3440b7a10 2023-07-21T22:18:40.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.896+0000 7ff343fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff3440cee90 0x7ff3440b3bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41630/0 (socket says 172.21.15.6:41630) 2023-07-21T22:18:40.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.896+0000 7ff343fff640 1 -- 172.21.15.6:0/2633528167 learned_addr learned my addr 172.21.15.6:0/2633528167 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:40.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.896+0000 7ff348ed3640 1 --2- 172.21.15.6:0/2633528167 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440b7a10 0x7ff34406a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.896+0000 7ff3437fe640 1 -- 172.21.15.6:0/2633528167 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111901036 0 0) 0x7ff3440cf2e0 con 0x7ff3440cee90 2023-07-21T22:18:40.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.896+0000 7ff3437fe640 1 -- 172.21.15.6:0/2633528167 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff334003530 con 0x7ff3440cee90 2023-07-21T22:18:40.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.896+0000 7ff348ed3640 1 -- 172.21.15.6:0/2633528167 >> v1:172.21.15.161:6789/0 conn(0x7ff3440b42c0 legacy=0x7ff3440d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.896+0000 7ff3437fe640 1 -- 172.21.15.6:0/2633528167 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597196438 0 0) 0x7ff3440ccee0 con 0x7ff3440b42c0 2023-07-21T22:18:40.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.896+0000 7ff348ed3640 1 -- 172.21.15.6:0/2633528167 >> v1:172.21.15.6:6789/0 conn(0x7ff3440cee90 legacy=0x7ff3440b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.896+0000 7ff348ed3640 1 -- 172.21.15.6:0/2633528167 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3440cc920 con 0x7ff3440b7a10 2023-07-21T22:18:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.900+0000 7ff348ed3640 1 --2- 172.21.15.6:0/2633528167 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440b7a10 0x7ff34406a9b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff3380097f0 tx=0x7ff33801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bce657307937a01 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.900+0000 7ff3437fe640 1 -- 172.21.15.6:0/2633528167 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3380aa610 con 0x7ff3440b7a10 2023-07-21T22:18:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.900+0000 7ff3437fe640 1 -- 172.21.15.6:0/2633528167 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3380a6040 con 0x7ff3440b7a10 2023-07-21T22:18:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.900+0000 7ff3437fe640 1 -- 172.21.15.6:0/2633528167 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3380aa970 con 0x7ff3440b7a10 2023-07-21T22:18:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.900+0000 7ff349ed5640 1 -- 172.21.15.6:0/2633528167 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440b7a10 msgr2=0x7ff34406a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.900+0000 7ff349ed5640 1 --2- 172.21.15.6:0/2633528167 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440b7a10 0x7ff34406a9b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff3380097f0 tx=0x7ff33801c490 comp rx=0 tx=0).stop 2023-07-21T22:18:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.900+0000 7ff349ed5640 1 -- 172.21.15.6:0/2633528167 shutdown_connections 2023-07-21T22:18:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.900+0000 7ff349ed5640 1 --2- 172.21.15.6:0/2633528167 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440b7a10 0x7ff34406a9b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.900+0000 7ff349ed5640 1 -- 172.21.15.6:0/2633528167 >> 172.21.15.6:0/2633528167 conn(0x7ff344069ea0 msgr2=0x7ff34406a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.900+0000 7ff349ed5640 1 -- 172.21.15.6:0/2633528167 shutdown_connections 2023-07-21T22:18:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.900+0000 7ff349ed5640 1 -- 172.21.15.6:0/2633528167 wait complete. 2023-07-21T22:18:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff349ed5640 1 Processor -- start 2023-07-21T22:18:40.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff349ed5640 1 -- start start 2023-07-21T22:18:40.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff349ed5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3440b42c0 0x7ff3441470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff349ed5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3440b7a10 0x7ff34414f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff349ed5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440cee90 0x7ff34414fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff349ed5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440c8b30 con 0x7ff3440b7a10 2023-07-21T22:18:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff349ed5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440b39a0 con 0x7ff3440b42c0 2023-07-21T22:18:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff349ed5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440b2d90 con 0x7ff3440cee90 2023-07-21T22:18:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff343fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3440b7a10 0x7ff34414f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff343fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3440b7a10 0x7ff34414f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54594/0 (socket says 172.21.15.6:54594) 2023-07-21T22:18:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff343fff640 1 -- 172.21.15.6:0/3114609728 learned_addr learned my addr 172.21.15.6:0/3114609728 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:40.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff348ed3640 1 --2- 172.21.15.6:0/3114609728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3440b42c0 0x7ff3441470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff3496d4640 1 --2- 172.21.15.6:0/3114609728 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440cee90 0x7ff34414fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff343fff640 1 -- 172.21.15.6:0/3114609728 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440cee90 msgr2=0x7ff34414fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff343fff640 1 --2- 172.21.15.6:0/3114609728 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440cee90 0x7ff34414fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff343fff640 1 -- 172.21.15.6:0/3114609728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3440b42c0 msgr2=0x7ff3441470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff343fff640 1 --2- 172.21.15.6:0/3114609728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3440b42c0 0x7ff3441470c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff343fff640 1 -- 172.21.15.6:0/3114609728 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff338009420 con 0x7ff3440b7a10 2023-07-21T22:18:40.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff348ed3640 1 --2- 172.21.15.6:0/3114609728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3440b42c0 0x7ff3441470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:40.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff3496d4640 1 --2- 172.21.15.6:0/3114609728 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440cee90 0x7ff34414fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:40.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff343fff640 1 --2- 172.21.15.6:0/3114609728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3440b7a10 0x7ff34414f820 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff33000c450 tx=0x7ff33000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:40.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff3417fa640 1 -- 172.21.15.6:0/3114609728 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff330005cf0 con 0x7ff3440b7a10 2023-07-21T22:18:40.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff3417fa640 1 -- 172.21.15.6:0/3114609728 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff330005e50 con 0x7ff3440b7a10 2023-07-21T22:18:40.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff3417fa640 1 -- 172.21.15.6:0/3114609728 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff330007290 con 0x7ff3440b7a10 2023-07-21T22:18:40.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff349ed5640 1 -- 172.21.15.6:0/3114609728 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3440b3070 con 0x7ff3440b7a10 2023-07-21T22:18:40.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.904+0000 7ff349ed5640 1 -- 172.21.15.6:0/3114609728 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3440b3630 con 0x7ff3440b7a10 2023-07-21T22:18:40.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.908+0000 7ff349ed5640 1 -- 172.21.15.6:0/3114609728 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3440678d0 con 0x7ff3440b7a10 2023-07-21T22:18:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.908+0000 7ff3417fa640 1 -- 172.21.15.6:0/3114609728 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff3300073f0 con 0x7ff3440b7a10 2023-07-21T22:18:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.908+0000 7ff3417fa640 1 --2- 172.21.15.6:0/3114609728 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff3280662b0 0x7ff328068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.908+0000 7ff3417fa640 1 -- 172.21.15.6:0/3114609728 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff330082fd0 con 0x7ff3440b7a10 2023-07-21T22:18:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.908+0000 7ff348ed3640 1 --2- 172.21.15.6:0/3114609728 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff3280662b0 0x7ff328068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.908+0000 7ff348ed3640 1 --2- 172.21.15.6:0/3114609728 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff3280662b0 0x7ff328068760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff3380ae000 tx=0x7ff338008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:40.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:40.912+0000 7ff3417fa640 1 -- 172.21.15.6:0/3114609728 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff330050700 con 0x7ff3440b7a10 2023-07-21T22:18:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.072+0000 7ff349ed5640 1 -- 172.21.15.6:0/3114609728 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff34406b1b0 con 0x7ff3440b7a10 2023-07-21T22:18:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.072+0000 7ff3417fa640 1 -- 172.21.15.6:0/3114609728 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v22) v1 ==== 84+0+126 (secure 0 0 0) 0x7ff330017020 con 0x7ff3440b7a10 2023-07-21T22:18:41.119 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:18:41.119 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:18:41.119 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:18:41.120 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-07-21T22:18:41.120 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-07-21T22:18:41.120 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:18:41.120 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:18:41.120 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-07-21T22:18:41.121 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-07-21T22:18:41.121 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:18:41.121 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:18:41.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.072+0000 7ff349ed5640 1 -- 172.21.15.6:0/3114609728 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff3280662b0 msgr2=0x7ff328068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:41.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.072+0000 7ff349ed5640 1 --2- 172.21.15.6:0/3114609728 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff3280662b0 0x7ff328068760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff3380ae000 tx=0x7ff338008040 comp rx=0 tx=0).stop 2023-07-21T22:18:41.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.072+0000 7ff349ed5640 1 -- 172.21.15.6:0/3114609728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3440b7a10 msgr2=0x7ff34414f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:41.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.072+0000 7ff349ed5640 1 --2- 172.21.15.6:0/3114609728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3440b7a10 0x7ff34414f820 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff33000c450 tx=0x7ff33000c910 comp rx=0 tx=0).stop 2023-07-21T22:18:41.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.072+0000 7ff349ed5640 1 -- 172.21.15.6:0/3114609728 shutdown_connections 2023-07-21T22:18:41.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.072+0000 7ff349ed5640 1 --2- 172.21.15.6:0/3114609728 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440cee90 0x7ff34414fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.072+0000 7ff349ed5640 1 --2- 172.21.15.6:0/3114609728 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff3280662b0 0x7ff328068760 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.072+0000 7ff349ed5640 1 --2- 172.21.15.6:0/3114609728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3440b7a10 0x7ff34414f820 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.072+0000 7ff349ed5640 1 --2- 172.21.15.6:0/3114609728 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3440b42c0 0x7ff3441470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.072+0000 7ff349ed5640 1 -- 172.21.15.6:0/3114609728 >> 172.21.15.6:0/3114609728 conn(0x7ff344069ea0 msgr2=0x7ff34415f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:41.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.072+0000 7ff349ed5640 1 -- 172.21.15.6:0/3114609728 shutdown_connections 2023-07-21T22:18:41.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.072+0000 7ff349ed5640 1 -- 172.21.15.6:0/3114609728 wait complete. 2023-07-21T22:18:41.138 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-21T22:18:41.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-21T22:18:41.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.240+0000 7f0c573fa640 1 Processor -- start 2023-07-21T22:18:41.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.240+0000 7f0c573fa640 1 -- start start 2023-07-21T22:18:41.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.240+0000 7f0c573fa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0c50070f30 0x7f0c500ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:41.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.240+0000 7f0c573fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c500af2b0 0x7f0c5015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:41.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.240+0000 7f0c573fa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c50159d70 con 0x7f0c50069430 2023-07-21T22:18:41.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.240+0000 7f0c573fa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c500c9c60 con 0x7f0c50070f30 2023-07-21T22:18:41.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.240+0000 7f0c573fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c500c9f40 con 0x7f0c500af2b0 2023-07-21T22:18:41.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.240+0000 7f0c54995640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0c50070f30 0x7f0c500ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:41.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.240+0000 7f0c55196640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0c50069430 0x7f0c50069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:60022/0 (socket says 172.21.15.6:60022) 2023-07-21T22:18:41.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.240+0000 7f0c55196640 1 -- 172.21.15.6:0/3853247071 learned_addr learned my addr 172.21.15.6:0/3853247071 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:41.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.240+0000 7f0c55997640 1 --2- 172.21.15.6:0/3853247071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c500af2b0 0x7f0c5015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:41.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.240+0000 7f0c47fff640 1 -- 172.21.15.6:0/3853247071 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778004167 0 0) 0x7f0c4c001120 con 0x7f0c50069430 2023-07-21T22:18:41.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.240+0000 7f0c47fff640 1 -- 172.21.15.6:0/3853247071 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c3c003530 con 0x7f0c50069430 2023-07-21T22:18:41.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.240+0000 7f0c54995640 1 -- 172.21.15.6:0/3853247071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c500af2b0 msgr2=0x7f0c5015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:41.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.240+0000 7f0c54995640 1 --2- 172.21.15.6:0/3853247071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c500af2b0 0x7f0c5015a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.240+0000 7f0c54995640 1 -- 172.21.15.6:0/3853247071 >> v1:172.21.15.161:6789/0 conn(0x7f0c50069430 legacy=0x7f0c50069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:41.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.240+0000 7f0c54995640 1 -- 172.21.15.6:0/3853247071 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c500ca220 con 0x7f0c50070f30 2023-07-21T22:18:41.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.240+0000 7f0c55997640 1 --2- 172.21.15.6:0/3853247071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c500af2b0 0x7f0c5015a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:41.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.244+0000 7f0c54995640 1 --2- 172.21.15.6:0/3853247071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c50070f30 0x7f0c500ad6f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0c400097c0 tx=0x7f0c4001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcdd391b4c2e635e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:41.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.244+0000 7f0c47fff640 1 -- 172.21.15.6:0/3853247071 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c400ab680 con 0x7f0c50070f30 2023-07-21T22:18:41.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.244+0000 7f0c47fff640 1 -- 172.21.15.6:0/3853247071 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c400ab7e0 con 0x7f0c50070f30 2023-07-21T22:18:41.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.244+0000 7f0c47fff640 1 -- 172.21.15.6:0/3853247071 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c400abb50 con 0x7f0c50070f30 2023-07-21T22:18:41.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.244+0000 7f0c573fa640 1 -- 172.21.15.6:0/3853247071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c50070f30 msgr2=0x7f0c500ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.244+0000 7f0c573fa640 1 --2- 172.21.15.6:0/3853247071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c50070f30 0x7f0c500ad6f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0c400097c0 tx=0x7f0c4001c480 comp rx=0 tx=0).stop 2023-07-21T22:18:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.244+0000 7f0c573fa640 1 -- 172.21.15.6:0/3853247071 shutdown_connections 2023-07-21T22:18:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.244+0000 7f0c573fa640 1 --2- 172.21.15.6:0/3853247071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c500af2b0 0x7f0c5015a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.244+0000 7f0c573fa640 1 --2- 172.21.15.6:0/3853247071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c50070f30 0x7f0c500ad6f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.244+0000 7f0c573fa640 1 -- 172.21.15.6:0/3853247071 >> 172.21.15.6:0/3853247071 conn(0x7f0c500cde90 msgr2=0x7f0c500ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.244+0000 7f0c573fa640 1 -- 172.21.15.6:0/3853247071 shutdown_connections 2023-07-21T22:18:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.244+0000 7f0c573fa640 1 -- 172.21.15.6:0/3853247071 wait complete. 2023-07-21T22:18:41.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c573fa640 1 Processor -- start 2023-07-21T22:18:41.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c573fa640 1 -- start start 2023-07-21T22:18:41.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c573fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c50069430 0x7f0c50156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:41.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c573fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c50070f30 0x7f0c500c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:41.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c573fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c500af2b0 0x7f0c50150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:41.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c573fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c50150f90 con 0x7f0c500af2b0 2023-07-21T22:18:41.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c573fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c50151210 con 0x7f0c50070f30 2023-07-21T22:18:41.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c573fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c500b0e60 con 0x7f0c50069430 2023-07-21T22:18:41.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c55997640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c500af2b0 0x7f0c50150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:41.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c55997640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c500af2b0 0x7f0c50150a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54598/0 (socket says 172.21.15.6:54598) 2023-07-21T22:18:41.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c55997640 1 -- 172.21.15.6:0/576308445 learned_addr learned my addr 172.21.15.6:0/576308445 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:41.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c55196640 1 --2- 172.21.15.6:0/576308445 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c50069430 0x7f0c50156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:41.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c54995640 1 --2- 172.21.15.6:0/576308445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c50070f30 0x7f0c500c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:41.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c55997640 1 -- 172.21.15.6:0/576308445 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c50069430 msgr2=0x7f0c50156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:41.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c55997640 1 --2- 172.21.15.6:0/576308445 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c50069430 0x7f0c50156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c55997640 1 -- 172.21.15.6:0/576308445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c50070f30 msgr2=0x7f0c500c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:41.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c55997640 1 --2- 172.21.15.6:0/576308445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c50070f30 0x7f0c500c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c55997640 1 -- 172.21.15.6:0/576308445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c48009a70 con 0x7f0c500af2b0 2023-07-21T22:18:41.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c55997640 1 --2- 172.21.15.6:0/576308445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c500af2b0 0x7f0c50150a50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800efc0 tx=0x7f0c48009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:41.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c45ffb640 1 -- 172.21.15.6:0/576308445 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48009d70 con 0x7f0c500af2b0 2023-07-21T22:18:41.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c45ffb640 1 -- 172.21.15.6:0/576308445 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4800f040 con 0x7f0c500af2b0 2023-07-21T22:18:41.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c45ffb640 1 -- 172.21.15.6:0/576308445 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c480039a0 con 0x7f0c500af2b0 2023-07-21T22:18:41.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c573fa640 1 -- 172.21.15.6:0/576308445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c40009420 con 0x7f0c500af2b0 2023-07-21T22:18:41.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.248+0000 7f0c573fa640 1 -- 172.21.15.6:0/576308445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c500b1420 con 0x7f0c500af2b0 2023-07-21T22:18:41.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.252+0000 7f0c573fa640 1 -- 172.21.15.6:0/576308445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c500678d0 con 0x7f0c500af2b0 2023-07-21T22:18:41.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.252+0000 7f0c45ffb640 1 -- 172.21.15.6:0/576308445 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0c480144a0 con 0x7f0c500af2b0 2023-07-21T22:18:41.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.252+0000 7f0c45ffb640 1 --2- 172.21.15.6:0/576308445 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0c34066280 0x7f0c34068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:41.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.252+0000 7f0c45ffb640 1 -- 172.21.15.6:0/576308445 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0c48084600 con 0x7f0c500af2b0 2023-07-21T22:18:41.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.252+0000 7f0c55196640 1 --2- 172.21.15.6:0/576308445 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0c34066280 0x7f0c34068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:41.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.256+0000 7f0c55196640 1 --2- 172.21.15.6:0/576308445 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0c34066280 0x7f0c34068730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c001280 tx=0x7f0c4c007bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:41.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.256+0000 7f0c45ffb640 1 -- 172.21.15.6:0/576308445 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c48051de0 con 0x7f0c500af2b0 2023-07-21T22:18:41.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:41.416+0000 7f0c573fa640 1 -- 172.21.15.6:0/576308445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0c500aeb80 con 0x7f0c500af2b0 2023-07-21T22:18:42.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.300+0000 7f0c45ffb640 1 -- 172.21.15.6:0/576308445 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0c48055400 con 0x7f0c500af2b0 2023-07-21T22:18:42.348 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-07-21T22:18:42.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.308+0000 7f0c573fa640 1 -- 172.21.15.6:0/576308445 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0c34066280 msgr2=0x7f0c34068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:42.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.308+0000 7f0c573fa640 1 --2- 172.21.15.6:0/576308445 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0c34066280 0x7f0c34068730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c001280 tx=0x7f0c4c007bc0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.308+0000 7f0c573fa640 1 -- 172.21.15.6:0/576308445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c500af2b0 msgr2=0x7f0c50150a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:42.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.308+0000 7f0c573fa640 1 --2- 172.21.15.6:0/576308445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c500af2b0 0x7f0c50150a50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800efc0 tx=0x7f0c48009f90 comp rx=0 tx=0).stop 2023-07-21T22:18:42.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.308+0000 7f0c573fa640 1 -- 172.21.15.6:0/576308445 shutdown_connections 2023-07-21T22:18:42.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.308+0000 7f0c573fa640 1 --2- 172.21.15.6:0/576308445 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0c34066280 0x7f0c34068730 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.308+0000 7f0c573fa640 1 --2- 172.21.15.6:0/576308445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c500af2b0 0x7f0c50150a50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.308+0000 7f0c573fa640 1 --2- 172.21.15.6:0/576308445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c50070f30 0x7f0c500c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.308+0000 7f0c573fa640 1 --2- 172.21.15.6:0/576308445 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c50069430 0x7f0c50156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.308+0000 7f0c573fa640 1 -- 172.21.15.6:0/576308445 >> 172.21.15.6:0/576308445 conn(0x7f0c500cde90 msgr2=0x7f0c50069800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:42.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.308+0000 7f0c573fa640 1 -- 172.21.15.6:0/576308445 shutdown_connections 2023-07-21T22:18:42.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.308+0000 7f0c573fa640 1 -- 172.21.15.6:0/576308445 wait complete. 2023-07-21T22:18:42.379 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T22:18:42.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.488+0000 7f44e8af9640 1 Processor -- start 2023-07-21T22:18:42.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.488+0000 7f44e8af9640 1 -- start start 2023-07-21T22:18:42.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.488+0000 7f44e8af9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f44e415bec0 0x7f44e40cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:42.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.488+0000 7f44e8af9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e40d29f0 0x7f44e40b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:42.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.488+0000 7f44e8af9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e40d0aa0 con 0x7f44e40d0250 2023-07-21T22:18:42.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.488+0000 7f44e8af9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e40d07c0 con 0x7f44e415bec0 2023-07-21T22:18:42.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.488+0000 7f44e8af9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40b1dc0 con 0x7f44e40d29f0 2023-07-21T22:18:42.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.488+0000 7f44e2d9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e40d29f0 0x7f44e40b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:42.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.488+0000 7f44dbfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f44e40d0250 0x7f44e40d22e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:60024/0 (socket says 172.21.15.6:60024) 2023-07-21T22:18:42.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.488+0000 7f44e259c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f44e415bec0 0x7f44e40cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:42.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.488+0000 7f44dbfff640 1 -- 172.21.15.6:0/1108500698 learned_addr learned my addr 172.21.15.6:0/1108500698 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:42.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.488+0000 7f44e1d9b640 1 -- 172.21.15.6:0/1108500698 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579668389 0 0) 0x7f44cc001120 con 0x7f44e40d0250 2023-07-21T22:18:42.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.492+0000 7f44e1d9b640 1 -- 172.21.15.6:0/1108500698 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44d0003530 con 0x7f44e40d0250 2023-07-21T22:18:42.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.492+0000 7f44e259c640 1 -- 172.21.15.6:0/1108500698 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e40d29f0 msgr2=0x7f44e40b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:42.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.492+0000 7f44e259c640 1 --2- 172.21.15.6:0/1108500698 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e40d29f0 0x7f44e40b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.492+0000 7f44e259c640 1 -- 172.21.15.6:0/1108500698 >> v1:172.21.15.161:6789/0 conn(0x7f44e40d0250 legacy=0x7f44e40d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:42.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.492+0000 7f44e259c640 1 -- 172.21.15.6:0/1108500698 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e40b20a0 con 0x7f44e415bec0 2023-07-21T22:18:42.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.492+0000 7f44e2d9d640 1 --2- 172.21.15.6:0/1108500698 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e40d29f0 0x7f44e40b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:42.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.492+0000 7f44e259c640 1 --2- 172.21.15.6:0/1108500698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44e415bec0 0x7f44e40cf610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f44d40097c0 tx=0x7f44d401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd6cf55da31128bb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:42.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.492+0000 7f44e1d9b640 1 -- 172.21.15.6:0/1108500698 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d40ab5f0 con 0x7f44e415bec0 2023-07-21T22:18:42.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.492+0000 7f44e1d9b640 1 -- 172.21.15.6:0/1108500698 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d40ab750 con 0x7f44e415bec0 2023-07-21T22:18:42.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.492+0000 7f44e1d9b640 1 -- 172.21.15.6:0/1108500698 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d40abae0 con 0x7f44e415bec0 2023-07-21T22:18:42.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.492+0000 7f44e8af9640 1 -- 172.21.15.6:0/1108500698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44e415bec0 msgr2=0x7f44e40cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:42.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.492+0000 7f44e8af9640 1 --2- 172.21.15.6:0/1108500698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44e415bec0 0x7f44e40cf610 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f44d40097c0 tx=0x7f44d401c450 comp rx=0 tx=0).stop 2023-07-21T22:18:42.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e8af9640 1 -- 172.21.15.6:0/1108500698 shutdown_connections 2023-07-21T22:18:42.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e8af9640 1 --2- 172.21.15.6:0/1108500698 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e40d29f0 0x7f44e40b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e8af9640 1 --2- 172.21.15.6:0/1108500698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44e415bec0 0x7f44e40cf610 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e8af9640 1 -- 172.21.15.6:0/1108500698 >> 172.21.15.6:0/1108500698 conn(0x7f44e40659d0 msgr2=0x7f44e409b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:42.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e8af9640 1 -- 172.21.15.6:0/1108500698 shutdown_connections 2023-07-21T22:18:42.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e8af9640 1 -- 172.21.15.6:0/1108500698 wait complete. 2023-07-21T22:18:42.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e8af9640 1 Processor -- start 2023-07-21T22:18:42.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e8af9640 1 -- start start 2023-07-21T22:18:42.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e8af9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e40d0250 0x7f44e40b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:42.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e8af9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44e40d29f0 0x7f44e4155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:42.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e8af9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44e415bec0 0x7f44e414d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:42.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e8af9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40af9e0 con 0x7f44e415bec0 2023-07-21T22:18:42.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e8af9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40afca0 con 0x7f44e40d29f0 2023-07-21T22:18:42.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e8af9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40aff80 con 0x7f44e40d0250 2023-07-21T22:18:42.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44e415bec0 0x7f44e414d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:42.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44e415bec0 0x7f44e414d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54612/0 (socket says 172.21.15.6:54612) 2023-07-21T22:18:42.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e2d9d640 1 -- 172.21.15.6:0/3241961582 learned_addr learned my addr 172.21.15.6:0/3241961582 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:42.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44dbfff640 1 --2- 172.21.15.6:0/3241961582 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44e40d29f0 0x7f44e4155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:42.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e259c640 1 --2- 172.21.15.6:0/3241961582 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e40d0250 0x7f44e40b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:42.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e2d9d640 1 -- 172.21.15.6:0/3241961582 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e40d0250 msgr2=0x7f44e40b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:42.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e2d9d640 1 --2- 172.21.15.6:0/3241961582 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e40d0250 0x7f44e40b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e2d9d640 1 -- 172.21.15.6:0/3241961582 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44e40d29f0 msgr2=0x7f44e4155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e2d9d640 1 --2- 172.21.15.6:0/3241961582 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44e40d29f0 0x7f44e4155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.496+0000 7f44e2d9d640 1 -- 172.21.15.6:0/3241961582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44dc009a70 con 0x7f44e415bec0 2023-07-21T22:18:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.500+0000 7f44e2d9d640 1 --2- 172.21.15.6:0/3241961582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44e415bec0 0x7f44e414d4d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00efc0 tx=0x7f44dc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.500+0000 7f44daffd640 1 -- 172.21.15.6:0/3241961582 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc014480 con 0x7f44e415bec0 2023-07-21T22:18:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.500+0000 7f44daffd640 1 -- 172.21.15.6:0/3241961582 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc00f040 con 0x7f44e415bec0 2023-07-21T22:18:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.500+0000 7f44e8af9640 1 -- 172.21.15.6:0/3241961582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d4009420 con 0x7f44e415bec0 2023-07-21T22:18:42.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.500+0000 7f44daffd640 1 -- 172.21.15.6:0/3241961582 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc014840 con 0x7f44e415bec0 2023-07-21T22:18:42.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.500+0000 7f44e8af9640 1 -- 172.21.15.6:0/3241961582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e41557e0 con 0x7f44e415bec0 2023-07-21T22:18:42.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.500+0000 7f44e8af9640 1 -- 172.21.15.6:0/3241961582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e40b04a0 con 0x7f44e415bec0 2023-07-21T22:18:42.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.500+0000 7f44daffd640 1 -- 172.21.15.6:0/3241961582 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f44dc0149a0 con 0x7f44e415bec0 2023-07-21T22:18:42.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.500+0000 7f44daffd640 1 --2- 172.21.15.6:0/3241961582 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f44c4066280 0x7f44c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:42.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.500+0000 7f44daffd640 1 -- 172.21.15.6:0/3241961582 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f44dc084f60 con 0x7f44e415bec0 2023-07-21T22:18:42.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.500+0000 7f44e259c640 1 --2- 172.21.15.6:0/3241961582 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f44c4066280 0x7f44c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:42.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.504+0000 7f44e259c640 1 --2- 172.21.15.6:0/3241961582 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f44c4066280 0x7f44c4068730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44d40af000 tx=0x7f44d40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:42.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.504+0000 7f44daffd640 1 -- 172.21.15.6:0/3241961582 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44dc052650 con 0x7f44e415bec0 2023-07-21T22:18:42.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:42.660+0000 7f44e8af9640 1 -- 172.21.15.6:0/3241961582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f44e40678d0 con 0x7f44e415bec0 2023-07-21T22:18:43.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.312+0000 7f44daffd640 1 -- 172.21.15.6:0/3241961582 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v24) v1 ==== 170+0+0 (secure 0 0 0) 0x7f44dc055c70 con 0x7f44e415bec0 2023-07-21T22:18:43.359 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-07-21T22:18:43.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.324+0000 7f44e8af9640 1 -- 172.21.15.6:0/3241961582 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f44c4066280 msgr2=0x7f44c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.324+0000 7f44e8af9640 1 --2- 172.21.15.6:0/3241961582 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f44c4066280 0x7f44c4068730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44d40af000 tx=0x7f44d40a7000 comp rx=0 tx=0).stop 2023-07-21T22:18:43.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.324+0000 7f44e8af9640 1 -- 172.21.15.6:0/3241961582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44e415bec0 msgr2=0x7f44e414d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.324+0000 7f44e8af9640 1 --2- 172.21.15.6:0/3241961582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44e415bec0 0x7f44e414d4d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00efc0 tx=0x7f44dc00c490 comp rx=0 tx=0).stop 2023-07-21T22:18:43.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.324+0000 7f44e8af9640 1 -- 172.21.15.6:0/3241961582 shutdown_connections 2023-07-21T22:18:43.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.324+0000 7f44e8af9640 1 --2- 172.21.15.6:0/3241961582 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f44c4066280 0x7f44c4068730 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.324+0000 7f44e8af9640 1 --2- 172.21.15.6:0/3241961582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44e415bec0 0x7f44e414d4d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.324+0000 7f44e8af9640 1 --2- 172.21.15.6:0/3241961582 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44e40d29f0 0x7f44e4155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.324+0000 7f44e8af9640 1 --2- 172.21.15.6:0/3241961582 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e40d0250 0x7f44e40b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.324+0000 7f44e8af9640 1 -- 172.21.15.6:0/3241961582 >> 172.21.15.6:0/3241961582 conn(0x7f44e40659d0 msgr2=0x7f44e4166080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:43.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.328+0000 7f44e8af9640 1 -- 172.21.15.6:0/3241961582 shutdown_connections 2023-07-21T22:18:43.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.328+0000 7f44e8af9640 1 -- 172.21.15.6:0/3241961582 wait complete. 2023-07-21T22:18:43.407 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-21T22:18:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.508+0000 7f89567f6640 1 Processor -- start 2023-07-21T22:18:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f89567f6640 1 -- start start 2023-07-21T22:18:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f89567f6640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f895006a540 0x7f895006a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f89567f6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89500cb7a0 con 0x7f89500cf710 2023-07-21T22:18:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f89567f6640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89500d0920 con 0x7f89500cf2e0 2023-07-21T22:18:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f89567f6640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f895015bfd0 con 0x7f895006a540 2023-07-21T22:18:43.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f8954d93640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f89500cf710 0x7f89500cd0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41638/0 (socket says 172.21.15.6:41638) 2023-07-21T22:18:43.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f8954d93640 1 -- 172.21.15.6:0/1655777768 learned_addr learned my addr 172.21.15.6:0/1655777768 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:43.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894ffff640 1 --2- 172.21.15.6:0/1655777768 >> v2:172.21.15.161:3300/0 conn(0x7f895006a540 0x7f895006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894effd640 1 -- 172.21.15.6:0/1655777768 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157879543 0 0) 0x7f89500cb7a0 con 0x7f89500cf710 2023-07-21T22:18:43.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894effd640 1 -- 172.21.15.6:0/1655777768 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8938003530 con 0x7f89500cf710 2023-07-21T22:18:43.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894effd640 1 -- 172.21.15.6:0/1655777768 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833855848 0 0) 0x7f89500d0920 con 0x7f89500cf2e0 2023-07-21T22:18:43.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894effd640 1 -- 172.21.15.6:0/1655777768 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89500cb7a0 con 0x7f89500cf2e0 2023-07-21T22:18:43.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894effd640 1 -- 172.21.15.6:0/1655777768 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4287398937 0 0) 0x7f8938003530 con 0x7f89500cf710 2023-07-21T22:18:43.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894effd640 1 -- 172.21.15.6:0/1655777768 >> v2:172.21.15.161:3300/0 conn(0x7f895006a540 msgr2=0x7f895006a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894effd640 1 --2- 172.21.15.6:0/1655777768 >> v2:172.21.15.161:3300/0 conn(0x7f895006a540 0x7f895006a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894effd640 1 -- 172.21.15.6:0/1655777768 >> v1:172.21.15.161:6789/0 conn(0x7f89500cf2e0 legacy=0x7f89500cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894effd640 1 -- 172.21.15.6:0/1655777768 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89500cd7e0 con 0x7f89500cf710 2023-07-21T22:18:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894effd640 1 -- 172.21.15.6:0/1655777768 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f8948001a00 con 0x7f89500cf710 2023-07-21T22:18:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894effd640 1 -- 172.21.15.6:0/1655777768 >> v1:172.21.15.6:6789/0 conn(0x7f89500cf710 legacy=0x7f89500cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894effd640 1 --2- 172.21.15.6:0/1655777768 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8938003b10 0x7f8938003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894effd640 1 --2- 172.21.15.6:0/1655777768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89380047d0 0x7f8938004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894effd640 1 --2- 172.21.15.6:0/1655777768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8938005180 0x7f893800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894effd640 1 -- 172.21.15.6:0/1655777768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895015bfd0 con 0x7f89380047d0 2023-07-21T22:18:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894effd640 1 -- 172.21.15.6:0/1655777768 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893800bfe0 con 0x7f8938005180 2023-07-21T22:18:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894effd640 1 -- 172.21.15.6:0/1655777768 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893800c1a0 con 0x7f8938003b10 2023-07-21T22:18:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894ffff640 1 --2- 172.21.15.6:0/1655777768 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8938003b10 0x7f8938003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894f7fe640 1 --2- 172.21.15.6:0/1655777768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89380047d0 0x7f8938004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f8954d93640 1 --2- 172.21.15.6:0/1655777768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8938005180 0x7f893800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894ffff640 1 -- 172.21.15.6:0/1655777768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8938005180 msgr2=0x7f893800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:43.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894ffff640 1 --2- 172.21.15.6:0/1655777768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8938005180 0x7f893800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894ffff640 1 -- 172.21.15.6:0/1655777768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89380047d0 msgr2=0x7f8938004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:43.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894ffff640 1 --2- 172.21.15.6:0/1655777768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89380047d0 0x7f8938004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f894ffff640 1 -- 172.21.15.6:0/1655777768 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8938003530 con 0x7f8938003b10 2023-07-21T22:18:43.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.512+0000 7f8954d93640 1 -- 172.21.15.6:0/1655777768 reap_dead start 2023-07-21T22:18:43.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.516+0000 7f894ffff640 1 --2- 172.21.15.6:0/1655777768 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8938003b10 0x7f8938003f00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8940009ae0 tx=0x7f894001ca50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=516e559cffb57082 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:43.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.516+0000 7f894effd640 1 -- 172.21.15.6:0/1655777768 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89400a5560 con 0x7f8938003b10 2023-07-21T22:18:43.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.516+0000 7f894effd640 1 -- 172.21.15.6:0/1655777768 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89400a56c0 con 0x7f8938003b10 2023-07-21T22:18:43.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.516+0000 7f894effd640 1 -- 172.21.15.6:0/1655777768 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89400a5a70 con 0x7f8938003b10 2023-07-21T22:18:43.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.516+0000 7f89567f6640 1 -- 172.21.15.6:0/1655777768 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8938003b10 msgr2=0x7f8938003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.516+0000 7f89567f6640 1 --2- 172.21.15.6:0/1655777768 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8938003b10 0x7f8938003f00 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8940009ae0 tx=0x7f894001ca50 comp rx=0 tx=0).stop 2023-07-21T22:18:43.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.516+0000 7f89567f6640 1 -- 172.21.15.6:0/1655777768 shutdown_connections 2023-07-21T22:18:43.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.516+0000 7f89567f6640 1 --2- 172.21.15.6:0/1655777768 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8938003b10 0x7f8938003f00 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.516+0000 7f89567f6640 1 -- 172.21.15.6:0/1655777768 >> 172.21.15.6:0/1655777768 conn(0x7f8950099490 msgr2=0x7f8950089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:43.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.516+0000 7f89567f6640 1 -- 172.21.15.6:0/1655777768 shutdown_connections 2023-07-21T22:18:43.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.516+0000 7f89567f6640 1 -- 172.21.15.6:0/1655777768 wait complete. 2023-07-21T22:18:43.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f89567f6640 1 Processor -- start 2023-07-21T22:18:43.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f89567f6640 1 -- start start 2023-07-21T22:18:43.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f89567f6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8938003b10 0x7f89500b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f89567f6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89500b2f70 0x7f89501587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f89567f6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895006dda0 0x7f895006e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f89567f6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89500b4380 con 0x7f895006dda0 2023-07-21T22:18:43.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f89567f6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8950158d00 con 0x7f89500b2f70 2023-07-21T22:18:43.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f89567f6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895006e750 con 0x7f8938003b10 2023-07-21T22:18:43.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f8954d93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895006dda0 0x7f895006e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f894f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89500b2f70 0x7f89501587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f8954d93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895006dda0 0x7f895006e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54628/0 (socket says 172.21.15.6:54628) 2023-07-21T22:18:43.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f8954d93640 1 -- 172.21.15.6:0/203981679 learned_addr learned my addr 172.21.15.6:0/203981679 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:43.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f894ffff640 1 --2- 172.21.15.6:0/203981679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8938003b10 0x7f89500b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f8954d93640 1 -- 172.21.15.6:0/203981679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8938003b10 msgr2=0x7f89500b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f8954d93640 1 --2- 172.21.15.6:0/203981679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8938003b10 0x7f89500b3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f8954d93640 1 -- 172.21.15.6:0/203981679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89500b2f70 msgr2=0x7f89501587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f8954d93640 1 --2- 172.21.15.6:0/203981679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89500b2f70 0x7f89501587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f8954d93640 1 -- 172.21.15.6:0/203981679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895015c5c0 con 0x7f895006dda0 2023-07-21T22:18:43.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f894ffff640 1 --2- 172.21.15.6:0/203981679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8938003b10 0x7f89500b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:43.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f894f7fe640 1 --2- 172.21.15.6:0/203981679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89500b2f70 0x7f89501587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:43.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f8954d93640 1 --2- 172.21.15.6:0/203981679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895006dda0 0x7f895006e210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8950071270 tx=0x7f8948007970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:43.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f894cff9640 1 -- 172.21.15.6:0/203981679 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8948012560 con 0x7f895006dda0 2023-07-21T22:18:43.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f894cff9640 1 -- 172.21.15.6:0/203981679 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89480126e0 con 0x7f895006dda0 2023-07-21T22:18:43.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f894cff9640 1 -- 172.21.15.6:0/203981679 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8948012a90 con 0x7f895006dda0 2023-07-21T22:18:43.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f89567f6640 1 -- 172.21.15.6:0/203981679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89500c5f70 con 0x7f895006dda0 2023-07-21T22:18:43.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.520+0000 7f89567f6640 1 -- 172.21.15.6:0/203981679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89500b4870 con 0x7f895006dda0 2023-07-21T22:18:43.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.524+0000 7f89567f6640 1 -- 172.21.15.6:0/203981679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f895006bb80 con 0x7f895006dda0 2023-07-21T22:18:43.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.524+0000 7f894cff9640 1 -- 172.21.15.6:0/203981679 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8948012bf0 con 0x7f895006dda0 2023-07-21T22:18:43.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.528+0000 7f894cff9640 1 --2- 172.21.15.6:0/203981679 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f893c0662b0 0x7f893c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.528+0000 7f894cff9640 1 -- 172.21.15.6:0/203981679 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f8948084630 con 0x7f895006dda0 2023-07-21T22:18:43.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.528+0000 7f894ffff640 1 --2- 172.21.15.6:0/203981679 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f893c0662b0 0x7f893c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.528+0000 7f894ffff640 1 --2- 172.21.15.6:0/203981679 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f893c0662b0 0x7f893c068760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f89400af000 tx=0x7f89400046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:43.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.528+0000 7f894cff9640 1 -- 172.21.15.6:0/203981679 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8948051af0 con 0x7f895006dda0 2023-07-21T22:18:43.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:43.716+0000 7f89567f6640 1 -- 172.21.15.6:0/203981679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f895015c750 con 0x7f895006dda0 2023-07-21T22:18:44.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.528+0000 7f894cff9640 1 -- 172.21.15.6:0/203981679 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8948055110 con 0x7f895006dda0 2023-07-21T22:18:44.573 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 3 and data pool 4 2023-07-21T22:18:44.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.528+0000 7f89567f6640 1 -- 172.21.15.6:0/203981679 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f893c0662b0 msgr2=0x7f893c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.528+0000 7f89567f6640 1 --2- 172.21.15.6:0/203981679 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f893c0662b0 0x7f893c068760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f89400af000 tx=0x7f89400046d0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.528+0000 7f89567f6640 1 -- 172.21.15.6:0/203981679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895006dda0 msgr2=0x7f895006e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.528+0000 7f89567f6640 1 --2- 172.21.15.6:0/203981679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895006dda0 0x7f895006e210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8950071270 tx=0x7f8948007970 comp rx=0 tx=0).stop 2023-07-21T22:18:44.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.528+0000 7f89567f6640 1 -- 172.21.15.6:0/203981679 shutdown_connections 2023-07-21T22:18:44.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.528+0000 7f89567f6640 1 --2- 172.21.15.6:0/203981679 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f893c0662b0 0x7f893c068760 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.528+0000 7f89567f6640 1 --2- 172.21.15.6:0/203981679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f895006dda0 0x7f895006e210 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.528+0000 7f89567f6640 1 --2- 172.21.15.6:0/203981679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89500b2f70 0x7f89501587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.528+0000 7f89567f6640 1 --2- 172.21.15.6:0/203981679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8938003b10 0x7f89500b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.528+0000 7f89567f6640 1 -- 172.21.15.6:0/203981679 >> 172.21.15.6:0/203981679 conn(0x7f8950099490 msgr2=0x7f89500ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:44.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.528+0000 7f89567f6640 1 -- 172.21.15.6:0/203981679 shutdown_connections 2023-07-21T22:18:44.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.528+0000 7f89567f6640 1 -- 172.21.15.6:0/203981679 wait complete. 2023-07-21T22:18:44.602 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:18:44.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.704+0000 7f76b4e48640 1 Processor -- start 2023-07-21T22:18:44.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.704+0000 7f76b4e48640 1 -- start start 2023-07-21T22:18:44.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.704+0000 7f76b4e48640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f76b00d1850 0x7f76b00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.704+0000 7f76b4e48640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b00ccaf0 con 0x7f76b015fd60 2023-07-21T22:18:44.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.704+0000 7f76b4e48640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b0160320 con 0x7f76b00b7c70 2023-07-21T22:18:44.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.704+0000 7f76b4e48640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b00d1190 con 0x7f76b00d1850 2023-07-21T22:18:44.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.704+0000 7f76a7fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f76b015fd60 0x7f76b00d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41652/0 (socket says 172.21.15.6:41652) 2023-07-21T22:18:44.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.704+0000 7f76a7fff640 1 -- 172.21.15.6:0/470674657 learned_addr learned my addr 172.21.15.6:0/470674657 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:44.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.704+0000 7f76aed9d640 1 --2- 172.21.15.6:0/470674657 >> v2:172.21.15.6:3300/0 conn(0x7f76b00d1850 0x7f76b00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.704+0000 7f76add9b640 1 -- 172.21.15.6:0/470674657 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889333215 0 0) 0x7f76b00ccaf0 con 0x7f76b015fd60 2023-07-21T22:18:44.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.704+0000 7f76add9b640 1 -- 172.21.15.6:0/470674657 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f769c003530 con 0x7f76b015fd60 2023-07-21T22:18:44.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.704+0000 7f76add9b640 1 -- 172.21.15.6:0/470674657 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500856089 0 0) 0x7f76b0160320 con 0x7f76b00b7c70 2023-07-21T22:18:44.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.704+0000 7f76add9b640 1 -- 172.21.15.6:0/470674657 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76b00ccaf0 con 0x7f76b00b7c70 2023-07-21T22:18:44.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.704+0000 7f76aed9d640 1 -- 172.21.15.6:0/470674657 >> v1:172.21.15.161:6789/0 conn(0x7f76b00b7c70 legacy=0x7f76b015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.704+0000 7f76aed9d640 1 -- 172.21.15.6:0/470674657 >> v1:172.21.15.6:6789/0 conn(0x7f76b015fd60 legacy=0x7f76b00d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.704+0000 7f76add9b640 1 -- 172.21.15.6:0/470674657 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3915372111 0 0) 0x7f769c003530 con 0x7f76b015fd60 2023-07-21T22:18:44.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.708+0000 7f76aed9d640 1 -- 172.21.15.6:0/470674657 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b00ccd90 con 0x7f76b00d1850 2023-07-21T22:18:44.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.708+0000 7f76aed9d640 1 --2- 172.21.15.6:0/470674657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00d1850 0x7f76b00d0c50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009d90 tx=0x7f76a801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a48f6bc8759f7772 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.708+0000 7f76add9b640 1 -- 172.21.15.6:0/470674657 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7698001680 con 0x7f76b00d1850 2023-07-21T22:18:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.708+0000 7f76add9b640 1 -- 172.21.15.6:0/470674657 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a80a55c0 con 0x7f76b00d1850 2023-07-21T22:18:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.708+0000 7f76add9b640 1 -- 172.21.15.6:0/470674657 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a80a5950 con 0x7f76b00d1850 2023-07-21T22:18:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.708+0000 7f76b4e48640 1 -- 172.21.15.6:0/470674657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00d1850 msgr2=0x7f76b00d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.708+0000 7f76b4e48640 1 --2- 172.21.15.6:0/470674657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00d1850 0x7f76b00d0c50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009d90 tx=0x7f76a801c870 comp rx=0 tx=0).stop 2023-07-21T22:18:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.708+0000 7f76b4e48640 1 -- 172.21.15.6:0/470674657 shutdown_connections 2023-07-21T22:18:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.708+0000 7f76b4e48640 1 --2- 172.21.15.6:0/470674657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00d1850 0x7f76b00d0c50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.708+0000 7f76b4e48640 1 -- 172.21.15.6:0/470674657 >> 172.21.15.6:0/470674657 conn(0x7f76b00650b0 msgr2=0x7f76b00654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.708+0000 7f76b4e48640 1 -- 172.21.15.6:0/470674657 shutdown_connections 2023-07-21T22:18:44.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.708+0000 7f76b4e48640 1 -- 172.21.15.6:0/470674657 wait complete. 2023-07-21T22:18:44.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.712+0000 7f76b4e48640 1 Processor -- start 2023-07-21T22:18:44.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.712+0000 7f76b4e48640 1 -- start start 2023-07-21T22:18:44.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.712+0000 7f76b4e48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00b7c70 0x7f76b00c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.712+0000 7f76b4e48640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76b00d1850 0x7f76b00c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.712+0000 7f76b4e48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76b015fd60 0x7f76b00b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.712+0000 7f76b4e48640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b015efd0 con 0x7f76b00b7c70 2023-07-21T22:18:44.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.712+0000 7f76b4e48640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b00c8110 con 0x7f76b00d1850 2023-07-21T22:18:44.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.712+0000 7f76b4e48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b015ecf0 con 0x7f76b015fd60 2023-07-21T22:18:44.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.712+0000 7f76ae59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00b7c70 0x7f76b00c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.712+0000 7f76ae59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00b7c70 0x7f76b00c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54640/0 (socket says 172.21.15.6:54640) 2023-07-21T22:18:44.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.712+0000 7f76ae59c640 1 -- 172.21.15.6:0/730812546 learned_addr learned my addr 172.21.15.6:0/730812546 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:44.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.712+0000 7f76a7fff640 1 --2- 172.21.15.6:0/730812546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76b00d1850 0x7f76b00c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.712+0000 7f76aed9d640 1 --2- 172.21.15.6:0/730812546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76b015fd60 0x7f76b00b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.712+0000 7f76ae59c640 1 -- 172.21.15.6:0/730812546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76b015fd60 msgr2=0x7f76b00b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.712+0000 7f76ae59c640 1 --2- 172.21.15.6:0/730812546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76b015fd60 0x7f76b00b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.712+0000 7f76ae59c640 1 -- 172.21.15.6:0/730812546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76b00d1850 msgr2=0x7f76b00c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.712+0000 7f76ae59c640 1 --2- 172.21.15.6:0/730812546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76b00d1850 0x7f76b00c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.712+0000 7f76ae59c640 1 -- 172.21.15.6:0/730812546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a8009a70 con 0x7f76b00b7c70 2023-07-21T22:18:44.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.712+0000 7f76ae59c640 1 --2- 172.21.15.6:0/730812546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00b7c70 0x7f76b00c7bd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f76a000c430 tx=0x7f76a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:44.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.716+0000 7f76a6ffd640 1 -- 172.21.15.6:0/730812546 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a00052d0 con 0x7f76b00b7c70 2023-07-21T22:18:44.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.716+0000 7f76a6ffd640 1 -- 172.21.15.6:0/730812546 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a0005450 con 0x7f76b00b7c70 2023-07-21T22:18:44.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.716+0000 7f76b4e48640 1 -- 172.21.15.6:0/730812546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b00c9570 con 0x7f76b00b7c70 2023-07-21T22:18:44.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.716+0000 7f76a6ffd640 1 -- 172.21.15.6:0/730812546 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a0003840 con 0x7f76b00b7c70 2023-07-21T22:18:44.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.716+0000 7f76b4e48640 1 -- 172.21.15.6:0/730812546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b00c9b30 con 0x7f76b00b7c70 2023-07-21T22:18:44.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.716+0000 7f76b4e48640 1 -- 172.21.15.6:0/730812546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b00678d0 con 0x7f76b00b7c70 2023-07-21T22:18:44.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.716+0000 7f76a6ffd640 1 -- 172.21.15.6:0/730812546 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f76a00039a0 con 0x7f76b00b7c70 2023-07-21T22:18:44.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.716+0000 7f76a6ffd640 1 --2- 172.21.15.6:0/730812546 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f7690066280 0x7f7690068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.716+0000 7f76a6ffd640 1 -- 172.21.15.6:0/730812546 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f76a0083360 con 0x7f76b00b7c70 2023-07-21T22:18:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.716+0000 7f76a7fff640 1 --2- 172.21.15.6:0/730812546 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f7690066280 0x7f7690068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.720+0000 7f76a7fff640 1 --2- 172.21.15.6:0/730812546 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f7690066280 0x7f7690068730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f76b015d6d0 tx=0x7f76980016c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:44.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.720+0000 7f76a6ffd640 1 -- 172.21.15.6:0/730812546 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76a00507f0 con 0x7f76b00b7c70 2023-07-21T22:18:44.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.876+0000 7f76b4e48640 1 -- 172.21.15.6:0/730812546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76b00b6720 con 0x7f76b00b7c70 2023-07-21T22:18:44.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.876+0000 7f76a6ffd640 1 -- 172.21.15.6:0/730812546 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18220 (secure 0 0 0) 0x7f76a0053e10 con 0x7f76b00b7c70 2023-07-21T22:18:44.925 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:18:44.925 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:18:43.722252+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:18:41.465054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:18:42.709896+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:18:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.880+0000 7f76b4e48640 1 -- 172.21.15.6:0/730812546 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f7690066280 msgr2=0x7f7690068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.880+0000 7f76b4e48640 1 --2- 172.21.15.6:0/730812546 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f7690066280 0x7f7690068730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f76b015d6d0 tx=0x7f76980016c0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.880+0000 7f76b4e48640 1 -- 172.21.15.6:0/730812546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00b7c70 msgr2=0x7f76b00c7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.880+0000 7f76b4e48640 1 --2- 172.21.15.6:0/730812546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00b7c70 0x7f76b00c7bd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f76a000c430 tx=0x7f76a000c8f0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.880+0000 7f76b4e48640 1 -- 172.21.15.6:0/730812546 shutdown_connections 2023-07-21T22:18:44.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.880+0000 7f76b4e48640 1 --2- 172.21.15.6:0/730812546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76b015fd60 0x7f76b00b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.880+0000 7f76b4e48640 1 --2- 172.21.15.6:0/730812546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76b00d1850 0x7f76b00c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.880+0000 7f76b4e48640 1 --2- 172.21.15.6:0/730812546 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f7690066280 0x7f7690068730 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.880+0000 7f76b4e48640 1 --2- 172.21.15.6:0/730812546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00b7c70 0x7f76b00c7bd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.880+0000 7f76b4e48640 1 -- 172.21.15.6:0/730812546 >> 172.21.15.6:0/730812546 conn(0x7f76b00650b0 msgr2=0x7f76b0065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.880+0000 7f76b4e48640 1 -- 172.21.15.6:0/730812546 shutdown_connections 2023-07-21T22:18:44.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:44.880+0000 7f76b4e48640 1 -- 172.21.15.6:0/730812546 wait complete. 2023-07-21T22:18:44.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:18:45.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.044+0000 7fd7a5eec640 1 Processor -- start 2023-07-21T22:18:45.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.044+0000 7fd7a5eec640 1 -- start start 2023-07-21T22:18:45.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.044+0000 7fd7a5eec640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7a0160330 0x7fd7a00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:45.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.044+0000 7fd7a5eec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7a00c8940 0x7fd7a00ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:45.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.044+0000 7fd7a5eec640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a00c17d0 con 0x7fd7a00c0f80 2023-07-21T22:18:45.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.044+0000 7fd7a5eec640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a00c14f0 con 0x7fd7a0160330 2023-07-21T22:18:45.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.044+0000 7fd7a5eec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a00cac10 con 0x7fd7a00c8940 2023-07-21T22:18:45.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.044+0000 7fd79f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7a0160330 0x7fd7a00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:45.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.044+0000 7fd79ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd7a00c0f80 0x7fd7a00cd490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41658/0 (socket says 172.21.15.6:41658) 2023-07-21T22:18:45.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.044+0000 7fd79ffff640 1 -- 172.21.15.6:0/4230512822 learned_addr learned my addr 172.21.15.6:0/4230512822 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:45.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.044+0000 7fd79effd640 1 --2- 172.21.15.6:0/4230512822 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7a00c8940 0x7fd7a00ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:45.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.044+0000 7fd79f7fe640 1 -- 172.21.15.6:0/4230512822 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7a00c8940 msgr2=0x7fd7a00ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:45.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.044+0000 7fd79f7fe640 1 --2- 172.21.15.6:0/4230512822 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7a00c8940 0x7fd7a00ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:45.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.044+0000 7fd79f7fe640 1 -- 172.21.15.6:0/4230512822 >> v1:172.21.15.6:6789/0 conn(0x7fd7a00c0f80 legacy=0x7fd7a00cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:45.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.044+0000 7fd79f7fe640 1 -- 172.21.15.6:0/4230512822 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a00caef0 con 0x7fd7a0160330 2023-07-21T22:18:45.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.044+0000 7fd79e7fc640 1 -- 172.21.15.6:0/4230512822 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722724285 0 0) 0x7fd7a00c17d0 con 0x7fd7a00c0f80 2023-07-21T22:18:45.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.048+0000 7fd79f7fe640 1 --2- 172.21.15.6:0/4230512822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7a0160330 0x7fd7a00cb6f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd7900097c0 tx=0x7fd79001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f02f621bad0565b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:45.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.048+0000 7fd79e7fc640 1 -- 172.21.15.6:0/4230512822 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7900a8970 con 0x7fd7a0160330 2023-07-21T22:18:45.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.048+0000 7fd79e7fc640 1 -- 172.21.15.6:0/4230512822 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7900a8ad0 con 0x7fd7a0160330 2023-07-21T22:18:45.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.048+0000 7fd79e7fc640 1 -- 172.21.15.6:0/4230512822 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7900a8e60 con 0x7fd7a0160330 2023-07-21T22:18:45.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.048+0000 7fd7a5eec640 1 -- 172.21.15.6:0/4230512822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7a0160330 msgr2=0x7fd7a00cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:45.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.048+0000 7fd7a5eec640 1 --2- 172.21.15.6:0/4230512822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7a0160330 0x7fd7a00cb6f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd7900097c0 tx=0x7fd79001ec70 comp rx=0 tx=0).stop 2023-07-21T22:18:45.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.048+0000 7fd7a5eec640 1 -- 172.21.15.6:0/4230512822 shutdown_connections 2023-07-21T22:18:45.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.048+0000 7fd7a5eec640 1 --2- 172.21.15.6:0/4230512822 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7a00c8940 0x7fd7a00ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:45.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.048+0000 7fd7a5eec640 1 --2- 172.21.15.6:0/4230512822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7a0160330 0x7fd7a00cb6f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:45.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.048+0000 7fd7a5eec640 1 -- 172.21.15.6:0/4230512822 >> 172.21.15.6:0/4230512822 conn(0x7fd7a00afcf0 msgr2=0x7fd7a00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:45.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.048+0000 7fd7a5eec640 1 -- 172.21.15.6:0/4230512822 shutdown_connections 2023-07-21T22:18:45.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.048+0000 7fd7a5eec640 1 -- 172.21.15.6:0/4230512822 wait complete. 2023-07-21T22:18:45.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd7a5eec640 1 Processor -- start 2023-07-21T22:18:45.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd7a5eec640 1 -- start start 2023-07-21T22:18:45.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd7a5eec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7a00c0f80 0x7fd7a00c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:45.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd7a5eec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7a00c8940 0x7fd7a00ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:45.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd7a5eec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7a0160330 0x7fd7a00cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:45.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd7a5eec640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a00b2c40 con 0x7fd7a0160330 2023-07-21T22:18:45.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd7a5eec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a0151100 con 0x7fd7a00c0f80 2023-07-21T22:18:45.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd7a5eec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a00c6cf0 con 0x7fd7a00c8940 2023-07-21T22:18:45.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd79ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7a0160330 0x7fd7a00cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd79ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7a0160330 0x7fd7a00cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54664/0 (socket says 172.21.15.6:54664) 2023-07-21T22:18:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd79ffff640 1 -- 172.21.15.6:0/1252948096 learned_addr learned my addr 172.21.15.6:0/1252948096 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd79effd640 1 --2- 172.21.15.6:0/1252948096 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7a00c8940 0x7fd7a00ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd79f7fe640 1 --2- 172.21.15.6:0/1252948096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7a00c0f80 0x7fd7a00c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd79ffff640 1 -- 172.21.15.6:0/1252948096 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7a00c8940 msgr2=0x7fd7a00ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd79ffff640 1 --2- 172.21.15.6:0/1252948096 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7a00c8940 0x7fd7a00ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:45.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd79ffff640 1 -- 172.21.15.6:0/1252948096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7a00c0f80 msgr2=0x7fd7a00c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd79ffff640 1 --2- 172.21.15.6:0/1252948096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7a00c0f80 0x7fd7a00c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd79ffff640 1 -- 172.21.15.6:0/1252948096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd790009420 con 0x7fd7a0160330 2023-07-21T22:18:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd79ffff640 1 --2- 172.21.15.6:0/1252948096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7a0160330 0x7fd7a00cd2a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd798001570 tx=0x7fd79800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd787fff640 1 -- 172.21.15.6:0/1252948096 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79800a640 con 0x7fd7a0160330 2023-07-21T22:18:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd787fff640 1 -- 172.21.15.6:0/1252948096 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79800a7c0 con 0x7fd7a0160330 2023-07-21T22:18:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd787fff640 1 -- 172.21.15.6:0/1252948096 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79800ab70 con 0x7fd7a0160330 2023-07-21T22:18:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd7a5eec640 1 -- 172.21.15.6:0/1252948096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a00b2610 con 0x7fd7a0160330 2023-07-21T22:18:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.052+0000 7fd7a5eec640 1 -- 172.21.15.6:0/1252948096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a00c6a10 con 0x7fd7a0160330 2023-07-21T22:18:45.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.056+0000 7fd7a5eec640 1 -- 172.21.15.6:0/1252948096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a00b2d80 con 0x7fd7a0160330 2023-07-21T22:18:45.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.056+0000 7fd787fff640 1 -- 172.21.15.6:0/1252948096 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd79800acd0 con 0x7fd7a0160330 2023-07-21T22:18:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.056+0000 7fd787fff640 1 --2- 172.21.15.6:0/1252948096 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd78c066280 0x7fd78c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.056+0000 7fd787fff640 1 -- 172.21.15.6:0/1252948096 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd7980831d0 con 0x7fd7a0160330 2023-07-21T22:18:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.056+0000 7fd79f7fe640 1 --2- 172.21.15.6:0/1252948096 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd78c066280 0x7fd78c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.060+0000 7fd79f7fe640 1 --2- 172.21.15.6:0/1252948096 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd78c066280 0x7fd78c068730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7900b2000 tx=0x7fd790008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.060+0000 7fd787fff640 1 -- 172.21.15.6:0/1252948096 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd7a00b2d80 con 0x7fd7a0160330 2023-07-21T22:18:45.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.216+0000 7fd7a5eec640 1 -- 172.21.15.6:0/1252948096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7a00b2d80 con 0x7fd7a0160330 2023-07-21T22:18:45.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.220+0000 7fd787fff640 1 -- 172.21.15.6:0/1252948096 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18220 (secure 0 0 0) 0x7fd7a00b2d80 con 0x7fd7a0160330 2023-07-21T22:18:45.266 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:18:45.266 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:18:43.722252+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:18:41.465054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:18:42.709896+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:18:45.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.220+0000 7fd7a5eec640 1 -- 172.21.15.6:0/1252948096 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd78c066280 msgr2=0x7fd78c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:45.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.220+0000 7fd7a5eec640 1 --2- 172.21.15.6:0/1252948096 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd78c066280 0x7fd78c068730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7900b2000 tx=0x7fd790008040 comp rx=0 tx=0).stop 2023-07-21T22:18:45.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.220+0000 7fd7a5eec640 1 -- 172.21.15.6:0/1252948096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7a0160330 msgr2=0x7fd7a00cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:45.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.220+0000 7fd7a5eec640 1 --2- 172.21.15.6:0/1252948096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7a0160330 0x7fd7a00cd2a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd798001570 tx=0x7fd79800cca0 comp rx=0 tx=0).stop 2023-07-21T22:18:45.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.220+0000 7fd7a5eec640 1 -- 172.21.15.6:0/1252948096 shutdown_connections 2023-07-21T22:18:45.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.220+0000 7fd7a5eec640 1 --2- 172.21.15.6:0/1252948096 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd78c066280 0x7fd78c068730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:45.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.220+0000 7fd7a5eec640 1 --2- 172.21.15.6:0/1252948096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7a0160330 0x7fd7a00cd2a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:45.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.220+0000 7fd7a5eec640 1 --2- 172.21.15.6:0/1252948096 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7a00c8940 0x7fd7a00ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:45.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.220+0000 7fd7a5eec640 1 --2- 172.21.15.6:0/1252948096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7a00c0f80 0x7fd7a00c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:45.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.220+0000 7fd7a5eec640 1 -- 172.21.15.6:0/1252948096 >> 172.21.15.6:0/1252948096 conn(0x7fd7a00afcf0 msgr2=0x7fd7a006f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:45.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.220+0000 7fd7a5eec640 1 -- 172.21.15.6:0/1252948096 shutdown_connections 2023-07-21T22:18:45.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.220+0000 7fd7a5eec640 1 -- 172.21.15.6:0/1252948096 wait complete. 2023-07-21T22:18:45.287 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-21T22:18:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.392+0000 7f0cdceec640 1 Processor -- start 2023-07-21T22:18:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.392+0000 7f0cdceec640 1 -- start start 2023-07-21T22:18:45.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.392+0000 7f0cdceec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cd806a540 0x7f0cd806a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:45.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.392+0000 7f0cdceec640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0cd80cf2e0 0x7f0cd80cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:45.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.392+0000 7f0cdceec640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd80cb7a0 con 0x7f0cd80cc9c0 2023-07-21T22:18:45.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.392+0000 7f0cdceec640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd80d0920 con 0x7f0cd80cf2e0 2023-07-21T22:18:45.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.392+0000 7f0cdceec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd815bfd0 con 0x7f0cd806a540 2023-07-21T22:18:45.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.392+0000 7f0ccffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0cd80cf2e0 0x7f0cd80cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:45.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.392+0000 7f0cd6d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0cd80cc9c0 0x7f0cd80cce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41674/0 (socket says 172.21.15.6:41674) 2023-07-21T22:18:45.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.392+0000 7f0cd6d9d640 1 -- 172.21.15.6:0/2466215469 learned_addr learned my addr 172.21.15.6:0/2466215469 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:45.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.392+0000 7f0cd659c640 1 --2- 172.21.15.6:0/2466215469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cd806a540 0x7f0cd806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:45.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.392+0000 7f0ccffff640 1 -- 172.21.15.6:0/2466215469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cd806a540 msgr2=0x7f0cd806a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:45.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.392+0000 7f0ccffff640 1 --2- 172.21.15.6:0/2466215469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cd806a540 0x7f0cd806a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:45.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.392+0000 7f0ccffff640 1 -- 172.21.15.6:0/2466215469 >> v1:172.21.15.6:6789/0 conn(0x7f0cd80cc9c0 legacy=0x7f0cd80cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:45.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.392+0000 7f0ccffff640 1 -- 172.21.15.6:0/2466215469 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd806ae50 con 0x7f0cd80cf2e0 2023-07-21T22:18:45.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.392+0000 7f0cd5d9b640 1 -- 172.21.15.6:0/2466215469 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193405911 0 0) 0x7f0cd80cb7a0 con 0x7f0cd80cc9c0 2023-07-21T22:18:45.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.396+0000 7f0ccffff640 1 --2- 172.21.15.6:0/2466215469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd80cf2e0 0x7f0cd80cf710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0cc00097c0 tx=0x7f0cc001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf36a70d5d4b9771 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:45.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.396+0000 7f0cd5d9b640 1 -- 172.21.15.6:0/2466215469 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc00ab650 con 0x7f0cd80cf2e0 2023-07-21T22:18:45.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.396+0000 7f0cd5d9b640 1 -- 172.21.15.6:0/2466215469 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc00ab7b0 con 0x7f0cd80cf2e0 2023-07-21T22:18:45.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.396+0000 7f0cd5d9b640 1 -- 172.21.15.6:0/2466215469 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc00abb40 con 0x7f0cd80cf2e0 2023-07-21T22:18:45.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.396+0000 7f0cdceec640 1 -- 172.21.15.6:0/2466215469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd80cf2e0 msgr2=0x7f0cd80cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:45.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.396+0000 7f0cdceec640 1 --2- 172.21.15.6:0/2466215469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd80cf2e0 0x7f0cd80cf710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0cc00097c0 tx=0x7f0cc001c450 comp rx=0 tx=0).stop 2023-07-21T22:18:45.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.396+0000 7f0cdceec640 1 -- 172.21.15.6:0/2466215469 shutdown_connections 2023-07-21T22:18:45.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.396+0000 7f0cdceec640 1 --2- 172.21.15.6:0/2466215469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd80cf2e0 0x7f0cd80cf710 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:45.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.396+0000 7f0cdceec640 1 --2- 172.21.15.6:0/2466215469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cd806a540 0x7f0cd806a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:45.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.396+0000 7f0cdceec640 1 -- 172.21.15.6:0/2466215469 >> 172.21.15.6:0/2466215469 conn(0x7f0cd8099490 msgr2=0x7f0cd8089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:45.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.396+0000 7f0cdceec640 1 -- 172.21.15.6:0/2466215469 shutdown_connections 2023-07-21T22:18:45.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.396+0000 7f0cdceec640 1 -- 172.21.15.6:0/2466215469 wait complete. 2023-07-21T22:18:45.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0cdceec640 1 Processor -- start 2023-07-21T22:18:45.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0cdceec640 1 -- start start 2023-07-21T22:18:45.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0cdceec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cd806a540 0x7f0cd80c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:45.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0cdceec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd80cc9c0 0x7f0cd8152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:45.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0cdceec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cd80cf2e0 0x7f0cd815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0cdceec640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd815dc10 con 0x7f0cd80cc9c0 2023-07-21T22:18:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0cdceec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd815caf0 con 0x7f0cd806a540 2023-07-21T22:18:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0cdceec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd815cdd0 con 0x7f0cd80cf2e0 2023-07-21T22:18:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0ccffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd80cc9c0 0x7f0cd8152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0ccffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd80cc9c0 0x7f0cd8152330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54688/0 (socket says 172.21.15.6:54688) 2023-07-21T22:18:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0ccffff640 1 -- 172.21.15.6:0/24218047 learned_addr learned my addr 172.21.15.6:0/24218047 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0cd659c640 1 --2- 172.21.15.6:0/24218047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cd806a540 0x7f0cd80c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0cd6d9d640 1 --2- 172.21.15.6:0/24218047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cd80cf2e0 0x7f0cd815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:45.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0ccffff640 1 -- 172.21.15.6:0/24218047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cd80cf2e0 msgr2=0x7f0cd815c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:45.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0ccffff640 1 --2- 172.21.15.6:0/24218047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cd80cf2e0 0x7f0cd815c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:45.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0ccffff640 1 -- 172.21.15.6:0/24218047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cd806a540 msgr2=0x7f0cd80c4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:45.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0ccffff640 1 --2- 172.21.15.6:0/24218047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cd806a540 0x7f0cd80c4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:45.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0ccffff640 1 -- 172.21.15.6:0/24218047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc0009420 con 0x7f0cd80cc9c0 2023-07-21T22:18:45.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0ccffff640 1 --2- 172.21.15.6:0/24218047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd80cc9c0 0x7f0cd8152330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0cc001ab00 tx=0x7f0cc001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:45.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0cceffd640 1 -- 172.21.15.6:0/24218047 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0004220 con 0x7f0cd80cc9c0 2023-07-21T22:18:45.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0cceffd640 1 -- 172.21.15.6:0/24218047 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc00b9070 con 0x7f0cd80cc9c0 2023-07-21T22:18:45.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0cceffd640 1 -- 172.21.15.6:0/24218047 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0003620 con 0x7f0cd80cc9c0 2023-07-21T22:18:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.400+0000 7f0cdceec640 1 -- 172.21.15.6:0/24218047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd815d0b0 con 0x7f0cd80cc9c0 2023-07-21T22:18:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.404+0000 7f0cdceec640 1 -- 172.21.15.6:0/24218047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd8152870 con 0x7f0cd80cc9c0 2023-07-21T22:18:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.404+0000 7f0cdceec640 1 -- 172.21.15.6:0/24218047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd815dd50 con 0x7f0cd80cc9c0 2023-07-21T22:18:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.404+0000 7f0cceffd640 1 -- 172.21.15.6:0/24218047 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0cc0003780 con 0x7f0cd80cc9c0 2023-07-21T22:18:45.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.404+0000 7f0cceffd640 1 --2- 172.21.15.6:0/24218047 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0cb8066280 0x7f0cb8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:45.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.404+0000 7f0cceffd640 1 -- 172.21.15.6:0/24218047 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0cc00bb070 con 0x7f0cd80cc9c0 2023-07-21T22:18:45.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.404+0000 7f0cd659c640 1 --2- 172.21.15.6:0/24218047 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0cb8066280 0x7f0cb8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:45.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.408+0000 7f0cd659c640 1 --2- 172.21.15.6:0/24218047 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0cb8066280 0x7f0cb8068730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80079c0 tx=0x7f0cc8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:45.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.408+0000 7f0cceffd640 1 -- 172.21.15.6:0/24218047 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0cd815dd50 con 0x7f0cd80cc9c0 2023-07-21T22:18:45.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:45.604+0000 7f0cdceec640 1 -- 172.21.15.6:0/24218047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0cd815dd50 con 0x7f0cd80cc9c0 2023-07-21T22:18:46.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.540+0000 7f0cceffd640 1 -- 172.21.15.6:0/24218047 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0cd815dd50 con 0x7f0cd80cc9c0 2023-07-21T22:18:46.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.544+0000 7f0cdceec640 1 -- 172.21.15.6:0/24218047 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0cb8066280 msgr2=0x7f0cb8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:46.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.544+0000 7f0cdceec640 1 --2- 172.21.15.6:0/24218047 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0cb8066280 0x7f0cb8068730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80079c0 tx=0x7f0cc8008040 comp rx=0 tx=0).stop 2023-07-21T22:18:46.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.544+0000 7f0cdceec640 1 -- 172.21.15.6:0/24218047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd80cc9c0 msgr2=0x7f0cd8152330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:46.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.544+0000 7f0cdceec640 1 --2- 172.21.15.6:0/24218047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd80cc9c0 0x7f0cd8152330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0cc001ab00 tx=0x7f0cc001ac90 comp rx=0 tx=0).stop 2023-07-21T22:18:46.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.544+0000 7f0cdceec640 1 -- 172.21.15.6:0/24218047 shutdown_connections 2023-07-21T22:18:46.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.544+0000 7f0cdceec640 1 --2- 172.21.15.6:0/24218047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cd80cf2e0 0x7f0cd815c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:46.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.544+0000 7f0cdceec640 1 --2- 172.21.15.6:0/24218047 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0cb8066280 0x7f0cb8068730 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:46.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.544+0000 7f0cdceec640 1 --2- 172.21.15.6:0/24218047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd80cc9c0 0x7f0cd8152330 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:46.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.544+0000 7f0cdceec640 1 --2- 172.21.15.6:0/24218047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cd806a540 0x7f0cd80c4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:46.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.544+0000 7f0cdceec640 1 -- 172.21.15.6:0/24218047 >> 172.21.15.6:0/24218047 conn(0x7f0cd8099490 msgr2=0x7f0cd8089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:46.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.544+0000 7f0cdceec640 1 -- 172.21.15.6:0/24218047 shutdown_connections 2023-07-21T22:18:46.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.544+0000 7f0cdceec640 1 -- 172.21.15.6:0/24218047 wait complete. 2023-07-21T22:18:46.613 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-21T22:18:46.613 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-21T22:18:46.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.716+0000 7fdf26d40640 1 Processor -- start 2023-07-21T22:18:46.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.716+0000 7fdf26d40640 1 -- start start 2023-07-21T22:18:46.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.720+0000 7fdf26d40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf200aeb40 0x7fdf2015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:46.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.720+0000 7fdf26d40640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf201532b0 con 0x7fdf20159440 2023-07-21T22:18:46.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.720+0000 7fdf26d40640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf200ca6f0 con 0x7fdf200aef10 2023-07-21T22:18:46.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.720+0000 7fdf26d40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf201599d0 con 0x7fdf200aeb40 2023-07-21T22:18:46.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.720+0000 7fdf252dd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdf20159440 0x7fdf200c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41688/0 (socket says 172.21.15.6:41688) 2023-07-21T22:18:46.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.720+0000 7fdf252dd640 1 -- 172.21.15.6:0/2702132584 learned_addr learned my addr 172.21.15.6:0/2702132584 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:46.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.720+0000 7fdf24adc640 1 --2- 172.21.15.6:0/2702132584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf200aeb40 0x7fdf2015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:46.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.720+0000 7fdf1f7fe640 1 -- 172.21.15.6:0/2702132584 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360975137 0 0) 0x7fdf201532b0 con 0x7fdf20159440 2023-07-21T22:18:46.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.720+0000 7fdf1f7fe640 1 -- 172.21.15.6:0/2702132584 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf10003530 con 0x7fdf20159440 2023-07-21T22:18:46.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.720+0000 7fdf1f7fe640 1 -- 172.21.15.6:0/2702132584 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752645929 0 0) 0x7fdf200ca6f0 con 0x7fdf200aef10 2023-07-21T22:18:46.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.720+0000 7fdf1f7fe640 1 -- 172.21.15.6:0/2702132584 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf201532b0 con 0x7fdf200aef10 2023-07-21T22:18:46.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.720+0000 7fdf24adc640 1 -- 172.21.15.6:0/2702132584 >> v1:172.21.15.161:6789/0 conn(0x7fdf200aef10 legacy=0x7fdf20158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:46.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.720+0000 7fdf24adc640 1 -- 172.21.15.6:0/2702132584 >> v1:172.21.15.6:6789/0 conn(0x7fdf20159440 legacy=0x7fdf200c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:46.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.720+0000 7fdf24adc640 1 -- 172.21.15.6:0/2702132584 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf20159cb0 con 0x7fdf200aeb40 2023-07-21T22:18:46.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.724+0000 7fdf24adc640 1 --2- 172.21.15.6:0/2702132584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf200aeb40 0x7fdf2015cef0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdf140097f0 tx=0x7fdf1401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3996d3a7d3e8e4ef server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:46.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.724+0000 7fdf1f7fe640 1 -- 172.21.15.6:0/2702132584 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf140ab600 con 0x7fdf200aeb40 2023-07-21T22:18:46.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.724+0000 7fdf1f7fe640 1 -- 172.21.15.6:0/2702132584 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf140ab760 con 0x7fdf200aeb40 2023-07-21T22:18:46.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.724+0000 7fdf1f7fe640 1 -- 172.21.15.6:0/2702132584 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf140abaf0 con 0x7fdf200aeb40 2023-07-21T22:18:46.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.724+0000 7fdf26d40640 1 -- 172.21.15.6:0/2702132584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf200aeb40 msgr2=0x7fdf2015cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:46.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.724+0000 7fdf26d40640 1 --2- 172.21.15.6:0/2702132584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf200aeb40 0x7fdf2015cef0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdf140097f0 tx=0x7fdf1401c400 comp rx=0 tx=0).stop 2023-07-21T22:18:46.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.724+0000 7fdf26d40640 1 -- 172.21.15.6:0/2702132584 shutdown_connections 2023-07-21T22:18:46.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.724+0000 7fdf26d40640 1 --2- 172.21.15.6:0/2702132584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf200aeb40 0x7fdf2015cef0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:46.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.724+0000 7fdf26d40640 1 -- 172.21.15.6:0/2702132584 >> 172.21.15.6:0/2702132584 conn(0x7fdf200cde90 msgr2=0x7fdf200ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:46.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.724+0000 7fdf26d40640 1 -- 172.21.15.6:0/2702132584 shutdown_connections 2023-07-21T22:18:46.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.724+0000 7fdf26d40640 1 -- 172.21.15.6:0/2702132584 wait complete. 2023-07-21T22:18:46.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.724+0000 7fdf26d40640 1 Processor -- start 2023-07-21T22:18:46.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.724+0000 7fdf26d40640 1 -- start start 2023-07-21T22:18:46.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf26d40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf200aeb40 0x7fdf2014d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:46.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf26d40640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf200aef10 0x7fdf200c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:46.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf26d40640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf20159440 0x7fdf2014e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:46.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf26d40640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf20156b60 con 0x7fdf200aef10 2023-07-21T22:18:46.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf26d40640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf200c7950 con 0x7fdf20159440 2023-07-21T22:18:46.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf26d40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf200c70b0 con 0x7fdf200aeb40 2023-07-21T22:18:46.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf1ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf200aef10 0x7fdf200c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:46.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf1ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf200aef10 0x7fdf200c6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54698/0 (socket says 172.21.15.6:54698) 2023-07-21T22:18:46.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf1ffff640 1 -- 172.21.15.6:0/1459760215 learned_addr learned my addr 172.21.15.6:0/1459760215 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:46.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf252dd640 1 --2- 172.21.15.6:0/1459760215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf20159440 0x7fdf2014e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:46.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf24adc640 1 --2- 172.21.15.6:0/1459760215 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf200aeb40 0x7fdf2014d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:46.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf1ffff640 1 -- 172.21.15.6:0/1459760215 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf200aeb40 msgr2=0x7fdf2014d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:46.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf1ffff640 1 --2- 172.21.15.6:0/1459760215 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf200aeb40 0x7fdf2014d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:46.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf1ffff640 1 -- 172.21.15.6:0/1459760215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf20159440 msgr2=0x7fdf2014e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:46.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf1ffff640 1 --2- 172.21.15.6:0/1459760215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf20159440 0x7fdf2014e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:46.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf1ffff640 1 -- 172.21.15.6:0/1459760215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf14009420 con 0x7fdf200aef10 2023-07-21T22:18:46.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf1ffff640 1 --2- 172.21.15.6:0/1459760215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf200aef10 0x7fdf200c6830 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c00c500 tx=0x7fdf0c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:46.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf1d7fa640 1 -- 172.21.15.6:0/1459760215 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c0052d0 con 0x7fdf200aef10 2023-07-21T22:18:46.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf1d7fa640 1 -- 172.21.15.6:0/1459760215 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0c005470 con 0x7fdf200aef10 2023-07-21T22:18:46.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf26d40640 1 -- 172.21.15.6:0/1459760215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf200c7390 con 0x7fdf200aef10 2023-07-21T22:18:46.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf1d7fa640 1 -- 172.21.15.6:0/1459760215 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c003840 con 0x7fdf200aef10 2023-07-21T22:18:46.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf26d40640 1 -- 172.21.15.6:0/1459760215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf200c6d70 con 0x7fdf200aef10 2023-07-21T22:18:46.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf26d40640 1 -- 172.21.15.6:0/1459760215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf200678d0 con 0x7fdf200aef10 2023-07-21T22:18:46.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.728+0000 7fdf1d7fa640 1 -- 172.21.15.6:0/1459760215 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdf0c0039a0 con 0x7fdf200aef10 2023-07-21T22:18:46.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.732+0000 7fdf1d7fa640 1 --2- 172.21.15.6:0/1459760215 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fdf04066280 0x7fdf04068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:46.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.732+0000 7fdf1d7fa640 1 -- 172.21.15.6:0/1459760215 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdf0c083250 con 0x7fdf200aef10 2023-07-21T22:18:46.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.732+0000 7fdf24adc640 1 --2- 172.21.15.6:0/1459760215 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fdf04066280 0x7fdf04068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:46.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.732+0000 7fdf24adc640 1 --2- 172.21.15.6:0/1459760215 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fdf04066280 0x7fdf04068730 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdf140af000 tx=0x7fdf140a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:46.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.736+0000 7fdf1d7fa640 1 -- 172.21.15.6:0/1459760215 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdf0c0506f0 con 0x7fdf200aef10 2023-07-21T22:18:46.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:46.920+0000 7fdf26d40640 1 -- 172.21.15.6:0/1459760215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdf200c36a0 con 0x7fdf200aef10 2023-07-21T22:18:47.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.548+0000 7fdf1d7fa640 1 -- 172.21.15.6:0/1459760215 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdf0c053d10 con 0x7fdf200aef10 2023-07-21T22:18:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.548+0000 7fdf26d40640 1 -- 172.21.15.6:0/1459760215 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fdf04066280 msgr2=0x7fdf04068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.548+0000 7fdf26d40640 1 --2- 172.21.15.6:0/1459760215 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fdf04066280 0x7fdf04068730 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdf140af000 tx=0x7fdf140a7000 comp rx=0 tx=0).stop 2023-07-21T22:18:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.548+0000 7fdf26d40640 1 -- 172.21.15.6:0/1459760215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf200aef10 msgr2=0x7fdf200c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.548+0000 7fdf26d40640 1 --2- 172.21.15.6:0/1459760215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf200aef10 0x7fdf200c6830 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c00c500 tx=0x7fdf0c00c9c0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.548+0000 7fdf26d40640 1 -- 172.21.15.6:0/1459760215 shutdown_connections 2023-07-21T22:18:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.548+0000 7fdf26d40640 1 --2- 172.21.15.6:0/1459760215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf20159440 0x7fdf2014e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.548+0000 7fdf26d40640 1 --2- 172.21.15.6:0/1459760215 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fdf04066280 0x7fdf04068730 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.548+0000 7fdf26d40640 1 --2- 172.21.15.6:0/1459760215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf200aef10 0x7fdf200c6830 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.548+0000 7fdf26d40640 1 --2- 172.21.15.6:0/1459760215 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf200aeb40 0x7fdf2014d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.548+0000 7fdf26d40640 1 -- 172.21.15.6:0/1459760215 >> 172.21.15.6:0/1459760215 conn(0x7fdf200cde90 msgr2=0x7fdf200cc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.548+0000 7fdf26d40640 1 -- 172.21.15.6:0/1459760215 shutdown_connections 2023-07-21T22:18:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.548+0000 7fdf26d40640 1 -- 172.21.15.6:0/1459760215 wait complete. 2023-07-21T22:18:47.618 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-21T22:18:47.619 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:18:47.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.720+0000 7f1e787fa640 1 Processor -- start 2023-07-21T22:18:47.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.720+0000 7f1e787fa640 1 -- start start 2023-07-21T22:18:47.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.720+0000 7f1e787fa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1e70070b70 0x7f1e70070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:47.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.720+0000 7f1e787fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e7006b1e0 0x7f1e700c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:47.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.720+0000 7f1e787fa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e700cac70 con 0x7f1e700c21f0 2023-07-21T22:18:47.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.720+0000 7f1e787fa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e70071480 con 0x7f1e70070b70 2023-07-21T22:18:47.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.720+0000 7f1e787fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e700ca060 con 0x7f1e7006b1e0 2023-07-21T22:18:47.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.720+0000 7f1e76596640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1e70070b70 0x7f1e70070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:47.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.720+0000 7f1e76d97640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1e700c21f0 0x7f1e700cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54042/0 (socket says 172.21.15.6:54042) 2023-07-21T22:18:47.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.720+0000 7f1e76d97640 1 -- 172.21.15.6:0/3629104287 learned_addr learned my addr 172.21.15.6:0/3629104287 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:47.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.720+0000 7f1e75d95640 1 --2- 172.21.15.6:0/3629104287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e7006b1e0 0x7f1e700c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:47.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.720+0000 7f1e75594640 1 -- 172.21.15.6:0/3629104287 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047741189 0 0) 0x7f1e700cac70 con 0x7f1e700c21f0 2023-07-21T22:18:47.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.720+0000 7f1e75594640 1 -- 172.21.15.6:0/3629104287 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e5c003530 con 0x7f1e700c21f0 2023-07-21T22:18:47.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.720+0000 7f1e76596640 1 -- 172.21.15.6:0/3629104287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e7006b1e0 msgr2=0x7f1e700c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:47.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.720+0000 7f1e76596640 1 --2- 172.21.15.6:0/3629104287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e7006b1e0 0x7f1e700c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.720+0000 7f1e76596640 1 -- 172.21.15.6:0/3629104287 >> v1:172.21.15.6:6789/0 conn(0x7f1e700c21f0 legacy=0x7f1e700cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:47.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.720+0000 7f1e76596640 1 -- 172.21.15.6:0/3629104287 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e700ca340 con 0x7f1e70070b70 2023-07-21T22:18:47.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.724+0000 7f1e76596640 1 --2- 172.21.15.6:0/3629104287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e70070b70 0x7f1e70070f40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0097c0 tx=0x7f1e6c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43991c7163d15799 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:47.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.724+0000 7f1e75594640 1 -- 172.21.15.6:0/3629104287 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c0ac620 con 0x7f1e70070b70 2023-07-21T22:18:47.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.724+0000 7f1e75594640 1 -- 172.21.15.6:0/3629104287 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c0ac780 con 0x7f1e70070b70 2023-07-21T22:18:47.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.724+0000 7f1e75594640 1 -- 172.21.15.6:0/3629104287 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c0acb10 con 0x7f1e70070b70 2023-07-21T22:18:47.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.724+0000 7f1e787fa640 1 -- 172.21.15.6:0/3629104287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e70070b70 msgr2=0x7f1e70070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:47.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.724+0000 7f1e787fa640 1 --2- 172.21.15.6:0/3629104287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e70070b70 0x7f1e70070f40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0097c0 tx=0x7f1e6c01c3c0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.724+0000 7f1e787fa640 1 -- 172.21.15.6:0/3629104287 shutdown_connections 2023-07-21T22:18:47.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.724+0000 7f1e787fa640 1 --2- 172.21.15.6:0/3629104287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e7006b1e0 0x7f1e700c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.724+0000 7f1e787fa640 1 --2- 172.21.15.6:0/3629104287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e70070b70 0x7f1e70070f40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.724+0000 7f1e787fa640 1 -- 172.21.15.6:0/3629104287 >> 172.21.15.6:0/3629104287 conn(0x7f1e700afcf0 msgr2=0x7f1e700b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:47.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.724+0000 7f1e787fa640 1 -- 172.21.15.6:0/3629104287 shutdown_connections 2023-07-21T22:18:47.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.724+0000 7f1e787fa640 1 -- 172.21.15.6:0/3629104287 wait complete. 2023-07-21T22:18:47.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e787fa640 1 Processor -- start 2023-07-21T22:18:47.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e787fa640 1 -- start start 2023-07-21T22:18:47.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e787fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e7006b1e0 0x7f1e700c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:47.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e787fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e70070b70 0x7f1e700b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:47.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e787fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e700c21f0 0x7f1e7014f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:47.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e787fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e700c7870 con 0x7f1e7006b1e0 2023-07-21T22:18:47.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e787fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e700c7590 con 0x7f1e70070b70 2023-07-21T22:18:47.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e787fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e70154ee0 con 0x7f1e700c21f0 2023-07-21T22:18:47.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e76596640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e7006b1e0 0x7f1e700c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:47.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e76596640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e7006b1e0 0x7f1e700c6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46588/0 (socket says 172.21.15.6:46588) 2023-07-21T22:18:47.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e76596640 1 -- 172.21.15.6:0/2436494478 learned_addr learned my addr 172.21.15.6:0/2436494478 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:47.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e75d95640 1 --2- 172.21.15.6:0/2436494478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e70070b70 0x7f1e700b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:47.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e76d97640 1 --2- 172.21.15.6:0/2436494478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e700c21f0 0x7f1e7014f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:47.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e76596640 1 -- 172.21.15.6:0/2436494478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e700c21f0 msgr2=0x7f1e7014f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:47.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e76596640 1 --2- 172.21.15.6:0/2436494478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e700c21f0 0x7f1e7014f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e76596640 1 -- 172.21.15.6:0/2436494478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e70070b70 msgr2=0x7f1e700b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:47.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e76596640 1 --2- 172.21.15.6:0/2436494478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e70070b70 0x7f1e700b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e76596640 1 -- 172.21.15.6:0/2436494478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c009420 con 0x7f1e7006b1e0 2023-07-21T22:18:47.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e75d95640 1 --2- 172.21.15.6:0/2436494478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e70070b70 0x7f1e700b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:47.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e76d97640 1 --2- 172.21.15.6:0/2436494478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e700c21f0 0x7f1e7014f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:47.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e76596640 1 --2- 172.21.15.6:0/2436494478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e7006b1e0 0x7f1e700c6c90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0af040 tx=0x7f1e6c01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:47.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e66ffd640 1 -- 172.21.15.6:0/2436494478 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c0ac620 con 0x7f1e7006b1e0 2023-07-21T22:18:47.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e66ffd640 1 -- 172.21.15.6:0/2436494478 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c0b8450 con 0x7f1e7006b1e0 2023-07-21T22:18:47.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e787fa640 1 -- 172.21.15.6:0/2436494478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e701551c0 con 0x7f1e7006b1e0 2023-07-21T22:18:47.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e66ffd640 1 -- 172.21.15.6:0/2436494478 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c0b8820 con 0x7f1e7006b1e0 2023-07-21T22:18:47.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.728+0000 7f1e787fa640 1 -- 172.21.15.6:0/2436494478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e701559c0 con 0x7f1e7006b1e0 2023-07-21T22:18:47.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.732+0000 7f1e787fa640 1 -- 172.21.15.6:0/2436494478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e70154d40 con 0x7f1e7006b1e0 2023-07-21T22:18:47.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.732+0000 7f1e66ffd640 1 -- 172.21.15.6:0/2436494478 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1e6c0aa070 con 0x7f1e7006b1e0 2023-07-21T22:18:47.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.732+0000 7f1e66ffd640 1 --2- 172.21.15.6:0/2436494478 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1e540662b0 0x7f1e54068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:47.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.732+0000 7f1e66ffd640 1 -- 172.21.15.6:0/2436494478 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1e6c11e2e0 con 0x7f1e7006b1e0 2023-07-21T22:18:47.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.732+0000 7f1e75d95640 1 --2- 172.21.15.6:0/2436494478 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1e540662b0 0x7f1e54068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:47.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.732+0000 7f1e75d95640 1 --2- 172.21.15.6:0/2436494478 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1e540662b0 0x7f1e54068760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1e70159170 tx=0x7f1e60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:47.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.736+0000 7f1e66ffd640 1 -- 172.21.15.6:0/2436494478 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1e70154d40 con 0x7f1e7006b1e0 2023-07-21T22:18:47.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.924+0000 7f1e787fa640 1 -- 172.21.15.6:0/2436494478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e701556e0 con 0x7f1e7006b1e0 2023-07-21T22:18:47.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.924+0000 7f1e66ffd640 1 -- 172.21.15.6:0/2436494478 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f1e701556e0 con 0x7f1e7006b1e0 2023-07-21T22:18:47.971 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:18:47.971 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3109831689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3109831689},{"type":"v1","addr":"172.21.15.6:6834","nonce":3109831689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/937908788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":937908788},{"type":"v1","addr":"172.21.15.161:6836","nonce":937908788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/445360801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":445360801},{"type":"v1","addr":"172.21.15.6:6835","nonce":445360801}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:18:43.722596+0000","modified":"2023-07-21T22:18:47.542628+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/747850146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":747850146},{"type":"v1","addr":"172.21.15.161:6837","nonce":747850146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:18:47.971 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-07-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.924+0000 7f1e787fa640 1 -- 172.21.15.6:0/2436494478 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1e540662b0 msgr2=0x7f1e54068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.924+0000 7f1e787fa640 1 --2- 172.21.15.6:0/2436494478 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1e540662b0 0x7f1e54068760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1e70159170 tx=0x7f1e60008040 comp rx=0 tx=0).stop 2023-07-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.924+0000 7f1e787fa640 1 -- 172.21.15.6:0/2436494478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e7006b1e0 msgr2=0x7f1e700c6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.924+0000 7f1e787fa640 1 --2- 172.21.15.6:0/2436494478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e7006b1e0 0x7f1e700c6c90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0af040 tx=0x7f1e6c01ac00 comp rx=0 tx=0).stop 2023-07-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.924+0000 7f1e787fa640 1 -- 172.21.15.6:0/2436494478 shutdown_connections 2023-07-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.924+0000 7f1e787fa640 1 --2- 172.21.15.6:0/2436494478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e700c21f0 0x7f1e7014f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.924+0000 7f1e787fa640 1 --2- 172.21.15.6:0/2436494478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e70070b70 0x7f1e700b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.924+0000 7f1e787fa640 1 --2- 172.21.15.6:0/2436494478 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1e540662b0 0x7f1e54068760 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.924+0000 7f1e787fa640 1 --2- 172.21.15.6:0/2436494478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e7006b1e0 0x7f1e700c6c90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.924+0000 7f1e787fa640 1 -- 172.21.15.6:0/2436494478 >> 172.21.15.6:0/2436494478 conn(0x7f1e700afcf0 msgr2=0x7f1e70151de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.928+0000 7f1e787fa640 1 -- 172.21.15.6:0/2436494478 shutdown_connections 2023-07-21T22:18:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:47.928+0000 7f1e787fa640 1 -- 172.21.15.6:0/2436494478 wait complete. 2023-07-21T22:18:47.992 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:18:48.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.088+0000 7fd896f9f640 1 Processor -- start 2023-07-21T22:18:48.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.088+0000 7fd896f9f640 1 -- start start 2023-07-21T22:18:48.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.088+0000 7fd896f9f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd890070b70 0x7fd890070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:48.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.088+0000 7fd896f9f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd89006b1e0 0x7fd8900c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:48.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.088+0000 7fd896f9f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8900cac70 con 0x7fd8900c21f0 2023-07-21T22:18:48.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.088+0000 7fd896f9f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd890071480 con 0x7fd890070b70 2023-07-21T22:18:48.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.088+0000 7fd896f9f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8900ca060 con 0x7fd89006b1e0 2023-07-21T22:18:48.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.088+0000 7fd894d3b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd890070b70 0x7fd890070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:48.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.088+0000 7fd894d3b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd890070b70 0x7fd890070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46604/0 (socket says 172.21.15.6:46604) 2023-07-21T22:18:48.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.088+0000 7fd894d3b640 1 -- 172.21.15.6:0/2466159554 learned_addr learned my addr 172.21.15.6:0/2466159554 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:48.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.088+0000 7fd88ffff640 1 --2- 172.21.15.6:0/2466159554 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd89006b1e0 0x7fd8900c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:48.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.088+0000 7fd894d3b640 1 -- 172.21.15.6:0/2466159554 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd89006b1e0 msgr2=0x7fd8900c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:48.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.088+0000 7fd894d3b640 1 --2- 172.21.15.6:0/2466159554 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd89006b1e0 0x7fd8900c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.088+0000 7fd894d3b640 1 -- 172.21.15.6:0/2466159554 >> v1:172.21.15.161:6789/0 conn(0x7fd8900c21f0 legacy=0x7fd8900cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:48.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.088+0000 7fd894d3b640 1 -- 172.21.15.6:0/2466159554 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8900ca340 con 0x7fd890070b70 2023-07-21T22:18:48.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.092+0000 7fd894d3b640 1 --2- 172.21.15.6:0/2466159554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890070b70 0x7fd890070f40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd884009870 tx=0x7fd88401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e527d955a1c1e0f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:48.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.092+0000 7fd88f7fe640 1 -- 172.21.15.6:0/2466159554 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8840ab680 con 0x7fd890070b70 2023-07-21T22:18:48.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.092+0000 7fd88f7fe640 1 -- 172.21.15.6:0/2466159554 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8840ab7e0 con 0x7fd890070b70 2023-07-21T22:18:48.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.092+0000 7fd88f7fe640 1 -- 172.21.15.6:0/2466159554 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8840abb70 con 0x7fd890070b70 2023-07-21T22:18:48.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.092+0000 7fd896f9f640 1 -- 172.21.15.6:0/2466159554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890070b70 msgr2=0x7fd890070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:48.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.092+0000 7fd896f9f640 1 --2- 172.21.15.6:0/2466159554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890070b70 0x7fd890070f40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd884009870 tx=0x7fd88401c480 comp rx=0 tx=0).stop 2023-07-21T22:18:48.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.092+0000 7fd896f9f640 1 -- 172.21.15.6:0/2466159554 shutdown_connections 2023-07-21T22:18:48.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.092+0000 7fd896f9f640 1 --2- 172.21.15.6:0/2466159554 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd89006b1e0 0x7fd8900c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.092+0000 7fd896f9f640 1 --2- 172.21.15.6:0/2466159554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890070b70 0x7fd890070f40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.092+0000 7fd896f9f640 1 -- 172.21.15.6:0/2466159554 >> 172.21.15.6:0/2466159554 conn(0x7fd8900afcf0 msgr2=0x7fd8900b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:48.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.092+0000 7fd896f9f640 1 -- 172.21.15.6:0/2466159554 shutdown_connections 2023-07-21T22:18:48.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.092+0000 7fd896f9f640 1 -- 172.21.15.6:0/2466159554 wait complete. 2023-07-21T22:18:48.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd896f9f640 1 Processor -- start 2023-07-21T22:18:48.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd896f9f640 1 -- start start 2023-07-21T22:18:48.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd896f9f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd89006b1e0 0x7fd890155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:48.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd896f9f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890070b70 0x7fd8900c3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:48.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd896f9f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8900c21f0 0x7fd8901523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:48.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd896f9f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd890154e90 con 0x7fd890070b70 2023-07-21T22:18:48.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd896f9f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8900c3640 con 0x7fd89006b1e0 2023-07-21T22:18:48.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd896f9f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd890154560 con 0x7fd8900c21f0 2023-07-21T22:18:48.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd88ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890070b70 0x7fd8900c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:48.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd88ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890070b70 0x7fd8900c3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46620/0 (socket says 172.21.15.6:46620) 2023-07-21T22:18:48.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd894d3b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd89006b1e0 0x7fd890155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:48.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd88ffff640 1 -- 172.21.15.6:0/2400271419 learned_addr learned my addr 172.21.15.6:0/2400271419 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:48.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd89553c640 1 --2- 172.21.15.6:0/2400271419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8900c21f0 0x7fd8901523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:48.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd88ffff640 1 -- 172.21.15.6:0/2400271419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8900c21f0 msgr2=0x7fd8901523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:48.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd88ffff640 1 --2- 172.21.15.6:0/2400271419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8900c21f0 0x7fd8901523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd88ffff640 1 -- 172.21.15.6:0/2400271419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd89006b1e0 msgr2=0x7fd890155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:48.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd88ffff640 1 --2- 172.21.15.6:0/2400271419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd89006b1e0 0x7fd890155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd88ffff640 1 -- 172.21.15.6:0/2400271419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8840094d0 con 0x7fd890070b70 2023-07-21T22:18:48.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd89553c640 1 --2- 172.21.15.6:0/2400271419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8900c21f0 0x7fd8901523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:48.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd88ffff640 1 --2- 172.21.15.6:0/2400271419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890070b70 0x7fd8900c3100 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00e930 tx=0x7fd87c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:48.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.096+0000 7fd88d7fa640 1 -- 172.21.15.6:0/2400271419 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c009690 con 0x7fd890070b70 2023-07-21T22:18:48.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.100+0000 7fd88d7fa640 1 -- 172.21.15.6:0/2400271419 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87c00ca00 con 0x7fd890070b70 2023-07-21T22:18:48.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.100+0000 7fd88d7fa640 1 -- 172.21.15.6:0/2400271419 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c00cd70 con 0x7fd890070b70 2023-07-21T22:18:48.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.100+0000 7fd896f9f640 1 -- 172.21.15.6:0/2400271419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd890154840 con 0x7fd890070b70 2023-07-21T22:18:48.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.100+0000 7fd896f9f640 1 -- 172.21.15.6:0/2400271419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd890154210 con 0x7fd890070b70 2023-07-21T22:18:48.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.100+0000 7fd896f9f640 1 -- 172.21.15.6:0/2400271419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8900715c0 con 0x7fd890070b70 2023-07-21T22:18:48.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.100+0000 7fd88d7fa640 1 -- 172.21.15.6:0/2400271419 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd87c013470 con 0x7fd890070b70 2023-07-21T22:18:48.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.100+0000 7fd88d7fa640 1 --2- 172.21.15.6:0/2400271419 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd8740662b0 0x7fd874068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:48.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.100+0000 7fd88d7fa640 1 -- 172.21.15.6:0/2400271419 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd87c083f40 con 0x7fd890070b70 2023-07-21T22:18:48.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.100+0000 7fd894d3b640 1 --2- 172.21.15.6:0/2400271419 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd8740662b0 0x7fd874068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:48.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.104+0000 7fd894d3b640 1 --2- 172.21.15.6:0/2400271419 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd8740662b0 0x7fd874068760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd8840af000 tx=0x7fd8840b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:48.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.104+0000 7fd88d7fa640 1 -- 172.21.15.6:0/2400271419 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd87c051400 con 0x7fd890070b70 2023-07-21T22:18:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.260+0000 7fd896f9f640 1 -- 172.21.15.6:0/2400271419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8900678d0 con 0x7fd890070b70 2023-07-21T22:18:48.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.264+0000 7fd88d7fa640 1 -- 172.21.15.6:0/2400271419 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18207 (secure 0 0 0) 0x7fd87c021090 con 0x7fd890070b70 2023-07-21T22:18:48.310 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:18:48.310 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:18:45.315608+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:18:41.465054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:18:42.709896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:18:48.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.264+0000 7fd896f9f640 1 -- 172.21.15.6:0/2400271419 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd8740662b0 msgr2=0x7fd874068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:48.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.264+0000 7fd896f9f640 1 --2- 172.21.15.6:0/2400271419 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd8740662b0 0x7fd874068760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd8840af000 tx=0x7fd8840b6040 comp rx=0 tx=0).stop 2023-07-21T22:18:48.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.264+0000 7fd896f9f640 1 -- 172.21.15.6:0/2400271419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890070b70 msgr2=0x7fd8900c3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:48.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.264+0000 7fd896f9f640 1 --2- 172.21.15.6:0/2400271419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890070b70 0x7fd8900c3100 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00e930 tx=0x7fd87c00edf0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.264+0000 7fd896f9f640 1 -- 172.21.15.6:0/2400271419 shutdown_connections 2023-07-21T22:18:48.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.264+0000 7fd896f9f640 1 --2- 172.21.15.6:0/2400271419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8900c21f0 0x7fd8901523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.264+0000 7fd896f9f640 1 --2- 172.21.15.6:0/2400271419 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd8740662b0 0x7fd874068760 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.264+0000 7fd896f9f640 1 --2- 172.21.15.6:0/2400271419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890070b70 0x7fd8900c3100 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.264+0000 7fd896f9f640 1 --2- 172.21.15.6:0/2400271419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd89006b1e0 0x7fd890155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.264+0000 7fd896f9f640 1 -- 172.21.15.6:0/2400271419 >> 172.21.15.6:0/2400271419 conn(0x7fd8900afcf0 msgr2=0x7fd89006b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:48.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.264+0000 7fd896f9f640 1 -- 172.21.15.6:0/2400271419 shutdown_connections 2023-07-21T22:18:48.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.264+0000 7fd896f9f640 1 -- 172.21.15.6:0/2400271419 wait complete. 2023-07-21T22:18:48.331 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T22:18:48.331 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:18:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.428+0000 7fbe371c5640 1 Processor -- start 2023-07-21T22:18:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.428+0000 7fbe371c5640 1 -- start start 2023-07-21T22:18:48.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.432+0000 7fbe371c5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbe3015b7c0 0x7fbe3006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.432+0000 7fbe371c5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbe300cb780 0x7fbe3006b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.432+0000 7fbe371c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe3006fd90 0x7fbe30070210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.432+0000 7fbe371c5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe300cdce0 con 0x7fbe3015b7c0 2023-07-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.432+0000 7fbe371c5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe300ca830 con 0x7fbe300cb780 2023-07-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.432+0000 7fbe371c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3006f900 con 0x7fbe3006fd90 2023-07-21T22:18:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.432+0000 7fbe34f61640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbe3015b7c0 0x7fbe3006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.432+0000 7fbe34f61640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbe3015b7c0 0x7fbe3006b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46628/0 (socket says 172.21.15.6:46628) 2023-07-21T22:18:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.432+0000 7fbe34f61640 1 -- 172.21.15.6:0/2808831901 learned_addr learned my addr 172.21.15.6:0/2808831901 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.432+0000 7fbe35762640 1 --2- 172.21.15.6:0/2808831901 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe3006fd90 0x7fbe30070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:48.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.432+0000 7fbe2ffff640 1 --2- 172.21.15.6:0/2808831901 >> v2:172.21.15.161:3300/0 conn(0x7fbe300cb780 0x7fbe3006b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:48.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.432+0000 7fbe34f61640 1 -- 172.21.15.6:0/2808831901 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe3006fd90 msgr2=0x7fbe30070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:48.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.432+0000 7fbe34f61640 1 --2- 172.21.15.6:0/2808831901 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe3006fd90 0x7fbe30070210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.432+0000 7fbe34f61640 1 -- 172.21.15.6:0/2808831901 >> v2:172.21.15.161:3300/0 conn(0x7fbe300cb780 msgr2=0x7fbe3006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:48.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.432+0000 7fbe34f61640 1 --2- 172.21.15.6:0/2808831901 >> v2:172.21.15.161:3300/0 conn(0x7fbe300cb780 0x7fbe3006b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.432+0000 7fbe34f61640 1 -- 172.21.15.6:0/2808831901 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3015bb90 con 0x7fbe3015b7c0 2023-07-21T22:18:48.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.436+0000 7fbe34f61640 1 --2- 172.21.15.6:0/2808831901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe3015b7c0 0x7fbe3006b1e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe3006af40 tx=0x7fbe2401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7f157718b91e73 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:48.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.436+0000 7fbe2f7fe640 1 -- 172.21.15.6:0/2808831901 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe240ac630 con 0x7fbe3015b7c0 2023-07-21T22:18:48.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.436+0000 7fbe2f7fe640 1 -- 172.21.15.6:0/2808831901 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe240ac790 con 0x7fbe3015b7c0 2023-07-21T22:18:48.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.436+0000 7fbe2f7fe640 1 -- 172.21.15.6:0/2808831901 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe240acb20 con 0x7fbe3015b7c0 2023-07-21T22:18:48.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.436+0000 7fbe371c5640 1 -- 172.21.15.6:0/2808831901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe3015b7c0 msgr2=0x7fbe3006b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:48.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.436+0000 7fbe371c5640 1 --2- 172.21.15.6:0/2808831901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe3015b7c0 0x7fbe3006b1e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe3006af40 tx=0x7fbe2401c4a0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.436+0000 7fbe371c5640 1 -- 172.21.15.6:0/2808831901 shutdown_connections 2023-07-21T22:18:48.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.436+0000 7fbe371c5640 1 --2- 172.21.15.6:0/2808831901 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe3006fd90 0x7fbe30070210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.436+0000 7fbe371c5640 1 --2- 172.21.15.6:0/2808831901 >> v2:172.21.15.161:3300/0 conn(0x7fbe300cb780 0x7fbe3006b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.436+0000 7fbe371c5640 1 --2- 172.21.15.6:0/2808831901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe3015b7c0 0x7fbe3006b1e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.436+0000 7fbe371c5640 1 -- 172.21.15.6:0/2808831901 >> 172.21.15.6:0/2808831901 conn(0x7fbe300afcf0 msgr2=0x7fbe300b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:48.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.436+0000 7fbe371c5640 1 -- 172.21.15.6:0/2808831901 shutdown_connections 2023-07-21T22:18:48.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.436+0000 7fbe371c5640 1 -- 172.21.15.6:0/2808831901 wait complete. 2023-07-21T22:18:48.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.436+0000 7fbe371c5640 1 Processor -- start 2023-07-21T22:18:48.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe371c5640 1 -- start start 2023-07-21T22:18:48.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe371c5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe3006fd90 0x7fbe3014dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:48.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe371c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe3015b7c0 0x7fbe300b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:48.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe371c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe300b38f0 0x7fbe300c2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:48.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe371c5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe301526f0 con 0x7fbe300b38f0 2023-07-21T22:18:48.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe371c5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe300b3d70 con 0x7fbe3006fd90 2023-07-21T22:18:48.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe371c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3014e4f0 con 0x7fbe3015b7c0 2023-07-21T22:18:48.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe35762640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe300b38f0 0x7fbe300c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:48.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe35762640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe300b38f0 0x7fbe300c2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46640/0 (socket says 172.21.15.6:46640) 2023-07-21T22:18:48.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe35762640 1 -- 172.21.15.6:0/2223895485 learned_addr learned my addr 172.21.15.6:0/2223895485 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe34f61640 1 --2- 172.21.15.6:0/2223895485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe3006fd90 0x7fbe3014dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe2ffff640 1 --2- 172.21.15.6:0/2223895485 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe3015b7c0 0x7fbe300b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe35762640 1 -- 172.21.15.6:0/2223895485 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe3015b7c0 msgr2=0x7fbe300b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:48.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe35762640 1 --2- 172.21.15.6:0/2223895485 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe3015b7c0 0x7fbe300b33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe35762640 1 -- 172.21.15.6:0/2223895485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe3006fd90 msgr2=0x7fbe3014dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:48.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe35762640 1 --2- 172.21.15.6:0/2223895485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe3006fd90 0x7fbe3014dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe35762640 1 -- 172.21.15.6:0/2223895485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe240094d0 con 0x7fbe300b38f0 2023-07-21T22:18:48.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe34f61640 1 --2- 172.21.15.6:0/2223895485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe3006fd90 0x7fbe3014dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:48.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe35762640 1 --2- 172.21.15.6:0/2223895485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe300b38f0 0x7fbe300c2670 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbe28007e40 tx=0x7fbe2800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:48.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe2d7fa640 1 -- 172.21.15.6:0/2223895485 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28014620 con 0x7fbe300b38f0 2023-07-21T22:18:48.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe2d7fa640 1 -- 172.21.15.6:0/2223895485 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe280147a0 con 0x7fbe300b38f0 2023-07-21T22:18:48.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe371c5640 1 -- 172.21.15.6:0/2223895485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe300c3440 con 0x7fbe300b38f0 2023-07-21T22:18:48.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe2d7fa640 1 -- 172.21.15.6:0/2223895485 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28014b50 con 0x7fbe300b38f0 2023-07-21T22:18:48.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe371c5640 1 -- 172.21.15.6:0/2223895485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe300c3a00 con 0x7fbe300b38f0 2023-07-21T22:18:48.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.440+0000 7fbe371c5640 1 -- 172.21.15.6:0/2223895485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe30152830 con 0x7fbe300b38f0 2023-07-21T22:18:48.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.444+0000 7fbe2d7fa640 1 -- 172.21.15.6:0/2223895485 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbe28014cb0 con 0x7fbe300b38f0 2023-07-21T22:18:48.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.444+0000 7fbe2d7fa640 1 --2- 172.21.15.6:0/2223895485 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbe140662b0 0x7fbe14068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:48.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.444+0000 7fbe2d7fa640 1 -- 172.21.15.6:0/2223895485 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbe28084580 con 0x7fbe300b38f0 2023-07-21T22:18:48.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.444+0000 7fbe34f61640 1 --2- 172.21.15.6:0/2223895485 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbe140662b0 0x7fbe14068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:48.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.444+0000 7fbe34f61640 1 --2- 172.21.15.6:0/2223895485 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbe140662b0 0x7fbe14068760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbe240ae000 tx=0x7fbe24008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:48.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.448+0000 7fbe2d7fa640 1 -- 172.21.15.6:0/2223895485 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbe30152830 con 0x7fbe300b38f0 2023-07-21T22:18:48.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.600+0000 7fbe371c5640 1 -- 172.21.15.6:0/2223895485 --> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbe3006f590 con 0x7fbe140662b0 2023-07-21T22:18:48.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.608+0000 7fbe2d7fa640 1 -- 172.21.15.6:0/2223895485 <== mgr.4103 v2:172.21.15.161:6832/3471136886 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286231 (secure 0 0 0) 0x7fbe240bc090 con 0x7fbe140662b0 2023-07-21T22:18:48.661 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:18:48.663 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:18:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.612+0000 7fbe371c5640 1 -- 172.21.15.6:0/2223895485 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbe140662b0 msgr2=0x7fbe14068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.612+0000 7fbe371c5640 1 --2- 172.21.15.6:0/2223895485 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbe140662b0 0x7fbe14068760 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbe240ae000 tx=0x7fbe24008040 comp rx=0 tx=0).stop 2023-07-21T22:18:48.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.612+0000 7fbe371c5640 1 -- 172.21.15.6:0/2223895485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe300b38f0 msgr2=0x7fbe300c2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:48.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.612+0000 7fbe371c5640 1 --2- 172.21.15.6:0/2223895485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe300b38f0 0x7fbe300c2670 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbe28007e40 tx=0x7fbe2800e4b0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.612+0000 7fbe371c5640 1 -- 172.21.15.6:0/2223895485 shutdown_connections 2023-07-21T22:18:48.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.612+0000 7fbe371c5640 1 --2- 172.21.15.6:0/2223895485 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbe140662b0 0x7fbe14068760 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.612+0000 7fbe371c5640 1 --2- 172.21.15.6:0/2223895485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe300b38f0 0x7fbe300c2670 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.612+0000 7fbe371c5640 1 --2- 172.21.15.6:0/2223895485 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe3015b7c0 0x7fbe300b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.612+0000 7fbe371c5640 1 --2- 172.21.15.6:0/2223895485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe3006fd90 0x7fbe3014dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.612+0000 7fbe371c5640 1 -- 172.21.15.6:0/2223895485 >> 172.21.15.6:0/2223895485 conn(0x7fbe300afcf0 msgr2=0x7fbe300c8790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:48.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.612+0000 7fbe371c5640 1 -- 172.21.15.6:0/2223895485 shutdown_connections 2023-07-21T22:18:48.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.612+0000 7fbe371c5640 1 -- 172.21.15.6:0/2223895485 wait complete. 2023-07-21T22:18:48.680 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-21T22:18:46.768475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218748,"kb_used_data":3132,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755972,"statfs":{"total":773094113280,"available":772870115328,"internally_reserved":0,"allocated":3207168,"data_stored":1900606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.465661"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.341718+0000","last_change":"2023-07-21T22:18:44.336499+0000","last_active":"2023-07-21T22:18:44.341718+0000","last_peered":"2023-07-21T22:18:44.341718+0000","last_clean":"2023-07-21T22:18:44.341718+0000","last_became_active":"2023-07-21T22:18:44.336063+0000","last_became_peered":"2023-07-21T22:18:44.336063+0000","last_unstale":"2023-07-21T22:18:44.341718+0000","last_undegraded":"2023-07-21T22:18:44.341718+0000","last_fullsized":"2023-07-21T22:18:44.341718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:24:06.166416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346444+0000","last_change":"2023-07-21T22:18:44.341470+0000","last_active":"2023-07-21T22:18:44.346444+0000","last_peered":"2023-07-21T22:18:44.346444+0000","last_clean":"2023-07-21T22:18:44.346444+0000","last_became_active":"2023-07-21T22:18:44.341148+0000","last_became_peered":"2023-07-21T22:18:44.341148+0000","last_unstale":"2023-07-21T22:18:44.346444+0000","last_undegraded":"2023-07-21T22:18:44.346444+0000","last_fullsized":"2023-07-21T22:18:44.346444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:20.530615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.338400+0000","last_change":"2023-07-21T22:18:44.336245+0000","last_active":"2023-07-21T22:18:44.338400+0000","last_peered":"2023-07-21T22:18:44.338400+0000","last_clean":"2023-07-21T22:18:44.338400+0000","last_became_active":"2023-07-21T22:18:44.335682+0000","last_became_peered":"2023-07-21T22:18:44.335682+0000","last_unstale":"2023-07-21T22:18:44.338400+0000","last_undegraded":"2023-07-21T22:18:44.338400+0000","last_fullsized":"2023-07-21T22:18:44.338400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:16:43.932507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":24,"state":"creating+peering","last_fresh":"2023-07-21T22:18:43.319825+0000","last_change":"2023-07-21T22:18:43.319825+0000","last_active":"2023-07-21T22:18:43.300562+0000","last_peered":"2023-07-21T22:18:43.300562+0000","last_clean":"2023-07-21T22:18:43.300562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:18:43.319825+0000","last_undegraded":"2023-07-21T22:18:43.319825+0000","last_fullsized":"2023-07-21T22:18:43.319825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346108+0000","last_change":"2023-07-21T22:18:44.344066+0000","last_active":"2023-07-21T22:18:44.346108+0000","last_peered":"2023-07-21T22:18:44.346108+0000","last_clean":"2023-07-21T22:18:44.346108+0000","last_became_active":"2023-07-21T22:18:44.343765+0000","last_became_peered":"2023-07-21T22:18:44.343765+0000","last_unstale":"2023-07-21T22:18:44.346108+0000","last_undegraded":"2023-07-21T22:18:44.346108+0000","last_fullsized":"2023-07-21T22:18:44.346108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:54.484564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.338362+0000","last_change":"2023-07-21T22:18:44.336096+0000","last_active":"2023-07-21T22:18:44.338362+0000","last_peered":"2023-07-21T22:18:44.338362+0000","last_clean":"2023-07-21T22:18:44.338362+0000","last_became_active":"2023-07-21T22:18:44.335625+0000","last_became_peered":"2023-07-21T22:18:44.335625+0000","last_unstale":"2023-07-21T22:18:44.338362+0000","last_undegraded":"2023-07-21T22:18:44.338362+0000","last_fullsized":"2023-07-21T22:18:44.338362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:23:17.593542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.341432+0000","last_change":"2023-07-21T22:18:44.338953+0000","last_active":"2023-07-21T22:18:44.341432+0000","last_peered":"2023-07-21T22:18:44.341432+0000","last_clean":"2023-07-21T22:18:44.341432+0000","last_became_active":"2023-07-21T22:18:44.338582+0000","last_became_peered":"2023-07-21T22:18:44.338582+0000","last_unstale":"2023-07-21T22:18:44.341432+0000","last_undegraded":"2023-07-21T22:18:44.341432+0000","last_fullsized":"2023-07-21T22:18:44.341432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:10.090300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346408+0000","last_change":"2023-07-21T22:18:44.337662+0000","last_active":"2023-07-21T22:18:44.346408+0000","last_peered":"2023-07-21T22:18:44.346408+0000","last_clean":"2023-07-21T22:18:44.346408+0000","last_became_active":"2023-07-21T22:18:44.337217+0000","last_became_peered":"2023-07-21T22:18:44.337217+0000","last_unstale":"2023-07-21T22:18:44.346408+0000","last_undegraded":"2023-07-21T22:18:44.346408+0000","last_fullsized":"2023-07-21T22:18:44.346408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:06:33.367363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346142+0000","last_change":"2023-07-21T22:18:44.344268+0000","last_active":"2023-07-21T22:18:44.346142+0000","last_peered":"2023-07-21T22:18:44.346142+0000","last_clean":"2023-07-21T22:18:44.346142+0000","last_became_active":"2023-07-21T22:18:44.343880+0000","last_became_peered":"2023-07-21T22:18:44.343880+0000","last_unstale":"2023-07-21T22:18:44.346142+0000","last_undegraded":"2023-07-21T22:18:44.346142+0000","last_fullsized":"2023-07-21T22:18:44.346142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:45.242179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346345+0000","last_change":"2023-07-21T22:18:44.336379+0000","last_active":"2023-07-21T22:18:44.346345+0000","last_peered":"2023-07-21T22:18:44.346345+0000","last_clean":"2023-07-21T22:18:44.346345+0000","last_became_active":"2023-07-21T22:18:44.335846+0000","last_became_peered":"2023-07-21T22:18:44.335846+0000","last_unstale":"2023-07-21T22:18:44.346345+0000","last_undegraded":"2023-07-21T22:18:44.346345+0000","last_fullsized":"2023-07-21T22:18:44.346345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:44.120565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354172+0000","last_change":"2023-07-21T22:18:44.352832+0000","last_active":"2023-07-21T22:18:44.354172+0000","last_peered":"2023-07-21T22:18:44.354172+0000","last_clean":"2023-07-21T22:18:44.354172+0000","last_became_active":"2023-07-21T22:18:44.352465+0000","last_became_peered":"2023-07-21T22:18:44.352465+0000","last_unstale":"2023-07-21T22:18:44.354172+0000","last_undegraded":"2023-07-21T22:18:44.354172+0000","last_fullsized":"2023-07-21T22:18:44.354172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:48:56.083184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.342895+0000","last_change":"2023-07-21T22:18:44.337129+0000","last_active":"2023-07-21T22:18:44.342895+0000","last_peered":"2023-07-21T22:18:44.342895+0000","last_clean":"2023-07-21T22:18:44.342895+0000","last_became_active":"2023-07-21T22:18:44.336170+0000","last_became_peered":"2023-07-21T22:18:44.336170+0000","last_unstale":"2023-07-21T22:18:44.342895+0000","last_undegraded":"2023-07-21T22:18:44.342895+0000","last_fullsized":"2023-07-21T22:18:44.342895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:49.771671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.338356+0000","last_change":"2023-07-21T22:18:44.335382+0000","last_active":"2023-07-21T22:18:44.338356+0000","last_peered":"2023-07-21T22:18:44.338356+0000","last_clean":"2023-07-21T22:18:44.338356+0000","last_became_active":"2023-07-21T22:18:44.334933+0000","last_became_peered":"2023-07-21T22:18:44.334933+0000","last_unstale":"2023-07-21T22:18:44.338356+0000","last_undegraded":"2023-07-21T22:18:44.338356+0000","last_fullsized":"2023-07-21T22:18:44.338356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:30.400997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346250+0000","last_change":"2023-07-21T22:18:44.333998+0000","last_active":"2023-07-21T22:18:44.346250+0000","last_peered":"2023-07-21T22:18:44.346250+0000","last_clean":"2023-07-21T22:18:44.346250+0000","last_became_active":"2023-07-21T22:18:44.333720+0000","last_became_peered":"2023-07-21T22:18:44.333720+0000","last_unstale":"2023-07-21T22:18:44.346250+0000","last_undegraded":"2023-07-21T22:18:44.346250+0000","last_fullsized":"2023-07-21T22:18:44.346250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:47:24.196227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.344314+0000","last_change":"2023-07-21T22:18:44.341061+0000","last_active":"2023-07-21T22:18:44.344314+0000","last_peered":"2023-07-21T22:18:44.344314+0000","last_clean":"2023-07-21T22:18:44.344314+0000","last_became_active":"2023-07-21T22:18:44.340711+0000","last_became_peered":"2023-07-21T22:18:44.340711+0000","last_unstale":"2023-07-21T22:18:44.344314+0000","last_undegraded":"2023-07-21T22:18:44.344314+0000","last_fullsized":"2023-07-21T22:18:44.344314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:43.536674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.337952+0000","last_change":"2023-07-21T22:18:44.335984+0000","last_active":"2023-07-21T22:18:44.337952+0000","last_peered":"2023-07-21T22:18:44.337952+0000","last_clean":"2023-07-21T22:18:44.337952+0000","last_became_active":"2023-07-21T22:18:44.335481+0000","last_became_peered":"2023-07-21T22:18:44.335481+0000","last_unstale":"2023-07-21T22:18:44.337952+0000","last_undegraded":"2023-07-21T22:18:44.337952+0000","last_fullsized":"2023-07-21T22:18:44.337952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:55.939872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.335467+0000","last_change":"2023-07-21T22:18:44.333526+0000","last_active":"2023-07-21T22:18:44.335467+0000","last_peered":"2023-07-21T22:18:44.335467+0000","last_clean":"2023-07-21T22:18:44.335467+0000","last_became_active":"2023-07-21T22:18:44.333139+0000","last_became_peered":"2023-07-21T22:18:44.333139+0000","last_unstale":"2023-07-21T22:18:44.335467+0000","last_undegraded":"2023-07-21T22:18:44.335467+0000","last_fullsized":"2023-07-21T22:18:44.335467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:12.868716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.342623+0000","last_change":"2023-07-21T22:18:44.339606+0000","last_active":"2023-07-21T22:18:44.342623+0000","last_peered":"2023-07-21T22:18:44.342623+0000","last_clean":"2023-07-21T22:18:44.342623+0000","last_became_active":"2023-07-21T22:18:44.339282+0000","last_became_peered":"2023-07-21T22:18:44.339282+0000","last_unstale":"2023-07-21T22:18:44.342623+0000","last_undegraded":"2023-07-21T22:18:44.342623+0000","last_fullsized":"2023-07-21T22:18:44.342623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:56:31.905250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327372+0000","last_change":"2023-07-21T22:18:44.325126+0000","last_active":"2023-07-21T22:18:44.327372+0000","last_peered":"2023-07-21T22:18:44.327372+0000","last_clean":"2023-07-21T22:18:44.327372+0000","last_became_active":"2023-07-21T22:18:44.324795+0000","last_became_peered":"2023-07-21T22:18:44.324795+0000","last_unstale":"2023-07-21T22:18:44.327372+0000","last_undegraded":"2023-07-21T22:18:44.327372+0000","last_fullsized":"2023-07-21T22:18:44.327372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:54.484564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.342627+0000","last_change":"2023-07-21T22:18:44.338316+0000","last_active":"2023-07-21T22:18:44.342627+0000","last_peered":"2023-07-21T22:18:44.342627+0000","last_clean":"2023-07-21T22:18:44.342627+0000","last_became_active":"2023-07-21T22:18:44.337895+0000","last_became_peered":"2023-07-21T22:18:44.337895+0000","last_unstale":"2023-07-21T22:18:44.342627+0000","last_undegraded":"2023-07-21T22:18:44.342627+0000","last_fullsized":"2023-07-21T22:18:44.342627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:07:40.534702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.356332+0000","last_change":"2023-07-21T22:18:44.355582+0000","last_active":"2023-07-21T22:18:44.356332+0000","last_peered":"2023-07-21T22:18:44.356332+0000","last_clean":"2023-07-21T22:18:44.356332+0000","last_became_active":"2023-07-21T22:18:44.355317+0000","last_became_peered":"2023-07-21T22:18:44.355317+0000","last_unstale":"2023-07-21T22:18:44.356332+0000","last_undegraded":"2023-07-21T22:18:44.356332+0000","last_fullsized":"2023-07-21T22:18:44.356332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:51.653402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354983+0000","last_change":"2023-07-21T22:18:44.348333+0000","last_active":"2023-07-21T22:18:44.354983+0000","last_peered":"2023-07-21T22:18:44.354983+0000","last_clean":"2023-07-21T22:18:44.354983+0000","last_became_active":"2023-07-21T22:18:44.347982+0000","last_became_peered":"2023-07-21T22:18:44.347982+0000","last_unstale":"2023-07-21T22:18:44.354983+0000","last_undegraded":"2023-07-21T22:18:44.354983+0000","last_fullsized":"2023-07-21T22:18:44.354983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:54:18.053463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.338742+0000","last_change":"2023-07-21T22:18:44.333429+0000","last_active":"2023-07-21T22:18:44.338742+0000","last_peered":"2023-07-21T22:18:44.338742+0000","last_clean":"2023-07-21T22:18:44.338742+0000","last_became_active":"2023-07-21T22:18:44.333121+0000","last_became_peered":"2023-07-21T22:18:44.333121+0000","last_unstale":"2023-07-21T22:18:44.338742+0000","last_undegraded":"2023-07-21T22:18:44.338742+0000","last_fullsized":"2023-07-21T22:18:44.338742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:05.638943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.349028+0000","last_change":"2023-07-21T22:18:44.346478+0000","last_active":"2023-07-21T22:18:44.349028+0000","last_peered":"2023-07-21T22:18:44.349028+0000","last_clean":"2023-07-21T22:18:44.349028+0000","last_became_active":"2023-07-21T22:18:44.346160+0000","last_became_peered":"2023-07-21T22:18:44.346160+0000","last_unstale":"2023-07-21T22:18:44.349028+0000","last_undegraded":"2023-07-21T22:18:44.349028+0000","last_fullsized":"2023-07-21T22:18:44.349028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:25:34.392203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.350826+0000","last_change":"2023-07-21T22:18:44.348596+0000","last_active":"2023-07-21T22:18:44.350826+0000","last_peered":"2023-07-21T22:18:44.350826+0000","last_clean":"2023-07-21T22:18:44.350826+0000","last_became_active":"2023-07-21T22:18:44.348325+0000","last_became_peered":"2023-07-21T22:18:44.348325+0000","last_unstale":"2023-07-21T22:18:44.350826+0000","last_undegraded":"2023-07-21T22:18:44.350826+0000","last_fullsized":"2023-07-21T22:18:44.350826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:38:06.965559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.339342+0000","last_change":"2023-07-21T22:18:44.335321+0000","last_active":"2023-07-21T22:18:44.339342+0000","last_peered":"2023-07-21T22:18:44.339342+0000","last_clean":"2023-07-21T22:18:44.339342+0000","last_became_active":"2023-07-21T22:18:44.334970+0000","last_became_peered":"2023-07-21T22:18:44.334970+0000","last_unstale":"2023-07-21T22:18:44.339342+0000","last_undegraded":"2023-07-21T22:18:44.339342+0000","last_fullsized":"2023-07-21T22:18:44.339342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:45.242179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.347194+0000","last_change":"2023-07-21T22:18:44.345317+0000","last_active":"2023-07-21T22:18:44.347194+0000","last_peered":"2023-07-21T22:18:44.347194+0000","last_clean":"2023-07-21T22:18:44.347194+0000","last_became_active":"2023-07-21T22:18:44.344901+0000","last_became_peered":"2023-07-21T22:18:44.344901+0000","last_unstale":"2023-07-21T22:18:44.347194+0000","last_undegraded":"2023-07-21T22:18:44.347194+0000","last_fullsized":"2023-07-21T22:18:44.347194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:05.701948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.340949+0000","last_change":"2023-07-21T22:18:44.336787+0000","last_active":"2023-07-21T22:18:44.340949+0000","last_peered":"2023-07-21T22:18:44.340949+0000","last_clean":"2023-07-21T22:18:44.340949+0000","last_became_active":"2023-07-21T22:18:44.336502+0000","last_became_peered":"2023-07-21T22:18:44.336502+0000","last_unstale":"2023-07-21T22:18:44.340949+0000","last_undegraded":"2023-07-21T22:18:44.340949+0000","last_fullsized":"2023-07-21T22:18:44.340949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:51.413018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354531+0000","last_change":"2023-07-21T22:18:44.348671+0000","last_active":"2023-07-21T22:18:44.354531+0000","last_peered":"2023-07-21T22:18:44.354531+0000","last_clean":"2023-07-21T22:18:44.354531+0000","last_became_active":"2023-07-21T22:18:44.348361+0000","last_became_peered":"2023-07-21T22:18:44.348361+0000","last_unstale":"2023-07-21T22:18:44.354531+0000","last_undegraded":"2023-07-21T22:18:44.354531+0000","last_fullsized":"2023-07-21T22:18:44.354531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:37:46.816193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.350895+0000","last_change":"2023-07-21T22:18:44.348495+0000","last_active":"2023-07-21T22:18:44.350895+0000","last_peered":"2023-07-21T22:18:44.350895+0000","last_clean":"2023-07-21T22:18:44.350895+0000","last_became_active":"2023-07-21T22:18:44.348107+0000","last_became_peered":"2023-07-21T22:18:44.348107+0000","last_unstale":"2023-07-21T22:18:44.350895+0000","last_undegraded":"2023-07-21T22:18:44.350895+0000","last_fullsized":"2023-07-21T22:18:44.350895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:45:41.479888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.353726+0000","last_change":"2023-07-21T22:18:44.342060+0000","last_active":"2023-07-21T22:18:44.353726+0000","last_peered":"2023-07-21T22:18:44.353726+0000","last_clean":"2023-07-21T22:18:44.353726+0000","last_became_active":"2023-07-21T22:18:44.341767+0000","last_became_peered":"2023-07-21T22:18:44.341767+0000","last_unstale":"2023-07-21T22:18:44.353726+0000","last_undegraded":"2023-07-21T22:18:44.353726+0000","last_fullsized":"2023-07-21T22:18:44.353726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:51.413018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":24,"state":"creating+peering","last_fresh":"2023-07-21T22:18:43.318779+0000","last_change":"2023-07-21T22:18:43.318779+0000","last_active":"2023-07-21T22:18:43.300562+0000","last_peered":"2023-07-21T22:18:43.300562+0000","last_clean":"2023-07-21T22:18:43.300562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:18:43.318779+0000","last_undegraded":"2023-07-21T22:18:43.318779+0000","last_fullsized":"2023-07-21T22:18:43.318779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348765+0000","last_change":"2023-07-21T22:18:44.338017+0000","last_active":"2023-07-21T22:18:44.348765+0000","last_peered":"2023-07-21T22:18:44.348765+0000","last_clean":"2023-07-21T22:18:44.348765+0000","last_became_active":"2023-07-21T22:18:44.337215+0000","last_became_peered":"2023-07-21T22:18:44.337215+0000","last_unstale":"2023-07-21T22:18:44.348765+0000","last_undegraded":"2023-07-21T22:18:44.348765+0000","last_fullsized":"2023-07-21T22:18:44.348765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:13:17.888290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.544481+0000","last_change":"2023-07-21T22:18:43.345411+0000","last_active":"2023-07-21T22:18:44.544481+0000","last_peered":"2023-07-21T22:18:44.544481+0000","last_clean":"2023-07-21T22:18:44.544481+0000","last_became_active":"2023-07-21T22:18:43.345095+0000","last_became_peered":"2023-07-21T22:18:43.345095+0000","last_unstale":"2023-07-21T22:18:44.544481+0000","last_undegraded":"2023-07-21T22:18:44.544481+0000","last_fullsized":"2023-07-21T22:18:44.544481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:40:45.106399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.347173+0000","last_change":"2023-07-21T22:18:44.345111+0000","last_active":"2023-07-21T22:18:44.347173+0000","last_peered":"2023-07-21T22:18:44.347173+0000","last_clean":"2023-07-21T22:18:44.347173+0000","last_became_active":"2023-07-21T22:18:44.344325+0000","last_became_peered":"2023-07-21T22:18:44.344325+0000","last_unstale":"2023-07-21T22:18:44.347173+0000","last_undegraded":"2023-07-21T22:18:44.347173+0000","last_fullsized":"2023-07-21T22:18:44.347173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:26.300457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327919+0000","last_change":"2023-07-21T22:18:43.340538+0000","last_active":"2023-07-21T22:18:44.327919+0000","last_peered":"2023-07-21T22:18:44.327919+0000","last_clean":"2023-07-21T22:18:44.327919+0000","last_became_active":"2023-07-21T22:18:43.340172+0000","last_became_peered":"2023-07-21T22:18:43.340172+0000","last_unstale":"2023-07-21T22:18:44.327919+0000","last_undegraded":"2023-07-21T22:18:44.327919+0000","last_fullsized":"2023-07-21T22:18:44.327919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:26:53.788877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.343008+0000","last_change":"2023-07-21T22:18:44.342020+0000","last_active":"2023-07-21T22:18:44.343008+0000","last_peered":"2023-07-21T22:18:44.343008+0000","last_clean":"2023-07-21T22:18:44.343008+0000","last_became_active":"2023-07-21T22:18:44.341724+0000","last_became_peered":"2023-07-21T22:18:44.341724+0000","last_unstale":"2023-07-21T22:18:44.343008+0000","last_undegraded":"2023-07-21T22:18:44.343008+0000","last_fullsized":"2023-07-21T22:18:44.343008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:57:20.260229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.331377+0000","last_change":"2023-07-21T22:18:43.337771+0000","last_active":"2023-07-21T22:18:44.331377+0000","last_peered":"2023-07-21T22:18:44.331377+0000","last_clean":"2023-07-21T22:18:44.331377+0000","last_became_active":"2023-07-21T22:18:43.337480+0000","last_became_peered":"2023-07-21T22:18:43.337480+0000","last_unstale":"2023-07-21T22:18:44.331377+0000","last_undegraded":"2023-07-21T22:18:44.331377+0000","last_fullsized":"2023-07-21T22:18:44.331377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:44:35.365564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.355676+0000","last_change":"2023-07-21T22:18:44.349625+0000","last_active":"2023-07-21T22:18:44.355676+0000","last_peered":"2023-07-21T22:18:44.355676+0000","last_clean":"2023-07-21T22:18:44.355676+0000","last_became_active":"2023-07-21T22:18:44.349046+0000","last_became_peered":"2023-07-21T22:18:44.349046+0000","last_unstale":"2023-07-21T22:18:44.355676+0000","last_undegraded":"2023-07-21T22:18:44.355676+0000","last_fullsized":"2023-07-21T22:18:44.355676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:26:54.799948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T22:18:43.349137+0000","last_change":"2023-07-21T22:18:43.344968+0000","last_active":"2023-07-21T22:18:43.349137+0000","last_peered":"2023-07-21T22:18:43.349137+0000","last_clean":"2023-07-21T22:18:43.349137+0000","last_became_active":"2023-07-21T22:18:43.344570+0000","last_became_peered":"2023-07-21T22:18:43.344570+0000","last_unstale":"2023-07-21T22:18:43.349137+0000","last_undegraded":"2023-07-21T22:18:43.349137+0000","last_fullsized":"2023-07-21T22:18:43.349137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:48.760601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.544297+0000","last_change":"2023-07-21T22:18:43.348215+0000","last_active":"2023-07-21T22:18:44.544297+0000","last_peered":"2023-07-21T22:18:44.544297+0000","last_clean":"2023-07-21T22:18:44.544297+0000","last_became_active":"2023-07-21T22:18:43.347858+0000","last_became_peered":"2023-07-21T22:18:43.347858+0000","last_unstale":"2023-07-21T22:18:44.544297+0000","last_undegraded":"2023-07-21T22:18:44.544297+0000","last_fullsized":"2023-07-21T22:18:44.544297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:25.289386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346430+0000","last_change":"2023-07-21T22:18:44.341650+0000","last_active":"2023-07-21T22:18:44.346430+0000","last_peered":"2023-07-21T22:18:44.346430+0000","last_clean":"2023-07-21T22:18:44.346430+0000","last_became_active":"2023-07-21T22:18:44.341352+0000","last_became_peered":"2023-07-21T22:18:44.341352+0000","last_unstale":"2023-07-21T22:18:44.346430+0000","last_undegraded":"2023-07-21T22:18:44.346430+0000","last_fullsized":"2023-07-21T22:18:44.346430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:16:43.932507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.543980+0000","last_change":"2023-07-21T22:18:43.348256+0000","last_active":"2023-07-21T22:18:44.543980+0000","last_peered":"2023-07-21T22:18:44.543980+0000","last_clean":"2023-07-21T22:18:44.543980+0000","last_became_active":"2023-07-21T22:18:43.347754+0000","last_became_peered":"2023-07-21T22:18:43.347754+0000","last_unstale":"2023-07-21T22:18:44.543980+0000","last_undegraded":"2023-07-21T22:18:44.543980+0000","last_fullsized":"2023-07-21T22:18:44.543980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:29:22.726274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354180+0000","last_change":"2023-07-21T22:18:44.353012+0000","last_active":"2023-07-21T22:18:44.354180+0000","last_peered":"2023-07-21T22:18:44.354180+0000","last_clean":"2023-07-21T22:18:44.354180+0000","last_became_active":"2023-07-21T22:18:44.352586+0000","last_became_peered":"2023-07-21T22:18:44.352586+0000","last_unstale":"2023-07-21T22:18:44.354180+0000","last_undegraded":"2023-07-21T22:18:44.354180+0000","last_fullsized":"2023-07-21T22:18:44.354180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:53:39.587668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"25'1","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.545116+0000","last_change":"2023-07-21T22:18:43.338600+0000","last_active":"2023-07-21T22:18:44.545116+0000","last_peered":"2023-07-21T22:18:44.545116+0000","last_clean":"2023-07-21T22:18:44.545116+0000","last_became_active":"2023-07-21T22:18:43.338271+0000","last_became_peered":"2023-07-21T22:18:43.338271+0000","last_unstale":"2023-07-21T22:18:44.545116+0000","last_undegraded":"2023-07-21T22:18:44.545116+0000","last_fullsized":"2023-07-21T22:18:44.545116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:49.375113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":24,"state":"creating+peering","last_fresh":"2023-07-21T22:18:43.318984+0000","last_change":"2023-07-21T22:18:43.318984+0000","last_active":"2023-07-21T22:18:43.300562+0000","last_peered":"2023-07-21T22:18:43.300562+0000","last_clean":"2023-07-21T22:18:43.300562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:18:43.318984+0000","last_undegraded":"2023-07-21T22:18:43.318984+0000","last_fullsized":"2023-07-21T22:18:43.318984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.322602+0000","last_change":"2023-07-21T22:18:43.339272+0000","last_active":"2023-07-21T22:18:44.322602+0000","last_peered":"2023-07-21T22:18:44.322602+0000","last_clean":"2023-07-21T22:18:44.322602+0000","last_became_active":"2023-07-21T22:18:43.338864+0000","last_became_peered":"2023-07-21T22:18:43.338864+0000","last_unstale":"2023-07-21T22:18:44.322602+0000","last_undegraded":"2023-07-21T22:18:44.322602+0000","last_fullsized":"2023-07-21T22:18:44.322602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:21:31.802323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354956+0000","last_change":"2023-07-21T22:18:44.347783+0000","last_active":"2023-07-21T22:18:44.354956+0000","last_peered":"2023-07-21T22:18:44.354956+0000","last_clean":"2023-07-21T22:18:44.354956+0000","last_became_active":"2023-07-21T22:18:44.347417+0000","last_became_peered":"2023-07-21T22:18:44.347417+0000","last_unstale":"2023-07-21T22:18:44.354956+0000","last_undegraded":"2023-07-21T22:18:44.354956+0000","last_fullsized":"2023-07-21T22:18:44.354956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:13:17.888290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.539367+0000","last_change":"2023-07-21T22:18:43.341666+0000","last_active":"2023-07-21T22:18:44.539367+0000","last_peered":"2023-07-21T22:18:44.539367+0000","last_clean":"2023-07-21T22:18:44.539367+0000","last_became_active":"2023-07-21T22:18:43.341287+0000","last_became_peered":"2023-07-21T22:18:43.341287+0000","last_unstale":"2023-07-21T22:18:44.539367+0000","last_undegraded":"2023-07-21T22:18:44.539367+0000","last_fullsized":"2023-07-21T22:18:44.539367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:28.967479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348446+0000","last_change":"2023-07-21T22:18:44.345773+0000","last_active":"2023-07-21T22:18:44.348446+0000","last_peered":"2023-07-21T22:18:44.348446+0000","last_clean":"2023-07-21T22:18:44.348446+0000","last_became_active":"2023-07-21T22:18:44.345494+0000","last_became_peered":"2023-07-21T22:18:44.345494+0000","last_unstale":"2023-07-21T22:18:44.348446+0000","last_undegraded":"2023-07-21T22:18:44.348446+0000","last_fullsized":"2023-07-21T22:18:44.348446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:18:32.374919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T22:18:43.349108+0000","last_change":"2023-07-21T22:18:43.346587+0000","last_active":"2023-07-21T22:18:43.349108+0000","last_peered":"2023-07-21T22:18:43.349108+0000","last_clean":"2023-07-21T22:18:43.349108+0000","last_became_active":"2023-07-21T22:18:43.346170+0000","last_became_peered":"2023-07-21T22:18:43.346170+0000","last_unstale":"2023-07-21T22:18:43.349108+0000","last_undegraded":"2023-07-21T22:18:43.349108+0000","last_fullsized":"2023-07-21T22:18:43.349108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:29.389926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.342644+0000","last_change":"2023-07-21T22:18:44.339550+0000","last_active":"2023-07-21T22:18:44.342644+0000","last_peered":"2023-07-21T22:18:44.342644+0000","last_clean":"2023-07-21T22:18:44.342644+0000","last_became_active":"2023-07-21T22:18:44.339232+0000","last_became_peered":"2023-07-21T22:18:44.339232+0000","last_unstale":"2023-07-21T22:18:44.342644+0000","last_undegraded":"2023-07-21T22:18:44.342644+0000","last_fullsized":"2023-07-21T22:18:44.342644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:06:33.367363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.331764+0000","last_change":"2023-07-21T22:18:43.342021+0000","last_active":"2023-07-21T22:18:44.331764+0000","last_peered":"2023-07-21T22:18:44.331764+0000","last_clean":"2023-07-21T22:18:44.331764+0000","last_became_active":"2023-07-21T22:18:43.340494+0000","last_became_peered":"2023-07-21T22:18:43.340494+0000","last_unstale":"2023-07-21T22:18:44.331764+0000","last_undegraded":"2023-07-21T22:18:44.331764+0000","last_fullsized":"2023-07-21T22:18:44.331764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:43.109494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.350920+0000","last_change":"2023-07-21T22:18:44.349404+0000","last_active":"2023-07-21T22:18:44.350920+0000","last_peered":"2023-07-21T22:18:44.350920+0000","last_clean":"2023-07-21T22:18:44.350920+0000","last_became_active":"2023-07-21T22:18:44.348314+0000","last_became_peered":"2023-07-21T22:18:44.348314+0000","last_unstale":"2023-07-21T22:18:44.350920+0000","last_undegraded":"2023-07-21T22:18:44.350920+0000","last_fullsized":"2023-07-21T22:18:44.350920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:07:37.786708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.329935+0000","last_change":"2023-07-21T22:18:43.329711+0000","last_active":"2023-07-21T22:18:44.329935+0000","last_peered":"2023-07-21T22:18:44.329935+0000","last_clean":"2023-07-21T22:18:44.329935+0000","last_became_active":"2023-07-21T22:18:43.329184+0000","last_became_peered":"2023-07-21T22:18:43.329184+0000","last_unstale":"2023-07-21T22:18:44.329935+0000","last_undegraded":"2023-07-21T22:18:44.329935+0000","last_fullsized":"2023-07-21T22:18:44.329935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:44.231108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.355627+0000","last_change":"2023-07-21T22:18:44.354431+0000","last_active":"2023-07-21T22:18:44.355627+0000","last_peered":"2023-07-21T22:18:44.355627+0000","last_clean":"2023-07-21T22:18:44.355627+0000","last_became_active":"2023-07-21T22:18:44.354063+0000","last_became_peered":"2023-07-21T22:18:44.354063+0000","last_unstale":"2023-07-21T22:18:44.355627+0000","last_undegraded":"2023-07-21T22:18:44.355627+0000","last_fullsized":"2023-07-21T22:18:44.355627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:30:07.924076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":173,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.328122+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:18:44.328122+0000","last_peered":"2023-07-21T22:18:44.328122+0000","last_clean":"2023-07-21T22:18:44.328122+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:18:44.328122+0000","last_undegraded":"2023-07-21T22:18:44.328122+0000","last_fullsized":"2023-07-21T22:18:44.328122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:10:20.968928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.321937+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:18:44.321937+0000","last_peered":"2023-07-21T22:18:44.321937+0000","last_clean":"2023-07-21T22:18:44.321937+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:18:44.321937+0000","last_undegraded":"2023-07-21T22:18:44.321937+0000","last_fullsized":"2023-07-21T22:18:44.321937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:48:50.039471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.330287+0000","last_change":"2023-07-21T22:18:43.327625+0000","last_active":"2023-07-21T22:18:44.330287+0000","last_peered":"2023-07-21T22:18:44.330287+0000","last_clean":"2023-07-21T22:18:44.330287+0000","last_became_active":"2023-07-21T22:18:43.327272+0000","last_became_peered":"2023-07-21T22:18:43.327272+0000","last_unstale":"2023-07-21T22:18:44.330287+0000","last_undegraded":"2023-07-21T22:18:44.330287+0000","last_fullsized":"2023-07-21T22:18:44.330287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:30:06.913006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":24,"state":"creating+peering","last_fresh":"2023-07-21T22:18:43.319528+0000","last_change":"2023-07-21T22:18:43.319528+0000","last_active":"2023-07-21T22:18:43.300562+0000","last_peered":"2023-07-21T22:18:43.300562+0000","last_clean":"2023-07-21T22:18:43.300562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:18:43.319528+0000","last_undegraded":"2023-07-21T22:18:43.319528+0000","last_fullsized":"2023-07-21T22:18:43.319528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327999+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:18:44.327999+0000","last_peered":"2023-07-21T22:18:44.327999+0000","last_clean":"2023-07-21T22:18:44.327999+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:18:44.327999+0000","last_undegraded":"2023-07-21T22:18:44.327999+0000","last_fullsized":"2023-07-21T22:18:44.327999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:24:03.249599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327761+0000","last_change":"2023-07-21T22:18:43.344180+0000","last_active":"2023-07-21T22:18:44.327761+0000","last_peered":"2023-07-21T22:18:44.327761+0000","last_clean":"2023-07-21T22:18:44.327761+0000","last_became_active":"2023-07-21T22:18:43.343831+0000","last_became_peered":"2023-07-21T22:18:43.343831+0000","last_unstale":"2023-07-21T22:18:44.327761+0000","last_undegraded":"2023-07-21T22:18:44.327761+0000","last_fullsized":"2023-07-21T22:18:44.327761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:04.627872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354946+0000","last_change":"2023-07-21T22:18:44.347759+0000","last_active":"2023-07-21T22:18:44.354946+0000","last_peered":"2023-07-21T22:18:44.354946+0000","last_clean":"2023-07-21T22:18:44.354946+0000","last_became_active":"2023-07-21T22:18:44.347416+0000","last_became_peered":"2023-07-21T22:18:44.347416+0000","last_unstale":"2023-07-21T22:18:44.354946+0000","last_undegraded":"2023-07-21T22:18:44.354946+0000","last_fullsized":"2023-07-21T22:18:44.354946+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:12:36.391754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.318179+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:18:44.318179+0000","last_peered":"2023-07-21T22:18:44.318179+0000","last_clean":"2023-07-21T22:18:44.318179+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:18:44.318179+0000","last_undegraded":"2023-07-21T22:18:44.318179+0000","last_fullsized":"2023-07-21T22:18:44.318179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:06.825003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.321356+0000","last_change":"2023-07-21T22:18:43.332573+0000","last_active":"2023-07-21T22:18:44.321356+0000","last_peered":"2023-07-21T22:18:44.321356+0000","last_clean":"2023-07-21T22:18:44.321356+0000","last_became_active":"2023-07-21T22:18:43.331774+0000","last_became_peered":"2023-07-21T22:18:43.331774+0000","last_unstale":"2023-07-21T22:18:44.321356+0000","last_undegraded":"2023-07-21T22:18:44.321356+0000","last_fullsized":"2023-07-21T22:18:44.321356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:04.627872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.349586+0000","last_change":"2023-07-21T22:18:44.344092+0000","last_active":"2023-07-21T22:18:44.349586+0000","last_peered":"2023-07-21T22:18:44.349586+0000","last_clean":"2023-07-21T22:18:44.349586+0000","last_became_active":"2023-07-21T22:18:44.343819+0000","last_became_peered":"2023-07-21T22:18:44.343819+0000","last_unstale":"2023-07-21T22:18:44.349586+0000","last_undegraded":"2023-07-21T22:18:44.349586+0000","last_fullsized":"2023-07-21T22:18:44.349586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:03:22.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.324241+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:18:44.324241+0000","last_peered":"2023-07-21T22:18:44.324241+0000","last_clean":"2023-07-21T22:18:44.324241+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:18:44.324241+0000","last_undegraded":"2023-07-21T22:18:44.324241+0000","last_fullsized":"2023-07-21T22:18:44.324241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:45:35.436175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.330825+0000","last_change":"2023-07-21T22:18:43.347890+0000","last_active":"2023-07-21T22:18:44.330825+0000","last_peered":"2023-07-21T22:18:44.330825+0000","last_clean":"2023-07-21T22:18:44.330825+0000","last_became_active":"2023-07-21T22:18:43.347529+0000","last_became_peered":"2023-07-21T22:18:43.347529+0000","last_unstale":"2023-07-21T22:18:44.330825+0000","last_undegraded":"2023-07-21T22:18:44.330825+0000","last_fullsized":"2023-07-21T22:18:44.330825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:47:23.185156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.349943+0000","last_change":"2023-07-21T22:18:44.345749+0000","last_active":"2023-07-21T22:18:44.349943+0000","last_peered":"2023-07-21T22:18:44.349943+0000","last_clean":"2023-07-21T22:18:44.349943+0000","last_became_active":"2023-07-21T22:18:44.345413+0000","last_became_peered":"2023-07-21T22:18:44.345413+0000","last_unstale":"2023-07-21T22:18:44.349943+0000","last_undegraded":"2023-07-21T22:18:44.349943+0000","last_fullsized":"2023-07-21T22:18:44.349943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:42.552801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.328401+0000","last_change":"2023-07-21T22:18:43.339680+0000","last_active":"2023-07-21T22:18:44.328401+0000","last_peered":"2023-07-21T22:18:44.328401+0000","last_clean":"2023-07-21T22:18:44.328401+0000","last_became_active":"2023-07-21T22:18:43.339369+0000","last_became_peered":"2023-07-21T22:18:43.339369+0000","last_unstale":"2023-07-21T22:18:44.328401+0000","last_undegraded":"2023-07-21T22:18:44.328401+0000","last_fullsized":"2023-07-21T22:18:44.328401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:49.375113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327311+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:18:44.327311+0000","last_peered":"2023-07-21T22:18:44.327311+0000","last_clean":"2023-07-21T22:18:44.327311+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:18:44.327311+0000","last_undegraded":"2023-07-21T22:18:44.327311+0000","last_fullsized":"2023-07-21T22:18:44.327311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:21.376438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.349907+0000","last_change":"2023-07-21T22:18:44.345981+0000","last_active":"2023-07-21T22:18:44.349907+0000","last_peered":"2023-07-21T22:18:44.349907+0000","last_clean":"2023-07-21T22:18:44.349907+0000","last_became_active":"2023-07-21T22:18:44.345650+0000","last_became_peered":"2023-07-21T22:18:44.345650+0000","last_unstale":"2023-07-21T22:18:44.349907+0000","last_undegraded":"2023-07-21T22:18:44.349907+0000","last_fullsized":"2023-07-21T22:18:44.349907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:29.978550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327210+0000","last_change":"2023-07-21T22:18:43.336788+0000","last_active":"2023-07-21T22:18:44.327210+0000","last_peered":"2023-07-21T22:18:44.327210+0000","last_clean":"2023-07-21T22:18:44.327210+0000","last_became_active":"2023-07-21T22:18:43.336357+0000","last_became_peered":"2023-07-21T22:18:43.336357+0000","last_unstale":"2023-07-21T22:18:44.327210+0000","last_undegraded":"2023-07-21T22:18:44.327210+0000","last_fullsized":"2023-07-21T22:18:44.327210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:29.106844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327443+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:18:44.327443+0000","last_peered":"2023-07-21T22:18:44.327443+0000","last_clean":"2023-07-21T22:18:44.327443+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:18:44.327443+0000","last_undegraded":"2023-07-21T22:18:44.327443+0000","last_fullsized":"2023-07-21T22:18:44.327443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:50:59.658234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346914+0000","last_change":"2023-07-21T22:18:44.345851+0000","last_active":"2023-07-21T22:18:44.346914+0000","last_peered":"2023-07-21T22:18:44.346914+0000","last_clean":"2023-07-21T22:18:44.346914+0000","last_became_active":"2023-07-21T22:18:44.345553+0000","last_became_peered":"2023-07-21T22:18:44.345553+0000","last_unstale":"2023-07-21T22:18:44.346914+0000","last_undegraded":"2023-07-21T22:18:44.346914+0000","last_fullsized":"2023-07-21T22:18:44.346914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:37:46.816193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.545191+0000","last_change":"2023-07-21T22:18:43.335304+0000","last_active":"2023-07-21T22:18:44.545191+0000","last_peered":"2023-07-21T22:18:44.545191+0000","last_clean":"2023-07-21T22:18:44.545191+0000","last_became_active":"2023-07-21T22:18:43.334929+0000","last_became_peered":"2023-07-21T22:18:43.334929+0000","last_unstale":"2023-07-21T22:18:44.545191+0000","last_undegraded":"2023-07-21T22:18:44.545191+0000","last_fullsized":"2023-07-21T22:18:44.545191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:25.997043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.322299+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:18:44.322299+0000","last_peered":"2023-07-21T22:18:44.322299+0000","last_clean":"2023-07-21T22:18:44.322299+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:18:44.322299+0000","last_undegraded":"2023-07-21T22:18:44.322299+0000","last_fullsized":"2023-07-21T22:18:44.322299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:49.800708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.353585+0000","last_change":"2023-07-21T22:18:44.341231+0000","last_active":"2023-07-21T22:18:44.353585+0000","last_peered":"2023-07-21T22:18:44.353585+0000","last_clean":"2023-07-21T22:18:44.353585+0000","last_became_active":"2023-07-21T22:18:44.340874+0000","last_became_peered":"2023-07-21T22:18:44.340874+0000","last_unstale":"2023-07-21T22:18:44.353585+0000","last_undegraded":"2023-07-21T22:18:44.353585+0000","last_fullsized":"2023-07-21T22:18:44.353585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:54:18.053463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.332682+0000","last_change":"2023-07-21T22:18:43.340557+0000","last_active":"2023-07-21T22:18:44.332682+0000","last_peered":"2023-07-21T22:18:44.332682+0000","last_clean":"2023-07-21T22:18:44.332682+0000","last_became_active":"2023-07-21T22:18:43.340199+0000","last_became_peered":"2023-07-21T22:18:43.340199+0000","last_unstale":"2023-07-21T22:18:44.332682+0000","last_undegraded":"2023-07-21T22:18:44.332682+0000","last_fullsized":"2023-07-21T22:18:44.332682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:54.833351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T22:18:43.323742+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:18:43.323742+0000","last_peered":"2023-07-21T22:18:43.323742+0000","last_clean":"2023-07-21T22:18:43.323742+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:18:43.323742+0000","last_undegraded":"2023-07-21T22:18:43.323742+0000","last_fullsized":"2023-07-21T22:18:43.323742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:54:12.009749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.350300+0000","last_change":"2023-07-21T22:18:44.347206+0000","last_active":"2023-07-21T22:18:44.350300+0000","last_peered":"2023-07-21T22:18:44.350300+0000","last_clean":"2023-07-21T22:18:44.350300+0000","last_became_active":"2023-07-21T22:18:44.346914+0000","last_became_peered":"2023-07-21T22:18:44.346914+0000","last_unstale":"2023-07-21T22:18:44.350300+0000","last_undegraded":"2023-07-21T22:18:44.350300+0000","last_fullsized":"2023-07-21T22:18:44.350300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:47:23.190588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348379+0000","last_change":"2023-07-21T22:18:44.343986+0000","last_active":"2023-07-21T22:18:44.348379+0000","last_peered":"2023-07-21T22:18:44.348379+0000","last_clean":"2023-07-21T22:18:44.348379+0000","last_became_active":"2023-07-21T22:18:44.342943+0000","last_became_peered":"2023-07-21T22:18:44.342943+0000","last_unstale":"2023-07-21T22:18:44.348379+0000","last_undegraded":"2023-07-21T22:18:44.348379+0000","last_fullsized":"2023-07-21T22:18:44.348379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:25:56.912736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"25'6","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.551448+0000","last_change":"2023-07-21T22:18:43.336129+0000","last_active":"2023-07-21T22:18:44.551448+0000","last_peered":"2023-07-21T22:18:44.551448+0000","last_clean":"2023-07-21T22:18:44.551448+0000","last_became_active":"2023-07-21T22:18:43.335850+0000","last_became_peered":"2023-07-21T22:18:43.335850+0000","last_unstale":"2023-07-21T22:18:44.551448+0000","last_undegraded":"2023-07-21T22:18:44.551448+0000","last_fullsized":"2023-07-21T22:18:44.551448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:21:31.802323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.353149+0000","last_change":"2023-07-21T22:18:44.351088+0000","last_active":"2023-07-21T22:18:44.353149+0000","last_peered":"2023-07-21T22:18:44.353149+0000","last_clean":"2023-07-21T22:18:44.353149+0000","last_became_active":"2023-07-21T22:18:44.350791+0000","last_became_peered":"2023-07-21T22:18:44.350791+0000","last_unstale":"2023-07-21T22:18:44.353149+0000","last_undegraded":"2023-07-21T22:18:44.353149+0000","last_fullsized":"2023-07-21T22:18:44.353149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:27.008113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"25'3","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.544002+0000","last_change":"2023-07-21T22:18:43.340832+0000","last_active":"2023-07-21T22:18:44.544002+0000","last_peered":"2023-07-21T22:18:44.544002+0000","last_clean":"2023-07-21T22:18:44.544002+0000","last_became_active":"2023-07-21T22:18:43.340519+0000","last_became_peered":"2023-07-21T22:18:43.340519+0000","last_unstale":"2023-07-21T22:18:44.544002+0000","last_undegraded":"2023-07-21T22:18:44.544002+0000","last_fullsized":"2023-07-21T22:18:44.544002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:59:20.160352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327327+0000","last_change":"2023-07-21T22:18:43.335834+0000","last_active":"2023-07-21T22:18:44.327327+0000","last_peered":"2023-07-21T22:18:44.327327+0000","last_clean":"2023-07-21T22:18:44.327327+0000","last_became_active":"2023-07-21T22:18:43.335518+0000","last_became_peered":"2023-07-21T22:18:43.335518+0000","last_unstale":"2023-07-21T22:18:44.327327+0000","last_undegraded":"2023-07-21T22:18:44.327327+0000","last_fullsized":"2023-07-21T22:18:44.327327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:59:20.160352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354632+0000","last_change":"2023-07-21T22:18:44.349059+0000","last_active":"2023-07-21T22:18:44.354632+0000","last_peered":"2023-07-21T22:18:44.354632+0000","last_clean":"2023-07-21T22:18:44.354632+0000","last_became_active":"2023-07-21T22:18:44.348691+0000","last_became_peered":"2023-07-21T22:18:44.348691+0000","last_unstale":"2023-07-21T22:18:44.354632+0000","last_undegraded":"2023-07-21T22:18:44.354632+0000","last_fullsized":"2023-07-21T22:18:44.354632+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:12:36.391754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.331983+0000","last_change":"2023-07-21T22:18:43.341273+0000","last_active":"2023-07-21T22:18:44.331983+0000","last_peered":"2023-07-21T22:18:44.331983+0000","last_clean":"2023-07-21T22:18:44.331983+0000","last_became_active":"2023-07-21T22:18:43.340594+0000","last_became_peered":"2023-07-21T22:18:43.340594+0000","last_unstale":"2023-07-21T22:18:44.331983+0000","last_undegraded":"2023-07-21T22:18:44.331983+0000","last_fullsized":"2023-07-21T22:18:44.331983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:30:06.913006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.353533+0000","last_change":"2023-07-21T22:18:44.341063+0000","last_active":"2023-07-21T22:18:44.353533+0000","last_peered":"2023-07-21T22:18:44.353533+0000","last_clean":"2023-07-21T22:18:44.353533+0000","last_became_active":"2023-07-21T22:18:44.337396+0000","last_became_peered":"2023-07-21T22:18:44.337396+0000","last_unstale":"2023-07-21T22:18:44.353533+0000","last_undegraded":"2023-07-21T22:18:44.353533+0000","last_fullsized":"2023-07-21T22:18:44.353533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:54.484564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":24,"state":"creating+peering","last_fresh":"2023-07-21T22:18:43.319518+0000","last_change":"2023-07-21T22:18:43.319518+0000","last_active":"2023-07-21T22:18:43.300562+0000","last_peered":"2023-07-21T22:18:43.300562+0000","last_clean":"2023-07-21T22:18:43.300562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:18:43.319518+0000","last_undegraded":"2023-07-21T22:18:43.319518+0000","last_fullsized":"2023-07-21T22:18:43.319518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.329796+0000","last_change":"2023-07-21T22:18:43.341804+0000","last_active":"2023-07-21T22:18:44.329796+0000","last_peered":"2023-07-21T22:18:44.329796+0000","last_clean":"2023-07-21T22:18:44.329796+0000","last_became_active":"2023-07-21T22:18:43.341205+0000","last_became_peered":"2023-07-21T22:18:43.341205+0000","last_unstale":"2023-07-21T22:18:44.329796+0000","last_undegraded":"2023-07-21T22:18:44.329796+0000","last_fullsized":"2023-07-21T22:18:44.329796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:03:21.376838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.339571+0000","last_change":"2023-07-21T22:18:44.338013+0000","last_active":"2023-07-21T22:18:44.339571+0000","last_peered":"2023-07-21T22:18:44.339571+0000","last_clean":"2023-07-21T22:18:44.339571+0000","last_became_active":"2023-07-21T22:18:44.337701+0000","last_became_peered":"2023-07-21T22:18:44.337701+0000","last_unstale":"2023-07-21T22:18:44.339571+0000","last_undegraded":"2023-07-21T22:18:44.339571+0000","last_fullsized":"2023-07-21T22:18:44.339571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:51.413018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.321576+0000","last_change":"2023-07-21T22:18:43.337656+0000","last_active":"2023-07-21T22:18:44.321576+0000","last_peered":"2023-07-21T22:18:44.321576+0000","last_clean":"2023-07-21T22:18:44.321576+0000","last_became_active":"2023-07-21T22:18:43.337228+0000","last_became_peered":"2023-07-21T22:18:43.337228+0000","last_unstale":"2023-07-21T22:18:44.321576+0000","last_undegraded":"2023-07-21T22:18:44.321576+0000","last_fullsized":"2023-07-21T22:18:44.321576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:26:53.788877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348787+0000","last_change":"2023-07-21T22:18:44.337074+0000","last_active":"2023-07-21T22:18:44.348787+0000","last_peered":"2023-07-21T22:18:44.348787+0000","last_clean":"2023-07-21T22:18:44.348787+0000","last_became_active":"2023-07-21T22:18:44.336374+0000","last_became_peered":"2023-07-21T22:18:44.336374+0000","last_unstale":"2023-07-21T22:18:44.348787+0000","last_undegraded":"2023-07-21T22:18:44.348787+0000","last_fullsized":"2023-07-21T22:18:44.348787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:12.868716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"25'1","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.545999+0000","last_change":"2023-07-21T22:18:43.343871+0000","last_active":"2023-07-21T22:18:44.545999+0000","last_peered":"2023-07-21T22:18:44.545999+0000","last_clean":"2023-07-21T22:18:44.545999+0000","last_became_active":"2023-07-21T22:18:43.342848+0000","last_became_peered":"2023-07-21T22:18:43.342848+0000","last_unstale":"2023-07-21T22:18:44.545999+0000","last_undegraded":"2023-07-21T22:18:44.545999+0000","last_fullsized":"2023-07-21T22:18:44.545999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:19.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.342991+0000","last_change":"2023-07-21T22:18:44.338868+0000","last_active":"2023-07-21T22:18:44.342991+0000","last_peered":"2023-07-21T22:18:44.342991+0000","last_clean":"2023-07-21T22:18:44.342991+0000","last_became_active":"2023-07-21T22:18:44.337629+0000","last_became_peered":"2023-07-21T22:18:44.337629+0000","last_unstale":"2023-07-21T22:18:44.342991+0000","last_undegraded":"2023-07-21T22:18:44.342991+0000","last_fullsized":"2023-07-21T22:18:44.342991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:54:18.053463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"25'1","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.538568+0000","last_change":"2023-07-21T22:18:43.347419+0000","last_active":"2023-07-21T22:18:44.538568+0000","last_peered":"2023-07-21T22:18:44.538568+0000","last_clean":"2023-07-21T22:18:44.538568+0000","last_became_active":"2023-07-21T22:18:43.347118+0000","last_became_peered":"2023-07-21T22:18:43.347118+0000","last_unstale":"2023-07-21T22:18:44.538568+0000","last_undegraded":"2023-07-21T22:18:44.538568+0000","last_fullsized":"2023-07-21T22:18:44.538568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:03:21.376838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348407+0000","last_change":"2023-07-21T22:18:44.345638+0000","last_active":"2023-07-21T22:18:44.348407+0000","last_peered":"2023-07-21T22:18:44.348407+0000","last_clean":"2023-07-21T22:18:44.348407+0000","last_became_active":"2023-07-21T22:18:44.345310+0000","last_became_peered":"2023-07-21T22:18:44.345310+0000","last_unstale":"2023-07-21T22:18:44.348407+0000","last_undegraded":"2023-07-21T22:18:44.348407+0000","last_fullsized":"2023-07-21T22:18:44.348407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:30:26.113148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.545323+0000","last_change":"2023-07-21T22:18:43.345885+0000","last_active":"2023-07-21T22:18:44.545323+0000","last_peered":"2023-07-21T22:18:44.545323+0000","last_clean":"2023-07-21T22:18:44.545323+0000","last_became_active":"2023-07-21T22:18:43.345540+0000","last_became_peered":"2023-07-21T22:18:43.345540+0000","last_unstale":"2023-07-21T22:18:44.545323+0000","last_undegraded":"2023-07-21T22:18:44.545323+0000","last_fullsized":"2023-07-21T22:18:44.545323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:23:16.582471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348486+0000","last_change":"2023-07-21T22:18:44.346068+0000","last_active":"2023-07-21T22:18:44.348486+0000","last_peered":"2023-07-21T22:18:44.348486+0000","last_clean":"2023-07-21T22:18:44.348486+0000","last_became_active":"2023-07-21T22:18:44.345741+0000","last_became_peered":"2023-07-21T22:18:44.345741+0000","last_unstale":"2023-07-21T22:18:44.348486+0000","last_undegraded":"2023-07-21T22:18:44.348486+0000","last_fullsized":"2023-07-21T22:18:44.348486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:33:31.334871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.544215+0000","last_change":"2023-07-21T22:18:43.342235+0000","last_active":"2023-07-21T22:18:44.544215+0000","last_peered":"2023-07-21T22:18:44.544215+0000","last_clean":"2023-07-21T22:18:44.544215+0000","last_became_active":"2023-07-21T22:18:43.341945+0000","last_became_peered":"2023-07-21T22:18:43.341945+0000","last_unstale":"2023-07-21T22:18:44.544215+0000","last_undegraded":"2023-07-21T22:18:44.544215+0000","last_fullsized":"2023-07-21T22:18:44.544215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:25:33.381132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.353801+0000","last_change":"2023-07-21T22:18:44.342724+0000","last_active":"2023-07-21T22:18:44.353801+0000","last_peered":"2023-07-21T22:18:44.353801+0000","last_clean":"2023-07-21T22:18:44.353801+0000","last_became_active":"2023-07-21T22:18:44.342450+0000","last_became_peered":"2023-07-21T22:18:44.342450+0000","last_unstale":"2023-07-21T22:18:44.353801+0000","last_undegraded":"2023-07-21T22:18:44.353801+0000","last_fullsized":"2023-07-21T22:18:44.353801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:57:20.260229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.542136+0000","last_change":"2023-07-21T22:18:43.328543+0000","last_active":"2023-07-21T22:18:44.542136+0000","last_peered":"2023-07-21T22:18:44.542136+0000","last_clean":"2023-07-21T22:18:44.542136+0000","last_became_active":"2023-07-21T22:18:43.328165+0000","last_became_peered":"2023-07-21T22:18:43.328165+0000","last_unstale":"2023-07-21T22:18:44.542136+0000","last_undegraded":"2023-07-21T22:18:44.542136+0000","last_fullsized":"2023-07-21T22:18:44.542136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:54.833351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346881+0000","last_change":"2023-07-21T22:18:44.343626+0000","last_active":"2023-07-21T22:18:44.346881+0000","last_peered":"2023-07-21T22:18:44.346881+0000","last_clean":"2023-07-21T22:18:44.346881+0000","last_became_active":"2023-07-21T22:18:44.343339+0000","last_became_peered":"2023-07-21T22:18:44.343339+0000","last_unstale":"2023-07-21T22:18:44.346881+0000","last_undegraded":"2023-07-21T22:18:44.346881+0000","last_fullsized":"2023-07-21T22:18:44.346881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:36:40.719765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"25'4","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.542522+0000","last_change":"2023-07-21T22:18:43.341441+0000","last_active":"2023-07-21T22:18:44.542522+0000","last_peered":"2023-07-21T22:18:44.542522+0000","last_clean":"2023-07-21T22:18:44.542522+0000","last_became_active":"2023-07-21T22:18:43.340962+0000","last_became_peered":"2023-07-21T22:18:43.340962+0000","last_unstale":"2023-07-21T22:18:44.542522+0000","last_undegraded":"2023-07-21T22:18:44.542522+0000","last_fullsized":"2023-07-21T22:18:44.542522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:28.967479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":676715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":86347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":86347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":93475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":93475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":93475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":856064,"data_stored":684425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":86347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.55}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7470000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1829999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:18:48.689 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:18:48.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.820+0000 7f9a55493640 1 Processor -- start 2023-07-21T22:18:48.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.820+0000 7f9a55493640 1 -- start start 2023-07-21T22:18:48.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.824+0000 7f9a55493640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9a50070b70 0x7f9a50070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:48.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.824+0000 7f9a55493640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9a5006b1e0 0x7f9a500c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:48.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.824+0000 7f9a55493640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a500cac70 con 0x7f9a500c21f0 2023-07-21T22:18:48.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.824+0000 7f9a55493640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a50071480 con 0x7f9a5006b1e0 2023-07-21T22:18:48.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.824+0000 7f9a55493640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a500ca060 con 0x7f9a50070b70 2023-07-21T22:18:48.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.824+0000 7f9a47fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9a5006b1e0 0x7f9a500c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:48.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.824+0000 7f9a47fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9a5006b1e0 0x7f9a500c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46654/0 (socket says 172.21.15.6:46654) 2023-07-21T22:18:48.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.824+0000 7f9a47fff640 1 -- 172.21.15.6:0/1598492134 learned_addr learned my addr 172.21.15.6:0/1598492134 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:48.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.824+0000 7f9a4effd640 1 --2- 172.21.15.6:0/1598492134 >> v2:172.21.15.161:3300/0 conn(0x7f9a50070b70 0x7f9a50070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:48.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.824+0000 7f9a47fff640 1 -- 172.21.15.6:0/1598492134 >> v2:172.21.15.161:3300/0 conn(0x7f9a50070b70 msgr2=0x7f9a50070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:48.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.824+0000 7f9a47fff640 1 --2- 172.21.15.6:0/1598492134 >> v2:172.21.15.161:3300/0 conn(0x7f9a50070b70 0x7f9a50070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.824+0000 7f9a47fff640 1 -- 172.21.15.6:0/1598492134 >> v1:172.21.15.161:6789/0 conn(0x7f9a500c21f0 legacy=0x7f9a500cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:48.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.824+0000 7f9a47fff640 1 -- 172.21.15.6:0/1598492134 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a500ca340 con 0x7f9a5006b1e0 2023-07-21T22:18:48.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.828+0000 7f9a47fff640 1 --2- 172.21.15.6:0/1598492134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a5006b1e0 0x7f9a500c1cb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a5006f1f0 tx=0x7f9a3801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296ddb20b0e3a6b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:48.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.828+0000 7f9a4e7fc640 1 -- 172.21.15.6:0/1598492134 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a380aa430 con 0x7f9a5006b1e0 2023-07-21T22:18:48.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.828+0000 7f9a4e7fc640 1 -- 172.21.15.6:0/1598492134 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a380aa590 con 0x7f9a5006b1e0 2023-07-21T22:18:48.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.828+0000 7f9a4e7fc640 1 -- 172.21.15.6:0/1598492134 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a380aa920 con 0x7f9a5006b1e0 2023-07-21T22:18:48.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.828+0000 7f9a55493640 1 -- 172.21.15.6:0/1598492134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a5006b1e0 msgr2=0x7f9a500c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:48.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.828+0000 7f9a55493640 1 --2- 172.21.15.6:0/1598492134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a5006b1e0 0x7f9a500c1cb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9a5006f1f0 tx=0x7f9a3801c4d0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.828+0000 7f9a55493640 1 -- 172.21.15.6:0/1598492134 shutdown_connections 2023-07-21T22:18:48.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.828+0000 7f9a55493640 1 --2- 172.21.15.6:0/1598492134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a5006b1e0 0x7f9a500c1cb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.828+0000 7f9a55493640 1 --2- 172.21.15.6:0/1598492134 >> v2:172.21.15.161:3300/0 conn(0x7f9a50070b70 0x7f9a50070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.828+0000 7f9a55493640 1 -- 172.21.15.6:0/1598492134 >> 172.21.15.6:0/1598492134 conn(0x7f9a500afcf0 msgr2=0x7f9a500b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.828+0000 7f9a55493640 1 -- 172.21.15.6:0/1598492134 shutdown_connections 2023-07-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.828+0000 7f9a55493640 1 -- 172.21.15.6:0/1598492134 wait complete. 2023-07-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.828+0000 7f9a55493640 1 Processor -- start 2023-07-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.828+0000 7f9a55493640 1 -- start start 2023-07-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a55493640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a5006b1e0 0x7f9a500af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a55493640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a50070b70 0x7f9a500c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:48.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a55493640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a500c21f0 0x7f9a501524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a55493640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a50153ac0 con 0x7f9a50070b70 2023-07-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a55493640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a50153700 con 0x7f9a5006b1e0 2023-07-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a55493640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a500b3900 con 0x7f9a500c21f0 2023-07-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a47fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a50070b70 0x7f9a500c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a47fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a50070b70 0x7f9a500c5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46660/0 (socket says 172.21.15.6:46660) 2023-07-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a47fff640 1 -- 172.21.15.6:0/1439845401 learned_addr learned my addr 172.21.15.6:0/1439845401 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:48.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a4effd640 1 --2- 172.21.15.6:0/1439845401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a5006b1e0 0x7f9a500af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a4f7fe640 1 --2- 172.21.15.6:0/1439845401 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a500c21f0 0x7f9a501524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a47fff640 1 -- 172.21.15.6:0/1439845401 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a500c21f0 msgr2=0x7f9a501524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a47fff640 1 --2- 172.21.15.6:0/1439845401 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a500c21f0 0x7f9a501524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a47fff640 1 -- 172.21.15.6:0/1439845401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a5006b1e0 msgr2=0x7f9a500af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:48.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a47fff640 1 --2- 172.21.15.6:0/1439845401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a5006b1e0 0x7f9a500af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a47fff640 1 -- 172.21.15.6:0/1439845401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a380094d0 con 0x7f9a50070b70 2023-07-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a4effd640 1 --2- 172.21.15.6:0/1439845401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a5006b1e0 0x7f9a500af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a47fff640 1 --2- 172.21.15.6:0/1439845401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a50070b70 0x7f9a500c5b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9a380190e0 tx=0x7f9a3801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a477fe640 1 -- 172.21.15.6:0/1439845401 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a380aa430 con 0x7f9a50070b70 2023-07-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a477fe640 1 -- 172.21.15.6:0/1439845401 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a380b3820 con 0x7f9a50070b70 2023-07-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a477fe640 1 -- 172.21.15.6:0/1439845401 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a380b3bd0 con 0x7f9a50070b70 2023-07-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a55493640 1 -- 172.21.15.6:0/1439845401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a500b3be0 con 0x7f9a50070b70 2023-07-21T22:18:48.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a55493640 1 -- 172.21.15.6:0/1439845401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a500af9d0 con 0x7f9a50070b70 2023-07-21T22:18:48.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a55493640 1 -- 172.21.15.6:0/1439845401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a50153c00 con 0x7f9a50070b70 2023-07-21T22:18:48.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.832+0000 7f9a477fe640 1 -- 172.21.15.6:0/1439845401 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9a380b3d30 con 0x7f9a50070b70 2023-07-21T22:18:48.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.836+0000 7f9a477fe640 1 --2- 172.21.15.6:0/1439845401 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a30066280 0x7f9a30068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:48.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.836+0000 7f9a477fe640 1 -- 172.21.15.6:0/1439845401 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a3811de60 con 0x7f9a50070b70 2023-07-21T22:18:48.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.836+0000 7f9a4effd640 1 --2- 172.21.15.6:0/1439845401 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a30066280 0x7f9a30068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:48.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.836+0000 7f9a4effd640 1 --2- 172.21.15.6:0/1439845401 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a30066280 0x7f9a30068730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009bb0 tx=0x7f9a40008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:48.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.840+0000 7f9a477fe640 1 -- 172.21.15.6:0/1439845401 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a50153c00 con 0x7f9a50070b70 2023-07-21T22:18:49.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:48.992+0000 7f9a55493640 1 -- 172.21.15.6:0/1439845401 --> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a500c9cf0 con 0x7f9a30066280 2023-07-21T22:18:49.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.000+0000 7f9a477fe640 1 -- 172.21.15.6:0/1439845401 <== mgr.4103 v2:172.21.15.161:6832/3471136886 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286231 (secure 0 0 0) 0x7f9a40011a70 con 0x7f9a30066280 2023-07-21T22:18:49.048 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:18:49.050 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:18:49.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.004+0000 7f9a55493640 1 -- 172.21.15.6:0/1439845401 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a30066280 msgr2=0x7f9a30068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:49.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.004+0000 7f9a55493640 1 --2- 172.21.15.6:0/1439845401 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a30066280 0x7f9a30068730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9a40009bb0 tx=0x7f9a40008040 comp rx=0 tx=0).stop 2023-07-21T22:18:49.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.004+0000 7f9a55493640 1 -- 172.21.15.6:0/1439845401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a50070b70 msgr2=0x7f9a500c5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:49.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.004+0000 7f9a55493640 1 --2- 172.21.15.6:0/1439845401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a50070b70 0x7f9a500c5b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9a380190e0 tx=0x7f9a3801ad10 comp rx=0 tx=0).stop 2023-07-21T22:18:49.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.004+0000 7f9a55493640 1 -- 172.21.15.6:0/1439845401 shutdown_connections 2023-07-21T22:18:49.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.004+0000 7f9a55493640 1 --2- 172.21.15.6:0/1439845401 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a500c21f0 0x7f9a501524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.004+0000 7f9a55493640 1 --2- 172.21.15.6:0/1439845401 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a30066280 0x7f9a30068730 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.004+0000 7f9a55493640 1 --2- 172.21.15.6:0/1439845401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a50070b70 0x7f9a500c5b10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.004+0000 7f9a55493640 1 --2- 172.21.15.6:0/1439845401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a5006b1e0 0x7f9a500af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.004+0000 7f9a55493640 1 -- 172.21.15.6:0/1439845401 >> 172.21.15.6:0/1439845401 conn(0x7f9a500afcf0 msgr2=0x7f9a500c2690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:49.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.004+0000 7f9a55493640 1 -- 172.21.15.6:0/1439845401 shutdown_connections 2023-07-21T22:18:49.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.004+0000 7f9a55493640 1 -- 172.21.15.6:0/1439845401 wait complete. 2023-07-21T22:18:49.069 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-07-21T22:18:48.768936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218748,"kb_used_data":3132,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755972,"statfs":{"total":773094113280,"available":772870115328,"internally_reserved":0,"allocated":3207168,"data_stored":1900606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001298"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.341718+0000","last_change":"2023-07-21T22:18:44.336499+0000","last_active":"2023-07-21T22:18:44.341718+0000","last_peered":"2023-07-21T22:18:44.341718+0000","last_clean":"2023-07-21T22:18:44.341718+0000","last_became_active":"2023-07-21T22:18:44.336063+0000","last_became_peered":"2023-07-21T22:18:44.336063+0000","last_unstale":"2023-07-21T22:18:44.341718+0000","last_undegraded":"2023-07-21T22:18:44.341718+0000","last_fullsized":"2023-07-21T22:18:44.341718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:24:06.166416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346444+0000","last_change":"2023-07-21T22:18:44.341470+0000","last_active":"2023-07-21T22:18:44.346444+0000","last_peered":"2023-07-21T22:18:44.346444+0000","last_clean":"2023-07-21T22:18:44.346444+0000","last_became_active":"2023-07-21T22:18:44.341148+0000","last_became_peered":"2023-07-21T22:18:44.341148+0000","last_unstale":"2023-07-21T22:18:44.346444+0000","last_undegraded":"2023-07-21T22:18:44.346444+0000","last_fullsized":"2023-07-21T22:18:44.346444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:20.530615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.338400+0000","last_change":"2023-07-21T22:18:44.336245+0000","last_active":"2023-07-21T22:18:44.338400+0000","last_peered":"2023-07-21T22:18:44.338400+0000","last_clean":"2023-07-21T22:18:44.338400+0000","last_became_active":"2023-07-21T22:18:44.335682+0000","last_became_peered":"2023-07-21T22:18:44.335682+0000","last_unstale":"2023-07-21T22:18:44.338400+0000","last_undegraded":"2023-07-21T22:18:44.338400+0000","last_fullsized":"2023-07-21T22:18:44.338400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:16:43.932507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":24,"state":"creating+peering","last_fresh":"2023-07-21T22:18:43.319825+0000","last_change":"2023-07-21T22:18:43.319825+0000","last_active":"2023-07-21T22:18:43.300562+0000","last_peered":"2023-07-21T22:18:43.300562+0000","last_clean":"2023-07-21T22:18:43.300562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:18:43.319825+0000","last_undegraded":"2023-07-21T22:18:43.319825+0000","last_fullsized":"2023-07-21T22:18:43.319825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346108+0000","last_change":"2023-07-21T22:18:44.344066+0000","last_active":"2023-07-21T22:18:44.346108+0000","last_peered":"2023-07-21T22:18:44.346108+0000","last_clean":"2023-07-21T22:18:44.346108+0000","last_became_active":"2023-07-21T22:18:44.343765+0000","last_became_peered":"2023-07-21T22:18:44.343765+0000","last_unstale":"2023-07-21T22:18:44.346108+0000","last_undegraded":"2023-07-21T22:18:44.346108+0000","last_fullsized":"2023-07-21T22:18:44.346108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:54.484564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.338362+0000","last_change":"2023-07-21T22:18:44.336096+0000","last_active":"2023-07-21T22:18:44.338362+0000","last_peered":"2023-07-21T22:18:44.338362+0000","last_clean":"2023-07-21T22:18:44.338362+0000","last_became_active":"2023-07-21T22:18:44.335625+0000","last_became_peered":"2023-07-21T22:18:44.335625+0000","last_unstale":"2023-07-21T22:18:44.338362+0000","last_undegraded":"2023-07-21T22:18:44.338362+0000","last_fullsized":"2023-07-21T22:18:44.338362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:23:17.593542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.341432+0000","last_change":"2023-07-21T22:18:44.338953+0000","last_active":"2023-07-21T22:18:44.341432+0000","last_peered":"2023-07-21T22:18:44.341432+0000","last_clean":"2023-07-21T22:18:44.341432+0000","last_became_active":"2023-07-21T22:18:44.338582+0000","last_became_peered":"2023-07-21T22:18:44.338582+0000","last_unstale":"2023-07-21T22:18:44.341432+0000","last_undegraded":"2023-07-21T22:18:44.341432+0000","last_fullsized":"2023-07-21T22:18:44.341432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:10.090300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346408+0000","last_change":"2023-07-21T22:18:44.337662+0000","last_active":"2023-07-21T22:18:44.346408+0000","last_peered":"2023-07-21T22:18:44.346408+0000","last_clean":"2023-07-21T22:18:44.346408+0000","last_became_active":"2023-07-21T22:18:44.337217+0000","last_became_peered":"2023-07-21T22:18:44.337217+0000","last_unstale":"2023-07-21T22:18:44.346408+0000","last_undegraded":"2023-07-21T22:18:44.346408+0000","last_fullsized":"2023-07-21T22:18:44.346408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:06:33.367363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346142+0000","last_change":"2023-07-21T22:18:44.344268+0000","last_active":"2023-07-21T22:18:44.346142+0000","last_peered":"2023-07-21T22:18:44.346142+0000","last_clean":"2023-07-21T22:18:44.346142+0000","last_became_active":"2023-07-21T22:18:44.343880+0000","last_became_peered":"2023-07-21T22:18:44.343880+0000","last_unstale":"2023-07-21T22:18:44.346142+0000","last_undegraded":"2023-07-21T22:18:44.346142+0000","last_fullsized":"2023-07-21T22:18:44.346142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:45.242179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346345+0000","last_change":"2023-07-21T22:18:44.336379+0000","last_active":"2023-07-21T22:18:44.346345+0000","last_peered":"2023-07-21T22:18:44.346345+0000","last_clean":"2023-07-21T22:18:44.346345+0000","last_became_active":"2023-07-21T22:18:44.335846+0000","last_became_peered":"2023-07-21T22:18:44.335846+0000","last_unstale":"2023-07-21T22:18:44.346345+0000","last_undegraded":"2023-07-21T22:18:44.346345+0000","last_fullsized":"2023-07-21T22:18:44.346345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:44.120565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354172+0000","last_change":"2023-07-21T22:18:44.352832+0000","last_active":"2023-07-21T22:18:44.354172+0000","last_peered":"2023-07-21T22:18:44.354172+0000","last_clean":"2023-07-21T22:18:44.354172+0000","last_became_active":"2023-07-21T22:18:44.352465+0000","last_became_peered":"2023-07-21T22:18:44.352465+0000","last_unstale":"2023-07-21T22:18:44.354172+0000","last_undegraded":"2023-07-21T22:18:44.354172+0000","last_fullsized":"2023-07-21T22:18:44.354172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:48:56.083184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.342895+0000","last_change":"2023-07-21T22:18:44.337129+0000","last_active":"2023-07-21T22:18:44.342895+0000","last_peered":"2023-07-21T22:18:44.342895+0000","last_clean":"2023-07-21T22:18:44.342895+0000","last_became_active":"2023-07-21T22:18:44.336170+0000","last_became_peered":"2023-07-21T22:18:44.336170+0000","last_unstale":"2023-07-21T22:18:44.342895+0000","last_undegraded":"2023-07-21T22:18:44.342895+0000","last_fullsized":"2023-07-21T22:18:44.342895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:49.771671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.338356+0000","last_change":"2023-07-21T22:18:44.335382+0000","last_active":"2023-07-21T22:18:44.338356+0000","last_peered":"2023-07-21T22:18:44.338356+0000","last_clean":"2023-07-21T22:18:44.338356+0000","last_became_active":"2023-07-21T22:18:44.334933+0000","last_became_peered":"2023-07-21T22:18:44.334933+0000","last_unstale":"2023-07-21T22:18:44.338356+0000","last_undegraded":"2023-07-21T22:18:44.338356+0000","last_fullsized":"2023-07-21T22:18:44.338356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:30.400997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346250+0000","last_change":"2023-07-21T22:18:44.333998+0000","last_active":"2023-07-21T22:18:44.346250+0000","last_peered":"2023-07-21T22:18:44.346250+0000","last_clean":"2023-07-21T22:18:44.346250+0000","last_became_active":"2023-07-21T22:18:44.333720+0000","last_became_peered":"2023-07-21T22:18:44.333720+0000","last_unstale":"2023-07-21T22:18:44.346250+0000","last_undegraded":"2023-07-21T22:18:44.346250+0000","last_fullsized":"2023-07-21T22:18:44.346250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:47:24.196227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.344314+0000","last_change":"2023-07-21T22:18:44.341061+0000","last_active":"2023-07-21T22:18:44.344314+0000","last_peered":"2023-07-21T22:18:44.344314+0000","last_clean":"2023-07-21T22:18:44.344314+0000","last_became_active":"2023-07-21T22:18:44.340711+0000","last_became_peered":"2023-07-21T22:18:44.340711+0000","last_unstale":"2023-07-21T22:18:44.344314+0000","last_undegraded":"2023-07-21T22:18:44.344314+0000","last_fullsized":"2023-07-21T22:18:44.344314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:43.536674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.337952+0000","last_change":"2023-07-21T22:18:44.335984+0000","last_active":"2023-07-21T22:18:44.337952+0000","last_peered":"2023-07-21T22:18:44.337952+0000","last_clean":"2023-07-21T22:18:44.337952+0000","last_became_active":"2023-07-21T22:18:44.335481+0000","last_became_peered":"2023-07-21T22:18:44.335481+0000","last_unstale":"2023-07-21T22:18:44.337952+0000","last_undegraded":"2023-07-21T22:18:44.337952+0000","last_fullsized":"2023-07-21T22:18:44.337952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:55.939872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.335467+0000","last_change":"2023-07-21T22:18:44.333526+0000","last_active":"2023-07-21T22:18:44.335467+0000","last_peered":"2023-07-21T22:18:44.335467+0000","last_clean":"2023-07-21T22:18:44.335467+0000","last_became_active":"2023-07-21T22:18:44.333139+0000","last_became_peered":"2023-07-21T22:18:44.333139+0000","last_unstale":"2023-07-21T22:18:44.335467+0000","last_undegraded":"2023-07-21T22:18:44.335467+0000","last_fullsized":"2023-07-21T22:18:44.335467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:12.868716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.342623+0000","last_change":"2023-07-21T22:18:44.339606+0000","last_active":"2023-07-21T22:18:44.342623+0000","last_peered":"2023-07-21T22:18:44.342623+0000","last_clean":"2023-07-21T22:18:44.342623+0000","last_became_active":"2023-07-21T22:18:44.339282+0000","last_became_peered":"2023-07-21T22:18:44.339282+0000","last_unstale":"2023-07-21T22:18:44.342623+0000","last_undegraded":"2023-07-21T22:18:44.342623+0000","last_fullsized":"2023-07-21T22:18:44.342623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:56:31.905250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327372+0000","last_change":"2023-07-21T22:18:44.325126+0000","last_active":"2023-07-21T22:18:44.327372+0000","last_peered":"2023-07-21T22:18:44.327372+0000","last_clean":"2023-07-21T22:18:44.327372+0000","last_became_active":"2023-07-21T22:18:44.324795+0000","last_became_peered":"2023-07-21T22:18:44.324795+0000","last_unstale":"2023-07-21T22:18:44.327372+0000","last_undegraded":"2023-07-21T22:18:44.327372+0000","last_fullsized":"2023-07-21T22:18:44.327372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:54.484564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.342627+0000","last_change":"2023-07-21T22:18:44.338316+0000","last_active":"2023-07-21T22:18:44.342627+0000","last_peered":"2023-07-21T22:18:44.342627+0000","last_clean":"2023-07-21T22:18:44.342627+0000","last_became_active":"2023-07-21T22:18:44.337895+0000","last_became_peered":"2023-07-21T22:18:44.337895+0000","last_unstale":"2023-07-21T22:18:44.342627+0000","last_undegraded":"2023-07-21T22:18:44.342627+0000","last_fullsized":"2023-07-21T22:18:44.342627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:07:40.534702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.356332+0000","last_change":"2023-07-21T22:18:44.355582+0000","last_active":"2023-07-21T22:18:44.356332+0000","last_peered":"2023-07-21T22:18:44.356332+0000","last_clean":"2023-07-21T22:18:44.356332+0000","last_became_active":"2023-07-21T22:18:44.355317+0000","last_became_peered":"2023-07-21T22:18:44.355317+0000","last_unstale":"2023-07-21T22:18:44.356332+0000","last_undegraded":"2023-07-21T22:18:44.356332+0000","last_fullsized":"2023-07-21T22:18:44.356332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:51.653402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354983+0000","last_change":"2023-07-21T22:18:44.348333+0000","last_active":"2023-07-21T22:18:44.354983+0000","last_peered":"2023-07-21T22:18:44.354983+0000","last_clean":"2023-07-21T22:18:44.354983+0000","last_became_active":"2023-07-21T22:18:44.347982+0000","last_became_peered":"2023-07-21T22:18:44.347982+0000","last_unstale":"2023-07-21T22:18:44.354983+0000","last_undegraded":"2023-07-21T22:18:44.354983+0000","last_fullsized":"2023-07-21T22:18:44.354983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:54:18.053463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.338742+0000","last_change":"2023-07-21T22:18:44.333429+0000","last_active":"2023-07-21T22:18:44.338742+0000","last_peered":"2023-07-21T22:18:44.338742+0000","last_clean":"2023-07-21T22:18:44.338742+0000","last_became_active":"2023-07-21T22:18:44.333121+0000","last_became_peered":"2023-07-21T22:18:44.333121+0000","last_unstale":"2023-07-21T22:18:44.338742+0000","last_undegraded":"2023-07-21T22:18:44.338742+0000","last_fullsized":"2023-07-21T22:18:44.338742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:05.638943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.349028+0000","last_change":"2023-07-21T22:18:44.346478+0000","last_active":"2023-07-21T22:18:44.349028+0000","last_peered":"2023-07-21T22:18:44.349028+0000","last_clean":"2023-07-21T22:18:44.349028+0000","last_became_active":"2023-07-21T22:18:44.346160+0000","last_became_peered":"2023-07-21T22:18:44.346160+0000","last_unstale":"2023-07-21T22:18:44.349028+0000","last_undegraded":"2023-07-21T22:18:44.349028+0000","last_fullsized":"2023-07-21T22:18:44.349028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:25:34.392203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.350826+0000","last_change":"2023-07-21T22:18:44.348596+0000","last_active":"2023-07-21T22:18:44.350826+0000","last_peered":"2023-07-21T22:18:44.350826+0000","last_clean":"2023-07-21T22:18:44.350826+0000","last_became_active":"2023-07-21T22:18:44.348325+0000","last_became_peered":"2023-07-21T22:18:44.348325+0000","last_unstale":"2023-07-21T22:18:44.350826+0000","last_undegraded":"2023-07-21T22:18:44.350826+0000","last_fullsized":"2023-07-21T22:18:44.350826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:38:06.965559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.339342+0000","last_change":"2023-07-21T22:18:44.335321+0000","last_active":"2023-07-21T22:18:44.339342+0000","last_peered":"2023-07-21T22:18:44.339342+0000","last_clean":"2023-07-21T22:18:44.339342+0000","last_became_active":"2023-07-21T22:18:44.334970+0000","last_became_peered":"2023-07-21T22:18:44.334970+0000","last_unstale":"2023-07-21T22:18:44.339342+0000","last_undegraded":"2023-07-21T22:18:44.339342+0000","last_fullsized":"2023-07-21T22:18:44.339342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:45.242179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.347194+0000","last_change":"2023-07-21T22:18:44.345317+0000","last_active":"2023-07-21T22:18:44.347194+0000","last_peered":"2023-07-21T22:18:44.347194+0000","last_clean":"2023-07-21T22:18:44.347194+0000","last_became_active":"2023-07-21T22:18:44.344901+0000","last_became_peered":"2023-07-21T22:18:44.344901+0000","last_unstale":"2023-07-21T22:18:44.347194+0000","last_undegraded":"2023-07-21T22:18:44.347194+0000","last_fullsized":"2023-07-21T22:18:44.347194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:05.701948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.340949+0000","last_change":"2023-07-21T22:18:44.336787+0000","last_active":"2023-07-21T22:18:44.340949+0000","last_peered":"2023-07-21T22:18:44.340949+0000","last_clean":"2023-07-21T22:18:44.340949+0000","last_became_active":"2023-07-21T22:18:44.336502+0000","last_became_peered":"2023-07-21T22:18:44.336502+0000","last_unstale":"2023-07-21T22:18:44.340949+0000","last_undegraded":"2023-07-21T22:18:44.340949+0000","last_fullsized":"2023-07-21T22:18:44.340949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:51.413018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354531+0000","last_change":"2023-07-21T22:18:44.348671+0000","last_active":"2023-07-21T22:18:44.354531+0000","last_peered":"2023-07-21T22:18:44.354531+0000","last_clean":"2023-07-21T22:18:44.354531+0000","last_became_active":"2023-07-21T22:18:44.348361+0000","last_became_peered":"2023-07-21T22:18:44.348361+0000","last_unstale":"2023-07-21T22:18:44.354531+0000","last_undegraded":"2023-07-21T22:18:44.354531+0000","last_fullsized":"2023-07-21T22:18:44.354531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:37:46.816193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.350895+0000","last_change":"2023-07-21T22:18:44.348495+0000","last_active":"2023-07-21T22:18:44.350895+0000","last_peered":"2023-07-21T22:18:44.350895+0000","last_clean":"2023-07-21T22:18:44.350895+0000","last_became_active":"2023-07-21T22:18:44.348107+0000","last_became_peered":"2023-07-21T22:18:44.348107+0000","last_unstale":"2023-07-21T22:18:44.350895+0000","last_undegraded":"2023-07-21T22:18:44.350895+0000","last_fullsized":"2023-07-21T22:18:44.350895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:45:41.479888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.353726+0000","last_change":"2023-07-21T22:18:44.342060+0000","last_active":"2023-07-21T22:18:44.353726+0000","last_peered":"2023-07-21T22:18:44.353726+0000","last_clean":"2023-07-21T22:18:44.353726+0000","last_became_active":"2023-07-21T22:18:44.341767+0000","last_became_peered":"2023-07-21T22:18:44.341767+0000","last_unstale":"2023-07-21T22:18:44.353726+0000","last_undegraded":"2023-07-21T22:18:44.353726+0000","last_fullsized":"2023-07-21T22:18:44.353726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:51.413018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":24,"state":"creating+peering","last_fresh":"2023-07-21T22:18:43.318779+0000","last_change":"2023-07-21T22:18:43.318779+0000","last_active":"2023-07-21T22:18:43.300562+0000","last_peered":"2023-07-21T22:18:43.300562+0000","last_clean":"2023-07-21T22:18:43.300562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:18:43.318779+0000","last_undegraded":"2023-07-21T22:18:43.318779+0000","last_fullsized":"2023-07-21T22:18:43.318779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348765+0000","last_change":"2023-07-21T22:18:44.338017+0000","last_active":"2023-07-21T22:18:44.348765+0000","last_peered":"2023-07-21T22:18:44.348765+0000","last_clean":"2023-07-21T22:18:44.348765+0000","last_became_active":"2023-07-21T22:18:44.337215+0000","last_became_peered":"2023-07-21T22:18:44.337215+0000","last_unstale":"2023-07-21T22:18:44.348765+0000","last_undegraded":"2023-07-21T22:18:44.348765+0000","last_fullsized":"2023-07-21T22:18:44.348765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:13:17.888290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.544481+0000","last_change":"2023-07-21T22:18:43.345411+0000","last_active":"2023-07-21T22:18:44.544481+0000","last_peered":"2023-07-21T22:18:44.544481+0000","last_clean":"2023-07-21T22:18:44.544481+0000","last_became_active":"2023-07-21T22:18:43.345095+0000","last_became_peered":"2023-07-21T22:18:43.345095+0000","last_unstale":"2023-07-21T22:18:44.544481+0000","last_undegraded":"2023-07-21T22:18:44.544481+0000","last_fullsized":"2023-07-21T22:18:44.544481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:40:45.106399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.347173+0000","last_change":"2023-07-21T22:18:44.345111+0000","last_active":"2023-07-21T22:18:44.347173+0000","last_peered":"2023-07-21T22:18:44.347173+0000","last_clean":"2023-07-21T22:18:44.347173+0000","last_became_active":"2023-07-21T22:18:44.344325+0000","last_became_peered":"2023-07-21T22:18:44.344325+0000","last_unstale":"2023-07-21T22:18:44.347173+0000","last_undegraded":"2023-07-21T22:18:44.347173+0000","last_fullsized":"2023-07-21T22:18:44.347173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:26.300457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327919+0000","last_change":"2023-07-21T22:18:43.340538+0000","last_active":"2023-07-21T22:18:44.327919+0000","last_peered":"2023-07-21T22:18:44.327919+0000","last_clean":"2023-07-21T22:18:44.327919+0000","last_became_active":"2023-07-21T22:18:43.340172+0000","last_became_peered":"2023-07-21T22:18:43.340172+0000","last_unstale":"2023-07-21T22:18:44.327919+0000","last_undegraded":"2023-07-21T22:18:44.327919+0000","last_fullsized":"2023-07-21T22:18:44.327919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:26:53.788877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.343008+0000","last_change":"2023-07-21T22:18:44.342020+0000","last_active":"2023-07-21T22:18:44.343008+0000","last_peered":"2023-07-21T22:18:44.343008+0000","last_clean":"2023-07-21T22:18:44.343008+0000","last_became_active":"2023-07-21T22:18:44.341724+0000","last_became_peered":"2023-07-21T22:18:44.341724+0000","last_unstale":"2023-07-21T22:18:44.343008+0000","last_undegraded":"2023-07-21T22:18:44.343008+0000","last_fullsized":"2023-07-21T22:18:44.343008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:57:20.260229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.331377+0000","last_change":"2023-07-21T22:18:43.337771+0000","last_active":"2023-07-21T22:18:44.331377+0000","last_peered":"2023-07-21T22:18:44.331377+0000","last_clean":"2023-07-21T22:18:44.331377+0000","last_became_active":"2023-07-21T22:18:43.337480+0000","last_became_peered":"2023-07-21T22:18:43.337480+0000","last_unstale":"2023-07-21T22:18:44.331377+0000","last_undegraded":"2023-07-21T22:18:44.331377+0000","last_fullsized":"2023-07-21T22:18:44.331377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:44:35.365564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.355676+0000","last_change":"2023-07-21T22:18:44.349625+0000","last_active":"2023-07-21T22:18:44.355676+0000","last_peered":"2023-07-21T22:18:44.355676+0000","last_clean":"2023-07-21T22:18:44.355676+0000","last_became_active":"2023-07-21T22:18:44.349046+0000","last_became_peered":"2023-07-21T22:18:44.349046+0000","last_unstale":"2023-07-21T22:18:44.355676+0000","last_undegraded":"2023-07-21T22:18:44.355676+0000","last_fullsized":"2023-07-21T22:18:44.355676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:26:54.799948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T22:18:43.349137+0000","last_change":"2023-07-21T22:18:43.344968+0000","last_active":"2023-07-21T22:18:43.349137+0000","last_peered":"2023-07-21T22:18:43.349137+0000","last_clean":"2023-07-21T22:18:43.349137+0000","last_became_active":"2023-07-21T22:18:43.344570+0000","last_became_peered":"2023-07-21T22:18:43.344570+0000","last_unstale":"2023-07-21T22:18:43.349137+0000","last_undegraded":"2023-07-21T22:18:43.349137+0000","last_fullsized":"2023-07-21T22:18:43.349137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:48.760601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.544297+0000","last_change":"2023-07-21T22:18:43.348215+0000","last_active":"2023-07-21T22:18:44.544297+0000","last_peered":"2023-07-21T22:18:44.544297+0000","last_clean":"2023-07-21T22:18:44.544297+0000","last_became_active":"2023-07-21T22:18:43.347858+0000","last_became_peered":"2023-07-21T22:18:43.347858+0000","last_unstale":"2023-07-21T22:18:44.544297+0000","last_undegraded":"2023-07-21T22:18:44.544297+0000","last_fullsized":"2023-07-21T22:18:44.544297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:25.289386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346430+0000","last_change":"2023-07-21T22:18:44.341650+0000","last_active":"2023-07-21T22:18:44.346430+0000","last_peered":"2023-07-21T22:18:44.346430+0000","last_clean":"2023-07-21T22:18:44.346430+0000","last_became_active":"2023-07-21T22:18:44.341352+0000","last_became_peered":"2023-07-21T22:18:44.341352+0000","last_unstale":"2023-07-21T22:18:44.346430+0000","last_undegraded":"2023-07-21T22:18:44.346430+0000","last_fullsized":"2023-07-21T22:18:44.346430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:16:43.932507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.543980+0000","last_change":"2023-07-21T22:18:43.348256+0000","last_active":"2023-07-21T22:18:44.543980+0000","last_peered":"2023-07-21T22:18:44.543980+0000","last_clean":"2023-07-21T22:18:44.543980+0000","last_became_active":"2023-07-21T22:18:43.347754+0000","last_became_peered":"2023-07-21T22:18:43.347754+0000","last_unstale":"2023-07-21T22:18:44.543980+0000","last_undegraded":"2023-07-21T22:18:44.543980+0000","last_fullsized":"2023-07-21T22:18:44.543980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:29:22.726274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354180+0000","last_change":"2023-07-21T22:18:44.353012+0000","last_active":"2023-07-21T22:18:44.354180+0000","last_peered":"2023-07-21T22:18:44.354180+0000","last_clean":"2023-07-21T22:18:44.354180+0000","last_became_active":"2023-07-21T22:18:44.352586+0000","last_became_peered":"2023-07-21T22:18:44.352586+0000","last_unstale":"2023-07-21T22:18:44.354180+0000","last_undegraded":"2023-07-21T22:18:44.354180+0000","last_fullsized":"2023-07-21T22:18:44.354180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:53:39.587668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"25'1","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.545116+0000","last_change":"2023-07-21T22:18:43.338600+0000","last_active":"2023-07-21T22:18:44.545116+0000","last_peered":"2023-07-21T22:18:44.545116+0000","last_clean":"2023-07-21T22:18:44.545116+0000","last_became_active":"2023-07-21T22:18:43.338271+0000","last_became_peered":"2023-07-21T22:18:43.338271+0000","last_unstale":"2023-07-21T22:18:44.545116+0000","last_undegraded":"2023-07-21T22:18:44.545116+0000","last_fullsized":"2023-07-21T22:18:44.545116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:49.375113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":24,"state":"creating+peering","last_fresh":"2023-07-21T22:18:43.318984+0000","last_change":"2023-07-21T22:18:43.318984+0000","last_active":"2023-07-21T22:18:43.300562+0000","last_peered":"2023-07-21T22:18:43.300562+0000","last_clean":"2023-07-21T22:18:43.300562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:18:43.318984+0000","last_undegraded":"2023-07-21T22:18:43.318984+0000","last_fullsized":"2023-07-21T22:18:43.318984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.322602+0000","last_change":"2023-07-21T22:18:43.339272+0000","last_active":"2023-07-21T22:18:44.322602+0000","last_peered":"2023-07-21T22:18:44.322602+0000","last_clean":"2023-07-21T22:18:44.322602+0000","last_became_active":"2023-07-21T22:18:43.338864+0000","last_became_peered":"2023-07-21T22:18:43.338864+0000","last_unstale":"2023-07-21T22:18:44.322602+0000","last_undegraded":"2023-07-21T22:18:44.322602+0000","last_fullsized":"2023-07-21T22:18:44.322602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:21:31.802323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354956+0000","last_change":"2023-07-21T22:18:44.347783+0000","last_active":"2023-07-21T22:18:44.354956+0000","last_peered":"2023-07-21T22:18:44.354956+0000","last_clean":"2023-07-21T22:18:44.354956+0000","last_became_active":"2023-07-21T22:18:44.347417+0000","last_became_peered":"2023-07-21T22:18:44.347417+0000","last_unstale":"2023-07-21T22:18:44.354956+0000","last_undegraded":"2023-07-21T22:18:44.354956+0000","last_fullsized":"2023-07-21T22:18:44.354956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:13:17.888290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.539367+0000","last_change":"2023-07-21T22:18:43.341666+0000","last_active":"2023-07-21T22:18:44.539367+0000","last_peered":"2023-07-21T22:18:44.539367+0000","last_clean":"2023-07-21T22:18:44.539367+0000","last_became_active":"2023-07-21T22:18:43.341287+0000","last_became_peered":"2023-07-21T22:18:43.341287+0000","last_unstale":"2023-07-21T22:18:44.539367+0000","last_undegraded":"2023-07-21T22:18:44.539367+0000","last_fullsized":"2023-07-21T22:18:44.539367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:28.967479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348446+0000","last_change":"2023-07-21T22:18:44.345773+0000","last_active":"2023-07-21T22:18:44.348446+0000","last_peered":"2023-07-21T22:18:44.348446+0000","last_clean":"2023-07-21T22:18:44.348446+0000","last_became_active":"2023-07-21T22:18:44.345494+0000","last_became_peered":"2023-07-21T22:18:44.345494+0000","last_unstale":"2023-07-21T22:18:44.348446+0000","last_undegraded":"2023-07-21T22:18:44.348446+0000","last_fullsized":"2023-07-21T22:18:44.348446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:18:32.374919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T22:18:43.349108+0000","last_change":"2023-07-21T22:18:43.346587+0000","last_active":"2023-07-21T22:18:43.349108+0000","last_peered":"2023-07-21T22:18:43.349108+0000","last_clean":"2023-07-21T22:18:43.349108+0000","last_became_active":"2023-07-21T22:18:43.346170+0000","last_became_peered":"2023-07-21T22:18:43.346170+0000","last_unstale":"2023-07-21T22:18:43.349108+0000","last_undegraded":"2023-07-21T22:18:43.349108+0000","last_fullsized":"2023-07-21T22:18:43.349108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:29.389926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.342644+0000","last_change":"2023-07-21T22:18:44.339550+0000","last_active":"2023-07-21T22:18:44.342644+0000","last_peered":"2023-07-21T22:18:44.342644+0000","last_clean":"2023-07-21T22:18:44.342644+0000","last_became_active":"2023-07-21T22:18:44.339232+0000","last_became_peered":"2023-07-21T22:18:44.339232+0000","last_unstale":"2023-07-21T22:18:44.342644+0000","last_undegraded":"2023-07-21T22:18:44.342644+0000","last_fullsized":"2023-07-21T22:18:44.342644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:06:33.367363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.331764+0000","last_change":"2023-07-21T22:18:43.342021+0000","last_active":"2023-07-21T22:18:44.331764+0000","last_peered":"2023-07-21T22:18:44.331764+0000","last_clean":"2023-07-21T22:18:44.331764+0000","last_became_active":"2023-07-21T22:18:43.340494+0000","last_became_peered":"2023-07-21T22:18:43.340494+0000","last_unstale":"2023-07-21T22:18:44.331764+0000","last_undegraded":"2023-07-21T22:18:44.331764+0000","last_fullsized":"2023-07-21T22:18:44.331764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:43.109494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.350920+0000","last_change":"2023-07-21T22:18:44.349404+0000","last_active":"2023-07-21T22:18:44.350920+0000","last_peered":"2023-07-21T22:18:44.350920+0000","last_clean":"2023-07-21T22:18:44.350920+0000","last_became_active":"2023-07-21T22:18:44.348314+0000","last_became_peered":"2023-07-21T22:18:44.348314+0000","last_unstale":"2023-07-21T22:18:44.350920+0000","last_undegraded":"2023-07-21T22:18:44.350920+0000","last_fullsized":"2023-07-21T22:18:44.350920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:07:37.786708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.329935+0000","last_change":"2023-07-21T22:18:43.329711+0000","last_active":"2023-07-21T22:18:44.329935+0000","last_peered":"2023-07-21T22:18:44.329935+0000","last_clean":"2023-07-21T22:18:44.329935+0000","last_became_active":"2023-07-21T22:18:43.329184+0000","last_became_peered":"2023-07-21T22:18:43.329184+0000","last_unstale":"2023-07-21T22:18:44.329935+0000","last_undegraded":"2023-07-21T22:18:44.329935+0000","last_fullsized":"2023-07-21T22:18:44.329935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:44.231108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.355627+0000","last_change":"2023-07-21T22:18:44.354431+0000","last_active":"2023-07-21T22:18:44.355627+0000","last_peered":"2023-07-21T22:18:44.355627+0000","last_clean":"2023-07-21T22:18:44.355627+0000","last_became_active":"2023-07-21T22:18:44.354063+0000","last_became_peered":"2023-07-21T22:18:44.354063+0000","last_unstale":"2023-07-21T22:18:44.355627+0000","last_undegraded":"2023-07-21T22:18:44.355627+0000","last_fullsized":"2023-07-21T22:18:44.355627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:30:07.924076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":173,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.328122+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:18:44.328122+0000","last_peered":"2023-07-21T22:18:44.328122+0000","last_clean":"2023-07-21T22:18:44.328122+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:18:44.328122+0000","last_undegraded":"2023-07-21T22:18:44.328122+0000","last_fullsized":"2023-07-21T22:18:44.328122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:10:20.968928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.321937+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:18:44.321937+0000","last_peered":"2023-07-21T22:18:44.321937+0000","last_clean":"2023-07-21T22:18:44.321937+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:18:44.321937+0000","last_undegraded":"2023-07-21T22:18:44.321937+0000","last_fullsized":"2023-07-21T22:18:44.321937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:48:50.039471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.330287+0000","last_change":"2023-07-21T22:18:43.327625+0000","last_active":"2023-07-21T22:18:44.330287+0000","last_peered":"2023-07-21T22:18:44.330287+0000","last_clean":"2023-07-21T22:18:44.330287+0000","last_became_active":"2023-07-21T22:18:43.327272+0000","last_became_peered":"2023-07-21T22:18:43.327272+0000","last_unstale":"2023-07-21T22:18:44.330287+0000","last_undegraded":"2023-07-21T22:18:44.330287+0000","last_fullsized":"2023-07-21T22:18:44.330287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:30:06.913006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":24,"state":"creating+peering","last_fresh":"2023-07-21T22:18:43.319528+0000","last_change":"2023-07-21T22:18:43.319528+0000","last_active":"2023-07-21T22:18:43.300562+0000","last_peered":"2023-07-21T22:18:43.300562+0000","last_clean":"2023-07-21T22:18:43.300562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:18:43.319528+0000","last_undegraded":"2023-07-21T22:18:43.319528+0000","last_fullsized":"2023-07-21T22:18:43.319528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327999+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:18:44.327999+0000","last_peered":"2023-07-21T22:18:44.327999+0000","last_clean":"2023-07-21T22:18:44.327999+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:18:44.327999+0000","last_undegraded":"2023-07-21T22:18:44.327999+0000","last_fullsized":"2023-07-21T22:18:44.327999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:24:03.249599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327761+0000","last_change":"2023-07-21T22:18:43.344180+0000","last_active":"2023-07-21T22:18:44.327761+0000","last_peered":"2023-07-21T22:18:44.327761+0000","last_clean":"2023-07-21T22:18:44.327761+0000","last_became_active":"2023-07-21T22:18:43.343831+0000","last_became_peered":"2023-07-21T22:18:43.343831+0000","last_unstale":"2023-07-21T22:18:44.327761+0000","last_undegraded":"2023-07-21T22:18:44.327761+0000","last_fullsized":"2023-07-21T22:18:44.327761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:04.627872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354946+0000","last_change":"2023-07-21T22:18:44.347759+0000","last_active":"2023-07-21T22:18:44.354946+0000","last_peered":"2023-07-21T22:18:44.354946+0000","last_clean":"2023-07-21T22:18:44.354946+0000","last_became_active":"2023-07-21T22:18:44.347416+0000","last_became_peered":"2023-07-21T22:18:44.347416+0000","last_unstale":"2023-07-21T22:18:44.354946+0000","last_undegraded":"2023-07-21T22:18:44.354946+0000","last_fullsized":"2023-07-21T22:18:44.354946+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:12:36.391754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.318179+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:18:44.318179+0000","last_peered":"2023-07-21T22:18:44.318179+0000","last_clean":"2023-07-21T22:18:44.318179+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:18:44.318179+0000","last_undegraded":"2023-07-21T22:18:44.318179+0000","last_fullsized":"2023-07-21T22:18:44.318179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:06.825003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.321356+0000","last_change":"2023-07-21T22:18:43.332573+0000","last_active":"2023-07-21T22:18:44.321356+0000","last_peered":"2023-07-21T22:18:44.321356+0000","last_clean":"2023-07-21T22:18:44.321356+0000","last_became_active":"2023-07-21T22:18:43.331774+0000","last_became_peered":"2023-07-21T22:18:43.331774+0000","last_unstale":"2023-07-21T22:18:44.321356+0000","last_undegraded":"2023-07-21T22:18:44.321356+0000","last_fullsized":"2023-07-21T22:18:44.321356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:04.627872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.349586+0000","last_change":"2023-07-21T22:18:44.344092+0000","last_active":"2023-07-21T22:18:44.349586+0000","last_peered":"2023-07-21T22:18:44.349586+0000","last_clean":"2023-07-21T22:18:44.349586+0000","last_became_active":"2023-07-21T22:18:44.343819+0000","last_became_peered":"2023-07-21T22:18:44.343819+0000","last_unstale":"2023-07-21T22:18:44.349586+0000","last_undegraded":"2023-07-21T22:18:44.349586+0000","last_fullsized":"2023-07-21T22:18:44.349586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:03:22.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.324241+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:18:44.324241+0000","last_peered":"2023-07-21T22:18:44.324241+0000","last_clean":"2023-07-21T22:18:44.324241+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:18:44.324241+0000","last_undegraded":"2023-07-21T22:18:44.324241+0000","last_fullsized":"2023-07-21T22:18:44.324241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:45:35.436175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.330825+0000","last_change":"2023-07-21T22:18:43.347890+0000","last_active":"2023-07-21T22:18:44.330825+0000","last_peered":"2023-07-21T22:18:44.330825+0000","last_clean":"2023-07-21T22:18:44.330825+0000","last_became_active":"2023-07-21T22:18:43.347529+0000","last_became_peered":"2023-07-21T22:18:43.347529+0000","last_unstale":"2023-07-21T22:18:44.330825+0000","last_undegraded":"2023-07-21T22:18:44.330825+0000","last_fullsized":"2023-07-21T22:18:44.330825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:47:23.185156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.349943+0000","last_change":"2023-07-21T22:18:44.345749+0000","last_active":"2023-07-21T22:18:44.349943+0000","last_peered":"2023-07-21T22:18:44.349943+0000","last_clean":"2023-07-21T22:18:44.349943+0000","last_became_active":"2023-07-21T22:18:44.345413+0000","last_became_peered":"2023-07-21T22:18:44.345413+0000","last_unstale":"2023-07-21T22:18:44.349943+0000","last_undegraded":"2023-07-21T22:18:44.349943+0000","last_fullsized":"2023-07-21T22:18:44.349943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:42.552801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.328401+0000","last_change":"2023-07-21T22:18:43.339680+0000","last_active":"2023-07-21T22:18:44.328401+0000","last_peered":"2023-07-21T22:18:44.328401+0000","last_clean":"2023-07-21T22:18:44.328401+0000","last_became_active":"2023-07-21T22:18:43.339369+0000","last_became_peered":"2023-07-21T22:18:43.339369+0000","last_unstale":"2023-07-21T22:18:44.328401+0000","last_undegraded":"2023-07-21T22:18:44.328401+0000","last_fullsized":"2023-07-21T22:18:44.328401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:49.375113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327311+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:18:44.327311+0000","last_peered":"2023-07-21T22:18:44.327311+0000","last_clean":"2023-07-21T22:18:44.327311+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:18:44.327311+0000","last_undegraded":"2023-07-21T22:18:44.327311+0000","last_fullsized":"2023-07-21T22:18:44.327311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:21.376438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.349907+0000","last_change":"2023-07-21T22:18:44.345981+0000","last_active":"2023-07-21T22:18:44.349907+0000","last_peered":"2023-07-21T22:18:44.349907+0000","last_clean":"2023-07-21T22:18:44.349907+0000","last_became_active":"2023-07-21T22:18:44.345650+0000","last_became_peered":"2023-07-21T22:18:44.345650+0000","last_unstale":"2023-07-21T22:18:44.349907+0000","last_undegraded":"2023-07-21T22:18:44.349907+0000","last_fullsized":"2023-07-21T22:18:44.349907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:29.978550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327210+0000","last_change":"2023-07-21T22:18:43.336788+0000","last_active":"2023-07-21T22:18:44.327210+0000","last_peered":"2023-07-21T22:18:44.327210+0000","last_clean":"2023-07-21T22:18:44.327210+0000","last_became_active":"2023-07-21T22:18:43.336357+0000","last_became_peered":"2023-07-21T22:18:43.336357+0000","last_unstale":"2023-07-21T22:18:44.327210+0000","last_undegraded":"2023-07-21T22:18:44.327210+0000","last_fullsized":"2023-07-21T22:18:44.327210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:29.106844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327443+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:18:44.327443+0000","last_peered":"2023-07-21T22:18:44.327443+0000","last_clean":"2023-07-21T22:18:44.327443+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:18:44.327443+0000","last_undegraded":"2023-07-21T22:18:44.327443+0000","last_fullsized":"2023-07-21T22:18:44.327443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:50:59.658234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346914+0000","last_change":"2023-07-21T22:18:44.345851+0000","last_active":"2023-07-21T22:18:44.346914+0000","last_peered":"2023-07-21T22:18:44.346914+0000","last_clean":"2023-07-21T22:18:44.346914+0000","last_became_active":"2023-07-21T22:18:44.345553+0000","last_became_peered":"2023-07-21T22:18:44.345553+0000","last_unstale":"2023-07-21T22:18:44.346914+0000","last_undegraded":"2023-07-21T22:18:44.346914+0000","last_fullsized":"2023-07-21T22:18:44.346914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:37:46.816193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.545191+0000","last_change":"2023-07-21T22:18:43.335304+0000","last_active":"2023-07-21T22:18:44.545191+0000","last_peered":"2023-07-21T22:18:44.545191+0000","last_clean":"2023-07-21T22:18:44.545191+0000","last_became_active":"2023-07-21T22:18:43.334929+0000","last_became_peered":"2023-07-21T22:18:43.334929+0000","last_unstale":"2023-07-21T22:18:44.545191+0000","last_undegraded":"2023-07-21T22:18:44.545191+0000","last_fullsized":"2023-07-21T22:18:44.545191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:25.997043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.322299+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:18:44.322299+0000","last_peered":"2023-07-21T22:18:44.322299+0000","last_clean":"2023-07-21T22:18:44.322299+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:18:44.322299+0000","last_undegraded":"2023-07-21T22:18:44.322299+0000","last_fullsized":"2023-07-21T22:18:44.322299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:49.800708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.353585+0000","last_change":"2023-07-21T22:18:44.341231+0000","last_active":"2023-07-21T22:18:44.353585+0000","last_peered":"2023-07-21T22:18:44.353585+0000","last_clean":"2023-07-21T22:18:44.353585+0000","last_became_active":"2023-07-21T22:18:44.340874+0000","last_became_peered":"2023-07-21T22:18:44.340874+0000","last_unstale":"2023-07-21T22:18:44.353585+0000","last_undegraded":"2023-07-21T22:18:44.353585+0000","last_fullsized":"2023-07-21T22:18:44.353585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:54:18.053463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.332682+0000","last_change":"2023-07-21T22:18:43.340557+0000","last_active":"2023-07-21T22:18:44.332682+0000","last_peered":"2023-07-21T22:18:44.332682+0000","last_clean":"2023-07-21T22:18:44.332682+0000","last_became_active":"2023-07-21T22:18:43.340199+0000","last_became_peered":"2023-07-21T22:18:43.340199+0000","last_unstale":"2023-07-21T22:18:44.332682+0000","last_undegraded":"2023-07-21T22:18:44.332682+0000","last_fullsized":"2023-07-21T22:18:44.332682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:54.833351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T22:18:43.323742+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:18:43.323742+0000","last_peered":"2023-07-21T22:18:43.323742+0000","last_clean":"2023-07-21T22:18:43.323742+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:18:43.323742+0000","last_undegraded":"2023-07-21T22:18:43.323742+0000","last_fullsized":"2023-07-21T22:18:43.323742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:54:12.009749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.350300+0000","last_change":"2023-07-21T22:18:44.347206+0000","last_active":"2023-07-21T22:18:44.350300+0000","last_peered":"2023-07-21T22:18:44.350300+0000","last_clean":"2023-07-21T22:18:44.350300+0000","last_became_active":"2023-07-21T22:18:44.346914+0000","last_became_peered":"2023-07-21T22:18:44.346914+0000","last_unstale":"2023-07-21T22:18:44.350300+0000","last_undegraded":"2023-07-21T22:18:44.350300+0000","last_fullsized":"2023-07-21T22:18:44.350300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:47:23.190588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348379+0000","last_change":"2023-07-21T22:18:44.343986+0000","last_active":"2023-07-21T22:18:44.348379+0000","last_peered":"2023-07-21T22:18:44.348379+0000","last_clean":"2023-07-21T22:18:44.348379+0000","last_became_active":"2023-07-21T22:18:44.342943+0000","last_became_peered":"2023-07-21T22:18:44.342943+0000","last_unstale":"2023-07-21T22:18:44.348379+0000","last_undegraded":"2023-07-21T22:18:44.348379+0000","last_fullsized":"2023-07-21T22:18:44.348379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:25:56.912736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"25'6","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.551448+0000","last_change":"2023-07-21T22:18:43.336129+0000","last_active":"2023-07-21T22:18:44.551448+0000","last_peered":"2023-07-21T22:18:44.551448+0000","last_clean":"2023-07-21T22:18:44.551448+0000","last_became_active":"2023-07-21T22:18:43.335850+0000","last_became_peered":"2023-07-21T22:18:43.335850+0000","last_unstale":"2023-07-21T22:18:44.551448+0000","last_undegraded":"2023-07-21T22:18:44.551448+0000","last_fullsized":"2023-07-21T22:18:44.551448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:21:31.802323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.353149+0000","last_change":"2023-07-21T22:18:44.351088+0000","last_active":"2023-07-21T22:18:44.353149+0000","last_peered":"2023-07-21T22:18:44.353149+0000","last_clean":"2023-07-21T22:18:44.353149+0000","last_became_active":"2023-07-21T22:18:44.350791+0000","last_became_peered":"2023-07-21T22:18:44.350791+0000","last_unstale":"2023-07-21T22:18:44.353149+0000","last_undegraded":"2023-07-21T22:18:44.353149+0000","last_fullsized":"2023-07-21T22:18:44.353149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:27.008113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"25'3","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.544002+0000","last_change":"2023-07-21T22:18:43.340832+0000","last_active":"2023-07-21T22:18:44.544002+0000","last_peered":"2023-07-21T22:18:44.544002+0000","last_clean":"2023-07-21T22:18:44.544002+0000","last_became_active":"2023-07-21T22:18:43.340519+0000","last_became_peered":"2023-07-21T22:18:43.340519+0000","last_unstale":"2023-07-21T22:18:44.544002+0000","last_undegraded":"2023-07-21T22:18:44.544002+0000","last_fullsized":"2023-07-21T22:18:44.544002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:59:20.160352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327327+0000","last_change":"2023-07-21T22:18:43.335834+0000","last_active":"2023-07-21T22:18:44.327327+0000","last_peered":"2023-07-21T22:18:44.327327+0000","last_clean":"2023-07-21T22:18:44.327327+0000","last_became_active":"2023-07-21T22:18:43.335518+0000","last_became_peered":"2023-07-21T22:18:43.335518+0000","last_unstale":"2023-07-21T22:18:44.327327+0000","last_undegraded":"2023-07-21T22:18:44.327327+0000","last_fullsized":"2023-07-21T22:18:44.327327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:59:20.160352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354632+0000","last_change":"2023-07-21T22:18:44.349059+0000","last_active":"2023-07-21T22:18:44.354632+0000","last_peered":"2023-07-21T22:18:44.354632+0000","last_clean":"2023-07-21T22:18:44.354632+0000","last_became_active":"2023-07-21T22:18:44.348691+0000","last_became_peered":"2023-07-21T22:18:44.348691+0000","last_unstale":"2023-07-21T22:18:44.354632+0000","last_undegraded":"2023-07-21T22:18:44.354632+0000","last_fullsized":"2023-07-21T22:18:44.354632+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:12:36.391754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.331983+0000","last_change":"2023-07-21T22:18:43.341273+0000","last_active":"2023-07-21T22:18:44.331983+0000","last_peered":"2023-07-21T22:18:44.331983+0000","last_clean":"2023-07-21T22:18:44.331983+0000","last_became_active":"2023-07-21T22:18:43.340594+0000","last_became_peered":"2023-07-21T22:18:43.340594+0000","last_unstale":"2023-07-21T22:18:44.331983+0000","last_undegraded":"2023-07-21T22:18:44.331983+0000","last_fullsized":"2023-07-21T22:18:44.331983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:30:06.913006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.353533+0000","last_change":"2023-07-21T22:18:44.341063+0000","last_active":"2023-07-21T22:18:44.353533+0000","last_peered":"2023-07-21T22:18:44.353533+0000","last_clean":"2023-07-21T22:18:44.353533+0000","last_became_active":"2023-07-21T22:18:44.337396+0000","last_became_peered":"2023-07-21T22:18:44.337396+0000","last_unstale":"2023-07-21T22:18:44.353533+0000","last_undegraded":"2023-07-21T22:18:44.353533+0000","last_fullsized":"2023-07-21T22:18:44.353533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:54.484564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":24,"state":"creating+peering","last_fresh":"2023-07-21T22:18:43.319518+0000","last_change":"2023-07-21T22:18:43.319518+0000","last_active":"2023-07-21T22:18:43.300562+0000","last_peered":"2023-07-21T22:18:43.300562+0000","last_clean":"2023-07-21T22:18:43.300562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:18:43.319518+0000","last_undegraded":"2023-07-21T22:18:43.319518+0000","last_fullsized":"2023-07-21T22:18:43.319518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.329796+0000","last_change":"2023-07-21T22:18:43.341804+0000","last_active":"2023-07-21T22:18:44.329796+0000","last_peered":"2023-07-21T22:18:44.329796+0000","last_clean":"2023-07-21T22:18:44.329796+0000","last_became_active":"2023-07-21T22:18:43.341205+0000","last_became_peered":"2023-07-21T22:18:43.341205+0000","last_unstale":"2023-07-21T22:18:44.329796+0000","last_undegraded":"2023-07-21T22:18:44.329796+0000","last_fullsized":"2023-07-21T22:18:44.329796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:03:21.376838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.339571+0000","last_change":"2023-07-21T22:18:44.338013+0000","last_active":"2023-07-21T22:18:44.339571+0000","last_peered":"2023-07-21T22:18:44.339571+0000","last_clean":"2023-07-21T22:18:44.339571+0000","last_became_active":"2023-07-21T22:18:44.337701+0000","last_became_peered":"2023-07-21T22:18:44.337701+0000","last_unstale":"2023-07-21T22:18:44.339571+0000","last_undegraded":"2023-07-21T22:18:44.339571+0000","last_fullsized":"2023-07-21T22:18:44.339571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:51.413018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.321576+0000","last_change":"2023-07-21T22:18:43.337656+0000","last_active":"2023-07-21T22:18:44.321576+0000","last_peered":"2023-07-21T22:18:44.321576+0000","last_clean":"2023-07-21T22:18:44.321576+0000","last_became_active":"2023-07-21T22:18:43.337228+0000","last_became_peered":"2023-07-21T22:18:43.337228+0000","last_unstale":"2023-07-21T22:18:44.321576+0000","last_undegraded":"2023-07-21T22:18:44.321576+0000","last_fullsized":"2023-07-21T22:18:44.321576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:26:53.788877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348787+0000","last_change":"2023-07-21T22:18:44.337074+0000","last_active":"2023-07-21T22:18:44.348787+0000","last_peered":"2023-07-21T22:18:44.348787+0000","last_clean":"2023-07-21T22:18:44.348787+0000","last_became_active":"2023-07-21T22:18:44.336374+0000","last_became_peered":"2023-07-21T22:18:44.336374+0000","last_unstale":"2023-07-21T22:18:44.348787+0000","last_undegraded":"2023-07-21T22:18:44.348787+0000","last_fullsized":"2023-07-21T22:18:44.348787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:12.868716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"25'1","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.545999+0000","last_change":"2023-07-21T22:18:43.343871+0000","last_active":"2023-07-21T22:18:44.545999+0000","last_peered":"2023-07-21T22:18:44.545999+0000","last_clean":"2023-07-21T22:18:44.545999+0000","last_became_active":"2023-07-21T22:18:43.342848+0000","last_became_peered":"2023-07-21T22:18:43.342848+0000","last_unstale":"2023-07-21T22:18:44.545999+0000","last_undegraded":"2023-07-21T22:18:44.545999+0000","last_fullsized":"2023-07-21T22:18:44.545999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:19.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.342991+0000","last_change":"2023-07-21T22:18:44.338868+0000","last_active":"2023-07-21T22:18:44.342991+0000","last_peered":"2023-07-21T22:18:44.342991+0000","last_clean":"2023-07-21T22:18:44.342991+0000","last_became_active":"2023-07-21T22:18:44.337629+0000","last_became_peered":"2023-07-21T22:18:44.337629+0000","last_unstale":"2023-07-21T22:18:44.342991+0000","last_undegraded":"2023-07-21T22:18:44.342991+0000","last_fullsized":"2023-07-21T22:18:44.342991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:54:18.053463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"25'1","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.538568+0000","last_change":"2023-07-21T22:18:43.347419+0000","last_active":"2023-07-21T22:18:44.538568+0000","last_peered":"2023-07-21T22:18:44.538568+0000","last_clean":"2023-07-21T22:18:44.538568+0000","last_became_active":"2023-07-21T22:18:43.347118+0000","last_became_peered":"2023-07-21T22:18:43.347118+0000","last_unstale":"2023-07-21T22:18:44.538568+0000","last_undegraded":"2023-07-21T22:18:44.538568+0000","last_fullsized":"2023-07-21T22:18:44.538568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:03:21.376838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348407+0000","last_change":"2023-07-21T22:18:44.345638+0000","last_active":"2023-07-21T22:18:44.348407+0000","last_peered":"2023-07-21T22:18:44.348407+0000","last_clean":"2023-07-21T22:18:44.348407+0000","last_became_active":"2023-07-21T22:18:44.345310+0000","last_became_peered":"2023-07-21T22:18:44.345310+0000","last_unstale":"2023-07-21T22:18:44.348407+0000","last_undegraded":"2023-07-21T22:18:44.348407+0000","last_fullsized":"2023-07-21T22:18:44.348407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:30:26.113148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.545323+0000","last_change":"2023-07-21T22:18:43.345885+0000","last_active":"2023-07-21T22:18:44.545323+0000","last_peered":"2023-07-21T22:18:44.545323+0000","last_clean":"2023-07-21T22:18:44.545323+0000","last_became_active":"2023-07-21T22:18:43.345540+0000","last_became_peered":"2023-07-21T22:18:43.345540+0000","last_unstale":"2023-07-21T22:18:44.545323+0000","last_undegraded":"2023-07-21T22:18:44.545323+0000","last_fullsized":"2023-07-21T22:18:44.545323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:23:16.582471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348486+0000","last_change":"2023-07-21T22:18:44.346068+0000","last_active":"2023-07-21T22:18:44.348486+0000","last_peered":"2023-07-21T22:18:44.348486+0000","last_clean":"2023-07-21T22:18:44.348486+0000","last_became_active":"2023-07-21T22:18:44.345741+0000","last_became_peered":"2023-07-21T22:18:44.345741+0000","last_unstale":"2023-07-21T22:18:44.348486+0000","last_undegraded":"2023-07-21T22:18:44.348486+0000","last_fullsized":"2023-07-21T22:18:44.348486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:33:31.334871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.544215+0000","last_change":"2023-07-21T22:18:43.342235+0000","last_active":"2023-07-21T22:18:44.544215+0000","last_peered":"2023-07-21T22:18:44.544215+0000","last_clean":"2023-07-21T22:18:44.544215+0000","last_became_active":"2023-07-21T22:18:43.341945+0000","last_became_peered":"2023-07-21T22:18:43.341945+0000","last_unstale":"2023-07-21T22:18:44.544215+0000","last_undegraded":"2023-07-21T22:18:44.544215+0000","last_fullsized":"2023-07-21T22:18:44.544215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:25:33.381132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.353801+0000","last_change":"2023-07-21T22:18:44.342724+0000","last_active":"2023-07-21T22:18:44.353801+0000","last_peered":"2023-07-21T22:18:44.353801+0000","last_clean":"2023-07-21T22:18:44.353801+0000","last_became_active":"2023-07-21T22:18:44.342450+0000","last_became_peered":"2023-07-21T22:18:44.342450+0000","last_unstale":"2023-07-21T22:18:44.353801+0000","last_undegraded":"2023-07-21T22:18:44.353801+0000","last_fullsized":"2023-07-21T22:18:44.353801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:57:20.260229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.542136+0000","last_change":"2023-07-21T22:18:43.328543+0000","last_active":"2023-07-21T22:18:44.542136+0000","last_peered":"2023-07-21T22:18:44.542136+0000","last_clean":"2023-07-21T22:18:44.542136+0000","last_became_active":"2023-07-21T22:18:43.328165+0000","last_became_peered":"2023-07-21T22:18:43.328165+0000","last_unstale":"2023-07-21T22:18:44.542136+0000","last_undegraded":"2023-07-21T22:18:44.542136+0000","last_fullsized":"2023-07-21T22:18:44.542136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:54.833351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346881+0000","last_change":"2023-07-21T22:18:44.343626+0000","last_active":"2023-07-21T22:18:44.346881+0000","last_peered":"2023-07-21T22:18:44.346881+0000","last_clean":"2023-07-21T22:18:44.346881+0000","last_became_active":"2023-07-21T22:18:44.343339+0000","last_became_peered":"2023-07-21T22:18:44.343339+0000","last_unstale":"2023-07-21T22:18:44.346881+0000","last_undegraded":"2023-07-21T22:18:44.346881+0000","last_fullsized":"2023-07-21T22:18:44.346881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:36:40.719765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"25'4","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.542522+0000","last_change":"2023-07-21T22:18:43.341441+0000","last_active":"2023-07-21T22:18:44.542522+0000","last_peered":"2023-07-21T22:18:44.542522+0000","last_clean":"2023-07-21T22:18:44.542522+0000","last_became_active":"2023-07-21T22:18:43.340962+0000","last_became_peered":"2023-07-21T22:18:43.340962+0000","last_unstale":"2023-07-21T22:18:44.542522+0000","last_undegraded":"2023-07-21T22:18:44.542522+0000","last_fullsized":"2023-07-21T22:18:44.542522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:28.967479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":676715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":86347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":86347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":93475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":93475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":93475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":856064,"data_stored":684425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":86347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.55}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7470000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1829999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:18:49.075 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:18:49.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.212+0000 7f78fed11640 1 Processor -- start 2023-07-21T22:18:49.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.212+0000 7f78fed11640 1 -- start start 2023-07-21T22:18:49.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.212+0000 7f78fed11640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f78f815bdf0 0x7f78f80ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:49.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.212+0000 7f78fed11640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f806c000 con 0x7f78f815f970 2023-07-21T22:18:49.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.212+0000 7f78fed11640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78f80cb2e0 con 0x7f78f80c9e80 2023-07-21T22:18:49.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.212+0000 7f78fed11640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f80cb5c0 con 0x7f78f815bdf0 2023-07-21T22:18:49.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.212+0000 7f78fcaad640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f78f815bdf0 0x7f78f80ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:49.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.212+0000 7f78f7fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f78f815f970 0x7f78f806b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54054/0 (socket says 172.21.15.6:54054) 2023-07-21T22:18:49.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.212+0000 7f78f7fff640 1 -- 172.21.15.6:0/2876425473 learned_addr learned my addr 172.21.15.6:0/2876425473 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:49.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.212+0000 7f78fcaad640 1 -- 172.21.15.6:0/2876425473 >> v1:172.21.15.161:6789/0 conn(0x7f78f80c9e80 legacy=0x7f78f806b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:49.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.212+0000 7f78fcaad640 1 -- 172.21.15.6:0/2876425473 >> v1:172.21.15.6:6789/0 conn(0x7f78f815f970 legacy=0x7f78f806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:49.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.212+0000 7f78f77fe640 1 -- 172.21.15.6:0/2876425473 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618463041 0 0) 0x7f78f806c000 con 0x7f78f815f970 2023-07-21T22:18:49.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.212+0000 7f78fcaad640 1 -- 172.21.15.6:0/2876425473 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f80cb8a0 con 0x7f78f815bdf0 2023-07-21T22:18:49.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.216+0000 7f78fcaad640 1 --2- 172.21.15.6:0/2876425473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78f815bdf0 0x7f78f80ca970 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0097c0 tx=0x7f78ec01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ced805ce58f3a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:49.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.216+0000 7f78f77fe640 1 -- 172.21.15.6:0/2876425473 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0ac640 con 0x7f78f815bdf0 2023-07-21T22:18:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.216+0000 7f78f77fe640 1 -- 172.21.15.6:0/2876425473 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec0ac7a0 con 0x7f78f815bdf0 2023-07-21T22:18:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.216+0000 7f78f77fe640 1 -- 172.21.15.6:0/2876425473 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0acb30 con 0x7f78f815bdf0 2023-07-21T22:18:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.216+0000 7f78fed11640 1 -- 172.21.15.6:0/2876425473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78f815bdf0 msgr2=0x7f78f80ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.216+0000 7f78fed11640 1 --2- 172.21.15.6:0/2876425473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78f815bdf0 0x7f78f80ca970 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0097c0 tx=0x7f78ec01c3c0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.216+0000 7f78fed11640 1 -- 172.21.15.6:0/2876425473 shutdown_connections 2023-07-21T22:18:49.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.216+0000 7f78fed11640 1 --2- 172.21.15.6:0/2876425473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78f815bdf0 0x7f78f80ca970 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.216+0000 7f78fed11640 1 -- 172.21.15.6:0/2876425473 >> 172.21.15.6:0/2876425473 conn(0x7f78f80afcf0 msgr2=0x7f78f80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:49.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.216+0000 7f78fed11640 1 -- 172.21.15.6:0/2876425473 shutdown_connections 2023-07-21T22:18:49.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.216+0000 7f78fed11640 1 -- 172.21.15.6:0/2876425473 wait complete. 2023-07-21T22:18:49.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78fed11640 1 Processor -- start 2023-07-21T22:18:49.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78fed11640 1 -- start start 2023-07-21T22:18:49.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78fed11640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78f815bdf0 0x7f78f81521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:49.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78fed11640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78f815f970 0x7f78f80ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:49.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78fed11640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78f80c4260 0x7f78f80c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:49.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78fed11640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f8151d40 con 0x7f78f815f970 2023-07-21T22:18:49.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78fed11640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f8151170 con 0x7f78f815bdf0 2023-07-21T22:18:49.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78fed11640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f8151410 con 0x7f78f80c4260 2023-07-21T22:18:49.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78f7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78f815f970 0x7f78f80ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:49.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78f7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78f815f970 0x7f78f80ae7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46666/0 (socket says 172.21.15.6:46666) 2023-07-21T22:18:49.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78f7fff640 1 -- 172.21.15.6:0/3736863425 learned_addr learned my addr 172.21.15.6:0/3736863425 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:49.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78fcaad640 1 --2- 172.21.15.6:0/3736863425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78f815bdf0 0x7f78f81521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:49.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78fd2ae640 1 --2- 172.21.15.6:0/3736863425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78f80c4260 0x7f78f80c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:49.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78f7fff640 1 -- 172.21.15.6:0/3736863425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78f80c4260 msgr2=0x7f78f80c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:49.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78f7fff640 1 --2- 172.21.15.6:0/3736863425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78f80c4260 0x7f78f80c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78f7fff640 1 -- 172.21.15.6:0/3736863425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78f815bdf0 msgr2=0x7f78f81521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:49.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78f7fff640 1 --2- 172.21.15.6:0/3736863425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78f815bdf0 0x7f78f81521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78f7fff640 1 -- 172.21.15.6:0/3736863425 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec009420 con 0x7f78f815f970 2023-07-21T22:18:49.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78fd2ae640 1 --2- 172.21.15.6:0/3736863425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78f80c4260 0x7f78f80c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:49.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78f7fff640 1 --2- 172.21.15.6:0/3736863425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78f815f970 0x7f78f80ae7f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f78e400c410 tx=0x7f78e400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:49.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78f57fa640 1 -- 172.21.15.6:0/3736863425 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e40074e0 con 0x7f78f815f970 2023-07-21T22:18:49.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78f57fa640 1 -- 172.21.15.6:0/3736863425 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e4007640 con 0x7f78f815f970 2023-07-21T22:18:49.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78f57fa640 1 -- 172.21.15.6:0/3736863425 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e4004a30 con 0x7f78f815f970 2023-07-21T22:18:49.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78fed11640 1 -- 172.21.15.6:0/3736863425 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f8160340 con 0x7f78f815f970 2023-07-21T22:18:49.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.220+0000 7f78fed11640 1 -- 172.21.15.6:0/3736863425 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f81519d0 con 0x7f78f815f970 2023-07-21T22:18:49.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.224+0000 7f78fed11640 1 -- 172.21.15.6:0/3736863425 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f8151ef0 con 0x7f78f815f970 2023-07-21T22:18:49.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.224+0000 7f78f57fa640 1 -- 172.21.15.6:0/3736863425 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78e4004b90 con 0x7f78f815f970 2023-07-21T22:18:49.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.224+0000 7f78f57fa640 1 --2- 172.21.15.6:0/3736863425 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f78dc0662b0 0x7f78dc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:49.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.224+0000 7f78f57fa640 1 -- 172.21.15.6:0/3736863425 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f78e4083a70 con 0x7f78f815f970 2023-07-21T22:18:49.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.224+0000 7f78fcaad640 1 --2- 172.21.15.6:0/3736863425 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f78dc0662b0 0x7f78dc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:49.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.224+0000 7f78fcaad640 1 --2- 172.21.15.6:0/3736863425 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f78dc0662b0 0x7f78dc068760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0ae000 tx=0x7f78ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:49.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.228+0000 7f78f57fa640 1 -- 172.21.15.6:0/3736863425 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f78f8151ef0 con 0x7f78f815f970 2023-07-21T22:18:49.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.380+0000 7f78fed11640 1 -- 172.21.15.6:0/3736863425 --> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f78f81601c0 con 0x7f78dc0662b0 2023-07-21T22:18:49.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.388+0000 7f78f57fa640 1 -- 172.21.15.6:0/3736863425 <== mgr.4103 v2:172.21.15.161:6832/3471136886 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286231 (secure 0 0 0) 0x7f78ec0bc090 con 0x7f78dc0662b0 2023-07-21T22:18:49.438 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:18:49.439 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:18:49.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.392+0000 7f78fed11640 1 -- 172.21.15.6:0/3736863425 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f78dc0662b0 msgr2=0x7f78dc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:49.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.392+0000 7f78fed11640 1 --2- 172.21.15.6:0/3736863425 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f78dc0662b0 0x7f78dc068760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f78ec0ae000 tx=0x7f78ec008040 comp rx=0 tx=0).stop 2023-07-21T22:18:49.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.392+0000 7f78fed11640 1 -- 172.21.15.6:0/3736863425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78f815f970 msgr2=0x7f78f80ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:49.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.392+0000 7f78fed11640 1 --2- 172.21.15.6:0/3736863425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78f815f970 0x7f78f80ae7f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f78e400c410 tx=0x7f78e400c8d0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.392+0000 7f78fed11640 1 -- 172.21.15.6:0/3736863425 shutdown_connections 2023-07-21T22:18:49.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.392+0000 7f78fed11640 1 --2- 172.21.15.6:0/3736863425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78f80c4260 0x7f78f80c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.392+0000 7f78fed11640 1 --2- 172.21.15.6:0/3736863425 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f78dc0662b0 0x7f78dc068760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.392+0000 7f78fed11640 1 --2- 172.21.15.6:0/3736863425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78f815f970 0x7f78f80ae7f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.392+0000 7f78fed11640 1 --2- 172.21.15.6:0/3736863425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78f815bdf0 0x7f78f81521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.392+0000 7f78fed11640 1 -- 172.21.15.6:0/3736863425 >> 172.21.15.6:0/3736863425 conn(0x7f78f80afcf0 msgr2=0x7f78f80ce8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:49.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.392+0000 7f78fed11640 1 -- 172.21.15.6:0/3736863425 shutdown_connections 2023-07-21T22:18:49.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.392+0000 7f78fed11640 1 -- 172.21.15.6:0/3736863425 wait complete. 2023-07-21T22:18:49.457 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-07-21T22:18:48.768936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218748,"kb_used_data":3132,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755972,"statfs":{"total":773094113280,"available":772870115328,"internally_reserved":0,"allocated":3207168,"data_stored":1900606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001298"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.341718+0000","last_change":"2023-07-21T22:18:44.336499+0000","last_active":"2023-07-21T22:18:44.341718+0000","last_peered":"2023-07-21T22:18:44.341718+0000","last_clean":"2023-07-21T22:18:44.341718+0000","last_became_active":"2023-07-21T22:18:44.336063+0000","last_became_peered":"2023-07-21T22:18:44.336063+0000","last_unstale":"2023-07-21T22:18:44.341718+0000","last_undegraded":"2023-07-21T22:18:44.341718+0000","last_fullsized":"2023-07-21T22:18:44.341718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:24:06.166416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346444+0000","last_change":"2023-07-21T22:18:44.341470+0000","last_active":"2023-07-21T22:18:44.346444+0000","last_peered":"2023-07-21T22:18:44.346444+0000","last_clean":"2023-07-21T22:18:44.346444+0000","last_became_active":"2023-07-21T22:18:44.341148+0000","last_became_peered":"2023-07-21T22:18:44.341148+0000","last_unstale":"2023-07-21T22:18:44.346444+0000","last_undegraded":"2023-07-21T22:18:44.346444+0000","last_fullsized":"2023-07-21T22:18:44.346444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:20.530615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.338400+0000","last_change":"2023-07-21T22:18:44.336245+0000","last_active":"2023-07-21T22:18:44.338400+0000","last_peered":"2023-07-21T22:18:44.338400+0000","last_clean":"2023-07-21T22:18:44.338400+0000","last_became_active":"2023-07-21T22:18:44.335682+0000","last_became_peered":"2023-07-21T22:18:44.335682+0000","last_unstale":"2023-07-21T22:18:44.338400+0000","last_undegraded":"2023-07-21T22:18:44.338400+0000","last_fullsized":"2023-07-21T22:18:44.338400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:16:43.932507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":24,"state":"creating+peering","last_fresh":"2023-07-21T22:18:43.319825+0000","last_change":"2023-07-21T22:18:43.319825+0000","last_active":"2023-07-21T22:18:43.300562+0000","last_peered":"2023-07-21T22:18:43.300562+0000","last_clean":"2023-07-21T22:18:43.300562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:18:43.319825+0000","last_undegraded":"2023-07-21T22:18:43.319825+0000","last_fullsized":"2023-07-21T22:18:43.319825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346108+0000","last_change":"2023-07-21T22:18:44.344066+0000","last_active":"2023-07-21T22:18:44.346108+0000","last_peered":"2023-07-21T22:18:44.346108+0000","last_clean":"2023-07-21T22:18:44.346108+0000","last_became_active":"2023-07-21T22:18:44.343765+0000","last_became_peered":"2023-07-21T22:18:44.343765+0000","last_unstale":"2023-07-21T22:18:44.346108+0000","last_undegraded":"2023-07-21T22:18:44.346108+0000","last_fullsized":"2023-07-21T22:18:44.346108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:54.484564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.338362+0000","last_change":"2023-07-21T22:18:44.336096+0000","last_active":"2023-07-21T22:18:44.338362+0000","last_peered":"2023-07-21T22:18:44.338362+0000","last_clean":"2023-07-21T22:18:44.338362+0000","last_became_active":"2023-07-21T22:18:44.335625+0000","last_became_peered":"2023-07-21T22:18:44.335625+0000","last_unstale":"2023-07-21T22:18:44.338362+0000","last_undegraded":"2023-07-21T22:18:44.338362+0000","last_fullsized":"2023-07-21T22:18:44.338362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:23:17.593542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.341432+0000","last_change":"2023-07-21T22:18:44.338953+0000","last_active":"2023-07-21T22:18:44.341432+0000","last_peered":"2023-07-21T22:18:44.341432+0000","last_clean":"2023-07-21T22:18:44.341432+0000","last_became_active":"2023-07-21T22:18:44.338582+0000","last_became_peered":"2023-07-21T22:18:44.338582+0000","last_unstale":"2023-07-21T22:18:44.341432+0000","last_undegraded":"2023-07-21T22:18:44.341432+0000","last_fullsized":"2023-07-21T22:18:44.341432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:10.090300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346408+0000","last_change":"2023-07-21T22:18:44.337662+0000","last_active":"2023-07-21T22:18:44.346408+0000","last_peered":"2023-07-21T22:18:44.346408+0000","last_clean":"2023-07-21T22:18:44.346408+0000","last_became_active":"2023-07-21T22:18:44.337217+0000","last_became_peered":"2023-07-21T22:18:44.337217+0000","last_unstale":"2023-07-21T22:18:44.346408+0000","last_undegraded":"2023-07-21T22:18:44.346408+0000","last_fullsized":"2023-07-21T22:18:44.346408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:06:33.367363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346142+0000","last_change":"2023-07-21T22:18:44.344268+0000","last_active":"2023-07-21T22:18:44.346142+0000","last_peered":"2023-07-21T22:18:44.346142+0000","last_clean":"2023-07-21T22:18:44.346142+0000","last_became_active":"2023-07-21T22:18:44.343880+0000","last_became_peered":"2023-07-21T22:18:44.343880+0000","last_unstale":"2023-07-21T22:18:44.346142+0000","last_undegraded":"2023-07-21T22:18:44.346142+0000","last_fullsized":"2023-07-21T22:18:44.346142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:45.242179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346345+0000","last_change":"2023-07-21T22:18:44.336379+0000","last_active":"2023-07-21T22:18:44.346345+0000","last_peered":"2023-07-21T22:18:44.346345+0000","last_clean":"2023-07-21T22:18:44.346345+0000","last_became_active":"2023-07-21T22:18:44.335846+0000","last_became_peered":"2023-07-21T22:18:44.335846+0000","last_unstale":"2023-07-21T22:18:44.346345+0000","last_undegraded":"2023-07-21T22:18:44.346345+0000","last_fullsized":"2023-07-21T22:18:44.346345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:44.120565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354172+0000","last_change":"2023-07-21T22:18:44.352832+0000","last_active":"2023-07-21T22:18:44.354172+0000","last_peered":"2023-07-21T22:18:44.354172+0000","last_clean":"2023-07-21T22:18:44.354172+0000","last_became_active":"2023-07-21T22:18:44.352465+0000","last_became_peered":"2023-07-21T22:18:44.352465+0000","last_unstale":"2023-07-21T22:18:44.354172+0000","last_undegraded":"2023-07-21T22:18:44.354172+0000","last_fullsized":"2023-07-21T22:18:44.354172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:48:56.083184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.342895+0000","last_change":"2023-07-21T22:18:44.337129+0000","last_active":"2023-07-21T22:18:44.342895+0000","last_peered":"2023-07-21T22:18:44.342895+0000","last_clean":"2023-07-21T22:18:44.342895+0000","last_became_active":"2023-07-21T22:18:44.336170+0000","last_became_peered":"2023-07-21T22:18:44.336170+0000","last_unstale":"2023-07-21T22:18:44.342895+0000","last_undegraded":"2023-07-21T22:18:44.342895+0000","last_fullsized":"2023-07-21T22:18:44.342895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:49.771671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.338356+0000","last_change":"2023-07-21T22:18:44.335382+0000","last_active":"2023-07-21T22:18:44.338356+0000","last_peered":"2023-07-21T22:18:44.338356+0000","last_clean":"2023-07-21T22:18:44.338356+0000","last_became_active":"2023-07-21T22:18:44.334933+0000","last_became_peered":"2023-07-21T22:18:44.334933+0000","last_unstale":"2023-07-21T22:18:44.338356+0000","last_undegraded":"2023-07-21T22:18:44.338356+0000","last_fullsized":"2023-07-21T22:18:44.338356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:30.400997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346250+0000","last_change":"2023-07-21T22:18:44.333998+0000","last_active":"2023-07-21T22:18:44.346250+0000","last_peered":"2023-07-21T22:18:44.346250+0000","last_clean":"2023-07-21T22:18:44.346250+0000","last_became_active":"2023-07-21T22:18:44.333720+0000","last_became_peered":"2023-07-21T22:18:44.333720+0000","last_unstale":"2023-07-21T22:18:44.346250+0000","last_undegraded":"2023-07-21T22:18:44.346250+0000","last_fullsized":"2023-07-21T22:18:44.346250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:47:24.196227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.344314+0000","last_change":"2023-07-21T22:18:44.341061+0000","last_active":"2023-07-21T22:18:44.344314+0000","last_peered":"2023-07-21T22:18:44.344314+0000","last_clean":"2023-07-21T22:18:44.344314+0000","last_became_active":"2023-07-21T22:18:44.340711+0000","last_became_peered":"2023-07-21T22:18:44.340711+0000","last_unstale":"2023-07-21T22:18:44.344314+0000","last_undegraded":"2023-07-21T22:18:44.344314+0000","last_fullsized":"2023-07-21T22:18:44.344314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:43.536674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.337952+0000","last_change":"2023-07-21T22:18:44.335984+0000","last_active":"2023-07-21T22:18:44.337952+0000","last_peered":"2023-07-21T22:18:44.337952+0000","last_clean":"2023-07-21T22:18:44.337952+0000","last_became_active":"2023-07-21T22:18:44.335481+0000","last_became_peered":"2023-07-21T22:18:44.335481+0000","last_unstale":"2023-07-21T22:18:44.337952+0000","last_undegraded":"2023-07-21T22:18:44.337952+0000","last_fullsized":"2023-07-21T22:18:44.337952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:55.939872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.335467+0000","last_change":"2023-07-21T22:18:44.333526+0000","last_active":"2023-07-21T22:18:44.335467+0000","last_peered":"2023-07-21T22:18:44.335467+0000","last_clean":"2023-07-21T22:18:44.335467+0000","last_became_active":"2023-07-21T22:18:44.333139+0000","last_became_peered":"2023-07-21T22:18:44.333139+0000","last_unstale":"2023-07-21T22:18:44.335467+0000","last_undegraded":"2023-07-21T22:18:44.335467+0000","last_fullsized":"2023-07-21T22:18:44.335467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:12.868716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.342623+0000","last_change":"2023-07-21T22:18:44.339606+0000","last_active":"2023-07-21T22:18:44.342623+0000","last_peered":"2023-07-21T22:18:44.342623+0000","last_clean":"2023-07-21T22:18:44.342623+0000","last_became_active":"2023-07-21T22:18:44.339282+0000","last_became_peered":"2023-07-21T22:18:44.339282+0000","last_unstale":"2023-07-21T22:18:44.342623+0000","last_undegraded":"2023-07-21T22:18:44.342623+0000","last_fullsized":"2023-07-21T22:18:44.342623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:56:31.905250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327372+0000","last_change":"2023-07-21T22:18:44.325126+0000","last_active":"2023-07-21T22:18:44.327372+0000","last_peered":"2023-07-21T22:18:44.327372+0000","last_clean":"2023-07-21T22:18:44.327372+0000","last_became_active":"2023-07-21T22:18:44.324795+0000","last_became_peered":"2023-07-21T22:18:44.324795+0000","last_unstale":"2023-07-21T22:18:44.327372+0000","last_undegraded":"2023-07-21T22:18:44.327372+0000","last_fullsized":"2023-07-21T22:18:44.327372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:54.484564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.342627+0000","last_change":"2023-07-21T22:18:44.338316+0000","last_active":"2023-07-21T22:18:44.342627+0000","last_peered":"2023-07-21T22:18:44.342627+0000","last_clean":"2023-07-21T22:18:44.342627+0000","last_became_active":"2023-07-21T22:18:44.337895+0000","last_became_peered":"2023-07-21T22:18:44.337895+0000","last_unstale":"2023-07-21T22:18:44.342627+0000","last_undegraded":"2023-07-21T22:18:44.342627+0000","last_fullsized":"2023-07-21T22:18:44.342627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:07:40.534702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.356332+0000","last_change":"2023-07-21T22:18:44.355582+0000","last_active":"2023-07-21T22:18:44.356332+0000","last_peered":"2023-07-21T22:18:44.356332+0000","last_clean":"2023-07-21T22:18:44.356332+0000","last_became_active":"2023-07-21T22:18:44.355317+0000","last_became_peered":"2023-07-21T22:18:44.355317+0000","last_unstale":"2023-07-21T22:18:44.356332+0000","last_undegraded":"2023-07-21T22:18:44.356332+0000","last_fullsized":"2023-07-21T22:18:44.356332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:51.653402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354983+0000","last_change":"2023-07-21T22:18:44.348333+0000","last_active":"2023-07-21T22:18:44.354983+0000","last_peered":"2023-07-21T22:18:44.354983+0000","last_clean":"2023-07-21T22:18:44.354983+0000","last_became_active":"2023-07-21T22:18:44.347982+0000","last_became_peered":"2023-07-21T22:18:44.347982+0000","last_unstale":"2023-07-21T22:18:44.354983+0000","last_undegraded":"2023-07-21T22:18:44.354983+0000","last_fullsized":"2023-07-21T22:18:44.354983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:54:18.053463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.338742+0000","last_change":"2023-07-21T22:18:44.333429+0000","last_active":"2023-07-21T22:18:44.338742+0000","last_peered":"2023-07-21T22:18:44.338742+0000","last_clean":"2023-07-21T22:18:44.338742+0000","last_became_active":"2023-07-21T22:18:44.333121+0000","last_became_peered":"2023-07-21T22:18:44.333121+0000","last_unstale":"2023-07-21T22:18:44.338742+0000","last_undegraded":"2023-07-21T22:18:44.338742+0000","last_fullsized":"2023-07-21T22:18:44.338742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:05.638943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.349028+0000","last_change":"2023-07-21T22:18:44.346478+0000","last_active":"2023-07-21T22:18:44.349028+0000","last_peered":"2023-07-21T22:18:44.349028+0000","last_clean":"2023-07-21T22:18:44.349028+0000","last_became_active":"2023-07-21T22:18:44.346160+0000","last_became_peered":"2023-07-21T22:18:44.346160+0000","last_unstale":"2023-07-21T22:18:44.349028+0000","last_undegraded":"2023-07-21T22:18:44.349028+0000","last_fullsized":"2023-07-21T22:18:44.349028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:25:34.392203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.350826+0000","last_change":"2023-07-21T22:18:44.348596+0000","last_active":"2023-07-21T22:18:44.350826+0000","last_peered":"2023-07-21T22:18:44.350826+0000","last_clean":"2023-07-21T22:18:44.350826+0000","last_became_active":"2023-07-21T22:18:44.348325+0000","last_became_peered":"2023-07-21T22:18:44.348325+0000","last_unstale":"2023-07-21T22:18:44.350826+0000","last_undegraded":"2023-07-21T22:18:44.350826+0000","last_fullsized":"2023-07-21T22:18:44.350826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:38:06.965559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.339342+0000","last_change":"2023-07-21T22:18:44.335321+0000","last_active":"2023-07-21T22:18:44.339342+0000","last_peered":"2023-07-21T22:18:44.339342+0000","last_clean":"2023-07-21T22:18:44.339342+0000","last_became_active":"2023-07-21T22:18:44.334970+0000","last_became_peered":"2023-07-21T22:18:44.334970+0000","last_unstale":"2023-07-21T22:18:44.339342+0000","last_undegraded":"2023-07-21T22:18:44.339342+0000","last_fullsized":"2023-07-21T22:18:44.339342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:45.242179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.347194+0000","last_change":"2023-07-21T22:18:44.345317+0000","last_active":"2023-07-21T22:18:44.347194+0000","last_peered":"2023-07-21T22:18:44.347194+0000","last_clean":"2023-07-21T22:18:44.347194+0000","last_became_active":"2023-07-21T22:18:44.344901+0000","last_became_peered":"2023-07-21T22:18:44.344901+0000","last_unstale":"2023-07-21T22:18:44.347194+0000","last_undegraded":"2023-07-21T22:18:44.347194+0000","last_fullsized":"2023-07-21T22:18:44.347194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:05.701948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.340949+0000","last_change":"2023-07-21T22:18:44.336787+0000","last_active":"2023-07-21T22:18:44.340949+0000","last_peered":"2023-07-21T22:18:44.340949+0000","last_clean":"2023-07-21T22:18:44.340949+0000","last_became_active":"2023-07-21T22:18:44.336502+0000","last_became_peered":"2023-07-21T22:18:44.336502+0000","last_unstale":"2023-07-21T22:18:44.340949+0000","last_undegraded":"2023-07-21T22:18:44.340949+0000","last_fullsized":"2023-07-21T22:18:44.340949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:51.413018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354531+0000","last_change":"2023-07-21T22:18:44.348671+0000","last_active":"2023-07-21T22:18:44.354531+0000","last_peered":"2023-07-21T22:18:44.354531+0000","last_clean":"2023-07-21T22:18:44.354531+0000","last_became_active":"2023-07-21T22:18:44.348361+0000","last_became_peered":"2023-07-21T22:18:44.348361+0000","last_unstale":"2023-07-21T22:18:44.354531+0000","last_undegraded":"2023-07-21T22:18:44.354531+0000","last_fullsized":"2023-07-21T22:18:44.354531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:37:46.816193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.350895+0000","last_change":"2023-07-21T22:18:44.348495+0000","last_active":"2023-07-21T22:18:44.350895+0000","last_peered":"2023-07-21T22:18:44.350895+0000","last_clean":"2023-07-21T22:18:44.350895+0000","last_became_active":"2023-07-21T22:18:44.348107+0000","last_became_peered":"2023-07-21T22:18:44.348107+0000","last_unstale":"2023-07-21T22:18:44.350895+0000","last_undegraded":"2023-07-21T22:18:44.350895+0000","last_fullsized":"2023-07-21T22:18:44.350895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:45:41.479888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.353726+0000","last_change":"2023-07-21T22:18:44.342060+0000","last_active":"2023-07-21T22:18:44.353726+0000","last_peered":"2023-07-21T22:18:44.353726+0000","last_clean":"2023-07-21T22:18:44.353726+0000","last_became_active":"2023-07-21T22:18:44.341767+0000","last_became_peered":"2023-07-21T22:18:44.341767+0000","last_unstale":"2023-07-21T22:18:44.353726+0000","last_undegraded":"2023-07-21T22:18:44.353726+0000","last_fullsized":"2023-07-21T22:18:44.353726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:51.413018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":24,"state":"creating+peering","last_fresh":"2023-07-21T22:18:43.318779+0000","last_change":"2023-07-21T22:18:43.318779+0000","last_active":"2023-07-21T22:18:43.300562+0000","last_peered":"2023-07-21T22:18:43.300562+0000","last_clean":"2023-07-21T22:18:43.300562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:18:43.318779+0000","last_undegraded":"2023-07-21T22:18:43.318779+0000","last_fullsized":"2023-07-21T22:18:43.318779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348765+0000","last_change":"2023-07-21T22:18:44.338017+0000","last_active":"2023-07-21T22:18:44.348765+0000","last_peered":"2023-07-21T22:18:44.348765+0000","last_clean":"2023-07-21T22:18:44.348765+0000","last_became_active":"2023-07-21T22:18:44.337215+0000","last_became_peered":"2023-07-21T22:18:44.337215+0000","last_unstale":"2023-07-21T22:18:44.348765+0000","last_undegraded":"2023-07-21T22:18:44.348765+0000","last_fullsized":"2023-07-21T22:18:44.348765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:13:17.888290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.544481+0000","last_change":"2023-07-21T22:18:43.345411+0000","last_active":"2023-07-21T22:18:44.544481+0000","last_peered":"2023-07-21T22:18:44.544481+0000","last_clean":"2023-07-21T22:18:44.544481+0000","last_became_active":"2023-07-21T22:18:43.345095+0000","last_became_peered":"2023-07-21T22:18:43.345095+0000","last_unstale":"2023-07-21T22:18:44.544481+0000","last_undegraded":"2023-07-21T22:18:44.544481+0000","last_fullsized":"2023-07-21T22:18:44.544481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:40:45.106399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.347173+0000","last_change":"2023-07-21T22:18:44.345111+0000","last_active":"2023-07-21T22:18:44.347173+0000","last_peered":"2023-07-21T22:18:44.347173+0000","last_clean":"2023-07-21T22:18:44.347173+0000","last_became_active":"2023-07-21T22:18:44.344325+0000","last_became_peered":"2023-07-21T22:18:44.344325+0000","last_unstale":"2023-07-21T22:18:44.347173+0000","last_undegraded":"2023-07-21T22:18:44.347173+0000","last_fullsized":"2023-07-21T22:18:44.347173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:26.300457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327919+0000","last_change":"2023-07-21T22:18:43.340538+0000","last_active":"2023-07-21T22:18:44.327919+0000","last_peered":"2023-07-21T22:18:44.327919+0000","last_clean":"2023-07-21T22:18:44.327919+0000","last_became_active":"2023-07-21T22:18:43.340172+0000","last_became_peered":"2023-07-21T22:18:43.340172+0000","last_unstale":"2023-07-21T22:18:44.327919+0000","last_undegraded":"2023-07-21T22:18:44.327919+0000","last_fullsized":"2023-07-21T22:18:44.327919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:26:53.788877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.343008+0000","last_change":"2023-07-21T22:18:44.342020+0000","last_active":"2023-07-21T22:18:44.343008+0000","last_peered":"2023-07-21T22:18:44.343008+0000","last_clean":"2023-07-21T22:18:44.343008+0000","last_became_active":"2023-07-21T22:18:44.341724+0000","last_became_peered":"2023-07-21T22:18:44.341724+0000","last_unstale":"2023-07-21T22:18:44.343008+0000","last_undegraded":"2023-07-21T22:18:44.343008+0000","last_fullsized":"2023-07-21T22:18:44.343008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:57:20.260229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.331377+0000","last_change":"2023-07-21T22:18:43.337771+0000","last_active":"2023-07-21T22:18:44.331377+0000","last_peered":"2023-07-21T22:18:44.331377+0000","last_clean":"2023-07-21T22:18:44.331377+0000","last_became_active":"2023-07-21T22:18:43.337480+0000","last_became_peered":"2023-07-21T22:18:43.337480+0000","last_unstale":"2023-07-21T22:18:44.331377+0000","last_undegraded":"2023-07-21T22:18:44.331377+0000","last_fullsized":"2023-07-21T22:18:44.331377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:44:35.365564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.355676+0000","last_change":"2023-07-21T22:18:44.349625+0000","last_active":"2023-07-21T22:18:44.355676+0000","last_peered":"2023-07-21T22:18:44.355676+0000","last_clean":"2023-07-21T22:18:44.355676+0000","last_became_active":"2023-07-21T22:18:44.349046+0000","last_became_peered":"2023-07-21T22:18:44.349046+0000","last_unstale":"2023-07-21T22:18:44.355676+0000","last_undegraded":"2023-07-21T22:18:44.355676+0000","last_fullsized":"2023-07-21T22:18:44.355676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:26:54.799948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T22:18:43.349137+0000","last_change":"2023-07-21T22:18:43.344968+0000","last_active":"2023-07-21T22:18:43.349137+0000","last_peered":"2023-07-21T22:18:43.349137+0000","last_clean":"2023-07-21T22:18:43.349137+0000","last_became_active":"2023-07-21T22:18:43.344570+0000","last_became_peered":"2023-07-21T22:18:43.344570+0000","last_unstale":"2023-07-21T22:18:43.349137+0000","last_undegraded":"2023-07-21T22:18:43.349137+0000","last_fullsized":"2023-07-21T22:18:43.349137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:48.760601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.544297+0000","last_change":"2023-07-21T22:18:43.348215+0000","last_active":"2023-07-21T22:18:44.544297+0000","last_peered":"2023-07-21T22:18:44.544297+0000","last_clean":"2023-07-21T22:18:44.544297+0000","last_became_active":"2023-07-21T22:18:43.347858+0000","last_became_peered":"2023-07-21T22:18:43.347858+0000","last_unstale":"2023-07-21T22:18:44.544297+0000","last_undegraded":"2023-07-21T22:18:44.544297+0000","last_fullsized":"2023-07-21T22:18:44.544297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:25.289386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346430+0000","last_change":"2023-07-21T22:18:44.341650+0000","last_active":"2023-07-21T22:18:44.346430+0000","last_peered":"2023-07-21T22:18:44.346430+0000","last_clean":"2023-07-21T22:18:44.346430+0000","last_became_active":"2023-07-21T22:18:44.341352+0000","last_became_peered":"2023-07-21T22:18:44.341352+0000","last_unstale":"2023-07-21T22:18:44.346430+0000","last_undegraded":"2023-07-21T22:18:44.346430+0000","last_fullsized":"2023-07-21T22:18:44.346430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:16:43.932507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.543980+0000","last_change":"2023-07-21T22:18:43.348256+0000","last_active":"2023-07-21T22:18:44.543980+0000","last_peered":"2023-07-21T22:18:44.543980+0000","last_clean":"2023-07-21T22:18:44.543980+0000","last_became_active":"2023-07-21T22:18:43.347754+0000","last_became_peered":"2023-07-21T22:18:43.347754+0000","last_unstale":"2023-07-21T22:18:44.543980+0000","last_undegraded":"2023-07-21T22:18:44.543980+0000","last_fullsized":"2023-07-21T22:18:44.543980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:29:22.726274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354180+0000","last_change":"2023-07-21T22:18:44.353012+0000","last_active":"2023-07-21T22:18:44.354180+0000","last_peered":"2023-07-21T22:18:44.354180+0000","last_clean":"2023-07-21T22:18:44.354180+0000","last_became_active":"2023-07-21T22:18:44.352586+0000","last_became_peered":"2023-07-21T22:18:44.352586+0000","last_unstale":"2023-07-21T22:18:44.354180+0000","last_undegraded":"2023-07-21T22:18:44.354180+0000","last_fullsized":"2023-07-21T22:18:44.354180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:53:39.587668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"25'1","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.545116+0000","last_change":"2023-07-21T22:18:43.338600+0000","last_active":"2023-07-21T22:18:44.545116+0000","last_peered":"2023-07-21T22:18:44.545116+0000","last_clean":"2023-07-21T22:18:44.545116+0000","last_became_active":"2023-07-21T22:18:43.338271+0000","last_became_peered":"2023-07-21T22:18:43.338271+0000","last_unstale":"2023-07-21T22:18:44.545116+0000","last_undegraded":"2023-07-21T22:18:44.545116+0000","last_fullsized":"2023-07-21T22:18:44.545116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:49.375113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":24,"state":"creating+peering","last_fresh":"2023-07-21T22:18:43.318984+0000","last_change":"2023-07-21T22:18:43.318984+0000","last_active":"2023-07-21T22:18:43.300562+0000","last_peered":"2023-07-21T22:18:43.300562+0000","last_clean":"2023-07-21T22:18:43.300562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:18:43.318984+0000","last_undegraded":"2023-07-21T22:18:43.318984+0000","last_fullsized":"2023-07-21T22:18:43.318984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.322602+0000","last_change":"2023-07-21T22:18:43.339272+0000","last_active":"2023-07-21T22:18:44.322602+0000","last_peered":"2023-07-21T22:18:44.322602+0000","last_clean":"2023-07-21T22:18:44.322602+0000","last_became_active":"2023-07-21T22:18:43.338864+0000","last_became_peered":"2023-07-21T22:18:43.338864+0000","last_unstale":"2023-07-21T22:18:44.322602+0000","last_undegraded":"2023-07-21T22:18:44.322602+0000","last_fullsized":"2023-07-21T22:18:44.322602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:21:31.802323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354956+0000","last_change":"2023-07-21T22:18:44.347783+0000","last_active":"2023-07-21T22:18:44.354956+0000","last_peered":"2023-07-21T22:18:44.354956+0000","last_clean":"2023-07-21T22:18:44.354956+0000","last_became_active":"2023-07-21T22:18:44.347417+0000","last_became_peered":"2023-07-21T22:18:44.347417+0000","last_unstale":"2023-07-21T22:18:44.354956+0000","last_undegraded":"2023-07-21T22:18:44.354956+0000","last_fullsized":"2023-07-21T22:18:44.354956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:13:17.888290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.539367+0000","last_change":"2023-07-21T22:18:43.341666+0000","last_active":"2023-07-21T22:18:44.539367+0000","last_peered":"2023-07-21T22:18:44.539367+0000","last_clean":"2023-07-21T22:18:44.539367+0000","last_became_active":"2023-07-21T22:18:43.341287+0000","last_became_peered":"2023-07-21T22:18:43.341287+0000","last_unstale":"2023-07-21T22:18:44.539367+0000","last_undegraded":"2023-07-21T22:18:44.539367+0000","last_fullsized":"2023-07-21T22:18:44.539367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:28.967479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348446+0000","last_change":"2023-07-21T22:18:44.345773+0000","last_active":"2023-07-21T22:18:44.348446+0000","last_peered":"2023-07-21T22:18:44.348446+0000","last_clean":"2023-07-21T22:18:44.348446+0000","last_became_active":"2023-07-21T22:18:44.345494+0000","last_became_peered":"2023-07-21T22:18:44.345494+0000","last_unstale":"2023-07-21T22:18:44.348446+0000","last_undegraded":"2023-07-21T22:18:44.348446+0000","last_fullsized":"2023-07-21T22:18:44.348446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:18:32.374919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T22:18:43.349108+0000","last_change":"2023-07-21T22:18:43.346587+0000","last_active":"2023-07-21T22:18:43.349108+0000","last_peered":"2023-07-21T22:18:43.349108+0000","last_clean":"2023-07-21T22:18:43.349108+0000","last_became_active":"2023-07-21T22:18:43.346170+0000","last_became_peered":"2023-07-21T22:18:43.346170+0000","last_unstale":"2023-07-21T22:18:43.349108+0000","last_undegraded":"2023-07-21T22:18:43.349108+0000","last_fullsized":"2023-07-21T22:18:43.349108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:29.389926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.342644+0000","last_change":"2023-07-21T22:18:44.339550+0000","last_active":"2023-07-21T22:18:44.342644+0000","last_peered":"2023-07-21T22:18:44.342644+0000","last_clean":"2023-07-21T22:18:44.342644+0000","last_became_active":"2023-07-21T22:18:44.339232+0000","last_became_peered":"2023-07-21T22:18:44.339232+0000","last_unstale":"2023-07-21T22:18:44.342644+0000","last_undegraded":"2023-07-21T22:18:44.342644+0000","last_fullsized":"2023-07-21T22:18:44.342644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:06:33.367363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.331764+0000","last_change":"2023-07-21T22:18:43.342021+0000","last_active":"2023-07-21T22:18:44.331764+0000","last_peered":"2023-07-21T22:18:44.331764+0000","last_clean":"2023-07-21T22:18:44.331764+0000","last_became_active":"2023-07-21T22:18:43.340494+0000","last_became_peered":"2023-07-21T22:18:43.340494+0000","last_unstale":"2023-07-21T22:18:44.331764+0000","last_undegraded":"2023-07-21T22:18:44.331764+0000","last_fullsized":"2023-07-21T22:18:44.331764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:43.109494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.350920+0000","last_change":"2023-07-21T22:18:44.349404+0000","last_active":"2023-07-21T22:18:44.350920+0000","last_peered":"2023-07-21T22:18:44.350920+0000","last_clean":"2023-07-21T22:18:44.350920+0000","last_became_active":"2023-07-21T22:18:44.348314+0000","last_became_peered":"2023-07-21T22:18:44.348314+0000","last_unstale":"2023-07-21T22:18:44.350920+0000","last_undegraded":"2023-07-21T22:18:44.350920+0000","last_fullsized":"2023-07-21T22:18:44.350920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:07:37.786708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.329935+0000","last_change":"2023-07-21T22:18:43.329711+0000","last_active":"2023-07-21T22:18:44.329935+0000","last_peered":"2023-07-21T22:18:44.329935+0000","last_clean":"2023-07-21T22:18:44.329935+0000","last_became_active":"2023-07-21T22:18:43.329184+0000","last_became_peered":"2023-07-21T22:18:43.329184+0000","last_unstale":"2023-07-21T22:18:44.329935+0000","last_undegraded":"2023-07-21T22:18:44.329935+0000","last_fullsized":"2023-07-21T22:18:44.329935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:44.231108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.355627+0000","last_change":"2023-07-21T22:18:44.354431+0000","last_active":"2023-07-21T22:18:44.355627+0000","last_peered":"2023-07-21T22:18:44.355627+0000","last_clean":"2023-07-21T22:18:44.355627+0000","last_became_active":"2023-07-21T22:18:44.354063+0000","last_became_peered":"2023-07-21T22:18:44.354063+0000","last_unstale":"2023-07-21T22:18:44.355627+0000","last_undegraded":"2023-07-21T22:18:44.355627+0000","last_fullsized":"2023-07-21T22:18:44.355627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:30:07.924076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":173,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.328122+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:18:44.328122+0000","last_peered":"2023-07-21T22:18:44.328122+0000","last_clean":"2023-07-21T22:18:44.328122+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:18:44.328122+0000","last_undegraded":"2023-07-21T22:18:44.328122+0000","last_fullsized":"2023-07-21T22:18:44.328122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:10:20.968928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.321937+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:18:44.321937+0000","last_peered":"2023-07-21T22:18:44.321937+0000","last_clean":"2023-07-21T22:18:44.321937+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:18:44.321937+0000","last_undegraded":"2023-07-21T22:18:44.321937+0000","last_fullsized":"2023-07-21T22:18:44.321937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:48:50.039471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.330287+0000","last_change":"2023-07-21T22:18:43.327625+0000","last_active":"2023-07-21T22:18:44.330287+0000","last_peered":"2023-07-21T22:18:44.330287+0000","last_clean":"2023-07-21T22:18:44.330287+0000","last_became_active":"2023-07-21T22:18:43.327272+0000","last_became_peered":"2023-07-21T22:18:43.327272+0000","last_unstale":"2023-07-21T22:18:44.330287+0000","last_undegraded":"2023-07-21T22:18:44.330287+0000","last_fullsized":"2023-07-21T22:18:44.330287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:30:06.913006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":24,"state":"creating+peering","last_fresh":"2023-07-21T22:18:43.319528+0000","last_change":"2023-07-21T22:18:43.319528+0000","last_active":"2023-07-21T22:18:43.300562+0000","last_peered":"2023-07-21T22:18:43.300562+0000","last_clean":"2023-07-21T22:18:43.300562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:18:43.319528+0000","last_undegraded":"2023-07-21T22:18:43.319528+0000","last_fullsized":"2023-07-21T22:18:43.319528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327999+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:18:44.327999+0000","last_peered":"2023-07-21T22:18:44.327999+0000","last_clean":"2023-07-21T22:18:44.327999+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:18:44.327999+0000","last_undegraded":"2023-07-21T22:18:44.327999+0000","last_fullsized":"2023-07-21T22:18:44.327999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:24:03.249599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327761+0000","last_change":"2023-07-21T22:18:43.344180+0000","last_active":"2023-07-21T22:18:44.327761+0000","last_peered":"2023-07-21T22:18:44.327761+0000","last_clean":"2023-07-21T22:18:44.327761+0000","last_became_active":"2023-07-21T22:18:43.343831+0000","last_became_peered":"2023-07-21T22:18:43.343831+0000","last_unstale":"2023-07-21T22:18:44.327761+0000","last_undegraded":"2023-07-21T22:18:44.327761+0000","last_fullsized":"2023-07-21T22:18:44.327761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:04.627872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354946+0000","last_change":"2023-07-21T22:18:44.347759+0000","last_active":"2023-07-21T22:18:44.354946+0000","last_peered":"2023-07-21T22:18:44.354946+0000","last_clean":"2023-07-21T22:18:44.354946+0000","last_became_active":"2023-07-21T22:18:44.347416+0000","last_became_peered":"2023-07-21T22:18:44.347416+0000","last_unstale":"2023-07-21T22:18:44.354946+0000","last_undegraded":"2023-07-21T22:18:44.354946+0000","last_fullsized":"2023-07-21T22:18:44.354946+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:12:36.391754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.318179+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:18:44.318179+0000","last_peered":"2023-07-21T22:18:44.318179+0000","last_clean":"2023-07-21T22:18:44.318179+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:18:44.318179+0000","last_undegraded":"2023-07-21T22:18:44.318179+0000","last_fullsized":"2023-07-21T22:18:44.318179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:06.825003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.321356+0000","last_change":"2023-07-21T22:18:43.332573+0000","last_active":"2023-07-21T22:18:44.321356+0000","last_peered":"2023-07-21T22:18:44.321356+0000","last_clean":"2023-07-21T22:18:44.321356+0000","last_became_active":"2023-07-21T22:18:43.331774+0000","last_became_peered":"2023-07-21T22:18:43.331774+0000","last_unstale":"2023-07-21T22:18:44.321356+0000","last_undegraded":"2023-07-21T22:18:44.321356+0000","last_fullsized":"2023-07-21T22:18:44.321356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:04.627872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.349586+0000","last_change":"2023-07-21T22:18:44.344092+0000","last_active":"2023-07-21T22:18:44.349586+0000","last_peered":"2023-07-21T22:18:44.349586+0000","last_clean":"2023-07-21T22:18:44.349586+0000","last_became_active":"2023-07-21T22:18:44.343819+0000","last_became_peered":"2023-07-21T22:18:44.343819+0000","last_unstale":"2023-07-21T22:18:44.349586+0000","last_undegraded":"2023-07-21T22:18:44.349586+0000","last_fullsized":"2023-07-21T22:18:44.349586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:03:22.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.324241+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:18:44.324241+0000","last_peered":"2023-07-21T22:18:44.324241+0000","last_clean":"2023-07-21T22:18:44.324241+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:18:44.324241+0000","last_undegraded":"2023-07-21T22:18:44.324241+0000","last_fullsized":"2023-07-21T22:18:44.324241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:45:35.436175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.330825+0000","last_change":"2023-07-21T22:18:43.347890+0000","last_active":"2023-07-21T22:18:44.330825+0000","last_peered":"2023-07-21T22:18:44.330825+0000","last_clean":"2023-07-21T22:18:44.330825+0000","last_became_active":"2023-07-21T22:18:43.347529+0000","last_became_peered":"2023-07-21T22:18:43.347529+0000","last_unstale":"2023-07-21T22:18:44.330825+0000","last_undegraded":"2023-07-21T22:18:44.330825+0000","last_fullsized":"2023-07-21T22:18:44.330825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:47:23.185156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.349943+0000","last_change":"2023-07-21T22:18:44.345749+0000","last_active":"2023-07-21T22:18:44.349943+0000","last_peered":"2023-07-21T22:18:44.349943+0000","last_clean":"2023-07-21T22:18:44.349943+0000","last_became_active":"2023-07-21T22:18:44.345413+0000","last_became_peered":"2023-07-21T22:18:44.345413+0000","last_unstale":"2023-07-21T22:18:44.349943+0000","last_undegraded":"2023-07-21T22:18:44.349943+0000","last_fullsized":"2023-07-21T22:18:44.349943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:42.552801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.328401+0000","last_change":"2023-07-21T22:18:43.339680+0000","last_active":"2023-07-21T22:18:44.328401+0000","last_peered":"2023-07-21T22:18:44.328401+0000","last_clean":"2023-07-21T22:18:44.328401+0000","last_became_active":"2023-07-21T22:18:43.339369+0000","last_became_peered":"2023-07-21T22:18:43.339369+0000","last_unstale":"2023-07-21T22:18:44.328401+0000","last_undegraded":"2023-07-21T22:18:44.328401+0000","last_fullsized":"2023-07-21T22:18:44.328401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:49.375113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327311+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:18:44.327311+0000","last_peered":"2023-07-21T22:18:44.327311+0000","last_clean":"2023-07-21T22:18:44.327311+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:18:44.327311+0000","last_undegraded":"2023-07-21T22:18:44.327311+0000","last_fullsized":"2023-07-21T22:18:44.327311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:21.376438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.349907+0000","last_change":"2023-07-21T22:18:44.345981+0000","last_active":"2023-07-21T22:18:44.349907+0000","last_peered":"2023-07-21T22:18:44.349907+0000","last_clean":"2023-07-21T22:18:44.349907+0000","last_became_active":"2023-07-21T22:18:44.345650+0000","last_became_peered":"2023-07-21T22:18:44.345650+0000","last_unstale":"2023-07-21T22:18:44.349907+0000","last_undegraded":"2023-07-21T22:18:44.349907+0000","last_fullsized":"2023-07-21T22:18:44.349907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:29.978550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327210+0000","last_change":"2023-07-21T22:18:43.336788+0000","last_active":"2023-07-21T22:18:44.327210+0000","last_peered":"2023-07-21T22:18:44.327210+0000","last_clean":"2023-07-21T22:18:44.327210+0000","last_became_active":"2023-07-21T22:18:43.336357+0000","last_became_peered":"2023-07-21T22:18:43.336357+0000","last_unstale":"2023-07-21T22:18:44.327210+0000","last_undegraded":"2023-07-21T22:18:44.327210+0000","last_fullsized":"2023-07-21T22:18:44.327210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:29.106844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327443+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:18:44.327443+0000","last_peered":"2023-07-21T22:18:44.327443+0000","last_clean":"2023-07-21T22:18:44.327443+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:18:44.327443+0000","last_undegraded":"2023-07-21T22:18:44.327443+0000","last_fullsized":"2023-07-21T22:18:44.327443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:50:59.658234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346914+0000","last_change":"2023-07-21T22:18:44.345851+0000","last_active":"2023-07-21T22:18:44.346914+0000","last_peered":"2023-07-21T22:18:44.346914+0000","last_clean":"2023-07-21T22:18:44.346914+0000","last_became_active":"2023-07-21T22:18:44.345553+0000","last_became_peered":"2023-07-21T22:18:44.345553+0000","last_unstale":"2023-07-21T22:18:44.346914+0000","last_undegraded":"2023-07-21T22:18:44.346914+0000","last_fullsized":"2023-07-21T22:18:44.346914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:37:46.816193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.545191+0000","last_change":"2023-07-21T22:18:43.335304+0000","last_active":"2023-07-21T22:18:44.545191+0000","last_peered":"2023-07-21T22:18:44.545191+0000","last_clean":"2023-07-21T22:18:44.545191+0000","last_became_active":"2023-07-21T22:18:43.334929+0000","last_became_peered":"2023-07-21T22:18:43.334929+0000","last_unstale":"2023-07-21T22:18:44.545191+0000","last_undegraded":"2023-07-21T22:18:44.545191+0000","last_fullsized":"2023-07-21T22:18:44.545191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:25.997043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.322299+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:18:44.322299+0000","last_peered":"2023-07-21T22:18:44.322299+0000","last_clean":"2023-07-21T22:18:44.322299+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:18:44.322299+0000","last_undegraded":"2023-07-21T22:18:44.322299+0000","last_fullsized":"2023-07-21T22:18:44.322299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:49.800708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.353585+0000","last_change":"2023-07-21T22:18:44.341231+0000","last_active":"2023-07-21T22:18:44.353585+0000","last_peered":"2023-07-21T22:18:44.353585+0000","last_clean":"2023-07-21T22:18:44.353585+0000","last_became_active":"2023-07-21T22:18:44.340874+0000","last_became_peered":"2023-07-21T22:18:44.340874+0000","last_unstale":"2023-07-21T22:18:44.353585+0000","last_undegraded":"2023-07-21T22:18:44.353585+0000","last_fullsized":"2023-07-21T22:18:44.353585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:54:18.053463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.332682+0000","last_change":"2023-07-21T22:18:43.340557+0000","last_active":"2023-07-21T22:18:44.332682+0000","last_peered":"2023-07-21T22:18:44.332682+0000","last_clean":"2023-07-21T22:18:44.332682+0000","last_became_active":"2023-07-21T22:18:43.340199+0000","last_became_peered":"2023-07-21T22:18:43.340199+0000","last_unstale":"2023-07-21T22:18:44.332682+0000","last_undegraded":"2023-07-21T22:18:44.332682+0000","last_fullsized":"2023-07-21T22:18:44.332682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:54.833351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T22:18:43.323742+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:18:43.323742+0000","last_peered":"2023-07-21T22:18:43.323742+0000","last_clean":"2023-07-21T22:18:43.323742+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:18:43.323742+0000","last_undegraded":"2023-07-21T22:18:43.323742+0000","last_fullsized":"2023-07-21T22:18:43.323742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:54:12.009749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.350300+0000","last_change":"2023-07-21T22:18:44.347206+0000","last_active":"2023-07-21T22:18:44.350300+0000","last_peered":"2023-07-21T22:18:44.350300+0000","last_clean":"2023-07-21T22:18:44.350300+0000","last_became_active":"2023-07-21T22:18:44.346914+0000","last_became_peered":"2023-07-21T22:18:44.346914+0000","last_unstale":"2023-07-21T22:18:44.350300+0000","last_undegraded":"2023-07-21T22:18:44.350300+0000","last_fullsized":"2023-07-21T22:18:44.350300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:47:23.190588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348379+0000","last_change":"2023-07-21T22:18:44.343986+0000","last_active":"2023-07-21T22:18:44.348379+0000","last_peered":"2023-07-21T22:18:44.348379+0000","last_clean":"2023-07-21T22:18:44.348379+0000","last_became_active":"2023-07-21T22:18:44.342943+0000","last_became_peered":"2023-07-21T22:18:44.342943+0000","last_unstale":"2023-07-21T22:18:44.348379+0000","last_undegraded":"2023-07-21T22:18:44.348379+0000","last_fullsized":"2023-07-21T22:18:44.348379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:25:56.912736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"25'6","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.551448+0000","last_change":"2023-07-21T22:18:43.336129+0000","last_active":"2023-07-21T22:18:44.551448+0000","last_peered":"2023-07-21T22:18:44.551448+0000","last_clean":"2023-07-21T22:18:44.551448+0000","last_became_active":"2023-07-21T22:18:43.335850+0000","last_became_peered":"2023-07-21T22:18:43.335850+0000","last_unstale":"2023-07-21T22:18:44.551448+0000","last_undegraded":"2023-07-21T22:18:44.551448+0000","last_fullsized":"2023-07-21T22:18:44.551448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:21:31.802323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.353149+0000","last_change":"2023-07-21T22:18:44.351088+0000","last_active":"2023-07-21T22:18:44.353149+0000","last_peered":"2023-07-21T22:18:44.353149+0000","last_clean":"2023-07-21T22:18:44.353149+0000","last_became_active":"2023-07-21T22:18:44.350791+0000","last_became_peered":"2023-07-21T22:18:44.350791+0000","last_unstale":"2023-07-21T22:18:44.353149+0000","last_undegraded":"2023-07-21T22:18:44.353149+0000","last_fullsized":"2023-07-21T22:18:44.353149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:27.008113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"25'3","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.544002+0000","last_change":"2023-07-21T22:18:43.340832+0000","last_active":"2023-07-21T22:18:44.544002+0000","last_peered":"2023-07-21T22:18:44.544002+0000","last_clean":"2023-07-21T22:18:44.544002+0000","last_became_active":"2023-07-21T22:18:43.340519+0000","last_became_peered":"2023-07-21T22:18:43.340519+0000","last_unstale":"2023-07-21T22:18:44.544002+0000","last_undegraded":"2023-07-21T22:18:44.544002+0000","last_fullsized":"2023-07-21T22:18:44.544002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:59:20.160352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327327+0000","last_change":"2023-07-21T22:18:43.335834+0000","last_active":"2023-07-21T22:18:44.327327+0000","last_peered":"2023-07-21T22:18:44.327327+0000","last_clean":"2023-07-21T22:18:44.327327+0000","last_became_active":"2023-07-21T22:18:43.335518+0000","last_became_peered":"2023-07-21T22:18:43.335518+0000","last_unstale":"2023-07-21T22:18:44.327327+0000","last_undegraded":"2023-07-21T22:18:44.327327+0000","last_fullsized":"2023-07-21T22:18:44.327327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:59:20.160352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354632+0000","last_change":"2023-07-21T22:18:44.349059+0000","last_active":"2023-07-21T22:18:44.354632+0000","last_peered":"2023-07-21T22:18:44.354632+0000","last_clean":"2023-07-21T22:18:44.354632+0000","last_became_active":"2023-07-21T22:18:44.348691+0000","last_became_peered":"2023-07-21T22:18:44.348691+0000","last_unstale":"2023-07-21T22:18:44.354632+0000","last_undegraded":"2023-07-21T22:18:44.354632+0000","last_fullsized":"2023-07-21T22:18:44.354632+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:12:36.391754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.331983+0000","last_change":"2023-07-21T22:18:43.341273+0000","last_active":"2023-07-21T22:18:44.331983+0000","last_peered":"2023-07-21T22:18:44.331983+0000","last_clean":"2023-07-21T22:18:44.331983+0000","last_became_active":"2023-07-21T22:18:43.340594+0000","last_became_peered":"2023-07-21T22:18:43.340594+0000","last_unstale":"2023-07-21T22:18:44.331983+0000","last_undegraded":"2023-07-21T22:18:44.331983+0000","last_fullsized":"2023-07-21T22:18:44.331983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:30:06.913006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.353533+0000","last_change":"2023-07-21T22:18:44.341063+0000","last_active":"2023-07-21T22:18:44.353533+0000","last_peered":"2023-07-21T22:18:44.353533+0000","last_clean":"2023-07-21T22:18:44.353533+0000","last_became_active":"2023-07-21T22:18:44.337396+0000","last_became_peered":"2023-07-21T22:18:44.337396+0000","last_unstale":"2023-07-21T22:18:44.353533+0000","last_undegraded":"2023-07-21T22:18:44.353533+0000","last_fullsized":"2023-07-21T22:18:44.353533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:54.484564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":24,"state":"creating+peering","last_fresh":"2023-07-21T22:18:43.319518+0000","last_change":"2023-07-21T22:18:43.319518+0000","last_active":"2023-07-21T22:18:43.300562+0000","last_peered":"2023-07-21T22:18:43.300562+0000","last_clean":"2023-07-21T22:18:43.300562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:18:43.319518+0000","last_undegraded":"2023-07-21T22:18:43.319518+0000","last_fullsized":"2023-07-21T22:18:43.319518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.329796+0000","last_change":"2023-07-21T22:18:43.341804+0000","last_active":"2023-07-21T22:18:44.329796+0000","last_peered":"2023-07-21T22:18:44.329796+0000","last_clean":"2023-07-21T22:18:44.329796+0000","last_became_active":"2023-07-21T22:18:43.341205+0000","last_became_peered":"2023-07-21T22:18:43.341205+0000","last_unstale":"2023-07-21T22:18:44.329796+0000","last_undegraded":"2023-07-21T22:18:44.329796+0000","last_fullsized":"2023-07-21T22:18:44.329796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:03:21.376838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.339571+0000","last_change":"2023-07-21T22:18:44.338013+0000","last_active":"2023-07-21T22:18:44.339571+0000","last_peered":"2023-07-21T22:18:44.339571+0000","last_clean":"2023-07-21T22:18:44.339571+0000","last_became_active":"2023-07-21T22:18:44.337701+0000","last_became_peered":"2023-07-21T22:18:44.337701+0000","last_unstale":"2023-07-21T22:18:44.339571+0000","last_undegraded":"2023-07-21T22:18:44.339571+0000","last_fullsized":"2023-07-21T22:18:44.339571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:51.413018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.321576+0000","last_change":"2023-07-21T22:18:43.337656+0000","last_active":"2023-07-21T22:18:44.321576+0000","last_peered":"2023-07-21T22:18:44.321576+0000","last_clean":"2023-07-21T22:18:44.321576+0000","last_became_active":"2023-07-21T22:18:43.337228+0000","last_became_peered":"2023-07-21T22:18:43.337228+0000","last_unstale":"2023-07-21T22:18:44.321576+0000","last_undegraded":"2023-07-21T22:18:44.321576+0000","last_fullsized":"2023-07-21T22:18:44.321576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:26:53.788877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348787+0000","last_change":"2023-07-21T22:18:44.337074+0000","last_active":"2023-07-21T22:18:44.348787+0000","last_peered":"2023-07-21T22:18:44.348787+0000","last_clean":"2023-07-21T22:18:44.348787+0000","last_became_active":"2023-07-21T22:18:44.336374+0000","last_became_peered":"2023-07-21T22:18:44.336374+0000","last_unstale":"2023-07-21T22:18:44.348787+0000","last_undegraded":"2023-07-21T22:18:44.348787+0000","last_fullsized":"2023-07-21T22:18:44.348787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:12.868716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"25'1","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.545999+0000","last_change":"2023-07-21T22:18:43.343871+0000","last_active":"2023-07-21T22:18:44.545999+0000","last_peered":"2023-07-21T22:18:44.545999+0000","last_clean":"2023-07-21T22:18:44.545999+0000","last_became_active":"2023-07-21T22:18:43.342848+0000","last_became_peered":"2023-07-21T22:18:43.342848+0000","last_unstale":"2023-07-21T22:18:44.545999+0000","last_undegraded":"2023-07-21T22:18:44.545999+0000","last_fullsized":"2023-07-21T22:18:44.545999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:19.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.342991+0000","last_change":"2023-07-21T22:18:44.338868+0000","last_active":"2023-07-21T22:18:44.342991+0000","last_peered":"2023-07-21T22:18:44.342991+0000","last_clean":"2023-07-21T22:18:44.342991+0000","last_became_active":"2023-07-21T22:18:44.337629+0000","last_became_peered":"2023-07-21T22:18:44.337629+0000","last_unstale":"2023-07-21T22:18:44.342991+0000","last_undegraded":"2023-07-21T22:18:44.342991+0000","last_fullsized":"2023-07-21T22:18:44.342991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:54:18.053463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"25'1","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.538568+0000","last_change":"2023-07-21T22:18:43.347419+0000","last_active":"2023-07-21T22:18:44.538568+0000","last_peered":"2023-07-21T22:18:44.538568+0000","last_clean":"2023-07-21T22:18:44.538568+0000","last_became_active":"2023-07-21T22:18:43.347118+0000","last_became_peered":"2023-07-21T22:18:43.347118+0000","last_unstale":"2023-07-21T22:18:44.538568+0000","last_undegraded":"2023-07-21T22:18:44.538568+0000","last_fullsized":"2023-07-21T22:18:44.538568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:03:21.376838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348407+0000","last_change":"2023-07-21T22:18:44.345638+0000","last_active":"2023-07-21T22:18:44.348407+0000","last_peered":"2023-07-21T22:18:44.348407+0000","last_clean":"2023-07-21T22:18:44.348407+0000","last_became_active":"2023-07-21T22:18:44.345310+0000","last_became_peered":"2023-07-21T22:18:44.345310+0000","last_unstale":"2023-07-21T22:18:44.348407+0000","last_undegraded":"2023-07-21T22:18:44.348407+0000","last_fullsized":"2023-07-21T22:18:44.348407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:30:26.113148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.545323+0000","last_change":"2023-07-21T22:18:43.345885+0000","last_active":"2023-07-21T22:18:44.545323+0000","last_peered":"2023-07-21T22:18:44.545323+0000","last_clean":"2023-07-21T22:18:44.545323+0000","last_became_active":"2023-07-21T22:18:43.345540+0000","last_became_peered":"2023-07-21T22:18:43.345540+0000","last_unstale":"2023-07-21T22:18:44.545323+0000","last_undegraded":"2023-07-21T22:18:44.545323+0000","last_fullsized":"2023-07-21T22:18:44.545323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:23:16.582471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348486+0000","last_change":"2023-07-21T22:18:44.346068+0000","last_active":"2023-07-21T22:18:44.348486+0000","last_peered":"2023-07-21T22:18:44.348486+0000","last_clean":"2023-07-21T22:18:44.348486+0000","last_became_active":"2023-07-21T22:18:44.345741+0000","last_became_peered":"2023-07-21T22:18:44.345741+0000","last_unstale":"2023-07-21T22:18:44.348486+0000","last_undegraded":"2023-07-21T22:18:44.348486+0000","last_fullsized":"2023-07-21T22:18:44.348486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:33:31.334871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.544215+0000","last_change":"2023-07-21T22:18:43.342235+0000","last_active":"2023-07-21T22:18:44.544215+0000","last_peered":"2023-07-21T22:18:44.544215+0000","last_clean":"2023-07-21T22:18:44.544215+0000","last_became_active":"2023-07-21T22:18:43.341945+0000","last_became_peered":"2023-07-21T22:18:43.341945+0000","last_unstale":"2023-07-21T22:18:44.544215+0000","last_undegraded":"2023-07-21T22:18:44.544215+0000","last_fullsized":"2023-07-21T22:18:44.544215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:25:33.381132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.353801+0000","last_change":"2023-07-21T22:18:44.342724+0000","last_active":"2023-07-21T22:18:44.353801+0000","last_peered":"2023-07-21T22:18:44.353801+0000","last_clean":"2023-07-21T22:18:44.353801+0000","last_became_active":"2023-07-21T22:18:44.342450+0000","last_became_peered":"2023-07-21T22:18:44.342450+0000","last_unstale":"2023-07-21T22:18:44.353801+0000","last_undegraded":"2023-07-21T22:18:44.353801+0000","last_fullsized":"2023-07-21T22:18:44.353801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:57:20.260229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.542136+0000","last_change":"2023-07-21T22:18:43.328543+0000","last_active":"2023-07-21T22:18:44.542136+0000","last_peered":"2023-07-21T22:18:44.542136+0000","last_clean":"2023-07-21T22:18:44.542136+0000","last_became_active":"2023-07-21T22:18:43.328165+0000","last_became_peered":"2023-07-21T22:18:43.328165+0000","last_unstale":"2023-07-21T22:18:44.542136+0000","last_undegraded":"2023-07-21T22:18:44.542136+0000","last_fullsized":"2023-07-21T22:18:44.542136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:54.833351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346881+0000","last_change":"2023-07-21T22:18:44.343626+0000","last_active":"2023-07-21T22:18:44.346881+0000","last_peered":"2023-07-21T22:18:44.346881+0000","last_clean":"2023-07-21T22:18:44.346881+0000","last_became_active":"2023-07-21T22:18:44.343339+0000","last_became_peered":"2023-07-21T22:18:44.343339+0000","last_unstale":"2023-07-21T22:18:44.346881+0000","last_undegraded":"2023-07-21T22:18:44.346881+0000","last_fullsized":"2023-07-21T22:18:44.346881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:36:40.719765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"25'4","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.542522+0000","last_change":"2023-07-21T22:18:43.341441+0000","last_active":"2023-07-21T22:18:44.542522+0000","last_peered":"2023-07-21T22:18:44.542522+0000","last_clean":"2023-07-21T22:18:44.542522+0000","last_became_active":"2023-07-21T22:18:43.340962+0000","last_became_peered":"2023-07-21T22:18:43.340962+0000","last_unstale":"2023-07-21T22:18:44.542522+0000","last_undegraded":"2023-07-21T22:18:44.542522+0000","last_fullsized":"2023-07-21T22:18:44.542522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:28.967479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":676715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":86347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":86347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":93475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":93475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":93475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":856064,"data_stored":684425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":86347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.55}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7470000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1829999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:18:49.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2023-07-21T22:18:49.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 24, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:18:43.319825+0000', 'last_change': '2023-07-21T22:18:43.319825+0000', 'last_active': '2023-07-21T22:18:43.300562+0000', 'last_peered': '2023-07-21T22:18:43.300562+0000', 'last_clean': '2023-07-21T22:18:43.300562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:18:43.319825+0000', 'last_undegraded': '2023-07-21T22:18:43.319825+0000', 'last_fullsized': '2023-07-21T22:18:43.319825+0000', 'mapping_epoch': 24, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 24, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:18:43.300562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:18:43.300562+0000', 'last_clean_scrub_stamp': '2023-07-21T22:18:43.300562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:18:49.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2023-07-21T22:18:49.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 24, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:18:43.318779+0000', 'last_change': '2023-07-21T22:18:43.318779+0000', 'last_active': '2023-07-21T22:18:43.300562+0000', 'last_peered': '2023-07-21T22:18:43.300562+0000', 'last_clean': '2023-07-21T22:18:43.300562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:18:43.318779+0000', 'last_undegraded': '2023-07-21T22:18:43.318779+0000', 'last_fullsized': '2023-07-21T22:18:43.318779+0000', 'mapping_epoch': 24, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 24, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:18:43.300562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:18:43.300562+0000', 'last_clean_scrub_stamp': '2023-07-21T22:18:43.300562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:18:49.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-07-21T22:18:49.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 24, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:18:43.318984+0000', 'last_change': '2023-07-21T22:18:43.318984+0000', 'last_active': '2023-07-21T22:18:43.300562+0000', 'last_peered': '2023-07-21T22:18:43.300562+0000', 'last_clean': '2023-07-21T22:18:43.300562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:18:43.318984+0000', 'last_undegraded': '2023-07-21T22:18:43.318984+0000', 'last_fullsized': '2023-07-21T22:18:43.318984+0000', 'mapping_epoch': 24, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 24, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:18:43.300562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:18:43.300562+0000', 'last_clean_scrub_stamp': '2023-07-21T22:18:43.300562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:18:49.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-07-21T22:18:49.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 24, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:18:43.319528+0000', 'last_change': '2023-07-21T22:18:43.319528+0000', 'last_active': '2023-07-21T22:18:43.300562+0000', 'last_peered': '2023-07-21T22:18:43.300562+0000', 'last_clean': '2023-07-21T22:18:43.300562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:18:43.319528+0000', 'last_undegraded': '2023-07-21T22:18:43.319528+0000', 'last_fullsized': '2023-07-21T22:18:43.319528+0000', 'mapping_epoch': 24, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 24, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:18:43.300562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:18:43.300562+0000', 'last_clean_scrub_stamp': '2023-07-21T22:18:43.300562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:18:49.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-07-21T22:18:49.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 24, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:18:43.319518+0000', 'last_change': '2023-07-21T22:18:43.319518+0000', 'last_active': '2023-07-21T22:18:43.300562+0000', 'last_peered': '2023-07-21T22:18:43.300562+0000', 'last_clean': '2023-07-21T22:18:43.300562+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:18:43.319518+0000', 'last_undegraded': '2023-07-21T22:18:43.319518+0000', 'last_fullsized': '2023-07-21T22:18:43.319518+0000', 'mapping_epoch': 24, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 24, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:18:43.300562+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:18:43.300562+0000', 'last_clean_scrub_stamp': '2023-07-21T22:18:43.300562+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:18:49.468 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-21T22:18:49.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.600+0000 7f15a6f9d640 1 Processor -- start 2023-07-21T22:18:49.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.600+0000 7f15a6f9d640 1 -- start start 2023-07-21T22:18:49.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.600+0000 7f15a6f9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f15a00b7c70 0x7f15a00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:49.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.600+0000 7f15a6f9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15a015fd60 0x7f15a00d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:49.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.600+0000 7f15a6f9d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15a00ccaf0 con 0x7f15a00d1850 2023-07-21T22:18:49.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.600+0000 7f15a6f9d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a00d1190 con 0x7f15a00b7c70 2023-07-21T22:18:49.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.600+0000 7f15a6f9d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a0160600 con 0x7f15a015fd60 2023-07-21T22:18:49.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.600+0000 7f15a553a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15a015fd60 0x7f15a00d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:49.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.600+0000 7f15a4d39640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f15a00b7c70 0x7f15a00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:49.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.600+0000 7f159ffff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f15a00d1850 0x7f15a015f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:37248/0 (socket says 172.21.15.6:37248) 2023-07-21T22:18:49.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.600+0000 7f159ffff640 1 -- 172.21.15.6:0/1748585147 learned_addr learned my addr 172.21.15.6:0/1748585147 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:49.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.600+0000 7f159f7fe640 1 -- 172.21.15.6:0/1748585147 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160092525 0 0) 0x7f15a00ccaf0 con 0x7f15a00d1850 2023-07-21T22:18:49.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.600+0000 7f15a4d39640 1 -- 172.21.15.6:0/1748585147 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15a015fd60 msgr2=0x7f15a00d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:49.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.600+0000 7f15a4d39640 1 --2- 172.21.15.6:0/1748585147 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15a015fd60 0x7f15a00d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.600+0000 7f15a4d39640 1 -- 172.21.15.6:0/1748585147 >> v1:172.21.15.161:6789/0 conn(0x7f15a00d1850 legacy=0x7f15a015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:49.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.600+0000 7f15a4d39640 1 -- 172.21.15.6:0/1748585147 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a0160320 con 0x7f15a00b7c70 2023-07-21T22:18:49.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.600+0000 7f15a553a640 1 --2- 172.21.15.6:0/1748585147 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15a015fd60 0x7f15a00d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:49.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.604+0000 7f15a4d39640 1 --2- 172.21.15.6:0/1748585147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a00b7c70 0x7f15a00d0c50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f15940097c0 tx=0x7f159401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fc1e19e047fc5f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:49.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.604+0000 7f159f7fe640 1 -- 172.21.15.6:0/1748585147 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15940ab670 con 0x7f15a00b7c70 2023-07-21T22:18:49.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.604+0000 7f159f7fe640 1 -- 172.21.15.6:0/1748585147 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15940ab7d0 con 0x7f15a00b7c70 2023-07-21T22:18:49.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.604+0000 7f159f7fe640 1 -- 172.21.15.6:0/1748585147 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15940abb60 con 0x7f15a00b7c70 2023-07-21T22:18:49.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.604+0000 7f15a6f9d640 1 -- 172.21.15.6:0/1748585147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a00b7c70 msgr2=0x7f15a00d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:49.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.604+0000 7f15a6f9d640 1 --2- 172.21.15.6:0/1748585147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a00b7c70 0x7f15a00d0c50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f15940097c0 tx=0x7f159401c450 comp rx=0 tx=0).stop 2023-07-21T22:18:49.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.604+0000 7f15a6f9d640 1 -- 172.21.15.6:0/1748585147 shutdown_connections 2023-07-21T22:18:49.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.604+0000 7f15a6f9d640 1 --2- 172.21.15.6:0/1748585147 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15a015fd60 0x7f15a00d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.604+0000 7f15a6f9d640 1 --2- 172.21.15.6:0/1748585147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a00b7c70 0x7f15a00d0c50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.604+0000 7f15a6f9d640 1 -- 172.21.15.6:0/1748585147 >> 172.21.15.6:0/1748585147 conn(0x7f15a00650b0 msgr2=0x7f15a00654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:49.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.604+0000 7f15a6f9d640 1 -- 172.21.15.6:0/1748585147 shutdown_connections 2023-07-21T22:18:49.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.604+0000 7f15a6f9d640 1 -- 172.21.15.6:0/1748585147 wait complete. 2023-07-21T22:18:49.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f15a6f9d640 1 Processor -- start 2023-07-21T22:18:49.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f15a6f9d640 1 -- start start 2023-07-21T22:18:49.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f15a6f9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15a00b7c70 0x7f15a015eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:49.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f15a6f9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15a00d1850 0x7f15a00cfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:49.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f15a6f9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a015fd60 0x7f15a00b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:49.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f15a6f9d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a015f020 con 0x7f15a00d1850 2023-07-21T22:18:49.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f15a6f9d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a015b650 con 0x7f15a015fd60 2023-07-21T22:18:49.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f15a6f9d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a014f770 con 0x7f15a00b7c70 2023-07-21T22:18:49.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f159ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15a00d1850 0x7f15a00cfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:49.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f159ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15a00d1850 0x7f15a00cfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46680/0 (socket says 172.21.15.6:46680) 2023-07-21T22:18:49.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f159ffff640 1 -- 172.21.15.6:0/108028537 learned_addr learned my addr 172.21.15.6:0/108028537 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:49.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f15a4d39640 1 --2- 172.21.15.6:0/108028537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15a00b7c70 0x7f15a015eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:49.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f15a553a640 1 --2- 172.21.15.6:0/108028537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a015fd60 0x7f15a00b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:49.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f159ffff640 1 -- 172.21.15.6:0/108028537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15a00b7c70 msgr2=0x7f15a015eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:49.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f159ffff640 1 --2- 172.21.15.6:0/108028537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15a00b7c70 0x7f15a015eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f159ffff640 1 -- 172.21.15.6:0/108028537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a015fd60 msgr2=0x7f15a00b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f159ffff640 1 --2- 172.21.15.6:0/108028537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a015fd60 0x7f15a00b5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f159ffff640 1 -- 172.21.15.6:0/108028537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1598009a70 con 0x7f15a00d1850 2023-07-21T22:18:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f15a553a640 1 --2- 172.21.15.6:0/108028537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a015fd60 0x7f15a00b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f159ffff640 1 --2- 172.21.15.6:0/108028537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15a00d1850 0x7f15a00cfeb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f158c00c480 tx=0x7f158c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f159d7fa640 1 -- 172.21.15.6:0/108028537 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c0074e0 con 0x7f15a00d1850 2023-07-21T22:18:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f159d7fa640 1 -- 172.21.15.6:0/108028537 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c007660 con 0x7f15a00d1850 2023-07-21T22:18:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f15a6f9d640 1 -- 172.21.15.6:0/108028537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1594009420 con 0x7f15a00d1850 2023-07-21T22:18:49.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f159d7fa640 1 -- 172.21.15.6:0/108028537 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c004a30 con 0x7f15a00d1850 2023-07-21T22:18:49.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f15a6f9d640 1 -- 172.21.15.6:0/108028537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a01528c0 con 0x7f15a00d1850 2023-07-21T22:18:49.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.608+0000 7f15a6f9d640 1 -- 172.21.15.6:0/108028537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a00678d0 con 0x7f15a00d1850 2023-07-21T22:18:49.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.612+0000 7f159d7fa640 1 -- 172.21.15.6:0/108028537 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f158c004b90 con 0x7f15a00d1850 2023-07-21T22:18:49.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.612+0000 7f159d7fa640 1 --2- 172.21.15.6:0/108028537 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1584066280 0x7f1584068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:49.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.612+0000 7f159d7fa640 1 -- 172.21.15.6:0/108028537 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f158c082e80 con 0x7f15a00d1850 2023-07-21T22:18:49.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.612+0000 7f15a4d39640 1 --2- 172.21.15.6:0/108028537 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1584066280 0x7f1584068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:49.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.612+0000 7f15a4d39640 1 --2- 172.21.15.6:0/108028537 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1584066280 0x7f1584068730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f15940af000 tx=0x7f15940a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:49.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.616+0000 7f159d7fa640 1 -- 172.21.15.6:0/108028537 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f158c053e30 con 0x7f15a00d1850 2023-07-21T22:18:49.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.824+0000 7f15a6f9d640 1 -- 172.21.15.6:0/108028537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f15a015bda0 con 0x7f15a00d1850 2023-07-21T22:18:49.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.828+0000 7f159d7fa640 1 -- 172.21.15.6:0/108028537 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1096 (secure 0 0 0) 0x7f158c018080 con 0x7f15a00d1850 2023-07-21T22:18:49.874 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:18:49.874 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":32,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":26,"num_osds":8,"num_up_osds":8,"osd_up_since":1689977909,"num_in_osds":8,"osd_in_since":1689977900,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":100},{"state_name":"creating+peering","count":5}],"num_pgs":105,"num_pools":4,"num_objects":19,"data_bytes":592730,"bytes_used":223997952,"bytes_avail":772870115328,"bytes_total":773094113280,"inactive_pgs_ratio":0.0476190485060215,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4294}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-07-21T22:18:17.758108+0000","services":{}},"progress_events":{}} 2023-07-21T22:18:49.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.828+0000 7f15a6f9d640 1 -- 172.21.15.6:0/108028537 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1584066280 msgr2=0x7f1584068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:49.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.828+0000 7f15a6f9d640 1 --2- 172.21.15.6:0/108028537 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1584066280 0x7f1584068730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f15940af000 tx=0x7f15940a7000 comp rx=0 tx=0).stop 2023-07-21T22:18:49.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.828+0000 7f15a6f9d640 1 -- 172.21.15.6:0/108028537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15a00d1850 msgr2=0x7f15a00cfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:49.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.828+0000 7f15a6f9d640 1 --2- 172.21.15.6:0/108028537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15a00d1850 0x7f15a00cfeb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f158c00c480 tx=0x7f158c00c940 comp rx=0 tx=0).stop 2023-07-21T22:18:49.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.828+0000 7f15a6f9d640 1 -- 172.21.15.6:0/108028537 shutdown_connections 2023-07-21T22:18:49.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.828+0000 7f15a6f9d640 1 --2- 172.21.15.6:0/108028537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15a015fd60 0x7f15a00b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.828+0000 7f15a6f9d640 1 --2- 172.21.15.6:0/108028537 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1584066280 0x7f1584068730 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.828+0000 7f15a6f9d640 1 --2- 172.21.15.6:0/108028537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15a00d1850 0x7f15a00cfeb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.828+0000 7f15a6f9d640 1 --2- 172.21.15.6:0/108028537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15a00b7c70 0x7f15a015eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:49.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.828+0000 7f15a6f9d640 1 -- 172.21.15.6:0/108028537 >> 172.21.15.6:0/108028537 conn(0x7f15a00650b0 msgr2=0x7f15a00b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:49.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.828+0000 7f15a6f9d640 1 -- 172.21.15.6:0/108028537 shutdown_connections 2023-07-21T22:18:49.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.828+0000 7f15a6f9d640 1 -- 172.21.15.6:0/108028537 wait complete. 2023-07-21T22:18:49.894 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-21T22:18:49.895 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:18:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.992+0000 7fa127d37640 1 Processor -- start 2023-07-21T22:18:50.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.992+0000 7fa127d37640 1 -- start start 2023-07-21T22:18:50.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.992+0000 7fa127d37640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa120158ce0 0x7fa120070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.992+0000 7fa127d37640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1200c8ad0 0x7fa1200c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.992+0000 7fa127d37640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1200cc700 con 0x7fa1200c9560 2023-07-21T22:18:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.992+0000 7fa127d37640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1200c99e0 con 0x7fa120158ce0 2023-07-21T22:18:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.992+0000 7fa127d37640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1200b0ff0 con 0x7fa1200c8ad0 2023-07-21T22:18:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.992+0000 7fa125ad3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa120158ce0 0x7fa120070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:50.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.992+0000 7fa1262d4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa1200c9560 0x7fa1200cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54068/0 (socket says 172.21.15.6:54068) 2023-07-21T22:18:50.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.992+0000 7fa1262d4640 1 -- 172.21.15.6:0/3182693308 learned_addr learned my addr 172.21.15.6:0/3182693308 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:50.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.992+0000 7fa1252d2640 1 --2- 172.21.15.6:0/3182693308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1200c8ad0 0x7fa1200c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:50.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.996+0000 7fa124ad1640 1 -- 172.21.15.6:0/3182693308 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208242907 0 0) 0x7fa1200cc700 con 0x7fa1200c9560 2023-07-21T22:18:50.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.996+0000 7fa125ad3640 1 -- 172.21.15.6:0/3182693308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1200c8ad0 msgr2=0x7fa1200c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.996+0000 7fa125ad3640 1 --2- 172.21.15.6:0/3182693308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1200c8ad0 0x7fa1200c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.996+0000 7fa125ad3640 1 -- 172.21.15.6:0/3182693308 >> v1:172.21.15.6:6789/0 conn(0x7fa1200c9560 legacy=0x7fa1200cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.996+0000 7fa125ad3640 1 -- 172.21.15.6:0/3182693308 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa120070c80 con 0x7fa120158ce0 2023-07-21T22:18:50.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.996+0000 7fa125ad3640 1 --2- 172.21.15.6:0/3182693308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa120158ce0 0x7fa120070450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0097c0 tx=0x7fa11c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88741290d74a1ea server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.996+0000 7fa124ad1640 1 -- 172.21.15.6:0/3182693308 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1200cba20 con 0x7fa120158ce0 2023-07-21T22:18:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.996+0000 7fa124ad1640 1 -- 172.21.15.6:0/3182693308 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c0a7050 con 0x7fa120158ce0 2023-07-21T22:18:50.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:49.996+0000 7fa124ad1640 1 -- 172.21.15.6:0/3182693308 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c0ab820 con 0x7fa120158ce0 2023-07-21T22:18:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa127d37640 1 -- 172.21.15.6:0/3182693308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa120158ce0 msgr2=0x7fa120070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:50.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa127d37640 1 --2- 172.21.15.6:0/3182693308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa120158ce0 0x7fa120070450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0097c0 tx=0x7fa11c01c330 comp rx=0 tx=0).stop 2023-07-21T22:18:50.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa127d37640 1 -- 172.21.15.6:0/3182693308 shutdown_connections 2023-07-21T22:18:50.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa127d37640 1 --2- 172.21.15.6:0/3182693308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1200c8ad0 0x7fa1200c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:50.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa127d37640 1 --2- 172.21.15.6:0/3182693308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa120158ce0 0x7fa120070450 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:50.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa127d37640 1 -- 172.21.15.6:0/3182693308 >> 172.21.15.6:0/3182693308 conn(0x7fa1200afcf0 msgr2=0x7fa1200b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:50.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa127d37640 1 -- 172.21.15.6:0/3182693308 shutdown_connections 2023-07-21T22:18:50.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa127d37640 1 -- 172.21.15.6:0/3182693308 wait complete. 2023-07-21T22:18:50.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa127d37640 1 Processor -- start 2023-07-21T22:18:50.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa127d37640 1 -- start start 2023-07-21T22:18:50.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa127d37640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1200c8ad0 0x7fa1200c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa127d37640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1200c9560 0x7fa120159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa127d37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa120158ce0 0x7fa1200c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa127d37640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1200c5a60 con 0x7fa120158ce0 2023-07-21T22:18:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa127d37640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1200c5d40 con 0x7fa1200c9560 2023-07-21T22:18:50.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa127d37640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1200c6020 con 0x7fa1200c8ad0 2023-07-21T22:18:50.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa1262d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa120158ce0 0x7fa1200c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:50.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa1262d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa120158ce0 0x7fa1200c5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46712/0 (socket says 172.21.15.6:46712) 2023-07-21T22:18:50.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa1262d4640 1 -- 172.21.15.6:0/3042758489 learned_addr learned my addr 172.21.15.6:0/3042758489 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:50.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa1252d2640 1 --2- 172.21.15.6:0/3042758489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1200c9560 0x7fa120159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:50.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa125ad3640 1 --2- 172.21.15.6:0/3042758489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1200c8ad0 0x7fa1200c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:50.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa1262d4640 1 -- 172.21.15.6:0/3042758489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1200c8ad0 msgr2=0x7fa1200c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:50.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa1262d4640 1 --2- 172.21.15.6:0/3042758489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1200c8ad0 0x7fa1200c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:50.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa1262d4640 1 -- 172.21.15.6:0/3042758489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1200c9560 msgr2=0x7fa120159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:50.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa1262d4640 1 --2- 172.21.15.6:0/3042758489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1200c9560 0x7fa120159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:50.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.000+0000 7fa1262d4640 1 -- 172.21.15.6:0/3042758489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c009420 con 0x7fa120158ce0 2023-07-21T22:18:50.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.004+0000 7fa1262d4640 1 --2- 172.21.15.6:0/3042758489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa120158ce0 0x7fa1200c5230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa11800c700 tx=0x7fa11800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:50.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.004+0000 7fa1167fc640 1 -- 172.21.15.6:0/3042758489 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11800ce10 con 0x7fa120158ce0 2023-07-21T22:18:50.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.004+0000 7fa1167fc640 1 -- 172.21.15.6:0/3042758489 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11800a640 con 0x7fa120158ce0 2023-07-21T22:18:50.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.004+0000 7fa1167fc640 1 -- 172.21.15.6:0/3042758489 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11800aa70 con 0x7fa120158ce0 2023-07-21T22:18:50.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.004+0000 7fa127d37640 1 -- 172.21.15.6:0/3042758489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1200c6300 con 0x7fa120158ce0 2023-07-21T22:18:50.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.004+0000 7fa127d37640 1 -- 172.21.15.6:0/3042758489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1200c5770 con 0x7fa120158ce0 2023-07-21T22:18:50.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.004+0000 7fa127d37640 1 -- 172.21.15.6:0/3042758489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1200ca1a0 con 0x7fa120158ce0 2023-07-21T22:18:50.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.004+0000 7fa1167fc640 1 -- 172.21.15.6:0/3042758489 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa11800abd0 con 0x7fa120158ce0 2023-07-21T22:18:50.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.004+0000 7fa1167fc640 1 --2- 172.21.15.6:0/3042758489 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa104066280 0x7fa104068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:50.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.004+0000 7fa1167fc640 1 -- 172.21.15.6:0/3042758489 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa118083190 con 0x7fa120158ce0 2023-07-21T22:18:50.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.004+0000 7fa125ad3640 1 --2- 172.21.15.6:0/3042758489 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa104066280 0x7fa104068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:50.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.008+0000 7fa125ad3640 1 --2- 172.21.15.6:0/3042758489 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa104066280 0x7fa104068730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0ad000 tx=0x7fa11c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:50.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.008+0000 7fa1167fc640 1 -- 172.21.15.6:0/3042758489 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa1180506c0 con 0x7fa120158ce0 2023-07-21T22:18:50.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.160+0000 7fa127d37640 1 -- 172.21.15.6:0/3042758489 --> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1200c5eb0 con 0x7fa104066280 2023-07-21T22:18:50.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.168+0000 7fa1167fc640 1 -- 172.21.15.6:0/3042758489 <== mgr.4103 v2:172.21.15.161:6832/3471136886 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286231 (secure 0 0 0) 0x7fa1200c5eb0 con 0x7fa104066280 2023-07-21T22:18:50.219 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:18:50.220 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:18:50.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.172+0000 7fa127d37640 1 -- 172.21.15.6:0/3042758489 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa104066280 msgr2=0x7fa104068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:50.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.172+0000 7fa127d37640 1 --2- 172.21.15.6:0/3042758489 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa104066280 0x7fa104068730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0ad000 tx=0x7fa11c0a6000 comp rx=0 tx=0).stop 2023-07-21T22:18:50.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.172+0000 7fa127d37640 1 -- 172.21.15.6:0/3042758489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa120158ce0 msgr2=0x7fa1200c5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:50.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.172+0000 7fa127d37640 1 --2- 172.21.15.6:0/3042758489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa120158ce0 0x7fa1200c5230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa11800c700 tx=0x7fa11800cbc0 comp rx=0 tx=0).stop 2023-07-21T22:18:50.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.172+0000 7fa127d37640 1 -- 172.21.15.6:0/3042758489 shutdown_connections 2023-07-21T22:18:50.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.172+0000 7fa127d37640 1 --2- 172.21.15.6:0/3042758489 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa104066280 0x7fa104068730 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:50.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.172+0000 7fa127d37640 1 --2- 172.21.15.6:0/3042758489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa120158ce0 0x7fa1200c5230 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:50.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.172+0000 7fa127d37640 1 --2- 172.21.15.6:0/3042758489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1200c9560 0x7fa120159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:50.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.172+0000 7fa127d37640 1 --2- 172.21.15.6:0/3042758489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1200c8ad0 0x7fa1200c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:50.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.172+0000 7fa127d37640 1 -- 172.21.15.6:0/3042758489 >> 172.21.15.6:0/3042758489 conn(0x7fa1200afcf0 msgr2=0x7fa1200b36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:50.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.172+0000 7fa127d37640 1 -- 172.21.15.6:0/3042758489 shutdown_connections 2023-07-21T22:18:50.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:50.172+0000 7fa127d37640 1 -- 172.21.15.6:0/3042758489 wait complete. 2023-07-21T22:18:50.238 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-07-21T22:18:48.768936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218748,"kb_used_data":3132,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755972,"statfs":{"total":773094113280,"available":772870115328,"internally_reserved":0,"allocated":3207168,"data_stored":1900606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001298"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.341718+0000","last_change":"2023-07-21T22:18:44.336499+0000","last_active":"2023-07-21T22:18:44.341718+0000","last_peered":"2023-07-21T22:18:44.341718+0000","last_clean":"2023-07-21T22:18:44.341718+0000","last_became_active":"2023-07-21T22:18:44.336063+0000","last_became_peered":"2023-07-21T22:18:44.336063+0000","last_unstale":"2023-07-21T22:18:44.341718+0000","last_undegraded":"2023-07-21T22:18:44.341718+0000","last_fullsized":"2023-07-21T22:18:44.341718+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:24:06.166416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346444+0000","last_change":"2023-07-21T22:18:44.341470+0000","last_active":"2023-07-21T22:18:44.346444+0000","last_peered":"2023-07-21T22:18:44.346444+0000","last_clean":"2023-07-21T22:18:44.346444+0000","last_became_active":"2023-07-21T22:18:44.341148+0000","last_became_peered":"2023-07-21T22:18:44.341148+0000","last_unstale":"2023-07-21T22:18:44.346444+0000","last_undegraded":"2023-07-21T22:18:44.346444+0000","last_fullsized":"2023-07-21T22:18:44.346444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:20.530615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.338400+0000","last_change":"2023-07-21T22:18:44.336245+0000","last_active":"2023-07-21T22:18:44.338400+0000","last_peered":"2023-07-21T22:18:44.338400+0000","last_clean":"2023-07-21T22:18:44.338400+0000","last_became_active":"2023-07-21T22:18:44.335682+0000","last_became_peered":"2023-07-21T22:18:44.335682+0000","last_unstale":"2023-07-21T22:18:44.338400+0000","last_undegraded":"2023-07-21T22:18:44.338400+0000","last_fullsized":"2023-07-21T22:18:44.338400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:16:43.932507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":24,"state":"creating+peering","last_fresh":"2023-07-21T22:18:43.319825+0000","last_change":"2023-07-21T22:18:43.319825+0000","last_active":"2023-07-21T22:18:43.300562+0000","last_peered":"2023-07-21T22:18:43.300562+0000","last_clean":"2023-07-21T22:18:43.300562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:18:43.319825+0000","last_undegraded":"2023-07-21T22:18:43.319825+0000","last_fullsized":"2023-07-21T22:18:43.319825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346108+0000","last_change":"2023-07-21T22:18:44.344066+0000","last_active":"2023-07-21T22:18:44.346108+0000","last_peered":"2023-07-21T22:18:44.346108+0000","last_clean":"2023-07-21T22:18:44.346108+0000","last_became_active":"2023-07-21T22:18:44.343765+0000","last_became_peered":"2023-07-21T22:18:44.343765+0000","last_unstale":"2023-07-21T22:18:44.346108+0000","last_undegraded":"2023-07-21T22:18:44.346108+0000","last_fullsized":"2023-07-21T22:18:44.346108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:54.484564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.338362+0000","last_change":"2023-07-21T22:18:44.336096+0000","last_active":"2023-07-21T22:18:44.338362+0000","last_peered":"2023-07-21T22:18:44.338362+0000","last_clean":"2023-07-21T22:18:44.338362+0000","last_became_active":"2023-07-21T22:18:44.335625+0000","last_became_peered":"2023-07-21T22:18:44.335625+0000","last_unstale":"2023-07-21T22:18:44.338362+0000","last_undegraded":"2023-07-21T22:18:44.338362+0000","last_fullsized":"2023-07-21T22:18:44.338362+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:23:17.593542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.341432+0000","last_change":"2023-07-21T22:18:44.338953+0000","last_active":"2023-07-21T22:18:44.341432+0000","last_peered":"2023-07-21T22:18:44.341432+0000","last_clean":"2023-07-21T22:18:44.341432+0000","last_became_active":"2023-07-21T22:18:44.338582+0000","last_became_peered":"2023-07-21T22:18:44.338582+0000","last_unstale":"2023-07-21T22:18:44.341432+0000","last_undegraded":"2023-07-21T22:18:44.341432+0000","last_fullsized":"2023-07-21T22:18:44.341432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:10.090300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346408+0000","last_change":"2023-07-21T22:18:44.337662+0000","last_active":"2023-07-21T22:18:44.346408+0000","last_peered":"2023-07-21T22:18:44.346408+0000","last_clean":"2023-07-21T22:18:44.346408+0000","last_became_active":"2023-07-21T22:18:44.337217+0000","last_became_peered":"2023-07-21T22:18:44.337217+0000","last_unstale":"2023-07-21T22:18:44.346408+0000","last_undegraded":"2023-07-21T22:18:44.346408+0000","last_fullsized":"2023-07-21T22:18:44.346408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:06:33.367363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346142+0000","last_change":"2023-07-21T22:18:44.344268+0000","last_active":"2023-07-21T22:18:44.346142+0000","last_peered":"2023-07-21T22:18:44.346142+0000","last_clean":"2023-07-21T22:18:44.346142+0000","last_became_active":"2023-07-21T22:18:44.343880+0000","last_became_peered":"2023-07-21T22:18:44.343880+0000","last_unstale":"2023-07-21T22:18:44.346142+0000","last_undegraded":"2023-07-21T22:18:44.346142+0000","last_fullsized":"2023-07-21T22:18:44.346142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:45.242179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346345+0000","last_change":"2023-07-21T22:18:44.336379+0000","last_active":"2023-07-21T22:18:44.346345+0000","last_peered":"2023-07-21T22:18:44.346345+0000","last_clean":"2023-07-21T22:18:44.346345+0000","last_became_active":"2023-07-21T22:18:44.335846+0000","last_became_peered":"2023-07-21T22:18:44.335846+0000","last_unstale":"2023-07-21T22:18:44.346345+0000","last_undegraded":"2023-07-21T22:18:44.346345+0000","last_fullsized":"2023-07-21T22:18:44.346345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:44.120565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354172+0000","last_change":"2023-07-21T22:18:44.352832+0000","last_active":"2023-07-21T22:18:44.354172+0000","last_peered":"2023-07-21T22:18:44.354172+0000","last_clean":"2023-07-21T22:18:44.354172+0000","last_became_active":"2023-07-21T22:18:44.352465+0000","last_became_peered":"2023-07-21T22:18:44.352465+0000","last_unstale":"2023-07-21T22:18:44.354172+0000","last_undegraded":"2023-07-21T22:18:44.354172+0000","last_fullsized":"2023-07-21T22:18:44.354172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:48:56.083184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.342895+0000","last_change":"2023-07-21T22:18:44.337129+0000","last_active":"2023-07-21T22:18:44.342895+0000","last_peered":"2023-07-21T22:18:44.342895+0000","last_clean":"2023-07-21T22:18:44.342895+0000","last_became_active":"2023-07-21T22:18:44.336170+0000","last_became_peered":"2023-07-21T22:18:44.336170+0000","last_unstale":"2023-07-21T22:18:44.342895+0000","last_undegraded":"2023-07-21T22:18:44.342895+0000","last_fullsized":"2023-07-21T22:18:44.342895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:49.771671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.338356+0000","last_change":"2023-07-21T22:18:44.335382+0000","last_active":"2023-07-21T22:18:44.338356+0000","last_peered":"2023-07-21T22:18:44.338356+0000","last_clean":"2023-07-21T22:18:44.338356+0000","last_became_active":"2023-07-21T22:18:44.334933+0000","last_became_peered":"2023-07-21T22:18:44.334933+0000","last_unstale":"2023-07-21T22:18:44.338356+0000","last_undegraded":"2023-07-21T22:18:44.338356+0000","last_fullsized":"2023-07-21T22:18:44.338356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:30.400997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346250+0000","last_change":"2023-07-21T22:18:44.333998+0000","last_active":"2023-07-21T22:18:44.346250+0000","last_peered":"2023-07-21T22:18:44.346250+0000","last_clean":"2023-07-21T22:18:44.346250+0000","last_became_active":"2023-07-21T22:18:44.333720+0000","last_became_peered":"2023-07-21T22:18:44.333720+0000","last_unstale":"2023-07-21T22:18:44.346250+0000","last_undegraded":"2023-07-21T22:18:44.346250+0000","last_fullsized":"2023-07-21T22:18:44.346250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:47:24.196227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.344314+0000","last_change":"2023-07-21T22:18:44.341061+0000","last_active":"2023-07-21T22:18:44.344314+0000","last_peered":"2023-07-21T22:18:44.344314+0000","last_clean":"2023-07-21T22:18:44.344314+0000","last_became_active":"2023-07-21T22:18:44.340711+0000","last_became_peered":"2023-07-21T22:18:44.340711+0000","last_unstale":"2023-07-21T22:18:44.344314+0000","last_undegraded":"2023-07-21T22:18:44.344314+0000","last_fullsized":"2023-07-21T22:18:44.344314+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:43.536674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.337952+0000","last_change":"2023-07-21T22:18:44.335984+0000","last_active":"2023-07-21T22:18:44.337952+0000","last_peered":"2023-07-21T22:18:44.337952+0000","last_clean":"2023-07-21T22:18:44.337952+0000","last_became_active":"2023-07-21T22:18:44.335481+0000","last_became_peered":"2023-07-21T22:18:44.335481+0000","last_unstale":"2023-07-21T22:18:44.337952+0000","last_undegraded":"2023-07-21T22:18:44.337952+0000","last_fullsized":"2023-07-21T22:18:44.337952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:55.939872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.335467+0000","last_change":"2023-07-21T22:18:44.333526+0000","last_active":"2023-07-21T22:18:44.335467+0000","last_peered":"2023-07-21T22:18:44.335467+0000","last_clean":"2023-07-21T22:18:44.335467+0000","last_became_active":"2023-07-21T22:18:44.333139+0000","last_became_peered":"2023-07-21T22:18:44.333139+0000","last_unstale":"2023-07-21T22:18:44.335467+0000","last_undegraded":"2023-07-21T22:18:44.335467+0000","last_fullsized":"2023-07-21T22:18:44.335467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:12.868716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.342623+0000","last_change":"2023-07-21T22:18:44.339606+0000","last_active":"2023-07-21T22:18:44.342623+0000","last_peered":"2023-07-21T22:18:44.342623+0000","last_clean":"2023-07-21T22:18:44.342623+0000","last_became_active":"2023-07-21T22:18:44.339282+0000","last_became_peered":"2023-07-21T22:18:44.339282+0000","last_unstale":"2023-07-21T22:18:44.342623+0000","last_undegraded":"2023-07-21T22:18:44.342623+0000","last_fullsized":"2023-07-21T22:18:44.342623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:56:31.905250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327372+0000","last_change":"2023-07-21T22:18:44.325126+0000","last_active":"2023-07-21T22:18:44.327372+0000","last_peered":"2023-07-21T22:18:44.327372+0000","last_clean":"2023-07-21T22:18:44.327372+0000","last_became_active":"2023-07-21T22:18:44.324795+0000","last_became_peered":"2023-07-21T22:18:44.324795+0000","last_unstale":"2023-07-21T22:18:44.327372+0000","last_undegraded":"2023-07-21T22:18:44.327372+0000","last_fullsized":"2023-07-21T22:18:44.327372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:54.484564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.342627+0000","last_change":"2023-07-21T22:18:44.338316+0000","last_active":"2023-07-21T22:18:44.342627+0000","last_peered":"2023-07-21T22:18:44.342627+0000","last_clean":"2023-07-21T22:18:44.342627+0000","last_became_active":"2023-07-21T22:18:44.337895+0000","last_became_peered":"2023-07-21T22:18:44.337895+0000","last_unstale":"2023-07-21T22:18:44.342627+0000","last_undegraded":"2023-07-21T22:18:44.342627+0000","last_fullsized":"2023-07-21T22:18:44.342627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:07:40.534702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.356332+0000","last_change":"2023-07-21T22:18:44.355582+0000","last_active":"2023-07-21T22:18:44.356332+0000","last_peered":"2023-07-21T22:18:44.356332+0000","last_clean":"2023-07-21T22:18:44.356332+0000","last_became_active":"2023-07-21T22:18:44.355317+0000","last_became_peered":"2023-07-21T22:18:44.355317+0000","last_unstale":"2023-07-21T22:18:44.356332+0000","last_undegraded":"2023-07-21T22:18:44.356332+0000","last_fullsized":"2023-07-21T22:18:44.356332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:51.653402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354983+0000","last_change":"2023-07-21T22:18:44.348333+0000","last_active":"2023-07-21T22:18:44.354983+0000","last_peered":"2023-07-21T22:18:44.354983+0000","last_clean":"2023-07-21T22:18:44.354983+0000","last_became_active":"2023-07-21T22:18:44.347982+0000","last_became_peered":"2023-07-21T22:18:44.347982+0000","last_unstale":"2023-07-21T22:18:44.354983+0000","last_undegraded":"2023-07-21T22:18:44.354983+0000","last_fullsized":"2023-07-21T22:18:44.354983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:54:18.053463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.338742+0000","last_change":"2023-07-21T22:18:44.333429+0000","last_active":"2023-07-21T22:18:44.338742+0000","last_peered":"2023-07-21T22:18:44.338742+0000","last_clean":"2023-07-21T22:18:44.338742+0000","last_became_active":"2023-07-21T22:18:44.333121+0000","last_became_peered":"2023-07-21T22:18:44.333121+0000","last_unstale":"2023-07-21T22:18:44.338742+0000","last_undegraded":"2023-07-21T22:18:44.338742+0000","last_fullsized":"2023-07-21T22:18:44.338742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:05.638943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.349028+0000","last_change":"2023-07-21T22:18:44.346478+0000","last_active":"2023-07-21T22:18:44.349028+0000","last_peered":"2023-07-21T22:18:44.349028+0000","last_clean":"2023-07-21T22:18:44.349028+0000","last_became_active":"2023-07-21T22:18:44.346160+0000","last_became_peered":"2023-07-21T22:18:44.346160+0000","last_unstale":"2023-07-21T22:18:44.349028+0000","last_undegraded":"2023-07-21T22:18:44.349028+0000","last_fullsized":"2023-07-21T22:18:44.349028+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:25:34.392203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.350826+0000","last_change":"2023-07-21T22:18:44.348596+0000","last_active":"2023-07-21T22:18:44.350826+0000","last_peered":"2023-07-21T22:18:44.350826+0000","last_clean":"2023-07-21T22:18:44.350826+0000","last_became_active":"2023-07-21T22:18:44.348325+0000","last_became_peered":"2023-07-21T22:18:44.348325+0000","last_unstale":"2023-07-21T22:18:44.350826+0000","last_undegraded":"2023-07-21T22:18:44.350826+0000","last_fullsized":"2023-07-21T22:18:44.350826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:38:06.965559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.339342+0000","last_change":"2023-07-21T22:18:44.335321+0000","last_active":"2023-07-21T22:18:44.339342+0000","last_peered":"2023-07-21T22:18:44.339342+0000","last_clean":"2023-07-21T22:18:44.339342+0000","last_became_active":"2023-07-21T22:18:44.334970+0000","last_became_peered":"2023-07-21T22:18:44.334970+0000","last_unstale":"2023-07-21T22:18:44.339342+0000","last_undegraded":"2023-07-21T22:18:44.339342+0000","last_fullsized":"2023-07-21T22:18:44.339342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:45.242179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.347194+0000","last_change":"2023-07-21T22:18:44.345317+0000","last_active":"2023-07-21T22:18:44.347194+0000","last_peered":"2023-07-21T22:18:44.347194+0000","last_clean":"2023-07-21T22:18:44.347194+0000","last_became_active":"2023-07-21T22:18:44.344901+0000","last_became_peered":"2023-07-21T22:18:44.344901+0000","last_unstale":"2023-07-21T22:18:44.347194+0000","last_undegraded":"2023-07-21T22:18:44.347194+0000","last_fullsized":"2023-07-21T22:18:44.347194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:05.701948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.340949+0000","last_change":"2023-07-21T22:18:44.336787+0000","last_active":"2023-07-21T22:18:44.340949+0000","last_peered":"2023-07-21T22:18:44.340949+0000","last_clean":"2023-07-21T22:18:44.340949+0000","last_became_active":"2023-07-21T22:18:44.336502+0000","last_became_peered":"2023-07-21T22:18:44.336502+0000","last_unstale":"2023-07-21T22:18:44.340949+0000","last_undegraded":"2023-07-21T22:18:44.340949+0000","last_fullsized":"2023-07-21T22:18:44.340949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:51.413018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354531+0000","last_change":"2023-07-21T22:18:44.348671+0000","last_active":"2023-07-21T22:18:44.354531+0000","last_peered":"2023-07-21T22:18:44.354531+0000","last_clean":"2023-07-21T22:18:44.354531+0000","last_became_active":"2023-07-21T22:18:44.348361+0000","last_became_peered":"2023-07-21T22:18:44.348361+0000","last_unstale":"2023-07-21T22:18:44.354531+0000","last_undegraded":"2023-07-21T22:18:44.354531+0000","last_fullsized":"2023-07-21T22:18:44.354531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:37:46.816193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.350895+0000","last_change":"2023-07-21T22:18:44.348495+0000","last_active":"2023-07-21T22:18:44.350895+0000","last_peered":"2023-07-21T22:18:44.350895+0000","last_clean":"2023-07-21T22:18:44.350895+0000","last_became_active":"2023-07-21T22:18:44.348107+0000","last_became_peered":"2023-07-21T22:18:44.348107+0000","last_unstale":"2023-07-21T22:18:44.350895+0000","last_undegraded":"2023-07-21T22:18:44.350895+0000","last_fullsized":"2023-07-21T22:18:44.350895+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:45:41.479888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.353726+0000","last_change":"2023-07-21T22:18:44.342060+0000","last_active":"2023-07-21T22:18:44.353726+0000","last_peered":"2023-07-21T22:18:44.353726+0000","last_clean":"2023-07-21T22:18:44.353726+0000","last_became_active":"2023-07-21T22:18:44.341767+0000","last_became_peered":"2023-07-21T22:18:44.341767+0000","last_unstale":"2023-07-21T22:18:44.353726+0000","last_undegraded":"2023-07-21T22:18:44.353726+0000","last_fullsized":"2023-07-21T22:18:44.353726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:51.413018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":24,"state":"creating+peering","last_fresh":"2023-07-21T22:18:43.318779+0000","last_change":"2023-07-21T22:18:43.318779+0000","last_active":"2023-07-21T22:18:43.300562+0000","last_peered":"2023-07-21T22:18:43.300562+0000","last_clean":"2023-07-21T22:18:43.300562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:18:43.318779+0000","last_undegraded":"2023-07-21T22:18:43.318779+0000","last_fullsized":"2023-07-21T22:18:43.318779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348765+0000","last_change":"2023-07-21T22:18:44.338017+0000","last_active":"2023-07-21T22:18:44.348765+0000","last_peered":"2023-07-21T22:18:44.348765+0000","last_clean":"2023-07-21T22:18:44.348765+0000","last_became_active":"2023-07-21T22:18:44.337215+0000","last_became_peered":"2023-07-21T22:18:44.337215+0000","last_unstale":"2023-07-21T22:18:44.348765+0000","last_undegraded":"2023-07-21T22:18:44.348765+0000","last_fullsized":"2023-07-21T22:18:44.348765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:13:17.888290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.544481+0000","last_change":"2023-07-21T22:18:43.345411+0000","last_active":"2023-07-21T22:18:44.544481+0000","last_peered":"2023-07-21T22:18:44.544481+0000","last_clean":"2023-07-21T22:18:44.544481+0000","last_became_active":"2023-07-21T22:18:43.345095+0000","last_became_peered":"2023-07-21T22:18:43.345095+0000","last_unstale":"2023-07-21T22:18:44.544481+0000","last_undegraded":"2023-07-21T22:18:44.544481+0000","last_fullsized":"2023-07-21T22:18:44.544481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:40:45.106399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.347173+0000","last_change":"2023-07-21T22:18:44.345111+0000","last_active":"2023-07-21T22:18:44.347173+0000","last_peered":"2023-07-21T22:18:44.347173+0000","last_clean":"2023-07-21T22:18:44.347173+0000","last_became_active":"2023-07-21T22:18:44.344325+0000","last_became_peered":"2023-07-21T22:18:44.344325+0000","last_unstale":"2023-07-21T22:18:44.347173+0000","last_undegraded":"2023-07-21T22:18:44.347173+0000","last_fullsized":"2023-07-21T22:18:44.347173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:26.300457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327919+0000","last_change":"2023-07-21T22:18:43.340538+0000","last_active":"2023-07-21T22:18:44.327919+0000","last_peered":"2023-07-21T22:18:44.327919+0000","last_clean":"2023-07-21T22:18:44.327919+0000","last_became_active":"2023-07-21T22:18:43.340172+0000","last_became_peered":"2023-07-21T22:18:43.340172+0000","last_unstale":"2023-07-21T22:18:44.327919+0000","last_undegraded":"2023-07-21T22:18:44.327919+0000","last_fullsized":"2023-07-21T22:18:44.327919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:26:53.788877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.343008+0000","last_change":"2023-07-21T22:18:44.342020+0000","last_active":"2023-07-21T22:18:44.343008+0000","last_peered":"2023-07-21T22:18:44.343008+0000","last_clean":"2023-07-21T22:18:44.343008+0000","last_became_active":"2023-07-21T22:18:44.341724+0000","last_became_peered":"2023-07-21T22:18:44.341724+0000","last_unstale":"2023-07-21T22:18:44.343008+0000","last_undegraded":"2023-07-21T22:18:44.343008+0000","last_fullsized":"2023-07-21T22:18:44.343008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:57:20.260229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.331377+0000","last_change":"2023-07-21T22:18:43.337771+0000","last_active":"2023-07-21T22:18:44.331377+0000","last_peered":"2023-07-21T22:18:44.331377+0000","last_clean":"2023-07-21T22:18:44.331377+0000","last_became_active":"2023-07-21T22:18:43.337480+0000","last_became_peered":"2023-07-21T22:18:43.337480+0000","last_unstale":"2023-07-21T22:18:44.331377+0000","last_undegraded":"2023-07-21T22:18:44.331377+0000","last_fullsized":"2023-07-21T22:18:44.331377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:44:35.365564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.355676+0000","last_change":"2023-07-21T22:18:44.349625+0000","last_active":"2023-07-21T22:18:44.355676+0000","last_peered":"2023-07-21T22:18:44.355676+0000","last_clean":"2023-07-21T22:18:44.355676+0000","last_became_active":"2023-07-21T22:18:44.349046+0000","last_became_peered":"2023-07-21T22:18:44.349046+0000","last_unstale":"2023-07-21T22:18:44.355676+0000","last_undegraded":"2023-07-21T22:18:44.355676+0000","last_fullsized":"2023-07-21T22:18:44.355676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:26:54.799948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T22:18:43.349137+0000","last_change":"2023-07-21T22:18:43.344968+0000","last_active":"2023-07-21T22:18:43.349137+0000","last_peered":"2023-07-21T22:18:43.349137+0000","last_clean":"2023-07-21T22:18:43.349137+0000","last_became_active":"2023-07-21T22:18:43.344570+0000","last_became_peered":"2023-07-21T22:18:43.344570+0000","last_unstale":"2023-07-21T22:18:43.349137+0000","last_undegraded":"2023-07-21T22:18:43.349137+0000","last_fullsized":"2023-07-21T22:18:43.349137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:48.760601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.544297+0000","last_change":"2023-07-21T22:18:43.348215+0000","last_active":"2023-07-21T22:18:44.544297+0000","last_peered":"2023-07-21T22:18:44.544297+0000","last_clean":"2023-07-21T22:18:44.544297+0000","last_became_active":"2023-07-21T22:18:43.347858+0000","last_became_peered":"2023-07-21T22:18:43.347858+0000","last_unstale":"2023-07-21T22:18:44.544297+0000","last_undegraded":"2023-07-21T22:18:44.544297+0000","last_fullsized":"2023-07-21T22:18:44.544297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:25.289386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346430+0000","last_change":"2023-07-21T22:18:44.341650+0000","last_active":"2023-07-21T22:18:44.346430+0000","last_peered":"2023-07-21T22:18:44.346430+0000","last_clean":"2023-07-21T22:18:44.346430+0000","last_became_active":"2023-07-21T22:18:44.341352+0000","last_became_peered":"2023-07-21T22:18:44.341352+0000","last_unstale":"2023-07-21T22:18:44.346430+0000","last_undegraded":"2023-07-21T22:18:44.346430+0000","last_fullsized":"2023-07-21T22:18:44.346430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:16:43.932507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.543980+0000","last_change":"2023-07-21T22:18:43.348256+0000","last_active":"2023-07-21T22:18:44.543980+0000","last_peered":"2023-07-21T22:18:44.543980+0000","last_clean":"2023-07-21T22:18:44.543980+0000","last_became_active":"2023-07-21T22:18:43.347754+0000","last_became_peered":"2023-07-21T22:18:43.347754+0000","last_unstale":"2023-07-21T22:18:44.543980+0000","last_undegraded":"2023-07-21T22:18:44.543980+0000","last_fullsized":"2023-07-21T22:18:44.543980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:29:22.726274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354180+0000","last_change":"2023-07-21T22:18:44.353012+0000","last_active":"2023-07-21T22:18:44.354180+0000","last_peered":"2023-07-21T22:18:44.354180+0000","last_clean":"2023-07-21T22:18:44.354180+0000","last_became_active":"2023-07-21T22:18:44.352586+0000","last_became_peered":"2023-07-21T22:18:44.352586+0000","last_unstale":"2023-07-21T22:18:44.354180+0000","last_undegraded":"2023-07-21T22:18:44.354180+0000","last_fullsized":"2023-07-21T22:18:44.354180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:53:39.587668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"25'1","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.545116+0000","last_change":"2023-07-21T22:18:43.338600+0000","last_active":"2023-07-21T22:18:44.545116+0000","last_peered":"2023-07-21T22:18:44.545116+0000","last_clean":"2023-07-21T22:18:44.545116+0000","last_became_active":"2023-07-21T22:18:43.338271+0000","last_became_peered":"2023-07-21T22:18:43.338271+0000","last_unstale":"2023-07-21T22:18:44.545116+0000","last_undegraded":"2023-07-21T22:18:44.545116+0000","last_fullsized":"2023-07-21T22:18:44.545116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:49.375113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":24,"state":"creating+peering","last_fresh":"2023-07-21T22:18:43.318984+0000","last_change":"2023-07-21T22:18:43.318984+0000","last_active":"2023-07-21T22:18:43.300562+0000","last_peered":"2023-07-21T22:18:43.300562+0000","last_clean":"2023-07-21T22:18:43.300562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:18:43.318984+0000","last_undegraded":"2023-07-21T22:18:43.318984+0000","last_fullsized":"2023-07-21T22:18:43.318984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.322602+0000","last_change":"2023-07-21T22:18:43.339272+0000","last_active":"2023-07-21T22:18:44.322602+0000","last_peered":"2023-07-21T22:18:44.322602+0000","last_clean":"2023-07-21T22:18:44.322602+0000","last_became_active":"2023-07-21T22:18:43.338864+0000","last_became_peered":"2023-07-21T22:18:43.338864+0000","last_unstale":"2023-07-21T22:18:44.322602+0000","last_undegraded":"2023-07-21T22:18:44.322602+0000","last_fullsized":"2023-07-21T22:18:44.322602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:21:31.802323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354956+0000","last_change":"2023-07-21T22:18:44.347783+0000","last_active":"2023-07-21T22:18:44.354956+0000","last_peered":"2023-07-21T22:18:44.354956+0000","last_clean":"2023-07-21T22:18:44.354956+0000","last_became_active":"2023-07-21T22:18:44.347417+0000","last_became_peered":"2023-07-21T22:18:44.347417+0000","last_unstale":"2023-07-21T22:18:44.354956+0000","last_undegraded":"2023-07-21T22:18:44.354956+0000","last_fullsized":"2023-07-21T22:18:44.354956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:13:17.888290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.539367+0000","last_change":"2023-07-21T22:18:43.341666+0000","last_active":"2023-07-21T22:18:44.539367+0000","last_peered":"2023-07-21T22:18:44.539367+0000","last_clean":"2023-07-21T22:18:44.539367+0000","last_became_active":"2023-07-21T22:18:43.341287+0000","last_became_peered":"2023-07-21T22:18:43.341287+0000","last_unstale":"2023-07-21T22:18:44.539367+0000","last_undegraded":"2023-07-21T22:18:44.539367+0000","last_fullsized":"2023-07-21T22:18:44.539367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:28.967479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348446+0000","last_change":"2023-07-21T22:18:44.345773+0000","last_active":"2023-07-21T22:18:44.348446+0000","last_peered":"2023-07-21T22:18:44.348446+0000","last_clean":"2023-07-21T22:18:44.348446+0000","last_became_active":"2023-07-21T22:18:44.345494+0000","last_became_peered":"2023-07-21T22:18:44.345494+0000","last_unstale":"2023-07-21T22:18:44.348446+0000","last_undegraded":"2023-07-21T22:18:44.348446+0000","last_fullsized":"2023-07-21T22:18:44.348446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:18:32.374919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T22:18:43.349108+0000","last_change":"2023-07-21T22:18:43.346587+0000","last_active":"2023-07-21T22:18:43.349108+0000","last_peered":"2023-07-21T22:18:43.349108+0000","last_clean":"2023-07-21T22:18:43.349108+0000","last_became_active":"2023-07-21T22:18:43.346170+0000","last_became_peered":"2023-07-21T22:18:43.346170+0000","last_unstale":"2023-07-21T22:18:43.349108+0000","last_undegraded":"2023-07-21T22:18:43.349108+0000","last_fullsized":"2023-07-21T22:18:43.349108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:29.389926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.342644+0000","last_change":"2023-07-21T22:18:44.339550+0000","last_active":"2023-07-21T22:18:44.342644+0000","last_peered":"2023-07-21T22:18:44.342644+0000","last_clean":"2023-07-21T22:18:44.342644+0000","last_became_active":"2023-07-21T22:18:44.339232+0000","last_became_peered":"2023-07-21T22:18:44.339232+0000","last_unstale":"2023-07-21T22:18:44.342644+0000","last_undegraded":"2023-07-21T22:18:44.342644+0000","last_fullsized":"2023-07-21T22:18:44.342644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:06:33.367363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.331764+0000","last_change":"2023-07-21T22:18:43.342021+0000","last_active":"2023-07-21T22:18:44.331764+0000","last_peered":"2023-07-21T22:18:44.331764+0000","last_clean":"2023-07-21T22:18:44.331764+0000","last_became_active":"2023-07-21T22:18:43.340494+0000","last_became_peered":"2023-07-21T22:18:43.340494+0000","last_unstale":"2023-07-21T22:18:44.331764+0000","last_undegraded":"2023-07-21T22:18:44.331764+0000","last_fullsized":"2023-07-21T22:18:44.331764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:43.109494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.350920+0000","last_change":"2023-07-21T22:18:44.349404+0000","last_active":"2023-07-21T22:18:44.350920+0000","last_peered":"2023-07-21T22:18:44.350920+0000","last_clean":"2023-07-21T22:18:44.350920+0000","last_became_active":"2023-07-21T22:18:44.348314+0000","last_became_peered":"2023-07-21T22:18:44.348314+0000","last_unstale":"2023-07-21T22:18:44.350920+0000","last_undegraded":"2023-07-21T22:18:44.350920+0000","last_fullsized":"2023-07-21T22:18:44.350920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:07:37.786708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.329935+0000","last_change":"2023-07-21T22:18:43.329711+0000","last_active":"2023-07-21T22:18:44.329935+0000","last_peered":"2023-07-21T22:18:44.329935+0000","last_clean":"2023-07-21T22:18:44.329935+0000","last_became_active":"2023-07-21T22:18:43.329184+0000","last_became_peered":"2023-07-21T22:18:43.329184+0000","last_unstale":"2023-07-21T22:18:44.329935+0000","last_undegraded":"2023-07-21T22:18:44.329935+0000","last_fullsized":"2023-07-21T22:18:44.329935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:44.231108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.355627+0000","last_change":"2023-07-21T22:18:44.354431+0000","last_active":"2023-07-21T22:18:44.355627+0000","last_peered":"2023-07-21T22:18:44.355627+0000","last_clean":"2023-07-21T22:18:44.355627+0000","last_became_active":"2023-07-21T22:18:44.354063+0000","last_became_peered":"2023-07-21T22:18:44.354063+0000","last_unstale":"2023-07-21T22:18:44.355627+0000","last_undegraded":"2023-07-21T22:18:44.355627+0000","last_fullsized":"2023-07-21T22:18:44.355627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:30:07.924076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":173,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.328122+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:18:44.328122+0000","last_peered":"2023-07-21T22:18:44.328122+0000","last_clean":"2023-07-21T22:18:44.328122+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:18:44.328122+0000","last_undegraded":"2023-07-21T22:18:44.328122+0000","last_fullsized":"2023-07-21T22:18:44.328122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:10:20.968928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.321937+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:18:44.321937+0000","last_peered":"2023-07-21T22:18:44.321937+0000","last_clean":"2023-07-21T22:18:44.321937+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:18:44.321937+0000","last_undegraded":"2023-07-21T22:18:44.321937+0000","last_fullsized":"2023-07-21T22:18:44.321937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:48:50.039471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.330287+0000","last_change":"2023-07-21T22:18:43.327625+0000","last_active":"2023-07-21T22:18:44.330287+0000","last_peered":"2023-07-21T22:18:44.330287+0000","last_clean":"2023-07-21T22:18:44.330287+0000","last_became_active":"2023-07-21T22:18:43.327272+0000","last_became_peered":"2023-07-21T22:18:43.327272+0000","last_unstale":"2023-07-21T22:18:44.330287+0000","last_undegraded":"2023-07-21T22:18:44.330287+0000","last_fullsized":"2023-07-21T22:18:44.330287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:30:06.913006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":24,"state":"creating+peering","last_fresh":"2023-07-21T22:18:43.319528+0000","last_change":"2023-07-21T22:18:43.319528+0000","last_active":"2023-07-21T22:18:43.300562+0000","last_peered":"2023-07-21T22:18:43.300562+0000","last_clean":"2023-07-21T22:18:43.300562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:18:43.319528+0000","last_undegraded":"2023-07-21T22:18:43.319528+0000","last_fullsized":"2023-07-21T22:18:43.319528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327999+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:18:44.327999+0000","last_peered":"2023-07-21T22:18:44.327999+0000","last_clean":"2023-07-21T22:18:44.327999+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:18:44.327999+0000","last_undegraded":"2023-07-21T22:18:44.327999+0000","last_fullsized":"2023-07-21T22:18:44.327999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:24:03.249599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327761+0000","last_change":"2023-07-21T22:18:43.344180+0000","last_active":"2023-07-21T22:18:44.327761+0000","last_peered":"2023-07-21T22:18:44.327761+0000","last_clean":"2023-07-21T22:18:44.327761+0000","last_became_active":"2023-07-21T22:18:43.343831+0000","last_became_peered":"2023-07-21T22:18:43.343831+0000","last_unstale":"2023-07-21T22:18:44.327761+0000","last_undegraded":"2023-07-21T22:18:44.327761+0000","last_fullsized":"2023-07-21T22:18:44.327761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:04.627872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354946+0000","last_change":"2023-07-21T22:18:44.347759+0000","last_active":"2023-07-21T22:18:44.354946+0000","last_peered":"2023-07-21T22:18:44.354946+0000","last_clean":"2023-07-21T22:18:44.354946+0000","last_became_active":"2023-07-21T22:18:44.347416+0000","last_became_peered":"2023-07-21T22:18:44.347416+0000","last_unstale":"2023-07-21T22:18:44.354946+0000","last_undegraded":"2023-07-21T22:18:44.354946+0000","last_fullsized":"2023-07-21T22:18:44.354946+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:12:36.391754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.318179+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:18:44.318179+0000","last_peered":"2023-07-21T22:18:44.318179+0000","last_clean":"2023-07-21T22:18:44.318179+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:18:44.318179+0000","last_undegraded":"2023-07-21T22:18:44.318179+0000","last_fullsized":"2023-07-21T22:18:44.318179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:06.825003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.321356+0000","last_change":"2023-07-21T22:18:43.332573+0000","last_active":"2023-07-21T22:18:44.321356+0000","last_peered":"2023-07-21T22:18:44.321356+0000","last_clean":"2023-07-21T22:18:44.321356+0000","last_became_active":"2023-07-21T22:18:43.331774+0000","last_became_peered":"2023-07-21T22:18:43.331774+0000","last_unstale":"2023-07-21T22:18:44.321356+0000","last_undegraded":"2023-07-21T22:18:44.321356+0000","last_fullsized":"2023-07-21T22:18:44.321356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:04.627872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.349586+0000","last_change":"2023-07-21T22:18:44.344092+0000","last_active":"2023-07-21T22:18:44.349586+0000","last_peered":"2023-07-21T22:18:44.349586+0000","last_clean":"2023-07-21T22:18:44.349586+0000","last_became_active":"2023-07-21T22:18:44.343819+0000","last_became_peered":"2023-07-21T22:18:44.343819+0000","last_unstale":"2023-07-21T22:18:44.349586+0000","last_undegraded":"2023-07-21T22:18:44.349586+0000","last_fullsized":"2023-07-21T22:18:44.349586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:03:22.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.324241+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:18:44.324241+0000","last_peered":"2023-07-21T22:18:44.324241+0000","last_clean":"2023-07-21T22:18:44.324241+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:18:44.324241+0000","last_undegraded":"2023-07-21T22:18:44.324241+0000","last_fullsized":"2023-07-21T22:18:44.324241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:45:35.436175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.330825+0000","last_change":"2023-07-21T22:18:43.347890+0000","last_active":"2023-07-21T22:18:44.330825+0000","last_peered":"2023-07-21T22:18:44.330825+0000","last_clean":"2023-07-21T22:18:44.330825+0000","last_became_active":"2023-07-21T22:18:43.347529+0000","last_became_peered":"2023-07-21T22:18:43.347529+0000","last_unstale":"2023-07-21T22:18:44.330825+0000","last_undegraded":"2023-07-21T22:18:44.330825+0000","last_fullsized":"2023-07-21T22:18:44.330825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:47:23.185156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.349943+0000","last_change":"2023-07-21T22:18:44.345749+0000","last_active":"2023-07-21T22:18:44.349943+0000","last_peered":"2023-07-21T22:18:44.349943+0000","last_clean":"2023-07-21T22:18:44.349943+0000","last_became_active":"2023-07-21T22:18:44.345413+0000","last_became_peered":"2023-07-21T22:18:44.345413+0000","last_unstale":"2023-07-21T22:18:44.349943+0000","last_undegraded":"2023-07-21T22:18:44.349943+0000","last_fullsized":"2023-07-21T22:18:44.349943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:42.552801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.328401+0000","last_change":"2023-07-21T22:18:43.339680+0000","last_active":"2023-07-21T22:18:44.328401+0000","last_peered":"2023-07-21T22:18:44.328401+0000","last_clean":"2023-07-21T22:18:44.328401+0000","last_became_active":"2023-07-21T22:18:43.339369+0000","last_became_peered":"2023-07-21T22:18:43.339369+0000","last_unstale":"2023-07-21T22:18:44.328401+0000","last_undegraded":"2023-07-21T22:18:44.328401+0000","last_fullsized":"2023-07-21T22:18:44.328401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:49.375113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327311+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:18:44.327311+0000","last_peered":"2023-07-21T22:18:44.327311+0000","last_clean":"2023-07-21T22:18:44.327311+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:18:44.327311+0000","last_undegraded":"2023-07-21T22:18:44.327311+0000","last_fullsized":"2023-07-21T22:18:44.327311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:21.376438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.349907+0000","last_change":"2023-07-21T22:18:44.345981+0000","last_active":"2023-07-21T22:18:44.349907+0000","last_peered":"2023-07-21T22:18:44.349907+0000","last_clean":"2023-07-21T22:18:44.349907+0000","last_became_active":"2023-07-21T22:18:44.345650+0000","last_became_peered":"2023-07-21T22:18:44.345650+0000","last_unstale":"2023-07-21T22:18:44.349907+0000","last_undegraded":"2023-07-21T22:18:44.349907+0000","last_fullsized":"2023-07-21T22:18:44.349907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:29.978550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327210+0000","last_change":"2023-07-21T22:18:43.336788+0000","last_active":"2023-07-21T22:18:44.327210+0000","last_peered":"2023-07-21T22:18:44.327210+0000","last_clean":"2023-07-21T22:18:44.327210+0000","last_became_active":"2023-07-21T22:18:43.336357+0000","last_became_peered":"2023-07-21T22:18:43.336357+0000","last_unstale":"2023-07-21T22:18:44.327210+0000","last_undegraded":"2023-07-21T22:18:44.327210+0000","last_fullsized":"2023-07-21T22:18:44.327210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:29.106844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327443+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:18:44.327443+0000","last_peered":"2023-07-21T22:18:44.327443+0000","last_clean":"2023-07-21T22:18:44.327443+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:18:44.327443+0000","last_undegraded":"2023-07-21T22:18:44.327443+0000","last_fullsized":"2023-07-21T22:18:44.327443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:50:59.658234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346914+0000","last_change":"2023-07-21T22:18:44.345851+0000","last_active":"2023-07-21T22:18:44.346914+0000","last_peered":"2023-07-21T22:18:44.346914+0000","last_clean":"2023-07-21T22:18:44.346914+0000","last_became_active":"2023-07-21T22:18:44.345553+0000","last_became_peered":"2023-07-21T22:18:44.345553+0000","last_unstale":"2023-07-21T22:18:44.346914+0000","last_undegraded":"2023-07-21T22:18:44.346914+0000","last_fullsized":"2023-07-21T22:18:44.346914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:37:46.816193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.545191+0000","last_change":"2023-07-21T22:18:43.335304+0000","last_active":"2023-07-21T22:18:44.545191+0000","last_peered":"2023-07-21T22:18:44.545191+0000","last_clean":"2023-07-21T22:18:44.545191+0000","last_became_active":"2023-07-21T22:18:43.334929+0000","last_became_peered":"2023-07-21T22:18:43.334929+0000","last_unstale":"2023-07-21T22:18:44.545191+0000","last_undegraded":"2023-07-21T22:18:44.545191+0000","last_fullsized":"2023-07-21T22:18:44.545191+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:25.997043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.322299+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:18:44.322299+0000","last_peered":"2023-07-21T22:18:44.322299+0000","last_clean":"2023-07-21T22:18:44.322299+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:18:44.322299+0000","last_undegraded":"2023-07-21T22:18:44.322299+0000","last_fullsized":"2023-07-21T22:18:44.322299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:49.800708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.353585+0000","last_change":"2023-07-21T22:18:44.341231+0000","last_active":"2023-07-21T22:18:44.353585+0000","last_peered":"2023-07-21T22:18:44.353585+0000","last_clean":"2023-07-21T22:18:44.353585+0000","last_became_active":"2023-07-21T22:18:44.340874+0000","last_became_peered":"2023-07-21T22:18:44.340874+0000","last_unstale":"2023-07-21T22:18:44.353585+0000","last_undegraded":"2023-07-21T22:18:44.353585+0000","last_fullsized":"2023-07-21T22:18:44.353585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:54:18.053463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.332682+0000","last_change":"2023-07-21T22:18:43.340557+0000","last_active":"2023-07-21T22:18:44.332682+0000","last_peered":"2023-07-21T22:18:44.332682+0000","last_clean":"2023-07-21T22:18:44.332682+0000","last_became_active":"2023-07-21T22:18:43.340199+0000","last_became_peered":"2023-07-21T22:18:43.340199+0000","last_unstale":"2023-07-21T22:18:44.332682+0000","last_undegraded":"2023-07-21T22:18:44.332682+0000","last_fullsized":"2023-07-21T22:18:44.332682+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:54.833351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-21T22:18:43.323742+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:18:43.323742+0000","last_peered":"2023-07-21T22:18:43.323742+0000","last_clean":"2023-07-21T22:18:43.323742+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:18:43.323742+0000","last_undegraded":"2023-07-21T22:18:43.323742+0000","last_fullsized":"2023-07-21T22:18:43.323742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:54:12.009749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.350300+0000","last_change":"2023-07-21T22:18:44.347206+0000","last_active":"2023-07-21T22:18:44.350300+0000","last_peered":"2023-07-21T22:18:44.350300+0000","last_clean":"2023-07-21T22:18:44.350300+0000","last_became_active":"2023-07-21T22:18:44.346914+0000","last_became_peered":"2023-07-21T22:18:44.346914+0000","last_unstale":"2023-07-21T22:18:44.350300+0000","last_undegraded":"2023-07-21T22:18:44.350300+0000","last_fullsized":"2023-07-21T22:18:44.350300+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:47:23.190588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348379+0000","last_change":"2023-07-21T22:18:44.343986+0000","last_active":"2023-07-21T22:18:44.348379+0000","last_peered":"2023-07-21T22:18:44.348379+0000","last_clean":"2023-07-21T22:18:44.348379+0000","last_became_active":"2023-07-21T22:18:44.342943+0000","last_became_peered":"2023-07-21T22:18:44.342943+0000","last_unstale":"2023-07-21T22:18:44.348379+0000","last_undegraded":"2023-07-21T22:18:44.348379+0000","last_fullsized":"2023-07-21T22:18:44.348379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:25:56.912736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"25'6","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.551448+0000","last_change":"2023-07-21T22:18:43.336129+0000","last_active":"2023-07-21T22:18:44.551448+0000","last_peered":"2023-07-21T22:18:44.551448+0000","last_clean":"2023-07-21T22:18:44.551448+0000","last_became_active":"2023-07-21T22:18:43.335850+0000","last_became_peered":"2023-07-21T22:18:43.335850+0000","last_unstale":"2023-07-21T22:18:44.551448+0000","last_undegraded":"2023-07-21T22:18:44.551448+0000","last_fullsized":"2023-07-21T22:18:44.551448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:21:31.802323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.353149+0000","last_change":"2023-07-21T22:18:44.351088+0000","last_active":"2023-07-21T22:18:44.353149+0000","last_peered":"2023-07-21T22:18:44.353149+0000","last_clean":"2023-07-21T22:18:44.353149+0000","last_became_active":"2023-07-21T22:18:44.350791+0000","last_became_peered":"2023-07-21T22:18:44.350791+0000","last_unstale":"2023-07-21T22:18:44.353149+0000","last_undegraded":"2023-07-21T22:18:44.353149+0000","last_fullsized":"2023-07-21T22:18:44.353149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:27.008113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"25'3","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.544002+0000","last_change":"2023-07-21T22:18:43.340832+0000","last_active":"2023-07-21T22:18:44.544002+0000","last_peered":"2023-07-21T22:18:44.544002+0000","last_clean":"2023-07-21T22:18:44.544002+0000","last_became_active":"2023-07-21T22:18:43.340519+0000","last_became_peered":"2023-07-21T22:18:43.340519+0000","last_unstale":"2023-07-21T22:18:44.544002+0000","last_undegraded":"2023-07-21T22:18:44.544002+0000","last_fullsized":"2023-07-21T22:18:44.544002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:59:20.160352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.327327+0000","last_change":"2023-07-21T22:18:43.335834+0000","last_active":"2023-07-21T22:18:44.327327+0000","last_peered":"2023-07-21T22:18:44.327327+0000","last_clean":"2023-07-21T22:18:44.327327+0000","last_became_active":"2023-07-21T22:18:43.335518+0000","last_became_peered":"2023-07-21T22:18:43.335518+0000","last_unstale":"2023-07-21T22:18:44.327327+0000","last_undegraded":"2023-07-21T22:18:44.327327+0000","last_fullsized":"2023-07-21T22:18:44.327327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:59:20.160352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.354632+0000","last_change":"2023-07-21T22:18:44.349059+0000","last_active":"2023-07-21T22:18:44.354632+0000","last_peered":"2023-07-21T22:18:44.354632+0000","last_clean":"2023-07-21T22:18:44.354632+0000","last_became_active":"2023-07-21T22:18:44.348691+0000","last_became_peered":"2023-07-21T22:18:44.348691+0000","last_unstale":"2023-07-21T22:18:44.354632+0000","last_undegraded":"2023-07-21T22:18:44.354632+0000","last_fullsized":"2023-07-21T22:18:44.354632+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:12:36.391754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.331983+0000","last_change":"2023-07-21T22:18:43.341273+0000","last_active":"2023-07-21T22:18:44.331983+0000","last_peered":"2023-07-21T22:18:44.331983+0000","last_clean":"2023-07-21T22:18:44.331983+0000","last_became_active":"2023-07-21T22:18:43.340594+0000","last_became_peered":"2023-07-21T22:18:43.340594+0000","last_unstale":"2023-07-21T22:18:44.331983+0000","last_undegraded":"2023-07-21T22:18:44.331983+0000","last_fullsized":"2023-07-21T22:18:44.331983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:30:06.913006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.353533+0000","last_change":"2023-07-21T22:18:44.341063+0000","last_active":"2023-07-21T22:18:44.353533+0000","last_peered":"2023-07-21T22:18:44.353533+0000","last_clean":"2023-07-21T22:18:44.353533+0000","last_became_active":"2023-07-21T22:18:44.337396+0000","last_became_peered":"2023-07-21T22:18:44.337396+0000","last_unstale":"2023-07-21T22:18:44.353533+0000","last_undegraded":"2023-07-21T22:18:44.353533+0000","last_fullsized":"2023-07-21T22:18:44.353533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:54.484564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":24,"state":"creating+peering","last_fresh":"2023-07-21T22:18:43.319518+0000","last_change":"2023-07-21T22:18:43.319518+0000","last_active":"2023-07-21T22:18:43.300562+0000","last_peered":"2023-07-21T22:18:43.300562+0000","last_clean":"2023-07-21T22:18:43.300562+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:18:43.319518+0000","last_undegraded":"2023-07-21T22:18:43.319518+0000","last_fullsized":"2023-07-21T22:18:43.319518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.329796+0000","last_change":"2023-07-21T22:18:43.341804+0000","last_active":"2023-07-21T22:18:44.329796+0000","last_peered":"2023-07-21T22:18:44.329796+0000","last_clean":"2023-07-21T22:18:44.329796+0000","last_became_active":"2023-07-21T22:18:43.341205+0000","last_became_peered":"2023-07-21T22:18:43.341205+0000","last_unstale":"2023-07-21T22:18:44.329796+0000","last_undegraded":"2023-07-21T22:18:44.329796+0000","last_fullsized":"2023-07-21T22:18:44.329796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:03:21.376838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.339571+0000","last_change":"2023-07-21T22:18:44.338013+0000","last_active":"2023-07-21T22:18:44.339571+0000","last_peered":"2023-07-21T22:18:44.339571+0000","last_clean":"2023-07-21T22:18:44.339571+0000","last_became_active":"2023-07-21T22:18:44.337701+0000","last_became_peered":"2023-07-21T22:18:44.337701+0000","last_unstale":"2023-07-21T22:18:44.339571+0000","last_undegraded":"2023-07-21T22:18:44.339571+0000","last_fullsized":"2023-07-21T22:18:44.339571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:51.413018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.321576+0000","last_change":"2023-07-21T22:18:43.337656+0000","last_active":"2023-07-21T22:18:44.321576+0000","last_peered":"2023-07-21T22:18:44.321576+0000","last_clean":"2023-07-21T22:18:44.321576+0000","last_became_active":"2023-07-21T22:18:43.337228+0000","last_became_peered":"2023-07-21T22:18:43.337228+0000","last_unstale":"2023-07-21T22:18:44.321576+0000","last_undegraded":"2023-07-21T22:18:44.321576+0000","last_fullsized":"2023-07-21T22:18:44.321576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:26:53.788877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348787+0000","last_change":"2023-07-21T22:18:44.337074+0000","last_active":"2023-07-21T22:18:44.348787+0000","last_peered":"2023-07-21T22:18:44.348787+0000","last_clean":"2023-07-21T22:18:44.348787+0000","last_became_active":"2023-07-21T22:18:44.336374+0000","last_became_peered":"2023-07-21T22:18:44.336374+0000","last_unstale":"2023-07-21T22:18:44.348787+0000","last_undegraded":"2023-07-21T22:18:44.348787+0000","last_fullsized":"2023-07-21T22:18:44.348787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:12.868716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"25'1","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.545999+0000","last_change":"2023-07-21T22:18:43.343871+0000","last_active":"2023-07-21T22:18:44.545999+0000","last_peered":"2023-07-21T22:18:44.545999+0000","last_clean":"2023-07-21T22:18:44.545999+0000","last_became_active":"2023-07-21T22:18:43.342848+0000","last_became_peered":"2023-07-21T22:18:43.342848+0000","last_unstale":"2023-07-21T22:18:44.545999+0000","last_undegraded":"2023-07-21T22:18:44.545999+0000","last_fullsized":"2023-07-21T22:18:44.545999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:19.519544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.342991+0000","last_change":"2023-07-21T22:18:44.338868+0000","last_active":"2023-07-21T22:18:44.342991+0000","last_peered":"2023-07-21T22:18:44.342991+0000","last_clean":"2023-07-21T22:18:44.342991+0000","last_became_active":"2023-07-21T22:18:44.337629+0000","last_became_peered":"2023-07-21T22:18:44.337629+0000","last_unstale":"2023-07-21T22:18:44.342991+0000","last_undegraded":"2023-07-21T22:18:44.342991+0000","last_fullsized":"2023-07-21T22:18:44.342991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:54:18.053463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"25'1","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.538568+0000","last_change":"2023-07-21T22:18:43.347419+0000","last_active":"2023-07-21T22:18:44.538568+0000","last_peered":"2023-07-21T22:18:44.538568+0000","last_clean":"2023-07-21T22:18:44.538568+0000","last_became_active":"2023-07-21T22:18:43.347118+0000","last_became_peered":"2023-07-21T22:18:43.347118+0000","last_unstale":"2023-07-21T22:18:44.538568+0000","last_undegraded":"2023-07-21T22:18:44.538568+0000","last_fullsized":"2023-07-21T22:18:44.538568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:03:21.376838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348407+0000","last_change":"2023-07-21T22:18:44.345638+0000","last_active":"2023-07-21T22:18:44.348407+0000","last_peered":"2023-07-21T22:18:44.348407+0000","last_clean":"2023-07-21T22:18:44.348407+0000","last_became_active":"2023-07-21T22:18:44.345310+0000","last_became_peered":"2023-07-21T22:18:44.345310+0000","last_unstale":"2023-07-21T22:18:44.348407+0000","last_undegraded":"2023-07-21T22:18:44.348407+0000","last_fullsized":"2023-07-21T22:18:44.348407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:30:26.113148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.545323+0000","last_change":"2023-07-21T22:18:43.345885+0000","last_active":"2023-07-21T22:18:44.545323+0000","last_peered":"2023-07-21T22:18:44.545323+0000","last_clean":"2023-07-21T22:18:44.545323+0000","last_became_active":"2023-07-21T22:18:43.345540+0000","last_became_peered":"2023-07-21T22:18:43.345540+0000","last_unstale":"2023-07-21T22:18:44.545323+0000","last_undegraded":"2023-07-21T22:18:44.545323+0000","last_fullsized":"2023-07-21T22:18:44.545323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:23:16.582471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.348486+0000","last_change":"2023-07-21T22:18:44.346068+0000","last_active":"2023-07-21T22:18:44.348486+0000","last_peered":"2023-07-21T22:18:44.348486+0000","last_clean":"2023-07-21T22:18:44.348486+0000","last_became_active":"2023-07-21T22:18:44.345741+0000","last_became_peered":"2023-07-21T22:18:44.345741+0000","last_unstale":"2023-07-21T22:18:44.348486+0000","last_undegraded":"2023-07-21T22:18:44.348486+0000","last_fullsized":"2023-07-21T22:18:44.348486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:33:31.334871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.544215+0000","last_change":"2023-07-21T22:18:43.342235+0000","last_active":"2023-07-21T22:18:44.544215+0000","last_peered":"2023-07-21T22:18:44.544215+0000","last_clean":"2023-07-21T22:18:44.544215+0000","last_became_active":"2023-07-21T22:18:43.341945+0000","last_became_peered":"2023-07-21T22:18:43.341945+0000","last_unstale":"2023-07-21T22:18:44.544215+0000","last_undegraded":"2023-07-21T22:18:44.544215+0000","last_fullsized":"2023-07-21T22:18:44.544215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:25:33.381132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.353801+0000","last_change":"2023-07-21T22:18:44.342724+0000","last_active":"2023-07-21T22:18:44.353801+0000","last_peered":"2023-07-21T22:18:44.353801+0000","last_clean":"2023-07-21T22:18:44.353801+0000","last_became_active":"2023-07-21T22:18:44.342450+0000","last_became_peered":"2023-07-21T22:18:44.342450+0000","last_unstale":"2023-07-21T22:18:44.353801+0000","last_undegraded":"2023-07-21T22:18:44.353801+0000","last_fullsized":"2023-07-21T22:18:44.353801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:57:20.260229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.542136+0000","last_change":"2023-07-21T22:18:43.328543+0000","last_active":"2023-07-21T22:18:44.542136+0000","last_peered":"2023-07-21T22:18:44.542136+0000","last_clean":"2023-07-21T22:18:44.542136+0000","last_became_active":"2023-07-21T22:18:43.328165+0000","last_became_peered":"2023-07-21T22:18:43.328165+0000","last_unstale":"2023-07-21T22:18:44.542136+0000","last_undegraded":"2023-07-21T22:18:44.542136+0000","last_fullsized":"2023-07-21T22:18:44.542136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:54.833351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.346881+0000","last_change":"2023-07-21T22:18:44.343626+0000","last_active":"2023-07-21T22:18:44.346881+0000","last_peered":"2023-07-21T22:18:44.346881+0000","last_clean":"2023-07-21T22:18:44.346881+0000","last_became_active":"2023-07-21T22:18:44.343339+0000","last_became_peered":"2023-07-21T22:18:44.343339+0000","last_unstale":"2023-07-21T22:18:44.346881+0000","last_undegraded":"2023-07-21T22:18:44.346881+0000","last_fullsized":"2023-07-21T22:18:44.346881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:36:40.719765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"25'4","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-21T22:18:44.542522+0000","last_change":"2023-07-21T22:18:43.341441+0000","last_active":"2023-07-21T22:18:44.542522+0000","last_peered":"2023-07-21T22:18:44.542522+0000","last_clean":"2023-07-21T22:18:44.542522+0000","last_became_active":"2023-07-21T22:18:43.340962+0000","last_became_peered":"2023-07-21T22:18:43.340962+0000","last_unstale":"2023-07-21T22:18:44.542522+0000","last_undegraded":"2023-07-21T22:18:44.542522+0000","last_fullsized":"2023-07-21T22:18:44.542522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:28.967479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":839680,"data_stored":676715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":86347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":86347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":93475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":93475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":93475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":856064,"data_stored":684425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":86347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.55}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7470000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1829999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:18:50.481 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-07-21T22:18:50.437+0000 7f5d9f13c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:18:53.246 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:18:53.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.356+0000 7f6cad174640 1 Processor -- start 2023-07-21T22:18:53.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.356+0000 7f6cad174640 1 -- start start 2023-07-21T22:18:53.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.356+0000 7f6cad174640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ca80b7c70 0x7f6ca80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.356+0000 7f6cad174640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6ca80d1850 0x7f6ca815f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.356+0000 7f6cad174640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca80ccaf0 con 0x7f6ca80d1300 2023-07-21T22:18:53.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.356+0000 7f6cad174640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca80d1190 con 0x7f6ca80d1850 2023-07-21T22:18:53.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.356+0000 7f6cad174640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8160600 con 0x7f6ca80b7c70 2023-07-21T22:18:53.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.356+0000 7f6ca6d9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ca80b7c70 0x7f6ca80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.356+0000 7f6c9ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6ca80d1850 0x7f6ca815f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.356+0000 7f6ca6d9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ca80b7c70 0x7f6ca80d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:57708/0 (socket says 172.21.15.6:57708) 2023-07-21T22:18:53.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.356+0000 7f6c9ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6ca80d1850 0x7f6ca815f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:47806/0 (socket says 172.21.15.6:47806) 2023-07-21T22:18:53.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.356+0000 7f6ca759e640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6ca80d1300 0x7f6ca80d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:37264/0 (socket says 172.21.15.6:37264) 2023-07-21T22:18:53.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.356+0000 7f6ca6d9d640 1 -- 172.21.15.6:0/3252551731 learned_addr learned my addr 172.21.15.6:0/3252551731 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:53.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.356+0000 7f6c9ffff640 1 -- 172.21.15.6:0/3252551731 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ca80b7c70 msgr2=0x7f6ca80d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:53.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.356+0000 7f6c9ffff640 1 --2- 172.21.15.6:0/3252551731 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ca80b7c70 0x7f6ca80d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.356+0000 7f6c9ffff640 1 -- 172.21.15.6:0/3252551731 >> v1:172.21.15.161:6789/0 conn(0x7f6ca80d1300 legacy=0x7f6ca80d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.356+0000 7f6c9ffff640 1 -- 172.21.15.6:0/3252551731 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca8160320 con 0x7f6ca80d1850 2023-07-21T22:18:53.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.360+0000 7f6c9ffff640 1 --2- 172.21.15.6:0/3252551731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ca80d1850 0x7f6ca815f650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6c900097f0 tx=0x7f6c9001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f63542006c36528 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:53.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.360+0000 7f6ca659c640 1 -- 172.21.15.6:0/3252551731 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900ad660 con 0x7f6ca80d1850 2023-07-21T22:18:53.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.360+0000 7f6ca659c640 1 -- 172.21.15.6:0/3252551731 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c900ad7c0 con 0x7f6ca80d1850 2023-07-21T22:18:53.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.360+0000 7f6ca659c640 1 -- 172.21.15.6:0/3252551731 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900adb50 con 0x7f6ca80d1850 2023-07-21T22:18:53.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.360+0000 7f6cad174640 1 -- 172.21.15.6:0/3252551731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ca80d1850 msgr2=0x7f6ca815f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.360+0000 7f6cad174640 1 --2- 172.21.15.6:0/3252551731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ca80d1850 0x7f6ca815f650 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6c900097f0 tx=0x7f6c9001c450 comp rx=0 tx=0).stop 2023-07-21T22:18:53.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.360+0000 7f6cad174640 1 -- 172.21.15.6:0/3252551731 shutdown_connections 2023-07-21T22:18:53.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.360+0000 7f6cad174640 1 --2- 172.21.15.6:0/3252551731 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ca80d1850 0x7f6ca815f650 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.360+0000 7f6cad174640 1 --2- 172.21.15.6:0/3252551731 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ca80b7c70 0x7f6ca80d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.360+0000 7f6cad174640 1 -- 172.21.15.6:0/3252551731 >> 172.21.15.6:0/3252551731 conn(0x7f6ca80650b0 msgr2=0x7f6ca80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:53.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.360+0000 7f6cad174640 1 -- 172.21.15.6:0/3252551731 shutdown_connections 2023-07-21T22:18:53.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.360+0000 7f6cad174640 1 -- 172.21.15.6:0/3252551731 wait complete. 2023-07-21T22:18:53.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6cad174640 1 Processor -- start 2023-07-21T22:18:53.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6cad174640 1 -- start start 2023-07-21T22:18:53.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6cad174640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ca80b7c70 0x7f6ca81539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6cad174640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ca80d1300 0x7f6ca80c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6cad174640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ca80d1850 0x7f6ca80b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6cad174640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca81550c0 con 0x7f6ca80d1300 2023-07-21T22:18:53.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6cad174640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca81554e0 con 0x7f6ca80b7c70 2023-07-21T22:18:53.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6cad174640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8154160 con 0x7f6ca80d1850 2023-07-21T22:18:53.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6c9ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ca80d1300 0x7f6ca80c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6c9ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ca80d1300 0x7f6ca80c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46724/0 (socket says 172.21.15.6:46724) 2023-07-21T22:18:53.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6c9ffff640 1 -- 172.21.15.6:0/315803372 learned_addr learned my addr 172.21.15.6:0/315803372 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:53.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6ca6d9d640 1 --2- 172.21.15.6:0/315803372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ca80b7c70 0x7f6ca81539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6ca759e640 1 --2- 172.21.15.6:0/315803372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ca80d1850 0x7f6ca80b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6c9ffff640 1 -- 172.21.15.6:0/315803372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ca80d1850 msgr2=0x7f6ca80b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6c9ffff640 1 --2- 172.21.15.6:0/315803372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ca80d1850 0x7f6ca80b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6c9ffff640 1 -- 172.21.15.6:0/315803372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ca80b7c70 msgr2=0x7f6ca81539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6c9ffff640 1 --2- 172.21.15.6:0/315803372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ca80b7c70 0x7f6ca81539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6c9ffff640 1 -- 172.21.15.6:0/315803372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c90009420 con 0x7f6ca80d1300 2023-07-21T22:18:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6c9ffff640 1 --2- 172.21.15.6:0/315803372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ca80d1300 0x7f6ca80c9e50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6c900b0040 tx=0x7f6c900191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:53.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6c9f7fe640 1 -- 172.21.15.6:0/315803372 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900b6610 con 0x7f6ca80d1300 2023-07-21T22:18:53.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6c9f7fe640 1 -- 172.21.15.6:0/315803372 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c900b67b0 con 0x7f6ca80d1300 2023-07-21T22:18:53.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6c9f7fe640 1 -- 172.21.15.6:0/315803372 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900b6b60 con 0x7f6ca80d1300 2023-07-21T22:18:53.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6cad174640 1 -- 172.21.15.6:0/315803372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca8154440 con 0x7f6ca80d1300 2023-07-21T22:18:53.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.364+0000 7f6cad174640 1 -- 172.21.15.6:0/315803372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca8154a00 con 0x7f6ca80d1300 2023-07-21T22:18:53.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.368+0000 7f6cad174640 1 -- 172.21.15.6:0/315803372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca80678d0 con 0x7f6ca80d1300 2023-07-21T22:18:53.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.368+0000 7f6c9f7fe640 1 -- 172.21.15.6:0/315803372 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6c900b4040 con 0x7f6ca80d1300 2023-07-21T22:18:53.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.368+0000 7f6c9f7fe640 1 --2- 172.21.15.6:0/315803372 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6c88066280 0x7f6c88068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.368+0000 7f6c9f7fe640 1 -- 172.21.15.6:0/315803372 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6c9011e0d0 con 0x7f6ca80d1300 2023-07-21T22:18:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.368+0000 7f6ca6d9d640 1 --2- 172.21.15.6:0/315803372 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6c88066280 0x7f6c88068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.368+0000 7f6ca6d9d640 1 --2- 172.21.15.6:0/315803372 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6c88066280 0x7f6c88068730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80cdfe0 tx=0x7f6c98009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.372+0000 7f6c9f7fe640 1 -- 172.21.15.6:0/315803372 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6c900eb570 con 0x7f6ca80d1300 2023-07-21T22:18:53.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.520+0000 7f6cad174640 1 -- 172.21.15.6:0/315803372 --> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ca815ffa0 con 0x7f6c88066280 2023-07-21T22:18:53.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.532+0000 7f6c9f7fe640 1 -- 172.21.15.6:0/315803372 <== mgr.4103 v2:172.21.15.161:6832/3471136886 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286700 (secure 0 0 0) 0x7f6c98011a00 con 0x7f6c88066280 2023-07-21T22:18:53.580 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:18:53.581 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:18:53.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.536+0000 7f6cad174640 1 -- 172.21.15.6:0/315803372 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6c88066280 msgr2=0x7f6c88068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.536+0000 7f6cad174640 1 --2- 172.21.15.6:0/315803372 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6c88066280 0x7f6c88068730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80cdfe0 tx=0x7f6c98009240 comp rx=0 tx=0).stop 2023-07-21T22:18:53.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.536+0000 7f6cad174640 1 -- 172.21.15.6:0/315803372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ca80d1300 msgr2=0x7f6ca80c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.536+0000 7f6cad174640 1 --2- 172.21.15.6:0/315803372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ca80d1300 0x7f6ca80c9e50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6c900b0040 tx=0x7f6c900191f0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.536+0000 7f6cad174640 1 -- 172.21.15.6:0/315803372 shutdown_connections 2023-07-21T22:18:53.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.536+0000 7f6cad174640 1 --2- 172.21.15.6:0/315803372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ca80d1850 0x7f6ca80b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.536+0000 7f6cad174640 1 --2- 172.21.15.6:0/315803372 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6c88066280 0x7f6c88068730 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.536+0000 7f6cad174640 1 --2- 172.21.15.6:0/315803372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ca80d1300 0x7f6ca80c9e50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.536+0000 7f6cad174640 1 --2- 172.21.15.6:0/315803372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ca80b7c70 0x7f6ca81539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.536+0000 7f6cad174640 1 -- 172.21.15.6:0/315803372 >> 172.21.15.6:0/315803372 conn(0x7f6ca80650b0 msgr2=0x7f6ca80cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:53.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.536+0000 7f6cad174640 1 -- 172.21.15.6:0/315803372 shutdown_connections 2023-07-21T22:18:53.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.536+0000 7f6cad174640 1 -- 172.21.15.6:0/315803372 wait complete. 2023-07-21T22:18:53.600 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2023-07-21T22:18:52.769936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218952,"kb_used_data":3336,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755768,"statfs":{"total":773094113280,"available":772869906432,"internally_reserved":0,"allocated":3416064,"data_stored":1986484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.451763"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796317+0000","last_change":"2023-07-21T22:18:44.336499+0000","last_active":"2023-07-21T22:18:45.796317+0000","last_peered":"2023-07-21T22:18:45.796317+0000","last_clean":"2023-07-21T22:18:45.796317+0000","last_became_active":"2023-07-21T22:18:44.336063+0000","last_became_peered":"2023-07-21T22:18:44.336063+0000","last_unstale":"2023-07-21T22:18:45.796317+0000","last_undegraded":"2023-07-21T22:18:45.796317+0000","last_fullsized":"2023-07-21T22:18:45.796317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:26:54.799948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327558+0000","last_change":"2023-07-21T22:18:44.341470+0000","last_active":"2023-07-21T22:18:45.327558+0000","last_peered":"2023-07-21T22:18:45.327558+0000","last_clean":"2023-07-21T22:18:45.327558+0000","last_became_active":"2023-07-21T22:18:44.341148+0000","last_became_peered":"2023-07-21T22:18:44.341148+0000","last_unstale":"2023-07-21T22:18:45.327558+0000","last_undegraded":"2023-07-21T22:18:45.327558+0000","last_fullsized":"2023-07-21T22:18:45.327558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:43.536674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.328154+0000","last_change":"2023-07-21T22:18:44.336245+0000","last_active":"2023-07-21T22:18:45.328154+0000","last_peered":"2023-07-21T22:18:45.328154+0000","last_clean":"2023-07-21T22:18:45.328154+0000","last_became_active":"2023-07-21T22:18:44.335682+0000","last_became_peered":"2023-07-21T22:18:44.335682+0000","last_unstale":"2023-07-21T22:18:45.328154+0000","last_undegraded":"2023-07-21T22:18:45.328154+0000","last_fullsized":"2023-07-21T22:18:45.328154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:40:01.001208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797167+0000","last_change":"2023-07-21T22:18:44.335476+0000","last_active":"2023-07-21T22:18:45.797167+0000","last_peered":"2023-07-21T22:18:45.797167+0000","last_clean":"2023-07-21T22:18:45.797167+0000","last_became_active":"2023-07-21T22:18:44.335151+0000","last_became_peered":"2023-07-21T22:18:44.335151+0000","last_unstale":"2023-07-21T22:18:45.797167+0000","last_undegraded":"2023-07-21T22:18:45.797167+0000","last_fullsized":"2023-07-21T22:18:45.797167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:38:06.965559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795835+0000","last_change":"2023-07-21T22:18:44.344066+0000","last_active":"2023-07-21T22:18:45.795835+0000","last_peered":"2023-07-21T22:18:45.795835+0000","last_clean":"2023-07-21T22:18:45.795835+0000","last_became_active":"2023-07-21T22:18:44.343765+0000","last_became_peered":"2023-07-21T22:18:44.343765+0000","last_unstale":"2023-07-21T22:18:45.795835+0000","last_undegraded":"2023-07-21T22:18:45.795835+0000","last_fullsized":"2023-07-21T22:18:45.795835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:45:28.665708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326588+0000","last_change":"2023-07-21T22:18:44.336096+0000","last_active":"2023-07-21T22:18:45.326588+0000","last_peered":"2023-07-21T22:18:45.326588+0000","last_clean":"2023-07-21T22:18:45.326588+0000","last_became_active":"2023-07-21T22:18:44.335625+0000","last_became_peered":"2023-07-21T22:18:44.335625+0000","last_unstale":"2023-07-21T22:18:45.326588+0000","last_undegraded":"2023-07-21T22:18:45.326588+0000","last_fullsized":"2023-07-21T22:18:45.326588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:50.386184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797019+0000","last_change":"2023-07-21T22:18:44.338953+0000","last_active":"2023-07-21T22:18:45.797019+0000","last_peered":"2023-07-21T22:18:45.797019+0000","last_clean":"2023-07-21T22:18:45.797019+0000","last_became_active":"2023-07-21T22:18:44.338582+0000","last_became_peered":"2023-07-21T22:18:44.338582+0000","last_unstale":"2023-07-21T22:18:45.797019+0000","last_undegraded":"2023-07-21T22:18:45.797019+0000","last_fullsized":"2023-07-21T22:18:45.797019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:27:12.501057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327145+0000","last_change":"2023-07-21T22:18:44.337662+0000","last_active":"2023-07-21T22:18:45.327145+0000","last_peered":"2023-07-21T22:18:45.327145+0000","last_clean":"2023-07-21T22:18:45.327145+0000","last_became_active":"2023-07-21T22:18:44.337217+0000","last_became_peered":"2023-07-21T22:18:44.337217+0000","last_unstale":"2023-07-21T22:18:45.327145+0000","last_undegraded":"2023-07-21T22:18:45.327145+0000","last_fullsized":"2023-07-21T22:18:45.327145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:10:33.167054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795402+0000","last_change":"2023-07-21T22:18:44.344268+0000","last_active":"2023-07-21T22:18:45.795402+0000","last_peered":"2023-07-21T22:18:45.795402+0000","last_clean":"2023-07-21T22:18:45.795402+0000","last_became_active":"2023-07-21T22:18:44.343880+0000","last_became_peered":"2023-07-21T22:18:44.343880+0000","last_unstale":"2023-07-21T22:18:45.795402+0000","last_undegraded":"2023-07-21T22:18:45.795402+0000","last_fullsized":"2023-07-21T22:18:45.795402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:59:41.204617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327626+0000","last_change":"2023-07-21T22:18:44.336379+0000","last_active":"2023-07-21T22:18:45.327626+0000","last_peered":"2023-07-21T22:18:45.327626+0000","last_clean":"2023-07-21T22:18:45.327626+0000","last_became_active":"2023-07-21T22:18:44.335846+0000","last_became_peered":"2023-07-21T22:18:44.335846+0000","last_unstale":"2023-07-21T22:18:45.327626+0000","last_undegraded":"2023-07-21T22:18:45.327626+0000","last_fullsized":"2023-07-21T22:18:45.327626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:39:23.702494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.328146+0000","last_change":"2023-07-21T22:18:44.352832+0000","last_active":"2023-07-21T22:18:45.328146+0000","last_peered":"2023-07-21T22:18:45.328146+0000","last_clean":"2023-07-21T22:18:45.328146+0000","last_became_active":"2023-07-21T22:18:44.352465+0000","last_became_peered":"2023-07-21T22:18:44.352465+0000","last_unstale":"2023-07-21T22:18:45.328146+0000","last_undegraded":"2023-07-21T22:18:45.328146+0000","last_fullsized":"2023-07-21T22:18:45.328146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:08:29.897882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796396+0000","last_change":"2023-07-21T22:18:44.337129+0000","last_active":"2023-07-21T22:18:45.796396+0000","last_peered":"2023-07-21T22:18:45.796396+0000","last_clean":"2023-07-21T22:18:45.796396+0000","last_became_active":"2023-07-21T22:18:44.336170+0000","last_became_peered":"2023-07-21T22:18:44.336170+0000","last_unstale":"2023-07-21T22:18:45.796396+0000","last_undegraded":"2023-07-21T22:18:45.796396+0000","last_fullsized":"2023-07-21T22:18:45.796396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:03:22.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796163+0000","last_change":"2023-07-21T22:18:44.335382+0000","last_active":"2023-07-21T22:18:45.796163+0000","last_peered":"2023-07-21T22:18:45.796163+0000","last_clean":"2023-07-21T22:18:45.796163+0000","last_became_active":"2023-07-21T22:18:44.334933+0000","last_became_peered":"2023-07-21T22:18:44.334933+0000","last_unstale":"2023-07-21T22:18:45.796163+0000","last_undegraded":"2023-07-21T22:18:45.796163+0000","last_fullsized":"2023-07-21T22:18:45.796163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:51.413018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327284+0000","last_change":"2023-07-21T22:18:44.333998+0000","last_active":"2023-07-21T22:18:45.327284+0000","last_peered":"2023-07-21T22:18:45.327284+0000","last_clean":"2023-07-21T22:18:45.327284+0000","last_became_active":"2023-07-21T22:18:44.333720+0000","last_became_peered":"2023-07-21T22:18:44.333720+0000","last_unstale":"2023-07-21T22:18:45.327284+0000","last_undegraded":"2023-07-21T22:18:45.327284+0000","last_fullsized":"2023-07-21T22:18:45.327284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:40:46.117470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797150+0000","last_change":"2023-07-21T22:18:44.341061+0000","last_active":"2023-07-21T22:18:45.797150+0000","last_peered":"2023-07-21T22:18:45.797150+0000","last_clean":"2023-07-21T22:18:45.797150+0000","last_became_active":"2023-07-21T22:18:44.340711+0000","last_became_peered":"2023-07-21T22:18:44.340711+0000","last_unstale":"2023-07-21T22:18:45.797150+0000","last_undegraded":"2023-07-21T22:18:45.797150+0000","last_fullsized":"2023-07-21T22:18:45.797150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:08:29.897882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326507+0000","last_change":"2023-07-21T22:18:44.335984+0000","last_active":"2023-07-21T22:18:45.326507+0000","last_peered":"2023-07-21T22:18:45.326507+0000","last_clean":"2023-07-21T22:18:45.326507+0000","last_became_active":"2023-07-21T22:18:44.335481+0000","last_became_peered":"2023-07-21T22:18:44.335481+0000","last_unstale":"2023-07-21T22:18:45.326507+0000","last_undegraded":"2023-07-21T22:18:45.326507+0000","last_fullsized":"2023-07-21T22:18:45.326507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:05.701948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795507+0000","last_change":"2023-07-21T22:18:44.333526+0000","last_active":"2023-07-21T22:18:45.795507+0000","last_peered":"2023-07-21T22:18:45.795507+0000","last_clean":"2023-07-21T22:18:45.795507+0000","last_became_active":"2023-07-21T22:18:44.333139+0000","last_became_peered":"2023-07-21T22:18:44.333139+0000","last_unstale":"2023-07-21T22:18:45.795507+0000","last_undegraded":"2023-07-21T22:18:45.795507+0000","last_fullsized":"2023-07-21T22:18:45.795507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:55:23.041464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327855+0000","last_change":"2023-07-21T22:18:44.339606+0000","last_active":"2023-07-21T22:18:45.327855+0000","last_peered":"2023-07-21T22:18:45.327855+0000","last_clean":"2023-07-21T22:18:45.327855+0000","last_became_active":"2023-07-21T22:18:44.339282+0000","last_became_peered":"2023-07-21T22:18:44.339282+0000","last_unstale":"2023-07-21T22:18:45.327855+0000","last_undegraded":"2023-07-21T22:18:45.327855+0000","last_fullsized":"2023-07-21T22:18:45.327855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:19:32.663742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796266+0000","last_change":"2023-07-21T22:18:44.325126+0000","last_active":"2023-07-21T22:18:45.796266+0000","last_peered":"2023-07-21T22:18:45.796266+0000","last_clean":"2023-07-21T22:18:45.796266+0000","last_became_active":"2023-07-21T22:18:44.324795+0000","last_became_peered":"2023-07-21T22:18:44.324795+0000","last_unstale":"2023-07-21T22:18:45.796266+0000","last_undegraded":"2023-07-21T22:18:45.796266+0000","last_fullsized":"2023-07-21T22:18:45.796266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:05.638943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327584+0000","last_change":"2023-07-21T22:18:44.338316+0000","last_active":"2023-07-21T22:18:45.327584+0000","last_peered":"2023-07-21T22:18:45.327584+0000","last_clean":"2023-07-21T22:18:45.327584+0000","last_became_active":"2023-07-21T22:18:44.337895+0000","last_became_peered":"2023-07-21T22:18:44.337895+0000","last_unstale":"2023-07-21T22:18:45.327584+0000","last_undegraded":"2023-07-21T22:18:45.327584+0000","last_fullsized":"2023-07-21T22:18:45.327584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:39:23.702494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796989+0000","last_change":"2023-07-21T22:18:44.355582+0000","last_active":"2023-07-21T22:18:45.796989+0000","last_peered":"2023-07-21T22:18:45.796989+0000","last_clean":"2023-07-21T22:18:45.796989+0000","last_became_active":"2023-07-21T22:18:44.355317+0000","last_became_peered":"2023-07-21T22:18:44.355317+0000","last_unstale":"2023-07-21T22:18:45.796989+0000","last_undegraded":"2023-07-21T22:18:45.796989+0000","last_fullsized":"2023-07-21T22:18:45.796989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:06.515061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.794789+0000","last_change":"2023-07-21T22:18:44.348333+0000","last_active":"2023-07-21T22:18:45.794789+0000","last_peered":"2023-07-21T22:18:45.794789+0000","last_clean":"2023-07-21T22:18:45.794789+0000","last_became_active":"2023-07-21T22:18:44.347982+0000","last_became_peered":"2023-07-21T22:18:44.347982+0000","last_unstale":"2023-07-21T22:18:45.794789+0000","last_undegraded":"2023-07-21T22:18:45.794789+0000","last_fullsized":"2023-07-21T22:18:45.794789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:27.420151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325227+0000","last_change":"2023-07-21T22:18:44.333429+0000","last_active":"2023-07-21T22:18:45.325227+0000","last_peered":"2023-07-21T22:18:45.325227+0000","last_clean":"2023-07-21T22:18:45.325227+0000","last_became_active":"2023-07-21T22:18:44.333121+0000","last_became_peered":"2023-07-21T22:18:44.333121+0000","last_unstale":"2023-07-21T22:18:45.325227+0000","last_undegraded":"2023-07-21T22:18:45.325227+0000","last_fullsized":"2023-07-21T22:18:45.325227+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:30.117915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796802+0000","last_change":"2023-07-21T22:18:44.346478+0000","last_active":"2023-07-21T22:18:45.796802+0000","last_peered":"2023-07-21T22:18:45.796802+0000","last_clean":"2023-07-21T22:18:45.796802+0000","last_became_active":"2023-07-21T22:18:44.346160+0000","last_became_peered":"2023-07-21T22:18:44.346160+0000","last_unstale":"2023-07-21T22:18:45.796802+0000","last_undegraded":"2023-07-21T22:18:45.796802+0000","last_fullsized":"2023-07-21T22:18:45.796802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:27:23.426700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795082+0000","last_change":"2023-07-21T22:18:44.348596+0000","last_active":"2023-07-21T22:18:45.795082+0000","last_peered":"2023-07-21T22:18:45.795082+0000","last_clean":"2023-07-21T22:18:45.795082+0000","last_became_active":"2023-07-21T22:18:44.348325+0000","last_became_peered":"2023-07-21T22:18:44.348325+0000","last_unstale":"2023-07-21T22:18:45.795082+0000","last_undegraded":"2023-07-21T22:18:45.795082+0000","last_fullsized":"2023-07-21T22:18:45.795082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:55:23.041464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795256+0000","last_change":"2023-07-21T22:18:44.335321+0000","last_active":"2023-07-21T22:18:45.795256+0000","last_peered":"2023-07-21T22:18:45.795256+0000","last_clean":"2023-07-21T22:18:45.795256+0000","last_became_active":"2023-07-21T22:18:44.334970+0000","last_became_peered":"2023-07-21T22:18:44.334970+0000","last_unstale":"2023-07-21T22:18:45.795256+0000","last_undegraded":"2023-07-21T22:18:45.795256+0000","last_fullsized":"2023-07-21T22:18:45.795256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:40:05.799874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327703+0000","last_change":"2023-07-21T22:18:44.345317+0000","last_active":"2023-07-21T22:18:45.327703+0000","last_peered":"2023-07-21T22:18:45.327703+0000","last_clean":"2023-07-21T22:18:45.327703+0000","last_became_active":"2023-07-21T22:18:44.344901+0000","last_became_peered":"2023-07-21T22:18:44.344901+0000","last_unstale":"2023-07-21T22:18:45.327703+0000","last_undegraded":"2023-07-21T22:18:45.327703+0000","last_fullsized":"2023-07-21T22:18:45.327703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:19:32.663742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795619+0000","last_change":"2023-07-21T22:18:44.336787+0000","last_active":"2023-07-21T22:18:45.795619+0000","last_peered":"2023-07-21T22:18:45.795619+0000","last_clean":"2023-07-21T22:18:45.795619+0000","last_became_active":"2023-07-21T22:18:44.336502+0000","last_became_peered":"2023-07-21T22:18:44.336502+0000","last_unstale":"2023-07-21T22:18:45.795619+0000","last_undegraded":"2023-07-21T22:18:45.795619+0000","last_fullsized":"2023-07-21T22:18:45.795619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:32:12.452014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325564+0000","last_change":"2023-07-21T22:18:44.348671+0000","last_active":"2023-07-21T22:18:45.325564+0000","last_peered":"2023-07-21T22:18:45.325564+0000","last_clean":"2023-07-21T22:18:45.325564+0000","last_became_active":"2023-07-21T22:18:44.348361+0000","last_became_peered":"2023-07-21T22:18:44.348361+0000","last_unstale":"2023-07-21T22:18:45.325564+0000","last_undegraded":"2023-07-21T22:18:45.325564+0000","last_fullsized":"2023-07-21T22:18:45.325564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:40:05.799874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326775+0000","last_change":"2023-07-21T22:18:44.348495+0000","last_active":"2023-07-21T22:18:45.326775+0000","last_peered":"2023-07-21T22:18:45.326775+0000","last_clean":"2023-07-21T22:18:45.326775+0000","last_became_active":"2023-07-21T22:18:44.348107+0000","last_became_peered":"2023-07-21T22:18:44.348107+0000","last_unstale":"2023-07-21T22:18:45.326775+0000","last_undegraded":"2023-07-21T22:18:45.326775+0000","last_fullsized":"2023-07-21T22:18:45.326775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:40:46.117470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325342+0000","last_change":"2023-07-21T22:18:44.342060+0000","last_active":"2023-07-21T22:18:45.325342+0000","last_peered":"2023-07-21T22:18:45.325342+0000","last_clean":"2023-07-21T22:18:45.325342+0000","last_became_active":"2023-07-21T22:18:44.341767+0000","last_became_peered":"2023-07-21T22:18:44.341767+0000","last_unstale":"2023-07-21T22:18:45.325342+0000","last_undegraded":"2023-07-21T22:18:45.325342+0000","last_fullsized":"2023-07-21T22:18:45.325342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:59:41.204617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796723+0000","last_change":"2023-07-21T22:18:44.326741+0000","last_active":"2023-07-21T22:18:45.796723+0000","last_peered":"2023-07-21T22:18:45.796723+0000","last_clean":"2023-07-21T22:18:45.796723+0000","last_became_active":"2023-07-21T22:18:44.326440+0000","last_became_peered":"2023-07-21T22:18:44.326440+0000","last_unstale":"2023-07-21T22:18:45.796723+0000","last_undegraded":"2023-07-21T22:18:45.796723+0000","last_fullsized":"2023-07-21T22:18:45.796723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:29.978550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325968+0000","last_change":"2023-07-21T22:18:44.338017+0000","last_active":"2023-07-21T22:18:45.325968+0000","last_peered":"2023-07-21T22:18:45.325968+0000","last_clean":"2023-07-21T22:18:45.325968+0000","last_became_active":"2023-07-21T22:18:44.337215+0000","last_became_peered":"2023-07-21T22:18:44.337215+0000","last_unstale":"2023-07-21T22:18:45.325968+0000","last_undegraded":"2023-07-21T22:18:45.325968+0000","last_fullsized":"2023-07-21T22:18:45.325968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:42.883880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'2","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797139+0000","last_change":"2023-07-21T22:18:43.345411+0000","last_active":"2023-07-21T22:18:45.797139+0000","last_peered":"2023-07-21T22:18:45.797139+0000","last_clean":"2023-07-21T22:18:45.797139+0000","last_became_active":"2023-07-21T22:18:43.345095+0000","last_became_peered":"2023-07-21T22:18:43.345095+0000","last_unstale":"2023-07-21T22:18:45.797139+0000","last_undegraded":"2023-07-21T22:18:45.797139+0000","last_fullsized":"2023-07-21T22:18:45.797139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:39:59.990137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327735+0000","last_change":"2023-07-21T22:18:44.345111+0000","last_active":"2023-07-21T22:18:45.327735+0000","last_peered":"2023-07-21T22:18:45.327735+0000","last_clean":"2023-07-21T22:18:45.327735+0000","last_became_active":"2023-07-21T22:18:44.344325+0000","last_became_peered":"2023-07-21T22:18:44.344325+0000","last_unstale":"2023-07-21T22:18:45.327735+0000","last_undegraded":"2023-07-21T22:18:45.327735+0000","last_fullsized":"2023-07-21T22:18:45.327735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:06.515061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.794914+0000","last_change":"2023-07-21T22:18:43.340538+0000","last_active":"2023-07-21T22:18:45.794914+0000","last_peered":"2023-07-21T22:18:45.794914+0000","last_clean":"2023-07-21T22:18:45.794914+0000","last_became_active":"2023-07-21T22:18:43.340172+0000","last_became_peered":"2023-07-21T22:18:43.340172+0000","last_unstale":"2023-07-21T22:18:45.794914+0000","last_undegraded":"2023-07-21T22:18:45.794914+0000","last_fullsized":"2023-07-21T22:18:45.794914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:38:34.109172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795755+0000","last_change":"2023-07-21T22:18:44.342020+0000","last_active":"2023-07-21T22:18:45.795755+0000","last_peered":"2023-07-21T22:18:45.795755+0000","last_clean":"2023-07-21T22:18:45.795755+0000","last_became_active":"2023-07-21T22:18:44.341724+0000","last_became_peered":"2023-07-21T22:18:44.341724+0000","last_unstale":"2023-07-21T22:18:45.795755+0000","last_undegraded":"2023-07-21T22:18:45.795755+0000","last_fullsized":"2023-07-21T22:18:45.795755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:59:34.905191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797136+0000","last_change":"2023-07-21T22:18:43.337771+0000","last_active":"2023-07-21T22:18:45.797136+0000","last_peered":"2023-07-21T22:18:45.797136+0000","last_clean":"2023-07-21T22:18:45.797136+0000","last_became_active":"2023-07-21T22:18:43.337480+0000","last_became_peered":"2023-07-21T22:18:43.337480+0000","last_unstale":"2023-07-21T22:18:45.797136+0000","last_undegraded":"2023-07-21T22:18:45.797136+0000","last_fullsized":"2023-07-21T22:18:45.797136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:23:16.921120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325988+0000","last_change":"2023-07-21T22:18:44.349625+0000","last_active":"2023-07-21T22:18:45.325988+0000","last_peered":"2023-07-21T22:18:45.325988+0000","last_clean":"2023-07-21T22:18:45.325988+0000","last_became_active":"2023-07-21T22:18:44.349046+0000","last_became_peered":"2023-07-21T22:18:44.349046+0000","last_unstale":"2023-07-21T22:18:45.325988+0000","last_undegraded":"2023-07-21T22:18:45.325988+0000","last_fullsized":"2023-07-21T22:18:45.325988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:35:09.658092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"25'8","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796793+0000","last_change":"2023-07-21T22:18:43.344968+0000","last_active":"2023-07-21T22:18:45.796793+0000","last_peered":"2023-07-21T22:18:45.796793+0000","last_clean":"2023-07-21T22:18:45.796793+0000","last_became_active":"2023-07-21T22:18:43.344570+0000","last_became_peered":"2023-07-21T22:18:43.344570+0000","last_unstale":"2023-07-21T22:18:45.796793+0000","last_undegraded":"2023-07-21T22:18:45.796793+0000","last_fullsized":"2023-07-21T22:18:45.796793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:25.997043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797690+0000","last_change":"2023-07-21T22:18:43.348215+0000","last_active":"2023-07-21T22:18:45.797690+0000","last_peered":"2023-07-21T22:18:45.797690+0000","last_clean":"2023-07-21T22:18:45.797690+0000","last_became_active":"2023-07-21T22:18:43.347858+0000","last_became_peered":"2023-07-21T22:18:43.347858+0000","last_unstale":"2023-07-21T22:18:45.797690+0000","last_undegraded":"2023-07-21T22:18:45.797690+0000","last_fullsized":"2023-07-21T22:18:45.797690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:38:53.668385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327304+0000","last_change":"2023-07-21T22:18:44.341650+0000","last_active":"2023-07-21T22:18:45.327304+0000","last_peered":"2023-07-21T22:18:45.327304+0000","last_clean":"2023-07-21T22:18:45.327304+0000","last_became_active":"2023-07-21T22:18:44.341352+0000","last_became_peered":"2023-07-21T22:18:44.341352+0000","last_unstale":"2023-07-21T22:18:45.327304+0000","last_undegraded":"2023-07-21T22:18:45.327304+0000","last_fullsized":"2023-07-21T22:18:45.327304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:27:23.426700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797589+0000","last_change":"2023-07-21T22:18:43.348256+0000","last_active":"2023-07-21T22:18:45.797589+0000","last_peered":"2023-07-21T22:18:45.797589+0000","last_clean":"2023-07-21T22:18:45.797589+0000","last_became_active":"2023-07-21T22:18:43.347754+0000","last_became_peered":"2023-07-21T22:18:43.347754+0000","last_unstale":"2023-07-21T22:18:45.797589+0000","last_undegraded":"2023-07-21T22:18:45.797589+0000","last_fullsized":"2023-07-21T22:18:45.797589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:21:17.553066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326419+0000","last_change":"2023-07-21T22:18:44.353012+0000","last_active":"2023-07-21T22:18:45.326419+0000","last_peered":"2023-07-21T22:18:45.326419+0000","last_clean":"2023-07-21T22:18:45.326419+0000","last_became_active":"2023-07-21T22:18:44.352586+0000","last_became_peered":"2023-07-21T22:18:44.352586+0000","last_unstale":"2023-07-21T22:18:45.326419+0000","last_undegraded":"2023-07-21T22:18:45.326419+0000","last_fullsized":"2023-07-21T22:18:45.326419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:59:21.171422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"25'1","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797566+0000","last_change":"2023-07-21T22:18:43.338600+0000","last_active":"2023-07-21T22:18:45.797566+0000","last_peered":"2023-07-21T22:18:45.797566+0000","last_clean":"2023-07-21T22:18:45.797566+0000","last_became_active":"2023-07-21T22:18:43.338271+0000","last_became_peered":"2023-07-21T22:18:43.338271+0000","last_unstale":"2023-07-21T22:18:45.797566+0000","last_undegraded":"2023-07-21T22:18:45.797566+0000","last_fullsized":"2023-07-21T22:18:45.797566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:09:34.387655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796735+0000","last_change":"2023-07-21T22:18:44.341047+0000","last_active":"2023-07-21T22:18:45.796735+0000","last_peered":"2023-07-21T22:18:45.796735+0000","last_clean":"2023-07-21T22:18:45.796735+0000","last_became_active":"2023-07-21T22:18:44.340600+0000","last_became_peered":"2023-07-21T22:18:44.340600+0000","last_unstale":"2023-07-21T22:18:45.796735+0000","last_undegraded":"2023-07-21T22:18:45.796735+0000","last_fullsized":"2023-07-21T22:18:45.796735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:55.844422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327577+0000","last_change":"2023-07-21T22:18:43.339272+0000","last_active":"2023-07-21T22:18:45.327577+0000","last_peered":"2023-07-21T22:18:45.327577+0000","last_clean":"2023-07-21T22:18:45.327577+0000","last_became_active":"2023-07-21T22:18:43.338864+0000","last_became_peered":"2023-07-21T22:18:43.338864+0000","last_unstale":"2023-07-21T22:18:45.327577+0000","last_undegraded":"2023-07-21T22:18:45.327577+0000","last_fullsized":"2023-07-21T22:18:45.327577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:44:35.365564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.794696+0000","last_change":"2023-07-21T22:18:44.347783+0000","last_active":"2023-07-21T22:18:45.794696+0000","last_peered":"2023-07-21T22:18:45.794696+0000","last_clean":"2023-07-21T22:18:45.794696+0000","last_became_active":"2023-07-21T22:18:44.347417+0000","last_became_peered":"2023-07-21T22:18:44.347417+0000","last_unstale":"2023-07-21T22:18:45.794696+0000","last_undegraded":"2023-07-21T22:18:45.794696+0000","last_fullsized":"2023-07-21T22:18:45.794696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:42.552801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'2","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325726+0000","last_change":"2023-07-21T22:18:43.341666+0000","last_active":"2023-07-21T22:18:45.325726+0000","last_peered":"2023-07-21T22:18:45.325726+0000","last_clean":"2023-07-21T22:18:45.325726+0000","last_became_active":"2023-07-21T22:18:43.341287+0000","last_became_peered":"2023-07-21T22:18:43.341287+0000","last_unstale":"2023-07-21T22:18:45.325726+0000","last_undegraded":"2023-07-21T22:18:45.325726+0000","last_fullsized":"2023-07-21T22:18:45.325726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:59:33.894120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327725+0000","last_change":"2023-07-21T22:18:44.345773+0000","last_active":"2023-07-21T22:18:45.327725+0000","last_peered":"2023-07-21T22:18:45.327725+0000","last_clean":"2023-07-21T22:18:45.327725+0000","last_became_active":"2023-07-21T22:18:44.345494+0000","last_became_peered":"2023-07-21T22:18:44.345494+0000","last_unstale":"2023-07-21T22:18:45.327725+0000","last_undegraded":"2023-07-21T22:18:45.327725+0000","last_fullsized":"2023-07-21T22:18:45.327725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:27:23.426700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797377+0000","last_change":"2023-07-21T22:18:43.346587+0000","last_active":"2023-07-21T22:18:45.797377+0000","last_peered":"2023-07-21T22:18:45.797377+0000","last_clean":"2023-07-21T22:18:45.797377+0000","last_became_active":"2023-07-21T22:18:43.346170+0000","last_became_peered":"2023-07-21T22:18:43.346170+0000","last_unstale":"2023-07-21T22:18:45.797377+0000","last_undegraded":"2023-07-21T22:18:45.797377+0000","last_fullsized":"2023-07-21T22:18:45.797377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:26.409080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.328248+0000","last_change":"2023-07-21T22:18:44.339550+0000","last_active":"2023-07-21T22:18:45.328248+0000","last_peered":"2023-07-21T22:18:45.328248+0000","last_clean":"2023-07-21T22:18:45.328248+0000","last_became_active":"2023-07-21T22:18:44.339232+0000","last_became_peered":"2023-07-21T22:18:44.339232+0000","last_unstale":"2023-07-21T22:18:45.328248+0000","last_undegraded":"2023-07-21T22:18:45.328248+0000","last_fullsized":"2023-07-21T22:18:45.328248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:05:01.105745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326588+0000","last_change":"2023-07-21T22:18:43.342021+0000","last_active":"2023-07-21T22:18:45.326588+0000","last_peered":"2023-07-21T22:18:45.326588+0000","last_clean":"2023-07-21T22:18:45.326588+0000","last_became_active":"2023-07-21T22:18:43.340494+0000","last_became_peered":"2023-07-21T22:18:43.340494+0000","last_unstale":"2023-07-21T22:18:45.326588+0000","last_undegraded":"2023-07-21T22:18:45.326588+0000","last_fullsized":"2023-07-21T22:18:45.326588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:24:08.282241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327954+0000","last_change":"2023-07-21T22:18:44.349404+0000","last_active":"2023-07-21T22:18:45.327954+0000","last_peered":"2023-07-21T22:18:45.327954+0000","last_clean":"2023-07-21T22:18:45.327954+0000","last_became_active":"2023-07-21T22:18:44.348314+0000","last_became_peered":"2023-07-21T22:18:44.348314+0000","last_unstale":"2023-07-21T22:18:45.327954+0000","last_undegraded":"2023-07-21T22:18:45.327954+0000","last_fullsized":"2023-07-21T22:18:45.327954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:27:12.501057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325361+0000","last_change":"2023-07-21T22:18:43.329711+0000","last_active":"2023-07-21T22:18:45.325361+0000","last_peered":"2023-07-21T22:18:45.325361+0000","last_clean":"2023-07-21T22:18:45.325361+0000","last_became_active":"2023-07-21T22:18:43.329184+0000","last_became_peered":"2023-07-21T22:18:43.329184+0000","last_unstale":"2023-07-21T22:18:45.325361+0000","last_undegraded":"2023-07-21T22:18:45.325361+0000","last_fullsized":"2023-07-21T22:18:45.325361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:29:13.898457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795249+0000","last_change":"2023-07-21T22:18:44.354431+0000","last_active":"2023-07-21T22:18:45.795249+0000","last_peered":"2023-07-21T22:18:45.795249+0000","last_clean":"2023-07-21T22:18:45.795249+0000","last_became_active":"2023-07-21T22:18:44.354063+0000","last_became_peered":"2023-07-21T22:18:44.354063+0000","last_unstale":"2023-07-21T22:18:45.795249+0000","last_undegraded":"2023-07-21T22:18:45.795249+0000","last_fullsized":"2023-07-21T22:18:45.795249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:41:47.804776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":175,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796964+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:18:45.796964+0000","last_peered":"2023-07-21T22:18:45.796964+0000","last_clean":"2023-07-21T22:18:45.796964+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:18:45.796964+0000","last_undegraded":"2023-07-21T22:18:45.796964+0000","last_fullsized":"2023-07-21T22:18:45.796964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:19:20.465616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327327+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:18:45.327327+0000","last_peered":"2023-07-21T22:18:45.327327+0000","last_clean":"2023-07-21T22:18:45.327327+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:18:45.327327+0000","last_undegraded":"2023-07-21T22:18:45.327327+0000","last_fullsized":"2023-07-21T22:18:45.327327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:45.609689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325347+0000","last_change":"2023-07-21T22:18:43.327625+0000","last_active":"2023-07-21T22:18:45.325347+0000","last_peered":"2023-07-21T22:18:45.325347+0000","last_clean":"2023-07-21T22:18:45.325347+0000","last_became_active":"2023-07-21T22:18:43.327272+0000","last_became_peered":"2023-07-21T22:18:43.327272+0000","last_unstale":"2023-07-21T22:18:45.325347+0000","last_undegraded":"2023-07-21T22:18:45.325347+0000","last_fullsized":"2023-07-21T22:18:45.325347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:55:22.030393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797370+0000","last_change":"2023-07-21T22:18:44.335194+0000","last_active":"2023-07-21T22:18:45.797370+0000","last_peered":"2023-07-21T22:18:45.797370+0000","last_clean":"2023-07-21T22:18:45.797370+0000","last_became_active":"2023-07-21T22:18:44.334864+0000","last_became_peered":"2023-07-21T22:18:44.334864+0000","last_unstale":"2023-07-21T22:18:45.797370+0000","last_undegraded":"2023-07-21T22:18:45.797370+0000","last_fullsized":"2023-07-21T22:18:45.797370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:38:35.120243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797285+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:18:45.797285+0000","last_peered":"2023-07-21T22:18:45.797285+0000","last_clean":"2023-07-21T22:18:45.797285+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:18:45.797285+0000","last_undegraded":"2023-07-21T22:18:45.797285+0000","last_fullsized":"2023-07-21T22:18:45.797285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:04:55.062032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.794761+0000","last_change":"2023-07-21T22:18:43.344180+0000","last_active":"2023-07-21T22:18:45.794761+0000","last_peered":"2023-07-21T22:18:45.794761+0000","last_clean":"2023-07-21T22:18:45.794761+0000","last_became_active":"2023-07-21T22:18:43.343831+0000","last_became_peered":"2023-07-21T22:18:43.343831+0000","last_unstale":"2023-07-21T22:18:45.794761+0000","last_undegraded":"2023-07-21T22:18:45.794761+0000","last_fullsized":"2023-07-21T22:18:45.794761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:29.106844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795737+0000","last_change":"2023-07-21T22:18:44.347759+0000","last_active":"2023-07-21T22:18:45.795737+0000","last_peered":"2023-07-21T22:18:45.795737+0000","last_clean":"2023-07-21T22:18:45.795737+0000","last_became_active":"2023-07-21T22:18:44.347416+0000","last_became_peered":"2023-07-21T22:18:44.347416+0000","last_unstale":"2023-07-21T22:18:45.795737+0000","last_undegraded":"2023-07-21T22:18:45.795737+0000","last_fullsized":"2023-07-21T22:18:45.795737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:17:36.412750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796138+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:18:45.796138+0000","last_peered":"2023-07-21T22:18:45.796138+0000","last_clean":"2023-07-21T22:18:45.796138+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:18:45.796138+0000","last_undegraded":"2023-07-21T22:18:45.796138+0000","last_fullsized":"2023-07-21T22:18:45.796138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:12:30.348041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795402+0000","last_change":"2023-07-21T22:18:43.332573+0000","last_active":"2023-07-21T22:18:45.795402+0000","last_peered":"2023-07-21T22:18:45.795402+0000","last_clean":"2023-07-21T22:18:45.795402+0000","last_became_active":"2023-07-21T22:18:43.331774+0000","last_became_peered":"2023-07-21T22:18:43.331774+0000","last_unstale":"2023-07-21T22:18:45.795402+0000","last_undegraded":"2023-07-21T22:18:45.795402+0000","last_fullsized":"2023-07-21T22:18:45.795402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:41.872809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795393+0000","last_change":"2023-07-21T22:18:44.344092+0000","last_active":"2023-07-21T22:18:45.795393+0000","last_peered":"2023-07-21T22:18:45.795393+0000","last_clean":"2023-07-21T22:18:45.795393+0000","last_became_active":"2023-07-21T22:18:44.343819+0000","last_became_peered":"2023-07-21T22:18:44.343819+0000","last_unstale":"2023-07-21T22:18:45.795393+0000","last_undegraded":"2023-07-21T22:18:45.795393+0000","last_fullsized":"2023-07-21T22:18:45.795393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:45:28.665708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327394+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:18:45.327394+0000","last_peered":"2023-07-21T22:18:45.327394+0000","last_clean":"2023-07-21T22:18:45.327394+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:18:45.327394+0000","last_undegraded":"2023-07-21T22:18:45.327394+0000","last_fullsized":"2023-07-21T22:18:45.327394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:29:17.693632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327443+0000","last_change":"2023-07-21T22:18:43.347890+0000","last_active":"2023-07-21T22:18:45.327443+0000","last_peered":"2023-07-21T22:18:45.327443+0000","last_clean":"2023-07-21T22:18:45.327443+0000","last_became_active":"2023-07-21T22:18:43.347529+0000","last_became_peered":"2023-07-21T22:18:43.347529+0000","last_unstale":"2023-07-21T22:18:45.327443+0000","last_undegraded":"2023-07-21T22:18:45.327443+0000","last_fullsized":"2023-07-21T22:18:45.327443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:44:35.365564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795543+0000","last_change":"2023-07-21T22:18:44.345749+0000","last_active":"2023-07-21T22:18:45.795543+0000","last_peered":"2023-07-21T22:18:45.795543+0000","last_clean":"2023-07-21T22:18:45.795543+0000","last_became_active":"2023-07-21T22:18:44.345413+0000","last_became_peered":"2023-07-21T22:18:44.345413+0000","last_unstale":"2023-07-21T22:18:45.795543+0000","last_undegraded":"2023-07-21T22:18:45.795543+0000","last_fullsized":"2023-07-21T22:18:45.795543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:35:09.658092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327868+0000","last_change":"2023-07-21T22:18:43.339680+0000","last_active":"2023-07-21T22:18:45.327868+0000","last_peered":"2023-07-21T22:18:45.327868+0000","last_clean":"2023-07-21T22:18:45.327868+0000","last_became_active":"2023-07-21T22:18:43.339369+0000","last_became_peered":"2023-07-21T22:18:43.339369+0000","last_unstale":"2023-07-21T22:18:45.327868+0000","last_undegraded":"2023-07-21T22:18:45.327868+0000","last_fullsized":"2023-07-21T22:18:45.327868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:39:59.990137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795628+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:18:45.795628+0000","last_peered":"2023-07-21T22:18:45.795628+0000","last_clean":"2023-07-21T22:18:45.795628+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:18:45.795628+0000","last_undegraded":"2023-07-21T22:18:45.795628+0000","last_fullsized":"2023-07-21T22:18:45.795628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:54:07.130010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795286+0000","last_change":"2023-07-21T22:18:44.345981+0000","last_active":"2023-07-21T22:18:45.795286+0000","last_peered":"2023-07-21T22:18:45.795286+0000","last_clean":"2023-07-21T22:18:45.795286+0000","last_became_active":"2023-07-21T22:18:44.345650+0000","last_became_peered":"2023-07-21T22:18:44.345650+0000","last_unstale":"2023-07-21T22:18:45.795286+0000","last_undegraded":"2023-07-21T22:18:45.795286+0000","last_fullsized":"2023-07-21T22:18:45.795286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:17:36.412750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795559+0000","last_change":"2023-07-21T22:18:43.336788+0000","last_active":"2023-07-21T22:18:45.795559+0000","last_peered":"2023-07-21T22:18:45.795559+0000","last_clean":"2023-07-21T22:18:45.795559+0000","last_became_active":"2023-07-21T22:18:43.336357+0000","last_became_peered":"2023-07-21T22:18:43.336357+0000","last_unstale":"2023-07-21T22:18:45.795559+0000","last_undegraded":"2023-07-21T22:18:45.795559+0000","last_fullsized":"2023-07-21T22:18:45.795559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:28:38.838619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797723+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:18:45.797723+0000","last_peered":"2023-07-21T22:18:45.797723+0000","last_clean":"2023-07-21T22:18:45.797723+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:18:45.797723+0000","last_undegraded":"2023-07-21T22:18:45.797723+0000","last_fullsized":"2023-07-21T22:18:45.797723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:12:18.867824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795721+0000","last_change":"2023-07-21T22:18:44.345851+0000","last_active":"2023-07-21T22:18:45.795721+0000","last_peered":"2023-07-21T22:18:45.795721+0000","last_clean":"2023-07-21T22:18:45.795721+0000","last_became_active":"2023-07-21T22:18:44.345553+0000","last_became_peered":"2023-07-21T22:18:44.345553+0000","last_unstale":"2023-07-21T22:18:45.795721+0000","last_undegraded":"2023-07-21T22:18:45.795721+0000","last_fullsized":"2023-07-21T22:18:45.795721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:40:05.799874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326225+0000","last_change":"2023-07-21T22:18:43.335304+0000","last_active":"2023-07-21T22:18:45.326225+0000","last_peered":"2023-07-21T22:18:45.326225+0000","last_clean":"2023-07-21T22:18:45.326225+0000","last_became_active":"2023-07-21T22:18:43.334929+0000","last_became_peered":"2023-07-21T22:18:43.334929+0000","last_unstale":"2023-07-21T22:18:45.326225+0000","last_undegraded":"2023-07-21T22:18:45.326225+0000","last_fullsized":"2023-07-21T22:18:45.326225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:28:38.838619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795374+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:18:45.795374+0000","last_peered":"2023-07-21T22:18:45.795374+0000","last_clean":"2023-07-21T22:18:45.795374+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:18:45.795374+0000","last_undegraded":"2023-07-21T22:18:45.795374+0000","last_fullsized":"2023-07-21T22:18:45.795374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:59:28.861478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325244+0000","last_change":"2023-07-21T22:18:44.341231+0000","last_active":"2023-07-21T22:18:45.325244+0000","last_peered":"2023-07-21T22:18:45.325244+0000","last_clean":"2023-07-21T22:18:45.325244+0000","last_became_active":"2023-07-21T22:18:44.340874+0000","last_became_peered":"2023-07-21T22:18:44.340874+0000","last_unstale":"2023-07-21T22:18:45.325244+0000","last_undegraded":"2023-07-21T22:18:45.325244+0000","last_fullsized":"2023-07-21T22:18:45.325244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:27.420151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795870+0000","last_change":"2023-07-21T22:18:43.340557+0000","last_active":"2023-07-21T22:18:45.795870+0000","last_peered":"2023-07-21T22:18:45.795870+0000","last_clean":"2023-07-21T22:18:45.795870+0000","last_became_active":"2023-07-21T22:18:43.340199+0000","last_became_peered":"2023-07-21T22:18:43.340199+0000","last_unstale":"2023-07-21T22:18:45.795870+0000","last_undegraded":"2023-07-21T22:18:45.795870+0000","last_fullsized":"2023-07-21T22:18:45.795870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:41.872809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797371+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:18:45.797371+0000","last_peered":"2023-07-21T22:18:45.797371+0000","last_clean":"2023-07-21T22:18:45.797371+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:18:45.797371+0000","last_undegraded":"2023-07-21T22:18:45.797371+0000","last_fullsized":"2023-07-21T22:18:45.797371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:24.074202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326567+0000","last_change":"2023-07-21T22:18:44.347206+0000","last_active":"2023-07-21T22:18:45.326567+0000","last_peered":"2023-07-21T22:18:45.326567+0000","last_clean":"2023-07-21T22:18:45.326567+0000","last_became_active":"2023-07-21T22:18:44.346914+0000","last_became_peered":"2023-07-21T22:18:44.346914+0000","last_unstale":"2023-07-21T22:18:45.326567+0000","last_undegraded":"2023-07-21T22:18:45.326567+0000","last_fullsized":"2023-07-21T22:18:45.326567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:25:34.392203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327256+0000","last_change":"2023-07-21T22:18:44.343986+0000","last_active":"2023-07-21T22:18:45.327256+0000","last_peered":"2023-07-21T22:18:45.327256+0000","last_clean":"2023-07-21T22:18:45.327256+0000","last_became_active":"2023-07-21T22:18:44.342943+0000","last_became_peered":"2023-07-21T22:18:44.342943+0000","last_unstale":"2023-07-21T22:18:45.327256+0000","last_undegraded":"2023-07-21T22:18:45.327256+0000","last_fullsized":"2023-07-21T22:18:45.327256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:43.536674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"25'6","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327927+0000","last_change":"2023-07-21T22:18:43.336129+0000","last_active":"2023-07-21T22:18:45.327927+0000","last_peered":"2023-07-21T22:18:45.327927+0000","last_clean":"2023-07-21T22:18:45.327927+0000","last_became_active":"2023-07-21T22:18:43.335850+0000","last_became_peered":"2023-07-21T22:18:43.335850+0000","last_unstale":"2023-07-21T22:18:45.327927+0000","last_undegraded":"2023-07-21T22:18:45.327927+0000","last_fullsized":"2023-07-21T22:18:45.327927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:05.503990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795179+0000","last_change":"2023-07-21T22:18:44.351088+0000","last_active":"2023-07-21T22:18:45.795179+0000","last_peered":"2023-07-21T22:18:45.795179+0000","last_clean":"2023-07-21T22:18:45.795179+0000","last_became_active":"2023-07-21T22:18:44.350791+0000","last_became_peered":"2023-07-21T22:18:44.350791+0000","last_unstale":"2023-07-21T22:18:45.795179+0000","last_undegraded":"2023-07-21T22:18:45.795179+0000","last_fullsized":"2023-07-21T22:18:45.795179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:35:32.085049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"25'3","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797454+0000","last_change":"2023-07-21T22:18:43.340832+0000","last_active":"2023-07-21T22:18:45.797454+0000","last_peered":"2023-07-21T22:18:45.797454+0000","last_clean":"2023-07-21T22:18:45.797454+0000","last_became_active":"2023-07-21T22:18:43.340519+0000","last_became_peered":"2023-07-21T22:18:43.340519+0000","last_unstale":"2023-07-21T22:18:45.797454+0000","last_undegraded":"2023-07-21T22:18:45.797454+0000","last_fullsized":"2023-07-21T22:18:45.797454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:10:12.772739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327803+0000","last_change":"2023-07-21T22:18:43.335834+0000","last_active":"2023-07-21T22:18:45.327803+0000","last_peered":"2023-07-21T22:18:45.327803+0000","last_clean":"2023-07-21T22:18:45.327803+0000","last_became_active":"2023-07-21T22:18:43.335518+0000","last_became_peered":"2023-07-21T22:18:43.335518+0000","last_unstale":"2023-07-21T22:18:45.327803+0000","last_undegraded":"2023-07-21T22:18:45.327803+0000","last_fullsized":"2023-07-21T22:18:45.327803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:27:11.489986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325377+0000","last_change":"2023-07-21T22:18:44.349059+0000","last_active":"2023-07-21T22:18:45.325377+0000","last_peered":"2023-07-21T22:18:45.325377+0000","last_clean":"2023-07-21T22:18:45.325377+0000","last_became_active":"2023-07-21T22:18:44.348691+0000","last_became_peered":"2023-07-21T22:18:44.348691+0000","last_unstale":"2023-07-21T22:18:45.325377+0000","last_undegraded":"2023-07-21T22:18:45.325377+0000","last_fullsized":"2023-07-21T22:18:45.325377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:35:32.085049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795629+0000","last_change":"2023-07-21T22:18:43.341273+0000","last_active":"2023-07-21T22:18:45.795629+0000","last_peered":"2023-07-21T22:18:45.795629+0000","last_clean":"2023-07-21T22:18:45.795629+0000","last_became_active":"2023-07-21T22:18:43.340594+0000","last_became_peered":"2023-07-21T22:18:43.340594+0000","last_unstale":"2023-07-21T22:18:45.795629+0000","last_undegraded":"2023-07-21T22:18:45.795629+0000","last_fullsized":"2023-07-21T22:18:45.795629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:35:31.073978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325175+0000","last_change":"2023-07-21T22:18:44.341063+0000","last_active":"2023-07-21T22:18:45.325175+0000","last_peered":"2023-07-21T22:18:45.325175+0000","last_clean":"2023-07-21T22:18:45.325175+0000","last_became_active":"2023-07-21T22:18:44.337396+0000","last_became_peered":"2023-07-21T22:18:44.337396+0000","last_unstale":"2023-07-21T22:18:45.325175+0000","last_undegraded":"2023-07-21T22:18:45.325175+0000","last_fullsized":"2023-07-21T22:18:45.325175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:42.552801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797343+0000","last_change":"2023-07-21T22:18:44.334652+0000","last_active":"2023-07-21T22:18:45.797343+0000","last_peered":"2023-07-21T22:18:45.797343+0000","last_clean":"2023-07-21T22:18:45.797343+0000","last_became_active":"2023-07-21T22:18:44.334333+0000","last_became_peered":"2023-07-21T22:18:44.334333+0000","last_unstale":"2023-07-21T22:18:45.797343+0000","last_undegraded":"2023-07-21T22:18:45.797343+0000","last_fullsized":"2023-07-21T22:18:45.797343+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:42.552801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325316+0000","last_change":"2023-07-21T22:18:43.341804+0000","last_active":"2023-07-21T22:18:45.325316+0000","last_peered":"2023-07-21T22:18:45.325316+0000","last_clean":"2023-07-21T22:18:45.325316+0000","last_became_active":"2023-07-21T22:18:43.341205+0000","last_became_peered":"2023-07-21T22:18:43.341205+0000","last_unstale":"2023-07-21T22:18:45.325316+0000","last_undegraded":"2023-07-21T22:18:45.325316+0000","last_fullsized":"2023-07-21T22:18:45.325316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:38:34.109172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795614+0000","last_change":"2023-07-21T22:18:44.338013+0000","last_active":"2023-07-21T22:18:45.795614+0000","last_peered":"2023-07-21T22:18:45.795614+0000","last_clean":"2023-07-21T22:18:45.795614+0000","last_became_active":"2023-07-21T22:18:44.337701+0000","last_became_peered":"2023-07-21T22:18:44.337701+0000","last_unstale":"2023-07-21T22:18:45.795614+0000","last_undegraded":"2023-07-21T22:18:45.795614+0000","last_fullsized":"2023-07-21T22:18:45.795614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:41:47.804776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795127+0000","last_change":"2023-07-21T22:18:43.337656+0000","last_active":"2023-07-21T22:18:45.795127+0000","last_peered":"2023-07-21T22:18:45.795127+0000","last_clean":"2023-07-21T22:18:45.795127+0000","last_became_active":"2023-07-21T22:18:43.337228+0000","last_became_peered":"2023-07-21T22:18:43.337228+0000","last_unstale":"2023-07-21T22:18:45.795127+0000","last_undegraded":"2023-07-21T22:18:45.795127+0000","last_fullsized":"2023-07-21T22:18:45.795127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:29:13.898457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325846+0000","last_change":"2023-07-21T22:18:44.337074+0000","last_active":"2023-07-21T22:18:45.325846+0000","last_peered":"2023-07-21T22:18:45.325846+0000","last_clean":"2023-07-21T22:18:45.325846+0000","last_became_active":"2023-07-21T22:18:44.336374+0000","last_became_peered":"2023-07-21T22:18:44.336374+0000","last_unstale":"2023-07-21T22:18:45.325846+0000","last_undegraded":"2023-07-21T22:18:45.325846+0000","last_fullsized":"2023-07-21T22:18:45.325846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:45:28.665708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"25'1","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326818+0000","last_change":"2023-07-21T22:18:43.343871+0000","last_active":"2023-07-21T22:18:45.326818+0000","last_peered":"2023-07-21T22:18:45.326818+0000","last_clean":"2023-07-21T22:18:45.326818+0000","last_became_active":"2023-07-21T22:18:43.342848+0000","last_became_peered":"2023-07-21T22:18:43.342848+0000","last_unstale":"2023-07-21T22:18:45.326818+0000","last_undegraded":"2023-07-21T22:18:45.326818+0000","last_fullsized":"2023-07-21T22:18:45.326818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:29:22.726274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796455+0000","last_change":"2023-07-21T22:18:44.338868+0000","last_active":"2023-07-21T22:18:45.796455+0000","last_peered":"2023-07-21T22:18:45.796455+0000","last_clean":"2023-07-21T22:18:45.796455+0000","last_became_active":"2023-07-21T22:18:44.337629+0000","last_became_peered":"2023-07-21T22:18:44.337629+0000","last_unstale":"2023-07-21T22:18:45.796455+0000","last_undegraded":"2023-07-21T22:18:45.796455+0000","last_fullsized":"2023-07-21T22:18:45.796455+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:45.242179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"25'1","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795902+0000","last_change":"2023-07-21T22:18:43.347419+0000","last_active":"2023-07-21T22:18:45.795902+0000","last_peered":"2023-07-21T22:18:45.795902+0000","last_clean":"2023-07-21T22:18:45.795902+0000","last_became_active":"2023-07-21T22:18:43.347118+0000","last_became_peered":"2023-07-21T22:18:43.347118+0000","last_unstale":"2023-07-21T22:18:45.795902+0000","last_undegraded":"2023-07-21T22:18:45.795902+0000","last_fullsized":"2023-07-21T22:18:45.795902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:35:08.647021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326967+0000","last_change":"2023-07-21T22:18:44.345638+0000","last_active":"2023-07-21T22:18:45.326967+0000","last_peered":"2023-07-21T22:18:45.326967+0000","last_clean":"2023-07-21T22:18:45.326967+0000","last_became_active":"2023-07-21T22:18:44.345310+0000","last_became_peered":"2023-07-21T22:18:44.345310+0000","last_unstale":"2023-07-21T22:18:45.326967+0000","last_undegraded":"2023-07-21T22:18:45.326967+0000","last_fullsized":"2023-07-21T22:18:45.326967+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:10.090300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"25'2","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327549+0000","last_change":"2023-07-21T22:18:43.345885+0000","last_active":"2023-07-21T22:18:45.327549+0000","last_peered":"2023-07-21T22:18:45.327549+0000","last_clean":"2023-07-21T22:18:45.327549+0000","last_became_active":"2023-07-21T22:18:43.345540+0000","last_became_peered":"2023-07-21T22:18:43.345540+0000","last_unstale":"2023-07-21T22:18:45.327549+0000","last_undegraded":"2023-07-21T22:18:45.327549+0000","last_fullsized":"2023-07-21T22:18:45.327549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:09.079229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326687+0000","last_change":"2023-07-21T22:18:44.346068+0000","last_active":"2023-07-21T22:18:45.326687+0000","last_peered":"2023-07-21T22:18:45.326687+0000","last_clean":"2023-07-21T22:18:45.326687+0000","last_became_active":"2023-07-21T22:18:44.345741+0000","last_became_peered":"2023-07-21T22:18:44.345741+0000","last_unstale":"2023-07-21T22:18:45.326687+0000","last_undegraded":"2023-07-21T22:18:45.326687+0000","last_fullsized":"2023-07-21T22:18:45.326687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:10:33.167054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327858+0000","last_change":"2023-07-21T22:18:43.342235+0000","last_active":"2023-07-21T22:18:45.327858+0000","last_peered":"2023-07-21T22:18:45.327858+0000","last_clean":"2023-07-21T22:18:45.327858+0000","last_became_active":"2023-07-21T22:18:43.341945+0000","last_became_peered":"2023-07-21T22:18:43.341945+0000","last_unstale":"2023-07-21T22:18:45.327858+0000","last_undegraded":"2023-07-21T22:18:45.327858+0000","last_fullsized":"2023-07-21T22:18:45.327858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:08:28.886811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325543+0000","last_change":"2023-07-21T22:18:44.342724+0000","last_active":"2023-07-21T22:18:45.325543+0000","last_peered":"2023-07-21T22:18:45.325543+0000","last_clean":"2023-07-21T22:18:45.325543+0000","last_became_active":"2023-07-21T22:18:44.342450+0000","last_became_peered":"2023-07-21T22:18:44.342450+0000","last_unstale":"2023-07-21T22:18:45.325543+0000","last_undegraded":"2023-07-21T22:18:45.325543+0000","last_fullsized":"2023-07-21T22:18:45.325543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:17:36.412750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325551+0000","last_change":"2023-07-21T22:18:43.328543+0000","last_active":"2023-07-21T22:18:45.325551+0000","last_peered":"2023-07-21T22:18:45.325551+0000","last_clean":"2023-07-21T22:18:45.325551+0000","last_became_active":"2023-07-21T22:18:43.328165+0000","last_became_peered":"2023-07-21T22:18:43.328165+0000","last_unstale":"2023-07-21T22:18:45.325551+0000","last_undegraded":"2023-07-21T22:18:45.325551+0000","last_fullsized":"2023-07-21T22:18:45.325551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:41:46.793705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326688+0000","last_change":"2023-07-21T22:18:44.343626+0000","last_active":"2023-07-21T22:18:45.326688+0000","last_peered":"2023-07-21T22:18:45.326688+0000","last_clean":"2023-07-21T22:18:45.326688+0000","last_became_active":"2023-07-21T22:18:44.343339+0000","last_became_peered":"2023-07-21T22:18:44.343339+0000","last_unstale":"2023-07-21T22:18:45.326688+0000","last_undegraded":"2023-07-21T22:18:45.326688+0000","last_fullsized":"2023-07-21T22:18:45.326688+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:51.653402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"25'4","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795572+0000","last_change":"2023-07-21T22:18:43.341441+0000","last_active":"2023-07-21T22:18:45.795572+0000","last_peered":"2023-07-21T22:18:45.795572+0000","last_clean":"2023-07-21T22:18:45.795572+0000","last_became_active":"2023-07-21T22:18:43.340962+0000","last_became_peered":"2023-07-21T22:18:43.340962+0000","last_unstale":"2023-07-21T22:18:45.795572+0000","last_undegraded":"2023-07-21T22:18:45.795572+0000","last_fullsized":"2023-07-21T22:18:45.795572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:29:13.898457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":692276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":278528,"data_stored":100780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":101748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":100218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":100128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":100128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":868352,"data_stored":691078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":100128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:18:53.607 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T22:18:53.608 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-21T22:18:53.608 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-21T22:18:53.609 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-21T22:18:53.609 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-21T22:18:53.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.740+0000 7f00fd5fa640 1 Processor -- start 2023-07-21T22:18:53.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.740+0000 7f00fd5fa640 1 -- start start 2023-07-21T22:18:53.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00fd5fa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f00f80cb100 0x7f00f80cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00fd5fa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f80cac70 con 0x7f00f806b1e0 2023-07-21T22:18:53.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00fd5fa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f80cba60 con 0x7f00f8070b70 2023-07-21T22:18:53.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00fd5fa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f80ca060 con 0x7f00f80cb100 2023-07-21T22:18:53.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00effff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f00f806b1e0 0x7f00f80c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54076/0 (socket says 172.21.15.6:54076) 2023-07-21T22:18:53.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00effff640 1 -- 172.21.15.6:0/2401622301 learned_addr learned my addr 172.21.15.6:0/2401622301 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:53.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f77fe640 1 --2- 172.21.15.6:0/2401622301 >> v2:172.21.15.161:3300/0 conn(0x7f00f80cb100 0x7f00f80cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f67fc640 1 -- 172.21.15.6:0/2401622301 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041981418 0 0) 0x7f00f80cac70 con 0x7f00f806b1e0 2023-07-21T22:18:53.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f67fc640 1 -- 172.21.15.6:0/2401622301 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00e4003530 con 0x7f00f806b1e0 2023-07-21T22:18:53.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f67fc640 1 -- 172.21.15.6:0/2401622301 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2479848293 0 0) 0x7f00e4003530 con 0x7f00f806b1e0 2023-07-21T22:18:53.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f67fc640 1 -- 172.21.15.6:0/2401622301 >> v2:172.21.15.161:3300/0 conn(0x7f00f80cb100 msgr2=0x7f00f80cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:53.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f67fc640 1 --2- 172.21.15.6:0/2401622301 >> v2:172.21.15.161:3300/0 conn(0x7f00f80cb100 0x7f00f80cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f67fc640 1 -- 172.21.15.6:0/2401622301 >> v1:172.21.15.161:6789/0 conn(0x7f00f8070b70 legacy=0x7f00f8070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f67fc640 1 -- 172.21.15.6:0/2401622301 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f80ca340 con 0x7f00f806b1e0 2023-07-21T22:18:53.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f67fc640 1 -- 172.21.15.6:0/2401622301 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f00e0001680 con 0x7f00f806b1e0 2023-07-21T22:18:53.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f67fc640 1 -- 172.21.15.6:0/2401622301 >> v1:172.21.15.6:6789/0 conn(0x7f00f806b1e0 legacy=0x7f00f80c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f67fc640 1 --2- 172.21.15.6:0/2401622301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e4003980 0x7f00e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f67fc640 1 --2- 172.21.15.6:0/2401622301 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00e40047d0 0x7f00e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f67fc640 1 --2- 172.21.15.6:0/2401622301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00e4005180 0x7f00e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f67fc640 1 -- 172.21.15.6:0/2401622301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80ca060 con 0x7f00e4003980 2023-07-21T22:18:53.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f67fc640 1 -- 172.21.15.6:0/2401622301 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e400c000 con 0x7f00e4005180 2023-07-21T22:18:53.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f67fc640 1 -- 172.21.15.6:0/2401622301 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e400c1c0 con 0x7f00e40047d0 2023-07-21T22:18:53.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f6ffd640 1 --2- 172.21.15.6:0/2401622301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e4003980 0x7f00e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f77fe640 1 --2- 172.21.15.6:0/2401622301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00e4005180 0x7f00e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00effff640 1 --2- 172.21.15.6:0/2401622301 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00e40047d0 0x7f00e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f6ffd640 1 -- 172.21.15.6:0/2401622301 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00e40047d0 msgr2=0x7f00e4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:53.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f6ffd640 1 --2- 172.21.15.6:0/2401622301 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00e40047d0 0x7f00e4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f6ffd640 1 -- 172.21.15.6:0/2401622301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00e4005180 msgr2=0x7f00e400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:53.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f6ffd640 1 --2- 172.21.15.6:0/2401622301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00e4005180 0x7f00e400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f6ffd640 1 -- 172.21.15.6:0/2401622301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e4003530 con 0x7f00e4003980 2023-07-21T22:18:53.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00effff640 1 --2- 172.21.15.6:0/2401622301 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00e40047d0 0x7f00e4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:53.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f77fe640 1 --2- 172.21.15.6:0/2401622301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00e4005180 0x7f00e400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:53.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.744+0000 7f00f77fe640 1 -- 172.21.15.6:0/2401622301 reap_dead start 2023-07-21T22:18:53.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.748+0000 7f00f6ffd640 1 --2- 172.21.15.6:0/2401622301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e4003980 0x7f00e4003d90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f00e8001780 tx=0x7f00e801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576115eff04e9b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:53.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.748+0000 7f00f67fc640 1 -- 172.21.15.6:0/2401622301 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e80052d0 con 0x7f00e4003980 2023-07-21T22:18:53.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.748+0000 7f00f67fc640 1 -- 172.21.15.6:0/2401622301 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e80a7050 con 0x7f00e4003980 2023-07-21T22:18:53.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.748+0000 7f00f67fc640 1 -- 172.21.15.6:0/2401622301 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8003600 con 0x7f00e4003980 2023-07-21T22:18:53.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.748+0000 7f00fd5fa640 1 -- 172.21.15.6:0/2401622301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e4003980 msgr2=0x7f00e4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.748+0000 7f00fd5fa640 1 --2- 172.21.15.6:0/2401622301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e4003980 0x7f00e4003d90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f00e8001780 tx=0x7f00e801c3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.748+0000 7f00fd5fa640 1 -- 172.21.15.6:0/2401622301 shutdown_connections 2023-07-21T22:18:53.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.748+0000 7f00fd5fa640 1 --2- 172.21.15.6:0/2401622301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00e4003980 0x7f00e4003d90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.748+0000 7f00fd5fa640 1 -- 172.21.15.6:0/2401622301 >> 172.21.15.6:0/2401622301 conn(0x7f00f80afcf0 msgr2=0x7f00f80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:53.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.748+0000 7f00fd5fa640 1 -- 172.21.15.6:0/2401622301 shutdown_connections 2023-07-21T22:18:53.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.748+0000 7f00fd5fa640 1 -- 172.21.15.6:0/2401622301 wait complete. 2023-07-21T22:18:53.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00fd5fa640 1 Processor -- start 2023-07-21T22:18:53.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00fd5fa640 1 -- start start 2023-07-21T22:18:53.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00fd5fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00e4003980 0x7f00f8153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00fd5fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00f81507f0 0x7f00f814d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00fd5fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00f81e7610 0x7f00f814e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00fd5fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80c5fe0 con 0x7f00f81507f0 2023-07-21T22:18:53.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00fd5fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f8153840 con 0x7f00e4003980 2023-07-21T22:18:53.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00fd5fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f80c5360 con 0x7f00f81e7610 2023-07-21T22:18:53.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00effff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00f81507f0 0x7f00f814d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00effff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00f81507f0 0x7f00f814d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46742/0 (socket says 172.21.15.6:46742) 2023-07-21T22:18:53.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00effff640 1 -- 172.21.15.6:0/2156610749 learned_addr learned my addr 172.21.15.6:0/2156610749 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:53.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00f6ffd640 1 --2- 172.21.15.6:0/2156610749 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00e4003980 0x7f00f8153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00f77fe640 1 --2- 172.21.15.6:0/2156610749 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00f81e7610 0x7f00f814e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00effff640 1 -- 172.21.15.6:0/2156610749 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00f81e7610 msgr2=0x7f00f814e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00effff640 1 --2- 172.21.15.6:0/2156610749 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00f81e7610 0x7f00f814e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00effff640 1 -- 172.21.15.6:0/2156610749 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00e4003980 msgr2=0x7f00f8153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00effff640 1 --2- 172.21.15.6:0/2156610749 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00e4003980 0x7f00f8153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00effff640 1 -- 172.21.15.6:0/2156610749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f80c5640 con 0x7f00f81507f0 2023-07-21T22:18:53.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00effff640 1 --2- 172.21.15.6:0/2156610749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00f81507f0 0x7f00f814d490 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f00e000e780 tx=0x7f00e000e870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:53.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00ef7fe640 1 -- 172.21.15.6:0/2156610749 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0010510 con 0x7f00f81507f0 2023-07-21T22:18:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00ef7fe640 1 -- 172.21.15.6:0/2156610749 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e0010670 con 0x7f00f81507f0 2023-07-21T22:18:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00ef7fe640 1 -- 172.21.15.6:0/2156610749 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e00109e0 con 0x7f00f81507f0 2023-07-21T22:18:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00fd5fa640 1 -- 172.21.15.6:0/2156610749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f80c5920 con 0x7f00f81507f0 2023-07-21T22:18:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00fd5fa640 1 -- 172.21.15.6:0/2156610749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f814d9d0 con 0x7f00f81507f0 2023-07-21T22:18:53.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.752+0000 7f00fd5fa640 1 -- 172.21.15.6:0/2156610749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f80678d0 con 0x7f00f81507f0 2023-07-21T22:18:53.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.756+0000 7f00ef7fe640 1 -- 172.21.15.6:0/2156610749 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f00e0010b40 con 0x7f00f81507f0 2023-07-21T22:18:53.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.756+0000 7f00ef7fe640 1 --2- 172.21.15.6:0/2156610749 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f00d8066280 0x7f00d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.756+0000 7f00ef7fe640 1 -- 172.21.15.6:0/2156610749 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f00e0083250 con 0x7f00f81507f0 2023-07-21T22:18:53.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.756+0000 7f00f6ffd640 1 --2- 172.21.15.6:0/2156610749 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f00d8066280 0x7f00d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.756+0000 7f00f6ffd640 1 --2- 172.21.15.6:0/2156610749 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f00d8066280 0x7f00d8068730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f00e8001750 tx=0x7f00e80011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:53.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.760+0000 7f00ef7fe640 1 -- 172.21.15.6:0/2156610749 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00e0050810 con 0x7f00f81507f0 2023-07-21T22:18:54.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.952+0000 7f00fd5fa640 1 -- 172.21.15.6:0/2156610749 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f00f80c98c0 con 0x7f00f81507f0 2023-07-21T22:18:54.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.956+0000 7f00ef7fe640 1 -- 172.21.15.6:0/2156610749 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164248 (secure 0 0 0) 0x7f00e0053e30 con 0x7f00f81507f0 2023-07-21T22:18:54.004 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:18:54.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.960+0000 7f00fd5fa640 1 -- 172.21.15.6:0/2156610749 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f00d8066280 msgr2=0x7f00d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.960+0000 7f00fd5fa640 1 --2- 172.21.15.6:0/2156610749 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f00d8066280 0x7f00d8068730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f00e8001750 tx=0x7f00e80011a0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.960+0000 7f00fd5fa640 1 -- 172.21.15.6:0/2156610749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00f81507f0 msgr2=0x7f00f814d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.960+0000 7f00fd5fa640 1 --2- 172.21.15.6:0/2156610749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00f81507f0 0x7f00f814d490 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f00e000e780 tx=0x7f00e000e870 comp rx=0 tx=0).stop 2023-07-21T22:18:54.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.960+0000 7f00fd5fa640 1 -- 172.21.15.6:0/2156610749 shutdown_connections 2023-07-21T22:18:54.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.960+0000 7f00fd5fa640 1 --2- 172.21.15.6:0/2156610749 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00f81e7610 0x7f00f814e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.960+0000 7f00fd5fa640 1 --2- 172.21.15.6:0/2156610749 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f00d8066280 0x7f00d8068730 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.960+0000 7f00fd5fa640 1 --2- 172.21.15.6:0/2156610749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00f81507f0 0x7f00f814d490 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.960+0000 7f00fd5fa640 1 --2- 172.21.15.6:0/2156610749 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00e4003980 0x7f00f8153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.960+0000 7f00fd5fa640 1 -- 172.21.15.6:0/2156610749 >> 172.21.15.6:0/2156610749 conn(0x7f00f80afcf0 msgr2=0x7f00f80b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:54.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.960+0000 7f00fd5fa640 1 -- 172.21.15.6:0/2156610749 shutdown_connections 2023-07-21T22:18:54.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:53.960+0000 7f00fd5fa640 1 -- 172.21.15.6:0/2156610749 wait complete. 2023-07-21T22:18:54.025 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":5,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3471136886},{"type":"v1","addr":"172.21.15.161:6833","nonce":3471136886}]},"active_addr":"172.21.15.161:6833/3471136886","active_change":"2023-07-21T22:18:22.751502+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":2854890359}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":306225944}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":1202931620}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":1870877504}]}]} 2023-07-21T22:18:54.029 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-21T22:18:54.030 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-21T22:18:54.030 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:18:54.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.128+0000 7fef7387b640 1 Processor -- start 2023-07-21T22:18:54.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.128+0000 7fef7387b640 1 -- start start 2023-07-21T22:18:54.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.128+0000 7fef7387b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef6c070b70 0x7fef6c070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.128+0000 7fef7387b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fef6c06b1e0 0x7fef6c0c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.128+0000 7fef7387b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef6c0cac70 con 0x7fef6c0c21f0 2023-07-21T22:18:54.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.128+0000 7fef7387b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6c071480 con 0x7fef6c06b1e0 2023-07-21T22:18:54.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.128+0000 7fef7387b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0ca060 con 0x7fef6c070b70 2023-07-21T22:18:54.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.128+0000 7fef70e16640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fef6c06b1e0 0x7fef6c0c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.128+0000 7fef71617640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef6c070b70 0x7fef6c070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.128+0000 7fef71617640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef6c070b70 0x7fef6c070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:57750/0 (socket says 172.21.15.6:57750) 2023-07-21T22:18:54.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.128+0000 7fef70e16640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fef6c06b1e0 0x7fef6c0c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:47856/0 (socket says 172.21.15.6:47856) 2023-07-21T22:18:54.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.128+0000 7fef71617640 1 -- 172.21.15.6:0/1186210087 learned_addr learned my addr 172.21.15.6:0/1186210087 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:54.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.128+0000 7fef71e18640 1 --1- 172.21.15.6:0/1186210087 >> v1:172.21.15.161:6789/0 conn(0x7fef6c0c21f0 0x7fef6c0cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:37280/0 (socket says 172.21.15.6:37280) 2023-07-21T22:18:54.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.128+0000 7fef71617640 1 -- 172.21.15.6:0/1186210087 >> v2:172.21.15.161:3300/0 conn(0x7fef6c06b1e0 msgr2=0x7fef6c0c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:54.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.128+0000 7fef71617640 1 --2- 172.21.15.6:0/1186210087 >> v2:172.21.15.161:3300/0 conn(0x7fef6c06b1e0 0x7fef6c0c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.128+0000 7fef71617640 1 -- 172.21.15.6:0/1186210087 >> v1:172.21.15.161:6789/0 conn(0x7fef6c0c21f0 legacy=0x7fef6c0cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.128+0000 7fef71617640 1 -- 172.21.15.6:0/1186210087 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c0ca340 con 0x7fef6c070b70 2023-07-21T22:18:54.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.132+0000 7fef71617640 1 --2- 172.21.15.6:0/1186210087 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef6c070b70 0x7fef6c070f40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fef68009870 tx=0x7fef6801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3d67cfafdf7fb56 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:54.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.132+0000 7fef63fff640 1 -- 172.21.15.6:0/1186210087 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef680ab680 con 0x7fef6c070b70 2023-07-21T22:18:54.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.132+0000 7fef63fff640 1 -- 172.21.15.6:0/1186210087 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef680ab7e0 con 0x7fef6c070b70 2023-07-21T22:18:54.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.132+0000 7fef63fff640 1 -- 172.21.15.6:0/1186210087 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef680abb70 con 0x7fef6c070b70 2023-07-21T22:18:54.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.132+0000 7fef7387b640 1 -- 172.21.15.6:0/1186210087 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef6c070b70 msgr2=0x7fef6c070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.132+0000 7fef7387b640 1 --2- 172.21.15.6:0/1186210087 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef6c070b70 0x7fef6c070f40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fef68009870 tx=0x7fef6801c480 comp rx=0 tx=0).stop 2023-07-21T22:18:54.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.132+0000 7fef7387b640 1 -- 172.21.15.6:0/1186210087 shutdown_connections 2023-07-21T22:18:54.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.132+0000 7fef7387b640 1 --2- 172.21.15.6:0/1186210087 >> v2:172.21.15.161:3300/0 conn(0x7fef6c06b1e0 0x7fef6c0c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.132+0000 7fef7387b640 1 --2- 172.21.15.6:0/1186210087 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef6c070b70 0x7fef6c070f40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.132+0000 7fef7387b640 1 -- 172.21.15.6:0/1186210087 >> 172.21.15.6:0/1186210087 conn(0x7fef6c0afcf0 msgr2=0x7fef6c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:54.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.132+0000 7fef7387b640 1 -- 172.21.15.6:0/1186210087 shutdown_connections 2023-07-21T22:18:54.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.132+0000 7fef7387b640 1 -- 172.21.15.6:0/1186210087 wait complete. 2023-07-21T22:18:54.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef7387b640 1 Processor -- start 2023-07-21T22:18:54.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef7387b640 1 -- start start 2023-07-21T22:18:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef7387b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef6c06b1e0 0x7fef6c14e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef7387b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef6c070b70 0x7fef6c0a7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef7387b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef6c0c21f0 0x7fef6c0c3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef7387b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c14eca0 con 0x7fef6c0c21f0 2023-07-21T22:18:54.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef7387b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c151780 con 0x7fef6c06b1e0 2023-07-21T22:18:54.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef7387b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c151a20 con 0x7fef6c070b70 2023-07-21T22:18:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef71e18640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef6c0c21f0 0x7fef6c0c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef71e18640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef6c0c21f0 0x7fef6c0c3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46748/0 (socket says 172.21.15.6:46748) 2023-07-21T22:18:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef71e18640 1 -- 172.21.15.6:0/579290185 learned_addr learned my addr 172.21.15.6:0/579290185 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef70e16640 1 --2- 172.21.15.6:0/579290185 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef6c070b70 0x7fef6c0a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef71617640 1 --2- 172.21.15.6:0/579290185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef6c06b1e0 0x7fef6c14e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef71e18640 1 -- 172.21.15.6:0/579290185 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef6c070b70 msgr2=0x7fef6c0a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef71e18640 1 --2- 172.21.15.6:0/579290185 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef6c070b70 0x7fef6c0a7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef71e18640 1 -- 172.21.15.6:0/579290185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef6c06b1e0 msgr2=0x7fef6c14e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef71e18640 1 --2- 172.21.15.6:0/579290185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef6c06b1e0 0x7fef6c14e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef71e18640 1 -- 172.21.15.6:0/579290185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef680094d0 con 0x7fef6c0c21f0 2023-07-21T22:18:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef71e18640 1 --2- 172.21.15.6:0/579290185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef6c0c21f0 0x7fef6c0c3070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fef6400c700 tx=0x7fef6400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:54.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef61ffb640 1 -- 172.21.15.6:0/579290185 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef64004d70 con 0x7fef6c0c21f0 2023-07-21T22:18:54.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef61ffb640 1 -- 172.21.15.6:0/579290185 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6400a640 con 0x7fef6c0c21f0 2023-07-21T22:18:54.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef7387b640 1 -- 172.21.15.6:0/579290185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6c151d00 con 0x7fef6c0c21f0 2023-07-21T22:18:54.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef61ffb640 1 -- 172.21.15.6:0/579290185 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6400a9b0 con 0x7fef6c0c21f0 2023-07-21T22:18:54.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef7387b640 1 -- 172.21.15.6:0/579290185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6c0a79d0 con 0x7fef6c0c21f0 2023-07-21T22:18:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.136+0000 7fef7387b640 1 -- 172.21.15.6:0/579290185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6c0678d0 con 0x7fef6c0c21f0 2023-07-21T22:18:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.140+0000 7fef61ffb640 1 -- 172.21.15.6:0/579290185 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fef6400ab10 con 0x7fef6c0c21f0 2023-07-21T22:18:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.140+0000 7fef61ffb640 1 --2- 172.21.15.6:0/579290185 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fef500662b0 0x7fef50068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.140+0000 7fef61ffb640 1 -- 172.21.15.6:0/579290185 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fef64083410 con 0x7fef6c0c21f0 2023-07-21T22:18:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.140+0000 7fef71617640 1 --2- 172.21.15.6:0/579290185 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fef500662b0 0x7fef50068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.140+0000 7fef71617640 1 --2- 172.21.15.6:0/579290185 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fef500662b0 0x7fef50068760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fef680af000 tx=0x7fef680b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:54.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.144+0000 7fef61ffb640 1 -- 172.21.15.6:0/579290185 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fef64050930 con 0x7fef6c0c21f0 2023-07-21T22:18:54.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.300+0000 7fef7387b640 1 -- 172.21.15.6:0/579290185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef6c154230 con 0x7fef6c0c21f0 2023-07-21T22:18:54.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.304+0000 7fef61ffb640 1 -- 172.21.15.6:0/579290185 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18207 (secure 0 0 0) 0x7fef64053f50 con 0x7fef6c0c21f0 2023-07-21T22:18:54.349 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:18:54.349 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:18:45.315608+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:18:41.465054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:18:42.709896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:18:54.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.304+0000 7fef7387b640 1 -- 172.21.15.6:0/579290185 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fef500662b0 msgr2=0x7fef50068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.304+0000 7fef7387b640 1 --2- 172.21.15.6:0/579290185 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fef500662b0 0x7fef50068760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fef680af000 tx=0x7fef680b6040 comp rx=0 tx=0).stop 2023-07-21T22:18:54.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.304+0000 7fef7387b640 1 -- 172.21.15.6:0/579290185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef6c0c21f0 msgr2=0x7fef6c0c3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.304+0000 7fef7387b640 1 --2- 172.21.15.6:0/579290185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef6c0c21f0 0x7fef6c0c3070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fef6400c700 tx=0x7fef6400cbc0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.304+0000 7fef7387b640 1 -- 172.21.15.6:0/579290185 shutdown_connections 2023-07-21T22:18:54.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.304+0000 7fef7387b640 1 --2- 172.21.15.6:0/579290185 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fef500662b0 0x7fef50068760 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.304+0000 7fef7387b640 1 --2- 172.21.15.6:0/579290185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef6c0c21f0 0x7fef6c0c3070 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.304+0000 7fef7387b640 1 --2- 172.21.15.6:0/579290185 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef6c070b70 0x7fef6c0a7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.304+0000 7fef7387b640 1 --2- 172.21.15.6:0/579290185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef6c06b1e0 0x7fef6c14e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.304+0000 7fef7387b640 1 -- 172.21.15.6:0/579290185 >> 172.21.15.6:0/579290185 conn(0x7fef6c0afcf0 msgr2=0x7fef6c154da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:54.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.304+0000 7fef7387b640 1 -- 172.21.15.6:0/579290185 shutdown_connections 2023-07-21T22:18:54.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.304+0000 7fef7387b640 1 -- 172.21.15.6:0/579290185 wait complete. 2023-07-21T22:18:54.370 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-21T22:18:54.371 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:18:54.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.468+0000 7fea36493640 1 Processor -- start 2023-07-21T22:18:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.468+0000 7fea36493640 1 -- start start 2023-07-21T22:18:54.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.468+0000 7fea36493640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea300b7c70 0x7fea300d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.468+0000 7fea36493640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fea300d1850 0x7fea3015f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.468+0000 7fea36493640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea300ccaf0 con 0x7fea300d1300 2023-07-21T22:18:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.468+0000 7fea36493640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea300d1190 con 0x7fea300d1850 2023-07-21T22:18:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.468+0000 7fea36493640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea30160600 con 0x7fea300b7c70 2023-07-21T22:18:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.468+0000 7fea2f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fea300d1850 0x7fea3015f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.468+0000 7fea2f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fea300d1850 0x7fea3015f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46762/0 (socket says 172.21.15.6:46762) 2023-07-21T22:18:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.468+0000 7fea2f7fe640 1 -- 172.21.15.6:0/2765435289 learned_addr learned my addr 172.21.15.6:0/2765435289 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.468+0000 7fea2ffff640 1 --2- 172.21.15.6:0/2765435289 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea300b7c70 0x7fea300d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.468+0000 7fea2f7fe640 1 -- 172.21.15.6:0/2765435289 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea300b7c70 msgr2=0x7fea300d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.468+0000 7fea2f7fe640 1 --2- 172.21.15.6:0/2765435289 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea300b7c70 0x7fea300d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.468+0000 7fea2f7fe640 1 -- 172.21.15.6:0/2765435289 >> v1:172.21.15.161:6789/0 conn(0x7fea300d1300 legacy=0x7fea300d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.468+0000 7fea2f7fe640 1 -- 172.21.15.6:0/2765435289 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea30160320 con 0x7fea300d1850 2023-07-21T22:18:54.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.468+0000 7fea2ffff640 1 --2- 172.21.15.6:0/2765435289 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea300b7c70 0x7fea300d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:54.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.472+0000 7fea2f7fe640 1 --2- 172.21.15.6:0/2765435289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea300d1850 0x7fea3015f650 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fea240098a0 tx=0x7fea2401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a27382621289a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.472+0000 7fea2effd640 1 -- 172.21.15.6:0/2765435289 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea240ab600 con 0x7fea300d1850 2023-07-21T22:18:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.472+0000 7fea2effd640 1 -- 172.21.15.6:0/2765435289 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea240ab760 con 0x7fea300d1850 2023-07-21T22:18:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.472+0000 7fea2effd640 1 -- 172.21.15.6:0/2765435289 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea240abaf0 con 0x7fea300d1850 2023-07-21T22:18:54.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.472+0000 7fea36493640 1 -- 172.21.15.6:0/2765435289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea300d1850 msgr2=0x7fea3015f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.472+0000 7fea36493640 1 --2- 172.21.15.6:0/2765435289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea300d1850 0x7fea3015f650 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fea240098a0 tx=0x7fea2401c4f0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.472+0000 7fea36493640 1 -- 172.21.15.6:0/2765435289 shutdown_connections 2023-07-21T22:18:54.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.472+0000 7fea36493640 1 --2- 172.21.15.6:0/2765435289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea300d1850 0x7fea3015f650 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.472+0000 7fea36493640 1 --2- 172.21.15.6:0/2765435289 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea300b7c70 0x7fea300d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.472+0000 7fea36493640 1 -- 172.21.15.6:0/2765435289 >> 172.21.15.6:0/2765435289 conn(0x7fea300650b0 msgr2=0x7fea300654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.472+0000 7fea36493640 1 -- 172.21.15.6:0/2765435289 shutdown_connections 2023-07-21T22:18:54.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.472+0000 7fea36493640 1 -- 172.21.15.6:0/2765435289 wait complete. 2023-07-21T22:18:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea36493640 1 Processor -- start 2023-07-21T22:18:54.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea36493640 1 -- start start 2023-07-21T22:18:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea36493640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea300b7c70 0x7fea30154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea36493640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea300d1300 0x7fea3015c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea36493640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea300d1850 0x7fea30156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea36493640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea301f7b90 con 0x7fea300d1850 2023-07-21T22:18:54.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea36493640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3015af40 con 0x7fea300b7c70 2023-07-21T22:18:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea36493640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3015b220 con 0x7fea300d1300 2023-07-21T22:18:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea34a30640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea300d1850 0x7fea30156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea2ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea300b7c70 0x7fea30154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea34a30640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea300d1850 0x7fea30156930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46770/0 (socket says 172.21.15.6:46770) 2023-07-21T22:18:54.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea2ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea300b7c70 0x7fea30154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:47880/0 (socket says 172.21.15.6:47880) 2023-07-21T22:18:54.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea34a30640 1 -- 172.21.15.6:0/2515015257 learned_addr learned my addr 172.21.15.6:0/2515015257 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:54.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea2f7fe640 1 --2- 172.21.15.6:0/2515015257 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea300d1300 0x7fea3015c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea34a30640 1 -- 172.21.15.6:0/2515015257 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea300d1300 msgr2=0x7fea3015c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea34a30640 1 --2- 172.21.15.6:0/2515015257 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea300d1300 0x7fea3015c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea34a30640 1 -- 172.21.15.6:0/2515015257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea300b7c70 msgr2=0x7fea30154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea34a30640 1 --2- 172.21.15.6:0/2515015257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea300b7c70 0x7fea30154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea34a30640 1 -- 172.21.15.6:0/2515015257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea240094d0 con 0x7fea300d1850 2023-07-21T22:18:54.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea34a30640 1 --2- 172.21.15.6:0/2515015257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea300d1850 0x7fea30156930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fea2800c730 tx=0x7fea2800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:54.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea2cff9640 1 -- 172.21.15.6:0/2515015257 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea28003b80 con 0x7fea300d1850 2023-07-21T22:18:54.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea2cff9640 1 -- 172.21.15.6:0/2515015257 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea28003ce0 con 0x7fea300d1850 2023-07-21T22:18:54.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea36493640 1 -- 172.21.15.6:0/2515015257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea3015b500 con 0x7fea300d1850 2023-07-21T22:18:54.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.476+0000 7fea2cff9640 1 -- 172.21.15.6:0/2515015257 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2800aa30 con 0x7fea300d1850 2023-07-21T22:18:54.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.480+0000 7fea36493640 1 -- 172.21.15.6:0/2515015257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea301548c0 con 0x7fea300d1850 2023-07-21T22:18:54.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.480+0000 7fea36493640 1 -- 172.21.15.6:0/2515015257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea301f7d00 con 0x7fea300d1850 2023-07-21T22:18:54.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.480+0000 7fea2cff9640 1 -- 172.21.15.6:0/2515015257 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fea2800ab90 con 0x7fea300d1850 2023-07-21T22:18:54.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.480+0000 7fea2cff9640 1 --2- 172.21.15.6:0/2515015257 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fea1c066280 0x7fea1c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.480+0000 7fea2cff9640 1 -- 172.21.15.6:0/2515015257 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea28083a30 con 0x7fea300d1850 2023-07-21T22:18:54.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.480+0000 7fea2ffff640 1 --2- 172.21.15.6:0/2515015257 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fea1c066280 0x7fea1c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.480+0000 7fea2ffff640 1 --2- 172.21.15.6:0/2515015257 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fea1c066280 0x7fea1c068730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fea20006e90 tx=0x7fea20008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:54.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.484+0000 7fea2cff9640 1 -- 172.21.15.6:0/2515015257 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fea28050ed0 con 0x7fea300d1850 2023-07-21T22:18:54.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.644+0000 7fea36493640 1 -- 172.21.15.6:0/2515015257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea300678d0 con 0x7fea300d1850 2023-07-21T22:18:54.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.644+0000 7fea2cff9640 1 -- 172.21.15.6:0/2515015257 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18207 (secure 0 0 0) 0x7fea280544f0 con 0x7fea300d1850 2023-07-21T22:18:54.691 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:18:54.692 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:18:45.315608+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:18:41.465054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:18:42.709896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:18:54.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.648+0000 7fea36493640 1 -- 172.21.15.6:0/2515015257 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fea1c066280 msgr2=0x7fea1c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.648+0000 7fea36493640 1 --2- 172.21.15.6:0/2515015257 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fea1c066280 0x7fea1c068730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fea20006e90 tx=0x7fea20008040 comp rx=0 tx=0).stop 2023-07-21T22:18:54.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.648+0000 7fea36493640 1 -- 172.21.15.6:0/2515015257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea300d1850 msgr2=0x7fea30156930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.648+0000 7fea36493640 1 --2- 172.21.15.6:0/2515015257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea300d1850 0x7fea30156930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fea2800c730 tx=0x7fea2800cbf0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.648+0000 7fea36493640 1 -- 172.21.15.6:0/2515015257 shutdown_connections 2023-07-21T22:18:54.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.648+0000 7fea36493640 1 --2- 172.21.15.6:0/2515015257 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fea1c066280 0x7fea1c068730 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.648+0000 7fea36493640 1 --2- 172.21.15.6:0/2515015257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea300d1850 0x7fea30156930 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.648+0000 7fea36493640 1 --2- 172.21.15.6:0/2515015257 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fea300d1300 0x7fea3015c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.648+0000 7fea36493640 1 --2- 172.21.15.6:0/2515015257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fea300b7c70 0x7fea30154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.648+0000 7fea36493640 1 -- 172.21.15.6:0/2515015257 >> 172.21.15.6:0/2515015257 conn(0x7fea300650b0 msgr2=0x7fea300cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:54.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.648+0000 7fea36493640 1 -- 172.21.15.6:0/2515015257 shutdown_connections 2023-07-21T22:18:54.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.648+0000 7fea36493640 1 -- 172.21.15.6:0/2515015257 wait complete. 2023-07-21T22:18:54.713 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-21T22:18:54.714 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-21T22:18:54.714 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-21T22:18:54.715 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-21T22:18:54.715 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-21T22:18:54.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-21T22:18:54.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-21T22:18:54.717 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-21T22:18:54.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.916+0000 7ff0305ad640 1 Processor -- start 2023-07-21T22:18:54.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.916+0000 7ff0305ad640 1 -- start start 2023-07-21T22:18:54.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.916+0000 7f5bb50e6640 1 Processor -- start 2023-07-21T22:18:54.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7ff0305ad640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff02815ff10 0x7ff0280c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7ff0305ad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0280c1340 0x7ff0280cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7ff0305ad640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff0280cd3a0 0x7ff028069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7ff0305ad640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff02806aff0 con 0x7ff02815ff10 2023-07-21T22:18:54.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7ff0305ad640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0280cd800 con 0x7ff0280cd3a0 2023-07-21T22:18:54.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7ff0305ad640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02806eef0 con 0x7ff0280c1340 2023-07-21T22:18:54.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7ff02eb4a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff0280cd3a0 0x7ff028069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7ff02eb4a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff0280cd3a0 0x7ff028069430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:47896/0 (socket says 172.21.15.6:47896) 2023-07-21T22:18:54.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7ff02eb4a640 1 -- 172.21.15.6:0/697711196 learned_addr learned my addr 172.21.15.6:0/697711196 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:54.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7ff02db48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0280c1340 0x7ff0280cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.916+0000 7f5bb50e6640 1 -- start start 2023-07-21T22:18:54.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7f5bb50e6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ba800dc80 0x7f5ba80e7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7f5bb50e6640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5ba80550c0 0x7f5ba80ea950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7f5bb50e6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba80e8060 con 0x7f5ba800e050 2023-07-21T22:18:54.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7f5bb50e6640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba80361c0 con 0x7f5ba80550c0 2023-07-21T22:18:54.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7f5bb50e6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba80e7730 con 0x7f5ba800dc80 2023-07-21T22:18:54.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7f5baf59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5ba80550c0 0x7f5ba80ea950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7ff02eb4a640 1 -- 172.21.15.6:0/697711196 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0280c1340 msgr2=0x7ff0280cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7ff02eb4a640 1 --2- 172.21.15.6:0/697711196 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0280c1340 0x7ff0280cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7ff02eb4a640 1 -- 172.21.15.6:0/697711196 >> v2:172.21.15.6:3300/0 conn(0x7ff02815ff10 msgr2=0x7ff0280c0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7ff02e349640 1 --2- 172.21.15.6:0/697711196 >> v2:172.21.15.6:3300/0 conn(0x7ff02815ff10 0x7ff0280c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7f5bae59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5ba800e050 0x7f5ba80549b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54084/0 (socket says 172.21.15.6:54084) 2023-07-21T22:18:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7f5bae59c640 1 -- 172.21.15.6:0/1652189152 learned_addr learned my addr 172.21.15.6:0/1652189152 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7f5baed9d640 1 --2- 172.21.15.6:0/1652189152 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ba800dc80 0x7f5ba80e7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7f5baf59e640 1 -- 172.21.15.6:0/1652189152 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ba800dc80 msgr2=0x7f5ba80e7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7f5baf59e640 1 --2- 172.21.15.6:0/1652189152 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ba800dc80 0x7f5ba80e7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7f5baf59e640 1 -- 172.21.15.6:0/1652189152 >> v1:172.21.15.6:6789/0 conn(0x7f5ba800e050 legacy=0x7f5ba80549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7f5baf59e640 1 -- 172.21.15.6:0/1652189152 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba80e7a10 con 0x7f5ba80550c0 2023-07-21T22:18:54.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7ff02eb4a640 1 --2- 172.21.15.6:0/697711196 >> v2:172.21.15.6:3300/0 conn(0x7ff02815ff10 0x7ff0280c0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7ff02eb4a640 1 -- 172.21.15.6:0/697711196 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0280cc020 con 0x7ff0280cd3a0 2023-07-21T22:18:54.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7ff02db48640 1 --2- 172.21.15.6:0/697711196 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0280c1340 0x7ff0280cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:54.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.920+0000 7ff02e349640 1 --2- 172.21.15.6:0/697711196 >> v2:172.21.15.6:3300/0 conn(0x7ff02815ff10 0x7ff0280c0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:54.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.924+0000 7f99c3112640 1 Processor -- start 2023-07-21T22:18:54.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.924+0000 7f99c3112640 1 -- start start 2023-07-21T22:18:54.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.924+0000 7f5baf59e640 1 --2- 172.21.15.6:0/1652189152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ba80550c0 0x7f5ba80ea950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0067e20 tx=0x7f5bb0098480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9203c14ea1036d82 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:54.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f5badd9b640 1 -- 172.21.15.6:0/1652189152 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0128600 con 0x7f5ba80550c0 2023-07-21T22:18:54.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f5badd9b640 1 -- 172.21.15.6:0/1652189152 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb0124050 con 0x7f5ba80550c0 2023-07-21T22:18:54.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f5badd9b640 1 -- 172.21.15.6:0/1652189152 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb01289e0 con 0x7f5ba80550c0 2023-07-21T22:18:54.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f5bb50e6640 1 -- 172.21.15.6:0/1652189152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ba80550c0 msgr2=0x7f5ba80ea950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f5bb50e6640 1 --2- 172.21.15.6:0/1652189152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ba80550c0 0x7f5ba80ea950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0067e20 tx=0x7f5bb0098480 comp rx=0 tx=0).stop 2023-07-21T22:18:54.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7ff02eb4a640 1 --2- 172.21.15.6:0/697711196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0280cd3a0 0x7ff028069430 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff02806e990 tx=0x7ff01801c210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc1acad5d58d961f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:54.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7ff02d347640 1 -- 172.21.15.6:0/697711196 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0180ab600 con 0x7ff0280cd3a0 2023-07-21T22:18:54.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7ff02d347640 1 -- 172.21.15.6:0/697711196 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0180a7050 con 0x7ff0280cd3a0 2023-07-21T22:18:54.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7ff02d347640 1 -- 172.21.15.6:0/697711196 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0180ab980 con 0x7ff0280cd3a0 2023-07-21T22:18:54.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f99c3112640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99bc158680 0x7f99bc0af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f99c3112640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f99bc0afdf0 0x7f99bc06fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f5bb50e6640 1 -- 172.21.15.6:0/1652189152 shutdown_connections 2023-07-21T22:18:54.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f5bb50e6640 1 --2- 172.21.15.6:0/1652189152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ba80550c0 0x7f5ba80ea950 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f5bb50e6640 1 --2- 172.21.15.6:0/1652189152 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ba800dc80 0x7f5ba80e7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f5bb50e6640 1 -- 172.21.15.6:0/1652189152 >> 172.21.15.6:0/1652189152 conn(0x7f5ba800ceb0 msgr2=0x7f5ba8056d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:54.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f99c3112640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc158a50 con 0x7f99bc06ffb0 2023-07-21T22:18:54.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f99c3112640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc1599b0 con 0x7f99bc0afdf0 2023-07-21T22:18:54.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f99c3112640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc15d170 con 0x7f99bc158680 2023-07-21T22:18:54.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7ff0305ad640 1 -- 172.21.15.6:0/697711196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0280cd3a0 msgr2=0x7ff028069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7ff0305ad640 1 --2- 172.21.15.6:0/697711196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0280cd3a0 0x7ff028069430 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff02806e990 tx=0x7ff01801c210 comp rx=0 tx=0).stop 2023-07-21T22:18:54.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f5bb50e6640 1 -- 172.21.15.6:0/1652189152 shutdown_connections 2023-07-21T22:18:54.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f99c190f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f99bc0afdf0 0x7f99bc06fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f99c190f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f99bc0afdf0 0x7f99bc06fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46786/0 (socket says 172.21.15.6:46786) 2023-07-21T22:18:54.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f99c190f640 1 -- 172.21.15.6:0/2043956258 learned_addr learned my addr 172.21.15.6:0/2043956258 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:54.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f99c2110640 1 --2- 172.21.15.6:0/2043956258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99bc158680 0x7f99bc0af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f99c190f640 1 -- 172.21.15.6:0/2043956258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99bc158680 msgr2=0x7f99bc0af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:54.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f99c190f640 1 --2- 172.21.15.6:0/2043956258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99bc158680 0x7f99bc0af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f99c190f640 1 -- 172.21.15.6:0/2043956258 >> v1:172.21.15.6:6789/0 conn(0x7f99bc06ffb0 legacy=0x7f99bc0ccb10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:18:54.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7ff0305ad640 1 -- 172.21.15.6:0/697711196 shutdown_connections 2023-07-21T22:18:54.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7ff0305ad640 1 --2- 172.21.15.6:0/697711196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0280cd3a0 0x7ff028069430 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7ff0305ad640 1 --2- 172.21.15.6:0/697711196 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0280c1340 0x7ff0280cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7ff0305ad640 1 --2- 172.21.15.6:0/697711196 >> v2:172.21.15.6:3300/0 conn(0x7ff02815ff10 0x7ff0280c0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7ff0305ad640 1 -- 172.21.15.6:0/697711196 >> 172.21.15.6:0/697711196 conn(0x7ff0280ce9d0 msgr2=0x7ff0280ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:54.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.928+0000 7f5bb50e6640 1 -- 172.21.15.6:0/1652189152 wait complete. 2023-07-21T22:18:54.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.932+0000 7f99c190f640 1 -- 172.21.15.6:0/2043956258 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc158d30 con 0x7f99bc0afdf0 2023-07-21T22:18:54.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.932+0000 7f5bb50e6640 1 Processor -- start 2023-07-21T22:18:54.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.932+0000 7f5bb50e6640 1 -- start start 2023-07-21T22:18:54.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.932+0000 7ff0305ad640 1 -- 172.21.15.6:0/697711196 shutdown_connections 2023-07-21T22:18:54.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.932+0000 7ff0305ad640 1 -- 172.21.15.6:0/697711196 wait complete. 2023-07-21T22:18:54.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.932+0000 7f3c0b59e640 1 Processor -- start 2023-07-21T22:18:54.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.932+0000 7f5bb50e6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ba800dc80 0x7f5ba804ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f5bb50e6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba800e050 0x7f5ba8037fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7fe2cc39f640 1 Processor -- start 2023-07-21T22:18:54.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7ff0305ad640 1 Processor -- start 2023-07-21T22:18:54.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f5baed9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ba800dc80 0x7f5ba804ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f5baed9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ba800dc80 0x7f5ba804ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:47926/0 (socket says 172.21.15.6:47926) 2023-07-21T22:18:54.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f21109b7640 1 Processor -- start 2023-07-21T22:18:54.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f5bae59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba800e050 0x7f5ba8037fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f5bae59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba800e050 0x7f5ba8037fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46800/0 (socket says 172.21.15.6:46800) 2023-07-21T22:18:54.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f21109b7640 1 -- start start 2023-07-21T22:18:54.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.932+0000 7f3c0b59e640 1 -- start start 2023-07-21T22:18:54.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f3c0b59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c0c15fd60 0x7f3c0c0cba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f3c0b59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3c0c070f00 0x7f3c0c0afd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f3c0b59e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c0c0cd7b0 con 0x7f3c0c0af8b0 2023-07-21T22:18:54.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f3c0b59e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0c06c8b0 con 0x7f3c0c070f00 2023-07-21T22:18:54.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f3c0b59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0b0260 con 0x7f3c0c15fd60 2023-07-21T22:18:54.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f5bb50e6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ba80550c0 0x7f5ba803a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f3c0a59c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c0c15fd60 0x7f3c0c0cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f3c0ad9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3c0c070f00 0x7f3c0c0afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f3c0a59c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c0c15fd60 0x7f3c0c0cba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:57810/0 (socket says 172.21.15.6:57810) 2023-07-21T22:18:54.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f3c0a59c640 1 -- 172.21.15.6:0/3172943842 learned_addr learned my addr 172.21.15.6:0/3172943842 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:54.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7ff0305ad640 1 -- start start 2023-07-21T22:18:54.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f99c190f640 1 --2- 172.21.15.6:0/2043956258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99bc0afdf0 0x7f99bc06fa70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009e50 tx=0x7f99b401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106a0f4a847bdd86 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:54.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f99c110e640 1 -- 172.21.15.6:0/2043956258 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40a5740 con 0x7f99bc0afdf0 2023-07-21T22:18:54.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f99c110e640 1 -- 172.21.15.6:0/2043956258 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b40a58a0 con 0x7f99bc0afdf0 2023-07-21T22:18:54.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f99c110e640 1 -- 172.21.15.6:0/2043956258 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40a5c30 con 0x7f99bc0afdf0 2023-07-21T22:18:54.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f3c0a59c640 1 -- 172.21.15.6:0/3172943842 >> v2:172.21.15.161:3300/0 conn(0x7f3c0c070f00 msgr2=0x7f3c0c0afd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:54.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f3c0a59c640 1 --2- 172.21.15.6:0/3172943842 >> v2:172.21.15.161:3300/0 conn(0x7f3c0c070f00 0x7f3c0c0afd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f3c0a59c640 1 -- 172.21.15.6:0/3172943842 >> v1:172.21.15.6:6789/0 conn(0x7f3c0c0af8b0 legacy=0x7f3c0c0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:54.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f3c0a59c640 1 -- 172.21.15.6:0/3172943842 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c06d360 con 0x7f3c0c15fd60 2023-07-21T22:18:54.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f3c0ad9d640 1 --2- 172.21.15.6:0/3172943842 >> v2:172.21.15.161:3300/0 conn(0x7f3c0c070f00 0x7f3c0c0afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:54.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7ff0305ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0280c1340 0x7ff0280c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f21109b7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f210c0ad3c0 0x7f210c0cc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f21109b7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f210c06b5e0 con 0x7f210c0ad790 2023-07-21T22:18:54.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f21109b7640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f210c0ccd80 con 0x7f210c0c1880 2023-07-21T22:18:54.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f21109b7640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f210c0cd060 con 0x7f210c0ad3c0 2023-07-21T22:18:54.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f99c3112640 1 -- 172.21.15.6:0/2043956258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99bc0afdf0 msgr2=0x7f99bc06fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f99c3112640 1 --2- 172.21.15.6:0/2043956258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99bc0afdf0 0x7f99bc06fa70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009e50 tx=0x7f99b401c9d0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7fe2cc39f640 1 -- start start 2023-07-21T22:18:54.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7fe2cc39f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe2c415ff10 0x7fe2c40c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7fe2cc39f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe2c40cd570 0x7fe2c406b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7fe2cc39f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c406eef0 con 0x7fe2c40c1340 2023-07-21T22:18:54.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7fe2cc39f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c406aff0 con 0x7fe2c40cd570 2023-07-21T22:18:54.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7fe2cc39f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c40cc020 con 0x7fe2c415ff10 2023-07-21T22:18:54.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7ff02e349640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0280c1340 0x7ff0280c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7ff02e349640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0280c1340 0x7ff0280c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46804/0 (socket says 172.21.15.6:46804) 2023-07-21T22:18:54.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f5bb50e6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba8039b50 con 0x7f5ba800e050 2023-07-21T22:18:54.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7fe2c993a640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe2c40c1340 0x7fe2c40cce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54116/0 (socket says 172.21.15.6:54116) 2023-07-21T22:18:54.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7fe2c993a640 1 -- 172.21.15.6:0/1352100843 learned_addr learned my addr 172.21.15.6:0/1352100843 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:54.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f5bb50e6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba8039e30 con 0x7f5ba800dc80 2023-07-21T22:18:54.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7fe2ca93c640 1 --2- 172.21.15.6:0/1352100843 >> v2:172.21.15.6:3300/0 conn(0x7fe2c40cd570 0x7fe2c406b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f5bb50e6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba804d070 con 0x7f5ba80550c0 2023-07-21T22:18:54.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f5bae59c640 1 -- 172.21.15.6:0/2699994176 learned_addr learned my addr 172.21.15.6:0/2699994176 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:54.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f5baf59e640 1 --2- 172.21.15.6:0/2699994176 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ba80550c0 0x7f5ba803a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7ff02e349640 1 -- 172.21.15.6:0/493476259 learned_addr learned my addr 172.21.15.6:0/493476259 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:54.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7ff0305ad640 1 --2- 172.21.15.6:0/493476259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0280cd3a0 0x7ff0281517b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f99c3112640 1 -- 172.21.15.6:0/2043956258 shutdown_connections 2023-07-21T22:18:54.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f99c3112640 1 --2- 172.21.15.6:0/2043956258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99bc0afdf0 0x7f99bc06fa70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f99c3112640 1 --2- 172.21.15.6:0/2043956258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99bc158680 0x7f99bc0af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f99c3112640 1 -- 172.21.15.6:0/2043956258 >> 172.21.15.6:0/2043956258 conn(0x7f99bc0ca8b0 msgr2=0x7f99bc0cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:54.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7fe2ca13b640 1 --2- 172.21.15.6:0/1352100843 >> v2:172.21.15.161:3300/0 conn(0x7fe2c415ff10 0x7fe2c40c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7fe2c9139640 1 -- 172.21.15.6:0/1352100843 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079448245 0 0) 0x7fe2c406eef0 con 0x7fe2c40c1340 2023-07-21T22:18:54.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f210bfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f210c0c1880 0x7f210c0c9990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:37300/0 (socket says 172.21.15.6:37300) 2023-07-21T22:18:54.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.936+0000 7f210bfff640 1 -- 172.21.15.6:0/2172427086 learned_addr learned my addr 172.21.15.6:0/2172427086 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:54.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f210b7fe640 1 --2- 172.21.15.6:0/2172427086 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f210c0ad3c0 0x7f210c0cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f5baed9d640 1 -- 172.21.15.6:0/2699994176 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ba80550c0 msgr2=0x7f5ba803a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f5baed9d640 1 --2- 172.21.15.6:0/2699994176 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ba80550c0 0x7f5ba803a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f5baed9d640 1 -- 172.21.15.6:0/2699994176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba800e050 msgr2=0x7f5ba8037fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f5baed9d640 1 --2- 172.21.15.6:0/2699994176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba800e050 0x7f5ba8037fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f5baed9d640 1 -- 172.21.15.6:0/2699994176 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba804d350 con 0x7f5ba800dc80 2023-07-21T22:18:54.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f5baf59e640 1 --2- 172.21.15.6:0/2699994176 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ba80550c0 0x7f5ba803a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:54.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f5baed9d640 1 --2- 172.21.15.6:0/2699994176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ba800dc80 0x7f5ba804ddd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000e870 tx=0x7f5ba000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7ff0305ad640 1 --2- 172.21.15.6:0/493476259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff02815ff10 0x7ff0280c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7ff0305ad640 1 -- 172.21.15.6:0/493476259 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0281f7ff0 con 0x7ff0280c1340 2023-07-21T22:18:55.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7ff0305ad640 1 -- 172.21.15.6:0/493476259 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02814faa0 con 0x7ff0280cd3a0 2023-07-21T22:18:55.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7ff0305ad640 1 -- 172.21.15.6:0/493476259 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff028151f90 con 0x7ff02815ff10 2023-07-21T22:18:55.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7ff02db48640 1 --2- 172.21.15.6:0/493476259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0280cd3a0 0x7ff0281517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7ff02eb4a640 1 --2- 172.21.15.6:0/493476259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff02815ff10 0x7ff0280c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f99c3112640 1 -- 172.21.15.6:0/2043956258 shutdown_connections 2023-07-21T22:18:55.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f99c3112640 1 -- 172.21.15.6:0/2043956258 wait complete. 2023-07-21T22:18:55.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7fe2c9139640 1 -- 172.21.15.6:0/1352100843 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2b4003530 con 0x7fe2c40c1340 2023-07-21T22:18:55.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f5b977fe640 1 -- 172.21.15.6:0/2699994176 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba00095d0 con 0x7f5ba800dc80 2023-07-21T22:18:55.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f5b977fe640 1 -- 172.21.15.6:0/2699994176 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba000c940 con 0x7f5ba800dc80 2023-07-21T22:18:55.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f5b977fe640 1 -- 172.21.15.6:0/2699994176 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba000ccb0 con 0x7f5ba800dc80 2023-07-21T22:18:55.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f5bb50e6640 1 -- 172.21.15.6:0/2699994176 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba804d630 con 0x7f5ba800dc80 2023-07-21T22:18:55.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7ff02db48640 1 -- 172.21.15.6:0/493476259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff02815ff10 msgr2=0x7ff0280c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7ff02db48640 1 --2- 172.21.15.6:0/493476259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff02815ff10 0x7ff0280c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7ff02db48640 1 -- 172.21.15.6:0/493476259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0280c1340 msgr2=0x7ff0280c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7ff02db48640 1 --2- 172.21.15.6:0/493476259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0280c1340 0x7ff0280c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7ff02db48640 1 -- 172.21.15.6:0/493476259 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff020009a70 con 0x7ff0280cd3a0 2023-07-21T22:18:55.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f5bb50e6640 1 -- 172.21.15.6:0/2699994176 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba8038510 con 0x7f5ba800dc80 2023-07-21T22:18:55.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f3c0a59c640 1 --2- 172.21.15.6:0/3172943842 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c0c15fd60 0x7f3c0c0cba00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009e80 tx=0x7f3c0401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=513a4656ccd83411 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7ff02db48640 1 --2- 172.21.15.6:0/493476259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0280cd3a0 0x7ff0281517b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff02000efc0 tx=0x7ff02000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f210b7fe640 1 -- 172.21.15.6:0/2172427086 >> v1:172.21.15.161:6789/0 conn(0x7f210c0c1880 legacy=0x7f210c0c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f210b7fe640 1 -- 172.21.15.6:0/2172427086 >> v1:172.21.15.6:6789/0 conn(0x7f210c0ad790 legacy=0x7f210c0c1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:55.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f210b7fe640 1 -- 172.21.15.6:0/2172427086 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210c0cd340 con 0x7f210c0ad3c0 2023-07-21T22:18:55.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7fe2ca93c640 1 -- 172.21.15.6:0/1352100843 >> v2:172.21.15.161:3300/0 conn(0x7fe2c415ff10 msgr2=0x7fe2c40c0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:55.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7fe2ca93c640 1 --2- 172.21.15.6:0/1352100843 >> v2:172.21.15.161:3300/0 conn(0x7fe2c415ff10 0x7fe2c40c0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7fe2ca93c640 1 -- 172.21.15.6:0/1352100843 >> v1:172.21.15.6:6789/0 conn(0x7fe2c40c1340 legacy=0x7fe2c40cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7fe2ca93c640 1 -- 172.21.15.6:0/1352100843 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c40cc300 con 0x7fe2c40cd570 2023-07-21T22:18:55.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7fe2ca13b640 1 --2- 172.21.15.6:0/1352100843 >> v2:172.21.15.161:3300/0 conn(0x7fe2c415ff10 0x7fe2c40c0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:55.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f3c0959a640 1 -- 172.21.15.6:0/3172943842 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c040a57a0 con 0x7f3c0c15fd60 2023-07-21T22:18:55.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f3c0959a640 1 -- 172.21.15.6:0/3172943842 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c040a5900 con 0x7f3c0c15fd60 2023-07-21T22:18:55.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7ff01effd640 1 -- 172.21.15.6:0/493476259 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020014680 con 0x7ff0280cd3a0 2023-07-21T22:18:55.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7ff01effd640 1 -- 172.21.15.6:0/493476259 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02000f040 con 0x7ff0280cd3a0 2023-07-21T22:18:55.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7ff01effd640 1 -- 172.21.15.6:0/493476259 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020014a20 con 0x7ff0280cd3a0 2023-07-21T22:18:55.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7ff0305ad640 1 -- 172.21.15.6:0/493476259 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0180094d0 con 0x7ff0280cd3a0 2023-07-21T22:18:55.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f99c3112640 1 Processor -- start 2023-07-21T22:18:55.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f99c3112640 1 -- start start 2023-07-21T22:18:55.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f3c0b59e640 1 -- 172.21.15.6:0/3172943842 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c0c15fd60 msgr2=0x7f3c0c0cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f3c0b59e640 1 --2- 172.21.15.6:0/3172943842 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c0c15fd60 0x7f3c0c0cba00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009e80 tx=0x7f3c0401c920 comp rx=0 tx=0).stop 2023-07-21T22:18:55.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f3c0b59e640 1 -- 172.21.15.6:0/3172943842 shutdown_connections 2023-07-21T22:18:55.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f3c0b59e640 1 --2- 172.21.15.6:0/3172943842 >> v2:172.21.15.161:3300/0 conn(0x7f3c0c070f00 0x7f3c0c0afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f3c0b59e640 1 --2- 172.21.15.6:0/3172943842 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c0c15fd60 0x7f3c0c0cba00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f3c0b59e640 1 -- 172.21.15.6:0/3172943842 >> 172.21.15.6:0/3172943842 conn(0x7f3c0c0ca8b0 msgr2=0x7f3c0c0cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f3c0b59e640 1 -- 172.21.15.6:0/3172943842 shutdown_connections 2023-07-21T22:18:55.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f3c0b59e640 1 -- 172.21.15.6:0/3172943842 wait complete. 2023-07-21T22:18:55.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7ff0305ad640 1 -- 172.21.15.6:0/493476259 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0281f81d0 con 0x7ff0280cd3a0 2023-07-21T22:18:55.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f210b7fe640 1 --2- 172.21.15.6:0/2172427086 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f210c0ad3c0 0x7f210c0cc450 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2104009dc0 tx=0x7f210c0ca8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b764c64194979cbd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f99c3112640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99bc06ffb0 0x7f99bc0c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f210a7fc640 1 -- 172.21.15.6:0/2172427086 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21040a59e0 con 0x7f210c0ad3c0 2023-07-21T22:18:55.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f210a7fc640 1 -- 172.21.15.6:0/2172427086 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21040a5b40 con 0x7f210c0ad3c0 2023-07-21T22:18:55.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f210a7fc640 1 -- 172.21.15.6:0/2172427086 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21040ad440 con 0x7f210c0ad3c0 2023-07-21T22:18:55.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.940+0000 7f5bb50e6640 1 -- 172.21.15.6:0/2699994176 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5b90000fd0 con 0x7f5ba800dc80 2023-07-21T22:18:55.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f5b977fe640 1 -- 172.21.15.6:0/2699994176 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5ba0013470 con 0x7f5ba800dc80 2023-07-21T22:18:55.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7fb95da6d640 1 Processor -- start 2023-07-21T22:18:55.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f5b977fe640 1 --2- 172.21.15.6:0/2699994176 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5b9c066380 0x7f5b9c068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f5b977fe640 1 -- 172.21.15.6:0/2699994176 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5ba0084110 con 0x7f5ba800dc80 2023-07-21T22:18:55.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f3c0b59e640 1 Processor -- start 2023-07-21T22:18:55.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7fe2ca93c640 1 --2- 172.21.15.6:0/1352100843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2c40cd570 0x7fe2c406b440 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40caff0 tx=0x7fe2b801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab2f05fe8bc5171 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f5b977fe640 1 --2- 172.21.15.6:0/2699994176 >> [v2:172.21.15.6:6800/45975211,v1:172.21.15.6:6801/45975211] conn(0x7f5b9c06ec30 0x7f5b9c071040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f5b977fe640 1 -- 172.21.15.6:0/2699994176 --> [v2:172.21.15.6:6800/45975211,v1:172.21.15.6:6801/45975211] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b9c0716f0 con 0x7f5b9c06ec30 2023-07-21T22:18:55.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7fb95da6d640 1 -- start start 2023-07-21T22:18:55.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f5b977fe640 1 -- 172.21.15.6:0/2699994176 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ba00844c0 con 0x7f5ba800dc80 2023-07-21T22:18:55.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f5bae59c640 1 --2- 172.21.15.6:0/2699994176 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5b9c066380 0x7f5b9c068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f21109b7640 1 -- 172.21.15.6:0/2172427086 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f210c0ad3c0 msgr2=0x7f210c0cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f21109b7640 1 --2- 172.21.15.6:0/2172427086 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f210c0ad3c0 0x7f210c0cc450 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2104009dc0 tx=0x7f210c0ca8b0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.944+0000 7f3c0b59e640 1 -- start start 2023-07-21T22:18:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f21109b7640 1 -- 172.21.15.6:0/2172427086 shutdown_connections 2023-07-21T22:18:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f21109b7640 1 --2- 172.21.15.6:0/2172427086 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f210c0ad3c0 0x7f210c0cc450 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f21109b7640 1 -- 172.21.15.6:0/2172427086 >> 172.21.15.6:0/2172427086 conn(0x7f210c0cac20 msgr2=0x7f210c0caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fe2c9139640 1 -- 172.21.15.6:0/1352100843 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b80a5960 con 0x7fe2c40cd570 2023-07-21T22:18:55.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fe2c9139640 1 -- 172.21.15.6:0/1352100843 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b80a5ac0 con 0x7fe2c40cd570 2023-07-21T22:18:55.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f21109b7640 1 -- 172.21.15.6:0/2172427086 shutdown_connections 2023-07-21T22:18:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fe2c9139640 1 -- 172.21.15.6:0/1352100843 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b80a5960 con 0x7fe2c40cd570 2023-07-21T22:18:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f21109b7640 1 -- 172.21.15.6:0/2172427086 wait complete. 2023-07-21T22:18:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7ff0305ad640 1 -- 172.21.15.6:0/493476259 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff0281602e0 con 0x7ff0280cd3a0 2023-07-21T22:18:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f3c0b59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c0c070f00 0x7f3c0c147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fb95da6d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb9580b7c70 0x7fb9580d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f99c3112640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99bc0afdf0 0x7f99bc0c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f99c3112640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99bc158680 0x7f99bc1532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f99c3112640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0c4210 con 0x7f99bc06ffb0 2023-07-21T22:18:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fb95da6d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9580d1850 0x7fb95815f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fb95da6d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9580ccaf0 con 0x7fb9580d1300 2023-07-21T22:18:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fb95da6d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9580d1190 con 0x7fb9580b7c70 2023-07-21T22:18:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f99c3112640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0b1b10 con 0x7f99bc0afdf0 2023-07-21T22:18:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f99c3112640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0c22c0 con 0x7f99bc158680 2023-07-21T22:18:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fb95da6d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb958160600 con 0x7fb9580d1850 2023-07-21T22:18:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f3c0b59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c0c0af8b0 0x7f3c0c155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f99c2110640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99bc06ffb0 0x7f99bc0c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f99c2110640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99bc06ffb0 0x7f99bc0c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46814/0 (socket says 172.21.15.6:46814) 2023-07-21T22:18:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f99c2110640 1 -- 172.21.15.6:0/2792093723 learned_addr learned my addr 172.21.15.6:0/2792093723 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:55.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fb956ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9580d1850 0x7fb95815f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fb956ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9580d1850 0x7fb95815f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:57848/0 (socket says 172.21.15.6:57848) 2023-07-21T22:18:55.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fb956ffd640 1 -- 172.21.15.6:0/2846195643 learned_addr learned my addr 172.21.15.6:0/2846195643 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:55.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f3c0b59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c0c15fd60 0x7f3c0c1555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f3c09d9b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c0c0af8b0 0x7f3c0c155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f3c09d9b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c0c0af8b0 0x7f3c0c155090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:57864/0 (socket says 172.21.15.6:57864) 2023-07-21T22:18:55.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f5bae59c640 1 --2- 172.21.15.6:0/2699994176 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5b9c066380 0x7f5b9c068830 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ba803b080 tx=0x7f5ba4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f5baf59e640 1 --2- 172.21.15.6:0/2699994176 >> [v2:172.21.15.6:6800/45975211,v1:172.21.15.6:6801/45975211] conn(0x7f5b9c06ec30 0x7f5b9c071040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f3c09d9b640 1 -- 172.21.15.6:0/1089900934 learned_addr learned my addr 172.21.15.6:0/1089900934 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:55.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f3c0b59e640 1 -- 172.21.15.6:0/1089900934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c146390 con 0x7f3c0c070f00 2023-07-21T22:18:55.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f3c0b59e640 1 -- 172.21.15.6:0/1089900934 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c147170 con 0x7f3c0c15fd60 2023-07-21T22:18:55.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f3c0ad9d640 1 --2- 172.21.15.6:0/1089900934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c0c15fd60 0x7f3c0c1555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fe2cc39f640 1 -- 172.21.15.6:0/1352100843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2c40cd570 msgr2=0x7fe2c406b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fe2cc39f640 1 --2- 172.21.15.6:0/1352100843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2c40cd570 0x7fe2c406b440 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40caff0 tx=0x7fe2b801c8a0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f5baf59e640 1 --2- 172.21.15.6:0/2699994176 >> [v2:172.21.15.6:6800/45975211,v1:172.21.15.6:6801/45975211] conn(0x7f5b9c06ec30 0x7f5b9c071040 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f21109b7640 1 Processor -- start 2023-07-21T22:18:55.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fe2cc39f640 1 -- 172.21.15.6:0/1352100843 shutdown_connections 2023-07-21T22:18:55.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fe2cc39f640 1 --2- 172.21.15.6:0/1352100843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2c40cd570 0x7fe2c406b440 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fe2cc39f640 1 --2- 172.21.15.6:0/1352100843 >> v2:172.21.15.161:3300/0 conn(0x7fe2c415ff10 0x7fe2c40c0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fe2cc39f640 1 -- 172.21.15.6:0/1352100843 >> 172.21.15.6:0/1352100843 conn(0x7fe2c40ce9d0 msgr2=0x7fe2c40ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f3c0b59e640 1 -- 172.21.15.6:0/1089900934 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c148450 con 0x7f3c0c0af8b0 2023-07-21T22:18:55.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fe2cc39f640 1 -- 172.21.15.6:0/1352100843 shutdown_connections 2023-07-21T22:18:55.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f21109b7640 1 -- start start 2023-07-21T22:18:55.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fe2cc39f640 1 -- 172.21.15.6:0/1352100843 wait complete. 2023-07-21T22:18:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f3c09d9b640 1 -- 172.21.15.6:0/1089900934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c0c15fd60 msgr2=0x7f3c0c1555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f3c09d9b640 1 --2- 172.21.15.6:0/1089900934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c0c15fd60 0x7f3c0c1555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f3c09d9b640 1 -- 172.21.15.6:0/1089900934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c0c070f00 msgr2=0x7f3c0c147f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f3c09d9b640 1 --2- 172.21.15.6:0/1089900934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c0c070f00 0x7f3c0c147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f3c09d9b640 1 -- 172.21.15.6:0/1089900934 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc009420 con 0x7f3c0c0af8b0 2023-07-21T22:18:55.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f2a1cdb7640 1 Processor -- start 2023-07-21T22:18:55.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f21109b7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f210c0ad3c0 0x7f210c0ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f3c09d9b640 1 --2- 172.21.15.6:0/1089900934 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c0c0af8b0 0x7f3c0c155090 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000c480 tx=0x7f3c0000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f2a1cdb7640 1 -- start start 2023-07-21T22:18:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f3bfaffd640 1 -- 172.21.15.6:0/1089900934 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00011790 con 0x7f3c0c0af8b0 2023-07-21T22:18:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f3bfaffd640 1 -- 172.21.15.6:0/1089900934 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c00011910 con 0x7f3c0c0af8b0 2023-07-21T22:18:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f3bfaffd640 1 -- 172.21.15.6:0/1089900934 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00011cc0 con 0x7f3c0c0af8b0 2023-07-21T22:18:55.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f21109b7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f210c0ad790 0x7f210c0ab6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f210b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f210c0ad3c0 0x7f210c0ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f21109b7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f210c0c1880 0x7f210c1535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f21109b7640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210c160860 con 0x7f210c0ad3c0 2023-07-21T22:18:55.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f210b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f210c0ad3c0 0x7f210c0ac070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46828/0 (socket says 172.21.15.6:46828) 2023-07-21T22:18:55.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f21109b7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210c0ac750 con 0x7f210c0c1880 2023-07-21T22:18:55.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f210b7fe640 1 -- 172.21.15.6:0/47361653 learned_addr learned my addr 172.21.15.6:0/47361653 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:55.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f21109b7640 1 -- 172.21.15.6:0/47361653 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f210c0aca30 con 0x7f210c0ad790 2023-07-21T22:18:55.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f210affd640 1 --2- 172.21.15.6:0/47361653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f210c0ad790 0x7f210c0ab6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f5b977fe640 1 -- 172.21.15.6:0/2699994176 <== osd.0 v2:172.21.15.6:6800/45975211 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5b9c0716f0 con 0x7f5b9c06ec30 2023-07-21T22:18:55.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f3c0b59e640 1 -- 172.21.15.6:0/1089900934 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c04009b30 con 0x7f3c0c0af8b0 2023-07-21T22:18:55.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f3c0b59e640 1 -- 172.21.15.6:0/1089900934 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0c146840 con 0x7f3c0c0af8b0 2023-07-21T22:18:55.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7fe2cc39f640 1 Processor -- start 2023-07-21T22:18:55.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7fe2cc39f640 1 -- start start 2023-07-21T22:18:55.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f3c0b59e640 1 -- 172.21.15.6:0/1089900934 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3c0c0cbf40 con 0x7f3c0c0af8b0 2023-07-21T22:18:55.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f2a1cdb7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a1815bbe0 0x7f2a180d10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f2a1cdb7640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a180d0320 con 0x7f2a18160090 2023-07-21T22:18:55.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f2a1cdb7640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a180d15e0 con 0x7f2a180cc870 2023-07-21T22:18:55.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f2a1cdb7640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a180d0c80 con 0x7f2a1815bbe0 2023-07-21T22:18:55.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f210bfff640 1 --2- 172.21.15.6:0/47361653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f210c0c1880 0x7f210c1535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f2a177fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a1815bbe0 0x7f2a180d10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f2a177fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a1815bbe0 0x7f2a180d10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:57896/0 (socket says 172.21.15.6:57896) 2023-07-21T22:18:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f2a177fe640 1 -- 172.21.15.6:0/2363859903 learned_addr learned my addr 172.21.15.6:0/2363859903 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7ff01effd640 1 -- 172.21.15.6:0/493476259 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff020006d50 con 0x7ff0280cd3a0 2023-07-21T22:18:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7ff01effd640 1 --2- 172.21.15.6:0/493476259 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff00c066350 0x7ff00c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7ff01effd640 1 -- 172.21.15.6:0/493476259 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff020084a30 con 0x7ff0280cd3a0 2023-07-21T22:18:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7ff01effd640 1 --2- 172.21.15.6:0/493476259 >> [v2:172.21.15.6:6816/2815481744,v1:172.21.15.6:6817/2815481744] conn(0x7ff00c06eb80 0x7ff00c070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7ff01effd640 1 -- 172.21.15.6:0/493476259 --> [v2:172.21.15.6:6816/2815481744,v1:172.21.15.6:6817/2815481744] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff00c071640 con 0x7ff00c06eb80 2023-07-21T22:18:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7ff02e349640 1 --2- 172.21.15.6:0/493476259 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff00c066350 0x7ff00c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7ff02eb4a640 1 --2- 172.21.15.6:0/493476259 >> [v2:172.21.15.6:6816/2815481744,v1:172.21.15.6:6817/2815481744] conn(0x7ff00c06eb80 0x7ff00c070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fb956ffd640 1 -- 172.21.15.6:0/2846195643 >> v2:172.21.15.161:3300/0 conn(0x7fb9580b7c70 msgr2=0x7fb9580d0c50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:18:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fb956ffd640 1 --2- 172.21.15.6:0/2846195643 >> v2:172.21.15.161:3300/0 conn(0x7fb9580b7c70 0x7fb9580d0c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fb956ffd640 1 -- 172.21.15.6:0/2846195643 >> v1:172.21.15.161:6789/0 conn(0x7fb9580d1300 legacy=0x7fb9580d1da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:18:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7fb956ffd640 1 -- 172.21.15.6:0/2846195643 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb958160320 con 0x7fb9580d1850 2023-07-21T22:18:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f2a177fe640 1 -- 172.21.15.6:0/2363859903 >> v1:172.21.15.161:6789/0 conn(0x7f2a180cc870 legacy=0x7f2a1815f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f2a177fe640 1 -- 172.21.15.6:0/2363859903 >> v1:172.21.15.6:6789/0 conn(0x7f2a18160090 legacy=0x7f2a180b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f210bfff640 1 -- 172.21.15.6:0/47361653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f210c0ad790 msgr2=0x7f210c0ab6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f210bfff640 1 --2- 172.21.15.6:0/47361653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f210c0ad790 0x7f210c0ab6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f210bfff640 1 -- 172.21.15.6:0/47361653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f210c0ad3c0 msgr2=0x7f210c0ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f210bfff640 1 --2- 172.21.15.6:0/47361653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f210c0ad3c0 0x7f210c0ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f210bfff640 1 -- 172.21.15.6:0/47361653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2104009a70 con 0x7f210c0c1880 2023-07-21T22:18:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7fe2cc39f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2c40c1340 0x7fe2c40c0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7ff02e349640 1 --2- 172.21.15.6:0/493476259 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff00c066350 0x7ff00c068800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff024006fd0 tx=0x7ff024008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.948+0000 7f99c190f640 1 --2- 172.21.15.6:0/2792093723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99bc0afdf0 0x7f99bc0c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f99c2911640 1 --2- 172.21.15.6:0/2792093723 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99bc158680 0x7f99bc1532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f99c190f640 1 -- 172.21.15.6:0/2792093723 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99bc158680 msgr2=0x7f99bc1532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f99c190f640 1 --2- 172.21.15.6:0/2792093723 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99bc158680 0x7f99bc1532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f99c190f640 1 -- 172.21.15.6:0/2792093723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99bc06ffb0 msgr2=0x7f99bc0c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f99c190f640 1 --2- 172.21.15.6:0/2792093723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99bc06ffb0 0x7f99bc0c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f99c190f640 1 -- 172.21.15.6:0/2792093723 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b4009b30 con 0x7f99bc0afdf0 2023-07-21T22:18:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f99c190f640 1 --2- 172.21.15.6:0/2792093723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99bc0afdf0 0x7f99bc0c1d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f99b40ab000 tx=0x7f99b4019770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f99b2ffd640 1 -- 172.21.15.6:0/2792093723 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40bd070 con 0x7f99bc0afdf0 2023-07-21T22:18:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f99b2ffd640 1 -- 172.21.15.6:0/2792093723 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b40b8470 con 0x7f99bc0afdf0 2023-07-21T22:18:55.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f99b2ffd640 1 -- 172.21.15.6:0/2792093723 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40a5740 con 0x7f99bc0afdf0 2023-07-21T22:18:55.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.952+0000 7f99c3112640 1 -- 172.21.15.6:0/2792093723 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc0b0c60 con 0x7f99bc0afdf0 2023-07-21T22:18:55.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f99c3112640 1 -- 172.21.15.6:0/2792093723 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc0b11e0 con 0x7f99bc0afdf0 2023-07-21T22:18:55.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f3bfaffd640 1 -- 172.21.15.6:0/1089900934 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3c0001c460 con 0x7f3c0c0af8b0 2023-07-21T22:18:55.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7fe2cc39f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2c40cd570 0x7fe2c413b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7fe2cc39f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2c415ff10 0x7fe2c413bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7fe2cc39f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c406fab0 con 0x7fe2c40c1340 2023-07-21T22:18:55.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7fe2cc39f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c406fd90 con 0x7fe2c415ff10 2023-07-21T22:18:55.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7fe2cc39f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c4070070 con 0x7fe2c40cd570 2023-07-21T22:18:55.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f210bfff640 1 --2- 172.21.15.6:0/47361653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f210c0c1880 0x7f210c1535a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f210c0c88a0 tx=0x7f20fc00c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f2a177fe640 1 -- 172.21.15.6:0/2363859903 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a180d05c0 con 0x7f2a1815bbe0 2023-07-21T22:18:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7ff01effd640 1 -- 172.21.15.6:0/493476259 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0200098f0 con 0x7ff0280cd3a0 2023-07-21T22:18:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f3bfaffd640 1 --2- 172.21.15.6:0/1089900934 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3bec066350 0x7f3bec068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f3bfaffd640 1 -- 172.21.15.6:0/1089900934 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3c00083b00 con 0x7f3c0c0af8b0 2023-07-21T22:18:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7ff02eb4a640 1 --2- 172.21.15.6:0/493476259 >> [v2:172.21.15.6:6816/2815481744,v1:172.21.15.6:6817/2815481744] conn(0x7ff00c06eb80 0x7ff00c070f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f99b0ff9640 1 -- 172.21.15.6:0/2792093723 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f99bc070430 con 0x7f99bc0afdf0 2023-07-21T22:18:55.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f3bfaffd640 1 --2- 172.21.15.6:0/1089900934 >> [v2:172.21.15.6:6824/3751691192,v1:172.21.15.6:6825/3751691192] conn(0x7f3bec06ec00 0x7f3bec071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f3bfaffd640 1 -- 172.21.15.6:0/1089900934 --> [v2:172.21.15.6:6824/3751691192,v1:172.21.15.6:6825/3751691192] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3bec0716c0 con 0x7f3bec06ec00 2023-07-21T22:18:55.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f3bfaffd640 1 -- 172.21.15.6:0/1089900934 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c00085ea0 con 0x7f3c0c0af8b0 2023-07-21T22:18:55.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7fe2c993a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2c40cd570 0x7fe2c413b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7fe2c993a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2c40cd570 0x7fe2c413b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:57902/0 (socket says 172.21.15.6:57902) 2023-07-21T22:18:55.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7fe2c993a640 1 -- 172.21.15.6:0/3396372323 learned_addr learned my addr 172.21.15.6:0/3396372323 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:55.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7fb956ffd640 1 --2- 172.21.15.6:0/2846195643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9580d1850 0x7fb95815f650 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009870 tx=0x7fb94c01c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c979034129c54b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f3c0a59c640 1 --2- 172.21.15.6:0/1089900934 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3bec066350 0x7f3bec068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7fe2ca93c640 1 --2- 172.21.15.6:0/3396372323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2c415ff10 0x7fe2c413bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f3c0ad9d640 1 --2- 172.21.15.6:0/1089900934 >> [v2:172.21.15.6:6824/3751691192,v1:172.21.15.6:6825/3751691192] conn(0x7f3bec06ec00 0x7f3bec071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7fe2ca13b640 1 --2- 172.21.15.6:0/3396372323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2c40c1340 0x7fe2c40c0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7fe2c993a640 1 -- 172.21.15.6:0/3396372323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2c415ff10 msgr2=0x7fe2c413bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7fe2c993a640 1 --2- 172.21.15.6:0/3396372323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2c415ff10 0x7fe2c413bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7fe2c993a640 1 -- 172.21.15.6:0/3396372323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2c40c1340 msgr2=0x7fe2c40c0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7fe2c993a640 1 --2- 172.21.15.6:0/3396372323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2c40c1340 0x7fe2c40c0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7fe2c993a640 1 -- 172.21.15.6:0/3396372323 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b8009a70 con 0x7fe2c40cd570 2023-07-21T22:18:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f3c0ad9d640 1 --2- 172.21.15.6:0/1089900934 >> [v2:172.21.15.6:6824/3751691192,v1:172.21.15.6:6825/3751691192] conn(0x7f3bec06ec00 0x7f3bec071010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7fe2c993a640 1 --2- 172.21.15.6:0/3396372323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2c40cd570 0x7fe2c413b7d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0000fc0 tx=0x7fe2b000c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f3c0a59c640 1 --2- 172.21.15.6:0/1089900934 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3bec066350 0x7f3bec068800 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3c040ae000 tx=0x7f3c04004ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7fe2c2ffd640 1 -- 172.21.15.6:0/3396372323 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0005cf0 con 0x7fe2c40cd570 2023-07-21T22:18:55.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7fe2c2ffd640 1 -- 172.21.15.6:0/3396372323 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b0005e50 con 0x7fe2c40cd570 2023-07-21T22:18:55.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f2a177fe640 1 --2- 172.21.15.6:0/2363859903 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a1815bbe0 0x7f2a180d10a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0098a0 tx=0x7f2a0c01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c98578b60d5d65cf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7fe2c2ffd640 1 -- 172.21.15.6:0/3396372323 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0007290 con 0x7fe2c40cd570 2023-07-21T22:18:55.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7fe2cc39f640 1 -- 172.21.15.6:0/3396372323 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c4070350 con 0x7fe2c40cd570 2023-07-21T22:18:55.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7fe2cc39f640 1 -- 172.21.15.6:0/3396372323 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c4147580 con 0x7fe2c40cd570 2023-07-21T22:18:55.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f3bfaffd640 1 -- 172.21.15.6:0/1089900934 <== osd.3 v2:172.21.15.6:6824/3751691192 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3bec0716c0 con 0x7f3bec06ec00 2023-07-21T22:18:55.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f2103fff640 1 -- 172.21.15.6:0/47361653 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc005cf0 con 0x7f210c0c1880 2023-07-21T22:18:55.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f2103fff640 1 -- 172.21.15.6:0/47361653 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20fc005e50 con 0x7f210c0c1880 2023-07-21T22:18:55.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f2103fff640 1 -- 172.21.15.6:0/47361653 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc0072d0 con 0x7f210c0c1880 2023-07-21T22:18:55.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f21109b7640 1 -- 172.21.15.6:0/47361653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f210c0aaef0 con 0x7f210c0c1880 2023-07-21T22:18:55.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f21109b7640 1 -- 172.21.15.6:0/47361653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f210c0abc30 con 0x7f210c0c1880 2023-07-21T22:18:55.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.956+0000 7f21109b7640 1 -- 172.21.15.6:0/47361653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f210c0cc990 con 0x7f210c0c1880 2023-07-21T22:18:55.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f2103fff640 1 -- 172.21.15.6:0/47361653 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f20fc007430 con 0x7f210c0c1880 2023-07-21T22:18:55.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f99b2ffd640 1 -- 172.21.15.6:0/2792093723 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99b40039a0 con 0x7f99bc0afdf0 2023-07-21T22:18:55.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f99b2ffd640 1 --2- 172.21.15.6:0/2792093723 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f99a0077390 0x7f99a0079840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f99b2ffd640 1 -- 172.21.15.6:0/2792093723 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f99b411e700 con 0x7f99bc0afdf0 2023-07-21T22:18:55.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7fe2cc39f640 1 -- 172.21.15.6:0/3396372323 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2c41602e0 con 0x7fe2c40cd570 2023-07-21T22:18:55.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f2103fff640 1 --2- 172.21.15.6:0/47361653 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f20ec0662d0 0x7f20ec068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f2103fff640 1 -- 172.21.15.6:0/47361653 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f20fc0837d0 con 0x7f210c0c1880 2023-07-21T22:18:55.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f2103fff640 1 --2- 172.21.15.6:0/47361653 >> [v2:172.21.15.161:6800/771066506,v1:172.21.15.161:6801/771066506] conn(0x7f20ec06eb80 0x7f20ec070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f2103fff640 1 -- 172.21.15.6:0/47361653 --> [v2:172.21.15.161:6800/771066506,v1:172.21.15.161:6801/771066506] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20ec071640 con 0x7f20ec06eb80 2023-07-21T22:18:55.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f2103fff640 1 -- 172.21.15.6:0/47361653 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20fc083c70 con 0x7f210c0c1880 2023-07-21T22:18:55.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f2a167fc640 1 -- 172.21.15.6:0/2363859903 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c0ac410 con 0x7f2a1815bbe0 2023-07-21T22:18:55.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7fb9567fc640 1 -- 172.21.15.6:0/2846195643 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c0aa5f0 con 0x7fb9580d1850 2023-07-21T22:18:55.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7fb9567fc640 1 -- 172.21.15.6:0/2846195643 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c0aa750 con 0x7fb9580d1850 2023-07-21T22:18:55.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7fb9567fc640 1 -- 172.21.15.6:0/2846195643 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c0aaae0 con 0x7fb9580d1850 2023-07-21T22:18:55.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7fb95da6d640 1 -- 172.21.15.6:0/2846195643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9580d1850 msgr2=0x7fb95815f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7fb95da6d640 1 --2- 172.21.15.6:0/2846195643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9580d1850 0x7fb95815f650 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009870 tx=0x7fb94c01c4f0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f99b2ffd640 1 --2- 172.21.15.6:0/2792093723 >> [v2:172.21.15.6:6808/3480578303,v1:172.21.15.6:6809/3480578303] conn(0x7f99a007fc40 0x7f99a0082050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f99b2ffd640 1 -- 172.21.15.6:0/2792093723 --> [v2:172.21.15.6:6808/3480578303,v1:172.21.15.6:6809/3480578303] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99a0082700 con 0x7f99a007fc40 2023-07-21T22:18:55.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f99b2ffd640 1 -- 172.21.15.6:0/2792093723 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99b4120d20 con 0x7f99bc0afdf0 2023-07-21T22:18:55.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f210b7fe640 1 --2- 172.21.15.6:0/47361653 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f20ec0662d0 0x7f20ec068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f2a167fc640 1 -- 172.21.15.6:0/2363859903 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0c0ac570 con 0x7f2a1815bbe0 2023-07-21T22:18:55.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f2a167fc640 1 -- 172.21.15.6:0/2363859903 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c0ac900 con 0x7f2a1815bbe0 2023-07-21T22:18:55.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f2a1cdb7640 1 -- 172.21.15.6:0/2363859903 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a1815bbe0 msgr2=0x7f2a180d10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f2a1cdb7640 1 --2- 172.21.15.6:0/2363859903 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a1815bbe0 0x7f2a180d10a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0098a0 tx=0x7f2a0c01c4e0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f99c2110640 1 --2- 172.21.15.6:0/2792093723 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f99a0077390 0x7f99a0079840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f99c2911640 1 --2- 172.21.15.6:0/2792093723 >> [v2:172.21.15.6:6808/3480578303,v1:172.21.15.6:6809/3480578303] conn(0x7f99a007fc40 0x7f99a0082050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f2a1cdb7640 1 -- 172.21.15.6:0/2363859903 shutdown_connections 2023-07-21T22:18:55.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f2a1cdb7640 1 --2- 172.21.15.6:0/2363859903 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a1815bbe0 0x7f2a180d10a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f2a1cdb7640 1 -- 172.21.15.6:0/2363859903 >> 172.21.15.6:0/2363859903 conn(0x7f2a18070690 msgr2=0x7f2a18069430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7ff01effd640 1 -- 172.21.15.6:0/493476259 <== osd.1 v2:172.21.15.6:6816/2815481744 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff00c071640 con 0x7ff00c06eb80 2023-07-21T22:18:55.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.960+0000 7f210affd640 1 --2- 172.21.15.6:0/47361653 >> [v2:172.21.15.161:6800/771066506,v1:172.21.15.161:6801/771066506] conn(0x7f20ec06eb80 0x7f20ec070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.964+0000 7fb95da6d640 1 -- 172.21.15.6:0/2846195643 shutdown_connections 2023-07-21T22:18:55.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.964+0000 7fb95da6d640 1 --2- 172.21.15.6:0/2846195643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9580d1850 0x7fb95815f650 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.964+0000 7fb95da6d640 1 --2- 172.21.15.6:0/2846195643 >> v2:172.21.15.161:3300/0 conn(0x7fb9580b7c70 0x7fb9580d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.964+0000 7fb95da6d640 1 -- 172.21.15.6:0/2846195643 >> 172.21.15.6:0/2846195643 conn(0x7fb9580650b0 msgr2=0x7fb9580654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.964+0000 7f99c2911640 1 --2- 172.21.15.6:0/2792093723 >> [v2:172.21.15.6:6808/3480578303,v1:172.21.15.6:6809/3480578303] conn(0x7f99a007fc40 0x7f99a0082050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.964+0000 7fb95da6d640 1 -- 172.21.15.6:0/2846195643 shutdown_connections 2023-07-21T22:18:55.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.964+0000 7fb95da6d640 1 -- 172.21.15.6:0/2846195643 wait complete. 2023-07-21T22:18:55.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.964+0000 7f210b7fe640 1 --2- 172.21.15.6:0/47361653 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f20ec0662d0 0x7f20ec068780 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2104000f90 tx=0x7f2104004a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.964+0000 7fe2c2ffd640 1 -- 172.21.15.6:0/3396372323 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe2b00073f0 con 0x7fe2c40cd570 2023-07-21T22:18:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.964+0000 7f99b2ffd640 1 -- 172.21.15.6:0/2792093723 <== osd.2 v2:172.21.15.6:6808/3480578303 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f99a0082700 con 0x7f99a007fc40 2023-07-21T22:18:55.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.964+0000 7f210affd640 1 --2- 172.21.15.6:0/47361653 >> [v2:172.21.15.161:6800/771066506,v1:172.21.15.161:6801/771066506] conn(0x7f20ec06eb80 0x7f20ec070f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.964+0000 7f2a1cdb7640 1 -- 172.21.15.6:0/2363859903 shutdown_connections 2023-07-21T22:18:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.964+0000 7f2a1cdb7640 1 -- 172.21.15.6:0/2363859903 wait complete. 2023-07-21T22:18:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.964+0000 7f2103fff640 1 -- 172.21.15.6:0/47361653 <== osd.6 v2:172.21.15.161:6800/771066506 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f20ec071640 con 0x7f20ec06eb80 2023-07-21T22:18:55.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.964+0000 7f2a1cdb7640 1 Processor -- start 2023-07-21T22:18:55.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.964+0000 7fb95da6d640 1 Processor -- start 2023-07-21T22:18:55.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f99c2110640 1 --2- 172.21.15.6:0/2792093723 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f99a0077390 0x7f99a0079840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009b10 tx=0x7f99b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.964+0000 7f2a1cdb7640 1 -- start start 2023-07-21T22:18:55.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f2a1cdb7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a180cc870 0x7f2a1806f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f2a1cdb7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a1815bbe0 0x7f2a1806c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f2a1cdb7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a18160090 0x7f2a18159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f2a177fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a180cc870 0x7f2a1806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f2a177fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a180cc870 0x7f2a1806f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:48010/0 (socket says 172.21.15.6:48010) 2023-07-21T22:18:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f2a177fe640 1 -- 172.21.15.6:0/2306787795 learned_addr learned my addr 172.21.15.6:0/2306787795 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f2a16ffd640 1 --2- 172.21.15.6:0/2306787795 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a1815bbe0 0x7f2a1806c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f2a1cdb7640 1 -- 172.21.15.6:0/2306787795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a18157730 con 0x7f2a18160090 2023-07-21T22:18:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f2a1cdb7640 1 -- 172.21.15.6:0/2306787795 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a180cc4a0 con 0x7f2a180cc870 2023-07-21T22:18:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f2a1cdb7640 1 -- 172.21.15.6:0/2306787795 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a18157980 con 0x7f2a1815bbe0 2023-07-21T22:18:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f2a177fe640 1 -- 172.21.15.6:0/2306787795 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a1815bbe0 msgr2=0x7f2a1806c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f2a177fe640 1 --2- 172.21.15.6:0/2306787795 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a1815bbe0 0x7f2a1806c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f2a177fe640 1 -- 172.21.15.6:0/2306787795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a18160090 msgr2=0x7f2a18159b80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:18:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f2a17fff640 1 --2- 172.21.15.6:0/2306787795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a18160090 0x7f2a18159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f2a177fe640 1 --2- 172.21.15.6:0/2306787795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a18160090 0x7f2a18159b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f2a177fe640 1 -- 172.21.15.6:0/2306787795 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0c0094d0 con 0x7f2a180cc870 2023-07-21T22:18:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f2a17fff640 1 --2- 172.21.15.6:0/2306787795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a18160090 0x7f2a18159b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7fb95da6d640 1 -- start start 2023-07-21T22:18:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f2a177fe640 1 --2- 172.21.15.6:0/2306787795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a180cc870 0x7f2a1806f120 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c01ab90 tx=0x7f2a0c019280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7fb95da6d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9580b7c70 0x7fb958159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7fb95da6d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9580d1300 0x7fb95814bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f29fffff640 1 -- 172.21.15.6:0/2306787795 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c0ac410 con 0x7f2a180cc870 2023-07-21T22:18:55.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f29fffff640 1 -- 172.21.15.6:0/2306787795 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0c0b5630 con 0x7f2a180cc870 2023-07-21T22:18:55.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f29fffff640 1 -- 172.21.15.6:0/2306787795 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c0b59e0 con 0x7f2a180cc870 2023-07-21T22:18:55.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fe2c2ffd640 1 --2- 172.21.15.6:0/3396372323 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe2a8066280 0x7fe2a8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f2a1cdb7640 1 -- 172.21.15.6:0/2306787795 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a18157c60 con 0x7f2a180cc870 2023-07-21T22:18:55.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7f2a1cdb7640 1 -- 172.21.15.6:0/2306787795 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a1806ed20 con 0x7f2a180cc870 2023-07-21T22:18:55.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7f2a1cdb7640 1 -- 172.21.15.6:0/2306787795 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2a1815bfb0 con 0x7f2a180cc870 2023-07-21T22:18:55.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7fb95da6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9580d1850 0x7fb95814fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7fb95da6d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95814c8c0 con 0x7fb9580d1850 2023-07-21T22:18:55.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7fb95da6d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95814f1e0 con 0x7fb9580d1300 2023-07-21T22:18:55.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7fb95da6d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95815af10 con 0x7fb9580b7c70 2023-07-21T22:18:55.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.968+0000 7fb956ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9580d1300 0x7fb95814bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fb956ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9580d1300 0x7fb95814bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:48022/0 (socket says 172.21.15.6:48022) 2023-07-21T22:18:55.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fb956ffd640 1 -- 172.21.15.6:0/3419435646 learned_addr learned my addr 172.21.15.6:0/3419435646 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:55.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fb9577fe640 1 --2- 172.21.15.6:0/3419435646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9580b7c70 0x7fb958159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fb957fff640 1 --2- 172.21.15.6:0/3419435646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9580d1850 0x7fb95814fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fe2ca13b640 1 --2- 172.21.15.6:0/3396372323 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe2a8066280 0x7fe2a8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fe2c2ffd640 1 -- 172.21.15.6:0/3396372323 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe2b00833b0 con 0x7fe2c40cd570 2023-07-21T22:18:55.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fb957fff640 1 -- 172.21.15.6:0/3419435646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9580b7c70 msgr2=0x7fb958159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fb957fff640 1 --2- 172.21.15.6:0/3419435646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9580b7c70 0x7fb958159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fb957fff640 1 -- 172.21.15.6:0/3419435646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9580d1300 msgr2=0x7fb95814bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fb957fff640 1 --2- 172.21.15.6:0/3419435646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9580d1300 0x7fb95814bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fb957fff640 1 -- 172.21.15.6:0/3419435646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c0094d0 con 0x7fb9580d1850 2023-07-21T22:18:55.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fe2ca13b640 1 --2- 172.21.15.6:0/3396372323 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe2a8066280 0x7fe2a8068730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc006fd0 tx=0x7fe2bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fb957fff640 1 --2- 172.21.15.6:0/3419435646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9580d1850 0x7fb95814fb70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb95000be20 tx=0x7fb95000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fe2c2ffd640 1 --2- 172.21.15.6:0/3396372323 >> [v2:172.21.15.161:6824/3485236199,v1:172.21.15.161:6825/3485236199] conn(0x7fe2a806eb30 0x7fe2a8070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fe2c2ffd640 1 -- 172.21.15.6:0/3396372323 --> [v2:172.21.15.161:6824/3485236199,v1:172.21.15.161:6825/3485236199] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2a80715f0 con 0x7fe2a806eb30 2023-07-21T22:18:55.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fe2c2ffd640 1 -- 172.21.15.6:0/3396372323 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2b00859d0 con 0x7fe2c40cd570 2023-07-21T22:18:55.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fb93ffff640 1 -- 172.21.15.6:0/3419435646 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95000ce70 con 0x7fb9580d1850 2023-07-21T22:18:55.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fe2ca93c640 1 --2- 172.21.15.6:0/3396372323 >> [v2:172.21.15.161:6824/3485236199,v1:172.21.15.161:6825/3485236199] conn(0x7fe2a806eb30 0x7fe2a8070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.976+0000 7fe2ca93c640 1 --2- 172.21.15.6:0/3396372323 >> [v2:172.21.15.161:6824/3485236199,v1:172.21.15.161:6825/3485236199] conn(0x7fe2a806eb30 0x7fe2a8070f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fb95da6d640 1 -- 172.21.15.6:0/3419435646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95815b1f0 con 0x7fb9580d1850 2023-07-21T22:18:55.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.972+0000 7fb95da6d640 1 -- 172.21.15.6:0/3419435646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95815b7b0 con 0x7fb9580d1850 2023-07-21T22:18:55.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.976+0000 7f29fffff640 1 -- 172.21.15.6:0/2306787795 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2a0c0b3070 con 0x7f2a180cc870 2023-07-21T22:18:55.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.976+0000 7fb93ffff640 1 -- 172.21.15.6:0/3419435646 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb950014440 con 0x7fb9580d1850 2023-07-21T22:18:55.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.976+0000 7fb93ffff640 1 -- 172.21.15.6:0/3419435646 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb950014830 con 0x7fb9580d1850 2023-07-21T22:18:55.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.976+0000 7f29fffff640 1 --2- 172.21.15.6:0/2306787795 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2a04066280 0x7f2a04068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.976+0000 7f29fffff640 1 -- 172.21.15.6:0/2306787795 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2a0c11edb0 con 0x7f2a180cc870 2023-07-21T22:18:55.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.976+0000 7f29fffff640 1 --2- 172.21.15.6:0/2306787795 >> [v2:172.21.15.161:6816/2760284950,v1:172.21.15.161:6817/2760284950] conn(0x7f2a0406eb30 0x7f2a04070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.976+0000 7f29fffff640 1 -- 172.21.15.6:0/2306787795 --> [v2:172.21.15.161:6816/2760284950,v1:172.21.15.161:6817/2760284950] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a040715f0 con 0x7f2a0406eb30 2023-07-21T22:18:55.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.976+0000 7f29fffff640 1 -- 172.21.15.6:0/2306787795 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a0c11f160 con 0x7f2a180cc870 2023-07-21T22:18:55.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.976+0000 7f2a16ffd640 1 --2- 172.21.15.6:0/2306787795 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2a04066280 0x7f2a04068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.976+0000 7fb95da6d640 1 -- 172.21.15.6:0/3419435646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb95815ffa0 con 0x7fb9580d1850 2023-07-21T22:18:55.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.976+0000 7f2a17fff640 1 --2- 172.21.15.6:0/2306787795 >> [v2:172.21.15.161:6816/2760284950,v1:172.21.15.161:6817/2760284950] conn(0x7f2a0406eb30 0x7f2a04070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.976+0000 7fb93ffff640 1 -- 172.21.15.6:0/3419435646 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb95001d3b0 con 0x7fb9580d1850 2023-07-21T22:18:55.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.976+0000 7f2a16ffd640 1 --2- 172.21.15.6:0/2306787795 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2a04066280 0x7f2a04068730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2a18204d40 tx=0x7f2a08009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.976+0000 7f2a17fff640 1 --2- 172.21.15.6:0/2306787795 >> [v2:172.21.15.161:6816/2760284950,v1:172.21.15.161:6817/2760284950] conn(0x7f2a0406eb30 0x7f2a04070f40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.980+0000 7fb93ffff640 1 --2- 172.21.15.6:0/3419435646 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb9440662d0 0x7fb944068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.980+0000 7fe2c2ffd640 1 -- 172.21.15.6:0/3396372323 <== osd.4 v2:172.21.15.161:6824/3485236199 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe2a80715f0 con 0x7fe2a806eb30 2023-07-21T22:18:55.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.980+0000 7fb93ffff640 1 -- 172.21.15.6:0/3419435646 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb95008d3a0 con 0x7fb9580d1850 2023-07-21T22:18:55.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.980+0000 7f29fffff640 1 -- 172.21.15.6:0/2306787795 <== osd.7 v2:172.21.15.161:6816/2760284950 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2a040715f0 con 0x7f2a0406eb30 2023-07-21T22:18:55.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.980+0000 7fb93ffff640 1 --2- 172.21.15.6:0/3419435646 >> [v2:172.21.15.161:6808/1291367445,v1:172.21.15.161:6809/1291367445] conn(0x7fb94406eb80 0x7fb944070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.980+0000 7fb93ffff640 1 -- 172.21.15.6:0/3419435646 --> [v2:172.21.15.161:6808/1291367445,v1:172.21.15.161:6809/1291367445] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb944071640 con 0x7fb94406eb80 2023-07-21T22:18:55.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.980+0000 7fb93ffff640 1 -- 172.21.15.6:0/3419435646 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb95008d720 con 0x7fb9580d1850 2023-07-21T22:18:55.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.980+0000 7fb9577fe640 1 --2- 172.21.15.6:0/3419435646 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb9440662d0 0x7fb944068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.980+0000 7fb956ffd640 1 --2- 172.21.15.6:0/3419435646 >> [v2:172.21.15.161:6808/1291367445,v1:172.21.15.161:6809/1291367445] conn(0x7fb94406eb80 0x7fb944070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.980+0000 7fb9577fe640 1 --2- 172.21.15.6:0/3419435646 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb9440662d0 0x7fb944068780 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb9480098e0 tx=0x7fb948009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.980+0000 7fb956ffd640 1 --2- 172.21.15.6:0/3419435646 >> [v2:172.21.15.161:6808/1291367445,v1:172.21.15.161:6809/1291367445] conn(0x7fb94406eb80 0x7fb944070f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.980+0000 7fb93ffff640 1 -- 172.21.15.6:0/3419435646 <== osd.5 v2:172.21.15.161:6808/1291367445 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb944071640 con 0x7fb94406eb80 2023-07-21T22:18:55.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.984+0000 7f5bb50e6640 1 -- 172.21.15.6:0/2699994176 --> [v2:172.21.15.6:6800/45975211,v1:172.21.15.6:6801/45975211] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5b90002cc0 con 0x7f5b9c06ec30 2023-07-21T22:18:55.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.984+0000 7f5b977fe640 1 -- 172.21.15.6:0/2699994176 <== osd.0 v2:172.21.15.6:6800/45975211 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5b90002cc0 con 0x7f5b9c06ec30 2023-07-21T22:18:55.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.984+0000 7f5b957fa640 1 -- 172.21.15.6:0/2699994176 >> [v2:172.21.15.6:6800/45975211,v1:172.21.15.6:6801/45975211] conn(0x7f5b9c06ec30 msgr2=0x7f5b9c071040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.984+0000 7f5b957fa640 1 --2- 172.21.15.6:0/2699994176 >> [v2:172.21.15.6:6800/45975211,v1:172.21.15.6:6801/45975211] conn(0x7f5b9c06ec30 0x7f5b9c071040 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.984+0000 7f5b957fa640 1 -- 172.21.15.6:0/2699994176 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5b9c066380 msgr2=0x7f5b9c068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.984+0000 7f5b957fa640 1 --2- 172.21.15.6:0/2699994176 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5b9c066380 0x7f5b9c068830 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ba803b080 tx=0x7f5ba4009040 comp rx=0 tx=0).stop 2023-07-21T22:18:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.984+0000 7f5b957fa640 1 -- 172.21.15.6:0/2699994176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ba800dc80 msgr2=0x7f5ba804ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.984+0000 7f5b957fa640 1 --2- 172.21.15.6:0/2699994176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ba800dc80 0x7f5ba804ddd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5ba000e870 tx=0x7f5ba000ed30 comp rx=0 tx=0).stop 2023-07-21T22:18:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.984+0000 7f5baf59e640 1 -- 172.21.15.6:0/2699994176 reap_dead start 2023-07-21T22:18:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.984+0000 7f5b957fa640 1 -- 172.21.15.6:0/2699994176 shutdown_connections 2023-07-21T22:18:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.984+0000 7f5b957fa640 1 -- 172.21.15.6:0/2699994176 >> 172.21.15.6:0/2699994176 conn(0x7f5ba800ceb0 msgr2=0x7f5ba80e6130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.984+0000 7f5b957fa640 1 -- 172.21.15.6:0/2699994176 shutdown_connections 2023-07-21T22:18:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.984+0000 7f5b957fa640 1 -- 172.21.15.6:0/2699994176 wait complete. 2023-07-21T22:18:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.988+0000 7f3c0b59e640 1 -- 172.21.15.6:0/1089900934 --> [v2:172.21.15.6:6824/3751691192,v1:172.21.15.6:6825/3751691192] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3c0c0b2a90 con 0x7f3bec06ec00 2023-07-21T22:18:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.988+0000 7ff0305ad640 1 -- 172.21.15.6:0/493476259 --> [v2:172.21.15.6:6816/2815481744,v1:172.21.15.6:6817/2815481744] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff0280cc8c0 con 0x7ff00c06eb80 2023-07-21T22:18:55.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.992+0000 7f3bfaffd640 1 -- 172.21.15.6:0/1089900934 <== osd.3 v2:172.21.15.6:6824/3751691192 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3c0c0b2a90 con 0x7f3bec06ec00 2023-07-21T22:18:55.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.992+0000 7f3c0b59e640 1 -- 172.21.15.6:0/1089900934 >> [v2:172.21.15.6:6824/3751691192,v1:172.21.15.6:6825/3751691192] conn(0x7f3bec06ec00 msgr2=0x7f3bec071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.992+0000 7f3c0b59e640 1 --2- 172.21.15.6:0/1089900934 >> [v2:172.21.15.6:6824/3751691192,v1:172.21.15.6:6825/3751691192] conn(0x7f3bec06ec00 0x7f3bec071010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.992+0000 7ff01effd640 1 -- 172.21.15.6:0/493476259 <== osd.1 v2:172.21.15.6:6816/2815481744 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff0180ab520 con 0x7ff00c06eb80 2023-07-21T22:18:55.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.992+0000 7f3c0b59e640 1 -- 172.21.15.6:0/1089900934 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3bec066350 msgr2=0x7f3bec068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.992+0000 7f3c0b59e640 1 --2- 172.21.15.6:0/1089900934 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3bec066350 0x7f3bec068800 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3c040ae000 tx=0x7f3c04004ac0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.992+0000 7f3c0b59e640 1 -- 172.21.15.6:0/1089900934 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c0c0af8b0 msgr2=0x7f3c0c155090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.992+0000 7f3c0b59e640 1 --2- 172.21.15.6:0/1089900934 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c0c0af8b0 0x7f3c0c155090 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000c480 tx=0x7f3c0000c880 comp rx=0 tx=0).stop 2023-07-21T22:18:55.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.992+0000 7f3c0ad9d640 1 -- 172.21.15.6:0/1089900934 reap_dead start 2023-07-21T22:18:55.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.992+0000 7f3c0b59e640 1 -- 172.21.15.6:0/1089900934 shutdown_connections 2023-07-21T22:18:55.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.992+0000 7f3c0b59e640 1 -- 172.21.15.6:0/1089900934 >> 172.21.15.6:0/1089900934 conn(0x7f3c0c0ca8b0 msgr2=0x7f3c0c0cac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.992+0000 7f3c0b59e640 1 -- 172.21.15.6:0/1089900934 shutdown_connections 2023-07-21T22:18:55.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.992+0000 7f3c0b59e640 1 -- 172.21.15.6:0/1089900934 wait complete. 2023-07-21T22:18:55.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.996+0000 7f99b0ff9640 1 -- 172.21.15.6:0/2792093723 --> [v2:172.21.15.6:6808/3480578303,v1:172.21.15.6:6809/3480578303] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f99bc1595d0 con 0x7f99a007fc40 2023-07-21T22:18:55.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.996+0000 7f21109b7640 1 -- 172.21.15.6:0/47361653 --> [v2:172.21.15.161:6800/771066506,v1:172.21.15.161:6801/771066506] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f210c0cc990 con 0x7f20ec06eb80 2023-07-21T22:18:55.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.996+0000 7f99b2ffd640 1 -- 172.21.15.6:0/2792093723 <== osd.2 v2:172.21.15.6:6808/3480578303 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f99ac001250 con 0x7f99a007fc40 2023-07-21T22:18:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.996+0000 7f99b0ff9640 1 -- 172.21.15.6:0/2792093723 >> [v2:172.21.15.6:6808/3480578303,v1:172.21.15.6:6809/3480578303] conn(0x7f99a007fc40 msgr2=0x7f99a0082050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.996+0000 7f99b0ff9640 1 --2- 172.21.15.6:0/2792093723 >> [v2:172.21.15.6:6808/3480578303,v1:172.21.15.6:6809/3480578303] conn(0x7f99a007fc40 0x7f99a0082050 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.996+0000 7f99b0ff9640 1 -- 172.21.15.6:0/2792093723 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f99a0077390 msgr2=0x7f99a0079840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.996+0000 7f99b0ff9640 1 --2- 172.21.15.6:0/2792093723 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f99a0077390 0x7f99a0079840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009b10 tx=0x7f99b8008040 comp rx=0 tx=0).stop 2023-07-21T22:18:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.996+0000 7f99b0ff9640 1 -- 172.21.15.6:0/2792093723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99bc0afdf0 msgr2=0x7f99bc0c1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.996+0000 7f2103fff640 1 -- 172.21.15.6:0/47361653 <== osd.6 v2:172.21.15.161:6800/771066506 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f20f4001490 con 0x7f20ec06eb80 2023-07-21T22:18:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.996+0000 7f99b0ff9640 1 --2- 172.21.15.6:0/2792093723 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99bc0afdf0 0x7f99bc0c1d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f99b40ab000 tx=0x7f99b4019770 comp rx=0 tx=0).stop 2023-07-21T22:18:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.996+0000 7f99c2911640 1 -- 172.21.15.6:0/2792093723 reap_dead start 2023-07-21T22:18:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:54.996+0000 7f99b0ff9640 1 -- 172.21.15.6:0/2792093723 shutdown_connections 2023-07-21T22:18:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.000+0000 7f99b0ff9640 1 -- 172.21.15.6:0/2792093723 >> 172.21.15.6:0/2792093723 conn(0x7f99bc0ca8b0 msgr2=0x7f99bc0cc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.000+0000 7f99b0ff9640 1 -- 172.21.15.6:0/2792093723 shutdown_connections 2023-07-21T22:18:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.000+0000 7f99b0ff9640 1 -- 172.21.15.6:0/2792093723 wait complete. 2023-07-21T22:18:55.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.000+0000 7f2101ffb640 1 -- 172.21.15.6:0/47361653 >> [v2:172.21.15.161:6800/771066506,v1:172.21.15.161:6801/771066506] conn(0x7f20ec06eb80 msgr2=0x7f20ec070f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.000+0000 7f2101ffb640 1 --2- 172.21.15.6:0/47361653 >> [v2:172.21.15.161:6800/771066506,v1:172.21.15.161:6801/771066506] conn(0x7f20ec06eb80 0x7f20ec070f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.000+0000 7f2101ffb640 1 -- 172.21.15.6:0/47361653 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f20ec0662d0 msgr2=0x7f20ec068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.000+0000 7f2101ffb640 1 --2- 172.21.15.6:0/47361653 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f20ec0662d0 0x7f20ec068780 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2104000f90 tx=0x7f2104004a50 comp rx=0 tx=0).stop 2023-07-21T22:18:55.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.000+0000 7f2101ffb640 1 -- 172.21.15.6:0/47361653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f210c0c1880 msgr2=0x7f210c1535a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.000+0000 7f2101ffb640 1 --2- 172.21.15.6:0/47361653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f210c0c1880 0x7f210c1535a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f210c0c88a0 tx=0x7f20fc00c760 comp rx=0 tx=0).stop 2023-07-21T22:18:55.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.000+0000 7f210bfff640 1 -- 172.21.15.6:0/47361653 reap_dead start 2023-07-21T22:18:55.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.000+0000 7f2101ffb640 1 -- 172.21.15.6:0/47361653 shutdown_connections 2023-07-21T22:18:55.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.000+0000 7f2101ffb640 1 -- 172.21.15.6:0/47361653 >> 172.21.15.6:0/47361653 conn(0x7f210c0cac20 msgr2=0x7f210c0c9990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.000+0000 7f2101ffb640 1 -- 172.21.15.6:0/47361653 shutdown_connections 2023-07-21T22:18:55.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.000+0000 7f2101ffb640 1 -- 172.21.15.6:0/47361653 wait complete. 2023-07-21T22:18:55.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.004+0000 7fe2cc39f640 1 -- 172.21.15.6:0/3396372323 --> [v2:172.21.15.161:6824/3485236199,v1:172.21.15.161:6825/3485236199] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe2c40678d0 con 0x7fe2a806eb30 2023-07-21T22:18:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.004+0000 7fe2c2ffd640 1 -- 172.21.15.6:0/3396372323 <== osd.4 v2:172.21.15.161:6824/3485236199 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe2c40678d0 con 0x7fe2a806eb30 2023-07-21T22:18:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7fe2cc39f640 1 -- 172.21.15.6:0/3396372323 >> [v2:172.21.15.161:6824/3485236199,v1:172.21.15.161:6825/3485236199] conn(0x7fe2a806eb30 msgr2=0x7fe2a8070f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7fe2cc39f640 1 --2- 172.21.15.6:0/3396372323 >> [v2:172.21.15.161:6824/3485236199,v1:172.21.15.161:6825/3485236199] conn(0x7fe2a806eb30 0x7fe2a8070f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7ff0305ad640 1 -- 172.21.15.6:0/493476259 >> [v2:172.21.15.6:6816/2815481744,v1:172.21.15.6:6817/2815481744] conn(0x7ff00c06eb80 msgr2=0x7ff00c070f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7ff0305ad640 1 --2- 172.21.15.6:0/493476259 >> [v2:172.21.15.6:6816/2815481744,v1:172.21.15.6:6817/2815481744] conn(0x7ff00c06eb80 0x7ff00c070f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7fe2cc39f640 1 -- 172.21.15.6:0/3396372323 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe2a8066280 msgr2=0x7fe2a8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7fe2cc39f640 1 --2- 172.21.15.6:0/3396372323 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe2a8066280 0x7fe2a8068730 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc006fd0 tx=0x7fe2bc008040 comp rx=0 tx=0).stop 2023-07-21T22:18:55.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7fe2cc39f640 1 -- 172.21.15.6:0/3396372323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2c40cd570 msgr2=0x7fe2c413b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7fe2cc39f640 1 --2- 172.21.15.6:0/3396372323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2c40cd570 0x7fe2c413b7d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0000fc0 tx=0x7fe2b000c9b0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7fe2ca93c640 1 -- 172.21.15.6:0/3396372323 reap_dead start 2023-07-21T22:18:55.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7fe2cc39f640 1 -- 172.21.15.6:0/3396372323 shutdown_connections 2023-07-21T22:18:55.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7fe2cc39f640 1 -- 172.21.15.6:0/3396372323 >> 172.21.15.6:0/3396372323 conn(0x7fe2c40ce9d0 msgr2=0x7fe2c4149520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7f2a1cdb7640 1 -- 172.21.15.6:0/2306787795 --> [v2:172.21.15.161:6816/2760284950,v1:172.21.15.161:6817/2760284950] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2a180b5b90 con 0x7f2a0406eb30 2023-07-21T22:18:55.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7ff0305ad640 1 -- 172.21.15.6:0/493476259 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff00c066350 msgr2=0x7ff00c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7ff0305ad640 1 --2- 172.21.15.6:0/493476259 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff00c066350 0x7ff00c068800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff024006fd0 tx=0x7ff024008040 comp rx=0 tx=0).stop 2023-07-21T22:18:55.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7ff0305ad640 1 -- 172.21.15.6:0/493476259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0280cd3a0 msgr2=0x7ff0281517b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7ff0305ad640 1 --2- 172.21.15.6:0/493476259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0280cd3a0 0x7ff0281517b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff02000efc0 tx=0x7ff02000c490 comp rx=0 tx=0).stop 2023-07-21T22:18:55.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7ff02eb4a640 1 -- 172.21.15.6:0/493476259 reap_dead start 2023-07-21T22:18:55.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7ff0305ad640 1 -- 172.21.15.6:0/493476259 shutdown_connections 2023-07-21T22:18:55.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7ff0305ad640 1 -- 172.21.15.6:0/493476259 >> 172.21.15.6:0/493476259 conn(0x7ff0280ce9d0 msgr2=0x7ff02806bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7ff0305ad640 1 -- 172.21.15.6:0/493476259 shutdown_connections 2023-07-21T22:18:55.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7ff0305ad640 1 -- 172.21.15.6:0/493476259 wait complete. 2023-07-21T22:18:55.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7fe2cc39f640 1 -- 172.21.15.6:0/3396372323 shutdown_connections 2023-07-21T22:18:55.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7fe2cc39f640 1 -- 172.21.15.6:0/3396372323 wait complete. 2023-07-21T22:18:55.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7f29fffff640 1 -- 172.21.15.6:0/2306787795 <== osd.7 v2:172.21.15.161:6816/2760284950 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2a10007a00 con 0x7f2a0406eb30 2023-07-21T22:18:55.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7fb95da6d640 1 -- 172.21.15.6:0/3419435646 --> [v2:172.21.15.161:6808/1291367445,v1:172.21.15.161:6809/1291367445] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb95815b080 con 0x7fb94406eb80 2023-07-21T22:18:55.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.008+0000 7fb93ffff640 1 -- 172.21.15.6:0/3419435646 <== osd.5 v2:172.21.15.161:6808/1291367445 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb95815b080 con 0x7fb94406eb80 2023-07-21T22:18:55.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.012+0000 7fb95da6d640 1 -- 172.21.15.6:0/3419435646 >> [v2:172.21.15.161:6808/1291367445,v1:172.21.15.161:6809/1291367445] conn(0x7fb94406eb80 msgr2=0x7fb944070f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.012+0000 7fb95da6d640 1 --2- 172.21.15.6:0/3419435646 >> [v2:172.21.15.161:6808/1291367445,v1:172.21.15.161:6809/1291367445] conn(0x7fb94406eb80 0x7fb944070f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.012+0000 7f2a1cdb7640 1 -- 172.21.15.6:0/2306787795 >> [v2:172.21.15.161:6816/2760284950,v1:172.21.15.161:6817/2760284950] conn(0x7f2a0406eb30 msgr2=0x7f2a04070f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.012+0000 7f2a1cdb7640 1 --2- 172.21.15.6:0/2306787795 >> [v2:172.21.15.161:6816/2760284950,v1:172.21.15.161:6817/2760284950] conn(0x7f2a0406eb30 0x7f2a04070f40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.012+0000 7fb95da6d640 1 -- 172.21.15.6:0/3419435646 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb9440662d0 msgr2=0x7fb944068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.012+0000 7f2a1cdb7640 1 -- 172.21.15.6:0/2306787795 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2a04066280 msgr2=0x7f2a04068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.012+0000 7f2a1cdb7640 1 --2- 172.21.15.6:0/2306787795 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2a04066280 0x7f2a04068730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2a18204d40 tx=0x7f2a08009060 comp rx=0 tx=0).stop 2023-07-21T22:18:55.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.012+0000 7fb95da6d640 1 --2- 172.21.15.6:0/3419435646 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb9440662d0 0x7fb944068780 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb9480098e0 tx=0x7fb948009060 comp rx=0 tx=0).stop 2023-07-21T22:18:55.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.012+0000 7f2a1cdb7640 1 -- 172.21.15.6:0/2306787795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a180cc870 msgr2=0x7f2a1806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.012+0000 7f2a1cdb7640 1 --2- 172.21.15.6:0/2306787795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a180cc870 0x7f2a1806f120 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c01ab90 tx=0x7f2a0c019280 comp rx=0 tx=0).stop 2023-07-21T22:18:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.012+0000 7fb95da6d640 1 -- 172.21.15.6:0/3419435646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9580d1850 msgr2=0x7fb95814fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.012+0000 7fb95da6d640 1 --2- 172.21.15.6:0/3419435646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9580d1850 0x7fb95814fb70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb95000be20 tx=0x7fb95000bf10 comp rx=0 tx=0).stop 2023-07-21T22:18:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.012+0000 7f2a17fff640 1 -- 172.21.15.6:0/2306787795 reap_dead start 2023-07-21T22:18:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.012+0000 7f2a1cdb7640 1 -- 172.21.15.6:0/2306787795 shutdown_connections 2023-07-21T22:18:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.012+0000 7f2a1cdb7640 1 -- 172.21.15.6:0/2306787795 >> 172.21.15.6:0/2306787795 conn(0x7f2a18070690 msgr2=0x7f2a180c5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.012+0000 7fb957fff640 1 -- 172.21.15.6:0/3419435646 reap_dead start 2023-07-21T22:18:55.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.012+0000 7fb95da6d640 1 -- 172.21.15.6:0/3419435646 shutdown_connections 2023-07-21T22:18:55.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.012+0000 7fb95da6d640 1 -- 172.21.15.6:0/3419435646 >> 172.21.15.6:0/3419435646 conn(0x7fb9580650b0 msgr2=0x7fb9580b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.012+0000 7fb95da6d640 1 -- 172.21.15.6:0/3419435646 shutdown_connections 2023-07-21T22:18:55.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.012+0000 7fb95da6d640 1 -- 172.21.15.6:0/3419435646 wait complete. 2023-07-21T22:18:55.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.016+0000 7f2a1cdb7640 1 -- 172.21.15.6:0/2306787795 shutdown_connections 2023-07-21T22:18:55.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.016+0000 7f2a1cdb7640 1 -- 172.21.15.6:0/2306787795 wait complete. 2023-07-21T22:18:55.110 INFO:teuthology.orchestra.run.smithi006.stdout:64424509450 2023-07-21T22:18:55.110 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-21T22:18:55.111 INFO:teuthology.orchestra.run.smithi006.stdout:64424509447 2023-07-21T22:18:55.111 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-21T22:18:55.112 INFO:teuthology.orchestra.run.smithi006.stdout:64424509449 2023-07-21T22:18:55.112 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-21T22:18:55.113 INFO:teuthology.orchestra.run.smithi006.stdout:64424509448 2023-07-21T22:18:55.114 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-21T22:18:55.114 INFO:teuthology.orchestra.run.smithi006.stdout:64424509448 2023-07-21T22:18:55.115 INFO:teuthology.orchestra.run.smithi006.stdout:60129542154 2023-07-21T22:18:55.115 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-21T22:18:55.116 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-21T22:18:55.117 INFO:teuthology.orchestra.run.smithi006.stdout:64424509447 2023-07-21T22:18:55.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-21T22:18:55.118 INFO:teuthology.orchestra.run.smithi006.stdout:64424509448 2023-07-21T22:18:55.119 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-21T22:18:55.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.348+0000 7f9025911640 1 Processor -- start 2023-07-21T22:18:55.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.348+0000 7f9025911640 1 -- start start 2023-07-21T22:18:55.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.352+0000 7f9025911640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90200cb280 0x7f9020069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.352+0000 7f9025911640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9020069970 0x7f90200c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.352+0000 7f9025911640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90200cdac0 con 0x7f902015bc30 2023-07-21T22:18:55.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.352+0000 7f9025911640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902006c060 con 0x7f9020069970 2023-07-21T22:18:55.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.352+0000 7f9025911640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902006baa0 con 0x7f90200cb280 2023-07-21T22:18:55.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.352+0000 7f901f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9020069970 0x7f90200c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.352+0000 7f901f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9020069970 0x7f90200c8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46846/0 (socket says 172.21.15.6:46846) 2023-07-21T22:18:55.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.352+0000 7f901f7fe640 1 -- 172.21.15.6:0/239708064 learned_addr learned my addr 172.21.15.6:0/239708064 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:55.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.352+0000 7f901e7fc640 1 --2- 172.21.15.6:0/239708064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90200cb280 0x7f9020069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.352+0000 7f901e7fc640 1 -- 172.21.15.6:0/239708064 >> v2:172.21.15.6:3300/0 conn(0x7f9020069970 msgr2=0x7f90200c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:55.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.352+0000 7f901e7fc640 1 --2- 172.21.15.6:0/239708064 >> v2:172.21.15.6:3300/0 conn(0x7f9020069970 0x7f90200c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.352+0000 7f901e7fc640 1 -- 172.21.15.6:0/239708064 >> v1:172.21.15.6:6789/0 conn(0x7f902015bc30 legacy=0x7f90200cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:55.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.352+0000 7f901e7fc640 1 -- 172.21.15.6:0/239708064 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9020069dd0 con 0x7f90200cb280 2023-07-21T22:18:55.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.352+0000 7f901f7fe640 1 --2- 172.21.15.6:0/239708064 >> v2:172.21.15.6:3300/0 conn(0x7f9020069970 0x7f90200c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:55.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.360+0000 7f901e7fc640 1 --2- 172.21.15.6:0/239708064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90200cb280 0x7f9020069430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f90100097c0 tx=0x7f901001c2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fc6f5497f08ec96 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.360+0000 7f901dffb640 1 -- 172.21.15.6:0/239708064 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90100ab600 con 0x7f90200cb280 2023-07-21T22:18:55.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.360+0000 7f901dffb640 1 -- 172.21.15.6:0/239708064 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90100a7050 con 0x7f90200cb280 2023-07-21T22:18:55.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.360+0000 7f901dffb640 1 -- 172.21.15.6:0/239708064 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90100ab980 con 0x7f90200cb280 2023-07-21T22:18:55.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.360+0000 7f9025911640 1 -- 172.21.15.6:0/239708064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90200cb280 msgr2=0x7f9020069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.360+0000 7f9025911640 1 --2- 172.21.15.6:0/239708064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90200cb280 0x7f9020069430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f90100097c0 tx=0x7f901001c2f0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.360+0000 7f9025911640 1 -- 172.21.15.6:0/239708064 shutdown_connections 2023-07-21T22:18:55.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.360+0000 7f9025911640 1 --2- 172.21.15.6:0/239708064 >> v2:172.21.15.6:3300/0 conn(0x7f9020069970 0x7f90200c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.360+0000 7f9025911640 1 --2- 172.21.15.6:0/239708064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90200cb280 0x7f9020069430 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.360+0000 7f9025911640 1 -- 172.21.15.6:0/239708064 >> 172.21.15.6:0/239708064 conn(0x7f90200ce980 msgr2=0x7f90200ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.360+0000 7f9025911640 1 -- 172.21.15.6:0/239708064 shutdown_connections 2023-07-21T22:18:55.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.360+0000 7f9025911640 1 -- 172.21.15.6:0/239708064 wait complete. 2023-07-21T22:18:55.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.364+0000 7fab2183a640 1 Processor -- start 2023-07-21T22:18:55.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.364+0000 7f9025911640 1 Processor -- start 2023-07-21T22:18:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.364+0000 7f9025911640 1 -- start start 2023-07-21T22:18:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.364+0000 7f9025911640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9020069970 0x7f902006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.364+0000 7fab2183a640 1 -- start start 2023-07-21T22:18:55.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.364+0000 7fab2183a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fab1c0b7d90 0x7fab1c0cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.364+0000 7fab2183a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab1c0d13f0 0x7fab1c0ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.364+0000 7fab2183a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab1c0d0f60 con 0x7fab1c15f3f0 2023-07-21T22:18:55.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.364+0000 7fab2183a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1c0d0390 con 0x7fab1c0b7d90 2023-07-21T22:18:55.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.364+0000 7fab2183a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c0d0630 con 0x7fab1c0d13f0 2023-07-21T22:18:55.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f901effd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9020069970 0x7f902006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f901effd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9020069970 0x7f902006eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:57934/0 (socket says 172.21.15.6:57934) 2023-07-21T22:18:55.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f9025911640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90201f7b80 0x7f90200ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f901effd640 1 -- 172.21.15.6:0/806196342 learned_addr learned my addr 172.21.15.6:0/806196342 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:55.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f9025911640 1 --2- 172.21.15.6:0/806196342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90200adce0 0x7f902013ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7fab20838640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fab1c15f3f0 0x7fab1c0b7680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:37328/0 (socket says 172.21.15.6:37328) 2023-07-21T22:18:55.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7fab20838640 1 -- 172.21.15.6:0/1343506085 learned_addr learned my addr 172.21.15.6:0/1343506085 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:55.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f9025911640 1 -- 172.21.15.6:0/806196342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902013e940 con 0x7f90200adce0 2023-07-21T22:18:55.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7fab1bfff640 1 --2- 172.21.15.6:0/1343506085 >> v2:172.21.15.161:3300/0 conn(0x7fab1c0b7d90 0x7fab1c0cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7fab21039640 1 --2- 172.21.15.6:0/1343506085 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab1c0d13f0 0x7fab1c0ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f9025911640 1 -- 172.21.15.6:0/806196342 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90200ae150 con 0x7f90201f7b80 2023-07-21T22:18:55.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f901e7fc640 1 --2- 172.21.15.6:0/806196342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90201f7b80 0x7f90200ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f9025911640 1 -- 172.21.15.6:0/806196342 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902006f430 con 0x7f9020069970 2023-07-21T22:18:55.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7fab1b7fe640 1 -- 172.21.15.6:0/1343506085 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903137548 0 0) 0x7fab1c0d0f60 con 0x7fab1c15f3f0 2023-07-21T22:18:55.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7fab1b7fe640 1 -- 172.21.15.6:0/1343506085 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab04003530 con 0x7fab1c15f3f0 2023-07-21T22:18:55.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7fab1bfff640 1 -- 172.21.15.6:0/1343506085 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab1c0d13f0 msgr2=0x7fab1c0ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:55.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7fab1bfff640 1 --2- 172.21.15.6:0/1343506085 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab1c0d13f0 0x7fab1c0ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7fab1bfff640 1 -- 172.21.15.6:0/1343506085 >> v1:172.21.15.161:6789/0 conn(0x7fab1c15f3f0 legacy=0x7fab1c0b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7fab1bfff640 1 -- 172.21.15.6:0/1343506085 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c0d0910 con 0x7fab1c0b7d90 2023-07-21T22:18:55.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f901f7fe640 1 --2- 172.21.15.6:0/806196342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90200adce0 0x7f902013ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f901f7fe640 1 -- 172.21.15.6:0/806196342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9020069970 msgr2=0x7f902006eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f901f7fe640 1 --2- 172.21.15.6:0/806196342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9020069970 0x7f902006eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f901f7fe640 1 -- 172.21.15.6:0/806196342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90201f7b80 msgr2=0x7f90200ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f901f7fe640 1 --2- 172.21.15.6:0/806196342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90201f7b80 0x7f90200ad7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f901f7fe640 1 -- 172.21.15.6:0/806196342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9018009b30 con 0x7f90200adce0 2023-07-21T22:18:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f901f7fe640 1 --2- 172.21.15.6:0/806196342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90200adce0 0x7f902013ed60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9018009e50 tx=0x7f901800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f901effd640 1 --2- 172.21.15.6:0/806196342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9020069970 0x7f902006eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f9007fff640 1 -- 172.21.15.6:0/806196342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018018070 con 0x7f90200adce0 2023-07-21T22:18:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f9007fff640 1 -- 172.21.15.6:0/806196342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901800f040 con 0x7f90200adce0 2023-07-21T22:18:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f9007fff640 1 -- 172.21.15.6:0/806196342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901800cd40 con 0x7f90200adce0 2023-07-21T22:18:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f9025911640 1 -- 172.21.15.6:0/806196342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9010009420 con 0x7f90200adce0 2023-07-21T22:18:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.368+0000 7f9025911640 1 -- 172.21.15.6:0/806196342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902013dfa0 con 0x7f90200adce0 2023-07-21T22:18:55.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.372+0000 7f9025911640 1 -- 172.21.15.6:0/806196342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9000005260 con 0x7f90200adce0 2023-07-21T22:18:55.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.372+0000 7fa953fff640 1 Processor -- start 2023-07-21T22:18:55.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.372+0000 7f106a596640 1 Processor -- start 2023-07-21T22:18:55.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.372+0000 7fab1bfff640 1 --2- 172.21.15.6:0/1343506085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab1c0b7d90 0x7fab1c0cc9a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fab14009d90 tx=0x7fab1401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7c1cfe2ab6abed5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.372+0000 7fa953fff640 1 -- start start 2023-07-21T22:18:55.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.372+0000 7ff4fb5db640 1 Processor -- start 2023-07-21T22:18:55.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.372+0000 7f106a596640 1 -- start start 2023-07-21T22:18:55.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.372+0000 7fab1b7fe640 1 -- 172.21.15.6:0/1343506085 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab140a5800 con 0x7fab1c0b7d90 2023-07-21T22:18:55.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.372+0000 7fab1b7fe640 1 -- 172.21.15.6:0/1343506085 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab140a5960 con 0x7fab1c0b7d90 2023-07-21T22:18:55.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.372+0000 7fab1b7fe640 1 -- 172.21.15.6:0/1343506085 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab140a5cf0 con 0x7fab1c0b7d90 2023-07-21T22:18:55.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fab2183a640 1 -- 172.21.15.6:0/1343506085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab1c0b7d90 msgr2=0x7fab1c0cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fab2183a640 1 --2- 172.21.15.6:0/1343506085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab1c0b7d90 0x7fab1c0cc9a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fab14009d90 tx=0x7fab1401c8e0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa953fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9540af8b0 0x7fa9540afd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa953fff640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9540cd7b0 con 0x7fa95415fd60 2023-07-21T22:18:55.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa953fff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa95406d360 con 0x7fa9540707f0 2023-07-21T22:18:55.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa953fff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95406c8b0 con 0x7fa9540af8b0 2023-07-21T22:18:55.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fab2183a640 1 -- 172.21.15.6:0/1343506085 shutdown_connections 2023-07-21T22:18:55.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fab2183a640 1 --2- 172.21.15.6:0/1343506085 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab1c0d13f0 0x7fab1c0ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fab2183a640 1 --2- 172.21.15.6:0/1343506085 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab1c0b7d90 0x7fab1c0cc9a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fab2183a640 1 -- 172.21.15.6:0/1343506085 >> 172.21.15.6:0/1343506085 conn(0x7fab1c069f50 msgr2=0x7fab1c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f106a596640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f10640c8940 0x7f10640cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f106a596640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f10640c0f80 0x7f10640cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f106a596640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10640c17d0 con 0x7f1064160330 2023-07-21T22:18:55.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f106a596640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10640c14f0 con 0x7f10640c8940 2023-07-21T22:18:55.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f106a596640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10640cac10 con 0x7f10640c0f80 2023-07-21T22:18:55.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f9007fff640 1 -- 172.21.15.6:0/806196342 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f90180039a0 con 0x7f90200adce0 2023-07-21T22:18:55.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f85ee0f9640 1 Processor -- start 2023-07-21T22:18:55.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa9537fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fa9540707f0 0x7fa954070c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:37332/0 (socket says 172.21.15.6:37332) 2023-07-21T22:18:55.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa9537fe640 1 -- 172.21.15.6:0/626164134 learned_addr learned my addr 172.21.15.6:0/626164134 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:55.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.372+0000 7ff4fb5db640 1 -- start start 2023-07-21T22:18:55.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7ff4fb5db640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4f40cce60 0x7ff4f40cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7ff4fb5db640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff4f406b440 0x7ff4f406b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7ff4fb5db640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f406eef0 con 0x7ff4f415ff10 2023-07-21T22:18:55.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7ff4fb5db640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f406aff0 con 0x7ff4f406b440 2023-07-21T22:18:55.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7ff4fb5db640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f40cd820 con 0x7ff4f40cce60 2023-07-21T22:18:55.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f1068b33640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f10640c0f80 0x7f10640cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f1068b33640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f10640c0f80 0x7f10640cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:48054/0 (socket says 172.21.15.6:48054) 2023-07-21T22:18:55.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f1068b33640 1 -- 172.21.15.6:0/1402177550 learned_addr learned my addr 172.21.15.6:0/1402177550 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:55.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fab2183a640 1 -- 172.21.15.6:0/1343506085 shutdown_connections 2023-07-21T22:18:55.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fab2183a640 1 -- 172.21.15.6:0/1343506085 wait complete. 2023-07-21T22:18:55.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa951ffb640 1 -- 172.21.15.6:0/626164134 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126355190 0 0) 0x7fa95406d360 con 0x7fa9540707f0 2023-07-21T22:18:55.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa951ffb640 1 -- 172.21.15.6:0/626164134 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa93c003530 con 0x7fa9540707f0 2023-07-21T22:18:55.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa9527fc640 1 --2- 172.21.15.6:0/626164134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9540af8b0 0x7fa9540afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f9007fff640 1 --2- 172.21.15.6:0/806196342 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f900c066350 0x7f900c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f9007fff640 1 -- 172.21.15.6:0/806196342 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f90180841a0 con 0x7f90200adce0 2023-07-21T22:18:55.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa951ffb640 1 -- 172.21.15.6:0/626164134 <== mon.1 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3155992235 0 0) 0x7fa93c003530 con 0x7fa9540707f0 2023-07-21T22:18:55.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa951ffb640 1 -- 172.21.15.6:0/626164134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9540af8b0 msgr2=0x7fa9540afd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:55.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa951ffb640 1 --2- 172.21.15.6:0/626164134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9540af8b0 0x7fa9540afd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa951ffb640 1 -- 172.21.15.6:0/626164134 >> v1:172.21.15.6:6789/0 conn(0x7fa95415fd60 legacy=0x7fa9540cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa951ffb640 1 -- 172.21.15.6:0/626164134 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95406cac0 con 0x7fa9540707f0 2023-07-21T22:18:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa951ffb640 1 -- 172.21.15.6:0/626164134 <== mon.1 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fa948001680 con 0x7fa9540707f0 2023-07-21T22:18:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa951ffb640 1 -- 172.21.15.6:0/626164134 >> v1:172.21.15.161:6789/0 conn(0x7fa9540707f0 legacy=0x7fa954070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa951ffb640 1 --2- 172.21.15.6:0/626164134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa93c0039b0 0x7fa93c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa951ffb640 1 --2- 172.21.15.6:0/626164134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa93c0047d0 0x7fa93c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa951ffb640 1 --2- 172.21.15.6:0/626164134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa93c005180 0x7fa93c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa951ffb640 1 -- 172.21.15.6:0/626164134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95406c8b0 con 0x7fa93c0039b0 2023-07-21T22:18:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa951ffb640 1 -- 172.21.15.6:0/626164134 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c00c0c0 con 0x7fa93c005180 2023-07-21T22:18:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa951ffb640 1 -- 172.21.15.6:0/626164134 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c00c280 con 0x7fa93c0047d0 2023-07-21T22:18:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa952ffd640 1 --2- 172.21.15.6:0/626164134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa93c0039b0 0x7fa93c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa9537fe640 1 --2- 172.21.15.6:0/626164134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa93c005180 0x7fa93c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7fa9527fc640 1 --2- 172.21.15.6:0/626164134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa93c0047d0 0x7fa93c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f901effd640 1 --2- 172.21.15.6:0/806196342 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f900c066350 0x7f900c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f85ee0f9640 1 -- start start 2023-07-21T22:18:55.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f85ee0f9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f85e80b3c50 0x7f85e80b4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f85ee0f9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85e815bcb0 0x7f85e80b4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f85ee0f9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e80b4aa0 con 0x7f85e80b10c0 2023-07-21T22:18:55.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f85ee0f9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e80ce750 con 0x7f85e80b3c50 2023-07-21T22:18:55.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f85ee0f9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80cea30 con 0x7f85e815bcb0 2023-07-21T22:18:55.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7fa9537fe640 1 -- 172.21.15.6:0/626164134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa93c0047d0 msgr2=0x7fa93c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:55.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7fa9537fe640 1 --2- 172.21.15.6:0/626164134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa93c0047d0 0x7fa93c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7fa9537fe640 1 -- 172.21.15.6:0/626164134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa93c0039b0 msgr2=0x7fa93c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:55.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7fa9537fe640 1 --2- 172.21.15.6:0/626164134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa93c0039b0 0x7fa93c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7fa9537fe640 1 -- 172.21.15.6:0/626164134 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c003530 con 0x7fa93c005180 2023-07-21T22:18:55.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e7fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f85e80b10c0 0x7f85e815f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:37346/0 (socket says 172.21.15.6:37346) 2023-07-21T22:18:55.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e7fff640 1 -- 172.21.15.6:0/2079688590 learned_addr learned my addr 172.21.15.6:0/2079688590 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:55.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e67fc640 1 -- 172.21.15.6:0/2079688590 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250878679 0 0) 0x7f85e80b4aa0 con 0x7f85e80b10c0 2023-07-21T22:18:55.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e67fc640 1 -- 172.21.15.6:0/2079688590 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85d0003530 con 0x7f85e80b10c0 2023-07-21T22:18:55.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7fab2183a640 1 Processor -- start 2023-07-21T22:18:55.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7ff4f9377640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff4f415ff10 0x7ff4f40c0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54190/0 (socket says 172.21.15.6:54190) 2023-07-21T22:18:55.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7ff4f9377640 1 -- 172.21.15.6:0/364572733 learned_addr learned my addr 172.21.15.6:0/364572733 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:55.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e67fc640 1 -- 172.21.15.6:0/2079688590 <== mon.1 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2150546376 0 0) 0x7f85d0003530 con 0x7f85e80b10c0 2023-07-21T22:18:55.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e67fc640 1 -- 172.21.15.6:0/2079688590 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85e815bcb0 msgr2=0x7f85e80b4560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:18:55.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e67fc640 1 --2- 172.21.15.6:0/2079688590 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85e815bcb0 0x7f85e80b4560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e67fc640 1 -- 172.21.15.6:0/2079688590 >> v2:172.21.15.6:3300/0 conn(0x7f85e80b3c50 msgr2=0x7f85e80b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:55.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7ff4f9b78640 1 --2- 172.21.15.6:0/364572733 >> v2:172.21.15.6:3300/0 conn(0x7ff4f406b440 0x7ff4f406b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7ff4f8b76640 1 --2- 172.21.15.6:0/364572733 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4f40cce60 0x7ff4f40cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e67fc640 1 --2- 172.21.15.6:0/2079688590 >> v2:172.21.15.6:3300/0 conn(0x7f85e80b3c50 0x7f85e80b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e67fc640 1 -- 172.21.15.6:0/2079688590 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e80ced10 con 0x7f85e80b10c0 2023-07-21T22:18:55.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e67fc640 1 -- 172.21.15.6:0/2079688590 <== mon.1 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f85e0001a00 con 0x7f85e80b10c0 2023-07-21T22:18:55.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e67fc640 1 -- 172.21.15.6:0/2079688590 >> v1:172.21.15.161:6789/0 conn(0x7f85e80b10c0 legacy=0x7f85e815f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e67fc640 1 --2- 172.21.15.6:0/2079688590 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85d0003980 0x7f85d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e67fc640 1 --2- 172.21.15.6:0/2079688590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85d00047d0 0x7f85d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e67fc640 1 --2- 172.21.15.6:0/2079688590 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85d0005250 0x7f85d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e67fc640 1 -- 172.21.15.6:0/2079688590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80ce750 con 0x7f85d00047d0 2023-07-21T22:18:55.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e67fc640 1 -- 172.21.15.6:0/2079688590 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80cea30 con 0x7f85d0005250 2023-07-21T22:18:55.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e67fc640 1 -- 172.21.15.6:0/2079688590 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d000c1e0 con 0x7f85d0003980 2023-07-21T22:18:55.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f901effd640 1 --2- 172.21.15.6:0/806196342 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f900c066350 0x7f900c068800 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9014009970 tx=0x7f9014008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7ff4f9b78640 1 -- 172.21.15.6:0/364572733 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4f40cce60 msgr2=0x7ff4f40cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:55.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e7fff640 1 --2- 172.21.15.6:0/2079688590 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85d0005250 0x7f85d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7ff4f9b78640 1 --2- 172.21.15.6:0/364572733 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4f40cce60 0x7ff4f40cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7ff4f9b78640 1 -- 172.21.15.6:0/364572733 >> v1:172.21.15.6:6789/0 conn(0x7ff4f415ff10 legacy=0x7ff4f40c0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e6ffd640 1 --2- 172.21.15.6:0/2079688590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85d00047d0 0x7f85d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7ff4f9b78640 1 -- 172.21.15.6:0/364572733 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f40cc020 con 0x7ff4f406b440 2023-07-21T22:18:55.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e7fff640 1 -- 172.21.15.6:0/2079688590 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85d0003980 msgr2=0x7f85d0003d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:18:55.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e7fff640 1 --2- 172.21.15.6:0/2079688590 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85d0003980 0x7f85d0003d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e7fff640 1 -- 172.21.15.6:0/2079688590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85d00047d0 msgr2=0x7f85d0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:55.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e7fff640 1 --2- 172.21.15.6:0/2079688590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85d00047d0 0x7f85d0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f85e7fff640 1 -- 172.21.15.6:0/2079688590 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e80ced10 con 0x7f85d0005250 2023-07-21T22:18:55.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f1068b33640 1 -- 172.21.15.6:0/1402177550 >> v2:172.21.15.6:3300/0 conn(0x7f10640c8940 msgr2=0x7f10640cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:55.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f1068b33640 1 --2- 172.21.15.6:0/1402177550 >> v2:172.21.15.6:3300/0 conn(0x7f10640c8940 0x7f10640cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f1068b33640 1 -- 172.21.15.6:0/1402177550 >> v1:172.21.15.6:6789/0 conn(0x7f1064160330 legacy=0x7f10640ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:55.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.376+0000 7f1068b33640 1 -- 172.21.15.6:0/1402177550 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10640caef0 con 0x7f10640c0f80 2023-07-21T22:18:55.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7f1068b33640 1 --2- 172.21.15.6:0/1402177550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10640c0f80 0x7f10640cd660 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f10640c51e0 tx=0x7f105c01f1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=388b8a7cc034bc6f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.380+0000 7fab2183a640 1 -- start start 2023-07-21T22:18:55.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7f1062ffd640 1 -- 172.21.15.6:0/1402177550 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c0af400 con 0x7f10640c0f80 2023-07-21T22:18:55.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7f1062ffd640 1 -- 172.21.15.6:0/1402177550 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c0ab050 con 0x7f10640c0f80 2023-07-21T22:18:55.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7f1062ffd640 1 -- 172.21.15.6:0/1402177550 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c0af400 con 0x7f10640c0f80 2023-07-21T22:18:55.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7f9007fff640 1 -- 172.21.15.6:0/806196342 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9018051600 con 0x7f90200adce0 2023-07-21T22:18:55.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fa9537fe640 1 --2- 172.21.15.6:0/626164134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa93c005180 0x7fa93c00b990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa948001ec0 tx=0x7fa94801cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=619e4ec03a13821 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7f106a596640 1 -- 172.21.15.6:0/1402177550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10640c0f80 msgr2=0x7f10640cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7f106a596640 1 --2- 172.21.15.6:0/1402177550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10640c0f80 0x7f10640cd660 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f10640c51e0 tx=0x7f105c01f1a0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7f76bdf63640 1 Processor -- start 2023-07-21T22:18:55.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7f106a596640 1 -- 172.21.15.6:0/1402177550 shutdown_connections 2023-07-21T22:18:55.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7f106a596640 1 --2- 172.21.15.6:0/1402177550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10640c0f80 0x7f10640cd660 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7f106a596640 1 --2- 172.21.15.6:0/1402177550 >> v2:172.21.15.6:3300/0 conn(0x7f10640c8940 0x7f10640cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7f106a596640 1 -- 172.21.15.6:0/1402177550 >> 172.21.15.6:0/1402177550 conn(0x7f10640afcf0 msgr2=0x7f10640b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7f76bdf63640 1 -- start start 2023-07-21T22:18:55.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fa951ffb640 1 -- 172.21.15.6:0/626164134 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa948005ae0 con 0x7fa93c005180 2023-07-21T22:18:55.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fab2183a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab1c0b7d90 0x7fab1c15fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fa951ffb640 1 -- 172.21.15.6:0/626164134 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa948005c60 con 0x7fa93c005180 2023-07-21T22:18:55.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fa951ffb640 1 -- 172.21.15.6:0/626164134 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9480a5b20 con 0x7fa93c005180 2023-07-21T22:18:55.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7f106a596640 1 -- 172.21.15.6:0/1402177550 shutdown_connections 2023-07-21T22:18:55.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7f106a596640 1 -- 172.21.15.6:0/1402177550 wait complete. 2023-07-21T22:18:55.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fab2183a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab1c0d13f0 0x7fab1c0c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fa953fff640 1 -- 172.21.15.6:0/626164134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa93c005180 msgr2=0x7fa93c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fa953fff640 1 --2- 172.21.15.6:0/626164134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa93c005180 0x7fa93c00b990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa948001ec0 tx=0x7fa94801cc20 comp rx=0 tx=0).stop 2023-07-21T22:18:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fa9537fe640 1 -- 172.21.15.6:0/626164134 reap_dead start 2023-07-21T22:18:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fa953fff640 1 -- 172.21.15.6:0/626164134 shutdown_connections 2023-07-21T22:18:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fa953fff640 1 -- 172.21.15.6:0/626164134 >> 172.21.15.6:0/626164134 conn(0x7fa9540ca8b0 msgr2=0x7fa9540cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fa953fff640 1 -- 172.21.15.6:0/626164134 shutdown_connections 2023-07-21T22:18:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fa953fff640 1 -- 172.21.15.6:0/626164134 wait complete. 2023-07-21T22:18:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fab2183a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab1c15f3f0 0x7fab1c157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fab2183a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c0cb460 con 0x7fab1c15f3f0 2023-07-21T22:18:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fab2183a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c0c8580 con 0x7fab1c0b7d90 2023-07-21T22:18:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fab2183a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c0cb6b0 con 0x7fab1c0d13f0 2023-07-21T22:18:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7f76bdf63640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76b806f790 0x7f76b806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7f76bdf63640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b8160460 con 0x7f76b80c8e90 2023-07-21T22:18:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7f76bdf63640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b80c9600 con 0x7f76b8160090 2023-07-21T22:18:55.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7f76bdf63640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b80c98e0 con 0x7f76b806f790 2023-07-21T22:18:55.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fab1bfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab1c0d13f0 0x7fab1c0c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fab1bfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab1c0d13f0 0x7fab1c0c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:57974/0 (socket says 172.21.15.6:57974) 2023-07-21T22:18:55.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fab1bfff640 1 -- 172.21.15.6:0/1441733497 learned_addr learned my addr 172.21.15.6:0/1441733497 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:55.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7fab21039640 1 --2- 172.21.15.6:0/1441733497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab1c15f3f0 0x7fab1c157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.384+0000 7fab20838640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab1c0b7d90 0x7fab1c15fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f76bcf61640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f76b8160090 0x7f76b806f080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:37350/0 (socket says 172.21.15.6:37350) 2023-07-21T22:18:55.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f76bcf61640 1 -- 172.21.15.6:0/833613425 learned_addr learned my addr 172.21.15.6:0/833613425 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:55.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f76b7fff640 1 --2- 172.21.15.6:0/833613425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76b806f790 0x7f76b806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f106a596640 1 Processor -- start 2023-07-21T22:18:55.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7ff4f9b78640 1 --2- 172.21.15.6:0/364572733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f406b440 0x7ff4f406b860 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009d90 tx=0x7ff4ec01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac70262b3c0cdbe server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f85e7fff640 1 --2- 172.21.15.6:0/2079688590 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85d0005250 0x7f85d000b990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f85e000a8c0 tx=0x7f85e001d360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a10524002cf34f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f85e67fc640 1 -- 172.21.15.6:0/2079688590 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00ad630 con 0x7f85d0005250 2023-07-21T22:18:55.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f106a596640 1 -- start start 2023-07-21T22:18:55.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f85e67fc640 1 -- 172.21.15.6:0/2079688590 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e00a8070 con 0x7f85d0005250 2023-07-21T22:18:55.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f85e67fc640 1 -- 172.21.15.6:0/2079688590 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00ad630 con 0x7f85d0005250 2023-07-21T22:18:55.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7fa953fff640 1 Processor -- start 2023-07-21T22:18:55.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7fa953fff640 1 -- start start 2023-07-21T22:18:55.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f85ee0f9640 1 -- 172.21.15.6:0/2079688590 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85d0005250 msgr2=0x7f85d000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f85ee0f9640 1 --2- 172.21.15.6:0/2079688590 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85d0005250 0x7f85d000b990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f85e000a8c0 tx=0x7f85e001d360 comp rx=0 tx=0).stop 2023-07-21T22:18:55.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f85e7fff640 1 -- 172.21.15.6:0/2079688590 reap_dead start 2023-07-21T22:18:55.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f85ee0f9640 1 -- 172.21.15.6:0/2079688590 shutdown_connections 2023-07-21T22:18:55.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f85ee0f9640 1 -- 172.21.15.6:0/2079688590 >> 172.21.15.6:0/2079688590 conn(0x7f85e8069e80 msgr2=0x7f85e806a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7fab1bfff640 1 -- 172.21.15.6:0/1441733497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab1c0b7d90 msgr2=0x7fab1c15fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7fab1bfff640 1 --2- 172.21.15.6:0/1441733497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab1c0b7d90 0x7fab1c15fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7fab1bfff640 1 -- 172.21.15.6:0/1441733497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab1c15f3f0 msgr2=0x7fab1c157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7fab1bfff640 1 --2- 172.21.15.6:0/1441733497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab1c15f3f0 0x7fab1c157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7fab1bfff640 1 -- 172.21.15.6:0/1441733497 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab14009a70 con 0x7fab1c0d13f0 2023-07-21T22:18:55.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7fab1bfff640 1 --2- 172.21.15.6:0/1441733497 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab1c0d13f0 0x7fab1c0c8040 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fab140b0040 tx=0x7fab14019680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7fab197fa640 1 -- 172.21.15.6:0/1441733497 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab140b9650 con 0x7fab1c0d13f0 2023-07-21T22:18:55.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7fab197fa640 1 -- 172.21.15.6:0/1441733497 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab140b97b0 con 0x7fab1c0d13f0 2023-07-21T22:18:55.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7fab197fa640 1 -- 172.21.15.6:0/1441733497 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab140b9b60 con 0x7fab1c0d13f0 2023-07-21T22:18:55.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7fab2183a640 1 -- 172.21.15.6:0/1441733497 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1c0b30f0 con 0x7fab1c0d13f0 2023-07-21T22:18:55.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7fab2183a640 1 -- 172.21.15.6:0/1441733497 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1c158300 con 0x7fab1c0d13f0 2023-07-21T22:18:55.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f01815e6640 1 Processor -- start 2023-07-21T22:18:55.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f01815e6640 1 -- start start 2023-07-21T22:18:55.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f85ee0f9640 1 -- 172.21.15.6:0/2079688590 shutdown_connections 2023-07-21T22:18:55.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f76b7fff640 1 -- 172.21.15.6:0/833613425 >> v1:172.21.15.161:6789/0 conn(0x7f76b8160090 legacy=0x7f76b806f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f76b7fff640 1 -- 172.21.15.6:0/833613425 >> v1:172.21.15.6:6789/0 conn(0x7f76b80c8e90 legacy=0x7f76b80cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f76b7fff640 1 -- 172.21.15.6:0/833613425 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b80c9bc0 con 0x7f76b806f790 2023-07-21T22:18:55.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7ff4ebfff640 1 -- 172.21.15.6:0/364572733 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec0a59e0 con 0x7ff4f406b440 2023-07-21T22:18:55.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7ff4ebfff640 1 -- 172.21.15.6:0/364572733 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec0a5b40 con 0x7ff4f406b440 2023-07-21T22:18:55.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7ff4ebfff640 1 -- 172.21.15.6:0/364572733 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec0ad440 con 0x7ff4f406b440 2023-07-21T22:18:55.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f85ee0f9640 1 -- 172.21.15.6:0/2079688590 wait complete. 2023-07-21T22:18:55.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7fab2183a640 1 -- 172.21.15.6:0/1441733497 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faafc005260 con 0x7fab1c0d13f0 2023-07-21T22:18:55.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7fa953fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa93c005180 0x7fa9540b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f017bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f017c160150 0x7f017c06b150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54208/0 (socket says 172.21.15.6:54208) 2023-07-21T22:18:55.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f017bfff640 1 -- 172.21.15.6:0/3154303672 learned_addr learned my addr 172.21.15.6:0/3154303672 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:55.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7fa953fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa954166520 0x7fa9541f7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7ff4fb5db640 1 -- 172.21.15.6:0/364572733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f406b440 msgr2=0x7ff4f406b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7ff4fb5db640 1 --2- 172.21.15.6:0/364572733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f406b440 0x7ff4f406b860 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009d90 tx=0x7ff4ec01c940 comp rx=0 tx=0).stop 2023-07-21T22:18:55.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f01815e6640 1 --2- 172.21.15.6:0/3154303672 >> v2:172.21.15.161:3300/0 conn(0x7f017c070d30 0x7f017c069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7fa953fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa954164ec0 0x7fa95406b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f01815e6640 1 --2- 172.21.15.6:0/3154303672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f017c160520 0x7f017c0c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f76b7fff640 1 --2- 172.21.15.6:0/833613425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76b806f790 0x7f76b806d5d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009dc0 tx=0x7f76b001c6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c52e6a82bfeeebf8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7fa9527fc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa954166520 0x7fa9541f7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7fa9527fc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa954166520 0x7fa9541f7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:58000/0 (socket says 172.21.15.6:58000) 2023-07-21T22:18:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7fa9527fc640 1 -- 172.21.15.6:0/2961427246 learned_addr learned my addr 172.21.15.6:0/2961427246 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7fa9537fe640 1 --2- 172.21.15.6:0/2961427246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa954164ec0 0x7fa95406b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7fa952ffd640 1 --2- 172.21.15.6:0/2961427246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa93c005180 0x7fa9540b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7fa953fff640 1 -- 172.21.15.6:0/2961427246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa954165480 con 0x7fa93c005180 2023-07-21T22:18:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7fa953fff640 1 -- 172.21.15.6:0/2961427246 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa954165760 con 0x7fa954164ec0 2023-07-21T22:18:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7fa953fff640 1 -- 172.21.15.6:0/2961427246 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa954165a40 con 0x7fa954166520 2023-07-21T22:18:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f106a596640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10640c0f80 0x7f10640b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f106a596640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10640c8940 0x7f10640b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f106a596640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1064160330 0x7f10640c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.388+0000 7f106a596640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10640c54e0 con 0x7f1064160330 2023-07-21T22:18:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f106a596640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10640c2c60 con 0x7f10640c0f80 2023-07-21T22:18:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f106a596640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10640c2980 con 0x7f10640c8940 2023-07-21T22:18:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f10637fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10640c8940 0x7f10640b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f10637fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10640c8940 0x7f10640b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:57986/0 (socket says 172.21.15.6:57986) 2023-07-21T22:18:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f10637fe640 1 -- 172.21.15.6:0/4147181068 learned_addr learned my addr 172.21.15.6:0/4147181068 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f1068b33640 1 --2- 172.21.15.6:0/4147181068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1064160330 0x7f10640c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f1063fff640 1 --2- 172.21.15.6:0/4147181068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10640c0f80 0x7f10640b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f10637fe640 1 -- 172.21.15.6:0/4147181068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10640c0f80 msgr2=0x7f10640b20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f10637fe640 1 --2- 172.21.15.6:0/4147181068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10640c0f80 0x7f10640b20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f10637fe640 1 -- 172.21.15.6:0/4147181068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1064160330 msgr2=0x7f10640c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f10637fe640 1 --2- 172.21.15.6:0/4147181068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1064160330 0x7f10640c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f10637fe640 1 -- 172.21.15.6:0/4147181068 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c009b30 con 0x7f10640c8940 2023-07-21T22:18:55.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f1063fff640 1 --2- 172.21.15.6:0/4147181068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10640c0f80 0x7f10640b20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:55.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f10637fe640 1 --2- 172.21.15.6:0/4147181068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10640c8940 0x7f10640b2610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f105800b550 tx=0x7f105800ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f1060ff9640 1 -- 172.21.15.6:0/4147181068 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058010610 con 0x7f10640c8940 2023-07-21T22:18:55.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f1060ff9640 1 -- 172.21.15.6:0/4147181068 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1058010790 con 0x7f10640c8940 2023-07-21T22:18:55.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f1060ff9640 1 -- 172.21.15.6:0/4147181068 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058010b40 con 0x7f10640c8940 2023-07-21T22:18:55.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f85ee0f9640 1 Processor -- start 2023-07-21T22:18:55.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f85ee0f9640 1 -- start start 2023-07-21T22:18:55.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f017b7fe640 1 --2- 172.21.15.6:0/3154303672 >> v2:172.21.15.161:3300/0 conn(0x7f017c070d30 0x7f017c069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f01815e6640 1 -- 172.21.15.6:0/3154303672 --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017c06b930 con 0x7f017c160150 2023-07-21T22:18:55.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f0180de5640 1 --2- 172.21.15.6:0/3154303672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f017c160520 0x7f017c0c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f01815e6640 1 -- 172.21.15.6:0/3154303672 --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f017c06bc10 con 0x7f017c070d30 2023-07-21T22:18:55.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f01815e6640 1 -- 172.21.15.6:0/3154303672 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017c06bef0 con 0x7f017c160520 2023-07-21T22:18:55.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7fa9527fc640 1 -- 172.21.15.6:0/2961427246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa954164ec0 msgr2=0x7fa95406b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7fa9527fc640 1 --2- 172.21.15.6:0/2961427246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa954164ec0 0x7fa95406b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7fa9527fc640 1 -- 172.21.15.6:0/2961427246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa93c005180 msgr2=0x7fa9540b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7fa9527fc640 1 --2- 172.21.15.6:0/2961427246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa93c005180 0x7fa9540b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7fa9527fc640 1 -- 172.21.15.6:0/2961427246 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa954165d20 con 0x7fa954166520 2023-07-21T22:18:55.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f017b7fe640 1 -- 172.21.15.6:0/3154303672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f017c160520 msgr2=0x7f017c0c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:55.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f017b7fe640 1 --2- 172.21.15.6:0/3154303672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f017c160520 0x7f017c0c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f017b7fe640 1 -- 172.21.15.6:0/3154303672 >> v1:172.21.15.6:6789/0 conn(0x7f017c160150 legacy=0x7f017c06b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f017b7fe640 1 -- 172.21.15.6:0/3154303672 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017c0694d0 con 0x7f017c070d30 2023-07-21T22:18:55.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7fa9527fc640 1 --2- 172.21.15.6:0/2961427246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa954166520 0x7fa9541f7ff0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa94c003fd0 tx=0x7fa94c009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7ff4fb5db640 1 -- 172.21.15.6:0/364572733 shutdown_connections 2023-07-21T22:18:55.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7ff4fb5db640 1 --2- 172.21.15.6:0/364572733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f406b440 0x7ff4f406b860 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7ff4fb5db640 1 --2- 172.21.15.6:0/364572733 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4f40cce60 0x7ff4f40cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7ff4fb5db640 1 -- 172.21.15.6:0/364572733 >> 172.21.15.6:0/364572733 conn(0x7ff4f40ce9d0 msgr2=0x7ff4f40ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f106a596640 1 -- 172.21.15.6:0/4147181068 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10640c5780 con 0x7f10640c8940 2023-07-21T22:18:55.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f85ee0f9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85d0005250 0x7f85e80c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f106a596640 1 -- 172.21.15.6:0/4147181068 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10640c2190 con 0x7f10640c8940 2023-07-21T22:18:55.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7ff4fb5db640 1 -- 172.21.15.6:0/364572733 shutdown_connections 2023-07-21T22:18:55.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7ff4fb5db640 1 -- 172.21.15.6:0/364572733 wait complete. 2023-07-21T22:18:55.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f85ee0f9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85e80b6840 0x7f85e81560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.392+0000 7f85ee0f9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85e80b5c40 0x7f85e80b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85ee0f9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80cc0f0 con 0x7f85d0005250 2023-07-21T22:18:55.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85ee0f9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80b57b0 con 0x7f85e80b6840 2023-07-21T22:18:55.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85ee0f9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e8156600 con 0x7f85e80b5c40 2023-07-21T22:18:55.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7fab197fa640 1 -- 172.21.15.6:0/1441733497 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fab140b9cc0 con 0x7fab1c0d13f0 2023-07-21T22:18:55.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85e6ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85e80b6840 0x7f85e81560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85e6ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85e80b6840 0x7f85e81560c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:48100/0 (socket says 172.21.15.6:48100) 2023-07-21T22:18:55.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85e6ffd640 1 -- 172.21.15.6:0/1719330852 learned_addr learned my addr 172.21.15.6:0/1719330852 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:55.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f76b77fe640 1 -- 172.21.15.6:0/833613425 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b00a5710 con 0x7f76b806f790 2023-07-21T22:18:55.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f106a596640 1 -- 172.21.15.6:0/4147181068 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10640678d0 con 0x7f10640c8940 2023-07-21T22:18:55.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85e7fff640 1 --2- 172.21.15.6:0/1719330852 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85e80b5c40 0x7f85e80b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85e6ffd640 1 -- 172.21.15.6:0/1719330852 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85e80b5c40 msgr2=0x7f85e80b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85e6ffd640 1 --2- 172.21.15.6:0/1719330852 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85e80b5c40 0x7f85e80b60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85e6ffd640 1 -- 172.21.15.6:0/1719330852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85d0005250 msgr2=0x7f85e80c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85e77fe640 1 --2- 172.21.15.6:0/1719330852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85d0005250 0x7f85e80c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f76b77fe640 1 -- 172.21.15.6:0/833613425 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b00a5870 con 0x7f76b806f790 2023-07-21T22:18:55.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f76bdf63640 1 -- 172.21.15.6:0/833613425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76b806f790 msgr2=0x7f76b806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f76b77fe640 1 -- 172.21.15.6:0/833613425 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b00a5710 con 0x7f76b806f790 2023-07-21T22:18:55.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85e6ffd640 1 --2- 172.21.15.6:0/1719330852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85d0005250 0x7f85e80c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85e6ffd640 1 -- 172.21.15.6:0/1719330852 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e80b51a0 con 0x7f85e80b6840 2023-07-21T22:18:55.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85e77fe640 1 --2- 172.21.15.6:0/1719330852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85d0005250 0x7f85e80c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:55.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f76bdf63640 1 --2- 172.21.15.6:0/833613425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76b806f790 0x7f76b806d5d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009dc0 tx=0x7f76b001c6b0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7fab197fa640 1 --2- 172.21.15.6:0/1441733497 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fab0806eb60 0x7fab08071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f76bdf63640 1 -- 172.21.15.6:0/833613425 shutdown_connections 2023-07-21T22:18:55.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f76bdf63640 1 --2- 172.21.15.6:0/833613425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76b806f790 0x7f76b806d5d0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009dc0 tx=0x7f76b001c6b0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f76bdf63640 1 -- 172.21.15.6:0/833613425 >> 172.21.15.6:0/833613425 conn(0x7f76b80cb540 msgr2=0x7f76b80cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7fab197fa640 1 -- 172.21.15.6:0/1441733497 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab1411f830 con 0x7fab1c0d13f0 2023-07-21T22:18:55.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85e6ffd640 1 --2- 172.21.15.6:0/1719330852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85e80b6840 0x7f85e81560c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00d4d0 tx=0x7f85dc00d5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f76bdf63640 1 -- 172.21.15.6:0/833613425 shutdown_connections 2023-07-21T22:18:55.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7fab20838640 1 --2- 172.21.15.6:0/1441733497 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fab0806eb60 0x7fab08071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85cffff640 1 -- 172.21.15.6:0/1719330852 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc014430 con 0x7f85e80b6840 2023-07-21T22:18:55.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85cffff640 1 -- 172.21.15.6:0/1719330852 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc0145b0 con 0x7f85e80b6840 2023-07-21T22:18:55.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85cffff640 1 -- 172.21.15.6:0/1719330852 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc014960 con 0x7f85e80b6840 2023-07-21T22:18:55.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85ee0f9640 1 -- 172.21.15.6:0/1719330852 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e80cbe10 con 0x7f85e80b6840 2023-07-21T22:18:55.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7ff4fb5db640 1 Processor -- start 2023-07-21T22:18:55.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85ee0f9640 1 -- 172.21.15.6:0/1719330852 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e80cba30 con 0x7f85e80b6840 2023-07-21T22:18:55.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7ff4fb5db640 1 -- start start 2023-07-21T22:18:55.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f76bdf63640 1 -- 172.21.15.6:0/833613425 wait complete. 2023-07-21T22:18:55.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7fab20838640 1 --2- 172.21.15.6:0/1441733497 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fab0806eb60 0x7fab08071010 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fab100011f0 tx=0x7fab10009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.396+0000 7f85ee0f9640 1 -- 172.21.15.6:0/1719330852 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e80b5000 con 0x7f85e80b6840 2023-07-21T22:18:55.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7f017b7fe640 1 --2- 172.21.15.6:0/3154303672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f017c070d30 0x7f017c069cd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f01700097c0 tx=0x7f017001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73d8929fcfa40153 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7ff4fb5db640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4f406b440 0x7ff4f4158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7ff4fb5db640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4f40cce60 0x7ff4f40c17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7f76bdf63640 1 Processor -- start 2023-07-21T22:18:55.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7ff4f9377640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4f406b440 0x7ff4f4158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7ff4f9377640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4f406b440 0x7ff4f4158020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:48102/0 (socket says 172.21.15.6:48102) 2023-07-21T22:18:55.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7ff4f9377640 1 -- 172.21.15.6:0/1248849625 learned_addr learned my addr 172.21.15.6:0/1248849625 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:55.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7f76bdf63640 1 -- start start 2023-07-21T22:18:55.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7ff4f8b76640 1 --2- 172.21.15.6:0/1248849625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4f40cce60 0x7ff4f40c17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7ff4fb5db640 1 --2- 172.21.15.6:0/1248849625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f415ff10 0x7ff4f40c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7f85cffff640 1 -- 172.21.15.6:0/1719330852 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f85dc014ac0 con 0x7f85e80b6840 2023-07-21T22:18:55.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7fa93bfff640 1 -- 172.21.15.6:0/2961427246 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c007d20 con 0x7fa954166520 2023-07-21T22:18:55.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7fa953fff640 1 -- 172.21.15.6:0/2961427246 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa954166000 con 0x7fa954166520 2023-07-21T22:18:55.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7ff4fb5db640 1 -- 172.21.15.6:0/1248849625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f41613c0 con 0x7ff4f415ff10 2023-07-21T22:18:55.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7ff4f9b78640 1 --2- 172.21.15.6:0/1248849625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f415ff10 0x7ff4f40c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7ff4fb5db640 1 -- 172.21.15.6:0/1248849625 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f40c0820 con 0x7ff4f406b440 2023-07-21T22:18:55.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7ff4fb5db640 1 -- 172.21.15.6:0/1248849625 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f4160460 con 0x7ff4f40cce60 2023-07-21T22:18:55.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7fa953fff640 1 -- 172.21.15.6:0/2961427246 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9541f8530 con 0x7fa954166520 2023-07-21T22:18:55.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7fa93bfff640 1 -- 172.21.15.6:0/2961427246 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94c00f050 con 0x7fa954166520 2023-07-21T22:18:55.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7fa93bfff640 1 -- 172.21.15.6:0/2961427246 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c014610 con 0x7fa954166520 2023-07-21T22:18:55.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7f85cffff640 1 --2- 172.21.15.6:0/1719330852 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f85d40662d0 0x7f85d4068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7f85cffff640 1 -- 172.21.15.6:0/1719330852 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f85dc03b030 con 0x7f85e80b6840 2023-07-21T22:18:55.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7ff4f9377640 1 -- 172.21.15.6:0/1248849625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4f40cce60 msgr2=0x7ff4f40c17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7ff4f9377640 1 --2- 172.21.15.6:0/1248849625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4f40cce60 0x7ff4f40c17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7ff4f9377640 1 -- 172.21.15.6:0/1248849625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f415ff10 msgr2=0x7ff4f40c1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7ff4f9377640 1 --2- 172.21.15.6:0/1248849625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f415ff10 0x7ff4f40c1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7ff4f9377640 1 -- 172.21.15.6:0/1248849625 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec009a70 con 0x7ff4f406b440 2023-07-21T22:18:55.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7f76bdf63640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b80c8e90 0x7f76b81572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7ff4f9377640 1 --2- 172.21.15.6:0/1248849625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4f406b440 0x7ff4f4158020 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000c500 tx=0x7ff4f000c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7f76bdf63640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76b8160090 0x7f76b80ad790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7f85e77fe640 1 --2- 172.21.15.6:0/1719330852 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f85d40662d0 0x7f85d4068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7fab197fa640 1 -- 172.21.15.6:0/1441733497 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab140ecd20 con 0x7fab1c0d13f0 2023-07-21T22:18:55.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7f76bdf63640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76b80adcd0 0x7f76b806c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7f76bdf63640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b80ae140 con 0x7f76b80c8e90 2023-07-21T22:18:55.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7fa953fff640 1 -- 172.21.15.6:0/2961427246 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa954166240 con 0x7fa954166520 2023-07-21T22:18:55.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7f76b7fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76b8160090 0x7f76b80ad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7f76b7fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76b8160090 0x7f76b80ad790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:58036/0 (socket says 172.21.15.6:58036) 2023-07-21T22:18:55.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7f76b7fff640 1 -- 172.21.15.6:0/384988299 learned_addr learned my addr 172.21.15.6:0/384988299 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:55.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7f76bdf63640 1 -- 172.21.15.6:0/384988299 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b80c2560 con 0x7f76b80adcd0 2023-07-21T22:18:55.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7f76bdf63640 1 -- 172.21.15.6:0/384988299 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b80ae350 con 0x7f76b8160090 2023-07-21T22:18:55.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.400+0000 7f85e77fe640 1 --2- 172.21.15.6:0/1719330852 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f85d40662d0 0x7f85d4068780 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f85e8070b30 tx=0x7f85d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7f1060ff9640 1 -- 172.21.15.6:0/4147181068 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1058010ca0 con 0x7f10640c8940 2023-07-21T22:18:55.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7f76bcf61640 1 --2- 172.21.15.6:0/384988299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b80c8e90 0x7f76b81572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7f76bd762640 1 --2- 172.21.15.6:0/384988299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76b80adcd0 0x7f76b806c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7f76b7fff640 1 -- 172.21.15.6:0/384988299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76b80adcd0 msgr2=0x7f76b806c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7f76b7fff640 1 --2- 172.21.15.6:0/384988299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76b80adcd0 0x7f76b806c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7f76b7fff640 1 -- 172.21.15.6:0/384988299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b80c8e90 msgr2=0x7f76b81572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7f76b7fff640 1 --2- 172.21.15.6:0/384988299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b80c8e90 0x7f76b81572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7f76b7fff640 1 -- 172.21.15.6:0/384988299 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b0009a70 con 0x7f76b8160090 2023-07-21T22:18:55.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7f76b7fff640 1 --2- 172.21.15.6:0/384988299 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76b8160090 0x7f76b80ad790 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f76b001cf50 tx=0x7f76b0019450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7f1060ff9640 1 --2- 172.21.15.6:0/4147181068 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1050066300 0x7f10500687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7f1060ff9640 1 -- 172.21.15.6:0/4147181068 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1058083d70 con 0x7f10640c8940 2023-07-21T22:18:55.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7f1063fff640 1 --2- 172.21.15.6:0/4147181068 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1050066300 0x7f10500687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7f1063fff640 1 --2- 172.21.15.6:0/4147181068 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1050066300 0x7f10500687b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f105401b830 tx=0x7f1054019040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7f1060ff9640 1 -- 172.21.15.6:0/4147181068 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1058051260 con 0x7f10640c8940 2023-07-21T22:18:55.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7f76b57fa640 1 -- 172.21.15.6:0/384988299 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0004240 con 0x7f76b8160090 2023-07-21T22:18:55.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7f76b57fa640 1 -- 172.21.15.6:0/384988299 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b00043a0 con 0x7f76b8160090 2023-07-21T22:18:55.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7f76b57fa640 1 -- 172.21.15.6:0/384988299 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0004710 con 0x7f76b8160090 2023-07-21T22:18:55.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7f76bdf63640 1 -- 172.21.15.6:0/384988299 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b80aeb80 con 0x7f76b8160090 2023-07-21T22:18:55.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7f76bdf63640 1 -- 172.21.15.6:0/384988299 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b80af140 con 0x7f76b8160090 2023-07-21T22:18:55.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7f017affd640 1 -- 172.21.15.6:0/3154303672 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01700ab600 con 0x7f017c070d30 2023-07-21T22:18:55.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7f017affd640 1 -- 172.21.15.6:0/3154303672 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01700a7050 con 0x7f017c070d30 2023-07-21T22:18:55.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7f017affd640 1 -- 172.21.15.6:0/3154303672 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01700ab980 con 0x7f017c070d30 2023-07-21T22:18:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7ff4e9ffb640 1 -- 172.21.15.6:0/1248849625 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0005cf0 con 0x7ff4f406b440 2023-07-21T22:18:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.404+0000 7ff4e9ffb640 1 -- 172.21.15.6:0/1248849625 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f0005e50 con 0x7ff4f406b440 2023-07-21T22:18:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7ff4e9ffb640 1 -- 172.21.15.6:0/1248849625 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f00072f0 con 0x7ff4f406b440 2023-07-21T22:18:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7ff4fb5db640 1 -- 172.21.15.6:0/1248849625 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f4160740 con 0x7ff4f406b440 2023-07-21T22:18:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7ff4fb5db640 1 -- 172.21.15.6:0/1248849625 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f4160d00 con 0x7ff4f406b440 2023-07-21T22:18:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7f01815e6640 1 -- 172.21.15.6:0/3154303672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f017c070d30 msgr2=0x7f017c069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7f01815e6640 1 --2- 172.21.15.6:0/3154303672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f017c070d30 0x7f017c069cd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f01700097c0 tx=0x7f017001c3f0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7f85cffff640 1 -- 172.21.15.6:0/1719330852 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85dc051900 con 0x7f85e80b6840 2023-07-21T22:18:55.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7f76bdf63640 1 -- 172.21.15.6:0/384988299 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b80678d0 con 0x7f76b8160090 2023-07-21T22:18:55.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7fa93bfff640 1 -- 172.21.15.6:0/2961427246 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa94c014770 con 0x7fa954166520 2023-07-21T22:18:55.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7f01815e6640 1 -- 172.21.15.6:0/3154303672 shutdown_connections 2023-07-21T22:18:55.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7f01815e6640 1 --2- 172.21.15.6:0/3154303672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f017c160520 0x7f017c0c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7f01815e6640 1 --2- 172.21.15.6:0/3154303672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f017c070d30 0x7f017c069cd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7f01815e6640 1 -- 172.21.15.6:0/3154303672 >> 172.21.15.6:0/3154303672 conn(0x7f017c0cb4a0 msgr2=0x7f017c0cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7ff4fb5db640 1 -- 172.21.15.6:0/1248849625 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f40678d0 con 0x7ff4f406b440 2023-07-21T22:18:55.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7fa93bfff640 1 --2- 172.21.15.6:0/2961427246 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa940066280 0x7fa940068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7f01815e6640 1 -- 172.21.15.6:0/3154303672 shutdown_connections 2023-07-21T22:18:55.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7fa93bfff640 1 -- 172.21.15.6:0/2961427246 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa94c084ba0 con 0x7fa954166520 2023-07-21T22:18:55.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7f01815e6640 1 -- 172.21.15.6:0/3154303672 wait complete. 2023-07-21T22:18:55.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7fa93bfff640 1 -- 172.21.15.6:0/2961427246 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa94c052140 con 0x7fa954166520 2023-07-21T22:18:55.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.408+0000 7fa952ffd640 1 --2- 172.21.15.6:0/2961427246 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa940066280 0x7fa940068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.412+0000 7fa952ffd640 1 --2- 172.21.15.6:0/2961427246 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa940066280 0x7fa940068730 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa944001620 tx=0x7fa944009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.412+0000 7f01815e6640 1 Processor -- start 2023-07-21T22:18:55.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.412+0000 7f01815e6640 1 -- start start 2023-07-21T22:18:55.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.412+0000 7ff4e9ffb640 1 -- 172.21.15.6:0/1248849625 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff4f0007450 con 0x7ff4f406b440 2023-07-21T22:18:55.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.412+0000 7ff4e9ffb640 1 --2- 172.21.15.6:0/1248849625 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff4d8066350 0x7ff4d8068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.412+0000 7ff4e9ffb640 1 -- 172.21.15.6:0/1248849625 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff4f0083200 con 0x7ff4f406b440 2023-07-21T22:18:55.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.412+0000 7f76b57fa640 1 -- 172.21.15.6:0/384988299 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f76b00b4050 con 0x7f76b8160090 2023-07-21T22:18:55.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.412+0000 7ff4f8b76640 1 --2- 172.21.15.6:0/1248849625 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff4d8066350 0x7ff4d8068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.412+0000 7f76b57fa640 1 --2- 172.21.15.6:0/384988299 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f76a4066350 0x7f76a4068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.412+0000 7f76b57fa640 1 -- 172.21.15.6:0/384988299 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f76b011f890 con 0x7f76b8160090 2023-07-21T22:18:55.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.412+0000 7ff4f8b76640 1 --2- 172.21.15.6:0/1248849625 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff4d8066350 0x7ff4d8068800 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4157c20 tx=0x7ff4e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.416+0000 7f76bcf61640 1 --2- 172.21.15.6:0/384988299 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f76a4066350 0x7f76a4068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.416+0000 7f76bcf61640 1 --2- 172.21.15.6:0/384988299 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f76a4066350 0x7f76a4068800 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f76ac000f70 tx=0x7f76ac007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.416+0000 7f76b57fa640 1 -- 172.21.15.6:0/384988299 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76b00ecd80 con 0x7f76b8160090 2023-07-21T22:18:55.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.416+0000 7ff4e9ffb640 1 -- 172.21.15.6:0/1248849625 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff4f00507a0 con 0x7ff4f406b440 2023-07-21T22:18:55.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.416+0000 7f01815e6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f017c070d30 0x7f017c0c2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.416+0000 7f01815e6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f017c160150 0x7f017c15e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.416+0000 7f01815e6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f017c160520 0x7f017c06ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.416+0000 7f017b7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f017c160150 0x7f017c15e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.416+0000 7f017b7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f017c160150 0x7f017c15e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:58038/0 (socket says 172.21.15.6:58038) 2023-07-21T22:18:55.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.420+0000 7f017b7fe640 1 -- 172.21.15.6:0/2208393270 learned_addr learned my addr 172.21.15.6:0/2208393270 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:55.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.420+0000 7f0180de5640 1 --2- 172.21.15.6:0/2208393270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f017c160520 0x7f017c06ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.420+0000 7f017bfff640 1 --2- 172.21.15.6:0/2208393270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f017c070d30 0x7f017c0c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.420+0000 7f01815e6640 1 -- 172.21.15.6:0/2208393270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c0ade60 con 0x7f017c070d30 2023-07-21T22:18:55.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.420+0000 7f01815e6640 1 -- 172.21.15.6:0/2208393270 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c1639b0 con 0x7f017c160520 2023-07-21T22:18:55.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.420+0000 7f01815e6640 1 -- 172.21.15.6:0/2208393270 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017c1636d0 con 0x7f017c160150 2023-07-21T22:18:55.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.420+0000 7f017b7fe640 1 -- 172.21.15.6:0/2208393270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f017c160520 msgr2=0x7f017c06ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.420+0000 7f017b7fe640 1 --2- 172.21.15.6:0/2208393270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f017c160520 0x7f017c06ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.420+0000 7f017b7fe640 1 -- 172.21.15.6:0/2208393270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f017c070d30 msgr2=0x7f017c0c2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.420+0000 7f017b7fe640 1 --2- 172.21.15.6:0/2208393270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f017c070d30 0x7f017c0c2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.420+0000 7f017b7fe640 1 -- 172.21.15.6:0/2208393270 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0170009420 con 0x7f017c160150 2023-07-21T22:18:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.420+0000 7f017b7fe640 1 --2- 172.21.15.6:0/2208393270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f017c160150 0x7f017c15e7a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0170019000 tx=0x7f0170019190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.420+0000 7f0178ff9640 1 -- 172.21.15.6:0/2208393270 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01700b4600 con 0x7f017c160150 2023-07-21T22:18:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.420+0000 7f0178ff9640 1 -- 172.21.15.6:0/2208393270 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01700b4760 con 0x7f017c160150 2023-07-21T22:18:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.420+0000 7f0178ff9640 1 -- 172.21.15.6:0/2208393270 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01700b4b10 con 0x7f017c160150 2023-07-21T22:18:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.420+0000 7f01815e6640 1 -- 172.21.15.6:0/2208393270 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017c0ad810 con 0x7f017c160150 2023-07-21T22:18:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.420+0000 7f01815e6640 1 -- 172.21.15.6:0/2208393270 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017c15f840 con 0x7f017c160150 2023-07-21T22:18:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.424+0000 7f0178ff9640 1 -- 172.21.15.6:0/2208393270 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f01700b2040 con 0x7f017c160150 2023-07-21T22:18:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.428+0000 7f0178ff9640 1 --2- 172.21.15.6:0/2208393270 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0168066350 0x7f0168068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.428+0000 7f0178ff9640 1 -- 172.21.15.6:0/2208393270 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f017011d730 con 0x7f017c160150 2023-07-21T22:18:55.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.428+0000 7f017bfff640 1 --2- 172.21.15.6:0/2208393270 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0168066350 0x7f0168068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.428+0000 7f01815e6640 1 -- 172.21.15.6:0/2208393270 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017c0678d0 con 0x7f017c160150 2023-07-21T22:18:55.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.428+0000 7f017bfff640 1 --2- 172.21.15.6:0/2208393270 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0168066350 0x7f0168068800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f016c005890 tx=0x7f016c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.432+0000 7f0178ff9640 1 -- 172.21.15.6:0/2208393270 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f01700eac20 con 0x7f017c160150 2023-07-21T22:18:55.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.712+0000 7f9025911640 1 -- 172.21.15.6:0/806196342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f90000057e0 con 0x7f90200adce0 2023-07-21T22:18:55.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.712+0000 7f9007fff640 1 -- 172.21.15.6:0/806196342 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f901800cea0 con 0x7f90200adce0 2023-07-21T22:18:55.761 INFO:teuthology.orchestra.run.smithi006.stdout:64424509448 2023-07-21T22:18:55.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.716+0000 7f9005ffb640 1 -- 172.21.15.6:0/806196342 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f900c066350 msgr2=0x7f900c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.716+0000 7f9005ffb640 1 --2- 172.21.15.6:0/806196342 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f900c066350 0x7f900c068800 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9014009970 tx=0x7f9014008040 comp rx=0 tx=0).stop 2023-07-21T22:18:55.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.716+0000 7f9005ffb640 1 -- 172.21.15.6:0/806196342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90200adce0 msgr2=0x7f902013ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.716+0000 7f9005ffb640 1 --2- 172.21.15.6:0/806196342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90200adce0 0x7f902013ed60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9018009e50 tx=0x7f901800c490 comp rx=0 tx=0).stop 2023-07-21T22:18:55.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.716+0000 7f9005ffb640 1 -- 172.21.15.6:0/806196342 shutdown_connections 2023-07-21T22:18:55.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.720+0000 7f9005ffb640 1 --2- 172.21.15.6:0/806196342 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f900c066350 0x7f900c068800 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.720+0000 7f9005ffb640 1 --2- 172.21.15.6:0/806196342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90200adce0 0x7f902013ed60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.720+0000 7f9005ffb640 1 --2- 172.21.15.6:0/806196342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90201f7b80 0x7f90200ad7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.720+0000 7f9005ffb640 1 --2- 172.21.15.6:0/806196342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9020069970 0x7f902006eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.720+0000 7f9005ffb640 1 -- 172.21.15.6:0/806196342 >> 172.21.15.6:0/806196342 conn(0x7f90200ce980 msgr2=0x7f90200cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.720+0000 7f9005ffb640 1 -- 172.21.15.6:0/806196342 shutdown_connections 2023-07-21T22:18:55.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.720+0000 7f9005ffb640 1 -- 172.21.15.6:0/806196342 wait complete. 2023-07-21T22:18:55.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.732+0000 7fab2183a640 1 -- 172.21.15.6:0/1441733497 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faafc0057e0 con 0x7fab1c0d13f0 2023-07-21T22:18:55.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.732+0000 7fab197fa640 1 -- 172.21.15.6:0/1441733497 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fab140f0340 con 0x7fab1c0d13f0 2023-07-21T22:18:55.780 INFO:teuthology.orchestra.run.smithi006.stdout:64424509447 2023-07-21T22:18:55.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.736+0000 7f106a596640 1 -- 172.21.15.6:0/4147181068 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f10640c5c30 con 0x7f10640c8940 2023-07-21T22:18:55.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.736+0000 7fab02ffd640 1 -- 172.21.15.6:0/1441733497 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fab0806eb60 msgr2=0x7fab08071010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.736+0000 7fab02ffd640 1 --2- 172.21.15.6:0/1441733497 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fab0806eb60 0x7fab08071010 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fab100011f0 tx=0x7fab10009040 comp rx=0 tx=0).stop 2023-07-21T22:18:55.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.736+0000 7fab02ffd640 1 -- 172.21.15.6:0/1441733497 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab1c0d13f0 msgr2=0x7fab1c0c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.736+0000 7fab02ffd640 1 --2- 172.21.15.6:0/1441733497 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab1c0d13f0 0x7fab1c0c8040 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fab140b0040 tx=0x7fab14019680 comp rx=0 tx=0).stop 2023-07-21T22:18:55.785 INFO:teuthology.orchestra.run.smithi006.stdout:60129542153 2023-07-21T22:18:55.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.736+0000 7f1060ff9640 1 -- 172.21.15.6:0/4147181068 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f105801e020 con 0x7f10640c8940 2023-07-21T22:18:55.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.740+0000 7fab02ffd640 1 -- 172.21.15.6:0/1441733497 shutdown_connections 2023-07-21T22:18:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.740+0000 7fab02ffd640 1 --2- 172.21.15.6:0/1441733497 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fab0806eb60 0x7fab08071010 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.740+0000 7fab02ffd640 1 --2- 172.21.15.6:0/1441733497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab1c15f3f0 0x7fab1c157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.740+0000 7fab02ffd640 1 --2- 172.21.15.6:0/1441733497 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab1c0d13f0 0x7fab1c0c8040 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.740+0000 7fab02ffd640 1 --2- 172.21.15.6:0/1441733497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab1c0b7d90 0x7fab1c15fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.740+0000 7fab02ffd640 1 -- 172.21.15.6:0/1441733497 >> 172.21.15.6:0/1441733497 conn(0x7fab1c069f50 msgr2=0x7fab1c0d1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.740+0000 7fab02ffd640 1 -- 172.21.15.6:0/1441733497 shutdown_connections 2023-07-21T22:18:55.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.740+0000 7fab02ffd640 1 -- 172.21.15.6:0/1441733497 wait complete. 2023-07-21T22:18:55.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.740+0000 7f106a596640 1 -- 172.21.15.6:0/4147181068 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1050066300 msgr2=0x7f10500687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.740+0000 7f106a596640 1 --2- 172.21.15.6:0/4147181068 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1050066300 0x7f10500687b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f105401b830 tx=0x7f1054019040 comp rx=0 tx=0).stop 2023-07-21T22:18:55.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.740+0000 7f106a596640 1 -- 172.21.15.6:0/4147181068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10640c8940 msgr2=0x7f10640b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.740+0000 7f106a596640 1 --2- 172.21.15.6:0/4147181068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10640c8940 0x7f10640b2610 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f105800b550 tx=0x7f105800ba10 comp rx=0 tx=0).stop 2023-07-21T22:18:55.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.740+0000 7f85ee0f9640 1 -- 172.21.15.6:0/1719330852 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f85e80b5000 con 0x7f85e80b6840 2023-07-21T22:18:55.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.740+0000 7f106a596640 1 -- 172.21.15.6:0/4147181068 shutdown_connections 2023-07-21T22:18:55.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.740+0000 7f106a596640 1 --2- 172.21.15.6:0/4147181068 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1050066300 0x7f10500687b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.744+0000 7f106a596640 1 --2- 172.21.15.6:0/4147181068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1064160330 0x7f10640c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.744+0000 7f85cffff640 1 -- 172.21.15.6:0/1719330852 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f85e80b5000 con 0x7f85e80b6840 2023-07-21T22:18:55.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.744+0000 7ff4fb5db640 1 -- 172.21.15.6:0/1248849625 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff4f40cdb20 con 0x7ff4f406b440 2023-07-21T22:18:55.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.744+0000 7f106a596640 1 --2- 172.21.15.6:0/4147181068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10640c8940 0x7f10640b2610 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.744+0000 7f106a596640 1 --2- 172.21.15.6:0/4147181068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10640c0f80 0x7f10640b20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.744+0000 7f106a596640 1 -- 172.21.15.6:0/4147181068 >> 172.21.15.6:0/4147181068 conn(0x7f10640afcf0 msgr2=0x7f106406f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.744+0000 7f106a596640 1 -- 172.21.15.6:0/4147181068 shutdown_connections 2023-07-21T22:18:55.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.744+0000 7f106a596640 1 -- 172.21.15.6:0/4147181068 wait complete. 2023-07-21T22:18:55.793 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2023-07-21T22:18:55.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.744+0000 7ff4e9ffb640 1 -- 172.21.15.6:0/1248849625 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4f0053dc0 con 0x7ff4f406b440 2023-07-21T22:18:55.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.744+0000 7f85ee0f9640 1 -- 172.21.15.6:0/1719330852 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f85d40662d0 msgr2=0x7f85d4068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.748+0000 7f85ee0f9640 1 --2- 172.21.15.6:0/1719330852 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f85d40662d0 0x7f85d4068780 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f85e8070b30 tx=0x7f85d8008040 comp rx=0 tx=0).stop 2023-07-21T22:18:55.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.748+0000 7f85ee0f9640 1 -- 172.21.15.6:0/1719330852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85e80b6840 msgr2=0x7f85e81560c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.748+0000 7f85ee0f9640 1 --2- 172.21.15.6:0/1719330852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85e80b6840 0x7f85e81560c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00d4d0 tx=0x7f85dc00d5c0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.748+0000 7f76bdf63640 1 -- 172.21.15.6:0/384988299 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f76b80678d0 con 0x7f76b8160090 2023-07-21T22:18:55.795 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2023-07-21T22:18:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.748+0000 7f76b57fa640 1 -- 172.21.15.6:0/384988299 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f76b0004870 con 0x7f76b8160090 2023-07-21T22:18:55.795 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2023-07-21T22:18:55.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.748+0000 7f85ee0f9640 1 -- 172.21.15.6:0/1719330852 shutdown_connections 2023-07-21T22:18:55.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.748+0000 7f85ee0f9640 1 --2- 172.21.15.6:0/1719330852 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85e80b5c40 0x7f85e80b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.748+0000 7f85ee0f9640 1 --2- 172.21.15.6:0/1719330852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85e80b6840 0x7f85e81560c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.748+0000 7f85ee0f9640 1 --2- 172.21.15.6:0/1719330852 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f85d40662d0 0x7f85d4068780 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.748+0000 7f85ee0f9640 1 --2- 172.21.15.6:0/1719330852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85d0005250 0x7f85e80c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.748+0000 7f85ee0f9640 1 -- 172.21.15.6:0/1719330852 >> 172.21.15.6:0/1719330852 conn(0x7f85e8069e80 msgr2=0x7f85e80d20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.748+0000 7f85ee0f9640 1 -- 172.21.15.6:0/1719330852 shutdown_connections 2023-07-21T22:18:55.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.748+0000 7f85ee0f9640 1 -- 172.21.15.6:0/1719330852 wait complete. 2023-07-21T22:18:55.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.748+0000 7fa953fff640 1 -- 172.21.15.6:0/2961427246 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa954166240 con 0x7fa954166520 2023-07-21T22:18:55.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509448 for osd.0 2023-07-21T22:18:55.799 INFO:teuthology.orchestra.run.smithi006.stdout:64424509445 2023-07-21T22:18:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7fa93bfff640 1 -- 172.21.15.6:0/2961427246 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa954166240 con 0x7fa954166520 2023-07-21T22:18:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7ff4fb5db640 1 -- 172.21.15.6:0/1248849625 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff4d8066350 msgr2=0x7ff4d8068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7ff4fb5db640 1 --2- 172.21.15.6:0/1248849625 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff4d8066350 0x7ff4d8068800 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4157c20 tx=0x7ff4e4008040 comp rx=0 tx=0).stop 2023-07-21T22:18:55.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7ff4fb5db640 1 -- 172.21.15.6:0/1248849625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4f406b440 msgr2=0x7ff4f4158020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7ff4fb5db640 1 --2- 172.21.15.6:0/1248849625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4f406b440 0x7ff4f4158020 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000c500 tx=0x7ff4f000c9c0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7f76bdf63640 1 -- 172.21.15.6:0/384988299 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f76a4066350 msgr2=0x7f76a4068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7f76bdf63640 1 --2- 172.21.15.6:0/384988299 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f76a4066350 0x7f76a4068800 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f76ac000f70 tx=0x7f76ac007e30 comp rx=0 tx=0).stop 2023-07-21T22:18:55.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7f76bdf63640 1 -- 172.21.15.6:0/384988299 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76b8160090 msgr2=0x7f76b80ad790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7f76bdf63640 1 --2- 172.21.15.6:0/384988299 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76b8160090 0x7f76b80ad790 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f76b001cf50 tx=0x7f76b0019450 comp rx=0 tx=0).stop 2023-07-21T22:18:55.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7ff4fb5db640 1 -- 172.21.15.6:0/1248849625 shutdown_connections 2023-07-21T22:18:55.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7ff4fb5db640 1 --2- 172.21.15.6:0/1248849625 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff4d8066350 0x7ff4d8068800 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7ff4fb5db640 1 --2- 172.21.15.6:0/1248849625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4f415ff10 0x7ff4f40c1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7ff4fb5db640 1 --2- 172.21.15.6:0/1248849625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4f40cce60 0x7ff4f40c17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7ff4fb5db640 1 --2- 172.21.15.6:0/1248849625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4f406b440 0x7ff4f4158020 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7ff4fb5db640 1 -- 172.21.15.6:0/1248849625 >> 172.21.15.6:0/1248849625 conn(0x7ff4f40ce9d0 msgr2=0x7ff4f415e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7f76bdf63640 1 -- 172.21.15.6:0/384988299 shutdown_connections 2023-07-21T22:18:55.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7f76bdf63640 1 --2- 172.21.15.6:0/384988299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76b80adcd0 0x7f76b806c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7f76bdf63640 1 --2- 172.21.15.6:0/384988299 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76b8160090 0x7f76b80ad790 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7ff4fb5db640 1 -- 172.21.15.6:0/1248849625 shutdown_connections 2023-07-21T22:18:55.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7f76bdf63640 1 --2- 172.21.15.6:0/384988299 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f76a4066350 0x7f76a4068800 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7f76bdf63640 1 --2- 172.21.15.6:0/384988299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b80c8e90 0x7f76b81572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7f76bdf63640 1 -- 172.21.15.6:0/384988299 >> 172.21.15.6:0/384988299 conn(0x7f76b80cb540 msgr2=0x7f76b80ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7ff4fb5db640 1 -- 172.21.15.6:0/1248849625 wait complete. 2023-07-21T22:18:55.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7f76bdf63640 1 -- 172.21.15.6:0/384988299 shutdown_connections 2023-07-21T22:18:55.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7f76bdf63640 1 -- 172.21.15.6:0/384988299 wait complete. 2023-07-21T22:18:55.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7fa953fff640 1 -- 172.21.15.6:0/2961427246 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa940066280 msgr2=0x7fa940068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7fa953fff640 1 --2- 172.21.15.6:0/2961427246 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa940066280 0x7fa940068730 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa944001620 tx=0x7fa944009040 comp rx=0 tx=0).stop 2023-07-21T22:18:55.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7fa953fff640 1 -- 172.21.15.6:0/2961427246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa954166520 msgr2=0x7fa9541f7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.752+0000 7fa953fff640 1 --2- 172.21.15.6:0/2961427246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa954166520 0x7fa9541f7ff0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa94c003fd0 tx=0x7fa94c009c50 comp rx=0 tx=0).stop 2023-07-21T22:18:55.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.756+0000 7fa953fff640 1 -- 172.21.15.6:0/2961427246 shutdown_connections 2023-07-21T22:18:55.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.756+0000 7fa953fff640 1 --2- 172.21.15.6:0/2961427246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa954164ec0 0x7fa95406b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.756+0000 7fa953fff640 1 --2- 172.21.15.6:0/2961427246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa954166520 0x7fa9541f7ff0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.756+0000 7fa953fff640 1 --2- 172.21.15.6:0/2961427246 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa940066280 0x7fa940068730 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.756+0000 7fa953fff640 1 --2- 172.21.15.6:0/2961427246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa93c005180 0x7fa9540b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.756+0000 7fa953fff640 1 -- 172.21.15.6:0/2961427246 >> 172.21.15.6:0/2961427246 conn(0x7fa9540ca8b0 msgr2=0x7fa954162540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.756+0000 7fa953fff640 1 -- 172.21.15.6:0/2961427246 shutdown_connections 2023-07-21T22:18:55.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.756+0000 7fa953fff640 1 -- 172.21.15.6:0/2961427246 wait complete. 2023-07-21T22:18:55.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.764+0000 7f01815e6640 1 -- 172.21.15.6:0/2208393270 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f017c0b3d60 con 0x7f017c160150 2023-07-21T22:18:55.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.768+0000 7f0178ff9640 1 -- 172.21.15.6:0/2208393270 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f01700b8090 con 0x7f017c160150 2023-07-21T22:18:55.814 INFO:teuthology.orchestra.run.smithi006.stdout:64424509445 2023-07-21T22:18:55.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.772+0000 7f01815e6640 1 -- 172.21.15.6:0/2208393270 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0168066350 msgr2=0x7f0168068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.772+0000 7f01815e6640 1 --2- 172.21.15.6:0/2208393270 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0168066350 0x7f0168068800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f016c005890 tx=0x7f016c009040 comp rx=0 tx=0).stop 2023-07-21T22:18:55.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.772+0000 7f01815e6640 1 -- 172.21.15.6:0/2208393270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f017c160150 msgr2=0x7f017c15e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.772+0000 7f01815e6640 1 --2- 172.21.15.6:0/2208393270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f017c160150 0x7f017c15e7a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0170019000 tx=0x7f0170019190 comp rx=0 tx=0).stop 2023-07-21T22:18:55.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.772+0000 7f01815e6640 1 -- 172.21.15.6:0/2208393270 shutdown_connections 2023-07-21T22:18:55.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.772+0000 7f01815e6640 1 --2- 172.21.15.6:0/2208393270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f017c160520 0x7f017c06ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.772+0000 7f01815e6640 1 --2- 172.21.15.6:0/2208393270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f017c160150 0x7f017c15e7a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.772+0000 7f01815e6640 1 --2- 172.21.15.6:0/2208393270 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0168066350 0x7f0168068800 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.772+0000 7f01815e6640 1 --2- 172.21.15.6:0/2208393270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f017c070d30 0x7f017c0c2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.772+0000 7f01815e6640 1 -- 172.21.15.6:0/2208393270 >> 172.21.15.6:0/2208393270 conn(0x7f017c0cb4a0 msgr2=0x7f017c06fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.772+0000 7f01815e6640 1 -- 172.21.15.6:0/2208393270 shutdown_connections 2023-07-21T22:18:55.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:55.772+0000 7f01815e6640 1 -- 172.21.15.6:0/2208393270 wait complete. 2023-07-21T22:18:55.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509447 for osd.2 2023-07-21T22:18:55.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.6 2023-07-21T22:18:55.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509446 for osd.4 2023-07-21T22:18:55.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509446 for osd.1 2023-07-21T22:18:55.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.3 2023-07-21T22:18:55.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509446 for osd.7 2023-07-21T22:18:55.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.5 2023-07-21T22:18:56.800 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-21T22:18:56.830 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-21T22:18:56.834 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-21T22:18:56.835 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-21T22:18:56.842 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-21T22:18:56.843 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-21T22:18:56.843 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-21T22:18:56.847 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-21T22:18:57.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.980+0000 7f3963300640 1 Processor -- start 2023-07-21T22:18:57.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.980+0000 7f3963300640 1 -- start start 2023-07-21T22:18:57.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.984+0000 7f3963300640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f395c157990 0x7f395c0c8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.984+0000 7f3963300640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f395c0ca0b0 0x7f395c06aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.984+0000 7f3963300640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f395c158fb0 con 0x7f395c06b530 2023-07-21T22:18:57.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.984+0000 7f3963300640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f395c0cb6a0 con 0x7f395c157990 2023-07-21T22:18:57.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.984+0000 7f3963300640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f395c0ca550 con 0x7f395c0ca0b0 2023-07-21T22:18:57.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.984+0000 7f396089b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f395c0ca0b0 0x7f395c06aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.984+0000 7f396189d640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f395c06b530 0x7f395c15b630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:37354/0 (socket says 172.21.15.6:37354) 2023-07-21T22:18:57.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.984+0000 7f396089b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f395c0ca0b0 0x7f395c06aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:48120/0 (socket says 172.21.15.6:48120) 2023-07-21T22:18:57.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.984+0000 7f396089b640 1 -- 172.21.15.6:0/1747425660 learned_addr learned my addr 172.21.15.6:0/1747425660 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:57.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.984+0000 7f396109c640 1 --2- 172.21.15.6:0/1747425660 >> v2:172.21.15.6:3300/0 conn(0x7f395c157990 0x7f395c0c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.984+0000 7f396089b640 1 -- 172.21.15.6:0/1747425660 >> v2:172.21.15.6:3300/0 conn(0x7f395c157990 msgr2=0x7f395c0c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:57.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.984+0000 7f396089b640 1 --2- 172.21.15.6:0/1747425660 >> v2:172.21.15.6:3300/0 conn(0x7f395c157990 0x7f395c0c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.984+0000 7f396089b640 1 -- 172.21.15.6:0/1747425660 >> v1:172.21.15.161:6789/0 conn(0x7f395c06b530 legacy=0x7f395c15b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.984+0000 7f396089b640 1 -- 172.21.15.6:0/1747425660 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395c0cd650 con 0x7f395c0ca0b0 2023-07-21T22:18:57.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.984+0000 7f396109c640 1 --2- 172.21.15.6:0/1747425660 >> v2:172.21.15.6:3300/0 conn(0x7f395c157990 0x7f395c0c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:57.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.988+0000 7f396089b640 1 --2- 172.21.15.6:0/1747425660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f395c0ca0b0 0x7f395c06aff0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f395c06e720 tx=0x7f395401ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec588f3122e33bbb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.992+0000 7f3953fff640 1 -- 172.21.15.6:0/1747425660 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39540a7c50 con 0x7f395c0ca0b0 2023-07-21T22:18:57.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.992+0000 7f3953fff640 1 -- 172.21.15.6:0/1747425660 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39540ab070 con 0x7f395c0ca0b0 2023-07-21T22:18:57.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.992+0000 7f3963300640 1 -- 172.21.15.6:0/1747425660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f395c0ca0b0 msgr2=0x7f395c06aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.992+0000 7f3963300640 1 --2- 172.21.15.6:0/1747425660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f395c0ca0b0 0x7f395c06aff0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f395c06e720 tx=0x7f395401ebe0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.992+0000 7f3963300640 1 -- 172.21.15.6:0/1747425660 shutdown_connections 2023-07-21T22:18:57.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.992+0000 7f3963300640 1 --2- 172.21.15.6:0/1747425660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f395c0ca0b0 0x7f395c06aff0 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f395c06e720 tx=0x7f395401ebe0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.992+0000 7f3963300640 1 --2- 172.21.15.6:0/1747425660 >> v2:172.21.15.6:3300/0 conn(0x7f395c157990 0x7f395c0c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.992+0000 7f3963300640 1 -- 172.21.15.6:0/1747425660 >> 172.21.15.6:0/1747425660 conn(0x7f395c0ce980 msgr2=0x7f395c0ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:57.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.992+0000 7f3963300640 1 -- 172.21.15.6:0/1747425660 shutdown_connections 2023-07-21T22:18:57.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.992+0000 7f3963300640 1 -- 172.21.15.6:0/1747425660 wait complete. 2023-07-21T22:18:57.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.996+0000 7f3963300640 1 Processor -- start 2023-07-21T22:18:57.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:56.996+0000 7f3963300640 1 -- start start 2023-07-21T22:18:57.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f3963300640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f395c06b530 0x7f395c0c3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f3963300640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f395c157990 0x7f395c0c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f3963300640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f395c0c22e0 0x7f395c0c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f396109c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f395c06b530 0x7f395c0c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f396109c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f395c06b530 0x7f395c0c3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46996/0 (socket says 172.21.15.6:46996) 2023-07-21T22:18:57.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f3963300640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395c0c3d50 con 0x7f395c06b530 2023-07-21T22:18:57.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f3963300640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395c0c2770 con 0x7f395c0c22e0 2023-07-21T22:18:57.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f3963300640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f395c0c2a50 con 0x7f395c157990 2023-07-21T22:18:57.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f396089b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f395c157990 0x7f395c0c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f396089b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f395c157990 0x7f395c0c4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:58052/0 (socket says 172.21.15.6:58052) 2023-07-21T22:18:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f396089b640 1 -- 172.21.15.6:0/1712618874 learned_addr learned my addr 172.21.15.6:0/1712618874 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f396189d640 1 --2- 172.21.15.6:0/1712618874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f395c0c22e0 0x7f395c0c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f396089b640 1 -- 172.21.15.6:0/1712618874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f395c0c22e0 msgr2=0x7f395c0c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f396089b640 1 --2- 172.21.15.6:0/1712618874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f395c0c22e0 0x7f395c0c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f396089b640 1 -- 172.21.15.6:0/1712618874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f395c06b530 msgr2=0x7f395c0c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f396089b640 1 --2- 172.21.15.6:0/1712618874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f395c06b530 0x7f395c0c3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f396089b640 1 -- 172.21.15.6:0/1712618874 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f395400d050 con 0x7f395c157990 2023-07-21T22:18:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f396189d640 1 --2- 172.21.15.6:0/1712618874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f395c0c22e0 0x7f395c0c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f396109c640 1 --2- 172.21.15.6:0/1712618874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f395c06b530 0x7f395c0c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-07-21T22:18:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f396089b640 1 --2- 172.21.15.6:0/1712618874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f395c157990 0x7f395c0c4fe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f39540b3040 tx=0x7f395401d420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f3951ffb640 1 -- 172.21.15.6:0/1712618874 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39540bf070 con 0x7f395c157990 2023-07-21T22:18:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f3951ffb640 1 -- 172.21.15.6:0/1712618874 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39540ab040 con 0x7f395c157990 2023-07-21T22:18:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f3951ffb640 1 -- 172.21.15.6:0/1712618874 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39540ba7e0 con 0x7f395c157990 2023-07-21T22:18:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.000+0000 7f3963300640 1 -- 172.21.15.6:0/1712618874 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f395c0c2d30 con 0x7f395c157990 2023-07-21T22:18:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.004+0000 7f3963300640 1 -- 172.21.15.6:0/1712618874 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395c0c32f0 con 0x7f395c157990 2023-07-21T22:18:57.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.004+0000 7f3963300640 1 -- 172.21.15.6:0/1712618874 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393c005260 con 0x7f395c157990 2023-07-21T22:18:57.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.008+0000 7f3951ffb640 1 -- 172.21.15.6:0/1712618874 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f39540ba940 con 0x7f395c157990 2023-07-21T22:18:57.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.008+0000 7f3951ffb640 1 --2- 172.21.15.6:0/1712618874 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3940066350 0x7f3940068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.008+0000 7f3951ffb640 1 -- 172.21.15.6:0/1712618874 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f395411f950 con 0x7f395c157990 2023-07-21T22:18:57.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.012+0000 7f396109c640 1 --2- 172.21.15.6:0/1712618874 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3940066350 0x7f3940068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.012+0000 7f3951ffb640 1 -- 172.21.15.6:0/1712618874 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f39540ece40 con 0x7f395c157990 2023-07-21T22:18:57.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.012+0000 7f396109c640 1 --2- 172.21.15.6:0/1712618874 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3940066350 0x7f3940068800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f394c008930 tx=0x7f394c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.036+0000 7fc657fff640 1 Processor -- start 2023-07-21T22:18:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.036+0000 7fc657fff640 1 -- start start 2023-07-21T22:18:57.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.036+0000 7fc657fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc658069de0 0x7fc65815f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.036+0000 7fc657fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6580c8e70 0x7fc6580cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.036+0000 7fc657fff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc65806a1b0 con 0x7fc6580acd30 2023-07-21T22:18:57.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.036+0000 7fc657fff640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc658160950 con 0x7fc6580c8e70 2023-07-21T22:18:57.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.036+0000 7fc657fff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6580ad180 con 0x7fc658069de0 2023-07-21T22:18:57.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.036+0000 7fc656ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc658069de0 0x7fc65815f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.036+0000 7fc6577fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6580c8e70 0x7fc6580cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.036+0000 7fc656ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc658069de0 0x7fc65815f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:58062/0 (socket says 172.21.15.6:58062) 2023-07-21T22:18:57.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.036+0000 7fc656ffd640 1 -- 172.21.15.6:0/1167767343 learned_addr learned my addr 172.21.15.6:0/1167767343 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:57.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.036+0000 7fc6577fe640 1 --2- 172.21.15.6:0/1167767343 >> v2:172.21.15.6:3300/0 conn(0x7fc6580c8e70 0x7fc6580cc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47000/0 (socket says 172.21.15.6:47000) 2023-07-21T22:18:57.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.040+0000 7fc656ffd640 1 -- 172.21.15.6:0/1167767343 >> v2:172.21.15.6:3300/0 conn(0x7fc6580c8e70 msgr2=0x7fc6580cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:57.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.040+0000 7fc656ffd640 1 --2- 172.21.15.6:0/1167767343 >> v2:172.21.15.6:3300/0 conn(0x7fc6580c8e70 0x7fc6580cc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.040+0000 7fc656ffd640 1 -- 172.21.15.6:0/1167767343 >> v1:172.21.15.161:6789/0 conn(0x7fc6580acd30 legacy=0x7fc6580c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.040+0000 7fc656ffd640 1 -- 172.21.15.6:0/1167767343 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6581600b0 con 0x7fc658069de0 2023-07-21T22:18:57.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.040+0000 7fc6577fe640 1 --2- 172.21.15.6:0/1167767343 >> v2:172.21.15.6:3300/0 conn(0x7fc6580c8e70 0x7fc6580cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:57.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.044+0000 7fc656ffd640 1 --2- 172.21.15.6:0/1167767343 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc658069de0 0x7fc65815f9d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009870 tx=0x7fc64c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7245d921c64ee74a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.044+0000 7fc655ffb640 1 -- 172.21.15.6:0/1167767343 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c0ab680 con 0x7fc658069de0 2023-07-21T22:18:57.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.044+0000 7fc655ffb640 1 -- 172.21.15.6:0/1167767343 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c0ab7e0 con 0x7fc658069de0 2023-07-21T22:18:57.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.044+0000 7fc655ffb640 1 -- 172.21.15.6:0/1167767343 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c0abb70 con 0x7fc658069de0 2023-07-21T22:18:57.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.044+0000 7fc657fff640 1 -- 172.21.15.6:0/1167767343 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc658069de0 msgr2=0x7fc65815f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.044+0000 7fc657fff640 1 --2- 172.21.15.6:0/1167767343 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc658069de0 0x7fc65815f9d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009870 tx=0x7fc64c01c480 comp rx=0 tx=0).stop 2023-07-21T22:18:57.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.044+0000 7fc657fff640 1 -- 172.21.15.6:0/1167767343 shutdown_connections 2023-07-21T22:18:57.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.044+0000 7fc657fff640 1 --2- 172.21.15.6:0/1167767343 >> v2:172.21.15.6:3300/0 conn(0x7fc6580c8e70 0x7fc6580cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.044+0000 7fc657fff640 1 --2- 172.21.15.6:0/1167767343 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc658069de0 0x7fc65815f9d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.044+0000 7fc657fff640 1 -- 172.21.15.6:0/1167767343 >> 172.21.15.6:0/1167767343 conn(0x7fc6580cdde0 msgr2=0x7fc6580ce1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:57.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.044+0000 7fc657fff640 1 -- 172.21.15.6:0/1167767343 shutdown_connections 2023-07-21T22:18:57.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.044+0000 7fc657fff640 1 -- 172.21.15.6:0/1167767343 wait complete. 2023-07-21T22:18:57.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.048+0000 7fc657fff640 1 Processor -- start 2023-07-21T22:18:57.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.048+0000 7fc657fff640 1 -- start start 2023-07-21T22:18:57.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.048+0000 7f53b1bfa640 1 Processor -- start 2023-07-21T22:18:57.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.048+0000 7f53b1bfa640 1 -- start start 2023-07-21T22:18:57.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc657fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc658069de0 0x7fc6580b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc657fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6580acd30 0x7fc6581f7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc657fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6580c8e70 0x7fc658155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc657fff640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6580b1bf0 con 0x7fc658069de0 2023-07-21T22:18:57.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc657fff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc658155900 con 0x7fc6580c8e70 2023-07-21T22:18:57.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc657fff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6581f7c70 con 0x7fc6580acd30 2023-07-21T22:18:57.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc656ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc658069de0 0x7fc6580b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc656ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc658069de0 0x7fc6580b16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47010/0 (socket says 172.21.15.6:47010) 2023-07-21T22:18:57.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc656ffd640 1 -- 172.21.15.6:0/2410063025 learned_addr learned my addr 172.21.15.6:0/2410063025 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:57.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc6567fc640 1 --2- 172.21.15.6:0/2410063025 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6580acd30 0x7fc6581f7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc6577fe640 1 --2- 172.21.15.6:0/2410063025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6580c8e70 0x7fc658155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc6567fc640 1 -- 172.21.15.6:0/2410063025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6580c8e70 msgr2=0x7fc658155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc6567fc640 1 --2- 172.21.15.6:0/2410063025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6580c8e70 0x7fc658155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc6567fc640 1 -- 172.21.15.6:0/2410063025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc658069de0 msgr2=0x7fc6580b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc6567fc640 1 --2- 172.21.15.6:0/2410063025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc658069de0 0x7fc6580b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc6567fc640 1 -- 172.21.15.6:0/2410063025 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc648009420 con 0x7fc6580acd30 2023-07-21T22:18:57.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7f53b1bfa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53ac15bc30 0x7f53ac0cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7f53b1bfa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53ac069b40 0x7f53ac0c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7f53b1bfa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53ac06baa0 con 0x7f53ac0cb280 2023-07-21T22:18:57.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7f53b1bfa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53ac06c060 con 0x7f53ac069b40 2023-07-21T22:18:57.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7f53b1bfa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac06bd80 con 0x7f53ac15bc30 2023-07-21T22:18:57.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7f53ab7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53ac15bc30 0x7f53ac0cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7f53ab7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53ac15bc30 0x7f53ac0cd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:58084/0 (socket says 172.21.15.6:58084) 2023-07-21T22:18:57.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7f53ab7fe640 1 -- 172.21.15.6:0/2131632765 learned_addr learned my addr 172.21.15.6:0/2131632765 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:57.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7f53abfff640 1 --2- 172.21.15.6:0/2131632765 >> v2:172.21.15.6:3300/0 conn(0x7f53ac069b40 0x7f53ac0c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc6567fc640 1 --2- 172.21.15.6:0/2410063025 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6580acd30 0x7fc6581f7730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc65000c7a0 tx=0x7fc65000cba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc63f7fe640 1 -- 172.21.15.6:0/2410063025 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc650003b80 con 0x7fc6580acd30 2023-07-21T22:18:57.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc63f7fe640 1 -- 172.21.15.6:0/2410063025 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc650003ce0 con 0x7fc6580acd30 2023-07-21T22:18:57.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc63f7fe640 1 -- 172.21.15.6:0/2410063025 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc650005310 con 0x7fc6580acd30 2023-07-21T22:18:57.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc657fff640 1 -- 172.21.15.6:0/2410063025 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c0094d0 con 0x7fc6580acd30 2023-07-21T22:18:57.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7fc657fff640 1 -- 172.21.15.6:0/2410063025 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6581f81b0 con 0x7fc6580acd30 2023-07-21T22:18:57.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7f53ab7fe640 1 -- 172.21.15.6:0/2131632765 >> v2:172.21.15.6:3300/0 conn(0x7f53ac069b40 msgr2=0x7f53ac0c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:57.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7f53ab7fe640 1 --2- 172.21.15.6:0/2131632765 >> v2:172.21.15.6:3300/0 conn(0x7f53ac069b40 0x7f53ac0c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7f53ab7fe640 1 -- 172.21.15.6:0/2131632765 >> v1:172.21.15.161:6789/0 conn(0x7f53ac0cb280 legacy=0x7f53ac069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.052+0000 7f53ab7fe640 1 -- 172.21.15.6:0/2131632765 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac0c8430 con 0x7f53ac15bc30 2023-07-21T22:18:57.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.056+0000 7fc63f7fe640 1 -- 172.21.15.6:0/2410063025 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc650005470 con 0x7fc6580acd30 2023-07-21T22:18:57.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.060+0000 7f53ab7fe640 1 --2- 172.21.15.6:0/2131632765 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53ac15bc30 0x7f53ac0cd3b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f539c014420 tx=0x7f539c024fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79728c5fb8f37892 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.060+0000 7fc63f7fe640 1 --2- 172.21.15.6:0/2410063025 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc6400664b0 0x7fc640068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.060+0000 7fc63f7fe640 1 -- 172.21.15.6:0/2410063025 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc6500839c0 con 0x7fc6580acd30 2023-07-21T22:18:57.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.060+0000 7fc657fff640 1 -- 172.21.15.6:0/2410063025 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc638005260 con 0x7fc6580acd30 2023-07-21T22:18:57.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.060+0000 7f53aa7fc640 1 -- 172.21.15.6:0/2131632765 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c0ad880 con 0x7f53ac15bc30 2023-07-21T22:18:57.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.060+0000 7f53aa7fc640 1 -- 172.21.15.6:0/2131632765 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539c0ad9e0 con 0x7f53ac15bc30 2023-07-21T22:18:57.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.060+0000 7f53aa7fc640 1 -- 172.21.15.6:0/2131632765 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c0add70 con 0x7f53ac15bc30 2023-07-21T22:18:57.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.060+0000 7fc656ffd640 1 --2- 172.21.15.6:0/2410063025 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc6400664b0 0x7fc640068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.060+0000 7f53b1bfa640 1 -- 172.21.15.6:0/2131632765 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53ac15bc30 msgr2=0x7f53ac0cd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.060+0000 7f53b1bfa640 1 --2- 172.21.15.6:0/2131632765 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53ac15bc30 0x7f53ac0cd3b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f539c014420 tx=0x7f539c024fe0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.060+0000 7f53b1bfa640 1 -- 172.21.15.6:0/2131632765 shutdown_connections 2023-07-21T22:18:57.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.060+0000 7f53b1bfa640 1 --2- 172.21.15.6:0/2131632765 >> v2:172.21.15.6:3300/0 conn(0x7f53ac069b40 0x7f53ac0c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.060+0000 7f53b1bfa640 1 --2- 172.21.15.6:0/2131632765 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53ac15bc30 0x7f53ac0cd3b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.060+0000 7f53b1bfa640 1 -- 172.21.15.6:0/2131632765 >> 172.21.15.6:0/2131632765 conn(0x7f53ac0ce980 msgr2=0x7f53ac0ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:57.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.060+0000 7fc656ffd640 1 --2- 172.21.15.6:0/2410063025 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc6400664b0 0x7fc640068960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc64c01c4c0 tx=0x7fc64c0b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.060+0000 7f53b1bfa640 1 -- 172.21.15.6:0/2131632765 shutdown_connections 2023-07-21T22:18:57.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.060+0000 7f53b1bfa640 1 -- 172.21.15.6:0/2131632765 wait complete. 2023-07-21T22:18:57.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.060+0000 7f1aa51d2640 1 Processor -- start 2023-07-21T22:18:57.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.060+0000 7f1aa51d2640 1 -- start start 2023-07-21T22:18:57.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f1aa51d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa00b7c70 0x7f1aa00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f1aa51d2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1aa00d1850 0x7f1aa015f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f1aa51d2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1aa00d1300 0x7f1aa015fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f1aa51d2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa00d1190 con 0x7f1aa00d1850 2023-07-21T22:18:57.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f1aa51d2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa0160600 con 0x7f1aa00d1300 2023-07-21T22:18:57.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f1aa51d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa01600d0 con 0x7f1aa00b7c70 2023-07-21T22:18:57.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f1a9e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1aa00d1850 0x7f1aa015f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f1a9f59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1aa00d1300 0x7f1aa015fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f1a9e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1aa00d1850 0x7f1aa015f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47030/0 (socket says 172.21.15.6:47030) 2023-07-21T22:18:57.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f1a9e59c640 1 -- 172.21.15.6:0/3513639481 learned_addr learned my addr 172.21.15.6:0/3513639481 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:57.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f1a9ed9d640 1 --2- 172.21.15.6:0/3513639481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa00b7c70 0x7f1aa00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f53b1bfa640 1 Processor -- start 2023-07-21T22:18:57.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f1a9f59e640 1 -- 172.21.15.6:0/3513639481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa00b7c70 msgr2=0x7f1aa00d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:57.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f1a9f59e640 1 --2- 172.21.15.6:0/3513639481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa00b7c70 0x7f1aa00d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f1a9f59e640 1 -- 172.21.15.6:0/3513639481 >> v2:172.21.15.6:3300/0 conn(0x7f1aa00d1850 msgr2=0x7f1aa015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:57.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f1a9f59e640 1 --2- 172.21.15.6:0/3513639481 >> v2:172.21.15.6:3300/0 conn(0x7f1aa00d1850 0x7f1aa015f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f1a9f59e640 1 -- 172.21.15.6:0/3513639481 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa00ccaf0 con 0x7f1aa00d1300 2023-07-21T22:18:57.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f53b1bfa640 1 -- start start 2023-07-21T22:18:57.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7fc63f7fe640 1 -- 172.21.15.6:0/2410063025 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc650050e20 con 0x7fc6580acd30 2023-07-21T22:18:57.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f53b1bfa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53ac069b40 0x7f53ac15b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f53b1bfa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53ac0cb280 0x7f53ac14e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f53b1bfa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53ac15ca20 0x7f53ac15dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f53b1bfa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac0b2080 con 0x7f53ac0cb280 2023-07-21T22:18:57.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f53b1bfa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac159860 con 0x7f53ac15ca20 2023-07-21T22:18:57.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f53b1bfa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac0c5620 con 0x7f53ac069b40 2023-07-21T22:18:57.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f53ab7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53ac069b40 0x7f53ac15b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f53ab7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53ac069b40 0x7f53ac15b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:58098/0 (socket says 172.21.15.6:58098) 2023-07-21T22:18:57.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f53ab7fe640 1 -- 172.21.15.6:0/4101859764 learned_addr learned my addr 172.21.15.6:0/4101859764 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:57.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f53aaffd640 1 --2- 172.21.15.6:0/4101859764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53ac0cb280 0x7f53ac14e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f53abfff640 1 --2- 172.21.15.6:0/4101859764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53ac15ca20 0x7f53ac15dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f53ab7fe640 1 -- 172.21.15.6:0/4101859764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53ac15ca20 msgr2=0x7f53ac15dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f53ab7fe640 1 --2- 172.21.15.6:0/4101859764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53ac15ca20 0x7f53ac15dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.064+0000 7f53ab7fe640 1 -- 172.21.15.6:0/4101859764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53ac0cb280 msgr2=0x7f53ac14e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f53ab7fe640 1 --2- 172.21.15.6:0/4101859764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53ac0cb280 0x7f53ac14e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f53ab7fe640 1 -- 172.21.15.6:0/4101859764 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c00fd10 con 0x7f53ac069b40 2023-07-21T22:18:57.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f53aaffd640 1 --2- 172.21.15.6:0/4101859764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53ac0cb280 0x7f53ac14e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:57.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f53abfff640 1 --2- 172.21.15.6:0/4101859764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53ac15ca20 0x7f53ac15dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:57.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7ffaff618640 1 Processor -- start 2023-07-21T22:18:57.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f53ab7fe640 1 --2- 172.21.15.6:0/4101859764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53ac069b40 0x7f53ac15b1f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f539c023690 tx=0x7f539c0220a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7ffaff618640 1 -- start start 2023-07-21T22:18:57.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f5393fff640 1 -- 172.21.15.6:0/4101859764 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c0b68e0 con 0x7f53ac069b40 2023-07-21T22:18:57.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f5393fff640 1 -- 172.21.15.6:0/4101859764 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539c0b6a60 con 0x7f53ac069b40 2023-07-21T22:18:57.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f5393fff640 1 -- 172.21.15.6:0/4101859764 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c0b6e10 con 0x7f53ac069b40 2023-07-21T22:18:57.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f53b1bfa640 1 -- 172.21.15.6:0/4101859764 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ac15cf20 con 0x7f53ac069b40 2023-07-21T22:18:57.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f53b1bfa640 1 -- 172.21.15.6:0/4101859764 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ac0b1ca0 con 0x7f53ac069b40 2023-07-21T22:18:57.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f1a9f59e640 1 --2- 172.21.15.6:0/3513639481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1aa00d1300 0x7f1aa015fb90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0069e40 tx=0x7f1a9801c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=392853402842d013 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f1a9dd9b640 1 -- 172.21.15.6:0/3513639481 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a980a5870 con 0x7f1aa00d1300 2023-07-21T22:18:57.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f1a9dd9b640 1 -- 172.21.15.6:0/3513639481 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a980a59d0 con 0x7f1aa00d1300 2023-07-21T22:18:57.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7ffaff618640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ffaf80cf1c0 0x7ffaf80ce400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7ffaff618640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf80cc720 con 0x7ffaf80b46f0 2023-07-21T22:18:57.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7ffaff618640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf80d0140 con 0x7ffaf815baf0 2023-07-21T22:18:57.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7ffaff618640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf80b4b70 con 0x7ffaf80cf1c0 2023-07-21T22:18:57.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f1aa51d2640 1 -- 172.21.15.6:0/3513639481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1aa00d1300 msgr2=0x7f1aa015fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f1a9dd9b640 1 -- 172.21.15.6:0/3513639481 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a980a5870 con 0x7f1aa00d1300 2023-07-21T22:18:57.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f1aa51d2640 1 --2- 172.21.15.6:0/3513639481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1aa00d1300 0x7f1aa015fb90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0069e40 tx=0x7f1a9801c900 comp rx=0 tx=0).stop 2023-07-21T22:18:57.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7ffafdbb5640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ffaf80b46f0 0x7ffaf80d05d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54224/0 (socket says 172.21.15.6:54224) 2023-07-21T22:18:57.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7ffafdbb5640 1 -- 172.21.15.6:0/3130049849 learned_addr learned my addr 172.21.15.6:0/3130049849 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:57.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7ffafcbb3640 1 --2- 172.21.15.6:0/3130049849 >> v2:172.21.15.161:3300/0 conn(0x7ffaf80cf1c0 0x7ffaf80ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f1aa51d2640 1 -- 172.21.15.6:0/3513639481 shutdown_connections 2023-07-21T22:18:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f1aa51d2640 1 --2- 172.21.15.6:0/3513639481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1aa00d1300 0x7f1aa015fb90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f1aa51d2640 1 --2- 172.21.15.6:0/3513639481 >> v2:172.21.15.6:3300/0 conn(0x7f1aa00d1850 0x7f1aa015f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f1aa51d2640 1 --2- 172.21.15.6:0/3513639481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa00b7c70 0x7f1aa00d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f1aa51d2640 1 -- 172.21.15.6:0/3513639481 >> 172.21.15.6:0/3513639481 conn(0x7f1aa00650b0 msgr2=0x7f1aa00654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:57.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7f1aa51d2640 1 -- 172.21.15.6:0/3513639481 shutdown_connections 2023-07-21T22:18:57.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7ffaeffff640 1 -- 172.21.15.6:0/3130049849 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066814845 0 0) 0x7ffaf80cc720 con 0x7ffaf80b46f0 2023-07-21T22:18:57.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7ffaeffff640 1 -- 172.21.15.6:0/3130049849 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffae4003530 con 0x7ffaf80b46f0 2023-07-21T22:18:57.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7ffafcbb3640 1 -- 172.21.15.6:0/3130049849 >> v1:172.21.15.161:6789/0 conn(0x7ffaf815baf0 legacy=0x7ffaf80ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:57.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7ffafcbb3640 1 -- 172.21.15.6:0/3130049849 >> v1:172.21.15.6:6789/0 conn(0x7ffaf80b46f0 legacy=0x7ffaf80d05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.068+0000 7ffafcbb3640 1 -- 172.21.15.6:0/3130049849 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf80cc970 con 0x7ffaf80cf1c0 2023-07-21T22:18:57.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.072+0000 7f1aa51d2640 1 -- 172.21.15.6:0/3513639481 wait complete. 2023-07-21T22:18:57.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.072+0000 7f5391ffb640 1 -- 172.21.15.6:0/4101859764 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ac0b21c0 con 0x7f53ac069b40 2023-07-21T22:18:57.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.072+0000 7f1aa51d2640 1 Processor -- start 2023-07-21T22:18:57.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.072+0000 7f1aa51d2640 1 -- start start 2023-07-21T22:18:57.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.072+0000 7f5393fff640 1 -- 172.21.15.6:0/4101859764 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f539c0bc050 con 0x7f53ac069b40 2023-07-21T22:18:57.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.072+0000 7f5393fff640 1 --2- 172.21.15.6:0/4101859764 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5398066350 0x7f5398068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.072+0000 7f5393fff640 1 -- 172.21.15.6:0/4101859764 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f539c126d80 con 0x7f53ac069b40 2023-07-21T22:18:57.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f53aaffd640 1 --2- 172.21.15.6:0/4101859764 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5398066350 0x7f5398068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f4356d05640 1 Processor -- start 2023-07-21T22:18:57.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7fa874ad5640 1 Processor -- start 2023-07-21T22:18:57.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7ffafcbb3640 1 --2- 172.21.15.6:0/3130049849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaf80cf1c0 0x7ffaf80ce400 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffae80097c0 tx=0x7ffae801c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afe687fcd03c87c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f4356d05640 1 -- start start 2023-07-21T22:18:57.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7fa874ad5640 1 -- start start 2023-07-21T22:18:57.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f53aaffd640 1 --2- 172.21.15.6:0/4101859764 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5398066350 0x7f5398068800 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f53a0000c10 tx=0x7f53a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f1aa51d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa00b7c70 0x7f1aa00cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f1aa51d2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1aa00d1300 0x7f1aa015e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f1aa51d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa00d1850 0x7f1aa015e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7ffaeffff640 1 -- 172.21.15.6:0/3130049849 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae80ad680 con 0x7ffaf80cf1c0 2023-07-21T22:18:57.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7ffaeffff640 1 -- 172.21.15.6:0/3130049849 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae80ad7e0 con 0x7ffaf80cf1c0 2023-07-21T22:18:57.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7ffaeffff640 1 -- 172.21.15.6:0/3130049849 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae80adb70 con 0x7ffaf80cf1c0 2023-07-21T22:18:57.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f1aa51d2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa00c6620 con 0x7f1aa00b7c70 2023-07-21T22:18:57.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f1aa51d2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa0157e30 con 0x7f1aa00d1300 2023-07-21T22:18:57.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f1aa51d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa0157870 con 0x7f1aa00d1850 2023-07-21T22:18:57.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f1a9e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1aa00d1300 0x7f1aa015e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f1a9e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1aa00d1300 0x7f1aa015e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:48188/0 (socket says 172.21.15.6:48188) 2023-07-21T22:18:57.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f1a9e59c640 1 -- 172.21.15.6:0/719784597 learned_addr learned my addr 172.21.15.6:0/719784597 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:57.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f1a9f59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa00d1850 0x7f1aa015e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7ffaff618640 1 -- 172.21.15.6:0/3130049849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaf80cf1c0 msgr2=0x7ffaf80ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7ffaff618640 1 --2- 172.21.15.6:0/3130049849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaf80cf1c0 0x7ffaf80ce400 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffae80097c0 tx=0x7ffae801c380 comp rx=0 tx=0).stop 2023-07-21T22:18:57.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f1a9ed9d640 1 --2- 172.21.15.6:0/719784597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa00b7c70 0x7f1aa00cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7ffaff618640 1 -- 172.21.15.6:0/3130049849 shutdown_connections 2023-07-21T22:18:57.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7ffaff618640 1 --2- 172.21.15.6:0/3130049849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaf80cf1c0 0x7ffaf80ce400 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7ffaff618640 1 -- 172.21.15.6:0/3130049849 >> 172.21.15.6:0/3130049849 conn(0x7ffaf80b3be0 msgr2=0x7ffaf80b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:57.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7ffaff618640 1 -- 172.21.15.6:0/3130049849 shutdown_connections 2023-07-21T22:18:57.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f4356d05640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43500c8e70 0x7f435015f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f4356d05640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435006a1b0 con 0x7f4350069de0 2023-07-21T22:18:57.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f4356d05640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43501600b0 con 0x7f43500acd30 2023-07-21T22:18:57.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f4356d05640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4350160950 con 0x7f43500c8e70 2023-07-21T22:18:57.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f4355502640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43500c8e70 0x7f435015f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f4355d03640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4350069de0 0x7f43500c8760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54240/0 (socket says 172.21.15.6:54240) 2023-07-21T22:18:57.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f4355d03640 1 -- 172.21.15.6:0/1124734863 learned_addr learned my addr 172.21.15.6:0/1124734863 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f5393fff640 1 -- 172.21.15.6:0/4101859764 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f539c0f4270 con 0x7f53ac069b40 2023-07-21T22:18:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f1a9e59c640 1 -- 172.21.15.6:0/719784597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa00d1850 msgr2=0x7f1aa015e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f1a9e59c640 1 --2- 172.21.15.6:0/719784597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa00d1850 0x7f1aa015e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f1a9e59c640 1 -- 172.21.15.6:0/719784597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa00b7c70 msgr2=0x7f1aa00cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f1a9e59c640 1 --2- 172.21.15.6:0/719784597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa00b7c70 0x7f1aa00cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7f1a9e59c640 1 -- 172.21.15.6:0/719784597 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a98009a70 con 0x7f1aa00d1300 2023-07-21T22:18:57.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f1a9e59c640 1 --2- 172.21.15.6:0/719784597 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1aa00d1300 0x7f1aa015e290 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400e7f0 tx=0x7f1a9400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4354d01640 1 -- 172.21.15.6:0/1124734863 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807235871 0 0) 0x7f43501600b0 con 0x7f43500acd30 2023-07-21T22:18:57.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4354d01640 1 -- 172.21.15.6:0/1124734863 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f433c003530 con 0x7f43500acd30 2023-07-21T22:18:57.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4354d01640 1 -- 172.21.15.6:0/1124734863 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644602138 0 0) 0x7f435006a1b0 con 0x7f4350069de0 2023-07-21T22:18:57.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4354d01640 1 -- 172.21.15.6:0/1124734863 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43501600b0 con 0x7f4350069de0 2023-07-21T22:18:57.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7fa874ad5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa8680e6c10 0x7fa868052ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7fa874ad5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa868033860 0x7fa86804f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7fa874ad5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8680544d0 con 0x7fa868006bb0 2023-07-21T22:18:57.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7fa874ad5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8680e6fe0 con 0x7fa868033860 2023-07-21T22:18:57.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.076+0000 7fa874ad5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa868006780 con 0x7fa8680e6c10 2023-07-21T22:18:57.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7fa86effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa868033860 0x7fa86804f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7fa86effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa868033860 0x7fa86804f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47068/0 (socket says 172.21.15.6:47068) 2023-07-21T22:18:57.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7fa86effd640 1 -- 172.21.15.6:0/2805872564 learned_addr learned my addr 172.21.15.6:0/2805872564 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:57.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f1a877fe640 1 -- 172.21.15.6:0/719784597 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9400c940 con 0x7f1aa00d1300 2023-07-21T22:18:57.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f1a877fe640 1 -- 172.21.15.6:0/719784597 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9400caa0 con 0x7f1aa00d1300 2023-07-21T22:18:57.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f1a877fe640 1 -- 172.21.15.6:0/719784597 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9400ce30 con 0x7f1aa00d1300 2023-07-21T22:18:57.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f1aa51d2640 1 -- 172.21.15.6:0/719784597 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa0157b50 con 0x7f1aa00d1300 2023-07-21T22:18:57.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f1aa51d2640 1 -- 172.21.15.6:0/719784597 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa015c470 con 0x7f1aa00d1300 2023-07-21T22:18:57.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7ffaff618640 1 -- 172.21.15.6:0/3130049849 wait complete. 2023-07-21T22:18:57.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4354d01640 1 -- 172.21.15.6:0/1124734863 <== mon.1 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2083507593 0 0) 0x7f433c003530 con 0x7f43500acd30 2023-07-21T22:18:57.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4354d01640 1 -- 172.21.15.6:0/1124734863 >> v2:172.21.15.6:3300/0 conn(0x7f43500c8e70 msgr2=0x7f435015f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:57.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4354d01640 1 --2- 172.21.15.6:0/1124734863 >> v2:172.21.15.6:3300/0 conn(0x7f43500c8e70 0x7f435015f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4354d01640 1 -- 172.21.15.6:0/1124734863 >> v1:172.21.15.6:6789/0 conn(0x7f4350069de0 legacy=0x7f43500c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4354d01640 1 -- 172.21.15.6:0/1124734863 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4350160390 con 0x7f43500acd30 2023-07-21T22:18:57.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4354d01640 1 -- 172.21.15.6:0/1124734863 <== mon.1 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f434c001680 con 0x7f43500acd30 2023-07-21T22:18:57.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4354d01640 1 -- 172.21.15.6:0/1124734863 >> v1:172.21.15.161:6789/0 conn(0x7f43500acd30 legacy=0x7f43500cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4354d01640 1 --2- 172.21.15.6:0/1124734863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f433c003b10 0x7f433c003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4354d01640 1 --2- 172.21.15.6:0/1124734863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f433c0047d0 0x7f433c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4354d01640 1 --2- 172.21.15.6:0/1124734863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f433c005180 0x7f433c0141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4354d01640 1 -- 172.21.15.6:0/1124734863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4350160950 con 0x7f433c0047d0 2023-07-21T22:18:57.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4354d01640 1 -- 172.21.15.6:0/1124734863 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c014870 con 0x7f433c005180 2023-07-21T22:18:57.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4354d01640 1 -- 172.21.15.6:0/1124734863 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433c014a30 con 0x7f433c003b10 2023-07-21T22:18:57.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4355d03640 1 --2- 172.21.15.6:0/1124734863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f433c003b10 0x7f433c003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4356504640 1 --2- 172.21.15.6:0/1124734863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f433c005180 0x7f433c0141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4355d03640 1 -- 172.21.15.6:0/1124734863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f433c005180 msgr2=0x7f433c0141a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:57.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4355d03640 1 --2- 172.21.15.6:0/1124734863 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f433c005180 0x7f433c0141a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4355d03640 1 -- 172.21.15.6:0/1124734863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f433c0047d0 msgr2=0x7f433c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4355d03640 1 --2- 172.21.15.6:0/1124734863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f433c0047d0 0x7f433c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4355d03640 1 -- 172.21.15.6:0/1124734863 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4350160390 con 0x7f433c003b10 2023-07-21T22:18:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f4356504640 1 -- 172.21.15.6:0/1124734863 reap_dead start 2023-07-21T22:18:57.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7fa86f7fe640 1 --2- 172.21.15.6:0/2805872564 >> v2:172.21.15.161:3300/0 conn(0x7fa8680e6c10 0x7fa868052ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7ffaff618640 1 Processor -- start 2023-07-21T22:18:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7ffaff618640 1 -- start start 2023-07-21T22:18:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7fa86effd640 1 -- 172.21.15.6:0/2805872564 >> v2:172.21.15.161:3300/0 conn(0x7fa8680e6c10 msgr2=0x7fa868052ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:57.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7fa86effd640 1 --2- 172.21.15.6:0/2805872564 >> v2:172.21.15.161:3300/0 conn(0x7fa8680e6c10 0x7fa868052ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7fa86effd640 1 -- 172.21.15.6:0/2805872564 >> v1:172.21.15.6:6789/0 conn(0x7fa868006bb0 legacy=0x7fa868036530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7fa86effd640 1 -- 172.21.15.6:0/2805872564 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8680547b0 con 0x7fa868033860 2023-07-21T22:18:57.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.084+0000 7ffaff618640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaf80b46f0 0x7ffaf815c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.084+0000 7ffaff618640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf80cf1c0 0x7ffaf815ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.084+0000 7ffafd3b4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaf80b46f0 0x7ffaf815c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.084+0000 7ffafd3b4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaf80b46f0 0x7ffaf815c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:48220/0 (socket says 172.21.15.6:48220) 2023-07-21T22:18:57.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.084+0000 7ffafcbb3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf80cf1c0 0x7ffaf815ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.084+0000 7ffafcbb3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf80cf1c0 0x7ffaf815ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47098/0 (socket says 172.21.15.6:47098) 2023-07-21T22:18:57.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.084+0000 7ffafd3b4640 1 -- 172.21.15.6:0/2852935377 learned_addr learned my addr 172.21.15.6:0/2852935377 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:57.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.084+0000 7ffaff618640 1 --2- 172.21.15.6:0/2852935377 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffaf815baf0 0x7ffaf80c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.084+0000 7ffaff618640 1 -- 172.21.15.6:0/2852935377 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf815d380 con 0x7ffaf80cf1c0 2023-07-21T22:18:57.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.084+0000 7ffaff618640 1 -- 172.21.15.6:0/2852935377 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf815d5b0 con 0x7ffaf80b46f0 2023-07-21T22:18:57.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.084+0000 7ffafdbb5640 1 --2- 172.21.15.6:0/2852935377 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffaf815baf0 0x7ffaf80c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.084+0000 7f4355d03640 1 --2- 172.21.15.6:0/1124734863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f433c003b10 0x7f433c003ee0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f434800c260 tx=0x7f434801cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c5ae3cb14d9da3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.084+0000 7ffaff618640 1 -- 172.21.15.6:0/2852935377 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf815d890 con 0x7ffaf815baf0 2023-07-21T22:18:57.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.084+0000 7fa86effd640 1 --2- 172.21.15.6:0/2805872564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa868033860 0x7fa86804f070 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa868037460 tx=0x7fa86001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2c996e036d736 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.084+0000 7f4354d01640 1 -- 172.21.15.6:0/1124734863 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43480a57c0 con 0x7f433c003b10 2023-07-21T22:18:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.080+0000 7f1aa51d2640 1 -- 172.21.15.6:0/719784597 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa00678d0 con 0x7f1aa00d1300 2023-07-21T22:18:57.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.084+0000 7f1a877fe640 1 -- 172.21.15.6:0/719784597 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1a94013470 con 0x7f1aa00d1300 2023-07-21T22:18:57.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.084+0000 7f1a877fe640 1 --2- 172.21.15.6:0/719784597 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1a8c066350 0x7f1a8c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.084+0000 7f1a877fe640 1 -- 172.21.15.6:0/719784597 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a94083d00 con 0x7f1aa00d1300 2023-07-21T22:18:57.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7f1a9ed9d640 1 --2- 172.21.15.6:0/719784597 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1a8c066350 0x7f1a8c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7fa86e7fc640 1 -- 172.21.15.6:0/2805872564 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8600ab5f0 con 0x7fa868033860 2023-07-21T22:18:57.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7fa86e7fc640 1 -- 172.21.15.6:0/2805872564 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8600ab750 con 0x7fa868033860 2023-07-21T22:18:57.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7ffafd3b4640 1 -- 172.21.15.6:0/2852935377 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffaf815baf0 msgr2=0x7ffaf80c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7ffafd3b4640 1 --2- 172.21.15.6:0/2852935377 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffaf815baf0 0x7ffaf80c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7ffafd3b4640 1 -- 172.21.15.6:0/2852935377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf80cf1c0 msgr2=0x7ffaf815ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7ffafd3b4640 1 --2- 172.21.15.6:0/2852935377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf80cf1c0 0x7ffaf815ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7ffafd3b4640 1 -- 172.21.15.6:0/2852935377 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae8009420 con 0x7ffaf80b46f0 2023-07-21T22:18:57.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7ffafd3b4640 1 --2- 172.21.15.6:0/2852935377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaf80b46f0 0x7ffaf815c900 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000bdc0 tx=0x7ffaf0009f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7fa86e7fc640 1 -- 172.21.15.6:0/2805872564 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8600ab5f0 con 0x7fa868033860 2023-07-21T22:18:57.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.084+0000 7f4354d01640 1 -- 172.21.15.6:0/1124734863 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43480a5940 con 0x7f433c003b10 2023-07-21T22:18:57.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.084+0000 7f4354d01640 1 -- 172.21.15.6:0/1124734863 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43480a5cf0 con 0x7f433c003b10 2023-07-21T22:18:57.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7f4356d05640 1 -- 172.21.15.6:0/1124734863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f433c003b10 msgr2=0x7f433c003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7f4356d05640 1 --2- 172.21.15.6:0/1124734863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f433c003b10 0x7f433c003ee0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f434800c260 tx=0x7f434801cbf0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7f4356d05640 1 -- 172.21.15.6:0/1124734863 shutdown_connections 2023-07-21T22:18:57.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7f4356d05640 1 --2- 172.21.15.6:0/1124734863 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f433c003b10 0x7f433c003ee0 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f434800c260 tx=0x7f434801cbf0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7f4356d05640 1 -- 172.21.15.6:0/1124734863 >> 172.21.15.6:0/1124734863 conn(0x7f43500cdde0 msgr2=0x7f43500ce1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:57.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7f1a9ed9d640 1 --2- 172.21.15.6:0/719784597 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1a8c066350 0x7f1a8c068800 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000b9d0 tx=0x7f1a90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7f4356d05640 1 -- 172.21.15.6:0/1124734863 shutdown_connections 2023-07-21T22:18:57.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7f4356d05640 1 -- 172.21.15.6:0/1124734863 wait complete. 2023-07-21T22:18:57.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7fa874ad5640 1 -- 172.21.15.6:0/2805872564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa868033860 msgr2=0x7fa86804f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7fa874ad5640 1 --2- 172.21.15.6:0/2805872564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa868033860 0x7fa86804f070 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa868037460 tx=0x7fa86001c500 comp rx=0 tx=0).stop 2023-07-21T22:18:57.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7fa874ad5640 1 -- 172.21.15.6:0/2805872564 shutdown_connections 2023-07-21T22:18:57.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7fa874ad5640 1 --2- 172.21.15.6:0/2805872564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa868033860 0x7fa86804f070 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7fa874ad5640 1 --2- 172.21.15.6:0/2805872564 >> v2:172.21.15.161:3300/0 conn(0x7fa8680e6c10 0x7fa868052ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7fa874ad5640 1 -- 172.21.15.6:0/2805872564 >> 172.21.15.6:0/2805872564 conn(0x7fa868051530 msgr2=0x7fa868051930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:57.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7fa874ad5640 1 -- 172.21.15.6:0/2805872564 shutdown_connections 2023-07-21T22:18:57.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7fa874ad5640 1 -- 172.21.15.6:0/2805872564 wait complete. 2023-07-21T22:18:57.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.092+0000 7f1a877fe640 1 -- 172.21.15.6:0/719784597 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1a94051210 con 0x7f1aa00d1300 2023-07-21T22:18:57.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.092+0000 7f4356d05640 1 Processor -- start 2023-07-21T22:18:57.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7ffaedffb640 1 -- 172.21.15.6:0/2852935377 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0011710 con 0x7ffaf80b46f0 2023-07-21T22:18:57.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7ffaedffb640 1 -- 172.21.15.6:0/2852935377 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf000f050 con 0x7ffaf80b46f0 2023-07-21T22:18:57.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.088+0000 7ffaedffb640 1 -- 172.21.15.6:0/2852935377 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0011af0 con 0x7ffaf80b46f0 2023-07-21T22:18:57.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.092+0000 7f4356d05640 1 -- start start 2023-07-21T22:18:57.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.092+0000 7ffaff618640 1 -- 172.21.15.6:0/2852935377 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf80c76c0 con 0x7ffaf80b46f0 2023-07-21T22:18:57.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.092+0000 7fa874ad5640 1 Processor -- start 2023-07-21T22:18:57.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.092+0000 7ffaff618640 1 -- 172.21.15.6:0/2852935377 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf80c8210 con 0x7ffaf80b46f0 2023-07-21T22:18:57.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.092+0000 7f4356d05640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43501567e0 0x7f435015e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.092+0000 7f4356d05640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43501573a0 0x7f43500b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.092+0000 7fa874ad5640 1 -- start start 2023-07-21T22:18:57.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.092+0000 7fa874ad5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa868006bb0 0x7fa8680e9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.092+0000 7f4356d05640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4350156bb0 0x7f43500b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.092+0000 7f4356504640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4350156bb0 0x7f43500b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.092+0000 7f4356504640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4350156bb0 0x7f43500b16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47106/0 (socket says 172.21.15.6:47106) 2023-07-21T22:18:57.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.092+0000 7fa874ad5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa868033860 0x7fa8680488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.092+0000 7fa86f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa868006bb0 0x7fa8680e9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.092+0000 7fa86f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa868006bb0 0x7fa8680e9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:48240/0 (socket says 172.21.15.6:48240) 2023-07-21T22:18:57.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.092+0000 7fa86f7fe640 1 -- 172.21.15.6:0/3157201976 learned_addr learned my addr 172.21.15.6:0/3157201976 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:57.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.092+0000 7fa874ad5640 1 --2- 172.21.15.6:0/3157201976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8680e6c10 0x7fa8680db230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7fa874ad5640 1 -- 172.21.15.6:0/3157201976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa868048e10 con 0x7fa868033860 2023-07-21T22:18:57.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7fa874ad5640 1 -- 172.21.15.6:0/3157201976 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa868049040 con 0x7fa868006bb0 2023-07-21T22:18:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7fa874ad5640 1 -- 172.21.15.6:0/3157201976 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa868049320 con 0x7fa8680e6c10 2023-07-21T22:18:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7fa86effd640 1 --2- 172.21.15.6:0/3157201976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa868033860 0x7fa8680488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7fa86ffff640 1 --2- 172.21.15.6:0/3157201976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8680e6c10 0x7fa8680db230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7f4356504640 1 -- 172.21.15.6:0/3985065084 learned_addr learned my addr 172.21.15.6:0/3985065084 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7fa86f7fe640 1 -- 172.21.15.6:0/3157201976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8680e6c10 msgr2=0x7fa8680db230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7fa86f7fe640 1 --2- 172.21.15.6:0/3157201976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8680e6c10 0x7fa8680db230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7fa86f7fe640 1 -- 172.21.15.6:0/3157201976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa868033860 msgr2=0x7fa8680488d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7fa86f7fe640 1 --2- 172.21.15.6:0/3157201976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa868033860 0x7fa8680488d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7fa86f7fe640 1 -- 172.21.15.6:0/3157201976 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600094d0 con 0x7fa868006bb0 2023-07-21T22:18:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7f4356d05640 1 -- 172.21.15.6:0/3985065084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435015ea20 con 0x7f4350156bb0 2023-07-21T22:18:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7fa86f7fe640 1 --2- 172.21.15.6:0/3157201976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa868006bb0 0x7fa8680e9030 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa86400e870 tx=0x7fa86400ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7ffaedffb640 1 -- 172.21.15.6:0/2852935377 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffaf0011c50 con 0x7ffaf80b46f0 2023-07-21T22:18:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7f4356d05640 1 -- 172.21.15.6:0/3985065084 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435015ed00 con 0x7f43501567e0 2023-07-21T22:18:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7f4356d05640 1 -- 172.21.15.6:0/3985065084 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435015efe0 con 0x7f43501573a0 2023-07-21T22:18:57.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7fa857fff640 1 -- 172.21.15.6:0/3157201976 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86400c730 con 0x7fa868006bb0 2023-07-21T22:18:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7ffaedffb640 1 --2- 172.21.15.6:0/2852935377 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ffae4066800 0x7ffae4068cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7ffaedffb640 1 -- 172.21.15.6:0/2852935377 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffaf00846e0 con 0x7ffaf80b46f0 2023-07-21T22:18:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7ffadb7fe640 1 -- 172.21.15.6:0/2852935377 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf80c8460 con 0x7ffaf80b46f0 2023-07-21T22:18:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7f4356504640 1 -- 172.21.15.6:0/3985065084 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43501573a0 msgr2=0x7f43500b1190 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T22:18:57.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7f4356504640 1 --2- 172.21.15.6:0/3985065084 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43501573a0 0x7f43500b1190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7f4356504640 1 -- 172.21.15.6:0/3985065084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43501567e0 msgr2=0x7f435015e1a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T22:18:57.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7f4356504640 1 --2- 172.21.15.6:0/3985065084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43501567e0 0x7f435015e1a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7f4356504640 1 -- 172.21.15.6:0/3985065084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435015f2c0 con 0x7f4350156bb0 2023-07-21T22:18:57.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7fa874ad5640 1 -- 172.21.15.6:0/3157201976 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa868049600 con 0x7fa868006bb0 2023-07-21T22:18:57.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7fa874ad5640 1 -- 172.21.15.6:0/3157201976 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa868049bc0 con 0x7fa868006bb0 2023-07-21T22:18:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7fa857fff640 1 -- 172.21.15.6:0/3157201976 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86400c890 con 0x7fa868006bb0 2023-07-21T22:18:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7fa857fff640 1 -- 172.21.15.6:0/3157201976 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86400cc00 con 0x7fa868006bb0 2023-07-21T22:18:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7f4356504640 1 --2- 172.21.15.6:0/3985065084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4350156bb0 0x7f43500b16d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f43500acca0 tx=0x7f434c00e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.096+0000 7ffafcbb3640 1 --2- 172.21.15.6:0/2852935377 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ffae4066800 0x7ffae4068cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.100+0000 7f43467fc640 1 -- 172.21.15.6:0/3985065084 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c0052e0 con 0x7f4350156bb0 2023-07-21T22:18:57.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.100+0000 7f43467fc640 1 -- 172.21.15.6:0/3985065084 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c005440 con 0x7f4350156bb0 2023-07-21T22:18:57.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.100+0000 7f4356d05640 1 -- 172.21.15.6:0/3985065084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435015e6e0 con 0x7f4350156bb0 2023-07-21T22:18:57.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.100+0000 7f4356d05640 1 -- 172.21.15.6:0/3985065084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43500b1de0 con 0x7f4350156bb0 2023-07-21T22:18:57.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.100+0000 7ffafcbb3640 1 --2- 172.21.15.6:0/2852935377 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ffae4066800 0x7ffae4068cb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffae80af000 tx=0x7ffae80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.100+0000 7f4356d05640 1 -- 172.21.15.6:0/3985065084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435006d440 con 0x7f4350156bb0 2023-07-21T22:18:57.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.100+0000 7fa857fff640 1 -- 172.21.15.6:0/3157201976 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa864013470 con 0x7fa868006bb0 2023-07-21T22:18:57.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.100+0000 7fa857fff640 1 --2- 172.21.15.6:0/3157201976 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa85c066280 0x7fa85c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.100+0000 7fa857fff640 1 -- 172.21.15.6:0/3157201976 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa8640840b0 con 0x7fa868006bb0 2023-07-21T22:18:57.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.104+0000 7fa86effd640 1 --2- 172.21.15.6:0/3157201976 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa85c066280 0x7fa85c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.104+0000 7ffaedffb640 1 -- 172.21.15.6:0/2852935377 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffaf0051c00 con 0x7ffaf80b46f0 2023-07-21T22:18:57.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.104+0000 7fa874ad5640 1 -- 172.21.15.6:0/3157201976 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa850005260 con 0x7fa868006bb0 2023-07-21T22:18:57.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.104+0000 7f43467fc640 1 -- 172.21.15.6:0/3985065084 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c00ecd0 con 0x7f4350156bb0 2023-07-21T22:18:57.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.104+0000 7f43467fc640 1 -- 172.21.15.6:0/3985065084 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f434c003600 con 0x7f4350156bb0 2023-07-21T22:18:57.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.104+0000 7f43467fc640 1 --2- 172.21.15.6:0/3985065084 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f43340663d0 0x7f4334068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.104+0000 7f43467fc640 1 -- 172.21.15.6:0/3985065084 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f434c082ee0 con 0x7f4350156bb0 2023-07-21T22:18:57.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.104+0000 7f4355d03640 1 --2- 172.21.15.6:0/3985065084 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f43340663d0 0x7f4334068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.104+0000 7f4355d03640 1 --2- 172.21.15.6:0/3985065084 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f43340663d0 0x7f4334068880 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f43480aa000 tx=0x7f43480015e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.108+0000 7fa86effd640 1 --2- 172.21.15.6:0/3157201976 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa85c066280 0x7fa85c068730 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa8600af000 tx=0x7fa8600b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.112+0000 7fa857fff640 1 -- 172.21.15.6:0/3157201976 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa864051540 con 0x7fa868006bb0 2023-07-21T22:18:57.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.112+0000 7f43467fc640 1 -- 172.21.15.6:0/3985065084 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f434c0503d0 con 0x7f4350156bb0 2023-07-21T22:18:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.116+0000 7f43eecf9640 1 Processor -- start 2023-07-21T22:18:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.116+0000 7f43eecf9640 1 -- start start 2023-07-21T22:18:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.116+0000 7f43eecf9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43e8157990 0x7f43e80c8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.116+0000 7f43eecf9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e8158fb0 con 0x7f43e806b700 2023-07-21T22:18:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.116+0000 7f43eecf9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e80cb6a0 con 0x7f43e80ca0b0 2023-07-21T22:18:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.116+0000 7f43eecf9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e806bb80 con 0x7f43e8157990 2023-07-21T22:18:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.120+0000 7f43ed296640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f43e806b700 0x7f43e8069430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54260/0 (socket says 172.21.15.6:54260) 2023-07-21T22:18:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.120+0000 7f43ed296640 1 -- 172.21.15.6:0/2891795550 learned_addr learned my addr 172.21.15.6:0/2891795550 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.120+0000 7f43eca95640 1 --2- 172.21.15.6:0/2891795550 >> v2:172.21.15.6:3300/0 conn(0x7f43e8157990 0x7f43e80c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.120+0000 7f43eca95640 1 -- 172.21.15.6:0/2891795550 >> v1:172.21.15.161:6789/0 conn(0x7f43e80ca0b0 legacy=0x7f43e806aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.120+0000 7f43eca95640 1 -- 172.21.15.6:0/2891795550 >> v1:172.21.15.6:6789/0 conn(0x7f43e806b700 legacy=0x7f43e8069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.120+0000 7f43eca95640 1 -- 172.21.15.6:0/2891795550 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e80ca550 con 0x7f43e8157990 2023-07-21T22:18:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.124+0000 7f43eca95640 1 --2- 172.21.15.6:0/2891795550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e8157990 0x7f43e80c8300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f43d800a8c0 tx=0x7f43d801d530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30df6e667615128f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.128+0000 7f43e77fe640 1 -- 172.21.15.6:0/2891795550 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d80ab680 con 0x7f43e8157990 2023-07-21T22:18:57.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.128+0000 7f43e77fe640 1 -- 172.21.15.6:0/2891795550 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d80ab7e0 con 0x7f43e8157990 2023-07-21T22:18:57.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.128+0000 7f43eecf9640 1 -- 172.21.15.6:0/2891795550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e8157990 msgr2=0x7f43e80c8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.128+0000 7f43eecf9640 1 --2- 172.21.15.6:0/2891795550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e8157990 0x7f43e80c8300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f43d800a8c0 tx=0x7f43d801d530 comp rx=0 tx=0).stop 2023-07-21T22:18:57.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.128+0000 7f43eecf9640 1 -- 172.21.15.6:0/2891795550 shutdown_connections 2023-07-21T22:18:57.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.128+0000 7f43eecf9640 1 --2- 172.21.15.6:0/2891795550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e8157990 0x7f43e80c8300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.128+0000 7f43eecf9640 1 -- 172.21.15.6:0/2891795550 >> 172.21.15.6:0/2891795550 conn(0x7f43e80ce980 msgr2=0x7f43e80ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:57.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.128+0000 7f43eecf9640 1 -- 172.21.15.6:0/2891795550 shutdown_connections 2023-07-21T22:18:57.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.128+0000 7f43eecf9640 1 -- 172.21.15.6:0/2891795550 wait complete. 2023-07-21T22:18:57.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.132+0000 7f43eecf9640 1 Processor -- start 2023-07-21T22:18:57.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.132+0000 7f43eecf9640 1 -- start start 2023-07-21T22:18:57.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.136+0000 7f43eecf9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43e806b700 0x7f43e8157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.136+0000 7f43eecf9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e80ca0b0 0x7f43e81502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.136+0000 7f43eca95640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43e806b700 0x7f43e8157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.136+0000 7f43eca95640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43e806b700 0x7f43e8157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:58154/0 (socket says 172.21.15.6:58154) 2023-07-21T22:18:57.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.136+0000 7f43eca95640 1 -- 172.21.15.6:0/2302460184 learned_addr learned my addr 172.21.15.6:0/2302460184 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:57.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.136+0000 7f43e7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e80ca0b0 0x7f43e81502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.136+0000 7f43eecf9640 1 --2- 172.21.15.6:0/2302460184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43e8157990 0x7f43e814c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.136+0000 7f43eecf9640 1 -- 172.21.15.6:0/2302460184 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e81666c0 con 0x7f43e80ca0b0 2023-07-21T22:18:57.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.136+0000 7f43eecf9640 1 -- 172.21.15.6:0/2302460184 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e81507f0 con 0x7f43e8157990 2023-07-21T22:18:57.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.136+0000 7f43ed296640 1 --2- 172.21.15.6:0/2302460184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43e8157990 0x7f43e814c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.136+0000 7f43eecf9640 1 -- 172.21.15.6:0/2302460184 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e80c76a0 con 0x7f43e806b700 2023-07-21T22:18:57.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.140+0000 7f43eca95640 1 -- 172.21.15.6:0/2302460184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43e8157990 msgr2=0x7f43e814c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.140+0000 7f43eca95640 1 --2- 172.21.15.6:0/2302460184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43e8157990 0x7f43e814c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.140+0000 7f43eca95640 1 -- 172.21.15.6:0/2302460184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e80ca0b0 msgr2=0x7f43e81502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.140+0000 7f43eca95640 1 --2- 172.21.15.6:0/2302460184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e80ca0b0 0x7f43e81502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.140+0000 7f43eca95640 1 -- 172.21.15.6:0/2302460184 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d800a520 con 0x7f43e806b700 2023-07-21T22:18:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.140+0000 7f43eca95640 1 --2- 172.21.15.6:0/2302460184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43e806b700 0x7f43e8157410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f43d80ad040 tx=0x7f43d801bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.140+0000 7f43e57fa640 1 -- 172.21.15.6:0/2302460184 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d80074c0 con 0x7f43e806b700 2023-07-21T22:18:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.140+0000 7f43eecf9640 1 -- 172.21.15.6:0/2302460184 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e8165a80 con 0x7f43e806b700 2023-07-21T22:18:57.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.140+0000 7f43eecf9640 1 -- 172.21.15.6:0/2302460184 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e8165d20 con 0x7f43e806b700 2023-07-21T22:18:57.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.140+0000 7f43e57fa640 1 -- 172.21.15.6:0/2302460184 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d80ab670 con 0x7f43e806b700 2023-07-21T22:18:57.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.144+0000 7f43e57fa640 1 -- 172.21.15.6:0/2302460184 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d8007840 con 0x7f43e806b700 2023-07-21T22:18:57.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.144+0000 7f43e57fa640 1 -- 172.21.15.6:0/2302460184 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f43d80bf460 con 0x7f43e806b700 2023-07-21T22:18:57.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.148+0000 7f43e57fa640 1 --2- 172.21.15.6:0/2302460184 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f43d0066540 0x7f43d00689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.148+0000 7f43e57fa640 1 -- 172.21.15.6:0/2302460184 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f43d811e700 con 0x7f43e806b700 2023-07-21T22:18:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.148+0000 7f43e7fff640 1 --2- 172.21.15.6:0/2302460184 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f43d0066540 0x7f43d00689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.148+0000 7f43e7fff640 1 --2- 172.21.15.6:0/2302460184 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f43d0066540 0x7f43d00689f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f43e814ee00 tx=0x7f43dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.148+0000 7f43eecf9640 1 -- 172.21.15.6:0/2302460184 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c4005260 con 0x7f43e806b700 2023-07-21T22:18:57.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.156+0000 7f43e57fa640 1 -- 172.21.15.6:0/2302460184 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f43d80ebca0 con 0x7f43e806b700 2023-07-21T22:18:57.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.356+0000 7f3963300640 1 -- 172.21.15.6:0/1712618874 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f393c0057e0 con 0x7f395c157990 2023-07-21T22:18:57.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.356+0000 7f3951ffb640 1 -- 172.21.15.6:0/1712618874 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f39540072c0 con 0x7f395c157990 2023-07-21T22:18:57.405 INFO:teuthology.orchestra.run.smithi006.stdout:64424509448 2023-07-21T22:18:57.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.360+0000 7f39477fe640 1 -- 172.21.15.6:0/1712618874 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3940066350 msgr2=0x7f3940068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.360+0000 7f39477fe640 1 --2- 172.21.15.6:0/1712618874 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3940066350 0x7f3940068800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f394c008930 tx=0x7f394c008040 comp rx=0 tx=0).stop 2023-07-21T22:18:57.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.360+0000 7f39477fe640 1 -- 172.21.15.6:0/1712618874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f395c157990 msgr2=0x7f395c0c4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.360+0000 7f39477fe640 1 --2- 172.21.15.6:0/1712618874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f395c157990 0x7f395c0c4fe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f39540b3040 tx=0x7f395401d420 comp rx=0 tx=0).stop 2023-07-21T22:18:57.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.360+0000 7f39477fe640 1 -- 172.21.15.6:0/1712618874 shutdown_connections 2023-07-21T22:18:57.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.360+0000 7f39477fe640 1 --2- 172.21.15.6:0/1712618874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f395c0c22e0 0x7f395c0c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.360+0000 7f39477fe640 1 --2- 172.21.15.6:0/1712618874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f395c157990 0x7f395c0c4fe0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.360+0000 7f39477fe640 1 --2- 172.21.15.6:0/1712618874 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3940066350 0x7f3940068800 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.360+0000 7f39477fe640 1 --2- 172.21.15.6:0/1712618874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f395c06b530 0x7f395c0c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.360+0000 7f39477fe640 1 -- 172.21.15.6:0/1712618874 >> 172.21.15.6:0/1712618874 conn(0x7f395c0ce980 msgr2=0x7f395c0b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:57.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.360+0000 7f39477fe640 1 -- 172.21.15.6:0/1712618874 shutdown_connections 2023-07-21T22:18:57.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.360+0000 7f39477fe640 1 -- 172.21.15.6:0/1712618874 wait complete. 2023-07-21T22:18:57.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.388+0000 7fc657fff640 1 -- 172.21.15.6:0/2410063025 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc638005510 con 0x7fc6580acd30 2023-07-21T22:18:57.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.388+0000 7fc63f7fe640 1 -- 172.21.15.6:0/2410063025 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc650054440 con 0x7fc6580acd30 2023-07-21T22:18:57.437 INFO:teuthology.orchestra.run.smithi006.stdout:64424509447 2023-07-21T22:18:57.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509448 for osd.0 2023-07-21T22:18:57.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.392+0000 7fc657fff640 1 -- 172.21.15.6:0/2410063025 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc6400664b0 msgr2=0x7fc640068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.392+0000 7fc657fff640 1 --2- 172.21.15.6:0/2410063025 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc6400664b0 0x7fc640068960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc64c01c4c0 tx=0x7fc64c0b6040 comp rx=0 tx=0).stop 2023-07-21T22:18:57.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.392+0000 7fc657fff640 1 -- 172.21.15.6:0/2410063025 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6580acd30 msgr2=0x7fc6581f7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.392+0000 7fc657fff640 1 --2- 172.21.15.6:0/2410063025 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6580acd30 0x7fc6581f7730 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc65000c7a0 tx=0x7fc65000cba0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.392+0000 7fc657fff640 1 -- 172.21.15.6:0/2410063025 shutdown_connections 2023-07-21T22:18:57.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.392+0000 7fc657fff640 1 --2- 172.21.15.6:0/2410063025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6580c8e70 0x7fc658155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.396+0000 7fc657fff640 1 --2- 172.21.15.6:0/2410063025 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6580acd30 0x7fc6581f7730 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.396+0000 7fc657fff640 1 --2- 172.21.15.6:0/2410063025 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc6400664b0 0x7fc640068960 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.396+0000 7fc657fff640 1 --2- 172.21.15.6:0/2410063025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc658069de0 0x7fc6580b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.396+0000 7fc657fff640 1 -- 172.21.15.6:0/2410063025 >> 172.21.15.6:0/2410063025 conn(0x7fc6580cdde0 msgr2=0x7fc65815b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.396+0000 7fc657fff640 1 -- 172.21.15.6:0/2410063025 shutdown_connections 2023-07-21T22:18:57.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.396+0000 7fc657fff640 1 -- 172.21.15.6:0/2410063025 wait complete. 2023-07-21T22:18:57.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.412+0000 7f5391ffb640 1 -- 172.21.15.6:0/4101859764 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f53ac0678d0 con 0x7f53ac069b40 2023-07-21T22:18:57.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.412+0000 7f5393fff640 1 -- 172.21.15.6:0/4101859764 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f539c0ba090 con 0x7f53ac069b40 2023-07-21T22:18:57.460 INFO:teuthology.orchestra.run.smithi006.stdout:60129542153 2023-07-21T22:18:57.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.416+0000 7ffadb7fe640 1 -- 172.21.15.6:0/2852935377 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffaf804e020 con 0x7ffaf80b46f0 2023-07-21T22:18:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.416+0000 7ffaedffb640 1 -- 172.21.15.6:0/2852935377 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffaf0055220 con 0x7ffaf80b46f0 2023-07-21T22:18:57.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.416+0000 7f5391ffb640 1 -- 172.21.15.6:0/4101859764 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5398066350 msgr2=0x7f5398068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.416+0000 7f5391ffb640 1 --2- 172.21.15.6:0/4101859764 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5398066350 0x7f5398068800 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f53a0000c10 tx=0x7f53a0009040 comp rx=0 tx=0).stop 2023-07-21T22:18:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.416+0000 7f5391ffb640 1 -- 172.21.15.6:0/4101859764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53ac069b40 msgr2=0x7f53ac15b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.416+0000 7f5391ffb640 1 --2- 172.21.15.6:0/4101859764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53ac069b40 0x7f53ac15b1f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f539c023690 tx=0x7f539c0220a0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.464 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2023-07-21T22:18:57.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.416+0000 7f5391ffb640 1 -- 172.21.15.6:0/4101859764 shutdown_connections 2023-07-21T22:18:57.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.416+0000 7f5391ffb640 1 --2- 172.21.15.6:0/4101859764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53ac15ca20 0x7f53ac15dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.416+0000 7f5391ffb640 1 --2- 172.21.15.6:0/4101859764 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5398066350 0x7f5398068800 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.416+0000 7f5391ffb640 1 --2- 172.21.15.6:0/4101859764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53ac0cb280 0x7f53ac14e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.416+0000 7f5391ffb640 1 --2- 172.21.15.6:0/4101859764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53ac069b40 0x7f53ac15b1f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.416+0000 7f5391ffb640 1 -- 172.21.15.6:0/4101859764 >> 172.21.15.6:0/4101859764 conn(0x7f53ac0ce980 msgr2=0x7f53ac0af010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:57.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.416+0000 7f5391ffb640 1 -- 172.21.15.6:0/4101859764 shutdown_connections 2023-07-21T22:18:57.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.416+0000 7f5391ffb640 1 -- 172.21.15.6:0/4101859764 wait complete. 2023-07-21T22:18:57.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.420+0000 7ffadb7fe640 1 -- 172.21.15.6:0/2852935377 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ffae4066800 msgr2=0x7ffae4068cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.420+0000 7ffadb7fe640 1 --2- 172.21.15.6:0/2852935377 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ffae4066800 0x7ffae4068cb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffae80af000 tx=0x7ffae80a7000 comp rx=0 tx=0).stop 2023-07-21T22:18:57.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.420+0000 7ffadb7fe640 1 -- 172.21.15.6:0/2852935377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaf80b46f0 msgr2=0x7ffaf815c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.420+0000 7ffadb7fe640 1 --2- 172.21.15.6:0/2852935377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaf80b46f0 0x7ffaf815c900 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000bdc0 tx=0x7ffaf0009f10 comp rx=0 tx=0).stop 2023-07-21T22:18:57.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.420+0000 7ffadb7fe640 1 -- 172.21.15.6:0/2852935377 shutdown_connections 2023-07-21T22:18:57.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.420+0000 7ffadb7fe640 1 --2- 172.21.15.6:0/2852935377 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffaf815baf0 0x7ffaf80c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.420+0000 7ffadb7fe640 1 --2- 172.21.15.6:0/2852935377 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ffae4066800 0x7ffae4068cb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.420+0000 7ffadb7fe640 1 --2- 172.21.15.6:0/2852935377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf80cf1c0 0x7ffaf815ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.420+0000 7ffadb7fe640 1 --2- 172.21.15.6:0/2852935377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffaf80b46f0 0x7ffaf815c900 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.420+0000 7ffadb7fe640 1 -- 172.21.15.6:0/2852935377 >> 172.21.15.6:0/2852935377 conn(0x7ffaf80b3be0 msgr2=0x7ffaf80b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:57.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.420+0000 7ffadb7fe640 1 -- 172.21.15.6:0/2852935377 shutdown_connections 2023-07-21T22:18:57.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.420+0000 7ffadb7fe640 1 -- 172.21.15.6:0/2852935377 wait complete. 2023-07-21T22:18:57.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.424+0000 7f1aa51d2640 1 -- 172.21.15.6:0/719784597 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1aa00cde50 con 0x7f1aa00d1300 2023-07-21T22:18:57.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.424+0000 7f1a877fe640 1 -- 172.21.15.6:0/719784597 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a94021090 con 0x7f1aa00d1300 2023-07-21T22:18:57.471 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2023-07-21T22:18:57.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.424+0000 7f1aa51d2640 1 -- 172.21.15.6:0/719784597 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1a8c066350 msgr2=0x7f1a8c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.424+0000 7f1aa51d2640 1 --2- 172.21.15.6:0/719784597 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1a8c066350 0x7f1a8c068800 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000b9d0 tx=0x7f1a90008040 comp rx=0 tx=0).stop 2023-07-21T22:18:57.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.424+0000 7f1aa51d2640 1 -- 172.21.15.6:0/719784597 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1aa00d1300 msgr2=0x7f1aa015e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.424+0000 7f1aa51d2640 1 --2- 172.21.15.6:0/719784597 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1aa00d1300 0x7f1aa015e290 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400e7f0 tx=0x7f1a9400ecb0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.424+0000 7f1aa51d2640 1 -- 172.21.15.6:0/719784597 shutdown_connections 2023-07-21T22:18:57.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.424+0000 7f1aa51d2640 1 --2- 172.21.15.6:0/719784597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aa00d1850 0x7f1aa015e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.424+0000 7f1aa51d2640 1 --2- 172.21.15.6:0/719784597 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1aa00d1300 0x7f1aa015e290 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.424+0000 7f1aa51d2640 1 --2- 172.21.15.6:0/719784597 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1a8c066350 0x7f1a8c068800 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.424+0000 7f1aa51d2640 1 --2- 172.21.15.6:0/719784597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1aa00b7c70 0x7f1aa00cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.424+0000 7f1aa51d2640 1 -- 172.21.15.6:0/719784597 >> 172.21.15.6:0/719784597 conn(0x7f1aa00650b0 msgr2=0x7f1aa00cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:57.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.428+0000 7f1aa51d2640 1 -- 172.21.15.6:0/719784597 shutdown_connections 2023-07-21T22:18:57.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.428+0000 7f1aa51d2640 1 -- 172.21.15.6:0/719784597 wait complete. 2023-07-21T22:18:57.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509447 for osd.2 2023-07-21T22:18:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.440+0000 7f4356d05640 1 -- 172.21.15.6:0/3985065084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f43500678d0 con 0x7f4350156bb0 2023-07-21T22:18:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.440+0000 7f43467fc640 1 -- 172.21.15.6:0/3985065084 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f434c019090 con 0x7f4350156bb0 2023-07-21T22:18:57.487 INFO:teuthology.orchestra.run.smithi006.stdout:64424509445 2023-07-21T22:18:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.440+0000 7fa874ad5640 1 -- 172.21.15.6:0/3157201976 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa8500050d0 con 0x7fa868006bb0 2023-07-21T22:18:57.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.444+0000 7fa857fff640 1 -- 172.21.15.6:0/3157201976 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa864021030 con 0x7fa868006bb0 2023-07-21T22:18:57.490 INFO:teuthology.orchestra.run.smithi006.stdout:64424509446 2023-07-21T22:18:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.444+0000 7f4356d05640 1 -- 172.21.15.6:0/3985065084 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f43340663d0 msgr2=0x7f4334068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.444+0000 7f4356d05640 1 --2- 172.21.15.6:0/3985065084 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f43340663d0 0x7f4334068880 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f43480aa000 tx=0x7f43480015e0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.444+0000 7f4356d05640 1 -- 172.21.15.6:0/3985065084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4350156bb0 msgr2=0x7f43500b16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.444+0000 7f4356d05640 1 --2- 172.21.15.6:0/3985065084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4350156bb0 0x7f43500b16d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f43500acca0 tx=0x7f434c00e7c0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.444+0000 7f4356d05640 1 -- 172.21.15.6:0/3985065084 shutdown_connections 2023-07-21T22:18:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.444+0000 7f4356d05640 1 --2- 172.21.15.6:0/3985065084 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f43340663d0 0x7f4334068880 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.444+0000 7f4356d05640 1 --2- 172.21.15.6:0/3985065084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4350156bb0 0x7f43500b16d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.444+0000 7f4356d05640 1 --2- 172.21.15.6:0/3985065084 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43501573a0 0x7f43500b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.444+0000 7f4356d05640 1 --2- 172.21.15.6:0/3985065084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43501567e0 0x7f435015e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.444+0000 7f4356d05640 1 -- 172.21.15.6:0/3985065084 >> 172.21.15.6:0/3985065084 conn(0x7f43500cdde0 msgr2=0x7f435006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.444+0000 7f4356d05640 1 -- 172.21.15.6:0/3985065084 shutdown_connections 2023-07-21T22:18:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.444+0000 7f4356d05640 1 -- 172.21.15.6:0/3985065084 wait complete. 2023-07-21T22:18:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.444+0000 7fa874ad5640 1 -- 172.21.15.6:0/3157201976 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa85c066280 msgr2=0x7fa85c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.444+0000 7fa874ad5640 1 --2- 172.21.15.6:0/3157201976 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa85c066280 0x7fa85c068730 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa8600af000 tx=0x7fa8600b6040 comp rx=0 tx=0).stop 2023-07-21T22:18:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.444+0000 7fa874ad5640 1 -- 172.21.15.6:0/3157201976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa868006bb0 msgr2=0x7fa8680e9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.444+0000 7fa874ad5640 1 --2- 172.21.15.6:0/3157201976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa868006bb0 0x7fa8680e9030 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa86400e870 tx=0x7fa86400ec70 comp rx=0 tx=0).stop 2023-07-21T22:18:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.448+0000 7fa874ad5640 1 -- 172.21.15.6:0/3157201976 shutdown_connections 2023-07-21T22:18:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.448+0000 7fa874ad5640 1 --2- 172.21.15.6:0/3157201976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8680e6c10 0x7fa8680db230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.448+0000 7fa874ad5640 1 --2- 172.21.15.6:0/3157201976 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa85c066280 0x7fa85c068730 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.448+0000 7fa874ad5640 1 --2- 172.21.15.6:0/3157201976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa868033860 0x7fa8680488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.448+0000 7fa874ad5640 1 --2- 172.21.15.6:0/3157201976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa868006bb0 0x7fa8680e9030 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.448+0000 7fa874ad5640 1 -- 172.21.15.6:0/3157201976 >> 172.21.15.6:0/3157201976 conn(0x7fa868051530 msgr2=0x7fa86804f020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.448+0000 7fa874ad5640 1 -- 172.21.15.6:0/3157201976 shutdown_connections 2023-07-21T22:18:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.448+0000 7fa874ad5640 1 -- 172.21.15.6:0/3157201976 wait complete. 2023-07-21T22:18:57.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509446 for osd.1 2023-07-21T22:18:57.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.6 2023-07-21T22:18:57.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509446 for osd.4 2023-07-21T22:18:57.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.468+0000 7f43eecf9640 1 -- 172.21.15.6:0/2302460184 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f43c4005510 con 0x7f43e806b700 2023-07-21T22:18:57.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.468+0000 7f43e57fa640 1 -- 172.21.15.6:0/2302460184 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f43d80079a0 con 0x7f43e806b700 2023-07-21T22:18:57.514 INFO:teuthology.orchestra.run.smithi006.stdout:64424509445 2023-07-21T22:18:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.468+0000 7f43eecf9640 1 -- 172.21.15.6:0/2302460184 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f43d0066540 msgr2=0x7f43d00689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.468+0000 7f43eecf9640 1 --2- 172.21.15.6:0/2302460184 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f43d0066540 0x7f43d00689f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f43e814ee00 tx=0x7f43dc009040 comp rx=0 tx=0).stop 2023-07-21T22:18:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.468+0000 7f43eecf9640 1 -- 172.21.15.6:0/2302460184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43e806b700 msgr2=0x7f43e8157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.468+0000 7f43eecf9640 1 --2- 172.21.15.6:0/2302460184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43e806b700 0x7f43e8157410 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f43d80ad040 tx=0x7f43d801bd70 comp rx=0 tx=0).stop 2023-07-21T22:18:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.468+0000 7f43eecf9640 1 -- 172.21.15.6:0/2302460184 shutdown_connections 2023-07-21T22:18:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.468+0000 7f43eecf9640 1 --2- 172.21.15.6:0/2302460184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43e8157990 0x7f43e814c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.468+0000 7f43eecf9640 1 --2- 172.21.15.6:0/2302460184 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f43d0066540 0x7f43d00689f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.468+0000 7f43eecf9640 1 --2- 172.21.15.6:0/2302460184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43e80ca0b0 0x7f43e81502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.468+0000 7f43eecf9640 1 --2- 172.21.15.6:0/2302460184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43e806b700 0x7f43e8157410 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.468+0000 7f43eecf9640 1 -- 172.21.15.6:0/2302460184 >> 172.21.15.6:0/2302460184 conn(0x7f43e80ce980 msgr2=0x7f43e806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.468+0000 7f43eecf9640 1 -- 172.21.15.6:0/2302460184 shutdown_connections 2023-07-21T22:18:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:57.468+0000 7f43eecf9640 1 -- 172.21.15.6:0/2302460184 wait complete. 2023-07-21T22:18:57.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.3 2023-07-21T22:18:57.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509446 for osd.7 2023-07-21T22:18:57.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.5 2023-07-21T22:18:58.439 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-21T22:18:58.476 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-21T22:18:58.504 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-21T22:18:58.505 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-21T22:18:58.508 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-21T22:18:58.520 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-21T22:18:58.521 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-21T22:18:58.535 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-21T22:18:58.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.580+0000 7fe47e511640 1 Processor -- start 2023-07-21T22:18:58.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.584+0000 7fe47e511640 1 -- start start 2023-07-21T22:18:58.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.584+0000 7fe47e511640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe478157990 0x7fe4780c8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.584+0000 7fe47e511640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe4780ca0b0 0x7fe47806aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.584+0000 7fe47e511640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe478158fb0 con 0x7fe47806b530 2023-07-21T22:18:58.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.584+0000 7fe47e511640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4780cb6a0 con 0x7fe4780ca0b0 2023-07-21T22:18:58.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.584+0000 7fe47e511640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780cd650 con 0x7fe478157990 2023-07-21T22:18:58.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.584+0000 7fe47caae640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fe47806b530 0x7fe47815b630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:47016/0 (socket says 172.21.15.6:47016) 2023-07-21T22:18:58.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.584+0000 7fe47caae640 1 -- 172.21.15.6:0/1042905636 learned_addr learned my addr 172.21.15.6:0/1042905636 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:58.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.584+0000 7fe477fff640 1 --2- 172.21.15.6:0/1042905636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe478157990 0x7fe4780c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.584+0000 7fe4777fe640 1 --2- 172.21.15.6:0/1042905636 >> v2:172.21.15.161:3300/0 conn(0x7fe4780ca0b0 0x7fe47806aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.588+0000 7fe476ffd640 1 -- 172.21.15.6:0/1042905636 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340562807 0 0) 0x7fe478158fb0 con 0x7fe47806b530 2023-07-21T22:18:58.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.588+0000 7fe477fff640 1 -- 172.21.15.6:0/1042905636 >> v2:172.21.15.161:3300/0 conn(0x7fe4780ca0b0 msgr2=0x7fe47806aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:58.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.588+0000 7fe477fff640 1 --2- 172.21.15.6:0/1042905636 >> v2:172.21.15.161:3300/0 conn(0x7fe4780ca0b0 0x7fe47806aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.588+0000 7fe477fff640 1 -- 172.21.15.6:0/1042905636 >> v1:172.21.15.161:6789/0 conn(0x7fe47806b530 legacy=0x7fe47815b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.588+0000 7fe477fff640 1 -- 172.21.15.6:0/1042905636 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4780cd930 con 0x7fe478157990 2023-07-21T22:18:58.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.588+0000 7fe4777fe640 1 --2- 172.21.15.6:0/1042905636 >> v2:172.21.15.161:3300/0 conn(0x7fe4780ca0b0 0x7fe47806aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:58.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.592+0000 7fe477fff640 1 --2- 172.21.15.6:0/1042905636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe478157990 0x7fe4780c8300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0097c0 tx=0x7fe46c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc0e8aa30d28ee6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.592+0000 7fe476ffd640 1 -- 172.21.15.6:0/1042905636 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c0ab670 con 0x7fe478157990 2023-07-21T22:18:58.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.592+0000 7fe476ffd640 1 -- 172.21.15.6:0/1042905636 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c0ab7d0 con 0x7fe478157990 2023-07-21T22:18:58.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.596+0000 7fe47e511640 1 -- 172.21.15.6:0/1042905636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe478157990 msgr2=0x7fe4780c8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.596+0000 7fe47e511640 1 --2- 172.21.15.6:0/1042905636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe478157990 0x7fe4780c8300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0097c0 tx=0x7fe46c01c450 comp rx=0 tx=0).stop 2023-07-21T22:18:58.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.596+0000 7fe47e511640 1 -- 172.21.15.6:0/1042905636 shutdown_connections 2023-07-21T22:18:58.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.596+0000 7fe47e511640 1 --2- 172.21.15.6:0/1042905636 >> v2:172.21.15.161:3300/0 conn(0x7fe4780ca0b0 0x7fe47806aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.596+0000 7fe47e511640 1 --2- 172.21.15.6:0/1042905636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe478157990 0x7fe4780c8300 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.596+0000 7fe47e511640 1 -- 172.21.15.6:0/1042905636 >> 172.21.15.6:0/1042905636 conn(0x7fe4780ce980 msgr2=0x7fe4780ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:58.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.596+0000 7fe47e511640 1 -- 172.21.15.6:0/1042905636 shutdown_connections 2023-07-21T22:18:58.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.596+0000 7fe47e511640 1 -- 172.21.15.6:0/1042905636 wait complete. 2023-07-21T22:18:58.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.600+0000 7fe47e511640 1 Processor -- start 2023-07-21T22:18:58.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.600+0000 7fe47e511640 1 -- start start 2023-07-21T22:18:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.600+0000 7fe47e511640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe47806b530 0x7fe478156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.600+0000 7fe47e511640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4780ca0b0 0x7fe4780affc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.600+0000 7fe47e511640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4780b3720 0x7fe4780c1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.600+0000 7fe47e511640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780b1740 con 0x7fe4780ca0b0 2023-07-21T22:18:58.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.600+0000 7fe47e511640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780b1a20 con 0x7fe4780b3720 2023-07-21T22:18:58.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.604+0000 7fe47caae640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4780b3720 0x7fe4780c1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.604+0000 7fe4777fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4780ca0b0 0x7fe4780affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.604+0000 7fe47caae640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4780b3720 0x7fe4780c1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35666/0 (socket says 172.21.15.6:35666) 2023-07-21T22:18:58.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.604+0000 7fe47caae640 1 -- 172.21.15.6:0/3859323400 learned_addr learned my addr 172.21.15.6:0/3859323400 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:58.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.604+0000 7fe47e511640 1 -- 172.21.15.6:0/3859323400 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780b1d00 con 0x7fe47806b530 2023-07-21T22:18:58.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.604+0000 7fe47caae640 1 -- 172.21.15.6:0/3859323400 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe47806b530 msgr2=0x7fe478156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.604+0000 7fe477fff640 1 --2- 172.21.15.6:0/3859323400 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe47806b530 0x7fe478156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.604+0000 7fe47caae640 1 --2- 172.21.15.6:0/3859323400 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe47806b530 0x7fe478156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.604+0000 7fe47caae640 1 -- 172.21.15.6:0/3859323400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4780ca0b0 msgr2=0x7fe4780affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.604+0000 7fe47caae640 1 --2- 172.21.15.6:0/3859323400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4780ca0b0 0x7fe4780affc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.604+0000 7fe47caae640 1 -- 172.21.15.6:0/3859323400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46800a5c0 con 0x7fe4780b3720 2023-07-21T22:18:58.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.604+0000 7fe4777fe640 1 --2- 172.21.15.6:0/3859323400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4780ca0b0 0x7fe4780affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:58.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.604+0000 7fe477fff640 1 --2- 172.21.15.6:0/3859323400 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe47806b530 0x7fe478156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:58.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.604+0000 7fe47caae640 1 --2- 172.21.15.6:0/3859323400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4780b3720 0x7fe4780c1350 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe47000c780 tx=0x7fe47000cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.604+0000 7fe474ff9640 1 -- 172.21.15.6:0/3859323400 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47000ce90 con 0x7fe4780b3720 2023-07-21T22:18:58.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.604+0000 7fe47e511640 1 -- 172.21.15.6:0/3859323400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe46c009420 con 0x7fe4780b3720 2023-07-21T22:18:58.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.608+0000 7fe47e511640 1 -- 172.21.15.6:0/3859323400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4780b22c0 con 0x7fe4780b3720 2023-07-21T22:18:58.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.608+0000 7fe474ff9640 1 -- 172.21.15.6:0/3859323400 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47000a640 con 0x7fe4780b3720 2023-07-21T22:18:58.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.608+0000 7fe474ff9640 1 -- 172.21.15.6:0/3859323400 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47000a9d0 con 0x7fe4780b3720 2023-07-21T22:18:58.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.608+0000 7fe47e511640 1 -- 172.21.15.6:0/3859323400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe458005260 con 0x7fe4780b3720 2023-07-21T22:18:58.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.612+0000 7fe474ff9640 1 -- 172.21.15.6:0/3859323400 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe47000ab30 con 0x7fe4780b3720 2023-07-21T22:18:58.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.612+0000 7fe474ff9640 1 --2- 172.21.15.6:0/3859323400 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe460066460 0x7fe460068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.612+0000 7fe474ff9640 1 -- 172.21.15.6:0/3859323400 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe4700835b0 con 0x7fe4780b3720 2023-07-21T22:18:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.612+0000 7fe477fff640 1 --2- 172.21.15.6:0/3859323400 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe460066460 0x7fe460068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.612+0000 7fe477fff640 1 --2- 172.21.15.6:0/3859323400 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe460066460 0x7fe460068910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0af000 tx=0x7fe46c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.616+0000 7fe474ff9640 1 -- 172.21.15.6:0/3859323400 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe470050ac0 con 0x7fe4780b3720 2023-07-21T22:18:58.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.672+0000 7f6bde340640 1 Processor -- start 2023-07-21T22:18:58.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.672+0000 7f6bde340640 1 -- start start 2023-07-21T22:18:58.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.676+0000 7f6bde340640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6bd80caed0 0x7f6bd80c8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.676+0000 7f6bde340640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bd80ca0b0 0x7f6bd8157990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.676+0000 7f6bde340640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bd8158fb0 con 0x7f6bd806aff0 2023-07-21T22:18:58.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.676+0000 7f6bde340640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bd80cb6a0 con 0x7f6bd80caed0 2023-07-21T22:18:58.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.676+0000 7f6bde340640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd8157ed0 con 0x7f6bd80ca0b0 2023-07-21T22:18:58.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.676+0000 7f6bd77fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bd80ca0b0 0x7f6bd8157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.676+0000 7f6bd77fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bd80ca0b0 0x7f6bd8157990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:56536/0 (socket says 172.21.15.6:56536) 2023-07-21T22:18:58.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.676+0000 7f6bd77fe640 1 -- 172.21.15.6:0/2857626887 learned_addr learned my addr 172.21.15.6:0/2857626887 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:58.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.676+0000 7f6bd7fff640 1 --2- 172.21.15.6:0/2857626887 >> v2:172.21.15.6:3300/0 conn(0x7f6bd80caed0 0x7f6bd80c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.676+0000 7f6bd77fe640 1 -- 172.21.15.6:0/2857626887 >> v2:172.21.15.6:3300/0 conn(0x7f6bd80caed0 msgr2=0x7f6bd80c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:58.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.676+0000 7f6bd77fe640 1 --2- 172.21.15.6:0/2857626887 >> v2:172.21.15.6:3300/0 conn(0x7f6bd80caed0 0x7f6bd80c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.676+0000 7f6bd77fe640 1 -- 172.21.15.6:0/2857626887 >> v1:172.21.15.6:6789/0 conn(0x7f6bd806aff0 legacy=0x7f6bd806b470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:18:58.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.676+0000 7f6bd77fe640 1 -- 172.21.15.6:0/2857626887 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd806bb80 con 0x7f6bd80ca0b0 2023-07-21T22:18:58.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.680+0000 7f6bd7fff640 1 --2- 172.21.15.6:0/2857626887 >> v2:172.21.15.6:3300/0 conn(0x7f6bd80caed0 0x7f6bd80c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:58.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.680+0000 7f6bd77fe640 1 --2- 172.21.15.6:0/2857626887 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bd80ca0b0 0x7f6bd8157990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009e50 tx=0x7f6bd001f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55133784ecf8794f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.684+0000 7f6bd6ffd640 1 -- 172.21.15.6:0/2857626887 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd00af400 con 0x7f6bd80ca0b0 2023-07-21T22:18:58.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.684+0000 7f6bd6ffd640 1 -- 172.21.15.6:0/2857626887 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd00ab050 con 0x7f6bd80ca0b0 2023-07-21T22:18:58.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.684+0000 7f6bde340640 1 -- 172.21.15.6:0/2857626887 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bd80ca0b0 msgr2=0x7f6bd8157990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.684+0000 7f6bde340640 1 --2- 172.21.15.6:0/2857626887 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bd80ca0b0 0x7f6bd8157990 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009e50 tx=0x7f6bd001f1e0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.684+0000 7f6bde340640 1 -- 172.21.15.6:0/2857626887 shutdown_connections 2023-07-21T22:18:58.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.684+0000 7f6bde340640 1 --2- 172.21.15.6:0/2857626887 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bd80ca0b0 0x7f6bd8157990 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.684+0000 7f6bde340640 1 --2- 172.21.15.6:0/2857626887 >> v2:172.21.15.6:3300/0 conn(0x7f6bd80caed0 0x7f6bd80c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.684+0000 7f6bde340640 1 -- 172.21.15.6:0/2857626887 >> 172.21.15.6:0/2857626887 conn(0x7f6bd80ce980 msgr2=0x7f6bd80ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:58.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.684+0000 7f6bde340640 1 -- 172.21.15.6:0/2857626887 shutdown_connections 2023-07-21T22:18:58.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.684+0000 7f6bde340640 1 -- 172.21.15.6:0/2857626887 wait complete. 2023-07-21T22:18:58.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.688+0000 7f6bde340640 1 Processor -- start 2023-07-21T22:18:58.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.688+0000 7f6bde340640 1 -- start start 2023-07-21T22:18:58.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.688+0000 7f6bde340640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd806aff0 0x7f6bd80c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.688+0000 7f6bde340640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bd80ca0b0 0x7f6bd81591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.692+0000 7f6bd7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd806aff0 0x7f6bd80c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.692+0000 7f6bd7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd806aff0 0x7f6bd80c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35678/0 (socket says 172.21.15.6:35678) 2023-07-21T22:18:58.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.692+0000 7f6bd7fff640 1 -- 172.21.15.6:0/2905902430 learned_addr learned my addr 172.21.15.6:0/2905902430 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:58.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.692+0000 7f6bde340640 1 --2- 172.21.15.6:0/2905902430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bd80caed0 0x7f6bd8159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.692+0000 7f6bde340640 1 -- 172.21.15.6:0/2905902430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd81f1020 con 0x7f6bd80ca0b0 2023-07-21T22:18:58.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.692+0000 7f6bd77fe640 1 --2- 172.21.15.6:0/2905902430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bd80ca0b0 0x7f6bd81591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.692+0000 7f6bde340640 1 -- 172.21.15.6:0/2905902430 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd81eff80 con 0x7f6bd806aff0 2023-07-21T22:18:58.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.692+0000 7f6bde340640 1 -- 172.21.15.6:0/2905902430 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd81f0260 con 0x7f6bd80caed0 2023-07-21T22:18:58.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.692+0000 7f6bd7fff640 1 -- 172.21.15.6:0/2905902430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bd80caed0 msgr2=0x7f6bd8159720 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T22:18:58.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.692+0000 7f6bd7fff640 1 --2- 172.21.15.6:0/2905902430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bd80caed0 0x7f6bd8159720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.692+0000 7f6bd7fff640 1 -- 172.21.15.6:0/2905902430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bd80ca0b0 msgr2=0x7f6bd81591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.692+0000 7f6bd7fff640 1 --2- 172.21.15.6:0/2905902430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bd80ca0b0 0x7f6bd81591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.692+0000 7f6bd7fff640 1 -- 172.21.15.6:0/2905902430 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd0009b30 con 0x7f6bd806aff0 2023-07-21T22:18:58.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.692+0000 7f6bd77fe640 1 --2- 172.21.15.6:0/2905902430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bd80ca0b0 0x7f6bd81591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:58.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.692+0000 7f6bd7fff640 1 --2- 172.21.15.6:0/2905902430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd806aff0 0x7f6bd80c78a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800c7f0 tx=0x7f6bc800ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.692+0000 7f6bd4ff9640 1 -- 172.21.15.6:0/2905902430 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8007820 con 0x7f6bd806aff0 2023-07-21T22:18:58.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.692+0000 7f6bd4ff9640 1 -- 172.21.15.6:0/2905902430 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc8007980 con 0x7f6bd806aff0 2023-07-21T22:18:58.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.692+0000 7f6bde340640 1 -- 172.21.15.6:0/2905902430 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bd81f0540 con 0x7f6bd806aff0 2023-07-21T22:18:58.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.696+0000 7f6bde340640 1 -- 172.21.15.6:0/2905902430 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd81f0b00 con 0x7f6bd806aff0 2023-07-21T22:18:58.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.696+0000 7f6bd4ff9640 1 -- 172.21.15.6:0/2905902430 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8007d30 con 0x7f6bd806aff0 2023-07-21T22:18:58.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.700+0000 7f6bd4ff9640 1 -- 172.21.15.6:0/2905902430 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6bc80113f0 con 0x7f6bd806aff0 2023-07-21T22:18:58.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.700+0000 7f6bd4ff9640 1 --2- 172.21.15.6:0/2905902430 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6bc00664c0 0x7f6bc0068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.700+0000 7f6bd77fe640 1 --2- 172.21.15.6:0/2905902430 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6bc00664c0 0x7f6bc0068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.700+0000 7f6bd4ff9640 1 -- 172.21.15.6:0/2905902430 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6bc8083f20 con 0x7f6bd806aff0 2023-07-21T22:18:58.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.704+0000 7f6bd77fe640 1 --2- 172.21.15.6:0/2905902430 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6bc00664c0 0x7f6bc0068970 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00b1000 tx=0x7f6bd00aa000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.704+0000 7f6bde340640 1 -- 172.21.15.6:0/2905902430 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb8005260 con 0x7f6bd806aff0 2023-07-21T22:18:58.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.708+0000 7f6bd4ff9640 1 -- 172.21.15.6:0/2905902430 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6bc80514c0 con 0x7f6bd806aff0 2023-07-21T22:18:58.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.748+0000 7f1a51182640 1 Processor -- start 2023-07-21T22:18:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.748+0000 7f1a51182640 1 -- start start 2023-07-21T22:18:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.748+0000 7f1a51182640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1a4c157990 0x7f1a4c0c8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.748+0000 7f1a51182640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1a4c06b700 0x7f1a4c069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.748+0000 7f1a51182640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a4c158fb0 con 0x7f1a4c0ca0b0 2023-07-21T22:18:58.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.748+0000 7f1a51182640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4c0cb6a0 con 0x7f1a4c157990 2023-07-21T22:18:58.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.748+0000 7f1a51182640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4c06bb80 con 0x7f1a4c06b700 2023-07-21T22:18:58.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.748+0000 7f1a4b59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1a4c06b700 0x7f1a4c069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.748+0000 7f1a4b59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1a4c06b700 0x7f1a4c069430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35692/0 (socket says 172.21.15.6:35692) 2023-07-21T22:18:58.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.748+0000 7f1a4b59e640 1 -- 172.21.15.6:0/959891788 learned_addr learned my addr 172.21.15.6:0/959891788 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:58.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.748+0000 7f1a4a59c640 1 --1- 172.21.15.6:0/959891788 >> v1:172.21.15.6:6789/0 conn(0x7f1a4c0ca0b0 0x7f1a4c06aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39916/0 (socket says 172.21.15.6:39916) 2023-07-21T22:18:58.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7fc57cd74640 1 Processor -- start 2023-07-21T22:18:58.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7f1a4b59e640 1 -- 172.21.15.6:0/959891788 >> v2:172.21.15.6:3300/0 conn(0x7f1a4c157990 msgr2=0x7f1a4c0c8300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:18:58.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7fc57cd74640 1 -- start start 2023-07-21T22:18:58.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7f1a49d9b640 1 -- 172.21.15.6:0/959891788 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251133193 0 0) 0x7f1a4c158fb0 con 0x7f1a4c0ca0b0 2023-07-21T22:18:58.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7f1a4ad9d640 1 --2- 172.21.15.6:0/959891788 >> v2:172.21.15.6:3300/0 conn(0x7f1a4c157990 0x7f1a4c0c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7f1a4b59e640 1 --2- 172.21.15.6:0/959891788 >> v2:172.21.15.6:3300/0 conn(0x7f1a4c157990 0x7f1a4c0c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7f1a4b59e640 1 -- 172.21.15.6:0/959891788 >> v1:172.21.15.6:6789/0 conn(0x7f1a4c0ca0b0 legacy=0x7f1a4c06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7f1a4b59e640 1 -- 172.21.15.6:0/959891788 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c0ca550 con 0x7f1a4c06b700 2023-07-21T22:18:58.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7f1a4ad9d640 1 --2- 172.21.15.6:0/959891788 >> v2:172.21.15.6:3300/0 conn(0x7f1a4c157990 0x7f1a4c0c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:58.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7fddf899f640 1 Processor -- start 2023-07-21T22:18:58.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7f50973e9640 1 Processor -- start 2023-07-21T22:18:58.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7fddf899f640 1 -- start start 2023-07-21T22:18:58.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7fc57cd74640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc5780ce870 0x7fc57806c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7fc57cd74640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5780ca3b0 0x7fc57815bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7fc57cd74640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc57806b1e0 0x7fc57806b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7fc57cd74640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57806bb90 con 0x7fc57806b1e0 2023-07-21T22:18:58.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7fc57cd74640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57815c260 con 0x7fc5780ce870 2023-07-21T22:18:58.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7fc57cd74640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc578141900 con 0x7fc5780ca3b0 2023-07-21T22:18:58.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7fc576d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc57806b1e0 0x7fc57806b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7fc576d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc57806b1e0 0x7fc57806b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58242/0 (socket says 172.21.15.6:58242) 2023-07-21T22:18:58.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7fc576d9d640 1 -- 172.21.15.6:0/1307166117 learned_addr learned my addr 172.21.15.6:0/1307166117 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:58.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7fddf899f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fddf40ad460 0x7fddf406b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7fddf899f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddf406b720 0x7fddf40ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7fddf899f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf415f8a0 con 0x7fddf40c9e70 2023-07-21T22:18:58.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7fddf899f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf406bba0 con 0x7fddf40ad460 2023-07-21T22:18:58.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7fddf899f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf415c1b0 con 0x7fddf406b720 2023-07-21T22:18:58.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.752+0000 7f50973e9640 1 -- start start 2023-07-21T22:18:58.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7f50973e9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5090157990 0x7f50900c8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7f50973e9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f509006b700 0x7f5090069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7f50973e9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5090158fb0 con 0x7f50900ca0b0 2023-07-21T22:18:58.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7f50973e9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50900cb6a0 con 0x7f509006b700 2023-07-21T22:18:58.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7f50973e9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509006bb80 con 0x7f5090157990 2023-07-21T22:18:58.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7fddf2d9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddf406b720 0x7fddf40ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7fddf2d9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddf406b720 0x7fddf40ab8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:56556/0 (socket says 172.21.15.6:56556) 2023-07-21T22:18:58.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7fddf2d9d640 1 -- 172.21.15.6:0/1956675160 learned_addr learned my addr 172.21.15.6:0/1956675160 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:58.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7f5094984640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f50900ca0b0 0x7f509006aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:47018/0 (socket says 172.21.15.6:47018) 2023-07-21T22:18:58.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7f5094984640 1 -- 172.21.15.6:0/62072835 learned_addr learned my addr 172.21.15.6:0/62072835 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:58.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7fddf2d9d640 1 -- 172.21.15.6:0/1956675160 >> v2:172.21.15.6:3300/0 conn(0x7fddf40ad460 msgr2=0x7fddf406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:58.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7fddf2d9d640 1 --2- 172.21.15.6:0/1956675160 >> v2:172.21.15.6:3300/0 conn(0x7fddf40ad460 0x7fddf406b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7fddf2d9d640 1 -- 172.21.15.6:0/1956675160 >> v1:172.21.15.161:6789/0 conn(0x7fddf40c9e70 legacy=0x7fddf40cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:58.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7fddf2d9d640 1 -- 172.21.15.6:0/1956675160 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf40cdde0 con 0x7fddf406b720 2023-07-21T22:18:58.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7f5095185640 1 --2- 172.21.15.6:0/62072835 >> v2:172.21.15.161:3300/0 conn(0x7f5090157990 0x7f50900c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7f1a4b59e640 1 --2- 172.21.15.6:0/959891788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a4c06b700 0x7f1a4c069430 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0c8290 tx=0x7f1a3c01e9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c7a08674d93d3b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7fc576d9d640 1 -- 172.21.15.6:0/1307166117 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5780ca3b0 msgr2=0x7fc57815bd20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:18:58.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7fc576d9d640 1 --2- 172.21.15.6:0/1307166117 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5780ca3b0 0x7fc57815bd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7fc576d9d640 1 -- 172.21.15.6:0/1307166117 >> v2:172.21.15.161:3300/0 conn(0x7fc5780ce870 msgr2=0x7fc57806c000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:18:58.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7fc576d9d640 1 --2- 172.21.15.6:0/1307166117 >> v2:172.21.15.161:3300/0 conn(0x7fc5780ce870 0x7fc57806c000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7fc576d9d640 1 -- 172.21.15.6:0/1307166117 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57815ebd0 con 0x7fc57806b1e0 2023-07-21T22:18:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7f5087fff640 1 -- 172.21.15.6:0/62072835 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611548853 0 0) 0x7f5090158fb0 con 0x7f50900ca0b0 2023-07-21T22:18:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7f5087fff640 1 -- 172.21.15.6:0/62072835 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f507c003450 con 0x7f50900ca0b0 2023-07-21T22:18:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7f5087fff640 1 -- 172.21.15.6:0/62072835 <== mon.1 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2429901984 0 0) 0x7f507c003450 con 0x7f50900ca0b0 2023-07-21T22:18:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7f5095185640 1 -- 172.21.15.6:0/62072835 >> v2:172.21.15.6:3300/0 conn(0x7f509006b700 msgr2=0x7f5090069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7f5095185640 1 --2- 172.21.15.6:0/62072835 >> v2:172.21.15.6:3300/0 conn(0x7f509006b700 0x7f5090069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7f5095185640 1 -- 172.21.15.6:0/62072835 >> v1:172.21.15.161:6789/0 conn(0x7f50900ca0b0 legacy=0x7f509006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7f5095185640 1 -- 172.21.15.6:0/62072835 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50900ca550 con 0x7f5090157990 2023-07-21T22:18:58.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.760+0000 7fc576d9d640 1 --2- 172.21.15.6:0/1307166117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc57806b1e0 0x7fc57806b650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc5780cbc80 tx=0x7fc56801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161ba7c08ad65779 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.760+0000 7fc57559a640 1 -- 172.21.15.6:0/1307166117 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5680aa660 con 0x7fc57806b1e0 2023-07-21T22:18:58.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.760+0000 7fc57559a640 1 -- 172.21.15.6:0/1307166117 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5680aa7c0 con 0x7fc57806b1e0 2023-07-21T22:18:58.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.760+0000 7fddf2d9d640 1 --2- 172.21.15.6:0/1956675160 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddf406b720 0x7fddf40ab8a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009870 tx=0x7fdde401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4340f205aca011ac server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.760+0000 7fddf159a640 1 -- 172.21.15.6:0/1956675160 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde40aa5f0 con 0x7fddf406b720 2023-07-21T22:18:58.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.760+0000 7fddf159a640 1 -- 172.21.15.6:0/1956675160 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde40aa750 con 0x7fddf406b720 2023-07-21T22:18:58.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.760+0000 7fc57cd74640 1 -- 172.21.15.6:0/1307166117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc57806b1e0 msgr2=0x7fc57806b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.760+0000 7fc57cd74640 1 --2- 172.21.15.6:0/1307166117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc57806b1e0 0x7fc57806b650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc5780cbc80 tx=0x7fc56801c540 comp rx=0 tx=0).stop 2023-07-21T22:18:58.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7f1a49d9b640 1 -- 172.21.15.6:0/959891788 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0a7ab0 con 0x7f1a4c06b700 2023-07-21T22:18:58.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7f1a49d9b640 1 -- 172.21.15.6:0/959891788 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c0ab070 con 0x7f1a4c06b700 2023-07-21T22:18:58.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.756+0000 7f1a49d9b640 1 -- 172.21.15.6:0/959891788 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0a7e30 con 0x7f1a4c06b700 2023-07-21T22:18:58.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.760+0000 7f1a51182640 1 -- 172.21.15.6:0/959891788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a4c06b700 msgr2=0x7f1a4c069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.760+0000 7f1a51182640 1 --2- 172.21.15.6:0/959891788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a4c06b700 0x7f1a4c069430 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0c8290 tx=0x7f1a3c01e9e0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.760+0000 7f1a51182640 1 -- 172.21.15.6:0/959891788 shutdown_connections 2023-07-21T22:18:58.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.760+0000 7f1a51182640 1 --2- 172.21.15.6:0/959891788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a4c06b700 0x7f1a4c069430 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.760+0000 7f1a51182640 1 --2- 172.21.15.6:0/959891788 >> v2:172.21.15.6:3300/0 conn(0x7f1a4c157990 0x7f1a4c0c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.760+0000 7f1a51182640 1 -- 172.21.15.6:0/959891788 >> 172.21.15.6:0/959891788 conn(0x7f1a4c0ce980 msgr2=0x7f1a4c0ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:58.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.760+0000 7f1a51182640 1 -- 172.21.15.6:0/959891788 shutdown_connections 2023-07-21T22:18:58.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.760+0000 7f1a51182640 1 -- 172.21.15.6:0/959891788 wait complete. 2023-07-21T22:18:58.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7fddf159a640 1 -- 172.21.15.6:0/1956675160 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde40aaae0 con 0x7fddf406b720 2023-07-21T22:18:58.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7fddf899f640 1 -- 172.21.15.6:0/1956675160 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddf406b720 msgr2=0x7fddf40ab8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7fddf899f640 1 --2- 172.21.15.6:0/1956675160 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddf406b720 0x7fddf40ab8a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009870 tx=0x7fdde401c4d0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f1a51182640 1 Processor -- start 2023-07-21T22:18:58.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f5095185640 1 --2- 172.21.15.6:0/62072835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5090157990 0x7f50900c8300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f509006a7a0 tx=0x7f508c020760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cb4e2157bfb0bdf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f1a51182640 1 -- start start 2023-07-21T22:18:58.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7fc57cd74640 1 -- 172.21.15.6:0/1307166117 shutdown_connections 2023-07-21T22:18:58.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7fc57cd74640 1 --2- 172.21.15.6:0/1307166117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc57806b1e0 0x7fc57806b650 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7fc57cd74640 1 --2- 172.21.15.6:0/1307166117 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5780ca3b0 0x7fc57815bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7fc57cd74640 1 --2- 172.21.15.6:0/1307166117 >> v2:172.21.15.161:3300/0 conn(0x7fc5780ce870 0x7fc57806c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7fddf899f640 1 -- 172.21.15.6:0/1956675160 shutdown_connections 2023-07-21T22:18:58.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7fddf899f640 1 --2- 172.21.15.6:0/1956675160 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddf406b720 0x7fddf40ab8a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7fc57cd74640 1 -- 172.21.15.6:0/1307166117 >> 172.21.15.6:0/1307166117 conn(0x7fc5780b0980 msgr2=0x7fc5780ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:58.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7fddf899f640 1 --2- 172.21.15.6:0/1956675160 >> v2:172.21.15.6:3300/0 conn(0x7fddf40ad460 0x7fddf406b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7fddf899f640 1 -- 172.21.15.6:0/1956675160 >> 172.21.15.6:0/1956675160 conn(0x7fddf40b0980 msgr2=0x7fddf40ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:58.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7fddf899f640 1 -- 172.21.15.6:0/1956675160 shutdown_connections 2023-07-21T22:18:58.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f5087fff640 1 -- 172.21.15.6:0/62072835 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080004ce0 con 0x7f5090157990 2023-07-21T22:18:58.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7fc57cd74640 1 -- 172.21.15.6:0/1307166117 shutdown_connections 2023-07-21T22:18:58.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7fddf899f640 1 -- 172.21.15.6:0/1956675160 wait complete. 2023-07-21T22:18:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f5087fff640 1 -- 172.21.15.6:0/62072835 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508c0aa4b0 con 0x7f5090157990 2023-07-21T22:18:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f50973e9640 1 -- 172.21.15.6:0/62072835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5090157990 msgr2=0x7f50900c8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f50973e9640 1 --2- 172.21.15.6:0/62072835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5090157990 0x7f50900c8300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f509006a7a0 tx=0x7f508c020760 comp rx=0 tx=0).stop 2023-07-21T22:18:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f1a51182640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a4c06b700 0x7f1a4c1521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f1a51182640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a4c0ca0b0 0x7f1a4c0b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7fc57cd74640 1 -- 172.21.15.6:0/1307166117 wait complete. 2023-07-21T22:18:58.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f50973e9640 1 -- 172.21.15.6:0/62072835 shutdown_connections 2023-07-21T22:18:58.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f50973e9640 1 --2- 172.21.15.6:0/62072835 >> v2:172.21.15.6:3300/0 conn(0x7f509006b700 0x7f5090069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f50973e9640 1 --2- 172.21.15.6:0/62072835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5090157990 0x7f50900c8300 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f50973e9640 1 -- 172.21.15.6:0/62072835 >> 172.21.15.6:0/62072835 conn(0x7f50900ce980 msgr2=0x7f50900ca7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:58.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f1a4ad9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a4c06b700 0x7f1a4c1521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f1a4ad9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a4c06b700 0x7f1a4c1521f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:56564/0 (socket says 172.21.15.6:56564) 2023-07-21T22:18:58.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f1a4a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a4c0ca0b0 0x7f1a4c0b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f1a4a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a4c0ca0b0 0x7f1a4c0b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58266/0 (socket says 172.21.15.6:58266) 2023-07-21T22:18:58.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f1a4ad9d640 1 -- 172.21.15.6:0/2599474402 learned_addr learned my addr 172.21.15.6:0/2599474402 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:58.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f1a51182640 1 --2- 172.21.15.6:0/2599474402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a4c157990 0x7f1a4c151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f1a51182640 1 -- 172.21.15.6:0/2599474402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c153870 con 0x7f1a4c0ca0b0 2023-07-21T22:18:58.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f1a51182640 1 -- 172.21.15.6:0/2599474402 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c089090 con 0x7f1a4c157990 2023-07-21T22:18:58.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7f1a51182640 1 -- 172.21.15.6:0/2599474402 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c1527d0 con 0x7f1a4c06b700 2023-07-21T22:18:58.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7fc57cd74640 1 Processor -- start 2023-07-21T22:18:58.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.764+0000 7fddf899f640 1 Processor -- start 2023-07-21T22:18:58.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fddf899f640 1 -- start start 2023-07-21T22:18:58.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7f50973e9640 1 -- 172.21.15.6:0/62072835 shutdown_connections 2023-07-21T22:18:58.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fc57cd74640 1 -- start start 2023-07-21T22:18:58.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7f1a4ad9d640 1 -- 172.21.15.6:0/2599474402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a4c157990 msgr2=0x7f1a4c151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7f1a4ad9d640 1 --2- 172.21.15.6:0/2599474402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a4c157990 0x7f1a4c151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7f1a4ad9d640 1 -- 172.21.15.6:0/2599474402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a4c0ca0b0 msgr2=0x7f1a4c0b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7f1a4ad9d640 1 --2- 172.21.15.6:0/2599474402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a4c0ca0b0 0x7f1a4c0b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7f1a4ad9d640 1 -- 172.21.15.6:0/2599474402 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c008550 con 0x7f1a4c06b700 2023-07-21T22:18:58.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fc57cd74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc57806b1e0 0x7fc57814ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fc57cd74640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5780ca3b0 0x7fc578159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fc57cd74640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5780ce870 0x7fc578159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fc57cd74640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc578153de0 con 0x7fc57806b1e0 2023-07-21T22:18:58.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fc575d9b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5780ca3b0 0x7fc578159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fc57cd74640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc578152fb0 con 0x7fc5780ce870 2023-07-21T22:18:58.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fc57cd74640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5780b2040 con 0x7fc5780ca3b0 2023-07-21T22:18:58.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fc575d9b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5780ca3b0 0x7fc578159450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:56566/0 (socket says 172.21.15.6:56566) 2023-07-21T22:18:58.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fc575d9b640 1 -- 172.21.15.6:0/2572186349 learned_addr learned my addr 172.21.15.6:0/2572186349 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:58.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fc576d9d640 1 --2- 172.21.15.6:0/2572186349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5780ce870 0x7fc578159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fddf899f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddf406b720 0x7fddf4157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fddf899f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddf40ad460 0x7fddf40c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fddf899f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddf40c9e70 0x7fddf4155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fddf899f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf415f740 con 0x7fddf406b720 2023-07-21T22:18:58.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fddf899f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf415f180 con 0x7fddf40ad460 2023-07-21T22:18:58.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fddf899f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf415f460 con 0x7fddf40c9e70 2023-07-21T22:18:58.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fddf1d9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddf40ad460 0x7fddf40c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fddf1d9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddf40ad460 0x7fddf40c2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35726/0 (socket says 172.21.15.6:35726) 2023-07-21T22:18:58.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fddf1d9b640 1 -- 172.21.15.6:0/2987492600 learned_addr learned my addr 172.21.15.6:0/2987492600 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:58.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fddf2d9d640 1 --2- 172.21.15.6:0/2987492600 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddf40c9e70 0x7fddf4155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fddf1d9b640 1 -- 172.21.15.6:0/2987492600 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddf40c9e70 msgr2=0x7fddf4155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fddf1d9b640 1 --2- 172.21.15.6:0/2987492600 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddf40c9e70 0x7fddf4155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fddf1d9b640 1 -- 172.21.15.6:0/2987492600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddf406b720 msgr2=0x7fddf4157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fddf1d9b640 1 --2- 172.21.15.6:0/2987492600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddf406b720 0x7fddf4157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fddf1d9b640 1 -- 172.21.15.6:0/2987492600 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde40094d0 con 0x7fddf40ad460 2023-07-21T22:18:58.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fc575d9b640 1 -- 172.21.15.6:0/2572186349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5780ce870 msgr2=0x7fc578159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fc575d9b640 1 --2- 172.21.15.6:0/2572186349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5780ce870 0x7fc578159990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fc575d9b640 1 -- 172.21.15.6:0/2572186349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc57806b1e0 msgr2=0x7fc57814ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fc575d9b640 1 --2- 172.21.15.6:0/2572186349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc57806b1e0 0x7fc57814ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fc575d9b640 1 -- 172.21.15.6:0/2572186349 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5680094d0 con 0x7fc5780ca3b0 2023-07-21T22:18:58.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7f50973e9640 1 -- 172.21.15.6:0/62072835 wait complete. 2023-07-21T22:18:58.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7f50973e9640 1 Processor -- start 2023-07-21T22:18:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fc575d9b640 1 --2- 172.21.15.6:0/2572186349 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5780ca3b0 0x7fc578159450 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00b3e0 tx=0x7fc56c00b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fddf1d9b640 1 --2- 172.21.15.6:0/2987492600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddf40ad460 0x7fddf40c2ce0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdde800b550 tx=0x7fdde800ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7f1a4ad9d640 1 --2- 172.21.15.6:0/2599474402 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a4c06b700 0x7f1a4c1521f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000c7c0 tx=0x7f1a4000cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fdde2ffd640 1 -- 172.21.15.6:0/2987492600 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8010870 con 0x7fddf40ad460 2023-07-21T22:18:58.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fc566ffd640 1 -- 172.21.15.6:0/2572186349 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c011830 con 0x7fc5780ca3b0 2023-07-21T22:18:58.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7fdde2ffd640 1 -- 172.21.15.6:0/2987492600 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde80109f0 con 0x7fddf40ad460 2023-07-21T22:18:58.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.768+0000 7f93c5293640 1 Processor -- start 2023-07-21T22:18:58.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7fdde2ffd640 1 -- 172.21.15.6:0/2987492600 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8010da0 con 0x7fddf40ad460 2023-07-21T22:18:58.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7fddf899f640 1 -- 172.21.15.6:0/2987492600 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf40b1170 con 0x7fddf40ad460 2023-07-21T22:18:58.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7fc57cd74640 1 -- 172.21.15.6:0/2572186349 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc578153250 con 0x7fc5780ca3b0 2023-07-21T22:18:58.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7fc57cd74640 1 -- 172.21.15.6:0/2572186349 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc578153810 con 0x7fc5780ca3b0 2023-07-21T22:18:58.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7fddf899f640 1 -- 172.21.15.6:0/2987492600 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf4070200 con 0x7fddf40ad460 2023-07-21T22:18:58.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7f93c5293640 1 -- start start 2023-07-21T22:18:58.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7fc566ffd640 1 -- 172.21.15.6:0/2572186349 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c011990 con 0x7fc5780ca3b0 2023-07-21T22:18:58.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7fddf899f640 1 -- 172.21.15.6:0/2987492600 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf40678d0 con 0x7fddf40ad460 2023-07-21T22:18:58.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7fc566ffd640 1 -- 172.21.15.6:0/2572186349 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c011d60 con 0x7fc5780ca3b0 2023-07-21T22:18:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7f1a337fe640 1 -- 172.21.15.6:0/2599474402 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a400079b0 con 0x7f1a4c06b700 2023-07-21T22:18:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7f1a337fe640 1 -- 172.21.15.6:0/2599474402 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a40007b10 con 0x7f1a4c06b700 2023-07-21T22:18:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7f1a337fe640 1 -- 172.21.15.6:0/2599474402 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4000ce70 con 0x7f1a4c06b700 2023-07-21T22:18:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7f1a51182640 1 -- 172.21.15.6:0/2599474402 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a4c152ab0 con 0x7f1a4c06b700 2023-07-21T22:18:58.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7f1a51182640 1 -- 172.21.15.6:0/2599474402 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4c153070 con 0x7f1a4c06b700 2023-07-21T22:18:58.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7f50973e9640 1 -- start start 2023-07-21T22:18:58.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7f50973e9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509006b700 0x7f50900be290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7f93c5293640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93b8036e10 0x7f93b8005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7f93beffd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f93b80e6a00 0x7f93b8036700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:47036/0 (socket says 172.21.15.6:47036) 2023-07-21T22:18:58.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7f93beffd640 1 -- 172.21.15.6:0/4209734012 learned_addr learned my addr 172.21.15.6:0/4209734012 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:58.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7f93be7fc640 1 --2- 172.21.15.6:0/4209734012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93b8036e10 0x7f93b8005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7f93c5293640 1 -- 172.21.15.6:0/4209734012 --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b8050d10 con 0x7f93b80e6dd0 2023-07-21T22:18:58.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7f93c5293640 1 -- 172.21.15.6:0/4209734012 --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b8050fb0 con 0x7f93b80e6a00 2023-07-21T22:18:58.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.772+0000 7f93c5293640 1 -- 172.21.15.6:0/4209734012 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b8051570 con 0x7f93b8036e10 2023-07-21T22:18:58.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f50973e9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50900ca0b0 0x7f5090200cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7fc57cd74640 1 -- 172.21.15.6:0/2572186349 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc55c005260 con 0x7fc5780ca3b0 2023-07-21T22:18:58.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f1a51182640 1 -- 172.21.15.6:0/2599474402 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a4c0678d0 con 0x7f1a4c06b700 2023-07-21T22:18:58.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f93be7fc640 1 -- 172.21.15.6:0/4209734012 >> v1:172.21.15.161:6789/0 conn(0x7f93b80e6a00 legacy=0x7f93b8036700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f93be7fc640 1 -- 172.21.15.6:0/4209734012 >> v1:172.21.15.6:6789/0 conn(0x7f93b80e6dd0 legacy=0x7f93b8052f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f93be7fc640 1 -- 172.21.15.6:0/4209734012 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b8051290 con 0x7f93b8036e10 2023-07-21T22:18:58.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7fc566ffd640 1 -- 172.21.15.6:0/2572186349 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc56c01a400 con 0x7fc5780ca3b0 2023-07-21T22:18:58.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7fdde2ffd640 1 -- 172.21.15.6:0/2987492600 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdde800f3c0 con 0x7fddf40ad460 2023-07-21T22:18:58.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7fdde2ffd640 1 --2- 172.21.15.6:0/2987492600 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fddd4066280 0x7fddd4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7fdde2ffd640 1 -- 172.21.15.6:0/2987492600 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdde8083d20 con 0x7fddf40ad460 2023-07-21T22:18:58.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f50973e9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5090157990 0x7f50900c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f50973e9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50900c1fc0 con 0x7f50900ca0b0 2023-07-21T22:18:58.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f50973e9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50900c7810 con 0x7f5090157990 2023-07-21T22:18:58.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f50973e9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50900be7d0 con 0x7f509006b700 2023-07-21T22:18:58.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f5094984640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50900ca0b0 0x7f5090200cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f5094984640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50900ca0b0 0x7f5090200cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58286/0 (socket says 172.21.15.6:58286) 2023-07-21T22:18:58.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f5094984640 1 -- 172.21.15.6:0/1576529631 learned_addr learned my addr 172.21.15.6:0/1576529631 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:58.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7fddf259c640 1 --2- 172.21.15.6:0/2987492600 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fddd4066280 0x7fddd4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f5094984640 1 -- 172.21.15.6:0/1576529631 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509006b700 msgr2=0x7f50900be290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f1a337fe640 1 -- 172.21.15.6:0/2599474402 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1a400193f0 con 0x7f1a4c06b700 2023-07-21T22:18:58.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f5095185640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509006b700 0x7f50900be290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f5094984640 1 --2- 172.21.15.6:0/1576529631 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509006b700 0x7f50900be290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f5094984640 1 -- 172.21.15.6:0/1576529631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5090157990 msgr2=0x7f50900c6ea0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T22:18:58.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f5094984640 1 --2- 172.21.15.6:0/1576529631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5090157990 0x7f50900c6ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f5094984640 1 -- 172.21.15.6:0/1576529631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c009420 con 0x7f50900ca0b0 2023-07-21T22:18:58.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f5095185640 1 --2- 172.21.15.6:0/1576529631 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509006b700 0x7f50900be290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:58.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7fc566ffd640 1 --2- 172.21.15.6:0/2572186349 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc558066350 0x7fc558068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7fc566ffd640 1 -- 172.21.15.6:0/2572186349 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc56c083d90 con 0x7fc5780ca3b0 2023-07-21T22:18:58.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7fddf259c640 1 --2- 172.21.15.6:0/2987492600 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fddd4066280 0x7fddd4068730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fddf406dde0 tx=0x7fddec009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f571e92c640 1 Processor -- start 2023-07-21T22:18:58.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.776+0000 7f5094984640 1 --2- 172.21.15.6:0/1576529631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50900ca0b0 0x7f5090200cc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f508000d970 tx=0x7f508000de30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7fc57659c640 1 --2- 172.21.15.6:0/2572186349 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc558066350 0x7fc558068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f1a337fe640 1 --2- 172.21.15.6:0/2599474402 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1a380662d0 0x7f1a38068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f1a337fe640 1 -- 172.21.15.6:0/2599474402 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a40084110 con 0x7f1a4c06b700 2023-07-21T22:18:58.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f5085ffb640 1 -- 172.21.15.6:0/1576529631 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080008b80 con 0x7f50900ca0b0 2023-07-21T22:18:58.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f5085ffb640 1 -- 172.21.15.6:0/1576529631 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5080008ce0 con 0x7f50900ca0b0 2023-07-21T22:18:58.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f5085ffb640 1 -- 172.21.15.6:0/1576529631 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080010660 con 0x7f50900ca0b0 2023-07-21T22:18:58.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f50973e9640 1 -- 172.21.15.6:0/1576529631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50900c1620 con 0x7f50900ca0b0 2023-07-21T22:18:58.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7fc57659c640 1 --2- 172.21.15.6:0/2572186349 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc558066350 0x7fc558068800 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc57000abb0 tx=0x7fc570009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7fdde2ffd640 1 -- 172.21.15.6:0/2987492600 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdde80511b0 con 0x7fddf40ad460 2023-07-21T22:18:58.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f1a4a59c640 1 --2- 172.21.15.6:0/2599474402 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1a380662d0 0x7f1a38068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f50973e9640 1 -- 172.21.15.6:0/1576529631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50900c1be0 con 0x7f50900ca0b0 2023-07-21T22:18:58.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f93be7fc640 1 --2- 172.21.15.6:0/4209734012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93b8036e10 0x7f93b8005f90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009770 tx=0x7f93b401c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9e4cad74ff1b4aa server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f1a4a59c640 1 --2- 172.21.15.6:0/2599474402 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1a380662d0 0x7f1a38068780 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0c7fb0 tx=0x7f1a44007f40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f571e92c640 1 -- start start 2023-07-21T22:18:58.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f571e92c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f571000ddc0 0x7f57100e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f571e92c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5710055200 0x7f57100eaa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f571e92c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57100e81a0 con 0x7f571000e190 2023-07-21T22:18:58.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f571e92c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5710036300 con 0x7f571000ddc0 2023-07-21T22:18:58.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f571e92c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57100e7870 con 0x7f5710055200 2023-07-21T22:18:58.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f5717fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f571000ddc0 0x7f57100e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f5717fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f571000ddc0 0x7f57100e71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35756/0 (socket says 172.21.15.6:35756) 2023-07-21T22:18:58.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f5717fff640 1 -- 172.21.15.6:0/3161934869 learned_addr learned my addr 172.21.15.6:0/3161934869 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:58.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f50973e9640 1 -- 172.21.15.6:0/1576529631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50900c2100 con 0x7f50900ca0b0 2023-07-21T22:18:58.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f571cec9640 1 --2- 172.21.15.6:0/3161934869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5710055200 0x7f57100eaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f5717fff640 1 -- 172.21.15.6:0/3161934869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5710055200 msgr2=0x7f57100eaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:58.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f5717fff640 1 --2- 172.21.15.6:0/3161934869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5710055200 0x7f57100eaa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f5717fff640 1 -- 172.21.15.6:0/3161934869 >> v1:172.21.15.161:6789/0 conn(0x7f571000e190 legacy=0x7f5710054af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.780+0000 7f5717fff640 1 -- 172.21.15.6:0/3161934869 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57100e7b50 con 0x7f571000ddc0 2023-07-21T22:18:58.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.784+0000 7f5085ffb640 1 -- 172.21.15.6:0/1576529631 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f50800107c0 con 0x7f50900ca0b0 2023-07-21T22:18:58.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.784+0000 7fc566ffd640 1 -- 172.21.15.6:0/2572186349 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc56c0512c0 con 0x7fc5780ca3b0 2023-07-21T22:18:58.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.784+0000 7f5085ffb640 1 --2- 172.21.15.6:0/1576529631 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5074066350 0x7f5074068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.784+0000 7f5085ffb640 1 -- 172.21.15.6:0/1576529631 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5080009040 con 0x7f50900ca0b0 2023-07-21T22:18:58.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.784+0000 7f5095185640 1 --2- 172.21.15.6:0/1576529631 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5074066350 0x7f5074068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.784+0000 7f5095185640 1 --2- 172.21.15.6:0/1576529631 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5074066350 0x7f5074068800 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f508c0b3000 tx=0x7f508c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.788+0000 7f1a337fe640 1 -- 172.21.15.6:0/2599474402 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1a40051600 con 0x7f1a4c06b700 2023-07-21T22:18:58.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.788+0000 7f93bdffb640 1 -- 172.21.15.6:0/4209734012 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b40ab600 con 0x7f93b8036e10 2023-07-21T22:18:58.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.788+0000 7f93bdffb640 1 -- 172.21.15.6:0/4209734012 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b40a7050 con 0x7f93b8036e10 2023-07-21T22:18:58.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.788+0000 7f93bdffb640 1 -- 172.21.15.6:0/4209734012 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b40ab980 con 0x7f93b8036e10 2023-07-21T22:18:58.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.788+0000 7f5717fff640 1 --2- 172.21.15.6:0/3161934869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f571000ddc0 0x7f57100e71c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f570c009870 tx=0x7f570c01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=512a245d86cbb561 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.788+0000 7f5716ffd640 1 -- 172.21.15.6:0/3161934869 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c0ab650 con 0x7f571000ddc0 2023-07-21T22:18:58.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.788+0000 7f5716ffd640 1 -- 172.21.15.6:0/3161934869 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570c0ab7b0 con 0x7f571000ddc0 2023-07-21T22:18:58.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.788+0000 7f93c5293640 1 -- 172.21.15.6:0/4209734012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93b8036e10 msgr2=0x7f93b8005f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.788+0000 7f93c5293640 1 --2- 172.21.15.6:0/4209734012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93b8036e10 0x7f93b8005f90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009770 tx=0x7f93b401c370 comp rx=0 tx=0).stop 2023-07-21T22:18:58.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.788+0000 7f5716ffd640 1 -- 172.21.15.6:0/3161934869 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c0abb40 con 0x7f571000ddc0 2023-07-21T22:18:58.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.788+0000 7f93c5293640 1 -- 172.21.15.6:0/4209734012 shutdown_connections 2023-07-21T22:18:58.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.788+0000 7f93c5293640 1 --2- 172.21.15.6:0/4209734012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93b8036e10 0x7f93b8005f90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.788+0000 7f93c5293640 1 -- 172.21.15.6:0/4209734012 >> 172.21.15.6:0/4209734012 conn(0x7f93b8051700 msgr2=0x7f93b8051b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:58.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.788+0000 7f93c5293640 1 -- 172.21.15.6:0/4209734012 shutdown_connections 2023-07-21T22:18:58.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.788+0000 7f93c5293640 1 -- 172.21.15.6:0/4209734012 wait complete. 2023-07-21T22:18:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.792+0000 7f93c5293640 1 Processor -- start 2023-07-21T22:18:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.792+0000 7f93c5293640 1 -- start start 2023-07-21T22:18:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.792+0000 7f5085ffb640 1 -- 172.21.15.6:0/1576529631 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50900c2100 con 0x7f50900ca0b0 2023-07-21T22:18:58.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.792+0000 7f93c5293640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93b8036e10 0x7f93b80d53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.792+0000 7f93c5293640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b80e6a00 0x7f93b80db560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93beffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93b8036e10 0x7f93b80d53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93beffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93b8036e10 0x7f93b80d53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35762/0 (socket says 172.21.15.6:35762) 2023-07-21T22:18:58.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93be7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b80e6a00 0x7f93b80db560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93be7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b80e6a00 0x7f93b80db560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58292/0 (socket says 172.21.15.6:58292) 2023-07-21T22:18:58.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93beffd640 1 -- 172.21.15.6:0/3109142496 learned_addr learned my addr 172.21.15.6:0/3109142496 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:58.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93c5293640 1 --2- 172.21.15.6:0/3109142496 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93b80e6dd0 0x7f93b80e2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f571e92c640 1 -- 172.21.15.6:0/3161934869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f571000ddc0 msgr2=0x7f57100e71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f571e92c640 1 --2- 172.21.15.6:0/3161934869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f571000ddc0 0x7f57100e71c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f570c009870 tx=0x7f570c01c510 comp rx=0 tx=0).stop 2023-07-21T22:18:58.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93c5293640 1 -- 172.21.15.6:0/3109142496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b80da3a0 con 0x7f93b80e6a00 2023-07-21T22:18:58.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93c5293640 1 -- 172.21.15.6:0/3109142496 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b80d58e0 con 0x7f93b8036e10 2023-07-21T22:18:58.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93bffff640 1 --2- 172.21.15.6:0/3109142496 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93b80e6dd0 0x7f93b80e2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f571e92c640 1 -- 172.21.15.6:0/3161934869 shutdown_connections 2023-07-21T22:18:58.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f571e92c640 1 --2- 172.21.15.6:0/3161934869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5710055200 0x7f57100eaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f571e92c640 1 --2- 172.21.15.6:0/3161934869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f571000ddc0 0x7f57100e71c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f571e92c640 1 -- 172.21.15.6:0/3161934869 >> 172.21.15.6:0/3161934869 conn(0x7f571000cff0 msgr2=0x7f5710056e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:58.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93c5293640 1 -- 172.21.15.6:0/3109142496 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b80d9790 con 0x7f93b80e6dd0 2023-07-21T22:18:58.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f571e92c640 1 -- 172.21.15.6:0/3161934869 shutdown_connections 2023-07-21T22:18:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93beffd640 1 -- 172.21.15.6:0/3109142496 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93b80e6dd0 msgr2=0x7f93b80e2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93beffd640 1 --2- 172.21.15.6:0/3109142496 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93b80e6dd0 0x7f93b80e2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93beffd640 1 -- 172.21.15.6:0/3109142496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b80e6a00 msgr2=0x7f93b80db560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93beffd640 1 --2- 172.21.15.6:0/3109142496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b80e6a00 0x7f93b80db560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93beffd640 1 -- 172.21.15.6:0/3109142496 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b4009420 con 0x7f93b8036e10 2023-07-21T22:18:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93beffd640 1 --2- 172.21.15.6:0/3109142496 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93b8036e10 0x7f93b80d53a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f93c00630c0 tx=0x7f93c004da60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93a77fe640 1 -- 172.21.15.6:0/3109142496 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c00711c0 con 0x7f93b8036e10 2023-07-21T22:18:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93a77fe640 1 -- 172.21.15.6:0/3109142496 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c0071320 con 0x7f93b8036e10 2023-07-21T22:18:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93a77fe640 1 -- 172.21.15.6:0/3109142496 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c00716d0 con 0x7f93b8036e10 2023-07-21T22:18:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93c5293640 1 -- 172.21.15.6:0/3109142496 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b80d9a70 con 0x7f93b8036e10 2023-07-21T22:18:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f93c5293640 1 -- 172.21.15.6:0/3109142496 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b80da030 con 0x7f93b8036e10 2023-07-21T22:18:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.796+0000 7f571e92c640 1 -- 172.21.15.6:0/3161934869 wait complete. 2023-07-21T22:18:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.800+0000 7f571e92c640 1 Processor -- start 2023-07-21T22:18:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.800+0000 7f571e92c640 1 -- start start 2023-07-21T22:18:58.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.800+0000 7f93c5293640 1 -- 172.21.15.6:0/3109142496 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a0005260 con 0x7f93b8036e10 2023-07-21T22:18:58.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.800+0000 7f571e92c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f571000ddc0 0x7f57100d2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f5717fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f571000ddc0 0x7f57100d2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f5717fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f571000ddc0 0x7f57100d2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58308/0 (socket says 172.21.15.6:58308) 2023-07-21T22:18:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f5717fff640 1 -- 172.21.15.6:0/249914155 learned_addr learned my addr 172.21.15.6:0/249914155 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f571e92c640 1 --2- 172.21.15.6:0/249914155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f571000e190 0x7f57100530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f571e92c640 1 --2- 172.21.15.6:0/249914155 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5710055200 0x7f571004fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.800+0000 7f93a77fe640 1 -- 172.21.15.6:0/3109142496 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f93c0071830 con 0x7f93b8036e10 2023-07-21T22:18:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f93a77fe640 1 --2- 172.21.15.6:0/3109142496 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f93ac066380 0x7f93ac068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f93a77fe640 1 -- 172.21.15.6:0/3109142496 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f93c00fd110 con 0x7f93b8036e10 2023-07-21T22:18:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f57177fe640 1 --2- 172.21.15.6:0/249914155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f571000e190 0x7f57100530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f571e92c640 1 -- 172.21.15.6:0/249914155 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5710050c80 con 0x7f571000ddc0 2023-07-21T22:18:58.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f93be7fc640 1 --2- 172.21.15.6:0/3109142496 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f93ac066380 0x7f93ac068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f571e92c640 1 -- 172.21.15.6:0/249914155 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571004dea0 con 0x7f571000e190 2023-07-21T22:18:58.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f571cec9640 1 --2- 172.21.15.6:0/249914155 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5710055200 0x7f571004fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f571e92c640 1 -- 172.21.15.6:0/249914155 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57100d3310 con 0x7f5710055200 2023-07-21T22:18:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f5717fff640 1 -- 172.21.15.6:0/249914155 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5710055200 msgr2=0x7f571004fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f5717fff640 1 --2- 172.21.15.6:0/249914155 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5710055200 0x7f571004fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f5717fff640 1 -- 172.21.15.6:0/249914155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f571000e190 msgr2=0x7f57100530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f5717fff640 1 --2- 172.21.15.6:0/249914155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f571000e190 0x7f57100530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f5717fff640 1 -- 172.21.15.6:0/249914155 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570c0094d0 con 0x7f571000ddc0 2023-07-21T22:18:58.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f93a77fe640 1 -- 172.21.15.6:0/3109142496 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f93c00ca6b0 con 0x7f93b8036e10 2023-07-21T22:18:58.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f93be7fc640 1 --2- 172.21.15.6:0/3109142496 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f93ac066380 0x7f93ac068830 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f93b40ad000 tx=0x7f93b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.804+0000 7f5717fff640 1 --2- 172.21.15.6:0/249914155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f571000ddc0 0x7f57100d2dd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f570c0ad040 tx=0x7f570c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.808+0000 7f5714ff9640 1 -- 172.21.15.6:0/249914155 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c0b4800 con 0x7f571000ddc0 2023-07-21T22:18:58.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.808+0000 7f5714ff9640 1 -- 172.21.15.6:0/249914155 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570c0b49a0 con 0x7f571000ddc0 2023-07-21T22:18:58.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.808+0000 7f5714ff9640 1 -- 172.21.15.6:0/249914155 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570c0b4d50 con 0x7f571000ddc0 2023-07-21T22:18:58.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.808+0000 7f57177fe640 1 --2- 172.21.15.6:0/249914155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f571000e190 0x7f57100530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:58.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.808+0000 7f571cec9640 1 --2- 172.21.15.6:0/249914155 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5710055200 0x7f571004fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:58.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.808+0000 7f571e92c640 1 -- 172.21.15.6:0/249914155 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571004e0f0 con 0x7f571000ddc0 2023-07-21T22:18:58.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.812+0000 7f5714ff9640 1 -- 172.21.15.6:0/249914155 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f570c0b3380 con 0x7f571000ddc0 2023-07-21T22:18:58.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.812+0000 7f571e92c640 1 -- 172.21.15.6:0/249914155 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5710050910 con 0x7f571000ddc0 2023-07-21T22:18:58.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.812+0000 7f5714ff9640 1 --2- 172.21.15.6:0/249914155 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f56fc0662d0 0x7f56fc068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.812+0000 7f5714ff9640 1 -- 172.21.15.6:0/249914155 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f570c122170 con 0x7f571000ddc0 2023-07-21T22:18:58.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.816+0000 7f57177fe640 1 --2- 172.21.15.6:0/249914155 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f56fc0662d0 0x7f56fc068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.816+0000 7f571e92c640 1 -- 172.21.15.6:0/249914155 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5710057ac0 con 0x7f571000ddc0 2023-07-21T22:18:58.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.816+0000 7f57177fe640 1 --2- 172.21.15.6:0/249914155 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f56fc0662d0 0x7f56fc068780 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f57100e6b90 tx=0x7f5704009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.828+0000 7f5714ff9640 1 -- 172.21.15.6:0/249914155 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f570c123060 con 0x7f571000ddc0 2023-07-21T22:18:58.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.944+0000 7fe47e511640 1 -- 172.21.15.6:0/3859323400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe458005510 con 0x7fe4780b3720 2023-07-21T22:18:58.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.944+0000 7fe474ff9640 1 -- 172.21.15.6:0/3859323400 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe4700540e0 con 0x7fe4780b3720 2023-07-21T22:18:58.993 INFO:teuthology.orchestra.run.smithi006.stdout:64424509450 2023-07-21T22:18:58.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.948+0000 7fe45e7fc640 1 -- 172.21.15.6:0/3859323400 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe460066460 msgr2=0x7fe460068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.948+0000 7fe45e7fc640 1 --2- 172.21.15.6:0/3859323400 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe460066460 0x7fe460068910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0af000 tx=0x7fe46c008040 comp rx=0 tx=0).stop 2023-07-21T22:18:58.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.948+0000 7fe45e7fc640 1 -- 172.21.15.6:0/3859323400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4780b3720 msgr2=0x7fe4780c1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.948+0000 7fe45e7fc640 1 --2- 172.21.15.6:0/3859323400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4780b3720 0x7fe4780c1350 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe47000c780 tx=0x7fe47000cc40 comp rx=0 tx=0).stop 2023-07-21T22:18:58.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.948+0000 7fe45e7fc640 1 -- 172.21.15.6:0/3859323400 shutdown_connections 2023-07-21T22:18:58.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.948+0000 7fe45e7fc640 1 --2- 172.21.15.6:0/3859323400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4780b3720 0x7fe4780c1350 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.948+0000 7fe45e7fc640 1 --2- 172.21.15.6:0/3859323400 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe460066460 0x7fe460068910 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.948+0000 7fe45e7fc640 1 --2- 172.21.15.6:0/3859323400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4780ca0b0 0x7fe4780affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.948+0000 7fe45e7fc640 1 --2- 172.21.15.6:0/3859323400 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe47806b530 0x7fe478156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.948+0000 7fe45e7fc640 1 -- 172.21.15.6:0/3859323400 >> 172.21.15.6:0/3859323400 conn(0x7fe4780ce980 msgr2=0x7fe4780cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:58.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.948+0000 7fe45e7fc640 1 -- 172.21.15.6:0/3859323400 shutdown_connections 2023-07-21T22:18:58.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:58.948+0000 7fe45e7fc640 1 -- 172.21.15.6:0/3859323400 wait complete. 2023-07-21T22:18:59.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.0 2023-07-21T22:18:59.029 DEBUG:teuthology.parallel:result is None 2023-07-21T22:18:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.044+0000 7f6bde340640 1 -- 172.21.15.6:0/2905902430 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6bb8005510 con 0x7f6bd806aff0 2023-07-21T22:18:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.044+0000 7f6bd4ff9640 1 -- 172.21.15.6:0/2905902430 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6bc801f030 con 0x7f6bd806aff0 2023-07-21T22:18:59.091 INFO:teuthology.orchestra.run.smithi006.stdout:64424509449 2023-07-21T22:18:59.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.048+0000 7f6bde340640 1 -- 172.21.15.6:0/2905902430 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6bc00664c0 msgr2=0x7f6bc0068970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.048+0000 7f6bde340640 1 --2- 172.21.15.6:0/2905902430 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6bc00664c0 0x7f6bc0068970 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00b1000 tx=0x7f6bd00aa000 comp rx=0 tx=0).stop 2023-07-21T22:18:59.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.048+0000 7f6bde340640 1 -- 172.21.15.6:0/2905902430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd806aff0 msgr2=0x7f6bd80c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.048+0000 7f6bde340640 1 --2- 172.21.15.6:0/2905902430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd806aff0 0x7f6bd80c78a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800c7f0 tx=0x7f6bc800ccb0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.048+0000 7f6bde340640 1 -- 172.21.15.6:0/2905902430 shutdown_connections 2023-07-21T22:18:59.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.048+0000 7f6bde340640 1 --2- 172.21.15.6:0/2905902430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6bd80caed0 0x7f6bd8159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.048+0000 7f6bde340640 1 --2- 172.21.15.6:0/2905902430 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6bc00664c0 0x7f6bc0068970 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.048+0000 7f6bde340640 1 --2- 172.21.15.6:0/2905902430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bd80ca0b0 0x7f6bd81591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.048+0000 7f6bde340640 1 --2- 172.21.15.6:0/2905902430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6bd806aff0 0x7f6bd80c78a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.048+0000 7f6bde340640 1 -- 172.21.15.6:0/2905902430 >> 172.21.15.6:0/2905902430 conn(0x7f6bd80ce980 msgr2=0x7f6bd80b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:59.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.048+0000 7f6bde340640 1 -- 172.21.15.6:0/2905902430 shutdown_connections 2023-07-21T22:18:59.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.048+0000 7f6bde340640 1 -- 172.21.15.6:0/2905902430 wait complete. 2023-07-21T22:18:59.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.052+0000 7f50973e9640 1 -- 172.21.15.6:0/1576529631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f50900c2100 con 0x7f50900ca0b0 2023-07-21T22:18:59.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.052+0000 7f5085ffb640 1 -- 172.21.15.6:0/1576529631 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f50900c2100 con 0x7f50900ca0b0 2023-07-21T22:18:59.099 INFO:teuthology.orchestra.run.smithi006.stdout:64424509447 2023-07-21T22:18:59.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.056+0000 7f50973e9640 1 -- 172.21.15.6:0/1576529631 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5074066350 msgr2=0x7f5074068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.056+0000 7f50973e9640 1 --2- 172.21.15.6:0/1576529631 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5074066350 0x7f5074068800 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f508c0b3000 tx=0x7f508c008040 comp rx=0 tx=0).stop 2023-07-21T22:18:59.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.056+0000 7f50973e9640 1 -- 172.21.15.6:0/1576529631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50900ca0b0 msgr2=0x7f5090200cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.056+0000 7f50973e9640 1 --2- 172.21.15.6:0/1576529631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50900ca0b0 0x7f5090200cc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f508000d970 tx=0x7f508000de30 comp rx=0 tx=0).stop 2023-07-21T22:18:59.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.056+0000 7f50973e9640 1 -- 172.21.15.6:0/1576529631 shutdown_connections 2023-07-21T22:18:59.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.056+0000 7f50973e9640 1 --2- 172.21.15.6:0/1576529631 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5090157990 0x7f50900c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.056+0000 7f50973e9640 1 --2- 172.21.15.6:0/1576529631 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5074066350 0x7f5074068800 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.056+0000 7f50973e9640 1 --2- 172.21.15.6:0/1576529631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50900ca0b0 0x7f5090200cc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.056+0000 7f50973e9640 1 --2- 172.21.15.6:0/1576529631 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f509006b700 0x7f50900be290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.056+0000 7f50973e9640 1 -- 172.21.15.6:0/1576529631 >> 172.21.15.6:0/1576529631 conn(0x7f50900ce980 msgr2=0x7f5090070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:59.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.056+0000 7f50973e9640 1 -- 172.21.15.6:0/1576529631 shutdown_connections 2023-07-21T22:18:59.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.056+0000 7f50973e9640 1 -- 172.21.15.6:0/1576529631 wait complete. 2023-07-21T22:18:59.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2023-07-21T22:18:59.125 DEBUG:teuthology.parallel:result is None 2023-07-21T22:18:59.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2023-07-21T22:18:59.131 DEBUG:teuthology.parallel:result is None 2023-07-21T22:18:59.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.104+0000 7f93c5293640 1 -- 172.21.15.6:0/3109142496 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f93a00057e0 con 0x7f93b8036e10 2023-07-21T22:18:59.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.104+0000 7f93a77fe640 1 -- 172.21.15.6:0/3109142496 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93c00cdcd0 con 0x7f93b8036e10 2023-07-21T22:18:59.151 INFO:teuthology.orchestra.run.smithi006.stdout:64424509448 2023-07-21T22:18:59.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.108+0000 7f93c5293640 1 -- 172.21.15.6:0/3109142496 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f93ac066380 msgr2=0x7f93ac068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.108+0000 7f93c5293640 1 --2- 172.21.15.6:0/3109142496 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f93ac066380 0x7f93ac068830 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f93b40ad000 tx=0x7f93b4008040 comp rx=0 tx=0).stop 2023-07-21T22:18:59.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.108+0000 7f93c5293640 1 -- 172.21.15.6:0/3109142496 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93b8036e10 msgr2=0x7f93b80d53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.108+0000 7f93c5293640 1 --2- 172.21.15.6:0/3109142496 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93b8036e10 0x7f93b80d53a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f93c00630c0 tx=0x7f93c004da60 comp rx=0 tx=0).stop 2023-07-21T22:18:59.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.108+0000 7f93c5293640 1 -- 172.21.15.6:0/3109142496 shutdown_connections 2023-07-21T22:18:59.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.108+0000 7f93c5293640 1 --2- 172.21.15.6:0/3109142496 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93b80e6dd0 0x7f93b80e2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.108+0000 7f93c5293640 1 --2- 172.21.15.6:0/3109142496 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f93ac066380 0x7f93ac068830 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.108+0000 7f93c5293640 1 --2- 172.21.15.6:0/3109142496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93b80e6a00 0x7f93b80db560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.108+0000 7f93c5293640 1 --2- 172.21.15.6:0/3109142496 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93b8036e10 0x7f93b80d53a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.108+0000 7f93c5293640 1 -- 172.21.15.6:0/3109142496 >> 172.21.15.6:0/3109142496 conn(0x7f93b8051700 msgr2=0x7f93b804fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:59.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.108+0000 7f93c5293640 1 -- 172.21.15.6:0/3109142496 shutdown_connections 2023-07-21T22:18:59.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.108+0000 7f93c5293640 1 -- 172.21.15.6:0/3109142496 wait complete. 2023-07-21T22:18:59.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.108+0000 7fddf899f640 1 -- 172.21.15.6:0/2987492600 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fddf4066810 con 0x7fddf40ad460 2023-07-21T22:18:59.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.108+0000 7fdde2ffd640 1 -- 172.21.15.6:0/2987492600 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdde80547d0 con 0x7fddf40ad460 2023-07-21T22:18:59.157 INFO:teuthology.orchestra.run.smithi006.stdout:60129542154 2023-07-21T22:18:59.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.112+0000 7fc57cd74640 1 -- 172.21.15.6:0/2572186349 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc55c005510 con 0x7fc5780ca3b0 2023-07-21T22:18:59.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.112+0000 7fc566ffd640 1 -- 172.21.15.6:0/2572186349 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc56c0548e0 con 0x7fc5780ca3b0 2023-07-21T22:18:59.158 INFO:teuthology.orchestra.run.smithi006.stdout:64424509448 2023-07-21T22:18:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.112+0000 7fddf899f640 1 -- 172.21.15.6:0/2987492600 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fddd4066280 msgr2=0x7fddd4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.112+0000 7fddf899f640 1 --2- 172.21.15.6:0/2987492600 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fddd4066280 0x7fddd4068730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fddf406dde0 tx=0x7fddec009250 comp rx=0 tx=0).stop 2023-07-21T22:18:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.112+0000 7fddf899f640 1 -- 172.21.15.6:0/2987492600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddf40ad460 msgr2=0x7fddf40c2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.112+0000 7fddf899f640 1 --2- 172.21.15.6:0/2987492600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddf40ad460 0x7fddf40c2ce0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdde800b550 tx=0x7fdde800ba10 comp rx=0 tx=0).stop 2023-07-21T22:18:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.112+0000 7fddf899f640 1 -- 172.21.15.6:0/2987492600 shutdown_connections 2023-07-21T22:18:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.112+0000 7fddf899f640 1 --2- 172.21.15.6:0/2987492600 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fddf40c9e70 0x7fddf4155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.112+0000 7fddf899f640 1 --2- 172.21.15.6:0/2987492600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddf40ad460 0x7fddf40c2ce0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.112+0000 7fddf899f640 1 --2- 172.21.15.6:0/2987492600 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fddd4066280 0x7fddd4068730 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.112+0000 7fddf899f640 1 --2- 172.21.15.6:0/2987492600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddf406b720 0x7fddf4157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.112+0000 7fddf899f640 1 -- 172.21.15.6:0/2987492600 >> 172.21.15.6:0/2987492600 conn(0x7fddf40b0980 msgr2=0x7fddf415b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.112+0000 7fddf899f640 1 -- 172.21.15.6:0/2987492600 shutdown_connections 2023-07-21T22:18:59.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.112+0000 7fddf899f640 1 -- 172.21.15.6:0/2987492600 wait complete. 2023-07-21T22:18:59.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.116+0000 7fc57cd74640 1 -- 172.21.15.6:0/2572186349 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc558066350 msgr2=0x7fc558068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.116+0000 7fc57cd74640 1 --2- 172.21.15.6:0/2572186349 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc558066350 0x7fc558068800 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc57000abb0 tx=0x7fc570009250 comp rx=0 tx=0).stop 2023-07-21T22:18:59.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.116+0000 7fc57cd74640 1 -- 172.21.15.6:0/2572186349 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5780ca3b0 msgr2=0x7fc578159450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.116+0000 7fc57cd74640 1 --2- 172.21.15.6:0/2572186349 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5780ca3b0 0x7fc578159450 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00b3e0 tx=0x7fc56c00b8a0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.116+0000 7fc57cd74640 1 -- 172.21.15.6:0/2572186349 shutdown_connections 2023-07-21T22:18:59.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.116+0000 7fc57cd74640 1 --2- 172.21.15.6:0/2572186349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5780ce870 0x7fc578159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.116+0000 7fc57cd74640 1 --2- 172.21.15.6:0/2572186349 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5780ca3b0 0x7fc578159450 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.116+0000 7fc57cd74640 1 --2- 172.21.15.6:0/2572186349 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc558066350 0x7fc558068800 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.116+0000 7fc57cd74640 1 --2- 172.21.15.6:0/2572186349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc57806b1e0 0x7fc57814ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.116+0000 7fc57cd74640 1 -- 172.21.15.6:0/2572186349 >> 172.21.15.6:0/2572186349 conn(0x7fc5780b0980 msgr2=0x7fc57815ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:59.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.116+0000 7fc57cd74640 1 -- 172.21.15.6:0/2572186349 shutdown_connections 2023-07-21T22:18:59.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.116+0000 7fc57cd74640 1 -- 172.21.15.6:0/2572186349 wait complete. 2023-07-21T22:18:59.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.120+0000 7f1a51182640 1 -- 172.21.15.6:0/2599474402 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1a4c06b4e0 con 0x7f1a4c06b700 2023-07-21T22:18:59.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.120+0000 7f1a337fe640 1 -- 172.21.15.6:0/2599474402 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a40054c20 con 0x7f1a4c06b700 2023-07-21T22:18:59.166 INFO:teuthology.orchestra.run.smithi006.stdout:64424509448 2023-07-21T22:18:59.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.120+0000 7f1a51182640 1 -- 172.21.15.6:0/2599474402 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1a380662d0 msgr2=0x7f1a38068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.120+0000 7f1a51182640 1 --2- 172.21.15.6:0/2599474402 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1a380662d0 0x7f1a38068780 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0c7fb0 tx=0x7f1a44007f40 comp rx=0 tx=0).stop 2023-07-21T22:18:59.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.120+0000 7f1a51182640 1 -- 172.21.15.6:0/2599474402 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a4c06b700 msgr2=0x7f1a4c1521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.120+0000 7f1a51182640 1 --2- 172.21.15.6:0/2599474402 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a4c06b700 0x7f1a4c1521f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000c7c0 tx=0x7f1a4000cc80 comp rx=0 tx=0).stop 2023-07-21T22:18:59.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.120+0000 7f1a51182640 1 -- 172.21.15.6:0/2599474402 shutdown_connections 2023-07-21T22:18:59.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.120+0000 7f1a51182640 1 --2- 172.21.15.6:0/2599474402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a4c157990 0x7f1a4c151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.120+0000 7f1a51182640 1 --2- 172.21.15.6:0/2599474402 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1a380662d0 0x7f1a38068780 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.120+0000 7f1a51182640 1 --2- 172.21.15.6:0/2599474402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a4c0ca0b0 0x7f1a4c0b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.120+0000 7f1a51182640 1 --2- 172.21.15.6:0/2599474402 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a4c06b700 0x7f1a4c1521f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.120+0000 7f1a51182640 1 -- 172.21.15.6:0/2599474402 >> 172.21.15.6:0/2599474402 conn(0x7f1a4c0ce980 msgr2=0x7f1a4c154350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:59.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.120+0000 7f1a51182640 1 -- 172.21.15.6:0/2599474402 shutdown_connections 2023-07-21T22:18:59.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.120+0000 7f1a51182640 1 -- 172.21.15.6:0/2599474402 wait complete. 2023-07-21T22:18:59.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.7 2023-07-21T22:18:59.180 DEBUG:teuthology.parallel:result is None 2023-07-21T22:18:59.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.6 2023-07-21T22:18:59.188 DEBUG:teuthology.parallel:result is None 2023-07-21T22:18:59.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.4 2023-07-21T22:18:59.193 DEBUG:teuthology.parallel:result is None 2023-07-21T22:18:59.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.1 2023-07-21T22:18:59.200 DEBUG:teuthology.parallel:result is None 2023-07-21T22:18:59.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.152+0000 7f571e92c640 1 -- 172.21.15.6:0/249914155 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f571003cde0 con 0x7f571000ddc0 2023-07-21T22:18:59.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.156+0000 7f5714ff9640 1 -- 172.21.15.6:0/249914155 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f570c0eb2b0 con 0x7f571000ddc0 2023-07-21T22:18:59.201 INFO:teuthology.orchestra.run.smithi006.stdout:64424509447 2023-07-21T22:18:59.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.156+0000 7f571e92c640 1 -- 172.21.15.6:0/249914155 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f56fc0662d0 msgr2=0x7f56fc068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.156+0000 7f571e92c640 1 --2- 172.21.15.6:0/249914155 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f56fc0662d0 0x7f56fc068780 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f57100e6b90 tx=0x7f5704009040 comp rx=0 tx=0).stop 2023-07-21T22:18:59.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.156+0000 7f571e92c640 1 -- 172.21.15.6:0/249914155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f571000ddc0 msgr2=0x7f57100d2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.156+0000 7f571e92c640 1 --2- 172.21.15.6:0/249914155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f571000ddc0 0x7f57100d2dd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f570c0ad040 tx=0x7f570c01ad50 comp rx=0 tx=0).stop 2023-07-21T22:18:59.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.156+0000 7f571e92c640 1 -- 172.21.15.6:0/249914155 shutdown_connections 2023-07-21T22:18:59.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.156+0000 7f571e92c640 1 --2- 172.21.15.6:0/249914155 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5710055200 0x7f571004fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.156+0000 7f571e92c640 1 --2- 172.21.15.6:0/249914155 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f571000e190 0x7f57100530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.156+0000 7f571e92c640 1 --2- 172.21.15.6:0/249914155 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f56fc0662d0 0x7f56fc068780 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.156+0000 7f571e92c640 1 --2- 172.21.15.6:0/249914155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f571000ddc0 0x7f57100d2dd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.156+0000 7f571e92c640 1 -- 172.21.15.6:0/249914155 >> 172.21.15.6:0/249914155 conn(0x7f571000cff0 msgr2=0x7f57100dbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:59.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.156+0000 7f571e92c640 1 -- 172.21.15.6:0/249914155 shutdown_connections 2023-07-21T22:18:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.156+0000 7f571e92c640 1 -- 172.21.15.6:0/249914155 wait complete. 2023-07-21T22:18:59.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2023-07-21T22:18:59.223 DEBUG:teuthology.parallel:result is None 2023-07-21T22:18:59.223 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-21T22:18:59.223 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:18:59.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.364+0000 7fa833a96640 1 Processor -- start 2023-07-21T22:18:59.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.364+0000 7fa833a96640 1 -- start start 2023-07-21T22:18:59.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa833a96640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa82c145430 0x7fa82c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa833a96640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82c0b2140 con 0x7fa82c0d06b0 2023-07-21T22:18:59.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa833a96640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82c0b2410 con 0x7fa82c0b39f0 2023-07-21T22:18:59.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa833a96640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa82c0b26f0 con 0x7fa82c145430 2023-07-21T22:18:59.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa831832640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa82c0d06b0 0x7fa82c0b1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39934/0 (socket says 172.21.15.6:39934) 2023-07-21T22:18:59.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa831832640 1 -- 172.21.15.6:0/3238360839 learned_addr learned my addr 172.21.15.6:0/3238360839 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:18:59.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa831031640 1 --2- 172.21.15.6:0/3238360839 >> v2:172.21.15.161:3300/0 conn(0x7fa82c145430 0x7fa82c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa830830640 1 -- 172.21.15.6:0/3238360839 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762497995 0 0) 0x7fa82c0b2140 con 0x7fa82c0d06b0 2023-07-21T22:18:59.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa830830640 1 -- 172.21.15.6:0/3238360839 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa818003530 con 0x7fa82c0d06b0 2023-07-21T22:18:59.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa830830640 1 -- 172.21.15.6:0/3238360839 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2352452620 0 0) 0x7fa818003530 con 0x7fa82c0d06b0 2023-07-21T22:18:59.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa830830640 1 -- 172.21.15.6:0/3238360839 >> v2:172.21.15.161:3300/0 conn(0x7fa82c145430 msgr2=0x7fa82c0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:59.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa830830640 1 --2- 172.21.15.6:0/3238360839 >> v2:172.21.15.161:3300/0 conn(0x7fa82c145430 0x7fa82c0b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa830830640 1 -- 172.21.15.6:0/3238360839 >> v1:172.21.15.161:6789/0 conn(0x7fa82c0b39f0 legacy=0x7fa82c0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa830830640 1 -- 172.21.15.6:0/3238360839 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c0b29d0 con 0x7fa82c0d06b0 2023-07-21T22:18:59.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa830830640 1 -- 172.21.15.6:0/3238360839 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fa828001680 con 0x7fa82c0d06b0 2023-07-21T22:18:59.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa830830640 1 -- 172.21.15.6:0/3238360839 >> v1:172.21.15.6:6789/0 conn(0x7fa82c0d06b0 legacy=0x7fa82c0b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa830830640 1 --2- 172.21.15.6:0/3238360839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa818003980 0x7fa818003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa830830640 1 --2- 172.21.15.6:0/3238360839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8180047d0 0x7fa818004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa830830640 1 --2- 172.21.15.6:0/3238360839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa818005180 0x7fa81800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa830830640 1 -- 172.21.15.6:0/3238360839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c0b26f0 con 0x7fa818005180 2023-07-21T22:18:59.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa830830640 1 -- 172.21.15.6:0/3238360839 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81800c000 con 0x7fa818003980 2023-07-21T22:18:59.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa830830640 1 -- 172.21.15.6:0/3238360839 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81800c1c0 con 0x7fa8180047d0 2023-07-21T22:18:59.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa832033640 1 --2- 172.21.15.6:0/3238360839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa818005180 0x7fa81800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa831832640 1 --2- 172.21.15.6:0/3238360839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa818003980 0x7fa818003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa831031640 1 --2- 172.21.15.6:0/3238360839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8180047d0 0x7fa818004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa832033640 1 -- 172.21.15.6:0/3238360839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8180047d0 msgr2=0x7fa818004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:59.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa832033640 1 --2- 172.21.15.6:0/3238360839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8180047d0 0x7fa818004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa832033640 1 -- 172.21.15.6:0/3238360839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa818003980 msgr2=0x7fa818003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:59.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa832033640 1 --2- 172.21.15.6:0/3238360839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa818003980 0x7fa818003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.368+0000 7fa832033640 1 -- 172.21.15.6:0/3238360839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa818003530 con 0x7fa818005180 2023-07-21T22:18:59.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.372+0000 7fa832033640 1 -- 172.21.15.6:0/3238360839 reap_dead start 2023-07-21T22:18:59.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.372+0000 7fa832033640 1 --2- 172.21.15.6:0/3238360839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa818005180 0x7fa81800b990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa824001e40 tx=0x7fa82401c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374e4baa0d5a992b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:59.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.372+0000 7fa830830640 1 -- 172.21.15.6:0/3238360839 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa824003b80 con 0x7fa818005180 2023-07-21T22:18:59.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.372+0000 7fa830830640 1 -- 172.21.15.6:0/3238360839 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa824003ce0 con 0x7fa818005180 2023-07-21T22:18:59.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.372+0000 7fa830830640 1 -- 172.21.15.6:0/3238360839 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa824005260 con 0x7fa818005180 2023-07-21T22:18:59.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.372+0000 7fa833a96640 1 -- 172.21.15.6:0/3238360839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa818005180 msgr2=0x7fa81800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.372+0000 7fa833a96640 1 --2- 172.21.15.6:0/3238360839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa818005180 0x7fa81800b990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa824001e40 tx=0x7fa82401c740 comp rx=0 tx=0).stop 2023-07-21T22:18:59.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.372+0000 7fa833a96640 1 -- 172.21.15.6:0/3238360839 shutdown_connections 2023-07-21T22:18:59.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.372+0000 7fa833a96640 1 --2- 172.21.15.6:0/3238360839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa818005180 0x7fa81800b990 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.372+0000 7fa833a96640 1 -- 172.21.15.6:0/3238360839 >> 172.21.15.6:0/3238360839 conn(0x7fa82c0659d0 msgr2=0x7fa82c09b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:59.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.372+0000 7fa833a96640 1 -- 172.21.15.6:0/3238360839 shutdown_connections 2023-07-21T22:18:59.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.372+0000 7fa833a96640 1 -- 172.21.15.6:0/3238360839 wait complete. 2023-07-21T22:18:59.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.372+0000 7fa833a96640 1 Processor -- start 2023-07-21T22:18:59.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.372+0000 7fa833a96640 1 -- start start 2023-07-21T22:18:59.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa833a96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa818005180 0x7fa82c0c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa833a96640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa82c0c4de0 0x7fa82c0c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa833a96640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa82c0cb460 0x7fa82c0cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa833a96640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c0b5ca0 con 0x7fa818005180 2023-07-21T22:18:59.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa833a96640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c0b5f80 con 0x7fa82c0cb460 2023-07-21T22:18:59.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa833a96640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82c0b6260 con 0x7fa82c0c4de0 2023-07-21T22:18:59.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa831832640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa818005180 0x7fa82c0c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa831832640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa818005180 0x7fa82c0c5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58328/0 (socket says 172.21.15.6:58328) 2023-07-21T22:18:59.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa831832640 1 -- 172.21.15.6:0/2247745299 learned_addr learned my addr 172.21.15.6:0/2247745299 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:59.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa832033640 1 --2- 172.21.15.6:0/2247745299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa82c0cb460 0x7fa82c0cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa831031640 1 --2- 172.21.15.6:0/2247745299 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa82c0c4de0 0x7fa82c0c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa831832640 1 -- 172.21.15.6:0/2247745299 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa82c0c4de0 msgr2=0x7fa82c0c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa831832640 1 --2- 172.21.15.6:0/2247745299 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa82c0c4de0 0x7fa82c0c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa831832640 1 -- 172.21.15.6:0/2247745299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa82c0cb460 msgr2=0x7fa82c0cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa831832640 1 --2- 172.21.15.6:0/2247745299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa82c0cb460 0x7fa82c0cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa831832640 1 -- 172.21.15.6:0/2247745299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c0b6540 con 0x7fa818005180 2023-07-21T22:18:59.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa832033640 1 --2- 172.21.15.6:0/2247745299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa82c0cb460 0x7fa82c0cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:59.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa831832640 1 --2- 172.21.15.6:0/2247745299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa818005180 0x7fa82c0c5e80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa828007290 tx=0x7fa828007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:59.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa8227fc640 1 -- 172.21.15.6:0/2247745299 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82800f9c0 con 0x7fa818005180 2023-07-21T22:18:59.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa8227fc640 1 -- 172.21.15.6:0/2247745299 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82800fb40 con 0x7fa818005180 2023-07-21T22:18:59.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa8227fc640 1 -- 172.21.15.6:0/2247745299 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8280133f0 con 0x7fa818005180 2023-07-21T22:18:59.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa833a96640 1 -- 172.21.15.6:0/2247745299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82c0b6820 con 0x7fa818005180 2023-07-21T22:18:59.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa833a96640 1 -- 172.21.15.6:0/2247745299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82c0c7f90 con 0x7fa818005180 2023-07-21T22:18:59.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa833a96640 1 -- 172.21.15.6:0/2247745299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa82c0b60c0 con 0x7fa818005180 2023-07-21T22:18:59.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.376+0000 7fa8227fc640 1 -- 172.21.15.6:0/2247745299 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa828013550 con 0x7fa818005180 2023-07-21T22:18:59.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.380+0000 7fa8227fc640 1 --2- 172.21.15.6:0/2247745299 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa8100662d0 0x7fa810068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.380+0000 7fa8227fc640 1 -- 172.21.15.6:0/2247745299 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa828083ef0 con 0x7fa818005180 2023-07-21T22:18:59.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.380+0000 7fa831031640 1 --2- 172.21.15.6:0/2247745299 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa8100662d0 0x7fa810068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.380+0000 7fa831031640 1 --2- 172.21.15.6:0/2247745299 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa8100662d0 0x7fa810068780 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa82c15f6c0 tx=0x7fa81c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:59.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.384+0000 7fa8227fc640 1 -- 172.21.15.6:0/2247745299 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa82c0b60c0 con 0x7fa818005180 2023-07-21T22:18:59.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.532+0000 7fa833a96640 1 -- 172.21.15.6:0/2247745299 --> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa82c0b2f90 con 0x7fa8100662d0 2023-07-21T22:18:59.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.540+0000 7fa8227fc640 1 -- 172.21.15.6:0/2247745299 <== mgr.4103 v2:172.21.15.161:6832/3471136886 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286678 (secure 0 0 0) 0x7fa81c0096f0 con 0x7fa8100662d0 2023-07-21T22:18:59.590 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:18:59.592 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:18:59.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.544+0000 7fa833a96640 1 -- 172.21.15.6:0/2247745299 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa8100662d0 msgr2=0x7fa810068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.544+0000 7fa833a96640 1 --2- 172.21.15.6:0/2247745299 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa8100662d0 0x7fa810068780 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa82c15f6c0 tx=0x7fa81c008040 comp rx=0 tx=0).stop 2023-07-21T22:18:59.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.544+0000 7fa833a96640 1 -- 172.21.15.6:0/2247745299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa818005180 msgr2=0x7fa82c0c5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.544+0000 7fa833a96640 1 --2- 172.21.15.6:0/2247745299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa818005180 0x7fa82c0c5e80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa828007290 tx=0x7fa828007750 comp rx=0 tx=0).stop 2023-07-21T22:18:59.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.544+0000 7fa833a96640 1 -- 172.21.15.6:0/2247745299 shutdown_connections 2023-07-21T22:18:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.544+0000 7fa833a96640 1 --2- 172.21.15.6:0/2247745299 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa82c0cb460 0x7fa82c0cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.544+0000 7fa833a96640 1 --2- 172.21.15.6:0/2247745299 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa82c0c4de0 0x7fa82c0c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.544+0000 7fa833a96640 1 --2- 172.21.15.6:0/2247745299 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa8100662d0 0x7fa810068780 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.544+0000 7fa833a96640 1 --2- 172.21.15.6:0/2247745299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa818005180 0x7fa82c0c5e80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.544+0000 7fa833a96640 1 -- 172.21.15.6:0/2247745299 >> 172.21.15.6:0/2247745299 conn(0x7fa82c0659d0 msgr2=0x7fa82c0aefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.544+0000 7fa833a96640 1 -- 172.21.15.6:0/2247745299 shutdown_connections 2023-07-21T22:18:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.544+0000 7fa833a96640 1 -- 172.21.15.6:0/2247745299 wait complete. 2023-07-21T22:18:59.611 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-07-21T22:18:58.771596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218952,"kb_used_data":3336,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755768,"statfs":{"total":773094113280,"available":772869906432,"internally_reserved":0,"allocated":3416064,"data_stored":1986484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003121"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796317+0000","last_change":"2023-07-21T22:18:44.336499+0000","last_active":"2023-07-21T22:18:45.796317+0000","last_peered":"2023-07-21T22:18:45.796317+0000","last_clean":"2023-07-21T22:18:45.796317+0000","last_became_active":"2023-07-21T22:18:44.336063+0000","last_became_peered":"2023-07-21T22:18:44.336063+0000","last_unstale":"2023-07-21T22:18:45.796317+0000","last_undegraded":"2023-07-21T22:18:45.796317+0000","last_fullsized":"2023-07-21T22:18:45.796317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:26:54.799948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327558+0000","last_change":"2023-07-21T22:18:44.341470+0000","last_active":"2023-07-21T22:18:45.327558+0000","last_peered":"2023-07-21T22:18:45.327558+0000","last_clean":"2023-07-21T22:18:45.327558+0000","last_became_active":"2023-07-21T22:18:44.341148+0000","last_became_peered":"2023-07-21T22:18:44.341148+0000","last_unstale":"2023-07-21T22:18:45.327558+0000","last_undegraded":"2023-07-21T22:18:45.327558+0000","last_fullsized":"2023-07-21T22:18:45.327558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:43.536674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.328154+0000","last_change":"2023-07-21T22:18:44.336245+0000","last_active":"2023-07-21T22:18:45.328154+0000","last_peered":"2023-07-21T22:18:45.328154+0000","last_clean":"2023-07-21T22:18:45.328154+0000","last_became_active":"2023-07-21T22:18:44.335682+0000","last_became_peered":"2023-07-21T22:18:44.335682+0000","last_unstale":"2023-07-21T22:18:45.328154+0000","last_undegraded":"2023-07-21T22:18:45.328154+0000","last_fullsized":"2023-07-21T22:18:45.328154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:40:01.001208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797167+0000","last_change":"2023-07-21T22:18:44.335476+0000","last_active":"2023-07-21T22:18:45.797167+0000","last_peered":"2023-07-21T22:18:45.797167+0000","last_clean":"2023-07-21T22:18:45.797167+0000","last_became_active":"2023-07-21T22:18:44.335151+0000","last_became_peered":"2023-07-21T22:18:44.335151+0000","last_unstale":"2023-07-21T22:18:45.797167+0000","last_undegraded":"2023-07-21T22:18:45.797167+0000","last_fullsized":"2023-07-21T22:18:45.797167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:38:06.965559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795835+0000","last_change":"2023-07-21T22:18:44.344066+0000","last_active":"2023-07-21T22:18:45.795835+0000","last_peered":"2023-07-21T22:18:45.795835+0000","last_clean":"2023-07-21T22:18:45.795835+0000","last_became_active":"2023-07-21T22:18:44.343765+0000","last_became_peered":"2023-07-21T22:18:44.343765+0000","last_unstale":"2023-07-21T22:18:45.795835+0000","last_undegraded":"2023-07-21T22:18:45.795835+0000","last_fullsized":"2023-07-21T22:18:45.795835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:45:28.665708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326588+0000","last_change":"2023-07-21T22:18:44.336096+0000","last_active":"2023-07-21T22:18:45.326588+0000","last_peered":"2023-07-21T22:18:45.326588+0000","last_clean":"2023-07-21T22:18:45.326588+0000","last_became_active":"2023-07-21T22:18:44.335625+0000","last_became_peered":"2023-07-21T22:18:44.335625+0000","last_unstale":"2023-07-21T22:18:45.326588+0000","last_undegraded":"2023-07-21T22:18:45.326588+0000","last_fullsized":"2023-07-21T22:18:45.326588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:50.386184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797019+0000","last_change":"2023-07-21T22:18:44.338953+0000","last_active":"2023-07-21T22:18:45.797019+0000","last_peered":"2023-07-21T22:18:45.797019+0000","last_clean":"2023-07-21T22:18:45.797019+0000","last_became_active":"2023-07-21T22:18:44.338582+0000","last_became_peered":"2023-07-21T22:18:44.338582+0000","last_unstale":"2023-07-21T22:18:45.797019+0000","last_undegraded":"2023-07-21T22:18:45.797019+0000","last_fullsized":"2023-07-21T22:18:45.797019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:27:12.501057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327145+0000","last_change":"2023-07-21T22:18:44.337662+0000","last_active":"2023-07-21T22:18:45.327145+0000","last_peered":"2023-07-21T22:18:45.327145+0000","last_clean":"2023-07-21T22:18:45.327145+0000","last_became_active":"2023-07-21T22:18:44.337217+0000","last_became_peered":"2023-07-21T22:18:44.337217+0000","last_unstale":"2023-07-21T22:18:45.327145+0000","last_undegraded":"2023-07-21T22:18:45.327145+0000","last_fullsized":"2023-07-21T22:18:45.327145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:10:33.167054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795402+0000","last_change":"2023-07-21T22:18:44.344268+0000","last_active":"2023-07-21T22:18:45.795402+0000","last_peered":"2023-07-21T22:18:45.795402+0000","last_clean":"2023-07-21T22:18:45.795402+0000","last_became_active":"2023-07-21T22:18:44.343880+0000","last_became_peered":"2023-07-21T22:18:44.343880+0000","last_unstale":"2023-07-21T22:18:45.795402+0000","last_undegraded":"2023-07-21T22:18:45.795402+0000","last_fullsized":"2023-07-21T22:18:45.795402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:59:41.204617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327626+0000","last_change":"2023-07-21T22:18:44.336379+0000","last_active":"2023-07-21T22:18:45.327626+0000","last_peered":"2023-07-21T22:18:45.327626+0000","last_clean":"2023-07-21T22:18:45.327626+0000","last_became_active":"2023-07-21T22:18:44.335846+0000","last_became_peered":"2023-07-21T22:18:44.335846+0000","last_unstale":"2023-07-21T22:18:45.327626+0000","last_undegraded":"2023-07-21T22:18:45.327626+0000","last_fullsized":"2023-07-21T22:18:45.327626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:39:23.702494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.328146+0000","last_change":"2023-07-21T22:18:44.352832+0000","last_active":"2023-07-21T22:18:45.328146+0000","last_peered":"2023-07-21T22:18:45.328146+0000","last_clean":"2023-07-21T22:18:45.328146+0000","last_became_active":"2023-07-21T22:18:44.352465+0000","last_became_peered":"2023-07-21T22:18:44.352465+0000","last_unstale":"2023-07-21T22:18:45.328146+0000","last_undegraded":"2023-07-21T22:18:45.328146+0000","last_fullsized":"2023-07-21T22:18:45.328146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:08:29.897882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796396+0000","last_change":"2023-07-21T22:18:44.337129+0000","last_active":"2023-07-21T22:18:45.796396+0000","last_peered":"2023-07-21T22:18:45.796396+0000","last_clean":"2023-07-21T22:18:45.796396+0000","last_became_active":"2023-07-21T22:18:44.336170+0000","last_became_peered":"2023-07-21T22:18:44.336170+0000","last_unstale":"2023-07-21T22:18:45.796396+0000","last_undegraded":"2023-07-21T22:18:45.796396+0000","last_fullsized":"2023-07-21T22:18:45.796396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:03:22.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796163+0000","last_change":"2023-07-21T22:18:44.335382+0000","last_active":"2023-07-21T22:18:45.796163+0000","last_peered":"2023-07-21T22:18:45.796163+0000","last_clean":"2023-07-21T22:18:45.796163+0000","last_became_active":"2023-07-21T22:18:44.334933+0000","last_became_peered":"2023-07-21T22:18:44.334933+0000","last_unstale":"2023-07-21T22:18:45.796163+0000","last_undegraded":"2023-07-21T22:18:45.796163+0000","last_fullsized":"2023-07-21T22:18:45.796163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:51.413018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327284+0000","last_change":"2023-07-21T22:18:44.333998+0000","last_active":"2023-07-21T22:18:45.327284+0000","last_peered":"2023-07-21T22:18:45.327284+0000","last_clean":"2023-07-21T22:18:45.327284+0000","last_became_active":"2023-07-21T22:18:44.333720+0000","last_became_peered":"2023-07-21T22:18:44.333720+0000","last_unstale":"2023-07-21T22:18:45.327284+0000","last_undegraded":"2023-07-21T22:18:45.327284+0000","last_fullsized":"2023-07-21T22:18:45.327284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:40:46.117470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797150+0000","last_change":"2023-07-21T22:18:44.341061+0000","last_active":"2023-07-21T22:18:45.797150+0000","last_peered":"2023-07-21T22:18:45.797150+0000","last_clean":"2023-07-21T22:18:45.797150+0000","last_became_active":"2023-07-21T22:18:44.340711+0000","last_became_peered":"2023-07-21T22:18:44.340711+0000","last_unstale":"2023-07-21T22:18:45.797150+0000","last_undegraded":"2023-07-21T22:18:45.797150+0000","last_fullsized":"2023-07-21T22:18:45.797150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:08:29.897882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326507+0000","last_change":"2023-07-21T22:18:44.335984+0000","last_active":"2023-07-21T22:18:45.326507+0000","last_peered":"2023-07-21T22:18:45.326507+0000","last_clean":"2023-07-21T22:18:45.326507+0000","last_became_active":"2023-07-21T22:18:44.335481+0000","last_became_peered":"2023-07-21T22:18:44.335481+0000","last_unstale":"2023-07-21T22:18:45.326507+0000","last_undegraded":"2023-07-21T22:18:45.326507+0000","last_fullsized":"2023-07-21T22:18:45.326507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:05.701948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795507+0000","last_change":"2023-07-21T22:18:44.333526+0000","last_active":"2023-07-21T22:18:45.795507+0000","last_peered":"2023-07-21T22:18:45.795507+0000","last_clean":"2023-07-21T22:18:45.795507+0000","last_became_active":"2023-07-21T22:18:44.333139+0000","last_became_peered":"2023-07-21T22:18:44.333139+0000","last_unstale":"2023-07-21T22:18:45.795507+0000","last_undegraded":"2023-07-21T22:18:45.795507+0000","last_fullsized":"2023-07-21T22:18:45.795507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:55:23.041464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327855+0000","last_change":"2023-07-21T22:18:44.339606+0000","last_active":"2023-07-21T22:18:45.327855+0000","last_peered":"2023-07-21T22:18:45.327855+0000","last_clean":"2023-07-21T22:18:45.327855+0000","last_became_active":"2023-07-21T22:18:44.339282+0000","last_became_peered":"2023-07-21T22:18:44.339282+0000","last_unstale":"2023-07-21T22:18:45.327855+0000","last_undegraded":"2023-07-21T22:18:45.327855+0000","last_fullsized":"2023-07-21T22:18:45.327855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:19:32.663742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796266+0000","last_change":"2023-07-21T22:18:44.325126+0000","last_active":"2023-07-21T22:18:45.796266+0000","last_peered":"2023-07-21T22:18:45.796266+0000","last_clean":"2023-07-21T22:18:45.796266+0000","last_became_active":"2023-07-21T22:18:44.324795+0000","last_became_peered":"2023-07-21T22:18:44.324795+0000","last_unstale":"2023-07-21T22:18:45.796266+0000","last_undegraded":"2023-07-21T22:18:45.796266+0000","last_fullsized":"2023-07-21T22:18:45.796266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:05.638943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327584+0000","last_change":"2023-07-21T22:18:44.338316+0000","last_active":"2023-07-21T22:18:45.327584+0000","last_peered":"2023-07-21T22:18:45.327584+0000","last_clean":"2023-07-21T22:18:45.327584+0000","last_became_active":"2023-07-21T22:18:44.337895+0000","last_became_peered":"2023-07-21T22:18:44.337895+0000","last_unstale":"2023-07-21T22:18:45.327584+0000","last_undegraded":"2023-07-21T22:18:45.327584+0000","last_fullsized":"2023-07-21T22:18:45.327584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:39:23.702494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796989+0000","last_change":"2023-07-21T22:18:44.355582+0000","last_active":"2023-07-21T22:18:45.796989+0000","last_peered":"2023-07-21T22:18:45.796989+0000","last_clean":"2023-07-21T22:18:45.796989+0000","last_became_active":"2023-07-21T22:18:44.355317+0000","last_became_peered":"2023-07-21T22:18:44.355317+0000","last_unstale":"2023-07-21T22:18:45.796989+0000","last_undegraded":"2023-07-21T22:18:45.796989+0000","last_fullsized":"2023-07-21T22:18:45.796989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:06.515061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.794789+0000","last_change":"2023-07-21T22:18:44.348333+0000","last_active":"2023-07-21T22:18:45.794789+0000","last_peered":"2023-07-21T22:18:45.794789+0000","last_clean":"2023-07-21T22:18:45.794789+0000","last_became_active":"2023-07-21T22:18:44.347982+0000","last_became_peered":"2023-07-21T22:18:44.347982+0000","last_unstale":"2023-07-21T22:18:45.794789+0000","last_undegraded":"2023-07-21T22:18:45.794789+0000","last_fullsized":"2023-07-21T22:18:45.794789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:27.420151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325227+0000","last_change":"2023-07-21T22:18:44.333429+0000","last_active":"2023-07-21T22:18:45.325227+0000","last_peered":"2023-07-21T22:18:45.325227+0000","last_clean":"2023-07-21T22:18:45.325227+0000","last_became_active":"2023-07-21T22:18:44.333121+0000","last_became_peered":"2023-07-21T22:18:44.333121+0000","last_unstale":"2023-07-21T22:18:45.325227+0000","last_undegraded":"2023-07-21T22:18:45.325227+0000","last_fullsized":"2023-07-21T22:18:45.325227+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:30.117915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796802+0000","last_change":"2023-07-21T22:18:44.346478+0000","last_active":"2023-07-21T22:18:45.796802+0000","last_peered":"2023-07-21T22:18:45.796802+0000","last_clean":"2023-07-21T22:18:45.796802+0000","last_became_active":"2023-07-21T22:18:44.346160+0000","last_became_peered":"2023-07-21T22:18:44.346160+0000","last_unstale":"2023-07-21T22:18:45.796802+0000","last_undegraded":"2023-07-21T22:18:45.796802+0000","last_fullsized":"2023-07-21T22:18:45.796802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:27:23.426700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795082+0000","last_change":"2023-07-21T22:18:44.348596+0000","last_active":"2023-07-21T22:18:45.795082+0000","last_peered":"2023-07-21T22:18:45.795082+0000","last_clean":"2023-07-21T22:18:45.795082+0000","last_became_active":"2023-07-21T22:18:44.348325+0000","last_became_peered":"2023-07-21T22:18:44.348325+0000","last_unstale":"2023-07-21T22:18:45.795082+0000","last_undegraded":"2023-07-21T22:18:45.795082+0000","last_fullsized":"2023-07-21T22:18:45.795082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:55:23.041464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795256+0000","last_change":"2023-07-21T22:18:44.335321+0000","last_active":"2023-07-21T22:18:45.795256+0000","last_peered":"2023-07-21T22:18:45.795256+0000","last_clean":"2023-07-21T22:18:45.795256+0000","last_became_active":"2023-07-21T22:18:44.334970+0000","last_became_peered":"2023-07-21T22:18:44.334970+0000","last_unstale":"2023-07-21T22:18:45.795256+0000","last_undegraded":"2023-07-21T22:18:45.795256+0000","last_fullsized":"2023-07-21T22:18:45.795256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:40:05.799874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327703+0000","last_change":"2023-07-21T22:18:44.345317+0000","last_active":"2023-07-21T22:18:45.327703+0000","last_peered":"2023-07-21T22:18:45.327703+0000","last_clean":"2023-07-21T22:18:45.327703+0000","last_became_active":"2023-07-21T22:18:44.344901+0000","last_became_peered":"2023-07-21T22:18:44.344901+0000","last_unstale":"2023-07-21T22:18:45.327703+0000","last_undegraded":"2023-07-21T22:18:45.327703+0000","last_fullsized":"2023-07-21T22:18:45.327703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:19:32.663742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795619+0000","last_change":"2023-07-21T22:18:44.336787+0000","last_active":"2023-07-21T22:18:45.795619+0000","last_peered":"2023-07-21T22:18:45.795619+0000","last_clean":"2023-07-21T22:18:45.795619+0000","last_became_active":"2023-07-21T22:18:44.336502+0000","last_became_peered":"2023-07-21T22:18:44.336502+0000","last_unstale":"2023-07-21T22:18:45.795619+0000","last_undegraded":"2023-07-21T22:18:45.795619+0000","last_fullsized":"2023-07-21T22:18:45.795619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:32:12.452014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325564+0000","last_change":"2023-07-21T22:18:44.348671+0000","last_active":"2023-07-21T22:18:45.325564+0000","last_peered":"2023-07-21T22:18:45.325564+0000","last_clean":"2023-07-21T22:18:45.325564+0000","last_became_active":"2023-07-21T22:18:44.348361+0000","last_became_peered":"2023-07-21T22:18:44.348361+0000","last_unstale":"2023-07-21T22:18:45.325564+0000","last_undegraded":"2023-07-21T22:18:45.325564+0000","last_fullsized":"2023-07-21T22:18:45.325564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:40:05.799874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326775+0000","last_change":"2023-07-21T22:18:44.348495+0000","last_active":"2023-07-21T22:18:45.326775+0000","last_peered":"2023-07-21T22:18:45.326775+0000","last_clean":"2023-07-21T22:18:45.326775+0000","last_became_active":"2023-07-21T22:18:44.348107+0000","last_became_peered":"2023-07-21T22:18:44.348107+0000","last_unstale":"2023-07-21T22:18:45.326775+0000","last_undegraded":"2023-07-21T22:18:45.326775+0000","last_fullsized":"2023-07-21T22:18:45.326775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:40:46.117470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325342+0000","last_change":"2023-07-21T22:18:44.342060+0000","last_active":"2023-07-21T22:18:45.325342+0000","last_peered":"2023-07-21T22:18:45.325342+0000","last_clean":"2023-07-21T22:18:45.325342+0000","last_became_active":"2023-07-21T22:18:44.341767+0000","last_became_peered":"2023-07-21T22:18:44.341767+0000","last_unstale":"2023-07-21T22:18:45.325342+0000","last_undegraded":"2023-07-21T22:18:45.325342+0000","last_fullsized":"2023-07-21T22:18:45.325342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:59:41.204617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796723+0000","last_change":"2023-07-21T22:18:44.326741+0000","last_active":"2023-07-21T22:18:45.796723+0000","last_peered":"2023-07-21T22:18:45.796723+0000","last_clean":"2023-07-21T22:18:45.796723+0000","last_became_active":"2023-07-21T22:18:44.326440+0000","last_became_peered":"2023-07-21T22:18:44.326440+0000","last_unstale":"2023-07-21T22:18:45.796723+0000","last_undegraded":"2023-07-21T22:18:45.796723+0000","last_fullsized":"2023-07-21T22:18:45.796723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:29.978550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325968+0000","last_change":"2023-07-21T22:18:44.338017+0000","last_active":"2023-07-21T22:18:45.325968+0000","last_peered":"2023-07-21T22:18:45.325968+0000","last_clean":"2023-07-21T22:18:45.325968+0000","last_became_active":"2023-07-21T22:18:44.337215+0000","last_became_peered":"2023-07-21T22:18:44.337215+0000","last_unstale":"2023-07-21T22:18:45.325968+0000","last_undegraded":"2023-07-21T22:18:45.325968+0000","last_fullsized":"2023-07-21T22:18:45.325968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:42.883880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'2","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797139+0000","last_change":"2023-07-21T22:18:43.345411+0000","last_active":"2023-07-21T22:18:45.797139+0000","last_peered":"2023-07-21T22:18:45.797139+0000","last_clean":"2023-07-21T22:18:45.797139+0000","last_became_active":"2023-07-21T22:18:43.345095+0000","last_became_peered":"2023-07-21T22:18:43.345095+0000","last_unstale":"2023-07-21T22:18:45.797139+0000","last_undegraded":"2023-07-21T22:18:45.797139+0000","last_fullsized":"2023-07-21T22:18:45.797139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:39:59.990137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327735+0000","last_change":"2023-07-21T22:18:44.345111+0000","last_active":"2023-07-21T22:18:45.327735+0000","last_peered":"2023-07-21T22:18:45.327735+0000","last_clean":"2023-07-21T22:18:45.327735+0000","last_became_active":"2023-07-21T22:18:44.344325+0000","last_became_peered":"2023-07-21T22:18:44.344325+0000","last_unstale":"2023-07-21T22:18:45.327735+0000","last_undegraded":"2023-07-21T22:18:45.327735+0000","last_fullsized":"2023-07-21T22:18:45.327735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:06.515061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.794914+0000","last_change":"2023-07-21T22:18:43.340538+0000","last_active":"2023-07-21T22:18:45.794914+0000","last_peered":"2023-07-21T22:18:45.794914+0000","last_clean":"2023-07-21T22:18:45.794914+0000","last_became_active":"2023-07-21T22:18:43.340172+0000","last_became_peered":"2023-07-21T22:18:43.340172+0000","last_unstale":"2023-07-21T22:18:45.794914+0000","last_undegraded":"2023-07-21T22:18:45.794914+0000","last_fullsized":"2023-07-21T22:18:45.794914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:38:34.109172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795755+0000","last_change":"2023-07-21T22:18:44.342020+0000","last_active":"2023-07-21T22:18:45.795755+0000","last_peered":"2023-07-21T22:18:45.795755+0000","last_clean":"2023-07-21T22:18:45.795755+0000","last_became_active":"2023-07-21T22:18:44.341724+0000","last_became_peered":"2023-07-21T22:18:44.341724+0000","last_unstale":"2023-07-21T22:18:45.795755+0000","last_undegraded":"2023-07-21T22:18:45.795755+0000","last_fullsized":"2023-07-21T22:18:45.795755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:59:34.905191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797136+0000","last_change":"2023-07-21T22:18:43.337771+0000","last_active":"2023-07-21T22:18:45.797136+0000","last_peered":"2023-07-21T22:18:45.797136+0000","last_clean":"2023-07-21T22:18:45.797136+0000","last_became_active":"2023-07-21T22:18:43.337480+0000","last_became_peered":"2023-07-21T22:18:43.337480+0000","last_unstale":"2023-07-21T22:18:45.797136+0000","last_undegraded":"2023-07-21T22:18:45.797136+0000","last_fullsized":"2023-07-21T22:18:45.797136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:23:16.921120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325988+0000","last_change":"2023-07-21T22:18:44.349625+0000","last_active":"2023-07-21T22:18:45.325988+0000","last_peered":"2023-07-21T22:18:45.325988+0000","last_clean":"2023-07-21T22:18:45.325988+0000","last_became_active":"2023-07-21T22:18:44.349046+0000","last_became_peered":"2023-07-21T22:18:44.349046+0000","last_unstale":"2023-07-21T22:18:45.325988+0000","last_undegraded":"2023-07-21T22:18:45.325988+0000","last_fullsized":"2023-07-21T22:18:45.325988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:35:09.658092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"25'8","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796793+0000","last_change":"2023-07-21T22:18:43.344968+0000","last_active":"2023-07-21T22:18:45.796793+0000","last_peered":"2023-07-21T22:18:45.796793+0000","last_clean":"2023-07-21T22:18:45.796793+0000","last_became_active":"2023-07-21T22:18:43.344570+0000","last_became_peered":"2023-07-21T22:18:43.344570+0000","last_unstale":"2023-07-21T22:18:45.796793+0000","last_undegraded":"2023-07-21T22:18:45.796793+0000","last_fullsized":"2023-07-21T22:18:45.796793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:25.997043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797690+0000","last_change":"2023-07-21T22:18:43.348215+0000","last_active":"2023-07-21T22:18:45.797690+0000","last_peered":"2023-07-21T22:18:45.797690+0000","last_clean":"2023-07-21T22:18:45.797690+0000","last_became_active":"2023-07-21T22:18:43.347858+0000","last_became_peered":"2023-07-21T22:18:43.347858+0000","last_unstale":"2023-07-21T22:18:45.797690+0000","last_undegraded":"2023-07-21T22:18:45.797690+0000","last_fullsized":"2023-07-21T22:18:45.797690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:38:53.668385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327304+0000","last_change":"2023-07-21T22:18:44.341650+0000","last_active":"2023-07-21T22:18:45.327304+0000","last_peered":"2023-07-21T22:18:45.327304+0000","last_clean":"2023-07-21T22:18:45.327304+0000","last_became_active":"2023-07-21T22:18:44.341352+0000","last_became_peered":"2023-07-21T22:18:44.341352+0000","last_unstale":"2023-07-21T22:18:45.327304+0000","last_undegraded":"2023-07-21T22:18:45.327304+0000","last_fullsized":"2023-07-21T22:18:45.327304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:27:23.426700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797589+0000","last_change":"2023-07-21T22:18:43.348256+0000","last_active":"2023-07-21T22:18:45.797589+0000","last_peered":"2023-07-21T22:18:45.797589+0000","last_clean":"2023-07-21T22:18:45.797589+0000","last_became_active":"2023-07-21T22:18:43.347754+0000","last_became_peered":"2023-07-21T22:18:43.347754+0000","last_unstale":"2023-07-21T22:18:45.797589+0000","last_undegraded":"2023-07-21T22:18:45.797589+0000","last_fullsized":"2023-07-21T22:18:45.797589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:21:17.553066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326419+0000","last_change":"2023-07-21T22:18:44.353012+0000","last_active":"2023-07-21T22:18:45.326419+0000","last_peered":"2023-07-21T22:18:45.326419+0000","last_clean":"2023-07-21T22:18:45.326419+0000","last_became_active":"2023-07-21T22:18:44.352586+0000","last_became_peered":"2023-07-21T22:18:44.352586+0000","last_unstale":"2023-07-21T22:18:45.326419+0000","last_undegraded":"2023-07-21T22:18:45.326419+0000","last_fullsized":"2023-07-21T22:18:45.326419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:59:21.171422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"25'1","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797566+0000","last_change":"2023-07-21T22:18:43.338600+0000","last_active":"2023-07-21T22:18:45.797566+0000","last_peered":"2023-07-21T22:18:45.797566+0000","last_clean":"2023-07-21T22:18:45.797566+0000","last_became_active":"2023-07-21T22:18:43.338271+0000","last_became_peered":"2023-07-21T22:18:43.338271+0000","last_unstale":"2023-07-21T22:18:45.797566+0000","last_undegraded":"2023-07-21T22:18:45.797566+0000","last_fullsized":"2023-07-21T22:18:45.797566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:09:34.387655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796735+0000","last_change":"2023-07-21T22:18:44.341047+0000","last_active":"2023-07-21T22:18:45.796735+0000","last_peered":"2023-07-21T22:18:45.796735+0000","last_clean":"2023-07-21T22:18:45.796735+0000","last_became_active":"2023-07-21T22:18:44.340600+0000","last_became_peered":"2023-07-21T22:18:44.340600+0000","last_unstale":"2023-07-21T22:18:45.796735+0000","last_undegraded":"2023-07-21T22:18:45.796735+0000","last_fullsized":"2023-07-21T22:18:45.796735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:55.844422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327577+0000","last_change":"2023-07-21T22:18:43.339272+0000","last_active":"2023-07-21T22:18:45.327577+0000","last_peered":"2023-07-21T22:18:45.327577+0000","last_clean":"2023-07-21T22:18:45.327577+0000","last_became_active":"2023-07-21T22:18:43.338864+0000","last_became_peered":"2023-07-21T22:18:43.338864+0000","last_unstale":"2023-07-21T22:18:45.327577+0000","last_undegraded":"2023-07-21T22:18:45.327577+0000","last_fullsized":"2023-07-21T22:18:45.327577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:44:35.365564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.794696+0000","last_change":"2023-07-21T22:18:44.347783+0000","last_active":"2023-07-21T22:18:45.794696+0000","last_peered":"2023-07-21T22:18:45.794696+0000","last_clean":"2023-07-21T22:18:45.794696+0000","last_became_active":"2023-07-21T22:18:44.347417+0000","last_became_peered":"2023-07-21T22:18:44.347417+0000","last_unstale":"2023-07-21T22:18:45.794696+0000","last_undegraded":"2023-07-21T22:18:45.794696+0000","last_fullsized":"2023-07-21T22:18:45.794696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:42.552801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'2","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325726+0000","last_change":"2023-07-21T22:18:43.341666+0000","last_active":"2023-07-21T22:18:45.325726+0000","last_peered":"2023-07-21T22:18:45.325726+0000","last_clean":"2023-07-21T22:18:45.325726+0000","last_became_active":"2023-07-21T22:18:43.341287+0000","last_became_peered":"2023-07-21T22:18:43.341287+0000","last_unstale":"2023-07-21T22:18:45.325726+0000","last_undegraded":"2023-07-21T22:18:45.325726+0000","last_fullsized":"2023-07-21T22:18:45.325726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:59:33.894120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327725+0000","last_change":"2023-07-21T22:18:44.345773+0000","last_active":"2023-07-21T22:18:45.327725+0000","last_peered":"2023-07-21T22:18:45.327725+0000","last_clean":"2023-07-21T22:18:45.327725+0000","last_became_active":"2023-07-21T22:18:44.345494+0000","last_became_peered":"2023-07-21T22:18:44.345494+0000","last_unstale":"2023-07-21T22:18:45.327725+0000","last_undegraded":"2023-07-21T22:18:45.327725+0000","last_fullsized":"2023-07-21T22:18:45.327725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:27:23.426700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797377+0000","last_change":"2023-07-21T22:18:43.346587+0000","last_active":"2023-07-21T22:18:45.797377+0000","last_peered":"2023-07-21T22:18:45.797377+0000","last_clean":"2023-07-21T22:18:45.797377+0000","last_became_active":"2023-07-21T22:18:43.346170+0000","last_became_peered":"2023-07-21T22:18:43.346170+0000","last_unstale":"2023-07-21T22:18:45.797377+0000","last_undegraded":"2023-07-21T22:18:45.797377+0000","last_fullsized":"2023-07-21T22:18:45.797377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:26.409080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.328248+0000","last_change":"2023-07-21T22:18:44.339550+0000","last_active":"2023-07-21T22:18:45.328248+0000","last_peered":"2023-07-21T22:18:45.328248+0000","last_clean":"2023-07-21T22:18:45.328248+0000","last_became_active":"2023-07-21T22:18:44.339232+0000","last_became_peered":"2023-07-21T22:18:44.339232+0000","last_unstale":"2023-07-21T22:18:45.328248+0000","last_undegraded":"2023-07-21T22:18:45.328248+0000","last_fullsized":"2023-07-21T22:18:45.328248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:05:01.105745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326588+0000","last_change":"2023-07-21T22:18:43.342021+0000","last_active":"2023-07-21T22:18:45.326588+0000","last_peered":"2023-07-21T22:18:45.326588+0000","last_clean":"2023-07-21T22:18:45.326588+0000","last_became_active":"2023-07-21T22:18:43.340494+0000","last_became_peered":"2023-07-21T22:18:43.340494+0000","last_unstale":"2023-07-21T22:18:45.326588+0000","last_undegraded":"2023-07-21T22:18:45.326588+0000","last_fullsized":"2023-07-21T22:18:45.326588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:24:08.282241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327954+0000","last_change":"2023-07-21T22:18:44.349404+0000","last_active":"2023-07-21T22:18:45.327954+0000","last_peered":"2023-07-21T22:18:45.327954+0000","last_clean":"2023-07-21T22:18:45.327954+0000","last_became_active":"2023-07-21T22:18:44.348314+0000","last_became_peered":"2023-07-21T22:18:44.348314+0000","last_unstale":"2023-07-21T22:18:45.327954+0000","last_undegraded":"2023-07-21T22:18:45.327954+0000","last_fullsized":"2023-07-21T22:18:45.327954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:27:12.501057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325361+0000","last_change":"2023-07-21T22:18:43.329711+0000","last_active":"2023-07-21T22:18:45.325361+0000","last_peered":"2023-07-21T22:18:45.325361+0000","last_clean":"2023-07-21T22:18:45.325361+0000","last_became_active":"2023-07-21T22:18:43.329184+0000","last_became_peered":"2023-07-21T22:18:43.329184+0000","last_unstale":"2023-07-21T22:18:45.325361+0000","last_undegraded":"2023-07-21T22:18:45.325361+0000","last_fullsized":"2023-07-21T22:18:45.325361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:29:13.898457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795249+0000","last_change":"2023-07-21T22:18:44.354431+0000","last_active":"2023-07-21T22:18:45.795249+0000","last_peered":"2023-07-21T22:18:45.795249+0000","last_clean":"2023-07-21T22:18:45.795249+0000","last_became_active":"2023-07-21T22:18:44.354063+0000","last_became_peered":"2023-07-21T22:18:44.354063+0000","last_unstale":"2023-07-21T22:18:45.795249+0000","last_undegraded":"2023-07-21T22:18:45.795249+0000","last_fullsized":"2023-07-21T22:18:45.795249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:41:47.804776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":175,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796964+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:18:45.796964+0000","last_peered":"2023-07-21T22:18:45.796964+0000","last_clean":"2023-07-21T22:18:45.796964+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:18:45.796964+0000","last_undegraded":"2023-07-21T22:18:45.796964+0000","last_fullsized":"2023-07-21T22:18:45.796964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:19:20.465616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327327+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:18:45.327327+0000","last_peered":"2023-07-21T22:18:45.327327+0000","last_clean":"2023-07-21T22:18:45.327327+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:18:45.327327+0000","last_undegraded":"2023-07-21T22:18:45.327327+0000","last_fullsized":"2023-07-21T22:18:45.327327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:45.609689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325347+0000","last_change":"2023-07-21T22:18:43.327625+0000","last_active":"2023-07-21T22:18:45.325347+0000","last_peered":"2023-07-21T22:18:45.325347+0000","last_clean":"2023-07-21T22:18:45.325347+0000","last_became_active":"2023-07-21T22:18:43.327272+0000","last_became_peered":"2023-07-21T22:18:43.327272+0000","last_unstale":"2023-07-21T22:18:45.325347+0000","last_undegraded":"2023-07-21T22:18:45.325347+0000","last_fullsized":"2023-07-21T22:18:45.325347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:55:22.030393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797370+0000","last_change":"2023-07-21T22:18:44.335194+0000","last_active":"2023-07-21T22:18:45.797370+0000","last_peered":"2023-07-21T22:18:45.797370+0000","last_clean":"2023-07-21T22:18:45.797370+0000","last_became_active":"2023-07-21T22:18:44.334864+0000","last_became_peered":"2023-07-21T22:18:44.334864+0000","last_unstale":"2023-07-21T22:18:45.797370+0000","last_undegraded":"2023-07-21T22:18:45.797370+0000","last_fullsized":"2023-07-21T22:18:45.797370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:38:35.120243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797285+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:18:45.797285+0000","last_peered":"2023-07-21T22:18:45.797285+0000","last_clean":"2023-07-21T22:18:45.797285+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:18:45.797285+0000","last_undegraded":"2023-07-21T22:18:45.797285+0000","last_fullsized":"2023-07-21T22:18:45.797285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:04:55.062032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.794761+0000","last_change":"2023-07-21T22:18:43.344180+0000","last_active":"2023-07-21T22:18:45.794761+0000","last_peered":"2023-07-21T22:18:45.794761+0000","last_clean":"2023-07-21T22:18:45.794761+0000","last_became_active":"2023-07-21T22:18:43.343831+0000","last_became_peered":"2023-07-21T22:18:43.343831+0000","last_unstale":"2023-07-21T22:18:45.794761+0000","last_undegraded":"2023-07-21T22:18:45.794761+0000","last_fullsized":"2023-07-21T22:18:45.794761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:29.106844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795737+0000","last_change":"2023-07-21T22:18:44.347759+0000","last_active":"2023-07-21T22:18:45.795737+0000","last_peered":"2023-07-21T22:18:45.795737+0000","last_clean":"2023-07-21T22:18:45.795737+0000","last_became_active":"2023-07-21T22:18:44.347416+0000","last_became_peered":"2023-07-21T22:18:44.347416+0000","last_unstale":"2023-07-21T22:18:45.795737+0000","last_undegraded":"2023-07-21T22:18:45.795737+0000","last_fullsized":"2023-07-21T22:18:45.795737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:17:36.412750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796138+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:18:45.796138+0000","last_peered":"2023-07-21T22:18:45.796138+0000","last_clean":"2023-07-21T22:18:45.796138+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:18:45.796138+0000","last_undegraded":"2023-07-21T22:18:45.796138+0000","last_fullsized":"2023-07-21T22:18:45.796138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:12:30.348041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795402+0000","last_change":"2023-07-21T22:18:43.332573+0000","last_active":"2023-07-21T22:18:45.795402+0000","last_peered":"2023-07-21T22:18:45.795402+0000","last_clean":"2023-07-21T22:18:45.795402+0000","last_became_active":"2023-07-21T22:18:43.331774+0000","last_became_peered":"2023-07-21T22:18:43.331774+0000","last_unstale":"2023-07-21T22:18:45.795402+0000","last_undegraded":"2023-07-21T22:18:45.795402+0000","last_fullsized":"2023-07-21T22:18:45.795402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:41.872809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795393+0000","last_change":"2023-07-21T22:18:44.344092+0000","last_active":"2023-07-21T22:18:45.795393+0000","last_peered":"2023-07-21T22:18:45.795393+0000","last_clean":"2023-07-21T22:18:45.795393+0000","last_became_active":"2023-07-21T22:18:44.343819+0000","last_became_peered":"2023-07-21T22:18:44.343819+0000","last_unstale":"2023-07-21T22:18:45.795393+0000","last_undegraded":"2023-07-21T22:18:45.795393+0000","last_fullsized":"2023-07-21T22:18:45.795393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:45:28.665708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327394+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:18:45.327394+0000","last_peered":"2023-07-21T22:18:45.327394+0000","last_clean":"2023-07-21T22:18:45.327394+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:18:45.327394+0000","last_undegraded":"2023-07-21T22:18:45.327394+0000","last_fullsized":"2023-07-21T22:18:45.327394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:29:17.693632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327443+0000","last_change":"2023-07-21T22:18:43.347890+0000","last_active":"2023-07-21T22:18:45.327443+0000","last_peered":"2023-07-21T22:18:45.327443+0000","last_clean":"2023-07-21T22:18:45.327443+0000","last_became_active":"2023-07-21T22:18:43.347529+0000","last_became_peered":"2023-07-21T22:18:43.347529+0000","last_unstale":"2023-07-21T22:18:45.327443+0000","last_undegraded":"2023-07-21T22:18:45.327443+0000","last_fullsized":"2023-07-21T22:18:45.327443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:44:35.365564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795543+0000","last_change":"2023-07-21T22:18:44.345749+0000","last_active":"2023-07-21T22:18:45.795543+0000","last_peered":"2023-07-21T22:18:45.795543+0000","last_clean":"2023-07-21T22:18:45.795543+0000","last_became_active":"2023-07-21T22:18:44.345413+0000","last_became_peered":"2023-07-21T22:18:44.345413+0000","last_unstale":"2023-07-21T22:18:45.795543+0000","last_undegraded":"2023-07-21T22:18:45.795543+0000","last_fullsized":"2023-07-21T22:18:45.795543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:35:09.658092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327868+0000","last_change":"2023-07-21T22:18:43.339680+0000","last_active":"2023-07-21T22:18:45.327868+0000","last_peered":"2023-07-21T22:18:45.327868+0000","last_clean":"2023-07-21T22:18:45.327868+0000","last_became_active":"2023-07-21T22:18:43.339369+0000","last_became_peered":"2023-07-21T22:18:43.339369+0000","last_unstale":"2023-07-21T22:18:45.327868+0000","last_undegraded":"2023-07-21T22:18:45.327868+0000","last_fullsized":"2023-07-21T22:18:45.327868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:39:59.990137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795628+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:18:45.795628+0000","last_peered":"2023-07-21T22:18:45.795628+0000","last_clean":"2023-07-21T22:18:45.795628+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:18:45.795628+0000","last_undegraded":"2023-07-21T22:18:45.795628+0000","last_fullsized":"2023-07-21T22:18:45.795628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:54:07.130010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795286+0000","last_change":"2023-07-21T22:18:44.345981+0000","last_active":"2023-07-21T22:18:45.795286+0000","last_peered":"2023-07-21T22:18:45.795286+0000","last_clean":"2023-07-21T22:18:45.795286+0000","last_became_active":"2023-07-21T22:18:44.345650+0000","last_became_peered":"2023-07-21T22:18:44.345650+0000","last_unstale":"2023-07-21T22:18:45.795286+0000","last_undegraded":"2023-07-21T22:18:45.795286+0000","last_fullsized":"2023-07-21T22:18:45.795286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:17:36.412750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795559+0000","last_change":"2023-07-21T22:18:43.336788+0000","last_active":"2023-07-21T22:18:45.795559+0000","last_peered":"2023-07-21T22:18:45.795559+0000","last_clean":"2023-07-21T22:18:45.795559+0000","last_became_active":"2023-07-21T22:18:43.336357+0000","last_became_peered":"2023-07-21T22:18:43.336357+0000","last_unstale":"2023-07-21T22:18:45.795559+0000","last_undegraded":"2023-07-21T22:18:45.795559+0000","last_fullsized":"2023-07-21T22:18:45.795559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:28:38.838619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797723+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:18:45.797723+0000","last_peered":"2023-07-21T22:18:45.797723+0000","last_clean":"2023-07-21T22:18:45.797723+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:18:45.797723+0000","last_undegraded":"2023-07-21T22:18:45.797723+0000","last_fullsized":"2023-07-21T22:18:45.797723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:12:18.867824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795721+0000","last_change":"2023-07-21T22:18:44.345851+0000","last_active":"2023-07-21T22:18:45.795721+0000","last_peered":"2023-07-21T22:18:45.795721+0000","last_clean":"2023-07-21T22:18:45.795721+0000","last_became_active":"2023-07-21T22:18:44.345553+0000","last_became_peered":"2023-07-21T22:18:44.345553+0000","last_unstale":"2023-07-21T22:18:45.795721+0000","last_undegraded":"2023-07-21T22:18:45.795721+0000","last_fullsized":"2023-07-21T22:18:45.795721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:40:05.799874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326225+0000","last_change":"2023-07-21T22:18:43.335304+0000","last_active":"2023-07-21T22:18:45.326225+0000","last_peered":"2023-07-21T22:18:45.326225+0000","last_clean":"2023-07-21T22:18:45.326225+0000","last_became_active":"2023-07-21T22:18:43.334929+0000","last_became_peered":"2023-07-21T22:18:43.334929+0000","last_unstale":"2023-07-21T22:18:45.326225+0000","last_undegraded":"2023-07-21T22:18:45.326225+0000","last_fullsized":"2023-07-21T22:18:45.326225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:28:38.838619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795374+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:18:45.795374+0000","last_peered":"2023-07-21T22:18:45.795374+0000","last_clean":"2023-07-21T22:18:45.795374+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:18:45.795374+0000","last_undegraded":"2023-07-21T22:18:45.795374+0000","last_fullsized":"2023-07-21T22:18:45.795374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:59:28.861478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325244+0000","last_change":"2023-07-21T22:18:44.341231+0000","last_active":"2023-07-21T22:18:45.325244+0000","last_peered":"2023-07-21T22:18:45.325244+0000","last_clean":"2023-07-21T22:18:45.325244+0000","last_became_active":"2023-07-21T22:18:44.340874+0000","last_became_peered":"2023-07-21T22:18:44.340874+0000","last_unstale":"2023-07-21T22:18:45.325244+0000","last_undegraded":"2023-07-21T22:18:45.325244+0000","last_fullsized":"2023-07-21T22:18:45.325244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:27.420151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795870+0000","last_change":"2023-07-21T22:18:43.340557+0000","last_active":"2023-07-21T22:18:45.795870+0000","last_peered":"2023-07-21T22:18:45.795870+0000","last_clean":"2023-07-21T22:18:45.795870+0000","last_became_active":"2023-07-21T22:18:43.340199+0000","last_became_peered":"2023-07-21T22:18:43.340199+0000","last_unstale":"2023-07-21T22:18:45.795870+0000","last_undegraded":"2023-07-21T22:18:45.795870+0000","last_fullsized":"2023-07-21T22:18:45.795870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:41.872809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797371+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:18:45.797371+0000","last_peered":"2023-07-21T22:18:45.797371+0000","last_clean":"2023-07-21T22:18:45.797371+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:18:45.797371+0000","last_undegraded":"2023-07-21T22:18:45.797371+0000","last_fullsized":"2023-07-21T22:18:45.797371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:24.074202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326567+0000","last_change":"2023-07-21T22:18:44.347206+0000","last_active":"2023-07-21T22:18:45.326567+0000","last_peered":"2023-07-21T22:18:45.326567+0000","last_clean":"2023-07-21T22:18:45.326567+0000","last_became_active":"2023-07-21T22:18:44.346914+0000","last_became_peered":"2023-07-21T22:18:44.346914+0000","last_unstale":"2023-07-21T22:18:45.326567+0000","last_undegraded":"2023-07-21T22:18:45.326567+0000","last_fullsized":"2023-07-21T22:18:45.326567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:25:34.392203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327256+0000","last_change":"2023-07-21T22:18:44.343986+0000","last_active":"2023-07-21T22:18:45.327256+0000","last_peered":"2023-07-21T22:18:45.327256+0000","last_clean":"2023-07-21T22:18:45.327256+0000","last_became_active":"2023-07-21T22:18:44.342943+0000","last_became_peered":"2023-07-21T22:18:44.342943+0000","last_unstale":"2023-07-21T22:18:45.327256+0000","last_undegraded":"2023-07-21T22:18:45.327256+0000","last_fullsized":"2023-07-21T22:18:45.327256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:43.536674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"25'6","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327927+0000","last_change":"2023-07-21T22:18:43.336129+0000","last_active":"2023-07-21T22:18:45.327927+0000","last_peered":"2023-07-21T22:18:45.327927+0000","last_clean":"2023-07-21T22:18:45.327927+0000","last_became_active":"2023-07-21T22:18:43.335850+0000","last_became_peered":"2023-07-21T22:18:43.335850+0000","last_unstale":"2023-07-21T22:18:45.327927+0000","last_undegraded":"2023-07-21T22:18:45.327927+0000","last_fullsized":"2023-07-21T22:18:45.327927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:05.503990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795179+0000","last_change":"2023-07-21T22:18:44.351088+0000","last_active":"2023-07-21T22:18:45.795179+0000","last_peered":"2023-07-21T22:18:45.795179+0000","last_clean":"2023-07-21T22:18:45.795179+0000","last_became_active":"2023-07-21T22:18:44.350791+0000","last_became_peered":"2023-07-21T22:18:44.350791+0000","last_unstale":"2023-07-21T22:18:45.795179+0000","last_undegraded":"2023-07-21T22:18:45.795179+0000","last_fullsized":"2023-07-21T22:18:45.795179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:35:32.085049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"25'3","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797454+0000","last_change":"2023-07-21T22:18:43.340832+0000","last_active":"2023-07-21T22:18:45.797454+0000","last_peered":"2023-07-21T22:18:45.797454+0000","last_clean":"2023-07-21T22:18:45.797454+0000","last_became_active":"2023-07-21T22:18:43.340519+0000","last_became_peered":"2023-07-21T22:18:43.340519+0000","last_unstale":"2023-07-21T22:18:45.797454+0000","last_undegraded":"2023-07-21T22:18:45.797454+0000","last_fullsized":"2023-07-21T22:18:45.797454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:10:12.772739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327803+0000","last_change":"2023-07-21T22:18:43.335834+0000","last_active":"2023-07-21T22:18:45.327803+0000","last_peered":"2023-07-21T22:18:45.327803+0000","last_clean":"2023-07-21T22:18:45.327803+0000","last_became_active":"2023-07-21T22:18:43.335518+0000","last_became_peered":"2023-07-21T22:18:43.335518+0000","last_unstale":"2023-07-21T22:18:45.327803+0000","last_undegraded":"2023-07-21T22:18:45.327803+0000","last_fullsized":"2023-07-21T22:18:45.327803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:27:11.489986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325377+0000","last_change":"2023-07-21T22:18:44.349059+0000","last_active":"2023-07-21T22:18:45.325377+0000","last_peered":"2023-07-21T22:18:45.325377+0000","last_clean":"2023-07-21T22:18:45.325377+0000","last_became_active":"2023-07-21T22:18:44.348691+0000","last_became_peered":"2023-07-21T22:18:44.348691+0000","last_unstale":"2023-07-21T22:18:45.325377+0000","last_undegraded":"2023-07-21T22:18:45.325377+0000","last_fullsized":"2023-07-21T22:18:45.325377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:35:32.085049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795629+0000","last_change":"2023-07-21T22:18:43.341273+0000","last_active":"2023-07-21T22:18:45.795629+0000","last_peered":"2023-07-21T22:18:45.795629+0000","last_clean":"2023-07-21T22:18:45.795629+0000","last_became_active":"2023-07-21T22:18:43.340594+0000","last_became_peered":"2023-07-21T22:18:43.340594+0000","last_unstale":"2023-07-21T22:18:45.795629+0000","last_undegraded":"2023-07-21T22:18:45.795629+0000","last_fullsized":"2023-07-21T22:18:45.795629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:35:31.073978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325175+0000","last_change":"2023-07-21T22:18:44.341063+0000","last_active":"2023-07-21T22:18:45.325175+0000","last_peered":"2023-07-21T22:18:45.325175+0000","last_clean":"2023-07-21T22:18:45.325175+0000","last_became_active":"2023-07-21T22:18:44.337396+0000","last_became_peered":"2023-07-21T22:18:44.337396+0000","last_unstale":"2023-07-21T22:18:45.325175+0000","last_undegraded":"2023-07-21T22:18:45.325175+0000","last_fullsized":"2023-07-21T22:18:45.325175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:42.552801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797343+0000","last_change":"2023-07-21T22:18:44.334652+0000","last_active":"2023-07-21T22:18:45.797343+0000","last_peered":"2023-07-21T22:18:45.797343+0000","last_clean":"2023-07-21T22:18:45.797343+0000","last_became_active":"2023-07-21T22:18:44.334333+0000","last_became_peered":"2023-07-21T22:18:44.334333+0000","last_unstale":"2023-07-21T22:18:45.797343+0000","last_undegraded":"2023-07-21T22:18:45.797343+0000","last_fullsized":"2023-07-21T22:18:45.797343+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:42.552801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325316+0000","last_change":"2023-07-21T22:18:43.341804+0000","last_active":"2023-07-21T22:18:45.325316+0000","last_peered":"2023-07-21T22:18:45.325316+0000","last_clean":"2023-07-21T22:18:45.325316+0000","last_became_active":"2023-07-21T22:18:43.341205+0000","last_became_peered":"2023-07-21T22:18:43.341205+0000","last_unstale":"2023-07-21T22:18:45.325316+0000","last_undegraded":"2023-07-21T22:18:45.325316+0000","last_fullsized":"2023-07-21T22:18:45.325316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:38:34.109172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795614+0000","last_change":"2023-07-21T22:18:44.338013+0000","last_active":"2023-07-21T22:18:45.795614+0000","last_peered":"2023-07-21T22:18:45.795614+0000","last_clean":"2023-07-21T22:18:45.795614+0000","last_became_active":"2023-07-21T22:18:44.337701+0000","last_became_peered":"2023-07-21T22:18:44.337701+0000","last_unstale":"2023-07-21T22:18:45.795614+0000","last_undegraded":"2023-07-21T22:18:45.795614+0000","last_fullsized":"2023-07-21T22:18:45.795614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:41:47.804776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795127+0000","last_change":"2023-07-21T22:18:43.337656+0000","last_active":"2023-07-21T22:18:45.795127+0000","last_peered":"2023-07-21T22:18:45.795127+0000","last_clean":"2023-07-21T22:18:45.795127+0000","last_became_active":"2023-07-21T22:18:43.337228+0000","last_became_peered":"2023-07-21T22:18:43.337228+0000","last_unstale":"2023-07-21T22:18:45.795127+0000","last_undegraded":"2023-07-21T22:18:45.795127+0000","last_fullsized":"2023-07-21T22:18:45.795127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:29:13.898457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325846+0000","last_change":"2023-07-21T22:18:44.337074+0000","last_active":"2023-07-21T22:18:45.325846+0000","last_peered":"2023-07-21T22:18:45.325846+0000","last_clean":"2023-07-21T22:18:45.325846+0000","last_became_active":"2023-07-21T22:18:44.336374+0000","last_became_peered":"2023-07-21T22:18:44.336374+0000","last_unstale":"2023-07-21T22:18:45.325846+0000","last_undegraded":"2023-07-21T22:18:45.325846+0000","last_fullsized":"2023-07-21T22:18:45.325846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:45:28.665708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"25'1","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326818+0000","last_change":"2023-07-21T22:18:43.343871+0000","last_active":"2023-07-21T22:18:45.326818+0000","last_peered":"2023-07-21T22:18:45.326818+0000","last_clean":"2023-07-21T22:18:45.326818+0000","last_became_active":"2023-07-21T22:18:43.342848+0000","last_became_peered":"2023-07-21T22:18:43.342848+0000","last_unstale":"2023-07-21T22:18:45.326818+0000","last_undegraded":"2023-07-21T22:18:45.326818+0000","last_fullsized":"2023-07-21T22:18:45.326818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:29:22.726274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796455+0000","last_change":"2023-07-21T22:18:44.338868+0000","last_active":"2023-07-21T22:18:45.796455+0000","last_peered":"2023-07-21T22:18:45.796455+0000","last_clean":"2023-07-21T22:18:45.796455+0000","last_became_active":"2023-07-21T22:18:44.337629+0000","last_became_peered":"2023-07-21T22:18:44.337629+0000","last_unstale":"2023-07-21T22:18:45.796455+0000","last_undegraded":"2023-07-21T22:18:45.796455+0000","last_fullsized":"2023-07-21T22:18:45.796455+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:45.242179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"25'1","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795902+0000","last_change":"2023-07-21T22:18:43.347419+0000","last_active":"2023-07-21T22:18:45.795902+0000","last_peered":"2023-07-21T22:18:45.795902+0000","last_clean":"2023-07-21T22:18:45.795902+0000","last_became_active":"2023-07-21T22:18:43.347118+0000","last_became_peered":"2023-07-21T22:18:43.347118+0000","last_unstale":"2023-07-21T22:18:45.795902+0000","last_undegraded":"2023-07-21T22:18:45.795902+0000","last_fullsized":"2023-07-21T22:18:45.795902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:35:08.647021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326967+0000","last_change":"2023-07-21T22:18:44.345638+0000","last_active":"2023-07-21T22:18:45.326967+0000","last_peered":"2023-07-21T22:18:45.326967+0000","last_clean":"2023-07-21T22:18:45.326967+0000","last_became_active":"2023-07-21T22:18:44.345310+0000","last_became_peered":"2023-07-21T22:18:44.345310+0000","last_unstale":"2023-07-21T22:18:45.326967+0000","last_undegraded":"2023-07-21T22:18:45.326967+0000","last_fullsized":"2023-07-21T22:18:45.326967+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:10.090300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"25'2","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327549+0000","last_change":"2023-07-21T22:18:43.345885+0000","last_active":"2023-07-21T22:18:45.327549+0000","last_peered":"2023-07-21T22:18:45.327549+0000","last_clean":"2023-07-21T22:18:45.327549+0000","last_became_active":"2023-07-21T22:18:43.345540+0000","last_became_peered":"2023-07-21T22:18:43.345540+0000","last_unstale":"2023-07-21T22:18:45.327549+0000","last_undegraded":"2023-07-21T22:18:45.327549+0000","last_fullsized":"2023-07-21T22:18:45.327549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:09.079229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326687+0000","last_change":"2023-07-21T22:18:44.346068+0000","last_active":"2023-07-21T22:18:45.326687+0000","last_peered":"2023-07-21T22:18:45.326687+0000","last_clean":"2023-07-21T22:18:45.326687+0000","last_became_active":"2023-07-21T22:18:44.345741+0000","last_became_peered":"2023-07-21T22:18:44.345741+0000","last_unstale":"2023-07-21T22:18:45.326687+0000","last_undegraded":"2023-07-21T22:18:45.326687+0000","last_fullsized":"2023-07-21T22:18:45.326687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:10:33.167054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327858+0000","last_change":"2023-07-21T22:18:43.342235+0000","last_active":"2023-07-21T22:18:45.327858+0000","last_peered":"2023-07-21T22:18:45.327858+0000","last_clean":"2023-07-21T22:18:45.327858+0000","last_became_active":"2023-07-21T22:18:43.341945+0000","last_became_peered":"2023-07-21T22:18:43.341945+0000","last_unstale":"2023-07-21T22:18:45.327858+0000","last_undegraded":"2023-07-21T22:18:45.327858+0000","last_fullsized":"2023-07-21T22:18:45.327858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:08:28.886811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325543+0000","last_change":"2023-07-21T22:18:44.342724+0000","last_active":"2023-07-21T22:18:45.325543+0000","last_peered":"2023-07-21T22:18:45.325543+0000","last_clean":"2023-07-21T22:18:45.325543+0000","last_became_active":"2023-07-21T22:18:44.342450+0000","last_became_peered":"2023-07-21T22:18:44.342450+0000","last_unstale":"2023-07-21T22:18:45.325543+0000","last_undegraded":"2023-07-21T22:18:45.325543+0000","last_fullsized":"2023-07-21T22:18:45.325543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:17:36.412750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325551+0000","last_change":"2023-07-21T22:18:43.328543+0000","last_active":"2023-07-21T22:18:45.325551+0000","last_peered":"2023-07-21T22:18:45.325551+0000","last_clean":"2023-07-21T22:18:45.325551+0000","last_became_active":"2023-07-21T22:18:43.328165+0000","last_became_peered":"2023-07-21T22:18:43.328165+0000","last_unstale":"2023-07-21T22:18:45.325551+0000","last_undegraded":"2023-07-21T22:18:45.325551+0000","last_fullsized":"2023-07-21T22:18:45.325551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:41:46.793705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326688+0000","last_change":"2023-07-21T22:18:44.343626+0000","last_active":"2023-07-21T22:18:45.326688+0000","last_peered":"2023-07-21T22:18:45.326688+0000","last_clean":"2023-07-21T22:18:45.326688+0000","last_became_active":"2023-07-21T22:18:44.343339+0000","last_became_peered":"2023-07-21T22:18:44.343339+0000","last_unstale":"2023-07-21T22:18:45.326688+0000","last_undegraded":"2023-07-21T22:18:45.326688+0000","last_fullsized":"2023-07-21T22:18:45.326688+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:51.653402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"25'4","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795572+0000","last_change":"2023-07-21T22:18:43.341441+0000","last_active":"2023-07-21T22:18:45.795572+0000","last_peered":"2023-07-21T22:18:45.795572+0000","last_clean":"2023-07-21T22:18:45.795572+0000","last_became_active":"2023-07-21T22:18:43.340962+0000","last_became_peered":"2023-07-21T22:18:43.340962+0000","last_unstale":"2023-07-21T22:18:45.795572+0000","last_undegraded":"2023-07-21T22:18:45.795572+0000","last_fullsized":"2023-07-21T22:18:45.795572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:29:13.898457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":692276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":278528,"data_stored":100780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":101748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":100218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":100128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":100128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":868352,"data_stored":691078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":100128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:18:59.617 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:18:59.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.752+0000 7ff349d40640 1 Processor -- start 2023-07-21T22:18:59.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.752+0000 7ff349d40640 1 -- start start 2023-07-21T22:18:59.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.756+0000 7ff349d40640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff34415fd60 0x7ff3440d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.756+0000 7ff349d40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440d1850 0x7ff3440d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.756+0000 7ff349d40640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3440ccaf0 con 0x7ff3440b7c70 2023-07-21T22:18:59.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.756+0000 7ff349d40640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3440d1190 con 0x7ff34415fd60 2023-07-21T22:18:59.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.756+0000 7ff349d40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff344160600 con 0x7ff3440d1850 2023-07-21T22:18:59.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.756+0000 7ff342ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff34415fd60 0x7ff3440d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.756+0000 7ff342ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff34415fd60 0x7ff3440d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58342/0 (socket says 172.21.15.6:58342) 2023-07-21T22:18:59.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.756+0000 7ff342ffd640 1 -- 172.21.15.6:0/1088035798 learned_addr learned my addr 172.21.15.6:0/1088035798 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:59.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.756+0000 7ff343fff640 1 --2- 172.21.15.6:0/1088035798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440d1850 0x7ff3440d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.756+0000 7ff342ffd640 1 -- 172.21.15.6:0/1088035798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440d1850 msgr2=0x7ff3440d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:59.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.756+0000 7ff342ffd640 1 --2- 172.21.15.6:0/1088035798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440d1850 0x7ff3440d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.756+0000 7ff342ffd640 1 -- 172.21.15.6:0/1088035798 >> v1:172.21.15.161:6789/0 conn(0x7ff3440b7c70 legacy=0x7ff34415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.756+0000 7ff342ffd640 1 -- 172.21.15.6:0/1088035798 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff344160320 con 0x7ff34415fd60 2023-07-21T22:18:59.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.760+0000 7ff342ffd640 1 --2- 172.21.15.6:0/1088035798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff34415fd60 0x7ff3440d0c50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff338009870 tx=0x7ff33801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4a302444171452 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:59.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.760+0000 7ff3427fc640 1 -- 172.21.15.6:0/1088035798 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3380a95f0 con 0x7ff34415fd60 2023-07-21T22:18:59.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.760+0000 7ff3427fc640 1 -- 172.21.15.6:0/1088035798 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3380a9750 con 0x7ff34415fd60 2023-07-21T22:18:59.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.760+0000 7ff3427fc640 1 -- 172.21.15.6:0/1088035798 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3380a9ae0 con 0x7ff34415fd60 2023-07-21T22:18:59.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.760+0000 7ff349d40640 1 -- 172.21.15.6:0/1088035798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff34415fd60 msgr2=0x7ff3440d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.760+0000 7ff349d40640 1 --2- 172.21.15.6:0/1088035798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff34415fd60 0x7ff3440d0c50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff338009870 tx=0x7ff33801c510 comp rx=0 tx=0).stop 2023-07-21T22:18:59.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.760+0000 7ff349d40640 1 -- 172.21.15.6:0/1088035798 shutdown_connections 2023-07-21T22:18:59.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.760+0000 7ff349d40640 1 --2- 172.21.15.6:0/1088035798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440d1850 0x7ff3440d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.760+0000 7ff349d40640 1 --2- 172.21.15.6:0/1088035798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff34415fd60 0x7ff3440d0c50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.760+0000 7ff349d40640 1 -- 172.21.15.6:0/1088035798 >> 172.21.15.6:0/1088035798 conn(0x7ff3440650b0 msgr2=0x7ff3440654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:59.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.760+0000 7ff349d40640 1 -- 172.21.15.6:0/1088035798 shutdown_connections 2023-07-21T22:18:59.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.760+0000 7ff349d40640 1 -- 172.21.15.6:0/1088035798 wait complete. 2023-07-21T22:18:59.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.760+0000 7ff349d40640 1 Processor -- start 2023-07-21T22:18:59.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.760+0000 7ff349d40640 1 -- start start 2023-07-21T22:18:59.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff349d40640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3440b7c70 0x7ff344154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff349d40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440d1850 0x7ff3440c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff349d40640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff34415fd60 0x7ff34415e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff349d40640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34415b7b0 con 0x7ff3440b7c70 2023-07-21T22:18:59.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff349d40640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440c88e0 con 0x7ff34415fd60 2023-07-21T22:18:59.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff349d40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3440c8bc0 con 0x7ff3440d1850 2023-07-21T22:18:59.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff3437fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3440b7c70 0x7ff344154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff3437fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3440b7c70 0x7ff344154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58352/0 (socket says 172.21.15.6:58352) 2023-07-21T22:18:59.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff3437fe640 1 -- 172.21.15.6:0/850106197 learned_addr learned my addr 172.21.15.6:0/850106197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:18:59.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff342ffd640 1 --2- 172.21.15.6:0/850106197 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440d1850 0x7ff3440c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff343fff640 1 --2- 172.21.15.6:0/850106197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff34415fd60 0x7ff34415e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff3437fe640 1 -- 172.21.15.6:0/850106197 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440d1850 msgr2=0x7ff3440c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff3437fe640 1 --2- 172.21.15.6:0/850106197 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440d1850 0x7ff3440c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff3437fe640 1 -- 172.21.15.6:0/850106197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff34415fd60 msgr2=0x7ff34415e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff3437fe640 1 --2- 172.21.15.6:0/850106197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff34415fd60 0x7ff34415e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff3437fe640 1 -- 172.21.15.6:0/850106197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3380094d0 con 0x7ff3440b7c70 2023-07-21T22:18:59.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff343fff640 1 --2- 172.21.15.6:0/850106197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff34415fd60 0x7ff34415e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:59.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff3437fe640 1 --2- 172.21.15.6:0/850106197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3440b7c70 0x7ff344154140 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff33400c3c0 tx=0x7ff33400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:59.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff32bfff640 1 -- 172.21.15.6:0/850106197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3340052d0 con 0x7ff3440b7c70 2023-07-21T22:18:59.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff32bfff640 1 -- 172.21.15.6:0/850106197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff334005430 con 0x7ff3440b7c70 2023-07-21T22:18:59.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff32bfff640 1 -- 172.21.15.6:0/850106197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff334003840 con 0x7ff3440b7c70 2023-07-21T22:18:59.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff349d40640 1 -- 172.21.15.6:0/850106197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3440c8ea0 con 0x7ff3440b7c70 2023-07-21T22:18:59.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff349d40640 1 -- 172.21.15.6:0/850106197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3440c8380 con 0x7ff3440b7c70 2023-07-21T22:18:59.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.764+0000 7ff349d40640 1 -- 172.21.15.6:0/850106197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3440678d0 con 0x7ff3440b7c70 2023-07-21T22:18:59.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.768+0000 7ff32bfff640 1 -- 172.21.15.6:0/850106197 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff3340039a0 con 0x7ff3440b7c70 2023-07-21T22:18:59.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.768+0000 7ff32bfff640 1 --2- 172.21.15.6:0/850106197 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff330066280 0x7ff330068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.768+0000 7ff32bfff640 1 -- 172.21.15.6:0/850106197 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff334083260 con 0x7ff3440b7c70 2023-07-21T22:18:59.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.768+0000 7ff342ffd640 1 --2- 172.21.15.6:0/850106197 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff330066280 0x7ff330068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.768+0000 7ff342ffd640 1 --2- 172.21.15.6:0/850106197 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff330066280 0x7ff330068730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff3380ae000 tx=0x7ff3380b4040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:59.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.772+0000 7ff32bfff640 1 -- 172.21.15.6:0/850106197 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff3340506f0 con 0x7ff3440b7c70 2023-07-21T22:18:59.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.928+0000 7ff349d40640 1 -- 172.21.15.6:0/850106197 --> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3440c7a60 con 0x7ff330066280 2023-07-21T22:18:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.936+0000 7ff32bfff640 1 -- 172.21.15.6:0/850106197 <== mgr.4103 v2:172.21.15.161:6832/3471136886 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286678 (secure 0 0 0) 0x7ff3440c7a60 con 0x7ff330066280 2023-07-21T22:18:59.984 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:18:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:18:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.936+0000 7ff349d40640 1 -- 172.21.15.6:0/850106197 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff330066280 msgr2=0x7ff330068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.936+0000 7ff349d40640 1 --2- 172.21.15.6:0/850106197 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff330066280 0x7ff330068730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff3380ae000 tx=0x7ff3380b4040 comp rx=0 tx=0).stop 2023-07-21T22:18:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.936+0000 7ff349d40640 1 -- 172.21.15.6:0/850106197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3440b7c70 msgr2=0x7ff344154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.936+0000 7ff349d40640 1 --2- 172.21.15.6:0/850106197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3440b7c70 0x7ff344154140 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff33400c3c0 tx=0x7ff33400c880 comp rx=0 tx=0).stop 2023-07-21T22:18:59.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.936+0000 7ff349d40640 1 -- 172.21.15.6:0/850106197 shutdown_connections 2023-07-21T22:18:59.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.936+0000 7ff349d40640 1 --2- 172.21.15.6:0/850106197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff34415fd60 0x7ff34415e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.936+0000 7ff349d40640 1 --2- 172.21.15.6:0/850106197 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3440d1850 0x7ff3440c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.936+0000 7ff349d40640 1 --2- 172.21.15.6:0/850106197 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff330066280 0x7ff330068730 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.936+0000 7ff349d40640 1 --2- 172.21.15.6:0/850106197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3440b7c70 0x7ff344154140 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.940+0000 7ff349d40640 1 -- 172.21.15.6:0/850106197 >> 172.21.15.6:0/850106197 conn(0x7ff3440650b0 msgr2=0x7ff3440b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:59.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.940+0000 7ff349d40640 1 -- 172.21.15.6:0/850106197 shutdown_connections 2023-07-21T22:18:59.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:18:59.940+0000 7ff349d40640 1 -- 172.21.15.6:0/850106197 wait complete. 2023-07-21T22:19:00.004 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-07-21T22:18:58.771596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218952,"kb_used_data":3336,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755768,"statfs":{"total":773094113280,"available":772869906432,"internally_reserved":0,"allocated":3416064,"data_stored":1986484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003121"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796317+0000","last_change":"2023-07-21T22:18:44.336499+0000","last_active":"2023-07-21T22:18:45.796317+0000","last_peered":"2023-07-21T22:18:45.796317+0000","last_clean":"2023-07-21T22:18:45.796317+0000","last_became_active":"2023-07-21T22:18:44.336063+0000","last_became_peered":"2023-07-21T22:18:44.336063+0000","last_unstale":"2023-07-21T22:18:45.796317+0000","last_undegraded":"2023-07-21T22:18:45.796317+0000","last_fullsized":"2023-07-21T22:18:45.796317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:26:54.799948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327558+0000","last_change":"2023-07-21T22:18:44.341470+0000","last_active":"2023-07-21T22:18:45.327558+0000","last_peered":"2023-07-21T22:18:45.327558+0000","last_clean":"2023-07-21T22:18:45.327558+0000","last_became_active":"2023-07-21T22:18:44.341148+0000","last_became_peered":"2023-07-21T22:18:44.341148+0000","last_unstale":"2023-07-21T22:18:45.327558+0000","last_undegraded":"2023-07-21T22:18:45.327558+0000","last_fullsized":"2023-07-21T22:18:45.327558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:43.536674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.328154+0000","last_change":"2023-07-21T22:18:44.336245+0000","last_active":"2023-07-21T22:18:45.328154+0000","last_peered":"2023-07-21T22:18:45.328154+0000","last_clean":"2023-07-21T22:18:45.328154+0000","last_became_active":"2023-07-21T22:18:44.335682+0000","last_became_peered":"2023-07-21T22:18:44.335682+0000","last_unstale":"2023-07-21T22:18:45.328154+0000","last_undegraded":"2023-07-21T22:18:45.328154+0000","last_fullsized":"2023-07-21T22:18:45.328154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:40:01.001208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797167+0000","last_change":"2023-07-21T22:18:44.335476+0000","last_active":"2023-07-21T22:18:45.797167+0000","last_peered":"2023-07-21T22:18:45.797167+0000","last_clean":"2023-07-21T22:18:45.797167+0000","last_became_active":"2023-07-21T22:18:44.335151+0000","last_became_peered":"2023-07-21T22:18:44.335151+0000","last_unstale":"2023-07-21T22:18:45.797167+0000","last_undegraded":"2023-07-21T22:18:45.797167+0000","last_fullsized":"2023-07-21T22:18:45.797167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:38:06.965559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795835+0000","last_change":"2023-07-21T22:18:44.344066+0000","last_active":"2023-07-21T22:18:45.795835+0000","last_peered":"2023-07-21T22:18:45.795835+0000","last_clean":"2023-07-21T22:18:45.795835+0000","last_became_active":"2023-07-21T22:18:44.343765+0000","last_became_peered":"2023-07-21T22:18:44.343765+0000","last_unstale":"2023-07-21T22:18:45.795835+0000","last_undegraded":"2023-07-21T22:18:45.795835+0000","last_fullsized":"2023-07-21T22:18:45.795835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:45:28.665708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326588+0000","last_change":"2023-07-21T22:18:44.336096+0000","last_active":"2023-07-21T22:18:45.326588+0000","last_peered":"2023-07-21T22:18:45.326588+0000","last_clean":"2023-07-21T22:18:45.326588+0000","last_became_active":"2023-07-21T22:18:44.335625+0000","last_became_peered":"2023-07-21T22:18:44.335625+0000","last_unstale":"2023-07-21T22:18:45.326588+0000","last_undegraded":"2023-07-21T22:18:45.326588+0000","last_fullsized":"2023-07-21T22:18:45.326588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:50.386184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797019+0000","last_change":"2023-07-21T22:18:44.338953+0000","last_active":"2023-07-21T22:18:45.797019+0000","last_peered":"2023-07-21T22:18:45.797019+0000","last_clean":"2023-07-21T22:18:45.797019+0000","last_became_active":"2023-07-21T22:18:44.338582+0000","last_became_peered":"2023-07-21T22:18:44.338582+0000","last_unstale":"2023-07-21T22:18:45.797019+0000","last_undegraded":"2023-07-21T22:18:45.797019+0000","last_fullsized":"2023-07-21T22:18:45.797019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:27:12.501057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327145+0000","last_change":"2023-07-21T22:18:44.337662+0000","last_active":"2023-07-21T22:18:45.327145+0000","last_peered":"2023-07-21T22:18:45.327145+0000","last_clean":"2023-07-21T22:18:45.327145+0000","last_became_active":"2023-07-21T22:18:44.337217+0000","last_became_peered":"2023-07-21T22:18:44.337217+0000","last_unstale":"2023-07-21T22:18:45.327145+0000","last_undegraded":"2023-07-21T22:18:45.327145+0000","last_fullsized":"2023-07-21T22:18:45.327145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:10:33.167054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795402+0000","last_change":"2023-07-21T22:18:44.344268+0000","last_active":"2023-07-21T22:18:45.795402+0000","last_peered":"2023-07-21T22:18:45.795402+0000","last_clean":"2023-07-21T22:18:45.795402+0000","last_became_active":"2023-07-21T22:18:44.343880+0000","last_became_peered":"2023-07-21T22:18:44.343880+0000","last_unstale":"2023-07-21T22:18:45.795402+0000","last_undegraded":"2023-07-21T22:18:45.795402+0000","last_fullsized":"2023-07-21T22:18:45.795402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:59:41.204617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327626+0000","last_change":"2023-07-21T22:18:44.336379+0000","last_active":"2023-07-21T22:18:45.327626+0000","last_peered":"2023-07-21T22:18:45.327626+0000","last_clean":"2023-07-21T22:18:45.327626+0000","last_became_active":"2023-07-21T22:18:44.335846+0000","last_became_peered":"2023-07-21T22:18:44.335846+0000","last_unstale":"2023-07-21T22:18:45.327626+0000","last_undegraded":"2023-07-21T22:18:45.327626+0000","last_fullsized":"2023-07-21T22:18:45.327626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:39:23.702494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.328146+0000","last_change":"2023-07-21T22:18:44.352832+0000","last_active":"2023-07-21T22:18:45.328146+0000","last_peered":"2023-07-21T22:18:45.328146+0000","last_clean":"2023-07-21T22:18:45.328146+0000","last_became_active":"2023-07-21T22:18:44.352465+0000","last_became_peered":"2023-07-21T22:18:44.352465+0000","last_unstale":"2023-07-21T22:18:45.328146+0000","last_undegraded":"2023-07-21T22:18:45.328146+0000","last_fullsized":"2023-07-21T22:18:45.328146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:08:29.897882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796396+0000","last_change":"2023-07-21T22:18:44.337129+0000","last_active":"2023-07-21T22:18:45.796396+0000","last_peered":"2023-07-21T22:18:45.796396+0000","last_clean":"2023-07-21T22:18:45.796396+0000","last_became_active":"2023-07-21T22:18:44.336170+0000","last_became_peered":"2023-07-21T22:18:44.336170+0000","last_unstale":"2023-07-21T22:18:45.796396+0000","last_undegraded":"2023-07-21T22:18:45.796396+0000","last_fullsized":"2023-07-21T22:18:45.796396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:03:22.387909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796163+0000","last_change":"2023-07-21T22:18:44.335382+0000","last_active":"2023-07-21T22:18:45.796163+0000","last_peered":"2023-07-21T22:18:45.796163+0000","last_clean":"2023-07-21T22:18:45.796163+0000","last_became_active":"2023-07-21T22:18:44.334933+0000","last_became_peered":"2023-07-21T22:18:44.334933+0000","last_unstale":"2023-07-21T22:18:45.796163+0000","last_undegraded":"2023-07-21T22:18:45.796163+0000","last_fullsized":"2023-07-21T22:18:45.796163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:51.413018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327284+0000","last_change":"2023-07-21T22:18:44.333998+0000","last_active":"2023-07-21T22:18:45.327284+0000","last_peered":"2023-07-21T22:18:45.327284+0000","last_clean":"2023-07-21T22:18:45.327284+0000","last_became_active":"2023-07-21T22:18:44.333720+0000","last_became_peered":"2023-07-21T22:18:44.333720+0000","last_unstale":"2023-07-21T22:18:45.327284+0000","last_undegraded":"2023-07-21T22:18:45.327284+0000","last_fullsized":"2023-07-21T22:18:45.327284+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:40:46.117470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797150+0000","last_change":"2023-07-21T22:18:44.341061+0000","last_active":"2023-07-21T22:18:45.797150+0000","last_peered":"2023-07-21T22:18:45.797150+0000","last_clean":"2023-07-21T22:18:45.797150+0000","last_became_active":"2023-07-21T22:18:44.340711+0000","last_became_peered":"2023-07-21T22:18:44.340711+0000","last_unstale":"2023-07-21T22:18:45.797150+0000","last_undegraded":"2023-07-21T22:18:45.797150+0000","last_fullsized":"2023-07-21T22:18:45.797150+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:08:29.897882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326507+0000","last_change":"2023-07-21T22:18:44.335984+0000","last_active":"2023-07-21T22:18:45.326507+0000","last_peered":"2023-07-21T22:18:45.326507+0000","last_clean":"2023-07-21T22:18:45.326507+0000","last_became_active":"2023-07-21T22:18:44.335481+0000","last_became_peered":"2023-07-21T22:18:44.335481+0000","last_unstale":"2023-07-21T22:18:45.326507+0000","last_undegraded":"2023-07-21T22:18:45.326507+0000","last_fullsized":"2023-07-21T22:18:45.326507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:05.701948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795507+0000","last_change":"2023-07-21T22:18:44.333526+0000","last_active":"2023-07-21T22:18:45.795507+0000","last_peered":"2023-07-21T22:18:45.795507+0000","last_clean":"2023-07-21T22:18:45.795507+0000","last_became_active":"2023-07-21T22:18:44.333139+0000","last_became_peered":"2023-07-21T22:18:44.333139+0000","last_unstale":"2023-07-21T22:18:45.795507+0000","last_undegraded":"2023-07-21T22:18:45.795507+0000","last_fullsized":"2023-07-21T22:18:45.795507+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:55:23.041464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327855+0000","last_change":"2023-07-21T22:18:44.339606+0000","last_active":"2023-07-21T22:18:45.327855+0000","last_peered":"2023-07-21T22:18:45.327855+0000","last_clean":"2023-07-21T22:18:45.327855+0000","last_became_active":"2023-07-21T22:18:44.339282+0000","last_became_peered":"2023-07-21T22:18:44.339282+0000","last_unstale":"2023-07-21T22:18:45.327855+0000","last_undegraded":"2023-07-21T22:18:45.327855+0000","last_fullsized":"2023-07-21T22:18:45.327855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:19:32.663742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796266+0000","last_change":"2023-07-21T22:18:44.325126+0000","last_active":"2023-07-21T22:18:45.796266+0000","last_peered":"2023-07-21T22:18:45.796266+0000","last_clean":"2023-07-21T22:18:45.796266+0000","last_became_active":"2023-07-21T22:18:44.324795+0000","last_became_peered":"2023-07-21T22:18:44.324795+0000","last_unstale":"2023-07-21T22:18:45.796266+0000","last_undegraded":"2023-07-21T22:18:45.796266+0000","last_fullsized":"2023-07-21T22:18:45.796266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:05.638943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327584+0000","last_change":"2023-07-21T22:18:44.338316+0000","last_active":"2023-07-21T22:18:45.327584+0000","last_peered":"2023-07-21T22:18:45.327584+0000","last_clean":"2023-07-21T22:18:45.327584+0000","last_became_active":"2023-07-21T22:18:44.337895+0000","last_became_peered":"2023-07-21T22:18:44.337895+0000","last_unstale":"2023-07-21T22:18:45.327584+0000","last_undegraded":"2023-07-21T22:18:45.327584+0000","last_fullsized":"2023-07-21T22:18:45.327584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:39:23.702494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796989+0000","last_change":"2023-07-21T22:18:44.355582+0000","last_active":"2023-07-21T22:18:45.796989+0000","last_peered":"2023-07-21T22:18:45.796989+0000","last_clean":"2023-07-21T22:18:45.796989+0000","last_became_active":"2023-07-21T22:18:44.355317+0000","last_became_peered":"2023-07-21T22:18:44.355317+0000","last_unstale":"2023-07-21T22:18:45.796989+0000","last_undegraded":"2023-07-21T22:18:45.796989+0000","last_fullsized":"2023-07-21T22:18:45.796989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:06.515061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.794789+0000","last_change":"2023-07-21T22:18:44.348333+0000","last_active":"2023-07-21T22:18:45.794789+0000","last_peered":"2023-07-21T22:18:45.794789+0000","last_clean":"2023-07-21T22:18:45.794789+0000","last_became_active":"2023-07-21T22:18:44.347982+0000","last_became_peered":"2023-07-21T22:18:44.347982+0000","last_unstale":"2023-07-21T22:18:45.794789+0000","last_undegraded":"2023-07-21T22:18:45.794789+0000","last_fullsized":"2023-07-21T22:18:45.794789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:27.420151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325227+0000","last_change":"2023-07-21T22:18:44.333429+0000","last_active":"2023-07-21T22:18:45.325227+0000","last_peered":"2023-07-21T22:18:45.325227+0000","last_clean":"2023-07-21T22:18:45.325227+0000","last_became_active":"2023-07-21T22:18:44.333121+0000","last_became_peered":"2023-07-21T22:18:44.333121+0000","last_unstale":"2023-07-21T22:18:45.325227+0000","last_undegraded":"2023-07-21T22:18:45.325227+0000","last_fullsized":"2023-07-21T22:18:45.325227+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:30.117915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796802+0000","last_change":"2023-07-21T22:18:44.346478+0000","last_active":"2023-07-21T22:18:45.796802+0000","last_peered":"2023-07-21T22:18:45.796802+0000","last_clean":"2023-07-21T22:18:45.796802+0000","last_became_active":"2023-07-21T22:18:44.346160+0000","last_became_peered":"2023-07-21T22:18:44.346160+0000","last_unstale":"2023-07-21T22:18:45.796802+0000","last_undegraded":"2023-07-21T22:18:45.796802+0000","last_fullsized":"2023-07-21T22:18:45.796802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:27:23.426700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795082+0000","last_change":"2023-07-21T22:18:44.348596+0000","last_active":"2023-07-21T22:18:45.795082+0000","last_peered":"2023-07-21T22:18:45.795082+0000","last_clean":"2023-07-21T22:18:45.795082+0000","last_became_active":"2023-07-21T22:18:44.348325+0000","last_became_peered":"2023-07-21T22:18:44.348325+0000","last_unstale":"2023-07-21T22:18:45.795082+0000","last_undegraded":"2023-07-21T22:18:45.795082+0000","last_fullsized":"2023-07-21T22:18:45.795082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:55:23.041464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795256+0000","last_change":"2023-07-21T22:18:44.335321+0000","last_active":"2023-07-21T22:18:45.795256+0000","last_peered":"2023-07-21T22:18:45.795256+0000","last_clean":"2023-07-21T22:18:45.795256+0000","last_became_active":"2023-07-21T22:18:44.334970+0000","last_became_peered":"2023-07-21T22:18:44.334970+0000","last_unstale":"2023-07-21T22:18:45.795256+0000","last_undegraded":"2023-07-21T22:18:45.795256+0000","last_fullsized":"2023-07-21T22:18:45.795256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:40:05.799874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327703+0000","last_change":"2023-07-21T22:18:44.345317+0000","last_active":"2023-07-21T22:18:45.327703+0000","last_peered":"2023-07-21T22:18:45.327703+0000","last_clean":"2023-07-21T22:18:45.327703+0000","last_became_active":"2023-07-21T22:18:44.344901+0000","last_became_peered":"2023-07-21T22:18:44.344901+0000","last_unstale":"2023-07-21T22:18:45.327703+0000","last_undegraded":"2023-07-21T22:18:45.327703+0000","last_fullsized":"2023-07-21T22:18:45.327703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:19:32.663742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795619+0000","last_change":"2023-07-21T22:18:44.336787+0000","last_active":"2023-07-21T22:18:45.795619+0000","last_peered":"2023-07-21T22:18:45.795619+0000","last_clean":"2023-07-21T22:18:45.795619+0000","last_became_active":"2023-07-21T22:18:44.336502+0000","last_became_peered":"2023-07-21T22:18:44.336502+0000","last_unstale":"2023-07-21T22:18:45.795619+0000","last_undegraded":"2023-07-21T22:18:45.795619+0000","last_fullsized":"2023-07-21T22:18:45.795619+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:32:12.452014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325564+0000","last_change":"2023-07-21T22:18:44.348671+0000","last_active":"2023-07-21T22:18:45.325564+0000","last_peered":"2023-07-21T22:18:45.325564+0000","last_clean":"2023-07-21T22:18:45.325564+0000","last_became_active":"2023-07-21T22:18:44.348361+0000","last_became_peered":"2023-07-21T22:18:44.348361+0000","last_unstale":"2023-07-21T22:18:45.325564+0000","last_undegraded":"2023-07-21T22:18:45.325564+0000","last_fullsized":"2023-07-21T22:18:45.325564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:40:05.799874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326775+0000","last_change":"2023-07-21T22:18:44.348495+0000","last_active":"2023-07-21T22:18:45.326775+0000","last_peered":"2023-07-21T22:18:45.326775+0000","last_clean":"2023-07-21T22:18:45.326775+0000","last_became_active":"2023-07-21T22:18:44.348107+0000","last_became_peered":"2023-07-21T22:18:44.348107+0000","last_unstale":"2023-07-21T22:18:45.326775+0000","last_undegraded":"2023-07-21T22:18:45.326775+0000","last_fullsized":"2023-07-21T22:18:45.326775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:40:46.117470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325342+0000","last_change":"2023-07-21T22:18:44.342060+0000","last_active":"2023-07-21T22:18:45.325342+0000","last_peered":"2023-07-21T22:18:45.325342+0000","last_clean":"2023-07-21T22:18:45.325342+0000","last_became_active":"2023-07-21T22:18:44.341767+0000","last_became_peered":"2023-07-21T22:18:44.341767+0000","last_unstale":"2023-07-21T22:18:45.325342+0000","last_undegraded":"2023-07-21T22:18:45.325342+0000","last_fullsized":"2023-07-21T22:18:45.325342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:59:41.204617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796723+0000","last_change":"2023-07-21T22:18:44.326741+0000","last_active":"2023-07-21T22:18:45.796723+0000","last_peered":"2023-07-21T22:18:45.796723+0000","last_clean":"2023-07-21T22:18:45.796723+0000","last_became_active":"2023-07-21T22:18:44.326440+0000","last_became_peered":"2023-07-21T22:18:44.326440+0000","last_unstale":"2023-07-21T22:18:45.796723+0000","last_undegraded":"2023-07-21T22:18:45.796723+0000","last_fullsized":"2023-07-21T22:18:45.796723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:29.978550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325968+0000","last_change":"2023-07-21T22:18:44.338017+0000","last_active":"2023-07-21T22:18:45.325968+0000","last_peered":"2023-07-21T22:18:45.325968+0000","last_clean":"2023-07-21T22:18:45.325968+0000","last_became_active":"2023-07-21T22:18:44.337215+0000","last_became_peered":"2023-07-21T22:18:44.337215+0000","last_unstale":"2023-07-21T22:18:45.325968+0000","last_undegraded":"2023-07-21T22:18:45.325968+0000","last_fullsized":"2023-07-21T22:18:45.325968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:42.883880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"25'2","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797139+0000","last_change":"2023-07-21T22:18:43.345411+0000","last_active":"2023-07-21T22:18:45.797139+0000","last_peered":"2023-07-21T22:18:45.797139+0000","last_clean":"2023-07-21T22:18:45.797139+0000","last_became_active":"2023-07-21T22:18:43.345095+0000","last_became_peered":"2023-07-21T22:18:43.345095+0000","last_unstale":"2023-07-21T22:18:45.797139+0000","last_undegraded":"2023-07-21T22:18:45.797139+0000","last_fullsized":"2023-07-21T22:18:45.797139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:39:59.990137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327735+0000","last_change":"2023-07-21T22:18:44.345111+0000","last_active":"2023-07-21T22:18:45.327735+0000","last_peered":"2023-07-21T22:18:45.327735+0000","last_clean":"2023-07-21T22:18:45.327735+0000","last_became_active":"2023-07-21T22:18:44.344325+0000","last_became_peered":"2023-07-21T22:18:44.344325+0000","last_unstale":"2023-07-21T22:18:45.327735+0000","last_undegraded":"2023-07-21T22:18:45.327735+0000","last_fullsized":"2023-07-21T22:18:45.327735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:06.515061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.794914+0000","last_change":"2023-07-21T22:18:43.340538+0000","last_active":"2023-07-21T22:18:45.794914+0000","last_peered":"2023-07-21T22:18:45.794914+0000","last_clean":"2023-07-21T22:18:45.794914+0000","last_became_active":"2023-07-21T22:18:43.340172+0000","last_became_peered":"2023-07-21T22:18:43.340172+0000","last_unstale":"2023-07-21T22:18:45.794914+0000","last_undegraded":"2023-07-21T22:18:45.794914+0000","last_fullsized":"2023-07-21T22:18:45.794914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:38:34.109172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795755+0000","last_change":"2023-07-21T22:18:44.342020+0000","last_active":"2023-07-21T22:18:45.795755+0000","last_peered":"2023-07-21T22:18:45.795755+0000","last_clean":"2023-07-21T22:18:45.795755+0000","last_became_active":"2023-07-21T22:18:44.341724+0000","last_became_peered":"2023-07-21T22:18:44.341724+0000","last_unstale":"2023-07-21T22:18:45.795755+0000","last_undegraded":"2023-07-21T22:18:45.795755+0000","last_fullsized":"2023-07-21T22:18:45.795755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:59:34.905191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797136+0000","last_change":"2023-07-21T22:18:43.337771+0000","last_active":"2023-07-21T22:18:45.797136+0000","last_peered":"2023-07-21T22:18:45.797136+0000","last_clean":"2023-07-21T22:18:45.797136+0000","last_became_active":"2023-07-21T22:18:43.337480+0000","last_became_peered":"2023-07-21T22:18:43.337480+0000","last_unstale":"2023-07-21T22:18:45.797136+0000","last_undegraded":"2023-07-21T22:18:45.797136+0000","last_fullsized":"2023-07-21T22:18:45.797136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:23:16.921120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325988+0000","last_change":"2023-07-21T22:18:44.349625+0000","last_active":"2023-07-21T22:18:45.325988+0000","last_peered":"2023-07-21T22:18:45.325988+0000","last_clean":"2023-07-21T22:18:45.325988+0000","last_became_active":"2023-07-21T22:18:44.349046+0000","last_became_peered":"2023-07-21T22:18:44.349046+0000","last_unstale":"2023-07-21T22:18:45.325988+0000","last_undegraded":"2023-07-21T22:18:45.325988+0000","last_fullsized":"2023-07-21T22:18:45.325988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:35:09.658092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"25'8","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796793+0000","last_change":"2023-07-21T22:18:43.344968+0000","last_active":"2023-07-21T22:18:45.796793+0000","last_peered":"2023-07-21T22:18:45.796793+0000","last_clean":"2023-07-21T22:18:45.796793+0000","last_became_active":"2023-07-21T22:18:43.344570+0000","last_became_peered":"2023-07-21T22:18:43.344570+0000","last_unstale":"2023-07-21T22:18:45.796793+0000","last_undegraded":"2023-07-21T22:18:45.796793+0000","last_fullsized":"2023-07-21T22:18:45.796793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:25.997043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797690+0000","last_change":"2023-07-21T22:18:43.348215+0000","last_active":"2023-07-21T22:18:45.797690+0000","last_peered":"2023-07-21T22:18:45.797690+0000","last_clean":"2023-07-21T22:18:45.797690+0000","last_became_active":"2023-07-21T22:18:43.347858+0000","last_became_peered":"2023-07-21T22:18:43.347858+0000","last_unstale":"2023-07-21T22:18:45.797690+0000","last_undegraded":"2023-07-21T22:18:45.797690+0000","last_fullsized":"2023-07-21T22:18:45.797690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:38:53.668385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327304+0000","last_change":"2023-07-21T22:18:44.341650+0000","last_active":"2023-07-21T22:18:45.327304+0000","last_peered":"2023-07-21T22:18:45.327304+0000","last_clean":"2023-07-21T22:18:45.327304+0000","last_became_active":"2023-07-21T22:18:44.341352+0000","last_became_peered":"2023-07-21T22:18:44.341352+0000","last_unstale":"2023-07-21T22:18:45.327304+0000","last_undegraded":"2023-07-21T22:18:45.327304+0000","last_fullsized":"2023-07-21T22:18:45.327304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:27:23.426700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797589+0000","last_change":"2023-07-21T22:18:43.348256+0000","last_active":"2023-07-21T22:18:45.797589+0000","last_peered":"2023-07-21T22:18:45.797589+0000","last_clean":"2023-07-21T22:18:45.797589+0000","last_became_active":"2023-07-21T22:18:43.347754+0000","last_became_peered":"2023-07-21T22:18:43.347754+0000","last_unstale":"2023-07-21T22:18:45.797589+0000","last_undegraded":"2023-07-21T22:18:45.797589+0000","last_fullsized":"2023-07-21T22:18:45.797589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:21:17.553066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326419+0000","last_change":"2023-07-21T22:18:44.353012+0000","last_active":"2023-07-21T22:18:45.326419+0000","last_peered":"2023-07-21T22:18:45.326419+0000","last_clean":"2023-07-21T22:18:45.326419+0000","last_became_active":"2023-07-21T22:18:44.352586+0000","last_became_peered":"2023-07-21T22:18:44.352586+0000","last_unstale":"2023-07-21T22:18:45.326419+0000","last_undegraded":"2023-07-21T22:18:45.326419+0000","last_fullsized":"2023-07-21T22:18:45.326419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:59:21.171422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"25'1","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797566+0000","last_change":"2023-07-21T22:18:43.338600+0000","last_active":"2023-07-21T22:18:45.797566+0000","last_peered":"2023-07-21T22:18:45.797566+0000","last_clean":"2023-07-21T22:18:45.797566+0000","last_became_active":"2023-07-21T22:18:43.338271+0000","last_became_peered":"2023-07-21T22:18:43.338271+0000","last_unstale":"2023-07-21T22:18:45.797566+0000","last_undegraded":"2023-07-21T22:18:45.797566+0000","last_fullsized":"2023-07-21T22:18:45.797566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:09:34.387655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796735+0000","last_change":"2023-07-21T22:18:44.341047+0000","last_active":"2023-07-21T22:18:45.796735+0000","last_peered":"2023-07-21T22:18:45.796735+0000","last_clean":"2023-07-21T22:18:45.796735+0000","last_became_active":"2023-07-21T22:18:44.340600+0000","last_became_peered":"2023-07-21T22:18:44.340600+0000","last_unstale":"2023-07-21T22:18:45.796735+0000","last_undegraded":"2023-07-21T22:18:45.796735+0000","last_fullsized":"2023-07-21T22:18:45.796735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:55.844422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327577+0000","last_change":"2023-07-21T22:18:43.339272+0000","last_active":"2023-07-21T22:18:45.327577+0000","last_peered":"2023-07-21T22:18:45.327577+0000","last_clean":"2023-07-21T22:18:45.327577+0000","last_became_active":"2023-07-21T22:18:43.338864+0000","last_became_peered":"2023-07-21T22:18:43.338864+0000","last_unstale":"2023-07-21T22:18:45.327577+0000","last_undegraded":"2023-07-21T22:18:45.327577+0000","last_fullsized":"2023-07-21T22:18:45.327577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:44:35.365564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.794696+0000","last_change":"2023-07-21T22:18:44.347783+0000","last_active":"2023-07-21T22:18:45.794696+0000","last_peered":"2023-07-21T22:18:45.794696+0000","last_clean":"2023-07-21T22:18:45.794696+0000","last_became_active":"2023-07-21T22:18:44.347417+0000","last_became_peered":"2023-07-21T22:18:44.347417+0000","last_unstale":"2023-07-21T22:18:45.794696+0000","last_undegraded":"2023-07-21T22:18:45.794696+0000","last_fullsized":"2023-07-21T22:18:45.794696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:42.552801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'2","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325726+0000","last_change":"2023-07-21T22:18:43.341666+0000","last_active":"2023-07-21T22:18:45.325726+0000","last_peered":"2023-07-21T22:18:45.325726+0000","last_clean":"2023-07-21T22:18:45.325726+0000","last_became_active":"2023-07-21T22:18:43.341287+0000","last_became_peered":"2023-07-21T22:18:43.341287+0000","last_unstale":"2023-07-21T22:18:45.325726+0000","last_undegraded":"2023-07-21T22:18:45.325726+0000","last_fullsized":"2023-07-21T22:18:45.325726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:59:33.894120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327725+0000","last_change":"2023-07-21T22:18:44.345773+0000","last_active":"2023-07-21T22:18:45.327725+0000","last_peered":"2023-07-21T22:18:45.327725+0000","last_clean":"2023-07-21T22:18:45.327725+0000","last_became_active":"2023-07-21T22:18:44.345494+0000","last_became_peered":"2023-07-21T22:18:44.345494+0000","last_unstale":"2023-07-21T22:18:45.327725+0000","last_undegraded":"2023-07-21T22:18:45.327725+0000","last_fullsized":"2023-07-21T22:18:45.327725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:27:23.426700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797377+0000","last_change":"2023-07-21T22:18:43.346587+0000","last_active":"2023-07-21T22:18:45.797377+0000","last_peered":"2023-07-21T22:18:45.797377+0000","last_clean":"2023-07-21T22:18:45.797377+0000","last_became_active":"2023-07-21T22:18:43.346170+0000","last_became_peered":"2023-07-21T22:18:43.346170+0000","last_unstale":"2023-07-21T22:18:45.797377+0000","last_undegraded":"2023-07-21T22:18:45.797377+0000","last_fullsized":"2023-07-21T22:18:45.797377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:26.409080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.328248+0000","last_change":"2023-07-21T22:18:44.339550+0000","last_active":"2023-07-21T22:18:45.328248+0000","last_peered":"2023-07-21T22:18:45.328248+0000","last_clean":"2023-07-21T22:18:45.328248+0000","last_became_active":"2023-07-21T22:18:44.339232+0000","last_became_peered":"2023-07-21T22:18:44.339232+0000","last_unstale":"2023-07-21T22:18:45.328248+0000","last_undegraded":"2023-07-21T22:18:45.328248+0000","last_fullsized":"2023-07-21T22:18:45.328248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:05:01.105745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326588+0000","last_change":"2023-07-21T22:18:43.342021+0000","last_active":"2023-07-21T22:18:45.326588+0000","last_peered":"2023-07-21T22:18:45.326588+0000","last_clean":"2023-07-21T22:18:45.326588+0000","last_became_active":"2023-07-21T22:18:43.340494+0000","last_became_peered":"2023-07-21T22:18:43.340494+0000","last_unstale":"2023-07-21T22:18:45.326588+0000","last_undegraded":"2023-07-21T22:18:45.326588+0000","last_fullsized":"2023-07-21T22:18:45.326588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:24:08.282241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327954+0000","last_change":"2023-07-21T22:18:44.349404+0000","last_active":"2023-07-21T22:18:45.327954+0000","last_peered":"2023-07-21T22:18:45.327954+0000","last_clean":"2023-07-21T22:18:45.327954+0000","last_became_active":"2023-07-21T22:18:44.348314+0000","last_became_peered":"2023-07-21T22:18:44.348314+0000","last_unstale":"2023-07-21T22:18:45.327954+0000","last_undegraded":"2023-07-21T22:18:45.327954+0000","last_fullsized":"2023-07-21T22:18:45.327954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:27:12.501057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325361+0000","last_change":"2023-07-21T22:18:43.329711+0000","last_active":"2023-07-21T22:18:45.325361+0000","last_peered":"2023-07-21T22:18:45.325361+0000","last_clean":"2023-07-21T22:18:45.325361+0000","last_became_active":"2023-07-21T22:18:43.329184+0000","last_became_peered":"2023-07-21T22:18:43.329184+0000","last_unstale":"2023-07-21T22:18:45.325361+0000","last_undegraded":"2023-07-21T22:18:45.325361+0000","last_fullsized":"2023-07-21T22:18:45.325361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:29:13.898457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795249+0000","last_change":"2023-07-21T22:18:44.354431+0000","last_active":"2023-07-21T22:18:45.795249+0000","last_peered":"2023-07-21T22:18:45.795249+0000","last_clean":"2023-07-21T22:18:45.795249+0000","last_became_active":"2023-07-21T22:18:44.354063+0000","last_became_peered":"2023-07-21T22:18:44.354063+0000","last_unstale":"2023-07-21T22:18:45.795249+0000","last_undegraded":"2023-07-21T22:18:45.795249+0000","last_fullsized":"2023-07-21T22:18:45.795249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:41:47.804776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":175,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796964+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:18:45.796964+0000","last_peered":"2023-07-21T22:18:45.796964+0000","last_clean":"2023-07-21T22:18:45.796964+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:18:45.796964+0000","last_undegraded":"2023-07-21T22:18:45.796964+0000","last_fullsized":"2023-07-21T22:18:45.796964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:19:20.465616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327327+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:18:45.327327+0000","last_peered":"2023-07-21T22:18:45.327327+0000","last_clean":"2023-07-21T22:18:45.327327+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:18:45.327327+0000","last_undegraded":"2023-07-21T22:18:45.327327+0000","last_fullsized":"2023-07-21T22:18:45.327327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:45.609689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325347+0000","last_change":"2023-07-21T22:18:43.327625+0000","last_active":"2023-07-21T22:18:45.325347+0000","last_peered":"2023-07-21T22:18:45.325347+0000","last_clean":"2023-07-21T22:18:45.325347+0000","last_became_active":"2023-07-21T22:18:43.327272+0000","last_became_peered":"2023-07-21T22:18:43.327272+0000","last_unstale":"2023-07-21T22:18:45.325347+0000","last_undegraded":"2023-07-21T22:18:45.325347+0000","last_fullsized":"2023-07-21T22:18:45.325347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:55:22.030393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797370+0000","last_change":"2023-07-21T22:18:44.335194+0000","last_active":"2023-07-21T22:18:45.797370+0000","last_peered":"2023-07-21T22:18:45.797370+0000","last_clean":"2023-07-21T22:18:45.797370+0000","last_became_active":"2023-07-21T22:18:44.334864+0000","last_became_peered":"2023-07-21T22:18:44.334864+0000","last_unstale":"2023-07-21T22:18:45.797370+0000","last_undegraded":"2023-07-21T22:18:45.797370+0000","last_fullsized":"2023-07-21T22:18:45.797370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:38:35.120243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797285+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:18:45.797285+0000","last_peered":"2023-07-21T22:18:45.797285+0000","last_clean":"2023-07-21T22:18:45.797285+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:18:45.797285+0000","last_undegraded":"2023-07-21T22:18:45.797285+0000","last_fullsized":"2023-07-21T22:18:45.797285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:04:55.062032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.794761+0000","last_change":"2023-07-21T22:18:43.344180+0000","last_active":"2023-07-21T22:18:45.794761+0000","last_peered":"2023-07-21T22:18:45.794761+0000","last_clean":"2023-07-21T22:18:45.794761+0000","last_became_active":"2023-07-21T22:18:43.343831+0000","last_became_peered":"2023-07-21T22:18:43.343831+0000","last_unstale":"2023-07-21T22:18:45.794761+0000","last_undegraded":"2023-07-21T22:18:45.794761+0000","last_fullsized":"2023-07-21T22:18:45.794761+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:29.106844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795737+0000","last_change":"2023-07-21T22:18:44.347759+0000","last_active":"2023-07-21T22:18:45.795737+0000","last_peered":"2023-07-21T22:18:45.795737+0000","last_clean":"2023-07-21T22:18:45.795737+0000","last_became_active":"2023-07-21T22:18:44.347416+0000","last_became_peered":"2023-07-21T22:18:44.347416+0000","last_unstale":"2023-07-21T22:18:45.795737+0000","last_undegraded":"2023-07-21T22:18:45.795737+0000","last_fullsized":"2023-07-21T22:18:45.795737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:17:36.412750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796138+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:18:45.796138+0000","last_peered":"2023-07-21T22:18:45.796138+0000","last_clean":"2023-07-21T22:18:45.796138+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:18:45.796138+0000","last_undegraded":"2023-07-21T22:18:45.796138+0000","last_fullsized":"2023-07-21T22:18:45.796138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:12:30.348041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795402+0000","last_change":"2023-07-21T22:18:43.332573+0000","last_active":"2023-07-21T22:18:45.795402+0000","last_peered":"2023-07-21T22:18:45.795402+0000","last_clean":"2023-07-21T22:18:45.795402+0000","last_became_active":"2023-07-21T22:18:43.331774+0000","last_became_peered":"2023-07-21T22:18:43.331774+0000","last_unstale":"2023-07-21T22:18:45.795402+0000","last_undegraded":"2023-07-21T22:18:45.795402+0000","last_fullsized":"2023-07-21T22:18:45.795402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:41.872809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795393+0000","last_change":"2023-07-21T22:18:44.344092+0000","last_active":"2023-07-21T22:18:45.795393+0000","last_peered":"2023-07-21T22:18:45.795393+0000","last_clean":"2023-07-21T22:18:45.795393+0000","last_became_active":"2023-07-21T22:18:44.343819+0000","last_became_peered":"2023-07-21T22:18:44.343819+0000","last_unstale":"2023-07-21T22:18:45.795393+0000","last_undegraded":"2023-07-21T22:18:45.795393+0000","last_fullsized":"2023-07-21T22:18:45.795393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:45:28.665708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327394+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:18:45.327394+0000","last_peered":"2023-07-21T22:18:45.327394+0000","last_clean":"2023-07-21T22:18:45.327394+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:18:45.327394+0000","last_undegraded":"2023-07-21T22:18:45.327394+0000","last_fullsized":"2023-07-21T22:18:45.327394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:29:17.693632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327443+0000","last_change":"2023-07-21T22:18:43.347890+0000","last_active":"2023-07-21T22:18:45.327443+0000","last_peered":"2023-07-21T22:18:45.327443+0000","last_clean":"2023-07-21T22:18:45.327443+0000","last_became_active":"2023-07-21T22:18:43.347529+0000","last_became_peered":"2023-07-21T22:18:43.347529+0000","last_unstale":"2023-07-21T22:18:45.327443+0000","last_undegraded":"2023-07-21T22:18:45.327443+0000","last_fullsized":"2023-07-21T22:18:45.327443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:44:35.365564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795543+0000","last_change":"2023-07-21T22:18:44.345749+0000","last_active":"2023-07-21T22:18:45.795543+0000","last_peered":"2023-07-21T22:18:45.795543+0000","last_clean":"2023-07-21T22:18:45.795543+0000","last_became_active":"2023-07-21T22:18:44.345413+0000","last_became_peered":"2023-07-21T22:18:44.345413+0000","last_unstale":"2023-07-21T22:18:45.795543+0000","last_undegraded":"2023-07-21T22:18:45.795543+0000","last_fullsized":"2023-07-21T22:18:45.795543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:35:09.658092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327868+0000","last_change":"2023-07-21T22:18:43.339680+0000","last_active":"2023-07-21T22:18:45.327868+0000","last_peered":"2023-07-21T22:18:45.327868+0000","last_clean":"2023-07-21T22:18:45.327868+0000","last_became_active":"2023-07-21T22:18:43.339369+0000","last_became_peered":"2023-07-21T22:18:43.339369+0000","last_unstale":"2023-07-21T22:18:45.327868+0000","last_undegraded":"2023-07-21T22:18:45.327868+0000","last_fullsized":"2023-07-21T22:18:45.327868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:39:59.990137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795628+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:18:45.795628+0000","last_peered":"2023-07-21T22:18:45.795628+0000","last_clean":"2023-07-21T22:18:45.795628+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:18:45.795628+0000","last_undegraded":"2023-07-21T22:18:45.795628+0000","last_fullsized":"2023-07-21T22:18:45.795628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:54:07.130010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795286+0000","last_change":"2023-07-21T22:18:44.345981+0000","last_active":"2023-07-21T22:18:45.795286+0000","last_peered":"2023-07-21T22:18:45.795286+0000","last_clean":"2023-07-21T22:18:45.795286+0000","last_became_active":"2023-07-21T22:18:44.345650+0000","last_became_peered":"2023-07-21T22:18:44.345650+0000","last_unstale":"2023-07-21T22:18:45.795286+0000","last_undegraded":"2023-07-21T22:18:45.795286+0000","last_fullsized":"2023-07-21T22:18:45.795286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:17:36.412750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795559+0000","last_change":"2023-07-21T22:18:43.336788+0000","last_active":"2023-07-21T22:18:45.795559+0000","last_peered":"2023-07-21T22:18:45.795559+0000","last_clean":"2023-07-21T22:18:45.795559+0000","last_became_active":"2023-07-21T22:18:43.336357+0000","last_became_peered":"2023-07-21T22:18:43.336357+0000","last_unstale":"2023-07-21T22:18:45.795559+0000","last_undegraded":"2023-07-21T22:18:45.795559+0000","last_fullsized":"2023-07-21T22:18:45.795559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:28:38.838619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797723+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:18:45.797723+0000","last_peered":"2023-07-21T22:18:45.797723+0000","last_clean":"2023-07-21T22:18:45.797723+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:18:45.797723+0000","last_undegraded":"2023-07-21T22:18:45.797723+0000","last_fullsized":"2023-07-21T22:18:45.797723+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:12:18.867824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795721+0000","last_change":"2023-07-21T22:18:44.345851+0000","last_active":"2023-07-21T22:18:45.795721+0000","last_peered":"2023-07-21T22:18:45.795721+0000","last_clean":"2023-07-21T22:18:45.795721+0000","last_became_active":"2023-07-21T22:18:44.345553+0000","last_became_peered":"2023-07-21T22:18:44.345553+0000","last_unstale":"2023-07-21T22:18:45.795721+0000","last_undegraded":"2023-07-21T22:18:45.795721+0000","last_fullsized":"2023-07-21T22:18:45.795721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:40:05.799874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326225+0000","last_change":"2023-07-21T22:18:43.335304+0000","last_active":"2023-07-21T22:18:45.326225+0000","last_peered":"2023-07-21T22:18:45.326225+0000","last_clean":"2023-07-21T22:18:45.326225+0000","last_became_active":"2023-07-21T22:18:43.334929+0000","last_became_peered":"2023-07-21T22:18:43.334929+0000","last_unstale":"2023-07-21T22:18:45.326225+0000","last_undegraded":"2023-07-21T22:18:45.326225+0000","last_fullsized":"2023-07-21T22:18:45.326225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:28:38.838619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795374+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:18:45.795374+0000","last_peered":"2023-07-21T22:18:45.795374+0000","last_clean":"2023-07-21T22:18:45.795374+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:18:45.795374+0000","last_undegraded":"2023-07-21T22:18:45.795374+0000","last_fullsized":"2023-07-21T22:18:45.795374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:59:28.861478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325244+0000","last_change":"2023-07-21T22:18:44.341231+0000","last_active":"2023-07-21T22:18:45.325244+0000","last_peered":"2023-07-21T22:18:45.325244+0000","last_clean":"2023-07-21T22:18:45.325244+0000","last_became_active":"2023-07-21T22:18:44.340874+0000","last_became_peered":"2023-07-21T22:18:44.340874+0000","last_unstale":"2023-07-21T22:18:45.325244+0000","last_undegraded":"2023-07-21T22:18:45.325244+0000","last_fullsized":"2023-07-21T22:18:45.325244+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:27.420151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795870+0000","last_change":"2023-07-21T22:18:43.340557+0000","last_active":"2023-07-21T22:18:45.795870+0000","last_peered":"2023-07-21T22:18:45.795870+0000","last_clean":"2023-07-21T22:18:45.795870+0000","last_became_active":"2023-07-21T22:18:43.340199+0000","last_became_peered":"2023-07-21T22:18:43.340199+0000","last_unstale":"2023-07-21T22:18:45.795870+0000","last_undegraded":"2023-07-21T22:18:45.795870+0000","last_fullsized":"2023-07-21T22:18:45.795870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:14:41.872809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797371+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:18:45.797371+0000","last_peered":"2023-07-21T22:18:45.797371+0000","last_clean":"2023-07-21T22:18:45.797371+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:18:45.797371+0000","last_undegraded":"2023-07-21T22:18:45.797371+0000","last_fullsized":"2023-07-21T22:18:45.797371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:24.074202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326567+0000","last_change":"2023-07-21T22:18:44.347206+0000","last_active":"2023-07-21T22:18:45.326567+0000","last_peered":"2023-07-21T22:18:45.326567+0000","last_clean":"2023-07-21T22:18:45.326567+0000","last_became_active":"2023-07-21T22:18:44.346914+0000","last_became_peered":"2023-07-21T22:18:44.346914+0000","last_unstale":"2023-07-21T22:18:45.326567+0000","last_undegraded":"2023-07-21T22:18:45.326567+0000","last_fullsized":"2023-07-21T22:18:45.326567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:25:34.392203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327256+0000","last_change":"2023-07-21T22:18:44.343986+0000","last_active":"2023-07-21T22:18:45.327256+0000","last_peered":"2023-07-21T22:18:45.327256+0000","last_clean":"2023-07-21T22:18:45.327256+0000","last_became_active":"2023-07-21T22:18:44.342943+0000","last_became_peered":"2023-07-21T22:18:44.342943+0000","last_unstale":"2023-07-21T22:18:45.327256+0000","last_undegraded":"2023-07-21T22:18:45.327256+0000","last_fullsized":"2023-07-21T22:18:45.327256+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:58:43.536674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"25'6","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327927+0000","last_change":"2023-07-21T22:18:43.336129+0000","last_active":"2023-07-21T22:18:45.327927+0000","last_peered":"2023-07-21T22:18:45.327927+0000","last_clean":"2023-07-21T22:18:45.327927+0000","last_became_active":"2023-07-21T22:18:43.335850+0000","last_became_peered":"2023-07-21T22:18:43.335850+0000","last_unstale":"2023-07-21T22:18:45.327927+0000","last_undegraded":"2023-07-21T22:18:45.327927+0000","last_fullsized":"2023-07-21T22:18:45.327927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:05.503990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795179+0000","last_change":"2023-07-21T22:18:44.351088+0000","last_active":"2023-07-21T22:18:45.795179+0000","last_peered":"2023-07-21T22:18:45.795179+0000","last_clean":"2023-07-21T22:18:45.795179+0000","last_became_active":"2023-07-21T22:18:44.350791+0000","last_became_peered":"2023-07-21T22:18:44.350791+0000","last_unstale":"2023-07-21T22:18:45.795179+0000","last_undegraded":"2023-07-21T22:18:45.795179+0000","last_fullsized":"2023-07-21T22:18:45.795179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:35:32.085049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"25'3","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797454+0000","last_change":"2023-07-21T22:18:43.340832+0000","last_active":"2023-07-21T22:18:45.797454+0000","last_peered":"2023-07-21T22:18:45.797454+0000","last_clean":"2023-07-21T22:18:45.797454+0000","last_became_active":"2023-07-21T22:18:43.340519+0000","last_became_peered":"2023-07-21T22:18:43.340519+0000","last_unstale":"2023-07-21T22:18:45.797454+0000","last_undegraded":"2023-07-21T22:18:45.797454+0000","last_fullsized":"2023-07-21T22:18:45.797454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:10:12.772739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327803+0000","last_change":"2023-07-21T22:18:43.335834+0000","last_active":"2023-07-21T22:18:45.327803+0000","last_peered":"2023-07-21T22:18:45.327803+0000","last_clean":"2023-07-21T22:18:45.327803+0000","last_became_active":"2023-07-21T22:18:43.335518+0000","last_became_peered":"2023-07-21T22:18:43.335518+0000","last_unstale":"2023-07-21T22:18:45.327803+0000","last_undegraded":"2023-07-21T22:18:45.327803+0000","last_fullsized":"2023-07-21T22:18:45.327803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:27:11.489986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325377+0000","last_change":"2023-07-21T22:18:44.349059+0000","last_active":"2023-07-21T22:18:45.325377+0000","last_peered":"2023-07-21T22:18:45.325377+0000","last_clean":"2023-07-21T22:18:45.325377+0000","last_became_active":"2023-07-21T22:18:44.348691+0000","last_became_peered":"2023-07-21T22:18:44.348691+0000","last_unstale":"2023-07-21T22:18:45.325377+0000","last_undegraded":"2023-07-21T22:18:45.325377+0000","last_fullsized":"2023-07-21T22:18:45.325377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:35:32.085049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795629+0000","last_change":"2023-07-21T22:18:43.341273+0000","last_active":"2023-07-21T22:18:45.795629+0000","last_peered":"2023-07-21T22:18:45.795629+0000","last_clean":"2023-07-21T22:18:45.795629+0000","last_became_active":"2023-07-21T22:18:43.340594+0000","last_became_peered":"2023-07-21T22:18:43.340594+0000","last_unstale":"2023-07-21T22:18:45.795629+0000","last_undegraded":"2023-07-21T22:18:45.795629+0000","last_fullsized":"2023-07-21T22:18:45.795629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:35:31.073978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325175+0000","last_change":"2023-07-21T22:18:44.341063+0000","last_active":"2023-07-21T22:18:45.325175+0000","last_peered":"2023-07-21T22:18:45.325175+0000","last_clean":"2023-07-21T22:18:45.325175+0000","last_became_active":"2023-07-21T22:18:44.337396+0000","last_became_peered":"2023-07-21T22:18:44.337396+0000","last_unstale":"2023-07-21T22:18:45.325175+0000","last_undegraded":"2023-07-21T22:18:45.325175+0000","last_fullsized":"2023-07-21T22:18:45.325175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:42.552801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.797343+0000","last_change":"2023-07-21T22:18:44.334652+0000","last_active":"2023-07-21T22:18:45.797343+0000","last_peered":"2023-07-21T22:18:45.797343+0000","last_clean":"2023-07-21T22:18:45.797343+0000","last_became_active":"2023-07-21T22:18:44.334333+0000","last_became_peered":"2023-07-21T22:18:44.334333+0000","last_unstale":"2023-07-21T22:18:45.797343+0000","last_undegraded":"2023-07-21T22:18:45.797343+0000","last_fullsized":"2023-07-21T22:18:45.797343+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:42.552801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325316+0000","last_change":"2023-07-21T22:18:43.341804+0000","last_active":"2023-07-21T22:18:45.325316+0000","last_peered":"2023-07-21T22:18:45.325316+0000","last_clean":"2023-07-21T22:18:45.325316+0000","last_became_active":"2023-07-21T22:18:43.341205+0000","last_became_peered":"2023-07-21T22:18:43.341205+0000","last_unstale":"2023-07-21T22:18:45.325316+0000","last_undegraded":"2023-07-21T22:18:45.325316+0000","last_fullsized":"2023-07-21T22:18:45.325316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:38:34.109172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795614+0000","last_change":"2023-07-21T22:18:44.338013+0000","last_active":"2023-07-21T22:18:45.795614+0000","last_peered":"2023-07-21T22:18:45.795614+0000","last_clean":"2023-07-21T22:18:45.795614+0000","last_became_active":"2023-07-21T22:18:44.337701+0000","last_became_peered":"2023-07-21T22:18:44.337701+0000","last_unstale":"2023-07-21T22:18:45.795614+0000","last_undegraded":"2023-07-21T22:18:45.795614+0000","last_fullsized":"2023-07-21T22:18:45.795614+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:41:47.804776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795127+0000","last_change":"2023-07-21T22:18:43.337656+0000","last_active":"2023-07-21T22:18:45.795127+0000","last_peered":"2023-07-21T22:18:45.795127+0000","last_clean":"2023-07-21T22:18:45.795127+0000","last_became_active":"2023-07-21T22:18:43.337228+0000","last_became_peered":"2023-07-21T22:18:43.337228+0000","last_unstale":"2023-07-21T22:18:45.795127+0000","last_undegraded":"2023-07-21T22:18:45.795127+0000","last_fullsized":"2023-07-21T22:18:45.795127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:29:13.898457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325846+0000","last_change":"2023-07-21T22:18:44.337074+0000","last_active":"2023-07-21T22:18:45.325846+0000","last_peered":"2023-07-21T22:18:45.325846+0000","last_clean":"2023-07-21T22:18:45.325846+0000","last_became_active":"2023-07-21T22:18:44.336374+0000","last_became_peered":"2023-07-21T22:18:44.336374+0000","last_unstale":"2023-07-21T22:18:45.325846+0000","last_undegraded":"2023-07-21T22:18:45.325846+0000","last_fullsized":"2023-07-21T22:18:45.325846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:45:28.665708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"25'1","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326818+0000","last_change":"2023-07-21T22:18:43.343871+0000","last_active":"2023-07-21T22:18:45.326818+0000","last_peered":"2023-07-21T22:18:45.326818+0000","last_clean":"2023-07-21T22:18:45.326818+0000","last_became_active":"2023-07-21T22:18:43.342848+0000","last_became_peered":"2023-07-21T22:18:43.342848+0000","last_unstale":"2023-07-21T22:18:45.326818+0000","last_undegraded":"2023-07-21T22:18:45.326818+0000","last_fullsized":"2023-07-21T22:18:45.326818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:29:22.726274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.796455+0000","last_change":"2023-07-21T22:18:44.338868+0000","last_active":"2023-07-21T22:18:45.796455+0000","last_peered":"2023-07-21T22:18:45.796455+0000","last_clean":"2023-07-21T22:18:45.796455+0000","last_became_active":"2023-07-21T22:18:44.337629+0000","last_became_peered":"2023-07-21T22:18:44.337629+0000","last_unstale":"2023-07-21T22:18:45.796455+0000","last_undegraded":"2023-07-21T22:18:45.796455+0000","last_fullsized":"2023-07-21T22:18:45.796455+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:45.242179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"25'1","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795902+0000","last_change":"2023-07-21T22:18:43.347419+0000","last_active":"2023-07-21T22:18:45.795902+0000","last_peered":"2023-07-21T22:18:45.795902+0000","last_clean":"2023-07-21T22:18:45.795902+0000","last_became_active":"2023-07-21T22:18:43.347118+0000","last_became_peered":"2023-07-21T22:18:43.347118+0000","last_unstale":"2023-07-21T22:18:45.795902+0000","last_undegraded":"2023-07-21T22:18:45.795902+0000","last_fullsized":"2023-07-21T22:18:45.795902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:35:08.647021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326967+0000","last_change":"2023-07-21T22:18:44.345638+0000","last_active":"2023-07-21T22:18:45.326967+0000","last_peered":"2023-07-21T22:18:45.326967+0000","last_clean":"2023-07-21T22:18:45.326967+0000","last_became_active":"2023-07-21T22:18:44.345310+0000","last_became_peered":"2023-07-21T22:18:44.345310+0000","last_unstale":"2023-07-21T22:18:45.326967+0000","last_undegraded":"2023-07-21T22:18:45.326967+0000","last_fullsized":"2023-07-21T22:18:45.326967+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:10.090300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"25'2","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327549+0000","last_change":"2023-07-21T22:18:43.345885+0000","last_active":"2023-07-21T22:18:45.327549+0000","last_peered":"2023-07-21T22:18:45.327549+0000","last_clean":"2023-07-21T22:18:45.327549+0000","last_became_active":"2023-07-21T22:18:43.345540+0000","last_became_peered":"2023-07-21T22:18:43.345540+0000","last_unstale":"2023-07-21T22:18:45.327549+0000","last_undegraded":"2023-07-21T22:18:45.327549+0000","last_fullsized":"2023-07-21T22:18:45.327549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:09.079229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326687+0000","last_change":"2023-07-21T22:18:44.346068+0000","last_active":"2023-07-21T22:18:45.326687+0000","last_peered":"2023-07-21T22:18:45.326687+0000","last_clean":"2023-07-21T22:18:45.326687+0000","last_became_active":"2023-07-21T22:18:44.345741+0000","last_became_peered":"2023-07-21T22:18:44.345741+0000","last_unstale":"2023-07-21T22:18:45.326687+0000","last_undegraded":"2023-07-21T22:18:45.326687+0000","last_fullsized":"2023-07-21T22:18:45.326687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:10:33.167054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.327858+0000","last_change":"2023-07-21T22:18:43.342235+0000","last_active":"2023-07-21T22:18:45.327858+0000","last_peered":"2023-07-21T22:18:45.327858+0000","last_clean":"2023-07-21T22:18:45.327858+0000","last_became_active":"2023-07-21T22:18:43.341945+0000","last_became_peered":"2023-07-21T22:18:43.341945+0000","last_unstale":"2023-07-21T22:18:45.327858+0000","last_undegraded":"2023-07-21T22:18:45.327858+0000","last_fullsized":"2023-07-21T22:18:45.327858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:08:28.886811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325543+0000","last_change":"2023-07-21T22:18:44.342724+0000","last_active":"2023-07-21T22:18:45.325543+0000","last_peered":"2023-07-21T22:18:45.325543+0000","last_clean":"2023-07-21T22:18:45.325543+0000","last_became_active":"2023-07-21T22:18:44.342450+0000","last_became_peered":"2023-07-21T22:18:44.342450+0000","last_unstale":"2023-07-21T22:18:45.325543+0000","last_undegraded":"2023-07-21T22:18:45.325543+0000","last_fullsized":"2023-07-21T22:18:45.325543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:17:36.412750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.325551+0000","last_change":"2023-07-21T22:18:43.328543+0000","last_active":"2023-07-21T22:18:45.325551+0000","last_peered":"2023-07-21T22:18:45.325551+0000","last_clean":"2023-07-21T22:18:45.325551+0000","last_became_active":"2023-07-21T22:18:43.328165+0000","last_became_peered":"2023-07-21T22:18:43.328165+0000","last_unstale":"2023-07-21T22:18:45.325551+0000","last_undegraded":"2023-07-21T22:18:45.325551+0000","last_fullsized":"2023-07-21T22:18:45.325551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:41:46.793705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.326688+0000","last_change":"2023-07-21T22:18:44.343626+0000","last_active":"2023-07-21T22:18:45.326688+0000","last_peered":"2023-07-21T22:18:45.326688+0000","last_clean":"2023-07-21T22:18:45.326688+0000","last_became_active":"2023-07-21T22:18:44.343339+0000","last_became_peered":"2023-07-21T22:18:44.343339+0000","last_unstale":"2023-07-21T22:18:45.326688+0000","last_undegraded":"2023-07-21T22:18:45.326688+0000","last_fullsized":"2023-07-21T22:18:45.326688+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:43.300562+0000","last_clean_scrub_stamp":"2023-07-21T22:18:43.300562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:33:51.653402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"25'4","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-07-21T22:18:45.795572+0000","last_change":"2023-07-21T22:18:43.341441+0000","last_active":"2023-07-21T22:18:45.795572+0000","last_peered":"2023-07-21T22:18:45.795572+0000","last_clean":"2023-07-21T22:18:45.795572+0000","last_became_active":"2023-07-21T22:18:43.340962+0000","last_became_peered":"2023-07-21T22:18:43.340962+0000","last_unstale":"2023-07-21T22:18:45.795572+0000","last_undegraded":"2023-07-21T22:18:45.795572+0000","last_fullsized":"2023-07-21T22:18:45.795572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:42.289491+0000","last_clean_scrub_stamp":"2023-07-21T22:18:42.289491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:29:13.898457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":692276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":278528,"data_stored":100780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":101748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":100218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":100128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":100128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":868352,"data_stored":691078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":100128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:19:00.011 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-21T22:19:00.011 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-21T22:19:00.012 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-21T22:19:00.012 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-21T22:19:00.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e8a7b640 1 Processor -- start 2023-07-21T22:19:00.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e8a7b640 1 -- start start 2023-07-21T22:19:00.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e8a7b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83e4070b70 0x7f83e4070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e8a7b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e40cac70 con 0x7f83e40cb100 2023-07-21T22:19:00.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e8a7b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e4071480 con 0x7f83e406b1e0 2023-07-21T22:19:00.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e8a7b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40ca060 con 0x7f83e4070b70 2023-07-21T22:19:00.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e2d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f83e40cb100 0x7f83e41642e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39938/0 (socket says 172.21.15.6:39938) 2023-07-21T22:19:00.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e2d9d640 1 -- 172.21.15.6:0/2928883438 learned_addr learned my addr 172.21.15.6:0/2928883438 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:00.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e259c640 1 --2- 172.21.15.6:0/2928883438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83e4070b70 0x7f83e4070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e1d9b640 1 -- 172.21.15.6:0/2928883438 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882697446 0 0) 0x7f83e40cac70 con 0x7f83e40cb100 2023-07-21T22:19:00.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e1d9b640 1 -- 172.21.15.6:0/2928883438 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83d0003530 con 0x7f83e40cb100 2023-07-21T22:19:00.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e1d9b640 1 -- 172.21.15.6:0/2928883438 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151761573 0 0) 0x7f83e4071480 con 0x7f83e406b1e0 2023-07-21T22:19:00.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e1d9b640 1 -- 172.21.15.6:0/2928883438 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83e40cac70 con 0x7f83e406b1e0 2023-07-21T22:19:00.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e1d9b640 1 -- 172.21.15.6:0/2928883438 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1845468559 0 0) 0x7f83d0003530 con 0x7f83e40cb100 2023-07-21T22:19:00.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e1d9b640 1 -- 172.21.15.6:0/2928883438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83e4070b70 msgr2=0x7f83e4070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:00.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e1d9b640 1 --2- 172.21.15.6:0/2928883438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83e4070b70 0x7f83e4070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e1d9b640 1 -- 172.21.15.6:0/2928883438 >> v1:172.21.15.161:6789/0 conn(0x7f83e406b1e0 legacy=0x7f83e40c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e1d9b640 1 -- 172.21.15.6:0/2928883438 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e40ca340 con 0x7f83e40cb100 2023-07-21T22:19:00.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e1d9b640 1 -- 172.21.15.6:0/2928883438 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f83dc001a00 con 0x7f83e40cb100 2023-07-21T22:19:00.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e1d9b640 1 -- 172.21.15.6:0/2928883438 >> v1:172.21.15.6:6789/0 conn(0x7f83e40cb100 legacy=0x7f83e41642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e1d9b640 1 --2- 172.21.15.6:0/2928883438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83e4070b70 0x7f83d0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e1d9b640 1 --2- 172.21.15.6:0/2928883438 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83d00040f0 0x7f83d00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e1d9b640 1 --2- 172.21.15.6:0/2928883438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d0004d10 0x7f83d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e1d9b640 1 -- 172.21.15.6:0/2928883438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40ca060 con 0x7f83d0004d10 2023-07-21T22:19:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e1d9b640 1 -- 172.21.15.6:0/2928883438 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d000bb20 con 0x7f83d00040f0 2023-07-21T22:19:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e1d9b640 1 -- 172.21.15.6:0/2928883438 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d000bce0 con 0x7f83e4070b70 2023-07-21T22:19:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e2d9d640 1 --2- 172.21.15.6:0/2928883438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d0004d10 0x7f83d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83dbfff640 1 --2- 172.21.15.6:0/2928883438 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83d00040f0 0x7f83d00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e259c640 1 --2- 172.21.15.6:0/2928883438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83e4070b70 0x7f83d0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e2d9d640 1 -- 172.21.15.6:0/2928883438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83e4070b70 msgr2=0x7f83d0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:00.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e2d9d640 1 --2- 172.21.15.6:0/2928883438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83e4070b70 0x7f83d0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e2d9d640 1 -- 172.21.15.6:0/2928883438 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83d00040f0 msgr2=0x7f83d00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:00.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e2d9d640 1 --2- 172.21.15.6:0/2928883438 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83d00040f0 0x7f83d00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.152+0000 7f83e2d9d640 1 -- 172.21.15.6:0/2928883438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d0003530 con 0x7f83d0004d10 2023-07-21T22:19:00.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.156+0000 7f83e2d9d640 1 --2- 172.21.15.6:0/2928883438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d0004d10 0x7f83d0005180 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f83dc00a710 tx=0x7f83dc01d200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e73b507231afea server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:00.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.156+0000 7f83e1d9b640 1 -- 172.21.15.6:0/2928883438 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc0ad630 con 0x7f83d0004d10 2023-07-21T22:19:00.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.156+0000 7f83e1d9b640 1 -- 172.21.15.6:0/2928883438 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc0a8070 con 0x7f83d0004d10 2023-07-21T22:19:00.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.156+0000 7f83e1d9b640 1 -- 172.21.15.6:0/2928883438 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc0ada50 con 0x7f83d0004d10 2023-07-21T22:19:00.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.156+0000 7f83e8a7b640 1 -- 172.21.15.6:0/2928883438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d0004d10 msgr2=0x7f83d0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.156+0000 7f83e8a7b640 1 --2- 172.21.15.6:0/2928883438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83d0004d10 0x7f83d0005180 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f83dc00a710 tx=0x7f83dc01d200 comp rx=0 tx=0).stop 2023-07-21T22:19:00.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.156+0000 7f83e2d9d640 1 -- 172.21.15.6:0/2928883438 reap_dead start 2023-07-21T22:19:00.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.156+0000 7f83e8a7b640 1 -- 172.21.15.6:0/2928883438 shutdown_connections 2023-07-21T22:19:00.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.156+0000 7f83e8a7b640 1 -- 172.21.15.6:0/2928883438 >> 172.21.15.6:0/2928883438 conn(0x7f83e40afcf0 msgr2=0x7f83e40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:00.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.156+0000 7f83e8a7b640 1 -- 172.21.15.6:0/2928883438 shutdown_connections 2023-07-21T22:19:00.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.156+0000 7f83e8a7b640 1 -- 172.21.15.6:0/2928883438 wait complete. 2023-07-21T22:19:00.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.160+0000 7f83e8a7b640 1 Processor -- start 2023-07-21T22:19:00.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.160+0000 7f83e8a7b640 1 -- start start 2023-07-21T22:19:00.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.160+0000 7f83e8a7b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83d0004d10 0x7f83e41464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.160+0000 7f83e8a7b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83e4157560 0x7f83e41579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.160+0000 7f83e8a7b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e40c4180 0x7f83e40c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.160+0000 7f83e8a7b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40c4b30 con 0x7f83e40c4180 2023-07-21T22:19:00.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.160+0000 7f83e8a7b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40a8280 con 0x7f83e4157560 2023-07-21T22:19:00.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.160+0000 7f83e8a7b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40a8560 con 0x7f83d0004d10 2023-07-21T22:19:00.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.160+0000 7f83e2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e40c4180 0x7f83e40c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.160+0000 7f83e2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e40c4180 0x7f83e40c45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58374/0 (socket says 172.21.15.6:58374) 2023-07-21T22:19:00.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.160+0000 7f83e2d9d640 1 -- 172.21.15.6:0/1186375994 learned_addr learned my addr 172.21.15.6:0/1186375994 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:00.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.160+0000 7f83dbfff640 1 --2- 172.21.15.6:0/1186375994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83e4157560 0x7f83e41579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.160+0000 7f83e259c640 1 --2- 172.21.15.6:0/1186375994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83d0004d10 0x7f83e41464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.160+0000 7f83e2d9d640 1 -- 172.21.15.6:0/1186375994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83d0004d10 msgr2=0x7f83e41464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.160+0000 7f83e2d9d640 1 --2- 172.21.15.6:0/1186375994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83d0004d10 0x7f83e41464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.160+0000 7f83e2d9d640 1 -- 172.21.15.6:0/1186375994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83e4157560 msgr2=0x7f83e41579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.160+0000 7f83e2d9d640 1 --2- 172.21.15.6:0/1186375994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83e4157560 0x7f83e41579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.160+0000 7f83e2d9d640 1 -- 172.21.15.6:0/1186375994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e40a8840 con 0x7f83e40c4180 2023-07-21T22:19:00.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.164+0000 7f83e2d9d640 1 --2- 172.21.15.6:0/1186375994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e40c4180 0x7f83e40c45f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f83dc001790 tx=0x7f83d0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:00.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.164+0000 7f83daffd640 1 -- 172.21.15.6:0/1186375994 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc0bd070 con 0x7f83e40c4180 2023-07-21T22:19:00.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.164+0000 7f83daffd640 1 -- 172.21.15.6:0/1186375994 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc001800 con 0x7f83e40c4180 2023-07-21T22:19:00.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.164+0000 7f83e8a7b640 1 -- 172.21.15.6:0/1186375994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e40a8b20 con 0x7f83e40c4180 2023-07-21T22:19:00.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.164+0000 7f83daffd640 1 -- 172.21.15.6:0/1186375994 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc0ad630 con 0x7f83e40c4180 2023-07-21T22:19:00.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.164+0000 7f83e8a7b640 1 -- 172.21.15.6:0/1186375994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e40a7e70 con 0x7f83e40c4180 2023-07-21T22:19:00.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.164+0000 7f83e8a7b640 1 -- 172.21.15.6:0/1186375994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e40c17f0 con 0x7f83e40c4180 2023-07-21T22:19:00.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.164+0000 7f83daffd640 1 -- 172.21.15.6:0/1186375994 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f83dc0aa030 con 0x7f83e40c4180 2023-07-21T22:19:00.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.164+0000 7f83daffd640 1 --2- 172.21.15.6:0/1186375994 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f83c40662b0 0x7f83c4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.164+0000 7f83daffd640 1 -- 172.21.15.6:0/1186375994 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f83cc001d30 con 0x7f83e40c4180 2023-07-21T22:19:00.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.164+0000 7f83e259c640 1 --2- 172.21.15.6:0/1186375994 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f83c40662b0 0x7f83c4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.168+0000 7f83e259c640 1 --2- 172.21.15.6:0/1186375994 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f83c40662b0 0x7f83c4068760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009b20 tx=0x7f83d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:00.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.168+0000 7f83daffd640 1 -- 172.21.15.6:0/1186375994 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f83dc0eba10 con 0x7f83e40c4180 2023-07-21T22:19:00.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.372+0000 7f83e8a7b640 1 -- 172.21.15.6:0/1186375994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f83e406f580 con 0x7f83e40c4180 2023-07-21T22:19:00.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.372+0000 7f83daffd640 1 -- 172.21.15.6:0/1186375994 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f83dc0ef030 con 0x7f83e40c4180 2023-07-21T22:19:00.418 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:00.418 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-21T22:19:00.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.372+0000 7f83e8a7b640 1 -- 172.21.15.6:0/1186375994 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f83c40662b0 msgr2=0x7f83c4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.372+0000 7f83e8a7b640 1 --2- 172.21.15.6:0/1186375994 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f83c40662b0 0x7f83c4068760 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009b20 tx=0x7f83d4008040 comp rx=0 tx=0).stop 2023-07-21T22:19:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.372+0000 7f83e8a7b640 1 -- 172.21.15.6:0/1186375994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e40c4180 msgr2=0x7f83e40c45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.372+0000 7f83e8a7b640 1 --2- 172.21.15.6:0/1186375994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e40c4180 0x7f83e40c45f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f83dc001790 tx=0x7f83d0005800 comp rx=0 tx=0).stop 2023-07-21T22:19:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.372+0000 7f83e8a7b640 1 -- 172.21.15.6:0/1186375994 shutdown_connections 2023-07-21T22:19:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.372+0000 7f83e8a7b640 1 --2- 172.21.15.6:0/1186375994 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f83c40662b0 0x7f83c4068760 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.372+0000 7f83e8a7b640 1 --2- 172.21.15.6:0/1186375994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83e40c4180 0x7f83e40c45f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.372+0000 7f83e8a7b640 1 --2- 172.21.15.6:0/1186375994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83e4157560 0x7f83e41579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.372+0000 7f83e8a7b640 1 --2- 172.21.15.6:0/1186375994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83d0004d10 0x7f83e41464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.372+0000 7f83e8a7b640 1 -- 172.21.15.6:0/1186375994 >> 172.21.15.6:0/1186375994 conn(0x7f83e40afcf0 msgr2=0x7f83e40ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.372+0000 7f83e8a7b640 1 -- 172.21.15.6:0/1186375994 shutdown_connections 2023-07-21T22:19:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.372+0000 7f83e8a7b640 1 -- 172.21.15.6:0/1186375994 wait complete. 2023-07-21T22:19:00.439 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-21T22:19:00.439 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:19:00.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.536+0000 7fc2a419f640 1 Processor -- start 2023-07-21T22:19:00.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.536+0000 7fc2a419f640 1 -- start start 2023-07-21T22:19:00.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.540+0000 7fc2a419f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc29c0b7c70 0x7fc29c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.540+0000 7fc2a419f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc29c15fd60 0x7fc29c0d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.540+0000 7fc2a419f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29c0ccaf0 con 0x7fc29c0d1850 2023-07-21T22:19:00.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.540+0000 7fc2a419f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c0d1190 con 0x7fc29c15fd60 2023-07-21T22:19:00.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.540+0000 7fc2a419f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c160600 con 0x7fc29c0b7c70 2023-07-21T22:19:00.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.540+0000 7fc2a273c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc29c15fd60 0x7fc29c0d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.540+0000 7fc2a1f3b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc29c0b7c70 0x7fc29c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.540+0000 7fc2a1f3b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc29c0b7c70 0x7fc29c0d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:56716/0 (socket says 172.21.15.6:56716) 2023-07-21T22:19:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.540+0000 7fc2a273c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc29c15fd60 0x7fc29c0d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35840/0 (socket says 172.21.15.6:35840) 2023-07-21T22:19:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.540+0000 7fc2a1f3b640 1 -- 172.21.15.6:0/1058078388 learned_addr learned my addr 172.21.15.6:0/1058078388 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.540+0000 7fc2a0f39640 1 -- 172.21.15.6:0/1058078388 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563586611 0 0) 0x7fc29c0ccaf0 con 0x7fc29c0d1850 2023-07-21T22:19:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.540+0000 7fc2a0f39640 1 -- 172.21.15.6:0/1058078388 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc288003530 con 0x7fc29c0d1850 2023-07-21T22:19:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.540+0000 7fc2a273c640 1 -- 172.21.15.6:0/1058078388 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc29c0b7c70 msgr2=0x7fc29c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.540+0000 7fc2a273c640 1 --2- 172.21.15.6:0/1058078388 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc29c0b7c70 0x7fc29c0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.540+0000 7fc2a273c640 1 -- 172.21.15.6:0/1058078388 >> v1:172.21.15.161:6789/0 conn(0x7fc29c0d1850 legacy=0x7fc29c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.540+0000 7fc2a273c640 1 -- 172.21.15.6:0/1058078388 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c160320 con 0x7fc29c15fd60 2023-07-21T22:19:00.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.540+0000 7fc2a1f3b640 1 --2- 172.21.15.6:0/1058078388 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc29c0b7c70 0x7fc29c0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:00.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.544+0000 7fc2a273c640 1 --2- 172.21.15.6:0/1058078388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc29c15fd60 0x7fc29c0d1da0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc294009dc0 tx=0x7fc29401c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=972e9c9c8d9fc15b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:00.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.544+0000 7fc2a0f39640 1 -- 172.21.15.6:0/1058078388 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2940a59e0 con 0x7fc29c15fd60 2023-07-21T22:19:00.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.544+0000 7fc2a0f39640 1 -- 172.21.15.6:0/1058078388 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2940a5b40 con 0x7fc29c15fd60 2023-07-21T22:19:00.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.544+0000 7fc2a0f39640 1 -- 172.21.15.6:0/1058078388 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2940ad440 con 0x7fc29c15fd60 2023-07-21T22:19:00.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.544+0000 7fc2a419f640 1 -- 172.21.15.6:0/1058078388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc29c15fd60 msgr2=0x7fc29c0d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.544+0000 7fc2a419f640 1 --2- 172.21.15.6:0/1058078388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc29c15fd60 0x7fc29c0d1da0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc294009dc0 tx=0x7fc29401c900 comp rx=0 tx=0).stop 2023-07-21T22:19:00.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.544+0000 7fc2a419f640 1 -- 172.21.15.6:0/1058078388 shutdown_connections 2023-07-21T22:19:00.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.544+0000 7fc2a419f640 1 --2- 172.21.15.6:0/1058078388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc29c15fd60 0x7fc29c0d1da0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.544+0000 7fc2a419f640 1 --2- 172.21.15.6:0/1058078388 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc29c0b7c70 0x7fc29c0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.544+0000 7fc2a419f640 1 -- 172.21.15.6:0/1058078388 >> 172.21.15.6:0/1058078388 conn(0x7fc29c0650b0 msgr2=0x7fc29c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:00.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.544+0000 7fc2a419f640 1 -- 172.21.15.6:0/1058078388 shutdown_connections 2023-07-21T22:19:00.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.544+0000 7fc2a419f640 1 -- 172.21.15.6:0/1058078388 wait complete. 2023-07-21T22:19:00.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.544+0000 7fc2a419f640 1 Processor -- start 2023-07-21T22:19:00.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.544+0000 7fc2a419f640 1 -- start start 2023-07-21T22:19:00.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a419f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc29c0b7c70 0x7fc29c1567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a419f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc29c0d1850 0x7fc29c0c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a419f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc29c15fd60 0x7fc29c0c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a419f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0cc460 con 0x7fc29c15fd60 2023-07-21T22:19:00.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a419f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0c8c20 con 0x7fc29c0b7c70 2023-07-21T22:19:00.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a419f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0cc180 con 0x7fc29c0d1850 2023-07-21T22:19:00.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a273c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc29c15fd60 0x7fc29c0c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a273c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc29c15fd60 0x7fc29c0c86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58376/0 (socket says 172.21.15.6:58376) 2023-07-21T22:19:00.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a273c640 1 -- 172.21.15.6:0/3257165881 learned_addr learned my addr 172.21.15.6:0/3257165881 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:00.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a1f3b640 1 --2- 172.21.15.6:0/3257165881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc29c0b7c70 0x7fc29c1567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a173a640 1 --2- 172.21.15.6:0/3257165881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc29c0d1850 0x7fc29c0c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a273c640 1 -- 172.21.15.6:0/3257165881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc29c0d1850 msgr2=0x7fc29c0c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a273c640 1 --2- 172.21.15.6:0/3257165881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc29c0d1850 0x7fc29c0c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a273c640 1 -- 172.21.15.6:0/3257165881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc29c0b7c70 msgr2=0x7fc29c1567b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a273c640 1 --2- 172.21.15.6:0/3257165881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc29c0b7c70 0x7fc29c1567b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a273c640 1 -- 172.21.15.6:0/3257165881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2980094d0 con 0x7fc29c15fd60 2023-07-21T22:19:00.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a173a640 1 --2- 172.21.15.6:0/3257165881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc29c0d1850 0x7fc29c0c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:00.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a273c640 1 --2- 172.21.15.6:0/3257165881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc29c15fd60 0x7fc29c0c86e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc29401cde0 tx=0x7fc2940196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:00.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2927fc640 1 -- 172.21.15.6:0/3257165881 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2940aebb0 con 0x7fc29c15fd60 2023-07-21T22:19:00.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2927fc640 1 -- 172.21.15.6:0/3257165881 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2940aed10 con 0x7fc29c15fd60 2023-07-21T22:19:00.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a419f640 1 -- 172.21.15.6:0/3257165881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc294009a70 con 0x7fc29c15fd60 2023-07-21T22:19:00.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2927fc640 1 -- 172.21.15.6:0/3257165881 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2940b7630 con 0x7fc29c15fd60 2023-07-21T22:19:00.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a419f640 1 -- 172.21.15.6:0/3257165881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29c0c6240 con 0x7fc29c15fd60 2023-07-21T22:19:00.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.548+0000 7fc2a419f640 1 -- 172.21.15.6:0/3257165881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29c0678d0 con 0x7fc29c15fd60 2023-07-21T22:19:00.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.552+0000 7fc2927fc640 1 -- 172.21.15.6:0/3257165881 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc2940b4050 con 0x7fc29c15fd60 2023-07-21T22:19:00.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.552+0000 7fc2927fc640 1 --2- 172.21.15.6:0/3257165881 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc280066280 0x7fc280068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.552+0000 7fc2927fc640 1 -- 172.21.15.6:0/3257165881 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc29411f380 con 0x7fc29c15fd60 2023-07-21T22:19:00.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.552+0000 7fc2a1f3b640 1 --2- 172.21.15.6:0/3257165881 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc280066280 0x7fc280068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.552+0000 7fc2a1f3b640 1 --2- 172.21.15.6:0/3257165881 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc280066280 0x7fc280068730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc298006cb0 tx=0x7fc298009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:00.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.552+0000 7fc2927fc640 1 -- 172.21.15.6:0/3257165881 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc2940ec7f0 con 0x7fc29c15fd60 2023-07-21T22:19:00.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.708+0000 7fc2a419f640 1 -- 172.21.15.6:0/3257165881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc29c0b8280 con 0x7fc29c15fd60 2023-07-21T22:19:00.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.712+0000 7fc2927fc640 1 -- 172.21.15.6:0/3257165881 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18207 (secure 0 0 0) 0x7fc2940efe10 con 0x7fc29c15fd60 2023-07-21T22:19:00.758 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:00.759 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:18:45.315608+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:18:41.465054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:18:42.709896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:19:00.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.712+0000 7fc2a419f640 1 -- 172.21.15.6:0/3257165881 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc280066280 msgr2=0x7fc280068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.712+0000 7fc2a419f640 1 --2- 172.21.15.6:0/3257165881 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc280066280 0x7fc280068730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc298006cb0 tx=0x7fc298009240 comp rx=0 tx=0).stop 2023-07-21T22:19:00.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.712+0000 7fc2a419f640 1 -- 172.21.15.6:0/3257165881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc29c15fd60 msgr2=0x7fc29c0c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.712+0000 7fc2a419f640 1 --2- 172.21.15.6:0/3257165881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc29c15fd60 0x7fc29c0c86e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc29401cde0 tx=0x7fc2940196a0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.712+0000 7fc2a419f640 1 -- 172.21.15.6:0/3257165881 shutdown_connections 2023-07-21T22:19:00.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.712+0000 7fc2a419f640 1 --2- 172.21.15.6:0/3257165881 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc280066280 0x7fc280068730 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.712+0000 7fc2a419f640 1 --2- 172.21.15.6:0/3257165881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc29c15fd60 0x7fc29c0c86e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.712+0000 7fc2a419f640 1 --2- 172.21.15.6:0/3257165881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc29c0d1850 0x7fc29c0c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.712+0000 7fc2a419f640 1 --2- 172.21.15.6:0/3257165881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc29c0b7c70 0x7fc29c1567b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.712+0000 7fc2a419f640 1 -- 172.21.15.6:0/3257165881 >> 172.21.15.6:0/3257165881 conn(0x7fc29c0650b0 msgr2=0x7fc29c065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:00.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.712+0000 7fc2a419f640 1 -- 172.21.15.6:0/3257165881 shutdown_connections 2023-07-21T22:19:00.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.712+0000 7fc2a419f640 1 -- 172.21.15.6:0/3257165881 wait complete. 2023-07-21T22:19:00.780 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:18:41.465054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:18:42.709896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:19:00.781 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:19:00.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.884+0000 7ff4d9b9d640 1 Processor -- start 2023-07-21T22:19:00.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.884+0000 7ff4d9b9d640 1 -- start start 2023-07-21T22:19:00.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.884+0000 7ff4d9b9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4d4070330 0x7ff4d4070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.884+0000 7ff4d9b9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff4d406e0a0 0x7ff4d415c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.884+0000 7ff4d9b9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff4d4158b20 0x7ff4d415c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.884+0000 7ff4d9b9d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d40c9f90 con 0x7ff4d4158b20 2023-07-21T22:19:00.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.884+0000 7ff4d9b9d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d4070c40 con 0x7ff4d406e0a0 2023-07-21T22:19:00.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.884+0000 7ff4d9b9d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d406d000 con 0x7ff4d4070330 2023-07-21T22:19:00.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.884+0000 7ff4d3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff4d4158b20 0x7ff4d415c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.884+0000 7ff4d3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff4d4158b20 0x7ff4d415c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58388/0 (socket says 172.21.15.6:58388) 2023-07-21T22:19:00.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.884+0000 7ff4d3fff640 1 -- 172.21.15.6:0/1772080383 learned_addr learned my addr 172.21.15.6:0/1772080383 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:00.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.884+0000 7ff4d2ffd640 1 --2- 172.21.15.6:0/1772080383 >> v2:172.21.15.161:3300/0 conn(0x7ff4d406e0a0 0x7ff4d415c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.884+0000 7ff4d37fe640 1 --2- 172.21.15.6:0/1772080383 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4d4070330 0x7ff4d4070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.884+0000 7ff4d3fff640 1 -- 172.21.15.6:0/1772080383 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4d4070330 msgr2=0x7ff4d4070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:00.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.884+0000 7ff4d3fff640 1 --2- 172.21.15.6:0/1772080383 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4d4070330 0x7ff4d4070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.884+0000 7ff4d3fff640 1 -- 172.21.15.6:0/1772080383 >> v2:172.21.15.161:3300/0 conn(0x7ff4d406e0a0 msgr2=0x7ff4d415c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:00.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.884+0000 7ff4d3fff640 1 --2- 172.21.15.6:0/1772080383 >> v2:172.21.15.161:3300/0 conn(0x7ff4d406e0a0 0x7ff4d415c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.884+0000 7ff4d3fff640 1 -- 172.21.15.6:0/1772080383 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d406d2e0 con 0x7ff4d4158b20 2023-07-21T22:19:00.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.888+0000 7ff4d3fff640 1 --2- 172.21.15.6:0/1772080383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d4158b20 0x7ff4d415c990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4066170 tx=0x7ff4cc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef541890b6e4d2e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.888+0000 7ff4d27fc640 1 -- 172.21.15.6:0/1772080383 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc0a5710 con 0x7ff4d4158b20 2023-07-21T22:19:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.888+0000 7ff4d27fc640 1 -- 172.21.15.6:0/1772080383 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4cc0a5870 con 0x7ff4d4158b20 2023-07-21T22:19:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.888+0000 7ff4d27fc640 1 -- 172.21.15.6:0/1772080383 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc0a5c00 con 0x7ff4d4158b20 2023-07-21T22:19:00.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.888+0000 7ff4d9b9d640 1 -- 172.21.15.6:0/1772080383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d4158b20 msgr2=0x7ff4d415c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.888+0000 7ff4d9b9d640 1 --2- 172.21.15.6:0/1772080383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d4158b20 0x7ff4d415c990 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4066170 tx=0x7ff4cc01c9a0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.888+0000 7ff4d9b9d640 1 -- 172.21.15.6:0/1772080383 shutdown_connections 2023-07-21T22:19:00.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.888+0000 7ff4d9b9d640 1 --2- 172.21.15.6:0/1772080383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d4158b20 0x7ff4d415c990 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.888+0000 7ff4d9b9d640 1 --2- 172.21.15.6:0/1772080383 >> v2:172.21.15.161:3300/0 conn(0x7ff4d406e0a0 0x7ff4d415c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.888+0000 7ff4d9b9d640 1 --2- 172.21.15.6:0/1772080383 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4d4070330 0x7ff4d4070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.888+0000 7ff4d9b9d640 1 -- 172.21.15.6:0/1772080383 >> 172.21.15.6:0/1772080383 conn(0x7ff4d40b1840 msgr2=0x7ff4d40cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:00.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.888+0000 7ff4d9b9d640 1 -- 172.21.15.6:0/1772080383 shutdown_connections 2023-07-21T22:19:00.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.888+0000 7ff4d9b9d640 1 -- 172.21.15.6:0/1772080383 wait complete. 2023-07-21T22:19:00.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d9b9d640 1 Processor -- start 2023-07-21T22:19:00.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d9b9d640 1 -- start start 2023-07-21T22:19:00.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d9b9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d4070330 0x7ff4d414dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d9b9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4d4158b20 0x7ff4d40c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d9b9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4d40c20e0 0x7ff4d4154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d9b9d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d414e120 con 0x7ff4d4070330 2023-07-21T22:19:00.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d9b9d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40c7570 con 0x7ff4d40c20e0 2023-07-21T22:19:00.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d9b9d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40c6960 con 0x7ff4d4158b20 2023-07-21T22:19:00.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d4070330 0x7ff4d414dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d4070330 0x7ff4d414dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58390/0 (socket says 172.21.15.6:58390) 2023-07-21T22:19:00.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d37fe640 1 -- 172.21.15.6:0/610382515 learned_addr learned my addr 172.21.15.6:0/610382515 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:00.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d3fff640 1 --2- 172.21.15.6:0/610382515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4d40c20e0 0x7ff4d4154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d2ffd640 1 --2- 172.21.15.6:0/610382515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4d4158b20 0x7ff4d40c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d37fe640 1 -- 172.21.15.6:0/610382515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4d4158b20 msgr2=0x7ff4d40c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d37fe640 1 --2- 172.21.15.6:0/610382515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4d4158b20 0x7ff4d40c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d37fe640 1 -- 172.21.15.6:0/610382515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4d40c20e0 msgr2=0x7ff4d4154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d37fe640 1 --2- 172.21.15.6:0/610382515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4d40c20e0 0x7ff4d4154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d37fe640 1 -- 172.21.15.6:0/610382515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4cc009b30 con 0x7ff4d4070330 2023-07-21T22:19:00.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d37fe640 1 --2- 172.21.15.6:0/610382515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d4070330 0x7ff4d414dbe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400d800 tx=0x7ff4c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:00.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4bbfff640 1 -- 172.21.15.6:0/610382515 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c400b6c0 con 0x7ff4d4070330 2023-07-21T22:19:00.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4bbfff640 1 -- 172.21.15.6:0/610382515 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c400b820 con 0x7ff4d4070330 2023-07-21T22:19:00.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d9b9d640 1 -- 172.21.15.6:0/610382515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d40c6c40 con 0x7ff4d4070330 2023-07-21T22:19:00.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4bbfff640 1 -- 172.21.15.6:0/610382515 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c400bb90 con 0x7ff4d4070330 2023-07-21T22:19:00.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.892+0000 7ff4d9b9d640 1 -- 172.21.15.6:0/610382515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d40c7200 con 0x7ff4d4070330 2023-07-21T22:19:00.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.896+0000 7ff4d9b9d640 1 -- 172.21.15.6:0/610382515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d40678d0 con 0x7ff4d4070330 2023-07-21T22:19:00.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.896+0000 7ff4bbfff640 1 -- 172.21.15.6:0/610382515 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff4c400bcf0 con 0x7ff4d4070330 2023-07-21T22:19:00.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.896+0000 7ff4bbfff640 1 --2- 172.21.15.6:0/610382515 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff4c0066280 0x7ff4c0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.896+0000 7ff4bbfff640 1 -- 172.21.15.6:0/610382515 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff4c4084100 con 0x7ff4d4070330 2023-07-21T22:19:00.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.896+0000 7ff4d2ffd640 1 --2- 172.21.15.6:0/610382515 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff4c0066280 0x7ff4c0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.896+0000 7ff4d2ffd640 1 --2- 172.21.15.6:0/610382515 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff4c0066280 0x7ff4c0068730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff4d40b4fb0 tx=0x7ff4c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:00.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:00.900+0000 7ff4bbfff640 1 -- 172.21.15.6:0/610382515 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff4c40550b0 con 0x7ff4d4070330 2023-07-21T22:19:01.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.056+0000 7ff4d9b9d640 1 -- 172.21.15.6:0/610382515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff4d415c190 con 0x7ff4d4070330 2023-07-21T22:19:01.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.056+0000 7ff4bbfff640 1 -- 172.21.15.6:0/610382515 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff4c4054c40 con 0x7ff4d4070330 2023-07-21T22:19:01.103 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:19:01.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.056+0000 7ff4d9b9d640 1 -- 172.21.15.6:0/610382515 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff4c0066280 msgr2=0x7ff4c0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.056+0000 7ff4d9b9d640 1 --2- 172.21.15.6:0/610382515 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff4c0066280 0x7ff4c0068730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff4d40b4fb0 tx=0x7ff4c8008040 comp rx=0 tx=0).stop 2023-07-21T22:19:01.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.056+0000 7ff4d9b9d640 1 -- 172.21.15.6:0/610382515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d4070330 msgr2=0x7ff4d414dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.056+0000 7ff4d9b9d640 1 --2- 172.21.15.6:0/610382515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d4070330 0x7ff4d414dbe0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400d800 tx=0x7ff4c400dcc0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.056+0000 7ff4d9b9d640 1 -- 172.21.15.6:0/610382515 shutdown_connections 2023-07-21T22:19:01.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.056+0000 7ff4d9b9d640 1 --2- 172.21.15.6:0/610382515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4d40c20e0 0x7ff4d4154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.056+0000 7ff4d9b9d640 1 --2- 172.21.15.6:0/610382515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4d4158b20 0x7ff4d40c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.056+0000 7ff4d9b9d640 1 --2- 172.21.15.6:0/610382515 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff4c0066280 0x7ff4c0068730 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.056+0000 7ff4d9b9d640 1 --2- 172.21.15.6:0/610382515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4d4070330 0x7ff4d414dbe0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.056+0000 7ff4d9b9d640 1 -- 172.21.15.6:0/610382515 >> 172.21.15.6:0/610382515 conn(0x7ff4d40b1840 msgr2=0x7ff4d40cc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:01.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.056+0000 7ff4d9b9d640 1 -- 172.21.15.6:0/610382515 shutdown_connections 2023-07-21T22:19:01.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.056+0000 7ff4d9b9d640 1 -- 172.21.15.6:0/610382515 wait complete. 2023-07-21T22:19:01.125 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:19:01.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.224+0000 7feeec034640 1 Processor -- start 2023-07-21T22:19:01.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.224+0000 7feeec034640 1 -- start start 2023-07-21T22:19:01.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.224+0000 7feeec034640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee4070f30 0x7feee40ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.224+0000 7feeec034640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feee40af2b0 0x7feee415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.224+0000 7feeec034640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee4159d70 con 0x7feee4069430 2023-07-21T22:19:01.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.224+0000 7feeec034640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee40c9c60 con 0x7feee40af2b0 2023-07-21T22:19:01.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.224+0000 7feeec034640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee40c9f40 con 0x7feee4070f30 2023-07-21T22:19:01.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.224+0000 7feee9dd0640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7feee4069430 0x7feee4069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39940/0 (socket says 172.21.15.6:39940) 2023-07-21T22:19:01.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.224+0000 7feee9dd0640 1 -- 172.21.15.6:0/981396159 learned_addr learned my addr 172.21.15.6:0/981396159 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:01.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.228+0000 7feeea5d1640 1 --2- 172.21.15.6:0/981396159 >> v2:172.21.15.6:3300/0 conn(0x7feee40af2b0 0x7feee415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.228+0000 7feee95cf640 1 --2- 172.21.15.6:0/981396159 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee4070f30 0x7feee40ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.228+0000 7feee8dce640 1 -- 172.21.15.6:0/981396159 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187652783 0 0) 0x7feee0001120 con 0x7feee4069430 2023-07-21T22:19:01.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.228+0000 7feee8dce640 1 -- 172.21.15.6:0/981396159 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feed0003530 con 0x7feee4069430 2023-07-21T22:19:01.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.228+0000 7feeea5d1640 1 -- 172.21.15.6:0/981396159 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee4070f30 msgr2=0x7feee40ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:01.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.228+0000 7feeea5d1640 1 --2- 172.21.15.6:0/981396159 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee4070f30 0x7feee40ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.228+0000 7feeea5d1640 1 -- 172.21.15.6:0/981396159 >> v1:172.21.15.6:6789/0 conn(0x7feee4069430 legacy=0x7feee4069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.228+0000 7feeea5d1640 1 -- 172.21.15.6:0/981396159 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee40ca220 con 0x7feee40af2b0 2023-07-21T22:19:01.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.228+0000 7feee95cf640 1 --2- 172.21.15.6:0/981396159 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee4070f30 0x7feee40ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:01.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.228+0000 7feeea5d1640 1 --2- 172.21.15.6:0/981396159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee40af2b0 0x7feee415a1f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feedc009d90 tx=0x7feedc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63292a52bd84b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.228+0000 7feee8dce640 1 -- 172.21.15.6:0/981396159 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc0a5920 con 0x7feee40af2b0 2023-07-21T22:19:01.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.228+0000 7feee8dce640 1 -- 172.21.15.6:0/981396159 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feedc0a5a80 con 0x7feee40af2b0 2023-07-21T22:19:01.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.228+0000 7feee8dce640 1 -- 172.21.15.6:0/981396159 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc0a5e10 con 0x7feee40af2b0 2023-07-21T22:19:01.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feeec034640 1 -- 172.21.15.6:0/981396159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee40af2b0 msgr2=0x7feee415a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feeec034640 1 --2- 172.21.15.6:0/981396159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee40af2b0 0x7feee415a1f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feedc009d90 tx=0x7feedc01c950 comp rx=0 tx=0).stop 2023-07-21T22:19:01.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feeec034640 1 -- 172.21.15.6:0/981396159 shutdown_connections 2023-07-21T22:19:01.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feeec034640 1 --2- 172.21.15.6:0/981396159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee40af2b0 0x7feee415a1f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feeec034640 1 --2- 172.21.15.6:0/981396159 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee4070f30 0x7feee40ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feeec034640 1 -- 172.21.15.6:0/981396159 >> 172.21.15.6:0/981396159 conn(0x7feee40cde90 msgr2=0x7feee40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:01.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feeec034640 1 -- 172.21.15.6:0/981396159 shutdown_connections 2023-07-21T22:19:01.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feeec034640 1 -- 172.21.15.6:0/981396159 wait complete. 2023-07-21T22:19:01.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feeec034640 1 Processor -- start 2023-07-21T22:19:01.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feeec034640 1 -- start start 2023-07-21T22:19:01.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feeec034640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee4069430 0x7feee4150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feeec034640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee4070f30 0x7feee4155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feeec034640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee40af2b0 0x7feee40ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feeec034640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee40cb150 con 0x7feee4069430 2023-07-21T22:19:01.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feeec034640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee41557c0 con 0x7feee40af2b0 2023-07-21T22:19:01.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feeec034640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee40cb330 con 0x7feee4070f30 2023-07-21T22:19:01.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feee9dd0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee4069430 0x7feee4150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feee9dd0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee4069430 0x7feee4150d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58398/0 (socket says 172.21.15.6:58398) 2023-07-21T22:19:01.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feee9dd0640 1 -- 172.21.15.6:0/3029997242 learned_addr learned my addr 172.21.15.6:0/3029997242 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:01.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feeea5d1640 1 --2- 172.21.15.6:0/3029997242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee40af2b0 0x7feee40ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feee95cf640 1 --2- 172.21.15.6:0/3029997242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee4070f30 0x7feee4155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feee9dd0640 1 -- 172.21.15.6:0/3029997242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee4070f30 msgr2=0x7feee4155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feee9dd0640 1 --2- 172.21.15.6:0/3029997242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee4070f30 0x7feee4155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feee9dd0640 1 -- 172.21.15.6:0/3029997242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee40af2b0 msgr2=0x7feee40ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feee9dd0640 1 --2- 172.21.15.6:0/3029997242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee40af2b0 0x7feee40ca740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feee9dd0640 1 -- 172.21.15.6:0/3029997242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc009a70 con 0x7feee4069430 2023-07-21T22:19:01.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feeea5d1640 1 --2- 172.21.15.6:0/3029997242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee40af2b0 0x7feee40ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:01.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.232+0000 7feee95cf640 1 --2- 172.21.15.6:0/3029997242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee4070f30 0x7feee4155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:01.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.236+0000 7feee9dd0640 1 --2- 172.21.15.6:0/3029997242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee4069430 0x7feee4150d60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feee000c400 tx=0x7feee000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.236+0000 7feeda7fc640 1 -- 172.21.15.6:0/3029997242 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee0005cf0 con 0x7feee4069430 2023-07-21T22:19:01.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.236+0000 7feeda7fc640 1 -- 172.21.15.6:0/3029997242 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee0005e70 con 0x7feee4069430 2023-07-21T22:19:01.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.236+0000 7feeda7fc640 1 -- 172.21.15.6:0/3029997242 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee00072f0 con 0x7feee4069430 2023-07-21T22:19:01.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.236+0000 7feeec034640 1 -- 172.21.15.6:0/3029997242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee40cb610 con 0x7feee4069430 2023-07-21T22:19:01.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.236+0000 7feeec034640 1 -- 172.21.15.6:0/3029997242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee40cb8f0 con 0x7feee4069430 2023-07-21T22:19:01.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.236+0000 7feeec034640 1 -- 172.21.15.6:0/3029997242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee40678d0 con 0x7feee4069430 2023-07-21T22:19:01.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.236+0000 7feeda7fc640 1 -- 172.21.15.6:0/3029997242 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feee0007450 con 0x7feee4069430 2023-07-21T22:19:01.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.236+0000 7feeda7fc640 1 --2- 172.21.15.6:0/3029997242 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7feec8066280 0x7feec8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.236+0000 7feeda7fc640 1 -- 172.21.15.6:0/3029997242 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7feee0083250 con 0x7feee4069430 2023-07-21T22:19:01.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.236+0000 7feee95cf640 1 --2- 172.21.15.6:0/3029997242 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7feec8066280 0x7feec8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.240+0000 7feee95cf640 1 --2- 172.21.15.6:0/3029997242 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7feec8066280 0x7feec8068730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7feee40c7490 tx=0x7feed4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.240+0000 7feeda7fc640 1 -- 172.21.15.6:0/3029997242 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feee00540c0 con 0x7feee4069430 2023-07-21T22:19:01.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.396+0000 7feeec034640 1 -- 172.21.15.6:0/3029997242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feee4159d70 con 0x7feee4069430 2023-07-21T22:19:01.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.396+0000 7feeda7fc640 1 -- 172.21.15.6:0/3029997242 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7feee4159d70 con 0x7feee4069430 2023-07-21T22:19:01.444 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:19:01.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.396+0000 7feeec034640 1 -- 172.21.15.6:0/3029997242 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7feec8066280 msgr2=0x7feec8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.396+0000 7feeec034640 1 --2- 172.21.15.6:0/3029997242 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7feec8066280 0x7feec8068730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7feee40c7490 tx=0x7feed4008040 comp rx=0 tx=0).stop 2023-07-21T22:19:01.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.396+0000 7feeec034640 1 -- 172.21.15.6:0/3029997242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee4069430 msgr2=0x7feee4150d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.396+0000 7feeec034640 1 --2- 172.21.15.6:0/3029997242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee4069430 0x7feee4150d60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feee000c400 tx=0x7feee000c8c0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.396+0000 7feeec034640 1 -- 172.21.15.6:0/3029997242 shutdown_connections 2023-07-21T22:19:01.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.396+0000 7feeec034640 1 --2- 172.21.15.6:0/3029997242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee40af2b0 0x7feee40ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.396+0000 7feeec034640 1 --2- 172.21.15.6:0/3029997242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee4070f30 0x7feee4155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.396+0000 7feeec034640 1 --2- 172.21.15.6:0/3029997242 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7feec8066280 0x7feec8068730 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.396+0000 7feeec034640 1 --2- 172.21.15.6:0/3029997242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee4069430 0x7feee4150d60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.396+0000 7feeec034640 1 -- 172.21.15.6:0/3029997242 >> 172.21.15.6:0/3029997242 conn(0x7feee40cde90 msgr2=0x7feee41592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:01.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.400+0000 7feeec034640 1 -- 172.21.15.6:0/3029997242 shutdown_connections 2023-07-21T22:19:01.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.400+0000 7feeec034640 1 -- 172.21.15.6:0/3029997242 wait complete. 2023-07-21T22:19:01.464 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:19:01.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.564+0000 7f7a8f86d640 1 Processor -- start 2023-07-21T22:19:01.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.564+0000 7f7a8f86d640 1 -- start start 2023-07-21T22:19:01.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.564+0000 7f7a8f86d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7a8806a540 0x7f7a8806a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.564+0000 7f7a8f86d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7a880cf710 0x7f7a880cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.564+0000 7f7a8f86d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a880cb7a0 con 0x7f7a880cf2e0 2023-07-21T22:19:01.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.568+0000 7f7a8f86d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a880d0920 con 0x7f7a8806a540 2023-07-21T22:19:01.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.568+0000 7f7a8f86d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a8815bfd0 con 0x7f7a880cf710 2023-07-21T22:19:01.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.568+0000 7f7a8d609640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7a8806a540 0x7f7a8806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.568+0000 7f7a8d609640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7a8806a540 0x7f7a8806a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58410/0 (socket says 172.21.15.6:58410) 2023-07-21T22:19:01.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.568+0000 7f7a8d609640 1 -- 172.21.15.6:0/3312789743 learned_addr learned my addr 172.21.15.6:0/3312789743 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:01.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.568+0000 7f7a8d609640 1 -- 172.21.15.6:0/3312789743 >> v2:172.21.15.161:3300/0 conn(0x7f7a880cf710 msgr2=0x7f7a880cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:01.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.568+0000 7f7a8d609640 1 --2- 172.21.15.6:0/3312789743 >> v2:172.21.15.161:3300/0 conn(0x7f7a880cf710 0x7f7a880cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.568+0000 7f7a8d609640 1 -- 172.21.15.6:0/3312789743 >> v1:172.21.15.161:6789/0 conn(0x7f7a880cf2e0 legacy=0x7f7a880cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:01.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.568+0000 7f7a8d609640 1 -- 172.21.15.6:0/3312789743 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8806ae50 con 0x7f7a8806a540 2023-07-21T22:19:01.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.568+0000 7f7a8d609640 1 --2- 172.21.15.6:0/3312789743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a8806a540 0x7f7a8806a910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7a880712c0 tx=0x7f7a8401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0589516ce22d5f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.568+0000 7f7a7ffff640 1 -- 172.21.15.6:0/3312789743 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a840aa5f0 con 0x7f7a8806a540 2023-07-21T22:19:01.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.568+0000 7f7a7ffff640 1 -- 172.21.15.6:0/3312789743 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a840aa750 con 0x7f7a8806a540 2023-07-21T22:19:01.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.568+0000 7f7a7ffff640 1 -- 172.21.15.6:0/3312789743 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a840aaae0 con 0x7f7a8806a540 2023-07-21T22:19:01.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8f86d640 1 -- 172.21.15.6:0/3312789743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a8806a540 msgr2=0x7f7a8806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8f86d640 1 --2- 172.21.15.6:0/3312789743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a8806a540 0x7f7a8806a910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7a880712c0 tx=0x7f7a8401c490 comp rx=0 tx=0).stop 2023-07-21T22:19:01.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8f86d640 1 -- 172.21.15.6:0/3312789743 shutdown_connections 2023-07-21T22:19:01.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8f86d640 1 --2- 172.21.15.6:0/3312789743 >> v2:172.21.15.161:3300/0 conn(0x7f7a880cf710 0x7f7a880cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8f86d640 1 --2- 172.21.15.6:0/3312789743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a8806a540 0x7f7a8806a910 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8f86d640 1 -- 172.21.15.6:0/3312789743 >> 172.21.15.6:0/3312789743 conn(0x7f7a88099490 msgr2=0x7f7a88089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:01.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8f86d640 1 -- 172.21.15.6:0/3312789743 shutdown_connections 2023-07-21T22:19:01.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8f86d640 1 -- 172.21.15.6:0/3312789743 wait complete. 2023-07-21T22:19:01.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8f86d640 1 Processor -- start 2023-07-21T22:19:01.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8f86d640 1 -- start start 2023-07-21T22:19:01.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8f86d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a8806a540 0x7f7a8814af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8f86d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a880cf2e0 0x7f7a880c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8f86d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a880cf710 0x7f7a880c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8f86d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a881f7890 con 0x7f7a880cf710 2023-07-21T22:19:01.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8f86d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a880c6330 con 0x7f7a8806a540 2023-07-21T22:19:01.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8f86d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8814b440 con 0x7f7a880cf2e0 2023-07-21T22:19:01.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8de0a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a880cf710 0x7f7a880c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8de0a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a880cf710 0x7f7a880c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58414/0 (socket says 172.21.15.6:58414) 2023-07-21T22:19:01.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8de0a640 1 -- 172.21.15.6:0/1267626079 learned_addr learned my addr 172.21.15.6:0/1267626079 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:01.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8d609640 1 --2- 172.21.15.6:0/1267626079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a8806a540 0x7f7a8814af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8ce08640 1 --2- 172.21.15.6:0/1267626079 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a880cf2e0 0x7f7a880c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8de0a640 1 -- 172.21.15.6:0/1267626079 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a880cf2e0 msgr2=0x7f7a880c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8de0a640 1 --2- 172.21.15.6:0/1267626079 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a880cf2e0 0x7f7a880c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8de0a640 1 -- 172.21.15.6:0/1267626079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a8806a540 msgr2=0x7f7a8814af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8de0a640 1 --2- 172.21.15.6:0/1267626079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a8806a540 0x7f7a8814af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.572+0000 7f7a8de0a640 1 -- 172.21.15.6:0/1267626079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a840094d0 con 0x7f7a880cf710 2023-07-21T22:19:01.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.576+0000 7f7a8d609640 1 --2- 172.21.15.6:0/1267626079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a8806a540 0x7f7a8814af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:01.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.576+0000 7f7a8de0a640 1 --2- 172.21.15.6:0/1267626079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a880cf710 0x7f7a880c4910 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000b970 tx=0x7f7a8000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.576+0000 7f7a7dffb640 1 -- 172.21.15.6:0/1267626079 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8000cb40 con 0x7f7a880cf710 2023-07-21T22:19:01.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.576+0000 7f7a7dffb640 1 -- 172.21.15.6:0/1267626079 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8000ccc0 con 0x7f7a880cf710 2023-07-21T22:19:01.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.576+0000 7f7a7dffb640 1 -- 172.21.15.6:0/1267626079 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80014680 con 0x7f7a880cf710 2023-07-21T22:19:01.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.576+0000 7f7a8f86d640 1 -- 172.21.15.6:0/1267626079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a88153360 con 0x7f7a880cf710 2023-07-21T22:19:01.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.576+0000 7f7a8f86d640 1 -- 172.21.15.6:0/1267626079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a88153920 con 0x7f7a880cf710 2023-07-21T22:19:01.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.576+0000 7f7a8f86d640 1 -- 172.21.15.6:0/1267626079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a880678d0 con 0x7f7a880cf710 2023-07-21T22:19:01.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.576+0000 7f7a7dffb640 1 -- 172.21.15.6:0/1267626079 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7a8001d3b0 con 0x7f7a880cf710 2023-07-21T22:19:01.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.576+0000 7f7a7dffb640 1 --2- 172.21.15.6:0/1267626079 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f7a6c066280 0x7f7a6c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.576+0000 7f7a7dffb640 1 -- 172.21.15.6:0/1267626079 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a80083d20 con 0x7f7a880cf710 2023-07-21T22:19:01.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.580+0000 7f7a8d609640 1 --2- 172.21.15.6:0/1267626079 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f7a6c066280 0x7f7a6c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.580+0000 7f7a8d609640 1 --2- 172.21.15.6:0/1267626079 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f7a6c066280 0x7f7a6c068730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7a840ae000 tx=0x7f7a840a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.580+0000 7f7a7dffb640 1 -- 172.21.15.6:0/1267626079 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7a80051190 con 0x7f7a880cf710 2023-07-21T22:19:01.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.736+0000 7f7a8f86d640 1 -- 172.21.15.6:0/1267626079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a88070e70 con 0x7f7a880cf710 2023-07-21T22:19:01.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.740+0000 7f7a7dffb640 1 -- 172.21.15.6:0/1267626079 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a800190a0 con 0x7f7a880cf710 2023-07-21T22:19:01.786 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:19:01.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.740+0000 7f7a8f86d640 1 -- 172.21.15.6:0/1267626079 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f7a6c066280 msgr2=0x7f7a6c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.740+0000 7f7a8f86d640 1 --2- 172.21.15.6:0/1267626079 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f7a6c066280 0x7f7a6c068730 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7a840ae000 tx=0x7f7a840a7000 comp rx=0 tx=0).stop 2023-07-21T22:19:01.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.740+0000 7f7a8f86d640 1 -- 172.21.15.6:0/1267626079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a880cf710 msgr2=0x7f7a880c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.740+0000 7f7a8f86d640 1 --2- 172.21.15.6:0/1267626079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a880cf710 0x7f7a880c4910 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000b970 tx=0x7f7a8000be30 comp rx=0 tx=0).stop 2023-07-21T22:19:01.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.740+0000 7f7a8f86d640 1 -- 172.21.15.6:0/1267626079 shutdown_connections 2023-07-21T22:19:01.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.740+0000 7f7a8f86d640 1 --2- 172.21.15.6:0/1267626079 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f7a6c066280 0x7f7a6c068730 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.740+0000 7f7a8f86d640 1 --2- 172.21.15.6:0/1267626079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a880cf710 0x7f7a880c4910 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.740+0000 7f7a8f86d640 1 --2- 172.21.15.6:0/1267626079 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a880cf2e0 0x7f7a880c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.740+0000 7f7a8f86d640 1 --2- 172.21.15.6:0/1267626079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a8806a540 0x7f7a8814af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.740+0000 7f7a8f86d640 1 -- 172.21.15.6:0/1267626079 >> 172.21.15.6:0/1267626079 conn(0x7f7a88099490 msgr2=0x7f7a88089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:01.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.740+0000 7f7a8f86d640 1 -- 172.21.15.6:0/1267626079 shutdown_connections 2023-07-21T22:19:01.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.740+0000 7f7a8f86d640 1 -- 172.21.15.6:0/1267626079 wait complete. 2023-07-21T22:19:01.806 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:19:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.908+0000 7f9a72693640 1 Processor -- start 2023-07-21T22:19:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.908+0000 7f9a72693640 1 -- start start 2023-07-21T22:19:01.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.908+0000 7f9a72693640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9a6c069430 0x7f9a6c069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.908+0000 7f9a72693640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a6c070f30 0x7f9a6c0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.908+0000 7f9a72693640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6c159d70 con 0x7f9a6c0af2b0 2023-07-21T22:19:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.908+0000 7f9a72693640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a6c069d40 con 0x7f9a6c069430 2023-07-21T22:19:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.908+0000 7f9a72693640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0c9c60 con 0x7f9a6c070f30 2023-07-21T22:19:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.908+0000 7f9a6bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9a6c069430 0x7f9a6c069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.908+0000 7f9a70c30640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9a6c0af2b0 0x7f9a6c15a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39956/0 (socket says 172.21.15.6:39956) 2023-07-21T22:19:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.908+0000 7f9a70c30640 1 -- 172.21.15.6:0/3468863951 learned_addr learned my addr 172.21.15.6:0/3468863951 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.908+0000 7f9a6b7fe640 1 --2- 172.21.15.6:0/3468863951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a6c070f30 0x7f9a6c0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.908+0000 7f9a6bfff640 1 -- 172.21.15.6:0/3468863951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a6c070f30 msgr2=0x7f9a6c0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.908+0000 7f9a6bfff640 1 --2- 172.21.15.6:0/3468863951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a6c070f30 0x7f9a6c0ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.908+0000 7f9a6bfff640 1 -- 172.21.15.6:0/3468863951 >> v1:172.21.15.6:6789/0 conn(0x7f9a6c0af2b0 legacy=0x7f9a6c15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.908+0000 7f9a6bfff640 1 -- 172.21.15.6:0/3468863951 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6c0c9f40 con 0x7f9a6c069430 2023-07-21T22:19:01.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.908+0000 7f9a6b7fe640 1 --2- 172.21.15.6:0/3468863951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a6c070f30 0x7f9a6c0ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:01.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.908+0000 7f9a6affd640 1 -- 172.21.15.6:0/3468863951 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582152866 0 0) 0x7f9a640014a0 con 0x7f9a6c0af2b0 2023-07-21T22:19:01.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.912+0000 7f9a6bfff640 1 --2- 172.21.15.6:0/3468863951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6c069430 0x7f9a6c069800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0097c0 tx=0x7f9a5c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e931a1b7d163f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.912+0000 7f9a6affd640 1 -- 172.21.15.6:0/3468863951 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c0ad640 con 0x7f9a6c069430 2023-07-21T22:19:01.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.912+0000 7f9a6affd640 1 -- 172.21.15.6:0/3468863951 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5c0ad7a0 con 0x7f9a6c069430 2023-07-21T22:19:01.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.912+0000 7f9a6affd640 1 -- 172.21.15.6:0/3468863951 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c0adb30 con 0x7f9a6c069430 2023-07-21T22:19:01.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.912+0000 7f9a72693640 1 -- 172.21.15.6:0/3468863951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6c069430 msgr2=0x7f9a6c069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.912+0000 7f9a72693640 1 --2- 172.21.15.6:0/3468863951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6c069430 0x7f9a6c069800 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0097c0 tx=0x7f9a5c01c480 comp rx=0 tx=0).stop 2023-07-21T22:19:01.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.912+0000 7f9a72693640 1 -- 172.21.15.6:0/3468863951 shutdown_connections 2023-07-21T22:19:01.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.912+0000 7f9a72693640 1 --2- 172.21.15.6:0/3468863951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a6c070f30 0x7f9a6c0ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.912+0000 7f9a72693640 1 --2- 172.21.15.6:0/3468863951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6c069430 0x7f9a6c069800 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.912+0000 7f9a72693640 1 -- 172.21.15.6:0/3468863951 >> 172.21.15.6:0/3468863951 conn(0x7f9a6c0cde90 msgr2=0x7f9a6c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:01.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.912+0000 7f9a72693640 1 -- 172.21.15.6:0/3468863951 shutdown_connections 2023-07-21T22:19:01.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.912+0000 7f9a72693640 1 -- 172.21.15.6:0/3468863951 wait complete. 2023-07-21T22:19:01.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.912+0000 7f9a72693640 1 Processor -- start 2023-07-21T22:19:01.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a72693640 1 -- start start 2023-07-21T22:19:01.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a72693640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a6c069430 0x7f9a6c14d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a72693640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a6c070f30 0x7f9a6c0c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a72693640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6c0af2b0 0x7f9a6c151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a72693640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0b1030 con 0x7f9a6c0af2b0 2023-07-21T22:19:01.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a72693640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0ac730 con 0x7f9a6c069430 2023-07-21T22:19:01.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a72693640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6c0aca10 con 0x7f9a6c070f30 2023-07-21T22:19:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a70c30640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6c0af2b0 0x7f9a6c151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a70c30640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6c0af2b0 0x7f9a6c151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58434/0 (socket says 172.21.15.6:58434) 2023-07-21T22:19:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a70c30640 1 -- 172.21.15.6:0/3940375468 learned_addr learned my addr 172.21.15.6:0/3940375468 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:01.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a6bfff640 1 --2- 172.21.15.6:0/3940375468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a6c069430 0x7f9a6c14d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a6b7fe640 1 --2- 172.21.15.6:0/3940375468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a6c070f30 0x7f9a6c0c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a70c30640 1 -- 172.21.15.6:0/3940375468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a6c070f30 msgr2=0x7f9a6c0c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a70c30640 1 --2- 172.21.15.6:0/3940375468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a6c070f30 0x7f9a6c0c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a70c30640 1 -- 172.21.15.6:0/3940375468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a6c069430 msgr2=0x7f9a6c14d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a70c30640 1 --2- 172.21.15.6:0/3940375468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a6c069430 0x7f9a6c14d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a70c30640 1 -- 172.21.15.6:0/3940375468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c009420 con 0x7f9a6c0af2b0 2023-07-21T22:19:01.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a70c30640 1 --2- 172.21.15.6:0/3940375468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6c0af2b0 0x7f9a6c151550 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9a6400c700 tx=0x7f9a6400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a68ff9640 1 -- 172.21.15.6:0/3940375468 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6400ce10 con 0x7f9a6c0af2b0 2023-07-21T22:19:01.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a68ff9640 1 -- 172.21.15.6:0/3940375468 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6400a640 con 0x7f9a6c0af2b0 2023-07-21T22:19:01.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a68ff9640 1 -- 172.21.15.6:0/3940375468 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6400aa70 con 0x7f9a6c0af2b0 2023-07-21T22:19:01.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a72693640 1 -- 172.21.15.6:0/3940375468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a6c0accf0 con 0x7f9a6c0af2b0 2023-07-21T22:19:01.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a72693640 1 -- 172.21.15.6:0/3940375468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6c14d860 con 0x7f9a6c0af2b0 2023-07-21T22:19:01.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.916+0000 7f9a72693640 1 -- 172.21.15.6:0/3940375468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6c0b11a0 con 0x7f9a6c0af2b0 2023-07-21T22:19:01.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.920+0000 7f9a68ff9640 1 -- 172.21.15.6:0/3940375468 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9a6400abd0 con 0x7f9a6c0af2b0 2023-07-21T22:19:01.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.920+0000 7f9a68ff9640 1 --2- 172.21.15.6:0/3940375468 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a58066280 0x7f9a58068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.920+0000 7f9a68ff9640 1 -- 172.21.15.6:0/3940375468 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9a64082ff0 con 0x7f9a6c0af2b0 2023-07-21T22:19:01.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.920+0000 7f9a6bfff640 1 --2- 172.21.15.6:0/3940375468 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a58066280 0x7f9a58068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.920+0000 7f9a6bfff640 1 --2- 172.21.15.6:0/3940375468 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a58066280 0x7f9a58068730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0af000 tx=0x7f9a5c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:01.924+0000 7f9a68ff9640 1 -- 172.21.15.6:0/3940375468 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a64050510 con 0x7f9a6c0af2b0 2023-07-21T22:19:02.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.080+0000 7f9a72693640 1 -- 172.21.15.6:0/3940375468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9a6c159d40 con 0x7f9a6c0af2b0 2023-07-21T22:19:02.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.080+0000 7f9a68ff9640 1 -- 172.21.15.6:0/3940375468 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9a64018070 con 0x7f9a6c0af2b0 2023-07-21T22:19:02.126 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:19:02.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.080+0000 7f9a72693640 1 -- 172.21.15.6:0/3940375468 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a58066280 msgr2=0x7f9a58068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:02.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.080+0000 7f9a72693640 1 --2- 172.21.15.6:0/3940375468 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a58066280 0x7f9a58068730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0af000 tx=0x7f9a5c0a7070 comp rx=0 tx=0).stop 2023-07-21T22:19:02.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.080+0000 7f9a72693640 1 -- 172.21.15.6:0/3940375468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6c0af2b0 msgr2=0x7f9a6c151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:02.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.080+0000 7f9a72693640 1 --2- 172.21.15.6:0/3940375468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6c0af2b0 0x7f9a6c151550 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9a6400c700 tx=0x7f9a6400cbc0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.080+0000 7f9a72693640 1 -- 172.21.15.6:0/3940375468 shutdown_connections 2023-07-21T22:19:02.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.080+0000 7f9a72693640 1 --2- 172.21.15.6:0/3940375468 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a58066280 0x7f9a58068730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.080+0000 7f9a72693640 1 --2- 172.21.15.6:0/3940375468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a6c0af2b0 0x7f9a6c151550 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.080+0000 7f9a72693640 1 --2- 172.21.15.6:0/3940375468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a6c070f30 0x7f9a6c0c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.080+0000 7f9a72693640 1 --2- 172.21.15.6:0/3940375468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a6c069430 0x7f9a6c14d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.080+0000 7f9a72693640 1 -- 172.21.15.6:0/3940375468 >> 172.21.15.6:0/3940375468 conn(0x7f9a6c0cde90 msgr2=0x7f9a6c1579c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:02.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.080+0000 7f9a72693640 1 -- 172.21.15.6:0/3940375468 shutdown_connections 2023-07-21T22:19:02.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.080+0000 7f9a72693640 1 -- 172.21.15.6:0/3940375468 wait complete. 2023-07-21T22:19:02.147 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:19:02.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.244+0000 7fe100eca640 1 Processor -- start 2023-07-21T22:19:02.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.244+0000 7fe100eca640 1 -- start start 2023-07-21T22:19:02.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.244+0000 7fe100eca640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe0fc15fd60 0x7fe0fc0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:02.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.244+0000 7fe100eca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0fc0d1850 0x7fe0fc0d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:02.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.244+0000 7fe100eca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0fc0ccaf0 con 0x7fe0fc0b7c70 2023-07-21T22:19:02.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.244+0000 7fe100eca640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0fc0d1190 con 0x7fe0fc15fd60 2023-07-21T22:19:02.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.244+0000 7fe100eca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc160600 con 0x7fe0fc0d1850 2023-07-21T22:19:02.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.244+0000 7fe0fa59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe0fc0b7c70 0x7fe0fc15f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39958/0 (socket says 172.21.15.6:39958) 2023-07-21T22:19:02.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.244+0000 7fe0fa59c640 1 -- 172.21.15.6:0/4218047550 learned_addr learned my addr 172.21.15.6:0/4218047550 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.244+0000 7fe0fad9d640 1 --2- 172.21.15.6:0/4218047550 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0fc0d1850 0x7fe0fc0d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.244+0000 7fe0f3fff640 1 --2- 172.21.15.6:0/4218047550 >> v2:172.21.15.161:3300/0 conn(0x7fe0fc15fd60 0x7fe0fc0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.244+0000 7fe0f9d9b640 1 -- 172.21.15.6:0/4218047550 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231103077 0 0) 0x7fe0fc0ccaf0 con 0x7fe0fc0b7c70 2023-07-21T22:19:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.244+0000 7fe0f9d9b640 1 -- 172.21.15.6:0/4218047550 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0e8003530 con 0x7fe0fc0b7c70 2023-07-21T22:19:02.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.244+0000 7fe0f9d9b640 1 -- 172.21.15.6:0/4218047550 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 272360281 0 0) 0x7fe0e8003530 con 0x7fe0fc0b7c70 2023-07-21T22:19:02.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.244+0000 7fe0f3fff640 1 -- 172.21.15.6:0/4218047550 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0fc0d1850 msgr2=0x7fe0fc0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:02.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.244+0000 7fe0f3fff640 1 --2- 172.21.15.6:0/4218047550 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0fc0d1850 0x7fe0fc0d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.244+0000 7fe0f3fff640 1 -- 172.21.15.6:0/4218047550 >> v1:172.21.15.6:6789/0 conn(0x7fe0fc0b7c70 legacy=0x7fe0fc15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:02.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.244+0000 7fe0f3fff640 1 -- 172.21.15.6:0/4218047550 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc160320 con 0x7fe0fc15fd60 2023-07-21T22:19:02.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.248+0000 7fe0f3fff640 1 --2- 172.21.15.6:0/4218047550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0fc15fd60 0x7fe0fc0d0c50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40097c0 tx=0x7fe0e401c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5eadc5974a590c02 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:02.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.248+0000 7fe0f9d9b640 1 -- 172.21.15.6:0/4218047550 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec001680 con 0x7fe0fc15fd60 2023-07-21T22:19:02.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.248+0000 7fe0f9d9b640 1 -- 172.21.15.6:0/4218047550 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e40a7050 con 0x7fe0fc15fd60 2023-07-21T22:19:02.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.248+0000 7fe0f9d9b640 1 -- 172.21.15.6:0/4218047550 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e40ab600 con 0x7fe0fc15fd60 2023-07-21T22:19:02.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.248+0000 7fe100eca640 1 -- 172.21.15.6:0/4218047550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0fc15fd60 msgr2=0x7fe0fc0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:02.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.248+0000 7fe100eca640 1 --2- 172.21.15.6:0/4218047550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0fc15fd60 0x7fe0fc0d0c50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40097c0 tx=0x7fe0e401c370 comp rx=0 tx=0).stop 2023-07-21T22:19:02.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.248+0000 7fe100eca640 1 -- 172.21.15.6:0/4218047550 shutdown_connections 2023-07-21T22:19:02.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.248+0000 7fe100eca640 1 --2- 172.21.15.6:0/4218047550 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0fc0d1850 0x7fe0fc0d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.248+0000 7fe100eca640 1 --2- 172.21.15.6:0/4218047550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0fc15fd60 0x7fe0fc0d0c50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.248+0000 7fe100eca640 1 -- 172.21.15.6:0/4218047550 >> 172.21.15.6:0/4218047550 conn(0x7fe0fc0650b0 msgr2=0x7fe0fc0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:02.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.248+0000 7fe100eca640 1 -- 172.21.15.6:0/4218047550 shutdown_connections 2023-07-21T22:19:02.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.248+0000 7fe100eca640 1 -- 172.21.15.6:0/4218047550 wait complete. 2023-07-21T22:19:02.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe100eca640 1 Processor -- start 2023-07-21T22:19:02.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe100eca640 1 -- start start 2023-07-21T22:19:02.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe100eca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0fc0b7c70 0x7fe0fc1564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:02.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe100eca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0fc0d1850 0x7fe0fc15a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:02.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe100eca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0fc15fd60 0x7fe0fc14d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:02.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe100eca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0b2d20 con 0x7fe0fc0d1850 2023-07-21T22:19:02.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe100eca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc15b3c0 con 0x7fe0fc0b7c70 2023-07-21T22:19:02.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe100eca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0b26d0 con 0x7fe0fc15fd60 2023-07-21T22:19:02.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe0f3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0fc0d1850 0x7fe0fc15a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:02.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe0f3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0fc0d1850 0x7fe0fc15a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58440/0 (socket says 172.21.15.6:58440) 2023-07-21T22:19:02.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe0f3fff640 1 -- 172.21.15.6:0/62919639 learned_addr learned my addr 172.21.15.6:0/62919639 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:02.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe0fa59c640 1 --2- 172.21.15.6:0/62919639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0fc0b7c70 0x7fe0fc1564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:02.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe0fad9d640 1 --2- 172.21.15.6:0/62919639 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0fc15fd60 0x7fe0fc14d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:02.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe0f3fff640 1 -- 172.21.15.6:0/62919639 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0fc15fd60 msgr2=0x7fe0fc14d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:02.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe0f3fff640 1 --2- 172.21.15.6:0/62919639 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0fc15fd60 0x7fe0fc14d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe0f3fff640 1 -- 172.21.15.6:0/62919639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0fc0b7c70 msgr2=0x7fe0fc1564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:02.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe0f3fff640 1 --2- 172.21.15.6:0/62919639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0fc0b7c70 0x7fe0fc1564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe0f3fff640 1 -- 172.21.15.6:0/62919639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e4009420 con 0x7fe0fc0d1850 2023-07-21T22:19:02.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe0f3fff640 1 --2- 172.21.15.6:0/62919639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0fc0d1850 0x7fe0fc15a9c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4000c10 tx=0x7fe0e4019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:02.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe0f2ffd640 1 -- 172.21.15.6:0/62919639 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e40038b0 con 0x7fe0fc0d1850 2023-07-21T22:19:02.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe0f2ffd640 1 -- 172.21.15.6:0/62919639 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e4003a10 con 0x7fe0fc0d1850 2023-07-21T22:19:02.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe100eca640 1 -- 172.21.15.6:0/62919639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0fc0b29b0 con 0x7fe0fc0d1850 2023-07-21T22:19:02.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe0f2ffd640 1 -- 172.21.15.6:0/62919639 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4003dc0 con 0x7fe0fc0d1850 2023-07-21T22:19:02.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.252+0000 7fe100eca640 1 -- 172.21.15.6:0/62919639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0fc156a30 con 0x7fe0fc0d1850 2023-07-21T22:19:02.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.256+0000 7fe100eca640 1 -- 172.21.15.6:0/62919639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0fc0b2e90 con 0x7fe0fc0d1850 2023-07-21T22:19:02.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.256+0000 7fe0f2ffd640 1 -- 172.21.15.6:0/62919639 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe0e40b6420 con 0x7fe0fc0d1850 2023-07-21T22:19:02.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.256+0000 7fe0f2ffd640 1 --2- 172.21.15.6:0/62919639 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe0dc0662b0 0x7fe0dc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:02.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.256+0000 7fe0f2ffd640 1 -- 172.21.15.6:0/62919639 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe0e411e1e0 con 0x7fe0fc0d1850 2023-07-21T22:19:02.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.256+0000 7fe0fa59c640 1 --2- 172.21.15.6:0/62919639 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe0dc0662b0 0x7fe0dc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:02.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.260+0000 7fe0fa59c640 1 --2- 172.21.15.6:0/62919639 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe0dc0662b0 0x7fe0dc068760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec001ec0 tx=0x7fe0ec0016e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:02.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.260+0000 7fe0f2ffd640 1 -- 172.21.15.6:0/62919639 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe0e40eb670 con 0x7fe0fc0d1850 2023-07-21T22:19:02.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.448+0000 7fe100eca640 1 -- 172.21.15.6:0/62919639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0fc0b14c0 con 0x7fe0fc0d1850 2023-07-21T22:19:02.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.448+0000 7fe0f2ffd640 1 -- 172.21.15.6:0/62919639 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7fe0e40eec90 con 0x7fe0fc0d1850 2023-07-21T22:19:02.494 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:02.494 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3109831689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3109831689},{"type":"v1","addr":"172.21.15.6:6834","nonce":3109831689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/937908788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":937908788},{"type":"v1","addr":"172.21.15.161:6836","nonce":937908788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/445360801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":445360801},{"type":"v1","addr":"172.21.15.6:6835","nonce":445360801}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:18:43.722596+0000","modified":"2023-07-21T22:18:47.542628+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/747850146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":747850146},{"type":"v1","addr":"172.21.15.161:6837","nonce":747850146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:19:02.495 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-07-21T22:19:02.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.448+0000 7fe100eca640 1 -- 172.21.15.6:0/62919639 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe0dc0662b0 msgr2=0x7fe0dc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:02.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.448+0000 7fe100eca640 1 --2- 172.21.15.6:0/62919639 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe0dc0662b0 0x7fe0dc068760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec001ec0 tx=0x7fe0ec0016e0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.448+0000 7fe100eca640 1 -- 172.21.15.6:0/62919639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0fc0d1850 msgr2=0x7fe0fc15a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:02.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.448+0000 7fe100eca640 1 --2- 172.21.15.6:0/62919639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0fc0d1850 0x7fe0fc15a9c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4000c10 tx=0x7fe0e4019110 comp rx=0 tx=0).stop 2023-07-21T22:19:02.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.448+0000 7fe100eca640 1 -- 172.21.15.6:0/62919639 shutdown_connections 2023-07-21T22:19:02.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.448+0000 7fe100eca640 1 --2- 172.21.15.6:0/62919639 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0fc15fd60 0x7fe0fc14d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.448+0000 7fe100eca640 1 --2- 172.21.15.6:0/62919639 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe0dc0662b0 0x7fe0dc068760 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.448+0000 7fe100eca640 1 --2- 172.21.15.6:0/62919639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0fc0d1850 0x7fe0fc15a9c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.448+0000 7fe100eca640 1 --2- 172.21.15.6:0/62919639 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0fc0b7c70 0x7fe0fc1564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.448+0000 7fe100eca640 1 -- 172.21.15.6:0/62919639 >> 172.21.15.6:0/62919639 conn(0x7fe0fc0650b0 msgr2=0x7fe0fc0cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:02.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.448+0000 7fe100eca640 1 -- 172.21.15.6:0/62919639 shutdown_connections 2023-07-21T22:19:02.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.448+0000 7fe100eca640 1 -- 172.21.15.6:0/62919639 wait complete. 2023-07-21T22:19:02.516 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:19:02.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.612+0000 7f5247634640 1 Processor -- start 2023-07-21T22:19:02.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.612+0000 7f5247634640 1 -- start start 2023-07-21T22:19:02.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.612+0000 7f5247634640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52400ad6b0 0x7f52400d0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:02.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.612+0000 7f5247634640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52400af640 0x7f52400afac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:02.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.612+0000 7f5247634640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52400aee80 con 0x7f52400cdcd0 2023-07-21T22:19:02.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.612+0000 7f5247634640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52400d0ab0 con 0x7f52400af640 2023-07-21T22:19:02.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.612+0000 7f5247634640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52400adde0 con 0x7f52400ad6b0 2023-07-21T22:19:02.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.612+0000 7f5245bd1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52400af640 0x7f52400afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:02.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.612+0000 7f5245bd1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52400af640 0x7f52400afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58454/0 (socket says 172.21.15.6:58454) 2023-07-21T22:19:02.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.612+0000 7f5245bd1640 1 -- 172.21.15.6:0/2811148846 learned_addr learned my addr 172.21.15.6:0/2811148846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:02.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.612+0000 7f5244bcf640 1 --2- 172.21.15.6:0/2811148846 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52400ad6b0 0x7f52400d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:02.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.616+0000 7f5245bd1640 1 -- 172.21.15.6:0/2811148846 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52400ad6b0 msgr2=0x7f52400d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:02.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.616+0000 7f5245bd1640 1 --2- 172.21.15.6:0/2811148846 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52400ad6b0 0x7f52400d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.616+0000 7f5245bd1640 1 -- 172.21.15.6:0/2811148846 >> v1:172.21.15.161:6789/0 conn(0x7f52400cdcd0 legacy=0x7f52400ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:02.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.616+0000 7f5245bd1640 1 -- 172.21.15.6:0/2811148846 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52400ae0c0 con 0x7f52400af640 2023-07-21T22:19:02.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.616+0000 7f5245bd1640 1 --2- 172.21.15.6:0/2811148846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52400af640 0x7f52400afac0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5238009e80 tx=0x7f523801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443506dcd9d81dcc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:02.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.616+0000 7f5237fff640 1 -- 172.21.15.6:0/2811148846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52380a5880 con 0x7f52400af640 2023-07-21T22:19:02.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.616+0000 7f5237fff640 1 -- 172.21.15.6:0/2811148846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52380a59e0 con 0x7f52400af640 2023-07-21T22:19:02.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.616+0000 7f5237fff640 1 -- 172.21.15.6:0/2811148846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52380a5d70 con 0x7f52400af640 2023-07-21T22:19:02.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5247634640 1 -- 172.21.15.6:0/2811148846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52400af640 msgr2=0x7f52400afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:02.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5247634640 1 --2- 172.21.15.6:0/2811148846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52400af640 0x7f52400afac0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5238009e80 tx=0x7f523801c9c0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5247634640 1 -- 172.21.15.6:0/2811148846 shutdown_connections 2023-07-21T22:19:02.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5247634640 1 --2- 172.21.15.6:0/2811148846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52400af640 0x7f52400afac0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5247634640 1 --2- 172.21.15.6:0/2811148846 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52400ad6b0 0x7f52400d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5247634640 1 -- 172.21.15.6:0/2811148846 >> 172.21.15.6:0/2811148846 conn(0x7f5240099490 msgr2=0x7f5240089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:02.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5247634640 1 -- 172.21.15.6:0/2811148846 shutdown_connections 2023-07-21T22:19:02.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5247634640 1 -- 172.21.15.6:0/2811148846 wait complete. 2023-07-21T22:19:02.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5247634640 1 Processor -- start 2023-07-21T22:19:02.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5247634640 1 -- start start 2023-07-21T22:19:02.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5247634640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52400ad6b0 0x7f524014b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:02.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5247634640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52400af640 0x7f5240151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:02.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5247634640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52400cdcd0 0x7f5240152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:02.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5247634640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5240157ca0 con 0x7f52400cdcd0 2023-07-21T22:19:02.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5247634640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5240150650 con 0x7f52400af640 2023-07-21T22:19:02.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5247634640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5240150930 con 0x7f52400ad6b0 2023-07-21T22:19:02.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5245bd1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52400cdcd0 0x7f5240152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:02.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5245bd1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52400cdcd0 0x7f5240152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58456/0 (socket says 172.21.15.6:58456) 2023-07-21T22:19:02.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5245bd1640 1 -- 172.21.15.6:0/2546799679 learned_addr learned my addr 172.21.15.6:0/2546799679 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:02.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5244bcf640 1 --2- 172.21.15.6:0/2546799679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52400af640 0x7f5240151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:02.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f52453d0640 1 --2- 172.21.15.6:0/2546799679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52400ad6b0 0x7f524014b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:02.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5245bd1640 1 -- 172.21.15.6:0/2546799679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52400ad6b0 msgr2=0x7f524014b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:02.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5245bd1640 1 --2- 172.21.15.6:0/2546799679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52400ad6b0 0x7f524014b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5245bd1640 1 -- 172.21.15.6:0/2546799679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52400af640 msgr2=0x7f5240151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:02.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5245bd1640 1 --2- 172.21.15.6:0/2546799679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52400af640 0x7f5240151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.620+0000 7f5245bd1640 1 -- 172.21.15.6:0/2546799679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5238009b30 con 0x7f52400cdcd0 2023-07-21T22:19:02.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.624+0000 7f5245bd1640 1 --2- 172.21.15.6:0/2546799679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52400cdcd0 0x7f5240152240 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f523801a5f0 tx=0x7f5238019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:02.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.624+0000 7f5235ffb640 1 -- 172.21.15.6:0/2546799679 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52380b8670 con 0x7f52400cdcd0 2023-07-21T22:19:02.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.624+0000 7f5235ffb640 1 -- 172.21.15.6:0/2546799679 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52380b87d0 con 0x7f52400cdcd0 2023-07-21T22:19:02.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.624+0000 7f5235ffb640 1 -- 172.21.15.6:0/2546799679 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52380b8b40 con 0x7f52400cdcd0 2023-07-21T22:19:02.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.624+0000 7f5247634640 1 -- 172.21.15.6:0/2546799679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5240150c10 con 0x7f52400cdcd0 2023-07-21T22:19:02.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.624+0000 7f5247634640 1 -- 172.21.15.6:0/2546799679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524014ba80 con 0x7f52400cdcd0 2023-07-21T22:19:02.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.624+0000 7f5247634640 1 -- 172.21.15.6:0/2546799679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52401510c0 con 0x7f52400cdcd0 2023-07-21T22:19:02.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.624+0000 7f5235ffb640 1 -- 172.21.15.6:0/2546799679 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f52380b8ca0 con 0x7f52400cdcd0 2023-07-21T22:19:02.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.624+0000 7f5235ffb640 1 --2- 172.21.15.6:0/2546799679 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5224066280 0x7f5224068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:02.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.624+0000 7f5235ffb640 1 -- 172.21.15.6:0/2546799679 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f523811f1e0 con 0x7f52400cdcd0 2023-07-21T22:19:02.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.628+0000 7f52453d0640 1 --2- 172.21.15.6:0/2546799679 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5224066280 0x7f5224068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:02.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.628+0000 7f52453d0640 1 --2- 172.21.15.6:0/2546799679 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5224066280 0x7f5224068730 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f523c000fc0 tx=0x7f523c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:02.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.628+0000 7f5235ffb640 1 -- 172.21.15.6:0/2546799679 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f52380ec700 con 0x7f52400cdcd0 2023-07-21T22:19:02.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.784+0000 7f5247634640 1 -- 172.21.15.6:0/2546799679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52400678d0 con 0x7f52400cdcd0 2023-07-21T22:19:02.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.788+0000 7f5235ffb640 1 -- 172.21.15.6:0/2546799679 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18207 (secure 0 0 0) 0x7f52380efd20 con 0x7f52400cdcd0 2023-07-21T22:19:02.834 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:02.834 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:18:45.315608+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:18:41.465054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:18:42.709896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:19:02.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.788+0000 7f5247634640 1 -- 172.21.15.6:0/2546799679 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5224066280 msgr2=0x7f5224068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:02.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.788+0000 7f5247634640 1 --2- 172.21.15.6:0/2546799679 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5224066280 0x7f5224068730 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f523c000fc0 tx=0x7f523c009040 comp rx=0 tx=0).stop 2023-07-21T22:19:02.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.788+0000 7f5247634640 1 -- 172.21.15.6:0/2546799679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52400cdcd0 msgr2=0x7f5240152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:02.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.788+0000 7f5247634640 1 --2- 172.21.15.6:0/2546799679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52400cdcd0 0x7f5240152240 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f523801a5f0 tx=0x7f5238019760 comp rx=0 tx=0).stop 2023-07-21T22:19:02.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.788+0000 7f5247634640 1 -- 172.21.15.6:0/2546799679 shutdown_connections 2023-07-21T22:19:02.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.788+0000 7f5247634640 1 --2- 172.21.15.6:0/2546799679 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5224066280 0x7f5224068730 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.788+0000 7f5247634640 1 --2- 172.21.15.6:0/2546799679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52400cdcd0 0x7f5240152240 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.788+0000 7f5247634640 1 --2- 172.21.15.6:0/2546799679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52400af640 0x7f5240151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.788+0000 7f5247634640 1 --2- 172.21.15.6:0/2546799679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52400ad6b0 0x7f524014b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.788+0000 7f5247634640 1 -- 172.21.15.6:0/2546799679 >> 172.21.15.6:0/2546799679 conn(0x7f5240099490 msgr2=0x7f52400b14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:02.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.788+0000 7f5247634640 1 -- 172.21.15.6:0/2546799679 shutdown_connections 2023-07-21T22:19:02.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.788+0000 7f5247634640 1 -- 172.21.15.6:0/2546799679 wait complete. 2023-07-21T22:19:02.855 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:18:41.465054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:18:42.709896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:19:02.856 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:19:03.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.956+0000 7f788b47b640 1 Processor -- start 2023-07-21T22:19:03.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.960+0000 7f788b47b640 1 -- start start 2023-07-21T22:19:03.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.960+0000 7f788b47b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7884069430 0x7f7884069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.960+0000 7f788b47b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7884070f30 0x7f78840ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.960+0000 7f788b47b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7884159d70 con 0x7f78840af2b0 2023-07-21T22:19:03.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.960+0000 7f788b47b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7884069d40 con 0x7f7884070f30 2023-07-21T22:19:03.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.960+0000 7f788b47b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78840c9c60 con 0x7f7884069430 2023-07-21T22:19:03.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.960+0000 7f7889a18640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f78840af2b0 0x7f788415a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39972/0 (socket says 172.21.15.6:39972) 2023-07-21T22:19:03.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.960+0000 7f7889a18640 1 -- 172.21.15.6:0/1823692943 learned_addr learned my addr 172.21.15.6:0/1823692943 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.960+0000 7f7888a16640 1 --2- 172.21.15.6:0/1823692943 >> v2:172.21.15.6:3300/0 conn(0x7f7884070f30 0x7f78840ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.960+0000 7f7889217640 1 --2- 172.21.15.6:0/1823692943 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7884069430 0x7f7884069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.960+0000 7f787bfff640 1 -- 172.21.15.6:0/1823692943 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345323249 0 0) 0x7f787c0014a0 con 0x7f78840af2b0 2023-07-21T22:19:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.960+0000 7f7888a16640 1 -- 172.21.15.6:0/1823692943 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7884069430 msgr2=0x7f7884069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.960+0000 7f7888a16640 1 --2- 172.21.15.6:0/1823692943 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7884069430 0x7f7884069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.960+0000 7f7888a16640 1 -- 172.21.15.6:0/1823692943 >> v1:172.21.15.6:6789/0 conn(0x7f78840af2b0 legacy=0x7f788415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.960+0000 7f7888a16640 1 -- 172.21.15.6:0/1823692943 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78840c9f40 con 0x7f7884070f30 2023-07-21T22:19:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.964+0000 7f7888a16640 1 --2- 172.21.15.6:0/1823692943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7884070f30 0x7f78840ad6f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f78740097c0 tx=0x7f787401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392467eea5b61600 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.964+0000 7f787bfff640 1 -- 172.21.15.6:0/1823692943 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78740ab680 con 0x7f7884070f30 2023-07-21T22:19:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.964+0000 7f787bfff640 1 -- 172.21.15.6:0/1823692943 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78740ab7e0 con 0x7f7884070f30 2023-07-21T22:19:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.964+0000 7f787bfff640 1 -- 172.21.15.6:0/1823692943 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78740abb70 con 0x7f7884070f30 2023-07-21T22:19:03.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.964+0000 7f788b47b640 1 -- 172.21.15.6:0/1823692943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7884070f30 msgr2=0x7f78840ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.964+0000 7f788b47b640 1 --2- 172.21.15.6:0/1823692943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7884070f30 0x7f78840ad6f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f78740097c0 tx=0x7f787401c480 comp rx=0 tx=0).stop 2023-07-21T22:19:03.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.964+0000 7f788b47b640 1 -- 172.21.15.6:0/1823692943 shutdown_connections 2023-07-21T22:19:03.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.964+0000 7f788b47b640 1 --2- 172.21.15.6:0/1823692943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7884070f30 0x7f78840ad6f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.964+0000 7f788b47b640 1 --2- 172.21.15.6:0/1823692943 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7884069430 0x7f7884069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.964+0000 7f788b47b640 1 -- 172.21.15.6:0/1823692943 >> 172.21.15.6:0/1823692943 conn(0x7f78840cde90 msgr2=0x7f78840ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:03.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.964+0000 7f788b47b640 1 -- 172.21.15.6:0/1823692943 shutdown_connections 2023-07-21T22:19:03.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.964+0000 7f788b47b640 1 -- 172.21.15.6:0/1823692943 wait complete. 2023-07-21T22:19:03.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.964+0000 7f788b47b640 1 Processor -- start 2023-07-21T22:19:03.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.964+0000 7f788b47b640 1 -- start start 2023-07-21T22:19:03.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f788b47b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7884069430 0x7f7884142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f788b47b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7884070f30 0x7f788406ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f788b47b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78840af2b0 0x7f78840c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f788b47b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78840b1be0 con 0x7f7884069430 2023-07-21T22:19:03.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f788b47b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78840c6690 con 0x7f7884070f30 2023-07-21T22:19:03.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f788b47b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7884142c90 con 0x7f78840af2b0 2023-07-21T22:19:03.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f7889217640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7884069430 0x7f7884142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f7889217640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7884069430 0x7f7884142750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58476/0 (socket says 172.21.15.6:58476) 2023-07-21T22:19:03.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f7889217640 1 -- 172.21.15.6:0/3153933699 learned_addr learned my addr 172.21.15.6:0/3153933699 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:03.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f7889a18640 1 --2- 172.21.15.6:0/3153933699 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78840af2b0 0x7f78840c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f7888a16640 1 --2- 172.21.15.6:0/3153933699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7884070f30 0x7f788406ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f7889217640 1 -- 172.21.15.6:0/3153933699 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78840af2b0 msgr2=0x7f78840c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f7889217640 1 --2- 172.21.15.6:0/3153933699 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78840af2b0 0x7f78840c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f7889217640 1 -- 172.21.15.6:0/3153933699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7884070f30 msgr2=0x7f788406ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f7889217640 1 --2- 172.21.15.6:0/3153933699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7884070f30 0x7f788406ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f7889217640 1 -- 172.21.15.6:0/3153933699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7874009420 con 0x7f7884069430 2023-07-21T22:19:03.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f7889217640 1 --2- 172.21.15.6:0/3153933699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7884069430 0x7f7884142750 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f788000e870 tx=0x7f788000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:03.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f7879ffb640 1 -- 172.21.15.6:0/3153933699 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7880009510 con 0x7f7884069430 2023-07-21T22:19:03.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f7879ffb640 1 -- 172.21.15.6:0/3153933699 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f788000eec0 con 0x7f7884069430 2023-07-21T22:19:03.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f788b47b640 1 -- 172.21.15.6:0/3153933699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78840b0f60 con 0x7f7884069430 2023-07-21T22:19:03.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f7879ffb640 1 -- 172.21.15.6:0/3153933699 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788000cb40 con 0x7f7884069430 2023-07-21T22:19:03.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f788b47b640 1 -- 172.21.15.6:0/3153933699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78840b1520 con 0x7f7884069430 2023-07-21T22:19:03.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.968+0000 7f788b47b640 1 -- 172.21.15.6:0/3153933699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78840b1e50 con 0x7f7884069430 2023-07-21T22:19:03.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.972+0000 7f7879ffb640 1 -- 172.21.15.6:0/3153933699 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f788000cca0 con 0x7f7884069430 2023-07-21T22:19:03.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.972+0000 7f7879ffb640 1 --2- 172.21.15.6:0/3153933699 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f7868066280 0x7f7868068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.972+0000 7f7879ffb640 1 -- 172.21.15.6:0/3153933699 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7880083e90 con 0x7f7884069430 2023-07-21T22:19:03.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.972+0000 7f7888a16640 1 --2- 172.21.15.6:0/3153933699 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f7868066280 0x7f7868068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.972+0000 7f7888a16640 1 --2- 172.21.15.6:0/3153933699 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f7868066280 0x7f7868068730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f78740af000 tx=0x7f78740a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:03.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:02.976+0000 7f7879ffb640 1 -- 172.21.15.6:0/3153933699 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7880051270 con 0x7f7884069430 2023-07-21T22:19:03.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.132+0000 7f788b47b640 1 -- 172.21.15.6:0/3153933699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78840adbb0 con 0x7f7884069430 2023-07-21T22:19:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.132+0000 7f7879ffb640 1 -- 172.21.15.6:0/3153933699 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78800170a0 con 0x7f7884069430 2023-07-21T22:19:03.197 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:19:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.136+0000 7f788b47b640 1 -- 172.21.15.6:0/3153933699 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f7868066280 msgr2=0x7f7868068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.136+0000 7f788b47b640 1 --2- 172.21.15.6:0/3153933699 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f7868066280 0x7f7868068730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f78740af000 tx=0x7f78740a7000 comp rx=0 tx=0).stop 2023-07-21T22:19:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.136+0000 7f788b47b640 1 -- 172.21.15.6:0/3153933699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7884069430 msgr2=0x7f7884142750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.136+0000 7f788b47b640 1 --2- 172.21.15.6:0/3153933699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7884069430 0x7f7884142750 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f788000e870 tx=0x7f788000ec70 comp rx=0 tx=0).stop 2023-07-21T22:19:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.136+0000 7f788b47b640 1 -- 172.21.15.6:0/3153933699 shutdown_connections 2023-07-21T22:19:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.136+0000 7f788b47b640 1 --2- 172.21.15.6:0/3153933699 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78840af2b0 0x7f78840c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.136+0000 7f788b47b640 1 --2- 172.21.15.6:0/3153933699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7884070f30 0x7f788406ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.136+0000 7f788b47b640 1 --2- 172.21.15.6:0/3153933699 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f7868066280 0x7f7868068730 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.136+0000 7f788b47b640 1 --2- 172.21.15.6:0/3153933699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7884069430 0x7f7884142750 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.136+0000 7f788b47b640 1 -- 172.21.15.6:0/3153933699 >> 172.21.15.6:0/3153933699 conn(0x7f78840cde90 msgr2=0x7f7884153450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.136+0000 7f788b47b640 1 -- 172.21.15.6:0/3153933699 shutdown_connections 2023-07-21T22:19:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.136+0000 7f788b47b640 1 -- 172.21.15.6:0/3153933699 wait complete. 2023-07-21T22:19:03.200 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:19:03.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.300+0000 7fe7f939d640 1 Processor -- start 2023-07-21T22:19:03.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.300+0000 7fe7f939d640 1 -- start start 2023-07-21T22:19:03.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.304+0000 7fe7f939d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe7f415bb30 0x7fe7f40b1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.304+0000 7fe7f939d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7f40b07d0 0x7fe7f40cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.304+0000 7fe7f939d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7f40b19e0 con 0x7fe7f40d0300 2023-07-21T22:19:03.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.304+0000 7fe7f939d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7f40b17d0 con 0x7fe7f415bb30 2023-07-21T22:19:03.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.304+0000 7fe7f939d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f40d0780 con 0x7fe7f40b07d0 2023-07-21T22:19:03.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.304+0000 7fe7f2ffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe7f415bb30 0x7fe7f40b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.304+0000 7fe7ebfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7f40b07d0 0x7fe7f40cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.304+0000 7fe7f2ffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe7f415bb30 0x7fe7f40b1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35962/0 (socket says 172.21.15.6:35962) 2023-07-21T22:19:03.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.304+0000 7fe7f2ffd640 1 -- 172.21.15.6:0/2951839478 learned_addr learned my addr 172.21.15.6:0/2951839478 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:03.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.304+0000 7fe7f2ffd640 1 -- 172.21.15.6:0/2951839478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7f40b07d0 msgr2=0x7fe7f40cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:03.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.304+0000 7fe7f2ffd640 1 --2- 172.21.15.6:0/2951839478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7f40b07d0 0x7fe7f40cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.304+0000 7fe7f2ffd640 1 -- 172.21.15.6:0/2951839478 >> v1:172.21.15.161:6789/0 conn(0x7fe7f40d0300 legacy=0x7fe7f40aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.304+0000 7fe7f2ffd640 1 -- 172.21.15.6:0/2951839478 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f40b1cc0 con 0x7fe7f415bb30 2023-07-21T22:19:03.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.304+0000 7fe7ebfff640 1 --2- 172.21.15.6:0/2951839478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7f40b07d0 0x7fe7f40cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:03.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.304+0000 7fe7f27fc640 1 -- 172.21.15.6:0/2951839478 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481595977 0 0) 0x7fe7f40b19e0 con 0x7fe7f40d0300 2023-07-21T22:19:03.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.308+0000 7fe7f2ffd640 1 --2- 172.21.15.6:0/2951839478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7f415bb30 0x7fe7f40b1220 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4009870 tx=0x7fe7e401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e58b2e4012e9dc17 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:03.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.308+0000 7fe7f27fc640 1 -- 172.21.15.6:0/2951839478 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e40aa670 con 0x7fe7f415bb30 2023-07-21T22:19:03.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.308+0000 7fe7f27fc640 1 -- 172.21.15.6:0/2951839478 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e40aa7d0 con 0x7fe7f415bb30 2023-07-21T22:19:03.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.308+0000 7fe7f27fc640 1 -- 172.21.15.6:0/2951839478 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e40aab60 con 0x7fe7f415bb30 2023-07-21T22:19:03.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.308+0000 7fe7f939d640 1 -- 172.21.15.6:0/2951839478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7f415bb30 msgr2=0x7fe7f40b1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.308+0000 7fe7f939d640 1 --2- 172.21.15.6:0/2951839478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7f415bb30 0x7fe7f40b1220 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4009870 tx=0x7fe7e401c510 comp rx=0 tx=0).stop 2023-07-21T22:19:03.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.308+0000 7fe7f939d640 1 -- 172.21.15.6:0/2951839478 shutdown_connections 2023-07-21T22:19:03.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.308+0000 7fe7f939d640 1 --2- 172.21.15.6:0/2951839478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7f40b07d0 0x7fe7f40cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.308+0000 7fe7f939d640 1 --2- 172.21.15.6:0/2951839478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7f415bb30 0x7fe7f40b1220 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.308+0000 7fe7f939d640 1 -- 172.21.15.6:0/2951839478 >> 172.21.15.6:0/2951839478 conn(0x7fe7f409b4c0 msgr2=0x7fe7f40d21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:03.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.308+0000 7fe7f939d640 1 -- 172.21.15.6:0/2951839478 shutdown_connections 2023-07-21T22:19:03.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.308+0000 7fe7f939d640 1 -- 172.21.15.6:0/2951839478 wait complete. 2023-07-21T22:19:03.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.308+0000 7fe7f939d640 1 Processor -- start 2023-07-21T22:19:03.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.308+0000 7fe7f939d640 1 -- start start 2023-07-21T22:19:03.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7f939d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7f40b07d0 0x7fe7f413eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7f939d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7f40d0300 0x7fe7f415a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7f939d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7f415bb30 0x7fe7f4069f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7f939d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f413efe0 con 0x7fe7f40b07d0 2023-07-21T22:19:03.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7f939d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f41506b0 con 0x7fe7f415bb30 2023-07-21T22:19:03.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7f939d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f4150990 con 0x7fe7f40d0300 2023-07-21T22:19:03.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7f2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7f40b07d0 0x7fe7f413eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7f2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7f40b07d0 0x7fe7f413eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58482/0 (socket says 172.21.15.6:58482) 2023-07-21T22:19:03.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7f2ffd640 1 -- 172.21.15.6:0/710812905 learned_addr learned my addr 172.21.15.6:0/710812905 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:03.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7f37fe640 1 --2- 172.21.15.6:0/710812905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7f415bb30 0x7fe7f4069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7ebfff640 1 --2- 172.21.15.6:0/710812905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7f40d0300 0x7fe7f415a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7f2ffd640 1 -- 172.21.15.6:0/710812905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7f40d0300 msgr2=0x7fe7f415a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7f2ffd640 1 --2- 172.21.15.6:0/710812905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7f40d0300 0x7fe7f415a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7f2ffd640 1 -- 172.21.15.6:0/710812905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7f415bb30 msgr2=0x7fe7f4069f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7f2ffd640 1 --2- 172.21.15.6:0/710812905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7f415bb30 0x7fe7f4069f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7f2ffd640 1 -- 172.21.15.6:0/710812905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc009420 con 0x7fe7f40b07d0 2023-07-21T22:19:03.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7f2ffd640 1 --2- 172.21.15.6:0/710812905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7f40b07d0 0x7fe7f413eaa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe7e40ac040 tx=0x7fe7e401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:03.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7eb7fe640 1 -- 172.21.15.6:0/710812905 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e40bd5f0 con 0x7fe7f40b07d0 2023-07-21T22:19:03.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7eb7fe640 1 -- 172.21.15.6:0/710812905 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e40bd750 con 0x7fe7f40b07d0 2023-07-21T22:19:03.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7eb7fe640 1 -- 172.21.15.6:0/710812905 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e40bdb00 con 0x7fe7f40b07d0 2023-07-21T22:19:03.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7f939d640 1 -- 172.21.15.6:0/710812905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e40094d0 con 0x7fe7f40b07d0 2023-07-21T22:19:03.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7f939d640 1 -- 172.21.15.6:0/710812905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f4150f50 con 0x7fe7f40b07d0 2023-07-21T22:19:03.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7f939d640 1 -- 172.21.15.6:0/710812905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f404e020 con 0x7fe7f40b07d0 2023-07-21T22:19:03.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.312+0000 7fe7eb7fe640 1 -- 172.21.15.6:0/710812905 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe7e40b33f0 con 0x7fe7f40b07d0 2023-07-21T22:19:03.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.316+0000 7fe7eb7fe640 1 --2- 172.21.15.6:0/710812905 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe7d4066280 0x7fe7d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.316+0000 7fe7eb7fe640 1 -- 172.21.15.6:0/710812905 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe7e411ec20 con 0x7fe7f40b07d0 2023-07-21T22:19:03.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.316+0000 7fe7ebfff640 1 --2- 172.21.15.6:0/710812905 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe7d4066280 0x7fe7d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.316+0000 7fe7ebfff640 1 --2- 172.21.15.6:0/710812905 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe7d4066280 0x7fe7d4068730 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe7f41500c0 tx=0x7fe7dc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:03.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.320+0000 7fe7eb7fe640 1 -- 172.21.15.6:0/710812905 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe7e40ec1d0 con 0x7fe7f40b07d0 2023-07-21T22:19:03.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.472+0000 7fe7f939d640 1 -- 172.21.15.6:0/710812905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe7f4072a90 con 0x7fe7f40b07d0 2023-07-21T22:19:03.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.472+0000 7fe7eb7fe640 1 -- 172.21.15.6:0/710812905 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe7e40ef7f0 con 0x7fe7f40b07d0 2023-07-21T22:19:03.521 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:19:03.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.476+0000 7fe7f939d640 1 -- 172.21.15.6:0/710812905 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe7d4066280 msgr2=0x7fe7d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.476+0000 7fe7f939d640 1 --2- 172.21.15.6:0/710812905 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe7d4066280 0x7fe7d4068730 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe7f41500c0 tx=0x7fe7dc009190 comp rx=0 tx=0).stop 2023-07-21T22:19:03.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.476+0000 7fe7f939d640 1 -- 172.21.15.6:0/710812905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7f40b07d0 msgr2=0x7fe7f413eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.476+0000 7fe7f939d640 1 --2- 172.21.15.6:0/710812905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7f40b07d0 0x7fe7f413eaa0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe7e40ac040 tx=0x7fe7e401ad50 comp rx=0 tx=0).stop 2023-07-21T22:19:03.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.476+0000 7fe7f939d640 1 -- 172.21.15.6:0/710812905 shutdown_connections 2023-07-21T22:19:03.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.476+0000 7fe7f939d640 1 --2- 172.21.15.6:0/710812905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7f415bb30 0x7fe7f4069f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.476+0000 7fe7f939d640 1 --2- 172.21.15.6:0/710812905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7f40d0300 0x7fe7f415a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.476+0000 7fe7f939d640 1 --2- 172.21.15.6:0/710812905 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe7d4066280 0x7fe7d4068730 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.476+0000 7fe7f939d640 1 --2- 172.21.15.6:0/710812905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7f40b07d0 0x7fe7f413eaa0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.476+0000 7fe7f939d640 1 -- 172.21.15.6:0/710812905 >> 172.21.15.6:0/710812905 conn(0x7fe7f409b4c0 msgr2=0x7fe7f40b3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:03.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.476+0000 7fe7f939d640 1 -- 172.21.15.6:0/710812905 shutdown_connections 2023-07-21T22:19:03.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.476+0000 7fe7f939d640 1 -- 172.21.15.6:0/710812905 wait complete. 2023-07-21T22:19:03.542 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:19:03.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.640+0000 7fbf6fc6d640 1 Processor -- start 2023-07-21T22:19:03.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.640+0000 7fbf6fc6d640 1 -- start start 2023-07-21T22:19:03.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.644+0000 7fbf6fc6d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbf680aeb40 0x7fbf6815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.644+0000 7fbf6fc6d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbf680aef10 0x7fbf68158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.644+0000 7fbf6fc6d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf681532b0 con 0x7fbf68159270 2023-07-21T22:19:03.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.644+0000 7fbf6fc6d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf680ca6f0 con 0x7fbf680aeb40 2023-07-21T22:19:03.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.644+0000 7fbf6fc6d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf681599d0 con 0x7fbf680aef10 2023-07-21T22:19:03.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.644+0000 7fbf6e20a640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbf68159270 0x7fbf680c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39976/0 (socket says 172.21.15.6:39976) 2023-07-21T22:19:03.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.644+0000 7fbf6e20a640 1 -- 172.21.15.6:0/3615076440 learned_addr learned my addr 172.21.15.6:0/3615076440 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:03.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.644+0000 7fbf6da09640 1 --2- 172.21.15.6:0/3615076440 >> v2:172.21.15.6:3300/0 conn(0x7fbf680aeb40 0x7fbf6815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.644+0000 7fbf6d208640 1 --2- 172.21.15.6:0/3615076440 >> v2:172.21.15.161:3300/0 conn(0x7fbf680aef10 0x7fbf68158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.644+0000 7fbf6da09640 1 -- 172.21.15.6:0/3615076440 >> v2:172.21.15.161:3300/0 conn(0x7fbf680aef10 msgr2=0x7fbf68158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:03.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.644+0000 7fbf6da09640 1 --2- 172.21.15.6:0/3615076440 >> v2:172.21.15.161:3300/0 conn(0x7fbf680aef10 0x7fbf68158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.644+0000 7fbf6da09640 1 -- 172.21.15.6:0/3615076440 >> v1:172.21.15.6:6789/0 conn(0x7fbf68159270 legacy=0x7fbf680c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.644+0000 7fbf6da09640 1 -- 172.21.15.6:0/3615076440 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf68159cb0 con 0x7fbf680aeb40 2023-07-21T22:19:03.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.644+0000 7fbf6ca07640 1 -- 172.21.15.6:0/3615076440 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077485495 0 0) 0x7fbf681532b0 con 0x7fbf68159270 2023-07-21T22:19:03.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.648+0000 7fbf6da09640 1 --2- 172.21.15.6:0/3615076440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf680aeb40 0x7fbf6815cef0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbf680cee90 tx=0x7fbf6401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94900562a49cbe0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:03.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.648+0000 7fbf6ca07640 1 -- 172.21.15.6:0/3615076440 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf640ac600 con 0x7fbf680aeb40 2023-07-21T22:19:03.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.648+0000 7fbf6ca07640 1 -- 172.21.15.6:0/3615076440 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf640a8050 con 0x7fbf680aeb40 2023-07-21T22:19:03.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.648+0000 7fbf6ca07640 1 -- 172.21.15.6:0/3615076440 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf640ac980 con 0x7fbf680aeb40 2023-07-21T22:19:03.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.648+0000 7fbf6fc6d640 1 -- 172.21.15.6:0/3615076440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf680aeb40 msgr2=0x7fbf6815cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.648+0000 7fbf6fc6d640 1 --2- 172.21.15.6:0/3615076440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf680aeb40 0x7fbf6815cef0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbf680cee90 tx=0x7fbf6401c3a0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.648+0000 7fbf6fc6d640 1 -- 172.21.15.6:0/3615076440 shutdown_connections 2023-07-21T22:19:03.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.648+0000 7fbf6fc6d640 1 --2- 172.21.15.6:0/3615076440 >> v2:172.21.15.161:3300/0 conn(0x7fbf680aef10 0x7fbf68158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.648+0000 7fbf6fc6d640 1 --2- 172.21.15.6:0/3615076440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf680aeb40 0x7fbf6815cef0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.648+0000 7fbf6fc6d640 1 -- 172.21.15.6:0/3615076440 >> 172.21.15.6:0/3615076440 conn(0x7fbf680cde90 msgr2=0x7fbf680ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:03.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.648+0000 7fbf6fc6d640 1 -- 172.21.15.6:0/3615076440 shutdown_connections 2023-07-21T22:19:03.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.648+0000 7fbf6fc6d640 1 -- 172.21.15.6:0/3615076440 wait complete. 2023-07-21T22:19:03.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.648+0000 7fbf6fc6d640 1 Processor -- start 2023-07-21T22:19:03.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.648+0000 7fbf6fc6d640 1 -- start start 2023-07-21T22:19:03.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf6fc6d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf680aeb40 0x7fbf6814e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf6fc6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf680aef10 0x7fbf68145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf6fc6d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf68159270 0x7fbf68157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf6fc6d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf68146440 con 0x7fbf680aef10 2023-07-21T22:19:03.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf6fc6d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6814eeb0 con 0x7fbf68159270 2023-07-21T22:19:03.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf6fc6d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6814f190 con 0x7fbf680aeb40 2023-07-21T22:19:03.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf6d208640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf680aef10 0x7fbf68145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf6d208640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf680aef10 0x7fbf68145f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58488/0 (socket says 172.21.15.6:58488) 2023-07-21T22:19:03.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf6d208640 1 -- 172.21.15.6:0/2396996668 learned_addr learned my addr 172.21.15.6:0/2396996668 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:03.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf6e20a640 1 --2- 172.21.15.6:0/2396996668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf68159270 0x7fbf68157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf6da09640 1 --2- 172.21.15.6:0/2396996668 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf680aeb40 0x7fbf6814e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf6d208640 1 -- 172.21.15.6:0/2396996668 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf680aeb40 msgr2=0x7fbf6814e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf6d208640 1 --2- 172.21.15.6:0/2396996668 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf680aeb40 0x7fbf6814e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf6d208640 1 -- 172.21.15.6:0/2396996668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf68159270 msgr2=0x7fbf68157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf6d208640 1 --2- 172.21.15.6:0/2396996668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf68159270 0x7fbf68157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf6d208640 1 -- 172.21.15.6:0/2396996668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf64009420 con 0x7fbf680aef10 2023-07-21T22:19:03.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf6d208640 1 --2- 172.21.15.6:0/2396996668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf680aef10 0x7fbf68145f00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbf5800e930 tx=0x7fbf5800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:03.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf5e7fc640 1 -- 172.21.15.6:0/2396996668 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf58009690 con 0x7fbf680aef10 2023-07-21T22:19:03.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf5e7fc640 1 -- 172.21.15.6:0/2396996668 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5800ca00 con 0x7fbf680aef10 2023-07-21T22:19:03.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf6fc6d640 1 -- 172.21.15.6:0/2396996668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf68156b20 con 0x7fbf680aef10 2023-07-21T22:19:03.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf5e7fc640 1 -- 172.21.15.6:0/2396996668 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5800cd70 con 0x7fbf680aef10 2023-07-21T22:19:03.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf6fc6d640 1 -- 172.21.15.6:0/2396996668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6815bcb0 con 0x7fbf680aef10 2023-07-21T22:19:03.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.652+0000 7fbf6fc6d640 1 -- 172.21.15.6:0/2396996668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf6814f3d0 con 0x7fbf680aef10 2023-07-21T22:19:03.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.656+0000 7fbf5e7fc640 1 -- 172.21.15.6:0/2396996668 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbf58013470 con 0x7fbf680aef10 2023-07-21T22:19:03.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.656+0000 7fbf5e7fc640 1 --2- 172.21.15.6:0/2396996668 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbf4c0662b0 0x7fbf4c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.656+0000 7fbf5e7fc640 1 -- 172.21.15.6:0/2396996668 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf58083fb0 con 0x7fbf680aef10 2023-07-21T22:19:03.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.656+0000 7fbf6da09640 1 --2- 172.21.15.6:0/2396996668 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbf4c0662b0 0x7fbf4c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.656+0000 7fbf6da09640 1 --2- 172.21.15.6:0/2396996668 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbf4c0662b0 0x7fbf4c068760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbf640ae000 tx=0x7fbf640a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:03.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.660+0000 7fbf5e7fc640 1 -- 172.21.15.6:0/2396996668 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbf58051450 con 0x7fbf680aef10 2023-07-21T22:19:03.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.812+0000 7fbf6fc6d640 1 -- 172.21.15.6:0/2396996668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbf680678d0 con 0x7fbf680aef10 2023-07-21T22:19:03.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.812+0000 7fbf5e7fc640 1 -- 172.21.15.6:0/2396996668 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbf58017020 con 0x7fbf680aef10 2023-07-21T22:19:03.861 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:19:03.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.816+0000 7fbf6fc6d640 1 -- 172.21.15.6:0/2396996668 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbf4c0662b0 msgr2=0x7fbf4c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.816+0000 7fbf6fc6d640 1 --2- 172.21.15.6:0/2396996668 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbf4c0662b0 0x7fbf4c068760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbf640ae000 tx=0x7fbf640a7000 comp rx=0 tx=0).stop 2023-07-21T22:19:03.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.816+0000 7fbf6fc6d640 1 -- 172.21.15.6:0/2396996668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf680aef10 msgr2=0x7fbf68145f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.816+0000 7fbf6fc6d640 1 --2- 172.21.15.6:0/2396996668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf680aef10 0x7fbf68145f00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbf5800e930 tx=0x7fbf5800edf0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.816+0000 7fbf6fc6d640 1 -- 172.21.15.6:0/2396996668 shutdown_connections 2023-07-21T22:19:03.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.816+0000 7fbf6fc6d640 1 --2- 172.21.15.6:0/2396996668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf68159270 0x7fbf68157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.816+0000 7fbf6fc6d640 1 --2- 172.21.15.6:0/2396996668 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbf4c0662b0 0x7fbf4c068760 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.816+0000 7fbf6fc6d640 1 --2- 172.21.15.6:0/2396996668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf680aef10 0x7fbf68145f00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.816+0000 7fbf6fc6d640 1 --2- 172.21.15.6:0/2396996668 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf680aeb40 0x7fbf6814e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.816+0000 7fbf6fc6d640 1 -- 172.21.15.6:0/2396996668 >> 172.21.15.6:0/2396996668 conn(0x7fbf680cde90 msgr2=0x7fbf680ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:03.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.816+0000 7fbf6fc6d640 1 -- 172.21.15.6:0/2396996668 shutdown_connections 2023-07-21T22:19:03.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.816+0000 7fbf6fc6d640 1 -- 172.21.15.6:0/2396996668 wait complete. 2023-07-21T22:19:03.882 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:19:04.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.980+0000 7f4796f82640 1 Processor -- start 2023-07-21T22:19:04.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.980+0000 7f4796f82640 1 -- start start 2023-07-21T22:19:04.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.984+0000 7f4796f82640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4790070f30 0x7f47900ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:04.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.984+0000 7f4796f82640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4790159d70 con 0x7f4790069430 2023-07-21T22:19:04.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.984+0000 7f4796f82640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47900c9c60 con 0x7f47900af2b0 2023-07-21T22:19:04.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.984+0000 7f4796f82640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47900c9f40 con 0x7f4790070f30 2023-07-21T22:19:04.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.984+0000 7f4794d1e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4790069430 0x7f4790069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39980/0 (socket says 172.21.15.6:39980) 2023-07-21T22:19:04.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.984+0000 7f4794d1e640 1 -- 172.21.15.6:0/878421169 learned_addr learned my addr 172.21.15.6:0/878421169 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:04.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.984+0000 7f478ffff640 1 --2- 172.21.15.6:0/878421169 >> v2:172.21.15.161:3300/0 conn(0x7f4790070f30 0x7f47900ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:04.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.984+0000 7f478f7fe640 1 -- 172.21.15.6:0/878421169 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889960229 0 0) 0x7f4784001120 con 0x7f4790069430 2023-07-21T22:19:04.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.984+0000 7f478f7fe640 1 -- 172.21.15.6:0/878421169 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4780003530 con 0x7f4790069430 2023-07-21T22:19:04.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.984+0000 7f478ffff640 1 -- 172.21.15.6:0/878421169 >> v1:172.21.15.161:6789/0 conn(0x7f47900af2b0 legacy=0x7f479015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:04.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.984+0000 7f478ffff640 1 -- 172.21.15.6:0/878421169 >> v1:172.21.15.6:6789/0 conn(0x7f4790069430 legacy=0x7f4790069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:04.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.984+0000 7f478ffff640 1 -- 172.21.15.6:0/878421169 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47900ca220 con 0x7f4790070f30 2023-07-21T22:19:04.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.988+0000 7f478ffff640 1 --2- 172.21.15.6:0/878421169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4790070f30 0x7f47900ad6f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f477c0097c0 tx=0x7f477c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=226c57d0644178bb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:04.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.988+0000 7f478f7fe640 1 -- 172.21.15.6:0/878421169 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c0ab680 con 0x7f4790070f30 2023-07-21T22:19:04.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.988+0000 7f478f7fe640 1 -- 172.21.15.6:0/878421169 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c0ab7e0 con 0x7f4790070f30 2023-07-21T22:19:04.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.988+0000 7f478f7fe640 1 -- 172.21.15.6:0/878421169 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c0abb70 con 0x7f4790070f30 2023-07-21T22:19:04.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.988+0000 7f4796f82640 1 -- 172.21.15.6:0/878421169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4790070f30 msgr2=0x7f47900ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:04.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.988+0000 7f4796f82640 1 --2- 172.21.15.6:0/878421169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4790070f30 0x7f47900ad6f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f477c0097c0 tx=0x7f477c01c480 comp rx=0 tx=0).stop 2023-07-21T22:19:04.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.988+0000 7f4796f82640 1 -- 172.21.15.6:0/878421169 shutdown_connections 2023-07-21T22:19:04.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.988+0000 7f4796f82640 1 --2- 172.21.15.6:0/878421169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4790070f30 0x7f47900ad6f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.988+0000 7f4796f82640 1 -- 172.21.15.6:0/878421169 >> 172.21.15.6:0/878421169 conn(0x7f47900cde90 msgr2=0x7f47900ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:04.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.988+0000 7f4796f82640 1 -- 172.21.15.6:0/878421169 shutdown_connections 2023-07-21T22:19:04.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.988+0000 7f4796f82640 1 -- 172.21.15.6:0/878421169 wait complete. 2023-07-21T22:19:04.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.988+0000 7f4796f82640 1 Processor -- start 2023-07-21T22:19:04.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f4796f82640 1 -- start start 2023-07-21T22:19:04.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f4796f82640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4790069430 0x7f47900cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:04.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f4796f82640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4790070f30 0x7f479006c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:04.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f4796f82640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47900af2b0 0x7f47900c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:04.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f4796f82640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4790149210 con 0x7f4790070f30 2023-07-21T22:19:04.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f4796f82640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47900ca870 con 0x7f4790069430 2023-07-21T22:19:04.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f4796f82640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47900cb6d0 con 0x7f47900af2b0 2023-07-21T22:19:04.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f478ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4790070f30 0x7f479006c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:04.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f478ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4790070f30 0x7f479006c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58494/0 (socket says 172.21.15.6:58494) 2023-07-21T22:19:04.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f478ffff640 1 -- 172.21.15.6:0/1553147452 learned_addr learned my addr 172.21.15.6:0/1553147452 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:04.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f4794d1e640 1 --2- 172.21.15.6:0/1553147452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4790069430 0x7f47900cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:04.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f479551f640 1 --2- 172.21.15.6:0/1553147452 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47900af2b0 0x7f47900c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:04.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f478ffff640 1 -- 172.21.15.6:0/1553147452 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47900af2b0 msgr2=0x7f47900c74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:04.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f478ffff640 1 --2- 172.21.15.6:0/1553147452 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47900af2b0 0x7f47900c74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f478ffff640 1 -- 172.21.15.6:0/1553147452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4790069430 msgr2=0x7f47900cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:04.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f478ffff640 1 --2- 172.21.15.6:0/1553147452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4790069430 0x7f47900cbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f478ffff640 1 -- 172.21.15.6:0/1553147452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c009420 con 0x7f4790070f30 2023-07-21T22:19:04.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f4794d1e640 1 --2- 172.21.15.6:0/1553147452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4790069430 0x7f47900cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:04.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f478ffff640 1 --2- 172.21.15.6:0/1553147452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4790070f30 0x7f479006c960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f477c0ad040 tx=0x7f477c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:04.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f478d7fa640 1 -- 172.21.15.6:0/1553147452 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c0b5810 con 0x7f4790070f30 2023-07-21T22:19:04.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f478d7fa640 1 -- 172.21.15.6:0/1553147452 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c0b5990 con 0x7f4790070f30 2023-07-21T22:19:04.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f478d7fa640 1 -- 172.21.15.6:0/1553147452 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c0b5d40 con 0x7f4790070f30 2023-07-21T22:19:04.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f4796f82640 1 -- 172.21.15.6:0/1553147452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47900caac0 con 0x7f4790070f30 2023-07-21T22:19:04.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f4796f82640 1 -- 172.21.15.6:0/1553147452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47900cb080 con 0x7f4790070f30 2023-07-21T22:19:04.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.992+0000 7f4796f82640 1 -- 172.21.15.6:0/1553147452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47900678d0 con 0x7f4790070f30 2023-07-21T22:19:04.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.996+0000 7f478d7fa640 1 -- 172.21.15.6:0/1553147452 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f477c0bf410 con 0x7f4790070f30 2023-07-21T22:19:04.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.996+0000 7f478d7fa640 1 --2- 172.21.15.6:0/1553147452 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4774066280 0x7f4774068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:04.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.996+0000 7f478d7fa640 1 -- 172.21.15.6:0/1553147452 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f477c11e980 con 0x7f4790070f30 2023-07-21T22:19:04.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.996+0000 7f4794d1e640 1 --2- 172.21.15.6:0/1553147452 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4774066280 0x7f4774068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:04.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:03.996+0000 7f4794d1e640 1 --2- 172.21.15.6:0/1553147452 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4774066280 0x7f4774068730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4784001280 tx=0x7f4784009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:04.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.000+0000 7f478d7fa640 1 -- 172.21.15.6:0/1553147452 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f477c0ebdf0 con 0x7f4790070f30 2023-07-21T22:19:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.152+0000 7f4796f82640 1 -- 172.21.15.6:0/1553147452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f47900cb810 con 0x7f4790070f30 2023-07-21T22:19:04.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.156+0000 7f478d7fa640 1 -- 172.21.15.6:0/1553147452 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f477c0ab640 con 0x7f4790070f30 2023-07-21T22:19:04.201 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:19:04.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.156+0000 7f4796f82640 1 -- 172.21.15.6:0/1553147452 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4774066280 msgr2=0x7f4774068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.156+0000 7f4796f82640 1 --2- 172.21.15.6:0/1553147452 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4774066280 0x7f4774068730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4784001280 tx=0x7f4784009040 comp rx=0 tx=0).stop 2023-07-21T22:19:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.156+0000 7f4796f82640 1 -- 172.21.15.6:0/1553147452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4790070f30 msgr2=0x7f479006c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.156+0000 7f4796f82640 1 --2- 172.21.15.6:0/1553147452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4790070f30 0x7f479006c960 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f477c0ad040 tx=0x7f477c01acc0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.156+0000 7f4796f82640 1 -- 172.21.15.6:0/1553147452 shutdown_connections 2023-07-21T22:19:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.156+0000 7f4796f82640 1 --2- 172.21.15.6:0/1553147452 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f47900af2b0 0x7f47900c74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.156+0000 7f4796f82640 1 --2- 172.21.15.6:0/1553147452 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4774066280 0x7f4774068730 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.156+0000 7f4796f82640 1 --2- 172.21.15.6:0/1553147452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4790070f30 0x7f479006c960 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.156+0000 7f4796f82640 1 --2- 172.21.15.6:0/1553147452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4790069430 0x7f47900cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.156+0000 7f4796f82640 1 -- 172.21.15.6:0/1553147452 >> 172.21.15.6:0/1553147452 conn(0x7f47900cde90 msgr2=0x7f479014f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:04.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.156+0000 7f4796f82640 1 -- 172.21.15.6:0/1553147452 shutdown_connections 2023-07-21T22:19:04.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.156+0000 7f4796f82640 1 -- 172.21.15.6:0/1553147452 wait complete. 2023-07-21T22:19:04.222 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:19:04.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.320+0000 7f0452648640 1 Processor -- start 2023-07-21T22:19:04.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.320+0000 7f0452648640 1 -- start start 2023-07-21T22:19:04.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.320+0000 7f0452648640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f044c06a540 0x7f044c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:04.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.320+0000 7f0452648640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f044c0ca750 0x7f044c0cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:04.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.320+0000 7f0452648640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f044c06ae50 con 0x7f044c0cdcd0 2023-07-21T22:19:04.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.320+0000 7f0452648640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f044c0cef10 con 0x7f044c0ca750 2023-07-21T22:19:04.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.320+0000 7f0452648640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044c0cfaf0 con 0x7f044c06a540 2023-07-21T22:19:04.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.324+0000 7f044b7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f044c0cdcd0 0x7f044c0cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39996/0 (socket says 172.21.15.6:39996) 2023-07-21T22:19:04.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.324+0000 7f044b7fe640 1 -- 172.21.15.6:0/1049056092 learned_addr learned my addr 172.21.15.6:0/1049056092 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:04.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.324+0000 7f0450be5640 1 --2- 172.21.15.6:0/1049056092 >> v2:172.21.15.6:3300/0 conn(0x7f044c0ca750 0x7f044c0cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:04.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.324+0000 7f044bfff640 1 --2- 172.21.15.6:0/1049056092 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f044c06a540 0x7f044c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:04.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.324+0000 7f044affd640 1 -- 172.21.15.6:0/1049056092 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23002220 0 0) 0x7f044c06ae50 con 0x7f044c0cdcd0 2023-07-21T22:19:04.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.324+0000 7f044affd640 1 -- 172.21.15.6:0/1049056092 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0434003530 con 0x7f044c0cdcd0 2023-07-21T22:19:04.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.324+0000 7f0450be5640 1 -- 172.21.15.6:0/1049056092 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f044c06a540 msgr2=0x7f044c06a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:04.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.324+0000 7f0450be5640 1 --2- 172.21.15.6:0/1049056092 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f044c06a540 0x7f044c06a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.324+0000 7f0450be5640 1 -- 172.21.15.6:0/1049056092 >> v1:172.21.15.6:6789/0 conn(0x7f044c0cdcd0 legacy=0x7f044c0cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:04.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.324+0000 7f0450be5640 1 -- 172.21.15.6:0/1049056092 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c0cfdd0 con 0x7f044c0ca750 2023-07-21T22:19:04.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.324+0000 7f0450be5640 1 --2- 172.21.15.6:0/1049056092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c0ca750 0x7f044c0cabd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0444009d90 tx=0x7f044401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469165eccd30cad8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:04.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.324+0000 7f044affd640 1 -- 172.21.15.6:0/1049056092 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04440a59e0 con 0x7f044c0ca750 2023-07-21T22:19:04.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.324+0000 7f044affd640 1 -- 172.21.15.6:0/1049056092 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04440a5b40 con 0x7f044c0ca750 2023-07-21T22:19:04.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.324+0000 7f044affd640 1 -- 172.21.15.6:0/1049056092 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04440ad440 con 0x7f044c0ca750 2023-07-21T22:19:04.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f0452648640 1 -- 172.21.15.6:0/1049056092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c0ca750 msgr2=0x7f044c0cabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f0452648640 1 --2- 172.21.15.6:0/1049056092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c0ca750 0x7f044c0cabd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0444009d90 tx=0x7f044401c920 comp rx=0 tx=0).stop 2023-07-21T22:19:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f0452648640 1 -- 172.21.15.6:0/1049056092 shutdown_connections 2023-07-21T22:19:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f0452648640 1 --2- 172.21.15.6:0/1049056092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c0ca750 0x7f044c0cabd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f0452648640 1 --2- 172.21.15.6:0/1049056092 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f044c06a540 0x7f044c06a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f0452648640 1 -- 172.21.15.6:0/1049056092 >> 172.21.15.6:0/1049056092 conn(0x7f044c099490 msgr2=0x7f044c089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f0452648640 1 -- 172.21.15.6:0/1049056092 shutdown_connections 2023-07-21T22:19:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f0452648640 1 -- 172.21.15.6:0/1049056092 wait complete. 2023-07-21T22:19:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f0452648640 1 Processor -- start 2023-07-21T22:19:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f0452648640 1 -- start start 2023-07-21T22:19:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f0452648640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f044c06a540 0x7f044c0accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f0452648640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c0ca750 0x7f044c15acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f0452648640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f044c0cdcd0 0x7f044c14d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f0452648640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c154940 con 0x7f044c0ca750 2023-07-21T22:19:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f0452648640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c157510 con 0x7f044c06a540 2023-07-21T22:19:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f0452648640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044c1577f0 con 0x7f044c0cdcd0 2023-07-21T22:19:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f044b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c0ca750 0x7f044c15acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f044b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c0ca750 0x7f044c15acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58524/0 (socket says 172.21.15.6:58524) 2023-07-21T22:19:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f044b7fe640 1 -- 172.21.15.6:0/3951948014 learned_addr learned my addr 172.21.15.6:0/3951948014 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f044bfff640 1 --2- 172.21.15.6:0/3951948014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f044c06a540 0x7f044c0accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f0450be5640 1 --2- 172.21.15.6:0/3951948014 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f044c0cdcd0 0x7f044c14d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f044b7fe640 1 -- 172.21.15.6:0/3951948014 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f044c0cdcd0 msgr2=0x7f044c14d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f044b7fe640 1 --2- 172.21.15.6:0/3951948014 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f044c0cdcd0 0x7f044c14d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.328+0000 7f044b7fe640 1 -- 172.21.15.6:0/3951948014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f044c06a540 msgr2=0x7f044c0accf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.332+0000 7f044b7fe640 1 --2- 172.21.15.6:0/3951948014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f044c06a540 0x7f044c0accf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.332+0000 7f044b7fe640 1 -- 172.21.15.6:0/3951948014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0444009a70 con 0x7f044c0ca750 2023-07-21T22:19:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.332+0000 7f044b7fe640 1 --2- 172.21.15.6:0/3951948014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c0ca750 0x7f044c15acc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f044000c4d0 tx=0x7f044000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.332+0000 7f0448ff9640 1 -- 172.21.15.6:0/3951948014 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0440005cf0 con 0x7f044c0ca750 2023-07-21T22:19:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.332+0000 7f0448ff9640 1 -- 172.21.15.6:0/3951948014 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0440005e50 con 0x7f044c0ca750 2023-07-21T22:19:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.332+0000 7f0448ff9640 1 -- 172.21.15.6:0/3951948014 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0440007270 con 0x7f044c0ca750 2023-07-21T22:19:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.332+0000 7f0452648640 1 -- 172.21.15.6:0/3951948014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f044c157ad0 con 0x7f044c0ca750 2023-07-21T22:19:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.332+0000 7f0452648640 1 -- 172.21.15.6:0/3951948014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044c14dac0 con 0x7f044c0ca750 2023-07-21T22:19:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.332+0000 7f0452648640 1 -- 172.21.15.6:0/3951948014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044c0678d0 con 0x7f044c0ca750 2023-07-21T22:19:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.332+0000 7f0448ff9640 1 -- 172.21.15.6:0/3951948014 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f04400073d0 con 0x7f044c0ca750 2023-07-21T22:19:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.332+0000 7f0448ff9640 1 --2- 172.21.15.6:0/3951948014 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0438066280 0x7f0438068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.332+0000 7f0448ff9640 1 -- 172.21.15.6:0/3951948014 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0440083260 con 0x7f044c0ca750 2023-07-21T22:19:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.332+0000 7f044bfff640 1 --2- 172.21.15.6:0/3951948014 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0438066280 0x7f0438068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.336+0000 7f044bfff640 1 --2- 172.21.15.6:0/3951948014 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0438066280 0x7f0438068730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f044c0d0ef0 tx=0x7f043c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:04.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.336+0000 7f0448ff9640 1 -- 172.21.15.6:0/3951948014 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0440050780 con 0x7f044c0ca750 2023-07-21T22:19:04.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.528+0000 7f0452648640 1 -- 172.21.15.6:0/3951948014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f044c1594e0 con 0x7f044c0ca750 2023-07-21T22:19:04.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.528+0000 7f0448ff9640 1 -- 172.21.15.6:0/3951948014 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f0440053da0 con 0x7f044c0ca750 2023-07-21T22:19:04.575 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:04.575 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3109831689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3109831689},{"type":"v1","addr":"172.21.15.6:6834","nonce":3109831689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/937908788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":937908788},{"type":"v1","addr":"172.21.15.161:6836","nonce":937908788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/445360801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":445360801},{"type":"v1","addr":"172.21.15.6:6835","nonce":445360801}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:18:43.722596+0000","modified":"2023-07-21T22:18:47.542628+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/747850146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":747850146},{"type":"v1","addr":"172.21.15.161:6837","nonce":747850146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:19:04.576 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-07-21T22:19:04.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.528+0000 7f0452648640 1 -- 172.21.15.6:0/3951948014 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0438066280 msgr2=0x7f0438068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:04.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.528+0000 7f0452648640 1 --2- 172.21.15.6:0/3951948014 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0438066280 0x7f0438068730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f044c0d0ef0 tx=0x7f043c008040 comp rx=0 tx=0).stop 2023-07-21T22:19:04.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.528+0000 7f0452648640 1 -- 172.21.15.6:0/3951948014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c0ca750 msgr2=0x7f044c15acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:04.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.528+0000 7f0452648640 1 --2- 172.21.15.6:0/3951948014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c0ca750 0x7f044c15acc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f044000c4d0 tx=0x7f044000c990 comp rx=0 tx=0).stop 2023-07-21T22:19:04.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.528+0000 7f0452648640 1 -- 172.21.15.6:0/3951948014 shutdown_connections 2023-07-21T22:19:04.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.528+0000 7f0452648640 1 --2- 172.21.15.6:0/3951948014 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f044c0cdcd0 0x7f044c14d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.528+0000 7f0452648640 1 --2- 172.21.15.6:0/3951948014 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0438066280 0x7f0438068730 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.528+0000 7f0452648640 1 --2- 172.21.15.6:0/3951948014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f044c0ca750 0x7f044c15acc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.528+0000 7f0452648640 1 --2- 172.21.15.6:0/3951948014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f044c06a540 0x7f044c0accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.528+0000 7f0452648640 1 -- 172.21.15.6:0/3951948014 >> 172.21.15.6:0/3951948014 conn(0x7f044c099490 msgr2=0x7f044c158ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:04.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.532+0000 7f0452648640 1 -- 172.21.15.6:0/3951948014 shutdown_connections 2023-07-21T22:19:04.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.532+0000 7f0452648640 1 -- 172.21.15.6:0/3951948014 wait complete. 2023-07-21T22:19:04.596 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:19:04.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.692+0000 7f2eb3434640 1 Processor -- start 2023-07-21T22:19:04.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.692+0000 7f2eb3434640 1 -- start start 2023-07-21T22:19:04.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.696+0000 7f2eb3434640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2eac070b70 0x7f2eac070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:04.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.696+0000 7f2eb3434640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2eac06b1e0 0x7f2eac0c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:04.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.696+0000 7f2eb3434640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eac0cac70 con 0x7f2eac0c21f0 2023-07-21T22:19:04.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.696+0000 7f2eb3434640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eac071480 con 0x7f2eac06b1e0 2023-07-21T22:19:04.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.696+0000 7f2eb3434640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0ca060 con 0x7f2eac070b70 2023-07-21T22:19:04.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.696+0000 7f2eb19d1640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2eac0c21f0 0x7f2eac0cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40012/0 (socket says 172.21.15.6:40012) 2023-07-21T22:19:04.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.696+0000 7f2eb19d1640 1 -- 172.21.15.6:0/1664444521 learned_addr learned my addr 172.21.15.6:0/1664444521 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:04.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.696+0000 7f2eb09cf640 1 --2- 172.21.15.6:0/1664444521 >> v2:172.21.15.161:3300/0 conn(0x7f2eac06b1e0 0x7f2eac0c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:04.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.696+0000 7f2eb11d0640 1 --2- 172.21.15.6:0/1664444521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2eac070b70 0x7f2eac070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:04.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.696+0000 7f2ea3fff640 1 -- 172.21.15.6:0/1664444521 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3218892574 0 0) 0x7f2eac0cac70 con 0x7f2eac0c21f0 2023-07-21T22:19:04.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.696+0000 7f2ea3fff640 1 -- 172.21.15.6:0/1664444521 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e98003530 con 0x7f2eac0c21f0 2023-07-21T22:19:04.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.696+0000 7f2eb09cf640 1 -- 172.21.15.6:0/1664444521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2eac070b70 msgr2=0x7f2eac070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:04.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.696+0000 7f2eb09cf640 1 --2- 172.21.15.6:0/1664444521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2eac070b70 0x7f2eac070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.696+0000 7f2eb09cf640 1 -- 172.21.15.6:0/1664444521 >> v1:172.21.15.6:6789/0 conn(0x7f2eac0c21f0 legacy=0x7f2eac0cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:04.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.696+0000 7f2eb09cf640 1 -- 172.21.15.6:0/1664444521 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac0ca340 con 0x7f2eac06b1e0 2023-07-21T22:19:04.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.700+0000 7f2eb09cf640 1 --2- 172.21.15.6:0/1664444521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eac06b1e0 0x7f2eac0c1cb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0097c0 tx=0x7f2e9c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78080b5a50245b07 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:04.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.700+0000 7f2ea3fff640 1 -- 172.21.15.6:0/1664444521 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c0ac620 con 0x7f2eac06b1e0 2023-07-21T22:19:04.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.700+0000 7f2ea3fff640 1 -- 172.21.15.6:0/1664444521 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9c0ac780 con 0x7f2eac06b1e0 2023-07-21T22:19:04.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.700+0000 7f2ea3fff640 1 -- 172.21.15.6:0/1664444521 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c0acb10 con 0x7f2eac06b1e0 2023-07-21T22:19:04.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.700+0000 7f2eb3434640 1 -- 172.21.15.6:0/1664444521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eac06b1e0 msgr2=0x7f2eac0c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:04.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.700+0000 7f2eb3434640 1 --2- 172.21.15.6:0/1664444521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eac06b1e0 0x7f2eac0c1cb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0097c0 tx=0x7f2e9c01c3c0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.700+0000 7f2eb3434640 1 -- 172.21.15.6:0/1664444521 shutdown_connections 2023-07-21T22:19:04.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.700+0000 7f2eb3434640 1 --2- 172.21.15.6:0/1664444521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eac06b1e0 0x7f2eac0c1cb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.700+0000 7f2eb3434640 1 --2- 172.21.15.6:0/1664444521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2eac070b70 0x7f2eac070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.700+0000 7f2eb3434640 1 -- 172.21.15.6:0/1664444521 >> 172.21.15.6:0/1664444521 conn(0x7f2eac0afcf0 msgr2=0x7f2eac0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:04.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.700+0000 7f2eb3434640 1 -- 172.21.15.6:0/1664444521 shutdown_connections 2023-07-21T22:19:04.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.700+0000 7f2eb3434640 1 -- 172.21.15.6:0/1664444521 wait complete. 2023-07-21T22:19:04.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.700+0000 7f2eb3434640 1 Processor -- start 2023-07-21T22:19:04.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.700+0000 7f2eb3434640 1 -- start start 2023-07-21T22:19:04.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.700+0000 7f2eb3434640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eac06b1e0 0x7f2eac151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:04.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2eb3434640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eac070b70 0x7f2eac157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:04.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2eb3434640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2eac0c21f0 0x7f2eac157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:04.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2eb3434640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0c5ca0 con 0x7f2eac070b70 2023-07-21T22:19:04.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2eb3434640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac1517a0 con 0x7f2eac06b1e0 2023-07-21T22:19:04.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2eb3434640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0c8be0 con 0x7f2eac0c21f0 2023-07-21T22:19:04.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2eb09cf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eac070b70 0x7f2eac157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:04.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2eb09cf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eac070b70 0x7f2eac157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58538/0 (socket says 172.21.15.6:58538) 2023-07-21T22:19:04.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2eb09cf640 1 -- 172.21.15.6:0/2645448430 learned_addr learned my addr 172.21.15.6:0/2645448430 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:04.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2eb11d0640 1 --2- 172.21.15.6:0/2645448430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eac06b1e0 0x7f2eac151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:04.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2eb19d1640 1 --2- 172.21.15.6:0/2645448430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2eac0c21f0 0x7f2eac157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:04.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2eb09cf640 1 -- 172.21.15.6:0/2645448430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2eac0c21f0 msgr2=0x7f2eac157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:04.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2eb09cf640 1 --2- 172.21.15.6:0/2645448430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2eac0c21f0 0x7f2eac157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2eb09cf640 1 -- 172.21.15.6:0/2645448430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eac06b1e0 msgr2=0x7f2eac151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:04.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2eb09cf640 1 --2- 172.21.15.6:0/2645448430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eac06b1e0 0x7f2eac151260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2eb09cf640 1 -- 172.21.15.6:0/2645448430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c009420 con 0x7f2eac070b70 2023-07-21T22:19:04.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2eb09cf640 1 --2- 172.21.15.6:0/2645448430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eac070b70 0x7f2eac157900 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0097c0 tx=0x7f2e9c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:04.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2ea1ffb640 1 -- 172.21.15.6:0/2645448430 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c0ac620 con 0x7f2eac070b70 2023-07-21T22:19:04.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2ea1ffb640 1 -- 172.21.15.6:0/2645448430 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9c0b5410 con 0x7f2eac070b70 2023-07-21T22:19:04.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2ea1ffb640 1 -- 172.21.15.6:0/2645448430 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c0b57c0 con 0x7f2eac070b70 2023-07-21T22:19:04.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2eb3434640 1 -- 172.21.15.6:0/2645448430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eac0c8620 con 0x7f2eac070b70 2023-07-21T22:19:04.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2eb3434640 1 -- 172.21.15.6:0/2645448430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eac0c58c0 con 0x7f2eac070b70 2023-07-21T22:19:04.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2eb3434640 1 -- 172.21.15.6:0/2645448430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eac06d570 con 0x7f2eac070b70 2023-07-21T22:19:04.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.704+0000 7f2ea1ffb640 1 -- 172.21.15.6:0/2645448430 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2e9c0b3040 con 0x7f2eac070b70 2023-07-21T22:19:04.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.708+0000 7f2ea1ffb640 1 --2- 172.21.15.6:0/2645448430 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2e90066280 0x7f2e90068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:04.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.708+0000 7f2ea1ffb640 1 -- 172.21.15.6:0/2645448430 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2e9c11dd50 con 0x7f2eac070b70 2023-07-21T22:19:04.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.708+0000 7f2eb11d0640 1 --2- 172.21.15.6:0/2645448430 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2e90066280 0x7f2e90068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:04.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.708+0000 7f2eb11d0640 1 --2- 172.21.15.6:0/2645448430 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2e90066280 0x7f2e90068730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0b1ee0 tx=0x7f2ea8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:04.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.712+0000 7f2ea1ffb640 1 -- 172.21.15.6:0/2645448430 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2eac06d570 con 0x7f2eac070b70 2023-07-21T22:19:04.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.868+0000 7f2eb3434640 1 -- 172.21.15.6:0/2645448430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2eac0c5de0 con 0x7f2eac070b70 2023-07-21T22:19:04.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.872+0000 7f2ea1ffb640 1 -- 172.21.15.6:0/2645448430 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18207 (secure 0 0 0) 0x7f2eac0c5de0 con 0x7f2eac070b70 2023-07-21T22:19:04.920 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:04.920 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:18:45.315608+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:18:41.465054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:18:42.709896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:19:04.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.876+0000 7f2eb3434640 1 -- 172.21.15.6:0/2645448430 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2e90066280 msgr2=0x7f2e90068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:04.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.876+0000 7f2eb3434640 1 --2- 172.21.15.6:0/2645448430 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2e90066280 0x7f2e90068730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0b1ee0 tx=0x7f2ea8009190 comp rx=0 tx=0).stop 2023-07-21T22:19:04.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.876+0000 7f2eb3434640 1 -- 172.21.15.6:0/2645448430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eac070b70 msgr2=0x7f2eac157900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:04.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.876+0000 7f2eb3434640 1 --2- 172.21.15.6:0/2645448430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eac070b70 0x7f2eac157900 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0097c0 tx=0x7f2e9c019160 comp rx=0 tx=0).stop 2023-07-21T22:19:04.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.876+0000 7f2eb3434640 1 -- 172.21.15.6:0/2645448430 shutdown_connections 2023-07-21T22:19:04.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.876+0000 7f2eb3434640 1 --2- 172.21.15.6:0/2645448430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2eac0c21f0 0x7f2eac157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.876+0000 7f2eb3434640 1 --2- 172.21.15.6:0/2645448430 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2e90066280 0x7f2e90068730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.876+0000 7f2eb3434640 1 --2- 172.21.15.6:0/2645448430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eac070b70 0x7f2eac157900 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.876+0000 7f2eb3434640 1 --2- 172.21.15.6:0/2645448430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eac06b1e0 0x7f2eac151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:04.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.876+0000 7f2eb3434640 1 -- 172.21.15.6:0/2645448430 >> 172.21.15.6:0/2645448430 conn(0x7f2eac0afcf0 msgr2=0x7f2eac0c4500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:04.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.876+0000 7f2eb3434640 1 -- 172.21.15.6:0/2645448430 shutdown_connections 2023-07-21T22:19:04.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:04.876+0000 7f2eb3434640 1 -- 172.21.15.6:0/2645448430 wait complete. 2023-07-21T22:19:04.941 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:19:05.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.040+0000 7fce04448640 1 Processor -- start 2023-07-21T22:19:05.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.040+0000 7fce04448640 1 -- start start 2023-07-21T22:19:05.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.040+0000 7fce04448640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdfc0d06b0 0x7fcdfc0b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.040+0000 7fce04448640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcdfc0b1f70 0x7fcdfc0d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.040+0000 7fce04448640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdfc0b2410 con 0x7fcdfc145430 2023-07-21T22:19:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.040+0000 7fce04448640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdfc0b26f0 con 0x7fcdfc0b1f70 2023-07-21T22:19:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.040+0000 7fce04448640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc0b29d0 con 0x7fcdfc0d06b0 2023-07-21T22:19:05.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.040+0000 7fce029e5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcdfc0b1f70 0x7fcdfc0d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.040+0000 7fce029e5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcdfc0b1f70 0x7fcdfc0d22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58550/0 (socket says 172.21.15.6:58550) 2023-07-21T22:19:05.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.040+0000 7fce029e5640 1 -- 172.21.15.6:0/3528602434 learned_addr learned my addr 172.21.15.6:0/3528602434 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:05.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.040+0000 7fce021e4640 1 --2- 172.21.15.6:0/3528602434 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdfc0d06b0 0x7fcdfc0b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.040+0000 7fce029e5640 1 -- 172.21.15.6:0/3528602434 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdfc0d06b0 msgr2=0x7fcdfc0b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:05.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.040+0000 7fce029e5640 1 --2- 172.21.15.6:0/3528602434 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdfc0d06b0 0x7fcdfc0b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.040+0000 7fce029e5640 1 -- 172.21.15.6:0/3528602434 >> v1:172.21.15.161:6789/0 conn(0x7fcdfc145430 legacy=0x7fcdfc0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:05.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.040+0000 7fce029e5640 1 -- 172.21.15.6:0/3528602434 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc0b2cb0 con 0x7fcdfc0b1f70 2023-07-21T22:19:05.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.040+0000 7fce021e4640 1 --2- 172.21.15.6:0/3528602434 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdfc0d06b0 0x7fcdfc0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.044+0000 7fce029e5640 1 --2- 172.21.15.6:0/3528602434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdfc0b1f70 0x7fcdfc0d22e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009e50 tx=0x7fcdf401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec44bfabf9f83035 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.044+0000 7fce011e2640 1 -- 172.21.15.6:0/3528602434 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40a57c0 con 0x7fcdfc0b1f70 2023-07-21T22:19:05.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.044+0000 7fce011e2640 1 -- 172.21.15.6:0/3528602434 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf40a5920 con 0x7fcdfc0b1f70 2023-07-21T22:19:05.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.044+0000 7fce011e2640 1 -- 172.21.15.6:0/3528602434 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40a5cb0 con 0x7fcdfc0b1f70 2023-07-21T22:19:05.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.044+0000 7fce04448640 1 -- 172.21.15.6:0/3528602434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdfc0b1f70 msgr2=0x7fcdfc0d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:05.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.044+0000 7fce04448640 1 --2- 172.21.15.6:0/3528602434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdfc0b1f70 0x7fcdfc0d22e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009e50 tx=0x7fcdf401c9e0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.044+0000 7fce04448640 1 -- 172.21.15.6:0/3528602434 shutdown_connections 2023-07-21T22:19:05.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.044+0000 7fce04448640 1 --2- 172.21.15.6:0/3528602434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdfc0b1f70 0x7fcdfc0d22e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.044+0000 7fce04448640 1 --2- 172.21.15.6:0/3528602434 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdfc0d06b0 0x7fcdfc0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.044+0000 7fce04448640 1 -- 172.21.15.6:0/3528602434 >> 172.21.15.6:0/3528602434 conn(0x7fcdfc0659d0 msgr2=0x7fcdfc09b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:05.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.044+0000 7fce04448640 1 -- 172.21.15.6:0/3528602434 shutdown_connections 2023-07-21T22:19:05.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.044+0000 7fce04448640 1 -- 172.21.15.6:0/3528602434 wait complete. 2023-07-21T22:19:05.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce04448640 1 Processor -- start 2023-07-21T22:19:05.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce04448640 1 -- start start 2023-07-21T22:19:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce04448640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdfc0b1f70 0x7fcdfc150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce04448640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdfc0d06b0 0x7fcdfc0b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce04448640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdfc0cf5b0 0x7fcdfc0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce04448640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc0c5120 con 0x7fcdfc0cf5b0 2023-07-21T22:19:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce04448640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc1545d0 con 0x7fcdfc0b1f70 2023-07-21T22:19:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce04448640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc0c4b30 con 0x7fcdfc0d06b0 2023-07-21T22:19:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce029e5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdfc0cf5b0 0x7fcdfc0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce029e5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdfc0cf5b0 0x7fcdfc0b56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58566/0 (socket says 172.21.15.6:58566) 2023-07-21T22:19:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce029e5640 1 -- 172.21.15.6:0/633141154 learned_addr learned my addr 172.21.15.6:0/633141154 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:05.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce021e4640 1 --2- 172.21.15.6:0/633141154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdfc0b1f70 0x7fcdfc150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce019e3640 1 --2- 172.21.15.6:0/633141154 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdfc0d06b0 0x7fcdfc0b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce029e5640 1 -- 172.21.15.6:0/633141154 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdfc0d06b0 msgr2=0x7fcdfc0b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:05.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce029e5640 1 --2- 172.21.15.6:0/633141154 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdfc0d06b0 0x7fcdfc0b5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce029e5640 1 -- 172.21.15.6:0/633141154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdfc0b1f70 msgr2=0x7fcdfc150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:05.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce029e5640 1 --2- 172.21.15.6:0/633141154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdfc0b1f70 0x7fcdfc150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce029e5640 1 -- 172.21.15.6:0/633141154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf4009b30 con 0x7fcdfc0cf5b0 2023-07-21T22:19:05.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce021e4640 1 --2- 172.21.15.6:0/633141154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdfc0b1f70 0x7fcdfc150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce029e5640 1 --2- 172.21.15.6:0/633141154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdfc0cf5b0 0x7fcdfc0b56c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcdf401a610 tx=0x7fcdf4019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fcdf2ffd640 1 -- 172.21.15.6:0/633141154 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40b8670 con 0x7fcdfc0cf5b0 2023-07-21T22:19:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fcdf2ffd640 1 -- 172.21.15.6:0/633141154 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf40b87d0 con 0x7fcdfc0cf5b0 2023-07-21T22:19:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fcdf2ffd640 1 -- 172.21.15.6:0/633141154 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40b8b40 con 0x7fcdfc0cf5b0 2023-07-21T22:19:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce04448640 1 -- 172.21.15.6:0/633141154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdfc0c4e40 con 0x7fcdfc0cf5b0 2023-07-21T22:19:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce04448640 1 -- 172.21.15.6:0/633141154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdfc150da0 con 0x7fcdfc0cf5b0 2023-07-21T22:19:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.048+0000 7fce04448640 1 -- 172.21.15.6:0/633141154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdfc072e70 con 0x7fcdfc0cf5b0 2023-07-21T22:19:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.052+0000 7fcdf2ffd640 1 -- 172.21.15.6:0/633141154 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcdf40b8ca0 con 0x7fcdfc0cf5b0 2023-07-21T22:19:05.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.052+0000 7fcdf2ffd640 1 --2- 172.21.15.6:0/633141154 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fcde0066280 0x7fcde0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.052+0000 7fcdf2ffd640 1 -- 172.21.15.6:0/633141154 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcdf411f2d0 con 0x7fcdfc0cf5b0 2023-07-21T22:19:05.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.052+0000 7fce021e4640 1 --2- 172.21.15.6:0/633141154 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fcde0066280 0x7fcde0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.052+0000 7fce021e4640 1 --2- 172.21.15.6:0/633141154 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fcde0066280 0x7fcde0068730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009970 tx=0x7fcdf8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:05.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.056+0000 7fcdf2ffd640 1 -- 172.21.15.6:0/633141154 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcdf40ec860 con 0x7fcdfc0cf5b0 2023-07-21T22:19:05.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.240+0000 7fce04448640 1 -- 172.21.15.6:0/633141154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcdfc15cbb0 con 0x7fcdfc0cf5b0 2023-07-21T22:19:05.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.240+0000 7fcdf2ffd640 1 -- 172.21.15.6:0/633141154 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7fcdfc15cbb0 con 0x7fcdfc0cf5b0 2023-07-21T22:19:05.290 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:05.290 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3109831689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3109831689},{"type":"v1","addr":"172.21.15.6:6834","nonce":3109831689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/937908788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":937908788},{"type":"v1","addr":"172.21.15.161:6836","nonce":937908788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/445360801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":445360801},{"type":"v1","addr":"172.21.15.6:6835","nonce":445360801}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:18:43.722596+0000","modified":"2023-07-21T22:18:47.542628+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/747850146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":747850146},{"type":"v1","addr":"172.21.15.161:6837","nonce":747850146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:19:05.292 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-07-21T22:19:05.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.244+0000 7fce04448640 1 -- 172.21.15.6:0/633141154 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fcde0066280 msgr2=0x7fcde0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:05.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.244+0000 7fce04448640 1 --2- 172.21.15.6:0/633141154 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fcde0066280 0x7fcde0068730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009970 tx=0x7fcdf8008040 comp rx=0 tx=0).stop 2023-07-21T22:19:05.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.244+0000 7fce04448640 1 -- 172.21.15.6:0/633141154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdfc0cf5b0 msgr2=0x7fcdfc0b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:05.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.244+0000 7fce04448640 1 --2- 172.21.15.6:0/633141154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdfc0cf5b0 0x7fcdfc0b56c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcdf401a610 tx=0x7fcdf4019780 comp rx=0 tx=0).stop 2023-07-21T22:19:05.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.244+0000 7fce04448640 1 -- 172.21.15.6:0/633141154 shutdown_connections 2023-07-21T22:19:05.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.244+0000 7fce04448640 1 --2- 172.21.15.6:0/633141154 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fcde0066280 0x7fcde0068730 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.244+0000 7fce04448640 1 --2- 172.21.15.6:0/633141154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdfc0cf5b0 0x7fcdfc0b56c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.244+0000 7fce04448640 1 --2- 172.21.15.6:0/633141154 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdfc0d06b0 0x7fcdfc0b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.244+0000 7fce04448640 1 --2- 172.21.15.6:0/633141154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdfc0b1f70 0x7fcdfc150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.244+0000 7fce04448640 1 -- 172.21.15.6:0/633141154 >> 172.21.15.6:0/633141154 conn(0x7fcdfc0659d0 msgr2=0x7fcdfc15fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:05.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.244+0000 7fce04448640 1 -- 172.21.15.6:0/633141154 shutdown_connections 2023-07-21T22:19:05.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.244+0000 7fce04448640 1 -- 172.21.15.6:0/633141154 wait complete. 2023-07-21T22:19:05.711 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T22:18:43.722596+0000', 'modified': '2023-07-21T22:18:47.542628+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.161:6837/747850146', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6834', 'nonce': 747850146}, {'type': 'v1', 'addr': '172.21.15.161:6837', 'nonce': 747850146}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T22:19:05.711 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T22:19:05.712 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-21T22:19:05.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.816+0000 7f14de4e6640 1 Processor -- start 2023-07-21T22:19:05.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.816+0000 7f14de4e6640 1 -- start start 2023-07-21T22:19:05.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.816+0000 7f14de4e6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14d806c430 0x7f14d80b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.816+0000 7f14de4e6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f14d806e160 0x7f14d8069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.816+0000 7f14de4e6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d80b24f0 con 0x7f14d80ae1f0 2023-07-21T22:19:05.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.816+0000 7f14de4e6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d80b27d0 con 0x7f14d806e160 2023-07-21T22:19:05.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.816+0000 7f14de4e6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80b2ab0 con 0x7f14d806c430 2023-07-21T22:19:05.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.820+0000 7f14dca83640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f14d806e160 0x7f14d8069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.820+0000 7f14d7fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f14d80ae1f0 0x7f14d806bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:40020/0 (socket says 172.21.15.6:40020) 2023-07-21T22:19:05.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.820+0000 7f14d7fff640 1 -- 172.21.15.6:0/1778355389 learned_addr learned my addr 172.21.15.6:0/1778355389 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:05.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.820+0000 7f14d77fe640 1 --2- 172.21.15.6:0/1778355389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14d806c430 0x7f14d80b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.820+0000 7f14dca83640 1 -- 172.21.15.6:0/1778355389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14d806c430 msgr2=0x7f14d80b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.820+0000 7f14dca83640 1 --2- 172.21.15.6:0/1778355389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14d806c430 0x7f14d80b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.820+0000 7f14dca83640 1 -- 172.21.15.6:0/1778355389 >> v1:172.21.15.6:6789/0 conn(0x7f14d80ae1f0 legacy=0x7f14d806bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.820+0000 7f14dca83640 1 -- 172.21.15.6:0/1778355389 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d80b2d90 con 0x7f14d806e160 2023-07-21T22:19:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.820+0000 7f14d6ffd640 1 -- 172.21.15.6:0/1778355389 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675284172 0 0) 0x7f14d80b24f0 con 0x7f14d80ae1f0 2023-07-21T22:19:05.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.820+0000 7f14dca83640 1 --2- 172.21.15.6:0/1778355389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d806e160 0x7f14d8069430 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f14d0009d90 tx=0x7f14d001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1704b7c391668246 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.820+0000 7f14d6ffd640 1 -- 172.21.15.6:0/1778355389 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d00a5970 con 0x7f14d806e160 2023-07-21T22:19:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.820+0000 7f14d6ffd640 1 -- 172.21.15.6:0/1778355389 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d00a5ad0 con 0x7f14d806e160 2023-07-21T22:19:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.820+0000 7f14d6ffd640 1 -- 172.21.15.6:0/1778355389 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d00a5e60 con 0x7f14d806e160 2023-07-21T22:19:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14de4e6640 1 -- 172.21.15.6:0/1778355389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d806e160 msgr2=0x7f14d8069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14de4e6640 1 --2- 172.21.15.6:0/1778355389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d806e160 0x7f14d8069430 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f14d0009d90 tx=0x7f14d001c920 comp rx=0 tx=0).stop 2023-07-21T22:19:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14de4e6640 1 -- 172.21.15.6:0/1778355389 shutdown_connections 2023-07-21T22:19:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14de4e6640 1 --2- 172.21.15.6:0/1778355389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d806e160 0x7f14d8069430 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14de4e6640 1 --2- 172.21.15.6:0/1778355389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14d806c430 0x7f14d80b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14de4e6640 1 -- 172.21.15.6:0/1778355389 >> 172.21.15.6:0/1778355389 conn(0x7f14d80b1300 msgr2=0x7f14d80ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14de4e6640 1 -- 172.21.15.6:0/1778355389 shutdown_connections 2023-07-21T22:19:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14de4e6640 1 -- 172.21.15.6:0/1778355389 wait complete. 2023-07-21T22:19:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14de4e6640 1 Processor -- start 2023-07-21T22:19:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14de4e6640 1 -- start start 2023-07-21T22:19:05.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14de4e6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d806c430 0x7f14d80af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14de4e6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14d806e160 0x7f14d80ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14de4e6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14d80ae1f0 0x7f14d80aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14de4e6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80ab1b0 con 0x7f14d806c430 2023-07-21T22:19:05.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14de4e6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80a7fc0 con 0x7f14d80ae1f0 2023-07-21T22:19:05.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14de4e6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d80a8260 con 0x7f14d806e160 2023-07-21T22:19:05.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14d7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d806c430 0x7f14d80af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14d7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d806c430 0x7f14d80af620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58584/0 (socket says 172.21.15.6:58584) 2023-07-21T22:19:05.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14d7fff640 1 -- 172.21.15.6:0/223647843 learned_addr learned my addr 172.21.15.6:0/223647843 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14d77fe640 1 --2- 172.21.15.6:0/223647843 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14d806e160 0x7f14d80ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14dca83640 1 --2- 172.21.15.6:0/223647843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14d80ae1f0 0x7f14d80aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14d7fff640 1 -- 172.21.15.6:0/223647843 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14d806e160 msgr2=0x7f14d80ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14d7fff640 1 --2- 172.21.15.6:0/223647843 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14d806e160 0x7f14d80ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14d7fff640 1 -- 172.21.15.6:0/223647843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14d80ae1f0 msgr2=0x7f14d80aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:05.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14d7fff640 1 --2- 172.21.15.6:0/223647843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14d80ae1f0 0x7f14d80aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14d7fff640 1 -- 172.21.15.6:0/223647843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d0009a70 con 0x7f14d806c430 2023-07-21T22:19:05.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.824+0000 7f14dca83640 1 --2- 172.21.15.6:0/223647843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14d80ae1f0 0x7f14d80aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:05.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.828+0000 7f14d7fff640 1 --2- 172.21.15.6:0/223647843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d806c430 0x7f14d80af620 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f14c800c480 tx=0x7f14c800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:05.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.828+0000 7f14d4ff9640 1 -- 172.21.15.6:0/223647843 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c80074e0 con 0x7f14d806c430 2023-07-21T22:19:05.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.828+0000 7f14d4ff9640 1 -- 172.21.15.6:0/223647843 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c8007660 con 0x7f14d806c430 2023-07-21T22:19:05.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.828+0000 7f14d4ff9640 1 -- 172.21.15.6:0/223647843 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8004a30 con 0x7f14d806c430 2023-07-21T22:19:05.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.828+0000 7f14de4e6640 1 -- 172.21.15.6:0/223647843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d80b3710 con 0x7f14d806c430 2023-07-21T22:19:05.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.828+0000 7f14de4e6640 1 -- 172.21.15.6:0/223647843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d80cb430 con 0x7f14d806c430 2023-07-21T22:19:05.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.828+0000 7f14d4ff9640 1 -- 172.21.15.6:0/223647843 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f14c8004b90 con 0x7f14d806c430 2023-07-21T22:19:05.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.828+0000 7f14d4ff9640 1 --2- 172.21.15.6:0/223647843 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f14c4066280 0x7f14c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.828+0000 7f14d4ff9640 1 -- 172.21.15.6:0/223647843 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f14c8082f30 con 0x7f14d806c430 2023-07-21T22:19:05.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14d77fe640 1 --2- 172.21.15.6:0/223647843 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f14c4066280 0x7f14c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14e1835000 1 Processor -- start 2023-07-21T22:19:05.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14e1835000 1 -- start start 2023-07-21T22:19:05.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14d77fe640 1 --2- 172.21.15.6:0/223647843 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f14c4066280 0x7f14c4068730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f14d80cd930 tx=0x7f14cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:05.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14e1835000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 0x55fb914662d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14e1835000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb91466810 0x55fb9141c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14e1835000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb9141c8b0 0x55fb9141cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14e1835000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb912e3880 con 0x55fb91465f00 2023-07-21T22:19:05.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14e1835000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9121d840 con 0x55fb91466810 2023-07-21T22:19:05.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14e1835000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb912712e0 con 0x55fb9141c8b0 2023-07-21T22:19:05.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14d7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 0x55fb914662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14d7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 0x55fb914662d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58588/0 (socket says 172.21.15.6:58588) 2023-07-21T22:19:05.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14d7fff640 1 -- 172.21.15.6:0/2766383766 learned_addr learned my addr 172.21.15.6:0/2766383766 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:05.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14d77fe640 1 --2- 172.21.15.6:0/2766383766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb91466810 0x55fb9141c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14dca83640 1 --2- 172.21.15.6:0/2766383766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb9141c8b0 0x55fb9141cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14d7fff640 1 -- 172.21.15.6:0/2766383766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb9141c8b0 msgr2=0x55fb9141cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:05.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14d7fff640 1 --2- 172.21.15.6:0/2766383766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb9141c8b0 0x55fb9141cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14d7fff640 1 -- 172.21.15.6:0/2766383766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb91466810 msgr2=0x55fb9141c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:05.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14d7fff640 1 --2- 172.21.15.6:0/2766383766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb91466810 0x55fb9141c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14d7fff640 1 -- 172.21.15.6:0/2766383766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb90f66890 con 0x55fb91465f00 2023-07-21T22:19:05.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14d7fff640 1 --2- 172.21.15.6:0/2766383766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 0x55fb914662d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f14c8050560 tx=0x7f14c8058160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe90ce59af7df48 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:05.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14be7fc640 1 -- 172.21.15.6:0/2766383766 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8001050 con 0x55fb91465f00 2023-07-21T22:19:05.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14be7fc640 1 -- 172.21.15.6:0/2766383766 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c8050770 con 0x55fb91465f00 2023-07-21T22:19:05.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14be7fc640 1 -- 172.21.15.6:0/2766383766 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8050050 con 0x55fb91465f00 2023-07-21T22:19:05.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14e1835000 1 -- 172.21.15.6:0/2766383766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 msgr2=0x55fb914662d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:05.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14e1835000 1 --2- 172.21.15.6:0/2766383766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 0x55fb914662d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f14c8050560 tx=0x7f14c8058160 comp rx=0 tx=0).stop 2023-07-21T22:19:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14e1835000 1 -- 172.21.15.6:0/2766383766 shutdown_connections 2023-07-21T22:19:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14e1835000 1 --2- 172.21.15.6:0/2766383766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb9141c8b0 0x55fb9141cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14e1835000 1 --2- 172.21.15.6:0/2766383766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb91466810 0x55fb9141c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14e1835000 1 --2- 172.21.15.6:0/2766383766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 0x55fb914662d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14e1835000 1 -- 172.21.15.6:0/2766383766 >> 172.21.15.6:0/2766383766 conn(0x55fb91422a10 msgr2=0x55fb9141ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14e1835000 1 -- 172.21.15.6:0/2766383766 shutdown_connections 2023-07-21T22:19:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14e1835000 1 -- 172.21.15.6:0/2766383766 wait complete. 2023-07-21T22:19:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14e1835000 1 -- start start 2023-07-21T22:19:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.832+0000 7f14e1835000 1 Processor -- start 2023-07-21T22:19:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14e1835000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb9141c8b0 0x55fb9146d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14e1835000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb91465f00 0x55fb9146d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14e1835000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb91466810 0x55fb914274f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14e1835000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9126a380 con 0x55fb9141c8b0 2023-07-21T22:19:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14e1835000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb91226ae0 con 0x55fb91465f00 2023-07-21T22:19:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14e1835000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb91226780 con 0x55fb91466810 2023-07-21T22:19:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14e1835000 10 client.0 _ll_register_callbacks cb 0x55fb91408240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14d7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb9141c8b0 0x55fb9146d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14d7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb9141c8b0 0x55fb9146d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58592/0 (socket says 172.21.15.6:58592) 2023-07-21T22:19:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14d7fff640 1 -- 172.21.15.6:0/2770055210 learned_addr learned my addr 172.21.15.6:0/2770055210 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14d77fe640 1 --2- 172.21.15.6:0/2770055210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb91465f00 0x55fb9146d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14d7fff640 1 -- 172.21.15.6:0/2770055210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb91466810 msgr2=0x55fb914274f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14dca83640 1 --2- 172.21.15.6:0/2770055210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb91466810 0x55fb914274f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14d7fff640 1 --2- 172.21.15.6:0/2770055210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb91466810 0x55fb914274f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14d7fff640 1 -- 172.21.15.6:0/2770055210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb91465f00 msgr2=0x55fb9146d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14d7fff640 1 --2- 172.21.15.6:0/2770055210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb91465f00 0x55fb9146d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14d7fff640 1 -- 172.21.15.6:0/2770055210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d80cb430 con 0x55fb9141c8b0 2023-07-21T22:19:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14d77fe640 1 --2- 172.21.15.6:0/2770055210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb91465f00 0x55fb9146d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14dca83640 1 --2- 172.21.15.6:0/2770055210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb91466810 0x55fb914274f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14d7fff640 1 --2- 172.21.15.6:0/2770055210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb9141c8b0 0x55fb9146d030 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f14c8050560 tx=0x7f14c8057040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9465b687f1d0bf13 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:19:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14b6ffd640 1 -- 172.21.15.6:0/2770055210 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c8052fc0 con 0x55fb9141c8b0 2023-07-21T22:19:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14b6ffd640 1 -- 172.21.15.6:0/2770055210 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f14c8053120 con 0x55fb9141c8b0 2023-07-21T22:19:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14e1835000 1 -- 172.21.15.6:0/2770055210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb91231a20 con 0x55fb9141c8b0 2023-07-21T22:19:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14b6ffd640 1 -- 172.21.15.6:0/2770055210 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14c80532e0 con 0x55fb9141c8b0 2023-07-21T22:19:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14e1835000 10 client.4716 fetch_fsmap learned FSMap version 8 2023-07-21T22:19:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14e1835000 1 -- 172.21.15.6:0/2770055210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55fb9122ed10 con 0x55fb9141c8b0 2023-07-21T22:19:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14b6ffd640 1 -- 172.21.15.6:0/2770055210 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fb91231a20 con 0x55fb9141c8b0 2023-07-21T22:19:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14b6ffd640 1 -- 172.21.15.6:0/2770055210 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f14c806ba30 con 0x55fb9141c8b0 2023-07-21T22:19:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14e1835000 10 client.4716 fetch_fsmap finished waiting for FSMap version 8 2023-07-21T22:19:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14e1835000 10 client.4716 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-21T22:19:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14e1835000 20 client.4716 populate_metadata read hostname 'smithi006' 2023-07-21T22:19:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14e1835000 1 --2- 172.21.15.6:0/2770055210 >> [v2:172.21.15.161:6834/747850146,v1:172.21.15.161:6837/747850146] conn(0x55fb91428290 0x55fb91428660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14e1835000 4 client.4716 mds_command: new command op to 4294 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:19:05.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14e1835000 1 -- 172.21.15.6:0/2770055210 --> [v2:172.21.15.161:6834/747850146,v1:172.21.15.161:6837/747850146] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fb91298ec0 con 0x55fb91428290 2023-07-21T22:19:05.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14d77fe640 1 --2- 172.21.15.6:0/2770055210 >> [v2:172.21.15.161:6834/747850146,v1:172.21.15.161:6837/747850146] conn(0x55fb91428290 0x55fb91428660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14d77fe640 1 --2- 172.21.15.6:0/2770055210 >> [v2:172.21.15.161:6834/747850146,v1:172.21.15.161:6837/747850146] conn(0x55fb91428290 0x55fb91428660 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f40920b436639e22 server_cookie=7fba45e93da07d42 in_seq=0 out_seq=0 2023-07-21T22:19:05.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.836+0000 7f14b6ffd640 10 client.4716 ms_handle_connect on v2:172.21.15.161:6834/747850146 2023-07-21T22:19:05.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.840+0000 7f14b6ffd640 1 -- 172.21.15.6:0/2770055210 <== mds.0 v2:172.21.15.161:6834/747850146 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55fb91298ec0 con 0x55fb91428290 2023-07-21T22:19:05.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.840+0000 7f14b6ffd640 10 client.4716 handle_command_reply: tid=0 2023-07-21T22:19:05.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.840+0000 7f14e1835000 1 client.4716 shutdown 2023-07-21T22:19:05.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.840+0000 7f14e1835000 1 -- 172.21.15.6:0/2770055210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb9141c8b0 msgr2=0x55fb9146d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.840+0000 7f14e1835000 1 --2- 172.21.15.6:0/2770055210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb9141c8b0 0x55fb9146d030 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f14c8050560 tx=0x7f14c8057040 comp rx=0 tx=0).stop 2023-07-21T22:19:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.840+0000 7f14e1835000 1 -- 172.21.15.6:0/2770055210 shutdown_connections 2023-07-21T22:19:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.840+0000 7f14e1835000 1 --2- 172.21.15.6:0/2770055210 >> [v2:172.21.15.161:6834/747850146,v1:172.21.15.161:6837/747850146] conn(0x55fb91428290 0x55fb91428660 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.840+0000 7f14e1835000 1 --2- 172.21.15.6:0/2770055210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb91466810 0x55fb914274f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.840+0000 7f14e1835000 1 --2- 172.21.15.6:0/2770055210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb91465f00 0x55fb9146d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.840+0000 7f14e1835000 1 --2- 172.21.15.6:0/2770055210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb9141c8b0 0x55fb9146d030 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.840+0000 7f14b6ffd640 0 client.4716 ms_handle_reset on v2:172.21.15.161:6834/747850146 2023-07-21T22:19:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.840+0000 7f14e1835000 1 -- 172.21.15.6:0/2770055210 >> 172.21.15.6:0/2770055210 conn(0x55fb91422a10 msgr2=0x55fb9141b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.840+0000 7f14e1835000 1 -- 172.21.15.6:0/2770055210 shutdown_connections 2023-07-21T22:19:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.840+0000 7f14e1835000 1 -- 172.21.15.6:0/2770055210 wait complete. 2023-07-21T22:19:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.840+0000 7f14e1835000 20 client.4716 trim_cache size 0 max 16384 2023-07-21T22:19:05.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14e1835000 1 Processor -- start 2023-07-21T22:19:05.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14e1835000 1 -- start start 2023-07-21T22:19:05.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14e1835000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb9141c8b0 0x55fb914bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14e1835000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 0x55fb914c0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14e1835000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb91466810 0x55fb914c0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14e1835000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb90f27940 con 0x55fb91465f00 2023-07-21T22:19:05.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14e1835000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb91272570 con 0x55fb91466810 2023-07-21T22:19:05.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14e1835000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb91226780 con 0x55fb9141c8b0 2023-07-21T22:19:05.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14d77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 0x55fb914c0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14d77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 0x55fb914c0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58598/0 (socket says 172.21.15.6:58598) 2023-07-21T22:19:05.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14d77fe640 1 -- 172.21.15.6:0/2492891738 learned_addr learned my addr 172.21.15.6:0/2492891738 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:05.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14dca83640 1 --2- 172.21.15.6:0/2492891738 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb91466810 0x55fb914c0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14d7fff640 1 --2- 172.21.15.6:0/2492891738 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb9141c8b0 0x55fb914bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14d77fe640 1 -- 172.21.15.6:0/2492891738 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb9141c8b0 msgr2=0x55fb914bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:05.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14d77fe640 1 --2- 172.21.15.6:0/2492891738 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb9141c8b0 0x55fb914bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14d77fe640 1 -- 172.21.15.6:0/2492891738 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb91466810 msgr2=0x55fb914c0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:05.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14d77fe640 1 --2- 172.21.15.6:0/2492891738 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb91466810 0x55fb914c0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14d77fe640 1 -- 172.21.15.6:0/2492891738 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb9141ef80 con 0x55fb91465f00 2023-07-21T22:19:05.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14dca83640 1 --2- 172.21.15.6:0/2492891738 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb91466810 0x55fb914c0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:05.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14d77fe640 1 --2- 172.21.15.6:0/2492891738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 0x55fb914c0220 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f14d80ab860 tx=0x7f14cc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becb05fd8ac38652 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:05.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14beffd640 1 -- 172.21.15.6:0/2492891738 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc028070 con 0x55fb91465f00 2023-07-21T22:19:05.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14beffd640 1 -- 172.21.15.6:0/2492891738 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc029c40 con 0x55fb91465f00 2023-07-21T22:19:05.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14beffd640 1 -- 172.21.15.6:0/2492891738 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc029dd0 con 0x55fb91465f00 2023-07-21T22:19:05.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14e1835000 1 -- 172.21.15.6:0/2492891738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 msgr2=0x55fb914c0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:05.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14e1835000 1 --2- 172.21.15.6:0/2492891738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 0x55fb914c0220 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f14d80ab860 tx=0x7f14cc014000 comp rx=0 tx=0).stop 2023-07-21T22:19:05.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14e1835000 1 -- 172.21.15.6:0/2492891738 shutdown_connections 2023-07-21T22:19:05.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14e1835000 1 --2- 172.21.15.6:0/2492891738 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb91466810 0x55fb914c0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14e1835000 1 --2- 172.21.15.6:0/2492891738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 0x55fb914c0220 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14e1835000 1 --2- 172.21.15.6:0/2492891738 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb9141c8b0 0x55fb914bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14e1835000 1 -- 172.21.15.6:0/2492891738 >> 172.21.15.6:0/2492891738 conn(0x55fb91422a10 msgr2=0x55fb91420970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:05.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14e1835000 1 -- 172.21.15.6:0/2492891738 shutdown_connections 2023-07-21T22:19:05.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14e1835000 1 -- 172.21.15.6:0/2492891738 wait complete. 2023-07-21T22:19:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.856+0000 7f14e1835000 1 -- start start 2023-07-21T22:19:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14e1835000 1 Processor -- start 2023-07-21T22:19:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14e1835000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb9141c8b0 0x55fb9146a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14e1835000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 0x55fb9146ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14e1835000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb91466810 0x55fb9146b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14e1835000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb91267b90 con 0x55fb91465f00 2023-07-21T22:19:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14e1835000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb914732e0 con 0x55fb9141c8b0 2023-07-21T22:19:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14e1835000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb91207a80 con 0x55fb91466810 2023-07-21T22:19:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14e1835000 10 client.0 _ll_register_callbacks cb 0x55fb913e8430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14d77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 0x55fb9146ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14d77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 0x55fb9146ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58608/0 (socket says 172.21.15.6:58608) 2023-07-21T22:19:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14d77fe640 1 -- 172.21.15.6:0/2349795456 learned_addr learned my addr 172.21.15.6:0/2349795456 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14d7fff640 1 --2- 172.21.15.6:0/2349795456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb9141c8b0 0x55fb9146a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14dca83640 1 --2- 172.21.15.6:0/2349795456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb91466810 0x55fb9146b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14d77fe640 1 -- 172.21.15.6:0/2349795456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb91466810 msgr2=0x55fb9146b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14d77fe640 1 --2- 172.21.15.6:0/2349795456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb91466810 0x55fb9146b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14d77fe640 1 -- 172.21.15.6:0/2349795456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb9141c8b0 msgr2=0x55fb9146a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14d77fe640 1 --2- 172.21.15.6:0/2349795456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb9141c8b0 0x55fb9146a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14d77fe640 1 -- 172.21.15.6:0/2349795456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14cc009820 con 0x55fb91465f00 2023-07-21T22:19:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14dca83640 1 --2- 172.21.15.6:0/2349795456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb91466810 0x55fb9146b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:05.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14d77fe640 1 --2- 172.21.15.6:0/2349795456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 0x55fb9146ad60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f14cc02d040 tx=0x7f14cc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778d067d3917dba7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:05.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:19:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14b6ffd640 1 -- 172.21.15.6:0/2349795456 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc029550 con 0x55fb91465f00 2023-07-21T22:19:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14b6ffd640 1 -- 172.21.15.6:0/2349795456 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f14cc033440 con 0x55fb91465f00 2023-07-21T22:19:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14e1835000 1 -- 172.21.15.6:0/2349795456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb91268cd0 con 0x55fb91465f00 2023-07-21T22:19:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14b6ffd640 1 -- 172.21.15.6:0/2349795456 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14cc033640 con 0x55fb91465f00 2023-07-21T22:19:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14e1835000 10 client.4722 fetch_fsmap learned FSMap version 8 2023-07-21T22:19:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14e1835000 1 -- 172.21.15.6:0/2349795456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55fb91214fa0 con 0x55fb91465f00 2023-07-21T22:19:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14b6ffd640 1 -- 172.21.15.6:0/2349795456 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fb91268cd0 con 0x55fb91465f00 2023-07-21T22:19:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14b6ffd640 1 -- 172.21.15.6:0/2349795456 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f14cc021040 con 0x55fb91465f00 2023-07-21T22:19:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14e1835000 10 client.4722 fetch_fsmap finished waiting for FSMap version 8 2023-07-21T22:19:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14e1835000 10 client.4722 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-21T22:19:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14e1835000 20 client.4722 populate_metadata read hostname 'smithi006' 2023-07-21T22:19:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14e1835000 1 --2- 172.21.15.6:0/2349795456 >> [v2:172.21.15.161:6834/747850146,v1:172.21.15.161:6837/747850146] conn(0x55fb9146bc00 0x55fb914cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14e1835000 4 client.4722 mds_command: new command op to 4294 tid=0[{"prefix": "status"}] 2023-07-21T22:19:05.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14e1835000 1 -- 172.21.15.6:0/2349795456 --> [v2:172.21.15.161:6834/747850146,v1:172.21.15.161:6837/747850146] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fb91263360 con 0x55fb9146bc00 2023-07-21T22:19:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14d7fff640 1 --2- 172.21.15.6:0/2349795456 >> [v2:172.21.15.161:6834/747850146,v1:172.21.15.161:6837/747850146] conn(0x55fb9146bc00 0x55fb914cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14b6ffd640 10 client.4722 ms_handle_connect on v2:172.21.15.161:6834/747850146 2023-07-21T22:19:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.860+0000 7f14d7fff640 1 --2- 172.21.15.6:0/2349795456 >> [v2:172.21.15.161:6834/747850146,v1:172.21.15.161:6837/747850146] conn(0x55fb9146bc00 0x55fb914cbf70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6ac9a4f20ddd067 server_cookie=5acbc76805f33fcb in_seq=0 out_seq=0 2023-07-21T22:19:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14b6ffd640 1 -- 172.21.15.6:0/2349795456 <== mds.0 v2:172.21.15.161:6834/747850146 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55fb91263360 con 0x55fb9146bc00 2023-07-21T22:19:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14b6ffd640 10 client.4722 handle_command_reply: tid=0 2023-07-21T22:19:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14e1835000 1 client.4722 shutdown 2023-07-21T22:19:05.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14e1835000 1 -- 172.21.15.6:0/2349795456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 msgr2=0x55fb9146ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14e1835000 1 --2- 172.21.15.6:0/2349795456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 0x55fb9146ad60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f14cc02d040 tx=0x7f14cc004740 comp rx=0 tx=0).stop 2023-07-21T22:19:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14e1835000 1 -- 172.21.15.6:0/2349795456 shutdown_connections 2023-07-21T22:19:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14e1835000 1 --2- 172.21.15.6:0/2349795456 >> [v2:172.21.15.161:6834/747850146,v1:172.21.15.161:6837/747850146] conn(0x55fb9146bc00 0x55fb914cbf70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14e1835000 1 --2- 172.21.15.6:0/2349795456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55fb91466810 0x55fb9146b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14e1835000 1 --2- 172.21.15.6:0/2349795456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb91465f00 0x55fb9146ad60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14e1835000 1 --2- 172.21.15.6:0/2349795456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55fb9141c8b0 0x55fb9146a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14b6ffd640 0 client.4722 ms_handle_reset on v2:172.21.15.161:6834/747850146 2023-07-21T22:19:05.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14e1835000 1 -- 172.21.15.6:0/2349795456 >> 172.21.15.6:0/2349795456 conn(0x55fb91422a10 msgr2=0x55fb91421200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:05.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14e1835000 1 -- 172.21.15.6:0/2349795456 shutdown_connections 2023-07-21T22:19:05.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14e1835000 1 -- 172.21.15.6:0/2349795456 wait complete. 2023-07-21T22:19:05.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14e1835000 20 client.4722 trim_cache size 0 max 16384 2023-07-21T22:19:05.918 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:19:05.918 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "f3073df4-6cd1-4503-bd2e-d3e98fa18bdf", 2023-07-21T22:19:05.919 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-07-21T22:19:05.919 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4294, 2023-07-21T22:19:05.919 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-07-21T22:19:05.919 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-07-21T22:19:05.919 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-07-21T22:19:05.919 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 21.336474089999999, 2023-07-21T22:19:05.919 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 8, 2023-07-21T22:19:05.920 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 26, 2023-07-21T22:19:05.920 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 26, 2023-07-21T22:19:05.920 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 27.437177054999999 2023-07-21T22:19:05.920 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:19:05.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14de4e6640 1 -- 172.21.15.6:0/223647843 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f14c4066280 msgr2=0x7f14c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:05.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14de4e6640 1 --2- 172.21.15.6:0/223647843 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f14c4066280 0x7f14c4068730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f14d80cd930 tx=0x7f14cc008040 comp rx=0 tx=0).stop 2023-07-21T22:19:05.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14de4e6640 1 -- 172.21.15.6:0/223647843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d806c430 msgr2=0x7f14d80af620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:05.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14de4e6640 1 --2- 172.21.15.6:0/223647843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d806c430 0x7f14d80af620 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f14c800c480 tx=0x7f14c800c940 comp rx=0 tx=0).stop 2023-07-21T22:19:05.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14de4e6640 1 -- 172.21.15.6:0/223647843 shutdown_connections 2023-07-21T22:19:05.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14de4e6640 1 --2- 172.21.15.6:0/223647843 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14d80ae1f0 0x7f14d80aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14de4e6640 1 --2- 172.21.15.6:0/223647843 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14d806e160 0x7f14d80ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14de4e6640 1 --2- 172.21.15.6:0/223647843 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f14c4066280 0x7f14c4068730 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14de4e6640 1 --2- 172.21.15.6:0/223647843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d806c430 0x7f14d80af620 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:05.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14de4e6640 1 -- 172.21.15.6:0/223647843 >> 172.21.15.6:0/223647843 conn(0x7f14d80b1300 msgr2=0x7f14d80ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:05.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14de4e6640 1 -- 172.21.15.6:0/223647843 shutdown_connections 2023-07-21T22:19:05.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:05.864+0000 7f14de4e6640 1 -- 172.21.15.6:0/223647843 wait complete. 2023-07-21T22:19:05.929 INFO:teuthology.run_tasks:Running task kclient... 2023-07-21T22:19:05.951 INFO:tasks.kclient:Mounting kernel clients... 2023-07-21T22:19:05.952 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-07-21T22:19:05.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:05.953 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T22:19:05.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:05.963 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-07-21T22:19:06.033 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2023-07-21T22:19:06.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:19:06.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:06.036 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T22:19:06.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:06.086 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-07-21T22:19:06.156 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2023-07-21T22:19:06.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:19:06.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:06.159 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-07-21T22:19:06.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:06.170 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2023-07-21T22:19:06.242 INFO:teuthology.orchestra.run.smithi161.stderr:Cannot find device "ceph-brx" 2023-07-21T22:19:06.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:19:06.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:06.246 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-07-21T22:19:06.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:06.298 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2023-07-21T22:19:06.365 INFO:teuthology.orchestra.run.smithi161.stderr:Cannot find device "ceph-brx" 2023-07-21T22:19:06.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:19:06.367 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-07-21T22:19:06.368 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-21T22:19:06.368 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T22:19:06.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:19:06.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.468+0000 7fa64b100640 1 Processor -- start 2023-07-21T22:19:06.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.468+0000 7fa64b100640 1 -- start start 2023-07-21T22:19:06.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.468+0000 7fa64b100640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa6440b7c70 0x7fa6440d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:06.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.468+0000 7fa64b100640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa64415fd60 0x7fa6440d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:06.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.468+0000 7fa64b100640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6440ccaf0 con 0x7fa6440d1850 2023-07-21T22:19:06.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.468+0000 7fa64b100640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6440d1190 con 0x7fa6440b7c70 2023-07-21T22:19:06.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.468+0000 7fa64b100640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa644160600 con 0x7fa64415fd60 2023-07-21T22:19:06.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.468+0000 7fa648e9c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa6440b7c70 0x7fa6440d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:06.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.468+0000 7fa64969d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa64415fd60 0x7fa6440d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:06.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.468+0000 7fa648e9c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa6440b7c70 0x7fa6440d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:36110/0 (socket says 172.21.15.6:36110) 2023-07-21T22:19:06.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.468+0000 7fa648e9c640 1 -- 172.21.15.6:0/1136361819 learned_addr learned my addr 172.21.15.6:0/1136361819 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:06.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.468+0000 7fa648e9c640 1 -- 172.21.15.6:0/1136361819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa64415fd60 msgr2=0x7fa6440d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:06.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.468+0000 7fa648e9c640 1 --2- 172.21.15.6:0/1136361819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa64415fd60 0x7fa6440d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:06.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.468+0000 7fa648e9c640 1 -- 172.21.15.6:0/1136361819 >> v1:172.21.15.161:6789/0 conn(0x7fa6440d1850 legacy=0x7fa64415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:06.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.468+0000 7fa648e9c640 1 -- 172.21.15.6:0/1136361819 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa644160320 con 0x7fa6440b7c70 2023-07-21T22:19:06.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.468+0000 7fa64969d640 1 --2- 172.21.15.6:0/1136361819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa64415fd60 0x7fa6440d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:06.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.468+0000 7fa6437fe640 1 -- 172.21.15.6:0/1136361819 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170827519 0 0) 0x7fa6440ccaf0 con 0x7fa6440d1850 2023-07-21T22:19:06.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.472+0000 7fa648e9c640 1 --2- 172.21.15.6:0/1136361819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6440b7c70 0x7fa6440d0c50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa638009870 tx=0x7fa63801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4abbb2e126cc2b4b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:06.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.472+0000 7fa6437fe640 1 -- 172.21.15.6:0/1136361819 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6380a95f0 con 0x7fa6440b7c70 2023-07-21T22:19:06.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.472+0000 7fa6437fe640 1 -- 172.21.15.6:0/1136361819 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6380a9750 con 0x7fa6440b7c70 2023-07-21T22:19:06.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.472+0000 7fa6437fe640 1 -- 172.21.15.6:0/1136361819 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6380a9ae0 con 0x7fa6440b7c70 2023-07-21T22:19:06.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.472+0000 7fa64b100640 1 -- 172.21.15.6:0/1136361819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6440b7c70 msgr2=0x7fa6440d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:06.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.472+0000 7fa64b100640 1 --2- 172.21.15.6:0/1136361819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6440b7c70 0x7fa6440d0c50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa638009870 tx=0x7fa63801c510 comp rx=0 tx=0).stop 2023-07-21T22:19:06.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.472+0000 7fa64b100640 1 -- 172.21.15.6:0/1136361819 shutdown_connections 2023-07-21T22:19:06.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.472+0000 7fa64b100640 1 --2- 172.21.15.6:0/1136361819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa64415fd60 0x7fa6440d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:06.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.472+0000 7fa64b100640 1 --2- 172.21.15.6:0/1136361819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6440b7c70 0x7fa6440d0c50 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:06.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.472+0000 7fa64b100640 1 -- 172.21.15.6:0/1136361819 >> 172.21.15.6:0/1136361819 conn(0x7fa6440650b0 msgr2=0x7fa6440654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:06.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.472+0000 7fa64b100640 1 -- 172.21.15.6:0/1136361819 shutdown_connections 2023-07-21T22:19:06.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.472+0000 7fa64b100640 1 -- 172.21.15.6:0/1136361819 wait complete. 2023-07-21T22:19:06.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa64b100640 1 Processor -- start 2023-07-21T22:19:06.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa64b100640 1 -- start start 2023-07-21T22:19:06.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa64b100640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6440b7c70 0x7fa6440c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:06.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa64b100640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6440d1850 0x7fa6440c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:06.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa64b100640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa64415fd60 0x7fa64414c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:06.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa64b100640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64414ca40 con 0x7fa6440b7c70 2023-07-21T22:19:06.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa64b100640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa644157b70 con 0x7fa6440d1850 2023-07-21T22:19:06.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa64b100640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6440c8110 con 0x7fa64415fd60 2023-07-21T22:19:06.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa648e9c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6440b7c70 0x7fa6440c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:06.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa648e9c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6440b7c70 0x7fa6440c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58618/0 (socket says 172.21.15.6:58618) 2023-07-21T22:19:06.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa648e9c640 1 -- 172.21.15.6:0/3907509306 learned_addr learned my addr 172.21.15.6:0/3907509306 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:06.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa643fff640 1 --2- 172.21.15.6:0/3907509306 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6440d1850 0x7fa6440c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:06.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa64969d640 1 --2- 172.21.15.6:0/3907509306 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa64415fd60 0x7fa64414c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:06.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa648e9c640 1 -- 172.21.15.6:0/3907509306 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa64415fd60 msgr2=0x7fa64414c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:06.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa648e9c640 1 --2- 172.21.15.6:0/3907509306 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa64415fd60 0x7fa64414c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:06.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa648e9c640 1 -- 172.21.15.6:0/3907509306 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6440d1850 msgr2=0x7fa6440c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:06.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa648e9c640 1 --2- 172.21.15.6:0/3907509306 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6440d1850 0x7fa6440c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:06.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa648e9c640 1 -- 172.21.15.6:0/3907509306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c009a70 con 0x7fa6440b7c70 2023-07-21T22:19:06.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa648e9c640 1 --2- 172.21.15.6:0/3907509306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6440b7c70 0x7fa6440c6f00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa63801a140 tx=0x7fa6380192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:06.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa6417fa640 1 -- 172.21.15.6:0/3907509306 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa638004220 con 0x7fa6440b7c70 2023-07-21T22:19:06.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa6417fa640 1 -- 172.21.15.6:0/3907509306 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa638004380 con 0x7fa6440b7c70 2023-07-21T22:19:06.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa6417fa640 1 -- 172.21.15.6:0/3907509306 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa638003820 con 0x7fa6440b7c70 2023-07-21T22:19:06.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa64b100640 1 -- 172.21.15.6:0/3907509306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6380094d0 con 0x7fa6440b7c70 2023-07-21T22:19:06.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa64b100640 1 -- 172.21.15.6:0/3907509306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6440c77e0 con 0x7fa6440b7c70 2023-07-21T22:19:06.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.476+0000 7fa64b100640 1 -- 172.21.15.6:0/3907509306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6440678d0 con 0x7fa6440b7c70 2023-07-21T22:19:06.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.480+0000 7fa6417fa640 1 -- 172.21.15.6:0/3907509306 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa638003980 con 0x7fa6440b7c70 2023-07-21T22:19:06.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.480+0000 7fa6417fa640 1 --2- 172.21.15.6:0/3907509306 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa628066280 0x7fa628068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:06.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.480+0000 7fa6417fa640 1 -- 172.21.15.6:0/3907509306 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa63811dbe0 con 0x7fa6440b7c70 2023-07-21T22:19:06.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.480+0000 7fa643fff640 1 --2- 172.21.15.6:0/3907509306 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa628066280 0x7fa628068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:06.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.480+0000 7fa643fff640 1 --2- 172.21.15.6:0/3907509306 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa628066280 0x7fa628068730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa64415f050 tx=0x7fa630009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:06.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.484+0000 7fa6417fa640 1 -- 172.21.15.6:0/3907509306 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa6380eb050 con 0x7fa6440b7c70 2023-07-21T22:19:06.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.672+0000 7fa64b100640 1 -- 172.21.15.6:0/3907509306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa6440d1f40 con 0x7fa6440b7c70 2023-07-21T22:19:06.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.672+0000 7fa6417fa640 1 -- 172.21.15.6:0/3907509306 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa6380044f0 con 0x7fa6440b7c70 2023-07-21T22:19:06.718 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T22:19:06.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.672+0000 7fa64b100640 1 -- 172.21.15.6:0/3907509306 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa628066280 msgr2=0x7fa628068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:06.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.672+0000 7fa64b100640 1 --2- 172.21.15.6:0/3907509306 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa628066280 0x7fa628068730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa64415f050 tx=0x7fa630009040 comp rx=0 tx=0).stop 2023-07-21T22:19:06.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.672+0000 7fa64b100640 1 -- 172.21.15.6:0/3907509306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6440b7c70 msgr2=0x7fa6440c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:06.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.672+0000 7fa64b100640 1 --2- 172.21.15.6:0/3907509306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6440b7c70 0x7fa6440c6f00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa63801a140 tx=0x7fa6380192b0 comp rx=0 tx=0).stop 2023-07-21T22:19:06.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.672+0000 7fa64b100640 1 -- 172.21.15.6:0/3907509306 shutdown_connections 2023-07-21T22:19:06.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.672+0000 7fa64b100640 1 --2- 172.21.15.6:0/3907509306 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa64415fd60 0x7fa64414c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:06.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.672+0000 7fa64b100640 1 --2- 172.21.15.6:0/3907509306 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6440d1850 0x7fa6440c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:06.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.672+0000 7fa64b100640 1 --2- 172.21.15.6:0/3907509306 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fa628066280 0x7fa628068730 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:06.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.672+0000 7fa64b100640 1 --2- 172.21.15.6:0/3907509306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6440b7c70 0x7fa6440c6f00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:06.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.672+0000 7fa64b100640 1 -- 172.21.15.6:0/3907509306 >> 172.21.15.6:0/3907509306 conn(0x7fa6440650b0 msgr2=0x7fa6440b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:06.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.672+0000 7fa64b100640 1 -- 172.21.15.6:0/3907509306 shutdown_connections 2023-07-21T22:19:06.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:06.672+0000 7fa64b100640 1 -- 172.21.15.6:0/3907509306 wait complete. 2023-07-21T22:19:06.739 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T22:19:06.739 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:19:06.739 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-07-21T22:19:06.740 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T22:19:06.740 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T22:19:06.740 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T22:19:06.740 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T22:19:06.740 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:19:06.741 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:19:06.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:06.741 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-07-21T22:19:06.751 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:19:06.751 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:19:06.751 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:19:06.752 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:06.752 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-21T22:19:06.752 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:06.752 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:19:06.752 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:06.753 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-07-21T22:19:06.753 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:19:06.753 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:06.753 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-07-21T22:19:06.754 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:19:06.754 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:06.754 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-07-21T22:19:06.754 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:19:06.755 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42099sec preferred_lft 42099sec 2023-07-21T22:19:06.755 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-07-21T22:19:06.755 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:06.755 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:19:06.755 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:06.756 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-07-21T22:19:06.756 INFO:teuthology.orchestra.run.smithi006.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:19:06.756 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:42:2f:9a:3d:15 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:06.756 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:19:06.756 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:06.758 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-21T22:19:06.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:06.759 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T22:19:06.759 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T22:19:06.759 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2023-07-21T22:19:06.760 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2023-07-21T22:19:06.760 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2023-07-21T22:19:06.761 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-21T22:19:06.761 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T22:19:06.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:06.883 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:19:06.903 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-07-21T22:19:06.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:06.906 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-07-21T22:19:06.984 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-07-21T22:19:06.985 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:19:06.985 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:19:06.985 INFO:teuthology.orchestra.run.smithi006.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:19:06.985 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:19:06.985 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:19:06.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:06.986 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T22:19:06.986 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T22:19:06.987 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:19:06.987 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:19:06.987 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:19:06.987 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T22:19:07.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:07.084 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T22:19:07.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:07.097 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2023-07-21T22:19:07.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:07.146 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T22:19:07.146 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T22:19:07.146 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:19:07.147 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-21T22:19:07.147 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T22:19:07.230 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-21T22:19:07.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:07.231 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T22:19:07.231 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T22:19:07.231 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-21T22:19:07.232 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-21T22:19:07.232 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-21T22:19:07.232 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-21T22:19:07.232 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-21T22:19:07.233 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T22:19:07.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:07.415 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T22:19:07.415 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T22:19:07.416 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-07-21T22:19:07.416 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2023-07-21T22:19:07.416 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T22:19:07.459 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:19:07.459 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T22:19:07.509 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:19:07.510 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:19:07.510 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:19:07.560 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-21T22:19:07.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:07.561 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:19:07.676 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:19:07.676 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:19:07.677 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:19:07.782 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:19:07.783 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:19:07.783 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:19:07.783 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:19:07.783 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:19:07.794 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:19:07.795 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:19:07.795 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:19:07.795 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:19:07.795 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:19:07.795 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-07-21T22:19:07.795 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-07-21T22:19:07.796 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f3073df4-6cd1-4503-bd2e-d3e98fa18bdf" will pass to kernel 2023-07-21T22:19:07.798 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T22:19:07.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:07.799 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:19:07.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:07.822 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:19:07.902 INFO:teuthology.orchestra.run.smithi006.stdout:client4728 2023-07-21T22:19:07.903 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:19:07.904 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:19:07.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:07.957 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:19:08.020 INFO:teuthology.orchestra.run.smithi006.stdout:client4728 2023-07-21T22:19:08.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:08.021 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:19:08.085 INFO:teuthology.orchestra.run.smithi006.stdout:client4728 2023-07-21T22:19:08.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:08.086 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f3073df4-6cd1-4503-bd2e-d3e98fa18bdf.client4728/status') 2023-07-21T22:19:08.156 INFO:teuthology.orchestra.run.smithi006.stdout:instance: client.4728 (3)192.168.0.1:0/4056630341 2023-07-21T22:19:08.156 INFO:teuthology.orchestra.run.smithi006.stdout:blocklisted: false 2023-07-21T22:19:08.157 INFO:teuthology.orchestra.run.smithi006.stderr:0+1 records in 2023-07-21T22:19:08.157 INFO:teuthology.orchestra.run.smithi006.stderr:0+1 records out 2023-07-21T22:19:08.157 INFO:teuthology.orchestra.run.smithi006.stderr:69 bytes copied, 5.3413e-05 s, 1.3 MB/s 2023-07-21T22:19:08.158 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-07-21T22:19:08.158 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-21T22:19:08.158 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-21T22:19:08.159 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:19:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.296+0000 7fc966bd3640 1 Processor -- start 2023-07-21T22:19:08.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.296+0000 7fc966bd3640 1 -- start start 2023-07-21T22:19:08.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.296+0000 7fc966bd3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc9600cb780 0x7fc9600cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:08.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.296+0000 7fc966bd3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc96006b8f0 0x7fc9600cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:08.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.296+0000 7fc966bd3640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96006f900 con 0x7fc96015b7c0 2023-07-21T22:19:08.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.296+0000 7fc966bd3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9600cdce0 con 0x7fc96006b8f0 2023-07-21T22:19:08.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.296+0000 7fc966bd3640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9600ca830 con 0x7fc9600cb780 2023-07-21T22:19:08.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.296+0000 7fc965170640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc96006b8f0 0x7fc9600cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:08.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.300+0000 7fc965170640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc96006b8f0 0x7fc9600cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60620/0 (socket says 172.21.15.6:60620) 2023-07-21T22:19:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.300+0000 7fc965170640 1 -- 172.21.15.6:0/3545303480 learned_addr learned my addr 172.21.15.6:0/3545303480 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.300+0000 7fc95ffff640 1 --2- 172.21.15.6:0/3545303480 >> v2:172.21.15.161:3300/0 conn(0x7fc9600cb780 0x7fc9600cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.300+0000 7fc965170640 1 -- 172.21.15.6:0/3545303480 >> v2:172.21.15.161:3300/0 conn(0x7fc9600cb780 msgr2=0x7fc9600cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.300+0000 7fc965170640 1 --2- 172.21.15.6:0/3545303480 >> v2:172.21.15.161:3300/0 conn(0x7fc9600cb780 0x7fc9600cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.300+0000 7fc965170640 1 -- 172.21.15.6:0/3545303480 >> v1:172.21.15.161:6789/0 conn(0x7fc96015b7c0 legacy=0x7fc96006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.300+0000 7fc965170640 1 -- 172.21.15.6:0/3545303480 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96015bb90 con 0x7fc96006b8f0 2023-07-21T22:19:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.300+0000 7fc95ffff640 1 --2- 172.21.15.6:0/3545303480 >> v2:172.21.15.161:3300/0 conn(0x7fc9600cb780 0x7fc9600cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.300+0000 7fc965170640 1 --2- 172.21.15.6:0/3545303480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc96006b8f0 0x7fc9600cc270 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc96006af40 tx=0x7fc95801eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7adea1f97169534 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:08.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.300+0000 7fc95f7fe640 1 -- 172.21.15.6:0/3545303480 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9580a7bf0 con 0x7fc96006b8f0 2023-07-21T22:19:08.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.300+0000 7fc95f7fe640 1 -- 172.21.15.6:0/3545303480 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9580ab070 con 0x7fc96006b8f0 2023-07-21T22:19:08.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.300+0000 7fc95f7fe640 1 -- 172.21.15.6:0/3545303480 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9580b1400 con 0x7fc96006b8f0 2023-07-21T22:19:08.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc966bd3640 1 -- 172.21.15.6:0/3545303480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc96006b8f0 msgr2=0x7fc9600cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:08.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc966bd3640 1 --2- 172.21.15.6:0/3545303480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc96006b8f0 0x7fc9600cc270 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc96006af40 tx=0x7fc95801eba0 comp rx=0 tx=0).stop 2023-07-21T22:19:08.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc966bd3640 1 -- 172.21.15.6:0/3545303480 shutdown_connections 2023-07-21T22:19:08.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc966bd3640 1 --2- 172.21.15.6:0/3545303480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc96006b8f0 0x7fc9600cc270 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:08.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc966bd3640 1 --2- 172.21.15.6:0/3545303480 >> v2:172.21.15.161:3300/0 conn(0x7fc9600cb780 0x7fc9600cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:08.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc966bd3640 1 -- 172.21.15.6:0/3545303480 >> 172.21.15.6:0/3545303480 conn(0x7fc9600afcf0 msgr2=0x7fc9600b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:08.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc966bd3640 1 -- 172.21.15.6:0/3545303480 shutdown_connections 2023-07-21T22:19:08.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc966bd3640 1 -- 172.21.15.6:0/3545303480 wait complete. 2023-07-21T22:19:08.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc966bd3640 1 Processor -- start 2023-07-21T22:19:08.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc966bd3640 1 -- start start 2023-07-21T22:19:08.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc966bd3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc96006b8f0 0x7fc9601f7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc966bd3640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc96015b7c0 0x7fc9600b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc966bd3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9600b2fe0 0x7fc96015a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc966bd3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600b3510 con 0x7fc9600b2fe0 2023-07-21T22:19:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc966bd3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600b37f0 con 0x7fc96006b8f0 2023-07-21T22:19:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc966bd3640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600b3ad0 con 0x7fc96015b7c0 2023-07-21T22:19:08.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc965170640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9600b2fe0 0x7fc96015a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:08.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc965170640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9600b2fe0 0x7fc96015a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60626/0 (socket says 172.21.15.6:60626) 2023-07-21T22:19:08.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc965170640 1 -- 172.21.15.6:0/1660782028 learned_addr learned my addr 172.21.15.6:0/1660782028 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:08.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc96496f640 1 --2- 172.21.15.6:0/1660782028 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc96006b8f0 0x7fc9601f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:08.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc95ffff640 1 --2- 172.21.15.6:0/1660782028 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc96015b7c0 0x7fc9600b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:08.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc965170640 1 -- 172.21.15.6:0/1660782028 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc96015b7c0 msgr2=0x7fc9600b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:08.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc965170640 1 --2- 172.21.15.6:0/1660782028 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc96015b7c0 0x7fc9600b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:08.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc965170640 1 -- 172.21.15.6:0/1660782028 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc96006b8f0 msgr2=0x7fc9601f7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:08.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc965170640 1 --2- 172.21.15.6:0/1660782028 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc96006b8f0 0x7fc9601f7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:08.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.304+0000 7fc965170640 1 -- 172.21.15.6:0/1660782028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95800bd40 con 0x7fc9600b2fe0 2023-07-21T22:19:08.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.308+0000 7fc965170640 1 --2- 172.21.15.6:0/1660782028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9600b2fe0 0x7fc96015a270 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc9580b3040 tx=0x7fc95801d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:08.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.308+0000 7fc95d7fa640 1 -- 172.21.15.6:0/1660782028 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9580bf070 con 0x7fc9600b2fe0 2023-07-21T22:19:08.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.308+0000 7fc95d7fa640 1 -- 172.21.15.6:0/1660782028 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95800b3f0 con 0x7fc9600b2fe0 2023-07-21T22:19:08.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.308+0000 7fc95d7fa640 1 -- 172.21.15.6:0/1660782028 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9580086c0 con 0x7fc9600b2fe0 2023-07-21T22:19:08.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.308+0000 7fc966bd3640 1 -- 172.21.15.6:0/1660782028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9600b3db0 con 0x7fc9600b2fe0 2023-07-21T22:19:08.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.308+0000 7fc966bd3640 1 -- 172.21.15.6:0/1660782028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9600b11b0 con 0x7fc9600b2fe0 2023-07-21T22:19:08.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.308+0000 7fc966bd3640 1 -- 172.21.15.6:0/1660782028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9600678d0 con 0x7fc9600b2fe0 2023-07-21T22:19:08.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.308+0000 7fc95d7fa640 1 -- 172.21.15.6:0/1660782028 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc958008820 con 0x7fc9600b2fe0 2023-07-21T22:19:08.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.308+0000 7fc95d7fa640 1 --2- 172.21.15.6:0/1660782028 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc9440662b0 0x7fc944068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:08.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.308+0000 7fc95d7fa640 1 -- 172.21.15.6:0/1660782028 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc95811e380 con 0x7fc9600b2fe0 2023-07-21T22:19:08.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.308+0000 7fc96496f640 1 --2- 172.21.15.6:0/1660782028 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc9440662b0 0x7fc944068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:08.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.312+0000 7fc96496f640 1 --2- 172.21.15.6:0/1660782028 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc9440662b0 0x7fc944068760 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc960156d40 tx=0x7fc954009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:08.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.316+0000 7fc95d7fa640 1 -- 172.21.15.6:0/1660782028 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc9580eb8a0 con 0x7fc9600b2fe0 2023-07-21T22:19:08.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.504+0000 7fc966bd3640 1 -- 172.21.15.6:0/1660782028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc96006c380 con 0x7fc9600b2fe0 2023-07-21T22:19:08.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.504+0000 7fc95d7fa640 1 -- 172.21.15.6:0/1660782028 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc9580eeec0 con 0x7fc9600b2fe0 2023-07-21T22:19:08.552 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T22:19:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.508+0000 7fc966bd3640 1 -- 172.21.15.6:0/1660782028 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc9440662b0 msgr2=0x7fc944068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.508+0000 7fc966bd3640 1 --2- 172.21.15.6:0/1660782028 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc9440662b0 0x7fc944068760 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc960156d40 tx=0x7fc954009040 comp rx=0 tx=0).stop 2023-07-21T22:19:08.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.508+0000 7fc966bd3640 1 -- 172.21.15.6:0/1660782028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9600b2fe0 msgr2=0x7fc96015a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.508+0000 7fc966bd3640 1 --2- 172.21.15.6:0/1660782028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9600b2fe0 0x7fc96015a270 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc9580b3040 tx=0x7fc95801d3e0 comp rx=0 tx=0).stop 2023-07-21T22:19:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.508+0000 7fc966bd3640 1 -- 172.21.15.6:0/1660782028 shutdown_connections 2023-07-21T22:19:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.508+0000 7fc966bd3640 1 --2- 172.21.15.6:0/1660782028 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc9440662b0 0x7fc944068760 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.508+0000 7fc966bd3640 1 --2- 172.21.15.6:0/1660782028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9600b2fe0 0x7fc96015a270 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.508+0000 7fc966bd3640 1 --2- 172.21.15.6:0/1660782028 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc96015b7c0 0x7fc9600b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.508+0000 7fc966bd3640 1 --2- 172.21.15.6:0/1660782028 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc96006b8f0 0x7fc9601f7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:08.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.508+0000 7fc966bd3640 1 -- 172.21.15.6:0/1660782028 >> 172.21.15.6:0/1660782028 conn(0x7fc9600afcf0 msgr2=0x7fc9600cbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:08.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.508+0000 7fc966bd3640 1 -- 172.21.15.6:0/1660782028 shutdown_connections 2023-07-21T22:19:08.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:08.508+0000 7fc966bd3640 1 -- 172.21.15.6:0/1660782028 wait complete. 2023-07-21T22:19:08.573 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T22:19:08.574 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:19:08.574 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-07-21T22:19:08.574 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-07-21T22:19:08.574 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-21T22:19:08.575 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T22:19:08.575 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T22:19:08.575 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:19:08.575 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-07-21T22:19:08.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:08.576 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-07-21T22:19:08.588 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:19:08.588 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:19:08.588 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:19:08.589 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:08.589 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-21T22:19:08.589 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:08.590 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:19:08.590 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:08.590 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-07-21T22:19:08.590 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:19:08.590 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:08.590 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-07-21T22:19:08.591 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:19:08.591 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:08.591 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-07-21T22:19:08.591 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:19:08.591 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42097sec preferred_lft 42097sec 2023-07-21T22:19:08.591 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-07-21T22:19:08.591 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:08.591 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:19:08.592 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:08.592 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-07-21T22:19:08.592 INFO:teuthology.orchestra.run.smithi006.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:19:08.593 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:42:2f:9a:3d:15 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:08.593 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:19:08.593 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:08.593 INFO:teuthology.orchestra.run.smithi006.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:19:08.593 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:08.593 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T22:19:08.593 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:08.594 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-07-21T22:19:08.594 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:08.594 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:19:08.594 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:19:08.594 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-07-21T22:19:08.594 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:08.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:08.595 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:19:08.648 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-07-21T22:19:08.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:08.651 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-07-21T22:19:08.702 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-07-21T22:19:08.702 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:19:08.702 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:19:08.702 INFO:teuthology.orchestra.run.smithi006.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:19:08.703 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:19:08.703 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:19:08.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:08.703 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T22:19:08.704 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T22:19:08.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:19:08.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:19:08.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:19:08.705 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T22:19:08.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:08.800 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T22:19:08.810 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T22:19:08.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:08.811 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2023-07-21T22:19:08.861 INFO:teuthology.orchestra.run.smithi006.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-07-21T22:19:08.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:08.862 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T22:19:08.862 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T22:19:08.863 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T22:19:08.863 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-07-21T22:19:08.863 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T22:19:08.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:08.947 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-21T22:19:09.010 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:19:09.011 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:19:09.011 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:19:09.011 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:09.011 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-21T22:19:09.011 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:09.011 INFO:teuthology.orchestra.run.smithi006.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:19:09.012 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether ea:88:e6:0e:a5:b9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-21T22:19:09.012 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-21T22:19:09.012 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:09.012 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::e888:e6ff:fe0e:a5b9/64 scope link 2023-07-21T22:19:09.012 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:09.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:09.013 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-21T22:19:09.082 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:19:09.083 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:19:09.083 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:19:09.083 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:09.083 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-21T22:19:09.083 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:09.084 INFO:teuthology.orchestra.run.smithi006.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:19:09.084 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether ea:88:e6:0e:a5:b9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-21T22:19:09.084 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-21T22:19:09.084 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:09.084 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::e888:e6ff:fe0e:a5b9/64 scope link 2023-07-21T22:19:09.084 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:09.085 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-07-21T22:19:09.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:09.086 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T22:19:09.086 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T22:19:09.086 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-07-21T22:19:09.087 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-21T22:19:09.087 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-07-21T22:19:09.087 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-07-21T22:19:09.088 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-07-21T22:19:09.088 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T22:19:09.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:09.230 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T22:19:09.231 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T22:19:09.231 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.1 up 2023-07-21T22:19:09.231 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.1 master ceph-brx 2023-07-21T22:19:09.231 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T22:19:09.273 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:19:09.273 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-07-21T22:19:09.329 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-07-21T22:19:09.330 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:19:09.330 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-07-21T22:19:09.385 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-21T22:19:09.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:09.386 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-21T22:19:09.484 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-21T22:19:09.485 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-21T22:19:09.485 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:19:09.500 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-21T22:19:09.500 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-21T22:19:09.500 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:19:09.500 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:19:09.500 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:19:09.509 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-21T22:19:09.510 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-21T22:19:09.510 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:19:09.510 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:19:09.511 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:19:09.511 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-07-21T22:19:09.511 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-07-21T22:19:09.511 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=f3073df4-6cd1-4503-bd2e-d3e98fa18bdf" will pass to kernel 2023-07-21T22:19:09.514 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T22:19:09.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:09.515 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-07-21T22:19:09.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:09.537 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:19:09.592 INFO:teuthology.orchestra.run.smithi006.stdout:client4750 2023-07-21T22:19:09.593 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:19:09.593 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:19:09.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:09.645 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:19:09.705 INFO:teuthology.orchestra.run.smithi006.stdout:client4750 2023-07-21T22:19:09.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:09.706 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:19:09.760 INFO:teuthology.orchestra.run.smithi006.stdout:client4750 2023-07-21T22:19:09.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:09.761 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f3073df4-6cd1-4503-bd2e-d3e98fa18bdf.client4750/status') 2023-07-21T22:19:09.822 INFO:teuthology.orchestra.run.smithi006.stdout:instance: client.4750 (3)172.21.15.6:0/4078404636 2023-07-21T22:19:09.823 INFO:teuthology.orchestra.run.smithi006.stdout:blocklisted: false 2023-07-21T22:19:09.824 INFO:teuthology.orchestra.run.smithi006.stderr:0+1 records in 2023-07-21T22:19:09.824 INFO:teuthology.orchestra.run.smithi006.stderr:0+1 records out 2023-07-21T22:19:09.824 INFO:teuthology.orchestra.run.smithi006.stderr:69 bytes copied, 5.3673e-05 s, 1.3 MB/s 2023-07-21T22:19:09.824 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-07-21T22:19:09.825 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-21T22:19:09.825 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-21T22:19:09.825 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:19:10.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.964+0000 7f23123f6640 1 Processor -- start 2023-07-21T22:19:10.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.964+0000 7f23123f6640 1 -- start start 2023-07-21T22:19:10.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.964+0000 7f23123f6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f230c0b7c70 0x7f230c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:10.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.964+0000 7f23123f6640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f230c0d1850 0x7f230c15f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:10.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.964+0000 7f23123f6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c0d1300 0x7f230c15fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:10.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.964+0000 7f23123f6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230c0d1190 con 0x7f230c0b7c70 2023-07-21T22:19:10.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.964+0000 7f23123f6640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230c160600 con 0x7f230c0d1850 2023-07-21T22:19:10.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.964+0000 7f23123f6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230c1600d0 con 0x7f230c0d1300 2023-07-21T22:19:10.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.964+0000 7f230bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f230c0b7c70 0x7f230c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:10.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.964+0000 7f230bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f230c0b7c70 0x7f230c0d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60634/0 (socket says 172.21.15.6:60634) 2023-07-21T22:19:10.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.964+0000 7f230bfff640 1 -- 172.21.15.6:0/2286914577 learned_addr learned my addr 172.21.15.6:0/2286914577 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:10.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.964+0000 7f2310993640 1 --2- 172.21.15.6:0/2286914577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c0d1300 0x7f230c15fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:10.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.964+0000 7f230b7fe640 1 --2- 172.21.15.6:0/2286914577 >> v2:172.21.15.161:3300/0 conn(0x7f230c0d1850 0x7f230c15f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:10.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.964+0000 7f230bfff640 1 -- 172.21.15.6:0/2286914577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c0d1300 msgr2=0x7f230c15fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:10.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.964+0000 7f230bfff640 1 --2- 172.21.15.6:0/2286914577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c0d1300 0x7f230c15fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:10.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.964+0000 7f230bfff640 1 -- 172.21.15.6:0/2286914577 >> v2:172.21.15.161:3300/0 conn(0x7f230c0d1850 msgr2=0x7f230c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:10.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.964+0000 7f230bfff640 1 --2- 172.21.15.6:0/2286914577 >> v2:172.21.15.161:3300/0 conn(0x7f230c0d1850 0x7f230c15f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:10.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.964+0000 7f230bfff640 1 -- 172.21.15.6:0/2286914577 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c0ccaf0 con 0x7f230c0b7c70 2023-07-21T22:19:10.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.968+0000 7f230bfff640 1 --2- 172.21.15.6:0/2286914577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c0b7c70 0x7f230c0d0c50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f230c0b1180 tx=0x7f22fc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974b3c103b7e3501 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:10.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.968+0000 7f230affd640 1 -- 172.21.15.6:0/2286914577 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc0ac600 con 0x7f230c0b7c70 2023-07-21T22:19:10.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.968+0000 7f230affd640 1 -- 172.21.15.6:0/2286914577 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22fc0a8050 con 0x7f230c0b7c70 2023-07-21T22:19:10.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.968+0000 7f230affd640 1 -- 172.21.15.6:0/2286914577 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc0ac980 con 0x7f230c0b7c70 2023-07-21T22:19:10.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.968+0000 7f23123f6640 1 -- 172.21.15.6:0/2286914577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c0b7c70 msgr2=0x7f230c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:10.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.968+0000 7f23123f6640 1 --2- 172.21.15.6:0/2286914577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c0b7c70 0x7f230c0d0c50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f230c0b1180 tx=0x7f22fc01c4d0 comp rx=0 tx=0).stop 2023-07-21T22:19:10.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.968+0000 7f23123f6640 1 -- 172.21.15.6:0/2286914577 shutdown_connections 2023-07-21T22:19:10.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.968+0000 7f23123f6640 1 --2- 172.21.15.6:0/2286914577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c0d1300 0x7f230c15fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:10.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.968+0000 7f23123f6640 1 --2- 172.21.15.6:0/2286914577 >> v2:172.21.15.161:3300/0 conn(0x7f230c0d1850 0x7f230c15f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:10.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.968+0000 7f23123f6640 1 --2- 172.21.15.6:0/2286914577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c0b7c70 0x7f230c0d0c50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:10.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.968+0000 7f23123f6640 1 -- 172.21.15.6:0/2286914577 >> 172.21.15.6:0/2286914577 conn(0x7f230c0650b0 msgr2=0x7f230c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:10.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.968+0000 7f23123f6640 1 -- 172.21.15.6:0/2286914577 shutdown_connections 2023-07-21T22:19:10.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.968+0000 7f23123f6640 1 -- 172.21.15.6:0/2286914577 wait complete. 2023-07-21T22:19:10.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f23123f6640 1 Processor -- start 2023-07-21T22:19:10.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f23123f6640 1 -- start start 2023-07-21T22:19:10.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f23123f6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c0b7c70 0x7f230c0cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:10.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f23123f6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c0d1300 0x7f230c15b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:10.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f23123f6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c0d1850 0x7f230c156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:10.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f23123f6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c0cb720 con 0x7f230c0b7c70 2023-07-21T22:19:10.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f23123f6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c15c8e0 con 0x7f230c0d1300 2023-07-21T22:19:10.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f23123f6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230c15bda0 con 0x7f230c0d1850 2023-07-21T22:19:10.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f230bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c0b7c70 0x7f230c0cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:10.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f230bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c0b7c70 0x7f230c0cadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60646/0 (socket says 172.21.15.6:60646) 2023-07-21T22:19:10.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f230bfff640 1 -- 172.21.15.6:0/3275921748 learned_addr learned my addr 172.21.15.6:0/3275921748 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:10.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f230b7fe640 1 --2- 172.21.15.6:0/3275921748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c0d1300 0x7f230c15b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:10.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f2310993640 1 --2- 172.21.15.6:0/3275921748 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c0d1850 0x7f230c156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:10.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f230bfff640 1 -- 172.21.15.6:0/3275921748 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c0d1850 msgr2=0x7f230c156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:10.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f230bfff640 1 --2- 172.21.15.6:0/3275921748 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c0d1850 0x7f230c156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:10.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f230bfff640 1 -- 172.21.15.6:0/3275921748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c0d1300 msgr2=0x7f230c15b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:10.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f230bfff640 1 --2- 172.21.15.6:0/3275921748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c0d1300 0x7f230c15b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:10.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f230bfff640 1 -- 172.21.15.6:0/3275921748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc0094d0 con 0x7f230c0b7c70 2023-07-21T22:19:10.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f230b7fe640 1 --2- 172.21.15.6:0/3275921748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c0d1300 0x7f230c15b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:10.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f2310993640 1 --2- 172.21.15.6:0/3275921748 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c0d1850 0x7f230c156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:10.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f230bfff640 1 --2- 172.21.15.6:0/3275921748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c0b7c70 0x7f230c0cadf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f22fc01ab80 tx=0x7f22fc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:10.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f2308ff9640 1 -- 172.21.15.6:0/3275921748 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc0bd070 con 0x7f230c0b7c70 2023-07-21T22:19:10.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f2308ff9640 1 -- 172.21.15.6:0/3275921748 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22fc0ace70 con 0x7f230c0b7c70 2023-07-21T22:19:10.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f23123f6640 1 -- 172.21.15.6:0/3275921748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230c0cb440 con 0x7f230c0b7c70 2023-07-21T22:19:10.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f2308ff9640 1 -- 172.21.15.6:0/3275921748 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc0b7620 con 0x7f230c0b7c70 2023-07-21T22:19:10.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.972+0000 7f23123f6640 1 -- 172.21.15.6:0/3275921748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230c15c570 con 0x7f230c0b7c70 2023-07-21T22:19:10.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.976+0000 7f23123f6640 1 -- 172.21.15.6:0/3275921748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230c15c0f0 con 0x7f230c0b7c70 2023-07-21T22:19:10.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.976+0000 7f2308ff9640 1 -- 172.21.15.6:0/3275921748 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f22fc0b3040 con 0x7f230c0b7c70 2023-07-21T22:19:10.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.976+0000 7f2308ff9640 1 --2- 172.21.15.6:0/3275921748 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f22f80662b0 0x7f22f8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:10.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.976+0000 7f2308ff9640 1 -- 172.21.15.6:0/3275921748 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f22fc11d870 con 0x7f230c0b7c70 2023-07-21T22:19:10.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.976+0000 7f230b7fe640 1 --2- 172.21.15.6:0/3275921748 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f22f80662b0 0x7f22f8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:10.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.976+0000 7f230b7fe640 1 --2- 172.21.15.6:0/3275921748 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f22f80662b0 0x7f22f8068760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f230c15b530 tx=0x7f2300008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:10.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:09.980+0000 7f2308ff9640 1 -- 172.21.15.6:0/3275921748 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f230c15c0f0 con 0x7f230c0b7c70 2023-07-21T22:19:10.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:10.168+0000 7f23123f6640 1 -- 172.21.15.6:0/3275921748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f230c15c0c0 con 0x7f230c0b7c70 2023-07-21T22:19:10.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:10.168+0000 7f2308ff9640 1 -- 172.21.15.6:0/3275921748 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f22fc0eace0 con 0x7f230c0b7c70 2023-07-21T22:19:10.216 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T22:19:10.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:10.172+0000 7f23123f6640 1 -- 172.21.15.6:0/3275921748 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f22f80662b0 msgr2=0x7f22f8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:10.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:10.172+0000 7f23123f6640 1 --2- 172.21.15.6:0/3275921748 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f22f80662b0 0x7f22f8068760 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f230c15b530 tx=0x7f2300008040 comp rx=0 tx=0).stop 2023-07-21T22:19:10.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:10.172+0000 7f23123f6640 1 -- 172.21.15.6:0/3275921748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c0b7c70 msgr2=0x7f230c0cadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:10.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:10.172+0000 7f23123f6640 1 --2- 172.21.15.6:0/3275921748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c0b7c70 0x7f230c0cadf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f22fc01ab80 tx=0x7f22fc01ad10 comp rx=0 tx=0).stop 2023-07-21T22:19:10.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:10.172+0000 7f23123f6640 1 -- 172.21.15.6:0/3275921748 shutdown_connections 2023-07-21T22:19:10.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:10.172+0000 7f23123f6640 1 --2- 172.21.15.6:0/3275921748 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230c0d1850 0x7f230c156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:10.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:10.172+0000 7f23123f6640 1 --2- 172.21.15.6:0/3275921748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f230c0d1300 0x7f230c15b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:10.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:10.172+0000 7f23123f6640 1 --2- 172.21.15.6:0/3275921748 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f22f80662b0 0x7f22f8068760 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:10.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:10.172+0000 7f23123f6640 1 --2- 172.21.15.6:0/3275921748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c0b7c70 0x7f230c0cadf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:10.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:10.172+0000 7f23123f6640 1 -- 172.21.15.6:0/3275921748 >> 172.21.15.6:0/3275921748 conn(0x7f230c0650b0 msgr2=0x7f230c0b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:10.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:10.172+0000 7f23123f6640 1 -- 172.21.15.6:0/3275921748 shutdown_connections 2023-07-21T22:19:10.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:10.172+0000 7f23123f6640 1 -- 172.21.15.6:0/3275921748 wait complete. 2023-07-21T22:19:10.237 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T22:19:10.237 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:19:10.237 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-07-21T22:19:10.237 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-21T22:19:10.237 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-21T22:19:10.238 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T22:19:10.238 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T22:19:10.238 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:19:10.238 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-21T22:19:10.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:10.239 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-07-21T22:19:10.249 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:19:10.249 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:19:10.249 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:19:10.249 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:10.250 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-07-21T22:19:10.250 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:10.250 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:19:10.250 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:10.250 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2023-07-21T22:19:10.250 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:19:10.250 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:10.250 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2023-07-21T22:19:10.251 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:19:10.251 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:10.251 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:19:10.251 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:10.251 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-21T22:19:10.251 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42158sec preferred_lft 42158sec 2023-07-21T22:19:10.251 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2023-07-21T22:19:10.251 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:10.252 INFO:teuthology.orchestra.run.smithi161.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:19:10.252 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 02:42:cd:b0:0a:f0 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:10.252 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:19:10.252 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:10.253 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-21T22:19:10.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:10.254 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-07-21T22:19:10.254 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-07-21T22:19:10.254 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add name ceph-brx type bridge 2023-07-21T22:19:10.254 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr flush dev ceph-brx 2023-07-21T22:19:10.254 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set ceph-brx up 2023-07-21T22:19:10.255 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-21T22:19:10.255 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-07-21T22:19:10.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:10.372 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:19:10.392 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-07-21T22:19:10.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:10.394 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-07-21T22:19:10.468 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-07-21T22:19:10.469 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:19:10.469 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-21T22:19:10.469 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-21T22:19:10.469 INFO:teuthology.orchestra.run.smithi161.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:19:10.469 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-21T22:19:10.469 INFO:teuthology.orchestra.run.smithi161.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-21T22:19:10.470 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-21T22:19:10.470 INFO:teuthology.orchestra.run.smithi161.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-21T22:19:10.470 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:19:10.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:10.470 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-07-21T22:19:10.471 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-07-21T22:19:10.471 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-21T22:19:10.472 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-21T22:19:10.472 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-21T22:19:10.472 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-07-21T22:19:10.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:10.569 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-07-21T22:19:10.570 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:19:10.574 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:19:10.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:10.579 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list-id 2023-07-21T22:19:10.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:10.635 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-07-21T22:19:10.636 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-07-21T22:19:10.636 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-21T22:19:10.636 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-21T22:19:10.636 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-07-21T22:19:10.757 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-21T22:19:10.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:10.757 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-07-21T22:19:10.758 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-07-21T22:19:10.758 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-21T22:19:10.758 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-21T22:19:10.758 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-21T22:19:10.759 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-21T22:19:10.759 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-21T22:19:10.759 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-07-21T22:19:10.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:10.927 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-07-21T22:19:10.927 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-07-21T22:19:10.927 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2023-07-21T22:19:10.928 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set dev brx.0 master ceph-brx 2023-07-21T22:19:10.928 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-07-21T22:19:10.970 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:19:10.971 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-21T22:19:11.020 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-21T22:19:11.020 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:19:11.021 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-21T22:19:11.072 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-21T22:19:11.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:11.073 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-21T22:19:11.173 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-21T22:19:11.173 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-21T22:19:11.173 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-07-21T22:19:11.285 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-21T22:19:11.285 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-21T22:19:11.285 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-07-21T22:19:11.286 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:19:11.286 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:19:11.296 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-21T22:19:11.296 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-21T22:19:11.297 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-07-21T22:19:11.297 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:19:11.297 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:19:11.297 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-07-21T22:19:11.297 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-07-21T22:19:11.297 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f3073df4-6cd1-4503-bd2e-d3e98fa18bdf" will pass to kernel 2023-07-21T22:19:11.300 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T22:19:11.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:11.301 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-21T22:19:11.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:11.322 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:19:11.386 INFO:teuthology.orchestra.run.smithi161.stdout:client4637 2023-07-21T22:19:11.386 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:19:11.387 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:19:11.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:11.436 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:19:11.490 INFO:teuthology.orchestra.run.smithi161.stdout:client4637 2023-07-21T22:19:11.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:11.491 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:19:11.542 INFO:teuthology.orchestra.run.smithi161.stdout:client4637 2023-07-21T22:19:11.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:11.543 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f3073df4-6cd1-4503-bd2e-d3e98fa18bdf.client4637/status') 2023-07-21T22:19:11.609 INFO:teuthology.orchestra.run.smithi161.stdout:instance: client.4637 (3)192.168.0.1:0/2444774815 2023-07-21T22:19:11.609 INFO:teuthology.orchestra.run.smithi161.stdout:blocklisted: false 2023-07-21T22:19:11.610 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2023-07-21T22:19:11.610 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2023-07-21T22:19:11.610 INFO:teuthology.orchestra.run.smithi161.stderr:69 bytes copied, 5.5387e-05 s, 1.2 MB/s 2023-07-21T22:19:11.611 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-07-21T22:19:11.611 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-21T22:19:11.612 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-21T22:19:11.612 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:19:11.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f84a732c640 1 Processor -- start 2023-07-21T22:19:11.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f84a732c640 1 -- start start 2023-07-21T22:19:11.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f84a732c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84a00b7c70 0x7f84a00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:11.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f84a732c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f84a00d1850 0x7f84a015f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:11.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f84a732c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a00ccaf0 con 0x7f84a00d1300 2023-07-21T22:19:11.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f84a732c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a00d1190 con 0x7f84a00d1850 2023-07-21T22:19:11.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f84a732c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a0160600 con 0x7f84a00b7c70 2023-07-21T22:19:11.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f84a58c9640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f84a00d1300 0x7f84a00d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55862/0 (socket says 172.21.15.6:55862) 2023-07-21T22:19:11.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f84a58c9640 1 -- 172.21.15.6:0/1161520664 learned_addr learned my addr 172.21.15.6:0/1161520664 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:11.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f84a48c7640 1 --2- 172.21.15.6:0/1161520664 >> v2:172.21.15.161:3300/0 conn(0x7f84a00d1850 0x7f84a015f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:11.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f84a50c8640 1 --2- 172.21.15.6:0/1161520664 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84a00b7c70 0x7f84a00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:11.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f8497fff640 1 -- 172.21.15.6:0/1161520664 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657830711 0 0) 0x7f84a00ccaf0 con 0x7f84a00d1300 2023-07-21T22:19:11.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f8497fff640 1 -- 172.21.15.6:0/1161520664 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f848c003530 con 0x7f84a00d1300 2023-07-21T22:19:11.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f8497fff640 1 -- 172.21.15.6:0/1161520664 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 371013803 0 0) 0x7f848c003530 con 0x7f84a00d1300 2023-07-21T22:19:11.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f8497fff640 1 -- 172.21.15.6:0/1161520664 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84a00b7c70 msgr2=0x7f84a00d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:11.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f8497fff640 1 --2- 172.21.15.6:0/1161520664 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84a00b7c70 0x7f84a00d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:11.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f8497fff640 1 -- 172.21.15.6:0/1161520664 >> v2:172.21.15.161:3300/0 conn(0x7f84a00d1850 msgr2=0x7f84a015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:11.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f8497fff640 1 --2- 172.21.15.6:0/1161520664 >> v2:172.21.15.161:3300/0 conn(0x7f84a00d1850 0x7f84a015f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:11.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f8497fff640 1 -- 172.21.15.6:0/1161520664 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a0160320 con 0x7f84a00d1300 2023-07-21T22:19:11.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f8497fff640 1 -- 172.21.15.6:0/1161520664 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f8498001a00 con 0x7f84a00d1300 2023-07-21T22:19:11.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f8497fff640 1 -- 172.21.15.6:0/1161520664 >> v1:172.21.15.6:6789/0 conn(0x7f84a00d1300 legacy=0x7f84a00d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:11.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.720+0000 7f8497fff640 1 --2- 172.21.15.6:0/1161520664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f848c0039b0 0x7f848c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:11.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.724+0000 7f8497fff640 1 --2- 172.21.15.6:0/1161520664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f848c0047d0 0x7f848c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:11.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.724+0000 7f8497fff640 1 --2- 172.21.15.6:0/1161520664 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84a00b7c70 0x7f848c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:11.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.724+0000 7f8497fff640 1 -- 172.21.15.6:0/1161520664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a0160600 con 0x7f848c0047d0 2023-07-21T22:19:11.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.724+0000 7f8497fff640 1 -- 172.21.15.6:0/1161520664 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c00b990 con 0x7f848c0039b0 2023-07-21T22:19:11.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.724+0000 7f8497fff640 1 -- 172.21.15.6:0/1161520664 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848c00bad0 con 0x7f84a00b7c70 2023-07-21T22:19:11.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.724+0000 7f84a48c7640 1 --2- 172.21.15.6:0/1161520664 >> v2:172.21.15.161:3300/0 conn(0x7f84a00d1850 0x7f84a015f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:11.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.724+0000 7f84a50c8640 1 --2- 172.21.15.6:0/1161520664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f848c0039b0 0x7f848c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:11.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.724+0000 7f84a58c9640 1 --2- 172.21.15.6:0/1161520664 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84a00b7c70 0x7f848c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:11.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.724+0000 7f84a48c7640 1 --2- 172.21.15.6:0/1161520664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f848c0047d0 0x7f848c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:11.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.724+0000 7f84a50c8640 1 -- 172.21.15.6:0/1161520664 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84a00b7c70 msgr2=0x7f848c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:11.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.724+0000 7f84a50c8640 1 --2- 172.21.15.6:0/1161520664 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84a00b7c70 0x7f848c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:11.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.724+0000 7f84a50c8640 1 -- 172.21.15.6:0/1161520664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f848c0047d0 msgr2=0x7f848c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:11.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.724+0000 7f84a50c8640 1 --2- 172.21.15.6:0/1161520664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f848c0047d0 0x7f848c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:11.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.724+0000 7f84a50c8640 1 -- 172.21.15.6:0/1161520664 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c003530 con 0x7f848c0039b0 2023-07-21T22:19:11.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.724+0000 7f84a50c8640 1 --2- 172.21.15.6:0/1161520664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f848c0039b0 0x7f848c003dc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f849c009ae0 tx=0x7f849c01ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0b25f043a31352e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:11.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.724+0000 7f8497fff640 1 -- 172.21.15.6:0/1161520664 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c0a5530 con 0x7f848c0039b0 2023-07-21T22:19:11.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.724+0000 7f8497fff640 1 -- 172.21.15.6:0/1161520664 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849c0a5690 con 0x7f848c0039b0 2023-07-21T22:19:11.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.724+0000 7f8497fff640 1 -- 172.21.15.6:0/1161520664 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c0a5a40 con 0x7f848c0039b0 2023-07-21T22:19:11.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.728+0000 7f84a732c640 1 -- 172.21.15.6:0/1161520664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f848c0039b0 msgr2=0x7f848c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:11.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.728+0000 7f84a732c640 1 --2- 172.21.15.6:0/1161520664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f848c0039b0 0x7f848c003dc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f849c009ae0 tx=0x7f849c01ca50 comp rx=0 tx=0).stop 2023-07-21T22:19:11.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.728+0000 7f84a58c9640 1 -- 172.21.15.6:0/1161520664 reap_dead start 2023-07-21T22:19:11.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.728+0000 7f84a732c640 1 -- 172.21.15.6:0/1161520664 shutdown_connections 2023-07-21T22:19:11.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.728+0000 7f84a732c640 1 -- 172.21.15.6:0/1161520664 >> 172.21.15.6:0/1161520664 conn(0x7f84a00650b0 msgr2=0x7f84a00654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:11.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.728+0000 7f84a732c640 1 -- 172.21.15.6:0/1161520664 shutdown_connections 2023-07-21T22:19:11.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.728+0000 7f84a732c640 1 -- 172.21.15.6:0/1161520664 wait complete. 2023-07-21T22:19:11.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.728+0000 7f84a732c640 1 Processor -- start 2023-07-21T22:19:11.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.728+0000 7f84a732c640 1 -- start start 2023-07-21T22:19:11.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.728+0000 7f84a732c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f848c0039b0 0x7f84a00b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:11.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.728+0000 7f84a732c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84a015cb40 0x7f84a00c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:11.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.728+0000 7f84a732c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84a00ca430 0x7f84a00c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:11.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.728+0000 7f84a732c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a015c720 con 0x7f84a015cb40 2023-07-21T22:19:11.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.728+0000 7f84a732c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a00b0ab0 con 0x7f848c0039b0 2023-07-21T22:19:11.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.728+0000 7f84a732c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a015c0f0 con 0x7f84a00ca430 2023-07-21T22:19:11.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.728+0000 7f84a48c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84a015cb40 0x7f84a00c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:11.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.728+0000 7f84a48c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84a015cb40 0x7f84a00c9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60672/0 (socket says 172.21.15.6:60672) 2023-07-21T22:19:11.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.728+0000 7f84a48c7640 1 -- 172.21.15.6:0/924393677 learned_addr learned my addr 172.21.15.6:0/924393677 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:11.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.732+0000 7f84a50c8640 1 --2- 172.21.15.6:0/924393677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f848c0039b0 0x7f84a00b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:11.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.732+0000 7f84a58c9640 1 --2- 172.21.15.6:0/924393677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84a00ca430 0x7f84a00c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:11.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.732+0000 7f84a48c7640 1 -- 172.21.15.6:0/924393677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84a00ca430 msgr2=0x7f84a00c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:11.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.732+0000 7f84a48c7640 1 --2- 172.21.15.6:0/924393677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84a00ca430 0x7f84a00c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:11.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.732+0000 7f84a48c7640 1 -- 172.21.15.6:0/924393677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f848c0039b0 msgr2=0x7f84a00b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:11.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.732+0000 7f84a48c7640 1 --2- 172.21.15.6:0/924393677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f848c0039b0 0x7f84a00b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:11.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.732+0000 7f84a48c7640 1 -- 172.21.15.6:0/924393677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a00ca9b0 con 0x7f84a015cb40 2023-07-21T22:19:11.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.732+0000 7f84a58c9640 1 --2- 172.21.15.6:0/924393677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84a00ca430 0x7f84a00c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:11.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.732+0000 7f84a48c7640 1 --2- 172.21.15.6:0/924393677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84a015cb40 0x7f84a00c9ef0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8490011cd0 tx=0x7f849000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:11.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.732+0000 7f8495ffb640 1 -- 172.21.15.6:0/924393677 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849000fcc0 con 0x7f84a015cb40 2023-07-21T22:19:11.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.732+0000 7f8495ffb640 1 -- 172.21.15.6:0/924393677 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849000fe20 con 0x7f84a015cb40 2023-07-21T22:19:11.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.732+0000 7f8495ffb640 1 -- 172.21.15.6:0/924393677 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8490014680 con 0x7f84a015cb40 2023-07-21T22:19:11.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.732+0000 7f84a732c640 1 -- 172.21.15.6:0/924393677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a00cac90 con 0x7f84a015cb40 2023-07-21T22:19:11.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.732+0000 7f84a732c640 1 -- 172.21.15.6:0/924393677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a015cfb0 con 0x7f84a015cb40 2023-07-21T22:19:11.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.732+0000 7f84a732c640 1 -- 172.21.15.6:0/924393677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a00d07e0 con 0x7f84a015cb40 2023-07-21T22:19:11.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.732+0000 7f8495ffb640 1 -- 172.21.15.6:0/924393677 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f84900147e0 con 0x7f84a015cb40 2023-07-21T22:19:11.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.732+0000 7f8495ffb640 1 --2- 172.21.15.6:0/924393677 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f8484066280 0x7f8484068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:11.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.736+0000 7f8495ffb640 1 -- 172.21.15.6:0/924393677 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f84900846a0 con 0x7f84a015cb40 2023-07-21T22:19:11.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.736+0000 7f84a50c8640 1 --2- 172.21.15.6:0/924393677 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f8484066280 0x7f8484068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:11.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.736+0000 7f84a50c8640 1 --2- 172.21.15.6:0/924393677 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f8484066280 0x7f8484068730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f849c0af000 tx=0x7f849c0046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:11.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.736+0000 7f8495ffb640 1 -- 172.21.15.6:0/924393677 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8490051b10 con 0x7f84a015cb40 2023-07-21T22:19:11.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.924+0000 7f84a732c640 1 -- 172.21.15.6:0/924393677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f84a015c860 con 0x7f84a015cb40 2023-07-21T22:19:11.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.924+0000 7f8495ffb640 1 -- 172.21.15.6:0/924393677 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f84a015c860 con 0x7f84a015cb40 2023-07-21T22:19:11.973 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T22:19:11.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.928+0000 7f84a732c640 1 -- 172.21.15.6:0/924393677 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f8484066280 msgr2=0x7f8484068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:11.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.928+0000 7f84a732c640 1 --2- 172.21.15.6:0/924393677 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f8484066280 0x7f8484068730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f849c0af000 tx=0x7f849c0046d0 comp rx=0 tx=0).stop 2023-07-21T22:19:11.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.928+0000 7f84a732c640 1 -- 172.21.15.6:0/924393677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84a015cb40 msgr2=0x7f84a00c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:11.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.928+0000 7f84a732c640 1 --2- 172.21.15.6:0/924393677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84a015cb40 0x7f84a00c9ef0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8490011cd0 tx=0x7f849000f610 comp rx=0 tx=0).stop 2023-07-21T22:19:11.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.928+0000 7f84a732c640 1 -- 172.21.15.6:0/924393677 shutdown_connections 2023-07-21T22:19:11.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.928+0000 7f84a732c640 1 --2- 172.21.15.6:0/924393677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84a00ca430 0x7f84a00c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:11.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.928+0000 7f84a732c640 1 --2- 172.21.15.6:0/924393677 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f8484066280 0x7f8484068730 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:11.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.928+0000 7f84a732c640 1 --2- 172.21.15.6:0/924393677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84a015cb40 0x7f84a00c9ef0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:11.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.928+0000 7f84a732c640 1 --2- 172.21.15.6:0/924393677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f848c0039b0 0x7f84a00b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:11.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.928+0000 7f84a732c640 1 -- 172.21.15.6:0/924393677 >> 172.21.15.6:0/924393677 conn(0x7f84a00650b0 msgr2=0x7f84a00d1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:11.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.928+0000 7f84a732c640 1 -- 172.21.15.6:0/924393677 shutdown_connections 2023-07-21T22:19:11.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:11.928+0000 7f84a732c640 1 -- 172.21.15.6:0/924393677 wait complete. 2023-07-21T22:19:11.994 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T22:19:11.994 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:19:11.994 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-07-21T22:19:11.994 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-07-21T22:19:11.995 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-21T22:19:11.995 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T22:19:11.995 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T22:19:11.995 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:19:11.995 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-07-21T22:19:11.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:11.996 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-07-21T22:19:12.005 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:19:12.005 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:19:12.006 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:19:12.006 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:12.006 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-07-21T22:19:12.006 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:12.006 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:19:12.006 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:12.006 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2023-07-21T22:19:12.007 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:19:12.007 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:12.007 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2023-07-21T22:19:12.007 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:19:12.007 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:12.007 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:19:12.007 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:12.008 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-21T22:19:12.008 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42157sec preferred_lft 42157sec 2023-07-21T22:19:12.008 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2023-07-21T22:19:12.008 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:12.008 INFO:teuthology.orchestra.run.smithi161.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:19:12.008 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 02:42:cd:b0:0a:f0 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:12.008 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:19:12.009 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:12.009 INFO:teuthology.orchestra.run.smithi161.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:19:12.009 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:12.009 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T22:19:12.009 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:12.009 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-07-21T22:19:12.010 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:12.010 INFO:teuthology.orchestra.run.smithi161.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:19:12.010 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-21T22:19:12.010 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-07-21T22:19:12.010 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:12.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:12.013 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:19:12.076 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-07-21T22:19:12.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:12.078 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-07-21T22:19:12.130 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-07-21T22:19:12.131 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:19:12.131 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-21T22:19:12.131 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-21T22:19:12.131 INFO:teuthology.orchestra.run.smithi161.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:19:12.131 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-21T22:19:12.131 INFO:teuthology.orchestra.run.smithi161.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-21T22:19:12.131 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-21T22:19:12.132 INFO:teuthology.orchestra.run.smithi161.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-21T22:19:12.132 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:19:12.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:12.132 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-07-21T22:19:12.133 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-07-21T22:19:12.133 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-21T22:19:12.133 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-21T22:19:12.133 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-21T22:19:12.133 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-07-21T22:19:12.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:12.224 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-07-21T22:19:12.233 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-21T22:19:12.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:12.234 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list-id 2023-07-21T22:19:12.284 INFO:teuthology.orchestra.run.smithi161.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-07-21T22:19:12.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:12.285 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-07-21T22:19:12.285 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-07-21T22:19:12.286 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-21T22:19:12.286 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-07-21T22:19:12.286 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-07-21T22:19:12.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:12.373 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-21T22:19:12.437 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:19:12.437 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:19:12.438 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:19:12.438 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:12.438 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-07-21T22:19:12.439 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:12.439 INFO:teuthology.orchestra.run.smithi161.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:19:12.439 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 3e:47:4e:74:bc:75 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-21T22:19:12.440 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-21T22:19:12.440 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:12.440 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::3c47:4eff:fe74:bc75/64 scope link tentative 2023-07-21T22:19:12.441 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:12.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:12.443 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-21T22:19:12.505 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:19:12.505 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:19:12.505 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:19:12.505 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:12.506 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-07-21T22:19:12.506 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:12.506 INFO:teuthology.orchestra.run.smithi161.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:19:12.506 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 3e:47:4e:74:bc:75 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-21T22:19:12.506 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-21T22:19:12.506 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:12.506 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::3c47:4eff:fe74:bc75/64 scope link tentative 2023-07-21T22:19:12.507 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:12.507 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-07-21T22:19:12.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:12.508 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-07-21T22:19:12.508 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-07-21T22:19:12.509 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-07-21T22:19:12.509 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-21T22:19:12.509 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-07-21T22:19:12.509 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-07-21T22:19:12.510 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-07-21T22:19:12.510 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-07-21T22:19:12.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:12.649 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-07-21T22:19:12.649 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-07-21T22:19:12.649 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.1 up 2023-07-21T22:19:12.650 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set dev brx.1 master ceph-brx 2023-07-21T22:19:12.650 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-07-21T22:19:12.690 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:19:12.691 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-07-21T22:19:12.740 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-07-21T22:19:12.741 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:19:12.741 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-07-21T22:19:12.791 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-21T22:19:12.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:12.792 DEBUG:teuthology.orchestra.run.smithi161:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-21T22:19:12.886 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-21T22:19:12.887 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-21T22:19:12.887 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-07-21T22:19:12.902 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-21T22:19:12.902 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-21T22:19:12.902 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-07-21T22:19:12.902 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:19:12.903 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:19:12.909 INFO:teuthology.orchestra.run.smithi161.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-21T22:19:12.910 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-21T22:19:12.910 INFO:teuthology.orchestra.run.smithi161.stdout:invalid new device string format 2023-07-21T22:19:12.910 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:19:12.910 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:19:12.910 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-07-21T22:19:12.910 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-07-21T22:19:12.910 INFO:teuthology.orchestra.run.smithi161.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=f3073df4-6cd1-4503-bd2e-d3e98fa18bdf" will pass to kernel 2023-07-21T22:19:12.913 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T22:19:12.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:12.914 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-07-21T22:19:12.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:12.934 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:19:12.990 INFO:teuthology.orchestra.run.smithi161.stdout:client4765 2023-07-21T22:19:12.991 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:19:12.991 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:19:13.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:13.045 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:19:13.099 INFO:teuthology.orchestra.run.smithi161.stdout:client4765 2023-07-21T22:19:13.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:13.100 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:19:13.150 INFO:teuthology.orchestra.run.smithi161.stdout:client4765 2023-07-21T22:19:13.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:13.151 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f3073df4-6cd1-4503-bd2e-d3e98fa18bdf.client4765/status') 2023-07-21T22:19:13.212 INFO:teuthology.orchestra.run.smithi161.stdout:instance: client.4765 (3)192.168.0.2:0/3134132466 2023-07-21T22:19:13.213 INFO:teuthology.orchestra.run.smithi161.stdout:blocklisted: false 2023-07-21T22:19:13.213 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records in 2023-07-21T22:19:13.213 INFO:teuthology.orchestra.run.smithi161.stderr:0+1 records out 2023-07-21T22:19:13.213 INFO:teuthology.orchestra.run.smithi161.stderr:69 bytes copied, 6.8428e-05 s, 1.0 MB/s 2023-07-21T22:19:13.214 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-21T22:19:13.233 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:19:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.340+0000 7fad0ad74640 1 Processor -- start 2023-07-21T22:19:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.340+0000 7fad0ad74640 1 -- start start 2023-07-21T22:19:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.344+0000 7fad0ad74640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fad040c9730 0x7fad041638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.344+0000 7fad0ad74640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad040cc700 con 0x7fad040c8ad0 2023-07-21T22:19:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.344+0000 7fad0ad74640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad040b0ff0 con 0x7fad04158ce0 2023-07-21T22:19:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.344+0000 7fad0ad74640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad04070c80 con 0x7fad040c9730 2023-07-21T22:19:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.344+0000 7fad03fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fad040c8ad0 0x7fad040c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55864/0 (socket says 172.21.15.6:55864) 2023-07-21T22:19:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.344+0000 7fad03fff640 1 -- 172.21.15.6:0/3050665852 learned_addr learned my addr 172.21.15.6:0/3050665852 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.344+0000 7fad09311640 1 --2- 172.21.15.6:0/3050665852 >> v2:172.21.15.6:3300/0 conn(0x7fad040c9730 0x7fad041638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.344+0000 7fad037fe640 1 -- 172.21.15.6:0/3050665852 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 161478153 0 0) 0x7fad040cc700 con 0x7fad040c8ad0 2023-07-21T22:19:13.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.344+0000 7fad037fe640 1 -- 172.21.15.6:0/3050665852 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facf4003530 con 0x7fad040c8ad0 2023-07-21T22:19:13.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.344+0000 7fad09311640 1 -- 172.21.15.6:0/3050665852 >> v1:172.21.15.161:6789/0 conn(0x7fad04158ce0 legacy=0x7fad04070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.344+0000 7fad09311640 1 -- 172.21.15.6:0/3050665852 >> v1:172.21.15.6:6789/0 conn(0x7fad040c8ad0 legacy=0x7fad040c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.344+0000 7fad09311640 1 -- 172.21.15.6:0/3050665852 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad040cbdd0 con 0x7fad040c9730 2023-07-21T22:19:13.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.348+0000 7fad09311640 1 --2- 172.21.15.6:0/3050665852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad040c9730 0x7fad041638b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7facfc009d90 tx=0x7facfc01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f890d2c075b93e3f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:13.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.348+0000 7fad037fe640 1 -- 172.21.15.6:0/3050665852 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc0a57d0 con 0x7fad040c9730 2023-07-21T22:19:13.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.348+0000 7fad037fe640 1 -- 172.21.15.6:0/3050665852 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc0a5930 con 0x7fad040c9730 2023-07-21T22:19:13.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.348+0000 7fad037fe640 1 -- 172.21.15.6:0/3050665852 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc0a5ca0 con 0x7fad040c9730 2023-07-21T22:19:13.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.348+0000 7fad0ad74640 1 -- 172.21.15.6:0/3050665852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad040c9730 msgr2=0x7fad041638b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.348+0000 7fad0ad74640 1 --2- 172.21.15.6:0/3050665852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad040c9730 0x7fad041638b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7facfc009d90 tx=0x7facfc01c800 comp rx=0 tx=0).stop 2023-07-21T22:19:13.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.348+0000 7fad0ad74640 1 -- 172.21.15.6:0/3050665852 shutdown_connections 2023-07-21T22:19:13.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.348+0000 7fad0ad74640 1 --2- 172.21.15.6:0/3050665852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad040c9730 0x7fad041638b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.348+0000 7fad0ad74640 1 -- 172.21.15.6:0/3050665852 >> 172.21.15.6:0/3050665852 conn(0x7fad040afcf0 msgr2=0x7fad040b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:13.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.348+0000 7fad0ad74640 1 -- 172.21.15.6:0/3050665852 shutdown_connections 2023-07-21T22:19:13.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.348+0000 7fad0ad74640 1 -- 172.21.15.6:0/3050665852 wait complete. 2023-07-21T22:19:13.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.348+0000 7fad0ad74640 1 Processor -- start 2023-07-21T22:19:13.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.348+0000 7fad0ad74640 1 -- start start 2023-07-21T22:19:13.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad0ad74640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad040c8ad0 0x7fad04144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:13.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad0ad74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad040c9730 0x7fad04150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:13.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad0ad74640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad04158ce0 0x7fad040ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:13.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad0ad74640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0415a090 con 0x7fad040c9730 2023-07-21T22:19:13.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad0ad74640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0415a370 con 0x7fad04158ce0 2023-07-21T22:19:13.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad0ad74640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0415a650 con 0x7fad040c8ad0 2023-07-21T22:19:13.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad03fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad040c9730 0x7fad04150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:13.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad03fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad040c9730 0x7fad04150850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60692/0 (socket says 172.21.15.6:60692) 2023-07-21T22:19:13.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad03fff640 1 -- 172.21.15.6:0/1022660965 learned_addr learned my addr 172.21.15.6:0/1022660965 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:13.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad08b10640 1 --2- 172.21.15.6:0/1022660965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad040c8ad0 0x7fad04144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:13.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad09311640 1 --2- 172.21.15.6:0/1022660965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad04158ce0 0x7fad040ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad03fff640 1 -- 172.21.15.6:0/1022660965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad040c8ad0 msgr2=0x7fad04144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad03fff640 1 --2- 172.21.15.6:0/1022660965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad040c8ad0 0x7fad04144650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad03fff640 1 -- 172.21.15.6:0/1022660965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad04158ce0 msgr2=0x7fad040ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad03fff640 1 --2- 172.21.15.6:0/1022660965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad04158ce0 0x7fad040ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad03fff640 1 -- 172.21.15.6:0/1022660965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc009a70 con 0x7fad040c9730 2023-07-21T22:19:13.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad08b10640 1 --2- 172.21.15.6:0/1022660965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad040c8ad0 0x7fad04144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:13.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad03fff640 1 --2- 172.21.15.6:0/1022660965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad040c9730 0x7fad04150850 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7facf000c420 tx=0x7facf000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:13.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad017fa640 1 -- 172.21.15.6:0/1022660965 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0005cf0 con 0x7fad040c9730 2023-07-21T22:19:13.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad017fa640 1 -- 172.21.15.6:0/1022660965 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf0005e50 con 0x7fad040c9730 2023-07-21T22:19:13.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad017fa640 1 -- 172.21.15.6:0/1022660965 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf00072d0 con 0x7fad040c9730 2023-07-21T22:19:13.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad0ad74640 1 -- 172.21.15.6:0/1022660965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0415a930 con 0x7fad040c9730 2023-07-21T22:19:13.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad0ad74640 1 -- 172.21.15.6:0/1022660965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad04144b90 con 0x7fad040c9730 2023-07-21T22:19:13.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad0ad74640 1 -- 172.21.15.6:0/1022660965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad040ca1a0 con 0x7fad040c9730 2023-07-21T22:19:13.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.352+0000 7fad017fa640 1 -- 172.21.15.6:0/1022660965 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7facf0007430 con 0x7fad040c9730 2023-07-21T22:19:13.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.356+0000 7fad017fa640 1 --2- 172.21.15.6:0/1022660965 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7face8066280 0x7face8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:13.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.356+0000 7fad017fa640 1 -- 172.21.15.6:0/1022660965 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7facf00832a0 con 0x7fad040c9730 2023-07-21T22:19:13.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.356+0000 7fad08b10640 1 --2- 172.21.15.6:0/1022660965 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7face8066280 0x7face8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:13.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.356+0000 7fad08b10640 1 --2- 172.21.15.6:0/1022660965 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7face8066280 0x7face8068730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7facf8000f70 tx=0x7facf8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:13.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.360+0000 7fad017fa640 1 -- 172.21.15.6:0/1022660965 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7facf0050730 con 0x7fad040c9730 2023-07-21T22:19:13.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.516+0000 7fad0ad74640 1 -- 172.21.15.6:0/1022660965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad0415c600 con 0x7fad040c9730 2023-07-21T22:19:13.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.516+0000 7fad017fa640 1 -- 172.21.15.6:0/1022660965 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18207 (secure 0 0 0) 0x7facf0053d50 con 0x7fad040c9730 2023-07-21T22:19:13.564 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:13.564 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:18:45.315608+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:18:41.465054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:18:42.709896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:19:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.520+0000 7fad0ad74640 1 -- 172.21.15.6:0/1022660965 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7face8066280 msgr2=0x7face8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.520+0000 7fad0ad74640 1 --2- 172.21.15.6:0/1022660965 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7face8066280 0x7face8068730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7facf8000f70 tx=0x7facf8009040 comp rx=0 tx=0).stop 2023-07-21T22:19:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.520+0000 7fad0ad74640 1 -- 172.21.15.6:0/1022660965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad040c9730 msgr2=0x7fad04150850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.520+0000 7fad0ad74640 1 --2- 172.21.15.6:0/1022660965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad040c9730 0x7fad04150850 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7facf000c420 tx=0x7facf000c8e0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.520+0000 7fad0ad74640 1 -- 172.21.15.6:0/1022660965 shutdown_connections 2023-07-21T22:19:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.520+0000 7fad0ad74640 1 --2- 172.21.15.6:0/1022660965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad04158ce0 0x7fad040ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.520+0000 7fad0ad74640 1 --2- 172.21.15.6:0/1022660965 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7face8066280 0x7face8068730 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.520+0000 7fad0ad74640 1 --2- 172.21.15.6:0/1022660965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad040c9730 0x7fad04150850 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.520+0000 7fad0ad74640 1 --2- 172.21.15.6:0/1022660965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad040c8ad0 0x7fad04144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.520+0000 7fad0ad74640 1 -- 172.21.15.6:0/1022660965 >> 172.21.15.6:0/1022660965 conn(0x7fad040afcf0 msgr2=0x7fad04151c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:13.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.520+0000 7fad0ad74640 1 -- 172.21.15.6:0/1022660965 shutdown_connections 2023-07-21T22:19:13.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.520+0000 7fad0ad74640 1 -- 172.21.15.6:0/1022660965 wait complete. 2023-07-21T22:19:13.585 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:18:41.465054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:18:42.709896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:19:13.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:19:13.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.688+0000 7fc36080b640 1 Processor -- start 2023-07-21T22:19:13.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.688+0000 7fc36080b640 1 -- start start 2023-07-21T22:19:13.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.688+0000 7fc36080b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc35c0c2d30 0x7fc35c0c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:13.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.688+0000 7fc36080b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c154280 con 0x7fc35c0ca370 2023-07-21T22:19:13.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.688+0000 7fc36080b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc35c06d430 con 0x7fc35c069430 2023-07-21T22:19:13.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.688+0000 7fc36080b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0c31a0 con 0x7fc35c0c2d30 2023-07-21T22:19:13.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.688+0000 7fc35ad9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc35c0ca370 0x7fc35c159fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55878/0 (socket says 172.21.15.6:55878) 2023-07-21T22:19:13.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.688+0000 7fc35ad9d640 1 -- 172.21.15.6:0/1979086312 learned_addr learned my addr 172.21.15.6:0/1979086312 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:13.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.688+0000 7fc353fff640 1 --2- 172.21.15.6:0/1979086312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc35c0c2d30 0x7fc35c0c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:13.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.688+0000 7fc359d9b640 1 -- 172.21.15.6:0/1979086312 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270998631 0 0) 0x7fc35c154280 con 0x7fc35c0ca370 2023-07-21T22:19:13.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.688+0000 7fc359d9b640 1 -- 172.21.15.6:0/1979086312 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc348003530 con 0x7fc35c0ca370 2023-07-21T22:19:13.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.688+0000 7fc359d9b640 1 -- 172.21.15.6:0/1979086312 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884455586 0 0) 0x7fc35c06d430 con 0x7fc35c069430 2023-07-21T22:19:13.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.688+0000 7fc359d9b640 1 -- 172.21.15.6:0/1979086312 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc35c154280 con 0x7fc35c069430 2023-07-21T22:19:13.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.688+0000 7fc353fff640 1 -- 172.21.15.6:0/1979086312 >> v1:172.21.15.161:6789/0 conn(0x7fc35c069430 legacy=0x7fc35c069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.688+0000 7fc353fff640 1 -- 172.21.15.6:0/1979086312 >> v1:172.21.15.6:6789/0 conn(0x7fc35c0ca370 legacy=0x7fc35c159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.688+0000 7fc353fff640 1 -- 172.21.15.6:0/1979086312 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c06cb00 con 0x7fc35c0c2d30 2023-07-21T22:19:13.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.692+0000 7fc353fff640 1 --2- 172.21.15.6:0/1979086312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc35c0c2d30 0x7fc35c0c9e30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc3440097f0 tx=0x7fc34401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70c7c019d10c9172 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:13.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.692+0000 7fc359d9b640 1 -- 172.21.15.6:0/1979086312 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3440ab600 con 0x7fc35c0c2d30 2023-07-21T22:19:13.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.692+0000 7fc359d9b640 1 -- 172.21.15.6:0/1979086312 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3440ab760 con 0x7fc35c0c2d30 2023-07-21T22:19:13.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.692+0000 7fc359d9b640 1 -- 172.21.15.6:0/1979086312 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3440abaf0 con 0x7fc35c0c2d30 2023-07-21T22:19:13.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.692+0000 7fc36080b640 1 -- 172.21.15.6:0/1979086312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc35c0c2d30 msgr2=0x7fc35c0c9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.692+0000 7fc36080b640 1 --2- 172.21.15.6:0/1979086312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc35c0c2d30 0x7fc35c0c9e30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc3440097f0 tx=0x7fc34401c400 comp rx=0 tx=0).stop 2023-07-21T22:19:13.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.692+0000 7fc36080b640 1 -- 172.21.15.6:0/1979086312 shutdown_connections 2023-07-21T22:19:13.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.692+0000 7fc36080b640 1 --2- 172.21.15.6:0/1979086312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc35c0c2d30 0x7fc35c0c9e30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.692+0000 7fc36080b640 1 -- 172.21.15.6:0/1979086312 >> 172.21.15.6:0/1979086312 conn(0x7fc35c0cde50 msgr2=0x7fc35c0ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:13.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.692+0000 7fc36080b640 1 -- 172.21.15.6:0/1979086312 shutdown_connections 2023-07-21T22:19:13.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.692+0000 7fc36080b640 1 -- 172.21.15.6:0/1979086312 wait complete. 2023-07-21T22:19:13.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc36080b640 1 Processor -- start 2023-07-21T22:19:13.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc36080b640 1 -- start start 2023-07-21T22:19:13.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc36080b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc35c069430 0x7fc35c0b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:13.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc36080b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc35c0c2d30 0x7fc35c0b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:13.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc36080b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc35c0cce00 0x7fc35c158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:13.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc36080b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0cd9c0 con 0x7fc35c0c2d30 2023-07-21T22:19:13.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc36080b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c14da00 con 0x7fc35c0cce00 2023-07-21T22:19:13.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc36080b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c0b15c0 con 0x7fc35c069430 2023-07-21T22:19:13.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc353fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc35c0c2d30 0x7fc35c0b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:13.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc353fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc35c0c2d30 0x7fc35c0b2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60708/0 (socket says 172.21.15.6:60708) 2023-07-21T22:19:13.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc353fff640 1 -- 172.21.15.6:0/4121728536 learned_addr learned my addr 172.21.15.6:0/4121728536 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:13.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc35ad9d640 1 --2- 172.21.15.6:0/4121728536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc35c0cce00 0x7fc35c158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:13.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc35a59c640 1 --2- 172.21.15.6:0/4121728536 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc35c069430 0x7fc35c0b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:13.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc353fff640 1 -- 172.21.15.6:0/4121728536 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc35c069430 msgr2=0x7fc35c0b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc353fff640 1 --2- 172.21.15.6:0/4121728536 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc35c069430 0x7fc35c0b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc353fff640 1 -- 172.21.15.6:0/4121728536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc35c0cce00 msgr2=0x7fc35c158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc353fff640 1 --2- 172.21.15.6:0/4121728536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc35c0cce00 0x7fc35c158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc353fff640 1 -- 172.21.15.6:0/4121728536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc344009420 con 0x7fc35c0c2d30 2023-07-21T22:19:13.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc35a59c640 1 --2- 172.21.15.6:0/4121728536 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc35c069430 0x7fc35c0b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:13.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc353fff640 1 --2- 172.21.15.6:0/4121728536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc35c0c2d30 0x7fc35c0b2f20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc344019010 tx=0x7fc34401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:13.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc352ffd640 1 -- 172.21.15.6:0/4121728536 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3440bf610 con 0x7fc35c0c2d30 2023-07-21T22:19:13.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc352ffd640 1 -- 172.21.15.6:0/4121728536 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3440bf790 con 0x7fc35c0c2d30 2023-07-21T22:19:13.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc36080b640 1 -- 172.21.15.6:0/4121728536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35c0c3e80 con 0x7fc35c0c2d30 2023-07-21T22:19:13.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc352ffd640 1 -- 172.21.15.6:0/4121728536 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3440bfb40 con 0x7fc35c0c2d30 2023-07-21T22:19:13.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.696+0000 7fc36080b640 1 -- 172.21.15.6:0/4121728536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35c0b1b80 con 0x7fc35c0c2d30 2023-07-21T22:19:13.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.700+0000 7fc36080b640 1 -- 172.21.15.6:0/4121728536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35c14dbc0 con 0x7fc35c0c2d30 2023-07-21T22:19:13.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.700+0000 7fc352ffd640 1 -- 172.21.15.6:0/4121728536 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc3440b5400 con 0x7fc35c0c2d30 2023-07-21T22:19:13.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.700+0000 7fc352ffd640 1 --2- 172.21.15.6:0/4121728536 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc33c0662b0 0x7fc33c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:13.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.700+0000 7fc352ffd640 1 -- 172.21.15.6:0/4121728536 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc34411e930 con 0x7fc35c0c2d30 2023-07-21T22:19:13.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.700+0000 7fc35a59c640 1 --2- 172.21.15.6:0/4121728536 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc33c0662b0 0x7fc33c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:13.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.700+0000 7fc35a59c640 1 --2- 172.21.15.6:0/4121728536 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc33c0662b0 0x7fc33c068760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0011f0 tx=0x7fc34c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:13.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.704+0000 7fc352ffd640 1 -- 172.21.15.6:0/4121728536 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc3440ebf80 con 0x7fc35c0c2d30 2023-07-21T22:19:13.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.860+0000 7fc36080b640 1 -- 172.21.15.6:0/4121728536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc35c0678d0 con 0x7fc35c0c2d30 2023-07-21T22:19:13.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.860+0000 7fc352ffd640 1 -- 172.21.15.6:0/4121728536 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3440ef5a0 con 0x7fc35c0c2d30 2023-07-21T22:19:13.906 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:19:13.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.860+0000 7fc36080b640 1 -- 172.21.15.6:0/4121728536 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc33c0662b0 msgr2=0x7fc33c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.860+0000 7fc36080b640 1 --2- 172.21.15.6:0/4121728536 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc33c0662b0 0x7fc33c068760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc34c0011f0 tx=0x7fc34c009040 comp rx=0 tx=0).stop 2023-07-21T22:19:13.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.860+0000 7fc36080b640 1 -- 172.21.15.6:0/4121728536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc35c0c2d30 msgr2=0x7fc35c0b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.860+0000 7fc36080b640 1 --2- 172.21.15.6:0/4121728536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc35c0c2d30 0x7fc35c0b2f20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc344019010 tx=0x7fc34401ac40 comp rx=0 tx=0).stop 2023-07-21T22:19:13.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.860+0000 7fc36080b640 1 -- 172.21.15.6:0/4121728536 shutdown_connections 2023-07-21T22:19:13.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.860+0000 7fc36080b640 1 --2- 172.21.15.6:0/4121728536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc35c0cce00 0x7fc35c158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.860+0000 7fc36080b640 1 --2- 172.21.15.6:0/4121728536 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc33c0662b0 0x7fc33c068760 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.860+0000 7fc36080b640 1 --2- 172.21.15.6:0/4121728536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc35c0c2d30 0x7fc35c0b2f20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.860+0000 7fc36080b640 1 --2- 172.21.15.6:0/4121728536 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc35c069430 0x7fc35c0b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.860+0000 7fc36080b640 1 -- 172.21.15.6:0/4121728536 >> 172.21.15.6:0/4121728536 conn(0x7fc35c0cde50 msgr2=0x7fc35c0ada10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:13.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.860+0000 7fc36080b640 1 -- 172.21.15.6:0/4121728536 shutdown_connections 2023-07-21T22:19:13.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:13.860+0000 7fc36080b640 1 -- 172.21.15.6:0/4121728536 wait complete. 2023-07-21T22:19:13.927 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:19:14.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.028+0000 7f5a4c048640 1 Processor -- start 2023-07-21T22:19:14.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.028+0000 7f5a4c048640 1 -- start start 2023-07-21T22:19:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.028+0000 7f5a4c048640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5a4406a440 0x7f5a440b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.028+0000 7f5a4c048640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5a441453a0 0x7f5a4406c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.028+0000 7f5a4c048640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4406c040 con 0x7f5a4415f690 2023-07-21T22:19:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.028+0000 7f5a4c048640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a44160170 con 0x7f5a441453a0 2023-07-21T22:19:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.028+0000 7f5a4c048640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a44160600 con 0x7f5a4406a440 2023-07-21T22:19:14.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.028+0000 7f5a49de4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5a4415f690 0x7f5a4415fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55880/0 (socket says 172.21.15.6:55880) 2023-07-21T22:19:14.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.028+0000 7f5a49de4640 1 -- 172.21.15.6:0/2173368919 learned_addr learned my addr 172.21.15.6:0/2173368919 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:14.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.028+0000 7f5a4a5e5640 1 --2- 172.21.15.6:0/2173368919 >> v2:172.21.15.6:3300/0 conn(0x7f5a441453a0 0x7f5a4406c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:14.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.028+0000 7f5a495e3640 1 --2- 172.21.15.6:0/2173368919 >> v2:172.21.15.161:3300/0 conn(0x7f5a4406a440 0x7f5a440b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:14.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.028+0000 7f5a48de2640 1 -- 172.21.15.6:0/2173368919 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 909187503 0 0) 0x7f5a4406c040 con 0x7f5a4415f690 2023-07-21T22:19:14.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.028+0000 7f5a48de2640 1 -- 172.21.15.6:0/2173368919 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a30003530 con 0x7f5a4415f690 2023-07-21T22:19:14.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.028+0000 7f5a4a5e5640 1 -- 172.21.15.6:0/2173368919 >> v2:172.21.15.161:3300/0 conn(0x7f5a4406a440 msgr2=0x7f5a440b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:14.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.028+0000 7f5a4a5e5640 1 --2- 172.21.15.6:0/2173368919 >> v2:172.21.15.161:3300/0 conn(0x7f5a4406a440 0x7f5a440b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.028+0000 7f5a4a5e5640 1 -- 172.21.15.6:0/2173368919 >> v1:172.21.15.6:6789/0 conn(0x7f5a4415f690 legacy=0x7f5a4415fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:14.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.028+0000 7f5a4a5e5640 1 -- 172.21.15.6:0/2173368919 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a44160360 con 0x7f5a441453a0 2023-07-21T22:19:14.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.032+0000 7f5a4a5e5640 1 --2- 172.21.15.6:0/2173368919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a441453a0 0x7f5a4406c4d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5a44070f70 tx=0x7f5a3c01c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfee0eca4c9ce12 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:14.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.032+0000 7f5a48de2640 1 -- 172.21.15.6:0/2173368919 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c0a6650 con 0x7f5a441453a0 2023-07-21T22:19:14.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.032+0000 7f5a48de2640 1 -- 172.21.15.6:0/2173368919 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c0a67b0 con 0x7f5a441453a0 2023-07-21T22:19:14.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.032+0000 7f5a48de2640 1 -- 172.21.15.6:0/2173368919 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c0a6b40 con 0x7f5a441453a0 2023-07-21T22:19:14.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.032+0000 7f5a4c048640 1 -- 172.21.15.6:0/2173368919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a441453a0 msgr2=0x7f5a4406c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:14.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.032+0000 7f5a4c048640 1 --2- 172.21.15.6:0/2173368919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a441453a0 0x7f5a4406c4d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5a44070f70 tx=0x7f5a3c01c670 comp rx=0 tx=0).stop 2023-07-21T22:19:14.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.032+0000 7f5a4c048640 1 -- 172.21.15.6:0/2173368919 shutdown_connections 2023-07-21T22:19:14.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.032+0000 7f5a4c048640 1 --2- 172.21.15.6:0/2173368919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a441453a0 0x7f5a4406c4d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.032+0000 7f5a4c048640 1 --2- 172.21.15.6:0/2173368919 >> v2:172.21.15.161:3300/0 conn(0x7f5a4406a440 0x7f5a440b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.032+0000 7f5a4c048640 1 -- 172.21.15.6:0/2173368919 >> 172.21.15.6:0/2173368919 conn(0x7f5a440b1210 msgr2=0x7f5a440ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:14.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.032+0000 7f5a4c048640 1 -- 172.21.15.6:0/2173368919 shutdown_connections 2023-07-21T22:19:14.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.032+0000 7f5a4c048640 1 -- 172.21.15.6:0/2173368919 wait complete. 2023-07-21T22:19:14.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a4c048640 1 Processor -- start 2023-07-21T22:19:14.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a4c048640 1 -- start start 2023-07-21T22:19:14.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a4c048640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a4406a440 0x7f5a44141f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:14.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a4c048640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a441453a0 0x7f5a440af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:14.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a4c048640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a4415f690 0x7f5a440afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:14.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a4c048640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a44158220 con 0x7f5a4415f690 2023-07-21T22:19:14.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a4c048640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a440b0290 con 0x7f5a4406a440 2023-07-21T22:19:14.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a4c048640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4413cd80 con 0x7f5a441453a0 2023-07-21T22:19:14.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a4a5e5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a4415f690 0x7f5a440afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:14.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a49de4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a4406a440 0x7f5a44141f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:14.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a4a5e5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a4415f690 0x7f5a440afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60732/0 (socket says 172.21.15.6:60732) 2023-07-21T22:19:14.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a4a5e5640 1 -- 172.21.15.6:0/3557304854 learned_addr learned my addr 172.21.15.6:0/3557304854 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:14.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a495e3640 1 --2- 172.21.15.6:0/3557304854 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a441453a0 0x7f5a440af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:14.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a4a5e5640 1 -- 172.21.15.6:0/3557304854 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a441453a0 msgr2=0x7f5a440af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:14.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a4a5e5640 1 --2- 172.21.15.6:0/3557304854 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a441453a0 0x7f5a440af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a4a5e5640 1 -- 172.21.15.6:0/3557304854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a4406a440 msgr2=0x7f5a44141f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:14.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a4a5e5640 1 --2- 172.21.15.6:0/3557304854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a4406a440 0x7f5a44141f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a4a5e5640 1 -- 172.21.15.6:0/3557304854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c009a70 con 0x7f5a4415f690 2023-07-21T22:19:14.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a4a5e5640 1 --2- 172.21.15.6:0/3557304854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a4415f690 0x7f5a440afd50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c01a2a0 tx=0x7f5a3c019410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:14.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a3a7fc640 1 -- 172.21.15.6:0/3557304854 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c0b6070 con 0x7f5a4415f690 2023-07-21T22:19:14.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a3a7fc640 1 -- 172.21.15.6:0/3557304854 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c009450 con 0x7f5a4415f690 2023-07-21T22:19:14.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a3a7fc640 1 -- 172.21.15.6:0/3557304854 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c0a7650 con 0x7f5a4415f690 2023-07-21T22:19:14.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a4c048640 1 -- 172.21.15.6:0/3557304854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a440aea50 con 0x7f5a4415f690 2023-07-21T22:19:14.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a4c048640 1 -- 172.21.15.6:0/3557304854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a440af010 con 0x7f5a4415f690 2023-07-21T22:19:14.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.036+0000 7f5a4c048640 1 -- 172.21.15.6:0/3557304854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a440678d0 con 0x7f5a4415f690 2023-07-21T22:19:14.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.040+0000 7f5a3a7fc640 1 -- 172.21.15.6:0/3557304854 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5a3c0ba410 con 0x7f5a4415f690 2023-07-21T22:19:14.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.040+0000 7f5a3a7fc640 1 --2- 172.21.15.6:0/3557304854 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5a28066280 0x7f5a28068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:14.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.040+0000 7f5a3a7fc640 1 -- 172.21.15.6:0/3557304854 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5a3c11dda0 con 0x7f5a4415f690 2023-07-21T22:19:14.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.040+0000 7f5a49de4640 1 --2- 172.21.15.6:0/3557304854 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5a28066280 0x7f5a28068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:14.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.040+0000 7f5a49de4640 1 --2- 172.21.15.6:0/3557304854 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5a28066280 0x7f5a28068730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5a400011f0 tx=0x7f5a40007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:14.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.044+0000 7f5a3a7fc640 1 -- 172.21.15.6:0/3557304854 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5a3c0eecc0 con 0x7f5a4415f690 2023-07-21T22:19:14.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.200+0000 7f5a4c048640 1 -- 172.21.15.6:0/3557304854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5a440cf300 con 0x7f5a4415f690 2023-07-21T22:19:14.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.200+0000 7f5a3a7fc640 1 -- 172.21.15.6:0/3557304854 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5a3c0bf0a0 con 0x7f5a4415f690 2023-07-21T22:19:14.246 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:19:14.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.200+0000 7f5a4c048640 1 -- 172.21.15.6:0/3557304854 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5a28066280 msgr2=0x7f5a28068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:14.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.200+0000 7f5a4c048640 1 --2- 172.21.15.6:0/3557304854 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5a28066280 0x7f5a28068730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5a400011f0 tx=0x7f5a40007d40 comp rx=0 tx=0).stop 2023-07-21T22:19:14.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.200+0000 7f5a4c048640 1 -- 172.21.15.6:0/3557304854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a4415f690 msgr2=0x7f5a440afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:14.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.200+0000 7f5a4c048640 1 --2- 172.21.15.6:0/3557304854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a4415f690 0x7f5a440afd50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c01a2a0 tx=0x7f5a3c019410 comp rx=0 tx=0).stop 2023-07-21T22:19:14.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.200+0000 7f5a4c048640 1 -- 172.21.15.6:0/3557304854 shutdown_connections 2023-07-21T22:19:14.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.200+0000 7f5a4c048640 1 --2- 172.21.15.6:0/3557304854 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5a28066280 0x7f5a28068730 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.200+0000 7f5a4c048640 1 --2- 172.21.15.6:0/3557304854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a4415f690 0x7f5a440afd50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.200+0000 7f5a4c048640 1 --2- 172.21.15.6:0/3557304854 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a441453a0 0x7f5a440af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.200+0000 7f5a4c048640 1 --2- 172.21.15.6:0/3557304854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a4406a440 0x7f5a44141f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.200+0000 7f5a4c048640 1 -- 172.21.15.6:0/3557304854 >> 172.21.15.6:0/3557304854 conn(0x7f5a440b1210 msgr2=0x7f5a440b4000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:14.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.200+0000 7f5a4c048640 1 -- 172.21.15.6:0/3557304854 shutdown_connections 2023-07-21T22:19:14.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.200+0000 7f5a4c048640 1 -- 172.21.15.6:0/3557304854 wait complete. 2023-07-21T22:19:14.267 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:19:14.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.368+0000 7febeb6d8640 1 Processor -- start 2023-07-21T22:19:14.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.368+0000 7febeb6d8640 1 -- start start 2023-07-21T22:19:14.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.368+0000 7febeb6d8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7febe40af2b0 0x7febe40c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:14.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.368+0000 7febeb6d8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe40695b0 con 0x7febe40c3ac0 2023-07-21T22:19:14.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.368+0000 7febeb6d8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe4069890 con 0x7febe40cd120 2023-07-21T22:19:14.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.368+0000 7febeb6d8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe4069b70 con 0x7febe40af2b0 2023-07-21T22:19:14.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.368+0000 7febe8c73640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7febe40af2b0 0x7febe40c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:14.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.368+0000 7febe9474640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7febe40c3ac0 0x7febe40ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55892/0 (socket says 172.21.15.6:55892) 2023-07-21T22:19:14.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.368+0000 7febe9474640 1 -- 172.21.15.6:0/1124109201 learned_addr learned my addr 172.21.15.6:0/1124109201 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:14.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.368+0000 7febdbfff640 1 -- 172.21.15.6:0/1124109201 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873596569 0 0) 0x7febe4069890 con 0x7febe40cd120 2023-07-21T22:19:14.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.368+0000 7febe8c73640 1 -- 172.21.15.6:0/1124109201 >> v1:172.21.15.161:6789/0 conn(0x7febe40cd120 legacy=0x7febe40cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:14.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.368+0000 7febe8c73640 1 -- 172.21.15.6:0/1124109201 >> v1:172.21.15.6:6789/0 conn(0x7febe40c3ac0 legacy=0x7febe40ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:14.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.368+0000 7febe8c73640 1 -- 172.21.15.6:0/1124109201 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe4069e50 con 0x7febe40af2b0 2023-07-21T22:19:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.372+0000 7febe8c73640 1 --2- 172.21.15.6:0/1124109201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febe40af2b0 0x7febe40c2d30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7febd40097c0 tx=0x7febd401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f946c06742edf03 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:14.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.372+0000 7febdbfff640 1 -- 172.21.15.6:0/1124109201 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd40ab600 con 0x7febe40af2b0 2023-07-21T22:19:14.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.372+0000 7febdbfff640 1 -- 172.21.15.6:0/1124109201 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd40a7050 con 0x7febe40af2b0 2023-07-21T22:19:14.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.372+0000 7febdbfff640 1 -- 172.21.15.6:0/1124109201 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd40ab980 con 0x7febe40af2b0 2023-07-21T22:19:14.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.372+0000 7febeb6d8640 1 -- 172.21.15.6:0/1124109201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febe40af2b0 msgr2=0x7febe40c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:14.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.372+0000 7febeb6d8640 1 --2- 172.21.15.6:0/1124109201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febe40af2b0 0x7febe40c2d30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7febd40097c0 tx=0x7febd401c310 comp rx=0 tx=0).stop 2023-07-21T22:19:14.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.372+0000 7febeb6d8640 1 -- 172.21.15.6:0/1124109201 shutdown_connections 2023-07-21T22:19:14.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.372+0000 7febeb6d8640 1 --2- 172.21.15.6:0/1124109201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febe40af2b0 0x7febe40c2d30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.372+0000 7febeb6d8640 1 -- 172.21.15.6:0/1124109201 >> 172.21.15.6:0/1124109201 conn(0x7febe40cde90 msgr2=0x7febe40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:14.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.372+0000 7febeb6d8640 1 -- 172.21.15.6:0/1124109201 shutdown_connections 2023-07-21T22:19:14.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.372+0000 7febeb6d8640 1 -- 172.21.15.6:0/1124109201 wait complete. 2023-07-21T22:19:14.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febeb6d8640 1 Processor -- start 2023-07-21T22:19:14.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febeb6d8640 1 -- start start 2023-07-21T22:19:14.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febeb6d8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febe40af2b0 0x7febe414ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:14.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febeb6d8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febe40c3ac0 0x7febe40b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:14.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febeb6d8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febe40cd120 0x7febe40b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:14.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febeb6d8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe40b3ad0 con 0x7febe40af2b0 2023-07-21T22:19:14.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febeb6d8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe4155950 con 0x7febe40cd120 2023-07-21T22:19:14.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febeb6d8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe4155bf0 con 0x7febe40c3ac0 2023-07-21T22:19:14.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febe9474640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febe40af2b0 0x7febe414ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:14.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febe9474640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febe40af2b0 0x7febe414ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60748/0 (socket says 172.21.15.6:60748) 2023-07-21T22:19:14.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febe9474640 1 -- 172.21.15.6:0/3061306357 learned_addr learned my addr 172.21.15.6:0/3061306357 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:14.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febe9474640 1 -- 172.21.15.6:0/3061306357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febe40c3ac0 msgr2=0x7febe40b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:14.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febe9c75640 1 --2- 172.21.15.6:0/3061306357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febe40cd120 0x7febe40b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:14.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febe8c73640 1 --2- 172.21.15.6:0/3061306357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febe40c3ac0 0x7febe40b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:14.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febe9474640 1 --2- 172.21.15.6:0/3061306357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febe40c3ac0 0x7febe40b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febe9474640 1 -- 172.21.15.6:0/3061306357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febe40cd120 msgr2=0x7febe40b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:14.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febe9474640 1 --2- 172.21.15.6:0/3061306357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febe40cd120 0x7febe40b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febe9474640 1 -- 172.21.15.6:0/3061306357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd4009420 con 0x7febe40af2b0 2023-07-21T22:19:14.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febe9c75640 1 --2- 172.21.15.6:0/3061306357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febe40cd120 0x7febe40b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:14.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febe8c73640 1 --2- 172.21.15.6:0/3061306357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febe40c3ac0 0x7febe40b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:14.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febe9474640 1 --2- 172.21.15.6:0/3061306357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febe40af2b0 0x7febe414ecd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7febe000c780 tx=0x7febe000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:14.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febd9ffb640 1 -- 172.21.15.6:0/3061306357 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe00072d0 con 0x7febe40af2b0 2023-07-21T22:19:14.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febd9ffb640 1 -- 172.21.15.6:0/3061306357 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe0007430 con 0x7febe40af2b0 2023-07-21T22:19:14.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febd9ffb640 1 -- 172.21.15.6:0/3061306357 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe00047f0 con 0x7febe40af2b0 2023-07-21T22:19:14.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febeb6d8640 1 -- 172.21.15.6:0/3061306357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe4155ed0 con 0x7febe40af2b0 2023-07-21T22:19:14.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febeb6d8640 1 -- 172.21.15.6:0/3061306357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe4156490 con 0x7febe40af2b0 2023-07-21T22:19:14.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.376+0000 7febeb6d8640 1 -- 172.21.15.6:0/3061306357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe40678d0 con 0x7febe40af2b0 2023-07-21T22:19:14.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.380+0000 7febd9ffb640 1 -- 172.21.15.6:0/3061306357 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7febe0004950 con 0x7febe40af2b0 2023-07-21T22:19:14.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.380+0000 7febd9ffb640 1 --2- 172.21.15.6:0/3061306357 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7febc8066280 0x7febc8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:14.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.380+0000 7febd9ffb640 1 -- 172.21.15.6:0/3061306357 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7febe0083140 con 0x7febe40af2b0 2023-07-21T22:19:14.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.380+0000 7febe8c73640 1 --2- 172.21.15.6:0/3061306357 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7febc8066280 0x7febc8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:14.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.380+0000 7febe8c73640 1 --2- 172.21.15.6:0/3061306357 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7febc8066280 0x7febc8068730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7febd40ad000 tx=0x7febd4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:14.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.384+0000 7febd9ffb640 1 -- 172.21.15.6:0/3061306357 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7febe00505b0 con 0x7febe40af2b0 2023-07-21T22:19:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.536+0000 7febeb6d8640 1 -- 172.21.15.6:0/3061306357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7febe40aeb80 con 0x7febe40af2b0 2023-07-21T22:19:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.536+0000 7febd9ffb640 1 -- 172.21.15.6:0/3061306357 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7febe0053bd0 con 0x7febe40af2b0 2023-07-21T22:19:14.585 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:19:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.540+0000 7febeb6d8640 1 -- 172.21.15.6:0/3061306357 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7febc8066280 msgr2=0x7febc8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.540+0000 7febeb6d8640 1 --2- 172.21.15.6:0/3061306357 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7febc8066280 0x7febc8068730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7febd40ad000 tx=0x7febd4008040 comp rx=0 tx=0).stop 2023-07-21T22:19:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.540+0000 7febeb6d8640 1 -- 172.21.15.6:0/3061306357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febe40af2b0 msgr2=0x7febe414ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:14.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.540+0000 7febeb6d8640 1 --2- 172.21.15.6:0/3061306357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febe40af2b0 0x7febe414ecd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7febe000c780 tx=0x7febe000cc40 comp rx=0 tx=0).stop 2023-07-21T22:19:14.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.540+0000 7febeb6d8640 1 -- 172.21.15.6:0/3061306357 shutdown_connections 2023-07-21T22:19:14.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.540+0000 7febeb6d8640 1 --2- 172.21.15.6:0/3061306357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febe40cd120 0x7febe40b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.540+0000 7febeb6d8640 1 --2- 172.21.15.6:0/3061306357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febe40c3ac0 0x7febe40b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.540+0000 7febeb6d8640 1 --2- 172.21.15.6:0/3061306357 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7febc8066280 0x7febc8068730 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.540+0000 7febeb6d8640 1 --2- 172.21.15.6:0/3061306357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febe40af2b0 0x7febe414ecd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.540+0000 7febeb6d8640 1 -- 172.21.15.6:0/3061306357 >> 172.21.15.6:0/3061306357 conn(0x7febe40cde90 msgr2=0x7febe4161b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:14.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.540+0000 7febeb6d8640 1 -- 172.21.15.6:0/3061306357 shutdown_connections 2023-07-21T22:19:14.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.540+0000 7febeb6d8640 1 -- 172.21.15.6:0/3061306357 wait complete. 2023-07-21T22:19:14.605 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:19:14.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.704+0000 7f13a08ca640 1 Processor -- start 2023-07-21T22:19:14.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.704+0000 7f13a08ca640 1 -- start start 2023-07-21T22:19:14.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.708+0000 7f13a08ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f139c0cc960 0x7f139c0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:14.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.708+0000 7f13a08ca640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f139c160750 0x7f139c15c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:14.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.708+0000 7f13a08ca640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139c0cd270 con 0x7f139c0b1620 2023-07-21T22:19:14.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.708+0000 7f13a08ca640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139c0cf710 con 0x7f139c160750 2023-07-21T22:19:14.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.708+0000 7f13a08ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139c0cf430 con 0x7f139c0cc960 2023-07-21T22:19:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.708+0000 7f139b7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f139c0cc960 0x7f139c0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.708+0000 7f139bfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f139c160750 0x7f139c15c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.708+0000 7f139b7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f139c0cc960 0x7f139c0ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:40386/0 (socket says 172.21.15.6:40386) 2023-07-21T22:19:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.708+0000 7f139b7fe640 1 -- 172.21.15.6:0/612570048 learned_addr learned my addr 172.21.15.6:0/612570048 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.708+0000 7f139bfff640 1 --2- 172.21.15.6:0/612570048 >> v2:172.21.15.161:3300/0 conn(0x7f139c160750 0x7f139c15c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:39290/0 (socket says 172.21.15.6:39290) 2023-07-21T22:19:14.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.708+0000 7f139bfff640 1 -- 172.21.15.6:0/612570048 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f139c0cc960 msgr2=0x7f139c0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:14.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.708+0000 7f139bfff640 1 --2- 172.21.15.6:0/612570048 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f139c0cc960 0x7f139c0ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.708+0000 7f139bfff640 1 -- 172.21.15.6:0/612570048 >> v1:172.21.15.161:6789/0 conn(0x7f139c0b1620 legacy=0x7f139c0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:14.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.708+0000 7f139bfff640 1 -- 172.21.15.6:0/612570048 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139c15fc70 con 0x7f139c160750 2023-07-21T22:19:14.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.712+0000 7f139bfff640 1 --2- 172.21.15.6:0/612570048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f139c160750 0x7f139c15c310 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1394009d90 tx=0x7f139401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c36b06d14170445a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:14.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.712+0000 7f139a7fc640 1 -- 172.21.15.6:0/612570048 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13940a59e0 con 0x7f139c160750 2023-07-21T22:19:14.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.712+0000 7f139a7fc640 1 -- 172.21.15.6:0/612570048 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13940a5b40 con 0x7f139c160750 2023-07-21T22:19:14.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.712+0000 7f139a7fc640 1 -- 172.21.15.6:0/612570048 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13940ad440 con 0x7f139c160750 2023-07-21T22:19:14.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.712+0000 7f13a08ca640 1 -- 172.21.15.6:0/612570048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f139c160750 msgr2=0x7f139c15c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:14.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.712+0000 7f13a08ca640 1 --2- 172.21.15.6:0/612570048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f139c160750 0x7f139c15c310 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1394009d90 tx=0x7f139401c920 comp rx=0 tx=0).stop 2023-07-21T22:19:14.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.712+0000 7f13a08ca640 1 -- 172.21.15.6:0/612570048 shutdown_connections 2023-07-21T22:19:14.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.712+0000 7f13a08ca640 1 --2- 172.21.15.6:0/612570048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f139c160750 0x7f139c15c310 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.712+0000 7f13a08ca640 1 --2- 172.21.15.6:0/612570048 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f139c0cc960 0x7f139c0ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.712+0000 7f13a08ca640 1 -- 172.21.15.6:0/612570048 >> 172.21.15.6:0/612570048 conn(0x7f139c069f50 msgr2=0x7f139c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:14.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.712+0000 7f13a08ca640 1 -- 172.21.15.6:0/612570048 shutdown_connections 2023-07-21T22:19:14.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.712+0000 7f13a08ca640 1 -- 172.21.15.6:0/612570048 wait complete. 2023-07-21T22:19:14.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.712+0000 7f13a08ca640 1 Processor -- start 2023-07-21T22:19:14.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.712+0000 7f13a08ca640 1 -- start start 2023-07-21T22:19:14.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f13a08ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c0b1620 0x7f139c0b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:14.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f13a08ca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f139c0cc960 0x7f139c158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:14.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f13a08ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f139c160750 0x7f139c15d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:14.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f13a08ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c159eb0 con 0x7f139c0b1620 2023-07-21T22:19:14.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f13a08ca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c15a2d0 con 0x7f139c0cc960 2023-07-21T22:19:14.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f13a08ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139c15a790 con 0x7f139c160750 2023-07-21T22:19:14.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f139b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c0b1620 0x7f139c0b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:14.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f139b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c0b1620 0x7f139c0b5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60756/0 (socket says 172.21.15.6:60756) 2023-07-21T22:19:14.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f139b7fe640 1 -- 172.21.15.6:0/1568654448 learned_addr learned my addr 172.21.15.6:0/1568654448 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:14.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f139affd640 1 --2- 172.21.15.6:0/1568654448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f139c0cc960 0x7f139c158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:14.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f139bfff640 1 --2- 172.21.15.6:0/1568654448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f139c160750 0x7f139c15d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:14.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f139b7fe640 1 -- 172.21.15.6:0/1568654448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f139c160750 msgr2=0x7f139c15d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:14.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f139b7fe640 1 --2- 172.21.15.6:0/1568654448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f139c160750 0x7f139c15d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f139b7fe640 1 -- 172.21.15.6:0/1568654448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f139c0cc960 msgr2=0x7f139c158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:14.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f139b7fe640 1 --2- 172.21.15.6:0/1568654448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f139c0cc960 0x7f139c158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f139b7fe640 1 -- 172.21.15.6:0/1568654448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1394009a70 con 0x7f139c0b1620 2023-07-21T22:19:14.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f139affd640 1 --2- 172.21.15.6:0/1568654448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f139c0cc960 0x7f139c158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:14.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f139b7fe640 1 --2- 172.21.15.6:0/1568654448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c0b1620 0x7f139c0b5a00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f138c00e890 tx=0x7f138c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:14.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f1383fff640 1 -- 172.21.15.6:0/1568654448 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c009620 con 0x7f139c0b1620 2023-07-21T22:19:14.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f1383fff640 1 -- 172.21.15.6:0/1568654448 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138c00c8e0 con 0x7f139c0b1620 2023-07-21T22:19:14.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f1383fff640 1 -- 172.21.15.6:0/1568654448 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c00cc90 con 0x7f139c0b1620 2023-07-21T22:19:14.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f13a08ca640 1 -- 172.21.15.6:0/1568654448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139c159230 con 0x7f139c0b1620 2023-07-21T22:19:14.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f13a08ca640 1 -- 172.21.15.6:0/1568654448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139c1597f0 con 0x7f139c0b1620 2023-07-21T22:19:14.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f13a08ca640 1 -- 172.21.15.6:0/1568654448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f139c15a120 con 0x7f139c0b1620 2023-07-21T22:19:14.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.716+0000 7f1383fff640 1 -- 172.21.15.6:0/1568654448 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f138c013470 con 0x7f139c0b1620 2023-07-21T22:19:14.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.720+0000 7f1383fff640 1 --2- 172.21.15.6:0/1568654448 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1388066280 0x7f1388068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:14.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.720+0000 7f1383fff640 1 -- 172.21.15.6:0/1568654448 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f138c083e30 con 0x7f139c0b1620 2023-07-21T22:19:14.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.720+0000 7f139affd640 1 --2- 172.21.15.6:0/1568654448 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1388066280 0x7f1388068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:14.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.720+0000 7f139affd640 1 --2- 172.21.15.6:0/1568654448 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1388066280 0x7f1388068730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f139c166db0 tx=0x7f1390009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:14.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.724+0000 7f1383fff640 1 -- 172.21.15.6:0/1568654448 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f138c054d60 con 0x7f139c0b1620 2023-07-21T22:19:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.880+0000 7f13a08ca640 1 -- 172.21.15.6:0/1568654448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f139c04e020 con 0x7f139c0b1620 2023-07-21T22:19:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.880+0000 7f1383fff640 1 -- 172.21.15.6:0/1568654448 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f138c0548f0 con 0x7f139c0b1620 2023-07-21T22:19:14.928 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:19:14.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.884+0000 7f13a08ca640 1 -- 172.21.15.6:0/1568654448 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1388066280 msgr2=0x7f1388068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:14.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.884+0000 7f13a08ca640 1 --2- 172.21.15.6:0/1568654448 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1388066280 0x7f1388068730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f139c166db0 tx=0x7f1390009040 comp rx=0 tx=0).stop 2023-07-21T22:19:14.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.884+0000 7f13a08ca640 1 -- 172.21.15.6:0/1568654448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c0b1620 msgr2=0x7f139c0b5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.884+0000 7f13a08ca640 1 --2- 172.21.15.6:0/1568654448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c0b1620 0x7f139c0b5a00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f138c00e890 tx=0x7f138c00ed50 comp rx=0 tx=0).stop 2023-07-21T22:19:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.884+0000 7f13a08ca640 1 -- 172.21.15.6:0/1568654448 shutdown_connections 2023-07-21T22:19:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.884+0000 7f13a08ca640 1 --2- 172.21.15.6:0/1568654448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f139c160750 0x7f139c15d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.884+0000 7f13a08ca640 1 --2- 172.21.15.6:0/1568654448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f139c0cc960 0x7f139c158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.884+0000 7f13a08ca640 1 --2- 172.21.15.6:0/1568654448 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1388066280 0x7f1388068730 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.884+0000 7f13a08ca640 1 --2- 172.21.15.6:0/1568654448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f139c0b1620 0x7f139c0b5a00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.884+0000 7f13a08ca640 1 -- 172.21.15.6:0/1568654448 >> 172.21.15.6:0/1568654448 conn(0x7f139c069f50 msgr2=0x7f139c072420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.884+0000 7f13a08ca640 1 -- 172.21.15.6:0/1568654448 shutdown_connections 2023-07-21T22:19:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:14.884+0000 7f13a08ca640 1 -- 172.21.15.6:0/1568654448 wait complete. 2023-07-21T22:19:14.951 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:19:15.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.048+0000 7f7904fad640 1 Processor -- start 2023-07-21T22:19:15.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.048+0000 7f7904fad640 1 -- start start 2023-07-21T22:19:15.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f7904fad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7900070b70 0x7f7900070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:15.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f7904fad640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79000cac70 con 0x7f79000cb100 2023-07-21T22:19:15.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f7904fad640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7900071480 con 0x7f790006b1e0 2023-07-21T22:19:15.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f7904fad640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79000ca060 con 0x7f7900070b70 2023-07-21T22:19:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fed9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f79000cb100 0x7f79001642e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55906/0 (socket says 172.21.15.6:55906) 2023-07-21T22:19:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fed9d640 1 -- 172.21.15.6:0/1926803688 learned_addr learned my addr 172.21.15.6:0/1926803688 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fe59c640 1 --2- 172.21.15.6:0/1926803688 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7900070b70 0x7f7900070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fd59a640 1 -- 172.21.15.6:0/1926803688 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308694352 0 0) 0x7f79000cac70 con 0x7f79000cb100 2023-07-21T22:19:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fd59a640 1 -- 172.21.15.6:0/1926803688 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78e8003530 con 0x7f79000cb100 2023-07-21T22:19:15.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fd59a640 1 -- 172.21.15.6:0/1926803688 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272186421 0 0) 0x7f7900071480 con 0x7f790006b1e0 2023-07-21T22:19:15.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fd59a640 1 -- 172.21.15.6:0/1926803688 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79000cac70 con 0x7f790006b1e0 2023-07-21T22:19:15.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fd59a640 1 -- 172.21.15.6:0/1926803688 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2365681516 0 0) 0x7f78e8003530 con 0x7f79000cb100 2023-07-21T22:19:15.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fd59a640 1 -- 172.21.15.6:0/1926803688 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7900070b70 msgr2=0x7f7900070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:15.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fd59a640 1 --2- 172.21.15.6:0/1926803688 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7900070b70 0x7f7900070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fd59a640 1 -- 172.21.15.6:0/1926803688 >> v1:172.21.15.161:6789/0 conn(0x7f790006b1e0 legacy=0x7f79000c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:15.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fd59a640 1 -- 172.21.15.6:0/1926803688 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79000ca340 con 0x7f79000cb100 2023-07-21T22:19:15.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fd59a640 1 -- 172.21.15.6:0/1926803688 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f78f8001a00 con 0x7f79000cb100 2023-07-21T22:19:15.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fd59a640 1 -- 172.21.15.6:0/1926803688 >> v1:172.21.15.6:6789/0 conn(0x7f79000cb100 legacy=0x7f79001642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:15.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fd59a640 1 --2- 172.21.15.6:0/1926803688 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e8003b40 0x7f78e8003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fd59a640 1 --2- 172.21.15.6:0/1926803688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78e80047d0 0x7f78e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fd59a640 1 --2- 172.21.15.6:0/1926803688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78e8005180 0x7f78e800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fd59a640 1 -- 172.21.15.6:0/1926803688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79000ca060 con 0x7f78e8005180 2023-07-21T22:19:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fd59a640 1 -- 172.21.15.6:0/1926803688 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e800bfe0 con 0x7f78e80047d0 2023-07-21T22:19:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fd59a640 1 -- 172.21.15.6:0/1926803688 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e800c1a0 con 0x7f78e8003b40 2023-07-21T22:19:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fed9d640 1 --2- 172.21.15.6:0/1926803688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78e8005180 0x7f78e800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fdd9b640 1 --2- 172.21.15.6:0/1926803688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78e80047d0 0x7f78e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:15.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fe59c640 1 --2- 172.21.15.6:0/1926803688 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e8003b40 0x7f78e8003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:15.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fed9d640 1 -- 172.21.15.6:0/1926803688 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e8003b40 msgr2=0x7f78e8003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:15.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fed9d640 1 --2- 172.21.15.6:0/1926803688 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e8003b40 0x7f78e8003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fed9d640 1 -- 172.21.15.6:0/1926803688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78e80047d0 msgr2=0x7f78e8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:15.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fed9d640 1 --2- 172.21.15.6:0/1926803688 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78e80047d0 0x7f78e8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.052+0000 7f78fed9d640 1 -- 172.21.15.6:0/1926803688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e8003530 con 0x7f78e8005180 2023-07-21T22:19:15.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.056+0000 7f78fed9d640 1 --2- 172.21.15.6:0/1926803688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78e8005180 0x7f78e800b990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f78f800a7a0 tx=0x7f78f801d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f1874c9c0dfa31 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:15.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.056+0000 7f78fd59a640 1 -- 172.21.15.6:0/1926803688 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f80ad630 con 0x7f78e8005180 2023-07-21T22:19:15.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.056+0000 7f78fd59a640 1 -- 172.21.15.6:0/1926803688 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f80a8070 con 0x7f78e8005180 2023-07-21T22:19:15.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.056+0000 7f78fd59a640 1 -- 172.21.15.6:0/1926803688 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f80ada30 con 0x7f78e8005180 2023-07-21T22:19:15.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.056+0000 7f7904fad640 1 -- 172.21.15.6:0/1926803688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78e8005180 msgr2=0x7f78e800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:15.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.056+0000 7f7904fad640 1 --2- 172.21.15.6:0/1926803688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78e8005180 0x7f78e800b990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f78f800a7a0 tx=0x7f78f801d2a0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.056+0000 7f78fed9d640 1 -- 172.21.15.6:0/1926803688 reap_dead start 2023-07-21T22:19:15.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.056+0000 7f7904fad640 1 -- 172.21.15.6:0/1926803688 shutdown_connections 2023-07-21T22:19:15.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.056+0000 7f7904fad640 1 -- 172.21.15.6:0/1926803688 >> 172.21.15.6:0/1926803688 conn(0x7f79000afcf0 msgr2=0x7f79000b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:15.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.056+0000 7f7904fad640 1 -- 172.21.15.6:0/1926803688 shutdown_connections 2023-07-21T22:19:15.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.056+0000 7f7904fad640 1 -- 172.21.15.6:0/1926803688 wait complete. 2023-07-21T22:19:15.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f7904fad640 1 Processor -- start 2023-07-21T22:19:15.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f7904fad640 1 -- start start 2023-07-21T22:19:15.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f7904fad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e8005180 0x7f79000c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f7904fad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7900151410 0x7f7900151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f7904fad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7900157990 0x7f7900157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f7904fad640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79000a8740 con 0x7f7900151410 2023-07-21T22:19:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f7904fad640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7900158370 con 0x7f7900157990 2023-07-21T22:19:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f7904fad640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7900156e40 con 0x7f78e8005180 2023-07-21T22:19:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f78fdd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7900151410 0x7f7900151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f78fdd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7900151410 0x7f7900151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60774/0 (socket says 172.21.15.6:60774) 2023-07-21T22:19:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f78fdd9b640 1 -- 172.21.15.6:0/2495308514 learned_addr learned my addr 172.21.15.6:0/2495308514 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f78fed9d640 1 --2- 172.21.15.6:0/2495308514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7900157990 0x7f7900157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f78fe59c640 1 --2- 172.21.15.6:0/2495308514 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e8005180 0x7f79000c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f78fdd9b640 1 -- 172.21.15.6:0/2495308514 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e8005180 msgr2=0x7f79000c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f78fdd9b640 1 --2- 172.21.15.6:0/2495308514 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e8005180 0x7f79000c3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f78fdd9b640 1 -- 172.21.15.6:0/2495308514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7900157990 msgr2=0x7f7900157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f78fdd9b640 1 --2- 172.21.15.6:0/2495308514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7900157990 0x7f7900157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f78fdd9b640 1 -- 172.21.15.6:0/2495308514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79000c3510 con 0x7f7900151410 2023-07-21T22:19:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f78fdd9b640 1 --2- 172.21.15.6:0/2495308514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7900151410 0x7f7900151880 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f78f4012860 tx=0x7f78f4012c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f78eeffd640 1 -- 172.21.15.6:0/2495308514 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f4010bd0 con 0x7f7900151410 2023-07-21T22:19:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f78eeffd640 1 -- 172.21.15.6:0/2495308514 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f4010d50 con 0x7f7900151410 2023-07-21T22:19:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f78eeffd640 1 -- 172.21.15.6:0/2495308514 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f40166c0 con 0x7f7900151410 2023-07-21T22:19:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f7904fad640 1 -- 172.21.15.6:0/2495308514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79000c37f0 con 0x7f7900151410 2023-07-21T22:19:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f7904fad640 1 -- 172.21.15.6:0/2495308514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7900155ae0 con 0x7f7900151410 2023-07-21T22:19:15.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.060+0000 7f7904fad640 1 -- 172.21.15.6:0/2495308514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79000c3d10 con 0x7f7900151410 2023-07-21T22:19:15.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.064+0000 7f78eeffd640 1 -- 172.21.15.6:0/2495308514 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f78f4016820 con 0x7f7900151410 2023-07-21T22:19:15.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.064+0000 7f78eeffd640 1 --2- 172.21.15.6:0/2495308514 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f78e0066280 0x7f78e0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:15.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.064+0000 7f78eeffd640 1 -- 172.21.15.6:0/2495308514 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f78f4087460 con 0x7f7900151410 2023-07-21T22:19:15.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.064+0000 7f78fe59c640 1 --2- 172.21.15.6:0/2495308514 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f78e0066280 0x7f78e0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:15.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.064+0000 7f78fe59c640 1 --2- 172.21.15.6:0/2495308514 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f78e0066280 0x7f78e0068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7900157610 tx=0x7f78f0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:15.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.068+0000 7f78eeffd640 1 -- 172.21.15.6:0/2495308514 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f79000c3d10 con 0x7f7900151410 2023-07-21T22:19:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.224+0000 7f7904fad640 1 -- 172.21.15.6:0/2495308514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79000c3d10 con 0x7f7900151410 2023-07-21T22:19:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.224+0000 7f78eeffd640 1 -- 172.21.15.6:0/2495308514 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18207 (secure 0 0 0) 0x7f78f40548d0 con 0x7f7900151410 2023-07-21T22:19:15.271 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:15.271 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:18:45.315608+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:18:41.465054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:18:42.709896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:19:15.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.224+0000 7f7904fad640 1 -- 172.21.15.6:0/2495308514 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f78e0066280 msgr2=0x7f78e0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:15.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.224+0000 7f7904fad640 1 --2- 172.21.15.6:0/2495308514 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f78e0066280 0x7f78e0068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7900157610 tx=0x7f78f0009190 comp rx=0 tx=0).stop 2023-07-21T22:19:15.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.224+0000 7f7904fad640 1 -- 172.21.15.6:0/2495308514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7900151410 msgr2=0x7f7900151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:15.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.224+0000 7f7904fad640 1 --2- 172.21.15.6:0/2495308514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7900151410 0x7f7900151880 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f78f4012860 tx=0x7f78f4012c60 comp rx=0 tx=0).stop 2023-07-21T22:19:15.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.224+0000 7f7904fad640 1 -- 172.21.15.6:0/2495308514 shutdown_connections 2023-07-21T22:19:15.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.224+0000 7f7904fad640 1 --2- 172.21.15.6:0/2495308514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7900157990 0x7f7900157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.224+0000 7f7904fad640 1 --2- 172.21.15.6:0/2495308514 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f78e0066280 0x7f78e0068730 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.224+0000 7f7904fad640 1 --2- 172.21.15.6:0/2495308514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7900151410 0x7f7900151880 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.224+0000 7f7904fad640 1 --2- 172.21.15.6:0/2495308514 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78e8005180 0x7f79000c3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.224+0000 7f7904fad640 1 -- 172.21.15.6:0/2495308514 >> 172.21.15.6:0/2495308514 conn(0x7f79000afcf0 msgr2=0x7f79000b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.224+0000 7f7904fad640 1 -- 172.21.15.6:0/2495308514 shutdown_connections 2023-07-21T22:19:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.224+0000 7f7904fad640 1 -- 172.21.15.6:0/2495308514 wait complete. 2023-07-21T22:19:15.292 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:18:41.465054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:18:42.709896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:19:15.293 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:19:15.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.392+0000 7f4ea9796640 1 Processor -- start 2023-07-21T22:19:15.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.392+0000 7f4ea9796640 1 -- start start 2023-07-21T22:19:15.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.396+0000 7f4ea9796640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4ea40aeb40 0x7f4ea415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:15.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.396+0000 7f4ea9796640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4ea4159440 0x7f4ea40c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:15.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.396+0000 7f4ea9796640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea41532b0 con 0x7f4ea40aef10 2023-07-21T22:19:15.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.396+0000 7f4ea9796640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea40ca6f0 con 0x7f4ea40aeb40 2023-07-21T22:19:15.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.396+0000 7f4ea9796640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea41599d0 con 0x7f4ea4159440 2023-07-21T22:19:15.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.396+0000 7f4ea2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4ea40aeb40 0x7f4ea415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:15.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.396+0000 7f4ea2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4ea40aeb40 0x7f4ea415cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60776/0 (socket says 172.21.15.6:60776) 2023-07-21T22:19:15.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.396+0000 7f4ea2ffd640 1 -- 172.21.15.6:0/2778573704 learned_addr learned my addr 172.21.15.6:0/2778573704 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:15.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.396+0000 7f4ea37fe640 1 --2- 172.21.15.6:0/2778573704 >> v2:172.21.15.161:3300/0 conn(0x7f4ea4159440 0x7f4ea40c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:15.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.396+0000 7f4ea2ffd640 1 -- 172.21.15.6:0/2778573704 >> v2:172.21.15.161:3300/0 conn(0x7f4ea4159440 msgr2=0x7f4ea40c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:15.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.396+0000 7f4ea2ffd640 1 --2- 172.21.15.6:0/2778573704 >> v2:172.21.15.161:3300/0 conn(0x7f4ea4159440 0x7f4ea40c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.396+0000 7f4ea2ffd640 1 -- 172.21.15.6:0/2778573704 >> v1:172.21.15.161:6789/0 conn(0x7f4ea40aef10 legacy=0x7f4ea4158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:15.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.396+0000 7f4ea2ffd640 1 -- 172.21.15.6:0/2778573704 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea4159cb0 con 0x7f4ea40aeb40 2023-07-21T22:19:15.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.400+0000 7f4ea2ffd640 1 --2- 172.21.15.6:0/2778573704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ea40aeb40 0x7f4ea415cef0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40c8690 tx=0x7f4e9401eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ad396ca878ed00 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:15.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.400+0000 7f4ea27fc640 1 -- 172.21.15.6:0/2778573704 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e940a7be0 con 0x7f4ea40aeb40 2023-07-21T22:19:15.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.400+0000 7f4ea27fc640 1 -- 172.21.15.6:0/2778573704 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e940a7d40 con 0x7f4ea40aeb40 2023-07-21T22:19:15.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.400+0000 7f4ea27fc640 1 -- 172.21.15.6:0/2778573704 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e940af660 con 0x7f4ea40aeb40 2023-07-21T22:19:15.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.400+0000 7f4ea9796640 1 -- 172.21.15.6:0/2778573704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ea40aeb40 msgr2=0x7f4ea415cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:15.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.400+0000 7f4ea9796640 1 --2- 172.21.15.6:0/2778573704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ea40aeb40 0x7f4ea415cef0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40c8690 tx=0x7f4e9401eb10 comp rx=0 tx=0).stop 2023-07-21T22:19:15.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.400+0000 7f4ea9796640 1 -- 172.21.15.6:0/2778573704 shutdown_connections 2023-07-21T22:19:15.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.400+0000 7f4ea9796640 1 --2- 172.21.15.6:0/2778573704 >> v2:172.21.15.161:3300/0 conn(0x7f4ea4159440 0x7f4ea40c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.400+0000 7f4ea9796640 1 --2- 172.21.15.6:0/2778573704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ea40aeb40 0x7f4ea415cef0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.400+0000 7f4ea9796640 1 -- 172.21.15.6:0/2778573704 >> 172.21.15.6:0/2778573704 conn(0x7f4ea40cde90 msgr2=0x7f4ea40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:15.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.400+0000 7f4ea9796640 1 -- 172.21.15.6:0/2778573704 shutdown_connections 2023-07-21T22:19:15.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.400+0000 7f4ea9796640 1 -- 172.21.15.6:0/2778573704 wait complete. 2023-07-21T22:19:15.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.400+0000 7f4ea9796640 1 Processor -- start 2023-07-21T22:19:15.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.400+0000 7f4ea9796640 1 -- start start 2023-07-21T22:19:15.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4ea9796640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ea40aeb40 0x7f4ea4158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:15.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4ea9796640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ea40aef10 0x7f4ea414d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:15.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4ea9796640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ea4159440 0x7f4ea406c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:15.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4ea9796640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea406c190 con 0x7f4ea4159440 2023-07-21T22:19:15.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4ea9796640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea414e160 con 0x7f4ea40aef10 2023-07-21T22:19:15.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4ea9796640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea4158860 con 0x7f4ea40aeb40 2023-07-21T22:19:15.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4ea37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ea4159440 0x7f4ea406c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:15.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4e9bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ea40aef10 0x7f4ea414d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:15.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4ea2ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ea40aeb40 0x7f4ea4158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:15.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4ea37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ea4159440 0x7f4ea406c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60778/0 (socket says 172.21.15.6:60778) 2023-07-21T22:19:15.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4e9bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ea40aef10 0x7f4ea414d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:39318/0 (socket says 172.21.15.6:39318) 2023-07-21T22:19:15.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4ea37fe640 1 -- 172.21.15.6:0/1115589950 learned_addr learned my addr 172.21.15.6:0/1115589950 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:15.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4ea37fe640 1 -- 172.21.15.6:0/1115589950 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ea40aeb40 msgr2=0x7f4ea4158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:15.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4ea37fe640 1 --2- 172.21.15.6:0/1115589950 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ea40aeb40 0x7f4ea4158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4ea37fe640 1 -- 172.21.15.6:0/1115589950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ea40aef10 msgr2=0x7f4ea414d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:15.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4ea37fe640 1 --2- 172.21.15.6:0/1115589950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ea40aef10 0x7f4ea414d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4ea37fe640 1 -- 172.21.15.6:0/1115589950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9400b770 con 0x7f4ea4159440 2023-07-21T22:19:15.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4ea37fe640 1 --2- 172.21.15.6:0/1115589950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ea4159440 0x7f4ea406c8d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00efc0 tx=0x7f4e9c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:15.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4e9b7fe640 1 -- 172.21.15.6:0/1115589950 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c009ba0 con 0x7f4ea4159440 2023-07-21T22:19:15.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4e9b7fe640 1 -- 172.21.15.6:0/1115589950 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c00f040 con 0x7f4ea4159440 2023-07-21T22:19:15.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4e9b7fe640 1 -- 172.21.15.6:0/1115589950 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0146c0 con 0x7f4ea4159440 2023-07-21T22:19:15.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4ea9796640 1 -- 172.21.15.6:0/1115589950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea406b580 con 0x7f4ea4159440 2023-07-21T22:19:15.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4ea9796640 1 -- 172.21.15.6:0/1115589950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea406bb40 con 0x7f4ea4159440 2023-07-21T22:19:15.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.404+0000 7f4ea9796640 1 -- 172.21.15.6:0/1115589950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea406c340 con 0x7f4ea4159440 2023-07-21T22:19:15.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.408+0000 7f4e9b7fe640 1 -- 172.21.15.6:0/1115589950 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4e9c014820 con 0x7f4ea4159440 2023-07-21T22:19:15.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.408+0000 7f4e9b7fe640 1 --2- 172.21.15.6:0/1115589950 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4e84066280 0x7f4e84068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:15.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.408+0000 7f4e9b7fe640 1 -- 172.21.15.6:0/1115589950 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4e9c084700 con 0x7f4ea4159440 2023-07-21T22:19:15.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.408+0000 7f4ea2ffd640 1 --2- 172.21.15.6:0/1115589950 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4e84066280 0x7f4e84068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:15.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.408+0000 7f4ea2ffd640 1 --2- 172.21.15.6:0/1115589950 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4e84066280 0x7f4e84068730 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4e940b1000 tx=0x7f4e940a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:15.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.412+0000 7f4e9b7fe640 1 -- 172.21.15.6:0/1115589950 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4ea406c340 con 0x7f4ea4159440 2023-07-21T22:19:15.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.568+0000 7f4ea9796640 1 -- 172.21.15.6:0/1115589950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ea406c340 con 0x7f4ea4159440 2023-07-21T22:19:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.568+0000 7f4e9b7fe640 1 -- 172.21.15.6:0/1115589950 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ea406c340 con 0x7f4ea4159440 2023-07-21T22:19:15.617 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:19:15.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.572+0000 7f4ea9796640 1 -- 172.21.15.6:0/1115589950 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4e84066280 msgr2=0x7f4e84068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:15.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.572+0000 7f4ea9796640 1 --2- 172.21.15.6:0/1115589950 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4e84066280 0x7f4e84068730 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4e940b1000 tx=0x7f4e940a9070 comp rx=0 tx=0).stop 2023-07-21T22:19:15.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.572+0000 7f4ea9796640 1 -- 172.21.15.6:0/1115589950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ea4159440 msgr2=0x7f4ea406c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:15.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.572+0000 7f4ea9796640 1 --2- 172.21.15.6:0/1115589950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ea4159440 0x7f4ea406c8d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c00efc0 tx=0x7f4e9c00c490 comp rx=0 tx=0).stop 2023-07-21T22:19:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.572+0000 7f4ea9796640 1 -- 172.21.15.6:0/1115589950 shutdown_connections 2023-07-21T22:19:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.572+0000 7f4ea9796640 1 --2- 172.21.15.6:0/1115589950 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4e84066280 0x7f4e84068730 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.572+0000 7f4ea9796640 1 --2- 172.21.15.6:0/1115589950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ea4159440 0x7f4ea406c8d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.572+0000 7f4ea9796640 1 --2- 172.21.15.6:0/1115589950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ea40aef10 0x7f4ea414d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.572+0000 7f4ea9796640 1 --2- 172.21.15.6:0/1115589950 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ea40aeb40 0x7f4ea4158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.572+0000 7f4ea9796640 1 -- 172.21.15.6:0/1115589950 >> 172.21.15.6:0/1115589950 conn(0x7f4ea40cde90 msgr2=0x7f4ea414ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.572+0000 7f4ea9796640 1 -- 172.21.15.6:0/1115589950 shutdown_connections 2023-07-21T22:19:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.572+0000 7f4ea9796640 1 -- 172.21.15.6:0/1115589950 wait complete. 2023-07-21T22:19:15.638 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:19:15.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.740+0000 7f47a1234640 1 Processor -- start 2023-07-21T22:19:15.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.740+0000 7f47a1234640 1 -- start start 2023-07-21T22:19:15.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.740+0000 7f47a1234640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f479c070f30 0x7f479c0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:15.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.740+0000 7f47a1234640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f479c0af2b0 0x7f479c15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:15.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.740+0000 7f47a1234640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c159d70 con 0x7f479c069430 2023-07-21T22:19:15.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.740+0000 7f47a1234640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c0c9c60 con 0x7f479c070f30 2023-07-21T22:19:15.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.740+0000 7f47a1234640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c0c9f40 con 0x7f479c0af2b0 2023-07-21T22:19:15.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.740+0000 7f479a59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f479c070f30 0x7f479c0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:15.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.740+0000 7f479a59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f479c070f30 0x7f479c0ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60794/0 (socket says 172.21.15.6:60794) 2023-07-21T22:19:15.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.740+0000 7f479ad9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f479c069430 0x7f479c069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55910/0 (socket says 172.21.15.6:55910) 2023-07-21T22:19:15.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.740+0000 7f479a59c640 1 -- 172.21.15.6:0/2079145732 learned_addr learned my addr 172.21.15.6:0/2079145732 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:15.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.740+0000 7f479b59e640 1 --2- 172.21.15.6:0/2079145732 >> v2:172.21.15.161:3300/0 conn(0x7f479c0af2b0 0x7f479c15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:15.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.740+0000 7f479a59c640 1 -- 172.21.15.6:0/2079145732 >> v2:172.21.15.161:3300/0 conn(0x7f479c0af2b0 msgr2=0x7f479c15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:15.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.740+0000 7f479a59c640 1 --2- 172.21.15.6:0/2079145732 >> v2:172.21.15.161:3300/0 conn(0x7f479c0af2b0 0x7f479c15a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.740+0000 7f479a59c640 1 -- 172.21.15.6:0/2079145732 >> v1:172.21.15.6:6789/0 conn(0x7f479c069430 legacy=0x7f479c069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:15.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.740+0000 7f479a59c640 1 -- 172.21.15.6:0/2079145732 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c0ca220 con 0x7f479c070f30 2023-07-21T22:19:15.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.740+0000 7f479b59e640 1 --2- 172.21.15.6:0/2079145732 >> v2:172.21.15.161:3300/0 conn(0x7f479c0af2b0 0x7f479c15a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:15.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.740+0000 7f4799d9b640 1 -- 172.21.15.6:0/2079145732 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679464601 0 0) 0x7f478c001120 con 0x7f479c069430 2023-07-21T22:19:15.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.744+0000 7f479a59c640 1 --2- 172.21.15.6:0/2079145732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f479c070f30 0x7f479c0ad6f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f479c0cef70 tx=0x7f479001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f496012b75f96618 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:15.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.744+0000 7f4799d9b640 1 -- 172.21.15.6:0/2079145732 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47900aa660 con 0x7f479c070f30 2023-07-21T22:19:15.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.744+0000 7f4799d9b640 1 -- 172.21.15.6:0/2079145732 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47900aa7c0 con 0x7f479c070f30 2023-07-21T22:19:15.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.744+0000 7f4799d9b640 1 -- 172.21.15.6:0/2079145732 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47900aab50 con 0x7f479c070f30 2023-07-21T22:19:15.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.744+0000 7f47a1234640 1 -- 172.21.15.6:0/2079145732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f479c070f30 msgr2=0x7f479c0ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:15.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.744+0000 7f47a1234640 1 --2- 172.21.15.6:0/2079145732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f479c070f30 0x7f479c0ad6f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f479c0cef70 tx=0x7f479001c500 comp rx=0 tx=0).stop 2023-07-21T22:19:15.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.744+0000 7f47a1234640 1 -- 172.21.15.6:0/2079145732 shutdown_connections 2023-07-21T22:19:15.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.744+0000 7f47a1234640 1 --2- 172.21.15.6:0/2079145732 >> v2:172.21.15.161:3300/0 conn(0x7f479c0af2b0 0x7f479c15a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.744+0000 7f47a1234640 1 --2- 172.21.15.6:0/2079145732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f479c070f30 0x7f479c0ad6f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.744+0000 7f47a1234640 1 -- 172.21.15.6:0/2079145732 >> 172.21.15.6:0/2079145732 conn(0x7f479c0cde90 msgr2=0x7f479c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:15.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.744+0000 7f47a1234640 1 -- 172.21.15.6:0/2079145732 shutdown_connections 2023-07-21T22:19:15.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.744+0000 7f47a1234640 1 -- 172.21.15.6:0/2079145732 wait complete. 2023-07-21T22:19:15.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f47a1234640 1 Processor -- start 2023-07-21T22:19:15.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f47a1234640 1 -- start start 2023-07-21T22:19:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f47a1234640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f479c069430 0x7f479c14ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f47a1234640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f479c070f30 0x7f479c06c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f47a1234640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f479c0af2b0 0x7f479c06c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f47a1234640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c1f4cb0 con 0x7f479c069430 2023-07-21T22:19:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f47a1234640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c150bb0 con 0x7f479c070f30 2023-07-21T22:19:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f47a1234640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c150280 con 0x7f479c0af2b0 2023-07-21T22:19:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f479ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f479c069430 0x7f479c14ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f479ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f479c069430 0x7f479c14ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60800/0 (socket says 172.21.15.6:60800) 2023-07-21T22:19:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f479ad9d640 1 -- 172.21.15.6:0/2495880628 learned_addr learned my addr 172.21.15.6:0/2495880628 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:15.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f479a59c640 1 --2- 172.21.15.6:0/2495880628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f479c070f30 0x7f479c06c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:15.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f479b59e640 1 --2- 172.21.15.6:0/2495880628 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f479c0af2b0 0x7f479c06c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f479ad9d640 1 -- 172.21.15.6:0/2495880628 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f479c0af2b0 msgr2=0x7f479c06c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f479ad9d640 1 --2- 172.21.15.6:0/2495880628 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f479c0af2b0 0x7f479c06c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f479ad9d640 1 -- 172.21.15.6:0/2495880628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f479c070f30 msgr2=0x7f479c06c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f479ad9d640 1 --2- 172.21.15.6:0/2495880628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f479c070f30 0x7f479c06c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f479ad9d640 1 -- 172.21.15.6:0/2495880628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47900094d0 con 0x7f479c069430 2023-07-21T22:19:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f479a59c640 1 --2- 172.21.15.6:0/2495880628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f479c070f30 0x7f479c06c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f479b59e640 1 --2- 172.21.15.6:0/2495880628 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f479c0af2b0 0x7f479c06c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:15.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f479ad9d640 1 --2- 172.21.15.6:0/2495880628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f479c069430 0x7f479c14ba60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f478c00c480 tx=0x7f478c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:15.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f47837fe640 1 -- 172.21.15.6:0/2495880628 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c0074e0 con 0x7f479c069430 2023-07-21T22:19:15.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f47837fe640 1 -- 172.21.15.6:0/2495880628 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c007660 con 0x7f479c069430 2023-07-21T22:19:15.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f47837fe640 1 -- 172.21.15.6:0/2495880628 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478c004a30 con 0x7f479c069430 2023-07-21T22:19:15.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f47a1234640 1 -- 172.21.15.6:0/2495880628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c150560 con 0x7f479c069430 2023-07-21T22:19:15.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f47a1234640 1 -- 172.21.15.6:0/2495880628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c151040 con 0x7f479c069430 2023-07-21T22:19:15.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.748+0000 7f47a1234640 1 -- 172.21.15.6:0/2495880628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c0678d0 con 0x7f479c069430 2023-07-21T22:19:15.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.752+0000 7f47837fe640 1 -- 172.21.15.6:0/2495880628 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f478c004b90 con 0x7f479c069430 2023-07-21T22:19:15.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.752+0000 7f47837fe640 1 --2- 172.21.15.6:0/2495880628 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4788066280 0x7f4788068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:15.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.752+0000 7f47837fe640 1 -- 172.21.15.6:0/2495880628 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f478c082d60 con 0x7f479c069430 2023-07-21T22:19:15.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.752+0000 7f479a59c640 1 --2- 172.21.15.6:0/2495880628 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4788066280 0x7f4788068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:15.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.752+0000 7f479a59c640 1 --2- 172.21.15.6:0/2495880628 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4788066280 0x7f4788068730 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f47900ae000 tx=0x7f47900a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:15.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.756+0000 7f47837fe640 1 -- 172.21.15.6:0/2495880628 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f478c053c60 con 0x7f479c069430 2023-07-21T22:19:15.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.912+0000 7f47a1234640 1 -- 172.21.15.6:0/2495880628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f479c159d70 con 0x7f479c069430 2023-07-21T22:19:15.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.912+0000 7f47837fe640 1 -- 172.21.15.6:0/2495880628 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f479c159d70 con 0x7f479c069430 2023-07-21T22:19:15.958 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:19:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.912+0000 7f47a1234640 1 -- 172.21.15.6:0/2495880628 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4788066280 msgr2=0x7f4788068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.912+0000 7f47a1234640 1 --2- 172.21.15.6:0/2495880628 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4788066280 0x7f4788068730 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f47900ae000 tx=0x7f47900a7000 comp rx=0 tx=0).stop 2023-07-21T22:19:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.912+0000 7f47a1234640 1 -- 172.21.15.6:0/2495880628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f479c069430 msgr2=0x7f479c14ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.912+0000 7f47a1234640 1 --2- 172.21.15.6:0/2495880628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f479c069430 0x7f479c14ba60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f478c00c480 tx=0x7f478c00c940 comp rx=0 tx=0).stop 2023-07-21T22:19:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.912+0000 7f47a1234640 1 -- 172.21.15.6:0/2495880628 shutdown_connections 2023-07-21T22:19:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.912+0000 7f47a1234640 1 --2- 172.21.15.6:0/2495880628 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f479c0af2b0 0x7f479c06c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.912+0000 7f47a1234640 1 --2- 172.21.15.6:0/2495880628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f479c070f30 0x7f479c06c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.912+0000 7f47a1234640 1 --2- 172.21.15.6:0/2495880628 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4788066280 0x7f4788068730 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.912+0000 7f47a1234640 1 --2- 172.21.15.6:0/2495880628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f479c069430 0x7f479c14ba60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.912+0000 7f47a1234640 1 -- 172.21.15.6:0/2495880628 >> 172.21.15.6:0/2495880628 conn(0x7f479c0cde90 msgr2=0x7f479c155a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.912+0000 7f47a1234640 1 -- 172.21.15.6:0/2495880628 shutdown_connections 2023-07-21T22:19:15.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:15.912+0000 7f47a1234640 1 -- 172.21.15.6:0/2495880628 wait complete. 2023-07-21T22:19:15.979 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:19:16.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.080+0000 7f95bb982640 1 Processor -- start 2023-07-21T22:19:16.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.080+0000 7f95bb982640 1 -- start start 2023-07-21T22:19:16.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.080+0000 7f95bb982640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f95b40d2fc0 0x7f95b40b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:16.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.080+0000 7f95bb982640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95b40d2300 0x7f95b40d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:16.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.080+0000 7f95bb982640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b40b04c0 con 0x7f95b415bde0 2023-07-21T22:19:16.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.080+0000 7f95bb982640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b415c1b0 con 0x7f95b40d2fc0 2023-07-21T22:19:16.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.080+0000 7f95bb982640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40d2cc0 con 0x7f95b40d2300 2023-07-21T22:19:16.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.080+0000 7f95b971e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f95b415bde0 0x7f95b40d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55916/0 (socket says 172.21.15.6:55916) 2023-07-21T22:19:16.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.080+0000 7f95b971e640 1 -- 172.21.15.6:0/2091063898 learned_addr learned my addr 172.21.15.6:0/2091063898 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:16.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.080+0000 7f95b8f1d640 1 --2- 172.21.15.6:0/2091063898 >> v2:172.21.15.161:3300/0 conn(0x7f95b40d2fc0 0x7f95b40b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:16.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.080+0000 7f95b9f1f640 1 --2- 172.21.15.6:0/2091063898 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95b40d2300 0x7f95b40d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:16.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.080+0000 7f95abfff640 1 -- 172.21.15.6:0/2091063898 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107473764 0 0) 0x7f95b40b04c0 con 0x7f95b415bde0 2023-07-21T22:19:16.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.080+0000 7f95abfff640 1 -- 172.21.15.6:0/2091063898 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95a0003530 con 0x7f95b415bde0 2023-07-21T22:19:16.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.084+0000 7f95b8f1d640 1 -- 172.21.15.6:0/2091063898 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95b40d2300 msgr2=0x7f95b40d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:16.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.084+0000 7f95b8f1d640 1 --2- 172.21.15.6:0/2091063898 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95b40d2300 0x7f95b40d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.084+0000 7f95b8f1d640 1 -- 172.21.15.6:0/2091063898 >> v1:172.21.15.6:6789/0 conn(0x7f95b415bde0 legacy=0x7f95b40d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:16.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.084+0000 7f95b8f1d640 1 -- 172.21.15.6:0/2091063898 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b40d0aa0 con 0x7f95b40d2fc0 2023-07-21T22:19:16.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.084+0000 7f95b8f1d640 1 --2- 172.21.15.6:0/2091063898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95b40d2fc0 0x7f95b40b0950 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f95a40097c0 tx=0x7f95a401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85e9f049eb97a84c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:16.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.084+0000 7f95abfff640 1 -- 172.21.15.6:0/2091063898 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a40ab680 con 0x7f95b40d2fc0 2023-07-21T22:19:16.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.084+0000 7f95abfff640 1 -- 172.21.15.6:0/2091063898 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a40ab7e0 con 0x7f95b40d2fc0 2023-07-21T22:19:16.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.084+0000 7f95abfff640 1 -- 172.21.15.6:0/2091063898 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a40abb70 con 0x7f95b40d2fc0 2023-07-21T22:19:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.084+0000 7f95bb982640 1 -- 172.21.15.6:0/2091063898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95b40d2fc0 msgr2=0x7f95b40b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.084+0000 7f95bb982640 1 --2- 172.21.15.6:0/2091063898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95b40d2fc0 0x7f95b40b0950 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f95a40097c0 tx=0x7f95a401c480 comp rx=0 tx=0).stop 2023-07-21T22:19:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.084+0000 7f95bb982640 1 -- 172.21.15.6:0/2091063898 shutdown_connections 2023-07-21T22:19:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.084+0000 7f95bb982640 1 --2- 172.21.15.6:0/2091063898 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95b40d2300 0x7f95b40d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.084+0000 7f95bb982640 1 --2- 172.21.15.6:0/2091063898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95b40d2fc0 0x7f95b40b0950 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.084+0000 7f95bb982640 1 -- 172.21.15.6:0/2091063898 >> 172.21.15.6:0/2091063898 conn(0x7f95b40659d0 msgr2=0x7f95b409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95bb982640 1 -- 172.21.15.6:0/2091063898 shutdown_connections 2023-07-21T22:19:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95bb982640 1 -- 172.21.15.6:0/2091063898 wait complete. 2023-07-21T22:19:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95bb982640 1 Processor -- start 2023-07-21T22:19:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95bb982640 1 -- start start 2023-07-21T22:19:16.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95bb982640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95b40d2300 0x7f95b41526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:16.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95bb982640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95b40d2fc0 0x7f95b40c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:16.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95bb982640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95b415bde0 0x7f95b4158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:16.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95bb982640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40c8be0 con 0x7f95b40d2fc0 2023-07-21T22:19:16.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95bb982640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40c7f60 con 0x7f95b415bde0 2023-07-21T22:19:16.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95bb982640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40c8240 con 0x7f95b40d2300 2023-07-21T22:19:16.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95b8f1d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95b40d2fc0 0x7f95b40c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:16.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95b8f1d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95b40d2fc0 0x7f95b40c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60810/0 (socket says 172.21.15.6:60810) 2023-07-21T22:19:16.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95b8f1d640 1 -- 172.21.15.6:0/2342756919 learned_addr learned my addr 172.21.15.6:0/2342756919 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:16.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95b971e640 1 --2- 172.21.15.6:0/2342756919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95b40d2300 0x7f95b41526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:16.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95b9f1f640 1 --2- 172.21.15.6:0/2342756919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95b415bde0 0x7f95b4158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:16.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95b8f1d640 1 -- 172.21.15.6:0/2342756919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95b40d2300 msgr2=0x7f95b41526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:16.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95b8f1d640 1 --2- 172.21.15.6:0/2342756919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95b40d2300 0x7f95b41526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95b8f1d640 1 -- 172.21.15.6:0/2342756919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95b415bde0 msgr2=0x7f95b4158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:16.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95b8f1d640 1 --2- 172.21.15.6:0/2342756919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95b415bde0 0x7f95b4158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95b8f1d640 1 -- 172.21.15.6:0/2342756919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a4009420 con 0x7f95b40d2fc0 2023-07-21T22:19:16.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95b971e640 1 --2- 172.21.15.6:0/2342756919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95b40d2300 0x7f95b41526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:16.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.088+0000 7f95b8f1d640 1 --2- 172.21.15.6:0/2342756919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95b40d2fc0 0x7f95b40c5ea0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f95a40ad040 tx=0x7f95a401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.092+0000 7f95a9ffb640 1 -- 172.21.15.6:0/2342756919 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a40bf610 con 0x7f95b40d2fc0 2023-07-21T22:19:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.092+0000 7f95a9ffb640 1 -- 172.21.15.6:0/2342756919 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a40bf770 con 0x7f95b40d2fc0 2023-07-21T22:19:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.092+0000 7f95a9ffb640 1 -- 172.21.15.6:0/2342756919 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a40bfb20 con 0x7f95b40d2fc0 2023-07-21T22:19:16.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.092+0000 7f95bb982640 1 -- 172.21.15.6:0/2342756919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b40c8520 con 0x7f95b40d2fc0 2023-07-21T22:19:16.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.092+0000 7f95bb982640 1 -- 172.21.15.6:0/2342756919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b4152c10 con 0x7f95b40d2fc0 2023-07-21T22:19:16.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.092+0000 7f95bb982640 1 -- 172.21.15.6:0/2342756919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b40678d0 con 0x7f95b40d2fc0 2023-07-21T22:19:16.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.092+0000 7f95a9ffb640 1 -- 172.21.15.6:0/2342756919 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f95a40bfc80 con 0x7f95b40d2fc0 2023-07-21T22:19:16.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.092+0000 7f95a9ffb640 1 --2- 172.21.15.6:0/2342756919 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9598066280 0x7f9598068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.092+0000 7f95a9ffb640 1 -- 172.21.15.6:0/2342756919 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f95a411e6b0 con 0x7f95b40d2fc0 2023-07-21T22:19:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.096+0000 7f95b971e640 1 --2- 172.21.15.6:0/2342756919 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9598066280 0x7f9598068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.096+0000 7f95b971e640 1 --2- 172.21.15.6:0/2342756919 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9598066280 0x7f9598068730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f95b00010f0 tx=0x7f95b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:16.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.096+0000 7f95a9ffb640 1 -- 172.21.15.6:0/2342756919 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95a40ebb40 con 0x7f95b40d2fc0 2023-07-21T22:19:16.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.252+0000 7f95bb982640 1 -- 172.21.15.6:0/2342756919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f95b40af6c0 con 0x7f95b40d2fc0 2023-07-21T22:19:16.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.252+0000 7f95a9ffb640 1 -- 172.21.15.6:0/2342756919 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f95a40ef160 con 0x7f95b40d2fc0 2023-07-21T22:19:16.300 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:19:16.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.256+0000 7f95bb982640 1 -- 172.21.15.6:0/2342756919 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9598066280 msgr2=0x7f9598068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:16.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.256+0000 7f95bb982640 1 --2- 172.21.15.6:0/2342756919 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9598066280 0x7f9598068730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f95b00010f0 tx=0x7f95b0009040 comp rx=0 tx=0).stop 2023-07-21T22:19:16.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.256+0000 7f95bb982640 1 -- 172.21.15.6:0/2342756919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95b40d2fc0 msgr2=0x7f95b40c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:16.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.256+0000 7f95bb982640 1 --2- 172.21.15.6:0/2342756919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95b40d2fc0 0x7f95b40c5ea0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f95a40ad040 tx=0x7f95a401acc0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.256+0000 7f95bb982640 1 -- 172.21.15.6:0/2342756919 shutdown_connections 2023-07-21T22:19:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.256+0000 7f95bb982640 1 --2- 172.21.15.6:0/2342756919 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95b415bde0 0x7f95b4158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.256+0000 7f95bb982640 1 --2- 172.21.15.6:0/2342756919 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9598066280 0x7f9598068730 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.256+0000 7f95bb982640 1 --2- 172.21.15.6:0/2342756919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95b40d2fc0 0x7f95b40c5ea0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.256+0000 7f95bb982640 1 --2- 172.21.15.6:0/2342756919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95b40d2300 0x7f95b41526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.256+0000 7f95bb982640 1 -- 172.21.15.6:0/2342756919 >> 172.21.15.6:0/2342756919 conn(0x7f95b40659d0 msgr2=0x7f95b40ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.256+0000 7f95bb982640 1 -- 172.21.15.6:0/2342756919 shutdown_connections 2023-07-21T22:19:16.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.256+0000 7f95bb982640 1 -- 172.21.15.6:0/2342756919 wait complete. 2023-07-21T22:19:16.321 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:19:16.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.424+0000 7fb59adfa640 1 Processor -- start 2023-07-21T22:19:16.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.424+0000 7fb59adfa640 1 -- start start 2023-07-21T22:19:16.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.424+0000 7fb59adfa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb59406a540 0x7fb59406a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:16.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.424+0000 7fb59adfa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb5940cf2e0 0x7fb5940cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:16.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.424+0000 7fb59adfa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5940cc9c0 0x7fb5940cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:16.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.424+0000 7fb59adfa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5940d0920 con 0x7fb5940cf2e0 2023-07-21T22:19:16.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.424+0000 7fb59adfa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59415bfd0 con 0x7fb59406a540 2023-07-21T22:19:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.424+0000 7fb59adfa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59406ae50 con 0x7fb5940cc9c0 2023-07-21T22:19:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.424+0000 7fb593fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb5940cf2e0 0x7fb5940cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.424+0000 7fb593fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb5940cf2e0 0x7fb5940cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60812/0 (socket says 172.21.15.6:60812) 2023-07-21T22:19:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.424+0000 7fb593fff640 1 -- 172.21.15.6:0/2581480880 learned_addr learned my addr 172.21.15.6:0/2581480880 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:16.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.424+0000 7fb598b96640 1 --2- 172.21.15.6:0/2581480880 >> v2:172.21.15.161:3300/0 conn(0x7fb59406a540 0x7fb59406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:16.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.424+0000 7fb599397640 1 --2- 172.21.15.6:0/2581480880 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5940cc9c0 0x7fb5940cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:16.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.428+0000 7fb593fff640 1 -- 172.21.15.6:0/2581480880 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5940cc9c0 msgr2=0x7fb5940cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:16.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.428+0000 7fb593fff640 1 --2- 172.21.15.6:0/2581480880 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5940cc9c0 0x7fb5940cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.428+0000 7fb593fff640 1 -- 172.21.15.6:0/2581480880 >> v2:172.21.15.161:3300/0 conn(0x7fb59406a540 msgr2=0x7fb59406a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:16.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.428+0000 7fb593fff640 1 --2- 172.21.15.6:0/2581480880 >> v2:172.21.15.161:3300/0 conn(0x7fb59406a540 0x7fb59406a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.428+0000 7fb593fff640 1 -- 172.21.15.6:0/2581480880 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5940cfd10 con 0x7fb5940cf2e0 2023-07-21T22:19:16.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.428+0000 7fb593fff640 1 --2- 172.21.15.6:0/2581480880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5940cf2e0 0x7fb5940cf710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb59406fee0 tx=0x7fb58001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319c937876ba0085 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:16.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.428+0000 7fb5937fe640 1 -- 172.21.15.6:0/2581480880 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5800aa5f0 con 0x7fb5940cf2e0 2023-07-21T22:19:16.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.428+0000 7fb5937fe640 1 -- 172.21.15.6:0/2581480880 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5800aa750 con 0x7fb5940cf2e0 2023-07-21T22:19:16.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.428+0000 7fb5937fe640 1 -- 172.21.15.6:0/2581480880 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5800aaae0 con 0x7fb5940cf2e0 2023-07-21T22:19:16.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.428+0000 7fb59adfa640 1 -- 172.21.15.6:0/2581480880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5940cf2e0 msgr2=0x7fb5940cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:16.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.428+0000 7fb59adfa640 1 --2- 172.21.15.6:0/2581480880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5940cf2e0 0x7fb5940cf710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb59406fee0 tx=0x7fb58001c4d0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.428+0000 7fb59adfa640 1 -- 172.21.15.6:0/2581480880 shutdown_connections 2023-07-21T22:19:16.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.428+0000 7fb59adfa640 1 --2- 172.21.15.6:0/2581480880 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5940cc9c0 0x7fb5940cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.428+0000 7fb59adfa640 1 --2- 172.21.15.6:0/2581480880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5940cf2e0 0x7fb5940cf710 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.428+0000 7fb59adfa640 1 --2- 172.21.15.6:0/2581480880 >> v2:172.21.15.161:3300/0 conn(0x7fb59406a540 0x7fb59406a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.428+0000 7fb59adfa640 1 -- 172.21.15.6:0/2581480880 >> 172.21.15.6:0/2581480880 conn(0x7fb594099490 msgr2=0x7fb594089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:16.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.428+0000 7fb59adfa640 1 -- 172.21.15.6:0/2581480880 shutdown_connections 2023-07-21T22:19:16.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb59adfa640 1 -- 172.21.15.6:0/2581480880 wait complete. 2023-07-21T22:19:16.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb59adfa640 1 Processor -- start 2023-07-21T22:19:16.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb59adfa640 1 -- start start 2023-07-21T22:19:16.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb59adfa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb59406a540 0x7fb594152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:16.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb59adfa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5940cc9c0 0x7fb5940b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:16.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb59adfa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5940cf2e0 0x7fb594154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:16.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb59adfa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5941526c0 con 0x7fb59406a540 2023-07-21T22:19:16.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb59adfa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5940c80c0 con 0x7fb5940cf2e0 2023-07-21T22:19:16.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb59adfa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5940c7210 con 0x7fb5940cc9c0 2023-07-21T22:19:16.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb598b96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb59406a540 0x7fb594152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:16.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb598b96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb59406a540 0x7fb594152180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60818/0 (socket says 172.21.15.6:60818) 2023-07-21T22:19:16.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb598b96640 1 -- 172.21.15.6:0/3878144897 learned_addr learned my addr 172.21.15.6:0/3878144897 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:16.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb599397640 1 --2- 172.21.15.6:0/3878144897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5940cf2e0 0x7fb594154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:16.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb593fff640 1 --2- 172.21.15.6:0/3878144897 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5940cc9c0 0x7fb5940b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:16.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb598b96640 1 -- 172.21.15.6:0/3878144897 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5940cc9c0 msgr2=0x7fb5940b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:16.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb598b96640 1 --2- 172.21.15.6:0/3878144897 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5940cc9c0 0x7fb5940b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb598b96640 1 -- 172.21.15.6:0/3878144897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5940cf2e0 msgr2=0x7fb594154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:16.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb598b96640 1 --2- 172.21.15.6:0/3878144897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5940cf2e0 0x7fb594154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb598b96640 1 -- 172.21.15.6:0/3878144897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5800094d0 con 0x7fb59406a540 2023-07-21T22:19:16.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb598b96640 1 --2- 172.21.15.6:0/3878144897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb59406a540 0x7fb594152180 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb58800d800 tx=0x7fb58800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:16.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.432+0000 7fb5917fa640 1 -- 172.21.15.6:0/3878144897 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb588009640 con 0x7fb59406a540 2023-07-21T22:19:16.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.436+0000 7fb5917fa640 1 -- 172.21.15.6:0/3878144897 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5880097a0 con 0x7fb59406a540 2023-07-21T22:19:16.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.436+0000 7fb5917fa640 1 -- 172.21.15.6:0/3878144897 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb588009930 con 0x7fb59406a540 2023-07-21T22:19:16.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.436+0000 7fb59adfa640 1 -- 172.21.15.6:0/3878144897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5940c74b0 con 0x7fb59406a540 2023-07-21T22:19:16.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.436+0000 7fb59adfa640 1 -- 172.21.15.6:0/3878144897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5940c7a70 con 0x7fb59406a540 2023-07-21T22:19:16.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.436+0000 7fb59adfa640 1 -- 172.21.15.6:0/3878144897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5940678d0 con 0x7fb59406a540 2023-07-21T22:19:16.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.436+0000 7fb5917fa640 1 -- 172.21.15.6:0/3878144897 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb588009a90 con 0x7fb59406a540 2023-07-21T22:19:16.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.436+0000 7fb5917fa640 1 --2- 172.21.15.6:0/3878144897 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb578066280 0x7fb578068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:16.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.436+0000 7fb5917fa640 1 -- 172.21.15.6:0/3878144897 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb588084050 con 0x7fb59406a540 2023-07-21T22:19:16.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.436+0000 7fb593fff640 1 --2- 172.21.15.6:0/3878144897 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb578066280 0x7fb578068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:16.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.440+0000 7fb593fff640 1 --2- 172.21.15.6:0/3878144897 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb578066280 0x7fb578068730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb5800ae000 tx=0x7fb5800b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:16.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.440+0000 7fb5917fa640 1 -- 172.21.15.6:0/3878144897 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb588051580 con 0x7fb59406a540 2023-07-21T22:19:16.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.596+0000 7fb59adfa640 1 -- 172.21.15.6:0/3878144897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb59406bdb0 con 0x7fb59406a540 2023-07-21T22:19:16.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.596+0000 7fb5917fa640 1 -- 172.21.15.6:0/3878144897 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb588054ba0 con 0x7fb59406a540 2023-07-21T22:19:16.644 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:19:16.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.600+0000 7fb59adfa640 1 -- 172.21.15.6:0/3878144897 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb578066280 msgr2=0x7fb578068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.600+0000 7fb59adfa640 1 --2- 172.21.15.6:0/3878144897 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb578066280 0x7fb578068730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb5800ae000 tx=0x7fb5800b5040 comp rx=0 tx=0).stop 2023-07-21T22:19:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.600+0000 7fb59adfa640 1 -- 172.21.15.6:0/3878144897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb59406a540 msgr2=0x7fb594152180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.600+0000 7fb59adfa640 1 --2- 172.21.15.6:0/3878144897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb59406a540 0x7fb594152180 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb58800d800 tx=0x7fb58800dcc0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.600+0000 7fb59adfa640 1 -- 172.21.15.6:0/3878144897 shutdown_connections 2023-07-21T22:19:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.600+0000 7fb59adfa640 1 --2- 172.21.15.6:0/3878144897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb5940cf2e0 0x7fb594154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.600+0000 7fb59adfa640 1 --2- 172.21.15.6:0/3878144897 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb5940cc9c0 0x7fb5940b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.600+0000 7fb59adfa640 1 --2- 172.21.15.6:0/3878144897 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb578066280 0x7fb578068730 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.600+0000 7fb59adfa640 1 --2- 172.21.15.6:0/3878144897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb59406a540 0x7fb594152180 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.600+0000 7fb59adfa640 1 -- 172.21.15.6:0/3878144897 >> 172.21.15.6:0/3878144897 conn(0x7fb594099490 msgr2=0x7fb5940cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.600+0000 7fb59adfa640 1 -- 172.21.15.6:0/3878144897 shutdown_connections 2023-07-21T22:19:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.600+0000 7fb59adfa640 1 -- 172.21.15.6:0/3878144897 wait complete. 2023-07-21T22:19:16.667 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:19:16.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.764+0000 7ff8d6bad640 1 Processor -- start 2023-07-21T22:19:16.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.764+0000 7ff8d6bad640 1 -- start start 2023-07-21T22:19:16.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.764+0000 7ff8d6bad640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff8d015fd60 0x7ff8d00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:16.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.764+0000 7ff8d6bad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8d00d1850 0x7ff8d00d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:16.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.764+0000 7ff8d6bad640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d00ccaf0 con 0x7ff8d00b7c70 2023-07-21T22:19:16.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.764+0000 7ff8d6bad640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d00d1190 con 0x7ff8d015fd60 2023-07-21T22:19:16.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.764+0000 7ff8d6bad640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d0160600 con 0x7ff8d00d1850 2023-07-21T22:19:16.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.764+0000 7ff8d4949640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff8d00b7c70 0x7ff8d015f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55928/0 (socket says 172.21.15.6:55928) 2023-07-21T22:19:16.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.764+0000 7ff8d4949640 1 -- 172.21.15.6:0/941970534 learned_addr learned my addr 172.21.15.6:0/941970534 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:16.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.768+0000 7ff8cffff640 1 --2- 172.21.15.6:0/941970534 >> v2:172.21.15.161:3300/0 conn(0x7ff8d015fd60 0x7ff8d00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:16.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.768+0000 7ff8d514a640 1 --2- 172.21.15.6:0/941970534 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8d00d1850 0x7ff8d00d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:16.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.768+0000 7ff8cf7fe640 1 -- 172.21.15.6:0/941970534 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500019688 0 0) 0x7ff8d00ccaf0 con 0x7ff8d00b7c70 2023-07-21T22:19:16.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.768+0000 7ff8cf7fe640 1 -- 172.21.15.6:0/941970534 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8c0003530 con 0x7ff8d00b7c70 2023-07-21T22:19:16.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.768+0000 7ff8cffff640 1 -- 172.21.15.6:0/941970534 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8d00d1850 msgr2=0x7ff8d00d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:16.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.768+0000 7ff8cffff640 1 --2- 172.21.15.6:0/941970534 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8d00d1850 0x7ff8d00d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.768+0000 7ff8cffff640 1 -- 172.21.15.6:0/941970534 >> v1:172.21.15.6:6789/0 conn(0x7ff8d00b7c70 legacy=0x7ff8d015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:16.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.768+0000 7ff8cffff640 1 -- 172.21.15.6:0/941970534 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d0160320 con 0x7ff8d015fd60 2023-07-21T22:19:16.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.768+0000 7ff8cffff640 1 --2- 172.21.15.6:0/941970534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8d015fd60 0x7ff8d00d0c50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0097c0 tx=0x7ff8bc01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d92b88898d77437f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:16.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.768+0000 7ff8cf7fe640 1 -- 172.21.15.6:0/941970534 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc0ab670 con 0x7ff8d015fd60 2023-07-21T22:19:16.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.768+0000 7ff8cf7fe640 1 -- 172.21.15.6:0/941970534 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc0ab7d0 con 0x7ff8d015fd60 2023-07-21T22:19:16.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.768+0000 7ff8cf7fe640 1 -- 172.21.15.6:0/941970534 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc0abb40 con 0x7ff8d015fd60 2023-07-21T22:19:16.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8d6bad640 1 -- 172.21.15.6:0/941970534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8d015fd60 msgr2=0x7ff8d00d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:16.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8d6bad640 1 --2- 172.21.15.6:0/941970534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8d015fd60 0x7ff8d00d0c50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0097c0 tx=0x7ff8bc01c450 comp rx=0 tx=0).stop 2023-07-21T22:19:16.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8d6bad640 1 -- 172.21.15.6:0/941970534 shutdown_connections 2023-07-21T22:19:16.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8d6bad640 1 --2- 172.21.15.6:0/941970534 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8d00d1850 0x7ff8d00d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8d6bad640 1 --2- 172.21.15.6:0/941970534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8d015fd60 0x7ff8d00d0c50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8d6bad640 1 -- 172.21.15.6:0/941970534 >> 172.21.15.6:0/941970534 conn(0x7ff8d00650b0 msgr2=0x7ff8d00654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:16.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8d6bad640 1 -- 172.21.15.6:0/941970534 shutdown_connections 2023-07-21T22:19:16.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8d6bad640 1 -- 172.21.15.6:0/941970534 wait complete. 2023-07-21T22:19:16.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8d6bad640 1 Processor -- start 2023-07-21T22:19:16.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8d6bad640 1 -- start start 2023-07-21T22:19:16.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8d6bad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d00b7c70 0x7ff8d0159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:16.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8d6bad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8d00d1850 0x7ff8d00b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:16.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8d6bad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8d015fd60 0x7ff8d0150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:16.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8d6bad640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d0152fd0 con 0x7ff8d00b7c70 2023-07-21T22:19:16.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8d6bad640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d01523c0 con 0x7ff8d015fd60 2023-07-21T22:19:16.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8d6bad640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d01526a0 con 0x7ff8d00d1850 2023-07-21T22:19:16.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8d4949640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d00b7c70 0x7ff8d0159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:16.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8d4949640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d00b7c70 0x7ff8d0159f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60820/0 (socket says 172.21.15.6:60820) 2023-07-21T22:19:16.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8d4949640 1 -- 172.21.15.6:0/2856339789 learned_addr learned my addr 172.21.15.6:0/2856339789 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:16.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8cffff640 1 --2- 172.21.15.6:0/2856339789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8d00d1850 0x7ff8d00b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:16.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.772+0000 7ff8d514a640 1 --2- 172.21.15.6:0/2856339789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8d015fd60 0x7ff8d0150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:16.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.776+0000 7ff8d4949640 1 -- 172.21.15.6:0/2856339789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8d00d1850 msgr2=0x7ff8d00b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:16.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.776+0000 7ff8d4949640 1 --2- 172.21.15.6:0/2856339789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8d00d1850 0x7ff8d00b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.776+0000 7ff8d4949640 1 -- 172.21.15.6:0/2856339789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8d015fd60 msgr2=0x7ff8d0150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:16.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.776+0000 7ff8d4949640 1 --2- 172.21.15.6:0/2856339789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8d015fd60 0x7ff8d0150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.776+0000 7ff8d4949640 1 -- 172.21.15.6:0/2856339789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc009420 con 0x7ff8d00b7c70 2023-07-21T22:19:16.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.776+0000 7ff8d4949640 1 --2- 172.21.15.6:0/2856339789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d00b7c70 0x7ff8d0159f20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400c3c0 tx=0x7ff8c400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:16.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.776+0000 7ff8cd7fa640 1 -- 172.21.15.6:0/2856339789 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4005cf0 con 0x7ff8d00b7c70 2023-07-21T22:19:16.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.776+0000 7ff8cd7fa640 1 -- 172.21.15.6:0/2856339789 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c4005e50 con 0x7ff8d00b7c70 2023-07-21T22:19:16.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.776+0000 7ff8d6bad640 1 -- 172.21.15.6:0/2856339789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d0152980 con 0x7ff8d00b7c70 2023-07-21T22:19:16.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.776+0000 7ff8cd7fa640 1 -- 172.21.15.6:0/2856339789 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40072f0 con 0x7ff8d00b7c70 2023-07-21T22:19:16.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.776+0000 7ff8d6bad640 1 -- 172.21.15.6:0/2856339789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d015a460 con 0x7ff8d00b7c70 2023-07-21T22:19:16.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.776+0000 7ff8d6bad640 1 -- 172.21.15.6:0/2856339789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d00678d0 con 0x7ff8d00b7c70 2023-07-21T22:19:16.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.776+0000 7ff8cd7fa640 1 -- 172.21.15.6:0/2856339789 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff8c4007450 con 0x7ff8d00b7c70 2023-07-21T22:19:16.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.776+0000 7ff8cd7fa640 1 --2- 172.21.15.6:0/2856339789 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff8b4066280 0x7ff8b4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:16.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.776+0000 7ff8cd7fa640 1 -- 172.21.15.6:0/2856339789 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff8c4083310 con 0x7ff8d00b7c70 2023-07-21T22:19:16.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.780+0000 7ff8cffff640 1 --2- 172.21.15.6:0/2856339789 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff8b4066280 0x7ff8b4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:16.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.780+0000 7ff8cffff640 1 --2- 172.21.15.6:0/2856339789 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff8b4066280 0x7ff8b4068730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0af000 tx=0x7ff8bc0b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:16.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.780+0000 7ff8cd7fa640 1 -- 172.21.15.6:0/2856339789 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8c40507a0 con 0x7ff8d00b7c70 2023-07-21T22:19:16.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.940+0000 7ff8d6bad640 1 -- 172.21.15.6:0/2856339789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8d00b2a10 con 0x7ff8d00b7c70 2023-07-21T22:19:16.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.944+0000 7ff8cd7fa640 1 -- 172.21.15.6:0/2856339789 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18207 (secure 0 0 0) 0x7ff8c4053dc0 con 0x7ff8d00b7c70 2023-07-21T22:19:16.990 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:16.990 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:18:45.315608+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:18:41.465054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:18:42.709896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:19:16.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.944+0000 7ff8d6bad640 1 -- 172.21.15.6:0/2856339789 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff8b4066280 msgr2=0x7ff8b4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:16.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.944+0000 7ff8d6bad640 1 --2- 172.21.15.6:0/2856339789 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff8b4066280 0x7ff8b4068730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0af000 tx=0x7ff8bc0b6040 comp rx=0 tx=0).stop 2023-07-21T22:19:16.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.944+0000 7ff8d6bad640 1 -- 172.21.15.6:0/2856339789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d00b7c70 msgr2=0x7ff8d0159f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:16.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.944+0000 7ff8d6bad640 1 --2- 172.21.15.6:0/2856339789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d00b7c70 0x7ff8d0159f20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400c3c0 tx=0x7ff8c400c880 comp rx=0 tx=0).stop 2023-07-21T22:19:16.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.944+0000 7ff8d6bad640 1 -- 172.21.15.6:0/2856339789 shutdown_connections 2023-07-21T22:19:16.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.944+0000 7ff8d6bad640 1 --2- 172.21.15.6:0/2856339789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8d015fd60 0x7ff8d0150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.944+0000 7ff8d6bad640 1 --2- 172.21.15.6:0/2856339789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8d00d1850 0x7ff8d00b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.944+0000 7ff8d6bad640 1 --2- 172.21.15.6:0/2856339789 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff8b4066280 0x7ff8b4068730 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.944+0000 7ff8d6bad640 1 --2- 172.21.15.6:0/2856339789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d00b7c70 0x7ff8d0159f20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.944+0000 7ff8d6bad640 1 -- 172.21.15.6:0/2856339789 >> 172.21.15.6:0/2856339789 conn(0x7ff8d00650b0 msgr2=0x7ff8d00b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.944+0000 7ff8d6bad640 1 -- 172.21.15.6:0/2856339789 shutdown_connections 2023-07-21T22:19:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:16.944+0000 7ff8d6bad640 1 -- 172.21.15.6:0/2856339789 wait complete. 2023-07-21T22:19:17.011 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:18:41.465054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:18:42.709896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:19:17.011 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:19:17.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.112+0000 7f5345a34640 1 Processor -- start 2023-07-21T22:19:17.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.112+0000 7f5345a34640 1 -- start start 2023-07-21T22:19:17.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.112+0000 7f5345a34640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53400aeb40 0x7f534015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:17.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.112+0000 7f5345a34640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53401532b0 con 0x7f5340159440 2023-07-21T22:19:17.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.112+0000 7f5345a34640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53400ca6f0 con 0x7f53400aef10 2023-07-21T22:19:17.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.112+0000 7f5345a34640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53401599d0 con 0x7f53400aeb40 2023-07-21T22:19:17.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.112+0000 7f533effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53400aeb40 0x7f534015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:17.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.112+0000 7f533f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5340159440 0x7f53400c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55936/0 (socket says 172.21.15.6:55936) 2023-07-21T22:19:17.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.112+0000 7f533f7fe640 1 -- 172.21.15.6:0/1091816658 learned_addr learned my addr 172.21.15.6:0/1091816658 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:17.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.112+0000 7f533effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53400aeb40 0x7f534015cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60826/0 (socket says 172.21.15.6:60826) 2023-07-21T22:19:17.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.116+0000 7f533effd640 1 -- 172.21.15.6:0/1091816658 >> v1:172.21.15.161:6789/0 conn(0x7f53400aef10 legacy=0x7f5340158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:17.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.116+0000 7f533effd640 1 -- 172.21.15.6:0/1091816658 >> v1:172.21.15.6:6789/0 conn(0x7f5340159440 legacy=0x7f53400c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:17.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.116+0000 7f533e7fc640 1 -- 172.21.15.6:0/1091816658 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334998980 0 0) 0x7f53401532b0 con 0x7f5340159440 2023-07-21T22:19:17.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.116+0000 7f533effd640 1 -- 172.21.15.6:0/1091816658 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5340159cb0 con 0x7f53400aeb40 2023-07-21T22:19:17.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.116+0000 7f533effd640 1 --2- 172.21.15.6:0/1091816658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53400aeb40 0x7f534015cef0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f533000ba60 tx=0x7f533001ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca66bb25138ce52 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:17.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.116+0000 7f533e7fc640 1 -- 172.21.15.6:0/1091816658 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53300a7b60 con 0x7f53400aeb40 2023-07-21T22:19:17.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.116+0000 7f533e7fc640 1 -- 172.21.15.6:0/1091816658 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53300a7cc0 con 0x7f53400aeb40 2023-07-21T22:19:17.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.116+0000 7f533e7fc640 1 -- 172.21.15.6:0/1091816658 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53300af660 con 0x7f53400aeb40 2023-07-21T22:19:17.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.116+0000 7f5345a34640 1 -- 172.21.15.6:0/1091816658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53400aeb40 msgr2=0x7f534015cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:17.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.116+0000 7f5345a34640 1 --2- 172.21.15.6:0/1091816658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53400aeb40 0x7f534015cef0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f533000ba60 tx=0x7f533001ea90 comp rx=0 tx=0).stop 2023-07-21T22:19:17.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.116+0000 7f5345a34640 1 -- 172.21.15.6:0/1091816658 shutdown_connections 2023-07-21T22:19:17.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.116+0000 7f5345a34640 1 --2- 172.21.15.6:0/1091816658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53400aeb40 0x7f534015cef0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.116+0000 7f5345a34640 1 -- 172.21.15.6:0/1091816658 >> 172.21.15.6:0/1091816658 conn(0x7f53400cde90 msgr2=0x7f53400ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:17.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f5345a34640 1 -- 172.21.15.6:0/1091816658 shutdown_connections 2023-07-21T22:19:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f5345a34640 1 -- 172.21.15.6:0/1091816658 wait complete. 2023-07-21T22:19:17.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f5345a34640 1 Processor -- start 2023-07-21T22:19:17.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f5345a34640 1 -- start start 2023-07-21T22:19:17.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f5345a34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53400aeb40 0x7f534014df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:17.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f5345a34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53400aef10 0x7f53400b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:17.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f5345a34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5340159440 0x7f53400b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:17.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f5345a34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534014ec30 con 0x7f53400aeb40 2023-07-21T22:19:17.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f5345a34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534014e950 con 0x7f5340159440 2023-07-21T22:19:17.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f5345a34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534006b320 con 0x7f53400aef10 2023-07-21T22:19:17.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f533effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53400aeb40 0x7f534014df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:17.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f533effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53400aeb40 0x7f534014df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60830/0 (socket says 172.21.15.6:60830) 2023-07-21T22:19:17.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f533effd640 1 -- 172.21.15.6:0/3915131595 learned_addr learned my addr 172.21.15.6:0/3915131595 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:17.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f533f7fe640 1 --2- 172.21.15.6:0/3915131595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5340159440 0x7f53400b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:17.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f5337fff640 1 --2- 172.21.15.6:0/3915131595 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53400aef10 0x7f53400b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:17.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f533effd640 1 -- 172.21.15.6:0/3915131595 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53400aef10 msgr2=0x7f53400b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:17.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f533effd640 1 --2- 172.21.15.6:0/3915131595 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53400aef10 0x7f53400b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f533effd640 1 -- 172.21.15.6:0/3915131595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5340159440 msgr2=0x7f53400b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:17.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f533effd640 1 --2- 172.21.15.6:0/3915131595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5340159440 0x7f53400b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f533effd640 1 -- 172.21.15.6:0/3915131595 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533000b6c0 con 0x7f53400aeb40 2023-07-21T22:19:17.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f533effd640 1 --2- 172.21.15.6:0/3915131595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53400aeb40 0x7f534014df70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f53300b2040 tx=0x7f533001b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:17.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f533cff9640 1 -- 172.21.15.6:0/3915131595 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53300afe40 con 0x7f53400aeb40 2023-07-21T22:19:17.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f533cff9640 1 -- 172.21.15.6:0/3915131595 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53300ba470 con 0x7f53400aeb40 2023-07-21T22:19:17.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f5345a34640 1 -- 172.21.15.6:0/3915131595 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534006b600 con 0x7f53400aeb40 2023-07-21T22:19:17.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.120+0000 7f533cff9640 1 -- 172.21.15.6:0/3915131595 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53300ba820 con 0x7f53400aeb40 2023-07-21T22:19:17.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.124+0000 7f5345a34640 1 -- 172.21.15.6:0/3915131595 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53400b1eb0 con 0x7f53400aeb40 2023-07-21T22:19:17.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.124+0000 7f5345a34640 1 -- 172.21.15.6:0/3915131595 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53400678d0 con 0x7f53400aeb40 2023-07-21T22:19:17.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.124+0000 7f533cff9640 1 -- 172.21.15.6:0/3915131595 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f53300b6070 con 0x7f53400aeb40 2023-07-21T22:19:17.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.124+0000 7f533cff9640 1 --2- 172.21.15.6:0/3915131595 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5320066280 0x7f5320068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:17.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.124+0000 7f533cff9640 1 -- 172.21.15.6:0/3915131595 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f533011f1b0 con 0x7f53400aeb40 2023-07-21T22:19:17.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.124+0000 7f5337fff640 1 --2- 172.21.15.6:0/3915131595 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5320066280 0x7f5320068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:17.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.124+0000 7f5337fff640 1 --2- 172.21.15.6:0/3915131595 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5320066280 0x7f5320068730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5340152a50 tx=0x7f5328009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:17.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.128+0000 7f533cff9640 1 -- 172.21.15.6:0/3915131595 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f53300ec620 con 0x7f53400aeb40 2023-07-21T22:19:17.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.284+0000 7f5345a34640 1 -- 172.21.15.6:0/3915131595 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53400cb820 con 0x7f53400aeb40 2023-07-21T22:19:17.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.288+0000 7f533cff9640 1 -- 172.21.15.6:0/3915131595 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53300efc40 con 0x7f53400aeb40 2023-07-21T22:19:17.334 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:19:17.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.288+0000 7f5345a34640 1 -- 172.21.15.6:0/3915131595 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5320066280 msgr2=0x7f5320068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:17.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.288+0000 7f5345a34640 1 --2- 172.21.15.6:0/3915131595 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5320066280 0x7f5320068730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5340152a50 tx=0x7f5328009040 comp rx=0 tx=0).stop 2023-07-21T22:19:17.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.288+0000 7f5345a34640 1 -- 172.21.15.6:0/3915131595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53400aeb40 msgr2=0x7f534014df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:17.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.288+0000 7f5345a34640 1 --2- 172.21.15.6:0/3915131595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53400aeb40 0x7f534014df70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f53300b2040 tx=0x7f533001b830 comp rx=0 tx=0).stop 2023-07-21T22:19:17.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.288+0000 7f5345a34640 1 -- 172.21.15.6:0/3915131595 shutdown_connections 2023-07-21T22:19:17.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.288+0000 7f5345a34640 1 --2- 172.21.15.6:0/3915131595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5340159440 0x7f53400b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.288+0000 7f5345a34640 1 --2- 172.21.15.6:0/3915131595 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f53400aef10 0x7f53400b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.288+0000 7f5345a34640 1 --2- 172.21.15.6:0/3915131595 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5320066280 0x7f5320068730 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.288+0000 7f5345a34640 1 --2- 172.21.15.6:0/3915131595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53400aeb40 0x7f534014df70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.288+0000 7f5345a34640 1 -- 172.21.15.6:0/3915131595 >> 172.21.15.6:0/3915131595 conn(0x7f53400cde90 msgr2=0x7f53400ad8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.288+0000 7f5345a34640 1 -- 172.21.15.6:0/3915131595 shutdown_connections 2023-07-21T22:19:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.288+0000 7f5345a34640 1 -- 172.21.15.6:0/3915131595 wait complete. 2023-07-21T22:19:17.358 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:19:17.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.460+0000 7f37a55e9640 1 Processor -- start 2023-07-21T22:19:17.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.460+0000 7f37a55e9640 1 -- start start 2023-07-21T22:19:17.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.460+0000 7f37a55e9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f37a00cf2e0 0x7f37a00cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:17.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.460+0000 7f37a55e9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37a00ca790 0x7f37a00cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:17.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.460+0000 7f37a55e9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a00d0920 con 0x7f37a006a540 2023-07-21T22:19:17.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.460+0000 7f37a55e9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a015bfd0 con 0x7f37a00cf2e0 2023-07-21T22:19:17.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.460+0000 7f37a55e9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00cfd10 con 0x7f37a00ca790 2023-07-21T22:19:17.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.460+0000 7f37967fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f37a00cf2e0 0x7f37a00cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:17.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.460+0000 7f37967fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f37a00cf2e0 0x7f37a00cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42194/0 (socket says 172.21.15.6:42194) 2023-07-21T22:19:17.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.460+0000 7f37967fc640 1 -- 172.21.15.6:0/3342439610 learned_addr learned my addr 172.21.15.6:0/3342439610 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:17.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.460+0000 7f379f7fe640 1 --2- 172.21.15.6:0/3342439610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37a00ca790 0x7f37a00cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:17.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.460+0000 7f37967fc640 1 -- 172.21.15.6:0/3342439610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37a00ca790 msgr2=0x7f37a00cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:17.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.460+0000 7f37967fc640 1 --2- 172.21.15.6:0/3342439610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37a00ca790 0x7f37a00cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.460+0000 7f37967fc640 1 -- 172.21.15.6:0/3342439610 >> v1:172.21.15.161:6789/0 conn(0x7f37a006a540 legacy=0x7f37a006a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:17.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.460+0000 7f37967fc640 1 -- 172.21.15.6:0/3342439610 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a00cfff0 con 0x7f37a00cf2e0 2023-07-21T22:19:17.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.464+0000 7f37967fc640 1 --2- 172.21.15.6:0/3342439610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a00cf2e0 0x7f37a00cf710 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3788009870 tx=0x7f378801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e216261fafecdda6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:17.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.464+0000 7f379e7fc640 1 -- 172.21.15.6:0/3342439610 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37880aa670 con 0x7f37a00cf2e0 2023-07-21T22:19:17.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.464+0000 7f379e7fc640 1 -- 172.21.15.6:0/3342439610 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37880aa7d0 con 0x7f37a00cf2e0 2023-07-21T22:19:17.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.464+0000 7f379e7fc640 1 -- 172.21.15.6:0/3342439610 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37880aab60 con 0x7f37a00cf2e0 2023-07-21T22:19:17.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.464+0000 7f37a55e9640 1 -- 172.21.15.6:0/3342439610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a00cf2e0 msgr2=0x7f37a00cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:17.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.464+0000 7f37a55e9640 1 --2- 172.21.15.6:0/3342439610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a00cf2e0 0x7f37a00cf710 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3788009870 tx=0x7f378801c510 comp rx=0 tx=0).stop 2023-07-21T22:19:17.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.464+0000 7f37a55e9640 1 -- 172.21.15.6:0/3342439610 shutdown_connections 2023-07-21T22:19:17.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.464+0000 7f37a55e9640 1 --2- 172.21.15.6:0/3342439610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37a00ca790 0x7f37a00cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.464+0000 7f37a55e9640 1 --2- 172.21.15.6:0/3342439610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a00cf2e0 0x7f37a00cf710 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.464+0000 7f37a55e9640 1 -- 172.21.15.6:0/3342439610 >> 172.21.15.6:0/3342439610 conn(0x7f37a0099490 msgr2=0x7f37a0089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:17.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.464+0000 7f37a55e9640 1 -- 172.21.15.6:0/3342439610 shutdown_connections 2023-07-21T22:19:17.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.464+0000 7f37a55e9640 1 -- 172.21.15.6:0/3342439610 wait complete. 2023-07-21T22:19:17.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f37a55e9640 1 Processor -- start 2023-07-21T22:19:17.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f37a55e9640 1 -- start start 2023-07-21T22:19:17.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f37a55e9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37a006a540 0x7f37a00b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:17.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f37a55e9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a00ca790 0x7f37a015a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:17.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f37a55e9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37a00cf2e0 0x7f37a006e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:17.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f37a55e9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a014bed0 con 0x7f37a00ca790 2023-07-21T22:19:17.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f37a55e9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a015b380 con 0x7f37a00cf2e0 2023-07-21T22:19:17.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f37a55e9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00af490 con 0x7f37a006a540 2023-07-21T22:19:17.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f37967fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a00ca790 0x7f37a015a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:17.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f37967fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a00ca790 0x7f37a015a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42196/0 (socket says 172.21.15.6:42196) 2023-07-21T22:19:17.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f37967fc640 1 -- 172.21.15.6:0/257338682 learned_addr learned my addr 172.21.15.6:0/257338682 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:17.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f379effd640 1 --2- 172.21.15.6:0/257338682 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37a006a540 0x7f37a00b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:17.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f379f7fe640 1 --2- 172.21.15.6:0/257338682 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37a00cf2e0 0x7f37a006e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:17.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f37967fc640 1 -- 172.21.15.6:0/257338682 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37a006a540 msgr2=0x7f37a00b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:17.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f37967fc640 1 --2- 172.21.15.6:0/257338682 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37a006a540 0x7f37a00b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f37967fc640 1 -- 172.21.15.6:0/257338682 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37a00cf2e0 msgr2=0x7f37a006e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:17.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f37967fc640 1 --2- 172.21.15.6:0/257338682 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37a00cf2e0 0x7f37a006e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f37967fc640 1 -- 172.21.15.6:0/257338682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37880094d0 con 0x7f37a00ca790 2023-07-21T22:19:17.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f37967fc640 1 --2- 172.21.15.6:0/257338682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a00ca790 0x7f37a015a490 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f37880ac040 tx=0x7f378801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:17.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f3797fff640 1 -- 172.21.15.6:0/257338682 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37880b3800 con 0x7f37a00ca790 2023-07-21T22:19:17.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f3797fff640 1 -- 172.21.15.6:0/257338682 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37880b3980 con 0x7f37a00ca790 2023-07-21T22:19:17.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f3797fff640 1 -- 172.21.15.6:0/257338682 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37880b3d30 con 0x7f37a00ca790 2023-07-21T22:19:17.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f37a55e9640 1 -- 172.21.15.6:0/257338682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a015aae0 con 0x7f37a00ca790 2023-07-21T22:19:17.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.468+0000 7f37a55e9640 1 -- 172.21.15.6:0/257338682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a015b0a0 con 0x7f37a00ca790 2023-07-21T22:19:17.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.472+0000 7f37a55e9640 1 -- 172.21.15.6:0/257338682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a00678d0 con 0x7f37a00ca790 2023-07-21T22:19:17.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.472+0000 7f3797fff640 1 -- 172.21.15.6:0/257338682 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f37880b2380 con 0x7f37a00ca790 2023-07-21T22:19:17.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.472+0000 7f3797fff640 1 --2- 172.21.15.6:0/257338682 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f37800662b0 0x7f3780068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:17.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.472+0000 7f3797fff640 1 -- 172.21.15.6:0/257338682 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f378811e510 con 0x7f37a00ca790 2023-07-21T22:19:17.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.472+0000 7f379effd640 1 --2- 172.21.15.6:0/257338682 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f37800662b0 0x7f3780068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:17.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.472+0000 7f379effd640 1 --2- 172.21.15.6:0/257338682 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f37800662b0 0x7f3780068760 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3790007fd0 tx=0x7f3790009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:17.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.476+0000 7f3797fff640 1 -- 172.21.15.6:0/257338682 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f37880eba30 con 0x7f37a00ca790 2023-07-21T22:19:17.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.632+0000 7f37a55e9640 1 -- 172.21.15.6:0/257338682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f37a014eb30 con 0x7f37a00ca790 2023-07-21T22:19:17.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.632+0000 7f3797fff640 1 -- 172.21.15.6:0/257338682 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f37880aa630 con 0x7f37a00ca790 2023-07-21T22:19:17.678 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:19:17.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.632+0000 7f37a55e9640 1 -- 172.21.15.6:0/257338682 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f37800662b0 msgr2=0x7f3780068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:17.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.632+0000 7f37a55e9640 1 --2- 172.21.15.6:0/257338682 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f37800662b0 0x7f3780068760 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3790007fd0 tx=0x7f3790009040 comp rx=0 tx=0).stop 2023-07-21T22:19:17.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.632+0000 7f37a55e9640 1 -- 172.21.15.6:0/257338682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a00ca790 msgr2=0x7f37a015a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:17.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.632+0000 7f37a55e9640 1 --2- 172.21.15.6:0/257338682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a00ca790 0x7f37a015a490 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f37880ac040 tx=0x7f378801ad50 comp rx=0 tx=0).stop 2023-07-21T22:19:17.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.632+0000 7f37a55e9640 1 -- 172.21.15.6:0/257338682 shutdown_connections 2023-07-21T22:19:17.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.632+0000 7f37a55e9640 1 --2- 172.21.15.6:0/257338682 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37a00cf2e0 0x7f37a006e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.632+0000 7f37a55e9640 1 --2- 172.21.15.6:0/257338682 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f37800662b0 0x7f3780068760 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.632+0000 7f37a55e9640 1 --2- 172.21.15.6:0/257338682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a00ca790 0x7f37a015a490 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.632+0000 7f37a55e9640 1 --2- 172.21.15.6:0/257338682 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37a006a540 0x7f37a00b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.632+0000 7f37a55e9640 1 -- 172.21.15.6:0/257338682 >> 172.21.15.6:0/257338682 conn(0x7f37a0099490 msgr2=0x7f37a00cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:17.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.632+0000 7f37a55e9640 1 -- 172.21.15.6:0/257338682 shutdown_connections 2023-07-21T22:19:17.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.632+0000 7f37a55e9640 1 -- 172.21.15.6:0/257338682 wait complete. 2023-07-21T22:19:17.699 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:19:17.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.800+0000 7fb934af9640 1 Processor -- start 2023-07-21T22:19:17.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.800+0000 7fb934af9640 1 -- start start 2023-07-21T22:19:17.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.800+0000 7fb934af9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb9300aeb40 0x7fb93015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:17.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.800+0000 7fb934af9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9300aef10 0x7fb930158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:17.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.800+0000 7fb934af9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9301532b0 con 0x7fb930159270 2023-07-21T22:19:17.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.800+0000 7fb934af9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9300ca6f0 con 0x7fb9300aeb40 2023-07-21T22:19:17.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.800+0000 7fb934af9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9301599d0 con 0x7fb9300aef10 2023-07-21T22:19:17.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.800+0000 7fb92e59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb9300aeb40 0x7fb93015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:17.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.800+0000 7fb927fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9300aef10 0x7fb930158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:17.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.800+0000 7fb92e59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb9300aeb40 0x7fb93015cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:36206/0 (socket says 172.21.15.6:36206) 2023-07-21T22:19:17.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.800+0000 7fb92e59c640 1 -- 172.21.15.6:0/4294733503 learned_addr learned my addr 172.21.15.6:0/4294733503 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:17.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.800+0000 7fb92e59c640 1 -- 172.21.15.6:0/4294733503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9300aef10 msgr2=0x7fb930158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:17.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.800+0000 7fb92e59c640 1 --2- 172.21.15.6:0/4294733503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9300aef10 0x7fb930158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.800+0000 7fb92e59c640 1 -- 172.21.15.6:0/4294733503 >> v1:172.21.15.161:6789/0 conn(0x7fb930159270 legacy=0x7fb9300c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:17.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.800+0000 7fb92e59c640 1 -- 172.21.15.6:0/4294733503 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb930159cb0 con 0x7fb9300aeb40 2023-07-21T22:19:17.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.804+0000 7fb92e59c640 1 --2- 172.21.15.6:0/4294733503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9300aeb40 0x7fb93015cef0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb920009870 tx=0x7fb92001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a1d0d646a4232f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:17.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.804+0000 7fb92dd9b640 1 -- 172.21.15.6:0/4294733503 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9200ab680 con 0x7fb9300aeb40 2023-07-21T22:19:17.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.804+0000 7fb92dd9b640 1 -- 172.21.15.6:0/4294733503 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9200ab7e0 con 0x7fb9300aeb40 2023-07-21T22:19:17.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.804+0000 7fb92dd9b640 1 -- 172.21.15.6:0/4294733503 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9200abb70 con 0x7fb9300aeb40 2023-07-21T22:19:17.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.804+0000 7fb934af9640 1 -- 172.21.15.6:0/4294733503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9300aeb40 msgr2=0x7fb93015cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:17.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.804+0000 7fb934af9640 1 --2- 172.21.15.6:0/4294733503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9300aeb40 0x7fb93015cef0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb920009870 tx=0x7fb92001c480 comp rx=0 tx=0).stop 2023-07-21T22:19:17.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.804+0000 7fb934af9640 1 -- 172.21.15.6:0/4294733503 shutdown_connections 2023-07-21T22:19:17.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.804+0000 7fb934af9640 1 --2- 172.21.15.6:0/4294733503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9300aef10 0x7fb930158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.804+0000 7fb934af9640 1 --2- 172.21.15.6:0/4294733503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9300aeb40 0x7fb93015cef0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.804+0000 7fb934af9640 1 -- 172.21.15.6:0/4294733503 >> 172.21.15.6:0/4294733503 conn(0x7fb9300cde90 msgr2=0x7fb9300ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:17.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.804+0000 7fb934af9640 1 -- 172.21.15.6:0/4294733503 shutdown_connections 2023-07-21T22:19:17.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.804+0000 7fb934af9640 1 -- 172.21.15.6:0/4294733503 wait complete. 2023-07-21T22:19:17.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb934af9640 1 Processor -- start 2023-07-21T22:19:17.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb934af9640 1 -- start start 2023-07-21T22:19:17.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb934af9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9300aeb40 0x7fb930149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:17.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb934af9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9300aef10 0x7fb930152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:17.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb934af9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb930159270 0x7fb9301488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:17.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb934af9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb930149f70 con 0x7fb9300aef10 2023-07-21T22:19:17.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb934af9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93014e360 con 0x7fb930159270 2023-07-21T22:19:17.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb934af9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93014e640 con 0x7fb9300aeb40 2023-07-21T22:19:17.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb927fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9300aef10 0x7fb930152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:17.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb927fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9300aef10 0x7fb930152900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42198/0 (socket says 172.21.15.6:42198) 2023-07-21T22:19:17.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb927fff640 1 -- 172.21.15.6:0/1777247182 learned_addr learned my addr 172.21.15.6:0/1777247182 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:17.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb92e59c640 1 --2- 172.21.15.6:0/1777247182 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9300aeb40 0x7fb930149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:17.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb92ed9d640 1 --2- 172.21.15.6:0/1777247182 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb930159270 0x7fb9301488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:17.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb927fff640 1 -- 172.21.15.6:0/1777247182 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9300aeb40 msgr2=0x7fb930149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:17.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb927fff640 1 --2- 172.21.15.6:0/1777247182 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9300aeb40 0x7fb930149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb927fff640 1 -- 172.21.15.6:0/1777247182 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb930159270 msgr2=0x7fb9301488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:17.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb927fff640 1 --2- 172.21.15.6:0/1777247182 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb930159270 0x7fb9301488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:17.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb927fff640 1 -- 172.21.15.6:0/1777247182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9200094d0 con 0x7fb9300aef10 2023-07-21T22:19:17.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb927fff640 1 --2- 172.21.15.6:0/1777247182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9300aef10 0x7fb930152900 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb91800e930 tx=0x7fb91800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:17.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb926ffd640 1 -- 172.21.15.6:0/1777247182 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918009690 con 0x7fb9300aef10 2023-07-21T22:19:17.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb926ffd640 1 -- 172.21.15.6:0/1777247182 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91800ca00 con 0x7fb9300aef10 2023-07-21T22:19:17.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb926ffd640 1 -- 172.21.15.6:0/1777247182 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91800cd70 con 0x7fb9300aef10 2023-07-21T22:19:17.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb934af9640 1 -- 172.21.15.6:0/1777247182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb930150540 con 0x7fb9300aef10 2023-07-21T22:19:17.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.808+0000 7fb934af9640 1 -- 172.21.15.6:0/1777247182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb930152e40 con 0x7fb9300aef10 2023-07-21T22:19:17.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.812+0000 7fb934af9640 1 -- 172.21.15.6:0/1777247182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9300678d0 con 0x7fb9300aef10 2023-07-21T22:19:17.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.812+0000 7fb926ffd640 1 -- 172.21.15.6:0/1777247182 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb918013470 con 0x7fb9300aef10 2023-07-21T22:19:17.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.812+0000 7fb926ffd640 1 --2- 172.21.15.6:0/1777247182 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb9100662b0 0x7fb910068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:17.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.812+0000 7fb926ffd640 1 -- 172.21.15.6:0/1777247182 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb918083e70 con 0x7fb9300aef10 2023-07-21T22:19:17.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.812+0000 7fb92e59c640 1 --2- 172.21.15.6:0/1777247182 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb9100662b0 0x7fb910068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:17.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.812+0000 7fb92e59c640 1 --2- 172.21.15.6:0/1777247182 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb9100662b0 0x7fb910068760 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb9200af000 tx=0x7fb9200b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:17.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.816+0000 7fb926ffd640 1 -- 172.21.15.6:0/1777247182 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb918051450 con 0x7fb9300aef10 2023-07-21T22:19:18.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.972+0000 7fb934af9640 1 -- 172.21.15.6:0/1777247182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb9300c2ee0 con 0x7fb9300aef10 2023-07-21T22:19:18.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.972+0000 7fb926ffd640 1 -- 172.21.15.6:0/1777247182 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb918017020 con 0x7fb9300aef10 2023-07-21T22:19:18.019 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:19:18.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.972+0000 7fb934af9640 1 -- 172.21.15.6:0/1777247182 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb9100662b0 msgr2=0x7fb910068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:18.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.972+0000 7fb934af9640 1 --2- 172.21.15.6:0/1777247182 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb9100662b0 0x7fb910068760 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb9200af000 tx=0x7fb9200b6040 comp rx=0 tx=0).stop 2023-07-21T22:19:18.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.972+0000 7fb934af9640 1 -- 172.21.15.6:0/1777247182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9300aef10 msgr2=0x7fb930152900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:18.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.972+0000 7fb934af9640 1 --2- 172.21.15.6:0/1777247182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9300aef10 0x7fb930152900 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb91800e930 tx=0x7fb91800edf0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.972+0000 7fb934af9640 1 -- 172.21.15.6:0/1777247182 shutdown_connections 2023-07-21T22:19:18.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.972+0000 7fb934af9640 1 --2- 172.21.15.6:0/1777247182 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb930159270 0x7fb9301488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.972+0000 7fb934af9640 1 --2- 172.21.15.6:0/1777247182 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb9100662b0 0x7fb910068760 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.972+0000 7fb934af9640 1 --2- 172.21.15.6:0/1777247182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9300aef10 0x7fb930152900 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.972+0000 7fb934af9640 1 --2- 172.21.15.6:0/1777247182 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb9300aeb40 0x7fb930149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.972+0000 7fb934af9640 1 -- 172.21.15.6:0/1777247182 >> 172.21.15.6:0/1777247182 conn(0x7fb9300cde90 msgr2=0x7fb9300ae3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:18.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.972+0000 7fb934af9640 1 -- 172.21.15.6:0/1777247182 shutdown_connections 2023-07-21T22:19:18.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:17.972+0000 7fb934af9640 1 -- 172.21.15.6:0/1777247182 wait complete. 2023-07-21T22:19:18.040 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:19:18.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.140+0000 7f4354693640 1 Processor -- start 2023-07-21T22:19:18.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.140+0000 7f4354693640 1 -- start start 2023-07-21T22:19:18.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.140+0000 7f4354693640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f434c069430 0x7f434c0cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:18.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.140+0000 7f4354693640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f434c160030 0x7f434c069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:18.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.140+0000 7f4354693640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f434c069d40 con 0x7f434c070330 2023-07-21T22:19:18.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.140+0000 7f4354693640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f434c0cb7d0 con 0x7f434c160030 2023-07-21T22:19:18.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.140+0000 7f4354693640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434c06c510 con 0x7f434c069430 2023-07-21T22:19:18.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.140+0000 7f4351c2e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f434c160030 0x7f434c069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:18.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.140+0000 7f4351c2e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f434c160030 0x7f434c069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42206/0 (socket says 172.21.15.6:42206) 2023-07-21T22:19:18.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.140+0000 7f4351c2e640 1 -- 172.21.15.6:0/241053277 learned_addr learned my addr 172.21.15.6:0/241053277 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:18.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.140+0000 7f435242f640 1 --2- 172.21.15.6:0/241053277 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f434c069430 0x7f434c0cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:18.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.140+0000 7f4351c2e640 1 -- 172.21.15.6:0/241053277 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f434c069430 msgr2=0x7f434c0cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:18.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.140+0000 7f4351c2e640 1 --2- 172.21.15.6:0/241053277 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f434c069430 0x7f434c0cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.140+0000 7f4351c2e640 1 -- 172.21.15.6:0/241053277 >> v1:172.21.15.161:6789/0 conn(0x7f434c070330 legacy=0x7f434c0707b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:18.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.140+0000 7f4351c2e640 1 -- 172.21.15.6:0/241053277 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434c06c7f0 con 0x7f434c160030 2023-07-21T22:19:18.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.140+0000 7f435142d640 1 -- 172.21.15.6:0/241053277 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156440787 0 0) 0x7f434c069d40 con 0x7f434c070330 2023-07-21T22:19:18.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.144+0000 7f4351c2e640 1 --2- 172.21.15.6:0/241053277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f434c160030 0x7f434c069800 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f433c009870 tx=0x7f433c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26d3072d35d4c65 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:18.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.144+0000 7f435142d640 1 -- 172.21.15.6:0/241053277 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c0ab680 con 0x7f434c160030 2023-07-21T22:19:18.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.144+0000 7f435142d640 1 -- 172.21.15.6:0/241053277 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c0ab7e0 con 0x7f434c160030 2023-07-21T22:19:18.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.144+0000 7f435142d640 1 -- 172.21.15.6:0/241053277 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c0abb70 con 0x7f434c160030 2023-07-21T22:19:18.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.144+0000 7f4354693640 1 -- 172.21.15.6:0/241053277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f434c160030 msgr2=0x7f434c069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:18.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.144+0000 7f4354693640 1 --2- 172.21.15.6:0/241053277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f434c160030 0x7f434c069800 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f433c009870 tx=0x7f433c01c480 comp rx=0 tx=0).stop 2023-07-21T22:19:18.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.144+0000 7f4354693640 1 -- 172.21.15.6:0/241053277 shutdown_connections 2023-07-21T22:19:18.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.144+0000 7f4354693640 1 --2- 172.21.15.6:0/241053277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f434c160030 0x7f434c069800 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.144+0000 7f4354693640 1 --2- 172.21.15.6:0/241053277 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f434c069430 0x7f434c0cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.144+0000 7f4354693640 1 -- 172.21.15.6:0/241053277 >> 172.21.15.6:0/241053277 conn(0x7f434c0b1840 msgr2=0x7f434c0cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:18.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.144+0000 7f4354693640 1 -- 172.21.15.6:0/241053277 shutdown_connections 2023-07-21T22:19:18.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.144+0000 7f4354693640 1 -- 172.21.15.6:0/241053277 wait complete. 2023-07-21T22:19:18.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f4354693640 1 Processor -- start 2023-07-21T22:19:18.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f4354693640 1 -- start start 2023-07-21T22:19:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f4354693640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f434c069430 0x7f434c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f4354693640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f434c070330 0x7f434c0cea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f4354693640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f434c160030 0x7f434c0c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f4354693640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c0cef80 con 0x7f434c069430 2023-07-21T22:19:18.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f4354693640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434c0cdea0 con 0x7f434c160030 2023-07-21T22:19:18.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f4354693640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434c0cd600 con 0x7f434c070330 2023-07-21T22:19:18.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f435242f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f434c069430 0x7f434c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:18.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f435242f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f434c069430 0x7f434c0ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42212/0 (socket says 172.21.15.6:42212) 2023-07-21T22:19:18.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f435242f640 1 -- 172.21.15.6:0/3221486735 learned_addr learned my addr 172.21.15.6:0/3221486735 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:18.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f4352c30640 1 --2- 172.21.15.6:0/3221486735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f434c160030 0x7f434c0c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:18.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f4351c2e640 1 --2- 172.21.15.6:0/3221486735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f434c070330 0x7f434c0cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:18.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f435242f640 1 -- 172.21.15.6:0/3221486735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f434c070330 msgr2=0x7f434c0cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:18.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f435242f640 1 --2- 172.21.15.6:0/3221486735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f434c070330 0x7f434c0cea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f435242f640 1 -- 172.21.15.6:0/3221486735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f434c160030 msgr2=0x7f434c0c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:18.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f435242f640 1 --2- 172.21.15.6:0/3221486735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f434c160030 0x7f434c0c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f435242f640 1 -- 172.21.15.6:0/3221486735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c0094d0 con 0x7f434c069430 2023-07-21T22:19:18.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f435242f640 1 --2- 172.21.15.6:0/3221486735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f434c069430 0x7f434c0ccf90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f434800e870 tx=0x7f434800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:18.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f4342ffd640 1 -- 172.21.15.6:0/3221486735 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4348009510 con 0x7f434c069430 2023-07-21T22:19:18.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f4342ffd640 1 -- 172.21.15.6:0/3221486735 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434800eec0 con 0x7f434c069430 2023-07-21T22:19:18.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f4342ffd640 1 -- 172.21.15.6:0/3221486735 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434800cb40 con 0x7f434c069430 2023-07-21T22:19:18.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f4354693640 1 -- 172.21.15.6:0/3221486735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434c0cd8e0 con 0x7f434c069430 2023-07-21T22:19:18.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.148+0000 7f4354693640 1 -- 172.21.15.6:0/3221486735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f434c1f4730 con 0x7f434c069430 2023-07-21T22:19:18.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.152+0000 7f4354693640 1 -- 172.21.15.6:0/3221486735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f434c0678d0 con 0x7f434c069430 2023-07-21T22:19:18.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.152+0000 7f4342ffd640 1 -- 172.21.15.6:0/3221486735 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f434800cca0 con 0x7f434c069430 2023-07-21T22:19:18.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.152+0000 7f4342ffd640 1 --2- 172.21.15.6:0/3221486735 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4330066280 0x7f4330068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:18.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.152+0000 7f4342ffd640 1 -- 172.21.15.6:0/3221486735 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4348083da0 con 0x7f434c069430 2023-07-21T22:19:18.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.152+0000 7f4351c2e640 1 --2- 172.21.15.6:0/3221486735 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4330066280 0x7f4330068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:18.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.152+0000 7f4351c2e640 1 --2- 172.21.15.6:0/3221486735 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4330066280 0x7f4330068730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f433c0af000 tx=0x7f433c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:18.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.156+0000 7f4342ffd640 1 -- 172.21.15.6:0/3221486735 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f43480512c0 con 0x7f434c069430 2023-07-21T22:19:18.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.308+0000 7f4354693640 1 -- 172.21.15.6:0/3221486735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f434c15eb10 con 0x7f434c069430 2023-07-21T22:19:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.312+0000 7f4342ffd640 1 -- 172.21.15.6:0/3221486735 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f43480170a0 con 0x7f434c069430 2023-07-21T22:19:18.357 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:19:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.312+0000 7f4354693640 1 -- 172.21.15.6:0/3221486735 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4330066280 msgr2=0x7f4330068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.312+0000 7f4354693640 1 --2- 172.21.15.6:0/3221486735 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4330066280 0x7f4330068730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f433c0af000 tx=0x7f433c0a7000 comp rx=0 tx=0).stop 2023-07-21T22:19:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.312+0000 7f4354693640 1 -- 172.21.15.6:0/3221486735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f434c069430 msgr2=0x7f434c0ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.312+0000 7f4354693640 1 --2- 172.21.15.6:0/3221486735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f434c069430 0x7f434c0ccf90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f434800e870 tx=0x7f434800ec70 comp rx=0 tx=0).stop 2023-07-21T22:19:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.312+0000 7f4354693640 1 -- 172.21.15.6:0/3221486735 shutdown_connections 2023-07-21T22:19:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.312+0000 7f4354693640 1 --2- 172.21.15.6:0/3221486735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f434c160030 0x7f434c0c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.312+0000 7f4354693640 1 --2- 172.21.15.6:0/3221486735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f434c070330 0x7f434c0cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.312+0000 7f4354693640 1 --2- 172.21.15.6:0/3221486735 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4330066280 0x7f4330068730 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.312+0000 7f4354693640 1 --2- 172.21.15.6:0/3221486735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f434c069430 0x7f434c0ccf90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.312+0000 7f4354693640 1 -- 172.21.15.6:0/3221486735 >> 172.21.15.6:0/3221486735 conn(0x7f434c0b1840 msgr2=0x7f434c1555e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.312+0000 7f4354693640 1 -- 172.21.15.6:0/3221486735 shutdown_connections 2023-07-21T22:19:18.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.312+0000 7f4354693640 1 -- 172.21.15.6:0/3221486735 wait complete. 2023-07-21T22:19:18.379 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:19:18.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.476+0000 7fc12fc0b640 1 Processor -- start 2023-07-21T22:19:18.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.476+0000 7fc12fc0b640 1 -- start start 2023-07-21T22:19:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.476+0000 7fc12fc0b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc128070b70 0x7fc128070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.476+0000 7fc12fc0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc1280cb100 0x7fc1280cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.476+0000 7fc12fc0b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1280cac70 con 0x7fc12806b1e0 2023-07-21T22:19:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.476+0000 7fc12fc0b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1280cbaa0 con 0x7fc128070b70 2023-07-21T22:19:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.480+0000 7fc12fc0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc128071480 con 0x7fc1280cb100 2023-07-21T22:19:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.480+0000 7fc12d1a6640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc12806b1e0 0x7fc1280c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34362/0 (socket says 172.21.15.6:34362) 2023-07-21T22:19:18.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.480+0000 7fc12d1a6640 1 -- 172.21.15.6:0/605280985 learned_addr learned my addr 172.21.15.6:0/605280985 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:18.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.480+0000 7fc12e1a8640 1 --2- 172.21.15.6:0/605280985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc1280cb100 0x7fc1280cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:18.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.480+0000 7fc12d9a7640 1 --2- 172.21.15.6:0/605280985 >> v2:172.21.15.161:3300/0 conn(0x7fc128070b70 0x7fc128070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:18.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.480+0000 7fc12c9a5640 1 -- 172.21.15.6:0/605280985 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660438871 0 0) 0x7fc1280cac70 con 0x7fc12806b1e0 2023-07-21T22:19:18.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.480+0000 7fc12c9a5640 1 -- 172.21.15.6:0/605280985 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc114003530 con 0x7fc12806b1e0 2023-07-21T22:19:18.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.480+0000 7fc12e1a8640 1 -- 172.21.15.6:0/605280985 >> v2:172.21.15.161:3300/0 conn(0x7fc128070b70 msgr2=0x7fc128070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:18.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.480+0000 7fc12e1a8640 1 --2- 172.21.15.6:0/605280985 >> v2:172.21.15.161:3300/0 conn(0x7fc128070b70 0x7fc128070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.480+0000 7fc12e1a8640 1 -- 172.21.15.6:0/605280985 >> v1:172.21.15.6:6789/0 conn(0x7fc12806b1e0 legacy=0x7fc1280c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:18.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.480+0000 7fc12e1a8640 1 -- 172.21.15.6:0/605280985 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1280ca060 con 0x7fc1280cb100 2023-07-21T22:19:18.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.480+0000 7fc12d9a7640 1 --2- 172.21.15.6:0/605280985 >> v2:172.21.15.161:3300/0 conn(0x7fc128070b70 0x7fc128070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:18.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.480+0000 7fc12e1a8640 1 --2- 172.21.15.6:0/605280985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc1280cb100 0x7fc1280cb560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc120009d90 tx=0x7fc12001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0efd0897d0bfaa4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:18.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.484+0000 7fc12c9a5640 1 -- 172.21.15.6:0/605280985 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1200a59e0 con 0x7fc1280cb100 2023-07-21T22:19:18.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.484+0000 7fc12c9a5640 1 -- 172.21.15.6:0/605280985 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1200a5b40 con 0x7fc1280cb100 2023-07-21T22:19:18.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.484+0000 7fc12c9a5640 1 -- 172.21.15.6:0/605280985 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1200ad440 con 0x7fc1280cb100 2023-07-21T22:19:18.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.484+0000 7fc12fc0b640 1 -- 172.21.15.6:0/605280985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc1280cb100 msgr2=0x7fc1280cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.484+0000 7fc12fc0b640 1 --2- 172.21.15.6:0/605280985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc1280cb100 0x7fc1280cb560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc120009d90 tx=0x7fc12001c920 comp rx=0 tx=0).stop 2023-07-21T22:19:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.484+0000 7fc12fc0b640 1 -- 172.21.15.6:0/605280985 shutdown_connections 2023-07-21T22:19:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.484+0000 7fc12fc0b640 1 --2- 172.21.15.6:0/605280985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc1280cb100 0x7fc1280cb560 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.484+0000 7fc12fc0b640 1 --2- 172.21.15.6:0/605280985 >> v2:172.21.15.161:3300/0 conn(0x7fc128070b70 0x7fc128070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.484+0000 7fc12fc0b640 1 -- 172.21.15.6:0/605280985 >> 172.21.15.6:0/605280985 conn(0x7fc1280afcf0 msgr2=0x7fc1280b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:18.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.484+0000 7fc12fc0b640 1 -- 172.21.15.6:0/605280985 shutdown_connections 2023-07-21T22:19:18.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.484+0000 7fc12fc0b640 1 -- 172.21.15.6:0/605280985 wait complete. 2023-07-21T22:19:18.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.484+0000 7fc12fc0b640 1 Processor -- start 2023-07-21T22:19:18.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.484+0000 7fc12fc0b640 1 -- start start 2023-07-21T22:19:18.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.484+0000 7fc12fc0b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc12806b1e0 0x7fc1281535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:18.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.484+0000 7fc12fc0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc128070b70 0x7fc12814f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:18.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.484+0000 7fc12fc0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc1280cb100 0x7fc1281526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:18.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.484+0000 7fc12fc0b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc128157440 con 0x7fc128070b70 2023-07-21T22:19:18.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.484+0000 7fc12fc0b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12814fc40 con 0x7fc12806b1e0 2023-07-21T22:19:18.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.484+0000 7fc12fc0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc128156b30 con 0x7fc1280cb100 2023-07-21T22:19:18.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.488+0000 7fc12d1a6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc128070b70 0x7fc12814f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:18.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.488+0000 7fc12d1a6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc128070b70 0x7fc12814f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42226/0 (socket says 172.21.15.6:42226) 2023-07-21T22:19:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.488+0000 7fc12d1a6640 1 -- 172.21.15.6:0/4152904287 learned_addr learned my addr 172.21.15.6:0/4152904287 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.488+0000 7fc12d9a7640 1 --2- 172.21.15.6:0/4152904287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc12806b1e0 0x7fc1281535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.488+0000 7fc12e1a8640 1 --2- 172.21.15.6:0/4152904287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc1280cb100 0x7fc1281526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.488+0000 7fc12d1a6640 1 -- 172.21.15.6:0/4152904287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc1280cb100 msgr2=0x7fc1281526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.488+0000 7fc12d1a6640 1 --2- 172.21.15.6:0/4152904287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc1280cb100 0x7fc1281526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.488+0000 7fc12d1a6640 1 -- 172.21.15.6:0/4152904287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc12806b1e0 msgr2=0x7fc1281535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.488+0000 7fc12d1a6640 1 --2- 172.21.15.6:0/4152904287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc12806b1e0 0x7fc1281535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.488+0000 7fc12d1a6640 1 -- 172.21.15.6:0/4152904287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc124009420 con 0x7fc128070b70 2023-07-21T22:19:18.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.488+0000 7fc12e1a8640 1 --2- 172.21.15.6:0/4152904287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc1280cb100 0x7fc1281526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:18.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.488+0000 7fc12d1a6640 1 --2- 172.21.15.6:0/4152904287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc128070b70 0x7fc12814f700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc11800c420 tx=0x7fc11800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:18.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.488+0000 7fc11e7fc640 1 -- 172.21.15.6:0/4152904287 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc118005cf0 con 0x7fc128070b70 2023-07-21T22:19:18.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.488+0000 7fc11e7fc640 1 -- 172.21.15.6:0/4152904287 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc118005e50 con 0x7fc128070b70 2023-07-21T22:19:18.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.488+0000 7fc11e7fc640 1 -- 172.21.15.6:0/4152904287 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1180072d0 con 0x7fc128070b70 2023-07-21T22:19:18.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.488+0000 7fc12fc0b640 1 -- 172.21.15.6:0/4152904287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc120009a70 con 0x7fc128070b70 2023-07-21T22:19:18.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.488+0000 7fc12fc0b640 1 -- 172.21.15.6:0/4152904287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc128156df0 con 0x7fc128070b70 2023-07-21T22:19:18.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.488+0000 7fc12fc0b640 1 -- 172.21.15.6:0/4152904287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1281575f0 con 0x7fc128070b70 2023-07-21T22:19:18.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.488+0000 7fc11e7fc640 1 -- 172.21.15.6:0/4152904287 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc118007430 con 0x7fc128070b70 2023-07-21T22:19:18.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.492+0000 7fc11e7fc640 1 --2- 172.21.15.6:0/4152904287 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc10c066280 0x7fc10c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:18.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.492+0000 7fc11e7fc640 1 -- 172.21.15.6:0/4152904287 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc1180832f0 con 0x7fc128070b70 2023-07-21T22:19:18.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.492+0000 7fc12d9a7640 1 --2- 172.21.15.6:0/4152904287 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc10c066280 0x7fc10c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:18.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.492+0000 7fc12d9a7640 1 --2- 172.21.15.6:0/4152904287 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc10c066280 0x7fc10c068730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc124009c80 tx=0x7fc124008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:18.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.496+0000 7fc11e7fc640 1 -- 172.21.15.6:0/4152904287 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc1281575f0 con 0x7fc128070b70 2023-07-21T22:19:18.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.652+0000 7fc12fc0b640 1 -- 172.21.15.6:0/4152904287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1280678d0 con 0x7fc128070b70 2023-07-21T22:19:18.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.652+0000 7fc11e7fc640 1 -- 172.21.15.6:0/4152904287 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18207 (secure 0 0 0) 0x7fc118050780 con 0x7fc128070b70 2023-07-21T22:19:18.701 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:18.701 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:18:45.315608+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:18:41.465054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:18:42.709896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:19:18.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.656+0000 7fc12fc0b640 1 -- 172.21.15.6:0/4152904287 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc10c066280 msgr2=0x7fc10c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:18.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.656+0000 7fc12fc0b640 1 --2- 172.21.15.6:0/4152904287 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc10c066280 0x7fc10c068730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc124009c80 tx=0x7fc124008040 comp rx=0 tx=0).stop 2023-07-21T22:19:18.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.656+0000 7fc12fc0b640 1 -- 172.21.15.6:0/4152904287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc128070b70 msgr2=0x7fc12814f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:18.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.656+0000 7fc12fc0b640 1 --2- 172.21.15.6:0/4152904287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc128070b70 0x7fc12814f700 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc11800c420 tx=0x7fc11800c8e0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.656+0000 7fc12fc0b640 1 -- 172.21.15.6:0/4152904287 shutdown_connections 2023-07-21T22:19:18.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.656+0000 7fc12fc0b640 1 --2- 172.21.15.6:0/4152904287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc1280cb100 0x7fc1281526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.656+0000 7fc12fc0b640 1 --2- 172.21.15.6:0/4152904287 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc10c066280 0x7fc10c068730 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.656+0000 7fc12fc0b640 1 --2- 172.21.15.6:0/4152904287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc128070b70 0x7fc12814f700 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.656+0000 7fc12fc0b640 1 --2- 172.21.15.6:0/4152904287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc12806b1e0 0x7fc1281535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.656+0000 7fc12fc0b640 1 -- 172.21.15.6:0/4152904287 >> 172.21.15.6:0/4152904287 conn(0x7fc1280afcf0 msgr2=0x7fc1281590a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:18.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.656+0000 7fc12fc0b640 1 -- 172.21.15.6:0/4152904287 shutdown_connections 2023-07-21T22:19:18.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.656+0000 7fc12fc0b640 1 -- 172.21.15.6:0/4152904287 wait complete. 2023-07-21T22:19:18.722 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:18:41.465054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:18:42.709896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:19:18.723 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:19:18.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.824+0000 7f28bae93640 1 Processor -- start 2023-07-21T22:19:18.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.824+0000 7f28bae93640 1 -- start start 2023-07-21T22:19:18.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.824+0000 7f28bae93640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f28b40cb890 0x7f28b406a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.824+0000 7f28bae93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28b40ce810 0x7f28b406add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.824+0000 7f28bae93640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b406b310 con 0x7f28b40c59b0 2023-07-21T22:19:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.824+0000 7f28bae93640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b415cf20 con 0x7f28b40cb890 2023-07-21T22:19:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.824+0000 7f28bae93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b415c380 con 0x7f28b40ce810 2023-07-21T22:19:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.824+0000 7f28b3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f28b40cb890 0x7f28b406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:18.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.824+0000 7f28b3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f28b40cb890 0x7f28b406a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42238/0 (socket says 172.21.15.6:42238) 2023-07-21T22:19:18.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.824+0000 7f28b3fff640 1 -- 172.21.15.6:0/1113461950 learned_addr learned my addr 172.21.15.6:0/1113461950 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:18.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.824+0000 7f28b8c2f640 1 --1- 172.21.15.6:0/1113461950 >> v1:172.21.15.6:6789/0 conn(0x7f28b40c59b0 0x7f28b415c810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34366/0 (socket says 172.21.15.6:34366) 2023-07-21T22:19:18.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.824+0000 7f28b9430640 1 --2- 172.21.15.6:0/1113461950 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28b40ce810 0x7f28b406add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:18.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.824+0000 7f28b3fff640 1 -- 172.21.15.6:0/1113461950 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28b40ce810 msgr2=0x7f28b406add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:18.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.824+0000 7f28b3fff640 1 --2- 172.21.15.6:0/1113461950 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28b40ce810 0x7f28b406add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.824+0000 7f28b3fff640 1 -- 172.21.15.6:0/1113461950 >> v1:172.21.15.6:6789/0 conn(0x7f28b40c59b0 legacy=0x7f28b415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:18.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.824+0000 7f28b37fe640 1 -- 172.21.15.6:0/1113461950 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430561175 0 0) 0x7f28b406b310 con 0x7f28b40c59b0 2023-07-21T22:19:18.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.824+0000 7f28b3fff640 1 -- 172.21.15.6:0/1113461950 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b40c5d80 con 0x7f28b40cb890 2023-07-21T22:19:18.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.828+0000 7f28b3fff640 1 --2- 172.21.15.6:0/1113461950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b40cb890 0x7f28b406a890 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009870 tx=0x7f28a001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611a57b70c81abbf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:18.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.828+0000 7f28b37fe640 1 -- 172.21.15.6:0/1113461950 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a00ab680 con 0x7f28b40cb890 2023-07-21T22:19:18.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.828+0000 7f28b37fe640 1 -- 172.21.15.6:0/1113461950 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a00ab7e0 con 0x7f28b40cb890 2023-07-21T22:19:18.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.828+0000 7f28b37fe640 1 -- 172.21.15.6:0/1113461950 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a00abb70 con 0x7f28b40cb890 2023-07-21T22:19:18.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.828+0000 7f28bae93640 1 -- 172.21.15.6:0/1113461950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b40cb890 msgr2=0x7f28b406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:18.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.828+0000 7f28bae93640 1 --2- 172.21.15.6:0/1113461950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b40cb890 0x7f28b406a890 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009870 tx=0x7f28a001c480 comp rx=0 tx=0).stop 2023-07-21T22:19:18.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.828+0000 7f28bae93640 1 -- 172.21.15.6:0/1113461950 shutdown_connections 2023-07-21T22:19:18.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.828+0000 7f28bae93640 1 --2- 172.21.15.6:0/1113461950 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28b40ce810 0x7f28b406add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.828+0000 7f28bae93640 1 --2- 172.21.15.6:0/1113461950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b40cb890 0x7f28b406a890 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.828+0000 7f28bae93640 1 -- 172.21.15.6:0/1113461950 >> 172.21.15.6:0/1113461950 conn(0x7f28b40cef80 msgr2=0x7f28b40cf380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:18.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.828+0000 7f28bae93640 1 -- 172.21.15.6:0/1113461950 shutdown_connections 2023-07-21T22:19:18.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.828+0000 7f28bae93640 1 -- 172.21.15.6:0/1113461950 wait complete. 2023-07-21T22:19:18.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28bae93640 1 Processor -- start 2023-07-21T22:19:18.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28bae93640 1 -- start start 2023-07-21T22:19:18.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28bae93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28b40c59b0 0x7f28b414cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:18.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28bae93640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28b40cb890 0x7f28b414ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28bae93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b40ce810 0x7f28b41493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28bae93640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b40c60e0 con 0x7f28b40ce810 2023-07-21T22:19:18.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28bae93640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b40c7620 con 0x7f28b40cb890 2023-07-21T22:19:18.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28bae93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b4150a80 con 0x7f28b40c59b0 2023-07-21T22:19:18.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28b9430640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b40ce810 0x7f28b41493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:18.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28b9430640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b40ce810 0x7f28b41493d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42246/0 (socket says 172.21.15.6:42246) 2023-07-21T22:19:18.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28b9430640 1 -- 172.21.15.6:0/1865011106 learned_addr learned my addr 172.21.15.6:0/1865011106 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28b8c2f640 1 --2- 172.21.15.6:0/1865011106 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28b40c59b0 0x7f28b414cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:18.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28b3fff640 1 --2- 172.21.15.6:0/1865011106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28b40cb890 0x7f28b414ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:18.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28b9430640 1 -- 172.21.15.6:0/1865011106 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28b40c59b0 msgr2=0x7f28b414cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:18.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28b9430640 1 --2- 172.21.15.6:0/1865011106 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28b40c59b0 0x7f28b414cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28b9430640 1 -- 172.21.15.6:0/1865011106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28b40cb890 msgr2=0x7f28b414ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:18.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28b9430640 1 --2- 172.21.15.6:0/1865011106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28b40cb890 0x7f28b414ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:18.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28b9430640 1 -- 172.21.15.6:0/1865011106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a00094d0 con 0x7f28b40ce810 2023-07-21T22:19:18.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28b9430640 1 --2- 172.21.15.6:0/1865011106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b40ce810 0x7f28b41493d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f28ac007e70 tx=0x7f28ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:18.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28b17fa640 1 -- 172.21.15.6:0/1865011106 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac014620 con 0x7f28b40ce810 2023-07-21T22:19:18.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28b17fa640 1 -- 172.21.15.6:0/1865011106 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ac0147a0 con 0x7f28b40ce810 2023-07-21T22:19:18.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28bae93640 1 -- 172.21.15.6:0/1865011106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b4150d60 con 0x7f28b40ce810 2023-07-21T22:19:18.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28b17fa640 1 -- 172.21.15.6:0/1865011106 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac014b50 con 0x7f28b40ce810 2023-07-21T22:19:18.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.832+0000 7f28bae93640 1 -- 172.21.15.6:0/1865011106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b41506e0 con 0x7f28b40ce810 2023-07-21T22:19:18.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.836+0000 7f28bae93640 1 -- 172.21.15.6:0/1865011106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b415bf60 con 0x7f28b40ce810 2023-07-21T22:19:18.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.836+0000 7f28b17fa640 1 -- 172.21.15.6:0/1865011106 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f28ac014cb0 con 0x7f28b40ce810 2023-07-21T22:19:18.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.836+0000 7f28b17fa640 1 --2- 172.21.15.6:0/1865011106 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2898066280 0x7f2898068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:18.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.836+0000 7f28b17fa640 1 -- 172.21.15.6:0/1865011106 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f28ac084780 con 0x7f28b40ce810 2023-07-21T22:19:18.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.836+0000 7f28b8c2f640 1 --2- 172.21.15.6:0/1865011106 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2898066280 0x7f2898068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:18.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.836+0000 7f28b8c2f640 1 --2- 172.21.15.6:0/1865011106 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2898066280 0x7f2898068730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f28a8000f70 tx=0x7f28a8007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:18.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.840+0000 7f28b17fa640 1 -- 172.21.15.6:0/1865011106 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f28ac0555f0 con 0x7f28b40ce810 2023-07-21T22:19:19.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:18.996+0000 7f28bae93640 1 -- 172.21.15.6:0/1865011106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28b40678d0 con 0x7f28b40ce810 2023-07-21T22:19:19.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.000+0000 7f28b17fa640 1 -- 172.21.15.6:0/1865011106 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28ac055180 con 0x7f28b40ce810 2023-07-21T22:19:19.046 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:19:19.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.000+0000 7f28bae93640 1 -- 172.21.15.6:0/1865011106 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2898066280 msgr2=0x7f2898068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:19.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.000+0000 7f28bae93640 1 --2- 172.21.15.6:0/1865011106 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2898066280 0x7f2898068730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f28a8000f70 tx=0x7f28a8007c10 comp rx=0 tx=0).stop 2023-07-21T22:19:19.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.000+0000 7f28bae93640 1 -- 172.21.15.6:0/1865011106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b40ce810 msgr2=0x7f28b41493d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:19.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.000+0000 7f28bae93640 1 --2- 172.21.15.6:0/1865011106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b40ce810 0x7f28b41493d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f28ac007e70 tx=0x7f28ac00e4b0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.000+0000 7f28bae93640 1 -- 172.21.15.6:0/1865011106 shutdown_connections 2023-07-21T22:19:19.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.000+0000 7f28bae93640 1 --2- 172.21.15.6:0/1865011106 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2898066280 0x7f2898068730 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.000+0000 7f28bae93640 1 --2- 172.21.15.6:0/1865011106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b40ce810 0x7f28b41493d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.000+0000 7f28bae93640 1 --2- 172.21.15.6:0/1865011106 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28b40cb890 0x7f28b414ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.000+0000 7f28bae93640 1 --2- 172.21.15.6:0/1865011106 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28b40c59b0 0x7f28b414cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.000+0000 7f28bae93640 1 -- 172.21.15.6:0/1865011106 >> 172.21.15.6:0/1865011106 conn(0x7f28b40cef80 msgr2=0x7f28b415c810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:19.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.000+0000 7f28bae93640 1 -- 172.21.15.6:0/1865011106 shutdown_connections 2023-07-21T22:19:19.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.000+0000 7f28bae93640 1 -- 172.21.15.6:0/1865011106 wait complete. 2023-07-21T22:19:19.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:19:19.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.168+0000 7f3f23a6a640 1 Processor -- start 2023-07-21T22:19:19.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.168+0000 7f3f23a6a640 1 -- start start 2023-07-21T22:19:19.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.168+0000 7f3f23a6a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3f1c15bde0 0x7f3f1c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:19.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.168+0000 7f3f23a6a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3f1c0d2300 0x7f3f1c0d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:19.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.168+0000 7f3f23a6a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f1c0b04c0 con 0x7f3f1c0d2fc0 2023-07-21T22:19:19.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.168+0000 7f3f23a6a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f1c15c1b0 con 0x7f3f1c15bde0 2023-07-21T22:19:19.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.168+0000 7f3f23a6a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f1c0b1060 con 0x7f3f1c0d2300 2023-07-21T22:19:19.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.168+0000 7f3f21806640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3f1c15bde0 0x7f3f1c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:19.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.168+0000 7f3f21005640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3f1c0d2fc0 0x7f3f1c0b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34378/0 (socket says 172.21.15.6:34378) 2023-07-21T22:19:19.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.168+0000 7f3f21005640 1 -- 172.21.15.6:0/390528798 learned_addr learned my addr 172.21.15.6:0/390528798 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:19.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.168+0000 7f3f21806640 1 -- 172.21.15.6:0/390528798 >> v2:172.21.15.161:3300/0 conn(0x7f3f1c0d2300 msgr2=0x7f3f1c0d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:19.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.168+0000 7f3f21806640 1 --2- 172.21.15.6:0/390528798 >> v2:172.21.15.161:3300/0 conn(0x7f3f1c0d2300 0x7f3f1c0d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.168+0000 7f3f21806640 1 -- 172.21.15.6:0/390528798 >> v1:172.21.15.6:6789/0 conn(0x7f3f1c0d2fc0 legacy=0x7f3f1c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:19.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.168+0000 7f3f20804640 1 -- 172.21.15.6:0/390528798 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569486937 0 0) 0x7f3f1c0b04c0 con 0x7f3f1c0d2fc0 2023-07-21T22:19:19.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.168+0000 7f3f21806640 1 -- 172.21.15.6:0/390528798 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c0d2c80 con 0x7f3f1c15bde0 2023-07-21T22:19:19.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.172+0000 7f3f21806640 1 --2- 172.21.15.6:0/390528798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f1c15bde0 0x7f3f1c0d0270 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c08c820 tx=0x7f3f1801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fe7adbc86e8245 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:19.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.172+0000 7f3f20804640 1 -- 172.21.15.6:0/390528798 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18004230 con 0x7f3f1c15bde0 2023-07-21T22:19:19.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.172+0000 7f3f20804640 1 -- 172.21.15.6:0/390528798 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f180a7050 con 0x7f3f1c15bde0 2023-07-21T22:19:19.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.172+0000 7f3f20804640 1 -- 172.21.15.6:0/390528798 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18003620 con 0x7f3f1c15bde0 2023-07-21T22:19:19.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.172+0000 7f3f23a6a640 1 -- 172.21.15.6:0/390528798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f1c15bde0 msgr2=0x7f3f1c0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:19.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.172+0000 7f3f23a6a640 1 --2- 172.21.15.6:0/390528798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f1c15bde0 0x7f3f1c0d0270 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c08c820 tx=0x7f3f1801c440 comp rx=0 tx=0).stop 2023-07-21T22:19:19.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.172+0000 7f3f23a6a640 1 -- 172.21.15.6:0/390528798 shutdown_connections 2023-07-21T22:19:19.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.172+0000 7f3f23a6a640 1 --2- 172.21.15.6:0/390528798 >> v2:172.21.15.161:3300/0 conn(0x7f3f1c0d2300 0x7f3f1c0d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.172+0000 7f3f23a6a640 1 --2- 172.21.15.6:0/390528798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f1c15bde0 0x7f3f1c0d0270 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.172+0000 7f3f23a6a640 1 -- 172.21.15.6:0/390528798 >> 172.21.15.6:0/390528798 conn(0x7f3f1c0659d0 msgr2=0x7f3f1c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:19.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.172+0000 7f3f23a6a640 1 -- 172.21.15.6:0/390528798 shutdown_connections 2023-07-21T22:19:19.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.172+0000 7f3f23a6a640 1 -- 172.21.15.6:0/390528798 wait complete. 2023-07-21T22:19:19.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f23a6a640 1 Processor -- start 2023-07-21T22:19:19.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f23a6a640 1 -- start start 2023-07-21T22:19:19.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f23a6a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f1c0d2300 0x7f3f1c14de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:19.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f23a6a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f1c0d2fc0 0x7f3f1c1530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:19.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f23a6a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f1c15bde0 0x7f3f1c0b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:19.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f23a6a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c14e340 con 0x7f3f1c15bde0 2023-07-21T22:19:19.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f23a6a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c153600 con 0x7f3f1c0d2300 2023-07-21T22:19:19.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f23a6a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c1547a0 con 0x7f3f1c0d2fc0 2023-07-21T22:19:19.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f22007640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f1c15bde0 0x7f3f1c0b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:19.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f22007640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f1c15bde0 0x7f3f1c0b5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42252/0 (socket says 172.21.15.6:42252) 2023-07-21T22:19:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f22007640 1 -- 172.21.15.6:0/3662741915 learned_addr learned my addr 172.21.15.6:0/3662741915 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f21806640 1 --2- 172.21.15.6:0/3662741915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f1c0d2300 0x7f3f1c14de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f21005640 1 --2- 172.21.15.6:0/3662741915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f1c0d2fc0 0x7f3f1c1530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f22007640 1 -- 172.21.15.6:0/3662741915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f1c0d2fc0 msgr2=0x7f3f1c1530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f22007640 1 --2- 172.21.15.6:0/3662741915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f1c0d2fc0 0x7f3f1c1530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f22007640 1 -- 172.21.15.6:0/3662741915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f1c0d2300 msgr2=0x7f3f1c14de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f22007640 1 --2- 172.21.15.6:0/3662741915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f1c0d2300 0x7f3f1c14de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f22007640 1 -- 172.21.15.6:0/3662741915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f180093b0 con 0x7f3f1c15bde0 2023-07-21T22:19:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f22007640 1 --2- 172.21.15.6:0/3662741915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f1c15bde0 0x7f3f1c0b5d20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3f1400b970 tx=0x7f3f1400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f127fc640 1 -- 172.21.15.6:0/3662741915 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1400cb40 con 0x7f3f1c15bde0 2023-07-21T22:19:19.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f127fc640 1 -- 172.21.15.6:0/3662741915 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1400ccc0 con 0x7f3f1c15bde0 2023-07-21T22:19:19.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f127fc640 1 -- 172.21.15.6:0/3662741915 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f14014680 con 0x7f3f1c15bde0 2023-07-21T22:19:19.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f23a6a640 1 -- 172.21.15.6:0/3662741915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f1c1541e0 con 0x7f3f1c15bde0 2023-07-21T22:19:19.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.176+0000 7f3f23a6a640 1 -- 172.21.15.6:0/3662741915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1c0b5240 con 0x7f3f1c15bde0 2023-07-21T22:19:19.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.180+0000 7f3f23a6a640 1 -- 172.21.15.6:0/3662741915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1c0678d0 con 0x7f3f1c15bde0 2023-07-21T22:19:19.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.180+0000 7f3f127fc640 1 -- 172.21.15.6:0/3662741915 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3f1401d3b0 con 0x7f3f1c15bde0 2023-07-21T22:19:19.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.180+0000 7f3f127fc640 1 --2- 172.21.15.6:0/3662741915 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3f00066280 0x7f3f00068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:19.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.180+0000 7f3f127fc640 1 -- 172.21.15.6:0/3662741915 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3f14083c70 con 0x7f3f1c15bde0 2023-07-21T22:19:19.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.180+0000 7f3f21806640 1 --2- 172.21.15.6:0/3662741915 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3f00066280 0x7f3f00068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:19.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.180+0000 7f3f21806640 1 --2- 172.21.15.6:0/3662741915 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3f00066280 0x7f3f00068730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3f180ad000 tx=0x7f3f180a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:19.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.184+0000 7f3f127fc640 1 -- 172.21.15.6:0/3662741915 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3f14051190 con 0x7f3f1c15bde0 2023-07-21T22:19:19.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.336+0000 7f3f23a6a640 1 -- 172.21.15.6:0/3662741915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3f1c0b0120 con 0x7f3f1c15bde0 2023-07-21T22:19:19.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.336+0000 7f3f127fc640 1 -- 172.21.15.6:0/3662741915 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3f140190a0 con 0x7f3f1c15bde0 2023-07-21T22:19:19.385 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:19:19.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.340+0000 7f3f23a6a640 1 -- 172.21.15.6:0/3662741915 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3f00066280 msgr2=0x7f3f00068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:19.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.340+0000 7f3f23a6a640 1 --2- 172.21.15.6:0/3662741915 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3f00066280 0x7f3f00068730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3f180ad000 tx=0x7f3f180a6000 comp rx=0 tx=0).stop 2023-07-21T22:19:19.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.340+0000 7f3f23a6a640 1 -- 172.21.15.6:0/3662741915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f1c15bde0 msgr2=0x7f3f1c0b5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:19.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.340+0000 7f3f23a6a640 1 --2- 172.21.15.6:0/3662741915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f1c15bde0 0x7f3f1c0b5d20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3f1400b970 tx=0x7f3f1400be30 comp rx=0 tx=0).stop 2023-07-21T22:19:19.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.340+0000 7f3f23a6a640 1 -- 172.21.15.6:0/3662741915 shutdown_connections 2023-07-21T22:19:19.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.340+0000 7f3f23a6a640 1 --2- 172.21.15.6:0/3662741915 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3f00066280 0x7f3f00068730 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.340+0000 7f3f23a6a640 1 --2- 172.21.15.6:0/3662741915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f1c15bde0 0x7f3f1c0b5d20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.340+0000 7f3f23a6a640 1 --2- 172.21.15.6:0/3662741915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f1c0d2fc0 0x7f3f1c1530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.340+0000 7f3f23a6a640 1 --2- 172.21.15.6:0/3662741915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f1c0d2300 0x7f3f1c14de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.340+0000 7f3f23a6a640 1 -- 172.21.15.6:0/3662741915 >> 172.21.15.6:0/3662741915 conn(0x7f3f1c0659d0 msgr2=0x7f3f1c06afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:19.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.340+0000 7f3f23a6a640 1 -- 172.21.15.6:0/3662741915 shutdown_connections 2023-07-21T22:19:19.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.340+0000 7f3f23a6a640 1 -- 172.21.15.6:0/3662741915 wait complete. 2023-07-21T22:19:19.406 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:19:19.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.504+0000 7f2276f7d640 1 Processor -- start 2023-07-21T22:19:19.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.504+0000 7f2276f7d640 1 -- start start 2023-07-21T22:19:19.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2276f7d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f22700cc960 0x7f22700ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:19.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2276f7d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22700cd270 con 0x7f2270160750 2023-07-21T22:19:19.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2276f7d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22700cf430 con 0x7f22700b1620 2023-07-21T22:19:19.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2276f7d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22700cf710 con 0x7f22700cc960 2023-07-21T22:19:19.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f227677c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2270160750 0x7f227015c310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34384/0 (socket says 172.21.15.6:34384) 2023-07-21T22:19:19.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f227677c640 1 -- 172.21.15.6:0/3415768245 learned_addr learned my addr 172.21.15.6:0/3415768245 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:19.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2275f7b640 1 --2- 172.21.15.6:0/3415768245 >> v2:172.21.15.161:3300/0 conn(0x7f22700cc960 0x7f22700ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:19.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2274f79640 1 -- 172.21.15.6:0/3415768245 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2347331825 0 0) 0x7f22700cd270 con 0x7f2270160750 2023-07-21T22:19:19.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2274f79640 1 -- 172.21.15.6:0/3415768245 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f225c003530 con 0x7f2270160750 2023-07-21T22:19:19.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2274f79640 1 -- 172.21.15.6:0/3415768245 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3019397359 0 0) 0x7f225c003530 con 0x7f2270160750 2023-07-21T22:19:19.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2274f79640 1 -- 172.21.15.6:0/3415768245 >> v2:172.21.15.161:3300/0 conn(0x7f22700cc960 msgr2=0x7f22700ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:19.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2274f79640 1 --2- 172.21.15.6:0/3415768245 >> v2:172.21.15.161:3300/0 conn(0x7f22700cc960 0x7f22700ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2274f79640 1 -- 172.21.15.6:0/3415768245 >> v1:172.21.15.161:6789/0 conn(0x7f22700b1620 legacy=0x7f22700ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:19.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2274f79640 1 -- 172.21.15.6:0/3415768245 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227015fc70 con 0x7f2270160750 2023-07-21T22:19:19.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2274f79640 1 -- 172.21.15.6:0/3415768245 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f2268001a00 con 0x7f2270160750 2023-07-21T22:19:19.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2274f79640 1 -- 172.21.15.6:0/3415768245 >> v1:172.21.15.6:6789/0 conn(0x7f2270160750 legacy=0x7f227015c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:19.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2274f79640 1 --2- 172.21.15.6:0/3415768245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f225c003980 0x7f225c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:19.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2274f79640 1 --2- 172.21.15.6:0/3415768245 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f225c004370 0x7f225c004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:19.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2274f79640 1 --2- 172.21.15.6:0/3415768245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c005030 0x7f225c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:19.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2274f79640 1 -- 172.21.15.6:0/3415768245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22700cf710 con 0x7f225c005030 2023-07-21T22:19:19.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2274f79640 1 -- 172.21.15.6:0/3415768245 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c00bf80 con 0x7f225c003980 2023-07-21T22:19:19.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2274f79640 1 -- 172.21.15.6:0/3415768245 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c00c140 con 0x7f225c004370 2023-07-21T22:19:19.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f227677c640 1 --2- 172.21.15.6:0/3415768245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c005030 0x7f225c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:19.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2275f7b640 1 --2- 172.21.15.6:0/3415768245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f225c003980 0x7f225c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:19.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f227577a640 1 --2- 172.21.15.6:0/3415768245 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f225c004370 0x7f225c004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:19.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2275f7b640 1 -- 172.21.15.6:0/3415768245 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f225c004370 msgr2=0x7f225c004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:19.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2275f7b640 1 --2- 172.21.15.6:0/3415768245 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f225c004370 0x7f225c004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2275f7b640 1 -- 172.21.15.6:0/3415768245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c005030 msgr2=0x7f225c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:19.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2275f7b640 1 --2- 172.21.15.6:0/3415768245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c005030 0x7f225c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f2275f7b640 1 -- 172.21.15.6:0/3415768245 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c003530 con 0x7f225c003980 2023-07-21T22:19:19.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f227677c640 1 --2- 172.21.15.6:0/3415768245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c005030 0x7f225c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:19.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.508+0000 7f227677c640 1 -- 172.21.15.6:0/3415768245 reap_dead start 2023-07-21T22:19:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.512+0000 7f2275f7b640 1 --2- 172.21.15.6:0/3415768245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f225c003980 0x7f225c003d50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f226c009ae0 tx=0x7f226c01ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d6065fd320f4819 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.512+0000 7f2274f79640 1 -- 172.21.15.6:0/3415768245 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c0a5640 con 0x7f225c003980 2023-07-21T22:19:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.512+0000 7f2274f79640 1 -- 172.21.15.6:0/3415768245 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c0a57a0 con 0x7f225c003980 2023-07-21T22:19:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.512+0000 7f2274f79640 1 -- 172.21.15.6:0/3415768245 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c0a5b50 con 0x7f225c003980 2023-07-21T22:19:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.512+0000 7f2276f7d640 1 -- 172.21.15.6:0/3415768245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f225c003980 msgr2=0x7f225c003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.512+0000 7f2276f7d640 1 --2- 172.21.15.6:0/3415768245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f225c003980 0x7f225c003d50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f226c009ae0 tx=0x7f226c01ca50 comp rx=0 tx=0).stop 2023-07-21T22:19:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.512+0000 7f2276f7d640 1 -- 172.21.15.6:0/3415768245 shutdown_connections 2023-07-21T22:19:19.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.512+0000 7f2276f7d640 1 --2- 172.21.15.6:0/3415768245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f225c003980 0x7f225c003d50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.512+0000 7f2276f7d640 1 -- 172.21.15.6:0/3415768245 >> 172.21.15.6:0/3415768245 conn(0x7f2270069f50 msgr2=0x7f227006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:19.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.512+0000 7f2276f7d640 1 -- 172.21.15.6:0/3415768245 shutdown_connections 2023-07-21T22:19:19.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.512+0000 7f2276f7d640 1 -- 172.21.15.6:0/3415768245 wait complete. 2023-07-21T22:19:19.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f2276f7d640 1 Processor -- start 2023-07-21T22:19:19.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f2276f7d640 1 -- start start 2023-07-21T22:19:19.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f2276f7d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f225c003980 0x7f22701f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:19.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f2276f7d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22700c66d0 0x7f22700c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:19.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f2276f7d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f227015e380 0x7f227015e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:19.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f2276f7d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227015f0d0 con 0x7f22700c66d0 2023-07-21T22:19:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f2276f7d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227015c310 con 0x7f225c003980 2023-07-21T22:19:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f2276f7d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227015ed30 con 0x7f227015e380 2023-07-21T22:19:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f227577a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22700c66d0 0x7f22700c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f227577a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22700c66d0 0x7f22700c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42272/0 (socket says 172.21.15.6:42272) 2023-07-21T22:19:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f227577a640 1 -- 172.21.15.6:0/466225231 learned_addr learned my addr 172.21.15.6:0/466225231 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f2275f7b640 1 --2- 172.21.15.6:0/466225231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f225c003980 0x7f22701f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f227677c640 1 --2- 172.21.15.6:0/466225231 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f227015e380 0x7f227015e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f227577a640 1 -- 172.21.15.6:0/466225231 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f227015e380 msgr2=0x7f227015e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f227577a640 1 --2- 172.21.15.6:0/466225231 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f227015e380 0x7f227015e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f227577a640 1 -- 172.21.15.6:0/466225231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f225c003980 msgr2=0x7f22701f10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f227577a640 1 --2- 172.21.15.6:0/466225231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f225c003980 0x7f22701f10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f227577a640 1 -- 172.21.15.6:0/466225231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22700c6c00 con 0x7f22700c66d0 2023-07-21T22:19:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f227577a640 1 --2- 172.21.15.6:0/466225231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22700c66d0 0x7f22700c8800 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f226000f720 tx=0x7f226000f750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f22667fc640 1 -- 172.21.15.6:0/466225231 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226000fe80 con 0x7f22700c66d0 2023-07-21T22:19:19.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f22667fc640 1 -- 172.21.15.6:0/466225231 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22600052e0 con 0x7f22700c66d0 2023-07-21T22:19:19.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f22667fc640 1 -- 172.21.15.6:0/466225231 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2260003840 con 0x7f22700c66d0 2023-07-21T22:19:19.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f2276f7d640 1 -- 172.21.15.6:0/466225231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22700c6ee0 con 0x7f22700c66d0 2023-07-21T22:19:19.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f2276f7d640 1 -- 172.21.15.6:0/466225231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22700c74a0 con 0x7f22700c66d0 2023-07-21T22:19:19.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.516+0000 7f2276f7d640 1 -- 172.21.15.6:0/466225231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227015c480 con 0x7f22700c66d0 2023-07-21T22:19:19.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.520+0000 7f22667fc640 1 -- 172.21.15.6:0/466225231 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f22600039a0 con 0x7f22700c66d0 2023-07-21T22:19:19.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.520+0000 7f22667fc640 1 --2- 172.21.15.6:0/466225231 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2254066280 0x7f2254068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:19.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.520+0000 7f22667fc640 1 -- 172.21.15.6:0/466225231 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2260083800 con 0x7f22700c66d0 2023-07-21T22:19:19.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.520+0000 7f2275f7b640 1 --2- 172.21.15.6:0/466225231 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2254066280 0x7f2254068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:19.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.520+0000 7f2275f7b640 1 --2- 172.21.15.6:0/466225231 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2254066280 0x7f2254068730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f226c0af000 tx=0x7f226c0046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:19.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.524+0000 7f22667fc640 1 -- 172.21.15.6:0/466225231 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f227015c480 con 0x7f22700c66d0 2023-07-21T22:19:19.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.680+0000 7f2276f7d640 1 -- 172.21.15.6:0/466225231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f227015c480 con 0x7f22700c66d0 2023-07-21T22:19:19.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.680+0000 7f22667fc640 1 -- 172.21.15.6:0/466225231 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f227015c480 con 0x7f22700c66d0 2023-07-21T22:19:19.729 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:19:19.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.684+0000 7f2276f7d640 1 -- 172.21.15.6:0/466225231 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2254066280 msgr2=0x7f2254068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:19.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.684+0000 7f2276f7d640 1 --2- 172.21.15.6:0/466225231 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2254066280 0x7f2254068730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f226c0af000 tx=0x7f226c0046d0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.684+0000 7f2276f7d640 1 -- 172.21.15.6:0/466225231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22700c66d0 msgr2=0x7f22700c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:19.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.684+0000 7f2276f7d640 1 --2- 172.21.15.6:0/466225231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22700c66d0 0x7f22700c8800 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f226000f720 tx=0x7f226000f750 comp rx=0 tx=0).stop 2023-07-21T22:19:19.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.684+0000 7f2276f7d640 1 -- 172.21.15.6:0/466225231 shutdown_connections 2023-07-21T22:19:19.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.684+0000 7f2276f7d640 1 --2- 172.21.15.6:0/466225231 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f227015e380 0x7f227015e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.684+0000 7f2276f7d640 1 --2- 172.21.15.6:0/466225231 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2254066280 0x7f2254068730 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.684+0000 7f2276f7d640 1 --2- 172.21.15.6:0/466225231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22700c66d0 0x7f22700c8800 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.684+0000 7f2276f7d640 1 --2- 172.21.15.6:0/466225231 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f225c003980 0x7f22701f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.684+0000 7f2276f7d640 1 -- 172.21.15.6:0/466225231 >> 172.21.15.6:0/466225231 conn(0x7f2270069f50 msgr2=0x7f22700d0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:19.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.684+0000 7f2276f7d640 1 -- 172.21.15.6:0/466225231 shutdown_connections 2023-07-21T22:19:19.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.684+0000 7f2276f7d640 1 -- 172.21.15.6:0/466225231 wait complete. 2023-07-21T22:19:19.749 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:19:19.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.848+0000 7febde4ec640 1 Processor -- start 2023-07-21T22:19:19.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.848+0000 7febde4ec640 1 -- start start 2023-07-21T22:19:19.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.852+0000 7febde4ec640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7febd80cb0f0 0x7febd8069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:19.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.852+0000 7febde4ec640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd80cb570 con 0x7febd806d2d0 2023-07-21T22:19:19.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.852+0000 7febde4ec640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd8069d40 con 0x7febd8069430 2023-07-21T22:19:19.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.852+0000 7febde4ec640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd80cb7d0 con 0x7febd80cb0f0 2023-07-21T22:19:19.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.852+0000 7febd77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7febd80cb0f0 0x7febd8069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:19.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.852+0000 7febdca89640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7febd806d2d0 0x7febd806d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34398/0 (socket says 172.21.15.6:34398) 2023-07-21T22:19:19.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.852+0000 7febd77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7febd80cb0f0 0x7febd8069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42284/0 (socket says 172.21.15.6:42284) 2023-07-21T22:19:19.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.852+0000 7febdca89640 1 -- 172.21.15.6:0/3791360216 learned_addr learned my addr 172.21.15.6:0/3791360216 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:19.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.852+0000 7febd77fe640 1 -- 172.21.15.6:0/3791360216 >> v1:172.21.15.161:6789/0 conn(0x7febd8069430 legacy=0x7febd8160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:19.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.852+0000 7febd77fe640 1 -- 172.21.15.6:0/3791360216 >> v1:172.21.15.6:6789/0 conn(0x7febd806d2d0 legacy=0x7febd806d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:19.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.852+0000 7febd77fe640 1 -- 172.21.15.6:0/3791360216 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd806c510 con 0x7febd80cb0f0 2023-07-21T22:19:19.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.852+0000 7febd6ffd640 1 -- 172.21.15.6:0/3791360216 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759831267 0 0) 0x7febd80cb570 con 0x7febd806d2d0 2023-07-21T22:19:19.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.856+0000 7febd77fe640 1 --2- 172.21.15.6:0/3791360216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd80cb0f0 0x7febd8069800 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7febcc0097c0 tx=0x7febcc01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5c0890cb001f70 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:19.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.856+0000 7febd6ffd640 1 -- 172.21.15.6:0/3791360216 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc0ab600 con 0x7febd80cb0f0 2023-07-21T22:19:19.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.856+0000 7febd6ffd640 1 -- 172.21.15.6:0/3791360216 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febcc0a7050 con 0x7febd80cb0f0 2023-07-21T22:19:19.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.856+0000 7febd6ffd640 1 -- 172.21.15.6:0/3791360216 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc0ab980 con 0x7febd80cb0f0 2023-07-21T22:19:19.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.856+0000 7febde4ec640 1 -- 172.21.15.6:0/3791360216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd80cb0f0 msgr2=0x7febd8069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:19.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.856+0000 7febde4ec640 1 --2- 172.21.15.6:0/3791360216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd80cb0f0 0x7febd8069800 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7febcc0097c0 tx=0x7febcc01c380 comp rx=0 tx=0).stop 2023-07-21T22:19:19.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.856+0000 7febde4ec640 1 -- 172.21.15.6:0/3791360216 shutdown_connections 2023-07-21T22:19:19.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.856+0000 7febde4ec640 1 --2- 172.21.15.6:0/3791360216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd80cb0f0 0x7febd8069800 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.856+0000 7febde4ec640 1 -- 172.21.15.6:0/3791360216 >> 172.21.15.6:0/3791360216 conn(0x7febd80b1840 msgr2=0x7febd80cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:19.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.856+0000 7febde4ec640 1 -- 172.21.15.6:0/3791360216 shutdown_connections 2023-07-21T22:19:19.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.856+0000 7febde4ec640 1 -- 172.21.15.6:0/3791360216 wait complete. 2023-07-21T22:19:19.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.856+0000 7febde4ec640 1 Processor -- start 2023-07-21T22:19:19.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.856+0000 7febde4ec640 1 -- start start 2023-07-21T22:19:19.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febde4ec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febd8069430 0x7febd80c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:19.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febde4ec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd806d2d0 0x7febd81f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:19.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febde4ec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febd80cb0f0 0x7febd81f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:19.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febde4ec640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd80c8490 con 0x7febd806d2d0 2023-07-21T22:19:19.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febde4ec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd81f6340 con 0x7febd80cb0f0 2023-07-21T22:19:19.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febde4ec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd80c61b0 con 0x7febd8069430 2023-07-21T22:19:19.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febd77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd806d2d0 0x7febd81f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:19.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febd77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd806d2d0 0x7febd81f5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42296/0 (socket says 172.21.15.6:42296) 2023-07-21T22:19:19.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febd77fe640 1 -- 172.21.15.6:0/2173377045 learned_addr learned my addr 172.21.15.6:0/2173377045 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:19.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febd7fff640 1 --2- 172.21.15.6:0/2173377045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febd8069430 0x7febd80c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:19.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febdca89640 1 --2- 172.21.15.6:0/2173377045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febd80cb0f0 0x7febd81f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:19.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febd77fe640 1 -- 172.21.15.6:0/2173377045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febd8069430 msgr2=0x7febd80c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:19.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febd77fe640 1 --2- 172.21.15.6:0/2173377045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febd8069430 0x7febd80c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febd77fe640 1 -- 172.21.15.6:0/2173377045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febd80cb0f0 msgr2=0x7febd81f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:19.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febd77fe640 1 --2- 172.21.15.6:0/2173377045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febd80cb0f0 0x7febd81f4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:19.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febd77fe640 1 -- 172.21.15.6:0/2173377045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc009420 con 0x7febd806d2d0 2023-07-21T22:19:19.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febd77fe640 1 --2- 172.21.15.6:0/2173377045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd806d2d0 0x7febd81f5e00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7febcc019fb0 tx=0x7febcc019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:19.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febd4ff9640 1 -- 172.21.15.6:0/2173377045 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc0b5670 con 0x7febd806d2d0 2023-07-21T22:19:19.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febd4ff9640 1 -- 172.21.15.6:0/2173377045 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febcc0abe90 con 0x7febd806d2d0 2023-07-21T22:19:19.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febd4ff9640 1 -- 172.21.15.6:0/2173377045 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc0b5a30 con 0x7febd806d2d0 2023-07-21T22:19:19.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febde4ec640 1 -- 172.21.15.6:0/2173377045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd81f54c0 con 0x7febd806d2d0 2023-07-21T22:19:19.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febde4ec640 1 -- 172.21.15.6:0/2173377045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd80c6450 con 0x7febd806d2d0 2023-07-21T22:19:19.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.860+0000 7febde4ec640 1 -- 172.21.15.6:0/2173377045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd80678d0 con 0x7febd806d2d0 2023-07-21T22:19:19.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.864+0000 7febd4ff9640 1 -- 172.21.15.6:0/2173377045 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7febcc0b2040 con 0x7febd806d2d0 2023-07-21T22:19:19.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.864+0000 7febd4ff9640 1 --2- 172.21.15.6:0/2173377045 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7febc4066280 0x7febc4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:19.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.864+0000 7febd4ff9640 1 -- 172.21.15.6:0/2173377045 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7febcc11e1b0 con 0x7febd806d2d0 2023-07-21T22:19:19.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.864+0000 7febd7fff640 1 --2- 172.21.15.6:0/2173377045 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7febc4066280 0x7febc4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:19.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.864+0000 7febd7fff640 1 --2- 172.21.15.6:0/2173377045 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7febc4066280 0x7febc4068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7febc80098e0 tx=0x7febc8009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:19.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:19.868+0000 7febd4ff9640 1 -- 172.21.15.6:0/2173377045 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7febcc0eb6e0 con 0x7febd806d2d0 2023-07-21T22:19:20.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.020+0000 7febde4ec640 1 -- 172.21.15.6:0/2173377045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7febd806e920 con 0x7febd806d2d0 2023-07-21T22:19:20.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.024+0000 7febd4ff9640 1 -- 172.21.15.6:0/2173377045 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7febcc0eed00 con 0x7febd806d2d0 2023-07-21T22:19:20.069 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:19:20.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.024+0000 7febde4ec640 1 -- 172.21.15.6:0/2173377045 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7febc4066280 msgr2=0x7febc4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:20.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.024+0000 7febde4ec640 1 --2- 172.21.15.6:0/2173377045 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7febc4066280 0x7febc4068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7febc80098e0 tx=0x7febc8009060 comp rx=0 tx=0).stop 2023-07-21T22:19:20.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.024+0000 7febde4ec640 1 -- 172.21.15.6:0/2173377045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd806d2d0 msgr2=0x7febd81f5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:20.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.024+0000 7febde4ec640 1 --2- 172.21.15.6:0/2173377045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd806d2d0 0x7febd81f5e00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7febcc019fb0 tx=0x7febcc019120 comp rx=0 tx=0).stop 2023-07-21T22:19:20.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.024+0000 7febde4ec640 1 -- 172.21.15.6:0/2173377045 shutdown_connections 2023-07-21T22:19:20.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.024+0000 7febde4ec640 1 --2- 172.21.15.6:0/2173377045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febd80cb0f0 0x7febd81f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:20.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.024+0000 7febde4ec640 1 --2- 172.21.15.6:0/2173377045 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7febc4066280 0x7febc4068730 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:20.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.024+0000 7febde4ec640 1 --2- 172.21.15.6:0/2173377045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd806d2d0 0x7febd81f5e00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:20.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.024+0000 7febde4ec640 1 --2- 172.21.15.6:0/2173377045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febd8069430 0x7febd80c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:20.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.024+0000 7febde4ec640 1 -- 172.21.15.6:0/2173377045 >> 172.21.15.6:0/2173377045 conn(0x7febd80b1840 msgr2=0x7febd8166e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:20.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.024+0000 7febde4ec640 1 -- 172.21.15.6:0/2173377045 shutdown_connections 2023-07-21T22:19:20.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.024+0000 7febde4ec640 1 -- 172.21.15.6:0/2173377045 wait complete. 2023-07-21T22:19:20.101 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2023-07-21T22:19:20.101 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-21T22:19:20.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-07-21T22:19:20.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.200+0000 7f6f94974640 1 Processor -- start 2023-07-21T22:19:20.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.200+0000 7f6f94974640 1 -- start start 2023-07-21T22:19:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.200+0000 7f6f94974640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6f900b7c70 0x7f6f900d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.200+0000 7f6f94974640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f900ccaf0 con 0x7f6f9015fd60 2023-07-21T22:19:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.200+0000 7f6f94974640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f90160320 con 0x7f6f900d1850 2023-07-21T22:19:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.200+0000 7f6f94974640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f900d1190 con 0x7f6f900b7c70 2023-07-21T22:19:20.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.200+0000 7f6f8ed9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6f9015fd60 0x7f6f900d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34402/0 (socket says 172.21.15.6:34402) 2023-07-21T22:19:20.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.200+0000 7f6f8ed9d640 1 -- 172.21.15.6:0/3123139937 learned_addr learned my addr 172.21.15.6:0/3123139937 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:20.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.200+0000 7f6f8e59c640 1 --2- 172.21.15.6:0/3123139937 >> v2:172.21.15.161:3300/0 conn(0x7f6f900b7c70 0x7f6f900d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:20.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.200+0000 7f6f8d59a640 1 -- 172.21.15.6:0/3123139937 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667920288 0 0) 0x7f6f900ccaf0 con 0x7f6f9015fd60 2023-07-21T22:19:20.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.200+0000 7f6f8d59a640 1 -- 172.21.15.6:0/3123139937 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f78003530 con 0x7f6f9015fd60 2023-07-21T22:19:20.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.200+0000 7f6f8e59c640 1 -- 172.21.15.6:0/3123139937 >> v1:172.21.15.161:6789/0 conn(0x7f6f900d1850 legacy=0x7f6f9015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:20.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.200+0000 7f6f8d59a640 1 -- 172.21.15.6:0/3123139937 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881254199 0 0) 0x7f6f90160320 con 0x7f6f900d1850 2023-07-21T22:19:20.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.200+0000 7f6f8e59c640 1 -- 172.21.15.6:0/3123139937 >> v1:172.21.15.6:6789/0 conn(0x7f6f9015fd60 legacy=0x7f6f900d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:20.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.200+0000 7f6f8e59c640 1 -- 172.21.15.6:0/3123139937 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f900ccd90 con 0x7f6f900b7c70 2023-07-21T22:19:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.204+0000 7f6f8e59c640 1 --2- 172.21.15.6:0/3123139937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f900b7c70 0x7f6f900d0c50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6f800097c0 tx=0x7f6f8001c2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=588b3a5457197b59 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.204+0000 7f6f8d59a640 1 -- 172.21.15.6:0/3123139937 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88001a00 con 0x7f6f900b7c70 2023-07-21T22:19:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.204+0000 7f6f8d59a640 1 -- 172.21.15.6:0/3123139937 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f800a7050 con 0x7f6f900b7c70 2023-07-21T22:19:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.204+0000 7f6f8d59a640 1 -- 172.21.15.6:0/3123139937 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f800ab620 con 0x7f6f900b7c70 2023-07-21T22:19:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.204+0000 7f6f94974640 1 -- 172.21.15.6:0/3123139937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f900b7c70 msgr2=0x7f6f900d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:20.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.204+0000 7f6f94974640 1 --2- 172.21.15.6:0/3123139937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f900b7c70 0x7f6f900d0c50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6f800097c0 tx=0x7f6f8001c2c0 comp rx=0 tx=0).stop 2023-07-21T22:19:20.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.204+0000 7f6f94974640 1 -- 172.21.15.6:0/3123139937 shutdown_connections 2023-07-21T22:19:20.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.204+0000 7f6f94974640 1 --2- 172.21.15.6:0/3123139937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f900b7c70 0x7f6f900d0c50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:20.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.204+0000 7f6f94974640 1 -- 172.21.15.6:0/3123139937 >> 172.21.15.6:0/3123139937 conn(0x7f6f900650b0 msgr2=0x7f6f900654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:20.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.204+0000 7f6f94974640 1 -- 172.21.15.6:0/3123139937 shutdown_connections 2023-07-21T22:19:20.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.204+0000 7f6f94974640 1 -- 172.21.15.6:0/3123139937 wait complete. 2023-07-21T22:19:20.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f94974640 1 Processor -- start 2023-07-21T22:19:20.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f94974640 1 -- start start 2023-07-21T22:19:20.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f94974640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f900b7c70 0x7f6f9014d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:20.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f94974640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f900d1850 0x7f6f90151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f94974640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f9015fd60 0x7f6f900b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f94974640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f901535d0 con 0x7f6f9015fd60 2023-07-21T22:19:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f94974640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9014d9c0 con 0x7f6f900d1850 2023-07-21T22:19:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f94974640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f901529c0 con 0x7f6f900b7c70 2023-07-21T22:19:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f8ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f9015fd60 0x7f6f900b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f8ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f9015fd60 0x7f6f900b62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42300/0 (socket says 172.21.15.6:42300) 2023-07-21T22:19:20.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f8ed9d640 1 -- 172.21.15.6:0/3926383737 learned_addr learned my addr 172.21.15.6:0/3926383737 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f8e59c640 1 --2- 172.21.15.6:0/3926383737 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f900b7c70 0x7f6f9014d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f8dd9b640 1 --2- 172.21.15.6:0/3926383737 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f900d1850 0x7f6f90151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f8ed9d640 1 -- 172.21.15.6:0/3926383737 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f900b7c70 msgr2=0x7f6f9014d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f8ed9d640 1 --2- 172.21.15.6:0/3926383737 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f900b7c70 0x7f6f9014d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f8ed9d640 1 -- 172.21.15.6:0/3926383737 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f900d1850 msgr2=0x7f6f90151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f8ed9d640 1 --2- 172.21.15.6:0/3926383737 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f900d1850 0x7f6f90151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f8ed9d640 1 -- 172.21.15.6:0/3926383737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f80009420 con 0x7f6f9015fd60 2023-07-21T22:19:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f8ed9d640 1 --2- 172.21.15.6:0/3926383737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f9015fd60 0x7f6f900b62b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800ca50 tx=0x7f6f8800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f7effd640 1 -- 172.21.15.6:0/3926383737 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8800a9a0 con 0x7f6f9015fd60 2023-07-21T22:19:20.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f7effd640 1 -- 172.21.15.6:0/3926383737 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8800ab00 con 0x7f6f9015fd60 2023-07-21T22:19:20.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f7effd640 1 -- 172.21.15.6:0/3926383737 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88004e40 con 0x7f6f9015fd60 2023-07-21T22:19:20.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f94974640 1 -- 172.21.15.6:0/3926383737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f90152ca0 con 0x7f6f9015fd60 2023-07-21T22:19:20.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.208+0000 7f6f94974640 1 -- 172.21.15.6:0/3926383737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f90153260 con 0x7f6f9015fd60 2023-07-21T22:19:20.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.212+0000 7f6f94974640 1 -- 172.21.15.6:0/3926383737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f900678d0 con 0x7f6f9015fd60 2023-07-21T22:19:20.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.212+0000 7f6f7effd640 1 -- 172.21.15.6:0/3926383737 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6f880070d0 con 0x7f6f9015fd60 2023-07-21T22:19:20.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.212+0000 7f6f7effd640 1 --2- 172.21.15.6:0/3926383737 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6f70066280 0x7f6f70068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:20.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.212+0000 7f6f7effd640 1 -- 172.21.15.6:0/3926383737 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f88083550 con 0x7f6f9015fd60 2023-07-21T22:19:20.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.212+0000 7f6f8e59c640 1 --2- 172.21.15.6:0/3926383737 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6f70066280 0x7f6f70068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:20.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.212+0000 7f6f8e59c640 1 --2- 172.21.15.6:0/3926383737 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6f70066280 0x7f6f70068730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6f800ad000 tx=0x7f6f800a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:20.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.216+0000 7f6f7effd640 1 -- 172.21.15.6:0/3926383737 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6f880509e0 con 0x7f6f9015fd60 2023-07-21T22:19:20.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.432+0000 7f6f94974640 1 -- 172.21.15.6:0/3926383737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f6f90153710 con 0x7f6f9015fd60 2023-07-21T22:19:20.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.588+0000 7f6f7effd640 1 -- 172.21.15.6:0/3926383737 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v61) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6f88054000 con 0x7f6f9015fd60 2023-07-21T22:19:20.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.588+0000 7f6f94974640 1 -- 172.21.15.6:0/3926383737 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6f70066280 msgr2=0x7f6f70068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:20.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.588+0000 7f6f94974640 1 --2- 172.21.15.6:0/3926383737 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6f70066280 0x7f6f70068730 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6f800ad000 tx=0x7f6f800a6000 comp rx=0 tx=0).stop 2023-07-21T22:19:20.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.588+0000 7f6f94974640 1 -- 172.21.15.6:0/3926383737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f9015fd60 msgr2=0x7f6f900b62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:20.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.588+0000 7f6f94974640 1 --2- 172.21.15.6:0/3926383737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f9015fd60 0x7f6f900b62b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800ca50 tx=0x7f6f8800cf10 comp rx=0 tx=0).stop 2023-07-21T22:19:20.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.588+0000 7f6f94974640 1 -- 172.21.15.6:0/3926383737 shutdown_connections 2023-07-21T22:19:20.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.588+0000 7f6f94974640 1 --2- 172.21.15.6:0/3926383737 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6f70066280 0x7f6f70068730 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:20.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.588+0000 7f6f94974640 1 --2- 172.21.15.6:0/3926383737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f9015fd60 0x7f6f900b62b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:20.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.588+0000 7f6f94974640 1 --2- 172.21.15.6:0/3926383737 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f900d1850 0x7f6f90151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:20.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.588+0000 7f6f94974640 1 --2- 172.21.15.6:0/3926383737 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f900b7c70 0x7f6f9014d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:20.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.588+0000 7f6f94974640 1 -- 172.21.15.6:0/3926383737 >> 172.21.15.6:0/3926383737 conn(0x7f6f900650b0 msgr2=0x7f6f900b7270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:20.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.588+0000 7f6f94974640 1 -- 172.21.15.6:0/3926383737 shutdown_connections 2023-07-21T22:19:20.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.588+0000 7f6f94974640 1 -- 172.21.15.6:0/3926383737 wait complete. 2023-07-21T22:19:20.655 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-21T22:19:20.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.756+0000 7f1ce9819640 1 Processor -- start 2023-07-21T22:19:20.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.756+0000 7f1ce9819640 1 -- start start 2023-07-21T22:19:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.756+0000 7f1ce9819640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1ce40af2b0 0x7f1ce415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:20.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.756+0000 7f1ce9819640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce4159d70 con 0x7f1ce4070f30 2023-07-21T22:19:20.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.756+0000 7f1ce9819640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce40c9c60 con 0x7f1ce4069430 2023-07-21T22:19:20.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.756+0000 7f1ce9819640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce40c9f40 con 0x7f1ce40af2b0 2023-07-21T22:19:20.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.756+0000 7f1cdbfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1ce4070f30 0x7f1ce40ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34410/0 (socket says 172.21.15.6:34410) 2023-07-21T22:19:20.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.756+0000 7f1cdbfff640 1 -- 172.21.15.6:0/401827266 learned_addr learned my addr 172.21.15.6:0/401827266 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:20.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.756+0000 7f1ce37fe640 1 --2- 172.21.15.6:0/401827266 >> v2:172.21.15.6:3300/0 conn(0x7f1ce40af2b0 0x7f1ce415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:20.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.756+0000 7f1ce27fc640 1 -- 172.21.15.6:0/401827266 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614171236 0 0) 0x7f1ccc001120 con 0x7f1ce4070f30 2023-07-21T22:19:20.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.756+0000 7f1ce27fc640 1 -- 172.21.15.6:0/401827266 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cd0003530 con 0x7f1ce4070f30 2023-07-21T22:19:20.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.756+0000 7f1ce37fe640 1 -- 172.21.15.6:0/401827266 >> v1:172.21.15.161:6789/0 conn(0x7f1ce4069430 legacy=0x7f1ce4069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:20.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.756+0000 7f1ce27fc640 1 -- 172.21.15.6:0/401827266 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894039421 0 0) 0x7f1ce40c9c60 con 0x7f1ce4069430 2023-07-21T22:19:20.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.756+0000 7f1ce37fe640 1 -- 172.21.15.6:0/401827266 >> v1:172.21.15.6:6789/0 conn(0x7f1ce4070f30 legacy=0x7f1ce40ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:20.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.756+0000 7f1ce37fe640 1 -- 172.21.15.6:0/401827266 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce40ca220 con 0x7f1ce40af2b0 2023-07-21T22:19:20.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.760+0000 7f1ce37fe640 1 --2- 172.21.15.6:0/401827266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce40af2b0 0x7f1ce415a1f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009d90 tx=0x7f1cdc01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa7451cccbb4228 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:20.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.760+0000 7f1ce27fc640 1 -- 172.21.15.6:0/401827266 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc0a5920 con 0x7f1ce40af2b0 2023-07-21T22:19:20.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.760+0000 7f1ce27fc640 1 -- 172.21.15.6:0/401827266 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc0a5a80 con 0x7f1ce40af2b0 2023-07-21T22:19:20.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.760+0000 7f1ce27fc640 1 -- 172.21.15.6:0/401827266 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc0a5df0 con 0x7f1ce40af2b0 2023-07-21T22:19:20.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.760+0000 7f1ce9819640 1 -- 172.21.15.6:0/401827266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce40af2b0 msgr2=0x7f1ce415a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:20.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.760+0000 7f1ce9819640 1 --2- 172.21.15.6:0/401827266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce40af2b0 0x7f1ce415a1f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009d90 tx=0x7f1cdc01c950 comp rx=0 tx=0).stop 2023-07-21T22:19:20.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.760+0000 7f1ce9819640 1 -- 172.21.15.6:0/401827266 shutdown_connections 2023-07-21T22:19:20.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.760+0000 7f1ce9819640 1 --2- 172.21.15.6:0/401827266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce40af2b0 0x7f1ce415a1f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:20.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.760+0000 7f1ce9819640 1 -- 172.21.15.6:0/401827266 >> 172.21.15.6:0/401827266 conn(0x7f1ce40cde90 msgr2=0x7f1ce40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:20.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.760+0000 7f1ce9819640 1 -- 172.21.15.6:0/401827266 shutdown_connections 2023-07-21T22:19:20.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.760+0000 7f1ce9819640 1 -- 172.21.15.6:0/401827266 wait complete. 2023-07-21T22:19:20.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce9819640 1 Processor -- start 2023-07-21T22:19:20.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce9819640 1 -- start start 2023-07-21T22:19:20.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce9819640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce4069430 0x7f1ce4151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:20.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce9819640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ce4070f30 0x7f1ce40cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:20.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce9819640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ce40af2b0 0x7f1ce40cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:20.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce9819640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce4148110 con 0x7f1ce4069430 2023-07-21T22:19:20.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce9819640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce4147500 con 0x7f1ce4070f30 2023-07-21T22:19:20.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce9819640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce41477e0 con 0x7f1ce40af2b0 2023-07-21T22:19:20.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce4069430 0x7f1ce4151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:20.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce4069430 0x7f1ce4151810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42318/0 (socket says 172.21.15.6:42318) 2023-07-21T22:19:20.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce2ffd640 1 -- 172.21.15.6:0/604449389 learned_addr learned my addr 172.21.15.6:0/604449389 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:20.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1cdbfff640 1 --2- 172.21.15.6:0/604449389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ce4070f30 0x7f1ce40cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:20.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce37fe640 1 --2- 172.21.15.6:0/604449389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ce40af2b0 0x7f1ce40cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:20.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce2ffd640 1 -- 172.21.15.6:0/604449389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ce40af2b0 msgr2=0x7f1ce40cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:20.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce2ffd640 1 --2- 172.21.15.6:0/604449389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ce40af2b0 0x7f1ce40cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:20.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce2ffd640 1 -- 172.21.15.6:0/604449389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ce4070f30 msgr2=0x7f1ce40cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:20.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce2ffd640 1 --2- 172.21.15.6:0/604449389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ce4070f30 0x7f1ce40cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:20.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce2ffd640 1 -- 172.21.15.6:0/604449389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cdc009a70 con 0x7f1ce4069430 2023-07-21T22:19:20.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1cdbfff640 1 --2- 172.21.15.6:0/604449389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ce4070f30 0x7f1ce40cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:20.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce2ffd640 1 --2- 172.21.15.6:0/604449389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce4069430 0x7f1ce4151810 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400c410 tx=0x7f1cd400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:20.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce0ff9640 1 -- 172.21.15.6:0/604449389 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd40054e0 con 0x7f1ce4069430 2023-07-21T22:19:20.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce0ff9640 1 -- 172.21.15.6:0/604449389 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd4003600 con 0x7f1ce4069430 2023-07-21T22:19:20.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce0ff9640 1 -- 172.21.15.6:0/604449389 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd40039b0 con 0x7f1ce4069430 2023-07-21T22:19:20.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce9819640 1 -- 172.21.15.6:0/604449389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce4147ac0 con 0x7f1ce4069430 2023-07-21T22:19:20.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.764+0000 7f1ce9819640 1 -- 172.21.15.6:0/604449389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce41485a0 con 0x7f1ce4069430 2023-07-21T22:19:20.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.768+0000 7f1ce9819640 1 -- 172.21.15.6:0/604449389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce40678d0 con 0x7f1ce4069430 2023-07-21T22:19:20.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.768+0000 7f1ce0ff9640 1 -- 172.21.15.6:0/604449389 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1cd4003b10 con 0x7f1ce4069430 2023-07-21T22:19:20.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.768+0000 7f1ce0ff9640 1 --2- 172.21.15.6:0/604449389 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1cc40662b0 0x7f1cc4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:20.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.768+0000 7f1ce0ff9640 1 -- 172.21.15.6:0/604449389 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1cd4083270 con 0x7f1ce4069430 2023-07-21T22:19:20.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.768+0000 7f1cdbfff640 1 --2- 172.21.15.6:0/604449389 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1cc40662b0 0x7f1cc4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:20.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.768+0000 7f1cdbfff640 1 --2- 172.21.15.6:0/604449389 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1cc40662b0 0x7f1cc4068760 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1ce40c4dd0 tx=0x7f1ccc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:20.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.772+0000 7f1ce0ff9640 1 -- 172.21.15.6:0/604449389 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1cd4054220 con 0x7f1ce4069430 2023-07-21T22:19:20.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.928+0000 7f1ce9819640 1 -- 172.21.15.6:0/604449389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1ce40cbdf0 con 0x7f1ce4069430 2023-07-21T22:19:20.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.932+0000 7f1ce0ff9640 1 -- 172.21.15.6:0/604449389 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1cd4053db0 con 0x7f1ce4069430 2023-07-21T22:19:20.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.936+0000 7f1ce9819640 1 -- 172.21.15.6:0/604449389 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1cc40662b0 msgr2=0x7f1cc4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:20.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.936+0000 7f1ce9819640 1 --2- 172.21.15.6:0/604449389 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1cc40662b0 0x7f1cc4068760 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1ce40c4dd0 tx=0x7f1ccc009040 comp rx=0 tx=0).stop 2023-07-21T22:19:20.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.936+0000 7f1ce9819640 1 -- 172.21.15.6:0/604449389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce4069430 msgr2=0x7f1ce4151810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:20.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.936+0000 7f1ce9819640 1 --2- 172.21.15.6:0/604449389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce4069430 0x7f1ce4151810 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400c410 tx=0x7f1cd400c8d0 comp rx=0 tx=0).stop 2023-07-21T22:19:20.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.936+0000 7f1ce9819640 1 -- 172.21.15.6:0/604449389 shutdown_connections 2023-07-21T22:19:20.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.936+0000 7f1ce9819640 1 --2- 172.21.15.6:0/604449389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ce40af2b0 0x7f1ce40cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:20.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.936+0000 7f1ce9819640 1 --2- 172.21.15.6:0/604449389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ce4070f30 0x7f1ce40cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:20.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.936+0000 7f1ce9819640 1 --2- 172.21.15.6:0/604449389 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1cc40662b0 0x7f1cc4068760 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:20.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.936+0000 7f1ce9819640 1 --2- 172.21.15.6:0/604449389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce4069430 0x7f1ce4151810 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:20.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.936+0000 7f1ce9819640 1 -- 172.21.15.6:0/604449389 >> 172.21.15.6:0/604449389 conn(0x7f1ce40cde90 msgr2=0x7f1ce406c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:20.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.936+0000 7f1ce9819640 1 -- 172.21.15.6:0/604449389 shutdown_connections 2023-07-21T22:19:20.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:20.936+0000 7f1ce9819640 1 -- 172.21.15.6:0/604449389 wait complete. 2023-07-21T22:19:21.002 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:19:21.003 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:19:21.059 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:19:21.111 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:19:21.112 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:19:21.112 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:19:21.122 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:19:21.123 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:19:21.180 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:19:21.180 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:19:21.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:19:21.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.372+0000 7fe61e182640 1 Processor -- start 2023-07-21T22:19:21.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.372+0000 7fe61e182640 1 -- start start 2023-07-21T22:19:21.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.372+0000 7fe61e182640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe6180b7c70 0x7fe6180d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:21.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.372+0000 7fe61e182640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe6180d1850 0x7fe61815f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:21.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.372+0000 7fe61e182640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6180ccaf0 con 0x7fe6180d1300 2023-07-21T22:19:21.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.372+0000 7fe61e182640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6180d1190 con 0x7fe6180d1850 2023-07-21T22:19:21.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.372+0000 7fe61e182640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe618160600 con 0x7fe6180b7c70 2023-07-21T22:19:21.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.372+0000 7fe616ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe6180d1850 0x7fe61815f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:21.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.372+0000 7fe617fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe6180d1300 0x7fe6180d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34412/0 (socket says 172.21.15.6:34412) 2023-07-21T22:19:21.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.372+0000 7fe617fff640 1 -- 172.21.15.6:0/4049548894 learned_addr learned my addr 172.21.15.6:0/4049548894 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:21.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.372+0000 7fe6177fe640 1 --2- 172.21.15.6:0/4049548894 >> v2:172.21.15.161:3300/0 conn(0x7fe6180b7c70 0x7fe6180d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:21.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.372+0000 7fe616ffd640 1 -- 172.21.15.6:0/4049548894 >> v2:172.21.15.161:3300/0 conn(0x7fe6180b7c70 msgr2=0x7fe6180d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:21.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.372+0000 7fe616ffd640 1 --2- 172.21.15.6:0/4049548894 >> v2:172.21.15.161:3300/0 conn(0x7fe6180b7c70 0x7fe6180d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:21.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.372+0000 7fe616ffd640 1 -- 172.21.15.6:0/4049548894 >> v1:172.21.15.6:6789/0 conn(0x7fe6180d1300 legacy=0x7fe6180d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:21.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.372+0000 7fe616ffd640 1 -- 172.21.15.6:0/4049548894 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe618160320 con 0x7fe6180d1850 2023-07-21T22:19:21.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.372+0000 7fe6167fc640 1 -- 172.21.15.6:0/4049548894 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702189575 0 0) 0x7fe6180ccaf0 con 0x7fe6180d1300 2023-07-21T22:19:21.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.376+0000 7fe616ffd640 1 --2- 172.21.15.6:0/4049548894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6180d1850 0x7fe61815f650 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe6180b40a0 tx=0x7fe60c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e765f248115867 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:21.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.376+0000 7fe6167fc640 1 -- 172.21.15.6:0/4049548894 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c0ab600 con 0x7fe6180d1850 2023-07-21T22:19:21.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.376+0000 7fe6167fc640 1 -- 172.21.15.6:0/4049548894 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c0a7050 con 0x7fe6180d1850 2023-07-21T22:19:21.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.376+0000 7fe6167fc640 1 -- 172.21.15.6:0/4049548894 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c0ab980 con 0x7fe6180d1850 2023-07-21T22:19:21.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.376+0000 7fe61e182640 1 -- 172.21.15.6:0/4049548894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6180d1850 msgr2=0x7fe61815f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:21.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.376+0000 7fe61e182640 1 --2- 172.21.15.6:0/4049548894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6180d1850 0x7fe61815f650 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe6180b40a0 tx=0x7fe60c01c410 comp rx=0 tx=0).stop 2023-07-21T22:19:21.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.376+0000 7fe61e182640 1 -- 172.21.15.6:0/4049548894 shutdown_connections 2023-07-21T22:19:21.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.376+0000 7fe61e182640 1 --2- 172.21.15.6:0/4049548894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6180d1850 0x7fe61815f650 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:21.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.376+0000 7fe61e182640 1 --2- 172.21.15.6:0/4049548894 >> v2:172.21.15.161:3300/0 conn(0x7fe6180b7c70 0x7fe6180d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:21.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.376+0000 7fe61e182640 1 -- 172.21.15.6:0/4049548894 >> 172.21.15.6:0/4049548894 conn(0x7fe6180650b0 msgr2=0x7fe6180654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:21.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.376+0000 7fe61e182640 1 -- 172.21.15.6:0/4049548894 shutdown_connections 2023-07-21T22:19:21.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.376+0000 7fe61e182640 1 -- 172.21.15.6:0/4049548894 wait complete. 2023-07-21T22:19:21.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe61e182640 1 Processor -- start 2023-07-21T22:19:21.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe61e182640 1 -- start start 2023-07-21T22:19:21.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe61e182640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6180b7c70 0x7fe6180c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe61e182640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6180d1300 0x7fe6180b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe61e182640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6180d1850 0x7fe618157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe61e182640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe618157be0 con 0x7fe6180d1850 2023-07-21T22:19:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe61e182640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6180c7e80 con 0x7fe6180b7c70 2023-07-21T22:19:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe61e182640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6180c8160 con 0x7fe6180d1300 2023-07-21T22:19:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe617fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6180d1850 0x7fe618157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe617fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6180d1850 0x7fe618157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42328/0 (socket says 172.21.15.6:42328) 2023-07-21T22:19:21.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe617fff640 1 -- 172.21.15.6:0/3282631675 learned_addr learned my addr 172.21.15.6:0/3282631675 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:21.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe6177fe640 1 --2- 172.21.15.6:0/3282631675 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6180b7c70 0x7fe6180c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:21.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe616ffd640 1 --2- 172.21.15.6:0/3282631675 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6180d1300 0x7fe6180b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:21.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe617fff640 1 -- 172.21.15.6:0/3282631675 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6180d1300 msgr2=0x7fe6180b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:21.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe617fff640 1 --2- 172.21.15.6:0/3282631675 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6180d1300 0x7fe6180b5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:21.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe617fff640 1 -- 172.21.15.6:0/3282631675 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6180b7c70 msgr2=0x7fe6180c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:21.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe617fff640 1 --2- 172.21.15.6:0/3282631675 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6180b7c70 0x7fe6180c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:21.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe617fff640 1 -- 172.21.15.6:0/3282631675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c009420 con 0x7fe6180d1850 2023-07-21T22:19:21.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe617fff640 1 --2- 172.21.15.6:0/3282631675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6180d1850 0x7fe618157390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe61000c780 tx=0x7fe61000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:21.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe5fffff640 1 -- 172.21.15.6:0/3282631675 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61000ce90 con 0x7fe6180d1850 2023-07-21T22:19:21.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe5fffff640 1 -- 172.21.15.6:0/3282631675 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61000a640 con 0x7fe6180d1850 2023-07-21T22:19:21.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe5fffff640 1 -- 172.21.15.6:0/3282631675 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61000a9d0 con 0x7fe6180d1850 2023-07-21T22:19:21.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe61e182640 1 -- 172.21.15.6:0/3282631675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6180c8440 con 0x7fe6180d1850 2023-07-21T22:19:21.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe61e182640 1 -- 172.21.15.6:0/3282631675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6181578d0 con 0x7fe6180d1850 2023-07-21T22:19:21.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.380+0000 7fe61e182640 1 -- 172.21.15.6:0/3282631675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe618157d50 con 0x7fe6180d1850 2023-07-21T22:19:21.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.384+0000 7fe5fffff640 1 -- 172.21.15.6:0/3282631675 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe61000ab30 con 0x7fe6180d1850 2023-07-21T22:19:21.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.384+0000 7fe5fffff640 1 --2- 172.21.15.6:0/3282631675 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe604066280 0x7fe604068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:21.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.384+0000 7fe5fffff640 1 -- 172.21.15.6:0/3282631675 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe610083310 con 0x7fe6180d1850 2023-07-21T22:19:21.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.384+0000 7fe6177fe640 1 --2- 172.21.15.6:0/3282631675 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe604066280 0x7fe604068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:21.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.384+0000 7fe6177fe640 1 --2- 172.21.15.6:0/3282631675 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe604066280 0x7fe604068730 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe60800b930 tx=0x7fe608008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:21.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.388+0000 7fe5fffff640 1 -- 172.21.15.6:0/3282631675 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe6100506f0 con 0x7fe6180d1850 2023-07-21T22:19:21.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.548+0000 7fe61e182640 1 -- 172.21.15.6:0/3282631675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6180678d0 con 0x7fe6180d1850 2023-07-21T22:19:21.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.548+0000 7fe5fffff640 1 -- 172.21.15.6:0/3282631675 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18207 (secure 0 0 0) 0x7fe610053d10 con 0x7fe6180d1850 2023-07-21T22:19:21.594 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:21.595 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:18:45.315608+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:18:41.465054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:18:42.709896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:19:21.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.548+0000 7fe61e182640 1 -- 172.21.15.6:0/3282631675 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe604066280 msgr2=0x7fe604068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:21.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.548+0000 7fe61e182640 1 --2- 172.21.15.6:0/3282631675 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe604066280 0x7fe604068730 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe60800b930 tx=0x7fe608008040 comp rx=0 tx=0).stop 2023-07-21T22:19:21.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.548+0000 7fe61e182640 1 -- 172.21.15.6:0/3282631675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6180d1850 msgr2=0x7fe618157390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:21.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.548+0000 7fe61e182640 1 --2- 172.21.15.6:0/3282631675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6180d1850 0x7fe618157390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe61000c780 tx=0x7fe61000cc40 comp rx=0 tx=0).stop 2023-07-21T22:19:21.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.548+0000 7fe61e182640 1 -- 172.21.15.6:0/3282631675 shutdown_connections 2023-07-21T22:19:21.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.548+0000 7fe61e182640 1 --2- 172.21.15.6:0/3282631675 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe604066280 0x7fe604068730 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:21.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.548+0000 7fe61e182640 1 --2- 172.21.15.6:0/3282631675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6180d1850 0x7fe618157390 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:21.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.548+0000 7fe61e182640 1 --2- 172.21.15.6:0/3282631675 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6180d1300 0x7fe6180b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:21.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.548+0000 7fe61e182640 1 --2- 172.21.15.6:0/3282631675 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6180b7c70 0x7fe6180c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:21.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.548+0000 7fe61e182640 1 -- 172.21.15.6:0/3282631675 >> 172.21.15.6:0/3282631675 conn(0x7fe6180650b0 msgr2=0x7fe618065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:21.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.548+0000 7fe61e182640 1 -- 172.21.15.6:0/3282631675 shutdown_connections 2023-07-21T22:19:21.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.548+0000 7fe61e182640 1 -- 172.21.15.6:0/3282631675 wait complete. 2023-07-21T22:19:21.615 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:18:41.465054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:18:42.709896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:19:21.616 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:19:21.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.716+0000 7f2f31f82640 1 Processor -- start 2023-07-21T22:19:21.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.716+0000 7f2f31f82640 1 -- start start 2023-07-21T22:19:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.716+0000 7f2f31f82640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f2c15f690 0x7f2f2c0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.716+0000 7f2f31f82640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2f2c06a440 0x7f2f2c06c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.716+0000 7f2f31f82640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2c06c040 con 0x7f2f2c1453a0 2023-07-21T22:19:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.716+0000 7f2f31f82640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2c160170 con 0x7f2f2c06a440 2023-07-21T22:19:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.716+0000 7f2f31f82640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c160600 con 0x7f2f2c15f690 2023-07-21T22:19:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.716+0000 7f2f2affd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2f2c1453a0 0x7f2f2c15fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34422/0 (socket says 172.21.15.6:34422) 2023-07-21T22:19:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.716+0000 7f2f2affd640 1 -- 172.21.15.6:0/1358514481 learned_addr learned my addr 172.21.15.6:0/1358514481 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2bfff640 1 --2- 172.21.15.6:0/1358514481 >> v2:172.21.15.161:3300/0 conn(0x7f2f2c06a440 0x7f2f2c06c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.716+0000 7f2f2b7fe640 1 --2- 172.21.15.6:0/1358514481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f2c15f690 0x7f2f2c0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2a7fc640 1 -- 172.21.15.6:0/1358514481 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672892163 0 0) 0x7f2f2c06c040 con 0x7f2f2c1453a0 2023-07-21T22:19:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2a7fc640 1 -- 172.21.15.6:0/1358514481 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f14003530 con 0x7f2f2c1453a0 2023-07-21T22:19:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2a7fc640 1 -- 172.21.15.6:0/1358514481 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1340828929 0 0) 0x7f2f14003530 con 0x7f2f2c1453a0 2023-07-21T22:19:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2a7fc640 1 -- 172.21.15.6:0/1358514481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f2c15f690 msgr2=0x7f2f2c0b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:21.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2a7fc640 1 --2- 172.21.15.6:0/1358514481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f2c15f690 0x7f2f2c0b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:21.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2a7fc640 1 -- 172.21.15.6:0/1358514481 >> v2:172.21.15.161:3300/0 conn(0x7f2f2c06a440 msgr2=0x7f2f2c06c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:21.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2a7fc640 1 --2- 172.21.15.6:0/1358514481 >> v2:172.21.15.161:3300/0 conn(0x7f2f2c06a440 0x7f2f2c06c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:21.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2a7fc640 1 -- 172.21.15.6:0/1358514481 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c160360 con 0x7f2f2c1453a0 2023-07-21T22:19:21.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2a7fc640 1 -- 172.21.15.6:0/1358514481 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f2f20001680 con 0x7f2f2c1453a0 2023-07-21T22:19:21.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2a7fc640 1 -- 172.21.15.6:0/1358514481 >> v1:172.21.15.6:6789/0 conn(0x7f2f2c1453a0 legacy=0x7f2f2c15fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:21.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2a7fc640 1 --2- 172.21.15.6:0/1358514481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f14003980 0x7f2f14003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:21.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2a7fc640 1 --2- 172.21.15.6:0/1358514481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f140047d0 0x7f2f14004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:21.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2a7fc640 1 --2- 172.21.15.6:0/1358514481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f2c15f690 0x7f2f14005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:21.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2a7fc640 1 -- 172.21.15.6:0/1358514481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c160600 con 0x7f2f14003980 2023-07-21T22:19:21.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2a7fc640 1 -- 172.21.15.6:0/1358514481 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1400b990 con 0x7f2f140047d0 2023-07-21T22:19:21.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2a7fc640 1 -- 172.21.15.6:0/1358514481 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1400bb50 con 0x7f2f2c15f690 2023-07-21T22:19:21.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2b7fe640 1 --2- 172.21.15.6:0/1358514481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f14003980 0x7f2f14003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:21.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2affd640 1 --2- 172.21.15.6:0/1358514481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f140047d0 0x7f2f14004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:21.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2bfff640 1 --2- 172.21.15.6:0/1358514481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f2c15f690 0x7f2f14005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:21.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2b7fe640 1 -- 172.21.15.6:0/1358514481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f2c15f690 msgr2=0x7f2f14005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:21.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2b7fe640 1 --2- 172.21.15.6:0/1358514481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f2c15f690 0x7f2f14005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:21.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2b7fe640 1 -- 172.21.15.6:0/1358514481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f140047d0 msgr2=0x7f2f14004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:21.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2b7fe640 1 --2- 172.21.15.6:0/1358514481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f140047d0 0x7f2f14004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:21.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2b7fe640 1 -- 172.21.15.6:0/1358514481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f14003530 con 0x7f2f14003980 2023-07-21T22:19:21.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2affd640 1 --2- 172.21.15.6:0/1358514481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f140047d0 0x7f2f14004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:21.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.720+0000 7f2f2b7fe640 1 --2- 172.21.15.6:0/1358514481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f14003980 0x7f2f14003d90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c009ae0 tx=0x7f2f1c01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b06e897190688bc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:21.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.724+0000 7f2f2a7fc640 1 -- 172.21.15.6:0/1358514481 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c0a6510 con 0x7f2f14003980 2023-07-21T22:19:21.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.724+0000 7f2f2a7fc640 1 -- 172.21.15.6:0/1358514481 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1c0a6670 con 0x7f2f14003980 2023-07-21T22:19:21.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.724+0000 7f2f2a7fc640 1 -- 172.21.15.6:0/1358514481 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c0a6a20 con 0x7f2f14003980 2023-07-21T22:19:21.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.724+0000 7f2f31f82640 1 -- 172.21.15.6:0/1358514481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f14003980 msgr2=0x7f2f14003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:21.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.724+0000 7f2f31f82640 1 --2- 172.21.15.6:0/1358514481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f14003980 0x7f2f14003d90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c009ae0 tx=0x7f2f1c01ca20 comp rx=0 tx=0).stop 2023-07-21T22:19:21.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.724+0000 7f2f2bfff640 1 -- 172.21.15.6:0/1358514481 reap_dead start 2023-07-21T22:19:21.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.724+0000 7f2f31f82640 1 -- 172.21.15.6:0/1358514481 shutdown_connections 2023-07-21T22:19:21.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.724+0000 7f2f31f82640 1 -- 172.21.15.6:0/1358514481 >> 172.21.15.6:0/1358514481 conn(0x7f2f2c0b1210 msgr2=0x7f2f2c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:21.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.724+0000 7f2f31f82640 1 -- 172.21.15.6:0/1358514481 shutdown_connections 2023-07-21T22:19:21.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.724+0000 7f2f31f82640 1 -- 172.21.15.6:0/1358514481 wait complete. 2023-07-21T22:19:21.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.724+0000 7f2f31f82640 1 Processor -- start 2023-07-21T22:19:21.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.724+0000 7f2f31f82640 1 -- start start 2023-07-21T22:19:21.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.724+0000 7f2f31f82640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f14003980 0x7f2f2c13c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:21.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.724+0000 7f2f31f82640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f2c14b9a0 0x7f2f2c14bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:21.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.724+0000 7f2f31f82640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f2c1f7ad0 0x7f2f2c1f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:21.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.724+0000 7f2f31f82640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c1f8480 con 0x7f2f2c14b9a0 2023-07-21T22:19:21.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.724+0000 7f2f31f82640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c15bdd0 con 0x7f2f14003980 2023-07-21T22:19:21.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.724+0000 7f2f31f82640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c15c390 con 0x7f2f2c1f7ad0 2023-07-21T22:19:21.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.724+0000 7f2f2affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f2c14b9a0 0x7f2f2c14bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:21.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.728+0000 7f2f2affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f2c14b9a0 0x7f2f2c14bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42360/0 (socket says 172.21.15.6:42360) 2023-07-21T22:19:21.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.728+0000 7f2f2affd640 1 -- 172.21.15.6:0/1789683014 learned_addr learned my addr 172.21.15.6:0/1789683014 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:21.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.728+0000 7f2f2affd640 1 -- 172.21.15.6:0/1789683014 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f2c1f7ad0 msgr2=0x7f2f2c1f7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:21.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.728+0000 7f2f2affd640 1 --2- 172.21.15.6:0/1789683014 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f2c1f7ad0 0x7f2f2c1f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:21.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.728+0000 7f2f2affd640 1 -- 172.21.15.6:0/1789683014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f14003980 msgr2=0x7f2f2c13c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:21.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.728+0000 7f2f2affd640 1 --2- 172.21.15.6:0/1789683014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f14003980 0x7f2f2c13c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:21.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.728+0000 7f2f2affd640 1 -- 172.21.15.6:0/1789683014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c14c420 con 0x7f2f2c14b9a0 2023-07-21T22:19:21.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.728+0000 7f2f2affd640 1 --2- 172.21.15.6:0/1789683014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f2c14b9a0 0x7f2f2c14bdf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000e700 tx=0x7f2f2000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:21.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.728+0000 7f2f13fff640 1 -- 172.21.15.6:0/1789683014 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2000c5e0 con 0x7f2f2c14b9a0 2023-07-21T22:19:21.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.728+0000 7f2f13fff640 1 -- 172.21.15.6:0/1789683014 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2000c740 con 0x7f2f2c14b9a0 2023-07-21T22:19:21.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.728+0000 7f2f13fff640 1 -- 172.21.15.6:0/1789683014 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2000cad0 con 0x7f2f2c14b9a0 2023-07-21T22:19:21.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.728+0000 7f2f31f82640 1 -- 172.21.15.6:0/1789683014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f2c14c700 con 0x7f2f2c14b9a0 2023-07-21T22:19:21.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.728+0000 7f2f31f82640 1 -- 172.21.15.6:0/1789683014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2c13cc60 con 0x7f2f2c14b9a0 2023-07-21T22:19:21.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.728+0000 7f2f31f82640 1 -- 172.21.15.6:0/1789683014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2c14c8f0 con 0x7f2f2c14b9a0 2023-07-21T22:19:21.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.728+0000 7f2f13fff640 1 -- 172.21.15.6:0/1789683014 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f2000cc30 con 0x7f2f2c14b9a0 2023-07-21T22:19:21.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.728+0000 7f2f13fff640 1 --2- 172.21.15.6:0/1789683014 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2f18066280 0x7f2f18068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:21.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.732+0000 7f2f13fff640 1 -- 172.21.15.6:0/1789683014 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f20083ad0 con 0x7f2f2c14b9a0 2023-07-21T22:19:21.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.732+0000 7f2f2b7fe640 1 --2- 172.21.15.6:0/1789683014 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2f18066280 0x7f2f18068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:21.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.732+0000 7f2f2b7fe640 1 --2- 172.21.15.6:0/1789683014 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2f18066280 0x7f2f18068730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0af000 tx=0x7f2f1c004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:21.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.732+0000 7f2f13fff640 1 -- 172.21.15.6:0/1789683014 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2f20050f50 con 0x7f2f2c14b9a0 2023-07-21T22:19:21.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.892+0000 7f2f31f82640 1 -- 172.21.15.6:0/1789683014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2f2c0678d0 con 0x7f2f2c14b9a0 2023-07-21T22:19:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.892+0000 7f2f13fff640 1 -- 172.21.15.6:0/1789683014 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f20054570 con 0x7f2f2c14b9a0 2023-07-21T22:19:21.939 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:19:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.892+0000 7f2f31f82640 1 -- 172.21.15.6:0/1789683014 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2f18066280 msgr2=0x7f2f18068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.892+0000 7f2f31f82640 1 --2- 172.21.15.6:0/1789683014 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2f18066280 0x7f2f18068730 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0af000 tx=0x7f2f1c004740 comp rx=0 tx=0).stop 2023-07-21T22:19:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.892+0000 7f2f31f82640 1 -- 172.21.15.6:0/1789683014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f2c14b9a0 msgr2=0x7f2f2c14bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.892+0000 7f2f31f82640 1 --2- 172.21.15.6:0/1789683014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f2c14b9a0 0x7f2f2c14bdf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000e700 tx=0x7f2f2000ebc0 comp rx=0 tx=0).stop 2023-07-21T22:19:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.892+0000 7f2f31f82640 1 -- 172.21.15.6:0/1789683014 shutdown_connections 2023-07-21T22:19:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.892+0000 7f2f31f82640 1 --2- 172.21.15.6:0/1789683014 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f2c1f7ad0 0x7f2f2c1f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.892+0000 7f2f31f82640 1 --2- 172.21.15.6:0/1789683014 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2f18066280 0x7f2f18068730 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:21.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.892+0000 7f2f31f82640 1 --2- 172.21.15.6:0/1789683014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f2c14b9a0 0x7f2f2c14bdf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:21.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.892+0000 7f2f31f82640 1 --2- 172.21.15.6:0/1789683014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f14003980 0x7f2f2c13c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:21.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.892+0000 7f2f31f82640 1 -- 172.21.15.6:0/1789683014 >> 172.21.15.6:0/1789683014 conn(0x7f2f2c0b1210 msgr2=0x7f2f2c144280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:21.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.892+0000 7f2f31f82640 1 -- 172.21.15.6:0/1789683014 shutdown_connections 2023-07-21T22:19:21.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:21.892+0000 7f2f31f82640 1 -- 172.21.15.6:0/1789683014 wait complete. 2023-07-21T22:19:21.960 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:19:22.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.060+0000 7f0aa8540640 1 Processor -- start 2023-07-21T22:19:22.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.060+0000 7f0aa8540640 1 -- start start 2023-07-21T22:19:22.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.060+0000 7f0aa8540640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aa006a540 0x7f0aa006a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:22.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.064+0000 7f0aa8540640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa00cb7a0 con 0x7f0aa00cf2e0 2023-07-21T22:19:22.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.064+0000 7f0aa8540640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa00d0920 con 0x7f0aa00cf710 2023-07-21T22:19:22.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.064+0000 7f0aa8540640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa015bfd0 con 0x7f0aa006a540 2023-07-21T22:19:22.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.064+0000 7f0aa5adb640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0aa00cf2e0 0x7f0aa00cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34428/0 (socket says 172.21.15.6:34428) 2023-07-21T22:19:22.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.064+0000 7f0aa5adb640 1 -- 172.21.15.6:0/1209674630 learned_addr learned my addr 172.21.15.6:0/1209674630 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:22.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.064+0000 7f0aa62dc640 1 --2- 172.21.15.6:0/1209674630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aa006a540 0x7f0aa006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:22.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.064+0000 7f0aa52da640 1 -- 172.21.15.6:0/1209674630 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3622520400 0 0) 0x7f0aa00cb7a0 con 0x7f0aa00cf2e0 2023-07-21T22:19:22.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.064+0000 7f0aa52da640 1 -- 172.21.15.6:0/1209674630 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a8c003530 con 0x7f0aa00cf2e0 2023-07-21T22:19:22.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.064+0000 7f0aa52da640 1 -- 172.21.15.6:0/1209674630 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1486987096 0 0) 0x7f0aa00d0920 con 0x7f0aa00cf710 2023-07-21T22:19:22.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.064+0000 7f0aa52da640 1 -- 172.21.15.6:0/1209674630 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aa00cb7a0 con 0x7f0aa00cf710 2023-07-21T22:19:22.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.064+0000 7f0aa62dc640 1 -- 172.21.15.6:0/1209674630 >> v1:172.21.15.161:6789/0 conn(0x7f0aa00cf710 legacy=0x7f0aa00cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:22.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.064+0000 7f0aa62dc640 1 -- 172.21.15.6:0/1209674630 >> v1:172.21.15.6:6789/0 conn(0x7f0aa00cf2e0 legacy=0x7f0aa00cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:22.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.064+0000 7f0aa62dc640 1 -- 172.21.15.6:0/1209674630 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa00cd7e0 con 0x7f0aa006a540 2023-07-21T22:19:22.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.064+0000 7f0aa62dc640 1 --2- 172.21.15.6:0/1209674630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aa006a540 0x7f0aa006a910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0097f0 tx=0x7f0a9c01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=658259f08bb5c163 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:22.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.068+0000 7f0aa52da640 1 -- 172.21.15.6:0/1209674630 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0ac410 con 0x7f0aa006a540 2023-07-21T22:19:22.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.068+0000 7f0aa52da640 1 -- 172.21.15.6:0/1209674630 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c0ac570 con 0x7f0aa006a540 2023-07-21T22:19:22.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.068+0000 7f0aa52da640 1 -- 172.21.15.6:0/1209674630 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0ac900 con 0x7f0aa006a540 2023-07-21T22:19:22.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.068+0000 7f0aa8540640 1 -- 172.21.15.6:0/1209674630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aa006a540 msgr2=0x7f0aa006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:22.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.068+0000 7f0aa8540640 1 --2- 172.21.15.6:0/1209674630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aa006a540 0x7f0aa006a910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0097f0 tx=0x7f0a9c01c4c0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.068+0000 7f0aa8540640 1 -- 172.21.15.6:0/1209674630 shutdown_connections 2023-07-21T22:19:22.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.068+0000 7f0aa8540640 1 --2- 172.21.15.6:0/1209674630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aa006a540 0x7f0aa006a910 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.068+0000 7f0aa8540640 1 -- 172.21.15.6:0/1209674630 >> 172.21.15.6:0/1209674630 conn(0x7f0aa0099490 msgr2=0x7f0aa0089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:22.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.068+0000 7f0aa8540640 1 -- 172.21.15.6:0/1209674630 shutdown_connections 2023-07-21T22:19:22.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.068+0000 7f0aa8540640 1 -- 172.21.15.6:0/1209674630 wait complete. 2023-07-21T22:19:22.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.068+0000 7f0aa8540640 1 Processor -- start 2023-07-21T22:19:22.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.068+0000 7f0aa8540640 1 -- start start 2023-07-21T22:19:22.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.068+0000 7f0aa8540640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0aa006a540 0x7f0aa00b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:22.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.068+0000 7f0aa8540640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aa00cf2e0 0x7f0aa014a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:22.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.068+0000 7f0aa8540640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0aa00cf710 0x7f0aa0156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:22.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.068+0000 7f0aa8540640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa0155730 con 0x7f0aa00cf710 2023-07-21T22:19:22.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.068+0000 7f0aa8540640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa00b1380 con 0x7f0aa006a540 2023-07-21T22:19:22.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.068+0000 7f0aa8540640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa00af3b0 con 0x7f0aa00cf2e0 2023-07-21T22:19:22.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.068+0000 7f0aa6add640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0aa00cf710 0x7f0aa0156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:22.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.072+0000 7f0aa6add640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0aa00cf710 0x7f0aa0156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42376/0 (socket says 172.21.15.6:42376) 2023-07-21T22:19:22.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.072+0000 7f0aa6add640 1 -- 172.21.15.6:0/3709033866 learned_addr learned my addr 172.21.15.6:0/3709033866 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:22.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.072+0000 7f0aa62dc640 1 --2- 172.21.15.6:0/3709033866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0aa006a540 0x7f0aa00b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:22.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.072+0000 7f0aa5adb640 1 --2- 172.21.15.6:0/3709033866 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aa00cf2e0 0x7f0aa014a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:22.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.072+0000 7f0aa6add640 1 -- 172.21.15.6:0/3709033866 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aa00cf2e0 msgr2=0x7f0aa014a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:22.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.072+0000 7f0aa6add640 1 --2- 172.21.15.6:0/3709033866 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aa00cf2e0 0x7f0aa014a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.072+0000 7f0aa6add640 1 -- 172.21.15.6:0/3709033866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0aa006a540 msgr2=0x7f0aa00b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:22.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.072+0000 7f0aa6add640 1 --2- 172.21.15.6:0/3709033866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0aa006a540 0x7f0aa00b0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.072+0000 7f0aa6add640 1 -- 172.21.15.6:0/3709033866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c009420 con 0x7f0aa00cf710 2023-07-21T22:19:22.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.072+0000 7f0aa5adb640 1 --2- 172.21.15.6:0/3709033866 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aa00cf2e0 0x7f0aa014a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:22.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.072+0000 7f0aa6add640 1 --2- 172.21.15.6:0/3709033866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0aa00cf710 0x7f0aa0156020 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800c790 tx=0x7f0a9800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:22.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.072+0000 7f0a96ffd640 1 -- 172.21.15.6:0/3709033866 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9800cea0 con 0x7f0aa00cf710 2023-07-21T22:19:22.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.072+0000 7f0a96ffd640 1 -- 172.21.15.6:0/3709033866 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a98003b80 con 0x7f0aa00cf710 2023-07-21T22:19:22.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.072+0000 7f0a96ffd640 1 -- 172.21.15.6:0/3709033866 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9800a850 con 0x7f0aa00cf710 2023-07-21T22:19:22.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.072+0000 7f0aa8540640 1 -- 172.21.15.6:0/3709033866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa0152c80 con 0x7f0aa00cf710 2023-07-21T22:19:22.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.072+0000 7f0aa8540640 1 -- 172.21.15.6:0/3709033866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa0153240 con 0x7f0aa00cf710 2023-07-21T22:19:22.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.072+0000 7f0aa8540640 1 -- 172.21.15.6:0/3709033866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa00cffd0 con 0x7f0aa00cf710 2023-07-21T22:19:22.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.072+0000 7f0a96ffd640 1 -- 172.21.15.6:0/3709033866 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a9800a9b0 con 0x7f0aa00cf710 2023-07-21T22:19:22.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.072+0000 7f0a96ffd640 1 --2- 172.21.15.6:0/3709033866 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0a840662b0 0x7f0a84068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:22.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.072+0000 7f0a96ffd640 1 -- 172.21.15.6:0/3709033866 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0a98083b20 con 0x7f0aa00cf710 2023-07-21T22:19:22.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.076+0000 7f0aa62dc640 1 --2- 172.21.15.6:0/3709033866 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0a840662b0 0x7f0a84068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:22.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.076+0000 7f0aa62dc640 1 --2- 172.21.15.6:0/3709033866 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0a840662b0 0x7f0a84068760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0ae000 tx=0x7f0a9c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:22.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.076+0000 7f0a96ffd640 1 -- 172.21.15.6:0/3709033866 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0aa00cffd0 con 0x7f0aa00cf710 2023-07-21T22:19:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.232+0000 7f0aa8540640 1 -- 172.21.15.6:0/3709033866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0aa00cffd0 con 0x7f0aa00cf710 2023-07-21T22:19:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.232+0000 7f0a96ffd640 1 -- 172.21.15.6:0/3709033866 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v26) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0aa00cffd0 con 0x7f0aa00cf710 2023-07-21T22:19:22.280 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:19:22.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.236+0000 7f0aa8540640 1 -- 172.21.15.6:0/3709033866 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0a840662b0 msgr2=0x7f0a84068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:22.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.236+0000 7f0aa8540640 1 --2- 172.21.15.6:0/3709033866 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0a840662b0 0x7f0a84068760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0ae000 tx=0x7f0a9c008040 comp rx=0 tx=0).stop 2023-07-21T22:19:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.236+0000 7f0aa8540640 1 -- 172.21.15.6:0/3709033866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0aa00cf710 msgr2=0x7f0aa0156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.236+0000 7f0aa8540640 1 --2- 172.21.15.6:0/3709033866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0aa00cf710 0x7f0aa0156020 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800c790 tx=0x7f0a9800cc50 comp rx=0 tx=0).stop 2023-07-21T22:19:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.236+0000 7f0aa8540640 1 -- 172.21.15.6:0/3709033866 shutdown_connections 2023-07-21T22:19:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.236+0000 7f0aa8540640 1 --2- 172.21.15.6:0/3709033866 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0a840662b0 0x7f0a84068760 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.236+0000 7f0aa8540640 1 --2- 172.21.15.6:0/3709033866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0aa00cf710 0x7f0aa0156020 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.236+0000 7f0aa8540640 1 --2- 172.21.15.6:0/3709033866 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aa00cf2e0 0x7f0aa014a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.236+0000 7f0aa8540640 1 --2- 172.21.15.6:0/3709033866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0aa006a540 0x7f0aa00b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.236+0000 7f0aa8540640 1 -- 172.21.15.6:0/3709033866 >> 172.21.15.6:0/3709033866 conn(0x7f0aa0099490 msgr2=0x7f0aa00b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:22.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.236+0000 7f0aa8540640 1 -- 172.21.15.6:0/3709033866 shutdown_connections 2023-07-21T22:19:22.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.236+0000 7f0aa8540640 1 -- 172.21.15.6:0/3709033866 wait complete. 2023-07-21T22:19:22.301 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:19:22.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.400+0000 7f4eb8c18640 1 Processor -- start 2023-07-21T22:19:22.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.400+0000 7f4eb8c18640 1 -- start start 2023-07-21T22:19:22.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.404+0000 7f4eb8c18640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4eb415f690 0x7f4eb40b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:22.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.404+0000 7f4eb8c18640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4eb41453a0 0x7f4eb415fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:22.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.404+0000 7f4eb8c18640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4eb406c4d0 0x7f4eb406c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:22.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.404+0000 7f4eb8c18640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb406c040 con 0x7f4eb41453a0 2023-07-21T22:19:22.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.404+0000 7f4eb8c18640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb4160600 con 0x7f4eb415f690 2023-07-21T22:19:22.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.404+0000 7f4eb8c18640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb4160360 con 0x7f4eb406c4d0 2023-07-21T22:19:22.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.404+0000 7f4eabfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4eb41453a0 0x7f4eb415fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:22.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.404+0000 7f4eabfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4eb41453a0 0x7f4eb415fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42386/0 (socket says 172.21.15.6:42386) 2023-07-21T22:19:22.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.404+0000 7f4eabfff640 1 -- 172.21.15.6:0/1857634137 learned_addr learned my addr 172.21.15.6:0/1857634137 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:22.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.404+0000 7f4eabfff640 1 -- 172.21.15.6:0/1857634137 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4eb406c4d0 msgr2=0x7f4eb406c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:22.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.404+0000 7f4eabfff640 1 --2- 172.21.15.6:0/1857634137 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4eb406c4d0 0x7f4eb406c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.404+0000 7f4eabfff640 1 -- 172.21.15.6:0/1857634137 >> v2:172.21.15.161:3300/0 conn(0x7f4eb415f690 msgr2=0x7f4eb40b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:22.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.404+0000 7f4eabfff640 1 --2- 172.21.15.6:0/1857634137 >> v2:172.21.15.161:3300/0 conn(0x7f4eb415f690 0x7f4eb40b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.404+0000 7f4eabfff640 1 -- 172.21.15.6:0/1857634137 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb406b9f0 con 0x7f4eb41453a0 2023-07-21T22:19:22.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.408+0000 7f4eabfff640 1 --2- 172.21.15.6:0/1857634137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eb41453a0 0x7f4eb415fa60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40aba90 tx=0x7f4e9c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c229c0717dd8a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:22.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.408+0000 7f4eb1d9b640 1 -- 172.21.15.6:0/1857634137 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0ac640 con 0x7f4eb41453a0 2023-07-21T22:19:22.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.408+0000 7f4eb1d9b640 1 -- 172.21.15.6:0/1857634137 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c0ac7a0 con 0x7f4eb41453a0 2023-07-21T22:19:22.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.408+0000 7f4eb1d9b640 1 -- 172.21.15.6:0/1857634137 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0acb30 con 0x7f4eb41453a0 2023-07-21T22:19:22.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.408+0000 7f4eb8c18640 1 -- 172.21.15.6:0/1857634137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eb41453a0 msgr2=0x7f4eb415fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:22.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.408+0000 7f4eb8c18640 1 --2- 172.21.15.6:0/1857634137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eb41453a0 0x7f4eb415fa60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4eb40aba90 tx=0x7f4e9c01c440 comp rx=0 tx=0).stop 2023-07-21T22:19:22.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.408+0000 7f4eb8c18640 1 -- 172.21.15.6:0/1857634137 shutdown_connections 2023-07-21T22:19:22.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.408+0000 7f4eb8c18640 1 --2- 172.21.15.6:0/1857634137 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4eb406c4d0 0x7f4eb406c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.408+0000 7f4eb8c18640 1 --2- 172.21.15.6:0/1857634137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eb41453a0 0x7f4eb415fa60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.408+0000 7f4eb8c18640 1 --2- 172.21.15.6:0/1857634137 >> v2:172.21.15.161:3300/0 conn(0x7f4eb415f690 0x7f4eb40b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.408+0000 7f4eb8c18640 1 -- 172.21.15.6:0/1857634137 >> 172.21.15.6:0/1857634137 conn(0x7f4eb40b1210 msgr2=0x7f4eb40ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:22.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.408+0000 7f4eb8c18640 1 -- 172.21.15.6:0/1857634137 shutdown_connections 2023-07-21T22:19:22.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.408+0000 7f4eb8c18640 1 -- 172.21.15.6:0/1857634137 wait complete. 2023-07-21T22:19:22.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.408+0000 7f4eb8c18640 1 Processor -- start 2023-07-21T22:19:22.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.408+0000 7f4eb8c18640 1 -- start start 2023-07-21T22:19:22.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eb8c18640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4eb406c4d0 0x7f4eb4137a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:22.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eb8c18640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4eb41453a0 0x7f4eb415dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:22.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eb8c18640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eb415f690 0x7f4eb41f4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:22.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eb8c18640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb41380c0 con 0x7f4eb415f690 2023-07-21T22:19:22.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eb8c18640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb413c1b0 con 0x7f4eb41453a0 2023-07-21T22:19:22.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eb8c18640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb413d160 con 0x7f4eb406c4d0 2023-07-21T22:19:22.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eb2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eb415f690 0x7f4eb41f4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:22.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eb2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eb415f690 0x7f4eb41f4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42390/0 (socket says 172.21.15.6:42390) 2023-07-21T22:19:22.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eb2d9d640 1 -- 172.21.15.6:0/991561146 learned_addr learned my addr 172.21.15.6:0/991561146 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:22.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eb259c640 1 --2- 172.21.15.6:0/991561146 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4eb406c4d0 0x7f4eb4137a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:22.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eabfff640 1 --2- 172.21.15.6:0/991561146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4eb41453a0 0x7f4eb415dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:22.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eb2d9d640 1 -- 172.21.15.6:0/991561146 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4eb406c4d0 msgr2=0x7f4eb4137a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:22.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eb2d9d640 1 --2- 172.21.15.6:0/991561146 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4eb406c4d0 0x7f4eb4137a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eb2d9d640 1 -- 172.21.15.6:0/991561146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4eb41453a0 msgr2=0x7f4eb415dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:22.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eb2d9d640 1 --2- 172.21.15.6:0/991561146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4eb41453a0 0x7f4eb415dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eb2d9d640 1 -- 172.21.15.6:0/991561146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c0094d0 con 0x7f4eb415f690 2023-07-21T22:19:22.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eb2d9d640 1 --2- 172.21.15.6:0/991561146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eb415f690 0x7f4eb41f4800 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00b9a0 tx=0x7f4eac00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:22.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eaaffd640 1 -- 172.21.15.6:0/991561146 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac00cba0 con 0x7f4eb415f690 2023-07-21T22:19:22.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eaaffd640 1 -- 172.21.15.6:0/991561146 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eac00cd20 con 0x7f4eb415f690 2023-07-21T22:19:22.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eaaffd640 1 -- 172.21.15.6:0/991561146 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac014680 con 0x7f4eb415f690 2023-07-21T22:19:22.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eb8c18640 1 -- 172.21.15.6:0/991561146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb415e410 con 0x7f4eb415f690 2023-07-21T22:19:22.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eb8c18640 1 -- 172.21.15.6:0/991561146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb413c680 con 0x7f4eb415f690 2023-07-21T22:19:22.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eb8c18640 1 -- 172.21.15.6:0/991561146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb40678d0 con 0x7f4eb415f690 2023-07-21T22:19:22.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.412+0000 7f4eaaffd640 1 -- 172.21.15.6:0/991561146 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4eac01d3b0 con 0x7f4eb415f690 2023-07-21T22:19:22.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.416+0000 7f4eaaffd640 1 --2- 172.21.15.6:0/991561146 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4e94066280 0x7f4e94068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:22.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.416+0000 7f4eaaffd640 1 -- 172.21.15.6:0/991561146 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4eac083ba0 con 0x7f4eb415f690 2023-07-21T22:19:22.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.416+0000 7f4eb259c640 1 --2- 172.21.15.6:0/991561146 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4e94066280 0x7f4e94068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:22.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.416+0000 7f4eb259c640 1 --2- 172.21.15.6:0/991561146 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4e94066280 0x7f4e94068730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4138220 tx=0x7f4ea4006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:22.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.420+0000 7f4eaaffd640 1 -- 172.21.15.6:0/991561146 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4eac0510c0 con 0x7f4eb415f690 2023-07-21T22:19:22.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.576+0000 7f4eb8c18640 1 -- 172.21.15.6:0/991561146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4eb40cf300 con 0x7f4eb415f690 2023-07-21T22:19:22.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.576+0000 7f4eaaffd640 1 -- 172.21.15.6:0/991561146 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4eac019020 con 0x7f4eb415f690 2023-07-21T22:19:22.623 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:19:22.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.576+0000 7f4eb8c18640 1 -- 172.21.15.6:0/991561146 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4e94066280 msgr2=0x7f4e94068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:22.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.576+0000 7f4eb8c18640 1 --2- 172.21.15.6:0/991561146 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4e94066280 0x7f4e94068730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4138220 tx=0x7f4ea4006f90 comp rx=0 tx=0).stop 2023-07-21T22:19:22.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.576+0000 7f4eb8c18640 1 -- 172.21.15.6:0/991561146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eb415f690 msgr2=0x7f4eb41f4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:22.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.576+0000 7f4eb8c18640 1 --2- 172.21.15.6:0/991561146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eb415f690 0x7f4eb41f4800 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00b9a0 tx=0x7f4eac00be60 comp rx=0 tx=0).stop 2023-07-21T22:19:22.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.576+0000 7f4eb8c18640 1 -- 172.21.15.6:0/991561146 shutdown_connections 2023-07-21T22:19:22.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.576+0000 7f4eb8c18640 1 --2- 172.21.15.6:0/991561146 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4e94066280 0x7f4e94068730 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.576+0000 7f4eb8c18640 1 --2- 172.21.15.6:0/991561146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eb415f690 0x7f4eb41f4800 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.576+0000 7f4eb8c18640 1 --2- 172.21.15.6:0/991561146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4eb41453a0 0x7f4eb415dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.576+0000 7f4eb8c18640 1 --2- 172.21.15.6:0/991561146 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4eb406c4d0 0x7f4eb4137a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.576+0000 7f4eb8c18640 1 -- 172.21.15.6:0/991561146 >> 172.21.15.6:0/991561146 conn(0x7f4eb40b1210 msgr2=0x7f4eb415e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:22.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.576+0000 7f4eb8c18640 1 -- 172.21.15.6:0/991561146 shutdown_connections 2023-07-21T22:19:22.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.576+0000 7f4eb8c18640 1 -- 172.21.15.6:0/991561146 wait complete. 2023-07-21T22:19:22.646 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:19:22.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.744+0000 7f4fc6fd2640 1 Processor -- start 2023-07-21T22:19:22.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.744+0000 7f4fc6fd2640 1 -- start start 2023-07-21T22:19:22.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.744+0000 7f4fc6fd2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fc0069430 0x7f4fc0069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:22.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.744+0000 7f4fc6fd2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4fc00af2b0 0x7f4fc015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:22.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.744+0000 7f4fc6fd2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc0159d70 con 0x7f4fc0070f30 2023-07-21T22:19:22.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.744+0000 7f4fc6fd2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc0069d40 con 0x7f4fc00af2b0 2023-07-21T22:19:22.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.744+0000 7f4fc6fd2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc00c9c60 con 0x7f4fc0069430 2023-07-21T22:19:22.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.748+0000 7f4fbffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4fc0070f30 0x7f4fc00ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34442/0 (socket says 172.21.15.6:34442) 2023-07-21T22:19:22.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.748+0000 7f4fbffff640 1 -- 172.21.15.6:0/404324032 learned_addr learned my addr 172.21.15.6:0/404324032 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:22.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.748+0000 7f4fc556f640 1 --2- 172.21.15.6:0/404324032 >> v2:172.21.15.6:3300/0 conn(0x7f4fc00af2b0 0x7f4fc015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:22.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.748+0000 7f4fc4d6e640 1 --2- 172.21.15.6:0/404324032 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fc0069430 0x7f4fc0069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:22.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.748+0000 7f4fc556f640 1 -- 172.21.15.6:0/404324032 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fc0069430 msgr2=0x7f4fc0069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:22.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.748+0000 7f4fc556f640 1 --2- 172.21.15.6:0/404324032 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fc0069430 0x7f4fc0069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.748+0000 7f4fc556f640 1 -- 172.21.15.6:0/404324032 >> v1:172.21.15.6:6789/0 conn(0x7f4fc0070f30 legacy=0x7f4fc00ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:22.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.748+0000 7f4fc556f640 1 -- 172.21.15.6:0/404324032 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc00c9f40 con 0x7f4fc00af2b0 2023-07-21T22:19:22.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.748+0000 7f4fbf7fe640 1 -- 172.21.15.6:0/404324032 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682554437 0 0) 0x7f4fac001120 con 0x7f4fc0070f30 2023-07-21T22:19:22.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.748+0000 7f4fc556f640 1 --2- 172.21.15.6:0/404324032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc00af2b0 0x7f4fc015a1f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009d90 tx=0x7f4fb801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e118654e8ce82d38 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:22.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.748+0000 7f4fbf7fe640 1 -- 172.21.15.6:0/404324032 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb80a5a10 con 0x7f4fc00af2b0 2023-07-21T22:19:22.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.748+0000 7f4fbf7fe640 1 -- 172.21.15.6:0/404324032 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb80a5b70 con 0x7f4fc00af2b0 2023-07-21T22:19:22.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.748+0000 7f4fbf7fe640 1 -- 172.21.15.6:0/404324032 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb80ad440 con 0x7f4fc00af2b0 2023-07-21T22:19:22.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc6fd2640 1 -- 172.21.15.6:0/404324032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc00af2b0 msgr2=0x7f4fc015a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:22.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc6fd2640 1 --2- 172.21.15.6:0/404324032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc00af2b0 0x7f4fc015a1f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8009d90 tx=0x7f4fb801c950 comp rx=0 tx=0).stop 2023-07-21T22:19:22.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc6fd2640 1 -- 172.21.15.6:0/404324032 shutdown_connections 2023-07-21T22:19:22.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc6fd2640 1 --2- 172.21.15.6:0/404324032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc00af2b0 0x7f4fc015a1f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc6fd2640 1 --2- 172.21.15.6:0/404324032 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fc0069430 0x7f4fc0069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc6fd2640 1 -- 172.21.15.6:0/404324032 >> 172.21.15.6:0/404324032 conn(0x7f4fc00cde90 msgr2=0x7f4fc00ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:22.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc6fd2640 1 -- 172.21.15.6:0/404324032 shutdown_connections 2023-07-21T22:19:22.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc6fd2640 1 -- 172.21.15.6:0/404324032 wait complete. 2023-07-21T22:19:22.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc6fd2640 1 Processor -- start 2023-07-21T22:19:22.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc6fd2640 1 -- start start 2023-07-21T22:19:22.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc6fd2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fc0069430 0x7f4fc0163aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:22.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc6fd2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fc0070f30 0x7f4fc01f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:22.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc6fd2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc00af2b0 0x7f4fc0141330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:22.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc6fd2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc01f8200 con 0x7f4fc00af2b0 2023-07-21T22:19:22.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc6fd2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc0154880 con 0x7f4fc0069430 2023-07-21T22:19:22.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc6fd2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc0155120 con 0x7f4fc0070f30 2023-07-21T22:19:22.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc556f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc00af2b0 0x7f4fc0141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:22.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc556f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc00af2b0 0x7f4fc0141330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42402/0 (socket says 172.21.15.6:42402) 2023-07-21T22:19:22.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc556f640 1 -- 172.21.15.6:0/2060176165 learned_addr learned my addr 172.21.15.6:0/2060176165 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:22.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fbffff640 1 --2- 172.21.15.6:0/2060176165 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fc0070f30 0x7f4fc01f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:22.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc4d6e640 1 --2- 172.21.15.6:0/2060176165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fc0069430 0x7f4fc0163aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:22.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc556f640 1 -- 172.21.15.6:0/2060176165 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fc0070f30 msgr2=0x7f4fc01f7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:22.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc556f640 1 --2- 172.21.15.6:0/2060176165 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fc0070f30 0x7f4fc01f7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc556f640 1 -- 172.21.15.6:0/2060176165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fc0069430 msgr2=0x7f4fc0163aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:22.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc556f640 1 --2- 172.21.15.6:0/2060176165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fc0069430 0x7f4fc0163aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.752+0000 7f4fc556f640 1 -- 172.21.15.6:0/2060176165 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb8009a70 con 0x7f4fc00af2b0 2023-07-21T22:19:22.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.756+0000 7f4fc556f640 1 --2- 172.21.15.6:0/2060176165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc00af2b0 0x7f4fc0141330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4fb801b000 tx=0x7f4fb80196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:22.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.756+0000 7f4fbd7fa640 1 -- 172.21.15.6:0/2060176165 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb80addc0 con 0x7f4fc00af2b0 2023-07-21T22:19:22.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.756+0000 7f4fbd7fa640 1 -- 172.21.15.6:0/2060176165 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb8009450 con 0x7f4fc00af2b0 2023-07-21T22:19:22.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.756+0000 7f4fc6fd2640 1 -- 172.21.15.6:0/2060176165 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc0141870 con 0x7f4fc00af2b0 2023-07-21T22:19:22.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.756+0000 7f4fbd7fa640 1 -- 172.21.15.6:0/2060176165 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb80b9650 con 0x7f4fc00af2b0 2023-07-21T22:19:22.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.756+0000 7f4fc6fd2640 1 -- 172.21.15.6:0/2060176165 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc0154ad0 con 0x7f4fc00af2b0 2023-07-21T22:19:22.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.756+0000 7f4fc6fd2640 1 -- 172.21.15.6:0/2060176165 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc01552b0 con 0x7f4fc00af2b0 2023-07-21T22:19:22.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.756+0000 7f4fbd7fa640 1 -- 172.21.15.6:0/2060176165 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4fb80039a0 con 0x7f4fc00af2b0 2023-07-21T22:19:22.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.756+0000 7f4fbd7fa640 1 --2- 172.21.15.6:0/2060176165 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4fa40662b0 0x7f4fa4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:22.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.756+0000 7f4fbd7fa640 1 -- 172.21.15.6:0/2060176165 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4fb811ee30 con 0x7f4fc00af2b0 2023-07-21T22:19:22.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.756+0000 7f4fc4d6e640 1 --2- 172.21.15.6:0/2060176165 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4fa40662b0 0x7f4fa4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:22.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.760+0000 7f4fc4d6e640 1 --2- 172.21.15.6:0/2060176165 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4fa40662b0 0x7f4fa4068760 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4007a60 tx=0x7f4fb4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:22.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.760+0000 7f4fbd7fa640 1 -- 172.21.15.6:0/2060176165 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4fb80ec350 con 0x7f4fc00af2b0 2023-07-21T22:19:22.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.916+0000 7f4fc6fd2640 1 -- 172.21.15.6:0/2060176165 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4fc00678d0 con 0x7f4fc00af2b0 2023-07-21T22:19:22.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.916+0000 7f4fbd7fa640 1 -- 172.21.15.6:0/2060176165 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4fb80b20a0 con 0x7f4fc00af2b0 2023-07-21T22:19:22.963 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:19:22.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.916+0000 7f4fc6fd2640 1 -- 172.21.15.6:0/2060176165 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4fa40662b0 msgr2=0x7f4fa4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:22.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.916+0000 7f4fc6fd2640 1 --2- 172.21.15.6:0/2060176165 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4fa40662b0 0x7f4fa4068760 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4007a60 tx=0x7f4fb4008040 comp rx=0 tx=0).stop 2023-07-21T22:19:22.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.916+0000 7f4fc6fd2640 1 -- 172.21.15.6:0/2060176165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc00af2b0 msgr2=0x7f4fc0141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:22.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.916+0000 7f4fc6fd2640 1 --2- 172.21.15.6:0/2060176165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc00af2b0 0x7f4fc0141330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4fb801b000 tx=0x7f4fb80196f0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.916+0000 7f4fc6fd2640 1 -- 172.21.15.6:0/2060176165 shutdown_connections 2023-07-21T22:19:22.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.916+0000 7f4fc6fd2640 1 --2- 172.21.15.6:0/2060176165 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4fa40662b0 0x7f4fa4068760 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.916+0000 7f4fc6fd2640 1 --2- 172.21.15.6:0/2060176165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc00af2b0 0x7f4fc0141330 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.916+0000 7f4fc6fd2640 1 --2- 172.21.15.6:0/2060176165 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fc0070f30 0x7f4fc01f7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.916+0000 7f4fc6fd2640 1 --2- 172.21.15.6:0/2060176165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fc0069430 0x7f4fc0163aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:22.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.916+0000 7f4fc6fd2640 1 -- 172.21.15.6:0/2060176165 >> 172.21.15.6:0/2060176165 conn(0x7f4fc00cde90 msgr2=0x7f4fc0158e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:22.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.920+0000 7f4fc6fd2640 1 -- 172.21.15.6:0/2060176165 shutdown_connections 2023-07-21T22:19:22.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:22.920+0000 7f4fc6fd2640 1 -- 172.21.15.6:0/2060176165 wait complete. 2023-07-21T22:19:22.984 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:19:23.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.084+0000 7f15f886d640 1 Processor -- start 2023-07-21T22:19:23.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.084+0000 7f15f886d640 1 -- start start 2023-07-21T22:19:23.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.084+0000 7f15f886d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f15f415f500 0x7f15f406cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:23.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.084+0000 7f15f886d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f15f406d430 0x7f15f406a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:23.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.084+0000 7f15f886d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f40cdc80 con 0x7f15f406aa80 2023-07-21T22:19:23.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.084+0000 7f15f886d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f406af00 con 0x7f15f415f500 2023-07-21T22:19:23.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.084+0000 7f15f886d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f406e4c0 con 0x7f15f406d430 2023-07-21T22:19:23.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.084+0000 7f15f259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f15f415f500 0x7f15f406cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:23.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.084+0000 7f15f259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f15f415f500 0x7f15f406cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42414/0 (socket says 172.21.15.6:42414) 2023-07-21T22:19:23.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.084+0000 7f15f259c640 1 -- 172.21.15.6:0/2454101145 learned_addr learned my addr 172.21.15.6:0/2454101145 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:23.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.084+0000 7f15ebfff640 1 --2- 172.21.15.6:0/2454101145 >> v2:172.21.15.161:3300/0 conn(0x7f15f406d430 0x7f15f406a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:23.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.084+0000 7f15f259c640 1 -- 172.21.15.6:0/2454101145 >> v2:172.21.15.161:3300/0 conn(0x7f15f406d430 msgr2=0x7f15f406a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:23.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.084+0000 7f15f259c640 1 --2- 172.21.15.6:0/2454101145 >> v2:172.21.15.161:3300/0 conn(0x7f15f406d430 0x7f15f406a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.084+0000 7f15f259c640 1 -- 172.21.15.6:0/2454101145 >> v1:172.21.15.161:6789/0 conn(0x7f15f406aa80 legacy=0x7f15f40b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:23.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.084+0000 7f15f259c640 1 -- 172.21.15.6:0/2454101145 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f406d940 con 0x7f15f415f500 2023-07-21T22:19:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.088+0000 7f15f259c640 1 --2- 172.21.15.6:0/2454101145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f415f500 0x7f15f406cef0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f15f40d1190 tx=0x7f15e401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ece6ee18a6d6a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.088+0000 7f15f1d9b640 1 -- 172.21.15.6:0/2454101145 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e40ab5f0 con 0x7f15f415f500 2023-07-21T22:19:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.088+0000 7f15f1d9b640 1 -- 172.21.15.6:0/2454101145 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e40ab750 con 0x7f15f415f500 2023-07-21T22:19:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.088+0000 7f15f1d9b640 1 -- 172.21.15.6:0/2454101145 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e40abae0 con 0x7f15f415f500 2023-07-21T22:19:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.088+0000 7f15f886d640 1 -- 172.21.15.6:0/2454101145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f415f500 msgr2=0x7f15f406cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.088+0000 7f15f886d640 1 --2- 172.21.15.6:0/2454101145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f415f500 0x7f15f406cef0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f15f40d1190 tx=0x7f15e401c500 comp rx=0 tx=0).stop 2023-07-21T22:19:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.088+0000 7f15f886d640 1 -- 172.21.15.6:0/2454101145 shutdown_connections 2023-07-21T22:19:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.088+0000 7f15f886d640 1 --2- 172.21.15.6:0/2454101145 >> v2:172.21.15.161:3300/0 conn(0x7f15f406d430 0x7f15f406a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.088+0000 7f15f886d640 1 --2- 172.21.15.6:0/2454101145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f415f500 0x7f15f406cef0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.088+0000 7f15f886d640 1 -- 172.21.15.6:0/2454101145 >> 172.21.15.6:0/2454101145 conn(0x7f15f40659d0 msgr2=0x7f15f4099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.088+0000 7f15f886d640 1 -- 172.21.15.6:0/2454101145 shutdown_connections 2023-07-21T22:19:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.088+0000 7f15f886d640 1 -- 172.21.15.6:0/2454101145 wait complete. 2023-07-21T22:19:23.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f886d640 1 Processor -- start 2023-07-21T22:19:23.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f886d640 1 -- start start 2023-07-21T22:19:23.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f886d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15f406aa80 0x7f15f4155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:23.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f886d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15f406d430 0x7f15f40ad200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:23.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f886d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f415f500 0x7f15f40ad740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:23.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f886d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f415ea20 con 0x7f15f415f500 2023-07-21T22:19:23.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f886d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f415de10 con 0x7f15f406d430 2023-07-21T22:19:23.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f886d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f415e0f0 con 0x7f15f406aa80 2023-07-21T22:19:23.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f415f500 0x7f15f40ad740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:23.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15ebfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15f406d430 0x7f15f40ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:23.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f415f500 0x7f15f40ad740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42426/0 (socket says 172.21.15.6:42426) 2023-07-21T22:19:23.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f2d9d640 1 -- 172.21.15.6:0/3936966801 learned_addr learned my addr 172.21.15.6:0/3936966801 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:23.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f259c640 1 --2- 172.21.15.6:0/3936966801 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15f406aa80 0x7f15f4155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:23.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f2d9d640 1 -- 172.21.15.6:0/3936966801 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15f406aa80 msgr2=0x7f15f4155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f2d9d640 1 --2- 172.21.15.6:0/3936966801 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15f406aa80 0x7f15f4155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f2d9d640 1 -- 172.21.15.6:0/3936966801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15f406d430 msgr2=0x7f15f40ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f2d9d640 1 --2- 172.21.15.6:0/3936966801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15f406d430 0x7f15f40ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f2d9d640 1 -- 172.21.15.6:0/3936966801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e4009480 con 0x7f15f415f500 2023-07-21T22:19:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15ebfff640 1 --2- 172.21.15.6:0/3936966801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15f406d430 0x7f15f40ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f2d9d640 1 --2- 172.21.15.6:0/3936966801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f415f500 0x7f15f40ad740 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00c770 tx=0x7f15ec00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15eaffd640 1 -- 172.21.15.6:0/3936966801 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec003b80 con 0x7f15f415f500 2023-07-21T22:19:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15eaffd640 1 -- 172.21.15.6:0/3936966801 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec003ce0 con 0x7f15f415f500 2023-07-21T22:19:23.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15eaffd640 1 -- 172.21.15.6:0/3936966801 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec00aa90 con 0x7f15f415f500 2023-07-21T22:19:23.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f886d640 1 -- 172.21.15.6:0/3936966801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f415e3d0 con 0x7f15f415f500 2023-07-21T22:19:23.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f886d640 1 -- 172.21.15.6:0/3936966801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f4155c60 con 0x7f15f415f500 2023-07-21T22:19:23.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.092+0000 7f15f886d640 1 -- 172.21.15.6:0/3936966801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f415ebd0 con 0x7f15f415f500 2023-07-21T22:19:23.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.096+0000 7f15eaffd640 1 -- 172.21.15.6:0/3936966801 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f15ec00abf0 con 0x7f15f415f500 2023-07-21T22:19:23.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.096+0000 7f15eaffd640 1 --2- 172.21.15.6:0/3936966801 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f15d4066280 0x7f15d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:23.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.096+0000 7f15eaffd640 1 -- 172.21.15.6:0/3936966801 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15ec083b50 con 0x7f15f415f500 2023-07-21T22:19:23.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.096+0000 7f15f259c640 1 --2- 172.21.15.6:0/3936966801 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f15d4066280 0x7f15d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:23.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.096+0000 7f15f259c640 1 --2- 172.21.15.6:0/3936966801 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f15d4066280 0x7f15d4068730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f15e40af000 tx=0x7f15e40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:23.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.100+0000 7f15eaffd640 1 -- 172.21.15.6:0/3936966801 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f15f415ebd0 con 0x7f15f415f500 2023-07-21T22:19:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.268+0000 7f15f886d640 1 -- 172.21.15.6:0/3936966801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f15f40678d0 con 0x7f15f415f500 2023-07-21T22:19:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.272+0000 7f15eaffd640 1 -- 172.21.15.6:0/3936966801 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f15ec050f50 con 0x7f15f415f500 2023-07-21T22:19:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-07-21T22:19:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.272+0000 7f15f886d640 1 -- 172.21.15.6:0/3936966801 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f15d4066280 msgr2=0x7f15d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.272+0000 7f15f886d640 1 --2- 172.21.15.6:0/3936966801 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f15d4066280 0x7f15d4068730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f15e40af000 tx=0x7f15e40a7000 comp rx=0 tx=0).stop 2023-07-21T22:19:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.272+0000 7f15f886d640 1 -- 172.21.15.6:0/3936966801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f415f500 msgr2=0x7f15f40ad740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.272+0000 7f15f886d640 1 --2- 172.21.15.6:0/3936966801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f415f500 0x7f15f40ad740 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00c770 tx=0x7f15ec00cc30 comp rx=0 tx=0).stop 2023-07-21T22:19:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.272+0000 7f15f886d640 1 -- 172.21.15.6:0/3936966801 shutdown_connections 2023-07-21T22:19:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.272+0000 7f15f886d640 1 --2- 172.21.15.6:0/3936966801 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f15d4066280 0x7f15d4068730 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.272+0000 7f15f886d640 1 --2- 172.21.15.6:0/3936966801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f415f500 0x7f15f40ad740 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.272+0000 7f15f886d640 1 --2- 172.21.15.6:0/3936966801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15f406d430 0x7f15f40ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.272+0000 7f15f886d640 1 --2- 172.21.15.6:0/3936966801 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15f406aa80 0x7f15f4155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.272+0000 7f15f886d640 1 -- 172.21.15.6:0/3936966801 >> 172.21.15.6:0/3936966801 conn(0x7f15f40659d0 msgr2=0x7f15f40ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.272+0000 7f15f886d640 1 -- 172.21.15.6:0/3936966801 shutdown_connections 2023-07-21T22:19:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.272+0000 7f15f886d640 1 -- 172.21.15.6:0/3936966801 wait complete. 2023-07-21T22:19:23.338 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-21T22:19:23.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:23.339 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-21T22:19:23.421 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:19:23.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:23.422 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T22:19:23.435 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:19:23.435 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:19:23.445 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:19:23.446 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:19:23.497 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:19:23.498 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:19:23.552 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:19:23.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.656+0000 7f36e1caf640 1 Processor -- start 2023-07-21T22:19:23.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.656+0000 7f36e1caf640 1 -- start start 2023-07-21T22:19:23.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.656+0000 7f36e1caf640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f36dc15f3f0 0x7f36dc0b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:23.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.656+0000 7f36e1caf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36dc0d13f0 0x7f36dc0b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:23.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.656+0000 7f36e1caf640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f36dc0cc9a0 0x7f36dc0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:23.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.656+0000 7f36e1caf640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36dc0d0f60 con 0x7f36dc15f3f0 2023-07-21T22:19:23.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.656+0000 7f36e1caf640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36dc0d0390 con 0x7f36dc0cc9a0 2023-07-21T22:19:23.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.656+0000 7f36e1caf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36dc0d0630 con 0x7f36dc0d13f0 2023-07-21T22:19:23.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.656+0000 7f36e0cad640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f36dc15f3f0 0x7f36dc0b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:23.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.656+0000 7f36e0cad640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f36dc15f3f0 0x7f36dc0b7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42436/0 (socket says 172.21.15.6:42436) 2023-07-21T22:19:23.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.656+0000 7f36e0cad640 1 -- 172.21.15.6:0/2041220560 learned_addr learned my addr 172.21.15.6:0/2041220560 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:23.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.656+0000 7f36dbfff640 1 --2- 172.21.15.6:0/2041220560 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36dc0d13f0 0x7f36dc0b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:23.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.656+0000 7f36e14ae640 1 --2- 172.21.15.6:0/2041220560 >> v2:172.21.15.161:3300/0 conn(0x7f36dc0cc9a0 0x7f36dc0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:23.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.656+0000 7f36e0cad640 1 -- 172.21.15.6:0/2041220560 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36dc0d13f0 msgr2=0x7f36dc0b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:23.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.656+0000 7f36e0cad640 1 --2- 172.21.15.6:0/2041220560 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36dc0d13f0 0x7f36dc0b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.656+0000 7f36e0cad640 1 -- 172.21.15.6:0/2041220560 >> v2:172.21.15.161:3300/0 conn(0x7f36dc0cc9a0 msgr2=0x7f36dc0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:23.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.656+0000 7f36e0cad640 1 --2- 172.21.15.6:0/2041220560 >> v2:172.21.15.161:3300/0 conn(0x7f36dc0cc9a0 0x7f36dc0ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.656+0000 7f36e0cad640 1 -- 172.21.15.6:0/2041220560 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36dc0d0910 con 0x7f36dc15f3f0 2023-07-21T22:19:23.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.656+0000 7f36dbfff640 1 --2- 172.21.15.6:0/2041220560 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36dc0d13f0 0x7f36dc0b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:23.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.656+0000 7f36e14ae640 1 --2- 172.21.15.6:0/2041220560 >> v2:172.21.15.161:3300/0 conn(0x7f36dc0cc9a0 0x7f36dc0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:23.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.660+0000 7f36e0cad640 1 --2- 172.21.15.6:0/2041220560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36dc15f3f0 0x7f36dc0b7680 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f36dc08a220 tx=0x7f36d001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7f4cff2b336044 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:23.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.660+0000 7f36db7fe640 1 -- 172.21.15.6:0/2041220560 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d00ab600 con 0x7f36dc15f3f0 2023-07-21T22:19:23.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.660+0000 7f36db7fe640 1 -- 172.21.15.6:0/2041220560 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d00a7050 con 0x7f36dc15f3f0 2023-07-21T22:19:23.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.660+0000 7f36db7fe640 1 -- 172.21.15.6:0/2041220560 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d00ab980 con 0x7f36dc15f3f0 2023-07-21T22:19:23.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.660+0000 7f36e1caf640 1 -- 172.21.15.6:0/2041220560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36dc15f3f0 msgr2=0x7f36dc0b7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:23.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.660+0000 7f36e1caf640 1 --2- 172.21.15.6:0/2041220560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36dc15f3f0 0x7f36dc0b7680 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f36dc08a220 tx=0x7f36d001c470 comp rx=0 tx=0).stop 2023-07-21T22:19:23.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.660+0000 7f36e1caf640 1 -- 172.21.15.6:0/2041220560 shutdown_connections 2023-07-21T22:19:23.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.660+0000 7f36e1caf640 1 --2- 172.21.15.6:0/2041220560 >> v2:172.21.15.161:3300/0 conn(0x7f36dc0cc9a0 0x7f36dc0ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.660+0000 7f36e1caf640 1 --2- 172.21.15.6:0/2041220560 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36dc0d13f0 0x7f36dc0b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.660+0000 7f36e1caf640 1 --2- 172.21.15.6:0/2041220560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36dc15f3f0 0x7f36dc0b7680 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.660+0000 7f36e1caf640 1 -- 172.21.15.6:0/2041220560 >> 172.21.15.6:0/2041220560 conn(0x7f36dc069f50 msgr2=0x7f36dc06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:23.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.660+0000 7f36e1caf640 1 -- 172.21.15.6:0/2041220560 shutdown_connections 2023-07-21T22:19:23.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.660+0000 7f36e1caf640 1 -- 172.21.15.6:0/2041220560 wait complete. 2023-07-21T22:19:23.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36e1caf640 1 Processor -- start 2023-07-21T22:19:23.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36e1caf640 1 -- start start 2023-07-21T22:19:23.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36e1caf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36dc0cc9a0 0x7f36dc14fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:23.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36e1caf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36dc0d13f0 0x7f36dc154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:23.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36e1caf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36dc15f3f0 0x7f36dc0b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:23.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36e1caf640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36dc150640 con 0x7f36dc0d13f0 2023-07-21T22:19:23.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36e1caf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36dc150920 con 0x7f36dc15f3f0 2023-07-21T22:19:23.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36e1caf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36dc150c00 con 0x7f36dc0cc9a0 2023-07-21T22:19:23.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36dbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36dc0d13f0 0x7f36dc154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:23.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36dbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36dc0d13f0 0x7f36dc154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42440/0 (socket says 172.21.15.6:42440) 2023-07-21T22:19:23.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36dbfff640 1 -- 172.21.15.6:0/1081295790 learned_addr learned my addr 172.21.15.6:0/1081295790 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:23.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36e0cad640 1 --2- 172.21.15.6:0/1081295790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36dc0cc9a0 0x7f36dc14fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:23.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36e14ae640 1 --2- 172.21.15.6:0/1081295790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36dc15f3f0 0x7f36dc0b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:23.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36dbfff640 1 -- 172.21.15.6:0/1081295790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36dc0cc9a0 msgr2=0x7f36dc14fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:23.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36dbfff640 1 --2- 172.21.15.6:0/1081295790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36dc0cc9a0 0x7f36dc14fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36dbfff640 1 -- 172.21.15.6:0/1081295790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36dc15f3f0 msgr2=0x7f36dc0b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:23.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36dbfff640 1 --2- 172.21.15.6:0/1081295790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36dc15f3f0 0x7f36dc0b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36dbfff640 1 -- 172.21.15.6:0/1081295790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d00094d0 con 0x7f36dc0d13f0 2023-07-21T22:19:23.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36dbfff640 1 --2- 172.21.15.6:0/1081295790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36dc0d13f0 0x7f36dc154940 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f36c800e810 tx=0x7f36c800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:23.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36d97fa640 1 -- 172.21.15.6:0/1081295790 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c800c8d0 con 0x7f36dc0d13f0 2023-07-21T22:19:23.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36d97fa640 1 -- 172.21.15.6:0/1081295790 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c800ca30 con 0x7f36dc0d13f0 2023-07-21T22:19:23.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36d97fa640 1 -- 172.21.15.6:0/1081295790 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c800cdc0 con 0x7f36dc0d13f0 2023-07-21T22:19:23.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36e1caf640 1 -- 172.21.15.6:0/1081295790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36dc150ee0 con 0x7f36dc0d13f0 2023-07-21T22:19:23.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36e1caf640 1 -- 172.21.15.6:0/1081295790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36dc14ff60 con 0x7f36dc0d13f0 2023-07-21T22:19:23.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.664+0000 7f36e1caf640 1 -- 172.21.15.6:0/1081295790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36dc0678d0 con 0x7f36dc0d13f0 2023-07-21T22:19:23.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.668+0000 7f36d97fa640 1 -- 172.21.15.6:0/1081295790 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f36c8013410 con 0x7f36dc0d13f0 2023-07-21T22:19:23.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.668+0000 7f36d97fa640 1 --2- 172.21.15.6:0/1081295790 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f36c00662b0 0x7f36c0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:23.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.668+0000 7f36d97fa640 1 -- 172.21.15.6:0/1081295790 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f36c8083af0 con 0x7f36dc0d13f0 2023-07-21T22:19:23.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.668+0000 7f36e0cad640 1 --2- 172.21.15.6:0/1081295790 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f36c00662b0 0x7f36c0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:23.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.668+0000 7f36e0cad640 1 --2- 172.21.15.6:0/1081295790 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f36c00662b0 0x7f36c0068760 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f36d00ad000 tx=0x7f36d00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:23.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.672+0000 7f36d97fa640 1 -- 172.21.15.6:0/1081295790 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f36c8050f40 con 0x7f36dc0d13f0 2023-07-21T22:19:23.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.827+0000 7f36e1caf640 1 -- 172.21.15.6:0/1081295790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36dc0cc5d0 con 0x7f36dc0d13f0 2023-07-21T22:19:23.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.831+0000 7f36d97fa640 1 -- 172.21.15.6:0/1081295790 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18302 (secure 0 0 0) 0x7f36c8054560 con 0x7f36dc0d13f0 2023-07-21T22:19:23.878 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:23.878 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:19:23.595355+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:18:41.465054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:18:42.709896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:19:23.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.831+0000 7f36e1caf640 1 -- 172.21.15.6:0/1081295790 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f36c00662b0 msgr2=0x7f36c0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:23.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.831+0000 7f36e1caf640 1 --2- 172.21.15.6:0/1081295790 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f36c00662b0 0x7f36c0068760 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f36d00ad000 tx=0x7f36d00a6000 comp rx=0 tx=0).stop 2023-07-21T22:19:23.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.831+0000 7f36e1caf640 1 -- 172.21.15.6:0/1081295790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36dc0d13f0 msgr2=0x7f36dc154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:23.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.831+0000 7f36e1caf640 1 --2- 172.21.15.6:0/1081295790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36dc0d13f0 0x7f36dc154940 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f36c800e810 tx=0x7f36c800ecd0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.831+0000 7f36e1caf640 1 -- 172.21.15.6:0/1081295790 shutdown_connections 2023-07-21T22:19:23.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.831+0000 7f36e1caf640 1 --2- 172.21.15.6:0/1081295790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36dc15f3f0 0x7f36dc0b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.831+0000 7f36e1caf640 1 --2- 172.21.15.6:0/1081295790 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f36c00662b0 0x7f36c0068760 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.831+0000 7f36e1caf640 1 --2- 172.21.15.6:0/1081295790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36dc0d13f0 0x7f36dc154940 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.831+0000 7f36e1caf640 1 --2- 172.21.15.6:0/1081295790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36dc0cc9a0 0x7f36dc14fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:23.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.831+0000 7f36e1caf640 1 -- 172.21.15.6:0/1081295790 >> 172.21.15.6:0/1081295790 conn(0x7f36dc069f50 msgr2=0x7f36dc157b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:23.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.831+0000 7f36e1caf640 1 -- 172.21.15.6:0/1081295790 shutdown_connections 2023-07-21T22:19:23.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.831+0000 7f36e1caf640 1 -- 172.21.15.6:0/1081295790 wait complete. 2023-07-21T22:19:23.900 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:18:41.465054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:18:42.709896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:19:23.901 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:19:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.999+0000 7fd7e08f9640 1 Processor -- start 2023-07-21T22:19:24.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.999+0000 7fd7e08f9640 1 -- start start 2023-07-21T22:19:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.999+0000 7fd7e08f9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7dc069430 0x7fd7dc069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.999+0000 7fd7e08f9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd7dc0af2b0 0x7fd7dc15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.999+0000 7fd7e08f9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7dc159d70 con 0x7fd7dc070f30 2023-07-21T22:19:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.999+0000 7fd7e08f9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7dc069d40 con 0x7fd7dc0af2b0 2023-07-21T22:19:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:23.999+0000 7fd7e08f9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc0c9c60 con 0x7fd7dc069430 2023-07-21T22:19:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.003+0000 7fd7dad9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd7dc0af2b0 0x7fd7dc15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.003+0000 7fd7da59c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7dc069430 0x7fd7dc069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.003+0000 7fd7d3fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd7dc070f30 0x7fd7dc0ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:38304/0 (socket says 172.21.15.6:38304) 2023-07-21T22:19:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.003+0000 7fd7d3fff640 1 -- 172.21.15.6:0/620866828 learned_addr learned my addr 172.21.15.6:0/620866828 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.003+0000 7fd7da59c640 1 -- 172.21.15.6:0/620866828 >> v2:172.21.15.161:3300/0 conn(0x7fd7dc0af2b0 msgr2=0x7fd7dc15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:24.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.003+0000 7fd7da59c640 1 --2- 172.21.15.6:0/620866828 >> v2:172.21.15.161:3300/0 conn(0x7fd7dc0af2b0 0x7fd7dc15a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.003+0000 7fd7da59c640 1 -- 172.21.15.6:0/620866828 >> v1:172.21.15.161:6789/0 conn(0x7fd7dc070f30 legacy=0x7fd7dc0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:24.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.003+0000 7fd7da59c640 1 -- 172.21.15.6:0/620866828 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7dc0c9f40 con 0x7fd7dc069430 2023-07-21T22:19:24.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.007+0000 7fd7da59c640 1 --2- 172.21.15.6:0/620866828 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7dc069430 0x7fd7dc069800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0097c0 tx=0x7fd7cc01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a0d1be09d10498b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:24.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.007+0000 7fd7d9d9b640 1 -- 172.21.15.6:0/620866828 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc0ad640 con 0x7fd7dc069430 2023-07-21T22:19:24.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.007+0000 7fd7d9d9b640 1 -- 172.21.15.6:0/620866828 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7cc0ad7a0 con 0x7fd7dc069430 2023-07-21T22:19:24.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.007+0000 7fd7d9d9b640 1 -- 172.21.15.6:0/620866828 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc0adb30 con 0x7fd7dc069430 2023-07-21T22:19:24.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.007+0000 7fd7e08f9640 1 -- 172.21.15.6:0/620866828 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7dc069430 msgr2=0x7fd7dc069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:24.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.007+0000 7fd7e08f9640 1 --2- 172.21.15.6:0/620866828 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7dc069430 0x7fd7dc069800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0097c0 tx=0x7fd7cc01c480 comp rx=0 tx=0).stop 2023-07-21T22:19:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.007+0000 7fd7e08f9640 1 -- 172.21.15.6:0/620866828 shutdown_connections 2023-07-21T22:19:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.007+0000 7fd7e08f9640 1 --2- 172.21.15.6:0/620866828 >> v2:172.21.15.161:3300/0 conn(0x7fd7dc0af2b0 0x7fd7dc15a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.007+0000 7fd7e08f9640 1 --2- 172.21.15.6:0/620866828 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7dc069430 0x7fd7dc069800 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.007+0000 7fd7e08f9640 1 -- 172.21.15.6:0/620866828 >> 172.21.15.6:0/620866828 conn(0x7fd7dc0cde90 msgr2=0x7fd7dc0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.007+0000 7fd7e08f9640 1 -- 172.21.15.6:0/620866828 shutdown_connections 2023-07-21T22:19:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.007+0000 7fd7e08f9640 1 -- 172.21.15.6:0/620866828 wait complete. 2023-07-21T22:19:24.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.007+0000 7fd7e08f9640 1 Processor -- start 2023-07-21T22:19:24.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.007+0000 7fd7e08f9640 1 -- start start 2023-07-21T22:19:24.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.007+0000 7fd7e08f9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7dc069430 0x7fd7dc0abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:24.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.007+0000 7fd7e08f9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7dc070f30 0x7fd7dc152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:24.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.007+0000 7fd7e08f9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7dc0af2b0 0x7fd7dc0b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:24.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.007+0000 7fd7e08f9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc151300 con 0x7fd7dc070f30 2023-07-21T22:19:24.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.007+0000 7fd7e08f9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc1515e0 con 0x7fd7dc0af2b0 2023-07-21T22:19:24.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.007+0000 7fd7e08f9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7dc1518c0 con 0x7fd7dc069430 2023-07-21T22:19:24.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.011+0000 7fd7d3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7dc070f30 0x7fd7dc152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:24.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.011+0000 7fd7da59c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7dc069430 0x7fd7dc0abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:24.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.011+0000 7fd7d3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7dc070f30 0x7fd7dc152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42446/0 (socket says 172.21.15.6:42446) 2023-07-21T22:19:24.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.011+0000 7fd7d3fff640 1 -- 172.21.15.6:0/70166389 learned_addr learned my addr 172.21.15.6:0/70166389 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:24.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.011+0000 7fd7dad9d640 1 --2- 172.21.15.6:0/70166389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7dc0af2b0 0x7fd7dc0b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:24.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.011+0000 7fd7d3fff640 1 -- 172.21.15.6:0/70166389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7dc069430 msgr2=0x7fd7dc0abbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:24.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.011+0000 7fd7d3fff640 1 --2- 172.21.15.6:0/70166389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7dc069430 0x7fd7dc0abbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.011+0000 7fd7d3fff640 1 -- 172.21.15.6:0/70166389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7dc0af2b0 msgr2=0x7fd7dc0b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:24.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.011+0000 7fd7d3fff640 1 --2- 172.21.15.6:0/70166389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7dc0af2b0 0x7fd7dc0b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.011+0000 7fd7d3fff640 1 -- 172.21.15.6:0/70166389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc009420 con 0x7fd7dc070f30 2023-07-21T22:19:24.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.011+0000 7fd7d3fff640 1 --2- 172.21.15.6:0/70166389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7dc070f30 0x7fd7dc152680 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400c500 tx=0x7fd7c400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.011+0000 7fd7d2ffd640 1 -- 172.21.15.6:0/70166389 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c4005cf0 con 0x7fd7dc070f30 2023-07-21T22:19:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.011+0000 7fd7d2ffd640 1 -- 172.21.15.6:0/70166389 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c4005e50 con 0x7fd7dc070f30 2023-07-21T22:19:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.011+0000 7fd7d2ffd640 1 -- 172.21.15.6:0/70166389 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c40072f0 con 0x7fd7dc070f30 2023-07-21T22:19:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.011+0000 7fd7e08f9640 1 -- 172.21.15.6:0/70166389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7dc151ba0 con 0x7fd7dc070f30 2023-07-21T22:19:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.011+0000 7fd7e08f9640 1 -- 172.21.15.6:0/70166389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7dc152160 con 0x7fd7dc070f30 2023-07-21T22:19:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.011+0000 7fd7e08f9640 1 -- 172.21.15.6:0/70166389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7dc1523a0 con 0x7fd7dc070f30 2023-07-21T22:19:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.011+0000 7fd7d2ffd640 1 -- 172.21.15.6:0/70166389 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd7c4007450 con 0x7fd7dc070f30 2023-07-21T22:19:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.011+0000 7fd7d2ffd640 1 --2- 172.21.15.6:0/70166389 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd7bc066280 0x7fd7bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.015+0000 7fd7d2ffd640 1 -- 172.21.15.6:0/70166389 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fd7c40830d0 con 0x7fd7dc070f30 2023-07-21T22:19:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.015+0000 7fd7da59c640 1 --2- 172.21.15.6:0/70166389 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd7bc066280 0x7fd7bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.015+0000 7fd7da59c640 1 --2- 172.21.15.6:0/70166389 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd7bc066280 0x7fd7bc068730 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0af000 tx=0x7fd7cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:24.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.015+0000 7fd7d2ffd640 1 -- 172.21.15.6:0/70166389 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd7dc1523a0 con 0x7fd7dc070f30 2023-07-21T22:19:24.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.171+0000 7fd7e08f9640 1 -- 172.21.15.6:0/70166389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd7dc159d70 con 0x7fd7dc070f30 2023-07-21T22:19:24.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.175+0000 7fd7d2ffd640 1 -- 172.21.15.6:0/70166389 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd7dc159d70 con 0x7fd7dc070f30 2023-07-21T22:19:24.222 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:19:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.175+0000 7fd7e08f9640 1 -- 172.21.15.6:0/70166389 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd7bc066280 msgr2=0x7fd7bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.175+0000 7fd7e08f9640 1 --2- 172.21.15.6:0/70166389 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd7bc066280 0x7fd7bc068730 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc0af000 tx=0x7fd7cc008040 comp rx=0 tx=0).stop 2023-07-21T22:19:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.175+0000 7fd7e08f9640 1 -- 172.21.15.6:0/70166389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7dc070f30 msgr2=0x7fd7dc152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:24.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.175+0000 7fd7e08f9640 1 --2- 172.21.15.6:0/70166389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7dc070f30 0x7fd7dc152680 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd7c400c500 tx=0x7fd7c400c9c0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.175+0000 7fd7e08f9640 1 -- 172.21.15.6:0/70166389 shutdown_connections 2023-07-21T22:19:24.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.175+0000 7fd7e08f9640 1 --2- 172.21.15.6:0/70166389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7dc0af2b0 0x7fd7dc0b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.175+0000 7fd7e08f9640 1 --2- 172.21.15.6:0/70166389 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd7bc066280 0x7fd7bc068730 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.175+0000 7fd7e08f9640 1 --2- 172.21.15.6:0/70166389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7dc070f30 0x7fd7dc152680 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.175+0000 7fd7e08f9640 1 --2- 172.21.15.6:0/70166389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7dc069430 0x7fd7dc0abbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.175+0000 7fd7e08f9640 1 -- 172.21.15.6:0/70166389 >> 172.21.15.6:0/70166389 conn(0x7fd7dc0cde90 msgr2=0x7fd7dc158c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:24.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.175+0000 7fd7e08f9640 1 -- 172.21.15.6:0/70166389 shutdown_connections 2023-07-21T22:19:24.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.175+0000 7fd7e08f9640 1 -- 172.21.15.6:0/70166389 wait complete. 2023-07-21T22:19:24.242 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:19:24.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.343+0000 7f0440a25640 1 Processor -- start 2023-07-21T22:19:24.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.343+0000 7f0440a25640 1 -- start start 2023-07-21T22:19:24.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.343+0000 7f0440a25640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f043c0b7980 0x7f043c06a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.343+0000 7f0440a25640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f043c0b42c0 0x7f043c0d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.343+0000 7f0440a25640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043c0cff30 con 0x7f043c0cee50 2023-07-21T22:19:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.343+0000 7f0440a25640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043c0cf550 con 0x7f043c0b42c0 2023-07-21T22:19:24.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.343+0000 7f0440a25640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043c0ccee0 con 0x7f043c0b7980 2023-07-21T22:19:24.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.343+0000 7f043a59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f043c0cee50 0x7f043c0b3bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34448/0 (socket says 172.21.15.6:34448) 2023-07-21T22:19:24.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.343+0000 7f043a59c640 1 -- 172.21.15.6:0/2722486121 learned_addr learned my addr 172.21.15.6:0/2722486121 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:24.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.343+0000 7f043ad9d640 1 --2- 172.21.15.6:0/2722486121 >> v2:172.21.15.161:3300/0 conn(0x7f043c0b7980 0x7f043c06a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:24.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.343+0000 7f043b59e640 1 --2- 172.21.15.6:0/2722486121 >> v2:172.21.15.6:3300/0 conn(0x7f043c0b42c0 0x7f043c0d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:24.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.343+0000 7f0439d9b640 1 -- 172.21.15.6:0/2722486121 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245097223 0 0) 0x7f043c0cff30 con 0x7f043c0cee50 2023-07-21T22:19:24.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.343+0000 7f0439d9b640 1 -- 172.21.15.6:0/2722486121 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0424003530 con 0x7f043c0cee50 2023-07-21T22:19:24.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.343+0000 7f043ad9d640 1 -- 172.21.15.6:0/2722486121 >> v2:172.21.15.6:3300/0 conn(0x7f043c0b42c0 msgr2=0x7f043c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:24.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.343+0000 7f043ad9d640 1 --2- 172.21.15.6:0/2722486121 >> v2:172.21.15.6:3300/0 conn(0x7f043c0b42c0 0x7f043c0d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.343+0000 7f043ad9d640 1 -- 172.21.15.6:0/2722486121 >> v1:172.21.15.6:6789/0 conn(0x7f043c0cee50 legacy=0x7f043c0b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:24.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.343+0000 7f043ad9d640 1 -- 172.21.15.6:0/2722486121 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c0cf2a0 con 0x7f043c0b7980 2023-07-21T22:19:24.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.347+0000 7f043ad9d640 1 --2- 172.21.15.6:0/2722486121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f043c0b7980 0x7f043c06a9b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f043c06b3c0 tx=0x7f042c01c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17dc4fe822936cd6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:24.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.347+0000 7f0439d9b640 1 -- 172.21.15.6:0/2722486121 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c0ab660 con 0x7f043c0b7980 2023-07-21T22:19:24.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.347+0000 7f0439d9b640 1 -- 172.21.15.6:0/2722486121 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042c0ab7c0 con 0x7f043c0b7980 2023-07-21T22:19:24.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.347+0000 7f0439d9b640 1 -- 172.21.15.6:0/2722486121 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c0abb50 con 0x7f043c0b7980 2023-07-21T22:19:24.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.347+0000 7f0440a25640 1 -- 172.21.15.6:0/2722486121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f043c0b7980 msgr2=0x7f043c06a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:24.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.347+0000 7f0440a25640 1 --2- 172.21.15.6:0/2722486121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f043c0b7980 0x7f043c06a9b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f043c06b3c0 tx=0x7f042c01c460 comp rx=0 tx=0).stop 2023-07-21T22:19:24.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.351+0000 7f0440a25640 1 -- 172.21.15.6:0/2722486121 shutdown_connections 2023-07-21T22:19:24.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.351+0000 7f0440a25640 1 --2- 172.21.15.6:0/2722486121 >> v2:172.21.15.6:3300/0 conn(0x7f043c0b42c0 0x7f043c0d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.351+0000 7f0440a25640 1 --2- 172.21.15.6:0/2722486121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f043c0b7980 0x7f043c06a9b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.351+0000 7f0440a25640 1 -- 172.21.15.6:0/2722486121 >> 172.21.15.6:0/2722486121 conn(0x7f043c069ea0 msgr2=0x7f043c06a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:24.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.351+0000 7f0440a25640 1 -- 172.21.15.6:0/2722486121 shutdown_connections 2023-07-21T22:19:24.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.351+0000 7f0440a25640 1 -- 172.21.15.6:0/2722486121 wait complete. 2023-07-21T22:19:24.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.351+0000 7f0440a25640 1 Processor -- start 2023-07-21T22:19:24.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.351+0000 7f0440a25640 1 -- start start 2023-07-21T22:19:24.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.351+0000 7f0440a25640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f043c0b42c0 0x7f043c0c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:24.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.351+0000 7f0440a25640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f043c0b7980 0x7f043c15a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:24.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.351+0000 7f0440a25640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f043c0cee50 0x7f043c15a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:24.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.351+0000 7f0440a25640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c15ac50 con 0x7f043c0b7980 2023-07-21T22:19:24.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.351+0000 7f0440a25640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0ca210 con 0x7f043c0b42c0 2023-07-21T22:19:24.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.351+0000 7f0440a25640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0cb7c0 con 0x7f043c0cee50 2023-07-21T22:19:24.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.351+0000 7f043a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f043c0b7980 0x7f043c15a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:24.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.351+0000 7f043a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f043c0b7980 0x7f043c15a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42468/0 (socket says 172.21.15.6:42468) 2023-07-21T22:19:24.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.351+0000 7f043a59c640 1 -- 172.21.15.6:0/3451628842 learned_addr learned my addr 172.21.15.6:0/3451628842 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:24.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.351+0000 7f043ad9d640 1 --2- 172.21.15.6:0/3451628842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f043c0b42c0 0x7f043c0c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:24.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.351+0000 7f043b59e640 1 --2- 172.21.15.6:0/3451628842 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f043c0cee50 0x7f043c15a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:24.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.355+0000 7f043a59c640 1 -- 172.21.15.6:0/3451628842 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f043c0cee50 msgr2=0x7f043c15a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:24.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.355+0000 7f043a59c640 1 --2- 172.21.15.6:0/3451628842 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f043c0cee50 0x7f043c15a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.355+0000 7f043a59c640 1 -- 172.21.15.6:0/3451628842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f043c0b42c0 msgr2=0x7f043c0c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:24.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.355+0000 7f043a59c640 1 --2- 172.21.15.6:0/3451628842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f043c0b42c0 0x7f043c0c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.355+0000 7f043a59c640 1 -- 172.21.15.6:0/3451628842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c009420 con 0x7f043c0b7980 2023-07-21T22:19:24.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.355+0000 7f043a59c640 1 --2- 172.21.15.6:0/3451628842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f043c0b7980 0x7f043c15a1d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f043000c420 tx=0x7f043000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:24.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.355+0000 7f04237fe640 1 -- 172.21.15.6:0/3451628842 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430005cf0 con 0x7f043c0b7980 2023-07-21T22:19:24.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.355+0000 7f04237fe640 1 -- 172.21.15.6:0/3451628842 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0430005e50 con 0x7f043c0b7980 2023-07-21T22:19:24.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.355+0000 7f04237fe640 1 -- 172.21.15.6:0/3451628842 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04300072d0 con 0x7f043c0b7980 2023-07-21T22:19:24.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.355+0000 7f0440a25640 1 -- 172.21.15.6:0/3451628842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043c0c9450 con 0x7f043c0b7980 2023-07-21T22:19:24.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.355+0000 7f0440a25640 1 -- 172.21.15.6:0/3451628842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043c0c9a10 con 0x7f043c0b7980 2023-07-21T22:19:24.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.355+0000 7f0440a25640 1 -- 172.21.15.6:0/3451628842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043c04e020 con 0x7f043c0b7980 2023-07-21T22:19:24.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.355+0000 7f04237fe640 1 -- 172.21.15.6:0/3451628842 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0430007430 con 0x7f043c0b7980 2023-07-21T22:19:24.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.355+0000 7f04237fe640 1 --2- 172.21.15.6:0/3451628842 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0428066280 0x7f0428068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:24.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.355+0000 7f04237fe640 1 -- 172.21.15.6:0/3451628842 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0430083310 con 0x7f043c0b7980 2023-07-21T22:19:24.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.355+0000 7f043ad9d640 1 --2- 172.21.15.6:0/3451628842 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0428066280 0x7f0428068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:24.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.359+0000 7f043ad9d640 1 --2- 172.21.15.6:0/3451628842 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0428066280 0x7f0428068730 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f042c0af000 tx=0x7f042c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:24.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.359+0000 7f04237fe640 1 -- 172.21.15.6:0/3451628842 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0430050760 con 0x7f043c0b7980 2023-07-21T22:19:24.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.515+0000 7f0440a25640 1 -- 172.21.15.6:0/3451628842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f043c0c91e0 con 0x7f043c0b7980 2023-07-21T22:19:24.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.515+0000 7f04237fe640 1 -- 172.21.15.6:0/3451628842 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0430053d80 con 0x7f043c0b7980 2023-07-21T22:19:24.563 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:19:24.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.515+0000 7f0440a25640 1 -- 172.21.15.6:0/3451628842 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0428066280 msgr2=0x7f0428068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:24.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.515+0000 7f0440a25640 1 --2- 172.21.15.6:0/3451628842 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0428066280 0x7f0428068730 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f042c0af000 tx=0x7f042c0a7000 comp rx=0 tx=0).stop 2023-07-21T22:19:24.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.515+0000 7f0440a25640 1 -- 172.21.15.6:0/3451628842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f043c0b7980 msgr2=0x7f043c15a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:24.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.515+0000 7f0440a25640 1 --2- 172.21.15.6:0/3451628842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f043c0b7980 0x7f043c15a1d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f043000c420 tx=0x7f043000c8e0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.515+0000 7f0440a25640 1 -- 172.21.15.6:0/3451628842 shutdown_connections 2023-07-21T22:19:24.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.515+0000 7f0440a25640 1 --2- 172.21.15.6:0/3451628842 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f043c0cee50 0x7f043c15a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.515+0000 7f0440a25640 1 --2- 172.21.15.6:0/3451628842 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0428066280 0x7f0428068730 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.515+0000 7f0440a25640 1 --2- 172.21.15.6:0/3451628842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f043c0b7980 0x7f043c15a1d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.515+0000 7f0440a25640 1 --2- 172.21.15.6:0/3451628842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f043c0b42c0 0x7f043c0c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.515+0000 7f0440a25640 1 -- 172.21.15.6:0/3451628842 >> 172.21.15.6:0/3451628842 conn(0x7f043c069ea0 msgr2=0x7f043c15e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:24.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.519+0000 7f0440a25640 1 -- 172.21.15.6:0/3451628842 shutdown_connections 2023-07-21T22:19:24.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.519+0000 7f0440a25640 1 -- 172.21.15.6:0/3451628842 wait complete. 2023-07-21T22:19:24.584 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:19:24.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.687+0000 7f2d4ac0b640 1 Processor -- start 2023-07-21T22:19:24.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.687+0000 7f2d4ac0b640 1 -- start start 2023-07-21T22:19:24.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.687+0000 7f2d4ac0b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2d440cba60 0x7f2d440c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:24.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.687+0000 7f2d4ac0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d4415b9c0 0x7f2d440cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:24.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.687+0000 7f2d4ac0b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d440cc370 con 0x7f2d44158090 2023-07-21T22:19:24.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.687+0000 7f2d4ac0b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d440c37e0 con 0x7f2d440cba60 2023-07-21T22:19:24.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.687+0000 7f2d4ac0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d440c3ac0 con 0x7f2d4415b9c0 2023-07-21T22:19:24.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.687+0000 7f2d491a8640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2d44158090 0x7f2d44158510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34462/0 (socket says 172.21.15.6:34462) 2023-07-21T22:19:24.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.687+0000 7f2d489a7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2d440cba60 0x7f2d440c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:24.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.687+0000 7f2d491a8640 1 -- 172.21.15.6:0/1853786866 learned_addr learned my addr 172.21.15.6:0/1853786866 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:24.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.687+0000 7f2d43fff640 1 --2- 172.21.15.6:0/1853786866 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d4415b9c0 0x7f2d440cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:24.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.687+0000 7f2d489a7640 1 -- 172.21.15.6:0/1853786866 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d4415b9c0 msgr2=0x7f2d440cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:24.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.687+0000 7f2d489a7640 1 --2- 172.21.15.6:0/1853786866 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d4415b9c0 0x7f2d440cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.687+0000 7f2d489a7640 1 -- 172.21.15.6:0/1853786866 >> v1:172.21.15.6:6789/0 conn(0x7f2d44158090 legacy=0x7f2d44158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:24.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.687+0000 7f2d489a7640 1 -- 172.21.15.6:0/1853786866 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d440c3da0 con 0x7f2d440cba60 2023-07-21T22:19:24.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.687+0000 7f2d437fe640 1 -- 172.21.15.6:0/1853786866 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650053820 0 0) 0x7f2d440cc370 con 0x7f2d44158090 2023-07-21T22:19:24.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.691+0000 7f2d489a7640 1 --2- 172.21.15.6:0/1853786866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d440cba60 0x7f2d440c3150 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2d380097c0 tx=0x7f2d3801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9f998087b28200 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:24.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.691+0000 7f2d437fe640 1 -- 172.21.15.6:0/1853786866 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d380ab600 con 0x7f2d440cba60 2023-07-21T22:19:24.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.691+0000 7f2d437fe640 1 -- 172.21.15.6:0/1853786866 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d380a7050 con 0x7f2d440cba60 2023-07-21T22:19:24.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.691+0000 7f2d437fe640 1 -- 172.21.15.6:0/1853786866 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d380ab980 con 0x7f2d440cba60 2023-07-21T22:19:24.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.691+0000 7f2d4ac0b640 1 -- 172.21.15.6:0/1853786866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d440cba60 msgr2=0x7f2d440c3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:24.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.691+0000 7f2d4ac0b640 1 --2- 172.21.15.6:0/1853786866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d440cba60 0x7f2d440c3150 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2d380097c0 tx=0x7f2d3801c330 comp rx=0 tx=0).stop 2023-07-21T22:19:24.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.691+0000 7f2d4ac0b640 1 -- 172.21.15.6:0/1853786866 shutdown_connections 2023-07-21T22:19:24.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.691+0000 7f2d4ac0b640 1 --2- 172.21.15.6:0/1853786866 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d4415b9c0 0x7f2d440cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.691+0000 7f2d4ac0b640 1 --2- 172.21.15.6:0/1853786866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d440cba60 0x7f2d440c3150 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.691+0000 7f2d4ac0b640 1 -- 172.21.15.6:0/1853786866 >> 172.21.15.6:0/1853786866 conn(0x7f2d440cde90 msgr2=0x7f2d440ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:24.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.691+0000 7f2d4ac0b640 1 -- 172.21.15.6:0/1853786866 shutdown_connections 2023-07-21T22:19:24.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.691+0000 7f2d4ac0b640 1 -- 172.21.15.6:0/1853786866 wait complete. 2023-07-21T22:19:24.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.695+0000 7f2d4ac0b640 1 Processor -- start 2023-07-21T22:19:24.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.695+0000 7f2d4ac0b640 1 -- start start 2023-07-21T22:19:24.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.695+0000 7f2d4ac0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d440cba60 0x7f2d440c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:24.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.695+0000 7f2d4ac0b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d44158090 0x7f2d4414eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:24.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.695+0000 7f2d4ac0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d4415b9c0 0x7f2d4414f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.695+0000 7f2d4ac0b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d440c6580 con 0x7f2d440cba60 2023-07-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.695+0000 7f2d4ac0b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d440c6860 con 0x7f2d44158090 2023-07-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.695+0000 7f2d4ac0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d440c6b40 con 0x7f2d4415b9c0 2023-07-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.695+0000 7f2d489a7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d440cba60 0x7f2d440c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.695+0000 7f2d489a7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d440cba60 0x7f2d440c5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42482/0 (socket says 172.21.15.6:42482) 2023-07-21T22:19:24.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.695+0000 7f2d489a7640 1 -- 172.21.15.6:0/610419348 learned_addr learned my addr 172.21.15.6:0/610419348 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:24.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.695+0000 7f2d43fff640 1 --2- 172.21.15.6:0/610419348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d44158090 0x7f2d4414eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:24.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.695+0000 7f2d491a8640 1 --2- 172.21.15.6:0/610419348 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d4415b9c0 0x7f2d4414f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:24.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.695+0000 7f2d489a7640 1 -- 172.21.15.6:0/610419348 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d4415b9c0 msgr2=0x7f2d4414f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:24.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.695+0000 7f2d489a7640 1 --2- 172.21.15.6:0/610419348 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d4415b9c0 0x7f2d4414f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.695+0000 7f2d489a7640 1 -- 172.21.15.6:0/610419348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d44158090 msgr2=0x7f2d4414eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:24.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.695+0000 7f2d489a7640 1 --2- 172.21.15.6:0/610419348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d44158090 0x7f2d4414eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.695+0000 7f2d489a7640 1 -- 172.21.15.6:0/610419348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d38009420 con 0x7f2d440cba60 2023-07-21T22:19:24.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.699+0000 7f2d489a7640 1 --2- 172.21.15.6:0/610419348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d440cba60 0x7f2d440c5aa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2d38019f60 tx=0x7f2d380190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:24.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.699+0000 7f2d417fa640 1 -- 172.21.15.6:0/610419348 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d380b4610 con 0x7f2d440cba60 2023-07-21T22:19:24.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.699+0000 7f2d417fa640 1 -- 172.21.15.6:0/610419348 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d380abe90 con 0x7f2d440cba60 2023-07-21T22:19:24.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.699+0000 7f2d4ac0b640 1 -- 172.21.15.6:0/610419348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d440c6e20 con 0x7f2d440cba60 2023-07-21T22:19:24.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.699+0000 7f2d417fa640 1 -- 172.21.15.6:0/610419348 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d380b49d0 con 0x7f2d440cba60 2023-07-21T22:19:24.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.699+0000 7f2d4ac0b640 1 -- 172.21.15.6:0/610419348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d440c7620 con 0x7f2d440cba60 2023-07-21T22:19:24.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.699+0000 7f2d4ac0b640 1 -- 172.21.15.6:0/610419348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d440714b0 con 0x7f2d440cba60 2023-07-21T22:19:24.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.699+0000 7f2d417fa640 1 -- 172.21.15.6:0/610419348 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d380b2040 con 0x7f2d440cba60 2023-07-21T22:19:24.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.699+0000 7f2d417fa640 1 --2- 172.21.15.6:0/610419348 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2d28066280 0x7f2d28068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:24.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.703+0000 7f2d417fa640 1 -- 172.21.15.6:0/610419348 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f2d3811de80 con 0x7f2d440cba60 2023-07-21T22:19:24.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.703+0000 7f2d43fff640 1 --2- 172.21.15.6:0/610419348 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2d28066280 0x7f2d28068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:24.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.703+0000 7f2d43fff640 1 --2- 172.21.15.6:0/610419348 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2d28066280 0x7f2d28068730 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2d4406dc30 tx=0x7f2d30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:24.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.707+0000 7f2d417fa640 1 -- 172.21.15.6:0/610419348 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d380eb370 con 0x7f2d440cba60 2023-07-21T22:19:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.863+0000 7f2d4ac0b640 1 -- 172.21.15.6:0/610419348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2d440678d0 con 0x7f2d440cba60 2023-07-21T22:19:24.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.863+0000 7f2d417fa640 1 -- 172.21.15.6:0/610419348 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2d380b0020 con 0x7f2d440cba60 2023-07-21T22:19:24.911 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:19:24.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.863+0000 7f2d4ac0b640 1 -- 172.21.15.6:0/610419348 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2d28066280 msgr2=0x7f2d28068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:24.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.863+0000 7f2d4ac0b640 1 --2- 172.21.15.6:0/610419348 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2d28066280 0x7f2d28068730 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2d4406dc30 tx=0x7f2d30008040 comp rx=0 tx=0).stop 2023-07-21T22:19:24.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.863+0000 7f2d4ac0b640 1 -- 172.21.15.6:0/610419348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d440cba60 msgr2=0x7f2d440c5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:24.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.863+0000 7f2d4ac0b640 1 --2- 172.21.15.6:0/610419348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d440cba60 0x7f2d440c5aa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2d38019f60 tx=0x7f2d380190d0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.863+0000 7f2d4ac0b640 1 -- 172.21.15.6:0/610419348 shutdown_connections 2023-07-21T22:19:24.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.863+0000 7f2d4ac0b640 1 --2- 172.21.15.6:0/610419348 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2d4415b9c0 0x7f2d4414f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.863+0000 7f2d4ac0b640 1 --2- 172.21.15.6:0/610419348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2d44158090 0x7f2d4414eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.863+0000 7f2d4ac0b640 1 --2- 172.21.15.6:0/610419348 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2d28066280 0x7f2d28068730 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.863+0000 7f2d4ac0b640 1 --2- 172.21.15.6:0/610419348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d440cba60 0x7f2d440c5aa0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:24.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.863+0000 7f2d4ac0b640 1 -- 172.21.15.6:0/610419348 >> 172.21.15.6:0/610419348 conn(0x7f2d440cde90 msgr2=0x7f2d4406b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:24.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.863+0000 7f2d4ac0b640 1 -- 172.21.15.6:0/610419348 shutdown_connections 2023-07-21T22:19:24.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:24.863+0000 7f2d4ac0b640 1 -- 172.21.15.6:0/610419348 wait complete. 2023-07-21T22:19:24.931 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:19:25.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.031+0000 7f1494cec640 1 Processor -- start 2023-07-21T22:19:25.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.031+0000 7f1494cec640 1 -- start start 2023-07-21T22:19:25.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.031+0000 7f1494cec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f149015bde0 0x7f14900d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:25.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.031+0000 7f1494cec640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14900b04c0 con 0x7f14900d2300 2023-07-21T22:19:25.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.031+0000 7f1494cec640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14900b1060 con 0x7f14900d2fc0 2023-07-21T22:19:25.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.031+0000 7f1494cec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149015c1b0 con 0x7f149015bde0 2023-07-21T22:19:25.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.031+0000 7f148ed9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f14900d2300 0x7f14900cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34470/0 (socket says 172.21.15.6:34470) 2023-07-21T22:19:25.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.031+0000 7f148ed9d640 1 -- 172.21.15.6:0/3973360144 learned_addr learned my addr 172.21.15.6:0/3973360144 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:25.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.031+0000 7f148e59c640 1 --2- 172.21.15.6:0/3973360144 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f149015bde0 0x7f14900d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:25.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.031+0000 7f148dd9b640 1 -- 172.21.15.6:0/3973360144 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342256665 0 0) 0x7f14900b04c0 con 0x7f14900d2300 2023-07-21T22:19:25.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.031+0000 7f148dd9b640 1 -- 172.21.15.6:0/3973360144 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f147c003530 con 0x7f14900d2300 2023-07-21T22:19:25.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.031+0000 7f148dd9b640 1 -- 172.21.15.6:0/3973360144 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759100244 0 0) 0x7f14900b1060 con 0x7f14900d2fc0 2023-07-21T22:19:25.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.031+0000 7f148dd9b640 1 -- 172.21.15.6:0/3973360144 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14900b04c0 con 0x7f14900d2fc0 2023-07-21T22:19:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.031+0000 7f148dd9b640 1 -- 172.21.15.6:0/3973360144 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 789945062 0 0) 0x7f147c003530 con 0x7f14900d2300 2023-07-21T22:19:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.031+0000 7f148dd9b640 1 -- 172.21.15.6:0/3973360144 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f149015bde0 msgr2=0x7f14900d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.031+0000 7f148dd9b640 1 --2- 172.21.15.6:0/3973360144 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f149015bde0 0x7f14900d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.031+0000 7f148dd9b640 1 -- 172.21.15.6:0/3973360144 >> v1:172.21.15.161:6789/0 conn(0x7f14900d2fc0 legacy=0x7f14900b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.035+0000 7f148dd9b640 1 -- 172.21.15.6:0/3973360144 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14900d0aa0 con 0x7f14900d2300 2023-07-21T22:19:25.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.035+0000 7f148dd9b640 1 -- 172.21.15.6:0/3973360144 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f1488001a00 con 0x7f14900d2300 2023-07-21T22:19:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.035+0000 7f148dd9b640 1 -- 172.21.15.6:0/3973360144 >> v1:172.21.15.6:6789/0 conn(0x7f14900d2300 legacy=0x7f14900cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.035+0000 7f148dd9b640 1 --2- 172.21.15.6:0/3973360144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c003b40 0x7f147c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.035+0000 7f148dd9b640 1 --2- 172.21.15.6:0/3973360144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f147c0047d0 0x7f147c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.035+0000 7f148dd9b640 1 --2- 172.21.15.6:0/3973360144 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f149015bde0 0x7f147c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.035+0000 7f148dd9b640 1 -- 172.21.15.6:0/3973360144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149015c1b0 con 0x7f147c003b40 2023-07-21T22:19:25.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.035+0000 7f148dd9b640 1 -- 172.21.15.6:0/3973360144 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147c00ba40 con 0x7f147c0047d0 2023-07-21T22:19:25.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.035+0000 7f148dd9b640 1 -- 172.21.15.6:0/3973360144 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147c00bbb0 con 0x7f149015bde0 2023-07-21T22:19:25.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.035+0000 7f148e59c640 1 --2- 172.21.15.6:0/3973360144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c003b40 0x7f147c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:25.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.035+0000 7f148ed9d640 1 --2- 172.21.15.6:0/3973360144 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f149015bde0 0x7f147c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:25.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.035+0000 7f1487fff640 1 --2- 172.21.15.6:0/3973360144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f147c0047d0 0x7f147c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:25.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.035+0000 7f148e59c640 1 -- 172.21.15.6:0/3973360144 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f149015bde0 msgr2=0x7f147c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:25.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.035+0000 7f148e59c640 1 --2- 172.21.15.6:0/3973360144 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f149015bde0 0x7f147c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:25.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.035+0000 7f148e59c640 1 -- 172.21.15.6:0/3973360144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f147c0047d0 msgr2=0x7f147c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:25.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.035+0000 7f148e59c640 1 --2- 172.21.15.6:0/3973360144 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f147c0047d0 0x7f147c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:25.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.035+0000 7f148e59c640 1 -- 172.21.15.6:0/3973360144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147c003530 con 0x7f147c003b40 2023-07-21T22:19:25.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.035+0000 7f148e59c640 1 --2- 172.21.15.6:0/3973360144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c003b40 0x7f147c003f30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1480009ac0 tx=0x7f148001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6195dc6b651e2445 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:25.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.039+0000 7f148dd9b640 1 -- 172.21.15.6:0/3973360144 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14800059a0 con 0x7f147c003b40 2023-07-21T22:19:25.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.039+0000 7f148dd9b640 1 -- 172.21.15.6:0/3973360144 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1480005b00 con 0x7f147c003b40 2023-07-21T22:19:25.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.039+0000 7f148dd9b640 1 -- 172.21.15.6:0/3973360144 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14800a5600 con 0x7f147c003b40 2023-07-21T22:19:25.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.039+0000 7f1494cec640 1 -- 172.21.15.6:0/3973360144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c003b40 msgr2=0x7f147c003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:25.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.039+0000 7f1494cec640 1 --2- 172.21.15.6:0/3973360144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c003b40 0x7f147c003f30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1480009ac0 tx=0x7f148001ca30 comp rx=0 tx=0).stop 2023-07-21T22:19:25.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.039+0000 7f148ed9d640 1 -- 172.21.15.6:0/3973360144 reap_dead start 2023-07-21T22:19:25.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.039+0000 7f1494cec640 1 -- 172.21.15.6:0/3973360144 shutdown_connections 2023-07-21T22:19:25.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.039+0000 7f1494cec640 1 -- 172.21.15.6:0/3973360144 >> 172.21.15.6:0/3973360144 conn(0x7f14900659d0 msgr2=0x7f149009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:25.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.039+0000 7f1494cec640 1 -- 172.21.15.6:0/3973360144 shutdown_connections 2023-07-21T22:19:25.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.039+0000 7f1494cec640 1 -- 172.21.15.6:0/3973360144 wait complete. 2023-07-21T22:19:25.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.039+0000 7f1494cec640 1 Processor -- start 2023-07-21T22:19:25.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.039+0000 7f1494cec640 1 -- start start 2023-07-21T22:19:25.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.039+0000 7f1494cec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c003b40 0x7f14900b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:25.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f1494cec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1490152ce0 0x7f14900b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:25.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f1494cec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14900cf210 0x7f1490152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:25.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f1494cec640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14900b4010 con 0x7f147c003b40 2023-07-21T22:19:25.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f1494cec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14900cb1a0 con 0x7f1490152ce0 2023-07-21T22:19:25.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f1494cec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14900cb480 con 0x7f14900cf210 2023-07-21T22:19:25.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f148e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c003b40 0x7f14900b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:25.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f148e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c003b40 0x7f14900b3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42498/0 (socket says 172.21.15.6:42498) 2023-07-21T22:19:25.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f148e59c640 1 -- 172.21.15.6:0/3301128303 learned_addr learned my addr 172.21.15.6:0/3301128303 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:25.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f1487fff640 1 --2- 172.21.15.6:0/3301128303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1490152ce0 0x7f14900b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:25.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f148ed9d640 1 --2- 172.21.15.6:0/3301128303 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14900cf210 0x7f1490152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:25.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f148e59c640 1 -- 172.21.15.6:0/3301128303 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14900cf210 msgr2=0x7f1490152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:25.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f148e59c640 1 --2- 172.21.15.6:0/3301128303 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14900cf210 0x7f1490152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:25.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f148e59c640 1 -- 172.21.15.6:0/3301128303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1490152ce0 msgr2=0x7f14900b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:25.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f148e59c640 1 --2- 172.21.15.6:0/3301128303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1490152ce0 0x7f14900b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:25.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f148e59c640 1 -- 172.21.15.6:0/3301128303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14900cb760 con 0x7f147c003b40 2023-07-21T22:19:25.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f148e59c640 1 --2- 172.21.15.6:0/3301128303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c003b40 0x7f14900b3a30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1480009ac0 tx=0x7f147c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:25.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f1486ffd640 1 -- 172.21.15.6:0/3301128303 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14800059a0 con 0x7f147c003b40 2023-07-21T22:19:25.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f1486ffd640 1 -- 172.21.15.6:0/3301128303 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14800a5c80 con 0x7f147c003b40 2023-07-21T22:19:25.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f1486ffd640 1 -- 172.21.15.6:0/3301128303 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480005c70 con 0x7f147c003b40 2023-07-21T22:19:25.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f1494cec640 1 -- 172.21.15.6:0/3301128303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14900cba40 con 0x7f147c003b40 2023-07-21T22:19:25.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f1494cec640 1 -- 172.21.15.6:0/3301128303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14900cf690 con 0x7f147c003b40 2023-07-21T22:19:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f1494cec640 1 -- 172.21.15.6:0/3301128303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14900cf940 con 0x7f147c003b40 2023-07-21T22:19:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.043+0000 7f1486ffd640 1 -- 172.21.15.6:0/3301128303 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1480006030 con 0x7f147c003b40 2023-07-21T22:19:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.047+0000 7f1486ffd640 1 --2- 172.21.15.6:0/3301128303 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1470066280 0x7f1470068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:25.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.047+0000 7f1486ffd640 1 -- 172.21.15.6:0/3301128303 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f148011e0d0 con 0x7f147c003b40 2023-07-21T22:19:25.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.047+0000 7f1487fff640 1 --2- 172.21.15.6:0/3301128303 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1470066280 0x7f1470068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:25.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.047+0000 7f1487fff640 1 --2- 172.21.15.6:0/3301128303 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1470066280 0x7f1470068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1478007fd0 tx=0x7f1478009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:25.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.051+0000 7f1486ffd640 1 -- 172.21.15.6:0/3301128303 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14900cf940 con 0x7f147c003b40 2023-07-21T22:19:25.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.207+0000 7f1494cec640 1 -- 172.21.15.6:0/3301128303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f14900cf940 con 0x7f147c003b40 2023-07-21T22:19:25.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.207+0000 7f1486ffd640 1 -- 172.21.15.6:0/3301128303 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f14900cf940 con 0x7f147c003b40 2023-07-21T22:19:25.255 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:19:25.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.207+0000 7f1494cec640 1 -- 172.21.15.6:0/3301128303 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1470066280 msgr2=0x7f1470068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:25.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.207+0000 7f1494cec640 1 --2- 172.21.15.6:0/3301128303 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1470066280 0x7f1470068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1478007fd0 tx=0x7f1478009040 comp rx=0 tx=0).stop 2023-07-21T22:19:25.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.207+0000 7f1494cec640 1 -- 172.21.15.6:0/3301128303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c003b40 msgr2=0x7f14900b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:25.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.207+0000 7f1494cec640 1 --2- 172.21.15.6:0/3301128303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c003b40 0x7f14900b3a30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1480009ac0 tx=0x7f147c005800 comp rx=0 tx=0).stop 2023-07-21T22:19:25.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.207+0000 7f1494cec640 1 -- 172.21.15.6:0/3301128303 shutdown_connections 2023-07-21T22:19:25.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.207+0000 7f1494cec640 1 --2- 172.21.15.6:0/3301128303 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14900cf210 0x7f1490152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:25.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.207+0000 7f1494cec640 1 --2- 172.21.15.6:0/3301128303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1490152ce0 0x7f14900b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:25.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.207+0000 7f1494cec640 1 --2- 172.21.15.6:0/3301128303 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1470066280 0x7f1470068730 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:25.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.207+0000 7f1494cec640 1 --2- 172.21.15.6:0/3301128303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f147c003b40 0x7f14900b3a30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:25.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.207+0000 7f1494cec640 1 -- 172.21.15.6:0/3301128303 >> 172.21.15.6:0/3301128303 conn(0x7f14900659d0 msgr2=0x7f14900b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:25.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.207+0000 7f1494cec640 1 -- 172.21.15.6:0/3301128303 shutdown_connections 2023-07-21T22:19:25.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.207+0000 7f1494cec640 1 -- 172.21.15.6:0/3301128303 wait complete. 2023-07-21T22:19:25.275 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:19:25.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.371+0000 7f3490cec640 1 Processor -- start 2023-07-21T22:19:25.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.371+0000 7f3490cec640 1 -- start start 2023-07-21T22:19:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.375+0000 7f3490cec640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f348c0c9730 0x7f348c1638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.375+0000 7f3490cec640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348c0cc700 con 0x7f348c0c8ad0 2023-07-21T22:19:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.375+0000 7f3490cec640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348c0b0ff0 con 0x7f348c158ce0 2023-07-21T22:19:25.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.375+0000 7f3490cec640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348c070c80 con 0x7f348c0c9730 2023-07-21T22:19:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.375+0000 7f3489d9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f348c0c8ad0 0x7f348c0c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34482/0 (socket says 172.21.15.6:34482) 2023-07-21T22:19:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.375+0000 7f3489d9b640 1 -- 172.21.15.6:0/3947069505 learned_addr learned my addr 172.21.15.6:0/3947069505 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:25.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.375+0000 7f348ad9d640 1 --2- 172.21.15.6:0/3947069505 >> v2:172.21.15.161:3300/0 conn(0x7f348c0c9730 0x7f348c1638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.375+0000 7f348959a640 1 -- 172.21.15.6:0/3947069505 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3654849233 0 0) 0x7f348c0cc700 con 0x7f348c0c8ad0 2023-07-21T22:19:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.375+0000 7f348959a640 1 -- 172.21.15.6:0/3947069505 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3474003530 con 0x7f348c0c8ad0 2023-07-21T22:19:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.375+0000 7f348959a640 1 -- 172.21.15.6:0/3947069505 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834677958 0 0) 0x7f348c0b0ff0 con 0x7f348c158ce0 2023-07-21T22:19:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.375+0000 7f348959a640 1 -- 172.21.15.6:0/3947069505 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f348c0cc700 con 0x7f348c158ce0 2023-07-21T22:19:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.375+0000 7f348959a640 1 -- 172.21.15.6:0/3947069505 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 674703632 0 0) 0x7f3474003530 con 0x7f348c0c8ad0 2023-07-21T22:19:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.375+0000 7f348ad9d640 1 -- 172.21.15.6:0/3947069505 >> v1:172.21.15.161:6789/0 conn(0x7f348c158ce0 legacy=0x7f348c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:25.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.375+0000 7f348ad9d640 1 -- 172.21.15.6:0/3947069505 >> v1:172.21.15.6:6789/0 conn(0x7f348c0c8ad0 legacy=0x7f348c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:25.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.375+0000 7f348ad9d640 1 -- 172.21.15.6:0/3947069505 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c0cbdd0 con 0x7f348c0c9730 2023-07-21T22:19:25.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.379+0000 7f348ad9d640 1 --2- 172.21.15.6:0/3947069505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f348c0c9730 0x7f348c1638b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3484009d90 tx=0x7f348401c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de8f5e8132d10ab7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:25.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.379+0000 7f348959a640 1 -- 172.21.15.6:0/3947069505 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3480001680 con 0x7f348c0c9730 2023-07-21T22:19:25.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.379+0000 7f348959a640 1 -- 172.21.15.6:0/3947069505 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34840a6470 con 0x7f348c0c9730 2023-07-21T22:19:25.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.379+0000 7f348959a640 1 -- 172.21.15.6:0/3947069505 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34840a6800 con 0x7f348c0c9730 2023-07-21T22:19:25.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.379+0000 7f3490cec640 1 -- 172.21.15.6:0/3947069505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f348c0c9730 msgr2=0x7f348c1638b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:25.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.379+0000 7f3490cec640 1 --2- 172.21.15.6:0/3947069505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f348c0c9730 0x7f348c1638b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3484009d90 tx=0x7f348401c720 comp rx=0 tx=0).stop 2023-07-21T22:19:25.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.379+0000 7f3490cec640 1 -- 172.21.15.6:0/3947069505 shutdown_connections 2023-07-21T22:19:25.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.379+0000 7f3490cec640 1 --2- 172.21.15.6:0/3947069505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f348c0c9730 0x7f348c1638b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:25.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.379+0000 7f3490cec640 1 -- 172.21.15.6:0/3947069505 >> 172.21.15.6:0/3947069505 conn(0x7f348c0afcf0 msgr2=0x7f348c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:25.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.379+0000 7f3490cec640 1 -- 172.21.15.6:0/3947069505 shutdown_connections 2023-07-21T22:19:25.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.379+0000 7f3490cec640 1 -- 172.21.15.6:0/3947069505 wait complete. 2023-07-21T22:19:25.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.379+0000 7f3490cec640 1 Processor -- start 2023-07-21T22:19:25.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.379+0000 7f3490cec640 1 -- start start 2023-07-21T22:19:25.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f3490cec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f348c0c8ad0 0x7f348c166a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:25.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f3490cec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f348c0c9730 0x7f348c0ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:25.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f3490cec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c158ce0 0x7f348c149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:25.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f3490cec640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c14e8e0 con 0x7f348c158ce0 2023-07-21T22:19:25.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f3490cec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0ac2f0 con 0x7f348c0c8ad0 2023-07-21T22:19:25.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f3490cec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0ac5d0 con 0x7f348c0c9730 2023-07-21T22:19:25.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f348ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c158ce0 0x7f348c149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:25.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f348ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c158ce0 0x7f348c149ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42500/0 (socket says 172.21.15.6:42500) 2023-07-21T22:19:25.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f348ad9d640 1 -- 172.21.15.6:0/3784892824 learned_addr learned my addr 172.21.15.6:0/3784892824 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:25.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f3489d9b640 1 --2- 172.21.15.6:0/3784892824 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f348c0c9730 0x7f348c0ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:25.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f348a59c640 1 --2- 172.21.15.6:0/3784892824 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f348c0c8ad0 0x7f348c166a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:25.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f348ad9d640 1 -- 172.21.15.6:0/3784892824 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f348c0c9730 msgr2=0x7f348c0ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:25.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f348ad9d640 1 --2- 172.21.15.6:0/3784892824 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f348c0c9730 0x7f348c0ab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:25.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f348ad9d640 1 -- 172.21.15.6:0/3784892824 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f348c0c8ad0 msgr2=0x7f348c166a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:25.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f348ad9d640 1 --2- 172.21.15.6:0/3784892824 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f348c0c8ad0 0x7f348c166a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:25.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f348ad9d640 1 -- 172.21.15.6:0/3784892824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3484009a70 con 0x7f348c158ce0 2023-07-21T22:19:25.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f348a59c640 1 --2- 172.21.15.6:0/3784892824 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f348c0c8ad0 0x7f348c166a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:25.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f348ad9d640 1 --2- 172.21.15.6:0/3784892824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c158ce0 0x7f348c149ad0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f348401cc00 tx=0x7f34840194c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:25.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f347affd640 1 -- 172.21.15.6:0/3784892824 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3484003ba0 con 0x7f348c158ce0 2023-07-21T22:19:25.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f347affd640 1 -- 172.21.15.6:0/3784892824 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34840b6040 con 0x7f348c158ce0 2023-07-21T22:19:25.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f347affd640 1 -- 172.21.15.6:0/3784892824 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34840a6e60 con 0x7f348c158ce0 2023-07-21T22:19:25.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f3490cec640 1 -- 172.21.15.6:0/3784892824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348c0ac8b0 con 0x7f348c158ce0 2023-07-21T22:19:25.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f3490cec640 1 -- 172.21.15.6:0/3784892824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348c166fd0 con 0x7f348c158ce0 2023-07-21T22:19:25.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f3490cec640 1 -- 172.21.15.6:0/3784892824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348c0ca1a0 con 0x7f348c158ce0 2023-07-21T22:19:25.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.383+0000 7f347affd640 1 -- 172.21.15.6:0/3784892824 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3484004030 con 0x7f348c158ce0 2023-07-21T22:19:25.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.387+0000 7f347affd640 1 --2- 172.21.15.6:0/3784892824 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f346c066280 0x7f346c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:25.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.387+0000 7f347affd640 1 -- 172.21.15.6:0/3784892824 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f348411dff0 con 0x7f348c158ce0 2023-07-21T22:19:25.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.387+0000 7f348a59c640 1 --2- 172.21.15.6:0/3784892824 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f346c066280 0x7f346c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:25.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.387+0000 7f348a59c640 1 --2- 172.21.15.6:0/3784892824 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f346c066280 0x7f346c068730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f347c0011f0 tx=0x7f347c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:25.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.391+0000 7f347affd640 1 -- 172.21.15.6:0/3784892824 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f34840eb3f0 con 0x7f348c158ce0 2023-07-21T22:19:25.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.555+0000 7f3490cec640 1 -- 172.21.15.6:0/3784892824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f348c14ea20 con 0x7f348c158ce0 2023-07-21T22:19:25.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.559+0000 7f347affd640 1 -- 172.21.15.6:0/3784892824 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f348c14ea20 con 0x7f348c158ce0 2023-07-21T22:19:25.605 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-07-21T22:19:25.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.559+0000 7f3490cec640 1 -- 172.21.15.6:0/3784892824 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f346c066280 msgr2=0x7f346c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:25.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.559+0000 7f3490cec640 1 --2- 172.21.15.6:0/3784892824 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f346c066280 0x7f346c068730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f347c0011f0 tx=0x7f347c009040 comp rx=0 tx=0).stop 2023-07-21T22:19:25.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.559+0000 7f3490cec640 1 -- 172.21.15.6:0/3784892824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c158ce0 msgr2=0x7f348c149ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:25.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.559+0000 7f3490cec640 1 --2- 172.21.15.6:0/3784892824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c158ce0 0x7f348c149ad0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f348401cc00 tx=0x7f34840194c0 comp rx=0 tx=0).stop 2023-07-21T22:19:25.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.559+0000 7f3490cec640 1 -- 172.21.15.6:0/3784892824 shutdown_connections 2023-07-21T22:19:25.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.559+0000 7f3490cec640 1 --2- 172.21.15.6:0/3784892824 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f346c066280 0x7f346c068730 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.559+0000 7f3490cec640 1 --2- 172.21.15.6:0/3784892824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f348c158ce0 0x7f348c149ad0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.559+0000 7f3490cec640 1 --2- 172.21.15.6:0/3784892824 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f348c0c9730 0x7f348c0ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.559+0000 7f3490cec640 1 --2- 172.21.15.6:0/3784892824 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f348c0c8ad0 0x7f348c166a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.559+0000 7f3490cec640 1 -- 172.21.15.6:0/3784892824 >> 172.21.15.6:0/3784892824 conn(0x7f348c0afcf0 msgr2=0x7f348c070dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.559+0000 7f3490cec640 1 -- 172.21.15.6:0/3784892824 shutdown_connections 2023-07-21T22:19:25.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.559+0000 7f3490cec640 1 -- 172.21.15.6:0/3784892824 wait complete. 2023-07-21T22:19:25.626 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-21T22:19:25.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:25.627 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-07-21T22:19:25.716 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-07-21T22:19:25.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:25.717 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-21T22:19:25.746 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:19:25.746 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:19:25.755 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:19:25.756 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:19:25.808 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:19:25.809 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:19:25.861 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:19:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.999+0000 7f5aa786d640 1 Processor -- start 2023-07-21T22:19:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:25.999+0000 7f5aa786d640 1 -- start start 2023-07-21T22:19:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5aa786d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa00ae1f0 0x7f5aa00b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5aa786d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5aa006e160 0x7f5aa006bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5aa786d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa006a440 con 0x7f5aa006c260 2023-07-21T22:19:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5aa786d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa006c680 con 0x7f5aa006e160 2023-07-21T22:19:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5aa786d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa00b24f0 con 0x7f5aa00ae1f0 2023-07-21T22:19:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5aa5e0a640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5aa006c260 0x7f5aa015f7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34496/0 (socket says 172.21.15.6:34496) 2023-07-21T22:19:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5aa5e0a640 1 -- 172.21.15.6:0/135497430 learned_addr learned my addr 172.21.15.6:0/135497430 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:26.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5aa5609640 1 --2- 172.21.15.6:0/135497430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa00ae1f0 0x7f5aa00b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5aa4e08640 1 --2- 172.21.15.6:0/135497430 >> v2:172.21.15.161:3300/0 conn(0x7f5aa006e160 0x7f5aa006bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5a97fff640 1 -- 172.21.15.6:0/135497430 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244544717 0 0) 0x7f5aa006a440 con 0x7f5aa006c260 2023-07-21T22:19:26.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5a97fff640 1 -- 172.21.15.6:0/135497430 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a8c003530 con 0x7f5aa006c260 2023-07-21T22:19:26.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5a97fff640 1 -- 172.21.15.6:0/135497430 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3451151909 0 0) 0x7f5a8c003530 con 0x7f5aa006c260 2023-07-21T22:19:26.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5a97fff640 1 -- 172.21.15.6:0/135497430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa00ae1f0 msgr2=0x7f5aa00b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:26.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5a97fff640 1 --2- 172.21.15.6:0/135497430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa00ae1f0 0x7f5aa00b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5a97fff640 1 -- 172.21.15.6:0/135497430 >> v2:172.21.15.161:3300/0 conn(0x7f5aa006e160 msgr2=0x7f5aa006bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:26.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5a97fff640 1 --2- 172.21.15.6:0/135497430 >> v2:172.21.15.161:3300/0 conn(0x7f5aa006e160 0x7f5aa006bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5a97fff640 1 -- 172.21.15.6:0/135497430 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa00b27d0 con 0x7f5aa006c260 2023-07-21T22:19:26.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5a97fff640 1 -- 172.21.15.6:0/135497430 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f5a98001a00 con 0x7f5aa006c260 2023-07-21T22:19:26.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5a97fff640 1 -- 172.21.15.6:0/135497430 >> v1:172.21.15.6:6789/0 conn(0x7f5aa006c260 legacy=0x7f5aa015f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5a97fff640 1 --2- 172.21.15.6:0/135497430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a8c003980 0x7f5a8c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5a97fff640 1 --2- 172.21.15.6:0/135497430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa00ae1f0 0x7f5a8c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5a97fff640 1 --2- 172.21.15.6:0/135497430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a8c004d10 0x7f5a8c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5a97fff640 1 -- 172.21.15.6:0/135497430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa006c680 con 0x7f5a8c004d10 2023-07-21T22:19:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5a97fff640 1 -- 172.21.15.6:0/135497430 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa00b24f0 con 0x7f5a8c003980 2023-07-21T22:19:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5a97fff640 1 -- 172.21.15.6:0/135497430 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c00b990 con 0x7f5aa00ae1f0 2023-07-21T22:19:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5aa5e0a640 1 --2- 172.21.15.6:0/135497430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a8c004d10 0x7f5a8c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5aa5609640 1 --2- 172.21.15.6:0/135497430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a8c003980 0x7f5a8c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5aa4e08640 1 --2- 172.21.15.6:0/135497430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa00ae1f0 0x7f5a8c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5aa5e0a640 1 -- 172.21.15.6:0/135497430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa00ae1f0 msgr2=0x7f5a8c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5aa5e0a640 1 --2- 172.21.15.6:0/135497430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa00ae1f0 0x7f5a8c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5aa5e0a640 1 -- 172.21.15.6:0/135497430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a8c003980 msgr2=0x7f5a8c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5aa5e0a640 1 --2- 172.21.15.6:0/135497430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a8c003980 0x7f5a8c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.003+0000 7f5aa5e0a640 1 -- 172.21.15.6:0/135497430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c003530 con 0x7f5a8c004d10 2023-07-21T22:19:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.007+0000 7f5aa5e0a640 1 --2- 172.21.15.6:0/135497430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a8c004d10 0x7f5a8c005180 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5a9800a860 tx=0x7f5a9801d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4312d3120712ed server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.007+0000 7f5a97fff640 1 -- 172.21.15.6:0/135497430 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a980ad630 con 0x7f5a8c004d10 2023-07-21T22:19:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.007+0000 7f5a97fff640 1 -- 172.21.15.6:0/135497430 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a980a8070 con 0x7f5a8c004d10 2023-07-21T22:19:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.007+0000 7f5a97fff640 1 -- 172.21.15.6:0/135497430 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a980ad9f0 con 0x7f5a8c004d10 2023-07-21T22:19:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.007+0000 7f5aa786d640 1 -- 172.21.15.6:0/135497430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a8c004d10 msgr2=0x7f5a8c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.007+0000 7f5aa786d640 1 --2- 172.21.15.6:0/135497430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a8c004d10 0x7f5a8c005180 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5a9800a860 tx=0x7f5a9801d300 comp rx=0 tx=0).stop 2023-07-21T22:19:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.007+0000 7f5aa5e0a640 1 -- 172.21.15.6:0/135497430 reap_dead start 2023-07-21T22:19:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.007+0000 7f5aa786d640 1 -- 172.21.15.6:0/135497430 shutdown_connections 2023-07-21T22:19:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.007+0000 7f5aa786d640 1 -- 172.21.15.6:0/135497430 >> 172.21.15.6:0/135497430 conn(0x7f5aa00b1300 msgr2=0x7f5aa00ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.007+0000 7f5aa786d640 1 -- 172.21.15.6:0/135497430 shutdown_connections 2023-07-21T22:19:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.007+0000 7f5aa786d640 1 -- 172.21.15.6:0/135497430 wait complete. 2023-07-21T22:19:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.007+0000 7f5aa786d640 1 Processor -- start 2023-07-21T22:19:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa786d640 1 -- start start 2023-07-21T22:19:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa786d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a8c004d10 0x7f5aa0140180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa786d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5aa00cd460 0x7f5aa00cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa786d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa015eb60 0x7f5aa015efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa786d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa015db30 con 0x7f5a8c004d10 2023-07-21T22:19:26.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa786d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa00cddf0 con 0x7f5aa00cd460 2023-07-21T22:19:26.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa786d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa015f510 con 0x7f5aa015eb60 2023-07-21T22:19:26.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa5609640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a8c004d10 0x7f5aa0140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa5609640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a8c004d10 0x7f5aa0140180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42518/0 (socket says 172.21.15.6:42518) 2023-07-21T22:19:26.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa5609640 1 -- 172.21.15.6:0/4166312456 learned_addr learned my addr 172.21.15.6:0/4166312456 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:26.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa4e08640 1 --2- 172.21.15.6:0/4166312456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5aa00cd460 0x7f5aa00cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa5e0a640 1 --2- 172.21.15.6:0/4166312456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa015eb60 0x7f5aa015efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa5609640 1 -- 172.21.15.6:0/4166312456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa015eb60 msgr2=0x7f5aa015efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa5609640 1 --2- 172.21.15.6:0/4166312456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa015eb60 0x7f5aa015efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa5609640 1 -- 172.21.15.6:0/4166312456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5aa00cd460 msgr2=0x7f5aa00cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa5609640 1 --2- 172.21.15.6:0/4166312456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5aa00cd460 0x7f5aa00cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa5609640 1 -- 172.21.15.6:0/4166312456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa015cc20 con 0x7f5a8c004d10 2023-07-21T22:19:26.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa5609640 1 --2- 172.21.15.6:0/4166312456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a8c004d10 0x7f5aa0140180 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c011960 tx=0x7f5a9c011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:26.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5a95ffb640 1 -- 172.21.15.6:0/4166312456 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c00fa30 con 0x7f5a8c004d10 2023-07-21T22:19:26.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5a95ffb640 1 -- 172.21.15.6:0/4166312456 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9c00fb90 con 0x7f5a8c004d10 2023-07-21T22:19:26.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5a95ffb640 1 -- 172.21.15.6:0/4166312456 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c014440 con 0x7f5a8c004d10 2023-07-21T22:19:26.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa786d640 1 -- 172.21.15.6:0/4166312456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa015ceb0 con 0x7f5a8c004d10 2023-07-21T22:19:26.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa786d640 1 -- 172.21.15.6:0/4166312456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa015d470 con 0x7f5a8c004d10 2023-07-21T22:19:26.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.011+0000 7f5aa786d640 1 -- 172.21.15.6:0/4166312456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa00b2ab0 con 0x7f5a8c004d10 2023-07-21T22:19:26.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.015+0000 7f5a95ffb640 1 -- 172.21.15.6:0/4166312456 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5a9c0145a0 con 0x7f5a8c004d10 2023-07-21T22:19:26.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.015+0000 7f5a95ffb640 1 --2- 172.21.15.6:0/4166312456 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5a84066280 0x7f5a84068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.015+0000 7f5a95ffb640 1 -- 172.21.15.6:0/4166312456 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5a9c084530 con 0x7f5a8c004d10 2023-07-21T22:19:26.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.015+0000 7f5aa4e08640 1 --2- 172.21.15.6:0/4166312456 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5a84066280 0x7f5a84068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.015+0000 7f5aa4e08640 1 --2- 172.21.15.6:0/4166312456 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5a84066280 0x7f5a84068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5aa00aeac0 tx=0x7f5a90009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.019+0000 7f5a95ffb640 1 -- 172.21.15.6:0/4166312456 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5a9c051960 con 0x7f5a8c004d10 2023-07-21T22:19:26.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.175+0000 7f5aa786d640 1 -- 172.21.15.6:0/4166312456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5aa00678d0 con 0x7f5a8c004d10 2023-07-21T22:19:26.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.175+0000 7f5a95ffb640 1 -- 172.21.15.6:0/4166312456 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18302 (secure 0 0 0) 0x7f5a9c054f80 con 0x7f5a8c004d10 2023-07-21T22:19:26.223 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:26.223 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":28,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:19:24.603032+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:18:41.465054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:18:42.709896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:19:26.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.175+0000 7f5aa786d640 1 -- 172.21.15.6:0/4166312456 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5a84066280 msgr2=0x7f5a84068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.175+0000 7f5aa786d640 1 --2- 172.21.15.6:0/4166312456 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5a84066280 0x7f5a84068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5aa00aeac0 tx=0x7f5a90009190 comp rx=0 tx=0).stop 2023-07-21T22:19:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.175+0000 7f5aa786d640 1 -- 172.21.15.6:0/4166312456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a8c004d10 msgr2=0x7f5aa0140180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.175+0000 7f5aa786d640 1 --2- 172.21.15.6:0/4166312456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a8c004d10 0x7f5aa0140180 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c011960 tx=0x7f5a9c011d60 comp rx=0 tx=0).stop 2023-07-21T22:19:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.175+0000 7f5aa786d640 1 -- 172.21.15.6:0/4166312456 shutdown_connections 2023-07-21T22:19:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.175+0000 7f5aa786d640 1 --2- 172.21.15.6:0/4166312456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa015eb60 0x7f5aa015efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.175+0000 7f5aa786d640 1 --2- 172.21.15.6:0/4166312456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5aa00cd460 0x7f5aa00cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.175+0000 7f5aa786d640 1 --2- 172.21.15.6:0/4166312456 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5a84066280 0x7f5a84068730 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.175+0000 7f5aa786d640 1 --2- 172.21.15.6:0/4166312456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a8c004d10 0x7f5aa0140180 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.175+0000 7f5aa786d640 1 -- 172.21.15.6:0/4166312456 >> 172.21.15.6:0/4166312456 conn(0x7f5aa00b1300 msgr2=0x7f5aa00ab890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:26.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.175+0000 7f5aa786d640 1 -- 172.21.15.6:0/4166312456 shutdown_connections 2023-07-21T22:19:26.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.175+0000 7f5aa786d640 1 -- 172.21.15.6:0/4166312456 wait complete. 2023-07-21T22:19:26.244 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:18:41.465054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:18:42.709896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:19:26.245 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:19:26.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.343+0000 7fbef74ca640 1 Processor -- start 2023-07-21T22:19:26.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.343+0000 7fbef74ca640 1 -- start start 2023-07-21T22:19:26.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.347+0000 7fbef74ca640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbef0160750 0x7fbef0166e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.347+0000 7fbef74ca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef00cf430 con 0x7fbef00cc960 2023-07-21T22:19:26.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.347+0000 7fbef74ca640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef015fc70 con 0x7fbef00b1620 2023-07-21T22:19:26.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.347+0000 7fbef74ca640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef00cf710 con 0x7fbef0160750 2023-07-21T22:19:26.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.347+0000 7fbef64c8640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbef00cc960 0x7fbef00ccd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34508/0 (socket says 172.21.15.6:34508) 2023-07-21T22:19:26.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.347+0000 7fbef64c8640 1 -- 172.21.15.6:0/234222279 learned_addr learned my addr 172.21.15.6:0/234222279 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:26.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.347+0000 7fbef6cc9640 1 --2- 172.21.15.6:0/234222279 >> v2:172.21.15.161:3300/0 conn(0x7fbef0160750 0x7fbef0166e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.347+0000 7fbef54c6640 1 -- 172.21.15.6:0/234222279 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39994861 0 0) 0x7fbef00cf430 con 0x7fbef00cc960 2023-07-21T22:19:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.347+0000 7fbef54c6640 1 -- 172.21.15.6:0/234222279 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbedc003530 con 0x7fbef00cc960 2023-07-21T22:19:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.347+0000 7fbef6cc9640 1 -- 172.21.15.6:0/234222279 >> v1:172.21.15.161:6789/0 conn(0x7fbef00b1620 legacy=0x7fbef00ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.347+0000 7fbef6cc9640 1 -- 172.21.15.6:0/234222279 >> v1:172.21.15.6:6789/0 conn(0x7fbef00cc960 legacy=0x7fbef00ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.347+0000 7fbef6cc9640 1 -- 172.21.15.6:0/234222279 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef015ff50 con 0x7fbef0160750 2023-07-21T22:19:26.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.351+0000 7fbef6cc9640 1 --2- 172.21.15.6:0/234222279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbef0160750 0x7fbef0166e00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009d90 tx=0x7fbee801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ba6ba1a2f6f744e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:26.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.351+0000 7fbef54c6640 1 -- 172.21.15.6:0/234222279 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee80a5a00 con 0x7fbef0160750 2023-07-21T22:19:26.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.351+0000 7fbef54c6640 1 -- 172.21.15.6:0/234222279 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee80a5b60 con 0x7fbef0160750 2023-07-21T22:19:26.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.351+0000 7fbef54c6640 1 -- 172.21.15.6:0/234222279 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee80ad440 con 0x7fbef0160750 2023-07-21T22:19:26.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.351+0000 7fbef74ca640 1 -- 172.21.15.6:0/234222279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbef0160750 msgr2=0x7fbef0166e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.351+0000 7fbef74ca640 1 --2- 172.21.15.6:0/234222279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbef0160750 0x7fbef0166e00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009d90 tx=0x7fbee801c920 comp rx=0 tx=0).stop 2023-07-21T22:19:26.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.351+0000 7fbef74ca640 1 -- 172.21.15.6:0/234222279 shutdown_connections 2023-07-21T22:19:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.351+0000 7fbef74ca640 1 --2- 172.21.15.6:0/234222279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbef0160750 0x7fbef0166e00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.351+0000 7fbef74ca640 1 -- 172.21.15.6:0/234222279 >> 172.21.15.6:0/234222279 conn(0x7fbef0069f50 msgr2=0x7fbef006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.351+0000 7fbef74ca640 1 -- 172.21.15.6:0/234222279 shutdown_connections 2023-07-21T22:19:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.351+0000 7fbef74ca640 1 -- 172.21.15.6:0/234222279 wait complete. 2023-07-21T22:19:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.351+0000 7fbef74ca640 1 Processor -- start 2023-07-21T22:19:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.351+0000 7fbef74ca640 1 -- start start 2023-07-21T22:19:26.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.351+0000 7fbef74ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbef00b1620 0x7fbef00b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.351+0000 7fbef74ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef00cc960 0x7fbef00b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.351+0000 7fbef74ca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbef0160750 0x7fbef015ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.351+0000 7fbef74ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef0159b10 con 0x7fbef00cc960 2023-07-21T22:19:26.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.351+0000 7fbef74ca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef0159d60 con 0x7fbef0160750 2023-07-21T22:19:26.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.351+0000 7fbef74ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef015a040 con 0x7fbef00b1620 2023-07-21T22:19:26.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.355+0000 7fbef5cc7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef00cc960 0x7fbef00b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.355+0000 7fbef5cc7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef00cc960 0x7fbef00b5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42532/0 (socket says 172.21.15.6:42532) 2023-07-21T22:19:26.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.355+0000 7fbef5cc7640 1 -- 172.21.15.6:0/3840993689 learned_addr learned my addr 172.21.15.6:0/3840993689 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:26.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.355+0000 7fbef64c8640 1 --2- 172.21.15.6:0/3840993689 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbef00b1620 0x7fbef00b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.355+0000 7fbef6cc9640 1 --2- 172.21.15.6:0/3840993689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbef0160750 0x7fbef015ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.355+0000 7fbef5cc7640 1 -- 172.21.15.6:0/3840993689 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbef00b1620 msgr2=0x7fbef00b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.355+0000 7fbef5cc7640 1 --2- 172.21.15.6:0/3840993689 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbef00b1620 0x7fbef00b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.355+0000 7fbef5cc7640 1 -- 172.21.15.6:0/3840993689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbef0160750 msgr2=0x7fbef015ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.355+0000 7fbef5cc7640 1 --2- 172.21.15.6:0/3840993689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbef0160750 0x7fbef015ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.355+0000 7fbef5cc7640 1 -- 172.21.15.6:0/3840993689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee8009a70 con 0x7fbef00cc960 2023-07-21T22:19:26.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.355+0000 7fbef5cc7640 1 --2- 172.21.15.6:0/3840993689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef00cc960 0x7fbef00b5c60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbee000c420 tx=0x7fbee000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:26.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.355+0000 7fbee6ffd640 1 -- 172.21.15.6:0/3840993689 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee00052d0 con 0x7fbef00cc960 2023-07-21T22:19:26.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.355+0000 7fbee6ffd640 1 -- 172.21.15.6:0/3840993689 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee0005430 con 0x7fbef00cc960 2023-07-21T22:19:26.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.355+0000 7fbee6ffd640 1 -- 172.21.15.6:0/3840993689 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee0007260 con 0x7fbef00cc960 2023-07-21T22:19:26.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.355+0000 7fbef74ca640 1 -- 172.21.15.6:0/3840993689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef015a320 con 0x7fbef00cc960 2023-07-21T22:19:26.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.355+0000 7fbef74ca640 1 -- 172.21.15.6:0/3840993689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef015a8e0 con 0x7fbef00cc960 2023-07-21T22:19:26.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.355+0000 7fbef74ca640 1 -- 172.21.15.6:0/3840993689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef004e020 con 0x7fbef00cc960 2023-07-21T22:19:26.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.355+0000 7fbee6ffd640 1 -- 172.21.15.6:0/3840993689 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbee00073c0 con 0x7fbef00cc960 2023-07-21T22:19:26.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.359+0000 7fbee6ffd640 1 --2- 172.21.15.6:0/3840993689 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbed4066280 0x7fbed4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.359+0000 7fbee6ffd640 1 -- 172.21.15.6:0/3840993689 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbee0083160 con 0x7fbef00cc960 2023-07-21T22:19:26.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.359+0000 7fbef64c8640 1 --2- 172.21.15.6:0/3840993689 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbed4066280 0x7fbed4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.359+0000 7fbef64c8640 1 --2- 172.21.15.6:0/3840993689 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbed4066280 0x7fbed4068730 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbeec005890 tx=0x7fbeec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:26.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.363+0000 7fbee6ffd640 1 -- 172.21.15.6:0/3840993689 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbee00505b0 con 0x7fbef00cc960 2023-07-21T22:19:26.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.515+0000 7fbef74ca640 1 -- 172.21.15.6:0/3840993689 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbef00cfad0 con 0x7fbef00cc960 2023-07-21T22:19:26.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.519+0000 7fbee6ffd640 1 -- 172.21.15.6:0/3840993689 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbee0053bd0 con 0x7fbef00cc960 2023-07-21T22:19:26.565 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:19:26.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.519+0000 7fbef74ca640 1 -- 172.21.15.6:0/3840993689 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbed4066280 msgr2=0x7fbed4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.519+0000 7fbef74ca640 1 --2- 172.21.15.6:0/3840993689 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbed4066280 0x7fbed4068730 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbeec005890 tx=0x7fbeec009040 comp rx=0 tx=0).stop 2023-07-21T22:19:26.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.519+0000 7fbef74ca640 1 -- 172.21.15.6:0/3840993689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef00cc960 msgr2=0x7fbef00b5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.519+0000 7fbef74ca640 1 --2- 172.21.15.6:0/3840993689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef00cc960 0x7fbef00b5c60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbee000c420 tx=0x7fbee000c8e0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.519+0000 7fbef74ca640 1 -- 172.21.15.6:0/3840993689 shutdown_connections 2023-07-21T22:19:26.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.519+0000 7fbef74ca640 1 --2- 172.21.15.6:0/3840993689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbef0160750 0x7fbef015ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.519+0000 7fbef74ca640 1 --2- 172.21.15.6:0/3840993689 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbed4066280 0x7fbed4068730 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.519+0000 7fbef74ca640 1 --2- 172.21.15.6:0/3840993689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbef00cc960 0x7fbef00b5c60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.519+0000 7fbef74ca640 1 --2- 172.21.15.6:0/3840993689 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbef00b1620 0x7fbef00b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.519+0000 7fbef74ca640 1 -- 172.21.15.6:0/3840993689 >> 172.21.15.6:0/3840993689 conn(0x7fbef0069f50 msgr2=0x7fbef0157bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:26.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.519+0000 7fbef74ca640 1 -- 172.21.15.6:0/3840993689 shutdown_connections 2023-07-21T22:19:26.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.519+0000 7fbef74ca640 1 -- 172.21.15.6:0/3840993689 wait complete. 2023-07-21T22:19:26.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:19:26.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.683+0000 7fc2f779f640 1 Processor -- start 2023-07-21T22:19:26.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.683+0000 7fc2f779f640 1 -- start start 2023-07-21T22:19:26.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2f779f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2f0070f30 0x7fc2f00ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2f779f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f0159d70 con 0x7fc2f00af2b0 2023-07-21T22:19:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2f779f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f00c9c60 con 0x7fc2f0069430 2023-07-21T22:19:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2f779f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00c9f40 con 0x7fc2f0070f30 2023-07-21T22:19:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2f5d3c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc2f00af2b0 0x7fc2f015a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34512/0 (socket says 172.21.15.6:34512) 2023-07-21T22:19:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2f5d3c640 1 -- 172.21.15.6:0/3923759315 learned_addr learned my addr 172.21.15.6:0/3923759315 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2f4d3a640 1 --2- 172.21.15.6:0/3923759315 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2f0070f30 0x7fc2f00ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2e7fff640 1 -- 172.21.15.6:0/3923759315 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3772804453 0 0) 0x7fc2e80014a0 con 0x7fc2f00af2b0 2023-07-21T22:19:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2e7fff640 1 -- 172.21.15.6:0/3923759315 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2dc003530 con 0x7fc2f00af2b0 2023-07-21T22:19:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2e7fff640 1 -- 172.21.15.6:0/3923759315 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 956816869 0 0) 0x7fc2f00c9c60 con 0x7fc2f0069430 2023-07-21T22:19:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2e7fff640 1 -- 172.21.15.6:0/3923759315 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2e80014a0 con 0x7fc2f0069430 2023-07-21T22:19:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2e7fff640 1 -- 172.21.15.6:0/3923759315 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 709690010 0 0) 0x7fc2dc003530 con 0x7fc2f00af2b0 2023-07-21T22:19:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2e7fff640 1 -- 172.21.15.6:0/3923759315 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2f0070f30 msgr2=0x7fc2f00ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2e7fff640 1 --2- 172.21.15.6:0/3923759315 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2f0070f30 0x7fc2f00ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2e7fff640 1 -- 172.21.15.6:0/3923759315 >> v1:172.21.15.161:6789/0 conn(0x7fc2f0069430 legacy=0x7fc2f0069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2e7fff640 1 -- 172.21.15.6:0/3923759315 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f00ca220 con 0x7fc2f00af2b0 2023-07-21T22:19:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2f4d3a640 1 --2- 172.21.15.6:0/3923759315 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2f0070f30 0x7fc2f00ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2e7fff640 1 -- 172.21.15.6:0/3923759315 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fc2e8001b90 con 0x7fc2f00af2b0 2023-07-21T22:19:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2e7fff640 1 -- 172.21.15.6:0/3923759315 >> v1:172.21.15.6:6789/0 conn(0x7fc2f00af2b0 legacy=0x7fc2f015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2e7fff640 1 --2- 172.21.15.6:0/3923759315 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2f0070f30 0x7fc2dc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2e7fff640 1 --2- 172.21.15.6:0/3923759315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2dc004080 0x7fc2dc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2e7fff640 1 --2- 172.21.15.6:0/3923759315 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2dc004d10 0x7fc2dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2e7fff640 1 -- 172.21.15.6:0/3923759315 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00c9f40 con 0x7fc2dc004080 2023-07-21T22:19:26.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2e7fff640 1 -- 172.21.15.6:0/3923759315 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc00ba40 con 0x7fc2dc004d10 2023-07-21T22:19:26.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2e7fff640 1 -- 172.21.15.6:0/3923759315 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc00bc00 con 0x7fc2f0070f30 2023-07-21T22:19:26.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2f4d3a640 1 --2- 172.21.15.6:0/3923759315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2dc004080 0x7fc2dc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2f553b640 1 --2- 172.21.15.6:0/3923759315 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2f0070f30 0x7fc2dc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2f5d3c640 1 --2- 172.21.15.6:0/3923759315 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2dc004d10 0x7fc2dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2f4d3a640 1 -- 172.21.15.6:0/3923759315 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2f0070f30 msgr2=0x7fc2dc003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2f4d3a640 1 --2- 172.21.15.6:0/3923759315 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2f0070f30 0x7fc2dc003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2f4d3a640 1 -- 172.21.15.6:0/3923759315 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2dc004d10 msgr2=0x7fc2dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2f4d3a640 1 --2- 172.21.15.6:0/3923759315 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2dc004d10 0x7fc2dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2f4d3a640 1 -- 172.21.15.6:0/3923759315 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e0009420 con 0x7fc2dc004080 2023-07-21T22:19:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.687+0000 7fc2f553b640 1 --2- 172.21.15.6:0/3923759315 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2f0070f30 0x7fc2dc003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:26.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.691+0000 7fc2f4d3a640 1 --2- 172.21.15.6:0/3923759315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2dc004080 0x7fc2dc0047d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009c60 tx=0x7fc2e001cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8908623a66b2ac84 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:26.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.691+0000 7fc2e7fff640 1 -- 172.21.15.6:0/3923759315 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0004030 con 0x7fc2dc004080 2023-07-21T22:19:26.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.691+0000 7fc2e7fff640 1 -- 172.21.15.6:0/3923759315 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e0004190 con 0x7fc2dc004080 2023-07-21T22:19:26.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.691+0000 7fc2e7fff640 1 -- 172.21.15.6:0/3923759315 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e00a5870 con 0x7fc2dc004080 2023-07-21T22:19:26.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.691+0000 7fc2f779f640 1 -- 172.21.15.6:0/3923759315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2dc004080 msgr2=0x7fc2dc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.691+0000 7fc2f779f640 1 --2- 172.21.15.6:0/3923759315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2dc004080 0x7fc2dc0047d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009c60 tx=0x7fc2e001cbb0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.691+0000 7fc2f5d3c640 1 -- 172.21.15.6:0/3923759315 reap_dead start 2023-07-21T22:19:26.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.691+0000 7fc2f779f640 1 -- 172.21.15.6:0/3923759315 shutdown_connections 2023-07-21T22:19:26.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.691+0000 7fc2f779f640 1 -- 172.21.15.6:0/3923759315 >> 172.21.15.6:0/3923759315 conn(0x7fc2f00cde90 msgr2=0x7fc2f00ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:26.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.691+0000 7fc2f779f640 1 -- 172.21.15.6:0/3923759315 shutdown_connections 2023-07-21T22:19:26.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.691+0000 7fc2f779f640 1 -- 172.21.15.6:0/3923759315 wait complete. 2023-07-21T22:19:26.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f779f640 1 Processor -- start 2023-07-21T22:19:26.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f779f640 1 -- start start 2023-07-21T22:19:26.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f779f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2dc004080 0x7fc2f00c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f779f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2f00c6690 0x7fc2f014ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f779f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2f0152b90 0x7fc2f00c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f779f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00c6270 con 0x7fc2f0152b90 2023-07-21T22:19:26.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f779f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f014f440 con 0x7fc2dc004080 2023-07-21T22:19:26.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f779f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f00c55f0 con 0x7fc2f00c6690 2023-07-21T22:19:26.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f5d3c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2f0152b90 0x7fc2f00c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f5d3c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2f0152b90 0x7fc2f00c6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42558/0 (socket says 172.21.15.6:42558) 2023-07-21T22:19:26.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f5d3c640 1 -- 172.21.15.6:0/246271994 learned_addr learned my addr 172.21.15.6:0/246271994 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:26.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f553b640 1 --2- 172.21.15.6:0/246271994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2dc004080 0x7fc2f00c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f4d3a640 1 --2- 172.21.15.6:0/246271994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2f00c6690 0x7fc2f014ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f5d3c640 1 -- 172.21.15.6:0/246271994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2f00c6690 msgr2=0x7fc2f014ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f5d3c640 1 --2- 172.21.15.6:0/246271994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2f00c6690 0x7fc2f014ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f5d3c640 1 -- 172.21.15.6:0/246271994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2dc004080 msgr2=0x7fc2f00c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f5d3c640 1 --2- 172.21.15.6:0/246271994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2dc004080 0x7fc2f00c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f5d3c640 1 -- 172.21.15.6:0/246271994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f00c58d0 con 0x7fc2f0152b90 2023-07-21T22:19:26.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f5d3c640 1 --2- 172.21.15.6:0/246271994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2f0152b90 0x7fc2f00c6bc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8000f90 tx=0x7fc2e8007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:26.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2e5ffb640 1 -- 172.21.15.6:0/246271994 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8010510 con 0x7fc2f0152b90 2023-07-21T22:19:26.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2e5ffb640 1 -- 172.21.15.6:0/246271994 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e8010670 con 0x7fc2f0152b90 2023-07-21T22:19:26.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2e5ffb640 1 -- 172.21.15.6:0/246271994 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8010a20 con 0x7fc2f0152b90 2023-07-21T22:19:26.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f779f640 1 -- 172.21.15.6:0/246271994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f00c5bb0 con 0x7fc2f0152b90 2023-07-21T22:19:26.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.695+0000 7fc2f779f640 1 -- 172.21.15.6:0/246271994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f0153310 con 0x7fc2f0152b90 2023-07-21T22:19:26.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.699+0000 7fc2f779f640 1 -- 172.21.15.6:0/246271994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f00678d0 con 0x7fc2f0152b90 2023-07-21T22:19:26.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.699+0000 7fc2e5ffb640 1 -- 172.21.15.6:0/246271994 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc2e8010b80 con 0x7fc2f0152b90 2023-07-21T22:19:26.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.699+0000 7fc2e5ffb640 1 --2- 172.21.15.6:0/246271994 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc2d4066280 0x7fc2d4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.699+0000 7fc2e5ffb640 1 -- 172.21.15.6:0/246271994 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc2e8083490 con 0x7fc2f0152b90 2023-07-21T22:19:26.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.699+0000 7fc2f553b640 1 --2- 172.21.15.6:0/246271994 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc2d4066280 0x7fc2d4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.699+0000 7fc2f553b640 1 --2- 172.21.15.6:0/246271994 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc2d4066280 0x7fc2d4068730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec005630 tx=0x7fc2ec007220 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:26.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.703+0000 7fc2e5ffb640 1 -- 172.21.15.6:0/246271994 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc2e8050970 con 0x7fc2f0152b90 2023-07-21T22:19:26.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.859+0000 7fc2f779f640 1 -- 172.21.15.6:0/246271994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc2f0159d40 con 0x7fc2f0152b90 2023-07-21T22:19:26.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.859+0000 7fc2e5ffb640 1 -- 172.21.15.6:0/246271994 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc2e8053f90 con 0x7fc2f0152b90 2023-07-21T22:19:26.908 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:19:26.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.863+0000 7fc2f779f640 1 -- 172.21.15.6:0/246271994 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc2d4066280 msgr2=0x7fc2d4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.863+0000 7fc2f779f640 1 --2- 172.21.15.6:0/246271994 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc2d4066280 0x7fc2d4068730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec005630 tx=0x7fc2ec007220 comp rx=0 tx=0).stop 2023-07-21T22:19:26.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.863+0000 7fc2f779f640 1 -- 172.21.15.6:0/246271994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2f0152b90 msgr2=0x7fc2f00c6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.863+0000 7fc2f779f640 1 --2- 172.21.15.6:0/246271994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2f0152b90 0x7fc2f00c6bc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8000f90 tx=0x7fc2e8007a20 comp rx=0 tx=0).stop 2023-07-21T22:19:26.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.863+0000 7fc2f779f640 1 -- 172.21.15.6:0/246271994 shutdown_connections 2023-07-21T22:19:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.863+0000 7fc2f779f640 1 --2- 172.21.15.6:0/246271994 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc2d4066280 0x7fc2d4068730 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.863+0000 7fc2f779f640 1 --2- 172.21.15.6:0/246271994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2f0152b90 0x7fc2f00c6bc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.863+0000 7fc2f779f640 1 --2- 172.21.15.6:0/246271994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2f00c6690 0x7fc2f014ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.863+0000 7fc2f779f640 1 --2- 172.21.15.6:0/246271994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2dc004080 0x7fc2f00c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.863+0000 7fc2f779f640 1 -- 172.21.15.6:0/246271994 >> 172.21.15.6:0/246271994 conn(0x7fc2f00cde90 msgr2=0x7fc2f006f270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.863+0000 7fc2f779f640 1 -- 172.21.15.6:0/246271994 shutdown_connections 2023-07-21T22:19:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:26.863+0000 7fc2f779f640 1 -- 172.21.15.6:0/246271994 wait complete. 2023-07-21T22:19:26.928 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:19:27.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.027+0000 7f0d51c6d640 1 Processor -- start 2023-07-21T22:19:27.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.027+0000 7f0d51c6d640 1 -- start start 2023-07-21T22:19:27.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.027+0000 7f0d51c6d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d4c069430 0x7f0d4c069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:27.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.027+0000 7f0d51c6d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d4c0af2b0 0x7f0d4c15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:27.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.027+0000 7f0d51c6d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d4c159d70 con 0x7f0d4c070f30 2023-07-21T22:19:27.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.027+0000 7f0d51c6d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d4c069d40 con 0x7f0d4c069430 2023-07-21T22:19:27.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.027+0000 7f0d51c6d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c0c9c60 con 0x7f0d4c0af2b0 2023-07-21T22:19:27.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.027+0000 7f0d4b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d4c069430 0x7f0d4c069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:27.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.027+0000 7f0d4affd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0d4c070f30 0x7f0d4c0ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34524/0 (socket says 172.21.15.6:34524) 2023-07-21T22:19:27.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.027+0000 7f0d4affd640 1 -- 172.21.15.6:0/316377031 learned_addr learned my addr 172.21.15.6:0/316377031 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:27.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.031+0000 7f0d4bfff640 1 --2- 172.21.15.6:0/316377031 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d4c0af2b0 0x7f0d4c15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:27.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.031+0000 7f0d4b7fe640 1 -- 172.21.15.6:0/316377031 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d4c0af2b0 msgr2=0x7f0d4c15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:27.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.031+0000 7f0d4b7fe640 1 --2- 172.21.15.6:0/316377031 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d4c0af2b0 0x7f0d4c15a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.031+0000 7f0d4b7fe640 1 -- 172.21.15.6:0/316377031 >> v1:172.21.15.6:6789/0 conn(0x7f0d4c070f30 legacy=0x7f0d4c0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.031+0000 7f0d4b7fe640 1 -- 172.21.15.6:0/316377031 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4c0c9f40 con 0x7f0d4c069430 2023-07-21T22:19:27.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.031+0000 7f0d4a7fc640 1 -- 172.21.15.6:0/316377031 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607428372 0 0) 0x7f0d40001120 con 0x7f0d4c070f30 2023-07-21T22:19:27.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.031+0000 7f0d4b7fe640 1 --2- 172.21.15.6:0/316377031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c069430 0x7f0d4c069800 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0097c0 tx=0x7f0d3c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e42c8d76c297c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:27.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.031+0000 7f0d4a7fc640 1 -- 172.21.15.6:0/316377031 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0ab680 con 0x7f0d4c069430 2023-07-21T22:19:27.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.031+0000 7f0d4a7fc640 1 -- 172.21.15.6:0/316377031 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3c0ab7e0 con 0x7f0d4c069430 2023-07-21T22:19:27.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.031+0000 7f0d4a7fc640 1 -- 172.21.15.6:0/316377031 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0abb70 con 0x7f0d4c069430 2023-07-21T22:19:27.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d51c6d640 1 -- 172.21.15.6:0/316377031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c069430 msgr2=0x7f0d4c069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d51c6d640 1 --2- 172.21.15.6:0/316377031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c069430 0x7f0d4c069800 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0097c0 tx=0x7f0d3c01c480 comp rx=0 tx=0).stop 2023-07-21T22:19:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d51c6d640 1 -- 172.21.15.6:0/316377031 shutdown_connections 2023-07-21T22:19:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d51c6d640 1 --2- 172.21.15.6:0/316377031 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d4c0af2b0 0x7f0d4c15a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d51c6d640 1 --2- 172.21.15.6:0/316377031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c069430 0x7f0d4c069800 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d51c6d640 1 -- 172.21.15.6:0/316377031 >> 172.21.15.6:0/316377031 conn(0x7f0d4c0cde90 msgr2=0x7f0d4c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d51c6d640 1 -- 172.21.15.6:0/316377031 shutdown_connections 2023-07-21T22:19:27.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d51c6d640 1 -- 172.21.15.6:0/316377031 wait complete. 2023-07-21T22:19:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d51c6d640 1 Processor -- start 2023-07-21T22:19:27.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d51c6d640 1 -- start start 2023-07-21T22:19:27.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d51c6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c069430 0x7f0d4c0c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d51c6d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d4c070f30 0x7f0d4c13f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d51c6d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d4c0af2b0 0x7f0d4c140320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d51c6d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c0c54a0 con 0x7f0d4c069430 2023-07-21T22:19:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d51c6d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c1551c0 con 0x7f0d4c0af2b0 2023-07-21T22:19:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d51c6d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4c1554a0 con 0x7f0d4c070f30 2023-07-21T22:19:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d4b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c069430 0x7f0d4c0c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:27.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d4b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c069430 0x7f0d4c0c4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42572/0 (socket says 172.21.15.6:42572) 2023-07-21T22:19:27.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d4b7fe640 1 -- 172.21.15.6:0/839437552 learned_addr learned my addr 172.21.15.6:0/839437552 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:27.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d4affd640 1 --2- 172.21.15.6:0/839437552 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d4c070f30 0x7f0d4c13f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:27.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d4bfff640 1 --2- 172.21.15.6:0/839437552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d4c0af2b0 0x7f0d4c140320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:27.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d4b7fe640 1 -- 172.21.15.6:0/839437552 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d4c070f30 msgr2=0x7f0d4c13f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d4b7fe640 1 --2- 172.21.15.6:0/839437552 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d4c070f30 0x7f0d4c13f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d4b7fe640 1 -- 172.21.15.6:0/839437552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d4c0af2b0 msgr2=0x7f0d4c140320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d4b7fe640 1 --2- 172.21.15.6:0/839437552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d4c0af2b0 0x7f0d4c140320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d4b7fe640 1 -- 172.21.15.6:0/839437552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c009420 con 0x7f0d4c069430 2023-07-21T22:19:27.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.035+0000 7f0d4bfff640 1 --2- 172.21.15.6:0/839437552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d4c0af2b0 0x7f0d4c140320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.039+0000 7f0d4b7fe640 1 --2- 172.21.15.6:0/839437552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c069430 0x7f0d4c0c4f60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0ad040 tx=0x7f0d3c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.039+0000 7f0d33fff640 1 -- 172.21.15.6:0/839437552 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0b5810 con 0x7f0d4c069430 2023-07-21T22:19:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.039+0000 7f0d33fff640 1 -- 172.21.15.6:0/839437552 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3c0b59b0 con 0x7f0d4c069430 2023-07-21T22:19:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.039+0000 7f0d33fff640 1 -- 172.21.15.6:0/839437552 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0b5d60 con 0x7f0d4c069430 2023-07-21T22:19:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.039+0000 7f0d51c6d640 1 -- 172.21.15.6:0/839437552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4c155780 con 0x7f0d4c069430 2023-07-21T22:19:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.039+0000 7f0d51c6d640 1 -- 172.21.15.6:0/839437552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4c155d40 con 0x7f0d4c069430 2023-07-21T22:19:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.039+0000 7f0d51c6d640 1 -- 172.21.15.6:0/839437552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4c0678d0 con 0x7f0d4c069430 2023-07-21T22:19:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.039+0000 7f0d33fff640 1 -- 172.21.15.6:0/839437552 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0d3c0b4390 con 0x7f0d4c069430 2023-07-21T22:19:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.039+0000 7f0d33fff640 1 --2- 172.21.15.6:0/839437552 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0d38066280 0x7f0d38068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.039+0000 7f0d33fff640 1 -- 172.21.15.6:0/839437552 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0d3c11e930 con 0x7f0d4c069430 2023-07-21T22:19:27.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.039+0000 7f0d4affd640 1 --2- 172.21.15.6:0/839437552 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0d38066280 0x7f0d38068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:27.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.043+0000 7f0d4affd640 1 --2- 172.21.15.6:0/839437552 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0d38066280 0x7f0d38068730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c151060 tx=0x7f0d400079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:27.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.043+0000 7f0d33fff640 1 -- 172.21.15.6:0/839437552 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0d3c0ebd70 con 0x7f0d4c069430 2023-07-21T22:19:27.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.199+0000 7f0d51c6d640 1 -- 172.21.15.6:0/839437552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0d4c0aeb80 con 0x7f0d4c069430 2023-07-21T22:19:27.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.199+0000 7f0d33fff640 1 -- 172.21.15.6:0/839437552 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0d3c0ef390 con 0x7f0d4c069430 2023-07-21T22:19:27.247 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:19:27.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.199+0000 7f0d51c6d640 1 -- 172.21.15.6:0/839437552 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0d38066280 msgr2=0x7f0d38068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.199+0000 7f0d51c6d640 1 --2- 172.21.15.6:0/839437552 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0d38066280 0x7f0d38068730 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c151060 tx=0x7f0d400079c0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.199+0000 7f0d51c6d640 1 -- 172.21.15.6:0/839437552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c069430 msgr2=0x7f0d4c0c4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.199+0000 7f0d51c6d640 1 --2- 172.21.15.6:0/839437552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c069430 0x7f0d4c0c4f60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0ad040 tx=0x7f0d3c01acc0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.199+0000 7f0d51c6d640 1 -- 172.21.15.6:0/839437552 shutdown_connections 2023-07-21T22:19:27.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.199+0000 7f0d51c6d640 1 --2- 172.21.15.6:0/839437552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d4c0af2b0 0x7f0d4c140320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.199+0000 7f0d51c6d640 1 --2- 172.21.15.6:0/839437552 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d4c070f30 0x7f0d4c13f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.199+0000 7f0d51c6d640 1 --2- 172.21.15.6:0/839437552 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0d38066280 0x7f0d38068730 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.199+0000 7f0d51c6d640 1 --2- 172.21.15.6:0/839437552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d4c069430 0x7f0d4c0c4f60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.199+0000 7f0d51c6d640 1 -- 172.21.15.6:0/839437552 >> 172.21.15.6:0/839437552 conn(0x7f0d4c0cde90 msgr2=0x7f0d4c06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:27.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.199+0000 7f0d51c6d640 1 -- 172.21.15.6:0/839437552 shutdown_connections 2023-07-21T22:19:27.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.199+0000 7f0d51c6d640 1 -- 172.21.15.6:0/839437552 wait complete. 2023-07-21T22:19:27.268 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:19:27.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.367+0000 7f71be819640 1 Processor -- start 2023-07-21T22:19:27.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.367+0000 7f71be819640 1 -- start start 2023-07-21T22:19:27.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.367+0000 7f71be819640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f71b8069430 0x7f71b8069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:27.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.367+0000 7f71be819640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b8159d70 con 0x7f71b80af2b0 2023-07-21T22:19:27.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.367+0000 7f71be819640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b8069d40 con 0x7f71b8070f30 2023-07-21T22:19:27.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.367+0000 7f71be819640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b80c9c60 con 0x7f71b8069430 2023-07-21T22:19:27.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.367+0000 7f71bcdb6640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f71b80af2b0 0x7f71b815a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34528/0 (socket says 172.21.15.6:34528) 2023-07-21T22:19:27.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.367+0000 7f71bcdb6640 1 -- 172.21.15.6:0/2425165563 learned_addr learned my addr 172.21.15.6:0/2425165563 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:27.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.367+0000 7f71b7fff640 1 --2- 172.21.15.6:0/2425165563 >> v2:172.21.15.161:3300/0 conn(0x7f71b8069430 0x7f71b8069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:27.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.367+0000 7f71b6ffd640 1 -- 172.21.15.6:0/2425165563 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1197524487 0 0) 0x7f71b00014a0 con 0x7f71b80af2b0 2023-07-21T22:19:27.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.367+0000 7f71b6ffd640 1 -- 172.21.15.6:0/2425165563 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71a0003530 con 0x7f71b80af2b0 2023-07-21T22:19:27.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71b6ffd640 1 -- 172.21.15.6:0/2425165563 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4284017053 0 0) 0x7f71a0003530 con 0x7f71b80af2b0 2023-07-21T22:19:27.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71b6ffd640 1 -- 172.21.15.6:0/2425165563 >> v2:172.21.15.161:3300/0 conn(0x7f71b8069430 msgr2=0x7f71b8069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:27.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71b6ffd640 1 --2- 172.21.15.6:0/2425165563 >> v2:172.21.15.161:3300/0 conn(0x7f71b8069430 0x7f71b8069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71b6ffd640 1 -- 172.21.15.6:0/2425165563 >> v1:172.21.15.161:6789/0 conn(0x7f71b8070f30 legacy=0x7f71b80ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71b6ffd640 1 -- 172.21.15.6:0/2425165563 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b80c9f40 con 0x7f71b80af2b0 2023-07-21T22:19:27.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71b6ffd640 1 -- 172.21.15.6:0/2425165563 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f71b0001b90 con 0x7f71b80af2b0 2023-07-21T22:19:27.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71b6ffd640 1 -- 172.21.15.6:0/2425165563 >> v1:172.21.15.6:6789/0 conn(0x7f71b80af2b0 legacy=0x7f71b815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71b6ffd640 1 --2- 172.21.15.6:0/2425165563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71a0003980 0x7f71a0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71b6ffd640 1 --2- 172.21.15.6:0/2425165563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71a00047d0 0x7f71a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71b6ffd640 1 --2- 172.21.15.6:0/2425165563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71a0005180 0x7f71a000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71b6ffd640 1 -- 172.21.15.6:0/2425165563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b80c9c60 con 0x7f71a0005180 2023-07-21T22:19:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71b6ffd640 1 -- 172.21.15.6:0/2425165563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a000c000 con 0x7f71a00047d0 2023-07-21T22:19:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71b6ffd640 1 -- 172.21.15.6:0/2425165563 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a000c1c0 con 0x7f71a0003980 2023-07-21T22:19:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71bcdb6640 1 --2- 172.21.15.6:0/2425165563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71a0005180 0x7f71a000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71b7fff640 1 --2- 172.21.15.6:0/2425165563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71a0003980 0x7f71a0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71b77fe640 1 --2- 172.21.15.6:0/2425165563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71a00047d0 0x7f71a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71bcdb6640 1 -- 172.21.15.6:0/2425165563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71a0003980 msgr2=0x7f71a0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71bcdb6640 1 --2- 172.21.15.6:0/2425165563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71a0003980 0x7f71a0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71bcdb6640 1 -- 172.21.15.6:0/2425165563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71a00047d0 msgr2=0x7f71a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71bcdb6640 1 --2- 172.21.15.6:0/2425165563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71a00047d0 0x7f71a0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71bcdb6640 1 -- 172.21.15.6:0/2425165563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a0003530 con 0x7f71a0005180 2023-07-21T22:19:27.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71bcdb6640 1 -- 172.21.15.6:0/2425165563 reap_dead start 2023-07-21T22:19:27.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.371+0000 7f71bcdb6640 1 --2- 172.21.15.6:0/2425165563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71a0005180 0x7f71a000b990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f71b000a830 tx=0x7f71b001d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73970932335f3ee9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.375+0000 7f71b6ffd640 1 -- 172.21.15.6:0/2425165563 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00ad630 con 0x7f71a0005180 2023-07-21T22:19:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.375+0000 7f71b6ffd640 1 -- 172.21.15.6:0/2425165563 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b00a8070 con 0x7f71a0005180 2023-07-21T22:19:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.375+0000 7f71b6ffd640 1 -- 172.21.15.6:0/2425165563 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00ad9f0 con 0x7f71a0005180 2023-07-21T22:19:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.375+0000 7f71be819640 1 -- 172.21.15.6:0/2425165563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71a0005180 msgr2=0x7f71a000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.375+0000 7f71be819640 1 --2- 172.21.15.6:0/2425165563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71a0005180 0x7f71a000b990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f71b000a830 tx=0x7f71b001d340 comp rx=0 tx=0).stop 2023-07-21T22:19:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.375+0000 7f71be819640 1 -- 172.21.15.6:0/2425165563 shutdown_connections 2023-07-21T22:19:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.375+0000 7f71be819640 1 --2- 172.21.15.6:0/2425165563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71a0005180 0x7f71a000b990 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.375+0000 7f71be819640 1 -- 172.21.15.6:0/2425165563 >> 172.21.15.6:0/2425165563 conn(0x7f71b80cde90 msgr2=0x7f71b80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.375+0000 7f71be819640 1 -- 172.21.15.6:0/2425165563 shutdown_connections 2023-07-21T22:19:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.375+0000 7f71be819640 1 -- 172.21.15.6:0/2425165563 wait complete. 2023-07-21T22:19:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.375+0000 7f71be819640 1 Processor -- start 2023-07-21T22:19:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.375+0000 7f71be819640 1 -- start start 2023-07-21T22:19:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.375+0000 7f71be819640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71a0005180 0x7f71b81f0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.375+0000 7f71be819640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71b814b980 0x7f71b80c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.375+0000 7f71be819640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71b80c7560 0x7f71b80b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.375+0000 7f71be819640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b81efee0 con 0x7f71b80c7560 2023-07-21T22:19:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.375+0000 7f71be819640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b80c79d0 con 0x7f71a0005180 2023-07-21T22:19:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.375+0000 7f71be819640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b80b3a70 con 0x7f71b814b980 2023-07-21T22:19:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.379+0000 7f71bcdb6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71b80c7560 0x7f71b80b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.379+0000 7f71bcdb6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71b80c7560 0x7f71b80b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42592/0 (socket says 172.21.15.6:42592) 2023-07-21T22:19:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.379+0000 7f71bcdb6640 1 -- 172.21.15.6:0/590836052 learned_addr learned my addr 172.21.15.6:0/590836052 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.379+0000 7f71b7fff640 1 --2- 172.21.15.6:0/590836052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71a0005180 0x7f71b81f0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.379+0000 7f71b77fe640 1 --2- 172.21.15.6:0/590836052 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71b814b980 0x7f71b80c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.379+0000 7f71bcdb6640 1 -- 172.21.15.6:0/590836052 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71b814b980 msgr2=0x7f71b80c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.379+0000 7f71bcdb6640 1 --2- 172.21.15.6:0/590836052 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71b814b980 0x7f71b80c7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.379+0000 7f71bcdb6640 1 -- 172.21.15.6:0/590836052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71a0005180 msgr2=0x7f71b81f0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.379+0000 7f71bcdb6640 1 --2- 172.21.15.6:0/590836052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71a0005180 0x7f71b81f0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.379+0000 7f71bcdb6640 1 -- 172.21.15.6:0/590836052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b81ef820 con 0x7f71b80c7560 2023-07-21T22:19:27.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.379+0000 7f71b7fff640 1 --2- 172.21.15.6:0/590836052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71a0005180 0x7f71b81f0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:27.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.379+0000 7f71bcdb6640 1 --2- 172.21.15.6:0/590836052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71b80c7560 0x7f71b80b2d80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f71b001dbe0 tx=0x7f71a0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:27.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.379+0000 7f71b4ff9640 1 -- 172.21.15.6:0/590836052 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00ad430 con 0x7f71b80c7560 2023-07-21T22:19:27.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.379+0000 7f71b4ff9640 1 -- 172.21.15.6:0/590836052 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b00ad590 con 0x7f71b80c7560 2023-07-21T22:19:27.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.379+0000 7f71b4ff9640 1 -- 172.21.15.6:0/590836052 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00ad900 con 0x7f71b80c7560 2023-07-21T22:19:27.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.379+0000 7f71be819640 1 -- 172.21.15.6:0/590836052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b81efb00 con 0x7f71b80c7560 2023-07-21T22:19:27.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.379+0000 7f71be819640 1 -- 172.21.15.6:0/590836052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b814bdf0 con 0x7f71b80c7560 2023-07-21T22:19:27.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.379+0000 7f71be819640 1 -- 172.21.15.6:0/590836052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b80678d0 con 0x7f71b80c7560 2023-07-21T22:19:27.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.379+0000 7f71b4ff9640 1 -- 172.21.15.6:0/590836052 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f71b00aa030 con 0x7f71b80c7560 2023-07-21T22:19:27.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.383+0000 7f71b4ff9640 1 --2- 172.21.15.6:0/590836052 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f71a4066280 0x7f71a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:27.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.383+0000 7f71b4ff9640 1 -- 172.21.15.6:0/590836052 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f71b011dde0 con 0x7f71b80c7560 2023-07-21T22:19:27.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.383+0000 7f71b7fff640 1 --2- 172.21.15.6:0/590836052 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f71a4066280 0x7f71a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:27.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.383+0000 7f71b7fff640 1 --2- 172.21.15.6:0/590836052 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f71a4066280 0x7f71a4068730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009ac0 tx=0x7f71a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:27.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.383+0000 7f71b4ff9640 1 -- 172.21.15.6:0/590836052 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f71b00eb210 con 0x7f71b80c7560 2023-07-21T22:19:27.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.539+0000 7f71be819640 1 -- 172.21.15.6:0/590836052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f71b8159d70 con 0x7f71b80c7560 2023-07-21T22:19:27.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.539+0000 7f71b4ff9640 1 -- 172.21.15.6:0/590836052 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f71b8159d70 con 0x7f71b80c7560 2023-07-21T22:19:27.587 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:19:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.543+0000 7f71be819640 1 -- 172.21.15.6:0/590836052 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f71a4066280 msgr2=0x7f71a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.543+0000 7f71be819640 1 --2- 172.21.15.6:0/590836052 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f71a4066280 0x7f71a4068730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009ac0 tx=0x7f71a8008040 comp rx=0 tx=0).stop 2023-07-21T22:19:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.543+0000 7f71be819640 1 -- 172.21.15.6:0/590836052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71b80c7560 msgr2=0x7f71b80b2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.543+0000 7f71be819640 1 --2- 172.21.15.6:0/590836052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71b80c7560 0x7f71b80b2d80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f71b001dbe0 tx=0x7f71a0005800 comp rx=0 tx=0).stop 2023-07-21T22:19:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.543+0000 7f71be819640 1 -- 172.21.15.6:0/590836052 shutdown_connections 2023-07-21T22:19:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.543+0000 7f71be819640 1 --2- 172.21.15.6:0/590836052 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f71a4066280 0x7f71a4068730 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.543+0000 7f71be819640 1 --2- 172.21.15.6:0/590836052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71b80c7560 0x7f71b80b2d80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.543+0000 7f71be819640 1 --2- 172.21.15.6:0/590836052 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f71b814b980 0x7f71b80c7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.543+0000 7f71be819640 1 --2- 172.21.15.6:0/590836052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f71a0005180 0x7f71b81f0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.543+0000 7f71be819640 1 -- 172.21.15.6:0/590836052 >> 172.21.15.6:0/590836052 conn(0x7f71b80cde90 msgr2=0x7f71b8157cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:27.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.543+0000 7f71be819640 1 -- 172.21.15.6:0/590836052 shutdown_connections 2023-07-21T22:19:27.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.543+0000 7f71be819640 1 -- 172.21.15.6:0/590836052 wait complete. 2023-07-21T22:19:27.609 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:19:27.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.707+0000 7fc6bd900640 1 Processor -- start 2023-07-21T22:19:27.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.707+0000 7fc6bd900640 1 -- start start 2023-07-21T22:19:27.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.711+0000 7fc6bd900640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6b8070b70 0x7fc6b8070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:27.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.711+0000 7fc6bd900640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6b806b1e0 0x7fc6b80c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:27.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.711+0000 7fc6bd900640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b80cac70 con 0x7fc6b80c21f0 2023-07-21T22:19:27.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.711+0000 7fc6bd900640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b8071480 con 0x7fc6b8070b70 2023-07-21T22:19:27.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.711+0000 7fc6bd900640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b80ca060 con 0x7fc6b806b1e0 2023-07-21T22:19:27.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.711+0000 7fc6b6ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6b8070b70 0x7fc6b8070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:27.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.711+0000 7fc6b77fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc6b80c21f0 0x7fc6b80cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58520/0 (socket says 172.21.15.6:58520) 2023-07-21T22:19:27.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.711+0000 7fc6b77fe640 1 -- 172.21.15.6:0/152339123 learned_addr learned my addr 172.21.15.6:0/152339123 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:27.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.711+0000 7fc6affff640 1 --2- 172.21.15.6:0/152339123 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6b806b1e0 0x7fc6b80c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:27.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.711+0000 7fc6b6ffd640 1 -- 172.21.15.6:0/152339123 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6b806b1e0 msgr2=0x7fc6b80c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:27.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.711+0000 7fc6b6ffd640 1 --2- 172.21.15.6:0/152339123 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6b806b1e0 0x7fc6b80c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.711+0000 7fc6b6ffd640 1 -- 172.21.15.6:0/152339123 >> v1:172.21.15.6:6789/0 conn(0x7fc6b80c21f0 legacy=0x7fc6b80cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.711+0000 7fc6b6ffd640 1 -- 172.21.15.6:0/152339123 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b80ca340 con 0x7fc6b8070b70 2023-07-21T22:19:27.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.711+0000 7fc6b67fc640 1 -- 172.21.15.6:0/152339123 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3839452011 0 0) 0x7fc6b80cac70 con 0x7fc6b80c21f0 2023-07-21T22:19:27.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.715+0000 7fc6b6ffd640 1 --2- 172.21.15.6:0/152339123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b8070b70 0x7fc6b8070f40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80097c0 tx=0x7fc6a801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de803c7ef009ee6e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:27.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.715+0000 7fc6b67fc640 1 -- 172.21.15.6:0/152339123 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a80ac640 con 0x7fc6b8070b70 2023-07-21T22:19:27.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.715+0000 7fc6b67fc640 1 -- 172.21.15.6:0/152339123 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a80ac7a0 con 0x7fc6b8070b70 2023-07-21T22:19:27.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.715+0000 7fc6b67fc640 1 -- 172.21.15.6:0/152339123 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a80acb30 con 0x7fc6b8070b70 2023-07-21T22:19:27.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.715+0000 7fc6bd900640 1 -- 172.21.15.6:0/152339123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b8070b70 msgr2=0x7fc6b8070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.715+0000 7fc6bd900640 1 --2- 172.21.15.6:0/152339123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b8070b70 0x7fc6b8070f40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80097c0 tx=0x7fc6a801c3e0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.715+0000 7fc6bd900640 1 -- 172.21.15.6:0/152339123 shutdown_connections 2023-07-21T22:19:27.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.715+0000 7fc6bd900640 1 --2- 172.21.15.6:0/152339123 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6b806b1e0 0x7fc6b80c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.715+0000 7fc6bd900640 1 --2- 172.21.15.6:0/152339123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b8070b70 0x7fc6b8070f40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.715+0000 7fc6bd900640 1 -- 172.21.15.6:0/152339123 >> 172.21.15.6:0/152339123 conn(0x7fc6b80afcf0 msgr2=0x7fc6b80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:27.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.715+0000 7fc6bd900640 1 -- 172.21.15.6:0/152339123 shutdown_connections 2023-07-21T22:19:27.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.715+0000 7fc6bd900640 1 -- 172.21.15.6:0/152339123 wait complete. 2023-07-21T22:19:27.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.715+0000 7fc6bd900640 1 Processor -- start 2023-07-21T22:19:27.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.715+0000 7fc6bd900640 1 -- start start 2023-07-21T22:19:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6bd900640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6b806b1e0 0x7fc6b81550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6bd900640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6b8070b70 0x7fc6b80cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:27.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6bd900640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b80c21f0 0x7fc6b814f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:27.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6bd900640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b80cc9e0 con 0x7fc6b80c21f0 2023-07-21T22:19:27.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6bd900640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b80cccc0 con 0x7fc6b806b1e0 2023-07-21T22:19:27.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6bd900640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b80ccfa0 con 0x7fc6b8070b70 2023-07-21T22:19:27.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6b77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b80c21f0 0x7fc6b814f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:27.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6b77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b80c21f0 0x7fc6b814f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33052/0 (socket says 172.21.15.6:33052) 2023-07-21T22:19:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6b77fe640 1 -- 172.21.15.6:0/776784523 learned_addr learned my addr 172.21.15.6:0/776784523 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6affff640 1 --2- 172.21.15.6:0/776784523 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6b8070b70 0x7fc6b80cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6b6ffd640 1 --2- 172.21.15.6:0/776784523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6b806b1e0 0x7fc6b81550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6b77fe640 1 -- 172.21.15.6:0/776784523 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6b8070b70 msgr2=0x7fc6b80cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6b77fe640 1 --2- 172.21.15.6:0/776784523 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6b8070b70 0x7fc6b80cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6b77fe640 1 -- 172.21.15.6:0/776784523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6b806b1e0 msgr2=0x7fc6b81550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6b77fe640 1 --2- 172.21.15.6:0/776784523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6b806b1e0 0x7fc6b81550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6b77fe640 1 -- 172.21.15.6:0/776784523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a8009420 con 0x7fc6b80c21f0 2023-07-21T22:19:27.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6b77fe640 1 --2- 172.21.15.6:0/776784523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b80c21f0 0x7fc6b814f650 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000c780 tx=0x7fc6b000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:27.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6b4ff9640 1 -- 172.21.15.6:0/776784523 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0004d70 con 0x7fc6b80c21f0 2023-07-21T22:19:27.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6b4ff9640 1 -- 172.21.15.6:0/776784523 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b000a640 con 0x7fc6b80c21f0 2023-07-21T22:19:27.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6b4ff9640 1 -- 172.21.15.6:0/776784523 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000a9f0 con 0x7fc6b80c21f0 2023-07-21T22:19:27.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6bd900640 1 -- 172.21.15.6:0/776784523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b80cd280 con 0x7fc6b80c21f0 2023-07-21T22:19:27.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6bd900640 1 -- 172.21.15.6:0/776784523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b81573c0 con 0x7fc6b80c21f0 2023-07-21T22:19:27.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6bd900640 1 -- 172.21.15.6:0/776784523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b80678d0 con 0x7fc6b80c21f0 2023-07-21T22:19:27.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.719+0000 7fc6b4ff9640 1 -- 172.21.15.6:0/776784523 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc6b000ab50 con 0x7fc6b80c21f0 2023-07-21T22:19:27.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.723+0000 7fc6b4ff9640 1 --2- 172.21.15.6:0/776784523 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc698066280 0x7fc698068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:27.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.723+0000 7fc6b4ff9640 1 -- 172.21.15.6:0/776784523 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc6b0083240 con 0x7fc6b80c21f0 2023-07-21T22:19:27.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.723+0000 7fc6b6ffd640 1 --2- 172.21.15.6:0/776784523 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc698066280 0x7fc698068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:27.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.723+0000 7fc6b6ffd640 1 --2- 172.21.15.6:0/776784523 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc698066280 0x7fc698068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80ae000 tx=0x7fc6a80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:27.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.727+0000 7fc6b4ff9640 1 -- 172.21.15.6:0/776784523 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6b0050690 con 0x7fc6b80c21f0 2023-07-21T22:19:27.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.891+0000 7fc6bd900640 1 -- 172.21.15.6:0/776784523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc6b80cd730 con 0x7fc6b80c21f0 2023-07-21T22:19:27.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.891+0000 7fc6b4ff9640 1 -- 172.21.15.6:0/776784523 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc6b0053cb0 con 0x7fc6b80c21f0 2023-07-21T22:19:27.941 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-07-21T22:19:27.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.895+0000 7fc6bd900640 1 -- 172.21.15.6:0/776784523 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc698066280 msgr2=0x7fc698068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.895+0000 7fc6bd900640 1 --2- 172.21.15.6:0/776784523 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc698066280 0x7fc698068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc6a80ae000 tx=0x7fc6a80a7000 comp rx=0 tx=0).stop 2023-07-21T22:19:27.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.895+0000 7fc6bd900640 1 -- 172.21.15.6:0/776784523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b80c21f0 msgr2=0x7fc6b814f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.895+0000 7fc6bd900640 1 --2- 172.21.15.6:0/776784523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b80c21f0 0x7fc6b814f650 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000c780 tx=0x7fc6b000cb80 comp rx=0 tx=0).stop 2023-07-21T22:19:27.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.895+0000 7fc6bd900640 1 -- 172.21.15.6:0/776784523 shutdown_connections 2023-07-21T22:19:27.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.895+0000 7fc6bd900640 1 --2- 172.21.15.6:0/776784523 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fc698066280 0x7fc698068730 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.895+0000 7fc6bd900640 1 --2- 172.21.15.6:0/776784523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6b80c21f0 0x7fc6b814f650 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.895+0000 7fc6bd900640 1 --2- 172.21.15.6:0/776784523 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6b8070b70 0x7fc6b80cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.895+0000 7fc6bd900640 1 --2- 172.21.15.6:0/776784523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6b806b1e0 0x7fc6b81550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.895+0000 7fc6bd900640 1 -- 172.21.15.6:0/776784523 >> 172.21.15.6:0/776784523 conn(0x7fc6b80afcf0 msgr2=0x7fc6b80b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.895+0000 7fc6bd900640 1 -- 172.21.15.6:0/776784523 shutdown_connections 2023-07-21T22:19:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:27.895+0000 7fc6bd900640 1 -- 172.21.15.6:0/776784523 wait complete. 2023-07-21T22:19:27.961 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-07-21T22:19:27.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:27.962 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-07-21T22:19:28.025 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:19:28.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:28.025 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-21T22:19:28.035 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:19:28.036 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:19:28.045 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:19:28.045 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:19:28.100 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:19:28.101 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:19:28.152 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:19:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.247+0000 7eff23b03640 1 Processor -- start 2023-07-21T22:19:28.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.247+0000 7eff23b03640 1 -- start start 2023-07-21T22:19:28.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.247+0000 7eff23b03640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7eff1c158ce0 0x7eff1c070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:28.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.247+0000 7eff23b03640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7eff1c0c8ad0 0x7eff1c0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:28.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.247+0000 7eff23b03640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c0c99c0 con 0x7eff1c0c9560 2023-07-21T22:19:28.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.247+0000 7eff23b03640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c0cc700 con 0x7eff1c158ce0 2023-07-21T22:19:28.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.247+0000 7eff23b03640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c0b0ff0 con 0x7eff1c0c8ad0 2023-07-21T22:19:28.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.251+0000 7eff2189f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7eff1c158ce0 0x7eff1c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:28.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.251+0000 7eff220a0640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7eff1c0c9560 0x7eff1c0cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58526/0 (socket says 172.21.15.6:58526) 2023-07-21T22:19:28.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.251+0000 7eff220a0640 1 -- 172.21.15.6:0/840061311 learned_addr learned my addr 172.21.15.6:0/840061311 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:28.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.251+0000 7eff2109e640 1 --2- 172.21.15.6:0/840061311 >> v2:172.21.15.161:3300/0 conn(0x7eff1c0c8ad0 0x7eff1c0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:28.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.251+0000 7eff2189f640 1 -- 172.21.15.6:0/840061311 >> v2:172.21.15.161:3300/0 conn(0x7eff1c0c8ad0 msgr2=0x7eff1c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.251+0000 7eff2189f640 1 --2- 172.21.15.6:0/840061311 >> v2:172.21.15.161:3300/0 conn(0x7eff1c0c8ad0 0x7eff1c0c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.251+0000 7eff2189f640 1 -- 172.21.15.6:0/840061311 >> v1:172.21.15.6:6789/0 conn(0x7eff1c0c9560 legacy=0x7eff1c0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.251+0000 7eff2089d640 1 -- 172.21.15.6:0/840061311 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 158567710 0 0) 0x7eff1c0c99c0 con 0x7eff1c0c9560 2023-07-21T22:19:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.251+0000 7eff2189f640 1 -- 172.21.15.6:0/840061311 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c070c80 con 0x7eff1c158ce0 2023-07-21T22:19:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.251+0000 7eff2109e640 1 --2- 172.21.15.6:0/840061311 >> v2:172.21.15.161:3300/0 conn(0x7eff1c0c8ad0 0x7eff1c0c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.251+0000 7eff2189f640 1 --2- 172.21.15.6:0/840061311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff1c158ce0 0x7eff1c070450 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0c1a30 tx=0x7eff1801c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a843ad1cc5285986 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:28.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.251+0000 7eff2089d640 1 -- 172.21.15.6:0/840061311 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c0cba20 con 0x7eff1c158ce0 2023-07-21T22:19:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.251+0000 7eff2089d640 1 -- 172.21.15.6:0/840061311 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff180a7050 con 0x7eff1c158ce0 2023-07-21T22:19:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.251+0000 7eff2089d640 1 -- 172.21.15.6:0/840061311 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180ab820 con 0x7eff1c158ce0 2023-07-21T22:19:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff23b03640 1 -- 172.21.15.6:0/840061311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff1c158ce0 msgr2=0x7eff1c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff23b03640 1 --2- 172.21.15.6:0/840061311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff1c158ce0 0x7eff1c070450 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0c1a30 tx=0x7eff1801c310 comp rx=0 tx=0).stop 2023-07-21T22:19:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff23b03640 1 -- 172.21.15.6:0/840061311 shutdown_connections 2023-07-21T22:19:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff23b03640 1 --2- 172.21.15.6:0/840061311 >> v2:172.21.15.161:3300/0 conn(0x7eff1c0c8ad0 0x7eff1c0c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff23b03640 1 --2- 172.21.15.6:0/840061311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff1c158ce0 0x7eff1c070450 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff23b03640 1 -- 172.21.15.6:0/840061311 >> 172.21.15.6:0/840061311 conn(0x7eff1c0afcf0 msgr2=0x7eff1c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff23b03640 1 -- 172.21.15.6:0/840061311 shutdown_connections 2023-07-21T22:19:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff23b03640 1 -- 172.21.15.6:0/840061311 wait complete. 2023-07-21T22:19:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff23b03640 1 Processor -- start 2023-07-21T22:19:28.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff23b03640 1 -- start start 2023-07-21T22:19:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff23b03640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff1c0c8ad0 0x7eff1c0c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:28.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff23b03640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff1c0c9560 0x7eff1c0c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:28.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff23b03640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff1c158ce0 0x7eff1c0c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:28.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff23b03640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0c5e20 con 0x7eff1c158ce0 2023-07-21T22:19:28.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff23b03640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0c7b50 con 0x7eff1c0c9560 2023-07-21T22:19:28.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff23b03640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0c7e30 con 0x7eff1c0c8ad0 2023-07-21T22:19:28.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff220a0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff1c158ce0 0x7eff1c0c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:28.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff220a0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff1c158ce0 0x7eff1c0c7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33070/0 (socket says 172.21.15.6:33070) 2023-07-21T22:19:28.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff220a0640 1 -- 172.21.15.6:0/1990301937 learned_addr learned my addr 172.21.15.6:0/1990301937 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:28.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff2109e640 1 --2- 172.21.15.6:0/1990301937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff1c0c9560 0x7eff1c0c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff2189f640 1 --2- 172.21.15.6:0/1990301937 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff1c0c8ad0 0x7eff1c0c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:28.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff220a0640 1 -- 172.21.15.6:0/1990301937 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff1c0c8ad0 msgr2=0x7eff1c0c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff220a0640 1 --2- 172.21.15.6:0/1990301937 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff1c0c8ad0 0x7eff1c0c4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff220a0640 1 -- 172.21.15.6:0/1990301937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff1c0c9560 msgr2=0x7eff1c0c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff220a0640 1 --2- 172.21.15.6:0/1990301937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff1c0c9560 0x7eff1c0c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.255+0000 7eff220a0640 1 -- 172.21.15.6:0/1990301937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff18009420 con 0x7eff1c158ce0 2023-07-21T22:19:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.259+0000 7eff220a0640 1 --2- 172.21.15.6:0/1990301937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff1c158ce0 0x7eff1c0c7220 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7eff1400c700 tx=0x7eff1400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.259+0000 7eff127fc640 1 -- 172.21.15.6:0/1990301937 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1400ce10 con 0x7eff1c158ce0 2023-07-21T22:19:28.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.259+0000 7eff127fc640 1 -- 172.21.15.6:0/1990301937 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1400a640 con 0x7eff1c158ce0 2023-07-21T22:19:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.259+0000 7eff127fc640 1 -- 172.21.15.6:0/1990301937 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1400aa30 con 0x7eff1c158ce0 2023-07-21T22:19:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.259+0000 7eff23b03640 1 -- 172.21.15.6:0/1990301937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c0b2050 con 0x7eff1c158ce0 2023-07-21T22:19:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.259+0000 7eff23b03640 1 -- 172.21.15.6:0/1990301937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c0c7760 con 0x7eff1c158ce0 2023-07-21T22:19:28.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.259+0000 7eff23b03640 1 -- 172.21.15.6:0/1990301937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1c0ca1a0 con 0x7eff1c158ce0 2023-07-21T22:19:28.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.259+0000 7eff127fc640 1 -- 172.21.15.6:0/1990301937 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7eff1400ab90 con 0x7eff1c158ce0 2023-07-21T22:19:28.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.259+0000 7eff127fc640 1 --2- 172.21.15.6:0/1990301937 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7eff00066280 0x7eff00068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:28.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.263+0000 7eff127fc640 1 -- 172.21.15.6:0/1990301937 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7eff14083210 con 0x7eff1c158ce0 2023-07-21T22:19:28.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.263+0000 7eff2189f640 1 --2- 172.21.15.6:0/1990301937 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7eff00066280 0x7eff00068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:28.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.263+0000 7eff2189f640 1 --2- 172.21.15.6:0/1990301937 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7eff00066280 0x7eff00068730 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7eff180ad000 tx=0x7eff180a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:28.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.267+0000 7eff127fc640 1 -- 172.21.15.6:0/1990301937 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7eff14050660 con 0x7eff1c158ce0 2023-07-21T22:19:28.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.423+0000 7eff23b03640 1 -- 172.21.15.6:0/1990301937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff1c0b1eb0 con 0x7eff1c158ce0 2023-07-21T22:19:28.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.423+0000 7eff127fc640 1 -- 172.21.15.6:0/1990301937 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18302 (secure 0 0 0) 0x7eff1c0b1eb0 con 0x7eff1c158ce0 2023-07-21T22:19:28.470 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:28.471 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":28,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:19:24.603032+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:18:41.465054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:18:42.709896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:19:28.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.423+0000 7eff23b03640 1 -- 172.21.15.6:0/1990301937 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7eff00066280 msgr2=0x7eff00068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:28.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.423+0000 7eff23b03640 1 --2- 172.21.15.6:0/1990301937 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7eff00066280 0x7eff00068730 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7eff180ad000 tx=0x7eff180a6000 comp rx=0 tx=0).stop 2023-07-21T22:19:28.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.423+0000 7eff23b03640 1 -- 172.21.15.6:0/1990301937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff1c158ce0 msgr2=0x7eff1c0c7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:28.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.423+0000 7eff23b03640 1 --2- 172.21.15.6:0/1990301937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff1c158ce0 0x7eff1c0c7220 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7eff1400c700 tx=0x7eff1400cbc0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.423+0000 7eff23b03640 1 -- 172.21.15.6:0/1990301937 shutdown_connections 2023-07-21T22:19:28.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.423+0000 7eff23b03640 1 --2- 172.21.15.6:0/1990301937 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7eff00066280 0x7eff00068730 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.423+0000 7eff23b03640 1 --2- 172.21.15.6:0/1990301937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff1c158ce0 0x7eff1c0c7220 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.423+0000 7eff23b03640 1 --2- 172.21.15.6:0/1990301937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff1c0c9560 0x7eff1c0c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.423+0000 7eff23b03640 1 --2- 172.21.15.6:0/1990301937 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff1c0c8ad0 0x7eff1c0c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.423+0000 7eff23b03640 1 -- 172.21.15.6:0/1990301937 >> 172.21.15.6:0/1990301937 conn(0x7eff1c0afcf0 msgr2=0x7eff1c150500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:28.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.423+0000 7eff23b03640 1 -- 172.21.15.6:0/1990301937 shutdown_connections 2023-07-21T22:19:28.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.423+0000 7eff23b03640 1 -- 172.21.15.6:0/1990301937 wait complete. 2023-07-21T22:19:28.492 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:18:41.465054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:18:42.709896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:19:28.493 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:19:28.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.591+0000 7fb21a893640 1 Processor -- start 2023-07-21T22:19:28.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.591+0000 7fb21a893640 1 -- start start 2023-07-21T22:19:28.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.591+0000 7fb21a893640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb214069430 0x7fb214069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:28.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.591+0000 7fb21a893640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb2140af2b0 0x7fb21415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:28.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.591+0000 7fb21a893640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb214159d70 con 0x7fb214070f30 2023-07-21T22:19:28.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.591+0000 7fb21a893640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb214069d40 con 0x7fb2140af2b0 2023-07-21T22:19:28.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.591+0000 7fb21a893640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2140c9c60 con 0x7fb214069430 2023-07-21T22:19:28.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.591+0000 7fb2137fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb214070f30 0x7fb2140ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58540/0 (socket says 172.21.15.6:58540) 2023-07-21T22:19:28.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.591+0000 7fb2137fe640 1 -- 172.21.15.6:0/3619441814 learned_addr learned my addr 172.21.15.6:0/3619441814 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:28.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.591+0000 7fb218e30640 1 --2- 172.21.15.6:0/3619441814 >> v2:172.21.15.161:3300/0 conn(0x7fb2140af2b0 0x7fb21415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:28.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.591+0000 7fb213fff640 1 --2- 172.21.15.6:0/3619441814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb214069430 0x7fb214069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:28.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.595+0000 7fb212ffd640 1 -- 172.21.15.6:0/3619441814 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299708788 0 0) 0x7fb208001120 con 0x7fb214070f30 2023-07-21T22:19:28.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.595+0000 7fb212ffd640 1 -- 172.21.15.6:0/3619441814 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1fc003530 con 0x7fb214070f30 2023-07-21T22:19:28.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.595+0000 7fb218e30640 1 -- 172.21.15.6:0/3619441814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb214069430 msgr2=0x7fb214069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:28.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.595+0000 7fb218e30640 1 --2- 172.21.15.6:0/3619441814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb214069430 0x7fb214069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.595+0000 7fb218e30640 1 -- 172.21.15.6:0/3619441814 >> v1:172.21.15.6:6789/0 conn(0x7fb214070f30 legacy=0x7fb2140ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:28.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.595+0000 7fb218e30640 1 -- 172.21.15.6:0/3619441814 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2140c9f40 con 0x7fb2140af2b0 2023-07-21T22:19:28.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.595+0000 7fb218e30640 1 --2- 172.21.15.6:0/3619441814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2140af2b0 0x7fb21415a1f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009d90 tx=0x7fb20c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=592b8bc80f1f21e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:28.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.595+0000 7fb212ffd640 1 -- 172.21.15.6:0/3619441814 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c0a5920 con 0x7fb2140af2b0 2023-07-21T22:19:28.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.595+0000 7fb212ffd640 1 -- 172.21.15.6:0/3619441814 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20c0a5a80 con 0x7fb2140af2b0 2023-07-21T22:19:28.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.595+0000 7fb212ffd640 1 -- 172.21.15.6:0/3619441814 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c0a5e10 con 0x7fb2140af2b0 2023-07-21T22:19:28.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb21a893640 1 -- 172.21.15.6:0/3619441814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2140af2b0 msgr2=0x7fb21415a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:28.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb21a893640 1 --2- 172.21.15.6:0/3619441814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2140af2b0 0x7fb21415a1f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009d90 tx=0x7fb20c01c950 comp rx=0 tx=0).stop 2023-07-21T22:19:28.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb21a893640 1 -- 172.21.15.6:0/3619441814 shutdown_connections 2023-07-21T22:19:28.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb21a893640 1 --2- 172.21.15.6:0/3619441814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2140af2b0 0x7fb21415a1f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb21a893640 1 --2- 172.21.15.6:0/3619441814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb214069430 0x7fb214069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb21a893640 1 -- 172.21.15.6:0/3619441814 >> 172.21.15.6:0/3619441814 conn(0x7fb2140cde90 msgr2=0x7fb2140ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:28.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb21a893640 1 -- 172.21.15.6:0/3619441814 shutdown_connections 2023-07-21T22:19:28.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb21a893640 1 -- 172.21.15.6:0/3619441814 wait complete. 2023-07-21T22:19:28.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb21a893640 1 Processor -- start 2023-07-21T22:19:28.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb21a893640 1 -- start start 2023-07-21T22:19:28.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb21a893640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb214069430 0x7fb214148be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:28.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb21a893640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb214070f30 0x7fb2140c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:28.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb21a893640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2140af2b0 0x7fb2141552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:28.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb21a893640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21414d180 con 0x7fb2140af2b0 2023-07-21T22:19:28.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb21a893640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2140c4d60 con 0x7fb214070f30 2023-07-21T22:19:28.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb21a893640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21414c850 con 0x7fb214069430 2023-07-21T22:19:28.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb218e30640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2140af2b0 0x7fb2141552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:28.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb218e30640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2140af2b0 0x7fb2141552c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33076/0 (socket says 172.21.15.6:33076) 2023-07-21T22:19:28.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb218e30640 1 -- 172.21.15.6:0/2123438167 learned_addr learned my addr 172.21.15.6:0/2123438167 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:28.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb218e30640 1 -- 172.21.15.6:0/2123438167 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb214069430 msgr2=0x7fb214148be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:28.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb213fff640 1 --2- 172.21.15.6:0/2123438167 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb214069430 0x7fb214148be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:28.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb2137fe640 1 --2- 172.21.15.6:0/2123438167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb214070f30 0x7fb2140c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:28.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb218e30640 1 --2- 172.21.15.6:0/2123438167 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb214069430 0x7fb214148be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb218e30640 1 -- 172.21.15.6:0/2123438167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb214070f30 msgr2=0x7fb2140c4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:28.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb218e30640 1 --2- 172.21.15.6:0/2123438167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb214070f30 0x7fb2140c4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb218e30640 1 -- 172.21.15.6:0/2123438167 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c009a70 con 0x7fb2140af2b0 2023-07-21T22:19:28.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb2137fe640 1 --2- 172.21.15.6:0/2123438167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb214070f30 0x7fb2140c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:28.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.599+0000 7fb213fff640 1 --2- 172.21.15.6:0/2123438167 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb214069430 0x7fb214148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:28.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.603+0000 7fb218e30640 1 --2- 172.21.15.6:0/2123438167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2140af2b0 0x7fb2141552c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009d90 tx=0x7fb20c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:28.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.603+0000 7fb210ff9640 1 -- 172.21.15.6:0/2123438167 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c0aecd0 con 0x7fb2140af2b0 2023-07-21T22:19:28.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.603+0000 7fb210ff9640 1 -- 172.21.15.6:0/2123438167 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20c0aee30 con 0x7fb2140af2b0 2023-07-21T22:19:28.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.603+0000 7fb21a893640 1 -- 172.21.15.6:0/2123438167 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21414cb30 con 0x7fb2140af2b0 2023-07-21T22:19:28.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.603+0000 7fb210ff9640 1 -- 172.21.15.6:0/2123438167 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c0b7630 con 0x7fb2140af2b0 2023-07-21T22:19:28.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.603+0000 7fb21a893640 1 -- 172.21.15.6:0/2123438167 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2140c4a70 con 0x7fb2140af2b0 2023-07-21T22:19:28.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.603+0000 7fb21a893640 1 -- 172.21.15.6:0/2123438167 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2140678d0 con 0x7fb2140af2b0 2023-07-21T22:19:28.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.603+0000 7fb210ff9640 1 -- 172.21.15.6:0/2123438167 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb20c0b4050 con 0x7fb2140af2b0 2023-07-21T22:19:28.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.603+0000 7fb210ff9640 1 --2- 172.21.15.6:0/2123438167 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb200066280 0x7fb200068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:28.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.603+0000 7fb210ff9640 1 -- 172.21.15.6:0/2123438167 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb20c11ef70 con 0x7fb2140af2b0 2023-07-21T22:19:28.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.603+0000 7fb213fff640 1 --2- 172.21.15.6:0/2123438167 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb200066280 0x7fb200068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:28.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.607+0000 7fb213fff640 1 --2- 172.21.15.6:0/2123438167 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb200066280 0x7fb200068730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb204009a40 tx=0x7fb204008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:28.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.607+0000 7fb210ff9640 1 -- 172.21.15.6:0/2123438167 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb20c0ec3a0 con 0x7fb2140af2b0 2023-07-21T22:19:28.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.767+0000 7fb21a893640 1 -- 172.21.15.6:0/2123438167 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb21414d2c0 con 0x7fb2140af2b0 2023-07-21T22:19:28.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.767+0000 7fb210ff9640 1 -- 172.21.15.6:0/2123438167 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb20c0c70a0 con 0x7fb2140af2b0 2023-07-21T22:19:28.815 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:19:28.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.767+0000 7fb21a893640 1 -- 172.21.15.6:0/2123438167 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb200066280 msgr2=0x7fb200068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:28.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.767+0000 7fb21a893640 1 --2- 172.21.15.6:0/2123438167 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb200066280 0x7fb200068730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb204009a40 tx=0x7fb204008040 comp rx=0 tx=0).stop 2023-07-21T22:19:28.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.767+0000 7fb21a893640 1 -- 172.21.15.6:0/2123438167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2140af2b0 msgr2=0x7fb2141552c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:28.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.767+0000 7fb21a893640 1 --2- 172.21.15.6:0/2123438167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2140af2b0 0x7fb2141552c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009d90 tx=0x7fb20c0196f0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.767+0000 7fb21a893640 1 -- 172.21.15.6:0/2123438167 shutdown_connections 2023-07-21T22:19:28.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.767+0000 7fb21a893640 1 --2- 172.21.15.6:0/2123438167 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb200066280 0x7fb200068730 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.767+0000 7fb21a893640 1 --2- 172.21.15.6:0/2123438167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2140af2b0 0x7fb2141552c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.767+0000 7fb21a893640 1 --2- 172.21.15.6:0/2123438167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb214070f30 0x7fb2140c4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.767+0000 7fb21a893640 1 --2- 172.21.15.6:0/2123438167 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb214069430 0x7fb214148be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.767+0000 7fb21a893640 1 -- 172.21.15.6:0/2123438167 >> 172.21.15.6:0/2123438167 conn(0x7fb2140cde90 msgr2=0x7fb2140cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:28.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.767+0000 7fb21a893640 1 -- 172.21.15.6:0/2123438167 shutdown_connections 2023-07-21T22:19:28.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.767+0000 7fb21a893640 1 -- 172.21.15.6:0/2123438167 wait complete. 2023-07-21T22:19:28.836 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:19:28.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.935+0000 7fb230bad640 1 Processor -- start 2023-07-21T22:19:28.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.935+0000 7fb230bad640 1 -- start start 2023-07-21T22:19:28.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.935+0000 7fb230bad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb22c15bde0 0x7fb22c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:28.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.935+0000 7fb230bad640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22c0b04c0 con 0x7fb22c0d2fc0 2023-07-21T22:19:28.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.935+0000 7fb230bad640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22c0b1060 con 0x7fb22c0d2300 2023-07-21T22:19:28.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.935+0000 7fb230bad640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c15c1b0 con 0x7fb22c15bde0 2023-07-21T22:19:28.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.935+0000 7fb223fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb22c0d2fc0 0x7fb22c0b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58544/0 (socket says 172.21.15.6:58544) 2023-07-21T22:19:28.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.935+0000 7fb223fff640 1 -- 172.21.15.6:0/2593816453 learned_addr learned my addr 172.21.15.6:0/2593816453 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:28.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.935+0000 7fb229d9b640 1 -- 172.21.15.6:0/2593816453 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4179280313 0 0) 0x7fb22c0b04c0 con 0x7fb22c0d2fc0 2023-07-21T22:19:28.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.935+0000 7fb229d9b640 1 -- 172.21.15.6:0/2593816453 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb218003530 con 0x7fb22c0d2fc0 2023-07-21T22:19:28.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.935+0000 7fb22a59c640 1 --2- 172.21.15.6:0/2593816453 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb22c15bde0 0x7fb22c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:28.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.935+0000 7fb229d9b640 1 -- 172.21.15.6:0/2593816453 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 263970497 0 0) 0x7fb218003530 con 0x7fb22c0d2fc0 2023-07-21T22:19:28.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.935+0000 7fb229d9b640 1 -- 172.21.15.6:0/2593816453 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb22c15bde0 msgr2=0x7fb22c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:28.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.935+0000 7fb229d9b640 1 --2- 172.21.15.6:0/2593816453 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb22c15bde0 0x7fb22c0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.935+0000 7fb229d9b640 1 -- 172.21.15.6:0/2593816453 >> v1:172.21.15.161:6789/0 conn(0x7fb22c0d2300 legacy=0x7fb22c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:28.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.935+0000 7fb229d9b640 1 -- 172.21.15.6:0/2593816453 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c0d0aa0 con 0x7fb22c0d2fc0 2023-07-21T22:19:28.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.935+0000 7fb229d9b640 1 -- 172.21.15.6:0/2593816453 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fb214001680 con 0x7fb22c0d2fc0 2023-07-21T22:19:28.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.935+0000 7fb229d9b640 1 -- 172.21.15.6:0/2593816453 >> v1:172.21.15.6:6789/0 conn(0x7fb22c0d2fc0 legacy=0x7fb22c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:28.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.939+0000 7fb229d9b640 1 --2- 172.21.15.6:0/2593816453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2180039b0 0x7fb218003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:28.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.939+0000 7fb229d9b640 1 --2- 172.21.15.6:0/2593816453 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb22c15bde0 0x7fb2180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:28.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.939+0000 7fb229d9b640 1 --2- 172.21.15.6:0/2593816453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb218004d10 0x7fb218005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:28.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.939+0000 7fb229d9b640 1 -- 172.21.15.6:0/2593816453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c15c1b0 con 0x7fb218004d10 2023-07-21T22:19:28.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.939+0000 7fb229d9b640 1 -- 172.21.15.6:0/2593816453 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21800b990 con 0x7fb2180039b0 2023-07-21T22:19:28.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.939+0000 7fb229d9b640 1 -- 172.21.15.6:0/2593816453 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21800bb20 con 0x7fb22c15bde0 2023-07-21T22:19:28.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.939+0000 7fb22ad9d640 1 --2- 172.21.15.6:0/2593816453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb218004d10 0x7fb218005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:28.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.939+0000 7fb22a59c640 1 --2- 172.21.15.6:0/2593816453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2180039b0 0x7fb218003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:28.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.939+0000 7fb223fff640 1 --2- 172.21.15.6:0/2593816453 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb22c15bde0 0x7fb2180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:28.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.939+0000 7fb22ad9d640 1 -- 172.21.15.6:0/2593816453 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb22c15bde0 msgr2=0x7fb2180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:28.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.939+0000 7fb22ad9d640 1 --2- 172.21.15.6:0/2593816453 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb22c15bde0 0x7fb2180047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.939+0000 7fb22ad9d640 1 -- 172.21.15.6:0/2593816453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2180039b0 msgr2=0x7fb218003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:28.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.939+0000 7fb22ad9d640 1 --2- 172.21.15.6:0/2593816453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2180039b0 0x7fb218003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.939+0000 7fb22ad9d640 1 -- 172.21.15.6:0/2593816453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb218003530 con 0x7fb218004d10 2023-07-21T22:19:28.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.939+0000 7fb22a59c640 1 --2- 172.21.15.6:0/2593816453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2180039b0 0x7fb218003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:28.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.939+0000 7fb22ad9d640 1 --2- 172.21.15.6:0/2593816453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb218004d10 0x7fb218005180 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb224001f60 tx=0x7fb22401c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d495fcc43697c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:28.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.939+0000 7fb229d9b640 1 -- 172.21.15.6:0/2593816453 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2240a6650 con 0x7fb218004d10 2023-07-21T22:19:28.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.939+0000 7fb229d9b640 1 -- 172.21.15.6:0/2593816453 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2240a67b0 con 0x7fb218004d10 2023-07-21T22:19:28.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.939+0000 7fb229d9b640 1 -- 172.21.15.6:0/2593816453 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2240a6b60 con 0x7fb218004d10 2023-07-21T22:19:28.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.943+0000 7fb230bad640 1 -- 172.21.15.6:0/2593816453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb218004d10 msgr2=0x7fb218005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:28.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.943+0000 7fb230bad640 1 --2- 172.21.15.6:0/2593816453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb218004d10 0x7fb218005180 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb224001f60 tx=0x7fb22401c860 comp rx=0 tx=0).stop 2023-07-21T22:19:28.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.943+0000 7fb22ad9d640 1 -- 172.21.15.6:0/2593816453 reap_dead start 2023-07-21T22:19:28.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.943+0000 7fb230bad640 1 -- 172.21.15.6:0/2593816453 shutdown_connections 2023-07-21T22:19:28.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.943+0000 7fb230bad640 1 -- 172.21.15.6:0/2593816453 >> 172.21.15.6:0/2593816453 conn(0x7fb22c0659d0 msgr2=0x7fb22c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:28.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.943+0000 7fb230bad640 1 -- 172.21.15.6:0/2593816453 shutdown_connections 2023-07-21T22:19:28.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.943+0000 7fb230bad640 1 -- 172.21.15.6:0/2593816453 wait complete. 2023-07-21T22:19:28.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.943+0000 7fb230bad640 1 Processor -- start 2023-07-21T22:19:28.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.943+0000 7fb230bad640 1 -- start start 2023-07-21T22:19:28.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.943+0000 7fb230bad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb218004d10 0x7fb22c1e5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:28.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.943+0000 7fb230bad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb22c153840 0x7fb22c153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:28.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.943+0000 7fb230bad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb22c154500 0x7fb22c154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:28.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.943+0000 7fb230bad640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c0c5c00 con 0x7fb218004d10 2023-07-21T22:19:28.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.943+0000 7fb230bad640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c0c5fd0 con 0x7fb22c154500 2023-07-21T22:19:28.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.943+0000 7fb230bad640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c0c62b0 con 0x7fb22c153840 2023-07-21T22:19:28.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.943+0000 7fb22a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb218004d10 0x7fb22c1e5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:28.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.943+0000 7fb22a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb218004d10 0x7fb22c1e5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33106/0 (socket says 172.21.15.6:33106) 2023-07-21T22:19:28.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.943+0000 7fb22a59c640 1 -- 172.21.15.6:0/322576381 learned_addr learned my addr 172.21.15.6:0/322576381 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:28.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.947+0000 7fb223fff640 1 --2- 172.21.15.6:0/322576381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb22c153840 0x7fb22c153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:28.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.947+0000 7fb22ad9d640 1 --2- 172.21.15.6:0/322576381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb22c154500 0x7fb22c154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:28.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.947+0000 7fb22a59c640 1 -- 172.21.15.6:0/322576381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb22c153840 msgr2=0x7fb22c153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:28.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.947+0000 7fb22a59c640 1 --2- 172.21.15.6:0/322576381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb22c153840 0x7fb22c153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.947+0000 7fb22a59c640 1 -- 172.21.15.6:0/322576381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb22c154500 msgr2=0x7fb22c154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:28.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.947+0000 7fb22a59c640 1 --2- 172.21.15.6:0/322576381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb22c154500 0x7fb22c154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:28.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.947+0000 7fb22a59c640 1 -- 172.21.15.6:0/322576381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c0c6590 con 0x7fb218004d10 2023-07-21T22:19:28.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.947+0000 7fb22ad9d640 1 --2- 172.21.15.6:0/322576381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb22c154500 0x7fb22c154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:28.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.947+0000 7fb22a59c640 1 --2- 172.21.15.6:0/322576381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb218004d10 0x7fb22c1e5480 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb21c011ca0 tx=0x7fb21c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:28.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.947+0000 7fb222ffd640 1 -- 172.21.15.6:0/322576381 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c011ee0 con 0x7fb218004d10 2023-07-21T22:19:28.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.947+0000 7fb222ffd640 1 -- 172.21.15.6:0/322576381 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21c00fe40 con 0x7fb218004d10 2023-07-21T22:19:28.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.947+0000 7fb222ffd640 1 -- 172.21.15.6:0/322576381 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c005bc0 con 0x7fb218004d10 2023-07-21T22:19:28.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.947+0000 7fb230bad640 1 -- 172.21.15.6:0/322576381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22c0c6870 con 0x7fb218004d10 2023-07-21T22:19:28.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.947+0000 7fb230bad640 1 -- 172.21.15.6:0/322576381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22c1541f0 con 0x7fb218004d10 2023-07-21T22:19:28.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.947+0000 7fb230bad640 1 -- 172.21.15.6:0/322576381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb22c0678d0 con 0x7fb218004d10 2023-07-21T22:19:28.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.947+0000 7fb222ffd640 1 -- 172.21.15.6:0/322576381 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb21c005d20 con 0x7fb218004d10 2023-07-21T22:19:28.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.947+0000 7fb222ffd640 1 --2- 172.21.15.6:0/322576381 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb20c0662b0 0x7fb20c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:28.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.947+0000 7fb222ffd640 1 -- 172.21.15.6:0/322576381 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb21c0847a0 con 0x7fb218004d10 2023-07-21T22:19:28.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.951+0000 7fb223fff640 1 --2- 172.21.15.6:0/322576381 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb20c0662b0 0x7fb20c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:28.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.951+0000 7fb223fff640 1 --2- 172.21.15.6:0/322576381 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb20c0662b0 0x7fb20c068760 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb214001060 tx=0x7fb214009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:29.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:28.951+0000 7fb222ffd640 1 -- 172.21.15.6:0/322576381 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb21c055700 con 0x7fb218004d10 2023-07-21T22:19:29.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.107+0000 7fb230bad640 1 -- 172.21.15.6:0/322576381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb22c0b7d90 con 0x7fb218004d10 2023-07-21T22:19:29.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.107+0000 7fb222ffd640 1 -- 172.21.15.6:0/322576381 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb21c055290 con 0x7fb218004d10 2023-07-21T22:19:29.155 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:19:29.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.107+0000 7fb230bad640 1 -- 172.21.15.6:0/322576381 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb20c0662b0 msgr2=0x7fb20c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:29.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.107+0000 7fb230bad640 1 --2- 172.21.15.6:0/322576381 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb20c0662b0 0x7fb20c068760 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb214001060 tx=0x7fb214009040 comp rx=0 tx=0).stop 2023-07-21T22:19:29.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.107+0000 7fb230bad640 1 -- 172.21.15.6:0/322576381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb218004d10 msgr2=0x7fb22c1e5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:29.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.107+0000 7fb230bad640 1 --2- 172.21.15.6:0/322576381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb218004d10 0x7fb22c1e5480 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb21c011ca0 tx=0x7fb21c00f610 comp rx=0 tx=0).stop 2023-07-21T22:19:29.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.111+0000 7fb230bad640 1 -- 172.21.15.6:0/322576381 shutdown_connections 2023-07-21T22:19:29.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.111+0000 7fb230bad640 1 --2- 172.21.15.6:0/322576381 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb22c154500 0x7fb22c154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.111+0000 7fb230bad640 1 --2- 172.21.15.6:0/322576381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb22c153840 0x7fb22c153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.111+0000 7fb230bad640 1 --2- 172.21.15.6:0/322576381 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fb20c0662b0 0x7fb20c068760 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.111+0000 7fb230bad640 1 --2- 172.21.15.6:0/322576381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb218004d10 0x7fb22c1e5480 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.111+0000 7fb230bad640 1 -- 172.21.15.6:0/322576381 >> 172.21.15.6:0/322576381 conn(0x7fb22c0659d0 msgr2=0x7fb22c0d2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:29.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.111+0000 7fb230bad640 1 -- 172.21.15.6:0/322576381 shutdown_connections 2023-07-21T22:19:29.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.111+0000 7fb230bad640 1 -- 172.21.15.6:0/322576381 wait complete. 2023-07-21T22:19:29.176 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:19:29.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.275+0000 7f6fece19640 1 Processor -- start 2023-07-21T22:19:29.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.275+0000 7f6fece19640 1 -- start start 2023-07-21T22:19:29.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.275+0000 7f6fece19640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fe80cf2e0 0x7f6fe80cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:29.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.275+0000 7f6fece19640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6fe80ca790 0x7f6fe80cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:29.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.275+0000 7f6fece19640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe80d0920 con 0x7f6fe806a540 2023-07-21T22:19:29.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.275+0000 7f6fece19640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe815bfd0 con 0x7f6fe80ca790 2023-07-21T22:19:29.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.275+0000 7f6fece19640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe80cfd10 con 0x7f6fe80cf2e0 2023-07-21T22:19:29.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.275+0000 7f6fe659c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6fe806a540 0x7f6fe806a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58548/0 (socket says 172.21.15.6:58548) 2023-07-21T22:19:29.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.275+0000 7f6fe659c640 1 -- 172.21.15.6:0/1546062096 learned_addr learned my addr 172.21.15.6:0/1546062096 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:29.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.275+0000 7f6fe6d9d640 1 --2- 172.21.15.6:0/1546062096 >> v2:172.21.15.161:3300/0 conn(0x7f6fe80ca790 0x7f6fe80cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:29.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.275+0000 7f6fe5d9b640 1 --2- 172.21.15.6:0/1546062096 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fe80cf2e0 0x7f6fe80cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:29.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.275+0000 7f6fe559a640 1 -- 172.21.15.6:0/1546062096 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404021789 0 0) 0x7f6fe80d0920 con 0x7f6fe806a540 2023-07-21T22:19:29.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.275+0000 7f6fe559a640 1 -- 172.21.15.6:0/1546062096 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fd0003530 con 0x7f6fe806a540 2023-07-21T22:19:29.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.275+0000 7f6fe6d9d640 1 -- 172.21.15.6:0/1546062096 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fe80cf2e0 msgr2=0x7f6fe80cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:29.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.275+0000 7f6fe6d9d640 1 --2- 172.21.15.6:0/1546062096 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fe80cf2e0 0x7f6fe80cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.275+0000 7f6fe6d9d640 1 -- 172.21.15.6:0/1546062096 >> v1:172.21.15.6:6789/0 conn(0x7f6fe806a540 legacy=0x7f6fe806a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:29.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.275+0000 7f6fe6d9d640 1 -- 172.21.15.6:0/1546062096 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe80cfff0 con 0x7f6fe80ca790 2023-07-21T22:19:29.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.279+0000 7f6fe6d9d640 1 --2- 172.21.15.6:0/1546062096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fe80ca790 0x7f6fe80cac00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0009d90 tx=0x7f6fe001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d20860f2000b43e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:29.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.279+0000 7f6fe559a640 1 -- 172.21.15.6:0/1546062096 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe00a59e0 con 0x7f6fe80ca790 2023-07-21T22:19:29.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.279+0000 7f6fe559a640 1 -- 172.21.15.6:0/1546062096 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe00a5b40 con 0x7f6fe80ca790 2023-07-21T22:19:29.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.279+0000 7f6fe559a640 1 -- 172.21.15.6:0/1546062096 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe00ad440 con 0x7f6fe80ca790 2023-07-21T22:19:29.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.279+0000 7f6fece19640 1 -- 172.21.15.6:0/1546062096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fe80ca790 msgr2=0x7f6fe80cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:29.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.279+0000 7f6fece19640 1 --2- 172.21.15.6:0/1546062096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fe80ca790 0x7f6fe80cac00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0009d90 tx=0x7f6fe001c920 comp rx=0 tx=0).stop 2023-07-21T22:19:29.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.279+0000 7f6fece19640 1 -- 172.21.15.6:0/1546062096 shutdown_connections 2023-07-21T22:19:29.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.279+0000 7f6fece19640 1 --2- 172.21.15.6:0/1546062096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fe80ca790 0x7f6fe80cac00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.279+0000 7f6fece19640 1 --2- 172.21.15.6:0/1546062096 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fe80cf2e0 0x7f6fe80cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.279+0000 7f6fece19640 1 -- 172.21.15.6:0/1546062096 >> 172.21.15.6:0/1546062096 conn(0x7f6fe8099490 msgr2=0x7f6fe8089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:29.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.279+0000 7f6fece19640 1 -- 172.21.15.6:0/1546062096 shutdown_connections 2023-07-21T22:19:29.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.279+0000 7f6fece19640 1 -- 172.21.15.6:0/1546062096 wait complete. 2023-07-21T22:19:29.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fece19640 1 Processor -- start 2023-07-21T22:19:29.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fece19640 1 -- start start 2023-07-21T22:19:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fece19640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fe806a540 0x7f6fe8157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fece19640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe80ca790 0x7f6fe8157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fece19640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fe80cf2e0 0x7f6fe8151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fece19640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe814ff10 con 0x7f6fe80ca790 2023-07-21T22:19:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fece19640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe8151130 con 0x7f6fe806a540 2023-07-21T22:19:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fece19640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe81513d0 con 0x7f6fe80cf2e0 2023-07-21T22:19:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fe5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe80ca790 0x7f6fe8157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:29.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fe5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe80ca790 0x7f6fe8157860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33118/0 (socket says 172.21.15.6:33118) 2023-07-21T22:19:29.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fe5d9b640 1 -- 172.21.15.6:0/2199489911 learned_addr learned my addr 172.21.15.6:0/2199489911 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:29.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fe659c640 1 --2- 172.21.15.6:0/2199489911 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fe806a540 0x7f6fe8157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:29.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fe6d9d640 1 --2- 172.21.15.6:0/2199489911 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fe80cf2e0 0x7f6fe8151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:29.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fe5d9b640 1 -- 172.21.15.6:0/2199489911 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fe80cf2e0 msgr2=0x7f6fe8151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:29.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fe5d9b640 1 --2- 172.21.15.6:0/2199489911 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fe80cf2e0 0x7f6fe8151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fe5d9b640 1 -- 172.21.15.6:0/2199489911 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fe806a540 msgr2=0x7f6fe8157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:29.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fe5d9b640 1 --2- 172.21.15.6:0/2199489911 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fe806a540 0x7f6fe8157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fe5d9b640 1 -- 172.21.15.6:0/2199489911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe0009a70 con 0x7f6fe80ca790 2023-07-21T22:19:29.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fe659c640 1 --2- 172.21.15.6:0/2199489911 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fe806a540 0x7f6fe8157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:29.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fe6d9d640 1 --2- 172.21.15.6:0/2199489911 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fe80cf2e0 0x7f6fe8151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:29.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fe5d9b640 1 --2- 172.21.15.6:0/2199489911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe80ca790 0x7f6fe8157860 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00e930 tx=0x7f6fdc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:29.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fd6ffd640 1 -- 172.21.15.6:0/2199489911 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc009690 con 0x7f6fe80ca790 2023-07-21T22:19:29.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fd6ffd640 1 -- 172.21.15.6:0/2199489911 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc00ca00 con 0x7f6fe80ca790 2023-07-21T22:19:29.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fd6ffd640 1 -- 172.21.15.6:0/2199489911 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc00cd70 con 0x7f6fe80ca790 2023-07-21T22:19:29.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fece19640 1 -- 172.21.15.6:0/2199489911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe81516b0 con 0x7f6fe80ca790 2023-07-21T22:19:29.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.283+0000 7f6fece19640 1 -- 172.21.15.6:0/2199489911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe815d120 con 0x7f6fe80ca790 2023-07-21T22:19:29.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.287+0000 7f6fece19640 1 -- 172.21.15.6:0/2199489911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe80678d0 con 0x7f6fe80ca790 2023-07-21T22:19:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.287+0000 7f6fd6ffd640 1 -- 172.21.15.6:0/2199489911 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6fdc013470 con 0x7f6fe80ca790 2023-07-21T22:19:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.287+0000 7f6fd6ffd640 1 --2- 172.21.15.6:0/2199489911 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6fc8066280 0x7f6fc8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.287+0000 7f6fd6ffd640 1 -- 172.21.15.6:0/2199489911 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6fdc0840b0 con 0x7f6fe80ca790 2023-07-21T22:19:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.287+0000 7f6fe659c640 1 --2- 172.21.15.6:0/2199489911 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6fc8066280 0x7f6fc8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.287+0000 7f6fe659c640 1 --2- 172.21.15.6:0/2199489911 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6fc8066280 0x7f6fc8068730 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8005890 tx=0x7f6fd8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:29.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.291+0000 7f6fd6ffd640 1 -- 172.21.15.6:0/2199489911 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6fdc051510 con 0x7f6fe80ca790 2023-07-21T22:19:29.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.447+0000 7f6fece19640 1 -- 172.21.15.6:0/2199489911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6fe80cee70 con 0x7f6fe80ca790 2023-07-21T22:19:29.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.447+0000 7f6fd6ffd640 1 -- 172.21.15.6:0/2199489911 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6fdc054b30 con 0x7f6fe80ca790 2023-07-21T22:19:29.494 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:19:29.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.447+0000 7f6fece19640 1 -- 172.21.15.6:0/2199489911 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6fc8066280 msgr2=0x7f6fc8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:29.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.447+0000 7f6fece19640 1 --2- 172.21.15.6:0/2199489911 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6fc8066280 0x7f6fc8068730 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8005890 tx=0x7f6fd8009040 comp rx=0 tx=0).stop 2023-07-21T22:19:29.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.447+0000 7f6fece19640 1 -- 172.21.15.6:0/2199489911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe80ca790 msgr2=0x7f6fe8157860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:29.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.447+0000 7f6fece19640 1 --2- 172.21.15.6:0/2199489911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe80ca790 0x7f6fe8157860 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00e930 tx=0x7f6fdc00edf0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.447+0000 7f6fece19640 1 -- 172.21.15.6:0/2199489911 shutdown_connections 2023-07-21T22:19:29.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.447+0000 7f6fece19640 1 --2- 172.21.15.6:0/2199489911 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6fe80cf2e0 0x7f6fe8151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.447+0000 7f6fece19640 1 --2- 172.21.15.6:0/2199489911 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6fc8066280 0x7f6fc8068730 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.447+0000 7f6fece19640 1 --2- 172.21.15.6:0/2199489911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fe80ca790 0x7f6fe8157860 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.447+0000 7f6fece19640 1 --2- 172.21.15.6:0/2199489911 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6fe806a540 0x7f6fe8157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.447+0000 7f6fece19640 1 -- 172.21.15.6:0/2199489911 >> 172.21.15.6:0/2199489911 conn(0x7f6fe8099490 msgr2=0x7f6fe80ae680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.447+0000 7f6fece19640 1 -- 172.21.15.6:0/2199489911 shutdown_connections 2023-07-21T22:19:29.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.447+0000 7f6fece19640 1 -- 172.21.15.6:0/2199489911 wait complete. 2023-07-21T22:19:29.515 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:19:29.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.615+0000 7f9fca2d8640 1 Processor -- start 2023-07-21T22:19:29.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.615+0000 7f9fca2d8640 1 -- start start 2023-07-21T22:19:29.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.615+0000 7f9fca2d8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9fc415bde0 0x7f9fc40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:29.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.615+0000 7f9fca2d8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9fc40d2fc0 0x7f9fc40b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:29.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.615+0000 7f9fca2d8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9fc40d2300 0x7f9fc40d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:29.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.615+0000 7f9fca2d8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc40d2ce0 con 0x7f9fc415bde0 2023-07-21T22:19:29.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.615+0000 7f9fca2d8640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc415c1b0 con 0x7f9fc40d2300 2023-07-21T22:19:29.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.615+0000 7f9fca2d8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc40b04c0 con 0x7f9fc40d2fc0 2023-07-21T22:19:29.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.615+0000 7f9fc3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9fc415bde0 0x7f9fc40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:29.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.615+0000 7f9fc3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9fc415bde0 0x7f9fc40d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33128/0 (socket says 172.21.15.6:33128) 2023-07-21T22:19:29.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.615+0000 7f9fc3fff640 1 -- 172.21.15.6:0/2076109051 learned_addr learned my addr 172.21.15.6:0/2076109051 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:29.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.615+0000 7f9fc37fe640 1 --2- 172.21.15.6:0/2076109051 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9fc40d2fc0 0x7f9fc40b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:29.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.615+0000 7f9fc8875640 1 --2- 172.21.15.6:0/2076109051 >> v2:172.21.15.161:3300/0 conn(0x7f9fc40d2300 0x7f9fc40d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:29.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.615+0000 7f9fc3fff640 1 -- 172.21.15.6:0/2076109051 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9fc40d2fc0 msgr2=0x7f9fc40b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:29.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.615+0000 7f9fc3fff640 1 --2- 172.21.15.6:0/2076109051 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9fc40d2fc0 0x7f9fc40b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.615+0000 7f9fc3fff640 1 -- 172.21.15.6:0/2076109051 >> v2:172.21.15.161:3300/0 conn(0x7f9fc40d2300 msgr2=0x7f9fc40d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:29.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.615+0000 7f9fc3fff640 1 --2- 172.21.15.6:0/2076109051 >> v2:172.21.15.161:3300/0 conn(0x7f9fc40d2300 0x7f9fc40d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.615+0000 7f9fc3fff640 1 -- 172.21.15.6:0/2076109051 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc40d0aa0 con 0x7f9fc415bde0 2023-07-21T22:19:29.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.619+0000 7f9fc3fff640 1 --2- 172.21.15.6:0/2076109051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fc415bde0 0x7f9fc40d0270 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40b83f0 tx=0x7f9fb401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf001228df650fd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:29.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.619+0000 7f9fc2ffd640 1 -- 172.21.15.6:0/2076109051 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb40aa620 con 0x7f9fc415bde0 2023-07-21T22:19:29.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.619+0000 7f9fc2ffd640 1 -- 172.21.15.6:0/2076109051 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb40aa780 con 0x7f9fc415bde0 2023-07-21T22:19:29.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.619+0000 7f9fc2ffd640 1 -- 172.21.15.6:0/2076109051 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb40aab10 con 0x7f9fc415bde0 2023-07-21T22:19:29.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.619+0000 7f9fca2d8640 1 -- 172.21.15.6:0/2076109051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fc415bde0 msgr2=0x7f9fc40d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.619+0000 7f9fca2d8640 1 --2- 172.21.15.6:0/2076109051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fc415bde0 0x7f9fc40d0270 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40b83f0 tx=0x7f9fb401c500 comp rx=0 tx=0).stop 2023-07-21T22:19:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.619+0000 7f9fca2d8640 1 -- 172.21.15.6:0/2076109051 shutdown_connections 2023-07-21T22:19:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.619+0000 7f9fca2d8640 1 --2- 172.21.15.6:0/2076109051 >> v2:172.21.15.161:3300/0 conn(0x7f9fc40d2300 0x7f9fc40d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.619+0000 7f9fca2d8640 1 --2- 172.21.15.6:0/2076109051 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9fc40d2fc0 0x7f9fc40b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.619+0000 7f9fca2d8640 1 --2- 172.21.15.6:0/2076109051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fc415bde0 0x7f9fc40d0270 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.619+0000 7f9fca2d8640 1 -- 172.21.15.6:0/2076109051 >> 172.21.15.6:0/2076109051 conn(0x7f9fc40659d0 msgr2=0x7f9fc409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:29.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.619+0000 7f9fca2d8640 1 -- 172.21.15.6:0/2076109051 shutdown_connections 2023-07-21T22:19:29.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.619+0000 7f9fca2d8640 1 -- 172.21.15.6:0/2076109051 wait complete. 2023-07-21T22:19:29.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fca2d8640 1 Processor -- start 2023-07-21T22:19:29.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fca2d8640 1 -- start start 2023-07-21T22:19:29.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fca2d8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9fc40d2300 0x7f9fc415af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:29.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fca2d8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fc40d2fc0 0x7f9fc4154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:29.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fca2d8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fc415bde0 0x7f9fc414ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:29.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fca2d8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc414e9f0 con 0x7f9fc415bde0 2023-07-21T22:19:29.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fca2d8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc415f1a0 con 0x7f9fc40d2fc0 2023-07-21T22:19:29.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fca2d8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc414fa90 con 0x7f9fc40d2300 2023-07-21T22:19:29.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fc8875640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fc415bde0 0x7f9fc414ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:29.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fc8875640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fc415bde0 0x7f9fc414ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33134/0 (socket says 172.21.15.6:33134) 2023-07-21T22:19:29.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fc8875640 1 -- 172.21.15.6:0/270719751 learned_addr learned my addr 172.21.15.6:0/270719751 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:29.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fc3fff640 1 --2- 172.21.15.6:0/270719751 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9fc40d2300 0x7f9fc415af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:29.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fc37fe640 1 --2- 172.21.15.6:0/270719751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fc40d2fc0 0x7f9fc4154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:29.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fc8875640 1 -- 172.21.15.6:0/270719751 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9fc40d2300 msgr2=0x7f9fc415af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:29.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fc8875640 1 --2- 172.21.15.6:0/270719751 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9fc40d2300 0x7f9fc415af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fc8875640 1 -- 172.21.15.6:0/270719751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fc40d2fc0 msgr2=0x7f9fc4154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:29.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fc8875640 1 --2- 172.21.15.6:0/270719751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fc40d2fc0 0x7f9fc4154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fc8875640 1 -- 172.21.15.6:0/270719751 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb4009480 con 0x7f9fc415bde0 2023-07-21T22:19:29.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fc8875640 1 --2- 172.21.15.6:0/270719751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fc415bde0 0x7f9fc414ee10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc007d50 tx=0x7f9fbc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:29.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fc0ff9640 1 -- 172.21.15.6:0/270719751 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc014420 con 0x7f9fc415bde0 2023-07-21T22:19:29.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fc0ff9640 1 -- 172.21.15.6:0/270719751 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fbc0145a0 con 0x7f9fc415bde0 2023-07-21T22:19:29.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fc0ff9640 1 -- 172.21.15.6:0/270719751 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc014950 con 0x7f9fc415bde0 2023-07-21T22:19:29.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fca2d8640 1 -- 172.21.15.6:0/270719751 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc415b4d0 con 0x7f9fc415bde0 2023-07-21T22:19:29.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fca2d8640 1 -- 172.21.15.6:0/270719751 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc414e330 con 0x7f9fc415bde0 2023-07-21T22:19:29.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.623+0000 7f9fca2d8640 1 -- 172.21.15.6:0/270719751 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc414eb30 con 0x7f9fc415bde0 2023-07-21T22:19:29.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.627+0000 7f9fc0ff9640 1 -- 172.21.15.6:0/270719751 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9fbc014ab0 con 0x7f9fc415bde0 2023-07-21T22:19:29.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.627+0000 7f9fc0ff9640 1 --2- 172.21.15.6:0/270719751 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9fb00662b0 0x7f9fb0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:29.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.627+0000 7f9fc0ff9640 1 -- 172.21.15.6:0/270719751 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9fbc084480 con 0x7f9fc415bde0 2023-07-21T22:19:29.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.627+0000 7f9fc3fff640 1 --2- 172.21.15.6:0/270719751 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9fb00662b0 0x7f9fb0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:29.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.627+0000 7f9fc3fff640 1 --2- 172.21.15.6:0/270719751 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9fb00662b0 0x7f9fb0068760 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40ae000 tx=0x7f9fb40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:29.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.631+0000 7f9fc0ff9640 1 -- 172.21.15.6:0/270719751 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9fc414eb30 con 0x7f9fc415bde0 2023-07-21T22:19:29.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.787+0000 7f9fca2d8640 1 -- 172.21.15.6:0/270719751 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9fc414eb30 con 0x7f9fc415bde0 2023-07-21T22:19:29.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.787+0000 7f9fc0ff9640 1 -- 172.21.15.6:0/270719751 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9fc414eb30 con 0x7f9fc415bde0 2023-07-21T22:19:29.837 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:19:29.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.791+0000 7f9fca2d8640 1 -- 172.21.15.6:0/270719751 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9fb00662b0 msgr2=0x7f9fb0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.791+0000 7f9fca2d8640 1 --2- 172.21.15.6:0/270719751 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9fb00662b0 0x7f9fb0068760 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40ae000 tx=0x7f9fb40a7000 comp rx=0 tx=0).stop 2023-07-21T22:19:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.791+0000 7f9fca2d8640 1 -- 172.21.15.6:0/270719751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fc415bde0 msgr2=0x7f9fc414ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.791+0000 7f9fca2d8640 1 --2- 172.21.15.6:0/270719751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fc415bde0 0x7f9fc414ee10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc007d50 tx=0x7f9fbc00e4b0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.791+0000 7f9fca2d8640 1 -- 172.21.15.6:0/270719751 shutdown_connections 2023-07-21T22:19:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.791+0000 7f9fca2d8640 1 --2- 172.21.15.6:0/270719751 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9fb00662b0 0x7f9fb0068760 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.791+0000 7f9fca2d8640 1 --2- 172.21.15.6:0/270719751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9fc415bde0 0x7f9fc414ee10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.791+0000 7f9fca2d8640 1 --2- 172.21.15.6:0/270719751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9fc40d2fc0 0x7f9fc4154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.791+0000 7f9fca2d8640 1 --2- 172.21.15.6:0/270719751 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9fc40d2300 0x7f9fc415af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.791+0000 7f9fca2d8640 1 -- 172.21.15.6:0/270719751 >> 172.21.15.6:0/270719751 conn(0x7f9fc40659d0 msgr2=0x7f9fc40cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.791+0000 7f9fca2d8640 1 -- 172.21.15.6:0/270719751 shutdown_connections 2023-07-21T22:19:29.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.791+0000 7f9fca2d8640 1 -- 172.21.15.6:0/270719751 wait complete. 2023-07-21T22:19:29.858 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:19:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.955+0000 7f618ee93640 1 Processor -- start 2023-07-21T22:19:30.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.955+0000 7f618ee93640 1 -- start start 2023-07-21T22:19:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.955+0000 7f618ee93640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6188158ce0 0x7f6188070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.955+0000 7f618ee93640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f61880c9730 0x7f61880ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.955+0000 7f618ee93640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61880cc700 con 0x7f61880c8ad0 2023-07-21T22:19:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.955+0000 7f618ee93640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61880b0ff0 con 0x7f6188158ce0 2023-07-21T22:19:30.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.955+0000 7f618ee93640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6188070c80 con 0x7f61880c9730 2023-07-21T22:19:30.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.955+0000 7f618cc2f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6188158ce0 0x7f6188070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.955+0000 7f6187fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f61880c8ad0 0x7f61880c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58550/0 (socket says 172.21.15.6:58550) 2023-07-21T22:19:30.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.955+0000 7f6187fff640 1 -- 172.21.15.6:0/368379427 learned_addr learned my addr 172.21.15.6:0/368379427 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:30.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.955+0000 7f618d430640 1 --2- 172.21.15.6:0/368379427 >> v2:172.21.15.161:3300/0 conn(0x7f61880c9730 0x7f61880ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.955+0000 7f618cc2f640 1 -- 172.21.15.6:0/368379427 >> v2:172.21.15.161:3300/0 conn(0x7f61880c9730 msgr2=0x7f61880ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:30.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.955+0000 7f618cc2f640 1 --2- 172.21.15.6:0/368379427 >> v2:172.21.15.161:3300/0 conn(0x7f61880c9730 0x7f61880ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.955+0000 7f618cc2f640 1 -- 172.21.15.6:0/368379427 >> v1:172.21.15.6:6789/0 conn(0x7f61880c8ad0 legacy=0x7f61880c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.959+0000 7f618cc2f640 1 -- 172.21.15.6:0/368379427 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61880cbdd0 con 0x7f6188158ce0 2023-07-21T22:19:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.959+0000 7f61877fe640 1 -- 172.21.15.6:0/368379427 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437470060 0 0) 0x7f61880cc700 con 0x7f61880c8ad0 2023-07-21T22:19:30.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.959+0000 7f618cc2f640 1 --2- 172.21.15.6:0/368379427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6188158ce0 0x7f6188070450 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f61880b0d70 tx=0x7f617c01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e21ad6b119db67 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.959+0000 7f61877fe640 1 -- 172.21.15.6:0/368379427 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c0ab600 con 0x7f6188158ce0 2023-07-21T22:19:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.959+0000 7f61877fe640 1 -- 172.21.15.6:0/368379427 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617c0a7050 con 0x7f6188158ce0 2023-07-21T22:19:30.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.959+0000 7f61877fe640 1 -- 172.21.15.6:0/368379427 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c0ab980 con 0x7f6188158ce0 2023-07-21T22:19:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.959+0000 7f618ee93640 1 -- 172.21.15.6:0/368379427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6188158ce0 msgr2=0x7f6188070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:30.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.959+0000 7f618ee93640 1 --2- 172.21.15.6:0/368379427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6188158ce0 0x7f6188070450 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f61880b0d70 tx=0x7f617c01c310 comp rx=0 tx=0).stop 2023-07-21T22:19:30.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.959+0000 7f618ee93640 1 -- 172.21.15.6:0/368379427 shutdown_connections 2023-07-21T22:19:30.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.959+0000 7f618ee93640 1 --2- 172.21.15.6:0/368379427 >> v2:172.21.15.161:3300/0 conn(0x7f61880c9730 0x7f61880ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.959+0000 7f618ee93640 1 --2- 172.21.15.6:0/368379427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6188158ce0 0x7f6188070450 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.959+0000 7f618ee93640 1 -- 172.21.15.6:0/368379427 >> 172.21.15.6:0/368379427 conn(0x7f61880afcf0 msgr2=0x7f61880b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:30.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f618ee93640 1 -- 172.21.15.6:0/368379427 shutdown_connections 2023-07-21T22:19:30.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f618ee93640 1 -- 172.21.15.6:0/368379427 wait complete. 2023-07-21T22:19:30.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f618ee93640 1 Processor -- start 2023-07-21T22:19:30.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f618ee93640 1 -- start start 2023-07-21T22:19:30.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f618ee93640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61880c8ad0 0x7f61881455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f618ee93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61880c9730 0x7f6188155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f618ee93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6188158ce0 0x7f61881504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f618ee93640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6188146920 con 0x7f6188158ce0 2023-07-21T22:19:30.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f618ee93640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6188146db0 con 0x7f61880c8ad0 2023-07-21T22:19:30.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f618ee93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6188155690 con 0x7f61880c9730 2023-07-21T22:19:30.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f618d430640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6188158ce0 0x7f61881504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f618d430640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6188158ce0 0x7f61881504b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33150/0 (socket says 172.21.15.6:33150) 2023-07-21T22:19:30.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f618d430640 1 -- 172.21.15.6:0/2302754246 learned_addr learned my addr 172.21.15.6:0/2302754246 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:30.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f618cc2f640 1 --2- 172.21.15.6:0/2302754246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61880c8ad0 0x7f61881455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f6187fff640 1 --2- 172.21.15.6:0/2302754246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61880c9730 0x7f6188155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f618d430640 1 -- 172.21.15.6:0/2302754246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61880c9730 msgr2=0x7f6188155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:30.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f618d430640 1 --2- 172.21.15.6:0/2302754246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61880c9730 0x7f6188155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f618d430640 1 -- 172.21.15.6:0/2302754246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61880c8ad0 msgr2=0x7f61881455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:30.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f618d430640 1 --2- 172.21.15.6:0/2302754246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61880c8ad0 0x7f61881455d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f618d430640 1 -- 172.21.15.6:0/2302754246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c009420 con 0x7f6188158ce0 2023-07-21T22:19:30.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.963+0000 7f618d430640 1 --2- 172.21.15.6:0/2302754246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6188158ce0 0x7f61881504b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6180007e30 tx=0x7f618000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:30.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.967+0000 7f61857fa640 1 -- 172.21.15.6:0/2302754246 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6180014620 con 0x7f6188158ce0 2023-07-21T22:19:30.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.967+0000 7f61857fa640 1 -- 172.21.15.6:0/2302754246 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618000ee90 con 0x7f6188158ce0 2023-07-21T22:19:30.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.967+0000 7f61857fa640 1 -- 172.21.15.6:0/2302754246 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61800149c0 con 0x7f6188158ce0 2023-07-21T22:19:30.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.967+0000 7f618ee93640 1 -- 172.21.15.6:0/2302754246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6188145d10 con 0x7f6188158ce0 2023-07-21T22:19:30.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.967+0000 7f618ee93640 1 -- 172.21.15.6:0/2302754246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61881462d0 con 0x7f6188158ce0 2023-07-21T22:19:30.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.967+0000 7f618ee93640 1 -- 172.21.15.6:0/2302754246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61880ca1a0 con 0x7f6188158ce0 2023-07-21T22:19:30.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.967+0000 7f61857fa640 1 -- 172.21.15.6:0/2302754246 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6180014b20 con 0x7f6188158ce0 2023-07-21T22:19:30.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.967+0000 7f61857fa640 1 --2- 172.21.15.6:0/2302754246 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f616c066280 0x7f616c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.967+0000 7f61857fa640 1 -- 172.21.15.6:0/2302754246 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f61800845f0 con 0x7f6188158ce0 2023-07-21T22:19:30.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.967+0000 7f618cc2f640 1 --2- 172.21.15.6:0/2302754246 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f616c066280 0x7f616c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.971+0000 7f618cc2f640 1 --2- 172.21.15.6:0/2302754246 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f616c066280 0x7f616c068730 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f617c0ad000 tx=0x7f617c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:30.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:29.971+0000 7f61857fa640 1 -- 172.21.15.6:0/2302754246 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6180051aa0 con 0x7f6188158ce0 2023-07-21T22:19:30.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.135+0000 7f618ee93640 1 -- 172.21.15.6:0/2302754246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f61880678d0 con 0x7f6188158ce0 2023-07-21T22:19:30.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.139+0000 7f61857fa640 1 -- 172.21.15.6:0/2302754246 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f61800550c0 con 0x7f6188158ce0 2023-07-21T22:19:30.185 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-07-21T22:19:30.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.139+0000 7f618ee93640 1 -- 172.21.15.6:0/2302754246 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f616c066280 msgr2=0x7f616c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:30.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.139+0000 7f618ee93640 1 --2- 172.21.15.6:0/2302754246 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f616c066280 0x7f616c068730 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f617c0ad000 tx=0x7f617c008040 comp rx=0 tx=0).stop 2023-07-21T22:19:30.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.139+0000 7f618ee93640 1 -- 172.21.15.6:0/2302754246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6188158ce0 msgr2=0x7f61881504b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:30.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.139+0000 7f618ee93640 1 --2- 172.21.15.6:0/2302754246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6188158ce0 0x7f61881504b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6180007e30 tx=0x7f618000e4b0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.139+0000 7f618ee93640 1 -- 172.21.15.6:0/2302754246 shutdown_connections 2023-07-21T22:19:30.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.139+0000 7f618ee93640 1 --2- 172.21.15.6:0/2302754246 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f616c066280 0x7f616c068730 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.139+0000 7f618ee93640 1 --2- 172.21.15.6:0/2302754246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6188158ce0 0x7f61881504b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.139+0000 7f618ee93640 1 --2- 172.21.15.6:0/2302754246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61880c9730 0x7f6188155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.139+0000 7f618ee93640 1 --2- 172.21.15.6:0/2302754246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61880c8ad0 0x7f61881455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.139+0000 7f618ee93640 1 -- 172.21.15.6:0/2302754246 >> 172.21.15.6:0/2302754246 conn(0x7f61880afcf0 msgr2=0x7f6188153d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:30.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.139+0000 7f618ee93640 1 -- 172.21.15.6:0/2302754246 shutdown_connections 2023-07-21T22:19:30.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.139+0000 7f618ee93640 1 -- 172.21.15.6:0/2302754246 wait complete. 2023-07-21T22:19:30.206 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-07-21T22:19:30.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:30.207 DEBUG:teuthology.orchestra.run.smithi161:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-07-21T22:19:30.292 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-07-21T22:19:30.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:30.293 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-21T22:19:30.303 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-21T22:19:30.304 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:19:30.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f0545a31640 1 Processor -- start 2023-07-21T22:19:30.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f0545a31640 1 -- start start 2023-07-21T22:19:30.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f0545a31640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f054015f3f0 0x7f05400b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f0545a31640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05400d13f0 0x7f05400b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f0545a31640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05400d0f60 con 0x7f05400cc9a0 2023-07-21T22:19:30.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f0545a31640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05400cd4e0 con 0x7f054015f3f0 2023-07-21T22:19:30.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f0545a31640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05400d0390 con 0x7f05400d13f0 2023-07-21T22:19:30.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f0545230640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f05400cc9a0 0x7f05400ccdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58562/0 (socket says 172.21.15.6:58562) 2023-07-21T22:19:30.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f0545230640 1 -- 172.21.15.6:0/2292154553 learned_addr learned my addr 172.21.15.6:0/2292154553 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:30.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f053ffff640 1 --2- 172.21.15.6:0/2292154553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05400d13f0 0x7f05400b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f0544a2f640 1 --2- 172.21.15.6:0/2292154553 >> v2:172.21.15.161:3300/0 conn(0x7f054015f3f0 0x7f05400b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f053f7fe640 1 -- 172.21.15.6:0/2292154553 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981855024 0 0) 0x7f05400d0f60 con 0x7f05400cc9a0 2023-07-21T22:19:30.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f053f7fe640 1 -- 172.21.15.6:0/2292154553 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0530003530 con 0x7f05400cc9a0 2023-07-21T22:19:30.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f053f7fe640 1 -- 172.21.15.6:0/2292154553 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4165877381 0 0) 0x7f0530003530 con 0x7f05400cc9a0 2023-07-21T22:19:30.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f053f7fe640 1 -- 172.21.15.6:0/2292154553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05400d13f0 msgr2=0x7f05400b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:30.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f053f7fe640 1 --2- 172.21.15.6:0/2292154553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05400d13f0 0x7f05400b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f053f7fe640 1 -- 172.21.15.6:0/2292154553 >> v2:172.21.15.161:3300/0 conn(0x7f054015f3f0 msgr2=0x7f05400b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:30.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f053f7fe640 1 --2- 172.21.15.6:0/2292154553 >> v2:172.21.15.161:3300/0 conn(0x7f054015f3f0 0x7f05400b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f053f7fe640 1 -- 172.21.15.6:0/2292154553 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05400d0630 con 0x7f05400cc9a0 2023-07-21T22:19:30.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f053f7fe640 1 -- 172.21.15.6:0/2292154553 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f0538001a00 con 0x7f05400cc9a0 2023-07-21T22:19:30.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f053f7fe640 1 -- 172.21.15.6:0/2292154553 >> v1:172.21.15.6:6789/0 conn(0x7f05400cc9a0 legacy=0x7f05400ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:30.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f053f7fe640 1 --2- 172.21.15.6:0/2292154553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05400d13f0 0x7f0530003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f053f7fe640 1 --2- 172.21.15.6:0/2292154553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0530003f00 0x7f05300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f053f7fe640 1 --2- 172.21.15.6:0/2292154553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0530004d10 0x7f0530005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f053f7fe640 1 -- 172.21.15.6:0/2292154553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05400cd4e0 con 0x7f0530004d10 2023-07-21T22:19:30.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f053f7fe640 1 -- 172.21.15.6:0/2292154553 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05400d0390 con 0x7f0530003f00 2023-07-21T22:19:30.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f053f7fe640 1 -- 172.21.15.6:0/2292154553 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053000b9c0 con 0x7f05400d13f0 2023-07-21T22:19:30.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f0544a2f640 1 --2- 172.21.15.6:0/2292154553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05400d13f0 0x7f0530003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f0545230640 1 --2- 172.21.15.6:0/2292154553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0530004d10 0x7f0530005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f053ffff640 1 --2- 172.21.15.6:0/2292154553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0530003f00 0x7f05300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f0545230640 1 -- 172.21.15.6:0/2292154553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05400d13f0 msgr2=0x7f0530003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:30.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f0545230640 1 --2- 172.21.15.6:0/2292154553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05400d13f0 0x7f0530003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f0545230640 1 -- 172.21.15.6:0/2292154553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0530003f00 msgr2=0x7f05300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:30.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f0545230640 1 --2- 172.21.15.6:0/2292154553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0530003f00 0x7f05300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f0545230640 1 -- 172.21.15.6:0/2292154553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0530003530 con 0x7f0530004d10 2023-07-21T22:19:30.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.403+0000 7f0544a2f640 1 --2- 172.21.15.6:0/2292154553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05400d13f0 0x7f0530003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:30.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.407+0000 7f0545230640 1 --2- 172.21.15.6:0/2292154553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0530004d10 0x7f0530005180 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f053800a860 tx=0x7f053801fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e83021afc00b73 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:30.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.407+0000 7f053f7fe640 1 -- 172.21.15.6:0/2292154553 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05380aa6f0 con 0x7f0530004d10 2023-07-21T22:19:30.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.407+0000 7f053f7fe640 1 -- 172.21.15.6:0/2292154553 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05380aa850 con 0x7f0530004d10 2023-07-21T22:19:30.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.407+0000 7f053f7fe640 1 -- 172.21.15.6:0/2292154553 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05380aac60 con 0x7f0530004d10 2023-07-21T22:19:30.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.407+0000 7f0545a31640 1 -- 172.21.15.6:0/2292154553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0530004d10 msgr2=0x7f0530005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:30.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.407+0000 7f0545a31640 1 --2- 172.21.15.6:0/2292154553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0530004d10 0x7f0530005180 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f053800a860 tx=0x7f053801fa60 comp rx=0 tx=0).stop 2023-07-21T22:19:30.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.407+0000 7f0545230640 1 -- 172.21.15.6:0/2292154553 reap_dead start 2023-07-21T22:19:30.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.407+0000 7f0545a31640 1 -- 172.21.15.6:0/2292154553 shutdown_connections 2023-07-21T22:19:30.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.407+0000 7f0545a31640 1 -- 172.21.15.6:0/2292154553 >> 172.21.15.6:0/2292154553 conn(0x7f0540069f50 msgr2=0x7f054006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:30.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.407+0000 7f0545a31640 1 -- 172.21.15.6:0/2292154553 shutdown_connections 2023-07-21T22:19:30.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.407+0000 7f0545a31640 1 -- 172.21.15.6:0/2292154553 wait complete. 2023-07-21T22:19:30.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f0545a31640 1 Processor -- start 2023-07-21T22:19:30.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f0545a31640 1 -- start start 2023-07-21T22:19:30.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f0545a31640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0530004d10 0x7f05401f1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f0545a31640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05400b4ff0 0x7f054015cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f0545a31640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05400b5440 0x7f054015cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f0545a31640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05401f1eb0 con 0x7f05400b4ff0 2023-07-21T22:19:30.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f0545a31640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05401f2940 con 0x7f05400b5440 2023-07-21T22:19:30.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f0545a31640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05401f20a0 con 0x7f0530004d10 2023-07-21T22:19:30.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f053ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05400b4ff0 0x7f054015cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f053ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05400b4ff0 0x7f054015cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33162/0 (socket says 172.21.15.6:33162) 2023-07-21T22:19:30.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f053ffff640 1 -- 172.21.15.6:0/4261303664 learned_addr learned my addr 172.21.15.6:0/4261303664 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:30.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f0545230640 1 --2- 172.21.15.6:0/4261303664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05400b5440 0x7f054015cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f0544a2f640 1 --2- 172.21.15.6:0/4261303664 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0530004d10 0x7f05401f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f053ffff640 1 -- 172.21.15.6:0/4261303664 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0530004d10 msgr2=0x7f05401f1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:30.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f053ffff640 1 --2- 172.21.15.6:0/4261303664 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0530004d10 0x7f05401f1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f053ffff640 1 -- 172.21.15.6:0/4261303664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05400b5440 msgr2=0x7f054015cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:30.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f053ffff640 1 --2- 172.21.15.6:0/4261303664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05400b5440 0x7f054015cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f053ffff640 1 -- 172.21.15.6:0/4261303664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05401f2380 con 0x7f05400b4ff0 2023-07-21T22:19:30.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f0545230640 1 --2- 172.21.15.6:0/4261303664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05400b5440 0x7f054015cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:30.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f053ffff640 1 --2- 172.21.15.6:0/4261303664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05400b4ff0 0x7f054015cab0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f052c0119d0 tx=0x7f052c011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:30.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f053d7fa640 1 -- 172.21.15.6:0/4261303664 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c00faf0 con 0x7f05400b4ff0 2023-07-21T22:19:30.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f053d7fa640 1 -- 172.21.15.6:0/4261303664 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c00fc50 con 0x7f05400b4ff0 2023-07-21T22:19:30.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f053d7fa640 1 -- 172.21.15.6:0/4261303664 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c014440 con 0x7f05400b4ff0 2023-07-21T22:19:30.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f0545a31640 1 -- 172.21.15.6:0/4261303664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05401f2660 con 0x7f05400b4ff0 2023-07-21T22:19:30.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.411+0000 7f0545a31640 1 -- 172.21.15.6:0/4261303664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05400b3830 con 0x7f05400b4ff0 2023-07-21T22:19:30.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.415+0000 7f0545a31640 1 -- 172.21.15.6:0/4261303664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05400678d0 con 0x7f05400b4ff0 2023-07-21T22:19:30.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.415+0000 7f053d7fa640 1 -- 172.21.15.6:0/4261303664 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f052c0145a0 con 0x7f05400b4ff0 2023-07-21T22:19:30.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.415+0000 7f053d7fa640 1 --2- 172.21.15.6:0/4261303664 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0524066280 0x7f0524068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.415+0000 7f053d7fa640 1 -- 172.21.15.6:0/4261303664 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f052c084500 con 0x7f05400b4ff0 2023-07-21T22:19:30.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.415+0000 7f0544a2f640 1 --2- 172.21.15.6:0/4261303664 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0524066280 0x7f0524068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.415+0000 7f0544a2f640 1 --2- 172.21.15.6:0/4261303664 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0524066280 0x7f0524068730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0534009e00 tx=0x7f0534009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:30.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.419+0000 7f053d7fa640 1 -- 172.21.15.6:0/4261303664 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f052c051960 con 0x7f05400b4ff0 2023-07-21T22:19:30.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.607+0000 7f0545a31640 1 -- 172.21.15.6:0/4261303664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05400d3060 con 0x7f05400b4ff0 2023-07-21T22:19:30.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.607+0000 7f053d7fa640 1 -- 172.21.15.6:0/4261303664 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f052c054f80 con 0x7f05400b4ff0 2023-07-21T22:19:30.657 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:30.657 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3109831689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3109831689},{"type":"v1","addr":"172.21.15.6:6834","nonce":3109831689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/937908788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":937908788},{"type":"v1","addr":"172.21.15.161:6836","nonce":937908788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/445360801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":445360801},{"type":"v1","addr":"172.21.15.6:6835","nonce":445360801}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:18:43.722596+0000","modified":"2023-07-21T22:18:47.542628+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/747850146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":747850146},{"type":"v1","addr":"172.21.15.161:6837","nonce":747850146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:19:30.657 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-07-21T22:19:30.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.611+0000 7f0545a31640 1 -- 172.21.15.6:0/4261303664 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0524066280 msgr2=0x7f0524068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:30.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.611+0000 7f0545a31640 1 --2- 172.21.15.6:0/4261303664 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0524066280 0x7f0524068730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0534009e00 tx=0x7f0534009190 comp rx=0 tx=0).stop 2023-07-21T22:19:30.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.611+0000 7f0545a31640 1 -- 172.21.15.6:0/4261303664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05400b4ff0 msgr2=0x7f054015cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:30.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.611+0000 7f0545a31640 1 --2- 172.21.15.6:0/4261303664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05400b4ff0 0x7f054015cab0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f052c0119d0 tx=0x7f052c011dd0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.611+0000 7f0545a31640 1 -- 172.21.15.6:0/4261303664 shutdown_connections 2023-07-21T22:19:30.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.611+0000 7f0545a31640 1 --2- 172.21.15.6:0/4261303664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05400b5440 0x7f054015cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.611+0000 7f0545a31640 1 --2- 172.21.15.6:0/4261303664 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0524066280 0x7f0524068730 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.611+0000 7f0545a31640 1 --2- 172.21.15.6:0/4261303664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05400b4ff0 0x7f054015cab0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.611+0000 7f0545a31640 1 --2- 172.21.15.6:0/4261303664 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0530004d10 0x7f05401f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.611+0000 7f0545a31640 1 -- 172.21.15.6:0/4261303664 >> 172.21.15.6:0/4261303664 conn(0x7f0540069f50 msgr2=0x7f05400d2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:30.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.611+0000 7f0545a31640 1 -- 172.21.15.6:0/4261303664 shutdown_connections 2023-07-21T22:19:30.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.611+0000 7f0545a31640 1 -- 172.21.15.6:0/4261303664 wait complete. 2023-07-21T22:19:30.678 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:19:30.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.775+0000 7febddb67640 1 Processor -- start 2023-07-21T22:19:30.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.775+0000 7febddb67640 1 -- start start 2023-07-21T22:19:30.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.779+0000 7febddb67640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7febd8160450 0x7febd806e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.779+0000 7febddb67640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7febd8069430 0x7febd8069830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.779+0000 7febddb67640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd80c9c30 con 0x7febd815bc00 2023-07-21T22:19:30.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.779+0000 7febddb67640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd80c96b0 con 0x7febd8160450 2023-07-21T22:19:30.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.779+0000 7febddb67640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd815bfd0 con 0x7febd8069430 2023-07-21T22:19:30.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.779+0000 7febcffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7febd8160450 0x7febd806e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.779+0000 7febcffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7febd8160450 0x7febd806e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33176/0 (socket says 172.21.15.6:33176) 2023-07-21T22:19:30.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.779+0000 7febcffff640 1 -- 172.21.15.6:0/1184033324 learned_addr learned my addr 172.21.15.6:0/1184033324 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:30.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.779+0000 7febd7fff640 1 --2- 172.21.15.6:0/1184033324 >> v2:172.21.15.161:3300/0 conn(0x7febd8069430 0x7febd8069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.779+0000 7febcffff640 1 -- 172.21.15.6:0/1184033324 >> v2:172.21.15.161:3300/0 conn(0x7febd8069430 msgr2=0x7febd8069830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:30.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.779+0000 7febcffff640 1 --2- 172.21.15.6:0/1184033324 >> v2:172.21.15.161:3300/0 conn(0x7febd8069430 0x7febd8069830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.779+0000 7febcffff640 1 -- 172.21.15.6:0/1184033324 >> v1:172.21.15.161:6789/0 conn(0x7febd815bc00 legacy=0x7febd80ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:30.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.779+0000 7febcffff640 1 -- 172.21.15.6:0/1184033324 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd8069d70 con 0x7febd8160450 2023-07-21T22:19:30.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.783+0000 7febcffff640 1 --2- 172.21.15.6:0/1184033324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd8160450 0x7febd806e690 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7febd80ce4e0 tx=0x7febc001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e784be3559b7d9ef server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:30.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.783+0000 7febd6ffd640 1 -- 172.21.15.6:0/1184033324 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc00aa5f0 con 0x7febd8160450 2023-07-21T22:19:30.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.783+0000 7febd6ffd640 1 -- 172.21.15.6:0/1184033324 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc00aa750 con 0x7febd8160450 2023-07-21T22:19:30.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.783+0000 7febd6ffd640 1 -- 172.21.15.6:0/1184033324 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc00aaae0 con 0x7febd8160450 2023-07-21T22:19:30.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.783+0000 7febddb67640 1 -- 172.21.15.6:0/1184033324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd8160450 msgr2=0x7febd806e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:30.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.783+0000 7febddb67640 1 --2- 172.21.15.6:0/1184033324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd8160450 0x7febd806e690 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7febd80ce4e0 tx=0x7febc001c490 comp rx=0 tx=0).stop 2023-07-21T22:19:30.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.783+0000 7febddb67640 1 -- 172.21.15.6:0/1184033324 shutdown_connections 2023-07-21T22:19:30.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.783+0000 7febddb67640 1 --2- 172.21.15.6:0/1184033324 >> v2:172.21.15.161:3300/0 conn(0x7febd8069430 0x7febd8069830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.783+0000 7febddb67640 1 --2- 172.21.15.6:0/1184033324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd8160450 0x7febd806e690 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.783+0000 7febddb67640 1 -- 172.21.15.6:0/1184033324 >> 172.21.15.6:0/1184033324 conn(0x7febd80b1840 msgr2=0x7febd80cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:30.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.783+0000 7febddb67640 1 -- 172.21.15.6:0/1184033324 shutdown_connections 2023-07-21T22:19:30.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.783+0000 7febddb67640 1 -- 172.21.15.6:0/1184033324 wait complete. 2023-07-21T22:19:30.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.783+0000 7febddb67640 1 Processor -- start 2023-07-21T22:19:30.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.783+0000 7febddb67640 1 -- start start 2023-07-21T22:19:30.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.783+0000 7febddb67640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febd8069430 0x7febd8150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.783+0000 7febddb67640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febd815bc00 0x7febd80c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.783+0000 7febddb67640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd8160450 0x7febd80b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.783+0000 7febddb67640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd8150e60 con 0x7febd8160450 2023-07-21T22:19:30.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.783+0000 7febddb67640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd80c7440 con 0x7febd8069430 2023-07-21T22:19:30.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.783+0000 7febddb67640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd80c7720 con 0x7febd815bc00 2023-07-21T22:19:30.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.787+0000 7febd7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd8160450 0x7febd80b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.787+0000 7febd7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd8160450 0x7febd80b2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33186/0 (socket says 172.21.15.6:33186) 2023-07-21T22:19:30.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.787+0000 7febd7fff640 1 -- 172.21.15.6:0/1009807523 learned_addr learned my addr 172.21.15.6:0/1009807523 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:30.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.787+0000 7febcffff640 1 --2- 172.21.15.6:0/1009807523 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febd815bc00 0x7febd80c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.787+0000 7febd77fe640 1 --2- 172.21.15.6:0/1009807523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febd8069430 0x7febd8150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.787+0000 7febd7fff640 1 -- 172.21.15.6:0/1009807523 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febd815bc00 msgr2=0x7febd80c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:30.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.787+0000 7febd7fff640 1 --2- 172.21.15.6:0/1009807523 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febd815bc00 0x7febd80c6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.787+0000 7febd7fff640 1 -- 172.21.15.6:0/1009807523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febd8069430 msgr2=0x7febd8150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:30.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.787+0000 7febd7fff640 1 --2- 172.21.15.6:0/1009807523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febd8069430 0x7febd8150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:30.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.787+0000 7febd7fff640 1 -- 172.21.15.6:0/1009807523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc00094d0 con 0x7febd8160450 2023-07-21T22:19:30.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.787+0000 7febd7fff640 1 --2- 172.21.15.6:0/1009807523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd8160450 0x7febd80b2310 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7febd0007e40 tx=0x7febd000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:30.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.787+0000 7febd4ff9640 1 -- 172.21.15.6:0/1009807523 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd0014620 con 0x7febd8160450 2023-07-21T22:19:30.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.787+0000 7febd4ff9640 1 -- 172.21.15.6:0/1009807523 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd000ee90 con 0x7febd8160450 2023-07-21T22:19:30.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.787+0000 7febd4ff9640 1 -- 172.21.15.6:0/1009807523 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd00149e0 con 0x7febd8160450 2023-07-21T22:19:30.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.787+0000 7febddb67640 1 -- 172.21.15.6:0/1009807523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd80c7a00 con 0x7febd8160450 2023-07-21T22:19:30.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.787+0000 7febddb67640 1 -- 172.21.15.6:0/1009807523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd80c7fc0 con 0x7febd8160450 2023-07-21T22:19:30.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.787+0000 7febddb67640 1 -- 172.21.15.6:0/1009807523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd80b1ff0 con 0x7febd8160450 2023-07-21T22:19:30.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.787+0000 7febd4ff9640 1 -- 172.21.15.6:0/1009807523 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7febd0014b40 con 0x7febd8160450 2023-07-21T22:19:30.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.791+0000 7febd4ff9640 1 --2- 172.21.15.6:0/1009807523 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7febb80662b0 0x7febb8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:30.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.791+0000 7febd4ff9640 1 -- 172.21.15.6:0/1009807523 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7febd0084650 con 0x7febd8160450 2023-07-21T22:19:30.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.791+0000 7febd77fe640 1 --2- 172.21.15.6:0/1009807523 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7febb80662b0 0x7febb8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:30.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.791+0000 7febd77fe640 1 --2- 172.21.15.6:0/1009807523 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7febb80662b0 0x7febb8068760 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7febc8007fd0 tx=0x7febc8007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:30.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.791+0000 7febd4ff9640 1 -- 172.21.15.6:0/1009807523 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7febd0051aa0 con 0x7febd8160450 2023-07-21T22:19:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.951+0000 7febddb67640 1 -- 172.21.15.6:0/1009807523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febd80678d0 con 0x7febd8160450 2023-07-21T22:19:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.951+0000 7febd4ff9640 1 -- 172.21.15.6:0/1009807523 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18302 (secure 0 0 0) 0x7febd00550c0 con 0x7febd8160450 2023-07-21T22:19:31.000 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:31.000 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":28,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:19:24.603032+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:18:41.465054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:18:42.709896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:19:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.955+0000 7febddb67640 1 -- 172.21.15.6:0/1009807523 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7febb80662b0 msgr2=0x7febb8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.955+0000 7febddb67640 1 --2- 172.21.15.6:0/1009807523 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7febb80662b0 0x7febb8068760 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7febc8007fd0 tx=0x7febc8007e40 comp rx=0 tx=0).stop 2023-07-21T22:19:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.955+0000 7febddb67640 1 -- 172.21.15.6:0/1009807523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd8160450 msgr2=0x7febd80b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.955+0000 7febddb67640 1 --2- 172.21.15.6:0/1009807523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd8160450 0x7febd80b2310 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7febd0007e40 tx=0x7febd000e4b0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.955+0000 7febddb67640 1 -- 172.21.15.6:0/1009807523 shutdown_connections 2023-07-21T22:19:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.955+0000 7febddb67640 1 --2- 172.21.15.6:0/1009807523 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7febb80662b0 0x7febb8068760 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.955+0000 7febddb67640 1 --2- 172.21.15.6:0/1009807523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7febd8160450 0x7febd80b2310 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.955+0000 7febddb67640 1 --2- 172.21.15.6:0/1009807523 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febd815bc00 0x7febd80c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.955+0000 7febddb67640 1 --2- 172.21.15.6:0/1009807523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febd8069430 0x7febd8150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.955+0000 7febddb67640 1 -- 172.21.15.6:0/1009807523 >> 172.21.15.6:0/1009807523 conn(0x7febd80b1840 msgr2=0x7febd8157720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:31.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.955+0000 7febddb67640 1 -- 172.21.15.6:0/1009807523 shutdown_connections 2023-07-21T22:19:31.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:30.955+0000 7febddb67640 1 -- 172.21.15.6:0/1009807523 wait complete. 2023-07-21T22:19:31.021 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:18:41.465054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:18:42.709896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:19:31.022 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:19:31.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.119+0000 7fbc8b634640 1 Processor -- start 2023-07-21T22:19:31.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.119+0000 7fbc8b634640 1 -- start start 2023-07-21T22:19:31.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.123+0000 7fbc8b634640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbc8406a440 0x7fbc840b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.123+0000 7fbc8b634640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbc841453a0 0x7fbc8406c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.123+0000 7fbc8b634640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8406c040 con 0x7fbc8415f690 2023-07-21T22:19:31.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.123+0000 7fbc8b634640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc84160170 con 0x7fbc8406a440 2023-07-21T22:19:31.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.123+0000 7fbc8b634640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc84160600 con 0x7fbc841453a0 2023-07-21T22:19:31.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.123+0000 7fbc88bcf640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbc8406a440 0x7fbc840b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.123+0000 7fbc88bcf640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbc8406a440 0x7fbc840b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33202/0 (socket says 172.21.15.6:33202) 2023-07-21T22:19:31.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.123+0000 7fbc88bcf640 1 -- 172.21.15.6:0/3587430028 learned_addr learned my addr 172.21.15.6:0/3587430028 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:31.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.123+0000 7fbc89bd1640 1 --2- 172.21.15.6:0/3587430028 >> v2:172.21.15.161:3300/0 conn(0x7fbc841453a0 0x7fbc8406c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.123+0000 7fbc88bcf640 1 -- 172.21.15.6:0/3587430028 >> v2:172.21.15.161:3300/0 conn(0x7fbc841453a0 msgr2=0x7fbc8406c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:31.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.123+0000 7fbc88bcf640 1 --2- 172.21.15.6:0/3587430028 >> v2:172.21.15.161:3300/0 conn(0x7fbc841453a0 0x7fbc8406c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.123+0000 7fbc88bcf640 1 -- 172.21.15.6:0/3587430028 >> v1:172.21.15.161:6789/0 conn(0x7fbc8415f690 legacy=0x7fbc8415fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:31.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.123+0000 7fbc88bcf640 1 -- 172.21.15.6:0/3587430028 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc84160360 con 0x7fbc8406a440 2023-07-21T22:19:31.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.127+0000 7fbc88bcf640 1 --2- 172.21.15.6:0/3587430028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc8406a440 0x7fbc840b1890 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbc8406f580 tx=0x7fbc7401c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85176c0c7511f52d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:31.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.127+0000 7fbc7bfff640 1 -- 172.21.15.6:0/3587430028 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc740ab600 con 0x7fbc8406a440 2023-07-21T22:19:31.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.127+0000 7fbc7bfff640 1 -- 172.21.15.6:0/3587430028 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc740a7050 con 0x7fbc8406a440 2023-07-21T22:19:31.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.127+0000 7fbc7bfff640 1 -- 172.21.15.6:0/3587430028 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc740ab980 con 0x7fbc8406a440 2023-07-21T22:19:31.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.127+0000 7fbc8b634640 1 -- 172.21.15.6:0/3587430028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc8406a440 msgr2=0x7fbc840b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.127+0000 7fbc8b634640 1 --2- 172.21.15.6:0/3587430028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc8406a440 0x7fbc840b1890 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbc8406f580 tx=0x7fbc7401c220 comp rx=0 tx=0).stop 2023-07-21T22:19:31.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.127+0000 7fbc8b634640 1 -- 172.21.15.6:0/3587430028 shutdown_connections 2023-07-21T22:19:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.127+0000 7fbc8b634640 1 --2- 172.21.15.6:0/3587430028 >> v2:172.21.15.161:3300/0 conn(0x7fbc841453a0 0x7fbc8406c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.127+0000 7fbc8b634640 1 --2- 172.21.15.6:0/3587430028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc8406a440 0x7fbc840b1890 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.127+0000 7fbc8b634640 1 -- 172.21.15.6:0/3587430028 >> 172.21.15.6:0/3587430028 conn(0x7fbc840b1210 msgr2=0x7fbc840ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.127+0000 7fbc8b634640 1 -- 172.21.15.6:0/3587430028 shutdown_connections 2023-07-21T22:19:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.127+0000 7fbc8b634640 1 -- 172.21.15.6:0/3587430028 wait complete. 2023-07-21T22:19:31.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.127+0000 7fbc8b634640 1 Processor -- start 2023-07-21T22:19:31.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.127+0000 7fbc8b634640 1 -- start start 2023-07-21T22:19:31.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.127+0000 7fbc8b634640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc8406a440 0x7fbc8413d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc8b634640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc841453a0 0x7fbc8413da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc8b634640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc8415f690 0x7fbc8413df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc8b634640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8415d2d0 con 0x7fbc8415f690 2023-07-21T22:19:31.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc8b634640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8413d7b0 con 0x7fbc8406a440 2023-07-21T22:19:31.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc8b634640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8415c650 con 0x7fbc841453a0 2023-07-21T22:19:31.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc89bd1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc8415f690 0x7fbc8413df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc89bd1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc8415f690 0x7fbc8413df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33214/0 (socket says 172.21.15.6:33214) 2023-07-21T22:19:31.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc89bd1640 1 -- 172.21.15.6:0/4086113939 learned_addr learned my addr 172.21.15.6:0/4086113939 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:31.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc893d0640 1 --2- 172.21.15.6:0/4086113939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc8406a440 0x7fbc8413d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc88bcf640 1 --2- 172.21.15.6:0/4086113939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc841453a0 0x7fbc8413da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc89bd1640 1 -- 172.21.15.6:0/4086113939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc841453a0 msgr2=0x7fbc8413da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc89bd1640 1 --2- 172.21.15.6:0/4086113939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc841453a0 0x7fbc8413da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc89bd1640 1 -- 172.21.15.6:0/4086113939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc8406a440 msgr2=0x7fbc8413d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc89bd1640 1 --2- 172.21.15.6:0/4086113939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc8406a440 0x7fbc8413d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc89bd1640 1 -- 172.21.15.6:0/4086113939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc740094d0 con 0x7fbc8415f690 2023-07-21T22:19:31.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc88bcf640 1 --2- 172.21.15.6:0/4086113939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc841453a0 0x7fbc8413da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:31.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc89bd1640 1 --2- 172.21.15.6:0/4086113939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc8415f690 0x7fbc8413df70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c007e40 tx=0x7fbc7c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:31.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc79ffb640 1 -- 172.21.15.6:0/4086113939 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c014620 con 0x7fbc8415f690 2023-07-21T22:19:31.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc79ffb640 1 -- 172.21.15.6:0/4086113939 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c00ee90 con 0x7fbc8415f690 2023-07-21T22:19:31.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc79ffb640 1 -- 172.21.15.6:0/4086113939 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c0149e0 con 0x7fbc8415f690 2023-07-21T22:19:31.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc8b634640 1 -- 172.21.15.6:0/4086113939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8415c930 con 0x7fbc8415f690 2023-07-21T22:19:31.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc8b634640 1 -- 172.21.15.6:0/4086113939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8415cef0 con 0x7fbc8415f690 2023-07-21T22:19:31.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc8b634640 1 -- 172.21.15.6:0/4086113939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc841f3dc0 con 0x7fbc8415f690 2023-07-21T22:19:31.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.131+0000 7fbc79ffb640 1 -- 172.21.15.6:0/4086113939 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbc7c014b40 con 0x7fbc8415f690 2023-07-21T22:19:31.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.135+0000 7fbc79ffb640 1 --2- 172.21.15.6:0/4086113939 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbc68066280 0x7fbc68068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.135+0000 7fbc79ffb640 1 -- 172.21.15.6:0/4086113939 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbc7c0845d0 con 0x7fbc8415f690 2023-07-21T22:19:31.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.135+0000 7fbc893d0640 1 --2- 172.21.15.6:0/4086113939 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbc68066280 0x7fbc68068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.135+0000 7fbc893d0640 1 --2- 172.21.15.6:0/4086113939 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbc68066280 0x7fbc68068730 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbc80007fd0 tx=0x7fbc80007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:31.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.139+0000 7fbc79ffb640 1 -- 172.21.15.6:0/4086113939 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbc841f3dc0 con 0x7fbc8415f690 2023-07-21T22:19:31.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.291+0000 7fbc8b634640 1 -- 172.21.15.6:0/4086113939 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbc841f3dc0 con 0x7fbc8415f690 2023-07-21T22:19:31.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.291+0000 7fbc79ffb640 1 -- 172.21.15.6:0/4086113939 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbc841f3dc0 con 0x7fbc8415f690 2023-07-21T22:19:31.341 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:19:31.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.295+0000 7fbc8b634640 1 -- 172.21.15.6:0/4086113939 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbc68066280 msgr2=0x7fbc68068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.295+0000 7fbc8b634640 1 --2- 172.21.15.6:0/4086113939 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbc68066280 0x7fbc68068730 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbc80007fd0 tx=0x7fbc80007e40 comp rx=0 tx=0).stop 2023-07-21T22:19:31.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.295+0000 7fbc8b634640 1 -- 172.21.15.6:0/4086113939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc8415f690 msgr2=0x7fbc8413df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.295+0000 7fbc8b634640 1 --2- 172.21.15.6:0/4086113939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc8415f690 0x7fbc8413df70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c007e40 tx=0x7fbc7c00e4b0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.295+0000 7fbc8b634640 1 -- 172.21.15.6:0/4086113939 shutdown_connections 2023-07-21T22:19:31.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.295+0000 7fbc8b634640 1 --2- 172.21.15.6:0/4086113939 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbc68066280 0x7fbc68068730 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.295+0000 7fbc8b634640 1 --2- 172.21.15.6:0/4086113939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc8415f690 0x7fbc8413df70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.295+0000 7fbc8b634640 1 --2- 172.21.15.6:0/4086113939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc841453a0 0x7fbc8413da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.295+0000 7fbc8b634640 1 --2- 172.21.15.6:0/4086113939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc8406a440 0x7fbc8413d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.295+0000 7fbc8b634640 1 -- 172.21.15.6:0/4086113939 >> 172.21.15.6:0/4086113939 conn(0x7fbc840b1210 msgr2=0x7fbc84141840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:31.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.295+0000 7fbc8b634640 1 -- 172.21.15.6:0/4086113939 shutdown_connections 2023-07-21T22:19:31.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.295+0000 7fbc8b634640 1 -- 172.21.15.6:0/4086113939 wait complete. 2023-07-21T22:19:31.362 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:19:31.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.463+0000 7f5b821d3640 1 Processor -- start 2023-07-21T22:19:31.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.463+0000 7f5b821d3640 1 -- start start 2023-07-21T22:19:31.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.463+0000 7f5b821d3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b7c070f30 0x7f5b7c0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.463+0000 7f5b821d3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5b7c0af2b0 0x7f5b7c15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.463+0000 7f5b821d3640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7c159d70 con 0x7f5b7c069430 2023-07-21T22:19:31.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.463+0000 7f5b821d3640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7c0c9c60 con 0x7f5b7c070f30 2023-07-21T22:19:31.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.463+0000 7f5b821d3640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7c0c9f40 con 0x7f5b7c0af2b0 2023-07-21T22:19:31.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.463+0000 7f5b7affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b7c070f30 0x7f5b7c0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.463+0000 7f5b7affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b7c070f30 0x7f5b7c0ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33216/0 (socket says 172.21.15.6:33216) 2023-07-21T22:19:31.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.463+0000 7f5b7affd640 1 -- 172.21.15.6:0/724579772 learned_addr learned my addr 172.21.15.6:0/724579772 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:31.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.463+0000 7f5b7bfff640 1 --2- 172.21.15.6:0/724579772 >> v2:172.21.15.161:3300/0 conn(0x7f5b7c0af2b0 0x7f5b7c15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.463+0000 7f5b7affd640 1 -- 172.21.15.6:0/724579772 >> v2:172.21.15.161:3300/0 conn(0x7f5b7c0af2b0 msgr2=0x7f5b7c15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:31.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.463+0000 7f5b7affd640 1 --2- 172.21.15.6:0/724579772 >> v2:172.21.15.161:3300/0 conn(0x7f5b7c0af2b0 0x7f5b7c15a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.463+0000 7f5b7affd640 1 -- 172.21.15.6:0/724579772 >> v1:172.21.15.161:6789/0 conn(0x7f5b7c069430 legacy=0x7f5b7c069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.463+0000 7f5b7affd640 1 -- 172.21.15.6:0/724579772 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c0ca220 con 0x7f5b7c070f30 2023-07-21T22:19:31.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.467+0000 7f5b7affd640 1 --2- 172.21.15.6:0/724579772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c070f30 0x7f5b7c0ad6f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0cef70 tx=0x7f5b7001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ffd81edf8d0c8c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:31.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.467+0000 7f5b7a7fc640 1 -- 172.21.15.6:0/724579772 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b700aa660 con 0x7f5b7c070f30 2023-07-21T22:19:31.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.467+0000 7f5b7a7fc640 1 -- 172.21.15.6:0/724579772 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b700aa7c0 con 0x7f5b7c070f30 2023-07-21T22:19:31.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.467+0000 7f5b7a7fc640 1 -- 172.21.15.6:0/724579772 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b700aab50 con 0x7f5b7c070f30 2023-07-21T22:19:31.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.467+0000 7f5b821d3640 1 -- 172.21.15.6:0/724579772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c070f30 msgr2=0x7f5b7c0ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.467+0000 7f5b821d3640 1 --2- 172.21.15.6:0/724579772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c070f30 0x7f5b7c0ad6f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0cef70 tx=0x7f5b7001c500 comp rx=0 tx=0).stop 2023-07-21T22:19:31.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.467+0000 7f5b821d3640 1 -- 172.21.15.6:0/724579772 shutdown_connections 2023-07-21T22:19:31.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.467+0000 7f5b821d3640 1 --2- 172.21.15.6:0/724579772 >> v2:172.21.15.161:3300/0 conn(0x7f5b7c0af2b0 0x7f5b7c15a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.467+0000 7f5b821d3640 1 --2- 172.21.15.6:0/724579772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c070f30 0x7f5b7c0ad6f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.467+0000 7f5b821d3640 1 -- 172.21.15.6:0/724579772 >> 172.21.15.6:0/724579772 conn(0x7f5b7c0cde90 msgr2=0x7f5b7c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:31.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.467+0000 7f5b821d3640 1 -- 172.21.15.6:0/724579772 shutdown_connections 2023-07-21T22:19:31.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.467+0000 7f5b821d3640 1 -- 172.21.15.6:0/724579772 wait complete. 2023-07-21T22:19:31.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.467+0000 7f5b821d3640 1 Processor -- start 2023-07-21T22:19:31.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b821d3640 1 -- start start 2023-07-21T22:19:31.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b821d3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b7c069430 0x7f5b7c150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b821d3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c070f30 0x7f5b7c0ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b821d3640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b7c0af2b0 0x7f5b7c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b821d3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0ac190 con 0x7f5b7c070f30 2023-07-21T22:19:31.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b821d3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0ac470 con 0x7f5b7c069430 2023-07-21T22:19:31.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b821d3640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0ac750 con 0x7f5b7c0af2b0 2023-07-21T22:19:31.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b7affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c070f30 0x7f5b7c0ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b7affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c070f30 0x7f5b7c0ab890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33230/0 (socket says 172.21.15.6:33230) 2023-07-21T22:19:31.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b7affd640 1 -- 172.21.15.6:0/3220343305 learned_addr learned my addr 172.21.15.6:0/3220343305 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:31.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b7bfff640 1 --2- 172.21.15.6:0/3220343305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b7c0af2b0 0x7f5b7c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b7b7fe640 1 --2- 172.21.15.6:0/3220343305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b7c069430 0x7f5b7c150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b7affd640 1 -- 172.21.15.6:0/3220343305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b7c0af2b0 msgr2=0x7f5b7c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b7affd640 1 --2- 172.21.15.6:0/3220343305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b7c0af2b0 0x7f5b7c06b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b7affd640 1 -- 172.21.15.6:0/3220343305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b7c069430 msgr2=0x7f5b7c150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b7affd640 1 --2- 172.21.15.6:0/3220343305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b7c069430 0x7f5b7c150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b7affd640 1 -- 172.21.15.6:0/3220343305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b700094d0 con 0x7f5b7c070f30 2023-07-21T22:19:31.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b7bfff640 1 --2- 172.21.15.6:0/3220343305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b7c0af2b0 0x7f5b7c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:31.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b7b7fe640 1 --2- 172.21.15.6:0/3220343305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b7c069430 0x7f5b7c150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:31.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b7affd640 1 --2- 172.21.15.6:0/3220343305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c070f30 0x7f5b7c0ab890 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5b70019110 tx=0x7f5b7001ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:31.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b63fff640 1 -- 172.21.15.6:0/3220343305 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b700b3800 con 0x7f5b7c070f30 2023-07-21T22:19:31.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b63fff640 1 -- 172.21.15.6:0/3220343305 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b700b3960 con 0x7f5b7c070f30 2023-07-21T22:19:31.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b63fff640 1 -- 172.21.15.6:0/3220343305 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b700b3d10 con 0x7f5b7c070f30 2023-07-21T22:19:31.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b821d3640 1 -- 172.21.15.6:0/3220343305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7c0aca30 con 0x7f5b7c070f30 2023-07-21T22:19:31.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b821d3640 1 -- 172.21.15.6:0/3220343305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7c150870 con 0x7f5b7c070f30 2023-07-21T22:19:31.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.471+0000 7f5b821d3640 1 -- 172.21.15.6:0/3220343305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b7c0678d0 con 0x7f5b7c070f30 2023-07-21T22:19:31.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.475+0000 7f5b63fff640 1 -- 172.21.15.6:0/3220343305 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5b700b2380 con 0x7f5b7c070f30 2023-07-21T22:19:31.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.475+0000 7f5b63fff640 1 --2- 172.21.15.6:0/3220343305 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5b680662b0 0x7f5b68068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.475+0000 7f5b63fff640 1 -- 172.21.15.6:0/3220343305 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5b700a6040 con 0x7f5b7c070f30 2023-07-21T22:19:31.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.475+0000 7f5b7b7fe640 1 --2- 172.21.15.6:0/3220343305 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5b680662b0 0x7f5b68068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.475+0000 7f5b7b7fe640 1 --2- 172.21.15.6:0/3220343305 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5b680662b0 0x7f5b68068760 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c157100 tx=0x7f5b6c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:31.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.479+0000 7f5b63fff640 1 -- 172.21.15.6:0/3220343305 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5b700eb930 con 0x7f5b7c070f30 2023-07-21T22:19:31.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.631+0000 7f5b821d3640 1 -- 172.21.15.6:0/3220343305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5b7c0acee0 con 0x7f5b7c070f30 2023-07-21T22:19:31.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.631+0000 7f5b63fff640 1 -- 172.21.15.6:0/3220343305 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5b700eef50 con 0x7f5b7c070f30 2023-07-21T22:19:31.681 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:19:31.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.635+0000 7f5b821d3640 1 -- 172.21.15.6:0/3220343305 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5b680662b0 msgr2=0x7f5b68068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.635+0000 7f5b821d3640 1 --2- 172.21.15.6:0/3220343305 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5b680662b0 0x7f5b68068760 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c157100 tx=0x7f5b6c009040 comp rx=0 tx=0).stop 2023-07-21T22:19:31.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.635+0000 7f5b821d3640 1 -- 172.21.15.6:0/3220343305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c070f30 msgr2=0x7f5b7c0ab890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.635+0000 7f5b821d3640 1 --2- 172.21.15.6:0/3220343305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c070f30 0x7f5b7c0ab890 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5b70019110 tx=0x7f5b7001ad40 comp rx=0 tx=0).stop 2023-07-21T22:19:31.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.635+0000 7f5b821d3640 1 -- 172.21.15.6:0/3220343305 shutdown_connections 2023-07-21T22:19:31.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.635+0000 7f5b821d3640 1 --2- 172.21.15.6:0/3220343305 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b7c0af2b0 0x7f5b7c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.635+0000 7f5b821d3640 1 --2- 172.21.15.6:0/3220343305 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f5b680662b0 0x7f5b68068760 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.635+0000 7f5b821d3640 1 --2- 172.21.15.6:0/3220343305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b7c070f30 0x7f5b7c0ab890 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.635+0000 7f5b821d3640 1 --2- 172.21.15.6:0/3220343305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b7c069430 0x7f5b7c150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.635+0000 7f5b821d3640 1 -- 172.21.15.6:0/3220343305 >> 172.21.15.6:0/3220343305 conn(0x7f5b7c0cde90 msgr2=0x7f5b7c06fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:31.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.635+0000 7f5b821d3640 1 -- 172.21.15.6:0/3220343305 shutdown_connections 2023-07-21T22:19:31.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.635+0000 7f5b821d3640 1 -- 172.21.15.6:0/3220343305 wait complete. 2023-07-21T22:19:31.703 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:19:31.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.803+0000 7f105ac34640 1 Processor -- start 2023-07-21T22:19:31.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.803+0000 7f105ac34640 1 -- start start 2023-07-21T22:19:31.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.803+0000 7f105ac34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1054069430 0x7f10540cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.803+0000 7f105ac34640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f105406d2d0 0x7f105406d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.803+0000 7f105ac34640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10540cb7d0 con 0x7f1054160030 2023-07-21T22:19:31.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.803+0000 7f105ac34640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f105406c510 con 0x7f105406d2d0 2023-07-21T22:19:31.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.803+0000 7f105ac34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105406c7f0 con 0x7f1054069430 2023-07-21T22:19:31.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.803+0000 7f10591d1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f105406d2d0 0x7f105406d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.803+0000 7f10591d1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f105406d2d0 0x7f105406d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33236/0 (socket says 172.21.15.6:33236) 2023-07-21T22:19:31.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.803+0000 7f10591d1640 1 -- 172.21.15.6:0/3236490201 learned_addr learned my addr 172.21.15.6:0/3236490201 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:31.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.803+0000 7f10589d0640 1 --2- 172.21.15.6:0/3236490201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1054069430 0x7f10540cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.803+0000 7f10591d1640 1 -- 172.21.15.6:0/3236490201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1054069430 msgr2=0x7f10540cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:31.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.803+0000 7f10591d1640 1 --2- 172.21.15.6:0/3236490201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1054069430 0x7f10540cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.803+0000 7f10591d1640 1 -- 172.21.15.6:0/3236490201 >> v1:172.21.15.161:6789/0 conn(0x7f1054160030 legacy=0x7f1054069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.803+0000 7f10591d1640 1 -- 172.21.15.6:0/3236490201 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105406cad0 con 0x7f105406d2d0 2023-07-21T22:19:31.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.807+0000 7f10591d1640 1 --2- 172.21.15.6:0/3236490201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f105406d2d0 0x7f105406d750 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f104c009e50 tx=0x7f104c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8dc8efe8cf10000 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:31.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.807+0000 7f10537fe640 1 -- 172.21.15.6:0/3236490201 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c0a5830 con 0x7f105406d2d0 2023-07-21T22:19:31.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.807+0000 7f10537fe640 1 -- 172.21.15.6:0/3236490201 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104c0a5990 con 0x7f105406d2d0 2023-07-21T22:19:31.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.807+0000 7f10537fe640 1 -- 172.21.15.6:0/3236490201 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c0a5d20 con 0x7f105406d2d0 2023-07-21T22:19:31.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.807+0000 7f105ac34640 1 -- 172.21.15.6:0/3236490201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f105406d2d0 msgr2=0x7f105406d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.807+0000 7f105ac34640 1 --2- 172.21.15.6:0/3236490201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f105406d2d0 0x7f105406d750 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f104c009e50 tx=0x7f104c01c950 comp rx=0 tx=0).stop 2023-07-21T22:19:31.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.807+0000 7f105ac34640 1 -- 172.21.15.6:0/3236490201 shutdown_connections 2023-07-21T22:19:31.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.807+0000 7f105ac34640 1 --2- 172.21.15.6:0/3236490201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f105406d2d0 0x7f105406d750 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.807+0000 7f105ac34640 1 --2- 172.21.15.6:0/3236490201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1054069430 0x7f10540cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.807+0000 7f105ac34640 1 -- 172.21.15.6:0/3236490201 >> 172.21.15.6:0/3236490201 conn(0x7f10540b1840 msgr2=0x7f10540cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:31.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.807+0000 7f105ac34640 1 -- 172.21.15.6:0/3236490201 shutdown_connections 2023-07-21T22:19:31.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.807+0000 7f105ac34640 1 -- 172.21.15.6:0/3236490201 wait complete. 2023-07-21T22:19:31.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f105ac34640 1 Processor -- start 2023-07-21T22:19:31.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f105ac34640 1 -- start start 2023-07-21T22:19:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f105ac34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1054069430 0x7f10540cede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f105ac34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f105406d2d0 0x7f105414f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f105ac34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1054160030 0x7f105414f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f105ac34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10540cf630 con 0x7f1054069430 2023-07-21T22:19:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f105ac34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1054159dd0 con 0x7f1054160030 2023-07-21T22:19:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f105ac34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10541594a0 con 0x7f105406d2d0 2023-07-21T22:19:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f10589d0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1054069430 0x7f10540cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f10589d0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1054069430 0x7f10540cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33238/0 (socket says 172.21.15.6:33238) 2023-07-21T22:19:31.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f10589d0640 1 -- 172.21.15.6:0/1757577063 learned_addr learned my addr 172.21.15.6:0/1757577063 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:31.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f10591d1640 1 --2- 172.21.15.6:0/1757577063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1054160030 0x7f105414f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f1053fff640 1 --2- 172.21.15.6:0/1757577063 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f105406d2d0 0x7f105414f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f10589d0640 1 -- 172.21.15.6:0/1757577063 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f105406d2d0 msgr2=0x7f105414f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f10589d0640 1 --2- 172.21.15.6:0/1757577063 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f105406d2d0 0x7f105414f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f10589d0640 1 -- 172.21.15.6:0/1757577063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1054160030 msgr2=0x7f105414f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f10589d0640 1 --2- 172.21.15.6:0/1757577063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1054160030 0x7f105414f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f10589d0640 1 -- 172.21.15.6:0/1757577063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104c009b30 con 0x7f1054069430 2023-07-21T22:19:31.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f10589d0640 1 --2- 172.21.15.6:0/1757577063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1054069430 0x7f10540cede0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f104800d5f0 tx=0x7f104800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:31.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f10517fa640 1 -- 172.21.15.6:0/1757577063 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10480125f0 con 0x7f1054069430 2023-07-21T22:19:31.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f10517fa640 1 -- 172.21.15.6:0/1757577063 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1048012750 con 0x7f1054069430 2023-07-21T22:19:31.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f10517fa640 1 -- 172.21.15.6:0/1757577063 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048012b00 con 0x7f1054069430 2023-07-21T22:19:31.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f105ac34640 1 -- 172.21.15.6:0/1757577063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1054159780 con 0x7f1054069430 2023-07-21T22:19:31.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f105ac34640 1 -- 172.21.15.6:0/1757577063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10540cf320 con 0x7f1054069430 2023-07-21T22:19:31.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.811+0000 7f105ac34640 1 -- 172.21.15.6:0/1757577063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10540678d0 con 0x7f1054069430 2023-07-21T22:19:31.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.815+0000 7f10517fa640 1 -- 172.21.15.6:0/1757577063 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1048012c60 con 0x7f1054069430 2023-07-21T22:19:31.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.815+0000 7f10517fa640 1 --2- 172.21.15.6:0/1757577063 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1038066280 0x7f1038068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.815+0000 7f10517fa640 1 -- 172.21.15.6:0/1757577063 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f10480841f0 con 0x7f1054069430 2023-07-21T22:19:31.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.815+0000 7f1053fff640 1 --2- 172.21.15.6:0/1757577063 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1038066280 0x7f1038068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.815+0000 7f1053fff640 1 --2- 172.21.15.6:0/1757577063 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1038066280 0x7f1038068730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f10540c59a0 tx=0x7f1040009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:31.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.819+0000 7f10517fa640 1 -- 172.21.15.6:0/1757577063 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1048051640 con 0x7f1054069430 2023-07-21T22:19:32.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.971+0000 7f105ac34640 1 -- 172.21.15.6:0/1757577063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f105406e920 con 0x7f1054069430 2023-07-21T22:19:32.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.971+0000 7f10517fa640 1 -- 172.21.15.6:0/1757577063 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1048054c60 con 0x7f1054069430 2023-07-21T22:19:32.020 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:19:32.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.975+0000 7f105ac34640 1 -- 172.21.15.6:0/1757577063 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1038066280 msgr2=0x7f1038068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.975+0000 7f105ac34640 1 --2- 172.21.15.6:0/1757577063 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1038066280 0x7f1038068730 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f10540c59a0 tx=0x7f1040009040 comp rx=0 tx=0).stop 2023-07-21T22:19:32.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.975+0000 7f105ac34640 1 -- 172.21.15.6:0/1757577063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1054069430 msgr2=0x7f10540cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.975+0000 7f105ac34640 1 --2- 172.21.15.6:0/1757577063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1054069430 0x7f10540cede0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f104800d5f0 tx=0x7f104800dab0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.975+0000 7f105ac34640 1 -- 172.21.15.6:0/1757577063 shutdown_connections 2023-07-21T22:19:32.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.975+0000 7f105ac34640 1 --2- 172.21.15.6:0/1757577063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1054160030 0x7f105414f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.975+0000 7f105ac34640 1 --2- 172.21.15.6:0/1757577063 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f105406d2d0 0x7f105414f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.975+0000 7f105ac34640 1 --2- 172.21.15.6:0/1757577063 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f1038066280 0x7f1038068730 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.975+0000 7f105ac34640 1 --2- 172.21.15.6:0/1757577063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1054069430 0x7f10540cede0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.975+0000 7f105ac34640 1 -- 172.21.15.6:0/1757577063 >> 172.21.15.6:0/1757577063 conn(0x7f10540b1840 msgr2=0x7f10540afa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:32.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.975+0000 7f105ac34640 1 -- 172.21.15.6:0/1757577063 shutdown_connections 2023-07-21T22:19:32.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:31.975+0000 7f105ac34640 1 -- 172.21.15.6:0/1757577063 wait complete. 2023-07-21T22:19:32.041 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:19:32.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.139+0000 7ff9217c5640 1 Processor -- start 2023-07-21T22:19:32.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.139+0000 7ff9217c5640 1 -- start start 2023-07-21T22:19:32.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.139+0000 7ff9217c5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff91c0cf2e0 0x7ff91c0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.139+0000 7ff9217c5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff91c0ca790 0x7ff91c0cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.139+0000 7ff9217c5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff91c0d0920 con 0x7ff91c06a540 2023-07-21T22:19:32.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.139+0000 7ff9217c5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91c15bfd0 con 0x7ff91c0ca790 2023-07-21T22:19:32.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.139+0000 7ff9217c5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91c0cfd10 con 0x7ff91c0cf2e0 2023-07-21T22:19:32.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.139+0000 7ff91affd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff91c06a540 0x7ff91c06a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58574/0 (socket says 172.21.15.6:58574) 2023-07-21T22:19:32.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.139+0000 7ff91affd640 1 -- 172.21.15.6:0/1256791472 learned_addr learned my addr 172.21.15.6:0/1256791472 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:32.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.139+0000 7ff91b7fe640 1 --2- 172.21.15.6:0/1256791472 >> v2:172.21.15.6:3300/0 conn(0x7ff91c0ca790 0x7ff91c0cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.143+0000 7ff913fff640 1 --2- 172.21.15.6:0/1256791472 >> v2:172.21.15.161:3300/0 conn(0x7ff91c0cf2e0 0x7ff91c0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.143+0000 7ff91a7fc640 1 -- 172.21.15.6:0/1256791472 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46821549 0 0) 0x7ff91c0d0920 con 0x7ff91c06a540 2023-07-21T22:19:32.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.143+0000 7ff91a7fc640 1 -- 172.21.15.6:0/1256791472 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff908003530 con 0x7ff91c06a540 2023-07-21T22:19:32.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.143+0000 7ff91b7fe640 1 -- 172.21.15.6:0/1256791472 >> v2:172.21.15.161:3300/0 conn(0x7ff91c0cf2e0 msgr2=0x7ff91c0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.143+0000 7ff91b7fe640 1 --2- 172.21.15.6:0/1256791472 >> v2:172.21.15.161:3300/0 conn(0x7ff91c0cf2e0 0x7ff91c0cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.143+0000 7ff91b7fe640 1 -- 172.21.15.6:0/1256791472 >> v1:172.21.15.6:6789/0 conn(0x7ff91c06a540 legacy=0x7ff91c06a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.143+0000 7ff91b7fe640 1 -- 172.21.15.6:0/1256791472 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c0cfff0 con 0x7ff91c0ca790 2023-07-21T22:19:32.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.143+0000 7ff91b7fe640 1 --2- 172.21.15.6:0/1256791472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff91c0ca790 0x7ff91c0cac30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff914009d90 tx=0x7ff91401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b48886900c7942d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.143+0000 7ff91a7fc640 1 -- 172.21.15.6:0/1256791472 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9140a59a0 con 0x7ff91c0ca790 2023-07-21T22:19:32.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.143+0000 7ff91a7fc640 1 -- 172.21.15.6:0/1256791472 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9140a5b00 con 0x7ff91c0ca790 2023-07-21T22:19:32.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.143+0000 7ff91a7fc640 1 -- 172.21.15.6:0/1256791472 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9140a5e90 con 0x7ff91c0ca790 2023-07-21T22:19:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff9217c5640 1 -- 172.21.15.6:0/1256791472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff91c0ca790 msgr2=0x7ff91c0cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff9217c5640 1 --2- 172.21.15.6:0/1256791472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff91c0ca790 0x7ff91c0cac30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff914009d90 tx=0x7ff91401c8e0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff9217c5640 1 -- 172.21.15.6:0/1256791472 shutdown_connections 2023-07-21T22:19:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff9217c5640 1 --2- 172.21.15.6:0/1256791472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff91c0ca790 0x7ff91c0cac30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff9217c5640 1 --2- 172.21.15.6:0/1256791472 >> v2:172.21.15.161:3300/0 conn(0x7ff91c0cf2e0 0x7ff91c0cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff9217c5640 1 -- 172.21.15.6:0/1256791472 >> 172.21.15.6:0/1256791472 conn(0x7ff91c099490 msgr2=0x7ff91c089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff9217c5640 1 -- 172.21.15.6:0/1256791472 shutdown_connections 2023-07-21T22:19:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff9217c5640 1 -- 172.21.15.6:0/1256791472 wait complete. 2023-07-21T22:19:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff9217c5640 1 Processor -- start 2023-07-21T22:19:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff9217c5640 1 -- start start 2023-07-21T22:19:32.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff9217c5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff91c06a540 0x7ff91c0b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff9217c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff91c0ca790 0x7ff91c14ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff9217c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff91c0cf2e0 0x7ff91c06e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff9217c5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c0ad6f0 con 0x7ff91c0ca790 2023-07-21T22:19:32.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff9217c5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c14f460 con 0x7ff91c06a540 2023-07-21T22:19:32.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff9217c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c0b0d00 con 0x7ff91c0cf2e0 2023-07-21T22:19:32.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff913fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff91c0ca790 0x7ff91c14ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff913fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff91c0ca790 0x7ff91c14ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33260/0 (socket says 172.21.15.6:33260) 2023-07-21T22:19:32.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff913fff640 1 -- 172.21.15.6:0/3958441213 learned_addr learned my addr 172.21.15.6:0/3958441213 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:32.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff91affd640 1 --2- 172.21.15.6:0/3958441213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff91c06a540 0x7ff91c0b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff91b7fe640 1 --2- 172.21.15.6:0/3958441213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff91c0cf2e0 0x7ff91c06e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff913fff640 1 -- 172.21.15.6:0/3958441213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff91c0cf2e0 msgr2=0x7ff91c06e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff913fff640 1 --2- 172.21.15.6:0/3958441213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff91c0cf2e0 0x7ff91c06e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff913fff640 1 -- 172.21.15.6:0/3958441213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff91c06a540 msgr2=0x7ff91c0b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff913fff640 1 --2- 172.21.15.6:0/3958441213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff91c06a540 0x7ff91c0b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff913fff640 1 -- 172.21.15.6:0/3958441213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff914009a70 con 0x7ff91c0ca790 2023-07-21T22:19:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff91b7fe640 1 --2- 172.21.15.6:0/3958441213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff91c0cf2e0 0x7ff91c06e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff91affd640 1 --2- 172.21.15.6:0/3958441213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff91c06a540 0x7ff91c0b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.147+0000 7ff913fff640 1 --2- 172.21.15.6:0/3958441213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff91c0ca790 0x7ff91c14ef20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff90400d800 tx=0x7ff90400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.151+0000 7ff9137fe640 1 -- 172.21.15.6:0/3958441213 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90400b6c0 con 0x7ff91c0ca790 2023-07-21T22:19:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.151+0000 7ff9137fe640 1 -- 172.21.15.6:0/3958441213 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90400b820 con 0x7ff91c0ca790 2023-07-21T22:19:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.151+0000 7ff9137fe640 1 -- 172.21.15.6:0/3958441213 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90400bb90 con 0x7ff91c0ca790 2023-07-21T22:19:32.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.151+0000 7ff9217c5640 1 -- 172.21.15.6:0/3958441213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff91c0b0fe0 con 0x7ff91c0ca790 2023-07-21T22:19:32.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.151+0000 7ff9217c5640 1 -- 172.21.15.6:0/3958441213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff91c0ad940 con 0x7ff91c0ca790 2023-07-21T22:19:32.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.151+0000 7ff9217c5640 1 -- 172.21.15.6:0/3958441213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff91c0678d0 con 0x7ff91c0ca790 2023-07-21T22:19:32.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.151+0000 7ff9137fe640 1 -- 172.21.15.6:0/3958441213 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff90400bcf0 con 0x7ff91c0ca790 2023-07-21T22:19:32.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.151+0000 7ff9137fe640 1 --2- 172.21.15.6:0/3958441213 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff8fc066280 0x7ff8fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.151+0000 7ff9137fe640 1 -- 172.21.15.6:0/3958441213 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7ff9040843a0 con 0x7ff91c0ca790 2023-07-21T22:19:32.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.151+0000 7ff91affd640 1 --2- 172.21.15.6:0/3958441213 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff8fc066280 0x7ff8fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.155+0000 7ff91affd640 1 --2- 172.21.15.6:0/3958441213 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff8fc066280 0x7ff8fc068730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0011f0 tx=0x7ff90c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.155+0000 7ff9137fe640 1 -- 172.21.15.6:0/3958441213 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff9040551d0 con 0x7ff91c0ca790 2023-07-21T22:19:32.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.307+0000 7ff9217c5640 1 -- 172.21.15.6:0/3958441213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff91c0accf0 con 0x7ff91c0ca790 2023-07-21T22:19:32.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.307+0000 7ff9137fe640 1 -- 172.21.15.6:0/3958441213 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff904054d60 con 0x7ff91c0ca790 2023-07-21T22:19:32.357 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:19:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.311+0000 7ff9217c5640 1 -- 172.21.15.6:0/3958441213 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff8fc066280 msgr2=0x7ff8fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.311+0000 7ff9217c5640 1 --2- 172.21.15.6:0/3958441213 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff8fc066280 0x7ff8fc068730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0011f0 tx=0x7ff90c009040 comp rx=0 tx=0).stop 2023-07-21T22:19:32.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.311+0000 7ff9217c5640 1 -- 172.21.15.6:0/3958441213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff91c0ca790 msgr2=0x7ff91c14ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.311+0000 7ff9217c5640 1 --2- 172.21.15.6:0/3958441213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff91c0ca790 0x7ff91c14ef20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff90400d800 tx=0x7ff90400dcc0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.311+0000 7ff9217c5640 1 -- 172.21.15.6:0/3958441213 shutdown_connections 2023-07-21T22:19:32.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.311+0000 7ff9217c5640 1 --2- 172.21.15.6:0/3958441213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff91c0cf2e0 0x7ff91c06e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.311+0000 7ff9217c5640 1 --2- 172.21.15.6:0/3958441213 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff8fc066280 0x7ff8fc068730 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.311+0000 7ff9217c5640 1 --2- 172.21.15.6:0/3958441213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff91c0ca790 0x7ff91c14ef20 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.311+0000 7ff9217c5640 1 --2- 172.21.15.6:0/3958441213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff91c06a540 0x7ff91c0b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.311+0000 7ff9217c5640 1 -- 172.21.15.6:0/3958441213 >> 172.21.15.6:0/3958441213 conn(0x7ff91c099490 msgr2=0x7ff91c1584c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:32.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.311+0000 7ff9217c5640 1 -- 172.21.15.6:0/3958441213 shutdown_connections 2023-07-21T22:19:32.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.311+0000 7ff9217c5640 1 -- 172.21.15.6:0/3958441213 wait complete. 2023-07-21T22:19:32.378 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:19:32.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.475+0000 7f69a07ad640 1 Processor -- start 2023-07-21T22:19:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.475+0000 7f69a07ad640 1 -- start start 2023-07-21T22:19:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.475+0000 7f69a07ad640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6998158ce0 0x7f6998070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.475+0000 7f69a07ad640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f69980c8ad0 0x7f69980c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.479+0000 7f69a07ad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f69980c9560 0x7f69980cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.479+0000 7f69a07ad640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69980c99e0 con 0x7f6998158ce0 2023-07-21T22:19:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.479+0000 7f69a07ad640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69980cc700 con 0x7f69980c8ad0 2023-07-21T22:19:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.479+0000 7f69a07ad640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69980b0ff0 con 0x7f69980c9560 2023-07-21T22:19:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.479+0000 7f699e549640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6998158ce0 0x7f6998070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.479+0000 7f699e549640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6998158ce0 0x7f6998070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33272/0 (socket says 172.21.15.6:33272) 2023-07-21T22:19:32.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.479+0000 7f699e549640 1 -- 172.21.15.6:0/2273145551 learned_addr learned my addr 172.21.15.6:0/2273145551 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:32.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.479+0000 7f699ed4a640 1 --2- 172.21.15.6:0/2273145551 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f69980c9560 0x7f69980cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.479+0000 7f699dd48640 1 --2- 172.21.15.6:0/2273145551 >> v2:172.21.15.161:3300/0 conn(0x7f69980c8ad0 0x7f69980c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.479+0000 7f699e549640 1 -- 172.21.15.6:0/2273145551 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f69980c9560 msgr2=0x7f69980cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.479+0000 7f699e549640 1 --2- 172.21.15.6:0/2273145551 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f69980c9560 0x7f69980cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.479+0000 7f699e549640 1 -- 172.21.15.6:0/2273145551 >> v2:172.21.15.161:3300/0 conn(0x7f69980c8ad0 msgr2=0x7f69980c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.479+0000 7f699e549640 1 --2- 172.21.15.6:0/2273145551 >> v2:172.21.15.161:3300/0 conn(0x7f69980c8ad0 0x7f69980c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.479+0000 7f699e549640 1 -- 172.21.15.6:0/2273145551 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6998070c80 con 0x7f6998158ce0 2023-07-21T22:19:32.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.479+0000 7f699e549640 1 --2- 172.21.15.6:0/2273145551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6998158ce0 0x7f6998070450 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f69980c1a30 tx=0x7f699401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6755a84333de9e9b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.479+0000 7f699d547640 1 -- 172.21.15.6:0/2273145551 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69940ab600 con 0x7f6998158ce0 2023-07-21T22:19:32.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.479+0000 7f699d547640 1 -- 172.21.15.6:0/2273145551 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69940a7050 con 0x7f6998158ce0 2023-07-21T22:19:32.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.479+0000 7f699d547640 1 -- 172.21.15.6:0/2273145551 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69940ab980 con 0x7f6998158ce0 2023-07-21T22:19:32.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f69a07ad640 1 -- 172.21.15.6:0/2273145551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6998158ce0 msgr2=0x7f6998070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f69a07ad640 1 --2- 172.21.15.6:0/2273145551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6998158ce0 0x7f6998070450 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f69980c1a30 tx=0x7f699401c3b0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f69a07ad640 1 -- 172.21.15.6:0/2273145551 shutdown_connections 2023-07-21T22:19:32.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f69a07ad640 1 --2- 172.21.15.6:0/2273145551 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f69980c9560 0x7f69980cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f69a07ad640 1 --2- 172.21.15.6:0/2273145551 >> v2:172.21.15.161:3300/0 conn(0x7f69980c8ad0 0x7f69980c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f69a07ad640 1 --2- 172.21.15.6:0/2273145551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6998158ce0 0x7f6998070450 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f69a07ad640 1 -- 172.21.15.6:0/2273145551 >> 172.21.15.6:0/2273145551 conn(0x7f69980afcf0 msgr2=0x7f69980b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:32.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f69a07ad640 1 -- 172.21.15.6:0/2273145551 shutdown_connections 2023-07-21T22:19:32.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f69a07ad640 1 -- 172.21.15.6:0/2273145551 wait complete. 2023-07-21T22:19:32.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f69a07ad640 1 Processor -- start 2023-07-21T22:19:32.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f69a07ad640 1 -- start start 2023-07-21T22:19:32.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f69a07ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69980c8ad0 0x7f6998156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f69a07ad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69980c9560 0x7f6998135b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f699e549640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69980c8ad0 0x7f6998156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f699e549640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69980c8ad0 0x7f6998156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33286/0 (socket says 172.21.15.6:33286) 2023-07-21T22:19:32.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f69a07ad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6998158ce0 0x7f69981360d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f699e549640 1 -- 172.21.15.6:0/269469482 learned_addr learned my addr 172.21.15.6:0/269469482 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:32.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f69a07ad640 1 -- 172.21.15.6:0/269469482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699814ea10 con 0x7f69980c8ad0 2023-07-21T22:19:32.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f69a07ad640 1 -- 172.21.15.6:0/269469482 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699814ecf0 con 0x7f69980c9560 2023-07-21T22:19:32.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f69a07ad640 1 -- 172.21.15.6:0/269469482 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699814efd0 con 0x7f6998158ce0 2023-07-21T22:19:32.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.483+0000 7f699dd48640 1 --2- 172.21.15.6:0/269469482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69980c9560 0x7f6998135b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.487+0000 7f699ed4a640 1 --2- 172.21.15.6:0/269469482 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6998158ce0 0x7f69981360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.487+0000 7f699e549640 1 -- 172.21.15.6:0/269469482 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6998158ce0 msgr2=0x7f69981360d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.487+0000 7f699e549640 1 --2- 172.21.15.6:0/269469482 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6998158ce0 0x7f69981360d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.487+0000 7f699e549640 1 -- 172.21.15.6:0/269469482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69980c9560 msgr2=0x7f6998135b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.487+0000 7f699e549640 1 --2- 172.21.15.6:0/269469482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69980c9560 0x7f6998135b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.487+0000 7f699e549640 1 -- 172.21.15.6:0/269469482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69940094d0 con 0x7f69980c8ad0 2023-07-21T22:19:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.487+0000 7f699e549640 1 --2- 172.21.15.6:0/269469482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69980c8ad0 0x7f6998156ff0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f69940ae040 tx=0x7f6994019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.487+0000 7f698effd640 1 -- 172.21.15.6:0/269469482 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69940b4820 con 0x7f69980c8ad0 2023-07-21T22:19:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.487+0000 7f698effd640 1 -- 172.21.15.6:0/269469482 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69940b49a0 con 0x7f69980c8ad0 2023-07-21T22:19:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.487+0000 7f69a07ad640 1 -- 172.21.15.6:0/269469482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f699814f2b0 con 0x7f69980c8ad0 2023-07-21T22:19:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.487+0000 7f698effd640 1 -- 172.21.15.6:0/269469482 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69940b4d50 con 0x7f69980c8ad0 2023-07-21T22:19:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.487+0000 7f69a07ad640 1 -- 172.21.15.6:0/269469482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6998136810 con 0x7f69980c8ad0 2023-07-21T22:19:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.487+0000 7f69a07ad640 1 -- 172.21.15.6:0/269469482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69980ca1a0 con 0x7f69980c8ad0 2023-07-21T22:19:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.487+0000 7f698effd640 1 -- 172.21.15.6:0/269469482 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f69940c5450 con 0x7f69980c8ad0 2023-07-21T22:19:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.487+0000 7f698effd640 1 --2- 172.21.15.6:0/269469482 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f697c0662b0 0x7f697c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.487+0000 7f698effd640 1 -- 172.21.15.6:0/269469482 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6994121a70 con 0x7f69980c8ad0 2023-07-21T22:19:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.491+0000 7f699dd48640 1 --2- 172.21.15.6:0/269469482 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f697c0662b0 0x7f697c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.491+0000 7f699dd48640 1 --2- 172.21.15.6:0/269469482 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f697c0662b0 0x7f697c068760 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f69981f3b70 tx=0x7f6988008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.491+0000 7f698effd640 1 -- 172.21.15.6:0/269469482 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f69940eee10 con 0x7f69980c8ad0 2023-07-21T22:19:32.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.683+0000 7f69a07ad640 1 -- 172.21.15.6:0/269469482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f699814eb50 con 0x7f69980c8ad0 2023-07-21T22:19:32.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.683+0000 7f698effd640 1 -- 172.21.15.6:0/269469482 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f699814eb50 con 0x7f69980c8ad0 2023-07-21T22:19:32.731 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:32.731 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3109831689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3109831689},{"type":"v1","addr":"172.21.15.6:6834","nonce":3109831689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/937908788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":937908788},{"type":"v1","addr":"172.21.15.161:6836","nonce":937908788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/445360801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":445360801},{"type":"v1","addr":"172.21.15.6:6835","nonce":445360801}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:18:43.722596+0000","modified":"2023-07-21T22:18:47.542628+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/747850146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":747850146},{"type":"v1","addr":"172.21.15.161:6837","nonce":747850146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:19:32.731 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-07-21T22:19:32.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.683+0000 7f69a07ad640 1 -- 172.21.15.6:0/269469482 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f697c0662b0 msgr2=0x7f697c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.683+0000 7f69a07ad640 1 --2- 172.21.15.6:0/269469482 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f697c0662b0 0x7f697c068760 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f69981f3b70 tx=0x7f6988008040 comp rx=0 tx=0).stop 2023-07-21T22:19:32.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.683+0000 7f69a07ad640 1 -- 172.21.15.6:0/269469482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69980c8ad0 msgr2=0x7f6998156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.683+0000 7f69a07ad640 1 --2- 172.21.15.6:0/269469482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69980c8ad0 0x7f6998156ff0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f69940ae040 tx=0x7f6994019150 comp rx=0 tx=0).stop 2023-07-21T22:19:32.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.683+0000 7f69a07ad640 1 -- 172.21.15.6:0/269469482 shutdown_connections 2023-07-21T22:19:32.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.683+0000 7f69a07ad640 1 --2- 172.21.15.6:0/269469482 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6998158ce0 0x7f69981360d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.683+0000 7f69a07ad640 1 --2- 172.21.15.6:0/269469482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f69980c9560 0x7f6998135b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.683+0000 7f69a07ad640 1 --2- 172.21.15.6:0/269469482 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f697c0662b0 0x7f697c068760 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.683+0000 7f69a07ad640 1 --2- 172.21.15.6:0/269469482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69980c8ad0 0x7f6998156ff0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.683+0000 7f69a07ad640 1 -- 172.21.15.6:0/269469482 >> 172.21.15.6:0/269469482 conn(0x7f69980afcf0 msgr2=0x7f69980b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:32.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.683+0000 7f69a07ad640 1 -- 172.21.15.6:0/269469482 shutdown_connections 2023-07-21T22:19:32.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.683+0000 7f69a07ad640 1 -- 172.21.15.6:0/269469482 wait complete. 2023-07-21T22:19:32.752 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:19:32.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.847+0000 7f7303198640 1 Processor -- start 2023-07-21T22:19:32.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.847+0000 7f7303198640 1 -- start start 2023-07-21T22:19:32.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7303198640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f72fc159850 0x7f72fc15db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7303198640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72fc0cd7e0 0x7f72fc159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7303198640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72fc15a660 con 0x7f72fc15a160 2023-07-21T22:19:32.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7303198640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72fc15a940 con 0x7f72fc159850 2023-07-21T22:19:32.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7303198640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc15ac20 con 0x7f72fc0cd7e0 2023-07-21T22:19:32.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7302997640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f72fc15a160 0x7f72fc0af8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58588/0 (socket says 172.21.15.6:58588) 2023-07-21T22:19:32.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7302997640 1 -- 172.21.15.6:0/404280683 learned_addr learned my addr 172.21.15.6:0/404280683 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:32.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301995640 1 --2- 172.21.15.6:0/404280683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72fc0cd7e0 0x7f72fc159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7302196640 1 --2- 172.21.15.6:0/404280683 >> v2:172.21.15.161:3300/0 conn(0x7f72fc159850 0x7f72fc15db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301194640 1 -- 172.21.15.6:0/404280683 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103278633 0 0) 0x7f72fc15a660 con 0x7f72fc15a160 2023-07-21T22:19:32.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301194640 1 -- 172.21.15.6:0/404280683 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72e8003530 con 0x7f72fc15a160 2023-07-21T22:19:32.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301194640 1 -- 172.21.15.6:0/404280683 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4056775977 0 0) 0x7f72e8003530 con 0x7f72fc15a160 2023-07-21T22:19:32.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301194640 1 -- 172.21.15.6:0/404280683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72fc0cd7e0 msgr2=0x7f72fc159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301194640 1 --2- 172.21.15.6:0/404280683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72fc0cd7e0 0x7f72fc159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301194640 1 -- 172.21.15.6:0/404280683 >> v2:172.21.15.161:3300/0 conn(0x7f72fc159850 msgr2=0x7f72fc15db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301194640 1 --2- 172.21.15.6:0/404280683 >> v2:172.21.15.161:3300/0 conn(0x7f72fc159850 0x7f72fc15db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301194640 1 -- 172.21.15.6:0/404280683 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc15d380 con 0x7f72fc15a160 2023-07-21T22:19:32.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301194640 1 -- 172.21.15.6:0/404280683 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f72f4001a00 con 0x7f72fc15a160 2023-07-21T22:19:32.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301194640 1 -- 172.21.15.6:0/404280683 >> v1:172.21.15.6:6789/0 conn(0x7f72fc15a160 legacy=0x7f72fc0af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301194640 1 --2- 172.21.15.6:0/404280683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72fc0cd7e0 0x7f72e8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301194640 1 --2- 172.21.15.6:0/404280683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8003f00 0x7f72e80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301194640 1 --2- 172.21.15.6:0/404280683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72e8004d10 0x7f72e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301194640 1 -- 172.21.15.6:0/404280683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc15a940 con 0x7f72e8003f00 2023-07-21T22:19:32.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301194640 1 -- 172.21.15.6:0/404280683 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc15ac20 con 0x7f72e8004d10 2023-07-21T22:19:32.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301194640 1 -- 172.21.15.6:0/404280683 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e800b990 con 0x7f72fc0cd7e0 2023-07-21T22:19:32.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301995640 1 --2- 172.21.15.6:0/404280683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8003f00 0x7f72e80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7302997640 1 --2- 172.21.15.6:0/404280683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72e8004d10 0x7f72e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7302196640 1 --2- 172.21.15.6:0/404280683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72fc0cd7e0 0x7f72e8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301995640 1 -- 172.21.15.6:0/404280683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72fc0cd7e0 msgr2=0x7f72e8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301995640 1 --2- 172.21.15.6:0/404280683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72fc0cd7e0 0x7f72e8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301995640 1 -- 172.21.15.6:0/404280683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72e8004d10 msgr2=0x7f72e8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301995640 1 --2- 172.21.15.6:0/404280683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72e8004d10 0x7f72e8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.851+0000 7f7301995640 1 -- 172.21.15.6:0/404280683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e8003530 con 0x7f72e8003f00 2023-07-21T22:19:32.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.855+0000 7f7301995640 1 --2- 172.21.15.6:0/404280683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8003f00 0x7f72e80047d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009ae0 tx=0x7f72ec01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da6fa6044658a87 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.855+0000 7f7301194640 1 -- 172.21.15.6:0/404280683 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec0a5530 con 0x7f72e8003f00 2023-07-21T22:19:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.855+0000 7f7301194640 1 -- 172.21.15.6:0/404280683 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ec0a5690 con 0x7f72e8003f00 2023-07-21T22:19:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.855+0000 7f7301194640 1 -- 172.21.15.6:0/404280683 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec0a5a40 con 0x7f72e8003f00 2023-07-21T22:19:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.855+0000 7f7303198640 1 -- 172.21.15.6:0/404280683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8003f00 msgr2=0x7f72e80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.855+0000 7f7303198640 1 --2- 172.21.15.6:0/404280683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8003f00 0x7f72e80047d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009ae0 tx=0x7f72ec01ca50 comp rx=0 tx=0).stop 2023-07-21T22:19:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.855+0000 7f7302997640 1 -- 172.21.15.6:0/404280683 reap_dead start 2023-07-21T22:19:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.855+0000 7f7303198640 1 -- 172.21.15.6:0/404280683 shutdown_connections 2023-07-21T22:19:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.855+0000 7f7303198640 1 -- 172.21.15.6:0/404280683 >> 172.21.15.6:0/404280683 conn(0x7f72fc0ca8b0 msgr2=0x7f72fc0cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.855+0000 7f7303198640 1 -- 172.21.15.6:0/404280683 shutdown_connections 2023-07-21T22:19:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.855+0000 7f7303198640 1 -- 172.21.15.6:0/404280683 wait complete. 2023-07-21T22:19:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.855+0000 7f7303198640 1 Processor -- start 2023-07-21T22:19:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.855+0000 7f7303198640 1 -- start start 2023-07-21T22:19:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f7303198640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8003f00 0x7f72fc0c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f7303198640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72fc14a6a0 0x7f72fc0c1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f7303198640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72fc070650 0x7f72fc070af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f7303198640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc071030 con 0x7f72e8003f00 2023-07-21T22:19:32.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f7303198640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0c4f00 con 0x7f72fc14a6a0 2023-07-21T22:19:32.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f7303198640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0b3200 con 0x7f72fc070650 2023-07-21T22:19:32.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f7302196640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8003f00 0x7f72fc0c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f7302196640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8003f00 0x7f72fc0c3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33306/0 (socket says 172.21.15.6:33306) 2023-07-21T22:19:32.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f7302196640 1 -- 172.21.15.6:0/337087468 learned_addr learned my addr 172.21.15.6:0/337087468 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f7301995640 1 --2- 172.21.15.6:0/337087468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72fc14a6a0 0x7f72fc0c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f7302997640 1 --2- 172.21.15.6:0/337087468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72fc070650 0x7f72fc070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f7302196640 1 -- 172.21.15.6:0/337087468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72fc070650 msgr2=0x7f72fc070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f7302196640 1 --2- 172.21.15.6:0/337087468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72fc070650 0x7f72fc070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f7302196640 1 -- 172.21.15.6:0/337087468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72fc14a6a0 msgr2=0x7f72fc0c1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f7302196640 1 --2- 172.21.15.6:0/337087468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72fc14a6a0 0x7f72fc0c1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f7302196640 1 -- 172.21.15.6:0/337087468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc0c5150 con 0x7f72e8003f00 2023-07-21T22:19:32.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f7302196640 1 --2- 172.21.15.6:0/337087468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8003f00 0x7f72fc0c3fd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f72f8011aa0 tx=0x7f72f8011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f72f2ffd640 1 -- 172.21.15.6:0/337087468 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f800fb80 con 0x7f72e8003f00 2023-07-21T22:19:32.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f72f2ffd640 1 -- 172.21.15.6:0/337087468 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f800fce0 con 0x7f72e8003f00 2023-07-21T22:19:32.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f72f2ffd640 1 -- 172.21.15.6:0/337087468 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8014680 con 0x7f72e8003f00 2023-07-21T22:19:32.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f7303198640 1 -- 172.21.15.6:0/337087468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72fc0c5430 con 0x7f72e8003f00 2023-07-21T22:19:32.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f7303198640 1 -- 172.21.15.6:0/337087468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72fc0c4700 con 0x7f72e8003f00 2023-07-21T22:19:32.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f7303198640 1 -- 172.21.15.6:0/337087468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72fc0c7f30 con 0x7f72e8003f00 2023-07-21T22:19:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.859+0000 7f72f2ffd640 1 -- 172.21.15.6:0/337087468 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f72f80147e0 con 0x7f72e8003f00 2023-07-21T22:19:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.863+0000 7f72f2ffd640 1 --2- 172.21.15.6:0/337087468 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f72e00662b0 0x7f72e0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.863+0000 7f72f2ffd640 1 -- 172.21.15.6:0/337087468 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f72f80846d0 con 0x7f72e8003f00 2023-07-21T22:19:32.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.863+0000 7f7301995640 1 --2- 172.21.15.6:0/337087468 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f72e00662b0 0x7f72e0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.863+0000 7f7301995640 1 --2- 172.21.15.6:0/337087468 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f72e00662b0 0x7f72e0068760 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0af000 tx=0x7f72ec0046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:32.867+0000 7f72f2ffd640 1 -- 172.21.15.6:0/337087468 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72f8051a70 con 0x7f72e8003f00 2023-07-21T22:19:33.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.023+0000 7f7303198640 1 -- 172.21.15.6:0/337087468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72fc0678d0 con 0x7f72e8003f00 2023-07-21T22:19:33.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.027+0000 7f72f2ffd640 1 -- 172.21.15.6:0/337087468 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18302 (secure 0 0 0) 0x7f72f8055090 con 0x7f72e8003f00 2023-07-21T22:19:33.074 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:33.074 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":28,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:19:24.603032+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:18:41.465054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:18:42.709896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:19:33.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.027+0000 7f7303198640 1 -- 172.21.15.6:0/337087468 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f72e00662b0 msgr2=0x7f72e0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.027+0000 7f7303198640 1 --2- 172.21.15.6:0/337087468 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f72e00662b0 0x7f72e0068760 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0af000 tx=0x7f72ec0046d0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.027+0000 7f7303198640 1 -- 172.21.15.6:0/337087468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8003f00 msgr2=0x7f72fc0c3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.027+0000 7f7303198640 1 --2- 172.21.15.6:0/337087468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8003f00 0x7f72fc0c3fd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f72f8011aa0 tx=0x7f72f8011f60 comp rx=0 tx=0).stop 2023-07-21T22:19:33.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.027+0000 7f7303198640 1 -- 172.21.15.6:0/337087468 shutdown_connections 2023-07-21T22:19:33.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.027+0000 7f7303198640 1 --2- 172.21.15.6:0/337087468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72fc070650 0x7f72fc070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.027+0000 7f7303198640 1 --2- 172.21.15.6:0/337087468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72fc14a6a0 0x7f72fc0c1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.027+0000 7f7303198640 1 --2- 172.21.15.6:0/337087468 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f72e00662b0 0x7f72e0068760 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.027+0000 7f7303198640 1 --2- 172.21.15.6:0/337087468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8003f00 0x7f72fc0c3fd0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.027+0000 7f7303198640 1 -- 172.21.15.6:0/337087468 >> 172.21.15.6:0/337087468 conn(0x7f72fc0ca8b0 msgr2=0x7f72fc15c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:33.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.027+0000 7f7303198640 1 -- 172.21.15.6:0/337087468 shutdown_connections 2023-07-21T22:19:33.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.027+0000 7f7303198640 1 -- 172.21.15.6:0/337087468 wait complete. 2023-07-21T22:19:33.096 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-21T22:19:33.097 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:19:33.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.191+0000 7f853b648640 1 Processor -- start 2023-07-21T22:19:33.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.191+0000 7f853b648640 1 -- start start 2023-07-21T22:19:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f853b648640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f85340c0f80 0x7f85340cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f853b648640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85340c17d0 con 0x7f85340c8940 2023-07-21T22:19:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f853b648640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85340c14f0 con 0x7f8534160330 2023-07-21T22:19:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f853b648640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85340cdd70 con 0x7f85340c0f80 2023-07-21T22:19:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f8538be3640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f85340c8940 0x7f85340cd660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58602/0 (socket says 172.21.15.6:58602) 2023-07-21T22:19:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f8538be3640 1 -- 172.21.15.6:0/2761862981 learned_addr learned my addr 172.21.15.6:0/2761862981 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:33.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f8539be5640 1 --2- 172.21.15.6:0/2761862981 >> v2:172.21.15.161:3300/0 conn(0x7f85340c0f80 0x7f85340cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f852bfff640 1 -- 172.21.15.6:0/2761862981 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660360562 0 0) 0x7f85340c17d0 con 0x7f85340c8940 2023-07-21T22:19:33.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f852bfff640 1 -- 172.21.15.6:0/2761862981 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8520003530 con 0x7f85340c8940 2023-07-21T22:19:33.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f852bfff640 1 -- 172.21.15.6:0/2761862981 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3861619173 0 0) 0x7f8520003530 con 0x7f85340c8940 2023-07-21T22:19:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f852bfff640 1 -- 172.21.15.6:0/2761862981 >> v2:172.21.15.161:3300/0 conn(0x7f85340c0f80 msgr2=0x7f85340cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f852bfff640 1 --2- 172.21.15.6:0/2761862981 >> v2:172.21.15.161:3300/0 conn(0x7f85340c0f80 0x7f85340cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f852bfff640 1 -- 172.21.15.6:0/2761862981 >> v1:172.21.15.161:6789/0 conn(0x7f8534160330 legacy=0x7f85340ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f852bfff640 1 -- 172.21.15.6:0/2761862981 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85340cac10 con 0x7f85340c8940 2023-07-21T22:19:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f852bfff640 1 -- 172.21.15.6:0/2761862981 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f8524001680 con 0x7f85340c8940 2023-07-21T22:19:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f852bfff640 1 -- 172.21.15.6:0/2761862981 >> v1:172.21.15.6:6789/0 conn(0x7f85340c8940 legacy=0x7f85340cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f852bfff640 1 --2- 172.21.15.6:0/2761862981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8520003980 0x7f8520003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f852bfff640 1 --2- 172.21.15.6:0/2761862981 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85200047d0 0x7f8520004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f852bfff640 1 --2- 172.21.15.6:0/2761862981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8520005180 0x7f852000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f852bfff640 1 -- 172.21.15.6:0/2761862981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85340cdd70 con 0x7f8520003980 2023-07-21T22:19:33.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f852bfff640 1 -- 172.21.15.6:0/2761862981 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852000bfe0 con 0x7f8520005180 2023-07-21T22:19:33.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f852bfff640 1 -- 172.21.15.6:0/2761862981 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852000c1a0 con 0x7f85200047d0 2023-07-21T22:19:33.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f85393e4640 1 --2- 172.21.15.6:0/2761862981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8520003980 0x7f8520003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f8539be5640 1 --2- 172.21.15.6:0/2761862981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8520005180 0x7f852000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f8538be3640 1 --2- 172.21.15.6:0/2761862981 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85200047d0 0x7f8520004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f85393e4640 1 -- 172.21.15.6:0/2761862981 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85200047d0 msgr2=0x7f8520004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f85393e4640 1 --2- 172.21.15.6:0/2761862981 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85200047d0 0x7f8520004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f85393e4640 1 -- 172.21.15.6:0/2761862981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8520005180 msgr2=0x7f852000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f85393e4640 1 --2- 172.21.15.6:0/2761862981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8520005180 0x7f852000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f85393e4640 1 -- 172.21.15.6:0/2761862981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8520003530 con 0x7f8520003980 2023-07-21T22:19:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f8539be5640 1 -- 172.21.15.6:0/2761862981 reap_dead start 2023-07-21T22:19:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.195+0000 7f8538be3640 1 --2- 172.21.15.6:0/2761862981 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85200047d0 0x7f8520004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.199+0000 7f85393e4640 1 --2- 172.21.15.6:0/2761862981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8520003980 0x7f8520003d90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8530001780 tx=0x7f853001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d841110dd1efce server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.199+0000 7f852bfff640 1 -- 172.21.15.6:0/2761862981 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85300052d0 con 0x7f8520003980 2023-07-21T22:19:33.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.199+0000 7f852bfff640 1 -- 172.21.15.6:0/2761862981 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85300a7050 con 0x7f8520003980 2023-07-21T22:19:33.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.199+0000 7f852bfff640 1 -- 172.21.15.6:0/2761862981 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8530003600 con 0x7f8520003980 2023-07-21T22:19:33.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.199+0000 7f853b648640 1 -- 172.21.15.6:0/2761862981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8520003980 msgr2=0x7f8520003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.199+0000 7f853b648640 1 --2- 172.21.15.6:0/2761862981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8520003980 0x7f8520003d90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8530001780 tx=0x7f853001c3e0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.199+0000 7f853b648640 1 -- 172.21.15.6:0/2761862981 shutdown_connections 2023-07-21T22:19:33.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.199+0000 7f853b648640 1 --2- 172.21.15.6:0/2761862981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8520003980 0x7f8520003d90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.199+0000 7f853b648640 1 -- 172.21.15.6:0/2761862981 >> 172.21.15.6:0/2761862981 conn(0x7f85340afcf0 msgr2=0x7f85340b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:33.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.199+0000 7f853b648640 1 -- 172.21.15.6:0/2761862981 shutdown_connections 2023-07-21T22:19:33.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.199+0000 7f853b648640 1 -- 172.21.15.6:0/2761862981 wait complete. 2023-07-21T22:19:33.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f853b648640 1 Processor -- start 2023-07-21T22:19:33.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f853b648640 1 -- start start 2023-07-21T22:19:33.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f853b648640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8520003980 0x7f8534155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f853b648640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85341f5ea0 0x7f85340c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f853b648640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85340c7c80 0x7f85341549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f853b648640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85340b1e20 con 0x7f85341f5ea0 2023-07-21T22:19:33.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f853b648640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85340c62b0 con 0x7f85340c7c80 2023-07-21T22:19:33.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f853b648640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85340b2070 con 0x7f8520003980 2023-07-21T22:19:33.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f8538be3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85341f5ea0 0x7f85340c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f8538be3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85341f5ea0 0x7f85340c5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33314/0 (socket says 172.21.15.6:33314) 2023-07-21T22:19:33.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f8538be3640 1 -- 172.21.15.6:0/2230302270 learned_addr learned my addr 172.21.15.6:0/2230302270 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:33.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f8538be3640 1 -- 172.21.15.6:0/2230302270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8520003980 msgr2=0x7f8534155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f8538be3640 1 --2- 172.21.15.6:0/2230302270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8520003980 0x7f8534155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f8538be3640 1 -- 172.21.15.6:0/2230302270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85340c7c80 msgr2=0x7f85341549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f8538be3640 1 --2- 172.21.15.6:0/2230302270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85340c7c80 0x7f85341549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f8538be3640 1 -- 172.21.15.6:0/2230302270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85340b2350 con 0x7f85341f5ea0 2023-07-21T22:19:33.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f8538be3640 1 --2- 172.21.15.6:0/2230302270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85341f5ea0 0x7f85340c5c40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8524001bc0 tx=0x7f8524011860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:33.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f8529ffb640 1 -- 172.21.15.6:0/2230302270 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85240137a0 con 0x7f85341f5ea0 2023-07-21T22:19:33.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f8529ffb640 1 -- 172.21.15.6:0/2230302270 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8524013900 con 0x7f85341f5ea0 2023-07-21T22:19:33.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f8529ffb640 1 -- 172.21.15.6:0/2230302270 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8524013c70 con 0x7f85341f5ea0 2023-07-21T22:19:33.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f853b648640 1 -- 172.21.15.6:0/2230302270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85340b2630 con 0x7f85341f5ea0 2023-07-21T22:19:33.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f853b648640 1 -- 172.21.15.6:0/2230302270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85340c8100 con 0x7f85341f5ea0 2023-07-21T22:19:33.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.203+0000 7f853b648640 1 -- 172.21.15.6:0/2230302270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85340b2870 con 0x7f85341f5ea0 2023-07-21T22:19:33.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.207+0000 7f8529ffb640 1 -- 172.21.15.6:0/2230302270 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8524014370 con 0x7f85341f5ea0 2023-07-21T22:19:33.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.207+0000 7f8529ffb640 1 --2- 172.21.15.6:0/2230302270 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f8518066280 0x7f8518068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.207+0000 7f8529ffb640 1 -- 172.21.15.6:0/2230302270 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8524086470 con 0x7f85341f5ea0 2023-07-21T22:19:33.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.207+0000 7f85393e4640 1 --2- 172.21.15.6:0/2230302270 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f8518066280 0x7f8518068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.207+0000 7f85393e4640 1 --2- 172.21.15.6:0/2230302270 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f8518066280 0x7f8518068730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8530001750 tx=0x7f8530001130 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:33.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.211+0000 7f8529ffb640 1 -- 172.21.15.6:0/2230302270 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85340b2870 con 0x7f85341f5ea0 2023-07-21T22:19:33.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.399+0000 7f853b648640 1 -- 172.21.15.6:0/2230302270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85340b2870 con 0x7f85341f5ea0 2023-07-21T22:19:33.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.399+0000 7f8529ffb640 1 -- 172.21.15.6:0/2230302270 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f85340b2870 con 0x7f85341f5ea0 2023-07-21T22:19:33.448 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:33.448 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3109831689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3109831689},{"type":"v1","addr":"172.21.15.6:6834","nonce":3109831689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/937908788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":937908788},{"type":"v1","addr":"172.21.15.161:6836","nonce":937908788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/445360801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":445360801},{"type":"v1","addr":"172.21.15.6:6835","nonce":445360801}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:18:43.722596+0000","modified":"2023-07-21T22:18:47.542628+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/747850146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":747850146},{"type":"v1","addr":"172.21.15.161:6837","nonce":747850146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:19:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-07-21T22:19:33.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.403+0000 7f853b648640 1 -- 172.21.15.6:0/2230302270 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f8518066280 msgr2=0x7f8518068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.403+0000 7f853b648640 1 --2- 172.21.15.6:0/2230302270 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f8518066280 0x7f8518068730 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8530001750 tx=0x7f8530001130 comp rx=0 tx=0).stop 2023-07-21T22:19:33.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.403+0000 7f853b648640 1 -- 172.21.15.6:0/2230302270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85341f5ea0 msgr2=0x7f85340c5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.403+0000 7f853b648640 1 --2- 172.21.15.6:0/2230302270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85341f5ea0 0x7f85340c5c40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8524001bc0 tx=0x7f8524011860 comp rx=0 tx=0).stop 2023-07-21T22:19:33.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.403+0000 7f853b648640 1 -- 172.21.15.6:0/2230302270 shutdown_connections 2023-07-21T22:19:33.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.403+0000 7f853b648640 1 --2- 172.21.15.6:0/2230302270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85340c7c80 0x7f85341549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.403+0000 7f853b648640 1 --2- 172.21.15.6:0/2230302270 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f8518066280 0x7f8518068730 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.403+0000 7f853b648640 1 --2- 172.21.15.6:0/2230302270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85341f5ea0 0x7f85340c5c40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.403+0000 7f853b648640 1 --2- 172.21.15.6:0/2230302270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8520003980 0x7f8534155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.403+0000 7f853b648640 1 -- 172.21.15.6:0/2230302270 >> 172.21.15.6:0/2230302270 conn(0x7f85340afcf0 msgr2=0x7f85340cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:33.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.403+0000 7f853b648640 1 -- 172.21.15.6:0/2230302270 shutdown_connections 2023-07-21T22:19:33.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.403+0000 7f853b648640 1 -- 172.21.15.6:0/2230302270 wait complete. 2023-07-21T22:19:33.469 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:19:33.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.567+0000 7f5586e34640 1 Processor -- start 2023-07-21T22:19:33.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.567+0000 7f5586e34640 1 -- start start 2023-07-21T22:19:33.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.567+0000 7f5586e34640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5580158ce0 0x7f5580070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.567+0000 7f5586e34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55800c9730 0x7f55800ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.567+0000 7f5586e34640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55800cc700 con 0x7f55800c8ad0 2023-07-21T22:19:33.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.567+0000 7f5586e34640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55800b0ff0 con 0x7f5580158ce0 2023-07-21T22:19:33.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.567+0000 7f5586e34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5580070c80 con 0x7f55800c9730 2023-07-21T22:19:33.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.567+0000 7f55853d1640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55800c9730 0x7f55800ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.567+0000 7f5584bd0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5580158ce0 0x7f5580070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.567+0000 7f55853d1640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55800c9730 0x7f55800ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:44134/0 (socket says 172.21.15.6:44134) 2023-07-21T22:19:33.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.567+0000 7f5577fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f55800c8ad0 0x7f55800c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:48096/0 (socket says 172.21.15.6:48096) 2023-07-21T22:19:33.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.567+0000 7f55853d1640 1 -- 172.21.15.6:0/3053341047 learned_addr learned my addr 172.21.15.6:0/3053341047 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:33.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.567+0000 7f5584bd0640 1 -- 172.21.15.6:0/3053341047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55800c9730 msgr2=0x7f55800ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:33.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.567+0000 7f5584bd0640 1 --2- 172.21.15.6:0/3053341047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55800c9730 0x7f55800ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.567+0000 7f5584bd0640 1 -- 172.21.15.6:0/3053341047 >> v1:172.21.15.161:6789/0 conn(0x7f55800c8ad0 legacy=0x7f55800c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.567+0000 7f5584bd0640 1 -- 172.21.15.6:0/3053341047 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55800cbdd0 con 0x7f5580158ce0 2023-07-21T22:19:33.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.567+0000 7f55777fe640 1 -- 172.21.15.6:0/3053341047 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592131848 0 0) 0x7f55800cc700 con 0x7f55800c8ad0 2023-07-21T22:19:33.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.571+0000 7f5584bd0640 1 --2- 172.21.15.6:0/3053341047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5580158ce0 0x7f5580070450 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f557c0097c0 tx=0x7f557c01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87d6a8a71c5c8c27 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:33.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.571+0000 7f55777fe640 1 -- 172.21.15.6:0/3053341047 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c004230 con 0x7f5580158ce0 2023-07-21T22:19:33.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.571+0000 7f55777fe640 1 -- 172.21.15.6:0/3053341047 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557c0a7050 con 0x7f5580158ce0 2023-07-21T22:19:33.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.571+0000 7f55777fe640 1 -- 172.21.15.6:0/3053341047 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c003620 con 0x7f5580158ce0 2023-07-21T22:19:33.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.571+0000 7f5586e34640 1 -- 172.21.15.6:0/3053341047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5580158ce0 msgr2=0x7f5580070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.571+0000 7f5586e34640 1 --2- 172.21.15.6:0/3053341047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5580158ce0 0x7f5580070450 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f557c0097c0 tx=0x7f557c01c330 comp rx=0 tx=0).stop 2023-07-21T22:19:33.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.571+0000 7f5586e34640 1 -- 172.21.15.6:0/3053341047 shutdown_connections 2023-07-21T22:19:33.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.571+0000 7f5586e34640 1 --2- 172.21.15.6:0/3053341047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55800c9730 0x7f55800ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.571+0000 7f5586e34640 1 --2- 172.21.15.6:0/3053341047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5580158ce0 0x7f5580070450 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.571+0000 7f5586e34640 1 -- 172.21.15.6:0/3053341047 >> 172.21.15.6:0/3053341047 conn(0x7f55800afcf0 msgr2=0x7f55800b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:33.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.571+0000 7f5586e34640 1 -- 172.21.15.6:0/3053341047 shutdown_connections 2023-07-21T22:19:33.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.571+0000 7f5586e34640 1 -- 172.21.15.6:0/3053341047 wait complete. 2023-07-21T22:19:33.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5586e34640 1 Processor -- start 2023-07-21T22:19:33.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5586e34640 1 -- start start 2023-07-21T22:19:33.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5586e34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55800c8ad0 0x7f55801529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5586e34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55800c9730 0x7f558014a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5586e34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5580158ce0 0x7f55800c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5586e34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558014abf0 con 0x7f55800c8ad0 2023-07-21T22:19:33.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5586e34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55800b3a50 con 0x7f55800c9730 2023-07-21T22:19:33.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5586e34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55800b3d30 con 0x7f5580158ce0 2023-07-21T22:19:33.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5584bd0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55800c8ad0 0x7f55801529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5584bd0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55800c8ad0 0x7f55801529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33328/0 (socket says 172.21.15.6:33328) 2023-07-21T22:19:33.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5584bd0640 1 -- 172.21.15.6:0/1170190720 learned_addr learned my addr 172.21.15.6:0/1170190720 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:33.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f55853d1640 1 --2- 172.21.15.6:0/1170190720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5580158ce0 0x7f55800c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5577fff640 1 --2- 172.21.15.6:0/1170190720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55800c9730 0x7f558014a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5584bd0640 1 -- 172.21.15.6:0/1170190720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5580158ce0 msgr2=0x7f55800c2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5584bd0640 1 --2- 172.21.15.6:0/1170190720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5580158ce0 0x7f55800c2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5584bd0640 1 -- 172.21.15.6:0/1170190720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55800c9730 msgr2=0x7f558014a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5584bd0640 1 --2- 172.21.15.6:0/1170190720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55800c9730 0x7f558014a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5584bd0640 1 -- 172.21.15.6:0/1170190720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c009420 con 0x7f55800c8ad0 2023-07-21T22:19:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5584bd0640 1 --2- 172.21.15.6:0/1170190720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55800c8ad0 0x7f55801529d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f557c0ae040 tx=0x7f557c0190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f55757fa640 1 -- 172.21.15.6:0/1170190720 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c003af0 con 0x7f55800c8ad0 2023-07-21T22:19:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f55757fa640 1 -- 172.21.15.6:0/1170190720 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557c003c50 con 0x7f55800c8ad0 2023-07-21T22:19:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f55757fa640 1 -- 172.21.15.6:0/1170190720 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c0ab440 con 0x7f55800c8ad0 2023-07-21T22:19:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5586e34640 1 -- 172.21.15.6:0/1170190720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55800b4010 con 0x7f55800c8ad0 2023-07-21T22:19:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5586e34640 1 -- 172.21.15.6:0/1170190720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f558014be90 con 0x7f55800c8ad0 2023-07-21T22:19:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.575+0000 7f5586e34640 1 -- 172.21.15.6:0/1170190720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55800ca1a0 con 0x7f55800c8ad0 2023-07-21T22:19:33.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.579+0000 7f55757fa640 1 -- 172.21.15.6:0/1170190720 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f557c0b2040 con 0x7f55800c8ad0 2023-07-21T22:19:33.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.579+0000 7f55757fa640 1 --2- 172.21.15.6:0/1170190720 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f556c066280 0x7f556c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.579+0000 7f55757fa640 1 -- 172.21.15.6:0/1170190720 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f557c11dc40 con 0x7f55800c8ad0 2023-07-21T22:19:33.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.579+0000 7f5577fff640 1 --2- 172.21.15.6:0/1170190720 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f556c066280 0x7f556c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.579+0000 7f5577fff640 1 --2- 172.21.15.6:0/1170190720 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f556c066280 0x7f556c068730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f55801f7570 tx=0x7f5570007be0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.583+0000 7f55757fa640 1 -- 172.21.15.6:0/1170190720 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f557c0eb070 con 0x7f55800c8ad0 2023-07-21T22:19:33.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.771+0000 7f5586e34640 1 -- 172.21.15.6:0/1170190720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55800678d0 con 0x7f55800c8ad0 2023-07-21T22:19:33.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.771+0000 7f55757fa640 1 -- 172.21.15.6:0/1170190720 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4656 (secure 0 0 0) 0x7f557c0b0090 con 0x7f55800c8ad0 2023-07-21T22:19:33.821 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:33.822 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3109831689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3109831689},{"type":"v1","addr":"172.21.15.6:6834","nonce":3109831689}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/937908788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":937908788},{"type":"v1","addr":"172.21.15.161:6836","nonce":937908788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4282,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/445360801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":445360801},{"type":"v1","addr":"172.21.15.6:6835","nonce":445360801}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:18:43.722596+0000","modified":"2023-07-21T22:18:47.542628+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/747850146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":747850146},{"type":"v1","addr":"172.21.15.161:6837","nonce":747850146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:19:33.824 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-07-21T22:19:33.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.775+0000 7f5586e34640 1 -- 172.21.15.6:0/1170190720 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f556c066280 msgr2=0x7f556c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.775+0000 7f5586e34640 1 --2- 172.21.15.6:0/1170190720 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f556c066280 0x7f556c068730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f55801f7570 tx=0x7f5570007be0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.775+0000 7f5586e34640 1 -- 172.21.15.6:0/1170190720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55800c8ad0 msgr2=0x7f55801529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.775+0000 7f5586e34640 1 --2- 172.21.15.6:0/1170190720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55800c8ad0 0x7f55801529d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f557c0ae040 tx=0x7f557c0190d0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.775+0000 7f5586e34640 1 -- 172.21.15.6:0/1170190720 shutdown_connections 2023-07-21T22:19:33.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.775+0000 7f5586e34640 1 --2- 172.21.15.6:0/1170190720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5580158ce0 0x7f55800c2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.775+0000 7f5586e34640 1 --2- 172.21.15.6:0/1170190720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55800c9730 0x7f558014a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.775+0000 7f5586e34640 1 --2- 172.21.15.6:0/1170190720 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f556c066280 0x7f556c068730 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.775+0000 7f5586e34640 1 --2- 172.21.15.6:0/1170190720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55800c8ad0 0x7f55801529d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.775+0000 7f5586e34640 1 -- 172.21.15.6:0/1170190720 >> 172.21.15.6:0/1170190720 conn(0x7f55800afcf0 msgr2=0x7f5580156be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:33.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.775+0000 7f5586e34640 1 -- 172.21.15.6:0/1170190720 shutdown_connections 2023-07-21T22:19:33.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.775+0000 7f5586e34640 1 -- 172.21.15.6:0/1170190720 wait complete. 2023-07-21T22:19:33.841 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:19:33.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.935+0000 7f8690103640 1 Processor -- start 2023-07-21T22:19:33.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f8690103640 1 -- start start 2023-07-21T22:19:33.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f8690103640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f86880cb100 0x7f86880cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f8690103640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86880cac70 con 0x7f8688070b70 2023-07-21T22:19:33.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f8690103640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86880cba60 con 0x7f868806b1e0 2023-07-21T22:19:33.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f8690103640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86880ca060 con 0x7f86880cb100 2023-07-21T22:19:33.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868de9f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8688070b70 0x7f8688070f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58618/0 (socket says 172.21.15.6:58618) 2023-07-21T22:19:33.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868de9f640 1 -- 172.21.15.6:0/3654486474 learned_addr learned my addr 172.21.15.6:0/3654486474 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868e6a0640 1 --2- 172.21.15.6:0/3654486474 >> v2:172.21.15.161:3300/0 conn(0x7f86880cb100 0x7f86880cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868ce9d640 1 -- 172.21.15.6:0/3654486474 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192530998 0 0) 0x7f86880cac70 con 0x7f8688070b70 2023-07-21T22:19:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868ce9d640 1 -- 172.21.15.6:0/3654486474 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8674003530 con 0x7f8688070b70 2023-07-21T22:19:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868ce9d640 1 -- 172.21.15.6:0/3654486474 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2738729820 0 0) 0x7f8674003530 con 0x7f8688070b70 2023-07-21T22:19:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868ce9d640 1 -- 172.21.15.6:0/3654486474 >> v2:172.21.15.161:3300/0 conn(0x7f86880cb100 msgr2=0x7f86880cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868ce9d640 1 --2- 172.21.15.6:0/3654486474 >> v2:172.21.15.161:3300/0 conn(0x7f86880cb100 0x7f86880cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868ce9d640 1 -- 172.21.15.6:0/3654486474 >> v1:172.21.15.161:6789/0 conn(0x7f868806b1e0 legacy=0x7f86880c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868ce9d640 1 -- 172.21.15.6:0/3654486474 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86880ca340 con 0x7f8688070b70 2023-07-21T22:19:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868ce9d640 1 -- 172.21.15.6:0/3654486474 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f8684001680 con 0x7f8688070b70 2023-07-21T22:19:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868ce9d640 1 -- 172.21.15.6:0/3654486474 >> v1:172.21.15.6:6789/0 conn(0x7f8688070b70 legacy=0x7f8688070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868ce9d640 1 --2- 172.21.15.6:0/3654486474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8674003980 0x7f8674003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868ce9d640 1 --2- 172.21.15.6:0/3654486474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86740047d0 0x7f8674004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868ce9d640 1 --2- 172.21.15.6:0/3654486474 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8674005180 0x7f867400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868ce9d640 1 -- 172.21.15.6:0/3654486474 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86880ca060 con 0x7f86740047d0 2023-07-21T22:19:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868ce9d640 1 -- 172.21.15.6:0/3654486474 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867400c000 con 0x7f8674003980 2023-07-21T22:19:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868ce9d640 1 -- 172.21.15.6:0/3654486474 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867400c1c0 con 0x7f8674005180 2023-07-21T22:19:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868d69e640 1 --2- 172.21.15.6:0/3654486474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86740047d0 0x7f8674004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868de9f640 1 --2- 172.21.15.6:0/3654486474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8674003980 0x7f8674003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868e6a0640 1 --2- 172.21.15.6:0/3654486474 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8674005180 0x7f867400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868d69e640 1 -- 172.21.15.6:0/3654486474 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8674005180 msgr2=0x7f867400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868d69e640 1 --2- 172.21.15.6:0/3654486474 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8674005180 0x7f867400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868d69e640 1 -- 172.21.15.6:0/3654486474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8674003980 msgr2=0x7f8674003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868d69e640 1 --2- 172.21.15.6:0/3654486474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8674003980 0x7f8674003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868d69e640 1 -- 172.21.15.6:0/3654486474 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8674003530 con 0x7f86740047d0 2023-07-21T22:19:33.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.939+0000 7f868e6a0640 1 -- 172.21.15.6:0/3654486474 reap_dead start 2023-07-21T22:19:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.943+0000 7f868d69e640 1 --2- 172.21.15.6:0/3654486474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86740047d0 0x7f8674004c40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8678001780 tx=0x7f867801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0e670b50e519a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.943+0000 7f868ce9d640 1 -- 172.21.15.6:0/3654486474 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86780052d0 con 0x7f86740047d0 2023-07-21T22:19:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.943+0000 7f868ce9d640 1 -- 172.21.15.6:0/3654486474 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86780a7050 con 0x7f86740047d0 2023-07-21T22:19:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.943+0000 7f868ce9d640 1 -- 172.21.15.6:0/3654486474 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678003600 con 0x7f86740047d0 2023-07-21T22:19:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.943+0000 7f8690103640 1 -- 172.21.15.6:0/3654486474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86740047d0 msgr2=0x7f8674004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.943+0000 7f8690103640 1 --2- 172.21.15.6:0/3654486474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86740047d0 0x7f8674004c40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8678001780 tx=0x7f867801c3e0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.943+0000 7f8690103640 1 -- 172.21.15.6:0/3654486474 shutdown_connections 2023-07-21T22:19:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.943+0000 7f8690103640 1 --2- 172.21.15.6:0/3654486474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86740047d0 0x7f8674004c40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.943+0000 7f8690103640 1 -- 172.21.15.6:0/3654486474 >> 172.21.15.6:0/3654486474 conn(0x7f86880afcf0 msgr2=0x7f86880b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.943+0000 7f8690103640 1 -- 172.21.15.6:0/3654486474 shutdown_connections 2023-07-21T22:19:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.943+0000 7f8690103640 1 -- 172.21.15.6:0/3654486474 wait complete. 2023-07-21T22:19:33.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f8690103640 1 Processor -- start 2023-07-21T22:19:33.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f8690103640 1 -- start start 2023-07-21T22:19:33.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f8690103640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86740047d0 0x7f868814d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f8690103640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86881f4e60 0x7f86881576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f8690103640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86880b3030 0x7f86880b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f8690103640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86880b39e0 con 0x7f86881f4e60 2023-07-21T22:19:33.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f8690103640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8688151520 con 0x7f86740047d0 2023-07-21T22:19:33.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f8690103640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868814d760 con 0x7f86880b3030 2023-07-21T22:19:33.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f868d69e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86881f4e60 0x7f86881576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f868d69e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86881f4e60 0x7f86881576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33340/0 (socket says 172.21.15.6:33340) 2023-07-21T22:19:33.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f868d69e640 1 -- 172.21.15.6:0/665894066 learned_addr learned my addr 172.21.15.6:0/665894066 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:33.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f868e6a0640 1 --2- 172.21.15.6:0/665894066 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86880b3030 0x7f86880b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f868de9f640 1 --2- 172.21.15.6:0/665894066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86740047d0 0x7f868814d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f868d69e640 1 -- 172.21.15.6:0/665894066 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86880b3030 msgr2=0x7f86880b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f868d69e640 1 --2- 172.21.15.6:0/665894066 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86880b3030 0x7f86880b34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f868d69e640 1 -- 172.21.15.6:0/665894066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86740047d0 msgr2=0x7f868814d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f868d69e640 1 --2- 172.21.15.6:0/665894066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86740047d0 0x7f868814d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f868d69e640 1 -- 172.21.15.6:0/665894066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86881f5360 con 0x7f86881f4e60 2023-07-21T22:19:33.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f868e6a0640 1 --2- 172.21.15.6:0/665894066 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86880b3030 0x7f86880b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:33.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f868de9f640 1 --2- 172.21.15.6:0/665894066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86740047d0 0x7f868814d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f868d69e640 1 --2- 172.21.15.6:0/665894066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86881f4e60 0x7f86881576f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f867801c210 tx=0x7f8674005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f867e7fc640 1 -- 172.21.15.6:0/665894066 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678007500 con 0x7f86881f4e60 2023-07-21T22:19:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f867e7fc640 1 -- 172.21.15.6:0/665894066 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8678007660 con 0x7f86881f4e60 2023-07-21T22:19:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f8690103640 1 -- 172.21.15.6:0/665894066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86881f5640 con 0x7f86881f4e60 2023-07-21T22:19:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f867e7fc640 1 -- 172.21.15.6:0/665894066 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678006a00 con 0x7f86881f4e60 2023-07-21T22:19:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.947+0000 7f8690103640 1 -- 172.21.15.6:0/665894066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86881f5c00 con 0x7f86881f4e60 2023-07-21T22:19:34.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.951+0000 7f8690103640 1 -- 172.21.15.6:0/665894066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8688151690 con 0x7f86881f4e60 2023-07-21T22:19:34.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.951+0000 7f867e7fc640 1 -- 172.21.15.6:0/665894066 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8678006b60 con 0x7f86881f4e60 2023-07-21T22:19:34.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.951+0000 7f867e7fc640 1 --2- 172.21.15.6:0/665894066 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f866c0662b0 0x7f866c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.951+0000 7f867e7fc640 1 -- 172.21.15.6:0/665894066 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f867811e080 con 0x7f86881f4e60 2023-07-21T22:19:34.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.951+0000 7f868de9f640 1 --2- 172.21.15.6:0/665894066 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f866c0662b0 0x7f866c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.951+0000 7f868de9f640 1 --2- 172.21.15.6:0/665894066 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f866c0662b0 0x7f866c068760 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8684007cc0 tx=0x7f8684009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:34.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:33.955+0000 7f867e7fc640 1 -- 172.21.15.6:0/665894066 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f86780eee20 con 0x7f86881f4e60 2023-07-21T22:19:34.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.107+0000 7f8690103640 1 -- 172.21.15.6:0/665894066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86880678d0 con 0x7f86881f4e60 2023-07-21T22:19:34.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.111+0000 7f867e7fc640 1 -- 172.21.15.6:0/665894066 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18302 (secure 0 0 0) 0x7f86780ee9b0 con 0x7f86881f4e60 2023-07-21T22:19:34.158 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:34.158 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":28,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:19:24.603032+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:18:41.465054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-21T22:18:42.709896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":5}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:19:34.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.111+0000 7f8690103640 1 -- 172.21.15.6:0/665894066 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f866c0662b0 msgr2=0x7f866c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.111+0000 7f8690103640 1 --2- 172.21.15.6:0/665894066 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f866c0662b0 0x7f866c068760 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8684007cc0 tx=0x7f8684009040 comp rx=0 tx=0).stop 2023-07-21T22:19:34.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.111+0000 7f8690103640 1 -- 172.21.15.6:0/665894066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86881f4e60 msgr2=0x7f86881576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.111+0000 7f8690103640 1 --2- 172.21.15.6:0/665894066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86881f4e60 0x7f86881576f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f867801c210 tx=0x7f8674005800 comp rx=0 tx=0).stop 2023-07-21T22:19:34.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.111+0000 7f8690103640 1 -- 172.21.15.6:0/665894066 shutdown_connections 2023-07-21T22:19:34.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.111+0000 7f8690103640 1 --2- 172.21.15.6:0/665894066 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86880b3030 0x7f86880b34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.111+0000 7f8690103640 1 --2- 172.21.15.6:0/665894066 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f866c0662b0 0x7f866c068760 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.111+0000 7f8690103640 1 --2- 172.21.15.6:0/665894066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86881f4e60 0x7f86881576f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.111+0000 7f8690103640 1 --2- 172.21.15.6:0/665894066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86740047d0 0x7f868814d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.111+0000 7f8690103640 1 -- 172.21.15.6:0/665894066 >> 172.21.15.6:0/665894066 conn(0x7f86880afcf0 msgr2=0x7f86880cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.111+0000 7f8690103640 1 -- 172.21.15.6:0/665894066 shutdown_connections 2023-07-21T22:19:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.111+0000 7f8690103640 1 -- 172.21.15.6:0/665894066 wait complete. 2023-07-21T22:19:34.179 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-21T22:19:34.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.275+0000 7f0c58b9d640 1 Processor -- start 2023-07-21T22:19:34.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.275+0000 7f0c58b9d640 1 -- start start 2023-07-21T22:19:34.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.279+0000 7f0c58b9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0c5406b1e0 0x7f0c540c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.279+0000 7f0c58b9d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c540cac70 con 0x7f0c540c21f0 2023-07-21T22:19:34.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.279+0000 7f0c58b9d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c540ca060 con 0x7f0c54070b70 2023-07-21T22:19:34.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.279+0000 7f0c58b9d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c540ca340 con 0x7f0c5406b1e0 2023-07-21T22:19:34.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.279+0000 7f0c52d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0c540c21f0 0x7f0c540cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58628/0 (socket says 172.21.15.6:58628) 2023-07-21T22:19:34.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.279+0000 7f0c52d9d640 1 -- 172.21.15.6:0/1138976318 learned_addr learned my addr 172.21.15.6:0/1138976318 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:34.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.279+0000 7f0c51d9b640 1 --2- 172.21.15.6:0/1138976318 >> v2:172.21.15.161:3300/0 conn(0x7f0c5406b1e0 0x7f0c540c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.279+0000 7f0c5159a640 1 -- 172.21.15.6:0/1138976318 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426739084 0 0) 0x7f0c540cac70 con 0x7f0c540c21f0 2023-07-21T22:19:34.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.279+0000 7f0c5159a640 1 -- 172.21.15.6:0/1138976318 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c3c003530 con 0x7f0c540c21f0 2023-07-21T22:19:34.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.279+0000 7f0c5159a640 1 -- 172.21.15.6:0/1138976318 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486948691 0 0) 0x7f0c540ca060 con 0x7f0c54070b70 2023-07-21T22:19:34.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.279+0000 7f0c5159a640 1 -- 172.21.15.6:0/1138976318 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c540cac70 con 0x7f0c54070b70 2023-07-21T22:19:34.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.279+0000 7f0c51d9b640 1 -- 172.21.15.6:0/1138976318 >> v1:172.21.15.161:6789/0 conn(0x7f0c54070b70 legacy=0x7f0c54070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.279+0000 7f0c51d9b640 1 -- 172.21.15.6:0/1138976318 >> v1:172.21.15.6:6789/0 conn(0x7f0c540c21f0 legacy=0x7f0c540cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.279+0000 7f0c51d9b640 1 -- 172.21.15.6:0/1138976318 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c540ca620 con 0x7f0c5406b1e0 2023-07-21T22:19:34.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.283+0000 7f0c51d9b640 1 --2- 172.21.15.6:0/1138976318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c5406b1e0 0x7f0c540c1cb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0c480097c0 tx=0x7f0c4801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8b64e4b8ec7052a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:34.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.283+0000 7f0c5159a640 1 -- 172.21.15.6:0/1138976318 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c480ab650 con 0x7f0c5406b1e0 2023-07-21T22:19:34.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.283+0000 7f0c5159a640 1 -- 172.21.15.6:0/1138976318 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c480ab7b0 con 0x7f0c5406b1e0 2023-07-21T22:19:34.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.283+0000 7f0c5159a640 1 -- 172.21.15.6:0/1138976318 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c480abb20 con 0x7f0c5406b1e0 2023-07-21T22:19:34.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.283+0000 7f0c58b9d640 1 -- 172.21.15.6:0/1138976318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c5406b1e0 msgr2=0x7f0c540c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.283+0000 7f0c58b9d640 1 --2- 172.21.15.6:0/1138976318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c5406b1e0 0x7f0c540c1cb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0c480097c0 tx=0x7f0c4801c450 comp rx=0 tx=0).stop 2023-07-21T22:19:34.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.283+0000 7f0c58b9d640 1 -- 172.21.15.6:0/1138976318 shutdown_connections 2023-07-21T22:19:34.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.283+0000 7f0c58b9d640 1 --2- 172.21.15.6:0/1138976318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c5406b1e0 0x7f0c540c1cb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.283+0000 7f0c58b9d640 1 -- 172.21.15.6:0/1138976318 >> 172.21.15.6:0/1138976318 conn(0x7f0c540afcf0 msgr2=0x7f0c540b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:34.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.283+0000 7f0c58b9d640 1 -- 172.21.15.6:0/1138976318 shutdown_connections 2023-07-21T22:19:34.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.283+0000 7f0c58b9d640 1 -- 172.21.15.6:0/1138976318 wait complete. 2023-07-21T22:19:34.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.283+0000 7f0c58b9d640 1 Processor -- start 2023-07-21T22:19:34.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.283+0000 7f0c58b9d640 1 -- start start 2023-07-21T22:19:34.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c58b9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c5406b1e0 0x7f0c540c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c58b9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c54070b70 0x7f0c54135b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c58b9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c540c21f0 0x7f0c54164c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c58b9d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c54136290 con 0x7f0c54070b70 2023-07-21T22:19:34.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c58b9d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c54136570 con 0x7f0c5406b1e0 2023-07-21T22:19:34.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c58b9d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c54136850 con 0x7f0c540c21f0 2023-07-21T22:19:34.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c51d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c54070b70 0x7f0c54135b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c51d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c54070b70 0x7f0c54135b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33352/0 (socket says 172.21.15.6:33352) 2023-07-21T22:19:34.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c51d9b640 1 -- 172.21.15.6:0/3627902379 learned_addr learned my addr 172.21.15.6:0/3627902379 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:34.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c5259c640 1 --2- 172.21.15.6:0/3627902379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c5406b1e0 0x7f0c540c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c52d9d640 1 --2- 172.21.15.6:0/3627902379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c540c21f0 0x7f0c54164c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c51d9b640 1 -- 172.21.15.6:0/3627902379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c540c21f0 msgr2=0x7f0c54164c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c51d9b640 1 --2- 172.21.15.6:0/3627902379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c540c21f0 0x7f0c54164c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c51d9b640 1 -- 172.21.15.6:0/3627902379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c5406b1e0 msgr2=0x7f0c540c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c51d9b640 1 --2- 172.21.15.6:0/3627902379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c5406b1e0 0x7f0c540c4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c51d9b640 1 -- 172.21.15.6:0/3627902379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c48009420 con 0x7f0c54070b70 2023-07-21T22:19:34.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c52d9d640 1 --2- 172.21.15.6:0/3627902379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c540c21f0 0x7f0c54164c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:34.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c51d9b640 1 --2- 172.21.15.6:0/3627902379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c54070b70 0x7f0c54135b90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0c48000c10 tx=0x7f0c4801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:34.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c42ffd640 1 -- 172.21.15.6:0/3627902379 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c480b5600 con 0x7f0c54070b70 2023-07-21T22:19:34.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c42ffd640 1 -- 172.21.15.6:0/3627902379 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c480b5760 con 0x7f0c54070b70 2023-07-21T22:19:34.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c42ffd640 1 -- 172.21.15.6:0/3627902379 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c480b5ad0 con 0x7f0c54070b70 2023-07-21T22:19:34.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c58b9d640 1 -- 172.21.15.6:0/3627902379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c54136b30 con 0x7f0c54070b70 2023-07-21T22:19:34.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c58b9d640 1 -- 172.21.15.6:0/3627902379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c540c2620 con 0x7f0c54070b70 2023-07-21T22:19:34.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c58b9d640 1 -- 172.21.15.6:0/3627902379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c540678d0 con 0x7f0c54070b70 2023-07-21T22:19:34.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.287+0000 7f0c42ffd640 1 -- 172.21.15.6:0/3627902379 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0c480b5c30 con 0x7f0c54070b70 2023-07-21T22:19:34.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.291+0000 7f0c42ffd640 1 --2- 172.21.15.6:0/3627902379 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0c34066280 0x7f0c34068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.291+0000 7f0c42ffd640 1 -- 172.21.15.6:0/3627902379 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f0c4811ea40 con 0x7f0c54070b70 2023-07-21T22:19:34.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.291+0000 7f0c5259c640 1 --2- 172.21.15.6:0/3627902379 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0c34066280 0x7f0c34068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.291+0000 7f0c5259c640 1 --2- 172.21.15.6:0/3627902379 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0c34066280 0x7f0c34068730 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0c440011f0 tx=0x7f0c44009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:34.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.295+0000 7f0c42ffd640 1 -- 172.21.15.6:0/3627902379 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c480ebfb0 con 0x7f0c54070b70 2023-07-21T22:19:34.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.483+0000 7f0c58b9d640 1 -- 172.21.15.6:0/3627902379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0c54136fe0 con 0x7f0c54070b70 2023-07-21T22:19:34.532 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-07-21T22:19:34.483+0000 7f195e836640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-21T22:19:34.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.491+0000 7f0c42ffd640 1 -- 172.21.15.6:0/3627902379 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0c480c4020 con 0x7f0c54070b70 2023-07-21T22:19:34.539 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-21T22:19:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.495+0000 7f0c58b9d640 1 -- 172.21.15.6:0/3627902379 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0c34066280 msgr2=0x7f0c34068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.495+0000 7f0c58b9d640 1 --2- 172.21.15.6:0/3627902379 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0c34066280 0x7f0c34068730 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0c440011f0 tx=0x7f0c44009040 comp rx=0 tx=0).stop 2023-07-21T22:19:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.495+0000 7f0c58b9d640 1 -- 172.21.15.6:0/3627902379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c54070b70 msgr2=0x7f0c54135b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.495+0000 7f0c58b9d640 1 --2- 172.21.15.6:0/3627902379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c54070b70 0x7f0c54135b90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0c48000c10 tx=0x7f0c4801ac90 comp rx=0 tx=0).stop 2023-07-21T22:19:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.495+0000 7f0c58b9d640 1 -- 172.21.15.6:0/3627902379 shutdown_connections 2023-07-21T22:19:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.495+0000 7f0c58b9d640 1 --2- 172.21.15.6:0/3627902379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c540c21f0 0x7f0c54164c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.495+0000 7f0c58b9d640 1 --2- 172.21.15.6:0/3627902379 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f0c34066280 0x7f0c34068730 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.495+0000 7f0c58b9d640 1 --2- 172.21.15.6:0/3627902379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c54070b70 0x7f0c54135b90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.495+0000 7f0c58b9d640 1 --2- 172.21.15.6:0/3627902379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c5406b1e0 0x7f0c540c4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.495+0000 7f0c58b9d640 1 -- 172.21.15.6:0/3627902379 >> 172.21.15.6:0/3627902379 conn(0x7f0c540afcf0 msgr2=0x7f0c54151510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:34.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.495+0000 7f0c58b9d640 1 -- 172.21.15.6:0/3627902379 shutdown_connections 2023-07-21T22:19:34.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.495+0000 7f0c58b9d640 1 -- 172.21.15.6:0/3627902379 wait complete. 2023-07-21T22:19:34.548 INFO:tasks.ceph.mds.b.smithi161.stderr: -8068> 2023-07-21T22:18:38.426+0000 7f5da5148640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6836/0: (98) Address already in use 2023-07-21T22:19:34.551 INFO:tasks.ceph.mds.b.smithi161.stderr: -6847> 2023-07-21T22:18:50.437+0000 7f5d9f13c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:19:34.560 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-21T22:19:34.603 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-07-21T22:19:34.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f68453ad640 1 Processor -- start 2023-07-21T22:19:34.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f68453ad640 1 -- start start 2023-07-21T22:19:34.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f68453ad640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f68400cd670 0x7f68400cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f68453ad640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68400b08d0 con 0x7f6840156560 2023-07-21T22:19:34.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f68453ad640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6840159cb0 con 0x7f6840158df0 2023-07-21T22:19:34.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f68453ad640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68401599d0 con 0x7f68400cd670 2023-07-21T22:19:34.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f683effd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6840156560 0x7f68400ccf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58632/0 (socket says 172.21.15.6:58632) 2023-07-21T22:19:34.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f683effd640 1 -- 172.21.15.6:0/2478357996 learned_addr learned my addr 172.21.15.6:0/2478357996 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:34.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f68367fc640 1 --2- 172.21.15.6:0/2478357996 >> v2:172.21.15.161:3300/0 conn(0x7f68400cd670 0x7f68400cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f683e7fc640 1 -- 172.21.15.6:0/2478357996 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666705552 0 0) 0x7f68400b08d0 con 0x7f6840156560 2023-07-21T22:19:34.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f683e7fc640 1 -- 172.21.15.6:0/2478357996 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f682c003530 con 0x7f6840156560 2023-07-21T22:19:34.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f683e7fc640 1 -- 172.21.15.6:0/2478357996 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4017200765 0 0) 0x7f682c003530 con 0x7f6840156560 2023-07-21T22:19:34.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f683e7fc640 1 -- 172.21.15.6:0/2478357996 >> v2:172.21.15.161:3300/0 conn(0x7f68400cd670 msgr2=0x7f68400cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:34.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f683e7fc640 1 --2- 172.21.15.6:0/2478357996 >> v2:172.21.15.161:3300/0 conn(0x7f68400cd670 0x7f68400cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f683e7fc640 1 -- 172.21.15.6:0/2478357996 >> v1:172.21.15.161:6789/0 conn(0x7f6840158df0 legacy=0x7f684006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f683e7fc640 1 -- 172.21.15.6:0/2478357996 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68400ca900 con 0x7f6840156560 2023-07-21T22:19:34.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f683e7fc640 1 -- 172.21.15.6:0/2478357996 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f6830001680 con 0x7f6840156560 2023-07-21T22:19:34.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f683e7fc640 1 -- 172.21.15.6:0/2478357996 >> v1:172.21.15.6:6789/0 conn(0x7f6840156560 legacy=0x7f68400ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f683e7fc640 1 --2- 172.21.15.6:0/2478357996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f682c003980 0x7f682c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f683e7fc640 1 --2- 172.21.15.6:0/2478357996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f682c0047d0 0x7f682c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f683e7fc640 1 --2- 172.21.15.6:0/2478357996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f682c005180 0x7f682c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f683e7fc640 1 -- 172.21.15.6:0/2478357996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68401599d0 con 0x7f682c003980 2023-07-21T22:19:34.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f683e7fc640 1 -- 172.21.15.6:0/2478357996 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c00c000 con 0x7f682c0047d0 2023-07-21T22:19:34.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f683e7fc640 1 -- 172.21.15.6:0/2478357996 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682c00c1c0 con 0x7f682c005180 2023-07-21T22:19:34.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.659+0000 7f683effd640 1 --2- 172.21.15.6:0/2478357996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f682c003980 0x7f682c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.663+0000 7f68367fc640 1 --2- 172.21.15.6:0/2478357996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f682c0047d0 0x7f682c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.663+0000 7f683f7fe640 1 --2- 172.21.15.6:0/2478357996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f682c005180 0x7f682c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.663+0000 7f683effd640 1 -- 172.21.15.6:0/2478357996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f682c005180 msgr2=0x7f682c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:34.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.663+0000 7f683effd640 1 --2- 172.21.15.6:0/2478357996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f682c005180 0x7f682c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.663+0000 7f683effd640 1 -- 172.21.15.6:0/2478357996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f682c0047d0 msgr2=0x7f682c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:34.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.663+0000 7f683effd640 1 --2- 172.21.15.6:0/2478357996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f682c0047d0 0x7f682c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.663+0000 7f683effd640 1 -- 172.21.15.6:0/2478357996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c003530 con 0x7f682c003980 2023-07-21T22:19:34.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.663+0000 7f68367fc640 1 --2- 172.21.15.6:0/2478357996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f682c0047d0 0x7f682c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:34.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.663+0000 7f683f7fe640 1 -- 172.21.15.6:0/2478357996 reap_dead start 2023-07-21T22:19:34.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.663+0000 7f683effd640 1 --2- 172.21.15.6:0/2478357996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f682c003980 0x7f682c003d90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f683000c240 tx=0x7f683001cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849b6a505c55feb0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:34.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.667+0000 7f683e7fc640 1 -- 172.21.15.6:0/2478357996 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6830005ae0 con 0x7f682c003980 2023-07-21T22:19:34.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.667+0000 7f683e7fc640 1 -- 172.21.15.6:0/2478357996 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6830005c40 con 0x7f682c003980 2023-07-21T22:19:34.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.667+0000 7f683e7fc640 1 -- 172.21.15.6:0/2478357996 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68300a59b0 con 0x7f682c003980 2023-07-21T22:19:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.667+0000 7f68453ad640 1 -- 172.21.15.6:0/2478357996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f682c003980 msgr2=0x7f682c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.667+0000 7f68453ad640 1 --2- 172.21.15.6:0/2478357996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f682c003980 0x7f682c003d90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f683000c240 tx=0x7f683001cbd0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.667+0000 7f68453ad640 1 -- 172.21.15.6:0/2478357996 shutdown_connections 2023-07-21T22:19:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.667+0000 7f68453ad640 1 --2- 172.21.15.6:0/2478357996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f682c003980 0x7f682c003d90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.667+0000 7f68453ad640 1 -- 172.21.15.6:0/2478357996 >> 172.21.15.6:0/2478357996 conn(0x7f68400afac0 msgr2=0x7f68400afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:34.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.667+0000 7f68453ad640 1 -- 172.21.15.6:0/2478357996 shutdown_connections 2023-07-21T22:19:34.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.667+0000 7f68453ad640 1 -- 172.21.15.6:0/2478357996 wait complete. 2023-07-21T22:19:34.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.667+0000 7f68453ad640 1 Processor -- start 2023-07-21T22:19:34.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f68453ad640 1 -- start start 2023-07-21T22:19:34.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f68453ad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f682c003980 0x7f6840159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f68453ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6840147f50 0x7f68400b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f68453ad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68401ef8d0 0x7f68401efd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f68453ad640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684015a720 con 0x7f6840147f50 2023-07-21T22:19:34.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f68453ad640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684015aa00 con 0x7f682c003980 2023-07-21T22:19:34.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f68453ad640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684015ace0 con 0x7f68401ef8d0 2023-07-21T22:19:34.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f68367fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6840147f50 0x7f68400b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f68367fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6840147f50 0x7f68400b34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33370/0 (socket says 172.21.15.6:33370) 2023-07-21T22:19:34.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f68367fc640 1 -- 172.21.15.6:0/2131445641 learned_addr learned my addr 172.21.15.6:0/2131445641 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:34.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f683effd640 1 --2- 172.21.15.6:0/2131445641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f682c003980 0x7f6840159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f683f7fe640 1 --2- 172.21.15.6:0/2131445641 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68401ef8d0 0x7f68401efd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f68367fc640 1 -- 172.21.15.6:0/2131445641 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68401ef8d0 msgr2=0x7f68401efd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f68367fc640 1 --2- 172.21.15.6:0/2131445641 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68401ef8d0 0x7f68401efd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f68367fc640 1 -- 172.21.15.6:0/2131445641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f682c003980 msgr2=0x7f6840159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f68367fc640 1 --2- 172.21.15.6:0/2131445641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f682c003980 0x7f6840159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f68367fc640 1 -- 172.21.15.6:0/2131445641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684015afc0 con 0x7f6840147f50 2023-07-21T22:19:34.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f683effd640 1 --2- 172.21.15.6:0/2131445641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f682c003980 0x7f6840159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:34.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f683f7fe640 1 --2- 172.21.15.6:0/2131445641 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68401ef8d0 0x7f68401efd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:34.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f68367fc640 1 --2- 172.21.15.6:0/2131445641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6840147f50 0x7f68400b34e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f682800f410 tx=0x7f682800f500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:34.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f6837fff640 1 -- 172.21.15.6:0/2131445641 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682800e040 con 0x7f6840147f50 2023-07-21T22:19:34.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f6837fff640 1 -- 172.21.15.6:0/2131445641 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682800f040 con 0x7f6840147f50 2023-07-21T22:19:34.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f6837fff640 1 -- 172.21.15.6:0/2131445641 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68280039a0 con 0x7f6840147f50 2023-07-21T22:19:34.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f68453ad640 1 -- 172.21.15.6:0/2131445641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684015a410 con 0x7f6840147f50 2023-07-21T22:19:34.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f68453ad640 1 -- 172.21.15.6:0/2131445641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68400b3a20 con 0x7f6840147f50 2023-07-21T22:19:34.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.671+0000 7f68453ad640 1 -- 172.21.15.6:0/2131445641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68400b1060 con 0x7f6840147f50 2023-07-21T22:19:34.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.675+0000 7f6837fff640 1 -- 172.21.15.6:0/2131445641 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6828003b00 con 0x7f6840147f50 2023-07-21T22:19:34.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.675+0000 7f6837fff640 1 --2- 172.21.15.6:0/2131445641 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6820066280 0x7f6820068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.675+0000 7f6837fff640 1 -- 172.21.15.6:0/2131445641 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f6828084440 con 0x7f6840147f50 2023-07-21T22:19:34.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.675+0000 7f683effd640 1 --2- 172.21.15.6:0/2131445641 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6820066280 0x7f6820068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.675+0000 7f683effd640 1 --2- 172.21.15.6:0/2131445641 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6820066280 0x7f6820068730 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f68300ab000 tx=0x7f68300b1040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:34.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.679+0000 7f6837fff640 1 -- 172.21.15.6:0/2131445641 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6828055220 con 0x7f6840147f50 2023-07-21T22:19:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:34.871+0000 7f68453ad640 1 -- 172.21.15.6:0/2131445641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f684015b150 con 0x7f6840147f50 2023-07-21T22:19:35.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.491+0000 7f6837fff640 1 -- 172.21.15.6:0/2131445641 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6828054db0 con 0x7f6840147f50 2023-07-21T22:19:35.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.495+0000 7f68453ad640 1 -- 172.21.15.6:0/2131445641 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6820066280 msgr2=0x7f6820068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:35.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.495+0000 7f68453ad640 1 --2- 172.21.15.6:0/2131445641 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6820066280 0x7f6820068730 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f68300ab000 tx=0x7f68300b1040 comp rx=0 tx=0).stop 2023-07-21T22:19:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.495+0000 7f68453ad640 1 -- 172.21.15.6:0/2131445641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6840147f50 msgr2=0x7f68400b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.495+0000 7f68453ad640 1 --2- 172.21.15.6:0/2131445641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6840147f50 0x7f68400b34e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f682800f410 tx=0x7f682800f500 comp rx=0 tx=0).stop 2023-07-21T22:19:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.495+0000 7f68453ad640 1 -- 172.21.15.6:0/2131445641 shutdown_connections 2023-07-21T22:19:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.495+0000 7f68453ad640 1 --2- 172.21.15.6:0/2131445641 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f68401ef8d0 0x7f68401efd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.495+0000 7f68453ad640 1 --2- 172.21.15.6:0/2131445641 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6820066280 0x7f6820068730 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.495+0000 7f68453ad640 1 --2- 172.21.15.6:0/2131445641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6840147f50 0x7f68400b34e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:35.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.495+0000 7f68453ad640 1 --2- 172.21.15.6:0/2131445641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f682c003980 0x7f6840159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:35.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.495+0000 7f68453ad640 1 -- 172.21.15.6:0/2131445641 >> 172.21.15.6:0/2131445641 conn(0x7f68400afac0 msgr2=0x7f68400cbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:35.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.495+0000 7f68453ad640 1 -- 172.21.15.6:0/2131445641 shutdown_connections 2023-07-21T22:19:35.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.495+0000 7f68453ad640 1 -- 172.21.15.6:0/2131445641 wait complete. 2023-07-21T22:19:35.566 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-21T22:19:35.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.671+0000 7f95d1f70640 1 Processor -- start 2023-07-21T22:19:35.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.671+0000 7f95d1f70640 1 -- start start 2023-07-21T22:19:35.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.671+0000 7f95d1f70640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95cc0cfd90 0x7f95cc0cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:35.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.671+0000 7f95d1f70640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f95cc0b5010 0x7f95cc0cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:35.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.671+0000 7f95d1f70640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95cc15bfa0 con 0x7f95cc0cebd0 2023-07-21T22:19:35.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.671+0000 7f95d1f70640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95cc0ccdf0 con 0x7f95cc0b5010 2023-07-21T22:19:35.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.671+0000 7f95d1f70640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc0cd0d0 con 0x7f95cc0cfd90 2023-07-21T22:19:35.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.671+0000 7f95d176f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f95cc0b5010 0x7f95cc0cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:35.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.671+0000 7f95d176f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f95cc0b5010 0x7f95cc0cde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33386/0 (socket says 172.21.15.6:33386) 2023-07-21T22:19:35.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.671+0000 7f95d176f640 1 -- 172.21.15.6:0/1184428640 learned_addr learned my addr 172.21.15.6:0/1184428640 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:35.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.671+0000 7f95d0f6e640 1 --2- 172.21.15.6:0/1184428640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95cc0cfd90 0x7f95cc0cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:35.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.675+0000 7f95d176f640 1 -- 172.21.15.6:0/1184428640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95cc0cfd90 msgr2=0x7f95cc0cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:35.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.675+0000 7f95d176f640 1 --2- 172.21.15.6:0/1184428640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95cc0cfd90 0x7f95cc0cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:35.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.675+0000 7f95d176f640 1 -- 172.21.15.6:0/1184428640 >> v1:172.21.15.161:6789/0 conn(0x7f95cc0cebd0 legacy=0x7f95cc0d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:35.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.675+0000 7f95d176f640 1 -- 172.21.15.6:0/1184428640 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc0cd3b0 con 0x7f95cc0b5010 2023-07-21T22:19:35.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.675+0000 7f95cb7fe640 1 -- 172.21.15.6:0/1184428640 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671230240 0 0) 0x7f95b8001120 con 0x7f95cc0cebd0 2023-07-21T22:19:35.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.675+0000 7f95d176f640 1 --2- 172.21.15.6:0/1184428640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc0b5010 0x7f95cc0cde90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f95c4009e50 tx=0x7f95c401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aaf13c50dbb4c08 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:35.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.675+0000 7f95cb7fe640 1 -- 172.21.15.6:0/1184428640 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c40a5810 con 0x7f95cc0b5010 2023-07-21T22:19:35.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.675+0000 7f95cb7fe640 1 -- 172.21.15.6:0/1184428640 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c40a5970 con 0x7f95cc0b5010 2023-07-21T22:19:35.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.675+0000 7f95cb7fe640 1 -- 172.21.15.6:0/1184428640 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c40a5d00 con 0x7f95cc0b5010 2023-07-21T22:19:35.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.675+0000 7f95d1f70640 1 -- 172.21.15.6:0/1184428640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc0b5010 msgr2=0x7f95cc0cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:35.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.675+0000 7f95d1f70640 1 --2- 172.21.15.6:0/1184428640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc0b5010 0x7f95cc0cde90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f95c4009e50 tx=0x7f95c401c950 comp rx=0 tx=0).stop 2023-07-21T22:19:35.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.675+0000 7f95d1f70640 1 -- 172.21.15.6:0/1184428640 shutdown_connections 2023-07-21T22:19:35.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.675+0000 7f95d1f70640 1 --2- 172.21.15.6:0/1184428640 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc0b5010 0x7f95cc0cde90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:35.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.675+0000 7f95d1f70640 1 --2- 172.21.15.6:0/1184428640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95cc0cfd90 0x7f95cc0cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:35.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.675+0000 7f95d1f70640 1 -- 172.21.15.6:0/1184428640 >> 172.21.15.6:0/1184428640 conn(0x7f95cc09b490 msgr2=0x7f95cc0d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:35.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.675+0000 7f95d1f70640 1 -- 172.21.15.6:0/1184428640 shutdown_connections 2023-07-21T22:19:35.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95d1f70640 1 -- 172.21.15.6:0/1184428640 wait complete. 2023-07-21T22:19:35.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95d1f70640 1 Processor -- start 2023-07-21T22:19:35.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95d1f70640 1 -- start start 2023-07-21T22:19:35.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95d1f70640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95cc0b5010 0x7f95cc150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:35.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95d1f70640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95cc0cebd0 0x7f95cc156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:35.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95d1f70640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc0cfd90 0x7f95cc154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:35.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95d1f70640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc157e10 con 0x7f95cc0cfd90 2023-07-21T22:19:35.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95d1f70640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc0c9290 con 0x7f95cc0b5010 2023-07-21T22:19:35.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95d1f70640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc156d70 con 0x7f95cc0cebd0 2023-07-21T22:19:35.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95d176f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc0cfd90 0x7f95cc154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:35.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95d176f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc0cfd90 0x7f95cc154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33396/0 (socket says 172.21.15.6:33396) 2023-07-21T22:19:35.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95d176f640 1 -- 172.21.15.6:0/1263089324 learned_addr learned my addr 172.21.15.6:0/1263089324 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:35.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95d0f6e640 1 --2- 172.21.15.6:0/1263089324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95cc0b5010 0x7f95cc150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:35.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95cbfff640 1 --2- 172.21.15.6:0/1263089324 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95cc0cebd0 0x7f95cc156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:35.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95d176f640 1 -- 172.21.15.6:0/1263089324 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95cc0cebd0 msgr2=0x7f95cc156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:35.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95d176f640 1 --2- 172.21.15.6:0/1263089324 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95cc0cebd0 0x7f95cc156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:35.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95d176f640 1 -- 172.21.15.6:0/1263089324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95cc0b5010 msgr2=0x7f95cc150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:35.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95d176f640 1 --2- 172.21.15.6:0/1263089324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95cc0b5010 0x7f95cc150270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:35.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95d176f640 1 -- 172.21.15.6:0/1263089324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c4009b30 con 0x7f95cc0cfd90 2023-07-21T22:19:35.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95d0f6e640 1 --2- 172.21.15.6:0/1263089324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95cc0b5010 0x7f95cc150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:35.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.679+0000 7f95d176f640 1 --2- 172.21.15.6:0/1263089324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc0cfd90 0x7f95cc154630 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f95c401a580 tx=0x7f95c40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:35.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.683+0000 7f95c97fa640 1 -- 172.21.15.6:0/1263089324 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c40b8670 con 0x7f95cc0cfd90 2023-07-21T22:19:35.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.683+0000 7f95c97fa640 1 -- 172.21.15.6:0/1263089324 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c40b87d0 con 0x7f95cc0cfd90 2023-07-21T22:19:35.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.683+0000 7f95c97fa640 1 -- 172.21.15.6:0/1263089324 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c40b8b80 con 0x7f95cc0cfd90 2023-07-21T22:19:35.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.683+0000 7f95d1f70640 1 -- 172.21.15.6:0/1263089324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95cc157050 con 0x7f95cc0cfd90 2023-07-21T22:19:35.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.683+0000 7f95d1f70640 1 -- 172.21.15.6:0/1263089324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95cc157610 con 0x7f95cc0cfd90 2023-07-21T22:19:35.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.683+0000 7f95d1f70640 1 -- 172.21.15.6:0/1263089324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95cc04e020 con 0x7f95cc0cfd90 2023-07-21T22:19:35.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.683+0000 7f95c97fa640 1 -- 172.21.15.6:0/1263089324 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f95c40b8ce0 con 0x7f95cc0cfd90 2023-07-21T22:19:35.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.683+0000 7f95c97fa640 1 --2- 172.21.15.6:0/1263089324 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f95b0066280 0x7f95b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:35.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.683+0000 7f95c97fa640 1 -- 172.21.15.6:0/1263089324 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f95c411f300 con 0x7f95cc0cfd90 2023-07-21T22:19:35.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.683+0000 7f95d0f6e640 1 --2- 172.21.15.6:0/1263089324 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f95b0066280 0x7f95b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:35.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.687+0000 7f95d0f6e640 1 --2- 172.21.15.6:0/1263089324 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f95b0066280 0x7f95b0068730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009af0 tx=0x7f95c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:35.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.687+0000 7f95c97fa640 1 -- 172.21.15.6:0/1263089324 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95c40ec810 con 0x7f95cc0cfd90 2023-07-21T22:19:35.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:35.847+0000 7f95d1f70640 1 -- 172.21.15.6:0/1263089324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f95cc0b7300 con 0x7f95cc0cfd90 2023-07-21T22:19:36.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.679+0000 7f95c97fa640 1 -- 172.21.15.6:0/1263089324 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7f95c40efe30 con 0x7f95cc0cfd90 2023-07-21T22:19:36.727 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-07-21T22:19:36.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.683+0000 7f95d1f70640 1 -- 172.21.15.6:0/1263089324 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f95b0066280 msgr2=0x7f95b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:36.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.683+0000 7f95d1f70640 1 --2- 172.21.15.6:0/1263089324 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f95b0066280 0x7f95b0068730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009af0 tx=0x7f95c0008040 comp rx=0 tx=0).stop 2023-07-21T22:19:36.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.683+0000 7f95d1f70640 1 -- 172.21.15.6:0/1263089324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc0cfd90 msgr2=0x7f95cc154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:36.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.683+0000 7f95d1f70640 1 --2- 172.21.15.6:0/1263089324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc0cfd90 0x7f95cc154630 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f95c401a580 tx=0x7f95c40196f0 comp rx=0 tx=0).stop 2023-07-21T22:19:36.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.683+0000 7f95d1f70640 1 -- 172.21.15.6:0/1263089324 shutdown_connections 2023-07-21T22:19:36.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.683+0000 7f95d1f70640 1 --2- 172.21.15.6:0/1263089324 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f95b0066280 0x7f95b0068730 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:36.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.683+0000 7f95d1f70640 1 --2- 172.21.15.6:0/1263089324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95cc0cfd90 0x7f95cc154630 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:36.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.683+0000 7f95d1f70640 1 --2- 172.21.15.6:0/1263089324 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95cc0cebd0 0x7f95cc156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:36.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.683+0000 7f95d1f70640 1 --2- 172.21.15.6:0/1263089324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95cc0b5010 0x7f95cc150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:36.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.683+0000 7f95d1f70640 1 -- 172.21.15.6:0/1263089324 >> 172.21.15.6:0/1263089324 conn(0x7f95cc09b490 msgr2=0x7f95cc069eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:36.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.683+0000 7f95d1f70640 1 -- 172.21.15.6:0/1263089324 shutdown_connections 2023-07-21T22:19:36.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.683+0000 7f95d1f70640 1 -- 172.21.15.6:0/1263089324 wait complete. 2023-07-21T22:19:36.754 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-21T22:19:36.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.859+0000 7fcc91d37640 1 Processor -- start 2023-07-21T22:19:36.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.859+0000 7fcc91d37640 1 -- start start 2023-07-21T22:19:36.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.859+0000 7fcc91d37640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcc8c06a540 0x7fcc8c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:36.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.859+0000 7fcc91d37640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc8c0cf710 0x7fcc8c0cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:36.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.859+0000 7fcc91d37640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8c0cb7a0 con 0x7fcc8c0cf2e0 2023-07-21T22:19:36.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.859+0000 7fcc91d37640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8c0d0920 con 0x7fcc8c06a540 2023-07-21T22:19:36.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.859+0000 7fcc91d37640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c15bfd0 con 0x7fcc8c0cf710 2023-07-21T22:19:36.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.859+0000 7fcc8b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcc8c06a540 0x7fcc8c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:36.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.859+0000 7fcc8affd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcc8c0cf2e0 0x7fcc8c0cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58638/0 (socket says 172.21.15.6:58638) 2023-07-21T22:19:36.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.859+0000 7fcc8affd640 1 -- 172.21.15.6:0/3169609178 learned_addr learned my addr 172.21.15.6:0/3169609178 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:36.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.859+0000 7fcc8bfff640 1 --2- 172.21.15.6:0/3169609178 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc8c0cf710 0x7fcc8c0cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:36.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.859+0000 7fcc8b7fe640 1 -- 172.21.15.6:0/3169609178 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc8c0cf710 msgr2=0x7fcc8c0cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:36.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.859+0000 7fcc8b7fe640 1 --2- 172.21.15.6:0/3169609178 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc8c0cf710 0x7fcc8c0cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:36.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.859+0000 7fcc8b7fe640 1 -- 172.21.15.6:0/3169609178 >> v1:172.21.15.6:6789/0 conn(0x7fcc8c0cf2e0 legacy=0x7fcc8c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:36.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.859+0000 7fcc8b7fe640 1 -- 172.21.15.6:0/3169609178 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c06ae50 con 0x7fcc8c06a540 2023-07-21T22:19:36.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.859+0000 7fcc8a7fc640 1 -- 172.21.15.6:0/3169609178 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602328952 0 0) 0x7fcc8c0cb7a0 con 0x7fcc8c0cf2e0 2023-07-21T22:19:36.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.863+0000 7fcc8b7fe640 1 --2- 172.21.15.6:0/3169609178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc8c06a540 0x7fcc8c06a910 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0097c0 tx=0x7fcc7c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3d4dfc28a12f85 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:36.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.863+0000 7fcc8a7fc640 1 -- 172.21.15.6:0/3169609178 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c0ad660 con 0x7fcc8c06a540 2023-07-21T22:19:36.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.863+0000 7fcc8a7fc640 1 -- 172.21.15.6:0/3169609178 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c0ad7c0 con 0x7fcc8c06a540 2023-07-21T22:19:36.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.863+0000 7fcc8a7fc640 1 -- 172.21.15.6:0/3169609178 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c0adb50 con 0x7fcc8c06a540 2023-07-21T22:19:36.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.863+0000 7fcc91d37640 1 -- 172.21.15.6:0/3169609178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc8c06a540 msgr2=0x7fcc8c06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:36.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.863+0000 7fcc91d37640 1 --2- 172.21.15.6:0/3169609178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc8c06a540 0x7fcc8c06a910 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0097c0 tx=0x7fcc7c01c450 comp rx=0 tx=0).stop 2023-07-21T22:19:36.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.863+0000 7fcc91d37640 1 -- 172.21.15.6:0/3169609178 shutdown_connections 2023-07-21T22:19:36.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.863+0000 7fcc91d37640 1 --2- 172.21.15.6:0/3169609178 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc8c0cf710 0x7fcc8c0cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:36.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.863+0000 7fcc91d37640 1 --2- 172.21.15.6:0/3169609178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc8c06a540 0x7fcc8c06a910 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:36.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.863+0000 7fcc91d37640 1 -- 172.21.15.6:0/3169609178 >> 172.21.15.6:0/3169609178 conn(0x7fcc8c099490 msgr2=0x7fcc8c089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:36.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.863+0000 7fcc91d37640 1 -- 172.21.15.6:0/3169609178 shutdown_connections 2023-07-21T22:19:36.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.863+0000 7fcc91d37640 1 -- 172.21.15.6:0/3169609178 wait complete. 2023-07-21T22:19:36.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc91d37640 1 Processor -- start 2023-07-21T22:19:36.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc91d37640 1 -- start start 2023-07-21T22:19:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc91d37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc8c06a540 0x7fcc8c158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc91d37640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc8c0cf2e0 0x7fcc8c147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc91d37640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc8c0cf710 0x7fcc8c15a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc91d37640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c14afb0 con 0x7fcc8c06a540 2023-07-21T22:19:36.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc91d37640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c0b55e0 con 0x7fcc8c0cf2e0 2023-07-21T22:19:36.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc91d37640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c0b58c0 con 0x7fcc8c0cf710 2023-07-21T22:19:36.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc8b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc8c06a540 0x7fcc8c158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:36.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc8b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc8c06a540 0x7fcc8c158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33418/0 (socket says 172.21.15.6:33418) 2023-07-21T22:19:36.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc8b7fe640 1 -- 172.21.15.6:0/3573012896 learned_addr learned my addr 172.21.15.6:0/3573012896 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:36.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc8affd640 1 --2- 172.21.15.6:0/3573012896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc8c0cf2e0 0x7fcc8c147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:36.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc8bfff640 1 --2- 172.21.15.6:0/3573012896 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc8c0cf710 0x7fcc8c15a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:36.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc8b7fe640 1 -- 172.21.15.6:0/3573012896 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc8c0cf710 msgr2=0x7fcc8c15a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:36.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc8b7fe640 1 --2- 172.21.15.6:0/3573012896 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc8c0cf710 0x7fcc8c15a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:36.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc8b7fe640 1 -- 172.21.15.6:0/3573012896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc8c0cf2e0 msgr2=0x7fcc8c147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:36.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc8b7fe640 1 --2- 172.21.15.6:0/3573012896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc8c0cf2e0 0x7fcc8c147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:36.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc8b7fe640 1 -- 172.21.15.6:0/3573012896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7c009420 con 0x7fcc8c06a540 2023-07-21T22:19:36.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc8b7fe640 1 --2- 172.21.15.6:0/3573012896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc8c06a540 0x7fcc8c158db0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c009710 tx=0x7fcc7c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:36.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc73fff640 1 -- 172.21.15.6:0/3573012896 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c004220 con 0x7fcc8c06a540 2023-07-21T22:19:36.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc73fff640 1 -- 172.21.15.6:0/3573012896 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c004380 con 0x7fcc8c06a540 2023-07-21T22:19:36.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc73fff640 1 -- 172.21.15.6:0/3573012896 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c003820 con 0x7fcc8c06a540 2023-07-21T22:19:36.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc91d37640 1 -- 172.21.15.6:0/3573012896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8c0b5ba0 con 0x7fcc8c06a540 2023-07-21T22:19:36.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.867+0000 7fcc91d37640 1 -- 172.21.15.6:0/3573012896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8c148410 con 0x7fcc8c06a540 2023-07-21T22:19:36.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.871+0000 7fcc91d37640 1 -- 172.21.15.6:0/3573012896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8c0678d0 con 0x7fcc8c06a540 2023-07-21T22:19:36.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.871+0000 7fcc73fff640 1 -- 172.21.15.6:0/3573012896 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcc7c003980 con 0x7fcc8c06a540 2023-07-21T22:19:36.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.871+0000 7fcc73fff640 1 --2- 172.21.15.6:0/3573012896 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fcc78066280 0x7fcc78068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:36.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.871+0000 7fcc73fff640 1 -- 172.21.15.6:0/3573012896 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5768+0+0 (secure 0 0 0) 0x7fcc7c11dda0 con 0x7fcc8c06a540 2023-07-21T22:19:36.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.871+0000 7fcc8affd640 1 --2- 172.21.15.6:0/3573012896 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fcc78066280 0x7fcc78068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:36.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.871+0000 7fcc8affd640 1 --2- 172.21.15.6:0/3573012896 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fcc78066280 0x7fcc78068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c1585f0 tx=0x7fcc80007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:36.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:36.875+0000 7fcc73fff640 1 -- 172.21.15.6:0/3573012896 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcc7c0eb2a0 con 0x7fcc8c06a540 2023-07-21T22:19:37.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.031+0000 7fcc91d37640 1 -- 172.21.15.6:0/3573012896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcc8c0716a0 con 0x7fcc8c06a540 2023-07-21T22:19:37.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.691+0000 7fcc73fff640 1 -- 172.21.15.6:0/3573012896 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcc7c0b20d0 con 0x7fcc8c06a540 2023-07-21T22:19:37.739 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-07-21T22:19:37.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.695+0000 7fcc91d37640 1 -- 172.21.15.6:0/3573012896 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fcc78066280 msgr2=0x7fcc78068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:37.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.695+0000 7fcc91d37640 1 --2- 172.21.15.6:0/3573012896 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fcc78066280 0x7fcc78068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c1585f0 tx=0x7fcc80007c10 comp rx=0 tx=0).stop 2023-07-21T22:19:37.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.695+0000 7fcc91d37640 1 -- 172.21.15.6:0/3573012896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc8c06a540 msgr2=0x7fcc8c158db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:37.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.695+0000 7fcc91d37640 1 --2- 172.21.15.6:0/3573012896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc8c06a540 0x7fcc8c158db0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c009710 tx=0x7fcc7c01ac90 comp rx=0 tx=0).stop 2023-07-21T22:19:37.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.695+0000 7fcc91d37640 1 -- 172.21.15.6:0/3573012896 shutdown_connections 2023-07-21T22:19:37.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.695+0000 7fcc91d37640 1 --2- 172.21.15.6:0/3573012896 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcc8c0cf710 0x7fcc8c15a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:37.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.695+0000 7fcc91d37640 1 --2- 172.21.15.6:0/3573012896 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc8c0cf2e0 0x7fcc8c147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:37.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.695+0000 7fcc91d37640 1 --2- 172.21.15.6:0/3573012896 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fcc78066280 0x7fcc78068730 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:37.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.695+0000 7fcc91d37640 1 --2- 172.21.15.6:0/3573012896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc8c06a540 0x7fcc8c158db0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:37.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.695+0000 7fcc91d37640 1 -- 172.21.15.6:0/3573012896 >> 172.21.15.6:0/3573012896 conn(0x7fcc8c099490 msgr2=0x7fcc8c089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:37.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.695+0000 7fcc91d37640 1 -- 172.21.15.6:0/3573012896 shutdown_connections 2023-07-21T22:19:37.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.695+0000 7fcc91d37640 1 -- 172.21.15.6:0/3573012896 wait complete. 2023-07-21T22:19:37.766 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-21T22:19:37.766 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-21T22:19:37.766 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-21T22:19:37.767 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:19:37.767 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-21T22:19:37.767 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-21T22:19:37.767 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-21T22:19:37.767 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:19:37.768 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-21T22:19:37.768 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-21T22:19:37.768 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-21T22:19:37.768 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:19:37.769 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-21T22:19:37.769 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-21T22:19:37.769 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-21T22:19:37.769 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:19:37.780 INFO:tasks.ceph.mds.a:Stopped 2023-07-21T22:19:37.781 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-21T22:19:37.781 INFO:tasks.ceph.mds.c:Stopped 2023-07-21T22:19:37.782 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-21T22:19:37.783 INFO:tasks.ceph.mds.b:Stopped 2023-07-21T22:19:37.784 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-21T22:19:37.784 INFO:tasks.ceph.mds.d:Stopped 2023-07-21T22:19:37.785 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-21T22:19:37.827 INFO:tasks.ceph.mds.a:Started 2023-07-21T22:19:37.828 DEBUG:teuthology.parallel:result is None 2023-07-21T22:19:37.829 INFO:tasks.ceph.mds.c:Started 2023-07-21T22:19:37.830 DEBUG:teuthology.parallel:result is None 2023-07-21T22:19:37.831 INFO:tasks.ceph.mds.b:Started 2023-07-21T22:19:37.832 DEBUG:teuthology.parallel:result is None 2023-07-21T22:19:37.833 INFO:tasks.ceph.mds.d:Started 2023-07-21T22:19:37.833 DEBUG:teuthology.parallel:result is None 2023-07-21T22:19:37.834 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-21T22:19:37.916 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-07-21T22:19:37.917 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-21T22:19:37.921 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2023-07-21T22:19:37.922 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-07-21T22:19:37.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.935+0000 7ff413693640 1 Processor -- start 2023-07-21T22:19:37.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.935+0000 7ff413693640 1 -- start start 2023-07-21T22:19:37.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.935+0000 7ff413693640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff40c15bc00 0x7ff40c0ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:37.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.935+0000 7ff413693640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff40c160450 0x7ff40c06e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:37.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.935+0000 7ff413693640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff40c0c9c30 con 0x7ff40c069430 2023-07-21T22:19:37.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.935+0000 7ff413693640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40c0c96b0 con 0x7ff40c15bc00 2023-07-21T22:19:37.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.935+0000 7ff413693640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40c15bfd0 con 0x7ff40c160450 2023-07-21T22:19:37.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.935+0000 7ff41142f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff40c15bc00 0x7ff40c0ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:37.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.935+0000 7ff410c2e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff40c160450 0x7ff40c06e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:37.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.935+0000 7ff411c30640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff40c069430 0x7ff40c069830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:38048/0 (socket says 172.21.15.6:38048) 2023-07-21T22:19:37.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.935+0000 7ff411c30640 1 -- 172.21.15.6:0/1641346079 learned_addr learned my addr 172.21.15.6:0/1641346079 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:37.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.935+0000 7ff410c2e640 1 -- 172.21.15.6:0/1641346079 >> v2:172.21.15.6:3300/0 conn(0x7ff40c15bc00 msgr2=0x7ff40c0ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:37.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.935+0000 7ff410c2e640 1 --2- 172.21.15.6:0/1641346079 >> v2:172.21.15.6:3300/0 conn(0x7ff40c15bc00 0x7ff40c0ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:37.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.935+0000 7ff410c2e640 1 -- 172.21.15.6:0/1641346079 >> v1:172.21.15.161:6789/0 conn(0x7ff40c069430 legacy=0x7ff40c069830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:37.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.935+0000 7ff403fff640 1 -- 172.21.15.6:0/1641346079 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4087199058 0 0) 0x7ff40c0c9c30 con 0x7ff40c069430 2023-07-21T22:19:37.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.935+0000 7ff410c2e640 1 -- 172.21.15.6:0/1641346079 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c0cee30 con 0x7ff40c160450 2023-07-21T22:19:37.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.935+0000 7ff41142f640 1 --2- 172.21.15.6:0/1641346079 >> v2:172.21.15.6:3300/0 conn(0x7ff40c15bc00 0x7ff40c0ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:37.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.939+0000 7ff410c2e640 1 --2- 172.21.15.6:0/1641346079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff40c160450 0x7ff40c06e690 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff40c06a160 tx=0x7ff3fc01c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76585b376c39862e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:37.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.939+0000 7ff403fff640 1 -- 172.21.15.6:0/1641346079 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0a7070 con 0x7ff40c160450 2023-07-21T22:19:37.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.939+0000 7ff403fff640 1 -- 172.21.15.6:0/1641346079 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc0ab430 con 0x7ff40c160450 2023-07-21T22:19:37.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.939+0000 7ff403fff640 1 -- 172.21.15.6:0/1641346079 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0ab7c0 con 0x7ff40c160450 2023-07-21T22:19:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.939+0000 7ff413693640 1 -- 172.21.15.6:0/1641346079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff40c160450 msgr2=0x7ff40c06e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.939+0000 7ff413693640 1 --2- 172.21.15.6:0/1641346079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff40c160450 0x7ff40c06e690 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff40c06a160 tx=0x7ff3fc01c430 comp rx=0 tx=0).stop 2023-07-21T22:19:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.939+0000 7ff413693640 1 -- 172.21.15.6:0/1641346079 shutdown_connections 2023-07-21T22:19:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.939+0000 7ff413693640 1 --2- 172.21.15.6:0/1641346079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff40c160450 0x7ff40c06e690 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.939+0000 7ff413693640 1 --2- 172.21.15.6:0/1641346079 >> v2:172.21.15.6:3300/0 conn(0x7ff40c15bc00 0x7ff40c0ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.939+0000 7ff413693640 1 -- 172.21.15.6:0/1641346079 >> 172.21.15.6:0/1641346079 conn(0x7ff40c0b1840 msgr2=0x7ff40c0cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.939+0000 7ff413693640 1 -- 172.21.15.6:0/1641346079 shutdown_connections 2023-07-21T22:19:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.939+0000 7ff413693640 1 -- 172.21.15.6:0/1641346079 wait complete. 2023-07-21T22:19:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff413693640 1 Processor -- start 2023-07-21T22:19:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff413693640 1 -- start start 2023-07-21T22:19:37.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff413693640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40c069430 0x7ff40c1508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff413693640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c15bc00 0x7ff40c149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff413693640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff40c160450 0x7ff40c15ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff413693640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c149960 con 0x7ff40c15bc00 2023-07-21T22:19:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff413693640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c14a330 con 0x7ff40c160450 2023-07-21T22:19:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff413693640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c148d50 con 0x7ff40c069430 2023-07-21T22:19:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff410c2e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c15bc00 0x7ff40c149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff410c2e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c15bc00 0x7ff40c149df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39638/0 (socket says 172.21.15.6:39638) 2023-07-21T22:19:37.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff410c2e640 1 -- 172.21.15.6:0/2315680701 learned_addr learned my addr 172.21.15.6:0/2315680701 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:37.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff410c2e640 1 -- 172.21.15.6:0/2315680701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40c069430 msgr2=0x7ff40c1508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:37.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff41142f640 1 --2- 172.21.15.6:0/2315680701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40c069430 0x7ff40c1508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:37.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff411c30640 1 --2- 172.21.15.6:0/2315680701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff40c160450 0x7ff40c15ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:37.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff410c2e640 1 --2- 172.21.15.6:0/2315680701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40c069430 0x7ff40c1508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:37.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff410c2e640 1 -- 172.21.15.6:0/2315680701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff40c160450 msgr2=0x7ff40c15ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:37.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff410c2e640 1 --2- 172.21.15.6:0/2315680701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff40c160450 0x7ff40c15ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:37.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff410c2e640 1 -- 172.21.15.6:0/2315680701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff408009420 con 0x7ff40c15bc00 2023-07-21T22:19:37.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff41142f640 1 --2- 172.21.15.6:0/2315680701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40c069430 0x7ff40c1508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:37.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff411c30640 1 --2- 172.21.15.6:0/2315680701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff40c160450 0x7ff40c15ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:37.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff410c2e640 1 --2- 172.21.15.6:0/2315680701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c15bc00 0x7ff40c149df0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc019040 tx=0x7ff3fc01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:37.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff401ffb640 1 -- 172.21.15.6:0/2315680701 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0b5610 con 0x7ff40c15bc00 2023-07-21T22:19:37.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff401ffb640 1 -- 172.21.15.6:0/2315680701 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc0b5790 con 0x7ff40c15bc00 2023-07-21T22:19:37.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff401ffb640 1 -- 172.21.15.6:0/2315680701 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0b5b40 con 0x7ff40c15bc00 2023-07-21T22:19:37.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.943+0000 7ff413693640 1 -- 172.21.15.6:0/2315680701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3fc009420 con 0x7ff40c15bc00 2023-07-21T22:19:37.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.947+0000 7ff413693640 1 -- 172.21.15.6:0/2315680701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40c149310 con 0x7ff40c15bc00 2023-07-21T22:19:37.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.947+0000 7ff413693640 1 -- 172.21.15.6:0/2315680701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40c0678d0 con 0x7ff40c15bc00 2023-07-21T22:19:37.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.947+0000 7ff401ffb640 1 -- 172.21.15.6:0/2315680701 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff3fc0b5ca0 con 0x7ff40c15bc00 2023-07-21T22:19:37.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.947+0000 7ff401ffb640 1 --2- 172.21.15.6:0/2315680701 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff3f0066280 0x7ff3f0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:37.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.947+0000 7ff401ffb640 1 -- 172.21.15.6:0/2315680701 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5296+0+0 (secure 0 0 0) 0x7ff3fc11e0c0 con 0x7ff40c15bc00 2023-07-21T22:19:37.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.947+0000 7ff41142f640 1 --2- 172.21.15.6:0/2315680701 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff3f0066280 0x7ff3f0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:37.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.951+0000 7ff41142f640 1 --2- 172.21.15.6:0/2315680701 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff3f0066280 0x7ff3f0068730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff408009c70 tx=0x7ff408008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:38.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:37.951+0000 7ff401ffb640 1 -- 172.21.15.6:0/2315680701 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff3fc0eb870 con 0x7ff40c15bc00 2023-07-21T22:19:38.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.119+0000 7ff413693640 1 -- 172.21.15.6:0/2315680701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff40c0c9890 con 0x7ff40c15bc00 2023-07-21T22:19:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.707+0000 7ff401ffb640 1 -- 172.21.15.6:0/2315680701 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff3fc0eee90 con 0x7ff40c15bc00 2023-07-21T22:19:38.756 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-07-21T22:19:38.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.711+0000 7ff413693640 1 -- 172.21.15.6:0/2315680701 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff3f0066280 msgr2=0x7ff3f0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:38.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.711+0000 7ff413693640 1 --2- 172.21.15.6:0/2315680701 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff3f0066280 0x7ff3f0068730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff408009c70 tx=0x7ff408008040 comp rx=0 tx=0).stop 2023-07-21T22:19:38.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.711+0000 7ff413693640 1 -- 172.21.15.6:0/2315680701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c15bc00 msgr2=0x7ff40c149df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:38.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.711+0000 7ff413693640 1 --2- 172.21.15.6:0/2315680701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c15bc00 0x7ff40c149df0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc019040 tx=0x7ff3fc01ac70 comp rx=0 tx=0).stop 2023-07-21T22:19:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.711+0000 7ff413693640 1 -- 172.21.15.6:0/2315680701 shutdown_connections 2023-07-21T22:19:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.711+0000 7ff413693640 1 --2- 172.21.15.6:0/2315680701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff40c160450 0x7ff40c15ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.711+0000 7ff413693640 1 --2- 172.21.15.6:0/2315680701 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff3f0066280 0x7ff3f0068730 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.711+0000 7ff413693640 1 --2- 172.21.15.6:0/2315680701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40c15bc00 0x7ff40c149df0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.711+0000 7ff413693640 1 --2- 172.21.15.6:0/2315680701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40c069430 0x7ff40c1508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:38.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.711+0000 7ff413693640 1 -- 172.21.15.6:0/2315680701 >> 172.21.15.6:0/2315680701 conn(0x7ff40c0b1840 msgr2=0x7ff40c06c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:38.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.711+0000 7ff413693640 1 -- 172.21.15.6:0/2315680701 shutdown_connections 2023-07-21T22:19:38.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.711+0000 7ff413693640 1 -- 172.21.15.6:0/2315680701 wait complete. 2023-07-21T22:19:38.793 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-21T22:19:38.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.895+0000 7f4d68bfa640 1 Processor -- start 2023-07-21T22:19:38.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.895+0000 7f4d68bfa640 1 -- start start 2023-07-21T22:19:38.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.895+0000 7f4d68bfa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d640d06b0 0x7f4d640b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:38.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.895+0000 7f4d68bfa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4d64145430 0x7f4d640b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:38.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.895+0000 7f4d68bfa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d640b1f70 0x7f4d640d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:38.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.895+0000 7f4d68bfa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d640b2410 con 0x7f4d640d06b0 2023-07-21T22:19:38.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.895+0000 7f4d68bfa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d640b26f0 con 0x7f4d64145430 2023-07-21T22:19:38.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.895+0000 7f4d68bfa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d640b29d0 con 0x7f4d640b1f70 2023-07-21T22:19:38.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.895+0000 7f4d6259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d640d06b0 0x7f4d640b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:38.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.895+0000 7f4d6259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d640d06b0 0x7f4d640b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39652/0 (socket says 172.21.15.6:39652) 2023-07-21T22:19:38.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.895+0000 7f4d6259c640 1 -- 172.21.15.6:0/403598856 learned_addr learned my addr 172.21.15.6:0/403598856 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:38.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.895+0000 7f4d5bfff640 1 --2- 172.21.15.6:0/403598856 >> v2:172.21.15.161:3300/0 conn(0x7f4d64145430 0x7f4d640b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:38.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.895+0000 7f4d62d9d640 1 --2- 172.21.15.6:0/403598856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d640b1f70 0x7f4d640d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:38.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.895+0000 7f4d6259c640 1 -- 172.21.15.6:0/403598856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d640b1f70 msgr2=0x7f4d640d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:38.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.895+0000 7f4d6259c640 1 --2- 172.21.15.6:0/403598856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d640b1f70 0x7f4d640d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:38.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.895+0000 7f4d6259c640 1 -- 172.21.15.6:0/403598856 >> v2:172.21.15.161:3300/0 conn(0x7f4d64145430 msgr2=0x7f4d640b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:38.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.895+0000 7f4d6259c640 1 --2- 172.21.15.6:0/403598856 >> v2:172.21.15.161:3300/0 conn(0x7f4d64145430 0x7f4d640b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:38.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.895+0000 7f4d6259c640 1 -- 172.21.15.6:0/403598856 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d640b2cb0 con 0x7f4d640d06b0 2023-07-21T22:19:38.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.899+0000 7f4d6259c640 1 --2- 172.21.15.6:0/403598856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d640d06b0 0x7f4d640b1a30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4d6408b230 tx=0x7f4d5401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebdb9249898f913 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:38.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.899+0000 7f4d61d9b640 1 -- 172.21.15.6:0/403598856 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d540aa610 con 0x7f4d640d06b0 2023-07-21T22:19:38.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.899+0000 7f4d61d9b640 1 -- 172.21.15.6:0/403598856 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d540a6040 con 0x7f4d640d06b0 2023-07-21T22:19:38.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.899+0000 7f4d61d9b640 1 -- 172.21.15.6:0/403598856 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d540aa990 con 0x7f4d640d06b0 2023-07-21T22:19:38.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.899+0000 7f4d68bfa640 1 -- 172.21.15.6:0/403598856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d640d06b0 msgr2=0x7f4d640b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:38.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.899+0000 7f4d68bfa640 1 --2- 172.21.15.6:0/403598856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d640d06b0 0x7f4d640b1a30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4d6408b230 tx=0x7f4d5401c4d0 comp rx=0 tx=0).stop 2023-07-21T22:19:38.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.899+0000 7f4d68bfa640 1 -- 172.21.15.6:0/403598856 shutdown_connections 2023-07-21T22:19:38.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.899+0000 7f4d68bfa640 1 --2- 172.21.15.6:0/403598856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d640b1f70 0x7f4d640d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:38.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.899+0000 7f4d68bfa640 1 --2- 172.21.15.6:0/403598856 >> v2:172.21.15.161:3300/0 conn(0x7f4d64145430 0x7f4d640b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:38.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.899+0000 7f4d68bfa640 1 --2- 172.21.15.6:0/403598856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d640d06b0 0x7f4d640b1a30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:38.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.899+0000 7f4d68bfa640 1 -- 172.21.15.6:0/403598856 >> 172.21.15.6:0/403598856 conn(0x7f4d640659d0 msgr2=0x7f4d6409b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:38.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.899+0000 7f4d68bfa640 1 -- 172.21.15.6:0/403598856 shutdown_connections 2023-07-21T22:19:38.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.899+0000 7f4d68bfa640 1 -- 172.21.15.6:0/403598856 wait complete. 2023-07-21T22:19:38.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d68bfa640 1 Processor -- start 2023-07-21T22:19:38.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d68bfa640 1 -- start start 2023-07-21T22:19:38.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d68bfa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d640b1f70 0x7f4d6415bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:38.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d68bfa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d640d06b0 0x7f4d6415e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:38.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d68bfa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d640c5260 0x7f4d641559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:38.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d68bfa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d640c9e30 con 0x7f4d640c5260 2023-07-21T22:19:38.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d68bfa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d640c5740 con 0x7f4d640d06b0 2023-07-21T22:19:38.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d68bfa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d640ca040 con 0x7f4d640b1f70 2023-07-21T22:19:38.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d62d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d640c5260 0x7f4d641559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:38.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d6259c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d640b1f70 0x7f4d6415bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:38.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d62d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d640c5260 0x7f4d641559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39666/0 (socket says 172.21.15.6:39666) 2023-07-21T22:19:38.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d5bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d640d06b0 0x7f4d6415e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:38.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d62d9d640 1 -- 172.21.15.6:0/197128023 learned_addr learned my addr 172.21.15.6:0/197128023 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:38.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d62d9d640 1 -- 172.21.15.6:0/197128023 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d640b1f70 msgr2=0x7f4d6415bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:38.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d62d9d640 1 --2- 172.21.15.6:0/197128023 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d640b1f70 0x7f4d6415bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:38.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d62d9d640 1 -- 172.21.15.6:0/197128023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d640d06b0 msgr2=0x7f4d6415e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:38.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d62d9d640 1 --2- 172.21.15.6:0/197128023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d640d06b0 0x7f4d6415e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:38.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d62d9d640 1 -- 172.21.15.6:0/197128023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d540094d0 con 0x7f4d640c5260 2023-07-21T22:19:38.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d5bfff640 1 --2- 172.21.15.6:0/197128023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d640d06b0 0x7f4d6415e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:38.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d6259c640 1 --2- 172.21.15.6:0/197128023 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d640b1f70 0x7f4d6415bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:38.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d62d9d640 1 --2- 172.21.15.6:0/197128023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d640c5260 0x7f4d641559d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c007d20 tx=0x7f4d5c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:38.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d5affd640 1 -- 172.21.15.6:0/197128023 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c014420 con 0x7f4d640c5260 2023-07-21T22:19:38.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d5affd640 1 -- 172.21.15.6:0/197128023 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c0145a0 con 0x7f4d640c5260 2023-07-21T22:19:38.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.903+0000 7f4d5affd640 1 -- 172.21.15.6:0/197128023 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c014950 con 0x7f4d640c5260 2023-07-21T22:19:38.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.907+0000 7f4d68bfa640 1 -- 172.21.15.6:0/197128023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d640ca320 con 0x7f4d640c5260 2023-07-21T22:19:38.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.907+0000 7f4d68bfa640 1 -- 172.21.15.6:0/197128023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6415e650 con 0x7f4d640c5260 2023-07-21T22:19:38.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.907+0000 7f4d68bfa640 1 -- 172.21.15.6:0/197128023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d64072e70 con 0x7f4d640c5260 2023-07-21T22:19:38.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.907+0000 7f4d5affd640 1 -- 172.21.15.6:0/197128023 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4d5c014ab0 con 0x7f4d640c5260 2023-07-21T22:19:38.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.907+0000 7f4d5affd640 1 --2- 172.21.15.6:0/197128023 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4d44066280 0x7f4d44068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:38.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.907+0000 7f4d5affd640 1 -- 172.21.15.6:0/197128023 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4d5c084130 con 0x7f4d640c5260 2023-07-21T22:19:38.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.907+0000 7f4d6259c640 1 --2- 172.21.15.6:0/197128023 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4d44066280 0x7f4d44068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:38.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.907+0000 7f4d6259c640 1 --2- 172.21.15.6:0/197128023 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4d44066280 0x7f4d44068730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4d540ae000 tx=0x7f4d540b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:38.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:38.911+0000 7f4d5affd640 1 -- 172.21.15.6:0/197128023 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4d5c0519b0 con 0x7f4d640c5260 2023-07-21T22:19:39.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.119+0000 7f4d68bfa640 1 -- 172.21.15.6:0/197128023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4d640678d0 con 0x7f4d640c5260 2023-07-21T22:19:39.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.119+0000 7f4d5affd640 1 -- 172.21.15.6:0/197128023 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f4d5c054fd0 con 0x7f4d640c5260 2023-07-21T22:19:39.168 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:39.168 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:19:39.168 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-07-21T22:19:39.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.169 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-07-21T22:19:39.169 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkHn5HNxAADk0AaSGwZfEj3SwNvEm8hw==", 2023-07-21T22:19:39.169 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.169 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:19:39.169 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:19:39.170 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:19:39.170 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:19:39.170 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.171 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-07-21T22:19:39.171 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkQFvXCBAANxf0/I2RQcHy4iYiydjkcg==", 2023-07-21T22:19:39.171 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.172 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:19:39.172 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:19:39.172 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:19:39.173 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:19:39.173 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.173 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.174 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-07-21T22:19:39.174 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkYtGXAxAAy+RDDBSvc1FeZq+eg23tRA==", 2023-07-21T22:19:39.174 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.175 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:19:39.175 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:19:39.175 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:19:39.176 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:19:39.176 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.177 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.177 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-07-21T22:19:39.177 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkH+Y1EBAAl+qTqd+gFrB9LtJWwD5dgA==", 2023-07-21T22:19:39.177 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.178 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:19:39.178 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:19:39.178 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:19:39.178 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:19:39.178 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.179 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.179 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-07-21T22:19:39.179 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAKBLtkPwZrLBAAQHZECi2zHST1MKYgGoa/Iw==", 2023-07-21T22:19:39.180 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.180 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:19:39.180 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:19:39.181 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:19:39.181 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.182 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-07-21T22:19:39.182 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQANBLtkvwgwNBAApurMm8c3pSlX2r16Gli/Ag==", 2023-07-21T22:19:39.183 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.183 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:19:39.183 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:19:39.183 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:19:39.183 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.184 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-07-21T22:19:39.184 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAQBLtkf2p1OxAAcKYw2RixFefYAwcfkGnOKQ==", 2023-07-21T22:19:39.184 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.184 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:19:39.184 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:19:39.184 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:19:39.184 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.185 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-07-21T22:19:39.185 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAUBLtkQUl6BhAAXXT1ZK1h9aZEcp6qIHsLiA==", 2023-07-21T22:19:39.185 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.185 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:19:39.185 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:19:39.185 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:19:39.186 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.186 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.186 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-07-21T22:19:39.186 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAaBLtkc1VfExAAPzDz2k/c0qVePG9h1saQCw==", 2023-07-21T22:19:39.186 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.186 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:19:39.186 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:19:39.187 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:19:39.187 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.188 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-07-21T22:19:39.189 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAdBLtkJ6fcGhAAglVSJIQS04WYBv4APhl57g==", 2023-07-21T22:19:39.189 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.189 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:19:39.189 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:19:39.189 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:19:39.190 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.190 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-07-21T22:19:39.190 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAgBLtkPINGIRAAWKs1RNQIdhZYlDAzDgUkNw==", 2023-07-21T22:19:39.190 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.190 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:19:39.191 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:19:39.191 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:19:39.191 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.191 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-07-21T22:19:39.191 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAjBLtk83MCKBAAZH2NhMBphVv4QkRzy+NDgg==", 2023-07-21T22:19:39.192 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.192 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:19:39.192 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:19:39.192 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:19:39.192 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.193 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-07-21T22:19:39.193 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA==", 2023-07-21T22:19:39.193 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.193 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:19:39.193 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:19:39.193 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:19:39.193 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:19:39.193 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.194 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.194 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-07-21T22:19:39.194 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkPVXTHhAAYmkzwAvqsfrowpAucTnlUQ==", 2023-07-21T22:19:39.194 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.194 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:19:39.195 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:19:39.195 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:19:39.195 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:19:39.195 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.195 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.195 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-07-21T22:19:39.196 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkd7wSGxAArvSYwe+k48vgRzb3fQAEAQ==", 2023-07-21T22:19:39.196 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.196 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:19:39.196 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:19:39.196 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:19:39.196 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:19:39.197 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.197 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.197 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-07-21T22:19:39.197 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkoZ4YJRAAX4yh0Q1pR4wY7yEV6kg9QA==", 2023-07-21T22:19:39.197 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.197 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:19:39.197 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:19:39.198 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:19:39.198 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:19:39.198 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.198 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.198 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-07-21T22:19:39.198 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtk0ILFGhAAQZ+8lGNFVdOtZYOuLlfkoQ==", 2023-07-21T22:19:39.199 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.199 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:19:39.199 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:19:39.199 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:19:39.199 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:19:39.199 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.200 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-mds", 2023-07-21T22:19:39.200 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQApBLtkvMokLRAAJwgceuxce5Lu3Nc0Mx09Ug==", 2023-07-21T22:19:39.200 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.201 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-mds" 2023-07-21T22:19:39.201 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.201 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-mgr", 2023-07-21T22:19:39.201 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQApBLtkSdUkLRAAZ48IpjNUO1zasnQgoBNeCw==", 2023-07-21T22:19:39.202 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.202 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-21T22:19:39.202 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.202 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-osd", 2023-07-21T22:19:39.202 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQApBLtk990kLRAAqKHX+TopmbKbD4zIosawJg==", 2023-07-21T22:19:39.202 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.203 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-osd" 2023-07-21T22:19:39.203 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.203 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.203 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.203 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rbd", 2023-07-21T22:19:39.203 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQApBLtkRuYkLRAAN7DypgLgY/oBuCcuwoq99w==", 2023-07-21T22:19:39.203 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.204 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-21T22:19:39.204 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.204 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.204 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-21T22:19:39.204 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQApBLtkz+4kLRAA4TlfJtFfDX3fW7a0it1lqA==", 2023-07-21T22:19:39.204 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.204 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-21T22:19:39.205 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.205 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.205 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rgw", 2023-07-21T22:19:39.205 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQApBLtkoPckLRAAETG1OwIptVLRrafBqEufRQ==", 2023-07-21T22:19:39.205 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.205 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-21T22:19:39.206 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.206 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.206 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-07-21T22:19:39.206 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkdobtMhAAQbwi3cvsrW9P0t3d52oEKw==", 2023-07-21T22:19:39.206 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.207 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:19:39.207 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T22:19:39.207 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:19:39.207 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:39.207 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:39.208 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-07-21T22:19:39.208 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkHhzpLhAAZTx4Vrc0Htk88104SzuAxQ==", 2023-07-21T22:19:39.208 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:19:39.208 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:19:39.208 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T22:19:39.208 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:19:39.208 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.209 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:39.209 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-07-21T22:19:39.209 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:19:39.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.119+0000 7f4d68bfa640 1 -- 172.21.15.6:0/197128023 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4d44066280 msgr2=0x7f4d44068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:39.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.119+0000 7f4d68bfa640 1 --2- 172.21.15.6:0/197128023 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4d44066280 0x7f4d44068730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4d540ae000 tx=0x7f4d540b5040 comp rx=0 tx=0).stop 2023-07-21T22:19:39.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.119+0000 7f4d68bfa640 1 -- 172.21.15.6:0/197128023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d640c5260 msgr2=0x7f4d641559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:39.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.119+0000 7f4d68bfa640 1 --2- 172.21.15.6:0/197128023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d640c5260 0x7f4d641559d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c007d20 tx=0x7f4d5c00e4b0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.119+0000 7f4d68bfa640 1 -- 172.21.15.6:0/197128023 shutdown_connections 2023-07-21T22:19:39.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.119+0000 7f4d68bfa640 1 --2- 172.21.15.6:0/197128023 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4d44066280 0x7f4d44068730 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.119+0000 7f4d68bfa640 1 --2- 172.21.15.6:0/197128023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d640c5260 0x7f4d641559d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.119+0000 7f4d68bfa640 1 --2- 172.21.15.6:0/197128023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d640d06b0 0x7f4d6415e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.119+0000 7f4d68bfa640 1 --2- 172.21.15.6:0/197128023 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d640b1f70 0x7f4d6415bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.119+0000 7f4d68bfa640 1 -- 172.21.15.6:0/197128023 >> 172.21.15.6:0/197128023 conn(0x7f4d640659d0 msgr2=0x7f4d640b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:39.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.119+0000 7f4d68bfa640 1 -- 172.21.15.6:0/197128023 shutdown_connections 2023-07-21T22:19:39.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.119+0000 7f4d68bfa640 1 -- 172.21.15.6:0/197128023 wait complete. 2023-07-21T22:19:39.213 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-21T22:19:39.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.311+0000 7f4d50296640 1 Processor -- start 2023-07-21T22:19:39.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.311+0000 7f4d50296640 1 -- start start 2023-07-21T22:19:39.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.311+0000 7f4d50296640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d48158ce0 0x7f4d48070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:39.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.311+0000 7f4d50296640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4d480c8ad0 0x7f4d480c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:39.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.311+0000 7f4d50296640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d480c99c0 con 0x7f4d480c9560 2023-07-21T22:19:39.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.311+0000 7f4d50296640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d480cc700 con 0x7f4d48158ce0 2023-07-21T22:19:39.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.311+0000 7f4d50296640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d480b0ff0 con 0x7f4d480c8ad0 2023-07-21T22:19:39.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.311+0000 7f4d4e032640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d48158ce0 0x7f4d48070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:39.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.311+0000 7f4d4e032640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d48158ce0 0x7f4d48070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39680/0 (socket says 172.21.15.6:39680) 2023-07-21T22:19:39.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.311+0000 7f4d4e032640 1 -- 172.21.15.6:0/1983205304 learned_addr learned my addr 172.21.15.6:0/1983205304 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:39.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.311+0000 7f4d4d831640 1 --2- 172.21.15.6:0/1983205304 >> v2:172.21.15.161:3300/0 conn(0x7f4d480c8ad0 0x7f4d480c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:39.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.311+0000 7f4d4e032640 1 -- 172.21.15.6:0/1983205304 >> v2:172.21.15.161:3300/0 conn(0x7f4d480c8ad0 msgr2=0x7f4d480c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:39.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.311+0000 7f4d4e032640 1 --2- 172.21.15.6:0/1983205304 >> v2:172.21.15.161:3300/0 conn(0x7f4d480c8ad0 0x7f4d480c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.311+0000 7f4d4e032640 1 -- 172.21.15.6:0/1983205304 >> v1:172.21.15.161:6789/0 conn(0x7f4d480c9560 legacy=0x7f4d480cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.311+0000 7f4d4e032640 1 -- 172.21.15.6:0/1983205304 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d48070c80 con 0x7f4d48158ce0 2023-07-21T22:19:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.311+0000 7f4d4d831640 1 --2- 172.21.15.6:0/1983205304 >> v2:172.21.15.161:3300/0 conn(0x7f4d480c8ad0 0x7f4d480c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:39.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.315+0000 7f4d4e032640 1 --2- 172.21.15.6:0/1983205304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d48158ce0 0x7f4d48070450 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4d480c1a30 tx=0x7f4d4401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583263bb47bd44 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:39.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.315+0000 7f4d4d030640 1 -- 172.21.15.6:0/1983205304 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d480cba20 con 0x7f4d48158ce0 2023-07-21T22:19:39.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.315+0000 7f4d4d030640 1 -- 172.21.15.6:0/1983205304 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d440a7050 con 0x7f4d48158ce0 2023-07-21T22:19:39.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.315+0000 7f4d4d030640 1 -- 172.21.15.6:0/1983205304 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d440ab820 con 0x7f4d48158ce0 2023-07-21T22:19:39.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.315+0000 7f4d50296640 1 -- 172.21.15.6:0/1983205304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d48158ce0 msgr2=0x7f4d48070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:39.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.315+0000 7f4d50296640 1 --2- 172.21.15.6:0/1983205304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d48158ce0 0x7f4d48070450 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4d480c1a30 tx=0x7f4d4401c370 comp rx=0 tx=0).stop 2023-07-21T22:19:39.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.315+0000 7f4d50296640 1 -- 172.21.15.6:0/1983205304 shutdown_connections 2023-07-21T22:19:39.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.315+0000 7f4d50296640 1 --2- 172.21.15.6:0/1983205304 >> v2:172.21.15.161:3300/0 conn(0x7f4d480c8ad0 0x7f4d480c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.315+0000 7f4d50296640 1 --2- 172.21.15.6:0/1983205304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d48158ce0 0x7f4d48070450 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.315+0000 7f4d50296640 1 -- 172.21.15.6:0/1983205304 >> 172.21.15.6:0/1983205304 conn(0x7f4d480afcf0 msgr2=0x7f4d480b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:39.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.315+0000 7f4d50296640 1 -- 172.21.15.6:0/1983205304 shutdown_connections 2023-07-21T22:19:39.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.315+0000 7f4d50296640 1 -- 172.21.15.6:0/1983205304 wait complete. 2023-07-21T22:19:39.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.315+0000 7f4d50296640 1 Processor -- start 2023-07-21T22:19:39.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.315+0000 7f4d50296640 1 -- start start 2023-07-21T22:19:39.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d50296640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d480c8ad0 0x7f4d4814bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:39.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d50296640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d480c9560 0x7f4d481590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:39.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d50296640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d48158ce0 0x7f4d4814d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:39.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d50296640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d480c8170 con 0x7f4d480c8ad0 2023-07-21T22:19:39.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d50296640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d480b1c80 con 0x7f4d480c9560 2023-07-21T22:19:39.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d50296640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d480b1390 con 0x7f4d48158ce0 2023-07-21T22:19:39.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d4e032640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d480c8ad0 0x7f4d4814bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:39.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d4e032640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d480c8ad0 0x7f4d4814bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39686/0 (socket says 172.21.15.6:39686) 2023-07-21T22:19:39.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d4e032640 1 -- 172.21.15.6:0/1515197591 learned_addr learned my addr 172.21.15.6:0/1515197591 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d4d831640 1 --2- 172.21.15.6:0/1515197591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d480c9560 0x7f4d481590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d4e833640 1 --2- 172.21.15.6:0/1515197591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d48158ce0 0x7f4d4814d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:39.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d4e032640 1 -- 172.21.15.6:0/1515197591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d48158ce0 msgr2=0x7f4d4814d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d4e032640 1 --2- 172.21.15.6:0/1515197591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d48158ce0 0x7f4d4814d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d4e032640 1 -- 172.21.15.6:0/1515197591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d480c9560 msgr2=0x7f4d481590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d4e032640 1 --2- 172.21.15.6:0/1515197591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d480c9560 0x7f4d481590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d4e032640 1 -- 172.21.15.6:0/1515197591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d440094d0 con 0x7f4d480c8ad0 2023-07-21T22:19:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d4e833640 1 --2- 172.21.15.6:0/1515197591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d48158ce0 0x7f4d4814d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d4d831640 1 --2- 172.21.15.6:0/1515197591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d480c9560 0x7f4d481590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d4e032640 1 --2- 172.21.15.6:0/1515197591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d480c8ad0 0x7f4d4814bec0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4d440ae040 tx=0x7f4d4401abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d3effd640 1 -- 172.21.15.6:0/1515197591 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d440b6620 con 0x7f4d480c8ad0 2023-07-21T22:19:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d3effd640 1 -- 172.21.15.6:0/1515197591 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d440b67a0 con 0x7f4d480c8ad0 2023-07-21T22:19:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d50296640 1 -- 172.21.15.6:0/1515197591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4814c400 con 0x7f4d480c8ad0 2023-07-21T22:19:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d3effd640 1 -- 172.21.15.6:0/1515197591 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d440b6b50 con 0x7f4d480c8ad0 2023-07-21T22:19:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d50296640 1 -- 172.21.15.6:0/1515197591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d480b1630 con 0x7f4d480c8ad0 2023-07-21T22:19:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d50296640 1 -- 172.21.15.6:0/1515197591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d480ca1a0 con 0x7f4d480c8ad0 2023-07-21T22:19:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.319+0000 7f4d3effd640 1 -- 172.21.15.6:0/1515197591 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4d440b2040 con 0x7f4d480c8ad0 2023-07-21T22:19:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.323+0000 7f4d3effd640 1 --2- 172.21.15.6:0/1515197591 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4d2c0662b0 0x7f4d2c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.323+0000 7f4d3effd640 1 -- 172.21.15.6:0/1515197591 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4d4411ded0 con 0x7f4d480c8ad0 2023-07-21T22:19:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.323+0000 7f4d4d831640 1 --2- 172.21.15.6:0/1515197591 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4d2c0662b0 0x7f4d2c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.323+0000 7f4d4d831640 1 --2- 172.21.15.6:0/1515197591 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4d2c0662b0 0x7f4d2c068760 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4d480c6a10 tx=0x7f4d38008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.327+0000 7f4d3effd640 1 -- 172.21.15.6:0/1515197591 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4d440eb680 con 0x7f4d480c8ad0 2023-07-21T22:19:39.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.531+0000 7f4d50296640 1 -- 172.21.15.6:0/1515197591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f4d480678d0 con 0x7f4d480c8ad0 2023-07-21T22:19:39.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.539+0000 7f4d3effd640 1 -- 172.21.15.6:0/1515197591 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4d440eeca0 con 0x7f4d480c8ad0 2023-07-21T22:19:39.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.539+0000 7f4d50296640 1 -- 172.21.15.6:0/1515197591 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4d2c0662b0 msgr2=0x7f4d2c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:39.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.539+0000 7f4d50296640 1 --2- 172.21.15.6:0/1515197591 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4d2c0662b0 0x7f4d2c068760 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4d480c6a10 tx=0x7f4d38008040 comp rx=0 tx=0).stop 2023-07-21T22:19:39.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.539+0000 7f4d50296640 1 -- 172.21.15.6:0/1515197591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d480c8ad0 msgr2=0x7f4d4814bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:39.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.539+0000 7f4d50296640 1 --2- 172.21.15.6:0/1515197591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d480c8ad0 0x7f4d4814bec0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4d440ae040 tx=0x7f4d4401abb0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.539+0000 7f4d50296640 1 -- 172.21.15.6:0/1515197591 shutdown_connections 2023-07-21T22:19:39.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.539+0000 7f4d50296640 1 --2- 172.21.15.6:0/1515197591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d48158ce0 0x7f4d4814d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.539+0000 7f4d50296640 1 --2- 172.21.15.6:0/1515197591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d480c9560 0x7f4d481590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.539+0000 7f4d50296640 1 --2- 172.21.15.6:0/1515197591 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4d2c0662b0 0x7f4d2c068760 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.539+0000 7f4d50296640 1 --2- 172.21.15.6:0/1515197591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d480c8ad0 0x7f4d4814bec0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.539+0000 7f4d50296640 1 -- 172.21.15.6:0/1515197591 >> 172.21.15.6:0/1515197591 conn(0x7f4d480afcf0 msgr2=0x7f4d480ca610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:39.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.539+0000 7f4d50296640 1 -- 172.21.15.6:0/1515197591 shutdown_connections 2023-07-21T22:19:39.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.539+0000 7f4d50296640 1 -- 172.21.15.6:0/1515197591 wait complete. 2023-07-21T22:19:39.607 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-21T22:19:39.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.703+0000 7ff054eec640 1 Processor -- start 2023-07-21T22:19:39.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.703+0000 7ff054eec640 1 -- start start 2023-07-21T22:19:39.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.707+0000 7ff054eec640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff0500b7c70 0x7ff0500d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:39.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.707+0000 7ff054eec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff05015fd60 0x7ff0500d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:39.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.707+0000 7ff054eec640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0500ccaf0 con 0x7ff0500d1850 2023-07-21T22:19:39.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.707+0000 7ff054eec640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0500d1190 con 0x7ff0500b7c70 2023-07-21T22:19:39.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.707+0000 7ff054eec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff050160600 con 0x7ff05015fd60 2023-07-21T22:19:39.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.707+0000 7ff04e59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff0500b7c70 0x7ff0500d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:39.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.707+0000 7ff04dd9b640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff0500d1850 0x7ff05015f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:38060/0 (socket says 172.21.15.6:38060) 2023-07-21T22:19:39.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.707+0000 7ff04dd9b640 1 -- 172.21.15.6:0/3877794386 learned_addr learned my addr 172.21.15.6:0/3877794386 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:39.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.707+0000 7ff04ed9d640 1 --2- 172.21.15.6:0/3877794386 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff05015fd60 0x7ff0500d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:39.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.707+0000 7ff04ed9d640 1 -- 172.21.15.6:0/3877794386 >> v2:172.21.15.161:3300/0 conn(0x7ff0500b7c70 msgr2=0x7ff0500d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:39.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.707+0000 7ff04ed9d640 1 --2- 172.21.15.6:0/3877794386 >> v2:172.21.15.161:3300/0 conn(0x7ff0500b7c70 0x7ff0500d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.707+0000 7ff04ed9d640 1 -- 172.21.15.6:0/3877794386 >> v1:172.21.15.161:6789/0 conn(0x7ff0500d1850 legacy=0x7ff05015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:39.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.707+0000 7ff04ed9d640 1 -- 172.21.15.6:0/3877794386 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff050160320 con 0x7ff05015fd60 2023-07-21T22:19:39.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.711+0000 7ff04ed9d640 1 --2- 172.21.15.6:0/3877794386 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff05015fd60 0x7ff0500d1da0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff048009d90 tx=0x7ff04801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6139ef7040473259 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:39.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.711+0000 7ff04d59a640 1 -- 172.21.15.6:0/3877794386 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0480a5a00 con 0x7ff05015fd60 2023-07-21T22:19:39.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.711+0000 7ff04d59a640 1 -- 172.21.15.6:0/3877794386 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0480a5b60 con 0x7ff05015fd60 2023-07-21T22:19:39.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.711+0000 7ff04d59a640 1 -- 172.21.15.6:0/3877794386 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0480ad440 con 0x7ff05015fd60 2023-07-21T22:19:39.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.711+0000 7ff054eec640 1 -- 172.21.15.6:0/3877794386 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff05015fd60 msgr2=0x7ff0500d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.711+0000 7ff054eec640 1 --2- 172.21.15.6:0/3877794386 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff05015fd60 0x7ff0500d1da0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff048009d90 tx=0x7ff04801c920 comp rx=0 tx=0).stop 2023-07-21T22:19:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.711+0000 7ff054eec640 1 -- 172.21.15.6:0/3877794386 shutdown_connections 2023-07-21T22:19:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.711+0000 7ff054eec640 1 --2- 172.21.15.6:0/3877794386 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff05015fd60 0x7ff0500d1da0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.711+0000 7ff054eec640 1 --2- 172.21.15.6:0/3877794386 >> v2:172.21.15.161:3300/0 conn(0x7ff0500b7c70 0x7ff0500d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.711+0000 7ff054eec640 1 -- 172.21.15.6:0/3877794386 >> 172.21.15.6:0/3877794386 conn(0x7ff0500650b0 msgr2=0x7ff0500654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:39.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.711+0000 7ff054eec640 1 -- 172.21.15.6:0/3877794386 shutdown_connections 2023-07-21T22:19:39.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.711+0000 7ff054eec640 1 -- 172.21.15.6:0/3877794386 wait complete. 2023-07-21T22:19:39.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff054eec640 1 Processor -- start 2023-07-21T22:19:39.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff054eec640 1 -- start start 2023-07-21T22:19:39.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff054eec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0500b7c70 0x7ff05015b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:39.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff054eec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0500d1850 0x7ff050152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:39.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff054eec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff05015fd60 0x7ff05015c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:39.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff054eec640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05015b8e0 con 0x7ff05015fd60 2023-07-21T22:19:39.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff054eec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff050152690 con 0x7ff0500b7c70 2023-07-21T22:19:39.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff054eec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff050150580 con 0x7ff0500d1850 2023-07-21T22:19:39.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff04ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff05015fd60 0x7ff05015c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:39.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff04ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff05015fd60 0x7ff05015c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39694/0 (socket says 172.21.15.6:39694) 2023-07-21T22:19:39.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff04ed9d640 1 -- 172.21.15.6:0/2995263954 learned_addr learned my addr 172.21.15.6:0/2995263954 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:39.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff04e59c640 1 --2- 172.21.15.6:0/2995263954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0500b7c70 0x7ff05015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:39.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff04dd9b640 1 --2- 172.21.15.6:0/2995263954 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0500d1850 0x7ff050152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:39.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff04ed9d640 1 -- 172.21.15.6:0/2995263954 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0500d1850 msgr2=0x7ff050152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:39.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff04ed9d640 1 --2- 172.21.15.6:0/2995263954 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0500d1850 0x7ff050152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff04ed9d640 1 -- 172.21.15.6:0/2995263954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0500b7c70 msgr2=0x7ff05015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:39.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff04ed9d640 1 --2- 172.21.15.6:0/2995263954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0500b7c70 0x7ff05015b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff04ed9d640 1 -- 172.21.15.6:0/2995263954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff048009a70 con 0x7ff05015fd60 2023-07-21T22:19:39.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff04ed9d640 1 --2- 172.21.15.6:0/2995263954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff05015fd60 0x7ff05015c130 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff04801ce00 tx=0x7ff0480196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:39.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff03effd640 1 -- 172.21.15.6:0/2995263954 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0480adad0 con 0x7ff05015fd60 2023-07-21T22:19:39.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff03effd640 1 -- 172.21.15.6:0/2995263954 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0480adc30 con 0x7ff05015fd60 2023-07-21T22:19:39.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff054eec640 1 -- 172.21.15.6:0/2995263954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff050159d60 con 0x7ff05015fd60 2023-07-21T22:19:39.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff03effd640 1 -- 172.21.15.6:0/2995263954 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0480b8420 con 0x7ff05015fd60 2023-07-21T22:19:39.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.715+0000 7ff054eec640 1 -- 172.21.15.6:0/2995263954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff050159a80 con 0x7ff05015fd60 2023-07-21T22:19:39.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.719+0000 7ff054eec640 1 -- 172.21.15.6:0/2995263954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0501503e0 con 0x7ff05015fd60 2023-07-21T22:19:39.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.719+0000 7ff03effd640 1 -- 172.21.15.6:0/2995263954 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff0480b8580 con 0x7ff05015fd60 2023-07-21T22:19:39.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.719+0000 7ff03effd640 1 --2- 172.21.15.6:0/2995263954 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff030066280 0x7ff030068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:39.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.719+0000 7ff03effd640 1 -- 172.21.15.6:0/2995263954 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff04811eed0 con 0x7ff05015fd60 2023-07-21T22:19:39.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.719+0000 7ff04e59c640 1 --2- 172.21.15.6:0/2995263954 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff030066280 0x7ff030068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:39.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.719+0000 7ff04e59c640 1 --2- 172.21.15.6:0/2995263954 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff030066280 0x7ff030068730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff050159160 tx=0x7ff040009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:39.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.723+0000 7ff03effd640 1 -- 172.21.15.6:0/2995263954 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff0501503e0 con 0x7ff05015fd60 2023-07-21T22:19:39.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.931+0000 7ff054eec640 1 -- 172.21.15.6:0/2995263954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7ff0501503e0 con 0x7ff05015fd60 2023-07-21T22:19:39.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.935+0000 7ff03effd640 1 -- 172.21.15.6:0/2995263954 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff0501503e0 con 0x7ff05015fd60 2023-07-21T22:19:39.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.939+0000 7ff054eec640 1 -- 172.21.15.6:0/2995263954 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff030066280 msgr2=0x7ff030068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:39.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.939+0000 7ff054eec640 1 --2- 172.21.15.6:0/2995263954 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff030066280 0x7ff030068730 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff050159160 tx=0x7ff040009190 comp rx=0 tx=0).stop 2023-07-21T22:19:39.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.939+0000 7ff054eec640 1 -- 172.21.15.6:0/2995263954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff05015fd60 msgr2=0x7ff05015c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:39.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.939+0000 7ff054eec640 1 --2- 172.21.15.6:0/2995263954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff05015fd60 0x7ff05015c130 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff04801ce00 tx=0x7ff0480196c0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.939+0000 7ff054eec640 1 -- 172.21.15.6:0/2995263954 shutdown_connections 2023-07-21T22:19:39.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.939+0000 7ff054eec640 1 --2- 172.21.15.6:0/2995263954 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff030066280 0x7ff030068730 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.939+0000 7ff054eec640 1 --2- 172.21.15.6:0/2995263954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff05015fd60 0x7ff05015c130 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.939+0000 7ff054eec640 1 --2- 172.21.15.6:0/2995263954 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0500d1850 0x7ff050152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.939+0000 7ff054eec640 1 --2- 172.21.15.6:0/2995263954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0500b7c70 0x7ff05015b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:39.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.939+0000 7ff054eec640 1 -- 172.21.15.6:0/2995263954 >> 172.21.15.6:0/2995263954 conn(0x7ff0500650b0 msgr2=0x7ff050065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:39.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.939+0000 7ff054eec640 1 -- 172.21.15.6:0/2995263954 shutdown_connections 2023-07-21T22:19:39.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:39.939+0000 7ff054eec640 1 -- 172.21.15.6:0/2995263954 wait complete. 2023-07-21T22:19:40.004 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-21T22:19:40.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.099+0000 7fbbe2f00640 1 Processor -- start 2023-07-21T22:19:40.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.103+0000 7fbbe2f00640 1 -- start start 2023-07-21T22:19:40.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.103+0000 7fbbe2f00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbdc06b1e0 0x7fbbdc0c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.103+0000 7fbbe2f00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbdc0cac70 con 0x7fbbdc0c21f0 2023-07-21T22:19:40.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.103+0000 7fbbe2f00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbdc0ca060 con 0x7fbbdc070b70 2023-07-21T22:19:40.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.103+0000 7fbbe2f00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc0ca340 con 0x7fbbdc06b1e0 2023-07-21T22:19:40.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.103+0000 7fbbe149d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbbdc0c21f0 0x7fbbdc0cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52218/0 (socket says 172.21.15.6:52218) 2023-07-21T22:19:40.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.103+0000 7fbbe149d640 1 -- 172.21.15.6:0/1247356297 learned_addr learned my addr 172.21.15.6:0/1247356297 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:40.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.103+0000 7fbbdbfff640 1 --2- 172.21.15.6:0/1247356297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbdc06b1e0 0x7fbbdc0c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.103+0000 7fbbdb7fe640 1 -- 172.21.15.6:0/1247356297 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258159713 0 0) 0x7fbbdc0cac70 con 0x7fbbdc0c21f0 2023-07-21T22:19:40.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.103+0000 7fbbdb7fe640 1 -- 172.21.15.6:0/1247356297 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbcc003530 con 0x7fbbdc0c21f0 2023-07-21T22:19:40.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.103+0000 7fbbdb7fe640 1 -- 172.21.15.6:0/1247356297 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043550844 0 0) 0x7fbbdc0ca060 con 0x7fbbdc070b70 2023-07-21T22:19:40.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.103+0000 7fbbdb7fe640 1 -- 172.21.15.6:0/1247356297 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbdc0cac70 con 0x7fbbdc070b70 2023-07-21T22:19:40.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.103+0000 7fbbdbfff640 1 -- 172.21.15.6:0/1247356297 >> v1:172.21.15.161:6789/0 conn(0x7fbbdc070b70 legacy=0x7fbbdc070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.103+0000 7fbbdbfff640 1 -- 172.21.15.6:0/1247356297 >> v1:172.21.15.6:6789/0 conn(0x7fbbdc0c21f0 legacy=0x7fbbdc0cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.103+0000 7fbbdbfff640 1 -- 172.21.15.6:0/1247356297 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc0ca620 con 0x7fbbdc06b1e0 2023-07-21T22:19:40.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.107+0000 7fbbdbfff640 1 --2- 172.21.15.6:0/1247356297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbdc06b1e0 0x7fbbdc0c1cb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80097f0 tx=0x7fbbc801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abaaf8479c7b1872 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:40.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.107+0000 7fbbdb7fe640 1 -- 172.21.15.6:0/1247356297 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80ab600 con 0x7fbbdc06b1e0 2023-07-21T22:19:40.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.107+0000 7fbbdb7fe640 1 -- 172.21.15.6:0/1247356297 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc80ab760 con 0x7fbbdc06b1e0 2023-07-21T22:19:40.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.107+0000 7fbbdb7fe640 1 -- 172.21.15.6:0/1247356297 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80abad0 con 0x7fbbdc06b1e0 2023-07-21T22:19:40.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.107+0000 7fbbe2f00640 1 -- 172.21.15.6:0/1247356297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbdc06b1e0 msgr2=0x7fbbdc0c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.107+0000 7fbbe2f00640 1 --2- 172.21.15.6:0/1247356297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbdc06b1e0 0x7fbbdc0c1cb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80097f0 tx=0x7fbbc801c400 comp rx=0 tx=0).stop 2023-07-21T22:19:40.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.107+0000 7fbbe2f00640 1 -- 172.21.15.6:0/1247356297 shutdown_connections 2023-07-21T22:19:40.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.107+0000 7fbbe2f00640 1 --2- 172.21.15.6:0/1247356297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbdc06b1e0 0x7fbbdc0c1cb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.107+0000 7fbbe2f00640 1 -- 172.21.15.6:0/1247356297 >> 172.21.15.6:0/1247356297 conn(0x7fbbdc0afcf0 msgr2=0x7fbbdc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:40.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.107+0000 7fbbe2f00640 1 -- 172.21.15.6:0/1247356297 shutdown_connections 2023-07-21T22:19:40.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.107+0000 7fbbe2f00640 1 -- 172.21.15.6:0/1247356297 wait complete. 2023-07-21T22:19:40.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.107+0000 7fbbe2f00640 1 Processor -- start 2023-07-21T22:19:40.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe2f00640 1 -- start start 2023-07-21T22:19:40.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe2f00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbdc06b1e0 0x7fbbdc148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe2f00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbdc070b70 0x7fbbdc0ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe2f00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbdc0c21f0 0x7fbbdc149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe2f00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc0c39d0 con 0x7fbbdc06b1e0 2023-07-21T22:19:40.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe2f00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc0c3cb0 con 0x7fbbdc070b70 2023-07-21T22:19:40.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe2f00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc0c3f90 con 0x7fbbdc0c21f0 2023-07-21T22:19:40.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe0c9c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbdc06b1e0 0x7fbbdc148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe0c9c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbdc06b1e0 0x7fbbdc148140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39698/0 (socket says 172.21.15.6:39698) 2023-07-21T22:19:40.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe0c9c640 1 -- 172.21.15.6:0/1855037981 learned_addr learned my addr 172.21.15.6:0/1855037981 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:40.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbdbfff640 1 --2- 172.21.15.6:0/1855037981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbdc070b70 0x7fbbdc0ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe149d640 1 --2- 172.21.15.6:0/1855037981 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbdc0c21f0 0x7fbbdc149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe0c9c640 1 -- 172.21.15.6:0/1855037981 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbdc0c21f0 msgr2=0x7fbbdc149240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe0c9c640 1 --2- 172.21.15.6:0/1855037981 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbdc0c21f0 0x7fbbdc149240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe0c9c640 1 -- 172.21.15.6:0/1855037981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbdc070b70 msgr2=0x7fbbdc0ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe0c9c640 1 --2- 172.21.15.6:0/1855037981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbdc070b70 0x7fbbdc0ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe0c9c640 1 -- 172.21.15.6:0/1855037981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc8009420 con 0x7fbbdc06b1e0 2023-07-21T22:19:40.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbdbfff640 1 --2- 172.21.15.6:0/1855037981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbdc070b70 0x7fbbdc0ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:40.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe149d640 1 --2- 172.21.15.6:0/1855037981 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbdc0c21f0 0x7fbbdc149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:40.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe0c9c640 1 --2- 172.21.15.6:0/1855037981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbdc06b1e0 0x7fbbdc148140 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000c500 tx=0x7fbbd000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:40.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbd97fa640 1 -- 172.21.15.6:0/1855037981 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd00052d0 con 0x7fbbdc06b1e0 2023-07-21T22:19:40.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbd97fa640 1 -- 172.21.15.6:0/1855037981 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd0005450 con 0x7fbbdc06b1e0 2023-07-21T22:19:40.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbd97fa640 1 -- 172.21.15.6:0/1855037981 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0012870 con 0x7fbbdc06b1e0 2023-07-21T22:19:40.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe2f00640 1 -- 172.21.15.6:0/1855037981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbdc0c4270 con 0x7fbbdc06b1e0 2023-07-21T22:19:40.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe2f00640 1 -- 172.21.15.6:0/1855037981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbdc148680 con 0x7fbbdc06b1e0 2023-07-21T22:19:40.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.111+0000 7fbbe2f00640 1 -- 172.21.15.6:0/1855037981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbdc0678d0 con 0x7fbbdc06b1e0 2023-07-21T22:19:40.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.115+0000 7fbbd97fa640 1 -- 172.21.15.6:0/1855037981 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbbd00129d0 con 0x7fbbdc06b1e0 2023-07-21T22:19:40.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.115+0000 7fbbd97fa640 1 --2- 172.21.15.6:0/1855037981 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbbc0066280 0x7fbbc0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.115+0000 7fbbd97fa640 1 -- 172.21.15.6:0/1855037981 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbbd0083620 con 0x7fbbdc06b1e0 2023-07-21T22:19:40.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.115+0000 7fbbdbfff640 1 --2- 172.21.15.6:0/1855037981 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbbc0066280 0x7fbbc0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.115+0000 7fbbdbfff640 1 --2- 172.21.15.6:0/1855037981 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbbc0066280 0x7fbbc0068730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80af000 tx=0x7fbbc80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:40.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.119+0000 7fbbd97fa640 1 -- 172.21.15.6:0/1855037981 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbbd0050de0 con 0x7fbbdc06b1e0 2023-07-21T22:19:40.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.327+0000 7fbbe2f00640 1 -- 172.21.15.6:0/1855037981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fbbdc0c4720 con 0x7fbbdc06b1e0 2023-07-21T22:19:40.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.331+0000 7fbbd97fa640 1 -- 172.21.15.6:0/1855037981 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbbd0054400 con 0x7fbbdc06b1e0 2023-07-21T22:19:40.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.335+0000 7fbbe2f00640 1 -- 172.21.15.6:0/1855037981 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbbc0066280 msgr2=0x7fbbc0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.335+0000 7fbbe2f00640 1 --2- 172.21.15.6:0/1855037981 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbbc0066280 0x7fbbc0068730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80af000 tx=0x7fbbc80a7000 comp rx=0 tx=0).stop 2023-07-21T22:19:40.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.335+0000 7fbbe2f00640 1 -- 172.21.15.6:0/1855037981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbdc06b1e0 msgr2=0x7fbbdc148140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.335+0000 7fbbe2f00640 1 --2- 172.21.15.6:0/1855037981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbdc06b1e0 0x7fbbdc148140 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000c500 tx=0x7fbbd000c9c0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.335+0000 7fbbe2f00640 1 -- 172.21.15.6:0/1855037981 shutdown_connections 2023-07-21T22:19:40.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.335+0000 7fbbe2f00640 1 --2- 172.21.15.6:0/1855037981 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbdc0c21f0 0x7fbbdc149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.335+0000 7fbbe2f00640 1 --2- 172.21.15.6:0/1855037981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbdc070b70 0x7fbbdc0ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.335+0000 7fbbe2f00640 1 --2- 172.21.15.6:0/1855037981 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbbc0066280 0x7fbbc0068730 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.335+0000 7fbbe2f00640 1 --2- 172.21.15.6:0/1855037981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbdc06b1e0 0x7fbbdc148140 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.335+0000 7fbbe2f00640 1 -- 172.21.15.6:0/1855037981 >> 172.21.15.6:0/1855037981 conn(0x7fbbdc0afcf0 msgr2=0x7fbbdc159480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:40.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.335+0000 7fbbe2f00640 1 -- 172.21.15.6:0/1855037981 shutdown_connections 2023-07-21T22:19:40.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.335+0000 7fbbe2f00640 1 -- 172.21.15.6:0/1855037981 wait complete. 2023-07-21T22:19:40.401 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-21T22:19:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.499+0000 7f6c30e34640 1 Processor -- start 2023-07-21T22:19:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.499+0000 7f6c30e34640 1 -- start start 2023-07-21T22:19:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.499+0000 7f6c30e34640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6c2c159860 0x7f6c2c0708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.499+0000 7f6c30e34640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c2c06dad0 0x7f6c2c0afda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.499+0000 7f6c30e34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c2c0c1e70 0x7f6c2c0b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.499+0000 7f6c30e34640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c2c0c8970 con 0x7f6c2c06dad0 2023-07-21T22:19:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.499+0000 7f6c30e34640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c2c0c8c50 con 0x7f6c2c159860 2023-07-21T22:19:40.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.499+0000 7f6c30e34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c0c8f30 con 0x7f6c2c0c1e70 2023-07-21T22:19:40.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.499+0000 7f6c29d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c2c06dad0 0x7f6c2c0afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.499+0000 7f6c29d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c2c06dad0 0x7f6c2c0afda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39706/0 (socket says 172.21.15.6:39706) 2023-07-21T22:19:40.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.499+0000 7f6c29d9b640 1 -- 172.21.15.6:0/1082407188 learned_addr learned my addr 172.21.15.6:0/1082407188 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.499+0000 7f6c2a59c640 1 --2- 172.21.15.6:0/1082407188 >> v2:172.21.15.161:3300/0 conn(0x7f6c2c159860 0x7f6c2c0708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.499+0000 7f6c2ad9d640 1 --2- 172.21.15.6:0/1082407188 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c2c0c1e70 0x7f6c2c0b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.499+0000 7f6c29d9b640 1 -- 172.21.15.6:0/1082407188 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c2c0c1e70 msgr2=0x7f6c2c0b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.499+0000 7f6c29d9b640 1 --2- 172.21.15.6:0/1082407188 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c2c0c1e70 0x7f6c2c0b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.499+0000 7f6c29d9b640 1 -- 172.21.15.6:0/1082407188 >> v2:172.21.15.161:3300/0 conn(0x7f6c2c159860 msgr2=0x7f6c2c0708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.499+0000 7f6c29d9b640 1 --2- 172.21.15.6:0/1082407188 >> v2:172.21.15.161:3300/0 conn(0x7f6c2c159860 0x7f6c2c0708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.499+0000 7f6c29d9b640 1 -- 172.21.15.6:0/1082407188 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c0c9210 con 0x7f6c2c06dad0 2023-07-21T22:19:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.503+0000 7f6c29d9b640 1 --2- 172.21.15.6:0/1082407188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c2c06dad0 0x7f6c2c0afda0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c06c710 tx=0x7f6c2001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cecf9eca064e4d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.503+0000 7f6c2959a640 1 -- 172.21.15.6:0/1082407188 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c200aa5f0 con 0x7f6c2c06dad0 2023-07-21T22:19:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.503+0000 7f6c2959a640 1 -- 172.21.15.6:0/1082407188 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c200aa750 con 0x7f6c2c06dad0 2023-07-21T22:19:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.503+0000 7f6c2959a640 1 -- 172.21.15.6:0/1082407188 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c200aaae0 con 0x7f6c2c06dad0 2023-07-21T22:19:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.503+0000 7f6c30e34640 1 -- 172.21.15.6:0/1082407188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c2c06dad0 msgr2=0x7f6c2c0afda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.503+0000 7f6c30e34640 1 --2- 172.21.15.6:0/1082407188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c2c06dad0 0x7f6c2c0afda0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c06c710 tx=0x7f6c2001c4d0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.503+0000 7f6c30e34640 1 -- 172.21.15.6:0/1082407188 shutdown_connections 2023-07-21T22:19:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.503+0000 7f6c30e34640 1 --2- 172.21.15.6:0/1082407188 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c2c0c1e70 0x7f6c2c0b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.503+0000 7f6c30e34640 1 --2- 172.21.15.6:0/1082407188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c2c06dad0 0x7f6c2c0afda0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.503+0000 7f6c30e34640 1 --2- 172.21.15.6:0/1082407188 >> v2:172.21.15.161:3300/0 conn(0x7f6c2c159860 0x7f6c2c0708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.503+0000 7f6c30e34640 1 -- 172.21.15.6:0/1082407188 >> 172.21.15.6:0/1082407188 conn(0x7f6c2c0cada0 msgr2=0x7f6c2c0cb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.503+0000 7f6c30e34640 1 -- 172.21.15.6:0/1082407188 shutdown_connections 2023-07-21T22:19:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.503+0000 7f6c30e34640 1 -- 172.21.15.6:0/1082407188 wait complete. 2023-07-21T22:19:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c30e34640 1 Processor -- start 2023-07-21T22:19:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c30e34640 1 -- start start 2023-07-21T22:19:40.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c30e34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c2c06dad0 0x7f6c2c159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c30e34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c2c0c1e70 0x7f6c2c0c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c30e34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c2c159860 0x7f6c2c15bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c30e34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c1538f0 con 0x7f6c2c06dad0 2023-07-21T22:19:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c30e34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c0c5990 con 0x7f6c2c159860 2023-07-21T22:19:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c30e34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c14b680 con 0x7f6c2c0c1e70 2023-07-21T22:19:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c2a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c2c06dad0 0x7f6c2c159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c2a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c2c06dad0 0x7f6c2c159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39722/0 (socket says 172.21.15.6:39722) 2023-07-21T22:19:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c2a59c640 1 -- 172.21.15.6:0/1819118717 learned_addr learned my addr 172.21.15.6:0/1819118717 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c29d9b640 1 --2- 172.21.15.6:0/1819118717 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c2c0c1e70 0x7f6c2c0c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c2ad9d640 1 --2- 172.21.15.6:0/1819118717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c2c159860 0x7f6c2c15bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c2a59c640 1 -- 172.21.15.6:0/1819118717 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c2c0c1e70 msgr2=0x7f6c2c0c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c2a59c640 1 --2- 172.21.15.6:0/1819118717 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c2c0c1e70 0x7f6c2c0c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c2a59c640 1 -- 172.21.15.6:0/1819118717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c2c159860 msgr2=0x7f6c2c15bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c2a59c640 1 --2- 172.21.15.6:0/1819118717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c2c159860 0x7f6c2c15bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c2a59c640 1 -- 172.21.15.6:0/1819118717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c200094d0 con 0x7f6c2c06dad0 2023-07-21T22:19:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c2a59c640 1 --2- 172.21.15.6:0/1819118717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c2c06dad0 0x7f6c2c159db0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00e870 tx=0x7f6c1c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c1affd640 1 -- 172.21.15.6:0/1819118717 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c009510 con 0x7f6c2c06dad0 2023-07-21T22:19:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c1affd640 1 -- 172.21.15.6:0/1819118717 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1c00eec0 con 0x7f6c2c06dad0 2023-07-21T22:19:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c30e34640 1 -- 172.21.15.6:0/1819118717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c2c14b960 con 0x7f6c2c06dad0 2023-07-21T22:19:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c1affd640 1 -- 172.21.15.6:0/1819118717 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c00cb40 con 0x7f6c2c06dad0 2023-07-21T22:19:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.507+0000 7f6c30e34640 1 -- 172.21.15.6:0/1819118717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2c0c81d0 con 0x7f6c2c06dad0 2023-07-21T22:19:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.511+0000 7f6c30e34640 1 -- 172.21.15.6:0/1819118717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c2c0678d0 con 0x7f6c2c06dad0 2023-07-21T22:19:40.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.511+0000 7f6c1affd640 1 -- 172.21.15.6:0/1819118717 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6c1c00cca0 con 0x7f6c2c06dad0 2023-07-21T22:19:40.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.511+0000 7f6c1affd640 1 --2- 172.21.15.6:0/1819118717 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6c0c066280 0x7f6c0c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.511+0000 7f6c1affd640 1 -- 172.21.15.6:0/1819118717 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6c1c0839c0 con 0x7f6c2c06dad0 2023-07-21T22:19:40.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.511+0000 7f6c29d9b640 1 --2- 172.21.15.6:0/1819118717 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6c0c066280 0x7f6c0c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.515+0000 7f6c29d9b640 1 --2- 172.21.15.6:0/1819118717 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6c0c066280 0x7f6c0c068730 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6c200ae000 tx=0x7f6c200b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:40.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.515+0000 7f6c1affd640 1 -- 172.21.15.6:0/1819118717 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6c1c051240 con 0x7f6c2c06dad0 2023-07-21T22:19:40.674 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:19:40.678 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:19:40.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.727+0000 7f6c30e34640 1 -- 172.21.15.6:0/1819118717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f6c2c0c8730 con 0x7f6c2c06dad0 2023-07-21T22:19:40.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.731+0000 7f6c1affd640 1 -- 172.21.15.6:0/1819118717 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6c1c0170a0 con 0x7f6c2c06dad0 2023-07-21T22:19:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.731+0000 7f6c30e34640 1 -- 172.21.15.6:0/1819118717 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6c0c066280 msgr2=0x7f6c0c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.731+0000 7f6c30e34640 1 --2- 172.21.15.6:0/1819118717 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6c0c066280 0x7f6c0c068730 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6c200ae000 tx=0x7f6c200b5040 comp rx=0 tx=0).stop 2023-07-21T22:19:40.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.731+0000 7f6c30e34640 1 -- 172.21.15.6:0/1819118717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c2c06dad0 msgr2=0x7f6c2c159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.731+0000 7f6c30e34640 1 --2- 172.21.15.6:0/1819118717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c2c06dad0 0x7f6c2c159db0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00e870 tx=0x7f6c1c00ec70 comp rx=0 tx=0).stop 2023-07-21T22:19:40.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.731+0000 7f6c30e34640 1 -- 172.21.15.6:0/1819118717 shutdown_connections 2023-07-21T22:19:40.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.731+0000 7f6c30e34640 1 --2- 172.21.15.6:0/1819118717 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c2c159860 0x7f6c2c15bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.731+0000 7f6c30e34640 1 --2- 172.21.15.6:0/1819118717 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c2c0c1e70 0x7f6c2c0c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.731+0000 7f6c30e34640 1 --2- 172.21.15.6:0/1819118717 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f6c0c066280 0x7f6c0c068730 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.731+0000 7f6c30e34640 1 --2- 172.21.15.6:0/1819118717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c2c06dad0 0x7f6c2c159db0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.731+0000 7f6c30e34640 1 -- 172.21.15.6:0/1819118717 >> 172.21.15.6:0/1819118717 conn(0x7f6c2c0cada0 msgr2=0x7f6c2c0b3900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:40.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.731+0000 7f6c30e34640 1 -- 172.21.15.6:0/1819118717 shutdown_connections 2023-07-21T22:19:40.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.731+0000 7f6c30e34640 1 -- 172.21.15.6:0/1819118717 wait complete. 2023-07-21T22:19:40.799 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-21T22:19:40.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.895+0000 7ff89e974640 1 Processor -- start 2023-07-21T22:19:40.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.895+0000 7ff89e974640 1 -- start start 2023-07-21T22:19:40.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.899+0000 7ff89e974640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff898158ce0 0x7ff898070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.899+0000 7ff89e974640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff8980c9730 0x7ff8980ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.899+0000 7ff89e974640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8980cc700 con 0x7ff8980c8ad0 2023-07-21T22:19:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.899+0000 7ff89e974640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8980b0ff0 con 0x7ff8980c9730 2023-07-21T22:19:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.899+0000 7ff89e974640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff898070c80 con 0x7ff898158ce0 2023-07-21T22:19:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.899+0000 7ff897fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff898158ce0 0x7ff898070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.899+0000 7ff89cf11640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff8980c9730 0x7ff8980ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.899+0000 7ff897fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff898158ce0 0x7ff898070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:53564/0 (socket says 172.21.15.6:53564) 2023-07-21T22:19:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.899+0000 7ff897fff640 1 -- 172.21.15.6:0/4086207532 learned_addr learned my addr 172.21.15.6:0/4086207532 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.899+0000 7ff8977fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff8980c8ad0 0x7ff8980c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:38074/0 (socket says 172.21.15.6:38074) 2023-07-21T22:19:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.899+0000 7ff897fff640 1 -- 172.21.15.6:0/4086207532 >> v2:172.21.15.161:3300/0 conn(0x7ff8980c9730 msgr2=0x7ff8980ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.899+0000 7ff897fff640 1 --2- 172.21.15.6:0/4086207532 >> v2:172.21.15.161:3300/0 conn(0x7ff8980c9730 0x7ff8980ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.899+0000 7ff897fff640 1 -- 172.21.15.6:0/4086207532 >> v1:172.21.15.161:6789/0 conn(0x7ff8980c8ad0 legacy=0x7ff8980c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.899+0000 7ff897fff640 1 -- 172.21.15.6:0/4086207532 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8980cbdd0 con 0x7ff898158ce0 2023-07-21T22:19:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.899+0000 7ff89cf11640 1 --2- 172.21.15.6:0/4086207532 >> v2:172.21.15.161:3300/0 conn(0x7ff8980c9730 0x7ff8980ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.899+0000 7ff896ffd640 1 -- 172.21.15.6:0/4086207532 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188592116 0 0) 0x7ff8980cc700 con 0x7ff8980c8ad0 2023-07-21T22:19:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.903+0000 7ff897fff640 1 --2- 172.21.15.6:0/4086207532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff898158ce0 0x7ff898070450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff888009870 tx=0x7ff88801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edab158e3f7faaf8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.903+0000 7ff896ffd640 1 -- 172.21.15.6:0/4086207532 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8880ab610 con 0x7ff898158ce0 2023-07-21T22:19:40.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.903+0000 7ff896ffd640 1 -- 172.21.15.6:0/4086207532 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8880ab770 con 0x7ff898158ce0 2023-07-21T22:19:40.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.903+0000 7ff896ffd640 1 -- 172.21.15.6:0/4086207532 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8880abb00 con 0x7ff898158ce0 2023-07-21T22:19:40.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.903+0000 7ff89e974640 1 -- 172.21.15.6:0/4086207532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff898158ce0 msgr2=0x7ff898070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.903+0000 7ff89e974640 1 --2- 172.21.15.6:0/4086207532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff898158ce0 0x7ff898070450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff888009870 tx=0x7ff88801c3f0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.903+0000 7ff89e974640 1 -- 172.21.15.6:0/4086207532 shutdown_connections 2023-07-21T22:19:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.903+0000 7ff89e974640 1 --2- 172.21.15.6:0/4086207532 >> v2:172.21.15.161:3300/0 conn(0x7ff8980c9730 0x7ff8980ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.903+0000 7ff89e974640 1 --2- 172.21.15.6:0/4086207532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff898158ce0 0x7ff898070450 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.903+0000 7ff89e974640 1 -- 172.21.15.6:0/4086207532 >> 172.21.15.6:0/4086207532 conn(0x7ff8980afcf0 msgr2=0x7ff8980b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.903+0000 7ff89e974640 1 -- 172.21.15.6:0/4086207532 shutdown_connections 2023-07-21T22:19:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.903+0000 7ff89e974640 1 -- 172.21.15.6:0/4086207532 wait complete. 2023-07-21T22:19:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.903+0000 7ff89e974640 1 Processor -- start 2023-07-21T22:19:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.903+0000 7ff89e974640 1 -- start start 2023-07-21T22:19:40.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff89e974640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8980c8ad0 0x7ff8980b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff89e974640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8980c9730 0x7ff8980b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff89e974640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff898158ce0 0x7ff8981648c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff89e974640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8981659f0 con 0x7ff8980c8ad0 2023-07-21T22:19:40.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff89e974640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8980c70a0 con 0x7ff8980c9730 2023-07-21T22:19:40.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff89e974640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8980c7340 con 0x7ff898158ce0 2023-07-21T22:19:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff897fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8980c8ad0 0x7ff8980b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff897fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8980c8ad0 0x7ff8980b3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39726/0 (socket says 172.21.15.6:39726) 2023-07-21T22:19:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff897fff640 1 -- 172.21.15.6:0/1611064268 learned_addr learned my addr 172.21.15.6:0/1611064268 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff8977fe640 1 --2- 172.21.15.6:0/1611064268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8980c9730 0x7ff8980b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff89cf11640 1 --2- 172.21.15.6:0/1611064268 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff898158ce0 0x7ff8981648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff897fff640 1 -- 172.21.15.6:0/1611064268 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff898158ce0 msgr2=0x7ff8981648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff897fff640 1 --2- 172.21.15.6:0/1611064268 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff898158ce0 0x7ff8981648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff897fff640 1 -- 172.21.15.6:0/1611064268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8980c9730 msgr2=0x7ff8980b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff897fff640 1 --2- 172.21.15.6:0/1611064268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8980c9730 0x7ff8980b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff897fff640 1 -- 172.21.15.6:0/1611064268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff890009a70 con 0x7ff8980c8ad0 2023-07-21T22:19:40.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff89cf11640 1 --2- 172.21.15.6:0/1611064268 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff898158ce0 0x7ff8981648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:40.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff8977fe640 1 --2- 172.21.15.6:0/1611064268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8980c9730 0x7ff8980b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:40.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff897fff640 1 --2- 172.21.15.6:0/1611064268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8980c8ad0 0x7ff8980b3b60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff8880ad040 tx=0x7ff88801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:40.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff894ff9640 1 -- 172.21.15.6:0/1611064268 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8880be5f0 con 0x7ff8980c8ad0 2023-07-21T22:19:40.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff894ff9640 1 -- 172.21.15.6:0/1611064268 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8880be770 con 0x7ff8980c8ad0 2023-07-21T22:19:40.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff894ff9640 1 -- 172.21.15.6:0/1611064268 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8880beb20 con 0x7ff8980c8ad0 2023-07-21T22:19:40.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff89e974640 1 -- 172.21.15.6:0/1611064268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8880094d0 con 0x7ff8980c8ad0 2023-07-21T22:19:40.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff89e974640 1 -- 172.21.15.6:0/1611064268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff898165710 con 0x7ff8980c8ad0 2023-07-21T22:19:40.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff89e974640 1 -- 172.21.15.6:0/1611064268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8980ca1a0 con 0x7ff8980c8ad0 2023-07-21T22:19:40.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.907+0000 7ff894ff9640 1 -- 172.21.15.6:0/1611064268 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff8880b4600 con 0x7ff8980c8ad0 2023-07-21T22:19:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.911+0000 7ff894ff9640 1 --2- 172.21.15.6:0/1611064268 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff884066280 0x7ff884068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.911+0000 7ff894ff9640 1 -- 172.21.15.6:0/1611064268 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff88811e9f0 con 0x7ff8980c8ad0 2023-07-21T22:19:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.911+0000 7ff8977fe640 1 --2- 172.21.15.6:0/1611064268 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff884066280 0x7ff884068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.911+0000 7ff8977fe640 1 --2- 172.21.15.6:0/1611064268 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff884066280 0x7ff884068730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff88c007fd0 tx=0x7ff88c007c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:40.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:40.915+0000 7ff894ff9640 1 -- 172.21.15.6:0/1611064268 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8880ec240 con 0x7ff8980c8ad0 2023-07-21T22:19:41.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.123+0000 7ff89e974640 1 -- 172.21.15.6:0/1611064268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7ff8980678d0 con 0x7ff8980c8ad0 2023-07-21T22:19:41.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.127+0000 7ff894ff9640 1 -- 172.21.15.6:0/1611064268 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff8880ef860 con 0x7ff8980c8ad0 2023-07-21T22:19:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.127+0000 7ff89e974640 1 -- 172.21.15.6:0/1611064268 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff884066280 msgr2=0x7ff884068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:41.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.127+0000 7ff89e974640 1 --2- 172.21.15.6:0/1611064268 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff884066280 0x7ff884068730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff88c007fd0 tx=0x7ff88c007c20 comp rx=0 tx=0).stop 2023-07-21T22:19:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.127+0000 7ff89e974640 1 -- 172.21.15.6:0/1611064268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8980c8ad0 msgr2=0x7ff8980b3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.127+0000 7ff89e974640 1 --2- 172.21.15.6:0/1611064268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8980c8ad0 0x7ff8980b3b60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff8880ad040 tx=0x7ff88801ac30 comp rx=0 tx=0).stop 2023-07-21T22:19:41.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.127+0000 7ff89e974640 1 -- 172.21.15.6:0/1611064268 shutdown_connections 2023-07-21T22:19:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.127+0000 7ff89e974640 1 --2- 172.21.15.6:0/1611064268 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff898158ce0 0x7ff8981648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.127+0000 7ff89e974640 1 --2- 172.21.15.6:0/1611064268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8980c9730 0x7ff8980b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.127+0000 7ff89e974640 1 --2- 172.21.15.6:0/1611064268 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff884066280 0x7ff884068730 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.127+0000 7ff89e974640 1 --2- 172.21.15.6:0/1611064268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8980c8ad0 0x7ff8980b3b60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.127+0000 7ff89e974640 1 -- 172.21.15.6:0/1611064268 >> 172.21.15.6:0/1611064268 conn(0x7ff8980afcf0 msgr2=0x7ff8980ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:41.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.127+0000 7ff89e974640 1 -- 172.21.15.6:0/1611064268 shutdown_connections 2023-07-21T22:19:41.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.127+0000 7ff89e974640 1 -- 172.21.15.6:0/1611064268 wait complete. 2023-07-21T22:19:41.196 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-21T22:19:41.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.295+0000 7fadf8448640 1 Processor -- start 2023-07-21T22:19:41.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.295+0000 7fadf8448640 1 -- start start 2023-07-21T22:19:41.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.295+0000 7fadf8448640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadf0070b70 0x7fadf0070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:41.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.295+0000 7fadf8448640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf00cac70 con 0x7fadf00cb100 2023-07-21T22:19:41.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.295+0000 7fadf8448640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf0071480 con 0x7fadf006b1e0 2023-07-21T22:19:41.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.295+0000 7fadf8448640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00ca060 con 0x7fadf0070b70 2023-07-21T22:19:41.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.295+0000 7fadf69e5640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fadf00cb100 0x7fadf01642e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52222/0 (socket says 172.21.15.6:52222) 2023-07-21T22:19:41.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.295+0000 7fadf69e5640 1 -- 172.21.15.6:0/771133782 learned_addr learned my addr 172.21.15.6:0/771133782 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.295+0000 7fadf61e4640 1 --2- 172.21.15.6:0/771133782 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadf0070b70 0x7fadf0070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.295+0000 7fadf51e2640 1 -- 172.21.15.6:0/771133782 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 133909115 0 0) 0x7fadf00cac70 con 0x7fadf00cb100 2023-07-21T22:19:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.295+0000 7fadf51e2640 1 -- 172.21.15.6:0/771133782 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faddc003530 con 0x7fadf00cb100 2023-07-21T22:19:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.295+0000 7fadf51e2640 1 -- 172.21.15.6:0/771133782 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532496520 0 0) 0x7fadf0071480 con 0x7fadf006b1e0 2023-07-21T22:19:41.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.295+0000 7fadf51e2640 1 -- 172.21.15.6:0/771133782 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadf00cac70 con 0x7fadf006b1e0 2023-07-21T22:19:41.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.295+0000 7fadf51e2640 1 -- 172.21.15.6:0/771133782 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1776798324 0 0) 0x7faddc003530 con 0x7fadf00cb100 2023-07-21T22:19:41.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.295+0000 7fadf51e2640 1 -- 172.21.15.6:0/771133782 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadf0070b70 msgr2=0x7fadf0070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:41.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.295+0000 7fadf51e2640 1 --2- 172.21.15.6:0/771133782 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadf0070b70 0x7fadf0070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.295+0000 7fadf51e2640 1 -- 172.21.15.6:0/771133782 >> v1:172.21.15.161:6789/0 conn(0x7fadf006b1e0 legacy=0x7fadf00c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:41.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf51e2640 1 -- 172.21.15.6:0/771133782 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf00ca340 con 0x7fadf00cb100 2023-07-21T22:19:41.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf51e2640 1 -- 172.21.15.6:0/771133782 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fade8001a00 con 0x7fadf00cb100 2023-07-21T22:19:41.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf51e2640 1 -- 172.21.15.6:0/771133782 >> v1:172.21.15.6:6789/0 conn(0x7fadf00cb100 legacy=0x7fadf01642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:41.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf51e2640 1 --2- 172.21.15.6:0/771133782 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadf0070b70 0x7faddc003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:41.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf51e2640 1 --2- 172.21.15.6:0/771133782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faddc0040a0 0x7faddc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:41.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf51e2640 1 --2- 172.21.15.6:0/771133782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faddc004d10 0x7faddc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:41.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf51e2640 1 -- 172.21.15.6:0/771133782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00ca060 con 0x7faddc0040a0 2023-07-21T22:19:41.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf51e2640 1 -- 172.21.15.6:0/771133782 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc00bb20 con 0x7faddc004d10 2023-07-21T22:19:41.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf51e2640 1 -- 172.21.15.6:0/771133782 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faddc00bcb0 con 0x7fadf0070b70 2023-07-21T22:19:41.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf59e3640 1 --2- 172.21.15.6:0/771133782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faddc0040a0 0x7faddc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:41.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf61e4640 1 --2- 172.21.15.6:0/771133782 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadf0070b70 0x7faddc003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:41.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf69e5640 1 --2- 172.21.15.6:0/771133782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faddc004d10 0x7faddc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:41.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf59e3640 1 -- 172.21.15.6:0/771133782 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadf0070b70 msgr2=0x7faddc003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:41.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf59e3640 1 --2- 172.21.15.6:0/771133782 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadf0070b70 0x7faddc003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf59e3640 1 -- 172.21.15.6:0/771133782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faddc004d10 msgr2=0x7faddc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:41.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf59e3640 1 --2- 172.21.15.6:0/771133782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faddc004d10 0x7faddc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf59e3640 1 -- 172.21.15.6:0/771133782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc003530 con 0x7faddc0040a0 2023-07-21T22:19:41.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf69e5640 1 --2- 172.21.15.6:0/771133782 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faddc004d10 0x7faddc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf59e3640 1 --2- 172.21.15.6:0/771133782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faddc0040a0 0x7faddc0047d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fade00018d0 tx=0x7fade001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a321c740f0bc4eaa server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf51e2640 1 -- 172.21.15.6:0/771133782 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade00052d0 con 0x7faddc0040a0 2023-07-21T22:19:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf51e2640 1 -- 172.21.15.6:0/771133782 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade00a7050 con 0x7faddc0040a0 2023-07-21T22:19:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.299+0000 7fadf51e2640 1 -- 172.21.15.6:0/771133782 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0003600 con 0x7faddc0040a0 2023-07-21T22:19:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.303+0000 7fadf8448640 1 -- 172.21.15.6:0/771133782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faddc0040a0 msgr2=0x7faddc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:41.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.303+0000 7fadf8448640 1 --2- 172.21.15.6:0/771133782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faddc0040a0 0x7faddc0047d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fade00018d0 tx=0x7fade001c4f0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.303+0000 7fadf69e5640 1 -- 172.21.15.6:0/771133782 reap_dead start 2023-07-21T22:19:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.303+0000 7fadf8448640 1 -- 172.21.15.6:0/771133782 shutdown_connections 2023-07-21T22:19:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.303+0000 7fadf8448640 1 -- 172.21.15.6:0/771133782 >> 172.21.15.6:0/771133782 conn(0x7fadf00afcf0 msgr2=0x7fadf00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.303+0000 7fadf8448640 1 -- 172.21.15.6:0/771133782 shutdown_connections 2023-07-21T22:19:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.303+0000 7fadf8448640 1 -- 172.21.15.6:0/771133782 wait complete. 2023-07-21T22:19:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.303+0000 7fadf8448640 1 Processor -- start 2023-07-21T22:19:41.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.303+0000 7fadf8448640 1 -- start start 2023-07-21T22:19:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.303+0000 7fadf8448640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faddc0040a0 0x7fadf00c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.303+0000 7fadf8448640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fadf014fae0 0x7fadf014f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.303+0000 7fadf8448640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadf0150fd0 0x7fadf0151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:41.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.303+0000 7fadf8448640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00c3590 con 0x7faddc0040a0 2023-07-21T22:19:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.303+0000 7fadf8448640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00c8f90 con 0x7fadf014fae0 2023-07-21T22:19:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.303+0000 7fadf8448640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00c91e0 con 0x7fadf0150fd0 2023-07-21T22:19:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.303+0000 7fadf61e4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faddc0040a0 0x7fadf00c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.303+0000 7fadf61e4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faddc0040a0 0x7fadf00c3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39748/0 (socket says 172.21.15.6:39748) 2023-07-21T22:19:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.303+0000 7fadf61e4640 1 -- 172.21.15.6:0/2202368837 learned_addr learned my addr 172.21.15.6:0/2202368837 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.303+0000 7fadf69e5640 1 --2- 172.21.15.6:0/2202368837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadf0150fd0 0x7fadf0151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:41.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.303+0000 7fadf59e3640 1 --2- 172.21.15.6:0/2202368837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fadf014fae0 0x7fadf014f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:41.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.307+0000 7fadf61e4640 1 -- 172.21.15.6:0/2202368837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadf0150fd0 msgr2=0x7fadf0151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:41.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.307+0000 7fadf61e4640 1 --2- 172.21.15.6:0/2202368837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadf0150fd0 0x7fadf0151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.307+0000 7fadf61e4640 1 -- 172.21.15.6:0/2202368837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fadf014fae0 msgr2=0x7fadf014f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:41.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.307+0000 7fadf61e4640 1 --2- 172.21.15.6:0/2202368837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fadf014fae0 0x7fadf014f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.307+0000 7fadf61e4640 1 -- 172.21.15.6:0/2202368837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf00c94c0 con 0x7faddc0040a0 2023-07-21T22:19:41.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.307+0000 7fadf61e4640 1 --2- 172.21.15.6:0/2202368837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faddc0040a0 0x7fadf00c3c90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fadec0119d0 tx=0x7fadec011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:41.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.307+0000 7fade6ffd640 1 -- 172.21.15.6:0/2202368837 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec00fb50 con 0x7faddc0040a0 2023-07-21T22:19:41.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.307+0000 7fade6ffd640 1 -- 172.21.15.6:0/2202368837 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadec00fcb0 con 0x7faddc0040a0 2023-07-21T22:19:41.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.307+0000 7fadf8448640 1 -- 172.21.15.6:0/2202368837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf00c3770 con 0x7faddc0040a0 2023-07-21T22:19:41.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.307+0000 7fade6ffd640 1 -- 172.21.15.6:0/2202368837 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec014440 con 0x7faddc0040a0 2023-07-21T22:19:41.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.307+0000 7fadf8448640 1 -- 172.21.15.6:0/2202368837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf014f930 con 0x7faddc0040a0 2023-07-21T22:19:41.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.307+0000 7fadf8448640 1 -- 172.21.15.6:0/2202368837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf00c9700 con 0x7faddc0040a0 2023-07-21T22:19:41.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.307+0000 7fade6ffd640 1 -- 172.21.15.6:0/2202368837 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fadec0145a0 con 0x7faddc0040a0 2023-07-21T22:19:41.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.307+0000 7fade6ffd640 1 --2- 172.21.15.6:0/2202368837 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fadd40662b0 0x7fadd4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:41.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.307+0000 7fade6ffd640 1 -- 172.21.15.6:0/2202368837 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fadec0840e0 con 0x7faddc0040a0 2023-07-21T22:19:41.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.307+0000 7fadf59e3640 1 --2- 172.21.15.6:0/2202368837 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fadd40662b0 0x7fadd4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:41.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.311+0000 7fadf59e3640 1 --2- 172.21.15.6:0/2202368837 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fadd40662b0 0x7fadd4068760 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fade00ac000 tx=0x7fade00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:41.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.311+0000 7fade6ffd640 1 -- 172.21.15.6:0/2202368837 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fadf00c9700 con 0x7faddc0040a0 2023-07-21T22:19:41.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.519+0000 7fadf8448640 1 -- 172.21.15.6:0/2202368837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fadf00c9700 con 0x7faddc0040a0 2023-07-21T22:19:41.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.523+0000 7fade6ffd640 1 -- 172.21.15.6:0/2202368837 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fadf00c9700 con 0x7faddc0040a0 2023-07-21T22:19:41.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.523+0000 7fadf8448640 1 -- 172.21.15.6:0/2202368837 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fadd40662b0 msgr2=0x7fadd4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:41.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.523+0000 7fadf8448640 1 --2- 172.21.15.6:0/2202368837 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fadd40662b0 0x7fadd4068760 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fade00ac000 tx=0x7fade00a6000 comp rx=0 tx=0).stop 2023-07-21T22:19:41.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.523+0000 7fadf8448640 1 -- 172.21.15.6:0/2202368837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faddc0040a0 msgr2=0x7fadf00c3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:41.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.523+0000 7fadf8448640 1 --2- 172.21.15.6:0/2202368837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faddc0040a0 0x7fadf00c3c90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fadec0119d0 tx=0x7fadec011e90 comp rx=0 tx=0).stop 2023-07-21T22:19:41.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.523+0000 7fadf8448640 1 -- 172.21.15.6:0/2202368837 shutdown_connections 2023-07-21T22:19:41.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.523+0000 7fadf8448640 1 --2- 172.21.15.6:0/2202368837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fadf0150fd0 0x7fadf0151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.523+0000 7fadf8448640 1 --2- 172.21.15.6:0/2202368837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fadf014fae0 0x7fadf014f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.523+0000 7fadf8448640 1 --2- 172.21.15.6:0/2202368837 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fadd40662b0 0x7fadd4068760 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.523+0000 7fadf8448640 1 --2- 172.21.15.6:0/2202368837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faddc0040a0 0x7fadf00c3c90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.523+0000 7fadf8448640 1 -- 172.21.15.6:0/2202368837 >> 172.21.15.6:0/2202368837 conn(0x7fadf00afcf0 msgr2=0x7fadf0156930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:41.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.523+0000 7fadf8448640 1 -- 172.21.15.6:0/2202368837 shutdown_connections 2023-07-21T22:19:41.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.523+0000 7fadf8448640 1 -- 172.21.15.6:0/2202368837 wait complete. 2023-07-21T22:19:41.593 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:19:41.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.691+0000 7f9a1e79f640 1 Processor -- start 2023-07-21T22:19:41.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.691+0000 7f9a1e79f640 1 -- start start 2023-07-21T22:19:41.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.695+0000 7f9a1e79f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a180cdcd0 0x7f9a180cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:41.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.695+0000 7f9a1e79f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9a180ca750 0x7f9a180cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:41.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.695+0000 7f9a1e79f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a180cfaf0 con 0x7f9a1806a540 2023-07-21T22:19:41.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.695+0000 7f9a1e79f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a180cef10 con 0x7f9a180ca750 2023-07-21T22:19:41.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.695+0000 7f9a1e79f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a180cfdd0 con 0x7f9a180cdcd0 2023-07-21T22:19:41.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.695+0000 7f9a1cd3c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9a180ca750 0x7f9a180cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:41.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.695+0000 7f9a1cd3c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9a180ca750 0x7f9a180cabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39752/0 (socket says 172.21.15.6:39752) 2023-07-21T22:19:41.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.695+0000 7f9a1cd3c640 1 -- 172.21.15.6:0/3806959177 learned_addr learned my addr 172.21.15.6:0/3806959177 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:41.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.695+0000 7f9a177fe640 1 --2- 172.21.15.6:0/3806959177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a180cdcd0 0x7f9a180cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:41.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.695+0000 7f9a1cd3c640 1 -- 172.21.15.6:0/3806959177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a180cdcd0 msgr2=0x7f9a180cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:41.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.695+0000 7f9a1cd3c640 1 --2- 172.21.15.6:0/3806959177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a180cdcd0 0x7f9a180cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.695+0000 7f9a1cd3c640 1 -- 172.21.15.6:0/3806959177 >> v1:172.21.15.161:6789/0 conn(0x7f9a1806a540 legacy=0x7f9a1806a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:41.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.695+0000 7f9a1cd3c640 1 -- 172.21.15.6:0/3806959177 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a180d00b0 con 0x7f9a180ca750 2023-07-21T22:19:41.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.699+0000 7f9a1cd3c640 1 --2- 172.21.15.6:0/3806959177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a180ca750 0x7f9a180cabd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9a10009e50 tx=0x7f9a1001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e83428a1cfe8ce6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:41.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.699+0000 7f9a16ffd640 1 -- 172.21.15.6:0/3806959177 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a100a58a0 con 0x7f9a180ca750 2023-07-21T22:19:41.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.699+0000 7f9a16ffd640 1 -- 172.21.15.6:0/3806959177 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a100a5a00 con 0x7f9a180ca750 2023-07-21T22:19:41.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.699+0000 7f9a16ffd640 1 -- 172.21.15.6:0/3806959177 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a100a5d90 con 0x7f9a180ca750 2023-07-21T22:19:41.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.699+0000 7f9a1e79f640 1 -- 172.21.15.6:0/3806959177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a180ca750 msgr2=0x7f9a180cabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:41.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.699+0000 7f9a1e79f640 1 --2- 172.21.15.6:0/3806959177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a180ca750 0x7f9a180cabd0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9a10009e50 tx=0x7f9a1001c9e0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.699+0000 7f9a1e79f640 1 -- 172.21.15.6:0/3806959177 shutdown_connections 2023-07-21T22:19:41.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.699+0000 7f9a1e79f640 1 --2- 172.21.15.6:0/3806959177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a180ca750 0x7f9a180cabd0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.699+0000 7f9a1e79f640 1 --2- 172.21.15.6:0/3806959177 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a180cdcd0 0x7f9a180cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.699+0000 7f9a1e79f640 1 -- 172.21.15.6:0/3806959177 >> 172.21.15.6:0/3806959177 conn(0x7f9a18099490 msgr2=0x7f9a18089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:41.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.699+0000 7f9a1e79f640 1 -- 172.21.15.6:0/3806959177 shutdown_connections 2023-07-21T22:19:41.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.699+0000 7f9a1e79f640 1 -- 172.21.15.6:0/3806959177 wait complete. 2023-07-21T22:19:41.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.699+0000 7f9a1e79f640 1 Processor -- start 2023-07-21T22:19:41.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.699+0000 7f9a1e79f640 1 -- start start 2023-07-21T22:19:41.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a1e79f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a1806a540 0x7f9a181593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:41.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a1e79f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a180ca750 0x7f9a180c6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:41.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a1e79f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a180cdcd0 0x7f9a18154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:41.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a1e79f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a180ad750 con 0x7f9a180cdcd0 2023-07-21T22:19:41.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a1e79f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a180ada30 con 0x7f9a180ca750 2023-07-21T22:19:41.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a1e79f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a180add10 con 0x7f9a1806a540 2023-07-21T22:19:41.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a1cd3c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a180cdcd0 0x7f9a18154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:41.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a1cd3c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a180cdcd0 0x7f9a18154c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39760/0 (socket says 172.21.15.6:39760) 2023-07-21T22:19:41.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a1cd3c640 1 -- 172.21.15.6:0/3168785967 learned_addr learned my addr 172.21.15.6:0/3168785967 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:41.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a177fe640 1 --2- 172.21.15.6:0/3168785967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a180ca750 0x7f9a180c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:41.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a17fff640 1 --2- 172.21.15.6:0/3168785967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a1806a540 0x7f9a181593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:41.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a1cd3c640 1 -- 172.21.15.6:0/3168785967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a1806a540 msgr2=0x7f9a181593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:41.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a1cd3c640 1 --2- 172.21.15.6:0/3168785967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a1806a540 0x7f9a181593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a1cd3c640 1 -- 172.21.15.6:0/3168785967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a180ca750 msgr2=0x7f9a180c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:41.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a1cd3c640 1 --2- 172.21.15.6:0/3168785967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a180ca750 0x7f9a180c6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a1cd3c640 1 -- 172.21.15.6:0/3168785967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a10009b30 con 0x7f9a180cdcd0 2023-07-21T22:19:41.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a1cd3c640 1 --2- 172.21.15.6:0/3168785967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a180cdcd0 0x7f9a18154c50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9a1001a610 tx=0x7f9a10019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:41.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a14ff9640 1 -- 172.21.15.6:0/3168785967 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a100b8670 con 0x7f9a180cdcd0 2023-07-21T22:19:41.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a14ff9640 1 -- 172.21.15.6:0/3168785967 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a100b87f0 con 0x7f9a180cdcd0 2023-07-21T22:19:41.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a1e79f640 1 -- 172.21.15.6:0/3168785967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a180adff0 con 0x7f9a180cdcd0 2023-07-21T22:19:41.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a14ff9640 1 -- 172.21.15.6:0/3168785967 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a100b8ba0 con 0x7f9a180cdcd0 2023-07-21T22:19:41.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a1e79f640 1 -- 172.21.15.6:0/3168785967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a180ae7f0 con 0x7f9a180cdcd0 2023-07-21T22:19:41.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a1e79f640 1 -- 172.21.15.6:0/3168785967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a180678d0 con 0x7f9a180cdcd0 2023-07-21T22:19:41.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.703+0000 7f9a14ff9640 1 -- 172.21.15.6:0/3168785967 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9a100b8d00 con 0x7f9a180cdcd0 2023-07-21T22:19:41.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.707+0000 7f9a14ff9640 1 --2- 172.21.15.6:0/3168785967 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a04066280 0x7f9a04068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:41.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.707+0000 7f9a14ff9640 1 -- 172.21.15.6:0/3168785967 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9a1011f170 con 0x7f9a180cdcd0 2023-07-21T22:19:41.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.707+0000 7f9a17fff640 1 --2- 172.21.15.6:0/3168785967 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a04066280 0x7f9a04068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:41.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.707+0000 7f9a17fff640 1 --2- 172.21.15.6:0/3168785967 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a04066280 0x7f9a04068730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9a08000fc0 tx=0x7f9a08009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:41.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.711+0000 7f9a14ff9640 1 -- 172.21.15.6:0/3168785967 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a100ecbd0 con 0x7f9a180cdcd0 2023-07-21T22:19:41.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.867+0000 7f9a1e79f640 1 -- 172.21.15.6:0/3168785967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a180ae4a0 con 0x7f9a180cdcd0 2023-07-21T22:19:41.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.867+0000 7f9a14ff9640 1 -- 172.21.15.6:0/3168785967 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+14567 (secure 0 0 0) 0x7f9a100f01f0 con 0x7f9a180cdcd0 2023-07-21T22:19:41.917 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:41.917 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":35,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:19:38.721567+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:19:41.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.871+0000 7f9a1e79f640 1 -- 172.21.15.6:0/3168785967 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a04066280 msgr2=0x7f9a04068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:41.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.871+0000 7f9a1e79f640 1 --2- 172.21.15.6:0/3168785967 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a04066280 0x7f9a04068730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9a08000fc0 tx=0x7f9a08009040 comp rx=0 tx=0).stop 2023-07-21T22:19:41.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.871+0000 7f9a1e79f640 1 -- 172.21.15.6:0/3168785967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a180cdcd0 msgr2=0x7f9a18154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:41.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.871+0000 7f9a1e79f640 1 --2- 172.21.15.6:0/3168785967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a180cdcd0 0x7f9a18154c50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9a1001a610 tx=0x7f9a10019780 comp rx=0 tx=0).stop 2023-07-21T22:19:41.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.871+0000 7f9a1e79f640 1 -- 172.21.15.6:0/3168785967 shutdown_connections 2023-07-21T22:19:41.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.871+0000 7f9a1e79f640 1 --2- 172.21.15.6:0/3168785967 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9a04066280 0x7f9a04068730 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.871+0000 7f9a1e79f640 1 --2- 172.21.15.6:0/3168785967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a180cdcd0 0x7f9a18154c50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.871+0000 7f9a1e79f640 1 --2- 172.21.15.6:0/3168785967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a180ca750 0x7f9a180c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.871+0000 7f9a1e79f640 1 --2- 172.21.15.6:0/3168785967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a1806a540 0x7f9a181593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:41.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.871+0000 7f9a1e79f640 1 -- 172.21.15.6:0/3168785967 >> 172.21.15.6:0/3168785967 conn(0x7f9a18099490 msgr2=0x7f9a180cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.871+0000 7f9a1e79f640 1 -- 172.21.15.6:0/3168785967 shutdown_connections 2023-07-21T22:19:41.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:41.871+0000 7f9a1e79f640 1 -- 172.21.15.6:0/3168785967 wait complete. 2023-07-21T22:19:41.938 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:19:41.940 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:19:42.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.039+0000 7f88f4740640 1 Processor -- start 2023-07-21T22:19:42.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.039+0000 7f88f4740640 1 -- start start 2023-07-21T22:19:42.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.039+0000 7f88f4740640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f88ec0cf2e0 0x7f88ec0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:42.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.039+0000 7f88f4740640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88ec0ca790 0x7f88ec0cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:42.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.039+0000 7f88f4740640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ec0d0920 con 0x7f88ec06a540 2023-07-21T22:19:42.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.039+0000 7f88f4740640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ec15bfd0 con 0x7f88ec0cf2e0 2023-07-21T22:19:42.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.039+0000 7f88f4740640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec0cfd10 con 0x7f88ec0ca790 2023-07-21T22:19:42.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.039+0000 7f88f1cdb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f88ec0cf2e0 0x7f88ec0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:42.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.039+0000 7f88f24dc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f88ec06a540 0x7f88ec06a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52230/0 (socket says 172.21.15.6:52230) 2023-07-21T22:19:42.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.039+0000 7f88f1cdb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f88ec0cf2e0 0x7f88ec0cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39762/0 (socket says 172.21.15.6:39762) 2023-07-21T22:19:42.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.039+0000 7f88f24dc640 1 -- 172.21.15.6:0/3876222489 learned_addr learned my addr 172.21.15.6:0/3876222489 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:42.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.039+0000 7f88f2cdd640 1 --2- 172.21.15.6:0/3876222489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88ec0ca790 0x7f88ec0cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:42.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.039+0000 7f88f1cdb640 1 -- 172.21.15.6:0/3876222489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88ec0ca790 msgr2=0x7f88ec0cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:42.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.039+0000 7f88f1cdb640 1 --2- 172.21.15.6:0/3876222489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88ec0ca790 0x7f88ec0cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.039+0000 7f88f1cdb640 1 -- 172.21.15.6:0/3876222489 >> v1:172.21.15.6:6789/0 conn(0x7f88ec06a540 legacy=0x7f88ec06a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:42.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.043+0000 7f88f1cdb640 1 -- 172.21.15.6:0/3876222489 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec0cfff0 con 0x7f88ec0cf2e0 2023-07-21T22:19:42.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.043+0000 7f88f14da640 1 -- 172.21.15.6:0/3876222489 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263689231 0 0) 0x7f88ec0d0920 con 0x7f88ec06a540 2023-07-21T22:19:42.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.043+0000 7f88f1cdb640 1 --2- 172.21.15.6:0/3876222489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88ec0cf2e0 0x7f88ec0cf710 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0097c0 tx=0x7f88dc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc53b5ffc65870f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:42.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.043+0000 7f88f14da640 1 -- 172.21.15.6:0/3876222489 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0ab650 con 0x7f88ec0cf2e0 2023-07-21T22:19:42.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.043+0000 7f88f14da640 1 -- 172.21.15.6:0/3876222489 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc0ab7b0 con 0x7f88ec0cf2e0 2023-07-21T22:19:42.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.043+0000 7f88f14da640 1 -- 172.21.15.6:0/3876222489 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc0abb40 con 0x7f88ec0cf2e0 2023-07-21T22:19:42.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.043+0000 7f88f4740640 1 -- 172.21.15.6:0/3876222489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88ec0cf2e0 msgr2=0x7f88ec0cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:42.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.043+0000 7f88f4740640 1 --2- 172.21.15.6:0/3876222489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88ec0cf2e0 0x7f88ec0cf710 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0097c0 tx=0x7f88dc01c450 comp rx=0 tx=0).stop 2023-07-21T22:19:42.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.043+0000 7f88f4740640 1 -- 172.21.15.6:0/3876222489 shutdown_connections 2023-07-21T22:19:42.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.043+0000 7f88f4740640 1 --2- 172.21.15.6:0/3876222489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88ec0ca790 0x7f88ec0cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.043+0000 7f88f4740640 1 --2- 172.21.15.6:0/3876222489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88ec0cf2e0 0x7f88ec0cf710 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.043+0000 7f88f4740640 1 -- 172.21.15.6:0/3876222489 >> 172.21.15.6:0/3876222489 conn(0x7f88ec099490 msgr2=0x7f88ec089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:42.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.043+0000 7f88f4740640 1 -- 172.21.15.6:0/3876222489 shutdown_connections 2023-07-21T22:19:42.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.043+0000 7f88f4740640 1 -- 172.21.15.6:0/3876222489 wait complete. 2023-07-21T22:19:42.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f4740640 1 Processor -- start 2023-07-21T22:19:42.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f4740640 1 -- start start 2023-07-21T22:19:42.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f4740640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88ec06a540 0x7f88ec14cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:42.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f4740640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88ec0ca790 0x7f88ec1539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:42.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f4740640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88ec0cf2e0 0x7f88ec153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:42.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f4740640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec155340 con 0x7f88ec0cf2e0 2023-07-21T22:19:42.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f4740640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec154730 con 0x7f88ec0ca790 2023-07-21T22:19:42.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f4740640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec154a10 con 0x7f88ec06a540 2023-07-21T22:19:42.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f2cdd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88ec0cf2e0 0x7f88ec153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:42.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f2cdd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88ec0cf2e0 0x7f88ec153f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39766/0 (socket says 172.21.15.6:39766) 2023-07-21T22:19:42.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f2cdd640 1 -- 172.21.15.6:0/2982468453 learned_addr learned my addr 172.21.15.6:0/2982468453 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:42.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f24dc640 1 --2- 172.21.15.6:0/2982468453 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88ec06a540 0x7f88ec14cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:42.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f2cdd640 1 -- 172.21.15.6:0/2982468453 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88ec06a540 msgr2=0x7f88ec14cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:42.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f2cdd640 1 --2- 172.21.15.6:0/2982468453 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88ec06a540 0x7f88ec14cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f2cdd640 1 -- 172.21.15.6:0/2982468453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88ec0ca790 msgr2=0x7f88ec1539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:42.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f2cdd640 1 --2- 172.21.15.6:0/2982468453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88ec0ca790 0x7f88ec1539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f2cdd640 1 -- 172.21.15.6:0/2982468453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc009420 con 0x7f88ec0cf2e0 2023-07-21T22:19:42.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f24dc640 1 --2- 172.21.15.6:0/2982468453 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88ec06a540 0x7f88ec14cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:42.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f2cdd640 1 --2- 172.21.15.6:0/2982468453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88ec0cf2e0 0x7f88ec153f00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f88e400efc0 tx=0x7f88e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:42.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88e2ffd640 1 -- 172.21.15.6:0/2982468453 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4014480 con 0x7f88ec0cf2e0 2023-07-21T22:19:42.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88e2ffd640 1 -- 172.21.15.6:0/2982468453 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e400f040 con 0x7f88ec0cf2e0 2023-07-21T22:19:42.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f4740640 1 -- 172.21.15.6:0/2982468453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ec154cf0 con 0x7f88ec0cf2e0 2023-07-21T22:19:42.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88e2ffd640 1 -- 172.21.15.6:0/2982468453 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e4014820 con 0x7f88ec0cf2e0 2023-07-21T22:19:42.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.047+0000 7f88f4740640 1 -- 172.21.15.6:0/2982468453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ec154440 con 0x7f88ec0cf2e0 2023-07-21T22:19:42.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.051+0000 7f88f4740640 1 -- 172.21.15.6:0/2982468453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ec1554b0 con 0x7f88ec0cf2e0 2023-07-21T22:19:42.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.051+0000 7f88e2ffd640 1 -- 172.21.15.6:0/2982468453 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88e4014980 con 0x7f88ec0cf2e0 2023-07-21T22:19:42.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.051+0000 7f88e2ffd640 1 --2- 172.21.15.6:0/2982468453 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f88d0066280 0x7f88d0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:42.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.051+0000 7f88e2ffd640 1 -- 172.21.15.6:0/2982468453 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f88e40845c0 con 0x7f88ec0cf2e0 2023-07-21T22:19:42.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.051+0000 7f88f24dc640 1 --2- 172.21.15.6:0/2982468453 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f88d0066280 0x7f88d0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:42.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.051+0000 7f88f24dc640 1 --2- 172.21.15.6:0/2982468453 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f88d0066280 0x7f88d0068730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f88e8000f70 tx=0x7f88e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:42.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.055+0000 7f88e2ffd640 1 -- 172.21.15.6:0/2982468453 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f88e4051d90 con 0x7f88ec0cf2e0 2023-07-21T22:19:42.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.207+0000 7f88f4740640 1 -- 172.21.15.6:0/2982468453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f88ec0678d0 con 0x7f88ec0cf2e0 2023-07-21T22:19:42.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.211+0000 7f88e2ffd640 1 -- 172.21.15.6:0/2982468453 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f88e40553b0 con 0x7f88ec0cf2e0 2023-07-21T22:19:42.258 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:19:42.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.211+0000 7f88f4740640 1 -- 172.21.15.6:0/2982468453 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f88d0066280 msgr2=0x7f88d0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:42.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.211+0000 7f88f4740640 1 --2- 172.21.15.6:0/2982468453 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f88d0066280 0x7f88d0068730 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f88e8000f70 tx=0x7f88e8009040 comp rx=0 tx=0).stop 2023-07-21T22:19:42.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.211+0000 7f88f4740640 1 -- 172.21.15.6:0/2982468453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88ec0cf2e0 msgr2=0x7f88ec153f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:42.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.211+0000 7f88f4740640 1 --2- 172.21.15.6:0/2982468453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88ec0cf2e0 0x7f88ec153f00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f88e400efc0 tx=0x7f88e400c490 comp rx=0 tx=0).stop 2023-07-21T22:19:42.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.211+0000 7f88f4740640 1 -- 172.21.15.6:0/2982468453 shutdown_connections 2023-07-21T22:19:42.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.211+0000 7f88f4740640 1 --2- 172.21.15.6:0/2982468453 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f88d0066280 0x7f88d0068730 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.211+0000 7f88f4740640 1 --2- 172.21.15.6:0/2982468453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88ec0cf2e0 0x7f88ec153f00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.211+0000 7f88f4740640 1 --2- 172.21.15.6:0/2982468453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88ec0ca790 0x7f88ec1539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.211+0000 7f88f4740640 1 --2- 172.21.15.6:0/2982468453 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88ec06a540 0x7f88ec14cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.211+0000 7f88f4740640 1 -- 172.21.15.6:0/2982468453 >> 172.21.15.6:0/2982468453 conn(0x7f88ec099490 msgr2=0x7f88ec0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.211+0000 7f88f4740640 1 -- 172.21.15.6:0/2982468453 shutdown_connections 2023-07-21T22:19:42.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.211+0000 7f88f4740640 1 -- 172.21.15.6:0/2982468453 wait complete. 2023-07-21T22:19:42.278 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:19:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.379+0000 7fd59d911640 1 Processor -- start 2023-07-21T22:19:42.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.379+0000 7fd59d911640 1 -- start start 2023-07-21T22:19:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.379+0000 7fd59d911640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5981590a0 0x7fd5980c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:42.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.379+0000 7fd59d911640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5980c37e0 con 0x7fd5980cba60 2023-07-21T22:19:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.379+0000 7fd59d911640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5980c3ac0 con 0x7fd59815b9c0 2023-07-21T22:19:42.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.379+0000 7fd59d911640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5980c3da0 con 0x7fd5981590a0 2023-07-21T22:19:42.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.379+0000 7fd596ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd5980cba60 0x7fd5980cbe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52246/0 (socket says 172.21.15.6:52246) 2023-07-21T22:19:42.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.379+0000 7fd596ffd640 1 -- 172.21.15.6:0/2629574127 learned_addr learned my addr 172.21.15.6:0/2629574127 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:42.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.379+0000 7fd58ffff640 1 --2- 172.21.15.6:0/2629574127 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5981590a0 0x7fd5980c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:42.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.379+0000 7fd5967fc640 1 -- 172.21.15.6:0/2629574127 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337373228 0 0) 0x7fd5980c37e0 con 0x7fd5980cba60 2023-07-21T22:19:42.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.379+0000 7fd5967fc640 1 -- 172.21.15.6:0/2629574127 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd584003530 con 0x7fd5980cba60 2023-07-21T22:19:42.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.379+0000 7fd5967fc640 1 -- 172.21.15.6:0/2629574127 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117145992 0 0) 0x7fd5980c3ac0 con 0x7fd59815b9c0 2023-07-21T22:19:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.379+0000 7fd5967fc640 1 -- 172.21.15.6:0/2629574127 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5980c37e0 con 0x7fd59815b9c0 2023-07-21T22:19:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.379+0000 7fd5967fc640 1 -- 172.21.15.6:0/2629574127 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 678053767 0 0) 0x7fd584003530 con 0x7fd5980cba60 2023-07-21T22:19:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.379+0000 7fd58ffff640 1 -- 172.21.15.6:0/2629574127 >> v1:172.21.15.161:6789/0 conn(0x7fd59815b9c0 legacy=0x7fd598159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:42.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.379+0000 7fd58ffff640 1 -- 172.21.15.6:0/2629574127 >> v1:172.21.15.6:6789/0 conn(0x7fd5980cba60 legacy=0x7fd5980cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:42.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.379+0000 7fd58ffff640 1 -- 172.21.15.6:0/2629574127 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5980c4080 con 0x7fd5981590a0 2023-07-21T22:19:42.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.383+0000 7fd58ffff640 1 --2- 172.21.15.6:0/2629574127 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5981590a0 0x7fd5980c3150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd5800097f0 tx=0x7fd58001c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad06873fdb1b972c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:42.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.383+0000 7fd5967fc640 1 -- 172.21.15.6:0/2629574127 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588001680 con 0x7fd5981590a0 2023-07-21T22:19:42.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.383+0000 7fd5967fc640 1 -- 172.21.15.6:0/2629574127 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5800a7050 con 0x7fd5981590a0 2023-07-21T22:19:42.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.383+0000 7fd5967fc640 1 -- 172.21.15.6:0/2629574127 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5800ab620 con 0x7fd5981590a0 2023-07-21T22:19:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.383+0000 7fd59d911640 1 -- 172.21.15.6:0/2629574127 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5981590a0 msgr2=0x7fd5980c3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.383+0000 7fd59d911640 1 --2- 172.21.15.6:0/2629574127 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5981590a0 0x7fd5980c3150 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd5800097f0 tx=0x7fd58001c310 comp rx=0 tx=0).stop 2023-07-21T22:19:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.383+0000 7fd59d911640 1 -- 172.21.15.6:0/2629574127 shutdown_connections 2023-07-21T22:19:42.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.383+0000 7fd59d911640 1 --2- 172.21.15.6:0/2629574127 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5981590a0 0x7fd5980c3150 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.383+0000 7fd59d911640 1 -- 172.21.15.6:0/2629574127 >> 172.21.15.6:0/2629574127 conn(0x7fd5980cde90 msgr2=0x7fd5980ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:42.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.383+0000 7fd59d911640 1 -- 172.21.15.6:0/2629574127 shutdown_connections 2023-07-21T22:19:42.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.383+0000 7fd59d911640 1 -- 172.21.15.6:0/2629574127 wait complete. 2023-07-21T22:19:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd59d911640 1 Processor -- start 2023-07-21T22:19:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd59d911640 1 -- start start 2023-07-21T22:19:42.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd59d911640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5980cba60 0x7fd5980c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd59d911640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5981590a0 0x7fd598148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd59d911640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd59815b9c0 0x7fd59806f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd59d911640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5980c5000 con 0x7fd5981590a0 2023-07-21T22:19:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd59d911640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5980c70f0 con 0x7fd59815b9c0 2023-07-21T22:19:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd59d911640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5980c7390 con 0x7fd5980cba60 2023-07-21T22:19:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd58ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5981590a0 0x7fd598148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:42.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd58ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5981590a0 0x7fd598148c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39770/0 (socket says 172.21.15.6:39770) 2023-07-21T22:19:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd58ffff640 1 -- 172.21.15.6:0/382941370 learned_addr learned my addr 172.21.15.6:0/382941370 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd5977fe640 1 --2- 172.21.15.6:0/382941370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd59815b9c0 0x7fd59806f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:42.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd596ffd640 1 --2- 172.21.15.6:0/382941370 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5980cba60 0x7fd5980c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:42.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd58ffff640 1 -- 172.21.15.6:0/382941370 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5980cba60 msgr2=0x7fd5980c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd58ffff640 1 --2- 172.21.15.6:0/382941370 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5980cba60 0x7fd5980c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd58ffff640 1 -- 172.21.15.6:0/382941370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd59815b9c0 msgr2=0x7fd59806f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd58ffff640 1 --2- 172.21.15.6:0/382941370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd59815b9c0 0x7fd59806f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd58ffff640 1 -- 172.21.15.6:0/382941370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd580009420 con 0x7fd5981590a0 2023-07-21T22:19:42.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd596ffd640 1 --2- 172.21.15.6:0/382941370 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5980cba60 0x7fd5980c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd58ffff640 1 --2- 172.21.15.6:0/382941370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5981590a0 0x7fd598148c90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd5800ae040 tx=0x7fd58001ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd594ff9640 1 -- 172.21.15.6:0/382941370 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580004020 con 0x7fd5981590a0 2023-07-21T22:19:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd594ff9640 1 -- 172.21.15.6:0/382941370 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5800041a0 con 0x7fd5981590a0 2023-07-21T22:19:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd594ff9640 1 -- 172.21.15.6:0/382941370 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580003620 con 0x7fd5981590a0 2023-07-21T22:19:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd59d911640 1 -- 172.21.15.6:0/382941370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5980c52a0 con 0x7fd5981590a0 2023-07-21T22:19:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd59d911640 1 -- 172.21.15.6:0/382941370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5980c7670 con 0x7fd5981590a0 2023-07-21T22:19:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.387+0000 7fd59d911640 1 -- 172.21.15.6:0/382941370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5980714b0 con 0x7fd5981590a0 2023-07-21T22:19:42.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.391+0000 7fd594ff9640 1 -- 172.21.15.6:0/382941370 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd580003780 con 0x7fd5981590a0 2023-07-21T22:19:42.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.391+0000 7fd594ff9640 1 --2- 172.21.15.6:0/382941370 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd5780662b0 0x7fd578068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:42.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.391+0000 7fd594ff9640 1 -- 172.21.15.6:0/382941370 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd58011ddc0 con 0x7fd5981590a0 2023-07-21T22:19:42.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.391+0000 7fd596ffd640 1 --2- 172.21.15.6:0/382941370 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd5780662b0 0x7fd578068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:42.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.391+0000 7fd596ffd640 1 --2- 172.21.15.6:0/382941370 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd5780662b0 0x7fd578068760 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd588000fc0 tx=0x7fd588009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:42.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.395+0000 7fd594ff9640 1 -- 172.21.15.6:0/382941370 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd5800eb4f0 con 0x7fd5981590a0 2023-07-21T22:19:42.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.551+0000 7fd59d911640 1 -- 172.21.15.6:0/382941370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd5980678d0 con 0x7fd5981590a0 2023-07-21T22:19:42.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.551+0000 7fd594ff9640 1 -- 172.21.15.6:0/382941370 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v35) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd5800bb0a0 con 0x7fd5981590a0 2023-07-21T22:19:42.601 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:19:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.555+0000 7fd59d911640 1 -- 172.21.15.6:0/382941370 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd5780662b0 msgr2=0x7fd578068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.555+0000 7fd59d911640 1 --2- 172.21.15.6:0/382941370 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd5780662b0 0x7fd578068760 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd588000fc0 tx=0x7fd588009040 comp rx=0 tx=0).stop 2023-07-21T22:19:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.555+0000 7fd59d911640 1 -- 172.21.15.6:0/382941370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5981590a0 msgr2=0x7fd598148c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:42.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.555+0000 7fd59d911640 1 --2- 172.21.15.6:0/382941370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5981590a0 0x7fd598148c90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd5800ae040 tx=0x7fd58001ab50 comp rx=0 tx=0).stop 2023-07-21T22:19:42.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.555+0000 7fd59d911640 1 -- 172.21.15.6:0/382941370 shutdown_connections 2023-07-21T22:19:42.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.555+0000 7fd59d911640 1 --2- 172.21.15.6:0/382941370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd59815b9c0 0x7fd59806f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.555+0000 7fd59d911640 1 --2- 172.21.15.6:0/382941370 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd5780662b0 0x7fd578068760 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.555+0000 7fd59d911640 1 --2- 172.21.15.6:0/382941370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5981590a0 0x7fd598148c90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.555+0000 7fd59d911640 1 --2- 172.21.15.6:0/382941370 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5980cba60 0x7fd5980c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.555+0000 7fd59d911640 1 -- 172.21.15.6:0/382941370 >> 172.21.15.6:0/382941370 conn(0x7fd5980cde90 msgr2=0x7fd598159930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:42.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.555+0000 7fd59d911640 1 -- 172.21.15.6:0/382941370 shutdown_connections 2023-07-21T22:19:42.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.555+0000 7fd59d911640 1 -- 172.21.15.6:0/382941370 wait complete. 2023-07-21T22:19:42.621 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T22:19:42.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.719+0000 7efdfa00b640 1 Processor -- start 2023-07-21T22:19:42.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.719+0000 7efdfa00b640 1 -- start start 2023-07-21T22:19:42.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.719+0000 7efdfa00b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efdf415bdf0 0x7efdf40ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:42.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.719+0000 7efdfa00b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efdf415f970 0x7efdf415fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:42.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.719+0000 7efdfa00b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdf406b1e0 0x7efdf406b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:42.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.719+0000 7efdfa00b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf4160330 con 0x7efdf415bdf0 2023-07-21T22:19:42.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.719+0000 7efdfa00b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf40cb2e0 con 0x7efdf415f970 2023-07-21T22:19:42.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.719+0000 7efdfa00b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf40cb5c0 con 0x7efdf406b1e0 2023-07-21T22:19:42.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.719+0000 7efdf37fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efdf415bdf0 0x7efdf40ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:42.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.719+0000 7efdf37fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efdf415bdf0 0x7efdf40ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39776/0 (socket says 172.21.15.6:39776) 2023-07-21T22:19:42.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.719+0000 7efdf37fe640 1 -- 172.21.15.6:0/2302757761 learned_addr learned my addr 172.21.15.6:0/2302757761 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:42.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.719+0000 7efdf2ffd640 1 --2- 172.21.15.6:0/2302757761 >> v2:172.21.15.161:3300/0 conn(0x7efdf415f970 0x7efdf415fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:42.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.719+0000 7efdf3fff640 1 --2- 172.21.15.6:0/2302757761 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdf406b1e0 0x7efdf406b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:42.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.719+0000 7efdf37fe640 1 -- 172.21.15.6:0/2302757761 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdf406b1e0 msgr2=0x7efdf406b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:42.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.719+0000 7efdf37fe640 1 --2- 172.21.15.6:0/2302757761 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdf406b1e0 0x7efdf406b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.719+0000 7efdf37fe640 1 -- 172.21.15.6:0/2302757761 >> v2:172.21.15.161:3300/0 conn(0x7efdf415f970 msgr2=0x7efdf415fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:42.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.719+0000 7efdf37fe640 1 --2- 172.21.15.6:0/2302757761 >> v2:172.21.15.161:3300/0 conn(0x7efdf415f970 0x7efdf415fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.719+0000 7efdf37fe640 1 -- 172.21.15.6:0/2302757761 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf40cb8a0 con 0x7efdf415bdf0 2023-07-21T22:19:42.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.723+0000 7efdf37fe640 1 --2- 172.21.15.6:0/2302757761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf415bdf0 0x7efdf40ca970 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efdf40adc10 tx=0x7efde401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f09a58988942c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:42.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.723+0000 7efdf27fc640 1 -- 172.21.15.6:0/2302757761 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde40ab620 con 0x7efdf415bdf0 2023-07-21T22:19:42.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.723+0000 7efdf27fc640 1 -- 172.21.15.6:0/2302757761 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde40ab780 con 0x7efdf415bdf0 2023-07-21T22:19:42.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.723+0000 7efdf27fc640 1 -- 172.21.15.6:0/2302757761 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde40abb10 con 0x7efdf415bdf0 2023-07-21T22:19:42.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.723+0000 7efdfa00b640 1 -- 172.21.15.6:0/2302757761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf415bdf0 msgr2=0x7efdf40ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:42.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.723+0000 7efdfa00b640 1 --2- 172.21.15.6:0/2302757761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf415bdf0 0x7efdf40ca970 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7efdf40adc10 tx=0x7efde401c440 comp rx=0 tx=0).stop 2023-07-21T22:19:42.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.723+0000 7efdfa00b640 1 -- 172.21.15.6:0/2302757761 shutdown_connections 2023-07-21T22:19:42.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.723+0000 7efdfa00b640 1 --2- 172.21.15.6:0/2302757761 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdf406b1e0 0x7efdf406b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.723+0000 7efdfa00b640 1 --2- 172.21.15.6:0/2302757761 >> v2:172.21.15.161:3300/0 conn(0x7efdf415f970 0x7efdf415fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.723+0000 7efdfa00b640 1 --2- 172.21.15.6:0/2302757761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf415bdf0 0x7efdf40ca970 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.723+0000 7efdfa00b640 1 -- 172.21.15.6:0/2302757761 >> 172.21.15.6:0/2302757761 conn(0x7efdf40afcf0 msgr2=0x7efdf40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:42.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.723+0000 7efdfa00b640 1 -- 172.21.15.6:0/2302757761 shutdown_connections 2023-07-21T22:19:42.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.723+0000 7efdfa00b640 1 -- 172.21.15.6:0/2302757761 wait complete. 2023-07-21T22:19:42.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdfa00b640 1 Processor -- start 2023-07-21T22:19:42.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdfa00b640 1 -- start start 2023-07-21T22:19:42.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdfa00b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdf406b1e0 0x7efdf41535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:42.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdfa00b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf415bdf0 0x7efdf4153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:42.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdfa00b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdf415f970 0x7efdf41544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:42.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdfa00b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf41582a0 con 0x7efdf415bdf0 2023-07-21T22:19:42.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdfa00b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf4157690 con 0x7efdf406b1e0 2023-07-21T22:19:42.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdfa00b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf4157970 con 0x7efdf415f970 2023-07-21T22:19:42.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdf2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf415bdf0 0x7efdf4153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:42.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdf2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf415bdf0 0x7efdf4153f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39784/0 (socket says 172.21.15.6:39784) 2023-07-21T22:19:42.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdf2ffd640 1 -- 172.21.15.6:0/1295874287 learned_addr learned my addr 172.21.15.6:0/1295874287 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:42.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdf37fe640 1 --2- 172.21.15.6:0/1295874287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdf406b1e0 0x7efdf41535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:42.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdf3fff640 1 --2- 172.21.15.6:0/1295874287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdf415f970 0x7efdf41544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:42.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdf2ffd640 1 -- 172.21.15.6:0/1295874287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdf415f970 msgr2=0x7efdf41544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:42.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdf2ffd640 1 --2- 172.21.15.6:0/1295874287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdf415f970 0x7efdf41544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdf2ffd640 1 -- 172.21.15.6:0/1295874287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdf406b1e0 msgr2=0x7efdf41535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:42.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdf2ffd640 1 --2- 172.21.15.6:0/1295874287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdf406b1e0 0x7efdf41535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdf2ffd640 1 -- 172.21.15.6:0/1295874287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde40094d0 con 0x7efdf415bdf0 2023-07-21T22:19:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdf3fff640 1 --2- 172.21.15.6:0/1295874287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdf415f970 0x7efdf41544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdf2ffd640 1 --2- 172.21.15.6:0/1295874287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf415bdf0 0x7efdf4153f80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efde800d800 tx=0x7efde800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efddbfff640 1 -- 172.21.15.6:0/1295874287 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde800b6c0 con 0x7efdf415bdf0 2023-07-21T22:19:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efddbfff640 1 -- 172.21.15.6:0/1295874287 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde800b820 con 0x7efdf415bdf0 2023-07-21T22:19:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdfa00b640 1 -- 172.21.15.6:0/1295874287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf4157c50 con 0x7efdf415bdf0 2023-07-21T22:19:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efddbfff640 1 -- 172.21.15.6:0/1295874287 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde800bb90 con 0x7efdf415bdf0 2023-07-21T22:19:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdfa00b640 1 -- 172.21.15.6:0/1295874287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf4153af0 con 0x7efdf415bdf0 2023-07-21T22:19:42.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.727+0000 7efdfa00b640 1 -- 172.21.15.6:0/1295874287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf40c5210 con 0x7efdf415bdf0 2023-07-21T22:19:42.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.731+0000 7efddbfff640 1 -- 172.21.15.6:0/1295874287 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efde800bcf0 con 0x7efdf415bdf0 2023-07-21T22:19:42.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.731+0000 7efddbfff640 1 --2- 172.21.15.6:0/1295874287 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7efde0066280 0x7efde0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:42.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.731+0000 7efddbfff640 1 -- 172.21.15.6:0/1295874287 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efde8083f60 con 0x7efdf415bdf0 2023-07-21T22:19:42.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.731+0000 7efdf37fe640 1 --2- 172.21.15.6:0/1295874287 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7efde0066280 0x7efde0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:42.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.731+0000 7efdf37fe640 1 --2- 172.21.15.6:0/1295874287 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7efde0066280 0x7efde0068730 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efde40af000 tx=0x7efde40b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:42.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.735+0000 7efddbfff640 1 -- 172.21.15.6:0/1295874287 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efde8055120 con 0x7efdf415bdf0 2023-07-21T22:19:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.891+0000 7efdfa00b640 1 -- 172.21.15.6:0/1295874287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efdf40678d0 con 0x7efdf415bdf0 2023-07-21T22:19:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.891+0000 7efddbfff640 1 -- 172.21.15.6:0/1295874287 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+126 (secure 0 0 0) 0x7efde8054cb0 con 0x7efdf415bdf0 2023-07-21T22:19:42.941 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:42.941 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:19:42.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:42.941 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-07-21T22:19:42.941 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-07-21T22:19:42.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:19:42.941 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:42.942 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-07-21T22:19:42.942 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-07-21T22:19:42.942 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:42.942 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:19:42.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.895+0000 7efdfa00b640 1 -- 172.21.15.6:0/1295874287 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7efde0066280 msgr2=0x7efde0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:42.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.895+0000 7efdfa00b640 1 --2- 172.21.15.6:0/1295874287 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7efde0066280 0x7efde0068730 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efde40af000 tx=0x7efde40b6040 comp rx=0 tx=0).stop 2023-07-21T22:19:42.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.895+0000 7efdfa00b640 1 -- 172.21.15.6:0/1295874287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf415bdf0 msgr2=0x7efdf4153f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:42.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.895+0000 7efdfa00b640 1 --2- 172.21.15.6:0/1295874287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf415bdf0 0x7efdf4153f80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7efde800d800 tx=0x7efde800dcc0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.895+0000 7efdfa00b640 1 -- 172.21.15.6:0/1295874287 shutdown_connections 2023-07-21T22:19:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.895+0000 7efdfa00b640 1 --2- 172.21.15.6:0/1295874287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdf415f970 0x7efdf41544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.895+0000 7efdfa00b640 1 --2- 172.21.15.6:0/1295874287 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7efde0066280 0x7efde0068730 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.895+0000 7efdfa00b640 1 --2- 172.21.15.6:0/1295874287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf415bdf0 0x7efdf4153f80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.895+0000 7efdfa00b640 1 --2- 172.21.15.6:0/1295874287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdf406b1e0 0x7efdf41535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.895+0000 7efdfa00b640 1 -- 172.21.15.6:0/1295874287 >> 172.21.15.6:0/1295874287 conn(0x7efdf40afcf0 msgr2=0x7efdf4072420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.895+0000 7efdfa00b640 1 -- 172.21.15.6:0/1295874287 shutdown_connections 2023-07-21T22:19:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:42.895+0000 7efdfa00b640 1 -- 172.21.15.6:0/1295874287 wait complete. 2023-07-21T22:19:42.961 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-21T22:19:42.962 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-21T22:19:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.063+0000 7f4941076640 1 Processor -- start 2023-07-21T22:19:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.063+0000 7f4941076640 1 -- start start 2023-07-21T22:19:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.063+0000 7f4941076640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f493c0d03f0 0x7f493c0ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.063+0000 7f4941076640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f493c0b11b0 0x7f493c0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.063+0000 7f4941076640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493c0ceaa0 con 0x7f493c15bb10 2023-07-21T22:19:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.063+0000 7f4941076640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493c0ce690 con 0x7f493c0b11b0 2023-07-21T22:19:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.063+0000 7f4941076640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c0d1fb0 con 0x7f493c0d03f0 2023-07-21T22:19:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.063+0000 7f4940875640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f493c0b11b0 0x7f493c0aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.063+0000 7f4940875640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f493c0b11b0 0x7f493c0aece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39788/0 (socket says 172.21.15.6:39788) 2023-07-21T22:19:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.063+0000 7f4940875640 1 -- 172.21.15.6:0/694161677 learned_addr learned my addr 172.21.15.6:0/694161677 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:43.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.063+0000 7f493b7fe640 1 --2- 172.21.15.6:0/694161677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f493c0d03f0 0x7f493c0ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:43.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.063+0000 7f4940875640 1 -- 172.21.15.6:0/694161677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f493c0d03f0 msgr2=0x7f493c0ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:43.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.063+0000 7f4940875640 1 --2- 172.21.15.6:0/694161677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f493c0d03f0 0x7f493c0ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:43.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.063+0000 7f4940875640 1 -- 172.21.15.6:0/694161677 >> v1:172.21.15.161:6789/0 conn(0x7f493c15bb10 legacy=0x7f493c0cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:43.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.063+0000 7f4940875640 1 -- 172.21.15.6:0/694161677 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c0ced80 con 0x7f493c0b11b0 2023-07-21T22:19:43.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.067+0000 7f4940875640 1 --2- 172.21.15.6:0/694161677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f493c0b11b0 0x7f493c0aece0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4934009e50 tx=0x7f493401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0f94b8139eec8a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.067+0000 7f493affd640 1 -- 172.21.15.6:0/694161677 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49340a5810 con 0x7f493c0b11b0 2023-07-21T22:19:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.067+0000 7f493affd640 1 -- 172.21.15.6:0/694161677 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49340a5970 con 0x7f493c0b11b0 2023-07-21T22:19:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.067+0000 7f493affd640 1 -- 172.21.15.6:0/694161677 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49340a5d00 con 0x7f493c0b11b0 2023-07-21T22:19:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.067+0000 7f4941076640 1 -- 172.21.15.6:0/694161677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f493c0b11b0 msgr2=0x7f493c0aece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.067+0000 7f4941076640 1 --2- 172.21.15.6:0/694161677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f493c0b11b0 0x7f493c0aece0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4934009e50 tx=0x7f493401c950 comp rx=0 tx=0).stop 2023-07-21T22:19:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.067+0000 7f4941076640 1 -- 172.21.15.6:0/694161677 shutdown_connections 2023-07-21T22:19:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.067+0000 7f4941076640 1 --2- 172.21.15.6:0/694161677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f493c0b11b0 0x7f493c0aece0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.067+0000 7f4941076640 1 --2- 172.21.15.6:0/694161677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f493c0d03f0 0x7f493c0ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.067+0000 7f4941076640 1 -- 172.21.15.6:0/694161677 >> 172.21.15.6:0/694161677 conn(0x7f493c09b480 msgr2=0x7f493c0d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.067+0000 7f4941076640 1 -- 172.21.15.6:0/694161677 shutdown_connections 2023-07-21T22:19:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.067+0000 7f4941076640 1 -- 172.21.15.6:0/694161677 wait complete. 2023-07-21T22:19:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f4941076640 1 Processor -- start 2023-07-21T22:19:43.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f4941076640 1 -- start start 2023-07-21T22:19:43.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f4941076640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f493c0b11b0 0x7f493c157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:43.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f4941076640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f493c0d03f0 0x7f493c14e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:43.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f4941076640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f493c15bb10 0x7f493c150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:43.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f4941076640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c15eeb0 con 0x7f493c0d03f0 2023-07-21T22:19:43.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f4941076640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c15e8f0 con 0x7f493c15bb10 2023-07-21T22:19:43.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f4941076640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c15ebd0 con 0x7f493c0b11b0 2023-07-21T22:19:43.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f493b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f493c0d03f0 0x7f493c14e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:43.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f493b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f493c0d03f0 0x7f493c14e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39798/0 (socket says 172.21.15.6:39798) 2023-07-21T22:19:43.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f493b7fe640 1 -- 172.21.15.6:0/630009521 learned_addr learned my addr 172.21.15.6:0/630009521 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:43.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f493bfff640 1 --2- 172.21.15.6:0/630009521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f493c0b11b0 0x7f493c157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f4940875640 1 --2- 172.21.15.6:0/630009521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f493c15bb10 0x7f493c150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f493b7fe640 1 -- 172.21.15.6:0/630009521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f493c0b11b0 msgr2=0x7f493c157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f493b7fe640 1 --2- 172.21.15.6:0/630009521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f493c0b11b0 0x7f493c157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f493b7fe640 1 -- 172.21.15.6:0/630009521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f493c15bb10 msgr2=0x7f493c150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f493b7fe640 1 --2- 172.21.15.6:0/630009521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f493c15bb10 0x7f493c150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:43.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f493b7fe640 1 -- 172.21.15.6:0/630009521 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4934009b30 con 0x7f493c0d03f0 2023-07-21T22:19:43.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f493b7fe640 1 --2- 172.21.15.6:0/630009521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f493c0d03f0 0x7f493c14e180 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f493000d7d0 tx=0x7f493000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:43.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f4938ff9640 1 -- 172.21.15.6:0/630009521 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493000b6c0 con 0x7f493c0d03f0 2023-07-21T22:19:43.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f4938ff9640 1 -- 172.21.15.6:0/630009521 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493000b820 con 0x7f493c0d03f0 2023-07-21T22:19:43.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f4941076640 1 -- 172.21.15.6:0/630009521 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493c154560 con 0x7f493c0d03f0 2023-07-21T22:19:43.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f4938ff9640 1 -- 172.21.15.6:0/630009521 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493000bbd0 con 0x7f493c0d03f0 2023-07-21T22:19:43.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.071+0000 7f4941076640 1 -- 172.21.15.6:0/630009521 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493c15c290 con 0x7f493c0d03f0 2023-07-21T22:19:43.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.075+0000 7f4941076640 1 -- 172.21.15.6:0/630009521 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493c071810 con 0x7f493c0d03f0 2023-07-21T22:19:43.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.075+0000 7f4938ff9640 1 -- 172.21.15.6:0/630009521 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f493000bd30 con 0x7f493c0d03f0 2023-07-21T22:19:43.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.075+0000 7f4938ff9640 1 --2- 172.21.15.6:0/630009521 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4928066280 0x7f4928068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:43.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.075+0000 7f4938ff9640 1 -- 172.21.15.6:0/630009521 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4930083e30 con 0x7f493c0d03f0 2023-07-21T22:19:43.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.075+0000 7f493bfff640 1 --2- 172.21.15.6:0/630009521 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4928066280 0x7f4928068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:43.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.075+0000 7f493bfff640 1 --2- 172.21.15.6:0/630009521 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4928066280 0x7f4928068730 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f492c007fd0 tx=0x7f492c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:43.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.079+0000 7f4938ff9640 1 -- 172.21.15.6:0/630009521 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4930055130 con 0x7f493c0d03f0 2023-07-21T22:19:43.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.235+0000 7f4941076640 1 -- 172.21.15.6:0/630009521 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f493c04e020 con 0x7f493c0d03f0 2023-07-21T22:19:43.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.747+0000 7f4938ff9640 1 -- 172.21.15.6:0/630009521 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4930054cc0 con 0x7f493c0d03f0 2023-07-21T22:19:43.796 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-07-21T22:19:43.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.751+0000 7f4941076640 1 -- 172.21.15.6:0/630009521 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4928066280 msgr2=0x7f4928068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:43.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.751+0000 7f4941076640 1 --2- 172.21.15.6:0/630009521 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4928066280 0x7f4928068730 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f492c007fd0 tx=0x7f492c009040 comp rx=0 tx=0).stop 2023-07-21T22:19:43.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.751+0000 7f4941076640 1 -- 172.21.15.6:0/630009521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f493c0d03f0 msgr2=0x7f493c14e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:43.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.751+0000 7f4941076640 1 --2- 172.21.15.6:0/630009521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f493c0d03f0 0x7f493c14e180 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f493000d7d0 tx=0x7f493000dc90 comp rx=0 tx=0).stop 2023-07-21T22:19:43.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.751+0000 7f4941076640 1 -- 172.21.15.6:0/630009521 shutdown_connections 2023-07-21T22:19:43.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.751+0000 7f4941076640 1 --2- 172.21.15.6:0/630009521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f493c15bb10 0x7f493c150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:43.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.751+0000 7f4941076640 1 --2- 172.21.15.6:0/630009521 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4928066280 0x7f4928068730 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:43.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.751+0000 7f4941076640 1 --2- 172.21.15.6:0/630009521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f493c0d03f0 0x7f493c14e180 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:43.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.751+0000 7f4941076640 1 --2- 172.21.15.6:0/630009521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f493c0b11b0 0x7f493c157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:43.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.751+0000 7f4941076640 1 -- 172.21.15.6:0/630009521 >> 172.21.15.6:0/630009521 conn(0x7f493c09b480 msgr2=0x7f493c0afdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:43.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.751+0000 7f4941076640 1 -- 172.21.15.6:0/630009521 shutdown_connections 2023-07-21T22:19:43.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.751+0000 7f4941076640 1 -- 172.21.15.6:0/630009521 wait complete. 2023-07-21T22:19:43.824 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T22:19:43.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.931+0000 7fedbb8d8640 1 Processor -- start 2023-07-21T22:19:43.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.931+0000 7fedbb8d8640 1 -- start start 2023-07-21T22:19:43.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.931+0000 7fedbb8d8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb4158a40 0x7fedb40cb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:43.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.931+0000 7fedbb8d8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fedb40c8940 0x7fedb40ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:43.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.931+0000 7fedbb8d8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb4070c10 con 0x7fedb40cd4a0 2023-07-21T22:19:43.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.931+0000 7fedbb8d8640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb40cd940 con 0x7fedb40c8940 2023-07-21T22:19:43.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.931+0000 7fedbb8d8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb40711b0 con 0x7fedb4158a40 2023-07-21T22:19:43.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.931+0000 7fedb9674640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb4158a40 0x7fedb40cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:43.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.931+0000 7fedb8e73640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fedb40c8940 0x7fedb40ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:43.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.931+0000 7fedb9674640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb4158a40 0x7fedb40cb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:53694/0 (socket says 172.21.15.6:53694) 2023-07-21T22:19:43.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.931+0000 7fedb9674640 1 -- 172.21.15.6:0/2008934788 learned_addr learned my addr 172.21.15.6:0/2008934788 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:43.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.931+0000 7fedb8e73640 1 -- 172.21.15.6:0/2008934788 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb4158a40 msgr2=0x7fedb40cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:43.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.931+0000 7fedb8e73640 1 --2- 172.21.15.6:0/2008934788 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb4158a40 0x7fedb40cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:43.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.931+0000 7fedb8e73640 1 -- 172.21.15.6:0/2008934788 >> v1:172.21.15.161:6789/0 conn(0x7fedb40cd4a0 legacy=0x7fedb415c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:43.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.931+0000 7fedb8e73640 1 -- 172.21.15.6:0/2008934788 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb40c8e20 con 0x7fedb40c8940 2023-07-21T22:19:43.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.931+0000 7fedb9674640 1 --2- 172.21.15.6:0/2008934788 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb4158a40 0x7fedb40cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:43.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.935+0000 7fedb8e73640 1 --2- 172.21.15.6:0/2008934788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedb40c8940 0x7fedb40ccf60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7feda40097f0 tx=0x7feda401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33e0e07191dbadd2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:43.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.935+0000 7fedabfff640 1 -- 172.21.15.6:0/2008934788 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda40ab600 con 0x7fedb40c8940 2023-07-21T22:19:43.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.935+0000 7fedabfff640 1 -- 172.21.15.6:0/2008934788 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda40a7050 con 0x7fedb40c8940 2023-07-21T22:19:43.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.935+0000 7fedabfff640 1 -- 172.21.15.6:0/2008934788 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda40ab980 con 0x7fedb40c8940 2023-07-21T22:19:43.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.935+0000 7fedbb8d8640 1 -- 172.21.15.6:0/2008934788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedb40c8940 msgr2=0x7fedb40ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:43.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.935+0000 7fedbb8d8640 1 --2- 172.21.15.6:0/2008934788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedb40c8940 0x7fedb40ccf60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7feda40097f0 tx=0x7feda401c450 comp rx=0 tx=0).stop 2023-07-21T22:19:43.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.935+0000 7fedbb8d8640 1 -- 172.21.15.6:0/2008934788 shutdown_connections 2023-07-21T22:19:43.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.935+0000 7fedbb8d8640 1 --2- 172.21.15.6:0/2008934788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedb40c8940 0x7fedb40ccf60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:43.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.935+0000 7fedbb8d8640 1 --2- 172.21.15.6:0/2008934788 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb4158a40 0x7fedb40cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:43.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.935+0000 7fedbb8d8640 1 -- 172.21.15.6:0/2008934788 >> 172.21.15.6:0/2008934788 conn(0x7fedb40afac0 msgr2=0x7fedb40afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:43.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.935+0000 7fedbb8d8640 1 -- 172.21.15.6:0/2008934788 shutdown_connections 2023-07-21T22:19:43.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.935+0000 7fedbb8d8640 1 -- 172.21.15.6:0/2008934788 wait complete. 2023-07-21T22:19:43.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedbb8d8640 1 Processor -- start 2023-07-21T22:19:43.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedbb8d8640 1 -- start start 2023-07-21T22:19:43.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedbb8d8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40c8940 0x7fedb414a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:43.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedbb8d8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedb40cd4a0 0x7fedb415b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:43.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedbb8d8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb41498c0 0x7fedb40b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:43.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedbb8d8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb40c2b40 con 0x7fedb40c8940 2023-07-21T22:19:43.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedbb8d8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb415bd20 con 0x7fedb40cd4a0 2023-07-21T22:19:43.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedbb8d8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb40c3980 con 0x7fedb41498c0 2023-07-21T22:19:43.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedb9674640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40c8940 0x7fedb414a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:43.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedb9674640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40c8940 0x7fedb414a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39814/0 (socket says 172.21.15.6:39814) 2023-07-21T22:19:43.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedb9674640 1 -- 172.21.15.6:0/2474874585 learned_addr learned my addr 172.21.15.6:0/2474874585 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:43.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedb9e75640 1 --2- 172.21.15.6:0/2474874585 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb41498c0 0x7fedb40b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:43.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedb8e73640 1 --2- 172.21.15.6:0/2474874585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedb40cd4a0 0x7fedb415b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:43.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedb9674640 1 -- 172.21.15.6:0/2474874585 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb41498c0 msgr2=0x7fedb40b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:43.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedb9674640 1 --2- 172.21.15.6:0/2474874585 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb41498c0 0x7fedb40b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:43.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedb9674640 1 -- 172.21.15.6:0/2474874585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedb40cd4a0 msgr2=0x7fedb415b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:43.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedb9674640 1 --2- 172.21.15.6:0/2474874585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedb40cd4a0 0x7fedb415b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:43.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedb9674640 1 -- 172.21.15.6:0/2474874585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb000b770 con 0x7fedb40c8940 2023-07-21T22:19:43.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedb9674640 1 --2- 172.21.15.6:0/2474874585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40c8940 0x7fedb414a530 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fedb000ed70 tx=0x7fedb000d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:43.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7feda9ffb640 1 -- 172.21.15.6:0/2474874585 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0010640 con 0x7fedb40c8940 2023-07-21T22:19:43.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7feda9ffb640 1 -- 172.21.15.6:0/2474874585 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb00107a0 con 0x7fedb40c8940 2023-07-21T22:19:43.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7feda9ffb640 1 -- 172.21.15.6:0/2474874585 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0010b10 con 0x7fedb40c8940 2023-07-21T22:19:43.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedbb8d8640 1 -- 172.21.15.6:0/2474874585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda4009420 con 0x7fedb40c8940 2023-07-21T22:19:43.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedbb8d8640 1 -- 172.21.15.6:0/2474874585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb40c3050 con 0x7fedb40c8940 2023-07-21T22:19:43.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.939+0000 7fedbb8d8640 1 -- 172.21.15.6:0/2474874585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb40ca370 con 0x7fedb40c8940 2023-07-21T22:19:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.943+0000 7feda9ffb640 1 -- 172.21.15.6:0/2474874585 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fedb0010c70 con 0x7fedb40c8940 2023-07-21T22:19:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.943+0000 7feda9ffb640 1 --2- 172.21.15.6:0/2474874585 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fed98066280 0x7fed98068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.943+0000 7feda9ffb640 1 -- 172.21.15.6:0/2474874585 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fedb0084540 con 0x7fedb40c8940 2023-07-21T22:19:43.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.943+0000 7fedb8e73640 1 --2- 172.21.15.6:0/2474874585 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fed98066280 0x7fed98068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:43.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.947+0000 7fedb8e73640 1 --2- 172.21.15.6:0/2474874585 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fed98066280 0x7fed98068730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feda40ad000 tx=0x7feda40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:43.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:43.947+0000 7feda9ffb640 1 -- 172.21.15.6:0/2474874585 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fedb0051cc0 con 0x7fedb40c8940 2023-07-21T22:19:44.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.103+0000 7fedbb8d8640 1 -- 172.21.15.6:0/2474874585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fedb40c8510 con 0x7fedb40c8940 2023-07-21T22:19:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.755+0000 7feda9ffb640 1 -- 172.21.15.6:0/2474874585 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7fedb00552e0 con 0x7fedb40c8940 2023-07-21T22:19:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-07-21T22:19:44.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.763+0000 7fedbb8d8640 1 -- 172.21.15.6:0/2474874585 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fed98066280 msgr2=0x7fed98068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:44.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.763+0000 7fedbb8d8640 1 --2- 172.21.15.6:0/2474874585 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fed98066280 0x7fed98068730 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feda40ad000 tx=0x7feda40a6000 comp rx=0 tx=0).stop 2023-07-21T22:19:44.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.763+0000 7fedbb8d8640 1 -- 172.21.15.6:0/2474874585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40c8940 msgr2=0x7fedb414a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:44.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.763+0000 7fedbb8d8640 1 --2- 172.21.15.6:0/2474874585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40c8940 0x7fedb414a530 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fedb000ed70 tx=0x7fedb000d720 comp rx=0 tx=0).stop 2023-07-21T22:19:44.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.767+0000 7fedbb8d8640 1 -- 172.21.15.6:0/2474874585 shutdown_connections 2023-07-21T22:19:44.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.767+0000 7fedbb8d8640 1 --2- 172.21.15.6:0/2474874585 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb41498c0 0x7fedb40b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:44.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.767+0000 7fedbb8d8640 1 --2- 172.21.15.6:0/2474874585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedb40cd4a0 0x7fedb415b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:44.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.767+0000 7fedbb8d8640 1 --2- 172.21.15.6:0/2474874585 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fed98066280 0x7fed98068730 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:44.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.767+0000 7fedbb8d8640 1 --2- 172.21.15.6:0/2474874585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40c8940 0x7fedb414a530 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:44.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.767+0000 7fedbb8d8640 1 -- 172.21.15.6:0/2474874585 >> 172.21.15.6:0/2474874585 conn(0x7fedb40afac0 msgr2=0x7fedb406c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:44.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.767+0000 7fedbb8d8640 1 -- 172.21.15.6:0/2474874585 shutdown_connections 2023-07-21T22:19:44.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.767+0000 7fedbb8d8640 1 -- 172.21.15.6:0/2474874585 wait complete. 2023-07-21T22:19:44.850 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-21T22:19:45.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.951+0000 7f8ba3103640 1 Processor -- start 2023-07-21T22:19:45.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.951+0000 7f8ba3103640 1 -- start start 2023-07-21T22:19:45.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.955+0000 7f8ba3103640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b9c0aeb40 0x7f8b9c15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:45.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.955+0000 7f8ba3103640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8b9c159440 0x7f8b9c0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:45.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.955+0000 7f8ba3103640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9c1532b0 con 0x7f8b9c0aef10 2023-07-21T22:19:45.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.955+0000 7f8ba3103640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9c0ca6f0 con 0x7f8b9c159440 2023-07-21T22:19:45.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.955+0000 7f8ba3103640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c1599d0 con 0x7f8b9c0aeb40 2023-07-21T22:19:45.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.955+0000 7f8b9bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8b9c0aef10 0x7f8b9c158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52260/0 (socket says 172.21.15.6:52260) 2023-07-21T22:19:45.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.955+0000 7f8b9bfff640 1 -- 172.21.15.6:0/144339584 learned_addr learned my addr 172.21.15.6:0/144339584 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:45.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.955+0000 7f8ba0e9f640 1 --2- 172.21.15.6:0/144339584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b9c0aeb40 0x7f8b9c15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:45.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.955+0000 7f8ba16a0640 1 --2- 172.21.15.6:0/144339584 >> v2:172.21.15.161:3300/0 conn(0x7f8b9c159440 0x7f8b9c0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:45.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.955+0000 7f8b9b7fe640 1 -- 172.21.15.6:0/144339584 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722041341 0 0) 0x7f8b9c1532b0 con 0x7f8b9c0aef10 2023-07-21T22:19:45.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.955+0000 7f8b9b7fe640 1 -- 172.21.15.6:0/144339584 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b8c003530 con 0x7f8b9c0aef10 2023-07-21T22:19:45.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.955+0000 7f8ba0e9f640 1 -- 172.21.15.6:0/144339584 >> v2:172.21.15.161:3300/0 conn(0x7f8b9c159440 msgr2=0x7f8b9c0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:45.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.955+0000 7f8ba0e9f640 1 --2- 172.21.15.6:0/144339584 >> v2:172.21.15.161:3300/0 conn(0x7f8b9c159440 0x7f8b9c0c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:45.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.955+0000 7f8ba0e9f640 1 -- 172.21.15.6:0/144339584 >> v1:172.21.15.6:6789/0 conn(0x7f8b9c0aef10 legacy=0x7f8b9c158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:45.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.955+0000 7f8ba0e9f640 1 -- 172.21.15.6:0/144339584 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c159cb0 con 0x7f8b9c0aeb40 2023-07-21T22:19:45.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.955+0000 7f8ba16a0640 1 --2- 172.21.15.6:0/144339584 >> v2:172.21.15.161:3300/0 conn(0x7f8b9c159440 0x7f8b9c0c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:45.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.959+0000 7f8ba0e9f640 1 --2- 172.21.15.6:0/144339584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b9c0aeb40 0x7f8b9c15cef0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8b900097c0 tx=0x7f8b9001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8521310c77e002c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:45.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.959+0000 7f8b9b7fe640 1 -- 172.21.15.6:0/144339584 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b900ac620 con 0x7f8b9c0aeb40 2023-07-21T22:19:45.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.959+0000 7f8b9b7fe640 1 -- 172.21.15.6:0/144339584 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b900ac780 con 0x7f8b9c0aeb40 2023-07-21T22:19:45.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.959+0000 7f8b9b7fe640 1 -- 172.21.15.6:0/144339584 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b900acb10 con 0x7f8b9c0aeb40 2023-07-21T22:19:45.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.959+0000 7f8ba3103640 1 -- 172.21.15.6:0/144339584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b9c0aeb40 msgr2=0x7f8b9c15cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:45.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.959+0000 7f8ba3103640 1 --2- 172.21.15.6:0/144339584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b9c0aeb40 0x7f8b9c15cef0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8b900097c0 tx=0x7f8b9001c3c0 comp rx=0 tx=0).stop 2023-07-21T22:19:45.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.959+0000 7f8ba3103640 1 -- 172.21.15.6:0/144339584 shutdown_connections 2023-07-21T22:19:45.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.959+0000 7f8ba3103640 1 --2- 172.21.15.6:0/144339584 >> v2:172.21.15.161:3300/0 conn(0x7f8b9c159440 0x7f8b9c0c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:45.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.959+0000 7f8ba3103640 1 --2- 172.21.15.6:0/144339584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b9c0aeb40 0x7f8b9c15cef0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:45.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.959+0000 7f8ba3103640 1 -- 172.21.15.6:0/144339584 >> 172.21.15.6:0/144339584 conn(0x7f8b9c0cde90 msgr2=0x7f8b9c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:45.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.959+0000 7f8ba3103640 1 -- 172.21.15.6:0/144339584 shutdown_connections 2023-07-21T22:19:45.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.959+0000 7f8ba3103640 1 -- 172.21.15.6:0/144339584 wait complete. 2023-07-21T22:19:45.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.959+0000 7f8ba3103640 1 Processor -- start 2023-07-21T22:19:45.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.959+0000 7f8ba3103640 1 -- start start 2023-07-21T22:19:45.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8ba3103640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b9c0aeb40 0x7f8b9c06c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:45.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8ba3103640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b9c0aef10 0x7f8b9c15a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:45.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8ba3103640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b9c159440 0x7f8b9c06b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:45.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8ba3103640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c06c860 con 0x7f8b9c0aeb40 2023-07-21T22:19:45.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8ba3103640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0b1bb0 con 0x7f8b9c0aef10 2023-07-21T22:19:45.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8ba3103640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0b1e90 con 0x7f8b9c159440 2023-07-21T22:19:45.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8ba0e9f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b9c0aeb40 0x7f8b9c06c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:45.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8ba0e9f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b9c0aeb40 0x7f8b9c06c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39828/0 (socket says 172.21.15.6:39828) 2023-07-21T22:19:45.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8ba0e9f640 1 -- 172.21.15.6:0/682392658 learned_addr learned my addr 172.21.15.6:0/682392658 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:45.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8ba16a0640 1 --2- 172.21.15.6:0/682392658 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b9c159440 0x7f8b9c06b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:45.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8b9bfff640 1 --2- 172.21.15.6:0/682392658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b9c0aef10 0x7f8b9c15a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:45.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8ba0e9f640 1 -- 172.21.15.6:0/682392658 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b9c159440 msgr2=0x7f8b9c06b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:45.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8ba0e9f640 1 --2- 172.21.15.6:0/682392658 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b9c159440 0x7f8b9c06b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:45.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8ba0e9f640 1 -- 172.21.15.6:0/682392658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b9c0aef10 msgr2=0x7f8b9c15a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:45.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8ba0e9f640 1 --2- 172.21.15.6:0/682392658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b9c0aef10 0x7f8b9c15a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:45.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8ba0e9f640 1 -- 172.21.15.6:0/682392658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b94009a70 con 0x7f8b9c0aeb40 2023-07-21T22:19:45.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8b9bfff640 1 --2- 172.21.15.6:0/682392658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b9c0aef10 0x7f8b9c15a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:45.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8ba0e9f640 1 --2- 172.21.15.6:0/682392658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b9c0aeb40 0x7f8b9c06c320 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8b900af040 tx=0x7f8b90019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:45.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8b997fa640 1 -- 172.21.15.6:0/682392658 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b900b5410 con 0x7f8b9c0aeb40 2023-07-21T22:19:45.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8b997fa640 1 -- 172.21.15.6:0/682392658 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b900b5570 con 0x7f8b9c0aeb40 2023-07-21T22:19:45.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8b997fa640 1 -- 172.21.15.6:0/682392658 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b900b5900 con 0x7f8b9c0aeb40 2023-07-21T22:19:45.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8ba3103640 1 -- 172.21.15.6:0/682392658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b90009420 con 0x7f8b9c0aeb40 2023-07-21T22:19:45.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8ba3103640 1 -- 172.21.15.6:0/682392658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9c0b2450 con 0x7f8b9c0aeb40 2023-07-21T22:19:45.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.963+0000 7f8ba3103640 1 -- 172.21.15.6:0/682392658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b9c0678d0 con 0x7f8b9c0aeb40 2023-07-21T22:19:45.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.967+0000 7f8b997fa640 1 -- 172.21.15.6:0/682392658 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8b900b3040 con 0x7f8b9c0aeb40 2023-07-21T22:19:45.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.967+0000 7f8b997fa640 1 --2- 172.21.15.6:0/682392658 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f8b80066280 0x7f8b80068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:45.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.967+0000 7f8b997fa640 1 -- 172.21.15.6:0/682392658 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f8b9011dc40 con 0x7f8b9c0aeb40 2023-07-21T22:19:45.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.967+0000 7f8b9bfff640 1 --2- 172.21.15.6:0/682392658 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f8b80066280 0x7f8b80068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:45.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.967+0000 7f8b9bfff640 1 --2- 172.21.15.6:0/682392658 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f8b80066280 0x7f8b80068730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c15b150 tx=0x7f8b88009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:45.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:44.971+0000 7f8b997fa640 1 -- 172.21.15.6:0/682392658 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8b900eb110 con 0x7f8b9c0aeb40 2023-07-21T22:19:45.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.159+0000 7f8ba3103640 1 -- 172.21.15.6:0/682392658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8b9c0c2ee0 con 0x7f8b9c0aeb40 2023-07-21T22:19:45.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.763+0000 7f8b997fa640 1 -- 172.21.15.6:0/682392658 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8b900b10c0 con 0x7f8b9c0aeb40 2023-07-21T22:19:45.810 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 5 and data pool 6 2023-07-21T22:19:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.771+0000 7f8ba3103640 1 -- 172.21.15.6:0/682392658 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f8b80066280 msgr2=0x7f8b80068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.771+0000 7f8ba3103640 1 --2- 172.21.15.6:0/682392658 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f8b80066280 0x7f8b80068730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c15b150 tx=0x7f8b88009040 comp rx=0 tx=0).stop 2023-07-21T22:19:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.771+0000 7f8ba3103640 1 -- 172.21.15.6:0/682392658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b9c0aeb40 msgr2=0x7f8b9c06c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.771+0000 7f8ba3103640 1 --2- 172.21.15.6:0/682392658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b9c0aeb40 0x7f8b9c06c320 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8b900af040 tx=0x7f8b90019160 comp rx=0 tx=0).stop 2023-07-21T22:19:45.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.779+0000 7f8ba3103640 1 -- 172.21.15.6:0/682392658 shutdown_connections 2023-07-21T22:19:45.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.779+0000 7f8ba3103640 1 --2- 172.21.15.6:0/682392658 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b9c159440 0x7f8b9c06b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:45.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.779+0000 7f8ba3103640 1 --2- 172.21.15.6:0/682392658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b9c0aef10 0x7f8b9c15a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:45.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.779+0000 7f8ba3103640 1 --2- 172.21.15.6:0/682392658 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f8b80066280 0x7f8b80068730 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:45.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.779+0000 7f8ba3103640 1 --2- 172.21.15.6:0/682392658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b9c0aeb40 0x7f8b9c06c320 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:45.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.779+0000 7f8ba3103640 1 -- 172.21.15.6:0/682392658 >> 172.21.15.6:0/682392658 conn(0x7f8b9c0cde90 msgr2=0x7f8b9c1527a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:45.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.779+0000 7f8ba3103640 1 -- 172.21.15.6:0/682392658 shutdown_connections 2023-07-21T22:19:45.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.779+0000 7f8ba3103640 1 -- 172.21.15.6:0/682392658 wait complete. 2023-07-21T22:19:45.863 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:19:46.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.963+0000 7f35bac0b640 1 Processor -- start 2023-07-21T22:19:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.963+0000 7f35bac0b640 1 -- start start 2023-07-21T22:19:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.963+0000 7f35bac0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35b40b7c70 0x7f35b40d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:46.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.963+0000 7f35bac0b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f35b40d1850 0x7f35b415f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:46.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.963+0000 7f35bac0b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f35b40d1300 0x7f35b415fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:46.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.963+0000 7f35bac0b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b40d1190 con 0x7f35b40d1300 2023-07-21T22:19:46.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.963+0000 7f35bac0b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b4160600 con 0x7f35b40d1850 2023-07-21T22:19:46.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.963+0000 7f35bac0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b41600d0 con 0x7f35b40b7c70 2023-07-21T22:19:46.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.963+0000 7f35b91a8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f35b40d1300 0x7f35b415fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:46.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.963+0000 7f35b91a8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f35b40d1300 0x7f35b415fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39842/0 (socket says 172.21.15.6:39842) 2023-07-21T22:19:46.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.963+0000 7f35b91a8640 1 -- 172.21.15.6:0/2794992048 learned_addr learned my addr 172.21.15.6:0/2794992048 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:46.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.963+0000 7f35b3fff640 1 --2- 172.21.15.6:0/2794992048 >> v2:172.21.15.161:3300/0 conn(0x7f35b40d1850 0x7f35b415f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:46.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.963+0000 7f35b89a7640 1 --2- 172.21.15.6:0/2794992048 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35b40b7c70 0x7f35b40d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:46.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.963+0000 7f35b91a8640 1 -- 172.21.15.6:0/2794992048 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35b40b7c70 msgr2=0x7f35b40d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:46.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.963+0000 7f35b91a8640 1 --2- 172.21.15.6:0/2794992048 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35b40b7c70 0x7f35b40d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.963+0000 7f35b91a8640 1 -- 172.21.15.6:0/2794992048 >> v2:172.21.15.161:3300/0 conn(0x7f35b40d1850 msgr2=0x7f35b415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:46.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.963+0000 7f35b91a8640 1 --2- 172.21.15.6:0/2794992048 >> v2:172.21.15.161:3300/0 conn(0x7f35b40d1850 0x7f35b415f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.963+0000 7f35b91a8640 1 -- 172.21.15.6:0/2794992048 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b40ccaf0 con 0x7f35b40d1300 2023-07-21T22:19:46.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.967+0000 7f35b91a8640 1 --2- 172.21.15.6:0/2794992048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35b40d1300 0x7f35b415fb90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f35b4069dc0 tx=0x7f35ac01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107eca062607ca4e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:46.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.967+0000 7f35b37fe640 1 -- 172.21.15.6:0/2794992048 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac0a5730 con 0x7f35b40d1300 2023-07-21T22:19:46.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.967+0000 7f35b37fe640 1 -- 172.21.15.6:0/2794992048 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ac0a5890 con 0x7f35b40d1300 2023-07-21T22:19:46.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.967+0000 7f35b37fe640 1 -- 172.21.15.6:0/2794992048 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ac0a5c20 con 0x7f35b40d1300 2023-07-21T22:19:46.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.967+0000 7f35bac0b640 1 -- 172.21.15.6:0/2794992048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35b40d1300 msgr2=0x7f35b415fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:46.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.967+0000 7f35bac0b640 1 --2- 172.21.15.6:0/2794992048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35b40d1300 0x7f35b415fb90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f35b4069dc0 tx=0x7f35ac01c9a0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.967+0000 7f35bac0b640 1 -- 172.21.15.6:0/2794992048 shutdown_connections 2023-07-21T22:19:46.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.967+0000 7f35bac0b640 1 --2- 172.21.15.6:0/2794992048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35b40d1300 0x7f35b415fb90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.967+0000 7f35bac0b640 1 --2- 172.21.15.6:0/2794992048 >> v2:172.21.15.161:3300/0 conn(0x7f35b40d1850 0x7f35b415f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.967+0000 7f35bac0b640 1 --2- 172.21.15.6:0/2794992048 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35b40b7c70 0x7f35b40d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.967+0000 7f35bac0b640 1 -- 172.21.15.6:0/2794992048 >> 172.21.15.6:0/2794992048 conn(0x7f35b40650b0 msgr2=0x7f35b40654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:46.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.967+0000 7f35bac0b640 1 -- 172.21.15.6:0/2794992048 shutdown_connections 2023-07-21T22:19:46.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.967+0000 7f35bac0b640 1 -- 172.21.15.6:0/2794992048 wait complete. 2023-07-21T22:19:46.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35bac0b640 1 Processor -- start 2023-07-21T22:19:46.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35bac0b640 1 -- start start 2023-07-21T22:19:46.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35bac0b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35b40b7c70 0x7f35b4158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:46.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35bac0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35b40d1300 0x7f35b40b2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:46.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35bac0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35b40d1850 0x7f35b40b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:46.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35bac0b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b4158ad0 con 0x7f35b40d1300 2023-07-21T22:19:46.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35bac0b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b40c71b0 con 0x7f35b40b7c70 2023-07-21T22:19:46.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35bac0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b40b25b0 con 0x7f35b40d1850 2023-07-21T22:19:46.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35b3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35b40d1300 0x7f35b40b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:46.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35b3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35b40d1300 0x7f35b40b2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39850/0 (socket says 172.21.15.6:39850) 2023-07-21T22:19:46.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35b3fff640 1 -- 172.21.15.6:0/3543213225 learned_addr learned my addr 172.21.15.6:0/3543213225 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35b91a8640 1 --2- 172.21.15.6:0/3543213225 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35b40d1850 0x7f35b40b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35b89a7640 1 --2- 172.21.15.6:0/3543213225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35b40b7c70 0x7f35b4158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35b3fff640 1 -- 172.21.15.6:0/3543213225 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35b40d1850 msgr2=0x7f35b40b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35b3fff640 1 --2- 172.21.15.6:0/3543213225 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35b40d1850 0x7f35b40b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35b3fff640 1 -- 172.21.15.6:0/3543213225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35b40b7c70 msgr2=0x7f35b4158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35b3fff640 1 --2- 172.21.15.6:0/3543213225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35b40b7c70 0x7f35b4158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35b3fff640 1 -- 172.21.15.6:0/3543213225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac009b30 con 0x7f35b40d1300 2023-07-21T22:19:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35b3fff640 1 --2- 172.21.15.6:0/3543213225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35b40d1300 0x7f35b40b2070 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f35a000e870 tx=0x7f35a000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35b17fa640 1 -- 172.21.15.6:0/3543213225 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a0009510 con 0x7f35b40d1300 2023-07-21T22:19:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35b17fa640 1 -- 172.21.15.6:0/3543213225 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a000eec0 con 0x7f35b40d1300 2023-07-21T22:19:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35bac0b640 1 -- 172.21.15.6:0/3543213225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b40c5e30 con 0x7f35b40d1300 2023-07-21T22:19:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35b17fa640 1 -- 172.21.15.6:0/3543213225 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a000cb40 con 0x7f35b40d1300 2023-07-21T22:19:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.971+0000 7f35bac0b640 1 -- 172.21.15.6:0/3543213225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b40c63f0 con 0x7f35b40d1300 2023-07-21T22:19:46.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.975+0000 7f35bac0b640 1 -- 172.21.15.6:0/3543213225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b40678d0 con 0x7f35b40d1300 2023-07-21T22:19:46.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.975+0000 7f35b17fa640 1 -- 172.21.15.6:0/3543213225 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f35a000cca0 con 0x7f35b40d1300 2023-07-21T22:19:46.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.975+0000 7f35b17fa640 1 --2- 172.21.15.6:0/3543213225 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3598066280 0x7f3598068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:46.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.975+0000 7f35b17fa640 1 -- 172.21.15.6:0/3543213225 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f35a0083da0 con 0x7f35b40d1300 2023-07-21T22:19:46.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.975+0000 7f35b89a7640 1 --2- 172.21.15.6:0/3543213225 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3598066280 0x7f3598068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:46.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.975+0000 7f35b89a7640 1 --2- 172.21.15.6:0/3543213225 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3598066280 0x7f3598068730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f35a8009b60 tx=0x7f35a8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:46.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:45.979+0000 7f35b17fa640 1 -- 172.21.15.6:0/3543213225 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f35a0051230 con 0x7f35b40d1300 2023-07-21T22:19:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.135+0000 7f35bac0b640 1 -- 172.21.15.6:0/3543213225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35b40730b0 con 0x7f35b40d1300 2023-07-21T22:19:46.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.135+0000 7f35b17fa640 1 -- 172.21.15.6:0/3543213225 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18292 (secure 0 0 0) 0x7f35a0017090 con 0x7f35b40d1300 2023-07-21T22:19:46.185 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:46.185 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":38,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:19:45.163088+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:19:43.286760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-21T22:19:44.152686+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:19:46.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.139+0000 7f35bac0b640 1 -- 172.21.15.6:0/3543213225 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3598066280 msgr2=0x7f3598068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:46.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.139+0000 7f35bac0b640 1 --2- 172.21.15.6:0/3543213225 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3598066280 0x7f3598068730 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f35a8009b60 tx=0x7f35a8009190 comp rx=0 tx=0).stop 2023-07-21T22:19:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.139+0000 7f35bac0b640 1 -- 172.21.15.6:0/3543213225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35b40d1300 msgr2=0x7f35b40b2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.139+0000 7f35bac0b640 1 --2- 172.21.15.6:0/3543213225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35b40d1300 0x7f35b40b2070 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f35a000e870 tx=0x7f35a000ec70 comp rx=0 tx=0).stop 2023-07-21T22:19:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.139+0000 7f35bac0b640 1 -- 172.21.15.6:0/3543213225 shutdown_connections 2023-07-21T22:19:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.139+0000 7f35bac0b640 1 --2- 172.21.15.6:0/3543213225 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f35b40d1850 0x7f35b40b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.139+0000 7f35bac0b640 1 --2- 172.21.15.6:0/3543213225 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3598066280 0x7f3598068730 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.139+0000 7f35bac0b640 1 --2- 172.21.15.6:0/3543213225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35b40d1300 0x7f35b40b2070 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.139+0000 7f35bac0b640 1 --2- 172.21.15.6:0/3543213225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f35b40b7c70 0x7f35b4158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.139+0000 7f35bac0b640 1 -- 172.21.15.6:0/3543213225 >> 172.21.15.6:0/3543213225 conn(0x7f35b40650b0 msgr2=0x7f35b40b5130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.139+0000 7f35bac0b640 1 -- 172.21.15.6:0/3543213225 shutdown_connections 2023-07-21T22:19:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.139+0000 7f35bac0b640 1 -- 172.21.15.6:0/3543213225 wait complete. 2023-07-21T22:19:46.206 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:19:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.303+0000 7f9c181d2640 1 Processor -- start 2023-07-21T22:19:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.303+0000 7f9c181d2640 1 -- start start 2023-07-21T22:19:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.303+0000 7f9c181d2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c10145430 0x7f9c100b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.303+0000 7f9c181d2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9c100b39f0 0x7f9c100d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.303+0000 7f9c181d2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c100b2140 con 0x7f9c100d06b0 2023-07-21T22:19:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.303+0000 7f9c181d2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c100b2410 con 0x7f9c10145430 2023-07-21T22:19:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.303+0000 7f9c181d2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c100b26f0 con 0x7f9c100b39f0 2023-07-21T22:19:46.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.303+0000 7f9c1576d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c10145430 0x7f9c100b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:46.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.303+0000 7f9c1576d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9c10145430 0x7f9c100b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39856/0 (socket says 172.21.15.6:39856) 2023-07-21T22:19:46.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.303+0000 7f9c1576d640 1 -- 172.21.15.6:0/2327958519 learned_addr learned my addr 172.21.15.6:0/2327958519 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:46.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.303+0000 7f9c1676f640 1 --2- 172.21.15.6:0/2327958519 >> v2:172.21.15.161:3300/0 conn(0x7f9c100b39f0 0x7f9c100d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:46.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.303+0000 7f9c1576d640 1 -- 172.21.15.6:0/2327958519 >> v2:172.21.15.161:3300/0 conn(0x7f9c100b39f0 msgr2=0x7f9c100d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:46.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.303+0000 7f9c1576d640 1 --2- 172.21.15.6:0/2327958519 >> v2:172.21.15.161:3300/0 conn(0x7f9c100b39f0 0x7f9c100d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.303+0000 7f9c1576d640 1 -- 172.21.15.6:0/2327958519 >> v1:172.21.15.161:6789/0 conn(0x7f9c100d06b0 legacy=0x7f9c100b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:46.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.303+0000 7f9c1576d640 1 -- 172.21.15.6:0/2327958519 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c100b29d0 con 0x7f9c10145430 2023-07-21T22:19:46.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.307+0000 7f9c1576d640 1 --2- 172.21.15.6:0/2327958519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c10145430 0x7f9c100b34b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9c1008cb00 tx=0x7f9c0001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf92de4a284350a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:46.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.307+0000 7f9c14f6c640 1 -- 172.21.15.6:0/2327958519 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c000ac600 con 0x7f9c10145430 2023-07-21T22:19:46.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.307+0000 7f9c14f6c640 1 -- 172.21.15.6:0/2327958519 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c000a8050 con 0x7f9c10145430 2023-07-21T22:19:46.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.307+0000 7f9c14f6c640 1 -- 172.21.15.6:0/2327958519 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c000ac980 con 0x7f9c10145430 2023-07-21T22:19:46.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.307+0000 7f9c181d2640 1 -- 172.21.15.6:0/2327958519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c10145430 msgr2=0x7f9c100b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:46.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.307+0000 7f9c181d2640 1 --2- 172.21.15.6:0/2327958519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c10145430 0x7f9c100b34b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9c1008cb00 tx=0x7f9c0001c490 comp rx=0 tx=0).stop 2023-07-21T22:19:46.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.307+0000 7f9c181d2640 1 -- 172.21.15.6:0/2327958519 shutdown_connections 2023-07-21T22:19:46.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.307+0000 7f9c181d2640 1 --2- 172.21.15.6:0/2327958519 >> v2:172.21.15.161:3300/0 conn(0x7f9c100b39f0 0x7f9c100d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.307+0000 7f9c181d2640 1 --2- 172.21.15.6:0/2327958519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c10145430 0x7f9c100b34b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.307+0000 7f9c181d2640 1 -- 172.21.15.6:0/2327958519 >> 172.21.15.6:0/2327958519 conn(0x7f9c100659d0 msgr2=0x7f9c1009b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:46.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.307+0000 7f9c181d2640 1 -- 172.21.15.6:0/2327958519 shutdown_connections 2023-07-21T22:19:46.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.307+0000 7f9c181d2640 1 -- 172.21.15.6:0/2327958519 wait complete. 2023-07-21T22:19:46.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.307+0000 7f9c181d2640 1 Processor -- start 2023-07-21T22:19:46.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c181d2640 1 -- start start 2023-07-21T22:19:46.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c181d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c100b39f0 0x7f9c100b7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:46.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c181d2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c100d06b0 0x7f9c10154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:46.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c181d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c100b5180 0x7f9c10155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:46.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c181d2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100caf10 con 0x7f9c100b5180 2023-07-21T22:19:46.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c181d2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100c9a10 con 0x7f9c100d06b0 2023-07-21T22:19:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c181d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100cb4b0 con 0x7f9c100b39f0 2023-07-21T22:19:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c1676f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c100b5180 0x7f9c10155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c1676f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c100b5180 0x7f9c10155990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39870/0 (socket says 172.21.15.6:39870) 2023-07-21T22:19:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c1676f640 1 -- 172.21.15.6:0/1109025259 learned_addr learned my addr 172.21.15.6:0/1109025259 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c15f6e640 1 --2- 172.21.15.6:0/1109025259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c100b39f0 0x7f9c100b7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c1576d640 1 --2- 172.21.15.6:0/1109025259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c100d06b0 0x7f9c10154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:46.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c1676f640 1 -- 172.21.15.6:0/1109025259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c100b39f0 msgr2=0x7f9c100b7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:46.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c1676f640 1 --2- 172.21.15.6:0/1109025259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c100b39f0 0x7f9c100b7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c1676f640 1 -- 172.21.15.6:0/1109025259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c100d06b0 msgr2=0x7f9c10154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:46.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c1676f640 1 --2- 172.21.15.6:0/1109025259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c100d06b0 0x7f9c10154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c1676f640 1 -- 172.21.15.6:0/1109025259 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c000094d0 con 0x7f9c100b5180 2023-07-21T22:19:46.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c1576d640 1 --2- 172.21.15.6:0/1109025259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c100d06b0 0x7f9c10154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:46.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c15f6e640 1 --2- 172.21.15.6:0/1109025259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c100b39f0 0x7f9c100b7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:46.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c1676f640 1 --2- 172.21.15.6:0/1109025259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c100b5180 0x7f9c10155990 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009fd0 tx=0x7f9c0800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:46.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c067fc640 1 -- 172.21.15.6:0/1109025259 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08014420 con 0x7f9c100b5180 2023-07-21T22:19:46.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c067fc640 1 -- 172.21.15.6:0/1109025259 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c08014580 con 0x7f9c100b5180 2023-07-21T22:19:46.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c067fc640 1 -- 172.21.15.6:0/1109025259 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c08014930 con 0x7f9c100b5180 2023-07-21T22:19:46.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c181d2640 1 -- 172.21.15.6:0/1109025259 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c100c94c0 con 0x7f9c100b5180 2023-07-21T22:19:46.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c181d2640 1 -- 172.21.15.6:0/1109025259 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c100cb140 con 0x7f9c100b5180 2023-07-21T22:19:46.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.311+0000 7f9c181d2640 1 -- 172.21.15.6:0/1109025259 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c10072e70 con 0x7f9c100b5180 2023-07-21T22:19:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.315+0000 7f9c067fc640 1 -- 172.21.15.6:0/1109025259 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9c08014a90 con 0x7f9c100b5180 2023-07-21T22:19:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.315+0000 7f9c067fc640 1 --2- 172.21.15.6:0/1109025259 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9bf40662b0 0x7f9bf4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.315+0000 7f9c067fc640 1 -- 172.21.15.6:0/1109025259 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9c08084630 con 0x7f9c100b5180 2023-07-21T22:19:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.315+0000 7f9c15f6e640 1 --2- 172.21.15.6:0/1109025259 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9bf40662b0 0x7f9bf4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:46.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.315+0000 7f9c15f6e640 1 --2- 172.21.15.6:0/1109025259 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9bf40662b0 0x7f9bf4068760 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9c1015ce40 tx=0x7f9c0c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:46.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.319+0000 7f9c067fc640 1 -- 172.21.15.6:0/1109025259 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9c08055530 con 0x7f9c100b5180 2023-07-21T22:19:46.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.475+0000 7f9c181d2640 1 -- 172.21.15.6:0/1109025259 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c100cb620 con 0x7f9c100b5180 2023-07-21T22:19:46.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.475+0000 7f9c067fc640 1 -- 172.21.15.6:0/1109025259 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18292 (secure 0 0 0) 0x7f9c080550c0 con 0x7f9c100b5180 2023-07-21T22:19:46.524 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:46.524 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":38,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:19:45.163088+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:19:43.286760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-21T22:19:44.152686+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:19:46.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.479+0000 7f9c181d2640 1 -- 172.21.15.6:0/1109025259 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9bf40662b0 msgr2=0x7f9bf4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:46.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.479+0000 7f9c181d2640 1 --2- 172.21.15.6:0/1109025259 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9bf40662b0 0x7f9bf4068760 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9c1015ce40 tx=0x7f9c0c009040 comp rx=0 tx=0).stop 2023-07-21T22:19:46.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.479+0000 7f9c181d2640 1 -- 172.21.15.6:0/1109025259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c100b5180 msgr2=0x7f9c10155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:46.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.479+0000 7f9c181d2640 1 --2- 172.21.15.6:0/1109025259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c100b5180 0x7f9c10155990 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9c08009fd0 tx=0x7f9c0800e4b0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.479+0000 7f9c181d2640 1 -- 172.21.15.6:0/1109025259 shutdown_connections 2023-07-21T22:19:46.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.479+0000 7f9c181d2640 1 --2- 172.21.15.6:0/1109025259 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f9bf40662b0 0x7f9bf4068760 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.479+0000 7f9c181d2640 1 --2- 172.21.15.6:0/1109025259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c100b5180 0x7f9c10155990 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.479+0000 7f9c181d2640 1 --2- 172.21.15.6:0/1109025259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9c100d06b0 0x7f9c10154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.479+0000 7f9c181d2640 1 --2- 172.21.15.6:0/1109025259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9c100b39f0 0x7f9c100b7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.479+0000 7f9c181d2640 1 -- 172.21.15.6:0/1109025259 >> 172.21.15.6:0/1109025259 conn(0x7f9c100659d0 msgr2=0x7f9c1015fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:46.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.479+0000 7f9c181d2640 1 -- 172.21.15.6:0/1109025259 shutdown_connections 2023-07-21T22:19:46.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.479+0000 7f9c181d2640 1 -- 172.21.15.6:0/1109025259 wait complete. 2023-07-21T22:19:46.545 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-21T22:19:46.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.643+0000 7f052f59e640 1 Processor -- start 2023-07-21T22:19:46.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.643+0000 7f052f59e640 1 -- start start 2023-07-21T22:19:46.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.647+0000 7f052f59e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f05300b1620 0x7f05300ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:46.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.647+0000 7f052f59e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05300cf430 con 0x7f0530160750 2023-07-21T22:19:46.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.647+0000 7f052f59e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f053015fc70 con 0x7f05300cc960 2023-07-21T22:19:46.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.647+0000 7f052f59e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05300cf710 con 0x7f05300b1620 2023-07-21T22:19:46.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.647+0000 7f052dd9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f05300b1620 0x7f05300ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:46.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.647+0000 7f052dd9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f05300b1620 0x7f05300ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39884/0 (socket says 172.21.15.6:39884) 2023-07-21T22:19:46.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.647+0000 7f052dd9b640 1 -- 172.21.15.6:0/1747993629 learned_addr learned my addr 172.21.15.6:0/1747993629 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:46.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.647+0000 7f052dd9b640 1 -- 172.21.15.6:0/1747993629 >> v1:172.21.15.161:6789/0 conn(0x7f05300cc960 legacy=0x7f05300ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:46.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.647+0000 7f052dd9b640 1 -- 172.21.15.6:0/1747993629 >> v1:172.21.15.6:6789/0 conn(0x7f0530160750 legacy=0x7f053015c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:46.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.647+0000 7f052dd9b640 1 -- 172.21.15.6:0/1747993629 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053015ff50 con 0x7f05300b1620 2023-07-21T22:19:46.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.647+0000 7f052d59a640 1 -- 172.21.15.6:0/1747993629 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653671774 0 0) 0x7f05300cf430 con 0x7f0530160750 2023-07-21T22:19:46.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.647+0000 7f052dd9b640 1 --2- 172.21.15.6:0/1747993629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05300b1620 0x7f05300ce950 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0524009870 tx=0x7f052401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bac6f8abcecbd38 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:46.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.651+0000 7f052d59a640 1 -- 172.21.15.6:0/1747993629 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05240aa650 con 0x7f05300b1620 2023-07-21T22:19:46.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.651+0000 7f052d59a640 1 -- 172.21.15.6:0/1747993629 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05240aa7b0 con 0x7f05300b1620 2023-07-21T22:19:46.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.651+0000 7f052d59a640 1 -- 172.21.15.6:0/1747993629 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05240aab40 con 0x7f05300b1620 2023-07-21T22:19:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.651+0000 7f052f59e640 1 -- 172.21.15.6:0/1747993629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05300b1620 msgr2=0x7f05300ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.651+0000 7f052f59e640 1 --2- 172.21.15.6:0/1747993629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05300b1620 0x7f05300ce950 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0524009870 tx=0x7f052401c4d0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.651+0000 7f052f59e640 1 -- 172.21.15.6:0/1747993629 shutdown_connections 2023-07-21T22:19:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.651+0000 7f052f59e640 1 --2- 172.21.15.6:0/1747993629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05300b1620 0x7f05300ce950 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.651+0000 7f052f59e640 1 -- 172.21.15.6:0/1747993629 >> 172.21.15.6:0/1747993629 conn(0x7f0530069f50 msgr2=0x7f053006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:46.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.651+0000 7f052f59e640 1 -- 172.21.15.6:0/1747993629 shutdown_connections 2023-07-21T22:19:46.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.651+0000 7f052f59e640 1 -- 172.21.15.6:0/1747993629 wait complete. 2023-07-21T22:19:46.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.651+0000 7f052f59e640 1 Processor -- start 2023-07-21T22:19:46.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.651+0000 7f052f59e640 1 -- start start 2023-07-21T22:19:46.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.651+0000 7f052f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05300b1620 0x7f05300cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:46.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.651+0000 7f052f59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05300cc960 0x7f05300b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:46.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f052f59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0530160750 0x7f0530153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:46.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f052f59e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05300c5cf0 con 0x7f05300b1620 2023-07-21T22:19:46.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f052f59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05300cc550 con 0x7f05300cc960 2023-07-21T22:19:46.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f052f59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05300c5ed0 con 0x7f0530160750 2023-07-21T22:19:46.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f052e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05300b1620 0x7f05300cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:46.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f052e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05300b1620 0x7f05300cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39892/0 (socket says 172.21.15.6:39892) 2023-07-21T22:19:46.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f052e59c640 1 -- 172.21.15.6:0/3606392043 learned_addr learned my addr 172.21.15.6:0/3606392043 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:46.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f052dd9b640 1 --2- 172.21.15.6:0/3606392043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05300cc960 0x7f05300b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:46.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f052ed9d640 1 --2- 172.21.15.6:0/3606392043 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0530160750 0x7f0530153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:46.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f052e59c640 1 -- 172.21.15.6:0/3606392043 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0530160750 msgr2=0x7f0530153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:46.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f052e59c640 1 --2- 172.21.15.6:0/3606392043 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0530160750 0x7f0530153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f052e59c640 1 -- 172.21.15.6:0/3606392043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05300cc960 msgr2=0x7f05300b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:46.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f052e59c640 1 --2- 172.21.15.6:0/3606392043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05300cc960 0x7f05300b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f052e59c640 1 -- 172.21.15.6:0/3606392043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05240094d0 con 0x7f05300b1620 2023-07-21T22:19:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f052ed9d640 1 --2- 172.21.15.6:0/3606392043 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0530160750 0x7f0530153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f052e59c640 1 --2- 172.21.15.6:0/3606392043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05300b1620 0x7f05300cc010 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f052000c450 tx=0x7f052000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f051effd640 1 -- 172.21.15.6:0/3606392043 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0520012830 con 0x7f05300b1620 2023-07-21T22:19:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f051effd640 1 -- 172.21.15.6:0/3606392043 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05200129b0 con 0x7f05300b1620 2023-07-21T22:19:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f051effd640 1 -- 172.21.15.6:0/3606392043 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0520012d60 con 0x7f05300b1620 2023-07-21T22:19:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f052f59e640 1 -- 172.21.15.6:0/3606392043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05300c61b0 con 0x7f05300b1620 2023-07-21T22:19:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f052f59e640 1 -- 172.21.15.6:0/3606392043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05300c6770 con 0x7f05300b1620 2023-07-21T22:19:46.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f052f59e640 1 -- 172.21.15.6:0/3606392043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05300b19f0 con 0x7f05300b1620 2023-07-21T22:19:46.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.655+0000 7f051effd640 1 -- 172.21.15.6:0/3606392043 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f052001c460 con 0x7f05300b1620 2023-07-21T22:19:46.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.659+0000 7f051effd640 1 --2- 172.21.15.6:0/3606392043 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f05100662b0 0x7f0510068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:46.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.659+0000 7f051effd640 1 -- 172.21.15.6:0/3606392043 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0520083c20 con 0x7f05300b1620 2023-07-21T22:19:46.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.659+0000 7f052dd9b640 1 --2- 172.21.15.6:0/3606392043 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f05100662b0 0x7f0510068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:46.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.659+0000 7f052dd9b640 1 --2- 172.21.15.6:0/3606392043 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f05100662b0 0x7f0510068760 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f05240ae000 tx=0x7f05240a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:46.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.663+0000 7f051effd640 1 -- 172.21.15.6:0/3606392043 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05300b19f0 con 0x7f05300b1620 2023-07-21T22:19:46.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:46.855+0000 7f052f59e640 1 -- 172.21.15.6:0/3606392043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f05300b19f0 con 0x7f05300b1620 2023-07-21T22:19:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.795+0000 7f051effd640 1 -- 172.21.15.6:0/3606392043 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f05300b19f0 con 0x7f05300b1620 2023-07-21T22:19:47.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.795+0000 7f052f59e640 1 -- 172.21.15.6:0/3606392043 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f05100662b0 msgr2=0x7f0510068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.795+0000 7f052f59e640 1 --2- 172.21.15.6:0/3606392043 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f05100662b0 0x7f0510068760 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f05240ae000 tx=0x7f05240a7000 comp rx=0 tx=0).stop 2023-07-21T22:19:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.795+0000 7f052f59e640 1 -- 172.21.15.6:0/3606392043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05300b1620 msgr2=0x7f05300cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.795+0000 7f052f59e640 1 --2- 172.21.15.6:0/3606392043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05300b1620 0x7f05300cc010 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f052000c450 tx=0x7f052000c910 comp rx=0 tx=0).stop 2023-07-21T22:19:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.795+0000 7f052f59e640 1 -- 172.21.15.6:0/3606392043 shutdown_connections 2023-07-21T22:19:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.795+0000 7f052f59e640 1 --2- 172.21.15.6:0/3606392043 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0530160750 0x7f0530153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.795+0000 7f052f59e640 1 --2- 172.21.15.6:0/3606392043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05300cc960 0x7f05300b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.795+0000 7f052f59e640 1 --2- 172.21.15.6:0/3606392043 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f05100662b0 0x7f0510068760 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.795+0000 7f052f59e640 1 --2- 172.21.15.6:0/3606392043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05300b1620 0x7f05300cc010 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.795+0000 7f052f59e640 1 -- 172.21.15.6:0/3606392043 >> 172.21.15.6:0/3606392043 conn(0x7f0530069f50 msgr2=0x7f05300b6450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.795+0000 7f052f59e640 1 -- 172.21.15.6:0/3606392043 shutdown_connections 2023-07-21T22:19:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.795+0000 7f052f59e640 1 -- 172.21.15.6:0/3606392043 wait complete. 2023-07-21T22:19:47.867 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-21T22:19:47.868 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-21T22:19:48.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.971+0000 7f989ee93640 1 Processor -- start 2023-07-21T22:19:48.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.971+0000 7f989ee93640 1 -- start start 2023-07-21T22:19:48.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.971+0000 7f989ee93640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f989815bde0 0x7f98980d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:48.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.971+0000 7f989ee93640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f98980d2300 0x7f98980d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:48.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.971+0000 7f989ee93640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98980b04c0 con 0x7f98980d2fc0 2023-07-21T22:19:48.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.971+0000 7f989ee93640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989815c1b0 con 0x7f989815bde0 2023-07-21T22:19:48.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.971+0000 7f989ee93640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98980b1060 con 0x7f98980d2300 2023-07-21T22:19:48.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.971+0000 7f989cc2f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f989815bde0 0x7f98980d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:48.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.971+0000 7f989cc2f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f989815bde0 0x7f98980d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48074/0 (socket says 172.21.15.6:48074) 2023-07-21T22:19:48.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.971+0000 7f989cc2f640 1 -- 172.21.15.6:0/1285805455 learned_addr learned my addr 172.21.15.6:0/1285805455 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:48.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.971+0000 7f9897fff640 1 --1- 172.21.15.6:0/1285805455 >> v1:172.21.15.6:6789/0 conn(0x7f98980d2fc0 0x7f98980b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33846/0 (socket says 172.21.15.6:33846) 2023-07-21T22:19:48.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.971+0000 7f989cc2f640 1 -- 172.21.15.6:0/1285805455 >> v2:172.21.15.161:3300/0 conn(0x7f98980d2300 msgr2=0x7f98980d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:48.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.971+0000 7f989cc2f640 1 --2- 172.21.15.6:0/1285805455 >> v2:172.21.15.161:3300/0 conn(0x7f98980d2300 0x7f98980d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:48.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.971+0000 7f989cc2f640 1 -- 172.21.15.6:0/1285805455 >> v1:172.21.15.6:6789/0 conn(0x7f98980d2fc0 legacy=0x7f98980b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:48.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.971+0000 7f989cc2f640 1 -- 172.21.15.6:0/1285805455 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98980d2c80 con 0x7f989815bde0 2023-07-21T22:19:48.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.971+0000 7f98977fe640 1 -- 172.21.15.6:0/1285805455 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066715617 0 0) 0x7f98980b04c0 con 0x7f98980d2fc0 2023-07-21T22:19:48.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.975+0000 7f989cc2f640 1 --2- 172.21.15.6:0/1285805455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f989815bde0 0x7f98980d0270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f989808c820 tx=0x7f988c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96fe87a5e53b4e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:48.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.975+0000 7f98977fe640 1 -- 172.21.15.6:0/1285805455 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c0ab610 con 0x7f989815bde0 2023-07-21T22:19:48.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.975+0000 7f98977fe640 1 -- 172.21.15.6:0/1285805455 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988c0ab770 con 0x7f989815bde0 2023-07-21T22:19:48.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.975+0000 7f98977fe640 1 -- 172.21.15.6:0/1285805455 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c0abb00 con 0x7f989815bde0 2023-07-21T22:19:48.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.975+0000 7f989ee93640 1 -- 172.21.15.6:0/1285805455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f989815bde0 msgr2=0x7f98980d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:48.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.975+0000 7f989ee93640 1 --2- 172.21.15.6:0/1285805455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f989815bde0 0x7f98980d0270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f989808c820 tx=0x7f988c01c500 comp rx=0 tx=0).stop 2023-07-21T22:19:48.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.975+0000 7f989ee93640 1 -- 172.21.15.6:0/1285805455 shutdown_connections 2023-07-21T22:19:48.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.975+0000 7f989ee93640 1 --2- 172.21.15.6:0/1285805455 >> v2:172.21.15.161:3300/0 conn(0x7f98980d2300 0x7f98980d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:48.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.975+0000 7f989ee93640 1 --2- 172.21.15.6:0/1285805455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f989815bde0 0x7f98980d0270 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:48.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.975+0000 7f989ee93640 1 -- 172.21.15.6:0/1285805455 >> 172.21.15.6:0/1285805455 conn(0x7f98980659d0 msgr2=0x7f989809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:48.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.975+0000 7f989ee93640 1 -- 172.21.15.6:0/1285805455 shutdown_connections 2023-07-21T22:19:48.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.975+0000 7f989ee93640 1 -- 172.21.15.6:0/1285805455 wait complete. 2023-07-21T22:19:48.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f989ee93640 1 Processor -- start 2023-07-21T22:19:48.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f989ee93640 1 -- start start 2023-07-21T22:19:48.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f989ee93640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98980d2300 0x7f989815ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f989ee93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98980d2fc0 0x7f98980b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f989ee93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f989815bde0 0x7f98980b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f989ee93640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98980b1b00 con 0x7f989815bde0 2023-07-21T22:19:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f989ee93640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98980b11a0 con 0x7f98980d2300 2023-07-21T22:19:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f989ee93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989815f000 con 0x7f98980d2fc0 2023-07-21T22:19:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f989d430640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f989815bde0 0x7f98980b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:48.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f989d430640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f989815bde0 0x7f98980b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48078/0 (socket says 172.21.15.6:48078) 2023-07-21T22:19:48.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f989d430640 1 -- 172.21.15.6:0/95161002 learned_addr learned my addr 172.21.15.6:0/95161002 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:48.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f9897fff640 1 --2- 172.21.15.6:0/95161002 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98980d2fc0 0x7f98980b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:48.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f989cc2f640 1 --2- 172.21.15.6:0/95161002 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98980d2300 0x7f989815ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:48.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f989d430640 1 -- 172.21.15.6:0/95161002 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98980d2fc0 msgr2=0x7f98980b2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:48.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f989d430640 1 --2- 172.21.15.6:0/95161002 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98980d2fc0 0x7f98980b2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:48.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f989d430640 1 -- 172.21.15.6:0/95161002 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98980d2300 msgr2=0x7f989815ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:48.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f989d430640 1 --2- 172.21.15.6:0/95161002 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98980d2300 0x7f989815ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:48.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f989d430640 1 -- 172.21.15.6:0/95161002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c009480 con 0x7f989815bde0 2023-07-21T22:19:48.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f989d430640 1 --2- 172.21.15.6:0/95161002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f989815bde0 0x7f98980b1f20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f989000b970 tx=0x7f989000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:48.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f98957fa640 1 -- 172.21.15.6:0/95161002 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989000cb40 con 0x7f989815bde0 2023-07-21T22:19:48.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f98957fa640 1 -- 172.21.15.6:0/95161002 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989000ccc0 con 0x7f989815bde0 2023-07-21T22:19:48.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f989ee93640 1 -- 172.21.15.6:0/95161002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98980b1440 con 0x7f989815bde0 2023-07-21T22:19:48.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f98957fa640 1 -- 172.21.15.6:0/95161002 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890014680 con 0x7f989815bde0 2023-07-21T22:19:48.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.979+0000 7f989ee93640 1 -- 172.21.15.6:0/95161002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98980b2460 con 0x7f989815bde0 2023-07-21T22:19:48.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.983+0000 7f989ee93640 1 -- 172.21.15.6:0/95161002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98980b1c40 con 0x7f989815bde0 2023-07-21T22:19:48.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.983+0000 7f98957fa640 1 -- 172.21.15.6:0/95161002 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f989001d3b0 con 0x7f989815bde0 2023-07-21T22:19:48.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.983+0000 7f98957fa640 1 --2- 172.21.15.6:0/95161002 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f987c066280 0x7f987c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:48.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.983+0000 7f98957fa640 1 -- 172.21.15.6:0/95161002 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9890083d20 con 0x7f989815bde0 2023-07-21T22:19:48.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.983+0000 7f989cc2f640 1 --2- 172.21.15.6:0/95161002 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f987c066280 0x7f987c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:48.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.983+0000 7f989cc2f640 1 --2- 172.21.15.6:0/95161002 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f987c066280 0x7f987c068730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f988c0af000 tx=0x7f988c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:48.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:47.987+0000 7f98957fa640 1 -- 172.21.15.6:0/95161002 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f98980b1c40 con 0x7f989815bde0 2023-07-21T22:19:48.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.175+0000 7f989ee93640 1 -- 172.21.15.6:0/95161002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f98980b1c40 con 0x7f989815bde0 2023-07-21T22:19:48.745 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-07-21T22:19:48.699+0000 7fa6303f6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:19:48.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.799+0000 7f98957fa640 1 -- 172.21.15.6:0/95161002 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f98980b1c40 con 0x7f989815bde0 2023-07-21T22:19:48.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.799+0000 7f989ee93640 1 -- 172.21.15.6:0/95161002 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f987c066280 msgr2=0x7f987c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:48.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.799+0000 7f989ee93640 1 --2- 172.21.15.6:0/95161002 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f987c066280 0x7f987c068730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f988c0af000 tx=0x7f988c0a7000 comp rx=0 tx=0).stop 2023-07-21T22:19:48.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.799+0000 7f989ee93640 1 -- 172.21.15.6:0/95161002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f989815bde0 msgr2=0x7f98980b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:48.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.799+0000 7f989ee93640 1 --2- 172.21.15.6:0/95161002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f989815bde0 0x7f98980b1f20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f989000b970 tx=0x7f989000be30 comp rx=0 tx=0).stop 2023-07-21T22:19:48.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.799+0000 7f989ee93640 1 -- 172.21.15.6:0/95161002 shutdown_connections 2023-07-21T22:19:48.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.799+0000 7f989ee93640 1 --2- 172.21.15.6:0/95161002 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f987c066280 0x7f987c068730 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:48.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.799+0000 7f989ee93640 1 --2- 172.21.15.6:0/95161002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f989815bde0 0x7f98980b1f20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:48.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.799+0000 7f989ee93640 1 --2- 172.21.15.6:0/95161002 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98980d2fc0 0x7f98980b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:48.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.799+0000 7f989ee93640 1 --2- 172.21.15.6:0/95161002 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98980d2300 0x7f989815ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:48.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.799+0000 7f989ee93640 1 -- 172.21.15.6:0/95161002 >> 172.21.15.6:0/95161002 conn(0x7f98980659d0 msgr2=0x7f989806afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:48.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.799+0000 7f989ee93640 1 -- 172.21.15.6:0/95161002 shutdown_connections 2023-07-21T22:19:48.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.799+0000 7f989ee93640 1 -- 172.21.15.6:0/95161002 wait complete. 2023-07-21T22:19:48.873 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-21T22:19:48.874 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:19:49.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.975+0000 7ff8f640b640 1 Processor -- start 2023-07-21T22:19:49.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.975+0000 7ff8f640b640 1 -- start start 2023-07-21T22:19:49.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.979+0000 7ff8f640b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff8f0070b70 0x7ff8f0070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:49.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.979+0000 7ff8f640b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff8f006b1e0 0x7ff8f00c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:49.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.979+0000 7ff8f640b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f00cac70 con 0x7ff8f00c21f0 2023-07-21T22:19:49.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.979+0000 7ff8f640b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f0071480 con 0x7ff8f0070b70 2023-07-21T22:19:49.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.979+0000 7ff8f640b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f00ca060 con 0x7ff8f006b1e0 2023-07-21T22:19:49.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.979+0000 7ff8effff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff8f0070b70 0x7ff8f0070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:49.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.979+0000 7ff8effff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff8f0070b70 0x7ff8f0070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48082/0 (socket says 172.21.15.6:48082) 2023-07-21T22:19:49.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.979+0000 7ff8effff640 1 -- 172.21.15.6:0/2628553973 learned_addr learned my addr 172.21.15.6:0/2628553973 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:49.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.979+0000 7ff8ef7fe640 1 --2- 172.21.15.6:0/2628553973 >> v2:172.21.15.161:3300/0 conn(0x7ff8f006b1e0 0x7ff8f00c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:49.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.979+0000 7ff8effff640 1 -- 172.21.15.6:0/2628553973 >> v2:172.21.15.161:3300/0 conn(0x7ff8f006b1e0 msgr2=0x7ff8f00c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:49.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.979+0000 7ff8effff640 1 --2- 172.21.15.6:0/2628553973 >> v2:172.21.15.161:3300/0 conn(0x7ff8f006b1e0 0x7ff8f00c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.979+0000 7ff8effff640 1 -- 172.21.15.6:0/2628553973 >> v1:172.21.15.161:6789/0 conn(0x7ff8f00c21f0 legacy=0x7ff8f00cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:49.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.979+0000 7ff8effff640 1 -- 172.21.15.6:0/2628553973 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f00ca340 con 0x7ff8f0070b70 2023-07-21T22:19:49.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.983+0000 7ff8effff640 1 --2- 172.21.15.6:0/2628553973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f0070b70 0x7ff8f0070f40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff8f006f380 tx=0x7ff8e001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ee4c4a5bee946c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:49.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.983+0000 7ff8eeffd640 1 -- 172.21.15.6:0/2628553973 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e00aa5f0 con 0x7ff8f0070b70 2023-07-21T22:19:49.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.983+0000 7ff8eeffd640 1 -- 172.21.15.6:0/2628553973 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e00aa750 con 0x7ff8f0070b70 2023-07-21T22:19:49.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.983+0000 7ff8eeffd640 1 -- 172.21.15.6:0/2628553973 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e00aaae0 con 0x7ff8f0070b70 2023-07-21T22:19:49.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.983+0000 7ff8f640b640 1 -- 172.21.15.6:0/2628553973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f0070b70 msgr2=0x7ff8f0070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:49.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.983+0000 7ff8f640b640 1 --2- 172.21.15.6:0/2628553973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f0070b70 0x7ff8f0070f40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff8f006f380 tx=0x7ff8e001c490 comp rx=0 tx=0).stop 2023-07-21T22:19:49.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.983+0000 7ff8f640b640 1 -- 172.21.15.6:0/2628553973 shutdown_connections 2023-07-21T22:19:49.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.983+0000 7ff8f640b640 1 --2- 172.21.15.6:0/2628553973 >> v2:172.21.15.161:3300/0 conn(0x7ff8f006b1e0 0x7ff8f00c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.983+0000 7ff8f640b640 1 --2- 172.21.15.6:0/2628553973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f0070b70 0x7ff8f0070f40 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.983+0000 7ff8f640b640 1 -- 172.21.15.6:0/2628553973 >> 172.21.15.6:0/2628553973 conn(0x7ff8f00afcf0 msgr2=0x7ff8f00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:49.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.983+0000 7ff8f640b640 1 -- 172.21.15.6:0/2628553973 shutdown_connections 2023-07-21T22:19:49.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.983+0000 7ff8f640b640 1 -- 172.21.15.6:0/2628553973 wait complete. 2023-07-21T22:19:49.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.983+0000 7ff8f640b640 1 Processor -- start 2023-07-21T22:19:49.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.983+0000 7ff8f640b640 1 -- start start 2023-07-21T22:19:49.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.983+0000 7ff8f640b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8f006b1e0 0x7ff8f0155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:49.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.983+0000 7ff8f640b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8f0070b70 0x7ff8f0150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:49.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.983+0000 7ff8f640b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f00c21f0 0x7ff8f00b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:49.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.983+0000 7ff8f640b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f0151980 con 0x7ff8f00c21f0 2023-07-21T22:19:49.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.983+0000 7ff8f640b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f0150d70 con 0x7ff8f0070b70 2023-07-21T22:19:49.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.983+0000 7ff8f640b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f0151050 con 0x7ff8f006b1e0 2023-07-21T22:19:49.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.987+0000 7ff8f49a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f00c21f0 0x7ff8f00b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:49.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.987+0000 7ff8f49a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f00c21f0 0x7ff8f00b1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48090/0 (socket says 172.21.15.6:48090) 2023-07-21T22:19:49.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.987+0000 7ff8f49a8640 1 -- 172.21.15.6:0/1553816166 learned_addr learned my addr 172.21.15.6:0/1553816166 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:49.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.987+0000 7ff8ef7fe640 1 --2- 172.21.15.6:0/1553816166 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8f0070b70 0x7ff8f0150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:49.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.987+0000 7ff8effff640 1 --2- 172.21.15.6:0/1553816166 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8f006b1e0 0x7ff8f0155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:49.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.987+0000 7ff8f49a8640 1 -- 172.21.15.6:0/1553816166 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8f006b1e0 msgr2=0x7ff8f0155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:49.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.987+0000 7ff8f49a8640 1 --2- 172.21.15.6:0/1553816166 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8f006b1e0 0x7ff8f0155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.987+0000 7ff8f49a8640 1 -- 172.21.15.6:0/1553816166 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8f0070b70 msgr2=0x7ff8f0150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:49.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.987+0000 7ff8f49a8640 1 --2- 172.21.15.6:0/1553816166 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8f0070b70 0x7ff8f0150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.987+0000 7ff8f49a8640 1 -- 172.21.15.6:0/1553816166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e00094d0 con 0x7ff8f00c21f0 2023-07-21T22:19:49.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.987+0000 7ff8f49a8640 1 --2- 172.21.15.6:0/1553816166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f00c21f0 0x7ff8f00b1650 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800c780 tx=0x7ff8e800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:49.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.987+0000 7ff8ecff9640 1 -- 172.21.15.6:0/1553816166 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e800a9f0 con 0x7ff8f00c21f0 2023-07-21T22:19:49.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.987+0000 7ff8ecff9640 1 -- 172.21.15.6:0/1553816166 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e800ce90 con 0x7ff8f00c21f0 2023-07-21T22:19:49.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.987+0000 7ff8ecff9640 1 -- 172.21.15.6:0/1553816166 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e800add0 con 0x7ff8f00c21f0 2023-07-21T22:19:49.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.987+0000 7ff8f640b640 1 -- 172.21.15.6:0/1553816166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f0151330 con 0x7ff8f00c21f0 2023-07-21T22:19:49.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.987+0000 7ff8f640b640 1 -- 172.21.15.6:0/1553816166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f0150670 con 0x7ff8f00c21f0 2023-07-21T22:19:49.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.987+0000 7ff8f640b640 1 -- 172.21.15.6:0/1553816166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f00678d0 con 0x7ff8f00c21f0 2023-07-21T22:19:49.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.987+0000 7ff8ecff9640 1 -- 172.21.15.6:0/1553816166 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff8e8012420 con 0x7ff8f00c21f0 2023-07-21T22:19:49.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.991+0000 7ff8ecff9640 1 --2- 172.21.15.6:0/1553816166 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff8dc066280 0x7ff8dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:49.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.991+0000 7ff8ecff9640 1 -- 172.21.15.6:0/1553816166 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff8e8083dd0 con 0x7ff8f00c21f0 2023-07-21T22:19:49.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.991+0000 7ff8effff640 1 --2- 172.21.15.6:0/1553816166 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff8dc066280 0x7ff8dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:49.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.991+0000 7ff8effff640 1 --2- 172.21.15.6:0/1553816166 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff8dc066280 0x7ff8dc068730 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00ae000 tx=0x7ff8e00b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:49.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:48.995+0000 7ff8ecff9640 1 -- 172.21.15.6:0/1553816166 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8e8051260 con 0x7ff8f00c21f0 2023-07-21T22:19:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.183+0000 7ff8f640b640 1 -- 172.21.15.6:0/1553816166 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8f00c98c0 con 0x7ff8f00c21f0 2023-07-21T22:19:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.183+0000 7ff8ecff9640 1 -- 172.21.15.6:0/1553816166 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4662 (secure 0 0 0) 0x7ff8e8016020 con 0x7ff8f00c21f0 2023-07-21T22:19:49.231 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:49.231 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4928,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3033056690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3033056690},{"type":"v1","addr":"172.21.15.161:6836","nonce":3033056690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/77801161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":77801161},{"type":"v1","addr":"172.21.15.6:6835","nonce":77801161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5152,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/558287949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":558287949},{"type":"v1","addr":"172.21.15.161:6837","nonce":558287949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:19:45.163404+0000","modified":"2023-07-21T22:19:48.796910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5181":{"gid":5181,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/2921512075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2921512075},{"type":"v1","addr":"172.21.15.6:6834","nonce":2921512075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-21T22:19:49.231 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-07-21T22:19:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.183+0000 7ff8f640b640 1 -- 172.21.15.6:0/1553816166 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff8dc066280 msgr2=0x7ff8dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:49.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.183+0000 7ff8f640b640 1 --2- 172.21.15.6:0/1553816166 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff8dc066280 0x7ff8dc068730 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff8e00ae000 tx=0x7ff8e00b5040 comp rx=0 tx=0).stop 2023-07-21T22:19:49.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.183+0000 7ff8f640b640 1 -- 172.21.15.6:0/1553816166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f00c21f0 msgr2=0x7ff8f00b1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:49.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.183+0000 7ff8f640b640 1 --2- 172.21.15.6:0/1553816166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f00c21f0 0x7ff8f00b1650 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800c780 tx=0x7ff8e800cc40 comp rx=0 tx=0).stop 2023-07-21T22:19:49.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.183+0000 7ff8f640b640 1 -- 172.21.15.6:0/1553816166 shutdown_connections 2023-07-21T22:19:49.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.183+0000 7ff8f640b640 1 --2- 172.21.15.6:0/1553816166 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff8dc066280 0x7ff8dc068730 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.183+0000 7ff8f640b640 1 --2- 172.21.15.6:0/1553816166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8f00c21f0 0x7ff8f00b1650 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.183+0000 7ff8f640b640 1 --2- 172.21.15.6:0/1553816166 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8f0070b70 0x7ff8f0150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.183+0000 7ff8f640b640 1 --2- 172.21.15.6:0/1553816166 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8f006b1e0 0x7ff8f0155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.183+0000 7ff8f640b640 1 -- 172.21.15.6:0/1553816166 >> 172.21.15.6:0/1553816166 conn(0x7ff8f00afcf0 msgr2=0x7ff8f00c2620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.183+0000 7ff8f640b640 1 -- 172.21.15.6:0/1553816166 shutdown_connections 2023-07-21T22:19:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.183+0000 7ff8f640b640 1 -- 172.21.15.6:0/1553816166 wait complete. 2023-07-21T22:19:49.252 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:19:49.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.347+0000 7fcac8e93640 1 Processor -- start 2023-07-21T22:19:49.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.347+0000 7fcac8e93640 1 -- start start 2023-07-21T22:19:49.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.347+0000 7fcac8e93640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcac4158ce0 0x7fcac4070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:49.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac8e93640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac40cc700 con 0x7fcac40c8ad0 2023-07-21T22:19:49.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac8e93640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac40b0ff0 con 0x7fcac40c9730 2023-07-21T22:19:49.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac8e93640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac4070c80 con 0x7fcac4158ce0 2023-07-21T22:19:49.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac1d9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcac40c8ad0 0x7fcac40c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33862/0 (socket says 172.21.15.6:33862) 2023-07-21T22:19:49.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac1d9b640 1 -- 172.21.15.6:0/2500244294 learned_addr learned my addr 172.21.15.6:0/2500244294 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:49.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac259c640 1 --2- 172.21.15.6:0/2500244294 >> v2:172.21.15.161:3300/0 conn(0x7fcac4158ce0 0x7fcac4070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:49.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac159a640 1 -- 172.21.15.6:0/2500244294 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313160174 0 0) 0x7fcac40cc700 con 0x7fcac40c8ad0 2023-07-21T22:19:49.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac159a640 1 -- 172.21.15.6:0/2500244294 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaac005740 con 0x7fcac40c8ad0 2023-07-21T22:19:49.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac159a640 1 -- 172.21.15.6:0/2500244294 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447716050 0 0) 0x7fcac40b0ff0 con 0x7fcac40c9730 2023-07-21T22:19:49.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac159a640 1 -- 172.21.15.6:0/2500244294 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcac40cc700 con 0x7fcac40c9730 2023-07-21T22:19:49.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac159a640 1 -- 172.21.15.6:0/2500244294 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2792704594 0 0) 0x7fcaac005740 con 0x7fcac40c8ad0 2023-07-21T22:19:49.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac159a640 1 -- 172.21.15.6:0/2500244294 >> v2:172.21.15.161:3300/0 conn(0x7fcac4158ce0 msgr2=0x7fcac4070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:49.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac159a640 1 --2- 172.21.15.6:0/2500244294 >> v2:172.21.15.161:3300/0 conn(0x7fcac4158ce0 0x7fcac4070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac159a640 1 -- 172.21.15.6:0/2500244294 >> v1:172.21.15.161:6789/0 conn(0x7fcac40c9730 legacy=0x7fcac40ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:49.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac159a640 1 -- 172.21.15.6:0/2500244294 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac40cbdd0 con 0x7fcac40c8ad0 2023-07-21T22:19:49.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac159a640 1 -- 172.21.15.6:0/2500244294 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fcab8001680 con 0x7fcac40c8ad0 2023-07-21T22:19:49.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac159a640 1 -- 172.21.15.6:0/2500244294 >> v1:172.21.15.6:6789/0 conn(0x7fcac40c8ad0 legacy=0x7fcac40c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:49.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac159a640 1 --2- 172.21.15.6:0/2500244294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaac005d20 0x7fcaac006110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:49.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac159a640 1 --2- 172.21.15.6:0/2500244294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcaac0069e0 0x7fcaac006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:49.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac159a640 1 --2- 172.21.15.6:0/2500244294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcaac007400 0x7fcaac00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:49.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac159a640 1 -- 172.21.15.6:0/2500244294 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac4070c80 con 0x7fcaac005d20 2023-07-21T22:19:49.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac159a640 1 -- 172.21.15.6:0/2500244294 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac00e340 con 0x7fcaac0069e0 2023-07-21T22:19:49.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac159a640 1 -- 172.21.15.6:0/2500244294 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac00e500 con 0x7fcaac007400 2023-07-21T22:19:49.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac259c640 1 --2- 172.21.15.6:0/2500244294 >> v2:172.21.15.161:3300/0 conn(0x7fcac4158ce0 0x7fcac4070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:49.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac259c640 1 --2- 172.21.15.6:0/2500244294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaac005d20 0x7fcaac006110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:49.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac1d9b640 1 --2- 172.21.15.6:0/2500244294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcaac0069e0 0x7fcaac006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:49.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac2d9d640 1 --2- 172.21.15.6:0/2500244294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcaac007400 0x7fcaac00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:49.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac259c640 1 -- 172.21.15.6:0/2500244294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcaac007400 msgr2=0x7fcaac00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:49.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac259c640 1 --2- 172.21.15.6:0/2500244294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcaac007400 0x7fcaac00dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac259c640 1 -- 172.21.15.6:0/2500244294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcaac0069e0 msgr2=0x7fcaac006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:49.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac259c640 1 --2- 172.21.15.6:0/2500244294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcaac0069e0 0x7fcaac006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac259c640 1 -- 172.21.15.6:0/2500244294 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac005740 con 0x7fcaac005d20 2023-07-21T22:19:49.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac1d9b640 1 --2- 172.21.15.6:0/2500244294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcaac0069e0 0x7fcaac006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:49.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.351+0000 7fcac2d9d640 1 -- 172.21.15.6:0/2500244294 reap_dead start 2023-07-21T22:19:49.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.355+0000 7fcac259c640 1 --2- 172.21.15.6:0/2500244294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaac005d20 0x7fcaac006110 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcab4009c90 tx=0x7fcab401cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662e16339eb07671 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:49.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.355+0000 7fcac159a640 1 -- 172.21.15.6:0/2500244294 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab4004020 con 0x7fcaac005d20 2023-07-21T22:19:49.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.355+0000 7fcac159a640 1 -- 172.21.15.6:0/2500244294 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab4004180 con 0x7fcaac005d20 2023-07-21T22:19:49.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.355+0000 7fcac159a640 1 -- 172.21.15.6:0/2500244294 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab40a5740 con 0x7fcaac005d20 2023-07-21T22:19:49.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.355+0000 7fcac8e93640 1 -- 172.21.15.6:0/2500244294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaac005d20 msgr2=0x7fcaac006110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:49.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.355+0000 7fcac8e93640 1 --2- 172.21.15.6:0/2500244294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaac005d20 0x7fcaac006110 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcab4009c90 tx=0x7fcab401cbc0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.355+0000 7fcac8e93640 1 -- 172.21.15.6:0/2500244294 shutdown_connections 2023-07-21T22:19:49.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.355+0000 7fcac8e93640 1 --2- 172.21.15.6:0/2500244294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcaac005d20 0x7fcaac006110 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.355+0000 7fcac8e93640 1 -- 172.21.15.6:0/2500244294 >> 172.21.15.6:0/2500244294 conn(0x7fcac40afcf0 msgr2=0x7fcac40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:49.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.355+0000 7fcac8e93640 1 -- 172.21.15.6:0/2500244294 shutdown_connections 2023-07-21T22:19:49.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.355+0000 7fcac8e93640 1 -- 172.21.15.6:0/2500244294 wait complete. 2023-07-21T22:19:49.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.355+0000 7fcac8e93640 1 Processor -- start 2023-07-21T22:19:49.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.355+0000 7fcac8e93640 1 -- start start 2023-07-21T22:19:49.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcac8e93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcaac005d20 0x7fcac40ac120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:49.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcac8e93640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcac40ce080 0x7fcac40ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:49.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcac8e93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac41471c0 0x7fcac4147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:49.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcac8e93640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac40cea30 con 0x7fcac41471c0 2023-07-21T22:19:49.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcac8e93640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac40ac700 con 0x7fcac40ce080 2023-07-21T22:19:49.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcac8e93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac40ac9e0 con 0x7fcaac005d20 2023-07-21T22:19:49.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcac2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac41471c0 0x7fcac4147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:49.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcac2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac41471c0 0x7fcac4147630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48106/0 (socket says 172.21.15.6:48106) 2023-07-21T22:19:49.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcac2d9d640 1 -- 172.21.15.6:0/2660411129 learned_addr learned my addr 172.21.15.6:0/2660411129 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:49.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcac259c640 1 --2- 172.21.15.6:0/2660411129 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcaac005d20 0x7fcac40ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:49.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcac1d9b640 1 --2- 172.21.15.6:0/2660411129 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcac40ce080 0x7fcac40ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:49.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcac2d9d640 1 -- 172.21.15.6:0/2660411129 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcaac005d20 msgr2=0x7fcac40ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:49.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcac2d9d640 1 --2- 172.21.15.6:0/2660411129 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcaac005d20 0x7fcac40ac120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcac2d9d640 1 -- 172.21.15.6:0/2660411129 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcac40ce080 msgr2=0x7fcac40ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:49.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcac2d9d640 1 --2- 172.21.15.6:0/2660411129 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcac40ce080 0x7fcac40ce4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcac2d9d640 1 -- 172.21.15.6:0/2660411129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac40accc0 con 0x7fcac41471c0 2023-07-21T22:19:49.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcac2d9d640 1 --2- 172.21.15.6:0/2660411129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac41471c0 0x7fcac4147630 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcabc007fd0 tx=0x7fcabc00f990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:49.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcab2ffd640 1 -- 172.21.15.6:0/2660411129 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00fe90 con 0x7fcac41471c0 2023-07-21T22:19:49.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcab2ffd640 1 -- 172.21.15.6:0/2660411129 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc006b60 con 0x7fcac41471c0 2023-07-21T22:19:49.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcab2ffd640 1 -- 172.21.15.6:0/2660411129 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc003980 con 0x7fcac41471c0 2023-07-21T22:19:49.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcac8e93640 1 -- 172.21.15.6:0/2660411129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac40acfa0 con 0x7fcac41471c0 2023-07-21T22:19:49.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcac8e93640 1 -- 172.21.15.6:0/2660411129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac4147b70 con 0x7fcac41471c0 2023-07-21T22:19:49.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.359+0000 7fcac8e93640 1 -- 172.21.15.6:0/2660411129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac40ca1a0 con 0x7fcac41471c0 2023-07-21T22:19:49.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.363+0000 7fcab2ffd640 1 -- 172.21.15.6:0/2660411129 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcabc003ae0 con 0x7fcac41471c0 2023-07-21T22:19:49.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.363+0000 7fcab2ffd640 1 --2- 172.21.15.6:0/2660411129 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fcaa4066280 0x7fcaa4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:49.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.363+0000 7fcab2ffd640 1 -- 172.21.15.6:0/2660411129 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcabc082cb0 con 0x7fcac41471c0 2023-07-21T22:19:49.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.363+0000 7fcac259c640 1 --2- 172.21.15.6:0/2660411129 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fcaa4066280 0x7fcaa4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:49.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.363+0000 7fcac259c640 1 --2- 172.21.15.6:0/2660411129 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fcaa4066280 0x7fcaa4068730 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcab40ae000 tx=0x7fcab40a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:49.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.367+0000 7fcab2ffd640 1 -- 172.21.15.6:0/2660411129 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcabc0501c0 con 0x7fcac41471c0 2023-07-21T22:19:49.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.523+0000 7fcac8e93640 1 -- 172.21.15.6:0/2660411129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcac40678d0 con 0x7fcac41471c0 2023-07-21T22:19:49.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.523+0000 7fcab2ffd640 1 -- 172.21.15.6:0/2660411129 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18279 (secure 0 0 0) 0x7fcabc01a090 con 0x7fcac41471c0 2023-07-21T22:19:49.572 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:49.572 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":39,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:19:46.760502+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:19:43.286760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-21T22:19:44.152686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:19:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.527+0000 7fcac8e93640 1 -- 172.21.15.6:0/2660411129 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fcaa4066280 msgr2=0x7fcaa4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.527+0000 7fcac8e93640 1 --2- 172.21.15.6:0/2660411129 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fcaa4066280 0x7fcaa4068730 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcab40ae000 tx=0x7fcab40a7040 comp rx=0 tx=0).stop 2023-07-21T22:19:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.527+0000 7fcac8e93640 1 -- 172.21.15.6:0/2660411129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac41471c0 msgr2=0x7fcac4147630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.527+0000 7fcac8e93640 1 --2- 172.21.15.6:0/2660411129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac41471c0 0x7fcac4147630 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcabc007fd0 tx=0x7fcabc00f990 comp rx=0 tx=0).stop 2023-07-21T22:19:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.527+0000 7fcac8e93640 1 -- 172.21.15.6:0/2660411129 shutdown_connections 2023-07-21T22:19:49.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.527+0000 7fcac8e93640 1 --2- 172.21.15.6:0/2660411129 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fcaa4066280 0x7fcaa4068730 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.527+0000 7fcac8e93640 1 --2- 172.21.15.6:0/2660411129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac41471c0 0x7fcac4147630 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.527+0000 7fcac8e93640 1 --2- 172.21.15.6:0/2660411129 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcac40ce080 0x7fcac40ce4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.527+0000 7fcac8e93640 1 --2- 172.21.15.6:0/2660411129 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcaac005d20 0x7fcac40ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.527+0000 7fcac8e93640 1 -- 172.21.15.6:0/2660411129 >> 172.21.15.6:0/2660411129 conn(0x7fcac40afcf0 msgr2=0x7fcac406be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:49.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.527+0000 7fcac8e93640 1 -- 172.21.15.6:0/2660411129 shutdown_connections 2023-07-21T22:19:49.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.527+0000 7fcac8e93640 1 -- 172.21.15.6:0/2660411129 wait complete. 2023-07-21T22:19:49.593 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T22:19:49.594 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:19:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.691+0000 7fac152ec640 1 Processor -- start 2023-07-21T22:19:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.691+0000 7fac152ec640 1 -- start start 2023-07-21T22:19:49.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.691+0000 7fac152ec640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fac1015bcb0 0x7fac100b4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:49.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.691+0000 7fac152ec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac100b10c0 0x7fac100cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:49.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.691+0000 7fac152ec640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac100ce750 con 0x7fac100b3c50 2023-07-21T22:19:49.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.691+0000 7fac152ec640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac100cea30 con 0x7fac1015bcb0 2023-07-21T22:19:49.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.691+0000 7fac152ec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac100ced10 con 0x7fac100b10c0 2023-07-21T22:19:49.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.691+0000 7fac0effd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fac100b3c50 0x7fac100b4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33864/0 (socket says 172.21.15.6:33864) 2023-07-21T22:19:49.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.691+0000 7fac0effd640 1 -- 172.21.15.6:0/659556315 learned_addr learned my addr 172.21.15.6:0/659556315 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:49.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.691+0000 7fac0f7fe640 1 --2- 172.21.15.6:0/659556315 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac100b10c0 0x7fac100cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:49.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.691+0000 7fac0e7fc640 1 --2- 172.21.15.6:0/659556315 >> v2:172.21.15.161:3300/0 conn(0x7fac1015bcb0 0x7fac100b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:49.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.691+0000 7fac0dffb640 1 -- 172.21.15.6:0/659556315 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229191694 0 0) 0x7fac100ce750 con 0x7fac100b3c50 2023-07-21T22:19:49.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.691+0000 7fac0dffb640 1 -- 172.21.15.6:0/659556315 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabf8003530 con 0x7fac100b3c50 2023-07-21T22:19:49.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.691+0000 7fac0f7fe640 1 -- 172.21.15.6:0/659556315 >> v2:172.21.15.161:3300/0 conn(0x7fac1015bcb0 msgr2=0x7fac100b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:49.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.691+0000 7fac0f7fe640 1 --2- 172.21.15.6:0/659556315 >> v2:172.21.15.161:3300/0 conn(0x7fac1015bcb0 0x7fac100b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.691+0000 7fac0dffb640 1 -- 172.21.15.6:0/659556315 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 688177901 0 0) 0x7fabf8003530 con 0x7fac100b3c50 2023-07-21T22:19:49.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.691+0000 7fac0f7fe640 1 -- 172.21.15.6:0/659556315 >> v1:172.21.15.6:6789/0 conn(0x7fac100b3c50 legacy=0x7fac100b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:49.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.691+0000 7fac0f7fe640 1 -- 172.21.15.6:0/659556315 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac100ceff0 con 0x7fac100b10c0 2023-07-21T22:19:49.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.695+0000 7fac0f7fe640 1 --2- 172.21.15.6:0/659556315 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac100b10c0 0x7fac100cffc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fac08009d90 tx=0x7fac0801c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e53434f3f8438c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:49.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.695+0000 7fac0dffb640 1 -- 172.21.15.6:0/659556315 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac00001680 con 0x7fac100b10c0 2023-07-21T22:19:49.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.695+0000 7fac0dffb640 1 -- 172.21.15.6:0/659556315 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac080a6440 con 0x7fac100b10c0 2023-07-21T22:19:49.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.695+0000 7fac0dffb640 1 -- 172.21.15.6:0/659556315 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac080a67d0 con 0x7fac100b10c0 2023-07-21T22:19:49.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.695+0000 7fac152ec640 1 -- 172.21.15.6:0/659556315 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac100b10c0 msgr2=0x7fac100cffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:49.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.695+0000 7fac152ec640 1 --2- 172.21.15.6:0/659556315 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac100b10c0 0x7fac100cffc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fac08009d90 tx=0x7fac0801c7e0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.695+0000 7fac152ec640 1 -- 172.21.15.6:0/659556315 shutdown_connections 2023-07-21T22:19:49.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.695+0000 7fac152ec640 1 --2- 172.21.15.6:0/659556315 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac100b10c0 0x7fac100cffc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.695+0000 7fac152ec640 1 --2- 172.21.15.6:0/659556315 >> v2:172.21.15.161:3300/0 conn(0x7fac1015bcb0 0x7fac100b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.695+0000 7fac152ec640 1 -- 172.21.15.6:0/659556315 >> 172.21.15.6:0/659556315 conn(0x7fac10069e80 msgr2=0x7fac1006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:49.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.695+0000 7fac152ec640 1 -- 172.21.15.6:0/659556315 shutdown_connections 2023-07-21T22:19:49.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.695+0000 7fac152ec640 1 -- 172.21.15.6:0/659556315 wait complete. 2023-07-21T22:19:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac152ec640 1 Processor -- start 2023-07-21T22:19:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac152ec640 1 -- start start 2023-07-21T22:19:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac152ec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac100b10c0 0x7fac10147d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac152ec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac100b3c50 0x7fac101592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac152ec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac1015bcb0 0x7fac100d21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac152ec640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac10159d20 con 0x7fac100b3c50 2023-07-21T22:19:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac152ec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac101482c0 con 0x7fac1015bcb0 2023-07-21T22:19:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac152ec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1014ad50 con 0x7fac100b10c0 2023-07-21T22:19:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac0e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac100b3c50 0x7fac101592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac0e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac100b3c50 0x7fac101592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48110/0 (socket says 172.21.15.6:48110) 2023-07-21T22:19:49.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac0e7fc640 1 -- 172.21.15.6:0/2985288292 learned_addr learned my addr 172.21.15.6:0/2985288292 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:49.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac0effd640 1 --2- 172.21.15.6:0/2985288292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac100b10c0 0x7fac10147d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:49.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac0f7fe640 1 --2- 172.21.15.6:0/2985288292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac1015bcb0 0x7fac100d21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:49.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac0e7fc640 1 -- 172.21.15.6:0/2985288292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac100b10c0 msgr2=0x7fac10147d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:49.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac0e7fc640 1 --2- 172.21.15.6:0/2985288292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac100b10c0 0x7fac10147d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac0e7fc640 1 -- 172.21.15.6:0/2985288292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac1015bcb0 msgr2=0x7fac100d21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:49.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac0e7fc640 1 --2- 172.21.15.6:0/2985288292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac1015bcb0 0x7fac100d21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac0e7fc640 1 -- 172.21.15.6:0/2985288292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac08009a70 con 0x7fac100b3c50 2023-07-21T22:19:49.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac0e7fc640 1 --2- 172.21.15.6:0/2985288292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac100b3c50 0x7fac101592b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fac0400e930 tx=0x7fac0400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:49.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fabf77fe640 1 -- 172.21.15.6:0/2985288292 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04009690 con 0x7fac100b3c50 2023-07-21T22:19:49.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fabf77fe640 1 -- 172.21.15.6:0/2985288292 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0400ca00 con 0x7fac100b3c50 2023-07-21T22:19:49.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fabf77fe640 1 -- 172.21.15.6:0/2985288292 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0400cd70 con 0x7fac100b3c50 2023-07-21T22:19:49.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac152ec640 1 -- 172.21.15.6:0/2985288292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1014b030 con 0x7fac100b3c50 2023-07-21T22:19:49.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac152ec640 1 -- 172.21.15.6:0/2985288292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac1014b5f0 con 0x7fac100b3c50 2023-07-21T22:19:49.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.699+0000 7fac152ec640 1 -- 172.21.15.6:0/2985288292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac100678d0 con 0x7fac100b3c50 2023-07-21T22:19:49.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.703+0000 7fabf77fe640 1 -- 172.21.15.6:0/2985288292 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fac04013470 con 0x7fac100b3c50 2023-07-21T22:19:49.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.703+0000 7fabf77fe640 1 --2- 172.21.15.6:0/2985288292 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fabfc066280 0x7fabfc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:49.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.703+0000 7fabf77fe640 1 -- 172.21.15.6:0/2985288292 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fac04083e70 con 0x7fac100b3c50 2023-07-21T22:19:49.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.703+0000 7fac0effd640 1 --2- 172.21.15.6:0/2985288292 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fabfc066280 0x7fabfc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:49.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.703+0000 7fac0effd640 1 --2- 172.21.15.6:0/2985288292 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fabfc066280 0x7fabfc068730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fac000017b0 tx=0x7fac000015c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:49.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.707+0000 7fabf77fe640 1 -- 172.21.15.6:0/2985288292 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fac04051450 con 0x7fac100b3c50 2023-07-21T22:19:49.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.863+0000 7fac152ec640 1 -- 172.21.15.6:0/2985288292 --> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac100cfda0 con 0x7fabfc066280 2023-07-21T22:19:49.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.875+0000 7fabf77fe640 1 -- 172.21.15.6:0/2985288292 <== mgr.4103 v2:172.21.15.161:6832/3471136886 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305572 (secure 0 0 0) 0x7fac100cfda0 con 0x7fabfc066280 2023-07-21T22:19:49.925 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:49.926 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:19:49.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.879+0000 7fac152ec640 1 -- 172.21.15.6:0/2985288292 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fabfc066280 msgr2=0x7fabfc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:49.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.879+0000 7fac152ec640 1 --2- 172.21.15.6:0/2985288292 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fabfc066280 0x7fabfc068730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fac000017b0 tx=0x7fac000015c0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.879+0000 7fac152ec640 1 -- 172.21.15.6:0/2985288292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac100b3c50 msgr2=0x7fac101592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:49.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.879+0000 7fac152ec640 1 --2- 172.21.15.6:0/2985288292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac100b3c50 0x7fac101592b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fac0400e930 tx=0x7fac0400edf0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.879+0000 7fac152ec640 1 -- 172.21.15.6:0/2985288292 shutdown_connections 2023-07-21T22:19:49.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.879+0000 7fac152ec640 1 --2- 172.21.15.6:0/2985288292 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac1015bcb0 0x7fac100d21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.879+0000 7fac152ec640 1 --2- 172.21.15.6:0/2985288292 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fabfc066280 0x7fabfc068730 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.879+0000 7fac152ec640 1 --2- 172.21.15.6:0/2985288292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac100b3c50 0x7fac101592b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.879+0000 7fac152ec640 1 --2- 172.21.15.6:0/2985288292 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac100b10c0 0x7fac10147d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:49.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.879+0000 7fac152ec640 1 -- 172.21.15.6:0/2985288292 >> 172.21.15.6:0/2985288292 conn(0x7fac10069e80 msgr2=0x7fac100b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:49.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.879+0000 7fac152ec640 1 -- 172.21.15.6:0/2985288292 shutdown_connections 2023-07-21T22:19:49.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:49.879+0000 7fac152ec640 1 -- 172.21.15.6:0/2985288292 wait complete. 2023-07-21T22:19:49.946 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-07-21T22:19:48.783200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":198,"acting":198,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219912,"kb_used_data":4296,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754808,"statfs":{"total":773094113280,"available":772868923392,"internally_reserved":0,"allocated":4399104,"data_stored":2459914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.025726"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768022+0000","last_change":"2023-07-21T22:19:44.768022+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768022+0000","last_undegraded":"2023-07-21T22:19:44.768022+0000","last_fullsized":"2023-07-21T22:19:44.768022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.767197+0000","last_change":"2023-07-21T22:19:44.767197+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.767197+0000","last_undegraded":"2023-07-21T22:19:44.767197+0000","last_fullsized":"2023-07-21T22:19:44.767197+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768295+0000","last_change":"2023-07-21T22:19:44.768295+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768295+0000","last_undegraded":"2023-07-21T22:19:44.768295+0000","last_fullsized":"2023-07-21T22:19:44.768295+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766959+0000","last_change":"2023-07-21T22:19:44.766959+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766959+0000","last_undegraded":"2023-07-21T22:19:44.766959+0000","last_fullsized":"2023-07-21T22:19:44.766959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.763989+0000","last_change":"2023-07-21T22:19:44.763989+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.763989+0000","last_undegraded":"2023-07-21T22:19:44.763989+0000","last_fullsized":"2023-07-21T22:19:44.763989+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.763657+0000","last_change":"2023-07-21T22:19:44.763657+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.763657+0000","last_undegraded":"2023-07-21T22:19:44.763657+0000","last_fullsized":"2023-07-21T22:19:44.763657+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.773690+0000","last_change":"2023-07-21T22:19:44.773690+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.773690+0000","last_undegraded":"2023-07-21T22:19:44.773690+0000","last_fullsized":"2023-07-21T22:19:44.773690+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766125+0000","last_change":"2023-07-21T22:19:44.766125+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766125+0000","last_undegraded":"2023-07-21T22:19:44.766125+0000","last_fullsized":"2023-07-21T22:19:44.766125+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.769362+0000","last_change":"2023-07-21T22:19:44.769362+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.769362+0000","last_undegraded":"2023-07-21T22:19:44.769362+0000","last_fullsized":"2023-07-21T22:19:44.769362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.779034+0000","last_change":"2023-07-21T22:19:44.779034+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.779034+0000","last_undegraded":"2023-07-21T22:19:44.779034+0000","last_fullsized":"2023-07-21T22:19:44.779034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.774886+0000","last_change":"2023-07-21T22:19:44.774886+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.774886+0000","last_undegraded":"2023-07-21T22:19:44.774886+0000","last_fullsized":"2023-07-21T22:19:44.774886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768913+0000","last_change":"2023-07-21T22:19:44.768913+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768913+0000","last_undegraded":"2023-07-21T22:19:44.768913+0000","last_fullsized":"2023-07-21T22:19:44.768913+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.770660+0000","last_change":"2023-07-21T22:19:44.770660+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.770660+0000","last_undegraded":"2023-07-21T22:19:44.770660+0000","last_fullsized":"2023-07-21T22:19:44.770660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766187+0000","last_change":"2023-07-21T22:19:44.766187+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766187+0000","last_undegraded":"2023-07-21T22:19:44.766187+0000","last_fullsized":"2023-07-21T22:19:44.766187+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.771715+0000","last_change":"2023-07-21T22:19:44.771715+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.771715+0000","last_undegraded":"2023-07-21T22:19:44.771715+0000","last_fullsized":"2023-07-21T22:19:44.771715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768059+0000","last_change":"2023-07-21T22:19:44.768059+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768059+0000","last_undegraded":"2023-07-21T22:19:44.768059+0000","last_fullsized":"2023-07-21T22:19:44.768059+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766520+0000","last_change":"2023-07-21T22:19:44.766520+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766520+0000","last_undegraded":"2023-07-21T22:19:44.766520+0000","last_fullsized":"2023-07-21T22:19:44.766520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:19:44.749638+0000","last_change":"2023-07-21T22:19:44.749638+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.749638+0000","last_undegraded":"2023-07-21T22:19:44.749638+0000","last_fullsized":"2023-07-21T22:19:44.749638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.767049+0000","last_change":"2023-07-21T22:19:44.767049+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.767049+0000","last_undegraded":"2023-07-21T22:19:44.767049+0000","last_fullsized":"2023-07-21T22:19:44.767049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:19:44.749638+0000","last_change":"2023-07-21T22:19:44.749638+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.749638+0000","last_undegraded":"2023-07-21T22:19:44.749638+0000","last_fullsized":"2023-07-21T22:19:44.749638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.771411+0000","last_change":"2023-07-21T22:19:44.771411+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.771411+0000","last_undegraded":"2023-07-21T22:19:44.771411+0000","last_fullsized":"2023-07-21T22:19:44.771411+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.764010+0000","last_change":"2023-07-21T22:19:44.764010+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.764010+0000","last_undegraded":"2023-07-21T22:19:44.764010+0000","last_fullsized":"2023-07-21T22:19:44.764010+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.767129+0000","last_change":"2023-07-21T22:19:44.767129+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.767129+0000","last_undegraded":"2023-07-21T22:19:44.767129+0000","last_fullsized":"2023-07-21T22:19:44.767129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.764715+0000","last_change":"2023-07-21T22:19:44.764715+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.764715+0000","last_undegraded":"2023-07-21T22:19:44.764715+0000","last_fullsized":"2023-07-21T22:19:44.764715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:19:44.749638+0000","last_change":"2023-07-21T22:19:44.749638+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.749638+0000","last_undegraded":"2023-07-21T22:19:44.749638+0000","last_fullsized":"2023-07-21T22:19:44.749638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.764497+0000","last_change":"2023-07-21T22:19:44.764497+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.764497+0000","last_undegraded":"2023-07-21T22:19:44.764497+0000","last_fullsized":"2023-07-21T22:19:44.764497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:19:44.749638+0000","last_change":"2023-07-21T22:19:44.749638+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.749638+0000","last_undegraded":"2023-07-21T22:19:44.749638+0000","last_fullsized":"2023-07-21T22:19:44.749638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.774031+0000","last_change":"2023-07-21T22:19:44.774031+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.774031+0000","last_undegraded":"2023-07-21T22:19:44.774031+0000","last_fullsized":"2023-07-21T22:19:44.774031+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:19:44.749638+0000","last_change":"2023-07-21T22:19:44.749638+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.749638+0000","last_undegraded":"2023-07-21T22:19:44.749638+0000","last_fullsized":"2023-07-21T22:19:44.749638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:19:44.749638+0000","last_change":"2023-07-21T22:19:44.749638+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.749638+0000","last_undegraded":"2023-07-21T22:19:44.749638+0000","last_fullsized":"2023-07-21T22:19:44.749638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766623+0000","last_change":"2023-07-21T22:19:44.766623+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766623+0000","last_undegraded":"2023-07-21T22:19:44.766623+0000","last_fullsized":"2023-07-21T22:19:44.766623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.763159+0000","last_change":"2023-07-21T22:19:44.763159+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.763159+0000","last_undegraded":"2023-07-21T22:19:44.763159+0000","last_fullsized":"2023-07-21T22:19:44.763159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.765687+0000","last_change":"2023-07-21T22:19:44.765687+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.765687+0000","last_undegraded":"2023-07-21T22:19:44.765687+0000","last_fullsized":"2023-07-21T22:19:44.765687+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-07-21T22:19:43.764289+0000","last_change":"2023-07-21T22:19:43.764289+0000","last_active":"2023-07-21T22:19:43.740945+0000","last_peered":"2023-07-21T22:19:43.740945+0000","last_clean":"2023-07-21T22:19:43.740945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:43.764289+0000","last_undegraded":"2023-07-21T22:19:43.764289+0000","last_fullsized":"2023-07-21T22:19:43.764289+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.763516+0000","last_change":"2023-07-21T22:19:44.763516+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.763516+0000","last_undegraded":"2023-07-21T22:19:44.763516+0000","last_fullsized":"2023-07-21T22:19:44.763516+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.784165+0000","last_change":"2023-07-21T22:19:44.784165+0000","last_active":"2023-07-21T22:19:44.784165+0000","last_peered":"2023-07-21T22:19:44.784165+0000","last_clean":"2023-07-21T22:19:44.784165+0000","last_became_active":"2023-07-21T22:19:44.783159+0000","last_became_peered":"2023-07-21T22:19:44.783159+0000","last_unstale":"2023-07-21T22:19:44.784165+0000","last_undegraded":"2023-07-21T22:19:44.784165+0000","last_fullsized":"2023-07-21T22:19:44.784165+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:40:25.511271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.764880+0000","last_change":"2023-07-21T22:19:44.764880+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.764880+0000","last_undegraded":"2023-07-21T22:19:44.764880+0000","last_fullsized":"2023-07-21T22:19:44.764880+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.781601+0000","last_change":"2023-07-21T22:19:44.777629+0000","last_active":"2023-07-21T22:19:44.781601+0000","last_peered":"2023-07-21T22:19:44.781601+0000","last_clean":"2023-07-21T22:19:44.781601+0000","last_became_active":"2023-07-21T22:19:44.777335+0000","last_became_peered":"2023-07-21T22:19:44.777335+0000","last_unstale":"2023-07-21T22:19:44.781601+0000","last_undegraded":"2023-07-21T22:19:44.781601+0000","last_fullsized":"2023-07-21T22:19:44.781601+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:49:46.208003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768510+0000","last_change":"2023-07-21T22:19:44.768510+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768510+0000","last_undegraded":"2023-07-21T22:19:44.768510+0000","last_fullsized":"2023-07-21T22:19:44.768510+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.789651+0000","last_change":"2023-07-21T22:19:44.780467+0000","last_active":"2023-07-21T22:19:44.789651+0000","last_peered":"2023-07-21T22:19:44.789651+0000","last_clean":"2023-07-21T22:19:44.789651+0000","last_became_active":"2023-07-21T22:19:44.780154+0000","last_became_peered":"2023-07-21T22:19:44.780154+0000","last_unstale":"2023-07-21T22:19:44.789651+0000","last_undegraded":"2023-07-21T22:19:44.789651+0000","last_fullsized":"2023-07-21T22:19:44.789651+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:09:10.166181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.771673+0000","last_change":"2023-07-21T22:19:44.771673+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.771673+0000","last_undegraded":"2023-07-21T22:19:44.771673+0000","last_fullsized":"2023-07-21T22:19:44.771673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.792244+0000","last_change":"2023-07-21T22:19:44.787151+0000","last_active":"2023-07-21T22:19:44.792244+0000","last_peered":"2023-07-21T22:19:44.792244+0000","last_clean":"2023-07-21T22:19:44.792244+0000","last_became_active":"2023-07-21T22:19:44.786795+0000","last_became_peered":"2023-07-21T22:19:44.786795+0000","last_unstale":"2023-07-21T22:19:44.792244+0000","last_undegraded":"2023-07-21T22:19:44.792244+0000","last_fullsized":"2023-07-21T22:19:44.792244+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:22:55.835971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.771192+0000","last_change":"2023-07-21T22:19:44.771192+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.771192+0000","last_undegraded":"2023-07-21T22:19:44.771192+0000","last_fullsized":"2023-07-21T22:19:44.771192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.784675+0000","last_change":"2023-07-21T22:19:44.778629+0000","last_active":"2023-07-21T22:19:44.784675+0000","last_peered":"2023-07-21T22:19:44.784675+0000","last_clean":"2023-07-21T22:19:44.784675+0000","last_became_active":"2023-07-21T22:19:44.778106+0000","last_became_peered":"2023-07-21T22:19:44.778106+0000","last_unstale":"2023-07-21T22:19:44.784675+0000","last_undegraded":"2023-07-21T22:19:44.784675+0000","last_fullsized":"2023-07-21T22:19:44.784675+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:45:37.572263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.765253+0000","last_change":"2023-07-21T22:19:44.765253+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.765253+0000","last_undegraded":"2023-07-21T22:19:44.765253+0000","last_fullsized":"2023-07-21T22:19:44.765253+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.784029+0000","last_change":"2023-07-21T22:19:44.780493+0000","last_active":"2023-07-21T22:19:44.784029+0000","last_peered":"2023-07-21T22:19:44.784029+0000","last_clean":"2023-07-21T22:19:44.784029+0000","last_became_active":"2023-07-21T22:19:44.780040+0000","last_became_peered":"2023-07-21T22:19:44.780040+0000","last_unstale":"2023-07-21T22:19:44.784029+0000","last_undegraded":"2023-07-21T22:19:44.784029+0000","last_fullsized":"2023-07-21T22:19:44.784029+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:28:09.333154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.769994+0000","last_change":"2023-07-21T22:19:44.769994+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.769994+0000","last_undegraded":"2023-07-21T22:19:44.769994+0000","last_fullsized":"2023-07-21T22:19:44.769994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.788893+0000","last_change":"2023-07-21T22:19:44.779555+0000","last_active":"2023-07-21T22:19:44.788893+0000","last_peered":"2023-07-21T22:19:44.788893+0000","last_clean":"2023-07-21T22:19:44.788893+0000","last_became_active":"2023-07-21T22:19:44.779239+0000","last_became_peered":"2023-07-21T22:19:44.779239+0000","last_unstale":"2023-07-21T22:19:44.788893+0000","last_undegraded":"2023-07-21T22:19:44.788893+0000","last_fullsized":"2023-07-21T22:19:44.788893+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:50:17.073564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.763794+0000","last_change":"2023-07-21T22:19:44.763794+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.763794+0000","last_undegraded":"2023-07-21T22:19:44.763794+0000","last_fullsized":"2023-07-21T22:19:44.763794+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.785204+0000","last_change":"2023-07-21T22:19:44.785204+0000","last_active":"2023-07-21T22:19:44.785204+0000","last_peered":"2023-07-21T22:19:44.785204+0000","last_clean":"2023-07-21T22:19:44.785204+0000","last_became_active":"2023-07-21T22:19:44.784909+0000","last_became_peered":"2023-07-21T22:19:44.784909+0000","last_unstale":"2023-07-21T22:19:44.785204+0000","last_undegraded":"2023-07-21T22:19:44.785204+0000","last_fullsized":"2023-07-21T22:19:44.785204+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:43:15.721579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.767329+0000","last_change":"2023-07-21T22:19:44.767329+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.767329+0000","last_undegraded":"2023-07-21T22:19:44.767329+0000","last_fullsized":"2023-07-21T22:19:44.767329+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.792929+0000","last_change":"2023-07-21T22:19:44.790427+0000","last_active":"2023-07-21T22:19:44.792929+0000","last_peered":"2023-07-21T22:19:44.792929+0000","last_clean":"2023-07-21T22:19:44.792929+0000","last_became_active":"2023-07-21T22:19:44.790178+0000","last_became_peered":"2023-07-21T22:19:44.790178+0000","last_unstale":"2023-07-21T22:19:44.792929+0000","last_undegraded":"2023-07-21T22:19:44.792929+0000","last_fullsized":"2023-07-21T22:19:44.792929+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:46:53.814962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.769752+0000","last_change":"2023-07-21T22:19:44.769752+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.769752+0000","last_undegraded":"2023-07-21T22:19:44.769752+0000","last_fullsized":"2023-07-21T22:19:44.769752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.788454+0000","last_change":"2023-07-21T22:19:44.784266+0000","last_active":"2023-07-21T22:19:44.788454+0000","last_peered":"2023-07-21T22:19:44.788454+0000","last_clean":"2023-07-21T22:19:44.788454+0000","last_became_active":"2023-07-21T22:19:44.783964+0000","last_became_peered":"2023-07-21T22:19:44.783964+0000","last_unstale":"2023-07-21T22:19:44.788454+0000","last_undegraded":"2023-07-21T22:19:44.788454+0000","last_fullsized":"2023-07-21T22:19:44.788454+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:03:12.948637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.765043+0000","last_change":"2023-07-21T22:19:44.765043+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.765043+0000","last_undegraded":"2023-07-21T22:19:44.765043+0000","last_fullsized":"2023-07-21T22:19:44.765043+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.784552+0000","last_change":"2023-07-21T22:19:44.777147+0000","last_active":"2023-07-21T22:19:44.784552+0000","last_peered":"2023-07-21T22:19:44.784552+0000","last_clean":"2023-07-21T22:19:44.784552+0000","last_became_active":"2023-07-21T22:19:44.776832+0000","last_became_peered":"2023-07-21T22:19:44.776832+0000","last_unstale":"2023-07-21T22:19:44.784552+0000","last_undegraded":"2023-07-21T22:19:44.784552+0000","last_fullsized":"2023-07-21T22:19:44.784552+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:17:36.251165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.771152+0000","last_change":"2023-07-21T22:19:44.771152+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.771152+0000","last_undegraded":"2023-07-21T22:19:44.771152+0000","last_fullsized":"2023-07-21T22:19:44.771152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.785472+0000","last_change":"2023-07-21T22:19:44.785472+0000","last_active":"2023-07-21T22:19:44.785472+0000","last_peered":"2023-07-21T22:19:44.785472+0000","last_clean":"2023-07-21T22:19:44.785472+0000","last_became_active":"2023-07-21T22:19:44.785213+0000","last_became_peered":"2023-07-21T22:19:44.785213+0000","last_unstale":"2023-07-21T22:19:44.785472+0000","last_undegraded":"2023-07-21T22:19:44.785472+0000","last_fullsized":"2023-07-21T22:19:44.785472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:13:36.531608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.769316+0000","last_change":"2023-07-21T22:19:44.769316+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.769316+0000","last_undegraded":"2023-07-21T22:19:44.769316+0000","last_fullsized":"2023-07-21T22:19:44.769316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.787548+0000","last_change":"2023-07-21T22:19:44.783624+0000","last_active":"2023-07-21T22:19:44.787548+0000","last_peered":"2023-07-21T22:19:44.787548+0000","last_clean":"2023-07-21T22:19:44.787548+0000","last_became_active":"2023-07-21T22:19:44.783333+0000","last_became_peered":"2023-07-21T22:19:44.783333+0000","last_unstale":"2023-07-21T22:19:44.787548+0000","last_undegraded":"2023-07-21T22:19:44.787548+0000","last_fullsized":"2023-07-21T22:19:44.787548+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:32:02.965725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766122+0000","last_change":"2023-07-21T22:19:44.766122+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766122+0000","last_undegraded":"2023-07-21T22:19:44.766122+0000","last_fullsized":"2023-07-21T22:19:44.766122+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-07-21T22:19:43.764711+0000","last_change":"2023-07-21T22:19:43.764711+0000","last_active":"2023-07-21T22:19:43.740945+0000","last_peered":"2023-07-21T22:19:43.740945+0000","last_clean":"2023-07-21T22:19:43.740945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:43.764711+0000","last_undegraded":"2023-07-21T22:19:43.764711+0000","last_fullsized":"2023-07-21T22:19:43.764711+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768451+0000","last_change":"2023-07-21T22:19:44.768451+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768451+0000","last_undegraded":"2023-07-21T22:19:44.768451+0000","last_fullsized":"2023-07-21T22:19:44.768451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.784502+0000","last_change":"2023-07-21T22:19:44.778323+0000","last_active":"2023-07-21T22:19:44.784502+0000","last_peered":"2023-07-21T22:19:44.784502+0000","last_clean":"2023-07-21T22:19:44.784502+0000","last_became_active":"2023-07-21T22:19:44.778005+0000","last_became_peered":"2023-07-21T22:19:44.778005+0000","last_unstale":"2023-07-21T22:19:44.784502+0000","last_undegraded":"2023-07-21T22:19:44.784502+0000","last_fullsized":"2023-07-21T22:19:44.784502+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:00:12.364084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.767057+0000","last_change":"2023-07-21T22:19:44.767057+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.767057+0000","last_undegraded":"2023-07-21T22:19:44.767057+0000","last_fullsized":"2023-07-21T22:19:44.767057+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.792899+0000","last_change":"2023-07-21T22:19:44.789449+0000","last_active":"2023-07-21T22:19:44.792899+0000","last_peered":"2023-07-21T22:19:44.792899+0000","last_clean":"2023-07-21T22:19:44.792899+0000","last_became_active":"2023-07-21T22:19:44.789151+0000","last_became_peered":"2023-07-21T22:19:44.789151+0000","last_unstale":"2023-07-21T22:19:44.792899+0000","last_undegraded":"2023-07-21T22:19:44.792899+0000","last_fullsized":"2023-07-21T22:19:44.792899+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:55:24.800943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.774363+0000","last_change":"2023-07-21T22:19:44.774363+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.774363+0000","last_undegraded":"2023-07-21T22:19:44.774363+0000","last_fullsized":"2023-07-21T22:19:44.774363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.792205+0000","last_change":"2023-07-21T22:19:44.785599+0000","last_active":"2023-07-21T22:19:44.792205+0000","last_peered":"2023-07-21T22:19:44.792205+0000","last_clean":"2023-07-21T22:19:44.792205+0000","last_became_active":"2023-07-21T22:19:44.785328+0000","last_became_peered":"2023-07-21T22:19:44.785328+0000","last_unstale":"2023-07-21T22:19:44.792205+0000","last_undegraded":"2023-07-21T22:19:44.792205+0000","last_fullsized":"2023-07-21T22:19:44.792205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:50:28.731700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.765414+0000","last_change":"2023-07-21T22:19:44.765414+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.765414+0000","last_undegraded":"2023-07-21T22:19:44.765414+0000","last_fullsized":"2023-07-21T22:19:44.765414+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.778978+0000","last_change":"2023-07-21T22:19:44.774139+0000","last_active":"2023-07-21T22:19:44.778978+0000","last_peered":"2023-07-21T22:19:44.778978+0000","last_clean":"2023-07-21T22:19:44.778978+0000","last_became_active":"2023-07-21T22:19:44.773835+0000","last_became_peered":"2023-07-21T22:19:44.773835+0000","last_unstale":"2023-07-21T22:19:44.778978+0000","last_undegraded":"2023-07-21T22:19:44.778978+0000","last_fullsized":"2023-07-21T22:19:44.778978+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:08:10.427202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.762868+0000","last_change":"2023-07-21T22:19:44.762868+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.762868+0000","last_undegraded":"2023-07-21T22:19:44.762868+0000","last_fullsized":"2023-07-21T22:19:44.762868+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.781609+0000","last_change":"2023-07-21T22:19:44.777586+0000","last_active":"2023-07-21T22:19:44.781609+0000","last_peered":"2023-07-21T22:19:44.781609+0000","last_clean":"2023-07-21T22:19:44.781609+0000","last_became_active":"2023-07-21T22:19:44.777266+0000","last_became_peered":"2023-07-21T22:19:44.777266+0000","last_unstale":"2023-07-21T22:19:44.781609+0000","last_undegraded":"2023-07-21T22:19:44.781609+0000","last_fullsized":"2023-07-21T22:19:44.781609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:05.638815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.765560+0000","last_change":"2023-07-21T22:19:44.765560+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.765560+0000","last_undegraded":"2023-07-21T22:19:44.765560+0000","last_fullsized":"2023-07-21T22:19:44.765560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.780259+0000","last_change":"2023-07-21T22:19:44.777277+0000","last_active":"2023-07-21T22:19:44.780259+0000","last_peered":"2023-07-21T22:19:44.780259+0000","last_clean":"2023-07-21T22:19:44.780259+0000","last_became_active":"2023-07-21T22:19:44.776977+0000","last_became_peered":"2023-07-21T22:19:44.776977+0000","last_unstale":"2023-07-21T22:19:44.780259+0000","last_undegraded":"2023-07-21T22:19:44.780259+0000","last_fullsized":"2023-07-21T22:19:44.780259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:06:16.148343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.769392+0000","last_change":"2023-07-21T22:19:44.769392+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.769392+0000","last_undegraded":"2023-07-21T22:19:44.769392+0000","last_fullsized":"2023-07-21T22:19:44.769392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.778879+0000","last_change":"2023-07-21T22:19:44.771175+0000","last_active":"2023-07-21T22:19:44.778879+0000","last_peered":"2023-07-21T22:19:44.778879+0000","last_clean":"2023-07-21T22:19:44.778879+0000","last_became_active":"2023-07-21T22:19:44.770768+0000","last_became_peered":"2023-07-21T22:19:44.770768+0000","last_unstale":"2023-07-21T22:19:44.778879+0000","last_undegraded":"2023-07-21T22:19:44.778879+0000","last_fullsized":"2023-07-21T22:19:44.778879+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:26:57.618903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.779783+0000","last_change":"2023-07-21T22:19:44.779783+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.779783+0000","last_undegraded":"2023-07-21T22:19:44.779783+0000","last_fullsized":"2023-07-21T22:19:44.779783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.788284+0000","last_change":"2023-07-21T22:19:44.782353+0000","last_active":"2023-07-21T22:19:44.788284+0000","last_peered":"2023-07-21T22:19:44.788284+0000","last_clean":"2023-07-21T22:19:44.788284+0000","last_became_active":"2023-07-21T22:19:44.782034+0000","last_became_peered":"2023-07-21T22:19:44.782034+0000","last_unstale":"2023-07-21T22:19:44.788284+0000","last_undegraded":"2023-07-21T22:19:44.788284+0000","last_fullsized":"2023-07-21T22:19:44.788284+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:17:53.758418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.767979+0000","last_change":"2023-07-21T22:19:44.767979+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.767979+0000","last_undegraded":"2023-07-21T22:19:44.767979+0000","last_fullsized":"2023-07-21T22:19:44.767979+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.780224+0000","last_change":"2023-07-21T22:19:44.777212+0000","last_active":"2023-07-21T22:19:44.780224+0000","last_peered":"2023-07-21T22:19:44.780224+0000","last_clean":"2023-07-21T22:19:44.780224+0000","last_became_active":"2023-07-21T22:19:44.776901+0000","last_became_peered":"2023-07-21T22:19:44.776901+0000","last_unstale":"2023-07-21T22:19:44.780224+0000","last_undegraded":"2023-07-21T22:19:44.780224+0000","last_fullsized":"2023-07-21T22:19:44.780224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:55:10.392765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.774188+0000","last_change":"2023-07-21T22:19:44.774188+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.774188+0000","last_undegraded":"2023-07-21T22:19:44.774188+0000","last_fullsized":"2023-07-21T22:19:44.774188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.788228+0000","last_change":"2023-07-21T22:19:44.781768+0000","last_active":"2023-07-21T22:19:44.788228+0000","last_peered":"2023-07-21T22:19:44.788228+0000","last_clean":"2023-07-21T22:19:44.788228+0000","last_became_active":"2023-07-21T22:19:44.781490+0000","last_became_peered":"2023-07-21T22:19:44.781490+0000","last_unstale":"2023-07-21T22:19:44.788228+0000","last_undegraded":"2023-07-21T22:19:44.788228+0000","last_fullsized":"2023-07-21T22:19:44.788228+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:55:24.800943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":191,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.769000+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:19:44.769000+0000","last_peered":"2023-07-21T22:19:44.769000+0000","last_clean":"2023-07-21T22:19:44.769000+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:19:44.769000+0000","last_undegraded":"2023-07-21T22:19:44.769000+0000","last_fullsized":"2023-07-21T22:19:44.769000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:14:16.711607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.780940+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:19:44.780940+0000","last_peered":"2023-07-21T22:19:44.780940+0000","last_clean":"2023-07-21T22:19:44.780940+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:19:44.780940+0000","last_undegraded":"2023-07-21T22:19:44.780940+0000","last_fullsized":"2023-07-21T22:19:44.780940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:02:49.722750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.764887+0000","last_change":"2023-07-21T22:19:44.764887+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.764887+0000","last_undegraded":"2023-07-21T22:19:44.764887+0000","last_fullsized":"2023-07-21T22:19:44.764887+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.788422+0000","last_change":"2023-07-21T22:19:44.783741+0000","last_active":"2023-07-21T22:19:44.788422+0000","last_peered":"2023-07-21T22:19:44.788422+0000","last_clean":"2023-07-21T22:19:44.788422+0000","last_became_active":"2023-07-21T22:19:44.783453+0000","last_became_peered":"2023-07-21T22:19:44.783453+0000","last_unstale":"2023-07-21T22:19:44.788422+0000","last_undegraded":"2023-07-21T22:19:44.788422+0000","last_fullsized":"2023-07-21T22:19:44.788422+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:15:29.350117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.768908+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:19:44.768908+0000","last_peered":"2023-07-21T22:19:44.768908+0000","last_clean":"2023-07-21T22:19:44.768908+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:19:44.768908+0000","last_undegraded":"2023-07-21T22:19:44.768908+0000","last_fullsized":"2023-07-21T22:19:44.768908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:36:13.815180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766813+0000","last_change":"2023-07-21T22:19:44.766813+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766813+0000","last_undegraded":"2023-07-21T22:19:44.766813+0000","last_fullsized":"2023-07-21T22:19:44.766813+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.783489+0000","last_change":"2023-07-21T22:19:44.781409+0000","last_active":"2023-07-21T22:19:44.783489+0000","last_peered":"2023-07-21T22:19:44.783489+0000","last_clean":"2023-07-21T22:19:44.783489+0000","last_became_active":"2023-07-21T22:19:44.781102+0000","last_became_peered":"2023-07-21T22:19:44.781102+0000","last_unstale":"2023-07-21T22:19:44.783489+0000","last_undegraded":"2023-07-21T22:19:44.783489+0000","last_fullsized":"2023-07-21T22:19:44.783489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:07:50.600290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.760572+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:19:44.760572+0000","last_peered":"2023-07-21T22:19:44.760572+0000","last_clean":"2023-07-21T22:19:44.760572+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:19:44.760572+0000","last_undegraded":"2023-07-21T22:19:44.760572+0000","last_fullsized":"2023-07-21T22:19:44.760572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:31.218728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766681+0000","last_change":"2023-07-21T22:19:44.766681+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766681+0000","last_undegraded":"2023-07-21T22:19:44.766681+0000","last_fullsized":"2023-07-21T22:19:44.766681+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.782520+0000","last_change":"2023-07-21T22:19:44.782520+0000","last_active":"2023-07-21T22:19:44.782520+0000","last_peered":"2023-07-21T22:19:44.782520+0000","last_clean":"2023-07-21T22:19:44.782520+0000","last_became_active":"2023-07-21T22:19:44.782191+0000","last_became_peered":"2023-07-21T22:19:44.782191+0000","last_unstale":"2023-07-21T22:19:44.782520+0000","last_undegraded":"2023-07-21T22:19:44.782520+0000","last_fullsized":"2023-07-21T22:19:44.782520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:20:48.080503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.780629+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:19:44.780629+0000","last_peered":"2023-07-21T22:19:44.780629+0000","last_clean":"2023-07-21T22:19:44.780629+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:19:44.780629+0000","last_undegraded":"2023-07-21T22:19:44.780629+0000","last_fullsized":"2023-07-21T22:19:44.780629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:22:10.939623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768939+0000","last_change":"2023-07-21T22:19:44.768939+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768939+0000","last_undegraded":"2023-07-21T22:19:44.768939+0000","last_fullsized":"2023-07-21T22:19:44.768939+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.784000+0000","last_change":"2023-07-21T22:19:44.781398+0000","last_active":"2023-07-21T22:19:44.784000+0000","last_peered":"2023-07-21T22:19:44.784000+0000","last_clean":"2023-07-21T22:19:44.784000+0000","last_became_active":"2023-07-21T22:19:44.781004+0000","last_became_peered":"2023-07-21T22:19:44.781004+0000","last_unstale":"2023-07-21T22:19:44.784000+0000","last_undegraded":"2023-07-21T22:19:44.784000+0000","last_fullsized":"2023-07-21T22:19:44.784000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:07:04.484973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.769020+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:19:44.769020+0000","last_peered":"2023-07-21T22:19:44.769020+0000","last_clean":"2023-07-21T22:19:44.769020+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:19:44.769020+0000","last_undegraded":"2023-07-21T22:19:44.769020+0000","last_fullsized":"2023-07-21T22:19:44.769020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:14:06.976155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.763282+0000","last_change":"2023-07-21T22:19:44.763282+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.763282+0000","last_undegraded":"2023-07-21T22:19:44.763282+0000","last_fullsized":"2023-07-21T22:19:44.763282+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-07-21T22:19:43.764166+0000","last_change":"2023-07-21T22:19:43.764166+0000","last_active":"2023-07-21T22:19:43.740945+0000","last_peered":"2023-07-21T22:19:43.740945+0000","last_clean":"2023-07-21T22:19:43.740945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:43.764166+0000","last_undegraded":"2023-07-21T22:19:43.764166+0000","last_fullsized":"2023-07-21T22:19:43.764166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.775481+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:19:44.775481+0000","last_peered":"2023-07-21T22:19:44.775481+0000","last_clean":"2023-07-21T22:19:44.775481+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:19:44.775481+0000","last_undegraded":"2023-07-21T22:19:44.775481+0000","last_fullsized":"2023-07-21T22:19:44.775481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:06.464541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.765724+0000","last_change":"2023-07-21T22:19:44.765724+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.765724+0000","last_undegraded":"2023-07-21T22:19:44.765724+0000","last_fullsized":"2023-07-21T22:19:44.765724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.788811+0000","last_change":"2023-07-21T22:19:44.779517+0000","last_active":"2023-07-21T22:19:44.788811+0000","last_peered":"2023-07-21T22:19:44.788811+0000","last_clean":"2023-07-21T22:19:44.788811+0000","last_became_active":"2023-07-21T22:19:44.779216+0000","last_became_peered":"2023-07-21T22:19:44.779216+0000","last_unstale":"2023-07-21T22:19:44.788811+0000","last_undegraded":"2023-07-21T22:19:44.788811+0000","last_fullsized":"2023-07-21T22:19:44.788811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:41:47.182450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.773635+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:19:44.773635+0000","last_peered":"2023-07-21T22:19:44.773635+0000","last_clean":"2023-07-21T22:19:44.773635+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:19:44.773635+0000","last_undegraded":"2023-07-21T22:19:44.773635+0000","last_fullsized":"2023-07-21T22:19:44.773635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:26.209156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766654+0000","last_change":"2023-07-21T22:19:44.766654+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766654+0000","last_undegraded":"2023-07-21T22:19:44.766654+0000","last_fullsized":"2023-07-21T22:19:44.766654+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.782154+0000","last_change":"2023-07-21T22:19:44.778837+0000","last_active":"2023-07-21T22:19:44.782154+0000","last_peered":"2023-07-21T22:19:44.782154+0000","last_clean":"2023-07-21T22:19:44.782154+0000","last_became_active":"2023-07-21T22:19:44.778207+0000","last_became_peered":"2023-07-21T22:19:44.778207+0000","last_unstale":"2023-07-21T22:19:44.782154+0000","last_undegraded":"2023-07-21T22:19:44.782154+0000","last_fullsized":"2023-07-21T22:19:44.782154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:45:53.723203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T22:19:43.765265+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:19:43.765265+0000","last_peered":"2023-07-21T22:19:43.765265+0000","last_clean":"2023-07-21T22:19:43.765265+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:19:43.765265+0000","last_undegraded":"2023-07-21T22:19:43.765265+0000","last_fullsized":"2023-07-21T22:19:43.765265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:56:24.283075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":995328,"data_stored":750208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.63200000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.88}]},{"osd":2,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.84299999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.72499999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.91600000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":1.0129999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.80100000000000005}]}]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":159840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.503}]},{"osd":1,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48199999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.64400000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.72999999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54500000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.41499999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.70499999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":166468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.71999999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.749}]},{"osd":2,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.80600000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.85199999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.876}]},{"osd":7,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.95199999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":159840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.39800000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47999999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.90800000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.82499999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.94399999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":159840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.437},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.71799999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":159840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":5.4800000000000004,"5min":5.4800000000000004,"15min":5.4800000000000004},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.48899999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":3.4220000000000002,"5min":3.4220000000000002,"15min":3.4220000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.56299999999999994}]},{"osd":3,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":5.8710000000000004,"5min":5.8710000000000004,"15min":5.8710000000000004},"last":0.44}]},{"osd":4,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":3.6259999999999999,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.4100000000000001,"5min":4.4100000000000001,"15min":4.4100000000000001},"last":0.71399999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":5.766,"5min":5.766,"15min":5.766},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.669,"5min":3.669,"15min":3.669},"last":0.746}]},{"osd":6,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":5.8200000000000003,"5min":5.8200000000000003,"15min":5.8200000000000003},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.9269999999999996,"5min":5.9269999999999996,"15min":5.9269999999999996},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":3.5800000000000001,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.83599999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":995328,"data_stored":750208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.44}]},{"osd":2,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.33000000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.90400000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.77500000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.70799999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":389120,"data_stored":153670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":0.65900000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":8.6280000000000001,"5min":8.6280000000000001,"15min":8.6280000000000001},"last":0.623}]},{"osd":2,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.74099999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":3.1829999999999998,"5min":3.1829999999999998,"15min":3.1829999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":2.887,"5min":2.887,"15min":2.887},"last":0.76400000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.55600000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":8.0760000000000005,"5min":8.0760000000000005,"15min":8.0760000000000005},"last":0.78500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:19:49.954 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:19:50.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.083+0000 7f04ef737640 1 Processor -- start 2023-07-21T22:19:50.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.083+0000 7f04ef737640 1 -- start start 2023-07-21T22:19:50.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.083+0000 7f04ef737640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e815bdf0 0x7f04e80ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:50.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.083+0000 7f04ef737640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f04e815f970 0x7f04e815fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:50.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.083+0000 7f04ef737640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e8160300 con 0x7f04e806b1e0 2023-07-21T22:19:50.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.083+0000 7f04ef737640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e80cb2e0 con 0x7f04e815f970 2023-07-21T22:19:50.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.083+0000 7f04ef737640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80cb5c0 con 0x7f04e815bdf0 2023-07-21T22:19:50.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.087+0000 7f04ed4d3640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e815bdf0 0x7f04e80ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:50.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.087+0000 7f04ed4d3640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e815bdf0 0x7f04e80ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:49526/0 (socket says 172.21.15.6:49526) 2023-07-21T22:19:50.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.087+0000 7f04eccd2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f04e815f970 0x7f04e815fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:50.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.087+0000 7f04ed4d3640 1 -- 172.21.15.6:0/726159241 learned_addr learned my addr 172.21.15.6:0/726159241 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:50.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.087+0000 7f04ed4d3640 1 -- 172.21.15.6:0/726159241 >> v2:172.21.15.161:3300/0 conn(0x7f04e815f970 msgr2=0x7f04e815fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:50.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.087+0000 7f04ed4d3640 1 --2- 172.21.15.6:0/726159241 >> v2:172.21.15.161:3300/0 conn(0x7f04e815f970 0x7f04e815fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.087+0000 7f04ed4d3640 1 -- 172.21.15.6:0/726159241 >> v1:172.21.15.161:6789/0 conn(0x7f04e806b1e0 legacy=0x7f04e806b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:50.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.087+0000 7f04ed4d3640 1 -- 172.21.15.6:0/726159241 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e80cb8a0 con 0x7f04e815bdf0 2023-07-21T22:19:50.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.087+0000 7f04eccd2640 1 --2- 172.21.15.6:0/726159241 >> v2:172.21.15.161:3300/0 conn(0x7f04e815f970 0x7f04e815fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:50.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.087+0000 7f04ed4d3640 1 --2- 172.21.15.6:0/726159241 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e815bdf0 0x7f04e80ca970 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f04e4009870 tx=0x7f04e401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=705f7f56d9c60fa9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:50.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.087+0000 7f04dffff640 1 -- 172.21.15.6:0/726159241 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e40a6040 con 0x7f04e815bdf0 2023-07-21T22:19:50.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.087+0000 7f04dffff640 1 -- 172.21.15.6:0/726159241 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e40aa600 con 0x7f04e815bdf0 2023-07-21T22:19:50.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.087+0000 7f04dffff640 1 -- 172.21.15.6:0/726159241 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e40aa990 con 0x7f04e815bdf0 2023-07-21T22:19:50.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ef737640 1 -- 172.21.15.6:0/726159241 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e815bdf0 msgr2=0x7f04e80ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:50.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ef737640 1 --2- 172.21.15.6:0/726159241 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e815bdf0 0x7f04e80ca970 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f04e4009870 tx=0x7f04e401c480 comp rx=0 tx=0).stop 2023-07-21T22:19:50.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ef737640 1 -- 172.21.15.6:0/726159241 shutdown_connections 2023-07-21T22:19:50.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ef737640 1 --2- 172.21.15.6:0/726159241 >> v2:172.21.15.161:3300/0 conn(0x7f04e815f970 0x7f04e815fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ef737640 1 --2- 172.21.15.6:0/726159241 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e815bdf0 0x7f04e80ca970 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ef737640 1 -- 172.21.15.6:0/726159241 >> 172.21.15.6:0/726159241 conn(0x7f04e80afcf0 msgr2=0x7f04e80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:50.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ef737640 1 -- 172.21.15.6:0/726159241 shutdown_connections 2023-07-21T22:19:50.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ef737640 1 -- 172.21.15.6:0/726159241 wait complete. 2023-07-21T22:19:50.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ef737640 1 Processor -- start 2023-07-21T22:19:50.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ef737640 1 -- start start 2023-07-21T22:19:50.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ef737640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e806b1e0 0x7f04e815ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:50.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ef737640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e815bdf0 0x7f04e80b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:50.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ef737640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e815f970 0x7f04e80c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:50.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ef737640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80b23a0 con 0x7f04e806b1e0 2023-07-21T22:19:50.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ef737640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80b1530 con 0x7f04e815f970 2023-07-21T22:19:50.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ef737640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e80c85c0 con 0x7f04e815bdf0 2023-07-21T22:19:50.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ed4d3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e806b1e0 0x7f04e815ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:50.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ed4d3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e806b1e0 0x7f04e815ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48120/0 (socket says 172.21.15.6:48120) 2023-07-21T22:19:50.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ed4d3640 1 -- 172.21.15.6:0/1084694980 learned_addr learned my addr 172.21.15.6:0/1084694980 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:50.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04edcd4640 1 --2- 172.21.15.6:0/1084694980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e815f970 0x7f04e80c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:50.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04eccd2640 1 --2- 172.21.15.6:0/1084694980 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e815bdf0 0x7f04e80b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:50.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ed4d3640 1 -- 172.21.15.6:0/1084694980 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e815bdf0 msgr2=0x7f04e80b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:50.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ed4d3640 1 --2- 172.21.15.6:0/1084694980 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e815bdf0 0x7f04e80b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ed4d3640 1 -- 172.21.15.6:0/1084694980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e815f970 msgr2=0x7f04e80c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:50.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ed4d3640 1 --2- 172.21.15.6:0/1084694980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e815f970 0x7f04e80c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.091+0000 7f04ed4d3640 1 -- 172.21.15.6:0/1084694980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d8009420 con 0x7f04e806b1e0 2023-07-21T22:19:50.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.095+0000 7f04ed4d3640 1 --2- 172.21.15.6:0/1084694980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e806b1e0 0x7f04e815ac70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f04e401ab30 tx=0x7f04e401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:50.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.095+0000 7f04ddffb640 1 -- 172.21.15.6:0/1084694980 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e40b3600 con 0x7f04e806b1e0 2023-07-21T22:19:50.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.095+0000 7f04ddffb640 1 -- 172.21.15.6:0/1084694980 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e40b3760 con 0x7f04e806b1e0 2023-07-21T22:19:50.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.095+0000 7f04ef737640 1 -- 172.21.15.6:0/1084694980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e40094d0 con 0x7f04e806b1e0 2023-07-21T22:19:50.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.095+0000 7f04ddffb640 1 -- 172.21.15.6:0/1084694980 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e40b3af0 con 0x7f04e806b1e0 2023-07-21T22:19:50.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.095+0000 7f04ef737640 1 -- 172.21.15.6:0/1084694980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e80b1a00 con 0x7f04e806b1e0 2023-07-21T22:19:50.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.095+0000 7f04ef737640 1 -- 172.21.15.6:0/1084694980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e8072d90 con 0x7f04e806b1e0 2023-07-21T22:19:50.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.095+0000 7f04ddffb640 1 -- 172.21.15.6:0/1084694980 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f04e40b3c50 con 0x7f04e806b1e0 2023-07-21T22:19:50.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.095+0000 7f04ddffb640 1 --2- 172.21.15.6:0/1084694980 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f04cc0662b0 0x7f04cc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:50.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.095+0000 7f04ddffb640 1 -- 172.21.15.6:0/1084694980 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f04e411e4e0 con 0x7f04e806b1e0 2023-07-21T22:19:50.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.095+0000 7f04eccd2640 1 --2- 172.21.15.6:0/1084694980 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f04cc0662b0 0x7f04cc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:50.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.099+0000 7f04eccd2640 1 --2- 172.21.15.6:0/1084694980 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f04cc0662b0 0x7f04cc068760 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f04e80b26e0 tx=0x7f04d8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:50.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.099+0000 7f04ddffb640 1 -- 172.21.15.6:0/1084694980 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f04e40eb9b0 con 0x7f04e806b1e0 2023-07-21T22:19:50.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.251+0000 7f04ef737640 1 -- 172.21.15.6:0/1084694980 --> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04e80678d0 con 0x7f04cc0662b0 2023-07-21T22:19:50.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.263+0000 7f04ddffb640 1 -- 172.21.15.6:0/1084694980 <== mgr.4103 v2:172.21.15.161:6832/3471136886 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305572 (secure 0 0 0) 0x7f04e80678d0 con 0x7f04cc0662b0 2023-07-21T22:19:50.313 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:50.315 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:19:50.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.263+0000 7f04ef737640 1 -- 172.21.15.6:0/1084694980 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f04cc0662b0 msgr2=0x7f04cc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:50.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.263+0000 7f04ef737640 1 --2- 172.21.15.6:0/1084694980 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f04cc0662b0 0x7f04cc068760 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f04e80b26e0 tx=0x7f04d8009190 comp rx=0 tx=0).stop 2023-07-21T22:19:50.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.263+0000 7f04ef737640 1 -- 172.21.15.6:0/1084694980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e806b1e0 msgr2=0x7f04e815ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:50.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.263+0000 7f04ef737640 1 --2- 172.21.15.6:0/1084694980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e806b1e0 0x7f04e815ac70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f04e401ab30 tx=0x7f04e401acc0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.263+0000 7f04ef737640 1 -- 172.21.15.6:0/1084694980 shutdown_connections 2023-07-21T22:19:50.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.263+0000 7f04ef737640 1 --2- 172.21.15.6:0/1084694980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e815f970 0x7f04e80c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.263+0000 7f04ef737640 1 --2- 172.21.15.6:0/1084694980 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e815bdf0 0x7f04e80b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.263+0000 7f04ef737640 1 --2- 172.21.15.6:0/1084694980 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f04cc0662b0 0x7f04cc068760 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.263+0000 7f04ef737640 1 --2- 172.21.15.6:0/1084694980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e806b1e0 0x7f04e815ac70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.263+0000 7f04ef737640 1 -- 172.21.15.6:0/1084694980 >> 172.21.15.6:0/1084694980 conn(0x7f04e80afcf0 msgr2=0x7f04e80ad0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.263+0000 7f04ef737640 1 -- 172.21.15.6:0/1084694980 shutdown_connections 2023-07-21T22:19:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.263+0000 7f04ef737640 1 -- 172.21.15.6:0/1084694980 wait complete. 2023-07-21T22:19:50.332 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-07-21T22:19:48.783200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":198,"acting":198,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219912,"kb_used_data":4296,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754808,"statfs":{"total":773094113280,"available":772868923392,"internally_reserved":0,"allocated":4399104,"data_stored":2459914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.025726"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768022+0000","last_change":"2023-07-21T22:19:44.768022+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768022+0000","last_undegraded":"2023-07-21T22:19:44.768022+0000","last_fullsized":"2023-07-21T22:19:44.768022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.767197+0000","last_change":"2023-07-21T22:19:44.767197+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.767197+0000","last_undegraded":"2023-07-21T22:19:44.767197+0000","last_fullsized":"2023-07-21T22:19:44.767197+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768295+0000","last_change":"2023-07-21T22:19:44.768295+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768295+0000","last_undegraded":"2023-07-21T22:19:44.768295+0000","last_fullsized":"2023-07-21T22:19:44.768295+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766959+0000","last_change":"2023-07-21T22:19:44.766959+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766959+0000","last_undegraded":"2023-07-21T22:19:44.766959+0000","last_fullsized":"2023-07-21T22:19:44.766959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.763989+0000","last_change":"2023-07-21T22:19:44.763989+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.763989+0000","last_undegraded":"2023-07-21T22:19:44.763989+0000","last_fullsized":"2023-07-21T22:19:44.763989+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.763657+0000","last_change":"2023-07-21T22:19:44.763657+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.763657+0000","last_undegraded":"2023-07-21T22:19:44.763657+0000","last_fullsized":"2023-07-21T22:19:44.763657+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.773690+0000","last_change":"2023-07-21T22:19:44.773690+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.773690+0000","last_undegraded":"2023-07-21T22:19:44.773690+0000","last_fullsized":"2023-07-21T22:19:44.773690+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766125+0000","last_change":"2023-07-21T22:19:44.766125+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766125+0000","last_undegraded":"2023-07-21T22:19:44.766125+0000","last_fullsized":"2023-07-21T22:19:44.766125+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.769362+0000","last_change":"2023-07-21T22:19:44.769362+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.769362+0000","last_undegraded":"2023-07-21T22:19:44.769362+0000","last_fullsized":"2023-07-21T22:19:44.769362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.779034+0000","last_change":"2023-07-21T22:19:44.779034+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.779034+0000","last_undegraded":"2023-07-21T22:19:44.779034+0000","last_fullsized":"2023-07-21T22:19:44.779034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.774886+0000","last_change":"2023-07-21T22:19:44.774886+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.774886+0000","last_undegraded":"2023-07-21T22:19:44.774886+0000","last_fullsized":"2023-07-21T22:19:44.774886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768913+0000","last_change":"2023-07-21T22:19:44.768913+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768913+0000","last_undegraded":"2023-07-21T22:19:44.768913+0000","last_fullsized":"2023-07-21T22:19:44.768913+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.770660+0000","last_change":"2023-07-21T22:19:44.770660+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.770660+0000","last_undegraded":"2023-07-21T22:19:44.770660+0000","last_fullsized":"2023-07-21T22:19:44.770660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766187+0000","last_change":"2023-07-21T22:19:44.766187+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766187+0000","last_undegraded":"2023-07-21T22:19:44.766187+0000","last_fullsized":"2023-07-21T22:19:44.766187+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.771715+0000","last_change":"2023-07-21T22:19:44.771715+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.771715+0000","last_undegraded":"2023-07-21T22:19:44.771715+0000","last_fullsized":"2023-07-21T22:19:44.771715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768059+0000","last_change":"2023-07-21T22:19:44.768059+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768059+0000","last_undegraded":"2023-07-21T22:19:44.768059+0000","last_fullsized":"2023-07-21T22:19:44.768059+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766520+0000","last_change":"2023-07-21T22:19:44.766520+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766520+0000","last_undegraded":"2023-07-21T22:19:44.766520+0000","last_fullsized":"2023-07-21T22:19:44.766520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:19:44.749638+0000","last_change":"2023-07-21T22:19:44.749638+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.749638+0000","last_undegraded":"2023-07-21T22:19:44.749638+0000","last_fullsized":"2023-07-21T22:19:44.749638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.767049+0000","last_change":"2023-07-21T22:19:44.767049+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.767049+0000","last_undegraded":"2023-07-21T22:19:44.767049+0000","last_fullsized":"2023-07-21T22:19:44.767049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:19:44.749638+0000","last_change":"2023-07-21T22:19:44.749638+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.749638+0000","last_undegraded":"2023-07-21T22:19:44.749638+0000","last_fullsized":"2023-07-21T22:19:44.749638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.771411+0000","last_change":"2023-07-21T22:19:44.771411+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.771411+0000","last_undegraded":"2023-07-21T22:19:44.771411+0000","last_fullsized":"2023-07-21T22:19:44.771411+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.764010+0000","last_change":"2023-07-21T22:19:44.764010+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.764010+0000","last_undegraded":"2023-07-21T22:19:44.764010+0000","last_fullsized":"2023-07-21T22:19:44.764010+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.767129+0000","last_change":"2023-07-21T22:19:44.767129+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.767129+0000","last_undegraded":"2023-07-21T22:19:44.767129+0000","last_fullsized":"2023-07-21T22:19:44.767129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.764715+0000","last_change":"2023-07-21T22:19:44.764715+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.764715+0000","last_undegraded":"2023-07-21T22:19:44.764715+0000","last_fullsized":"2023-07-21T22:19:44.764715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:19:44.749638+0000","last_change":"2023-07-21T22:19:44.749638+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.749638+0000","last_undegraded":"2023-07-21T22:19:44.749638+0000","last_fullsized":"2023-07-21T22:19:44.749638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.764497+0000","last_change":"2023-07-21T22:19:44.764497+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.764497+0000","last_undegraded":"2023-07-21T22:19:44.764497+0000","last_fullsized":"2023-07-21T22:19:44.764497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:19:44.749638+0000","last_change":"2023-07-21T22:19:44.749638+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.749638+0000","last_undegraded":"2023-07-21T22:19:44.749638+0000","last_fullsized":"2023-07-21T22:19:44.749638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.774031+0000","last_change":"2023-07-21T22:19:44.774031+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.774031+0000","last_undegraded":"2023-07-21T22:19:44.774031+0000","last_fullsized":"2023-07-21T22:19:44.774031+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:19:44.749638+0000","last_change":"2023-07-21T22:19:44.749638+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.749638+0000","last_undegraded":"2023-07-21T22:19:44.749638+0000","last_fullsized":"2023-07-21T22:19:44.749638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:19:44.749638+0000","last_change":"2023-07-21T22:19:44.749638+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.749638+0000","last_undegraded":"2023-07-21T22:19:44.749638+0000","last_fullsized":"2023-07-21T22:19:44.749638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766623+0000","last_change":"2023-07-21T22:19:44.766623+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766623+0000","last_undegraded":"2023-07-21T22:19:44.766623+0000","last_fullsized":"2023-07-21T22:19:44.766623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.763159+0000","last_change":"2023-07-21T22:19:44.763159+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.763159+0000","last_undegraded":"2023-07-21T22:19:44.763159+0000","last_fullsized":"2023-07-21T22:19:44.763159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.765687+0000","last_change":"2023-07-21T22:19:44.765687+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.765687+0000","last_undegraded":"2023-07-21T22:19:44.765687+0000","last_fullsized":"2023-07-21T22:19:44.765687+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-07-21T22:19:43.764289+0000","last_change":"2023-07-21T22:19:43.764289+0000","last_active":"2023-07-21T22:19:43.740945+0000","last_peered":"2023-07-21T22:19:43.740945+0000","last_clean":"2023-07-21T22:19:43.740945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:43.764289+0000","last_undegraded":"2023-07-21T22:19:43.764289+0000","last_fullsized":"2023-07-21T22:19:43.764289+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.763516+0000","last_change":"2023-07-21T22:19:44.763516+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.763516+0000","last_undegraded":"2023-07-21T22:19:44.763516+0000","last_fullsized":"2023-07-21T22:19:44.763516+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.784165+0000","last_change":"2023-07-21T22:19:44.784165+0000","last_active":"2023-07-21T22:19:44.784165+0000","last_peered":"2023-07-21T22:19:44.784165+0000","last_clean":"2023-07-21T22:19:44.784165+0000","last_became_active":"2023-07-21T22:19:44.783159+0000","last_became_peered":"2023-07-21T22:19:44.783159+0000","last_unstale":"2023-07-21T22:19:44.784165+0000","last_undegraded":"2023-07-21T22:19:44.784165+0000","last_fullsized":"2023-07-21T22:19:44.784165+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:40:25.511271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.764880+0000","last_change":"2023-07-21T22:19:44.764880+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.764880+0000","last_undegraded":"2023-07-21T22:19:44.764880+0000","last_fullsized":"2023-07-21T22:19:44.764880+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.781601+0000","last_change":"2023-07-21T22:19:44.777629+0000","last_active":"2023-07-21T22:19:44.781601+0000","last_peered":"2023-07-21T22:19:44.781601+0000","last_clean":"2023-07-21T22:19:44.781601+0000","last_became_active":"2023-07-21T22:19:44.777335+0000","last_became_peered":"2023-07-21T22:19:44.777335+0000","last_unstale":"2023-07-21T22:19:44.781601+0000","last_undegraded":"2023-07-21T22:19:44.781601+0000","last_fullsized":"2023-07-21T22:19:44.781601+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:49:46.208003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768510+0000","last_change":"2023-07-21T22:19:44.768510+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768510+0000","last_undegraded":"2023-07-21T22:19:44.768510+0000","last_fullsized":"2023-07-21T22:19:44.768510+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.789651+0000","last_change":"2023-07-21T22:19:44.780467+0000","last_active":"2023-07-21T22:19:44.789651+0000","last_peered":"2023-07-21T22:19:44.789651+0000","last_clean":"2023-07-21T22:19:44.789651+0000","last_became_active":"2023-07-21T22:19:44.780154+0000","last_became_peered":"2023-07-21T22:19:44.780154+0000","last_unstale":"2023-07-21T22:19:44.789651+0000","last_undegraded":"2023-07-21T22:19:44.789651+0000","last_fullsized":"2023-07-21T22:19:44.789651+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:09:10.166181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.771673+0000","last_change":"2023-07-21T22:19:44.771673+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.771673+0000","last_undegraded":"2023-07-21T22:19:44.771673+0000","last_fullsized":"2023-07-21T22:19:44.771673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.792244+0000","last_change":"2023-07-21T22:19:44.787151+0000","last_active":"2023-07-21T22:19:44.792244+0000","last_peered":"2023-07-21T22:19:44.792244+0000","last_clean":"2023-07-21T22:19:44.792244+0000","last_became_active":"2023-07-21T22:19:44.786795+0000","last_became_peered":"2023-07-21T22:19:44.786795+0000","last_unstale":"2023-07-21T22:19:44.792244+0000","last_undegraded":"2023-07-21T22:19:44.792244+0000","last_fullsized":"2023-07-21T22:19:44.792244+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:22:55.835971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.771192+0000","last_change":"2023-07-21T22:19:44.771192+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.771192+0000","last_undegraded":"2023-07-21T22:19:44.771192+0000","last_fullsized":"2023-07-21T22:19:44.771192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.784675+0000","last_change":"2023-07-21T22:19:44.778629+0000","last_active":"2023-07-21T22:19:44.784675+0000","last_peered":"2023-07-21T22:19:44.784675+0000","last_clean":"2023-07-21T22:19:44.784675+0000","last_became_active":"2023-07-21T22:19:44.778106+0000","last_became_peered":"2023-07-21T22:19:44.778106+0000","last_unstale":"2023-07-21T22:19:44.784675+0000","last_undegraded":"2023-07-21T22:19:44.784675+0000","last_fullsized":"2023-07-21T22:19:44.784675+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:45:37.572263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.765253+0000","last_change":"2023-07-21T22:19:44.765253+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.765253+0000","last_undegraded":"2023-07-21T22:19:44.765253+0000","last_fullsized":"2023-07-21T22:19:44.765253+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.784029+0000","last_change":"2023-07-21T22:19:44.780493+0000","last_active":"2023-07-21T22:19:44.784029+0000","last_peered":"2023-07-21T22:19:44.784029+0000","last_clean":"2023-07-21T22:19:44.784029+0000","last_became_active":"2023-07-21T22:19:44.780040+0000","last_became_peered":"2023-07-21T22:19:44.780040+0000","last_unstale":"2023-07-21T22:19:44.784029+0000","last_undegraded":"2023-07-21T22:19:44.784029+0000","last_fullsized":"2023-07-21T22:19:44.784029+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:28:09.333154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.769994+0000","last_change":"2023-07-21T22:19:44.769994+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.769994+0000","last_undegraded":"2023-07-21T22:19:44.769994+0000","last_fullsized":"2023-07-21T22:19:44.769994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.788893+0000","last_change":"2023-07-21T22:19:44.779555+0000","last_active":"2023-07-21T22:19:44.788893+0000","last_peered":"2023-07-21T22:19:44.788893+0000","last_clean":"2023-07-21T22:19:44.788893+0000","last_became_active":"2023-07-21T22:19:44.779239+0000","last_became_peered":"2023-07-21T22:19:44.779239+0000","last_unstale":"2023-07-21T22:19:44.788893+0000","last_undegraded":"2023-07-21T22:19:44.788893+0000","last_fullsized":"2023-07-21T22:19:44.788893+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:50:17.073564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.763794+0000","last_change":"2023-07-21T22:19:44.763794+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.763794+0000","last_undegraded":"2023-07-21T22:19:44.763794+0000","last_fullsized":"2023-07-21T22:19:44.763794+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.785204+0000","last_change":"2023-07-21T22:19:44.785204+0000","last_active":"2023-07-21T22:19:44.785204+0000","last_peered":"2023-07-21T22:19:44.785204+0000","last_clean":"2023-07-21T22:19:44.785204+0000","last_became_active":"2023-07-21T22:19:44.784909+0000","last_became_peered":"2023-07-21T22:19:44.784909+0000","last_unstale":"2023-07-21T22:19:44.785204+0000","last_undegraded":"2023-07-21T22:19:44.785204+0000","last_fullsized":"2023-07-21T22:19:44.785204+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:43:15.721579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.767329+0000","last_change":"2023-07-21T22:19:44.767329+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.767329+0000","last_undegraded":"2023-07-21T22:19:44.767329+0000","last_fullsized":"2023-07-21T22:19:44.767329+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.792929+0000","last_change":"2023-07-21T22:19:44.790427+0000","last_active":"2023-07-21T22:19:44.792929+0000","last_peered":"2023-07-21T22:19:44.792929+0000","last_clean":"2023-07-21T22:19:44.792929+0000","last_became_active":"2023-07-21T22:19:44.790178+0000","last_became_peered":"2023-07-21T22:19:44.790178+0000","last_unstale":"2023-07-21T22:19:44.792929+0000","last_undegraded":"2023-07-21T22:19:44.792929+0000","last_fullsized":"2023-07-21T22:19:44.792929+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:46:53.814962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.769752+0000","last_change":"2023-07-21T22:19:44.769752+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.769752+0000","last_undegraded":"2023-07-21T22:19:44.769752+0000","last_fullsized":"2023-07-21T22:19:44.769752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.788454+0000","last_change":"2023-07-21T22:19:44.784266+0000","last_active":"2023-07-21T22:19:44.788454+0000","last_peered":"2023-07-21T22:19:44.788454+0000","last_clean":"2023-07-21T22:19:44.788454+0000","last_became_active":"2023-07-21T22:19:44.783964+0000","last_became_peered":"2023-07-21T22:19:44.783964+0000","last_unstale":"2023-07-21T22:19:44.788454+0000","last_undegraded":"2023-07-21T22:19:44.788454+0000","last_fullsized":"2023-07-21T22:19:44.788454+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:03:12.948637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.765043+0000","last_change":"2023-07-21T22:19:44.765043+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.765043+0000","last_undegraded":"2023-07-21T22:19:44.765043+0000","last_fullsized":"2023-07-21T22:19:44.765043+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.784552+0000","last_change":"2023-07-21T22:19:44.777147+0000","last_active":"2023-07-21T22:19:44.784552+0000","last_peered":"2023-07-21T22:19:44.784552+0000","last_clean":"2023-07-21T22:19:44.784552+0000","last_became_active":"2023-07-21T22:19:44.776832+0000","last_became_peered":"2023-07-21T22:19:44.776832+0000","last_unstale":"2023-07-21T22:19:44.784552+0000","last_undegraded":"2023-07-21T22:19:44.784552+0000","last_fullsized":"2023-07-21T22:19:44.784552+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:17:36.251165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.771152+0000","last_change":"2023-07-21T22:19:44.771152+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.771152+0000","last_undegraded":"2023-07-21T22:19:44.771152+0000","last_fullsized":"2023-07-21T22:19:44.771152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.785472+0000","last_change":"2023-07-21T22:19:44.785472+0000","last_active":"2023-07-21T22:19:44.785472+0000","last_peered":"2023-07-21T22:19:44.785472+0000","last_clean":"2023-07-21T22:19:44.785472+0000","last_became_active":"2023-07-21T22:19:44.785213+0000","last_became_peered":"2023-07-21T22:19:44.785213+0000","last_unstale":"2023-07-21T22:19:44.785472+0000","last_undegraded":"2023-07-21T22:19:44.785472+0000","last_fullsized":"2023-07-21T22:19:44.785472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:13:36.531608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.769316+0000","last_change":"2023-07-21T22:19:44.769316+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.769316+0000","last_undegraded":"2023-07-21T22:19:44.769316+0000","last_fullsized":"2023-07-21T22:19:44.769316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.787548+0000","last_change":"2023-07-21T22:19:44.783624+0000","last_active":"2023-07-21T22:19:44.787548+0000","last_peered":"2023-07-21T22:19:44.787548+0000","last_clean":"2023-07-21T22:19:44.787548+0000","last_became_active":"2023-07-21T22:19:44.783333+0000","last_became_peered":"2023-07-21T22:19:44.783333+0000","last_unstale":"2023-07-21T22:19:44.787548+0000","last_undegraded":"2023-07-21T22:19:44.787548+0000","last_fullsized":"2023-07-21T22:19:44.787548+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:32:02.965725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766122+0000","last_change":"2023-07-21T22:19:44.766122+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766122+0000","last_undegraded":"2023-07-21T22:19:44.766122+0000","last_fullsized":"2023-07-21T22:19:44.766122+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-07-21T22:19:43.764711+0000","last_change":"2023-07-21T22:19:43.764711+0000","last_active":"2023-07-21T22:19:43.740945+0000","last_peered":"2023-07-21T22:19:43.740945+0000","last_clean":"2023-07-21T22:19:43.740945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:43.764711+0000","last_undegraded":"2023-07-21T22:19:43.764711+0000","last_fullsized":"2023-07-21T22:19:43.764711+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768451+0000","last_change":"2023-07-21T22:19:44.768451+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768451+0000","last_undegraded":"2023-07-21T22:19:44.768451+0000","last_fullsized":"2023-07-21T22:19:44.768451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.784502+0000","last_change":"2023-07-21T22:19:44.778323+0000","last_active":"2023-07-21T22:19:44.784502+0000","last_peered":"2023-07-21T22:19:44.784502+0000","last_clean":"2023-07-21T22:19:44.784502+0000","last_became_active":"2023-07-21T22:19:44.778005+0000","last_became_peered":"2023-07-21T22:19:44.778005+0000","last_unstale":"2023-07-21T22:19:44.784502+0000","last_undegraded":"2023-07-21T22:19:44.784502+0000","last_fullsized":"2023-07-21T22:19:44.784502+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:00:12.364084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.767057+0000","last_change":"2023-07-21T22:19:44.767057+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.767057+0000","last_undegraded":"2023-07-21T22:19:44.767057+0000","last_fullsized":"2023-07-21T22:19:44.767057+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.792899+0000","last_change":"2023-07-21T22:19:44.789449+0000","last_active":"2023-07-21T22:19:44.792899+0000","last_peered":"2023-07-21T22:19:44.792899+0000","last_clean":"2023-07-21T22:19:44.792899+0000","last_became_active":"2023-07-21T22:19:44.789151+0000","last_became_peered":"2023-07-21T22:19:44.789151+0000","last_unstale":"2023-07-21T22:19:44.792899+0000","last_undegraded":"2023-07-21T22:19:44.792899+0000","last_fullsized":"2023-07-21T22:19:44.792899+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:55:24.800943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.774363+0000","last_change":"2023-07-21T22:19:44.774363+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.774363+0000","last_undegraded":"2023-07-21T22:19:44.774363+0000","last_fullsized":"2023-07-21T22:19:44.774363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.792205+0000","last_change":"2023-07-21T22:19:44.785599+0000","last_active":"2023-07-21T22:19:44.792205+0000","last_peered":"2023-07-21T22:19:44.792205+0000","last_clean":"2023-07-21T22:19:44.792205+0000","last_became_active":"2023-07-21T22:19:44.785328+0000","last_became_peered":"2023-07-21T22:19:44.785328+0000","last_unstale":"2023-07-21T22:19:44.792205+0000","last_undegraded":"2023-07-21T22:19:44.792205+0000","last_fullsized":"2023-07-21T22:19:44.792205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:50:28.731700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.765414+0000","last_change":"2023-07-21T22:19:44.765414+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.765414+0000","last_undegraded":"2023-07-21T22:19:44.765414+0000","last_fullsized":"2023-07-21T22:19:44.765414+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.778978+0000","last_change":"2023-07-21T22:19:44.774139+0000","last_active":"2023-07-21T22:19:44.778978+0000","last_peered":"2023-07-21T22:19:44.778978+0000","last_clean":"2023-07-21T22:19:44.778978+0000","last_became_active":"2023-07-21T22:19:44.773835+0000","last_became_peered":"2023-07-21T22:19:44.773835+0000","last_unstale":"2023-07-21T22:19:44.778978+0000","last_undegraded":"2023-07-21T22:19:44.778978+0000","last_fullsized":"2023-07-21T22:19:44.778978+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:08:10.427202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.762868+0000","last_change":"2023-07-21T22:19:44.762868+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.762868+0000","last_undegraded":"2023-07-21T22:19:44.762868+0000","last_fullsized":"2023-07-21T22:19:44.762868+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.781609+0000","last_change":"2023-07-21T22:19:44.777586+0000","last_active":"2023-07-21T22:19:44.781609+0000","last_peered":"2023-07-21T22:19:44.781609+0000","last_clean":"2023-07-21T22:19:44.781609+0000","last_became_active":"2023-07-21T22:19:44.777266+0000","last_became_peered":"2023-07-21T22:19:44.777266+0000","last_unstale":"2023-07-21T22:19:44.781609+0000","last_undegraded":"2023-07-21T22:19:44.781609+0000","last_fullsized":"2023-07-21T22:19:44.781609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:05.638815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.765560+0000","last_change":"2023-07-21T22:19:44.765560+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.765560+0000","last_undegraded":"2023-07-21T22:19:44.765560+0000","last_fullsized":"2023-07-21T22:19:44.765560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.780259+0000","last_change":"2023-07-21T22:19:44.777277+0000","last_active":"2023-07-21T22:19:44.780259+0000","last_peered":"2023-07-21T22:19:44.780259+0000","last_clean":"2023-07-21T22:19:44.780259+0000","last_became_active":"2023-07-21T22:19:44.776977+0000","last_became_peered":"2023-07-21T22:19:44.776977+0000","last_unstale":"2023-07-21T22:19:44.780259+0000","last_undegraded":"2023-07-21T22:19:44.780259+0000","last_fullsized":"2023-07-21T22:19:44.780259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:06:16.148343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.769392+0000","last_change":"2023-07-21T22:19:44.769392+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.769392+0000","last_undegraded":"2023-07-21T22:19:44.769392+0000","last_fullsized":"2023-07-21T22:19:44.769392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.778879+0000","last_change":"2023-07-21T22:19:44.771175+0000","last_active":"2023-07-21T22:19:44.778879+0000","last_peered":"2023-07-21T22:19:44.778879+0000","last_clean":"2023-07-21T22:19:44.778879+0000","last_became_active":"2023-07-21T22:19:44.770768+0000","last_became_peered":"2023-07-21T22:19:44.770768+0000","last_unstale":"2023-07-21T22:19:44.778879+0000","last_undegraded":"2023-07-21T22:19:44.778879+0000","last_fullsized":"2023-07-21T22:19:44.778879+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:26:57.618903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.779783+0000","last_change":"2023-07-21T22:19:44.779783+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.779783+0000","last_undegraded":"2023-07-21T22:19:44.779783+0000","last_fullsized":"2023-07-21T22:19:44.779783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.788284+0000","last_change":"2023-07-21T22:19:44.782353+0000","last_active":"2023-07-21T22:19:44.788284+0000","last_peered":"2023-07-21T22:19:44.788284+0000","last_clean":"2023-07-21T22:19:44.788284+0000","last_became_active":"2023-07-21T22:19:44.782034+0000","last_became_peered":"2023-07-21T22:19:44.782034+0000","last_unstale":"2023-07-21T22:19:44.788284+0000","last_undegraded":"2023-07-21T22:19:44.788284+0000","last_fullsized":"2023-07-21T22:19:44.788284+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:17:53.758418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.767979+0000","last_change":"2023-07-21T22:19:44.767979+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.767979+0000","last_undegraded":"2023-07-21T22:19:44.767979+0000","last_fullsized":"2023-07-21T22:19:44.767979+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.780224+0000","last_change":"2023-07-21T22:19:44.777212+0000","last_active":"2023-07-21T22:19:44.780224+0000","last_peered":"2023-07-21T22:19:44.780224+0000","last_clean":"2023-07-21T22:19:44.780224+0000","last_became_active":"2023-07-21T22:19:44.776901+0000","last_became_peered":"2023-07-21T22:19:44.776901+0000","last_unstale":"2023-07-21T22:19:44.780224+0000","last_undegraded":"2023-07-21T22:19:44.780224+0000","last_fullsized":"2023-07-21T22:19:44.780224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:55:10.392765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.774188+0000","last_change":"2023-07-21T22:19:44.774188+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.774188+0000","last_undegraded":"2023-07-21T22:19:44.774188+0000","last_fullsized":"2023-07-21T22:19:44.774188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.788228+0000","last_change":"2023-07-21T22:19:44.781768+0000","last_active":"2023-07-21T22:19:44.788228+0000","last_peered":"2023-07-21T22:19:44.788228+0000","last_clean":"2023-07-21T22:19:44.788228+0000","last_became_active":"2023-07-21T22:19:44.781490+0000","last_became_peered":"2023-07-21T22:19:44.781490+0000","last_unstale":"2023-07-21T22:19:44.788228+0000","last_undegraded":"2023-07-21T22:19:44.788228+0000","last_fullsized":"2023-07-21T22:19:44.788228+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:55:24.800943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":191,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.769000+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:19:44.769000+0000","last_peered":"2023-07-21T22:19:44.769000+0000","last_clean":"2023-07-21T22:19:44.769000+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:19:44.769000+0000","last_undegraded":"2023-07-21T22:19:44.769000+0000","last_fullsized":"2023-07-21T22:19:44.769000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:14:16.711607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.780940+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:19:44.780940+0000","last_peered":"2023-07-21T22:19:44.780940+0000","last_clean":"2023-07-21T22:19:44.780940+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:19:44.780940+0000","last_undegraded":"2023-07-21T22:19:44.780940+0000","last_fullsized":"2023-07-21T22:19:44.780940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:02:49.722750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.764887+0000","last_change":"2023-07-21T22:19:44.764887+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.764887+0000","last_undegraded":"2023-07-21T22:19:44.764887+0000","last_fullsized":"2023-07-21T22:19:44.764887+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.788422+0000","last_change":"2023-07-21T22:19:44.783741+0000","last_active":"2023-07-21T22:19:44.788422+0000","last_peered":"2023-07-21T22:19:44.788422+0000","last_clean":"2023-07-21T22:19:44.788422+0000","last_became_active":"2023-07-21T22:19:44.783453+0000","last_became_peered":"2023-07-21T22:19:44.783453+0000","last_unstale":"2023-07-21T22:19:44.788422+0000","last_undegraded":"2023-07-21T22:19:44.788422+0000","last_fullsized":"2023-07-21T22:19:44.788422+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:15:29.350117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.768908+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:19:44.768908+0000","last_peered":"2023-07-21T22:19:44.768908+0000","last_clean":"2023-07-21T22:19:44.768908+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:19:44.768908+0000","last_undegraded":"2023-07-21T22:19:44.768908+0000","last_fullsized":"2023-07-21T22:19:44.768908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:36:13.815180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766813+0000","last_change":"2023-07-21T22:19:44.766813+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766813+0000","last_undegraded":"2023-07-21T22:19:44.766813+0000","last_fullsized":"2023-07-21T22:19:44.766813+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.783489+0000","last_change":"2023-07-21T22:19:44.781409+0000","last_active":"2023-07-21T22:19:44.783489+0000","last_peered":"2023-07-21T22:19:44.783489+0000","last_clean":"2023-07-21T22:19:44.783489+0000","last_became_active":"2023-07-21T22:19:44.781102+0000","last_became_peered":"2023-07-21T22:19:44.781102+0000","last_unstale":"2023-07-21T22:19:44.783489+0000","last_undegraded":"2023-07-21T22:19:44.783489+0000","last_fullsized":"2023-07-21T22:19:44.783489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:07:50.600290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.760572+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:19:44.760572+0000","last_peered":"2023-07-21T22:19:44.760572+0000","last_clean":"2023-07-21T22:19:44.760572+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:19:44.760572+0000","last_undegraded":"2023-07-21T22:19:44.760572+0000","last_fullsized":"2023-07-21T22:19:44.760572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:31.218728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766681+0000","last_change":"2023-07-21T22:19:44.766681+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766681+0000","last_undegraded":"2023-07-21T22:19:44.766681+0000","last_fullsized":"2023-07-21T22:19:44.766681+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.782520+0000","last_change":"2023-07-21T22:19:44.782520+0000","last_active":"2023-07-21T22:19:44.782520+0000","last_peered":"2023-07-21T22:19:44.782520+0000","last_clean":"2023-07-21T22:19:44.782520+0000","last_became_active":"2023-07-21T22:19:44.782191+0000","last_became_peered":"2023-07-21T22:19:44.782191+0000","last_unstale":"2023-07-21T22:19:44.782520+0000","last_undegraded":"2023-07-21T22:19:44.782520+0000","last_fullsized":"2023-07-21T22:19:44.782520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:20:48.080503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.780629+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:19:44.780629+0000","last_peered":"2023-07-21T22:19:44.780629+0000","last_clean":"2023-07-21T22:19:44.780629+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:19:44.780629+0000","last_undegraded":"2023-07-21T22:19:44.780629+0000","last_fullsized":"2023-07-21T22:19:44.780629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:22:10.939623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768939+0000","last_change":"2023-07-21T22:19:44.768939+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768939+0000","last_undegraded":"2023-07-21T22:19:44.768939+0000","last_fullsized":"2023-07-21T22:19:44.768939+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.784000+0000","last_change":"2023-07-21T22:19:44.781398+0000","last_active":"2023-07-21T22:19:44.784000+0000","last_peered":"2023-07-21T22:19:44.784000+0000","last_clean":"2023-07-21T22:19:44.784000+0000","last_became_active":"2023-07-21T22:19:44.781004+0000","last_became_peered":"2023-07-21T22:19:44.781004+0000","last_unstale":"2023-07-21T22:19:44.784000+0000","last_undegraded":"2023-07-21T22:19:44.784000+0000","last_fullsized":"2023-07-21T22:19:44.784000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:07:04.484973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.769020+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:19:44.769020+0000","last_peered":"2023-07-21T22:19:44.769020+0000","last_clean":"2023-07-21T22:19:44.769020+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:19:44.769020+0000","last_undegraded":"2023-07-21T22:19:44.769020+0000","last_fullsized":"2023-07-21T22:19:44.769020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:14:06.976155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.763282+0000","last_change":"2023-07-21T22:19:44.763282+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.763282+0000","last_undegraded":"2023-07-21T22:19:44.763282+0000","last_fullsized":"2023-07-21T22:19:44.763282+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-07-21T22:19:43.764166+0000","last_change":"2023-07-21T22:19:43.764166+0000","last_active":"2023-07-21T22:19:43.740945+0000","last_peered":"2023-07-21T22:19:43.740945+0000","last_clean":"2023-07-21T22:19:43.740945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:43.764166+0000","last_undegraded":"2023-07-21T22:19:43.764166+0000","last_fullsized":"2023-07-21T22:19:43.764166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.775481+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:19:44.775481+0000","last_peered":"2023-07-21T22:19:44.775481+0000","last_clean":"2023-07-21T22:19:44.775481+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:19:44.775481+0000","last_undegraded":"2023-07-21T22:19:44.775481+0000","last_fullsized":"2023-07-21T22:19:44.775481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:06.464541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.765724+0000","last_change":"2023-07-21T22:19:44.765724+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.765724+0000","last_undegraded":"2023-07-21T22:19:44.765724+0000","last_fullsized":"2023-07-21T22:19:44.765724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.788811+0000","last_change":"2023-07-21T22:19:44.779517+0000","last_active":"2023-07-21T22:19:44.788811+0000","last_peered":"2023-07-21T22:19:44.788811+0000","last_clean":"2023-07-21T22:19:44.788811+0000","last_became_active":"2023-07-21T22:19:44.779216+0000","last_became_peered":"2023-07-21T22:19:44.779216+0000","last_unstale":"2023-07-21T22:19:44.788811+0000","last_undegraded":"2023-07-21T22:19:44.788811+0000","last_fullsized":"2023-07-21T22:19:44.788811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:41:47.182450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.773635+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:19:44.773635+0000","last_peered":"2023-07-21T22:19:44.773635+0000","last_clean":"2023-07-21T22:19:44.773635+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:19:44.773635+0000","last_undegraded":"2023-07-21T22:19:44.773635+0000","last_fullsized":"2023-07-21T22:19:44.773635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:26.209156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766654+0000","last_change":"2023-07-21T22:19:44.766654+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766654+0000","last_undegraded":"2023-07-21T22:19:44.766654+0000","last_fullsized":"2023-07-21T22:19:44.766654+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.782154+0000","last_change":"2023-07-21T22:19:44.778837+0000","last_active":"2023-07-21T22:19:44.782154+0000","last_peered":"2023-07-21T22:19:44.782154+0000","last_clean":"2023-07-21T22:19:44.782154+0000","last_became_active":"2023-07-21T22:19:44.778207+0000","last_became_peered":"2023-07-21T22:19:44.778207+0000","last_unstale":"2023-07-21T22:19:44.782154+0000","last_undegraded":"2023-07-21T22:19:44.782154+0000","last_fullsized":"2023-07-21T22:19:44.782154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:45:53.723203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T22:19:43.765265+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:19:43.765265+0000","last_peered":"2023-07-21T22:19:43.765265+0000","last_clean":"2023-07-21T22:19:43.765265+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:19:43.765265+0000","last_undegraded":"2023-07-21T22:19:43.765265+0000","last_fullsized":"2023-07-21T22:19:43.765265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:56:24.283075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":995328,"data_stored":750208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.63200000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.88}]},{"osd":2,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.84299999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.72499999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.91600000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":1.0129999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.80100000000000005}]}]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":159840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.503}]},{"osd":1,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48199999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.64400000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.72999999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54500000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.41499999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.70499999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":166468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.71999999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.749}]},{"osd":2,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.80600000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.85199999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.876}]},{"osd":7,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.95199999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":159840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.39800000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47999999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.90800000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.82499999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.94399999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":159840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.437},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.71799999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":159840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":5.4800000000000004,"5min":5.4800000000000004,"15min":5.4800000000000004},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.48899999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":3.4220000000000002,"5min":3.4220000000000002,"15min":3.4220000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.56299999999999994}]},{"osd":3,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":5.8710000000000004,"5min":5.8710000000000004,"15min":5.8710000000000004},"last":0.44}]},{"osd":4,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":3.6259999999999999,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.4100000000000001,"5min":4.4100000000000001,"15min":4.4100000000000001},"last":0.71399999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":5.766,"5min":5.766,"15min":5.766},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.669,"5min":3.669,"15min":3.669},"last":0.746}]},{"osd":6,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":5.8200000000000003,"5min":5.8200000000000003,"15min":5.8200000000000003},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.9269999999999996,"5min":5.9269999999999996,"15min":5.9269999999999996},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":3.5800000000000001,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.83599999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":995328,"data_stored":750208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.44}]},{"osd":2,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.33000000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.90400000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.77500000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.70799999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":389120,"data_stored":153670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":0.65900000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":8.6280000000000001,"5min":8.6280000000000001,"15min":8.6280000000000001},"last":0.623}]},{"osd":2,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.74099999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":3.1829999999999998,"5min":3.1829999999999998,"15min":3.1829999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":2.887,"5min":2.887,"15min":2.887},"last":0.76400000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.55600000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":8.0760000000000005,"5min":8.0760000000000005,"15min":8.0760000000000005},"last":0.78500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:19:50.343 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:19:50.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.467+0000 7f40e789c640 1 Processor -- start 2023-07-21T22:19:50.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.467+0000 7f40e789c640 1 -- start start 2023-07-21T22:19:50.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.471+0000 7f40e789c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40e0160330 0x7f40e00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:50.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.471+0000 7f40e789c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40e00c0f80 0x7f40e00cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:50.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.471+0000 7f40e789c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e00c17d0 con 0x7f40e00c8940 2023-07-21T22:19:50.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.471+0000 7f40e789c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e00c14f0 con 0x7f40e0160330 2023-07-21T22:19:50.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.471+0000 7f40e789c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e00cac10 con 0x7f40e00c0f80 2023-07-21T22:19:50.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.471+0000 7f40e5638640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40e0160330 0x7f40e00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:50.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.471+0000 7f40e4e37640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f40e00c8940 0x7f40e00ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33876/0 (socket says 172.21.15.6:33876) 2023-07-21T22:19:50.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.471+0000 7f40e4e37640 1 -- 172.21.15.6:0/2229954911 learned_addr learned my addr 172.21.15.6:0/2229954911 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:50.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.471+0000 7f40e5e39640 1 --2- 172.21.15.6:0/2229954911 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40e00c0f80 0x7f40e00cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:50.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.471+0000 7f40e5638640 1 -- 172.21.15.6:0/2229954911 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40e00c0f80 msgr2=0x7f40e00cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:50.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.471+0000 7f40e5638640 1 --2- 172.21.15.6:0/2229954911 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40e00c0f80 0x7f40e00cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.471+0000 7f40e5638640 1 -- 172.21.15.6:0/2229954911 >> v1:172.21.15.6:6789/0 conn(0x7f40e00c8940 legacy=0x7f40e00ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:50.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.471+0000 7f40e5638640 1 -- 172.21.15.6:0/2229954911 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e00caef0 con 0x7f40e0160330 2023-07-21T22:19:50.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.475+0000 7f40e5638640 1 --2- 172.21.15.6:0/2229954911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40e0160330 0x7f40e00cb6f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f40dc0097c0 tx=0x7f40dc01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c22d2e934003b93 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:50.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.475+0000 7f40d7fff640 1 -- 172.21.15.6:0/2229954911 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc0a8970 con 0x7f40e0160330 2023-07-21T22:19:50.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.475+0000 7f40d7fff640 1 -- 172.21.15.6:0/2229954911 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc0a8ad0 con 0x7f40e0160330 2023-07-21T22:19:50.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.475+0000 7f40d7fff640 1 -- 172.21.15.6:0/2229954911 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc0a8e60 con 0x7f40e0160330 2023-07-21T22:19:50.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.475+0000 7f40e789c640 1 -- 172.21.15.6:0/2229954911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40e0160330 msgr2=0x7f40e00cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:50.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.475+0000 7f40e789c640 1 --2- 172.21.15.6:0/2229954911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40e0160330 0x7f40e00cb6f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f40dc0097c0 tx=0x7f40dc01ec70 comp rx=0 tx=0).stop 2023-07-21T22:19:50.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.475+0000 7f40e789c640 1 -- 172.21.15.6:0/2229954911 shutdown_connections 2023-07-21T22:19:50.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.475+0000 7f40e789c640 1 --2- 172.21.15.6:0/2229954911 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40e00c0f80 0x7f40e00cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.475+0000 7f40e789c640 1 --2- 172.21.15.6:0/2229954911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40e0160330 0x7f40e00cb6f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.475+0000 7f40e789c640 1 -- 172.21.15.6:0/2229954911 >> 172.21.15.6:0/2229954911 conn(0x7f40e00afcf0 msgr2=0x7f40e00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:50.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.475+0000 7f40e789c640 1 -- 172.21.15.6:0/2229954911 shutdown_connections 2023-07-21T22:19:50.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.475+0000 7f40e789c640 1 -- 172.21.15.6:0/2229954911 wait complete. 2023-07-21T22:19:50.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.475+0000 7f40e789c640 1 Processor -- start 2023-07-21T22:19:50.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.475+0000 7f40e789c640 1 -- start start 2023-07-21T22:19:50.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e789c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40e00c0f80 0x7f40e00c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:50.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e789c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40e00c8940 0x7f40e00c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:50.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e789c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40e0160330 0x7f40e01f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:50.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e789c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e01f64a0 con 0x7f40e00c8940 2023-07-21T22:19:50.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e789c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e00c30f0 con 0x7f40e00c0f80 2023-07-21T22:19:50.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e789c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e00c3390 con 0x7f40e0160330 2023-07-21T22:19:50.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e4e37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40e00c8940 0x7f40e00c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:50.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e4e37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40e00c8940 0x7f40e00c6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48140/0 (socket says 172.21.15.6:48140) 2023-07-21T22:19:50.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e4e37640 1 -- 172.21.15.6:0/919288651 learned_addr learned my addr 172.21.15.6:0/919288651 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:50.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e5e39640 1 --2- 172.21.15.6:0/919288651 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40e0160330 0x7f40e01f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:50.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e5638640 1 --2- 172.21.15.6:0/919288651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40e00c0f80 0x7f40e00c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:50.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e4e37640 1 -- 172.21.15.6:0/919288651 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40e0160330 msgr2=0x7f40e01f5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:50.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e4e37640 1 --2- 172.21.15.6:0/919288651 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40e0160330 0x7f40e01f5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e4e37640 1 -- 172.21.15.6:0/919288651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40e00c0f80 msgr2=0x7f40e00c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:50.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e4e37640 1 --2- 172.21.15.6:0/919288651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40e00c0f80 0x7f40e00c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e4e37640 1 -- 172.21.15.6:0/919288651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc009420 con 0x7f40e00c8940 2023-07-21T22:19:50.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e5638640 1 --2- 172.21.15.6:0/919288651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40e00c0f80 0x7f40e00c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:50.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e4e37640 1 --2- 172.21.15.6:0/919288651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40e00c8940 0x7f40e00c6790 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f40d0005890 tx=0x7f40d000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:50.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40d5ffb640 1 -- 172.21.15.6:0/919288651 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d0005cf0 con 0x7f40e00c8940 2023-07-21T22:19:50.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40d5ffb640 1 -- 172.21.15.6:0/919288651 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d0005e50 con 0x7f40e00c8940 2023-07-21T22:19:50.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40d5ffb640 1 -- 172.21.15.6:0/919288651 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d00072b0 con 0x7f40e00c8940 2023-07-21T22:19:50.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e789c640 1 -- 172.21.15.6:0/919288651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e00c3670 con 0x7f40e00c8940 2023-07-21T22:19:50.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e789c640 1 -- 172.21.15.6:0/919288651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e015cf90 con 0x7f40e00c8940 2023-07-21T22:19:50.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40e789c640 1 -- 172.21.15.6:0/919288651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e00678d0 con 0x7f40e00c8940 2023-07-21T22:19:50.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.479+0000 7f40d5ffb640 1 -- 172.21.15.6:0/919288651 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f40d0007410 con 0x7f40e00c8940 2023-07-21T22:19:50.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.483+0000 7f40d5ffb640 1 --2- 172.21.15.6:0/919288651 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f40c4066280 0x7f40c4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:50.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.483+0000 7f40d5ffb640 1 -- 172.21.15.6:0/919288651 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f40d0083240 con 0x7f40e00c8940 2023-07-21T22:19:50.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.483+0000 7f40e5638640 1 --2- 172.21.15.6:0/919288651 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f40c4066280 0x7f40c4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:50.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.483+0000 7f40e5638640 1 --2- 172.21.15.6:0/919288651 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f40c4066280 0x7f40c4068730 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f40dc0b2000 tx=0x7f40dc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:50.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.487+0000 7f40d5ffb640 1 -- 172.21.15.6:0/919288651 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f40d00506e0 con 0x7f40e00c8940 2023-07-21T22:19:50.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.639+0000 7f40e789c640 1 -- 172.21.15.6:0/919288651 --> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40e0160700 con 0x7f40c4066280 2023-07-21T22:19:50.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.651+0000 7f40d5ffb640 1 -- 172.21.15.6:0/919288651 <== mgr.4103 v2:172.21.15.161:6832/3471136886 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305572 (secure 0 0 0) 0x7f40dc0b04c0 con 0x7f40c4066280 2023-07-21T22:19:50.701 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:50.703 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:19:50.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.655+0000 7f40e789c640 1 -- 172.21.15.6:0/919288651 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f40c4066280 msgr2=0x7f40c4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:50.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.655+0000 7f40e789c640 1 --2- 172.21.15.6:0/919288651 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f40c4066280 0x7f40c4068730 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f40dc0b2000 tx=0x7f40dc008040 comp rx=0 tx=0).stop 2023-07-21T22:19:50.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.655+0000 7f40e789c640 1 -- 172.21.15.6:0/919288651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40e00c8940 msgr2=0x7f40e00c6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:50.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.655+0000 7f40e789c640 1 --2- 172.21.15.6:0/919288651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40e00c8940 0x7f40e00c6790 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f40d0005890 tx=0x7f40d000c960 comp rx=0 tx=0).stop 2023-07-21T22:19:50.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.655+0000 7f40e789c640 1 -- 172.21.15.6:0/919288651 shutdown_connections 2023-07-21T22:19:50.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.655+0000 7f40e789c640 1 --2- 172.21.15.6:0/919288651 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40e0160330 0x7f40e01f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.655+0000 7f40e789c640 1 --2- 172.21.15.6:0/919288651 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f40c4066280 0x7f40c4068730 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.655+0000 7f40e789c640 1 --2- 172.21.15.6:0/919288651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40e00c8940 0x7f40e00c6790 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.655+0000 7f40e789c640 1 --2- 172.21.15.6:0/919288651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40e00c0f80 0x7f40e00c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.655+0000 7f40e789c640 1 -- 172.21.15.6:0/919288651 >> 172.21.15.6:0/919288651 conn(0x7f40e00afcf0 msgr2=0x7f40e00ade50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:50.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.655+0000 7f40e789c640 1 -- 172.21.15.6:0/919288651 shutdown_connections 2023-07-21T22:19:50.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.655+0000 7f40e789c640 1 -- 172.21.15.6:0/919288651 wait complete. 2023-07-21T22:19:50.720 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-07-21T22:19:48.783200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":198,"acting":198,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219912,"kb_used_data":4296,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754808,"statfs":{"total":773094113280,"available":772868923392,"internally_reserved":0,"allocated":4399104,"data_stored":2459914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.025726"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768022+0000","last_change":"2023-07-21T22:19:44.768022+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768022+0000","last_undegraded":"2023-07-21T22:19:44.768022+0000","last_fullsized":"2023-07-21T22:19:44.768022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.767197+0000","last_change":"2023-07-21T22:19:44.767197+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.767197+0000","last_undegraded":"2023-07-21T22:19:44.767197+0000","last_fullsized":"2023-07-21T22:19:44.767197+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768295+0000","last_change":"2023-07-21T22:19:44.768295+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768295+0000","last_undegraded":"2023-07-21T22:19:44.768295+0000","last_fullsized":"2023-07-21T22:19:44.768295+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766959+0000","last_change":"2023-07-21T22:19:44.766959+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766959+0000","last_undegraded":"2023-07-21T22:19:44.766959+0000","last_fullsized":"2023-07-21T22:19:44.766959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.763989+0000","last_change":"2023-07-21T22:19:44.763989+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.763989+0000","last_undegraded":"2023-07-21T22:19:44.763989+0000","last_fullsized":"2023-07-21T22:19:44.763989+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.763657+0000","last_change":"2023-07-21T22:19:44.763657+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.763657+0000","last_undegraded":"2023-07-21T22:19:44.763657+0000","last_fullsized":"2023-07-21T22:19:44.763657+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.773690+0000","last_change":"2023-07-21T22:19:44.773690+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.773690+0000","last_undegraded":"2023-07-21T22:19:44.773690+0000","last_fullsized":"2023-07-21T22:19:44.773690+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766125+0000","last_change":"2023-07-21T22:19:44.766125+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766125+0000","last_undegraded":"2023-07-21T22:19:44.766125+0000","last_fullsized":"2023-07-21T22:19:44.766125+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.769362+0000","last_change":"2023-07-21T22:19:44.769362+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.769362+0000","last_undegraded":"2023-07-21T22:19:44.769362+0000","last_fullsized":"2023-07-21T22:19:44.769362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.779034+0000","last_change":"2023-07-21T22:19:44.779034+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.779034+0000","last_undegraded":"2023-07-21T22:19:44.779034+0000","last_fullsized":"2023-07-21T22:19:44.779034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.774886+0000","last_change":"2023-07-21T22:19:44.774886+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.774886+0000","last_undegraded":"2023-07-21T22:19:44.774886+0000","last_fullsized":"2023-07-21T22:19:44.774886+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768913+0000","last_change":"2023-07-21T22:19:44.768913+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768913+0000","last_undegraded":"2023-07-21T22:19:44.768913+0000","last_fullsized":"2023-07-21T22:19:44.768913+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.770660+0000","last_change":"2023-07-21T22:19:44.770660+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.770660+0000","last_undegraded":"2023-07-21T22:19:44.770660+0000","last_fullsized":"2023-07-21T22:19:44.770660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766187+0000","last_change":"2023-07-21T22:19:44.766187+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766187+0000","last_undegraded":"2023-07-21T22:19:44.766187+0000","last_fullsized":"2023-07-21T22:19:44.766187+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.771715+0000","last_change":"2023-07-21T22:19:44.771715+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.771715+0000","last_undegraded":"2023-07-21T22:19:44.771715+0000","last_fullsized":"2023-07-21T22:19:44.771715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768059+0000","last_change":"2023-07-21T22:19:44.768059+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768059+0000","last_undegraded":"2023-07-21T22:19:44.768059+0000","last_fullsized":"2023-07-21T22:19:44.768059+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766520+0000","last_change":"2023-07-21T22:19:44.766520+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766520+0000","last_undegraded":"2023-07-21T22:19:44.766520+0000","last_fullsized":"2023-07-21T22:19:44.766520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:19:44.749638+0000","last_change":"2023-07-21T22:19:44.749638+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.749638+0000","last_undegraded":"2023-07-21T22:19:44.749638+0000","last_fullsized":"2023-07-21T22:19:44.749638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.767049+0000","last_change":"2023-07-21T22:19:44.767049+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.767049+0000","last_undegraded":"2023-07-21T22:19:44.767049+0000","last_fullsized":"2023-07-21T22:19:44.767049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:19:44.749638+0000","last_change":"2023-07-21T22:19:44.749638+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.749638+0000","last_undegraded":"2023-07-21T22:19:44.749638+0000","last_fullsized":"2023-07-21T22:19:44.749638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.771411+0000","last_change":"2023-07-21T22:19:44.771411+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.771411+0000","last_undegraded":"2023-07-21T22:19:44.771411+0000","last_fullsized":"2023-07-21T22:19:44.771411+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.764010+0000","last_change":"2023-07-21T22:19:44.764010+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.764010+0000","last_undegraded":"2023-07-21T22:19:44.764010+0000","last_fullsized":"2023-07-21T22:19:44.764010+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.767129+0000","last_change":"2023-07-21T22:19:44.767129+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.767129+0000","last_undegraded":"2023-07-21T22:19:44.767129+0000","last_fullsized":"2023-07-21T22:19:44.767129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.764715+0000","last_change":"2023-07-21T22:19:44.764715+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.764715+0000","last_undegraded":"2023-07-21T22:19:44.764715+0000","last_fullsized":"2023-07-21T22:19:44.764715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:19:44.749638+0000","last_change":"2023-07-21T22:19:44.749638+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.749638+0000","last_undegraded":"2023-07-21T22:19:44.749638+0000","last_fullsized":"2023-07-21T22:19:44.749638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.764497+0000","last_change":"2023-07-21T22:19:44.764497+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.764497+0000","last_undegraded":"2023-07-21T22:19:44.764497+0000","last_fullsized":"2023-07-21T22:19:44.764497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:19:44.749638+0000","last_change":"2023-07-21T22:19:44.749638+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.749638+0000","last_undegraded":"2023-07-21T22:19:44.749638+0000","last_fullsized":"2023-07-21T22:19:44.749638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.774031+0000","last_change":"2023-07-21T22:19:44.774031+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.774031+0000","last_undegraded":"2023-07-21T22:19:44.774031+0000","last_fullsized":"2023-07-21T22:19:44.774031+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:19:44.749638+0000","last_change":"2023-07-21T22:19:44.749638+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.749638+0000","last_undegraded":"2023-07-21T22:19:44.749638+0000","last_fullsized":"2023-07-21T22:19:44.749638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-21T22:19:44.749638+0000","last_change":"2023-07-21T22:19:44.749638+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.749638+0000","last_undegraded":"2023-07-21T22:19:44.749638+0000","last_fullsized":"2023-07-21T22:19:44.749638+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766623+0000","last_change":"2023-07-21T22:19:44.766623+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766623+0000","last_undegraded":"2023-07-21T22:19:44.766623+0000","last_fullsized":"2023-07-21T22:19:44.766623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.763159+0000","last_change":"2023-07-21T22:19:44.763159+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.763159+0000","last_undegraded":"2023-07-21T22:19:44.763159+0000","last_fullsized":"2023-07-21T22:19:44.763159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.765687+0000","last_change":"2023-07-21T22:19:44.765687+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.765687+0000","last_undegraded":"2023-07-21T22:19:44.765687+0000","last_fullsized":"2023-07-21T22:19:44.765687+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-07-21T22:19:43.764289+0000","last_change":"2023-07-21T22:19:43.764289+0000","last_active":"2023-07-21T22:19:43.740945+0000","last_peered":"2023-07-21T22:19:43.740945+0000","last_clean":"2023-07-21T22:19:43.740945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:43.764289+0000","last_undegraded":"2023-07-21T22:19:43.764289+0000","last_fullsized":"2023-07-21T22:19:43.764289+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.763516+0000","last_change":"2023-07-21T22:19:44.763516+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.763516+0000","last_undegraded":"2023-07-21T22:19:44.763516+0000","last_fullsized":"2023-07-21T22:19:44.763516+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.784165+0000","last_change":"2023-07-21T22:19:44.784165+0000","last_active":"2023-07-21T22:19:44.784165+0000","last_peered":"2023-07-21T22:19:44.784165+0000","last_clean":"2023-07-21T22:19:44.784165+0000","last_became_active":"2023-07-21T22:19:44.783159+0000","last_became_peered":"2023-07-21T22:19:44.783159+0000","last_unstale":"2023-07-21T22:19:44.784165+0000","last_undegraded":"2023-07-21T22:19:44.784165+0000","last_fullsized":"2023-07-21T22:19:44.784165+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:40:25.511271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.764880+0000","last_change":"2023-07-21T22:19:44.764880+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.764880+0000","last_undegraded":"2023-07-21T22:19:44.764880+0000","last_fullsized":"2023-07-21T22:19:44.764880+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.781601+0000","last_change":"2023-07-21T22:19:44.777629+0000","last_active":"2023-07-21T22:19:44.781601+0000","last_peered":"2023-07-21T22:19:44.781601+0000","last_clean":"2023-07-21T22:19:44.781601+0000","last_became_active":"2023-07-21T22:19:44.777335+0000","last_became_peered":"2023-07-21T22:19:44.777335+0000","last_unstale":"2023-07-21T22:19:44.781601+0000","last_undegraded":"2023-07-21T22:19:44.781601+0000","last_fullsized":"2023-07-21T22:19:44.781601+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:49:46.208003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768510+0000","last_change":"2023-07-21T22:19:44.768510+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768510+0000","last_undegraded":"2023-07-21T22:19:44.768510+0000","last_fullsized":"2023-07-21T22:19:44.768510+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.789651+0000","last_change":"2023-07-21T22:19:44.780467+0000","last_active":"2023-07-21T22:19:44.789651+0000","last_peered":"2023-07-21T22:19:44.789651+0000","last_clean":"2023-07-21T22:19:44.789651+0000","last_became_active":"2023-07-21T22:19:44.780154+0000","last_became_peered":"2023-07-21T22:19:44.780154+0000","last_unstale":"2023-07-21T22:19:44.789651+0000","last_undegraded":"2023-07-21T22:19:44.789651+0000","last_fullsized":"2023-07-21T22:19:44.789651+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:09:10.166181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.771673+0000","last_change":"2023-07-21T22:19:44.771673+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.771673+0000","last_undegraded":"2023-07-21T22:19:44.771673+0000","last_fullsized":"2023-07-21T22:19:44.771673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.792244+0000","last_change":"2023-07-21T22:19:44.787151+0000","last_active":"2023-07-21T22:19:44.792244+0000","last_peered":"2023-07-21T22:19:44.792244+0000","last_clean":"2023-07-21T22:19:44.792244+0000","last_became_active":"2023-07-21T22:19:44.786795+0000","last_became_peered":"2023-07-21T22:19:44.786795+0000","last_unstale":"2023-07-21T22:19:44.792244+0000","last_undegraded":"2023-07-21T22:19:44.792244+0000","last_fullsized":"2023-07-21T22:19:44.792244+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:22:55.835971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.771192+0000","last_change":"2023-07-21T22:19:44.771192+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.771192+0000","last_undegraded":"2023-07-21T22:19:44.771192+0000","last_fullsized":"2023-07-21T22:19:44.771192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.784675+0000","last_change":"2023-07-21T22:19:44.778629+0000","last_active":"2023-07-21T22:19:44.784675+0000","last_peered":"2023-07-21T22:19:44.784675+0000","last_clean":"2023-07-21T22:19:44.784675+0000","last_became_active":"2023-07-21T22:19:44.778106+0000","last_became_peered":"2023-07-21T22:19:44.778106+0000","last_unstale":"2023-07-21T22:19:44.784675+0000","last_undegraded":"2023-07-21T22:19:44.784675+0000","last_fullsized":"2023-07-21T22:19:44.784675+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:45:37.572263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.765253+0000","last_change":"2023-07-21T22:19:44.765253+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.765253+0000","last_undegraded":"2023-07-21T22:19:44.765253+0000","last_fullsized":"2023-07-21T22:19:44.765253+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.784029+0000","last_change":"2023-07-21T22:19:44.780493+0000","last_active":"2023-07-21T22:19:44.784029+0000","last_peered":"2023-07-21T22:19:44.784029+0000","last_clean":"2023-07-21T22:19:44.784029+0000","last_became_active":"2023-07-21T22:19:44.780040+0000","last_became_peered":"2023-07-21T22:19:44.780040+0000","last_unstale":"2023-07-21T22:19:44.784029+0000","last_undegraded":"2023-07-21T22:19:44.784029+0000","last_fullsized":"2023-07-21T22:19:44.784029+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:28:09.333154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.769994+0000","last_change":"2023-07-21T22:19:44.769994+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.769994+0000","last_undegraded":"2023-07-21T22:19:44.769994+0000","last_fullsized":"2023-07-21T22:19:44.769994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.788893+0000","last_change":"2023-07-21T22:19:44.779555+0000","last_active":"2023-07-21T22:19:44.788893+0000","last_peered":"2023-07-21T22:19:44.788893+0000","last_clean":"2023-07-21T22:19:44.788893+0000","last_became_active":"2023-07-21T22:19:44.779239+0000","last_became_peered":"2023-07-21T22:19:44.779239+0000","last_unstale":"2023-07-21T22:19:44.788893+0000","last_undegraded":"2023-07-21T22:19:44.788893+0000","last_fullsized":"2023-07-21T22:19:44.788893+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:50:17.073564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.763794+0000","last_change":"2023-07-21T22:19:44.763794+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.763794+0000","last_undegraded":"2023-07-21T22:19:44.763794+0000","last_fullsized":"2023-07-21T22:19:44.763794+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.785204+0000","last_change":"2023-07-21T22:19:44.785204+0000","last_active":"2023-07-21T22:19:44.785204+0000","last_peered":"2023-07-21T22:19:44.785204+0000","last_clean":"2023-07-21T22:19:44.785204+0000","last_became_active":"2023-07-21T22:19:44.784909+0000","last_became_peered":"2023-07-21T22:19:44.784909+0000","last_unstale":"2023-07-21T22:19:44.785204+0000","last_undegraded":"2023-07-21T22:19:44.785204+0000","last_fullsized":"2023-07-21T22:19:44.785204+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:43:15.721579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.767329+0000","last_change":"2023-07-21T22:19:44.767329+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.767329+0000","last_undegraded":"2023-07-21T22:19:44.767329+0000","last_fullsized":"2023-07-21T22:19:44.767329+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.792929+0000","last_change":"2023-07-21T22:19:44.790427+0000","last_active":"2023-07-21T22:19:44.792929+0000","last_peered":"2023-07-21T22:19:44.792929+0000","last_clean":"2023-07-21T22:19:44.792929+0000","last_became_active":"2023-07-21T22:19:44.790178+0000","last_became_peered":"2023-07-21T22:19:44.790178+0000","last_unstale":"2023-07-21T22:19:44.792929+0000","last_undegraded":"2023-07-21T22:19:44.792929+0000","last_fullsized":"2023-07-21T22:19:44.792929+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:46:53.814962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.769752+0000","last_change":"2023-07-21T22:19:44.769752+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.769752+0000","last_undegraded":"2023-07-21T22:19:44.769752+0000","last_fullsized":"2023-07-21T22:19:44.769752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.788454+0000","last_change":"2023-07-21T22:19:44.784266+0000","last_active":"2023-07-21T22:19:44.788454+0000","last_peered":"2023-07-21T22:19:44.788454+0000","last_clean":"2023-07-21T22:19:44.788454+0000","last_became_active":"2023-07-21T22:19:44.783964+0000","last_became_peered":"2023-07-21T22:19:44.783964+0000","last_unstale":"2023-07-21T22:19:44.788454+0000","last_undegraded":"2023-07-21T22:19:44.788454+0000","last_fullsized":"2023-07-21T22:19:44.788454+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:03:12.948637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.765043+0000","last_change":"2023-07-21T22:19:44.765043+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.765043+0000","last_undegraded":"2023-07-21T22:19:44.765043+0000","last_fullsized":"2023-07-21T22:19:44.765043+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.784552+0000","last_change":"2023-07-21T22:19:44.777147+0000","last_active":"2023-07-21T22:19:44.784552+0000","last_peered":"2023-07-21T22:19:44.784552+0000","last_clean":"2023-07-21T22:19:44.784552+0000","last_became_active":"2023-07-21T22:19:44.776832+0000","last_became_peered":"2023-07-21T22:19:44.776832+0000","last_unstale":"2023-07-21T22:19:44.784552+0000","last_undegraded":"2023-07-21T22:19:44.784552+0000","last_fullsized":"2023-07-21T22:19:44.784552+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:17:36.251165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.771152+0000","last_change":"2023-07-21T22:19:44.771152+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.771152+0000","last_undegraded":"2023-07-21T22:19:44.771152+0000","last_fullsized":"2023-07-21T22:19:44.771152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.785472+0000","last_change":"2023-07-21T22:19:44.785472+0000","last_active":"2023-07-21T22:19:44.785472+0000","last_peered":"2023-07-21T22:19:44.785472+0000","last_clean":"2023-07-21T22:19:44.785472+0000","last_became_active":"2023-07-21T22:19:44.785213+0000","last_became_peered":"2023-07-21T22:19:44.785213+0000","last_unstale":"2023-07-21T22:19:44.785472+0000","last_undegraded":"2023-07-21T22:19:44.785472+0000","last_fullsized":"2023-07-21T22:19:44.785472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:13:36.531608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.769316+0000","last_change":"2023-07-21T22:19:44.769316+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.769316+0000","last_undegraded":"2023-07-21T22:19:44.769316+0000","last_fullsized":"2023-07-21T22:19:44.769316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.787548+0000","last_change":"2023-07-21T22:19:44.783624+0000","last_active":"2023-07-21T22:19:44.787548+0000","last_peered":"2023-07-21T22:19:44.787548+0000","last_clean":"2023-07-21T22:19:44.787548+0000","last_became_active":"2023-07-21T22:19:44.783333+0000","last_became_peered":"2023-07-21T22:19:44.783333+0000","last_unstale":"2023-07-21T22:19:44.787548+0000","last_undegraded":"2023-07-21T22:19:44.787548+0000","last_fullsized":"2023-07-21T22:19:44.787548+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:32:02.965725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766122+0000","last_change":"2023-07-21T22:19:44.766122+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766122+0000","last_undegraded":"2023-07-21T22:19:44.766122+0000","last_fullsized":"2023-07-21T22:19:44.766122+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-07-21T22:19:43.764711+0000","last_change":"2023-07-21T22:19:43.764711+0000","last_active":"2023-07-21T22:19:43.740945+0000","last_peered":"2023-07-21T22:19:43.740945+0000","last_clean":"2023-07-21T22:19:43.740945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:43.764711+0000","last_undegraded":"2023-07-21T22:19:43.764711+0000","last_fullsized":"2023-07-21T22:19:43.764711+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768451+0000","last_change":"2023-07-21T22:19:44.768451+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768451+0000","last_undegraded":"2023-07-21T22:19:44.768451+0000","last_fullsized":"2023-07-21T22:19:44.768451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.784502+0000","last_change":"2023-07-21T22:19:44.778323+0000","last_active":"2023-07-21T22:19:44.784502+0000","last_peered":"2023-07-21T22:19:44.784502+0000","last_clean":"2023-07-21T22:19:44.784502+0000","last_became_active":"2023-07-21T22:19:44.778005+0000","last_became_peered":"2023-07-21T22:19:44.778005+0000","last_unstale":"2023-07-21T22:19:44.784502+0000","last_undegraded":"2023-07-21T22:19:44.784502+0000","last_fullsized":"2023-07-21T22:19:44.784502+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:00:12.364084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.767057+0000","last_change":"2023-07-21T22:19:44.767057+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.767057+0000","last_undegraded":"2023-07-21T22:19:44.767057+0000","last_fullsized":"2023-07-21T22:19:44.767057+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.792899+0000","last_change":"2023-07-21T22:19:44.789449+0000","last_active":"2023-07-21T22:19:44.792899+0000","last_peered":"2023-07-21T22:19:44.792899+0000","last_clean":"2023-07-21T22:19:44.792899+0000","last_became_active":"2023-07-21T22:19:44.789151+0000","last_became_peered":"2023-07-21T22:19:44.789151+0000","last_unstale":"2023-07-21T22:19:44.792899+0000","last_undegraded":"2023-07-21T22:19:44.792899+0000","last_fullsized":"2023-07-21T22:19:44.792899+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:55:24.800943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.774363+0000","last_change":"2023-07-21T22:19:44.774363+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.774363+0000","last_undegraded":"2023-07-21T22:19:44.774363+0000","last_fullsized":"2023-07-21T22:19:44.774363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.792205+0000","last_change":"2023-07-21T22:19:44.785599+0000","last_active":"2023-07-21T22:19:44.792205+0000","last_peered":"2023-07-21T22:19:44.792205+0000","last_clean":"2023-07-21T22:19:44.792205+0000","last_became_active":"2023-07-21T22:19:44.785328+0000","last_became_peered":"2023-07-21T22:19:44.785328+0000","last_unstale":"2023-07-21T22:19:44.792205+0000","last_undegraded":"2023-07-21T22:19:44.792205+0000","last_fullsized":"2023-07-21T22:19:44.792205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:50:28.731700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.765414+0000","last_change":"2023-07-21T22:19:44.765414+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.765414+0000","last_undegraded":"2023-07-21T22:19:44.765414+0000","last_fullsized":"2023-07-21T22:19:44.765414+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.778978+0000","last_change":"2023-07-21T22:19:44.774139+0000","last_active":"2023-07-21T22:19:44.778978+0000","last_peered":"2023-07-21T22:19:44.778978+0000","last_clean":"2023-07-21T22:19:44.778978+0000","last_became_active":"2023-07-21T22:19:44.773835+0000","last_became_peered":"2023-07-21T22:19:44.773835+0000","last_unstale":"2023-07-21T22:19:44.778978+0000","last_undegraded":"2023-07-21T22:19:44.778978+0000","last_fullsized":"2023-07-21T22:19:44.778978+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:08:10.427202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.762868+0000","last_change":"2023-07-21T22:19:44.762868+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.762868+0000","last_undegraded":"2023-07-21T22:19:44.762868+0000","last_fullsized":"2023-07-21T22:19:44.762868+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.781609+0000","last_change":"2023-07-21T22:19:44.777586+0000","last_active":"2023-07-21T22:19:44.781609+0000","last_peered":"2023-07-21T22:19:44.781609+0000","last_clean":"2023-07-21T22:19:44.781609+0000","last_became_active":"2023-07-21T22:19:44.777266+0000","last_became_peered":"2023-07-21T22:19:44.777266+0000","last_unstale":"2023-07-21T22:19:44.781609+0000","last_undegraded":"2023-07-21T22:19:44.781609+0000","last_fullsized":"2023-07-21T22:19:44.781609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:05.638815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.765560+0000","last_change":"2023-07-21T22:19:44.765560+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.765560+0000","last_undegraded":"2023-07-21T22:19:44.765560+0000","last_fullsized":"2023-07-21T22:19:44.765560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.780259+0000","last_change":"2023-07-21T22:19:44.777277+0000","last_active":"2023-07-21T22:19:44.780259+0000","last_peered":"2023-07-21T22:19:44.780259+0000","last_clean":"2023-07-21T22:19:44.780259+0000","last_became_active":"2023-07-21T22:19:44.776977+0000","last_became_peered":"2023-07-21T22:19:44.776977+0000","last_unstale":"2023-07-21T22:19:44.780259+0000","last_undegraded":"2023-07-21T22:19:44.780259+0000","last_fullsized":"2023-07-21T22:19:44.780259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:06:16.148343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.769392+0000","last_change":"2023-07-21T22:19:44.769392+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.769392+0000","last_undegraded":"2023-07-21T22:19:44.769392+0000","last_fullsized":"2023-07-21T22:19:44.769392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.778879+0000","last_change":"2023-07-21T22:19:44.771175+0000","last_active":"2023-07-21T22:19:44.778879+0000","last_peered":"2023-07-21T22:19:44.778879+0000","last_clean":"2023-07-21T22:19:44.778879+0000","last_became_active":"2023-07-21T22:19:44.770768+0000","last_became_peered":"2023-07-21T22:19:44.770768+0000","last_unstale":"2023-07-21T22:19:44.778879+0000","last_undegraded":"2023-07-21T22:19:44.778879+0000","last_fullsized":"2023-07-21T22:19:44.778879+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:26:57.618903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.779783+0000","last_change":"2023-07-21T22:19:44.779783+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.779783+0000","last_undegraded":"2023-07-21T22:19:44.779783+0000","last_fullsized":"2023-07-21T22:19:44.779783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.788284+0000","last_change":"2023-07-21T22:19:44.782353+0000","last_active":"2023-07-21T22:19:44.788284+0000","last_peered":"2023-07-21T22:19:44.788284+0000","last_clean":"2023-07-21T22:19:44.788284+0000","last_became_active":"2023-07-21T22:19:44.782034+0000","last_became_peered":"2023-07-21T22:19:44.782034+0000","last_unstale":"2023-07-21T22:19:44.788284+0000","last_undegraded":"2023-07-21T22:19:44.788284+0000","last_fullsized":"2023-07-21T22:19:44.788284+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:17:53.758418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.767979+0000","last_change":"2023-07-21T22:19:44.767979+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.767979+0000","last_undegraded":"2023-07-21T22:19:44.767979+0000","last_fullsized":"2023-07-21T22:19:44.767979+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.780224+0000","last_change":"2023-07-21T22:19:44.777212+0000","last_active":"2023-07-21T22:19:44.780224+0000","last_peered":"2023-07-21T22:19:44.780224+0000","last_clean":"2023-07-21T22:19:44.780224+0000","last_became_active":"2023-07-21T22:19:44.776901+0000","last_became_peered":"2023-07-21T22:19:44.776901+0000","last_unstale":"2023-07-21T22:19:44.780224+0000","last_undegraded":"2023-07-21T22:19:44.780224+0000","last_fullsized":"2023-07-21T22:19:44.780224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:55:10.392765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.774188+0000","last_change":"2023-07-21T22:19:44.774188+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.774188+0000","last_undegraded":"2023-07-21T22:19:44.774188+0000","last_fullsized":"2023-07-21T22:19:44.774188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.788228+0000","last_change":"2023-07-21T22:19:44.781768+0000","last_active":"2023-07-21T22:19:44.788228+0000","last_peered":"2023-07-21T22:19:44.788228+0000","last_clean":"2023-07-21T22:19:44.788228+0000","last_became_active":"2023-07-21T22:19:44.781490+0000","last_became_peered":"2023-07-21T22:19:44.781490+0000","last_unstale":"2023-07-21T22:19:44.788228+0000","last_undegraded":"2023-07-21T22:19:44.788228+0000","last_fullsized":"2023-07-21T22:19:44.788228+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:55:24.800943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":191,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.769000+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:19:44.769000+0000","last_peered":"2023-07-21T22:19:44.769000+0000","last_clean":"2023-07-21T22:19:44.769000+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:19:44.769000+0000","last_undegraded":"2023-07-21T22:19:44.769000+0000","last_fullsized":"2023-07-21T22:19:44.769000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:14:16.711607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.780940+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:19:44.780940+0000","last_peered":"2023-07-21T22:19:44.780940+0000","last_clean":"2023-07-21T22:19:44.780940+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:19:44.780940+0000","last_undegraded":"2023-07-21T22:19:44.780940+0000","last_fullsized":"2023-07-21T22:19:44.780940+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:02:49.722750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.764887+0000","last_change":"2023-07-21T22:19:44.764887+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.764887+0000","last_undegraded":"2023-07-21T22:19:44.764887+0000","last_fullsized":"2023-07-21T22:19:44.764887+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.788422+0000","last_change":"2023-07-21T22:19:44.783741+0000","last_active":"2023-07-21T22:19:44.788422+0000","last_peered":"2023-07-21T22:19:44.788422+0000","last_clean":"2023-07-21T22:19:44.788422+0000","last_became_active":"2023-07-21T22:19:44.783453+0000","last_became_peered":"2023-07-21T22:19:44.783453+0000","last_unstale":"2023-07-21T22:19:44.788422+0000","last_undegraded":"2023-07-21T22:19:44.788422+0000","last_fullsized":"2023-07-21T22:19:44.788422+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:15:29.350117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.768908+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:19:44.768908+0000","last_peered":"2023-07-21T22:19:44.768908+0000","last_clean":"2023-07-21T22:19:44.768908+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:19:44.768908+0000","last_undegraded":"2023-07-21T22:19:44.768908+0000","last_fullsized":"2023-07-21T22:19:44.768908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:36:13.815180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766813+0000","last_change":"2023-07-21T22:19:44.766813+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766813+0000","last_undegraded":"2023-07-21T22:19:44.766813+0000","last_fullsized":"2023-07-21T22:19:44.766813+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.783489+0000","last_change":"2023-07-21T22:19:44.781409+0000","last_active":"2023-07-21T22:19:44.783489+0000","last_peered":"2023-07-21T22:19:44.783489+0000","last_clean":"2023-07-21T22:19:44.783489+0000","last_became_active":"2023-07-21T22:19:44.781102+0000","last_became_peered":"2023-07-21T22:19:44.781102+0000","last_unstale":"2023-07-21T22:19:44.783489+0000","last_undegraded":"2023-07-21T22:19:44.783489+0000","last_fullsized":"2023-07-21T22:19:44.783489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:07:50.600290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.760572+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:19:44.760572+0000","last_peered":"2023-07-21T22:19:44.760572+0000","last_clean":"2023-07-21T22:19:44.760572+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:19:44.760572+0000","last_undegraded":"2023-07-21T22:19:44.760572+0000","last_fullsized":"2023-07-21T22:19:44.760572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:31.218728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766681+0000","last_change":"2023-07-21T22:19:44.766681+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766681+0000","last_undegraded":"2023-07-21T22:19:44.766681+0000","last_fullsized":"2023-07-21T22:19:44.766681+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.782520+0000","last_change":"2023-07-21T22:19:44.782520+0000","last_active":"2023-07-21T22:19:44.782520+0000","last_peered":"2023-07-21T22:19:44.782520+0000","last_clean":"2023-07-21T22:19:44.782520+0000","last_became_active":"2023-07-21T22:19:44.782191+0000","last_became_peered":"2023-07-21T22:19:44.782191+0000","last_unstale":"2023-07-21T22:19:44.782520+0000","last_undegraded":"2023-07-21T22:19:44.782520+0000","last_fullsized":"2023-07-21T22:19:44.782520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:20:48.080503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.780629+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:19:44.780629+0000","last_peered":"2023-07-21T22:19:44.780629+0000","last_clean":"2023-07-21T22:19:44.780629+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:19:44.780629+0000","last_undegraded":"2023-07-21T22:19:44.780629+0000","last_fullsized":"2023-07-21T22:19:44.780629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:22:10.939623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.768939+0000","last_change":"2023-07-21T22:19:44.768939+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.768939+0000","last_undegraded":"2023-07-21T22:19:44.768939+0000","last_fullsized":"2023-07-21T22:19:44.768939+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.784000+0000","last_change":"2023-07-21T22:19:44.781398+0000","last_active":"2023-07-21T22:19:44.784000+0000","last_peered":"2023-07-21T22:19:44.784000+0000","last_clean":"2023-07-21T22:19:44.784000+0000","last_became_active":"2023-07-21T22:19:44.781004+0000","last_became_peered":"2023-07-21T22:19:44.781004+0000","last_unstale":"2023-07-21T22:19:44.784000+0000","last_undegraded":"2023-07-21T22:19:44.784000+0000","last_fullsized":"2023-07-21T22:19:44.784000+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:07:04.484973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.769020+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:19:44.769020+0000","last_peered":"2023-07-21T22:19:44.769020+0000","last_clean":"2023-07-21T22:19:44.769020+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:19:44.769020+0000","last_undegraded":"2023-07-21T22:19:44.769020+0000","last_fullsized":"2023-07-21T22:19:44.769020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:14:06.976155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.763282+0000","last_change":"2023-07-21T22:19:44.763282+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.763282+0000","last_undegraded":"2023-07-21T22:19:44.763282+0000","last_fullsized":"2023-07-21T22:19:44.763282+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":36,"state":"creating+peering","last_fresh":"2023-07-21T22:19:43.764166+0000","last_change":"2023-07-21T22:19:43.764166+0000","last_active":"2023-07-21T22:19:43.740945+0000","last_peered":"2023-07-21T22:19:43.740945+0000","last_clean":"2023-07-21T22:19:43.740945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:43.764166+0000","last_undegraded":"2023-07-21T22:19:43.764166+0000","last_fullsized":"2023-07-21T22:19:43.764166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.775481+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:19:44.775481+0000","last_peered":"2023-07-21T22:19:44.775481+0000","last_clean":"2023-07-21T22:19:44.775481+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:19:44.775481+0000","last_undegraded":"2023-07-21T22:19:44.775481+0000","last_fullsized":"2023-07-21T22:19:44.775481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:06.464541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.765724+0000","last_change":"2023-07-21T22:19:44.765724+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.765724+0000","last_undegraded":"2023-07-21T22:19:44.765724+0000","last_fullsized":"2023-07-21T22:19:44.765724+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.788811+0000","last_change":"2023-07-21T22:19:44.779517+0000","last_active":"2023-07-21T22:19:44.788811+0000","last_peered":"2023-07-21T22:19:44.788811+0000","last_clean":"2023-07-21T22:19:44.788811+0000","last_became_active":"2023-07-21T22:19:44.779216+0000","last_became_peered":"2023-07-21T22:19:44.779216+0000","last_unstale":"2023-07-21T22:19:44.788811+0000","last_undegraded":"2023-07-21T22:19:44.788811+0000","last_fullsized":"2023-07-21T22:19:44.788811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:41:47.182450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.773635+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:19:44.773635+0000","last_peered":"2023-07-21T22:19:44.773635+0000","last_clean":"2023-07-21T22:19:44.773635+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:19:44.773635+0000","last_undegraded":"2023-07-21T22:19:44.773635+0000","last_fullsized":"2023-07-21T22:19:44.773635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:26.209156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-07-21T22:19:44.766654+0000","last_change":"2023-07-21T22:19:44.766654+0000","last_active":"2023-07-21T22:19:44.749638+0000","last_peered":"2023-07-21T22:19:44.749638+0000","last_clean":"2023-07-21T22:19:44.749638+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:19:44.766654+0000","last_undegraded":"2023-07-21T22:19:44.766654+0000","last_fullsized":"2023-07-21T22:19:44.766654+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-21T22:19:44.782154+0000","last_change":"2023-07-21T22:19:44.778837+0000","last_active":"2023-07-21T22:19:44.782154+0000","last_peered":"2023-07-21T22:19:44.782154+0000","last_clean":"2023-07-21T22:19:44.782154+0000","last_became_active":"2023-07-21T22:19:44.778207+0000","last_became_peered":"2023-07-21T22:19:44.778207+0000","last_unstale":"2023-07-21T22:19:44.782154+0000","last_undegraded":"2023-07-21T22:19:44.782154+0000","last_fullsized":"2023-07-21T22:19:44.782154+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:45:53.723203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-07-21T22:19:43.765265+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:19:43.765265+0000","last_peered":"2023-07-21T22:19:43.765265+0000","last_clean":"2023-07-21T22:19:43.765265+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:19:43.765265+0000","last_undegraded":"2023-07-21T22:19:43.765265+0000","last_fullsized":"2023-07-21T22:19:43.765265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:56:24.283075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509458,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":995328,"data_stored":750208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.63200000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.88}]},{"osd":2,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.84299999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.72499999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.91600000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":1.0129999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.80100000000000005}]}]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":159840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.503}]},{"osd":1,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48199999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.64400000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.72999999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.54500000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.41499999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.70499999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":413696,"data_stored":166468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.71999999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.749}]},{"osd":2,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.80600000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.85199999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.876}]},{"osd":7,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.95199999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509457,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":159840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.39800000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47999999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.42199999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.90800000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.82499999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.94399999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":159840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.437},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.64900000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.71799999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":401408,"data_stored":159840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":5.4800000000000004,"5min":5.4800000000000004,"15min":5.4800000000000004},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.48899999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":3.4220000000000002,"5min":3.4220000000000002,"15min":3.4220000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.56299999999999994}]},{"osd":3,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":5.8710000000000004,"5min":5.8710000000000004,"15min":5.8710000000000004},"last":0.44}]},{"osd":4,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":3.6259999999999999,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.4100000000000001,"5min":4.4100000000000001,"15min":4.4100000000000001},"last":0.71399999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":5.766,"5min":5.766,"15min":5.766},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.669,"5min":3.669,"15min":3.669},"last":0.746}]},{"osd":6,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":5.8200000000000003,"5min":5.8200000000000003,"15min":5.8200000000000003},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.9269999999999996,"5min":5.9269999999999996,"15min":5.9269999999999996},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":3.5800000000000001,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.83599999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509460,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":995328,"data_stored":750208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.44}]},{"osd":2,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.33000000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.90400000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.77500000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.70799999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":389120,"data_stored":153670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":0.65900000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":8.6280000000000001,"5min":8.6280000000000001,"15min":8.6280000000000001},"last":0.623}]},{"osd":2,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.74099999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":3.1829999999999998,"5min":3.1829999999999998,"15min":3.1829999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":2.887,"5min":2.887,"15min":2.887},"last":0.76400000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.55600000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":8.0760000000000005,"5min":8.0760000000000005,"15min":8.0760000000000005},"last":0.78500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:19:50.727 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-07-21T22:19:50.727 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.768022+0000', 'last_change': '2023-07-21T22:19:44.768022+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.768022+0000', 'last_undegraded': '2023-07-21T22:19:44.768022+0000', 'last_fullsized': '2023-07-21T22:19:44.768022+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:19:50.728 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-07-21T22:19:50.728 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.767197+0000', 'last_change': '2023-07-21T22:19:44.767197+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.767197+0000', 'last_undegraded': '2023-07-21T22:19:44.767197+0000', 'last_fullsized': '2023-07-21T22:19:44.767197+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:19:50.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-07-21T22:19:50.729 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.768295+0000', 'last_change': '2023-07-21T22:19:44.768295+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.768295+0000', 'last_undegraded': '2023-07-21T22:19:44.768295+0000', 'last_fullsized': '2023-07-21T22:19:44.768295+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:19:50.729 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-07-21T22:19:50.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.766959+0000', 'last_change': '2023-07-21T22:19:44.766959+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.766959+0000', 'last_undegraded': '2023-07-21T22:19:44.766959+0000', 'last_fullsized': '2023-07-21T22:19:44.766959+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:19:50.730 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-07-21T22:19:50.730 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.763989+0000', 'last_change': '2023-07-21T22:19:44.763989+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.763989+0000', 'last_undegraded': '2023-07-21T22:19:44.763989+0000', 'last_fullsized': '2023-07-21T22:19:44.763989+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:19:50.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-07-21T22:19:50.731 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.763657+0000', 'last_change': '2023-07-21T22:19:44.763657+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.763657+0000', 'last_undegraded': '2023-07-21T22:19:44.763657+0000', 'last_fullsized': '2023-07-21T22:19:44.763657+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:19:50.731 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-07-21T22:19:50.732 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.773690+0000', 'last_change': '2023-07-21T22:19:44.773690+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.773690+0000', 'last_undegraded': '2023-07-21T22:19:44.773690+0000', 'last_fullsized': '2023-07-21T22:19:44.773690+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:19:50.733 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-07-21T22:19:50.733 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.766125+0000', 'last_change': '2023-07-21T22:19:44.766125+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.766125+0000', 'last_undegraded': '2023-07-21T22:19:44.766125+0000', 'last_fullsized': '2023-07-21T22:19:44.766125+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:19:50.734 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-07-21T22:19:50.735 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.769362+0000', 'last_change': '2023-07-21T22:19:44.769362+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.769362+0000', 'last_undegraded': '2023-07-21T22:19:44.769362+0000', 'last_fullsized': '2023-07-21T22:19:44.769362+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:19:50.736 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-07-21T22:19:50.737 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.779034+0000', 'last_change': '2023-07-21T22:19:44.779034+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.779034+0000', 'last_undegraded': '2023-07-21T22:19:44.779034+0000', 'last_fullsized': '2023-07-21T22:19:44.779034+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:19:50.738 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-07-21T22:19:50.738 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.774886+0000', 'last_change': '2023-07-21T22:19:44.774886+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.774886+0000', 'last_undegraded': '2023-07-21T22:19:44.774886+0000', 'last_fullsized': '2023-07-21T22:19:44.774886+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:19:50.739 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-07-21T22:19:50.739 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.768913+0000', 'last_change': '2023-07-21T22:19:44.768913+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.768913+0000', 'last_undegraded': '2023-07-21T22:19:44.768913+0000', 'last_fullsized': '2023-07-21T22:19:44.768913+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:19:50.740 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-07-21T22:19:50.741 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.770660+0000', 'last_change': '2023-07-21T22:19:44.770660+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.770660+0000', 'last_undegraded': '2023-07-21T22:19:44.770660+0000', 'last_fullsized': '2023-07-21T22:19:44.770660+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:19:50.742 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-07-21T22:19:50.742 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.766187+0000', 'last_change': '2023-07-21T22:19:44.766187+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.766187+0000', 'last_undegraded': '2023-07-21T22:19:44.766187+0000', 'last_fullsized': '2023-07-21T22:19:44.766187+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:19:50.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-07-21T22:19:50.743 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.771715+0000', 'last_change': '2023-07-21T22:19:44.771715+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.771715+0000', 'last_undegraded': '2023-07-21T22:19:44.771715+0000', 'last_fullsized': '2023-07-21T22:19:44.771715+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:19:50.743 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-07-21T22:19:50.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.768059+0000', 'last_change': '2023-07-21T22:19:44.768059+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.768059+0000', 'last_undegraded': '2023-07-21T22:19:44.768059+0000', 'last_fullsized': '2023-07-21T22:19:44.768059+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:19:50.744 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-07-21T22:19:50.744 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.766520+0000', 'last_change': '2023-07-21T22:19:44.766520+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.766520+0000', 'last_undegraded': '2023-07-21T22:19:44.766520+0000', 'last_fullsized': '2023-07-21T22:19:44.766520+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:19:50.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-07-21T22:19:50.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:19:44.749638+0000', 'last_change': '2023-07-21T22:19:44.749638+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.749638+0000', 'last_undegraded': '2023-07-21T22:19:44.749638+0000', 'last_fullsized': '2023-07-21T22:19:44.749638+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:19:50.745 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-07-21T22:19:50.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.767049+0000', 'last_change': '2023-07-21T22:19:44.767049+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.767049+0000', 'last_undegraded': '2023-07-21T22:19:44.767049+0000', 'last_fullsized': '2023-07-21T22:19:44.767049+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:19:50.746 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-07-21T22:19:50.746 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:19:44.749638+0000', 'last_change': '2023-07-21T22:19:44.749638+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.749638+0000', 'last_undegraded': '2023-07-21T22:19:44.749638+0000', 'last_fullsized': '2023-07-21T22:19:44.749638+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:19:50.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-07-21T22:19:50.747 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.771411+0000', 'last_change': '2023-07-21T22:19:44.771411+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.771411+0000', 'last_undegraded': '2023-07-21T22:19:44.771411+0000', 'last_fullsized': '2023-07-21T22:19:44.771411+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:19:50.747 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-07-21T22:19:50.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.764010+0000', 'last_change': '2023-07-21T22:19:44.764010+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.764010+0000', 'last_undegraded': '2023-07-21T22:19:44.764010+0000', 'last_fullsized': '2023-07-21T22:19:44.764010+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:19:50.748 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-07-21T22:19:50.748 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.767129+0000', 'last_change': '2023-07-21T22:19:44.767129+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.767129+0000', 'last_undegraded': '2023-07-21T22:19:44.767129+0000', 'last_fullsized': '2023-07-21T22:19:44.767129+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:19:50.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-07-21T22:19:50.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.764715+0000', 'last_change': '2023-07-21T22:19:44.764715+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.764715+0000', 'last_undegraded': '2023-07-21T22:19:44.764715+0000', 'last_fullsized': '2023-07-21T22:19:44.764715+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:19:50.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-07-21T22:19:50.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:19:44.749638+0000', 'last_change': '2023-07-21T22:19:44.749638+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.749638+0000', 'last_undegraded': '2023-07-21T22:19:44.749638+0000', 'last_fullsized': '2023-07-21T22:19:44.749638+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:19:50.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-07-21T22:19:50.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.764497+0000', 'last_change': '2023-07-21T22:19:44.764497+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.764497+0000', 'last_undegraded': '2023-07-21T22:19:44.764497+0000', 'last_fullsized': '2023-07-21T22:19:44.764497+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:19:50.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-07-21T22:19:50.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:19:44.749638+0000', 'last_change': '2023-07-21T22:19:44.749638+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.749638+0000', 'last_undegraded': '2023-07-21T22:19:44.749638+0000', 'last_fullsized': '2023-07-21T22:19:44.749638+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:19:50.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-07-21T22:19:50.752 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.774031+0000', 'last_change': '2023-07-21T22:19:44.774031+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.774031+0000', 'last_undegraded': '2023-07-21T22:19:44.774031+0000', 'last_fullsized': '2023-07-21T22:19:44.774031+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:19:50.752 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-07-21T22:19:50.753 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:19:44.749638+0000', 'last_change': '2023-07-21T22:19:44.749638+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.749638+0000', 'last_undegraded': '2023-07-21T22:19:44.749638+0000', 'last_fullsized': '2023-07-21T22:19:44.749638+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:19:50.753 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-07-21T22:19:50.753 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-21T22:19:44.749638+0000', 'last_change': '2023-07-21T22:19:44.749638+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.749638+0000', 'last_undegraded': '2023-07-21T22:19:44.749638+0000', 'last_fullsized': '2023-07-21T22:19:44.749638+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-21T22:19:50.754 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-07-21T22:19:50.754 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.766623+0000', 'last_change': '2023-07-21T22:19:44.766623+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.766623+0000', 'last_undegraded': '2023-07-21T22:19:44.766623+0000', 'last_fullsized': '2023-07-21T22:19:44.766623+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:19:50.754 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-07-21T22:19:50.755 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.763159+0000', 'last_change': '2023-07-21T22:19:44.763159+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.763159+0000', 'last_undegraded': '2023-07-21T22:19:44.763159+0000', 'last_fullsized': '2023-07-21T22:19:44.763159+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:19:50.755 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-07-21T22:19:50.755 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.765687+0000', 'last_change': '2023-07-21T22:19:44.765687+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.765687+0000', 'last_undegraded': '2023-07-21T22:19:44.765687+0000', 'last_fullsized': '2023-07-21T22:19:44.765687+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:19:50.756 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-07-21T22:19:50.756 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:43.764289+0000', 'last_change': '2023-07-21T22:19:43.764289+0000', 'last_active': '2023-07-21T22:19:43.740945+0000', 'last_peered': '2023-07-21T22:19:43.740945+0000', 'last_clean': '2023-07-21T22:19:43.740945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:43.764289+0000', 'last_undegraded': '2023-07-21T22:19:43.764289+0000', 'last_fullsized': '2023-07-21T22:19:43.764289+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:43.740945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:43.740945+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:43.740945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:19:50.756 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-07-21T22:19:50.757 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.763516+0000', 'last_change': '2023-07-21T22:19:44.763516+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.763516+0000', 'last_undegraded': '2023-07-21T22:19:44.763516+0000', 'last_fullsized': '2023-07-21T22:19:44.763516+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:19:50.757 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-07-21T22:19:50.757 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.764880+0000', 'last_change': '2023-07-21T22:19:44.764880+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.764880+0000', 'last_undegraded': '2023-07-21T22:19:44.764880+0000', 'last_fullsized': '2023-07-21T22:19:44.764880+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:19:50.758 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-07-21T22:19:50.758 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.768510+0000', 'last_change': '2023-07-21T22:19:44.768510+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.768510+0000', 'last_undegraded': '2023-07-21T22:19:44.768510+0000', 'last_fullsized': '2023-07-21T22:19:44.768510+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:19:50.758 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-07-21T22:19:50.759 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.771673+0000', 'last_change': '2023-07-21T22:19:44.771673+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.771673+0000', 'last_undegraded': '2023-07-21T22:19:44.771673+0000', 'last_fullsized': '2023-07-21T22:19:44.771673+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:19:50.759 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-07-21T22:19:50.759 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.771192+0000', 'last_change': '2023-07-21T22:19:44.771192+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.771192+0000', 'last_undegraded': '2023-07-21T22:19:44.771192+0000', 'last_fullsized': '2023-07-21T22:19:44.771192+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:19:50.760 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-07-21T22:19:50.760 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.765253+0000', 'last_change': '2023-07-21T22:19:44.765253+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.765253+0000', 'last_undegraded': '2023-07-21T22:19:44.765253+0000', 'last_fullsized': '2023-07-21T22:19:44.765253+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:19:50.760 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-07-21T22:19:50.761 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.769994+0000', 'last_change': '2023-07-21T22:19:44.769994+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.769994+0000', 'last_undegraded': '2023-07-21T22:19:44.769994+0000', 'last_fullsized': '2023-07-21T22:19:44.769994+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:19:50.761 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-07-21T22:19:50.761 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.763794+0000', 'last_change': '2023-07-21T22:19:44.763794+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.763794+0000', 'last_undegraded': '2023-07-21T22:19:44.763794+0000', 'last_fullsized': '2023-07-21T22:19:44.763794+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:19:50.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-07-21T22:19:50.762 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.767329+0000', 'last_change': '2023-07-21T22:19:44.767329+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.767329+0000', 'last_undegraded': '2023-07-21T22:19:44.767329+0000', 'last_fullsized': '2023-07-21T22:19:44.767329+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:19:50.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-07-21T22:19:50.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.769752+0000', 'last_change': '2023-07-21T22:19:44.769752+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.769752+0000', 'last_undegraded': '2023-07-21T22:19:44.769752+0000', 'last_fullsized': '2023-07-21T22:19:44.769752+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:19:50.763 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-07-21T22:19:50.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.765043+0000', 'last_change': '2023-07-21T22:19:44.765043+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.765043+0000', 'last_undegraded': '2023-07-21T22:19:44.765043+0000', 'last_fullsized': '2023-07-21T22:19:44.765043+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:19:50.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-07-21T22:19:50.764 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.771152+0000', 'last_change': '2023-07-21T22:19:44.771152+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.771152+0000', 'last_undegraded': '2023-07-21T22:19:44.771152+0000', 'last_fullsized': '2023-07-21T22:19:44.771152+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:19:50.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-07-21T22:19:50.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.769316+0000', 'last_change': '2023-07-21T22:19:44.769316+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.769316+0000', 'last_undegraded': '2023-07-21T22:19:44.769316+0000', 'last_fullsized': '2023-07-21T22:19:44.769316+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:19:50.765 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-07-21T22:19:50.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.766122+0000', 'last_change': '2023-07-21T22:19:44.766122+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.766122+0000', 'last_undegraded': '2023-07-21T22:19:44.766122+0000', 'last_fullsized': '2023-07-21T22:19:44.766122+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:19:50.766 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-07-21T22:19:50.766 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:43.764711+0000', 'last_change': '2023-07-21T22:19:43.764711+0000', 'last_active': '2023-07-21T22:19:43.740945+0000', 'last_peered': '2023-07-21T22:19:43.740945+0000', 'last_clean': '2023-07-21T22:19:43.740945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:43.764711+0000', 'last_undegraded': '2023-07-21T22:19:43.764711+0000', 'last_fullsized': '2023-07-21T22:19:43.764711+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:43.740945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:43.740945+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:43.740945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:19:50.766 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-07-21T22:19:50.767 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.768451+0000', 'last_change': '2023-07-21T22:19:44.768451+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.768451+0000', 'last_undegraded': '2023-07-21T22:19:44.768451+0000', 'last_fullsized': '2023-07-21T22:19:44.768451+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:19:50.767 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-07-21T22:19:50.767 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.767057+0000', 'last_change': '2023-07-21T22:19:44.767057+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.767057+0000', 'last_undegraded': '2023-07-21T22:19:44.767057+0000', 'last_fullsized': '2023-07-21T22:19:44.767057+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:19:50.768 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-07-21T22:19:50.768 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.774363+0000', 'last_change': '2023-07-21T22:19:44.774363+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.774363+0000', 'last_undegraded': '2023-07-21T22:19:44.774363+0000', 'last_fullsized': '2023-07-21T22:19:44.774363+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:19:50.769 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-07-21T22:19:50.769 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.765414+0000', 'last_change': '2023-07-21T22:19:44.765414+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.765414+0000', 'last_undegraded': '2023-07-21T22:19:44.765414+0000', 'last_fullsized': '2023-07-21T22:19:44.765414+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:19:50.769 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-07-21T22:19:50.770 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.762868+0000', 'last_change': '2023-07-21T22:19:44.762868+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.762868+0000', 'last_undegraded': '2023-07-21T22:19:44.762868+0000', 'last_fullsized': '2023-07-21T22:19:44.762868+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:19:50.770 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-07-21T22:19:50.770 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.765560+0000', 'last_change': '2023-07-21T22:19:44.765560+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.765560+0000', 'last_undegraded': '2023-07-21T22:19:44.765560+0000', 'last_fullsized': '2023-07-21T22:19:44.765560+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:19:50.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-07-21T22:19:50.771 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.769392+0000', 'last_change': '2023-07-21T22:19:44.769392+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.769392+0000', 'last_undegraded': '2023-07-21T22:19:44.769392+0000', 'last_fullsized': '2023-07-21T22:19:44.769392+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:19:50.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-07-21T22:19:50.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.779783+0000', 'last_change': '2023-07-21T22:19:44.779783+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.779783+0000', 'last_undegraded': '2023-07-21T22:19:44.779783+0000', 'last_fullsized': '2023-07-21T22:19:44.779783+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:19:50.772 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-07-21T22:19:50.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.767979+0000', 'last_change': '2023-07-21T22:19:44.767979+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.767979+0000', 'last_undegraded': '2023-07-21T22:19:44.767979+0000', 'last_fullsized': '2023-07-21T22:19:44.767979+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:19:50.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-07-21T22:19:50.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.774188+0000', 'last_change': '2023-07-21T22:19:44.774188+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.774188+0000', 'last_undegraded': '2023-07-21T22:19:44.774188+0000', 'last_fullsized': '2023-07-21T22:19:44.774188+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:19:50.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-07-21T22:19:50.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.764887+0000', 'last_change': '2023-07-21T22:19:44.764887+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.764887+0000', 'last_undegraded': '2023-07-21T22:19:44.764887+0000', 'last_fullsized': '2023-07-21T22:19:44.764887+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:19:50.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-07-21T22:19:50.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.766813+0000', 'last_change': '2023-07-21T22:19:44.766813+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.766813+0000', 'last_undegraded': '2023-07-21T22:19:44.766813+0000', 'last_fullsized': '2023-07-21T22:19:44.766813+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:19:50.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-07-21T22:19:50.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.766681+0000', 'last_change': '2023-07-21T22:19:44.766681+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.766681+0000', 'last_undegraded': '2023-07-21T22:19:44.766681+0000', 'last_fullsized': '2023-07-21T22:19:44.766681+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:19:50.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-07-21T22:19:50.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.768939+0000', 'last_change': '2023-07-21T22:19:44.768939+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.768939+0000', 'last_undegraded': '2023-07-21T22:19:44.768939+0000', 'last_fullsized': '2023-07-21T22:19:44.768939+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:19:50.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-07-21T22:19:50.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.763282+0000', 'last_change': '2023-07-21T22:19:44.763282+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.763282+0000', 'last_undegraded': '2023-07-21T22:19:44.763282+0000', 'last_fullsized': '2023-07-21T22:19:44.763282+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:19:50.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-07-21T22:19:50.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 36, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:43.764166+0000', 'last_change': '2023-07-21T22:19:43.764166+0000', 'last_active': '2023-07-21T22:19:43.740945+0000', 'last_peered': '2023-07-21T22:19:43.740945+0000', 'last_clean': '2023-07-21T22:19:43.740945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:43.764166+0000', 'last_undegraded': '2023-07-21T22:19:43.764166+0000', 'last_fullsized': '2023-07-21T22:19:43.764166+0000', 'mapping_epoch': 36, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 36, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:43.740945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:43.740945+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:43.740945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:19:50.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-07-21T22:19:50.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.765724+0000', 'last_change': '2023-07-21T22:19:44.765724+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.765724+0000', 'last_undegraded': '2023-07-21T22:19:44.765724+0000', 'last_fullsized': '2023-07-21T22:19:44.765724+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:19:50.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-07-21T22:19:50.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:19:44.766654+0000', 'last_change': '2023-07-21T22:19:44.766654+0000', 'last_active': '2023-07-21T22:19:44.749638+0000', 'last_peered': '2023-07-21T22:19:44.749638+0000', 'last_clean': '2023-07-21T22:19:44.749638+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:19:44.766654+0000', 'last_undegraded': '2023-07-21T22:19:44.766654+0000', 'last_fullsized': '2023-07-21T22:19:44.766654+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'last_clean_scrub_stamp': '2023-07-21T22:19:44.749638+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:19:50.780 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-21T22:19:50.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.875+0000 7fedb8819640 1 Processor -- start 2023-07-21T22:19:50.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.879+0000 7fedb8819640 1 -- start start 2023-07-21T22:19:50.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.879+0000 7fedb8819640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fedb40cb100 0x7fedb40cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:50.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.879+0000 7fedb8819640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb40cac70 con 0x7fedb406b1e0 2023-07-21T22:19:50.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.879+0000 7fedb8819640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb40cba60 con 0x7fedb4070b70 2023-07-21T22:19:50.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.879+0000 7fedb8819640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb40ca060 con 0x7fedb40cb100 2023-07-21T22:19:50.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.879+0000 7fedb2d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fedb40cb100 0x7fedb40cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:50.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.879+0000 7fedb2d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fedb40cb100 0x7fedb40cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48150/0 (socket says 172.21.15.6:48150) 2023-07-21T22:19:50.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.879+0000 7fedb2d9d640 1 -- 172.21.15.6:0/520460705 learned_addr learned my addr 172.21.15.6:0/520460705 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.879+0000 7fedb2d9d640 1 -- 172.21.15.6:0/520460705 >> v1:172.21.15.161:6789/0 conn(0x7fedb4070b70 legacy=0x7fedb4070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.879+0000 7fedb2d9d640 1 -- 172.21.15.6:0/520460705 >> v1:172.21.15.6:6789/0 conn(0x7fedb406b1e0 legacy=0x7fedb40c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.879+0000 7fedb2d9d640 1 -- 172.21.15.6:0/520460705 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb40ca340 con 0x7fedb40cb100 2023-07-21T22:19:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.879+0000 7fedb1d9b640 1 -- 172.21.15.6:0/520460705 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736763273 0 0) 0x7fedb40cac70 con 0x7fedb406b1e0 2023-07-21T22:19:50.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.883+0000 7fedb2d9d640 1 --2- 172.21.15.6:0/520460705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40cb100 0x7fedb40cb520 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fedac009e50 tx=0x7fedac01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7905b4dee8a9bf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.883+0000 7fedb1d9b640 1 -- 172.21.15.6:0/520460705 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac0a58a0 con 0x7fedb40cb100 2023-07-21T22:19:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.883+0000 7fedb1d9b640 1 -- 172.21.15.6:0/520460705 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac0a5a00 con 0x7fedb40cb100 2023-07-21T22:19:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.883+0000 7fedb1d9b640 1 -- 172.21.15.6:0/520460705 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac0a5d90 con 0x7fedb40cb100 2023-07-21T22:19:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.883+0000 7fedb8819640 1 -- 172.21.15.6:0/520460705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40cb100 msgr2=0x7fedb40cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.883+0000 7fedb8819640 1 --2- 172.21.15.6:0/520460705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40cb100 0x7fedb40cb520 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fedac009e50 tx=0x7fedac01c9e0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.883+0000 7fedb8819640 1 -- 172.21.15.6:0/520460705 shutdown_connections 2023-07-21T22:19:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.883+0000 7fedb8819640 1 --2- 172.21.15.6:0/520460705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40cb100 0x7fedb40cb520 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.883+0000 7fedb8819640 1 -- 172.21.15.6:0/520460705 >> 172.21.15.6:0/520460705 conn(0x7fedb40afcf0 msgr2=0x7fedb40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.883+0000 7fedb8819640 1 -- 172.21.15.6:0/520460705 shutdown_connections 2023-07-21T22:19:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.883+0000 7fedb8819640 1 -- 172.21.15.6:0/520460705 wait complete. 2023-07-21T22:19:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.883+0000 7fedb8819640 1 Processor -- start 2023-07-21T22:19:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.883+0000 7fedb8819640 1 -- start start 2023-07-21T22:19:50.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedb8819640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb406b1e0 0x7fedb40c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:50.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedb8819640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedb4070b70 0x7fedb40a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:50.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedb8819640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40cb100 0x7fedb40aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:50.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedb8819640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb41f1f10 con 0x7fedb40cb100 2023-07-21T22:19:50.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedb8819640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb40a91e0 con 0x7fedb4070b70 2023-07-21T22:19:50.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedb8819640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb40a8390 con 0x7fedb406b1e0 2023-07-21T22:19:50.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedb2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40cb100 0x7fedb40aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:50.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedb2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40cb100 0x7fedb40aed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48152/0 (socket says 172.21.15.6:48152) 2023-07-21T22:19:50.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedb2d9d640 1 -- 172.21.15.6:0/290610208 learned_addr learned my addr 172.21.15.6:0/290610208 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:50.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedb259c640 1 --2- 172.21.15.6:0/290610208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb406b1e0 0x7fedb40c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:50.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedabfff640 1 --2- 172.21.15.6:0/290610208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedb4070b70 0x7fedb40a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedb2d9d640 1 -- 172.21.15.6:0/290610208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb406b1e0 msgr2=0x7fedb40c8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedb2d9d640 1 --2- 172.21.15.6:0/290610208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb406b1e0 0x7fedb40c8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedb2d9d640 1 -- 172.21.15.6:0/290610208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedb4070b70 msgr2=0x7fedb40a7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedb2d9d640 1 --2- 172.21.15.6:0/290610208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedb4070b70 0x7fedb40a7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedb2d9d640 1 -- 172.21.15.6:0/290610208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac009b30 con 0x7fedb40cb100 2023-07-21T22:19:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedb2d9d640 1 --2- 172.21.15.6:0/290610208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40cb100 0x7fedb40aed30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fedac0af040 tx=0x7fedac019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedaaffd640 1 -- 172.21.15.6:0/290610208 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac0b8880 con 0x7fedb40cb100 2023-07-21T22:19:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedaaffd640 1 -- 172.21.15.6:0/290610208 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac0b8a00 con 0x7fedb40cb100 2023-07-21T22:19:50.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedaaffd640 1 -- 172.21.15.6:0/290610208 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac0b8db0 con 0x7fedb40cb100 2023-07-21T22:19:50.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedb8819640 1 -- 172.21.15.6:0/290610208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb40a8660 con 0x7fedb40cb100 2023-07-21T22:19:50.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedb8819640 1 -- 172.21.15.6:0/290610208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb40a8c20 con 0x7fedb40cb100 2023-07-21T22:19:50.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.887+0000 7fedb8819640 1 -- 172.21.15.6:0/290610208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb41f2080 con 0x7fedb40cb100 2023-07-21T22:19:50.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.891+0000 7fedaaffd640 1 -- 172.21.15.6:0/290610208 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fedac0c3460 con 0x7fedb40cb100 2023-07-21T22:19:50.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.891+0000 7fedaaffd640 1 --2- 172.21.15.6:0/290610208 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fed94066280 0x7fed94068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:50.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.891+0000 7fedaaffd640 1 -- 172.21.15.6:0/290610208 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fedac11f490 con 0x7fedb40cb100 2023-07-21T22:19:50.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.891+0000 7fedb259c640 1 --2- 172.21.15.6:0/290610208 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fed94066280 0x7fed94068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:50.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.891+0000 7fedb259c640 1 --2- 172.21.15.6:0/290610208 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fed94066280 0x7fed94068730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7feda4007fd0 tx=0x7feda4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:50.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:50.895+0000 7fedaaffd640 1 -- 172.21.15.6:0/290610208 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fedac0eca40 con 0x7fedb40cb100 2023-07-21T22:19:51.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.103+0000 7fedb8819640 1 -- 172.21.15.6:0/290610208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fedb40678d0 con 0x7fedb40cb100 2023-07-21T22:19:51.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.103+0000 7fedaaffd640 1 -- 172.21.15.6:0/290610208 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1432 (secure 0 0 0) 0x7fedac0f0060 con 0x7fedb40cb100 2023-07-21T22:19:51.153 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:51.153 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":93,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1689977909,"num_in_osds":8,"osd_in_since":1689977900,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592730,"bytes_used":225550336,"bytes_avail":772868562944,"bytes_total":773094113280,"write_bytes_sec":2380,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5181}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-07-21T22:19:34.780400+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-21T22:19:51.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.107+0000 7fedb8819640 1 -- 172.21.15.6:0/290610208 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fed94066280 msgr2=0x7fed94068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:51.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.107+0000 7fedb8819640 1 --2- 172.21.15.6:0/290610208 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fed94066280 0x7fed94068730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7feda4007fd0 tx=0x7feda4009040 comp rx=0 tx=0).stop 2023-07-21T22:19:51.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.107+0000 7fedb8819640 1 -- 172.21.15.6:0/290610208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40cb100 msgr2=0x7fedb40aed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:51.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.107+0000 7fedb8819640 1 --2- 172.21.15.6:0/290610208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40cb100 0x7fedb40aed30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fedac0af040 tx=0x7fedac019780 comp rx=0 tx=0).stop 2023-07-21T22:19:51.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.107+0000 7fedb8819640 1 -- 172.21.15.6:0/290610208 shutdown_connections 2023-07-21T22:19:51.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.107+0000 7fedb8819640 1 --2- 172.21.15.6:0/290610208 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fed94066280 0x7fed94068730 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:51.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.107+0000 7fedb8819640 1 --2- 172.21.15.6:0/290610208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40cb100 0x7fedb40aed30 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:51.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.107+0000 7fedb8819640 1 --2- 172.21.15.6:0/290610208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedb4070b70 0x7fedb40a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:51.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.107+0000 7fedb8819640 1 --2- 172.21.15.6:0/290610208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb406b1e0 0x7fedb40c8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:51.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.107+0000 7fedb8819640 1 -- 172.21.15.6:0/290610208 >> 172.21.15.6:0/290610208 conn(0x7fedb40afcf0 msgr2=0x7fedb40b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:51.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.107+0000 7fedb8819640 1 -- 172.21.15.6:0/290610208 shutdown_connections 2023-07-21T22:19:51.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.107+0000 7fedb8819640 1 -- 172.21.15.6:0/290610208 wait complete. 2023-07-21T22:19:51.174 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-21T22:19:51.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:19:51.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.271+0000 7fbb78111640 1 Processor -- start 2023-07-21T22:19:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.271+0000 7fbb78111640 1 -- start start 2023-07-21T22:19:51.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.271+0000 7fbb78111640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbb700b7c70 0x7fbb700d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:51.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.271+0000 7fbb78111640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb700d1850 0x7fbb7015f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:51.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.271+0000 7fbb78111640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb700ccaf0 con 0x7fbb700d1300 2023-07-21T22:19:51.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.271+0000 7fbb78111640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb700d1190 con 0x7fbb700b7c70 2023-07-21T22:19:51.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.271+0000 7fbb78111640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb70160600 con 0x7fbb700d1850 2023-07-21T22:19:51.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.271+0000 7fbb75ead640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbb700b7c70 0x7fbb700d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:51.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.271+0000 7fbb75ead640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbb700b7c70 0x7fbb700d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48162/0 (socket says 172.21.15.6:48162) 2023-07-21T22:19:51.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.271+0000 7fbb75ead640 1 -- 172.21.15.6:0/4271957075 learned_addr learned my addr 172.21.15.6:0/4271957075 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:51.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.271+0000 7fbb756ac640 1 --2- 172.21.15.6:0/4271957075 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb700d1850 0x7fbb7015f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:51.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.271+0000 7fbb75ead640 1 -- 172.21.15.6:0/4271957075 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb700d1850 msgr2=0x7fbb7015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:51.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.271+0000 7fbb75ead640 1 --2- 172.21.15.6:0/4271957075 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb700d1850 0x7fbb7015f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:51.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.271+0000 7fbb75ead640 1 -- 172.21.15.6:0/4271957075 >> v1:172.21.15.161:6789/0 conn(0x7fbb700d1300 legacy=0x7fbb700d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:51.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.271+0000 7fbb75ead640 1 -- 172.21.15.6:0/4271957075 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb70160320 con 0x7fbb700b7c70 2023-07-21T22:19:51.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.275+0000 7fbb75ead640 1 --2- 172.21.15.6:0/4271957075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb700b7c70 0x7fbb700d0c50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0098a0 tx=0x7fbb6c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a87f16c3bd6abbb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:51.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.275+0000 7fbb74eab640 1 -- 172.21.15.6:0/4271957075 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c0ad680 con 0x7fbb700b7c70 2023-07-21T22:19:51.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.275+0000 7fbb74eab640 1 -- 172.21.15.6:0/4271957075 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6c0ad7e0 con 0x7fbb700b7c70 2023-07-21T22:19:51.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.275+0000 7fbb74eab640 1 -- 172.21.15.6:0/4271957075 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c0adb70 con 0x7fbb700b7c70 2023-07-21T22:19:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.275+0000 7fbb78111640 1 -- 172.21.15.6:0/4271957075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb700b7c70 msgr2=0x7fbb700d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.275+0000 7fbb78111640 1 --2- 172.21.15.6:0/4271957075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb700b7c70 0x7fbb700d0c50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0098a0 tx=0x7fbb6c01c4b0 comp rx=0 tx=0).stop 2023-07-21T22:19:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.275+0000 7fbb78111640 1 -- 172.21.15.6:0/4271957075 shutdown_connections 2023-07-21T22:19:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.275+0000 7fbb78111640 1 --2- 172.21.15.6:0/4271957075 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb700d1850 0x7fbb7015f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.275+0000 7fbb78111640 1 --2- 172.21.15.6:0/4271957075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb700b7c70 0x7fbb700d0c50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.275+0000 7fbb78111640 1 -- 172.21.15.6:0/4271957075 >> 172.21.15.6:0/4271957075 conn(0x7fbb700650b0 msgr2=0x7fbb700654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:51.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.275+0000 7fbb78111640 1 -- 172.21.15.6:0/4271957075 shutdown_connections 2023-07-21T22:19:51.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.275+0000 7fbb78111640 1 -- 172.21.15.6:0/4271957075 wait complete. 2023-07-21T22:19:51.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb78111640 1 Processor -- start 2023-07-21T22:19:51.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb78111640 1 -- start start 2023-07-21T22:19:51.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb78111640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb700b7c70 0x7fbb700b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb78111640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb700d1300 0x7fbb70159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb78111640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb700d1850 0x7fbb7015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb78111640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7015cd70 con 0x7fbb700d1850 2023-07-21T22:19:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb78111640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7015ef80 con 0x7fbb700d1300 2023-07-21T22:19:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb78111640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7015e160 con 0x7fbb700b7c70 2023-07-21T22:19:51.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb766ae640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb700d1850 0x7fbb7015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:51.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb766ae640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb700d1850 0x7fbb7015a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48174/0 (socket says 172.21.15.6:48174) 2023-07-21T22:19:51.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb766ae640 1 -- 172.21.15.6:0/1604316708 learned_addr learned my addr 172.21.15.6:0/1604316708 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:51.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb756ac640 1 --2- 172.21.15.6:0/1604316708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb700d1300 0x7fbb70159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:51.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb75ead640 1 --2- 172.21.15.6:0/1604316708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb700b7c70 0x7fbb700b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:51.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb766ae640 1 -- 172.21.15.6:0/1604316708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb700b7c70 msgr2=0x7fbb700b62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:51.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb766ae640 1 --2- 172.21.15.6:0/1604316708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb700b7c70 0x7fbb700b62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb766ae640 1 -- 172.21.15.6:0/1604316708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb700d1300 msgr2=0x7fbb70159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb766ae640 1 --2- 172.21.15.6:0/1604316708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb700d1300 0x7fbb70159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb766ae640 1 -- 172.21.15.6:0/1604316708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6c0094d0 con 0x7fbb700d1850 2023-07-21T22:19:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb766ae640 1 --2- 172.21.15.6:0/1604316708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb700d1850 0x7fbb7015a3f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbb6800b970 tx=0x7fbb6800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb667fc640 1 -- 172.21.15.6:0/1604316708 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6800cb40 con 0x7fbb700d1850 2023-07-21T22:19:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb667fc640 1 -- 172.21.15.6:0/1604316708 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6800cca0 con 0x7fbb700d1850 2023-07-21T22:19:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb667fc640 1 -- 172.21.15.6:0/1604316708 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb68014680 con 0x7fbb700d1850 2023-07-21T22:19:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb78111640 1 -- 172.21.15.6:0/1604316708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb7014cfb0 con 0x7fbb700d1850 2023-07-21T22:19:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.279+0000 7fbb78111640 1 -- 172.21.15.6:0/1604316708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7015e6e0 con 0x7fbb700d1850 2023-07-21T22:19:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.283+0000 7fbb78111640 1 -- 172.21.15.6:0/1604316708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb70154060 con 0x7fbb700d1850 2023-07-21T22:19:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.283+0000 7fbb667fc640 1 -- 172.21.15.6:0/1604316708 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbb6801d3b0 con 0x7fbb700d1850 2023-07-21T22:19:51.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.283+0000 7fbb667fc640 1 --2- 172.21.15.6:0/1604316708 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbb54066280 0x7fbb54068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:51.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.283+0000 7fbb667fc640 1 -- 172.21.15.6:0/1604316708 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbb68083b00 con 0x7fbb700d1850 2023-07-21T22:19:51.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.283+0000 7fbb75ead640 1 --2- 172.21.15.6:0/1604316708 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbb54066280 0x7fbb54068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:51.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.283+0000 7fbb75ead640 1 --2- 172.21.15.6:0/1604316708 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbb54066280 0x7fbb54068730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0af000 tx=0x7fbb6c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:51.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.287+0000 7fbb667fc640 1 -- 172.21.15.6:0/1604316708 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb70154060 con 0x7fbb700d1850 2023-07-21T22:19:51.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.439+0000 7fbb78111640 1 -- 172.21.15.6:0/1604316708 --> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb7015ffa0 con 0x7fbb54066280 2023-07-21T22:19:51.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.451+0000 7fbb667fc640 1 -- 172.21.15.6:0/1604316708 <== mgr.4103 v2:172.21.15.161:6832/3471136886 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311503 (secure 0 0 0) 0x7fbb6c0bd090 con 0x7fbb54066280 2023-07-21T22:19:51.499 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:51.501 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:19:51.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.451+0000 7fbb78111640 1 -- 172.21.15.6:0/1604316708 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbb54066280 msgr2=0x7fbb54068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:51.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.451+0000 7fbb78111640 1 --2- 172.21.15.6:0/1604316708 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbb54066280 0x7fbb54068730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c0af000 tx=0x7fbb6c0a7000 comp rx=0 tx=0).stop 2023-07-21T22:19:51.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.451+0000 7fbb78111640 1 -- 172.21.15.6:0/1604316708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb700d1850 msgr2=0x7fbb7015a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:51.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.451+0000 7fbb78111640 1 --2- 172.21.15.6:0/1604316708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb700d1850 0x7fbb7015a3f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbb6800b970 tx=0x7fbb6800be30 comp rx=0 tx=0).stop 2023-07-21T22:19:51.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.451+0000 7fbb78111640 1 -- 172.21.15.6:0/1604316708 shutdown_connections 2023-07-21T22:19:51.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.451+0000 7fbb78111640 1 --2- 172.21.15.6:0/1604316708 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fbb54066280 0x7fbb54068730 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:51.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.451+0000 7fbb78111640 1 --2- 172.21.15.6:0/1604316708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb700d1850 0x7fbb7015a3f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:51.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.451+0000 7fbb78111640 1 --2- 172.21.15.6:0/1604316708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb700d1300 0x7fbb70159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:51.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.451+0000 7fbb78111640 1 --2- 172.21.15.6:0/1604316708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb700b7c70 0x7fbb700b62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:51.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.451+0000 7fbb78111640 1 -- 172.21.15.6:0/1604316708 >> 172.21.15.6:0/1604316708 conn(0x7fbb700650b0 msgr2=0x7fbb700cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:51.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.451+0000 7fbb78111640 1 -- 172.21.15.6:0/1604316708 shutdown_connections 2023-07-21T22:19:51.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:51.451+0000 7fbb78111640 1 -- 172.21.15.6:0/1604316708 wait complete. 2023-07-21T22:19:51.519 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-07-21T22:19:50.783513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220264,"kb_used_data":4648,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754456,"statfs":{"total":773094113280,"available":772868562944,"internally_reserved":0,"allocated":4759552,"data_stored":2627452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.021503"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405133+0000","last_change":"2023-07-21T22:19:45.798366+0000","last_active":"2023-07-21T22:19:47.405133+0000","last_peered":"2023-07-21T22:19:47.405133+0000","last_clean":"2023-07-21T22:19:47.405133+0000","last_became_active":"2023-07-21T22:19:45.798041+0000","last_became_peered":"2023-07-21T22:19:45.798041+0000","last_unstale":"2023-07-21T22:19:47.405133+0000","last_undegraded":"2023-07-21T22:19:47.405133+0000","last_fullsized":"2023-07-21T22:19:47.405133+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:47:48.224228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404636+0000","last_change":"2023-07-21T22:19:45.790485+0000","last_active":"2023-07-21T22:19:47.404636+0000","last_peered":"2023-07-21T22:19:47.404636+0000","last_clean":"2023-07-21T22:19:47.404636+0000","last_became_active":"2023-07-21T22:19:45.789044+0000","last_became_peered":"2023-07-21T22:19:45.789044+0000","last_unstale":"2023-07-21T22:19:47.404636+0000","last_undegraded":"2023-07-21T22:19:47.404636+0000","last_fullsized":"2023-07-21T22:19:47.404636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:28:50.889694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404331+0000","last_change":"2023-07-21T22:19:45.800124+0000","last_active":"2023-07-21T22:19:47.404331+0000","last_peered":"2023-07-21T22:19:47.404331+0000","last_clean":"2023-07-21T22:19:47.404331+0000","last_became_active":"2023-07-21T22:19:45.799827+0000","last_became_peered":"2023-07-21T22:19:45.799827+0000","last_unstale":"2023-07-21T22:19:47.404331+0000","last_undegraded":"2023-07-21T22:19:47.404331+0000","last_fullsized":"2023-07-21T22:19:47.404331+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:43:36.408275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765431+0000","last_change":"2023-07-21T22:19:45.795476+0000","last_active":"2023-07-21T22:19:46.765431+0000","last_peered":"2023-07-21T22:19:46.765431+0000","last_clean":"2023-07-21T22:19:46.765431+0000","last_became_active":"2023-07-21T22:19:45.795190+0000","last_became_peered":"2023-07-21T22:19:45.795190+0000","last_unstale":"2023-07-21T22:19:46.765431+0000","last_undegraded":"2023-07-21T22:19:46.765431+0000","last_fullsized":"2023-07-21T22:19:46.765431+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:14.477166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765811+0000","last_change":"2023-07-21T22:19:45.793167+0000","last_active":"2023-07-21T22:19:46.765811+0000","last_peered":"2023-07-21T22:19:46.765811+0000","last_clean":"2023-07-21T22:19:46.765811+0000","last_became_active":"2023-07-21T22:19:45.792899+0000","last_became_peered":"2023-07-21T22:19:45.792899+0000","last_unstale":"2023-07-21T22:19:46.765811+0000","last_undegraded":"2023-07-21T22:19:46.765811+0000","last_fullsized":"2023-07-21T22:19:46.765811+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:27:50.718755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405145+0000","last_change":"2023-07-21T22:19:45.787988+0000","last_active":"2023-07-21T22:19:47.405145+0000","last_peered":"2023-07-21T22:19:47.405145+0000","last_clean":"2023-07-21T22:19:47.405145+0000","last_became_active":"2023-07-21T22:19:45.787704+0000","last_became_peered":"2023-07-21T22:19:45.787704+0000","last_unstale":"2023-07-21T22:19:47.405145+0000","last_undegraded":"2023-07-21T22:19:47.405145+0000","last_fullsized":"2023-07-21T22:19:47.405145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:08:09.119388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905154+0000","last_change":"2023-07-21T22:19:45.790633+0000","last_active":"2023-07-21T22:19:46.905154+0000","last_peered":"2023-07-21T22:19:46.905154+0000","last_clean":"2023-07-21T22:19:46.905154+0000","last_became_active":"2023-07-21T22:19:45.790075+0000","last_became_peered":"2023-07-21T22:19:45.790075+0000","last_unstale":"2023-07-21T22:19:46.905154+0000","last_undegraded":"2023-07-21T22:19:46.905154+0000","last_fullsized":"2023-07-21T22:19:46.905154+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:26.174778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404523+0000","last_change":"2023-07-21T22:19:45.783149+0000","last_active":"2023-07-21T22:19:47.404523+0000","last_peered":"2023-07-21T22:19:47.404523+0000","last_clean":"2023-07-21T22:19:47.404523+0000","last_became_active":"2023-07-21T22:19:45.782854+0000","last_became_peered":"2023-07-21T22:19:45.782854+0000","last_unstale":"2023-07-21T22:19:47.404523+0000","last_undegraded":"2023-07-21T22:19:47.404523+0000","last_fullsized":"2023-07-21T22:19:47.404523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:08:09.119388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404255+0000","last_change":"2023-07-21T22:19:45.800035+0000","last_active":"2023-07-21T22:19:47.404255+0000","last_peered":"2023-07-21T22:19:47.404255+0000","last_clean":"2023-07-21T22:19:47.404255+0000","last_became_active":"2023-07-21T22:19:45.799766+0000","last_became_peered":"2023-07-21T22:19:45.799766+0000","last_unstale":"2023-07-21T22:19:47.404255+0000","last_undegraded":"2023-07-21T22:19:47.404255+0000","last_fullsized":"2023-07-21T22:19:47.404255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:05:06.892121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905545+0000","last_change":"2023-07-21T22:19:45.780960+0000","last_active":"2023-07-21T22:19:46.905545+0000","last_peered":"2023-07-21T22:19:46.905545+0000","last_clean":"2023-07-21T22:19:46.905545+0000","last_became_active":"2023-07-21T22:19:45.779499+0000","last_became_peered":"2023-07-21T22:19:45.779499+0000","last_unstale":"2023-07-21T22:19:46.905545+0000","last_undegraded":"2023-07-21T22:19:46.905545+0000","last_fullsized":"2023-07-21T22:19:46.905545+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:20:17.308772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905543+0000","last_change":"2023-07-21T22:19:45.782413+0000","last_active":"2023-07-21T22:19:46.905543+0000","last_peered":"2023-07-21T22:19:46.905543+0000","last_clean":"2023-07-21T22:19:46.905543+0000","last_became_active":"2023-07-21T22:19:45.781976+0000","last_became_peered":"2023-07-21T22:19:45.781976+0000","last_unstale":"2023-07-21T22:19:46.905543+0000","last_undegraded":"2023-07-21T22:19:46.905543+0000","last_fullsized":"2023-07-21T22:19:46.905543+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:25:14.660757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.403961+0000","last_change":"2023-07-21T22:19:45.796632+0000","last_active":"2023-07-21T22:19:47.403961+0000","last_peered":"2023-07-21T22:19:47.403961+0000","last_clean":"2023-07-21T22:19:47.403961+0000","last_became_active":"2023-07-21T22:19:45.796308+0000","last_became_peered":"2023-07-21T22:19:45.796308+0000","last_unstale":"2023-07-21T22:19:47.403961+0000","last_undegraded":"2023-07-21T22:19:47.403961+0000","last_fullsized":"2023-07-21T22:19:47.403961+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:09:29.099443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905613+0000","last_change":"2023-07-21T22:19:45.780887+0000","last_active":"2023-07-21T22:19:46.905613+0000","last_peered":"2023-07-21T22:19:46.905613+0000","last_clean":"2023-07-21T22:19:46.905613+0000","last_became_active":"2023-07-21T22:19:45.780574+0000","last_became_peered":"2023-07-21T22:19:45.780574+0000","last_unstale":"2023-07-21T22:19:46.905613+0000","last_undegraded":"2023-07-21T22:19:46.905613+0000","last_fullsized":"2023-07-21T22:19:46.905613+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:02:43.243631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405564+0000","last_change":"2023-07-21T22:19:45.781979+0000","last_active":"2023-07-21T22:19:47.405564+0000","last_peered":"2023-07-21T22:19:47.405564+0000","last_clean":"2023-07-21T22:19:47.405564+0000","last_became_active":"2023-07-21T22:19:45.781679+0000","last_became_peered":"2023-07-21T22:19:45.781679+0000","last_unstale":"2023-07-21T22:19:47.405564+0000","last_undegraded":"2023-07-21T22:19:47.405564+0000","last_fullsized":"2023-07-21T22:19:47.405564+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:53:07.234756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905146+0000","last_change":"2023-07-21T22:19:45.790432+0000","last_active":"2023-07-21T22:19:46.905146+0000","last_peered":"2023-07-21T22:19:46.905146+0000","last_clean":"2023-07-21T22:19:46.905146+0000","last_became_active":"2023-07-21T22:19:45.789693+0000","last_became_peered":"2023-07-21T22:19:45.789693+0000","last_unstale":"2023-07-21T22:19:46.905146+0000","last_undegraded":"2023-07-21T22:19:46.905146+0000","last_fullsized":"2023-07-21T22:19:46.905146+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:26:16.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.768864+0000","last_change":"2023-07-21T22:19:45.802267+0000","last_active":"2023-07-21T22:19:46.768864+0000","last_peered":"2023-07-21T22:19:46.768864+0000","last_clean":"2023-07-21T22:19:46.768864+0000","last_became_active":"2023-07-21T22:19:45.801816+0000","last_became_peered":"2023-07-21T22:19:45.801816+0000","last_unstale":"2023-07-21T22:19:46.768864+0000","last_undegraded":"2023-07-21T22:19:46.768864+0000","last_fullsized":"2023-07-21T22:19:46.768864+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:00:23.125262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769897+0000","last_change":"2023-07-21T22:19:45.803335+0000","last_active":"2023-07-21T22:19:46.769897+0000","last_peered":"2023-07-21T22:19:46.769897+0000","last_clean":"2023-07-21T22:19:46.769897+0000","last_became_active":"2023-07-21T22:19:45.803048+0000","last_became_peered":"2023-07-21T22:19:45.803048+0000","last_unstale":"2023-07-21T22:19:46.769897+0000","last_undegraded":"2023-07-21T22:19:46.769897+0000","last_fullsized":"2023-07-21T22:19:46.769897+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:00:34.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769960+0000","last_change":"2023-07-21T22:19:45.795606+0000","last_active":"2023-07-21T22:19:46.769960+0000","last_peered":"2023-07-21T22:19:46.769960+0000","last_clean":"2023-07-21T22:19:46.769960+0000","last_became_active":"2023-07-21T22:19:45.795338+0000","last_became_peered":"2023-07-21T22:19:45.795338+0000","last_unstale":"2023-07-21T22:19:46.769960+0000","last_undegraded":"2023-07-21T22:19:46.769960+0000","last_fullsized":"2023-07-21T22:19:46.769960+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:05:03.294830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765607+0000","last_change":"2023-07-21T22:19:45.779369+0000","last_active":"2023-07-21T22:19:46.765607+0000","last_peered":"2023-07-21T22:19:46.765607+0000","last_clean":"2023-07-21T22:19:46.765607+0000","last_became_active":"2023-07-21T22:19:45.778931+0000","last_became_peered":"2023-07-21T22:19:45.778931+0000","last_unstale":"2023-07-21T22:19:46.765607+0000","last_undegraded":"2023-07-21T22:19:46.765607+0000","last_fullsized":"2023-07-21T22:19:46.765607+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:20:36.840818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769707+0000","last_change":"2023-07-21T22:19:45.796986+0000","last_active":"2023-07-21T22:19:46.769707+0000","last_peered":"2023-07-21T22:19:46.769707+0000","last_clean":"2023-07-21T22:19:46.769707+0000","last_became_active":"2023-07-21T22:19:45.796681+0000","last_became_peered":"2023-07-21T22:19:45.796681+0000","last_unstale":"2023-07-21T22:19:46.769707+0000","last_undegraded":"2023-07-21T22:19:46.769707+0000","last_fullsized":"2023-07-21T22:19:46.769707+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:37.771891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905366+0000","last_change":"2023-07-21T22:19:45.782016+0000","last_active":"2023-07-21T22:19:46.905366+0000","last_peered":"2023-07-21T22:19:46.905366+0000","last_clean":"2023-07-21T22:19:46.905366+0000","last_became_active":"2023-07-21T22:19:45.780993+0000","last_became_peered":"2023-07-21T22:19:45.780993+0000","last_unstale":"2023-07-21T22:19:46.905366+0000","last_undegraded":"2023-07-21T22:19:46.905366+0000","last_fullsized":"2023-07-21T22:19:46.905366+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:22:02.565752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.406016+0000","last_change":"2023-07-21T22:19:45.793594+0000","last_active":"2023-07-21T22:19:47.406016+0000","last_peered":"2023-07-21T22:19:47.406016+0000","last_clean":"2023-07-21T22:19:47.406016+0000","last_became_active":"2023-07-21T22:19:45.788051+0000","last_became_peered":"2023-07-21T22:19:45.788051+0000","last_unstale":"2023-07-21T22:19:47.406016+0000","last_undegraded":"2023-07-21T22:19:47.406016+0000","last_fullsized":"2023-07-21T22:19:47.406016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:02:43.243631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769131+0000","last_change":"2023-07-21T22:19:45.787042+0000","last_active":"2023-07-21T22:19:46.769131+0000","last_peered":"2023-07-21T22:19:46.769131+0000","last_clean":"2023-07-21T22:19:46.769131+0000","last_became_active":"2023-07-21T22:19:45.786744+0000","last_became_peered":"2023-07-21T22:19:45.786744+0000","last_unstale":"2023-07-21T22:19:46.769131+0000","last_undegraded":"2023-07-21T22:19:46.769131+0000","last_fullsized":"2023-07-21T22:19:46.769131+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:26:16.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765158+0000","last_change":"2023-07-21T22:19:45.781151+0000","last_active":"2023-07-21T22:19:46.765158+0000","last_peered":"2023-07-21T22:19:46.765158+0000","last_clean":"2023-07-21T22:19:46.765158+0000","last_became_active":"2023-07-21T22:19:45.780518+0000","last_became_peered":"2023-07-21T22:19:45.780518+0000","last_unstale":"2023-07-21T22:19:46.765158+0000","last_undegraded":"2023-07-21T22:19:46.765158+0000","last_fullsized":"2023-07-21T22:19:46.765158+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:26:15.236042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.770252+0000","last_change":"2023-07-21T22:19:45.800520+0000","last_active":"2023-07-21T22:19:46.770252+0000","last_peered":"2023-07-21T22:19:46.770252+0000","last_clean":"2023-07-21T22:19:46.770252+0000","last_became_active":"2023-07-21T22:19:45.800254+0000","last_became_peered":"2023-07-21T22:19:45.800254+0000","last_unstale":"2023-07-21T22:19:46.770252+0000","last_undegraded":"2023-07-21T22:19:46.770252+0000","last_fullsized":"2023-07-21T22:19:46.770252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:33:03.322922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405475+0000","last_change":"2023-07-21T22:19:45.800069+0000","last_active":"2023-07-21T22:19:47.405475+0000","last_peered":"2023-07-21T22:19:47.405475+0000","last_clean":"2023-07-21T22:19:47.405475+0000","last_became_active":"2023-07-21T22:19:45.799789+0000","last_became_peered":"2023-07-21T22:19:45.799789+0000","last_unstale":"2023-07-21T22:19:47.405475+0000","last_undegraded":"2023-07-21T22:19:47.405475+0000","last_fullsized":"2023-07-21T22:19:47.405475+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:16.163592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769264+0000","last_change":"2023-07-21T22:19:45.784271+0000","last_active":"2023-07-21T22:19:46.769264+0000","last_peered":"2023-07-21T22:19:46.769264+0000","last_clean":"2023-07-21T22:19:46.769264+0000","last_became_active":"2023-07-21T22:19:45.783982+0000","last_became_peered":"2023-07-21T22:19:45.783982+0000","last_unstale":"2023-07-21T22:19:46.769264+0000","last_undegraded":"2023-07-21T22:19:46.769264+0000","last_fullsized":"2023-07-21T22:19:46.769264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:33:58.235048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905507+0000","last_change":"2023-07-21T22:19:45.792190+0000","last_active":"2023-07-21T22:19:46.905507+0000","last_peered":"2023-07-21T22:19:46.905507+0000","last_clean":"2023-07-21T22:19:46.905507+0000","last_became_active":"2023-07-21T22:19:45.791916+0000","last_became_peered":"2023-07-21T22:19:45.791916+0000","last_unstale":"2023-07-21T22:19:46.905507+0000","last_undegraded":"2023-07-21T22:19:46.905507+0000","last_fullsized":"2023-07-21T22:19:46.905507+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:59:09.560857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769462+0000","last_change":"2023-07-21T22:19:45.780510+0000","last_active":"2023-07-21T22:19:46.769462+0000","last_peered":"2023-07-21T22:19:46.769462+0000","last_clean":"2023-07-21T22:19:46.769462+0000","last_became_active":"2023-07-21T22:19:45.780241+0000","last_became_peered":"2023-07-21T22:19:45.780241+0000","last_unstale":"2023-07-21T22:19:46.769462+0000","last_undegraded":"2023-07-21T22:19:46.769462+0000","last_fullsized":"2023-07-21T22:19:46.769462+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:20:34.528651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769035+0000","last_change":"2023-07-21T22:19:45.794149+0000","last_active":"2023-07-21T22:19:46.769035+0000","last_peered":"2023-07-21T22:19:46.769035+0000","last_clean":"2023-07-21T22:19:46.769035+0000","last_became_active":"2023-07-21T22:19:45.793894+0000","last_became_peered":"2023-07-21T22:19:45.793894+0000","last_unstale":"2023-07-21T22:19:46.769035+0000","last_undegraded":"2023-07-21T22:19:46.769035+0000","last_fullsized":"2023-07-21T22:19:46.769035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:05:05.775653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769335+0000","last_change":"2023-07-21T22:19:45.790649+0000","last_active":"2023-07-21T22:19:46.769335+0000","last_peered":"2023-07-21T22:19:46.769335+0000","last_clean":"2023-07-21T22:19:46.769335+0000","last_became_active":"2023-07-21T22:19:45.790320+0000","last_became_peered":"2023-07-21T22:19:45.790320+0000","last_unstale":"2023-07-21T22:19:46.769335+0000","last_undegraded":"2023-07-21T22:19:46.769335+0000","last_fullsized":"2023-07-21T22:19:46.769335+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:59:09.560857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404638+0000","last_change":"2023-07-21T22:19:45.776166+0000","last_active":"2023-07-21T22:19:47.404638+0000","last_peered":"2023-07-21T22:19:47.404638+0000","last_clean":"2023-07-21T22:19:47.404638+0000","last_became_active":"2023-07-21T22:19:45.775811+0000","last_became_peered":"2023-07-21T22:19:45.775811+0000","last_unstale":"2023-07-21T22:19:47.404638+0000","last_undegraded":"2023-07-21T22:19:47.404638+0000","last_fullsized":"2023-07-21T22:19:47.404638+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:23:37.451740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769250+0000","last_change":"2023-07-21T22:19:45.780194+0000","last_active":"2023-07-21T22:19:46.769250+0000","last_peered":"2023-07-21T22:19:46.769250+0000","last_clean":"2023-07-21T22:19:46.769250+0000","last_became_active":"2023-07-21T22:19:45.779848+0000","last_became_peered":"2023-07-21T22:19:45.779848+0000","last_unstale":"2023-07-21T22:19:46.769250+0000","last_undegraded":"2023-07-21T22:19:46.769250+0000","last_fullsized":"2023-07-21T22:19:46.769250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:22:02.565752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.770339+0000","last_change":"2023-07-21T22:19:44.789473+0000","last_active":"2023-07-21T22:19:46.770339+0000","last_peered":"2023-07-21T22:19:46.770339+0000","last_clean":"2023-07-21T22:19:46.770339+0000","last_became_active":"2023-07-21T22:19:44.789250+0000","last_became_peered":"2023-07-21T22:19:44.789250+0000","last_unstale":"2023-07-21T22:19:46.770339+0000","last_undegraded":"2023-07-21T22:19:46.770339+0000","last_fullsized":"2023-07-21T22:19:46.770339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:55:01.556144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405143+0000","last_change":"2023-07-21T22:19:45.799593+0000","last_active":"2023-07-21T22:19:47.405143+0000","last_peered":"2023-07-21T22:19:47.405143+0000","last_clean":"2023-07-21T22:19:47.405143+0000","last_became_active":"2023-07-21T22:19:45.799217+0000","last_became_peered":"2023-07-21T22:19:45.799217+0000","last_unstale":"2023-07-21T22:19:47.405143+0000","last_undegraded":"2023-07-21T22:19:47.405143+0000","last_fullsized":"2023-07-21T22:19:47.405143+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:27:45.451327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404020+0000","last_change":"2023-07-21T22:19:44.784165+0000","last_active":"2023-07-21T22:19:47.404020+0000","last_peered":"2023-07-21T22:19:47.404020+0000","last_clean":"2023-07-21T22:19:47.404020+0000","last_became_active":"2023-07-21T22:19:44.783159+0000","last_became_peered":"2023-07-21T22:19:44.783159+0000","last_unstale":"2023-07-21T22:19:47.404020+0000","last_undegraded":"2023-07-21T22:19:47.404020+0000","last_fullsized":"2023-07-21T22:19:47.404020+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:48:12.861175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.406090+0000","last_change":"2023-07-21T22:19:45.793287+0000","last_active":"2023-07-21T22:19:47.406090+0000","last_peered":"2023-07-21T22:19:47.406090+0000","last_clean":"2023-07-21T22:19:47.406090+0000","last_became_active":"2023-07-21T22:19:45.789007+0000","last_became_peered":"2023-07-21T22:19:45.789007+0000","last_unstale":"2023-07-21T22:19:47.406090+0000","last_undegraded":"2023-07-21T22:19:47.406090+0000","last_fullsized":"2023-07-21T22:19:47.406090+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:24.695017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405438+0000","last_change":"2023-07-21T22:19:44.777629+0000","last_active":"2023-07-21T22:19:47.405438+0000","last_peered":"2023-07-21T22:19:47.405438+0000","last_clean":"2023-07-21T22:19:47.405438+0000","last_became_active":"2023-07-21T22:19:44.777335+0000","last_became_peered":"2023-07-21T22:19:44.777335+0000","last_unstale":"2023-07-21T22:19:47.405438+0000","last_undegraded":"2023-07-21T22:19:47.405438+0000","last_fullsized":"2023-07-21T22:19:47.405438+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:52:21.861655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404978+0000","last_change":"2023-07-21T22:19:45.787480+0000","last_active":"2023-07-21T22:19:47.404978+0000","last_peered":"2023-07-21T22:19:47.404978+0000","last_clean":"2023-07-21T22:19:47.404978+0000","last_became_active":"2023-07-21T22:19:45.786995+0000","last_became_peered":"2023-07-21T22:19:45.786995+0000","last_unstale":"2023-07-21T22:19:47.404978+0000","last_undegraded":"2023-07-21T22:19:47.404978+0000","last_fullsized":"2023-07-21T22:19:47.404978+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:52:22.870348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405905+0000","last_change":"2023-07-21T22:19:44.780467+0000","last_active":"2023-07-21T22:19:47.405905+0000","last_peered":"2023-07-21T22:19:47.405905+0000","last_clean":"2023-07-21T22:19:47.405905+0000","last_became_active":"2023-07-21T22:19:44.780154+0000","last_became_peered":"2023-07-21T22:19:44.780154+0000","last_unstale":"2023-07-21T22:19:47.405905+0000","last_undegraded":"2023-07-21T22:19:47.405905+0000","last_fullsized":"2023-07-21T22:19:47.405905+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:20:16.300079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404352+0000","last_change":"2023-07-21T22:19:45.797613+0000","last_active":"2023-07-21T22:19:47.404352+0000","last_peered":"2023-07-21T22:19:47.404352+0000","last_clean":"2023-07-21T22:19:47.404352+0000","last_became_active":"2023-07-21T22:19:45.797372+0000","last_became_peered":"2023-07-21T22:19:45.797372+0000","last_unstale":"2023-07-21T22:19:47.404352+0000","last_undegraded":"2023-07-21T22:19:47.404352+0000","last_fullsized":"2023-07-21T22:19:47.404352+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:23:37.451740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905224+0000","last_change":"2023-07-21T22:19:44.787151+0000","last_active":"2023-07-21T22:19:46.905224+0000","last_peered":"2023-07-21T22:19:46.905224+0000","last_clean":"2023-07-21T22:19:46.905224+0000","last_became_active":"2023-07-21T22:19:44.786795+0000","last_became_peered":"2023-07-21T22:19:44.786795+0000","last_unstale":"2023-07-21T22:19:46.905224+0000","last_undegraded":"2023-07-21T22:19:46.905224+0000","last_fullsized":"2023-07-21T22:19:46.905224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:23.686324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905370+0000","last_change":"2023-07-21T22:19:45.780801+0000","last_active":"2023-07-21T22:19:46.905370+0000","last_peered":"2023-07-21T22:19:46.905370+0000","last_clean":"2023-07-21T22:19:46.905370+0000","last_became_active":"2023-07-21T22:19:45.780490+0000","last_became_peered":"2023-07-21T22:19:45.780490+0000","last_unstale":"2023-07-21T22:19:46.905370+0000","last_undegraded":"2023-07-21T22:19:46.905370+0000","last_fullsized":"2023-07-21T22:19:46.905370+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:53:07.234756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769311+0000","last_change":"2023-07-21T22:19:44.778629+0000","last_active":"2023-07-21T22:19:46.769311+0000","last_peered":"2023-07-21T22:19:46.769311+0000","last_clean":"2023-07-21T22:19:46.769311+0000","last_became_active":"2023-07-21T22:19:44.778106+0000","last_became_peered":"2023-07-21T22:19:44.778106+0000","last_unstale":"2023-07-21T22:19:46.769311+0000","last_undegraded":"2023-07-21T22:19:46.769311+0000","last_fullsized":"2023-07-21T22:19:46.769311+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:53:06.226063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405819+0000","last_change":"2023-07-21T22:19:45.804605+0000","last_active":"2023-07-21T22:19:47.405819+0000","last_peered":"2023-07-21T22:19:47.405819+0000","last_clean":"2023-07-21T22:19:47.405819+0000","last_became_active":"2023-07-21T22:19:45.804414+0000","last_became_peered":"2023-07-21T22:19:45.804414+0000","last_unstale":"2023-07-21T22:19:47.405819+0000","last_undegraded":"2023-07-21T22:19:47.405819+0000","last_fullsized":"2023-07-21T22:19:47.405819+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:25:14.660757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404912+0000","last_change":"2023-07-21T22:19:44.780493+0000","last_active":"2023-07-21T22:19:47.404912+0000","last_peered":"2023-07-21T22:19:47.404912+0000","last_clean":"2023-07-21T22:19:47.404912+0000","last_became_active":"2023-07-21T22:19:44.780040+0000","last_became_peered":"2023-07-21T22:19:44.780040+0000","last_unstale":"2023-07-21T22:19:47.404912+0000","last_undegraded":"2023-07-21T22:19:47.404912+0000","last_fullsized":"2023-07-21T22:19:47.404912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:06:52.712913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404201+0000","last_change":"2023-07-21T22:19:45.788316+0000","last_active":"2023-07-21T22:19:47.404201+0000","last_peered":"2023-07-21T22:19:47.404201+0000","last_clean":"2023-07-21T22:19:47.404201+0000","last_became_active":"2023-07-21T22:19:45.787871+0000","last_became_peered":"2023-07-21T22:19:45.787871+0000","last_unstale":"2023-07-21T22:19:47.404201+0000","last_undegraded":"2023-07-21T22:19:47.404201+0000","last_fullsized":"2023-07-21T22:19:47.404201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:43:36.408275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405538+0000","last_change":"2023-07-21T22:19:44.779555+0000","last_active":"2023-07-21T22:19:47.405538+0000","last_peered":"2023-07-21T22:19:47.405538+0000","last_clean":"2023-07-21T22:19:47.405538+0000","last_became_active":"2023-07-21T22:19:44.779239+0000","last_became_peered":"2023-07-21T22:19:44.779239+0000","last_unstale":"2023-07-21T22:19:47.405538+0000","last_undegraded":"2023-07-21T22:19:47.405538+0000","last_fullsized":"2023-07-21T22:19:47.405538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:22:01.557059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765451+0000","last_change":"2023-07-21T22:19:45.795174+0000","last_active":"2023-07-21T22:19:46.765451+0000","last_peered":"2023-07-21T22:19:46.765451+0000","last_clean":"2023-07-21T22:19:46.765451+0000","last_became_active":"2023-07-21T22:19:45.794873+0000","last_became_peered":"2023-07-21T22:19:45.794873+0000","last_unstale":"2023-07-21T22:19:46.765451+0000","last_undegraded":"2023-07-21T22:19:46.765451+0000","last_fullsized":"2023-07-21T22:19:46.765451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:20:21.256367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405145+0000","last_change":"2023-07-21T22:19:44.785204+0000","last_active":"2023-07-21T22:19:47.405145+0000","last_peered":"2023-07-21T22:19:47.405145+0000","last_clean":"2023-07-21T22:19:47.405145+0000","last_became_active":"2023-07-21T22:19:44.784909+0000","last_became_peered":"2023-07-21T22:19:44.784909+0000","last_unstale":"2023-07-21T22:19:47.405145+0000","last_undegraded":"2023-07-21T22:19:47.405145+0000","last_fullsized":"2023-07-21T22:19:47.405145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:15.154900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.770119+0000","last_change":"2023-07-21T22:19:45.785312+0000","last_active":"2023-07-21T22:19:46.770119+0000","last_peered":"2023-07-21T22:19:46.770119+0000","last_clean":"2023-07-21T22:19:46.770119+0000","last_became_active":"2023-07-21T22:19:45.784786+0000","last_became_peered":"2023-07-21T22:19:45.784786+0000","last_unstale":"2023-07-21T22:19:46.770119+0000","last_undegraded":"2023-07-21T22:19:46.770119+0000","last_fullsized":"2023-07-21T22:19:46.770119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:12.058382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905851+0000","last_change":"2023-07-21T22:19:44.790427+0000","last_active":"2023-07-21T22:19:46.905851+0000","last_peered":"2023-07-21T22:19:46.905851+0000","last_clean":"2023-07-21T22:19:46.905851+0000","last_became_active":"2023-07-21T22:19:44.790178+0000","last_became_peered":"2023-07-21T22:19:44.790178+0000","last_unstale":"2023-07-21T22:19:46.905851+0000","last_undegraded":"2023-07-21T22:19:46.905851+0000","last_fullsized":"2023-07-21T22:19:46.905851+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:09:33.956964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.403869+0000","last_change":"2023-07-21T22:19:45.804899+0000","last_active":"2023-07-21T22:19:47.403869+0000","last_peered":"2023-07-21T22:19:47.403869+0000","last_clean":"2023-07-21T22:19:47.403869+0000","last_became_active":"2023-07-21T22:19:45.804575+0000","last_became_peered":"2023-07-21T22:19:45.804575+0000","last_unstale":"2023-07-21T22:19:47.403869+0000","last_undegraded":"2023-07-21T22:19:47.403869+0000","last_fullsized":"2023-07-21T22:19:47.403869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:44:04.377673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905727+0000","last_change":"2023-07-21T22:19:44.784266+0000","last_active":"2023-07-21T22:19:46.905727+0000","last_peered":"2023-07-21T22:19:46.905727+0000","last_clean":"2023-07-21T22:19:46.905727+0000","last_became_active":"2023-07-21T22:19:44.783964+0000","last_became_peered":"2023-07-21T22:19:44.783964+0000","last_unstale":"2023-07-21T22:19:46.905727+0000","last_undegraded":"2023-07-21T22:19:46.905727+0000","last_fullsized":"2023-07-21T22:19:46.905727+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:47:30.515460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.406118+0000","last_change":"2023-07-21T22:19:45.797537+0000","last_active":"2023-07-21T22:19:47.406118+0000","last_peered":"2023-07-21T22:19:47.406118+0000","last_clean":"2023-07-21T22:19:47.406118+0000","last_became_active":"2023-07-21T22:19:45.797227+0000","last_became_peered":"2023-07-21T22:19:45.797227+0000","last_unstale":"2023-07-21T22:19:47.406118+0000","last_undegraded":"2023-07-21T22:19:47.406118+0000","last_fullsized":"2023-07-21T22:19:47.406118+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:00:34.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404323+0000","last_change":"2023-07-21T22:19:44.777147+0000","last_active":"2023-07-21T22:19:47.404323+0000","last_peered":"2023-07-21T22:19:47.404323+0000","last_clean":"2023-07-21T22:19:47.404323+0000","last_became_active":"2023-07-21T22:19:44.776832+0000","last_became_peered":"2023-07-21T22:19:44.776832+0000","last_unstale":"2023-07-21T22:19:47.404323+0000","last_undegraded":"2023-07-21T22:19:47.404323+0000","last_fullsized":"2023-07-21T22:19:47.404323+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:23:36.443048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.403625+0000","last_change":"2023-07-21T22:19:45.802382+0000","last_active":"2023-07-21T22:19:47.403625+0000","last_peered":"2023-07-21T22:19:47.403625+0000","last_clean":"2023-07-21T22:19:47.403625+0000","last_became_active":"2023-07-21T22:19:45.802123+0000","last_became_peered":"2023-07-21T22:19:45.802123+0000","last_unstale":"2023-07-21T22:19:47.403625+0000","last_undegraded":"2023-07-21T22:19:47.403625+0000","last_fullsized":"2023-07-21T22:19:47.403625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:05:17.544063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404610+0000","last_change":"2023-07-21T22:19:44.785472+0000","last_active":"2023-07-21T22:19:47.404610+0000","last_peered":"2023-07-21T22:19:47.404610+0000","last_clean":"2023-07-21T22:19:47.404610+0000","last_became_active":"2023-07-21T22:19:44.785213+0000","last_became_peered":"2023-07-21T22:19:44.785213+0000","last_unstale":"2023-07-21T22:19:47.404610+0000","last_undegraded":"2023-07-21T22:19:47.404610+0000","last_fullsized":"2023-07-21T22:19:47.404610+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:07:57.052451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404615+0000","last_change":"2023-07-21T22:19:45.800204+0000","last_active":"2023-07-21T22:19:47.404615+0000","last_peered":"2023-07-21T22:19:47.404615+0000","last_clean":"2023-07-21T22:19:47.404615+0000","last_became_active":"2023-07-21T22:19:45.799367+0000","last_became_peered":"2023-07-21T22:19:45.799367+0000","last_unstale":"2023-07-21T22:19:47.404615+0000","last_undegraded":"2023-07-21T22:19:47.404615+0000","last_fullsized":"2023-07-21T22:19:47.404615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:27:45.451327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405188+0000","last_change":"2023-07-21T22:19:44.783624+0000","last_active":"2023-07-21T22:19:47.405188+0000","last_peered":"2023-07-21T22:19:47.405188+0000","last_clean":"2023-07-21T22:19:47.405188+0000","last_became_active":"2023-07-21T22:19:44.783333+0000","last_became_peered":"2023-07-21T22:19:44.783333+0000","last_unstale":"2023-07-21T22:19:47.405188+0000","last_undegraded":"2023-07-21T22:19:47.405188+0000","last_fullsized":"2023-07-21T22:19:47.405188+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:07:57.052451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769158+0000","last_change":"2023-07-21T22:19:45.782411+0000","last_active":"2023-07-21T22:19:46.769158+0000","last_peered":"2023-07-21T22:19:46.769158+0000","last_clean":"2023-07-21T22:19:46.769158+0000","last_became_active":"2023-07-21T22:19:45.782074+0000","last_became_peered":"2023-07-21T22:19:45.782074+0000","last_unstale":"2023-07-21T22:19:46.769158+0000","last_undegraded":"2023-07-21T22:19:46.769158+0000","last_fullsized":"2023-07-21T22:19:46.769158+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:26.174778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.768897+0000","last_change":"2023-07-21T22:19:44.782697+0000","last_active":"2023-07-21T22:19:46.768897+0000","last_peered":"2023-07-21T22:19:46.768897+0000","last_clean":"2023-07-21T22:19:46.768897+0000","last_became_active":"2023-07-21T22:19:44.782411+0000","last_became_peered":"2023-07-21T22:19:44.782411+0000","last_unstale":"2023-07-21T22:19:46.768897+0000","last_undegraded":"2023-07-21T22:19:46.768897+0000","last_fullsized":"2023-07-21T22:19:46.768897+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:58:30.574555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404339+0000","last_change":"2023-07-21T22:19:45.792883+0000","last_active":"2023-07-21T22:19:47.404339+0000","last_peered":"2023-07-21T22:19:47.404339+0000","last_clean":"2023-07-21T22:19:47.404339+0000","last_became_active":"2023-07-21T22:19:45.792588+0000","last_became_peered":"2023-07-21T22:19:45.792588+0000","last_unstale":"2023-07-21T22:19:47.404339+0000","last_undegraded":"2023-07-21T22:19:47.404339+0000","last_fullsized":"2023-07-21T22:19:47.404339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:40:24.707300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.768770+0000","last_change":"2023-07-21T22:19:44.778323+0000","last_active":"2023-07-21T22:19:46.768770+0000","last_peered":"2023-07-21T22:19:46.768770+0000","last_clean":"2023-07-21T22:19:46.768770+0000","last_became_active":"2023-07-21T22:19:44.778005+0000","last_became_peered":"2023-07-21T22:19:44.778005+0000","last_unstale":"2023-07-21T22:19:46.768770+0000","last_undegraded":"2023-07-21T22:19:46.768770+0000","last_fullsized":"2023-07-21T22:19:46.768770+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:17:34.163002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404110+0000","last_change":"2023-07-21T22:19:45.787973+0000","last_active":"2023-07-21T22:19:47.404110+0000","last_peered":"2023-07-21T22:19:47.404110+0000","last_clean":"2023-07-21T22:19:47.404110+0000","last_became_active":"2023-07-21T22:19:45.787684+0000","last_became_peered":"2023-07-21T22:19:45.787684+0000","last_unstale":"2023-07-21T22:19:47.404110+0000","last_undegraded":"2023-07-21T22:19:47.404110+0000","last_fullsized":"2023-07-21T22:19:47.404110+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:05:06.892121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905829+0000","last_change":"2023-07-21T22:19:44.789449+0000","last_active":"2023-07-21T22:19:46.905829+0000","last_peered":"2023-07-21T22:19:46.905829+0000","last_clean":"2023-07-21T22:19:46.905829+0000","last_became_active":"2023-07-21T22:19:44.789151+0000","last_became_peered":"2023-07-21T22:19:44.789151+0000","last_unstale":"2023-07-21T22:19:46.905829+0000","last_undegraded":"2023-07-21T22:19:46.905829+0000","last_fullsized":"2023-07-21T22:19:46.905829+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:12:44.382288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905732+0000","last_change":"2023-07-21T22:19:45.791328+0000","last_active":"2023-07-21T22:19:46.905732+0000","last_peered":"2023-07-21T22:19:46.905732+0000","last_clean":"2023-07-21T22:19:46.905732+0000","last_became_active":"2023-07-21T22:19:45.791020+0000","last_became_peered":"2023-07-21T22:19:45.791020+0000","last_unstale":"2023-07-21T22:19:46.905732+0000","last_undegraded":"2023-07-21T22:19:46.905732+0000","last_fullsized":"2023-07-21T22:19:46.905732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:12.058382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.406193+0000","last_change":"2023-07-21T22:19:44.785599+0000","last_active":"2023-07-21T22:19:47.406193+0000","last_peered":"2023-07-21T22:19:47.406193+0000","last_clean":"2023-07-21T22:19:47.406193+0000","last_became_active":"2023-07-21T22:19:44.785328+0000","last_became_peered":"2023-07-21T22:19:44.785328+0000","last_unstale":"2023-07-21T22:19:47.406193+0000","last_undegraded":"2023-07-21T22:19:47.406193+0000","last_fullsized":"2023-07-21T22:19:47.406193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:11.049689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.406058+0000","last_change":"2023-07-21T22:19:45.793835+0000","last_active":"2023-07-21T22:19:47.406058+0000","last_peered":"2023-07-21T22:19:47.406058+0000","last_clean":"2023-07-21T22:19:47.406058+0000","last_became_active":"2023-07-21T22:19:45.789295+0000","last_became_peered":"2023-07-21T22:19:45.789295+0000","last_unstale":"2023-07-21T22:19:47.406058+0000","last_undegraded":"2023-07-21T22:19:47.406058+0000","last_fullsized":"2023-07-21T22:19:47.406058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:09:27.126678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765728+0000","last_change":"2023-07-21T22:19:44.774139+0000","last_active":"2023-07-21T22:19:46.765728+0000","last_peered":"2023-07-21T22:19:46.765728+0000","last_clean":"2023-07-21T22:19:46.765728+0000","last_became_active":"2023-07-21T22:19:44.773835+0000","last_became_peered":"2023-07-21T22:19:44.773835+0000","last_unstale":"2023-07-21T22:19:46.765728+0000","last_undegraded":"2023-07-21T22:19:46.765728+0000","last_fullsized":"2023-07-21T22:19:46.765728+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:16:57.907636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765543+0000","last_change":"2023-07-21T22:19:45.788614+0000","last_active":"2023-07-21T22:19:46.765543+0000","last_peered":"2023-07-21T22:19:46.765543+0000","last_clean":"2023-07-21T22:19:46.765543+0000","last_became_active":"2023-07-21T22:19:45.788317+0000","last_became_peered":"2023-07-21T22:19:45.788317+0000","last_unstale":"2023-07-21T22:19:46.765543+0000","last_undegraded":"2023-07-21T22:19:46.765543+0000","last_fullsized":"2023-07-21T22:19:46.765543+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:40:04.954470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405292+0000","last_change":"2023-07-21T22:19:44.777586+0000","last_active":"2023-07-21T22:19:47.405292+0000","last_peered":"2023-07-21T22:19:47.405292+0000","last_clean":"2023-07-21T22:19:47.405292+0000","last_became_active":"2023-07-21T22:19:44.777266+0000","last_became_peered":"2023-07-21T22:19:44.777266+0000","last_unstale":"2023-07-21T22:19:47.405292+0000","last_undegraded":"2023-07-21T22:19:47.405292+0000","last_fullsized":"2023-07-21T22:19:47.405292+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:53:54.424873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769053+0000","last_change":"2023-07-21T22:19:45.787417+0000","last_active":"2023-07-21T22:19:46.769053+0000","last_peered":"2023-07-21T22:19:46.769053+0000","last_clean":"2023-07-21T22:19:46.769053+0000","last_became_active":"2023-07-21T22:19:45.787137+0000","last_became_peered":"2023-07-21T22:19:45.787137+0000","last_unstale":"2023-07-21T22:19:46.769053+0000","last_undegraded":"2023-07-21T22:19:46.769053+0000","last_fullsized":"2023-07-21T22:19:46.769053+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:03.794833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765467+0000","last_change":"2023-07-21T22:19:44.777277+0000","last_active":"2023-07-21T22:19:46.765467+0000","last_peered":"2023-07-21T22:19:46.765467+0000","last_clean":"2023-07-21T22:19:46.765467+0000","last_became_active":"2023-07-21T22:19:44.776977+0000","last_became_peered":"2023-07-21T22:19:44.776977+0000","last_unstale":"2023-07-21T22:19:46.765467+0000","last_undegraded":"2023-07-21T22:19:46.765467+0000","last_fullsized":"2023-07-21T22:19:46.765467+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:17:32.389832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.403834+0000","last_change":"2023-07-21T22:19:45.805182+0000","last_active":"2023-07-21T22:19:47.403834+0000","last_peered":"2023-07-21T22:19:47.403834+0000","last_clean":"2023-07-21T22:19:47.403834+0000","last_became_active":"2023-07-21T22:19:45.804788+0000","last_became_peered":"2023-07-21T22:19:45.804788+0000","last_unstale":"2023-07-21T22:19:47.403834+0000","last_undegraded":"2023-07-21T22:19:47.403834+0000","last_fullsized":"2023-07-21T22:19:47.403834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:41.214494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765271+0000","last_change":"2023-07-21T22:19:44.771175+0000","last_active":"2023-07-21T22:19:46.765271+0000","last_peered":"2023-07-21T22:19:46.765271+0000","last_clean":"2023-07-21T22:19:46.765271+0000","last_became_active":"2023-07-21T22:19:44.770768+0000","last_became_peered":"2023-07-21T22:19:44.770768+0000","last_unstale":"2023-07-21T22:19:46.765271+0000","last_undegraded":"2023-07-21T22:19:46.765271+0000","last_fullsized":"2023-07-21T22:19:46.765271+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:33:40.046607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905181+0000","last_change":"2023-07-21T22:19:45.778242+0000","last_active":"2023-07-21T22:19:46.905181+0000","last_peered":"2023-07-21T22:19:46.905181+0000","last_clean":"2023-07-21T22:19:46.905181+0000","last_became_active":"2023-07-21T22:19:45.777853+0000","last_became_peered":"2023-07-21T22:19:45.777853+0000","last_unstale":"2023-07-21T22:19:46.905181+0000","last_undegraded":"2023-07-21T22:19:46.905181+0000","last_fullsized":"2023-07-21T22:19:46.905181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:15:40.353165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769506+0000","last_change":"2023-07-21T22:19:44.782353+0000","last_active":"2023-07-21T22:19:46.769506+0000","last_peered":"2023-07-21T22:19:46.769506+0000","last_clean":"2023-07-21T22:19:46.769506+0000","last_became_active":"2023-07-21T22:19:44.782034+0000","last_became_peered":"2023-07-21T22:19:44.782034+0000","last_unstale":"2023-07-21T22:19:46.769506+0000","last_undegraded":"2023-07-21T22:19:46.769506+0000","last_fullsized":"2023-07-21T22:19:46.769506+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:20:16.300079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404473+0000","last_change":"2023-07-21T22:19:45.788130+0000","last_active":"2023-07-21T22:19:47.404473+0000","last_peered":"2023-07-21T22:19:47.404473+0000","last_clean":"2023-07-21T22:19:47.404473+0000","last_became_active":"2023-07-21T22:19:45.787524+0000","last_became_peered":"2023-07-21T22:19:45.787524+0000","last_unstale":"2023-07-21T22:19:47.404473+0000","last_undegraded":"2023-07-21T22:19:47.404473+0000","last_fullsized":"2023-07-21T22:19:47.404473+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:06:53.721606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765291+0000","last_change":"2023-07-21T22:19:44.777212+0000","last_active":"2023-07-21T22:19:46.765291+0000","last_peered":"2023-07-21T22:19:46.765291+0000","last_clean":"2023-07-21T22:19:46.765291+0000","last_became_active":"2023-07-21T22:19:44.776901+0000","last_became_peered":"2023-07-21T22:19:44.776901+0000","last_unstale":"2023-07-21T22:19:46.765291+0000","last_undegraded":"2023-07-21T22:19:46.765291+0000","last_fullsized":"2023-07-21T22:19:46.765291+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:45:10.993193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905696+0000","last_change":"2023-07-21T22:19:45.790032+0000","last_active":"2023-07-21T22:19:46.905696+0000","last_peered":"2023-07-21T22:19:46.905696+0000","last_clean":"2023-07-21T22:19:46.905696+0000","last_became_active":"2023-07-21T22:19:45.789745+0000","last_became_peered":"2023-07-21T22:19:45.789745+0000","last_unstale":"2023-07-21T22:19:46.905696+0000","last_undegraded":"2023-07-21T22:19:46.905696+0000","last_fullsized":"2023-07-21T22:19:46.905696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:00:34.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769465+0000","last_change":"2023-07-21T22:19:44.781768+0000","last_active":"2023-07-21T22:19:46.769465+0000","last_peered":"2023-07-21T22:19:46.769465+0000","last_clean":"2023-07-21T22:19:46.769465+0000","last_became_active":"2023-07-21T22:19:44.781490+0000","last_became_peered":"2023-07-21T22:19:44.781490+0000","last_unstale":"2023-07-21T22:19:46.769465+0000","last_undegraded":"2023-07-21T22:19:46.769465+0000","last_fullsized":"2023-07-21T22:19:46.769465+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:25:13.652064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":195,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769178+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:19:46.769178+0000","last_peered":"2023-07-21T22:19:46.769178+0000","last_clean":"2023-07-21T22:19:46.769178+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:19:46.769178+0000","last_undegraded":"2023-07-21T22:19:46.769178+0000","last_fullsized":"2023-07-21T22:19:46.769178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:14:26.705962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905748+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:19:46.905748+0000","last_peered":"2023-07-21T22:19:46.905748+0000","last_clean":"2023-07-21T22:19:46.905748+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:19:46.905748+0000","last_undegraded":"2023-07-21T22:19:46.905748+0000","last_fullsized":"2023-07-21T22:19:46.905748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:48:53.404894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405283+0000","last_change":"2023-07-21T22:19:45.800188+0000","last_active":"2023-07-21T22:19:47.405283+0000","last_peered":"2023-07-21T22:19:47.405283+0000","last_clean":"2023-07-21T22:19:47.405283+0000","last_became_active":"2023-07-21T22:19:45.799846+0000","last_became_peered":"2023-07-21T22:19:45.799846+0000","last_unstale":"2023-07-21T22:19:47.405283+0000","last_undegraded":"2023-07-21T22:19:47.405283+0000","last_fullsized":"2023-07-21T22:19:47.405283+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:28:50.889694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905912+0000","last_change":"2023-07-21T22:19:44.783741+0000","last_active":"2023-07-21T22:19:46.905912+0000","last_peered":"2023-07-21T22:19:46.905912+0000","last_clean":"2023-07-21T22:19:46.905912+0000","last_became_active":"2023-07-21T22:19:44.783453+0000","last_became_peered":"2023-07-21T22:19:44.783453+0000","last_unstale":"2023-07-21T22:19:46.905912+0000","last_undegraded":"2023-07-21T22:19:46.905912+0000","last_fullsized":"2023-07-21T22:19:46.905912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:20:44.879746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769016+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:19:46.769016+0000","last_peered":"2023-07-21T22:19:46.769016+0000","last_clean":"2023-07-21T22:19:46.769016+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:19:46.769016+0000","last_undegraded":"2023-07-21T22:19:46.769016+0000","last_fullsized":"2023-07-21T22:19:46.769016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:18:08.664515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769518+0000","last_change":"2023-07-21T22:19:45.791539+0000","last_active":"2023-07-21T22:19:46.769518+0000","last_peered":"2023-07-21T22:19:46.769518+0000","last_clean":"2023-07-21T22:19:46.769518+0000","last_became_active":"2023-07-21T22:19:45.787028+0000","last_became_peered":"2023-07-21T22:19:45.787028+0000","last_unstale":"2023-07-21T22:19:46.769518+0000","last_undegraded":"2023-07-21T22:19:46.769518+0000","last_fullsized":"2023-07-21T22:19:46.769518+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:02:43.243631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765763+0000","last_change":"2023-07-21T22:19:44.781409+0000","last_active":"2023-07-21T22:19:46.765763+0000","last_peered":"2023-07-21T22:19:46.765763+0000","last_clean":"2023-07-21T22:19:46.765763+0000","last_became_active":"2023-07-21T22:19:44.781102+0000","last_became_peered":"2023-07-21T22:19:44.781102+0000","last_unstale":"2023-07-21T22:19:46.765763+0000","last_undegraded":"2023-07-21T22:19:46.765763+0000","last_fullsized":"2023-07-21T22:19:46.765763+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:11:58.167178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765160+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:19:46.765160+0000","last_peered":"2023-07-21T22:19:46.765160+0000","last_clean":"2023-07-21T22:19:46.765160+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:19:46.765160+0000","last_undegraded":"2023-07-21T22:19:46.765160+0000","last_fullsized":"2023-07-21T22:19:46.765160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:37:03.690965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404780+0000","last_change":"2023-07-21T22:19:45.792921+0000","last_active":"2023-07-21T22:19:47.404780+0000","last_peered":"2023-07-21T22:19:47.404780+0000","last_clean":"2023-07-21T22:19:47.404780+0000","last_became_active":"2023-07-21T22:19:45.792564+0000","last_became_peered":"2023-07-21T22:19:45.792564+0000","last_unstale":"2023-07-21T22:19:47.404780+0000","last_undegraded":"2023-07-21T22:19:47.404780+0000","last_fullsized":"2023-07-21T22:19:47.404780+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:05:50.571384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404191+0000","last_change":"2023-07-21T22:19:44.782520+0000","last_active":"2023-07-21T22:19:47.404191+0000","last_peered":"2023-07-21T22:19:47.404191+0000","last_clean":"2023-07-21T22:19:47.404191+0000","last_became_active":"2023-07-21T22:19:44.782191+0000","last_became_peered":"2023-07-21T22:19:44.782191+0000","last_unstale":"2023-07-21T22:19:47.404191+0000","last_undegraded":"2023-07-21T22:19:47.404191+0000","last_fullsized":"2023-07-21T22:19:47.404191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:58:16.854391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905638+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:19:46.905638+0000","last_peered":"2023-07-21T22:19:46.905638+0000","last_clean":"2023-07-21T22:19:46.905638+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:19:46.905638+0000","last_undegraded":"2023-07-21T22:19:46.905638+0000","last_fullsized":"2023-07-21T22:19:46.905638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:08:19.633889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.403801+0000","last_change":"2023-07-21T22:19:45.799275+0000","last_active":"2023-07-21T22:19:47.403801+0000","last_peered":"2023-07-21T22:19:47.403801+0000","last_clean":"2023-07-21T22:19:47.403801+0000","last_became_active":"2023-07-21T22:19:45.798982+0000","last_became_peered":"2023-07-21T22:19:45.798982+0000","last_unstale":"2023-07-21T22:19:47.403801+0000","last_undegraded":"2023-07-21T22:19:47.403801+0000","last_fullsized":"2023-07-21T22:19:47.403801+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:24:08.073448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404207+0000","last_change":"2023-07-21T22:19:44.781398+0000","last_active":"2023-07-21T22:19:47.404207+0000","last_peered":"2023-07-21T22:19:47.404207+0000","last_clean":"2023-07-21T22:19:47.404207+0000","last_became_active":"2023-07-21T22:19:44.781004+0000","last_became_peered":"2023-07-21T22:19:44.781004+0000","last_unstale":"2023-07-21T22:19:47.404207+0000","last_undegraded":"2023-07-21T22:19:47.404207+0000","last_fullsized":"2023-07-21T22:19:47.404207+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:10:17.869764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405409+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:19:47.405409+0000","last_peered":"2023-07-21T22:19:47.405409+0000","last_clean":"2023-07-21T22:19:47.405409+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:19:47.405409+0000","last_undegraded":"2023-07-21T22:19:47.405409+0000","last_fullsized":"2023-07-21T22:19:47.405409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:04:43.078594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404890+0000","last_change":"2023-07-21T22:19:45.778736+0000","last_active":"2023-07-21T22:19:47.404890+0000","last_peered":"2023-07-21T22:19:47.404890+0000","last_clean":"2023-07-21T22:19:47.404890+0000","last_became_active":"2023-07-21T22:19:45.778432+0000","last_became_peered":"2023-07-21T22:19:45.778432+0000","last_unstale":"2023-07-21T22:19:47.404890+0000","last_undegraded":"2023-07-21T22:19:47.404890+0000","last_fullsized":"2023-07-21T22:19:47.404890+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:40:24.707300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769121+0000","last_change":"2023-07-21T22:19:44.782410+0000","last_active":"2023-07-21T22:19:46.769121+0000","last_peered":"2023-07-21T22:19:46.769121+0000","last_clean":"2023-07-21T22:19:46.769121+0000","last_became_active":"2023-07-21T22:19:44.782110+0000","last_became_peered":"2023-07-21T22:19:44.782110+0000","last_unstale":"2023-07-21T22:19:46.769121+0000","last_undegraded":"2023-07-21T22:19:46.769121+0000","last_fullsized":"2023-07-21T22:19:46.769121+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:16:16.396319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769729+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:19:46.769729+0000","last_peered":"2023-07-21T22:19:46.769729+0000","last_clean":"2023-07-21T22:19:46.769729+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:19:46.769729+0000","last_undegraded":"2023-07-21T22:19:46.769729+0000","last_fullsized":"2023-07-21T22:19:46.769729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:08:19.633889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405572+0000","last_change":"2023-07-21T22:19:45.795601+0000","last_active":"2023-07-21T22:19:47.405572+0000","last_peered":"2023-07-21T22:19:47.405572+0000","last_clean":"2023-07-21T22:19:47.405572+0000","last_became_active":"2023-07-21T22:19:45.795286+0000","last_became_peered":"2023-07-21T22:19:45.795286+0000","last_unstale":"2023-07-21T22:19:47.405572+0000","last_undegraded":"2023-07-21T22:19:47.405572+0000","last_fullsized":"2023-07-21T22:19:47.405572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:59:09.560857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405501+0000","last_change":"2023-07-21T22:19:44.779517+0000","last_active":"2023-07-21T22:19:47.405501+0000","last_peered":"2023-07-21T22:19:47.405501+0000","last_clean":"2023-07-21T22:19:47.405501+0000","last_became_active":"2023-07-21T22:19:44.779216+0000","last_became_peered":"2023-07-21T22:19:44.779216+0000","last_unstale":"2023-07-21T22:19:47.405501+0000","last_undegraded":"2023-07-21T22:19:47.405501+0000","last_fullsized":"2023-07-21T22:19:47.405501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:15:39.344472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405461+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:19:47.405461+0000","last_peered":"2023-07-21T22:19:47.405461+0000","last_clean":"2023-07-21T22:19:47.405461+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:19:47.405461+0000","last_undegraded":"2023-07-21T22:19:47.405461+0000","last_fullsized":"2023-07-21T22:19:47.405461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:46:40.731439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769742+0000","last_change":"2023-07-21T22:19:45.786411+0000","last_active":"2023-07-21T22:19:46.769742+0000","last_peered":"2023-07-21T22:19:46.769742+0000","last_clean":"2023-07-21T22:19:46.769742+0000","last_became_active":"2023-07-21T22:19:45.785976+0000","last_became_peered":"2023-07-21T22:19:45.785976+0000","last_unstale":"2023-07-21T22:19:46.769742+0000","last_undegraded":"2023-07-21T22:19:46.769742+0000","last_fullsized":"2023-07-21T22:19:46.769742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:24.695017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404652+0000","last_change":"2023-07-21T22:19:44.778837+0000","last_active":"2023-07-21T22:19:47.404652+0000","last_peered":"2023-07-21T22:19:47.404652+0000","last_clean":"2023-07-21T22:19:47.404652+0000","last_became_active":"2023-07-21T22:19:44.778207+0000","last_became_peered":"2023-07-21T22:19:44.778207+0000","last_unstale":"2023-07-21T22:19:47.404652+0000","last_undegraded":"2023-07-21T22:19:47.404652+0000","last_fullsized":"2023-07-21T22:19:47.404652+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:53:54.424873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.770448+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:19:46.770448+0000","last_peered":"2023-07-21T22:19:46.770448+0000","last_clean":"2023-07-21T22:19:46.770448+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:19:46.770448+0000","last_undegraded":"2023-07-21T22:19:46.770448+0000","last_fullsized":"2023-07-21T22:19:46.770448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:41:54.570180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":1048576,"data_stored":772251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.42799999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.44900000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.65100000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.59799999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.38},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.53000000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.5},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.46500000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.63900000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":446464,"data_stored":180361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.85399999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.628},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.875}]},{"osd":2,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.69699999999999995}]},{"osd":3,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.745},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.78900000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.67300000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.71899999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.90200000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":446464,"data_stored":180853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61699999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.499}]},{"osd":2,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.443},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.66600000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.59399999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":181847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.498},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.47499999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.45100000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.51800000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.84699999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.81299999999999994}]},{"osd":6,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.90500000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":442368,"data_stored":180319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.52900000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.44900000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.433}]},{"osd":4,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.629}]},{"osd":6,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.59699999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.60999999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":442368,"data_stored":180339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":5.4800000000000004,"5min":5.4800000000000004,"15min":5.4800000000000004},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.71899999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":3.4220000000000002,"5min":3.4220000000000002,"15min":3.4220000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.46800000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":5.8710000000000004,"5min":5.8710000000000004,"15min":5.8710000000000004},"last":0.42899999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":3.6259999999999999,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.4100000000000001,"5min":4.4100000000000001,"15min":4.4100000000000001},"last":0.78900000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":5.766,"5min":5.766,"15min":5.766},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.669,"5min":3.669,"15min":3.669},"last":0.89500000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":5.8200000000000003,"5min":5.8200000000000003,"15min":5.8200000000000003},"last":0.80800000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.9269999999999996,"5min":5.9269999999999996,"15min":5.9269999999999996},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":3.5800000000000001,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.93600000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":1036288,"data_stored":770651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.432}]},{"osd":3,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.499}]},{"osd":4,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73999999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.71999999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":442368,"data_stored":180831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":0.751}]},{"osd":1,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":8.6280000000000001,"5min":8.6280000000000001,"15min":8.6280000000000001},"last":0.72099999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.626},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.67600000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":3.1829999999999998,"5min":3.1829999999999998,"15min":3.1829999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":2.887,"5min":2.887,"15min":2.887},"last":0.64900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.81599999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":8.0760000000000005,"5min":8.0760000000000005,"15min":8.0760000000000005},"last":0.70399999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:19:54.527 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:19:54.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.635+0000 7f398b49c640 1 Processor -- start 2023-07-21T22:19:54.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.635+0000 7f398b49c640 1 -- start start 2023-07-21T22:19:54.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.635+0000 7f398b49c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f398414f200 0x7f3984069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:54.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.635+0000 7f398b49c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39840650b0 0x7f39840adab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:54.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.635+0000 7f398b49c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398406c0c0 con 0x7f39840654e0 2023-07-21T22:19:54.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.635+0000 7f398b49c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398414f5d0 con 0x7f398414f200 2023-07-21T22:19:54.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.635+0000 7f398b49c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398406bdc0 con 0x7f39840650b0 2023-07-21T22:19:54.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.635+0000 7f3989238640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f398414f200 0x7f3984069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:54.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.635+0000 7f3989238640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f398414f200 0x7f3984069430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48180/0 (socket says 172.21.15.6:48180) 2023-07-21T22:19:54.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.635+0000 7f3989238640 1 -- 172.21.15.6:0/2123233103 learned_addr learned my addr 172.21.15.6:0/2123233103 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:54.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.635+0000 7f3988a37640 1 --2- 172.21.15.6:0/2123233103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39840650b0 0x7f39840adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:54.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.639+0000 7f3989238640 1 -- 172.21.15.6:0/2123233103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39840650b0 msgr2=0x7f39840adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:54.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.639+0000 7f3989238640 1 --2- 172.21.15.6:0/2123233103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39840650b0 0x7f39840adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:54.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.639+0000 7f3989238640 1 -- 172.21.15.6:0/2123233103 >> v1:172.21.15.161:6789/0 conn(0x7f39840654e0 legacy=0x7f39840b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:54.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.639+0000 7f3989238640 1 -- 172.21.15.6:0/2123233103 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39840b31b0 con 0x7f398414f200 2023-07-21T22:19:54.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.639+0000 7f3988a37640 1 --2- 172.21.15.6:0/2123233103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39840650b0 0x7f39840adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:54.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.639+0000 7f3989238640 1 --2- 172.21.15.6:0/2123233103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398414f200 0x7f3984069430 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3980009870 tx=0x7f398001e750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991685c0c6f6d55d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:54.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.639+0000 7f397bfff640 1 -- 172.21.15.6:0/2123233103 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39800a8630 con 0x7f398414f200 2023-07-21T22:19:54.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.639+0000 7f397bfff640 1 -- 172.21.15.6:0/2123233103 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39800a8790 con 0x7f398414f200 2023-07-21T22:19:54.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.639+0000 7f397bfff640 1 -- 172.21.15.6:0/2123233103 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39800a8b20 con 0x7f398414f200 2023-07-21T22:19:54.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.639+0000 7f398b49c640 1 -- 172.21.15.6:0/2123233103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398414f200 msgr2=0x7f3984069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:54.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.639+0000 7f398b49c640 1 --2- 172.21.15.6:0/2123233103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398414f200 0x7f3984069430 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3980009870 tx=0x7f398001e750 comp rx=0 tx=0).stop 2023-07-21T22:19:54.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.639+0000 7f398b49c640 1 -- 172.21.15.6:0/2123233103 shutdown_connections 2023-07-21T22:19:54.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.639+0000 7f398b49c640 1 --2- 172.21.15.6:0/2123233103 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39840650b0 0x7f39840adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:54.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.639+0000 7f398b49c640 1 --2- 172.21.15.6:0/2123233103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398414f200 0x7f3984069430 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:54.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.639+0000 7f398b49c640 1 -- 172.21.15.6:0/2123233103 >> 172.21.15.6:0/2123233103 conn(0x7f39840b1300 msgr2=0x7f39840ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:54.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f398b49c640 1 -- 172.21.15.6:0/2123233103 shutdown_connections 2023-07-21T22:19:54.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f398b49c640 1 -- 172.21.15.6:0/2123233103 wait complete. 2023-07-21T22:19:54.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f398b49c640 1 Processor -- start 2023-07-21T22:19:54.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f398b49c640 1 -- start start 2023-07-21T22:19:54.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f398b49c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39840650b0 0x7f39840aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:54.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f398b49c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39840654e0 0x7f39840acf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:54.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f398b49c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f398414f200 0x7f39841f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:54.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f398b49c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39841f5d80 con 0x7f39840650b0 2023-07-21T22:19:54.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f398b49c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39840cc340 con 0x7f398414f200 2023-07-21T22:19:54.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f398b49c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3984136e00 con 0x7f39840654e0 2023-07-21T22:19:54.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f3989238640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39840650b0 0x7f39840aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:54.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f3989238640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39840650b0 0x7f39840aca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48188/0 (socket says 172.21.15.6:48188) 2023-07-21T22:19:54.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f3989238640 1 -- 172.21.15.6:0/2811057517 learned_addr learned my addr 172.21.15.6:0/2811057517 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:54.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f3988a37640 1 --2- 172.21.15.6:0/2811057517 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39840654e0 0x7f39840acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:54.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f3989a39640 1 --2- 172.21.15.6:0/2811057517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f398414f200 0x7f39841f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:54.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f3989238640 1 -- 172.21.15.6:0/2811057517 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39840654e0 msgr2=0x7f39840acf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:54.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f3989238640 1 --2- 172.21.15.6:0/2811057517 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39840654e0 0x7f39840acf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:54.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f3989238640 1 -- 172.21.15.6:0/2811057517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f398414f200 msgr2=0x7f39841f4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:54.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f3989238640 1 --2- 172.21.15.6:0/2811057517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f398414f200 0x7f39841f4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:54.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f3989238640 1 -- 172.21.15.6:0/2811057517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39800094d0 con 0x7f39840650b0 2023-07-21T22:19:54.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f3988a37640 1 --2- 172.21.15.6:0/2811057517 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39840654e0 0x7f39840acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:54.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f3989a39640 1 --2- 172.21.15.6:0/2811057517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f398414f200 0x7f39841f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:54.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.643+0000 7f3989238640 1 --2- 172.21.15.6:0/2811057517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39840650b0 0x7f39840aca10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f398001ce00 tx=0x7f398001b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:54.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.647+0000 7f3979ffb640 1 -- 172.21.15.6:0/2811057517 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39800b3860 con 0x7f39840650b0 2023-07-21T22:19:54.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.647+0000 7f3979ffb640 1 -- 172.21.15.6:0/2811057517 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39800b39c0 con 0x7f39840650b0 2023-07-21T22:19:54.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.647+0000 7f3979ffb640 1 -- 172.21.15.6:0/2811057517 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39800b3d50 con 0x7f39840650b0 2023-07-21T22:19:54.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.647+0000 7f398b49c640 1 -- 172.21.15.6:0/2811057517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39841f5aa0 con 0x7f39840650b0 2023-07-21T22:19:54.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.647+0000 7f398b49c640 1 -- 172.21.15.6:0/2811057517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39840cc8c0 con 0x7f39840650b0 2023-07-21T22:19:54.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.647+0000 7f398b49c640 1 -- 172.21.15.6:0/2811057517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39840678d0 con 0x7f39840650b0 2023-07-21T22:19:54.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.647+0000 7f3979ffb640 1 -- 172.21.15.6:0/2811057517 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f39800bf460 con 0x7f39840650b0 2023-07-21T22:19:54.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.647+0000 7f3979ffb640 1 --2- 172.21.15.6:0/2811057517 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3968066280 0x7f3968068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:54.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.647+0000 7f3979ffb640 1 -- 172.21.15.6:0/2811057517 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f398011dff0 con 0x7f39840650b0 2023-07-21T22:19:54.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.647+0000 7f3988a37640 1 --2- 172.21.15.6:0/2811057517 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3968066280 0x7f3968068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:54.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.651+0000 7f3988a37640 1 --2- 172.21.15.6:0/2811057517 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3968066280 0x7f3968068730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3984139f90 tx=0x7f3974008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:54.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.651+0000 7f3979ffb640 1 -- 172.21.15.6:0/2811057517 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f39800eb5a0 con 0x7f39840650b0 2023-07-21T22:19:54.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.807+0000 7f398b49c640 1 -- 172.21.15.6:0/2811057517 --> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39840ae400 con 0x7f3968066280 2023-07-21T22:19:54.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.815+0000 7f3979ffb640 1 -- 172.21.15.6:0/2811057517 <== mgr.4103 v2:172.21.15.161:6832/3471136886 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311477 (secure 0 0 0) 0x7f3974009600 con 0x7f3968066280 2023-07-21T22:19:54.867 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:54.869 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:19:54.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.819+0000 7f398b49c640 1 -- 172.21.15.6:0/2811057517 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3968066280 msgr2=0x7f3968068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:54.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.819+0000 7f398b49c640 1 --2- 172.21.15.6:0/2811057517 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3968066280 0x7f3968068730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3984139f90 tx=0x7f3974008040 comp rx=0 tx=0).stop 2023-07-21T22:19:54.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.819+0000 7f398b49c640 1 -- 172.21.15.6:0/2811057517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39840650b0 msgr2=0x7f39840aca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:54.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.819+0000 7f398b49c640 1 --2- 172.21.15.6:0/2811057517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39840650b0 0x7f39840aca10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f398001ce00 tx=0x7f398001b4f0 comp rx=0 tx=0).stop 2023-07-21T22:19:54.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.819+0000 7f398b49c640 1 -- 172.21.15.6:0/2811057517 shutdown_connections 2023-07-21T22:19:54.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.819+0000 7f398b49c640 1 --2- 172.21.15.6:0/2811057517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f398414f200 0x7f39841f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:54.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.819+0000 7f398b49c640 1 --2- 172.21.15.6:0/2811057517 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39840654e0 0x7f39840acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:54.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.819+0000 7f398b49c640 1 --2- 172.21.15.6:0/2811057517 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f3968066280 0x7f3968068730 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:54.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.819+0000 7f398b49c640 1 --2- 172.21.15.6:0/2811057517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39840650b0 0x7f39840aca10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:54.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.819+0000 7f398b49c640 1 -- 172.21.15.6:0/2811057517 >> 172.21.15.6:0/2811057517 conn(0x7f39840b1300 msgr2=0x7f398406a870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:54.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.819+0000 7f398b49c640 1 -- 172.21.15.6:0/2811057517 shutdown_connections 2023-07-21T22:19:54.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:54.819+0000 7f398b49c640 1 -- 172.21.15.6:0/2811057517 wait complete. 2023-07-21T22:19:54.888 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2023-07-21T22:19:54.784322+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220264,"kb_used_data":4648,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754456,"statfs":{"total":773094113280,"available":772868562944,"internally_reserved":0,"allocated":4759552,"data_stored":2627452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.018679"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405133+0000","last_change":"2023-07-21T22:19:45.798366+0000","last_active":"2023-07-21T22:19:47.405133+0000","last_peered":"2023-07-21T22:19:47.405133+0000","last_clean":"2023-07-21T22:19:47.405133+0000","last_became_active":"2023-07-21T22:19:45.798041+0000","last_became_peered":"2023-07-21T22:19:45.798041+0000","last_unstale":"2023-07-21T22:19:47.405133+0000","last_undegraded":"2023-07-21T22:19:47.405133+0000","last_fullsized":"2023-07-21T22:19:47.405133+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:47:48.224228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404636+0000","last_change":"2023-07-21T22:19:45.790485+0000","last_active":"2023-07-21T22:19:47.404636+0000","last_peered":"2023-07-21T22:19:47.404636+0000","last_clean":"2023-07-21T22:19:47.404636+0000","last_became_active":"2023-07-21T22:19:45.789044+0000","last_became_peered":"2023-07-21T22:19:45.789044+0000","last_unstale":"2023-07-21T22:19:47.404636+0000","last_undegraded":"2023-07-21T22:19:47.404636+0000","last_fullsized":"2023-07-21T22:19:47.404636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:28:50.889694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404331+0000","last_change":"2023-07-21T22:19:45.800124+0000","last_active":"2023-07-21T22:19:47.404331+0000","last_peered":"2023-07-21T22:19:47.404331+0000","last_clean":"2023-07-21T22:19:47.404331+0000","last_became_active":"2023-07-21T22:19:45.799827+0000","last_became_peered":"2023-07-21T22:19:45.799827+0000","last_unstale":"2023-07-21T22:19:47.404331+0000","last_undegraded":"2023-07-21T22:19:47.404331+0000","last_fullsized":"2023-07-21T22:19:47.404331+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:43:36.408275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765431+0000","last_change":"2023-07-21T22:19:45.795476+0000","last_active":"2023-07-21T22:19:46.765431+0000","last_peered":"2023-07-21T22:19:46.765431+0000","last_clean":"2023-07-21T22:19:46.765431+0000","last_became_active":"2023-07-21T22:19:45.795190+0000","last_became_peered":"2023-07-21T22:19:45.795190+0000","last_unstale":"2023-07-21T22:19:46.765431+0000","last_undegraded":"2023-07-21T22:19:46.765431+0000","last_fullsized":"2023-07-21T22:19:46.765431+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:14.477166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765811+0000","last_change":"2023-07-21T22:19:45.793167+0000","last_active":"2023-07-21T22:19:46.765811+0000","last_peered":"2023-07-21T22:19:46.765811+0000","last_clean":"2023-07-21T22:19:46.765811+0000","last_became_active":"2023-07-21T22:19:45.792899+0000","last_became_peered":"2023-07-21T22:19:45.792899+0000","last_unstale":"2023-07-21T22:19:46.765811+0000","last_undegraded":"2023-07-21T22:19:46.765811+0000","last_fullsized":"2023-07-21T22:19:46.765811+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:27:50.718755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405145+0000","last_change":"2023-07-21T22:19:45.787988+0000","last_active":"2023-07-21T22:19:47.405145+0000","last_peered":"2023-07-21T22:19:47.405145+0000","last_clean":"2023-07-21T22:19:47.405145+0000","last_became_active":"2023-07-21T22:19:45.787704+0000","last_became_peered":"2023-07-21T22:19:45.787704+0000","last_unstale":"2023-07-21T22:19:47.405145+0000","last_undegraded":"2023-07-21T22:19:47.405145+0000","last_fullsized":"2023-07-21T22:19:47.405145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:08:09.119388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905154+0000","last_change":"2023-07-21T22:19:45.790633+0000","last_active":"2023-07-21T22:19:46.905154+0000","last_peered":"2023-07-21T22:19:46.905154+0000","last_clean":"2023-07-21T22:19:46.905154+0000","last_became_active":"2023-07-21T22:19:45.790075+0000","last_became_peered":"2023-07-21T22:19:45.790075+0000","last_unstale":"2023-07-21T22:19:46.905154+0000","last_undegraded":"2023-07-21T22:19:46.905154+0000","last_fullsized":"2023-07-21T22:19:46.905154+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:26.174778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404523+0000","last_change":"2023-07-21T22:19:45.783149+0000","last_active":"2023-07-21T22:19:47.404523+0000","last_peered":"2023-07-21T22:19:47.404523+0000","last_clean":"2023-07-21T22:19:47.404523+0000","last_became_active":"2023-07-21T22:19:45.782854+0000","last_became_peered":"2023-07-21T22:19:45.782854+0000","last_unstale":"2023-07-21T22:19:47.404523+0000","last_undegraded":"2023-07-21T22:19:47.404523+0000","last_fullsized":"2023-07-21T22:19:47.404523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:08:09.119388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404255+0000","last_change":"2023-07-21T22:19:45.800035+0000","last_active":"2023-07-21T22:19:47.404255+0000","last_peered":"2023-07-21T22:19:47.404255+0000","last_clean":"2023-07-21T22:19:47.404255+0000","last_became_active":"2023-07-21T22:19:45.799766+0000","last_became_peered":"2023-07-21T22:19:45.799766+0000","last_unstale":"2023-07-21T22:19:47.404255+0000","last_undegraded":"2023-07-21T22:19:47.404255+0000","last_fullsized":"2023-07-21T22:19:47.404255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:05:06.892121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905545+0000","last_change":"2023-07-21T22:19:45.780960+0000","last_active":"2023-07-21T22:19:46.905545+0000","last_peered":"2023-07-21T22:19:46.905545+0000","last_clean":"2023-07-21T22:19:46.905545+0000","last_became_active":"2023-07-21T22:19:45.779499+0000","last_became_peered":"2023-07-21T22:19:45.779499+0000","last_unstale":"2023-07-21T22:19:46.905545+0000","last_undegraded":"2023-07-21T22:19:46.905545+0000","last_fullsized":"2023-07-21T22:19:46.905545+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:20:17.308772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905543+0000","last_change":"2023-07-21T22:19:45.782413+0000","last_active":"2023-07-21T22:19:46.905543+0000","last_peered":"2023-07-21T22:19:46.905543+0000","last_clean":"2023-07-21T22:19:46.905543+0000","last_became_active":"2023-07-21T22:19:45.781976+0000","last_became_peered":"2023-07-21T22:19:45.781976+0000","last_unstale":"2023-07-21T22:19:46.905543+0000","last_undegraded":"2023-07-21T22:19:46.905543+0000","last_fullsized":"2023-07-21T22:19:46.905543+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:25:14.660757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.403961+0000","last_change":"2023-07-21T22:19:45.796632+0000","last_active":"2023-07-21T22:19:47.403961+0000","last_peered":"2023-07-21T22:19:47.403961+0000","last_clean":"2023-07-21T22:19:47.403961+0000","last_became_active":"2023-07-21T22:19:45.796308+0000","last_became_peered":"2023-07-21T22:19:45.796308+0000","last_unstale":"2023-07-21T22:19:47.403961+0000","last_undegraded":"2023-07-21T22:19:47.403961+0000","last_fullsized":"2023-07-21T22:19:47.403961+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:09:29.099443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905613+0000","last_change":"2023-07-21T22:19:45.780887+0000","last_active":"2023-07-21T22:19:46.905613+0000","last_peered":"2023-07-21T22:19:46.905613+0000","last_clean":"2023-07-21T22:19:46.905613+0000","last_became_active":"2023-07-21T22:19:45.780574+0000","last_became_peered":"2023-07-21T22:19:45.780574+0000","last_unstale":"2023-07-21T22:19:46.905613+0000","last_undegraded":"2023-07-21T22:19:46.905613+0000","last_fullsized":"2023-07-21T22:19:46.905613+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:02:43.243631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405564+0000","last_change":"2023-07-21T22:19:45.781979+0000","last_active":"2023-07-21T22:19:47.405564+0000","last_peered":"2023-07-21T22:19:47.405564+0000","last_clean":"2023-07-21T22:19:47.405564+0000","last_became_active":"2023-07-21T22:19:45.781679+0000","last_became_peered":"2023-07-21T22:19:45.781679+0000","last_unstale":"2023-07-21T22:19:47.405564+0000","last_undegraded":"2023-07-21T22:19:47.405564+0000","last_fullsized":"2023-07-21T22:19:47.405564+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:53:07.234756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905146+0000","last_change":"2023-07-21T22:19:45.790432+0000","last_active":"2023-07-21T22:19:46.905146+0000","last_peered":"2023-07-21T22:19:46.905146+0000","last_clean":"2023-07-21T22:19:46.905146+0000","last_became_active":"2023-07-21T22:19:45.789693+0000","last_became_peered":"2023-07-21T22:19:45.789693+0000","last_unstale":"2023-07-21T22:19:46.905146+0000","last_undegraded":"2023-07-21T22:19:46.905146+0000","last_fullsized":"2023-07-21T22:19:46.905146+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:26:16.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.768864+0000","last_change":"2023-07-21T22:19:45.802267+0000","last_active":"2023-07-21T22:19:46.768864+0000","last_peered":"2023-07-21T22:19:46.768864+0000","last_clean":"2023-07-21T22:19:46.768864+0000","last_became_active":"2023-07-21T22:19:45.801816+0000","last_became_peered":"2023-07-21T22:19:45.801816+0000","last_unstale":"2023-07-21T22:19:46.768864+0000","last_undegraded":"2023-07-21T22:19:46.768864+0000","last_fullsized":"2023-07-21T22:19:46.768864+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:00:23.125262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769897+0000","last_change":"2023-07-21T22:19:45.803335+0000","last_active":"2023-07-21T22:19:46.769897+0000","last_peered":"2023-07-21T22:19:46.769897+0000","last_clean":"2023-07-21T22:19:46.769897+0000","last_became_active":"2023-07-21T22:19:45.803048+0000","last_became_peered":"2023-07-21T22:19:45.803048+0000","last_unstale":"2023-07-21T22:19:46.769897+0000","last_undegraded":"2023-07-21T22:19:46.769897+0000","last_fullsized":"2023-07-21T22:19:46.769897+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:00:34.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769960+0000","last_change":"2023-07-21T22:19:45.795606+0000","last_active":"2023-07-21T22:19:46.769960+0000","last_peered":"2023-07-21T22:19:46.769960+0000","last_clean":"2023-07-21T22:19:46.769960+0000","last_became_active":"2023-07-21T22:19:45.795338+0000","last_became_peered":"2023-07-21T22:19:45.795338+0000","last_unstale":"2023-07-21T22:19:46.769960+0000","last_undegraded":"2023-07-21T22:19:46.769960+0000","last_fullsized":"2023-07-21T22:19:46.769960+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:05:03.294830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765607+0000","last_change":"2023-07-21T22:19:45.779369+0000","last_active":"2023-07-21T22:19:46.765607+0000","last_peered":"2023-07-21T22:19:46.765607+0000","last_clean":"2023-07-21T22:19:46.765607+0000","last_became_active":"2023-07-21T22:19:45.778931+0000","last_became_peered":"2023-07-21T22:19:45.778931+0000","last_unstale":"2023-07-21T22:19:46.765607+0000","last_undegraded":"2023-07-21T22:19:46.765607+0000","last_fullsized":"2023-07-21T22:19:46.765607+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:20:36.840818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769707+0000","last_change":"2023-07-21T22:19:45.796986+0000","last_active":"2023-07-21T22:19:46.769707+0000","last_peered":"2023-07-21T22:19:46.769707+0000","last_clean":"2023-07-21T22:19:46.769707+0000","last_became_active":"2023-07-21T22:19:45.796681+0000","last_became_peered":"2023-07-21T22:19:45.796681+0000","last_unstale":"2023-07-21T22:19:46.769707+0000","last_undegraded":"2023-07-21T22:19:46.769707+0000","last_fullsized":"2023-07-21T22:19:46.769707+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:37.771891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905366+0000","last_change":"2023-07-21T22:19:45.782016+0000","last_active":"2023-07-21T22:19:46.905366+0000","last_peered":"2023-07-21T22:19:46.905366+0000","last_clean":"2023-07-21T22:19:46.905366+0000","last_became_active":"2023-07-21T22:19:45.780993+0000","last_became_peered":"2023-07-21T22:19:45.780993+0000","last_unstale":"2023-07-21T22:19:46.905366+0000","last_undegraded":"2023-07-21T22:19:46.905366+0000","last_fullsized":"2023-07-21T22:19:46.905366+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:22:02.565752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.406016+0000","last_change":"2023-07-21T22:19:45.793594+0000","last_active":"2023-07-21T22:19:47.406016+0000","last_peered":"2023-07-21T22:19:47.406016+0000","last_clean":"2023-07-21T22:19:47.406016+0000","last_became_active":"2023-07-21T22:19:45.788051+0000","last_became_peered":"2023-07-21T22:19:45.788051+0000","last_unstale":"2023-07-21T22:19:47.406016+0000","last_undegraded":"2023-07-21T22:19:47.406016+0000","last_fullsized":"2023-07-21T22:19:47.406016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:02:43.243631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769131+0000","last_change":"2023-07-21T22:19:45.787042+0000","last_active":"2023-07-21T22:19:46.769131+0000","last_peered":"2023-07-21T22:19:46.769131+0000","last_clean":"2023-07-21T22:19:46.769131+0000","last_became_active":"2023-07-21T22:19:45.786744+0000","last_became_peered":"2023-07-21T22:19:45.786744+0000","last_unstale":"2023-07-21T22:19:46.769131+0000","last_undegraded":"2023-07-21T22:19:46.769131+0000","last_fullsized":"2023-07-21T22:19:46.769131+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:26:16.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765158+0000","last_change":"2023-07-21T22:19:45.781151+0000","last_active":"2023-07-21T22:19:46.765158+0000","last_peered":"2023-07-21T22:19:46.765158+0000","last_clean":"2023-07-21T22:19:46.765158+0000","last_became_active":"2023-07-21T22:19:45.780518+0000","last_became_peered":"2023-07-21T22:19:45.780518+0000","last_unstale":"2023-07-21T22:19:46.765158+0000","last_undegraded":"2023-07-21T22:19:46.765158+0000","last_fullsized":"2023-07-21T22:19:46.765158+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:26:15.236042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.770252+0000","last_change":"2023-07-21T22:19:45.800520+0000","last_active":"2023-07-21T22:19:46.770252+0000","last_peered":"2023-07-21T22:19:46.770252+0000","last_clean":"2023-07-21T22:19:46.770252+0000","last_became_active":"2023-07-21T22:19:45.800254+0000","last_became_peered":"2023-07-21T22:19:45.800254+0000","last_unstale":"2023-07-21T22:19:46.770252+0000","last_undegraded":"2023-07-21T22:19:46.770252+0000","last_fullsized":"2023-07-21T22:19:46.770252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:33:03.322922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405475+0000","last_change":"2023-07-21T22:19:45.800069+0000","last_active":"2023-07-21T22:19:47.405475+0000","last_peered":"2023-07-21T22:19:47.405475+0000","last_clean":"2023-07-21T22:19:47.405475+0000","last_became_active":"2023-07-21T22:19:45.799789+0000","last_became_peered":"2023-07-21T22:19:45.799789+0000","last_unstale":"2023-07-21T22:19:47.405475+0000","last_undegraded":"2023-07-21T22:19:47.405475+0000","last_fullsized":"2023-07-21T22:19:47.405475+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:16.163592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769264+0000","last_change":"2023-07-21T22:19:45.784271+0000","last_active":"2023-07-21T22:19:46.769264+0000","last_peered":"2023-07-21T22:19:46.769264+0000","last_clean":"2023-07-21T22:19:46.769264+0000","last_became_active":"2023-07-21T22:19:45.783982+0000","last_became_peered":"2023-07-21T22:19:45.783982+0000","last_unstale":"2023-07-21T22:19:46.769264+0000","last_undegraded":"2023-07-21T22:19:46.769264+0000","last_fullsized":"2023-07-21T22:19:46.769264+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:33:58.235048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905507+0000","last_change":"2023-07-21T22:19:45.792190+0000","last_active":"2023-07-21T22:19:46.905507+0000","last_peered":"2023-07-21T22:19:46.905507+0000","last_clean":"2023-07-21T22:19:46.905507+0000","last_became_active":"2023-07-21T22:19:45.791916+0000","last_became_peered":"2023-07-21T22:19:45.791916+0000","last_unstale":"2023-07-21T22:19:46.905507+0000","last_undegraded":"2023-07-21T22:19:46.905507+0000","last_fullsized":"2023-07-21T22:19:46.905507+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:59:09.560857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769462+0000","last_change":"2023-07-21T22:19:45.780510+0000","last_active":"2023-07-21T22:19:46.769462+0000","last_peered":"2023-07-21T22:19:46.769462+0000","last_clean":"2023-07-21T22:19:46.769462+0000","last_became_active":"2023-07-21T22:19:45.780241+0000","last_became_peered":"2023-07-21T22:19:45.780241+0000","last_unstale":"2023-07-21T22:19:46.769462+0000","last_undegraded":"2023-07-21T22:19:46.769462+0000","last_fullsized":"2023-07-21T22:19:46.769462+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:20:34.528651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769035+0000","last_change":"2023-07-21T22:19:45.794149+0000","last_active":"2023-07-21T22:19:46.769035+0000","last_peered":"2023-07-21T22:19:46.769035+0000","last_clean":"2023-07-21T22:19:46.769035+0000","last_became_active":"2023-07-21T22:19:45.793894+0000","last_became_peered":"2023-07-21T22:19:45.793894+0000","last_unstale":"2023-07-21T22:19:46.769035+0000","last_undegraded":"2023-07-21T22:19:46.769035+0000","last_fullsized":"2023-07-21T22:19:46.769035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:05:05.775653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769335+0000","last_change":"2023-07-21T22:19:45.790649+0000","last_active":"2023-07-21T22:19:46.769335+0000","last_peered":"2023-07-21T22:19:46.769335+0000","last_clean":"2023-07-21T22:19:46.769335+0000","last_became_active":"2023-07-21T22:19:45.790320+0000","last_became_peered":"2023-07-21T22:19:45.790320+0000","last_unstale":"2023-07-21T22:19:46.769335+0000","last_undegraded":"2023-07-21T22:19:46.769335+0000","last_fullsized":"2023-07-21T22:19:46.769335+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:59:09.560857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404638+0000","last_change":"2023-07-21T22:19:45.776166+0000","last_active":"2023-07-21T22:19:47.404638+0000","last_peered":"2023-07-21T22:19:47.404638+0000","last_clean":"2023-07-21T22:19:47.404638+0000","last_became_active":"2023-07-21T22:19:45.775811+0000","last_became_peered":"2023-07-21T22:19:45.775811+0000","last_unstale":"2023-07-21T22:19:47.404638+0000","last_undegraded":"2023-07-21T22:19:47.404638+0000","last_fullsized":"2023-07-21T22:19:47.404638+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:23:37.451740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769250+0000","last_change":"2023-07-21T22:19:45.780194+0000","last_active":"2023-07-21T22:19:46.769250+0000","last_peered":"2023-07-21T22:19:46.769250+0000","last_clean":"2023-07-21T22:19:46.769250+0000","last_became_active":"2023-07-21T22:19:45.779848+0000","last_became_peered":"2023-07-21T22:19:45.779848+0000","last_unstale":"2023-07-21T22:19:46.769250+0000","last_undegraded":"2023-07-21T22:19:46.769250+0000","last_fullsized":"2023-07-21T22:19:46.769250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:22:02.565752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.770339+0000","last_change":"2023-07-21T22:19:44.789473+0000","last_active":"2023-07-21T22:19:46.770339+0000","last_peered":"2023-07-21T22:19:46.770339+0000","last_clean":"2023-07-21T22:19:46.770339+0000","last_became_active":"2023-07-21T22:19:44.789250+0000","last_became_peered":"2023-07-21T22:19:44.789250+0000","last_unstale":"2023-07-21T22:19:46.770339+0000","last_undegraded":"2023-07-21T22:19:46.770339+0000","last_fullsized":"2023-07-21T22:19:46.770339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:55:01.556144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405143+0000","last_change":"2023-07-21T22:19:45.799593+0000","last_active":"2023-07-21T22:19:47.405143+0000","last_peered":"2023-07-21T22:19:47.405143+0000","last_clean":"2023-07-21T22:19:47.405143+0000","last_became_active":"2023-07-21T22:19:45.799217+0000","last_became_peered":"2023-07-21T22:19:45.799217+0000","last_unstale":"2023-07-21T22:19:47.405143+0000","last_undegraded":"2023-07-21T22:19:47.405143+0000","last_fullsized":"2023-07-21T22:19:47.405143+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:27:45.451327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404020+0000","last_change":"2023-07-21T22:19:44.784165+0000","last_active":"2023-07-21T22:19:47.404020+0000","last_peered":"2023-07-21T22:19:47.404020+0000","last_clean":"2023-07-21T22:19:47.404020+0000","last_became_active":"2023-07-21T22:19:44.783159+0000","last_became_peered":"2023-07-21T22:19:44.783159+0000","last_unstale":"2023-07-21T22:19:47.404020+0000","last_undegraded":"2023-07-21T22:19:47.404020+0000","last_fullsized":"2023-07-21T22:19:47.404020+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:48:12.861175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.406090+0000","last_change":"2023-07-21T22:19:45.793287+0000","last_active":"2023-07-21T22:19:47.406090+0000","last_peered":"2023-07-21T22:19:47.406090+0000","last_clean":"2023-07-21T22:19:47.406090+0000","last_became_active":"2023-07-21T22:19:45.789007+0000","last_became_peered":"2023-07-21T22:19:45.789007+0000","last_unstale":"2023-07-21T22:19:47.406090+0000","last_undegraded":"2023-07-21T22:19:47.406090+0000","last_fullsized":"2023-07-21T22:19:47.406090+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:24.695017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405438+0000","last_change":"2023-07-21T22:19:44.777629+0000","last_active":"2023-07-21T22:19:47.405438+0000","last_peered":"2023-07-21T22:19:47.405438+0000","last_clean":"2023-07-21T22:19:47.405438+0000","last_became_active":"2023-07-21T22:19:44.777335+0000","last_became_peered":"2023-07-21T22:19:44.777335+0000","last_unstale":"2023-07-21T22:19:47.405438+0000","last_undegraded":"2023-07-21T22:19:47.405438+0000","last_fullsized":"2023-07-21T22:19:47.405438+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:52:21.861655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404978+0000","last_change":"2023-07-21T22:19:45.787480+0000","last_active":"2023-07-21T22:19:47.404978+0000","last_peered":"2023-07-21T22:19:47.404978+0000","last_clean":"2023-07-21T22:19:47.404978+0000","last_became_active":"2023-07-21T22:19:45.786995+0000","last_became_peered":"2023-07-21T22:19:45.786995+0000","last_unstale":"2023-07-21T22:19:47.404978+0000","last_undegraded":"2023-07-21T22:19:47.404978+0000","last_fullsized":"2023-07-21T22:19:47.404978+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:52:22.870348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405905+0000","last_change":"2023-07-21T22:19:44.780467+0000","last_active":"2023-07-21T22:19:47.405905+0000","last_peered":"2023-07-21T22:19:47.405905+0000","last_clean":"2023-07-21T22:19:47.405905+0000","last_became_active":"2023-07-21T22:19:44.780154+0000","last_became_peered":"2023-07-21T22:19:44.780154+0000","last_unstale":"2023-07-21T22:19:47.405905+0000","last_undegraded":"2023-07-21T22:19:47.405905+0000","last_fullsized":"2023-07-21T22:19:47.405905+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:20:16.300079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404352+0000","last_change":"2023-07-21T22:19:45.797613+0000","last_active":"2023-07-21T22:19:47.404352+0000","last_peered":"2023-07-21T22:19:47.404352+0000","last_clean":"2023-07-21T22:19:47.404352+0000","last_became_active":"2023-07-21T22:19:45.797372+0000","last_became_peered":"2023-07-21T22:19:45.797372+0000","last_unstale":"2023-07-21T22:19:47.404352+0000","last_undegraded":"2023-07-21T22:19:47.404352+0000","last_fullsized":"2023-07-21T22:19:47.404352+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:23:37.451740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905224+0000","last_change":"2023-07-21T22:19:44.787151+0000","last_active":"2023-07-21T22:19:46.905224+0000","last_peered":"2023-07-21T22:19:46.905224+0000","last_clean":"2023-07-21T22:19:46.905224+0000","last_became_active":"2023-07-21T22:19:44.786795+0000","last_became_peered":"2023-07-21T22:19:44.786795+0000","last_unstale":"2023-07-21T22:19:46.905224+0000","last_undegraded":"2023-07-21T22:19:46.905224+0000","last_fullsized":"2023-07-21T22:19:46.905224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:23.686324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905370+0000","last_change":"2023-07-21T22:19:45.780801+0000","last_active":"2023-07-21T22:19:46.905370+0000","last_peered":"2023-07-21T22:19:46.905370+0000","last_clean":"2023-07-21T22:19:46.905370+0000","last_became_active":"2023-07-21T22:19:45.780490+0000","last_became_peered":"2023-07-21T22:19:45.780490+0000","last_unstale":"2023-07-21T22:19:46.905370+0000","last_undegraded":"2023-07-21T22:19:46.905370+0000","last_fullsized":"2023-07-21T22:19:46.905370+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:53:07.234756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769311+0000","last_change":"2023-07-21T22:19:44.778629+0000","last_active":"2023-07-21T22:19:46.769311+0000","last_peered":"2023-07-21T22:19:46.769311+0000","last_clean":"2023-07-21T22:19:46.769311+0000","last_became_active":"2023-07-21T22:19:44.778106+0000","last_became_peered":"2023-07-21T22:19:44.778106+0000","last_unstale":"2023-07-21T22:19:46.769311+0000","last_undegraded":"2023-07-21T22:19:46.769311+0000","last_fullsized":"2023-07-21T22:19:46.769311+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:53:06.226063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405819+0000","last_change":"2023-07-21T22:19:45.804605+0000","last_active":"2023-07-21T22:19:47.405819+0000","last_peered":"2023-07-21T22:19:47.405819+0000","last_clean":"2023-07-21T22:19:47.405819+0000","last_became_active":"2023-07-21T22:19:45.804414+0000","last_became_peered":"2023-07-21T22:19:45.804414+0000","last_unstale":"2023-07-21T22:19:47.405819+0000","last_undegraded":"2023-07-21T22:19:47.405819+0000","last_fullsized":"2023-07-21T22:19:47.405819+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:25:14.660757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404912+0000","last_change":"2023-07-21T22:19:44.780493+0000","last_active":"2023-07-21T22:19:47.404912+0000","last_peered":"2023-07-21T22:19:47.404912+0000","last_clean":"2023-07-21T22:19:47.404912+0000","last_became_active":"2023-07-21T22:19:44.780040+0000","last_became_peered":"2023-07-21T22:19:44.780040+0000","last_unstale":"2023-07-21T22:19:47.404912+0000","last_undegraded":"2023-07-21T22:19:47.404912+0000","last_fullsized":"2023-07-21T22:19:47.404912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:06:52.712913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404201+0000","last_change":"2023-07-21T22:19:45.788316+0000","last_active":"2023-07-21T22:19:47.404201+0000","last_peered":"2023-07-21T22:19:47.404201+0000","last_clean":"2023-07-21T22:19:47.404201+0000","last_became_active":"2023-07-21T22:19:45.787871+0000","last_became_peered":"2023-07-21T22:19:45.787871+0000","last_unstale":"2023-07-21T22:19:47.404201+0000","last_undegraded":"2023-07-21T22:19:47.404201+0000","last_fullsized":"2023-07-21T22:19:47.404201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:43:36.408275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405538+0000","last_change":"2023-07-21T22:19:44.779555+0000","last_active":"2023-07-21T22:19:47.405538+0000","last_peered":"2023-07-21T22:19:47.405538+0000","last_clean":"2023-07-21T22:19:47.405538+0000","last_became_active":"2023-07-21T22:19:44.779239+0000","last_became_peered":"2023-07-21T22:19:44.779239+0000","last_unstale":"2023-07-21T22:19:47.405538+0000","last_undegraded":"2023-07-21T22:19:47.405538+0000","last_fullsized":"2023-07-21T22:19:47.405538+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:22:01.557059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765451+0000","last_change":"2023-07-21T22:19:45.795174+0000","last_active":"2023-07-21T22:19:46.765451+0000","last_peered":"2023-07-21T22:19:46.765451+0000","last_clean":"2023-07-21T22:19:46.765451+0000","last_became_active":"2023-07-21T22:19:45.794873+0000","last_became_peered":"2023-07-21T22:19:45.794873+0000","last_unstale":"2023-07-21T22:19:46.765451+0000","last_undegraded":"2023-07-21T22:19:46.765451+0000","last_fullsized":"2023-07-21T22:19:46.765451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:20:21.256367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405145+0000","last_change":"2023-07-21T22:19:44.785204+0000","last_active":"2023-07-21T22:19:47.405145+0000","last_peered":"2023-07-21T22:19:47.405145+0000","last_clean":"2023-07-21T22:19:47.405145+0000","last_became_active":"2023-07-21T22:19:44.784909+0000","last_became_peered":"2023-07-21T22:19:44.784909+0000","last_unstale":"2023-07-21T22:19:47.405145+0000","last_undegraded":"2023-07-21T22:19:47.405145+0000","last_fullsized":"2023-07-21T22:19:47.405145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:14:15.154900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.770119+0000","last_change":"2023-07-21T22:19:45.785312+0000","last_active":"2023-07-21T22:19:46.770119+0000","last_peered":"2023-07-21T22:19:46.770119+0000","last_clean":"2023-07-21T22:19:46.770119+0000","last_became_active":"2023-07-21T22:19:45.784786+0000","last_became_peered":"2023-07-21T22:19:45.784786+0000","last_unstale":"2023-07-21T22:19:46.770119+0000","last_undegraded":"2023-07-21T22:19:46.770119+0000","last_fullsized":"2023-07-21T22:19:46.770119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:12.058382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905851+0000","last_change":"2023-07-21T22:19:44.790427+0000","last_active":"2023-07-21T22:19:46.905851+0000","last_peered":"2023-07-21T22:19:46.905851+0000","last_clean":"2023-07-21T22:19:46.905851+0000","last_became_active":"2023-07-21T22:19:44.790178+0000","last_became_peered":"2023-07-21T22:19:44.790178+0000","last_unstale":"2023-07-21T22:19:46.905851+0000","last_undegraded":"2023-07-21T22:19:46.905851+0000","last_fullsized":"2023-07-21T22:19:46.905851+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:09:33.956964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.403869+0000","last_change":"2023-07-21T22:19:45.804899+0000","last_active":"2023-07-21T22:19:47.403869+0000","last_peered":"2023-07-21T22:19:47.403869+0000","last_clean":"2023-07-21T22:19:47.403869+0000","last_became_active":"2023-07-21T22:19:45.804575+0000","last_became_peered":"2023-07-21T22:19:45.804575+0000","last_unstale":"2023-07-21T22:19:47.403869+0000","last_undegraded":"2023-07-21T22:19:47.403869+0000","last_fullsized":"2023-07-21T22:19:47.403869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:44:04.377673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905727+0000","last_change":"2023-07-21T22:19:44.784266+0000","last_active":"2023-07-21T22:19:46.905727+0000","last_peered":"2023-07-21T22:19:46.905727+0000","last_clean":"2023-07-21T22:19:46.905727+0000","last_became_active":"2023-07-21T22:19:44.783964+0000","last_became_peered":"2023-07-21T22:19:44.783964+0000","last_unstale":"2023-07-21T22:19:46.905727+0000","last_undegraded":"2023-07-21T22:19:46.905727+0000","last_fullsized":"2023-07-21T22:19:46.905727+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:47:30.515460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.406118+0000","last_change":"2023-07-21T22:19:45.797537+0000","last_active":"2023-07-21T22:19:47.406118+0000","last_peered":"2023-07-21T22:19:47.406118+0000","last_clean":"2023-07-21T22:19:47.406118+0000","last_became_active":"2023-07-21T22:19:45.797227+0000","last_became_peered":"2023-07-21T22:19:45.797227+0000","last_unstale":"2023-07-21T22:19:47.406118+0000","last_undegraded":"2023-07-21T22:19:47.406118+0000","last_fullsized":"2023-07-21T22:19:47.406118+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:00:34.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404323+0000","last_change":"2023-07-21T22:19:44.777147+0000","last_active":"2023-07-21T22:19:47.404323+0000","last_peered":"2023-07-21T22:19:47.404323+0000","last_clean":"2023-07-21T22:19:47.404323+0000","last_became_active":"2023-07-21T22:19:44.776832+0000","last_became_peered":"2023-07-21T22:19:44.776832+0000","last_unstale":"2023-07-21T22:19:47.404323+0000","last_undegraded":"2023-07-21T22:19:47.404323+0000","last_fullsized":"2023-07-21T22:19:47.404323+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:23:36.443048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.403625+0000","last_change":"2023-07-21T22:19:45.802382+0000","last_active":"2023-07-21T22:19:47.403625+0000","last_peered":"2023-07-21T22:19:47.403625+0000","last_clean":"2023-07-21T22:19:47.403625+0000","last_became_active":"2023-07-21T22:19:45.802123+0000","last_became_peered":"2023-07-21T22:19:45.802123+0000","last_unstale":"2023-07-21T22:19:47.403625+0000","last_undegraded":"2023-07-21T22:19:47.403625+0000","last_fullsized":"2023-07-21T22:19:47.403625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:05:17.544063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404610+0000","last_change":"2023-07-21T22:19:44.785472+0000","last_active":"2023-07-21T22:19:47.404610+0000","last_peered":"2023-07-21T22:19:47.404610+0000","last_clean":"2023-07-21T22:19:47.404610+0000","last_became_active":"2023-07-21T22:19:44.785213+0000","last_became_peered":"2023-07-21T22:19:44.785213+0000","last_unstale":"2023-07-21T22:19:47.404610+0000","last_undegraded":"2023-07-21T22:19:47.404610+0000","last_fullsized":"2023-07-21T22:19:47.404610+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:07:57.052451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404615+0000","last_change":"2023-07-21T22:19:45.800204+0000","last_active":"2023-07-21T22:19:47.404615+0000","last_peered":"2023-07-21T22:19:47.404615+0000","last_clean":"2023-07-21T22:19:47.404615+0000","last_became_active":"2023-07-21T22:19:45.799367+0000","last_became_peered":"2023-07-21T22:19:45.799367+0000","last_unstale":"2023-07-21T22:19:47.404615+0000","last_undegraded":"2023-07-21T22:19:47.404615+0000","last_fullsized":"2023-07-21T22:19:47.404615+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:27:45.451327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405188+0000","last_change":"2023-07-21T22:19:44.783624+0000","last_active":"2023-07-21T22:19:47.405188+0000","last_peered":"2023-07-21T22:19:47.405188+0000","last_clean":"2023-07-21T22:19:47.405188+0000","last_became_active":"2023-07-21T22:19:44.783333+0000","last_became_peered":"2023-07-21T22:19:44.783333+0000","last_unstale":"2023-07-21T22:19:47.405188+0000","last_undegraded":"2023-07-21T22:19:47.405188+0000","last_fullsized":"2023-07-21T22:19:47.405188+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:07:57.052451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769158+0000","last_change":"2023-07-21T22:19:45.782411+0000","last_active":"2023-07-21T22:19:46.769158+0000","last_peered":"2023-07-21T22:19:46.769158+0000","last_clean":"2023-07-21T22:19:46.769158+0000","last_became_active":"2023-07-21T22:19:45.782074+0000","last_became_peered":"2023-07-21T22:19:45.782074+0000","last_unstale":"2023-07-21T22:19:46.769158+0000","last_undegraded":"2023-07-21T22:19:46.769158+0000","last_fullsized":"2023-07-21T22:19:46.769158+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:26.174778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.768897+0000","last_change":"2023-07-21T22:19:44.782697+0000","last_active":"2023-07-21T22:19:46.768897+0000","last_peered":"2023-07-21T22:19:46.768897+0000","last_clean":"2023-07-21T22:19:46.768897+0000","last_became_active":"2023-07-21T22:19:44.782411+0000","last_became_peered":"2023-07-21T22:19:44.782411+0000","last_unstale":"2023-07-21T22:19:46.768897+0000","last_undegraded":"2023-07-21T22:19:46.768897+0000","last_fullsized":"2023-07-21T22:19:46.768897+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:58:30.574555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404339+0000","last_change":"2023-07-21T22:19:45.792883+0000","last_active":"2023-07-21T22:19:47.404339+0000","last_peered":"2023-07-21T22:19:47.404339+0000","last_clean":"2023-07-21T22:19:47.404339+0000","last_became_active":"2023-07-21T22:19:45.792588+0000","last_became_peered":"2023-07-21T22:19:45.792588+0000","last_unstale":"2023-07-21T22:19:47.404339+0000","last_undegraded":"2023-07-21T22:19:47.404339+0000","last_fullsized":"2023-07-21T22:19:47.404339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:40:24.707300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.768770+0000","last_change":"2023-07-21T22:19:44.778323+0000","last_active":"2023-07-21T22:19:46.768770+0000","last_peered":"2023-07-21T22:19:46.768770+0000","last_clean":"2023-07-21T22:19:46.768770+0000","last_became_active":"2023-07-21T22:19:44.778005+0000","last_became_peered":"2023-07-21T22:19:44.778005+0000","last_unstale":"2023-07-21T22:19:46.768770+0000","last_undegraded":"2023-07-21T22:19:46.768770+0000","last_fullsized":"2023-07-21T22:19:46.768770+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:17:34.163002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404110+0000","last_change":"2023-07-21T22:19:45.787973+0000","last_active":"2023-07-21T22:19:47.404110+0000","last_peered":"2023-07-21T22:19:47.404110+0000","last_clean":"2023-07-21T22:19:47.404110+0000","last_became_active":"2023-07-21T22:19:45.787684+0000","last_became_peered":"2023-07-21T22:19:45.787684+0000","last_unstale":"2023-07-21T22:19:47.404110+0000","last_undegraded":"2023-07-21T22:19:47.404110+0000","last_fullsized":"2023-07-21T22:19:47.404110+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:05:06.892121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905829+0000","last_change":"2023-07-21T22:19:44.789449+0000","last_active":"2023-07-21T22:19:46.905829+0000","last_peered":"2023-07-21T22:19:46.905829+0000","last_clean":"2023-07-21T22:19:46.905829+0000","last_became_active":"2023-07-21T22:19:44.789151+0000","last_became_peered":"2023-07-21T22:19:44.789151+0000","last_unstale":"2023-07-21T22:19:46.905829+0000","last_undegraded":"2023-07-21T22:19:46.905829+0000","last_fullsized":"2023-07-21T22:19:46.905829+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:12:44.382288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905732+0000","last_change":"2023-07-21T22:19:45.791328+0000","last_active":"2023-07-21T22:19:46.905732+0000","last_peered":"2023-07-21T22:19:46.905732+0000","last_clean":"2023-07-21T22:19:46.905732+0000","last_became_active":"2023-07-21T22:19:45.791020+0000","last_became_peered":"2023-07-21T22:19:45.791020+0000","last_unstale":"2023-07-21T22:19:46.905732+0000","last_undegraded":"2023-07-21T22:19:46.905732+0000","last_fullsized":"2023-07-21T22:19:46.905732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:12.058382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.406193+0000","last_change":"2023-07-21T22:19:44.785599+0000","last_active":"2023-07-21T22:19:47.406193+0000","last_peered":"2023-07-21T22:19:47.406193+0000","last_clean":"2023-07-21T22:19:47.406193+0000","last_became_active":"2023-07-21T22:19:44.785328+0000","last_became_peered":"2023-07-21T22:19:44.785328+0000","last_unstale":"2023-07-21T22:19:47.406193+0000","last_undegraded":"2023-07-21T22:19:47.406193+0000","last_fullsized":"2023-07-21T22:19:47.406193+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:11.049689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.406058+0000","last_change":"2023-07-21T22:19:45.793835+0000","last_active":"2023-07-21T22:19:47.406058+0000","last_peered":"2023-07-21T22:19:47.406058+0000","last_clean":"2023-07-21T22:19:47.406058+0000","last_became_active":"2023-07-21T22:19:45.789295+0000","last_became_peered":"2023-07-21T22:19:45.789295+0000","last_unstale":"2023-07-21T22:19:47.406058+0000","last_undegraded":"2023-07-21T22:19:47.406058+0000","last_fullsized":"2023-07-21T22:19:47.406058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:09:27.126678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765728+0000","last_change":"2023-07-21T22:19:44.774139+0000","last_active":"2023-07-21T22:19:46.765728+0000","last_peered":"2023-07-21T22:19:46.765728+0000","last_clean":"2023-07-21T22:19:46.765728+0000","last_became_active":"2023-07-21T22:19:44.773835+0000","last_became_peered":"2023-07-21T22:19:44.773835+0000","last_unstale":"2023-07-21T22:19:46.765728+0000","last_undegraded":"2023-07-21T22:19:46.765728+0000","last_fullsized":"2023-07-21T22:19:46.765728+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:16:57.907636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765543+0000","last_change":"2023-07-21T22:19:45.788614+0000","last_active":"2023-07-21T22:19:46.765543+0000","last_peered":"2023-07-21T22:19:46.765543+0000","last_clean":"2023-07-21T22:19:46.765543+0000","last_became_active":"2023-07-21T22:19:45.788317+0000","last_became_peered":"2023-07-21T22:19:45.788317+0000","last_unstale":"2023-07-21T22:19:46.765543+0000","last_undegraded":"2023-07-21T22:19:46.765543+0000","last_fullsized":"2023-07-21T22:19:46.765543+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:40:04.954470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405292+0000","last_change":"2023-07-21T22:19:44.777586+0000","last_active":"2023-07-21T22:19:47.405292+0000","last_peered":"2023-07-21T22:19:47.405292+0000","last_clean":"2023-07-21T22:19:47.405292+0000","last_became_active":"2023-07-21T22:19:44.777266+0000","last_became_peered":"2023-07-21T22:19:44.777266+0000","last_unstale":"2023-07-21T22:19:47.405292+0000","last_undegraded":"2023-07-21T22:19:47.405292+0000","last_fullsized":"2023-07-21T22:19:47.405292+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:53:54.424873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769053+0000","last_change":"2023-07-21T22:19:45.787417+0000","last_active":"2023-07-21T22:19:46.769053+0000","last_peered":"2023-07-21T22:19:46.769053+0000","last_clean":"2023-07-21T22:19:46.769053+0000","last_became_active":"2023-07-21T22:19:45.787137+0000","last_became_peered":"2023-07-21T22:19:45.787137+0000","last_unstale":"2023-07-21T22:19:46.769053+0000","last_undegraded":"2023-07-21T22:19:46.769053+0000","last_fullsized":"2023-07-21T22:19:46.769053+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:03.794833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765467+0000","last_change":"2023-07-21T22:19:44.777277+0000","last_active":"2023-07-21T22:19:46.765467+0000","last_peered":"2023-07-21T22:19:46.765467+0000","last_clean":"2023-07-21T22:19:46.765467+0000","last_became_active":"2023-07-21T22:19:44.776977+0000","last_became_peered":"2023-07-21T22:19:44.776977+0000","last_unstale":"2023-07-21T22:19:46.765467+0000","last_undegraded":"2023-07-21T22:19:46.765467+0000","last_fullsized":"2023-07-21T22:19:46.765467+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:17:32.389832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.403834+0000","last_change":"2023-07-21T22:19:45.805182+0000","last_active":"2023-07-21T22:19:47.403834+0000","last_peered":"2023-07-21T22:19:47.403834+0000","last_clean":"2023-07-21T22:19:47.403834+0000","last_became_active":"2023-07-21T22:19:45.804788+0000","last_became_peered":"2023-07-21T22:19:45.804788+0000","last_unstale":"2023-07-21T22:19:47.403834+0000","last_undegraded":"2023-07-21T22:19:47.403834+0000","last_fullsized":"2023-07-21T22:19:47.403834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:41.214494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765271+0000","last_change":"2023-07-21T22:19:44.771175+0000","last_active":"2023-07-21T22:19:46.765271+0000","last_peered":"2023-07-21T22:19:46.765271+0000","last_clean":"2023-07-21T22:19:46.765271+0000","last_became_active":"2023-07-21T22:19:44.770768+0000","last_became_peered":"2023-07-21T22:19:44.770768+0000","last_unstale":"2023-07-21T22:19:46.765271+0000","last_undegraded":"2023-07-21T22:19:46.765271+0000","last_fullsized":"2023-07-21T22:19:46.765271+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:33:40.046607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905181+0000","last_change":"2023-07-21T22:19:45.778242+0000","last_active":"2023-07-21T22:19:46.905181+0000","last_peered":"2023-07-21T22:19:46.905181+0000","last_clean":"2023-07-21T22:19:46.905181+0000","last_became_active":"2023-07-21T22:19:45.777853+0000","last_became_peered":"2023-07-21T22:19:45.777853+0000","last_unstale":"2023-07-21T22:19:46.905181+0000","last_undegraded":"2023-07-21T22:19:46.905181+0000","last_fullsized":"2023-07-21T22:19:46.905181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:15:40.353165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769506+0000","last_change":"2023-07-21T22:19:44.782353+0000","last_active":"2023-07-21T22:19:46.769506+0000","last_peered":"2023-07-21T22:19:46.769506+0000","last_clean":"2023-07-21T22:19:46.769506+0000","last_became_active":"2023-07-21T22:19:44.782034+0000","last_became_peered":"2023-07-21T22:19:44.782034+0000","last_unstale":"2023-07-21T22:19:46.769506+0000","last_undegraded":"2023-07-21T22:19:46.769506+0000","last_fullsized":"2023-07-21T22:19:46.769506+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:20:16.300079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404473+0000","last_change":"2023-07-21T22:19:45.788130+0000","last_active":"2023-07-21T22:19:47.404473+0000","last_peered":"2023-07-21T22:19:47.404473+0000","last_clean":"2023-07-21T22:19:47.404473+0000","last_became_active":"2023-07-21T22:19:45.787524+0000","last_became_peered":"2023-07-21T22:19:45.787524+0000","last_unstale":"2023-07-21T22:19:47.404473+0000","last_undegraded":"2023-07-21T22:19:47.404473+0000","last_fullsized":"2023-07-21T22:19:47.404473+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:06:53.721606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765291+0000","last_change":"2023-07-21T22:19:44.777212+0000","last_active":"2023-07-21T22:19:46.765291+0000","last_peered":"2023-07-21T22:19:46.765291+0000","last_clean":"2023-07-21T22:19:46.765291+0000","last_became_active":"2023-07-21T22:19:44.776901+0000","last_became_peered":"2023-07-21T22:19:44.776901+0000","last_unstale":"2023-07-21T22:19:46.765291+0000","last_undegraded":"2023-07-21T22:19:46.765291+0000","last_fullsized":"2023-07-21T22:19:46.765291+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:45:10.993193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905696+0000","last_change":"2023-07-21T22:19:45.790032+0000","last_active":"2023-07-21T22:19:46.905696+0000","last_peered":"2023-07-21T22:19:46.905696+0000","last_clean":"2023-07-21T22:19:46.905696+0000","last_became_active":"2023-07-21T22:19:45.789745+0000","last_became_peered":"2023-07-21T22:19:45.789745+0000","last_unstale":"2023-07-21T22:19:46.905696+0000","last_undegraded":"2023-07-21T22:19:46.905696+0000","last_fullsized":"2023-07-21T22:19:46.905696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:00:34.472448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769465+0000","last_change":"2023-07-21T22:19:44.781768+0000","last_active":"2023-07-21T22:19:46.769465+0000","last_peered":"2023-07-21T22:19:46.769465+0000","last_clean":"2023-07-21T22:19:46.769465+0000","last_became_active":"2023-07-21T22:19:44.781490+0000","last_became_peered":"2023-07-21T22:19:44.781490+0000","last_unstale":"2023-07-21T22:19:46.769465+0000","last_undegraded":"2023-07-21T22:19:46.769465+0000","last_fullsized":"2023-07-21T22:19:46.769465+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:25:13.652064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":195,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769178+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:19:46.769178+0000","last_peered":"2023-07-21T22:19:46.769178+0000","last_clean":"2023-07-21T22:19:46.769178+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:19:46.769178+0000","last_undegraded":"2023-07-21T22:19:46.769178+0000","last_fullsized":"2023-07-21T22:19:46.769178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:14:26.705962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905748+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:19:46.905748+0000","last_peered":"2023-07-21T22:19:46.905748+0000","last_clean":"2023-07-21T22:19:46.905748+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:19:46.905748+0000","last_undegraded":"2023-07-21T22:19:46.905748+0000","last_fullsized":"2023-07-21T22:19:46.905748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:48:53.404894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405283+0000","last_change":"2023-07-21T22:19:45.800188+0000","last_active":"2023-07-21T22:19:47.405283+0000","last_peered":"2023-07-21T22:19:47.405283+0000","last_clean":"2023-07-21T22:19:47.405283+0000","last_became_active":"2023-07-21T22:19:45.799846+0000","last_became_peered":"2023-07-21T22:19:45.799846+0000","last_unstale":"2023-07-21T22:19:47.405283+0000","last_undegraded":"2023-07-21T22:19:47.405283+0000","last_fullsized":"2023-07-21T22:19:47.405283+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:28:50.889694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905912+0000","last_change":"2023-07-21T22:19:44.783741+0000","last_active":"2023-07-21T22:19:46.905912+0000","last_peered":"2023-07-21T22:19:46.905912+0000","last_clean":"2023-07-21T22:19:46.905912+0000","last_became_active":"2023-07-21T22:19:44.783453+0000","last_became_peered":"2023-07-21T22:19:44.783453+0000","last_unstale":"2023-07-21T22:19:46.905912+0000","last_undegraded":"2023-07-21T22:19:46.905912+0000","last_fullsized":"2023-07-21T22:19:46.905912+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:20:44.879746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769016+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:19:46.769016+0000","last_peered":"2023-07-21T22:19:46.769016+0000","last_clean":"2023-07-21T22:19:46.769016+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:19:46.769016+0000","last_undegraded":"2023-07-21T22:19:46.769016+0000","last_fullsized":"2023-07-21T22:19:46.769016+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:18:08.664515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769518+0000","last_change":"2023-07-21T22:19:45.791539+0000","last_active":"2023-07-21T22:19:46.769518+0000","last_peered":"2023-07-21T22:19:46.769518+0000","last_clean":"2023-07-21T22:19:46.769518+0000","last_became_active":"2023-07-21T22:19:45.787028+0000","last_became_peered":"2023-07-21T22:19:45.787028+0000","last_unstale":"2023-07-21T22:19:46.769518+0000","last_undegraded":"2023-07-21T22:19:46.769518+0000","last_fullsized":"2023-07-21T22:19:46.769518+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:02:43.243631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765763+0000","last_change":"2023-07-21T22:19:44.781409+0000","last_active":"2023-07-21T22:19:46.765763+0000","last_peered":"2023-07-21T22:19:46.765763+0000","last_clean":"2023-07-21T22:19:46.765763+0000","last_became_active":"2023-07-21T22:19:44.781102+0000","last_became_peered":"2023-07-21T22:19:44.781102+0000","last_unstale":"2023-07-21T22:19:46.765763+0000","last_undegraded":"2023-07-21T22:19:46.765763+0000","last_fullsized":"2023-07-21T22:19:46.765763+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:11:58.167178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.765160+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:19:46.765160+0000","last_peered":"2023-07-21T22:19:46.765160+0000","last_clean":"2023-07-21T22:19:46.765160+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:19:46.765160+0000","last_undegraded":"2023-07-21T22:19:46.765160+0000","last_fullsized":"2023-07-21T22:19:46.765160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:37:03.690965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404780+0000","last_change":"2023-07-21T22:19:45.792921+0000","last_active":"2023-07-21T22:19:47.404780+0000","last_peered":"2023-07-21T22:19:47.404780+0000","last_clean":"2023-07-21T22:19:47.404780+0000","last_became_active":"2023-07-21T22:19:45.792564+0000","last_became_peered":"2023-07-21T22:19:45.792564+0000","last_unstale":"2023-07-21T22:19:47.404780+0000","last_undegraded":"2023-07-21T22:19:47.404780+0000","last_fullsized":"2023-07-21T22:19:47.404780+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:05:50.571384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404191+0000","last_change":"2023-07-21T22:19:44.782520+0000","last_active":"2023-07-21T22:19:47.404191+0000","last_peered":"2023-07-21T22:19:47.404191+0000","last_clean":"2023-07-21T22:19:47.404191+0000","last_became_active":"2023-07-21T22:19:44.782191+0000","last_became_peered":"2023-07-21T22:19:44.782191+0000","last_unstale":"2023-07-21T22:19:47.404191+0000","last_undegraded":"2023-07-21T22:19:47.404191+0000","last_fullsized":"2023-07-21T22:19:47.404191+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:58:16.854391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.905638+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:19:46.905638+0000","last_peered":"2023-07-21T22:19:46.905638+0000","last_clean":"2023-07-21T22:19:46.905638+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:19:46.905638+0000","last_undegraded":"2023-07-21T22:19:46.905638+0000","last_fullsized":"2023-07-21T22:19:46.905638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:08:19.633889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.403801+0000","last_change":"2023-07-21T22:19:45.799275+0000","last_active":"2023-07-21T22:19:47.403801+0000","last_peered":"2023-07-21T22:19:47.403801+0000","last_clean":"2023-07-21T22:19:47.403801+0000","last_became_active":"2023-07-21T22:19:45.798982+0000","last_became_peered":"2023-07-21T22:19:45.798982+0000","last_unstale":"2023-07-21T22:19:47.403801+0000","last_undegraded":"2023-07-21T22:19:47.403801+0000","last_fullsized":"2023-07-21T22:19:47.403801+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:24:08.073448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404207+0000","last_change":"2023-07-21T22:19:44.781398+0000","last_active":"2023-07-21T22:19:47.404207+0000","last_peered":"2023-07-21T22:19:47.404207+0000","last_clean":"2023-07-21T22:19:47.404207+0000","last_became_active":"2023-07-21T22:19:44.781004+0000","last_became_peered":"2023-07-21T22:19:44.781004+0000","last_unstale":"2023-07-21T22:19:47.404207+0000","last_undegraded":"2023-07-21T22:19:47.404207+0000","last_fullsized":"2023-07-21T22:19:47.404207+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:10:17.869764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405409+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:19:47.405409+0000","last_peered":"2023-07-21T22:19:47.405409+0000","last_clean":"2023-07-21T22:19:47.405409+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:19:47.405409+0000","last_undegraded":"2023-07-21T22:19:47.405409+0000","last_fullsized":"2023-07-21T22:19:47.405409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:04:43.078594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404890+0000","last_change":"2023-07-21T22:19:45.778736+0000","last_active":"2023-07-21T22:19:47.404890+0000","last_peered":"2023-07-21T22:19:47.404890+0000","last_clean":"2023-07-21T22:19:47.404890+0000","last_became_active":"2023-07-21T22:19:45.778432+0000","last_became_peered":"2023-07-21T22:19:45.778432+0000","last_unstale":"2023-07-21T22:19:47.404890+0000","last_undegraded":"2023-07-21T22:19:47.404890+0000","last_fullsized":"2023-07-21T22:19:47.404890+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:40:24.707300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769121+0000","last_change":"2023-07-21T22:19:44.782410+0000","last_active":"2023-07-21T22:19:46.769121+0000","last_peered":"2023-07-21T22:19:46.769121+0000","last_clean":"2023-07-21T22:19:46.769121+0000","last_became_active":"2023-07-21T22:19:44.782110+0000","last_became_peered":"2023-07-21T22:19:44.782110+0000","last_unstale":"2023-07-21T22:19:46.769121+0000","last_undegraded":"2023-07-21T22:19:46.769121+0000","last_fullsized":"2023-07-21T22:19:46.769121+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:16:16.396319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769729+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:19:46.769729+0000","last_peered":"2023-07-21T22:19:46.769729+0000","last_clean":"2023-07-21T22:19:46.769729+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:19:46.769729+0000","last_undegraded":"2023-07-21T22:19:46.769729+0000","last_fullsized":"2023-07-21T22:19:46.769729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:08:19.633889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405572+0000","last_change":"2023-07-21T22:19:45.795601+0000","last_active":"2023-07-21T22:19:47.405572+0000","last_peered":"2023-07-21T22:19:47.405572+0000","last_clean":"2023-07-21T22:19:47.405572+0000","last_became_active":"2023-07-21T22:19:45.795286+0000","last_became_peered":"2023-07-21T22:19:45.795286+0000","last_unstale":"2023-07-21T22:19:47.405572+0000","last_undegraded":"2023-07-21T22:19:47.405572+0000","last_fullsized":"2023-07-21T22:19:47.405572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:59:09.560857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405501+0000","last_change":"2023-07-21T22:19:44.779517+0000","last_active":"2023-07-21T22:19:47.405501+0000","last_peered":"2023-07-21T22:19:47.405501+0000","last_clean":"2023-07-21T22:19:47.405501+0000","last_became_active":"2023-07-21T22:19:44.779216+0000","last_became_peered":"2023-07-21T22:19:44.779216+0000","last_unstale":"2023-07-21T22:19:47.405501+0000","last_undegraded":"2023-07-21T22:19:47.405501+0000","last_fullsized":"2023-07-21T22:19:47.405501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:15:39.344472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.405461+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:19:47.405461+0000","last_peered":"2023-07-21T22:19:47.405461+0000","last_clean":"2023-07-21T22:19:47.405461+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:19:47.405461+0000","last_undegraded":"2023-07-21T22:19:47.405461+0000","last_fullsized":"2023-07-21T22:19:47.405461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:46:40.731439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.769742+0000","last_change":"2023-07-21T22:19:45.786411+0000","last_active":"2023-07-21T22:19:46.769742+0000","last_peered":"2023-07-21T22:19:46.769742+0000","last_clean":"2023-07-21T22:19:46.769742+0000","last_became_active":"2023-07-21T22:19:45.785976+0000","last_became_peered":"2023-07-21T22:19:45.785976+0000","last_unstale":"2023-07-21T22:19:46.769742+0000","last_undegraded":"2023-07-21T22:19:46.769742+0000","last_fullsized":"2023-07-21T22:19:46.769742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:44.749638+0000","last_clean_scrub_stamp":"2023-07-21T22:19:44.749638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:24.695017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:47.404652+0000","last_change":"2023-07-21T22:19:44.778837+0000","last_active":"2023-07-21T22:19:47.404652+0000","last_peered":"2023-07-21T22:19:47.404652+0000","last_clean":"2023-07-21T22:19:47.404652+0000","last_became_active":"2023-07-21T22:19:44.778207+0000","last_became_peered":"2023-07-21T22:19:44.778207+0000","last_unstale":"2023-07-21T22:19:47.404652+0000","last_undegraded":"2023-07-21T22:19:47.404652+0000","last_fullsized":"2023-07-21T22:19:47.404652+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:19:43.740945+0000","last_clean_scrub_stamp":"2023-07-21T22:19:43.740945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:53:54.424873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-21T22:19:46.770448+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:19:46.770448+0000","last_peered":"2023-07-21T22:19:46.770448+0000","last_clean":"2023-07-21T22:19:46.770448+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:19:46.770448+0000","last_undegraded":"2023-07-21T22:19:46.770448+0000","last_fullsized":"2023-07-21T22:19:46.770448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:41:54.570180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509459,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":1048576,"data_stored":772251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.42799999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.44900000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.65100000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.59799999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.38},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.53000000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.5},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.46500000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.63900000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":446464,"data_stored":180361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.85399999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.628},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.875}]},{"osd":2,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.69699999999999995}]},{"osd":3,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.745},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.78900000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.67300000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.71899999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.90200000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":446464,"data_stored":180853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61699999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.499}]},{"osd":2,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.443},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.66600000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.272,"5min":1.272,"15min":1.272},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:19:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.59399999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":181847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.498},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.47499999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.45100000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.51800000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.84699999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.81299999999999994}]},{"osd":6,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.90500000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":442368,"data_stored":180319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.52900000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.44900000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.433}]},{"osd":4,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.56200000000000006}]},{"osd":5,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.629}]},{"osd":6,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.59699999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:19:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.60999999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":442368,"data_stored":180339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":5.4800000000000004,"5min":5.4800000000000004,"15min":5.4800000000000004},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.71899999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":3.4220000000000002,"5min":3.4220000000000002,"15min":3.4220000000000002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.46800000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":3.2469999999999999,"5min":3.2469999999999999,"15min":3.2469999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":5.8710000000000004,"5min":5.8710000000000004,"15min":5.8710000000000004},"last":0.42899999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":3.6259999999999999,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.4100000000000001,"5min":4.4100000000000001,"15min":4.4100000000000001},"last":0.78900000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":5.766,"5min":5.766,"15min":5.766},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.669,"5min":3.669,"15min":3.669},"last":0.89500000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":5.8200000000000003,"5min":5.8200000000000003,"15min":5.8200000000000003},"last":0.80800000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:19:31 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.9269999999999996,"5min":5.9269999999999996,"15min":5.9269999999999996},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":3.5800000000000001,"5min":3.5800000000000001,"15min":3.5800000000000001},"last":0.93600000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":1036288,"data_stored":770651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.432}]},{"osd":3,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.499}]},{"osd":4,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.73999999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.71999999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":442368,"data_stored":180831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":2.3100000000000001,"5min":2.3100000000000001,"15min":2.3100000000000001},"last":0.57399999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":8.6280000000000001,"5min":8.6280000000000001,"15min":8.6280000000000001},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.622},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.59299999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.55800000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":3.1829999999999998,"5min":3.1829999999999998,"15min":3.1829999999999998},"last":0.438},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":2.887,"5min":2.887,"15min":2.887},"last":0.66900000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.39400000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:19:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":8.0760000000000005,"5min":8.0760000000000005,"15min":8.0760000000000005},"last":0.505}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:19:54.895 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T22:19:54.896 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-21T22:19:55.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20aa448640 1 Processor -- start 2023-07-21T22:19:55.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20aa448640 1 -- start start 2023-07-21T22:19:55.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20aa448640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f20a40c8940 0x7f20a40ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:55.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20aa448640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a40cd8e0 con 0x7f20a4158a40 2023-07-21T22:19:55.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20aa448640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a40c8e20 con 0x7f20a40cd4a0 2023-07-21T22:19:55.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20aa448640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a40711b0 con 0x7f20a40c8940 2023-07-21T22:19:55.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20a3fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f20a4158a40 0x7f20a40cb240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33902/0 (socket says 172.21.15.6:33902) 2023-07-21T22:19:55.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20a3fff640 1 -- 172.21.15.6:0/2144019742 learned_addr learned my addr 172.21.15.6:0/2144019742 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:55.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20a37fe640 1 --2- 172.21.15.6:0/2144019742 >> v2:172.21.15.161:3300/0 conn(0x7f20a40c8940 0x7f20a40ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:55.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20a2ffd640 1 -- 172.21.15.6:0/2144019742 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850446208 0 0) 0x7f20a40cd8e0 con 0x7f20a4158a40 2023-07-21T22:19:55.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20a2ffd640 1 -- 172.21.15.6:0/2144019742 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f208c003530 con 0x7f20a4158a40 2023-07-21T22:19:55.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20a2ffd640 1 -- 172.21.15.6:0/2144019742 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3189838044 0 0) 0x7f208c003530 con 0x7f20a4158a40 2023-07-21T22:19:55.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20a2ffd640 1 -- 172.21.15.6:0/2144019742 >> v2:172.21.15.161:3300/0 conn(0x7f20a40c8940 msgr2=0x7f20a40ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:55.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20a2ffd640 1 --2- 172.21.15.6:0/2144019742 >> v2:172.21.15.161:3300/0 conn(0x7f20a40c8940 0x7f20a40ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:55.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20a2ffd640 1 -- 172.21.15.6:0/2144019742 >> v1:172.21.15.161:6789/0 conn(0x7f20a40cd4a0 legacy=0x7f20a406fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:55.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20a2ffd640 1 -- 172.21.15.6:0/2144019742 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a40c9100 con 0x7f20a4158a40 2023-07-21T22:19:55.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20a2ffd640 1 -- 172.21.15.6:0/2144019742 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f2094001680 con 0x7f20a4158a40 2023-07-21T22:19:55.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20a2ffd640 1 -- 172.21.15.6:0/2144019742 >> v1:172.21.15.6:6789/0 conn(0x7f20a4158a40 legacy=0x7f20a40cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:55.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20a2ffd640 1 --2- 172.21.15.6:0/2144019742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f208c003980 0x7f208c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:55.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20a2ffd640 1 --2- 172.21.15.6:0/2144019742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f208c0047d0 0x7f208c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:55.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20a2ffd640 1 --2- 172.21.15.6:0/2144019742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208c005180 0x7f208c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:55.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20a2ffd640 1 -- 172.21.15.6:0/2144019742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a40711b0 con 0x7f208c005180 2023-07-21T22:19:55.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20a2ffd640 1 -- 172.21.15.6:0/2144019742 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208c00c090 con 0x7f208c003980 2023-07-21T22:19:55.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20a2ffd640 1 -- 172.21.15.6:0/2144019742 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208c00c250 con 0x7f208c0047d0 2023-07-21T22:19:55.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20a89e5640 1 --2- 172.21.15.6:0/2144019742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208c005180 0x7f208c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:55.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.031+0000 7f20a3fff640 1 --2- 172.21.15.6:0/2144019742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f208c003980 0x7f208c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:55.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.035+0000 7f20a37fe640 1 --2- 172.21.15.6:0/2144019742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f208c0047d0 0x7f208c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:55.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.035+0000 7f20a89e5640 1 -- 172.21.15.6:0/2144019742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f208c0047d0 msgr2=0x7f208c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:55.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.035+0000 7f20a89e5640 1 --2- 172.21.15.6:0/2144019742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f208c0047d0 0x7f208c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:55.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.035+0000 7f20a89e5640 1 -- 172.21.15.6:0/2144019742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f208c003980 msgr2=0x7f208c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:55.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.035+0000 7f20a89e5640 1 --2- 172.21.15.6:0/2144019742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f208c003980 0x7f208c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:55.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.035+0000 7f20a89e5640 1 -- 172.21.15.6:0/2144019742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208c003530 con 0x7f208c005180 2023-07-21T22:19:55.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.035+0000 7f20a37fe640 1 --2- 172.21.15.6:0/2144019742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f208c0047d0 0x7f208c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.035+0000 7f20a89e5640 1 -- 172.21.15.6:0/2144019742 reap_dead start 2023-07-21T22:19:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.035+0000 7f20a89e5640 1 --2- 172.21.15.6:0/2144019742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208c005180 0x7f208c00b990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f209c001e70 tx=0x7f209c01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c86402b71a73b2c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.035+0000 7f20a2ffd640 1 -- 172.21.15.6:0/2144019742 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c003b80 con 0x7f208c005180 2023-07-21T22:19:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.035+0000 7f20a2ffd640 1 -- 172.21.15.6:0/2144019742 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209c003d20 con 0x7f208c005180 2023-07-21T22:19:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.035+0000 7f20a2ffd640 1 -- 172.21.15.6:0/2144019742 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209c005310 con 0x7f208c005180 2023-07-21T22:19:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.035+0000 7f20aa448640 1 -- 172.21.15.6:0/2144019742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208c005180 msgr2=0x7f208c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.035+0000 7f20aa448640 1 --2- 172.21.15.6:0/2144019742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208c005180 0x7f208c00b990 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f209c001e70 tx=0x7f209c01c760 comp rx=0 tx=0).stop 2023-07-21T22:19:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.035+0000 7f20aa448640 1 -- 172.21.15.6:0/2144019742 shutdown_connections 2023-07-21T22:19:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.035+0000 7f20aa448640 1 --2- 172.21.15.6:0/2144019742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f208c005180 0x7f208c00b990 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.035+0000 7f20aa448640 1 -- 172.21.15.6:0/2144019742 >> 172.21.15.6:0/2144019742 conn(0x7f20a40afac0 msgr2=0x7f20a40afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20aa448640 1 -- 172.21.15.6:0/2144019742 shutdown_connections 2023-07-21T22:19:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20aa448640 1 -- 172.21.15.6:0/2144019742 wait complete. 2023-07-21T22:19:55.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20aa448640 1 Processor -- start 2023-07-21T22:19:55.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20aa448640 1 -- start start 2023-07-21T22:19:55.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20aa448640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f208c005180 0x7f20a4156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:55.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20aa448640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a414e870 0x7f20a40c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:55.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20aa448640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20a40c5cd0 0x7f20a40ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:55.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20aa448640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a40c5020 con 0x7f20a414e870 2023-07-21T22:19:55.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20aa448640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a4156900 con 0x7f20a40c5cd0 2023-07-21T22:19:55.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20aa448640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a4156be0 con 0x7f208c005180 2023-07-21T22:19:55.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20a37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a414e870 0x7f20a40c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:55.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20a37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a414e870 0x7f20a40c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48216/0 (socket says 172.21.15.6:48216) 2023-07-21T22:19:55.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20a37fe640 1 -- 172.21.15.6:0/2985794253 learned_addr learned my addr 172.21.15.6:0/2985794253 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:55.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20a3fff640 1 --2- 172.21.15.6:0/2985794253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f208c005180 0x7f20a4156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:55.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20a89e5640 1 --2- 172.21.15.6:0/2985794253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20a40c5cd0 0x7f20a40ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:55.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20a37fe640 1 -- 172.21.15.6:0/2985794253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f208c005180 msgr2=0x7f20a4156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:55.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20a37fe640 1 --2- 172.21.15.6:0/2985794253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f208c005180 0x7f20a4156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:55.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20a37fe640 1 -- 172.21.15.6:0/2985794253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20a40c5cd0 msgr2=0x7f20a40ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:55.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20a37fe640 1 --2- 172.21.15.6:0/2985794253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20a40c5cd0 0x7f20a40ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20a37fe640 1 -- 172.21.15.6:0/2985794253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a4156ec0 con 0x7f20a414e870 2023-07-21T22:19:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.039+0000 7f20a37fe640 1 --2- 172.21.15.6:0/2985794253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a414e870 0x7f20a40c5790 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2098006c10 tx=0x7f2098011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.043+0000 7f20a0ff9640 1 -- 172.21.15.6:0/2985794253 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098009b70 con 0x7f20a414e870 2023-07-21T22:19:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.043+0000 7f20a0ff9640 1 -- 172.21.15.6:0/2985794253 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2098009cd0 con 0x7f20a414e870 2023-07-21T22:19:55.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.043+0000 7f20aa448640 1 -- 172.21.15.6:0/2985794253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a40c5270 con 0x7f20a414e870 2023-07-21T22:19:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.043+0000 7f20a0ff9640 1 -- 172.21.15.6:0/2985794253 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098004220 con 0x7f20a414e870 2023-07-21T22:19:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.043+0000 7f20aa448640 1 -- 172.21.15.6:0/2985794253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a40ace30 con 0x7f20a414e870 2023-07-21T22:19:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.043+0000 7f20aa448640 1 -- 172.21.15.6:0/2985794253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a40ca370 con 0x7f20a414e870 2023-07-21T22:19:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.043+0000 7f20a0ff9640 1 -- 172.21.15.6:0/2985794253 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2098004380 con 0x7f20a414e870 2023-07-21T22:19:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.043+0000 7f20a0ff9640 1 --2- 172.21.15.6:0/2985794253 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2090066280 0x7f2090068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.043+0000 7f20a0ff9640 1 -- 172.21.15.6:0/2985794253 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2098083cb0 con 0x7f20a414e870 2023-07-21T22:19:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.043+0000 7f20a3fff640 1 --2- 172.21.15.6:0/2985794253 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2090066280 0x7f2090068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.047+0000 7f20a3fff640 1 --2- 172.21.15.6:0/2985794253 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2090066280 0x7f2090068730 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2094001060 tx=0x7f2094001c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.047+0000 7f20a0ff9640 1 -- 172.21.15.6:0/2985794253 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2098051090 con 0x7f20a414e870 2023-07-21T22:19:55.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.259+0000 7f20aa448640 1 -- 172.21.15.6:0/2985794253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f20a40c93b0 con 0x7f20a414e870 2023-07-21T22:19:55.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.263+0000 7f20a0ff9640 1 -- 172.21.15.6:0/2985794253 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f20980546b0 con 0x7f20a414e870 2023-07-21T22:19:55.312 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-07-21T22:19:55.312 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA== 2023-07-21T22:19:55.312 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2023-07-21T22:19:55.313 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2023-07-21T22:19:55.313 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-21T22:19:55.314 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-07-21T22:19:55.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.267+0000 7f20aa448640 1 -- 172.21.15.6:0/2985794253 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2090066280 msgr2=0x7f2090068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:55.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.267+0000 7f20aa448640 1 --2- 172.21.15.6:0/2985794253 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2090066280 0x7f2090068730 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2094001060 tx=0x7f2094001c10 comp rx=0 tx=0).stop 2023-07-21T22:19:55.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.267+0000 7f20aa448640 1 -- 172.21.15.6:0/2985794253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a414e870 msgr2=0x7f20a40c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:55.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.267+0000 7f20aa448640 1 --2- 172.21.15.6:0/2985794253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a414e870 0x7f20a40c5790 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2098006c10 tx=0x7f2098011e90 comp rx=0 tx=0).stop 2023-07-21T22:19:55.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.267+0000 7f20aa448640 1 -- 172.21.15.6:0/2985794253 shutdown_connections 2023-07-21T22:19:55.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.267+0000 7f20aa448640 1 --2- 172.21.15.6:0/2985794253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20a40c5cd0 0x7f20a40ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:55.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.267+0000 7f20aa448640 1 --2- 172.21.15.6:0/2985794253 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f2090066280 0x7f2090068730 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:55.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.267+0000 7f20aa448640 1 --2- 172.21.15.6:0/2985794253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a414e870 0x7f20a40c5790 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.267+0000 7f20aa448640 1 --2- 172.21.15.6:0/2985794253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f208c005180 0x7f20a4156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.267+0000 7f20aa448640 1 -- 172.21.15.6:0/2985794253 >> 172.21.15.6:0/2985794253 conn(0x7f20a40afac0 msgr2=0x7f20a40706a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:55.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.267+0000 7f20aa448640 1 -- 172.21.15.6:0/2985794253 shutdown_connections 2023-07-21T22:19:55.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.267+0000 7f20aa448640 1 -- 172.21.15.6:0/2985794253 wait complete. 2023-07-21T22:19:55.332 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:19:55.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.427+0000 7fabc166d640 1 Processor -- start 2023-07-21T22:19:55.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.431+0000 7fabc166d640 1 -- start start 2023-07-21T22:19:55.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.431+0000 7fabc166d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabbc145430 0x7fabbc0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:55.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.431+0000 7fabc166d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fabbc0b39f0 0x7fabbc0d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:55.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.431+0000 7fabc166d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabbc0b2140 con 0x7fabbc0d06b0 2023-07-21T22:19:55.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.431+0000 7fabc166d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabbc0b2410 con 0x7fabbc0b39f0 2023-07-21T22:19:55.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.431+0000 7fabc166d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0b26f0 con 0x7fabbc145430 2023-07-21T22:19:55.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.431+0000 7fabb27fc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabbc145430 0x7fabbc0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:55.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.431+0000 7fabbb7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fabbc0b39f0 0x7fabbc0d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:55.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.431+0000 7fabb27fc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabbc145430 0x7fabbc0b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:49618/0 (socket says 172.21.15.6:49618) 2023-07-21T22:19:55.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.431+0000 7fabb27fc640 1 -- 172.21.15.6:0/2522116202 learned_addr learned my addr 172.21.15.6:0/2522116202 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:55.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.431+0000 7fabb27fc640 1 -- 172.21.15.6:0/2522116202 >> v2:172.21.15.161:3300/0 conn(0x7fabbc0b39f0 msgr2=0x7fabbc0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:55.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.431+0000 7fabb27fc640 1 --2- 172.21.15.6:0/2522116202 >> v2:172.21.15.161:3300/0 conn(0x7fabbc0b39f0 0x7fabbc0d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:55.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.431+0000 7fabb27fc640 1 -- 172.21.15.6:0/2522116202 >> v1:172.21.15.161:6789/0 conn(0x7fabbc0d06b0 legacy=0x7fabbc0b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:55.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.431+0000 7fabb27fc640 1 -- 172.21.15.6:0/2522116202 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc0b29d0 con 0x7fabbc145430 2023-07-21T22:19:55.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.435+0000 7fabb27fc640 1 --2- 172.21.15.6:0/2522116202 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabbc145430 0x7fabbc0b34b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faba4009870 tx=0x7faba401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fd5f342cf555554 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:55.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.435+0000 7fabba7fc640 1 -- 172.21.15.6:0/2522116202 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba40ab620 con 0x7fabbc145430 2023-07-21T22:19:55.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.435+0000 7fabba7fc640 1 -- 172.21.15.6:0/2522116202 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba40ab780 con 0x7fabbc145430 2023-07-21T22:19:55.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.435+0000 7fabba7fc640 1 -- 172.21.15.6:0/2522116202 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba40abb10 con 0x7fabbc145430 2023-07-21T22:19:55.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.435+0000 7fabc166d640 1 -- 172.21.15.6:0/2522116202 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabbc145430 msgr2=0x7fabbc0b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:55.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.435+0000 7fabc166d640 1 --2- 172.21.15.6:0/2522116202 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabbc145430 0x7fabbc0b34b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faba4009870 tx=0x7faba401c510 comp rx=0 tx=0).stop 2023-07-21T22:19:55.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.435+0000 7fabc166d640 1 -- 172.21.15.6:0/2522116202 shutdown_connections 2023-07-21T22:19:55.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.435+0000 7fabc166d640 1 --2- 172.21.15.6:0/2522116202 >> v2:172.21.15.161:3300/0 conn(0x7fabbc0b39f0 0x7fabbc0d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:55.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.435+0000 7fabc166d640 1 --2- 172.21.15.6:0/2522116202 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabbc145430 0x7fabbc0b34b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:55.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.435+0000 7fabc166d640 1 -- 172.21.15.6:0/2522116202 >> 172.21.15.6:0/2522116202 conn(0x7fabbc0659d0 msgr2=0x7fabbc09b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:55.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.435+0000 7fabc166d640 1 -- 172.21.15.6:0/2522116202 shutdown_connections 2023-07-21T22:19:55.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.435+0000 7fabc166d640 1 -- 172.21.15.6:0/2522116202 wait complete. 2023-07-21T22:19:55.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.435+0000 7fabc166d640 1 Processor -- start 2023-07-21T22:19:55.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabc166d640 1 -- start start 2023-07-21T22:19:55.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabc166d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabbc0b39f0 0x7fabbc0cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:55.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabc166d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabbc0d06b0 0x7fabbc1577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:55.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabc166d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabbc0cc980 0x7fabbc0b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:55.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabc166d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0cf700 con 0x7fabbc0cc980 2023-07-21T22:19:55.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabc166d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc159240 con 0x7fabbc0d06b0 2023-07-21T22:19:55.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabc166d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc157d30 con 0x7fabbc0b39f0 2023-07-21T22:19:55.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabbb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabbc0cc980 0x7fabbc0b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:55.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabbaffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabbc0b39f0 0x7fabbc0cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:55.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabbb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabbc0cc980 0x7fabbc0b6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48228/0 (socket says 172.21.15.6:48228) 2023-07-21T22:19:55.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabb27fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabbc0d06b0 0x7fabbc1577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:55.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabbb7fe640 1 -- 172.21.15.6:0/1819023877 learned_addr learned my addr 172.21.15.6:0/1819023877 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:55.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabbb7fe640 1 -- 172.21.15.6:0/1819023877 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabbc0b39f0 msgr2=0x7fabbc0cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:55.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabbb7fe640 1 --2- 172.21.15.6:0/1819023877 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabbc0b39f0 0x7fabbc0cf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:55.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabbb7fe640 1 -- 172.21.15.6:0/1819023877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabbc0d06b0 msgr2=0x7fabbc1577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:55.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabbb7fe640 1 --2- 172.21.15.6:0/1819023877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabbc0d06b0 0x7fabbc1577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:55.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabbb7fe640 1 -- 172.21.15.6:0/1819023877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba40094d0 con 0x7fabbc0cc980 2023-07-21T22:19:55.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabbb7fe640 1 --2- 172.21.15.6:0/1819023877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabbc0cc980 0x7fabbc0b6d10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009cb0 tx=0x7fabb400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:55.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabb3fff640 1 -- 172.21.15.6:0/1819023877 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4009b20 con 0x7fabbc0cc980 2023-07-21T22:19:55.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabb3fff640 1 -- 172.21.15.6:0/1819023877 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb400f040 con 0x7fabbc0cc980 2023-07-21T22:19:55.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabc166d640 1 -- 172.21.15.6:0/1819023877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabbc0b79e0 con 0x7fabbc0cc980 2023-07-21T22:19:55.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabb3fff640 1 -- 172.21.15.6:0/1819023877 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb40146c0 con 0x7fabbc0cc980 2023-07-21T22:19:55.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabc166d640 1 -- 172.21.15.6:0/1819023877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabbc0c95c0 con 0x7fabbc0cc980 2023-07-21T22:19:55.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.439+0000 7fabc166d640 1 -- 172.21.15.6:0/1819023877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabbc072e70 con 0x7fabbc0cc980 2023-07-21T22:19:55.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.443+0000 7fabb3fff640 1 -- 172.21.15.6:0/1819023877 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fabb4014820 con 0x7fabbc0cc980 2023-07-21T22:19:55.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.443+0000 7fabb3fff640 1 --2- 172.21.15.6:0/1819023877 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fab9c0662b0 0x7fab9c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:55.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.443+0000 7fabb3fff640 1 -- 172.21.15.6:0/1819023877 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fabb4084a20 con 0x7fabbc0cc980 2023-07-21T22:19:55.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.443+0000 7fabbaffd640 1 --2- 172.21.15.6:0/1819023877 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fab9c0662b0 0x7fab9c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:55.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.443+0000 7fabbaffd640 1 --2- 172.21.15.6:0/1819023877 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fab9c0662b0 0x7fab9c068760 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fabac001810 tx=0x7fabac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:55.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.447+0000 7fabb3fff640 1 -- 172.21.15.6:0/1819023877 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fabb4051eb0 con 0x7fabbc0cc980 2023-07-21T22:19:55.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.631+0000 7fabc166d640 1 -- 172.21.15.6:0/1819023877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabbc0678d0 con 0x7fabbc0cc980 2023-07-21T22:19:55.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.635+0000 7fabb3fff640 1 -- 172.21.15.6:0/1819023877 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4662 (secure 0 0 0) 0x7fabb4018090 con 0x7fabbc0cc980 2023-07-21T22:19:55.682 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:19:55.683 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4928,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3033056690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3033056690},{"type":"v1","addr":"172.21.15.161:6836","nonce":3033056690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/77801161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":77801161},{"type":"v1","addr":"172.21.15.6:6835","nonce":77801161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5152,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/558287949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":558287949},{"type":"v1","addr":"172.21.15.161:6837","nonce":558287949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:19:45.163404+0000","modified":"2023-07-21T22:19:48.796910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5181":{"gid":5181,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/2921512075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2921512075},{"type":"v1","addr":"172.21.15.6:6834","nonce":2921512075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-21T22:19:55.685 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-07-21T22:19:55.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.635+0000 7fabc166d640 1 -- 172.21.15.6:0/1819023877 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fab9c0662b0 msgr2=0x7fab9c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:55.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.635+0000 7fabc166d640 1 --2- 172.21.15.6:0/1819023877 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fab9c0662b0 0x7fab9c068760 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fabac001810 tx=0x7fabac009040 comp rx=0 tx=0).stop 2023-07-21T22:19:55.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.635+0000 7fabc166d640 1 -- 172.21.15.6:0/1819023877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabbc0cc980 msgr2=0x7fabbc0b6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:55.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.635+0000 7fabc166d640 1 --2- 172.21.15.6:0/1819023877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabbc0cc980 0x7fabbc0b6d10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009cb0 tx=0x7fabb400c490 comp rx=0 tx=0).stop 2023-07-21T22:19:55.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.635+0000 7fabc166d640 1 -- 172.21.15.6:0/1819023877 shutdown_connections 2023-07-21T22:19:55.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.635+0000 7fabc166d640 1 --2- 172.21.15.6:0/1819023877 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fab9c0662b0 0x7fab9c068760 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:55.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.635+0000 7fabc166d640 1 --2- 172.21.15.6:0/1819023877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fabbc0cc980 0x7fabbc0b6d10 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:55.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.635+0000 7fabc166d640 1 --2- 172.21.15.6:0/1819023877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabbc0d06b0 0x7fabbc1577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:55.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.635+0000 7fabc166d640 1 --2- 172.21.15.6:0/1819023877 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabbc0b39f0 0x7fabbc0cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:55.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.635+0000 7fabc166d640 1 -- 172.21.15.6:0/1819023877 >> 172.21.15.6:0/1819023877 conn(0x7fabbc0659d0 msgr2=0x7fabbc06acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:55.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.635+0000 7fabc166d640 1 -- 172.21.15.6:0/1819023877 shutdown_connections 2023-07-21T22:19:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:55.635+0000 7fabc166d640 1 -- 172.21.15.6:0/1819023877 wait complete. 2023-07-21T22:19:56.106 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T22:19:45.163404+0000', 'modified': '2023-07-21T22:19:48.796910+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5181}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5181': {'gid': 5181, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6834/2921512075', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 2921512075}, {'type': 'v1', 'addr': '172.21.15.6:6834', 'nonce': 2921512075}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T22:19:56.107 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T22:19:56.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-21T22:19:56.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.207+0000 7f458c0d8640 1 Processor -- start 2023-07-21T22:19:56.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.207+0000 7f458c0d8640 1 -- start start 2023-07-21T22:19:56.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.211+0000 7f458c0d8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f458406b1e0 0x7f45840c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.211+0000 7f458c0d8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45840cac70 con 0x7f4584070b70 2023-07-21T22:19:56.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.211+0000 7f458c0d8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45840ca060 con 0x7f45840c21f0 2023-07-21T22:19:56.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.211+0000 7f458c0d8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45840ca340 con 0x7f458406b1e0 2023-07-21T22:19:56.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.211+0000 7f4589673640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f458406b1e0 0x7f45840c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.211+0000 7f4589673640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f458406b1e0 0x7f45840c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48232/0 (socket says 172.21.15.6:48232) 2023-07-21T22:19:56.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.211+0000 7f4589e74640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4584070b70 0x7f4584070f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33906/0 (socket says 172.21.15.6:33906) 2023-07-21T22:19:56.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.211+0000 7f4589673640 1 -- 172.21.15.6:0/3892251567 learned_addr learned my addr 172.21.15.6:0/3892251567 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:56.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.211+0000 7f4589673640 1 -- 172.21.15.6:0/3892251567 >> v1:172.21.15.161:6789/0 conn(0x7f45840c21f0 legacy=0x7f45840cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:56.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.211+0000 7f4589673640 1 -- 172.21.15.6:0/3892251567 >> v1:172.21.15.6:6789/0 conn(0x7f4584070b70 legacy=0x7f4584070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:56.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.211+0000 7f4589673640 1 -- 172.21.15.6:0/3892251567 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45840ca620 con 0x7f458406b1e0 2023-07-21T22:19:56.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.211+0000 7f4588e72640 1 -- 172.21.15.6:0/3892251567 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 92104761 0 0) 0x7f45840cac70 con 0x7f4584070b70 2023-07-21T22:19:56.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.215+0000 7f4589673640 1 --2- 172.21.15.6:0/3892251567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f458406b1e0 0x7f45840c1cb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4574009870 tx=0x7f457401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1b803c109475bd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:56.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.215+0000 7f4588e72640 1 -- 172.21.15.6:0/3892251567 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45740aa670 con 0x7f458406b1e0 2023-07-21T22:19:56.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.215+0000 7f4588e72640 1 -- 172.21.15.6:0/3892251567 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45740aa7d0 con 0x7f458406b1e0 2023-07-21T22:19:56.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.215+0000 7f4588e72640 1 -- 172.21.15.6:0/3892251567 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45740aab60 con 0x7f458406b1e0 2023-07-21T22:19:56.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.215+0000 7f458c0d8640 1 -- 172.21.15.6:0/3892251567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f458406b1e0 msgr2=0x7f45840c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:56.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.215+0000 7f458c0d8640 1 --2- 172.21.15.6:0/3892251567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f458406b1e0 0x7f45840c1cb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4574009870 tx=0x7f457401c510 comp rx=0 tx=0).stop 2023-07-21T22:19:56.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.215+0000 7f458c0d8640 1 -- 172.21.15.6:0/3892251567 shutdown_connections 2023-07-21T22:19:56.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.215+0000 7f458c0d8640 1 --2- 172.21.15.6:0/3892251567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f458406b1e0 0x7f45840c1cb0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.215+0000 7f458c0d8640 1 -- 172.21.15.6:0/3892251567 >> 172.21.15.6:0/3892251567 conn(0x7f45840afcf0 msgr2=0x7f45840b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:56.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.215+0000 7f458c0d8640 1 -- 172.21.15.6:0/3892251567 shutdown_connections 2023-07-21T22:19:56.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.215+0000 7f458c0d8640 1 -- 172.21.15.6:0/3892251567 wait complete. 2023-07-21T22:19:56.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.215+0000 7f458c0d8640 1 Processor -- start 2023-07-21T22:19:56.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.215+0000 7f458c0d8640 1 -- start start 2023-07-21T22:19:56.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.215+0000 7f458c0d8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f458406b1e0 0x7f45841458b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f458c0d8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4584070b70 0x7f4584151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f458c0d8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45840c21f0 0x7f4584145110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f458c0d8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45841530f0 con 0x7f458406b1e0 2023-07-21T22:19:56.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f458c0d8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45840b3590 con 0x7f45840c21f0 2023-07-21T22:19:56.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f458c0d8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45840b3870 con 0x7f4584070b70 2023-07-21T22:19:56.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f4589e74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f458406b1e0 0x7f45841458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f4589e74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f458406b1e0 0x7f45841458b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48246/0 (socket says 172.21.15.6:48246) 2023-07-21T22:19:56.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f4589e74640 1 -- 172.21.15.6:0/2223718072 learned_addr learned my addr 172.21.15.6:0/2223718072 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:56.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f4589673640 1 --2- 172.21.15.6:0/2223718072 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4584070b70 0x7f4584151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f458a675640 1 --2- 172.21.15.6:0/2223718072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45840c21f0 0x7f4584145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f4589e74640 1 -- 172.21.15.6:0/2223718072 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4584070b70 msgr2=0x7f4584151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:56.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f4589e74640 1 --2- 172.21.15.6:0/2223718072 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4584070b70 0x7f4584151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f4589e74640 1 -- 172.21.15.6:0/2223718072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45840c21f0 msgr2=0x7f4584145110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:56.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f4589e74640 1 --2- 172.21.15.6:0/2223718072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45840c21f0 0x7f4584145110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f4589e74640 1 -- 172.21.15.6:0/2223718072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45740094d0 con 0x7f458406b1e0 2023-07-21T22:19:56.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f4589e74640 1 --2- 172.21.15.6:0/2223718072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f458406b1e0 0x7f45841458b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f458000c4a0 tx=0x7f458000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:56.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f457a7fc640 1 -- 172.21.15.6:0/2223718072 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45800074e0 con 0x7f458406b1e0 2023-07-21T22:19:56.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f457a7fc640 1 -- 172.21.15.6:0/2223718072 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4580007640 con 0x7f458406b1e0 2023-07-21T22:19:56.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f457a7fc640 1 -- 172.21.15.6:0/2223718072 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4580004a30 con 0x7f458406b1e0 2023-07-21T22:19:56.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f458c0d8640 1 -- 172.21.15.6:0/2223718072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45840b3b50 con 0x7f458406b1e0 2023-07-21T22:19:56.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.219+0000 7f458c0d8640 1 -- 172.21.15.6:0/2223718072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4584153580 con 0x7f458406b1e0 2023-07-21T22:19:56.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f457a7fc640 1 -- 172.21.15.6:0/2223718072 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4580004b90 con 0x7f458406b1e0 2023-07-21T22:19:56.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f457a7fc640 1 --2- 172.21.15.6:0/2223718072 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4568066280 0x7f4568068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f457a7fc640 1 -- 172.21.15.6:0/2223718072 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4580082f40 con 0x7f458406b1e0 2023-07-21T22:19:56.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f458f434000 1 Processor -- start 2023-07-21T22:19:56.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f458f434000 1 -- start start 2023-07-21T22:19:56.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f4589673640 1 --2- 172.21.15.6:0/2223718072 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4568066280 0x7f4568068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f4589673640 1 --2- 172.21.15.6:0/2223718072 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4568066280 0x7f4568068730 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f45740ae000 tx=0x7f45740b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:56.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f458f434000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b6f00 0x55ea472b72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f458f434000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea472b7810 0x55ea4726d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f458f434000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea4726d8b0 0x55ea4726dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f458f434000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea47134880 con 0x55ea4726d8b0 2023-07-21T22:19:56.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f458f434000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea4706e840 con 0x55ea472b7810 2023-07-21T22:19:56.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f458f434000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea470c22e0 con 0x55ea472b6f00 2023-07-21T22:19:56.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f458a675640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea4726d8b0 0x55ea4726dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f4589e74640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b6f00 0x55ea472b72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f458a675640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea4726d8b0 0x55ea4726dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48252/0 (socket says 172.21.15.6:48252) 2023-07-21T22:19:56.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f458a675640 1 -- 172.21.15.6:0/2580258331 learned_addr learned my addr 172.21.15.6:0/2580258331 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:56.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f4589673640 1 --2- 172.21.15.6:0/2580258331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea472b7810 0x55ea4726d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f458a675640 1 -- 172.21.15.6:0/2580258331 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b6f00 msgr2=0x55ea472b72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:56.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f458a675640 1 --2- 172.21.15.6:0/2580258331 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b6f00 0x55ea472b72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f458a675640 1 -- 172.21.15.6:0/2580258331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea472b7810 msgr2=0x55ea4726d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:56.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f458a675640 1 --2- 172.21.15.6:0/2580258331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea472b7810 0x55ea4726d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f458a675640 1 -- 172.21.15.6:0/2580258331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea46db7890 con 0x55ea4726d8b0 2023-07-21T22:19:56.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f4589e74640 1 --2- 172.21.15.6:0/2580258331 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b6f00 0x55ea472b72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:56.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f458a675640 1 --2- 172.21.15.6:0/2580258331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea4726d8b0 0x55ea4726dc80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f457c001cf0 tx=0x7f457c001610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d985319288e1bb75 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f45677fe640 1 -- 172.21.15.6:0/2580258331 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c003b90 con 0x55ea4726d8b0 2023-07-21T22:19:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f45677fe640 1 -- 172.21.15.6:0/2580258331 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457c003cf0 con 0x55ea4726d8b0 2023-07-21T22:19:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.223+0000 7f45677fe640 1 -- 172.21.15.6:0/2580258331 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c00fad0 con 0x55ea4726d8b0 2023-07-21T22:19:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458f434000 1 -- 172.21.15.6:0/2580258331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea4726d8b0 msgr2=0x55ea4726dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458f434000 1 --2- 172.21.15.6:0/2580258331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea4726d8b0 0x55ea4726dc80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f457c001cf0 tx=0x7f457c001610 comp rx=0 tx=0).stop 2023-07-21T22:19:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458f434000 1 -- 172.21.15.6:0/2580258331 shutdown_connections 2023-07-21T22:19:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458f434000 1 --2- 172.21.15.6:0/2580258331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea4726d8b0 0x55ea4726dc80 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458f434000 1 --2- 172.21.15.6:0/2580258331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea472b7810 0x55ea4726d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458f434000 1 --2- 172.21.15.6:0/2580258331 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b6f00 0x55ea472b72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458f434000 1 -- 172.21.15.6:0/2580258331 >> 172.21.15.6:0/2580258331 conn(0x55ea47273a10 msgr2=0x55ea4726bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458f434000 1 -- 172.21.15.6:0/2580258331 shutdown_connections 2023-07-21T22:19:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458f434000 1 -- 172.21.15.6:0/2580258331 wait complete. 2023-07-21T22:19:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458f434000 1 -- start start 2023-07-21T22:19:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458f434000 1 Processor -- start 2023-07-21T22:19:56.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458f434000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea4726d8b0 0x55ea472788e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458f434000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b6f00 0x55ea47278e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458f434000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea472b7810 0x55ea47279360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458f434000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea470bb380 con 0x55ea472b7810 2023-07-21T22:19:56.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458f434000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea47077ae0 con 0x55ea4726d8b0 2023-07-21T22:19:56.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458f434000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea47077780 con 0x55ea472b6f00 2023-07-21T22:19:56.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458f434000 10 client.0 _ll_register_callbacks cb 0x55ea47259240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:56.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458a675640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea472b7810 0x55ea47279360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458a675640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea472b7810 0x55ea47279360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48254/0 (socket says 172.21.15.6:48254) 2023-07-21T22:19:56.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458a675640 1 -- 172.21.15.6:0/590252470 learned_addr learned my addr 172.21.15.6:0/590252470 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:56.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f4589673640 1 --2- 172.21.15.6:0/590252470 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b6f00 0x55ea47278e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f4589e74640 1 --2- 172.21.15.6:0/590252470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea4726d8b0 0x55ea472788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458a675640 1 -- 172.21.15.6:0/590252470 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b6f00 msgr2=0x55ea47278e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:56.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458a675640 1 --2- 172.21.15.6:0/590252470 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b6f00 0x55ea47278e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458a675640 1 -- 172.21.15.6:0/590252470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea4726d8b0 msgr2=0x55ea472788e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:56.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458a675640 1 --2- 172.21.15.6:0/590252470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea4726d8b0 0x55ea472788e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458a675640 1 -- 172.21.15.6:0/590252470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4584153580 con 0x55ea472b7810 2023-07-21T22:19:56.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f4589673640 1 --2- 172.21.15.6:0/590252470 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b6f00 0x55ea47278e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:56.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f4589e74640 1 --2- 172.21.15.6:0/590252470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea4726d8b0 0x55ea472788e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:56.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458a675640 1 --2- 172.21.15.6:0/590252470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea472b7810 0x55ea47279360 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f457c007c80 tx=0x7f457c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb4d69caa1c37c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:56.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f4564ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:19:56.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f4564ff9640 1 -- 172.21.15.6:0/590252470 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c010e90 con 0x55ea472b7810 2023-07-21T22:19:56.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f4564ff9640 1 -- 172.21.15.6:0/590252470 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f457c027c40 con 0x55ea472b7810 2023-07-21T22:19:56.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.227+0000 7f458f434000 1 -- 172.21.15.6:0/590252470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea47082a20 con 0x55ea472b7810 2023-07-21T22:19:56.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f4564ff9640 1 -- 172.21.15.6:0/590252470 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f457c027e20 con 0x55ea472b7810 2023-07-21T22:19:56.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f458f434000 10 client.5379 fetch_fsmap learned FSMap version 17 2023-07-21T22:19:56.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f458f434000 1 -- 172.21.15.6:0/590252470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x7f45840ca060 con 0x55ea472b7810 2023-07-21T22:19:56.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f4564ff9640 1 -- 172.21.15.6:0/590252470 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ea47082a20 con 0x55ea472b7810 2023-07-21T22:19:56.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f4564ff9640 1 -- 172.21.15.6:0/590252470 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f457c012070 con 0x55ea472b7810 2023-07-21T22:19:56.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f458f434000 10 client.5379 fetch_fsmap finished waiting for FSMap version 17 2023-07-21T22:19:56.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f458f434000 10 client.5379 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-21T22:19:56.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f458f434000 20 client.5379 populate_metadata read hostname 'smithi006' 2023-07-21T22:19:56.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f458f434000 1 --2- 172.21.15.6:0/590252470 >> [v2:172.21.15.6:6832/2921512075,v1:172.21.15.6:6834/2921512075] conn(0x55ea47279c00 0x55ea472c8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f458f434000 4 client.5379 mds_command: new command op to 5181 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:19:56.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f458f434000 1 -- 172.21.15.6:0/590252470 --> [v2:172.21.15.6:6832/2921512075,v1:172.21.15.6:6834/2921512075] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea470e9ec0 con 0x55ea47279c00 2023-07-21T22:19:56.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f4589e74640 1 --2- 172.21.15.6:0/590252470 >> [v2:172.21.15.6:6832/2921512075,v1:172.21.15.6:6834/2921512075] conn(0x55ea47279c00 0x55ea472c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f4589e74640 1 --2- 172.21.15.6:0/590252470 >> [v2:172.21.15.6:6832/2921512075,v1:172.21.15.6:6834/2921512075] conn(0x55ea47279c00 0x55ea472c8450 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8726eb69fbb9a0d1 server_cookie=362b830ceca4439f in_seq=0 out_seq=0 2023-07-21T22:19:56.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f4564ff9640 10 client.5379 ms_handle_connect on v2:172.21.15.6:6832/2921512075 2023-07-21T22:19:56.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f4564ff9640 1 -- 172.21.15.6:0/590252470 <== mds.0 v2:172.21.15.6:6832/2921512075 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ea470e9ec0 con 0x55ea47279c00 2023-07-21T22:19:56.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f4564ff9640 10 client.5379 handle_command_reply: tid=0 2023-07-21T22:19:56.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f458f434000 1 client.5379 shutdown 2023-07-21T22:19:56.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f458f434000 1 -- 172.21.15.6:0/590252470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea472b7810 msgr2=0x55ea47279360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:56.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f458f434000 1 --2- 172.21.15.6:0/590252470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea472b7810 0x55ea47279360 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f457c007c80 tx=0x7f457c001260 comp rx=0 tx=0).stop 2023-07-21T22:19:56.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f458f434000 1 -- 172.21.15.6:0/590252470 shutdown_connections 2023-07-21T22:19:56.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f458f434000 1 --2- 172.21.15.6:0/590252470 >> [v2:172.21.15.6:6832/2921512075,v1:172.21.15.6:6834/2921512075] conn(0x55ea47279c00 0x55ea472c8450 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f458f434000 1 --2- 172.21.15.6:0/590252470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea472b7810 0x55ea47279360 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f458f434000 1 --2- 172.21.15.6:0/590252470 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b6f00 0x55ea47278e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f458f434000 1 --2- 172.21.15.6:0/590252470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea4726d8b0 0x55ea472788e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f4564ff9640 0 client.5379 ms_handle_reset on v2:172.21.15.6:6832/2921512075 2023-07-21T22:19:56.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f458f434000 1 -- 172.21.15.6:0/590252470 >> 172.21.15.6:0/590252470 conn(0x55ea47273a10 msgr2=0x55ea4726c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:56.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f458f434000 1 -- 172.21.15.6:0/590252470 shutdown_connections 2023-07-21T22:19:56.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f458f434000 1 -- 172.21.15.6:0/590252470 wait complete. 2023-07-21T22:19:56.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.231+0000 7f458f434000 20 client.5379 trim_cache size 0 max 16384 2023-07-21T22:19:56.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.247+0000 7f458f434000 1 Processor -- start 2023-07-21T22:19:56.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.247+0000 7f458f434000 1 -- start start 2023-07-21T22:19:56.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.247+0000 7f458f434000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea4726d8b0 0x55ea472c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.247+0000 7f458f434000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b6f00 0x55ea472ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.247+0000 7f458f434000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea472b7810 0x55ea472b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.247+0000 7f458f434000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea46d78940 con 0x55ea472b7810 2023-07-21T22:19:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.247+0000 7f458f434000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea47063450 con 0x55ea4726d8b0 2023-07-21T22:19:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.247+0000 7f458f434000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea470b6cf0 con 0x55ea472b6f00 2023-07-21T22:19:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.247+0000 7f458a675640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea472b7810 0x55ea472b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.247+0000 7f458a675640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea472b7810 0x55ea472b2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48270/0 (socket says 172.21.15.6:48270) 2023-07-21T22:19:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.247+0000 7f458a675640 1 -- 172.21.15.6:0/2180037062 learned_addr learned my addr 172.21.15.6:0/2180037062 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:56.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.247+0000 7f458a675640 1 -- 172.21.15.6:0/2180037062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b6f00 msgr2=0x55ea472ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:56.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.247+0000 7f458a675640 1 --2- 172.21.15.6:0/2180037062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b6f00 0x55ea472ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.247+0000 7f458a675640 1 -- 172.21.15.6:0/2180037062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea4726d8b0 msgr2=0x55ea472c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:56.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.247+0000 7f4589e74640 1 --2- 172.21.15.6:0/2180037062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea4726d8b0 0x55ea472c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.247+0000 7f458a675640 1 --2- 172.21.15.6:0/2180037062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea4726d8b0 0x55ea472c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.247+0000 7f458a675640 1 -- 172.21.15.6:0/2180037062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea4726ff80 con 0x55ea472b7810 2023-07-21T22:19:56.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.247+0000 7f4589e74640 1 --2- 172.21.15.6:0/2180037062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea4726d8b0 0x55ea472c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f458a675640 1 --2- 172.21.15.6:0/2180037062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea472b7810 0x55ea472b2190 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f457c005110 tx=0x7f457c01f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163e6f5ae10819c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f4567fff640 1 -- 172.21.15.6:0/2180037062 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c006d60 con 0x55ea472b7810 2023-07-21T22:19:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f4567fff640 1 -- 172.21.15.6:0/2180037062 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457c021070 con 0x55ea472b7810 2023-07-21T22:19:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f4567fff640 1 -- 172.21.15.6:0/2180037062 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c0053d0 con 0x55ea472b7810 2023-07-21T22:19:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f458f434000 1 -- 172.21.15.6:0/2180037062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea472b7810 msgr2=0x55ea472b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f458f434000 1 --2- 172.21.15.6:0/2180037062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea472b7810 0x55ea472b2190 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f457c005110 tx=0x7f457c01f070 comp rx=0 tx=0).stop 2023-07-21T22:19:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f458f434000 1 -- 172.21.15.6:0/2180037062 shutdown_connections 2023-07-21T22:19:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f458f434000 1 --2- 172.21.15.6:0/2180037062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea472b7810 0x55ea472b2190 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f458f434000 1 --2- 172.21.15.6:0/2180037062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b6f00 0x55ea472ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f458f434000 1 --2- 172.21.15.6:0/2180037062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea4726d8b0 0x55ea472c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f458f434000 1 -- 172.21.15.6:0/2180037062 >> 172.21.15.6:0/2180037062 conn(0x55ea47273a10 msgr2=0x55ea472c8450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f458f434000 1 -- 172.21.15.6:0/2180037062 shutdown_connections 2023-07-21T22:19:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f458f434000 1 -- 172.21.15.6:0/2180037062 wait complete. 2023-07-21T22:19:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f458f434000 1 -- start start 2023-07-21T22:19:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f458f434000 1 Processor -- start 2023-07-21T22:19:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f458f434000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea4726d8b0 0x55ea473147d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f458f434000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea472b6f00 0x55ea47314d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f458f434000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b7810 0x55ea472b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f458f434000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea4726d3d0 con 0x55ea4726d8b0 2023-07-21T22:19:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f458f434000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea47271b10 con 0x55ea472b6f00 2023-07-21T22:19:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f458f434000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ea47270880 con 0x55ea472b7810 2023-07-21T22:19:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f458f434000 10 client.0 _ll_register_callbacks cb 0x55ea47239430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f4589e74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea4726d8b0 0x55ea473147d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f4589e74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea4726d8b0 0x55ea473147d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48278/0 (socket says 172.21.15.6:48278) 2023-07-21T22:19:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f4589e74640 1 -- 172.21.15.6:0/2878457825 learned_addr learned my addr 172.21.15.6:0/2878457825 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f4589673640 1 --2- 172.21.15.6:0/2878457825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea472b6f00 0x55ea47314d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f458a675640 1 --2- 172.21.15.6:0/2878457825 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b7810 0x55ea472b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f4589e74640 1 -- 172.21.15.6:0/2878457825 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b7810 msgr2=0x55ea472b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f4589e74640 1 --2- 172.21.15.6:0/2878457825 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b7810 0x55ea472b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f4589e74640 1 -- 172.21.15.6:0/2878457825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea472b6f00 msgr2=0x55ea47314d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f4589e74640 1 --2- 172.21.15.6:0/2878457825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea472b6f00 0x55ea47314d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f4589e74640 1 -- 172.21.15.6:0/2878457825 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45840ca060 con 0x55ea4726d8b0 2023-07-21T22:19:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f4589673640 1 --2- 172.21.15.6:0/2878457825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea472b6f00 0x55ea47314d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.251+0000 7f4589e74640 1 --2- 172.21.15.6:0/2878457825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea4726d8b0 0x55ea473147d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4580054060 tx=0x7f458005c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970becdbc3a97213 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f4564ff9640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:19:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f4564ff9640 1 -- 172.21.15.6:0/2878457825 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458005bf30 con 0x55ea4726d8b0 2023-07-21T22:19:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f4564ff9640 1 -- 172.21.15.6:0/2878457825 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f458005c090 con 0x55ea4726d8b0 2023-07-21T22:19:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 1 -- 172.21.15.6:0/2878457825 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea470b9cd0 con 0x55ea4726d8b0 2023-07-21T22:19:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f4564ff9640 1 -- 172.21.15.6:0/2878457825 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f458004ff10 con 0x55ea4726d8b0 2023-07-21T22:19:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 10 client.5385 fetch_fsmap learned FSMap version 17 2023-07-21T22:19:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 1 -- 172.21.15.6:0/2878457825 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ea4707fd10 con 0x55ea4726d8b0 2023-07-21T22:19:56.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f4564ff9640 1 -- 172.21.15.6:0/2878457825 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ea470b9cd0 con 0x55ea4726d8b0 2023-07-21T22:19:56.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f4564ff9640 1 -- 172.21.15.6:0/2878457825 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f4580050070 con 0x55ea4726d8b0 2023-07-21T22:19:56.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 10 client.5385 fetch_fsmap finished waiting for FSMap version 17 2023-07-21T22:19:56.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 10 client.5385 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-21T22:19:56.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 20 client.5385 populate_metadata read hostname 'smithi006' 2023-07-21T22:19:56.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 1 --2- 172.21.15.6:0/2878457825 >> [v2:172.21.15.6:6832/2921512075,v1:172.21.15.6:6834/2921512075] conn(0x55ea4731b6a0 0x55ea4731da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 4 client.5385 mds_command: new command op to 5181 tid=0[{"prefix": "status"}] 2023-07-21T22:19:56.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 1 -- 172.21.15.6:0/2878457825 --> [v2:172.21.15.6:6832/2921512075,v1:172.21.15.6:6834/2921512075] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ea470b4360 con 0x55ea4731b6a0 2023-07-21T22:19:56.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f4589673640 1 --2- 172.21.15.6:0/2878457825 >> [v2:172.21.15.6:6832/2921512075,v1:172.21.15.6:6834/2921512075] conn(0x55ea4731b6a0 0x55ea4731da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f4589673640 1 --2- 172.21.15.6:0/2878457825 >> [v2:172.21.15.6:6832/2921512075,v1:172.21.15.6:6834/2921512075] conn(0x55ea4731b6a0 0x55ea4731da80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efec38033af5408 server_cookie=7edfdc80ba8d8aad in_seq=0 out_seq=0 2023-07-21T22:19:56.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f4564ff9640 10 client.5385 ms_handle_connect on v2:172.21.15.6:6832/2921512075 2023-07-21T22:19:56.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f4564ff9640 1 -- 172.21.15.6:0/2878457825 <== mds.0 v2:172.21.15.6:6832/2921512075 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55ea470b4360 con 0x55ea4731b6a0 2023-07-21T22:19:56.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f4564ff9640 10 client.5385 handle_command_reply: tid=0 2023-07-21T22:19:56.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 1 client.5385 shutdown 2023-07-21T22:19:56.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 1 -- 172.21.15.6:0/2878457825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea4726d8b0 msgr2=0x55ea473147d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:56.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 1 --2- 172.21.15.6:0/2878457825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea4726d8b0 0x55ea473147d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4580054060 tx=0x7f458005c3e0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 1 -- 172.21.15.6:0/2878457825 shutdown_connections 2023-07-21T22:19:56.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 1 --2- 172.21.15.6:0/2878457825 >> [v2:172.21.15.6:6832/2921512075,v1:172.21.15.6:6834/2921512075] conn(0x55ea4731b6a0 0x55ea4731da80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 1 --2- 172.21.15.6:0/2878457825 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ea472b7810 0x55ea472b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 1 --2- 172.21.15.6:0/2878457825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ea472b6f00 0x55ea47314d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f4564ff9640 0 client.5385 ms_handle_reset on v2:172.21.15.6:6832/2921512075 2023-07-21T22:19:56.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 1 --2- 172.21.15.6:0/2878457825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ea4726d8b0 0x55ea473147d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 1 -- 172.21.15.6:0/2878457825 >> 172.21.15.6:0/2878457825 conn(0x55ea47273a10 msgr2=0x55ea47273080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:56.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 1 -- 172.21.15.6:0/2878457825 shutdown_connections 2023-07-21T22:19:56.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 1 -- 172.21.15.6:0/2878457825 wait complete. 2023-07-21T22:19:56.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458f434000 20 client.5385 trim_cache size 0 max 16384 2023-07-21T22:19:56.311 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:19:56.311 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "f3073df4-6cd1-4503-bd2e-d3e98fa18bdf", 2023-07-21T22:19:56.312 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-07-21T22:19:56.312 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 5181, 2023-07-21T22:19:56.312 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-07-21T22:19:56.312 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-07-21T22:19:56.312 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-07-21T22:19:56.312 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.498524728, 2023-07-21T22:19:56.312 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 17, 2023-07-21T22:19:56.313 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 39, 2023-07-21T22:19:56.313 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 39, 2023-07-21T22:19:56.313 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 18.382586622000002 2023-07-21T22:19:56.313 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:19:56.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458c0d8640 1 -- 172.21.15.6:0/2223718072 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4568066280 msgr2=0x7f4568068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:56.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458c0d8640 1 --2- 172.21.15.6:0/2223718072 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4568066280 0x7f4568068730 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f45740ae000 tx=0x7f45740b5040 comp rx=0 tx=0).stop 2023-07-21T22:19:56.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458c0d8640 1 -- 172.21.15.6:0/2223718072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f458406b1e0 msgr2=0x7f45841458b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:56.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458c0d8640 1 --2- 172.21.15.6:0/2223718072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f458406b1e0 0x7f45841458b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f458000c4a0 tx=0x7f458000c960 comp rx=0 tx=0).stop 2023-07-21T22:19:56.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458c0d8640 1 -- 172.21.15.6:0/2223718072 shutdown_connections 2023-07-21T22:19:56.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458c0d8640 1 --2- 172.21.15.6:0/2223718072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45840c21f0 0x7f4584145110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458c0d8640 1 --2- 172.21.15.6:0/2223718072 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4584070b70 0x7f4584151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458c0d8640 1 --2- 172.21.15.6:0/2223718072 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f4568066280 0x7f4568068730 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458c0d8640 1 --2- 172.21.15.6:0/2223718072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f458406b1e0 0x7f45841458b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458c0d8640 1 -- 172.21.15.6:0/2223718072 >> 172.21.15.6:0/2223718072 conn(0x7f45840afcf0 msgr2=0x7f45840b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:56.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458c0d8640 1 -- 172.21.15.6:0/2223718072 shutdown_connections 2023-07-21T22:19:56.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.255+0000 7f458c0d8640 1 -- 172.21.15.6:0/2223718072 wait complete. 2023-07-21T22:19:56.323 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:19:56.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.419+0000 7f2556e0b640 1 Processor -- start 2023-07-21T22:19:56.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.419+0000 7f2556e0b640 1 -- start start 2023-07-21T22:19:56.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.419+0000 7f2556e0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25500b7c70 0x7f25500d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.419+0000 7f2556e0b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f255015fd60 0x7f25500d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.419+0000 7f2556e0b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25500ccaf0 con 0x7f25500d1850 2023-07-21T22:19:56.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.419+0000 7f2556e0b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25500d1190 con 0x7f255015fd60 2023-07-21T22:19:56.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.419+0000 7f2556e0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2550160600 con 0x7f25500b7c70 2023-07-21T22:19:56.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.419+0000 7f25553a8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f255015fd60 0x7f25500d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.419+0000 7f254ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f25500d1850 0x7f255015f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33920/0 (socket says 172.21.15.6:33920) 2023-07-21T22:19:56.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.419+0000 7f254ffff640 1 -- 172.21.15.6:0/711361622 learned_addr learned my addr 172.21.15.6:0/711361622 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:56.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.419+0000 7f2554ba7640 1 --2- 172.21.15.6:0/711361622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25500b7c70 0x7f25500d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.419+0000 7f25553a8640 1 -- 172.21.15.6:0/711361622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25500b7c70 msgr2=0x7f25500d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:56.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.419+0000 7f25553a8640 1 --2- 172.21.15.6:0/711361622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25500b7c70 0x7f25500d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.419+0000 7f25553a8640 1 -- 172.21.15.6:0/711361622 >> v1:172.21.15.6:6789/0 conn(0x7f25500d1850 legacy=0x7f255015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:56.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.419+0000 7f25553a8640 1 -- 172.21.15.6:0/711361622 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2550160320 con 0x7f255015fd60 2023-07-21T22:19:56.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.419+0000 7f254f7fe640 1 -- 172.21.15.6:0/711361622 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439900541 0 0) 0x7f25500ccaf0 con 0x7f25500d1850 2023-07-21T22:19:56.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.423+0000 7f25553a8640 1 --2- 172.21.15.6:0/711361622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f255015fd60 0x7f25500d1da0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2548009dc0 tx=0x7f254801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69551b0aff722678 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:56.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.423+0000 7f254f7fe640 1 -- 172.21.15.6:0/711361622 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25480a59e0 con 0x7f255015fd60 2023-07-21T22:19:56.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.423+0000 7f254f7fe640 1 -- 172.21.15.6:0/711361622 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25480a5b40 con 0x7f255015fd60 2023-07-21T22:19:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.423+0000 7f254f7fe640 1 -- 172.21.15.6:0/711361622 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25480ad440 con 0x7f255015fd60 2023-07-21T22:19:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.423+0000 7f2556e0b640 1 -- 172.21.15.6:0/711361622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f255015fd60 msgr2=0x7f25500d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.423+0000 7f2556e0b640 1 --2- 172.21.15.6:0/711361622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f255015fd60 0x7f25500d1da0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2548009dc0 tx=0x7f254801c900 comp rx=0 tx=0).stop 2023-07-21T22:19:56.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.423+0000 7f2556e0b640 1 -- 172.21.15.6:0/711361622 shutdown_connections 2023-07-21T22:19:56.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.423+0000 7f2556e0b640 1 --2- 172.21.15.6:0/711361622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f255015fd60 0x7f25500d1da0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.423+0000 7f2556e0b640 1 --2- 172.21.15.6:0/711361622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25500b7c70 0x7f25500d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.423+0000 7f2556e0b640 1 -- 172.21.15.6:0/711361622 >> 172.21.15.6:0/711361622 conn(0x7f25500650b0 msgr2=0x7f25500654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.423+0000 7f2556e0b640 1 -- 172.21.15.6:0/711361622 shutdown_connections 2023-07-21T22:19:56.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.423+0000 7f2556e0b640 1 -- 172.21.15.6:0/711361622 wait complete. 2023-07-21T22:19:56.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f2556e0b640 1 Processor -- start 2023-07-21T22:19:56.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f2556e0b640 1 -- start start 2023-07-21T22:19:56.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f2556e0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25500b7c70 0x7f25500c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f2556e0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25500d1850 0x7f2550153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f2556e0b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f255015fd60 0x7f25500b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f2556e0b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25500cc010 con 0x7f25500b7c70 2023-07-21T22:19:56.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f2556e0b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25500c9b50 con 0x7f255015fd60 2023-07-21T22:19:56.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f2556e0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25500cb400 con 0x7f25500d1850 2023-07-21T22:19:56.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f2554ba7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25500b7c70 0x7f25500c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f2554ba7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25500b7c70 0x7f25500c9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48302/0 (socket says 172.21.15.6:48302) 2023-07-21T22:19:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f2554ba7640 1 -- 172.21.15.6:0/2055950080 learned_addr learned my addr 172.21.15.6:0/2055950080 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f254ffff640 1 --2- 172.21.15.6:0/2055950080 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25500d1850 0x7f2550153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f2554ba7640 1 -- 172.21.15.6:0/2055950080 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25500d1850 msgr2=0x7f2550153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f25553a8640 1 --2- 172.21.15.6:0/2055950080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f255015fd60 0x7f25500b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f2554ba7640 1 --2- 172.21.15.6:0/2055950080 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25500d1850 0x7f2550153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f2554ba7640 1 -- 172.21.15.6:0/2055950080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f255015fd60 msgr2=0x7f25500b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:56.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f2554ba7640 1 --2- 172.21.15.6:0/2055950080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f255015fd60 0x7f25500b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f2554ba7640 1 -- 172.21.15.6:0/2055950080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2548009a70 con 0x7f25500b7c70 2023-07-21T22:19:56.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f25553a8640 1 --2- 172.21.15.6:0/2055950080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f255015fd60 0x7f25500b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f254ffff640 1 --2- 172.21.15.6:0/2055950080 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25500d1850 0x7f2550153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f2554ba7640 1 --2- 172.21.15.6:0/2055950080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25500b7c70 0x7f25500c9610 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f254400e870 tx=0x7f254400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f254d7fa640 1 -- 172.21.15.6:0/2055950080 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544009510 con 0x7f25500b7c70 2023-07-21T22:19:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f254d7fa640 1 -- 172.21.15.6:0/2055950080 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254400eec0 con 0x7f25500b7c70 2023-07-21T22:19:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f254d7fa640 1 -- 172.21.15.6:0/2055950080 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400cb40 con 0x7f25500b7c70 2023-07-21T22:19:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f2556e0b640 1 -- 172.21.15.6:0/2055950080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25500cb6e0 con 0x7f25500b7c70 2023-07-21T22:19:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.427+0000 7f2556e0b640 1 -- 172.21.15.6:0/2055950080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25500cbca0 con 0x7f25500b7c70 2023-07-21T22:19:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.431+0000 7f2556e0b640 1 -- 172.21.15.6:0/2055950080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25500678d0 con 0x7f25500b7c70 2023-07-21T22:19:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.431+0000 7f254d7fa640 1 -- 172.21.15.6:0/2055950080 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f254400cca0 con 0x7f25500b7c70 2023-07-21T22:19:56.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.431+0000 7f254d7fa640 1 --2- 172.21.15.6:0/2055950080 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f25340662b0 0x7f2534068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:56.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.431+0000 7f254d7fa640 1 -- 172.21.15.6:0/2055950080 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2544083e50 con 0x7f25500b7c70 2023-07-21T22:19:56.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.431+0000 7f254ffff640 1 --2- 172.21.15.6:0/2055950080 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f25340662b0 0x7f2534068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:56.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.435+0000 7f254ffff640 1 --2- 172.21.15.6:0/2055950080 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f25340662b0 0x7f2534068760 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f253c007fd0 tx=0x7f253c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:56.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.435+0000 7f254d7fa640 1 -- 172.21.15.6:0/2055950080 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2544051230 con 0x7f25500b7c70 2023-07-21T22:19:56.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.623+0000 7f2556e0b640 1 -- 172.21.15.6:0/2055950080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f25500d2ce0 con 0x7f25500b7c70 2023-07-21T22:19:56.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.623+0000 7f254d7fa640 1 -- 172.21.15.6:0/2055950080 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2544017070 con 0x7f25500b7c70 2023-07-21T22:19:56.672 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T22:19:56.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.627+0000 7f2556e0b640 1 -- 172.21.15.6:0/2055950080 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f25340662b0 msgr2=0x7f2534068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:56.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.627+0000 7f2556e0b640 1 --2- 172.21.15.6:0/2055950080 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f25340662b0 0x7f2534068760 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f253c007fd0 tx=0x7f253c009040 comp rx=0 tx=0).stop 2023-07-21T22:19:56.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.627+0000 7f2556e0b640 1 -- 172.21.15.6:0/2055950080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25500b7c70 msgr2=0x7f25500c9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:56.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.627+0000 7f2556e0b640 1 --2- 172.21.15.6:0/2055950080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25500b7c70 0x7f25500c9610 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f254400e870 tx=0x7f254400ec70 comp rx=0 tx=0).stop 2023-07-21T22:19:56.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.627+0000 7f2556e0b640 1 -- 172.21.15.6:0/2055950080 shutdown_connections 2023-07-21T22:19:56.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.627+0000 7f2556e0b640 1 --2- 172.21.15.6:0/2055950080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f255015fd60 0x7f25500b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.627+0000 7f2556e0b640 1 --2- 172.21.15.6:0/2055950080 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25500d1850 0x7f2550153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.627+0000 7f2556e0b640 1 --2- 172.21.15.6:0/2055950080 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f25340662b0 0x7f2534068760 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.627+0000 7f2556e0b640 1 --2- 172.21.15.6:0/2055950080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25500b7c70 0x7f25500c9610 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:56.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.627+0000 7f2556e0b640 1 -- 172.21.15.6:0/2055950080 >> 172.21.15.6:0/2055950080 conn(0x7f25500650b0 msgr2=0x7f25500b71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:56.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.627+0000 7f2556e0b640 1 -- 172.21.15.6:0/2055950080 shutdown_connections 2023-07-21T22:19:56.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:56.627+0000 7f2556e0b640 1 -- 172.21.15.6:0/2055950080 wait complete. 2023-07-21T22:19:56.693 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-21T22:19:56.694 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:19:56.694 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-07-21T22:19:56.694 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T22:19:56.694 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T22:19:56.695 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-21T22:19:56.695 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-21T22:19:56.695 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:19:56.695 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:19:56.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:56.696 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-07-21T22:19:56.708 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:19:56.708 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:19:56.708 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:19:56.709 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:56.709 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-21T22:19:56.709 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:56.709 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:19:56.710 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:56.710 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-07-21T22:19:56.710 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:19:56.710 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:56.710 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-07-21T22:19:56.711 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:19:56.711 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:56.711 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-07-21T22:19:56.712 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:19:56.712 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42049sec preferred_lft 42049sec 2023-07-21T22:19:56.712 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-07-21T22:19:56.712 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:56.712 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:19:56.713 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:56.713 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-07-21T22:19:56.713 INFO:teuthology.orchestra.run.smithi006.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:19:56.713 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:42:2f:9a:3d:15 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:56.713 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:19:56.713 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:56.713 INFO:teuthology.orchestra.run.smithi006.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:19:56.713 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-21T22:19:56.714 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T22:19:56.714 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:56.714 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-21T22:19:56.714 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:56.714 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:19:56.714 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:19:56.714 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-21T22:19:56.715 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:56.715 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:19:56.715 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T22:19:56.715 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-21T22:19:56.715 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:19:56.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:56.716 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:19:56.772 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-07-21T22:19:56.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:56.775 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-07-21T22:19:56.830 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-07-21T22:19:56.831 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:19:56.831 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:19:56.831 INFO:teuthology.orchestra.run.smithi006.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:19:56.831 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:19:56.831 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:19:56.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:56.832 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T22:19:56.833 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T22:19:56.833 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:19:56.833 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:19:56.833 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:19:56.834 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T22:19:56.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:56.928 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T22:19:56.937 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-21T22:19:56.938 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T22:19:56.938 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:19:56.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:56.939 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-07-21T22:19:57.003 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:19:57.004 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T22:19:57.053 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:19:57.054 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:19:57.054 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:19:57.104 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-21T22:19:57.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:57.105 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:19:57.201 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:19:57.201 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:19:57.201 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:19:57.216 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:19:57.217 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:19:57.217 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:19:57.217 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:19:57.217 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:19:57.226 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:19:57.226 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:19:57.226 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:19:57.227 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:19:57.227 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:19:57.227 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-07-21T22:19:57.228 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-07-21T22:19:57.228 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f3073df4-6cd1-4503-bd2e-d3e98fa18bdf" will pass to kernel 2023-07-21T22:19:57.230 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T22:19:57.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:57.231 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:19:57.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:57.255 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:19:57.312 INFO:teuthology.orchestra.run.smithi006.stdout:client5081 2023-07-21T22:19:57.313 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:19:57.313 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:19:57.365 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-21T22:19:57.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.503+0000 7ff41067b640 1 Processor -- start 2023-07-21T22:19:57.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.503+0000 7ff41067b640 1 -- start start 2023-07-21T22:19:57.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.507+0000 7ff41067b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff4080ae1f0 0x7ff4080b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:57.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.507+0000 7ff41067b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40806c430 0x7ff408069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:57.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.507+0000 7ff41067b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4080b24f0 con 0x7ff40806e160 2023-07-21T22:19:57.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.507+0000 7ff41067b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4080b27d0 con 0x7ff4080ae1f0 2023-07-21T22:19:57.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.507+0000 7ff41067b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080b2ab0 con 0x7ff40806c430 2023-07-21T22:19:57.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.507+0000 7ff40e417640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff4080ae1f0 0x7ff4080b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:57.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.507+0000 7ff40ec18640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40806c430 0x7ff408069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:57.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.507+0000 7ff40ec18640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40806c430 0x7ff408069430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:52110/0 (socket says 172.21.15.6:52110) 2023-07-21T22:19:57.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.507+0000 7ff40dc16640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff40806e160 0x7ff40806bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:43856/0 (socket says 172.21.15.6:43856) 2023-07-21T22:19:57.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.507+0000 7ff40ec18640 1 -- 172.21.15.6:0/3877037579 learned_addr learned my addr 172.21.15.6:0/3877037579 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:57.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.507+0000 7ff40e417640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff4080ae1f0 0x7ff4080b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:40170/0 (socket says 172.21.15.6:40170) 2023-07-21T22:19:57.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.507+0000 7ff40ec18640 1 -- 172.21.15.6:0/3877037579 >> v2:172.21.15.161:3300/0 conn(0x7ff4080ae1f0 msgr2=0x7ff4080b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:57.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.507+0000 7ff40ec18640 1 --2- 172.21.15.6:0/3877037579 >> v2:172.21.15.161:3300/0 conn(0x7ff4080ae1f0 0x7ff4080b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:57.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.507+0000 7ff40ec18640 1 -- 172.21.15.6:0/3877037579 >> v1:172.21.15.161:6789/0 conn(0x7ff40806e160 legacy=0x7ff40806bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:57.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.507+0000 7ff40ec18640 1 -- 172.21.15.6:0/3877037579 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4080b2d90 con 0x7ff40806c430 2023-07-21T22:19:57.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.511+0000 7ff40ec18640 1 --2- 172.21.15.6:0/3877037579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40806c430 0x7ff408069430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff400009e50 tx=0x7ff40001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a729d06b37bfb896 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:57.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.511+0000 7ff40d415640 1 -- 172.21.15.6:0/3877037579 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4000a58d0 con 0x7ff40806c430 2023-07-21T22:19:57.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.511+0000 7ff40d415640 1 -- 172.21.15.6:0/3877037579 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4000a5a30 con 0x7ff40806c430 2023-07-21T22:19:57.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.511+0000 7ff40d415640 1 -- 172.21.15.6:0/3877037579 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4000a5dc0 con 0x7ff40806c430 2023-07-21T22:19:57.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.511+0000 7ff41067b640 1 -- 172.21.15.6:0/3877037579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40806c430 msgr2=0x7ff408069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:57.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.511+0000 7ff41067b640 1 --2- 172.21.15.6:0/3877037579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40806c430 0x7ff408069430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff400009e50 tx=0x7ff40001c9e0 comp rx=0 tx=0).stop 2023-07-21T22:19:57.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.511+0000 7ff41067b640 1 -- 172.21.15.6:0/3877037579 shutdown_connections 2023-07-21T22:19:57.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.511+0000 7ff41067b640 1 --2- 172.21.15.6:0/3877037579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40806c430 0x7ff408069430 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:57.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.511+0000 7ff41067b640 1 --2- 172.21.15.6:0/3877037579 >> v2:172.21.15.161:3300/0 conn(0x7ff4080ae1f0 0x7ff4080b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:57.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.511+0000 7ff41067b640 1 -- 172.21.15.6:0/3877037579 >> 172.21.15.6:0/3877037579 conn(0x7ff4080b1300 msgr2=0x7ff4080ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:57.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.511+0000 7ff41067b640 1 -- 172.21.15.6:0/3877037579 shutdown_connections 2023-07-21T22:19:57.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.511+0000 7ff41067b640 1 -- 172.21.15.6:0/3877037579 wait complete. 2023-07-21T22:19:57.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.511+0000 7ff41067b640 1 Processor -- start 2023-07-21T22:19:57.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.511+0000 7ff41067b640 1 -- start start 2023-07-21T22:19:57.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff41067b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40806c430 0x7ff408159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:57.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff41067b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40806e160 0x7ff40813c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:57.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff41067b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4080ae1f0 0x7ff4080afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:57.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff41067b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40813c9b0 con 0x7ff40806e160 2023-07-21T22:19:57.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff41067b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40815a4a0 con 0x7ff4080ae1f0 2023-07-21T22:19:57.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff41067b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40815a780 con 0x7ff40806c430 2023-07-21T22:19:57.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff40dc16640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40806e160 0x7ff40813c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:57.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff40dc16640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40806e160 0x7ff40813c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54008/0 (socket says 172.21.15.6:54008) 2023-07-21T22:19:57.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff40dc16640 1 -- 172.21.15.6:0/4193738001 learned_addr learned my addr 172.21.15.6:0/4193738001 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:57.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff40e417640 1 --2- 172.21.15.6:0/4193738001 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40806c430 0x7ff408159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:57.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff40ec18640 1 --2- 172.21.15.6:0/4193738001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4080ae1f0 0x7ff4080afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:57.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff40dc16640 1 -- 172.21.15.6:0/4193738001 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40806c430 msgr2=0x7ff408159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:57.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff40dc16640 1 --2- 172.21.15.6:0/4193738001 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40806c430 0x7ff408159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:57.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff40dc16640 1 -- 172.21.15.6:0/4193738001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4080ae1f0 msgr2=0x7ff4080afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:57.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff40dc16640 1 --2- 172.21.15.6:0/4193738001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4080ae1f0 0x7ff4080afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:57.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff40dc16640 1 -- 172.21.15.6:0/4193738001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff400009b30 con 0x7ff40806e160 2023-07-21T22:19:57.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff40dc16640 1 --2- 172.21.15.6:0/4193738001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40806e160 0x7ff40813c470 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff3f800c490 tx=0x7ff3f800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:57.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff3feffd640 1 -- 172.21.15.6:0/4193738001 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8007480 con 0x7ff40806e160 2023-07-21T22:19:57.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff3feffd640 1 -- 172.21.15.6:0/4193738001 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f80075e0 con 0x7ff40806e160 2023-07-21T22:19:57.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff3feffd640 1 -- 172.21.15.6:0/4193738001 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8004a10 con 0x7ff40806e160 2023-07-21T22:19:57.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff41067b640 1 -- 172.21.15.6:0/4193738001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4080b3710 con 0x7ff40806e160 2023-07-21T22:19:57.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff41067b640 1 -- 172.21.15.6:0/4193738001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40815ad40 con 0x7ff40806e160 2023-07-21T22:19:57.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff41067b640 1 -- 172.21.15.6:0/4193738001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4080678d0 con 0x7ff40806e160 2023-07-21T22:19:57.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.515+0000 7ff3feffd640 1 -- 172.21.15.6:0/4193738001 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff3f8004b70 con 0x7ff40806e160 2023-07-21T22:19:57.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.519+0000 7ff3feffd640 1 --2- 172.21.15.6:0/4193738001 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff3ec066280 0x7ff3ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:57.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.519+0000 7ff3feffd640 1 -- 172.21.15.6:0/4193738001 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff3f8082e70 con 0x7ff40806e160 2023-07-21T22:19:57.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.519+0000 7ff40e417640 1 --2- 172.21.15.6:0/4193738001 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff3ec066280 0x7ff3ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:57.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.519+0000 7ff40e417640 1 --2- 172.21.15.6:0/4193738001 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff3ec066280 0x7ff3ec068730 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff404009ac0 tx=0x7ff404009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:57.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.523+0000 7ff3feffd640 1 -- 172.21.15.6:0/4193738001 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff3f80503a0 con 0x7ff40806e160 2023-07-21T22:19:57.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.699+0000 7ff41067b640 1 -- 172.21.15.6:0/4193738001 --> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4080b3590 con 0x7ff3ec066280 2023-07-21T22:19:57.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.699+0000 7ff3feffd640 1 -- 172.21.15.6:0/4193738001 <== mgr.4103 v2:172.21.15.161:6832/3471136886 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff404004040 con 0x7ff3ec066280 2023-07-21T22:19:57.749 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:19:57.749 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:19:57.749 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephfs" 2023-07-21T22:19:57.749 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:19:57.749 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:19:57.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.703+0000 7ff41067b640 1 -- 172.21.15.6:0/4193738001 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff3ec066280 msgr2=0x7ff3ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:57.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.703+0000 7ff41067b640 1 --2- 172.21.15.6:0/4193738001 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff3ec066280 0x7ff3ec068730 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff404009ac0 tx=0x7ff404009190 comp rx=0 tx=0).stop 2023-07-21T22:19:57.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.703+0000 7ff41067b640 1 -- 172.21.15.6:0/4193738001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40806e160 msgr2=0x7ff40813c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:57.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.703+0000 7ff41067b640 1 --2- 172.21.15.6:0/4193738001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40806e160 0x7ff40813c470 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff3f800c490 tx=0x7ff3f800c950 comp rx=0 tx=0).stop 2023-07-21T22:19:57.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.703+0000 7ff41067b640 1 -- 172.21.15.6:0/4193738001 shutdown_connections 2023-07-21T22:19:57.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.703+0000 7ff41067b640 1 --2- 172.21.15.6:0/4193738001 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4080ae1f0 0x7ff4080afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:57.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.703+0000 7ff41067b640 1 --2- 172.21.15.6:0/4193738001 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7ff3ec066280 0x7ff3ec068730 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:57.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.703+0000 7ff41067b640 1 --2- 172.21.15.6:0/4193738001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40806e160 0x7ff40813c470 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:57.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.703+0000 7ff41067b640 1 --2- 172.21.15.6:0/4193738001 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40806c430 0x7ff408159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:57.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.703+0000 7ff41067b640 1 -- 172.21.15.6:0/4193738001 >> 172.21.15.6:0/4193738001 conn(0x7ff4080b1300 msgr2=0x7ff4080ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:57.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.703+0000 7ff41067b640 1 -- 172.21.15.6:0/4193738001 shutdown_connections 2023-07-21T22:19:57.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.703+0000 7ff41067b640 1 -- 172.21.15.6:0/4193738001 wait complete. 2023-07-21T22:19:57.770 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-21T22:19:57.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.867+0000 7f72c09d2640 1 Processor -- start 2023-07-21T22:19:57.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.867+0000 7f72c09d2640 1 -- start start 2023-07-21T22:19:57.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.871+0000 7f72c09d2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f72bc0ce620 0x7f72bc0ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:57.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.871+0000 7f72c09d2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f72bc15c050 0x7f72bc15f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:57.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.871+0000 7f72c09d2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72bc0c6140 con 0x7f72bc15fee0 2023-07-21T22:19:57.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.871+0000 7f72c09d2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72bc06c3f0 con 0x7f72bc15c050 2023-07-21T22:19:57.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.871+0000 7f72c09d2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72bc0cef30 con 0x7f72bc0ce620 2023-07-21T22:19:57.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.871+0000 7f72b3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f72bc15c050 0x7f72bc15f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:57.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.871+0000 7f72b3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f72bc15c050 0x7f72bc15f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54018/0 (socket says 172.21.15.6:54018) 2023-07-21T22:19:57.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.871+0000 7f72b3fff640 1 -- 172.21.15.6:0/361457331 learned_addr learned my addr 172.21.15.6:0/361457331 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:57.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.871+0000 7f72ba59c640 1 --2- 172.21.15.6:0/361457331 >> v2:172.21.15.161:3300/0 conn(0x7f72bc0ce620 0x7f72bc0ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:57.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.871+0000 7f72b3fff640 1 -- 172.21.15.6:0/361457331 >> v2:172.21.15.161:3300/0 conn(0x7f72bc0ce620 msgr2=0x7f72bc0ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:57.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.871+0000 7f72b3fff640 1 --2- 172.21.15.6:0/361457331 >> v2:172.21.15.161:3300/0 conn(0x7f72bc0ce620 0x7f72bc0ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:57.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.871+0000 7f72b3fff640 1 -- 172.21.15.6:0/361457331 >> v1:172.21.15.161:6789/0 conn(0x7f72bc15fee0 legacy=0x7f72bc06e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:57.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.871+0000 7f72b3fff640 1 -- 172.21.15.6:0/361457331 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc06dab0 con 0x7f72bc15c050 2023-07-21T22:19:57.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.871+0000 7f72ba59c640 1 --2- 172.21.15.6:0/361457331 >> v2:172.21.15.161:3300/0 conn(0x7f72bc0ce620 0x7f72bc0ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:57.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.871+0000 7f72b3fff640 1 --2- 172.21.15.6:0/361457331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72bc15c050 0x7f72bc15f9a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0b1d90 tx=0x7f72a401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55756eba4b9ccfab server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:57.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.875+0000 7f72b9d9b640 1 -- 172.21.15.6:0/361457331 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a40ab600 con 0x7f72bc15c050 2023-07-21T22:19:57.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.875+0000 7f72b9d9b640 1 -- 172.21.15.6:0/361457331 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a40a7050 con 0x7f72bc15c050 2023-07-21T22:19:57.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.875+0000 7f72b9d9b640 1 -- 172.21.15.6:0/361457331 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a40ab980 con 0x7f72bc15c050 2023-07-21T22:19:57.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.875+0000 7f72c09d2640 1 -- 172.21.15.6:0/361457331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72bc15c050 msgr2=0x7f72bc15f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:57.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.875+0000 7f72c09d2640 1 --2- 172.21.15.6:0/361457331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72bc15c050 0x7f72bc15f9a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0b1d90 tx=0x7f72a401c490 comp rx=0 tx=0).stop 2023-07-21T22:19:57.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.875+0000 7f72c09d2640 1 -- 172.21.15.6:0/361457331 shutdown_connections 2023-07-21T22:19:57.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.875+0000 7f72c09d2640 1 --2- 172.21.15.6:0/361457331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72bc15c050 0x7f72bc15f9a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:57.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.875+0000 7f72c09d2640 1 --2- 172.21.15.6:0/361457331 >> v2:172.21.15.161:3300/0 conn(0x7f72bc0ce620 0x7f72bc0ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:57.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.875+0000 7f72c09d2640 1 -- 172.21.15.6:0/361457331 >> 172.21.15.6:0/361457331 conn(0x7f72bc0cc9a0 msgr2=0x7f72bc0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:57.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.875+0000 7f72c09d2640 1 -- 172.21.15.6:0/361457331 shutdown_connections 2023-07-21T22:19:57.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.875+0000 7f72c09d2640 1 -- 172.21.15.6:0/361457331 wait complete. 2023-07-21T22:19:57.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.875+0000 7f72c09d2640 1 Processor -- start 2023-07-21T22:19:57.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.875+0000 7f72c09d2640 1 -- start start 2023-07-21T22:19:57.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.875+0000 7f72c09d2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72bc0ce620 0x7f72bc0c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:57.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72c09d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72bc15c050 0x7f72bc0c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:57.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72c09d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72bc15fee0 0x7f72bc153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:57.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72c09d2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc0c46c0 con 0x7f72bc15fee0 2023-07-21T22:19:57.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72c09d2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc0c4f60 con 0x7f72bc0ce620 2023-07-21T22:19:57.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72c09d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc0b20c0 con 0x7f72bc15c050 2023-07-21T22:19:57.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72bad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72bc15fee0 0x7f72bc153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:57.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72ba59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72bc0ce620 0x7f72bc0c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:57.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72bad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72bc15fee0 0x7f72bc153a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54032/0 (socket says 172.21.15.6:54032) 2023-07-21T22:19:57.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72bad9d640 1 -- 172.21.15.6:0/2779716685 learned_addr learned my addr 172.21.15.6:0/2779716685 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:57.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72ba59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72bc0ce620 0x7f72bc0c8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:40194/0 (socket says 172.21.15.6:40194) 2023-07-21T22:19:57.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72b3fff640 1 --2- 172.21.15.6:0/2779716685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72bc15c050 0x7f72bc0c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:57.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72bad9d640 1 -- 172.21.15.6:0/2779716685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72bc15c050 msgr2=0x7f72bc0c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:57.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72bad9d640 1 --2- 172.21.15.6:0/2779716685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72bc15c050 0x7f72bc0c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:57.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72bad9d640 1 -- 172.21.15.6:0/2779716685 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72bc0ce620 msgr2=0x7f72bc0c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:57.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72bad9d640 1 --2- 172.21.15.6:0/2779716685 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72bc0ce620 0x7f72bc0c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:57.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72bad9d640 1 -- 172.21.15.6:0/2779716685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a40094d0 con 0x7f72bc15fee0 2023-07-21T22:19:57.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72bad9d640 1 --2- 172.21.15.6:0/2779716685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72bc15fee0 0x7f72bc153a10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f72b400b9e0 tx=0x7f72b400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:57.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72b2ffd640 1 -- 172.21.15.6:0/2779716685 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4003b80 con 0x7f72bc15fee0 2023-07-21T22:19:57.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72b2ffd640 1 -- 172.21.15.6:0/2779716685 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b4003ce0 con 0x7f72bc15fee0 2023-07-21T22:19:57.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72c09d2640 1 -- 172.21.15.6:0/2779716685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72bc0c8cc0 con 0x7f72bc15fee0 2023-07-21T22:19:57.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72b2ffd640 1 -- 172.21.15.6:0/2779716685 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b400cb60 con 0x7f72bc15fee0 2023-07-21T22:19:57.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72c09d2640 1 -- 172.21.15.6:0/2779716685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72bc0c4bf0 con 0x7f72bc15fee0 2023-07-21T22:19:57.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72c09d2640 1 -- 172.21.15.6:0/2779716685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72bc0678d0 con 0x7f72bc15fee0 2023-07-21T22:19:57.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.879+0000 7f72b2ffd640 1 -- 172.21.15.6:0/2779716685 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f72b400ccc0 con 0x7f72bc15fee0 2023-07-21T22:19:57.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.883+0000 7f72b2ffd640 1 --2- 172.21.15.6:0/2779716685 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f729c0662b0 0x7f729c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:57.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.883+0000 7f72b2ffd640 1 -- 172.21.15.6:0/2779716685 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f72b4083980 con 0x7f72bc15fee0 2023-07-21T22:19:57.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.883+0000 7f72ba59c640 1 --2- 172.21.15.6:0/2779716685 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f729c0662b0 0x7f729c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:57.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.883+0000 7f72ba59c640 1 --2- 172.21.15.6:0/2779716685 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f729c0662b0 0x7f729c068760 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0d0340 tx=0x7f72ac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:57.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:57.887+0000 7f72b2ffd640 1 -- 172.21.15.6:0/2779716685 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72b4050ea0 con 0x7f72bc15fee0 2023-07-21T22:19:58.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.075+0000 7f72c09d2640 1 -- 172.21.15.6:0/2779716685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f72bc15fcc0 con 0x7f72bc15fee0 2023-07-21T22:19:58.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.547+0000 7f72b2ffd640 1 -- 172.21.15.6:0/2779716685 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 6) v1 ==== 85675+0+0 (secure 0 0 0) 0x7f72b4051270 con 0x7f72bc15fee0 2023-07-21T22:19:58.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.547+0000 7f72b2ffd640 1 -- 172.21.15.6:0/2779716685 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v6) v1 ==== 92+0+0 (secure 0 0 0) 0x7f72b4071840 con 0x7f72bc15fee0 2023-07-21T22:19:58.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.551+0000 7f72c09d2640 1 -- 172.21.15.6:0/2779716685 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f729c0662b0 msgr2=0x7f729c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:58.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.551+0000 7f72c09d2640 1 --2- 172.21.15.6:0/2779716685 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f729c0662b0 0x7f729c068760 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0d0340 tx=0x7f72ac008040 comp rx=0 tx=0).stop 2023-07-21T22:19:58.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.551+0000 7f72c09d2640 1 -- 172.21.15.6:0/2779716685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72bc15fee0 msgr2=0x7f72bc153a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:58.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.551+0000 7f72c09d2640 1 --2- 172.21.15.6:0/2779716685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72bc15fee0 0x7f72bc153a10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f72b400b9e0 tx=0x7f72b400bea0 comp rx=0 tx=0).stop 2023-07-21T22:19:58.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.551+0000 7f72c09d2640 1 -- 172.21.15.6:0/2779716685 shutdown_connections 2023-07-21T22:19:58.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.551+0000 7f72c09d2640 1 --2- 172.21.15.6:0/2779716685 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f729c0662b0 0x7f729c068760 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:58.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.551+0000 7f72c09d2640 1 --2- 172.21.15.6:0/2779716685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72bc15fee0 0x7f72bc153a10 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:58.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.551+0000 7f72c09d2640 1 --2- 172.21.15.6:0/2779716685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72bc15c050 0x7f72bc0c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:58.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.551+0000 7f72c09d2640 1 --2- 172.21.15.6:0/2779716685 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72bc0ce620 0x7f72bc0c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:58.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.551+0000 7f72c09d2640 1 -- 172.21.15.6:0/2779716685 >> 172.21.15.6:0/2779716685 conn(0x7f72bc0cc9a0 msgr2=0x7f72bc0c6360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:58.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.551+0000 7f72c09d2640 1 -- 172.21.15.6:0/2779716685 shutdown_connections 2023-07-21T22:19:58.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.551+0000 7f72c09d2640 1 -- 172.21.15.6:0/2779716685 wait complete. 2023-07-21T22:19:58.623 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-21T22:19:58.771 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:19:58.723+0000 7f9f52433180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:19:58.772 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:19:58.729+0000 7f34dcc47180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:19:58.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.731+0000 7fd4da6f9640 1 Processor -- start 2023-07-21T22:19:58.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.731+0000 7fd4da6f9640 1 -- start start 2023-07-21T22:19:58.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.731+0000 7fd4da6f9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd4d415bde0 0x7fd4d40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:58.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.731+0000 7fd4da6f9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4d40d2fc0 0x7fd4d40b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:58.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.731+0000 7fd4da6f9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4d40d2300 0x7fd4d40d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:58.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.731+0000 7fd4da6f9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d415c1b0 con 0x7fd4d40d2fc0 2023-07-21T22:19:58.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.731+0000 7fd4da6f9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d40d2cc0 con 0x7fd4d415bde0 2023-07-21T22:19:58.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.731+0000 7fd4da6f9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d40b04c0 con 0x7fd4d40d2300 2023-07-21T22:19:58.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.731+0000 7fd4cbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4d40d2fc0 0x7fd4d40b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:58.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.731+0000 7fd4cbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4d40d2fc0 0x7fd4d40b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54058/0 (socket says 172.21.15.6:54058) 2023-07-21T22:19:58.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.731+0000 7fd4cbfff640 1 -- 172.21.15.6:0/3489845351 learned_addr learned my addr 172.21.15.6:0/3489845351 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:58.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.731+0000 7fd4d8c96640 1 --2- 172.21.15.6:0/3489845351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4d40d2300 0x7fd4d40d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:58.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.731+0000 7fd4d3fff640 1 --2- 172.21.15.6:0/3489845351 >> v2:172.21.15.161:3300/0 conn(0x7fd4d415bde0 0x7fd4d40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:58.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.731+0000 7fd4cbfff640 1 -- 172.21.15.6:0/3489845351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4d40d2300 msgr2=0x7fd4d40d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:58.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.731+0000 7fd4cbfff640 1 --2- 172.21.15.6:0/3489845351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4d40d2300 0x7fd4d40d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:58.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.731+0000 7fd4cbfff640 1 -- 172.21.15.6:0/3489845351 >> v2:172.21.15.161:3300/0 conn(0x7fd4d415bde0 msgr2=0x7fd4d40d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:58.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.731+0000 7fd4cbfff640 1 --2- 172.21.15.6:0/3489845351 >> v2:172.21.15.161:3300/0 conn(0x7fd4d415bde0 0x7fd4d40d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:58.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.731+0000 7fd4cbfff640 1 -- 172.21.15.6:0/3489845351 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d40d0aa0 con 0x7fd4d40d2fc0 2023-07-21T22:19:58.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.735+0000 7fd4cbfff640 1 --2- 172.21.15.6:0/3489845351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4d40d2fc0 0x7fd4d40b0950 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd4d408b210 tx=0x7fd4bc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb9ec33d19f3eed server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:58.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.735+0000 7fd4d37fe640 1 -- 172.21.15.6:0/3489845351 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc0aa620 con 0x7fd4d40d2fc0 2023-07-21T22:19:58.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.735+0000 7fd4d37fe640 1 -- 172.21.15.6:0/3489845351 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc0aa780 con 0x7fd4d40d2fc0 2023-07-21T22:19:58.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.735+0000 7fd4d37fe640 1 -- 172.21.15.6:0/3489845351 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc0aab10 con 0x7fd4d40d2fc0 2023-07-21T22:19:58.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.735+0000 7fd4da6f9640 1 -- 172.21.15.6:0/3489845351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4d40d2fc0 msgr2=0x7fd4d40b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:58.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.735+0000 7fd4da6f9640 1 --2- 172.21.15.6:0/3489845351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4d40d2fc0 0x7fd4d40b0950 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd4d408b210 tx=0x7fd4bc01c500 comp rx=0 tx=0).stop 2023-07-21T22:19:58.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.735+0000 7fd4da6f9640 1 -- 172.21.15.6:0/3489845351 shutdown_connections 2023-07-21T22:19:58.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.735+0000 7fd4da6f9640 1 --2- 172.21.15.6:0/3489845351 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4d40d2300 0x7fd4d40d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:58.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.735+0000 7fd4da6f9640 1 --2- 172.21.15.6:0/3489845351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4d40d2fc0 0x7fd4d40b0950 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:58.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.735+0000 7fd4da6f9640 1 --2- 172.21.15.6:0/3489845351 >> v2:172.21.15.161:3300/0 conn(0x7fd4d415bde0 0x7fd4d40d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:58.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.735+0000 7fd4da6f9640 1 -- 172.21.15.6:0/3489845351 >> 172.21.15.6:0/3489845351 conn(0x7fd4d40659d0 msgr2=0x7fd4d409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:58.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.735+0000 7fd4da6f9640 1 -- 172.21.15.6:0/3489845351 shutdown_connections 2023-07-21T22:19:58.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.735+0000 7fd4da6f9640 1 -- 172.21.15.6:0/3489845351 wait complete. 2023-07-21T22:19:58.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.735+0000 7fd4da6f9640 1 Processor -- start 2023-07-21T22:19:58.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.735+0000 7fd4da6f9640 1 -- start start 2023-07-21T22:19:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4da6f9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4d40d2300 0x7fd4d415ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4da6f9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4d40d2fc0 0x7fd4d41593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4da6f9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4d415bde0 0x7fd4d4159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4da6f9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d41f5bf0 con 0x7fd4d40d2300 2023-07-21T22:19:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4da6f9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d415f140 con 0x7fd4d40d2fc0 2023-07-21T22:19:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4da6f9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d41f52c0 con 0x7fd4d415bde0 2023-07-21T22:19:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4d3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4d40d2300 0x7fd4d415ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4d3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4d40d2300 0x7fd4d415ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54062/0 (socket says 172.21.15.6:54062) 2023-07-21T22:19:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4d3fff640 1 -- 172.21.15.6:0/3883404739 learned_addr learned my addr 172.21.15.6:0/3883404739 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4cbfff640 1 --2- 172.21.15.6:0/3883404739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4d40d2fc0 0x7fd4d41593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4d8c96640 1 --2- 172.21.15.6:0/3883404739 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4d415bde0 0x7fd4d4159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4d3fff640 1 -- 172.21.15.6:0/3883404739 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4d415bde0 msgr2=0x7fd4d4159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4d3fff640 1 --2- 172.21.15.6:0/3883404739 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4d415bde0 0x7fd4d4159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4d3fff640 1 -- 172.21.15.6:0/3883404739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4d40d2fc0 msgr2=0x7fd4d41593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4d3fff640 1 --2- 172.21.15.6:0/3883404739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4d40d2fc0 0x7fd4d41593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4d3fff640 1 -- 172.21.15.6:0/3883404739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc0094d0 con 0x7fd4d40d2300 2023-07-21T22:19:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4d3fff640 1 --2- 172.21.15.6:0/3883404739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4d40d2300 0x7fd4d415ec00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd4c400d830 tx=0x7fd4c400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4d17fa640 1 -- 172.21.15.6:0/3883404739 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4018070 con 0x7fd4d40d2300 2023-07-21T22:19:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4d17fa640 1 -- 172.21.15.6:0/3883404739 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c40059a0 con 0x7fd4d40d2300 2023-07-21T22:19:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4d17fa640 1 -- 172.21.15.6:0/3883404739 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4005b50 con 0x7fd4d40d2300 2023-07-21T22:19:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4da6f9640 1 -- 172.21.15.6:0/3883404739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d41f55a0 con 0x7fd4d40d2300 2023-07-21T22:19:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4da6f9640 1 -- 172.21.15.6:0/3883404739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d40c8200 con 0x7fd4d40d2300 2023-07-21T22:19:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.739+0000 7fd4da6f9640 1 -- 172.21.15.6:0/3883404739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d40678d0 con 0x7fd4d40d2300 2023-07-21T22:19:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.743+0000 7fd4d17fa640 1 -- 172.21.15.6:0/3883404739 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 6) v1 ==== 85675+0+0 (secure 0 0 0) 0x7fd4c400b6c0 con 0x7fd4d40d2300 2023-07-21T22:19:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.743+0000 7fd4d17fa640 1 --2- 172.21.15.6:0/3883404739 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd4b4066300 0x7fd4b40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.743+0000 7fd4d17fa640 1 -- 172.21.15.6:0/3883404739 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd4c4083da0 con 0x7fd4d40d2300 2023-07-21T22:19:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.743+0000 7fd4cbfff640 1 -- 172.21.15.6:0/3883404739 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd4b4066300 msgr2=0x7fd4b40687b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3471136886 2023-07-21T22:19:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.743+0000 7fd4cbfff640 1 --2- 172.21.15.6:0/3883404739 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd4b4066300 0x7fd4b40687b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:19:58.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.747+0000 7fd4d17fa640 1 -- 172.21.15.6:0/3883404739 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd4c4051230 con 0x7fd4d40d2300 2023-07-21T22:19:58.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.903+0000 7fd4da6f9640 1 -- 172.21.15.6:0/3883404739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fd4d40d2870 con 0x7fd4d40d2300 2023-07-21T22:19:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.911+0000 7fd4d17fa640 1 -- 172.21.15.6:0/3883404739 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd4c4054850 con 0x7fd4d40d2300 2023-07-21T22:19:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.911+0000 7fd4da6f9640 1 -- 172.21.15.6:0/3883404739 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd4b4066300 msgr2=0x7fd4b40687b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:19:58.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.911+0000 7fd4da6f9640 1 --2- 172.21.15.6:0/3883404739 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd4b4066300 0x7fd4b40687b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:58.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.911+0000 7fd4da6f9640 1 -- 172.21.15.6:0/3883404739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4d40d2300 msgr2=0x7fd4d415ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:58.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.911+0000 7fd4da6f9640 1 --2- 172.21.15.6:0/3883404739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4d40d2300 0x7fd4d415ec00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd4c400d830 tx=0x7fd4c400dcf0 comp rx=0 tx=0).stop 2023-07-21T22:19:58.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.911+0000 7fd4da6f9640 1 -- 172.21.15.6:0/3883404739 shutdown_connections 2023-07-21T22:19:58.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.911+0000 7fd4da6f9640 1 --2- 172.21.15.6:0/3883404739 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4d415bde0 0x7fd4d4159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:58.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.911+0000 7fd4da6f9640 1 --2- 172.21.15.6:0/3883404739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4d40d2fc0 0x7fd4d41593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:58.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.911+0000 7fd4da6f9640 1 --2- 172.21.15.6:0/3883404739 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fd4b4066300 0x7fd4b40687b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:58.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.911+0000 7fd4da6f9640 1 --2- 172.21.15.6:0/3883404739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4d40d2300 0x7fd4d415ec00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:58.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.911+0000 7fd4da6f9640 1 -- 172.21.15.6:0/3883404739 >> 172.21.15.6:0/3883404739 conn(0x7fd4d40659d0 msgr2=0x7fd4d406afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:58.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.911+0000 7fd4da6f9640 1 -- 172.21.15.6:0/3883404739 shutdown_connections 2023-07-21T22:19:58.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:58.911+0000 7fd4da6f9640 1 -- 172.21.15.6:0/3883404739 wait complete. 2023-07-21T22:19:58.980 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-21T22:19:59.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.083+0000 7f9610d74640 1 Processor -- start 2023-07-21T22:19:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.083+0000 7f9610d74640 1 -- start start 2023-07-21T22:19:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.083+0000 7f9610d74640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f960c15bde0 0x7f960c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.083+0000 7f9610d74640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f960c0d2fc0 0x7f960c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:59.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.083+0000 7f9610d74640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f960c0d2300 0x7f960c0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:59.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.083+0000 7f9610d74640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960c0d2ce0 con 0x7f960c0d2300 2023-07-21T22:19:59.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.083+0000 7f9610d74640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960c15c1b0 con 0x7f960c0d2fc0 2023-07-21T22:19:59.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.083+0000 7f9610d74640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0b04c0 con 0x7f960c15bde0 2023-07-21T22:19:59.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.083+0000 7f960ad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f960c0d2300 0x7f960c0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:59.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.083+0000 7f960ad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f960c0d2300 0x7f960c0d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54076/0 (socket says 172.21.15.6:54076) 2023-07-21T22:19:59.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.083+0000 7f960ad9d640 1 -- 172.21.15.6:0/2794768515 learned_addr learned my addr 172.21.15.6:0/2794768515 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:59.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.083+0000 7f9609d9b640 1 --2- 172.21.15.6:0/2794768515 >> v2:172.21.15.161:3300/0 conn(0x7f960c0d2fc0 0x7f960c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:59.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.083+0000 7f960a59c640 1 --2- 172.21.15.6:0/2794768515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f960c15bde0 0x7f960c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:59.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.083+0000 7f960ad9d640 1 -- 172.21.15.6:0/2794768515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f960c15bde0 msgr2=0x7f960c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:59.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.083+0000 7f960ad9d640 1 --2- 172.21.15.6:0/2794768515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f960c15bde0 0x7f960c0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:59.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.083+0000 7f960ad9d640 1 -- 172.21.15.6:0/2794768515 >> v2:172.21.15.161:3300/0 conn(0x7f960c0d2fc0 msgr2=0x7f960c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:59.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.083+0000 7f960ad9d640 1 --2- 172.21.15.6:0/2794768515 >> v2:172.21.15.161:3300/0 conn(0x7f960c0d2fc0 0x7f960c0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:59.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.083+0000 7f960ad9d640 1 -- 172.21.15.6:0/2794768515 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c0d0aa0 con 0x7f960c0d2300 2023-07-21T22:19:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.087+0000 7f960ad9d640 1 --2- 172.21.15.6:0/2794768515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960c0d2300 0x7f960c0d27a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f960c08af30 tx=0x7f960401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1fb703fbd3aa4f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.087+0000 7f960959a640 1 -- 172.21.15.6:0/2794768515 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96040a5850 con 0x7f960c0d2300 2023-07-21T22:19:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.087+0000 7f960959a640 1 -- 172.21.15.6:0/2794768515 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96040a59b0 con 0x7f960c0d2300 2023-07-21T22:19:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.087+0000 7f960959a640 1 -- 172.21.15.6:0/2794768515 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96040a5d40 con 0x7f960c0d2300 2023-07-21T22:19:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.087+0000 7f9610d74640 1 -- 172.21.15.6:0/2794768515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960c0d2300 msgr2=0x7f960c0d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.087+0000 7f9610d74640 1 --2- 172.21.15.6:0/2794768515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960c0d2300 0x7f960c0d27a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f960c08af30 tx=0x7f960401c9d0 comp rx=0 tx=0).stop 2023-07-21T22:19:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.087+0000 7f9610d74640 1 -- 172.21.15.6:0/2794768515 shutdown_connections 2023-07-21T22:19:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.087+0000 7f9610d74640 1 --2- 172.21.15.6:0/2794768515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960c0d2300 0x7f960c0d27a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.087+0000 7f9610d74640 1 --2- 172.21.15.6:0/2794768515 >> v2:172.21.15.161:3300/0 conn(0x7f960c0d2fc0 0x7f960c0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.087+0000 7f9610d74640 1 --2- 172.21.15.6:0/2794768515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f960c15bde0 0x7f960c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.087+0000 7f9610d74640 1 -- 172.21.15.6:0/2794768515 >> 172.21.15.6:0/2794768515 conn(0x7f960c0659d0 msgr2=0x7f960c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.087+0000 7f9610d74640 1 -- 172.21.15.6:0/2794768515 shutdown_connections 2023-07-21T22:19:59.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.087+0000 7f9610d74640 1 -- 172.21.15.6:0/2794768515 wait complete. 2023-07-21T22:19:59.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f9610d74640 1 Processor -- start 2023-07-21T22:19:59.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f9610d74640 1 -- start start 2023-07-21T22:19:59.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f9610d74640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f960c0d2300 0x7f960c0b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:59.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f9610d74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960c0d2fc0 0x7f960c0b6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:59.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f9610d74640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f960c15bde0 0x7f960c0b7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:59.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f9610d74640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0b6200 con 0x7f960c0d2fc0 2023-07-21T22:19:59.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f9610d74640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0b4150 con 0x7f960c15bde0 2023-07-21T22:19:59.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f9610d74640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0b5580 con 0x7f960c0d2300 2023-07-21T22:19:59.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f9609d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960c0d2fc0 0x7f960c0b6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:59.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f9609d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960c0d2fc0 0x7f960c0b6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54084/0 (socket says 172.21.15.6:54084) 2023-07-21T22:19:59.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f9609d9b640 1 -- 172.21.15.6:0/3561891644 learned_addr learned my addr 172.21.15.6:0/3561891644 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:59.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f960a59c640 1 --2- 172.21.15.6:0/3561891644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f960c0d2300 0x7f960c0b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:59.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f960ad9d640 1 --2- 172.21.15.6:0/3561891644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f960c15bde0 0x7f960c0b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:59.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f9609d9b640 1 -- 172.21.15.6:0/3561891644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f960c0d2300 msgr2=0x7f960c0b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:59.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f9609d9b640 1 --2- 172.21.15.6:0/3561891644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f960c0d2300 0x7f960c0b3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:59.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f9609d9b640 1 -- 172.21.15.6:0/3561891644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f960c15bde0 msgr2=0x7f960c0b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:59.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f9609d9b640 1 --2- 172.21.15.6:0/3561891644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f960c15bde0 0x7f960c0b7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:59.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f9609d9b640 1 -- 172.21.15.6:0/3561891644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9604009b30 con 0x7f960c0d2fc0 2023-07-21T22:19:59.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f9609d9b640 1 --2- 172.21.15.6:0/3561891644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960c0d2fc0 0x7f960c0b6ad0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f960000e870 tx=0x7f960000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:59.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f95faffd640 1 -- 172.21.15.6:0/3561891644 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000ee60 con 0x7f960c0d2fc0 2023-07-21T22:19:59.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f95faffd640 1 -- 172.21.15.6:0/3561891644 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960000c940 con 0x7f960c0d2fc0 2023-07-21T22:19:59.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f95faffd640 1 -- 172.21.15.6:0/3561891644 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000ccf0 con 0x7f960c0d2fc0 2023-07-21T22:19:59.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f9610d74640 1 -- 172.21.15.6:0/3561891644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960c0b5860 con 0x7f960c0d2fc0 2023-07-21T22:19:59.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.091+0000 7f9610d74640 1 -- 172.21.15.6:0/3561891644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960c0b5e20 con 0x7f960c0d2fc0 2023-07-21T22:19:59.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.095+0000 7f9610d74640 1 -- 172.21.15.6:0/3561891644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960c0678d0 con 0x7f960c0d2fc0 2023-07-21T22:19:59.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.095+0000 7f95faffd640 1 -- 172.21.15.6:0/3561891644 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 6) v1 ==== 85675+0+0 (secure 0 0 0) 0x7f9600013470 con 0x7f960c0d2fc0 2023-07-21T22:19:59.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.095+0000 7f95faffd640 1 --2- 172.21.15.6:0/3561891644 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f95ec0662d0 0x7f95ec068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:59.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.095+0000 7f95faffd640 1 -- 172.21.15.6:0/3561891644 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9600083de0 con 0x7f960c0d2fc0 2023-07-21T22:19:59.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.095+0000 7f960a59c640 1 -- 172.21.15.6:0/3561891644 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f95ec0662d0 msgr2=0x7f95ec068780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3471136886 2023-07-21T22:19:59.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.095+0000 7f960a59c640 1 --2- 172.21.15.6:0/3561891644 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f95ec0662d0 0x7f95ec068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:19:59.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.099+0000 7f95faffd640 1 -- 172.21.15.6:0/3561891644 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9600051300 con 0x7f960c0d2fc0 2023-07-21T22:19:59.193 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:19:59.149+0000 7f34dcc47180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:19:59.222 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:19:59.175+0000 7f9f52433180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:19:59.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.259+0000 7f9610d74640 1 -- 172.21.15.6:0/3561891644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f960c0cf660 con 0x7f960c0d2fc0 2023-07-21T22:19:59.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.267+0000 7f95faffd640 1 -- 172.21.15.6:0/3561891644 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v12)=0 v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7f96000170c0 con 0x7f960c0d2fc0 2023-07-21T22:19:59.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.267+0000 7f9610d74640 1 -- 172.21.15.6:0/3561891644 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f95ec0662d0 msgr2=0x7f95ec068780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:19:59.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.267+0000 7f9610d74640 1 --2- 172.21.15.6:0/3561891644 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f95ec0662d0 0x7f95ec068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:59.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.267+0000 7f9610d74640 1 -- 172.21.15.6:0/3561891644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960c0d2fc0 msgr2=0x7f960c0b6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:59.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.267+0000 7f9610d74640 1 --2- 172.21.15.6:0/3561891644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960c0d2fc0 0x7f960c0b6ad0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f960000e870 tx=0x7f960000ed30 comp rx=0 tx=0).stop 2023-07-21T22:19:59.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.267+0000 7f9610d74640 1 -- 172.21.15.6:0/3561891644 shutdown_connections 2023-07-21T22:19:59.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.267+0000 7f9610d74640 1 --2- 172.21.15.6:0/3561891644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f960c15bde0 0x7f960c0b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:59.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.267+0000 7f9610d74640 1 --2- 172.21.15.6:0/3561891644 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7f95ec0662d0 0x7f95ec068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:59.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.267+0000 7f9610d74640 1 --2- 172.21.15.6:0/3561891644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f960c0d2fc0 0x7f960c0b6ad0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:59.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.267+0000 7f9610d74640 1 --2- 172.21.15.6:0/3561891644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f960c0d2300 0x7f960c0b3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:59.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.267+0000 7f9610d74640 1 -- 172.21.15.6:0/3561891644 >> 172.21.15.6:0/3561891644 conn(0x7f960c0659d0 msgr2=0x7f960c0cd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:59.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.267+0000 7f9610d74640 1 -- 172.21.15.6:0/3561891644 shutdown_connections 2023-07-21T22:19:59.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.267+0000 7f9610d74640 1 -- 172.21.15.6:0/3561891644 wait complete. 2023-07-21T22:19:59.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:59.335 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-21T22:19:59.344 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:19:59.297+0000 7f34dcc47180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:19:59.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:19:59.350 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2023-07-21T22:19:59.385 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:19:59.339+0000 7f9f52433180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:19:59.396 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir0 1M 2023-07-21T22:19:59.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.539+0000 7fe328ed5640 1 Processor -- start 2023-07-21T22:19:59.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.539+0000 7fe328ed5640 1 -- start start 2023-07-21T22:19:59.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.539+0000 7fe328ed5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe32415bb10 0x7fe3240ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:59.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.539+0000 7fe328ed5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3240ceaa0 con 0x7fe3240b11b0 2023-07-21T22:19:59.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.539+0000 7fe328ed5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3240ced80 con 0x7fe3240d03f0 2023-07-21T22:19:59.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.539+0000 7fe328ed5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3240ce690 con 0x7fe32415bb10 2023-07-21T22:19:59.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.539+0000 7fe322ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe3240b11b0 0x7fe3240cfce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58034/0 (socket says 172.21.15.6:58034) 2023-07-21T22:19:59.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.539+0000 7fe322ffd640 1 -- 172.21.15.6:0/3221195969 learned_addr learned my addr 172.21.15.6:0/3221195969 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:19:59.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.539+0000 7fe3237fe640 1 --2- 172.21.15.6:0/3221195969 >> v2:172.21.15.161:3300/0 conn(0x7fe32415bb10 0x7fe3240ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:59.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.539+0000 7fe3237fe640 1 -- 172.21.15.6:0/3221195969 >> v1:172.21.15.161:6789/0 conn(0x7fe3240d03f0 legacy=0x7fe3240aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:59.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.539+0000 7fe3227fc640 1 -- 172.21.15.6:0/3221195969 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146789394 0 0) 0x7fe3240ceaa0 con 0x7fe3240b11b0 2023-07-21T22:19:59.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.539+0000 7fe3237fe640 1 -- 172.21.15.6:0/3221195969 >> v1:172.21.15.6:6789/0 conn(0x7fe3240b11b0 legacy=0x7fe3240cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:59.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.539+0000 7fe3237fe640 1 -- 172.21.15.6:0/3221195969 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3240cf060 con 0x7fe32415bb10 2023-07-21T22:19:59.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.543+0000 7fe3237fe640 1 --2- 172.21.15.6:0/3221195969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe32415bb10 0x7fe3240ce150 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe314009740 tx=0x7fe31401c220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa51a32d221d468e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.543+0000 7fe3227fc640 1 -- 172.21.15.6:0/3221195969 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3140ab600 con 0x7fe32415bb10 2023-07-21T22:19:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.543+0000 7fe3227fc640 1 -- 172.21.15.6:0/3221195969 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3140a7050 con 0x7fe32415bb10 2023-07-21T22:19:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.543+0000 7fe3227fc640 1 -- 172.21.15.6:0/3221195969 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3140ab980 con 0x7fe32415bb10 2023-07-21T22:19:59.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.543+0000 7fe328ed5640 1 -- 172.21.15.6:0/3221195969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe32415bb10 msgr2=0x7fe3240ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:59.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.543+0000 7fe328ed5640 1 --2- 172.21.15.6:0/3221195969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe32415bb10 0x7fe3240ce150 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe314009740 tx=0x7fe31401c220 comp rx=0 tx=0).stop 2023-07-21T22:19:59.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.543+0000 7fe328ed5640 1 -- 172.21.15.6:0/3221195969 shutdown_connections 2023-07-21T22:19:59.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.543+0000 7fe328ed5640 1 --2- 172.21.15.6:0/3221195969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe32415bb10 0x7fe3240ce150 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:59.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.543+0000 7fe328ed5640 1 -- 172.21.15.6:0/3221195969 >> 172.21.15.6:0/3221195969 conn(0x7fe32409b480 msgr2=0x7fe3240d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:59.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.543+0000 7fe328ed5640 1 -- 172.21.15.6:0/3221195969 shutdown_connections 2023-07-21T22:19:59.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.543+0000 7fe328ed5640 1 -- 172.21.15.6:0/3221195969 wait complete. 2023-07-21T22:19:59.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.547+0000 7fe328ed5640 1 Processor -- start 2023-07-21T22:19:59.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.547+0000 7fe328ed5640 1 -- start start 2023-07-21T22:19:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.547+0000 7fe328ed5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3240b11b0 0x7fe3240b69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.547+0000 7fe328ed5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3240d03f0 0x7fe32415db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.547+0000 7fe328ed5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe32415bb10 0x7fe32415c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.547+0000 7fe328ed5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32415cae0 con 0x7fe3240b11b0 2023-07-21T22:19:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.547+0000 7fe328ed5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32415cdc0 con 0x7fe32415bb10 2023-07-21T22:19:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.547+0000 7fe328ed5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32415d0a0 con 0x7fe3240d03f0 2023-07-21T22:19:59.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.551+0000 7fe3237fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3240b11b0 0x7fe3240b69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:59.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.551+0000 7fe3237fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3240b11b0 0x7fe3240b69d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54096/0 (socket says 172.21.15.6:54096) 2023-07-21T22:19:59.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.551+0000 7fe3237fe640 1 -- 172.21.15.6:0/1498790521 learned_addr learned my addr 172.21.15.6:0/1498790521 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:19:59.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.551+0000 7fe322ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3240d03f0 0x7fe32415db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:59.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.551+0000 7fe323fff640 1 --2- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe32415bb10 0x7fe32415c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:59.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.551+0000 7fe3237fe640 1 -- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3240d03f0 msgr2=0x7fe32415db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:59.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.551+0000 7fe3237fe640 1 --2- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3240d03f0 0x7fe32415db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:59.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.551+0000 7fe3237fe640 1 -- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe32415bb10 msgr2=0x7fe32415c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:59.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.551+0000 7fe3237fe640 1 --2- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe32415bb10 0x7fe32415c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:59.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.551+0000 7fe3237fe640 1 -- 172.21.15.6:0/1498790521 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe314009420 con 0x7fe3240b11b0 2023-07-21T22:19:59.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.551+0000 7fe3237fe640 1 --2- 172.21.15.6:0/1498790521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3240b11b0 0x7fe3240b69d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe3140ae040 tx=0x7fe31401aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:59.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.551+0000 7fe30bfff640 1 -- 172.21.15.6:0/1498790521 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3140b7650 con 0x7fe3240b11b0 2023-07-21T22:19:59.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.551+0000 7fe30bfff640 1 -- 172.21.15.6:0/1498790521 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3140b77d0 con 0x7fe3240b11b0 2023-07-21T22:19:59.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.551+0000 7fe328ed5640 1 -- 172.21.15.6:0/1498790521 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32415d380 con 0x7fe3240b11b0 2023-07-21T22:19:59.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.551+0000 7fe30bfff640 1 -- 172.21.15.6:0/1498790521 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3140b7b80 con 0x7fe3240b11b0 2023-07-21T22:19:59.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.551+0000 7fe328ed5640 1 -- 172.21.15.6:0/1498790521 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3240b3670 con 0x7fe3240b11b0 2023-07-21T22:19:59.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.551+0000 7fe328ed5640 1 -- 172.21.15.6:0/1498790521 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3240cea60 con 0x7fe3240b11b0 2023-07-21T22:19:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.551+0000 7fe30bfff640 1 -- 172.21.15.6:0/1498790521 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 6) v1 ==== 85675+0+0 (secure 0 0 0) 0x7fe3140b7ce0 con 0x7fe3240b11b0 2023-07-21T22:19:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.555+0000 7fe30bfff640 1 --2- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe3100662d0 0x7fe310068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.555+0000 7fe30bfff640 1 -- 172.21.15.6:0/1498790521 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe31411e6b0 con 0x7fe3240b11b0 2023-07-21T22:19:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.555+0000 7fe322ffd640 1 -- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe3100662d0 msgr2=0x7fe310068780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3471136886 2023-07-21T22:19:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.555+0000 7fe322ffd640 1 --2- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe3100662d0 0x7fe310068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:19:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.559+0000 7fe30bfff640 1 -- 172.21.15.6:0/1498790521 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe3140ebb50 con 0x7fe3240b11b0 2023-07-21T22:19:59.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.731+0000 7fe328ed5640 1 -- 172.21.15.6:0/1498790521 --> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe32415cf30 con 0x7fe3100662d0 2023-07-21T22:19:59.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.759+0000 7fe322ffd640 1 -- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe3100662d0 msgr2=0x7fe310068780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3471136886 2023-07-21T22:19:59.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:19:59.759+0000 7fe322ffd640 1 --2- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe3100662d0 0x7fe310068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:19:59.824 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:19:59.777+0000 7f34dcc47180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:19:59.882 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:19:59.837+0000 7f34dcc47180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:19:59.900 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:19:59.851+0000 7f9f52433180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:19:59.937 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:19:59.893+0000 7f34dcc47180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:19:59.962 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:19:59.915+0000 7f9f52433180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:20:00.020 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:19:59.971+0000 7f9f52433180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:20:00.021 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:19:59.977+0000 7f34dcc47180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:20:00.083 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:00.037+0000 7f34dcc47180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:20:00.113 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:20:00.063+0000 7f9f52433180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:20:00.166 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:00.121+0000 7f34dcc47180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:20:00.172 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:20:00.123+0000 7f9f52433180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:20:00.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:00.163+0000 7fe322ffd640 1 -- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe3100662d0 msgr2=0x7fe310068780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3471136886 2023-07-21T22:20:00.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:00.163+0000 7fe322ffd640 1 --2- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe3100662d0 0x7fe310068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-21T22:20:00.223 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:00.177+0000 7f34dcc47180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:20:00.261 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:20:00.215+0000 7f9f52433180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:20:00.320 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:20:00.271+0000 7f9f52433180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:20:00.364 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:00.321+0000 7f34dcc47180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:20:00.421 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:00.377+0000 7f34dcc47180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:20:00.471 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:20:00.423+0000 7f9f52433180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:20:00.532 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:20:00.483+0000 7f9f52433180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:20:00.662 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:20:00.662 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:20:00.663 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:20:00.670 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:00.625+0000 7f34dcc47180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:20:00.786 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:20:00.786 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:20:00.786 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:20:00.795 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:20:00.747+0000 7f9f52433180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:20:00.804 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:00.757+0000 7f34dcc47180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:20:00.932 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:00.885+0000 7f34dcc47180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:20:00.938 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:20:00.891+0000 7f9f52433180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:20:01.002 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:00.957+0000 7f34dcc47180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:20:01.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:00.967+0000 7fe322ffd640 1 -- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe3100662d0 msgr2=0x7fe310068780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3471136886 2023-07-21T22:20:01.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:00.967+0000 7fe322ffd640 1 --2- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe3100662d0 0x7fe310068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-21T22:20:01.069 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:20:01.023+0000 7f9f52433180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:20:01.135 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:01.089+0000 7f34dcc47180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:20:01.143 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:20:01.095+0000 7f9f52433180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:20:01.284 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:20:01.235+0000 7f9f52433180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:20:01.669 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:01.625+0000 7f34dcc47180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:20:01.753 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:01.709+0000 7f34dcc47180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:20:01.853 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:20:01.807+0000 7f9f52433180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:20:01.904 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:01.861+0000 7f34dcc47180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:20:01.942 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:20:01.895+0000 7f9f52433180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:20:01.987 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:01.941+0000 7f34dcc47180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:20:02.097 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:20:02.047+0000 7f9f52433180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:20:02.184 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:20:02.135+0000 7f9f52433180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:20:02.255 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:02.209+0000 7f34dcc47180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:20:02.314 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:02.269+0000 7f34dcc47180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:20:02.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:02.279+0000 7fe30bfff640 1 -- 172.21.15.6:0/1498790521 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 7) v1 ==== 85386+0+0 (secure 0 0 0) 0x7fe3140ebf20 con 0x7fe3240b11b0 2023-07-21T22:20:02.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:02.279+0000 7fe30bfff640 1 -- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe3100662d0 msgr2=0x7fe310068780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:20:02.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:02.279+0000 7fe30bfff640 1 --2- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:6832/3471136886,v1:172.21.15.161:6833/3471136886] conn(0x7fe3100662d0 0x7fe310068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:02.467 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:02.421+0000 7f345eeb6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:20:02.468 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:02.421+0000 7f345eeb6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:20:02.468 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:02.421+0000 7f345eeb6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:20:02.468 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:02.421+0000 7f345eeb6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:20:02.468 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:02.421+0000 7f345eeb6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:20:02.469 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:02.425+0000 7f345beb0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:20:02.469 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:02.425+0000 7f345beb0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:20:02.469 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:02.425+0000 7f345beb0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:20:02.469 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:02.425+0000 7f345beb0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:20:02.469 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:20:02.425+0000 7f345beb0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:20:02.483 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:20:02.435+0000 7f9f52433180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:20:02.546 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:20:02.499+0000 7f9f52433180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:20:03.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.287+0000 7fe30bfff640 1 -- 172.21.15.6:0/1498790521 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mgrmap(e 8) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fe3140f3310 con 0x7fe3240b11b0 2023-07-21T22:20:03.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.287+0000 7fe30bfff640 1 --2- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fe310033bc0 0x7fe3100707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:03.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.287+0000 7fe30bfff640 1 -- 172.21.15.6:0/1498790521 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe32415cf30 con 0x7fe310033bc0 2023-07-21T22:20:03.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.287+0000 7fe322ffd640 1 --2- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fe310033bc0 0x7fe3100707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:03.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.299+0000 7fe322ffd640 1 --2- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fe310033bc0 0x7fe3100707a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe318007a90 tx=0x7fe3180079e0 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:03.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.379+0000 7fe30bfff640 1 -- 172.21.15.6:0/1498790521 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fe32415cf30 con 0x7fe310033bc0 2023-07-21T22:20:03.428 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule set for path /snap_test_dir1/dir0 2023-07-21T22:20:03.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.383+0000 7fe328ed5640 1 -- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fe310033bc0 msgr2=0x7fe3100707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:03.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.383+0000 7fe328ed5640 1 --2- 172.21.15.6:0/1498790521 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fe310033bc0 0x7fe3100707a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe318007a90 tx=0x7fe3180079e0 comp rx=0 tx=0).stop 2023-07-21T22:20:03.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.383+0000 7fe328ed5640 1 -- 172.21.15.6:0/1498790521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3240b11b0 msgr2=0x7fe3240b69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:03.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.383+0000 7fe328ed5640 1 --2- 172.21.15.6:0/1498790521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3240b11b0 0x7fe3240b69d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe3140ae040 tx=0x7fe31401aa60 comp rx=0 tx=0).stop 2023-07-21T22:20:03.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.383+0000 7fe323fff640 1 -- 172.21.15.6:0/1498790521 reap_dead start 2023-07-21T22:20:03.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.383+0000 7fe328ed5640 1 -- 172.21.15.6:0/1498790521 shutdown_connections 2023-07-21T22:20:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.383+0000 7fe328ed5640 1 -- 172.21.15.6:0/1498790521 >> 172.21.15.6:0/1498790521 conn(0x7fe32409b480 msgr2=0x7fe324155de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.383+0000 7fe328ed5640 1 -- 172.21.15.6:0/1498790521 shutdown_connections 2023-07-21T22:20:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.383+0000 7fe328ed5640 1 -- 172.21.15.6:0/1498790521 wait complete. 2023-07-21T22:20:03.450 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2023-07-21T22:20:03.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:20:03.451 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2023-07-21T22:20:03.463 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir1 1M 2023-07-21T22:20:03.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.611+0000 7fa23bcd8640 1 Processor -- start 2023-07-21T22:20:03.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.611+0000 7fa23bcd8640 1 -- start start 2023-07-21T22:20:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.611+0000 7fa23bcd8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2340aeb40 0x7fa23415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.611+0000 7fa23bcd8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa234159440 0x7fa2340c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.611+0000 7fa23bcd8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2341532b0 con 0x7fa2340aef10 2023-07-21T22:20:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.611+0000 7fa23bcd8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2340ca6f0 con 0x7fa2340aeb40 2023-07-21T22:20:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.611+0000 7fa23bcd8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2341599d0 con 0x7fa234159440 2023-07-21T22:20:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.611+0000 7fa239a74640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2340aeb40 0x7fa23415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.611+0000 7fa239a74640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2340aeb40 0x7fa23415cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54108/0 (socket says 172.21.15.6:54108) 2023-07-21T22:20:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.611+0000 7fa239a74640 1 -- 172.21.15.6:0/1786186508 learned_addr learned my addr 172.21.15.6:0/1786186508 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.611+0000 7fa23a275640 1 --2- 172.21.15.6:0/1786186508 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa234159440 0x7fa2340c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:03.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.611+0000 7fa239a74640 1 -- 172.21.15.6:0/1786186508 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa234159440 msgr2=0x7fa2340c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:03.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.611+0000 7fa239a74640 1 --2- 172.21.15.6:0/1786186508 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa234159440 0x7fa2340c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:03.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.611+0000 7fa239a74640 1 -- 172.21.15.6:0/1786186508 >> v1:172.21.15.161:6789/0 conn(0x7fa2340aef10 legacy=0x7fa234158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:03.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.611+0000 7fa239a74640 1 -- 172.21.15.6:0/1786186508 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa234159cb0 con 0x7fa2340aeb40 2023-07-21T22:20:03.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.615+0000 7fa239a74640 1 --2- 172.21.15.6:0/1786186508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2340aeb40 0x7fa23415cef0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa230009870 tx=0x7fa23001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee47b79393aece7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:03.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.615+0000 7fa238a72640 1 -- 172.21.15.6:0/1786186508 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2300ab680 con 0x7fa2340aeb40 2023-07-21T22:20:03.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.615+0000 7fa238a72640 1 -- 172.21.15.6:0/1786186508 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2300ab7e0 con 0x7fa2340aeb40 2023-07-21T22:20:03.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.615+0000 7fa238a72640 1 -- 172.21.15.6:0/1786186508 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2300abb70 con 0x7fa2340aeb40 2023-07-21T22:20:03.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.615+0000 7fa23bcd8640 1 -- 172.21.15.6:0/1786186508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2340aeb40 msgr2=0x7fa23415cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:03.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.615+0000 7fa23bcd8640 1 --2- 172.21.15.6:0/1786186508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2340aeb40 0x7fa23415cef0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa230009870 tx=0x7fa23001c480 comp rx=0 tx=0).stop 2023-07-21T22:20:03.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.615+0000 7fa23bcd8640 1 -- 172.21.15.6:0/1786186508 shutdown_connections 2023-07-21T22:20:03.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.615+0000 7fa23bcd8640 1 --2- 172.21.15.6:0/1786186508 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa234159440 0x7fa2340c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:03.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.615+0000 7fa23bcd8640 1 --2- 172.21.15.6:0/1786186508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2340aeb40 0x7fa23415cef0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:03.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.615+0000 7fa23bcd8640 1 -- 172.21.15.6:0/1786186508 >> 172.21.15.6:0/1786186508 conn(0x7fa2340cde90 msgr2=0x7fa2340ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:03.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.615+0000 7fa23bcd8640 1 -- 172.21.15.6:0/1786186508 shutdown_connections 2023-07-21T22:20:03.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.615+0000 7fa23bcd8640 1 -- 172.21.15.6:0/1786186508 wait complete. 2023-07-21T22:20:03.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa23bcd8640 1 Processor -- start 2023-07-21T22:20:03.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa23bcd8640 1 -- start start 2023-07-21T22:20:03.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa23bcd8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2340aeb40 0x7fa234158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:03.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa23bcd8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2340aef10 0x7fa2341506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa23bcd8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa234159440 0x7fa23415ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa23bcd8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa234156bd0 con 0x7fa2340aef10 2023-07-21T22:20:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa23bcd8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa234158870 con 0x7fa2340aeb40 2023-07-21T22:20:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa23bcd8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23406c9f0 con 0x7fa234159440 2023-07-21T22:20:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa239273640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2340aef10 0x7fa2341506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa239a74640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2340aeb40 0x7fa234158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa239273640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2340aef10 0x7fa2341506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54110/0 (socket says 172.21.15.6:54110) 2023-07-21T22:20:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa239273640 1 -- 172.21.15.6:0/642713476 learned_addr learned my addr 172.21.15.6:0/642713476 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa23a275640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa234159440 0x7fa23415ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa239273640 1 -- 172.21.15.6:0/642713476 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa234159440 msgr2=0x7fa23415ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa239273640 1 --2- 172.21.15.6:0/642713476 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa234159440 0x7fa23415ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa239273640 1 -- 172.21.15.6:0/642713476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2340aeb40 msgr2=0x7fa234158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa239273640 1 --2- 172.21.15.6:0/642713476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2340aeb40 0x7fa234158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa239273640 1 -- 172.21.15.6:0/642713476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2300094d0 con 0x7fa2340aef10 2023-07-21T22:20:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa239273640 1 --2- 172.21.15.6:0/642713476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2340aef10 0x7fa2341506e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa22400c420 tx=0x7fa22400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa22a7fc640 1 -- 172.21.15.6:0/642713476 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2240052d0 con 0x7fa2340aef10 2023-07-21T22:20:03.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa22a7fc640 1 -- 172.21.15.6:0/642713476 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa224005430 con 0x7fa2340aef10 2023-07-21T22:20:03.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa22a7fc640 1 -- 172.21.15.6:0/642713476 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224007260 con 0x7fa2340aef10 2023-07-21T22:20:03.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa23bcd8640 1 -- 172.21.15.6:0/642713476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23406c150 con 0x7fa2340aef10 2023-07-21T22:20:03.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.619+0000 7fa23bcd8640 1 -- 172.21.15.6:0/642713476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23406c710 con 0x7fa2340aef10 2023-07-21T22:20:03.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.623+0000 7fa23bcd8640 1 -- 172.21.15.6:0/642713476 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa234156d40 con 0x7fa2340aef10 2023-07-21T22:20:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.623+0000 7fa22a7fc640 1 -- 172.21.15.6:0/642713476 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fa2240073c0 con 0x7fa2340aef10 2023-07-21T22:20:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.623+0000 7fa22a7fc640 1 --2- 172.21.15.6:0/642713476 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fa218066120 0x7fa2180685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.623+0000 7fa22a7fc640 1 -- 172.21.15.6:0/642713476 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fa224082e00 con 0x7fa2340aef10 2023-07-21T22:20:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.623+0000 7fa239a74640 1 --2- 172.21.15.6:0/642713476 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fa218066120 0x7fa2180685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.623+0000 7fa239a74640 1 --2- 172.21.15.6:0/642713476 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fa218066120 0x7fa2180685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa2300af000 tx=0x7fa2300b6040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:03.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.627+0000 7fa22a7fc640 1 -- 172.21.15.6:0/642713476 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa234156d40 con 0x7fa2340aef10 2023-07-21T22:20:03.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.799+0000 7fa23bcd8640 1 -- 172.21.15.6:0/642713476 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa23415c9d0 con 0x7fa218066120 2023-07-21T22:20:03.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.863+0000 7fa22a7fc640 1 -- 172.21.15.6:0/642713476 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fa2300ab950 con 0x7fa218066120 2023-07-21T22:20:03.911 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule set for path /snap_test_dir1/dir1 2023-07-21T22:20:03.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.863+0000 7fa23bcd8640 1 -- 172.21.15.6:0/642713476 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fa218066120 msgr2=0x7fa2180685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:03.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.863+0000 7fa23bcd8640 1 --2- 172.21.15.6:0/642713476 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fa218066120 0x7fa2180685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa2300af000 tx=0x7fa2300b6040 comp rx=0 tx=0).stop 2023-07-21T22:20:03.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.863+0000 7fa23bcd8640 1 -- 172.21.15.6:0/642713476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2340aef10 msgr2=0x7fa2341506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:03.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.863+0000 7fa23bcd8640 1 --2- 172.21.15.6:0/642713476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2340aef10 0x7fa2341506e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa22400c420 tx=0x7fa22400c8e0 comp rx=0 tx=0).stop 2023-07-21T22:20:03.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.863+0000 7fa23bcd8640 1 -- 172.21.15.6:0/642713476 shutdown_connections 2023-07-21T22:20:03.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.863+0000 7fa23bcd8640 1 --2- 172.21.15.6:0/642713476 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fa218066120 0x7fa2180685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:03.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.863+0000 7fa23bcd8640 1 --2- 172.21.15.6:0/642713476 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa234159440 0x7fa23415ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:03.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.863+0000 7fa23bcd8640 1 --2- 172.21.15.6:0/642713476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2340aef10 0x7fa2341506e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:03.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.863+0000 7fa23bcd8640 1 --2- 172.21.15.6:0/642713476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2340aeb40 0x7fa234158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:03.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.863+0000 7fa23bcd8640 1 -- 172.21.15.6:0/642713476 >> 172.21.15.6:0/642713476 conn(0x7fa2340cde90 msgr2=0x7fa2340c3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:03.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.863+0000 7fa23bcd8640 1 -- 172.21.15.6:0/642713476 shutdown_connections 2023-07-21T22:20:03.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:03.863+0000 7fa23bcd8640 1 -- 172.21.15.6:0/642713476 wait complete. 2023-07-21T22:20:03.932 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2023-07-21T22:20:03.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:20:03.932 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2023-07-21T22:20:03.945 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir2 1M 2023-07-21T22:20:04.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.083+0000 7f503c340640 1 Processor -- start 2023-07-21T22:20:04.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.083+0000 7f503c340640 1 -- start start 2023-07-21T22:20:04.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f503c340640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5034069430 0x7f5034069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:04.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f503c340640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5034159d70 con 0x7f5034070f30 2023-07-21T22:20:04.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f503c340640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5034069d40 con 0x7f50340af2b0 2023-07-21T22:20:04.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f503c340640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50340c9c60 con 0x7f5034069430 2023-07-21T22:20:04.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50398db640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5034070f30 0x7f50340ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58046/0 (socket says 172.21.15.6:58046) 2023-07-21T22:20:04.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50398db640 1 -- 172.21.15.6:0/725887370 learned_addr learned my addr 172.21.15.6:0/725887370 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:20:04.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f503a0dc640 1 --2- 172.21.15.6:0/725887370 >> v2:172.21.15.161:3300/0 conn(0x7f5034069430 0x7f5034069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:04.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50390da640 1 -- 172.21.15.6:0/725887370 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497823523 0 0) 0x7f5024001120 con 0x7f5034070f30 2023-07-21T22:20:04.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50390da640 1 -- 172.21.15.6:0/725887370 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5020003530 con 0x7f5034070f30 2023-07-21T22:20:04.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50390da640 1 -- 172.21.15.6:0/725887370 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2669654630 0 0) 0x7f5034069d40 con 0x7f50340af2b0 2023-07-21T22:20:04.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50390da640 1 -- 172.21.15.6:0/725887370 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5024001120 con 0x7f50340af2b0 2023-07-21T22:20:04.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50390da640 1 -- 172.21.15.6:0/725887370 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3395406547 0 0) 0x7f5020003530 con 0x7f5034070f30 2023-07-21T22:20:04.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50390da640 1 -- 172.21.15.6:0/725887370 >> v2:172.21.15.161:3300/0 conn(0x7f5034069430 msgr2=0x7f5034069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:04.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50390da640 1 --2- 172.21.15.6:0/725887370 >> v2:172.21.15.161:3300/0 conn(0x7f5034069430 0x7f5034069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50390da640 1 -- 172.21.15.6:0/725887370 >> v1:172.21.15.161:6789/0 conn(0x7f50340af2b0 legacy=0x7f503415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:04.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50390da640 1 -- 172.21.15.6:0/725887370 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50340c9f40 con 0x7f5034070f30 2023-07-21T22:20:04.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50390da640 1 -- 172.21.15.6:0/725887370 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f5024001790 con 0x7f5034070f30 2023-07-21T22:20:04.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50390da640 1 -- 172.21.15.6:0/725887370 >> v1:172.21.15.6:6789/0 conn(0x7f5034070f30 legacy=0x7f50340ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:04.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50390da640 1 --2- 172.21.15.6:0/725887370 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5020003b60 0x7f5020003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:04.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50390da640 1 --2- 172.21.15.6:0/725887370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50200047d0 0x7f5020004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:04.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50390da640 1 --2- 172.21.15.6:0/725887370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5020005180 0x7f502000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:04.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50390da640 1 -- 172.21.15.6:0/725887370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340c9c60 con 0x7f50200047d0 2023-07-21T22:20:04.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50390da640 1 -- 172.21.15.6:0/725887370 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502000c060 con 0x7f5020005180 2023-07-21T22:20:04.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50390da640 1 -- 172.21.15.6:0/725887370 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502000c1f0 con 0x7f5020003b60 2023-07-21T22:20:04.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50398db640 1 --2- 172.21.15.6:0/725887370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50200047d0 0x7f5020004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:04.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f503a0dc640 1 --2- 172.21.15.6:0/725887370 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5020003b60 0x7f5020003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:04.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f503a8dd640 1 --2- 172.21.15.6:0/725887370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5020005180 0x7f502000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:04.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50398db640 1 -- 172.21.15.6:0/725887370 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5020003b60 msgr2=0x7f5020003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:04.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50398db640 1 --2- 172.21.15.6:0/725887370 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5020003b60 0x7f5020003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50398db640 1 -- 172.21.15.6:0/725887370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5020005180 msgr2=0x7f502000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:04.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50398db640 1 --2- 172.21.15.6:0/725887370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5020005180 0x7f502000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f503a8dd640 1 -- 172.21.15.6:0/725887370 reap_dead start 2023-07-21T22:20:04.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.087+0000 7f50398db640 1 -- 172.21.15.6:0/725887370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5020003530 con 0x7f50200047d0 2023-07-21T22:20:04.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.091+0000 7f50398db640 1 --2- 172.21.15.6:0/725887370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50200047d0 0x7f5020004c40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5024007ee0 tx=0x7f502401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8649ca0613b7cd06 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:04.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.091+0000 7f50390da640 1 -- 172.21.15.6:0/725887370 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5024005ae0 con 0x7f50200047d0 2023-07-21T22:20:04.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.091+0000 7f50390da640 1 -- 172.21.15.6:0/725887370 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5024005c40 con 0x7f50200047d0 2023-07-21T22:20:04.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.091+0000 7f50390da640 1 -- 172.21.15.6:0/725887370 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5024007070 con 0x7f50200047d0 2023-07-21T22:20:04.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.091+0000 7f503c340640 1 -- 172.21.15.6:0/725887370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50200047d0 msgr2=0x7f5020004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:04.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.091+0000 7f503c340640 1 --2- 172.21.15.6:0/725887370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50200047d0 0x7f5020004c40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5024007ee0 tx=0x7f502401ca20 comp rx=0 tx=0).stop 2023-07-21T22:20:04.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.091+0000 7f503c340640 1 -- 172.21.15.6:0/725887370 shutdown_connections 2023-07-21T22:20:04.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.091+0000 7f503c340640 1 --2- 172.21.15.6:0/725887370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50200047d0 0x7f5020004c40 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.091+0000 7f503c340640 1 -- 172.21.15.6:0/725887370 >> 172.21.15.6:0/725887370 conn(0x7f50340cde90 msgr2=0x7f50340ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:04.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.091+0000 7f503c340640 1 -- 172.21.15.6:0/725887370 shutdown_connections 2023-07-21T22:20:04.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.091+0000 7f503c340640 1 -- 172.21.15.6:0/725887370 wait complete. 2023-07-21T22:20:04.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503c340640 1 Processor -- start 2023-07-21T22:20:04.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503c340640 1 -- start start 2023-07-21T22:20:04.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503c340640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50200047d0 0x7f503414eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:04.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503c340640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50340b3b60 0x7f50340b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:04.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503c340640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50340b2540 0x7f5034151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:04.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503c340640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340b2ac0 con 0x7f50200047d0 2023-07-21T22:20:04.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503c340640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340b2da0 con 0x7f50340b3b60 2023-07-21T22:20:04.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503c340640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50340b3080 con 0x7f50340b2540 2023-07-21T22:20:04.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503a0dc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50200047d0 0x7f503414eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:04.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503a0dc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50200047d0 0x7f503414eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54140/0 (socket says 172.21.15.6:54140) 2023-07-21T22:20:04.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503a0dc640 1 -- 172.21.15.6:0/3334018542 learned_addr learned my addr 172.21.15.6:0/3334018542 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:04.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f50398db640 1 --2- 172.21.15.6:0/3334018542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50340b3b60 0x7f50340b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:04.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503a8dd640 1 --2- 172.21.15.6:0/3334018542 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50340b2540 0x7f5034151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:04.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503a0dc640 1 -- 172.21.15.6:0/3334018542 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50340b2540 msgr2=0x7f5034151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:04.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503a0dc640 1 --2- 172.21.15.6:0/3334018542 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50340b2540 0x7f5034151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503a0dc640 1 -- 172.21.15.6:0/3334018542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50340b3b60 msgr2=0x7f50340b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:04.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503a0dc640 1 --2- 172.21.15.6:0/3334018542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50340b3b60 0x7f50340b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503a0dc640 1 -- 172.21.15.6:0/3334018542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50340b3360 con 0x7f50200047d0 2023-07-21T22:20:04.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503a0dc640 1 --2- 172.21.15.6:0/3334018542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50200047d0 0x7f503414eb20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5030011900 tx=0x7f50300119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f502affd640 1 -- 172.21.15.6:0/3334018542 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030004240 con 0x7f50200047d0 2023-07-21T22:20:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f502affd640 1 -- 172.21.15.6:0/3334018542 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50300043a0 con 0x7f50200047d0 2023-07-21T22:20:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503c340640 1 -- 172.21.15.6:0/3334018542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50340b3640 con 0x7f50200047d0 2023-07-21T22:20:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f502affd640 1 -- 172.21.15.6:0/3334018542 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5030003860 con 0x7f50200047d0 2023-07-21T22:20:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503c340640 1 -- 172.21.15.6:0/3334018542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5034151e60 con 0x7f50200047d0 2023-07-21T22:20:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.095+0000 7f503c340640 1 -- 172.21.15.6:0/3334018542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50340ae940 con 0x7f50200047d0 2023-07-21T22:20:04.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.099+0000 7f502affd640 1 -- 172.21.15.6:0/3334018542 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f50300039c0 con 0x7f50200047d0 2023-07-21T22:20:04.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.099+0000 7f502affd640 1 --2- 172.21.15.6:0/3334018542 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f5018066150 0x7f5018068600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:04.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.099+0000 7f502affd640 1 -- 172.21.15.6:0/3334018542 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f5030083d00 con 0x7f50200047d0 2023-07-21T22:20:04.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.099+0000 7f50398db640 1 --2- 172.21.15.6:0/3334018542 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f5018066150 0x7f5018068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:04.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.099+0000 7f50398db640 1 --2- 172.21.15.6:0/3334018542 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f5018066150 0x7f5018068600 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f50240ab000 tx=0x7f50240b1040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:04.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.103+0000 7f502affd640 1 -- 172.21.15.6:0/3334018542 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5030051340 con 0x7f50200047d0 2023-07-21T22:20:04.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.279+0000 7f503c340640 1 -- 172.21.15.6:0/3334018542 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f50340b2f10 con 0x7f5018066150 2023-07-21T22:20:04.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.339+0000 7f502affd640 1 -- 172.21.15.6:0/3334018542 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f5030051710 con 0x7f50200047d0 2023-07-21T22:20:04.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.355+0000 7f502affd640 1 -- 172.21.15.6:0/3334018542 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f50340b2f10 con 0x7f5018066150 2023-07-21T22:20:04.404 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule set for path /snap_test_dir1/dir2 2023-07-21T22:20:04.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.359+0000 7f503c340640 1 -- 172.21.15.6:0/3334018542 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f5018066150 msgr2=0x7f5018068600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:04.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.359+0000 7f503c340640 1 --2- 172.21.15.6:0/3334018542 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f5018066150 0x7f5018068600 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f50240ab000 tx=0x7f50240b1040 comp rx=0 tx=0).stop 2023-07-21T22:20:04.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.359+0000 7f503c340640 1 -- 172.21.15.6:0/3334018542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50200047d0 msgr2=0x7f503414eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.359+0000 7f503c340640 1 --2- 172.21.15.6:0/3334018542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50200047d0 0x7f503414eb20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5030011900 tx=0x7f50300119f0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.359+0000 7f503c340640 1 -- 172.21.15.6:0/3334018542 shutdown_connections 2023-07-21T22:20:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.359+0000 7f503c340640 1 --2- 172.21.15.6:0/3334018542 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f5018066150 0x7f5018068600 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.359+0000 7f503c340640 1 --2- 172.21.15.6:0/3334018542 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f50340b2540 0x7f5034151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.359+0000 7f503c340640 1 --2- 172.21.15.6:0/3334018542 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50340b3b60 0x7f50340b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.359+0000 7f503c340640 1 --2- 172.21.15.6:0/3334018542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50200047d0 0x7f503414eb20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.359+0000 7f503c340640 1 -- 172.21.15.6:0/3334018542 >> 172.21.15.6:0/3334018542 conn(0x7f50340cde90 msgr2=0x7f503406f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:04.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.359+0000 7f503c340640 1 -- 172.21.15.6:0/3334018542 shutdown_connections 2023-07-21T22:20:04.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.359+0000 7f503c340640 1 -- 172.21.15.6:0/3334018542 wait complete. 2023-07-21T22:20:04.425 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2023-07-21T22:20:04.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:20:04.426 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2023-07-21T22:20:04.437 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir3 1M 2023-07-21T22:20:04.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.579+0000 7f89ec05c640 1 Processor -- start 2023-07-21T22:20:04.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.583+0000 7f89ec05c640 1 -- start start 2023-07-21T22:20:04.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.583+0000 7f89ec05c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89e40c2d30 0x7f89e40c4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.583+0000 7f89ec05c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e415bf70 con 0x7f89e40ad450 2023-07-21T22:20:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.583+0000 7f89ec05c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e41600e0 con 0x7f89e415bba0 2023-07-21T22:20:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.583+0000 7f89ec05c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40c4d00 con 0x7f89e40c2d30 2023-07-21T22:20:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.583+0000 7f89e95f7640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f89e40ad450 0x7f89e40ad930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58048/0 (socket says 172.21.15.6:58048) 2023-07-21T22:20:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.583+0000 7f89e95f7640 1 -- 172.21.15.6:0/2840183055 learned_addr learned my addr 172.21.15.6:0/2840183055 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:20:04.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.583+0000 7f89ea5f9640 1 --2- 172.21.15.6:0/2840183055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89e40c2d30 0x7f89e40c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:04.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.583+0000 7f89e8df6640 1 -- 172.21.15.6:0/2840183055 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885285986 0 0) 0x7f89e415bf70 con 0x7f89e40ad450 2023-07-21T22:20:04.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.583+0000 7f89e8df6640 1 -- 172.21.15.6:0/2840183055 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89d0003530 con 0x7f89e40ad450 2023-07-21T22:20:04.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.583+0000 7f89e8df6640 1 -- 172.21.15.6:0/2840183055 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3900947862 0 0) 0x7f89e41600e0 con 0x7f89e415bba0 2023-07-21T22:20:04.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.583+0000 7f89e8df6640 1 -- 172.21.15.6:0/2840183055 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89e415bf70 con 0x7f89e415bba0 2023-07-21T22:20:04.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.583+0000 7f89ea5f9640 1 -- 172.21.15.6:0/2840183055 >> v1:172.21.15.161:6789/0 conn(0x7f89e415bba0 legacy=0x7f89e40acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:04.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.583+0000 7f89ea5f9640 1 -- 172.21.15.6:0/2840183055 >> v1:172.21.15.6:6789/0 conn(0x7f89e40ad450 legacy=0x7f89e40ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:04.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.583+0000 7f89ea5f9640 1 -- 172.21.15.6:0/2840183055 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e4160570 con 0x7f89e40c2d30 2023-07-21T22:20:04.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.587+0000 7f89ea5f9640 1 --2- 172.21.15.6:0/2840183055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89e40c2d30 0x7f89e40c4620 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009dc0 tx=0x7f89dc01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=875ad63b9be4b615 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:04.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.587+0000 7f89e8df6640 1 -- 172.21.15.6:0/2840183055 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc0a5970 con 0x7f89e40c2d30 2023-07-21T22:20:04.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.587+0000 7f89e8df6640 1 -- 172.21.15.6:0/2840183055 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89dc0a5ad0 con 0x7f89e40c2d30 2023-07-21T22:20:04.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.587+0000 7f89e8df6640 1 -- 172.21.15.6:0/2840183055 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc0a5e60 con 0x7f89e40c2d30 2023-07-21T22:20:04.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.587+0000 7f89ec05c640 1 -- 172.21.15.6:0/2840183055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89e40c2d30 msgr2=0x7f89e40c4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:04.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.587+0000 7f89ec05c640 1 --2- 172.21.15.6:0/2840183055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89e40c2d30 0x7f89e40c4620 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009dc0 tx=0x7f89dc01c8b0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.587+0000 7f89ec05c640 1 -- 172.21.15.6:0/2840183055 shutdown_connections 2023-07-21T22:20:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.587+0000 7f89ec05c640 1 --2- 172.21.15.6:0/2840183055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89e40c2d30 0x7f89e40c4620 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.587+0000 7f89ec05c640 1 -- 172.21.15.6:0/2840183055 >> 172.21.15.6:0/2840183055 conn(0x7f89e40cde90 msgr2=0x7f89e40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.587+0000 7f89ec05c640 1 -- 172.21.15.6:0/2840183055 shutdown_connections 2023-07-21T22:20:04.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.587+0000 7f89ec05c640 1 -- 172.21.15.6:0/2840183055 wait complete. 2023-07-21T22:20:04.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89ec05c640 1 Processor -- start 2023-07-21T22:20:04.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89ec05c640 1 -- start start 2023-07-21T22:20:04.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89ec05c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e40ad450 0x7f89e40b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:04.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89ec05c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89e40c2d30 0x7f89e4069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:04.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89ec05c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89e415bba0 0x7f89e414f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:04.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89ec05c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e406d170 con 0x7f89e40ad450 2023-07-21T22:20:04.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89ec05c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e4152ad0 con 0x7f89e415bba0 2023-07-21T22:20:04.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89ec05c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40b3da0 con 0x7f89e40c2d30 2023-07-21T22:20:04.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89e9df8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e40ad450 0x7f89e40b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:04.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89e9df8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e40ad450 0x7f89e40b36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54154/0 (socket says 172.21.15.6:54154) 2023-07-21T22:20:04.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89e9df8640 1 -- 172.21.15.6:0/207802252 learned_addr learned my addr 172.21.15.6:0/207802252 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:04.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89ea5f9640 1 --2- 172.21.15.6:0/207802252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89e415bba0 0x7f89e414f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:04.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89e95f7640 1 --2- 172.21.15.6:0/207802252 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89e40c2d30 0x7f89e4069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:04.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89e9df8640 1 -- 172.21.15.6:0/207802252 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89e40c2d30 msgr2=0x7f89e4069690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:04.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89e9df8640 1 --2- 172.21.15.6:0/207802252 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89e40c2d30 0x7f89e4069690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89e9df8640 1 -- 172.21.15.6:0/207802252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89e415bba0 msgr2=0x7f89e414f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89e9df8640 1 --2- 172.21.15.6:0/207802252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89e415bba0 0x7f89e414f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89e9df8640 1 -- 172.21.15.6:0/207802252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc009a70 con 0x7f89e40ad450 2023-07-21T22:20:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89ea5f9640 1 --2- 172.21.15.6:0/207802252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89e415bba0 0x7f89e414f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89e9df8640 1 --2- 172.21.15.6:0/207802252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e40ad450 0x7f89e40b36e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f89e000c490 tx=0x7f89e000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89da7fc640 1 -- 172.21.15.6:0/207802252 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e00052d0 con 0x7f89e40ad450 2023-07-21T22:20:04.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89da7fc640 1 -- 172.21.15.6:0/207802252 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e0005430 con 0x7f89e40ad450 2023-07-21T22:20:04.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89da7fc640 1 -- 172.21.15.6:0/207802252 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0012870 con 0x7f89e40ad450 2023-07-21T22:20:04.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89ec05c640 1 -- 172.21.15.6:0/207802252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e406c7d0 con 0x7f89e40ad450 2023-07-21T22:20:04.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89ec05c640 1 -- 172.21.15.6:0/207802252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e406cd90 con 0x7f89e40ad450 2023-07-21T22:20:04.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.591+0000 7f89ec05c640 1 -- 172.21.15.6:0/207802252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e406d2b0 con 0x7f89e40ad450 2023-07-21T22:20:04.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.595+0000 7f89da7fc640 1 -- 172.21.15.6:0/207802252 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f89e00129d0 con 0x7f89e40ad450 2023-07-21T22:20:04.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.595+0000 7f89da7fc640 1 --2- 172.21.15.6:0/207802252 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f89c8066480 0x7f89c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:04.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.595+0000 7f89da7fc640 1 -- 172.21.15.6:0/207802252 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f89e0083d80 con 0x7f89e40ad450 2023-07-21T22:20:04.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.595+0000 7f89e95f7640 1 --2- 172.21.15.6:0/207802252 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f89c8066480 0x7f89c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:04.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.595+0000 7f89e95f7640 1 --2- 172.21.15.6:0/207802252 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f89c8066480 0x7f89c8068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f89e40c4890 tx=0x7f89d4009040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:04.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.599+0000 7f89da7fc640 1 -- 172.21.15.6:0/207802252 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f89e0050e90 con 0x7f89e40ad450 2023-07-21T22:20:04.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.775+0000 7f89ec05c640 1 -- 172.21.15.6:0/207802252 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f89e40b1ab0 con 0x7f89c8066480 2023-07-21T22:20:04.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.851+0000 7f89da7fc640 1 -- 172.21.15.6:0/207802252 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f89e40b1ab0 con 0x7f89c8066480 2023-07-21T22:20:04.900 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule set for path /snap_test_dir1/dir3 2023-07-21T22:20:04.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.855+0000 7f89ec05c640 1 -- 172.21.15.6:0/207802252 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f89c8066480 msgr2=0x7f89c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:04.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.855+0000 7f89ec05c640 1 --2- 172.21.15.6:0/207802252 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f89c8066480 0x7f89c8068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f89e40c4890 tx=0x7f89d4009040 comp rx=0 tx=0).stop 2023-07-21T22:20:04.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.855+0000 7f89ec05c640 1 -- 172.21.15.6:0/207802252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e40ad450 msgr2=0x7f89e40b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:04.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.855+0000 7f89ec05c640 1 --2- 172.21.15.6:0/207802252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e40ad450 0x7f89e40b36e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f89e000c490 tx=0x7f89e000c950 comp rx=0 tx=0).stop 2023-07-21T22:20:04.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.855+0000 7f89ec05c640 1 -- 172.21.15.6:0/207802252 shutdown_connections 2023-07-21T22:20:04.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.855+0000 7f89ec05c640 1 --2- 172.21.15.6:0/207802252 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f89c8066480 0x7f89c8068930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.855+0000 7f89ec05c640 1 --2- 172.21.15.6:0/207802252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89e415bba0 0x7f89e414f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.855+0000 7f89ec05c640 1 --2- 172.21.15.6:0/207802252 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89e40c2d30 0x7f89e4069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.855+0000 7f89ec05c640 1 --2- 172.21.15.6:0/207802252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89e40ad450 0x7f89e40b36e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.855+0000 7f89ec05c640 1 -- 172.21.15.6:0/207802252 >> 172.21.15.6:0/207802252 conn(0x7f89e40cde90 msgr2=0x7f89e4153b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:04.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.855+0000 7f89ec05c640 1 -- 172.21.15.6:0/207802252 shutdown_connections 2023-07-21T22:20:04.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:04.855+0000 7f89ec05c640 1 -- 172.21.15.6:0/207802252 wait complete. 2023-07-21T22:20:04.921 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2023-07-21T22:20:04.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:20:04.921 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2023-07-21T22:20:04.933 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir4 1M 2023-07-21T22:20:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.079+0000 7fd71e4ec640 1 Processor -- start 2023-07-21T22:20:05.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.079+0000 7fd71e4ec640 1 -- start start 2023-07-21T22:20:05.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.083+0000 7fd71e4ec640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd71815f690 0x7fd7180b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.083+0000 7fd71e4ec640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7181453a0 0x7fd71815fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.083+0000 7fd71e4ec640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71806c040 con 0x7fd71806c4d0 2023-07-21T22:20:05.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.083+0000 7fd71e4ec640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd718160600 con 0x7fd7181453a0 2023-07-21T22:20:05.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.083+0000 7fd71e4ec640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd718160360 con 0x7fd71815f690 2023-07-21T22:20:05.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.083+0000 7fd7177fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7181453a0 0x7fd71815fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.083+0000 7fd7177fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7181453a0 0x7fd71815fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54156/0 (socket says 172.21.15.6:54156) 2023-07-21T22:20:05.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.083+0000 7fd7177fe640 1 -- 172.21.15.6:0/3616070086 learned_addr learned my addr 172.21.15.6:0/3616070086 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:05.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.083+0000 7fd717fff640 1 --2- 172.21.15.6:0/3616070086 >> v2:172.21.15.161:3300/0 conn(0x7fd71815f690 0x7fd7180b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.083+0000 7fd7177fe640 1 -- 172.21.15.6:0/3616070086 >> v2:172.21.15.161:3300/0 conn(0x7fd71815f690 msgr2=0x7fd7180b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:05.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.083+0000 7fd7177fe640 1 --2- 172.21.15.6:0/3616070086 >> v2:172.21.15.161:3300/0 conn(0x7fd71815f690 0x7fd7180b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.083+0000 7fd7177fe640 1 -- 172.21.15.6:0/3616070086 >> v1:172.21.15.161:6789/0 conn(0x7fd71806c4d0 legacy=0x7fd71806c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.083+0000 7fd7177fe640 1 -- 172.21.15.6:0/3616070086 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71806b9f0 con 0x7fd7181453a0 2023-07-21T22:20:05.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.087+0000 7fd7177fe640 1 --2- 172.21.15.6:0/3616070086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7181453a0 0x7fd71815fa60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd7180aba90 tx=0x7fd70c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f61437437a43a25 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:05.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.087+0000 7fd716ffd640 1 -- 172.21.15.6:0/3616070086 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c0ab660 con 0x7fd7181453a0 2023-07-21T22:20:05.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.087+0000 7fd716ffd640 1 -- 172.21.15.6:0/3616070086 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c0ab7c0 con 0x7fd7181453a0 2023-07-21T22:20:05.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.087+0000 7fd716ffd640 1 -- 172.21.15.6:0/3616070086 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c0abb50 con 0x7fd7181453a0 2023-07-21T22:20:05.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.087+0000 7fd71e4ec640 1 -- 172.21.15.6:0/3616070086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7181453a0 msgr2=0x7fd71815fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.087+0000 7fd71e4ec640 1 --2- 172.21.15.6:0/3616070086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7181453a0 0x7fd71815fa60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd7180aba90 tx=0x7fd70c01c440 comp rx=0 tx=0).stop 2023-07-21T22:20:05.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.087+0000 7fd71e4ec640 1 -- 172.21.15.6:0/3616070086 shutdown_connections 2023-07-21T22:20:05.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.087+0000 7fd71e4ec640 1 --2- 172.21.15.6:0/3616070086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7181453a0 0x7fd71815fa60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.087+0000 7fd71e4ec640 1 --2- 172.21.15.6:0/3616070086 >> v2:172.21.15.161:3300/0 conn(0x7fd71815f690 0x7fd7180b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.087+0000 7fd71e4ec640 1 -- 172.21.15.6:0/3616070086 >> 172.21.15.6:0/3616070086 conn(0x7fd7180b1210 msgr2=0x7fd7180ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:05.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.087+0000 7fd71e4ec640 1 -- 172.21.15.6:0/3616070086 shutdown_connections 2023-07-21T22:20:05.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.087+0000 7fd71e4ec640 1 -- 172.21.15.6:0/3616070086 wait complete. 2023-07-21T22:20:05.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.087+0000 7fd71e4ec640 1 Processor -- start 2023-07-21T22:20:05.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.087+0000 7fd71e4ec640 1 -- start start 2023-07-21T22:20:05.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.087+0000 7fd71e4ec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd71806c4d0 0x7fd718134520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.087+0000 7fd71e4ec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7181453a0 0x7fd71815e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.087+0000 7fd71e4ec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd71815f690 0x7fd71815e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.087+0000 7fd71e4ec640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71815eed0 con 0x7fd7181453a0 2023-07-21T22:20:05.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.087+0000 7fd71e4ec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd718137300 con 0x7fd71806c4d0 2023-07-21T22:20:05.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.087+0000 7fd71e4ec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7181375e0 con 0x7fd71815f690 2023-07-21T22:20:05.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.091+0000 7fd7177fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7181453a0 0x7fd71815e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.091+0000 7fd7177fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7181453a0 0x7fd71815e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54170/0 (socket says 172.21.15.6:54170) 2023-07-21T22:20:05.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.091+0000 7fd7177fe640 1 -- 172.21.15.6:0/3465605514 learned_addr learned my addr 172.21.15.6:0/3465605514 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:05.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.091+0000 7fd71ca89640 1 --2- 172.21.15.6:0/3465605514 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd71815f690 0x7fd71815e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.091+0000 7fd717fff640 1 --2- 172.21.15.6:0/3465605514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd71806c4d0 0x7fd718134520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.091+0000 7fd7177fe640 1 -- 172.21.15.6:0/3465605514 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd71815f690 msgr2=0x7fd71815e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.091+0000 7fd7177fe640 1 --2- 172.21.15.6:0/3465605514 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd71815f690 0x7fd71815e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.091+0000 7fd7177fe640 1 -- 172.21.15.6:0/3465605514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd71806c4d0 msgr2=0x7fd718134520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.091+0000 7fd7177fe640 1 --2- 172.21.15.6:0/3465605514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd71806c4d0 0x7fd718134520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.091+0000 7fd7177fe640 1 -- 172.21.15.6:0/3465605514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c0094d0 con 0x7fd7181453a0 2023-07-21T22:20:05.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.091+0000 7fd717fff640 1 --2- 172.21.15.6:0/3465605514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd71806c4d0 0x7fd718134520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:05.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.091+0000 7fd71ca89640 1 --2- 172.21.15.6:0/3465605514 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd71815f690 0x7fd71815e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:05.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.091+0000 7fd7177fe640 1 --2- 172.21.15.6:0/3465605514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7181453a0 0x7fd71815e450 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd70c019050 tx=0x7fd70c01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:05.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.091+0000 7fd714ff9640 1 -- 172.21.15.6:0/3465605514 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c0b4800 con 0x7fd7181453a0 2023-07-21T22:20:05.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.091+0000 7fd714ff9640 1 -- 172.21.15.6:0/3465605514 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c0b4980 con 0x7fd7181453a0 2023-07-21T22:20:05.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.091+0000 7fd71e4ec640 1 -- 172.21.15.6:0/3465605514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71813ae60 con 0x7fd7181453a0 2023-07-21T22:20:05.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.091+0000 7fd714ff9640 1 -- 172.21.15.6:0/3465605514 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c0b4d30 con 0x7fd7181453a0 2023-07-21T22:20:05.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.091+0000 7fd71e4ec640 1 -- 172.21.15.6:0/3465605514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71813b420 con 0x7fd7181453a0 2023-07-21T22:20:05.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.091+0000 7fd71e4ec640 1 -- 172.21.15.6:0/3465605514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71813b610 con 0x7fd7181453a0 2023-07-21T22:20:05.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.091+0000 7fd714ff9640 1 -- 172.21.15.6:0/3465605514 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fd70c0a9070 con 0x7fd7181453a0 2023-07-21T22:20:05.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.095+0000 7fd714ff9640 1 --2- 172.21.15.6:0/3465605514 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fd704066480 0x7fd704068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.095+0000 7fd714ff9640 1 -- 172.21.15.6:0/3465605514 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fd70c11e920 con 0x7fd7181453a0 2023-07-21T22:20:05.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.095+0000 7fd717fff640 1 --2- 172.21.15.6:0/3465605514 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fd704066480 0x7fd704068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.095+0000 7fd717fff640 1 --2- 172.21.15.6:0/3465605514 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fd704066480 0x7fd704068930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd7180ab9d0 tx=0x7fd708008040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:05.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.095+0000 7fd714ff9640 1 -- 172.21.15.6:0/3465605514 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd70c0eb9e0 con 0x7fd7181453a0 2023-07-21T22:20:05.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.271+0000 7fd71e4ec640 1 -- 172.21.15.6:0/3465605514 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd718144fe0 con 0x7fd704066480 2023-07-21T22:20:05.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.343+0000 7fd714ff9640 1 -- 172.21.15.6:0/3465605514 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fd70800f900 con 0x7fd704066480 2023-07-21T22:20:05.390 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule set for path /snap_test_dir1/dir4 2023-07-21T22:20:05.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.343+0000 7fd71e4ec640 1 -- 172.21.15.6:0/3465605514 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fd704066480 msgr2=0x7fd704068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.343+0000 7fd71e4ec640 1 --2- 172.21.15.6:0/3465605514 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fd704066480 0x7fd704068930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd7180ab9d0 tx=0x7fd708008040 comp rx=0 tx=0).stop 2023-07-21T22:20:05.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.343+0000 7fd71e4ec640 1 -- 172.21.15.6:0/3465605514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7181453a0 msgr2=0x7fd71815e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.343+0000 7fd71e4ec640 1 --2- 172.21.15.6:0/3465605514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7181453a0 0x7fd71815e450 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd70c019050 tx=0x7fd70c01ac80 comp rx=0 tx=0).stop 2023-07-21T22:20:05.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.343+0000 7fd71e4ec640 1 -- 172.21.15.6:0/3465605514 shutdown_connections 2023-07-21T22:20:05.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.343+0000 7fd71e4ec640 1 --2- 172.21.15.6:0/3465605514 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fd704066480 0x7fd704068930 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.343+0000 7fd71e4ec640 1 --2- 172.21.15.6:0/3465605514 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd71815f690 0x7fd71815e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.343+0000 7fd71e4ec640 1 --2- 172.21.15.6:0/3465605514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7181453a0 0x7fd71815e450 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.343+0000 7fd71e4ec640 1 --2- 172.21.15.6:0/3465605514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd71806c4d0 0x7fd718134520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.343+0000 7fd71e4ec640 1 -- 172.21.15.6:0/3465605514 >> 172.21.15.6:0/3465605514 conn(0x7fd7180b1210 msgr2=0x7fd71813dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:05.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.343+0000 7fd71e4ec640 1 -- 172.21.15.6:0/3465605514 shutdown_connections 2023-07-21T22:20:05.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.343+0000 7fd71e4ec640 1 -- 172.21.15.6:0/3465605514 wait complete. 2023-07-21T22:20:05.411 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2023-07-21T22:20:05.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:20:05.412 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2023-07-21T22:20:05.423 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir5 1M 2023-07-21T22:20:05.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.567+0000 7f00937fa640 1 Processor -- start 2023-07-21T22:20:05.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.567+0000 7f00937fa640 1 -- start start 2023-07-21T22:20:05.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.567+0000 7f00937fa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f008c15beb0 0x7f008c0cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.567+0000 7f00937fa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f008c0b0760 0x7f008c15f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.567+0000 7f00937fa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008c0cb6a0 con 0x7f008c06db00 2023-07-21T22:20:05.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.567+0000 7f00937fa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f008c06d020 con 0x7f008c15beb0 2023-07-21T22:20:05.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.567+0000 7f00937fa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f008c06d300 con 0x7f008c0b0760 2023-07-21T22:20:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.567+0000 7f0091596640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f008c15beb0 0x7f008c0cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.567+0000 7f0091596640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f008c15beb0 0x7f008c0cada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54180/0 (socket says 172.21.15.6:54180) 2023-07-21T22:20:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.567+0000 7f0091596640 1 -- 172.21.15.6:0/1798452203 learned_addr learned my addr 172.21.15.6:0/1798452203 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.567+0000 7f0091d97640 1 --2- 172.21.15.6:0/1798452203 >> v2:172.21.15.161:3300/0 conn(0x7f008c0b0760 0x7f008c15f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.567+0000 7f0091596640 1 -- 172.21.15.6:0/1798452203 >> v2:172.21.15.161:3300/0 conn(0x7f008c0b0760 msgr2=0x7f008c15f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.567+0000 7f0091596640 1 --2- 172.21.15.6:0/1798452203 >> v2:172.21.15.161:3300/0 conn(0x7f008c0b0760 0x7f008c15f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.567+0000 7f0091596640 1 -- 172.21.15.6:0/1798452203 >> v1:172.21.15.6:6789/0 conn(0x7f008c06db00 legacy=0x7f008c0ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.567+0000 7f0091596640 1 -- 172.21.15.6:0/1798452203 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c06d5e0 con 0x7f008c15beb0 2023-07-21T22:20:05.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.571+0000 7f0091596640 1 --2- 172.21.15.6:0/1798452203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c15beb0 0x7f008c0cada0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f008c0cf3a0 tx=0x7f008801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fd8128bc5fad2a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:05.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.571+0000 7f0083fff640 1 -- 172.21.15.6:0/1798452203 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00880ab600 con 0x7f008c15beb0 2023-07-21T22:20:05.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.571+0000 7f0083fff640 1 -- 172.21.15.6:0/1798452203 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00880a7050 con 0x7f008c15beb0 2023-07-21T22:20:05.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.571+0000 7f0083fff640 1 -- 172.21.15.6:0/1798452203 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00880ab980 con 0x7f008c15beb0 2023-07-21T22:20:05.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.571+0000 7f00937fa640 1 -- 172.21.15.6:0/1798452203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c15beb0 msgr2=0x7f008c0cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.571+0000 7f00937fa640 1 --2- 172.21.15.6:0/1798452203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c15beb0 0x7f008c0cada0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f008c0cf3a0 tx=0x7f008801c470 comp rx=0 tx=0).stop 2023-07-21T22:20:05.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.571+0000 7f00937fa640 1 -- 172.21.15.6:0/1798452203 shutdown_connections 2023-07-21T22:20:05.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.571+0000 7f00937fa640 1 --2- 172.21.15.6:0/1798452203 >> v2:172.21.15.161:3300/0 conn(0x7f008c0b0760 0x7f008c15f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.571+0000 7f00937fa640 1 --2- 172.21.15.6:0/1798452203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c15beb0 0x7f008c0cada0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.571+0000 7f00937fa640 1 -- 172.21.15.6:0/1798452203 >> 172.21.15.6:0/1798452203 conn(0x7f008c06c2f0 msgr2=0x7f008c0aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:05.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.571+0000 7f00937fa640 1 -- 172.21.15.6:0/1798452203 shutdown_connections 2023-07-21T22:20:05.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.571+0000 7f00937fa640 1 -- 172.21.15.6:0/1798452203 wait complete. 2023-07-21T22:20:05.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f00937fa640 1 Processor -- start 2023-07-21T22:20:05.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f00937fa640 1 -- start start 2023-07-21T22:20:05.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f00937fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c06db00 0x7f008c15cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f00937fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f008c0b0760 0x7f008c14ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f00937fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f008c15beb0 0x7f008c145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f00937fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c146440 con 0x7f008c06db00 2023-07-21T22:20:05.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f00937fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c15ebd0 con 0x7f008c0b0760 2023-07-21T22:20:05.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f00937fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008c15eeb0 con 0x7f008c15beb0 2023-07-21T22:20:05.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f0091596640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c06db00 0x7f008c15cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f0091596640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c06db00 0x7f008c15cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54190/0 (socket says 172.21.15.6:54190) 2023-07-21T22:20:05.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f0091596640 1 -- 172.21.15.6:0/1694303741 learned_addr learned my addr 172.21.15.6:0/1694303741 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:05.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f0091596640 1 -- 172.21.15.6:0/1694303741 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f008c15beb0 msgr2=0x7f008c145400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f0091596640 1 --2- 172.21.15.6:0/1694303741 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f008c15beb0 0x7f008c145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f0091596640 1 -- 172.21.15.6:0/1694303741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f008c0b0760 msgr2=0x7f008c14ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f0091596640 1 --2- 172.21.15.6:0/1694303741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f008c0b0760 0x7f008c14ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f0091596640 1 -- 172.21.15.6:0/1694303741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00880094d0 con 0x7f008c06db00 2023-07-21T22:20:05.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f0091596640 1 --2- 172.21.15.6:0/1694303741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c06db00 0x7f008c15cbc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f00880ae040 tx=0x7f0088019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:05.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f0081ffb640 1 -- 172.21.15.6:0/1694303741 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00880b4850 con 0x7f008c06db00 2023-07-21T22:20:05.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f0081ffb640 1 -- 172.21.15.6:0/1694303741 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00880b49b0 con 0x7f008c06db00 2023-07-21T22:20:05.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f0081ffb640 1 -- 172.21.15.6:0/1694303741 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00880b4d60 con 0x7f008c06db00 2023-07-21T22:20:05.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f00937fa640 1 -- 172.21.15.6:0/1694303741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008c1460d0 con 0x7f008c06db00 2023-07-21T22:20:05.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f00937fa640 1 -- 172.21.15.6:0/1694303741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008c15d100 con 0x7f008c06db00 2023-07-21T22:20:05.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.575+0000 7f00937fa640 1 -- 172.21.15.6:0/1694303741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f008c15f0d0 con 0x7f008c06db00 2023-07-21T22:20:05.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.579+0000 7f0081ffb640 1 -- 172.21.15.6:0/1694303741 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f00880b2070 con 0x7f008c06db00 2023-07-21T22:20:05.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.579+0000 7f0081ffb640 1 --2- 172.21.15.6:0/1694303741 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f0070066480 0x7f0070068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.579+0000 7f0081ffb640 1 -- 172.21.15.6:0/1694303741 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f008811e500 con 0x7f008c06db00 2023-07-21T22:20:05.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.579+0000 7f0090d95640 1 --2- 172.21.15.6:0/1694303741 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f0070066480 0x7f0070068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.579+0000 7f0090d95640 1 --2- 172.21.15.6:0/1694303741 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f0070066480 0x7f0070068930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f007c000f70 tx=0x7f007c0079c0 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:05.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.583+0000 7f0081ffb640 1 -- 172.21.15.6:0/1694303741 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00880eb470 con 0x7f008c06db00 2023-07-21T22:20:05.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.755+0000 7f00937fa640 1 -- 172.21.15.6:0/1694303741 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f008c15e9c0 con 0x7f0070066480 2023-07-21T22:20:05.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.819+0000 7f0081ffb640 1 -- 172.21.15.6:0/1694303741 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f008c15e9c0 con 0x7f0070066480 2023-07-21T22:20:05.866 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule set for path /snap_test_dir1/dir5 2023-07-21T22:20:05.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.819+0000 7f00937fa640 1 -- 172.21.15.6:0/1694303741 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f0070066480 msgr2=0x7f0070068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.819+0000 7f00937fa640 1 --2- 172.21.15.6:0/1694303741 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f0070066480 0x7f0070068930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f007c000f70 tx=0x7f007c0079c0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.819+0000 7f00937fa640 1 -- 172.21.15.6:0/1694303741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c06db00 msgr2=0x7f008c15cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.819+0000 7f00937fa640 1 --2- 172.21.15.6:0/1694303741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c06db00 0x7f008c15cbc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f00880ae040 tx=0x7f0088019210 comp rx=0 tx=0).stop 2023-07-21T22:20:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.819+0000 7f00937fa640 1 -- 172.21.15.6:0/1694303741 shutdown_connections 2023-07-21T22:20:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.819+0000 7f00937fa640 1 --2- 172.21.15.6:0/1694303741 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f0070066480 0x7f0070068930 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.819+0000 7f00937fa640 1 --2- 172.21.15.6:0/1694303741 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f008c15beb0 0x7f008c145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.819+0000 7f00937fa640 1 --2- 172.21.15.6:0/1694303741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f008c0b0760 0x7f008c14ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.819+0000 7f00937fa640 1 --2- 172.21.15.6:0/1694303741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c06db00 0x7f008c15cbc0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.819+0000 7f00937fa640 1 -- 172.21.15.6:0/1694303741 >> 172.21.15.6:0/1694303741 conn(0x7f008c06c2f0 msgr2=0x7f008c1517a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.819+0000 7f00937fa640 1 -- 172.21.15.6:0/1694303741 shutdown_connections 2023-07-21T22:20:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:05.819+0000 7f00937fa640 1 -- 172.21.15.6:0/1694303741 wait complete. 2023-07-21T22:20:05.887 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2023-07-21T22:20:05.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:20:05.888 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2023-07-21T22:20:05.900 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir6 1M 2023-07-21T22:20:06.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.039+0000 7f132da93640 1 Processor -- start 2023-07-21T22:20:06.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.039+0000 7f132da93640 1 -- start start 2023-07-21T22:20:06.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.043+0000 7f132da93640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f132806a440 0x7f13280b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.043+0000 7f132da93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13281453a0 0x7f132806c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.043+0000 7f132da93640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f132806c040 con 0x7f132815f690 2023-07-21T22:20:06.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.043+0000 7f132da93640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1328160170 con 0x7f132806a440 2023-07-21T22:20:06.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.043+0000 7f132da93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1328160600 con 0x7f13281453a0 2023-07-21T22:20:06.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.043+0000 7f1327fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13281453a0 0x7f132806c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.043+0000 7f1327fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13281453a0 0x7f132806c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:52280/0 (socket says 172.21.15.6:52280) 2023-07-21T22:20:06.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.043+0000 7f1327fff640 1 -- 172.21.15.6:0/2109127064 learned_addr learned my addr 172.21.15.6:0/2109127064 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:06.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.043+0000 7f13277fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f132815f690 0x7f132815fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:43930/0 (socket says 172.21.15.6:43930) 2023-07-21T22:20:06.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.043+0000 7f1326ffd640 1 --2- 172.21.15.6:0/2109127064 >> v2:172.21.15.161:3300/0 conn(0x7f132806a440 0x7f13280b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.043+0000 7f13267fc640 1 -- 172.21.15.6:0/2109127064 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611886152 0 0) 0x7f132806c040 con 0x7f132815f690 2023-07-21T22:20:06.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.043+0000 7f1327fff640 1 -- 172.21.15.6:0/2109127064 >> v2:172.21.15.161:3300/0 conn(0x7f132806a440 msgr2=0x7f13280b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.043+0000 7f1327fff640 1 --2- 172.21.15.6:0/2109127064 >> v2:172.21.15.161:3300/0 conn(0x7f132806a440 0x7f13280b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.043+0000 7f1327fff640 1 -- 172.21.15.6:0/2109127064 >> v1:172.21.15.161:6789/0 conn(0x7f132815f690 legacy=0x7f132815fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.043+0000 7f1327fff640 1 -- 172.21.15.6:0/2109127064 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1328160360 con 0x7f13281453a0 2023-07-21T22:20:06.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.043+0000 7f1326ffd640 1 --2- 172.21.15.6:0/2109127064 >> v2:172.21.15.161:3300/0 conn(0x7f132806a440 0x7f13280b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:06.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.047+0000 7f1327fff640 1 --2- 172.21.15.6:0/2109127064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13281453a0 0x7f132806c4d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1320009e50 tx=0x7f132001c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0a5b7837cd26af6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.047+0000 7f13267fc640 1 -- 172.21.15.6:0/2109127064 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13200a5540 con 0x7f13281453a0 2023-07-21T22:20:06.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.047+0000 7f13267fc640 1 -- 172.21.15.6:0/2109127064 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13200a56a0 con 0x7f13281453a0 2023-07-21T22:20:06.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.047+0000 7f13267fc640 1 -- 172.21.15.6:0/2109127064 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13200a5a30 con 0x7f13281453a0 2023-07-21T22:20:06.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.047+0000 7f132da93640 1 -- 172.21.15.6:0/2109127064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13281453a0 msgr2=0x7f132806c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.047+0000 7f132da93640 1 --2- 172.21.15.6:0/2109127064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13281453a0 0x7f132806c4d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1320009e50 tx=0x7f132001c770 comp rx=0 tx=0).stop 2023-07-21T22:20:06.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.047+0000 7f132da93640 1 -- 172.21.15.6:0/2109127064 shutdown_connections 2023-07-21T22:20:06.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.047+0000 7f132da93640 1 --2- 172.21.15.6:0/2109127064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13281453a0 0x7f132806c4d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.047+0000 7f132da93640 1 --2- 172.21.15.6:0/2109127064 >> v2:172.21.15.161:3300/0 conn(0x7f132806a440 0x7f13280b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.047+0000 7f132da93640 1 -- 172.21.15.6:0/2109127064 >> 172.21.15.6:0/2109127064 conn(0x7f13280b1210 msgr2=0x7f13280ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.047+0000 7f132da93640 1 -- 172.21.15.6:0/2109127064 shutdown_connections 2023-07-21T22:20:06.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.047+0000 7f132da93640 1 -- 172.21.15.6:0/2109127064 wait complete. 2023-07-21T22:20:06.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.047+0000 7f132da93640 1 Processor -- start 2023-07-21T22:20:06.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.047+0000 7f132da93640 1 -- start start 2023-07-21T22:20:06.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f132da93640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f132806a440 0x7f13280ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f132da93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13281453a0 0x7f13280afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f132da93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f132815f690 0x7f132813f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f132da93640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13281428c0 con 0x7f13281453a0 2023-07-21T22:20:06.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f132da93640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13281425e0 con 0x7f132806a440 2023-07-21T22:20:06.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f132da93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132813ec90 con 0x7f132815f690 2023-07-21T22:20:06.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f1326ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13281453a0 0x7f13280afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f1326ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13281453a0 0x7f13280afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54206/0 (socket says 172.21.15.6:54206) 2023-07-21T22:20:06.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f1326ffd640 1 -- 172.21.15.6:0/403579287 learned_addr learned my addr 172.21.15.6:0/403579287 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:06.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f13277fe640 1 --2- 172.21.15.6:0/403579287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f132806a440 0x7f13280ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f1327fff640 1 --2- 172.21.15.6:0/403579287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f132815f690 0x7f132813f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f1326ffd640 1 -- 172.21.15.6:0/403579287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f132815f690 msgr2=0x7f132813f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f1326ffd640 1 --2- 172.21.15.6:0/403579287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f132815f690 0x7f132813f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f1326ffd640 1 -- 172.21.15.6:0/403579287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f132806a440 msgr2=0x7f13280ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f1326ffd640 1 --2- 172.21.15.6:0/403579287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f132806a440 0x7f13280ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f1326ffd640 1 -- 172.21.15.6:0/403579287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131c009420 con 0x7f13281453a0 2023-07-21T22:20:06.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f13277fe640 1 --2- 172.21.15.6:0/403579287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f132806a440 0x7f13280ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:06.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f1327fff640 1 --2- 172.21.15.6:0/403579287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f132815f690 0x7f132813f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:06.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f1326ffd640 1 --2- 172.21.15.6:0/403579287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13281453a0 0x7f13280afd50 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f131c00e980 tx=0x7f131c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f130ffff640 1 -- 172.21.15.6:0/403579287 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c00ca00 con 0x7f13281453a0 2023-07-21T22:20:06.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f130ffff640 1 -- 172.21.15.6:0/403579287 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131c00cb60 con 0x7f13281453a0 2023-07-21T22:20:06.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f132da93640 1 -- 172.21.15.6:0/403579287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1320009b30 con 0x7f13281453a0 2023-07-21T22:20:06.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f130ffff640 1 -- 172.21.15.6:0/403579287 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c013470 con 0x7f13281453a0 2023-07-21T22:20:06.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f132da93640 1 -- 172.21.15.6:0/403579287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f132813f250 con 0x7f13281453a0 2023-07-21T22:20:06.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.051+0000 7f132da93640 1 -- 172.21.15.6:0/403579287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13280678d0 con 0x7f13281453a0 2023-07-21T22:20:06.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.055+0000 7f130ffff640 1 -- 172.21.15.6:0/403579287 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f131c0135d0 con 0x7f13281453a0 2023-07-21T22:20:06.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.055+0000 7f130ffff640 1 --2- 172.21.15.6:0/403579287 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1314066480 0x7f1314068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.055+0000 7f130ffff640 1 -- 172.21.15.6:0/403579287 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f131c084390 con 0x7f13281453a0 2023-07-21T22:20:06.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.055+0000 7f13277fe640 1 --2- 172.21.15.6:0/403579287 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1314066480 0x7f1314068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.055+0000 7f13277fe640 1 --2- 172.21.15.6:0/403579287 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1314066480 0x7f1314068930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1318007fd0 tx=0x7f1318007c20 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.059+0000 7f130ffff640 1 -- 172.21.15.6:0/403579287 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f131c051520 con 0x7f13281453a0 2023-07-21T22:20:06.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.231+0000 7f132da93640 1 -- 172.21.15.6:0/403579287 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f132806ad80 con 0x7f1314066480 2023-07-21T22:20:06.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.295+0000 7f130ffff640 1 -- 172.21.15.6:0/403579287 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f1318005c90 con 0x7f1314066480 2023-07-21T22:20:06.345 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule set for path /snap_test_dir1/dir6 2023-07-21T22:20:06.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.299+0000 7f132da93640 1 -- 172.21.15.6:0/403579287 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1314066480 msgr2=0x7f1314068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.299+0000 7f132da93640 1 --2- 172.21.15.6:0/403579287 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1314066480 0x7f1314068930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1318007fd0 tx=0x7f1318007c20 comp rx=0 tx=0).stop 2023-07-21T22:20:06.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.299+0000 7f132da93640 1 -- 172.21.15.6:0/403579287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13281453a0 msgr2=0x7f13280afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.299+0000 7f132da93640 1 --2- 172.21.15.6:0/403579287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13281453a0 0x7f13280afd50 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f131c00e980 tx=0x7f131c00ee40 comp rx=0 tx=0).stop 2023-07-21T22:20:06.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.299+0000 7f132da93640 1 -- 172.21.15.6:0/403579287 shutdown_connections 2023-07-21T22:20:06.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.299+0000 7f132da93640 1 --2- 172.21.15.6:0/403579287 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1314066480 0x7f1314068930 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.299+0000 7f132da93640 1 --2- 172.21.15.6:0/403579287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f132815f690 0x7f132813f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.299+0000 7f132da93640 1 --2- 172.21.15.6:0/403579287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13281453a0 0x7f13280afd50 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.299+0000 7f132da93640 1 --2- 172.21.15.6:0/403579287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f132806a440 0x7f13280ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.299+0000 7f132da93640 1 -- 172.21.15.6:0/403579287 >> 172.21.15.6:0/403579287 conn(0x7f13280b1210 msgr2=0x7f1328141840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.299+0000 7f132da93640 1 -- 172.21.15.6:0/403579287 shutdown_connections 2023-07-21T22:20:06.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.299+0000 7f132da93640 1 -- 172.21.15.6:0/403579287 wait complete. 2023-07-21T22:20:06.367 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2023-07-21T22:20:06.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:20:06.368 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2023-07-21T22:20:06.379 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir7 1M 2023-07-21T22:20:06.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.523+0000 7ff13f511640 1 Processor -- start 2023-07-21T22:20:06.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.523+0000 7ff13f511640 1 -- start start 2023-07-21T22:20:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.523+0000 7ff13f511640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff13815bba0 0x7ff1380c4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.523+0000 7ff13f511640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff1380ad450 0x7ff1380ad930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.523+0000 7ff13f511640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13815bf70 con 0x7ff1380c2d30 2023-07-21T22:20:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.523+0000 7ff13f511640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1381600e0 con 0x7ff1380ad450 2023-07-21T22:20:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.523+0000 7ff13f511640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1380c4d00 con 0x7ff13815bba0 2023-07-21T22:20:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.523+0000 7ff13daae640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff1380ad450 0x7ff1380ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.523+0000 7ff13daae640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff1380ad450 0x7ff1380ad930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54220/0 (socket says 172.21.15.6:54220) 2023-07-21T22:20:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.523+0000 7ff13daae640 1 -- 172.21.15.6:0/2358927151 learned_addr learned my addr 172.21.15.6:0/2358927151 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:06.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.523+0000 7ff13d2ad640 1 --2- 172.21.15.6:0/2358927151 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff13815bba0 0x7ff1380c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.523+0000 7ff13daae640 1 -- 172.21.15.6:0/2358927151 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff13815bba0 msgr2=0x7ff1380c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.523+0000 7ff13daae640 1 --2- 172.21.15.6:0/2358927151 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff13815bba0 0x7ff1380c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.523+0000 7ff13daae640 1 -- 172.21.15.6:0/2358927151 >> v1:172.21.15.161:6789/0 conn(0x7ff1380c2d30 legacy=0x7ff1380acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.523+0000 7ff13daae640 1 -- 172.21.15.6:0/2358927151 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff138160570 con 0x7ff1380ad450 2023-07-21T22:20:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.527+0000 7ff13daae640 1 --2- 172.21.15.6:0/2358927151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1380ad450 0x7ff1380ad930 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff130009e50 tx=0x7ff13001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fa0adb59d8f049 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.527+0000 7ff12ffff640 1 -- 172.21.15.6:0/2358927151 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1300a5700 con 0x7ff1380ad450 2023-07-21T22:20:06.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.527+0000 7ff12ffff640 1 -- 172.21.15.6:0/2358927151 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1300a5860 con 0x7ff1380ad450 2023-07-21T22:20:06.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.527+0000 7ff12ffff640 1 -- 172.21.15.6:0/2358927151 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1300a5bf0 con 0x7ff1380ad450 2023-07-21T22:20:06.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.527+0000 7ff13f511640 1 -- 172.21.15.6:0/2358927151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1380ad450 msgr2=0x7ff1380ad930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.527+0000 7ff13f511640 1 --2- 172.21.15.6:0/2358927151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1380ad450 0x7ff1380ad930 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff130009e50 tx=0x7ff13001c880 comp rx=0 tx=0).stop 2023-07-21T22:20:06.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.527+0000 7ff13f511640 1 -- 172.21.15.6:0/2358927151 shutdown_connections 2023-07-21T22:20:06.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.527+0000 7ff13f511640 1 --2- 172.21.15.6:0/2358927151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1380ad450 0x7ff1380ad930 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.527+0000 7ff13f511640 1 --2- 172.21.15.6:0/2358927151 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff13815bba0 0x7ff1380c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.527+0000 7ff13f511640 1 -- 172.21.15.6:0/2358927151 >> 172.21.15.6:0/2358927151 conn(0x7ff1380cde90 msgr2=0x7ff1380ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.527+0000 7ff13f511640 1 -- 172.21.15.6:0/2358927151 shutdown_connections 2023-07-21T22:20:06.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.527+0000 7ff13f511640 1 -- 172.21.15.6:0/2358927151 wait complete. 2023-07-21T22:20:06.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13f511640 1 Processor -- start 2023-07-21T22:20:06.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13f511640 1 -- start start 2023-07-21T22:20:06.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13f511640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1380ad450 0x7ff13815acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13f511640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1380c2d30 0x7ff13814d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13f511640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff13815bba0 0x7ff13814db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13f511640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff138159120 con 0x7ff13815bba0 2023-07-21T22:20:06.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13f511640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff138159350 con 0x7ff1380c2d30 2023-07-21T22:20:06.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13f511640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff138159630 con 0x7ff1380ad450 2023-07-21T22:20:06.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13daae640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff13815bba0 0x7ff13814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13daae640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff13815bba0 0x7ff13814db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54224/0 (socket says 172.21.15.6:54224) 2023-07-21T22:20:06.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13daae640 1 -- 172.21.15.6:0/1501414985 learned_addr learned my addr 172.21.15.6:0/1501414985 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:06.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13d2ad640 1 --2- 172.21.15.6:0/1501414985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1380ad450 0x7ff13815acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13caac640 1 --2- 172.21.15.6:0/1501414985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1380c2d30 0x7ff13814d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13daae640 1 -- 172.21.15.6:0/1501414985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1380ad450 msgr2=0x7ff13815acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13daae640 1 --2- 172.21.15.6:0/1501414985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1380ad450 0x7ff13815acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13daae640 1 -- 172.21.15.6:0/1501414985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1380c2d30 msgr2=0x7ff13814d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13daae640 1 --2- 172.21.15.6:0/1501414985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1380c2d30 0x7ff13814d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13daae640 1 -- 172.21.15.6:0/1501414985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff130009b30 con 0x7ff13815bba0 2023-07-21T22:20:06.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13daae640 1 --2- 172.21.15.6:0/1501414985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff13815bba0 0x7ff13814db50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff1300af040 tx=0x7ff130019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff12dffb640 1 -- 172.21.15.6:0/1501414985 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1300b8670 con 0x7ff13815bba0 2023-07-21T22:20:06.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff12dffb640 1 -- 172.21.15.6:0/1501414985 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1300b87d0 con 0x7ff13815bba0 2023-07-21T22:20:06.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff12dffb640 1 -- 172.21.15.6:0/1501414985 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1300b8b60 con 0x7ff13815bba0 2023-07-21T22:20:06.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13f511640 1 -- 172.21.15.6:0/1501414985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff138159910 con 0x7ff13815bba0 2023-07-21T22:20:06.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.531+0000 7ff13f511640 1 -- 172.21.15.6:0/1501414985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff138159ed0 con 0x7ff13815bba0 2023-07-21T22:20:06.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.535+0000 7ff13f511640 1 -- 172.21.15.6:0/1501414985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13806a190 con 0x7ff13815bba0 2023-07-21T22:20:06.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.535+0000 7ff12dffb640 1 -- 172.21.15.6:0/1501414985 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7ff1300b8cc0 con 0x7ff13815bba0 2023-07-21T22:20:06.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.535+0000 7ff12dffb640 1 --2- 172.21.15.6:0/1501414985 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7ff11c066480 0x7ff11c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.535+0000 7ff12dffb640 1 -- 172.21.15.6:0/1501414985 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6320+0+0 (secure 0 0 0) 0x7ff13011f6d0 con 0x7ff13815bba0 2023-07-21T22:20:06.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.535+0000 7ff13d2ad640 1 --2- 172.21.15.6:0/1501414985 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7ff11c066480 0x7ff11c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.535+0000 7ff13d2ad640 1 --2- 172.21.15.6:0/1501414985 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7ff11c066480 0x7ff11c068930 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff1340079c0 tx=0x7ff134008040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.539+0000 7ff12dffb640 1 -- 172.21.15.6:0/1501414985 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff1300ec800 con 0x7ff13815bba0 2023-07-21T22:20:06.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.715+0000 7ff13f511640 1 -- 172.21.15.6:0/1501414985 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1380aef60 con 0x7ff11c066480 2023-07-21T22:20:06.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.779+0000 7ff12dffb640 1 -- 172.21.15.6:0/1501414985 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7ff1340108d0 con 0x7ff11c066480 2023-07-21T22:20:06.827 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule set for path /snap_test_dir1/dir7 2023-07-21T22:20:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.783+0000 7ff13f511640 1 -- 172.21.15.6:0/1501414985 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7ff11c066480 msgr2=0x7ff11c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.783+0000 7ff13f511640 1 --2- 172.21.15.6:0/1501414985 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7ff11c066480 0x7ff11c068930 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff1340079c0 tx=0x7ff134008040 comp rx=0 tx=0).stop 2023-07-21T22:20:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.783+0000 7ff13f511640 1 -- 172.21.15.6:0/1501414985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff13815bba0 msgr2=0x7ff13814db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.783+0000 7ff13f511640 1 --2- 172.21.15.6:0/1501414985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff13815bba0 0x7ff13814db50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff1300af040 tx=0x7ff130019620 comp rx=0 tx=0).stop 2023-07-21T22:20:06.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.783+0000 7ff13f511640 1 -- 172.21.15.6:0/1501414985 shutdown_connections 2023-07-21T22:20:06.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.783+0000 7ff13f511640 1 --2- 172.21.15.6:0/1501414985 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7ff11c066480 0x7ff11c068930 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.783+0000 7ff13f511640 1 --2- 172.21.15.6:0/1501414985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff13815bba0 0x7ff13814db50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.783+0000 7ff13f511640 1 --2- 172.21.15.6:0/1501414985 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1380c2d30 0x7ff13814d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.783+0000 7ff13f511640 1 --2- 172.21.15.6:0/1501414985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1380ad450 0x7ff13815acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.783+0000 7ff13f511640 1 -- 172.21.15.6:0/1501414985 >> 172.21.15.6:0/1501414985 conn(0x7ff1380cde90 msgr2=0x7ff138157570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.783+0000 7ff13f511640 1 -- 172.21.15.6:0/1501414985 shutdown_connections 2023-07-21T22:20:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:06.783+0000 7ff13f511640 1 -- 172.21.15.6:0/1501414985 wait complete. 2023-07-21T22:20:06.848 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2023-07-21T22:20:06.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:20:06.849 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2023-07-21T22:20:06.860 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir8 1M 2023-07-21T22:20:07.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.003+0000 7f97b07fa640 1 Processor -- start 2023-07-21T22:20:07.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.003+0000 7f97b07fa640 1 -- start start 2023-07-21T22:20:07.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.007+0000 7f97b07fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97a80aeb40 0x7f97a815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.007+0000 7f97b07fa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a81532b0 con 0x7f97a80aef10 2023-07-21T22:20:07.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.007+0000 7f97b07fa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a80ca6f0 con 0x7f97a8159440 2023-07-21T22:20:07.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.007+0000 7f97b07fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a81599d0 con 0x7f97a80aeb40 2023-07-21T22:20:07.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.007+0000 7f97add95640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f97a80aef10 0x7f97a8158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58080/0 (socket says 172.21.15.6:58080) 2023-07-21T22:20:07.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.007+0000 7f97add95640 1 -- 172.21.15.6:0/859237105 learned_addr learned my addr 172.21.15.6:0/859237105 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:20:07.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.007+0000 7f97ae596640 1 --2- 172.21.15.6:0/859237105 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97a80aeb40 0x7f97a815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.007+0000 7f97ad594640 1 -- 172.21.15.6:0/859237105 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812391581 0 0) 0x7f97a81532b0 con 0x7f97a80aef10 2023-07-21T22:20:07.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.007+0000 7f97ad594640 1 -- 172.21.15.6:0/859237105 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9794005740 con 0x7f97a80aef10 2023-07-21T22:20:07.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.007+0000 7f97ad594640 1 -- 172.21.15.6:0/859237105 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2625474633 0 0) 0x7f97a80ca6f0 con 0x7f97a8159440 2023-07-21T22:20:07.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.007+0000 7f97ad594640 1 -- 172.21.15.6:0/859237105 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97a81532b0 con 0x7f97a8159440 2023-07-21T22:20:07.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.007+0000 7f97ae596640 1 -- 172.21.15.6:0/859237105 >> v1:172.21.15.161:6789/0 conn(0x7f97a8159440 legacy=0x7f97a80c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.007+0000 7f97ae596640 1 -- 172.21.15.6:0/859237105 >> v1:172.21.15.6:6789/0 conn(0x7f97a80aef10 legacy=0x7f97a8158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.007+0000 7f97ae596640 1 -- 172.21.15.6:0/859237105 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a8159cb0 con 0x7f97a80aeb40 2023-07-21T22:20:07.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.011+0000 7f97ae596640 1 --2- 172.21.15.6:0/859237105 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97a80aeb40 0x7f97a815cef0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f97a40097f0 tx=0x7f97a401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbdbb768fc61315c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:07.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.011+0000 7f97ad594640 1 -- 172.21.15.6:0/859237105 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a40ac620 con 0x7f97a80aeb40 2023-07-21T22:20:07.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.011+0000 7f97ad594640 1 -- 172.21.15.6:0/859237105 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a40ac780 con 0x7f97a80aeb40 2023-07-21T22:20:07.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.011+0000 7f97ad594640 1 -- 172.21.15.6:0/859237105 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a40acb10 con 0x7f97a80aeb40 2023-07-21T22:20:07.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.011+0000 7f97b07fa640 1 -- 172.21.15.6:0/859237105 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97a80aeb40 msgr2=0x7f97a815cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.011+0000 7f97b07fa640 1 --2- 172.21.15.6:0/859237105 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97a80aeb40 0x7f97a815cef0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f97a40097f0 tx=0x7f97a401c3c0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.011+0000 7f97b07fa640 1 -- 172.21.15.6:0/859237105 shutdown_connections 2023-07-21T22:20:07.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.011+0000 7f97b07fa640 1 --2- 172.21.15.6:0/859237105 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97a80aeb40 0x7f97a815cef0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.011+0000 7f97b07fa640 1 -- 172.21.15.6:0/859237105 >> 172.21.15.6:0/859237105 conn(0x7f97a80cde90 msgr2=0x7f97a80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:07.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.011+0000 7f97b07fa640 1 -- 172.21.15.6:0/859237105 shutdown_connections 2023-07-21T22:20:07.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.011+0000 7f97b07fa640 1 -- 172.21.15.6:0/859237105 wait complete. 2023-07-21T22:20:07.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97b07fa640 1 Processor -- start 2023-07-21T22:20:07.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97b07fa640 1 -- start start 2023-07-21T22:20:07.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97b07fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97a80aeb40 0x7f97a80c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97b07fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a80aef10 0x7f97a814d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97b07fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97a8159440 0x7f97a81576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97b07fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a81f5140 con 0x7f97a80aef10 2023-07-21T22:20:07.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97b07fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a814da90 con 0x7f97a80aeb40 2023-07-21T22:20:07.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97b07fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a8157c30 con 0x7f97a8159440 2023-07-21T22:20:07.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97add95640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a80aef10 0x7f97a814d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97add95640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a80aef10 0x7f97a814d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54238/0 (socket says 172.21.15.6:54238) 2023-07-21T22:20:07.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97add95640 1 -- 172.21.15.6:0/1642835088 learned_addr learned my addr 172.21.15.6:0/1642835088 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:07.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97ae596640 1 --2- 172.21.15.6:0/1642835088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97a80aeb40 0x7f97a80c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97aed97640 1 --2- 172.21.15.6:0/1642835088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97a8159440 0x7f97a81576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97add95640 1 -- 172.21.15.6:0/1642835088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97a8159440 msgr2=0x7f97a81576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97add95640 1 --2- 172.21.15.6:0/1642835088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97a8159440 0x7f97a81576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97add95640 1 -- 172.21.15.6:0/1642835088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97a80aeb40 msgr2=0x7f97a80c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97add95640 1 --2- 172.21.15.6:0/1642835088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97a80aeb40 0x7f97a80c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97add95640 1 -- 172.21.15.6:0/1642835088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a4009420 con 0x7f97a80aef10 2023-07-21T22:20:07.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97ae596640 1 --2- 172.21.15.6:0/1642835088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97a80aeb40 0x7f97a80c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:20:07.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97aed97640 1 --2- 172.21.15.6:0/1642835088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97a8159440 0x7f97a81576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:20:07.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97add95640 1 --2- 172.21.15.6:0/1642835088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a80aef10 0x7f97a814d550 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f979800c4d0 tx=0x7f979800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:07.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f979effd640 1 -- 172.21.15.6:0/1642835088 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798005cf0 con 0x7f97a80aef10 2023-07-21T22:20:07.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f979effd640 1 -- 172.21.15.6:0/1642835088 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9798005e50 con 0x7f97a80aef10 2023-07-21T22:20:07.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f979effd640 1 -- 172.21.15.6:0/1642835088 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798007270 con 0x7f97a80aef10 2023-07-21T22:20:07.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97b07fa640 1 -- 172.21.15.6:0/1642835088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a80c5540 con 0x7f97a80aef10 2023-07-21T22:20:07.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97b07fa640 1 -- 172.21.15.6:0/1642835088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a80c5b00 con 0x7f97a80aef10 2023-07-21T22:20:07.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.015+0000 7f97b07fa640 1 -- 172.21.15.6:0/1642835088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a81f52b0 con 0x7f97a80aef10 2023-07-21T22:20:07.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.019+0000 7f979effd640 1 -- 172.21.15.6:0/1642835088 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f97980073d0 con 0x7f97a80aef10 2023-07-21T22:20:07.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.019+0000 7f979effd640 1 --2- 172.21.15.6:0/1642835088 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f978c066480 0x7f978c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.019+0000 7f979effd640 1 -- 172.21.15.6:0/1642835088 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f9798083720 con 0x7f97a80aef10 2023-07-21T22:20:07.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.019+0000 7f97ae596640 1 --2- 172.21.15.6:0/1642835088 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f978c066480 0x7f978c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.019+0000 7f97ae596640 1 --2- 172.21.15.6:0/1642835088 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f978c066480 0x7f978c068930 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f97a40ae000 tx=0x7f97a4008040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.023+0000 7f979effd640 1 -- 172.21.15.6:0/1642835088 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f97a81f52b0 con 0x7f97a80aef10 2023-07-21T22:20:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.195+0000 7f97b07fa640 1 -- 172.21.15.6:0/1642835088 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f97a815c9d0 con 0x7f978c066480 2023-07-21T22:20:07.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.263+0000 7f979effd640 1 -- 172.21.15.6:0/1642835088 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f97a40bc0d0 con 0x7f978c066480 2023-07-21T22:20:07.310 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule set for path /snap_test_dir1/dir8 2023-07-21T22:20:07.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.263+0000 7f97b07fa640 1 -- 172.21.15.6:0/1642835088 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f978c066480 msgr2=0x7f978c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.263+0000 7f97b07fa640 1 --2- 172.21.15.6:0/1642835088 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f978c066480 0x7f978c068930 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f97a40ae000 tx=0x7f97a4008040 comp rx=0 tx=0).stop 2023-07-21T22:20:07.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.263+0000 7f97b07fa640 1 -- 172.21.15.6:0/1642835088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a80aef10 msgr2=0x7f97a814d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.263+0000 7f97b07fa640 1 --2- 172.21.15.6:0/1642835088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a80aef10 0x7f97a814d550 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f979800c4d0 tx=0x7f979800c990 comp rx=0 tx=0).stop 2023-07-21T22:20:07.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.263+0000 7f97b07fa640 1 -- 172.21.15.6:0/1642835088 shutdown_connections 2023-07-21T22:20:07.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.263+0000 7f97b07fa640 1 --2- 172.21.15.6:0/1642835088 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f978c066480 0x7f978c068930 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.263+0000 7f97b07fa640 1 --2- 172.21.15.6:0/1642835088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97a8159440 0x7f97a81576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.263+0000 7f97b07fa640 1 --2- 172.21.15.6:0/1642835088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a80aef10 0x7f97a814d550 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.263+0000 7f97b07fa640 1 --2- 172.21.15.6:0/1642835088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97a80aeb40 0x7f97a80c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.263+0000 7f97b07fa640 1 -- 172.21.15.6:0/1642835088 >> 172.21.15.6:0/1642835088 conn(0x7f97a80cde90 msgr2=0x7f97a80ca910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:07.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.263+0000 7f97b07fa640 1 -- 172.21.15.6:0/1642835088 shutdown_connections 2023-07-21T22:20:07.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.263+0000 7f97b07fa640 1 -- 172.21.15.6:0/1642835088 wait complete. 2023-07-21T22:20:07.332 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2023-07-21T22:20:07.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:20:07.333 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2023-07-21T22:20:07.345 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir9 1M 2023-07-21T22:20:07.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.487+0000 7f891179d640 1 Processor -- start 2023-07-21T22:20:07.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.487+0000 7f891179d640 1 -- start start 2023-07-21T22:20:07.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.491+0000 7f891179d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f890c15bde0 0x7f890c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.491+0000 7f891179d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f890c0d2fc0 0x7f890c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.491+0000 7f891179d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f890c0d2300 0x7f890c0d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.491+0000 7f891179d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f890c15c1b0 con 0x7f890c0d2fc0 2023-07-21T22:20:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.491+0000 7f891179d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f890c0d2cc0 con 0x7f890c15bde0 2023-07-21T22:20:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.491+0000 7f891179d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f890c0b04c0 con 0x7f890c0d2300 2023-07-21T22:20:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.491+0000 7f8903fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f890c0d2fc0 0x7f890c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.491+0000 7f8903fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f890c0d2fc0 0x7f890c0b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45638/0 (socket says 172.21.15.6:45638) 2023-07-21T22:20:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.491+0000 7f8903fff640 1 -- 172.21.15.6:0/3068487189 learned_addr learned my addr 172.21.15.6:0/3068487189 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.491+0000 7f8903fff640 1 -- 172.21.15.6:0/3068487189 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f890c0d2300 msgr2=0x7f890c0d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.491+0000 7f8903fff640 1 --2- 172.21.15.6:0/3068487189 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f890c0d2300 0x7f890c0d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.491+0000 7f8903fff640 1 -- 172.21.15.6:0/3068487189 >> v2:172.21.15.161:3300/0 conn(0x7f890c15bde0 msgr2=0x7f890c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.491+0000 7f8903fff640 1 --2- 172.21.15.6:0/3068487189 >> v2:172.21.15.161:3300/0 conn(0x7f890c15bde0 0x7f890c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.491+0000 7f8903fff640 1 -- 172.21.15.6:0/3068487189 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890c0d0aa0 con 0x7f890c0d2fc0 2023-07-21T22:20:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.495+0000 7f8903fff640 1 --2- 172.21.15.6:0/3068487189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f890c0d2fc0 0x7f890c0b0950 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f890c08b210 tx=0x7f88f401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b508f67dead72cc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.495+0000 7f890a7fc640 1 -- 172.21.15.6:0/3068487189 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f40aa620 con 0x7f890c0d2fc0 2023-07-21T22:20:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.495+0000 7f890a7fc640 1 -- 172.21.15.6:0/3068487189 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f40aa780 con 0x7f890c0d2fc0 2023-07-21T22:20:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.495+0000 7f890a7fc640 1 -- 172.21.15.6:0/3068487189 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f40aab10 con 0x7f890c0d2fc0 2023-07-21T22:20:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.495+0000 7f891179d640 1 -- 172.21.15.6:0/3068487189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f890c0d2fc0 msgr2=0x7f890c0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.495+0000 7f891179d640 1 --2- 172.21.15.6:0/3068487189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f890c0d2fc0 0x7f890c0b0950 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f890c08b210 tx=0x7f88f401c500 comp rx=0 tx=0).stop 2023-07-21T22:20:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.495+0000 7f891179d640 1 -- 172.21.15.6:0/3068487189 shutdown_connections 2023-07-21T22:20:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.495+0000 7f891179d640 1 --2- 172.21.15.6:0/3068487189 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f890c0d2300 0x7f890c0d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.495+0000 7f891179d640 1 --2- 172.21.15.6:0/3068487189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f890c0d2fc0 0x7f890c0b0950 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.495+0000 7f891179d640 1 --2- 172.21.15.6:0/3068487189 >> v2:172.21.15.161:3300/0 conn(0x7f890c15bde0 0x7f890c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.495+0000 7f891179d640 1 -- 172.21.15.6:0/3068487189 >> 172.21.15.6:0/3068487189 conn(0x7f890c0659d0 msgr2=0x7f890c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.495+0000 7f891179d640 1 -- 172.21.15.6:0/3068487189 shutdown_connections 2023-07-21T22:20:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.495+0000 7f891179d640 1 -- 172.21.15.6:0/3068487189 wait complete. 2023-07-21T22:20:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.495+0000 7f891179d640 1 Processor -- start 2023-07-21T22:20:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.495+0000 7f891179d640 1 -- start start 2023-07-21T22:20:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f891179d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f890c0d2300 0x7f890c154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f891179d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f890c0d2fc0 0x7f890c15c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f891179d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f890c15bde0 0x7f890c15c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f891179d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890c0b63f0 con 0x7f890c0d2300 2023-07-21T22:20:07.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f891179d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890c0c9440 con 0x7f890c0d2fc0 2023-07-21T22:20:07.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f891179d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f890c15cec0 con 0x7f890c15bde0 2023-07-21T22:20:07.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f890affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f890c0d2300 0x7f890c154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f890affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f890c0d2300 0x7f890c154fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45652/0 (socket says 172.21.15.6:45652) 2023-07-21T22:20:07.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f890affd640 1 -- 172.21.15.6:0/1683666435 learned_addr learned my addr 172.21.15.6:0/1683666435 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:07.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f8903fff640 1 --2- 172.21.15.6:0/1683666435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f890c0d2fc0 0x7f890c15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f890b7fe640 1 --2- 172.21.15.6:0/1683666435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f890c15bde0 0x7f890c15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f890affd640 1 -- 172.21.15.6:0/1683666435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f890c15bde0 msgr2=0x7f890c15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f890affd640 1 --2- 172.21.15.6:0/1683666435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f890c15bde0 0x7f890c15c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f890affd640 1 -- 172.21.15.6:0/1683666435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f890c0d2fc0 msgr2=0x7f890c15c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f890affd640 1 --2- 172.21.15.6:0/1683666435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f890c0d2fc0 0x7f890c15c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f890affd640 1 -- 172.21.15.6:0/1683666435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f40094d0 con 0x7f890c0d2300 2023-07-21T22:20:07.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f890b7fe640 1 --2- 172.21.15.6:0/1683666435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f890c15bde0 0x7f890c15c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:07.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f890affd640 1 --2- 172.21.15.6:0/1683666435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f890c0d2300 0x7f890c154fd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f88fc00b4a0 tx=0x7f88fc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:07.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f89037fe640 1 -- 172.21.15.6:0/1683666435 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88fc005a20 con 0x7f890c0d2300 2023-07-21T22:20:07.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f89037fe640 1 -- 172.21.15.6:0/1683666435 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88fc005b80 con 0x7f890c0d2300 2023-07-21T22:20:07.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f89037fe640 1 -- 172.21.15.6:0/1683666435 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88fc010610 con 0x7f890c0d2300 2023-07-21T22:20:07.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f891179d640 1 -- 172.21.15.6:0/1683666435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f890c0b5a50 con 0x7f890c0d2300 2023-07-21T22:20:07.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f891179d640 1 -- 172.21.15.6:0/1683666435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f890c0b6010 con 0x7f890c0d2300 2023-07-21T22:20:07.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f891179d640 1 -- 172.21.15.6:0/1683666435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f890c0b6530 con 0x7f890c0d2300 2023-07-21T22:20:07.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.499+0000 7f89037fe640 1 -- 172.21.15.6:0/1683666435 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f88fc010770 con 0x7f890c0d2300 2023-07-21T22:20:07.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.503+0000 7f89037fe640 1 --2- 172.21.15.6:0/1683666435 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f88ec066480 0x7f88ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.503+0000 7f89037fe640 1 -- 172.21.15.6:0/1683666435 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f88fc083a00 con 0x7f890c0d2300 2023-07-21T22:20:07.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.503+0000 7f8903fff640 1 --2- 172.21.15.6:0/1683666435 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f88ec066480 0x7f88ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.503+0000 7f8903fff640 1 --2- 172.21.15.6:0/1683666435 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f88ec066480 0x7f88ec068930 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f88f40ae000 tx=0x7f88f40b5040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:07.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.507+0000 7f89037fe640 1 -- 172.21.15.6:0/1683666435 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f890c0b6530 con 0x7f890c0d2300 2023-07-21T22:20:07.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.679+0000 7f891179d640 1 -- 172.21.15.6:0/1683666435 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f890c0b0150 con 0x7f88ec066480 2023-07-21T22:20:07.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.747+0000 7f89037fe640 1 -- 172.21.15.6:0/1683666435 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f88f40aa8f0 con 0x7f88ec066480 2023-07-21T22:20:07.797 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule set for path /snap_test_dir1/dir9 2023-07-21T22:20:07.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.751+0000 7f891179d640 1 -- 172.21.15.6:0/1683666435 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f88ec066480 msgr2=0x7f88ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.751+0000 7f891179d640 1 --2- 172.21.15.6:0/1683666435 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f88ec066480 0x7f88ec068930 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f88f40ae000 tx=0x7f88f40b5040 comp rx=0 tx=0).stop 2023-07-21T22:20:07.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.751+0000 7f891179d640 1 -- 172.21.15.6:0/1683666435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f890c0d2300 msgr2=0x7f890c154fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.751+0000 7f891179d640 1 --2- 172.21.15.6:0/1683666435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f890c0d2300 0x7f890c154fd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f88fc00b4a0 tx=0x7f88fc00b960 comp rx=0 tx=0).stop 2023-07-21T22:20:07.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.751+0000 7f891179d640 1 -- 172.21.15.6:0/1683666435 shutdown_connections 2023-07-21T22:20:07.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.751+0000 7f891179d640 1 --2- 172.21.15.6:0/1683666435 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f88ec066480 0x7f88ec068930 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.751+0000 7f891179d640 1 --2- 172.21.15.6:0/1683666435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f890c15bde0 0x7f890c15c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.751+0000 7f891179d640 1 --2- 172.21.15.6:0/1683666435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f890c0d2fc0 0x7f890c15c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.751+0000 7f891179d640 1 --2- 172.21.15.6:0/1683666435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f890c0d2300 0x7f890c154fd0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.751+0000 7f891179d640 1 -- 172.21.15.6:0/1683666435 >> 172.21.15.6:0/1683666435 conn(0x7f890c0659d0 msgr2=0x7f890c15ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:07.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.751+0000 7f891179d640 1 -- 172.21.15.6:0/1683666435 shutdown_connections 2023-07-21T22:20:07.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.751+0000 7f891179d640 1 -- 172.21.15.6:0/1683666435 wait complete. 2023-07-21T22:20:07.817 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2023-07-21T22:20:07.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir0 1M 2023-07-21T22:20:07.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.919+0000 7fda8686d640 1 Processor -- start 2023-07-21T22:20:07.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.919+0000 7fda8686d640 1 -- start start 2023-07-21T22:20:07.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.923+0000 7fda8686d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda80069430 0x7fda80069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.923+0000 7fda8686d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda80159d70 con 0x7fda80070f30 2023-07-21T22:20:07.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.923+0000 7fda8686d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda80069d40 con 0x7fda800af2b0 2023-07-21T22:20:07.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.923+0000 7fda8686d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda800c9c60 con 0x7fda80069430 2023-07-21T22:20:07.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.923+0000 7fda7ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda80069430 0x7fda80069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.923+0000 7fda7ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda80069430 0x7fda80069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45662/0 (socket says 172.21.15.6:45662) 2023-07-21T22:20:07.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.923+0000 7fda7ffff640 1 -- 172.21.15.6:0/2511106148 learned_addr learned my addr 172.21.15.6:0/2511106148 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:07.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.923+0000 7fda7ffff640 1 -- 172.21.15.6:0/2511106148 >> v1:172.21.15.161:6789/0 conn(0x7fda800af2b0 legacy=0x7fda8015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:07.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.923+0000 7fda7ffff640 1 -- 172.21.15.6:0/2511106148 >> v1:172.21.15.6:6789/0 conn(0x7fda80070f30 legacy=0x7fda800ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.923+0000 7fda7ffff640 1 -- 172.21.15.6:0/2511106148 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda800c9f40 con 0x7fda80069430 2023-07-21T22:20:07.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.923+0000 7fda7ffff640 1 --2- 172.21.15.6:0/2511106148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda80069430 0x7fda80069800 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fda70009870 tx=0x7fda7001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6f73bb9671168d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:07.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.923+0000 7fda7effd640 1 -- 172.21.15.6:0/2511106148 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda700ab610 con 0x7fda80069430 2023-07-21T22:20:07.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.923+0000 7fda7effd640 1 -- 172.21.15.6:0/2511106148 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda700ab770 con 0x7fda80069430 2023-07-21T22:20:07.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.923+0000 7fda7effd640 1 -- 172.21.15.6:0/2511106148 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda700abb00 con 0x7fda80069430 2023-07-21T22:20:07.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.927+0000 7fda8686d640 1 -- 172.21.15.6:0/2511106148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda80069430 msgr2=0x7fda80069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.927+0000 7fda8686d640 1 --2- 172.21.15.6:0/2511106148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda80069430 0x7fda80069800 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fda70009870 tx=0x7fda7001c500 comp rx=0 tx=0).stop 2023-07-21T22:20:07.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.927+0000 7fda8686d640 1 -- 172.21.15.6:0/2511106148 shutdown_connections 2023-07-21T22:20:07.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.927+0000 7fda8686d640 1 --2- 172.21.15.6:0/2511106148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda80069430 0x7fda80069800 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.927+0000 7fda8686d640 1 -- 172.21.15.6:0/2511106148 >> 172.21.15.6:0/2511106148 conn(0x7fda800cde90 msgr2=0x7fda800ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:07.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.927+0000 7fda8686d640 1 -- 172.21.15.6:0/2511106148 shutdown_connections 2023-07-21T22:20:07.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.927+0000 7fda8686d640 1 -- 172.21.15.6:0/2511106148 wait complete. 2023-07-21T22:20:07.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.927+0000 7fda8686d640 1 Processor -- start 2023-07-21T22:20:07.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.927+0000 7fda8686d640 1 -- start start 2023-07-21T22:20:07.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.927+0000 7fda8686d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda80069430 0x7fda80145b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.927+0000 7fda8686d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda80070f30 0x7fda80155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.927+0000 7fda8686d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda800af2b0 0x7fda801512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.927+0000 7fda8686d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda80146080 con 0x7fda800af2b0 2023-07-21T22:20:07.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.927+0000 7fda8686d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda800b0dc0 con 0x7fda80070f30 2023-07-21T22:20:07.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.927+0000 7fda8686d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda800b1010 con 0x7fda80069430 2023-07-21T22:20:07.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.927+0000 7fda84e0a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda800af2b0 0x7fda801512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.927+0000 7fda84e0a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda800af2b0 0x7fda801512b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45674/0 (socket says 172.21.15.6:45674) 2023-07-21T22:20:07.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.927+0000 7fda84e0a640 1 -- 172.21.15.6:0/1484746489 learned_addr learned my addr 172.21.15.6:0/1484746489 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:07.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.927+0000 7fda7f7fe640 1 --2- 172.21.15.6:0/1484746489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda80070f30 0x7fda80155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.931+0000 7fda7ffff640 1 --2- 172.21.15.6:0/1484746489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda80069430 0x7fda80145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.931+0000 7fda84e0a640 1 -- 172.21.15.6:0/1484746489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda80069430 msgr2=0x7fda80145b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.931+0000 7fda84e0a640 1 --2- 172.21.15.6:0/1484746489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda80069430 0x7fda80145b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.931+0000 7fda84e0a640 1 -- 172.21.15.6:0/1484746489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda80070f30 msgr2=0x7fda80155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.931+0000 7fda84e0a640 1 --2- 172.21.15.6:0/1484746489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda80070f30 0x7fda80155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.931+0000 7fda84e0a640 1 -- 172.21.15.6:0/1484746489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda700094d0 con 0x7fda800af2b0 2023-07-21T22:20:07.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.931+0000 7fda84e0a640 1 --2- 172.21.15.6:0/1484746489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda800af2b0 0x7fda801512b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fda7800c780 tx=0x7fda7800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:07.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.931+0000 7fda7cff9640 1 -- 172.21.15.6:0/1484746489 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78004b70 con 0x7fda800af2b0 2023-07-21T22:20:07.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.931+0000 7fda7cff9640 1 -- 172.21.15.6:0/1484746489 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7800ce90 con 0x7fda800af2b0 2023-07-21T22:20:07.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.931+0000 7fda7cff9640 1 -- 172.21.15.6:0/1484746489 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7800a850 con 0x7fda800af2b0 2023-07-21T22:20:07.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.931+0000 7fda8686d640 1 -- 172.21.15.6:0/1484746489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda800b12f0 con 0x7fda800af2b0 2023-07-21T22:20:07.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.931+0000 7fda8686d640 1 -- 172.21.15.6:0/1484746489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda800b18b0 con 0x7fda800af2b0 2023-07-21T22:20:07.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.931+0000 7fda8686d640 1 -- 172.21.15.6:0/1484746489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda800b1ad0 con 0x7fda800af2b0 2023-07-21T22:20:07.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.931+0000 7fda7cff9640 1 -- 172.21.15.6:0/1484746489 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fda7800a9b0 con 0x7fda800af2b0 2023-07-21T22:20:07.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.931+0000 7fda7cff9640 1 --2- 172.21.15.6:0/1484746489 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fda6c066480 0x7fda6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.935+0000 7fda7cff9640 1 -- 172.21.15.6:0/1484746489 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fda78084220 con 0x7fda800af2b0 2023-07-21T22:20:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.935+0000 7fda7ffff640 1 --2- 172.21.15.6:0/1484746489 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fda6c066480 0x7fda6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.935+0000 7fda7ffff640 1 --2- 172.21.15.6:0/1484746489 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fda6c066480 0x7fda6c068930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fda700af000 tx=0x7fda700b6040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:07.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:07.939+0000 7fda7cff9640 1 -- 172.21.15.6:0/1484746489 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fda780513e0 con 0x7fda800af2b0 2023-07-21T22:20:08.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.111+0000 7fda8686d640 1 -- 172.21.15.6:0/1484746489 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fda80157710 con 0x7fda6c066480 2023-07-21T22:20:08.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.159+0000 7fda7cff9640 1 -- 172.21.15.6:0/1484746489 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fda700ab8e0 con 0x7fda6c066480 2023-07-21T22:20:08.206 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule activated for path /snap_test_dir1/dir0 2023-07-21T22:20:08.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.159+0000 7fda8686d640 1 -- 172.21.15.6:0/1484746489 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fda6c066480 msgr2=0x7fda6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.159+0000 7fda8686d640 1 --2- 172.21.15.6:0/1484746489 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fda6c066480 0x7fda6c068930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fda700af000 tx=0x7fda700b6040 comp rx=0 tx=0).stop 2023-07-21T22:20:08.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.159+0000 7fda8686d640 1 -- 172.21.15.6:0/1484746489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda800af2b0 msgr2=0x7fda801512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.159+0000 7fda8686d640 1 --2- 172.21.15.6:0/1484746489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda800af2b0 0x7fda801512b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fda7800c780 tx=0x7fda7800cc40 comp rx=0 tx=0).stop 2023-07-21T22:20:08.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.159+0000 7fda8686d640 1 -- 172.21.15.6:0/1484746489 shutdown_connections 2023-07-21T22:20:08.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.159+0000 7fda8686d640 1 --2- 172.21.15.6:0/1484746489 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fda6c066480 0x7fda6c068930 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.159+0000 7fda8686d640 1 --2- 172.21.15.6:0/1484746489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda800af2b0 0x7fda801512b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.159+0000 7fda8686d640 1 --2- 172.21.15.6:0/1484746489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda80070f30 0x7fda80155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.159+0000 7fda8686d640 1 --2- 172.21.15.6:0/1484746489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda80069430 0x7fda80145b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.159+0000 7fda8686d640 1 -- 172.21.15.6:0/1484746489 >> 172.21.15.6:0/1484746489 conn(0x7fda800cde90 msgr2=0x7fda80156b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:08.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.159+0000 7fda8686d640 1 -- 172.21.15.6:0/1484746489 shutdown_connections 2023-07-21T22:20:08.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.159+0000 7fda8686d640 1 -- 172.21.15.6:0/1484746489 wait complete. 2023-07-21T22:20:08.228 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2023-07-21T22:20:08.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir1 1M 2023-07-21T22:20:08.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.331+0000 7fa203de9640 1 Processor -- start 2023-07-21T22:20:08.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.331+0000 7fa203de9640 1 -- start start 2023-07-21T22:20:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.331+0000 7fa203de9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1fc159440 0x7fa1fc0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.331+0000 7fa203de9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1fc1532b0 con 0x7fa1fc15cef0 2023-07-21T22:20:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.331+0000 7fa203de9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1fc0ca6f0 con 0x7fa1fc0aeb40 2023-07-21T22:20:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.331+0000 7fa203de9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc15d360 con 0x7fa1fc159440 2023-07-21T22:20:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.331+0000 7fa201384640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa1fc15cef0 0x7fa1fc158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33132/0 (socket says 172.21.15.6:33132) 2023-07-21T22:20:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.331+0000 7fa201384640 1 -- 172.21.15.6:0/317314128 learned_addr learned my addr 172.21.15.6:0/317314128 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:20:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.331+0000 7fa202386640 1 --2- 172.21.15.6:0/317314128 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1fc159440 0x7fa1fc0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.331+0000 7fa200b83640 1 -- 172.21.15.6:0/317314128 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360113905 0 0) 0x7fa1fc1532b0 con 0x7fa1fc15cef0 2023-07-21T22:20:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.331+0000 7fa200b83640 1 -- 172.21.15.6:0/317314128 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1e8003530 con 0x7fa1fc15cef0 2023-07-21T22:20:08.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.331+0000 7fa200b83640 1 -- 172.21.15.6:0/317314128 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484307393 0 0) 0x7fa1fc0ca6f0 con 0x7fa1fc0aeb40 2023-07-21T22:20:08.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.331+0000 7fa202386640 1 -- 172.21.15.6:0/317314128 >> v1:172.21.15.161:6789/0 conn(0x7fa1fc0aeb40 legacy=0x7fa1fc0aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.331+0000 7fa202386640 1 -- 172.21.15.6:0/317314128 >> v1:172.21.15.6:6789/0 conn(0x7fa1fc15cef0 legacy=0x7fa1fc158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.331+0000 7fa202386640 1 -- 172.21.15.6:0/317314128 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1fc1599d0 con 0x7fa1fc159440 2023-07-21T22:20:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.335+0000 7fa202386640 1 --2- 172.21.15.6:0/317314128 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1fc159440 0x7fa1fc0c88c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009dc0 tx=0x7fa1f401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=807085d4b504bc37 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.335+0000 7fa200b83640 1 -- 172.21.15.6:0/317314128 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f40a5a00 con 0x7fa1fc159440 2023-07-21T22:20:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.335+0000 7fa200b83640 1 -- 172.21.15.6:0/317314128 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f40a5b60 con 0x7fa1fc159440 2023-07-21T22:20:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.335+0000 7fa200b83640 1 -- 172.21.15.6:0/317314128 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f40ad440 con 0x7fa1fc159440 2023-07-21T22:20:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.335+0000 7fa203de9640 1 -- 172.21.15.6:0/317314128 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1fc159440 msgr2=0x7fa1fc0c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.335+0000 7fa203de9640 1 --2- 172.21.15.6:0/317314128 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1fc159440 0x7fa1fc0c88c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009dc0 tx=0x7fa1f401c940 comp rx=0 tx=0).stop 2023-07-21T22:20:08.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.335+0000 7fa203de9640 1 -- 172.21.15.6:0/317314128 shutdown_connections 2023-07-21T22:20:08.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.335+0000 7fa203de9640 1 --2- 172.21.15.6:0/317314128 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1fc159440 0x7fa1fc0c88c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.335+0000 7fa203de9640 1 -- 172.21.15.6:0/317314128 >> 172.21.15.6:0/317314128 conn(0x7fa1fc0cde90 msgr2=0x7fa1fc0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:08.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.335+0000 7fa203de9640 1 -- 172.21.15.6:0/317314128 shutdown_connections 2023-07-21T22:20:08.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.335+0000 7fa203de9640 1 -- 172.21.15.6:0/317314128 wait complete. 2023-07-21T22:20:08.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa203de9640 1 Processor -- start 2023-07-21T22:20:08.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa203de9640 1 -- start start 2023-07-21T22:20:08.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa203de9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1fc0aeb40 0x7fa1fc14bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa203de9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1fc159440 0x7fa1fc15a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa203de9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1fc15cef0 0x7fa1fc0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa203de9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc1588f0 con 0x7fa1fc0aeb40 2023-07-21T22:20:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa203de9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc06a1b0 con 0x7fa1fc159440 2023-07-21T22:20:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa203de9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc14c7f0 con 0x7fa1fc15cef0 2023-07-21T22:20:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa201b85640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1fc0aeb40 0x7fa1fc14bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa201b85640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1fc0aeb40 0x7fa1fc14bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45676/0 (socket says 172.21.15.6:45676) 2023-07-21T22:20:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa201b85640 1 -- 172.21.15.6:0/2413831997 learned_addr learned my addr 172.21.15.6:0/2413831997 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa201384640 1 --2- 172.21.15.6:0/2413831997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1fc159440 0x7fa1fc15a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa202386640 1 --2- 172.21.15.6:0/2413831997 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1fc15cef0 0x7fa1fc0700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa201b85640 1 -- 172.21.15.6:0/2413831997 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1fc15cef0 msgr2=0x7fa1fc0700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa201b85640 1 --2- 172.21.15.6:0/2413831997 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1fc15cef0 0x7fa1fc0700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa201b85640 1 -- 172.21.15.6:0/2413831997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1fc159440 msgr2=0x7fa1fc15a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa201b85640 1 --2- 172.21.15.6:0/2413831997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1fc159440 0x7fa1fc15a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa201b85640 1 -- 172.21.15.6:0/2413831997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f4009a70 con 0x7fa1fc0aeb40 2023-07-21T22:20:08.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa201b85640 1 --2- 172.21.15.6:0/2413831997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1fc0aeb40 0x7fa1fc14bf90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800c4d0 tx=0x7fa1f800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa1f27fc640 1 -- 172.21.15.6:0/2413831997 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8005480 con 0x7fa1fc0aeb40 2023-07-21T22:20:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa1f27fc640 1 -- 172.21.15.6:0/2413831997 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f8003600 con 0x7fa1fc0aeb40 2023-07-21T22:20:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa1f27fc640 1 -- 172.21.15.6:0/2413831997 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f80039b0 con 0x7fa1fc0aeb40 2023-07-21T22:20:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa203de9640 1 -- 172.21.15.6:0/2413831997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1fc069f10 con 0x7fa1fc0aeb40 2023-07-21T22:20:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa203de9640 1 -- 172.21.15.6:0/2413831997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1fc0b1200 con 0x7fa1fc0aeb40 2023-07-21T22:20:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.339+0000 7fa203de9640 1 -- 172.21.15.6:0/2413831997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1fc0678d0 con 0x7fa1fc0aeb40 2023-07-21T22:20:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.343+0000 7fa1f27fc640 1 -- 172.21.15.6:0/2413831997 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fa1f8003b10 con 0x7fa1fc0aeb40 2023-07-21T22:20:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.343+0000 7fa1f27fc640 1 --2- 172.21.15.6:0/2413831997 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fa1e0066480 0x7fa1e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.343+0000 7fa1f27fc640 1 -- 172.21.15.6:0/2413831997 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fa1f80836f0 con 0x7fa1fc0aeb40 2023-07-21T22:20:08.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.343+0000 7fa201384640 1 --2- 172.21.15.6:0/2413831997 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fa1e0066480 0x7fa1e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.343+0000 7fa201384640 1 --2- 172.21.15.6:0/2413831997 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fa1e0066480 0x7fa1e0068930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec007fd0 tx=0x7fa1ec009040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:08.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.347+0000 7fa1f27fc640 1 -- 172.21.15.6:0/2413831997 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa1f8050990 con 0x7fa1fc0aeb40 2023-07-21T22:20:08.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.519+0000 7fa203de9640 1 -- 172.21.15.6:0/2413831997 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1fc15c9d0 con 0x7fa1e0066480 2023-07-21T22:20:08.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.571+0000 7fa1f27fc640 1 -- 172.21.15.6:0/2413831997 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fa1ec001480 con 0x7fa1e0066480 2023-07-21T22:20:08.621 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule activated for path /snap_test_dir1/dir1 2023-07-21T22:20:08.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.575+0000 7fa203de9640 1 -- 172.21.15.6:0/2413831997 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fa1e0066480 msgr2=0x7fa1e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.575+0000 7fa203de9640 1 --2- 172.21.15.6:0/2413831997 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fa1e0066480 0x7fa1e0068930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec007fd0 tx=0x7fa1ec009040 comp rx=0 tx=0).stop 2023-07-21T22:20:08.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.575+0000 7fa203de9640 1 -- 172.21.15.6:0/2413831997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1fc0aeb40 msgr2=0x7fa1fc14bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.575+0000 7fa203de9640 1 --2- 172.21.15.6:0/2413831997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1fc0aeb40 0x7fa1fc14bf90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa1f800c4d0 tx=0x7fa1f800c990 comp rx=0 tx=0).stop 2023-07-21T22:20:08.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.575+0000 7fa203de9640 1 -- 172.21.15.6:0/2413831997 shutdown_connections 2023-07-21T22:20:08.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.575+0000 7fa203de9640 1 --2- 172.21.15.6:0/2413831997 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fa1e0066480 0x7fa1e0068930 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.575+0000 7fa203de9640 1 --2- 172.21.15.6:0/2413831997 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1fc15cef0 0x7fa1fc0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.575+0000 7fa203de9640 1 --2- 172.21.15.6:0/2413831997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1fc159440 0x7fa1fc15a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.575+0000 7fa203de9640 1 --2- 172.21.15.6:0/2413831997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1fc0aeb40 0x7fa1fc14bf90 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.575+0000 7fa203de9640 1 -- 172.21.15.6:0/2413831997 >> 172.21.15.6:0/2413831997 conn(0x7fa1fc0cde90 msgr2=0x7fa1fc0aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:08.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.575+0000 7fa203de9640 1 -- 172.21.15.6:0/2413831997 shutdown_connections 2023-07-21T22:20:08.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.575+0000 7fa203de9640 1 -- 172.21.15.6:0/2413831997 wait complete. 2023-07-21T22:20:08.641 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2023-07-21T22:20:08.642 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir2 1M 2023-07-21T22:20:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.743+0000 7fcb3cf96640 1 Processor -- start 2023-07-21T22:20:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.743+0000 7fcb3cf96640 1 -- start start 2023-07-21T22:20:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.747+0000 7fcb3cf96640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcb38070f30 0x7fcb380ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.747+0000 7fcb3cf96640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb380af2b0 0x7fcb3815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.747+0000 7fcb3cf96640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb38159d70 con 0x7fcb38069430 2023-07-21T22:20:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.747+0000 7fcb3cf96640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb380c9c60 con 0x7fcb38070f30 2023-07-21T22:20:08.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.747+0000 7fcb3cf96640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb380c9f40 con 0x7fcb380af2b0 2023-07-21T22:20:08.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.747+0000 7fcb2ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcb38070f30 0x7fcb380ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.747+0000 7fcb2ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcb38070f30 0x7fcb380ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45682/0 (socket says 172.21.15.6:45682) 2023-07-21T22:20:08.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.747+0000 7fcb2ffff640 1 -- 172.21.15.6:0/688569371 learned_addr learned my addr 172.21.15.6:0/688569371 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:08.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.747+0000 7fcb36d9d640 1 --2- 172.21.15.6:0/688569371 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb380af2b0 0x7fcb3815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.747+0000 7fcb2ffff640 1 -- 172.21.15.6:0/688569371 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb380af2b0 msgr2=0x7fcb3815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:08.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.747+0000 7fcb2ffff640 1 --2- 172.21.15.6:0/688569371 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb380af2b0 0x7fcb3815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.747+0000 7fcb2ffff640 1 -- 172.21.15.6:0/688569371 >> v1:172.21.15.6:6789/0 conn(0x7fcb38069430 legacy=0x7fcb38069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.747+0000 7fcb2ffff640 1 -- 172.21.15.6:0/688569371 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb380ca220 con 0x7fcb38070f30 2023-07-21T22:20:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.751+0000 7fcb2ffff640 1 --2- 172.21.15.6:0/688569371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb38070f30 0x7fcb380ad6f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009870 tx=0x7fcb2001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee59d374dd2fc572 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.751+0000 7fcb35d9b640 1 -- 172.21.15.6:0/688569371 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb200a9400 con 0x7fcb38070f30 2023-07-21T22:20:08.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.751+0000 7fcb35d9b640 1 -- 172.21.15.6:0/688569371 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb200a9560 con 0x7fcb38070f30 2023-07-21T22:20:08.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.751+0000 7fcb35d9b640 1 -- 172.21.15.6:0/688569371 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb200a98f0 con 0x7fcb38070f30 2023-07-21T22:20:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.751+0000 7fcb3cf96640 1 -- 172.21.15.6:0/688569371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb38070f30 msgr2=0x7fcb380ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.751+0000 7fcb3cf96640 1 --2- 172.21.15.6:0/688569371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb38070f30 0x7fcb380ad6f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009870 tx=0x7fcb2001c540 comp rx=0 tx=0).stop 2023-07-21T22:20:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.751+0000 7fcb3cf96640 1 -- 172.21.15.6:0/688569371 shutdown_connections 2023-07-21T22:20:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.751+0000 7fcb3cf96640 1 --2- 172.21.15.6:0/688569371 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb380af2b0 0x7fcb3815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.751+0000 7fcb3cf96640 1 --2- 172.21.15.6:0/688569371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb38070f30 0x7fcb380ad6f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.751+0000 7fcb3cf96640 1 -- 172.21.15.6:0/688569371 >> 172.21.15.6:0/688569371 conn(0x7fcb380cde90 msgr2=0x7fcb380ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.751+0000 7fcb3cf96640 1 -- 172.21.15.6:0/688569371 shutdown_connections 2023-07-21T22:20:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.751+0000 7fcb3cf96640 1 -- 172.21.15.6:0/688569371 wait complete. 2023-07-21T22:20:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.751+0000 7fcb3cf96640 1 Processor -- start 2023-07-21T22:20:08.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.751+0000 7fcb3cf96640 1 -- start start 2023-07-21T22:20:08.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb3cf96640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb38069430 0x7fcb3806bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb3cf96640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb38070f30 0x7fcb380cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb3cf96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb380af2b0 0x7fcb380cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb3cf96640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb380cc0c0 con 0x7fcb380af2b0 2023-07-21T22:20:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb3cf96640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb38154a00 con 0x7fcb38069430 2023-07-21T22:20:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb3cf96640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb38154ce0 con 0x7fcb38070f30 2023-07-21T22:20:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb36d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb380af2b0 0x7fcb380cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb36d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb380af2b0 0x7fcb380cbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45698/0 (socket says 172.21.15.6:45698) 2023-07-21T22:20:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb36d9d640 1 -- 172.21.15.6:0/1968975635 learned_addr learned my addr 172.21.15.6:0/1968975635 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb3659c640 1 --2- 172.21.15.6:0/1968975635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb38069430 0x7fcb3806bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb2ffff640 1 --2- 172.21.15.6:0/1968975635 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb38070f30 0x7fcb380cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb36d9d640 1 -- 172.21.15.6:0/1968975635 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb38070f30 msgr2=0x7fcb380cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb36d9d640 1 --2- 172.21.15.6:0/1968975635 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb38070f30 0x7fcb380cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb36d9d640 1 -- 172.21.15.6:0/1968975635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb38069430 msgr2=0x7fcb3806bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb36d9d640 1 --2- 172.21.15.6:0/1968975635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb38069430 0x7fcb3806bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb36d9d640 1 -- 172.21.15.6:0/1968975635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb200094d0 con 0x7fcb380af2b0 2023-07-21T22:20:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb3659c640 1 --2- 172.21.15.6:0/1968975635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb38069430 0x7fcb3806bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb36d9d640 1 --2- 172.21.15.6:0/1968975635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb380af2b0 0x7fcb380cbb80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcb30007e40 tx=0x7fcb3000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb2effd640 1 -- 172.21.15.6:0/1968975635 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb30014620 con 0x7fcb380af2b0 2023-07-21T22:20:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb3cf96640 1 -- 172.21.15.6:0/1968975635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb38154fc0 con 0x7fcb380af2b0 2023-07-21T22:20:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb2effd640 1 -- 172.21.15.6:0/1968975635 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3000ee90 con 0x7fcb380af2b0 2023-07-21T22:20:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb2effd640 1 -- 172.21.15.6:0/1968975635 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb300149e0 con 0x7fcb380af2b0 2023-07-21T22:20:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb3cf96640 1 -- 172.21.15.6:0/1968975635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3806c270 con 0x7fcb380af2b0 2023-07-21T22:20:08.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb3cf96640 1 -- 172.21.15.6:0/1968975635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3806c460 con 0x7fcb380af2b0 2023-07-21T22:20:08.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.755+0000 7fcb2effd640 1 -- 172.21.15.6:0/1968975635 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fcb30014b40 con 0x7fcb380af2b0 2023-07-21T22:20:08.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.759+0000 7fcb2effd640 1 --2- 172.21.15.6:0/1968975635 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fcb18066480 0x7fcb18068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.759+0000 7fcb2effd640 1 -- 172.21.15.6:0/1968975635 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fcb30084bb0 con 0x7fcb380af2b0 2023-07-21T22:20:08.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.759+0000 7fcb3659c640 1 --2- 172.21.15.6:0/1968975635 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fcb18066480 0x7fcb18068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.759+0000 7fcb3659c640 1 --2- 172.21.15.6:0/1968975635 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fcb18066480 0x7fcb18068930 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcb28000f70 tx=0x7fcb28009040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:08.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.759+0000 7fcb2effd640 1 -- 172.21.15.6:0/1968975635 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcb3806c460 con 0x7fcb380af2b0 2023-07-21T22:20:08.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.939+0000 7fcb3cf96640 1 -- 172.21.15.6:0/1968975635 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb38157710 con 0x7fcb18066480 2023-07-21T22:20:09.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.991+0000 7fcb2effd640 1 -- 172.21.15.6:0/1968975635 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fcb28001ca0 con 0x7fcb18066480 2023-07-21T22:20:09.041 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule activated for path /snap_test_dir1/dir2 2023-07-21T22:20:09.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.995+0000 7fcb3cf96640 1 -- 172.21.15.6:0/1968975635 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fcb18066480 msgr2=0x7fcb18068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:09.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.995+0000 7fcb3cf96640 1 --2- 172.21.15.6:0/1968975635 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fcb18066480 0x7fcb18068930 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcb28000f70 tx=0x7fcb28009040 comp rx=0 tx=0).stop 2023-07-21T22:20:09.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.995+0000 7fcb3cf96640 1 -- 172.21.15.6:0/1968975635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb380af2b0 msgr2=0x7fcb380cbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:09.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.995+0000 7fcb3cf96640 1 --2- 172.21.15.6:0/1968975635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb380af2b0 0x7fcb380cbb80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcb30007e40 tx=0x7fcb3000e4b0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.995+0000 7fcb3cf96640 1 -- 172.21.15.6:0/1968975635 shutdown_connections 2023-07-21T22:20:09.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.995+0000 7fcb3cf96640 1 --2- 172.21.15.6:0/1968975635 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fcb18066480 0x7fcb18068930 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.995+0000 7fcb3cf96640 1 --2- 172.21.15.6:0/1968975635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb380af2b0 0x7fcb380cbb80 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.995+0000 7fcb3cf96640 1 --2- 172.21.15.6:0/1968975635 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb38070f30 0x7fcb380cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.995+0000 7fcb3cf96640 1 --2- 172.21.15.6:0/1968975635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb38069430 0x7fcb3806bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.995+0000 7fcb3cf96640 1 -- 172.21.15.6:0/1968975635 >> 172.21.15.6:0/1968975635 conn(0x7fcb380cde90 msgr2=0x7fcb3806b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:09.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.995+0000 7fcb3cf96640 1 -- 172.21.15.6:0/1968975635 shutdown_connections 2023-07-21T22:20:09.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:08.995+0000 7fcb3cf96640 1 -- 172.21.15.6:0/1968975635 wait complete. 2023-07-21T22:20:09.062 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2023-07-21T22:20:09.062 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir3 1M 2023-07-21T22:20:09.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.163+0000 7fd22dbfa640 1 Processor -- start 2023-07-21T22:20:09.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.163+0000 7fd22dbfa640 1 -- start start 2023-07-21T22:20:09.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.163+0000 7fd22dbfa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2280aeb40 0x7fd22815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:09.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.163+0000 7fd22dbfa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd2280aef10 0x7fd228158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:09.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.163+0000 7fd22dbfa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd228159270 0x7fd2280c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:09.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.163+0000 7fd22dbfa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2281532b0 con 0x7fd2280aeb40 2023-07-21T22:20:09.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.163+0000 7fd22dbfa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2280ca6f0 con 0x7fd2280aef10 2023-07-21T22:20:09.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.163+0000 7fd22dbfa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2281599d0 con 0x7fd228159270 2023-07-21T22:20:09.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.163+0000 7fd2277fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2280aeb40 0x7fd22815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:09.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.163+0000 7fd2277fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2280aeb40 0x7fd22815cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45706/0 (socket says 172.21.15.6:45706) 2023-07-21T22:20:09.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.163+0000 7fd2277fe640 1 -- 172.21.15.6:0/2637300502 learned_addr learned my addr 172.21.15.6:0/2637300502 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:09.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.163+0000 7fd226ffd640 1 --2- 172.21.15.6:0/2637300502 >> v2:172.21.15.161:3300/0 conn(0x7fd2280aef10 0x7fd228158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:09.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.163+0000 7fd227fff640 1 --2- 172.21.15.6:0/2637300502 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd228159270 0x7fd2280c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:09.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.167+0000 7fd2277fe640 1 -- 172.21.15.6:0/2637300502 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd228159270 msgr2=0x7fd2280c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:09.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.167+0000 7fd2277fe640 1 --2- 172.21.15.6:0/2637300502 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd228159270 0x7fd2280c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.167+0000 7fd2277fe640 1 -- 172.21.15.6:0/2637300502 >> v2:172.21.15.161:3300/0 conn(0x7fd2280aef10 msgr2=0x7fd228158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:09.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.167+0000 7fd2277fe640 1 --2- 172.21.15.6:0/2637300502 >> v2:172.21.15.161:3300/0 conn(0x7fd2280aef10 0x7fd228158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.167+0000 7fd2277fe640 1 -- 172.21.15.6:0/2637300502 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd228159cb0 con 0x7fd2280aeb40 2023-07-21T22:20:09.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.167+0000 7fd227fff640 1 --2- 172.21.15.6:0/2637300502 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd228159270 0x7fd2280c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:09.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.167+0000 7fd226ffd640 1 --2- 172.21.15.6:0/2637300502 >> v2:172.21.15.161:3300/0 conn(0x7fd2280aef10 0x7fd228158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:09.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.167+0000 7fd2277fe640 1 --2- 172.21.15.6:0/2637300502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2280aeb40 0x7fd22815cef0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd2280cee90 tx=0x7fd21801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c1994adb6b1c6e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.167+0000 7fd2267fc640 1 -- 172.21.15.6:0/2637300502 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2180ab600 con 0x7fd2280aeb40 2023-07-21T22:20:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.167+0000 7fd2267fc640 1 -- 172.21.15.6:0/2637300502 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2180ab760 con 0x7fd2280aeb40 2023-07-21T22:20:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.167+0000 7fd2267fc640 1 -- 172.21.15.6:0/2637300502 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2180abaf0 con 0x7fd2280aeb40 2023-07-21T22:20:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.167+0000 7fd22dbfa640 1 -- 172.21.15.6:0/2637300502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2280aeb40 msgr2=0x7fd22815cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.167+0000 7fd22dbfa640 1 --2- 172.21.15.6:0/2637300502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2280aeb40 0x7fd22815cef0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd2280cee90 tx=0x7fd21801c440 comp rx=0 tx=0).stop 2023-07-21T22:20:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.167+0000 7fd22dbfa640 1 -- 172.21.15.6:0/2637300502 shutdown_connections 2023-07-21T22:20:09.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.167+0000 7fd22dbfa640 1 --2- 172.21.15.6:0/2637300502 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd228159270 0x7fd2280c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.167+0000 7fd22dbfa640 1 --2- 172.21.15.6:0/2637300502 >> v2:172.21.15.161:3300/0 conn(0x7fd2280aef10 0x7fd228158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.167+0000 7fd22dbfa640 1 --2- 172.21.15.6:0/2637300502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2280aeb40 0x7fd22815cef0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.167+0000 7fd22dbfa640 1 -- 172.21.15.6:0/2637300502 >> 172.21.15.6:0/2637300502 conn(0x7fd2280cde90 msgr2=0x7fd2280ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.167+0000 7fd22dbfa640 1 -- 172.21.15.6:0/2637300502 shutdown_connections 2023-07-21T22:20:09.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.171+0000 7fd22dbfa640 1 -- 172.21.15.6:0/2637300502 wait complete. 2023-07-21T22:20:09.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.171+0000 7fd22dbfa640 1 Processor -- start 2023-07-21T22:20:09.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.171+0000 7fd22dbfa640 1 -- start start 2023-07-21T22:20:09.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.171+0000 7fd22dbfa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2280aeb40 0x7fd228159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:09.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.171+0000 7fd22dbfa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2280aef10 0x7fd2281f7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:09.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.171+0000 7fd22dbfa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd228159270 0x7fd22814e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:09.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.171+0000 7fd22dbfa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2281f8410 con 0x7fd228159270 2023-07-21T22:20:09.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.171+0000 7fd22dbfa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22814ec00 con 0x7fd2280aeb40 2023-07-21T22:20:09.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.171+0000 7fd22dbfa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22815a560 con 0x7fd2280aef10 2023-07-21T22:20:09.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.171+0000 7fd227fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd228159270 0x7fd22814e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:09.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.171+0000 7fd227fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd228159270 0x7fd22814e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45722/0 (socket says 172.21.15.6:45722) 2023-07-21T22:20:09.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.171+0000 7fd227fff640 1 -- 172.21.15.6:0/2110503230 learned_addr learned my addr 172.21.15.6:0/2110503230 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:09.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.171+0000 7fd2277fe640 1 --2- 172.21.15.6:0/2110503230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2280aeb40 0x7fd228159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:09.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.171+0000 7fd226ffd640 1 --2- 172.21.15.6:0/2110503230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2280aef10 0x7fd2281f7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:09.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.171+0000 7fd227fff640 1 -- 172.21.15.6:0/2110503230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2280aef10 msgr2=0x7fd2281f7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:09.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.171+0000 7fd227fff640 1 --2- 172.21.15.6:0/2110503230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2280aef10 0x7fd2281f7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.171+0000 7fd227fff640 1 -- 172.21.15.6:0/2110503230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2280aeb40 msgr2=0x7fd228159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:09.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.171+0000 7fd227fff640 1 --2- 172.21.15.6:0/2110503230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2280aeb40 0x7fd228159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.171+0000 7fd227fff640 1 -- 172.21.15.6:0/2110503230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2180094d0 con 0x7fd228159270 2023-07-21T22:20:09.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.171+0000 7fd227fff640 1 --2- 172.21.15.6:0/2110503230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd228159270 0x7fd22814e330 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd220007ea0 tx=0x7fd220007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:09.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.175+0000 7fd20ffff640 1 -- 172.21.15.6:0/2110503230 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220003ba0 con 0x7fd228159270 2023-07-21T22:20:09.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.175+0000 7fd20ffff640 1 -- 172.21.15.6:0/2110503230 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22000f040 con 0x7fd228159270 2023-07-21T22:20:09.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.175+0000 7fd20ffff640 1 -- 172.21.15.6:0/2110503230 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22000de70 con 0x7fd228159270 2023-07-21T22:20:09.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.175+0000 7fd22dbfa640 1 -- 172.21.15.6:0/2110503230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22815a840 con 0x7fd228159270 2023-07-21T22:20:09.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.175+0000 7fd22dbfa640 1 -- 172.21.15.6:0/2110503230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22815ae00 con 0x7fd228159270 2023-07-21T22:20:09.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.175+0000 7fd22dbfa640 1 -- 172.21.15.6:0/2110503230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2280678d0 con 0x7fd228159270 2023-07-21T22:20:09.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.175+0000 7fd20ffff640 1 -- 172.21.15.6:0/2110503230 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fd220004030 con 0x7fd228159270 2023-07-21T22:20:09.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.175+0000 7fd20ffff640 1 --2- 172.21.15.6:0/2110503230 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fd214066480 0x7fd214068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:09.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.175+0000 7fd20ffff640 1 -- 172.21.15.6:0/2110503230 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fd2200844d0 con 0x7fd228159270 2023-07-21T22:20:09.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.175+0000 7fd2277fe640 1 --2- 172.21.15.6:0/2110503230 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fd214066480 0x7fd214068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:09.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.179+0000 7fd2277fe640 1 --2- 172.21.15.6:0/2110503230 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fd214066480 0x7fd214068930 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd2180af000 tx=0x7fd2180b6040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:09.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.179+0000 7fd20ffff640 1 -- 172.21.15.6:0/2110503230 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd220051620 con 0x7fd228159270 2023-07-21T22:20:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.355+0000 7fd22dbfa640 1 -- 172.21.15.6:0/2110503230 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd228159670 con 0x7fd214066480 2023-07-21T22:20:09.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.403+0000 7fd20ffff640 1 -- 172.21.15.6:0/2110503230 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fd2180ab8d0 con 0x7fd214066480 2023-07-21T22:20:09.452 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule activated for path /snap_test_dir1/dir3 2023-07-21T22:20:09.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.407+0000 7fd22dbfa640 1 -- 172.21.15.6:0/2110503230 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fd214066480 msgr2=0x7fd214068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:09.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.407+0000 7fd22dbfa640 1 --2- 172.21.15.6:0/2110503230 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fd214066480 0x7fd214068930 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd2180af000 tx=0x7fd2180b6040 comp rx=0 tx=0).stop 2023-07-21T22:20:09.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.407+0000 7fd22dbfa640 1 -- 172.21.15.6:0/2110503230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd228159270 msgr2=0x7fd22814e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.407+0000 7fd22dbfa640 1 --2- 172.21.15.6:0/2110503230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd228159270 0x7fd22814e330 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd220007ea0 tx=0x7fd220007f90 comp rx=0 tx=0).stop 2023-07-21T22:20:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.407+0000 7fd22dbfa640 1 -- 172.21.15.6:0/2110503230 shutdown_connections 2023-07-21T22:20:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.407+0000 7fd22dbfa640 1 --2- 172.21.15.6:0/2110503230 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fd214066480 0x7fd214068930 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.407+0000 7fd22dbfa640 1 --2- 172.21.15.6:0/2110503230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd228159270 0x7fd22814e330 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.407+0000 7fd22dbfa640 1 --2- 172.21.15.6:0/2110503230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2280aef10 0x7fd2281f7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.407+0000 7fd22dbfa640 1 --2- 172.21.15.6:0/2110503230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2280aeb40 0x7fd228159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.407+0000 7fd22dbfa640 1 -- 172.21.15.6:0/2110503230 >> 172.21.15.6:0/2110503230 conn(0x7fd2280cde90 msgr2=0x7fd2280cb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:09.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.407+0000 7fd22dbfa640 1 -- 172.21.15.6:0/2110503230 shutdown_connections 2023-07-21T22:20:09.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.407+0000 7fd22dbfa640 1 -- 172.21.15.6:0/2110503230 wait complete. 2023-07-21T22:20:09.473 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2023-07-21T22:20:09.474 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir4 1M 2023-07-21T22:20:09.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.575+0000 7f2b765fa640 1 Processor -- start 2023-07-21T22:20:09.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.575+0000 7f2b765fa640 1 -- start start 2023-07-21T22:20:09.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.575+0000 7f2b765fa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2b7015bde0 0x7f2b700d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:09.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.575+0000 7f2b765fa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2b700d2300 0x7f2b700d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:09.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.575+0000 7f2b765fa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b700b04c0 con 0x7f2b700d2fc0 2023-07-21T22:20:09.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.575+0000 7f2b765fa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7015c1b0 con 0x7f2b700d2300 2023-07-21T22:20:09.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.575+0000 7f2b765fa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b700b1060 con 0x7f2b7015bde0 2023-07-21T22:20:09.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.575+0000 7f2b74b97640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2b700d2300 0x7f2b700d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:09.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.575+0000 7f2b74b97640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2b700d2300 0x7f2b700d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45738/0 (socket says 172.21.15.6:45738) 2023-07-21T22:20:09.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.575+0000 7f2b74b97640 1 -- 172.21.15.6:0/825511617 learned_addr learned my addr 172.21.15.6:0/825511617 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:09.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.575+0000 7f2b6ffff640 1 --2- 172.21.15.6:0/825511617 >> v2:172.21.15.161:3300/0 conn(0x7f2b7015bde0 0x7f2b700d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:09.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.575+0000 7f2b74b97640 1 -- 172.21.15.6:0/825511617 >> v2:172.21.15.161:3300/0 conn(0x7f2b7015bde0 msgr2=0x7f2b700d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:09.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.575+0000 7f2b74b97640 1 --2- 172.21.15.6:0/825511617 >> v2:172.21.15.161:3300/0 conn(0x7f2b7015bde0 0x7f2b700d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.575+0000 7f2b74b97640 1 -- 172.21.15.6:0/825511617 >> v1:172.21.15.161:6789/0 conn(0x7f2b700d2fc0 legacy=0x7f2b700b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:09.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.575+0000 7f2b74b97640 1 -- 172.21.15.6:0/825511617 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b700d2c80 con 0x7f2b700d2300 2023-07-21T22:20:09.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.575+0000 7f2b6ffff640 1 --2- 172.21.15.6:0/825511617 >> v2:172.21.15.161:3300/0 conn(0x7f2b7015bde0 0x7f2b700d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:20:09.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.579+0000 7f2b74b97640 1 --2- 172.21.15.6:0/825511617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b700d2300 0x7f2b700d2740 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2b7008b210 tx=0x7f2b6801c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b24d5eb721f1f22 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:09.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.579+0000 7f2b6effd640 1 -- 172.21.15.6:0/825511617 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b680a5760 con 0x7f2b700d2300 2023-07-21T22:20:09.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.579+0000 7f2b6effd640 1 -- 172.21.15.6:0/825511617 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b680a58c0 con 0x7f2b700d2300 2023-07-21T22:20:09.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.579+0000 7f2b6effd640 1 -- 172.21.15.6:0/825511617 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b680a5c50 con 0x7f2b700d2300 2023-07-21T22:20:09.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.579+0000 7f2b765fa640 1 -- 172.21.15.6:0/825511617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b700d2300 msgr2=0x7f2b700d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:09.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.579+0000 7f2b765fa640 1 --2- 172.21.15.6:0/825511617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b700d2300 0x7f2b700d2740 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2b7008b210 tx=0x7f2b6801c990 comp rx=0 tx=0).stop 2023-07-21T22:20:09.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.579+0000 7f2b765fa640 1 -- 172.21.15.6:0/825511617 shutdown_connections 2023-07-21T22:20:09.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.579+0000 7f2b765fa640 1 --2- 172.21.15.6:0/825511617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b700d2300 0x7f2b700d2740 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.579+0000 7f2b765fa640 1 --2- 172.21.15.6:0/825511617 >> v2:172.21.15.161:3300/0 conn(0x7f2b7015bde0 0x7f2b700d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.579+0000 7f2b765fa640 1 -- 172.21.15.6:0/825511617 >> 172.21.15.6:0/825511617 conn(0x7f2b700659d0 msgr2=0x7f2b7009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:09.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.579+0000 7f2b765fa640 1 -- 172.21.15.6:0/825511617 shutdown_connections 2023-07-21T22:20:09.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.579+0000 7f2b765fa640 1 -- 172.21.15.6:0/825511617 wait complete. 2023-07-21T22:20:09.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b765fa640 1 Processor -- start 2023-07-21T22:20:09.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b765fa640 1 -- start start 2023-07-21T22:20:09.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b765fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b700d2300 0x7f2b7015c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:09.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b765fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b700d2fc0 0x7f2b7015c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:09.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b765fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b7015bde0 0x7f2b700b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:09.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b765fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7015f230 con 0x7f2b700d2300 2023-07-21T22:20:09.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b765fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700b5950 con 0x7f2b7015bde0 2023-07-21T22:20:09.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b765fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700b5340 con 0x7f2b700d2fc0 2023-07-21T22:20:09.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b6ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b700d2300 0x7f2b7015c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:09.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b6ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b700d2300 0x7f2b7015c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45746/0 (socket says 172.21.15.6:45746) 2023-07-21T22:20:09.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b6ffff640 1 -- 172.21.15.6:0/1252890384 learned_addr learned my addr 172.21.15.6:0/1252890384 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:09.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b6f7fe640 1 --2- 172.21.15.6:0/1252890384 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b700d2fc0 0x7f2b7015c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:09.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b74b97640 1 --2- 172.21.15.6:0/1252890384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b7015bde0 0x7f2b700b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:09.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b6ffff640 1 -- 172.21.15.6:0/1252890384 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b700d2fc0 msgr2=0x7f2b7015c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:09.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b6ffff640 1 --2- 172.21.15.6:0/1252890384 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b700d2fc0 0x7f2b7015c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b6ffff640 1 -- 172.21.15.6:0/1252890384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b7015bde0 msgr2=0x7f2b700b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:09.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b6ffff640 1 --2- 172.21.15.6:0/1252890384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b7015bde0 0x7f2b700b41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b6ffff640 1 -- 172.21.15.6:0/1252890384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b68009b30 con 0x7f2b700d2300 2023-07-21T22:20:09.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b6ffff640 1 --2- 172.21.15.6:0/1252890384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b700d2300 0x7f2b7015c2f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000c820 tx=0x7f2b6000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:09.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b6cff9640 1 -- 172.21.15.6:0/1252890384 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b60005ba0 con 0x7f2b700d2300 2023-07-21T22:20:09.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b6cff9640 1 -- 172.21.15.6:0/1252890384 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b60005d00 con 0x7f2b700d2300 2023-07-21T22:20:09.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b6cff9640 1 -- 172.21.15.6:0/1252890384 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b60007a50 con 0x7f2b700d2300 2023-07-21T22:20:09.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b765fa640 1 -- 172.21.15.6:0/1252890384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7014ee20 con 0x7f2b700d2300 2023-07-21T22:20:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.583+0000 7f2b765fa640 1 -- 172.21.15.6:0/1252890384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b700b55e0 con 0x7f2b700d2300 2023-07-21T22:20:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.587+0000 7f2b765fa640 1 -- 172.21.15.6:0/1252890384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b700b51a0 con 0x7f2b700d2300 2023-07-21T22:20:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.587+0000 7f2b6cff9640 1 -- 172.21.15.6:0/1252890384 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f2b60007bb0 con 0x7f2b700d2300 2023-07-21T22:20:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.587+0000 7f2b6cff9640 1 --2- 172.21.15.6:0/1252890384 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f2b5c066480 0x7f2b5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.587+0000 7f2b6cff9640 1 -- 172.21.15.6:0/1252890384 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f2b60084080 con 0x7f2b700d2300 2023-07-21T22:20:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.587+0000 7f2b6f7fe640 1 --2- 172.21.15.6:0/1252890384 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f2b5c066480 0x7f2b5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.587+0000 7f2b6f7fe640 1 --2- 172.21.15.6:0/1252890384 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f2b5c066480 0x7f2b5c068930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2b70070b30 tx=0x7f2b64007e40 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:09.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.591+0000 7f2b6cff9640 1 -- 172.21.15.6:0/1252890384 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2b600b4700 con 0x7f2b700d2300 2023-07-21T22:20:09.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.767+0000 7f2b765fa640 1 -- 172.21.15.6:0/1252890384 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b700d07b0 con 0x7f2b5c066480 2023-07-21T22:20:09.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.815+0000 7f2b6cff9640 1 -- 172.21.15.6:0/1252890384 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f2b64004c00 con 0x7f2b5c066480 2023-07-21T22:20:09.864 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule activated for path /snap_test_dir1/dir4 2023-07-21T22:20:09.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.819+0000 7f2b765fa640 1 -- 172.21.15.6:0/1252890384 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f2b5c066480 msgr2=0x7f2b5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:09.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.819+0000 7f2b765fa640 1 --2- 172.21.15.6:0/1252890384 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f2b5c066480 0x7f2b5c068930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2b70070b30 tx=0x7f2b64007e40 comp rx=0 tx=0).stop 2023-07-21T22:20:09.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.819+0000 7f2b765fa640 1 -- 172.21.15.6:0/1252890384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b700d2300 msgr2=0x7f2b7015c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:09.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.819+0000 7f2b765fa640 1 --2- 172.21.15.6:0/1252890384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b700d2300 0x7f2b7015c2f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000c820 tx=0x7f2b6000cce0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.819+0000 7f2b765fa640 1 -- 172.21.15.6:0/1252890384 shutdown_connections 2023-07-21T22:20:09.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.819+0000 7f2b765fa640 1 --2- 172.21.15.6:0/1252890384 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f2b5c066480 0x7f2b5c068930 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.819+0000 7f2b765fa640 1 --2- 172.21.15.6:0/1252890384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b7015bde0 0x7f2b700b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.819+0000 7f2b765fa640 1 --2- 172.21.15.6:0/1252890384 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b700d2fc0 0x7f2b7015c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.819+0000 7f2b765fa640 1 --2- 172.21.15.6:0/1252890384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b700d2300 0x7f2b7015c2f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:09.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.819+0000 7f2b765fa640 1 -- 172.21.15.6:0/1252890384 >> 172.21.15.6:0/1252890384 conn(0x7f2b700659d0 msgr2=0x7f2b700cdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:09.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.819+0000 7f2b765fa640 1 -- 172.21.15.6:0/1252890384 shutdown_connections 2023-07-21T22:20:09.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.819+0000 7f2b765fa640 1 -- 172.21.15.6:0/1252890384 wait complete. 2023-07-21T22:20:09.884 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2023-07-21T22:20:09.885 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir5 1M 2023-07-21T22:20:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.987+0000 7f91a5911640 1 Processor -- start 2023-07-21T22:20:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.987+0000 7f91a5911640 1 -- start start 2023-07-21T22:20:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.987+0000 7f91a5911640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91a00aeb40 0x7f91a015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.987+0000 7f91a5911640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f91a00aef10 0x7f91a0158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.987+0000 7f91a5911640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f91a0159270 0x7f91a00c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.987+0000 7f91a5911640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a01532b0 con 0x7f91a0159270 2023-07-21T22:20:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.987+0000 7f91a5911640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a00ca6f0 con 0x7f91a00aef10 2023-07-21T22:20:10.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.987+0000 7f91a5911640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a01599d0 con 0x7f91a00aeb40 2023-07-21T22:20:10.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.987+0000 7f919f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f91a0159270 0x7f91a00c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:10.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.987+0000 7f919f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f91a0159270 0x7f91a00c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45752/0 (socket says 172.21.15.6:45752) 2023-07-21T22:20:10.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.987+0000 7f919f7fe640 1 -- 172.21.15.6:0/2530009392 learned_addr learned my addr 172.21.15.6:0/2530009392 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:10.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.987+0000 7f919e7fc640 1 --2- 172.21.15.6:0/2530009392 >> v2:172.21.15.161:3300/0 conn(0x7f91a00aef10 0x7f91a0158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:10.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.987+0000 7f919effd640 1 --2- 172.21.15.6:0/2530009392 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91a00aeb40 0x7f91a015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:10.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.987+0000 7f919f7fe640 1 -- 172.21.15.6:0/2530009392 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91a00aeb40 msgr2=0x7f91a015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:10.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.987+0000 7f919f7fe640 1 --2- 172.21.15.6:0/2530009392 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91a00aeb40 0x7f91a015cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.987+0000 7f919f7fe640 1 -- 172.21.15.6:0/2530009392 >> v2:172.21.15.161:3300/0 conn(0x7f91a00aef10 msgr2=0x7f91a0158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:10.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.987+0000 7f919f7fe640 1 --2- 172.21.15.6:0/2530009392 >> v2:172.21.15.161:3300/0 conn(0x7f91a00aef10 0x7f91a0158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.987+0000 7f919f7fe640 1 -- 172.21.15.6:0/2530009392 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a0159cb0 con 0x7f91a0159270 2023-07-21T22:20:10.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.991+0000 7f919f7fe640 1 --2- 172.21.15.6:0/2530009392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a0159270 0x7f91a00c88c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f91a006ed50 tx=0x7f919801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e3795318d7ecc4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:10.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.991+0000 7f919dffb640 1 -- 172.21.15.6:0/2530009392 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91980a5790 con 0x7f91a0159270 2023-07-21T22:20:10.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.991+0000 7f919dffb640 1 -- 172.21.15.6:0/2530009392 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91980a58f0 con 0x7f91a0159270 2023-07-21T22:20:10.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.991+0000 7f919dffb640 1 -- 172.21.15.6:0/2530009392 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91980a5c80 con 0x7f91a0159270 2023-07-21T22:20:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.991+0000 7f91a5911640 1 -- 172.21.15.6:0/2530009392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a0159270 msgr2=0x7f91a00c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.991+0000 7f91a5911640 1 --2- 172.21.15.6:0/2530009392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a0159270 0x7f91a00c88c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f91a006ed50 tx=0x7f919801c910 comp rx=0 tx=0).stop 2023-07-21T22:20:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.991+0000 7f91a5911640 1 -- 172.21.15.6:0/2530009392 shutdown_connections 2023-07-21T22:20:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.991+0000 7f91a5911640 1 --2- 172.21.15.6:0/2530009392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a0159270 0x7f91a00c88c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.991+0000 7f91a5911640 1 --2- 172.21.15.6:0/2530009392 >> v2:172.21.15.161:3300/0 conn(0x7f91a00aef10 0x7f91a0158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.991+0000 7f91a5911640 1 --2- 172.21.15.6:0/2530009392 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91a00aeb40 0x7f91a015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.991+0000 7f91a5911640 1 -- 172.21.15.6:0/2530009392 >> 172.21.15.6:0/2530009392 conn(0x7f91a00cde90 msgr2=0x7f91a00ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.991+0000 7f91a5911640 1 -- 172.21.15.6:0/2530009392 shutdown_connections 2023-07-21T22:20:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.991+0000 7f91a5911640 1 -- 172.21.15.6:0/2530009392 wait complete. 2023-07-21T22:20:10.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f91a5911640 1 Processor -- start 2023-07-21T22:20:10.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f91a5911640 1 -- start start 2023-07-21T22:20:10.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f91a5911640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91a00aeb40 0x7f91a014f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:10.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f91a5911640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91a00aef10 0x7f91a014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:10.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f91a5911640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a0159270 0x7f91a014d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:10.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f91a5911640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a006cf80 con 0x7f91a0159270 2023-07-21T22:20:10.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f91a5911640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a006c370 con 0x7f91a00aeb40 2023-07-21T22:20:10.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f91a5911640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a006c650 con 0x7f91a00aef10 2023-07-21T22:20:10.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f919f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a0159270 0x7f91a014d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:10.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f919f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a0159270 0x7f91a014d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45754/0 (socket says 172.21.15.6:45754) 2023-07-21T22:20:10.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f919f7fe640 1 -- 172.21.15.6:0/442550168 learned_addr learned my addr 172.21.15.6:0/442550168 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:10.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f919e7fc640 1 --2- 172.21.15.6:0/442550168 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91a00aef10 0x7f91a014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:10.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f919effd640 1 --2- 172.21.15.6:0/442550168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91a00aeb40 0x7f91a014f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:10.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f919f7fe640 1 -- 172.21.15.6:0/442550168 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91a00aef10 msgr2=0x7f91a014e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:10.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f919f7fe640 1 --2- 172.21.15.6:0/442550168 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91a00aef10 0x7f91a014e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f919f7fe640 1 -- 172.21.15.6:0/442550168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91a00aeb40 msgr2=0x7f91a014f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:10.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f919f7fe640 1 --2- 172.21.15.6:0/442550168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91a00aeb40 0x7f91a014f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f919f7fe640 1 -- 172.21.15.6:0/442550168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9198009b30 con 0x7f91a0159270 2023-07-21T22:20:10.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f919f7fe640 1 --2- 172.21.15.6:0/442550168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a0159270 0x7f91a014d150 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f91980af040 tx=0x7f91980196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:10.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f9187fff640 1 -- 172.21.15.6:0/442550168 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91980b8640 con 0x7f91a0159270 2023-07-21T22:20:10.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f9187fff640 1 -- 172.21.15.6:0/442550168 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91980b87a0 con 0x7f91a0159270 2023-07-21T22:20:10.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f9187fff640 1 -- 172.21.15.6:0/442550168 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91980b8b10 con 0x7f91a0159270 2023-07-21T22:20:10.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f91a5911640 1 -- 172.21.15.6:0/442550168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a006c930 con 0x7f91a0159270 2023-07-21T22:20:10.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.995+0000 7f91a5911640 1 -- 172.21.15.6:0/442550168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a014ead0 con 0x7f91a0159270 2023-07-21T22:20:10.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.999+0000 7f91a5911640 1 -- 172.21.15.6:0/442550168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a00678d0 con 0x7f91a0159270 2023-07-21T22:20:10.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.999+0000 7f9187fff640 1 -- 172.21.15.6:0/442550168 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f91a00c9610 con 0x7f91a0159270 2023-07-21T22:20:10.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.999+0000 7f9187fff640 1 --2- 172.21.15.6:0/442550168 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f918c066480 0x7f918c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:10.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.999+0000 7f9187fff640 1 -- 172.21.15.6:0/442550168 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f919811f110 con 0x7f91a0159270 2023-07-21T22:20:10.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.999+0000 7f919effd640 1 --2- 172.21.15.6:0/442550168 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f918c066480 0x7f918c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:10.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:09.999+0000 7f919effd640 1 --2- 172.21.15.6:0/442550168 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f918c066480 0x7f918c068930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9190007a60 tx=0x7f9190008040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:10.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.003+0000 7f9187fff640 1 -- 172.21.15.6:0/442550168 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f91980ec2f0 con 0x7f91a0159270 2023-07-21T22:20:10.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.179+0000 7f91a5911640 1 -- 172.21.15.6:0/442550168 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f91a00b1860 con 0x7f918c066480 2023-07-21T22:20:10.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.227+0000 7f9187fff640 1 -- 172.21.15.6:0/442550168 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f91a00b1860 con 0x7f918c066480 2023-07-21T22:20:10.274 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule activated for path /snap_test_dir1/dir5 2023-07-21T22:20:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.227+0000 7f91a5911640 1 -- 172.21.15.6:0/442550168 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f918c066480 msgr2=0x7f918c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.227+0000 7f91a5911640 1 --2- 172.21.15.6:0/442550168 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f918c066480 0x7f918c068930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9190007a60 tx=0x7f9190008040 comp rx=0 tx=0).stop 2023-07-21T22:20:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.227+0000 7f91a5911640 1 -- 172.21.15.6:0/442550168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a0159270 msgr2=0x7f91a014d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.227+0000 7f91a5911640 1 --2- 172.21.15.6:0/442550168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a0159270 0x7f91a014d150 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f91980af040 tx=0x7f91980196b0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.227+0000 7f91a5911640 1 -- 172.21.15.6:0/442550168 shutdown_connections 2023-07-21T22:20:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.227+0000 7f91a5911640 1 --2- 172.21.15.6:0/442550168 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f918c066480 0x7f918c068930 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.227+0000 7f91a5911640 1 --2- 172.21.15.6:0/442550168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91a0159270 0x7f91a014d150 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.227+0000 7f91a5911640 1 --2- 172.21.15.6:0/442550168 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91a00aef10 0x7f91a014e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.227+0000 7f91a5911640 1 --2- 172.21.15.6:0/442550168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91a00aeb40 0x7f91a014f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.227+0000 7f91a5911640 1 -- 172.21.15.6:0/442550168 >> 172.21.15.6:0/442550168 conn(0x7f91a00cde90 msgr2=0x7f91a00c3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:10.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.227+0000 7f91a5911640 1 -- 172.21.15.6:0/442550168 shutdown_connections 2023-07-21T22:20:10.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.227+0000 7f91a5911640 1 -- 172.21.15.6:0/442550168 wait complete. 2023-07-21T22:20:10.295 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2023-07-21T22:20:10.296 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir6 1M 2023-07-21T22:20:10.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.399+0000 7f6c80e6d640 1 Processor -- start 2023-07-21T22:20:10.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.399+0000 7f6c80e6d640 1 -- start start 2023-07-21T22:20:10.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.399+0000 7f6c80e6d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c7c15a940 0x7f6c7c0c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:10.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.399+0000 7f6c80e6d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6c7c0cba60 0x7f6c7c0cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:10.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.399+0000 7f6c80e6d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7c0cc400 con 0x7f6c7c15b9c0 2023-07-21T22:20:10.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.399+0000 7f6c80e6d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7c069b40 con 0x7f6c7c15a940 2023-07-21T22:20:10.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.399+0000 7f6c80e6d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7c0c37e0 con 0x7f6c7c0cba60 2023-07-21T22:20:10.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.399+0000 7f6c73fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c7c15a940 0x7f6c7c0c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:10.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.399+0000 7f6c73fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c7c15a940 0x7f6c7c0c3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45760/0 (socket says 172.21.15.6:45760) 2023-07-21T22:20:10.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.399+0000 7f6c73fff640 1 -- 172.21.15.6:0/2516220986 learned_addr learned my addr 172.21.15.6:0/2516220986 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:10.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.399+0000 7f6c7ad9d640 1 --2- 172.21.15.6:0/2516220986 >> v2:172.21.15.161:3300/0 conn(0x7f6c7c0cba60 0x7f6c7c0cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:10.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.399+0000 7f6c73fff640 1 -- 172.21.15.6:0/2516220986 >> v2:172.21.15.161:3300/0 conn(0x7f6c7c0cba60 msgr2=0x7f6c7c0cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:10.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.399+0000 7f6c73fff640 1 --2- 172.21.15.6:0/2516220986 >> v2:172.21.15.161:3300/0 conn(0x7f6c7c0cba60 0x7f6c7c0cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.399+0000 7f6c73fff640 1 -- 172.21.15.6:0/2516220986 >> v1:172.21.15.161:6789/0 conn(0x7f6c7c15b9c0 legacy=0x7f6c7c069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:10.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.399+0000 7f6c73fff640 1 -- 172.21.15.6:0/2516220986 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c0c3ac0 con 0x7f6c7c15a940 2023-07-21T22:20:10.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.403+0000 7f6c73fff640 1 --2- 172.21.15.6:0/2516220986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c15a940 0x7f6c7c0c3150 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0c3060 tx=0x7f6c6401e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93b07fa2028fdb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:10.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.403+0000 7f6c79d9b640 1 -- 172.21.15.6:0/2516220986 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c640ad600 con 0x7f6c7c15a940 2023-07-21T22:20:10.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.403+0000 7f6c79d9b640 1 -- 172.21.15.6:0/2516220986 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c640a9050 con 0x7f6c7c15a940 2023-07-21T22:20:10.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.403+0000 7f6c79d9b640 1 -- 172.21.15.6:0/2516220986 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c640ad980 con 0x7f6c7c15a940 2023-07-21T22:20:10.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.403+0000 7f6c80e6d640 1 -- 172.21.15.6:0/2516220986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c15a940 msgr2=0x7f6c7c0c3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:10.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.403+0000 7f6c80e6d640 1 --2- 172.21.15.6:0/2516220986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c15a940 0x7f6c7c0c3150 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0c3060 tx=0x7f6c6401e680 comp rx=0 tx=0).stop 2023-07-21T22:20:10.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.403+0000 7f6c80e6d640 1 -- 172.21.15.6:0/2516220986 shutdown_connections 2023-07-21T22:20:10.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.403+0000 7f6c80e6d640 1 --2- 172.21.15.6:0/2516220986 >> v2:172.21.15.161:3300/0 conn(0x7f6c7c0cba60 0x7f6c7c0cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.403+0000 7f6c80e6d640 1 --2- 172.21.15.6:0/2516220986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c15a940 0x7f6c7c0c3150 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.403+0000 7f6c80e6d640 1 -- 172.21.15.6:0/2516220986 >> 172.21.15.6:0/2516220986 conn(0x7f6c7c0cde90 msgr2=0x7f6c7c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:10.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.403+0000 7f6c80e6d640 1 -- 172.21.15.6:0/2516220986 shutdown_connections 2023-07-21T22:20:10.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.403+0000 7f6c80e6d640 1 -- 172.21.15.6:0/2516220986 wait complete. 2023-07-21T22:20:10.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c80e6d640 1 Processor -- start 2023-07-21T22:20:10.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c80e6d640 1 -- start start 2023-07-21T22:20:10.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c80e6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c0cba60 0x7f6c7c0b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c80e6d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c7c15a940 0x7f6c7c0c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c80e6d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c7c15b9c0 0x7f6c7c0c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c80e6d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0b0dc0 con 0x7f6c7c0cba60 2023-07-21T22:20:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c80e6d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0b10a0 con 0x7f6c7c15a940 2023-07-21T22:20:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c80e6d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0c7da0 con 0x7f6c7c15b9c0 2023-07-21T22:20:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c7a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c0cba60 0x7f6c7c0b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c7a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c0cba60 0x7f6c7c0b2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45768/0 (socket says 172.21.15.6:45768) 2023-07-21T22:20:10.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c7a59c640 1 -- 172.21.15.6:0/2710037787 learned_addr learned my addr 172.21.15.6:0/2710037787 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:10.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c7ad9d640 1 --2- 172.21.15.6:0/2710037787 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c7c15b9c0 0x7f6c7c0c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:10.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c73fff640 1 --2- 172.21.15.6:0/2710037787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c7c15a940 0x7f6c7c0c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:10.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c7a59c640 1 -- 172.21.15.6:0/2710037787 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c7c15b9c0 msgr2=0x7f6c7c0c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:10.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c7a59c640 1 --2- 172.21.15.6:0/2710037787 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c7c15b9c0 0x7f6c7c0c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c7a59c640 1 -- 172.21.15.6:0/2710037787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c7c15a940 msgr2=0x7f6c7c0c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:10.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c7a59c640 1 --2- 172.21.15.6:0/2710037787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c7c15a940 0x7f6c7c0c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c7a59c640 1 -- 172.21.15.6:0/2710037787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c640094d0 con 0x7f6c7c0cba60 2023-07-21T22:20:10.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c7a59c640 1 --2- 172.21.15.6:0/2710037787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c0cba60 0x7f6c7c0b2a80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00c3f0 tx=0x7f6c6c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:10.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c72ffd640 1 -- 172.21.15.6:0/2710037787 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c0052d0 con 0x7f6c7c0cba60 2023-07-21T22:20:10.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c72ffd640 1 -- 172.21.15.6:0/2710037787 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c005430 con 0x7f6c7c0cba60 2023-07-21T22:20:10.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c72ffd640 1 -- 172.21.15.6:0/2710037787 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c003840 con 0x7f6c7c0cba60 2023-07-21T22:20:10.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c80e6d640 1 -- 172.21.15.6:0/2710037787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7c155a20 con 0x7f6c7c0cba60 2023-07-21T22:20:10.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c80e6d640 1 -- 172.21.15.6:0/2710037787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7c0c7090 con 0x7f6c7c0cba60 2023-07-21T22:20:10.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.407+0000 7f6c80e6d640 1 -- 172.21.15.6:0/2710037787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7c0714b0 con 0x7f6c7c0cba60 2023-07-21T22:20:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.411+0000 7f6c72ffd640 1 -- 172.21.15.6:0/2710037787 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f6c6c0039a0 con 0x7f6c7c0cba60 2023-07-21T22:20:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.411+0000 7f6c72ffd640 1 --2- 172.21.15.6:0/2710037787 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f6c5c0664b0 0x7f6c5c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.411+0000 7f6c72ffd640 1 -- 172.21.15.6:0/2710037787 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f6c6c083680 con 0x7f6c7c0cba60 2023-07-21T22:20:10.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.411+0000 7f6c73fff640 1 --2- 172.21.15.6:0/2710037787 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f6c5c0664b0 0x7f6c5c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:10.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.411+0000 7f6c73fff640 1 --2- 172.21.15.6:0/2710037787 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f6c5c0664b0 0x7f6c5c068960 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6c640af000 tx=0x7f6c64008040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:10.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.415+0000 7f6c72ffd640 1 -- 172.21.15.6:0/2710037787 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6c6c050860 con 0x7f6c7c0cba60 2023-07-21T22:20:10.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.591+0000 7f6c80e6d640 1 -- 172.21.15.6:0/2710037787 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c7c06a3f0 con 0x7f6c5c0664b0 2023-07-21T22:20:10.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.635+0000 7f6c72ffd640 1 -- 172.21.15.6:0/2710037787 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f6c640ad5e0 con 0x7f6c5c0664b0 2023-07-21T22:20:10.685 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule activated for path /snap_test_dir1/dir6 2023-07-21T22:20:10.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.639+0000 7f6c80e6d640 1 -- 172.21.15.6:0/2710037787 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f6c5c0664b0 msgr2=0x7f6c5c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:10.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.639+0000 7f6c80e6d640 1 --2- 172.21.15.6:0/2710037787 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f6c5c0664b0 0x7f6c5c068960 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6c640af000 tx=0x7f6c64008040 comp rx=0 tx=0).stop 2023-07-21T22:20:10.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.639+0000 7f6c80e6d640 1 -- 172.21.15.6:0/2710037787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c0cba60 msgr2=0x7f6c7c0b2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:10.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.639+0000 7f6c80e6d640 1 --2- 172.21.15.6:0/2710037787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c0cba60 0x7f6c7c0b2a80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00c3f0 tx=0x7f6c6c00c8b0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.639+0000 7f6c80e6d640 1 -- 172.21.15.6:0/2710037787 shutdown_connections 2023-07-21T22:20:10.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.639+0000 7f6c80e6d640 1 --2- 172.21.15.6:0/2710037787 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f6c5c0664b0 0x7f6c5c068960 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.639+0000 7f6c80e6d640 1 --2- 172.21.15.6:0/2710037787 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c7c15b9c0 0x7f6c7c0c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.639+0000 7f6c80e6d640 1 --2- 172.21.15.6:0/2710037787 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c7c15a940 0x7f6c7c0c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.639+0000 7f6c80e6d640 1 --2- 172.21.15.6:0/2710037787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c7c0cba60 0x7f6c7c0b2a80 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.639+0000 7f6c80e6d640 1 -- 172.21.15.6:0/2710037787 >> 172.21.15.6:0/2710037787 conn(0x7f6c7c0cde90 msgr2=0x7f6c7c14d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:10.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.639+0000 7f6c80e6d640 1 -- 172.21.15.6:0/2710037787 shutdown_connections 2023-07-21T22:20:10.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.639+0000 7f6c80e6d640 1 -- 172.21.15.6:0/2710037787 wait complete. 2023-07-21T22:20:10.706 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2023-07-21T22:20:10.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir7 1M 2023-07-21T22:20:10.731 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:20:10.760 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:20:10.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.811+0000 7fa018703640 1 Processor -- start 2023-07-21T22:20:10.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.811+0000 7fa018703640 1 -- start start 2023-07-21T22:20:10.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.811+0000 7fa018703640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa0100cba60 0x7fa0100c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:10.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.811+0000 7fa018703640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa01015b9c0 0x7fa0100cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:10.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.811+0000 7fa018703640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0100cc370 con 0x7fa010158090 2023-07-21T22:20:10.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.811+0000 7fa018703640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0100c37e0 con 0x7fa0100cba60 2023-07-21T22:20:10.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.811+0000 7fa018703640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0100c3ac0 con 0x7fa01015b9c0 2023-07-21T22:20:10.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.811+0000 7fa015c9e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa01015b9c0 0x7fa0100cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:10.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.811+0000 7fa015c9e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa01015b9c0 0x7fa0100cbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:36670/0 (socket says 172.21.15.6:36670) 2023-07-21T22:20:10.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.811+0000 7fa015c9e640 1 -- 172.21.15.6:0/3605462540 learned_addr learned my addr 172.21.15.6:0/3605462540 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:10.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.811+0000 7fa01649f640 1 --2- 172.21.15.6:0/3605462540 >> v2:172.21.15.161:3300/0 conn(0x7fa0100cba60 0x7fa0100c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:10.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.811+0000 7fa015c9e640 1 -- 172.21.15.6:0/3605462540 >> v2:172.21.15.161:3300/0 conn(0x7fa0100cba60 msgr2=0x7fa0100c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:10.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.811+0000 7fa015c9e640 1 --2- 172.21.15.6:0/3605462540 >> v2:172.21.15.161:3300/0 conn(0x7fa0100cba60 0x7fa0100c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.811+0000 7fa015c9e640 1 -- 172.21.15.6:0/3605462540 >> v1:172.21.15.161:6789/0 conn(0x7fa010158090 legacy=0x7fa010158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:10.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.811+0000 7fa01549d640 1 -- 172.21.15.6:0/3605462540 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511875546 0 0) 0x7fa0100cc370 con 0x7fa010158090 2023-07-21T22:20:10.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.811+0000 7fa015c9e640 1 -- 172.21.15.6:0/3605462540 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0100c3da0 con 0x7fa01015b9c0 2023-07-21T22:20:10.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.815+0000 7fa015c9e640 1 --2- 172.21.15.6:0/3605462540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa01015b9c0 0x7fa0100cbe30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa000006fd0 tx=0x7fa00001e880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2561d275dcf9a01b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:10.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.815+0000 7fa01549d640 1 -- 172.21.15.6:0/3605462540 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa000004230 con 0x7fa01015b9c0 2023-07-21T22:20:10.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.815+0000 7fa01549d640 1 -- 172.21.15.6:0/3605462540 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0000ab070 con 0x7fa01015b9c0 2023-07-21T22:20:10.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.815+0000 7fa01549d640 1 -- 172.21.15.6:0/3605462540 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0000a76f0 con 0x7fa01015b9c0 2023-07-21T22:20:10.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.815+0000 7fa018703640 1 -- 172.21.15.6:0/3605462540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa01015b9c0 msgr2=0x7fa0100cbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:10.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.815+0000 7fa018703640 1 --2- 172.21.15.6:0/3605462540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa01015b9c0 0x7fa0100cbe30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa000006fd0 tx=0x7fa00001e880 comp rx=0 tx=0).stop 2023-07-21T22:20:10.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.815+0000 7fa018703640 1 -- 172.21.15.6:0/3605462540 shutdown_connections 2023-07-21T22:20:10.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.815+0000 7fa018703640 1 --2- 172.21.15.6:0/3605462540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa01015b9c0 0x7fa0100cbe30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.815+0000 7fa018703640 1 --2- 172.21.15.6:0/3605462540 >> v2:172.21.15.161:3300/0 conn(0x7fa0100cba60 0x7fa0100c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.815+0000 7fa018703640 1 -- 172.21.15.6:0/3605462540 >> 172.21.15.6:0/3605462540 conn(0x7fa0100cde90 msgr2=0x7fa0100ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:10.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.815+0000 7fa018703640 1 -- 172.21.15.6:0/3605462540 shutdown_connections 2023-07-21T22:20:10.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.815+0000 7fa018703640 1 -- 172.21.15.6:0/3605462540 wait complete. 2023-07-21T22:20:10.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa018703640 1 Processor -- start 2023-07-21T22:20:10.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa018703640 1 -- start start 2023-07-21T22:20:10.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa018703640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0100cba60 0x7fa0100b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:10.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa018703640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa010158090 0x7fa0100c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:10.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa018703640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa01015b9c0 0x7fa01014ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:10.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa018703640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0100c6950 con 0x7fa010158090 2023-07-21T22:20:10.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa018703640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0100c7790 con 0x7fa01015b9c0 2023-07-21T22:20:10.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa018703640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0100c6b80 con 0x7fa0100cba60 2023-07-21T22:20:10.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa015c9e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa010158090 0x7fa0100c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:10.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa015c9e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa010158090 0x7fa0100c6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45782/0 (socket says 172.21.15.6:45782) 2023-07-21T22:20:10.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa015c9e640 1 -- 172.21.15.6:0/1332187980 learned_addr learned my addr 172.21.15.6:0/1332187980 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:10.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa016ca0640 1 --2- 172.21.15.6:0/1332187980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa01015b9c0 0x7fa01014ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:10.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa01649f640 1 --2- 172.21.15.6:0/1332187980 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0100cba60 0x7fa0100b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:10.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa015c9e640 1 -- 172.21.15.6:0/1332187980 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0100cba60 msgr2=0x7fa0100b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:10.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa015c9e640 1 --2- 172.21.15.6:0/1332187980 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0100cba60 0x7fa0100b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa015c9e640 1 -- 172.21.15.6:0/1332187980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa01015b9c0 msgr2=0x7fa01014ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:10.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa015c9e640 1 --2- 172.21.15.6:0/1332187980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa01015b9c0 0x7fa01014ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:10.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa015c9e640 1 -- 172.21.15.6:0/1332187980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00000b780 con 0x7fa010158090 2023-07-21T22:20:10.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa015c9e640 1 --2- 172.21.15.6:0/1332187980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa010158090 0x7fa0100c6410 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa000000c10 tx=0x7fa00001b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:10.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa006ffd640 1 -- 172.21.15.6:0/1332187980 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0000a7a40 con 0x7fa010158090 2023-07-21T22:20:10.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa006ffd640 1 -- 172.21.15.6:0/1332187980 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0000a7ba0 con 0x7fa010158090 2023-07-21T22:20:10.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa006ffd640 1 -- 172.21.15.6:0/1332187980 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa000003620 con 0x7fa010158090 2023-07-21T22:20:10.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa018703640 1 -- 172.21.15.6:0/1332187980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0100c6e60 con 0x7fa010158090 2023-07-21T22:20:10.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa018703640 1 -- 172.21.15.6:0/1332187980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0100c7420 con 0x7fa010158090 2023-07-21T22:20:10.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.819+0000 7fa018703640 1 -- 172.21.15.6:0/1332187980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0100714b0 con 0x7fa010158090 2023-07-21T22:20:10.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.823+0000 7fa006ffd640 1 -- 172.21.15.6:0/1332187980 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fa0000b9050 con 0x7fa010158090 2023-07-21T22:20:10.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.823+0000 7fa006ffd640 1 --2- 172.21.15.6:0/1332187980 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9ff40664b0 0x7f9ff4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:10.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.823+0000 7fa006ffd640 1 -- 172.21.15.6:0/1332187980 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fa00011fd90 con 0x7fa010158090 2023-07-21T22:20:10.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.823+0000 7fa01649f640 1 --2- 172.21.15.6:0/1332187980 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9ff40664b0 0x7f9ff4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:10.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.823+0000 7fa01649f640 1 --2- 172.21.15.6:0/1332187980 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9ff40664b0 0x7f9ff4068960 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa00c009b60 tx=0x7fa00c009190 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:10.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:10.827+0000 7fa006ffd640 1 -- 172.21.15.6:0/1332187980 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa0000ecf70 con 0x7fa010158090 2023-07-21T22:20:11.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.003+0000 7fa018703640 1 -- 172.21.15.6:0/1332187980 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0100c7900 con 0x7f9ff40664b0 2023-07-21T22:20:11.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.055+0000 7fa006ffd640 1 -- 172.21.15.6:0/1332187980 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fa0100c7900 con 0x7f9ff40664b0 2023-07-21T22:20:11.103 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule activated for path /snap_test_dir1/dir7 2023-07-21T22:20:11.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.055+0000 7fa018703640 1 -- 172.21.15.6:0/1332187980 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9ff40664b0 msgr2=0x7f9ff4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:11.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.055+0000 7fa018703640 1 --2- 172.21.15.6:0/1332187980 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9ff40664b0 0x7f9ff4068960 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa00c009b60 tx=0x7fa00c009190 comp rx=0 tx=0).stop 2023-07-21T22:20:11.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.055+0000 7fa018703640 1 -- 172.21.15.6:0/1332187980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa010158090 msgr2=0x7fa0100c6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:11.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.055+0000 7fa018703640 1 --2- 172.21.15.6:0/1332187980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa010158090 0x7fa0100c6410 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa000000c10 tx=0x7fa00001b620 comp rx=0 tx=0).stop 2023-07-21T22:20:11.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.055+0000 7fa018703640 1 -- 172.21.15.6:0/1332187980 shutdown_connections 2023-07-21T22:20:11.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.055+0000 7fa018703640 1 --2- 172.21.15.6:0/1332187980 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9ff40664b0 0x7f9ff4068960 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.055+0000 7fa018703640 1 --2- 172.21.15.6:0/1332187980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa01015b9c0 0x7fa01014ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.055+0000 7fa018703640 1 --2- 172.21.15.6:0/1332187980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa010158090 0x7fa0100c6410 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.055+0000 7fa018703640 1 --2- 172.21.15.6:0/1332187980 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0100cba60 0x7fa0100b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.055+0000 7fa018703640 1 -- 172.21.15.6:0/1332187980 >> 172.21.15.6:0/1332187980 conn(0x7fa0100cde90 msgr2=0x7fa01006f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:11.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.055+0000 7fa018703640 1 -- 172.21.15.6:0/1332187980 shutdown_connections 2023-07-21T22:20:11.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.055+0000 7fa018703640 1 -- 172.21.15.6:0/1332187980 wait complete. 2023-07-21T22:20:11.123 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2023-07-21T22:20:11.123 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir8 1M 2023-07-21T22:20:11.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.223+0000 7f1fb1293640 1 Processor -- start 2023-07-21T22:20:11.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.223+0000 7f1fb1293640 1 -- start start 2023-07-21T22:20:11.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.227+0000 7f1fb1293640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1fac15bde0 0x7f1fac0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:11.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.227+0000 7f1fb1293640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1fac0d2fc0 0x7f1fac0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:11.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.227+0000 7f1fb1293640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fac0b04c0 con 0x7f1fac0d2300 2023-07-21T22:20:11.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.227+0000 7f1fb1293640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fac15c1b0 con 0x7f1fac0d2fc0 2023-07-21T22:20:11.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.227+0000 7f1fb1293640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fac0d0aa0 con 0x7f1fac15bde0 2023-07-21T22:20:11.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.227+0000 7f1fa3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1fac0d2fc0 0x7f1fac0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:11.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.227+0000 7f1fa3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1fac0d2fc0 0x7f1fac0b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45784/0 (socket says 172.21.15.6:45784) 2023-07-21T22:20:11.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.227+0000 7f1fa3fff640 1 -- 172.21.15.6:0/3711340570 learned_addr learned my addr 172.21.15.6:0/3711340570 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:11.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.227+0000 7f1faaffd640 1 --2- 172.21.15.6:0/3711340570 >> v2:172.21.15.161:3300/0 conn(0x7f1fac15bde0 0x7f1fac0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:11.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.227+0000 7f1fa3fff640 1 -- 172.21.15.6:0/3711340570 >> v2:172.21.15.161:3300/0 conn(0x7f1fac15bde0 msgr2=0x7f1fac0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:11.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.227+0000 7f1fa3fff640 1 --2- 172.21.15.6:0/3711340570 >> v2:172.21.15.161:3300/0 conn(0x7f1fac15bde0 0x7f1fac0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.227+0000 7f1fa3fff640 1 -- 172.21.15.6:0/3711340570 >> v1:172.21.15.161:6789/0 conn(0x7f1fac0d2300 legacy=0x7f1fac0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:11.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.227+0000 7f1fa3fff640 1 -- 172.21.15.6:0/3711340570 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac0afb90 con 0x7f1fac0d2fc0 2023-07-21T22:20:11.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.231+0000 7f1fa3fff640 1 --2- 172.21.15.6:0/3711340570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fac0d2fc0 0x7f1fac0b0950 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1fac08b210 tx=0x7f1f9401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c19a4985edd3d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.231+0000 7f1faa7fc640 1 -- 172.21.15.6:0/3711340570 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940aa660 con 0x7f1fac0d2fc0 2023-07-21T22:20:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.231+0000 7f1faa7fc640 1 -- 172.21.15.6:0/3711340570 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f940aa7c0 con 0x7f1fac0d2fc0 2023-07-21T22:20:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.231+0000 7f1faa7fc640 1 -- 172.21.15.6:0/3711340570 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f940aab50 con 0x7f1fac0d2fc0 2023-07-21T22:20:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.231+0000 7f1fb1293640 1 -- 172.21.15.6:0/3711340570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fac0d2fc0 msgr2=0x7f1fac0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:11.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.231+0000 7f1fb1293640 1 --2- 172.21.15.6:0/3711340570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fac0d2fc0 0x7f1fac0b0950 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1fac08b210 tx=0x7f1f9401c500 comp rx=0 tx=0).stop 2023-07-21T22:20:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.231+0000 7f1fb1293640 1 -- 172.21.15.6:0/3711340570 shutdown_connections 2023-07-21T22:20:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.231+0000 7f1fb1293640 1 --2- 172.21.15.6:0/3711340570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fac0d2fc0 0x7f1fac0b0950 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.231+0000 7f1fb1293640 1 --2- 172.21.15.6:0/3711340570 >> v2:172.21.15.161:3300/0 conn(0x7f1fac15bde0 0x7f1fac0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.231+0000 7f1fb1293640 1 -- 172.21.15.6:0/3711340570 >> 172.21.15.6:0/3711340570 conn(0x7f1fac0659d0 msgr2=0x7f1fac09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.231+0000 7f1fb1293640 1 -- 172.21.15.6:0/3711340570 shutdown_connections 2023-07-21T22:20:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.231+0000 7f1fb1293640 1 -- 172.21.15.6:0/3711340570 wait complete. 2023-07-21T22:20:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.231+0000 7f1fb1293640 1 Processor -- start 2023-07-21T22:20:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.231+0000 7f1fb1293640 1 -- start start 2023-07-21T22:20:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.231+0000 7f1fb1293640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fac0d2300 0x7f1fac0b7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.231+0000 7f1fb1293640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1fac0d2fc0 0x7f1fac0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.231+0000 7f1fb1293640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fac15bde0 0x7f1fac0cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1fb1293640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac0c96e0 con 0x7f1fac15bde0 2023-07-21T22:20:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1fb1293640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac154380 con 0x7f1fac0d2300 2023-07-21T22:20:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1fb1293640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac0b5670 con 0x7f1fac0d2fc0 2023-07-21T22:20:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1faaffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fac0d2300 0x7f1fac0b7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1fab7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fac15bde0 0x7f1fac0cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1faaffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fac0d2300 0x7f1fac0b7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:50016/0 (socket says 172.21.15.6:50016) 2023-07-21T22:20:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1faaffd640 1 -- 172.21.15.6:0/4087804501 learned_addr learned my addr 172.21.15.6:0/4087804501 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1fa3fff640 1 --2- 172.21.15.6:0/4087804501 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1fac0d2fc0 0x7f1fac0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1faaffd640 1 -- 172.21.15.6:0/4087804501 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1fac0d2fc0 msgr2=0x7f1fac0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1faaffd640 1 --2- 172.21.15.6:0/4087804501 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1fac0d2fc0 0x7f1fac0cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1faaffd640 1 -- 172.21.15.6:0/4087804501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fac15bde0 msgr2=0x7f1fac0cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1faaffd640 1 --2- 172.21.15.6:0/4087804501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fac15bde0 0x7f1fac0cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1faaffd640 1 -- 172.21.15.6:0/4087804501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f940094d0 con 0x7f1fac0d2300 2023-07-21T22:20:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1faaffd640 1 --2- 172.21.15.6:0/4087804501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fac0d2300 0x7f1fac0b7590 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00d600 tx=0x7f1f9c00dac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1fa37fe640 1 -- 172.21.15.6:0/4087804501 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c0059a0 con 0x7f1fac0d2300 2023-07-21T22:20:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1fa37fe640 1 -- 172.21.15.6:0/4087804501 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9c005b00 con 0x7f1fac0d2300 2023-07-21T22:20:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1fa37fe640 1 -- 172.21.15.6:0/4087804501 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c006030 con 0x7f1fac0d2300 2023-07-21T22:20:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1fb1293640 1 -- 172.21.15.6:0/4087804501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fac0b5340 con 0x7f1fac0d2300 2023-07-21T22:20:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1fb1293640 1 -- 172.21.15.6:0/4087804501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fac1540a0 con 0x7f1fac0d2300 2023-07-21T22:20:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1fb1293640 1 -- 172.21.15.6:0/4087804501 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fac0b51a0 con 0x7f1fac0d2300 2023-07-21T22:20:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.235+0000 7f1fa37fe640 1 -- 172.21.15.6:0/4087804501 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f1f9c006190 con 0x7f1fac0d2300 2023-07-21T22:20:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.239+0000 7f1fa37fe640 1 --2- 172.21.15.6:0/4087804501 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1f8c0664b0 0x7f1f8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.239+0000 7f1fa37fe640 1 -- 172.21.15.6:0/4087804501 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f1f9c084280 con 0x7f1fac0d2300 2023-07-21T22:20:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.239+0000 7f1fa3fff640 1 --2- 172.21.15.6:0/4087804501 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1f8c0664b0 0x7f1f8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.239+0000 7f1fa3fff640 1 --2- 172.21.15.6:0/4087804501 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1f8c0664b0 0x7f1f8c068960 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1f940ae000 tx=0x7f1f940b5040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:11.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.243+0000 7f1fa37fe640 1 -- 172.21.15.6:0/4087804501 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1fac0b51a0 con 0x7f1fac0d2300 2023-07-21T22:20:11.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.419+0000 7f1fb1293640 1 -- 172.21.15.6:0/4087804501 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1fac0d07b0 con 0x7f1f8c0664b0 2023-07-21T22:20:11.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.467+0000 7f1fa37fe640 1 -- 172.21.15.6:0/4087804501 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f1f940aa930 con 0x7f1f8c0664b0 2023-07-21T22:20:11.517 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule activated for path /snap_test_dir1/dir8 2023-07-21T22:20:11.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.471+0000 7f1fb1293640 1 -- 172.21.15.6:0/4087804501 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1f8c0664b0 msgr2=0x7f1f8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:11.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.471+0000 7f1fb1293640 1 --2- 172.21.15.6:0/4087804501 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1f8c0664b0 0x7f1f8c068960 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1f940ae000 tx=0x7f1f940b5040 comp rx=0 tx=0).stop 2023-07-21T22:20:11.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.471+0000 7f1fb1293640 1 -- 172.21.15.6:0/4087804501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fac0d2300 msgr2=0x7f1fac0b7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:11.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.471+0000 7f1fb1293640 1 --2- 172.21.15.6:0/4087804501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fac0d2300 0x7f1fac0b7590 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00d600 tx=0x7f1f9c00dac0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.471+0000 7f1fb1293640 1 -- 172.21.15.6:0/4087804501 shutdown_connections 2023-07-21T22:20:11.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.471+0000 7f1fb1293640 1 --2- 172.21.15.6:0/4087804501 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1f8c0664b0 0x7f1f8c068960 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.471+0000 7f1fb1293640 1 --2- 172.21.15.6:0/4087804501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fac15bde0 0x7f1fac0cabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.471+0000 7f1fb1293640 1 --2- 172.21.15.6:0/4087804501 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1fac0d2fc0 0x7f1fac0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.471+0000 7f1fb1293640 1 --2- 172.21.15.6:0/4087804501 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1fac0d2300 0x7f1fac0b7590 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.471+0000 7f1fb1293640 1 -- 172.21.15.6:0/4087804501 >> 172.21.15.6:0/4087804501 conn(0x7f1fac0659d0 msgr2=0x7f1fac0af0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:11.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.471+0000 7f1fb1293640 1 -- 172.21.15.6:0/4087804501 shutdown_connections 2023-07-21T22:20:11.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.471+0000 7f1fb1293640 1 -- 172.21.15.6:0/4087804501 wait complete. 2023-07-21T22:20:11.537 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2023-07-21T22:20:11.538 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir9 1M 2023-07-21T22:20:11.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.639+0000 7fe8c2b74640 1 Processor -- start 2023-07-21T22:20:11.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.639+0000 7fe8c2b74640 1 -- start start 2023-07-21T22:20:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.639+0000 7fe8c2b74640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe8bc15cef0 0x7fe8bc158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.639+0000 7fe8c2b74640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8bc159270 0x7fe8bc0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.639+0000 7fe8c2b74640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8bc1532b0 con 0x7fe8bc0aeb40 2023-07-21T22:20:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.639+0000 7fe8c2b74640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8bc15d360 con 0x7fe8bc15cef0 2023-07-21T22:20:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.639+0000 7fe8c2b74640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc0ca6f0 con 0x7fe8bc159270 2023-07-21T22:20:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.643+0000 7fe8c0910640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe8bc0aeb40 0x7fe8bc0aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33162/0 (socket says 172.21.15.6:33162) 2023-07-21T22:20:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.643+0000 7fe8c0910640 1 -- 172.21.15.6:0/3387884213 learned_addr learned my addr 172.21.15.6:0/3387884213 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:20:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.643+0000 7fe8c1111640 1 --2- 172.21.15.6:0/3387884213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8bc159270 0x7fe8bc0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.643+0000 7fe8bbfff640 1 --2- 172.21.15.6:0/3387884213 >> v2:172.21.15.161:3300/0 conn(0x7fe8bc15cef0 0x7fe8bc158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.643+0000 7fe8bb7fe640 1 -- 172.21.15.6:0/3387884213 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10831794 0 0) 0x7fe8bc1532b0 con 0x7fe8bc0aeb40 2023-07-21T22:20:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.643+0000 7fe8bb7fe640 1 -- 172.21.15.6:0/3387884213 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8ac005740 con 0x7fe8bc0aeb40 2023-07-21T22:20:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.643+0000 7fe8c1111640 1 -- 172.21.15.6:0/3387884213 >> v2:172.21.15.161:3300/0 conn(0x7fe8bc15cef0 msgr2=0x7fe8bc158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.643+0000 7fe8c1111640 1 --2- 172.21.15.6:0/3387884213 >> v2:172.21.15.161:3300/0 conn(0x7fe8bc15cef0 0x7fe8bc158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.643+0000 7fe8c1111640 1 -- 172.21.15.6:0/3387884213 >> v1:172.21.15.6:6789/0 conn(0x7fe8bc0aeb40 legacy=0x7fe8bc0aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.643+0000 7fe8c1111640 1 -- 172.21.15.6:0/3387884213 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc1599d0 con 0x7fe8bc159270 2023-07-21T22:20:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.643+0000 7fe8c1111640 1 --2- 172.21.15.6:0/3387884213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8bc159270 0x7fe8bc0c88c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4009d90 tx=0x7fe8b401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c99144eb9a5c1d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.643+0000 7fe8bb7fe640 1 -- 172.21.15.6:0/3387884213 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40a59e0 con 0x7fe8bc159270 2023-07-21T22:20:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.643+0000 7fe8bb7fe640 1 -- 172.21.15.6:0/3387884213 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b40a5b40 con 0x7fe8bc159270 2023-07-21T22:20:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.643+0000 7fe8bb7fe640 1 -- 172.21.15.6:0/3387884213 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40ad440 con 0x7fe8bc159270 2023-07-21T22:20:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.647+0000 7fe8c2b74640 1 -- 172.21.15.6:0/3387884213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8bc159270 msgr2=0x7fe8bc0c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.647+0000 7fe8c2b74640 1 --2- 172.21.15.6:0/3387884213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8bc159270 0x7fe8bc0c88c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4009d90 tx=0x7fe8b401c920 comp rx=0 tx=0).stop 2023-07-21T22:20:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.647+0000 7fe8c2b74640 1 -- 172.21.15.6:0/3387884213 shutdown_connections 2023-07-21T22:20:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.647+0000 7fe8c2b74640 1 --2- 172.21.15.6:0/3387884213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8bc159270 0x7fe8bc0c88c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.647+0000 7fe8c2b74640 1 --2- 172.21.15.6:0/3387884213 >> v2:172.21.15.161:3300/0 conn(0x7fe8bc15cef0 0x7fe8bc158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.647+0000 7fe8c2b74640 1 -- 172.21.15.6:0/3387884213 >> 172.21.15.6:0/3387884213 conn(0x7fe8bc0cde90 msgr2=0x7fe8bc0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.647+0000 7fe8c2b74640 1 -- 172.21.15.6:0/3387884213 shutdown_connections 2023-07-21T22:20:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.647+0000 7fe8c2b74640 1 -- 172.21.15.6:0/3387884213 wait complete. 2023-07-21T22:20:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.647+0000 7fe8c2b74640 1 Processor -- start 2023-07-21T22:20:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.647+0000 7fe8c2b74640 1 -- start start 2023-07-21T22:20:11.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.647+0000 7fe8c2b74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc0aeb40 0x7fe8bc14dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:11.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.647+0000 7fe8c2b74640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8bc159270 0x7fe8bc0acca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:11.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.647+0000 7fe8c2b74640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8bc15cef0 0x7fe8bc070a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:11.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.647+0000 7fe8c2b74640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc0ad1e0 con 0x7fe8bc0aeb40 2023-07-21T22:20:11.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.647+0000 7fe8c2b74640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc14f400 con 0x7fe8bc159270 2023-07-21T22:20:11.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.647+0000 7fe8c2b74640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc0b10f0 con 0x7fe8bc15cef0 2023-07-21T22:20:11.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.647+0000 7fe8c0910640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc0aeb40 0x7fe8bc14dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:11.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.647+0000 7fe8c0910640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc0aeb40 0x7fe8bc14dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45808/0 (socket says 172.21.15.6:45808) 2023-07-21T22:20:11.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.647+0000 7fe8c0910640 1 -- 172.21.15.6:0/73217013 learned_addr learned my addr 172.21.15.6:0/73217013 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:20:11.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.651+0000 7fe8c1111640 1 --2- 172.21.15.6:0/73217013 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8bc15cef0 0x7fe8bc070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:11.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.651+0000 7fe8c0910640 1 -- 172.21.15.6:0/73217013 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8bc15cef0 msgr2=0x7fe8bc070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:11.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.651+0000 7fe8c0910640 1 --2- 172.21.15.6:0/73217013 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8bc15cef0 0x7fe8bc070a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.651+0000 7fe8c0910640 1 -- 172.21.15.6:0/73217013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8bc159270 msgr2=0x7fe8bc0acca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:11.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.651+0000 7fe8bbfff640 1 --2- 172.21.15.6:0/73217013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8bc159270 0x7fe8bc0acca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:11.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.651+0000 7fe8c0910640 1 --2- 172.21.15.6:0/73217013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8bc159270 0x7fe8bc0acca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.651+0000 7fe8c0910640 1 -- 172.21.15.6:0/73217013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b4009a70 con 0x7fe8bc0aeb40 2023-07-21T22:20:11.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.651+0000 7fe8c1111640 1 --2- 172.21.15.6:0/73217013 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8bc15cef0 0x7fe8bc070a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:20:11.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.651+0000 7fe8bbfff640 1 --2- 172.21.15.6:0/73217013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8bc159270 0x7fe8bc0acca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:20:11.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.651+0000 7fe8c0910640 1 --2- 172.21.15.6:0/73217013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc0aeb40 0x7fe8bc14dc30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000c4d0 tx=0x7fe8b000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:11.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.651+0000 7fe8b97fa640 1 -- 172.21.15.6:0/73217013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0005cf0 con 0x7fe8bc0aeb40 2023-07-21T22:20:11.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.651+0000 7fe8b97fa640 1 -- 172.21.15.6:0/73217013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b0005e50 con 0x7fe8bc0aeb40 2023-07-21T22:20:11.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.651+0000 7fe8b97fa640 1 -- 172.21.15.6:0/73217013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0007270 con 0x7fe8bc0aeb40 2023-07-21T22:20:11.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.651+0000 7fe8c2b74640 1 -- 172.21.15.6:0/73217013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8bc070f80 con 0x7fe8bc0aeb40 2023-07-21T22:20:11.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.651+0000 7fe8c2b74640 1 -- 172.21.15.6:0/73217013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8bc0ad3c0 con 0x7fe8bc0aeb40 2023-07-21T22:20:11.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.651+0000 7fe8c2b74640 1 -- 172.21.15.6:0/73217013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8bc0678d0 con 0x7fe8bc0aeb40 2023-07-21T22:20:11.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.651+0000 7fe8b97fa640 1 -- 172.21.15.6:0/73217013 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fe8b00073d0 con 0x7fe8bc0aeb40 2023-07-21T22:20:11.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.655+0000 7fe8b97fa640 1 --2- 172.21.15.6:0/73217013 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fe8a0066480 0x7fe8a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:11.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.655+0000 7fe8b97fa640 1 -- 172.21.15.6:0/73217013 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fe8b0083750 con 0x7fe8bc0aeb40 2023-07-21T22:20:11.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.655+0000 7fe8bbfff640 1 --2- 172.21.15.6:0/73217013 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fe8a0066480 0x7fe8a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:11.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.655+0000 7fe8bbfff640 1 --2- 172.21.15.6:0/73217013 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fe8a0066480 0x7fe8a0068930 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc070800 tx=0x7fe8a8008040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:11.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.659+0000 7fe8b97fa640 1 -- 172.21.15.6:0/73217013 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe8b0050880 con 0x7fe8bc0aeb40 2023-07-21T22:20:11.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.831+0000 7fe8c2b74640 1 -- 172.21.15.6:0/73217013 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8bc15c6f0 con 0x7fe8a0066480 2023-07-21T22:20:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.883+0000 7fe8b97fa640 1 -- 172.21.15.6:0/73217013 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fe8a8010960 con 0x7fe8a0066480 2023-07-21T22:20:11.933 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule activated for path /snap_test_dir1/dir9 2023-07-21T22:20:11.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.887+0000 7fe8c2b74640 1 -- 172.21.15.6:0/73217013 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fe8a0066480 msgr2=0x7fe8a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:11.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.887+0000 7fe8c2b74640 1 --2- 172.21.15.6:0/73217013 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fe8a0066480 0x7fe8a0068930 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc070800 tx=0x7fe8a8008040 comp rx=0 tx=0).stop 2023-07-21T22:20:11.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.887+0000 7fe8c2b74640 1 -- 172.21.15.6:0/73217013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc0aeb40 msgr2=0x7fe8bc14dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:11.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.887+0000 7fe8c2b74640 1 --2- 172.21.15.6:0/73217013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc0aeb40 0x7fe8bc14dc30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000c4d0 tx=0x7fe8b000c990 comp rx=0 tx=0).stop 2023-07-21T22:20:11.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.887+0000 7fe8c2b74640 1 -- 172.21.15.6:0/73217013 shutdown_connections 2023-07-21T22:20:11.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.887+0000 7fe8c2b74640 1 --2- 172.21.15.6:0/73217013 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fe8a0066480 0x7fe8a0068930 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.887+0000 7fe8c2b74640 1 --2- 172.21.15.6:0/73217013 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8bc15cef0 0x7fe8bc070a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.887+0000 7fe8c2b74640 1 --2- 172.21.15.6:0/73217013 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8bc159270 0x7fe8bc0acca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.887+0000 7fe8c2b74640 1 --2- 172.21.15.6:0/73217013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8bc0aeb40 0x7fe8bc14dc30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:11.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.887+0000 7fe8c2b74640 1 -- 172.21.15.6:0/73217013 >> 172.21.15.6:0/73217013 conn(0x7fe8bc0cde90 msgr2=0x7fe8bc15a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:11.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.887+0000 7fe8c2b74640 1 -- 172.21.15.6:0/73217013 shutdown_connections 2023-07-21T22:20:11.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:20:11.887+0000 7fe8c2b74640 1 -- 172.21.15.6:0/73217013 wait complete. 2023-07-21T22:20:11.954 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2023-07-21T22:20:40.929 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:20:40.933 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:21:00.116 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:21:00.072+0000 7f344b68f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:21:00.116 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:21:00.072+0000 7f344b68f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:21:00.116 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:21:00.072+0000 7f344b68f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:21:00.117 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:21:00.072+0000 7f344b68f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:21:00.117 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:21:00.072+0000 7f344b68f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:21:10.994 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:21:10.998 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:21:41.063 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:21:41.068 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:22:11.145 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:22:11.149 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:22:41.224 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:22:41.229 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:23:11.289 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:23:11.294 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:23:41.344 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:23:41.348 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:24:11.499 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:24:11.504 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:24:41.561 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:24:41.565 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:25:00.780 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:25:00.738+0000 7f344b68f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:25:00.781 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:25:00.738+0000 7f344b68f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:25:00.781 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:25:00.738+0000 7f344b68f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:25:00.781 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:25:00.738+0000 7f344b68f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:25:00.781 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:25:00.738+0000 7f344b68f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:25:11.944 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:25:11.948 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:25:42.006 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:25:42.010 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:26:12.070 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:26:12.074 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:26:42.145 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:26:42.149 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:27:12.331 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:27:12.335 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:27:42.411 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:27:42.415 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:28:12.474 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:28:12.479 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:28:42.538 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:28:42.542 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:29:12.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:29:12.590 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:29:42.641 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:29:42.646 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:30:12.712 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:30:12.716 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:30:42.794 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:30:42.799 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:31:12.848 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:31:12.852 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:31:19.955 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir0 1M 2023-07-21T22:31:20.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.068+0000 7ff7b4693640 1 Processor -- start 2023-07-21T22:31:20.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.068+0000 7ff7b4693640 1 -- start start 2023-07-21T22:31:20.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.068+0000 7ff7b4693640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7ac0cba60 0x7ff7ac0c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:20.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.068+0000 7ff7b4693640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7ac15b9c0 0x7ff7ac0cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:20.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.068+0000 7ff7b4693640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7ac0cc370 con 0x7ff7ac158090 2023-07-21T22:31:20.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.068+0000 7ff7b4693640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7ac0c37e0 con 0x7ff7ac15b9c0 2023-07-21T22:31:20.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.068+0000 7ff7b4693640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac0c3ac0 con 0x7ff7ac0cba60 2023-07-21T22:31:20.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.068+0000 7ff7b1c2e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7ac15b9c0 0x7ff7ac0cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:20.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.068+0000 7ff7b1c2e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7ac15b9c0 0x7ff7ac0cbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45930/0 (socket says 172.21.15.6:45930) 2023-07-21T22:31:20.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.068+0000 7ff7b1c2e640 1 -- 172.21.15.6:0/775508106 learned_addr learned my addr 172.21.15.6:0/775508106 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:20.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.072+0000 7ff7b242f640 1 --2- 172.21.15.6:0/775508106 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7ac0cba60 0x7ff7ac0c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:20.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.072+0000 7ff7b1c2e640 1 -- 172.21.15.6:0/775508106 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7ac0cba60 msgr2=0x7ff7ac0c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:20.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.072+0000 7ff7b1c2e640 1 --2- 172.21.15.6:0/775508106 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7ac0cba60 0x7ff7ac0c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.072+0000 7ff7b1c2e640 1 -- 172.21.15.6:0/775508106 >> v1:172.21.15.6:6789/0 conn(0x7ff7ac158090 legacy=0x7ff7ac158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:20.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.072+0000 7ff7b1c2e640 1 -- 172.21.15.6:0/775508106 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac0c3da0 con 0x7ff7ac15b9c0 2023-07-21T22:31:20.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.072+0000 7ff7b1c2e640 1 --2- 172.21.15.6:0/775508106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac15b9c0 0x7ff7ac0cbe30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff79c006fd0 tx=0x7ff79c01e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733f0edd94d762fc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:20.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.072+0000 7ff7b142d640 1 -- 172.21.15.6:0/775508106 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c004230 con 0x7ff7ac15b9c0 2023-07-21T22:31:20.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.072+0000 7ff7b142d640 1 -- 172.21.15.6:0/775508106 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79c0ab070 con 0x7ff7ac15b9c0 2023-07-21T22:31:20.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.072+0000 7ff7b142d640 1 -- 172.21.15.6:0/775508106 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79c0a76f0 con 0x7ff7ac15b9c0 2023-07-21T22:31:20.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b4693640 1 -- 172.21.15.6:0/775508106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac15b9c0 msgr2=0x7ff7ac0cbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:20.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b4693640 1 --2- 172.21.15.6:0/775508106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac15b9c0 0x7ff7ac0cbe30 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff79c006fd0 tx=0x7ff79c01e880 comp rx=0 tx=0).stop 2023-07-21T22:31:20.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b4693640 1 -- 172.21.15.6:0/775508106 shutdown_connections 2023-07-21T22:31:20.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b4693640 1 --2- 172.21.15.6:0/775508106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac15b9c0 0x7ff7ac0cbe30 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b4693640 1 --2- 172.21.15.6:0/775508106 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7ac0cba60 0x7ff7ac0c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b4693640 1 -- 172.21.15.6:0/775508106 >> 172.21.15.6:0/775508106 conn(0x7ff7ac0cde90 msgr2=0x7ff7ac0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b4693640 1 -- 172.21.15.6:0/775508106 shutdown_connections 2023-07-21T22:31:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b4693640 1 -- 172.21.15.6:0/775508106 wait complete. 2023-07-21T22:31:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b4693640 1 Processor -- start 2023-07-21T22:31:20.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b4693640 1 -- start start 2023-07-21T22:31:20.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b4693640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac0cba60 0x7ff7ac0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:20.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b4693640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7ac158090 0x7ff7ac14ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:20.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b4693640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7ac15b9c0 0x7ff7ac0b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:20.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b4693640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac14f180 con 0x7ff7ac0cba60 2023-07-21T22:31:20.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b4693640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac0b1300 con 0x7ff7ac158090 2023-07-21T22:31:20.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b4693640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac0c9720 con 0x7ff7ac15b9c0 2023-07-21T22:31:20.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b242f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac0cba60 0x7ff7ac0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:20.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b242f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac0cba60 0x7ff7ac0b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45942/0 (socket says 172.21.15.6:45942) 2023-07-21T22:31:20.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b242f640 1 -- 172.21.15.6:0/1595444553 learned_addr learned my addr 172.21.15.6:0/1595444553 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:20.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b2c30640 1 --2- 172.21.15.6:0/1595444553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7ac15b9c0 0x7ff7ac0b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:20.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b1c2e640 1 --2- 172.21.15.6:0/1595444553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7ac158090 0x7ff7ac14ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:20.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b242f640 1 -- 172.21.15.6:0/1595444553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7ac15b9c0 msgr2=0x7ff7ac0b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:20.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b242f640 1 --2- 172.21.15.6:0/1595444553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7ac15b9c0 0x7ff7ac0b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b242f640 1 -- 172.21.15.6:0/1595444553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7ac158090 msgr2=0x7ff7ac14ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:20.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b242f640 1 --2- 172.21.15.6:0/1595444553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7ac158090 0x7ff7ac14ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b242f640 1 -- 172.21.15.6:0/1595444553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79c00b780 con 0x7ff7ac0cba60 2023-07-21T22:31:20.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b2c30640 1 --2- 172.21.15.6:0/1595444553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7ac15b9c0 0x7ff7ac0b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:31:20.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.076+0000 7ff7b1c2e640 1 --2- 172.21.15.6:0/1595444553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7ac158090 0x7ff7ac14ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:31:20.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.080+0000 7ff7b242f640 1 --2- 172.21.15.6:0/1595444553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac0cba60 0x7ff7ac0b36a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800d800 tx=0x7ff7a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:20.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.080+0000 7ff7a2ffd640 1 -- 172.21.15.6:0/1595444553 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a800b6c0 con 0x7ff7ac0cba60 2023-07-21T22:31:20.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.080+0000 7ff7a2ffd640 1 -- 172.21.15.6:0/1595444553 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a800b820 con 0x7ff7ac0cba60 2023-07-21T22:31:20.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.080+0000 7ff7a2ffd640 1 -- 172.21.15.6:0/1595444553 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a800bb90 con 0x7ff7ac0cba60 2023-07-21T22:31:20.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.080+0000 7ff7b4693640 1 -- 172.21.15.6:0/1595444553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7ac0c9a00 con 0x7ff7ac0cba60 2023-07-21T22:31:20.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.080+0000 7ff7b4693640 1 -- 172.21.15.6:0/1595444553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7ac0c9fc0 con 0x7ff7ac0cba60 2023-07-21T22:31:20.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.080+0000 7ff7b4693640 1 -- 172.21.15.6:0/1595444553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7ac0714b0 con 0x7ff7ac0cba60 2023-07-21T22:31:20.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.080+0000 7ff7a2ffd640 1 -- 172.21.15.6:0/1595444553 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7ff7a800bcf0 con 0x7ff7ac0cba60 2023-07-21T22:31:20.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.080+0000 7ff7a2ffd640 1 --2- 172.21.15.6:0/1595444553 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7ff790066480 0x7ff790068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:20.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.080+0000 7ff7a2ffd640 1 -- 172.21.15.6:0/1595444553 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7ff7a8084760 con 0x7ff7ac0cba60 2023-07-21T22:31:20.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.084+0000 7ff7b1c2e640 1 --2- 172.21.15.6:0/1595444553 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7ff790066480 0x7ff790068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:20.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.084+0000 7ff7b1c2e640 1 --2- 172.21.15.6:0/1595444553 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7ff790066480 0x7ff790068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0b1000 tx=0x7ff79c0a9070 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.088+0000 7ff7a2ffd640 1 -- 172.21.15.6:0/1595444553 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff7a8051830 con 0x7ff7ac0cba60 2023-07-21T22:31:20.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.260+0000 7ff7b4693640 1 -- 172.21.15.6:0/1595444553 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7ac0678d0 con 0x7ff790066480 2023-07-21T22:31:20.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.332+0000 7ff7a2ffd640 1 -- 172.21.15.6:0/1595444553 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7ff7ac0678d0 con 0x7ff790066480 2023-07-21T22:31:20.379 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2023-07-21T22:31:20.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.332+0000 7ff7b4693640 1 -- 172.21.15.6:0/1595444553 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7ff790066480 msgr2=0x7ff790068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:20.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.332+0000 7ff7b4693640 1 --2- 172.21.15.6:0/1595444553 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7ff790066480 0x7ff790068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0b1000 tx=0x7ff79c0a9070 comp rx=0 tx=0).stop 2023-07-21T22:31:20.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.332+0000 7ff7b4693640 1 -- 172.21.15.6:0/1595444553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac0cba60 msgr2=0x7ff7ac0b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:20.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.332+0000 7ff7b4693640 1 --2- 172.21.15.6:0/1595444553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac0cba60 0x7ff7ac0b36a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff7a800d800 tx=0x7ff7a800dcc0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.332+0000 7ff7b4693640 1 -- 172.21.15.6:0/1595444553 shutdown_connections 2023-07-21T22:31:20.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.332+0000 7ff7b4693640 1 --2- 172.21.15.6:0/1595444553 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7ff790066480 0x7ff790068930 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.332+0000 7ff7b4693640 1 --2- 172.21.15.6:0/1595444553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7ac15b9c0 0x7ff7ac0b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.332+0000 7ff7b4693640 1 --2- 172.21.15.6:0/1595444553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7ac158090 0x7ff7ac14ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.332+0000 7ff7b4693640 1 --2- 172.21.15.6:0/1595444553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac0cba60 0x7ff7ac0b36a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.332+0000 7ff7b4693640 1 -- 172.21.15.6:0/1595444553 >> 172.21.15.6:0/1595444553 conn(0x7ff7ac0cde90 msgr2=0x7ff7ac06c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:20.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.332+0000 7ff7b4693640 1 -- 172.21.15.6:0/1595444553 shutdown_connections 2023-07-21T22:31:20.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.332+0000 7ff7b4693640 1 -- 172.21.15.6:0/1595444553 wait complete. 2023-07-21T22:31:20.400 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2023-07-21T22:31:20.401 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir1 1M 2023-07-21T22:31:20.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.504+0000 7fc74605c640 1 Processor -- start 2023-07-21T22:31:20.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.504+0000 7fc74605c640 1 -- start start 2023-07-21T22:31:20.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.504+0000 7fc74605c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc74006a540 0x7fc74006a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:20.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.504+0000 7fc74605c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7400cf2e0 0x7fc7400cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:20.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.504+0000 7fc74605c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc7400cc9c0 0x7fc7400cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:20.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.504+0000 7fc74605c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7400d0920 con 0x7fc74006a540 2023-07-21T22:31:20.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.504+0000 7fc74605c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc74015bfd0 con 0x7fc7400cc9c0 2023-07-21T22:31:20.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.504+0000 7fc74605c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74006ae50 con 0x7fc7400cf2e0 2023-07-21T22:31:20.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.504+0000 7fc73f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc74006a540 0x7fc74006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:20.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.504+0000 7fc73f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc74006a540 0x7fc74006a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45958/0 (socket says 172.21.15.6:45958) 2023-07-21T22:31:20.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.504+0000 7fc73f7fe640 1 -- 172.21.15.6:0/511627585 learned_addr learned my addr 172.21.15.6:0/511627585 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:20.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.504+0000 7fc73effd640 1 --2- 172.21.15.6:0/511627585 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7400cf2e0 0x7fc7400cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:20.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.504+0000 7fc73ffff640 1 --2- 172.21.15.6:0/511627585 >> v2:172.21.15.161:3300/0 conn(0x7fc7400cc9c0 0x7fc7400cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:20.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.504+0000 7fc73f7fe640 1 -- 172.21.15.6:0/511627585 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7400cf2e0 msgr2=0x7fc7400cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:20.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.504+0000 7fc73f7fe640 1 --2- 172.21.15.6:0/511627585 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7400cf2e0 0x7fc7400cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.504+0000 7fc73f7fe640 1 -- 172.21.15.6:0/511627585 >> v2:172.21.15.161:3300/0 conn(0x7fc7400cc9c0 msgr2=0x7fc7400cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:20.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.504+0000 7fc73f7fe640 1 --2- 172.21.15.6:0/511627585 >> v2:172.21.15.161:3300/0 conn(0x7fc7400cc9c0 0x7fc7400cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.504+0000 7fc73f7fe640 1 -- 172.21.15.6:0/511627585 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7400cfd10 con 0x7fc74006a540 2023-07-21T22:31:20.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.508+0000 7fc73f7fe640 1 --2- 172.21.15.6:0/511627585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc74006a540 0x7fc74006a910 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc7400cc780 tx=0x7fc73001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7813125ff7ec3329 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:20.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.508+0000 7fc73e7fc640 1 -- 172.21.15.6:0/511627585 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7300aa5f0 con 0x7fc74006a540 2023-07-21T22:31:20.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.508+0000 7fc73e7fc640 1 -- 172.21.15.6:0/511627585 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7300aa750 con 0x7fc74006a540 2023-07-21T22:31:20.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.508+0000 7fc73e7fc640 1 -- 172.21.15.6:0/511627585 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7300aaae0 con 0x7fc74006a540 2023-07-21T22:31:20.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.508+0000 7fc74605c640 1 -- 172.21.15.6:0/511627585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc74006a540 msgr2=0x7fc74006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:20.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.508+0000 7fc74605c640 1 --2- 172.21.15.6:0/511627585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc74006a540 0x7fc74006a910 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc7400cc780 tx=0x7fc73001c4d0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.508+0000 7fc74605c640 1 -- 172.21.15.6:0/511627585 shutdown_connections 2023-07-21T22:31:20.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.508+0000 7fc74605c640 1 --2- 172.21.15.6:0/511627585 >> v2:172.21.15.161:3300/0 conn(0x7fc7400cc9c0 0x7fc7400cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.508+0000 7fc74605c640 1 --2- 172.21.15.6:0/511627585 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7400cf2e0 0x7fc7400cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.508+0000 7fc74605c640 1 --2- 172.21.15.6:0/511627585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc74006a540 0x7fc74006a910 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.508+0000 7fc74605c640 1 -- 172.21.15.6:0/511627585 >> 172.21.15.6:0/511627585 conn(0x7fc740099490 msgr2=0x7fc740089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:20.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.508+0000 7fc74605c640 1 -- 172.21.15.6:0/511627585 shutdown_connections 2023-07-21T22:31:20.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.508+0000 7fc74605c640 1 -- 172.21.15.6:0/511627585 wait complete. 2023-07-21T22:31:20.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.508+0000 7fc74605c640 1 Processor -- start 2023-07-21T22:31:20.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc74605c640 1 -- start start 2023-07-21T22:31:20.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc74605c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc74006a540 0x7fc7401531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc74605c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7400cc9c0 0x7fc740159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc74605c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7400cf2e0 0x7fc74015a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc74605c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc740153a20 con 0x7fc7400cf2e0 2023-07-21T22:31:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc74605c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc740153d00 con 0x7fc7400cc9c0 2023-07-21T22:31:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc74605c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc740153fe0 con 0x7fc74006a540 2023-07-21T22:31:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc73ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7400cf2e0 0x7fc74015a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc73ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7400cf2e0 0x7fc74015a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45968/0 (socket says 172.21.15.6:45968) 2023-07-21T22:31:20.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc73ffff640 1 -- 172.21.15.6:0/3595230830 learned_addr learned my addr 172.21.15.6:0/3595230830 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:20.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc73f7fe640 1 --2- 172.21.15.6:0/3595230830 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc74006a540 0x7fc7401531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:20.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc73effd640 1 --2- 172.21.15.6:0/3595230830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7400cc9c0 0x7fc740159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:20.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc73ffff640 1 -- 172.21.15.6:0/3595230830 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc74006a540 msgr2=0x7fc7401531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:20.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc73ffff640 1 --2- 172.21.15.6:0/3595230830 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc74006a540 0x7fc7401531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc73ffff640 1 -- 172.21.15.6:0/3595230830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7400cc9c0 msgr2=0x7fc740159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:20.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc73ffff640 1 --2- 172.21.15.6:0/3595230830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7400cc9c0 0x7fc740159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc73ffff640 1 -- 172.21.15.6:0/3595230830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7300094d0 con 0x7fc7400cf2e0 2023-07-21T22:31:20.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc73ffff640 1 --2- 172.21.15.6:0/3595230830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7400cf2e0 0x7fc74015a150 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc73800eed0 tx=0x7fc73800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:20.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc727fff640 1 -- 172.21.15.6:0/3595230830 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc738010040 con 0x7fc7400cf2e0 2023-07-21T22:31:20.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc727fff640 1 -- 172.21.15.6:0/3595230830 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73800bd30 con 0x7fc7400cf2e0 2023-07-21T22:31:20.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc727fff640 1 -- 172.21.15.6:0/3595230830 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73800bea0 con 0x7fc7400cf2e0 2023-07-21T22:31:20.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc74605c640 1 -- 172.21.15.6:0/3595230830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7401542c0 con 0x7fc7400cf2e0 2023-07-21T22:31:20.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc74605c640 1 -- 172.21.15.6:0/3595230830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc740153730 con 0x7fc7400cf2e0 2023-07-21T22:31:20.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.512+0000 7fc74605c640 1 -- 172.21.15.6:0/3595230830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7400678d0 con 0x7fc7400cf2e0 2023-07-21T22:31:20.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.516+0000 7fc727fff640 1 -- 172.21.15.6:0/3595230830 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fc738014640 con 0x7fc7400cf2e0 2023-07-21T22:31:20.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.516+0000 7fc727fff640 1 --2- 172.21.15.6:0/3595230830 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fc72c066480 0x7fc72c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:20.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.516+0000 7fc727fff640 1 -- 172.21.15.6:0/3595230830 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fc738084c90 con 0x7fc7400cf2e0 2023-07-21T22:31:20.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.516+0000 7fc73f7fe640 1 --2- 172.21.15.6:0/3595230830 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fc72c066480 0x7fc72c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:20.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.516+0000 7fc73f7fe640 1 --2- 172.21.15.6:0/3595230830 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fc72c066480 0x7fc72c068930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc7300ae000 tx=0x7fc7300b5040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:20.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.520+0000 7fc727fff640 1 -- 172.21.15.6:0/3595230830 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc738051bf0 con 0x7fc7400cf2e0 2023-07-21T22:31:20.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.696+0000 7fc74605c640 1 -- 172.21.15.6:0/3595230830 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7400cd780 con 0x7fc72c066480 2023-07-21T22:31:20.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.772+0000 7fc727fff640 1 -- 172.21.15.6:0/3595230830 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fc7300aa570 con 0x7fc72c066480 2023-07-21T22:31:20.819 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2023-07-21T22:31:20.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.772+0000 7fc74605c640 1 -- 172.21.15.6:0/3595230830 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fc72c066480 msgr2=0x7fc72c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:20.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.772+0000 7fc74605c640 1 --2- 172.21.15.6:0/3595230830 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fc72c066480 0x7fc72c068930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc7300ae000 tx=0x7fc7300b5040 comp rx=0 tx=0).stop 2023-07-21T22:31:20.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.772+0000 7fc74605c640 1 -- 172.21.15.6:0/3595230830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7400cf2e0 msgr2=0x7fc74015a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:20.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.772+0000 7fc74605c640 1 --2- 172.21.15.6:0/3595230830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7400cf2e0 0x7fc74015a150 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc73800eed0 tx=0x7fc73800b480 comp rx=0 tx=0).stop 2023-07-21T22:31:20.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.772+0000 7fc74605c640 1 -- 172.21.15.6:0/3595230830 shutdown_connections 2023-07-21T22:31:20.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.772+0000 7fc74605c640 1 --2- 172.21.15.6:0/3595230830 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fc72c066480 0x7fc72c068930 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.772+0000 7fc74605c640 1 --2- 172.21.15.6:0/3595230830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7400cf2e0 0x7fc74015a150 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.772+0000 7fc74605c640 1 --2- 172.21.15.6:0/3595230830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7400cc9c0 0x7fc740159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.772+0000 7fc74605c640 1 --2- 172.21.15.6:0/3595230830 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc74006a540 0x7fc7401531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.772+0000 7fc74605c640 1 -- 172.21.15.6:0/3595230830 >> 172.21.15.6:0/3595230830 conn(0x7fc740099490 msgr2=0x7fc7400acf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:20.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.772+0000 7fc74605c640 1 -- 172.21.15.6:0/3595230830 shutdown_connections 2023-07-21T22:31:20.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.772+0000 7fc74605c640 1 -- 172.21.15.6:0/3595230830 wait complete. 2023-07-21T22:31:20.841 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2023-07-21T22:31:20.841 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir2 1M 2023-07-21T22:31:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.944+0000 7f27595d2640 1 Processor -- start 2023-07-21T22:31:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.944+0000 7f27595d2640 1 -- start start 2023-07-21T22:31:20.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.944+0000 7f27595d2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f275415cef0 0x7f2754158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:20.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.944+0000 7f27595d2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2754159270 0x7f27540c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.944+0000 7f27595d2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27541532b0 con 0x7f27540aeb40 2023-07-21T22:31:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.944+0000 7f27595d2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f275415d360 con 0x7f2754159270 2023-07-21T22:31:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.944+0000 7f27595d2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27540ca6f0 con 0x7f275415cef0 2023-07-21T22:31:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.944+0000 7f2752ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f27540aeb40 0x7f27540aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48776/0 (socket says 172.21.15.6:48776) 2023-07-21T22:31:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.944+0000 7f2752ffd640 1 -- 172.21.15.6:0/2884567369 learned_addr learned my addr 172.21.15.6:0/2884567369 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:20.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.944+0000 7f27537fe640 1 --2- 172.21.15.6:0/2884567369 >> v2:172.21.15.6:3300/0 conn(0x7f2754159270 0x7f27540c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:20.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.944+0000 7f274bfff640 1 --2- 172.21.15.6:0/2884567369 >> v2:172.21.15.161:3300/0 conn(0x7f275415cef0 0x7f2754158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.944+0000 7f27537fe640 1 -- 172.21.15.6:0/2884567369 >> v2:172.21.15.161:3300/0 conn(0x7f275415cef0 msgr2=0x7f2754158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.944+0000 7f27537fe640 1 --2- 172.21.15.6:0/2884567369 >> v2:172.21.15.161:3300/0 conn(0x7f275415cef0 0x7f2754158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.944+0000 7f27537fe640 1 -- 172.21.15.6:0/2884567369 >> v1:172.21.15.6:6789/0 conn(0x7f27540aeb40 legacy=0x7f27540aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.944+0000 7f27537fe640 1 -- 172.21.15.6:0/2884567369 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27541599d0 con 0x7f2754159270 2023-07-21T22:31:21.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.948+0000 7f27537fe640 1 --2- 172.21.15.6:0/2884567369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2754159270 0x7f27540c88c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f27540cee90 tx=0x7f274c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=269436c8fefd0f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:21.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.948+0000 7f27527fc640 1 -- 172.21.15.6:0/2884567369 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c0a59a0 con 0x7f2754159270 2023-07-21T22:31:21.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.948+0000 7f27527fc640 1 -- 172.21.15.6:0/2884567369 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c0a5b00 con 0x7f2754159270 2023-07-21T22:31:21.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.948+0000 7f27527fc640 1 -- 172.21.15.6:0/2884567369 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c0a5e90 con 0x7f2754159270 2023-07-21T22:31:21.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.948+0000 7f27595d2640 1 -- 172.21.15.6:0/2884567369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2754159270 msgr2=0x7f27540c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:21.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.948+0000 7f27595d2640 1 --2- 172.21.15.6:0/2884567369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2754159270 0x7f27540c88c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f27540cee90 tx=0x7f274c01c8e0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.948+0000 7f27595d2640 1 -- 172.21.15.6:0/2884567369 shutdown_connections 2023-07-21T22:31:21.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.948+0000 7f27595d2640 1 --2- 172.21.15.6:0/2884567369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2754159270 0x7f27540c88c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.948+0000 7f27595d2640 1 --2- 172.21.15.6:0/2884567369 >> v2:172.21.15.161:3300/0 conn(0x7f275415cef0 0x7f2754158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.948+0000 7f27595d2640 1 -- 172.21.15.6:0/2884567369 >> 172.21.15.6:0/2884567369 conn(0x7f27540cde90 msgr2=0x7f27540ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:21.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.948+0000 7f27595d2640 1 -- 172.21.15.6:0/2884567369 shutdown_connections 2023-07-21T22:31:21.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.948+0000 7f27595d2640 1 -- 172.21.15.6:0/2884567369 wait complete. 2023-07-21T22:31:21.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f27595d2640 1 Processor -- start 2023-07-21T22:31:21.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f27595d2640 1 -- start start 2023-07-21T22:31:21.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f27595d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27540aeb40 0x7f2754151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f27595d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2754159270 0x7f2754156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f27595d2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f275415cef0 0x7f27541495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f27595d2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2754157260 con 0x7f27540aeb40 2023-07-21T22:31:21.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f27595d2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275415a260 con 0x7f275415cef0 2023-07-21T22:31:21.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f27595d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2754151d70 con 0x7f2754159270 2023-07-21T22:31:21.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f2752ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27540aeb40 0x7f2754151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f2752ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27540aeb40 0x7f2754151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45976/0 (socket says 172.21.15.6:45976) 2023-07-21T22:31:21.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f2752ffd640 1 -- 172.21.15.6:0/1434626011 learned_addr learned my addr 172.21.15.6:0/1434626011 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:21.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f274bfff640 1 --2- 172.21.15.6:0/1434626011 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2754159270 0x7f2754156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f27537fe640 1 --2- 172.21.15.6:0/1434626011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f275415cef0 0x7f27541495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f2752ffd640 1 -- 172.21.15.6:0/1434626011 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2754159270 msgr2=0x7f2754156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:21.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f2752ffd640 1 --2- 172.21.15.6:0/1434626011 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2754159270 0x7f2754156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f2752ffd640 1 -- 172.21.15.6:0/1434626011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f275415cef0 msgr2=0x7f27541495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:21.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f2752ffd640 1 --2- 172.21.15.6:0/1434626011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f275415cef0 0x7f27541495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f2752ffd640 1 -- 172.21.15.6:0/1434626011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c009a70 con 0x7f27540aeb40 2023-07-21T22:31:21.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f2752ffd640 1 --2- 172.21.15.6:0/1434626011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27540aeb40 0x7f2754151790 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f274400c500 tx=0x7f274400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:21.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f274b7fe640 1 -- 172.21.15.6:0/1434626011 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2744005cf0 con 0x7f27540aeb40 2023-07-21T22:31:21.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f274b7fe640 1 -- 172.21.15.6:0/1434626011 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2744005e50 con 0x7f27540aeb40 2023-07-21T22:31:21.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f274b7fe640 1 -- 172.21.15.6:0/1434626011 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27440072f0 con 0x7f27540aeb40 2023-07-21T22:31:21.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f27595d2640 1 -- 172.21.15.6:0/1434626011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2754152050 con 0x7f27540aeb40 2023-07-21T22:31:21.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.952+0000 7f27595d2640 1 -- 172.21.15.6:0/1434626011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2754159ef0 con 0x7f27540aeb40 2023-07-21T22:31:21.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.956+0000 7f27595d2640 1 -- 172.21.15.6:0/1434626011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27540678d0 con 0x7f27540aeb40 2023-07-21T22:31:21.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.956+0000 7f274b7fe640 1 -- 172.21.15.6:0/1434626011 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f2744007450 con 0x7f27540aeb40 2023-07-21T22:31:21.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.956+0000 7f274b7fe640 1 --2- 172.21.15.6:0/1434626011 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f2734066480 0x7f2734068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.956+0000 7f274b7fe640 1 -- 172.21.15.6:0/1434626011 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f2744083660 con 0x7f27540aeb40 2023-07-21T22:31:21.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.956+0000 7f274bfff640 1 --2- 172.21.15.6:0/1434626011 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f2734066480 0x7f2734068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.956+0000 7f274bfff640 1 --2- 172.21.15.6:0/1434626011 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f2734066480 0x7f2734068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2754150a70 tx=0x7f273c00b3a0 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:21.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:20.960+0000 7f274b7fe640 1 -- 172.21.15.6:0/1434626011 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2744050890 con 0x7f27540aeb40 2023-07-21T22:31:21.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.136+0000 7f27595d2640 1 -- 172.21.15.6:0/1434626011 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f275415c9d0 con 0x7f2734066480 2023-07-21T22:31:21.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.208+0000 7f274b7fe640 1 -- 172.21.15.6:0/1434626011 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f273c003900 con 0x7f2734066480 2023-07-21T22:31:21.257 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2023-07-21T22:31:21.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.212+0000 7f27595d2640 1 -- 172.21.15.6:0/1434626011 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f2734066480 msgr2=0x7f2734068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:21.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.212+0000 7f27595d2640 1 --2- 172.21.15.6:0/1434626011 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f2734066480 0x7f2734068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2754150a70 tx=0x7f273c00b3a0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.212+0000 7f27595d2640 1 -- 172.21.15.6:0/1434626011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27540aeb40 msgr2=0x7f2754151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:21.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.212+0000 7f27595d2640 1 --2- 172.21.15.6:0/1434626011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27540aeb40 0x7f2754151790 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f274400c500 tx=0x7f274400c9c0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.212+0000 7f27595d2640 1 -- 172.21.15.6:0/1434626011 shutdown_connections 2023-07-21T22:31:21.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.212+0000 7f27595d2640 1 --2- 172.21.15.6:0/1434626011 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f2734066480 0x7f2734068930 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.212+0000 7f27595d2640 1 --2- 172.21.15.6:0/1434626011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f275415cef0 0x7f27541495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.212+0000 7f27595d2640 1 --2- 172.21.15.6:0/1434626011 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2754159270 0x7f2754156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.212+0000 7f27595d2640 1 --2- 172.21.15.6:0/1434626011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27540aeb40 0x7f2754151790 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.212+0000 7f27595d2640 1 -- 172.21.15.6:0/1434626011 >> 172.21.15.6:0/1434626011 conn(0x7f27540cde90 msgr2=0x7f27540cb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:21.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.212+0000 7f27595d2640 1 -- 172.21.15.6:0/1434626011 shutdown_connections 2023-07-21T22:31:21.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.212+0000 7f27595d2640 1 -- 172.21.15.6:0/1434626011 wait complete. 2023-07-21T22:31:21.278 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2023-07-21T22:31:21.278 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir3 1M 2023-07-21T22:31:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.380+0000 7f4760a93640 1 Processor -- start 2023-07-21T22:31:21.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.380+0000 7f4760a93640 1 -- start start 2023-07-21T22:31:21.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.380+0000 7f4760a93640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f475c0aeb40 0x7f475c15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.380+0000 7f4760a93640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f475c0aef10 0x7f475c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.380+0000 7f4760a93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c159270 0x7f475c0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.380+0000 7f4760a93640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f475c1532b0 con 0x7f475c0aeb40 2023-07-21T22:31:21.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.380+0000 7f4760a93640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f475c0ca6f0 con 0x7f475c0aef10 2023-07-21T22:31:21.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.380+0000 7f4760a93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475c1599d0 con 0x7f475c159270 2023-07-21T22:31:21.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.380+0000 7f475a59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f475c0aeb40 0x7f475c15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.380+0000 7f475a59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f475c0aeb40 0x7f475c15cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45988/0 (socket says 172.21.15.6:45988) 2023-07-21T22:31:21.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.380+0000 7f475a59c640 1 -- 172.21.15.6:0/3368342848 learned_addr learned my addr 172.21.15.6:0/3368342848 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:21.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.380+0000 7f4759d9b640 1 --2- 172.21.15.6:0/3368342848 >> v2:172.21.15.161:3300/0 conn(0x7f475c0aef10 0x7f475c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.380+0000 7f475ad9d640 1 --2- 172.21.15.6:0/3368342848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c159270 0x7f475c0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.380+0000 7f475a59c640 1 -- 172.21.15.6:0/3368342848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c159270 msgr2=0x7f475c0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:21.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.380+0000 7f475a59c640 1 --2- 172.21.15.6:0/3368342848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c159270 0x7f475c0c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.380+0000 7f475a59c640 1 -- 172.21.15.6:0/3368342848 >> v2:172.21.15.161:3300/0 conn(0x7f475c0aef10 msgr2=0x7f475c158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:21.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.380+0000 7f475a59c640 1 --2- 172.21.15.6:0/3368342848 >> v2:172.21.15.161:3300/0 conn(0x7f475c0aef10 0x7f475c158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.380+0000 7f475a59c640 1 -- 172.21.15.6:0/3368342848 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c159cb0 con 0x7f475c0aeb40 2023-07-21T22:31:21.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.384+0000 7f475a59c640 1 --2- 172.21.15.6:0/3368342848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f475c0aeb40 0x7f475c15cef0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f475c0cee90 tx=0x7f474c01eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d2d12addf9dac0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:21.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.384+0000 7f475959a640 1 -- 172.21.15.6:0/3368342848 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0a7ba0 con 0x7f475c0aeb40 2023-07-21T22:31:21.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.384+0000 7f475959a640 1 -- 172.21.15.6:0/3368342848 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c0a7d00 con 0x7f475c0aeb40 2023-07-21T22:31:21.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.384+0000 7f475959a640 1 -- 172.21.15.6:0/3368342848 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0af660 con 0x7f475c0aeb40 2023-07-21T22:31:21.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.384+0000 7f4760a93640 1 -- 172.21.15.6:0/3368342848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f475c0aeb40 msgr2=0x7f475c15cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:21.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.384+0000 7f4760a93640 1 --2- 172.21.15.6:0/3368342848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f475c0aeb40 0x7f475c15cef0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f475c0cee90 tx=0x7f474c01eb10 comp rx=0 tx=0).stop 2023-07-21T22:31:21.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.384+0000 7f4760a93640 1 -- 172.21.15.6:0/3368342848 shutdown_connections 2023-07-21T22:31:21.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.384+0000 7f4760a93640 1 --2- 172.21.15.6:0/3368342848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c159270 0x7f475c0c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.384+0000 7f4760a93640 1 --2- 172.21.15.6:0/3368342848 >> v2:172.21.15.161:3300/0 conn(0x7f475c0aef10 0x7f475c158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.384+0000 7f4760a93640 1 --2- 172.21.15.6:0/3368342848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f475c0aeb40 0x7f475c15cef0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.384+0000 7f4760a93640 1 -- 172.21.15.6:0/3368342848 >> 172.21.15.6:0/3368342848 conn(0x7f475c0cde90 msgr2=0x7f475c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:21.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.384+0000 7f4760a93640 1 -- 172.21.15.6:0/3368342848 shutdown_connections 2023-07-21T22:31:21.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.384+0000 7f4760a93640 1 -- 172.21.15.6:0/3368342848 wait complete. 2023-07-21T22:31:21.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f4760a93640 1 Processor -- start 2023-07-21T22:31:21.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f4760a93640 1 -- start start 2023-07-21T22:31:21.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f4760a93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f475c0aeb40 0x7f475c14bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f4760a93640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c0aef10 0x7f475c14e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f4760a93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c159270 0x7f475c150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f4760a93640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c14e250 con 0x7f475c0aeb40 2023-07-21T22:31:21.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f4760a93640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c14d6b0 con 0x7f475c0aef10 2023-07-21T22:31:21.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f4760a93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475c14d920 con 0x7f475c159270 2023-07-21T22:31:21.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f475a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f475c0aeb40 0x7f475c14bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f475a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f475c0aeb40 0x7f475c14bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45996/0 (socket says 172.21.15.6:45996) 2023-07-21T22:31:21.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f475a59c640 1 -- 172.21.15.6:0/2623356074 learned_addr learned my addr 172.21.15.6:0/2623356074 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:21.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f475ad9d640 1 --2- 172.21.15.6:0/2623356074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c159270 0x7f475c150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f4759d9b640 1 --2- 172.21.15.6:0/2623356074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c0aef10 0x7f475c14e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f475a59c640 1 -- 172.21.15.6:0/2623356074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c159270 msgr2=0x7f475c150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:21.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f475a59c640 1 --2- 172.21.15.6:0/2623356074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c159270 0x7f475c150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f475a59c640 1 -- 172.21.15.6:0/2623356074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c0aef10 msgr2=0x7f475c14e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:21.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f475a59c640 1 --2- 172.21.15.6:0/2623356074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c0aef10 0x7f475c14e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f475a59c640 1 -- 172.21.15.6:0/2623356074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c00b770 con 0x7f475c0aeb40 2023-07-21T22:31:21.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f4759d9b640 1 --2- 172.21.15.6:0/2623356074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c0aef10 0x7f475c14e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:21.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f475a59c640 1 --2- 172.21.15.6:0/2623356074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f475c0aeb40 0x7f475c14bf60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f474c01f3b0 tx=0x7f474c01d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:21.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f474affd640 1 -- 172.21.15.6:0/2623356074 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0a7ba0 con 0x7f475c0aeb40 2023-07-21T22:31:21.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f474affd640 1 -- 172.21.15.6:0/2623356074 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c0ba480 con 0x7f475c0aeb40 2023-07-21T22:31:21.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f474affd640 1 -- 172.21.15.6:0/2623356074 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0ba830 con 0x7f475c0aeb40 2023-07-21T22:31:21.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f4760a93640 1 -- 172.21.15.6:0/2623356074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475c14dc00 con 0x7f475c0aeb40 2023-07-21T22:31:21.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.388+0000 7f4760a93640 1 -- 172.21.15.6:0/2623356074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475c14c4a0 con 0x7f475c0aeb40 2023-07-21T22:31:21.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.392+0000 7f4760a93640 1 -- 172.21.15.6:0/2623356074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475c0678d0 con 0x7f475c0aeb40 2023-07-21T22:31:21.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.392+0000 7f474affd640 1 -- 172.21.15.6:0/2623356074 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f475c0c9610 con 0x7f475c0aeb40 2023-07-21T22:31:21.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.392+0000 7f474affd640 1 --2- 172.21.15.6:0/2623356074 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f473c066480 0x7f473c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.392+0000 7f474affd640 1 -- 172.21.15.6:0/2623356074 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f474c11f730 con 0x7f475c0aeb40 2023-07-21T22:31:21.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.392+0000 7f4759d9b640 1 --2- 172.21.15.6:0/2623356074 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f473c066480 0x7f473c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.392+0000 7f4759d9b640 1 --2- 172.21.15.6:0/2623356074 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f473c066480 0x7f473c068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f475c1f7990 tx=0x7f4750008040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:21.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.396+0000 7f474affd640 1 -- 172.21.15.6:0/2623356074 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f474c0ec770 con 0x7f475c0aeb40 2023-07-21T22:31:21.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.568+0000 7f4760a93640 1 -- 172.21.15.6:0/2623356074 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f475c159670 con 0x7f473c066480 2023-07-21T22:31:21.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.640+0000 7f474affd640 1 -- 172.21.15.6:0/2623356074 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f475000f920 con 0x7f473c066480 2023-07-21T22:31:21.688 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2023-07-21T22:31:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.640+0000 7f4760a93640 1 -- 172.21.15.6:0/2623356074 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f473c066480 msgr2=0x7f473c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.640+0000 7f4760a93640 1 --2- 172.21.15.6:0/2623356074 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f473c066480 0x7f473c068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f475c1f7990 tx=0x7f4750008040 comp rx=0 tx=0).stop 2023-07-21T22:31:21.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.640+0000 7f4760a93640 1 -- 172.21.15.6:0/2623356074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f475c0aeb40 msgr2=0x7f475c14bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.640+0000 7f4760a93640 1 --2- 172.21.15.6:0/2623356074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f475c0aeb40 0x7f475c14bf60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f474c01f3b0 tx=0x7f474c01d350 comp rx=0 tx=0).stop 2023-07-21T22:31:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.640+0000 7f4760a93640 1 -- 172.21.15.6:0/2623356074 shutdown_connections 2023-07-21T22:31:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.640+0000 7f4760a93640 1 --2- 172.21.15.6:0/2623356074 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f473c066480 0x7f473c068930 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.640+0000 7f4760a93640 1 --2- 172.21.15.6:0/2623356074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c159270 0x7f475c150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.640+0000 7f4760a93640 1 --2- 172.21.15.6:0/2623356074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c0aef10 0x7f475c14e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.640+0000 7f4760a93640 1 --2- 172.21.15.6:0/2623356074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f475c0aeb40 0x7f475c14bf60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.640+0000 7f4760a93640 1 -- 172.21.15.6:0/2623356074 >> 172.21.15.6:0/2623356074 conn(0x7f475c0cde90 msgr2=0x7f475c0cb570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:21.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.640+0000 7f4760a93640 1 -- 172.21.15.6:0/2623356074 shutdown_connections 2023-07-21T22:31:21.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.640+0000 7f4760a93640 1 -- 172.21.15.6:0/2623356074 wait complete. 2023-07-21T22:31:21.709 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2023-07-21T22:31:21.710 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir4 1M 2023-07-21T22:31:21.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.816+0000 7f52d8819640 1 Processor -- start 2023-07-21T22:31:21.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.816+0000 7f52d8819640 1 -- start start 2023-07-21T22:31:21.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.816+0000 7f52d8819640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f52d415bde0 0x7f52d40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.816+0000 7f52d8819640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52d40d2fc0 0x7f52d40b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.816+0000 7f52d8819640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d40b04c0 con 0x7f52d40d2300 2023-07-21T22:31:21.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.816+0000 7f52d8819640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d415c1b0 con 0x7f52d40d2fc0 2023-07-21T22:31:21.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.816+0000 7f52d8819640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d40d0aa0 con 0x7f52d415bde0 2023-07-21T22:31:21.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.816+0000 7f52cbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52d40d2fc0 0x7f52d40b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.816+0000 7f52cbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52d40d2fc0 0x7f52d40b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46012/0 (socket says 172.21.15.6:46012) 2023-07-21T22:31:21.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.816+0000 7f52cbfff640 1 -- 172.21.15.6:0/2272140206 learned_addr learned my addr 172.21.15.6:0/2272140206 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:21.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.816+0000 7f52d259c640 1 --2- 172.21.15.6:0/2272140206 >> v2:172.21.15.161:3300/0 conn(0x7f52d415bde0 0x7f52d40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.816+0000 7f52cbfff640 1 -- 172.21.15.6:0/2272140206 >> v2:172.21.15.161:3300/0 conn(0x7f52d415bde0 msgr2=0x7f52d40d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:21.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.816+0000 7f52cbfff640 1 --2- 172.21.15.6:0/2272140206 >> v2:172.21.15.161:3300/0 conn(0x7f52d415bde0 0x7f52d40d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.816+0000 7f52cbfff640 1 -- 172.21.15.6:0/2272140206 >> v1:172.21.15.6:6789/0 conn(0x7f52d40d2300 legacy=0x7f52d40cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:21.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.816+0000 7f52cbfff640 1 -- 172.21.15.6:0/2272140206 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d40afb90 con 0x7f52d40d2fc0 2023-07-21T22:31:21.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.820+0000 7f52cbfff640 1 --2- 172.21.15.6:0/2272140206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d40d2fc0 0x7f52d40b0950 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f52d408b210 tx=0x7f52bc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a294f16536ad37f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:21.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.820+0000 7f52d1d9b640 1 -- 172.21.15.6:0/2272140206 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc0aa660 con 0x7f52d40d2fc0 2023-07-21T22:31:21.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.820+0000 7f52d1d9b640 1 -- 172.21.15.6:0/2272140206 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc0aa7c0 con 0x7f52d40d2fc0 2023-07-21T22:31:21.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.820+0000 7f52d1d9b640 1 -- 172.21.15.6:0/2272140206 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc0aab50 con 0x7f52d40d2fc0 2023-07-21T22:31:21.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.820+0000 7f52d8819640 1 -- 172.21.15.6:0/2272140206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d40d2fc0 msgr2=0x7f52d40b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:21.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.820+0000 7f52d8819640 1 --2- 172.21.15.6:0/2272140206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d40d2fc0 0x7f52d40b0950 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f52d408b210 tx=0x7f52bc01c500 comp rx=0 tx=0).stop 2023-07-21T22:31:21.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.820+0000 7f52d8819640 1 -- 172.21.15.6:0/2272140206 shutdown_connections 2023-07-21T22:31:21.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.820+0000 7f52d8819640 1 --2- 172.21.15.6:0/2272140206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d40d2fc0 0x7f52d40b0950 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.820+0000 7f52d8819640 1 --2- 172.21.15.6:0/2272140206 >> v2:172.21.15.161:3300/0 conn(0x7f52d415bde0 0x7f52d40d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.820+0000 7f52d8819640 1 -- 172.21.15.6:0/2272140206 >> 172.21.15.6:0/2272140206 conn(0x7f52d40659d0 msgr2=0x7f52d409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:21.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.820+0000 7f52d8819640 1 -- 172.21.15.6:0/2272140206 shutdown_connections 2023-07-21T22:31:21.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.820+0000 7f52d8819640 1 -- 172.21.15.6:0/2272140206 wait complete. 2023-07-21T22:31:21.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d8819640 1 Processor -- start 2023-07-21T22:31:21.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d8819640 1 -- start start 2023-07-21T22:31:21.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d8819640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52d40d2300 0x7f52d4151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d8819640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52d40d2fc0 0x7f52d40cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d8819640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d415bde0 0x7f52d4158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d8819640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d4151dc0 con 0x7f52d415bde0 2023-07-21T22:31:21.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d8819640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d4151f90 con 0x7f52d40d2fc0 2023-07-21T22:31:21.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d8819640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d40b51a0 con 0x7f52d40d2300 2023-07-21T22:31:21.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d415bde0 0x7f52d4158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d415bde0 0x7f52d4158ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46026/0 (socket says 172.21.15.6:46026) 2023-07-21T22:31:21.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d2d9d640 1 -- 172.21.15.6:0/247520312 learned_addr learned my addr 172.21.15.6:0/247520312 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:21.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52cbfff640 1 --2- 172.21.15.6:0/247520312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52d40d2fc0 0x7f52d40cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d259c640 1 --2- 172.21.15.6:0/247520312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52d40d2300 0x7f52d4151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d2d9d640 1 -- 172.21.15.6:0/247520312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52d40d2300 msgr2=0x7f52d4151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:21.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d2d9d640 1 --2- 172.21.15.6:0/247520312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52d40d2300 0x7f52d4151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d2d9d640 1 -- 172.21.15.6:0/247520312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52d40d2fc0 msgr2=0x7f52d40cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:21.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d2d9d640 1 --2- 172.21.15.6:0/247520312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52d40d2fc0 0x7f52d40cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d2d9d640 1 -- 172.21.15.6:0/247520312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc0094d0 con 0x7f52d415bde0 2023-07-21T22:31:21.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d2d9d640 1 --2- 172.21.15.6:0/247520312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d415bde0 0x7f52d4158ed0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00c770 tx=0x7f52cc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:21.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52caffd640 1 -- 172.21.15.6:0/247520312 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc003b80 con 0x7f52d415bde0 2023-07-21T22:31:21.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52caffd640 1 -- 172.21.15.6:0/247520312 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc003ce0 con 0x7f52d415bde0 2023-07-21T22:31:21.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52caffd640 1 -- 172.21.15.6:0/247520312 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00aa90 con 0x7f52d415bde0 2023-07-21T22:31:21.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d8819640 1 -- 172.21.15.6:0/247520312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d40b5480 con 0x7f52d415bde0 2023-07-21T22:31:21.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d8819640 1 -- 172.21.15.6:0/247520312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d40b5a40 con 0x7f52d415bde0 2023-07-21T22:31:21.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.824+0000 7f52d8819640 1 -- 172.21.15.6:0/247520312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d40678d0 con 0x7f52d415bde0 2023-07-21T22:31:21.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.828+0000 7f52caffd640 1 -- 172.21.15.6:0/247520312 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f52cc00abf0 con 0x7f52d415bde0 2023-07-21T22:31:21.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.828+0000 7f52caffd640 1 --2- 172.21.15.6:0/247520312 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f52b4066480 0x7f52b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.828+0000 7f52caffd640 1 -- 172.21.15.6:0/247520312 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f52cc083ff0 con 0x7f52d415bde0 2023-07-21T22:31:21.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.828+0000 7f52d259c640 1 --2- 172.21.15.6:0/247520312 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f52b4066480 0x7f52b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.828+0000 7f52d259c640 1 --2- 172.21.15.6:0/247520312 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f52b4066480 0x7f52b4068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009a30 tx=0x7f52c4008040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:21.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:21.832+0000 7f52caffd640 1 -- 172.21.15.6:0/247520312 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f52cc051090 con 0x7f52d415bde0 2023-07-21T22:31:22.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.008+0000 7f52d8819640 1 -- 172.21.15.6:0/247520312 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f52d40d07b0 con 0x7f52b4066480 2023-07-21T22:31:22.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.076+0000 7f52caffd640 1 -- 172.21.15.6:0/247520312 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f52c40059a0 con 0x7f52b4066480 2023-07-21T22:31:22.123 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2023-07-21T22:31:22.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.076+0000 7f52d8819640 1 -- 172.21.15.6:0/247520312 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f52b4066480 msgr2=0x7f52b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:22.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.076+0000 7f52d8819640 1 --2- 172.21.15.6:0/247520312 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f52b4066480 0x7f52b4068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009a30 tx=0x7f52c4008040 comp rx=0 tx=0).stop 2023-07-21T22:31:22.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.076+0000 7f52d8819640 1 -- 172.21.15.6:0/247520312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d415bde0 msgr2=0x7f52d4158ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:22.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.076+0000 7f52d8819640 1 --2- 172.21.15.6:0/247520312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d415bde0 0x7f52d4158ed0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00c770 tx=0x7f52cc00cc30 comp rx=0 tx=0).stop 2023-07-21T22:31:22.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.076+0000 7f52d8819640 1 -- 172.21.15.6:0/247520312 shutdown_connections 2023-07-21T22:31:22.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.076+0000 7f52d8819640 1 --2- 172.21.15.6:0/247520312 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f52b4066480 0x7f52b4068930 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.076+0000 7f52d8819640 1 --2- 172.21.15.6:0/247520312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52d415bde0 0x7f52d4158ed0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.076+0000 7f52d8819640 1 --2- 172.21.15.6:0/247520312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52d40d2fc0 0x7f52d40cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.076+0000 7f52d8819640 1 --2- 172.21.15.6:0/247520312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52d40d2300 0x7f52d4151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.076+0000 7f52d8819640 1 -- 172.21.15.6:0/247520312 >> 172.21.15.6:0/247520312 conn(0x7f52d40659d0 msgr2=0x7f52d415aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:22.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.076+0000 7f52d8819640 1 -- 172.21.15.6:0/247520312 shutdown_connections 2023-07-21T22:31:22.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.076+0000 7f52d8819640 1 -- 172.21.15.6:0/247520312 wait complete. 2023-07-21T22:31:22.144 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2023-07-21T22:31:22.145 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir5 1M 2023-07-21T22:31:22.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.244+0000 7f9e960f9640 1 Processor -- start 2023-07-21T22:31:22.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.244+0000 7f9e960f9640 1 -- start start 2023-07-21T22:31:22.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.244+0000 7f9e960f9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e900aeb40 0x7f9e9015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:22.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.244+0000 7f9e960f9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e901532b0 con 0x7f9e900aef10 2023-07-21T22:31:22.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.244+0000 7f9e960f9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e900ca6f0 con 0x7f9e90159440 2023-07-21T22:31:22.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.244+0000 7f9e960f9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e901599d0 con 0x7f9e900aeb40 2023-07-21T22:31:22.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.248+0000 7f9e8f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e900aeb40 0x7f9e9015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:22.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.248+0000 7f9e8f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9e900aeb40 0x7f9e9015cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46036/0 (socket says 172.21.15.6:46036) 2023-07-21T22:31:22.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.248+0000 7f9e8f7fe640 1 -- 172.21.15.6:0/2660309793 learned_addr learned my addr 172.21.15.6:0/2660309793 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:22.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.248+0000 7f9e8f7fe640 1 -- 172.21.15.6:0/2660309793 >> v1:172.21.15.161:6789/0 conn(0x7f9e90159440 legacy=0x7f9e900c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:22.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.248+0000 7f9e8f7fe640 1 -- 172.21.15.6:0/2660309793 >> v1:172.21.15.6:6789/0 conn(0x7f9e900aef10 legacy=0x7f9e90158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:22.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.248+0000 7f9e8f7fe640 1 -- 172.21.15.6:0/2660309793 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e90159cb0 con 0x7f9e900aeb40 2023-07-21T22:31:22.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.248+0000 7f9e8f7fe640 1 --2- 172.21.15.6:0/2660309793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e900aeb40 0x7f9e9015cef0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9e80009870 tx=0x7f9e8001e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49a6287950e87b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:22.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.248+0000 7f9e8e7fc640 1 -- 172.21.15.6:0/2660309793 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e800a8660 con 0x7f9e900aeb40 2023-07-21T22:31:22.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.248+0000 7f9e8e7fc640 1 -- 172.21.15.6:0/2660309793 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e800a87c0 con 0x7f9e900aeb40 2023-07-21T22:31:22.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.248+0000 7f9e8e7fc640 1 -- 172.21.15.6:0/2660309793 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e800a8b50 con 0x7f9e900aeb40 2023-07-21T22:31:22.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.252+0000 7f9e960f9640 1 -- 172.21.15.6:0/2660309793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e900aeb40 msgr2=0x7f9e9015cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:22.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.252+0000 7f9e960f9640 1 --2- 172.21.15.6:0/2660309793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e900aeb40 0x7f9e9015cef0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9e80009870 tx=0x7f9e8001e690 comp rx=0 tx=0).stop 2023-07-21T22:31:22.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.252+0000 7f9e960f9640 1 -- 172.21.15.6:0/2660309793 shutdown_connections 2023-07-21T22:31:22.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.252+0000 7f9e960f9640 1 --2- 172.21.15.6:0/2660309793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e900aeb40 0x7f9e9015cef0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.252+0000 7f9e960f9640 1 -- 172.21.15.6:0/2660309793 >> 172.21.15.6:0/2660309793 conn(0x7f9e900cde90 msgr2=0x7f9e900ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:22.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.252+0000 7f9e960f9640 1 -- 172.21.15.6:0/2660309793 shutdown_connections 2023-07-21T22:31:22.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.252+0000 7f9e960f9640 1 -- 172.21.15.6:0/2660309793 wait complete. 2023-07-21T22:31:22.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.252+0000 7f9e960f9640 1 Processor -- start 2023-07-21T22:31:22.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.252+0000 7f9e960f9640 1 -- start start 2023-07-21T22:31:22.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.252+0000 7f9e960f9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e900aeb40 0x7f9e901f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:22.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.252+0000 7f9e960f9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e900aef10 0x7f9e9006c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:22.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.252+0000 7f9e960f9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e90159440 0x7f9e900c3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:22.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.252+0000 7f9e960f9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e90070a60 con 0x7f9e900aef10 2023-07-21T22:31:22.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.252+0000 7f9e960f9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e901f82e0 con 0x7f9e900aeb40 2023-07-21T22:31:22.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.252+0000 7f9e960f9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9006fde0 con 0x7f9e90159440 2023-07-21T22:31:22.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.252+0000 7f9e8effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e900aef10 0x7f9e9006c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:22.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.252+0000 7f9e8effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e900aef10 0x7f9e9006c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46046/0 (socket says 172.21.15.6:46046) 2023-07-21T22:31:22.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.252+0000 7f9e8effd640 1 -- 172.21.15.6:0/2075990934 learned_addr learned my addr 172.21.15.6:0/2075990934 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:22.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.252+0000 7f9e8f7fe640 1 --2- 172.21.15.6:0/2075990934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e900aeb40 0x7f9e901f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:22.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.252+0000 7f9e8ffff640 1 --2- 172.21.15.6:0/2075990934 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e90159440 0x7f9e900c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:22.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.256+0000 7f9e8effd640 1 -- 172.21.15.6:0/2075990934 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e90159440 msgr2=0x7f9e900c3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:22.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.256+0000 7f9e8effd640 1 --2- 172.21.15.6:0/2075990934 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e90159440 0x7f9e900c3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.256+0000 7f9e8effd640 1 -- 172.21.15.6:0/2075990934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e900aeb40 msgr2=0x7f9e901f7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:22.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.256+0000 7f9e8effd640 1 --2- 172.21.15.6:0/2075990934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e900aeb40 0x7f9e901f7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.256+0000 7f9e8effd640 1 -- 172.21.15.6:0/2075990934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e800094d0 con 0x7f9e900aef10 2023-07-21T22:31:22.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.256+0000 7f9e8effd640 1 --2- 172.21.15.6:0/2075990934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e900aef10 0x7f9e9006c380 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400c500 tx=0x7f9e8400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:22.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.256+0000 7f9e77fff640 1 -- 172.21.15.6:0/2075990934 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84005220 con 0x7f9e900aef10 2023-07-21T22:31:22.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.256+0000 7f9e77fff640 1 -- 172.21.15.6:0/2075990934 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e84005380 con 0x7f9e900aef10 2023-07-21T22:31:22.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.256+0000 7f9e77fff640 1 -- 172.21.15.6:0/2075990934 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84007270 con 0x7f9e900aef10 2023-07-21T22:31:22.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.256+0000 7f9e960f9640 1 -- 172.21.15.6:0/2075990934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e900700c0 con 0x7f9e900aef10 2023-07-21T22:31:22.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.256+0000 7f9e960f9640 1 -- 172.21.15.6:0/2075990934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e90070680 con 0x7f9e900aef10 2023-07-21T22:31:22.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.256+0000 7f9e960f9640 1 -- 172.21.15.6:0/2075990934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e90070ba0 con 0x7f9e900aef10 2023-07-21T22:31:22.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.256+0000 7f9e77fff640 1 -- 172.21.15.6:0/2075990934 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f9e840073d0 con 0x7f9e900aef10 2023-07-21T22:31:22.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.256+0000 7f9e77fff640 1 --2- 172.21.15.6:0/2075990934 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9e7c066480 0x7f9e7c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:22.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.256+0000 7f9e77fff640 1 -- 172.21.15.6:0/2075990934 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f9e84083460 con 0x7f9e900aef10 2023-07-21T22:31:22.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.260+0000 7f9e8f7fe640 1 --2- 172.21.15.6:0/2075990934 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9e7c066480 0x7f9e7c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:22.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.260+0000 7f9e8f7fe640 1 --2- 172.21.15.6:0/2075990934 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9e7c066480 0x7f9e7c068930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9e800b1000 tx=0x7f9e800a9000 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:22.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.260+0000 7f9e77fff640 1 -- 172.21.15.6:0/2075990934 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9e90070ba0 con 0x7f9e900aef10 2023-07-21T22:31:22.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.440+0000 7f9e960f9640 1 -- 172.21.15.6:0/2075990934 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e9015c9d0 con 0x7f9e7c066480 2023-07-21T22:31:22.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.512+0000 7f9e77fff640 1 -- 172.21.15.6:0/2075990934 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f9e8000e1d0 con 0x7f9e7c066480 2023-07-21T22:31:22.559 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2023-07-21T22:31:22.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.512+0000 7f9e960f9640 1 -- 172.21.15.6:0/2075990934 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9e7c066480 msgr2=0x7f9e7c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:22.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.512+0000 7f9e960f9640 1 --2- 172.21.15.6:0/2075990934 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9e7c066480 0x7f9e7c068930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9e800b1000 tx=0x7f9e800a9000 comp rx=0 tx=0).stop 2023-07-21T22:31:22.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.512+0000 7f9e960f9640 1 -- 172.21.15.6:0/2075990934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e900aef10 msgr2=0x7f9e9006c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.512+0000 7f9e960f9640 1 --2- 172.21.15.6:0/2075990934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e900aef10 0x7f9e9006c380 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400c500 tx=0x7f9e8400c9c0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.512+0000 7f9e960f9640 1 -- 172.21.15.6:0/2075990934 shutdown_connections 2023-07-21T22:31:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.512+0000 7f9e960f9640 1 --2- 172.21.15.6:0/2075990934 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9e7c066480 0x7f9e7c068930 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.512+0000 7f9e960f9640 1 --2- 172.21.15.6:0/2075990934 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9e90159440 0x7f9e900c3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.512+0000 7f9e960f9640 1 --2- 172.21.15.6:0/2075990934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e900aef10 0x7f9e9006c380 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.512+0000 7f9e960f9640 1 --2- 172.21.15.6:0/2075990934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e900aeb40 0x7f9e901f7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.512+0000 7f9e960f9640 1 -- 172.21.15.6:0/2075990934 >> 172.21.15.6:0/2075990934 conn(0x7f9e900cde90 msgr2=0x7f9e900cb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:22.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.512+0000 7f9e960f9640 1 -- 172.21.15.6:0/2075990934 shutdown_connections 2023-07-21T22:31:22.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.512+0000 7f9e960f9640 1 -- 172.21.15.6:0/2075990934 wait complete. 2023-07-21T22:31:22.581 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2023-07-21T22:31:22.581 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir6 1M 2023-07-21T22:31:22.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.680+0000 7f1db6e6d640 1 Processor -- start 2023-07-21T22:31:22.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.680+0000 7f1db6e6d640 1 -- start start 2023-07-21T22:31:22.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.684+0000 7f1db6e6d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1db0069430 0x7f1db00cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:22.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.684+0000 7f1db6e6d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1db006d2d0 0x7f1db006d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:22.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.684+0000 7f1db6e6d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db00cb7d0 con 0x7f1db0160030 2023-07-21T22:31:22.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.684+0000 7f1db6e6d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db006c510 con 0x7f1db0069430 2023-07-21T22:31:22.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.684+0000 7f1db6e6d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db006c7f0 con 0x7f1db006d2d0 2023-07-21T22:31:22.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.684+0000 7f1db4c09640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1db0069430 0x7f1db00cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:22.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.684+0000 7f1db4c09640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1db0069430 0x7f1db00cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46052/0 (socket says 172.21.15.6:46052) 2023-07-21T22:31:22.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.684+0000 7f1db4c09640 1 -- 172.21.15.6:0/2486964263 learned_addr learned my addr 172.21.15.6:0/2486964263 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:22.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.684+0000 7f1db540a640 1 --2- 172.21.15.6:0/2486964263 >> v2:172.21.15.161:3300/0 conn(0x7f1db006d2d0 0x7f1db006d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:22.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.684+0000 7f1db4c09640 1 -- 172.21.15.6:0/2486964263 >> v2:172.21.15.161:3300/0 conn(0x7f1db006d2d0 msgr2=0x7f1db006d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:22.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.684+0000 7f1db4c09640 1 --2- 172.21.15.6:0/2486964263 >> v2:172.21.15.161:3300/0 conn(0x7f1db006d2d0 0x7f1db006d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.684+0000 7f1db4c09640 1 -- 172.21.15.6:0/2486964263 >> v1:172.21.15.161:6789/0 conn(0x7f1db0160030 legacy=0x7f1db0069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:22.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.684+0000 7f1db4c09640 1 -- 172.21.15.6:0/2486964263 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db006cad0 con 0x7f1db0069430 2023-07-21T22:31:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.688+0000 7f1db4c09640 1 --2- 172.21.15.6:0/2486964263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db0069430 0x7f1db00cb0f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1db00b0b40 tx=0x7f1da401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1757a9379aeeaa23 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.688+0000 7f1daf7fe640 1 -- 172.21.15.6:0/2486964263 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da40ad660 con 0x7f1db0069430 2023-07-21T22:31:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.688+0000 7f1daf7fe640 1 -- 172.21.15.6:0/2486964263 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da40ad7c0 con 0x7f1db0069430 2023-07-21T22:31:22.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.688+0000 7f1daf7fe640 1 -- 172.21.15.6:0/2486964263 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da40adb50 con 0x7f1db0069430 2023-07-21T22:31:22.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.688+0000 7f1db6e6d640 1 -- 172.21.15.6:0/2486964263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db0069430 msgr2=0x7f1db00cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:22.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.688+0000 7f1db6e6d640 1 --2- 172.21.15.6:0/2486964263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db0069430 0x7f1db00cb0f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1db00b0b40 tx=0x7f1da401c440 comp rx=0 tx=0).stop 2023-07-21T22:31:22.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.688+0000 7f1db6e6d640 1 -- 172.21.15.6:0/2486964263 shutdown_connections 2023-07-21T22:31:22.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.688+0000 7f1db6e6d640 1 --2- 172.21.15.6:0/2486964263 >> v2:172.21.15.161:3300/0 conn(0x7f1db006d2d0 0x7f1db006d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.688+0000 7f1db6e6d640 1 --2- 172.21.15.6:0/2486964263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db0069430 0x7f1db00cb0f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.688+0000 7f1db6e6d640 1 -- 172.21.15.6:0/2486964263 >> 172.21.15.6:0/2486964263 conn(0x7f1db00b1840 msgr2=0x7f1db00cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:22.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.688+0000 7f1db6e6d640 1 -- 172.21.15.6:0/2486964263 shutdown_connections 2023-07-21T22:31:22.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.688+0000 7f1db6e6d640 1 -- 172.21.15.6:0/2486964263 wait complete. 2023-07-21T22:31:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.688+0000 7f1db6e6d640 1 Processor -- start 2023-07-21T22:31:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.688+0000 7f1db6e6d640 1 -- start start 2023-07-21T22:31:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1db6e6d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1db0069430 0x7f1db00b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1db6e6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db006d2d0 0x7f1db00b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1db6e6d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db0160030 0x7f1db01481a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1db6e6d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db00b36d0 con 0x7f1db006d2d0 2023-07-21T22:31:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1db6e6d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db00b4320 con 0x7f1db0069430 2023-07-21T22:31:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1db6e6d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db00b2b50 con 0x7f1db0160030 2023-07-21T22:31:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1daffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db006d2d0 0x7f1db00b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1daffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db006d2d0 0x7f1db00b3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46064/0 (socket says 172.21.15.6:46064) 2023-07-21T22:31:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1daffff640 1 -- 172.21.15.6:0/4123146719 learned_addr learned my addr 172.21.15.6:0/4123146719 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1db4c09640 1 --2- 172.21.15.6:0/4123146719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1db0069430 0x7f1db00b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1db540a640 1 --2- 172.21.15.6:0/4123146719 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db0160030 0x7f1db01481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1daffff640 1 -- 172.21.15.6:0/4123146719 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db0160030 msgr2=0x7f1db01481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1daffff640 1 --2- 172.21.15.6:0/4123146719 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db0160030 0x7f1db01481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1daffff640 1 -- 172.21.15.6:0/4123146719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1db0069430 msgr2=0x7f1db00b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1daffff640 1 --2- 172.21.15.6:0/4123146719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1db0069430 0x7f1db00b2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1daffff640 1 -- 172.21.15.6:0/4123146719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da40094d0 con 0x7f1db006d2d0 2023-07-21T22:31:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1daffff640 1 --2- 172.21.15.6:0/4123146719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db006d2d0 0x7f1db00b3de0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00c500 tx=0x7f1d9c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1dad7fa640 1 -- 172.21.15.6:0/4123146719 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c005220 con 0x7f1db006d2d0 2023-07-21T22:31:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1dad7fa640 1 -- 172.21.15.6:0/4123146719 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9c005380 con 0x7f1db006d2d0 2023-07-21T22:31:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1dad7fa640 1 -- 172.21.15.6:0/4123146719 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c007270 con 0x7f1db006d2d0 2023-07-21T22:31:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1db6e6d640 1 -- 172.21.15.6:0/4123146719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db00b2e30 con 0x7f1db006d2d0 2023-07-21T22:31:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1db6e6d640 1 -- 172.21.15.6:0/4123146719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db00b33f0 con 0x7f1db006d2d0 2023-07-21T22:31:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1db6e6d640 1 -- 172.21.15.6:0/4123146719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db0148b00 con 0x7f1db006d2d0 2023-07-21T22:31:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.692+0000 7f1dad7fa640 1 -- 172.21.15.6:0/4123146719 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f1d9c0073d0 con 0x7f1db006d2d0 2023-07-21T22:31:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.696+0000 7f1dad7fa640 1 --2- 172.21.15.6:0/4123146719 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1d94066480 0x7f1d94068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.696+0000 7f1dad7fa640 1 -- 172.21.15.6:0/4123146719 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f1d9c083a60 con 0x7f1db006d2d0 2023-07-21T22:31:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.696+0000 7f1db4c09640 1 --2- 172.21.15.6:0/4123146719 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1d94066480 0x7f1d94068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.696+0000 7f1db4c09640 1 --2- 172.21.15.6:0/4123146719 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1d94066480 0x7f1d94068930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1da40af000 tx=0x7f1da4008040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:22.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.700+0000 7f1dad7fa640 1 -- 172.21.15.6:0/4123146719 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1db0148b00 con 0x7f1db006d2d0 2023-07-21T22:31:22.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.876+0000 7f1db6e6d640 1 -- 172.21.15.6:0/4123146719 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1db006e040 con 0x7f1d94066480 2023-07-21T22:31:22.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.948+0000 7f1dad7fa640 1 -- 172.21.15.6:0/4123146719 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f1da40ad930 con 0x7f1d94066480 2023-07-21T22:31:22.998 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2023-07-21T22:31:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.952+0000 7f1db6e6d640 1 -- 172.21.15.6:0/4123146719 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1d94066480 msgr2=0x7f1d94068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.952+0000 7f1db6e6d640 1 --2- 172.21.15.6:0/4123146719 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1d94066480 0x7f1d94068930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1da40af000 tx=0x7f1da4008040 comp rx=0 tx=0).stop 2023-07-21T22:31:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.952+0000 7f1db6e6d640 1 -- 172.21.15.6:0/4123146719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db006d2d0 msgr2=0x7f1db00b3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.952+0000 7f1db6e6d640 1 --2- 172.21.15.6:0/4123146719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db006d2d0 0x7f1db00b3de0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00c500 tx=0x7f1d9c00c9c0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.952+0000 7f1db6e6d640 1 -- 172.21.15.6:0/4123146719 shutdown_connections 2023-07-21T22:31:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.952+0000 7f1db6e6d640 1 --2- 172.21.15.6:0/4123146719 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1d94066480 0x7f1d94068930 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.952+0000 7f1db6e6d640 1 --2- 172.21.15.6:0/4123146719 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db0160030 0x7f1db01481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.952+0000 7f1db6e6d640 1 --2- 172.21.15.6:0/4123146719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db006d2d0 0x7f1db00b3de0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.952+0000 7f1db6e6d640 1 --2- 172.21.15.6:0/4123146719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1db0069430 0x7f1db00b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.952+0000 7f1db6e6d640 1 -- 172.21.15.6:0/4123146719 >> 172.21.15.6:0/4123146719 conn(0x7f1db00b1840 msgr2=0x7f1db0070230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.952+0000 7f1db6e6d640 1 -- 172.21.15.6:0/4123146719 shutdown_connections 2023-07-21T22:31:23.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:22.952+0000 7f1db6e6d640 1 -- 172.21.15.6:0/4123146719 wait complete. 2023-07-21T22:31:23.019 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2023-07-21T22:31:23.019 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir7 1M 2023-07-21T22:31:23.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.120+0000 7fa137582640 1 Processor -- start 2023-07-21T22:31:23.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.120+0000 7fa137582640 1 -- start start 2023-07-21T22:31:23.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.120+0000 7fa137582640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa1300b1770 0x7fa1300d0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:23.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.120+0000 7fa137582640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa1300d0650 0x7fa1300accf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:23.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.120+0000 7fa137582640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1300d0ab0 con 0x7fa1300cdd10 2023-07-21T22:31:23.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.120+0000 7fa137582640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1300b0450 con 0x7fa1300d0650 2023-07-21T22:31:23.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.120+0000 7fa137582640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1300b06d0 con 0x7fa1300b1770 2023-07-21T22:31:23.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.120+0000 7fa13531e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa1300cdd10 0x7fa1300ce0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48820/0 (socket says 172.21.15.6:48820) 2023-07-21T22:31:23.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.120+0000 7fa13531e640 1 -- 172.21.15.6:0/3215020354 learned_addr learned my addr 172.21.15.6:0/3215020354 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:23.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.120+0000 7fa135b1f640 1 --2- 172.21.15.6:0/3215020354 >> v2:172.21.15.6:3300/0 conn(0x7fa1300d0650 0x7fa1300accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:23.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.120+0000 7fa134b1d640 1 --2- 172.21.15.6:0/3215020354 >> v2:172.21.15.161:3300/0 conn(0x7fa1300b1770 0x7fa1300d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:23.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.120+0000 7fa135b1f640 1 -- 172.21.15.6:0/3215020354 >> v2:172.21.15.161:3300/0 conn(0x7fa1300b1770 msgr2=0x7fa1300d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:23.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.120+0000 7fa135b1f640 1 --2- 172.21.15.6:0/3215020354 >> v2:172.21.15.161:3300/0 conn(0x7fa1300b1770 0x7fa1300d0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.120+0000 7fa135b1f640 1 -- 172.21.15.6:0/3215020354 >> v1:172.21.15.6:6789/0 conn(0x7fa1300cdd10 legacy=0x7fa1300ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:23.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.120+0000 7fa135b1f640 1 -- 172.21.15.6:0/3215020354 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1300b09b0 con 0x7fa1300d0650 2023-07-21T22:31:23.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.124+0000 7fa135b1f640 1 --2- 172.21.15.6:0/3215020354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1300d0650 0x7fa1300accf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa13006fc40 tx=0x7fa12801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1979cc48b45d48 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:23.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.124+0000 7fa127fff640 1 -- 172.21.15.6:0/3215020354 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1280a59a0 con 0x7fa1300d0650 2023-07-21T22:31:23.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.124+0000 7fa127fff640 1 -- 172.21.15.6:0/3215020354 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1280a5b00 con 0x7fa1300d0650 2023-07-21T22:31:23.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.124+0000 7fa127fff640 1 -- 172.21.15.6:0/3215020354 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1280a5e90 con 0x7fa1300d0650 2023-07-21T22:31:23.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.124+0000 7fa137582640 1 -- 172.21.15.6:0/3215020354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1300d0650 msgr2=0x7fa1300accf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:23.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.124+0000 7fa137582640 1 --2- 172.21.15.6:0/3215020354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1300d0650 0x7fa1300accf0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa13006fc40 tx=0x7fa12801c8e0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.124+0000 7fa137582640 1 -- 172.21.15.6:0/3215020354 shutdown_connections 2023-07-21T22:31:23.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.124+0000 7fa137582640 1 --2- 172.21.15.6:0/3215020354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1300d0650 0x7fa1300accf0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.124+0000 7fa137582640 1 --2- 172.21.15.6:0/3215020354 >> v2:172.21.15.161:3300/0 conn(0x7fa1300b1770 0x7fa1300d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.124+0000 7fa137582640 1 -- 172.21.15.6:0/3215020354 >> 172.21.15.6:0/3215020354 conn(0x7fa130099490 msgr2=0x7fa130089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:23.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.124+0000 7fa137582640 1 -- 172.21.15.6:0/3215020354 shutdown_connections 2023-07-21T22:31:23.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.124+0000 7fa137582640 1 -- 172.21.15.6:0/3215020354 wait complete. 2023-07-21T22:31:23.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa137582640 1 Processor -- start 2023-07-21T22:31:23.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa137582640 1 -- start start 2023-07-21T22:31:23.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa137582640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1300b1770 0x7fa13006c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:23.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa137582640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1300cdd10 0x7fa13014e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:23.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa137582640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1300d0650 0x7fa1300c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:23.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa137582640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13006aaa0 con 0x7fa1300b1770 2023-07-21T22:31:23.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa137582640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13014e6a0 con 0x7fa1300d0650 2023-07-21T22:31:23.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa137582640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1301545d0 con 0x7fa1300cdd10 2023-07-21T22:31:23.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa13531e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1300b1770 0x7fa13006c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:23.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa13531e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1300b1770 0x7fa13006c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46094/0 (socket says 172.21.15.6:46094) 2023-07-21T22:31:23.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa13531e640 1 -- 172.21.15.6:0/2391609491 learned_addr learned my addr 172.21.15.6:0/2391609491 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:23.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa134b1d640 1 --2- 172.21.15.6:0/2391609491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1300cdd10 0x7fa13014e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:23.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa135b1f640 1 --2- 172.21.15.6:0/2391609491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1300d0650 0x7fa1300c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:23.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa13531e640 1 -- 172.21.15.6:0/2391609491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1300cdd10 msgr2=0x7fa13014e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:23.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa13531e640 1 --2- 172.21.15.6:0/2391609491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1300cdd10 0x7fa13014e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa13531e640 1 -- 172.21.15.6:0/2391609491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1300d0650 msgr2=0x7fa1300c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:23.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa13531e640 1 --2- 172.21.15.6:0/2391609491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1300d0650 0x7fa1300c3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa13531e640 1 -- 172.21.15.6:0/2391609491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa128009a70 con 0x7fa1300b1770 2023-07-21T22:31:23.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa135b1f640 1 --2- 172.21.15.6:0/2391609491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1300d0650 0x7fa1300c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:23.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa13531e640 1 --2- 172.21.15.6:0/2391609491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1300b1770 0x7fa13006c210 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa12c00c500 tx=0x7fa12c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:23.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa125ffb640 1 -- 172.21.15.6:0/2391609491 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c005cf0 con 0x7fa1300b1770 2023-07-21T22:31:23.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa125ffb640 1 -- 172.21.15.6:0/2391609491 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c005e50 con 0x7fa1300b1770 2023-07-21T22:31:23.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa125ffb640 1 -- 172.21.15.6:0/2391609491 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c0072f0 con 0x7fa1300b1770 2023-07-21T22:31:23.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.128+0000 7fa137582640 1 -- 172.21.15.6:0/2391609491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1300c4a10 con 0x7fa1300b1770 2023-07-21T22:31:23.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.132+0000 7fa137582640 1 -- 172.21.15.6:0/2391609491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1300b2f70 con 0x7fa1300b1770 2023-07-21T22:31:23.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.132+0000 7fa137582640 1 -- 172.21.15.6:0/2391609491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1300678d0 con 0x7fa1300b1770 2023-07-21T22:31:23.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.132+0000 7fa125ffb640 1 -- 172.21.15.6:0/2391609491 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fa12c007450 con 0x7fa1300b1770 2023-07-21T22:31:23.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.132+0000 7fa125ffb640 1 --2- 172.21.15.6:0/2391609491 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fa114066480 0x7fa114068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:23.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.132+0000 7fa125ffb640 1 -- 172.21.15.6:0/2391609491 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fa12c083750 con 0x7fa1300b1770 2023-07-21T22:31:23.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.132+0000 7fa134b1d640 1 --2- 172.21.15.6:0/2391609491 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fa114066480 0x7fa114068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:23.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.132+0000 7fa134b1d640 1 --2- 172.21.15.6:0/2391609491 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fa114066480 0x7fa114068930 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa1301f7330 tx=0x7fa120008040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:23.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.136+0000 7fa125ffb640 1 -- 172.21.15.6:0/2391609491 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa12c0508d0 con 0x7fa1300b1770 2023-07-21T22:31:23.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.316+0000 7fa137582640 1 -- 172.21.15.6:0/2391609491 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1300b1250 con 0x7fa114066480 2023-07-21T22:31:23.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.388+0000 7fa125ffb640 1 -- 172.21.15.6:0/2391609491 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fa1200118b0 con 0x7fa114066480 2023-07-21T22:31:23.436 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2023-07-21T22:31:23.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.388+0000 7fa137582640 1 -- 172.21.15.6:0/2391609491 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fa114066480 msgr2=0x7fa114068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:23.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.388+0000 7fa137582640 1 --2- 172.21.15.6:0/2391609491 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fa114066480 0x7fa114068930 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa1301f7330 tx=0x7fa120008040 comp rx=0 tx=0).stop 2023-07-21T22:31:23.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.388+0000 7fa137582640 1 -- 172.21.15.6:0/2391609491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1300b1770 msgr2=0x7fa13006c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:23.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.388+0000 7fa137582640 1 --2- 172.21.15.6:0/2391609491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1300b1770 0x7fa13006c210 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fa12c00c500 tx=0x7fa12c00c9c0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.388+0000 7fa137582640 1 -- 172.21.15.6:0/2391609491 shutdown_connections 2023-07-21T22:31:23.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.388+0000 7fa137582640 1 --2- 172.21.15.6:0/2391609491 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fa114066480 0x7fa114068930 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.388+0000 7fa137582640 1 --2- 172.21.15.6:0/2391609491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1300d0650 0x7fa1300c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.388+0000 7fa137582640 1 --2- 172.21.15.6:0/2391609491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1300cdd10 0x7fa13014e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.388+0000 7fa137582640 1 --2- 172.21.15.6:0/2391609491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1300b1770 0x7fa13006c210 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.388+0000 7fa137582640 1 -- 172.21.15.6:0/2391609491 >> 172.21.15.6:0/2391609491 conn(0x7fa130099490 msgr2=0x7fa130158150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:23.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.388+0000 7fa137582640 1 -- 172.21.15.6:0/2391609491 shutdown_connections 2023-07-21T22:31:23.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.388+0000 7fa137582640 1 -- 172.21.15.6:0/2391609491 wait complete. 2023-07-21T22:31:23.457 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2023-07-21T22:31:23.458 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir8 1M 2023-07-21T22:31:23.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.560+0000 7f31929fa640 1 Processor -- start 2023-07-21T22:31:23.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.560+0000 7f31929fa640 1 -- start start 2023-07-21T22:31:23.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.560+0000 7f31929fa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f318c070f30 0x7f318c0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:23.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.560+0000 7f31929fa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f318c0af2b0 0x7f318c15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:23.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.560+0000 7f31929fa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f318c159d70 con 0x7f318c069430 2023-07-21T22:31:23.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.560+0000 7f31929fa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318c0c9c60 con 0x7f318c070f30 2023-07-21T22:31:23.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.560+0000 7f31929fa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318c0c9f40 con 0x7f318c0af2b0 2023-07-21T22:31:23.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.560+0000 7f318b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f318c070f30 0x7f318c0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:23.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.560+0000 7f318b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f318c070f30 0x7f318c0ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46110/0 (socket says 172.21.15.6:46110) 2023-07-21T22:31:23.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.560+0000 7f318b7fe640 1 -- 172.21.15.6:0/615044749 learned_addr learned my addr 172.21.15.6:0/615044749 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:23.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.560+0000 7f3190f97640 1 --2- 172.21.15.6:0/615044749 >> v2:172.21.15.161:3300/0 conn(0x7f318c0af2b0 0x7f318c15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:23.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.560+0000 7f318b7fe640 1 -- 172.21.15.6:0/615044749 >> v2:172.21.15.161:3300/0 conn(0x7f318c0af2b0 msgr2=0x7f318c15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:23.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.560+0000 7f318b7fe640 1 --2- 172.21.15.6:0/615044749 >> v2:172.21.15.161:3300/0 conn(0x7f318c0af2b0 0x7f318c15a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.560+0000 7f318b7fe640 1 -- 172.21.15.6:0/615044749 >> v1:172.21.15.161:6789/0 conn(0x7f318c069430 legacy=0x7f318c069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:23.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.560+0000 7f318b7fe640 1 -- 172.21.15.6:0/615044749 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c0ca220 con 0x7f318c070f30 2023-07-21T22:31:23.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.564+0000 7f318b7fe640 1 --2- 172.21.15.6:0/615044749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318c070f30 0x7f318c0ad6f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f318c0cef70 tx=0x7f318001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52edfab5c0472d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:23.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.564+0000 7f318affd640 1 -- 172.21.15.6:0/615044749 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31800aa660 con 0x7f318c070f30 2023-07-21T22:31:23.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.564+0000 7f318affd640 1 -- 172.21.15.6:0/615044749 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31800aa7c0 con 0x7f318c070f30 2023-07-21T22:31:23.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.564+0000 7f318affd640 1 -- 172.21.15.6:0/615044749 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31800aab50 con 0x7f318c070f30 2023-07-21T22:31:23.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.564+0000 7f31929fa640 1 -- 172.21.15.6:0/615044749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318c070f30 msgr2=0x7f318c0ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:23.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.564+0000 7f31929fa640 1 --2- 172.21.15.6:0/615044749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318c070f30 0x7f318c0ad6f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f318c0cef70 tx=0x7f318001c500 comp rx=0 tx=0).stop 2023-07-21T22:31:23.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.564+0000 7f31929fa640 1 -- 172.21.15.6:0/615044749 shutdown_connections 2023-07-21T22:31:23.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.564+0000 7f31929fa640 1 --2- 172.21.15.6:0/615044749 >> v2:172.21.15.161:3300/0 conn(0x7f318c0af2b0 0x7f318c15a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.564+0000 7f31929fa640 1 --2- 172.21.15.6:0/615044749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318c070f30 0x7f318c0ad6f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.564+0000 7f31929fa640 1 -- 172.21.15.6:0/615044749 >> 172.21.15.6:0/615044749 conn(0x7f318c0cde90 msgr2=0x7f318c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:23.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.564+0000 7f31929fa640 1 -- 172.21.15.6:0/615044749 shutdown_connections 2023-07-21T22:31:23.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.564+0000 7f31929fa640 1 -- 172.21.15.6:0/615044749 wait complete. 2023-07-21T22:31:23.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f31929fa640 1 Processor -- start 2023-07-21T22:31:23.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f31929fa640 1 -- start start 2023-07-21T22:31:23.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f31929fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f318c069430 0x7f318c0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:23.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f31929fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f318c070f30 0x7f318c13e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:23.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f31929fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318c0af2b0 0x7f318c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:23.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f31929fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c0b37d0 con 0x7f318c0af2b0 2023-07-21T22:31:23.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f31929fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318c1504a0 con 0x7f318c070f30 2023-07-21T22:31:23.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f31929fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318c150780 con 0x7f318c069430 2023-07-21T22:31:23.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f3190f97640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318c0af2b0 0x7f318c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:23.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f3190f97640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318c0af2b0 0x7f318c0cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46116/0 (socket says 172.21.15.6:46116) 2023-07-21T22:31:23.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f318b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f318c070f30 0x7f318c13e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:23.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f3190f97640 1 -- 172.21.15.6:0/2097883262 learned_addr learned my addr 172.21.15.6:0/2097883262 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:23.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f318bfff640 1 --2- 172.21.15.6:0/2097883262 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f318c069430 0x7f318c0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:23.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f318b7fe640 1 -- 172.21.15.6:0/2097883262 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f318c069430 msgr2=0x7f318c0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:23.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f318b7fe640 1 --2- 172.21.15.6:0/2097883262 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f318c069430 0x7f318c0b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f318b7fe640 1 -- 172.21.15.6:0/2097883262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318c0af2b0 msgr2=0x7f318c0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:23.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f318b7fe640 1 --2- 172.21.15.6:0/2097883262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318c0af2b0 0x7f318c0cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f318b7fe640 1 -- 172.21.15.6:0/2097883262 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31800094d0 con 0x7f318c070f30 2023-07-21T22:31:23.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f3190f97640 1 --2- 172.21.15.6:0/2097883262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318c0af2b0 0x7f318c0cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:23.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f318b7fe640 1 --2- 172.21.15.6:0/2097883262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f318c070f30 0x7f318c13e780 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f31800ab000 tx=0x7f318001ad40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:23.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f3188ff9640 1 -- 172.21.15.6:0/2097883262 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31800b3800 con 0x7f318c070f30 2023-07-21T22:31:23.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f3188ff9640 1 -- 172.21.15.6:0/2097883262 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31800b3980 con 0x7f318c070f30 2023-07-21T22:31:23.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f31929fa640 1 -- 172.21.15.6:0/2097883262 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318c150a60 con 0x7f318c070f30 2023-07-21T22:31:23.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f3188ff9640 1 -- 172.21.15.6:0/2097883262 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31800b3d30 con 0x7f318c070f30 2023-07-21T22:31:23.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.568+0000 7f31929fa640 1 -- 172.21.15.6:0/2097883262 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318c151020 con 0x7f318c070f30 2023-07-21T22:31:23.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.572+0000 7f31929fa640 1 -- 172.21.15.6:0/2097883262 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318c151210 con 0x7f318c070f30 2023-07-21T22:31:23.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.572+0000 7f3188ff9640 1 -- 172.21.15.6:0/2097883262 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f31800bc3e0 con 0x7f318c070f30 2023-07-21T22:31:23.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.572+0000 7f3188ff9640 1 --2- 172.21.15.6:0/2097883262 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3178066480 0x7f3178068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:23.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.572+0000 7f3188ff9640 1 -- 172.21.15.6:0/2097883262 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f31800a6040 con 0x7f318c070f30 2023-07-21T22:31:23.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.572+0000 7f318bfff640 1 --2- 172.21.15.6:0/2097883262 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3178066480 0x7f3178068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:23.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.572+0000 7f318bfff640 1 --2- 172.21.15.6:0/2097883262 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3178066480 0x7f3178068930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f318c0ccc50 tx=0x7f317c009040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:23.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.576+0000 7f3188ff9640 1 -- 172.21.15.6:0/2097883262 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f31800eb7a0 con 0x7f318c070f30 2023-07-21T22:31:23.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.756+0000 7f31929fa640 1 -- 172.21.15.6:0/2097883262 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f318c0678d0 con 0x7f3178066480 2023-07-21T22:31:23.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.824+0000 7f3188ff9640 1 -- 172.21.15.6:0/2097883262 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f318c0678d0 con 0x7f3178066480 2023-07-21T22:31:23.873 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2023-07-21T22:31:23.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.828+0000 7f31929fa640 1 -- 172.21.15.6:0/2097883262 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3178066480 msgr2=0x7f3178068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:23.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.828+0000 7f31929fa640 1 --2- 172.21.15.6:0/2097883262 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3178066480 0x7f3178068930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f318c0ccc50 tx=0x7f317c009040 comp rx=0 tx=0).stop 2023-07-21T22:31:23.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.828+0000 7f31929fa640 1 -- 172.21.15.6:0/2097883262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f318c070f30 msgr2=0x7f318c13e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:23.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.828+0000 7f31929fa640 1 --2- 172.21.15.6:0/2097883262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f318c070f30 0x7f318c13e780 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f31800ab000 tx=0x7f318001ad40 comp rx=0 tx=0).stop 2023-07-21T22:31:23.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.828+0000 7f31929fa640 1 -- 172.21.15.6:0/2097883262 shutdown_connections 2023-07-21T22:31:23.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.828+0000 7f31929fa640 1 --2- 172.21.15.6:0/2097883262 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3178066480 0x7f3178068930 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.828+0000 7f31929fa640 1 --2- 172.21.15.6:0/2097883262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f318c0af2b0 0x7f318c0cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.828+0000 7f31929fa640 1 --2- 172.21.15.6:0/2097883262 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f318c070f30 0x7f318c13e780 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.828+0000 7f31929fa640 1 --2- 172.21.15.6:0/2097883262 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f318c069430 0x7f318c0b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:23.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.828+0000 7f31929fa640 1 -- 172.21.15.6:0/2097883262 >> 172.21.15.6:0/2097883262 conn(0x7f318c0cde90 msgr2=0x7f318c06b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:23.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.828+0000 7f31929fa640 1 -- 172.21.15.6:0/2097883262 shutdown_connections 2023-07-21T22:31:23.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.828+0000 7f31929fa640 1 -- 172.21.15.6:0/2097883262 wait complete. 2023-07-21T22:31:23.894 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2023-07-21T22:31:23.894 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir9 1M 2023-07-21T22:31:24.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.996+0000 7f6198293640 1 Processor -- start 2023-07-21T22:31:24.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.996+0000 7f6198293640 1 -- start start 2023-07-21T22:31:24.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.996+0000 7f6198293640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f61900aeb40 0x7f619015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:24.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.996+0000 7f6198293640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6190159440 0x7f61900c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:24.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.996+0000 7f6198293640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61901532b0 con 0x7f61900aef10 2023-07-21T22:31:24.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.996+0000 7f6198293640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61900ca6f0 con 0x7f61900aeb40 2023-07-21T22:31:24.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.996+0000 7f6198293640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61901599d0 con 0x7f6190159440 2023-07-21T22:31:24.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.996+0000 7f619602f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f61900aeb40 0x7f619015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:24.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.996+0000 7f619602f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f61900aeb40 0x7f619015cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46120/0 (socket says 172.21.15.6:46120) 2023-07-21T22:31:24.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.996+0000 7f619602f640 1 -- 172.21.15.6:0/1576028325 learned_addr learned my addr 172.21.15.6:0/1576028325 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:24.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.996+0000 7f619602f640 1 -- 172.21.15.6:0/1576028325 >> v2:172.21.15.161:3300/0 conn(0x7f6190159440 msgr2=0x7f61900c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.996+0000 7f619602f640 1 --2- 172.21.15.6:0/1576028325 >> v2:172.21.15.161:3300/0 conn(0x7f6190159440 0x7f61900c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.996+0000 7f619602f640 1 -- 172.21.15.6:0/1576028325 >> v1:172.21.15.161:6789/0 conn(0x7f61900aef10 legacy=0x7f6190158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:23.996+0000 7f619602f640 1 -- 172.21.15.6:0/1576028325 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6190159cb0 con 0x7f61900aeb40 2023-07-21T22:31:24.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.000+0000 7f619602f640 1 --2- 172.21.15.6:0/1576028325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61900aeb40 0x7f619015cef0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f61900c8690 tx=0x7f618c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef765ead4aadee6b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:24.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.000+0000 7f619502d640 1 -- 172.21.15.6:0/1576028325 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c0ab600 con 0x7f61900aeb40 2023-07-21T22:31:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.000+0000 7f619502d640 1 -- 172.21.15.6:0/1576028325 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618c0ab760 con 0x7f61900aeb40 2023-07-21T22:31:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.000+0000 7f619502d640 1 -- 172.21.15.6:0/1576028325 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c0abaf0 con 0x7f61900aeb40 2023-07-21T22:31:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.000+0000 7f6198293640 1 -- 172.21.15.6:0/1576028325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61900aeb40 msgr2=0x7f619015cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.000+0000 7f6198293640 1 --2- 172.21.15.6:0/1576028325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61900aeb40 0x7f619015cef0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f61900c8690 tx=0x7f618c01c400 comp rx=0 tx=0).stop 2023-07-21T22:31:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.000+0000 7f6198293640 1 -- 172.21.15.6:0/1576028325 shutdown_connections 2023-07-21T22:31:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.000+0000 7f6198293640 1 --2- 172.21.15.6:0/1576028325 >> v2:172.21.15.161:3300/0 conn(0x7f6190159440 0x7f61900c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.000+0000 7f6198293640 1 --2- 172.21.15.6:0/1576028325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61900aeb40 0x7f619015cef0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.000+0000 7f6198293640 1 -- 172.21.15.6:0/1576028325 >> 172.21.15.6:0/1576028325 conn(0x7f61900cde90 msgr2=0x7f61900ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:24.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.000+0000 7f6198293640 1 -- 172.21.15.6:0/1576028325 shutdown_connections 2023-07-21T22:31:24.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.000+0000 7f6198293640 1 -- 172.21.15.6:0/1576028325 wait complete. 2023-07-21T22:31:24.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f6198293640 1 Processor -- start 2023-07-21T22:31:24.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f6198293640 1 -- start start 2023-07-21T22:31:24.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f6198293640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61900aeb40 0x7f61900b2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:24.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f6198293640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61900aef10 0x7f619014e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:24.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f6198293640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6190159440 0x7f61900ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:24.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f6198293640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61900b2db0 con 0x7f61900aef10 2023-07-21T22:31:24.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f6198293640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61900b17d0 con 0x7f61900aeb40 2023-07-21T22:31:24.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f6198293640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61900b1ab0 con 0x7f6190159440 2023-07-21T22:31:24.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f619582e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61900aef10 0x7f619014e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:24.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f619582e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61900aef10 0x7f619014e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46136/0 (socket says 172.21.15.6:46136) 2023-07-21T22:31:24.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f619582e640 1 -- 172.21.15.6:0/3841661197 learned_addr learned my addr 172.21.15.6:0/3841661197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f619602f640 1 --2- 172.21.15.6:0/3841661197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61900aeb40 0x7f61900b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f6196830640 1 --2- 172.21.15.6:0/3841661197 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6190159440 0x7f61900ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f619582e640 1 -- 172.21.15.6:0/3841661197 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6190159440 msgr2=0x7f61900ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f619582e640 1 --2- 172.21.15.6:0/3841661197 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6190159440 0x7f61900ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f619582e640 1 -- 172.21.15.6:0/3841661197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61900aeb40 msgr2=0x7f61900b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f619582e640 1 --2- 172.21.15.6:0/3841661197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61900aeb40 0x7f61900b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f619582e640 1 -- 172.21.15.6:0/3841661197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c0094d0 con 0x7f61900aef10 2023-07-21T22:31:24.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f619602f640 1 --2- 172.21.15.6:0/3841661197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61900aeb40 0x7f61900b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:31:24.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f6196830640 1 --2- 172.21.15.6:0/3841661197 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6190159440 0x7f61900ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:31:24.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f619582e640 1 --2- 172.21.15.6:0/3841661197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61900aef10 0x7f619014e110 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f618000c490 tx=0x7f6180001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:24.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f6186ffd640 1 -- 172.21.15.6:0/3841661197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6180003600 con 0x7f61900aef10 2023-07-21T22:31:24.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f6186ffd640 1 -- 172.21.15.6:0/3841661197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6180003780 con 0x7f61900aef10 2023-07-21T22:31:24.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f6198293640 1 -- 172.21.15.6:0/3841661197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61900b1d90 con 0x7f61900aef10 2023-07-21T22:31:24.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f6186ffd640 1 -- 172.21.15.6:0/3841661197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6180003b70 con 0x7f61900aef10 2023-07-21T22:31:24.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f6198293640 1 -- 172.21.15.6:0/3841661197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61900b2350 con 0x7f61900aef10 2023-07-21T22:31:24.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.004+0000 7f6198293640 1 -- 172.21.15.6:0/3841661197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61900678d0 con 0x7f61900aef10 2023-07-21T22:31:24.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.008+0000 7f6186ffd640 1 -- 172.21.15.6:0/3841661197 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f6180003cd0 con 0x7f61900aef10 2023-07-21T22:31:24.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.008+0000 7f6186ffd640 1 --2- 172.21.15.6:0/3841661197 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f6174066480 0x7f6174068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:24.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.008+0000 7f6186ffd640 1 -- 172.21.15.6:0/3841661197 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f6180083430 con 0x7f61900aef10 2023-07-21T22:31:24.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.008+0000 7f619602f640 1 --2- 172.21.15.6:0/3841661197 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f6174066480 0x7f6174068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:24.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.008+0000 7f619602f640 1 --2- 172.21.15.6:0/3841661197 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f6174066480 0x7f6174068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f618c0af000 tx=0x7f618c008040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:24.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.012+0000 7f6186ffd640 1 -- 172.21.15.6:0/3841661197 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6180050470 con 0x7f61900aef10 2023-07-21T22:31:24.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.184+0000 7f6198293640 1 -- 172.21.15.6:0/3841661197 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f61900af380 con 0x7f6174066480 2023-07-21T22:31:24.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.252+0000 7f6186ffd640 1 -- 172.21.15.6:0/3841661197 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f618c0bb0d0 con 0x7f6174066480 2023-07-21T22:31:24.299 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2023-07-21T22:31:24.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.252+0000 7f6198293640 1 -- 172.21.15.6:0/3841661197 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f6174066480 msgr2=0x7f6174068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:24.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.252+0000 7f6198293640 1 --2- 172.21.15.6:0/3841661197 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f6174066480 0x7f6174068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f618c0af000 tx=0x7f618c008040 comp rx=0 tx=0).stop 2023-07-21T22:31:24.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.252+0000 7f6198293640 1 -- 172.21.15.6:0/3841661197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61900aef10 msgr2=0x7f619014e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:24.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.252+0000 7f6198293640 1 --2- 172.21.15.6:0/3841661197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61900aef10 0x7f619014e110 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f618000c490 tx=0x7f6180001e80 comp rx=0 tx=0).stop 2023-07-21T22:31:24.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.252+0000 7f6198293640 1 -- 172.21.15.6:0/3841661197 shutdown_connections 2023-07-21T22:31:24.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.252+0000 7f6198293640 1 --2- 172.21.15.6:0/3841661197 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f6174066480 0x7f6174068930 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.252+0000 7f6198293640 1 --2- 172.21.15.6:0/3841661197 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6190159440 0x7f61900ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.252+0000 7f6198293640 1 --2- 172.21.15.6:0/3841661197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61900aef10 0x7f619014e110 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.252+0000 7f6198293640 1 --2- 172.21.15.6:0/3841661197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61900aeb40 0x7f61900b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.252+0000 7f6198293640 1 -- 172.21.15.6:0/3841661197 >> 172.21.15.6:0/3841661197 conn(0x7f61900cde90 msgr2=0x7f61900cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:24.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.252+0000 7f6198293640 1 -- 172.21.15.6:0/3841661197 shutdown_connections 2023-07-21T22:31:24.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.252+0000 7f6198293640 1 -- 172.21.15.6:0/3841661197 wait complete. 2023-07-21T22:31:24.319 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2023-07-21T22:31:24.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:24.320 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-07-21T22:31:24.332 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:24.332 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:24.332 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:24.333 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:24.333 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:24.333 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:24.333 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:24.333 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:24.333 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:24.333 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:24.334 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:24.334 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-21-22_21_00_UTC', 'scheduled-2023-07-21-22_22_00_UTC', 'scheduled-2023-07-21-22_23_00_UTC', 'scheduled-2023-07-21-22_24_00_UTC', 'scheduled-2023-07-21-22_25_00_UTC', 'scheduled-2023-07-21-22_26_00_UTC', 'scheduled-2023-07-21-22_27_00_UTC', 'scheduled-2023-07-21-22_28_00_UTC', 'scheduled-2023-07-21-22_29_00_UTC', 'scheduled-2023-07-21-22_30_00_UTC', 'scheduled-2023-07-21-22_31_00_UTC'] 2023-07-21T22:31:24.335 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir0 2023-07-21T22:31:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.476+0000 7f664220b640 1 Processor -- start 2023-07-21T22:31:24.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.476+0000 7f664220b640 1 -- start start 2023-07-21T22:31:24.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f664220b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f663c070f30 0x7f663c0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:24.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f664220b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663c159d70 con 0x7f663c069430 2023-07-21T22:31:24.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f664220b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663c0c9c60 con 0x7f663c0af2b0 2023-07-21T22:31:24.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f664220b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0c9f40 con 0x7f663c070f30 2023-07-21T22:31:24.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663b7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f663c069430 0x7f663c069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48822/0 (socket says 172.21.15.6:48822) 2023-07-21T22:31:24.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663b7fe640 1 -- 172.21.15.6:0/2916443082 learned_addr learned my addr 172.21.15.6:0/2916443082 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663a7fc640 1 -- 172.21.15.6:0/2916443082 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102413185 0 0) 0x7f662c001120 con 0x7f663c069430 2023-07-21T22:31:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663a7fc640 1 -- 172.21.15.6:0/2916443082 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6624003530 con 0x7f663c069430 2023-07-21T22:31:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663affd640 1 --2- 172.21.15.6:0/2916443082 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f663c070f30 0x7f663c0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663a7fc640 1 -- 172.21.15.6:0/2916443082 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1675946366 0 0) 0x7f6624003530 con 0x7f663c069430 2023-07-21T22:31:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663a7fc640 1 -- 172.21.15.6:0/2916443082 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f663c070f30 msgr2=0x7f663c0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:24.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663a7fc640 1 --2- 172.21.15.6:0/2916443082 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f663c070f30 0x7f663c0ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663a7fc640 1 -- 172.21.15.6:0/2916443082 >> v1:172.21.15.161:6789/0 conn(0x7f663c0af2b0 legacy=0x7f663c15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:24.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663a7fc640 1 -- 172.21.15.6:0/2916443082 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c0ca220 con 0x7f663c069430 2023-07-21T22:31:24.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663a7fc640 1 -- 172.21.15.6:0/2916443082 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f662c001810 con 0x7f663c069430 2023-07-21T22:31:24.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663a7fc640 1 -- 172.21.15.6:0/2916443082 >> v1:172.21.15.6:6789/0 conn(0x7f663c069430 legacy=0x7f663c069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:24.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663a7fc640 1 --2- 172.21.15.6:0/2916443082 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f663c070f30 0x7f66240039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:24.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663a7fc640 1 --2- 172.21.15.6:0/2916443082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6624003fe0 0x7f66240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:24.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663a7fc640 1 --2- 172.21.15.6:0/2916443082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6624004d10 0x7f6624005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:24.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663a7fc640 1 -- 172.21.15.6:0/2916443082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0c9f40 con 0x7f6624003fe0 2023-07-21T22:31:24.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663a7fc640 1 -- 172.21.15.6:0/2916443082 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662400ff30 con 0x7f6624004d10 2023-07-21T22:31:24.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663a7fc640 1 -- 172.21.15.6:0/2916443082 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66240100f0 con 0x7f663c070f30 2023-07-21T22:31:24.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663affd640 1 --2- 172.21.15.6:0/2916443082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6624003fe0 0x7f66240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:24.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663b7fe640 1 --2- 172.21.15.6:0/2916443082 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f663c070f30 0x7f66240039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:24.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663bfff640 1 --2- 172.21.15.6:0/2916443082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6624004d10 0x7f6624005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:24.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663affd640 1 -- 172.21.15.6:0/2916443082 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f663c070f30 msgr2=0x7f66240039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:24.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663affd640 1 --2- 172.21.15.6:0/2916443082 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f663c070f30 0x7f66240039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663affd640 1 -- 172.21.15.6:0/2916443082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6624004d10 msgr2=0x7f6624005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:24.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663affd640 1 --2- 172.21.15.6:0/2916443082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6624004d10 0x7f6624005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663affd640 1 -- 172.21.15.6:0/2916443082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6624003530 con 0x7f6624003fe0 2023-07-21T22:31:24.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.480+0000 7f663bfff640 1 --2- 172.21.15.6:0/2916443082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6624004d10 0x7f6624005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:24.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.484+0000 7f663affd640 1 --2- 172.21.15.6:0/2916443082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6624003fe0 0x7f66240047d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f663000ba30 tx=0x7f663001c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b34a03fcb3876a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:24.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.484+0000 7f663a7fc640 1 -- 172.21.15.6:0/2916443082 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66300ac620 con 0x7f6624003fe0 2023-07-21T22:31:24.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.484+0000 7f663a7fc640 1 -- 172.21.15.6:0/2916443082 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66300a6040 con 0x7f6624003fe0 2023-07-21T22:31:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.484+0000 7f663a7fc640 1 -- 172.21.15.6:0/2916443082 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66300ac9c0 con 0x7f6624003fe0 2023-07-21T22:31:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.484+0000 7f664220b640 1 -- 172.21.15.6:0/2916443082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6624003fe0 msgr2=0x7f66240047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.484+0000 7f664220b640 1 --2- 172.21.15.6:0/2916443082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6624003fe0 0x7f66240047d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f663000ba30 tx=0x7f663001c680 comp rx=0 tx=0).stop 2023-07-21T22:31:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.484+0000 7f663bfff640 1 -- 172.21.15.6:0/2916443082 reap_dead start 2023-07-21T22:31:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.484+0000 7f664220b640 1 -- 172.21.15.6:0/2916443082 shutdown_connections 2023-07-21T22:31:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.484+0000 7f664220b640 1 -- 172.21.15.6:0/2916443082 >> 172.21.15.6:0/2916443082 conn(0x7f663c0cde90 msgr2=0x7f663c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.484+0000 7f664220b640 1 -- 172.21.15.6:0/2916443082 shutdown_connections 2023-07-21T22:31:24.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.484+0000 7f664220b640 1 -- 172.21.15.6:0/2916443082 wait complete. 2023-07-21T22:31:24.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.484+0000 7f664220b640 1 Processor -- start 2023-07-21T22:31:24.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.484+0000 7f664220b640 1 -- start start 2023-07-21T22:31:24.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f664220b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6624003fe0 0x7f663c14ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:24.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f664220b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f663c0c84c0 0x7f663c150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:24.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f664220b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f663c1f5bc0 0x7f663c14e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:24.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f664220b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0b2250 con 0x7f6624003fe0 2023-07-21T22:31:24.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f664220b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f663c14cf50 con 0x7f663c1f5bc0 2023-07-21T22:31:24.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f664220b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c0b24a0 con 0x7f663c0c84c0 2023-07-21T22:31:24.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f663b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6624003fe0 0x7f663c14ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:24.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f663b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6624003fe0 0x7f663c14ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46166/0 (socket says 172.21.15.6:46166) 2023-07-21T22:31:24.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f663b7fe640 1 -- 172.21.15.6:0/3373314229 learned_addr learned my addr 172.21.15.6:0/3373314229 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:24.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f663bfff640 1 --2- 172.21.15.6:0/3373314229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f663c1f5bc0 0x7f663c14e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:24.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f663affd640 1 --2- 172.21.15.6:0/3373314229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f663c0c84c0 0x7f663c150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:24.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f663b7fe640 1 -- 172.21.15.6:0/3373314229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f663c0c84c0 msgr2=0x7f663c150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:24.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f663b7fe640 1 --2- 172.21.15.6:0/3373314229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f663c0c84c0 0x7f663c150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f663b7fe640 1 -- 172.21.15.6:0/3373314229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f663c1f5bc0 msgr2=0x7f663c14e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:24.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f663b7fe640 1 --2- 172.21.15.6:0/3373314229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f663c1f5bc0 0x7f663c14e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f663b7fe640 1 -- 172.21.15.6:0/3373314229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c0b2780 con 0x7f6624003fe0 2023-07-21T22:31:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f663affd640 1 --2- 172.21.15.6:0/3373314229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f663c0c84c0 0x7f663c150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f663b7fe640 1 --2- 172.21.15.6:0/3373314229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6624003fe0 0x7f663c14ca10 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f662c0058b0 tx=0x7f662c012630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f6623fff640 1 -- 172.21.15.6:0/3373314229 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c014750 con 0x7f6624003fe0 2023-07-21T22:31:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f6623fff640 1 -- 172.21.15.6:0/3373314229 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c0148b0 con 0x7f6624003fe0 2023-07-21T22:31:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f6623fff640 1 -- 172.21.15.6:0/3373314229 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c014c60 con 0x7f6624003fe0 2023-07-21T22:31:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f664220b640 1 -- 172.21.15.6:0/3373314229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663c0b2a60 con 0x7f6624003fe0 2023-07-21T22:31:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f664220b640 1 -- 172.21.15.6:0/3373314229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663c150670 con 0x7f6624003fe0 2023-07-21T22:31:24.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f664220b640 1 -- 172.21.15.6:0/3373314229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f663c0af710 con 0x7f6624003fe0 2023-07-21T22:31:24.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.488+0000 7f6623fff640 1 -- 172.21.15.6:0/3373314229 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f662c0153e0 con 0x7f6624003fe0 2023-07-21T22:31:24.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.492+0000 7f6623fff640 1 --2- 172.21.15.6:0/3373314229 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f66280664b0 0x7f6628068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:24.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.492+0000 7f6623fff640 1 -- 172.21.15.6:0/3373314229 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f662c086600 con 0x7f6624003fe0 2023-07-21T22:31:24.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.492+0000 7f663affd640 1 --2- 172.21.15.6:0/3373314229 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f66280664b0 0x7f6628068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:24.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.492+0000 7f663affd640 1 --2- 172.21.15.6:0/3373314229 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f66280664b0 0x7f6628068960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f66300b0000 tx=0x7f66300b7040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:24.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.496+0000 7f6623fff640 1 -- 172.21.15.6:0/3373314229 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f663c0af710 con 0x7f6624003fe0 2023-07-21T22:31:24.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.664+0000 7f664220b640 1 -- 172.21.15.6:0/3373314229 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f663c0b2610 con 0x7f66280664b0 2023-07-21T22:31:24.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.676+0000 7f6623fff640 1 -- 172.21.15.6:0/3373314229 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f663c0b2610 con 0x7f66280664b0 2023-07-21T22:31:24.724 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:24.724 INFO:teuthology.orchestra.run.smithi006.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:20:03", "first": "2023-07-21T22:21:00", "last": "2023-07-21T22:31:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-21T22:31:24.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.676+0000 7f664220b640 1 -- 172.21.15.6:0/3373314229 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f66280664b0 msgr2=0x7f6628068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:24.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.676+0000 7f664220b640 1 --2- 172.21.15.6:0/3373314229 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f66280664b0 0x7f6628068960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f66300b0000 tx=0x7f66300b7040 comp rx=0 tx=0).stop 2023-07-21T22:31:24.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.676+0000 7f664220b640 1 -- 172.21.15.6:0/3373314229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6624003fe0 msgr2=0x7f663c14ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:24.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.676+0000 7f664220b640 1 --2- 172.21.15.6:0/3373314229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6624003fe0 0x7f663c14ca10 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f662c0058b0 tx=0x7f662c012630 comp rx=0 tx=0).stop 2023-07-21T22:31:24.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.676+0000 7f664220b640 1 -- 172.21.15.6:0/3373314229 shutdown_connections 2023-07-21T22:31:24.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.676+0000 7f664220b640 1 --2- 172.21.15.6:0/3373314229 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f66280664b0 0x7f6628068960 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.676+0000 7f664220b640 1 --2- 172.21.15.6:0/3373314229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f663c1f5bc0 0x7f663c14e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.676+0000 7f664220b640 1 --2- 172.21.15.6:0/3373314229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f663c0c84c0 0x7f663c150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.676+0000 7f664220b640 1 --2- 172.21.15.6:0/3373314229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6624003fe0 0x7f663c14ca10 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.676+0000 7f664220b640 1 -- 172.21.15.6:0/3373314229 >> 172.21.15.6:0/3373314229 conn(0x7f663c0cde90 msgr2=0x7f663c06f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:24.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.676+0000 7f664220b640 1 -- 172.21.15.6:0/3373314229 shutdown_connections 2023-07-21T22:31:24.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.676+0000 7f664220b640 1 -- 172.21.15.6:0/3373314229 wait complete. 2023-07-21T22:31:24.745 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:20:03", "first": "2023-07-21T22:21:00", "last": "2023-07-21T22:31:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-21T22:31:24.745 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1M', 'retention': {}, 'start': '2023-07-21T00:00:00', 'created': '2023-07-21T22:20:03', 'first': '2023-07-21T22:21:00', 'last': '2023-07-21T22:31:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-21T22:31:24.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:24.746 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-07-21T22:31:24.756 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:24.756 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:24.756 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:24.756 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:24.757 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:24.757 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:24.757 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:24.757 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:24.757 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:24.757 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:24.757 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:24.758 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-21-22_21_00_UTC', 'scheduled-2023-07-21-22_22_00_UTC', 'scheduled-2023-07-21-22_23_00_UTC', 'scheduled-2023-07-21-22_24_00_UTC', 'scheduled-2023-07-21-22_25_00_UTC', 'scheduled-2023-07-21-22_26_00_UTC', 'scheduled-2023-07-21-22_27_00_UTC', 'scheduled-2023-07-21-22_28_00_UTC', 'scheduled-2023-07-21-22_29_00_UTC', 'scheduled-2023-07-21-22_30_00_UTC', 'scheduled-2023-07-21-22_31_00_UTC'] 2023-07-21T22:31:24.759 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir1 2023-07-21T22:31:24.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.904+0000 7f6f31aca640 1 Processor -- start 2023-07-21T22:31:24.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.904+0000 7f6f31aca640 1 -- start start 2023-07-21T22:31:24.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.908+0000 7f6f31aca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f2c069430 0x7f6f2c069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:24.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.908+0000 7f6f31aca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2c159d70 con 0x7f6f2c0af2b0 2023-07-21T22:31:24.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.908+0000 7f6f31aca640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f2c069d40 con 0x7f6f2c070f30 2023-07-21T22:31:24.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.908+0000 7f6f31aca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f2c0c9c60 con 0x7f6f2c069430 2023-07-21T22:31:24.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.908+0000 7f6f2b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f2c069430 0x7f6f2c069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:24.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.908+0000 7f6f2b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f2c069430 0x7f6f2c069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46174/0 (socket says 172.21.15.6:46174) 2023-07-21T22:31:24.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.908+0000 7f6f2b7fe640 1 -- 172.21.15.6:0/2522566501 learned_addr learned my addr 172.21.15.6:0/2522566501 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:24.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.908+0000 7f6f2b7fe640 1 -- 172.21.15.6:0/2522566501 >> v1:172.21.15.161:6789/0 conn(0x7f6f2c070f30 legacy=0x7f6f2c0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:24.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.908+0000 7f6f2b7fe640 1 -- 172.21.15.6:0/2522566501 >> v1:172.21.15.6:6789/0 conn(0x7f6f2c0af2b0 legacy=0x7f6f2c15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:24.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.908+0000 7f6f2b7fe640 1 -- 172.21.15.6:0/2522566501 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c0c9f40 con 0x7f6f2c069430 2023-07-21T22:31:24.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.908+0000 7f6f2b7fe640 1 --2- 172.21.15.6:0/2522566501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c069430 0x7f6f2c069800 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009870 tx=0x7f6f1c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbc897b9edcad8c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:24.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.908+0000 7f6f2a7fc640 1 -- 172.21.15.6:0/2522566501 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c0ab650 con 0x7f6f2c069430 2023-07-21T22:31:24.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f2a7fc640 1 -- 172.21.15.6:0/2522566501 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1c0ab7b0 con 0x7f6f2c069430 2023-07-21T22:31:24.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f2a7fc640 1 -- 172.21.15.6:0/2522566501 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c0abb40 con 0x7f6f2c069430 2023-07-21T22:31:24.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f31aca640 1 -- 172.21.15.6:0/2522566501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c069430 msgr2=0x7f6f2c069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:24.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f31aca640 1 --2- 172.21.15.6:0/2522566501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c069430 0x7f6f2c069800 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009870 tx=0x7f6f1c01c540 comp rx=0 tx=0).stop 2023-07-21T22:31:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f31aca640 1 -- 172.21.15.6:0/2522566501 shutdown_connections 2023-07-21T22:31:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f31aca640 1 --2- 172.21.15.6:0/2522566501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c069430 0x7f6f2c069800 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f31aca640 1 -- 172.21.15.6:0/2522566501 >> 172.21.15.6:0/2522566501 conn(0x7f6f2c0cde90 msgr2=0x7f6f2c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f31aca640 1 -- 172.21.15.6:0/2522566501 shutdown_connections 2023-07-21T22:31:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f31aca640 1 -- 172.21.15.6:0/2522566501 wait complete. 2023-07-21T22:31:24.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f31aca640 1 Processor -- start 2023-07-21T22:31:24.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f31aca640 1 -- start start 2023-07-21T22:31:24.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f31aca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c069430 0x7f6f2c0b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:24.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f31aca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f2c070f30 0x7f6f2c156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:24.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f31aca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f2c0af2b0 0x7f6f2c150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:24.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f31aca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c14af70 con 0x7f6f2c069430 2023-07-21T22:31:24.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f31aca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c1484c0 con 0x7f6f2c070f30 2023-07-21T22:31:24.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f31aca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c1504a0 con 0x7f6f2c0af2b0 2023-07-21T22:31:24.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f2b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c069430 0x7f6f2c0b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:24.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f2b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c069430 0x7f6f2c0b0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46182/0 (socket says 172.21.15.6:46182) 2023-07-21T22:31:24.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f2b7fe640 1 -- 172.21.15.6:0/2604619941 learned_addr learned my addr 172.21.15.6:0/2604619941 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:24.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f2affd640 1 --2- 172.21.15.6:0/2604619941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f2c070f30 0x7f6f2c156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:24.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.912+0000 7f6f2bfff640 1 --2- 172.21.15.6:0/2604619941 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f2c0af2b0 0x7f6f2c150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:24.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.916+0000 7f6f2b7fe640 1 -- 172.21.15.6:0/2604619941 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f2c0af2b0 msgr2=0x7f6f2c150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.916+0000 7f6f2b7fe640 1 --2- 172.21.15.6:0/2604619941 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f2c0af2b0 0x7f6f2c150c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.916+0000 7f6f2b7fe640 1 -- 172.21.15.6:0/2604619941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f2c070f30 msgr2=0x7f6f2c156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.916+0000 7f6f2b7fe640 1 --2- 172.21.15.6:0/2604619941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f2c070f30 0x7f6f2c156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.916+0000 7f6f2b7fe640 1 -- 172.21.15.6:0/2604619941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1c0094d0 con 0x7f6f2c069430 2023-07-21T22:31:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.916+0000 7f6f2b7fe640 1 --2- 172.21.15.6:0/2604619941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c069430 0x7f6f2c0b0dc0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0ad040 tx=0x7f6f1c01ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.916+0000 7f6f13fff640 1 -- 172.21.15.6:0/2604619941 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c0b4800 con 0x7f6f2c069430 2023-07-21T22:31:24.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.916+0000 7f6f13fff640 1 -- 172.21.15.6:0/2604619941 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1c0b4980 con 0x7f6f2c069430 2023-07-21T22:31:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.916+0000 7f6f13fff640 1 -- 172.21.15.6:0/2604619941 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c0b4d30 con 0x7f6f2c069430 2023-07-21T22:31:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.916+0000 7f6f31aca640 1 -- 172.21.15.6:0/2604619941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f2c150780 con 0x7f6f2c069430 2023-07-21T22:31:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.916+0000 7f6f31aca640 1 -- 172.21.15.6:0/2604619941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f2c0b1780 con 0x7f6f2c069430 2023-07-21T22:31:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.916+0000 7f6f31aca640 1 -- 172.21.15.6:0/2604619941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f2c0678d0 con 0x7f6f2c069430 2023-07-21T22:31:24.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.916+0000 7f6f13fff640 1 -- 172.21.15.6:0/2604619941 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f6f1c0c7440 con 0x7f6f2c069430 2023-07-21T22:31:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.916+0000 7f6f13fff640 1 --2- 172.21.15.6:0/2604619941 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f6f18066480 0x7f6f18068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.916+0000 7f6f13fff640 1 -- 172.21.15.6:0/2604619941 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f6f1c11ede0 con 0x7f6f2c069430 2023-07-21T22:31:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.920+0000 7f6f2affd640 1 --2- 172.21.15.6:0/2604619941 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f6f18066480 0x7f6f18068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:24.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.920+0000 7f6f2affd640 1 --2- 172.21.15.6:0/2604619941 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f6f18066480 0x7f6f18068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c0c8300 tx=0x7f6f20009040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:24.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:24.920+0000 7f6f13fff640 1 -- 172.21.15.6:0/2604619941 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6f1c0ec130 con 0x7f6f2c069430 2023-07-21T22:31:25.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.096+0000 7f6f31aca640 1 -- 172.21.15.6:0/2604619941 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f2c0ca500 con 0x7f6f18066480 2023-07-21T22:31:25.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.104+0000 7f6f13fff640 1 -- 172.21.15.6:0/2604619941 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f6f20001450 con 0x7f6f18066480 2023-07-21T22:31:25.153 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:25.153 INFO:teuthology.orchestra.run.smithi006.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:20:03", "first": "2023-07-21T22:21:00", "last": "2023-07-21T22:31:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-21T22:31:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.108+0000 7f6f31aca640 1 -- 172.21.15.6:0/2604619941 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f6f18066480 msgr2=0x7f6f18068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.108+0000 7f6f31aca640 1 --2- 172.21.15.6:0/2604619941 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f6f18066480 0x7f6f18068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c0c8300 tx=0x7f6f20009040 comp rx=0 tx=0).stop 2023-07-21T22:31:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.108+0000 7f6f31aca640 1 -- 172.21.15.6:0/2604619941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c069430 msgr2=0x7f6f2c0b0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.108+0000 7f6f31aca640 1 --2- 172.21.15.6:0/2604619941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c069430 0x7f6f2c0b0dc0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0ad040 tx=0x7f6f1c01ad80 comp rx=0 tx=0).stop 2023-07-21T22:31:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.108+0000 7f6f31aca640 1 -- 172.21.15.6:0/2604619941 shutdown_connections 2023-07-21T22:31:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.108+0000 7f6f31aca640 1 --2- 172.21.15.6:0/2604619941 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f6f18066480 0x7f6f18068930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.108+0000 7f6f31aca640 1 --2- 172.21.15.6:0/2604619941 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f2c0af2b0 0x7f6f2c150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.108+0000 7f6f31aca640 1 --2- 172.21.15.6:0/2604619941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f2c070f30 0x7f6f2c156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.108+0000 7f6f31aca640 1 --2- 172.21.15.6:0/2604619941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f2c069430 0x7f6f2c0b0dc0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.108+0000 7f6f31aca640 1 -- 172.21.15.6:0/2604619941 >> 172.21.15.6:0/2604619941 conn(0x7f6f2c0cde90 msgr2=0x7f6f2c159510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:25.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.108+0000 7f6f31aca640 1 -- 172.21.15.6:0/2604619941 shutdown_connections 2023-07-21T22:31:25.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.108+0000 7f6f31aca640 1 -- 172.21.15.6:0/2604619941 wait complete. 2023-07-21T22:31:25.174 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:20:03", "first": "2023-07-21T22:21:00", "last": "2023-07-21T22:31:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-21T22:31:25.175 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1M', 'retention': {}, 'start': '2023-07-21T00:00:00', 'created': '2023-07-21T22:20:03', 'first': '2023-07-21T22:21:00', 'last': '2023-07-21T22:31:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-21T22:31:25.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:25.176 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-07-21T22:31:25.186 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_21_01_UTC 2023-07-21T22:31:25.186 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:25.186 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:25.186 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:25.187 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:25.187 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:25.187 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:25.187 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:25.187 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:25.187 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:25.187 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:25.188 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-21-22_21_01_UTC', 'scheduled-2023-07-21-22_22_00_UTC', 'scheduled-2023-07-21-22_23_00_UTC', 'scheduled-2023-07-21-22_24_00_UTC', 'scheduled-2023-07-21-22_25_00_UTC', 'scheduled-2023-07-21-22_26_00_UTC', 'scheduled-2023-07-21-22_27_00_UTC', 'scheduled-2023-07-21-22_28_00_UTC', 'scheduled-2023-07-21-22_29_00_UTC', 'scheduled-2023-07-21-22_30_00_UTC', 'scheduled-2023-07-21-22_31_00_UTC'] 2023-07-21T22:31:25.189 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir2 2023-07-21T22:31:25.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.328+0000 7f3d6c1d2640 1 Processor -- start 2023-07-21T22:31:25.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.328+0000 7f3d6c1d2640 1 -- start start 2023-07-21T22:31:25.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.332+0000 7f3d6c1d2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3d6406a540 0x7f3d6406a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:25.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.332+0000 7f3d6c1d2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d640cf710 0x7f3d640cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:25.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.332+0000 7f3d6c1d2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d640cb7a0 con 0x7f3d640cf2e0 2023-07-21T22:31:25.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.332+0000 7f3d6c1d2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d640d0920 con 0x7f3d640cf710 2023-07-21T22:31:25.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.332+0000 7f3d6c1d2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6415bfd0 con 0x7f3d6406a540 2023-07-21T22:31:25.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.332+0000 7f3d6a76f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d640cf710 0x7f3d640cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:25.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.332+0000 7f3d6a76f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3d640cf710 0x7f3d640cd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46186/0 (socket says 172.21.15.6:46186) 2023-07-21T22:31:25.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.332+0000 7f3d6a76f640 1 -- 172.21.15.6:0/742182822 learned_addr learned my addr 172.21.15.6:0/742182822 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:25.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.332+0000 7f3d6976d640 1 --1- 172.21.15.6:0/742182822 >> v1:172.21.15.6:6789/0 conn(0x7f3d640cf2e0 0x7f3d640cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48842/0 (socket says 172.21.15.6:48842) 2023-07-21T22:31:25.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.332+0000 7f3d69f6e640 1 --2- 172.21.15.6:0/742182822 >> v2:172.21.15.161:3300/0 conn(0x7f3d6406a540 0x7f3d6406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:25.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.332+0000 7f3d6a76f640 1 -- 172.21.15.6:0/742182822 >> v2:172.21.15.161:3300/0 conn(0x7f3d6406a540 msgr2=0x7f3d6406a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:25.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.332+0000 7f3d6a76f640 1 --2- 172.21.15.6:0/742182822 >> v2:172.21.15.161:3300/0 conn(0x7f3d6406a540 0x7f3d6406a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.332+0000 7f3d6a76f640 1 -- 172.21.15.6:0/742182822 >> v1:172.21.15.6:6789/0 conn(0x7f3d640cf2e0 legacy=0x7f3d640cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:25.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.332+0000 7f3d6a76f640 1 -- 172.21.15.6:0/742182822 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6406ae50 con 0x7f3d640cf710 2023-07-21T22:31:25.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.332+0000 7f3d69f6e640 1 --2- 172.21.15.6:0/742182822 >> v2:172.21.15.161:3300/0 conn(0x7f3d6406a540 0x7f3d6406a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:31:25.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.336+0000 7f3d6a76f640 1 --2- 172.21.15.6:0/742182822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d640cf710 0x7f3d640cd0d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3d6406fee0 tx=0x7f3d5c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5b280f4ddd56f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:25.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.336+0000 7f3d68f6c640 1 -- 172.21.15.6:0/742182822 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c0a5860 con 0x7f3d640cf710 2023-07-21T22:31:25.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.336+0000 7f3d68f6c640 1 -- 172.21.15.6:0/742182822 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5c0a59c0 con 0x7f3d640cf710 2023-07-21T22:31:25.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.336+0000 7f3d68f6c640 1 -- 172.21.15.6:0/742182822 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c0a5d50 con 0x7f3d640cf710 2023-07-21T22:31:25.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.336+0000 7f3d6c1d2640 1 -- 172.21.15.6:0/742182822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d640cf710 msgr2=0x7f3d640cd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:25.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.336+0000 7f3d6c1d2640 1 --2- 172.21.15.6:0/742182822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d640cf710 0x7f3d640cd0d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3d6406fee0 tx=0x7f3d5c01c9a0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.336+0000 7f3d6c1d2640 1 -- 172.21.15.6:0/742182822 shutdown_connections 2023-07-21T22:31:25.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.336+0000 7f3d6c1d2640 1 --2- 172.21.15.6:0/742182822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d640cf710 0x7f3d640cd0d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.336+0000 7f3d6c1d2640 1 --2- 172.21.15.6:0/742182822 >> v2:172.21.15.161:3300/0 conn(0x7f3d6406a540 0x7f3d6406a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.336+0000 7f3d6c1d2640 1 -- 172.21.15.6:0/742182822 >> 172.21.15.6:0/742182822 conn(0x7f3d64099490 msgr2=0x7f3d64089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:25.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.336+0000 7f3d6c1d2640 1 -- 172.21.15.6:0/742182822 shutdown_connections 2023-07-21T22:31:25.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.336+0000 7f3d6c1d2640 1 -- 172.21.15.6:0/742182822 wait complete. 2023-07-21T22:31:25.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.336+0000 7f3d6c1d2640 1 Processor -- start 2023-07-21T22:31:25.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.336+0000 7f3d6c1d2640 1 -- start start 2023-07-21T22:31:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d6c1d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d6406a540 0x7f3d640b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d6c1d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d640cf2e0 0x7f3d6414e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d6c1d2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d640cf710 0x7f3d64151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d6c1d2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d641501e0 con 0x7f3d640cf2e0 2023-07-21T22:31:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d6c1d2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d64150480 con 0x7f3d640cf710 2023-07-21T22:31:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d6c1d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d64150760 con 0x7f3d6406a540 2023-07-21T22:31:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d6976d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d640cf2e0 0x7f3d6414e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d6976d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d640cf2e0 0x7f3d6414e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46196/0 (socket says 172.21.15.6:46196) 2023-07-21T22:31:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d6976d640 1 -- 172.21.15.6:0/2315230105 learned_addr learned my addr 172.21.15.6:0/2315230105 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:25.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d6a76f640 1 --2- 172.21.15.6:0/2315230105 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d640cf710 0x7f3d64151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:25.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d69f6e640 1 --2- 172.21.15.6:0/2315230105 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d6406a540 0x7f3d640b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:25.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d6976d640 1 -- 172.21.15.6:0/2315230105 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d6406a540 msgr2=0x7f3d640b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:25.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d6976d640 1 --2- 172.21.15.6:0/2315230105 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d6406a540 0x7f3d640b0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d6976d640 1 -- 172.21.15.6:0/2315230105 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d640cf710 msgr2=0x7f3d64151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d6976d640 1 --2- 172.21.15.6:0/2315230105 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d640cf710 0x7f3d64151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d6976d640 1 -- 172.21.15.6:0/2315230105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c009b30 con 0x7f3d640cf2e0 2023-07-21T22:31:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d6976d640 1 --2- 172.21.15.6:0/2315230105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d640cf2e0 0x7f3d6414e840 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3d5400c430 tx=0x7f3d5400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d5a7fc640 1 -- 172.21.15.6:0/2315230105 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d540074e0 con 0x7f3d640cf2e0 2023-07-21T22:31:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d5a7fc640 1 -- 172.21.15.6:0/2315230105 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d54007640 con 0x7f3d640cf2e0 2023-07-21T22:31:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d5a7fc640 1 -- 172.21.15.6:0/2315230105 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d54004a10 con 0x7f3d640cf2e0 2023-07-21T22:31:25.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d6c1d2640 1 -- 172.21.15.6:0/2315230105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d64150a40 con 0x7f3d640cf2e0 2023-07-21T22:31:25.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d6c1d2640 1 -- 172.21.15.6:0/2315230105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6414ed80 con 0x7f3d640cf2e0 2023-07-21T22:31:25.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d6c1d2640 1 -- 172.21.15.6:0/2315230105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d640678d0 con 0x7f3d640cf2e0 2023-07-21T22:31:25.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.340+0000 7f3d5a7fc640 1 -- 172.21.15.6:0/2315230105 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f3d54004b70 con 0x7f3d640cf2e0 2023-07-21T22:31:25.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.344+0000 7f3d5a7fc640 1 --2- 172.21.15.6:0/2315230105 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3d48066480 0x7f3d48068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:25.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.344+0000 7f3d5a7fc640 1 -- 172.21.15.6:0/2315230105 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f3d54083c10 con 0x7f3d640cf2e0 2023-07-21T22:31:25.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.344+0000 7f3d69f6e640 1 --2- 172.21.15.6:0/2315230105 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3d48066480 0x7f3d48068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:25.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.344+0000 7f3d69f6e640 1 --2- 172.21.15.6:0/2315230105 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3d48066480 0x7f3d48068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3d60006fd0 tx=0x7f3d60008040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:25.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.348+0000 7f3d5a7fc640 1 -- 172.21.15.6:0/2315230105 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3d54050ce0 con 0x7f3d640cf2e0 2023-07-21T22:31:25.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.516+0000 7f3d6c1d2640 1 -- 172.21.15.6:0/2315230105 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d640d05b0 con 0x7f3d48066480 2023-07-21T22:31:25.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.528+0000 7f3d5a7fc640 1 -- 172.21.15.6:0/2315230105 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f3d6000c050 con 0x7f3d48066480 2023-07-21T22:31:25.576 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:25.576 INFO:teuthology.orchestra.run.smithi006.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:20:04", "first": "2023-07-21T22:21:01", "last": "2023-07-21T22:31:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-21T22:31:25.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.528+0000 7f3d6c1d2640 1 -- 172.21.15.6:0/2315230105 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3d48066480 msgr2=0x7f3d48068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:25.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.528+0000 7f3d6c1d2640 1 --2- 172.21.15.6:0/2315230105 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3d48066480 0x7f3d48068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3d60006fd0 tx=0x7f3d60008040 comp rx=0 tx=0).stop 2023-07-21T22:31:25.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.528+0000 7f3d6c1d2640 1 -- 172.21.15.6:0/2315230105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d640cf2e0 msgr2=0x7f3d6414e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:25.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.528+0000 7f3d6c1d2640 1 --2- 172.21.15.6:0/2315230105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d640cf2e0 0x7f3d6414e840 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3d5400c430 tx=0x7f3d5400c8f0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.528+0000 7f3d6c1d2640 1 -- 172.21.15.6:0/2315230105 shutdown_connections 2023-07-21T22:31:25.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.528+0000 7f3d6c1d2640 1 --2- 172.21.15.6:0/2315230105 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3d48066480 0x7f3d48068930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.528+0000 7f3d6c1d2640 1 --2- 172.21.15.6:0/2315230105 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d640cf710 0x7f3d64151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.528+0000 7f3d6c1d2640 1 --2- 172.21.15.6:0/2315230105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d640cf2e0 0x7f3d6414e840 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.528+0000 7f3d6c1d2640 1 --2- 172.21.15.6:0/2315230105 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3d6406a540 0x7f3d640b0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.528+0000 7f3d6c1d2640 1 -- 172.21.15.6:0/2315230105 >> 172.21.15.6:0/2315230105 conn(0x7f3d64099490 msgr2=0x7f3d640b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:25.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.528+0000 7f3d6c1d2640 1 -- 172.21.15.6:0/2315230105 shutdown_connections 2023-07-21T22:31:25.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.528+0000 7f3d6c1d2640 1 -- 172.21.15.6:0/2315230105 wait complete. 2023-07-21T22:31:25.597 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:20:04", "first": "2023-07-21T22:21:01", "last": "2023-07-21T22:31:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-21T22:31:25.597 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1M', 'retention': {}, 'start': '2023-07-21T00:00:00', 'created': '2023-07-21T22:20:04', 'first': '2023-07-21T22:21:01', 'last': '2023-07-21T22:31:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-21T22:31:25.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:25.598 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-07-21T22:31:25.608 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:25.608 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:25.608 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:25.609 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:25.609 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:25.609 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:25.609 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:25.609 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:25.609 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:25.609 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_30_01_UTC 2023-07-21T22:31:25.609 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:25.610 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-21-22_21_00_UTC', 'scheduled-2023-07-21-22_22_00_UTC', 'scheduled-2023-07-21-22_23_00_UTC', 'scheduled-2023-07-21-22_24_00_UTC', 'scheduled-2023-07-21-22_25_00_UTC', 'scheduled-2023-07-21-22_26_00_UTC', 'scheduled-2023-07-21-22_27_00_UTC', 'scheduled-2023-07-21-22_28_00_UTC', 'scheduled-2023-07-21-22_29_00_UTC', 'scheduled-2023-07-21-22_30_01_UTC', 'scheduled-2023-07-21-22_31_00_UTC'] 2023-07-21T22:31:25.611 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir3 2023-07-21T22:31:25.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.752+0000 7f13b3a9c640 1 Processor -- start 2023-07-21T22:31:25.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.752+0000 7f13b3a9c640 1 -- start start 2023-07-21T22:31:25.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.756+0000 7f13b3a9c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f13ac0c3ac0 0x7f13ac0c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:25.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.756+0000 7f13b3a9c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13ac0af2b0 0x7f13ac0ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:25.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.756+0000 7f13b3a9c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ac0ca540 con 0x7f13ac0cd120 2023-07-21T22:31:25.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.756+0000 7f13b3a9c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13ac0695b0 con 0x7f13ac0c3ac0 2023-07-21T22:31:25.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.756+0000 7f13b3a9c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac069890 con 0x7f13ac0af2b0 2023-07-21T22:31:25.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.756+0000 7f13b2039640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f13ac0cd120 0x7f13ac0cd5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:48850/0 (socket says 172.21.15.6:48850) 2023-07-21T22:31:25.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.756+0000 7f13b2039640 1 -- 172.21.15.6:0/3924673755 learned_addr learned my addr 172.21.15.6:0/3924673755 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.756+0000 7f13b1838640 1 --2- 172.21.15.6:0/3924673755 >> v2:172.21.15.161:3300/0 conn(0x7f13ac0c3ac0 0x7f13ac0c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.756+0000 7f13b1037640 1 --2- 172.21.15.6:0/3924673755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13ac0af2b0 0x7f13ac0ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.756+0000 7f13b0836640 1 -- 172.21.15.6:0/3924673755 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450969792 0 0) 0x7f13ac0ca540 con 0x7f13ac0cd120 2023-07-21T22:31:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.756+0000 7f13b0836640 1 -- 172.21.15.6:0/3924673755 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1398003530 con 0x7f13ac0cd120 2023-07-21T22:31:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.756+0000 7f13b1838640 1 -- 172.21.15.6:0/3924673755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13ac0af2b0 msgr2=0x7f13ac0ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.756+0000 7f13b1838640 1 --2- 172.21.15.6:0/3924673755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13ac0af2b0 0x7f13ac0ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.756+0000 7f13b1838640 1 -- 172.21.15.6:0/3924673755 >> v1:172.21.15.6:6789/0 conn(0x7f13ac0cd120 legacy=0x7f13ac0cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.756+0000 7f13b0836640 1 -- 172.21.15.6:0/3924673755 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4157207582 0 0) 0x7f1398003530 con 0x7f13ac0cd120 2023-07-21T22:31:25.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.756+0000 7f13b1838640 1 -- 172.21.15.6:0/3924673755 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac069b70 con 0x7f13ac0c3ac0 2023-07-21T22:31:25.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.756+0000 7f13b1037640 1 --2- 172.21.15.6:0/3924673755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13ac0af2b0 0x7f13ac0ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:25.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.760+0000 7f13b1838640 1 --2- 172.21.15.6:0/3924673755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13ac0c3ac0 0x7f13ac0c2d30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f13a80097c0 tx=0x7f13a801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae88b69fe8fb6a78 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:25.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.760+0000 7f13b0836640 1 -- 172.21.15.6:0/3924673755 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4001a00 con 0x7f13ac0c3ac0 2023-07-21T22:31:25.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.760+0000 7f13b0836640 1 -- 172.21.15.6:0/3924673755 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a80a7050 con 0x7f13ac0c3ac0 2023-07-21T22:31:25.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.760+0000 7f13b0836640 1 -- 172.21.15.6:0/3924673755 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a80ab620 con 0x7f13ac0c3ac0 2023-07-21T22:31:25.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.760+0000 7f13b3a9c640 1 -- 172.21.15.6:0/3924673755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13ac0c3ac0 msgr2=0x7f13ac0c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:25.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.760+0000 7f13b3a9c640 1 --2- 172.21.15.6:0/3924673755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13ac0c3ac0 0x7f13ac0c2d30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f13a80097c0 tx=0x7f13a801c3a0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.760+0000 7f13b3a9c640 1 -- 172.21.15.6:0/3924673755 shutdown_connections 2023-07-21T22:31:25.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.760+0000 7f13b3a9c640 1 --2- 172.21.15.6:0/3924673755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13ac0af2b0 0x7f13ac0ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.760+0000 7f13b3a9c640 1 --2- 172.21.15.6:0/3924673755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13ac0c3ac0 0x7f13ac0c2d30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.760+0000 7f13b3a9c640 1 -- 172.21.15.6:0/3924673755 >> 172.21.15.6:0/3924673755 conn(0x7f13ac0cde90 msgr2=0x7f13ac0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:25.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.760+0000 7f13b3a9c640 1 -- 172.21.15.6:0/3924673755 shutdown_connections 2023-07-21T22:31:25.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.760+0000 7f13b3a9c640 1 -- 172.21.15.6:0/3924673755 wait complete. 2023-07-21T22:31:25.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.760+0000 7f13b3a9c640 1 Processor -- start 2023-07-21T22:31:25.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.760+0000 7f13b3a9c640 1 -- start start 2023-07-21T22:31:25.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13b3a9c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13ac0af2b0 0x7f13ac0b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:25.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13b3a9c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13ac0c3ac0 0x7f13ac157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:25.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13b3a9c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13ac0cd120 0x7f13ac159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:25.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13b3a9c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac158360 con 0x7f13ac0c3ac0 2023-07-21T22:31:25.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13b3a9c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac158640 con 0x7f13ac0cd120 2023-07-21T22:31:25.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13b3a9c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac158920 con 0x7f13ac0af2b0 2023-07-21T22:31:25.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13b1037640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13ac0c3ac0 0x7f13ac157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:25.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13b1037640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13ac0c3ac0 0x7f13ac157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46200/0 (socket says 172.21.15.6:46200) 2023-07-21T22:31:25.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13b1037640 1 -- 172.21.15.6:0/1767563876 learned_addr learned my addr 172.21.15.6:0/1767563876 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:25.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13b1838640 1 --2- 172.21.15.6:0/1767563876 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13ac0af2b0 0x7f13ac0b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:25.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13b2039640 1 --2- 172.21.15.6:0/1767563876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13ac0cd120 0x7f13ac159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:25.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13b1037640 1 -- 172.21.15.6:0/1767563876 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13ac0af2b0 msgr2=0x7f13ac0b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:25.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13b1037640 1 --2- 172.21.15.6:0/1767563876 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13ac0af2b0 0x7f13ac0b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13b1037640 1 -- 172.21.15.6:0/1767563876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13ac0cd120 msgr2=0x7f13ac159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:25.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13b1037640 1 --2- 172.21.15.6:0/1767563876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13ac0cd120 0x7f13ac159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:25.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13b1037640 1 -- 172.21.15.6:0/1767563876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139c009420 con 0x7f13ac0c3ac0 2023-07-21T22:31:25.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13b1037640 1 --2- 172.21.15.6:0/1767563876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13ac0c3ac0 0x7f13ac157b10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f139c00e980 tx=0x7f139c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:25.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13a27fc640 1 -- 172.21.15.6:0/1767563876 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c00ca00 con 0x7f13ac0c3ac0 2023-07-21T22:31:25.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13a27fc640 1 -- 172.21.15.6:0/1767563876 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c00cb60 con 0x7f13ac0c3ac0 2023-07-21T22:31:25.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13b3a9c640 1 -- 172.21.15.6:0/1767563876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a8009420 con 0x7f13ac0c3ac0 2023-07-21T22:31:25.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13a27fc640 1 -- 172.21.15.6:0/1767563876 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c013470 con 0x7f13ac0c3ac0 2023-07-21T22:31:25.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13b3a9c640 1 -- 172.21.15.6:0/1767563876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ac158ee0 con 0x7f13ac0c3ac0 2023-07-21T22:31:25.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13b3a9c640 1 -- 172.21.15.6:0/1767563876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13ac0678d0 con 0x7f13ac0c3ac0 2023-07-21T22:31:25.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.764+0000 7f13a27fc640 1 -- 172.21.15.6:0/1767563876 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f139c0135d0 con 0x7f13ac0c3ac0 2023-07-21T22:31:25.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.768+0000 7f13a27fc640 1 --2- 172.21.15.6:0/1767563876 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f13900664b0 0x7f1390068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:25.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.768+0000 7f13a27fc640 1 -- 172.21.15.6:0/1767563876 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f139c084560 con 0x7f13ac0c3ac0 2023-07-21T22:31:25.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.768+0000 7f13b1838640 1 --2- 172.21.15.6:0/1767563876 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f13900664b0 0x7f1390068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:25.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.768+0000 7f13b1838640 1 --2- 172.21.15.6:0/1767563876 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f13900664b0 0x7f1390068960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f13a80ad000 tx=0x7f13a80a6000 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:25.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.772+0000 7f13a27fc640 1 -- 172.21.15.6:0/1767563876 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f139c051510 con 0x7f13ac0c3ac0 2023-07-21T22:31:25.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.944+0000 7f13b3a9c640 1 -- 172.21.15.6:0/1767563876 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13ac0aeb80 con 0x7f13900664b0 2023-07-21T22:31:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.956+0000 7f13a27fc640 1 -- 172.21.15.6:0/1767563876 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f13ac0aeb80 con 0x7f13900664b0 2023-07-21T22:31:26.003 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:26.003 INFO:teuthology.orchestra.run.smithi006.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:20:04", "first": "2023-07-21T22:21:00", "last": "2023-07-21T22:31:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-21T22:31:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.956+0000 7f13b3a9c640 1 -- 172.21.15.6:0/1767563876 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f13900664b0 msgr2=0x7f1390068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.956+0000 7f13b3a9c640 1 --2- 172.21.15.6:0/1767563876 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f13900664b0 0x7f1390068960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f13a80ad000 tx=0x7f13a80a6000 comp rx=0 tx=0).stop 2023-07-21T22:31:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.956+0000 7f13b3a9c640 1 -- 172.21.15.6:0/1767563876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13ac0c3ac0 msgr2=0x7f13ac157b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.956+0000 7f13b3a9c640 1 --2- 172.21.15.6:0/1767563876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13ac0c3ac0 0x7f13ac157b10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f139c00e980 tx=0x7f139c00ee40 comp rx=0 tx=0).stop 2023-07-21T22:31:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.956+0000 7f13b3a9c640 1 -- 172.21.15.6:0/1767563876 shutdown_connections 2023-07-21T22:31:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.956+0000 7f13b3a9c640 1 --2- 172.21.15.6:0/1767563876 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f13900664b0 0x7f1390068960 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.956+0000 7f13b3a9c640 1 --2- 172.21.15.6:0/1767563876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13ac0cd120 0x7f13ac159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.956+0000 7f13b3a9c640 1 --2- 172.21.15.6:0/1767563876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13ac0c3ac0 0x7f13ac157b10 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.956+0000 7f13b3a9c640 1 --2- 172.21.15.6:0/1767563876 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13ac0af2b0 0x7f13ac0b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.956+0000 7f13b3a9c640 1 -- 172.21.15.6:0/1767563876 >> 172.21.15.6:0/1767563876 conn(0x7f13ac0cde90 msgr2=0x7f13ac162fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.956+0000 7f13b3a9c640 1 -- 172.21.15.6:0/1767563876 shutdown_connections 2023-07-21T22:31:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:25.956+0000 7f13b3a9c640 1 -- 172.21.15.6:0/1767563876 wait complete. 2023-07-21T22:31:26.023 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:20:04", "first": "2023-07-21T22:21:00", "last": "2023-07-21T22:31:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-21T22:31:26.024 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1M', 'retention': {}, 'start': '2023-07-21T00:00:00', 'created': '2023-07-21T22:20:04', 'first': '2023-07-21T22:21:00', 'last': '2023-07-21T22:31:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-21T22:31:26.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:26.025 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-07-21T22:31:26.035 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:26.035 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:26.035 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:26.036 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:26.036 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:26.036 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:26.036 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:26.036 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:26.036 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:26.036 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:26.036 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:26.037 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-21-22_21_00_UTC', 'scheduled-2023-07-21-22_22_00_UTC', 'scheduled-2023-07-21-22_23_00_UTC', 'scheduled-2023-07-21-22_24_00_UTC', 'scheduled-2023-07-21-22_25_00_UTC', 'scheduled-2023-07-21-22_26_00_UTC', 'scheduled-2023-07-21-22_27_00_UTC', 'scheduled-2023-07-21-22_28_00_UTC', 'scheduled-2023-07-21-22_29_00_UTC', 'scheduled-2023-07-21-22_30_00_UTC', 'scheduled-2023-07-21-22_31_00_UTC'] 2023-07-21T22:31:26.038 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir4 2023-07-21T22:31:26.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.180+0000 7f06d6e5c640 1 Processor -- start 2023-07-21T22:31:26.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.180+0000 7f06d6e5c640 1 -- start start 2023-07-21T22:31:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.180+0000 7f06d6e5c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06d006a540 0x7f06d006a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.180+0000 7f06d6e5c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f06d00cf2e0 0x7f06d00cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.180+0000 7f06d6e5c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f06d00cc9c0 0x7f06d00cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:26.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.180+0000 7f06d6e5c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d00d0920 con 0x7f06d00cc9c0 2023-07-21T22:31:26.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.180+0000 7f06d6e5c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d015bfd0 con 0x7f06d00cf2e0 2023-07-21T22:31:26.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.180+0000 7f06d6e5c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d006ae50 con 0x7f06d006a540 2023-07-21T22:31:26.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.180+0000 7f06d53f9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f06d00cc9c0 0x7f06d00cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:26.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.180+0000 7f06d53f9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f06d00cc9c0 0x7f06d00cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46206/0 (socket says 172.21.15.6:46206) 2023-07-21T22:31:26.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.180+0000 7f06d53f9640 1 -- 172.21.15.6:0/1642184654 learned_addr learned my addr 172.21.15.6:0/1642184654 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:26.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.180+0000 7f06cffff640 1 --2- 172.21.15.6:0/1642184654 >> v2:172.21.15.161:3300/0 conn(0x7f06d00cf2e0 0x7f06d00cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:26.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.180+0000 7f06d4bf8640 1 --2- 172.21.15.6:0/1642184654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06d006a540 0x7f06d006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:26.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.184+0000 7f06d53f9640 1 -- 172.21.15.6:0/1642184654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06d006a540 msgr2=0x7f06d006a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:26.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.184+0000 7f06d53f9640 1 --2- 172.21.15.6:0/1642184654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06d006a540 0x7f06d006a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.184+0000 7f06d53f9640 1 -- 172.21.15.6:0/1642184654 >> v2:172.21.15.161:3300/0 conn(0x7f06d00cf2e0 msgr2=0x7f06d00cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:26.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.184+0000 7f06d53f9640 1 --2- 172.21.15.6:0/1642184654 >> v2:172.21.15.161:3300/0 conn(0x7f06d00cf2e0 0x7f06d00cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.184+0000 7f06d53f9640 1 -- 172.21.15.6:0/1642184654 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d00cfd10 con 0x7f06d00cc9c0 2023-07-21T22:31:26.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.184+0000 7f06cffff640 1 --2- 172.21.15.6:0/1642184654 >> v2:172.21.15.161:3300/0 conn(0x7f06d00cf2e0 0x7f06d00cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:26.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.184+0000 7f06d53f9640 1 --2- 172.21.15.6:0/1642184654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06d00cc9c0 0x7f06d00cce30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f06d0070ba0 tx=0x7f06c801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d98cf7ca05a05ae server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:26.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.184+0000 7f06cf7fe640 1 -- 172.21.15.6:0/1642184654 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c80a5820 con 0x7f06d00cc9c0 2023-07-21T22:31:26.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.184+0000 7f06cf7fe640 1 -- 172.21.15.6:0/1642184654 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c80a5980 con 0x7f06d00cc9c0 2023-07-21T22:31:26.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.184+0000 7f06cf7fe640 1 -- 172.21.15.6:0/1642184654 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c80a5d10 con 0x7f06d00cc9c0 2023-07-21T22:31:26.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.184+0000 7f06d6e5c640 1 -- 172.21.15.6:0/1642184654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06d00cc9c0 msgr2=0x7f06d00cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:26.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.184+0000 7f06d6e5c640 1 --2- 172.21.15.6:0/1642184654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06d00cc9c0 0x7f06d00cce30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f06d0070ba0 tx=0x7f06c801c9a0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d6e5c640 1 -- 172.21.15.6:0/1642184654 shutdown_connections 2023-07-21T22:31:26.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d6e5c640 1 --2- 172.21.15.6:0/1642184654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06d00cc9c0 0x7f06d00cce30 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d6e5c640 1 --2- 172.21.15.6:0/1642184654 >> v2:172.21.15.161:3300/0 conn(0x7f06d00cf2e0 0x7f06d00cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d6e5c640 1 --2- 172.21.15.6:0/1642184654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06d006a540 0x7f06d006a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d6e5c640 1 -- 172.21.15.6:0/1642184654 >> 172.21.15.6:0/1642184654 conn(0x7f06d0099490 msgr2=0x7f06d0089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:26.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d6e5c640 1 -- 172.21.15.6:0/1642184654 shutdown_connections 2023-07-21T22:31:26.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d6e5c640 1 -- 172.21.15.6:0/1642184654 wait complete. 2023-07-21T22:31:26.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d6e5c640 1 Processor -- start 2023-07-21T22:31:26.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d6e5c640 1 -- start start 2023-07-21T22:31:26.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d6e5c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06d006a540 0x7f06d0151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:26.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d6e5c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06d00cc9c0 0x7f06d0152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:26.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d6e5c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06d00cf2e0 0x7f06d00b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:26.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d6e5c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d0151f60 con 0x7f06d006a540 2023-07-21T22:31:26.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d6e5c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d015a870 con 0x7f06d00cf2e0 2023-07-21T22:31:26.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d6e5c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d01529f0 con 0x7f06d00cc9c0 2023-07-21T22:31:26.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d4bf8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06d006a540 0x7f06d0151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:26.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d4bf8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06d006a540 0x7f06d0151a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46216/0 (socket says 172.21.15.6:46216) 2023-07-21T22:31:26.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d4bf8640 1 -- 172.21.15.6:0/23481996 learned_addr learned my addr 172.21.15.6:0/23481996 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:26.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06cffff640 1 --2- 172.21.15.6:0/23481996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06d00cc9c0 0x7f06d0152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:26.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d53f9640 1 --2- 172.21.15.6:0/23481996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06d00cf2e0 0x7f06d00b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:26.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d4bf8640 1 -- 172.21.15.6:0/23481996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06d00cc9c0 msgr2=0x7f06d0152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:26.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d4bf8640 1 --2- 172.21.15.6:0/23481996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06d00cc9c0 0x7f06d0152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d4bf8640 1 -- 172.21.15.6:0/23481996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06d00cf2e0 msgr2=0x7f06d00b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:26.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d4bf8640 1 --2- 172.21.15.6:0/23481996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06d00cf2e0 0x7f06d00b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d4bf8640 1 -- 172.21.15.6:0/23481996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c8009b30 con 0x7f06d006a540 2023-07-21T22:31:26.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06cffff640 1 --2- 172.21.15.6:0/23481996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06d00cc9c0 0x7f06d0152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:26.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d53f9640 1 --2- 172.21.15.6:0/23481996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06d00cf2e0 0x7f06d00b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:26.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.188+0000 7f06d4bf8640 1 --2- 172.21.15.6:0/23481996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06d006a540 0x7f06d0151a20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f06c400d800 tx=0x7f06c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:26.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.192+0000 7f06cd7fa640 1 -- 172.21.15.6:0/23481996 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c40096a0 con 0x7f06d006a540 2023-07-21T22:31:26.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.192+0000 7f06cd7fa640 1 -- 172.21.15.6:0/23481996 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c4009800 con 0x7f06d006a540 2023-07-21T22:31:26.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.192+0000 7f06cd7fa640 1 -- 172.21.15.6:0/23481996 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c4009990 con 0x7f06d006a540 2023-07-21T22:31:26.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.192+0000 7f06d6e5c640 1 -- 172.21.15.6:0/23481996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d0152cd0 con 0x7f06d006a540 2023-07-21T22:31:26.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.192+0000 7f06d6e5c640 1 -- 172.21.15.6:0/23481996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d0153290 con 0x7f06d006a540 2023-07-21T22:31:26.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.192+0000 7f06d6e5c640 1 -- 172.21.15.6:0/23481996 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d00ce200 con 0x7f06d006a540 2023-07-21T22:31:26.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.192+0000 7f06cd7fa640 1 -- 172.21.15.6:0/23481996 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f06c4009af0 con 0x7f06d006a540 2023-07-21T22:31:26.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.192+0000 7f06cd7fa640 1 --2- 172.21.15.6:0/23481996 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f06b4066480 0x7f06b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:26.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.192+0000 7f06cd7fa640 1 -- 172.21.15.6:0/23481996 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f06c4084770 con 0x7f06d006a540 2023-07-21T22:31:26.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.192+0000 7f06cffff640 1 --2- 172.21.15.6:0/23481996 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f06b4066480 0x7f06b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:26.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.196+0000 7f06cffff640 1 --2- 172.21.15.6:0/23481996 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f06b4066480 0x7f06b4068930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00b990 tx=0x7f06bc008040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:26.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.196+0000 7f06cd7fa640 1 -- 172.21.15.6:0/23481996 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f06c4051870 con 0x7f06d006a540 2023-07-21T22:31:26.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.368+0000 7f06d6e5c640 1 -- 172.21.15.6:0/23481996 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06d00cd780 con 0x7f06b4066480 2023-07-21T22:31:26.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.376+0000 7f06cd7fa640 1 -- 172.21.15.6:0/23481996 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f06bc00f860 con 0x7f06b4066480 2023-07-21T22:31:26.426 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:26.426 INFO:teuthology.orchestra.run.smithi006.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:20:05", "first": "2023-07-21T22:21:00", "last": "2023-07-21T22:31:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-21T22:31:26.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.380+0000 7f06d6e5c640 1 -- 172.21.15.6:0/23481996 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f06b4066480 msgr2=0x7f06b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:26.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.380+0000 7f06d6e5c640 1 --2- 172.21.15.6:0/23481996 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f06b4066480 0x7f06b4068930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00b990 tx=0x7f06bc008040 comp rx=0 tx=0).stop 2023-07-21T22:31:26.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.380+0000 7f06d6e5c640 1 -- 172.21.15.6:0/23481996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06d006a540 msgr2=0x7f06d0151a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:26.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.380+0000 7f06d6e5c640 1 --2- 172.21.15.6:0/23481996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06d006a540 0x7f06d0151a20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f06c400d800 tx=0x7f06c400dcc0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.380+0000 7f06d6e5c640 1 -- 172.21.15.6:0/23481996 shutdown_connections 2023-07-21T22:31:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.380+0000 7f06d6e5c640 1 --2- 172.21.15.6:0/23481996 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f06b4066480 0x7f06b4068930 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.380+0000 7f06d6e5c640 1 --2- 172.21.15.6:0/23481996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06d00cf2e0 0x7f06d00b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.380+0000 7f06d6e5c640 1 --2- 172.21.15.6:0/23481996 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06d00cc9c0 0x7f06d0152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.380+0000 7f06d6e5c640 1 --2- 172.21.15.6:0/23481996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06d006a540 0x7f06d0151a20 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.380+0000 7f06d6e5c640 1 -- 172.21.15.6:0/23481996 >> 172.21.15.6:0/23481996 conn(0x7f06d0099490 msgr2=0x7f06d006df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.380+0000 7f06d6e5c640 1 -- 172.21.15.6:0/23481996 shutdown_connections 2023-07-21T22:31:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.380+0000 7f06d6e5c640 1 -- 172.21.15.6:0/23481996 wait complete. 2023-07-21T22:31:26.447 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:20:05", "first": "2023-07-21T22:21:00", "last": "2023-07-21T22:31:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-21T22:31:26.448 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1M', 'retention': {}, 'start': '2023-07-21T00:00:00', 'created': '2023-07-21T22:20:05', 'first': '2023-07-21T22:21:00', 'last': '2023-07-21T22:31:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-21T22:31:26.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:26.449 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-07-21T22:31:26.459 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:26.459 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:26.459 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:26.459 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:26.459 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:26.459 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:26.460 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:26.460 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:26.460 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:26.460 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:26.460 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:26.461 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-21-22_21_00_UTC', 'scheduled-2023-07-21-22_22_00_UTC', 'scheduled-2023-07-21-22_23_00_UTC', 'scheduled-2023-07-21-22_24_00_UTC', 'scheduled-2023-07-21-22_25_00_UTC', 'scheduled-2023-07-21-22_26_00_UTC', 'scheduled-2023-07-21-22_27_00_UTC', 'scheduled-2023-07-21-22_28_00_UTC', 'scheduled-2023-07-21-22_29_00_UTC', 'scheduled-2023-07-21-22_30_00_UTC', 'scheduled-2023-07-21-22_31_00_UTC'] 2023-07-21T22:31:26.461 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir5 2023-07-21T22:31:26.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.600+0000 7f9d3d974640 1 Processor -- start 2023-07-21T22:31:26.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.600+0000 7f9d3d974640 1 -- start start 2023-07-21T22:31:26.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.600+0000 7f9d3d974640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d3815beb0 0x7f9d380cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:26.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.600+0000 7f9d3d974640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9d3806db00 0x7f9d380ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:26.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.600+0000 7f9d3d974640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d380cb6a0 con 0x7f9d380b0760 2023-07-21T22:31:26.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.600+0000 7f9d3d974640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d3806d020 con 0x7f9d3806db00 2023-07-21T22:31:26.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.600+0000 7f9d3d974640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3806d300 con 0x7f9d3815beb0 2023-07-21T22:31:26.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.604+0000 7f9d367fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9d3806db00 0x7f9d380ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:26.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.604+0000 7f9d36ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d3815beb0 0x7f9d380cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:26.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.604+0000 7f9d367fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9d3806db00 0x7f9d380ca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:53838/0 (socket says 172.21.15.6:53838) 2023-07-21T22:31:26.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.604+0000 7f9d36ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d3815beb0 0x7f9d380cada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:42194/0 (socket says 172.21.15.6:42194) 2023-07-21T22:31:26.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.604+0000 7f9d367fc640 1 -- 172.21.15.6:0/2037858480 learned_addr learned my addr 172.21.15.6:0/2037858480 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:26.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.604+0000 7f9d377fe640 1 --1- 172.21.15.6:0/2037858480 >> v1:172.21.15.161:6789/0 conn(0x7f9d380b0760 0x7f9d380cbf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:42192/0 (socket says 172.21.15.6:42192) 2023-07-21T22:31:26.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.604+0000 7f9d367fc640 1 -- 172.21.15.6:0/2037858480 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d3815beb0 msgr2=0x7f9d380cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:26.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.604+0000 7f9d367fc640 1 --2- 172.21.15.6:0/2037858480 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d3815beb0 0x7f9d380cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.604+0000 7f9d367fc640 1 -- 172.21.15.6:0/2037858480 >> v1:172.21.15.161:6789/0 conn(0x7f9d380b0760 legacy=0x7f9d380cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:26.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.604+0000 7f9d367fc640 1 -- 172.21.15.6:0/2037858480 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3806d5e0 con 0x7f9d3806db00 2023-07-21T22:31:26.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.604+0000 7f9d367fc640 1 --2- 172.21.15.6:0/2037858480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d3806db00 0x7f9d380ca0a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009870 tx=0x7f9d2c01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c36b134847e6b73 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:26.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.604+0000 7f9d35ffb640 1 -- 172.21.15.6:0/2037858480 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0ac620 con 0x7f9d3806db00 2023-07-21T22:31:26.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.604+0000 7f9d35ffb640 1 -- 172.21.15.6:0/2037858480 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2c0ac780 con 0x7f9d3806db00 2023-07-21T22:31:26.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.604+0000 7f9d35ffb640 1 -- 172.21.15.6:0/2037858480 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0acb10 con 0x7f9d3806db00 2023-07-21T22:31:26.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d3d974640 1 -- 172.21.15.6:0/2037858480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d3806db00 msgr2=0x7f9d380ca0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:26.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d3d974640 1 --2- 172.21.15.6:0/2037858480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d3806db00 0x7f9d380ca0a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c009870 tx=0x7f9d2c01c4b0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d3d974640 1 -- 172.21.15.6:0/2037858480 shutdown_connections 2023-07-21T22:31:26.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d3d974640 1 --2- 172.21.15.6:0/2037858480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d3806db00 0x7f9d380ca0a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d3d974640 1 --2- 172.21.15.6:0/2037858480 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d3815beb0 0x7f9d380cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d3d974640 1 -- 172.21.15.6:0/2037858480 >> 172.21.15.6:0/2037858480 conn(0x7f9d3806c2f0 msgr2=0x7f9d380aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:26.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d3d974640 1 -- 172.21.15.6:0/2037858480 shutdown_connections 2023-07-21T22:31:26.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d3d974640 1 -- 172.21.15.6:0/2037858480 wait complete. 2023-07-21T22:31:26.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d3d974640 1 Processor -- start 2023-07-21T22:31:26.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d3d974640 1 -- start start 2023-07-21T22:31:26.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d3d974640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d3806db00 0x7f9d380b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:26.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d3d974640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d380b0760 0x7f9d380b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:26.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d3d974640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d3815beb0 0x7f9d380b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:26.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d3d974640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380c4920 con 0x7f9d380b0760 2023-07-21T22:31:26.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d3d974640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380b3d80 con 0x7f9d3815beb0 2023-07-21T22:31:26.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d3d974640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d380c2600 con 0x7f9d3806db00 2023-07-21T22:31:26.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d367fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d380b0760 0x7f9d380b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:26.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d367fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d380b0760 0x7f9d380b2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46232/0 (socket says 172.21.15.6:46232) 2023-07-21T22:31:26.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d367fc640 1 -- 172.21.15.6:0/1696095831 learned_addr learned my addr 172.21.15.6:0/1696095831 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:26.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d377fe640 1 --2- 172.21.15.6:0/1696095831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d3815beb0 0x7f9d380b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:26.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d36ffd640 1 --2- 172.21.15.6:0/1696095831 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d3806db00 0x7f9d380b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:26.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d367fc640 1 -- 172.21.15.6:0/1696095831 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d3806db00 msgr2=0x7f9d380b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:26.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d367fc640 1 --2- 172.21.15.6:0/1696095831 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d3806db00 0x7f9d380b24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d367fc640 1 -- 172.21.15.6:0/1696095831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d3815beb0 msgr2=0x7f9d380b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:26.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d367fc640 1 --2- 172.21.15.6:0/1696095831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d3815beb0 0x7f9d380b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.608+0000 7f9d367fc640 1 -- 172.21.15.6:0/1696095831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2c0094d0 con 0x7f9d380b0760 2023-07-21T22:31:26.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.612+0000 7f9d367fc640 1 --2- 172.21.15.6:0/1696095831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d380b0760 0x7f9d380b2a30 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c01ab60 tx=0x7f9d2c019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:26.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.612+0000 7f9d1ffff640 1 -- 172.21.15.6:0/1696095831 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0ac620 con 0x7f9d380b0760 2023-07-21T22:31:26.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.612+0000 7f9d1ffff640 1 -- 172.21.15.6:0/1696095831 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2c0b5440 con 0x7f9d380b0760 2023-07-21T22:31:26.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.612+0000 7f9d1ffff640 1 -- 172.21.15.6:0/1696095831 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0b57f0 con 0x7f9d380b0760 2023-07-21T22:31:26.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.612+0000 7f9d3d974640 1 -- 172.21.15.6:0/1696095831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d380b20f0 con 0x7f9d380b0760 2023-07-21T22:31:26.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.612+0000 7f9d3d974640 1 -- 172.21.15.6:0/1696095831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d380b1e10 con 0x7f9d380b0760 2023-07-21T22:31:26.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.612+0000 7f9d3d974640 1 -- 172.21.15.6:0/1696095831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d380678d0 con 0x7f9d380b0760 2023-07-21T22:31:26.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.612+0000 7f9d1ffff640 1 -- 172.21.15.6:0/1696095831 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f9d2c0b3070 con 0x7f9d380b0760 2023-07-21T22:31:26.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.612+0000 7f9d1ffff640 1 --2- 172.21.15.6:0/1696095831 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9d24066480 0x7f9d24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:26.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.612+0000 7f9d1ffff640 1 -- 172.21.15.6:0/1696095831 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f9d2c11e060 con 0x7f9d380b0760 2023-07-21T22:31:26.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.612+0000 7f9d36ffd640 1 --2- 172.21.15.6:0/1696095831 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9d24066480 0x7f9d24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:26.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.616+0000 7f9d36ffd640 1 --2- 172.21.15.6:0/1696095831 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9d24066480 0x7f9d24068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9d380c5f50 tx=0x7f9d28009190 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:26.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.616+0000 7f9d1ffff640 1 -- 172.21.15.6:0/1696095831 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9d2c0eb170 con 0x7f9d380b0760 2023-07-21T22:31:26.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.796+0000 7f9d3d974640 1 -- 172.21.15.6:0/1696095831 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9d380c2740 con 0x7f9d24066480 2023-07-21T22:31:26.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.804+0000 7f9d1ffff640 1 -- 172.21.15.6:0/1696095831 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f9d380c2740 con 0x7f9d24066480 2023-07-21T22:31:26.854 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:26.854 INFO:teuthology.orchestra.run.smithi006.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:20:05", "first": "2023-07-21T22:21:00", "last": "2023-07-21T22:31:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-21T22:31:26.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.808+0000 7f9d3d974640 1 -- 172.21.15.6:0/1696095831 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9d24066480 msgr2=0x7f9d24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:26.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.808+0000 7f9d3d974640 1 --2- 172.21.15.6:0/1696095831 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9d24066480 0x7f9d24068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9d380c5f50 tx=0x7f9d28009190 comp rx=0 tx=0).stop 2023-07-21T22:31:26.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.808+0000 7f9d3d974640 1 -- 172.21.15.6:0/1696095831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d380b0760 msgr2=0x7f9d380b2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:26.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.808+0000 7f9d3d974640 1 --2- 172.21.15.6:0/1696095831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d380b0760 0x7f9d380b2a30 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c01ab60 tx=0x7f9d2c019250 comp rx=0 tx=0).stop 2023-07-21T22:31:26.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.808+0000 7f9d3d974640 1 -- 172.21.15.6:0/1696095831 shutdown_connections 2023-07-21T22:31:26.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.808+0000 7f9d3d974640 1 --2- 172.21.15.6:0/1696095831 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9d24066480 0x7f9d24068930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.808+0000 7f9d3d974640 1 --2- 172.21.15.6:0/1696095831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9d3815beb0 0x7f9d380b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.808+0000 7f9d3d974640 1 --2- 172.21.15.6:0/1696095831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d380b0760 0x7f9d380b2a30 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.808+0000 7f9d3d974640 1 --2- 172.21.15.6:0/1696095831 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9d3806db00 0x7f9d380b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:26.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.808+0000 7f9d3d974640 1 -- 172.21.15.6:0/1696095831 >> 172.21.15.6:0/1696095831 conn(0x7f9d3806c2f0 msgr2=0x7f9d380b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:26.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.808+0000 7f9d3d974640 1 -- 172.21.15.6:0/1696095831 shutdown_connections 2023-07-21T22:31:26.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:26.808+0000 7f9d3d974640 1 -- 172.21.15.6:0/1696095831 wait complete. 2023-07-21T22:31:26.874 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:20:05", "first": "2023-07-21T22:21:00", "last": "2023-07-21T22:31:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-21T22:31:26.875 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1M', 'retention': {}, 'start': '2023-07-21T00:00:00', 'created': '2023-07-21T22:20:05', 'first': '2023-07-21T22:21:00', 'last': '2023-07-21T22:31:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-21T22:31:26.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:26.876 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-07-21T22:31:26.887 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:26.887 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:26.888 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:26.888 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:26.888 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:26.888 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:26.889 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:26.889 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:26.889 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:26.889 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:26.890 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:26.891 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-21-22_21_00_UTC', 'scheduled-2023-07-21-22_22_00_UTC', 'scheduled-2023-07-21-22_23_00_UTC', 'scheduled-2023-07-21-22_24_00_UTC', 'scheduled-2023-07-21-22_25_00_UTC', 'scheduled-2023-07-21-22_26_00_UTC', 'scheduled-2023-07-21-22_27_00_UTC', 'scheduled-2023-07-21-22_28_00_UTC', 'scheduled-2023-07-21-22_29_00_UTC', 'scheduled-2023-07-21-22_30_00_UTC', 'scheduled-2023-07-21-22_31_00_UTC'] 2023-07-21T22:31:26.892 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir6 2023-07-21T22:31:27.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.036+0000 7f1824493640 1 Processor -- start 2023-07-21T22:31:27.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.036+0000 7f1824493640 1 -- start start 2023-07-21T22:31:27.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.040+0000 7f1824493640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f181c069430 0x7f181c0cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.040+0000 7f1824493640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f181c06d2d0 0x7f181c06d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.040+0000 7f1824493640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181c0cb7d0 con 0x7f181c160030 2023-07-21T22:31:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.040+0000 7f1824493640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f181c06c510 con 0x7f181c06d2d0 2023-07-21T22:31:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.040+0000 7f1824493640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f181c06c7f0 con 0x7f181c069430 2023-07-21T22:31:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.040+0000 7f1822a30640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f181c06d2d0 0x7f181c06d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:27.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.040+0000 7f1822a30640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f181c06d2d0 0x7f181c06d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46246/0 (socket says 172.21.15.6:46246) 2023-07-21T22:31:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.040+0000 7f1822a30640 1 -- 172.21.15.6:0/1481088398 learned_addr learned my addr 172.21.15.6:0/1481088398 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.040+0000 7f182222f640 1 --2- 172.21.15.6:0/1481088398 >> v2:172.21.15.161:3300/0 conn(0x7f181c069430 0x7f181c0cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:27.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.040+0000 7f1822a30640 1 -- 172.21.15.6:0/1481088398 >> v2:172.21.15.161:3300/0 conn(0x7f181c069430 msgr2=0x7f181c0cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:27.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.040+0000 7f1822a30640 1 --2- 172.21.15.6:0/1481088398 >> v2:172.21.15.161:3300/0 conn(0x7f181c069430 0x7f181c0cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.040+0000 7f1822a30640 1 -- 172.21.15.6:0/1481088398 >> v1:172.21.15.161:6789/0 conn(0x7f181c160030 legacy=0x7f181c069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:27.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.040+0000 7f1822a30640 1 -- 172.21.15.6:0/1481088398 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181c06cad0 con 0x7f181c06d2d0 2023-07-21T22:31:27.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.040+0000 7f182222f640 1 --2- 172.21.15.6:0/1481088398 >> v2:172.21.15.161:3300/0 conn(0x7f181c069430 0x7f181c0cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:27.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.044+0000 7f1822a30640 1 --2- 172.21.15.6:0/1481088398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f181c06d2d0 0x7f181c06d6f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f181c06eee0 tx=0x7f181401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e936ddfd7d78a522 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:27.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.044+0000 7f182122d640 1 -- 172.21.15.6:0/1481088398 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18140a56f0 con 0x7f181c06d2d0 2023-07-21T22:31:27.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.044+0000 7f182122d640 1 -- 172.21.15.6:0/1481088398 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18140a5850 con 0x7f181c06d2d0 2023-07-21T22:31:27.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.044+0000 7f182122d640 1 -- 172.21.15.6:0/1481088398 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18140a5be0 con 0x7f181c06d2d0 2023-07-21T22:31:27.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.044+0000 7f1824493640 1 -- 172.21.15.6:0/1481088398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f181c06d2d0 msgr2=0x7f181c06d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:27.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.044+0000 7f1824493640 1 --2- 172.21.15.6:0/1481088398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f181c06d2d0 0x7f181c06d6f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f181c06eee0 tx=0x7f181401c910 comp rx=0 tx=0).stop 2023-07-21T22:31:27.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.044+0000 7f1824493640 1 -- 172.21.15.6:0/1481088398 shutdown_connections 2023-07-21T22:31:27.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.044+0000 7f1824493640 1 --2- 172.21.15.6:0/1481088398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f181c06d2d0 0x7f181c06d6f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.044+0000 7f1824493640 1 --2- 172.21.15.6:0/1481088398 >> v2:172.21.15.161:3300/0 conn(0x7f181c069430 0x7f181c0cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.044+0000 7f1824493640 1 -- 172.21.15.6:0/1481088398 >> 172.21.15.6:0/1481088398 conn(0x7f181c0b1840 msgr2=0x7f181c0cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:27.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.044+0000 7f1824493640 1 -- 172.21.15.6:0/1481088398 shutdown_connections 2023-07-21T22:31:27.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.044+0000 7f1824493640 1 -- 172.21.15.6:0/1481088398 wait complete. 2023-07-21T22:31:27.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.044+0000 7f1824493640 1 Processor -- start 2023-07-21T22:31:27.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.044+0000 7f1824493640 1 -- start start 2023-07-21T22:31:27.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1824493640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f181c069430 0x7f181c14b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:27.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1824493640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f181c06d2d0 0x7f181c159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:27.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1824493640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f181c160030 0x7f181c15a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:27.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1824493640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c14b7a0 con 0x7f181c160030 2023-07-21T22:31:27.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1824493640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181c0c8300 con 0x7f181c069430 2023-07-21T22:31:27.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1824493640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181c0c85e0 con 0x7f181c06d2d0 2023-07-21T22:31:27.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1822a30640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f181c160030 0x7f181c15a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:27.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1822a30640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f181c160030 0x7f181c15a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46258/0 (socket says 172.21.15.6:46258) 2023-07-21T22:31:27.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1822a30640 1 -- 172.21.15.6:0/2893189653 learned_addr learned my addr 172.21.15.6:0/2893189653 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:27.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f182222f640 1 --2- 172.21.15.6:0/2893189653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f181c069430 0x7f181c14b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:27.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1821a2e640 1 --2- 172.21.15.6:0/2893189653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f181c06d2d0 0x7f181c159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:27.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1822a30640 1 -- 172.21.15.6:0/2893189653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f181c06d2d0 msgr2=0x7f181c159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:27.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1822a30640 1 --2- 172.21.15.6:0/2893189653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f181c06d2d0 0x7f181c159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1822a30640 1 -- 172.21.15.6:0/2893189653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f181c069430 msgr2=0x7f181c14b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:27.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1822a30640 1 --2- 172.21.15.6:0/2893189653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f181c069430 0x7f181c14b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1822a30640 1 -- 172.21.15.6:0/2893189653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1814009b30 con 0x7f181c160030 2023-07-21T22:31:27.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1822a30640 1 --2- 172.21.15.6:0/2893189653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f181c160030 0x7f181c15a350 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f18140af040 tx=0x7f18140196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:27.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1812ffd640 1 -- 172.21.15.6:0/2893189653 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18140b8670 con 0x7f181c160030 2023-07-21T22:31:27.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1812ffd640 1 -- 172.21.15.6:0/2893189653 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18140b87d0 con 0x7f181c160030 2023-07-21T22:31:27.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1812ffd640 1 -- 172.21.15.6:0/2893189653 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18140b8b80 con 0x7f181c160030 2023-07-21T22:31:27.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1824493640 1 -- 172.21.15.6:0/2893189653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181c152ff0 con 0x7f181c160030 2023-07-21T22:31:27.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1824493640 1 -- 172.21.15.6:0/2893189653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181c1535b0 con 0x7f181c160030 2023-07-21T22:31:27.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1824493640 1 -- 172.21.15.6:0/2893189653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f181c0678d0 con 0x7f181c160030 2023-07-21T22:31:27.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.048+0000 7f1812ffd640 1 -- 172.21.15.6:0/2893189653 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f18140b8ce0 con 0x7f181c160030 2023-07-21T22:31:27.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.052+0000 7f1812ffd640 1 --2- 172.21.15.6:0/2893189653 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1800066480 0x7f1800068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:27.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.052+0000 7f1812ffd640 1 -- 172.21.15.6:0/2893189653 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f181411f690 con 0x7f181c160030 2023-07-21T22:31:27.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.052+0000 7f182222f640 1 --2- 172.21.15.6:0/2893189653 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1800066480 0x7f1800068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:27.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.052+0000 7f182222f640 1 --2- 172.21.15.6:0/2893189653 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1800066480 0x7f1800068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1818009950 tx=0x7f1818008040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:27.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.056+0000 7f1812ffd640 1 -- 172.21.15.6:0/2893189653 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f18140ec820 con 0x7f181c160030 2023-07-21T22:31:27.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.232+0000 7f1824493640 1 -- 172.21.15.6:0/2893189653 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f181c0c8470 con 0x7f1800066480 2023-07-21T22:31:27.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.244+0000 7f1812ffd640 1 -- 172.21.15.6:0/2893189653 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f181c0c8470 con 0x7f1800066480 2023-07-21T22:31:27.291 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:27.292 INFO:teuthology.orchestra.run.smithi006.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:20:06", "first": "2023-07-21T22:21:00", "last": "2023-07-21T22:31:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-21T22:31:27.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.244+0000 7f1824493640 1 -- 172.21.15.6:0/2893189653 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1800066480 msgr2=0x7f1800068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:27.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.244+0000 7f1824493640 1 --2- 172.21.15.6:0/2893189653 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1800066480 0x7f1800068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1818009950 tx=0x7f1818008040 comp rx=0 tx=0).stop 2023-07-21T22:31:27.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.244+0000 7f1824493640 1 -- 172.21.15.6:0/2893189653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f181c160030 msgr2=0x7f181c15a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:27.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.244+0000 7f1824493640 1 --2- 172.21.15.6:0/2893189653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f181c160030 0x7f181c15a350 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f18140af040 tx=0x7f18140196b0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.244+0000 7f1824493640 1 -- 172.21.15.6:0/2893189653 shutdown_connections 2023-07-21T22:31:27.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.244+0000 7f1824493640 1 --2- 172.21.15.6:0/2893189653 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1800066480 0x7f1800068930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.244+0000 7f1824493640 1 --2- 172.21.15.6:0/2893189653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f181c160030 0x7f181c15a350 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.244+0000 7f1824493640 1 --2- 172.21.15.6:0/2893189653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f181c06d2d0 0x7f181c159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.244+0000 7f1824493640 1 --2- 172.21.15.6:0/2893189653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f181c069430 0x7f181c14b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.244+0000 7f1824493640 1 -- 172.21.15.6:0/2893189653 >> 172.21.15.6:0/2893189653 conn(0x7f181c0b1840 msgr2=0x7f181c069800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:27.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.244+0000 7f1824493640 1 -- 172.21.15.6:0/2893189653 shutdown_connections 2023-07-21T22:31:27.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.244+0000 7f1824493640 1 -- 172.21.15.6:0/2893189653 wait complete. 2023-07-21T22:31:27.311 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:20:06", "first": "2023-07-21T22:21:00", "last": "2023-07-21T22:31:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-21T22:31:27.312 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1M', 'retention': {}, 'start': '2023-07-21T00:00:00', 'created': '2023-07-21T22:20:06', 'first': '2023-07-21T22:21:00', 'last': '2023-07-21T22:31:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-21T22:31:27.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:27.313 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-07-21T22:31:27.323 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:27.323 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:27.323 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:27.323 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:27.324 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:27.324 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:27.324 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:27.324 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:27.324 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:27.324 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:27.325 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:27.325 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-21-22_21_00_UTC', 'scheduled-2023-07-21-22_22_00_UTC', 'scheduled-2023-07-21-22_23_00_UTC', 'scheduled-2023-07-21-22_24_00_UTC', 'scheduled-2023-07-21-22_25_00_UTC', 'scheduled-2023-07-21-22_26_00_UTC', 'scheduled-2023-07-21-22_27_00_UTC', 'scheduled-2023-07-21-22_28_00_UTC', 'scheduled-2023-07-21-22_29_00_UTC', 'scheduled-2023-07-21-22_30_00_UTC', 'scheduled-2023-07-21-22_31_00_UTC'] 2023-07-21T22:31:27.326 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir7 2023-07-21T22:31:27.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.464+0000 7f1460d2c640 1 Processor -- start 2023-07-21T22:31:27.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.464+0000 7f1460d2c640 1 -- start start 2023-07-21T22:31:27.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.464+0000 7f1460d2c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f145c069430 0x7f145c069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:27.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.464+0000 7f1460d2c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f145c0af2b0 0x7f145c15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:27.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.464+0000 7f1460d2c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f145c159d70 con 0x7f145c070f30 2023-07-21T22:31:27.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.464+0000 7f1460d2c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f145c069d40 con 0x7f145c069430 2023-07-21T22:31:27.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.464+0000 7f1460d2c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f145c0c9c60 con 0x7f145c0af2b0 2023-07-21T22:31:27.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.468+0000 7f145a59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f145c069430 0x7f145c069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:27.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.468+0000 7f1453fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f145c070f30 0x7f145c0ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35312/0 (socket says 172.21.15.6:35312) 2023-07-21T22:31:27.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.468+0000 7f1453fff640 1 -- 172.21.15.6:0/1858350703 learned_addr learned my addr 172.21.15.6:0/1858350703 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:27.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.468+0000 7f145ad9d640 1 --2- 172.21.15.6:0/1858350703 >> v2:172.21.15.161:3300/0 conn(0x7f145c0af2b0 0x7f145c15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:27.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.468+0000 7f145a59c640 1 -- 172.21.15.6:0/1858350703 >> v2:172.21.15.161:3300/0 conn(0x7f145c0af2b0 msgr2=0x7f145c15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:27.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.468+0000 7f145a59c640 1 --2- 172.21.15.6:0/1858350703 >> v2:172.21.15.161:3300/0 conn(0x7f145c0af2b0 0x7f145c15a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.468+0000 7f145a59c640 1 -- 172.21.15.6:0/1858350703 >> v1:172.21.15.6:6789/0 conn(0x7f145c070f30 legacy=0x7f145c0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:27.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.468+0000 7f145a59c640 1 -- 172.21.15.6:0/1858350703 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c0c9f40 con 0x7f145c069430 2023-07-21T22:31:27.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.468+0000 7f145a59c640 1 --2- 172.21.15.6:0/1858350703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f145c069430 0x7f145c069800 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f145c0cef70 tx=0x7f144c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f625a3666995fb1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:27.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.468+0000 7f1459d9b640 1 -- 172.21.15.6:0/1858350703 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c0ab600 con 0x7f145c069430 2023-07-21T22:31:27.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.468+0000 7f1459d9b640 1 -- 172.21.15.6:0/1858350703 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144c0a7050 con 0x7f145c069430 2023-07-21T22:31:27.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.468+0000 7f1459d9b640 1 -- 172.21.15.6:0/1858350703 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c0ab980 con 0x7f145c069430 2023-07-21T22:31:27.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1460d2c640 1 -- 172.21.15.6:0/1858350703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f145c069430 msgr2=0x7f145c069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:27.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1460d2c640 1 --2- 172.21.15.6:0/1858350703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f145c069430 0x7f145c069800 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f145c0cef70 tx=0x7f144c01c460 comp rx=0 tx=0).stop 2023-07-21T22:31:27.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1460d2c640 1 -- 172.21.15.6:0/1858350703 shutdown_connections 2023-07-21T22:31:27.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1460d2c640 1 --2- 172.21.15.6:0/1858350703 >> v2:172.21.15.161:3300/0 conn(0x7f145c0af2b0 0x7f145c15a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1460d2c640 1 --2- 172.21.15.6:0/1858350703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f145c069430 0x7f145c069800 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1460d2c640 1 -- 172.21.15.6:0/1858350703 >> 172.21.15.6:0/1858350703 conn(0x7f145c0cde90 msgr2=0x7f145c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:27.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1460d2c640 1 -- 172.21.15.6:0/1858350703 shutdown_connections 2023-07-21T22:31:27.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1460d2c640 1 -- 172.21.15.6:0/1858350703 wait complete. 2023-07-21T22:31:27.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1460d2c640 1 Processor -- start 2023-07-21T22:31:27.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1460d2c640 1 -- start start 2023-07-21T22:31:27.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1460d2c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f145c069430 0x7f145c14dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:27.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1460d2c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f145c070f30 0x7f145c0cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:27.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1460d2c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f145c0af2b0 0x7f145c06b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:27.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1460d2c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c14e100 con 0x7f145c070f30 2023-07-21T22:31:27.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1460d2c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c0cbc00 con 0x7f145c069430 2023-07-21T22:31:27.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1460d2c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145c0cbee0 con 0x7f145c0af2b0 2023-07-21T22:31:27.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1453fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f145c070f30 0x7f145c0cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:27.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1453fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f145c070f30 0x7f145c0cb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58796/0 (socket says 172.21.15.6:58796) 2023-07-21T22:31:27.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1453fff640 1 -- 172.21.15.6:0/339408872 learned_addr learned my addr 172.21.15.6:0/339408872 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:27.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f145a59c640 1 --2- 172.21.15.6:0/339408872 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f145c069430 0x7f145c14dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:27.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f145ad9d640 1 --2- 172.21.15.6:0/339408872 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f145c0af2b0 0x7f145c06b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:27.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1453fff640 1 -- 172.21.15.6:0/339408872 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f145c0af2b0 msgr2=0x7f145c06b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:27.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1453fff640 1 --2- 172.21.15.6:0/339408872 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f145c0af2b0 0x7f145c06b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1453fff640 1 -- 172.21.15.6:0/339408872 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f145c069430 msgr2=0x7f145c14dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:27.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1453fff640 1 --2- 172.21.15.6:0/339408872 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f145c069430 0x7f145c14dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f1453fff640 1 -- 172.21.15.6:0/339408872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144c009420 con 0x7f145c070f30 2023-07-21T22:31:27.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.472+0000 7f145ad9d640 1 --2- 172.21.15.6:0/339408872 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f145c0af2b0 0x7f145c06b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:27.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.476+0000 7f1453fff640 1 --2- 172.21.15.6:0/339408872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f145c070f30 0x7f145c0cb240 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f144400c500 tx=0x7f144400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:27.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.476+0000 7f1452ffd640 1 -- 172.21.15.6:0/339408872 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444005cf0 con 0x7f145c070f30 2023-07-21T22:31:27.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.476+0000 7f1452ffd640 1 -- 172.21.15.6:0/339408872 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1444005e50 con 0x7f145c070f30 2023-07-21T22:31:27.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.476+0000 7f1460d2c640 1 -- 172.21.15.6:0/339408872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145c0cc1c0 con 0x7f145c070f30 2023-07-21T22:31:27.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.476+0000 7f1452ffd640 1 -- 172.21.15.6:0/339408872 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14440072f0 con 0x7f145c070f30 2023-07-21T22:31:27.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.476+0000 7f1460d2c640 1 -- 172.21.15.6:0/339408872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145c1f5770 con 0x7f145c070f30 2023-07-21T22:31:27.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.476+0000 7f1460d2c640 1 -- 172.21.15.6:0/339408872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145c06d100 con 0x7f145c070f30 2023-07-21T22:31:27.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.476+0000 7f1452ffd640 1 -- 172.21.15.6:0/339408872 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f1444007450 con 0x7f145c070f30 2023-07-21T22:31:27.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.476+0000 7f1452ffd640 1 --2- 172.21.15.6:0/339408872 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f143c066480 0x7f143c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:27.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.476+0000 7f1452ffd640 1 -- 172.21.15.6:0/339408872 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f1444083450 con 0x7f145c070f30 2023-07-21T22:31:27.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.480+0000 7f145a59c640 1 --2- 172.21.15.6:0/339408872 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f143c066480 0x7f143c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:27.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.480+0000 7f145a59c640 1 --2- 172.21.15.6:0/339408872 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f143c066480 0x7f143c068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f144c0ad000 tx=0x7f144c0a6000 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:27.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.480+0000 7f1452ffd640 1 -- 172.21.15.6:0/339408872 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14440506a0 con 0x7f145c070f30 2023-07-21T22:31:27.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.656+0000 7f1460d2c640 1 -- 172.21.15.6:0/339408872 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f145c157710 con 0x7f143c066480 2023-07-21T22:31:27.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.664+0000 7f1452ffd640 1 -- 172.21.15.6:0/339408872 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f144c0ab660 con 0x7f143c066480 2023-07-21T22:31:27.714 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:27.714 INFO:teuthology.orchestra.run.smithi006.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:20:06", "first": "2023-07-21T22:21:00", "last": "2023-07-21T22:31:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-21T22:31:27.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.668+0000 7f1460d2c640 1 -- 172.21.15.6:0/339408872 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f143c066480 msgr2=0x7f143c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:27.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.668+0000 7f1460d2c640 1 --2- 172.21.15.6:0/339408872 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f143c066480 0x7f143c068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f144c0ad000 tx=0x7f144c0a6000 comp rx=0 tx=0).stop 2023-07-21T22:31:27.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.668+0000 7f1460d2c640 1 -- 172.21.15.6:0/339408872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f145c070f30 msgr2=0x7f145c0cb240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:27.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.668+0000 7f1460d2c640 1 --2- 172.21.15.6:0/339408872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f145c070f30 0x7f145c0cb240 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f144400c500 tx=0x7f144400c9c0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.668+0000 7f1460d2c640 1 -- 172.21.15.6:0/339408872 shutdown_connections 2023-07-21T22:31:27.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.668+0000 7f1460d2c640 1 --2- 172.21.15.6:0/339408872 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f143c066480 0x7f143c068930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.668+0000 7f1460d2c640 1 --2- 172.21.15.6:0/339408872 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f145c0af2b0 0x7f145c06b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.668+0000 7f1460d2c640 1 --2- 172.21.15.6:0/339408872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f145c070f30 0x7f145c0cb240 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.668+0000 7f1460d2c640 1 --2- 172.21.15.6:0/339408872 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f145c069430 0x7f145c14dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.668+0000 7f1460d2c640 1 -- 172.21.15.6:0/339408872 >> 172.21.15.6:0/339408872 conn(0x7f145c0cde90 msgr2=0x7f145c0adf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:27.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.668+0000 7f1460d2c640 1 -- 172.21.15.6:0/339408872 shutdown_connections 2023-07-21T22:31:27.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.668+0000 7f1460d2c640 1 -- 172.21.15.6:0/339408872 wait complete. 2023-07-21T22:31:27.735 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:20:06", "first": "2023-07-21T22:21:00", "last": "2023-07-21T22:31:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-21T22:31:27.735 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1M', 'retention': {}, 'start': '2023-07-21T00:00:00', 'created': '2023-07-21T22:20:06', 'first': '2023-07-21T22:21:00', 'last': '2023-07-21T22:31:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-21T22:31:27.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:27.736 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-07-21T22:31:27.746 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:27.746 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:27.747 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:27.747 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:27.747 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:27.747 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:27.747 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:27.747 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:27.747 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:27.748 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:27.748 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:27.749 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-21-22_21_00_UTC', 'scheduled-2023-07-21-22_22_00_UTC', 'scheduled-2023-07-21-22_23_00_UTC', 'scheduled-2023-07-21-22_24_00_UTC', 'scheduled-2023-07-21-22_25_00_UTC', 'scheduled-2023-07-21-22_26_00_UTC', 'scheduled-2023-07-21-22_27_00_UTC', 'scheduled-2023-07-21-22_28_00_UTC', 'scheduled-2023-07-21-22_29_00_UTC', 'scheduled-2023-07-21-22_30_00_UTC', 'scheduled-2023-07-21-22_31_00_UTC'] 2023-07-21T22:31:27.749 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir8 2023-07-21T22:31:27.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.892+0000 7fed06540640 1 Processor -- start 2023-07-21T22:31:27.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.892+0000 7fed06540640 1 -- start start 2023-07-21T22:31:27.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.896+0000 7fed06540640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed0015f690 0x7fed000b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.896+0000 7fed06540640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed001453a0 0x7fed0015fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.896+0000 7fed06540640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0006c040 con 0x7fed0006c4d0 2023-07-21T22:31:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.896+0000 7fed06540640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed00160600 con 0x7fed0015f690 2023-07-21T22:31:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.896+0000 7fed06540640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed00160360 con 0x7fed001453a0 2023-07-21T22:31:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.896+0000 7fecfffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed0015f690 0x7fed000b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.896+0000 7fecfffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed0015f690 0x7fed000b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58808/0 (socket says 172.21.15.6:58808) 2023-07-21T22:31:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.896+0000 7fecfffff640 1 -- 172.21.15.6:0/2722847970 learned_addr learned my addr 172.21.15.6:0/2722847970 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.896+0000 7fecff7fe640 1 --2- 172.21.15.6:0/2722847970 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed001453a0 0x7fed0015fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.896+0000 7fecfffff640 1 -- 172.21.15.6:0/2722847970 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed001453a0 msgr2=0x7fed0015fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.896+0000 7fecfffff640 1 --2- 172.21.15.6:0/2722847970 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed001453a0 0x7fed0015fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.896+0000 7fecfffff640 1 -- 172.21.15.6:0/2722847970 >> v1:172.21.15.161:6789/0 conn(0x7fed0006c4d0 legacy=0x7fed0006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:27.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.896+0000 7fecfffff640 1 -- 172.21.15.6:0/2722847970 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0006b9f0 con 0x7fed0015f690 2023-07-21T22:31:27.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.900+0000 7fecfffff640 1 --2- 172.21.15.6:0/2722847970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed0015f690 0x7fed000b1890 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fecf0009870 tx=0x7fecf001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb13c081cf7373c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:27.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.900+0000 7fecfeffd640 1 -- 172.21.15.6:0/2722847970 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf00ad640 con 0x7fed0015f690 2023-07-21T22:31:27.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.900+0000 7fecfeffd640 1 -- 172.21.15.6:0/2722847970 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf00ad7a0 con 0x7fed0015f690 2023-07-21T22:31:27.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.900+0000 7fecfeffd640 1 -- 172.21.15.6:0/2722847970 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf00adb30 con 0x7fed0015f690 2023-07-21T22:31:27.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.900+0000 7fed06540640 1 -- 172.21.15.6:0/2722847970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed0015f690 msgr2=0x7fed000b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:27.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.900+0000 7fed06540640 1 --2- 172.21.15.6:0/2722847970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed0015f690 0x7fed000b1890 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fecf0009870 tx=0x7fecf001c480 comp rx=0 tx=0).stop 2023-07-21T22:31:27.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.900+0000 7fed06540640 1 -- 172.21.15.6:0/2722847970 shutdown_connections 2023-07-21T22:31:27.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.900+0000 7fed06540640 1 --2- 172.21.15.6:0/2722847970 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed001453a0 0x7fed0015fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.900+0000 7fed06540640 1 --2- 172.21.15.6:0/2722847970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed0015f690 0x7fed000b1890 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.900+0000 7fed06540640 1 -- 172.21.15.6:0/2722847970 >> 172.21.15.6:0/2722847970 conn(0x7fed000b1210 msgr2=0x7fed000ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:27.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.900+0000 7fed06540640 1 -- 172.21.15.6:0/2722847970 shutdown_connections 2023-07-21T22:31:27.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.900+0000 7fed06540640 1 -- 172.21.15.6:0/2722847970 wait complete. 2023-07-21T22:31:27.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.900+0000 7fed06540640 1 Processor -- start 2023-07-21T22:31:27.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.900+0000 7fed06540640 1 -- start start 2023-07-21T22:31:27.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fed06540640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed0006c4d0 0x7fed0013cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:27.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fed06540640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed001453a0 0x7fed00143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fed06540640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed0015f690 0x7fed0015e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fed06540640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed00144500 con 0x7fed001453a0 2023-07-21T22:31:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fed06540640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0015e870 con 0x7fed0015f690 2023-07-21T22:31:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fed06540640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed001f8d60 con 0x7fed0006c4d0 2023-07-21T22:31:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fecff7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed001453a0 0x7fed00143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fecff7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed001453a0 0x7fed00143fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58812/0 (socket says 172.21.15.6:58812) 2023-07-21T22:31:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fecff7fe640 1 -- 172.21.15.6:0/796082745 learned_addr learned my addr 172.21.15.6:0/796082745 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:27.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fecfffff640 1 --2- 172.21.15.6:0/796082745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed0006c4d0 0x7fed0013cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:27.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fed04add640 1 --2- 172.21.15.6:0/796082745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed0015f690 0x7fed0015e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:27.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fecff7fe640 1 -- 172.21.15.6:0/796082745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed0006c4d0 msgr2=0x7fed0013cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:27.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fecff7fe640 1 --2- 172.21.15.6:0/796082745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed0006c4d0 0x7fed0013cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fecff7fe640 1 -- 172.21.15.6:0/796082745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed0015f690 msgr2=0x7fed0015e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:27.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fecff7fe640 1 --2- 172.21.15.6:0/796082745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed0015f690 0x7fed0015e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:27.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fecff7fe640 1 -- 172.21.15.6:0/796082745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf00094d0 con 0x7fed001453a0 2023-07-21T22:31:27.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fecfffff640 1 --2- 172.21.15.6:0/796082745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed0006c4d0 0x7fed0013cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:27.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fecff7fe640 1 --2- 172.21.15.6:0/796082745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed001453a0 0x7fed00143fc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fecf400e8a0 tx=0x7fecf400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:27.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fecfcff9640 1 -- 172.21.15.6:0/796082745 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf4009510 con 0x7fed001453a0 2023-07-21T22:31:27.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fecfcff9640 1 -- 172.21.15.6:0/796082745 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf400c940 con 0x7fed001453a0 2023-07-21T22:31:27.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fecfcff9640 1 -- 172.21.15.6:0/796082745 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf400ccb0 con 0x7fed001453a0 2023-07-21T22:31:27.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fed06540640 1 -- 172.21.15.6:0/796082745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed001f9040 con 0x7fed001453a0 2023-07-21T22:31:27.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fed06540640 1 -- 172.21.15.6:0/796082745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed001f9600 con 0x7fed001453a0 2023-07-21T22:31:27.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.904+0000 7fed06540640 1 -- 172.21.15.6:0/796082745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed000678d0 con 0x7fed001453a0 2023-07-21T22:31:27.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.908+0000 7fecfcff9640 1 -- 172.21.15.6:0/796082745 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fecf4013470 con 0x7fed001453a0 2023-07-21T22:31:27.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.908+0000 7fecfcff9640 1 --2- 172.21.15.6:0/796082745 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fecec066480 0x7fecec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:27.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.908+0000 7fecfcff9640 1 -- 172.21.15.6:0/796082745 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fecf40840a0 con 0x7fed001453a0 2023-07-21T22:31:27.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.908+0000 7fecfffff640 1 --2- 172.21.15.6:0/796082745 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fecec066480 0x7fecec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:27.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.908+0000 7fecfffff640 1 --2- 172.21.15.6:0/796082745 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fecec066480 0x7fecec068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fecf00af000 tx=0x7fecf0009040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:27.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:27.912+0000 7fecfcff9640 1 -- 172.21.15.6:0/796082745 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fecf4051370 con 0x7fed001453a0 2023-07-21T22:31:28.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.084+0000 7fed06540640 1 -- 172.21.15.6:0/796082745 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed00144fe0 con 0x7fecec066480 2023-07-21T22:31:28.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.092+0000 7fecfcff9640 1 -- 172.21.15.6:0/796082745 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fecf00a6040 con 0x7fecec066480 2023-07-21T22:31:28.144 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:28.144 INFO:teuthology.orchestra.run.smithi006.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:20:07", "first": "2023-07-21T22:21:00", "last": "2023-07-21T22:31:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-21T22:31:28.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.096+0000 7fed06540640 1 -- 172.21.15.6:0/796082745 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fecec066480 msgr2=0x7fecec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:28.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.096+0000 7fed06540640 1 --2- 172.21.15.6:0/796082745 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fecec066480 0x7fecec068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fecf00af000 tx=0x7fecf0009040 comp rx=0 tx=0).stop 2023-07-21T22:31:28.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.096+0000 7fed06540640 1 -- 172.21.15.6:0/796082745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed001453a0 msgr2=0x7fed00143fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:28.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.096+0000 7fed06540640 1 --2- 172.21.15.6:0/796082745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed001453a0 0x7fed00143fc0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fecf400e8a0 tx=0x7fecf400eca0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.096+0000 7fed06540640 1 -- 172.21.15.6:0/796082745 shutdown_connections 2023-07-21T22:31:28.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.096+0000 7fed06540640 1 --2- 172.21.15.6:0/796082745 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fecec066480 0x7fecec068930 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.096+0000 7fed06540640 1 --2- 172.21.15.6:0/796082745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed0015f690 0x7fed0015e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.096+0000 7fed06540640 1 --2- 172.21.15.6:0/796082745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed001453a0 0x7fed00143fc0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.096+0000 7fed06540640 1 --2- 172.21.15.6:0/796082745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed0006c4d0 0x7fed0013cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.096+0000 7fed06540640 1 -- 172.21.15.6:0/796082745 >> 172.21.15.6:0/796082745 conn(0x7fed000b1210 msgr2=0x7fed000cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:28.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.096+0000 7fed06540640 1 -- 172.21.15.6:0/796082745 shutdown_connections 2023-07-21T22:31:28.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.096+0000 7fed06540640 1 -- 172.21.15.6:0/796082745 wait complete. 2023-07-21T22:31:28.163 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:20:07", "first": "2023-07-21T22:21:00", "last": "2023-07-21T22:31:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-21T22:31:28.163 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1M', 'retention': {}, 'start': '2023-07-21T00:00:00', 'created': '2023-07-21T22:20:07', 'first': '2023-07-21T22:21:00', 'last': '2023-07-21T22:31:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-21T22:31:28.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:28.164 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-07-21T22:31:28.175 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:28.175 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:28.175 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:28.175 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:28.175 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:28.176 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:28.176 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:28.176 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:28.176 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:28.176 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:28.176 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:28.177 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-21-22_21_00_UTC', 'scheduled-2023-07-21-22_22_00_UTC', 'scheduled-2023-07-21-22_23_00_UTC', 'scheduled-2023-07-21-22_24_00_UTC', 'scheduled-2023-07-21-22_25_00_UTC', 'scheduled-2023-07-21-22_26_00_UTC', 'scheduled-2023-07-21-22_27_00_UTC', 'scheduled-2023-07-21-22_28_00_UTC', 'scheduled-2023-07-21-22_29_00_UTC', 'scheduled-2023-07-21-22_30_00_UTC', 'scheduled-2023-07-21-22_31_00_UTC'] 2023-07-21T22:31:28.177 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir9 2023-07-21T22:31:28.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.316+0000 7fcf16574640 1 Processor -- start 2023-07-21T22:31:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.316+0000 7fcf16574640 1 -- start start 2023-07-21T22:31:28.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.320+0000 7fcf16574640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcf100cba60 0x7fcf100c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:28.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.320+0000 7fcf16574640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf1015b9c0 0x7fcf100cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:28.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.320+0000 7fcf16574640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcf10158090 0x7fcf10158510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:28.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.320+0000 7fcf16574640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf100cc370 con 0x7fcf10158090 2023-07-21T22:31:28.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.320+0000 7fcf16574640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf100c37e0 con 0x7fcf100cba60 2023-07-21T22:31:28.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.320+0000 7fcf16574640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf100c3ac0 con 0x7fcf1015b9c0 2023-07-21T22:31:28.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.320+0000 7fcf14b11640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcf10158090 0x7fcf10158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:28.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.320+0000 7fcf14b11640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcf10158090 0x7fcf10158510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58820/0 (socket says 172.21.15.6:58820) 2023-07-21T22:31:28.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.320+0000 7fcf14b11640 1 -- 172.21.15.6:0/1733014810 learned_addr learned my addr 172.21.15.6:0/1733014810 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:28.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.320+0000 7fcf0f7fe640 1 --2- 172.21.15.6:0/1733014810 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf1015b9c0 0x7fcf100cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:28.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.320+0000 7fcf0ffff640 1 --2- 172.21.15.6:0/1733014810 >> v2:172.21.15.161:3300/0 conn(0x7fcf100cba60 0x7fcf100c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:28.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.320+0000 7fcf14b11640 1 -- 172.21.15.6:0/1733014810 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf1015b9c0 msgr2=0x7fcf100cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:28.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.320+0000 7fcf14b11640 1 --2- 172.21.15.6:0/1733014810 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf1015b9c0 0x7fcf100cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.320+0000 7fcf14b11640 1 -- 172.21.15.6:0/1733014810 >> v2:172.21.15.161:3300/0 conn(0x7fcf100cba60 msgr2=0x7fcf100c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:28.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.320+0000 7fcf14b11640 1 --2- 172.21.15.6:0/1733014810 >> v2:172.21.15.161:3300/0 conn(0x7fcf100cba60 0x7fcf100c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.320+0000 7fcf14b11640 1 -- 172.21.15.6:0/1733014810 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf100c3da0 con 0x7fcf10158090 2023-07-21T22:31:28.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.324+0000 7fcf14b11640 1 --2- 172.21.15.6:0/1733014810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10158090 0x7fcf10158510 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcf100cba10 tx=0x7fcf0801ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15f8020c42f01bc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:28.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.324+0000 7fcf0effd640 1 -- 172.21.15.6:0/1733014810 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0800b2d0 con 0x7fcf10158090 2023-07-21T22:31:28.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.324+0000 7fcf0effd640 1 -- 172.21.15.6:0/1733014810 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0800b430 con 0x7fcf10158090 2023-07-21T22:31:28.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.324+0000 7fcf0effd640 1 -- 172.21.15.6:0/1733014810 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf080a7a90 con 0x7fcf10158090 2023-07-21T22:31:28.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.324+0000 7fcf16574640 1 -- 172.21.15.6:0/1733014810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10158090 msgr2=0x7fcf10158510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:28.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.324+0000 7fcf16574640 1 --2- 172.21.15.6:0/1733014810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10158090 0x7fcf10158510 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcf100cba10 tx=0x7fcf0801ea80 comp rx=0 tx=0).stop 2023-07-21T22:31:28.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.324+0000 7fcf16574640 1 -- 172.21.15.6:0/1733014810 shutdown_connections 2023-07-21T22:31:28.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.324+0000 7fcf16574640 1 --2- 172.21.15.6:0/1733014810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf10158090 0x7fcf10158510 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.324+0000 7fcf16574640 1 --2- 172.21.15.6:0/1733014810 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf1015b9c0 0x7fcf100cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.324+0000 7fcf16574640 1 --2- 172.21.15.6:0/1733014810 >> v2:172.21.15.161:3300/0 conn(0x7fcf100cba60 0x7fcf100c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.324+0000 7fcf16574640 1 -- 172.21.15.6:0/1733014810 >> 172.21.15.6:0/1733014810 conn(0x7fcf100cde90 msgr2=0x7fcf100ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:28.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.324+0000 7fcf16574640 1 -- 172.21.15.6:0/1733014810 shutdown_connections 2023-07-21T22:31:28.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.324+0000 7fcf16574640 1 -- 172.21.15.6:0/1733014810 wait complete. 2023-07-21T22:31:28.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.324+0000 7fcf16574640 1 Processor -- start 2023-07-21T22:31:28.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.324+0000 7fcf16574640 1 -- start start 2023-07-21T22:31:28.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf16574640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf100cba60 0x7fcf1013f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:28.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf16574640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf10158090 0x7fcf10162100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:28.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf16574640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf1015b9c0 0x7fcf10162640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:28.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf16574640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf100c5be0 con 0x7fcf100cba60 2023-07-21T22:31:28.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf16574640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1014bf10 con 0x7fcf10158090 2023-07-21T22:31:28.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf16574640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf100c4f60 con 0x7fcf1015b9c0 2023-07-21T22:31:28.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf0ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf100cba60 0x7fcf1013f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:28.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf0ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf100cba60 0x7fcf1013f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58828/0 (socket says 172.21.15.6:58828) 2023-07-21T22:31:28.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf0ffff640 1 -- 172.21.15.6:0/1266107050 learned_addr learned my addr 172.21.15.6:0/1266107050 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:28.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf0f7fe640 1 --2- 172.21.15.6:0/1266107050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf10158090 0x7fcf10162100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:28.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf14b11640 1 --2- 172.21.15.6:0/1266107050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf1015b9c0 0x7fcf10162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:28.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf0ffff640 1 -- 172.21.15.6:0/1266107050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf1015b9c0 msgr2=0x7fcf10162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:28.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf0ffff640 1 --2- 172.21.15.6:0/1266107050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf1015b9c0 0x7fcf10162640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf0ffff640 1 -- 172.21.15.6:0/1266107050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf10158090 msgr2=0x7fcf10162100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:28.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf0ffff640 1 --2- 172.21.15.6:0/1266107050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf10158090 0x7fcf10162100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf0ffff640 1 -- 172.21.15.6:0/1266107050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0800bd40 con 0x7fcf100cba60 2023-07-21T22:31:28.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf0f7fe640 1 --2- 172.21.15.6:0/1266107050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf10158090 0x7fcf10162100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:28.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf0ffff640 1 --2- 172.21.15.6:0/1266107050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf100cba60 0x7fcf1013f830 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000e960 tx=0x7fcf0000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:28.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf0cff9640 1 -- 172.21.15.6:0/1266107050 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00009690 con 0x7fcf100cba60 2023-07-21T22:31:28.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf0cff9640 1 -- 172.21.15.6:0/1266107050 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0000ca00 con 0x7fcf100cba60 2023-07-21T22:31:28.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf0cff9640 1 -- 172.21.15.6:0/1266107050 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0000cd70 con 0x7fcf100cba60 2023-07-21T22:31:28.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf16574640 1 -- 172.21.15.6:0/1266107050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf100c5240 con 0x7fcf100cba60 2023-07-21T22:31:28.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf16574640 1 -- 172.21.15.6:0/1266107050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf100c5800 con 0x7fcf100cba60 2023-07-21T22:31:28.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf16574640 1 -- 172.21.15.6:0/1266107050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf100714b0 con 0x7fcf100cba60 2023-07-21T22:31:28.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.328+0000 7fcf0cff9640 1 -- 172.21.15.6:0/1266107050 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fcf00013470 con 0x7fcf100cba60 2023-07-21T22:31:28.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.332+0000 7fcf0cff9640 1 --2- 172.21.15.6:0/1266107050 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fcefc066480 0x7fcefc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:28.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.332+0000 7fcf0cff9640 1 -- 172.21.15.6:0/1266107050 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fcf000843e0 con 0x7fcf100cba60 2023-07-21T22:31:28.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.332+0000 7fcf0f7fe640 1 --2- 172.21.15.6:0/1266107050 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fcefc066480 0x7fcefc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:28.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.332+0000 7fcf0f7fe640 1 --2- 172.21.15.6:0/1266107050 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fcefc066480 0x7fcefc068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcf100c4b40 tx=0x7fcf04008040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:28.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.336+0000 7fcf0cff9640 1 -- 172.21.15.6:0/1266107050 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcf00051550 con 0x7fcf100cba60 2023-07-21T22:31:28.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.508+0000 7fcf16574640 1 -- 172.21.15.6:0/1266107050 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf100678d0 con 0x7fcefc066480 2023-07-21T22:31:28.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.516+0000 7fcf0cff9640 1 -- 172.21.15.6:0/1266107050 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fcf100678d0 con 0x7fcefc066480 2023-07-21T22:31:28.565 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:28.565 INFO:teuthology.orchestra.run.smithi006.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:20:07", "first": "2023-07-21T22:21:00", "last": "2023-07-21T22:31:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-21T22:31:28.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.520+0000 7fcf16574640 1 -- 172.21.15.6:0/1266107050 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fcefc066480 msgr2=0x7fcefc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:28.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.520+0000 7fcf16574640 1 --2- 172.21.15.6:0/1266107050 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fcefc066480 0x7fcefc068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcf100c4b40 tx=0x7fcf04008040 comp rx=0 tx=0).stop 2023-07-21T22:31:28.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.520+0000 7fcf16574640 1 -- 172.21.15.6:0/1266107050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf100cba60 msgr2=0x7fcf1013f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:28.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.520+0000 7fcf16574640 1 --2- 172.21.15.6:0/1266107050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf100cba60 0x7fcf1013f830 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcf0000e960 tx=0x7fcf0000ee20 comp rx=0 tx=0).stop 2023-07-21T22:31:28.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.520+0000 7fcf16574640 1 -- 172.21.15.6:0/1266107050 shutdown_connections 2023-07-21T22:31:28.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.520+0000 7fcf16574640 1 --2- 172.21.15.6:0/1266107050 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fcefc066480 0x7fcefc068930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.520+0000 7fcf16574640 1 --2- 172.21.15.6:0/1266107050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf1015b9c0 0x7fcf10162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.520+0000 7fcf16574640 1 --2- 172.21.15.6:0/1266107050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf10158090 0x7fcf10162100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.520+0000 7fcf16574640 1 --2- 172.21.15.6:0/1266107050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf100cba60 0x7fcf1013f830 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.520+0000 7fcf16574640 1 -- 172.21.15.6:0/1266107050 >> 172.21.15.6:0/1266107050 conn(0x7fcf100cde90 msgr2=0x7fcf1006f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:28.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.520+0000 7fcf16574640 1 -- 172.21.15.6:0/1266107050 shutdown_connections 2023-07-21T22:31:28.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.520+0000 7fcf16574640 1 -- 172.21.15.6:0/1266107050 wait complete. 2023-07-21T22:31:28.586 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:20:07", "first": "2023-07-21T22:21:00", "last": "2023-07-21T22:31:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-21T22:31:28.586 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1M', 'retention': {}, 'start': '2023-07-21T00:00:00', 'created': '2023-07-21T22:20:07', 'first': '2023-07-21T22:21:00', 'last': '2023-07-21T22:31:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-21T22:31:28.587 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir0 1M 2023-07-21T22:31:28.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.688+0000 7f1edfc96640 1 Processor -- start 2023-07-21T22:31:28.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.688+0000 7f1edfc96640 1 -- start start 2023-07-21T22:31:28.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.688+0000 7f1edfc96640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1ed80cf2e0 0x7f1ed80cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:28.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.688+0000 7f1edfc96640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1ed80ca790 0x7f1ed80cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:28.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.688+0000 7f1edfc96640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed80d0920 con 0x7f1ed806a540 2023-07-21T22:31:28.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.688+0000 7f1edfc96640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed815bfd0 con 0x7f1ed80cf2e0 2023-07-21T22:31:28.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.688+0000 7f1edfc96640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed80cfd10 con 0x7f1ed80ca790 2023-07-21T22:31:28.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.688+0000 7f1edd231640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1ed80cf2e0 0x7f1ed80cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:28.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.688+0000 7f1edd231640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1ed80cf2e0 0x7f1ed80cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58842/0 (socket says 172.21.15.6:58842) 2023-07-21T22:31:28.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.688+0000 7f1edd231640 1 -- 172.21.15.6:0/944525458 learned_addr learned my addr 172.21.15.6:0/944525458 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:28.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.688+0000 7f1ede233640 1 --2- 172.21.15.6:0/944525458 >> v2:172.21.15.161:3300/0 conn(0x7f1ed80ca790 0x7f1ed80cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:28.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.688+0000 7f1edd231640 1 -- 172.21.15.6:0/944525458 >> v2:172.21.15.161:3300/0 conn(0x7f1ed80ca790 msgr2=0x7f1ed80cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:28.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.688+0000 7f1edd231640 1 --2- 172.21.15.6:0/944525458 >> v2:172.21.15.161:3300/0 conn(0x7f1ed80ca790 0x7f1ed80cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.688+0000 7f1edd231640 1 -- 172.21.15.6:0/944525458 >> v1:172.21.15.6:6789/0 conn(0x7f1ed806a540 legacy=0x7f1ed806a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:28.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.688+0000 7f1edd231640 1 -- 172.21.15.6:0/944525458 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed80cfff0 con 0x7f1ed80cf2e0 2023-07-21T22:31:28.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.692+0000 7f1edd231640 1 --2- 172.21.15.6:0/944525458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ed80cf2e0 0x7f1ed80cf710 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009870 tx=0x7f1ec801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d977950c8dd9eaab server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:28.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.692+0000 7f1edca30640 1 -- 172.21.15.6:0/944525458 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec80aa430 con 0x7f1ed80cf2e0 2023-07-21T22:31:28.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.692+0000 7f1edca30640 1 -- 172.21.15.6:0/944525458 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec80aa590 con 0x7f1ed80cf2e0 2023-07-21T22:31:28.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.692+0000 7f1edca30640 1 -- 172.21.15.6:0/944525458 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec80aa920 con 0x7f1ed80cf2e0 2023-07-21T22:31:28.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.692+0000 7f1edfc96640 1 -- 172.21.15.6:0/944525458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ed80cf2e0 msgr2=0x7f1ed80cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:28.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.692+0000 7f1edfc96640 1 --2- 172.21.15.6:0/944525458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ed80cf2e0 0x7f1ed80cf710 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009870 tx=0x7f1ec801c4d0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.692+0000 7f1edfc96640 1 -- 172.21.15.6:0/944525458 shutdown_connections 2023-07-21T22:31:28.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.692+0000 7f1edfc96640 1 --2- 172.21.15.6:0/944525458 >> v2:172.21.15.161:3300/0 conn(0x7f1ed80ca790 0x7f1ed80cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.692+0000 7f1edfc96640 1 --2- 172.21.15.6:0/944525458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ed80cf2e0 0x7f1ed80cf710 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.692+0000 7f1edfc96640 1 -- 172.21.15.6:0/944525458 >> 172.21.15.6:0/944525458 conn(0x7f1ed8099490 msgr2=0x7f1ed8089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:28.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.692+0000 7f1edfc96640 1 -- 172.21.15.6:0/944525458 shutdown_connections 2023-07-21T22:31:28.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.692+0000 7f1edfc96640 1 -- 172.21.15.6:0/944525458 wait complete. 2023-07-21T22:31:28.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.692+0000 7f1edfc96640 1 Processor -- start 2023-07-21T22:31:28.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.692+0000 7f1edfc96640 1 -- start start 2023-07-21T22:31:28.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1edfc96640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ed806a540 0x7f1ed814c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:28.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1edfc96640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ed80ca790 0x7f1ed8154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:28.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1edfc96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ed80cf2e0 0x7f1ed8155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:28.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1edfc96640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed815b440 con 0x7f1ed80cf2e0 2023-07-21T22:31:28.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1edfc96640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed815ae80 con 0x7f1ed806a540 2023-07-21T22:31:28.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1edfc96640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed815b160 con 0x7f1ed80ca790 2023-07-21T22:31:28.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1ede233640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ed80cf2e0 0x7f1ed8155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:28.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1ede233640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ed80cf2e0 0x7f1ed8155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58856/0 (socket says 172.21.15.6:58856) 2023-07-21T22:31:28.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1ede233640 1 -- 172.21.15.6:0/982362325 learned_addr learned my addr 172.21.15.6:0/982362325 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:28.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1edd231640 1 --2- 172.21.15.6:0/982362325 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ed80ca790 0x7f1ed8154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:28.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1edda32640 1 --2- 172.21.15.6:0/982362325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ed806a540 0x7f1ed814c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:28.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1ede233640 1 -- 172.21.15.6:0/982362325 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ed80ca790 msgr2=0x7f1ed8154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:28.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1ede233640 1 --2- 172.21.15.6:0/982362325 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ed80ca790 0x7f1ed8154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1ede233640 1 -- 172.21.15.6:0/982362325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ed806a540 msgr2=0x7f1ed814c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:28.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1ede233640 1 --2- 172.21.15.6:0/982362325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ed806a540 0x7f1ed814c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:28.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1ede233640 1 -- 172.21.15.6:0/982362325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec80094d0 con 0x7f1ed80cf2e0 2023-07-21T22:31:28.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1edd231640 1 --2- 172.21.15.6:0/982362325 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ed80ca790 0x7f1ed8154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:28.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1ede233640 1 --2- 172.21.15.6:0/982362325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ed80cf2e0 0x7f1ed8155040 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0007e60 tx=0x7f1ed000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:28.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1ece7fc640 1 -- 172.21.15.6:0/982362325 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0014420 con 0x7f1ed80cf2e0 2023-07-21T22:31:28.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1ece7fc640 1 -- 172.21.15.6:0/982362325 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed00145a0 con 0x7f1ed80cf2e0 2023-07-21T22:31:28.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1edfc96640 1 -- 172.21.15.6:0/982362325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed8152750 con 0x7f1ed80cf2e0 2023-07-21T22:31:28.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1ece7fc640 1 -- 172.21.15.6:0/982362325 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0014950 con 0x7f1ed80cf2e0 2023-07-21T22:31:28.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1edfc96640 1 -- 172.21.15.6:0/982362325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed815a010 con 0x7f1ed80cf2e0 2023-07-21T22:31:28.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.696+0000 7f1edfc96640 1 -- 172.21.15.6:0/982362325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed80678d0 con 0x7f1ed80cf2e0 2023-07-21T22:31:28.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.700+0000 7f1ece7fc640 1 -- 172.21.15.6:0/982362325 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f1ed0014ab0 con 0x7f1ed80cf2e0 2023-07-21T22:31:28.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.700+0000 7f1ece7fc640 1 --2- 172.21.15.6:0/982362325 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1ebc066480 0x7f1ebc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:28.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.700+0000 7f1ece7fc640 1 -- 172.21.15.6:0/982362325 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f1ed0084b00 con 0x7f1ed80cf2e0 2023-07-21T22:31:28.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.700+0000 7f1edda32640 1 --2- 172.21.15.6:0/982362325 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1ebc066480 0x7f1ebc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:28.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.700+0000 7f1edda32640 1 --2- 172.21.15.6:0/982362325 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1ebc066480 0x7f1ebc068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4007fd0 tx=0x7f1ed4009040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:28.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.704+0000 7f1ece7fc640 1 -- 172.21.15.6:0/982362325 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1ed0086e60 con 0x7f1ed80cf2e0 2023-07-21T22:31:28.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.880+0000 7f1edfc96640 1 -- 172.21.15.6:0/982362325 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ed80cee70 con 0x7f1ebc066480 2023-07-21T22:31:29.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.964+0000 7f1ece7fc640 1 -- 172.21.15.6:0/982362325 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f1ed4001450 con 0x7f1ebc066480 2023-07-21T22:31:29.011 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule removed for path /snap_test_dir1/dir0 2023-07-21T22:31:29.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.964+0000 7f1edfc96640 1 -- 172.21.15.6:0/982362325 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1ebc066480 msgr2=0x7f1ebc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:29.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.964+0000 7f1edfc96640 1 --2- 172.21.15.6:0/982362325 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1ebc066480 0x7f1ebc068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4007fd0 tx=0x7f1ed4009040 comp rx=0 tx=0).stop 2023-07-21T22:31:29.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.964+0000 7f1edfc96640 1 -- 172.21.15.6:0/982362325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ed80cf2e0 msgr2=0x7f1ed8155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:29.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.964+0000 7f1edfc96640 1 --2- 172.21.15.6:0/982362325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ed80cf2e0 0x7f1ed8155040 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0007e60 tx=0x7f1ed000e4b0 comp rx=0 tx=0).stop 2023-07-21T22:31:29.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.964+0000 7f1edfc96640 1 -- 172.21.15.6:0/982362325 shutdown_connections 2023-07-21T22:31:29.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.964+0000 7f1edfc96640 1 --2- 172.21.15.6:0/982362325 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1ebc066480 0x7f1ebc068930 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:29.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.964+0000 7f1edfc96640 1 --2- 172.21.15.6:0/982362325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ed80cf2e0 0x7f1ed8155040 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:29.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.964+0000 7f1edfc96640 1 --2- 172.21.15.6:0/982362325 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ed80ca790 0x7f1ed8154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:29.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.964+0000 7f1edfc96640 1 --2- 172.21.15.6:0/982362325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ed806a540 0x7f1ed814c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:29.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.964+0000 7f1edfc96640 1 -- 172.21.15.6:0/982362325 >> 172.21.15.6:0/982362325 conn(0x7f1ed8099490 msgr2=0x7f1ed80b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:29.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.964+0000 7f1edfc96640 1 -- 172.21.15.6:0/982362325 shutdown_connections 2023-07-21T22:31:29.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:28.964+0000 7f1edfc96640 1 -- 172.21.15.6:0/982362325 wait complete. 2023-07-21T22:31:29.032 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2023-07-21T22:31:29.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:29.033 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-07-21T22:31:29.043 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:29.044 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:29.044 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:29.044 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:29.044 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:29.044 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:29.044 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:29.045 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:29.045 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:29.045 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:29.045 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:29.046 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:29.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:29.046 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_21_00_UTC) 2023-07-21T22:31:29.103 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:29.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:29.104 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_22_00_UTC) 2023-07-21T22:31:29.162 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:29.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:29.162 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_23_00_UTC) 2023-07-21T22:31:29.222 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:29.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:29.222 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_24_00_UTC) 2023-07-21T22:31:29.278 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:29.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:29.279 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_25_00_UTC) 2023-07-21T22:31:29.333 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:29.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:29.334 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_26_00_UTC) 2023-07-21T22:31:29.389 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:29.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:29.390 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_27_00_UTC) 2023-07-21T22:31:29.446 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:29.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:29.446 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_28_00_UTC) 2023-07-21T22:31:29.503 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:29.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:29.504 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_29_00_UTC) 2023-07-21T22:31:29.561 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:29.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:29.562 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_30_00_UTC) 2023-07-21T22:31:29.622 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:29.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:29.623 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-21-22_31_00_UTC) 2023-07-21T22:31:29.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:29.679 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2023-07-21T22:31:29.735 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir1 1M 2023-07-21T22:31:29.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.880+0000 7fed4fa48640 1 Processor -- start 2023-07-21T22:31:29.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.880+0000 7fed4fa48640 1 -- start start 2023-07-21T22:31:29.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed4fa48640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fed480cf2e0 0x7fed480cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:29.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed4fa48640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed480d0920 con 0x7fed4806a540 2023-07-21T22:31:29.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed4fa48640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4815bfd0 con 0x7fed480ca790 2023-07-21T22:31:29.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed4fa48640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed480cfd10 con 0x7fed480cf2e0 2023-07-21T22:31:29.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed4d7e4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fed4806a540 0x7fed4806a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35334/0 (socket says 172.21.15.6:35334) 2023-07-21T22:31:29.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed4d7e4640 1 -- 172.21.15.6:0/3569481716 learned_addr learned my addr 172.21.15.6:0/3569481716 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:29.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed4cfe3640 1 --2- 172.21.15.6:0/3569481716 >> v2:172.21.15.161:3300/0 conn(0x7fed480cf2e0 0x7fed480cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:29.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed3ffff640 1 -- 172.21.15.6:0/3569481716 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1927995368 0 0) 0x7fed480d0920 con 0x7fed4806a540 2023-07-21T22:31:29.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed3ffff640 1 -- 172.21.15.6:0/3569481716 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed34003530 con 0x7fed4806a540 2023-07-21T22:31:29.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed3ffff640 1 -- 172.21.15.6:0/3569481716 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2419453982 0 0) 0x7fed34003530 con 0x7fed4806a540 2023-07-21T22:31:29.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed3ffff640 1 -- 172.21.15.6:0/3569481716 >> v2:172.21.15.161:3300/0 conn(0x7fed480cf2e0 msgr2=0x7fed480cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:29.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed3ffff640 1 --2- 172.21.15.6:0/3569481716 >> v2:172.21.15.161:3300/0 conn(0x7fed480cf2e0 0x7fed480cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:29.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed3ffff640 1 -- 172.21.15.6:0/3569481716 >> v1:172.21.15.161:6789/0 conn(0x7fed480ca790 legacy=0x7fed480cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:29.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed3ffff640 1 -- 172.21.15.6:0/3569481716 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed480cfff0 con 0x7fed4806a540 2023-07-21T22:31:29.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed3ffff640 1 -- 172.21.15.6:0/3569481716 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fed44001680 con 0x7fed4806a540 2023-07-21T22:31:29.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed3ffff640 1 -- 172.21.15.6:0/3569481716 >> v1:172.21.15.6:6789/0 conn(0x7fed4806a540 legacy=0x7fed4806a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:29.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed3ffff640 1 --2- 172.21.15.6:0/3569481716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed34003980 0x7fed34003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:29.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed3ffff640 1 --2- 172.21.15.6:0/3569481716 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed340047d0 0x7fed34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:29.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed3ffff640 1 --2- 172.21.15.6:0/3569481716 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed34005180 0x7fed3400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:29.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed3ffff640 1 -- 172.21.15.6:0/3569481716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed480cfd10 con 0x7fed34003980 2023-07-21T22:31:29.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed3ffff640 1 -- 172.21.15.6:0/3569481716 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3400c000 con 0x7fed340047d0 2023-07-21T22:31:29.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed3ffff640 1 -- 172.21.15.6:0/3569481716 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3400c1c0 con 0x7fed34005180 2023-07-21T22:31:29.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed4d7e4640 1 --2- 172.21.15.6:0/3569481716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed34003980 0x7fed34003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:29.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed4dfe5640 1 --2- 172.21.15.6:0/3569481716 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed34005180 0x7fed3400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:29.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed4cfe3640 1 --2- 172.21.15.6:0/3569481716 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed340047d0 0x7fed34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:29.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed4d7e4640 1 -- 172.21.15.6:0/3569481716 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed34005180 msgr2=0x7fed3400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:29.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed4d7e4640 1 --2- 172.21.15.6:0/3569481716 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed34005180 0x7fed3400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:29.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed4d7e4640 1 -- 172.21.15.6:0/3569481716 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed340047d0 msgr2=0x7fed34004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:29.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed4d7e4640 1 --2- 172.21.15.6:0/3569481716 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed340047d0 0x7fed34004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:29.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed4d7e4640 1 -- 172.21.15.6:0/3569481716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed34003530 con 0x7fed34003980 2023-07-21T22:31:29.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed4dfe5640 1 --2- 172.21.15.6:0/3569481716 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed34005180 0x7fed3400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:29.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.884+0000 7fed4dfe5640 1 -- 172.21.15.6:0/3569481716 reap_dead start 2023-07-21T22:31:29.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.888+0000 7fed4d7e4640 1 --2- 172.21.15.6:0/3569481716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed34003980 0x7fed34003d90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fed4400c240 tx=0x7fed4401cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a6b14996eb3b14 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:29.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.888+0000 7fed3ffff640 1 -- 172.21.15.6:0/3569481716 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed44005ae0 con 0x7fed34003980 2023-07-21T22:31:29.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.888+0000 7fed3ffff640 1 -- 172.21.15.6:0/3569481716 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed44005c40 con 0x7fed34003980 2023-07-21T22:31:29.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.888+0000 7fed3ffff640 1 -- 172.21.15.6:0/3569481716 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed440072b0 con 0x7fed34003980 2023-07-21T22:31:29.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.888+0000 7fed4fa48640 1 -- 172.21.15.6:0/3569481716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed34003980 msgr2=0x7fed34003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:29.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.888+0000 7fed4fa48640 1 --2- 172.21.15.6:0/3569481716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed34003980 0x7fed34003d90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fed4400c240 tx=0x7fed4401cc10 comp rx=0 tx=0).stop 2023-07-21T22:31:29.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.888+0000 7fed4fa48640 1 -- 172.21.15.6:0/3569481716 shutdown_connections 2023-07-21T22:31:29.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.888+0000 7fed4fa48640 1 --2- 172.21.15.6:0/3569481716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed34003980 0x7fed34003d90 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:29.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.888+0000 7fed4fa48640 1 -- 172.21.15.6:0/3569481716 >> 172.21.15.6:0/3569481716 conn(0x7fed48099490 msgr2=0x7fed48089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:29.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.888+0000 7fed4fa48640 1 -- 172.21.15.6:0/3569481716 shutdown_connections 2023-07-21T22:31:29.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.888+0000 7fed4fa48640 1 -- 172.21.15.6:0/3569481716 wait complete. 2023-07-21T22:31:29.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4fa48640 1 Processor -- start 2023-07-21T22:31:29.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4fa48640 1 -- start start 2023-07-21T22:31:29.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4fa48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed34003980 0x7fed4806d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:29.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4fa48640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed480b5880 0x7fed48152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:29.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4fa48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed480b5cf0 0x7fed481532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:29.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4fa48640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed48153820 con 0x7fed480b5cf0 2023-07-21T22:31:29.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4fa48640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed480ca180 con 0x7fed480b5880 2023-07-21T22:31:29.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4fa48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed480b15c0 con 0x7fed34003980 2023-07-21T22:31:29.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4dfe5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed480b5cf0 0x7fed481532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:29.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4dfe5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed480b5cf0 0x7fed481532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58870/0 (socket says 172.21.15.6:58870) 2023-07-21T22:31:29.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4dfe5640 1 -- 172.21.15.6:0/1762319838 learned_addr learned my addr 172.21.15.6:0/1762319838 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:29.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4cfe3640 1 --2- 172.21.15.6:0/1762319838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed480b5880 0x7fed48152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:29.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4d7e4640 1 --2- 172.21.15.6:0/1762319838 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed34003980 0x7fed4806d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:29.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4dfe5640 1 -- 172.21.15.6:0/1762319838 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed34003980 msgr2=0x7fed4806d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:29.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4dfe5640 1 --2- 172.21.15.6:0/1762319838 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed34003980 0x7fed4806d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:29.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4dfe5640 1 -- 172.21.15.6:0/1762319838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed480b5880 msgr2=0x7fed48152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:29.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4dfe5640 1 --2- 172.21.15.6:0/1762319838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed480b5880 0x7fed48152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:29.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4dfe5640 1 -- 172.21.15.6:0/1762319838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed480b0520 con 0x7fed480b5cf0 2023-07-21T22:31:29.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4dfe5640 1 --2- 172.21.15.6:0/1762319838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed480b5cf0 0x7fed481532e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fed40000f90 tx=0x7fed4000e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:29.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed3dffb640 1 -- 172.21.15.6:0/1762319838 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4000ed20 con 0x7fed480b5cf0 2023-07-21T22:31:29.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed3dffb640 1 -- 172.21.15.6:0/1762319838 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4000eea0 con 0x7fed480b5cf0 2023-07-21T22:31:29.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed3dffb640 1 -- 172.21.15.6:0/1762319838 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed40003ba0 con 0x7fed480b5cf0 2023-07-21T22:31:29.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4fa48640 1 -- 172.21.15.6:0/1762319838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed480b0800 con 0x7fed480b5cf0 2023-07-21T22:31:29.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.892+0000 7fed4fa48640 1 -- 172.21.15.6:0/1762319838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed480b0dc0 con 0x7fed480b5cf0 2023-07-21T22:31:29.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.896+0000 7fed4fa48640 1 -- 172.21.15.6:0/1762319838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed480cde50 con 0x7fed480b5cf0 2023-07-21T22:31:29.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.896+0000 7fed3dffb640 1 -- 172.21.15.6:0/1762319838 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fed40003d00 con 0x7fed480b5cf0 2023-07-21T22:31:29.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.896+0000 7fed3dffb640 1 --2- 172.21.15.6:0/1762319838 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fed2c066480 0x7fed2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.896+0000 7fed3dffb640 1 -- 172.21.15.6:0/1762319838 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fed40082ef0 con 0x7fed480b5cf0 2023-07-21T22:31:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.896+0000 7fed4d7e4640 1 --2- 172.21.15.6:0/1762319838 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fed2c066480 0x7fed2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.896+0000 7fed4d7e4640 1 --2- 172.21.15.6:0/1762319838 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fed2c066480 0x7fed2c068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fed440ab000 tx=0x7fed440b1040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:29.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:29.900+0000 7fed3dffb640 1 -- 172.21.15.6:0/1762319838 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed40050070 con 0x7fed480b5cf0 2023-07-21T22:31:30.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:30.072+0000 7fed4fa48640 1 -- 172.21.15.6:0/1762319838 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fed480cee70 con 0x7fed2c066480 2023-07-21T22:31:30.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:30.156+0000 7fed3dffb640 1 -- 172.21.15.6:0/1762319838 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fed44001580 con 0x7fed2c066480 2023-07-21T22:31:30.206 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule removed for path /snap_test_dir1/dir1 2023-07-21T22:31:30.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:30.160+0000 7fed4fa48640 1 -- 172.21.15.6:0/1762319838 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fed2c066480 msgr2=0x7fed2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:30.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:30.160+0000 7fed4fa48640 1 --2- 172.21.15.6:0/1762319838 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fed2c066480 0x7fed2c068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fed440ab000 tx=0x7fed440b1040 comp rx=0 tx=0).stop 2023-07-21T22:31:30.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:30.160+0000 7fed4fa48640 1 -- 172.21.15.6:0/1762319838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed480b5cf0 msgr2=0x7fed481532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:30.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:30.160+0000 7fed4fa48640 1 --2- 172.21.15.6:0/1762319838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed480b5cf0 0x7fed481532e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fed40000f90 tx=0x7fed4000e7c0 comp rx=0 tx=0).stop 2023-07-21T22:31:30.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:30.160+0000 7fed4fa48640 1 -- 172.21.15.6:0/1762319838 shutdown_connections 2023-07-21T22:31:30.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:30.160+0000 7fed4fa48640 1 --2- 172.21.15.6:0/1762319838 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fed2c066480 0x7fed2c068930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:30.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:30.160+0000 7fed4fa48640 1 --2- 172.21.15.6:0/1762319838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed480b5cf0 0x7fed481532e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:30.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:30.160+0000 7fed4fa48640 1 --2- 172.21.15.6:0/1762319838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed480b5880 0x7fed48152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:30.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:30.160+0000 7fed4fa48640 1 --2- 172.21.15.6:0/1762319838 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed34003980 0x7fed4806d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:30.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:30.160+0000 7fed4fa48640 1 -- 172.21.15.6:0/1762319838 >> 172.21.15.6:0/1762319838 conn(0x7fed48099490 msgr2=0x7fed480cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:30.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:30.160+0000 7fed4fa48640 1 -- 172.21.15.6:0/1762319838 shutdown_connections 2023-07-21T22:31:30.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:30.160+0000 7fed4fa48640 1 -- 172.21.15.6:0/1762319838 wait complete. 2023-07-21T22:31:30.227 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2023-07-21T22:31:30.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:30.228 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-07-21T22:31:30.237 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:30.239 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:30.239 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:30.239 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:30.239 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:30.240 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:30.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:30.241 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_21_00_UTC) 2023-07-21T22:31:30.305 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:30.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:30.306 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_22_00_UTC) 2023-07-21T22:31:30.361 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:30.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:30.362 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_23_00_UTC) 2023-07-21T22:31:30.418 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:30.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:30.419 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_24_00_UTC) 2023-07-21T22:31:30.477 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:30.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:30.478 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_25_00_UTC) 2023-07-21T22:31:30.538 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:30.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:30.540 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_26_00_UTC) 2023-07-21T22:31:30.598 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:30.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:30.599 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_27_00_UTC) 2023-07-21T22:31:30.658 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:30.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:30.659 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_28_00_UTC) 2023-07-21T22:31:30.713 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:30.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:30.714 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_29_00_UTC) 2023-07-21T22:31:30.770 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:30.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:30.771 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_30_00_UTC) 2023-07-21T22:31:30.830 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:30.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:30.831 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-21-22_31_00_UTC) 2023-07-21T22:31:30.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:30.890 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2023-07-21T22:31:30.941 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir2 1M 2023-07-21T22:31:31.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.080+0000 7f5a18582640 1 Processor -- start 2023-07-21T22:31:31.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.084+0000 7f5a18582640 1 -- start start 2023-07-21T22:31:31.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.084+0000 7f5a18582640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a10069430 0x7f5a10069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:31.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.084+0000 7f5a18582640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5a10070f30 0x7f5a100ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:31.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.084+0000 7f5a18582640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a10159d70 con 0x7f5a100af2b0 2023-07-21T22:31:31.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.084+0000 7f5a18582640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a10069d40 con 0x7f5a10070f30 2023-07-21T22:31:31.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.084+0000 7f5a18582640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a100c9c60 con 0x7f5a10069430 2023-07-21T22:31:31.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.084+0000 7f5a16b1f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5a100af2b0 0x7f5a1015a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35350/0 (socket says 172.21.15.6:35350) 2023-07-21T22:31:31.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.084+0000 7f5a16b1f640 1 -- 172.21.15.6:0/1097696938 learned_addr learned my addr 172.21.15.6:0/1097696938 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:31.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.084+0000 7f5a1631e640 1 --2- 172.21.15.6:0/1097696938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a10069430 0x7f5a10069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:31.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.084+0000 7f5a15b1d640 1 --2- 172.21.15.6:0/1097696938 >> v2:172.21.15.161:3300/0 conn(0x7f5a10070f30 0x7f5a100ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:31.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.084+0000 7f5a1531c640 1 -- 172.21.15.6:0/1097696938 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486081229 0 0) 0x7f5a080014a0 con 0x7f5a100af2b0 2023-07-21T22:31:31.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.084+0000 7f5a1531c640 1 -- 172.21.15.6:0/1097696938 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59fc003530 con 0x7f5a100af2b0 2023-07-21T22:31:31.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.084+0000 7f5a15b1d640 1 -- 172.21.15.6:0/1097696938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a10069430 msgr2=0x7f5a10069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:31.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.084+0000 7f5a15b1d640 1 --2- 172.21.15.6:0/1097696938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a10069430 0x7f5a10069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:31.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.084+0000 7f5a15b1d640 1 -- 172.21.15.6:0/1097696938 >> v1:172.21.15.6:6789/0 conn(0x7f5a100af2b0 legacy=0x7f5a1015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:31.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.084+0000 7f5a15b1d640 1 -- 172.21.15.6:0/1097696938 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a100c9f40 con 0x7f5a10070f30 2023-07-21T22:31:31.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.084+0000 7f5a1631e640 1 --2- 172.21.15.6:0/1097696938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a10069430 0x7f5a10069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:31.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.088+0000 7f5a15b1d640 1 --2- 172.21.15.6:0/1097696938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a10070f30 0x7f5a100ad6f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5a000097c0 tx=0x7f5a0001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d54ae056f874c96c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:31.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.088+0000 7f5a1531c640 1 -- 172.21.15.6:0/1097696938 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a000ab680 con 0x7f5a10070f30 2023-07-21T22:31:31.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.088+0000 7f5a1531c640 1 -- 172.21.15.6:0/1097696938 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a000ab7e0 con 0x7f5a10070f30 2023-07-21T22:31:31.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.088+0000 7f5a1531c640 1 -- 172.21.15.6:0/1097696938 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a000abb70 con 0x7f5a10070f30 2023-07-21T22:31:31.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.088+0000 7f5a18582640 1 -- 172.21.15.6:0/1097696938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a10070f30 msgr2=0x7f5a100ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:31.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.088+0000 7f5a18582640 1 --2- 172.21.15.6:0/1097696938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a10070f30 0x7f5a100ad6f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5a000097c0 tx=0x7f5a0001c480 comp rx=0 tx=0).stop 2023-07-21T22:31:31.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.088+0000 7f5a18582640 1 -- 172.21.15.6:0/1097696938 shutdown_connections 2023-07-21T22:31:31.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.088+0000 7f5a18582640 1 --2- 172.21.15.6:0/1097696938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a10070f30 0x7f5a100ad6f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:31.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.088+0000 7f5a18582640 1 --2- 172.21.15.6:0/1097696938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a10069430 0x7f5a10069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:31.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.088+0000 7f5a18582640 1 -- 172.21.15.6:0/1097696938 >> 172.21.15.6:0/1097696938 conn(0x7f5a100cde90 msgr2=0x7f5a100ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:31.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.088+0000 7f5a18582640 1 -- 172.21.15.6:0/1097696938 shutdown_connections 2023-07-21T22:31:31.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.088+0000 7f5a18582640 1 -- 172.21.15.6:0/1097696938 wait complete. 2023-07-21T22:31:31.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a18582640 1 Processor -- start 2023-07-21T22:31:31.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a18582640 1 -- start start 2023-07-21T22:31:31.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a18582640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a10069430 0x7f5a101522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:31.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a18582640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a10070f30 0x7f5a10150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:31.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a18582640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a100af2b0 0x7f5a10151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:31.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a18582640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a100c5310 con 0x7f5a100af2b0 2023-07-21T22:31:31.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a18582640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a10158500 con 0x7f5a10069430 2023-07-21T22:31:31.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a18582640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a100c6500 con 0x7f5a10070f30 2023-07-21T22:31:31.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a16b1f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a100af2b0 0x7f5a10151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:31.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a16b1f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a100af2b0 0x7f5a10151170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58886/0 (socket says 172.21.15.6:58886) 2023-07-21T22:31:31.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a16b1f640 1 -- 172.21.15.6:0/474065952 learned_addr learned my addr 172.21.15.6:0/474065952 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:31.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a1631e640 1 --2- 172.21.15.6:0/474065952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a10069430 0x7f5a101522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:31.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a15b1d640 1 --2- 172.21.15.6:0/474065952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a10070f30 0x7f5a10150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:31.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a16b1f640 1 -- 172.21.15.6:0/474065952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a10070f30 msgr2=0x7f5a10150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:31.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a16b1f640 1 --2- 172.21.15.6:0/474065952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a10070f30 0x7f5a10150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:31.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a16b1f640 1 -- 172.21.15.6:0/474065952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a10069430 msgr2=0x7f5a101522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:31.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a16b1f640 1 --2- 172.21.15.6:0/474065952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a10069430 0x7f5a101522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:31.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a16b1f640 1 -- 172.21.15.6:0/474065952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0c009420 con 0x7f5a100af2b0 2023-07-21T22:31:31.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a1631e640 1 --2- 172.21.15.6:0/474065952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a10069430 0x7f5a101522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:31.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a16b1f640 1 --2- 172.21.15.6:0/474065952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a100af2b0 0x7f5a10151170 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800cb70 tx=0x7f5a0800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:31.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a06ffd640 1 -- 172.21.15.6:0/474065952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0800ace0 con 0x7f5a100af2b0 2023-07-21T22:31:31.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a06ffd640 1 -- 172.21.15.6:0/474065952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0800ae40 con 0x7f5a100af2b0 2023-07-21T22:31:31.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a06ffd640 1 -- 172.21.15.6:0/474065952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08012620 con 0x7f5a100af2b0 2023-07-21T22:31:31.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a18582640 1 -- 172.21.15.6:0/474065952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a00009420 con 0x7f5a100af2b0 2023-07-21T22:31:31.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.092+0000 7f5a18582640 1 -- 172.21.15.6:0/474065952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a10157eb0 con 0x7f5a100af2b0 2023-07-21T22:31:31.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.096+0000 7f5a18582640 1 -- 172.21.15.6:0/474065952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a100678d0 con 0x7f5a100af2b0 2023-07-21T22:31:31.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.096+0000 7f5a06ffd640 1 -- 172.21.15.6:0/474065952 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f5a08007070 con 0x7f5a100af2b0 2023-07-21T22:31:31.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.096+0000 7f5a06ffd640 1 --2- 172.21.15.6:0/474065952 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f59f40664b0 0x7f59f4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:31.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.096+0000 7f5a06ffd640 1 -- 172.21.15.6:0/474065952 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f5a080840a0 con 0x7f5a100af2b0 2023-07-21T22:31:31.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.096+0000 7f5a1631e640 1 --2- 172.21.15.6:0/474065952 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f59f40664b0 0x7f59f4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:31.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.096+0000 7f5a1631e640 1 --2- 172.21.15.6:0/474065952 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f59f40664b0 0x7f59f4068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009ca0 tx=0x7f5a0c008040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:31.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.100+0000 7f5a06ffd640 1 -- 172.21.15.6:0/474065952 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5a080510e0 con 0x7f5a100af2b0 2023-07-21T22:31:31.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.272+0000 7f5a18582640 1 -- 172.21.15.6:0/474065952 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a100adc30 con 0x7f59f40664b0 2023-07-21T22:31:31.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.356+0000 7f5a06ffd640 1 -- 172.21.15.6:0/474065952 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f5a0c0098f0 con 0x7f59f40664b0 2023-07-21T22:31:31.405 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule removed for path /snap_test_dir1/dir2 2023-07-21T22:31:31.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.356+0000 7f5a18582640 1 -- 172.21.15.6:0/474065952 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f59f40664b0 msgr2=0x7f59f4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:31.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.356+0000 7f5a18582640 1 --2- 172.21.15.6:0/474065952 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f59f40664b0 0x7f59f4068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c009ca0 tx=0x7f5a0c008040 comp rx=0 tx=0).stop 2023-07-21T22:31:31.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.356+0000 7f5a18582640 1 -- 172.21.15.6:0/474065952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a100af2b0 msgr2=0x7f5a10151170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:31.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.356+0000 7f5a18582640 1 --2- 172.21.15.6:0/474065952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a100af2b0 0x7f5a10151170 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5a0800cb70 tx=0x7f5a0800a430 comp rx=0 tx=0).stop 2023-07-21T22:31:31.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.356+0000 7f5a18582640 1 -- 172.21.15.6:0/474065952 shutdown_connections 2023-07-21T22:31:31.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.356+0000 7f5a18582640 1 --2- 172.21.15.6:0/474065952 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f59f40664b0 0x7f59f4068960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:31.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.356+0000 7f5a18582640 1 --2- 172.21.15.6:0/474065952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a100af2b0 0x7f5a10151170 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:31.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.356+0000 7f5a18582640 1 --2- 172.21.15.6:0/474065952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a10070f30 0x7f5a10150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:31.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.356+0000 7f5a18582640 1 --2- 172.21.15.6:0/474065952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a10069430 0x7f5a101522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:31.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.360+0000 7f5a18582640 1 -- 172.21.15.6:0/474065952 >> 172.21.15.6:0/474065952 conn(0x7f5a100cde90 msgr2=0x7f5a1015a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:31.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.360+0000 7f5a18582640 1 -- 172.21.15.6:0/474065952 shutdown_connections 2023-07-21T22:31:31.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:31.360+0000 7f5a18582640 1 -- 172.21.15.6:0/474065952 wait complete. 2023-07-21T22:31:31.425 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2023-07-21T22:31:31.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:31.426 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-07-21T22:31:31.436 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_21_01_UTC 2023-07-21T22:31:31.436 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:31.436 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:31.437 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:31.437 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:31.437 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:31.437 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:31.437 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:31.437 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:31.437 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:31.438 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:31.439 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_21_01_UTC 2023-07-21T22:31:31.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:31.439 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_21_01_UTC) 2023-07-21T22:31:31.499 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:31.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:31.501 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_22_00_UTC) 2023-07-21T22:31:31.557 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:31.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:31.558 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_23_00_UTC) 2023-07-21T22:31:31.614 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:31.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:31.614 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_24_00_UTC) 2023-07-21T22:31:31.670 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:31.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:31.671 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_25_00_UTC) 2023-07-21T22:31:31.725 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:31.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:31.726 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_26_00_UTC) 2023-07-21T22:31:31.784 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:31.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:31.785 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_27_00_UTC) 2023-07-21T22:31:31.842 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:31.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:31.842 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_28_00_UTC) 2023-07-21T22:31:31.897 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:31.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:31.898 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_29_00_UTC) 2023-07-21T22:31:31.954 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:31.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:31.955 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_30_00_UTC) 2023-07-21T22:31:32.013 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:32.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:32.014 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-21-22_31_00_UTC) 2023-07-21T22:31:32.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:32.070 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2023-07-21T22:31:32.122 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir3 1M 2023-07-21T22:31:32.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.272+0000 7f122997d640 1 Processor -- start 2023-07-21T22:31:32.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.272+0000 7f122997d640 1 -- start start 2023-07-21T22:31:32.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.272+0000 7f122997d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f122415ee90 0x7f122406c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:32.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.272+0000 7f122997d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f122406c960 0x7f12240afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:32.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.272+0000 7f122997d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f12240affe0 0x7f122415f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:32.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.272+0000 7f122997d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f122406cde0 con 0x7f122406c960 2023-07-21T22:31:32.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.272+0000 7f122997d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f122415f260 con 0x7f12240affe0 2023-07-21T22:31:32.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.272+0000 7f122997d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122406b0f0 con 0x7f122415ee90 2023-07-21T22:31:32.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.272+0000 7f1223fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f122406c960 0x7f12240afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:32.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.272+0000 7f1223fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f122406c960 0x7f12240afaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58902/0 (socket says 172.21.15.6:58902) 2023-07-21T22:31:32.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.272+0000 7f1223fff640 1 -- 172.21.15.6:0/1170134974 learned_addr learned my addr 172.21.15.6:0/1170134974 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:32.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.272+0000 7f122897b640 1 --2- 172.21.15.6:0/1170134974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f122415ee90 0x7f122406c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:32.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.272+0000 7f122917c640 1 --2- 172.21.15.6:0/1170134974 >> v2:172.21.15.161:3300/0 conn(0x7f12240affe0 0x7f122415f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:32.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.272+0000 7f1223fff640 1 -- 172.21.15.6:0/1170134974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f122415ee90 msgr2=0x7f122406c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:32.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.272+0000 7f1223fff640 1 --2- 172.21.15.6:0/1170134974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f122415ee90 0x7f122406c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:32.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.272+0000 7f1223fff640 1 -- 172.21.15.6:0/1170134974 >> v2:172.21.15.161:3300/0 conn(0x7f12240affe0 msgr2=0x7f122415f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:32.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.272+0000 7f1223fff640 1 --2- 172.21.15.6:0/1170134974 >> v2:172.21.15.161:3300/0 conn(0x7f12240affe0 0x7f122415f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:32.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.272+0000 7f1223fff640 1 -- 172.21.15.6:0/1170134974 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122406b3d0 con 0x7f122406c960 2023-07-21T22:31:32.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.272+0000 7f122897b640 1 --2- 172.21.15.6:0/1170134974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f122415ee90 0x7f122406c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:32.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.272+0000 7f122917c640 1 --2- 172.21.15.6:0/1170134974 >> v2:172.21.15.161:3300/0 conn(0x7f12240affe0 0x7f122415f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:32.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.276+0000 7f1223fff640 1 --2- 172.21.15.6:0/1170134974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f122406c960 0x7f12240afaa0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f122406cfe0 tx=0x7f121001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955773036b246e3e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:32.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.276+0000 7f12237fe640 1 -- 172.21.15.6:0/1170134974 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12100ab600 con 0x7f122406c960 2023-07-21T22:31:32.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.276+0000 7f12237fe640 1 -- 172.21.15.6:0/1170134974 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12100a7050 con 0x7f122406c960 2023-07-21T22:31:32.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.276+0000 7f12237fe640 1 -- 172.21.15.6:0/1170134974 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12100ab980 con 0x7f122406c960 2023-07-21T22:31:32.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.276+0000 7f122997d640 1 -- 172.21.15.6:0/1170134974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f122406c960 msgr2=0x7f12240afaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:32.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.276+0000 7f122997d640 1 --2- 172.21.15.6:0/1170134974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f122406c960 0x7f12240afaa0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f122406cfe0 tx=0x7f121001c210 comp rx=0 tx=0).stop 2023-07-21T22:31:32.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.276+0000 7f122997d640 1 -- 172.21.15.6:0/1170134974 shutdown_connections 2023-07-21T22:31:32.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.276+0000 7f122997d640 1 --2- 172.21.15.6:0/1170134974 >> v2:172.21.15.161:3300/0 conn(0x7f12240affe0 0x7f122415f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:32.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.276+0000 7f122997d640 1 --2- 172.21.15.6:0/1170134974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f122406c960 0x7f12240afaa0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:32.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.276+0000 7f122997d640 1 --2- 172.21.15.6:0/1170134974 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f122415ee90 0x7f122406c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:32.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.276+0000 7f122997d640 1 -- 172.21.15.6:0/1170134974 >> 172.21.15.6:0/1170134974 conn(0x7f12240ca800 msgr2=0x7f12240cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:32.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.276+0000 7f122997d640 1 -- 172.21.15.6:0/1170134974 shutdown_connections 2023-07-21T22:31:32.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.276+0000 7f122997d640 1 -- 172.21.15.6:0/1170134974 wait complete. 2023-07-21T22:31:32.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f122997d640 1 Processor -- start 2023-07-21T22:31:32.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f122997d640 1 -- start start 2023-07-21T22:31:32.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f122997d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f122406c960 0x7f122414a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:32.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f122997d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12240affe0 0x7f1224156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:32.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f122997d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f122415ee90 0x7f12240c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:32.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f122997d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12240ae090 con 0x7f12240affe0 2023-07-21T22:31:32.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f122997d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12240ae860 con 0x7f122415ee90 2023-07-21T22:31:32.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f122997d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1224155f60 con 0x7f122406c960 2023-07-21T22:31:32.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f1223fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12240affe0 0x7f1224156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:32.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f1223fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12240affe0 0x7f1224156720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58914/0 (socket says 172.21.15.6:58914) 2023-07-21T22:31:32.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f1223fff640 1 -- 172.21.15.6:0/1367734160 learned_addr learned my addr 172.21.15.6:0/1367734160 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:32.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f122897b640 1 --2- 172.21.15.6:0/1367734160 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f122406c960 0x7f122414a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:32.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f122917c640 1 --2- 172.21.15.6:0/1367734160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f122415ee90 0x7f12240c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:32.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f1223fff640 1 -- 172.21.15.6:0/1367734160 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f122406c960 msgr2=0x7f122414a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:32.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f1223fff640 1 --2- 172.21.15.6:0/1367734160 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f122406c960 0x7f122414a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:32.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f1223fff640 1 -- 172.21.15.6:0/1367734160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f122415ee90 msgr2=0x7f12240c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:32.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f1223fff640 1 --2- 172.21.15.6:0/1367734160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f122415ee90 0x7f12240c18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:32.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f1223fff640 1 -- 172.21.15.6:0/1367734160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12100094d0 con 0x7f12240affe0 2023-07-21T22:31:32.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f122917c640 1 --2- 172.21.15.6:0/1367734160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f122415ee90 0x7f12240c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:32.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f1223fff640 1 --2- 172.21.15.6:0/1367734160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12240affe0 0x7f1224156720 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f12100ae040 tx=0x7f1210018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:32.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f12217fa640 1 -- 172.21.15.6:0/1367734160 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12100b4620 con 0x7f12240affe0 2023-07-21T22:31:32.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f12217fa640 1 -- 172.21.15.6:0/1367734160 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12100b4780 con 0x7f12240affe0 2023-07-21T22:31:32.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f122997d640 1 -- 172.21.15.6:0/1367734160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12240ae2a0 con 0x7f12240affe0 2023-07-21T22:31:32.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f12217fa640 1 -- 172.21.15.6:0/1367734160 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12100b4b30 con 0x7f12240affe0 2023-07-21T22:31:32.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.280+0000 7f122997d640 1 -- 172.21.15.6:0/1367734160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1224156200 con 0x7f12240affe0 2023-07-21T22:31:32.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.284+0000 7f122997d640 1 -- 172.21.15.6:0/1367734160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1224155dc0 con 0x7f12240affe0 2023-07-21T22:31:32.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.284+0000 7f12217fa640 1 -- 172.21.15.6:0/1367734160 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f12100b2070 con 0x7f12240affe0 2023-07-21T22:31:32.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.284+0000 7f12217fa640 1 --2- 172.21.15.6:0/1367734160 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1208066480 0x7f1208068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:32.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.284+0000 7f12217fa640 1 -- 172.21.15.6:0/1367734160 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f121011d530 con 0x7f12240affe0 2023-07-21T22:31:32.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.284+0000 7f122897b640 1 --2- 172.21.15.6:0/1367734160 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1208066480 0x7f1208068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:32.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.284+0000 7f122897b640 1 --2- 172.21.15.6:0/1367734160 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1208066480 0x7f1208068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f122414b2e0 tx=0x7f1218008040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:32.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.288+0000 7f12217fa640 1 -- 172.21.15.6:0/1367734160 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1224155dc0 con 0x7f12240affe0 2023-07-21T22:31:32.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.468+0000 7f122997d640 1 -- 172.21.15.6:0/1367734160 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f122406bc70 con 0x7f1208066480 2023-07-21T22:31:32.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.552+0000 7f12217fa640 1 -- 172.21.15.6:0/1367734160 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f121800c590 con 0x7f1208066480 2023-07-21T22:31:32.599 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule removed for path /snap_test_dir1/dir3 2023-07-21T22:31:32.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.552+0000 7f122997d640 1 -- 172.21.15.6:0/1367734160 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1208066480 msgr2=0x7f1208068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:32.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.552+0000 7f122997d640 1 --2- 172.21.15.6:0/1367734160 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1208066480 0x7f1208068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f122414b2e0 tx=0x7f1218008040 comp rx=0 tx=0).stop 2023-07-21T22:31:32.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.552+0000 7f122997d640 1 -- 172.21.15.6:0/1367734160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12240affe0 msgr2=0x7f1224156720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:32.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.552+0000 7f122997d640 1 --2- 172.21.15.6:0/1367734160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12240affe0 0x7f1224156720 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f12100ae040 tx=0x7f1210018fb0 comp rx=0 tx=0).stop 2023-07-21T22:31:32.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.552+0000 7f122997d640 1 -- 172.21.15.6:0/1367734160 shutdown_connections 2023-07-21T22:31:32.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.552+0000 7f122997d640 1 --2- 172.21.15.6:0/1367734160 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f1208066480 0x7f1208068930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:32.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.552+0000 7f122997d640 1 --2- 172.21.15.6:0/1367734160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f122415ee90 0x7f12240c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:32.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.552+0000 7f122997d640 1 --2- 172.21.15.6:0/1367734160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12240affe0 0x7f1224156720 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:32.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.552+0000 7f122997d640 1 --2- 172.21.15.6:0/1367734160 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f122406c960 0x7f122414a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:32.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.552+0000 7f122997d640 1 -- 172.21.15.6:0/1367734160 >> 172.21.15.6:0/1367734160 conn(0x7f12240ca800 msgr2=0x7f1224070270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:32.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.552+0000 7f122997d640 1 -- 172.21.15.6:0/1367734160 shutdown_connections 2023-07-21T22:31:32.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:32.552+0000 7f122997d640 1 -- 172.21.15.6:0/1367734160 wait complete. 2023-07-21T22:31:32.620 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2023-07-21T22:31:32.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:32.621 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-07-21T22:31:32.631 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:32.631 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:32.631 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:32.632 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:32.632 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:32.632 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:32.632 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:32.632 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:32.632 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:32.633 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_30_01_UTC 2023-07-21T22:31:32.633 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:32.634 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:32.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:32.634 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_21_00_UTC) 2023-07-21T22:31:32.695 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:32.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:32.696 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_22_00_UTC) 2023-07-21T22:31:32.753 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:32.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:32.754 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_23_00_UTC) 2023-07-21T22:31:32.810 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:32.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:32.811 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_24_00_UTC) 2023-07-21T22:31:32.869 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:32.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:32.870 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_25_00_UTC) 2023-07-21T22:31:32.925 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:32.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:32.926 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_26_00_UTC) 2023-07-21T22:31:32.985 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:32.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:32.986 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_27_00_UTC) 2023-07-21T22:31:33.041 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:33.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:33.042 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_28_00_UTC) 2023-07-21T22:31:33.101 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:33.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:33.102 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_29_00_UTC) 2023-07-21T22:31:33.158 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_30_01_UTC 2023-07-21T22:31:33.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:33.159 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_30_01_UTC) 2023-07-21T22:31:33.213 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:33.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:33.214 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-21-22_31_00_UTC) 2023-07-21T22:31:33.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:33.269 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2023-07-21T22:31:33.322 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir4 1M 2023-07-21T22:31:33.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f050806d640 1 Processor -- start 2023-07-21T22:31:33.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f050806d640 1 -- start start 2023-07-21T22:31:33.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f050806d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0500159440 0x7f05000c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:33.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f050806d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05001532b0 con 0x7f05000aeb40 2023-07-21T22:31:33.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f050806d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05000ca6f0 con 0x7f050015cef0 2023-07-21T22:31:33.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f050806d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f050015d360 con 0x7f0500159440 2023-07-21T22:31:33.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f0505e09640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f05000aeb40 0x7f05000aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35362/0 (socket says 172.21.15.6:35362) 2023-07-21T22:31:33.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f0505e09640 1 -- 172.21.15.6:0/2231178480 learned_addr learned my addr 172.21.15.6:0/2231178480 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:33.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f050660a640 1 --2- 172.21.15.6:0/2231178480 >> v2:172.21.15.161:3300/0 conn(0x7f0500159440 0x7f05000c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:33.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f0504e07640 1 -- 172.21.15.6:0/2231178480 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1750904331 0 0) 0x7f05001532b0 con 0x7f05000aeb40 2023-07-21T22:31:33.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f0504e07640 1 -- 172.21.15.6:0/2231178480 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04ec005740 con 0x7f05000aeb40 2023-07-21T22:31:33.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f0504e07640 1 -- 172.21.15.6:0/2231178480 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920974656 0 0) 0x7f05000ca6f0 con 0x7f050015cef0 2023-07-21T22:31:33.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f0504e07640 1 -- 172.21.15.6:0/2231178480 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05001532b0 con 0x7f050015cef0 2023-07-21T22:31:33.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f0504e07640 1 -- 172.21.15.6:0/2231178480 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3137662646 0 0) 0x7f04ec005740 con 0x7f05000aeb40 2023-07-21T22:31:33.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f0504e07640 1 -- 172.21.15.6:0/2231178480 >> v2:172.21.15.161:3300/0 conn(0x7f0500159440 msgr2=0x7f05000c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:33.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f0504e07640 1 --2- 172.21.15.6:0/2231178480 >> v2:172.21.15.161:3300/0 conn(0x7f0500159440 0x7f05000c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:33.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f0504e07640 1 -- 172.21.15.6:0/2231178480 >> v1:172.21.15.161:6789/0 conn(0x7f050015cef0 legacy=0x7f0500158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:33.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f0504e07640 1 -- 172.21.15.6:0/2231178480 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05001599d0 con 0x7f05000aeb40 2023-07-21T22:31:33.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f0504e07640 1 -- 172.21.15.6:0/2231178480 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f04fc001680 con 0x7f05000aeb40 2023-07-21T22:31:33.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f050660a640 1 --2- 172.21.15.6:0/2231178480 >> v2:172.21.15.161:3300/0 conn(0x7f0500159440 0x7f05000c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:33.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f0504e07640 1 -- 172.21.15.6:0/2231178480 >> v1:172.21.15.6:6789/0 conn(0x7f05000aeb40 legacy=0x7f05000aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:33.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f0504e07640 1 --2- 172.21.15.6:0/2231178480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04ec005d20 0x7f04ec006110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:33.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f0504e07640 1 --2- 172.21.15.6:0/2231178480 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04ec0069e0 0x7f04ec006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:33.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f0504e07640 1 --2- 172.21.15.6:0/2231178480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04ec007390 0x7f04ec00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:33.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f0504e07640 1 -- 172.21.15.6:0/2231178480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050015d360 con 0x7f04ec005d20 2023-07-21T22:31:33.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f0504e07640 1 -- 172.21.15.6:0/2231178480 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec00e1f0 con 0x7f04ec007390 2023-07-21T22:31:33.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.464+0000 7f0504e07640 1 -- 172.21.15.6:0/2231178480 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec00e3b0 con 0x7f04ec0069e0 2023-07-21T22:31:33.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.468+0000 7f0505e09640 1 --2- 172.21.15.6:0/2231178480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04ec005d20 0x7f04ec006110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:33.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.468+0000 7f050660a640 1 --2- 172.21.15.6:0/2231178480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04ec007390 0x7f04ec00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:33.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.468+0000 7f0505608640 1 --2- 172.21.15.6:0/2231178480 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04ec0069e0 0x7f04ec006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:33.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.468+0000 7f050660a640 1 -- 172.21.15.6:0/2231178480 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04ec0069e0 msgr2=0x7f04ec006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:33.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.468+0000 7f050660a640 1 --2- 172.21.15.6:0/2231178480 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04ec0069e0 0x7f04ec006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:33.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.468+0000 7f050660a640 1 -- 172.21.15.6:0/2231178480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04ec005d20 msgr2=0x7f04ec006110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:33.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.468+0000 7f050660a640 1 --2- 172.21.15.6:0/2231178480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04ec005d20 0x7f04ec006110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:33.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.468+0000 7f050660a640 1 -- 172.21.15.6:0/2231178480 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ec005740 con 0x7f04ec007390 2023-07-21T22:31:33.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.468+0000 7f0505e09640 1 --2- 172.21.15.6:0/2231178480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04ec005d20 0x7f04ec006110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:33.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.468+0000 7f050660a640 1 -- 172.21.15.6:0/2231178480 reap_dead start 2023-07-21T22:31:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.468+0000 7f050660a640 1 --2- 172.21.15.6:0/2231178480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04ec007390 0x7f04ec00dba0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f04f800e350 tx=0x7f04f801ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e9a13e6b0bb6401 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.468+0000 7f0504e07640 1 -- 172.21.15.6:0/2231178480 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f80a5e20 con 0x7f04ec007390 2023-07-21T22:31:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.468+0000 7f0504e07640 1 -- 172.21.15.6:0/2231178480 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f800f040 con 0x7f04ec007390 2023-07-21T22:31:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.468+0000 7f0504e07640 1 -- 172.21.15.6:0/2231178480 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8003be0 con 0x7f04ec007390 2023-07-21T22:31:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.472+0000 7f050806d640 1 -- 172.21.15.6:0/2231178480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04ec007390 msgr2=0x7f04ec00dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.472+0000 7f050806d640 1 --2- 172.21.15.6:0/2231178480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04ec007390 0x7f04ec00dba0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f04f800e350 tx=0x7f04f801ce30 comp rx=0 tx=0).stop 2023-07-21T22:31:33.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.472+0000 7f050806d640 1 -- 172.21.15.6:0/2231178480 shutdown_connections 2023-07-21T22:31:33.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.472+0000 7f050806d640 1 --2- 172.21.15.6:0/2231178480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04ec007390 0x7f04ec00dba0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:33.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.472+0000 7f050806d640 1 -- 172.21.15.6:0/2231178480 >> 172.21.15.6:0/2231178480 conn(0x7f05000cde90 msgr2=0x7f05000ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:33.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.472+0000 7f050806d640 1 -- 172.21.15.6:0/2231178480 shutdown_connections 2023-07-21T22:31:33.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.472+0000 7f050806d640 1 -- 172.21.15.6:0/2231178480 wait complete. 2023-07-21T22:31:33.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.472+0000 7f050806d640 1 Processor -- start 2023-07-21T22:31:33.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.472+0000 7f050806d640 1 -- start start 2023-07-21T22:31:33.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.472+0000 7f050806d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04ec007390 0x7f050006bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:33.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.472+0000 7f050806d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f050014ccb0 0x7f05000cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:33.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.472+0000 7f050806d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05000cb840 0x7f05000700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:33.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.472+0000 7f050806d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05000cbcb0 con 0x7f050014ccb0 2023-07-21T22:31:33.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.472+0000 7f050806d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050006c140 con 0x7f04ec007390 2023-07-21T22:31:33.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.472+0000 7f050806d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050006c530 con 0x7f05000cb840 2023-07-21T22:31:33.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.472+0000 7f0505608640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f050014ccb0 0x7f05000cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:33.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.472+0000 7f0505608640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f050014ccb0 0x7f05000cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58930/0 (socket says 172.21.15.6:58930) 2023-07-21T22:31:33.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.472+0000 7f0505608640 1 -- 172.21.15.6:0/3600363695 learned_addr learned my addr 172.21.15.6:0/3600363695 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:33.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.472+0000 7f050660a640 1 --2- 172.21.15.6:0/3600363695 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05000cb840 0x7f05000700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:33.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.472+0000 7f0505e09640 1 --2- 172.21.15.6:0/3600363695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04ec007390 0x7f050006bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:33.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.476+0000 7f0505608640 1 -- 172.21.15.6:0/3600363695 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05000cb840 msgr2=0x7f05000700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:33.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.476+0000 7f0505608640 1 --2- 172.21.15.6:0/3600363695 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05000cb840 0x7f05000700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:33.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.476+0000 7f0505608640 1 -- 172.21.15.6:0/3600363695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04ec007390 msgr2=0x7f050006bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:33.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.476+0000 7f0505608640 1 --2- 172.21.15.6:0/3600363695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04ec007390 0x7f050006bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:33.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.476+0000 7f0505608640 1 -- 172.21.15.6:0/3600363695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0500159840 con 0x7f050014ccb0 2023-07-21T22:31:33.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.476+0000 7f0505608640 1 --2- 172.21.15.6:0/3600363695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f050014ccb0 0x7f05000cb300 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f04f000f770 tx=0x7f04f000fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:33.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.476+0000 7f04f67fc640 1 -- 172.21.15.6:0/3600363695 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f0005110 con 0x7f050014ccb0 2023-07-21T22:31:33.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.476+0000 7f04f67fc640 1 -- 172.21.15.6:0/3600363695 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f0005270 con 0x7f050014ccb0 2023-07-21T22:31:33.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.476+0000 7f04f67fc640 1 -- 172.21.15.6:0/3600363695 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f0007030 con 0x7f050014ccb0 2023-07-21T22:31:33.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.476+0000 7f050806d640 1 -- 172.21.15.6:0/3600363695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050006c7d0 con 0x7f050014ccb0 2023-07-21T22:31:33.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.476+0000 7f050806d640 1 -- 172.21.15.6:0/3600363695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050006cd90 con 0x7f050014ccb0 2023-07-21T22:31:33.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.476+0000 7f050806d640 1 -- 172.21.15.6:0/3600363695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05000af810 con 0x7f050014ccb0 2023-07-21T22:31:33.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.476+0000 7f04f67fc640 1 -- 172.21.15.6:0/3600363695 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f04f00073a0 con 0x7f050014ccb0 2023-07-21T22:31:33.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.476+0000 7f04f67fc640 1 --2- 172.21.15.6:0/3600363695 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f04e4066480 0x7f04e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:33.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.476+0000 7f04f67fc640 1 -- 172.21.15.6:0/3600363695 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f04f0083af0 con 0x7f050014ccb0 2023-07-21T22:31:33.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.476+0000 7f0505e09640 1 --2- 172.21.15.6:0/3600363695 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f04e4066480 0x7f04e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:33.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.480+0000 7f0505e09640 1 --2- 172.21.15.6:0/3600363695 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f04e4066480 0x7f04e4068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f04fc001ec0 tx=0x7f04fc009040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:33.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.480+0000 7f04f67fc640 1 -- 172.21.15.6:0/3600363695 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f04f0050b30 con 0x7f050014ccb0 2023-07-21T22:31:33.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.652+0000 7f050806d640 1 -- 172.21.15.6:0/3600363695 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f050015c6f0 con 0x7f04e4066480 2023-07-21T22:31:33.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.740+0000 7f04f67fc640 1 -- 172.21.15.6:0/3600363695 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f04fc001540 con 0x7f04e4066480 2023-07-21T22:31:33.789 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule removed for path /snap_test_dir1/dir4 2023-07-21T22:31:33.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.740+0000 7f050806d640 1 -- 172.21.15.6:0/3600363695 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f04e4066480 msgr2=0x7f04e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:33.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.740+0000 7f050806d640 1 --2- 172.21.15.6:0/3600363695 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f04e4066480 0x7f04e4068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f04fc001ec0 tx=0x7f04fc009040 comp rx=0 tx=0).stop 2023-07-21T22:31:33.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.740+0000 7f050806d640 1 -- 172.21.15.6:0/3600363695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f050014ccb0 msgr2=0x7f05000cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:33.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.740+0000 7f050806d640 1 --2- 172.21.15.6:0/3600363695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f050014ccb0 0x7f05000cb300 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f04f000f770 tx=0x7f04f000fc30 comp rx=0 tx=0).stop 2023-07-21T22:31:33.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.744+0000 7f050806d640 1 -- 172.21.15.6:0/3600363695 shutdown_connections 2023-07-21T22:31:33.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.744+0000 7f050806d640 1 --2- 172.21.15.6:0/3600363695 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f04e4066480 0x7f04e4068930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:33.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.744+0000 7f050806d640 1 --2- 172.21.15.6:0/3600363695 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05000cb840 0x7f05000700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:33.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.744+0000 7f050806d640 1 --2- 172.21.15.6:0/3600363695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f050014ccb0 0x7f05000cb300 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:33.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.744+0000 7f050806d640 1 --2- 172.21.15.6:0/3600363695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04ec007390 0x7f050006bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:33.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.744+0000 7f050806d640 1 -- 172.21.15.6:0/3600363695 >> 172.21.15.6:0/3600363695 conn(0x7f05000cde90 msgr2=0x7f050014d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:33.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.744+0000 7f050806d640 1 -- 172.21.15.6:0/3600363695 shutdown_connections 2023-07-21T22:31:33.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:33.744+0000 7f050806d640 1 -- 172.21.15.6:0/3600363695 wait complete. 2023-07-21T22:31:33.810 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2023-07-21T22:31:33.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:33.811 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-07-21T22:31:33.823 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:33.823 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:33.823 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:33.823 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:33.824 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:33.824 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:33.824 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:33.824 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:33.824 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:33.825 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:33.825 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:33.826 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:33.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:33.827 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_21_00_UTC) 2023-07-21T22:31:33.928 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:33.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:33.929 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_22_00_UTC) 2023-07-21T22:31:33.998 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:33.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:33.999 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_23_00_UTC) 2023-07-21T22:31:34.033 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:34.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:34.034 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_24_00_UTC) 2023-07-21T22:31:34.100 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:34.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:34.101 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_25_00_UTC) 2023-07-21T22:31:34.165 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:34.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:34.167 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_26_00_UTC) 2023-07-21T22:31:34.236 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:34.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:34.237 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_27_00_UTC) 2023-07-21T22:31:34.311 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:34.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:34.312 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_28_00_UTC) 2023-07-21T22:31:34.386 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:34.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:34.388 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_29_00_UTC) 2023-07-21T22:31:34.445 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:34.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:34.446 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_30_00_UTC) 2023-07-21T22:31:34.505 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:34.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:34.506 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-21-22_31_00_UTC) 2023-07-21T22:31:34.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:34.562 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2023-07-21T22:31:34.614 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir5 1M 2023-07-21T22:31:34.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.756+0000 7f4fc534b640 1 Processor -- start 2023-07-21T22:31:34.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.756+0000 7f4fc534b640 1 -- start start 2023-07-21T22:31:34.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.756+0000 7f4fc534b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4fc00b0d50 0x7f4fc00cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:34.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.756+0000 7f4fc534b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc015f820 con 0x7f4fc00cf1d0 2023-07-21T22:31:34.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.756+0000 7f4fc534b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc015fa70 con 0x7f4fc00cc7d0 2023-07-21T22:31:34.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.756+0000 7f4fc534b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc015fd50 con 0x7f4fc00b0d50 2023-07-21T22:31:34.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.756+0000 7f4fc4b4a640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4fc00cf1d0 0x7f4fc00d0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35364/0 (socket says 172.21.15.6:35364) 2023-07-21T22:31:34.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.756+0000 7f4fc4b4a640 1 -- 172.21.15.6:0/3305375970 learned_addr learned my addr 172.21.15.6:0/3305375970 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:34.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.756+0000 7f4fbf7fe640 1 --2- 172.21.15.6:0/3305375970 >> v2:172.21.15.161:3300/0 conn(0x7f4fc00b0d50 0x7f4fc00cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:34.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.756+0000 7f4fbeffd640 1 -- 172.21.15.6:0/3305375970 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901362791 0 0) 0x7f4fc015f820 con 0x7f4fc00cf1d0 2023-07-21T22:31:34.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.756+0000 7f4fbeffd640 1 -- 172.21.15.6:0/3305375970 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fa8003530 con 0x7f4fc00cf1d0 2023-07-21T22:31:34.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.756+0000 7f4fbeffd640 1 -- 172.21.15.6:0/3305375970 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987798061 0 0) 0x7f4fc015fa70 con 0x7f4fc00cc7d0 2023-07-21T22:31:34.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.756+0000 7f4fbeffd640 1 -- 172.21.15.6:0/3305375970 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fc015f820 con 0x7f4fc00cc7d0 2023-07-21T22:31:34.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.756+0000 7f4fbf7fe640 1 -- 172.21.15.6:0/3305375970 >> v1:172.21.15.161:6789/0 conn(0x7f4fc00cc7d0 legacy=0x7f4fc00ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:34.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.756+0000 7f4fbf7fe640 1 -- 172.21.15.6:0/3305375970 >> v1:172.21.15.6:6789/0 conn(0x7f4fc00cf1d0 legacy=0x7f4fc00d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:34.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.756+0000 7f4fbf7fe640 1 -- 172.21.15.6:0/3305375970 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc0160030 con 0x7f4fc00b0d50 2023-07-21T22:31:34.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.760+0000 7f4fbf7fe640 1 --2- 172.21.15.6:0/3305375970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fc00b0d50 0x7f4fc00cfd50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40097c0 tx=0x7f4fb401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45beb948c1f2f698 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:34.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.760+0000 7f4fbeffd640 1 -- 172.21.15.6:0/3305375970 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40a8050 con 0x7f4fc00b0d50 2023-07-21T22:31:34.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.760+0000 7f4fbeffd640 1 -- 172.21.15.6:0/3305375970 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb40ac5f0 con 0x7f4fc00b0d50 2023-07-21T22:31:34.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.760+0000 7f4fbeffd640 1 -- 172.21.15.6:0/3305375970 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40ac960 con 0x7f4fc00b0d50 2023-07-21T22:31:34.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.760+0000 7f4fc534b640 1 -- 172.21.15.6:0/3305375970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fc00b0d50 msgr2=0x7f4fc00cfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:34.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.760+0000 7f4fc534b640 1 --2- 172.21.15.6:0/3305375970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fc00b0d50 0x7f4fc00cfd50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40097c0 tx=0x7f4fb401c480 comp rx=0 tx=0).stop 2023-07-21T22:31:34.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.760+0000 7f4fc534b640 1 -- 172.21.15.6:0/3305375970 shutdown_connections 2023-07-21T22:31:34.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.760+0000 7f4fc534b640 1 --2- 172.21.15.6:0/3305375970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fc00b0d50 0x7f4fc00cfd50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:34.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.760+0000 7f4fc534b640 1 -- 172.21.15.6:0/3305375970 >> 172.21.15.6:0/3305375970 conn(0x7f4fc0069e10 msgr2=0x7f4fc006a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:34.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.760+0000 7f4fc534b640 1 -- 172.21.15.6:0/3305375970 shutdown_connections 2023-07-21T22:31:34.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.760+0000 7f4fc534b640 1 -- 172.21.15.6:0/3305375970 wait complete. 2023-07-21T22:31:34.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fc534b640 1 Processor -- start 2023-07-21T22:31:34.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fc534b640 1 -- start start 2023-07-21T22:31:34.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fc534b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fc00b0d50 0x7f4fc00b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:34.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fc534b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc00cc7d0 0x7f4fc0159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:34.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fc534b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fc00cf1d0 0x7f4fc0157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:34.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fc534b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc00cac70 con 0x7f4fc00cc7d0 2023-07-21T22:31:34.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fc534b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc0151ec0 con 0x7f4fc00cf1d0 2023-07-21T22:31:34.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fc534b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc00b7e70 con 0x7f4fc00b0d50 2023-07-21T22:31:34.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fbf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc00cc7d0 0x7f4fc0159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fbf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc00cc7d0 0x7f4fc0159490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58944/0 (socket says 172.21.15.6:58944) 2023-07-21T22:31:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fbf7fe640 1 -- 172.21.15.6:0/1546846681 learned_addr learned my addr 172.21.15.6:0/1546846681 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fc4b4a640 1 --2- 172.21.15.6:0/1546846681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fc00cf1d0 0x7f4fc0157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fbffff640 1 --2- 172.21.15.6:0/1546846681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fc00b0d50 0x7f4fc00b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fbf7fe640 1 -- 172.21.15.6:0/1546846681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fc00b0d50 msgr2=0x7f4fc00b7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:34.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fbf7fe640 1 --2- 172.21.15.6:0/1546846681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fc00b0d50 0x7f4fc00b7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:34.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fbf7fe640 1 -- 172.21.15.6:0/1546846681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fc00cf1d0 msgr2=0x7f4fc0157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:34.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fbf7fe640 1 --2- 172.21.15.6:0/1546846681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fc00cf1d0 0x7f4fc0157f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:34.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fbf7fe640 1 -- 172.21.15.6:0/1546846681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb4009420 con 0x7f4fc00cc7d0 2023-07-21T22:31:34.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fc4b4a640 1 --2- 172.21.15.6:0/1546846681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fc00cf1d0 0x7f4fc0157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:34.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fbf7fe640 1 --2- 172.21.15.6:0/1546846681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc00cc7d0 0x7f4fc0159490 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40af040 tx=0x7f4fb4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:34.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fbcff9640 1 -- 172.21.15.6:0/1546846681 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40acb70 con 0x7f4fc00cc7d0 2023-07-21T22:31:34.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fbcff9640 1 -- 172.21.15.6:0/1546846681 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb40accd0 con 0x7f4fc00cc7d0 2023-07-21T22:31:34.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fbcff9640 1 -- 172.21.15.6:0/1546846681 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4003820 con 0x7f4fc00cc7d0 2023-07-21T22:31:34.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fc534b640 1 -- 172.21.15.6:0/1546846681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc00cae80 con 0x7f4fc00cc7d0 2023-07-21T22:31:34.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fc534b640 1 -- 172.21.15.6:0/1546846681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc00cb440 con 0x7f4fc00cc7d0 2023-07-21T22:31:34.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.764+0000 7f4fc534b640 1 -- 172.21.15.6:0/1546846681 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc004e020 con 0x7f4fc00cc7d0 2023-07-21T22:31:34.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.768+0000 7f4fbcff9640 1 -- 172.21.15.6:0/1546846681 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f4fb40b3040 con 0x7f4fc00cc7d0 2023-07-21T22:31:34.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.768+0000 7f4fbcff9640 1 --2- 172.21.15.6:0/1546846681 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4fac066480 0x7f4fac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:34.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.768+0000 7f4fbcff9640 1 -- 172.21.15.6:0/1546846681 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7525+0+0 (secure 0 0 0) 0x7f4fb411e230 con 0x7f4fc00cc7d0 2023-07-21T22:31:34.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.768+0000 7f4fbffff640 1 --2- 172.21.15.6:0/1546846681 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4fac066480 0x7f4fac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:34.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.768+0000 7f4fbffff640 1 --2- 172.21.15.6:0/1546846681 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4fac066480 0x7f4fac068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00011f0 tx=0x7f4fb0009040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:34.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.772+0000 7f4fbcff9640 1 -- 172.21.15.6:0/1546846681 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4fb40eac30 con 0x7f4fc00cc7d0 2023-07-21T22:31:35.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:34.960+0000 7f4fc534b640 1 -- 172.21.15.6:0/1546846681 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fc00d0db0 con 0x7f4fac066480 2023-07-21T22:31:35.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:35.064+0000 7f4fbcff9640 1 -- 172.21.15.6:0/1546846681 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f4fb0001cb0 con 0x7f4fac066480 2023-07-21T22:31:35.111 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule removed for path /snap_test_dir1/dir5 2023-07-21T22:31:35.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:35.064+0000 7f4fc534b640 1 -- 172.21.15.6:0/1546846681 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4fac066480 msgr2=0x7f4fac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:35.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:35.064+0000 7f4fc534b640 1 --2- 172.21.15.6:0/1546846681 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4fac066480 0x7f4fac068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00011f0 tx=0x7f4fb0009040 comp rx=0 tx=0).stop 2023-07-21T22:31:35.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:35.064+0000 7f4fc534b640 1 -- 172.21.15.6:0/1546846681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc00cc7d0 msgr2=0x7f4fc0159490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:35.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:35.064+0000 7f4fc534b640 1 --2- 172.21.15.6:0/1546846681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc00cc7d0 0x7f4fc0159490 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40af040 tx=0x7f4fb4019220 comp rx=0 tx=0).stop 2023-07-21T22:31:35.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:35.064+0000 7f4fc534b640 1 -- 172.21.15.6:0/1546846681 shutdown_connections 2023-07-21T22:31:35.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:35.064+0000 7f4fc534b640 1 --2- 172.21.15.6:0/1546846681 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4fac066480 0x7f4fac068930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:35.064+0000 7f4fc534b640 1 --2- 172.21.15.6:0/1546846681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fc00cf1d0 0x7f4fc0157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:35.064+0000 7f4fc534b640 1 --2- 172.21.15.6:0/1546846681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc00cc7d0 0x7f4fc0159490 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:35.064+0000 7f4fc534b640 1 --2- 172.21.15.6:0/1546846681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fc00b0d50 0x7f4fc00b7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:35.064+0000 7f4fc534b640 1 -- 172.21.15.6:0/1546846681 >> 172.21.15.6:0/1546846681 conn(0x7f4fc0069e10 msgr2=0x7f4fc015ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:35.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:35.064+0000 7f4fc534b640 1 -- 172.21.15.6:0/1546846681 shutdown_connections 2023-07-21T22:31:35.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:35.064+0000 7f4fc534b640 1 -- 172.21.15.6:0/1546846681 wait complete. 2023-07-21T22:31:35.132 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2023-07-21T22:31:35.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:35.133 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-07-21T22:31:35.144 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:35.144 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:35.144 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:35.145 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:35.145 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:35.145 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:35.145 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:35.145 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:35.145 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:35.146 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:35.146 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:35.146 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:35.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:35.147 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_21_00_UTC) 2023-07-21T22:31:35.211 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:35.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:35.212 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_22_00_UTC) 2023-07-21T22:31:35.273 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:35.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:35.274 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_23_00_UTC) 2023-07-21T22:31:35.330 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:35.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:35.330 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_24_00_UTC) 2023-07-21T22:31:35.386 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:35.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:35.387 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_25_00_UTC) 2023-07-21T22:31:35.450 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:35.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:35.451 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_26_00_UTC) 2023-07-21T22:31:35.506 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:35.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:35.507 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_27_00_UTC) 2023-07-21T22:31:35.561 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:35.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:35.562 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_28_00_UTC) 2023-07-21T22:31:35.618 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:35.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:35.619 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_29_00_UTC) 2023-07-21T22:31:35.681 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:35.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:35.682 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_30_00_UTC) 2023-07-21T22:31:35.737 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:35.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:35.738 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-21-22_31_00_UTC) 2023-07-21T22:31:35.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:35.793 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2023-07-21T22:31:35.850 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir6 1M 2023-07-21T22:31:36.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.008+0000 7fd981b37640 1 Processor -- start 2023-07-21T22:31:36.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.008+0000 7fd981b37640 1 -- start start 2023-07-21T22:31:36.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.008+0000 7fd981b37640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd97c0d2fc0 0x7fd97c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:36.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.012+0000 7fd981b37640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd97c0d2300 0x7fd97c0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:36.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.012+0000 7fd981b37640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd97c0b04c0 con 0x7fd97c15bde0 2023-07-21T22:31:36.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.012+0000 7fd981b37640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd97c0d2ce0 con 0x7fd97c0d2300 2023-07-21T22:31:36.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.012+0000 7fd981b37640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c15c1b0 con 0x7fd97c0d2fc0 2023-07-21T22:31:36.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.012+0000 7fd97b7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd97c15bde0 0x7fd97c0d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:40144/0 (socket says 172.21.15.6:40144) 2023-07-21T22:31:36.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.012+0000 7fd97b7fe640 1 -- 172.21.15.6:0/1316365677 learned_addr learned my addr 172.21.15.6:0/1316365677 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:36.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.012+0000 7fd97bfff640 1 --2- 172.21.15.6:0/1316365677 >> v2:172.21.15.161:3300/0 conn(0x7fd97c0d2300 0x7fd97c0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:36.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.012+0000 7fd97a7fc640 1 -- 172.21.15.6:0/1316365677 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434384034 0 0) 0x7fd97c0b04c0 con 0x7fd97c15bde0 2023-07-21T22:31:36.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.012+0000 7fd97a7fc640 1 -- 172.21.15.6:0/1316365677 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd968003530 con 0x7fd97c15bde0 2023-07-21T22:31:36.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.012+0000 7fd97affd640 1 --2- 172.21.15.6:0/1316365677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd97c0d2fc0 0x7fd97c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:36.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.012+0000 7fd97bfff640 1 -- 172.21.15.6:0/1316365677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd97c0d2fc0 msgr2=0x7fd97c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:36.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.012+0000 7fd97bfff640 1 --2- 172.21.15.6:0/1316365677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd97c0d2fc0 0x7fd97c0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:36.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.012+0000 7fd97a7fc640 1 -- 172.21.15.6:0/1316365677 <== mon.1 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1391694100 0 0) 0x7fd968003530 con 0x7fd97c15bde0 2023-07-21T22:31:36.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.012+0000 7fd97bfff640 1 -- 172.21.15.6:0/1316365677 >> v1:172.21.15.161:6789/0 conn(0x7fd97c15bde0 legacy=0x7fd97c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:36.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.012+0000 7fd97bfff640 1 -- 172.21.15.6:0/1316365677 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c0d0aa0 con 0x7fd97c0d2300 2023-07-21T22:31:36.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.016+0000 7fd97bfff640 1 --2- 172.21.15.6:0/1316365677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd97c0d2300 0x7fd97c0d27a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009d90 tx=0x7fd96c01c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3047caa43173343a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:36.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.016+0000 7fd97a7fc640 1 -- 172.21.15.6:0/1316365677 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9740016d0 con 0x7fd97c0d2300 2023-07-21T22:31:36.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.016+0000 7fd97a7fc640 1 -- 172.21.15.6:0/1316365677 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96c0a5670 con 0x7fd97c0d2300 2023-07-21T22:31:36.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.016+0000 7fd97a7fc640 1 -- 172.21.15.6:0/1316365677 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96c0a5a00 con 0x7fd97c0d2300 2023-07-21T22:31:36.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.016+0000 7fd981b37640 1 -- 172.21.15.6:0/1316365677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd97c0d2300 msgr2=0x7fd97c0d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:36.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.016+0000 7fd981b37640 1 --2- 172.21.15.6:0/1316365677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd97c0d2300 0x7fd97c0d27a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd96c009d90 tx=0x7fd96c01c870 comp rx=0 tx=0).stop 2023-07-21T22:31:36.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.020+0000 7fd981b37640 1 -- 172.21.15.6:0/1316365677 shutdown_connections 2023-07-21T22:31:36.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.020+0000 7fd981b37640 1 --2- 172.21.15.6:0/1316365677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd97c0d2300 0x7fd97c0d27a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:36.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.020+0000 7fd981b37640 1 --2- 172.21.15.6:0/1316365677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd97c0d2fc0 0x7fd97c0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:36.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.020+0000 7fd981b37640 1 -- 172.21.15.6:0/1316365677 >> 172.21.15.6:0/1316365677 conn(0x7fd97c0659d0 msgr2=0x7fd97c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:36.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.024+0000 7fd981b37640 1 -- 172.21.15.6:0/1316365677 shutdown_connections 2023-07-21T22:31:36.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.024+0000 7fd981b37640 1 -- 172.21.15.6:0/1316365677 wait complete. 2023-07-21T22:31:36.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.028+0000 7fd981b37640 1 Processor -- start 2023-07-21T22:31:36.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.032+0000 7fd981b37640 1 -- start start 2023-07-21T22:31:36.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.032+0000 7fd981b37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd97c0d2300 0x7fd97c0b75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:36.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.032+0000 7fd981b37640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd97c0d2fc0 0x7fd97c15d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:36.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.032+0000 7fd981b37640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd97c15bde0 0x7fd97c15d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:36.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.032+0000 7fd981b37640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c0c6a50 con 0x7fd97c0d2300 2023-07-21T22:31:36.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.032+0000 7fd981b37640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c0c6cf0 con 0x7fd97c0d2fc0 2023-07-21T22:31:36.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.032+0000 7fd981b37640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c15c690 con 0x7fd97c15bde0 2023-07-21T22:31:36.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.032+0000 7fd97b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd97c0d2300 0x7fd97c0b75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:36.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.032+0000 7fd97b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd97c0d2300 0x7fd97c0b75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58956/0 (socket says 172.21.15.6:58956) 2023-07-21T22:31:36.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.032+0000 7fd97b7fe640 1 -- 172.21.15.6:0/2018666460 learned_addr learned my addr 172.21.15.6:0/2018666460 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:36.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.032+0000 7fd97affd640 1 --2- 172.21.15.6:0/2018666460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd97c0d2fc0 0x7fd97c15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:36.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.032+0000 7fd97bfff640 1 --2- 172.21.15.6:0/2018666460 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd97c15bde0 0x7fd97c15d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:36.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.036+0000 7fd97b7fe640 1 -- 172.21.15.6:0/2018666460 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd97c15bde0 msgr2=0x7fd97c15d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:36.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.036+0000 7fd97b7fe640 1 --2- 172.21.15.6:0/2018666460 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd97c15bde0 0x7fd97c15d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:36.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.036+0000 7fd97b7fe640 1 -- 172.21.15.6:0/2018666460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd97c0d2fc0 msgr2=0x7fd97c15d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:36.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.036+0000 7fd97b7fe640 1 --2- 172.21.15.6:0/2018666460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd97c0d2fc0 0x7fd97c15d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:36.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.036+0000 7fd97b7fe640 1 -- 172.21.15.6:0/2018666460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96c009a70 con 0x7fd97c0d2300 2023-07-21T22:31:36.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.036+0000 7fd97b7fe640 1 --2- 172.21.15.6:0/2018666460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd97c0d2300 0x7fd97c0b75d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd974007f20 tx=0x7fd97400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:36.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.036+0000 7fd973fff640 1 -- 172.21.15.6:0/2018666460 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974005930 con 0x7fd97c0d2300 2023-07-21T22:31:36.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.036+0000 7fd973fff640 1 -- 172.21.15.6:0/2018666460 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd974005a90 con 0x7fd97c0d2300 2023-07-21T22:31:36.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.036+0000 7fd973fff640 1 -- 172.21.15.6:0/2018666460 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974005e20 con 0x7fd97c0d2300 2023-07-21T22:31:36.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.036+0000 7fd981b37640 1 -- 172.21.15.6:0/2018666460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97c15c970 con 0x7fd97c0d2300 2023-07-21T22:31:36.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.036+0000 7fd981b37640 1 -- 172.21.15.6:0/2018666460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97c14d470 con 0x7fd97c0d2300 2023-07-21T22:31:36.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.040+0000 7fd981b37640 1 -- 172.21.15.6:0/2018666460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97c0678d0 con 0x7fd97c0d2300 2023-07-21T22:31:36.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.040+0000 7fd973fff640 1 -- 172.21.15.6:0/2018666460 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fd974007070 con 0x7fd97c0d2300 2023-07-21T22:31:36.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.044+0000 7fd973fff640 1 --2- 172.21.15.6:0/2018666460 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fd95c0664d0 0x7fd95c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:36.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.044+0000 7fd973fff640 1 -- 172.21.15.6:0/2018666460 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 7365+0+0 (secure 0 0 0) 0x7fd9740a5fc0 con 0x7fd97c0d2300 2023-07-21T22:31:36.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.044+0000 7fd97affd640 1 --2- 172.21.15.6:0/2018666460 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fd95c0664d0 0x7fd95c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:36.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.048+0000 7fd97affd640 1 --2- 172.21.15.6:0/2018666460 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fd95c0664d0 0x7fd95c068980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd97c159d50 tx=0x7fd964009190 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:36.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.052+0000 7fd973fff640 1 -- 172.21.15.6:0/2018666460 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd974072e10 con 0x7fd97c0d2300 2023-07-21T22:31:36.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.256+0000 7fd981b37640 1 -- 172.21.15.6:0/2018666460 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd97c0c6e60 con 0x7fd95c0664d0 2023-07-21T22:31:36.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.328+0000 7fd973fff640 1 -- 172.21.15.6:0/2018666460 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fd97c0c6e60 con 0x7fd95c0664d0 2023-07-21T22:31:36.378 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule removed for path /snap_test_dir1/dir6 2023-07-21T22:31:36.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.332+0000 7fd981b37640 1 -- 172.21.15.6:0/2018666460 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fd95c0664d0 msgr2=0x7fd95c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:36.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.332+0000 7fd981b37640 1 --2- 172.21.15.6:0/2018666460 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fd95c0664d0 0x7fd95c068980 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd97c159d50 tx=0x7fd964009190 comp rx=0 tx=0).stop 2023-07-21T22:31:36.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.332+0000 7fd981b37640 1 -- 172.21.15.6:0/2018666460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd97c0d2300 msgr2=0x7fd97c0b75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:36.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.332+0000 7fd981b37640 1 --2- 172.21.15.6:0/2018666460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd97c0d2300 0x7fd97c0b75d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd974007f20 tx=0x7fd97400cb90 comp rx=0 tx=0).stop 2023-07-21T22:31:36.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.332+0000 7fd981b37640 1 -- 172.21.15.6:0/2018666460 shutdown_connections 2023-07-21T22:31:36.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.332+0000 7fd981b37640 1 --2- 172.21.15.6:0/2018666460 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fd95c0664d0 0x7fd95c068980 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:36.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.332+0000 7fd981b37640 1 --2- 172.21.15.6:0/2018666460 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd97c15bde0 0x7fd97c15d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:36.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.332+0000 7fd981b37640 1 --2- 172.21.15.6:0/2018666460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd97c0d2fc0 0x7fd97c15d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:36.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.332+0000 7fd981b37640 1 --2- 172.21.15.6:0/2018666460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd97c0d2300 0x7fd97c0b75d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:36.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.332+0000 7fd981b37640 1 -- 172.21.15.6:0/2018666460 >> 172.21.15.6:0/2018666460 conn(0x7fd97c0659d0 msgr2=0x7fd97c0cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:36.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.332+0000 7fd981b37640 1 -- 172.21.15.6:0/2018666460 shutdown_connections 2023-07-21T22:31:36.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:36.332+0000 7fd981b37640 1 -- 172.21.15.6:0/2018666460 wait complete. 2023-07-21T22:31:36.399 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2023-07-21T22:31:36.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:36.400 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-07-21T22:31:36.410 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:36.410 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:36.410 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:36.410 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:36.411 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:36.411 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:36.411 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:36.411 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:36.411 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:36.411 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:36.411 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:36.412 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:36.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:36.413 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_21_00_UTC) 2023-07-21T22:31:36.470 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:36.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:36.471 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_22_00_UTC) 2023-07-21T22:31:36.525 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:36.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:36.526 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_23_00_UTC) 2023-07-21T22:31:36.581 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:36.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:36.582 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_24_00_UTC) 2023-07-21T22:31:36.636 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:36.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:36.637 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_25_00_UTC) 2023-07-21T22:31:36.692 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:36.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:36.693 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_26_00_UTC) 2023-07-21T22:31:36.749 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:36.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:36.749 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_27_00_UTC) 2023-07-21T22:31:36.806 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:36.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:36.806 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_28_00_UTC) 2023-07-21T22:31:36.876 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:36.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:36.877 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_29_00_UTC) 2023-07-21T22:31:36.937 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:36.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:36.938 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_30_00_UTC) 2023-07-21T22:31:36.993 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:36.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:36.994 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-21-22_31_00_UTC) 2023-07-21T22:31:37.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:37.058 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2023-07-21T22:31:37.117 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir7 1M 2023-07-21T22:31:37.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.284+0000 7f3be9e48640 1 Processor -- start 2023-07-21T22:31:37.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.284+0000 7f3be9e48640 1 -- start start 2023-07-21T22:31:37.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.284+0000 7f3be9e48640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3be41453a0 0x7f3be40b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:37.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.284+0000 7f3be9e48640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be406c040 con 0x7f3be406a440 2023-07-21T22:31:37.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.284+0000 7f3be9e48640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be4160600 con 0x7f3be415f690 2023-07-21T22:31:37.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.284+0000 7f3be9e48640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be4160170 con 0x7f3be41453a0 2023-07-21T22:31:37.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.284+0000 7f3be2ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3be406a440 0x7f3be406c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35372/0 (socket says 172.21.15.6:35372) 2023-07-21T22:31:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.284+0000 7f3be2ffd640 1 -- 172.21.15.6:0/2341726083 learned_addr learned my addr 172.21.15.6:0/2341726083 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.284+0000 7f3be3fff640 1 --2- 172.21.15.6:0/2341726083 >> v2:172.21.15.161:3300/0 conn(0x7f3be41453a0 0x7f3be40b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.288+0000 7f3be27fc640 1 -- 172.21.15.6:0/2341726083 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 318571322 0 0) 0x7f3be406c040 con 0x7f3be406a440 2023-07-21T22:31:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.288+0000 7f3be27fc640 1 -- 172.21.15.6:0/2341726083 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bcc003530 con 0x7f3be406a440 2023-07-21T22:31:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.288+0000 7f3be3fff640 1 -- 172.21.15.6:0/2341726083 >> v1:172.21.15.161:6789/0 conn(0x7f3be415f690 legacy=0x7f3be415fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.288+0000 7f3be3fff640 1 -- 172.21.15.6:0/2341726083 >> v1:172.21.15.6:6789/0 conn(0x7f3be406a440 legacy=0x7f3be406c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.288+0000 7f3be3fff640 1 -- 172.21.15.6:0/2341726083 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be4160360 con 0x7f3be41453a0 2023-07-21T22:31:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.288+0000 7f3be3fff640 1 --2- 172.21.15.6:0/2341726083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3be41453a0 0x7f3be40b1890 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009d90 tx=0x7f3bdc01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88832b6715229858 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:37.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.288+0000 7f3be27fc640 1 -- 172.21.15.6:0/2341726083 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0a5860 con 0x7f3be41453a0 2023-07-21T22:31:37.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.288+0000 7f3be27fc640 1 -- 172.21.15.6:0/2341726083 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc0a59c0 con 0x7f3be41453a0 2023-07-21T22:31:37.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.288+0000 7f3be27fc640 1 -- 172.21.15.6:0/2341726083 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0a5d30 con 0x7f3be41453a0 2023-07-21T22:31:37.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be9e48640 1 -- 172.21.15.6:0/2341726083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3be41453a0 msgr2=0x7f3be40b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:37.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be9e48640 1 --2- 172.21.15.6:0/2341726083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3be41453a0 0x7f3be40b1890 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009d90 tx=0x7f3bdc01c890 comp rx=0 tx=0).stop 2023-07-21T22:31:37.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be9e48640 1 -- 172.21.15.6:0/2341726083 shutdown_connections 2023-07-21T22:31:37.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be9e48640 1 --2- 172.21.15.6:0/2341726083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3be41453a0 0x7f3be40b1890 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:37.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be9e48640 1 -- 172.21.15.6:0/2341726083 >> 172.21.15.6:0/2341726083 conn(0x7f3be40b1210 msgr2=0x7f3be40ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:37.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be9e48640 1 -- 172.21.15.6:0/2341726083 shutdown_connections 2023-07-21T22:31:37.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be9e48640 1 -- 172.21.15.6:0/2341726083 wait complete. 2023-07-21T22:31:37.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be9e48640 1 Processor -- start 2023-07-21T22:31:37.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be9e48640 1 -- start start 2023-07-21T22:31:37.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be9e48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be406a440 0x7f3be415e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:37.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be9e48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3be41453a0 0x7f3be415b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:37.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be9e48640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3be415f690 0x7f3be413a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:37.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be9e48640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be4139e40 con 0x7f3be406a440 2023-07-21T22:31:37.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be9e48640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be415c780 con 0x7f3be415f690 2023-07-21T22:31:37.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be9e48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be415ef20 con 0x7f3be41453a0 2023-07-21T22:31:37.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be406a440 0x7f3be415e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:37.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be406a440 0x7f3be415e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58960/0 (socket says 172.21.15.6:58960) 2023-07-21T22:31:37.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be37fe640 1 -- 172.21.15.6:0/4089015438 learned_addr learned my addr 172.21.15.6:0/4089015438 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:37.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be3fff640 1 --2- 172.21.15.6:0/4089015438 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3be415f690 0x7f3be413a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:37.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be2ffd640 1 --2- 172.21.15.6:0/4089015438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3be41453a0 0x7f3be415b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:37.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be37fe640 1 -- 172.21.15.6:0/4089015438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3be41453a0 msgr2=0x7f3be415b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:37.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be37fe640 1 --2- 172.21.15.6:0/4089015438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3be41453a0 0x7f3be415b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:37.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be37fe640 1 -- 172.21.15.6:0/4089015438 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3be415f690 msgr2=0x7f3be413a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:37.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be37fe640 1 --2- 172.21.15.6:0/4089015438 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3be415f690 0x7f3be413a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:37.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.292+0000 7f3be37fe640 1 -- 172.21.15.6:0/4089015438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc009a70 con 0x7f3be406a440 2023-07-21T22:31:37.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.296+0000 7f3be37fe640 1 --2- 172.21.15.6:0/4089015438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be406a440 0x7f3be415e9e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3bd400c450 tx=0x7f3bd400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:37.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.296+0000 7f3bcbfff640 1 -- 172.21.15.6:0/4089015438 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd40052d0 con 0x7f3be406a440 2023-07-21T22:31:37.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.296+0000 7f3bcbfff640 1 -- 172.21.15.6:0/4089015438 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd4005430 con 0x7f3be406a440 2023-07-21T22:31:37.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.296+0000 7f3bcbfff640 1 -- 172.21.15.6:0/4089015438 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd4007260 con 0x7f3be406a440 2023-07-21T22:31:37.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.296+0000 7f3be9e48640 1 -- 172.21.15.6:0/4089015438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be415be70 con 0x7f3be406a440 2023-07-21T22:31:37.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.296+0000 7f3be9e48640 1 -- 172.21.15.6:0/4089015438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be4139b60 con 0x7f3be406a440 2023-07-21T22:31:37.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.296+0000 7f3be9e48640 1 -- 172.21.15.6:0/4089015438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be40678d0 con 0x7f3be406a440 2023-07-21T22:31:37.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.296+0000 7f3bcbfff640 1 -- 172.21.15.6:0/4089015438 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f3bd40073c0 con 0x7f3be406a440 2023-07-21T22:31:37.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.296+0000 7f3bcbfff640 1 --2- 172.21.15.6:0/4089015438 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3bd0066480 0x7f3bd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:37.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.296+0000 7f3bcbfff640 1 -- 172.21.15.6:0/4089015438 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7237+0+0 (secure 0 0 0) 0x7f3bd4083c20 con 0x7f3be406a440 2023-07-21T22:31:37.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.296+0000 7f3be2ffd640 1 --2- 172.21.15.6:0/4089015438 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3bd0066480 0x7f3bd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:37.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.300+0000 7f3be2ffd640 1 --2- 172.21.15.6:0/4089015438 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3bd0066480 0x7f3bd0068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3be4132b10 tx=0x7f3bd8007d40 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:37.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.300+0000 7f3bcbfff640 1 -- 172.21.15.6:0/4089015438 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3bd4050ac0 con 0x7f3be406a440 2023-07-21T22:31:37.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.472+0000 7f3be9e48640 1 -- 172.21.15.6:0/4089015438 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3be406ad80 con 0x7f3bd0066480 2023-07-21T22:31:37.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.544+0000 7f3bcbfff640 1 -- 172.21.15.6:0/4089015438 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f3bd8005860 con 0x7f3bd0066480 2023-07-21T22:31:37.594 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule removed for path /snap_test_dir1/dir7 2023-07-21T22:31:37.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.548+0000 7f3be9e48640 1 -- 172.21.15.6:0/4089015438 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3bd0066480 msgr2=0x7f3bd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:37.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.548+0000 7f3be9e48640 1 --2- 172.21.15.6:0/4089015438 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3bd0066480 0x7f3bd0068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3be4132b10 tx=0x7f3bd8007d40 comp rx=0 tx=0).stop 2023-07-21T22:31:37.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.548+0000 7f3be9e48640 1 -- 172.21.15.6:0/4089015438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be406a440 msgr2=0x7f3be415e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:37.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.548+0000 7f3be9e48640 1 --2- 172.21.15.6:0/4089015438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be406a440 0x7f3be415e9e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3bd400c450 tx=0x7f3bd400c910 comp rx=0 tx=0).stop 2023-07-21T22:31:37.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.548+0000 7f3be9e48640 1 -- 172.21.15.6:0/4089015438 shutdown_connections 2023-07-21T22:31:37.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.548+0000 7f3be9e48640 1 --2- 172.21.15.6:0/4089015438 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3bd0066480 0x7f3bd0068930 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:37.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.548+0000 7f3be9e48640 1 --2- 172.21.15.6:0/4089015438 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3be415f690 0x7f3be413a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:37.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.548+0000 7f3be9e48640 1 --2- 172.21.15.6:0/4089015438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3be41453a0 0x7f3be415b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:37.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.548+0000 7f3be9e48640 1 --2- 172.21.15.6:0/4089015438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3be406a440 0x7f3be415e9e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:37.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.548+0000 7f3be9e48640 1 -- 172.21.15.6:0/4089015438 >> 172.21.15.6:0/4089015438 conn(0x7f3be40b1210 msgr2=0x7f3be40b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:37.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.548+0000 7f3be9e48640 1 -- 172.21.15.6:0/4089015438 shutdown_connections 2023-07-21T22:31:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:37.548+0000 7f3be9e48640 1 -- 172.21.15.6:0/4089015438 wait complete. 2023-07-21T22:31:37.615 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2023-07-21T22:31:37.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:37.616 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-07-21T22:31:37.626 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:37.626 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:37.626 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:37.627 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:37.627 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:37.627 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:37.627 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:37.627 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:37.627 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:37.627 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:37.627 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:37.628 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:37.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:37.629 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_21_00_UTC) 2023-07-21T22:31:37.686 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:37.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:37.687 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_22_00_UTC) 2023-07-21T22:31:37.749 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:37.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:37.750 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_23_00_UTC) 2023-07-21T22:31:37.810 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:37.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:37.810 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_24_00_UTC) 2023-07-21T22:31:37.905 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:37.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:37.905 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_25_00_UTC) 2023-07-21T22:31:37.920 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:37.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:37.921 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_26_00_UTC) 2023-07-21T22:31:37.976 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:37.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:37.977 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_27_00_UTC) 2023-07-21T22:31:38.037 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:38.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:38.037 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_28_00_UTC) 2023-07-21T22:31:38.092 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:38.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:38.093 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_29_00_UTC) 2023-07-21T22:31:38.149 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:38.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:38.149 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_30_00_UTC) 2023-07-21T22:31:38.207 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:38.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:38.208 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-21-22_31_00_UTC) 2023-07-21T22:31:38.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:38.266 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2023-07-21T22:31:38.318 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir8 1M 2023-07-21T22:31:38.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.456+0000 7f3c2bf2c640 1 Processor -- start 2023-07-21T22:31:38.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.456+0000 7f3c2bf2c640 1 -- start start 2023-07-21T22:31:38.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.460+0000 7f3c2bf2c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c2415cef0 0x7f3c24158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:38.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.460+0000 7f3c2bf2c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c24159270 0x7f3c240c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:38.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.460+0000 7f3c2bf2c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c241532b0 con 0x7f3c240aeb40 2023-07-21T22:31:38.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.460+0000 7f3c2bf2c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c2415d360 con 0x7f3c24159270 2023-07-21T22:31:38.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.460+0000 7f3c2bf2c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240ca6f0 con 0x7f3c2415cef0 2023-07-21T22:31:38.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.460+0000 7f3c2a4c9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c24159270 0x7f3c240c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:38.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.460+0000 7f3c2a4c9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c24159270 0x7f3c240c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38834/0 (socket says 172.21.15.6:38834) 2023-07-21T22:31:38.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.460+0000 7f3c2a4c9640 1 -- 172.21.15.6:0/659384718 learned_addr learned my addr 172.21.15.6:0/659384718 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:38.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.460+0000 7f3c294c7640 1 --2- 172.21.15.6:0/659384718 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c2415cef0 0x7f3c24158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:38.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.460+0000 7f3c2a4c9640 1 -- 172.21.15.6:0/659384718 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c2415cef0 msgr2=0x7f3c24158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:38.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.460+0000 7f3c2a4c9640 1 --2- 172.21.15.6:0/659384718 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c2415cef0 0x7f3c24158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:38.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.460+0000 7f3c2a4c9640 1 -- 172.21.15.6:0/659384718 >> v1:172.21.15.161:6789/0 conn(0x7f3c240aeb40 legacy=0x7f3c240aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:38.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.460+0000 7f3c2a4c9640 1 -- 172.21.15.6:0/659384718 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c241599d0 con 0x7f3c24159270 2023-07-21T22:31:38.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.464+0000 7f3c2a4c9640 1 --2- 172.21.15.6:0/659384718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c24159270 0x7f3c240c88c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c009e50 tx=0x7f3c1c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d3d37cb2779872 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:38.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.464+0000 7f3c28cc6640 1 -- 172.21.15.6:0/659384718 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0a5820 con 0x7f3c24159270 2023-07-21T22:31:38.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.464+0000 7f3c28cc6640 1 -- 172.21.15.6:0/659384718 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1c0a5980 con 0x7f3c24159270 2023-07-21T22:31:38.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.464+0000 7f3c28cc6640 1 -- 172.21.15.6:0/659384718 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0a5d10 con 0x7f3c24159270 2023-07-21T22:31:38.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.464+0000 7f3c2bf2c640 1 -- 172.21.15.6:0/659384718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c24159270 msgr2=0x7f3c240c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:38.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.464+0000 7f3c2bf2c640 1 --2- 172.21.15.6:0/659384718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c24159270 0x7f3c240c88c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c009e50 tx=0x7f3c1c01c9a0 comp rx=0 tx=0).stop 2023-07-21T22:31:38.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.464+0000 7f3c2bf2c640 1 -- 172.21.15.6:0/659384718 shutdown_connections 2023-07-21T22:31:38.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.464+0000 7f3c2bf2c640 1 --2- 172.21.15.6:0/659384718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c24159270 0x7f3c240c88c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:38.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.464+0000 7f3c2bf2c640 1 --2- 172.21.15.6:0/659384718 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c2415cef0 0x7f3c24158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:38.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.464+0000 7f3c2bf2c640 1 -- 172.21.15.6:0/659384718 >> 172.21.15.6:0/659384718 conn(0x7f3c240cde90 msgr2=0x7f3c240ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:38.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.464+0000 7f3c2bf2c640 1 -- 172.21.15.6:0/659384718 shutdown_connections 2023-07-21T22:31:38.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.464+0000 7f3c2bf2c640 1 -- 172.21.15.6:0/659384718 wait complete. 2023-07-21T22:31:38.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.464+0000 7f3c2bf2c640 1 Processor -- start 2023-07-21T22:31:38.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.464+0000 7f3c2bf2c640 1 -- start start 2023-07-21T22:31:38.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c2bf2c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c240aeb40 0x7f3c2414dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:38.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c2bf2c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c24159270 0x7f3c2414d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:38.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c2bf2c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c2415cef0 0x7f3c240b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:38.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c2bf2c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240b1420 con 0x7f3c24159270 2023-07-21T22:31:38.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c2bf2c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c24151b60 con 0x7f3c2415cef0 2023-07-21T22:31:38.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c2bf2c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c24151e40 con 0x7f3c240aeb40 2023-07-21T22:31:38.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c294c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c24159270 0x7f3c2414d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:38.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c294c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c24159270 0x7f3c2414d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38844/0 (socket says 172.21.15.6:38844) 2023-07-21T22:31:38.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c294c7640 1 -- 172.21.15.6:0/1061765806 learned_addr learned my addr 172.21.15.6:0/1061765806 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:38.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c294c7640 1 -- 172.21.15.6:0/1061765806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c240aeb40 msgr2=0x7f3c2414dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:38.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c294c7640 1 --2- 172.21.15.6:0/1061765806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c240aeb40 0x7f3c2414dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:38.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c2a4c9640 1 --2- 172.21.15.6:0/1061765806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c2415cef0 0x7f3c240b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:38.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c294c7640 1 -- 172.21.15.6:0/1061765806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c2415cef0 msgr2=0x7f3c240b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:38.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c294c7640 1 --2- 172.21.15.6:0/1061765806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c2415cef0 0x7f3c240b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:38.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c294c7640 1 -- 172.21.15.6:0/1061765806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c009b30 con 0x7f3c24159270 2023-07-21T22:31:38.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c2a4c9640 1 --2- 172.21.15.6:0/1061765806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c2415cef0 0x7f3c240b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:31:38.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c294c7640 1 --2- 172.21.15.6:0/1061765806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c24159270 0x7f3c2414d980 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3c1400d5f0 tx=0x7f3c1400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:38.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c1a7fc640 1 -- 172.21.15.6:0/1061765806 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c140125f0 con 0x7f3c24159270 2023-07-21T22:31:38.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c1a7fc640 1 -- 172.21.15.6:0/1061765806 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c14012750 con 0x7f3c24159270 2023-07-21T22:31:38.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c1a7fc640 1 -- 172.21.15.6:0/1061765806 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c14012ae0 con 0x7f3c24159270 2023-07-21T22:31:38.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c2bf2c640 1 -- 172.21.15.6:0/1061765806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c24153ef0 con 0x7f3c24159270 2023-07-21T22:31:38.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c2bf2c640 1 -- 172.21.15.6:0/1061765806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c24152120 con 0x7f3c24159270 2023-07-21T22:31:38.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.468+0000 7f3c2bf2c640 1 -- 172.21.15.6:0/1061765806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c240678d0 con 0x7f3c24159270 2023-07-21T22:31:38.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.472+0000 7f3c1a7fc640 1 -- 172.21.15.6:0/1061765806 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f3c14012c40 con 0x7f3c24159270 2023-07-21T22:31:38.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.472+0000 7f3c1a7fc640 1 --2- 172.21.15.6:0/1061765806 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3c08066480 0x7f3c08068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:38.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.472+0000 7f3c1a7fc640 1 -- 172.21.15.6:0/1061765806 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 7077+0+0 (secure 0 0 0) 0x7f3c14084a40 con 0x7f3c24159270 2023-07-21T22:31:38.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.472+0000 7f3c29cc8640 1 --2- 172.21.15.6:0/1061765806 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3c08066480 0x7f3c08068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:38.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.472+0000 7f3c29cc8640 1 --2- 172.21.15.6:0/1061765806 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3c08066480 0x7f3c08068930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3c20003cf0 tx=0x7f3c200079c0 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:38.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.476+0000 7f3c1a7fc640 1 -- 172.21.15.6:0/1061765806 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3c140517a0 con 0x7f3c24159270 2023-07-21T22:31:38.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.656+0000 7f3c2bf2c640 1 -- 172.21.15.6:0/1061765806 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c2415c9d0 con 0x7f3c08066480 2023-07-21T22:31:38.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.728+0000 7f3c1a7fc640 1 -- 172.21.15.6:0/1061765806 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f3c20005030 con 0x7f3c08066480 2023-07-21T22:31:38.779 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule removed for path /snap_test_dir1/dir8 2023-07-21T22:31:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.732+0000 7f3c2bf2c640 1 -- 172.21.15.6:0/1061765806 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3c08066480 msgr2=0x7f3c08068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.732+0000 7f3c2bf2c640 1 --2- 172.21.15.6:0/1061765806 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3c08066480 0x7f3c08068930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3c20003cf0 tx=0x7f3c200079c0 comp rx=0 tx=0).stop 2023-07-21T22:31:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.732+0000 7f3c2bf2c640 1 -- 172.21.15.6:0/1061765806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c24159270 msgr2=0x7f3c2414d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.732+0000 7f3c2bf2c640 1 --2- 172.21.15.6:0/1061765806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c24159270 0x7f3c2414d980 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3c1400d5f0 tx=0x7f3c1400dab0 comp rx=0 tx=0).stop 2023-07-21T22:31:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.732+0000 7f3c2bf2c640 1 -- 172.21.15.6:0/1061765806 shutdown_connections 2023-07-21T22:31:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.732+0000 7f3c2bf2c640 1 --2- 172.21.15.6:0/1061765806 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f3c08066480 0x7f3c08068930 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:38.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.732+0000 7f3c2bf2c640 1 --2- 172.21.15.6:0/1061765806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c2415cef0 0x7f3c240b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:38.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.732+0000 7f3c2bf2c640 1 --2- 172.21.15.6:0/1061765806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c24159270 0x7f3c2414d980 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:38.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.732+0000 7f3c2bf2c640 1 --2- 172.21.15.6:0/1061765806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c240aeb40 0x7f3c2414dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:38.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.732+0000 7f3c2bf2c640 1 -- 172.21.15.6:0/1061765806 >> 172.21.15.6:0/1061765806 conn(0x7f3c240cde90 msgr2=0x7f3c240ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:38.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.732+0000 7f3c2bf2c640 1 -- 172.21.15.6:0/1061765806 shutdown_connections 2023-07-21T22:31:38.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:38.732+0000 7f3c2bf2c640 1 -- 172.21.15.6:0/1061765806 wait complete. 2023-07-21T22:31:38.800 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2023-07-21T22:31:38.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:38.801 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-07-21T22:31:38.811 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:38.811 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:38.812 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:38.812 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:38.812 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:38.812 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:38.812 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:38.812 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:38.812 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:38.813 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:38.813 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:38.814 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:38.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:38.814 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_21_00_UTC) 2023-07-21T22:31:38.928 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:38.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:38.929 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_22_00_UTC) 2023-07-21T22:31:38.945 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:38.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:38.946 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_23_00_UTC) 2023-07-21T22:31:39.009 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:39.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:39.010 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_24_00_UTC) 2023-07-21T22:31:39.065 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:39.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:39.067 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_25_00_UTC) 2023-07-21T22:31:39.121 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:39.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:39.123 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_26_00_UTC) 2023-07-21T22:31:39.177 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:39.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:39.177 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_27_00_UTC) 2023-07-21T22:31:39.233 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:39.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:39.234 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_28_00_UTC) 2023-07-21T22:31:39.290 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:39.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:39.291 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_29_00_UTC) 2023-07-21T22:31:39.349 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:39.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:39.350 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_30_00_UTC) 2023-07-21T22:31:39.405 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:39.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:39.405 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-21-22_31_00_UTC) 2023-07-21T22:31:39.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:39.461 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2023-07-21T22:31:39.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir9 1M 2023-07-21T22:31:39.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.656+0000 7f30fd967640 1 Processor -- start 2023-07-21T22:31:39.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.656+0000 7f30fd967640 1 -- start start 2023-07-21T22:31:39.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.656+0000 7f30fd967640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f30f80cdd10 0x7f30f80ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:39.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.656+0000 7f30fd967640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f30f80d0820 0x7f30f80accf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:39.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.656+0000 7f30fd967640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f80b0450 con 0x7f30f80b1770 2023-07-21T22:31:39.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.656+0000 7f30fd967640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f80ce620 con 0x7f30f80d0820 2023-07-21T22:31:39.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.656+0000 7f30fd967640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f80b06d0 con 0x7f30f80cdd10 2023-07-21T22:31:39.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.656+0000 7f30f77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f30f80d0820 0x7f30f80accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:39.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.656+0000 7f30f77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f30f80d0820 0x7f30f80accf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38860/0 (socket says 172.21.15.6:38860) 2023-07-21T22:31:39.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.656+0000 7f30f77fe640 1 -- 172.21.15.6:0/4129847417 learned_addr learned my addr 172.21.15.6:0/4129847417 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:39.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.656+0000 7f30f6ffd640 1 --2- 172.21.15.6:0/4129847417 >> v2:172.21.15.161:3300/0 conn(0x7f30f80cdd10 0x7f30f80ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:39.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.656+0000 7f30f77fe640 1 -- 172.21.15.6:0/4129847417 >> v2:172.21.15.161:3300/0 conn(0x7f30f80cdd10 msgr2=0x7f30f80ce0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:39.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.656+0000 7f30f77fe640 1 --2- 172.21.15.6:0/4129847417 >> v2:172.21.15.161:3300/0 conn(0x7f30f80cdd10 0x7f30f80ce0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:39.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.656+0000 7f30f77fe640 1 -- 172.21.15.6:0/4129847417 >> v1:172.21.15.161:6789/0 conn(0x7f30f80b1770 legacy=0x7f30f80d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:39.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.656+0000 7f30f77fe640 1 -- 172.21.15.6:0/4129847417 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f80b09b0 con 0x7f30f80d0820 2023-07-21T22:31:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.660+0000 7f30f77fe640 1 --2- 172.21.15.6:0/4129847417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f80d0820 0x7f30f80accf0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f30f80cdbd0 tx=0x7f30f001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d55076efdb6b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.660+0000 7f30f67fc640 1 -- 172.21.15.6:0/4129847417 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f00a5860 con 0x7f30f80d0820 2023-07-21T22:31:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.660+0000 7f30f67fc640 1 -- 172.21.15.6:0/4129847417 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f00a59c0 con 0x7f30f80d0820 2023-07-21T22:31:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.660+0000 7f30f67fc640 1 -- 172.21.15.6:0/4129847417 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f00a5d50 con 0x7f30f80d0820 2023-07-21T22:31:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.660+0000 7f30fd967640 1 -- 172.21.15.6:0/4129847417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f80d0820 msgr2=0x7f30f80accf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.660+0000 7f30fd967640 1 --2- 172.21.15.6:0/4129847417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f80d0820 0x7f30f80accf0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f30f80cdbd0 tx=0x7f30f001c9a0 comp rx=0 tx=0).stop 2023-07-21T22:31:39.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.660+0000 7f30fd967640 1 -- 172.21.15.6:0/4129847417 shutdown_connections 2023-07-21T22:31:39.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.660+0000 7f30fd967640 1 --2- 172.21.15.6:0/4129847417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f80d0820 0x7f30f80accf0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:39.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.660+0000 7f30fd967640 1 --2- 172.21.15.6:0/4129847417 >> v2:172.21.15.161:3300/0 conn(0x7f30f80cdd10 0x7f30f80ce0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:39.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.660+0000 7f30fd967640 1 -- 172.21.15.6:0/4129847417 >> 172.21.15.6:0/4129847417 conn(0x7f30f8099490 msgr2=0x7f30f8089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:39.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.660+0000 7f30fd967640 1 -- 172.21.15.6:0/4129847417 shutdown_connections 2023-07-21T22:31:39.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.660+0000 7f30fd967640 1 -- 172.21.15.6:0/4129847417 wait complete. 2023-07-21T22:31:39.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30fd967640 1 Processor -- start 2023-07-21T22:31:39.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30fd967640 1 -- start start 2023-07-21T22:31:39.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30fd967640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f80b1770 0x7f30f8150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:39.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30fd967640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30f80cdd10 0x7f30f8148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30fd967640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30f80d0820 0x7f30f8153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30fd967640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f8152170 con 0x7f30f80b1770 2023-07-21T22:31:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30fd967640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f8152600 con 0x7f30f80d0820 2023-07-21T22:31:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30fd967640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f8151560 con 0x7f30f80cdd10 2023-07-21T22:31:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30f6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f80b1770 0x7f30f8150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30f6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f80b1770 0x7f30f8150f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38876/0 (socket says 172.21.15.6:38876) 2023-07-21T22:31:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30f6ffd640 1 -- 172.21.15.6:0/153216265 learned_addr learned my addr 172.21.15.6:0/153216265 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:39.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30effff640 1 --2- 172.21.15.6:0/153216265 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30f80cdd10 0x7f30f8148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30f77fe640 1 --2- 172.21.15.6:0/153216265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30f80d0820 0x7f30f8153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30f6ffd640 1 -- 172.21.15.6:0/153216265 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30f80cdd10 msgr2=0x7f30f8148c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30f6ffd640 1 --2- 172.21.15.6:0/153216265 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30f80cdd10 0x7f30f8148c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30f6ffd640 1 -- 172.21.15.6:0/153216265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30f80d0820 msgr2=0x7f30f8153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30f6ffd640 1 --2- 172.21.15.6:0/153216265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30f80d0820 0x7f30f8153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30f6ffd640 1 -- 172.21.15.6:0/153216265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f0009b30 con 0x7f30f80b1770 2023-07-21T22:31:39.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30f6ffd640 1 --2- 172.21.15.6:0/153216265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f80b1770 0x7f30f8150f20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f30e800e930 tx=0x7f30e800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:39.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30f4ff9640 1 -- 172.21.15.6:0/153216265 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8009690 con 0x7f30f80b1770 2023-07-21T22:31:39.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30f4ff9640 1 -- 172.21.15.6:0/153216265 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e800ca00 con 0x7f30f80b1770 2023-07-21T22:31:39.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30fd967640 1 -- 172.21.15.6:0/153216265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f8151840 con 0x7f30f80b1770 2023-07-21T22:31:39.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30f4ff9640 1 -- 172.21.15.6:0/153216265 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e800cd70 con 0x7f30f80b1770 2023-07-21T22:31:39.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30fd967640 1 -- 172.21.15.6:0/153216265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f8151e00 con 0x7f30f80b1770 2023-07-21T22:31:39.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.664+0000 7f30fd967640 1 -- 172.21.15.6:0/153216265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f80678d0 con 0x7f30f80b1770 2023-07-21T22:31:39.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.668+0000 7f30f4ff9640 1 -- 172.21.15.6:0/153216265 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f30e8013470 con 0x7f30f80b1770 2023-07-21T22:31:39.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.668+0000 7f30f4ff9640 1 --2- 172.21.15.6:0/153216265 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f30d8066480 0x7f30d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:39.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.668+0000 7f30f4ff9640 1 -- 172.21.15.6:0/153216265 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6981+0+0 (secure 0 0 0) 0x7f30e8084750 con 0x7f30f80b1770 2023-07-21T22:31:39.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.668+0000 7f30effff640 1 --2- 172.21.15.6:0/153216265 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f30d8066480 0x7f30d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:39.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.668+0000 7f30effff640 1 --2- 172.21.15.6:0/153216265 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f30d8066480 0x7f30d8068930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f30f8150010 tx=0x7f30e0009040 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:39.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.672+0000 7f30f4ff9640 1 -- 172.21.15.6:0/153216265 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f30e80515d0 con 0x7f30f80b1770 2023-07-21T22:31:39.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.868+0000 7f30fd967640 1 -- 172.21.15.6:0/153216265 --> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f30f80b1250 con 0x7f30d8066480 2023-07-21T22:31:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.956+0000 7f30f4ff9640 1 -- 172.21.15.6:0/153216265 <== mgr.5099 v2:172.21.15.161:6832/2930793066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f30e0001c80 con 0x7f30d8066480 2023-07-21T22:31:40.006 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule removed for path /snap_test_dir1/dir9 2023-07-21T22:31:40.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.960+0000 7f30fd967640 1 -- 172.21.15.6:0/153216265 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f30d8066480 msgr2=0x7f30d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:40.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.960+0000 7f30fd967640 1 --2- 172.21.15.6:0/153216265 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f30d8066480 0x7f30d8068930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f30f8150010 tx=0x7f30e0009040 comp rx=0 tx=0).stop 2023-07-21T22:31:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.960+0000 7f30fd967640 1 -- 172.21.15.6:0/153216265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f80b1770 msgr2=0x7f30f8150f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.960+0000 7f30fd967640 1 --2- 172.21.15.6:0/153216265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f80b1770 0x7f30f8150f20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f30e800e930 tx=0x7f30e800edf0 comp rx=0 tx=0).stop 2023-07-21T22:31:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.960+0000 7f30fd967640 1 -- 172.21.15.6:0/153216265 shutdown_connections 2023-07-21T22:31:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.960+0000 7f30fd967640 1 --2- 172.21.15.6:0/153216265 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f30d8066480 0x7f30d8068930 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.960+0000 7f30fd967640 1 --2- 172.21.15.6:0/153216265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30f80d0820 0x7f30f8153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.960+0000 7f30fd967640 1 --2- 172.21.15.6:0/153216265 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30f80cdd10 0x7f30f8148c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:40.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.960+0000 7f30fd967640 1 --2- 172.21.15.6:0/153216265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f80b1770 0x7f30f8150f20 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:40.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.960+0000 7f30fd967640 1 -- 172.21.15.6:0/153216265 >> 172.21.15.6:0/153216265 conn(0x7f30f8099490 msgr2=0x7f30f81582b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:40.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.960+0000 7f30fd967640 1 -- 172.21.15.6:0/153216265 shutdown_connections 2023-07-21T22:31:40.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:39.960+0000 7f30fd967640 1 -- 172.21.15.6:0/153216265 wait complete. 2023-07-21T22:31:40.027 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2023-07-21T22:31:40.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:40.027 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-07-21T22:31:40.038 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:40.038 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:40.038 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:40.038 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:40.038 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:40.038 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:40.039 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:40.039 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:40.039 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:40.039 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:40.039 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:40.040 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_21_00_UTC 2023-07-21T22:31:40.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:40.041 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_21_00_UTC) 2023-07-21T22:31:40.113 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_22_00_UTC 2023-07-21T22:31:40.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:40.114 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_22_00_UTC) 2023-07-21T22:31:40.173 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_23_00_UTC 2023-07-21T22:31:40.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:40.174 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_23_00_UTC) 2023-07-21T22:31:40.230 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_24_00_UTC 2023-07-21T22:31:40.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:40.231 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_24_00_UTC) 2023-07-21T22:31:40.292 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_25_00_UTC 2023-07-21T22:31:40.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:40.293 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_25_00_UTC) 2023-07-21T22:31:40.353 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_26_00_UTC 2023-07-21T22:31:40.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:40.354 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_26_00_UTC) 2023-07-21T22:31:40.409 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_27_00_UTC 2023-07-21T22:31:40.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:40.410 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_27_00_UTC) 2023-07-21T22:31:40.465 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_28_00_UTC 2023-07-21T22:31:40.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:40.466 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_28_00_UTC) 2023-07-21T22:31:40.522 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_29_00_UTC 2023-07-21T22:31:40.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:40.523 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_29_00_UTC) 2023-07-21T22:31:40.582 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_30_00_UTC 2023-07-21T22:31:40.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:40.583 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_30_00_UTC) 2023-07-21T22:31:40.641 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_31_00_UTC 2023-07-21T22:31:40.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:40.642 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-21-22_31_00_UTC) 2023-07-21T22:31:40.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:40.698 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2023-07-21T22:31:40.749 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-21T22:31:40.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.912+0000 7f4233c6d640 1 Processor -- start 2023-07-21T22:31:40.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.912+0000 7f4233c6d640 1 -- start start 2023-07-21T22:31:40.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.912+0000 7f4233c6d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f422c159a70 0x7f422c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:40.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.912+0000 7f4233c6d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f422c071030 0x7f422c0c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:40.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.912+0000 7f4233c6d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422c0cbe50 con 0x7f422c15e060 2023-07-21T22:31:40.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.912+0000 7f4233c6d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422c0cd660 con 0x7f422c071030 2023-07-21T22:31:40.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.912+0000 7f4233c6d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422c0cc0a0 con 0x7f422c159a70 2023-07-21T22:31:40.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.916+0000 7f4231a09640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f422c159a70 0x7f422c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:40.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.916+0000 7f423220a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f422c071030 0x7f422c0c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:40.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.916+0000 7f423220a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f422c071030 0x7f422c0c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35454/0 (socket says 172.21.15.6:35454) 2023-07-21T22:31:40.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.916+0000 7f423220a640 1 -- 172.21.15.6:0/719990632 learned_addr learned my addr 172.21.15.6:0/719990632 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:40.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.916+0000 7f423220a640 1 -- 172.21.15.6:0/719990632 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f422c159a70 msgr2=0x7f422c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:40.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.916+0000 7f423220a640 1 --2- 172.21.15.6:0/719990632 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f422c159a70 0x7f422c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:40.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.916+0000 7f423220a640 1 -- 172.21.15.6:0/719990632 >> v1:172.21.15.161:6789/0 conn(0x7f422c15e060 legacy=0x7f422c070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:40.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.916+0000 7f423220a640 1 -- 172.21.15.6:0/719990632 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c0cc380 con 0x7f422c071030 2023-07-21T22:31:40.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.916+0000 7f4230a07640 1 -- 172.21.15.6:0/719990632 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320662817 0 0) 0x7f422c0cbe50 con 0x7f422c15e060 2023-07-21T22:31:40.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.916+0000 7f423220a640 1 --2- 172.21.15.6:0/719990632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f422c071030 0x7f422c0c9da0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4224009e50 tx=0x7f422401c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cf2cafc1c0e41d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:40.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.916+0000 7f4230a07640 1 -- 172.21.15.6:0/719990632 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42240a5720 con 0x7f422c071030 2023-07-21T22:31:40.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.916+0000 7f4230a07640 1 -- 172.21.15.6:0/719990632 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42240a5880 con 0x7f422c071030 2023-07-21T22:31:40.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.916+0000 7f4230a07640 1 -- 172.21.15.6:0/719990632 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42240a5c10 con 0x7f422c071030 2023-07-21T22:31:40.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f4233c6d640 1 -- 172.21.15.6:0/719990632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f422c071030 msgr2=0x7f422c0c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:40.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f4233c6d640 1 --2- 172.21.15.6:0/719990632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f422c071030 0x7f422c0c9da0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4224009e50 tx=0x7f422401c8c0 comp rx=0 tx=0).stop 2023-07-21T22:31:40.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f4233c6d640 1 -- 172.21.15.6:0/719990632 shutdown_connections 2023-07-21T22:31:40.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f4233c6d640 1 --2- 172.21.15.6:0/719990632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f422c071030 0x7f422c0c9da0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:40.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f4233c6d640 1 --2- 172.21.15.6:0/719990632 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f422c159a70 0x7f422c0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:40.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f4233c6d640 1 -- 172.21.15.6:0/719990632 >> 172.21.15.6:0/719990632 conn(0x7f422c0afac0 msgr2=0x7f422c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:40.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f4233c6d640 1 -- 172.21.15.6:0/719990632 shutdown_connections 2023-07-21T22:31:40.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f4233c6d640 1 -- 172.21.15.6:0/719990632 wait complete. 2023-07-21T22:31:40.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f4233c6d640 1 Processor -- start 2023-07-21T22:31:40.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f4233c6d640 1 -- start start 2023-07-21T22:31:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f4233c6d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f422c071030 0x7f422c06d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f4233c6d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f422c159a70 0x7f422c14e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f4233c6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f422c15e060 0x7f422c06b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f4233c6d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c06c000 con 0x7f422c15e060 2023-07-21T22:31:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f4233c6d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c06c2e0 con 0x7f422c071030 2023-07-21T22:31:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f4233c6d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422c06c5c0 con 0x7f422c159a70 2023-07-21T22:31:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f423220a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f422c15e060 0x7f422c06b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f423220a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f422c15e060 0x7f422c06b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38878/0 (socket says 172.21.15.6:38878) 2023-07-21T22:31:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f423220a640 1 -- 172.21.15.6:0/4157815397 learned_addr learned my addr 172.21.15.6:0/4157815397 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f4231a09640 1 --2- 172.21.15.6:0/4157815397 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f422c071030 0x7f422c06d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f4231208640 1 --2- 172.21.15.6:0/4157815397 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f422c159a70 0x7f422c14e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f423220a640 1 -- 172.21.15.6:0/4157815397 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f422c159a70 msgr2=0x7f422c14e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f423220a640 1 --2- 172.21.15.6:0/4157815397 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f422c159a70 0x7f422c14e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f423220a640 1 -- 172.21.15.6:0/4157815397 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f422c071030 msgr2=0x7f422c06d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f423220a640 1 --2- 172.21.15.6:0/4157815397 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f422c071030 0x7f422c06d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f423220a640 1 -- 172.21.15.6:0/4157815397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4224009b30 con 0x7f422c15e060 2023-07-21T22:31:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.920+0000 7f4231208640 1 --2- 172.21.15.6:0/4157815397 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f422c159a70 0x7f422c14e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.924+0000 7f423220a640 1 --2- 172.21.15.6:0/4157815397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f422c15e060 0x7f422c06b540 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f422401a4f0 tx=0x7f4224019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.924+0000 7f42227fc640 1 -- 172.21.15.6:0/4157815397 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42240b8670 con 0x7f422c15e060 2023-07-21T22:31:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.924+0000 7f42227fc640 1 -- 172.21.15.6:0/4157815397 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42240b87f0 con 0x7f422c15e060 2023-07-21T22:31:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.924+0000 7f42227fc640 1 -- 172.21.15.6:0/4157815397 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42240b8ba0 con 0x7f422c15e060 2023-07-21T22:31:40.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.924+0000 7f4233c6d640 1 -- 172.21.15.6:0/4157815397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422c06c8a0 con 0x7f422c15e060 2023-07-21T22:31:40.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.924+0000 7f4233c6d640 1 -- 172.21.15.6:0/4157815397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422c14e7f0 con 0x7f422c15e060 2023-07-21T22:31:40.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.924+0000 7f4233c6d640 1 -- 172.21.15.6:0/4157815397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422c15e450 con 0x7f422c15e060 2023-07-21T22:31:40.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.924+0000 7f42227fc640 1 -- 172.21.15.6:0/4157815397 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f42240b8d00 con 0x7f422c15e060 2023-07-21T22:31:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.924+0000 7f42227fc640 1 --2- 172.21.15.6:0/4157815397 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4210066480 0x7f4210068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.924+0000 7f42227fc640 1 -- 172.21.15.6:0/4157815397 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6741+0+0 (secure 0 0 0) 0x7f422411f830 con 0x7f422c15e060 2023-07-21T22:31:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.924+0000 7f4231a09640 1 --2- 172.21.15.6:0/4157815397 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4210066480 0x7f4210068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.928+0000 7f4231a09640 1 --2- 172.21.15.6:0/4157815397 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4210066480 0x7f4210068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f422c0aeb10 tx=0x7f4228009190 comp rx=0 tx=0).ready entity=mgr.5099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:40.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:40.928+0000 7f42227fc640 1 -- 172.21.15.6:0/4157815397 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f422c15e450 con 0x7f422c15e060 2023-07-21T22:31:41.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:41.128+0000 7f4233c6d640 1 -- 172.21.15.6:0/4157815397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f422c06cdc0 con 0x7f422c15e060 2023-07-21T22:31:41.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:41.836+0000 7f42227fc640 1 -- 172.21.15.6:0/4157815397 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 13) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f42240ecab0 con 0x7f422c15e060 2023-07-21T22:31:41.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:41.836+0000 7f42227fc640 1 -- 172.21.15.6:0/4157815397 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v13) v1 ==== 93+0+0 (secure 0 0 0) 0x7f42241054c0 con 0x7f422c15e060 2023-07-21T22:31:41.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:41.840+0000 7f4233c6d640 1 -- 172.21.15.6:0/4157815397 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4210066480 msgr2=0x7f4210068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:41.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:41.840+0000 7f4233c6d640 1 --2- 172.21.15.6:0/4157815397 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4210066480 0x7f4210068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f422c0aeb10 tx=0x7f4228009190 comp rx=0 tx=0).stop 2023-07-21T22:31:41.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:41.840+0000 7f4233c6d640 1 -- 172.21.15.6:0/4157815397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f422c15e060 msgr2=0x7f422c06b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:41.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:41.840+0000 7f4233c6d640 1 --2- 172.21.15.6:0/4157815397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f422c15e060 0x7f422c06b540 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f422401a4f0 tx=0x7f4224019660 comp rx=0 tx=0).stop 2023-07-21T22:31:41.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:41.840+0000 7f4233c6d640 1 -- 172.21.15.6:0/4157815397 shutdown_connections 2023-07-21T22:31:41.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:41.840+0000 7f4233c6d640 1 --2- 172.21.15.6:0/4157815397 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4210066480 0x7f4210068930 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:41.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:41.840+0000 7f4233c6d640 1 --2- 172.21.15.6:0/4157815397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f422c15e060 0x7f422c06b540 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:41.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:41.840+0000 7f4233c6d640 1 --2- 172.21.15.6:0/4157815397 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f422c159a70 0x7f422c14e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:41.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:41.840+0000 7f4233c6d640 1 --2- 172.21.15.6:0/4157815397 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f422c071030 0x7f422c06d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:41.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:41.840+0000 7f4233c6d640 1 -- 172.21.15.6:0/4157815397 >> 172.21.15.6:0/4157815397 conn(0x7f422c0afac0 msgr2=0x7f422c14ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:41.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:41.840+0000 7f4233c6d640 1 -- 172.21.15.6:0/4157815397 shutdown_connections 2023-07-21T22:31:41.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:41.840+0000 7f4233c6d640 1 -- 172.21.15.6:0/4157815397 wait complete. 2023-07-21T22:31:41.928 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:31:41.929 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:31:41.997 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:31:42.062 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:31:42.062 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:31:42.063 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:31:42.076 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:31:42.076 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:31:42.099 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:42.052+0000 7fb033613180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:31:42.119 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:31:42.121 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:42.077+0000 7f249f646180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:31:42.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.264+0000 7f965c093640 1 Processor -- start 2023-07-21T22:31:42.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.264+0000 7f965c093640 1 -- start start 2023-07-21T22:31:42.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.268+0000 7f965c093640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f965415fd60 0x7f96540d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:42.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.268+0000 7f965c093640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96540ccaf0 con 0x7f96540b7c70 2023-07-21T22:31:42.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.268+0000 7f965c093640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9654160320 con 0x7f96540d1850 2023-07-21T22:31:42.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.268+0000 7f965c093640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96540d1190 con 0x7f965415fd60 2023-07-21T22:31:42.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.268+0000 7f965962e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f965415fd60 0x7f96540d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:42.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.268+0000 7f965962e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f965415fd60 0x7f96540d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38906/0 (socket says 172.21.15.6:38906) 2023-07-21T22:31:42.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.268+0000 7f965962e640 1 -- 172.21.15.6:0/156450503 learned_addr learned my addr 172.21.15.6:0/156450503 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:42.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.268+0000 7f9659e2f640 1 --1- 172.21.15.6:0/156450503 >> v1:172.21.15.6:6789/0 conn(0x7f96540b7c70 0x7f965415f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44318/0 (socket says 172.21.15.6:44318) 2023-07-21T22:31:42.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.268+0000 7f965962e640 1 -- 172.21.15.6:0/156450503 >> v1:172.21.15.161:6789/0 conn(0x7f96540d1850 legacy=0x7f96540d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:42.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.268+0000 7f965962e640 1 -- 172.21.15.6:0/156450503 >> v1:172.21.15.6:6789/0 conn(0x7f96540b7c70 legacy=0x7f965415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:42.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.268+0000 7f965962e640 1 -- 172.21.15.6:0/156450503 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96540ccd90 con 0x7f965415fd60 2023-07-21T22:31:42.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.268+0000 7f9658e2d640 1 -- 172.21.15.6:0/156450503 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3459975117 0 0) 0x7f96540ccaf0 con 0x7f96540b7c70 2023-07-21T22:31:42.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.272+0000 7f965962e640 1 --2- 172.21.15.6:0/156450503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f965415fd60 0x7f96540d0c50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9644009870 tx=0x7f964401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4cad798af31624 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:42.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.272+0000 7f9658e2d640 1 -- 172.21.15.6:0/156450503 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96440ab650 con 0x7f965415fd60 2023-07-21T22:31:42.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.272+0000 7f9658e2d640 1 -- 172.21.15.6:0/156450503 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96440ab7b0 con 0x7f965415fd60 2023-07-21T22:31:42.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.272+0000 7f9658e2d640 1 -- 172.21.15.6:0/156450503 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96440abb40 con 0x7f965415fd60 2023-07-21T22:31:42.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.272+0000 7f965c093640 1 -- 172.21.15.6:0/156450503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f965415fd60 msgr2=0x7f96540d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:42.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.272+0000 7f965c093640 1 --2- 172.21.15.6:0/156450503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f965415fd60 0x7f96540d0c50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9644009870 tx=0x7f964401c540 comp rx=0 tx=0).stop 2023-07-21T22:31:42.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.272+0000 7f965c093640 1 -- 172.21.15.6:0/156450503 shutdown_connections 2023-07-21T22:31:42.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.272+0000 7f965c093640 1 --2- 172.21.15.6:0/156450503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f965415fd60 0x7f96540d0c50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.272+0000 7f965c093640 1 -- 172.21.15.6:0/156450503 >> 172.21.15.6:0/156450503 conn(0x7f96540650b0 msgr2=0x7f96540654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:42.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.272+0000 7f965c093640 1 -- 172.21.15.6:0/156450503 shutdown_connections 2023-07-21T22:31:42.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.272+0000 7f965c093640 1 -- 172.21.15.6:0/156450503 wait complete. 2023-07-21T22:31:42.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.272+0000 7f965c093640 1 Processor -- start 2023-07-21T22:31:42.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.272+0000 7f965c093640 1 -- start start 2023-07-21T22:31:42.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f965c093640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96540b7c70 0x7f965415d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:42.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f965c093640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96540d1850 0x7f965414f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:42.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f965c093640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f965415fd60 0x7f96540ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:42.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f965c093640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965414fc80 con 0x7f965415fd60 2023-07-21T22:31:42.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f965c093640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96540cad50 con 0x7f96540d1850 2023-07-21T22:31:42.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f965c093640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965415dca0 con 0x7f96540b7c70 2023-07-21T22:31:42.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f9659e2f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96540b7c70 0x7f965415d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:42.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f965962e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96540d1850 0x7f965414f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:42.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f965a630640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f965415fd60 0x7f96540ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:42.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f9659e2f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96540b7c70 0x7f965415d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:46380/0 (socket says 172.21.15.6:46380) 2023-07-21T22:31:42.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f9659e2f640 1 -- 172.21.15.6:0/2610651569 learned_addr learned my addr 172.21.15.6:0/2610651569 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:42.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f965962e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96540d1850 0x7f965414f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35494/0 (socket says 172.21.15.6:35494) 2023-07-21T22:31:42.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f9659e2f640 1 -- 172.21.15.6:0/2610651569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96540d1850 msgr2=0x7f965414f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:42.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f9659e2f640 1 --2- 172.21.15.6:0/2610651569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96540d1850 0x7f965414f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f9659e2f640 1 -- 172.21.15.6:0/2610651569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f965415fd60 msgr2=0x7f96540ca810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:42.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f9659e2f640 1 --2- 172.21.15.6:0/2610651569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f965415fd60 0x7f96540ca810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f9659e2f640 1 -- 172.21.15.6:0/2610651569 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96440094d0 con 0x7f96540b7c70 2023-07-21T22:31:42.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f9659e2f640 1 --2- 172.21.15.6:0/2610651569 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96540b7c70 0x7f965415d5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f965000c410 tx=0x7f965000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:42.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f964a7fc640 1 -- 172.21.15.6:0/2610651569 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96500074e0 con 0x7f96540b7c70 2023-07-21T22:31:42.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f964a7fc640 1 -- 172.21.15.6:0/2610651569 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9650007640 con 0x7f96540b7c70 2023-07-21T22:31:42.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f964a7fc640 1 -- 172.21.15.6:0/2610651569 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9650004a30 con 0x7f96540b7c70 2023-07-21T22:31:42.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f965c093640 1 -- 172.21.15.6:0/2610651569 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965415df80 con 0x7f96540b7c70 2023-07-21T22:31:42.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f965c093640 1 -- 172.21.15.6:0/2610651569 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965415e540 con 0x7f96540b7c70 2023-07-21T22:31:42.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.276+0000 7f965c093640 1 -- 172.21.15.6:0/2610651569 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96540678d0 con 0x7f96540b7c70 2023-07-21T22:31:42.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.280+0000 7f964a7fc640 1 -- 172.21.15.6:0/2610651569 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 13) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f9650004b90 con 0x7f96540b7c70 2023-07-21T22:31:42.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.280+0000 7f964a7fc640 1 --2- 172.21.15.6:0/2610651569 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9638066430 0x7f96380688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:42.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.280+0000 7f964a7fc640 1 -- 172.21.15.6:0/2610651569 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6581+0+0 (secure 0 0 0) 0x7f9650083eb0 con 0x7f96540b7c70 2023-07-21T22:31:42.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.280+0000 7f965962e640 1 -- 172.21.15.6:0/2610651569 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9638066430 msgr2=0x7f96380688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2930793066 2023-07-21T22:31:42.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.280+0000 7f965962e640 1 --2- 172.21.15.6:0/2610651569 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9638066430 0x7f96380688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:31:42.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.284+0000 7f964a7fc640 1 -- 172.21.15.6:0/2610651569 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9650050fe0 con 0x7f96540b7c70 2023-07-21T22:31:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.444+0000 7f965c093640 1 -- 172.21.15.6:0/2610651569 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96540b6770 con 0x7f96540b7c70 2023-07-21T22:31:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.444+0000 7f964a7fc640 1 -- 172.21.15.6:0/2610651569 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+19093 (secure 0 0 0) 0x7f9650054600 con 0x7f96540b7c70 2023-07-21T22:31:42.493 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:42.493 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":51,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:31:41.819240+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:19:43.286760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-21T22:19:44.152686+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":51,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1c","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/1202931620":"2023-07-22T22:20:02.274267+0000","172.21.15.161:6833/3471136886":"2023-07-22T22:20:02.274267+0000","172.21.15.161:6832/3471136886":"2023-07-22T22:20:02.274267+0000","172.21.15.161:0/2854890359":"2023-07-22T22:20:02.274267+0000","172.21.15.161:0/1870877504":"2023-07-22T22:20:02.274267+0000","172.21.15.161:0/306225944":"2023-07-22T22:20:02.274267+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":105},{"begin":108,"length":113}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":10,"length":1},{"begin":21,"length":2},{"begin":33,"length":1},{"begin":43,"length":1},{"begin":53,"length":1},{"begin":64,"length":1},{"begin":75,"length":1},{"begin":86,"length":1},{"begin":96,"length":1},{"begin":103,"length":1},{"begin":210,"length":11}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:31:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.448+0000 7f965c093640 1 -- 172.21.15.6:0/2610651569 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9638066430 msgr2=0x7f96380688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:31:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.448+0000 7f965c093640 1 --2- 172.21.15.6:0/2610651569 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9638066430 0x7f96380688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.448+0000 7f965c093640 1 -- 172.21.15.6:0/2610651569 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96540b7c70 msgr2=0x7f965415d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.448+0000 7f965c093640 1 --2- 172.21.15.6:0/2610651569 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96540b7c70 0x7f965415d5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f965000c410 tx=0x7f965000c8d0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.448+0000 7f965c093640 1 -- 172.21.15.6:0/2610651569 shutdown_connections 2023-07-21T22:31:42.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.448+0000 7f965c093640 1 --2- 172.21.15.6:0/2610651569 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f9638066430 0x7f96380688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.448+0000 7f965c093640 1 --2- 172.21.15.6:0/2610651569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f965415fd60 0x7f96540ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.448+0000 7f965c093640 1 --2- 172.21.15.6:0/2610651569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96540d1850 0x7f965414f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.448+0000 7f965c093640 1 --2- 172.21.15.6:0/2610651569 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96540b7c70 0x7f965415d5a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.448+0000 7f965c093640 1 -- 172.21.15.6:0/2610651569 >> 172.21.15.6:0/2610651569 conn(0x7f96540650b0 msgr2=0x7f9654156910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:42.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.448+0000 7f965c093640 1 -- 172.21.15.6:0/2610651569 shutdown_connections 2023-07-21T22:31:42.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.448+0000 7f965c093640 1 -- 172.21.15.6:0/2610651569 wait complete. 2023-07-21T22:31:42.522 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:19:43.286760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:19:44.152686+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 220, 'snap_epoch': 51, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:31:42.523 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:31:42.561 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:42.517+0000 7f249f646180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:31:42.586 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:42.536+0000 7fb033613180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:31:42.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.624+0000 7f4284d40640 1 Processor -- start 2023-07-21T22:31:42.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.624+0000 7f4284d40640 1 -- start start 2023-07-21T22:31:42.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.624+0000 7f4284d40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f428015bde0 0x7f42800d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:42.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.624+0000 7f4284d40640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f42800d2fc0 0x7f42800b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:42.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.624+0000 7f4284d40640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f42800d2300 0x7f42800d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:42.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.624+0000 7f4284d40640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42800d2ce0 con 0x7f42800d2fc0 2023-07-21T22:31:42.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.624+0000 7f4284d40640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428015c1b0 con 0x7f42800d2300 2023-07-21T22:31:42.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.624+0000 7f4284d40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42800b04c0 con 0x7f428015bde0 2023-07-21T22:31:42.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.624+0000 7f4277fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f42800d2fc0 0x7f42800b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:42.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.628+0000 7f4277fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f42800d2fc0 0x7f42800b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38928/0 (socket says 172.21.15.6:38928) 2023-07-21T22:31:42.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.628+0000 7f4277fff640 1 -- 172.21.15.6:0/218062540 learned_addr learned my addr 172.21.15.6:0/218062540 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:42.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.628+0000 7f427e59c640 1 --2- 172.21.15.6:0/218062540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f428015bde0 0x7f42800d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:42.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.628+0000 7f427ed9d640 1 --2- 172.21.15.6:0/218062540 >> v2:172.21.15.161:3300/0 conn(0x7f42800d2300 0x7f42800d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:42.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.628+0000 7f4277fff640 1 -- 172.21.15.6:0/218062540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f428015bde0 msgr2=0x7f42800d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:42.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.628+0000 7f4277fff640 1 --2- 172.21.15.6:0/218062540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f428015bde0 0x7f42800d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.628+0000 7f4277fff640 1 -- 172.21.15.6:0/218062540 >> v2:172.21.15.161:3300/0 conn(0x7f42800d2300 msgr2=0x7f42800d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:42.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.628+0000 7f4277fff640 1 --2- 172.21.15.6:0/218062540 >> v2:172.21.15.161:3300/0 conn(0x7f42800d2300 0x7f42800d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.628+0000 7f4277fff640 1 -- 172.21.15.6:0/218062540 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42800d0aa0 con 0x7f42800d2fc0 2023-07-21T22:31:42.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.628+0000 7f4277fff640 1 --2- 172.21.15.6:0/218062540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42800d2fc0 0x7f42800b0950 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f42800b83f0 tx=0x7f426801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee1a4a7e47f05ac server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:42.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.628+0000 7f427dd9b640 1 -- 172.21.15.6:0/218062540 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42680aa620 con 0x7f42800d2fc0 2023-07-21T22:31:42.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.628+0000 7f427dd9b640 1 -- 172.21.15.6:0/218062540 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42680aa780 con 0x7f42800d2fc0 2023-07-21T22:31:42.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.628+0000 7f427dd9b640 1 -- 172.21.15.6:0/218062540 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42680aab10 con 0x7f42800d2fc0 2023-07-21T22:31:42.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f4284d40640 1 -- 172.21.15.6:0/218062540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42800d2fc0 msgr2=0x7f42800b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:42.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f4284d40640 1 --2- 172.21.15.6:0/218062540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42800d2fc0 0x7f42800b0950 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f42800b83f0 tx=0x7f426801c500 comp rx=0 tx=0).stop 2023-07-21T22:31:42.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f4284d40640 1 -- 172.21.15.6:0/218062540 shutdown_connections 2023-07-21T22:31:42.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f4284d40640 1 --2- 172.21.15.6:0/218062540 >> v2:172.21.15.161:3300/0 conn(0x7f42800d2300 0x7f42800d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f4284d40640 1 --2- 172.21.15.6:0/218062540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42800d2fc0 0x7f42800b0950 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f4284d40640 1 --2- 172.21.15.6:0/218062540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f428015bde0 0x7f42800d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f4284d40640 1 -- 172.21.15.6:0/218062540 >> 172.21.15.6:0/218062540 conn(0x7f42800659d0 msgr2=0x7f428009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:42.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f4284d40640 1 -- 172.21.15.6:0/218062540 shutdown_connections 2023-07-21T22:31:42.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f4284d40640 1 -- 172.21.15.6:0/218062540 wait complete. 2023-07-21T22:31:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f4284d40640 1 Processor -- start 2023-07-21T22:31:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f4284d40640 1 -- start start 2023-07-21T22:31:42.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f4284d40640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42800d2300 0x7f42800cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:42.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f4284d40640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42800d2fc0 0x7f42800b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:42.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f4284d40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f428015bde0 0x7f42800b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:42.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f4284d40640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428015d470 con 0x7f42800d2fc0 2023-07-21T22:31:42.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f4284d40640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42800cc3b0 con 0x7f42800d2300 2023-07-21T22:31:42.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f4284d40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42800b3ba0 con 0x7f428015bde0 2023-07-21T22:31:42.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f4277fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42800d2fc0 0x7f42800b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:42.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f427e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42800d2300 0x7f42800cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:42.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f4277fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42800d2fc0 0x7f42800b2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38934/0 (socket says 172.21.15.6:38934) 2023-07-21T22:31:42.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f4277fff640 1 -- 172.21.15.6:0/2088423842 learned_addr learned my addr 172.21.15.6:0/2088423842 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:42.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.632+0000 7f427ed9d640 1 --2- 172.21.15.6:0/2088423842 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f428015bde0 0x7f42800b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:42.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.636+0000 7f4277fff640 1 -- 172.21.15.6:0/2088423842 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f428015bde0 msgr2=0x7f42800b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:42.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.636+0000 7f4277fff640 1 --2- 172.21.15.6:0/2088423842 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f428015bde0 0x7f42800b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.636+0000 7f4277fff640 1 -- 172.21.15.6:0/2088423842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42800d2300 msgr2=0x7f42800cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:42.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.636+0000 7f4277fff640 1 --2- 172.21.15.6:0/2088423842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42800d2300 0x7f42800cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.636+0000 7f4277fff640 1 -- 172.21.15.6:0/2088423842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42680094d0 con 0x7f42800d2fc0 2023-07-21T22:31:42.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.636+0000 7f4277fff640 1 --2- 172.21.15.6:0/2088423842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42800d2fc0 0x7f42800b2960 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f426801abb0 tx=0x7f426801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:42.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.636+0000 7f4276ffd640 1 -- 172.21.15.6:0/2088423842 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42680aae00 con 0x7f42800d2fc0 2023-07-21T22:31:42.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.636+0000 7f4276ffd640 1 -- 172.21.15.6:0/2088423842 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42680bd3f0 con 0x7f42800d2fc0 2023-07-21T22:31:42.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.636+0000 7f4276ffd640 1 -- 172.21.15.6:0/2088423842 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42680bd780 con 0x7f42800d2fc0 2023-07-21T22:31:42.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.636+0000 7f4284d40640 1 -- 172.21.15.6:0/2088423842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42800b3e80 con 0x7f42800d2fc0 2023-07-21T22:31:42.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.636+0000 7f4284d40640 1 -- 172.21.15.6:0/2088423842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42800b13e0 con 0x7f42800d2fc0 2023-07-21T22:31:42.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.636+0000 7f4284d40640 1 -- 172.21.15.6:0/2088423842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428015d5e0 con 0x7f42800d2fc0 2023-07-21T22:31:42.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.636+0000 7f4276ffd640 1 -- 172.21.15.6:0/2088423842 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f42680b33f0 con 0x7f42800d2fc0 2023-07-21T22:31:42.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.640+0000 7f4276ffd640 1 --2- 172.21.15.6:0/2088423842 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4260066430 0x7f42600688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:42.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.640+0000 7f4276ffd640 1 -- 172.21.15.6:0/2088423842 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6581+0+0 (secure 0 0 0) 0x7f426811e3c0 con 0x7f42800d2fc0 2023-07-21T22:31:42.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.640+0000 7f427e59c640 1 -- 172.21.15.6:0/2088423842 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4260066430 msgr2=0x7f42600688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2930793066 2023-07-21T22:31:42.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.640+0000 7f427e59c640 1 --2- 172.21.15.6:0/2088423842 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4260066430 0x7f42600688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:31:42.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.648+0000 7f4276ffd640 1 -- 172.21.15.6:0/2088423842 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f42680eb480 con 0x7f42800d2fc0 2023-07-21T22:31:42.713 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:42.669+0000 7f249f646180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:31:42.749 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:42.700+0000 7fb033613180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:31:42.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.804+0000 7f4284d40640 1 -- 172.21.15.6:0/2088423842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f42800678d0 con 0x7f42800d2fc0 2023-07-21T22:31:42.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.804+0000 7f4276ffd640 1 -- 172.21.15.6:0/2088423842 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7f42680eeaa0 con 0x7f42800d2fc0 2023-07-21T22:31:42.855 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:31:42.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.808+0000 7f4284d40640 1 -- 172.21.15.6:0/2088423842 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4260066430 msgr2=0x7f42600688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:31:42.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.808+0000 7f4284d40640 1 --2- 172.21.15.6:0/2088423842 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4260066430 0x7f42600688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.808+0000 7f4284d40640 1 -- 172.21.15.6:0/2088423842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42800d2fc0 msgr2=0x7f42800b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:42.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.808+0000 7f4284d40640 1 --2- 172.21.15.6:0/2088423842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42800d2fc0 0x7f42800b2960 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f426801abb0 tx=0x7f426801ad40 comp rx=0 tx=0).stop 2023-07-21T22:31:42.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.808+0000 7f4284d40640 1 -- 172.21.15.6:0/2088423842 shutdown_connections 2023-07-21T22:31:42.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.808+0000 7f4284d40640 1 --2- 172.21.15.6:0/2088423842 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4260066430 0x7f42600688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.808+0000 7f4284d40640 1 --2- 172.21.15.6:0/2088423842 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f428015bde0 0x7f42800b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.808+0000 7f4284d40640 1 --2- 172.21.15.6:0/2088423842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42800d2fc0 0x7f42800b2960 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.808+0000 7f4284d40640 1 --2- 172.21.15.6:0/2088423842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42800d2300 0x7f42800cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:42.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.808+0000 7f4284d40640 1 -- 172.21.15.6:0/2088423842 >> 172.21.15.6:0/2088423842 conn(0x7f42800659d0 msgr2=0x7f42801558d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:42.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.808+0000 7f4284d40640 1 -- 172.21.15.6:0/2088423842 shutdown_connections 2023-07-21T22:31:42.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.808+0000 7f4284d40640 1 -- 172.21.15.6:0/2088423842 wait complete. 2023-07-21T22:31:42.876 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:31:42.919 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:31:42.925 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:31:43.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.980+0000 7f43ae7fa640 1 Processor -- start 2023-07-21T22:31:43.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.980+0000 7f43ae7fa640 1 -- start start 2023-07-21T22:31:43.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.980+0000 7f43ae7fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43a80d2fc0 0x7f43a80b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:43.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.980+0000 7f43ae7fa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a80b04c0 con 0x7f43a815bde0 2023-07-21T22:31:43.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.980+0000 7f43ae7fa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a80d0aa0 con 0x7f43a80d2300 2023-07-21T22:31:43.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.980+0000 7f43ae7fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a815c1b0 con 0x7f43a80d2fc0 2023-07-21T22:31:43.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.980+0000 7f43a7fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f43a815bde0 0x7f43a80d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44330/0 (socket says 172.21.15.6:44330) 2023-07-21T22:31:43.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.980+0000 7f43a7fff640 1 -- 172.21.15.6:0/1439272905 learned_addr learned my addr 172.21.15.6:0/1439272905 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:43.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.980+0000 7f43a77fe640 1 --2- 172.21.15.6:0/1439272905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43a80d2fc0 0x7f43a80b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:43.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.980+0000 7f43a6ffd640 1 -- 172.21.15.6:0/1439272905 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461732448 0 0) 0x7f43a80b04c0 con 0x7f43a815bde0 2023-07-21T22:31:43.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.980+0000 7f43a77fe640 1 -- 172.21.15.6:0/1439272905 >> v1:172.21.15.161:6789/0 conn(0x7f43a80d2300 legacy=0x7f43a80cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:43.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.980+0000 7f43a77fe640 1 -- 172.21.15.6:0/1439272905 >> v1:172.21.15.6:6789/0 conn(0x7f43a815bde0 legacy=0x7f43a80d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:43.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.980+0000 7f43a77fe640 1 -- 172.21.15.6:0/1439272905 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a80afb90 con 0x7f43a80d2fc0 2023-07-21T22:31:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.984+0000 7f43a77fe640 1 --2- 172.21.15.6:0/1439272905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43a80d2fc0 0x7f43a80b0950 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f439c0097f0 tx=0x7f439c01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7349e5e23173 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.984+0000 7f43a6ffd640 1 -- 172.21.15.6:0/1439272905 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0aa620 con 0x7f43a80d2fc0 2023-07-21T22:31:43.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.984+0000 7f43a6ffd640 1 -- 172.21.15.6:0/1439272905 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c0aa780 con 0x7f43a80d2fc0 2023-07-21T22:31:43.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.984+0000 7f43a6ffd640 1 -- 172.21.15.6:0/1439272905 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0aab10 con 0x7f43a80d2fc0 2023-07-21T22:31:43.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.984+0000 7f43ae7fa640 1 -- 172.21.15.6:0/1439272905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43a80d2fc0 msgr2=0x7f43a80b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.984+0000 7f43ae7fa640 1 --2- 172.21.15.6:0/1439272905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43a80d2fc0 0x7f43a80b0950 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f439c0097f0 tx=0x7f439c01c4c0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.984+0000 7f43ae7fa640 1 -- 172.21.15.6:0/1439272905 shutdown_connections 2023-07-21T22:31:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.984+0000 7f43ae7fa640 1 --2- 172.21.15.6:0/1439272905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43a80d2fc0 0x7f43a80b0950 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.984+0000 7f43ae7fa640 1 -- 172.21.15.6:0/1439272905 >> 172.21.15.6:0/1439272905 conn(0x7f43a80659d0 msgr2=0x7f43a809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.984+0000 7f43ae7fa640 1 -- 172.21.15.6:0/1439272905 shutdown_connections 2023-07-21T22:31:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.984+0000 7f43ae7fa640 1 -- 172.21.15.6:0/1439272905 wait complete. 2023-07-21T22:31:43.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43ae7fa640 1 Processor -- start 2023-07-21T22:31:43.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43ae7fa640 1 -- start start 2023-07-21T22:31:43.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43ae7fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43a80d2300 0x7f43a80b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:43.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43ae7fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43a80d2fc0 0x7f43a814dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:43.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43ae7fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43a815bde0 0x7f43a80cf030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:43.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43ae7fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a80b1a50 con 0x7f43a80d2fc0 2023-07-21T22:31:43.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43ae7fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a80b1d30 con 0x7f43a815bde0 2023-07-21T22:31:43.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43ae7fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a80b2010 con 0x7f43a80d2300 2023-07-21T22:31:43.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43a77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43a80d2fc0 0x7f43a814dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:43.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43a7fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43a80d2300 0x7f43a80b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:43.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43a77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43a80d2fc0 0x7f43a814dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38940/0 (socket says 172.21.15.6:38940) 2023-07-21T22:31:43.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43a77fe640 1 -- 172.21.15.6:0/2472537736 learned_addr learned my addr 172.21.15.6:0/2472537736 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:43.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43acd97640 1 --2- 172.21.15.6:0/2472537736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43a815bde0 0x7f43a80cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:43.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43a77fe640 1 -- 172.21.15.6:0/2472537736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43a80d2300 msgr2=0x7f43a80b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:43.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43a77fe640 1 --2- 172.21.15.6:0/2472537736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43a80d2300 0x7f43a80b1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43a77fe640 1 -- 172.21.15.6:0/2472537736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43a815bde0 msgr2=0x7f43a80cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:43.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43a77fe640 1 --2- 172.21.15.6:0/2472537736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43a815bde0 0x7f43a80cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43a77fe640 1 -- 172.21.15.6:0/2472537736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c009420 con 0x7f43a80d2fc0 2023-07-21T22:31:43.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43acd97640 1 --2- 172.21.15.6:0/2472537736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43a815bde0 0x7f43a80cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:43.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43a77fe640 1 --2- 172.21.15.6:0/2472537736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43a80d2fc0 0x7f43a814dee0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f439c0ac040 tx=0x7f439c01ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:43.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43a4ff9640 1 -- 172.21.15.6:0/2472537736 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0be410 con 0x7f43a80d2fc0 2023-07-21T22:31:43.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43a4ff9640 1 -- 172.21.15.6:0/2472537736 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c0be5b0 con 0x7f43a80d2fc0 2023-07-21T22:31:43.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43a4ff9640 1 -- 172.21.15.6:0/2472537736 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0be960 con 0x7f43a80d2fc0 2023-07-21T22:31:43.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43ae7fa640 1 -- 172.21.15.6:0/2472537736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a80b22f0 con 0x7f43a80d2fc0 2023-07-21T22:31:43.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.988+0000 7f43ae7fa640 1 -- 172.21.15.6:0/2472537736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a80b16d0 con 0x7f43a80d2fc0 2023-07-21T22:31:43.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.992+0000 7f43ae7fa640 1 -- 172.21.15.6:0/2472537736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a80678d0 con 0x7f43a80d2fc0 2023-07-21T22:31:43.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.992+0000 7f43a4ff9640 1 -- 172.21.15.6:0/2472537736 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f439c0beac0 con 0x7f43a80d2fc0 2023-07-21T22:31:43.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.992+0000 7f43a4ff9640 1 --2- 172.21.15.6:0/2472537736 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4394066430 0x7f43940688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:43.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.992+0000 7f43a4ff9640 1 -- 172.21.15.6:0/2472537736 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7717+0+0 (secure 0 0 0) 0x7f439c11f680 con 0x7f43a80d2fc0 2023-07-21T22:31:43.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.992+0000 7f43a7fff640 1 -- 172.21.15.6:0/2472537736 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4394066430 msgr2=0x7f43940688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2930793066 2023-07-21T22:31:43.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.992+0000 7f43a7fff640 1 --2- 172.21.15.6:0/2472537736 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4394066430 0x7f43940688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:31:43.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:42.996+0000 7f43a4ff9640 1 -- 172.21.15.6:0/2472537736 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f439c0ec210 con 0x7f43a80d2fc0 2023-07-21T22:31:43.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.156+0000 7f43ae7fa640 1 -- 172.21.15.6:0/2472537736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f43a80d1500 con 0x7f43a80d2fc0 2023-07-21T22:31:43.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.160+0000 7f43a4ff9640 1 -- 172.21.15.6:0/2472537736 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v52) v1 ==== 92+0+10 (secure 0 0 0) 0x7f439c0ef830 con 0x7f43a80d2fc0 2023-07-21T22:31:43.207 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:31:43.208 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:43.165+0000 7f249f646180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:31:43.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.160+0000 7f43ae7fa640 1 -- 172.21.15.6:0/2472537736 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4394066430 msgr2=0x7f43940688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:31:43.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.160+0000 7f43ae7fa640 1 --2- 172.21.15.6:0/2472537736 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4394066430 0x7f43940688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.160+0000 7f43ae7fa640 1 -- 172.21.15.6:0/2472537736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43a80d2fc0 msgr2=0x7f43a814dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:43.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.160+0000 7f43ae7fa640 1 --2- 172.21.15.6:0/2472537736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43a80d2fc0 0x7f43a814dee0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f439c0ac040 tx=0x7f439c01ad00 comp rx=0 tx=0).stop 2023-07-21T22:31:43.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.160+0000 7f43ae7fa640 1 -- 172.21.15.6:0/2472537736 shutdown_connections 2023-07-21T22:31:43.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.160+0000 7f43ae7fa640 1 --2- 172.21.15.6:0/2472537736 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4394066430 0x7f43940688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.160+0000 7f43ae7fa640 1 --2- 172.21.15.6:0/2472537736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43a815bde0 0x7f43a80cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.160+0000 7f43ae7fa640 1 --2- 172.21.15.6:0/2472537736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43a80d2fc0 0x7f43a814dee0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.160+0000 7f43ae7fa640 1 --2- 172.21.15.6:0/2472537736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43a80d2300 0x7f43a80b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.160+0000 7f43ae7fa640 1 -- 172.21.15.6:0/2472537736 >> 172.21.15.6:0/2472537736 conn(0x7f43a80659d0 msgr2=0x7f43a80b71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:43.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.160+0000 7f43ae7fa640 1 -- 172.21.15.6:0/2472537736 shutdown_connections 2023-07-21T22:31:43.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.160+0000 7f43ae7fa640 1 -- 172.21.15.6:0/2472537736 wait complete. 2023-07-21T22:31:43.228 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:31:43.267 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:43.221+0000 7f249f646180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:31:43.272 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:43.224+0000 7fb033613180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:31:43.322 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:43.277+0000 7f249f646180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:31:43.335 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:43.288+0000 7fb033613180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:31:43.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.332+0000 7f65c7fff640 1 Processor -- start 2023-07-21T22:31:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.332+0000 7f65c7fff640 1 -- start start 2023-07-21T22:31:43.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.332+0000 7f65c7fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80cc960 0x7f65c80ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:43.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.332+0000 7f65c7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f65c80b1620 0x7f65c80ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:43.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.332+0000 7f65c7fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f65c8160750 0x7f65c80b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:43.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.332+0000 7f65c7fff640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c80cf710 con 0x7f65c80b1620 2023-07-21T22:31:43.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.332+0000 7f65c7fff640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c80cd270 con 0x7f65c8160750 2023-07-21T22:31:43.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.332+0000 7f65c7fff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c80cf430 con 0x7f65c80cc960 2023-07-21T22:31:43.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.332+0000 7f65bffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f65c80b1620 0x7f65c80ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:43.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.332+0000 7f65c6ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80cc960 0x7f65c80ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:43.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.332+0000 7f65bffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f65c80b1620 0x7f65c80ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38942/0 (socket says 172.21.15.6:38942) 2023-07-21T22:31:43.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.332+0000 7f65bffff640 1 -- 172.21.15.6:0/1354586733 learned_addr learned my addr 172.21.15.6:0/1354586733 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:43.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.332+0000 7f65c77fe640 1 --2- 172.21.15.6:0/1354586733 >> v2:172.21.15.161:3300/0 conn(0x7f65c8160750 0x7f65c80b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:43.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.336+0000 7f65bffff640 1 -- 172.21.15.6:0/1354586733 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80cc960 msgr2=0x7f65c80ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:43.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.336+0000 7f65bffff640 1 --2- 172.21.15.6:0/1354586733 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80cc960 0x7f65c80ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.336+0000 7f65bffff640 1 -- 172.21.15.6:0/1354586733 >> v2:172.21.15.161:3300/0 conn(0x7f65c8160750 msgr2=0x7f65c80b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:43.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.336+0000 7f65bffff640 1 --2- 172.21.15.6:0/1354586733 >> v2:172.21.15.161:3300/0 conn(0x7f65c8160750 0x7f65c80b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.336+0000 7f65bffff640 1 -- 172.21.15.6:0/1354586733 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c815fc70 con 0x7f65c80b1620 2023-07-21T22:31:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.336+0000 7f65bffff640 1 --2- 172.21.15.6:0/1354586733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65c80b1620 0x7f65c80ce950 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f65c808b5d0 tx=0x7f65b001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa61a1fd363613e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.336+0000 7f65c67fc640 1 -- 172.21.15.6:0/1354586733 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00aa5f0 con 0x7f65c80b1620 2023-07-21T22:31:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.336+0000 7f65c67fc640 1 -- 172.21.15.6:0/1354586733 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b00aa750 con 0x7f65c80b1620 2023-07-21T22:31:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.336+0000 7f65c67fc640 1 -- 172.21.15.6:0/1354586733 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00aaae0 con 0x7f65c80b1620 2023-07-21T22:31:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65c7fff640 1 -- 172.21.15.6:0/1354586733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65c80b1620 msgr2=0x7f65c80ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65c7fff640 1 --2- 172.21.15.6:0/1354586733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65c80b1620 0x7f65c80ce950 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f65c808b5d0 tx=0x7f65b001c4d0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65c7fff640 1 -- 172.21.15.6:0/1354586733 shutdown_connections 2023-07-21T22:31:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65c7fff640 1 --2- 172.21.15.6:0/1354586733 >> v2:172.21.15.161:3300/0 conn(0x7f65c8160750 0x7f65c80b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65c7fff640 1 --2- 172.21.15.6:0/1354586733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65c80b1620 0x7f65c80ce950 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65c7fff640 1 --2- 172.21.15.6:0/1354586733 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80cc960 0x7f65c80ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65c7fff640 1 -- 172.21.15.6:0/1354586733 >> 172.21.15.6:0/1354586733 conn(0x7f65c8069f50 msgr2=0x7f65c806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:43.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65c7fff640 1 -- 172.21.15.6:0/1354586733 shutdown_connections 2023-07-21T22:31:43.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65c7fff640 1 -- 172.21.15.6:0/1354586733 wait complete. 2023-07-21T22:31:43.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65c7fff640 1 Processor -- start 2023-07-21T22:31:43.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65c7fff640 1 -- start start 2023-07-21T22:31:43.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65c7fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80b1620 0x7f65c8159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:43.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65c7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65c80cc960 0x7f65c80b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:43.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65c7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c8160750 0x7f65c8143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:43.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65c7fff640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c8152a30 con 0x7f65c80cc960 2023-07-21T22:31:43.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65c7fff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c80b3da0 con 0x7f65c8160750 2023-07-21T22:31:43.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65c7fff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c80b3fd0 con 0x7f65c80b1620 2023-07-21T22:31:43.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65bffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65c80cc960 0x7f65c80b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:43.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65bffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65c80cc960 0x7f65c80b3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38950/0 (socket says 172.21.15.6:38950) 2023-07-21T22:31:43.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65bffff640 1 -- 172.21.15.6:0/539250195 learned_addr learned my addr 172.21.15.6:0/539250195 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:43.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65c6ffd640 1 --2- 172.21.15.6:0/539250195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80b1620 0x7f65c8159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:43.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65c77fe640 1 --2- 172.21.15.6:0/539250195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c8160750 0x7f65c8143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:43.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65bffff640 1 -- 172.21.15.6:0/539250195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80b1620 msgr2=0x7f65c8159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:43.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65bffff640 1 --2- 172.21.15.6:0/539250195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80b1620 0x7f65c8159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65bffff640 1 -- 172.21.15.6:0/539250195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c8160750 msgr2=0x7f65c8143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:43.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65bffff640 1 --2- 172.21.15.6:0/539250195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c8160750 0x7f65c8143440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65bffff640 1 -- 172.21.15.6:0/539250195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b00094d0 con 0x7f65c80cc960 2023-07-21T22:31:43.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.340+0000 7f65c77fe640 1 --2- 172.21.15.6:0/539250195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c8160750 0x7f65c8143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:43.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.344+0000 7f65bffff640 1 --2- 172.21.15.6:0/539250195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65c80cc960 0x7f65c80b3860 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f65b001ab80 tx=0x7f65b001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:43.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.344+0000 7f65c4ff9640 1 -- 172.21.15.6:0/539250195 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00bd5f0 con 0x7f65c80cc960 2023-07-21T22:31:43.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.344+0000 7f65c4ff9640 1 -- 172.21.15.6:0/539250195 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b00bd750 con 0x7f65c80cc960 2023-07-21T22:31:43.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.344+0000 7f65c4ff9640 1 -- 172.21.15.6:0/539250195 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00bdb00 con 0x7f65c80cc960 2023-07-21T22:31:43.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.344+0000 7f65c7fff640 1 -- 172.21.15.6:0/539250195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c81544a0 con 0x7f65c80cc960 2023-07-21T22:31:43.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.344+0000 7f65c7fff640 1 -- 172.21.15.6:0/539250195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c8143980 con 0x7f65c80cc960 2023-07-21T22:31:43.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.344+0000 7f65c7fff640 1 -- 172.21.15.6:0/539250195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c8154630 con 0x7f65c80cc960 2023-07-21T22:31:43.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.344+0000 7f65c4ff9640 1 -- 172.21.15.6:0/539250195 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f65b00b33f0 con 0x7f65c80cc960 2023-07-21T22:31:43.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.344+0000 7f65c4ff9640 1 --2- 172.21.15.6:0/539250195 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f65a8066430 0x7f65a80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:43.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.344+0000 7f65c4ff9640 1 -- 172.21.15.6:0/539250195 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7717+0+0 (secure 0 0 0) 0x7f65b00a7070 con 0x7f65c80cc960 2023-07-21T22:31:43.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.344+0000 7f65c6ffd640 1 -- 172.21.15.6:0/539250195 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f65a8066430 msgr2=0x7f65a80688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2930793066 2023-07-21T22:31:43.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.344+0000 7f65c6ffd640 1 --2- 172.21.15.6:0/539250195 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f65a8066430 0x7f65a80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:31:43.401 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:43.352+0000 7fb033613180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:31:43.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.352+0000 7f65c4ff9640 1 -- 172.21.15.6:0/539250195 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f65b00ec280 con 0x7f65c80cc960 2023-07-21T22:31:43.410 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:43.365+0000 7f249f646180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:31:43.467 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:43.421+0000 7f249f646180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:31:43.492 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:43.444+0000 7fb033613180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:31:43.550 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:43.505+0000 7f249f646180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:31:43.551 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:43.504+0000 7fb033613180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:31:43.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.508+0000 7f65c7fff640 1 -- 172.21.15.6:0/539250195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f65c804e020 con 0x7f65c80cc960 2023-07-21T22:31:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.508+0000 7f65c4ff9640 1 -- 172.21.15.6:0/539250195 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v52) v1 ==== 104+0+11 (secure 0 0 0) 0x7f65b00c30a0 con 0x7f65c80cc960 2023-07-21T22:31:43.557 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:31:43.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.512+0000 7f65c7fff640 1 -- 172.21.15.6:0/539250195 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f65a8066430 msgr2=0x7f65a80688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:31:43.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.512+0000 7f65c7fff640 1 --2- 172.21.15.6:0/539250195 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f65a8066430 0x7f65a80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.512+0000 7f65c7fff640 1 -- 172.21.15.6:0/539250195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65c80cc960 msgr2=0x7f65c80b3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:43.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.512+0000 7f65c7fff640 1 --2- 172.21.15.6:0/539250195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65c80cc960 0x7f65c80b3860 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f65b001ab80 tx=0x7f65b001ad10 comp rx=0 tx=0).stop 2023-07-21T22:31:43.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.512+0000 7f65c7fff640 1 -- 172.21.15.6:0/539250195 shutdown_connections 2023-07-21T22:31:43.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.512+0000 7f65c7fff640 1 --2- 172.21.15.6:0/539250195 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f65a8066430 0x7f65a80688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.512+0000 7f65c7fff640 1 --2- 172.21.15.6:0/539250195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c8160750 0x7f65c8143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.512+0000 7f65c7fff640 1 --2- 172.21.15.6:0/539250195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65c80cc960 0x7f65c80b3860 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.512+0000 7f65c7fff640 1 --2- 172.21.15.6:0/539250195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80b1620 0x7f65c8159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.512+0000 7f65c7fff640 1 -- 172.21.15.6:0/539250195 >> 172.21.15.6:0/539250195 conn(0x7f65c8069f50 msgr2=0x7f65c815ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:43.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.512+0000 7f65c7fff640 1 -- 172.21.15.6:0/539250195 shutdown_connections 2023-07-21T22:31:43.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.512+0000 7f65c7fff640 1 -- 172.21.15.6:0/539250195 wait complete. 2023-07-21T22:31:43.578 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:31:43.605 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:43.561+0000 7f249f646180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:31:43.641 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:43.592+0000 7fb033613180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:31:43.702 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:43.652+0000 7fb033613180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:31:43.747 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:43.705+0000 7f249f646180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:31:43.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.724+0000 7f4afdf96640 1 Processor -- start 2023-07-21T22:31:43.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.724+0000 7f4afdf96640 1 -- start start 2023-07-21T22:31:43.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.724+0000 7f4afdf96640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4af80d2fc0 0x7f4af80b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:43.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.724+0000 7f4afdf96640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4af80d2300 0x7f4af80d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:43.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.724+0000 7f4afdf96640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af80b04c0 con 0x7f4af815bde0 2023-07-21T22:31:43.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.724+0000 7f4afdf96640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af815c1b0 con 0x7f4af80d2300 2023-07-21T22:31:43.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.724+0000 7f4afdf96640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af80d2c80 con 0x7f4af80d2fc0 2023-07-21T22:31:43.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.724+0000 7f4af7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4af80d2300 0x7f4af80d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:43.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.724+0000 7f4af7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4af80d2300 0x7f4af80d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38958/0 (socket says 172.21.15.6:38958) 2023-07-21T22:31:43.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.724+0000 7f4af7fff640 1 -- 172.21.15.6:0/4171145057 learned_addr learned my addr 172.21.15.6:0/4171145057 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:43.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.724+0000 7f4af6ffd640 1 --2- 172.21.15.6:0/4171145057 >> v2:172.21.15.161:3300/0 conn(0x7f4af80d2fc0 0x7f4af80b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:43.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.724+0000 7f4af7fff640 1 -- 172.21.15.6:0/4171145057 >> v2:172.21.15.161:3300/0 conn(0x7f4af80d2fc0 msgr2=0x7f4af80b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:43.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.724+0000 7f4af7fff640 1 --2- 172.21.15.6:0/4171145057 >> v2:172.21.15.161:3300/0 conn(0x7f4af80d2fc0 0x7f4af80b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.724+0000 7f4af7fff640 1 -- 172.21.15.6:0/4171145057 >> v1:172.21.15.6:6789/0 conn(0x7f4af815bde0 legacy=0x7f4af80d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:43.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.724+0000 7f4af7fff640 1 -- 172.21.15.6:0/4171145057 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af80d0aa0 con 0x7f4af80d2300 2023-07-21T22:31:43.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.724+0000 7f4af67fc640 1 -- 172.21.15.6:0/4171145057 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3536670787 0 0) 0x7f4af80b04c0 con 0x7f4af815bde0 2023-07-21T22:31:43.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.728+0000 7f4af7fff640 1 --2- 172.21.15.6:0/4171145057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af80d2300 0x7f4af80d2740 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4af808c600 tx=0x7f4af001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6acd424e68450bfd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:43.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.728+0000 7f4af67fc640 1 -- 172.21.15.6:0/4171145057 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af00a5890 con 0x7f4af80d2300 2023-07-21T22:31:43.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.728+0000 7f4af67fc640 1 -- 172.21.15.6:0/4171145057 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af00a59f0 con 0x7f4af80d2300 2023-07-21T22:31:43.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.728+0000 7f4af67fc640 1 -- 172.21.15.6:0/4171145057 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af00a5d80 con 0x7f4af80d2300 2023-07-21T22:31:43.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.728+0000 7f4afdf96640 1 -- 172.21.15.6:0/4171145057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af80d2300 msgr2=0x7f4af80d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:43.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.728+0000 7f4afdf96640 1 --2- 172.21.15.6:0/4171145057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af80d2300 0x7f4af80d2740 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4af808c600 tx=0x7f4af001c9d0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.728+0000 7f4afdf96640 1 -- 172.21.15.6:0/4171145057 shutdown_connections 2023-07-21T22:31:43.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.728+0000 7f4afdf96640 1 --2- 172.21.15.6:0/4171145057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af80d2300 0x7f4af80d2740 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.728+0000 7f4afdf96640 1 --2- 172.21.15.6:0/4171145057 >> v2:172.21.15.161:3300/0 conn(0x7f4af80d2fc0 0x7f4af80b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.728+0000 7f4afdf96640 1 -- 172.21.15.6:0/4171145057 >> 172.21.15.6:0/4171145057 conn(0x7f4af80659d0 msgr2=0x7f4af809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:43.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.728+0000 7f4afdf96640 1 -- 172.21.15.6:0/4171145057 shutdown_connections 2023-07-21T22:31:43.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.728+0000 7f4afdf96640 1 -- 172.21.15.6:0/4171145057 wait complete. 2023-07-21T22:31:43.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4afdf96640 1 Processor -- start 2023-07-21T22:31:43.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4afdf96640 1 -- start start 2023-07-21T22:31:43.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4afdf96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af80d2300 0x7f4af8152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:43.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4afdf96640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4af80d2fc0 0x7f4af8159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:43.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4afdf96640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4af815bde0 0x7f4af814d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:43.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4afdf96640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af80b6ad0 con 0x7f4af80d2300 2023-07-21T22:31:43.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4afdf96640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af8153180 con 0x7f4af815bde0 2023-07-21T22:31:43.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4afdf96640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af8153460 con 0x7f4af80d2fc0 2023-07-21T22:31:43.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4af77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af80d2300 0x7f4af8152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:43.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4af77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af80d2300 0x7f4af8152930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38962/0 (socket says 172.21.15.6:38962) 2023-07-21T22:31:43.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4af77fe640 1 -- 172.21.15.6:0/3113613503 learned_addr learned my addr 172.21.15.6:0/3113613503 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:43.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4af7fff640 1 --2- 172.21.15.6:0/3113613503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4af815bde0 0x7f4af814d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:43.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4af6ffd640 1 --2- 172.21.15.6:0/3113613503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4af80d2fc0 0x7f4af8159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:43.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4af77fe640 1 -- 172.21.15.6:0/3113613503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4af80d2fc0 msgr2=0x7f4af8159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:43.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4af77fe640 1 --2- 172.21.15.6:0/3113613503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4af80d2fc0 0x7f4af8159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4af77fe640 1 -- 172.21.15.6:0/3113613503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4af815bde0 msgr2=0x7f4af814d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:43.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4af77fe640 1 --2- 172.21.15.6:0/3113613503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4af815bde0 0x7f4af814d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4af77fe640 1 -- 172.21.15.6:0/3113613503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af0009b30 con 0x7f4af80d2300 2023-07-21T22:31:43.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4af77fe640 1 --2- 172.21.15.6:0/3113613503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af80d2300 0x7f4af8152930 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800c550 tx=0x7f4ae800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:43.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4adffff640 1 -- 172.21.15.6:0/3113613503 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8005480 con 0x7f4af80d2300 2023-07-21T22:31:43.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4adffff640 1 -- 172.21.15.6:0/3113613503 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae8003600 con 0x7f4af80d2300 2023-07-21T22:31:43.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4adffff640 1 -- 172.21.15.6:0/3113613503 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae80039b0 con 0x7f4af80d2300 2023-07-21T22:31:43.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4afdf96640 1 -- 172.21.15.6:0/3113613503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af8153740 con 0x7f4af80d2300 2023-07-21T22:31:43.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4afdf96640 1 -- 172.21.15.6:0/3113613503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af8159bd0 con 0x7f4af80d2300 2023-07-21T22:31:43.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.732+0000 7f4afdf96640 1 -- 172.21.15.6:0/3113613503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af8153980 con 0x7f4af80d2300 2023-07-21T22:31:43.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.736+0000 7f4adffff640 1 -- 172.21.15.6:0/3113613503 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f4ae8003b10 con 0x7f4af80d2300 2023-07-21T22:31:43.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.736+0000 7f4adffff640 1 --2- 172.21.15.6:0/3113613503 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4ae4066430 0x7f4ae40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:43.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.736+0000 7f4adffff640 1 -- 172.21.15.6:0/3113613503 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7717+0+0 (secure 0 0 0) 0x7f4ae8083ab0 con 0x7f4af80d2300 2023-07-21T22:31:43.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.736+0000 7f4af6ffd640 1 -- 172.21.15.6:0/3113613503 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4ae4066430 msgr2=0x7f4ae40688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2930793066 2023-07-21T22:31:43.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.736+0000 7f4af6ffd640 1 --2- 172.21.15.6:0/3113613503 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4ae4066430 0x7f4ae40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:31:43.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.740+0000 7f4adffff640 1 -- 172.21.15.6:0/3113613503 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4af8153980 con 0x7f4af80d2300 2023-07-21T22:31:43.806 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:43.761+0000 7f249f646180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:31:43.856 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:43.808+0000 7fb033613180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:31:43.918 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:43.868+0000 7fb033613180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:31:43.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.896+0000 7f4afdf96640 1 -- 172.21.15.6:0/3113613503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4af8159e50 con 0x7f4af80d2300 2023-07-21T22:31:43.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.896+0000 7f4adffff640 1 -- 172.21.15.6:0/3113613503 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ae80170a0 con 0x7f4af80d2300 2023-07-21T22:31:43.946 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:31:43.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.900+0000 7f4afdf96640 1 -- 172.21.15.6:0/3113613503 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4ae4066430 msgr2=0x7f4ae40688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:31:43.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.900+0000 7f4afdf96640 1 --2- 172.21.15.6:0/3113613503 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4ae4066430 0x7f4ae40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.900+0000 7f4afdf96640 1 -- 172.21.15.6:0/3113613503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af80d2300 msgr2=0x7f4af8152930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:43.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.900+0000 7f4afdf96640 1 --2- 172.21.15.6:0/3113613503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af80d2300 0x7f4af8152930 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4ae800c550 tx=0x7f4ae800ca10 comp rx=0 tx=0).stop 2023-07-21T22:31:43.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.900+0000 7f4afdf96640 1 -- 172.21.15.6:0/3113613503 shutdown_connections 2023-07-21T22:31:43.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.900+0000 7f4afdf96640 1 --2- 172.21.15.6:0/3113613503 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f4ae4066430 0x7f4ae40688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.900+0000 7f4afdf96640 1 --2- 172.21.15.6:0/3113613503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4af815bde0 0x7f4af814d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.900+0000 7f4afdf96640 1 --2- 172.21.15.6:0/3113613503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4af80d2fc0 0x7f4af8159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.900+0000 7f4afdf96640 1 --2- 172.21.15.6:0/3113613503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af80d2300 0x7f4af8152930 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:43.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.900+0000 7f4afdf96640 1 -- 172.21.15.6:0/3113613503 >> 172.21.15.6:0/3113613503 conn(0x7f4af80659d0 msgr2=0x7f4af806afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:43.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.900+0000 7f4afdf96640 1 -- 172.21.15.6:0/3113613503 shutdown_connections 2023-07-21T22:31:43.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:43.900+0000 7f4afdf96640 1 -- 172.21.15.6:0/3113613503 wait complete. 2023-07-21T22:31:43.968 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:31:44.047 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:31:44.047 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:31:44.047 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:31:44.055 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:44.013+0000 7f249f646180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:31:44.174 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:31:44.175 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:31:44.175 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:31:44.183 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:44.136+0000 7fb033613180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:31:44.188 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:44.145+0000 7f249f646180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:31:44.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.144+0000 7f41d6311640 1 Processor -- start 2023-07-21T22:31:44.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.144+0000 7f41d6311640 1 -- start start 2023-07-21T22:31:44.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.144+0000 7f41d6311640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41d00b7c70 0x7f41d00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:44.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.144+0000 7f41d6311640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f41d00d1850 0x7f41d015f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:44.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.144+0000 7f41d6311640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41d00d1300 0x7f41d015fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:44.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.144+0000 7f41d6311640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d00d1190 con 0x7f41d00d1300 2023-07-21T22:31:44.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.144+0000 7f41d6311640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d0160600 con 0x7f41d00d1850 2023-07-21T22:31:44.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.144+0000 7f41d6311640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d01600d0 con 0x7f41d00b7c70 2023-07-21T22:31:44.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.144+0000 7f41d48ae640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41d00d1300 0x7f41d015fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:44.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.144+0000 7f41d48ae640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41d00d1300 0x7f41d015fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38972/0 (socket says 172.21.15.6:38972) 2023-07-21T22:31:44.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.144+0000 7f41d48ae640 1 -- 172.21.15.6:0/3306001164 learned_addr learned my addr 172.21.15.6:0/3306001164 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:44.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.144+0000 7f41cffff640 1 --2- 172.21.15.6:0/3306001164 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41d00b7c70 0x7f41d00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:44.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.144+0000 7f41cf7fe640 1 --2- 172.21.15.6:0/3306001164 >> v2:172.21.15.161:3300/0 conn(0x7f41d00d1850 0x7f41d015f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:44.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.144+0000 7f41d48ae640 1 -- 172.21.15.6:0/3306001164 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41d00b7c70 msgr2=0x7f41d00d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:44.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.144+0000 7f41d48ae640 1 --2- 172.21.15.6:0/3306001164 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41d00b7c70 0x7f41d00d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.144+0000 7f41d48ae640 1 -- 172.21.15.6:0/3306001164 >> v2:172.21.15.161:3300/0 conn(0x7f41d00d1850 msgr2=0x7f41d015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:44.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.144+0000 7f41d48ae640 1 --2- 172.21.15.6:0/3306001164 >> v2:172.21.15.161:3300/0 conn(0x7f41d00d1850 0x7f41d015f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.144+0000 7f41d48ae640 1 -- 172.21.15.6:0/3306001164 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d00ccaf0 con 0x7f41d00d1300 2023-07-21T22:31:44.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.148+0000 7f41d48ae640 1 --2- 172.21.15.6:0/3306001164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d00d1300 0x7f41d015fb90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f41d0069dc0 tx=0x7f41c801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311a4434a27f4a57 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:44.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.148+0000 7f41ceffd640 1 -- 172.21.15.6:0/3306001164 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c80a5730 con 0x7f41d00d1300 2023-07-21T22:31:44.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.148+0000 7f41ceffd640 1 -- 172.21.15.6:0/3306001164 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c80a5890 con 0x7f41d00d1300 2023-07-21T22:31:44.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.148+0000 7f41ceffd640 1 -- 172.21.15.6:0/3306001164 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c80a5c20 con 0x7f41d00d1300 2023-07-21T22:31:44.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.148+0000 7f41d6311640 1 -- 172.21.15.6:0/3306001164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d00d1300 msgr2=0x7f41d015fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:44.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.148+0000 7f41d6311640 1 --2- 172.21.15.6:0/3306001164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d00d1300 0x7f41d015fb90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f41d0069dc0 tx=0x7f41c801c9a0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.148+0000 7f41d6311640 1 -- 172.21.15.6:0/3306001164 shutdown_connections 2023-07-21T22:31:44.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.148+0000 7f41d6311640 1 --2- 172.21.15.6:0/3306001164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d00d1300 0x7f41d015fb90 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.148+0000 7f41d6311640 1 --2- 172.21.15.6:0/3306001164 >> v2:172.21.15.161:3300/0 conn(0x7f41d00d1850 0x7f41d015f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.148+0000 7f41d6311640 1 --2- 172.21.15.6:0/3306001164 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41d00b7c70 0x7f41d00d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.148+0000 7f41d6311640 1 -- 172.21.15.6:0/3306001164 >> 172.21.15.6:0/3306001164 conn(0x7f41d00650b0 msgr2=0x7f41d00654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:44.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.148+0000 7f41d6311640 1 -- 172.21.15.6:0/3306001164 shutdown_connections 2023-07-21T22:31:44.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.148+0000 7f41d6311640 1 -- 172.21.15.6:0/3306001164 wait complete. 2023-07-21T22:31:44.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41d6311640 1 Processor -- start 2023-07-21T22:31:44.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41d6311640 1 -- start start 2023-07-21T22:31:44.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41d6311640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41d00b7c70 0x7f41d0158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:44.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41d6311640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41d00d1300 0x7f41d00b2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:44.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41d6311640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d00d1850 0x7f41d00b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:44.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41d6311640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d0158ad0 con 0x7f41d00d1850 2023-07-21T22:31:44.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41d6311640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d00c71b0 con 0x7f41d00d1300 2023-07-21T22:31:44.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41d6311640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d00b25b0 con 0x7f41d00b7c70 2023-07-21T22:31:44.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41d48ae640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d00d1850 0x7f41d00b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:44.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41d48ae640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d00d1850 0x7f41d00b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38984/0 (socket says 172.21.15.6:38984) 2023-07-21T22:31:44.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41d48ae640 1 -- 172.21.15.6:0/3080691826 learned_addr learned my addr 172.21.15.6:0/3080691826 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:44.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41cffff640 1 --2- 172.21.15.6:0/3080691826 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41d00b7c70 0x7f41d0158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:44.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41cf7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41d00d1300 0x7f41d00b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:44.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41d48ae640 1 -- 172.21.15.6:0/3080691826 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41d00b7c70 msgr2=0x7f41d0158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:44.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41d48ae640 1 --2- 172.21.15.6:0/3080691826 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41d00b7c70 0x7f41d0158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41d48ae640 1 -- 172.21.15.6:0/3080691826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41d00d1300 msgr2=0x7f41d00b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:44.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41d48ae640 1 --2- 172.21.15.6:0/3080691826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41d00d1300 0x7f41d00b2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41d48ae640 1 -- 172.21.15.6:0/3080691826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c8009b30 con 0x7f41d00d1850 2023-07-21T22:31:44.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41cffff640 1 --2- 172.21.15.6:0/3080691826 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41d00b7c70 0x7f41d0158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:44.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41d48ae640 1 --2- 172.21.15.6:0/3080691826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d00d1850 0x7f41d00b2be0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f41c801b050 tx=0x7f41c8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:44.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41ccff9640 1 -- 172.21.15.6:0/3080691826 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c80b8670 con 0x7f41d00d1850 2023-07-21T22:31:44.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41ccff9640 1 -- 172.21.15.6:0/3080691826 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c80b87f0 con 0x7f41d00d1850 2023-07-21T22:31:44.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41ccff9640 1 -- 172.21.15.6:0/3080691826 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c80b8ba0 con 0x7f41d00d1850 2023-07-21T22:31:44.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41d6311640 1 -- 172.21.15.6:0/3080691826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d00c5e30 con 0x7f41d00d1850 2023-07-21T22:31:44.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.152+0000 7f41d6311640 1 -- 172.21.15.6:0/3080691826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d00c63f0 con 0x7f41d00d1850 2023-07-21T22:31:44.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.156+0000 7f41d6311640 1 -- 172.21.15.6:0/3080691826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d00678d0 con 0x7f41d00d1850 2023-07-21T22:31:44.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.156+0000 7f41ccff9640 1 -- 172.21.15.6:0/3080691826 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f41c80b8d00 con 0x7f41d00d1850 2023-07-21T22:31:44.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.156+0000 7f41ccff9640 1 --2- 172.21.15.6:0/3080691826 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f41bc066430 0x7f41bc0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:44.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.156+0000 7f41ccff9640 1 -- 172.21.15.6:0/3080691826 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7717+0+0 (secure 0 0 0) 0x7f41c811fbf0 con 0x7f41d00d1850 2023-07-21T22:31:44.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.156+0000 7f41cffff640 1 -- 172.21.15.6:0/3080691826 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f41bc066430 msgr2=0x7f41bc0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2930793066 2023-07-21T22:31:44.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.156+0000 7f41cffff640 1 --2- 172.21.15.6:0/3080691826 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f41bc066430 0x7f41bc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:31:44.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.160+0000 7f41ccff9640 1 -- 172.21.15.6:0/3080691826 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f41c80eca00 con 0x7f41d00d1850 2023-07-21T22:31:44.312 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:44.269+0000 7f249f646180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:31:44.328 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:44.280+0000 7fb033613180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:31:44.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.328+0000 7f41d6311640 1 -- 172.21.15.6:0/3080691826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f41d00730b0 con 0x7f41d00d1850 2023-07-21T22:31:44.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.328+0000 7f41ccff9640 1 -- 172.21.15.6:0/3080691826 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v52) v1 ==== 80+0+359 (secure 0 0 0) 0x7f41c8009510 con 0x7f41d00d1850 2023-07-21T22:31:44.378 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/1202931620 2023-07-22T22:20:02.274267+0000 2023-07-21T22:31:44.379 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6833/3471136886 2023-07-22T22:20:02.274267+0000 2023-07-21T22:31:44.379 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6832/3471136886 2023-07-22T22:20:02.274267+0000 2023-07-21T22:31:44.379 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/2854890359 2023-07-22T22:20:02.274267+0000 2023-07-21T22:31:44.379 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/1870877504 2023-07-22T22:20:02.274267+0000 2023-07-21T22:31:44.379 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/306225944 2023-07-22T22:20:02.274267+0000 2023-07-21T22:31:44.379 INFO:teuthology.orchestra.run.smithi006.stderr:listed 6 entries 2023-07-21T22:31:44.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.332+0000 7f41d6311640 1 -- 172.21.15.6:0/3080691826 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f41bc066430 msgr2=0x7f41bc0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:31:44.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.332+0000 7f41d6311640 1 --2- 172.21.15.6:0/3080691826 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f41bc066430 0x7f41bc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.332+0000 7f41d6311640 1 -- 172.21.15.6:0/3080691826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d00d1850 msgr2=0x7f41d00b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:44.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.332+0000 7f41d6311640 1 --2- 172.21.15.6:0/3080691826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d00d1850 0x7f41d00b2be0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f41c801b050 tx=0x7f41c8019740 comp rx=0 tx=0).stop 2023-07-21T22:31:44.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.332+0000 7f41d6311640 1 -- 172.21.15.6:0/3080691826 shutdown_connections 2023-07-21T22:31:44.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.332+0000 7f41d6311640 1 --2- 172.21.15.6:0/3080691826 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f41bc066430 0x7f41bc0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.332+0000 7f41d6311640 1 --2- 172.21.15.6:0/3080691826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41d00d1850 0x7f41d00b2be0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.332+0000 7f41d6311640 1 --2- 172.21.15.6:0/3080691826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41d00d1300 0x7f41d00b2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.332+0000 7f41d6311640 1 --2- 172.21.15.6:0/3080691826 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41d00b7c70 0x7f41d0158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.332+0000 7f41d6311640 1 -- 172.21.15.6:0/3080691826 >> 172.21.15.6:0/3080691826 conn(0x7f41d00650b0 msgr2=0x7f41d00b5130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:44.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.332+0000 7f41d6311640 1 -- 172.21.15.6:0/3080691826 shutdown_connections 2023-07-21T22:31:44.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.332+0000 7f41d6311640 1 -- 172.21.15.6:0/3080691826 wait complete. 2023-07-21T22:31:44.382 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:44.337+0000 7f249f646180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:31:44.400 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-21T22:31:44.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:44.401 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-21T22:31:44.459 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:31:44.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:31:44.460 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T22:31:44.465 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:44.416+0000 7fb033613180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:31:44.470 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:31:44.470 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:31:44.479 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:31:44.479 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:31:44.480 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:31:44.518 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:31:44.519 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:31:44.519 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:31:44.520 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:44.473+0000 7f249f646180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:31:44.528 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:31:44.528 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:31:44.539 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:44.492+0000 7fb033613180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:31:44.682 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:44.632+0000 7fb033613180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:31:44.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.636+0000 7fc2e2ccb640 1 Processor -- start 2023-07-21T22:31:44.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.636+0000 7fc2e2ccb640 1 -- start start 2023-07-21T22:31:44.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.636+0000 7fc2e2ccb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc2dc0b7c70 0x7fc2dc0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:44.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.636+0000 7fc2e2ccb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2dc15fd60 0x7fc2dc0d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:44.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.636+0000 7fc2e2ccb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2dc0ccaf0 con 0x7fc2dc0d1850 2023-07-21T22:31:44.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.636+0000 7fc2e2ccb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2dc0d1190 con 0x7fc2dc0b7c70 2023-07-21T22:31:44.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.636+0000 7fc2e2ccb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc160600 con 0x7fc2dc15fd60 2023-07-21T22:31:44.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.640+0000 7fc2e0a67640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc2dc0b7c70 0x7fc2dc0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:44.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.640+0000 7fc2e1268640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2dc15fd60 0x7fc2dc0d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:44.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.640+0000 7fc2e1268640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2dc15fd60 0x7fc2dc0d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:46458/0 (socket says 172.21.15.6:46458) 2023-07-21T22:31:44.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.640+0000 7fc2e0a67640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc2dc0b7c70 0x7fc2dc0d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35608/0 (socket says 172.21.15.6:35608) 2023-07-21T22:31:44.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.640+0000 7fc2e1268640 1 -- 172.21.15.6:0/2428613074 learned_addr learned my addr 172.21.15.6:0/2428613074 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:44.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.640+0000 7fc2e1268640 1 -- 172.21.15.6:0/2428613074 >> v2:172.21.15.161:3300/0 conn(0x7fc2dc0b7c70 msgr2=0x7fc2dc0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:44.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.640+0000 7fc2e1268640 1 --2- 172.21.15.6:0/2428613074 >> v2:172.21.15.161:3300/0 conn(0x7fc2dc0b7c70 0x7fc2dc0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.640+0000 7fc2e1268640 1 -- 172.21.15.6:0/2428613074 >> v1:172.21.15.161:6789/0 conn(0x7fc2dc0d1850 legacy=0x7fc2dc15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:44.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.640+0000 7fc2e1268640 1 -- 172.21.15.6:0/2428613074 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc160320 con 0x7fc2dc15fd60 2023-07-21T22:31:44.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.640+0000 7fc2e0a67640 1 --2- 172.21.15.6:0/2428613074 >> v2:172.21.15.161:3300/0 conn(0x7fc2dc0b7c70 0x7fc2dc0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:44.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.640+0000 7fc2e1268640 1 --2- 172.21.15.6:0/2428613074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2dc15fd60 0x7fc2dc0d1da0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009e50 tx=0x7fc2d401c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef9d5713c70e2fb4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:44.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.640+0000 7fc2db7fe640 1 -- 172.21.15.6:0/2428613074 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d40a58d0 con 0x7fc2dc15fd60 2023-07-21T22:31:44.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.640+0000 7fc2db7fe640 1 -- 172.21.15.6:0/2428613074 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d40a5a30 con 0x7fc2dc15fd60 2023-07-21T22:31:44.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.640+0000 7fc2db7fe640 1 -- 172.21.15.6:0/2428613074 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d40a5dc0 con 0x7fc2dc15fd60 2023-07-21T22:31:44.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2e2ccb640 1 -- 172.21.15.6:0/2428613074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2dc15fd60 msgr2=0x7fc2dc0d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:44.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2e2ccb640 1 --2- 172.21.15.6:0/2428613074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2dc15fd60 0x7fc2dc0d1da0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009e50 tx=0x7fc2d401c9e0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2e2ccb640 1 -- 172.21.15.6:0/2428613074 shutdown_connections 2023-07-21T22:31:44.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2e2ccb640 1 --2- 172.21.15.6:0/2428613074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2dc15fd60 0x7fc2dc0d1da0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2e2ccb640 1 --2- 172.21.15.6:0/2428613074 >> v2:172.21.15.161:3300/0 conn(0x7fc2dc0b7c70 0x7fc2dc0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2e2ccb640 1 -- 172.21.15.6:0/2428613074 >> 172.21.15.6:0/2428613074 conn(0x7fc2dc0650b0 msgr2=0x7fc2dc0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:44.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2e2ccb640 1 -- 172.21.15.6:0/2428613074 shutdown_connections 2023-07-21T22:31:44.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2e2ccb640 1 -- 172.21.15.6:0/2428613074 wait complete. 2023-07-21T22:31:44.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2e2ccb640 1 Processor -- start 2023-07-21T22:31:44.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2e2ccb640 1 -- start start 2023-07-21T22:31:44.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2e2ccb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2dc0b7c70 0x7fc2dc153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:44.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2e2ccb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2dc0d1850 0x7fc2dc15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:44.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2e2ccb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2dc15fd60 0x7fc2dc15df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:44.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2e2ccb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc15ef10 con 0x7fc2dc0d1850 2023-07-21T22:31:44.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2e2ccb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc0cb430 con 0x7fc2dc0b7c70 2023-07-21T22:31:44.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2e2ccb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2dc0cb710 con 0x7fc2dc15fd60 2023-07-21T22:31:44.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2dbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2dc0d1850 0x7fc2dc15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:44.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2dbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2dc0d1850 0x7fc2dc15ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38998/0 (socket says 172.21.15.6:38998) 2023-07-21T22:31:44.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2e0a67640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2dc0b7c70 0x7fc2dc153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:44.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2dbfff640 1 -- 172.21.15.6:0/3392496708 learned_addr learned my addr 172.21.15.6:0/3392496708 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:44.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.644+0000 7fc2e1268640 1 --2- 172.21.15.6:0/3392496708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2dc15fd60 0x7fc2dc15df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:44.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.648+0000 7fc2dbfff640 1 -- 172.21.15.6:0/3392496708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2dc15fd60 msgr2=0x7fc2dc15df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:44.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.648+0000 7fc2dbfff640 1 --2- 172.21.15.6:0/3392496708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2dc15fd60 0x7fc2dc15df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.648+0000 7fc2dbfff640 1 -- 172.21.15.6:0/3392496708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2dc0b7c70 msgr2=0x7fc2dc153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:44.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.648+0000 7fc2dbfff640 1 --2- 172.21.15.6:0/3392496708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2dc0b7c70 0x7fc2dc153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.648+0000 7fc2dbfff640 1 -- 172.21.15.6:0/3392496708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d0009420 con 0x7fc2dc0d1850 2023-07-21T22:31:44.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.648+0000 7fc2dbfff640 1 --2- 172.21.15.6:0/3392496708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2dc0d1850 0x7fc2dc15ba00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800c3c0 tx=0x7fc2c800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:44.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.648+0000 7fc2d97fa640 1 -- 172.21.15.6:0/3392496708 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80052d0 con 0x7fc2dc0d1850 2023-07-21T22:31:44.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.648+0000 7fc2d97fa640 1 -- 172.21.15.6:0/3392496708 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c8005430 con 0x7fc2dc0d1850 2023-07-21T22:31:44.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.648+0000 7fc2d97fa640 1 -- 172.21.15.6:0/3392496708 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8003840 con 0x7fc2dc0d1850 2023-07-21T22:31:44.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.648+0000 7fc2e2ccb640 1 -- 172.21.15.6:0/3392496708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d4009b30 con 0x7fc2dc0d1850 2023-07-21T22:31:44.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.648+0000 7fc2e2ccb640 1 -- 172.21.15.6:0/3392496708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2dc0cbcd0 con 0x7fc2dc0d1850 2023-07-21T22:31:44.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.648+0000 7fc2e2ccb640 1 -- 172.21.15.6:0/3392496708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2dc0678d0 con 0x7fc2dc0d1850 2023-07-21T22:31:44.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.648+0000 7fc2d97fa640 1 -- 172.21.15.6:0/3392496708 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 85829+0+0 (secure 0 0 0) 0x7fc2c80039a0 con 0x7fc2dc0d1850 2023-07-21T22:31:44.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.648+0000 7fc2d97fa640 1 --2- 172.21.15.6:0/3392496708 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fc2c0066430 0x7fc2c00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:44.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.648+0000 7fc2d97fa640 1 -- 172.21.15.6:0/3392496708 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7717+0+0 (secure 0 0 0) 0x7fc2c8083b60 con 0x7fc2dc0d1850 2023-07-21T22:31:44.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.648+0000 7fc2e0a67640 1 -- 172.21.15.6:0/3392496708 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fc2c0066430 msgr2=0x7fc2c00688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2930793066 2023-07-21T22:31:44.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.648+0000 7fc2e0a67640 1 --2- 172.21.15.6:0/3392496708 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fc2c0066430 0x7fc2c00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:31:44.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.652+0000 7fc2d97fa640 1 -- 172.21.15.6:0/3392496708 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc2c80507a0 con 0x7fc2dc0d1850 2023-07-21T22:31:44.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.844+0000 7fc2e2ccb640 1 -- 172.21.15.6:0/3392496708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2dc0cbec0 con 0x7fc2dc0d1850 2023-07-21T22:31:44.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.844+0000 7fc2d97fa640 1 -- 172.21.15.6:0/3392496708 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4662 (secure 0 0 0) 0x7fc2c8017090 con 0x7fc2dc0d1850 2023-07-21T22:31:44.893 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:44.894 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4928,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3033056690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3033056690},{"type":"v1","addr":"172.21.15.161:6836","nonce":3033056690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/77801161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":77801161},{"type":"v1","addr":"172.21.15.6:6835","nonce":77801161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5152,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/558287949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":558287949},{"type":"v1","addr":"172.21.15.161:6837","nonce":558287949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:19:45.163404+0000","modified":"2023-07-21T22:19:48.796910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5181":{"gid":5181,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/2921512075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2921512075},{"type":"v1","addr":"172.21.15.6:6834","nonce":2921512075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-21T22:31:44.894 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-07-21T22:31:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.848+0000 7fc2e2ccb640 1 -- 172.21.15.6:0/3392496708 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fc2c0066430 msgr2=0x7fc2c00688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:31:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.848+0000 7fc2e2ccb640 1 --2- 172.21.15.6:0/3392496708 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fc2c0066430 0x7fc2c00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.848+0000 7fc2e2ccb640 1 -- 172.21.15.6:0/3392496708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2dc0d1850 msgr2=0x7fc2dc15ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:44.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.848+0000 7fc2e2ccb640 1 --2- 172.21.15.6:0/3392496708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2dc0d1850 0x7fc2dc15ba00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800c3c0 tx=0x7fc2c800c880 comp rx=0 tx=0).stop 2023-07-21T22:31:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.848+0000 7fc2e2ccb640 1 -- 172.21.15.6:0/3392496708 shutdown_connections 2023-07-21T22:31:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.848+0000 7fc2e2ccb640 1 --2- 172.21.15.6:0/3392496708 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fc2c0066430 0x7fc2c00688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.848+0000 7fc2e2ccb640 1 --2- 172.21.15.6:0/3392496708 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2dc15fd60 0x7fc2dc15df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.848+0000 7fc2e2ccb640 1 --2- 172.21.15.6:0/3392496708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2dc0d1850 0x7fc2dc15ba00 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.848+0000 7fc2e2ccb640 1 --2- 172.21.15.6:0/3392496708 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2dc0b7c70 0x7fc2dc153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:44.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.848+0000 7fc2e2ccb640 1 -- 172.21.15.6:0/3392496708 >> 172.21.15.6:0/3392496708 conn(0x7fc2dc0650b0 msgr2=0x7fc2dc0b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:44.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.848+0000 7fc2e2ccb640 1 -- 172.21.15.6:0/3392496708 shutdown_connections 2023-07-21T22:31:44.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:44.848+0000 7fc2e2ccb640 1 -- 172.21.15.6:0/3392496708 wait complete. 2023-07-21T22:31:44.914 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:31:45.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.012+0000 7f7168418640 1 Processor -- start 2023-07-21T22:31:45.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.012+0000 7f7168418640 1 -- start start 2023-07-21T22:31:45.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.012+0000 7f7168418640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7160070b70 0x7f7160070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:45.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.012+0000 7f7168418640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f716006b1e0 0x7f71600c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:45.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.012+0000 7f7168418640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71600cac70 con 0x7f71600c21f0 2023-07-21T22:31:45.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.012+0000 7f7168418640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7160071480 con 0x7f7160070b70 2023-07-21T22:31:45.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.012+0000 7f7168418640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71600ca060 con 0x7f716006b1e0 2023-07-21T22:31:45.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.016+0000 7f71661b4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7160070b70 0x7f7160070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:45.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.016+0000 7f71659b3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f716006b1e0 0x7f71600c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:45.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.016+0000 7f71661b4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7160070b70 0x7f7160070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39006/0 (socket says 172.21.15.6:39006) 2023-07-21T22:31:45.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.016+0000 7f71661b4640 1 -- 172.21.15.6:0/3338260091 learned_addr learned my addr 172.21.15.6:0/3338260091 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:45.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.016+0000 7f71661b4640 1 -- 172.21.15.6:0/3338260091 >> v2:172.21.15.161:3300/0 conn(0x7f716006b1e0 msgr2=0x7f71600c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:45.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.016+0000 7f71661b4640 1 --2- 172.21.15.6:0/3338260091 >> v2:172.21.15.161:3300/0 conn(0x7f716006b1e0 0x7f71600c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.016+0000 7f71661b4640 1 -- 172.21.15.6:0/3338260091 >> v1:172.21.15.161:6789/0 conn(0x7f71600c21f0 legacy=0x7f71600cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:45.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.016+0000 7f71661b4640 1 -- 172.21.15.6:0/3338260091 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71600ca340 con 0x7f7160070b70 2023-07-21T22:31:45.065 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:45.021+0000 7f249f646180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:31:45.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.016+0000 7f71661b4640 1 --2- 172.21.15.6:0/3338260091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7160070b70 0x7f7160070f40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f716006f380 tx=0x7f715c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7309b7e139e949ee server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:45.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.016+0000 7f71651b2640 1 -- 172.21.15.6:0/3338260091 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c0aa430 con 0x7f7160070b70 2023-07-21T22:31:45.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.016+0000 7f71651b2640 1 -- 172.21.15.6:0/3338260091 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715c0aa590 con 0x7f7160070b70 2023-07-21T22:31:45.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.016+0000 7f71651b2640 1 -- 172.21.15.6:0/3338260091 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c0aa920 con 0x7f7160070b70 2023-07-21T22:31:45.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f7168418640 1 -- 172.21.15.6:0/3338260091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7160070b70 msgr2=0x7f7160070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:45.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f7168418640 1 --2- 172.21.15.6:0/3338260091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7160070b70 0x7f7160070f40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f716006f380 tx=0x7f715c01c4d0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f7168418640 1 -- 172.21.15.6:0/3338260091 shutdown_connections 2023-07-21T22:31:45.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f7168418640 1 --2- 172.21.15.6:0/3338260091 >> v2:172.21.15.161:3300/0 conn(0x7f716006b1e0 0x7f71600c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f7168418640 1 --2- 172.21.15.6:0/3338260091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7160070b70 0x7f7160070f40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f7168418640 1 -- 172.21.15.6:0/3338260091 >> 172.21.15.6:0/3338260091 conn(0x7f71600afcf0 msgr2=0x7f71600b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:45.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f7168418640 1 -- 172.21.15.6:0/3338260091 shutdown_connections 2023-07-21T22:31:45.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f7168418640 1 -- 172.21.15.6:0/3338260091 wait complete. 2023-07-21T22:31:45.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f7168418640 1 Processor -- start 2023-07-21T22:31:45.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f7168418640 1 -- start start 2023-07-21T22:31:45.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f7168418640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f716006b1e0 0x7f71600c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:45.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f7168418640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7160070b70 0x7f7160149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:45.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f7168418640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71600c21f0 0x7f7160158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:45.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f7168418640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71600c3030 con 0x7f71600c21f0 2023-07-21T22:31:45.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f7168418640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71600c3e90 con 0x7f716006b1e0 2023-07-21T22:31:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f7168418640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71600c3280 con 0x7f7160070b70 2023-07-21T22:31:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f71669b5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71600c21f0 0x7f7160158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f71661b4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f716006b1e0 0x7f71600c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f71661b4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f716006b1e0 0x7f71600c44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35620/0 (socket says 172.21.15.6:35620) 2023-07-21T22:31:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f71661b4640 1 -- 172.21.15.6:0/1210347722 learned_addr learned my addr 172.21.15.6:0/1210347722 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:45.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.020+0000 7f71659b3640 1 --2- 172.21.15.6:0/1210347722 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7160070b70 0x7f7160149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:45.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.024+0000 7f71661b4640 1 -- 172.21.15.6:0/1210347722 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7160070b70 msgr2=0x7f7160149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:45.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.024+0000 7f71661b4640 1 --2- 172.21.15.6:0/1210347722 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7160070b70 0x7f7160149f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.024+0000 7f71661b4640 1 -- 172.21.15.6:0/1210347722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71600c21f0 msgr2=0x7f7160158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:45.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.024+0000 7f71661b4640 1 --2- 172.21.15.6:0/1210347722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71600c21f0 0x7f7160158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.024+0000 7f71661b4640 1 -- 172.21.15.6:0/1210347722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715c0094d0 con 0x7f716006b1e0 2023-07-21T22:31:45.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.024+0000 7f71669b5640 1 --2- 172.21.15.6:0/1210347722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71600c21f0 0x7f7160158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:45.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.024+0000 7f71661b4640 1 --2- 172.21.15.6:0/1210347722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f716006b1e0 0x7f71600c44c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f715c0190e0 tx=0x7f715c01ad10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:45.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.024+0000 7f7156ffd640 1 -- 172.21.15.6:0/1210347722 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c0aa430 con 0x7f716006b1e0 2023-07-21T22:31:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.024+0000 7f7156ffd640 1 -- 172.21.15.6:0/1210347722 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715c0b3800 con 0x7f716006b1e0 2023-07-21T22:31:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.024+0000 7f7156ffd640 1 -- 172.21.15.6:0/1210347722 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c0b3b90 con 0x7f716006b1e0 2023-07-21T22:31:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.024+0000 7f7168418640 1 -- 172.21.15.6:0/1210347722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71600c3560 con 0x7f716006b1e0 2023-07-21T22:31:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.024+0000 7f7168418640 1 -- 172.21.15.6:0/1210347722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71600c3b20 con 0x7f716006b1e0 2023-07-21T22:31:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.024+0000 7f7168418640 1 -- 172.21.15.6:0/1210347722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71600678d0 con 0x7f716006b1e0 2023-07-21T22:31:45.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.024+0000 7f7156ffd640 1 -- 172.21.15.6:0/1210347722 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 13) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f715c0b3cf0 con 0x7f716006b1e0 2023-07-21T22:31:45.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.028+0000 7f7156ffd640 1 --2- 172.21.15.6:0/1210347722 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f7144066460 0x7f7144068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:45.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.028+0000 7f7156ffd640 1 -- 172.21.15.6:0/1210347722 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7717+0+0 (secure 0 0 0) 0x7f715c11e890 con 0x7f716006b1e0 2023-07-21T22:31:45.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.028+0000 7f71659b3640 1 -- 172.21.15.6:0/1210347722 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f7144066460 msgr2=0x7f7144068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2930793066 2023-07-21T22:31:45.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.028+0000 7f71659b3640 1 --2- 172.21.15.6:0/1210347722 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f7144066460 0x7f7144068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:31:45.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.032+0000 7f7156ffd640 1 -- 172.21.15.6:0/1210347722 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f715c0eb3c0 con 0x7f716006b1e0 2023-07-21T22:31:45.151 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:45.109+0000 7f249f646180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:31:45.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.192+0000 7f7168418640 1 -- 172.21.15.6:0/1210347722 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71600c98c0 con 0x7f716006b1e0 2023-07-21T22:31:45.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.192+0000 7f7156ffd640 1 -- 172.21.15.6:0/1210347722 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+20796 (secure 0 0 0) 0x7f715c0c3070 con 0x7f716006b1e0 2023-07-21T22:31:45.242 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:45.242 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":52,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:31:42.741290+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:19:43.286760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-21T22:19:44.152686+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":51,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1c","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/1202931620":"2023-07-22T22:20:02.274267+0000","172.21.15.161:6833/3471136886":"2023-07-22T22:20:02.274267+0000","172.21.15.161:6832/3471136886":"2023-07-22T22:20:02.274267+0000","172.21.15.161:0/2854890359":"2023-07-22T22:20:02.274267+0000","172.21.15.161:0/1870877504":"2023-07-22T22:20:02.274267+0000","172.21.15.161:0/306225944":"2023-07-22T22:20:02.274267+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":6,"length":1},{"begin":8,"length":1},{"begin":10,"length":1},{"begin":13,"length":1},{"begin":17,"length":1},{"begin":19,"length":1},{"begin":21,"length":2},{"begin":24,"length":1},{"begin":28,"length":1},{"begin":30,"length":1},{"begin":33,"length":1},{"begin":35,"length":1},{"begin":39,"length":1},{"begin":41,"length":1},{"begin":43,"length":1},{"begin":45,"length":1},{"begin":49,"length":1},{"begin":51,"length":1},{"begin":53,"length":1},{"begin":55,"length":1},{"begin":59,"length":1},{"begin":61,"length":2},{"begin":64,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":73,"length":1},{"begin":75,"length":1},{"begin":77,"length":1},{"begin":81,"length":2},{"begin":84,"length":1},{"begin":86,"length":1},{"begin":88,"length":1},{"begin":92,"length":1},{"begin":94,"length":1},{"begin":96,"length":1},{"begin":98,"length":1},{"begin":103,"length":1},{"begin":105,"length":1},{"begin":109,"length":1},{"begin":111,"length":1},{"begin":177,"length":44}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":3,"length":3},{"begin":7,"length":1},{"begin":9,"length":1},{"begin":11,"length":2},{"begin":14,"length":3},{"begin":18,"length":1},{"begin":20,"length":1},{"begin":23,"length":1},{"begin":25,"length":3},{"begin":29,"length":1},{"begin":31,"length":2},{"begin":34,"length":1},{"begin":36,"length":3},{"begin":40,"length":1},{"begin":42,"length":1},{"begin":44,"length":1},{"begin":46,"length":3},{"begin":50,"length":1},{"begin":52,"length":1},{"begin":54,"length":1},{"begin":56,"length":3},{"begin":60,"length":1},{"begin":63,"length":1},{"begin":65,"length":1},{"begin":67,"length":3},{"begin":71,"length":2},{"begin":74,"length":1},{"begin":76,"length":1},{"begin":78,"length":3},{"begin":83,"length":1},{"begin":85,"length":1},{"begin":87,"length":1},{"begin":89,"length":3},{"begin":93,"length":1},{"begin":95,"length":1},{"begin":97,"length":1},{"begin":99,"length":4},{"begin":104,"length":1},{"begin":106,"length":1},{"begin":108,"length":1},{"begin":110,"length":1},{"begin":112,"length":65}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:31:45.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.196+0000 7f7168418640 1 -- 172.21.15.6:0/1210347722 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f7144066460 msgr2=0x7f7144068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:31:45.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.196+0000 7f7168418640 1 --2- 172.21.15.6:0/1210347722 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f7144066460 0x7f7144068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.196+0000 7f7168418640 1 -- 172.21.15.6:0/1210347722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f716006b1e0 msgr2=0x7f71600c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:45.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.196+0000 7f7168418640 1 --2- 172.21.15.6:0/1210347722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f716006b1e0 0x7f71600c44c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f715c0190e0 tx=0x7f715c01ad10 comp rx=0 tx=0).stop 2023-07-21T22:31:45.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.196+0000 7f7168418640 1 -- 172.21.15.6:0/1210347722 shutdown_connections 2023-07-21T22:31:45.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.196+0000 7f7168418640 1 --2- 172.21.15.6:0/1210347722 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7f7144066460 0x7f7144068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.196+0000 7f7168418640 1 --2- 172.21.15.6:0/1210347722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71600c21f0 0x7f7160158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.196+0000 7f7168418640 1 --2- 172.21.15.6:0/1210347722 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7160070b70 0x7f7160149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.196+0000 7f7168418640 1 --2- 172.21.15.6:0/1210347722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f716006b1e0 0x7f71600c44c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.196+0000 7f7168418640 1 -- 172.21.15.6:0/1210347722 >> 172.21.15.6:0/1210347722 conn(0x7f71600afcf0 msgr2=0x7f71600b38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:45.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.196+0000 7f7168418640 1 -- 172.21.15.6:0/1210347722 shutdown_connections 2023-07-21T22:31:45.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.196+0000 7f7168418640 1 -- 172.21.15.6:0/1210347722 wait complete. 2023-07-21T22:31:45.264 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:19:43.286760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:19:44.152686+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 220, 'snap_epoch': 51, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:31:45.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:31:45.266 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:45.216+0000 7fb033613180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:31:45.298 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:45.253+0000 7f249f646180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:31:45.354 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:45.304+0000 7fb033613180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:31:45.382 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:45.337+0000 7f249f646180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:31:45.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.364+0000 7fb89d00b640 1 Processor -- start 2023-07-21T22:31:45.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.364+0000 7fb89d00b640 1 -- start start 2023-07-21T22:31:45.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.368+0000 7fb89d00b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb8980cba60 0x7fb8980c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:45.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.368+0000 7fb89d00b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb89815b9c0 0x7fb8980cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:45.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.368+0000 7fb89d00b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8980cc370 con 0x7fb898158090 2023-07-21T22:31:45.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.368+0000 7fb89d00b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8980c37e0 con 0x7fb89815b9c0 2023-07-21T22:31:45.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.368+0000 7fb89d00b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8980c3ac0 con 0x7fb8980cba60 2023-07-21T22:31:45.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.368+0000 7fb89659c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb89815b9c0 0x7fb8980cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:45.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.368+0000 7fb89659c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb89815b9c0 0x7fb8980cbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39026/0 (socket says 172.21.15.6:39026) 2023-07-21T22:31:45.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.368+0000 7fb89759e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb898158090 0x7fb8981584f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44346/0 (socket says 172.21.15.6:44346) 2023-07-21T22:31:45.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.368+0000 7fb89659c640 1 -- 172.21.15.6:0/3727166407 learned_addr learned my addr 172.21.15.6:0/3727166407 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:45.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.368+0000 7fb896d9d640 1 --2- 172.21.15.6:0/3727166407 >> v2:172.21.15.161:3300/0 conn(0x7fb8980cba60 0x7fb8980c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.368+0000 7fb89659c640 1 -- 172.21.15.6:0/3727166407 >> v2:172.21.15.161:3300/0 conn(0x7fb8980cba60 msgr2=0x7fb8980c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.368+0000 7fb89659c640 1 --2- 172.21.15.6:0/3727166407 >> v2:172.21.15.161:3300/0 conn(0x7fb8980cba60 0x7fb8980c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.368+0000 7fb89659c640 1 -- 172.21.15.6:0/3727166407 >> v1:172.21.15.6:6789/0 conn(0x7fb898158090 legacy=0x7fb8981584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.368+0000 7fb89659c640 1 -- 172.21.15.6:0/3727166407 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8980c3da0 con 0x7fb89815b9c0 2023-07-21T22:31:45.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.368+0000 7fb896d9d640 1 --2- 172.21.15.6:0/3727166407 >> v2:172.21.15.161:3300/0 conn(0x7fb8980cba60 0x7fb8980c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:45.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.368+0000 7fb89659c640 1 --2- 172.21.15.6:0/3727166407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb89815b9c0 0x7fb8980cbe30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb8980cba10 tx=0x7fb88c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c232df62ab0751a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.372+0000 7fb895d9b640 1 -- 172.21.15.6:0/3727166407 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c0ab600 con 0x7fb89815b9c0 2023-07-21T22:31:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.372+0000 7fb895d9b640 1 -- 172.21.15.6:0/3727166407 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c0a7050 con 0x7fb89815b9c0 2023-07-21T22:31:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.372+0000 7fb895d9b640 1 -- 172.21.15.6:0/3727166407 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c0ab980 con 0x7fb89815b9c0 2023-07-21T22:31:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.372+0000 7fb89d00b640 1 -- 172.21.15.6:0/3727166407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb89815b9c0 msgr2=0x7fb8980cbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.372+0000 7fb89d00b640 1 --2- 172.21.15.6:0/3727166407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb89815b9c0 0x7fb8980cbe30 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb8980cba10 tx=0x7fb88c01c3b0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.372+0000 7fb89d00b640 1 -- 172.21.15.6:0/3727166407 shutdown_connections 2023-07-21T22:31:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.372+0000 7fb89d00b640 1 --2- 172.21.15.6:0/3727166407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb89815b9c0 0x7fb8980cbe30 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.372+0000 7fb89d00b640 1 --2- 172.21.15.6:0/3727166407 >> v2:172.21.15.161:3300/0 conn(0x7fb8980cba60 0x7fb8980c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.372+0000 7fb89d00b640 1 -- 172.21.15.6:0/3727166407 >> 172.21.15.6:0/3727166407 conn(0x7fb8980cde90 msgr2=0x7fb8980ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.372+0000 7fb89d00b640 1 -- 172.21.15.6:0/3727166407 shutdown_connections 2023-07-21T22:31:45.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.372+0000 7fb89d00b640 1 -- 172.21.15.6:0/3727166407 wait complete. 2023-07-21T22:31:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.372+0000 7fb89d00b640 1 Processor -- start 2023-07-21T22:31:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.372+0000 7fb89d00b640 1 -- start start 2023-07-21T22:31:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.372+0000 7fb89d00b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8980cba60 0x7fb898156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.372+0000 7fb89d00b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb898158090 0x7fb89814fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.372+0000 7fb89d00b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb89815b9c0 0x7fb8981465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.372+0000 7fb89d00b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89814adf0 con 0x7fb898158090 2023-07-21T22:31:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.372+0000 7fb89d00b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89814b0d0 con 0x7fb8980cba60 2023-07-21T22:31:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.372+0000 7fb89d00b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89814b3b0 con 0x7fb89815b9c0 2023-07-21T22:31:45.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.376+0000 7fb89659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb898158090 0x7fb89814fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:45.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.376+0000 7fb896d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8980cba60 0x7fb898156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:45.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.376+0000 7fb89759e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb89815b9c0 0x7fb8981465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:45.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.376+0000 7fb896d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8980cba60 0x7fb898156d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35636/0 (socket says 172.21.15.6:35636) 2023-07-21T22:31:45.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.376+0000 7fb896d9d640 1 -- 172.21.15.6:0/1077305612 learned_addr learned my addr 172.21.15.6:0/1077305612 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:45.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.376+0000 7fb89659c640 1 -- 172.21.15.6:0/1077305612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb89815b9c0 msgr2=0x7fb8981465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:45.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.376+0000 7fb89659c640 1 --2- 172.21.15.6:0/1077305612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb89815b9c0 0x7fb8981465a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.376+0000 7fb89659c640 1 -- 172.21.15.6:0/1077305612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8980cba60 msgr2=0x7fb898156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:45.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.376+0000 7fb89659c640 1 --2- 172.21.15.6:0/1077305612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8980cba60 0x7fb898156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.376+0000 7fb89659c640 1 -- 172.21.15.6:0/1077305612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88c0094d0 con 0x7fb898158090 2023-07-21T22:31:45.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.376+0000 7fb89659c640 1 --2- 172.21.15.6:0/1077305612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb898158090 0x7fb89814fa50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb88c0ab000 tx=0x7fb88c019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:45.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.376+0000 7fb87f7fe640 1 -- 172.21.15.6:0/1077305612 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c0b6620 con 0x7fb898158090 2023-07-21T22:31:45.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.376+0000 7fb87f7fe640 1 -- 172.21.15.6:0/1077305612 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c0b67a0 con 0x7fb898158090 2023-07-21T22:31:45.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.376+0000 7fb89d00b640 1 -- 172.21.15.6:0/1077305612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb89814b690 con 0x7fb898158090 2023-07-21T22:31:45.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.376+0000 7fb87f7fe640 1 -- 172.21.15.6:0/1077305612 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c0b6b50 con 0x7fb898158090 2023-07-21T22:31:45.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.376+0000 7fb89d00b640 1 -- 172.21.15.6:0/1077305612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89814aa10 con 0x7fb898158090 2023-07-21T22:31:45.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.376+0000 7fb89d00b640 1 -- 172.21.15.6:0/1077305612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8980714b0 con 0x7fb898158090 2023-07-21T22:31:45.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.376+0000 7fb87f7fe640 1 -- 172.21.15.6:0/1077305612 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 85829+0+0 (secure 0 0 0) 0x7fb88c0b2040 con 0x7fb898158090 2023-07-21T22:31:45.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.380+0000 7fb87f7fe640 1 --2- 172.21.15.6:0/1077305612 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fb884066430 0x7fb8840688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:45.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.380+0000 7fb87f7fe640 1 -- 172.21.15.6:0/1077305612 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7717+0+0 (secure 0 0 0) 0x7fb88c11e9d0 con 0x7fb898158090 2023-07-21T22:31:45.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.380+0000 7fb896d9d640 1 -- 172.21.15.6:0/1077305612 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fb884066430 msgr2=0x7fb8840688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2930793066 2023-07-21T22:31:45.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.380+0000 7fb896d9d640 1 --2- 172.21.15.6:0/1077305612 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fb884066430 0x7fb8840688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:31:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.388+0000 7fb87f7fe640 1 -- 172.21.15.6:0/1077305612 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb88c0eb4e0 con 0x7fb898158090 2023-07-21T22:31:45.516 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:45.468+0000 7fb033613180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:31:45.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.540+0000 7fb89d00b640 1 -- 172.21.15.6:0/1077305612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8980678d0 con 0x7fb898158090 2023-07-21T22:31:45.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.540+0000 7fb87f7fe640 1 -- 172.21.15.6:0/1077305612 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb88c0eeb00 con 0x7fb898158090 2023-07-21T22:31:45.591 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:31:45.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.544+0000 7fb89d00b640 1 -- 172.21.15.6:0/1077305612 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fb884066430 msgr2=0x7fb8840688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:31:45.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.544+0000 7fb89d00b640 1 --2- 172.21.15.6:0/1077305612 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fb884066430 0x7fb8840688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.544+0000 7fb89d00b640 1 -- 172.21.15.6:0/1077305612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb898158090 msgr2=0x7fb89814fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:45.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.544+0000 7fb89d00b640 1 --2- 172.21.15.6:0/1077305612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb898158090 0x7fb89814fa50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb88c0ab000 tx=0x7fb88c019150 comp rx=0 tx=0).stop 2023-07-21T22:31:45.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.544+0000 7fb89d00b640 1 -- 172.21.15.6:0/1077305612 shutdown_connections 2023-07-21T22:31:45.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.544+0000 7fb89d00b640 1 --2- 172.21.15.6:0/1077305612 >> [v2:172.21.15.161:6832/2930793066,v1:172.21.15.161:6833/2930793066] conn(0x7fb884066430 0x7fb8840688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.544+0000 7fb89d00b640 1 --2- 172.21.15.6:0/1077305612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb89815b9c0 0x7fb8981465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.544+0000 7fb89d00b640 1 --2- 172.21.15.6:0/1077305612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb898158090 0x7fb89814fa50 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.544+0000 7fb89d00b640 1 --2- 172.21.15.6:0/1077305612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8980cba60 0x7fb898156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.544+0000 7fb89d00b640 1 -- 172.21.15.6:0/1077305612 >> 172.21.15.6:0/1077305612 conn(0x7fb8980cde90 msgr2=0x7fb89814d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:45.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.544+0000 7fb89d00b640 1 -- 172.21.15.6:0/1077305612 shutdown_connections 2023-07-21T22:31:45.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.544+0000 7fb89d00b640 1 -- 172.21.15.6:0/1077305612 wait complete. 2023-07-21T22:31:45.605 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:45.556+0000 7fb033613180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:31:45.612 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:31:45.652 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:45.609+0000 7f249f646180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:31:45.712 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:45.669+0000 7f249f646180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:31:45.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.720+0000 7f3feaa48640 1 Processor -- start 2023-07-21T22:31:45.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.720+0000 7f3feaa48640 1 -- start start 2023-07-21T22:31:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.720+0000 7f3feaa48640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3fe415bde0 0x7f3fe40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.720+0000 7f3feaa48640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3fe40d2300 0x7f3fe40d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.720+0000 7f3feaa48640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe40b04c0 con 0x7f3fe40d2fc0 2023-07-21T22:31:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.720+0000 7f3feaa48640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe415c1b0 con 0x7f3fe40d2300 2023-07-21T22:31:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.720+0000 7f3feaa48640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe40b1060 con 0x7f3fe415bde0 2023-07-21T22:31:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.720+0000 7f3fe37fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3fe40d2fc0 0x7f3fe40b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44362/0 (socket says 172.21.15.6:44362) 2023-07-21T22:31:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.720+0000 7f3fe37fe640 1 -- 172.21.15.6:0/2149856608 learned_addr learned my addr 172.21.15.6:0/2149856608 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.720+0000 7f3fe8fe5640 1 --2- 172.21.15.6:0/2149856608 >> v2:172.21.15.6:3300/0 conn(0x7f3fe40d2300 0x7f3fe40d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.720+0000 7f3fe3fff640 1 --2- 172.21.15.6:0/2149856608 >> v2:172.21.15.161:3300/0 conn(0x7f3fe415bde0 0x7f3fe40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:45.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.720+0000 7f3fe8fe5640 1 -- 172.21.15.6:0/2149856608 >> v2:172.21.15.161:3300/0 conn(0x7f3fe415bde0 msgr2=0x7f3fe40d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:45.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.720+0000 7f3fe8fe5640 1 --2- 172.21.15.6:0/2149856608 >> v2:172.21.15.161:3300/0 conn(0x7f3fe415bde0 0x7f3fe40d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.720+0000 7f3fe8fe5640 1 -- 172.21.15.6:0/2149856608 >> v1:172.21.15.6:6789/0 conn(0x7f3fe40d2fc0 legacy=0x7f3fe40b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:45.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.720+0000 7f3fe8fe5640 1 -- 172.21.15.6:0/2149856608 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe40d2c80 con 0x7f3fe40d2300 2023-07-21T22:31:45.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.724+0000 7f3fe8fe5640 1 --2- 172.21.15.6:0/2149856608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40d2300 0x7f3fe40d2740 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f3fe408b210 tx=0x7f3fdc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d7b8d65ff2f093 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:45.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.724+0000 7f3fe2ffd640 1 -- 172.21.15.6:0/2149856608 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0a58e0 con 0x7f3fe40d2300 2023-07-21T22:31:45.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.724+0000 7f3fe2ffd640 1 -- 172.21.15.6:0/2149856608 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc0a5a40 con 0x7f3fe40d2300 2023-07-21T22:31:45.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.724+0000 7f3fe2ffd640 1 -- 172.21.15.6:0/2149856608 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0a5dd0 con 0x7f3fe40d2300 2023-07-21T22:31:45.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.724+0000 7f3feaa48640 1 -- 172.21.15.6:0/2149856608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40d2300 msgr2=0x7f3fe40d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:45.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.724+0000 7f3feaa48640 1 --2- 172.21.15.6:0/2149856608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40d2300 0x7f3fe40d2740 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f3fe408b210 tx=0x7f3fdc01c910 comp rx=0 tx=0).stop 2023-07-21T22:31:45.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.724+0000 7f3feaa48640 1 -- 172.21.15.6:0/2149856608 shutdown_connections 2023-07-21T22:31:45.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.724+0000 7f3feaa48640 1 --2- 172.21.15.6:0/2149856608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40d2300 0x7f3fe40d2740 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.724+0000 7f3feaa48640 1 --2- 172.21.15.6:0/2149856608 >> v2:172.21.15.161:3300/0 conn(0x7f3fe415bde0 0x7f3fe40d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.724+0000 7f3feaa48640 1 -- 172.21.15.6:0/2149856608 >> 172.21.15.6:0/2149856608 conn(0x7f3fe40659d0 msgr2=0x7f3fe409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:45.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.724+0000 7f3feaa48640 1 -- 172.21.15.6:0/2149856608 shutdown_connections 2023-07-21T22:31:45.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3feaa48640 1 -- 172.21.15.6:0/2149856608 wait complete. 2023-07-21T22:31:45.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3feaa48640 1 Processor -- start 2023-07-21T22:31:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3feaa48640 1 -- start start 2023-07-21T22:31:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3feaa48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fe40d2300 0x7f3fe4152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3feaa48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40d2fc0 0x7f3fe4152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3feaa48640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fe415bde0 0x7f3fe40cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3feaa48640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe415d290 con 0x7f3fe40d2fc0 2023-07-21T22:31:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3feaa48640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe415edc0 con 0x7f3fe415bde0 2023-07-21T22:31:45.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3feaa48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe415f0a0 con 0x7f3fe40d2300 2023-07-21T22:31:45.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3fe37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40d2fc0 0x7f3fe4152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:45.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3fe37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40d2fc0 0x7f3fe4152180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39048/0 (socket says 172.21.15.6:39048) 2023-07-21T22:31:45.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3fe37fe640 1 -- 172.21.15.6:0/1442516304 learned_addr learned my addr 172.21.15.6:0/1442516304 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:45.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3fe3fff640 1 --2- 172.21.15.6:0/1442516304 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fe40d2300 0x7f3fe4152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:45.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3fe8fe5640 1 --2- 172.21.15.6:0/1442516304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fe415bde0 0x7f3fe40cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:45.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3fe37fe640 1 -- 172.21.15.6:0/1442516304 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fe40d2300 msgr2=0x7f3fe4152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:45.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3fe37fe640 1 --2- 172.21.15.6:0/1442516304 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fe40d2300 0x7f3fe4152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3fe37fe640 1 -- 172.21.15.6:0/1442516304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fe415bde0 msgr2=0x7f3fe40cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:45.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3fe37fe640 1 --2- 172.21.15.6:0/1442516304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fe415bde0 0x7f3fe40cbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3fe37fe640 1 -- 172.21.15.6:0/1442516304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc009a70 con 0x7f3fe40d2fc0 2023-07-21T22:31:45.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3fe8fe5640 1 --2- 172.21.15.6:0/1442516304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fe415bde0 0x7f3fe40cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:45.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.728+0000 7f3fe37fe640 1 --2- 172.21.15.6:0/1442516304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40d2fc0 0x7f3fe4152180 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800c430 tx=0x7f3fd800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:45.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.732+0000 7f3fe0ff9640 1 -- 172.21.15.6:0/1442516304 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8005cf0 con 0x7f3fe40d2fc0 2023-07-21T22:31:45.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.732+0000 7f3fe0ff9640 1 -- 172.21.15.6:0/1442516304 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd8005e50 con 0x7f3fe40d2fc0 2023-07-21T22:31:45.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.732+0000 7f3fe0ff9640 1 -- 172.21.15.6:0/1442516304 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd80072f0 con 0x7f3fe40d2fc0 2023-07-21T22:31:45.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.732+0000 7f3feaa48640 1 -- 172.21.15.6:0/1442516304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe415f380 con 0x7f3fe40d2fc0 2023-07-21T22:31:45.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.732+0000 7f3feaa48640 1 -- 172.21.15.6:0/1442516304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe41526c0 con 0x7f3fe40d2fc0 2023-07-21T22:31:45.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.732+0000 7f3feaa48640 1 -- 172.21.15.6:0/1442516304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe415f5c0 con 0x7f3fe40d2fc0 2023-07-21T22:31:45.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.732+0000 7f3fe0ff9640 1 -- 172.21.15.6:0/1442516304 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 14) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f3fd8007510 con 0x7f3fe40d2fc0 2023-07-21T22:31:45.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.736+0000 7f3fe0ff9640 1 -- 172.21.15.6:0/1442516304 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7420+0+0 (secure 0 0 0) 0x7f3fd8083270 con 0x7f3fe40d2fc0 2023-07-21T22:31:45.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.740+0000 7f3fe0ff9640 1 -- 172.21.15.6:0/1442516304 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3fe415f5c0 con 0x7f3fe40d2fc0 2023-07-21T22:31:45.798 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:45.753+0000 7f2426c17640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:31:45.798 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:45.753+0000 7f2426c17640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:31:45.798 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:45.753+0000 7f2426c17640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:31:45.798 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:45.753+0000 7f2426c17640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:31:45.798 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:45.753+0000 7f2426c17640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:31:45.798 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:45.753+0000 7f242ac1f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:31:45.799 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:45.753+0000 7f242ac1f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:31:45.799 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:45.753+0000 7f242ac1f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:31:45.799 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:45.753+0000 7f242ac1f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:31:45.799 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:31:45.753+0000 7f242ac1f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:31:45.914 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:45.868+0000 7fb033613180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:31:45.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.904+0000 7f3feaa48640 1 -- 172.21.15.6:0/1442516304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3fe415f570 con 0x7f3fe40d2fc0 2023-07-21T22:31:45.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.904+0000 7f3fe0ff9640 1 -- 172.21.15.6:0/1442516304 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v53) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3fd80506a0 con 0x7f3fe40d2fc0 2023-07-21T22:31:45.953 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:31:45.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.908+0000 7f3feaa48640 1 -- 172.21.15.6:0/1442516304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40d2fc0 msgr2=0x7f3fe4152180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:45.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.908+0000 7f3feaa48640 1 --2- 172.21.15.6:0/1442516304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40d2fc0 0x7f3fe4152180 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800c430 tx=0x7f3fd800c8f0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.908+0000 7f3feaa48640 1 -- 172.21.15.6:0/1442516304 shutdown_connections 2023-07-21T22:31:45.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.908+0000 7f3feaa48640 1 --2- 172.21.15.6:0/1442516304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fe415bde0 0x7f3fe40cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.908+0000 7f3feaa48640 1 --2- 172.21.15.6:0/1442516304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40d2fc0 0x7f3fe4152180 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.908+0000 7f3feaa48640 1 --2- 172.21.15.6:0/1442516304 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fe40d2300 0x7f3fe4152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:45.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.908+0000 7f3feaa48640 1 -- 172.21.15.6:0/1442516304 >> 172.21.15.6:0/1442516304 conn(0x7f3fe40659d0 msgr2=0x7f3fe40ce140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:45.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.908+0000 7f3feaa48640 1 -- 172.21.15.6:0/1442516304 shutdown_connections 2023-07-21T22:31:45.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:45.908+0000 7f3feaa48640 1 -- 172.21.15.6:0/1442516304 wait complete. 2023-07-21T22:31:45.975 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:31:45.979 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:31:45.932+0000 7fb033613180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:31:46.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.076+0000 7f6f03e93640 1 Processor -- start 2023-07-21T22:31:46.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.076+0000 7f6f03e93640 1 -- start start 2023-07-21T22:31:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.076+0000 7f6f03e93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6efc069430 0x7f6efc069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.076+0000 7f6f03e93640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6efc0af2b0 0x7f6efc15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.076+0000 7f6f03e93640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6efc159d70 con 0x7f6efc070f30 2023-07-21T22:31:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.076+0000 7f6f03e93640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6efc069d40 con 0x7f6efc0af2b0 2023-07-21T22:31:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.076+0000 7f6f03e93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc0c9c60 con 0x7f6efc069430 2023-07-21T22:31:46.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.076+0000 7f6f02430640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6efc0af2b0 0x7f6efc15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:46.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.076+0000 7f6f02430640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6efc0af2b0 0x7f6efc15a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39060/0 (socket says 172.21.15.6:39060) 2023-07-21T22:31:46.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.076+0000 7f6f02430640 1 -- 172.21.15.6:0/1337108777 learned_addr learned my addr 172.21.15.6:0/1337108777 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.076+0000 7f6f01c2f640 1 --2- 172.21.15.6:0/1337108777 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6efc069430 0x7f6efc069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.076+0000 7f6f02430640 1 -- 172.21.15.6:0/1337108777 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6efc069430 msgr2=0x7f6efc069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.076+0000 7f6f02430640 1 --2- 172.21.15.6:0/1337108777 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6efc069430 0x7f6efc069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.076+0000 7f6f02430640 1 -- 172.21.15.6:0/1337108777 >> v1:172.21.15.161:6789/0 conn(0x7f6efc070f30 legacy=0x7f6efc0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.076+0000 7f6f02430640 1 -- 172.21.15.6:0/1337108777 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6efc0c9f40 con 0x7f6efc0af2b0 2023-07-21T22:31:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.080+0000 7f6f02430640 1 --2- 172.21.15.6:0/1337108777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0af2b0 0x7f6efc15a1f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009e50 tx=0x7f6ef401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1141af9b9d2e11 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:46.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.080+0000 7f6f00c2d640 1 -- 172.21.15.6:0/1337108777 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef40a5850 con 0x7f6efc0af2b0 2023-07-21T22:31:46.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.080+0000 7f6f00c2d640 1 -- 172.21.15.6:0/1337108777 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef40a59b0 con 0x7f6efc0af2b0 2023-07-21T22:31:46.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.080+0000 7f6f00c2d640 1 -- 172.21.15.6:0/1337108777 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef40a5d40 con 0x7f6efc0af2b0 2023-07-21T22:31:46.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.080+0000 7f6f03e93640 1 -- 172.21.15.6:0/1337108777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0af2b0 msgr2=0x7f6efc15a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:46.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.080+0000 7f6f03e93640 1 --2- 172.21.15.6:0/1337108777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0af2b0 0x7f6efc15a1f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4009e50 tx=0x7f6ef401c9d0 comp rx=0 tx=0).stop 2023-07-21T22:31:46.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.080+0000 7f6f03e93640 1 -- 172.21.15.6:0/1337108777 shutdown_connections 2023-07-21T22:31:46.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.080+0000 7f6f03e93640 1 --2- 172.21.15.6:0/1337108777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0af2b0 0x7f6efc15a1f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.080+0000 7f6f03e93640 1 --2- 172.21.15.6:0/1337108777 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6efc069430 0x7f6efc069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.080+0000 7f6f03e93640 1 -- 172.21.15.6:0/1337108777 >> 172.21.15.6:0/1337108777 conn(0x7f6efc0cde90 msgr2=0x7f6efc0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.080+0000 7f6f03e93640 1 -- 172.21.15.6:0/1337108777 shutdown_connections 2023-07-21T22:31:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.080+0000 7f6f03e93640 1 -- 172.21.15.6:0/1337108777 wait complete. 2023-07-21T22:31:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f03e93640 1 Processor -- start 2023-07-21T22:31:46.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f03e93640 1 -- start start 2023-07-21T22:31:46.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f03e93640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6efc069430 0x7f6efc151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:46.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f03e93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6efc070f30 0x7f6efc06f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:46.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f03e93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0af2b0 0x7f6efc06f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:46.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f03e93640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc154510 con 0x7f6efc0af2b0 2023-07-21T22:31:46.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f03e93640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc1549a0 con 0x7f6efc069430 2023-07-21T22:31:46.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f03e93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc153900 con 0x7f6efc070f30 2023-07-21T22:31:46.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f02430640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0af2b0 0x7f6efc06f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:46.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f02430640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0af2b0 0x7f6efc06f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39064/0 (socket says 172.21.15.6:39064) 2023-07-21T22:31:46.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f02430640 1 -- 172.21.15.6:0/3075245219 learned_addr learned my addr 172.21.15.6:0/3075245219 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:46.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f0142e640 1 --2- 172.21.15.6:0/3075245219 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6efc070f30 0x7f6efc06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:46.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f01c2f640 1 --2- 172.21.15.6:0/3075245219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6efc069430 0x7f6efc151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:46.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f02430640 1 -- 172.21.15.6:0/3075245219 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6efc070f30 msgr2=0x7f6efc06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:46.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f02430640 1 --2- 172.21.15.6:0/3075245219 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6efc070f30 0x7f6efc06f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:46.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f02430640 1 -- 172.21.15.6:0/3075245219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6efc069430 msgr2=0x7f6efc151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:46.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f02430640 1 --2- 172.21.15.6:0/3075245219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6efc069430 0x7f6efc151890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:46.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f02430640 1 -- 172.21.15.6:0/3075245219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef4009b30 con 0x7f6efc0af2b0 2023-07-21T22:31:46.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f02430640 1 --2- 172.21.15.6:0/3075245219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0af2b0 0x7f6efc06f5a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6ef401b080 tx=0x7f6ef4019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:46.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6ef27fc640 1 -- 172.21.15.6:0/3075245219 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef40b8640 con 0x7f6efc0af2b0 2023-07-21T22:31:46.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6ef27fc640 1 -- 172.21.15.6:0/3075245219 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef40b87e0 con 0x7f6efc0af2b0 2023-07-21T22:31:46.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6ef27fc640 1 -- 172.21.15.6:0/3075245219 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef40b8b90 con 0x7f6efc0af2b0 2023-07-21T22:31:46.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f03e93640 1 -- 172.21.15.6:0/3075245219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6efc153be0 con 0x7f6efc0af2b0 2023-07-21T22:31:46.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.084+0000 7f6f03e93640 1 -- 172.21.15.6:0/3075245219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6efc1541a0 con 0x7f6efc0af2b0 2023-07-21T22:31:46.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.088+0000 7f6f03e93640 1 -- 172.21.15.6:0/3075245219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6efc154680 con 0x7f6efc0af2b0 2023-07-21T22:31:46.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.088+0000 7f6ef27fc640 1 -- 172.21.15.6:0/3075245219 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 14) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f6ef40b8cf0 con 0x7f6efc0af2b0 2023-07-21T22:31:46.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.088+0000 7f6ef27fc640 1 -- 172.21.15.6:0/3075245219 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7420+0+0 (secure 0 0 0) 0x7f6ef411f250 con 0x7f6efc0af2b0 2023-07-21T22:31:46.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.092+0000 7f6ef27fc640 1 -- 172.21.15.6:0/3075245219 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ef40ec590 con 0x7f6efc0af2b0 2023-07-21T22:31:46.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.244+0000 7f6f03e93640 1 -- 172.21.15.6:0/3075245219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6efc159d70 con 0x7f6efc0af2b0 2023-07-21T22:31:46.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.244+0000 7f6ef27fc640 1 -- 172.21.15.6:0/3075245219 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6efc159d70 con 0x7f6efc0af2b0 2023-07-21T22:31:46.294 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:31:46.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.248+0000 7f6f03e93640 1 -- 172.21.15.6:0/3075245219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0af2b0 msgr2=0x7f6efc06f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:46.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.248+0000 7f6f03e93640 1 --2- 172.21.15.6:0/3075245219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0af2b0 0x7f6efc06f5a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6ef401b080 tx=0x7f6ef4019770 comp rx=0 tx=0).stop 2023-07-21T22:31:46.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.248+0000 7f6f03e93640 1 -- 172.21.15.6:0/3075245219 shutdown_connections 2023-07-21T22:31:46.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.248+0000 7f6f03e93640 1 --2- 172.21.15.6:0/3075245219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6efc0af2b0 0x7f6efc06f5a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:46.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.248+0000 7f6f03e93640 1 --2- 172.21.15.6:0/3075245219 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6efc070f30 0x7f6efc06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:46.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.248+0000 7f6f03e93640 1 --2- 172.21.15.6:0/3075245219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6efc069430 0x7f6efc151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:46.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.248+0000 7f6f03e93640 1 -- 172.21.15.6:0/3075245219 >> 172.21.15.6:0/3075245219 conn(0x7f6efc0cde90 msgr2=0x7f6efc06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:46.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.248+0000 7f6f03e93640 1 -- 172.21.15.6:0/3075245219 shutdown_connections 2023-07-21T22:31:46.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.248+0000 7f6f03e93640 1 -- 172.21.15.6:0/3075245219 wait complete. 2023-07-21T22:31:46.315 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:31:46.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.460+0000 7f44c1bad640 1 Processor -- start 2023-07-21T22:31:46.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.460+0000 7f44c1bad640 1 -- start start 2023-07-21T22:31:46.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.460+0000 7f44c1bad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44bc0d2300 0x7f44bc0d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:46.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.460+0000 7f44c1bad640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44bc0b04c0 con 0x7f44bc15bde0 2023-07-21T22:31:46.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.460+0000 7f44c1bad640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44bc0b1060 con 0x7f44bc0d2fc0 2023-07-21T22:31:46.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.460+0000 7f44c1bad640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc15c1b0 con 0x7f44bc0d2300 2023-07-21T22:31:46.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.460+0000 7f44bb7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f44bc15bde0 0x7f44bc0d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44374/0 (socket says 172.21.15.6:44374) 2023-07-21T22:31:46.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.460+0000 7f44bb7fe640 1 -- 172.21.15.6:0/3836314616 learned_addr learned my addr 172.21.15.6:0/3836314616 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:46.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.460+0000 7f44bbfff640 1 --2- 172.21.15.6:0/3836314616 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44bc0d2300 0x7f44bc0d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:46.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.464+0000 7f44ba7fc640 1 -- 172.21.15.6:0/3836314616 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703953707 0 0) 0x7f44bc0b04c0 con 0x7f44bc15bde0 2023-07-21T22:31:46.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.464+0000 7f44ba7fc640 1 -- 172.21.15.6:0/3836314616 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44a4003530 con 0x7f44bc15bde0 2023-07-21T22:31:46.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.464+0000 7f44ba7fc640 1 -- 172.21.15.6:0/3836314616 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432860882 0 0) 0x7f44bc0b1060 con 0x7f44bc0d2fc0 2023-07-21T22:31:46.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.464+0000 7f44ba7fc640 1 -- 172.21.15.6:0/3836314616 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44bc0b04c0 con 0x7f44bc0d2fc0 2023-07-21T22:31:46.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.464+0000 7f44bbfff640 1 -- 172.21.15.6:0/3836314616 >> v1:172.21.15.161:6789/0 conn(0x7f44bc0d2fc0 legacy=0x7f44bc0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:46.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.464+0000 7f44bbfff640 1 -- 172.21.15.6:0/3836314616 >> v1:172.21.15.6:6789/0 conn(0x7f44bc15bde0 legacy=0x7f44bc0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:46.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.464+0000 7f44bbfff640 1 -- 172.21.15.6:0/3836314616 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc0d0aa0 con 0x7f44bc0d2300 2023-07-21T22:31:46.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.464+0000 7f44bbfff640 1 --2- 172.21.15.6:0/3836314616 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44bc0d2300 0x7f44bc0d2780 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009dc0 tx=0x7f44b401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ededd431fa58b2a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:46.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.464+0000 7f44ba7fc640 1 -- 172.21.15.6:0/3836314616 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40a5940 con 0x7f44bc0d2300 2023-07-21T22:31:46.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.464+0000 7f44ba7fc640 1 -- 172.21.15.6:0/3836314616 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b40a5aa0 con 0x7f44bc0d2300 2023-07-21T22:31:46.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.464+0000 7f44ba7fc640 1 -- 172.21.15.6:0/3836314616 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40a5e30 con 0x7f44bc0d2300 2023-07-21T22:31:46.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44c1bad640 1 -- 172.21.15.6:0/3836314616 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44bc0d2300 msgr2=0x7f44bc0d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:46.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44c1bad640 1 --2- 172.21.15.6:0/3836314616 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44bc0d2300 0x7f44bc0d2780 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009dc0 tx=0x7f44b401c970 comp rx=0 tx=0).stop 2023-07-21T22:31:46.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44c1bad640 1 -- 172.21.15.6:0/3836314616 shutdown_connections 2023-07-21T22:31:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44c1bad640 1 --2- 172.21.15.6:0/3836314616 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44bc0d2300 0x7f44bc0d2780 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44c1bad640 1 -- 172.21.15.6:0/3836314616 >> 172.21.15.6:0/3836314616 conn(0x7f44bc0659d0 msgr2=0x7f44bc09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44c1bad640 1 -- 172.21.15.6:0/3836314616 shutdown_connections 2023-07-21T22:31:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44c1bad640 1 -- 172.21.15.6:0/3836314616 wait complete. 2023-07-21T22:31:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44c1bad640 1 Processor -- start 2023-07-21T22:31:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44c1bad640 1 -- start start 2023-07-21T22:31:46.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44c1bad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44bc0d2300 0x7f44bc15cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:46.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44c1bad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44bc0d2fc0 0x7f44bc14bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:46.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44c1bad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44bc15bde0 0x7f44bc15eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:46.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44c1bad640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc15d310 con 0x7f44bc0d2300 2023-07-21T22:31:46.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44c1bad640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0ca380 con 0x7f44bc0d2fc0 2023-07-21T22:31:46.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44c1bad640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc0ca660 con 0x7f44bc15bde0 2023-07-21T22:31:46.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44bc0d2300 0x7f44bc15cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:46.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44bc0d2300 0x7f44bc15cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39074/0 (socket says 172.21.15.6:39074) 2023-07-21T22:31:46.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44bb7fe640 1 -- 172.21.15.6:0/2222709701 learned_addr learned my addr 172.21.15.6:0/2222709701 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:46.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44bbfff640 1 --2- 172.21.15.6:0/2222709701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44bc15bde0 0x7f44bc15eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:46.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44baffd640 1 --2- 172.21.15.6:0/2222709701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44bc0d2fc0 0x7f44bc14bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:46.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44bb7fe640 1 -- 172.21.15.6:0/2222709701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44bc15bde0 msgr2=0x7f44bc15eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:46.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44bb7fe640 1 --2- 172.21.15.6:0/2222709701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44bc15bde0 0x7f44bc15eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:46.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44bb7fe640 1 -- 172.21.15.6:0/2222709701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44bc0d2fc0 msgr2=0x7f44bc14bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:46.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44bb7fe640 1 --2- 172.21.15.6:0/2222709701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44bc0d2fc0 0x7f44bc14bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:46.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44bb7fe640 1 -- 172.21.15.6:0/2222709701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b4009a70 con 0x7f44bc0d2300 2023-07-21T22:31:46.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.468+0000 7f44bbfff640 1 --2- 172.21.15.6:0/2222709701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44bc15bde0 0x7f44bc15eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:46.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.472+0000 7f44bb7fe640 1 --2- 172.21.15.6:0/2222709701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44bc0d2300 0x7f44bc15cd30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00c680 tx=0x7f44ac00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:46.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.472+0000 7f44a3fff640 1 -- 172.21.15.6:0/2222709701 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac007270 con 0x7f44bc0d2300 2023-07-21T22:31:46.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.472+0000 7f44a3fff640 1 -- 172.21.15.6:0/2222709701 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac0073d0 con 0x7f44bc0d2300 2023-07-21T22:31:46.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.472+0000 7f44a3fff640 1 -- 172.21.15.6:0/2222709701 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac00ce80 con 0x7f44bc0d2300 2023-07-21T22:31:46.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.472+0000 7f44c1bad640 1 -- 172.21.15.6:0/2222709701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44bc0ca940 con 0x7f44bc0d2300 2023-07-21T22:31:46.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.472+0000 7f44c1bad640 1 -- 172.21.15.6:0/2222709701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44bc15f070 con 0x7f44bc0d2300 2023-07-21T22:31:46.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.472+0000 7f44c1bad640 1 -- 172.21.15.6:0/2222709701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44bc0678d0 con 0x7f44bc0d2300 2023-07-21T22:31:46.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.472+0000 7f44a3fff640 1 -- 172.21.15.6:0/2222709701 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 14) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f44ac0057b0 con 0x7f44bc0d2300 2023-07-21T22:31:46.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.472+0000 7f44a3fff640 1 -- 172.21.15.6:0/2222709701 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7420+0+0 (secure 0 0 0) 0x7f44ac083200 con 0x7f44bc0d2300 2023-07-21T22:31:46.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.476+0000 7f44a3fff640 1 -- 172.21.15.6:0/2222709701 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44ac0505b0 con 0x7f44bc0d2300 2023-07-21T22:31:46.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.632+0000 7f44c1bad640 1 -- 172.21.15.6:0/2222709701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f44bc08ad20 con 0x7f44bc0d2300 2023-07-21T22:31:46.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.632+0000 7f44a3fff640 1 -- 172.21.15.6:0/2222709701 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44ac017020 con 0x7f44bc0d2300 2023-07-21T22:31:46.680 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:31:46.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.632+0000 7f44c1bad640 1 -- 172.21.15.6:0/2222709701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44bc0d2300 msgr2=0x7f44bc15cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:46.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.632+0000 7f44c1bad640 1 --2- 172.21.15.6:0/2222709701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44bc0d2300 0x7f44bc15cd30 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f44ac00c680 tx=0x7f44ac00cb40 comp rx=0 tx=0).stop 2023-07-21T22:31:46.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.632+0000 7f44c1bad640 1 -- 172.21.15.6:0/2222709701 shutdown_connections 2023-07-21T22:31:46.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.632+0000 7f44c1bad640 1 --2- 172.21.15.6:0/2222709701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44bc15bde0 0x7f44bc15eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:46.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.632+0000 7f44c1bad640 1 --2- 172.21.15.6:0/2222709701 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44bc0d2fc0 0x7f44bc14bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:46.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.632+0000 7f44c1bad640 1 --2- 172.21.15.6:0/2222709701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44bc0d2300 0x7f44bc15cd30 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:46.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.632+0000 7f44c1bad640 1 -- 172.21.15.6:0/2222709701 >> 172.21.15.6:0/2222709701 conn(0x7f44bc0659d0 msgr2=0x7f44bc0af190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:46.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.632+0000 7f44c1bad640 1 -- 172.21.15.6:0/2222709701 shutdown_connections 2023-07-21T22:31:46.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.632+0000 7f44c1bad640 1 -- 172.21.15.6:0/2222709701 wait complete. 2023-07-21T22:31:46.701 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:31:46.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.808+0000 7f767f493640 1 Processor -- start 2023-07-21T22:31:46.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.808+0000 7f767f493640 1 -- start start 2023-07-21T22:31:46.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.812+0000 7f767f493640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f767815fd60 0x7f76780d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:46.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.812+0000 7f767f493640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76780d1850 0x7f76780d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:46.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.812+0000 7f767f493640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76780ccaf0 con 0x7f76780b7c70 2023-07-21T22:31:46.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.812+0000 7f767f493640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76780d1190 con 0x7f767815fd60 2023-07-21T22:31:46.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.812+0000 7f767f493640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7678160600 con 0x7f76780d1850 2023-07-21T22:31:46.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.812+0000 7f767ca2e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f767815fd60 0x7f76780d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:46.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.812+0000 7f767ca2e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f767815fd60 0x7f76780d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39086/0 (socket says 172.21.15.6:39086) 2023-07-21T22:31:46.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.812+0000 7f767ca2e640 1 -- 172.21.15.6:0/3328053639 learned_addr learned my addr 172.21.15.6:0/3328053639 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:46.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.812+0000 7f767da30640 1 --2- 172.21.15.6:0/3328053639 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76780d1850 0x7f76780d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.812+0000 7f767ca2e640 1 -- 172.21.15.6:0/3328053639 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76780d1850 msgr2=0x7f76780d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.812+0000 7f767ca2e640 1 --2- 172.21.15.6:0/3328053639 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76780d1850 0x7f76780d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.812+0000 7f767ca2e640 1 -- 172.21.15.6:0/3328053639 >> v1:172.21.15.161:6789/0 conn(0x7f76780b7c70 legacy=0x7f767815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.812+0000 7f767ca2e640 1 -- 172.21.15.6:0/3328053639 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7678160320 con 0x7f767815fd60 2023-07-21T22:31:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.812+0000 7f767da30640 1 --2- 172.21.15.6:0/3328053639 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76780d1850 0x7f76780d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.812+0000 7f767ca2e640 1 --2- 172.21.15.6:0/3328053639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f767815fd60 0x7f76780d0c50 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7668009870 tx=0x7f766801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ef0a9ebf8b87cf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.812+0000 7f766ffff640 1 -- 172.21.15.6:0/3328053639 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76680a95f0 con 0x7f767815fd60 2023-07-21T22:31:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.812+0000 7f766ffff640 1 -- 172.21.15.6:0/3328053639 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76680a9750 con 0x7f767815fd60 2023-07-21T22:31:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.812+0000 7f766ffff640 1 -- 172.21.15.6:0/3328053639 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76680a9ae0 con 0x7f767815fd60 2023-07-21T22:31:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767f493640 1 -- 172.21.15.6:0/3328053639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f767815fd60 msgr2=0x7f76780d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767f493640 1 --2- 172.21.15.6:0/3328053639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f767815fd60 0x7f76780d0c50 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7668009870 tx=0x7f766801c510 comp rx=0 tx=0).stop 2023-07-21T22:31:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767f493640 1 -- 172.21.15.6:0/3328053639 shutdown_connections 2023-07-21T22:31:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767f493640 1 --2- 172.21.15.6:0/3328053639 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76780d1850 0x7f76780d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:46.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767f493640 1 --2- 172.21.15.6:0/3328053639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f767815fd60 0x7f76780d0c50 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:46.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767f493640 1 -- 172.21.15.6:0/3328053639 >> 172.21.15.6:0/3328053639 conn(0x7f76780650b0 msgr2=0x7f76780654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:46.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767f493640 1 -- 172.21.15.6:0/3328053639 shutdown_connections 2023-07-21T22:31:46.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767f493640 1 -- 172.21.15.6:0/3328053639 wait complete. 2023-07-21T22:31:46.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767f493640 1 Processor -- start 2023-07-21T22:31:46.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767f493640 1 -- start start 2023-07-21T22:31:46.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767f493640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76780b7c70 0x7f767814ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:46.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767f493640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76780d1850 0x7f7678159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:46.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767f493640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f767815fd60 0x7f767815a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:46.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767f493640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76780b2ae0 con 0x7f76780b7c70 2023-07-21T22:31:46.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767f493640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76780b2dc0 con 0x7f76780d1850 2023-07-21T22:31:46.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767f493640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76780b30a0 con 0x7f767815fd60 2023-07-21T22:31:46.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767d22f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76780b7c70 0x7f767814ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:46.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767d22f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76780b7c70 0x7f767814ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39096/0 (socket says 172.21.15.6:39096) 2023-07-21T22:31:46.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767d22f640 1 -- 172.21.15.6:0/1910638850 learned_addr learned my addr 172.21.15.6:0/1910638850 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:46.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767ca2e640 1 --2- 172.21.15.6:0/1910638850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76780d1850 0x7f7678159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:46.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.816+0000 7f767da30640 1 --2- 172.21.15.6:0/1910638850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f767815fd60 0x7f767815a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:46.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.820+0000 7f767d22f640 1 -- 172.21.15.6:0/1910638850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f767815fd60 msgr2=0x7f767815a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:46.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.820+0000 7f767d22f640 1 --2- 172.21.15.6:0/1910638850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f767815fd60 0x7f767815a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:46.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.820+0000 7f767d22f640 1 -- 172.21.15.6:0/1910638850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76780d1850 msgr2=0x7f7678159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:46.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.820+0000 7f767d22f640 1 --2- 172.21.15.6:0/1910638850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76780d1850 0x7f7678159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:46.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.820+0000 7f767d22f640 1 -- 172.21.15.6:0/1910638850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76680094d0 con 0x7f76780b7c70 2023-07-21T22:31:46.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.820+0000 7f767d22f640 1 --2- 172.21.15.6:0/1910638850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76780b7c70 0x7f767814ea70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f767400c3c0 tx=0x7f767400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:46.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.820+0000 7f766dffb640 1 -- 172.21.15.6:0/1910638850 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76740052d0 con 0x7f76780b7c70 2023-07-21T22:31:46.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.820+0000 7f766dffb640 1 -- 172.21.15.6:0/1910638850 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7674005430 con 0x7f76780b7c70 2023-07-21T22:31:46.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.820+0000 7f766dffb640 1 -- 172.21.15.6:0/1910638850 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674003840 con 0x7f76780b7c70 2023-07-21T22:31:46.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.820+0000 7f767f493640 1 -- 172.21.15.6:0/1910638850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76780b3380 con 0x7f76780b7c70 2023-07-21T22:31:46.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.820+0000 7f767f493640 1 -- 172.21.15.6:0/1910638850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76780b2770 con 0x7f76780b7c70 2023-07-21T22:31:46.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.820+0000 7f767f493640 1 -- 172.21.15.6:0/1910638850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76780678d0 con 0x7f76780b7c70 2023-07-21T22:31:46.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.820+0000 7f766dffb640 1 -- 172.21.15.6:0/1910638850 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 15) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f76740039a0 con 0x7f76780b7c70 2023-07-21T22:31:46.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.820+0000 7f766dffb640 1 --2- 172.21.15.6:0/1910638850 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f765c0660d0 0x7f765c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:46.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.820+0000 7f766dffb640 1 -- 172.21.15.6:0/1910638850 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 7480+0+0 (secure 0 0 0) 0x7f7674083430 con 0x7f76780b7c70 2023-07-21T22:31:46.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.820+0000 7f767ca2e640 1 --2- 172.21.15.6:0/1910638850 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f765c0660d0 0x7f765c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:46.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.824+0000 7f767ca2e640 1 --2- 172.21.15.6:0/1910638850 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f765c0660d0 0x7f765c068580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f76680ae000 tx=0x7f76680b4040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:46.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:46.824+0000 7f766dffb640 1 -- 172.21.15.6:0/1910638850 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7674050640 con 0x7f76780b7c70 2023-07-21T22:31:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.020+0000 7f767f493640 1 -- 172.21.15.6:0/1910638850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f767815fac0 con 0x7f76780b7c70 2023-07-21T22:31:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.020+0000 7f766dffb640 1 -- 172.21.15.6:0/1910638850 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4662 (secure 0 0 0) 0x7f7674053c60 con 0x7f76780b7c70 2023-07-21T22:31:47.070 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:47.070 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4928,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3033056690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3033056690},{"type":"v1","addr":"172.21.15.161:6836","nonce":3033056690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/77801161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":77801161},{"type":"v1","addr":"172.21.15.6:6835","nonce":77801161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5152,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/558287949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":558287949},{"type":"v1","addr":"172.21.15.161:6837","nonce":558287949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:19:45.163404+0000","modified":"2023-07-21T22:19:48.796910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5181":{"gid":5181,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/2921512075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2921512075},{"type":"v1","addr":"172.21.15.6:6834","nonce":2921512075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-21T22:31:47.070 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-07-21T22:31:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.024+0000 7f767f493640 1 -- 172.21.15.6:0/1910638850 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f765c0660d0 msgr2=0x7f765c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.024+0000 7f767f493640 1 --2- 172.21.15.6:0/1910638850 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f765c0660d0 0x7f765c068580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f76680ae000 tx=0x7f76680b4040 comp rx=0 tx=0).stop 2023-07-21T22:31:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.024+0000 7f767f493640 1 -- 172.21.15.6:0/1910638850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76780b7c70 msgr2=0x7f767814ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.024+0000 7f767f493640 1 --2- 172.21.15.6:0/1910638850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76780b7c70 0x7f767814ea70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f767400c3c0 tx=0x7f767400c880 comp rx=0 tx=0).stop 2023-07-21T22:31:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.024+0000 7f767f493640 1 -- 172.21.15.6:0/1910638850 shutdown_connections 2023-07-21T22:31:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.024+0000 7f767f493640 1 --2- 172.21.15.6:0/1910638850 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f765c0660d0 0x7f765c068580 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.024+0000 7f767f493640 1 --2- 172.21.15.6:0/1910638850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f767815fd60 0x7f767815a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.024+0000 7f767f493640 1 --2- 172.21.15.6:0/1910638850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76780d1850 0x7f7678159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.024+0000 7f767f493640 1 --2- 172.21.15.6:0/1910638850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76780b7c70 0x7f767814ea70 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.024+0000 7f767f493640 1 -- 172.21.15.6:0/1910638850 >> 172.21.15.6:0/1910638850 conn(0x7f76780650b0 msgr2=0x7f7678065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.024+0000 7f767f493640 1 -- 172.21.15.6:0/1910638850 shutdown_connections 2023-07-21T22:31:47.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.024+0000 7f767f493640 1 -- 172.21.15.6:0/1910638850 wait complete. 2023-07-21T22:31:47.094 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:31:47.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.188+0000 7ffab7d9d640 1 Processor -- start 2023-07-21T22:31:47.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.192+0000 7ffab7d9d640 1 -- start start 2023-07-21T22:31:47.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.192+0000 7ffab7d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffab0158ce0 0x7ffab0070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:47.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.192+0000 7ffab7d9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ffab00c9730 0x7ffab00ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:47.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.192+0000 7ffab7d9d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab00cc700 con 0x7ffab00c8ad0 2023-07-21T22:31:47.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.192+0000 7ffab7d9d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab00b0ff0 con 0x7ffab0158ce0 2023-07-21T22:31:47.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.192+0000 7ffab7d9d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab0070c80 con 0x7ffab00c9730 2023-07-21T22:31:47.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.192+0000 7ffab5b39640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffab0158ce0 0x7ffab0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:47.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.192+0000 7ffab5338640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ffab00c8ad0 0x7ffab00c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:44382/0 (socket says 172.21.15.6:44382) 2023-07-21T22:31:47.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.192+0000 7ffab5b39640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffab0158ce0 0x7ffab0070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39102/0 (socket says 172.21.15.6:39102) 2023-07-21T22:31:47.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.192+0000 7ffab5338640 1 -- 172.21.15.6:0/2186841238 learned_addr learned my addr 172.21.15.6:0/2186841238 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:47.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.192+0000 7ffab633a640 1 --2- 172.21.15.6:0/2186841238 >> v2:172.21.15.161:3300/0 conn(0x7ffab00c9730 0x7ffab00ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:47.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.192+0000 7ffab4b37640 1 -- 172.21.15.6:0/2186841238 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106463021 0 0) 0x7ffab00cc700 con 0x7ffab00c8ad0 2023-07-21T22:31:47.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.192+0000 7ffab4b37640 1 -- 172.21.15.6:0/2186841238 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa9c005740 con 0x7ffab00c8ad0 2023-07-21T22:31:47.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.192+0000 7ffab5b39640 1 -- 172.21.15.6:0/2186841238 >> v2:172.21.15.161:3300/0 conn(0x7ffab00c9730 msgr2=0x7ffab00ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:47.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.192+0000 7ffab5b39640 1 --2- 172.21.15.6:0/2186841238 >> v2:172.21.15.161:3300/0 conn(0x7ffab00c9730 0x7ffab00ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.192+0000 7ffab5b39640 1 -- 172.21.15.6:0/2186841238 >> v1:172.21.15.6:6789/0 conn(0x7ffab00c8ad0 legacy=0x7ffab00c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:47.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.192+0000 7ffab5b39640 1 -- 172.21.15.6:0/2186841238 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab00cbdd0 con 0x7ffab0158ce0 2023-07-21T22:31:47.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.196+0000 7ffab5b39640 1 --2- 172.21.15.6:0/2186841238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffab0158ce0 0x7ffab0070450 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ffab00b0d70 tx=0x7ffaac01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e72ae6bdc75971 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:47.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.196+0000 7ffab4b37640 1 -- 172.21.15.6:0/2186841238 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac0ab600 con 0x7ffab0158ce0 2023-07-21T22:31:47.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.196+0000 7ffab4b37640 1 -- 172.21.15.6:0/2186841238 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac0a7050 con 0x7ffab0158ce0 2023-07-21T22:31:47.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.196+0000 7ffab4b37640 1 -- 172.21.15.6:0/2186841238 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac0ab960 con 0x7ffab0158ce0 2023-07-21T22:31:47.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.196+0000 7ffab7d9d640 1 -- 172.21.15.6:0/2186841238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffab0158ce0 msgr2=0x7ffab0070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:47.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.196+0000 7ffab7d9d640 1 --2- 172.21.15.6:0/2186841238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffab0158ce0 0x7ffab0070450 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ffab00b0d70 tx=0x7ffaac01c310 comp rx=0 tx=0).stop 2023-07-21T22:31:47.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.196+0000 7ffab7d9d640 1 -- 172.21.15.6:0/2186841238 shutdown_connections 2023-07-21T22:31:47.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.196+0000 7ffab7d9d640 1 --2- 172.21.15.6:0/2186841238 >> v2:172.21.15.161:3300/0 conn(0x7ffab00c9730 0x7ffab00ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.196+0000 7ffab7d9d640 1 --2- 172.21.15.6:0/2186841238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffab0158ce0 0x7ffab0070450 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.196+0000 7ffab7d9d640 1 -- 172.21.15.6:0/2186841238 >> 172.21.15.6:0/2186841238 conn(0x7ffab00afcf0 msgr2=0x7ffab00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.196+0000 7ffab7d9d640 1 -- 172.21.15.6:0/2186841238 shutdown_connections 2023-07-21T22:31:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.196+0000 7ffab7d9d640 1 -- 172.21.15.6:0/2186841238 wait complete. 2023-07-21T22:31:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.196+0000 7ffab7d9d640 1 Processor -- start 2023-07-21T22:31:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.196+0000 7ffab7d9d640 1 -- start start 2023-07-21T22:31:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab7d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffab00c8ad0 0x7ffab01631e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab7d9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffab00c9730 0x7ffab014c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab7d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffab0158ce0 0x7ffab0147450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab7d9d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab01f87a0 con 0x7ffab00c8ad0 2023-07-21T22:31:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab7d9d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab0162440 con 0x7ffab0158ce0 2023-07-21T22:31:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab7d9d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab0162720 con 0x7ffab00c9730 2023-07-21T22:31:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab5b39640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffab00c8ad0 0x7ffab01631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab5b39640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffab00c8ad0 0x7ffab01631e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39104/0 (socket says 172.21.15.6:39104) 2023-07-21T22:31:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab5b39640 1 -- 172.21.15.6:0/2789360920 learned_addr learned my addr 172.21.15.6:0/2789360920 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab633a640 1 --2- 172.21.15.6:0/2789360920 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffab0158ce0 0x7ffab0147450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab5b39640 1 -- 172.21.15.6:0/2789360920 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffab00c9730 msgr2=0x7ffab014c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab5338640 1 --2- 172.21.15.6:0/2789360920 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffab00c9730 0x7ffab014c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab5b39640 1 --2- 172.21.15.6:0/2789360920 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffab00c9730 0x7ffab014c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab5b39640 1 -- 172.21.15.6:0/2789360920 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffab0158ce0 msgr2=0x7ffab0147450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab5b39640 1 --2- 172.21.15.6:0/2789360920 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffab0158ce0 0x7ffab0147450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab5b39640 1 -- 172.21.15.6:0/2789360920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac009420 con 0x7ffab00c8ad0 2023-07-21T22:31:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab633a640 1 --2- 172.21.15.6:0/2789360920 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffab0158ce0 0x7ffab0147450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:31:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab5338640 1 --2- 172.21.15.6:0/2789360920 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffab00c9730 0x7ffab014c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:31:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab5b39640 1 --2- 172.21.15.6:0/2789360920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffab00c8ad0 0x7ffab01631e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ffaac018f20 tx=0x7ffaac0190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffaa67fc640 1 -- 172.21.15.6:0/2789360920 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac003a30 con 0x7ffab00c8ad0 2023-07-21T22:31:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffaa67fc640 1 -- 172.21.15.6:0/2789360920 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac003b90 con 0x7ffab00c8ad0 2023-07-21T22:31:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffaa67fc640 1 -- 172.21.15.6:0/2789360920 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac0ab400 con 0x7ffab00c8ad0 2023-07-21T22:31:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab7d9d640 1 -- 172.21.15.6:0/2789360920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab0162a00 con 0x7ffab00c8ad0 2023-07-21T22:31:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab7d9d640 1 -- 172.21.15.6:0/2789360920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab014cd40 con 0x7ffab00c8ad0 2023-07-21T22:31:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.200+0000 7ffab7d9d640 1 -- 172.21.15.6:0/2789360920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab00ca1a0 con 0x7ffab00c8ad0 2023-07-21T22:31:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.204+0000 7ffaa67fc640 1 -- 172.21.15.6:0/2789360920 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 15) v1 ==== 85496+0+0 (secure 0 0 0) 0x7ffaac0b2040 con 0x7ffab00c8ad0 2023-07-21T22:31:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.204+0000 7ffaa67fc640 1 --2- 172.21.15.6:0/2789360920 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ffa940660d0 0x7ffa94068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.204+0000 7ffaa67fc640 1 -- 172.21.15.6:0/2789360920 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 7480+0+0 (secure 0 0 0) 0x7ffaac11ddb0 con 0x7ffab00c8ad0 2023-07-21T22:31:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.204+0000 7ffab5338640 1 --2- 172.21.15.6:0/2789360920 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ffa940660d0 0x7ffa94068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.204+0000 7ffab5338640 1 --2- 172.21.15.6:0/2789360920 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ffa940660d0 0x7ffa94068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ffab014d1e0 tx=0x7ffaa0009040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:47.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.208+0000 7ffaa67fc640 1 -- 172.21.15.6:0/2789360920 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffaac0eafe0 con 0x7ffab00c8ad0 2023-07-21T22:31:47.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.364+0000 7ffab7d9d640 1 -- 172.21.15.6:0/2789360920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffab014cf30 con 0x7ffab00c8ad0 2023-07-21T22:31:47.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.368+0000 7ffaa67fc640 1 -- 172.21.15.6:0/2789360920 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20433 (secure 0 0 0) 0x7ffab014cf30 con 0x7ffab00c8ad0 2023-07-21T22:31:47.415 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:47.415 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":54,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:31:46.674199+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:19:43.286760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-21T22:19:44.152686+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":54,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1c","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/306225944":"2023-07-22T22:20:02.274267+0000","172.21.15.161:0/2854890359":"2023-07-22T22:20:02.274267+0000","172.21.15.161:6833/2930793066":"2023-07-22T22:31:45.670007+0000","172.21.15.161:0/1870877504":"2023-07-22T22:20:02.274267+0000","172.21.15.161:6832/3471136886":"2023-07-22T22:20:02.274267+0000","172.21.15.161:0/3549650704":"2023-07-22T22:31:45.670007+0000","172.21.15.161:6833/3471136886":"2023-07-22T22:20:02.274267+0000","172.21.15.161:0/1595540412":"2023-07-22T22:31:45.670007+0000","172.21.15.161:0/1202931620":"2023-07-22T22:20:02.274267+0000","172.21.15.161:0/3122173945":"2023-07-22T22:31:45.670007+0000","172.21.15.161:0/4100698986":"2023-07-22T22:31:45.670007+0000","172.21.15.161:0/1549347844":"2023-07-22T22:31:45.670007+0000","172.21.15.161:0/1787547650":"2023-07-22T22:31:45.670007+0000","172.21.15.161:0/3635192101":"2023-07-22T22:31:45.670007+0000","172.21.15.161:6832/2930793066":"2023-07-22T22:31:45.670007+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":6,"length":1},{"begin":8,"length":1},{"begin":10,"length":1},{"begin":13,"length":1},{"begin":17,"length":1},{"begin":19,"length":1},{"begin":21,"length":2},{"begin":24,"length":1},{"begin":28,"length":1},{"begin":30,"length":1},{"begin":33,"length":1},{"begin":35,"length":1},{"begin":39,"length":1},{"begin":41,"length":1},{"begin":43,"length":1},{"begin":45,"length":1},{"begin":49,"length":1},{"begin":51,"length":1},{"begin":53,"length":1},{"begin":55,"length":1},{"begin":59,"length":1},{"begin":61,"length":2},{"begin":64,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":73,"length":1},{"begin":75,"length":1},{"begin":77,"length":1},{"begin":81,"length":2},{"begin":84,"length":1},{"begin":86,"length":1},{"begin":88,"length":1},{"begin":92,"length":1},{"begin":94,"length":1},{"begin":96,"length":1},{"begin":98,"length":1},{"begin":103,"length":1},{"begin":105,"length":1},{"begin":107,"length":1},{"begin":109,"length":1},{"begin":111,"length":1},{"begin":177,"length":45}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:31:47.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.368+0000 7ffab7d9d640 1 -- 172.21.15.6:0/2789360920 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ffa940660d0 msgr2=0x7ffa94068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:47.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.368+0000 7ffab7d9d640 1 --2- 172.21.15.6:0/2789360920 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ffa940660d0 0x7ffa94068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ffab014d1e0 tx=0x7ffaa0009040 comp rx=0 tx=0).stop 2023-07-21T22:31:47.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.368+0000 7ffab7d9d640 1 -- 172.21.15.6:0/2789360920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffab00c8ad0 msgr2=0x7ffab01631e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:47.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.368+0000 7ffab7d9d640 1 --2- 172.21.15.6:0/2789360920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffab00c8ad0 0x7ffab01631e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ffaac018f20 tx=0x7ffaac0190b0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.368+0000 7ffab7d9d640 1 -- 172.21.15.6:0/2789360920 shutdown_connections 2023-07-21T22:31:47.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.368+0000 7ffab7d9d640 1 --2- 172.21.15.6:0/2789360920 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ffa940660d0 0x7ffa94068580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.368+0000 7ffab7d9d640 1 --2- 172.21.15.6:0/2789360920 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffab0158ce0 0x7ffab0147450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.368+0000 7ffab7d9d640 1 --2- 172.21.15.6:0/2789360920 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffab00c9730 0x7ffab014c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.368+0000 7ffab7d9d640 1 --2- 172.21.15.6:0/2789360920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffab00c8ad0 0x7ffab01631e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.368+0000 7ffab7d9d640 1 -- 172.21.15.6:0/2789360920 >> 172.21.15.6:0/2789360920 conn(0x7ffab00afcf0 msgr2=0x7ffab0157410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:47.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.368+0000 7ffab7d9d640 1 -- 172.21.15.6:0/2789360920 shutdown_connections 2023-07-21T22:31:47.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.368+0000 7ffab7d9d640 1 -- 172.21.15.6:0/2789360920 wait complete. 2023-07-21T22:31:47.436 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-21T22:31:47.436 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:31:47.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.532+0000 7f5276d9d640 1 Processor -- start 2023-07-21T22:31:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.532+0000 7f5276d9d640 1 -- start start 2023-07-21T22:31:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.532+0000 7f5276d9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5270158ce0 0x7f5270070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.532+0000 7f5276d9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f52700c9730 0x7f52700ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.532+0000 7f5276d9d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52700cc700 con 0x7f52700c8ad0 2023-07-21T22:31:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.532+0000 7f5276d9d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52700b0ff0 con 0x7f52700c9730 2023-07-21T22:31:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.532+0000 7f5276d9d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5270070c80 con 0x7f5270158ce0 2023-07-21T22:31:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.532+0000 7f526ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f52700c8ad0 0x7f52700c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39356/0 (socket says 172.21.15.6:39356) 2023-07-21T22:31:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.532+0000 7f526ffff640 1 -- 172.21.15.6:0/1858243211 learned_addr learned my addr 172.21.15.6:0/1858243211 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:47.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.532+0000 7f5274b39640 1 --2- 172.21.15.6:0/1858243211 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5270158ce0 0x7f5270070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:47.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.532+0000 7f527533a640 1 --2- 172.21.15.6:0/1858243211 >> v2:172.21.15.161:3300/0 conn(0x7f52700c9730 0x7f52700ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:47.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.532+0000 7f526f7fe640 1 -- 172.21.15.6:0/1858243211 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 346939540 0 0) 0x7f52700cc700 con 0x7f52700c8ad0 2023-07-21T22:31:47.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.532+0000 7f526f7fe640 1 -- 172.21.15.6:0/1858243211 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5260003530 con 0x7f52700c8ad0 2023-07-21T22:31:47.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.532+0000 7f526f7fe640 1 -- 172.21.15.6:0/1858243211 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1350501845 0 0) 0x7f5260003530 con 0x7f52700c8ad0 2023-07-21T22:31:47.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f526f7fe640 1 -- 172.21.15.6:0/1858243211 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5270158ce0 msgr2=0x7f5270070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:47.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f526f7fe640 1 --2- 172.21.15.6:0/1858243211 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5270158ce0 0x7f5270070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f526f7fe640 1 -- 172.21.15.6:0/1858243211 >> v2:172.21.15.161:3300/0 conn(0x7f52700c9730 msgr2=0x7f52700ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:47.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f526f7fe640 1 --2- 172.21.15.6:0/1858243211 >> v2:172.21.15.161:3300/0 conn(0x7f52700c9730 0x7f52700ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f526f7fe640 1 -- 172.21.15.6:0/1858243211 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52700cbdd0 con 0x7f52700c8ad0 2023-07-21T22:31:47.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f526f7fe640 1 -- 172.21.15.6:0/1858243211 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f525c001680 con 0x7f52700c8ad0 2023-07-21T22:31:47.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f526f7fe640 1 -- 172.21.15.6:0/1858243211 >> v1:172.21.15.6:6789/0 conn(0x7f52700c8ad0 legacy=0x7f52700c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:47.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f526f7fe640 1 --2- 172.21.15.6:0/1858243211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5260003980 0x7f5260003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:47.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f526f7fe640 1 --2- 172.21.15.6:0/1858243211 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5270158ce0 0x7f52600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:47.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f526f7fe640 1 --2- 172.21.15.6:0/1858243211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5260004d10 0x7f5260005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:47.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f526f7fe640 1 -- 172.21.15.6:0/1858243211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52700b0ff0 con 0x7f5260003980 2023-07-21T22:31:47.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f526f7fe640 1 -- 172.21.15.6:0/1858243211 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5270070c80 con 0x7f5260004d10 2023-07-21T22:31:47.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f526f7fe640 1 -- 172.21.15.6:0/1858243211 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526000ba10 con 0x7f5270158ce0 2023-07-21T22:31:47.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f5274b39640 1 --2- 172.21.15.6:0/1858243211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5260003980 0x7f5260003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:47.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f526ffff640 1 --2- 172.21.15.6:0/1858243211 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5270158ce0 0x7f52600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:47.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f527533a640 1 --2- 172.21.15.6:0/1858243211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5260004d10 0x7f5260005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:47.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f5274b39640 1 -- 172.21.15.6:0/1858243211 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5270158ce0 msgr2=0x7f52600047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:47.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f5274b39640 1 --2- 172.21.15.6:0/1858243211 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5270158ce0 0x7f52600047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f5274b39640 1 -- 172.21.15.6:0/1858243211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5260004d10 msgr2=0x7f5260005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:47.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f5274b39640 1 --2- 172.21.15.6:0/1858243211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5260004d10 0x7f5260005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f5274b39640 1 -- 172.21.15.6:0/1858243211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5260003530 con 0x7f5260003980 2023-07-21T22:31:47.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f527533a640 1 --2- 172.21.15.6:0/1858243211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5260004d10 0x7f5260005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:47.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f5274b39640 1 --2- 172.21.15.6:0/1858243211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5260003980 0x7f5260003d90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5264009ae0 tx=0x7f526401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5584cf8faed685d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:47.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f526f7fe640 1 -- 172.21.15.6:0/1858243211 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52640a6510 con 0x7f5260003980 2023-07-21T22:31:47.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f526f7fe640 1 -- 172.21.15.6:0/1858243211 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52640a6670 con 0x7f5260003980 2023-07-21T22:31:47.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.536+0000 7f526f7fe640 1 -- 172.21.15.6:0/1858243211 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52640a6a20 con 0x7f5260003980 2023-07-21T22:31:47.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.540+0000 7f5276d9d640 1 -- 172.21.15.6:0/1858243211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5260003980 msgr2=0x7f5260003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:47.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.540+0000 7f5276d9d640 1 --2- 172.21.15.6:0/1858243211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5260003980 0x7f5260003d90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5264009ae0 tx=0x7f526401ca20 comp rx=0 tx=0).stop 2023-07-21T22:31:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.540+0000 7f527533a640 1 -- 172.21.15.6:0/1858243211 reap_dead start 2023-07-21T22:31:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.540+0000 7f5276d9d640 1 -- 172.21.15.6:0/1858243211 shutdown_connections 2023-07-21T22:31:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.540+0000 7f5276d9d640 1 -- 172.21.15.6:0/1858243211 >> 172.21.15.6:0/1858243211 conn(0x7f52700afcf0 msgr2=0x7f52700b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.540+0000 7f5276d9d640 1 -- 172.21.15.6:0/1858243211 shutdown_connections 2023-07-21T22:31:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.540+0000 7f5276d9d640 1 -- 172.21.15.6:0/1858243211 wait complete. 2023-07-21T22:31:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.540+0000 7f5276d9d640 1 Processor -- start 2023-07-21T22:31:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.540+0000 7f5276d9d640 1 -- start start 2023-07-21T22:31:47.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.540+0000 7f5276d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5260003980 0x7f52700aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:47.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.540+0000 7f5276d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f527015c630 0x7f52701525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:47.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.540+0000 7f5276d9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52700c5f70 0x7f52700c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.540+0000 7f5276d9d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527015cba0 con 0x7f527015c630 2023-07-21T22:31:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.540+0000 7f5276d9d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52700c6920 con 0x7f5260003980 2023-07-21T22:31:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.540+0000 7f5276d9d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527015d0d0 con 0x7f52700c5f70 2023-07-21T22:31:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.540+0000 7f526ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f527015c630 0x7f52701525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.540+0000 7f526ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f527015c630 0x7f52701525c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56386/0 (socket says 172.21.15.6:56386) 2023-07-21T22:31:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.540+0000 7f5274b39640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5260003980 0x7f52700aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.540+0000 7f526ffff640 1 -- 172.21.15.6:0/3405723532 learned_addr learned my addr 172.21.15.6:0/3405723532 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.540+0000 7f527533a640 1 --2- 172.21.15.6:0/3405723532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52700c5f70 0x7f52700c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.544+0000 7f526ffff640 1 -- 172.21.15.6:0/3405723532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52700c5f70 msgr2=0x7f52700c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.544+0000 7f526ffff640 1 --2- 172.21.15.6:0/3405723532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52700c5f70 0x7f52700c63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.544+0000 7f526ffff640 1 -- 172.21.15.6:0/3405723532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5260003980 msgr2=0x7f52700aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.544+0000 7f526ffff640 1 --2- 172.21.15.6:0/3405723532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5260003980 0x7f52700aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.544+0000 7f526ffff640 1 -- 172.21.15.6:0/3405723532 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52700c53d0 con 0x7f527015c630 2023-07-21T22:31:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.544+0000 7f526ffff640 1 --2- 172.21.15.6:0/3405723532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f527015c630 0x7f52701525c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f525c00e7b0 tx=0x7f525c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.544+0000 7f526d7fa640 1 -- 172.21.15.6:0/3405723532 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c00ee60 con 0x7f527015c630 2023-07-21T22:31:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.544+0000 7f526d7fa640 1 -- 172.21.15.6:0/3405723532 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525c00c870 con 0x7f527015c630 2023-07-21T22:31:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.544+0000 7f526d7fa640 1 -- 172.21.15.6:0/3405723532 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c00cc20 con 0x7f527015c630 2023-07-21T22:31:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.544+0000 7f5276d9d640 1 -- 172.21.15.6:0/3405723532 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52700c56b0 con 0x7f527015c630 2023-07-21T22:31:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.544+0000 7f5276d9d640 1 -- 172.21.15.6:0/3405723532 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52700c2670 con 0x7f527015c630 2023-07-21T22:31:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.544+0000 7f5276d9d640 1 -- 172.21.15.6:0/3405723532 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52700ca1a0 con 0x7f527015c630 2023-07-21T22:31:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.544+0000 7f526d7fa640 1 -- 172.21.15.6:0/3405723532 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 15) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f525c00cd80 con 0x7f527015c630 2023-07-21T22:31:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.544+0000 7f526d7fa640 1 --2- 172.21.15.6:0/3405723532 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f5254066100 0x7f52540685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.544+0000 7f526d7fa640 1 -- 172.21.15.6:0/3405723532 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 7480+0+0 (secure 0 0 0) 0x7f525c083ac0 con 0x7f527015c630 2023-07-21T22:31:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.544+0000 7f5274b39640 1 --2- 172.21.15.6:0/3405723532 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f5254066100 0x7f52540685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.548+0000 7f5274b39640 1 --2- 172.21.15.6:0/3405723532 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f5254066100 0x7f52540685b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5264009ae0 tx=0x7f52640046d0 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:47.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.548+0000 7f526d7fa640 1 -- 172.21.15.6:0/3405723532 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f525c050c20 con 0x7f527015c630 2023-07-21T22:31:47.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.736+0000 7f5276d9d640 1 -- 172.21.15.6:0/3405723532 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52700678d0 con 0x7f527015c630 2023-07-21T22:31:47.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.736+0000 7f526d7fa640 1 -- 172.21.15.6:0/3405723532 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4662 (secure 0 0 0) 0x7f525c054240 con 0x7f527015c630 2023-07-21T22:31:47.786 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:47.787 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4928,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3033056690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3033056690},{"type":"v1","addr":"172.21.15.161:6836","nonce":3033056690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/77801161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":77801161},{"type":"v1","addr":"172.21.15.6:6835","nonce":77801161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5152,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/558287949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":558287949},{"type":"v1","addr":"172.21.15.161:6837","nonce":558287949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:19:45.163404+0000","modified":"2023-07-21T22:19:48.796910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5181":{"gid":5181,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/2921512075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2921512075},{"type":"v1","addr":"172.21.15.6:6834","nonce":2921512075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-21T22:31:47.787 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-07-21T22:31:47.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.740+0000 7f5276d9d640 1 -- 172.21.15.6:0/3405723532 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f5254066100 msgr2=0x7f52540685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:47.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.740+0000 7f5276d9d640 1 --2- 172.21.15.6:0/3405723532 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f5254066100 0x7f52540685b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5264009ae0 tx=0x7f52640046d0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.740+0000 7f5276d9d640 1 -- 172.21.15.6:0/3405723532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f527015c630 msgr2=0x7f52701525c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:47.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.740+0000 7f5276d9d640 1 --2- 172.21.15.6:0/3405723532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f527015c630 0x7f52701525c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f525c00e7b0 tx=0x7f525c00ec70 comp rx=0 tx=0).stop 2023-07-21T22:31:47.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.740+0000 7f5276d9d640 1 -- 172.21.15.6:0/3405723532 shutdown_connections 2023-07-21T22:31:47.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.740+0000 7f5276d9d640 1 --2- 172.21.15.6:0/3405723532 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f5254066100 0x7f52540685b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.740+0000 7f5276d9d640 1 --2- 172.21.15.6:0/3405723532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52700c5f70 0x7f52700c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.740+0000 7f5276d9d640 1 --2- 172.21.15.6:0/3405723532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f527015c630 0x7f52701525c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.740+0000 7f5276d9d640 1 --2- 172.21.15.6:0/3405723532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5260003980 0x7f52700aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.740+0000 7f5276d9d640 1 -- 172.21.15.6:0/3405723532 >> 172.21.15.6:0/3405723532 conn(0x7f52700afcf0 msgr2=0x7f52700c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:47.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.740+0000 7f5276d9d640 1 -- 172.21.15.6:0/3405723532 shutdown_connections 2023-07-21T22:31:47.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.740+0000 7f5276d9d640 1 -- 172.21.15.6:0/3405723532 wait complete. 2023-07-21T22:31:47.809 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:31:47.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.912+0000 7f45c5834640 1 Processor -- start 2023-07-21T22:31:47.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.912+0000 7f45c5834640 1 -- start start 2023-07-21T22:31:47.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.912+0000 7f45c5834640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45c015bcb0 0x7f45c00b4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:47.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.912+0000 7f45c5834640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c00ce750 con 0x7f45c00b10c0 2023-07-21T22:31:47.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.912+0000 7f45c5834640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c00cea30 con 0x7f45c00b3c50 2023-07-21T22:31:47.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.912+0000 7f45c5834640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c00ced10 con 0x7f45c015bcb0 2023-07-21T22:31:47.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.912+0000 7f45b7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45c015bcb0 0x7f45c00b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:47.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.912+0000 7f45b7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45c015bcb0 0x7f45c00b4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56390/0 (socket says 172.21.15.6:56390) 2023-07-21T22:31:47.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.912+0000 7f45bf7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f45c00b10c0 0x7f45c00cffc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39366/0 (socket says 172.21.15.6:39366) 2023-07-21T22:31:47.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.912+0000 7f45b7fff640 1 -- 172.21.15.6:0/1552366907 learned_addr learned my addr 172.21.15.6:0/1552366907 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:47.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.912+0000 7f45b7fff640 1 -- 172.21.15.6:0/1552366907 >> v1:172.21.15.161:6789/0 conn(0x7f45c00b3c50 legacy=0x7f45c00b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:47.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.912+0000 7f45b7fff640 1 -- 172.21.15.6:0/1552366907 >> v1:172.21.15.6:6789/0 conn(0x7f45c00b10c0 legacy=0x7f45c00cffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:47.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.912+0000 7f45be7fc640 1 -- 172.21.15.6:0/1552366907 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545463201 0 0) 0x7f45c00ce750 con 0x7f45c00b10c0 2023-07-21T22:31:47.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.912+0000 7f45b7fff640 1 -- 172.21.15.6:0/1552366907 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c00ceff0 con 0x7f45c015bcb0 2023-07-21T22:31:47.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.916+0000 7f45b7fff640 1 --2- 172.21.15.6:0/1552366907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c015bcb0 0x7f45c00b4730 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f45a8009870 tx=0x7f45a801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170a143851431b1e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:47.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.916+0000 7f45be7fc640 1 -- 172.21.15.6:0/1552366907 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a80ab600 con 0x7f45c015bcb0 2023-07-21T22:31:47.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.916+0000 7f45be7fc640 1 -- 172.21.15.6:0/1552366907 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a80a7050 con 0x7f45c015bcb0 2023-07-21T22:31:47.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.916+0000 7f45be7fc640 1 -- 172.21.15.6:0/1552366907 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a80ab980 con 0x7f45c015bcb0 2023-07-21T22:31:47.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.916+0000 7f45c5834640 1 -- 172.21.15.6:0/1552366907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c015bcb0 msgr2=0x7f45c00b4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:47.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.916+0000 7f45c5834640 1 --2- 172.21.15.6:0/1552366907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c015bcb0 0x7f45c00b4730 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f45a8009870 tx=0x7f45a801c4b0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.916+0000 7f45c5834640 1 -- 172.21.15.6:0/1552366907 shutdown_connections 2023-07-21T22:31:47.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.916+0000 7f45c5834640 1 --2- 172.21.15.6:0/1552366907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c015bcb0 0x7f45c00b4730 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.916+0000 7f45c5834640 1 -- 172.21.15.6:0/1552366907 >> 172.21.15.6:0/1552366907 conn(0x7f45c0069e80 msgr2=0x7f45c006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:47.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.916+0000 7f45c5834640 1 -- 172.21.15.6:0/1552366907 shutdown_connections 2023-07-21T22:31:47.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.916+0000 7f45c5834640 1 -- 172.21.15.6:0/1552366907 wait complete. 2023-07-21T22:31:47.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45c5834640 1 Processor -- start 2023-07-21T22:31:47.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45c5834640 1 -- start start 2023-07-21T22:31:47.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45c5834640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45c00b10c0 0x7f45c014f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:47.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45c5834640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c00b3c50 0x7f45c00b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:47.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45c5834640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45c015bcb0 0x7f45c00cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:47.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45c5834640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c014f880 con 0x7f45c00b3c50 2023-07-21T22:31:47.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45c5834640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00c6cd0 con 0x7f45c00b10c0 2023-07-21T22:31:47.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45c5834640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00c60c0 con 0x7f45c015bcb0 2023-07-21T22:31:47.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45b7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c00b3c50 0x7f45c00b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:47.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45b7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c00b3c50 0x7f45c00b5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56394/0 (socket says 172.21.15.6:56394) 2023-07-21T22:31:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45b7fff640 1 -- 172.21.15.6:0/800128709 learned_addr learned my addr 172.21.15.6:0/800128709 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45beffd640 1 --2- 172.21.15.6:0/800128709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45c00b10c0 0x7f45c014f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45bf7fe640 1 --2- 172.21.15.6:0/800128709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45c015bcb0 0x7f45c00cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45b7fff640 1 -- 172.21.15.6:0/800128709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45c015bcb0 msgr2=0x7f45c00cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45b7fff640 1 --2- 172.21.15.6:0/800128709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45c015bcb0 0x7f45c00cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45b7fff640 1 -- 172.21.15.6:0/800128709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45c00b10c0 msgr2=0x7f45c014f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45b7fff640 1 --2- 172.21.15.6:0/800128709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45c00b10c0 0x7f45c014f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45b7fff640 1 -- 172.21.15.6:0/800128709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a80094d0 con 0x7f45c00b3c50 2023-07-21T22:31:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45bf7fe640 1 --2- 172.21.15.6:0/800128709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45c015bcb0 0x7f45c00cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:31:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45b7fff640 1 --2- 172.21.15.6:0/800128709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c00b3c50 0x7f45c00b5000 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f45a80ae040 tx=0x7f45a801acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45bcff9640 1 -- 172.21.15.6:0/800128709 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a80b6620 con 0x7f45c00b3c50 2023-07-21T22:31:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45bcff9640 1 -- 172.21.15.6:0/800128709 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a80b67a0 con 0x7f45c00b3c50 2023-07-21T22:31:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45bcff9640 1 -- 172.21.15.6:0/800128709 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a80b6b50 con 0x7f45c00b3c50 2023-07-21T22:31:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45c5834640 1 -- 172.21.15.6:0/800128709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c00c63a0 con 0x7f45c00b3c50 2023-07-21T22:31:47.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.920+0000 7f45c5834640 1 -- 172.21.15.6:0/800128709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c00c6960 con 0x7f45c00b3c50 2023-07-21T22:31:47.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.924+0000 7f45c5834640 1 -- 172.21.15.6:0/800128709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c00678d0 con 0x7f45c00b3c50 2023-07-21T22:31:47.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.924+0000 7f45bcff9640 1 -- 172.21.15.6:0/800128709 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f45a80b2040 con 0x7f45c00b3c50 2023-07-21T22:31:47.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.924+0000 7f45bcff9640 1 --2- 172.21.15.6:0/800128709 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f45a00663a0 0x7f45a0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:47.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.924+0000 7f45bcff9640 1 -- 172.21.15.6:0/800128709 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7464+0+0 (secure 0 0 0) 0x7f45a811e9e0 con 0x7f45c00b3c50 2023-07-21T22:31:47.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.924+0000 7f45beffd640 1 --2- 172.21.15.6:0/800128709 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f45a00663a0 0x7f45a0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:47.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.924+0000 7f45beffd640 1 --2- 172.21.15.6:0/800128709 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f45a00663a0 0x7f45a0068850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f45c00ccb90 tx=0x7f45b0009040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:47.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:47.928+0000 7f45bcff9640 1 -- 172.21.15.6:0/800128709 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f45a80eb620 con 0x7f45c00b3c50 2023-07-21T22:31:48.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.116+0000 7f45c5834640 1 -- 172.21.15.6:0/800128709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45c00cfda0 con 0x7f45c00b3c50 2023-07-21T22:31:48.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.120+0000 7f45bcff9640 1 -- 172.21.15.6:0/800128709 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4662 (secure 0 0 0) 0x7f45a80eec40 con 0x7f45c00b3c50 2023-07-21T22:31:48.167 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:48.168 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4928,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3033056690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3033056690},{"type":"v1","addr":"172.21.15.161:6836","nonce":3033056690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/77801161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":77801161},{"type":"v1","addr":"172.21.15.6:6835","nonce":77801161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5152,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/558287949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":558287949},{"type":"v1","addr":"172.21.15.161:6837","nonce":558287949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:19:45.163404+0000","modified":"2023-07-21T22:19:48.796910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5181":{"gid":5181,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6834/2921512075","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2921512075},{"type":"v1","addr":"172.21.15.6:6834","nonce":2921512075}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-21T22:31:48.168 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2023-07-21T22:31:48.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.120+0000 7f45c5834640 1 -- 172.21.15.6:0/800128709 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f45a00663a0 msgr2=0x7f45a0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.120+0000 7f45c5834640 1 --2- 172.21.15.6:0/800128709 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f45a00663a0 0x7f45a0068850 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f45c00ccb90 tx=0x7f45b0009040 comp rx=0 tx=0).stop 2023-07-21T22:31:48.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.120+0000 7f45c5834640 1 -- 172.21.15.6:0/800128709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c00b3c50 msgr2=0x7f45c00b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.120+0000 7f45c5834640 1 --2- 172.21.15.6:0/800128709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c00b3c50 0x7f45c00b5000 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f45a80ae040 tx=0x7f45a801acf0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.120+0000 7f45c5834640 1 -- 172.21.15.6:0/800128709 shutdown_connections 2023-07-21T22:31:48.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.120+0000 7f45c5834640 1 --2- 172.21.15.6:0/800128709 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f45a00663a0 0x7f45a0068850 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.120+0000 7f45c5834640 1 --2- 172.21.15.6:0/800128709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45c015bcb0 0x7f45c00cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.120+0000 7f45c5834640 1 --2- 172.21.15.6:0/800128709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45c00b3c50 0x7f45c00b5000 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.120+0000 7f45c5834640 1 --2- 172.21.15.6:0/800128709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45c00b10c0 0x7f45c014f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.120+0000 7f45c5834640 1 -- 172.21.15.6:0/800128709 >> 172.21.15.6:0/800128709 conn(0x7f45c0069e80 msgr2=0x7f45c00b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:48.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.120+0000 7f45c5834640 1 -- 172.21.15.6:0/800128709 shutdown_connections 2023-07-21T22:31:48.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.120+0000 7f45c5834640 1 -- 172.21.15.6:0/800128709 wait complete. 2023-07-21T22:31:48.188 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:31:48.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.284+0000 7f1368940640 1 Processor -- start 2023-07-21T22:31:48.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.284+0000 7f1368940640 1 -- start start 2023-07-21T22:31:48.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.288+0000 7f1368940640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f136415f240 0x7f13640ad720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.288+0000 7f1368940640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13640ca300 con 0x7f13640cbef0 2023-07-21T22:31:48.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.288+0000 7f1368940640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13640ca5e0 con 0x7f13640c9e20 2023-07-21T22:31:48.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.288+0000 7f1368940640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13640caba0 con 0x7f136415f240 2023-07-21T22:31:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.288+0000 7f1362d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f13640cbef0 0x7f13640cd5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39382/0 (socket says 172.21.15.6:39382) 2023-07-21T22:31:48.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.288+0000 7f1362d9d640 1 -- 172.21.15.6:0/2198345806 learned_addr learned my addr 172.21.15.6:0/2198345806 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:48.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.288+0000 7f136259c640 1 --2- 172.21.15.6:0/2198345806 >> v2:172.21.15.161:3300/0 conn(0x7f136415f240 0x7f13640ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.288+0000 7f1361d9b640 1 -- 172.21.15.6:0/2198345806 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747061216 0 0) 0x7f13640ca300 con 0x7f13640cbef0 2023-07-21T22:31:48.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.288+0000 7f1361d9b640 1 -- 172.21.15.6:0/2198345806 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1350003530 con 0x7f13640cbef0 2023-07-21T22:31:48.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.288+0000 7f136259c640 1 -- 172.21.15.6:0/2198345806 >> v1:172.21.15.161:6789/0 conn(0x7f13640c9e20 legacy=0x7f136415fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.288+0000 7f1361d9b640 1 -- 172.21.15.6:0/2198345806 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481983659 0 0) 0x7f13640ca5e0 con 0x7f13640c9e20 2023-07-21T22:31:48.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.288+0000 7f136259c640 1 -- 172.21.15.6:0/2198345806 >> v1:172.21.15.6:6789/0 conn(0x7f13640cbef0 legacy=0x7f13640cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.288+0000 7f136259c640 1 -- 172.21.15.6:0/2198345806 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13640ca8c0 con 0x7f136415f240 2023-07-21T22:31:48.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.292+0000 7f136259c640 1 --2- 172.21.15.6:0/2198345806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f136415f240 0x7f13640ad720 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f13540097c0 tx=0x7f135401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=825cc77228e34e37 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:48.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.292+0000 7f1361d9b640 1 -- 172.21.15.6:0/2198345806 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540ab600 con 0x7f136415f240 2023-07-21T22:31:48.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.292+0000 7f1361d9b640 1 -- 172.21.15.6:0/2198345806 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13540a7050 con 0x7f136415f240 2023-07-21T22:31:48.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.292+0000 7f1361d9b640 1 -- 172.21.15.6:0/2198345806 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540ab980 con 0x7f136415f240 2023-07-21T22:31:48.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.292+0000 7f1368940640 1 -- 172.21.15.6:0/2198345806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f136415f240 msgr2=0x7f13640ad720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.292+0000 7f1368940640 1 --2- 172.21.15.6:0/2198345806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f136415f240 0x7f13640ad720 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f13540097c0 tx=0x7f135401c3f0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.292+0000 7f1368940640 1 -- 172.21.15.6:0/2198345806 shutdown_connections 2023-07-21T22:31:48.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.292+0000 7f1368940640 1 --2- 172.21.15.6:0/2198345806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f136415f240 0x7f13640ad720 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.292+0000 7f1368940640 1 -- 172.21.15.6:0/2198345806 >> 172.21.15.6:0/2198345806 conn(0x7f13640cada0 msgr2=0x7f13640cb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:48.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.292+0000 7f1368940640 1 -- 172.21.15.6:0/2198345806 shutdown_connections 2023-07-21T22:31:48.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.292+0000 7f1368940640 1 -- 172.21.15.6:0/2198345806 wait complete. 2023-07-21T22:31:48.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.292+0000 7f1368940640 1 Processor -- start 2023-07-21T22:31:48.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.292+0000 7f1368940640 1 -- start start 2023-07-21T22:31:48.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f1368940640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13640c9e20 0x7f13640b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f1368940640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13640cbef0 0x7f13640b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f1368940640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13640b3490 0x7f13640b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f1368940640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1364152fe0 con 0x7f13640c9e20 2023-07-21T22:31:48.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f1368940640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13640af370 con 0x7f13640b3490 2023-07-21T22:31:48.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f1368940640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13640c6040 con 0x7f13640cbef0 2023-07-21T22:31:48.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f136259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13640c9e20 0x7f13640b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f136259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13640c9e20 0x7f13640b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56400/0 (socket says 172.21.15.6:56400) 2023-07-21T22:31:48.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f136259c640 1 -- 172.21.15.6:0/3462482829 learned_addr learned my addr 172.21.15.6:0/3462482829 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:48.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f135bfff640 1 --2- 172.21.15.6:0/3462482829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13640cbef0 0x7f13640b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f1362d9d640 1 --2- 172.21.15.6:0/3462482829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13640b3490 0x7f13640b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f136259c640 1 -- 172.21.15.6:0/3462482829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13640cbef0 msgr2=0x7f13640b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f136259c640 1 --2- 172.21.15.6:0/3462482829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13640cbef0 0x7f13640b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f136259c640 1 -- 172.21.15.6:0/3462482829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13640b3490 msgr2=0x7f13640b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f136259c640 1 --2- 172.21.15.6:0/3462482829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13640b3490 0x7f13640b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f136259c640 1 -- 172.21.15.6:0/3462482829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1354009420 con 0x7f13640c9e20 2023-07-21T22:31:48.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f1362d9d640 1 --2- 172.21.15.6:0/3462482829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13640b3490 0x7f13640b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:48.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f136259c640 1 --2- 172.21.15.6:0/3462482829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13640c9e20 0x7f13640b1770 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f13540097c0 tx=0x7f135401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:48.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f135affd640 1 -- 172.21.15.6:0/3462482829 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540abd80 con 0x7f13640c9e20 2023-07-21T22:31:48.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f135affd640 1 -- 172.21.15.6:0/3462482829 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1354004020 con 0x7f13640c9e20 2023-07-21T22:31:48.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f135affd640 1 -- 172.21.15.6:0/3462482829 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540043d0 con 0x7f13640c9e20 2023-07-21T22:31:48.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f1368940640 1 -- 172.21.15.6:0/3462482829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13640c6320 con 0x7f13640c9e20 2023-07-21T22:31:48.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f1368940640 1 -- 172.21.15.6:0/3462482829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13640af650 con 0x7f13640c9e20 2023-07-21T22:31:48.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.296+0000 7f1368940640 1 -- 172.21.15.6:0/3462482829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13640678d0 con 0x7f13640c9e20 2023-07-21T22:31:48.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.300+0000 7f135affd640 1 -- 172.21.15.6:0/3462482829 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1354003620 con 0x7f13640c9e20 2023-07-21T22:31:48.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.300+0000 7f135affd640 1 --2- 172.21.15.6:0/3462482829 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f13440663a0 0x7f1344068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.300+0000 7f135affd640 1 -- 172.21.15.6:0/3462482829 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7464+0+0 (secure 0 0 0) 0x7f135411e500 con 0x7f13640c9e20 2023-07-21T22:31:48.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.300+0000 7f135bfff640 1 --2- 172.21.15.6:0/3462482829 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f13440663a0 0x7f1344068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.300+0000 7f135bfff640 1 --2- 172.21.15.6:0/3462482829 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f13440663a0 0x7f1344068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f136415a3e0 tx=0x7f134c009040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:48.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.304+0000 7f135affd640 1 -- 172.21.15.6:0/3462482829 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f13540eb1c0 con 0x7f13640c9e20 2023-07-21T22:31:48.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.468+0000 7f1368940640 1 -- 172.21.15.6:0/3462482829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f136406d290 con 0x7f13640c9e20 2023-07-21T22:31:48.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.468+0000 7f135affd640 1 -- 172.21.15.6:0/3462482829 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+20408 (secure 0 0 0) 0x7f13540ee7e0 con 0x7f13640c9e20 2023-07-21T22:31:48.518 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:48.519 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":55,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:31:47.750619+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:19:43.286760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-21T22:19:44.152686+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":54,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1c","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/306225944":"2023-07-22T22:20:02.274267+0000","172.21.15.161:0/2854890359":"2023-07-22T22:20:02.274267+0000","172.21.15.161:6833/2930793066":"2023-07-22T22:31:45.670007+0000","172.21.15.161:0/1870877504":"2023-07-22T22:20:02.274267+0000","172.21.15.161:6832/3471136886":"2023-07-22T22:20:02.274267+0000","172.21.15.161:0/3549650704":"2023-07-22T22:31:45.670007+0000","172.21.15.161:6833/3471136886":"2023-07-22T22:20:02.274267+0000","172.21.15.161:0/1595540412":"2023-07-22T22:31:45.670007+0000","172.21.15.161:0/1202931620":"2023-07-22T22:20:02.274267+0000","172.21.15.161:0/3122173945":"2023-07-22T22:31:45.670007+0000","172.21.15.161:0/4100698986":"2023-07-22T22:31:45.670007+0000","172.21.15.161:0/1549347844":"2023-07-22T22:31:45.670007+0000","172.21.15.161:0/1787547650":"2023-07-22T22:31:45.670007+0000","172.21.15.161:0/3635192101":"2023-07-22T22:31:45.670007+0000","172.21.15.161:6832/2930793066":"2023-07-22T22:31:45.670007+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":6,"length":1},{"begin":8,"length":1},{"begin":10,"length":1},{"begin":13,"length":1},{"begin":17,"length":1},{"begin":19,"length":1},{"begin":21,"length":2},{"begin":24,"length":1},{"begin":28,"length":1},{"begin":30,"length":1},{"begin":33,"length":1},{"begin":35,"length":1},{"begin":39,"length":1},{"begin":41,"length":1},{"begin":43,"length":1},{"begin":45,"length":1},{"begin":49,"length":1},{"begin":51,"length":1},{"begin":53,"length":1},{"begin":55,"length":1},{"begin":59,"length":1},{"begin":61,"length":2},{"begin":64,"length":1},{"begin":66,"length":1},{"begin":70,"length":1},{"begin":73,"length":1},{"begin":75,"length":1},{"begin":77,"length":1},{"begin":81,"length":2},{"begin":84,"length":1},{"begin":86,"length":1},{"begin":88,"length":1},{"begin":92,"length":1},{"begin":94,"length":1},{"begin":96,"length":1},{"begin":98,"length":1},{"begin":103,"length":1},{"begin":105,"length":1},{"begin":109,"length":1},{"begin":111,"length":1},{"begin":177,"length":44}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:31:48.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.472+0000 7f1368940640 1 -- 172.21.15.6:0/3462482829 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f13440663a0 msgr2=0x7f1344068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.472+0000 7f1368940640 1 --2- 172.21.15.6:0/3462482829 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f13440663a0 0x7f1344068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f136415a3e0 tx=0x7f134c009040 comp rx=0 tx=0).stop 2023-07-21T22:31:48.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.472+0000 7f1368940640 1 -- 172.21.15.6:0/3462482829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13640c9e20 msgr2=0x7f13640b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.472+0000 7f1368940640 1 --2- 172.21.15.6:0/3462482829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13640c9e20 0x7f13640b1770 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f13540097c0 tx=0x7f135401ac30 comp rx=0 tx=0).stop 2023-07-21T22:31:48.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.472+0000 7f1368940640 1 -- 172.21.15.6:0/3462482829 shutdown_connections 2023-07-21T22:31:48.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.472+0000 7f1368940640 1 --2- 172.21.15.6:0/3462482829 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f13440663a0 0x7f1344068850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.472+0000 7f1368940640 1 --2- 172.21.15.6:0/3462482829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13640b3490 0x7f13640b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.472+0000 7f1368940640 1 --2- 172.21.15.6:0/3462482829 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13640cbef0 0x7f13640b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.472+0000 7f1368940640 1 --2- 172.21.15.6:0/3462482829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13640c9e20 0x7f13640b1770 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.472+0000 7f1368940640 1 -- 172.21.15.6:0/3462482829 >> 172.21.15.6:0/3462482829 conn(0x7f13640cada0 msgr2=0x7f13640cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:48.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.472+0000 7f1368940640 1 -- 172.21.15.6:0/3462482829 shutdown_connections 2023-07-21T22:31:48.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.472+0000 7f1368940640 1 -- 172.21.15.6:0/3462482829 wait complete. 2023-07-21T22:31:48.539 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-21T22:31:48.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.636+0000 7fe401737640 1 Processor -- start 2023-07-21T22:31:48.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.636+0000 7fe401737640 1 -- start start 2023-07-21T22:31:48.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.636+0000 7fe401737640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe3fc15bdf0 0x7fe3fc0ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.636+0000 7fe401737640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc06c000 con 0x7fe3fc15f970 2023-07-21T22:31:48.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.636+0000 7fe401737640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc0cb2e0 con 0x7fe3fc0c9e80 2023-07-21T22:31:48.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.636+0000 7fe401737640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc0cb5c0 con 0x7fe3fc15bdf0 2023-07-21T22:31:48.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.636+0000 7fe3f3fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe3fc15f970 0x7fe3fc06b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39386/0 (socket says 172.21.15.6:39386) 2023-07-21T22:31:48.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.636+0000 7fe3f3fff640 1 -- 172.21.15.6:0/3404553699 learned_addr learned my addr 172.21.15.6:0/3404553699 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:48.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3faffd640 1 --2- 172.21.15.6:0/3404553699 >> v2:172.21.15.161:3300/0 conn(0x7fe3fc15bdf0 0x7fe3fc0ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3fa7fc640 1 -- 172.21.15.6:0/3404553699 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678232389 0 0) 0x7fe3fc06c000 con 0x7fe3fc15f970 2023-07-21T22:31:48.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3fa7fc640 1 -- 172.21.15.6:0/3404553699 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3e8003530 con 0x7fe3fc15f970 2023-07-21T22:31:48.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3fa7fc640 1 -- 172.21.15.6:0/3404553699 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448888212 0 0) 0x7fe3fc0cb2e0 con 0x7fe3fc0c9e80 2023-07-21T22:31:48.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3fa7fc640 1 -- 172.21.15.6:0/3404553699 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3fc06c000 con 0x7fe3fc0c9e80 2023-07-21T22:31:48.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3fa7fc640 1 -- 172.21.15.6:0/3404553699 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 800623702 0 0) 0x7fe3e8003530 con 0x7fe3fc15f970 2023-07-21T22:31:48.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3fa7fc640 1 -- 172.21.15.6:0/3404553699 >> v2:172.21.15.161:3300/0 conn(0x7fe3fc15bdf0 msgr2=0x7fe3fc0ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:48.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3fa7fc640 1 --2- 172.21.15.6:0/3404553699 >> v2:172.21.15.161:3300/0 conn(0x7fe3fc15bdf0 0x7fe3fc0ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3fa7fc640 1 -- 172.21.15.6:0/3404553699 >> v1:172.21.15.161:6789/0 conn(0x7fe3fc0c9e80 legacy=0x7fe3fc06b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3fa7fc640 1 -- 172.21.15.6:0/3404553699 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc0cb8a0 con 0x7fe3fc15f970 2023-07-21T22:31:48.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3fa7fc640 1 -- 172.21.15.6:0/3404553699 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fe3e4001680 con 0x7fe3fc15f970 2023-07-21T22:31:48.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3faffd640 1 --2- 172.21.15.6:0/3404553699 >> v2:172.21.15.161:3300/0 conn(0x7fe3fc15bdf0 0x7fe3fc0ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:48.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3fa7fc640 1 -- 172.21.15.6:0/3404553699 >> v1:172.21.15.6:6789/0 conn(0x7fe3fc15f970 legacy=0x7fe3fc06b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3fa7fc640 1 --2- 172.21.15.6:0/3404553699 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3e8003b10 0x7fe3e8003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3fa7fc640 1 --2- 172.21.15.6:0/3404553699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3e80047d0 0x7fe3e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3fa7fc640 1 --2- 172.21.15.6:0/3404553699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3e8005180 0x7fe3e800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3fa7fc640 1 -- 172.21.15.6:0/3404553699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0cb5c0 con 0x7fe3e80047d0 2023-07-21T22:31:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3fa7fc640 1 -- 172.21.15.6:0/3404553699 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e800c090 con 0x7fe3e8005180 2023-07-21T22:31:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3fa7fc640 1 -- 172.21.15.6:0/3404553699 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e800c250 con 0x7fe3e8003b10 2023-07-21T22:31:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3f3fff640 1 --2- 172.21.15.6:0/3404553699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3e80047d0 0x7fe3e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3faffd640 1 --2- 172.21.15.6:0/3404553699 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3e8003b10 0x7fe3e8003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3fb7fe640 1 --2- 172.21.15.6:0/3404553699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3e8005180 0x7fe3e800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3f3fff640 1 -- 172.21.15.6:0/3404553699 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3e8003b10 msgr2=0x7fe3e8003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3f3fff640 1 --2- 172.21.15.6:0/3404553699 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3e8003b10 0x7fe3e8003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3f3fff640 1 -- 172.21.15.6:0/3404553699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3e8005180 msgr2=0x7fe3e800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3f3fff640 1 --2- 172.21.15.6:0/3404553699 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3e8005180 0x7fe3e800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3f3fff640 1 -- 172.21.15.6:0/3404553699 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e8003530 con 0x7fe3e80047d0 2023-07-21T22:31:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.640+0000 7fe3fb7fe640 1 -- 172.21.15.6:0/3404553699 reap_dead start 2023-07-21T22:31:48.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.644+0000 7fe3f3fff640 1 --2- 172.21.15.6:0/3404553699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3e80047d0 0x7fe3e8004c40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4001ec0 tx=0x7fe3e401cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0db7756cd8746e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:48.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.644+0000 7fe3fa7fc640 1 -- 172.21.15.6:0/3404553699 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e40058e0 con 0x7fe3e80047d0 2023-07-21T22:31:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.644+0000 7fe3fa7fc640 1 -- 172.21.15.6:0/3404553699 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e4005a60 con 0x7fe3e80047d0 2023-07-21T22:31:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.644+0000 7fe3fa7fc640 1 -- 172.21.15.6:0/3404553699 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e4005e50 con 0x7fe3e80047d0 2023-07-21T22:31:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.644+0000 7fe401737640 1 -- 172.21.15.6:0/3404553699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3e80047d0 msgr2=0x7fe3e8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.644+0000 7fe401737640 1 --2- 172.21.15.6:0/3404553699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3e80047d0 0x7fe3e8004c40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4001ec0 tx=0x7fe3e401cb50 comp rx=0 tx=0).stop 2023-07-21T22:31:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.644+0000 7fe401737640 1 -- 172.21.15.6:0/3404553699 shutdown_connections 2023-07-21T22:31:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.644+0000 7fe401737640 1 --2- 172.21.15.6:0/3404553699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3e80047d0 0x7fe3e8004c40 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.644+0000 7fe401737640 1 -- 172.21.15.6:0/3404553699 >> 172.21.15.6:0/3404553699 conn(0x7fe3fc0afcf0 msgr2=0x7fe3fc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:48.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.644+0000 7fe401737640 1 -- 172.21.15.6:0/3404553699 shutdown_connections 2023-07-21T22:31:48.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.644+0000 7fe401737640 1 -- 172.21.15.6:0/3404553699 wait complete. 2023-07-21T22:31:48.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.644+0000 7fe401737640 1 Processor -- start 2023-07-21T22:31:48.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.644+0000 7fe401737640 1 -- start start 2023-07-21T22:31:48.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe401737640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3e80047d0 0x7fe3fc15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe401737640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3fc15ed50 0x7fe3fc0c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe401737640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3fc0ac890 0x7fe3fc0acd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe401737640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc15f1c0 con 0x7fe3e80047d0 2023-07-21T22:31:48.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe401737640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0ad240 con 0x7fe3fc0ac890 2023-07-21T22:31:48.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe401737640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc15de60 con 0x7fe3fc15ed50 2023-07-21T22:31:48.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe3faffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3e80047d0 0x7fe3fc15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe3faffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3e80047d0 0x7fe3fc15e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56420/0 (socket says 172.21.15.6:56420) 2023-07-21T22:31:48.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe3faffd640 1 -- 172.21.15.6:0/326367119 learned_addr learned my addr 172.21.15.6:0/326367119 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:48.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe3f3fff640 1 --2- 172.21.15.6:0/326367119 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3fc15ed50 0x7fe3fc0c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe3fb7fe640 1 --2- 172.21.15.6:0/326367119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3fc0ac890 0x7fe3fc0acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe3faffd640 1 -- 172.21.15.6:0/326367119 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3fc15ed50 msgr2=0x7fe3fc0c0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe3faffd640 1 --2- 172.21.15.6:0/326367119 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3fc15ed50 0x7fe3fc0c0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe3faffd640 1 -- 172.21.15.6:0/326367119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3fc0ac890 msgr2=0x7fe3fc0acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe3faffd640 1 --2- 172.21.15.6:0/326367119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3fc0ac890 0x7fe3fc0acd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe3faffd640 1 -- 172.21.15.6:0/326367119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc160340 con 0x7fe3e80047d0 2023-07-21T22:31:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe3f3fff640 1 --2- 172.21.15.6:0/326367119 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3fc15ed50 0x7fe3fc0c0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe3faffd640 1 --2- 172.21.15.6:0/326367119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3e80047d0 0x7fe3fc15e2f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec011830 tx=0x7fe3ec011860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe3f37fe640 1 -- 172.21.15.6:0/326367119 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec015870 con 0x7fe3e80047d0 2023-07-21T22:31:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe3f37fe640 1 -- 172.21.15.6:0/326367119 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec0159d0 con 0x7fe3e80047d0 2023-07-21T22:31:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe401737640 1 -- 172.21.15.6:0/326367119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3fc15cfb0 con 0x7fe3e80047d0 2023-07-21T22:31:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe3f37fe640 1 -- 172.21.15.6:0/326367119 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec015d40 con 0x7fe3e80047d0 2023-07-21T22:31:48.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe401737640 1 -- 172.21.15.6:0/326367119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3fc15d530 con 0x7fe3e80047d0 2023-07-21T22:31:48.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe401737640 1 -- 172.21.15.6:0/326367119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3fc0678d0 con 0x7fe3e80047d0 2023-07-21T22:31:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.648+0000 7fe3f37fe640 1 -- 172.21.15.6:0/326367119 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe3ec0143e0 con 0x7fe3e80047d0 2023-07-21T22:31:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.652+0000 7fe3f37fe640 1 --2- 172.21.15.6:0/326367119 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fe3dc0663a0 0x7fe3dc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.652+0000 7fe3f37fe640 1 -- 172.21.15.6:0/326367119 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7464+0+0 (secure 0 0 0) 0x7fe3ec0848c0 con 0x7fe3e80047d0 2023-07-21T22:31:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.652+0000 7fe3f3fff640 1 --2- 172.21.15.6:0/326367119 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fe3dc0663a0 0x7fe3dc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.652+0000 7fe3f3fff640 1 --2- 172.21.15.6:0/326367119 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fe3dc0663a0 0x7fe3dc068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40aa000 tx=0x7fe3e4001a00 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:48.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.656+0000 7fe3f37fe640 1 -- 172.21.15.6:0/326367119 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe3ec0516b0 con 0x7fe3e80047d0 2023-07-21T22:31:48.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.844+0000 7fe401737640 1 -- 172.21.15.6:0/326367119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe3fc0ab680 con 0x7fe3e80047d0 2023-07-21T22:31:48.893 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-07-21T22:31:48.844+0000 7f195e836640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-21T22:31:48.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.852+0000 7fe3f37fe640 1 -- 172.21.15.6:0/326367119 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe3ec054cd0 con 0x7fe3e80047d0 2023-07-21T22:31:48.901 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-21T22:31:48.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.856+0000 7fe401737640 1 -- 172.21.15.6:0/326367119 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fe3dc0663a0 msgr2=0x7fe3dc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.856+0000 7fe401737640 1 --2- 172.21.15.6:0/326367119 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fe3dc0663a0 0x7fe3dc068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40aa000 tx=0x7fe3e4001a00 comp rx=0 tx=0).stop 2023-07-21T22:31:48.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.856+0000 7fe401737640 1 -- 172.21.15.6:0/326367119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3e80047d0 msgr2=0x7fe3fc15e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.856+0000 7fe401737640 1 --2- 172.21.15.6:0/326367119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3e80047d0 0x7fe3fc15e2f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec011830 tx=0x7fe3ec011860 comp rx=0 tx=0).stop 2023-07-21T22:31:48.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.856+0000 7fe401737640 1 -- 172.21.15.6:0/326367119 shutdown_connections 2023-07-21T22:31:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.856+0000 7fe401737640 1 --2- 172.21.15.6:0/326367119 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fe3dc0663a0 0x7fe3dc068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.856+0000 7fe401737640 1 --2- 172.21.15.6:0/326367119 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3fc0ac890 0x7fe3fc0acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.856+0000 7fe401737640 1 --2- 172.21.15.6:0/326367119 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe3fc15ed50 0x7fe3fc0c0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.856+0000 7fe401737640 1 --2- 172.21.15.6:0/326367119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3e80047d0 0x7fe3fc15e2f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.856+0000 7fe401737640 1 -- 172.21.15.6:0/326367119 >> 172.21.15.6:0/326367119 conn(0x7fe3fc0afcf0 msgr2=0x7fe3fc15b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.856+0000 7fe401737640 1 -- 172.21.15.6:0/326367119 shutdown_connections 2023-07-21T22:31:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:48.856+0000 7fe401737640 1 -- 172.21.15.6:0/326367119 wait complete. 2023-07-21T22:31:48.925 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-21T22:31:48.966 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-07-21T22:31:49.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.024+0000 7f4867396640 1 Processor -- start 2023-07-21T22:31:49.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.024+0000 7f4867396640 1 -- start start 2023-07-21T22:31:49.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.028+0000 7f4867396640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f486015be20 0x7f486006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:49.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.028+0000 7f4867396640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f486015cca0 0x7f48600ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:49.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.028+0000 7f4867396640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48600ca910 0x7f48600cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:49.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.028+0000 7f4867396640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48600cb2d0 con 0x7f486015be20 2023-07-21T22:31:49.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.028+0000 7f4867396640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48600abd20 con 0x7f486015cca0 2023-07-21T22:31:49.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.028+0000 7f4867396640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486006ba80 con 0x7f48600ca910 2023-07-21T22:31:49.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.028+0000 7f4865132640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f486015be20 0x7f486006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:49.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.028+0000 7f4865132640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f486015be20 0x7f486006d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56448/0 (socket says 172.21.15.6:56448) 2023-07-21T22:31:49.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.028+0000 7f4865132640 1 -- 172.21.15.6:0/737356381 learned_addr learned my addr 172.21.15.6:0/737356381 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:49.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.028+0000 7f4865132640 1 -- 172.21.15.6:0/737356381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48600ca910 msgr2=0x7f48600cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:49.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.028+0000 7f4864931640 1 --2- 172.21.15.6:0/737356381 >> v2:172.21.15.161:3300/0 conn(0x7f486015cca0 0x7f48600ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:49.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.028+0000 7f4865933640 1 --2- 172.21.15.6:0/737356381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48600ca910 0x7f48600cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:49.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.028+0000 7f4865132640 1 --2- 172.21.15.6:0/737356381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48600ca910 0x7f48600cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:49.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.028+0000 7f4865132640 1 -- 172.21.15.6:0/737356381 >> v2:172.21.15.161:3300/0 conn(0x7f486015cca0 msgr2=0x7f48600ac1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:49.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.028+0000 7f4865132640 1 --2- 172.21.15.6:0/737356381 >> v2:172.21.15.161:3300/0 conn(0x7f486015cca0 0x7f48600ac1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:49.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.028+0000 7f4865132640 1 -- 172.21.15.6:0/737356381 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486006b4c0 con 0x7f486015be20 2023-07-21T22:31:49.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.028+0000 7f4864931640 1 --2- 172.21.15.6:0/737356381 >> v2:172.21.15.161:3300/0 conn(0x7f486015cca0 0x7f48600ac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:31:49.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.028+0000 7f4865933640 1 --2- 172.21.15.6:0/737356381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48600ca910 0x7f48600cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:31:49.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4865132640 1 --2- 172.21.15.6:0/737356381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f486015be20 0x7f486006d0f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f48600ca7e0 tx=0x7f485c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73236582e52f1f37 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:49.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4857fff640 1 -- 172.21.15.6:0/737356381 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c0ab600 con 0x7f486015be20 2023-07-21T22:31:49.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4857fff640 1 -- 172.21.15.6:0/737356381 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485c0ab760 con 0x7f486015be20 2023-07-21T22:31:49.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4857fff640 1 -- 172.21.15.6:0/737356381 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c0abaf0 con 0x7f486015be20 2023-07-21T22:31:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4867396640 1 -- 172.21.15.6:0/737356381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f486015be20 msgr2=0x7f486006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4867396640 1 --2- 172.21.15.6:0/737356381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f486015be20 0x7f486006d0f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f48600ca7e0 tx=0x7f485c01c440 comp rx=0 tx=0).stop 2023-07-21T22:31:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4867396640 1 -- 172.21.15.6:0/737356381 shutdown_connections 2023-07-21T22:31:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4867396640 1 --2- 172.21.15.6:0/737356381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48600ca910 0x7f48600cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4867396640 1 --2- 172.21.15.6:0/737356381 >> v2:172.21.15.161:3300/0 conn(0x7f486015cca0 0x7f48600ac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:49.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4867396640 1 --2- 172.21.15.6:0/737356381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f486015be20 0x7f486006d0f0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:49.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4867396640 1 -- 172.21.15.6:0/737356381 >> 172.21.15.6:0/737356381 conn(0x7f48600afac0 msgr2=0x7f48600afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:49.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4867396640 1 -- 172.21.15.6:0/737356381 shutdown_connections 2023-07-21T22:31:49.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4867396640 1 -- 172.21.15.6:0/737356381 wait complete. 2023-07-21T22:31:49.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4867396640 1 Processor -- start 2023-07-21T22:31:49.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4867396640 1 -- start start 2023-07-21T22:31:49.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4867396640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48600ca910 0x7f48600c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:49.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4867396640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f486015be20 0x7f48600afe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:49.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4867396640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f486015cca0 0x7f48600b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:49.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4867396640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4860147e60 con 0x7f48600ca910 2023-07-21T22:31:49.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4867396640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48601503e0 con 0x7f486015cca0 2023-07-21T22:31:49.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.032+0000 7f4867396640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48600c8720 con 0x7f486015be20 2023-07-21T22:31:49.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.036+0000 7f4865132640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48600ca910 0x7f48600c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:49.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.036+0000 7f4865132640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48600ca910 0x7f48600c1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56452/0 (socket says 172.21.15.6:56452) 2023-07-21T22:31:49.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.036+0000 7f4865132640 1 -- 172.21.15.6:0/500718653 learned_addr learned my addr 172.21.15.6:0/500718653 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:49.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.036+0000 7f4864931640 1 --2- 172.21.15.6:0/500718653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f486015be20 0x7f48600afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:49.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.036+0000 7f4865933640 1 --2- 172.21.15.6:0/500718653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f486015cca0 0x7f48600b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:49.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.036+0000 7f4865132640 1 -- 172.21.15.6:0/500718653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f486015be20 msgr2=0x7f48600afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:49.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.036+0000 7f4865132640 1 --2- 172.21.15.6:0/500718653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f486015be20 0x7f48600afe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:49.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.036+0000 7f4865132640 1 -- 172.21.15.6:0/500718653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f486015cca0 msgr2=0x7f48600b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:49.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.036+0000 7f4865132640 1 --2- 172.21.15.6:0/500718653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f486015cca0 0x7f48600b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:49.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.036+0000 7f4865132640 1 -- 172.21.15.6:0/500718653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c0094d0 con 0x7f48600ca910 2023-07-21T22:31:49.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.036+0000 7f4864931640 1 --2- 172.21.15.6:0/500718653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f486015be20 0x7f48600afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:49.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.036+0000 7f4865132640 1 --2- 172.21.15.6:0/500718653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48600ca910 0x7f48600c1a10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f485c01aaf0 tx=0x7f485c01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:49.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.036+0000 7f4855ffb640 1 -- 172.21.15.6:0/500718653 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c0b4800 con 0x7f48600ca910 2023-07-21T22:31:49.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.036+0000 7f4855ffb640 1 -- 172.21.15.6:0/500718653 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485c0b4980 con 0x7f48600ca910 2023-07-21T22:31:49.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.036+0000 7f4855ffb640 1 -- 172.21.15.6:0/500718653 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c0b4d30 con 0x7f48600ca910 2023-07-21T22:31:49.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.036+0000 7f4867396640 1 -- 172.21.15.6:0/500718653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48600ac870 con 0x7f48600ca910 2023-07-21T22:31:49.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.036+0000 7f4867396640 1 -- 172.21.15.6:0/500718653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48600c8ce0 con 0x7f48600ca910 2023-07-21T22:31:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.036+0000 7f4867396640 1 -- 172.21.15.6:0/500718653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48600678d0 con 0x7f48600ca910 2023-07-21T22:31:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.036+0000 7f4855ffb640 1 -- 172.21.15.6:0/500718653 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f485c0c7440 con 0x7f48600ca910 2023-07-21T22:31:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.040+0000 7f4855ffb640 1 --2- 172.21.15.6:0/500718653 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f48440663d0 0x7f4844068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.040+0000 7f4855ffb640 1 -- 172.21.15.6:0/500718653 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6866+0+0 (secure 0 0 0) 0x7f485c11ee40 con 0x7f48600ca910 2023-07-21T22:31:49.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.040+0000 7f4864931640 1 --2- 172.21.15.6:0/500718653 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f48440663d0 0x7f4844068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:49.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.040+0000 7f4864931640 1 --2- 172.21.15.6:0/500718653 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f48440663d0 0x7f4844068880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f48600ca8a0 tx=0x7f4850008040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:49.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.040+0000 7f4855ffb640 1 -- 172.21.15.6:0/500718653 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f485c0ebd60 con 0x7f48600ca910 2023-07-21T22:31:49.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.232+0000 7f4867396640 1 -- 172.21.15.6:0/500718653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f48600acca0 con 0x7f48600ca910 2023-07-21T22:31:49.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.868+0000 7f4855ffb640 1 -- 172.21.15.6:0/500718653 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f485c0ef380 con 0x7f48600ca910 2023-07-21T22:31:49.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.872+0000 7f4867396640 1 -- 172.21.15.6:0/500718653 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f48440663d0 msgr2=0x7f4844068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:49.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.872+0000 7f4867396640 1 --2- 172.21.15.6:0/500718653 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f48440663d0 0x7f4844068880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f48600ca8a0 tx=0x7f4850008040 comp rx=0 tx=0).stop 2023-07-21T22:31:49.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.872+0000 7f4867396640 1 -- 172.21.15.6:0/500718653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48600ca910 msgr2=0x7f48600c1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:49.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.872+0000 7f4867396640 1 --2- 172.21.15.6:0/500718653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48600ca910 0x7f48600c1a10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f485c01aaf0 tx=0x7f485c01ac80 comp rx=0 tx=0).stop 2023-07-21T22:31:49.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.872+0000 7f4867396640 1 -- 172.21.15.6:0/500718653 shutdown_connections 2023-07-21T22:31:49.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.872+0000 7f4867396640 1 --2- 172.21.15.6:0/500718653 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f48440663d0 0x7f4844068880 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:49.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.872+0000 7f4867396640 1 --2- 172.21.15.6:0/500718653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f486015cca0 0x7f48600b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:49.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.872+0000 7f4867396640 1 --2- 172.21.15.6:0/500718653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f486015be20 0x7f48600afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:49.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.872+0000 7f4867396640 1 --2- 172.21.15.6:0/500718653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48600ca910 0x7f48600c1a10 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:49.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.872+0000 7f4867396640 1 -- 172.21.15.6:0/500718653 >> 172.21.15.6:0/500718653 conn(0x7f48600afac0 msgr2=0x7f48600af340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:49.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.872+0000 7f4867396640 1 -- 172.21.15.6:0/500718653 shutdown_connections 2023-07-21T22:31:49.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:49.872+0000 7f4867396640 1 -- 172.21.15.6:0/500718653 wait complete. 2023-07-21T22:31:49.943 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-21T22:31:50.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.092+0000 7f80ec9c5640 1 Processor -- start 2023-07-21T22:31:50.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.092+0000 7f80ec9c5640 1 -- start start 2023-07-21T22:31:50.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.092+0000 7f80ec9c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80e815bba0 0x7f80e80c4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:50.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.092+0000 7f80ec9c5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f80e80c2d30 0x7f80e80acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:50.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.092+0000 7f80ec9c5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e815bf70 con 0x7f80e80ad280 2023-07-21T22:31:50.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.092+0000 7f80ec9c5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e80ad700 con 0x7f80e80c2d30 2023-07-21T22:31:50.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.092+0000 7f80ec9c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e81600e0 con 0x7f80e815bba0 2023-07-21T22:31:50.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.092+0000 7f80dffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f80e80c2d30 0x7f80e80acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:50.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.092+0000 7f80dffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f80e80c2d30 0x7f80e80acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56464/0 (socket says 172.21.15.6:56464) 2023-07-21T22:31:50.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.092+0000 7f80dffff640 1 -- 172.21.15.6:0/4187140605 learned_addr learned my addr 172.21.15.6:0/4187140605 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:50.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.092+0000 7f80e659c640 1 --2- 172.21.15.6:0/4187140605 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80e815bba0 0x7f80e80c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:50.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.092+0000 7f80dffff640 1 -- 172.21.15.6:0/4187140605 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80e815bba0 msgr2=0x7f80e80c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:50.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.092+0000 7f80dffff640 1 --2- 172.21.15.6:0/4187140605 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80e815bba0 0x7f80e80c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:50.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.092+0000 7f80dffff640 1 -- 172.21.15.6:0/4187140605 >> v1:172.21.15.161:6789/0 conn(0x7f80e80ad280 legacy=0x7f80e80ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:50.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.092+0000 7f80dffff640 1 -- 172.21.15.6:0/4187140605 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e80c4d00 con 0x7f80e80c2d30 2023-07-21T22:31:50.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.092+0000 7f80e5d9b640 1 -- 172.21.15.6:0/4187140605 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2647128634 0 0) 0x7f80e815bf70 con 0x7f80e80ad280 2023-07-21T22:31:50.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.096+0000 7f80dffff640 1 --2- 172.21.15.6:0/4187140605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80e80c2d30 0x7f80e80acd40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009870 tx=0x7f80d001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c786cc45a8a924 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:50.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.096+0000 7f80e5d9b640 1 -- 172.21.15.6:0/4187140605 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d00ab600 con 0x7f80e80c2d30 2023-07-21T22:31:50.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.096+0000 7f80e5d9b640 1 -- 172.21.15.6:0/4187140605 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d00a7050 con 0x7f80e80c2d30 2023-07-21T22:31:50.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.096+0000 7f80e5d9b640 1 -- 172.21.15.6:0/4187140605 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d00ab980 con 0x7f80e80c2d30 2023-07-21T22:31:50.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.096+0000 7f80ec9c5640 1 -- 172.21.15.6:0/4187140605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80e80c2d30 msgr2=0x7f80e80acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:50.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.096+0000 7f80ec9c5640 1 --2- 172.21.15.6:0/4187140605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80e80c2d30 0x7f80e80acd40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009870 tx=0x7f80d001c420 comp rx=0 tx=0).stop 2023-07-21T22:31:50.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.096+0000 7f80ec9c5640 1 -- 172.21.15.6:0/4187140605 shutdown_connections 2023-07-21T22:31:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.096+0000 7f80ec9c5640 1 --2- 172.21.15.6:0/4187140605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80e80c2d30 0x7f80e80acd40 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.096+0000 7f80ec9c5640 1 --2- 172.21.15.6:0/4187140605 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80e815bba0 0x7f80e80c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.096+0000 7f80ec9c5640 1 -- 172.21.15.6:0/4187140605 >> 172.21.15.6:0/4187140605 conn(0x7f80e80cde90 msgr2=0x7f80e80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.096+0000 7f80ec9c5640 1 -- 172.21.15.6:0/4187140605 shutdown_connections 2023-07-21T22:31:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.096+0000 7f80ec9c5640 1 -- 172.21.15.6:0/4187140605 wait complete. 2023-07-21T22:31:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80ec9c5640 1 Processor -- start 2023-07-21T22:31:50.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80ec9c5640 1 -- start start 2023-07-21T22:31:50.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80ec9c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80e80ad280 0x7f80e80b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:50.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80ec9c5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80e80c2d30 0x7f80e8159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:50.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80ec9c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80e815bba0 0x7f80e8154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:50.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80ec9c5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e81527e0 con 0x7f80e815bba0 2023-07-21T22:31:50.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80ec9c5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e815a020 con 0x7f80e80c2d30 2023-07-21T22:31:50.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80ec9c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e8158e50 con 0x7f80e80ad280 2023-07-21T22:31:50.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80e6d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80e815bba0 0x7f80e8154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:50.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80e659c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80e80ad280 0x7f80e80b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:50.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80e6d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80e815bba0 0x7f80e8154750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56478/0 (socket says 172.21.15.6:56478) 2023-07-21T22:31:50.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80e6d9d640 1 -- 172.21.15.6:0/1299813478 learned_addr learned my addr 172.21.15.6:0/1299813478 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:50.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80dffff640 1 --2- 172.21.15.6:0/1299813478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80e80c2d30 0x7f80e8159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:50.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80e6d9d640 1 -- 172.21.15.6:0/1299813478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80e80ad280 msgr2=0x7f80e80b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:50.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80e6d9d640 1 --2- 172.21.15.6:0/1299813478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80e80ad280 0x7f80e80b2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:50.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80e6d9d640 1 -- 172.21.15.6:0/1299813478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80e80c2d30 msgr2=0x7f80e8159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:50.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80e6d9d640 1 --2- 172.21.15.6:0/1299813478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80e80c2d30 0x7f80e8159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:50.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80e6d9d640 1 -- 172.21.15.6:0/1299813478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d00094d0 con 0x7f80e815bba0 2023-07-21T22:31:50.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80e659c640 1 --2- 172.21.15.6:0/1299813478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80e80ad280 0x7f80e80b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:50.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80e6d9d640 1 --2- 172.21.15.6:0/1299813478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80e815bba0 0x7f80e8154750 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f80e000c780 tx=0x7f80e000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:50.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80deffd640 1 -- 172.21.15.6:0/1299813478 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0003db0 con 0x7f80e815bba0 2023-07-21T22:31:50.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80deffd640 1 -- 172.21.15.6:0/1299813478 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e000ce30 con 0x7f80e815bba0 2023-07-21T22:31:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80ec9c5640 1 -- 172.21.15.6:0/1299813478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e8159130 con 0x7f80e815bba0 2023-07-21T22:31:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80deffd640 1 -- 172.21.15.6:0/1299813478 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e00052b0 con 0x7f80e815bba0 2023-07-21T22:31:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.100+0000 7f80ec9c5640 1 -- 172.21.15.6:0/1299813478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e81596f0 con 0x7f80e815bba0 2023-07-21T22:31:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.104+0000 7f80ec9c5640 1 -- 172.21.15.6:0/1299813478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e8152990 con 0x7f80e815bba0 2023-07-21T22:31:50.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.104+0000 7f80deffd640 1 -- 172.21.15.6:0/1299813478 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f80e0005410 con 0x7f80e815bba0 2023-07-21T22:31:50.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.104+0000 7f80deffd640 1 --2- 172.21.15.6:0/1299813478 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f80c80663d0 0x7f80c8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:50.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.104+0000 7f80deffd640 1 -- 172.21.15.6:0/1299813478 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6866+0+0 (secure 0 0 0) 0x7f80e0083e80 con 0x7f80e815bba0 2023-07-21T22:31:50.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.104+0000 7f80e659c640 1 --2- 172.21.15.6:0/1299813478 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f80c80663d0 0x7f80c8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:50.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.104+0000 7f80e659c640 1 --2- 172.21.15.6:0/1299813478 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f80c80663d0 0x7f80c8068880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009f50 tx=0x7f80d8009190 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:50.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.108+0000 7f80deffd640 1 -- 172.21.15.6:0/1299813478 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f80e8152990 con 0x7f80e815bba0 2023-07-21T22:31:50.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.264+0000 7f80ec9c5640 1 -- 172.21.15.6:0/1299813478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f80e8152990 con 0x7f80e815bba0 2023-07-21T22:31:50.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.872+0000 7f80deffd640 1 -- 172.21.15.6:0/1299813478 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v57) v1 ==== 181+0+0 (secure 0 0 0) 0x7f80e8152990 con 0x7f80e815bba0 2023-07-21T22:31:50.920 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-07-21T22:31:50.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.876+0000 7f80ec9c5640 1 -- 172.21.15.6:0/1299813478 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f80c80663d0 msgr2=0x7f80c8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:50.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.876+0000 7f80ec9c5640 1 --2- 172.21.15.6:0/1299813478 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f80c80663d0 0x7f80c8068880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009f50 tx=0x7f80d8009190 comp rx=0 tx=0).stop 2023-07-21T22:31:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.876+0000 7f80ec9c5640 1 -- 172.21.15.6:0/1299813478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80e815bba0 msgr2=0x7f80e8154750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.876+0000 7f80ec9c5640 1 --2- 172.21.15.6:0/1299813478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80e815bba0 0x7f80e8154750 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f80e000c780 tx=0x7f80e000cc40 comp rx=0 tx=0).stop 2023-07-21T22:31:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.876+0000 7f80ec9c5640 1 -- 172.21.15.6:0/1299813478 shutdown_connections 2023-07-21T22:31:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.876+0000 7f80ec9c5640 1 --2- 172.21.15.6:0/1299813478 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f80c80663d0 0x7f80c8068880 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.876+0000 7f80ec9c5640 1 --2- 172.21.15.6:0/1299813478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80e815bba0 0x7f80e8154750 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.876+0000 7f80ec9c5640 1 --2- 172.21.15.6:0/1299813478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80e80c2d30 0x7f80e8159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.876+0000 7f80ec9c5640 1 --2- 172.21.15.6:0/1299813478 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80e80ad280 0x7f80e80b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:50.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.876+0000 7f80ec9c5640 1 -- 172.21.15.6:0/1299813478 >> 172.21.15.6:0/1299813478 conn(0x7f80e80cde90 msgr2=0x7f80e8069430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:50.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.876+0000 7f80ec9c5640 1 -- 172.21.15.6:0/1299813478 shutdown_connections 2023-07-21T22:31:50.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:50.876+0000 7f80ec9c5640 1 -- 172.21.15.6:0/1299813478 wait complete. 2023-07-21T22:31:50.949 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-21T22:31:51.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.052+0000 7f2579196640 1 Processor -- start 2023-07-21T22:31:51.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.052+0000 7f2579196640 1 -- start start 2023-07-21T22:31:51.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.052+0000 7f2579196640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f257415bde0 0x7f25740d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:51.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.052+0000 7f2579196640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f25740d2fc0 0x7f25740b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:51.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.052+0000 7f2579196640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25740d2300 0x7f25740d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:51.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.052+0000 7f2579196640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257415c1b0 con 0x7f25740d2fc0 2023-07-21T22:31:51.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.052+0000 7f2579196640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25740d2cc0 con 0x7f257415bde0 2023-07-21T22:31:51.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.052+0000 7f2579196640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25740b04c0 con 0x7f25740d2300 2023-07-21T22:31:51.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.052+0000 7f256bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f25740d2fc0 0x7f25740b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:51.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.052+0000 7f256bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f25740d2fc0 0x7f25740b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56486/0 (socket says 172.21.15.6:56486) 2023-07-21T22:31:51.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.052+0000 7f256bfff640 1 -- 172.21.15.6:0/3317167939 learned_addr learned my addr 172.21.15.6:0/3317167939 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:51.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.052+0000 7f257359e640 1 --2- 172.21.15.6:0/3317167939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25740d2300 0x7f25740d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:51.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.052+0000 7f2572d9d640 1 --2- 172.21.15.6:0/3317167939 >> v2:172.21.15.161:3300/0 conn(0x7f257415bde0 0x7f25740d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:51.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.052+0000 7f256bfff640 1 -- 172.21.15.6:0/3317167939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25740d2300 msgr2=0x7f25740d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:51.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.052+0000 7f256bfff640 1 --2- 172.21.15.6:0/3317167939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25740d2300 0x7f25740d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:51.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.052+0000 7f256bfff640 1 -- 172.21.15.6:0/3317167939 >> v2:172.21.15.161:3300/0 conn(0x7f257415bde0 msgr2=0x7f25740d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:51.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.052+0000 7f256bfff640 1 --2- 172.21.15.6:0/3317167939 >> v2:172.21.15.161:3300/0 conn(0x7f257415bde0 0x7f25740d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:51.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.052+0000 7f256bfff640 1 -- 172.21.15.6:0/3317167939 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25740d0aa0 con 0x7f25740d2fc0 2023-07-21T22:31:51.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.056+0000 7f256bfff640 1 --2- 172.21.15.6:0/3317167939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25740d2fc0 0x7f25740b0950 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f257408b210 tx=0x7f255c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7d0f727111803a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:51.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.056+0000 7f257259c640 1 -- 172.21.15.6:0/3317167939 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c0aa620 con 0x7f25740d2fc0 2023-07-21T22:31:51.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.056+0000 7f257259c640 1 -- 172.21.15.6:0/3317167939 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255c0aa780 con 0x7f25740d2fc0 2023-07-21T22:31:51.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.056+0000 7f257259c640 1 -- 172.21.15.6:0/3317167939 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c0aab10 con 0x7f25740d2fc0 2023-07-21T22:31:51.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.056+0000 7f2579196640 1 -- 172.21.15.6:0/3317167939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25740d2fc0 msgr2=0x7f25740b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:51.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.056+0000 7f2579196640 1 --2- 172.21.15.6:0/3317167939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25740d2fc0 0x7f25740b0950 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f257408b210 tx=0x7f255c01c500 comp rx=0 tx=0).stop 2023-07-21T22:31:51.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.056+0000 7f2579196640 1 -- 172.21.15.6:0/3317167939 shutdown_connections 2023-07-21T22:31:51.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.056+0000 7f2579196640 1 --2- 172.21.15.6:0/3317167939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25740d2300 0x7f25740d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:51.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.056+0000 7f2579196640 1 --2- 172.21.15.6:0/3317167939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25740d2fc0 0x7f25740b0950 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:51.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.056+0000 7f2579196640 1 --2- 172.21.15.6:0/3317167939 >> v2:172.21.15.161:3300/0 conn(0x7f257415bde0 0x7f25740d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:51.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.056+0000 7f2579196640 1 -- 172.21.15.6:0/3317167939 >> 172.21.15.6:0/3317167939 conn(0x7f25740659d0 msgr2=0x7f257409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:51.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.056+0000 7f2579196640 1 -- 172.21.15.6:0/3317167939 shutdown_connections 2023-07-21T22:31:51.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.056+0000 7f2579196640 1 -- 172.21.15.6:0/3317167939 wait complete. 2023-07-21T22:31:51.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f2579196640 1 Processor -- start 2023-07-21T22:31:51.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f2579196640 1 -- start start 2023-07-21T22:31:51.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f2579196640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25740d2300 0x7f257414dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:51.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f2579196640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25740d2fc0 0x7f2574158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:51.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f2579196640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f257415bde0 0x7f25741589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:51.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f2579196640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25740c5390 con 0x7f25740d2300 2023-07-21T22:31:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f2579196640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25740c4a60 con 0x7f257415bde0 2023-07-21T22:31:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f2579196640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25740c4d40 con 0x7f25740d2fc0 2023-07-21T22:31:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f2572d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25740d2300 0x7f257414dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f2572d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25740d2300 0x7f257414dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56488/0 (socket says 172.21.15.6:56488) 2023-07-21T22:31:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f2572d9d640 1 -- 172.21.15.6:0/2217941419 learned_addr learned my addr 172.21.15.6:0/2217941419 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f2572d9d640 1 -- 172.21.15.6:0/2217941419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25740d2fc0 msgr2=0x7f2574158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f2572d9d640 1 --2- 172.21.15.6:0/2217941419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25740d2fc0 0x7f2574158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f2572d9d640 1 -- 172.21.15.6:0/2217941419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f257415bde0 msgr2=0x7f25741589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f257359e640 1 --2- 172.21.15.6:0/2217941419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f257415bde0 0x7f25741589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f2572d9d640 1 --2- 172.21.15.6:0/2217941419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f257415bde0 0x7f25741589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f2572d9d640 1 -- 172.21.15.6:0/2217941419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c0094d0 con 0x7f25740d2300 2023-07-21T22:31:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f257359e640 1 --2- 172.21.15.6:0/2217941419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f257415bde0 0x7f25741589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:31:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f2572d9d640 1 --2- 172.21.15.6:0/2217941419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25740d2300 0x7f257414dc30 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f256400e9b0 tx=0x7f256400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f256b7fe640 1 -- 172.21.15.6:0/2217941419 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2564009670 con 0x7f25740d2300 2023-07-21T22:31:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f256b7fe640 1 -- 172.21.15.6:0/2217941419 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256400c9a0 con 0x7f25740d2300 2023-07-21T22:31:51.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f256b7fe640 1 -- 172.21.15.6:0/2217941419 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256400cd10 con 0x7f25740d2300 2023-07-21T22:31:51.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f2579196640 1 -- 172.21.15.6:0/2217941419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25740c5020 con 0x7f25740d2300 2023-07-21T22:31:51.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.060+0000 7f2579196640 1 -- 172.21.15.6:0/2217941419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25740c7c30 con 0x7f25740d2300 2023-07-21T22:31:51.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.064+0000 7f2579196640 1 -- 172.21.15.6:0/2217941419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25740c7e80 con 0x7f25740d2300 2023-07-21T22:31:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.064+0000 7f256b7fe640 1 -- 172.21.15.6:0/2217941419 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2564013470 con 0x7f25740d2300 2023-07-21T22:31:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.064+0000 7f256b7fe640 1 --2- 172.21.15.6:0/2217941419 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f25540663d0 0x7f2554068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.064+0000 7f256b7fe640 1 -- 172.21.15.6:0/2217941419 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f2564084600 con 0x7f25740d2300 2023-07-21T22:31:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.064+0000 7f256bfff640 1 --2- 172.21.15.6:0/2217941419 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f25540663d0 0x7f2554068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.064+0000 7f256bfff640 1 --2- 172.21.15.6:0/2217941419 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f25540663d0 0x7f2554068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f255c0ae000 tx=0x7f255c008040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:51.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.068+0000 7f256b7fe640 1 -- 172.21.15.6:0/2217941419 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2564051800 con 0x7f25740d2300 2023-07-21T22:31:51.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.224+0000 7f2579196640 1 -- 172.21.15.6:0/2217941419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f25740678d0 con 0x7f25740d2300 2023-07-21T22:31:51.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.888+0000 7f256b7fe640 1 -- 172.21.15.6:0/2217941419 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v58) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2564054e20 con 0x7f25740d2300 2023-07-21T22:31:51.936 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-07-21T22:31:51.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.892+0000 7f2579196640 1 -- 172.21.15.6:0/2217941419 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f25540663d0 msgr2=0x7f2554068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:51.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.892+0000 7f2579196640 1 --2- 172.21.15.6:0/2217941419 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f25540663d0 0x7f2554068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f255c0ae000 tx=0x7f255c008040 comp rx=0 tx=0).stop 2023-07-21T22:31:51.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.892+0000 7f2579196640 1 -- 172.21.15.6:0/2217941419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25740d2300 msgr2=0x7f257414dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:51.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.892+0000 7f2579196640 1 --2- 172.21.15.6:0/2217941419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25740d2300 0x7f257414dc30 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f256400e9b0 tx=0x7f256400ee70 comp rx=0 tx=0).stop 2023-07-21T22:31:51.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.892+0000 7f2579196640 1 -- 172.21.15.6:0/2217941419 shutdown_connections 2023-07-21T22:31:51.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.892+0000 7f2579196640 1 --2- 172.21.15.6:0/2217941419 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f25540663d0 0x7f2554068880 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:51.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.892+0000 7f2579196640 1 --2- 172.21.15.6:0/2217941419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f257415bde0 0x7f25741589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:51.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.892+0000 7f2579196640 1 --2- 172.21.15.6:0/2217941419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25740d2fc0 0x7f2574158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:51.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.892+0000 7f2579196640 1 --2- 172.21.15.6:0/2217941419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25740d2300 0x7f257414dc30 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:51.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.892+0000 7f2579196640 1 -- 172.21.15.6:0/2217941419 >> 172.21.15.6:0/2217941419 conn(0x7f25740659d0 msgr2=0x7f257415ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:51.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.892+0000 7f2579196640 1 -- 172.21.15.6:0/2217941419 shutdown_connections 2023-07-21T22:31:51.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:51.892+0000 7f2579196640 1 -- 172.21.15.6:0/2217941419 wait complete. 2023-07-21T22:31:51.963 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-21T22:31:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.060+0000 7eff75dd2640 1 Processor -- start 2023-07-21T22:31:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.060+0000 7eff75dd2640 1 -- start start 2023-07-21T22:31:52.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.064+0000 7eff75dd2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7eff7006cf10 0x7eff7015c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:52.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.064+0000 7eff75dd2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff701586e0 con 0x7eff700cc000 2023-07-21T22:31:52.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.064+0000 7eff75dd2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff701560a0 con 0x7eff700c85a0 2023-07-21T22:31:52.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.064+0000 7eff75dd2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff701595a0 con 0x7eff7006cf10 2023-07-21T22:31:52.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.064+0000 7eff6ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7eff700cc000 0x7eff700cc460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39406/0 (socket says 172.21.15.6:39406) 2023-07-21T22:31:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.064+0000 7eff6ffff640 1 -- 172.21.15.6:0/1401053710 learned_addr learned my addr 172.21.15.6:0/1401053710 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.064+0000 7eff6effd640 1 --2- 172.21.15.6:0/1401053710 >> v2:172.21.15.161:3300/0 conn(0x7eff7006cf10 0x7eff7015c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.064+0000 7eff6e7fc640 1 -- 172.21.15.6:0/1401053710 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597880581 0 0) 0x7eff680014a0 con 0x7eff700cc000 2023-07-21T22:31:52.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.064+0000 7eff6e7fc640 1 -- 172.21.15.6:0/1401053710 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff58003450 con 0x7eff700cc000 2023-07-21T22:31:52.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.064+0000 7eff6effd640 1 -- 172.21.15.6:0/1401053710 >> v1:172.21.15.161:6789/0 conn(0x7eff700c85a0 legacy=0x7eff700c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:52.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.064+0000 7eff6effd640 1 -- 172.21.15.6:0/1401053710 >> v1:172.21.15.6:6789/0 conn(0x7eff700cc000 legacy=0x7eff700cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:52.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.064+0000 7eff6effd640 1 -- 172.21.15.6:0/1401053710 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff70158920 con 0x7eff7006cf10 2023-07-21T22:31:52.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.068+0000 7eff6effd640 1 --2- 172.21.15.6:0/1401053710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff7006cf10 0x7eff7015c730 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7eff640097c0 tx=0x7eff6401c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4dad51dc252bb60 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:52.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.068+0000 7eff6e7fc640 1 -- 172.21.15.6:0/1401053710 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff640ab600 con 0x7eff7006cf10 2023-07-21T22:31:52.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.068+0000 7eff6e7fc640 1 -- 172.21.15.6:0/1401053710 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff640a7050 con 0x7eff7006cf10 2023-07-21T22:31:52.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.068+0000 7eff6e7fc640 1 -- 172.21.15.6:0/1401053710 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff640ab980 con 0x7eff7006cf10 2023-07-21T22:31:52.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.068+0000 7eff75dd2640 1 -- 172.21.15.6:0/1401053710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff7006cf10 msgr2=0x7eff7015c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:52.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.068+0000 7eff75dd2640 1 --2- 172.21.15.6:0/1401053710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff7006cf10 0x7eff7015c730 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7eff640097c0 tx=0x7eff6401c360 comp rx=0 tx=0).stop 2023-07-21T22:31:52.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.068+0000 7eff75dd2640 1 -- 172.21.15.6:0/1401053710 shutdown_connections 2023-07-21T22:31:52.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.068+0000 7eff75dd2640 1 --2- 172.21.15.6:0/1401053710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff7006cf10 0x7eff7015c730 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.068+0000 7eff75dd2640 1 -- 172.21.15.6:0/1401053710 >> 172.21.15.6:0/1401053710 conn(0x7eff700afac0 msgr2=0x7eff700afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.068+0000 7eff75dd2640 1 -- 172.21.15.6:0/1401053710 shutdown_connections 2023-07-21T22:31:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.068+0000 7eff75dd2640 1 -- 172.21.15.6:0/1401053710 wait complete. 2023-07-21T22:31:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.068+0000 7eff75dd2640 1 Processor -- start 2023-07-21T22:31:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.068+0000 7eff75dd2640 1 -- start start 2023-07-21T22:31:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff75dd2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff7006cf10 0x7eff700b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:52.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff75dd2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff700c85a0 0x7eff70154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:52.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff75dd2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff700cc000 0x7eff70152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:52.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff75dd2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff700b23a0 con 0x7eff700c85a0 2023-07-21T22:31:52.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff75dd2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff700b1610 con 0x7eff7006cf10 2023-07-21T22:31:52.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff75dd2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff700b18f0 con 0x7eff700cc000 2023-07-21T22:31:52.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff6effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff700c85a0 0x7eff70154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:52.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff6effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff700c85a0 0x7eff70154860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56500/0 (socket says 172.21.15.6:56500) 2023-07-21T22:31:52.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff6effd640 1 -- 172.21.15.6:0/1024856535 learned_addr learned my addr 172.21.15.6:0/1024856535 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:52.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff6ffff640 1 --2- 172.21.15.6:0/1024856535 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff700cc000 0x7eff70152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:52.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff6f7fe640 1 --2- 172.21.15.6:0/1024856535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff7006cf10 0x7eff700b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff6effd640 1 -- 172.21.15.6:0/1024856535 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff700cc000 msgr2=0x7eff70152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff6effd640 1 --2- 172.21.15.6:0/1024856535 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff700cc000 0x7eff70152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff6effd640 1 -- 172.21.15.6:0/1024856535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff7006cf10 msgr2=0x7eff700b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:52.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff6effd640 1 --2- 172.21.15.6:0/1024856535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff7006cf10 0x7eff700b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff6effd640 1 -- 172.21.15.6:0/1024856535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff64009420 con 0x7eff700c85a0 2023-07-21T22:31:52.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff6f7fe640 1 --2- 172.21.15.6:0/1024856535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff7006cf10 0x7eff700b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:52.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff6effd640 1 --2- 172.21.15.6:0/1024856535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff700c85a0 0x7eff70154860 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7eff640ae040 tx=0x7eff64019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:52.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff57fff640 1 -- 172.21.15.6:0/1024856535 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff640b4430 con 0x7eff700c85a0 2023-07-21T22:31:52.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff57fff640 1 -- 172.21.15.6:0/1024856535 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff640b4590 con 0x7eff700c85a0 2023-07-21T22:31:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff75dd2640 1 -- 172.21.15.6:0/1024856535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff700b1bd0 con 0x7eff700c85a0 2023-07-21T22:31:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff57fff640 1 -- 172.21.15.6:0/1024856535 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff640b4940 con 0x7eff700c85a0 2023-07-21T22:31:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff75dd2640 1 -- 172.21.15.6:0/1024856535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff70154da0 con 0x7eff700c85a0 2023-07-21T22:31:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.072+0000 7eff75dd2640 1 -- 172.21.15.6:0/1024856535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff700b2200 con 0x7eff700c85a0 2023-07-21T22:31:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.076+0000 7eff57fff640 1 -- 172.21.15.6:0/1024856535 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7eff640b2040 con 0x7eff700c85a0 2023-07-21T22:31:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.076+0000 7eff57fff640 1 --2- 172.21.15.6:0/1024856535 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7eff5c0663a0 0x7eff5c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.076+0000 7eff57fff640 1 -- 172.21.15.6:0/1024856535 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5985+0+0 (secure 0 0 0) 0x7eff6411de30 con 0x7eff700c85a0 2023-07-21T22:31:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.076+0000 7eff6f7fe640 1 --2- 172.21.15.6:0/1024856535 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7eff5c0663a0 0x7eff5c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:52.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.076+0000 7eff6f7fe640 1 --2- 172.21.15.6:0/1024856535 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7eff5c0663a0 0x7eff5c068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7eff60000f70 tx=0x7eff60009040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:52.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.080+0000 7eff57fff640 1 -- 172.21.15.6:0/1024856535 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7eff700b2200 con 0x7eff700c85a0 2023-07-21T22:31:52.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.236+0000 7eff75dd2640 1 -- 172.21.15.6:0/1024856535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7eff700b1a30 con 0x7eff700c85a0 2023-07-21T22:31:52.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.240+0000 7eff57fff640 1 -- 172.21.15.6:0/1024856535 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v13) v1 ==== 115+0+0 (secure 0 0 0) 0x7eff700b1a30 con 0x7eff700c85a0 2023-07-21T22:31:52.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.244+0000 7eff75dd2640 1 -- 172.21.15.6:0/1024856535 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7eff5c0663a0 msgr2=0x7eff5c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:52.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.244+0000 7eff75dd2640 1 --2- 172.21.15.6:0/1024856535 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7eff5c0663a0 0x7eff5c068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7eff60000f70 tx=0x7eff60009040 comp rx=0 tx=0).stop 2023-07-21T22:31:52.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.244+0000 7eff75dd2640 1 -- 172.21.15.6:0/1024856535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff700c85a0 msgr2=0x7eff70154860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:52.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.244+0000 7eff75dd2640 1 --2- 172.21.15.6:0/1024856535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff700c85a0 0x7eff70154860 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7eff640ae040 tx=0x7eff64019100 comp rx=0 tx=0).stop 2023-07-21T22:31:52.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.244+0000 7eff75dd2640 1 -- 172.21.15.6:0/1024856535 shutdown_connections 2023-07-21T22:31:52.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.244+0000 7eff75dd2640 1 --2- 172.21.15.6:0/1024856535 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7eff5c0663a0 0x7eff5c068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.244+0000 7eff75dd2640 1 --2- 172.21.15.6:0/1024856535 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff700cc000 0x7eff70152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.244+0000 7eff75dd2640 1 --2- 172.21.15.6:0/1024856535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff700c85a0 0x7eff70154860 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.244+0000 7eff75dd2640 1 --2- 172.21.15.6:0/1024856535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff7006cf10 0x7eff700b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.244+0000 7eff75dd2640 1 -- 172.21.15.6:0/1024856535 >> 172.21.15.6:0/1024856535 conn(0x7eff700afac0 msgr2=0x7eff70156360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:52.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.244+0000 7eff75dd2640 1 -- 172.21.15.6:0/1024856535 shutdown_connections 2023-07-21T22:31:52.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.244+0000 7eff75dd2640 1 -- 172.21.15.6:0/1024856535 wait complete. 2023-07-21T22:31:52.310 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-21T22:31:52.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.416+0000 7f5bf9219640 1 Processor -- start 2023-07-21T22:31:52.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.416+0000 7f5bf9219640 1 -- start start 2023-07-21T22:31:52.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.420+0000 7f5bf9219640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4156560 0x7f5bf40cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:52.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.420+0000 7f5bf9219640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5bf4159500 0x7f5bf40cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:52.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.420+0000 7f5bf9219640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf40b08d0 con 0x7f5bf40ccf60 2023-07-21T22:31:52.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.420+0000 7f5bf9219640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf40cd8d0 con 0x7f5bf4159500 2023-07-21T22:31:52.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.420+0000 7f5bf9219640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf4159cb0 con 0x7f5bf4156560 2023-07-21T22:31:52.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.420+0000 7f5bf359e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5bf4159500 0x7f5bf40cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:52.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.420+0000 7f5bf359e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5bf4159500 0x7f5bf40cd390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56516/0 (socket says 172.21.15.6:56516) 2023-07-21T22:31:52.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.420+0000 7f5bebfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5bf40ccf60 0x7f5bf4158df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39420/0 (socket says 172.21.15.6:39420) 2023-07-21T22:31:52.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.420+0000 7f5bf359e640 1 -- 172.21.15.6:0/3839552110 learned_addr learned my addr 172.21.15.6:0/3839552110 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:52.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.420+0000 7f5bf2d9d640 1 --2- 172.21.15.6:0/3839552110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4156560 0x7f5bf40cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:52.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.420+0000 7f5bf359e640 1 -- 172.21.15.6:0/3839552110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4156560 msgr2=0x7f5bf40cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:52.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.420+0000 7f5bf359e640 1 --2- 172.21.15.6:0/3839552110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4156560 0x7f5bf40cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.420+0000 7f5bf359e640 1 -- 172.21.15.6:0/3839552110 >> v1:172.21.15.6:6789/0 conn(0x7f5bf40ccf60 legacy=0x7f5bf4158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:52.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.420+0000 7f5bf359e640 1 -- 172.21.15.6:0/3839552110 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf41599d0 con 0x7f5bf4159500 2023-07-21T22:31:52.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.420+0000 7f5bf259c640 1 -- 172.21.15.6:0/3839552110 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042545771 0 0) 0x7f5bf40b08d0 con 0x7f5bf40ccf60 2023-07-21T22:31:52.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.420+0000 7f5bf2d9d640 1 --2- 172.21.15.6:0/3839552110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4156560 0x7f5bf40cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:52.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.424+0000 7f5bf359e640 1 --2- 172.21.15.6:0/3839552110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bf4159500 0x7f5bf40cd390 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009e80 tx=0x7f5bec01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8b277eeb702816 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:52.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.424+0000 7f5bf259c640 1 -- 172.21.15.6:0/3839552110 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec0a58a0 con 0x7f5bf4159500 2023-07-21T22:31:52.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.424+0000 7f5bf259c640 1 -- 172.21.15.6:0/3839552110 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bec0a5a00 con 0x7f5bf4159500 2023-07-21T22:31:52.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.424+0000 7f5bf259c640 1 -- 172.21.15.6:0/3839552110 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec0a5d90 con 0x7f5bf4159500 2023-07-21T22:31:52.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.424+0000 7f5bf9219640 1 -- 172.21.15.6:0/3839552110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bf4159500 msgr2=0x7f5bf40cd390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:52.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.424+0000 7f5bf9219640 1 --2- 172.21.15.6:0/3839552110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bf4159500 0x7f5bf40cd390 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009e80 tx=0x7f5bec01c9c0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.424+0000 7f5bf9219640 1 -- 172.21.15.6:0/3839552110 shutdown_connections 2023-07-21T22:31:52.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.424+0000 7f5bf9219640 1 --2- 172.21.15.6:0/3839552110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bf4159500 0x7f5bf40cd390 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.424+0000 7f5bf9219640 1 --2- 172.21.15.6:0/3839552110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4156560 0x7f5bf40cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.424+0000 7f5bf9219640 1 -- 172.21.15.6:0/3839552110 >> 172.21.15.6:0/3839552110 conn(0x7f5bf40afac0 msgr2=0x7f5bf40afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:52.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.424+0000 7f5bf9219640 1 -- 172.21.15.6:0/3839552110 shutdown_connections 2023-07-21T22:31:52.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.424+0000 7f5bf9219640 1 -- 172.21.15.6:0/3839552110 wait complete. 2023-07-21T22:31:52.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.424+0000 7f5bf9219640 1 Processor -- start 2023-07-21T22:31:52.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.424+0000 7f5bf9219640 1 -- start start 2023-07-21T22:31:52.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bf9219640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bf40ccf60 0x7f5bf4145930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:52.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bf9219640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf4156560 0x7f5bf414b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:52.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bf9219640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4159500 0x7f5bf414e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:52.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bf9219640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf414ce50 con 0x7f5bf40ccf60 2023-07-21T22:31:52.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bf9219640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf414b650 con 0x7f5bf4156560 2023-07-21T22:31:52.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bf9219640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf414c5b0 con 0x7f5bf4159500 2023-07-21T22:31:52.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bf2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bf40ccf60 0x7f5bf4145930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:52.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bf2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bf40ccf60 0x7f5bf4145930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56524/0 (socket says 172.21.15.6:56524) 2023-07-21T22:31:52.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bf2d9d640 1 -- 172.21.15.6:0/2397294163 learned_addr learned my addr 172.21.15.6:0/2397294163 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:52.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bf359e640 1 --2- 172.21.15.6:0/2397294163 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4159500 0x7f5bf414e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:52.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bebfff640 1 --2- 172.21.15.6:0/2397294163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf4156560 0x7f5bf414b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bf2d9d640 1 -- 172.21.15.6:0/2397294163 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4159500 msgr2=0x7f5bf414e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bf2d9d640 1 --2- 172.21.15.6:0/2397294163 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4159500 0x7f5bf414e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bf2d9d640 1 -- 172.21.15.6:0/2397294163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf4156560 msgr2=0x7f5bf414b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:52.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bf2d9d640 1 --2- 172.21.15.6:0/2397294163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf4156560 0x7f5bf414b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bf2d9d640 1 -- 172.21.15.6:0/2397294163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec009b30 con 0x7f5bf40ccf60 2023-07-21T22:31:52.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bebfff640 1 --2- 172.21.15.6:0/2397294163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf4156560 0x7f5bf414b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:52.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bf2d9d640 1 --2- 172.21.15.6:0/2397294163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bf40ccf60 0x7f5bf4145930 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5be400e810 tx=0x7f5be400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:52.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5beb7fe640 1 -- 172.21.15.6:0/2397294163 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be400c8d0 con 0x7f5bf40ccf60 2023-07-21T22:31:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5beb7fe640 1 -- 172.21.15.6:0/2397294163 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be400ca30 con 0x7f5bf40ccf60 2023-07-21T22:31:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5beb7fe640 1 -- 172.21.15.6:0/2397294163 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be400cde0 con 0x7f5bf40ccf60 2023-07-21T22:31:52.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bf9219640 1 -- 172.21.15.6:0/2397294163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf414c890 con 0x7f5bf40ccf60 2023-07-21T22:31:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bf9219640 1 -- 172.21.15.6:0/2397294163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf414ebc0 con 0x7f5bf40ccf60 2023-07-21T22:31:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.428+0000 7f5bf9219640 1 -- 172.21.15.6:0/2397294163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf40678d0 con 0x7f5bf40ccf60 2023-07-21T22:31:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.432+0000 7f5beb7fe640 1 -- 172.21.15.6:0/2397294163 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5be4013410 con 0x7f5bf40ccf60 2023-07-21T22:31:52.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.432+0000 7f5beb7fe640 1 --2- 172.21.15.6:0/2397294163 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f5bd40663a0 0x7f5bd4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:52.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.432+0000 7f5beb7fe640 1 -- 172.21.15.6:0/2397294163 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5985+0+0 (secure 0 0 0) 0x7f5be4083d50 con 0x7f5bf40ccf60 2023-07-21T22:31:52.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.432+0000 7f5bebfff640 1 --2- 172.21.15.6:0/2397294163 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f5bd40663a0 0x7f5bd4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:52.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.432+0000 7f5bebfff640 1 --2- 172.21.15.6:0/2397294163 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f5bd40663a0 0x7f5bd4068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc007fd0 tx=0x7f5bdc007c20 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:52.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.436+0000 7f5beb7fe640 1 -- 172.21.15.6:0/2397294163 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5be4051090 con 0x7f5bf40ccf60 2023-07-21T22:31:52.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.588+0000 7f5bf9219640 1 -- 172.21.15.6:0/2397294163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f5bf406b920 con 0x7f5bf40ccf60 2023-07-21T22:31:52.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.592+0000 7f5beb7fe640 1 -- 172.21.15.6:0/2397294163 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v14) v1 ==== 120+0+0 (secure 0 0 0) 0x7f5be40546b0 con 0x7f5bf40ccf60 2023-07-21T22:31:52.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.596+0000 7f5bf9219640 1 -- 172.21.15.6:0/2397294163 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f5bd40663a0 msgr2=0x7f5bd4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:52.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.596+0000 7f5bf9219640 1 --2- 172.21.15.6:0/2397294163 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f5bd40663a0 0x7f5bd4068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc007fd0 tx=0x7f5bdc007c20 comp rx=0 tx=0).stop 2023-07-21T22:31:52.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.596+0000 7f5bf9219640 1 -- 172.21.15.6:0/2397294163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bf40ccf60 msgr2=0x7f5bf4145930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:52.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.596+0000 7f5bf9219640 1 --2- 172.21.15.6:0/2397294163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bf40ccf60 0x7f5bf4145930 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5be400e810 tx=0x7f5be400ecd0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.596+0000 7f5bf9219640 1 -- 172.21.15.6:0/2397294163 shutdown_connections 2023-07-21T22:31:52.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.596+0000 7f5bf9219640 1 --2- 172.21.15.6:0/2397294163 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f5bd40663a0 0x7f5bd4068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.596+0000 7f5bf9219640 1 --2- 172.21.15.6:0/2397294163 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4159500 0x7f5bf414e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.596+0000 7f5bf9219640 1 --2- 172.21.15.6:0/2397294163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf4156560 0x7f5bf414b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.596+0000 7f5bf9219640 1 --2- 172.21.15.6:0/2397294163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bf40ccf60 0x7f5bf4145930 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.596+0000 7f5bf9219640 1 -- 172.21.15.6:0/2397294163 >> 172.21.15.6:0/2397294163 conn(0x7f5bf40afac0 msgr2=0x7f5bf40cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.596+0000 7f5bf9219640 1 -- 172.21.15.6:0/2397294163 shutdown_connections 2023-07-21T22:31:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.596+0000 7f5bf9219640 1 -- 172.21.15.6:0/2397294163 wait complete. 2023-07-21T22:31:52.664 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-21T22:31:52.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.760+0000 7f27cecd8640 1 Processor -- start 2023-07-21T22:31:52.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.760+0000 7f27cecd8640 1 -- start start 2023-07-21T22:31:52.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.764+0000 7f27cecd8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f27c80d06b0 0x7f27c80b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:52.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.764+0000 7f27cecd8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c80b2410 con 0x7f27c80b1f70 2023-07-21T22:31:52.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.764+0000 7f27cecd8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c80b26f0 con 0x7f27c8145430 2023-07-21T22:31:52.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.764+0000 7f27cecd8640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c80b29d0 con 0x7f27c80d06b0 2023-07-21T22:31:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.764+0000 7f27cd275640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f27c80b1f70 0x7f27c80d22e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39434/0 (socket says 172.21.15.6:39434) 2023-07-21T22:31:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.764+0000 7f27cd275640 1 -- 172.21.15.6:0/1535583498 learned_addr learned my addr 172.21.15.6:0/1535583498 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.764+0000 7f27cca74640 1 --2- 172.21.15.6:0/1535583498 >> v2:172.21.15.161:3300/0 conn(0x7f27c80d06b0 0x7f27c80b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.764+0000 7f27c77fe640 1 -- 172.21.15.6:0/1535583498 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891346552 0 0) 0x7f27c80b2410 con 0x7f27c80b1f70 2023-07-21T22:31:52.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.764+0000 7f27c77fe640 1 -- 172.21.15.6:0/1535583498 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27b8003530 con 0x7f27c80b1f70 2023-07-21T22:31:52.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.764+0000 7f27c77fe640 1 -- 172.21.15.6:0/1535583498 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573578089 0 0) 0x7f27c80b26f0 con 0x7f27c8145430 2023-07-21T22:31:52.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.764+0000 7f27c77fe640 1 -- 172.21.15.6:0/1535583498 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27c80b2410 con 0x7f27c8145430 2023-07-21T22:31:52.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.764+0000 7f27cca74640 1 -- 172.21.15.6:0/1535583498 >> v1:172.21.15.161:6789/0 conn(0x7f27c8145430 legacy=0x7f27c80b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:52.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.764+0000 7f27cca74640 1 -- 172.21.15.6:0/1535583498 >> v1:172.21.15.6:6789/0 conn(0x7f27c80b1f70 legacy=0x7f27c80d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:52.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.764+0000 7f27cca74640 1 -- 172.21.15.6:0/1535583498 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c80b2cb0 con 0x7f27c80d06b0 2023-07-21T22:31:52.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.768+0000 7f27cca74640 1 --2- 172.21.15.6:0/1535583498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27c80d06b0 0x7f27c80b1a30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0097c0 tx=0x7f27bc01ceb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e28d58ebd165956 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.768+0000 7f27c77fe640 1 -- 172.21.15.6:0/1535583498 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc0ab670 con 0x7f27c80d06b0 2023-07-21T22:31:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.768+0000 7f27c77fe640 1 -- 172.21.15.6:0/1535583498 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc0ab7d0 con 0x7f27c80d06b0 2023-07-21T22:31:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.768+0000 7f27c77fe640 1 -- 172.21.15.6:0/1535583498 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc0abb60 con 0x7f27c80d06b0 2023-07-21T22:31:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.768+0000 7f27cecd8640 1 -- 172.21.15.6:0/1535583498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27c80d06b0 msgr2=0x7f27c80b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.768+0000 7f27cecd8640 1 --2- 172.21.15.6:0/1535583498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27c80d06b0 0x7f27c80b1a30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0097c0 tx=0x7f27bc01ceb0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.768+0000 7f27cecd8640 1 -- 172.21.15.6:0/1535583498 shutdown_connections 2023-07-21T22:31:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.768+0000 7f27cecd8640 1 --2- 172.21.15.6:0/1535583498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27c80d06b0 0x7f27c80b1a30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.768+0000 7f27cecd8640 1 -- 172.21.15.6:0/1535583498 >> 172.21.15.6:0/1535583498 conn(0x7f27c80659d0 msgr2=0x7f27c809b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:52.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.768+0000 7f27cecd8640 1 -- 172.21.15.6:0/1535583498 shutdown_connections 2023-07-21T22:31:52.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.768+0000 7f27cecd8640 1 -- 172.21.15.6:0/1535583498 wait complete. 2023-07-21T22:31:52.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.768+0000 7f27cecd8640 1 Processor -- start 2023-07-21T22:31:52.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.768+0000 7f27cecd8640 1 -- start start 2023-07-21T22:31:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27cecd8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27c80b1f70 0x7f27c80c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27cecd8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27c80d06b0 0x7f27c80c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27cecd8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27c815f280 0x7f27c80c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27cecd8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c80cadc0 con 0x7f27c80d06b0 2023-07-21T22:31:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27cecd8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c80ca4d0 con 0x7f27c815f280 2023-07-21T22:31:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27cecd8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c80ca770 con 0x7f27c80b1f70 2023-07-21T22:31:52.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27c7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27c80d06b0 0x7f27c80c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:52.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27c7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27c80d06b0 0x7f27c80c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56534/0 (socket says 172.21.15.6:56534) 2023-07-21T22:31:52.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27c7fff640 1 -- 172.21.15.6:0/493994745 learned_addr learned my addr 172.21.15.6:0/493994745 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:52.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27cca74640 1 --2- 172.21.15.6:0/493994745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27c80b1f70 0x7f27c80c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:52.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27cd275640 1 --2- 172.21.15.6:0/493994745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27c815f280 0x7f27c80c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:52.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27c7fff640 1 -- 172.21.15.6:0/493994745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27c80b1f70 msgr2=0x7f27c80c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27c7fff640 1 --2- 172.21.15.6:0/493994745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27c80b1f70 0x7f27c80c54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27c7fff640 1 -- 172.21.15.6:0/493994745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27c815f280 msgr2=0x7f27c80c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27c7fff640 1 --2- 172.21.15.6:0/493994745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27c815f280 0x7f27c80c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27c7fff640 1 -- 172.21.15.6:0/493994745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27bc009420 con 0x7f27c80d06b0 2023-07-21T22:31:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27c7fff640 1 --2- 172.21.15.6:0/493994745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27c80d06b0 0x7f27c80c9420 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f27b400c490 tx=0x7f27b400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27c57fa640 1 -- 172.21.15.6:0/493994745 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b40052d0 con 0x7f27c80d06b0 2023-07-21T22:31:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27c57fa640 1 -- 172.21.15.6:0/493994745 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b4005430 con 0x7f27c80d06b0 2023-07-21T22:31:52.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27c57fa640 1 -- 172.21.15.6:0/493994745 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b4012870 con 0x7f27c80d06b0 2023-07-21T22:31:52.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27cecd8640 1 -- 172.21.15.6:0/493994745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c80caa50 con 0x7f27c80d06b0 2023-07-21T22:31:52.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27cecd8640 1 -- 172.21.15.6:0/493994745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c806ad50 con 0x7f27c80d06b0 2023-07-21T22:31:52.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27cecd8640 1 -- 172.21.15.6:0/493994745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c80cabe0 con 0x7f27c80d06b0 2023-07-21T22:31:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.772+0000 7f27c57fa640 1 -- 172.21.15.6:0/493994745 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f27b40129d0 con 0x7f27c80d06b0 2023-07-21T22:31:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.776+0000 7f27c57fa640 1 --2- 172.21.15.6:0/493994745 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f27ac0663a0 0x7f27ac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.776+0000 7f27c57fa640 1 -- 172.21.15.6:0/493994745 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5985+0+0 (secure 0 0 0) 0x7f27b40839c0 con 0x7f27c80d06b0 2023-07-21T22:31:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.776+0000 7f27cca74640 1 --2- 172.21.15.6:0/493994745 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f27ac0663a0 0x7f27ac068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.776+0000 7f27cca74640 1 --2- 172.21.15.6:0/493994745 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f27ac0663a0 0x7f27ac068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0af000 tx=0x7f27bc004740 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:52.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.780+0000 7f27c57fa640 1 -- 172.21.15.6:0/493994745 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f27b4054820 con 0x7f27c80d06b0 2023-07-21T22:31:52.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.936+0000 7f27cecd8640 1 -- 172.21.15.6:0/493994745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f27c80678d0 con 0x7f27c80d06b0 2023-07-21T22:31:52.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.940+0000 7f27c57fa640 1 -- 172.21.15.6:0/493994745 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f27b40543b0 con 0x7f27c80d06b0 2023-07-21T22:31:52.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.940+0000 7f27cecd8640 1 -- 172.21.15.6:0/493994745 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f27ac0663a0 msgr2=0x7f27ac068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:52.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.940+0000 7f27cecd8640 1 --2- 172.21.15.6:0/493994745 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f27ac0663a0 0x7f27ac068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f27bc0af000 tx=0x7f27bc004740 comp rx=0 tx=0).stop 2023-07-21T22:31:52.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.940+0000 7f27cecd8640 1 -- 172.21.15.6:0/493994745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27c80d06b0 msgr2=0x7f27c80c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:52.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.940+0000 7f27cecd8640 1 --2- 172.21.15.6:0/493994745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27c80d06b0 0x7f27c80c9420 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f27b400c490 tx=0x7f27b400c950 comp rx=0 tx=0).stop 2023-07-21T22:31:52.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.940+0000 7f27cecd8640 1 -- 172.21.15.6:0/493994745 shutdown_connections 2023-07-21T22:31:52.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.940+0000 7f27cecd8640 1 --2- 172.21.15.6:0/493994745 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f27ac0663a0 0x7f27ac068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.940+0000 7f27cecd8640 1 --2- 172.21.15.6:0/493994745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27c815f280 0x7f27c80c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.940+0000 7f27cecd8640 1 --2- 172.21.15.6:0/493994745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27c80d06b0 0x7f27c80c9420 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.940+0000 7f27cecd8640 1 --2- 172.21.15.6:0/493994745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27c80b1f70 0x7f27c80c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:52.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.940+0000 7f27cecd8640 1 -- 172.21.15.6:0/493994745 >> 172.21.15.6:0/493994745 conn(0x7f27c80659d0 msgr2=0x7f27c815b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:52.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.940+0000 7f27cecd8640 1 -- 172.21.15.6:0/493994745 shutdown_connections 2023-07-21T22:31:52.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:52.940+0000 7f27cecd8640 1 -- 172.21.15.6:0/493994745 wait complete. 2023-07-21T22:31:53.010 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-07-21T22:31:53.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.104+0000 7f6425140640 1 Processor -- start 2023-07-21T22:31:53.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.104+0000 7f6425140640 1 -- start start 2023-07-21T22:31:53.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.108+0000 7f6425140640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f64200c8ad0 0x7f64200c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:53.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.108+0000 7f6425140640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f64200c9560 0x7f64200ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:53.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.108+0000 7f6425140640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64200c99c0 con 0x7f6420158ce0 2023-07-21T22:31:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.108+0000 7f6425140640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64200cc700 con 0x7f64200c8ad0 2023-07-21T22:31:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.108+0000 7f6425140640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64200b0ff0 con 0x7f64200c9560 2023-07-21T22:31:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.108+0000 7f6417fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f64200c8ad0 0x7f64200c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.108+0000 7f641ed9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6420158ce0 0x7f6420070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39448/0 (socket says 172.21.15.6:39448) 2023-07-21T22:31:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.108+0000 7f641ed9d640 1 -- 172.21.15.6:0/854738980 learned_addr learned my addr 172.21.15.6:0/854738980 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:53.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.108+0000 7f641f59e640 1 --2- 172.21.15.6:0/854738980 >> v2:172.21.15.161:3300/0 conn(0x7f64200c9560 0x7f64200ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:53.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.108+0000 7f6417fff640 1 -- 172.21.15.6:0/854738980 >> v2:172.21.15.161:3300/0 conn(0x7f64200c9560 msgr2=0x7f64200ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:53.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.108+0000 7f641e59c640 1 -- 172.21.15.6:0/854738980 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031544496 0 0) 0x7f64200c99c0 con 0x7f6420158ce0 2023-07-21T22:31:53.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.108+0000 7f6417fff640 1 --2- 172.21.15.6:0/854738980 >> v2:172.21.15.161:3300/0 conn(0x7f64200c9560 0x7f64200ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:53.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.108+0000 7f6417fff640 1 -- 172.21.15.6:0/854738980 >> v1:172.21.15.6:6789/0 conn(0x7f6420158ce0 legacy=0x7f6420070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:53.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.108+0000 7f6417fff640 1 -- 172.21.15.6:0/854738980 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6420070c80 con 0x7f64200c8ad0 2023-07-21T22:31:53.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.108+0000 7f641f59e640 1 --2- 172.21.15.6:0/854738980 >> v2:172.21.15.161:3300/0 conn(0x7f64200c9560 0x7f64200ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:53.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.112+0000 7f6417fff640 1 --2- 172.21.15.6:0/854738980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64200c8ad0 0x7f64200c9020 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f64200b0d70 tx=0x7f640801c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3be2433297cb4678 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:53.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.112+0000 7f641e59c640 1 -- 172.21.15.6:0/854738980 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64080ac640 con 0x7f64200c8ad0 2023-07-21T22:31:53.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.112+0000 7f641e59c640 1 -- 172.21.15.6:0/854738980 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64080ac7a0 con 0x7f64200c8ad0 2023-07-21T22:31:53.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.112+0000 7f641e59c640 1 -- 172.21.15.6:0/854738980 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64080acb30 con 0x7f64200c8ad0 2023-07-21T22:31:53.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.112+0000 7f6425140640 1 -- 172.21.15.6:0/854738980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64200c8ad0 msgr2=0x7f64200c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:53.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.112+0000 7f6425140640 1 --2- 172.21.15.6:0/854738980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64200c8ad0 0x7f64200c9020 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f64200b0d70 tx=0x7f640801c310 comp rx=0 tx=0).stop 2023-07-21T22:31:53.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.112+0000 7f6425140640 1 -- 172.21.15.6:0/854738980 shutdown_connections 2023-07-21T22:31:53.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.112+0000 7f6425140640 1 --2- 172.21.15.6:0/854738980 >> v2:172.21.15.161:3300/0 conn(0x7f64200c9560 0x7f64200ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:53.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.112+0000 7f6425140640 1 --2- 172.21.15.6:0/854738980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64200c8ad0 0x7f64200c9020 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:53.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.112+0000 7f6425140640 1 -- 172.21.15.6:0/854738980 >> 172.21.15.6:0/854738980 conn(0x7f64200afcf0 msgr2=0x7f64200b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:53.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.112+0000 7f6425140640 1 -- 172.21.15.6:0/854738980 shutdown_connections 2023-07-21T22:31:53.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.112+0000 7f6425140640 1 -- 172.21.15.6:0/854738980 wait complete. 2023-07-21T22:31:53.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.112+0000 7f6425140640 1 Processor -- start 2023-07-21T22:31:53.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.112+0000 7f6425140640 1 -- start start 2023-07-21T22:31:53.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f6425140640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64200c8ad0 0x7f642014af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:53.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f6425140640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64200c9560 0x7f64200c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:53.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f6425140640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6420158ce0 0x7f64200c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:53.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f6425140640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642014c330 con 0x7f6420158ce0 2023-07-21T22:31:53.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f6425140640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642014b480 con 0x7f64200c8ad0 2023-07-21T22:31:53.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f6425140640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642014b720 con 0x7f64200c9560 2023-07-21T22:31:53.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f641f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6420158ce0 0x7f64200c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:53.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f641f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6420158ce0 0x7f64200c67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56560/0 (socket says 172.21.15.6:56560) 2023-07-21T22:31:53.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f641f59e640 1 -- 172.21.15.6:0/1808014012 learned_addr learned my addr 172.21.15.6:0/1808014012 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:53.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f6417fff640 1 --2- 172.21.15.6:0/1808014012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64200c9560 0x7f64200c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:53.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f641ed9d640 1 --2- 172.21.15.6:0/1808014012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64200c8ad0 0x7f642014af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:53.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f641f59e640 1 -- 172.21.15.6:0/1808014012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64200c9560 msgr2=0x7f64200c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:53.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f641f59e640 1 --2- 172.21.15.6:0/1808014012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64200c9560 0x7f64200c6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:53.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f641f59e640 1 -- 172.21.15.6:0/1808014012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64200c8ad0 msgr2=0x7f642014af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:53.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f641f59e640 1 --2- 172.21.15.6:0/1808014012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64200c8ad0 0x7f642014af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:53.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f641f59e640 1 -- 172.21.15.6:0/1808014012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6408009420 con 0x7f6420158ce0 2023-07-21T22:31:53.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f641f59e640 1 --2- 172.21.15.6:0/1808014012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6420158ce0 0x7f64200c67d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6418009fa0 tx=0x7f641800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:53.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f64177fe640 1 -- 172.21.15.6:0/1808014012 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418003ba0 con 0x7f6420158ce0 2023-07-21T22:31:53.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f64177fe640 1 -- 172.21.15.6:0/1808014012 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641800f040 con 0x7f6420158ce0 2023-07-21T22:31:53.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f64177fe640 1 -- 172.21.15.6:0/1808014012 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418004030 con 0x7f6420158ce0 2023-07-21T22:31:53.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f6425140640 1 -- 172.21.15.6:0/1808014012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f642014ba00 con 0x7f6420158ce0 2023-07-21T22:31:53.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f6425140640 1 -- 172.21.15.6:0/1808014012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f642014bfc0 con 0x7f6420158ce0 2023-07-21T22:31:53.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f6425140640 1 -- 172.21.15.6:0/1808014012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64200ca1a0 con 0x7f6420158ce0 2023-07-21T22:31:53.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.116+0000 7f64177fe640 1 -- 172.21.15.6:0/1808014012 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6418004190 con 0x7f6420158ce0 2023-07-21T22:31:53.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.120+0000 7f64177fe640 1 --2- 172.21.15.6:0/1808014012 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f64000663d0 0x7f6400068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:53.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.120+0000 7f64177fe640 1 -- 172.21.15.6:0/1808014012 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5985+0+0 (secure 0 0 0) 0x7f6418084310 con 0x7f6420158ce0 2023-07-21T22:31:53.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.120+0000 7f641ed9d640 1 --2- 172.21.15.6:0/1808014012 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f64000663d0 0x7f6400068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:53.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.120+0000 7f641ed9d640 1 --2- 172.21.15.6:0/1808014012 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f64000663d0 0x7f6400068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6410000f70 tx=0x7f6410007df0 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:53.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.124+0000 7f64177fe640 1 -- 172.21.15.6:0/1808014012 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f64180515c0 con 0x7f6420158ce0 2023-07-21T22:31:53.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.336+0000 7f6425140640 1 -- 172.21.15.6:0/1808014012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f64200678d0 con 0x7f6420158ce0 2023-07-21T22:31:53.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.892+0000 7f64177fe640 1 -- 172.21.15.6:0/1808014012 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v479) v1 ==== 158+0+0 (secure 0 0 0) 0x7f6418054be0 con 0x7f6420158ce0 2023-07-21T22:31:53.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.892+0000 7f6425140640 1 -- 172.21.15.6:0/1808014012 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f64000663d0 msgr2=0x7f6400068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:53.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.892+0000 7f6425140640 1 --2- 172.21.15.6:0/1808014012 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f64000663d0 0x7f6400068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6410000f70 tx=0x7f6410007df0 comp rx=0 tx=0).stop 2023-07-21T22:31:53.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.892+0000 7f6425140640 1 -- 172.21.15.6:0/1808014012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6420158ce0 msgr2=0x7f64200c67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:53.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.892+0000 7f6425140640 1 --2- 172.21.15.6:0/1808014012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6420158ce0 0x7f64200c67d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f6418009fa0 tx=0x7f641800d560 comp rx=0 tx=0).stop 2023-07-21T22:31:53.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.892+0000 7f6425140640 1 -- 172.21.15.6:0/1808014012 shutdown_connections 2023-07-21T22:31:53.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.892+0000 7f6425140640 1 --2- 172.21.15.6:0/1808014012 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f64000663d0 0x7f6400068880 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:53.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.892+0000 7f6425140640 1 --2- 172.21.15.6:0/1808014012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6420158ce0 0x7f64200c67d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:53.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.892+0000 7f6425140640 1 --2- 172.21.15.6:0/1808014012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64200c9560 0x7f64200c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:53.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.892+0000 7f6425140640 1 --2- 172.21.15.6:0/1808014012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64200c8ad0 0x7f642014af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:53.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.892+0000 7f6425140640 1 -- 172.21.15.6:0/1808014012 >> 172.21.15.6:0/1808014012 conn(0x7f64200afcf0 msgr2=0x7f642006ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:53.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.896+0000 7f6425140640 1 -- 172.21.15.6:0/1808014012 shutdown_connections 2023-07-21T22:31:53.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:53.896+0000 7f6425140640 1 -- 172.21.15.6:0/1808014012 wait complete. 2023-07-21T22:31:53.965 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2023-07-21T22:31:53.966 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2023-07-21T22:31:53.966 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-21T22:31:53.967 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-07-21T22:31:54.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.068+0000 7ff9a2b37640 1 Processor -- start 2023-07-21T22:31:54.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.068+0000 7ff9a2b37640 1 -- start start 2023-07-21T22:31:54.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.068+0000 7ff9a2b37640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff99c06b1e0 0x7ff99c0c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:54.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.068+0000 7ff9a2b37640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff99c0c21f0 0x7ff99c0cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:54.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.068+0000 7ff9a2b37640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99c0cac70 con 0x7ff99c070b70 2023-07-21T22:31:54.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.068+0000 7ff9a2b37640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99c0ca060 con 0x7ff99c0c21f0 2023-07-21T22:31:54.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.068+0000 7ff9a2b37640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c0ca340 con 0x7ff99c06b1e0 2023-07-21T22:31:54.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.068+0000 7ff9a10d4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff99c0c21f0 0x7ff99c0cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:54.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.068+0000 7ff99bfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff99c06b1e0 0x7ff99c0c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:54.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.068+0000 7ff99bfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff99c06b1e0 0x7ff99c0c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:52940/0 (socket says 172.21.15.6:52940) 2023-07-21T22:31:54.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.068+0000 7ff9a10d4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff99c0c21f0 0x7ff99c0cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:49390/0 (socket says 172.21.15.6:49390) 2023-07-21T22:31:54.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.068+0000 7ff99bfff640 1 -- 172.21.15.6:0/1747374210 learned_addr learned my addr 172.21.15.6:0/1747374210 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:54.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.068+0000 7ff99bfff640 1 -- 172.21.15.6:0/1747374210 >> v2:172.21.15.161:3300/0 conn(0x7ff99c0c21f0 msgr2=0x7ff99c0cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:54.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.068+0000 7ff99bfff640 1 --2- 172.21.15.6:0/1747374210 >> v2:172.21.15.161:3300/0 conn(0x7ff99c0c21f0 0x7ff99c0cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:54.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.068+0000 7ff99bfff640 1 -- 172.21.15.6:0/1747374210 >> v1:172.21.15.161:6789/0 conn(0x7ff99c070b70 legacy=0x7ff99c070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:54.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.068+0000 7ff99bfff640 1 -- 172.21.15.6:0/1747374210 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c0ca620 con 0x7ff99c06b1e0 2023-07-21T22:31:54.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.068+0000 7ff9a10d4640 1 --2- 172.21.15.6:0/1747374210 >> v2:172.21.15.161:3300/0 conn(0x7ff99c0c21f0 0x7ff99c0cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:54.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.072+0000 7ff99bfff640 1 --2- 172.21.15.6:0/1747374210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff99c06b1e0 0x7ff99c0c1cb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff988009870 tx=0x7ff98801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6325365ab3cb9b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:54.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.072+0000 7ff99b7fe640 1 -- 172.21.15.6:0/1747374210 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9880a6040 con 0x7ff99c06b1e0 2023-07-21T22:31:54.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.072+0000 7ff99b7fe640 1 -- 172.21.15.6:0/1747374210 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9880aa600 con 0x7ff99c06b1e0 2023-07-21T22:31:54.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.072+0000 7ff99b7fe640 1 -- 172.21.15.6:0/1747374210 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9880aa990 con 0x7ff99c06b1e0 2023-07-21T22:31:54.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.072+0000 7ff9a2b37640 1 -- 172.21.15.6:0/1747374210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff99c06b1e0 msgr2=0x7ff99c0c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:54.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.072+0000 7ff9a2b37640 1 --2- 172.21.15.6:0/1747374210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff99c06b1e0 0x7ff99c0c1cb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff988009870 tx=0x7ff98801c480 comp rx=0 tx=0).stop 2023-07-21T22:31:54.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.072+0000 7ff9a2b37640 1 -- 172.21.15.6:0/1747374210 shutdown_connections 2023-07-21T22:31:54.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.072+0000 7ff9a2b37640 1 --2- 172.21.15.6:0/1747374210 >> v2:172.21.15.161:3300/0 conn(0x7ff99c0c21f0 0x7ff99c0cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:54.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.072+0000 7ff9a2b37640 1 --2- 172.21.15.6:0/1747374210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff99c06b1e0 0x7ff99c0c1cb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:54.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.072+0000 7ff9a2b37640 1 -- 172.21.15.6:0/1747374210 >> 172.21.15.6:0/1747374210 conn(0x7ff99c0afcf0 msgr2=0x7ff99c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:54.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.072+0000 7ff9a2b37640 1 -- 172.21.15.6:0/1747374210 shutdown_connections 2023-07-21T22:31:54.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.072+0000 7ff9a2b37640 1 -- 172.21.15.6:0/1747374210 wait complete. 2023-07-21T22:31:54.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a2b37640 1 Processor -- start 2023-07-21T22:31:54.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a2b37640 1 -- start start 2023-07-21T22:31:54.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a2b37640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff99c06b1e0 0x7ff99c1f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:54.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a2b37640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff99c070b70 0x7ff99c0c2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:54.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a2b37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff99c0c21f0 0x7ff99c0c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:54.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a2b37640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c153b30 con 0x7ff99c0c21f0 2023-07-21T22:31:54.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a2b37640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c153e10 con 0x7ff99c06b1e0 2023-07-21T22:31:54.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a2b37640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c0b2380 con 0x7ff99c070b70 2023-07-21T22:31:54.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a10d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff99c0c21f0 0x7ff99c0c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:54.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a10d4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff99c0c21f0 0x7ff99c0c3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56570/0 (socket says 172.21.15.6:56570) 2023-07-21T22:31:54.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a10d4640 1 -- 172.21.15.6:0/3453715971 learned_addr learned my addr 172.21.15.6:0/3453715971 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:54.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff99bfff640 1 --2- 172.21.15.6:0/3453715971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff99c070b70 0x7ff99c0c2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:54.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a08d3640 1 --2- 172.21.15.6:0/3453715971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff99c06b1e0 0x7ff99c1f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:54.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a10d4640 1 -- 172.21.15.6:0/3453715971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff99c070b70 msgr2=0x7ff99c0c2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:54.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a10d4640 1 --2- 172.21.15.6:0/3453715971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff99c070b70 0x7ff99c0c2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:54.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a10d4640 1 -- 172.21.15.6:0/3453715971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff99c06b1e0 msgr2=0x7ff99c1f4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:54.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a10d4640 1 --2- 172.21.15.6:0/3453715971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff99c06b1e0 0x7ff99c1f4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:54.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a10d4640 1 -- 172.21.15.6:0/3453715971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff994009a70 con 0x7ff99c0c21f0 2023-07-21T22:31:54.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a08d3640 1 --2- 172.21.15.6:0/3453715971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff99c06b1e0 0x7ff99c1f4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:54.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a10d4640 1 --2- 172.21.15.6:0/3453715971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff99c0c21f0 0x7ff99c0c3490 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff99400ef90 tx=0x7ff99400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:54.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9997fa640 1 -- 172.21.15.6:0/3453715971 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994014480 con 0x7ff99c0c21f0 2023-07-21T22:31:54.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9997fa640 1 -- 172.21.15.6:0/3453715971 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99400f040 con 0x7ff99c0c21f0 2023-07-21T22:31:54.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9997fa640 1 -- 172.21.15.6:0/3453715971 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994014840 con 0x7ff99c0c21f0 2023-07-21T22:31:54.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a2b37640 1 -- 172.21.15.6:0/3453715971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9880094d0 con 0x7ff99c0c21f0 2023-07-21T22:31:54.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a2b37640 1 -- 172.21.15.6:0/3453715971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99c0b2940 con 0x7ff99c0c21f0 2023-07-21T22:31:54.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.076+0000 7ff9a2b37640 1 -- 172.21.15.6:0/3453715971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99c0678d0 con 0x7ff99c0c21f0 2023-07-21T22:31:54.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.080+0000 7ff9997fa640 1 -- 172.21.15.6:0/3453715971 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff9940149a0 con 0x7ff99c0c21f0 2023-07-21T22:31:54.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.080+0000 7ff9997fa640 1 --2- 172.21.15.6:0/3453715971 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ff9800663a0 0x7ff980068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:54.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.080+0000 7ff9997fa640 1 -- 172.21.15.6:0/3453715971 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5985+0+0 (secure 0 0 0) 0x7ff994084e40 con 0x7ff99c0c21f0 2023-07-21T22:31:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.080+0000 7ff9a08d3640 1 --2- 172.21.15.6:0/3453715971 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ff9800663a0 0x7ff980068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:54.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.080+0000 7ff9a08d3640 1 --2- 172.21.15.6:0/3453715971 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ff9800663a0 0x7ff980068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff990001710 tx=0x7ff990009040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:54.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.084+0000 7ff9997fa640 1 -- 172.21.15.6:0/3453715971 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff994052040 con 0x7ff99c0c21f0 2023-07-21T22:31:54.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.296+0000 7ff9a2b37640 1 -- 172.21.15.6:0/3453715971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7ff99c153c70 con 0x7ff99c0c21f0 2023-07-21T22:31:54.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.892+0000 7ff9997fa640 1 -- 172.21.15.6:0/3453715971 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v480) v1 ==== 157+0+0 (secure 0 0 0) 0x7ff99c153c70 con 0x7ff99c0c21f0 2023-07-21T22:31:54.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.896+0000 7ff9a2b37640 1 -- 172.21.15.6:0/3453715971 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ff9800663a0 msgr2=0x7ff980068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:54.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.896+0000 7ff9a2b37640 1 --2- 172.21.15.6:0/3453715971 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ff9800663a0 0x7ff980068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff990001710 tx=0x7ff990009040 comp rx=0 tx=0).stop 2023-07-21T22:31:54.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.896+0000 7ff9a2b37640 1 -- 172.21.15.6:0/3453715971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff99c0c21f0 msgr2=0x7ff99c0c3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:54.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.896+0000 7ff9a2b37640 1 --2- 172.21.15.6:0/3453715971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff99c0c21f0 0x7ff99c0c3490 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff99400ef90 tx=0x7ff99400c490 comp rx=0 tx=0).stop 2023-07-21T22:31:54.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.896+0000 7ff9a2b37640 1 -- 172.21.15.6:0/3453715971 shutdown_connections 2023-07-21T22:31:54.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.896+0000 7ff9a2b37640 1 --2- 172.21.15.6:0/3453715971 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ff9800663a0 0x7ff980068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:54.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.896+0000 7ff9a2b37640 1 --2- 172.21.15.6:0/3453715971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff99c0c21f0 0x7ff99c0c3490 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:54.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.896+0000 7ff9a2b37640 1 --2- 172.21.15.6:0/3453715971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff99c070b70 0x7ff99c0c2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:54.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.896+0000 7ff9a2b37640 1 --2- 172.21.15.6:0/3453715971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff99c06b1e0 0x7ff99c1f4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:54.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.896+0000 7ff9a2b37640 1 -- 172.21.15.6:0/3453715971 >> 172.21.15.6:0/3453715971 conn(0x7ff99c0afcf0 msgr2=0x7ff99c0c43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:54.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.896+0000 7ff9a2b37640 1 -- 172.21.15.6:0/3453715971 shutdown_connections 2023-07-21T22:31:54.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:54.896+0000 7ff9a2b37640 1 -- 172.21.15.6:0/3453715971 wait complete. 2023-07-21T22:31:54.969 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-21T22:31:55.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.072+0000 7f6f54f67640 1 Processor -- start 2023-07-21T22:31:55.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.072+0000 7f6f54f67640 1 -- start start 2023-07-21T22:31:55.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.072+0000 7f6f54f67640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f5015bde0 0x7f6f500d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:55.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.072+0000 7f6f54f67640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f500d2fc0 0x7f6f500b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:55.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.072+0000 7f6f54f67640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f500b04c0 con 0x7f6f500d2300 2023-07-21T22:31:55.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.072+0000 7f6f54f67640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5015c1b0 con 0x7f6f5015bde0 2023-07-21T22:31:55.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.072+0000 7f6f54f67640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500d0aa0 con 0x7f6f500d2fc0 2023-07-21T22:31:55.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.072+0000 7f6f4e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f5015bde0 0x7f6f500d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:55.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.072+0000 7f6f4e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f5015bde0 0x7f6f500d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56572/0 (socket says 172.21.15.6:56572) 2023-07-21T22:31:55.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.072+0000 7f6f4e59c640 1 -- 172.21.15.6:0/876567243 learned_addr learned my addr 172.21.15.6:0/876567243 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:55.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.072+0000 7f6f4e59c640 1 -- 172.21.15.6:0/876567243 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f500d2fc0 msgr2=0x7f6f500b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:55.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.072+0000 7f6f4e59c640 1 --2- 172.21.15.6:0/876567243 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f500d2fc0 0x7f6f500b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.072+0000 7f6f4e59c640 1 -- 172.21.15.6:0/876567243 >> v1:172.21.15.161:6789/0 conn(0x7f6f500d2300 legacy=0x7f6f500cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:55.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.072+0000 7f6f4e59c640 1 -- 172.21.15.6:0/876567243 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f500afb90 con 0x7f6f5015bde0 2023-07-21T22:31:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.076+0000 7f6f4e59c640 1 --2- 172.21.15.6:0/876567243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f5015bde0 0x7f6f500d0270 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6f40006fd0 tx=0x7f6f4001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acdcca477357cdac server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.076+0000 7f6f4dd9b640 1 -- 172.21.15.6:0/876567243 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f400a6040 con 0x7f6f5015bde0 2023-07-21T22:31:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.076+0000 7f6f4dd9b640 1 -- 172.21.15.6:0/876567243 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f400aa600 con 0x7f6f5015bde0 2023-07-21T22:31:55.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.076+0000 7f6f4dd9b640 1 -- 172.21.15.6:0/876567243 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f400aa990 con 0x7f6f5015bde0 2023-07-21T22:31:55.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.076+0000 7f6f54f67640 1 -- 172.21.15.6:0/876567243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f5015bde0 msgr2=0x7f6f500d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:55.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.076+0000 7f6f54f67640 1 --2- 172.21.15.6:0/876567243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f5015bde0 0x7f6f500d0270 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6f40006fd0 tx=0x7f6f4001c4e0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.076+0000 7f6f54f67640 1 -- 172.21.15.6:0/876567243 shutdown_connections 2023-07-21T22:31:55.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.076+0000 7f6f54f67640 1 --2- 172.21.15.6:0/876567243 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f500d2fc0 0x7f6f500b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.076+0000 7f6f54f67640 1 --2- 172.21.15.6:0/876567243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f5015bde0 0x7f6f500d0270 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.076+0000 7f6f54f67640 1 -- 172.21.15.6:0/876567243 >> 172.21.15.6:0/876567243 conn(0x7f6f500659d0 msgr2=0x7f6f5009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:55.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.076+0000 7f6f54f67640 1 -- 172.21.15.6:0/876567243 shutdown_connections 2023-07-21T22:31:55.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.076+0000 7f6f54f67640 1 -- 172.21.15.6:0/876567243 wait complete. 2023-07-21T22:31:55.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f54f67640 1 Processor -- start 2023-07-21T22:31:55.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f54f67640 1 -- start start 2023-07-21T22:31:55.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f54f67640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f500d2300 0x7f6f500cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:55.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f54f67640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f500d2fc0 0x7f6f5015afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:55.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f54f67640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f5015bde0 0x7f6f500ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:55.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f54f67640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f50151950 con 0x7f6f500d2fc0 2023-07-21T22:31:55.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f54f67640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5015b500 con 0x7f6f5015bde0 2023-07-21T22:31:55.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f54f67640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f50150fb0 con 0x7f6f500d2300 2023-07-21T22:31:55.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f47fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f500d2fc0 0x7f6f5015afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:55.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f47fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f500d2fc0 0x7f6f5015afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56586/0 (socket says 172.21.15.6:56586) 2023-07-21T22:31:55.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f47fff640 1 -- 172.21.15.6:0/632649490 learned_addr learned my addr 172.21.15.6:0/632649490 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:55.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f4e59c640 1 --2- 172.21.15.6:0/632649490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f500d2300 0x7f6f500cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:55.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f4ed9d640 1 --2- 172.21.15.6:0/632649490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f5015bde0 0x7f6f500ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:55.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f47fff640 1 -- 172.21.15.6:0/632649490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f500d2300 msgr2=0x7f6f500cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:55.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f47fff640 1 --2- 172.21.15.6:0/632649490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f500d2300 0x7f6f500cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f47fff640 1 -- 172.21.15.6:0/632649490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f5015bde0 msgr2=0x7f6f500ce2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:55.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f47fff640 1 --2- 172.21.15.6:0/632649490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f5015bde0 0x7f6f500ce2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f47fff640 1 -- 172.21.15.6:0/632649490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f40009480 con 0x7f6f500d2fc0 2023-07-21T22:31:55.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f47fff640 1 --2- 172.21.15.6:0/632649490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f500d2fc0 0x7f6f5015afc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800b410 tx=0x7f6f3800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:55.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f46ffd640 1 -- 172.21.15.6:0/632649490 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f38011830 con 0x7f6f500d2fc0 2023-07-21T22:31:55.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f46ffd640 1 -- 172.21.15.6:0/632649490 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f38011990 con 0x7f6f500d2fc0 2023-07-21T22:31:55.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f46ffd640 1 -- 172.21.15.6:0/632649490 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f38011d40 con 0x7f6f500d2fc0 2023-07-21T22:31:55.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f54f67640 1 -- 172.21.15.6:0/632649490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f50151290 con 0x7f6f500d2fc0 2023-07-21T22:31:55.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.080+0000 7f6f54f67640 1 -- 172.21.15.6:0/632649490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f500ce7e0 con 0x7f6f500d2fc0 2023-07-21T22:31:55.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.084+0000 7f6f54f67640 1 -- 172.21.15.6:0/632649490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f50151a90 con 0x7f6f500d2fc0 2023-07-21T22:31:55.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.084+0000 7f6f46ffd640 1 -- 172.21.15.6:0/632649490 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6f3801a400 con 0x7f6f500d2fc0 2023-07-21T22:31:55.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.084+0000 7f6f46ffd640 1 --2- 172.21.15.6:0/632649490 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f6f300663a0 0x7f6f30068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:55.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.084+0000 7f6f46ffd640 1 -- 172.21.15.6:0/632649490 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5985+0+0 (secure 0 0 0) 0x7f6f38083fd0 con 0x7f6f500d2fc0 2023-07-21T22:31:55.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.084+0000 7f6f4e59c640 1 --2- 172.21.15.6:0/632649490 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f6f300663a0 0x7f6f30068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:55.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.084+0000 7f6f4e59c640 1 --2- 172.21.15.6:0/632649490 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f6f300663a0 0x7f6f30068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6f400ae000 tx=0x7f6f400a7000 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:55.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.088+0000 7f6f46ffd640 1 -- 172.21.15.6:0/632649490 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6f50151a90 con 0x7f6f500d2fc0 2023-07-21T22:31:55.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.248+0000 7f6f54f67640 1 -- 172.21.15.6:0/632649490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6f50151a90 con 0x7f6f500d2fc0 2023-07-21T22:31:55.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.252+0000 7f6f46ffd640 1 -- 172.21.15.6:0/632649490 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6f50151a90 con 0x7f6f500d2fc0 2023-07-21T22:31:55.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.252+0000 7f6f54f67640 1 -- 172.21.15.6:0/632649490 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f6f300663a0 msgr2=0x7f6f30068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:55.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.252+0000 7f6f54f67640 1 --2- 172.21.15.6:0/632649490 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f6f300663a0 0x7f6f30068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6f400ae000 tx=0x7f6f400a7000 comp rx=0 tx=0).stop 2023-07-21T22:31:55.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.252+0000 7f6f54f67640 1 -- 172.21.15.6:0/632649490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f500d2fc0 msgr2=0x7f6f5015afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:55.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.252+0000 7f6f54f67640 1 --2- 172.21.15.6:0/632649490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f500d2fc0 0x7f6f5015afc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800b410 tx=0x7f6f3800b8d0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.252+0000 7f6f54f67640 1 -- 172.21.15.6:0/632649490 shutdown_connections 2023-07-21T22:31:55.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.252+0000 7f6f54f67640 1 --2- 172.21.15.6:0/632649490 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f6f300663a0 0x7f6f30068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.252+0000 7f6f54f67640 1 --2- 172.21.15.6:0/632649490 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f5015bde0 0x7f6f500ce2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.252+0000 7f6f54f67640 1 --2- 172.21.15.6:0/632649490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f500d2fc0 0x7f6f5015afc0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.252+0000 7f6f54f67640 1 --2- 172.21.15.6:0/632649490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f500d2300 0x7f6f500cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.252+0000 7f6f54f67640 1 -- 172.21.15.6:0/632649490 >> 172.21.15.6:0/632649490 conn(0x7f6f500659d0 msgr2=0x7f6f501522c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:55.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.252+0000 7f6f54f67640 1 -- 172.21.15.6:0/632649490 shutdown_connections 2023-07-21T22:31:55.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.252+0000 7f6f54f67640 1 -- 172.21.15.6:0/632649490 wait complete. 2023-07-21T22:31:55.321 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:31:55.322 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:31:55.405 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:31:55.458 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:31:55.458 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:31:55.459 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:31:55.468 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:31:55.468 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:31:55.468 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:31:55.478 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:31:55.478 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:31:55.479 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:31:55.518 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:31:55.519 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:31:55.519 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:31:55.531 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:31:55.531 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-21T22:31:55.532 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:31:55.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.656+0000 7f8b67bad640 1 Processor -- start 2023-07-21T22:31:55.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.656+0000 7f8b67bad640 1 -- start start 2023-07-21T22:31:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.660+0000 7f8b67bad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b600c8ad0 0x7f8b600c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.660+0000 7f8b67bad640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8b600c9560 0x7f8b600ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.660+0000 7f8b67bad640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b600cc700 con 0x7f8b60158ce0 2023-07-21T22:31:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.660+0000 7f8b67bad640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b600c99e0 con 0x7f8b600c9560 2023-07-21T22:31:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.660+0000 7f8b67bad640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600b0ff0 con 0x7f8b600c8ad0 2023-07-21T22:31:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.660+0000 7f8b6614a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8b600c9560 0x7f8b600ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:55.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.660+0000 7f8b6614a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8b600c9560 0x7f8b600ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56588/0 (socket says 172.21.15.6:56588) 2023-07-21T22:31:55.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.660+0000 7f8b6614a640 1 -- 172.21.15.6:0/3314954513 learned_addr learned my addr 172.21.15.6:0/3314954513 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:55.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.660+0000 7f8b65148640 1 --2- 172.21.15.6:0/3314954513 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b600c8ad0 0x7f8b600c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:55.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.660+0000 7f8b6614a640 1 -- 172.21.15.6:0/3314954513 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b600c8ad0 msgr2=0x7f8b600c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:55.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.660+0000 7f8b6614a640 1 --2- 172.21.15.6:0/3314954513 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b600c8ad0 0x7f8b600c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.660+0000 7f8b6614a640 1 -- 172.21.15.6:0/3314954513 >> v1:172.21.15.161:6789/0 conn(0x7f8b60158ce0 legacy=0x7f8b60070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:55.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.660+0000 7f8b6614a640 1 -- 172.21.15.6:0/3314954513 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b60070c80 con 0x7f8b600c9560 2023-07-21T22:31:55.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.664+0000 7f8b6614a640 1 --2- 172.21.15.6:0/3314954513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b600c9560 0x7f8b600ccb90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009e50 tx=0x7f8b5801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e643c8d7bf62131f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:55.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.664+0000 7f8b64947640 1 -- 172.21.15.6:0/3314954513 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b580a5690 con 0x7f8b600c9560 2023-07-21T22:31:55.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.664+0000 7f8b64947640 1 -- 172.21.15.6:0/3314954513 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b580a57f0 con 0x7f8b600c9560 2023-07-21T22:31:55.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.664+0000 7f8b64947640 1 -- 172.21.15.6:0/3314954513 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b580a5b80 con 0x7f8b600c9560 2023-07-21T22:31:55.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.664+0000 7f8b67bad640 1 -- 172.21.15.6:0/3314954513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b600c9560 msgr2=0x7f8b600ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:55.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.664+0000 7f8b67bad640 1 --2- 172.21.15.6:0/3314954513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b600c9560 0x7f8b600ccb90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009e50 tx=0x7f8b5801c8c0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.664+0000 7f8b67bad640 1 -- 172.21.15.6:0/3314954513 shutdown_connections 2023-07-21T22:31:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.664+0000 7f8b67bad640 1 --2- 172.21.15.6:0/3314954513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b600c9560 0x7f8b600ccb90 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.664+0000 7f8b67bad640 1 --2- 172.21.15.6:0/3314954513 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b600c8ad0 0x7f8b600c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.664+0000 7f8b67bad640 1 -- 172.21.15.6:0/3314954513 >> 172.21.15.6:0/3314954513 conn(0x7f8b600afcf0 msgr2=0x7f8b600b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.664+0000 7f8b67bad640 1 -- 172.21.15.6:0/3314954513 shutdown_connections 2023-07-21T22:31:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.664+0000 7f8b67bad640 1 -- 172.21.15.6:0/3314954513 wait complete. 2023-07-21T22:31:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.664+0000 7f8b67bad640 1 Processor -- start 2023-07-21T22:31:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.664+0000 7f8b67bad640 1 -- start start 2023-07-21T22:31:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b67bad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b600c8ad0 0x7f8b601529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b67bad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b600c9560 0x7f8b60145f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b67bad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b60158ce0 0x7f8b601457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b67bad640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60146730 con 0x7f8b600c9560 2023-07-21T22:31:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b67bad640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600c1400 con 0x7f8b600c8ad0 2023-07-21T22:31:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b67bad640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600c1e50 con 0x7f8b60158ce0 2023-07-21T22:31:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b65148640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b600c9560 0x7f8b60145f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b65148640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b600c9560 0x7f8b60145f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56594/0 (socket says 172.21.15.6:56594) 2023-07-21T22:31:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b65148640 1 -- 172.21.15.6:0/1219786195 learned_addr learned my addr 172.21.15.6:0/1219786195 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b65949640 1 --2- 172.21.15.6:0/1219786195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b600c8ad0 0x7f8b601529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b6614a640 1 --2- 172.21.15.6:0/1219786195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b60158ce0 0x7f8b601457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:55.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b65148640 1 -- 172.21.15.6:0/1219786195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b60158ce0 msgr2=0x7f8b601457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b65148640 1 --2- 172.21.15.6:0/1219786195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b60158ce0 0x7f8b601457f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b65148640 1 -- 172.21.15.6:0/1219786195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b600c8ad0 msgr2=0x7f8b601529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b65148640 1 --2- 172.21.15.6:0/1219786195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b600c8ad0 0x7f8b601529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b65148640 1 -- 172.21.15.6:0/1219786195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b58009b30 con 0x7f8b600c9560 2023-07-21T22:31:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b65148640 1 --2- 172.21.15.6:0/1219786195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b600c9560 0x7f8b60145f90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000d830 tx=0x7f8b5000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b567fc640 1 -- 172.21.15.6:0/1219786195 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5000b6c0 con 0x7f8b600c9560 2023-07-21T22:31:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b567fc640 1 -- 172.21.15.6:0/1219786195 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5000b860 con 0x7f8b600c9560 2023-07-21T22:31:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b567fc640 1 -- 172.21.15.6:0/1219786195 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5000bc10 con 0x7f8b600c9560 2023-07-21T22:31:55.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b67bad640 1 -- 172.21.15.6:0/1219786195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b601464d0 con 0x7f8b600c9560 2023-07-21T22:31:55.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b67bad640 1 -- 172.21.15.6:0/1219786195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b600c1120 con 0x7f8b600c9560 2023-07-21T22:31:55.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b67bad640 1 -- 172.21.15.6:0/1219786195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b600ca1a0 con 0x7f8b600c9560 2023-07-21T22:31:55.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.668+0000 7f8b567fc640 1 -- 172.21.15.6:0/1219786195 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8b5001e460 con 0x7f8b600c9560 2023-07-21T22:31:55.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.672+0000 7f8b567fc640 1 --2- 172.21.15.6:0/1219786195 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f8b440663a0 0x7f8b44068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:55.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.672+0000 7f8b567fc640 1 -- 172.21.15.6:0/1219786195 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5985+0+0 (secure 0 0 0) 0x7f8b50084480 con 0x7f8b600c9560 2023-07-21T22:31:55.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.672+0000 7f8b65949640 1 --2- 172.21.15.6:0/1219786195 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f8b440663a0 0x7f8b44068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:55.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.672+0000 7f8b65949640 1 --2- 172.21.15.6:0/1219786195 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f8b440663a0 0x7f8b44068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8b600cb4f0 tx=0x7f8b5c009040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:55.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.676+0000 7f8b567fc640 1 -- 172.21.15.6:0/1219786195 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8b50051970 con 0x7f8b600c9560 2023-07-21T22:31:55.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.864+0000 7f8b67bad640 1 -- 172.21.15.6:0/1219786195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b600678d0 con 0x7f8b600c9560 2023-07-21T22:31:55.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.864+0000 7f8b567fc640 1 -- 172.21.15.6:0/1219786195 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3517 (secure 0 0 0) 0x7f8b50054f90 con 0x7f8b600c9560 2023-07-21T22:31:55.912 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:55.912 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4928,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3033056690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3033056690},{"type":"v1","addr":"172.21.15.161:6836","nonce":3033056690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5146,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/77801161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":77801161},{"type":"v1","addr":"172.21.15.6:6835","nonce":77801161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5152,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/558287949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":558287949},{"type":"v1","addr":"172.21.15.161:6837","nonce":558287949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5967,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/484966908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":484966908},{"type":"v1","addr":"172.21.15.6:6834","nonce":484966908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2023-07-21T22:31:55.913 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 19 2023-07-21T22:31:55.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.864+0000 7f8b67bad640 1 -- 172.21.15.6:0/1219786195 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f8b440663a0 msgr2=0x7f8b44068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:55.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.864+0000 7f8b67bad640 1 --2- 172.21.15.6:0/1219786195 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f8b440663a0 0x7f8b44068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8b600cb4f0 tx=0x7f8b5c009040 comp rx=0 tx=0).stop 2023-07-21T22:31:55.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.864+0000 7f8b67bad640 1 -- 172.21.15.6:0/1219786195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b600c9560 msgr2=0x7f8b60145f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:55.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.864+0000 7f8b67bad640 1 --2- 172.21.15.6:0/1219786195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b600c9560 0x7f8b60145f90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000d830 tx=0x7f8b5000dcf0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.864+0000 7f8b67bad640 1 -- 172.21.15.6:0/1219786195 shutdown_connections 2023-07-21T22:31:55.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.864+0000 7f8b67bad640 1 --2- 172.21.15.6:0/1219786195 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f8b440663a0 0x7f8b44068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.864+0000 7f8b67bad640 1 --2- 172.21.15.6:0/1219786195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8b60158ce0 0x7f8b601457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.864+0000 7f8b67bad640 1 --2- 172.21.15.6:0/1219786195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b600c9560 0x7f8b60145f90 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.864+0000 7f8b67bad640 1 --2- 172.21.15.6:0/1219786195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b600c8ad0 0x7f8b601529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:55.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.864+0000 7f8b67bad640 1 -- 172.21.15.6:0/1219786195 >> 172.21.15.6:0/1219786195 conn(0x7f8b600afcf0 msgr2=0x7f8b600ae810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:55.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.864+0000 7f8b67bad640 1 -- 172.21.15.6:0/1219786195 shutdown_connections 2023-07-21T22:31:55.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:55.864+0000 7f8b67bad640 1 -- 172.21.15.6:0/1219786195 wait complete. 2023-07-21T22:31:55.934 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-21T22:31:55.934 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-21T22:31:55.934 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-21T22:31:55.934 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:31:55.935 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-21T22:31:55.935 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-21T22:31:55.935 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-21T22:31:55.936 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:31:55.936 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-21T22:31:55.936 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-21T22:31:55.936 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-21T22:31:55.936 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:31:55.937 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-21T22:31:55.937 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-21T22:31:55.937 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-21T22:31:55.938 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:31:55.946 INFO:tasks.ceph.mds.a:Stopped 2023-07-21T22:31:55.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-21T22:31:55.947 INFO:tasks.ceph.mds.c:Stopped 2023-07-21T22:31:55.948 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-21T22:31:55.952 INFO:tasks.ceph.mds.d:Stopped 2023-07-21T22:31:55.953 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-21T22:31:55.953 INFO:tasks.ceph.mds.b:Stopped 2023-07-21T22:31:55.954 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-21T22:31:55.993 INFO:tasks.ceph.mds.a:Started 2023-07-21T22:31:55.993 DEBUG:teuthology.parallel:result is None 2023-07-21T22:31:55.996 INFO:tasks.ceph.mds.c:Started 2023-07-21T22:31:55.996 DEBUG:teuthology.parallel:result is None 2023-07-21T22:31:56.001 INFO:tasks.ceph.mds.d:Started 2023-07-21T22:31:56.002 DEBUG:teuthology.parallel:result is None 2023-07-21T22:31:56.004 INFO:tasks.ceph.mds.b:Started 2023-07-21T22:31:56.004 DEBUG:teuthology.parallel:result is None 2023-07-21T22:31:56.004 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-21T22:31:56.082 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-21T22:31:56.084 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-07-21T22:31:56.094 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-07-21T22:31:56.095 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2023-07-21T22:31:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.108+0000 7f0016e34640 1 Processor -- start 2023-07-21T22:31:56.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.108+0000 7f0016e34640 1 -- start start 2023-07-21T22:31:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.108+0000 7f0016e34640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f001015fd60 0x7f00100d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.108+0000 7f0016e34640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00100d1850 0x7f00100d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.108+0000 7f0016e34640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00100ccaf0 con 0x7f00100b7c70 2023-07-21T22:31:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.108+0000 7f0016e34640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00100d1190 con 0x7f00100d1850 2023-07-21T22:31:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.108+0000 7f0016e34640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0010160600 con 0x7f001015fd60 2023-07-21T22:31:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.108+0000 7f00153d1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00100d1850 0x7f00100d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.108+0000 7f00153d1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00100d1850 0x7f00100d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56640/0 (socket says 172.21.15.6:56640) 2023-07-21T22:31:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.108+0000 7f00153d1640 1 -- 172.21.15.6:0/3966241976 learned_addr learned my addr 172.21.15.6:0/3966241976 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.108+0000 7f0014bd0640 1 --1- 172.21.15.6:0/3966241976 >> v1:172.21.15.161:6789/0 conn(0x7f00100b7c70 0x7f001015f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:40128/0 (socket says 172.21.15.6:40128) 2023-07-21T22:31:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.108+0000 7f000ffff640 1 --2- 172.21.15.6:0/3966241976 >> v2:172.21.15.161:3300/0 conn(0x7f001015fd60 0x7f00100d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.108+0000 7f00153d1640 1 -- 172.21.15.6:0/3966241976 >> v2:172.21.15.161:3300/0 conn(0x7f001015fd60 msgr2=0x7f00100d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.108+0000 7f00153d1640 1 --2- 172.21.15.6:0/3966241976 >> v2:172.21.15.161:3300/0 conn(0x7f001015fd60 0x7f00100d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.108+0000 7f00153d1640 1 -- 172.21.15.6:0/3966241976 >> v1:172.21.15.161:6789/0 conn(0x7f00100b7c70 legacy=0x7f001015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.108+0000 7f00153d1640 1 -- 172.21.15.6:0/3966241976 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0010160320 con 0x7f00100d1850 2023-07-21T22:31:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.108+0000 7f000f7fe640 1 -- 172.21.15.6:0/3966241976 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1171272031 0 0) 0x7f00100ccaf0 con 0x7f00100b7c70 2023-07-21T22:31:56.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.112+0000 7f00153d1640 1 --2- 172.21.15.6:0/3966241976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00100d1850 0x7f00100d1da0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f00100b1180 tx=0x7f000801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991539219c615266 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:56.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.112+0000 7f000f7fe640 1 -- 172.21.15.6:0/3966241976 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00080a5880 con 0x7f00100d1850 2023-07-21T22:31:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.112+0000 7f000f7fe640 1 -- 172.21.15.6:0/3966241976 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00080a59e0 con 0x7f00100d1850 2023-07-21T22:31:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.112+0000 7f000f7fe640 1 -- 172.21.15.6:0/3966241976 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00080a5d70 con 0x7f00100d1850 2023-07-21T22:31:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.112+0000 7f0016e34640 1 -- 172.21.15.6:0/3966241976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00100d1850 msgr2=0x7f00100d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.112+0000 7f0016e34640 1 --2- 172.21.15.6:0/3966241976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00100d1850 0x7f00100d1da0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f00100b1180 tx=0x7f000801c9a0 comp rx=0 tx=0).stop 2023-07-21T22:31:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.112+0000 7f0016e34640 1 -- 172.21.15.6:0/3966241976 shutdown_connections 2023-07-21T22:31:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.112+0000 7f0016e34640 1 --2- 172.21.15.6:0/3966241976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00100d1850 0x7f00100d1da0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.112+0000 7f0016e34640 1 --2- 172.21.15.6:0/3966241976 >> v2:172.21.15.161:3300/0 conn(0x7f001015fd60 0x7f00100d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.112+0000 7f0016e34640 1 -- 172.21.15.6:0/3966241976 >> 172.21.15.6:0/3966241976 conn(0x7f00100650b0 msgr2=0x7f00100654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.112+0000 7f0016e34640 1 -- 172.21.15.6:0/3966241976 shutdown_connections 2023-07-21T22:31:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.112+0000 7f0016e34640 1 -- 172.21.15.6:0/3966241976 wait complete. 2023-07-21T22:31:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f0016e34640 1 Processor -- start 2023-07-21T22:31:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f0016e34640 1 -- start start 2023-07-21T22:31:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f0016e34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00100b7c70 0x7f00101564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f0016e34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00100d1850 0x7f00100b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f0016e34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f001015fd60 0x7f00100c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f0016e34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00101f4ac0 con 0x7f00100d1850 2023-07-21T22:31:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f0016e34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0010156a20 con 0x7f00100b7c70 2023-07-21T22:31:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f0016e34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00100b3260 con 0x7f001015fd60 2023-07-21T22:31:56.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f000ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00100d1850 0x7f00100b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:56.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f000ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00100d1850 0x7f00100b27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56654/0 (socket says 172.21.15.6:56654) 2023-07-21T22:31:56.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f000ffff640 1 -- 172.21.15.6:0/1910633371 learned_addr learned my addr 172.21.15.6:0/1910633371 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:56.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f0014bd0640 1 --2- 172.21.15.6:0/1910633371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00100b7c70 0x7f00101564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:56.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f00153d1640 1 --2- 172.21.15.6:0/1910633371 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f001015fd60 0x7f00100c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:56.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f000ffff640 1 -- 172.21.15.6:0/1910633371 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f001015fd60 msgr2=0x7f00100c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:56.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f000ffff640 1 --2- 172.21.15.6:0/1910633371 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f001015fd60 0x7f00100c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:56.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f000ffff640 1 -- 172.21.15.6:0/1910633371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00100b7c70 msgr2=0x7f00101564e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:56.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f000ffff640 1 --2- 172.21.15.6:0/1910633371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00100b7c70 0x7f00101564e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:56.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f000ffff640 1 -- 172.21.15.6:0/1910633371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0008009b30 con 0x7f00100d1850 2023-07-21T22:31:56.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f00153d1640 1 --2- 172.21.15.6:0/1910633371 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f001015fd60 0x7f00100c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:56.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f0014bd0640 1 --2- 172.21.15.6:0/1910633371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00100b7c70 0x7f00101564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:56.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f000ffff640 1 --2- 172.21.15.6:0/1910633371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00100d1850 0x7f00100b27e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7efffc00e930 tx=0x7efffc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:56.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f000d7fa640 1 -- 172.21.15.6:0/1910633371 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc009690 con 0x7f00100d1850 2023-07-21T22:31:56.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f000d7fa640 1 -- 172.21.15.6:0/1910633371 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efffc00ca00 con 0x7f00100d1850 2023-07-21T22:31:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f000d7fa640 1 -- 172.21.15.6:0/1910633371 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc00cd70 con 0x7f00100d1850 2023-07-21T22:31:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f0016e34640 1 -- 172.21.15.6:0/1910633371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00101f4400 con 0x7f00100d1850 2023-07-21T22:31:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.116+0000 7f0016e34640 1 -- 172.21.15.6:0/1910633371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00101f84d0 con 0x7f00100d1850 2023-07-21T22:31:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.120+0000 7f0016e34640 1 -- 172.21.15.6:0/1910633371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00100678d0 con 0x7f00100d1850 2023-07-21T22:31:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.120+0000 7f000d7fa640 1 -- 172.21.15.6:0/1910633371 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efffc013470 con 0x7f00100d1850 2023-07-21T22:31:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.120+0000 7f000d7fa640 1 --2- 172.21.15.6:0/1910633371 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7efff40663a0 0x7efff4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.120+0000 7f000d7fa640 1 -- 172.21.15.6:0/1910633371 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5985+0+0 (secure 0 0 0) 0x7efffc083fe0 con 0x7f00100d1850 2023-07-21T22:31:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.120+0000 7f0014bd0640 1 --2- 172.21.15.6:0/1910633371 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7efff40663a0 0x7efff4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.120+0000 7f0014bd0640 1 --2- 172.21.15.6:0/1910633371 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7efff40663a0 0x7efff4068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0004000f70 tx=0x7f0004007dd0 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:56.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.124+0000 7f000d7fa640 1 -- 172.21.15.6:0/1910633371 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efffc0514a0 con 0x7f00100d1850 2023-07-21T22:31:56.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:56.292+0000 7f0016e34640 1 -- 172.21.15.6:0/1910633371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f00100b8280 con 0x7f00100d1850 2023-07-21T22:31:57.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.280+0000 7f000d7fa640 1 -- 172.21.15.6:0/1910633371 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v63) v1 ==== 97+0+0 (secure 0 0 0) 0x7efffc054ac0 con 0x7f00100d1850 2023-07-21T22:31:57.328 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-07-21T22:31:57.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.280+0000 7f0016e34640 1 -- 172.21.15.6:0/1910633371 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7efff40663a0 msgr2=0x7efff4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:57.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.280+0000 7f0016e34640 1 --2- 172.21.15.6:0/1910633371 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7efff40663a0 0x7efff4068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0004000f70 tx=0x7f0004007dd0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.280+0000 7f0016e34640 1 -- 172.21.15.6:0/1910633371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00100d1850 msgr2=0x7f00100b27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:57.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.280+0000 7f0016e34640 1 --2- 172.21.15.6:0/1910633371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00100d1850 0x7f00100b27e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7efffc00e930 tx=0x7efffc00edf0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.284+0000 7f0016e34640 1 -- 172.21.15.6:0/1910633371 shutdown_connections 2023-07-21T22:31:57.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.284+0000 7f0016e34640 1 --2- 172.21.15.6:0/1910633371 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7efff40663a0 0x7efff4068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.284+0000 7f0016e34640 1 --2- 172.21.15.6:0/1910633371 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f001015fd60 0x7f00100c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.284+0000 7f0016e34640 1 --2- 172.21.15.6:0/1910633371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00100d1850 0x7f00100b27e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.284+0000 7f0016e34640 1 --2- 172.21.15.6:0/1910633371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00100b7c70 0x7f00101564e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.284+0000 7f0016e34640 1 -- 172.21.15.6:0/1910633371 >> 172.21.15.6:0/1910633371 conn(0x7f00100650b0 msgr2=0x7f0010065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:57.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.284+0000 7f0016e34640 1 -- 172.21.15.6:0/1910633371 shutdown_connections 2023-07-21T22:31:57.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.284+0000 7f0016e34640 1 -- 172.21.15.6:0/1910633371 wait complete. 2023-07-21T22:31:57.354 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-21T22:31:57.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.456+0000 7f73d2a34640 1 Processor -- start 2023-07-21T22:31:57.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.456+0000 7f73d2a34640 1 -- start start 2023-07-21T22:31:57.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.456+0000 7f73d2a34640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f73cc15fd60 0x7f73cc0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:57.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.456+0000 7f73d2a34640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f73cc0d1850 0x7f73cc0d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:57.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.456+0000 7f73d2a34640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73cc0ccaf0 con 0x7f73cc0b7c70 2023-07-21T22:31:57.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.456+0000 7f73d2a34640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73cc0d1190 con 0x7f73cc0d1850 2023-07-21T22:31:57.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.456+0000 7f73d2a34640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73cc160600 con 0x7f73cc15fd60 2023-07-21T22:31:57.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.456+0000 7f73d0fd1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f73cc0d1850 0x7f73cc0d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:57.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.456+0000 7f73d0fd1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f73cc0d1850 0x7f73cc0d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35494/0 (socket says 172.21.15.6:35494) 2023-07-21T22:31:57.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.456+0000 7f73d0fd1640 1 -- 172.21.15.6:0/3585917642 learned_addr learned my addr 172.21.15.6:0/3585917642 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:57.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.456+0000 7f73cbfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f73cc0b7c70 0x7f73cc15f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53574/0 (socket says 172.21.15.6:53574) 2023-07-21T22:31:57.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.456+0000 7f73cb7fe640 1 --2- 172.21.15.6:0/3585917642 >> v2:172.21.15.161:3300/0 conn(0x7f73cc15fd60 0x7f73cc0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:57.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.456+0000 7f73d0fd1640 1 -- 172.21.15.6:0/3585917642 >> v2:172.21.15.161:3300/0 conn(0x7f73cc15fd60 msgr2=0x7f73cc0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.456+0000 7f73d0fd1640 1 --2- 172.21.15.6:0/3585917642 >> v2:172.21.15.161:3300/0 conn(0x7f73cc15fd60 0x7f73cc0d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.456+0000 7f73d0fd1640 1 -- 172.21.15.6:0/3585917642 >> v1:172.21.15.6:6789/0 conn(0x7f73cc0b7c70 legacy=0x7f73cc15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.456+0000 7f73caffd640 1 -- 172.21.15.6:0/3585917642 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079379886 0 0) 0x7f73cc0ccaf0 con 0x7f73cc0b7c70 2023-07-21T22:31:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.456+0000 7f73d0fd1640 1 -- 172.21.15.6:0/3585917642 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73cc160320 con 0x7f73cc0d1850 2023-07-21T22:31:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.460+0000 7f73d0fd1640 1 --2- 172.21.15.6:0/3585917642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73cc0d1850 0x7f73cc0d1da0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0b1180 tx=0x7f73c401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d15439c09fd71a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.460+0000 7f73caffd640 1 -- 172.21.15.6:0/3585917642 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c40a5880 con 0x7f73cc0d1850 2023-07-21T22:31:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.460+0000 7f73caffd640 1 -- 172.21.15.6:0/3585917642 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c40a59e0 con 0x7f73cc0d1850 2023-07-21T22:31:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.460+0000 7f73caffd640 1 -- 172.21.15.6:0/3585917642 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c40a5d70 con 0x7f73cc0d1850 2023-07-21T22:31:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.460+0000 7f73d2a34640 1 -- 172.21.15.6:0/3585917642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73cc0d1850 msgr2=0x7f73cc0d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.460+0000 7f73d2a34640 1 --2- 172.21.15.6:0/3585917642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73cc0d1850 0x7f73cc0d1da0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f73cc0b1180 tx=0x7f73c401c9a0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.460+0000 7f73d2a34640 1 -- 172.21.15.6:0/3585917642 shutdown_connections 2023-07-21T22:31:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.460+0000 7f73d2a34640 1 --2- 172.21.15.6:0/3585917642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73cc0d1850 0x7f73cc0d1da0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.460+0000 7f73d2a34640 1 --2- 172.21.15.6:0/3585917642 >> v2:172.21.15.161:3300/0 conn(0x7f73cc15fd60 0x7f73cc0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.460+0000 7f73d2a34640 1 -- 172.21.15.6:0/3585917642 >> 172.21.15.6:0/3585917642 conn(0x7f73cc0650b0 msgr2=0x7f73cc0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.460+0000 7f73d2a34640 1 -- 172.21.15.6:0/3585917642 shutdown_connections 2023-07-21T22:31:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.460+0000 7f73d2a34640 1 -- 172.21.15.6:0/3585917642 wait complete. 2023-07-21T22:31:57.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73d2a34640 1 Processor -- start 2023-07-21T22:31:57.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73d2a34640 1 -- start start 2023-07-21T22:31:57.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73d2a34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73cc0b7c70 0x7f73cc0b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:57.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73d2a34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73cc0d1850 0x7f73cc0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:57.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73d2a34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73cc15fd60 0x7f73cc0c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:57.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73d2a34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc0b37a0 con 0x7f73cc0d1850 2023-07-21T22:31:57.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73d2a34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc0cc6d0 con 0x7f73cc0b7c70 2023-07-21T22:31:57.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73d2a34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73cc0cb890 con 0x7f73cc15fd60 2023-07-21T22:31:57.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73cb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73cc0d1850 0x7f73cc0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:57.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73cb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73cc0d1850 0x7f73cc0cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35496/0 (socket says 172.21.15.6:35496) 2023-07-21T22:31:57.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73cb7fe640 1 -- 172.21.15.6:0/1555618852 learned_addr learned my addr 172.21.15.6:0/1555618852 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73d0fd1640 1 --2- 172.21.15.6:0/1555618852 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73cc15fd60 0x7f73cc0c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73cbfff640 1 --2- 172.21.15.6:0/1555618852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73cc0b7c70 0x7f73cc0b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73cb7fe640 1 -- 172.21.15.6:0/1555618852 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73cc15fd60 msgr2=0x7f73cc0c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73cb7fe640 1 --2- 172.21.15.6:0/1555618852 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73cc15fd60 0x7f73cc0c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73cb7fe640 1 -- 172.21.15.6:0/1555618852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73cc0b7c70 msgr2=0x7f73cc0b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73cb7fe640 1 --2- 172.21.15.6:0/1555618852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73cc0b7c70 0x7f73cc0b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73cb7fe640 1 -- 172.21.15.6:0/1555618852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c4009b30 con 0x7f73cc0d1850 2023-07-21T22:31:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73cb7fe640 1 --2- 172.21.15.6:0/1555618852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73cc0d1850 0x7f73cc0cb350 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f73c000c7f0 tx=0x7f73c000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73c8ff9640 1 -- 172.21.15.6:0/1555618852 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c0004220 con 0x7f73cc0d1850 2023-07-21T22:31:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73c8ff9640 1 -- 172.21.15.6:0/1555618852 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c00043a0 con 0x7f73cc0d1850 2023-07-21T22:31:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73d2a34640 1 -- 172.21.15.6:0/1555618852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73cc0cbb50 con 0x7f73cc0d1850 2023-07-21T22:31:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73c8ff9640 1 -- 172.21.15.6:0/1555618852 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c0004510 con 0x7f73cc0d1850 2023-07-21T22:31:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.464+0000 7f73d2a34640 1 -- 172.21.15.6:0/1555618852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73cc0cc110 con 0x7f73cc0d1850 2023-07-21T22:31:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.468+0000 7f73d2a34640 1 -- 172.21.15.6:0/1555618852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73cc065e30 con 0x7f73cc0d1850 2023-07-21T22:31:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.468+0000 7f73c8ff9640 1 -- 172.21.15.6:0/1555618852 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f73c0003a70 con 0x7f73cc0d1850 2023-07-21T22:31:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.468+0000 7f73c8ff9640 1 --2- 172.21.15.6:0/1555618852 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f73b80663a0 0x7f73b8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.468+0000 7f73c8ff9640 1 -- 172.21.15.6:0/1555618852 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5254+0+0 (secure 0 0 0) 0x7f73c0083c40 con 0x7f73cc0d1850 2023-07-21T22:31:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.468+0000 7f73cbfff640 1 --2- 172.21.15.6:0/1555618852 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f73b80663a0 0x7f73b8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.472+0000 7f73cbfff640 1 --2- 172.21.15.6:0/1555618852 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f73b80663a0 0x7f73b8068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f73bc000f70 tx=0x7f73bc007c10 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:57.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.472+0000 7f73c8ff9640 1 -- 172.21.15.6:0/1555618852 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f73c00511b0 con 0x7f73cc0d1850 2023-07-21T22:31:57.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.680+0000 7f73d2a34640 1 -- 172.21.15.6:0/1555618852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f73cc0678d0 con 0x7f73cc0d1850 2023-07-21T22:31:57.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.680+0000 7f73c8ff9640 1 -- 172.21.15.6:0/1555618852 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f73c001e020 con 0x7f73cc0d1850 2023-07-21T22:31:57.729 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:57.729 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:31:57.730 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-07-21T22:31:57.730 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:57.730 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-07-21T22:31:57.730 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkHn5HNxAADk0AaSGwZfEj3SwNvEm8hw==", 2023-07-21T22:31:57.730 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:31:57.730 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:31:57.730 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:31:57.731 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:31:57.731 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:31:57.731 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:57.731 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:31:57.731 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:57.731 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-07-21T22:31:57.731 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkQFvXCBAANxf0/I2RQcHy4iYiydjkcg==", 2023-07-21T22:31:57.732 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:31:57.732 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:31:57.732 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:31:57.732 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:31:57.733 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:31:57.733 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:57.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:31:57.733 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:57.733 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-07-21T22:31:57.733 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkYtGXAxAAy+RDDBSvc1FeZq+eg23tRA==", 2023-07-21T22:31:57.734 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:31:57.734 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:31:57.734 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:31:57.734 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:31:57.734 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:31:57.734 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:57.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:31:57.735 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:57.735 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-07-21T22:31:57.735 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkH+Y1EBAAl+qTqd+gFrB9LtJWwD5dgA==", 2023-07-21T22:31:57.735 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:31:57.735 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:31:57.735 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:31:57.735 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:31:57.736 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:31:57.736 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:57.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:31:57.736 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:57.736 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-07-21T22:31:57.736 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAKBLtkPwZrLBAAQHZECi2zHST1MKYgGoa/Iw==", 2023-07-21T22:31:57.736 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:31:57.737 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:31:57.737 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:31:57.737 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:31:57.737 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:57.737 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:31:57.737 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:57.737 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-07-21T22:31:57.737 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQANBLtkvwgwNBAApurMm8c3pSlX2r16Gli/Ag==", 2023-07-21T22:31:57.738 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:31:57.738 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:31:57.738 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:31:57.738 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:31:57.738 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:57.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:31:57.738 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:57.739 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-07-21T22:31:57.739 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAQBLtkf2p1OxAAcKYw2RixFefYAwcfkGnOKQ==", 2023-07-21T22:31:57.739 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:31:57.739 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:31:57.739 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:31:57.739 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:31:57.739 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:57.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:31:57.740 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:57.740 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-07-21T22:31:57.740 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAUBLtkQUl6BhAAXXT1ZK1h9aZEcp6qIHsLiA==", 2023-07-21T22:31:57.740 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:31:57.740 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:31:57.740 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:31:57.740 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:31:57.741 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:57.741 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:31:57.741 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:57.741 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-07-21T22:31:57.741 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAaBLtkc1VfExAAPzDz2k/c0qVePG9h1saQCw==", 2023-07-21T22:31:57.741 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:31:57.741 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:31:57.741 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:31:57.742 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:31:57.742 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:57.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:31:57.742 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:57.742 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-07-21T22:31:57.742 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAdBLtkJ6fcGhAAglVSJIQS04WYBv4APhl57g==", 2023-07-21T22:31:57.742 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:31:57.743 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:31:57.743 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:31:57.743 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:31:57.743 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:57.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:31:57.743 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:57.743 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-07-21T22:31:57.743 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAgBLtkPINGIRAAWKs1RNQIdhZYlDAzDgUkNw==", 2023-07-21T22:31:57.744 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:31:57.744 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:31:57.744 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:31:57.744 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:31:57.744 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:57.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:31:57.744 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:57.745 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-07-21T22:31:57.745 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAjBLtk83MCKBAAZH2NhMBphVv4QkRzy+NDgg==", 2023-07-21T22:31:57.745 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:31:57.745 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:31:57.745 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:31:57.745 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:31:57.745 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:57.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:31:57.746 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:57.746 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-07-21T22:31:57.746 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA==", 2023-07-21T22:31:57.746 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:31:57.746 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:31:57.747 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-07-21T22:31:57.747 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-21T22:31:57.747 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:57.747 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:31:57.748 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:57.748 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-07-21T22:31:57.748 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkPVXTHhAAYmkzwAvqsfrowpAucTnlUQ==", 2023-07-21T22:31:57.749 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:31:57.749 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:31:57.749 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:31:57.749 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:31:57.750 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:31:57.750 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:57.750 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:31:57.750 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:57.751 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-07-21T22:31:57.751 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkd7wSGxAArvSYwe+k48vgRzb3fQAEAQ==", 2023-07-21T22:31:57.751 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:31:57.752 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:31:57.752 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:31:57.752 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:31:57.752 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:31:57.752 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:57.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:31:57.753 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:57.753 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-07-21T22:31:57.753 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkoZ4YJRAAX4yh0Q1pR4wY7yEV6kg9QA==", 2023-07-21T22:31:57.753 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:31:57.753 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:31:57.753 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:31:57.753 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:31:57.754 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:31:57.754 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:57.754 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:31:57.754 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:57.754 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-07-21T22:31:57.754 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtk0ILFGhAAQZ+8lGNFVdOtZYOuLlfkoQ==", 2023-07-21T22:31:57.754 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:31:57.754 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:31:57.755 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:31:57.755 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:31:57.755 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:31:57.755 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:57.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:31:57.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:57.756 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-07-21T22:31:57.756 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkdobtMhAAQbwi3cvsrW9P0t3d52oEKw==", 2023-07-21T22:31:57.756 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:31:57.756 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:31:57.756 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T22:31:57.756 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:31:57.756 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:57.757 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:31:57.757 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:57.757 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-07-21T22:31:57.757 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkHhzpLhAAZTx4Vrc0Htk88104SzuAxQ==", 2023-07-21T22:31:57.757 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:31:57.757 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:31:57.758 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T22:31:57.758 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:31:57.758 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:57.758 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:57.758 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-07-21T22:31:57.758 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:31:57.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.684+0000 7f73d2a34640 1 -- 172.21.15.6:0/1555618852 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f73b80663a0 msgr2=0x7f73b8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:57.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.684+0000 7f73d2a34640 1 --2- 172.21.15.6:0/1555618852 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f73b80663a0 0x7f73b8068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f73bc000f70 tx=0x7f73bc007c10 comp rx=0 tx=0).stop 2023-07-21T22:31:57.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.684+0000 7f73d2a34640 1 -- 172.21.15.6:0/1555618852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73cc0d1850 msgr2=0x7f73cc0cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:57.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.684+0000 7f73d2a34640 1 --2- 172.21.15.6:0/1555618852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73cc0d1850 0x7f73cc0cb350 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f73c000c7f0 tx=0x7f73c000ccb0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.684+0000 7f73d2a34640 1 -- 172.21.15.6:0/1555618852 shutdown_connections 2023-07-21T22:31:57.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.684+0000 7f73d2a34640 1 --2- 172.21.15.6:0/1555618852 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f73b80663a0 0x7f73b8068850 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.684+0000 7f73d2a34640 1 --2- 172.21.15.6:0/1555618852 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73cc15fd60 0x7f73cc0c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.684+0000 7f73d2a34640 1 --2- 172.21.15.6:0/1555618852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73cc0d1850 0x7f73cc0cb350 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.684+0000 7f73d2a34640 1 --2- 172.21.15.6:0/1555618852 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73cc0b7c70 0x7f73cc0b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.684+0000 7f73d2a34640 1 -- 172.21.15.6:0/1555618852 >> 172.21.15.6:0/1555618852 conn(0x7f73cc0650b0 msgr2=0x7f73cc0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:57.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.684+0000 7f73d2a34640 1 -- 172.21.15.6:0/1555618852 shutdown_connections 2023-07-21T22:31:57.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.684+0000 7f73d2a34640 1 -- 172.21.15.6:0/1555618852 wait complete. 2023-07-21T22:31:57.762 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:31:57.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.860+0000 7fd04e86d640 1 Processor -- start 2023-07-21T22:31:57.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.860+0000 7fd04e86d640 1 -- start start 2023-07-21T22:31:57.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.860+0000 7fd04e86d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd0480b7c70 0x7fd0480d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:57.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.860+0000 7fd04e86d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd04815fd60 0x7fd0480d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:57.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.860+0000 7fd04e86d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0480ccaf0 con 0x7fd0480d1850 2023-07-21T22:31:57.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.860+0000 7fd04e86d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0480d1190 con 0x7fd0480b7c70 2023-07-21T22:31:57.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.860+0000 7fd04e86d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd048160600 con 0x7fd04815fd60 2023-07-21T22:31:57.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.860+0000 7fd04ce0a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd04815fd60 0x7fd0480d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:57.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.860+0000 7fd047fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd0480b7c70 0x7fd0480d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:57.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.860+0000 7fd04ce0a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd04815fd60 0x7fd0480d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:60344/0 (socket says 172.21.15.6:60344) 2023-07-21T22:31:57.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.860+0000 7fd04ce0a640 1 -- 172.21.15.6:0/1078356467 learned_addr learned my addr 172.21.15.6:0/1078356467 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:57.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.860+0000 7fd04ce0a640 1 -- 172.21.15.6:0/1078356467 >> v2:172.21.15.161:3300/0 conn(0x7fd0480b7c70 msgr2=0x7fd0480d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:57.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.860+0000 7fd04ce0a640 1 --2- 172.21.15.6:0/1078356467 >> v2:172.21.15.161:3300/0 conn(0x7fd0480b7c70 0x7fd0480d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.860+0000 7fd04ce0a640 1 -- 172.21.15.6:0/1078356467 >> v1:172.21.15.161:6789/0 conn(0x7fd0480d1850 legacy=0x7fd04815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:57.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.860+0000 7fd04ce0a640 1 -- 172.21.15.6:0/1078356467 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd048160320 con 0x7fd04815fd60 2023-07-21T22:31:57.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.864+0000 7fd04ce0a640 1 --2- 172.21.15.6:0/1078356467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd04815fd60 0x7fd0480d1da0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd040009e50 tx=0x7fd04001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc12b57010442431 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:57.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.864+0000 7fd046ffd640 1 -- 172.21.15.6:0/1078356467 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0400a58d0 con 0x7fd04815fd60 2023-07-21T22:31:57.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.864+0000 7fd046ffd640 1 -- 172.21.15.6:0/1078356467 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0400a5a30 con 0x7fd04815fd60 2023-07-21T22:31:57.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.864+0000 7fd046ffd640 1 -- 172.21.15.6:0/1078356467 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0400a5dc0 con 0x7fd04815fd60 2023-07-21T22:31:57.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.864+0000 7fd04e86d640 1 -- 172.21.15.6:0/1078356467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd04815fd60 msgr2=0x7fd0480d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:57.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.864+0000 7fd04e86d640 1 --2- 172.21.15.6:0/1078356467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd04815fd60 0x7fd0480d1da0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd040009e50 tx=0x7fd04001c9e0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.864+0000 7fd04e86d640 1 -- 172.21.15.6:0/1078356467 shutdown_connections 2023-07-21T22:31:57.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.864+0000 7fd04e86d640 1 --2- 172.21.15.6:0/1078356467 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd04815fd60 0x7fd0480d1da0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.864+0000 7fd04e86d640 1 --2- 172.21.15.6:0/1078356467 >> v2:172.21.15.161:3300/0 conn(0x7fd0480b7c70 0x7fd0480d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.864+0000 7fd04e86d640 1 -- 172.21.15.6:0/1078356467 >> 172.21.15.6:0/1078356467 conn(0x7fd0480650b0 msgr2=0x7fd0480654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:57.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.864+0000 7fd04e86d640 1 -- 172.21.15.6:0/1078356467 shutdown_connections 2023-07-21T22:31:57.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.864+0000 7fd04e86d640 1 -- 172.21.15.6:0/1078356467 wait complete. 2023-07-21T22:31:57.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd04e86d640 1 Processor -- start 2023-07-21T22:31:57.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd04e86d640 1 -- start start 2023-07-21T22:31:57.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd04e86d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0480b7c70 0x7fd048153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:57.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd04e86d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0480d1850 0x7fd04815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:57.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd04e86d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd04815fd60 0x7fd04815df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:57.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd04e86d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04815ef10 con 0x7fd04815fd60 2023-07-21T22:31:57.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd04e86d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0480cb430 con 0x7fd0480d1850 2023-07-21T22:31:57.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd04e86d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0480cb710 con 0x7fd0480b7c70 2023-07-21T22:31:57.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd04ce0a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd04815fd60 0x7fd04815df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:57.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd047fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0480b7c70 0x7fd048153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:57.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd04ce0a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd04815fd60 0x7fd04815df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35508/0 (socket says 172.21.15.6:35508) 2023-07-21T22:31:57.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd04ce0a640 1 -- 172.21.15.6:0/2432195957 learned_addr learned my addr 172.21.15.6:0/2432195957 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:57.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd0477fe640 1 --2- 172.21.15.6:0/2432195957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0480d1850 0x7fd04815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:57.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd04ce0a640 1 -- 172.21.15.6:0/2432195957 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0480b7c70 msgr2=0x7fd048153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:57.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd04ce0a640 1 --2- 172.21.15.6:0/2432195957 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0480b7c70 0x7fd048153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd04ce0a640 1 -- 172.21.15.6:0/2432195957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0480d1850 msgr2=0x7fd04815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:57.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd04ce0a640 1 --2- 172.21.15.6:0/2432195957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0480d1850 0x7fd04815ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:57.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd04ce0a640 1 -- 172.21.15.6:0/2432195957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd040009b30 con 0x7fd04815fd60 2023-07-21T22:31:57.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd0477fe640 1 --2- 172.21.15.6:0/2432195957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0480d1850 0x7fd04815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:57.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd047fff640 1 --2- 172.21.15.6:0/2432195957 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0480b7c70 0x7fd048153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:57.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd04ce0a640 1 --2- 172.21.15.6:0/2432195957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd04815fd60 0x7fd04815df20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd04001a610 tx=0x7fd040019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:57.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd044ff9640 1 -- 172.21.15.6:0/2432195957 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0400b8640 con 0x7fd04815fd60 2023-07-21T22:31:57.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd044ff9640 1 -- 172.21.15.6:0/2432195957 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0400b87c0 con 0x7fd04815fd60 2023-07-21T22:31:57.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd04e86d640 1 -- 172.21.15.6:0/2432195957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0480cb9f0 con 0x7fd04815fd60 2023-07-21T22:31:57.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd044ff9640 1 -- 172.21.15.6:0/2432195957 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0400b8b70 con 0x7fd04815fd60 2023-07-21T22:31:57.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.868+0000 7fd04e86d640 1 -- 172.21.15.6:0/2432195957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0480cc1f0 con 0x7fd04815fd60 2023-07-21T22:31:57.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.872+0000 7fd04e86d640 1 -- 172.21.15.6:0/2432195957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0480678d0 con 0x7fd04815fd60 2023-07-21T22:31:57.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.872+0000 7fd044ff9640 1 -- 172.21.15.6:0/2432195957 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd0400b8cd0 con 0x7fd04815fd60 2023-07-21T22:31:57.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.872+0000 7fd044ff9640 1 --2- 172.21.15.6:0/2432195957 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fd0340663a0 0x7fd034068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:57.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.872+0000 7fd044ff9640 1 -- 172.21.15.6:0/2432195957 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5254+0+0 (secure 0 0 0) 0x7fd04011eb60 con 0x7fd04815fd60 2023-07-21T22:31:57.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.872+0000 7fd047fff640 1 --2- 172.21.15.6:0/2432195957 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fd0340663a0 0x7fd034068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:57.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.872+0000 7fd047fff640 1 --2- 172.21.15.6:0/2432195957 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fd0340663a0 0x7fd034068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd038009eb0 tx=0x7fd038009190 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:57.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:57.876+0000 7fd044ff9640 1 -- 172.21.15.6:0/2432195957 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd0400ec200 con 0x7fd04815fd60 2023-07-21T22:31:58.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.032+0000 7fd04e86d640 1 -- 172.21.15.6:0/2432195957 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0480cbea0 con 0x7fd04815fd60 2023-07-21T22:31:58.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.032+0000 7fd044ff9640 1 -- 172.21.15.6:0/2432195957 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+14637 (secure 0 0 0) 0x7fd0400ef820 con 0x7fd04815fd60 2023-07-21T22:31:58.082 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:58.082 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":63,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:31:57.277328+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:31:58.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.036+0000 7fd04e86d640 1 -- 172.21.15.6:0/2432195957 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fd0340663a0 msgr2=0x7fd034068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:58.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.036+0000 7fd04e86d640 1 --2- 172.21.15.6:0/2432195957 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fd0340663a0 0x7fd034068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd038009eb0 tx=0x7fd038009190 comp rx=0 tx=0).stop 2023-07-21T22:31:58.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.036+0000 7fd04e86d640 1 -- 172.21.15.6:0/2432195957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd04815fd60 msgr2=0x7fd04815df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:58.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.036+0000 7fd04e86d640 1 --2- 172.21.15.6:0/2432195957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd04815fd60 0x7fd04815df20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd04001a610 tx=0x7fd040019780 comp rx=0 tx=0).stop 2023-07-21T22:31:58.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.036+0000 7fd04e86d640 1 -- 172.21.15.6:0/2432195957 shutdown_connections 2023-07-21T22:31:58.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.036+0000 7fd04e86d640 1 --2- 172.21.15.6:0/2432195957 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fd0340663a0 0x7fd034068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.036+0000 7fd04e86d640 1 --2- 172.21.15.6:0/2432195957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd04815fd60 0x7fd04815df20 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.036+0000 7fd04e86d640 1 --2- 172.21.15.6:0/2432195957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0480d1850 0x7fd04815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.036+0000 7fd04e86d640 1 --2- 172.21.15.6:0/2432195957 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0480b7c70 0x7fd048153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.036+0000 7fd04e86d640 1 -- 172.21.15.6:0/2432195957 >> 172.21.15.6:0/2432195957 conn(0x7fd0480650b0 msgr2=0x7fd0480b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:58.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.036+0000 7fd04e86d640 1 -- 172.21.15.6:0/2432195957 shutdown_connections 2023-07-21T22:31:58.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.036+0000 7fd04e86d640 1 -- 172.21.15.6:0/2432195957 wait complete. 2023-07-21T22:31:58.103 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:31:58.104 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:31:58.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.204+0000 7fa69b6ca640 1 Processor -- start 2023-07-21T22:31:58.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.204+0000 7fa69b6ca640 1 -- start start 2023-07-21T22:31:58.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.204+0000 7fa69b6ca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa69415bde0 0x7fa69406b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:58.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.204+0000 7fa69b6ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6940cd120 0x7fa69406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:58.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.204+0000 7fa69b6ca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6941609d0 con 0x7fa69415c1b0 2023-07-21T22:31:58.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.204+0000 7fa69b6ca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa69406a670 con 0x7fa69415bde0 2023-07-21T22:31:58.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.204+0000 7fa69b6ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69406a910 con 0x7fa6940cd120 2023-07-21T22:31:58.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.204+0000 7fa699466640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa69415bde0 0x7fa69406b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:58.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.204+0000 7fa699466640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa69415bde0 0x7fa69406b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35510/0 (socket says 172.21.15.6:35510) 2023-07-21T22:31:58.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.204+0000 7fa699466640 1 -- 172.21.15.6:0/3161136407 learned_addr learned my addr 172.21.15.6:0/3161136407 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:58.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.204+0000 7fa699c67640 1 --2- 172.21.15.6:0/3161136407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6940cd120 0x7fa69406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.204+0000 7fa699466640 1 -- 172.21.15.6:0/3161136407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6940cd120 msgr2=0x7fa69406ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.204+0000 7fa699466640 1 --2- 172.21.15.6:0/3161136407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6940cd120 0x7fa69406ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.204+0000 7fa699466640 1 -- 172.21.15.6:0/3161136407 >> v1:172.21.15.6:6789/0 conn(0x7fa69415c1b0 legacy=0x7fa6940cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.204+0000 7fa699466640 1 -- 172.21.15.6:0/3161136407 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69406abf0 con 0x7fa69415bde0 2023-07-21T22:31:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.204+0000 7fa68bfff640 1 -- 172.21.15.6:0/3161136407 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084938102 0 0) 0x7fa6941609d0 con 0x7fa69415c1b0 2023-07-21T22:31:58.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.208+0000 7fa699466640 1 --2- 172.21.15.6:0/3161136407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa69415bde0 0x7fa69406b3f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa690006fd0 tx=0x7fa69001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c11b8abeea12d3a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:58.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.208+0000 7fa68bfff640 1 -- 172.21.15.6:0/3161136407 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6900ab5f0 con 0x7fa69415bde0 2023-07-21T22:31:58.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.208+0000 7fa68bfff640 1 -- 172.21.15.6:0/3161136407 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6900ab750 con 0x7fa69415bde0 2023-07-21T22:31:58.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.208+0000 7fa68bfff640 1 -- 172.21.15.6:0/3161136407 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6900abae0 con 0x7fa69415bde0 2023-07-21T22:31:58.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.208+0000 7fa69b6ca640 1 -- 172.21.15.6:0/3161136407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa69415bde0 msgr2=0x7fa69406b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:58.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.208+0000 7fa69b6ca640 1 --2- 172.21.15.6:0/3161136407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa69415bde0 0x7fa69406b3f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa690006fd0 tx=0x7fa69001c3d0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.208+0000 7fa69b6ca640 1 -- 172.21.15.6:0/3161136407 shutdown_connections 2023-07-21T22:31:58.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.208+0000 7fa69b6ca640 1 --2- 172.21.15.6:0/3161136407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6940cd120 0x7fa69406ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.208+0000 7fa69b6ca640 1 --2- 172.21.15.6:0/3161136407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa69415bde0 0x7fa69406b3f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.208+0000 7fa69b6ca640 1 -- 172.21.15.6:0/3161136407 >> 172.21.15.6:0/3161136407 conn(0x7fa6940659d0 msgr2=0x7fa694099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:58.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.208+0000 7fa69b6ca640 1 -- 172.21.15.6:0/3161136407 shutdown_connections 2023-07-21T22:31:58.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.208+0000 7fa69b6ca640 1 -- 172.21.15.6:0/3161136407 wait complete. 2023-07-21T22:31:58.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa69b6ca640 1 Processor -- start 2023-07-21T22:31:58.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa69b6ca640 1 -- start start 2023-07-21T22:31:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa69b6ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6940cd120 0x7fa6940c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa69b6ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa69415bde0 0x7fa69415d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa69b6ca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa69415c1b0 0x7fa694156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa69b6ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa694157730 con 0x7fa69415bde0 2023-07-21T22:31:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa69b6ca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940ca000 con 0x7fa69415c1b0 2023-07-21T22:31:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa69b6ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940c5500 con 0x7fa6940cd120 2023-07-21T22:31:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa698c65640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa69415bde0 0x7fa69415d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa698c65640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa69415bde0 0x7fa69415d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35522/0 (socket says 172.21.15.6:35522) 2023-07-21T22:31:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa698c65640 1 -- 172.21.15.6:0/2678371120 learned_addr learned my addr 172.21.15.6:0/2678371120 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa699466640 1 --2- 172.21.15.6:0/2678371120 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6940cd120 0x7fa6940c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa699c67640 1 --2- 172.21.15.6:0/2678371120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa69415c1b0 0x7fa694156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa698c65640 1 -- 172.21.15.6:0/2678371120 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6940cd120 msgr2=0x7fa6940c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa698c65640 1 --2- 172.21.15.6:0/2678371120 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6940cd120 0x7fa6940c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa698c65640 1 -- 172.21.15.6:0/2678371120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa69415c1b0 msgr2=0x7fa694156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa698c65640 1 --2- 172.21.15.6:0/2678371120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa69415c1b0 0x7fa694156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa698c65640 1 -- 172.21.15.6:0/2678371120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa690009480 con 0x7fa69415bde0 2023-07-21T22:31:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa699c67640 1 --2- 172.21.15.6:0/2678371120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa69415c1b0 0x7fa694156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:58.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa698c65640 1 --2- 172.21.15.6:0/2678371120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa69415bde0 0x7fa69415d5e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa68400c580 tx=0x7fa68400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa689ffb640 1 -- 172.21.15.6:0/2678371120 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa684003600 con 0x7fa69415bde0 2023-07-21T22:31:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa689ffb640 1 -- 172.21.15.6:0/2678371120 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa684003780 con 0x7fa69415bde0 2023-07-21T22:31:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa689ffb640 1 -- 172.21.15.6:0/2678371120 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa684003b30 con 0x7fa69415bde0 2023-07-21T22:31:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa69b6ca640 1 -- 172.21.15.6:0/2678371120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6941574d0 con 0x7fa69415bde0 2023-07-21T22:31:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa69b6ca640 1 -- 172.21.15.6:0/2678371120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6940c9d20 con 0x7fa69415bde0 2023-07-21T22:31:58.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.212+0000 7fa69b6ca640 1 -- 172.21.15.6:0/2678371120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6940678d0 con 0x7fa69415bde0 2023-07-21T22:31:58.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.216+0000 7fa689ffb640 1 -- 172.21.15.6:0/2678371120 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa684003c90 con 0x7fa69415bde0 2023-07-21T22:31:58.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.216+0000 7fa689ffb640 1 --2- 172.21.15.6:0/2678371120 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fa6780663a0 0x7fa678068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:58.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.216+0000 7fa689ffb640 1 -- 172.21.15.6:0/2678371120 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5254+0+0 (secure 0 0 0) 0x7fa684083120 con 0x7fa69415bde0 2023-07-21T22:31:58.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.216+0000 7fa699466640 1 --2- 172.21.15.6:0/2678371120 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fa6780663a0 0x7fa678068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:58.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.216+0000 7fa699466640 1 --2- 172.21.15.6:0/2678371120 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fa6780663a0 0x7fa678068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa6900af000 tx=0x7fa6900b6040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:58.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.220+0000 7fa689ffb640 1 -- 172.21.15.6:0/2678371120 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa684050910 con 0x7fa69415bde0 2023-07-21T22:31:58.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.376+0000 7fa69b6ca640 1 -- 172.21.15.6:0/2678371120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa6940c5640 con 0x7fa69415bde0 2023-07-21T22:31:58.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.376+0000 7fa689ffb640 1 -- 172.21.15.6:0/2678371120 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa684053f30 con 0x7fa69415bde0 2023-07-21T22:31:58.425 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:31:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.376+0000 7fa69b6ca640 1 -- 172.21.15.6:0/2678371120 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fa6780663a0 msgr2=0x7fa678068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.376+0000 7fa69b6ca640 1 --2- 172.21.15.6:0/2678371120 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fa6780663a0 0x7fa678068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa6900af000 tx=0x7fa6900b6040 comp rx=0 tx=0).stop 2023-07-21T22:31:58.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.376+0000 7fa69b6ca640 1 -- 172.21.15.6:0/2678371120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa69415bde0 msgr2=0x7fa69415d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.376+0000 7fa69b6ca640 1 --2- 172.21.15.6:0/2678371120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa69415bde0 0x7fa69415d5e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fa68400c580 tx=0x7fa68400ca40 comp rx=0 tx=0).stop 2023-07-21T22:31:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.376+0000 7fa69b6ca640 1 -- 172.21.15.6:0/2678371120 shutdown_connections 2023-07-21T22:31:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.376+0000 7fa69b6ca640 1 --2- 172.21.15.6:0/2678371120 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fa6780663a0 0x7fa678068850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.376+0000 7fa69b6ca640 1 --2- 172.21.15.6:0/2678371120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa69415c1b0 0x7fa694156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.376+0000 7fa69b6ca640 1 --2- 172.21.15.6:0/2678371120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa69415bde0 0x7fa69415d5e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.376+0000 7fa69b6ca640 1 --2- 172.21.15.6:0/2678371120 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6940cd120 0x7fa6940c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.376+0000 7fa69b6ca640 1 -- 172.21.15.6:0/2678371120 >> 172.21.15.6:0/2678371120 conn(0x7fa6940659d0 msgr2=0x7fa6941586a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.376+0000 7fa69b6ca640 1 -- 172.21.15.6:0/2678371120 shutdown_connections 2023-07-21T22:31:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.376+0000 7fa69b6ca640 1 -- 172.21.15.6:0/2678371120 wait complete. 2023-07-21T22:31:58.445 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:31:58.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.544+0000 7fa890af9640 1 Processor -- start 2023-07-21T22:31:58.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.544+0000 7fa890af9640 1 -- start start 2023-07-21T22:31:58.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.544+0000 7fa890af9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa88c15f690 0x7fa88c0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:58.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.544+0000 7fa890af9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa88c06a440 0x7fa88c06c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:58.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.544+0000 7fa890af9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88c06c040 con 0x7fa88c1453a0 2023-07-21T22:31:58.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.544+0000 7fa890af9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88c160170 con 0x7fa88c06a440 2023-07-21T22:31:58.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.548+0000 7fa890af9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88c160600 con 0x7fa88c15f690 2023-07-21T22:31:58.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.548+0000 7fa88ad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa88c06a440 0x7fa88c06c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:58.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.548+0000 7fa883fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa88c1453a0 0x7fa88c15fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53602/0 (socket says 172.21.15.6:53602) 2023-07-21T22:31:58.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.548+0000 7fa883fff640 1 -- 172.21.15.6:0/2283229321 learned_addr learned my addr 172.21.15.6:0/2283229321 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:31:58.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.548+0000 7fa88a59c640 1 --2- 172.21.15.6:0/2283229321 >> v2:172.21.15.161:3300/0 conn(0x7fa88c15f690 0x7fa88c0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:58.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.548+0000 7fa88ad9d640 1 -- 172.21.15.6:0/2283229321 >> v2:172.21.15.161:3300/0 conn(0x7fa88c15f690 msgr2=0x7fa88c0b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:58.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.548+0000 7fa88ad9d640 1 --2- 172.21.15.6:0/2283229321 >> v2:172.21.15.161:3300/0 conn(0x7fa88c15f690 0x7fa88c0b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.548+0000 7fa88ad9d640 1 -- 172.21.15.6:0/2283229321 >> v1:172.21.15.6:6789/0 conn(0x7fa88c1453a0 legacy=0x7fa88c15fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:58.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.548+0000 7fa88ad9d640 1 -- 172.21.15.6:0/2283229321 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c160360 con 0x7fa88c06a440 2023-07-21T22:31:58.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.548+0000 7fa889d9b640 1 -- 172.21.15.6:0/2283229321 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172786476 0 0) 0x7fa88c06c040 con 0x7fa88c1453a0 2023-07-21T22:31:58.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.548+0000 7fa88ad9d640 1 --2- 172.21.15.6:0/2283229321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa88c06a440 0x7fa88c06c4d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0aba90 tx=0x7fa88401c5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af05e9709e462ff server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:58.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.548+0000 7fa889d9b640 1 -- 172.21.15.6:0/2283229321 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8840a66d0 con 0x7fa88c06a440 2023-07-21T22:31:58.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.548+0000 7fa889d9b640 1 -- 172.21.15.6:0/2283229321 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8840a6830 con 0x7fa88c06a440 2023-07-21T22:31:58.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.548+0000 7fa889d9b640 1 -- 172.21.15.6:0/2283229321 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8840a6bc0 con 0x7fa88c06a440 2023-07-21T22:31:58.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa890af9640 1 -- 172.21.15.6:0/2283229321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa88c06a440 msgr2=0x7fa88c06c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:58.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa890af9640 1 --2- 172.21.15.6:0/2283229321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa88c06a440 0x7fa88c06c4d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa88c0aba90 tx=0x7fa88401c5e0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa890af9640 1 -- 172.21.15.6:0/2283229321 shutdown_connections 2023-07-21T22:31:58.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa890af9640 1 --2- 172.21.15.6:0/2283229321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa88c06a440 0x7fa88c06c4d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa890af9640 1 --2- 172.21.15.6:0/2283229321 >> v2:172.21.15.161:3300/0 conn(0x7fa88c15f690 0x7fa88c0b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa890af9640 1 -- 172.21.15.6:0/2283229321 >> 172.21.15.6:0/2283229321 conn(0x7fa88c0b1210 msgr2=0x7fa88c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:58.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa890af9640 1 -- 172.21.15.6:0/2283229321 shutdown_connections 2023-07-21T22:31:58.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa890af9640 1 -- 172.21.15.6:0/2283229321 wait complete. 2023-07-21T22:31:58.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa890af9640 1 Processor -- start 2023-07-21T22:31:58.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa890af9640 1 -- start start 2023-07-21T22:31:58.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa890af9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa88c06a440 0x7fa88c138120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:58.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa890af9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa88c1453a0 0x7fa88c13b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:58.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa890af9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa88c15f690 0x7fa88c13b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:58.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa890af9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c13f660 con 0x7fa88c1453a0 2023-07-21T22:31:58.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa890af9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c13f940 con 0x7fa88c15f690 2023-07-21T22:31:58.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa890af9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c13fc20 con 0x7fa88c06a440 2023-07-21T22:31:58.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa883fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa88c1453a0 0x7fa88c13b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:58.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa883fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa88c1453a0 0x7fa88c13b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35538/0 (socket says 172.21.15.6:35538) 2023-07-21T22:31:58.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa883fff640 1 -- 172.21.15.6:0/2492965318 learned_addr learned my addr 172.21.15.6:0/2492965318 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:58.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa88ad9d640 1 --2- 172.21.15.6:0/2492965318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa88c15f690 0x7fa88c13b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:58.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.552+0000 7fa88a59c640 1 --2- 172.21.15.6:0/2492965318 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa88c06a440 0x7fa88c138120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:58.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.556+0000 7fa883fff640 1 -- 172.21.15.6:0/2492965318 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa88c06a440 msgr2=0x7fa88c138120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:58.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.556+0000 7fa883fff640 1 --2- 172.21.15.6:0/2492965318 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa88c06a440 0x7fa88c138120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.556+0000 7fa883fff640 1 -- 172.21.15.6:0/2492965318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa88c15f690 msgr2=0x7fa88c13b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:58.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.556+0000 7fa883fff640 1 --2- 172.21.15.6:0/2492965318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa88c15f690 0x7fa88c13b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.556+0000 7fa883fff640 1 -- 172.21.15.6:0/2492965318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa884009a70 con 0x7fa88c1453a0 2023-07-21T22:31:58.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.556+0000 7fa88ad9d640 1 --2- 172.21.15.6:0/2492965318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa88c15f690 0x7fa88c13b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:58.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.556+0000 7fa88a59c640 1 --2- 172.21.15.6:0/2492965318 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa88c06a440 0x7fa88c138120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:58.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.556+0000 7fa883fff640 1 --2- 172.21.15.6:0/2492965318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa88c1453a0 0x7fa88c13b3d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa87400c480 tx=0x7fa87400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:58.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.556+0000 7fa882ffd640 1 -- 172.21.15.6:0/2492965318 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8740074e0 con 0x7fa88c1453a0 2023-07-21T22:31:58.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.556+0000 7fa882ffd640 1 -- 172.21.15.6:0/2492965318 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa874007660 con 0x7fa88c1453a0 2023-07-21T22:31:58.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.556+0000 7fa882ffd640 1 -- 172.21.15.6:0/2492965318 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa874004a30 con 0x7fa88c1453a0 2023-07-21T22:31:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.556+0000 7fa890af9640 1 -- 172.21.15.6:0/2492965318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88c13ff00 con 0x7fa88c1453a0 2023-07-21T22:31:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.556+0000 7fa890af9640 1 -- 172.21.15.6:0/2492965318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88c138660 con 0x7fa88c1453a0 2023-07-21T22:31:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.556+0000 7fa890af9640 1 -- 172.21.15.6:0/2492965318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88c140140 con 0x7fa88c1453a0 2023-07-21T22:31:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.556+0000 7fa882ffd640 1 -- 172.21.15.6:0/2492965318 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa874004b90 con 0x7fa88c1453a0 2023-07-21T22:31:58.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.556+0000 7fa882ffd640 1 --2- 172.21.15.6:0/2492965318 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fa86c0663d0 0x7fa86c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.560+0000 7fa882ffd640 1 -- 172.21.15.6:0/2492965318 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5254+0+0 (secure 0 0 0) 0x7fa874082cb0 con 0x7fa88c1453a0 2023-07-21T22:31:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.560+0000 7fa88a59c640 1 --2- 172.21.15.6:0/2492965318 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fa86c0663d0 0x7fa86c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.560+0000 7fa88a59c640 1 --2- 172.21.15.6:0/2492965318 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fa86c0663d0 0x7fa86c068880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa87c007a70 tx=0x7fa87c008040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.564+0000 7fa882ffd640 1 -- 172.21.15.6:0/2492965318 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa88c140140 con 0x7fa88c1453a0 2023-07-21T22:31:58.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.716+0000 7fa890af9640 1 -- 172.21.15.6:0/2492965318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa88c13f7a0 con 0x7fa88c1453a0 2023-07-21T22:31:58.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.716+0000 7fa882ffd640 1 -- 172.21.15.6:0/2492965318 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v63) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa88c13f7a0 con 0x7fa88c1453a0 2023-07-21T22:31:58.765 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:31:58.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.716+0000 7fa890af9640 1 -- 172.21.15.6:0/2492965318 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fa86c0663d0 msgr2=0x7fa86c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:58.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.716+0000 7fa890af9640 1 --2- 172.21.15.6:0/2492965318 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fa86c0663d0 0x7fa86c068880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa87c007a70 tx=0x7fa87c008040 comp rx=0 tx=0).stop 2023-07-21T22:31:58.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.716+0000 7fa890af9640 1 -- 172.21.15.6:0/2492965318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa88c1453a0 msgr2=0x7fa88c13b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:58.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.716+0000 7fa890af9640 1 --2- 172.21.15.6:0/2492965318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa88c1453a0 0x7fa88c13b3d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa87400c480 tx=0x7fa87400c940 comp rx=0 tx=0).stop 2023-07-21T22:31:58.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.716+0000 7fa890af9640 1 -- 172.21.15.6:0/2492965318 shutdown_connections 2023-07-21T22:31:58.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.716+0000 7fa890af9640 1 --2- 172.21.15.6:0/2492965318 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fa86c0663d0 0x7fa86c068880 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.716+0000 7fa890af9640 1 --2- 172.21.15.6:0/2492965318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa88c15f690 0x7fa88c13b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.716+0000 7fa890af9640 1 --2- 172.21.15.6:0/2492965318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa88c1453a0 0x7fa88c13b3d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.716+0000 7fa890af9640 1 --2- 172.21.15.6:0/2492965318 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa88c06a440 0x7fa88c138120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.716+0000 7fa890af9640 1 -- 172.21.15.6:0/2492965318 >> 172.21.15.6:0/2492965318 conn(0x7fa88c0b1210 msgr2=0x7fa88c140d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:58.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.716+0000 7fa890af9640 1 -- 172.21.15.6:0/2492965318 shutdown_connections 2023-07-21T22:31:58.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.716+0000 7fa890af9640 1 -- 172.21.15.6:0/2492965318 wait complete. 2023-07-21T22:31:58.786 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T22:31:58.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.880+0000 7f0b2267b640 1 Processor -- start 2023-07-21T22:31:58.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.880+0000 7f0b2267b640 1 -- start start 2023-07-21T22:31:58.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.884+0000 7f0b2267b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0b1c158ce0 0x7f0b1c070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:58.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.884+0000 7f0b2267b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b1c0c9730 0x7f0b1c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:58.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.884+0000 7f0b2267b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b1c0cc700 con 0x7f0b1c0c8ad0 2023-07-21T22:31:58.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.884+0000 7f0b2267b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b1c0b0ff0 con 0x7f0b1c0c9730 2023-07-21T22:31:58.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.884+0000 7f0b2267b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b1c070c80 con 0x7f0b1c158ce0 2023-07-21T22:31:58.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.884+0000 7f0b20c18640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b1c0c9730 0x7f0b1c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:58.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.884+0000 7f0b20c18640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b1c0c9730 0x7f0b1c0ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35544/0 (socket says 172.21.15.6:35544) 2023-07-21T22:31:58.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.884+0000 7f0b20c18640 1 -- 172.21.15.6:0/2821621308 learned_addr learned my addr 172.21.15.6:0/2821621308 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:58.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.884+0000 7f0b1bfff640 1 --2- 172.21.15.6:0/2821621308 >> v2:172.21.15.161:3300/0 conn(0x7f0b1c158ce0 0x7f0b1c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:58.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.884+0000 7f0b20c18640 1 -- 172.21.15.6:0/2821621308 >> v2:172.21.15.161:3300/0 conn(0x7f0b1c158ce0 msgr2=0x7f0b1c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:58.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.884+0000 7f0b20c18640 1 --2- 172.21.15.6:0/2821621308 >> v2:172.21.15.161:3300/0 conn(0x7f0b1c158ce0 0x7f0b1c070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.884+0000 7f0b20c18640 1 -- 172.21.15.6:0/2821621308 >> v1:172.21.15.161:6789/0 conn(0x7f0b1c0c8ad0 legacy=0x7f0b1c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:58.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.884+0000 7f0b20c18640 1 -- 172.21.15.6:0/2821621308 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1c0cbdd0 con 0x7f0b1c0c9730 2023-07-21T22:31:58.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.884+0000 7f0b1bfff640 1 --2- 172.21.15.6:0/2821621308 >> v2:172.21.15.161:3300/0 conn(0x7f0b1c158ce0 0x7f0b1c070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:58.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.888+0000 7f0b20c18640 1 --2- 172.21.15.6:0/2821621308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b1c0c9730 0x7f0b1c0ccb90 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c071be0 tx=0x7f0b1401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f58df2769fdfd0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:58.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.888+0000 7f0b1affd640 1 -- 172.21.15.6:0/2821621308 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b140a5650 con 0x7f0b1c0c9730 2023-07-21T22:31:58.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.888+0000 7f0b1affd640 1 -- 172.21.15.6:0/2821621308 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b140a57b0 con 0x7f0b1c0c9730 2023-07-21T22:31:58.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.888+0000 7f0b1affd640 1 -- 172.21.15.6:0/2821621308 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b140a5b40 con 0x7f0b1c0c9730 2023-07-21T22:31:58.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.888+0000 7f0b2267b640 1 -- 172.21.15.6:0/2821621308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b1c0c9730 msgr2=0x7f0b1c0ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:58.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.888+0000 7f0b2267b640 1 --2- 172.21.15.6:0/2821621308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b1c0c9730 0x7f0b1c0ccb90 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c071be0 tx=0x7f0b1401c880 comp rx=0 tx=0).stop 2023-07-21T22:31:58.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.888+0000 7f0b2267b640 1 -- 172.21.15.6:0/2821621308 shutdown_connections 2023-07-21T22:31:58.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.888+0000 7f0b2267b640 1 --2- 172.21.15.6:0/2821621308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b1c0c9730 0x7f0b1c0ccb90 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.888+0000 7f0b2267b640 1 --2- 172.21.15.6:0/2821621308 >> v2:172.21.15.161:3300/0 conn(0x7f0b1c158ce0 0x7f0b1c070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.888+0000 7f0b2267b640 1 -- 172.21.15.6:0/2821621308 >> 172.21.15.6:0/2821621308 conn(0x7f0b1c0afcf0 msgr2=0x7f0b1c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:58.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.888+0000 7f0b2267b640 1 -- 172.21.15.6:0/2821621308 shutdown_connections 2023-07-21T22:31:58.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.888+0000 7f0b2267b640 1 -- 172.21.15.6:0/2821621308 wait complete. 2023-07-21T22:31:58.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.888+0000 7f0b2267b640 1 Processor -- start 2023-07-21T22:31:58.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.888+0000 7f0b2267b640 1 -- start start 2023-07-21T22:31:58.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b2267b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b1c0c8ad0 0x7f0b1c143300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:58.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b2267b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b1c0c9730 0x7f0b1c1439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:58.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b2267b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b1c158ce0 0x7f0b1c154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:58.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b2267b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c143840 con 0x7f0b1c0c8ad0 2023-07-21T22:31:58.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b2267b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c143ef0 con 0x7f0b1c158ce0 2023-07-21T22:31:58.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b2267b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c154a40 con 0x7f0b1c0c9730 2023-07-21T22:31:58.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b1bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b1c0c8ad0 0x7f0b1c143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:58.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b1bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b1c0c8ad0 0x7f0b1c143300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35548/0 (socket says 172.21.15.6:35548) 2023-07-21T22:31:58.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b1bfff640 1 -- 172.21.15.6:0/4220313418 learned_addr learned my addr 172.21.15.6:0/4220313418 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:58.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b1b7fe640 1 --2- 172.21.15.6:0/4220313418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b1c0c9730 0x7f0b1c1439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:58.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b20c18640 1 --2- 172.21.15.6:0/4220313418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b1c158ce0 0x7f0b1c154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b1bfff640 1 -- 172.21.15.6:0/4220313418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b1c0c9730 msgr2=0x7f0b1c1439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b1bfff640 1 --2- 172.21.15.6:0/4220313418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b1c0c9730 0x7f0b1c1439b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b1bfff640 1 -- 172.21.15.6:0/4220313418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b1c158ce0 msgr2=0x7f0b1c154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:58.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b1bfff640 1 --2- 172.21.15.6:0/4220313418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b1c158ce0 0x7f0b1c154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:58.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b1bfff640 1 -- 172.21.15.6:0/4220313418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b14009b30 con 0x7f0b1c0c8ad0 2023-07-21T22:31:58.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b1bfff640 1 --2- 172.21.15.6:0/4220313418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b1c0c8ad0 0x7f0b1c143300 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00d830 tx=0x7f0b0c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:58.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b18ff9640 1 -- 172.21.15.6:0/4220313418 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c00b6c0 con 0x7f0b1c0c8ad0 2023-07-21T22:31:58.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b18ff9640 1 -- 172.21.15.6:0/4220313418 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c00b820 con 0x7f0b1c0c8ad0 2023-07-21T22:31:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b18ff9640 1 -- 172.21.15.6:0/4220313418 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c00bbd0 con 0x7f0b1c0c8ad0 2023-07-21T22:31:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b2267b640 1 -- 172.21.15.6:0/4220313418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1c1f8180 con 0x7f0b1c0c8ad0 2023-07-21T22:31:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b2267b640 1 -- 172.21.15.6:0/4220313418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1c1546d0 con 0x7f0b1c0c8ad0 2023-07-21T22:31:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.892+0000 7f0b2267b640 1 -- 172.21.15.6:0/4220313418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1c0ca1a0 con 0x7f0b1c0c8ad0 2023-07-21T22:31:58.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.896+0000 7f0b18ff9640 1 -- 172.21.15.6:0/4220313418 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0b0c01e460 con 0x7f0b1c0c8ad0 2023-07-21T22:31:58.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.896+0000 7f0b18ff9640 1 --2- 172.21.15.6:0/4220313418 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0b080663a0 0x7f0b08068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:58.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.896+0000 7f0b18ff9640 1 -- 172.21.15.6:0/4220313418 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5254+0+0 (secure 0 0 0) 0x7f0b0c0841e0 con 0x7f0b1c0c8ad0 2023-07-21T22:31:58.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.896+0000 7f0b1b7fe640 1 --2- 172.21.15.6:0/4220313418 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0b080663a0 0x7f0b08068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.896+0000 7f0b1b7fe640 1 --2- 172.21.15.6:0/4220313418 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0b080663a0 0x7f0b08068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0acdc0 tx=0x7f0b10009040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:58.900+0000 7f0b18ff9640 1 -- 172.21.15.6:0/4220313418 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b0c051880 con 0x7f0b1c0c8ad0 2023-07-21T22:31:59.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.056+0000 7f0b2267b640 1 -- 172.21.15.6:0/4220313418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0b1c0678d0 con 0x7f0b1c0c8ad0 2023-07-21T22:31:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.056+0000 7f0b18ff9640 1 -- 172.21.15.6:0/4220313418 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v63) v1 ==== 84+0+126 (secure 0 0 0) 0x7f0b0c054ea0 con 0x7f0b1c0c8ad0 2023-07-21T22:31:59.106 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:31:59.106 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:31:59.107 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:59.107 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-07-21T22:31:59.107 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-07-21T22:31:59.107 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:31:59.107 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:31:59.107 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-07-21T22:31:59.107 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-07-21T22:31:59.108 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:31:59.108 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:31:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.060+0000 7f0b2267b640 1 -- 172.21.15.6:0/4220313418 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0b080663a0 msgr2=0x7f0b08068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.060+0000 7f0b2267b640 1 --2- 172.21.15.6:0/4220313418 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0b080663a0 0x7f0b08068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0acdc0 tx=0x7f0b10009040 comp rx=0 tx=0).stop 2023-07-21T22:31:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.060+0000 7f0b2267b640 1 -- 172.21.15.6:0/4220313418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b1c0c8ad0 msgr2=0x7f0b1c143300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.060+0000 7f0b2267b640 1 --2- 172.21.15.6:0/4220313418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b1c0c8ad0 0x7f0b1c143300 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c00d830 tx=0x7f0b0c00dcf0 comp rx=0 tx=0).stop 2023-07-21T22:31:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.060+0000 7f0b2267b640 1 -- 172.21.15.6:0/4220313418 shutdown_connections 2023-07-21T22:31:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.060+0000 7f0b2267b640 1 --2- 172.21.15.6:0/4220313418 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0b080663a0 0x7f0b08068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.060+0000 7f0b2267b640 1 --2- 172.21.15.6:0/4220313418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b1c158ce0 0x7f0b1c154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.060+0000 7f0b2267b640 1 --2- 172.21.15.6:0/4220313418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b1c0c9730 0x7f0b1c1439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.060+0000 7f0b2267b640 1 --2- 172.21.15.6:0/4220313418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b1c0c8ad0 0x7f0b1c143300 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.060+0000 7f0b2267b640 1 -- 172.21.15.6:0/4220313418 >> 172.21.15.6:0/4220313418 conn(0x7f0b1c0afcf0 msgr2=0x7f0b1c070dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.060+0000 7f0b2267b640 1 -- 172.21.15.6:0/4220313418 shutdown_connections 2023-07-21T22:31:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.060+0000 7f0b2267b640 1 -- 172.21.15.6:0/4220313418 wait complete. 2023-07-21T22:31:59.128 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-21T22:31:59.128 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-21T22:31:59.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.228+0000 7f4fd8e34640 1 Processor -- start 2023-07-21T22:31:59.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.228+0000 7f4fd8e34640 1 -- start start 2023-07-21T22:31:59.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.228+0000 7f4fd8e34640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4fd4070f30 0x7f4fd40ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:59.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.228+0000 7f4fd8e34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fd40af2b0 0x7f4fd415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:59.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.228+0000 7f4fd8e34640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd4159d70 con 0x7f4fd4069430 2023-07-21T22:31:59.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.228+0000 7f4fd8e34640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd40c9c60 con 0x7f4fd4070f30 2023-07-21T22:31:59.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.228+0000 7f4fd8e34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd40c9f40 con 0x7f4fd40af2b0 2023-07-21T22:31:59.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.228+0000 7f4fcbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4fd4070f30 0x7f4fd40ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:59.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.228+0000 7f4fcbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4fd4070f30 0x7f4fd40ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35562/0 (socket says 172.21.15.6:35562) 2023-07-21T22:31:59.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.228+0000 7f4fcbfff640 1 -- 172.21.15.6:0/964931206 learned_addr learned my addr 172.21.15.6:0/964931206 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:59.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.228+0000 7f4fd2d9d640 1 --2- 172.21.15.6:0/964931206 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fd40af2b0 0x7f4fd415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:59.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.228+0000 7f4fcbfff640 1 -- 172.21.15.6:0/964931206 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fd40af2b0 msgr2=0x7f4fd415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:59.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.228+0000 7f4fcbfff640 1 --2- 172.21.15.6:0/964931206 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fd40af2b0 0x7f4fd415a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:59.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.228+0000 7f4fcbfff640 1 -- 172.21.15.6:0/964931206 >> v1:172.21.15.161:6789/0 conn(0x7f4fd4069430 legacy=0x7f4fd4069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:59.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.228+0000 7f4fcbfff640 1 -- 172.21.15.6:0/964931206 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd40ca220 con 0x7f4fd4070f30 2023-07-21T22:31:59.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.232+0000 7f4fcbfff640 1 --2- 172.21.15.6:0/964931206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fd4070f30 0x7f4fd40ad6f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009870 tx=0x7f4fbc01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1930a2c32b5b7fc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:59.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.232+0000 7f4fd1d9b640 1 -- 172.21.15.6:0/964931206 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0a9400 con 0x7f4fd4070f30 2023-07-21T22:31:59.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.232+0000 7f4fd1d9b640 1 -- 172.21.15.6:0/964931206 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc0a9560 con 0x7f4fd4070f30 2023-07-21T22:31:59.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.232+0000 7f4fd1d9b640 1 -- 172.21.15.6:0/964931206 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0a98f0 con 0x7f4fd4070f30 2023-07-21T22:31:59.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.232+0000 7f4fd8e34640 1 -- 172.21.15.6:0/964931206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fd4070f30 msgr2=0x7f4fd40ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:59.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.232+0000 7f4fd8e34640 1 --2- 172.21.15.6:0/964931206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fd4070f30 0x7f4fd40ad6f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009870 tx=0x7f4fbc01c540 comp rx=0 tx=0).stop 2023-07-21T22:31:59.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.232+0000 7f4fd8e34640 1 -- 172.21.15.6:0/964931206 shutdown_connections 2023-07-21T22:31:59.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.232+0000 7f4fd8e34640 1 --2- 172.21.15.6:0/964931206 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fd40af2b0 0x7f4fd415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:59.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.232+0000 7f4fd8e34640 1 --2- 172.21.15.6:0/964931206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fd4070f30 0x7f4fd40ad6f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:59.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.232+0000 7f4fd8e34640 1 -- 172.21.15.6:0/964931206 >> 172.21.15.6:0/964931206 conn(0x7f4fd40cde90 msgr2=0x7f4fd40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:59.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.232+0000 7f4fd8e34640 1 -- 172.21.15.6:0/964931206 shutdown_connections 2023-07-21T22:31:59.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.232+0000 7f4fd8e34640 1 -- 172.21.15.6:0/964931206 wait complete. 2023-07-21T22:31:59.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fd8e34640 1 Processor -- start 2023-07-21T22:31:59.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fd8e34640 1 -- start start 2023-07-21T22:31:59.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fd8e34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fd4069430 0x7f4fd414f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:59.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fd8e34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fd4070f30 0x7f4fd40ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:59.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fd8e34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fd40af2b0 0x7f4fd40abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:59.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fd8e34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4157050 con 0x7f4fd4069430 2023-07-21T22:31:59.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fd8e34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd41567b0 con 0x7f4fd40af2b0 2023-07-21T22:31:59.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fd8e34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4156a90 con 0x7f4fd4070f30 2023-07-21T22:31:59.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fd259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fd4069430 0x7f4fd414f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:59.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fd259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fd4069430 0x7f4fd414f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35566/0 (socket says 172.21.15.6:35566) 2023-07-21T22:31:59.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fd259c640 1 -- 172.21.15.6:0/1539336346 learned_addr learned my addr 172.21.15.6:0/1539336346 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:31:59.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fcbfff640 1 --2- 172.21.15.6:0/1539336346 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fd4070f30 0x7f4fd40ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:59.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fd2d9d640 1 --2- 172.21.15.6:0/1539336346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fd40af2b0 0x7f4fd40abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:59.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fd259c640 1 -- 172.21.15.6:0/1539336346 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fd4070f30 msgr2=0x7f4fd40ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:59.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fd259c640 1 --2- 172.21.15.6:0/1539336346 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fd4070f30 0x7f4fd40ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:59.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fd259c640 1 -- 172.21.15.6:0/1539336346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fd40af2b0 msgr2=0x7f4fd40abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:59.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fd259c640 1 --2- 172.21.15.6:0/1539336346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fd40af2b0 0x7f4fd40abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:59.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fd259c640 1 -- 172.21.15.6:0/1539336346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc0094d0 con 0x7f4fd4069430 2023-07-21T22:31:59.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fcbfff640 1 --2- 172.21.15.6:0/1539336346 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fd4070f30 0x7f4fd40ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:31:59.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fd259c640 1 --2- 172.21.15.6:0/1539336346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fd4069430 0x7f4fd414f890 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400c3c0 tx=0x7f4fc400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:59.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fcaffd640 1 -- 172.21.15.6:0/1539336346 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc40052d0 con 0x7f4fd4069430 2023-07-21T22:31:59.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fcaffd640 1 -- 172.21.15.6:0/1539336346 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc4005430 con 0x7f4fd4069430 2023-07-21T22:31:59.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fd8e34640 1 -- 172.21.15.6:0/1539336346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd4156d70 con 0x7f4fd4069430 2023-07-21T22:31:59.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fcaffd640 1 -- 172.21.15.6:0/1539336346 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc4003840 con 0x7f4fd4069430 2023-07-21T22:31:59.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.236+0000 7f4fd8e34640 1 -- 172.21.15.6:0/1539336346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd4156460 con 0x7f4fd4069430 2023-07-21T22:31:59.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.240+0000 7f4fd8e34640 1 -- 172.21.15.6:0/1539336346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd40678d0 con 0x7f4fd4069430 2023-07-21T22:31:59.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.240+0000 7f4fcaffd640 1 -- 172.21.15.6:0/1539336346 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4fc40039a0 con 0x7f4fd4069430 2023-07-21T22:31:59.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.240+0000 7f4fcaffd640 1 --2- 172.21.15.6:0/1539336346 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f4fb40663a0 0x7f4fb4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:59.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.240+0000 7f4fcaffd640 1 -- 172.21.15.6:0/1539336346 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5254+0+0 (secure 0 0 0) 0x7f4fc4082e80 con 0x7f4fd4069430 2023-07-21T22:31:59.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.240+0000 7f4fcbfff640 1 --2- 172.21.15.6:0/1539336346 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f4fb40663a0 0x7f4fb4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:59.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.240+0000 7f4fcbfff640 1 --2- 172.21.15.6:0/1539336346 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f4fb40663a0 0x7f4fb4068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc0ae000 tx=0x7f4fbc0b3040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:59.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.244+0000 7f4fcaffd640 1 -- 172.21.15.6:0/1539336346 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4fc40505a0 con 0x7f4fd4069430 2023-07-21T22:31:59.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.400+0000 7f4fd8e34640 1 -- 172.21.15.6:0/1539336346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4fd4159d70 con 0x7f4fd4069430 2023-07-21T22:31:59.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.916+0000 7f4fcaffd640 1 -- 172.21.15.6:0/1539336346 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v64) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4fd4159d70 con 0x7f4fd4069430 2023-07-21T22:31:59.966 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-07-21T22:31:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.920+0000 7f4fd8e34640 1 -- 172.21.15.6:0/1539336346 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f4fb40663a0 msgr2=0x7f4fb4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.920+0000 7f4fd8e34640 1 --2- 172.21.15.6:0/1539336346 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f4fb40663a0 0x7f4fb4068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc0ae000 tx=0x7f4fbc0b3040 comp rx=0 tx=0).stop 2023-07-21T22:31:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.920+0000 7f4fd8e34640 1 -- 172.21.15.6:0/1539336346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fd4069430 msgr2=0x7f4fd414f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.920+0000 7f4fd8e34640 1 --2- 172.21.15.6:0/1539336346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fd4069430 0x7f4fd414f890 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400c3c0 tx=0x7f4fc400c880 comp rx=0 tx=0).stop 2023-07-21T22:31:59.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.920+0000 7f4fd8e34640 1 -- 172.21.15.6:0/1539336346 shutdown_connections 2023-07-21T22:31:59.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.920+0000 7f4fd8e34640 1 --2- 172.21.15.6:0/1539336346 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f4fb40663a0 0x7f4fb4068850 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc0ae000 tx=0x7f4fbc0b3040 comp rx=0 tx=0).stop 2023-07-21T22:31:59.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.920+0000 7f4fd8e34640 1 --2- 172.21.15.6:0/1539336346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fd40af2b0 0x7f4fd40abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:59.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.920+0000 7f4fd8e34640 1 --2- 172.21.15.6:0/1539336346 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4fd4070f30 0x7f4fd40ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:59.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.920+0000 7f4fd8e34640 1 --2- 172.21.15.6:0/1539336346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fd4069430 0x7f4fd414f890 secure :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400c3c0 tx=0x7f4fc400c880 comp rx=0 tx=0).stop 2023-07-21T22:31:59.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.920+0000 7f4fd8e34640 1 -- 172.21.15.6:0/1539336346 >> 172.21.15.6:0/1539336346 conn(0x7f4fd40cde90 msgr2=0x7f4fd406fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:59.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.924+0000 7f4fd8e34640 1 -- 172.21.15.6:0/1539336346 shutdown_connections 2023-07-21T22:31:59.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:31:59.924+0000 7f4fd8e34640 1 -- 172.21.15.6:0/1539336346 wait complete. 2023-07-21T22:31:59.994 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T22:32:00.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.100+0000 7f21ebdd2640 1 Processor -- start 2023-07-21T22:32:00.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.100+0000 7f21ebdd2640 1 -- start start 2023-07-21T22:32:00.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.100+0000 7f21ebdd2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21e40d29f0 0x7f21e4166980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:00.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.100+0000 7f21ebdd2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e40d0aa0 con 0x7f21e415bec0 2023-07-21T22:32:00.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.100+0000 7f21ebdd2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e40d07c0 con 0x7f21e40d0250 2023-07-21T22:32:00.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.100+0000 7f21ebdd2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e40b1dc0 con 0x7f21e40d29f0 2023-07-21T22:32:00.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.100+0000 7f21e9b6e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f21e415bec0 0x7f21e40cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53616/0 (socket says 172.21.15.6:53616) 2023-07-21T22:32:00.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.100+0000 7f21e9b6e640 1 -- 172.21.15.6:0/55012379 learned_addr learned my addr 172.21.15.6:0/55012379 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:32:00.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.100+0000 7f21ea36f640 1 --2- 172.21.15.6:0/55012379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21e40d29f0 0x7f21e4166980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:00.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.100+0000 7f21e8b6c640 1 -- 172.21.15.6:0/55012379 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771420976 0 0) 0x7f21e0001120 con 0x7f21e415bec0 2023-07-21T22:32:00.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.100+0000 7f21e8b6c640 1 -- 172.21.15.6:0/55012379 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21d0003530 con 0x7f21e415bec0 2023-07-21T22:32:00.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.100+0000 7f21e8b6c640 1 -- 172.21.15.6:0/55012379 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649995517 0 0) 0x7f21e40d07c0 con 0x7f21e40d0250 2023-07-21T22:32:00.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.100+0000 7f21e8b6c640 1 -- 172.21.15.6:0/55012379 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21e0001120 con 0x7f21e40d0250 2023-07-21T22:32:00.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.100+0000 7f21ea36f640 1 -- 172.21.15.6:0/55012379 >> v1:172.21.15.161:6789/0 conn(0x7f21e40d0250 legacy=0x7f21e40d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:00.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.100+0000 7f21e8b6c640 1 -- 172.21.15.6:0/55012379 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3137932337 0 0) 0x7f21d0003530 con 0x7f21e415bec0 2023-07-21T22:32:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.100+0000 7f21ea36f640 1 -- 172.21.15.6:0/55012379 >> v1:172.21.15.6:6789/0 conn(0x7f21e415bec0 legacy=0x7f21e40cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:00.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.100+0000 7f21ea36f640 1 -- 172.21.15.6:0/55012379 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e40b20a0 con 0x7f21e40d29f0 2023-07-21T22:32:00.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.104+0000 7f21ea36f640 1 --2- 172.21.15.6:0/55012379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21e40d29f0 0x7f21e4166980 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009dc0 tx=0x7f21dc01c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=323c7ab1784502a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:00.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.104+0000 7f21e8b6c640 1 -- 172.21.15.6:0/55012379 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0001810 con 0x7f21e40d29f0 2023-07-21T22:32:00.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.104+0000 7f21e8b6c640 1 -- 172.21.15.6:0/55012379 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21dc0a55b0 con 0x7f21e40d29f0 2023-07-21T22:32:00.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.104+0000 7f21e8b6c640 1 -- 172.21.15.6:0/55012379 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21dc0a5940 con 0x7f21e40d29f0 2023-07-21T22:32:00.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.104+0000 7f21ebdd2640 1 -- 172.21.15.6:0/55012379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21e40d29f0 msgr2=0x7f21e4166980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:00.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.104+0000 7f21ebdd2640 1 --2- 172.21.15.6:0/55012379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21e40d29f0 0x7f21e4166980 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009dc0 tx=0x7f21dc01c860 comp rx=0 tx=0).stop 2023-07-21T22:32:00.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.104+0000 7f21ebdd2640 1 -- 172.21.15.6:0/55012379 shutdown_connections 2023-07-21T22:32:00.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.104+0000 7f21ebdd2640 1 --2- 172.21.15.6:0/55012379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21e40d29f0 0x7f21e4166980 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:00.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.104+0000 7f21ebdd2640 1 -- 172.21.15.6:0/55012379 >> 172.21.15.6:0/55012379 conn(0x7f21e40659d0 msgr2=0x7f21e409b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:00.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.104+0000 7f21ebdd2640 1 -- 172.21.15.6:0/55012379 shutdown_connections 2023-07-21T22:32:00.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.104+0000 7f21ebdd2640 1 -- 172.21.15.6:0/55012379 wait complete. 2023-07-21T22:32:00.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21ebdd2640 1 Processor -- start 2023-07-21T22:32:00.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21ebdd2640 1 -- start start 2023-07-21T22:32:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21ebdd2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21e40d0250 0x7f21e40b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21ebdd2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21e40d29f0 0x7f21e40b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21ebdd2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21e415bec0 0x7f21e414d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21ebdd2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e40b6520 con 0x7f21e40d0250 2023-07-21T22:32:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21ebdd2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e40b7e10 con 0x7f21e40d29f0 2023-07-21T22:32:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21ebdd2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e414d910 con 0x7f21e415bec0 2023-07-21T22:32:00.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21e9b6e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21e40d0250 0x7f21e40b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21e9b6e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21e40d0250 0x7f21e40b6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35580/0 (socket says 172.21.15.6:35580) 2023-07-21T22:32:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21e9b6e640 1 -- 172.21.15.6:0/2007337779 learned_addr learned my addr 172.21.15.6:0/2007337779 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21e936d640 1 --2- 172.21.15.6:0/2007337779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21e40d29f0 0x7f21e40b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21ea36f640 1 --2- 172.21.15.6:0/2007337779 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21e415bec0 0x7f21e414d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21e9b6e640 1 -- 172.21.15.6:0/2007337779 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21e415bec0 msgr2=0x7f21e414d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21e9b6e640 1 --2- 172.21.15.6:0/2007337779 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21e415bec0 0x7f21e414d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21e9b6e640 1 -- 172.21.15.6:0/2007337779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21e40d29f0 msgr2=0x7f21e40b5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21e9b6e640 1 --2- 172.21.15.6:0/2007337779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21e40d29f0 0x7f21e40b5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21e9b6e640 1 -- 172.21.15.6:0/2007337779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc009a70 con 0x7f21e40d0250 2023-07-21T22:32:00.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21e9b6e640 1 --2- 172.21.15.6:0/2007337779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21e40d0250 0x7f21e40b6b40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f21e000c7b0 tx=0x7f21e000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:00.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21da7fc640 1 -- 172.21.15.6:0/2007337779 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0005cf0 con 0x7f21e40d0250 2023-07-21T22:32:00.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21da7fc640 1 -- 172.21.15.6:0/2007337779 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e0005e70 con 0x7f21e40d0250 2023-07-21T22:32:00.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21da7fc640 1 -- 172.21.15.6:0/2007337779 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0007290 con 0x7f21e40d0250 2023-07-21T22:32:00.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21ebdd2640 1 -- 172.21.15.6:0/2007337779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e40b7200 con 0x7f21e40d0250 2023-07-21T22:32:00.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.108+0000 7f21ebdd2640 1 -- 172.21.15.6:0/2007337779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e40b77c0 con 0x7f21e40d0250 2023-07-21T22:32:00.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.112+0000 7f21ebdd2640 1 -- 172.21.15.6:0/2007337779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e40678d0 con 0x7f21e40d0250 2023-07-21T22:32:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.112+0000 7f21da7fc640 1 -- 172.21.15.6:0/2007337779 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f21e00073f0 con 0x7f21e40d0250 2023-07-21T22:32:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.112+0000 7f21da7fc640 1 --2- 172.21.15.6:0/2007337779 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f21c80663d0 0x7f21c8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.112+0000 7f21da7fc640 1 -- 172.21.15.6:0/2007337779 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5624+0+0 (secure 0 0 0) 0x7f21e0083a50 con 0x7f21e40d0250 2023-07-21T22:32:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.112+0000 7f21e936d640 1 --2- 172.21.15.6:0/2007337779 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f21c80663d0 0x7f21c8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.116+0000 7f21e936d640 1 --2- 172.21.15.6:0/2007337779 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f21c80663d0 0x7f21c8068880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f21e40b08a0 tx=0x7f21d4009040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:00.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.116+0000 7f21da7fc640 1 -- 172.21.15.6:0/2007337779 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f21e0050e40 con 0x7f21e40d0250 2023-07-21T22:32:00.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.272+0000 7f21ebdd2640 1 -- 172.21.15.6:0/2007337779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f21e40d0aa0 con 0x7f21e40d0250 2023-07-21T22:32:00.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.928+0000 7f21da7fc640 1 -- 172.21.15.6:0/2007337779 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v65) v1 ==== 170+0+0 (secure 0 0 0) 0x7f21e40d0aa0 con 0x7f21e40d0250 2023-07-21T22:32:00.980 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-07-21T22:32:00.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.936+0000 7f21ebdd2640 1 -- 172.21.15.6:0/2007337779 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f21c80663d0 msgr2=0x7f21c8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:00.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.936+0000 7f21ebdd2640 1 --2- 172.21.15.6:0/2007337779 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f21c80663d0 0x7f21c8068880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f21e40b08a0 tx=0x7f21d4009040 comp rx=0 tx=0).stop 2023-07-21T22:32:00.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.936+0000 7f21ebdd2640 1 -- 172.21.15.6:0/2007337779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21e40d0250 msgr2=0x7f21e40b6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:00.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.936+0000 7f21ebdd2640 1 --2- 172.21.15.6:0/2007337779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21e40d0250 0x7f21e40b6b40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f21e000c7b0 tx=0x7f21e000cc70 comp rx=0 tx=0).stop 2023-07-21T22:32:00.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.948+0000 7f21ebdd2640 1 -- 172.21.15.6:0/2007337779 shutdown_connections 2023-07-21T22:32:00.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.948+0000 7f21ebdd2640 1 --2- 172.21.15.6:0/2007337779 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f21c80663d0 0x7f21c8068880 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:00.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.948+0000 7f21ebdd2640 1 --2- 172.21.15.6:0/2007337779 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f21e415bec0 0x7f21e414d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:00.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.948+0000 7f21ebdd2640 1 --2- 172.21.15.6:0/2007337779 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f21e40d29f0 0x7f21e40b5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:00.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.948+0000 7f21ebdd2640 1 --2- 172.21.15.6:0/2007337779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21e40d0250 0x7f21e40b6b40 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:00.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.948+0000 7f21ebdd2640 1 -- 172.21.15.6:0/2007337779 >> 172.21.15.6:0/2007337779 conn(0x7f21e40659d0 msgr2=0x7f21e415ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:00.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.948+0000 7f21ebdd2640 1 -- 172.21.15.6:0/2007337779 shutdown_connections 2023-07-21T22:32:00.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:00.952+0000 7f21ebdd2640 1 -- 172.21.15.6:0/2007337779 wait complete. 2023-07-21T22:32:01.022 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-21T22:32:01.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c90ad8640 1 Processor -- start 2023-07-21T22:32:01.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c90ad8640 1 -- start start 2023-07-21T22:32:01.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c90ad8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8c15cef0 0x7f0c8c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c90ad8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8c1532b0 con 0x7f0c8c0aeb40 2023-07-21T22:32:01.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c90ad8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8c0ca6f0 con 0x7f0c8c159270 2023-07-21T22:32:01.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c90ad8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c15d360 con 0x7f0c8c15cef0 2023-07-21T22:32:01.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c8a59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0c8c0aeb40 0x7f0c8c0aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53628/0 (socket says 172.21.15.6:53628) 2023-07-21T22:32:01.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c8a59c640 1 -- 172.21.15.6:0/2828321923 learned_addr learned my addr 172.21.15.6:0/2828321923 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:32:01.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c83fff640 1 --2- 172.21.15.6:0/2828321923 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8c15cef0 0x7f0c8c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c89d9b640 1 -- 172.21.15.6:0/2828321923 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156480732 0 0) 0x7f0c8c1532b0 con 0x7f0c8c0aeb40 2023-07-21T22:32:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c89d9b640 1 -- 172.21.15.6:0/2828321923 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c78003530 con 0x7f0c8c0aeb40 2023-07-21T22:32:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c89d9b640 1 -- 172.21.15.6:0/2828321923 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794182390 0 0) 0x7f0c8c0ca6f0 con 0x7f0c8c159270 2023-07-21T22:32:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c89d9b640 1 -- 172.21.15.6:0/2828321923 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c8c1532b0 con 0x7f0c8c159270 2023-07-21T22:32:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c89d9b640 1 -- 172.21.15.6:0/2828321923 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2478969204 0 0) 0x7f0c78003530 con 0x7f0c8c0aeb40 2023-07-21T22:32:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c89d9b640 1 -- 172.21.15.6:0/2828321923 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8c15cef0 msgr2=0x7f0c8c158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:01.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c89d9b640 1 --2- 172.21.15.6:0/2828321923 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8c15cef0 0x7f0c8c158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c89d9b640 1 -- 172.21.15.6:0/2828321923 >> v1:172.21.15.161:6789/0 conn(0x7f0c8c159270 legacy=0x7f0c8c0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c89d9b640 1 -- 172.21.15.6:0/2828321923 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c1599d0 con 0x7f0c8c0aeb40 2023-07-21T22:32:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c89d9b640 1 -- 172.21.15.6:0/2828321923 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f0c7c001680 con 0x7f0c8c0aeb40 2023-07-21T22:32:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c89d9b640 1 -- 172.21.15.6:0/2828321923 >> v1:172.21.15.6:6789/0 conn(0x7f0c8c0aeb40 legacy=0x7f0c8c0aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c89d9b640 1 --2- 172.21.15.6:0/2828321923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c78003b40 0x7f0c78003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c89d9b640 1 --2- 172.21.15.6:0/2828321923 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c780047d0 0x7f0c78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c89d9b640 1 --2- 172.21.15.6:0/2828321923 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c78005180 0x7f0c7800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c89d9b640 1 -- 172.21.15.6:0/2828321923 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c15d360 con 0x7f0c78003b40 2023-07-21T22:32:01.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c89d9b640 1 -- 172.21.15.6:0/2828321923 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7800bf50 con 0x7f0c78005180 2023-07-21T22:32:01.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c89d9b640 1 -- 172.21.15.6:0/2828321923 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7800e320 con 0x7f0c780047d0 2023-07-21T22:32:01.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.124+0000 7f0c83fff640 1 --2- 172.21.15.6:0/2828321923 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8c15cef0 0x7f0c8c158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:32:01.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.128+0000 7f0c8a59c640 1 --2- 172.21.15.6:0/2828321923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c78003b40 0x7f0c78003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.128+0000 7f0c8ad9d640 1 --2- 172.21.15.6:0/2828321923 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c78005180 0x7f0c7800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.128+0000 7f0c83fff640 1 --2- 172.21.15.6:0/2828321923 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c780047d0 0x7f0c78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.128+0000 7f0c8a59c640 1 -- 172.21.15.6:0/2828321923 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c780047d0 msgr2=0x7f0c78004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:01.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.128+0000 7f0c8a59c640 1 --2- 172.21.15.6:0/2828321923 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c780047d0 0x7f0c78004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.128+0000 7f0c8a59c640 1 -- 172.21.15.6:0/2828321923 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c78005180 msgr2=0x7f0c7800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:01.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.128+0000 7f0c8a59c640 1 --2- 172.21.15.6:0/2828321923 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c78005180 0x7f0c7800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.128+0000 7f0c8a59c640 1 -- 172.21.15.6:0/2828321923 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c78003530 con 0x7f0c78003b40 2023-07-21T22:32:01.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.128+0000 7f0c8ad9d640 1 --2- 172.21.15.6:0/2828321923 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c78005180 0x7f0c7800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:01.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.128+0000 7f0c8a59c640 1 --2- 172.21.15.6:0/2828321923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c78003b40 0x7f0c78003f30 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00c160 tx=0x7f0c7c01cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e355afd08fc666b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:01.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.128+0000 7f0c89d9b640 1 -- 172.21.15.6:0/2828321923 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0058e0 con 0x7f0c78003b40 2023-07-21T22:32:01.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.128+0000 7f0c89d9b640 1 -- 172.21.15.6:0/2828321923 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c005a60 con 0x7f0c78003b40 2023-07-21T22:32:01.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.128+0000 7f0c89d9b640 1 -- 172.21.15.6:0/2828321923 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c005e10 con 0x7f0c78003b40 2023-07-21T22:32:01.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.128+0000 7f0c90ad8640 1 -- 172.21.15.6:0/2828321923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c78003b40 msgr2=0x7f0c78003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:01.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c90ad8640 1 --2- 172.21.15.6:0/2828321923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c78003b40 0x7f0c78003f30 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00c160 tx=0x7f0c7c01cad0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c8ad9d640 1 -- 172.21.15.6:0/2828321923 reap_dead start 2023-07-21T22:32:01.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c90ad8640 1 -- 172.21.15.6:0/2828321923 shutdown_connections 2023-07-21T22:32:01.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c90ad8640 1 -- 172.21.15.6:0/2828321923 >> 172.21.15.6:0/2828321923 conn(0x7f0c8c0cde90 msgr2=0x7f0c8c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:01.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c90ad8640 1 -- 172.21.15.6:0/2828321923 shutdown_connections 2023-07-21T22:32:01.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c90ad8640 1 -- 172.21.15.6:0/2828321923 wait complete. 2023-07-21T22:32:01.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c90ad8640 1 Processor -- start 2023-07-21T22:32:01.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c90ad8640 1 -- start start 2023-07-21T22:32:01.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c90ad8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c78003b40 0x7f0c8c1427c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c90ad8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c8c157c20 0x7f0c8c14db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c90ad8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c8c158050 0x7f0c8c14e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c90ad8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c06f060 con 0x7f0c8c157c20 2023-07-21T22:32:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c90ad8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c15e050 con 0x7f0c8c158050 2023-07-21T22:32:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c90ad8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c15e330 con 0x7f0c78003b40 2023-07-21T22:32:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c83fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c8c157c20 0x7f0c8c14db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c83fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c8c157c20 0x7f0c8c14db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35598/0 (socket says 172.21.15.6:35598) 2023-07-21T22:32:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c83fff640 1 -- 172.21.15.6:0/3886957877 learned_addr learned my addr 172.21.15.6:0/3886957877 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c8a59c640 1 --2- 172.21.15.6:0/3886957877 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c78003b40 0x7f0c8c1427c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c8ad9d640 1 --2- 172.21.15.6:0/3886957877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c8c158050 0x7f0c8c14e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c83fff640 1 -- 172.21.15.6:0/3886957877 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c78003b40 msgr2=0x7f0c8c1427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:01.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c83fff640 1 --2- 172.21.15.6:0/3886957877 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c78003b40 0x7f0c8c1427c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c83fff640 1 -- 172.21.15.6:0/3886957877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c8c158050 msgr2=0x7f0c8c14e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:01.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c83fff640 1 --2- 172.21.15.6:0/3886957877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c8c158050 0x7f0c8c14e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c83fff640 1 -- 172.21.15.6:0/3886957877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c15e610 con 0x7f0c8c157c20 2023-07-21T22:32:01.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.132+0000 7f0c8a59c640 1 --2- 172.21.15.6:0/3886957877 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c78003b40 0x7f0c8c1427c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.136+0000 7f0c83fff640 1 --2- 172.21.15.6:0/3886957877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c8c157c20 0x7f0c8c14db20 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f0c74011c00 tx=0x7f0c74011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.136+0000 7f0c82ffd640 1 -- 172.21.15.6:0/3886957877 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c74011ee0 con 0x7f0c8c157c20 2023-07-21T22:32:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.136+0000 7f0c82ffd640 1 -- 172.21.15.6:0/3886957877 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7400fa30 con 0x7f0c8c157c20 2023-07-21T22:32:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.136+0000 7f0c82ffd640 1 -- 172.21.15.6:0/3886957877 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7400fda0 con 0x7f0c8c157c20 2023-07-21T22:32:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.136+0000 7f0c90ad8640 1 -- 172.21.15.6:0/3886957877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c8c15e8f0 con 0x7f0c8c157c20 2023-07-21T22:32:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.136+0000 7f0c90ad8640 1 -- 172.21.15.6:0/3886957877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8c14a920 con 0x7f0c8c157c20 2023-07-21T22:32:01.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.136+0000 7f0c90ad8640 1 -- 172.21.15.6:0/3886957877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8c06f1d0 con 0x7f0c8c157c20 2023-07-21T22:32:01.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.136+0000 7f0c82ffd640 1 -- 172.21.15.6:0/3886957877 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0c7401d400 con 0x7f0c8c157c20 2023-07-21T22:32:01.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.136+0000 7f0c82ffd640 1 --2- 172.21.15.6:0/3886957877 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0c6c0663d0 0x7f0c6c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.136+0000 7f0c82ffd640 1 -- 172.21.15.6:0/3886957877 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f0c74084910 con 0x7f0c8c157c20 2023-07-21T22:32:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.140+0000 7f0c8a59c640 1 --2- 172.21.15.6:0/3886957877 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0c6c0663d0 0x7f0c6c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.140+0000 7f0c8a59c640 1 --2- 172.21.15.6:0/3886957877 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0c6c0663d0 0x7f0c6c068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0aa000 tx=0x7f0c7c001a00 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:01.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.140+0000 7f0c82ffd640 1 -- 172.21.15.6:0/3886957877 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c74051dd0 con 0x7f0c8c157c20 2023-07-21T22:32:01.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.328+0000 7f0c90ad8640 1 -- 172.21.15.6:0/3886957877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0c8c0678d0 con 0x7f0c8c157c20 2023-07-21T22:32:02.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.952+0000 7f0c82ffd640 1 -- 172.21.15.6:0/3886957877 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0c740553f0 con 0x7f0c8c157c20 2023-07-21T22:32:02.009 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 7 and data pool 8 2023-07-21T22:32:02.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.968+0000 7f0c90ad8640 1 -- 172.21.15.6:0/3886957877 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0c6c0663d0 msgr2=0x7f0c6c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:02.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.968+0000 7f0c90ad8640 1 --2- 172.21.15.6:0/3886957877 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0c6c0663d0 0x7f0c6c068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0aa000 tx=0x7f0c7c001a00 comp rx=0 tx=0).stop 2023-07-21T22:32:02.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.968+0000 7f0c90ad8640 1 -- 172.21.15.6:0/3886957877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c8c157c20 msgr2=0x7f0c8c14db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:02.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.968+0000 7f0c90ad8640 1 --2- 172.21.15.6:0/3886957877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c8c157c20 0x7f0c8c14db20 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f0c74011c00 tx=0x7f0c74011cf0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.972+0000 7f0c90ad8640 1 -- 172.21.15.6:0/3886957877 shutdown_connections 2023-07-21T22:32:02.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.972+0000 7f0c90ad8640 1 --2- 172.21.15.6:0/3886957877 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0c6c0663d0 0x7f0c6c068880 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.976+0000 7f0c90ad8640 1 --2- 172.21.15.6:0/3886957877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c8c158050 0x7f0c8c14e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.976+0000 7f0c90ad8640 1 --2- 172.21.15.6:0/3886957877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c8c157c20 0x7f0c8c14db20 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.976+0000 7f0c90ad8640 1 --2- 172.21.15.6:0/3886957877 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c78003b40 0x7f0c8c1427c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.976+0000 7f0c90ad8640 1 -- 172.21.15.6:0/3886957877 >> 172.21.15.6:0/3886957877 conn(0x7f0c8c0cde90 msgr2=0x7f0c8c0c3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:02.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.976+0000 7f0c90ad8640 1 -- 172.21.15.6:0/3886957877 shutdown_connections 2023-07-21T22:32:02.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:01.976+0000 7f0c90ad8640 1 -- 172.21.15.6:0/3886957877 wait complete. 2023-07-21T22:32:02.047 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:32:02.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.144+0000 7ffb051d2640 1 Processor -- start 2023-07-21T22:32:02.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.144+0000 7ffb051d2640 1 -- start start 2023-07-21T22:32:02.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.144+0000 7ffb051d2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffb0015fd60 0x7ffb000d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:02.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.144+0000 7ffb051d2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb000ccaf0 con 0x7ffb000d1850 2023-07-21T22:32:02.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.144+0000 7ffb051d2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb00160320 con 0x7ffb000b7c70 2023-07-21T22:32:02.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.144+0000 7ffb051d2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb000d1190 con 0x7ffb0015fd60 2023-07-21T22:32:02.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.144+0000 7ffaf7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffb0015fd60 0x7ffb000d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:02.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.144+0000 7ffaf7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffb0015fd60 0x7ffb000d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35608/0 (socket says 172.21.15.6:35608) 2023-07-21T22:32:02.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.144+0000 7ffaf7fff640 1 -- 172.21.15.6:0/700560779 learned_addr learned my addr 172.21.15.6:0/700560779 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:02.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.144+0000 7ffaff59e640 1 --1- 172.21.15.6:0/700560779 >> v1:172.21.15.6:6789/0 conn(0x7ffb000d1850 0x7ffb000d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53642/0 (socket says 172.21.15.6:53642) 2023-07-21T22:32:02.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.144+0000 7ffaf7fff640 1 -- 172.21.15.6:0/700560779 >> v1:172.21.15.161:6789/0 conn(0x7ffb000b7c70 legacy=0x7ffb0015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:02.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.144+0000 7ffaf7fff640 1 -- 172.21.15.6:0/700560779 >> v1:172.21.15.6:6789/0 conn(0x7ffb000d1850 legacy=0x7ffb000d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:02.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.144+0000 7ffaf7fff640 1 -- 172.21.15.6:0/700560779 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb000ccd90 con 0x7ffb0015fd60 2023-07-21T22:32:02.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.148+0000 7ffaf7fff640 1 --2- 172.21.15.6:0/700560779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb0015fd60 0x7ffb000d0c50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ffae8009870 tx=0x7ffae801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2d3bd068b2d3a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:02.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.148+0000 7ffafe59c640 1 -- 172.21.15.6:0/700560779 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae80ab650 con 0x7ffb0015fd60 2023-07-21T22:32:02.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.148+0000 7ffafe59c640 1 -- 172.21.15.6:0/700560779 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae80ab7b0 con 0x7ffb0015fd60 2023-07-21T22:32:02.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.148+0000 7ffafe59c640 1 -- 172.21.15.6:0/700560779 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae80abb40 con 0x7ffb0015fd60 2023-07-21T22:32:02.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.148+0000 7ffb051d2640 1 -- 172.21.15.6:0/700560779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb0015fd60 msgr2=0x7ffb000d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:02.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.148+0000 7ffb051d2640 1 --2- 172.21.15.6:0/700560779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb0015fd60 0x7ffb000d0c50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ffae8009870 tx=0x7ffae801c540 comp rx=0 tx=0).stop 2023-07-21T22:32:02.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.148+0000 7ffb051d2640 1 -- 172.21.15.6:0/700560779 shutdown_connections 2023-07-21T22:32:02.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.148+0000 7ffb051d2640 1 --2- 172.21.15.6:0/700560779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb0015fd60 0x7ffb000d0c50 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.148+0000 7ffb051d2640 1 -- 172.21.15.6:0/700560779 >> 172.21.15.6:0/700560779 conn(0x7ffb000650b0 msgr2=0x7ffb000654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:02.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.148+0000 7ffb051d2640 1 -- 172.21.15.6:0/700560779 shutdown_connections 2023-07-21T22:32:02.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.148+0000 7ffb051d2640 1 -- 172.21.15.6:0/700560779 wait complete. 2023-07-21T22:32:02.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffb051d2640 1 Processor -- start 2023-07-21T22:32:02.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffb051d2640 1 -- start start 2023-07-21T22:32:02.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffb051d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb000b7c70 0x7ffb0015eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:02.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffb051d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb000d1850 0x7ffb000cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:02.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffb051d2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb0015fd60 0x7ffb000c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:02.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffb051d2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb000c9910 con 0x7ffb000d1850 2023-07-21T22:32:02.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffb051d2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb000c9b90 con 0x7ffb0015fd60 2023-07-21T22:32:02.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffb051d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb000c9e70 con 0x7ffb000b7c70 2023-07-21T22:32:02.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffaf7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb000d1850 0x7ffb000cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:02.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffaf7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb000d1850 0x7ffb000cac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35624/0 (socket says 172.21.15.6:35624) 2023-07-21T22:32:02.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffaf7fff640 1 -- 172.21.15.6:0/1240054223 learned_addr learned my addr 172.21.15.6:0/1240054223 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:02.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffafed9d640 1 --2- 172.21.15.6:0/1240054223 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb000b7c70 0x7ffb0015eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:02.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffaff59e640 1 --2- 172.21.15.6:0/1240054223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb0015fd60 0x7ffb000c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffaf7fff640 1 -- 172.21.15.6:0/1240054223 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb000b7c70 msgr2=0x7ffb0015eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffaf7fff640 1 --2- 172.21.15.6:0/1240054223 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb000b7c70 0x7ffb0015eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffaf7fff640 1 -- 172.21.15.6:0/1240054223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb0015fd60 msgr2=0x7ffb000c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffaf7fff640 1 --2- 172.21.15.6:0/1240054223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb0015fd60 0x7ffb000c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffaf7fff640 1 -- 172.21.15.6:0/1240054223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae80094d0 con 0x7ffb000d1850 2023-07-21T22:32:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffaff59e640 1 --2- 172.21.15.6:0/1240054223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb0015fd60 0x7ffb000c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffaf7fff640 1 --2- 172.21.15.6:0/1240054223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb000d1850 0x7ffb000cac30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ffae80ad040 tx=0x7ffae80192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffaf77fe640 1 -- 172.21.15.6:0/1240054223 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae80aaa00 con 0x7ffb000d1850 2023-07-21T22:32:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffaf77fe640 1 -- 172.21.15.6:0/1240054223 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae80aab80 con 0x7ffb000d1850 2023-07-21T22:32:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffaf77fe640 1 -- 172.21.15.6:0/1240054223 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae80bf410 con 0x7ffb000d1850 2023-07-21T22:32:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.152+0000 7ffb051d2640 1 -- 172.21.15.6:0/1240054223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb000ca150 con 0x7ffb000d1850 2023-07-21T22:32:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.156+0000 7ffb051d2640 1 -- 172.21.15.6:0/1240054223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb000ca710 con 0x7ffb000d1850 2023-07-21T22:32:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.156+0000 7ffb051d2640 1 -- 172.21.15.6:0/1240054223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb00157b80 con 0x7ffb000d1850 2023-07-21T22:32:02.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.156+0000 7ffaf77fe640 1 -- 172.21.15.6:0/1240054223 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ffae80bf570 con 0x7ffb000d1850 2023-07-21T22:32:02.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.156+0000 7ffaf77fe640 1 --2- 172.21.15.6:0/1240054223 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ffae00663a0 0x7ffae0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.156+0000 7ffaf77fe640 1 -- 172.21.15.6:0/1240054223 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6106+0+0 (secure 0 0 0) 0x7ffae811efe0 con 0x7ffb000d1850 2023-07-21T22:32:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.156+0000 7ffafed9d640 1 --2- 172.21.15.6:0/1240054223 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ffae00663a0 0x7ffae0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.156+0000 7ffafed9d640 1 --2- 172.21.15.6:0/1240054223 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ffae00663a0 0x7ffae0068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffb000c86a0 tx=0x7ffaf0009040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:02.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.160+0000 7ffaf77fe640 1 -- 172.21.15.6:0/1240054223 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffae80ec4e0 con 0x7ffb000d1850 2023-07-21T22:32:02.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.320+0000 7ffb051d2640 1 -- 172.21.15.6:0/1240054223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb000ca900 con 0x7ffb000d1850 2023-07-21T22:32:02.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.320+0000 7ffaf77fe640 1 -- 172.21.15.6:0/1240054223 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+18362 (secure 0 0 0) 0x7ffae80efb00 con 0x7ffb000d1850 2023-07-21T22:32:02.368 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:32:02.369 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":66,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:32:01.333720+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:31:59.449200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-21T22:32:00.321692+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:32:02.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.320+0000 7ffb051d2640 1 -- 172.21.15.6:0/1240054223 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ffae00663a0 msgr2=0x7ffae0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:02.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.320+0000 7ffb051d2640 1 --2- 172.21.15.6:0/1240054223 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ffae00663a0 0x7ffae0068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffb000c86a0 tx=0x7ffaf0009040 comp rx=0 tx=0).stop 2023-07-21T22:32:02.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.320+0000 7ffb051d2640 1 -- 172.21.15.6:0/1240054223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb000d1850 msgr2=0x7ffb000cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:02.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.320+0000 7ffb051d2640 1 --2- 172.21.15.6:0/1240054223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb000d1850 0x7ffb000cac30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ffae80ad040 tx=0x7ffae80192e0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.320+0000 7ffb051d2640 1 -- 172.21.15.6:0/1240054223 shutdown_connections 2023-07-21T22:32:02.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.320+0000 7ffb051d2640 1 --2- 172.21.15.6:0/1240054223 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ffae00663a0 0x7ffae0068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.320+0000 7ffb051d2640 1 --2- 172.21.15.6:0/1240054223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb0015fd60 0x7ffb000c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.320+0000 7ffb051d2640 1 --2- 172.21.15.6:0/1240054223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb000d1850 0x7ffb000cac30 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.320+0000 7ffb051d2640 1 --2- 172.21.15.6:0/1240054223 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb000b7c70 0x7ffb0015eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.320+0000 7ffb051d2640 1 -- 172.21.15.6:0/1240054223 >> 172.21.15.6:0/1240054223 conn(0x7ffb000650b0 msgr2=0x7ffb00065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:02.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.320+0000 7ffb051d2640 1 -- 172.21.15.6:0/1240054223 shutdown_connections 2023-07-21T22:32:02.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.320+0000 7ffb051d2640 1 -- 172.21.15.6:0/1240054223 wait complete. 2023-07-21T22:32:02.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:32:02.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.484+0000 7fcd08f9f640 1 Processor -- start 2023-07-21T22:32:02.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.484+0000 7fcd08f9f640 1 -- start start 2023-07-21T22:32:02.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.488+0000 7fcd08f9f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcd0406a540 0x7fcd0406a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:02.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.488+0000 7fcd08f9f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd040cdc80 con 0x7fcd040ce0f0 2023-07-21T22:32:02.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.488+0000 7fcd08f9f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd0406e4c0 con 0x7fcd0415f500 2023-07-21T22:32:02.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.488+0000 7fcd08f9f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0406af00 con 0x7fcd0406a540 2023-07-21T22:32:02.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.488+0000 7fcd02d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcd040ce0f0 0x7fcd040ce550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53648/0 (socket says 172.21.15.6:53648) 2023-07-21T22:32:02.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.488+0000 7fcd02d9d640 1 -- 172.21.15.6:0/239350575 learned_addr learned my addr 172.21.15.6:0/239350575 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:32:02.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.488+0000 7fccfbfff640 1 --2- 172.21.15.6:0/239350575 >> v2:172.21.15.161:3300/0 conn(0x7fcd0406a540 0x7fcd0406a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:02.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.488+0000 7fcd01d9b640 1 -- 172.21.15.6:0/239350575 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1813816688 0 0) 0x7fcd040cdc80 con 0x7fcd040ce0f0 2023-07-21T22:32:02.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.488+0000 7fcd01d9b640 1 -- 172.21.15.6:0/239350575 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccf0003530 con 0x7fcd040ce0f0 2023-07-21T22:32:02.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.488+0000 7fcd01d9b640 1 -- 172.21.15.6:0/239350575 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2393217313 0 0) 0x7fcd0406e4c0 con 0x7fcd0415f500 2023-07-21T22:32:02.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.488+0000 7fcd01d9b640 1 -- 172.21.15.6:0/239350575 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd040cdc80 con 0x7fcd0415f500 2023-07-21T22:32:02.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.488+0000 7fccfbfff640 1 -- 172.21.15.6:0/239350575 >> v1:172.21.15.161:6789/0 conn(0x7fcd0415f500 legacy=0x7fcd0406cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:02.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.488+0000 7fccfbfff640 1 -- 172.21.15.6:0/239350575 >> v1:172.21.15.6:6789/0 conn(0x7fcd040ce0f0 legacy=0x7fcd040ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:02.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.488+0000 7fccfbfff640 1 -- 172.21.15.6:0/239350575 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0406d940 con 0x7fcd0406a540 2023-07-21T22:32:02.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.492+0000 7fccfbfff640 1 --2- 172.21.15.6:0/239350575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd0406a540 0x7fcd0406a9c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fccec0097c0 tx=0x7fccec01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb661517e85134f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:02.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.492+0000 7fcd01d9b640 1 -- 172.21.15.6:0/239350575 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec0ab600 con 0x7fcd0406a540 2023-07-21T22:32:02.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.492+0000 7fcd01d9b640 1 -- 172.21.15.6:0/239350575 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccec0a7050 con 0x7fcd0406a540 2023-07-21T22:32:02.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.492+0000 7fcd01d9b640 1 -- 172.21.15.6:0/239350575 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec0ab960 con 0x7fcd0406a540 2023-07-21T22:32:02.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.492+0000 7fcd08f9f640 1 -- 172.21.15.6:0/239350575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd0406a540 msgr2=0x7fcd0406a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:02.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.492+0000 7fcd08f9f640 1 --2- 172.21.15.6:0/239350575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd0406a540 0x7fcd0406a9c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fccec0097c0 tx=0x7fccec01c480 comp rx=0 tx=0).stop 2023-07-21T22:32:02.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.492+0000 7fcd08f9f640 1 -- 172.21.15.6:0/239350575 shutdown_connections 2023-07-21T22:32:02.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.492+0000 7fcd08f9f640 1 --2- 172.21.15.6:0/239350575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd0406a540 0x7fcd0406a9c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.492+0000 7fcd08f9f640 1 -- 172.21.15.6:0/239350575 >> 172.21.15.6:0/239350575 conn(0x7fcd040659d0 msgr2=0x7fcd04099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:02.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.492+0000 7fcd08f9f640 1 -- 172.21.15.6:0/239350575 shutdown_connections 2023-07-21T22:32:02.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.492+0000 7fcd08f9f640 1 -- 172.21.15.6:0/239350575 wait complete. 2023-07-21T22:32:02.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.492+0000 7fcd08f9f640 1 Processor -- start 2023-07-21T22:32:02.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.492+0000 7fcd08f9f640 1 -- start start 2023-07-21T22:32:02.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fcd08f9f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd0406a540 0x7fcd04150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:02.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fcd08f9f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd040ce0f0 0x7fcd0414fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:02.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fcd08f9f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd0415f500 0x7fcd040b3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:02.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fcd08f9f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd040cc030 con 0x7fcd0406a540 2023-07-21T22:32:02.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fcd08f9f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd041501e0 con 0x7fcd0415f500 2023-07-21T22:32:02.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fcd08f9f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd040b3e50 con 0x7fcd040ce0f0 2023-07-21T22:32:02.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fcd0259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd0406a540 0x7fcd04150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:02.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fcd0259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd0406a540 0x7fcd04150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35628/0 (socket says 172.21.15.6:35628) 2023-07-21T22:32:02.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fcd0259c640 1 -- 172.21.15.6:0/178234657 learned_addr learned my addr 172.21.15.6:0/178234657 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:02.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fcd0259c640 1 -- 172.21.15.6:0/178234657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd040ce0f0 msgr2=0x7fcd0414fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:02.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fcd0259c640 1 --2- 172.21.15.6:0/178234657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd040ce0f0 0x7fcd0414fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fcd0259c640 1 -- 172.21.15.6:0/178234657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd0415f500 msgr2=0x7fcd040b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:02.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fcd02d9d640 1 --2- 172.21.15.6:0/178234657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd0415f500 0x7fcd040b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:02.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fcd0259c640 1 --2- 172.21.15.6:0/178234657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd0415f500 0x7fcd040b3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fcd0259c640 1 -- 172.21.15.6:0/178234657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec009420 con 0x7fcd0406a540 2023-07-21T22:32:02.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fcd02d9d640 1 --2- 172.21.15.6:0/178234657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd0415f500 0x7fcd040b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:32:02.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fcd0259c640 1 --2- 172.21.15.6:0/178234657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd0406a540 0x7fcd04150700 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fccf400c450 tx=0x7fccf400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:02.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fccfaffd640 1 -- 172.21.15.6:0/178234657 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf40052d0 con 0x7fcd0406a540 2023-07-21T22:32:02.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fccfaffd640 1 -- 172.21.15.6:0/178234657 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf4005430 con 0x7fcd0406a540 2023-07-21T22:32:02.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fccfaffd640 1 -- 172.21.15.6:0/178234657 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4003890 con 0x7fcd0406a540 2023-07-21T22:32:02.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fcd08f9f640 1 -- 172.21.15.6:0/178234657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd040b40f0 con 0x7fcd0406a540 2023-07-21T22:32:02.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fcd08f9f640 1 -- 172.21.15.6:0/178234657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd040b46b0 con 0x7fcd0406a540 2023-07-21T22:32:02.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.496+0000 7fcd08f9f640 1 -- 172.21.15.6:0/178234657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0406d5e0 con 0x7fcd0406a540 2023-07-21T22:32:02.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.500+0000 7fccfaffd640 1 -- 172.21.15.6:0/178234657 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fccf40039f0 con 0x7fcd0406a540 2023-07-21T22:32:02.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.500+0000 7fccfaffd640 1 --2- 172.21.15.6:0/178234657 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fcce40663a0 0x7fcce4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:02.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.500+0000 7fccfaffd640 1 -- 172.21.15.6:0/178234657 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fccf4083af0 con 0x7fcd0406a540 2023-07-21T22:32:02.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.500+0000 7fccfbfff640 1 --2- 172.21.15.6:0/178234657 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fcce40663a0 0x7fcce4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:02.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.500+0000 7fccfbfff640 1 --2- 172.21.15.6:0/178234657 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fcce40663a0 0x7fcce4068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fccec0ad000 tx=0x7fccec004740 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.504+0000 7fccfaffd640 1 -- 172.21.15.6:0/178234657 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcd0406d5e0 con 0x7fcd0406a540 2023-07-21T22:32:02.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.660+0000 7fcd08f9f640 1 -- 172.21.15.6:0/178234657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd0406d5e0 con 0x7fcd0406a540 2023-07-21T22:32:02.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.660+0000 7fccfaffd640 1 -- 172.21.15.6:0/178234657 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+18362 (secure 0 0 0) 0x7fcd0406d5e0 con 0x7fcd0406a540 2023-07-21T22:32:02.709 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:32:02.710 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":66,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:32:01.333720+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:31:59.449200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-21T22:32:00.321692+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:32:02.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.660+0000 7fcd08f9f640 1 -- 172.21.15.6:0/178234657 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fcce40663a0 msgr2=0x7fcce4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:02.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.660+0000 7fcd08f9f640 1 --2- 172.21.15.6:0/178234657 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fcce40663a0 0x7fcce4068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fccec0ad000 tx=0x7fccec004740 comp rx=0 tx=0).stop 2023-07-21T22:32:02.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.660+0000 7fcd08f9f640 1 -- 172.21.15.6:0/178234657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd0406a540 msgr2=0x7fcd04150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:02.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.660+0000 7fcd08f9f640 1 --2- 172.21.15.6:0/178234657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd0406a540 0x7fcd04150700 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fccf400c450 tx=0x7fccf400c910 comp rx=0 tx=0).stop 2023-07-21T22:32:02.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.664+0000 7fcd08f9f640 1 -- 172.21.15.6:0/178234657 shutdown_connections 2023-07-21T22:32:02.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.664+0000 7fcd08f9f640 1 --2- 172.21.15.6:0/178234657 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fcce40663a0 0x7fcce4068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.664+0000 7fcd08f9f640 1 --2- 172.21.15.6:0/178234657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd0415f500 0x7fcd040b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.664+0000 7fcd08f9f640 1 --2- 172.21.15.6:0/178234657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd040ce0f0 0x7fcd0414fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.664+0000 7fcd08f9f640 1 --2- 172.21.15.6:0/178234657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd0406a540 0x7fcd04150700 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.664+0000 7fcd08f9f640 1 -- 172.21.15.6:0/178234657 >> 172.21.15.6:0/178234657 conn(0x7fcd040659d0 msgr2=0x7fcd040ae8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:02.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.664+0000 7fcd08f9f640 1 -- 172.21.15.6:0/178234657 shutdown_connections 2023-07-21T22:32:02.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.664+0000 7fcd08f9f640 1 -- 172.21.15.6:0/178234657 wait complete. 2023-07-21T22:32:02.730 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-21T22:32:02.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.828+0000 7fc088ae6640 1 Processor -- start 2023-07-21T22:32:02.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.832+0000 7fc088ae6640 1 -- start start 2023-07-21T22:32:02.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.832+0000 7fc088ae6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0840cb0f0 0x7fc084069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:02.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.832+0000 7fc088ae6640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc08406d2d0 0x7fc08406d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:02.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.832+0000 7fc088ae6640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0840cb540 con 0x7fc084069430 2023-07-21T22:32:02.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.832+0000 7fc088ae6640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc084069d40 con 0x7fc08406d2d0 2023-07-21T22:32:02.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.832+0000 7fc088ae6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0840cb7d0 con 0x7fc0840cb0f0 2023-07-21T22:32:02.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.832+0000 7fc07bfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0840cb0f0 0x7fc084069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:02.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.832+0000 7fc07bfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0840cb0f0 0x7fc084069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:60460/0 (socket says 172.21.15.6:60460) 2023-07-21T22:32:02.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.832+0000 7fc07bfff640 1 -- 172.21.15.6:0/1168162576 learned_addr learned my addr 172.21.15.6:0/1168162576 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:02.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.832+0000 7fc082d9d640 1 --2- 172.21.15.6:0/1168162576 >> v2:172.21.15.161:3300/0 conn(0x7fc08406d2d0 0x7fc08406d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:02.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.832+0000 7fc07bfff640 1 -- 172.21.15.6:0/1168162576 >> v2:172.21.15.161:3300/0 conn(0x7fc08406d2d0 msgr2=0x7fc08406d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:02.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.832+0000 7fc07bfff640 1 --2- 172.21.15.6:0/1168162576 >> v2:172.21.15.161:3300/0 conn(0x7fc08406d2d0 0x7fc08406d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.832+0000 7fc07bfff640 1 -- 172.21.15.6:0/1168162576 >> v1:172.21.15.161:6789/0 conn(0x7fc084069430 legacy=0x7fc084160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:02.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.832+0000 7fc07bfff640 1 -- 172.21.15.6:0/1168162576 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08406c510 con 0x7fc0840cb0f0 2023-07-21T22:32:02.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.836+0000 7fc07bfff640 1 --2- 172.21.15.6:0/1168162576 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0840cb0f0 0x7fc084069800 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc06c009870 tx=0x7fc06c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e90d6b573be5890 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:02.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.836+0000 7fc081d9b640 1 -- 172.21.15.6:0/1168162576 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0ab680 con 0x7fc0840cb0f0 2023-07-21T22:32:02.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.836+0000 7fc081d9b640 1 -- 172.21.15.6:0/1168162576 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c0ab7e0 con 0x7fc0840cb0f0 2023-07-21T22:32:02.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.836+0000 7fc081d9b640 1 -- 172.21.15.6:0/1168162576 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0abb70 con 0x7fc0840cb0f0 2023-07-21T22:32:02.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.836+0000 7fc088ae6640 1 -- 172.21.15.6:0/1168162576 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0840cb0f0 msgr2=0x7fc084069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:02.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.836+0000 7fc088ae6640 1 --2- 172.21.15.6:0/1168162576 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0840cb0f0 0x7fc084069800 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc06c009870 tx=0x7fc06c01c480 comp rx=0 tx=0).stop 2023-07-21T22:32:02.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.836+0000 7fc088ae6640 1 -- 172.21.15.6:0/1168162576 shutdown_connections 2023-07-21T22:32:02.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.836+0000 7fc088ae6640 1 --2- 172.21.15.6:0/1168162576 >> v2:172.21.15.161:3300/0 conn(0x7fc08406d2d0 0x7fc08406d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.836+0000 7fc088ae6640 1 --2- 172.21.15.6:0/1168162576 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0840cb0f0 0x7fc084069800 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.836+0000 7fc088ae6640 1 -- 172.21.15.6:0/1168162576 >> 172.21.15.6:0/1168162576 conn(0x7fc0840b1840 msgr2=0x7fc0840cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:02.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.836+0000 7fc088ae6640 1 -- 172.21.15.6:0/1168162576 shutdown_connections 2023-07-21T22:32:02.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.836+0000 7fc088ae6640 1 -- 172.21.15.6:0/1168162576 wait complete. 2023-07-21T22:32:02.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc088ae6640 1 Processor -- start 2023-07-21T22:32:02.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc088ae6640 1 -- start start 2023-07-21T22:32:02.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc088ae6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc084069430 0x7fc0840cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:02.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc088ae6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc08406d2d0 0x7fc084149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:02.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc088ae6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0840cb0f0 0x7fc0840c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:02.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc088ae6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0840ce750 con 0x7fc08406d2d0 2023-07-21T22:32:02.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc088ae6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08414a310 con 0x7fc084069430 2023-07-21T22:32:02.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc088ae6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0840c5ed0 con 0x7fc0840cb0f0 2023-07-21T22:32:02.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc07bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc08406d2d0 0x7fc084149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:02.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc07bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc08406d2d0 0x7fc084149dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35642/0 (socket says 172.21.15.6:35642) 2023-07-21T22:32:02.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc07bfff640 1 -- 172.21.15.6:0/2273340736 learned_addr learned my addr 172.21.15.6:0/2273340736 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:02.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc082d9d640 1 --2- 172.21.15.6:0/2273340736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0840cb0f0 0x7fc0840c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:02.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc08259c640 1 --2- 172.21.15.6:0/2273340736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc084069430 0x7fc0840cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:02.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc07bfff640 1 -- 172.21.15.6:0/2273340736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0840cb0f0 msgr2=0x7fc0840c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:02.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc07bfff640 1 --2- 172.21.15.6:0/2273340736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0840cb0f0 0x7fc0840c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc07bfff640 1 -- 172.21.15.6:0/2273340736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc084069430 msgr2=0x7fc0840cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:02.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc07bfff640 1 --2- 172.21.15.6:0/2273340736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc084069430 0x7fc0840cd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:02.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc07bfff640 1 -- 172.21.15.6:0/2273340736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06c0094d0 con 0x7fc08406d2d0 2023-07-21T22:32:02.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc07bfff640 1 --2- 172.21.15.6:0/2273340736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc08406d2d0 0x7fc084149dd0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc06c0ad040 tx=0x7fc06c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:02.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc07affd640 1 -- 172.21.15.6:0/2273340736 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0b5810 con 0x7fc08406d2d0 2023-07-21T22:32:02.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc07affd640 1 -- 172.21.15.6:0/2273340736 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c0b59b0 con 0x7fc08406d2d0 2023-07-21T22:32:02.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc07affd640 1 -- 172.21.15.6:0/2273340736 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0b5d60 con 0x7fc08406d2d0 2023-07-21T22:32:02.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc088ae6640 1 -- 172.21.15.6:0/2273340736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0840cdb40 con 0x7fc08406d2d0 2023-07-21T22:32:02.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc088ae6640 1 -- 172.21.15.6:0/2273340736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0840ce100 con 0x7fc08406d2d0 2023-07-21T22:32:02.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.840+0000 7fc088ae6640 1 -- 172.21.15.6:0/2273340736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0840678d0 con 0x7fc08406d2d0 2023-07-21T22:32:02.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.844+0000 7fc07affd640 1 -- 172.21.15.6:0/2273340736 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc06c0ca3e0 con 0x7fc08406d2d0 2023-07-21T22:32:02.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.844+0000 7fc07affd640 1 --2- 172.21.15.6:0/2273340736 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fc0640663d0 0x7fc064068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:02.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.844+0000 7fc07affd640 1 -- 172.21.15.6:0/2273340736 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fc06c11f470 con 0x7fc08406d2d0 2023-07-21T22:32:02.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.844+0000 7fc08259c640 1 --2- 172.21.15.6:0/2273340736 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fc0640663d0 0x7fc064068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:02.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.844+0000 7fc08259c640 1 --2- 172.21.15.6:0/2273340736 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fc0640663d0 0x7fc064068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc074007fd0 tx=0x7fc074009040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:02.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:02.848+0000 7fc07affd640 1 -- 172.21.15.6:0/2273340736 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc06c0ec730 con 0x7fc08406d2d0 2023-07-21T22:32:03.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:03.036+0000 7fc088ae6640 1 -- 172.21.15.6:0/2273340736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc0840711e0 con 0x7fc08406d2d0 2023-07-21T22:32:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:03.956+0000 7fc07affd640 1 -- 172.21.15.6:0/2273340736 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc06c0efd50 con 0x7fc08406d2d0 2023-07-21T22:32:04.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:03.956+0000 7fc088ae6640 1 -- 172.21.15.6:0/2273340736 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fc0640663d0 msgr2=0x7fc064068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:04.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:03.956+0000 7fc088ae6640 1 --2- 172.21.15.6:0/2273340736 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fc0640663d0 0x7fc064068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc074007fd0 tx=0x7fc074009040 comp rx=0 tx=0).stop 2023-07-21T22:32:04.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:03.956+0000 7fc088ae6640 1 -- 172.21.15.6:0/2273340736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc08406d2d0 msgr2=0x7fc084149dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:04.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:03.956+0000 7fc088ae6640 1 --2- 172.21.15.6:0/2273340736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc08406d2d0 0x7fc084149dd0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc06c0ad040 tx=0x7fc06c019220 comp rx=0 tx=0).stop 2023-07-21T22:32:04.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:03.956+0000 7fc088ae6640 1 -- 172.21.15.6:0/2273340736 shutdown_connections 2023-07-21T22:32:04.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:03.956+0000 7fc088ae6640 1 --2- 172.21.15.6:0/2273340736 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fc0640663d0 0x7fc064068880 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:04.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:03.956+0000 7fc088ae6640 1 --2- 172.21.15.6:0/2273340736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0840cb0f0 0x7fc0840c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:04.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:03.956+0000 7fc088ae6640 1 --2- 172.21.15.6:0/2273340736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc08406d2d0 0x7fc084149dd0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:04.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:03.956+0000 7fc088ae6640 1 --2- 172.21.15.6:0/2273340736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc084069430 0x7fc0840cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:04.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:03.956+0000 7fc088ae6640 1 -- 172.21.15.6:0/2273340736 >> 172.21.15.6:0/2273340736 conn(0x7fc0840b1840 msgr2=0x7fc084157550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:04.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:03.956+0000 7fc088ae6640 1 -- 172.21.15.6:0/2273340736 shutdown_connections 2023-07-21T22:32:04.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:03.956+0000 7fc088ae6640 1 -- 172.21.15.6:0/2273340736 wait complete. 2023-07-21T22:32:04.029 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-21T22:32:04.030 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-21T22:32:04.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.132+0000 7ff055103640 1 Processor -- start 2023-07-21T22:32:04.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.132+0000 7ff055103640 1 -- start start 2023-07-21T22:32:04.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.136+0000 7ff055103640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff050070f30 0x7ff0500ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:04.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.136+0000 7ff055103640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff050159d70 con 0x7ff050069430 2023-07-21T22:32:04.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.136+0000 7ff055103640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0500c9c60 con 0x7ff0500af2b0 2023-07-21T22:32:04.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.136+0000 7ff055103640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500c9f40 con 0x7ff050070f30 2023-07-21T22:32:04.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.136+0000 7ff04ed9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff050069430 0x7ff050069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53660/0 (socket says 172.21.15.6:53660) 2023-07-21T22:32:04.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.136+0000 7ff04ed9d640 1 -- 172.21.15.6:0/3914790861 learned_addr learned my addr 172.21.15.6:0/3914790861 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:32:04.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.136+0000 7ff047fff640 1 --2- 172.21.15.6:0/3914790861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff050070f30 0x7ff0500ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:04.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.136+0000 7ff04e59c640 1 -- 172.21.15.6:0/3914790861 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679245086 0 0) 0x7ff040001120 con 0x7ff050069430 2023-07-21T22:32:04.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.136+0000 7ff04e59c640 1 -- 172.21.15.6:0/3914790861 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff03c003530 con 0x7ff050069430 2023-07-21T22:32:04.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.136+0000 7ff04e59c640 1 -- 172.21.15.6:0/3914790861 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3668039240 0 0) 0x7ff0500c9c60 con 0x7ff0500af2b0 2023-07-21T22:32:04.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.136+0000 7ff04e59c640 1 -- 172.21.15.6:0/3914790861 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff040001120 con 0x7ff0500af2b0 2023-07-21T22:32:04.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.136+0000 7ff047fff640 1 -- 172.21.15.6:0/3914790861 >> v1:172.21.15.161:6789/0 conn(0x7ff0500af2b0 legacy=0x7ff05015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:04.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.136+0000 7ff047fff640 1 -- 172.21.15.6:0/3914790861 >> v1:172.21.15.6:6789/0 conn(0x7ff050069430 legacy=0x7ff050069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:04.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.136+0000 7ff04e59c640 1 -- 172.21.15.6:0/3914790861 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2897210630 0 0) 0x7ff03c003530 con 0x7ff050069430 2023-07-21T22:32:04.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.136+0000 7ff047fff640 1 -- 172.21.15.6:0/3914790861 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0500ca220 con 0x7ff050070f30 2023-07-21T22:32:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.140+0000 7ff047fff640 1 --2- 172.21.15.6:0/3914790861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff050070f30 0x7ff0500ad6f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff0380097f0 tx=0x7ff03801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=954795d64860782c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.140+0000 7ff04e59c640 1 -- 172.21.15.6:0/3914790861 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040001810 con 0x7ff050070f30 2023-07-21T22:32:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.140+0000 7ff04e59c640 1 -- 172.21.15.6:0/3914790861 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0380ad460 con 0x7ff050070f30 2023-07-21T22:32:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.140+0000 7ff04e59c640 1 -- 172.21.15.6:0/3914790861 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0380ad7f0 con 0x7ff050070f30 2023-07-21T22:32:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.140+0000 7ff055103640 1 -- 172.21.15.6:0/3914790861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff050070f30 msgr2=0x7ff0500ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.140+0000 7ff055103640 1 --2- 172.21.15.6:0/3914790861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff050070f30 0x7ff0500ad6f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff0380097f0 tx=0x7ff03801c3e0 comp rx=0 tx=0).stop 2023-07-21T22:32:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.140+0000 7ff055103640 1 -- 172.21.15.6:0/3914790861 shutdown_connections 2023-07-21T22:32:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.140+0000 7ff055103640 1 --2- 172.21.15.6:0/3914790861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff050070f30 0x7ff0500ad6f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.140+0000 7ff055103640 1 -- 172.21.15.6:0/3914790861 >> 172.21.15.6:0/3914790861 conn(0x7ff0500cde90 msgr2=0x7ff0500ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.140+0000 7ff055103640 1 -- 172.21.15.6:0/3914790861 shutdown_connections 2023-07-21T22:32:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.140+0000 7ff055103640 1 -- 172.21.15.6:0/3914790861 wait complete. 2023-07-21T22:32:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.140+0000 7ff055103640 1 Processor -- start 2023-07-21T22:32:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.140+0000 7ff055103640 1 -- start start 2023-07-21T22:32:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.140+0000 7ff055103640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff050069430 0x7ff0500c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.140+0000 7ff055103640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff050070f30 0x7ff0500c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.140+0000 7ff055103640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0500af2b0 0x7ff0500b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.140+0000 7ff055103640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500c7e10 con 0x7ff0500af2b0 2023-07-21T22:32:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.140+0000 7ff055103640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff050148a90 con 0x7ff050070f30 2023-07-21T22:32:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.140+0000 7ff055103640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500c7b90 con 0x7ff050069430 2023-07-21T22:32:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.144+0000 7ff04f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0500af2b0 0x7ff0500b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.144+0000 7ff04f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0500af2b0 0x7ff0500b0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35648/0 (socket says 172.21.15.6:35648) 2023-07-21T22:32:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.144+0000 7ff04f59e640 1 -- 172.21.15.6:0/1112389453 learned_addr learned my addr 172.21.15.6:0/1112389453 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.144+0000 7ff04ed9d640 1 --2- 172.21.15.6:0/1112389453 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff050069430 0x7ff0500c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.144+0000 7ff047fff640 1 --2- 172.21.15.6:0/1112389453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff050070f30 0x7ff0500c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.144+0000 7ff04f59e640 1 -- 172.21.15.6:0/1112389453 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff050069430 msgr2=0x7ff0500c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.144+0000 7ff04f59e640 1 --2- 172.21.15.6:0/1112389453 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff050069430 0x7ff0500c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.144+0000 7ff04f59e640 1 -- 172.21.15.6:0/1112389453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff050070f30 msgr2=0x7ff0500c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.144+0000 7ff04f59e640 1 --2- 172.21.15.6:0/1112389453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff050070f30 0x7ff0500c7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.144+0000 7ff04f59e640 1 -- 172.21.15.6:0/1112389453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff038009420 con 0x7ff0500af2b0 2023-07-21T22:32:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.144+0000 7ff04f59e640 1 --2- 172.21.15.6:0/1112389453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0500af2b0 0x7ff0500b0dc0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff04800c790 tx=0x7ff04800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.144+0000 7ff0477fe640 1 -- 172.21.15.6:0/1112389453 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04800cea0 con 0x7ff0500af2b0 2023-07-21T22:32:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.144+0000 7ff0477fe640 1 -- 172.21.15.6:0/1112389453 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff048003b80 con 0x7ff0500af2b0 2023-07-21T22:32:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.144+0000 7ff0477fe640 1 -- 172.21.15.6:0/1112389453 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04800a850 con 0x7ff0500af2b0 2023-07-21T22:32:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.144+0000 7ff055103640 1 -- 172.21.15.6:0/1112389453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05014cbc0 con 0x7ff0500af2b0 2023-07-21T22:32:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.144+0000 7ff055103640 1 -- 172.21.15.6:0/1112389453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05014d140 con 0x7ff0500af2b0 2023-07-21T22:32:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.144+0000 7ff055103640 1 -- 172.21.15.6:0/1112389453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0500ce490 con 0x7ff0500af2b0 2023-07-21T22:32:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.144+0000 7ff0477fe640 1 -- 172.21.15.6:0/1112389453 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff04800a9b0 con 0x7ff0500af2b0 2023-07-21T22:32:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.148+0000 7ff0477fe640 1 --2- 172.21.15.6:0/1112389453 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ff0300663a0 0x7ff030068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.148+0000 7ff0477fe640 1 -- 172.21.15.6:0/1112389453 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6106+0+0 (secure 0 0 0) 0x7ff048083d30 con 0x7ff0500af2b0 2023-07-21T22:32:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.148+0000 7ff04ed9d640 1 --2- 172.21.15.6:0/1112389453 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ff0300663a0 0x7ff030068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.148+0000 7ff04ed9d640 1 --2- 172.21.15.6:0/1112389453 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ff0300663a0 0x7ff030068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff040000f70 tx=0x7ff040001850 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.152+0000 7ff0477fe640 1 -- 172.21.15.6:0/1112389453 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff048054a90 con 0x7ff0500af2b0 2023-07-21T22:32:04.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.340+0000 7ff055103640 1 -- 172.21.15.6:0/1112389453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff0500678d0 con 0x7ff0500af2b0 2023-07-21T22:32:05.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.956+0000 7ff0477fe640 1 -- 172.21.15.6:0/1112389453 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff048054620 con 0x7ff0500af2b0 2023-07-21T22:32:05.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.960+0000 7ff055103640 1 -- 172.21.15.6:0/1112389453 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ff0300663a0 msgr2=0x7ff030068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:05.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.960+0000 7ff055103640 1 --2- 172.21.15.6:0/1112389453 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ff0300663a0 0x7ff030068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff040000f70 tx=0x7ff040001850 comp rx=0 tx=0).stop 2023-07-21T22:32:05.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.960+0000 7ff055103640 1 -- 172.21.15.6:0/1112389453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0500af2b0 msgr2=0x7ff0500b0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:05.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.960+0000 7ff055103640 1 --2- 172.21.15.6:0/1112389453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0500af2b0 0x7ff0500b0dc0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff04800c790 tx=0x7ff04800cc50 comp rx=0 tx=0).stop 2023-07-21T22:32:05.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.960+0000 7ff055103640 1 -- 172.21.15.6:0/1112389453 shutdown_connections 2023-07-21T22:32:05.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.960+0000 7ff055103640 1 --2- 172.21.15.6:0/1112389453 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7ff0300663a0 0x7ff030068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.960+0000 7ff055103640 1 --2- 172.21.15.6:0/1112389453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0500af2b0 0x7ff0500b0dc0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.960+0000 7ff055103640 1 --2- 172.21.15.6:0/1112389453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff050070f30 0x7ff0500c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.960+0000 7ff055103640 1 --2- 172.21.15.6:0/1112389453 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff050069430 0x7ff0500c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.960+0000 7ff055103640 1 -- 172.21.15.6:0/1112389453 >> 172.21.15.6:0/1112389453 conn(0x7ff0500cde90 msgr2=0x7ff050157bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:05.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.960+0000 7ff055103640 1 -- 172.21.15.6:0/1112389453 shutdown_connections 2023-07-21T22:32:05.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:04.960+0000 7ff055103640 1 -- 172.21.15.6:0/1112389453 wait complete. 2023-07-21T22:32:05.031 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-21T22:32:05.032 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:32:05.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39bb6ca640 1 Processor -- start 2023-07-21T22:32:05.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39bb6ca640 1 -- start start 2023-07-21T22:32:05.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39bb6ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39b40c9730 0x7f39b41638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:05.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39bb6ca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b40cc700 con 0x7f39b4158ce0 2023-07-21T22:32:05.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39bb6ca640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b40b0ff0 con 0x7f39b40c8ad0 2023-07-21T22:32:05.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39bb6ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b4070c80 con 0x7f39b40c9730 2023-07-21T22:32:05.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39b9466640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f39b4158ce0 0x7f39b4070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53664/0 (socket says 172.21.15.6:53664) 2023-07-21T22:32:05.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39b9466640 1 -- 172.21.15.6:0/1228172591 learned_addr learned my addr 172.21.15.6:0/1228172591 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:32:05.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39b9c67640 1 --2- 172.21.15.6:0/1228172591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39b40c9730 0x7f39b41638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:05.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39abfff640 1 -- 172.21.15.6:0/1228172591 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021306403 0 0) 0x7f39b40cc700 con 0x7f39b4158ce0 2023-07-21T22:32:05.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39abfff640 1 -- 172.21.15.6:0/1228172591 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39a0003530 con 0x7f39b4158ce0 2023-07-21T22:32:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39abfff640 1 -- 172.21.15.6:0/1228172591 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870394890 0 0) 0x7f39b40b0ff0 con 0x7f39b40c8ad0 2023-07-21T22:32:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39abfff640 1 -- 172.21.15.6:0/1228172591 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39b40cc700 con 0x7f39b40c8ad0 2023-07-21T22:32:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39abfff640 1 -- 172.21.15.6:0/1228172591 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2617712835 0 0) 0x7f39a0003530 con 0x7f39b4158ce0 2023-07-21T22:32:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39abfff640 1 -- 172.21.15.6:0/1228172591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39b40c9730 msgr2=0x7f39b41638b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39abfff640 1 --2- 172.21.15.6:0/1228172591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39b40c9730 0x7f39b41638b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39abfff640 1 -- 172.21.15.6:0/1228172591 >> v1:172.21.15.161:6789/0 conn(0x7f39b40c8ad0 legacy=0x7f39b40c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39abfff640 1 -- 172.21.15.6:0/1228172591 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b40cbdd0 con 0x7f39b4158ce0 2023-07-21T22:32:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39abfff640 1 -- 172.21.15.6:0/1228172591 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f39b0001680 con 0x7f39b4158ce0 2023-07-21T22:32:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39abfff640 1 -- 172.21.15.6:0/1228172591 >> v1:172.21.15.6:6789/0 conn(0x7f39b4158ce0 legacy=0x7f39b4070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39abfff640 1 --2- 172.21.15.6:0/1228172591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39b40c9730 0x7f39a0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39abfff640 1 --2- 172.21.15.6:0/1228172591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a0004080 0x7f39a00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39abfff640 1 --2- 172.21.15.6:0/1228172591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39a0004d10 0x7f39a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39abfff640 1 -- 172.21.15.6:0/1228172591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b4070c80 con 0x7f39a0004080 2023-07-21T22:32:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39abfff640 1 -- 172.21.15.6:0/1228172591 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a000fff0 con 0x7f39a0004d10 2023-07-21T22:32:05.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39abfff640 1 -- 172.21.15.6:0/1228172591 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a00101b0 con 0x7f39b40c9730 2023-07-21T22:32:05.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39b8c65640 1 --2- 172.21.15.6:0/1228172591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a0004080 0x7f39a00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:05.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39b9466640 1 --2- 172.21.15.6:0/1228172591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39b40c9730 0x7f39a0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:05.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39b9c67640 1 --2- 172.21.15.6:0/1228172591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39a0004d10 0x7f39a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:05.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39b8c65640 1 -- 172.21.15.6:0/1228172591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39b40c9730 msgr2=0x7f39a0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:05.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39b8c65640 1 --2- 172.21.15.6:0/1228172591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39b40c9730 0x7f39a0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39b8c65640 1 -- 172.21.15.6:0/1228172591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39a0004d10 msgr2=0x7f39a0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:05.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39b8c65640 1 --2- 172.21.15.6:0/1228172591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39a0004d10 0x7f39a0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39b8c65640 1 -- 172.21.15.6:0/1228172591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a0003530 con 0x7f39a0004080 2023-07-21T22:32:05.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.132+0000 7f39b9c67640 1 --2- 172.21.15.6:0/1228172591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39a0004d10 0x7f39a0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.136+0000 7f39b8c65640 1 --2- 172.21.15.6:0/1228172591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a0004080 0x7f39a00047d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f39a40018d0 tx=0x7f39a401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41b7863fe8ef02 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.136+0000 7f39abfff640 1 -- 172.21.15.6:0/1228172591 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a40052d0 con 0x7f39a0004080 2023-07-21T22:32:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.136+0000 7f39abfff640 1 -- 172.21.15.6:0/1228172591 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a40a7050 con 0x7f39a0004080 2023-07-21T22:32:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.136+0000 7f39abfff640 1 -- 172.21.15.6:0/1228172591 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a4003600 con 0x7f39a0004080 2023-07-21T22:32:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.136+0000 7f39bb6ca640 1 -- 172.21.15.6:0/1228172591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a0004080 msgr2=0x7f39a00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.136+0000 7f39bb6ca640 1 --2- 172.21.15.6:0/1228172591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a0004080 0x7f39a00047d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f39a40018d0 tx=0x7f39a401c530 comp rx=0 tx=0).stop 2023-07-21T22:32:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.136+0000 7f39b9c67640 1 -- 172.21.15.6:0/1228172591 reap_dead start 2023-07-21T22:32:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.136+0000 7f39bb6ca640 1 -- 172.21.15.6:0/1228172591 shutdown_connections 2023-07-21T22:32:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.136+0000 7f39bb6ca640 1 -- 172.21.15.6:0/1228172591 >> 172.21.15.6:0/1228172591 conn(0x7f39b40afcf0 msgr2=0x7f39b40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.136+0000 7f39bb6ca640 1 -- 172.21.15.6:0/1228172591 shutdown_connections 2023-07-21T22:32:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.136+0000 7f39bb6ca640 1 -- 172.21.15.6:0/1228172591 wait complete. 2023-07-21T22:32:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39bb6ca640 1 Processor -- start 2023-07-21T22:32:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39bb6ca640 1 -- start start 2023-07-21T22:32:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39bb6ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a0004080 0x7f39b40b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39bb6ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39b4146500 0x7f39b414e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39bb6ca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39b40ca330 0x7f39b40ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39bb6ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40cace0 con 0x7f39a0004080 2023-07-21T22:32:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39bb6ca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40b3800 con 0x7f39b40ca330 2023-07-21T22:32:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39bb6ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b414f2a0 con 0x7f39b4146500 2023-07-21T22:32:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39b9466640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a0004080 0x7f39b40b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39b9466640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a0004080 0x7f39b40b25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35662/0 (socket says 172.21.15.6:35662) 2023-07-21T22:32:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39b9466640 1 -- 172.21.15.6:0/3865538933 learned_addr learned my addr 172.21.15.6:0/3865538933 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39b9c67640 1 --2- 172.21.15.6:0/3865538933 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39b40ca330 0x7f39b40ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39b8c65640 1 --2- 172.21.15.6:0/3865538933 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39b4146500 0x7f39b414e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39b9466640 1 -- 172.21.15.6:0/3865538933 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39b4146500 msgr2=0x7f39b414e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39b9466640 1 --2- 172.21.15.6:0/3865538933 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39b4146500 0x7f39b414e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39b9466640 1 -- 172.21.15.6:0/3865538933 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39b40ca330 msgr2=0x7f39b40ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39b9466640 1 --2- 172.21.15.6:0/3865538933 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39b40ca330 0x7f39b40ca7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39b9466640 1 -- 172.21.15.6:0/3865538933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b414e8e0 con 0x7f39a0004080 2023-07-21T22:32:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39b8c65640 1 --2- 172.21.15.6:0/3865538933 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39b4146500 0x7f39b414e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:32:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39b9466640 1 --2- 172.21.15.6:0/3865538933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a0004080 0x7f39b40b25c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f39b0007340 tx=0x7f39b0007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:05.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39a9ffb640 1 -- 172.21.15.6:0/3865538933 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b000f960 con 0x7f39a0004080 2023-07-21T22:32:05.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39a9ffb640 1 -- 172.21.15.6:0/3865538933 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b000fac0 con 0x7f39a0004080 2023-07-21T22:32:05.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39a9ffb640 1 -- 172.21.15.6:0/3865538933 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b000fe50 con 0x7f39a0004080 2023-07-21T22:32:05.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39bb6ca640 1 -- 172.21.15.6:0/3865538933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b40b2bf0 con 0x7f39a0004080 2023-07-21T22:32:05.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.140+0000 7f39bb6ca640 1 -- 172.21.15.6:0/3865538933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b40b31b0 con 0x7f39a0004080 2023-07-21T22:32:05.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.144+0000 7f39bb6ca640 1 -- 172.21.15.6:0/3865538933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b40ca1a0 con 0x7f39a0004080 2023-07-21T22:32:05.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.144+0000 7f39a9ffb640 1 -- 172.21.15.6:0/3865538933 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f39b001c410 con 0x7f39a0004080 2023-07-21T22:32:05.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.144+0000 7f39a9ffb640 1 --2- 172.21.15.6:0/3865538933 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f39980663d0 0x7f3998068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:05.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.144+0000 7f39a9ffb640 1 -- 172.21.15.6:0/3865538933 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f39b0083a70 con 0x7f39a0004080 2023-07-21T22:32:05.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.144+0000 7f39b8c65640 1 --2- 172.21.15.6:0/3865538933 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f39980663d0 0x7f3998068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:05.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.148+0000 7f39b8c65640 1 --2- 172.21.15.6:0/3865538933 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f39980663d0 0x7f3998068880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f39a40018d0 tx=0x7f39a40a6000 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:05.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.148+0000 7f39a9ffb640 1 -- 172.21.15.6:0/3865538933 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f39b0050e40 con 0x7f39a0004080 2023-07-21T22:32:05.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.336+0000 7f39bb6ca640 1 -- 172.21.15.6:0/3865538933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39b40678d0 con 0x7f39a0004080 2023-07-21T22:32:05.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.336+0000 7f39a9ffb640 1 -- 172.21.15.6:0/3865538933 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f39b0054460 con 0x7f39a0004080 2023-07-21T22:32:05.386 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:32:05.386 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/2410607534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2410607534},{"type":"v1","addr":"172.21.15.161:6836","nonce":2410607534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/3696372013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":3696372013},{"type":"v1","addr":"172.21.15.161:6837","nonce":3696372013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6042,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/4134919456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4134919456},{"type":"v1","addr":"172.21.15.6:6833","nonce":4134919456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:32:01.334074+0000","modified":"2023-07-21T22:32:04.955966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6045},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6045":{"gid":6045,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2511103099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2511103099},{"type":"v1","addr":"172.21.15.6:6835","nonce":2511103099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-21T22:32:05.386 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 24 2023-07-21T22:32:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.340+0000 7f39bb6ca640 1 -- 172.21.15.6:0/3865538933 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f39980663d0 msgr2=0x7f3998068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.340+0000 7f39bb6ca640 1 --2- 172.21.15.6:0/3865538933 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f39980663d0 0x7f3998068880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f39a40018d0 tx=0x7f39a40a6000 comp rx=0 tx=0).stop 2023-07-21T22:32:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.340+0000 7f39bb6ca640 1 -- 172.21.15.6:0/3865538933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a0004080 msgr2=0x7f39b40b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.340+0000 7f39bb6ca640 1 --2- 172.21.15.6:0/3865538933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a0004080 0x7f39b40b25c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f39b0007340 tx=0x7f39b0007800 comp rx=0 tx=0).stop 2023-07-21T22:32:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.340+0000 7f39bb6ca640 1 -- 172.21.15.6:0/3865538933 shutdown_connections 2023-07-21T22:32:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.340+0000 7f39bb6ca640 1 --2- 172.21.15.6:0/3865538933 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f39980663d0 0x7f3998068880 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.340+0000 7f39bb6ca640 1 --2- 172.21.15.6:0/3865538933 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39b40ca330 0x7f39b40ca7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.340+0000 7f39bb6ca640 1 --2- 172.21.15.6:0/3865538933 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39b4146500 0x7f39b414e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.340+0000 7f39bb6ca640 1 --2- 172.21.15.6:0/3865538933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39a0004080 0x7f39b40b25c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.340+0000 7f39bb6ca640 1 -- 172.21.15.6:0/3865538933 >> 172.21.15.6:0/3865538933 conn(0x7f39b40afcf0 msgr2=0x7f39b406ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:05.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.340+0000 7f39bb6ca640 1 -- 172.21.15.6:0/3865538933 shutdown_connections 2023-07-21T22:32:05.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.340+0000 7f39bb6ca640 1 -- 172.21.15.6:0/3865538933 wait complete. 2023-07-21T22:32:05.406 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:32:05.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.504+0000 7f397fb74640 1 Processor -- start 2023-07-21T22:32:05.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.504+0000 7f397fb74640 1 -- start start 2023-07-21T22:32:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.504+0000 7f397fb74640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f39780b7c70 0x7f39780d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.504+0000 7f397fb74640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f397815fd60 0x7f39780d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.504+0000 7f397fb74640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39780ccaf0 con 0x7f39780d1850 2023-07-21T22:32:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.504+0000 7f397fb74640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39780d1190 con 0x7f39780b7c70 2023-07-21T22:32:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.504+0000 7f397fb74640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3978160600 con 0x7f397815fd60 2023-07-21T22:32:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.504+0000 7f397d910640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f39780b7c70 0x7f39780d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.504+0000 7f397d910640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f39780b7c70 0x7f39780d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35664/0 (socket says 172.21.15.6:35664) 2023-07-21T22:32:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.504+0000 7f397d910640 1 -- 172.21.15.6:0/614537074 learned_addr learned my addr 172.21.15.6:0/614537074 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:05.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.504+0000 7f397e111640 1 --2- 172.21.15.6:0/614537074 >> v2:172.21.15.161:3300/0 conn(0x7f397815fd60 0x7f39780d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:05.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.504+0000 7f397d910640 1 -- 172.21.15.6:0/614537074 >> v2:172.21.15.161:3300/0 conn(0x7f397815fd60 msgr2=0x7f39780d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:05.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.504+0000 7f397d910640 1 --2- 172.21.15.6:0/614537074 >> v2:172.21.15.161:3300/0 conn(0x7f397815fd60 0x7f39780d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.504+0000 7f397d910640 1 -- 172.21.15.6:0/614537074 >> v1:172.21.15.161:6789/0 conn(0x7f39780d1850 legacy=0x7f397815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:05.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.504+0000 7f397d910640 1 -- 172.21.15.6:0/614537074 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3978160320 con 0x7f39780b7c70 2023-07-21T22:32:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.508+0000 7f397d910640 1 --2- 172.21.15.6:0/614537074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39780b7c70 0x7f39780d0c50 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f39780b4040 tx=0x7f397401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718014f859c2f600 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.508+0000 7f397c90e640 1 -- 172.21.15.6:0/614537074 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39740aa650 con 0x7f39780b7c70 2023-07-21T22:32:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.508+0000 7f397c90e640 1 -- 172.21.15.6:0/614537074 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39740aa7b0 con 0x7f39780b7c70 2023-07-21T22:32:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.508+0000 7f397c90e640 1 -- 172.21.15.6:0/614537074 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39740aab40 con 0x7f39780b7c70 2023-07-21T22:32:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.508+0000 7f397fb74640 1 -- 172.21.15.6:0/614537074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39780b7c70 msgr2=0x7f39780d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.508+0000 7f397fb74640 1 --2- 172.21.15.6:0/614537074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39780b7c70 0x7f39780d0c50 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f39780b4040 tx=0x7f397401c4d0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.508+0000 7f397fb74640 1 -- 172.21.15.6:0/614537074 shutdown_connections 2023-07-21T22:32:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.508+0000 7f397fb74640 1 --2- 172.21.15.6:0/614537074 >> v2:172.21.15.161:3300/0 conn(0x7f397815fd60 0x7f39780d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.508+0000 7f397fb74640 1 --2- 172.21.15.6:0/614537074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39780b7c70 0x7f39780d0c50 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.508+0000 7f397fb74640 1 -- 172.21.15.6:0/614537074 >> 172.21.15.6:0/614537074 conn(0x7f39780650b0 msgr2=0x7f39780654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:05.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.508+0000 7f397fb74640 1 -- 172.21.15.6:0/614537074 shutdown_connections 2023-07-21T22:32:05.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.508+0000 7f397fb74640 1 -- 172.21.15.6:0/614537074 wait complete. 2023-07-21T22:32:05.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397fb74640 1 Processor -- start 2023-07-21T22:32:05.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397fb74640 1 -- start start 2023-07-21T22:32:05.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397fb74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39780b7c70 0x7f397815e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:05.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397fb74640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39780d1850 0x7f3978159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:05.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397fb74640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f397815fd60 0x7f397815a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:05.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397fb74640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397815e860 con 0x7f39780b7c70 2023-07-21T22:32:05.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397fb74640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39780b6f40 con 0x7f39780d1850 2023-07-21T22:32:05.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397fb74640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397815ea90 con 0x7f397815fd60 2023-07-21T22:32:05.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397d910640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39780b7c70 0x7f397815e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:05.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397d910640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39780b7c70 0x7f397815e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35674/0 (socket says 172.21.15.6:35674) 2023-07-21T22:32:05.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397d910640 1 -- 172.21.15.6:0/476931359 learned_addr learned my addr 172.21.15.6:0/476931359 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:05.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397d10f640 1 --2- 172.21.15.6:0/476931359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39780d1850 0x7f3978159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:05.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397e111640 1 --2- 172.21.15.6:0/476931359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f397815fd60 0x7f397815a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:05.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397d910640 1 -- 172.21.15.6:0/476931359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f397815fd60 msgr2=0x7f397815a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:05.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397d910640 1 --2- 172.21.15.6:0/476931359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f397815fd60 0x7f397815a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397d910640 1 -- 172.21.15.6:0/476931359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39780d1850 msgr2=0x7f3978159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:05.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397d910640 1 --2- 172.21.15.6:0/476931359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39780d1850 0x7f3978159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397d910640 1 -- 172.21.15.6:0/476931359 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39740094d0 con 0x7f39780b7c70 2023-07-21T22:32:05.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397d910640 1 --2- 172.21.15.6:0/476931359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39780b7c70 0x7f397815e320 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f39740ac040 tx=0x7f397401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:05.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f396e7fc640 1 -- 172.21.15.6:0/476931359 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39740b3800 con 0x7f39780b7c70 2023-07-21T22:32:05.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f396e7fc640 1 -- 172.21.15.6:0/476931359 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39740b3980 con 0x7f39780b7c70 2023-07-21T22:32:05.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f396e7fc640 1 -- 172.21.15.6:0/476931359 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39740b3d30 con 0x7f39780b7c70 2023-07-21T22:32:05.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397fb74640 1 -- 172.21.15.6:0/476931359 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397815ed70 con 0x7f39780b7c70 2023-07-21T22:32:05.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.512+0000 7f397fb74640 1 -- 172.21.15.6:0/476931359 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3978154570 con 0x7f39780b7c70 2023-07-21T22:32:05.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.516+0000 7f397fb74640 1 -- 172.21.15.6:0/476931359 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39781540f0 con 0x7f39780b7c70 2023-07-21T22:32:05.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.516+0000 7f396e7fc640 1 -- 172.21.15.6:0/476931359 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f39740b2380 con 0x7f39780b7c70 2023-07-21T22:32:05.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.516+0000 7f396e7fc640 1 --2- 172.21.15.6:0/476931359 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f395c0663a0 0x7f395c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:05.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.516+0000 7f396e7fc640 1 -- 172.21.15.6:0/476931359 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f397411e720 con 0x7f39780b7c70 2023-07-21T22:32:05.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.516+0000 7f397d10f640 1 --2- 172.21.15.6:0/476931359 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f395c0663a0 0x7f395c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:05.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.516+0000 7f397d10f640 1 --2- 172.21.15.6:0/476931359 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f395c0663a0 0x7f395c068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f39780cc8b0 tx=0x7f3968009040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:05.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.520+0000 7f396e7fc640 1 -- 172.21.15.6:0/476931359 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f39781540f0 con 0x7f39780b7c70 2023-07-21T22:32:05.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.676+0000 7f397fb74640 1 -- 172.21.15.6:0/476931359 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39781540f0 con 0x7f39780b7c70 2023-07-21T22:32:05.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.676+0000 7f396e7fc640 1 -- 172.21.15.6:0/476931359 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+18349 (secure 0 0 0) 0x7f39781540f0 con 0x7f39780b7c70 2023-07-21T22:32:05.726 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:32:05.726 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":67,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:32:02.928818+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:31:59.449200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-21T22:32:00.321692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:32:05.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.680+0000 7f397fb74640 1 -- 172.21.15.6:0/476931359 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f395c0663a0 msgr2=0x7f395c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:05.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.680+0000 7f397fb74640 1 --2- 172.21.15.6:0/476931359 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f395c0663a0 0x7f395c068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f39780cc8b0 tx=0x7f3968009040 comp rx=0 tx=0).stop 2023-07-21T22:32:05.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.680+0000 7f397fb74640 1 -- 172.21.15.6:0/476931359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39780b7c70 msgr2=0x7f397815e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:05.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.680+0000 7f397fb74640 1 --2- 172.21.15.6:0/476931359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39780b7c70 0x7f397815e320 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f39740ac040 tx=0x7f397401ad10 comp rx=0 tx=0).stop 2023-07-21T22:32:05.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.680+0000 7f397fb74640 1 -- 172.21.15.6:0/476931359 shutdown_connections 2023-07-21T22:32:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.680+0000 7f397fb74640 1 --2- 172.21.15.6:0/476931359 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f395c0663a0 0x7f395c068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.680+0000 7f397fb74640 1 --2- 172.21.15.6:0/476931359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f397815fd60 0x7f397815a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.680+0000 7f397fb74640 1 --2- 172.21.15.6:0/476931359 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39780d1850 0x7f3978159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.680+0000 7f397fb74640 1 --2- 172.21.15.6:0/476931359 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39780b7c70 0x7f397815e320 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.680+0000 7f397fb74640 1 -- 172.21.15.6:0/476931359 >> 172.21.15.6:0/476931359 conn(0x7f39780650b0 msgr2=0x7f39780cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.680+0000 7f397fb74640 1 -- 172.21.15.6:0/476931359 shutdown_connections 2023-07-21T22:32:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.680+0000 7f397fb74640 1 -- 172.21.15.6:0/476931359 wait complete. 2023-07-21T22:32:05.748 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T22:32:05.748 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:32:05.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.844+0000 7f1433496640 1 Processor -- start 2023-07-21T22:32:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.844+0000 7f1433496640 1 -- start start 2023-07-21T22:32:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.844+0000 7f1433496640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f142c160330 0x7f142c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:05.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.844+0000 7f1433496640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142c0c17d0 con 0x7f142c0c0f80 2023-07-21T22:32:05.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.844+0000 7f1433496640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142c0c14f0 con 0x7f142c0c8940 2023-07-21T22:32:05.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.844+0000 7f1433496640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f142c0cdd70 con 0x7f142c160330 2023-07-21T22:32:05.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.844+0000 7f1431232640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f142c160330 0x7f142c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:05.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.844+0000 7f1431232640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f142c160330 0x7f142c0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35686/0 (socket says 172.21.15.6:35686) 2023-07-21T22:32:05.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.844+0000 7f1431232640 1 -- 172.21.15.6:0/4041053908 learned_addr learned my addr 172.21.15.6:0/4041053908 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:05.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.844+0000 7f1431a33640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f142c0c0f80 0x7f142c0cd660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53670/0 (socket says 172.21.15.6:53670) 2023-07-21T22:32:05.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.844+0000 7f1431232640 1 -- 172.21.15.6:0/4041053908 >> v1:172.21.15.161:6789/0 conn(0x7f142c0c8940 legacy=0x7f142c0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:05.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.844+0000 7f1431232640 1 -- 172.21.15.6:0/4041053908 >> v1:172.21.15.6:6789/0 conn(0x7f142c0c0f80 legacy=0x7f142c0cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:05.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.844+0000 7f1431232640 1 -- 172.21.15.6:0/4041053908 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c0cac10 con 0x7f142c160330 2023-07-21T22:32:05.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.844+0000 7f1423fff640 1 -- 172.21.15.6:0/4041053908 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012265548 0 0) 0x7f142c0c17d0 con 0x7f142c0c0f80 2023-07-21T22:32:05.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.848+0000 7f1431232640 1 --2- 172.21.15.6:0/4041053908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f142c160330 0x7f142c0cb6f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1428009870 tx=0x7f142801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec799e81174798fd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:05.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.848+0000 7f1423fff640 1 -- 172.21.15.6:0/4041053908 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14280a8a30 con 0x7f142c160330 2023-07-21T22:32:05.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.848+0000 7f1423fff640 1 -- 172.21.15.6:0/4041053908 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14280a8b90 con 0x7f142c160330 2023-07-21T22:32:05.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.848+0000 7f1423fff640 1 -- 172.21.15.6:0/4041053908 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14280b0440 con 0x7f142c160330 2023-07-21T22:32:05.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.848+0000 7f1433496640 1 -- 172.21.15.6:0/4041053908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f142c160330 msgr2=0x7f142c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:05.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.848+0000 7f1433496640 1 --2- 172.21.15.6:0/4041053908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f142c160330 0x7f142c0cb6f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1428009870 tx=0x7f142801ed30 comp rx=0 tx=0).stop 2023-07-21T22:32:05.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.848+0000 7f1433496640 1 -- 172.21.15.6:0/4041053908 shutdown_connections 2023-07-21T22:32:05.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.848+0000 7f1433496640 1 --2- 172.21.15.6:0/4041053908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f142c160330 0x7f142c0cb6f0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.848+0000 7f1433496640 1 -- 172.21.15.6:0/4041053908 >> 172.21.15.6:0/4041053908 conn(0x7f142c0afcf0 msgr2=0x7f142c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:05.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.848+0000 7f1433496640 1 -- 172.21.15.6:0/4041053908 shutdown_connections 2023-07-21T22:32:05.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.848+0000 7f1433496640 1 -- 172.21.15.6:0/4041053908 wait complete. 2023-07-21T22:32:05.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1433496640 1 Processor -- start 2023-07-21T22:32:05.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1433496640 1 -- start start 2023-07-21T22:32:05.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1433496640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f142c0c0f80 0x7f142c160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:05.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1433496640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f142c0c8940 0x7f142c0c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:05.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1433496640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f142c160330 0x7f142c0c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:05.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1433496640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c0b1e40 con 0x7f142c160330 2023-07-21T22:32:05.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1433496640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c0b2120 con 0x7f142c0c0f80 2023-07-21T22:32:05.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1433496640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142c0b2400 con 0x7f142c0c8940 2023-07-21T22:32:05.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1431a33640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f142c160330 0x7f142c0c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:05.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1431a33640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f142c160330 0x7f142c0c7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35698/0 (socket says 172.21.15.6:35698) 2023-07-21T22:32:05.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1431a33640 1 -- 172.21.15.6:0/3925081132 learned_addr learned my addr 172.21.15.6:0/3925081132 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:05.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1431232640 1 --2- 172.21.15.6:0/3925081132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f142c0c0f80 0x7f142c160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:05.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1430a31640 1 --2- 172.21.15.6:0/3925081132 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f142c0c8940 0x7f142c0c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:05.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1431a33640 1 -- 172.21.15.6:0/3925081132 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f142c0c8940 msgr2=0x7f142c0c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:05.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1431a33640 1 --2- 172.21.15.6:0/3925081132 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f142c0c8940 0x7f142c0c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1431a33640 1 -- 172.21.15.6:0/3925081132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f142c0c0f80 msgr2=0x7f142c160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1431a33640 1 --2- 172.21.15.6:0/3925081132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f142c0c0f80 0x7f142c160970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1431a33640 1 -- 172.21.15.6:0/3925081132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14280094d0 con 0x7f142c160330 2023-07-21T22:32:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1430a31640 1 --2- 172.21.15.6:0/3925081132 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f142c0c8940 0x7f142c0c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1431a33640 1 --2- 172.21.15.6:0/3925081132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f142c160330 0x7f142c0c7920 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1424001570 tx=0x7f142400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1421ffb640 1 -- 172.21.15.6:0/3925081132 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142400a640 con 0x7f142c160330 2023-07-21T22:32:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1421ffb640 1 -- 172.21.15.6:0/3925081132 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142400a7c0 con 0x7f142c160330 2023-07-21T22:32:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1421ffb640 1 -- 172.21.15.6:0/3925081132 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142400ab70 con 0x7f142c160330 2023-07-21T22:32:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.852+0000 7f1433496640 1 -- 172.21.15.6:0/3925081132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142c0b26e0 con 0x7f142c160330 2023-07-21T22:32:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.856+0000 7f1433496640 1 -- 172.21.15.6:0/3925081132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142c0b2ca0 con 0x7f142c160330 2023-07-21T22:32:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.856+0000 7f1433496640 1 -- 172.21.15.6:0/3925081132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142c0b2ec0 con 0x7f142c160330 2023-07-21T22:32:05.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.856+0000 7f1421ffb640 1 -- 172.21.15.6:0/3925081132 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f142400acd0 con 0x7f142c160330 2023-07-21T22:32:05.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.856+0000 7f1421ffb640 1 --2- 172.21.15.6:0/3925081132 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f14100663a0 0x7f1410068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:05.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.856+0000 7f1421ffb640 1 -- 172.21.15.6:0/3925081132 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f1424083470 con 0x7f142c160330 2023-07-21T22:32:05.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.856+0000 7f1431232640 1 --2- 172.21.15.6:0/3925081132 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f14100663a0 0x7f1410068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.860+0000 7f1431232640 1 --2- 172.21.15.6:0/3925081132 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f14100663a0 0x7f1410068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f14280b2000 tx=0x7f1428009040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:05.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:05.860+0000 7f1421ffb640 1 -- 172.21.15.6:0/3925081132 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14240507c0 con 0x7f142c160330 2023-07-21T22:32:06.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.020+0000 7f1433496640 1 -- 172.21.15.6:0/3925081132 --> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f142c0cb1d0 con 0x7f14100663a0 2023-07-21T22:32:06.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.028+0000 7f1421ffb640 1 -- 172.21.15.6:0/3925081132 <== mgr.5743 v2:172.21.15.161:6832/3740183048 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305853 (secure 0 0 0) 0x7f14280ae340 con 0x7f14100663a0 2023-07-21T22:32:06.081 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:32:06.082 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:32:06.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.032+0000 7f1433496640 1 -- 172.21.15.6:0/3925081132 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f14100663a0 msgr2=0x7f1410068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:06.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.032+0000 7f1433496640 1 --2- 172.21.15.6:0/3925081132 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f14100663a0 0x7f1410068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f14280b2000 tx=0x7f1428009040 comp rx=0 tx=0).stop 2023-07-21T22:32:06.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.032+0000 7f1433496640 1 -- 172.21.15.6:0/3925081132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f142c160330 msgr2=0x7f142c0c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:06.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.032+0000 7f1433496640 1 --2- 172.21.15.6:0/3925081132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f142c160330 0x7f142c0c7920 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f1424001570 tx=0x7f142400cca0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.032+0000 7f1433496640 1 -- 172.21.15.6:0/3925081132 shutdown_connections 2023-07-21T22:32:06.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.032+0000 7f1433496640 1 --2- 172.21.15.6:0/3925081132 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f14100663a0 0x7f1410068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.032+0000 7f1433496640 1 --2- 172.21.15.6:0/3925081132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f142c160330 0x7f142c0c7920 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.032+0000 7f1433496640 1 --2- 172.21.15.6:0/3925081132 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f142c0c8940 0x7f142c0c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.032+0000 7f1433496640 1 --2- 172.21.15.6:0/3925081132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f142c0c0f80 0x7f142c160970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.032+0000 7f1433496640 1 -- 172.21.15.6:0/3925081132 >> 172.21.15.6:0/3925081132 conn(0x7f142c0afcf0 msgr2=0x7f142c0cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:06.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.032+0000 7f1433496640 1 -- 172.21.15.6:0/3925081132 shutdown_connections 2023-07-21T22:32:06.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.032+0000 7f1433496640 1 -- 172.21.15.6:0/3925081132 wait complete. 2023-07-21T22:32:06.101 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-21T22:32:05.705254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":295696,"kb_used_data":7120,"kb_used_omap":0,"kb_used_meta":288512,"kb_avail":754679024,"statfs":{"total":773094113280,"available":772791320576,"internally_reserved":0,"allocated":7290880,"data_stored":4119056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":295436288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.781878"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939046+0000","last_change":"2023-07-21T22:32:00.939046+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939046+0000","last_undegraded":"2023-07-21T22:32:00.939046+0000","last_fullsized":"2023-07-21T22:32:00.939046+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940135+0000","last_change":"2023-07-21T22:32:00.940135+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940135+0000","last_undegraded":"2023-07-21T22:32:00.940135+0000","last_fullsized":"2023-07-21T22:32:00.940135+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.935591+0000","last_change":"2023-07-21T22:32:00.935591+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.935591+0000","last_undegraded":"2023-07-21T22:32:00.935591+0000","last_fullsized":"2023-07-21T22:32:00.935591+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939384+0000","last_change":"2023-07-21T22:32:00.939384+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939384+0000","last_undegraded":"2023-07-21T22:32:00.939384+0000","last_fullsized":"2023-07-21T22:32:00.939384+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.945092+0000","last_change":"2023-07-21T22:32:00.945092+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.945092+0000","last_undegraded":"2023-07-21T22:32:00.945092+0000","last_fullsized":"2023-07-21T22:32:00.945092+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940528+0000","last_change":"2023-07-21T22:32:00.940528+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940528+0000","last_undegraded":"2023-07-21T22:32:00.940528+0000","last_fullsized":"2023-07-21T22:32:00.940528+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.931463+0000","last_change":"2023-07-21T22:32:00.931463+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.931463+0000","last_undegraded":"2023-07-21T22:32:00.931463+0000","last_fullsized":"2023-07-21T22:32:00.931463+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.943332+0000","last_change":"2023-07-21T22:32:00.943332+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.943332+0000","last_undegraded":"2023-07-21T22:32:00.943332+0000","last_fullsized":"2023-07-21T22:32:00.943332+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.943669+0000","last_change":"2023-07-21T22:32:00.943669+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.943669+0000","last_undegraded":"2023-07-21T22:32:00.943669+0000","last_fullsized":"2023-07-21T22:32:00.943669+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942369+0000","last_change":"2023-07-21T22:32:00.942369+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942369+0000","last_undegraded":"2023-07-21T22:32:00.942369+0000","last_fullsized":"2023-07-21T22:32:00.942369+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.933108+0000","last_change":"2023-07-21T22:32:00.933108+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.933108+0000","last_undegraded":"2023-07-21T22:32:00.933108+0000","last_fullsized":"2023-07-21T22:32:00.933108+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.943642+0000","last_change":"2023-07-21T22:32:00.943642+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.943642+0000","last_undegraded":"2023-07-21T22:32:00.943642+0000","last_fullsized":"2023-07-21T22:32:00.943642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939463+0000","last_change":"2023-07-21T22:32:00.939463+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939463+0000","last_undegraded":"2023-07-21T22:32:00.939463+0000","last_fullsized":"2023-07-21T22:32:00.939463+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.931137+0000","last_change":"2023-07-21T22:32:00.931137+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.931137+0000","last_undegraded":"2023-07-21T22:32:00.931137+0000","last_fullsized":"2023-07-21T22:32:00.931137+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940920+0000","last_change":"2023-07-21T22:32:00.940920+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940920+0000","last_undegraded":"2023-07-21T22:32:00.940920+0000","last_fullsized":"2023-07-21T22:32:00.940920+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941617+0000","last_change":"2023-07-21T22:32:00.941617+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941617+0000","last_undegraded":"2023-07-21T22:32:00.941617+0000","last_fullsized":"2023-07-21T22:32:00.941617+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.934576+0000","last_change":"2023-07-21T22:32:00.934576+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.934576+0000","last_undegraded":"2023-07-21T22:32:00.934576+0000","last_fullsized":"2023-07-21T22:32:00.934576+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939627+0000","last_change":"2023-07-21T22:32:00.939627+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939627+0000","last_undegraded":"2023-07-21T22:32:00.939627+0000","last_fullsized":"2023-07-21T22:32:00.939627+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.935124+0000","last_change":"2023-07-21T22:32:00.935124+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.935124+0000","last_undegraded":"2023-07-21T22:32:00.935124+0000","last_fullsized":"2023-07-21T22:32:00.935124+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940067+0000","last_change":"2023-07-21T22:32:00.940067+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940067+0000","last_undegraded":"2023-07-21T22:32:00.940067+0000","last_fullsized":"2023-07-21T22:32:00.940067+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939390+0000","last_change":"2023-07-21T22:32:00.939390+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939390+0000","last_undegraded":"2023-07-21T22:32:00.939390+0000","last_fullsized":"2023-07-21T22:32:00.939390+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942199+0000","last_change":"2023-07-21T22:32:00.942199+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942199+0000","last_undegraded":"2023-07-21T22:32:00.942199+0000","last_fullsized":"2023-07-21T22:32:00.942199+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.934188+0000","last_change":"2023-07-21T22:32:00.934188+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.934188+0000","last_undegraded":"2023-07-21T22:32:00.934188+0000","last_fullsized":"2023-07-21T22:32:00.934188+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.932446+0000","last_change":"2023-07-21T22:32:00.932446+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.932446+0000","last_undegraded":"2023-07-21T22:32:00.932446+0000","last_fullsized":"2023-07-21T22:32:00.932446+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.934081+0000","last_change":"2023-07-21T22:32:00.934081+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.934081+0000","last_undegraded":"2023-07-21T22:32:00.934081+0000","last_fullsized":"2023-07-21T22:32:00.934081+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942891+0000","last_change":"2023-07-21T22:32:00.942891+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942891+0000","last_undegraded":"2023-07-21T22:32:00.942891+0000","last_fullsized":"2023-07-21T22:32:00.942891+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941426+0000","last_change":"2023-07-21T22:32:00.941426+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941426+0000","last_undegraded":"2023-07-21T22:32:00.941426+0000","last_fullsized":"2023-07-21T22:32:00.941426+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939540+0000","last_change":"2023-07-21T22:32:00.939540+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939540+0000","last_undegraded":"2023-07-21T22:32:00.939540+0000","last_fullsized":"2023-07-21T22:32:00.939540+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.931313+0000","last_change":"2023-07-21T22:32:00.931313+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.931313+0000","last_undegraded":"2023-07-21T22:32:00.931313+0000","last_fullsized":"2023-07-21T22:32:00.931313+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942556+0000","last_change":"2023-07-21T22:32:00.942556+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942556+0000","last_undegraded":"2023-07-21T22:32:00.942556+0000","last_fullsized":"2023-07-21T22:32:00.942556+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.930989+0000","last_change":"2023-07-21T22:32:00.930989+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.930989+0000","last_undegraded":"2023-07-21T22:32:00.930989+0000","last_fullsized":"2023-07-21T22:32:00.930989+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.937353+0000","last_change":"2023-07-21T22:32:00.937353+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.937353+0000","last_undegraded":"2023-07-21T22:32:00.937353+0000","last_fullsized":"2023-07-21T22:32:00.937353+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940212+0000","last_change":"2023-07-21T22:32:00.940212+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940212+0000","last_undegraded":"2023-07-21T22:32:00.940212+0000","last_fullsized":"2023-07-21T22:32:00.940212+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.953399+0000","last_change":"2023-07-21T22:32:00.951495+0000","last_active":"2023-07-21T22:32:00.953399+0000","last_peered":"2023-07-21T22:32:00.953399+0000","last_clean":"2023-07-21T22:32:00.953399+0000","last_became_active":"2023-07-21T22:32:00.951233+0000","last_became_peered":"2023-07-21T22:32:00.951233+0000","last_unstale":"2023-07-21T22:32:00.953399+0000","last_undegraded":"2023-07-21T22:32:00.953399+0000","last_fullsized":"2023-07-21T22:32:00.953399+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:48:19.238340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936126+0000","last_change":"2023-07-21T22:32:00.936126+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936126+0000","last_undegraded":"2023-07-21T22:32:00.936126+0000","last_fullsized":"2023-07-21T22:32:00.936126+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.957667+0000","last_change":"2023-07-21T22:32:00.954953+0000","last_active":"2023-07-21T22:32:00.957667+0000","last_peered":"2023-07-21T22:32:00.957667+0000","last_clean":"2023-07-21T22:32:00.957667+0000","last_became_active":"2023-07-21T22:32:00.954668+0000","last_became_peered":"2023-07-21T22:32:00.954668+0000","last_unstale":"2023-07-21T22:32:00.957667+0000","last_undegraded":"2023-07-21T22:32:00.957667+0000","last_fullsized":"2023-07-21T22:32:00.957667+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:40:48.657491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939148+0000","last_change":"2023-07-21T22:32:00.939148+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939148+0000","last_undegraded":"2023-07-21T22:32:00.939148+0000","last_fullsized":"2023-07-21T22:32:00.939148+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.955289+0000","last_change":"2023-07-21T22:32:00.949062+0000","last_active":"2023-07-21T22:32:00.955289+0000","last_peered":"2023-07-21T22:32:00.955289+0000","last_clean":"2023-07-21T22:32:00.955289+0000","last_became_active":"2023-07-21T22:32:00.948796+0000","last_became_peered":"2023-07-21T22:32:00.948796+0000","last_unstale":"2023-07-21T22:32:00.955289+0000","last_undegraded":"2023-07-21T22:32:00.955289+0000","last_fullsized":"2023-07-21T22:32:00.955289+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:18:28.623919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942728+0000","last_change":"2023-07-21T22:32:00.942728+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942728+0000","last_undegraded":"2023-07-21T22:32:00.942728+0000","last_fullsized":"2023-07-21T22:32:00.942728+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.958912+0000","last_change":"2023-07-21T22:32:00.957955+0000","last_active":"2023-07-21T22:32:00.958912+0000","last_peered":"2023-07-21T22:32:00.958912+0000","last_clean":"2023-07-21T22:32:00.958912+0000","last_became_active":"2023-07-21T22:32:00.957647+0000","last_became_peered":"2023-07-21T22:32:00.957647+0000","last_unstale":"2023-07-21T22:32:00.958912+0000","last_undegraded":"2023-07-21T22:32:00.958912+0000","last_fullsized":"2023-07-21T22:32:00.958912+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:47:59.245516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.944136+0000","last_change":"2023-07-21T22:32:00.944136+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.944136+0000","last_undegraded":"2023-07-21T22:32:00.944136+0000","last_fullsized":"2023-07-21T22:32:00.944136+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.945045+0000","last_change":"2023-07-21T22:32:00.939672+0000","last_active":"2023-07-21T22:32:00.945045+0000","last_peered":"2023-07-21T22:32:00.945045+0000","last_clean":"2023-07-21T22:32:00.945045+0000","last_became_active":"2023-07-21T22:32:00.939377+0000","last_became_peered":"2023-07-21T22:32:00.939377+0000","last_unstale":"2023-07-21T22:32:00.945045+0000","last_undegraded":"2023-07-21T22:32:00.945045+0000","last_fullsized":"2023-07-21T22:32:00.945045+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:21:16.607665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940650+0000","last_change":"2023-07-21T22:32:00.940650+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940650+0000","last_undegraded":"2023-07-21T22:32:00.940650+0000","last_fullsized":"2023-07-21T22:32:00.940650+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.956668+0000","last_change":"2023-07-21T22:32:00.952492+0000","last_active":"2023-07-21T22:32:00.956668+0000","last_peered":"2023-07-21T22:32:00.956668+0000","last_clean":"2023-07-21T22:32:00.956668+0000","last_became_active":"2023-07-21T22:32:00.952206+0000","last_became_peered":"2023-07-21T22:32:00.952206+0000","last_unstale":"2023-07-21T22:32:00.956668+0000","last_undegraded":"2023-07-21T22:32:00.956668+0000","last_fullsized":"2023-07-21T22:32:00.956668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:23:46.523157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941817+0000","last_change":"2023-07-21T22:32:00.941817+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941817+0000","last_undegraded":"2023-07-21T22:32:00.941817+0000","last_fullsized":"2023-07-21T22:32:00.941817+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.953100+0000","last_change":"2023-07-21T22:32:00.950894+0000","last_active":"2023-07-21T22:32:00.953100+0000","last_peered":"2023-07-21T22:32:00.953100+0000","last_clean":"2023-07-21T22:32:00.953100+0000","last_became_active":"2023-07-21T22:32:00.950574+0000","last_became_peered":"2023-07-21T22:32:00.950574+0000","last_unstale":"2023-07-21T22:32:00.953100+0000","last_undegraded":"2023-07-21T22:32:00.953100+0000","last_fullsized":"2023-07-21T22:32:00.953100+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:39:22.307711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939246+0000","last_change":"2023-07-21T22:32:00.939246+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939246+0000","last_undegraded":"2023-07-21T22:32:00.939246+0000","last_fullsized":"2023-07-21T22:32:00.939246+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.954926+0000","last_change":"2023-07-21T22:32:00.950304+0000","last_active":"2023-07-21T22:32:00.954926+0000","last_peered":"2023-07-21T22:32:00.954926+0000","last_clean":"2023-07-21T22:32:00.954926+0000","last_became_active":"2023-07-21T22:32:00.949932+0000","last_became_peered":"2023-07-21T22:32:00.949932+0000","last_unstale":"2023-07-21T22:32:00.954926+0000","last_undegraded":"2023-07-21T22:32:00.954926+0000","last_fullsized":"2023-07-21T22:32:00.954926+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:33:09.061573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942335+0000","last_change":"2023-07-21T22:32:00.942335+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942335+0000","last_undegraded":"2023-07-21T22:32:00.942335+0000","last_fullsized":"2023-07-21T22:32:00.942335+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.951430+0000","last_change":"2023-07-21T22:32:00.949543+0000","last_active":"2023-07-21T22:32:00.951430+0000","last_peered":"2023-07-21T22:32:00.951430+0000","last_clean":"2023-07-21T22:32:00.951430+0000","last_became_active":"2023-07-21T22:32:00.949230+0000","last_became_peered":"2023-07-21T22:32:00.949230+0000","last_unstale":"2023-07-21T22:32:00.951430+0000","last_undegraded":"2023-07-21T22:32:00.951430+0000","last_fullsized":"2023-07-21T22:32:00.951430+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:01:13.578327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.937205+0000","last_change":"2023-07-21T22:32:00.937205+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.937205+0000","last_undegraded":"2023-07-21T22:32:00.937205+0000","last_fullsized":"2023-07-21T22:32:00.937205+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.956608+0000","last_change":"2023-07-21T22:32:00.951734+0000","last_active":"2023-07-21T22:32:00.956608+0000","last_peered":"2023-07-21T22:32:00.956608+0000","last_clean":"2023-07-21T22:32:00.956608+0000","last_became_active":"2023-07-21T22:32:00.950944+0000","last_became_peered":"2023-07-21T22:32:00.950944+0000","last_unstale":"2023-07-21T22:32:00.956608+0000","last_undegraded":"2023-07-21T22:32:00.956608+0000","last_fullsized":"2023-07-21T22:32:00.956608+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:18:12.778871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.930588+0000","last_change":"2023-07-21T22:32:00.930588+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.930588+0000","last_undegraded":"2023-07-21T22:32:00.930588+0000","last_fullsized":"2023-07-21T22:32:00.930588+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.956872+0000","last_change":"2023-07-21T22:32:00.955950+0000","last_active":"2023-07-21T22:32:00.956872+0000","last_peered":"2023-07-21T22:32:00.956872+0000","last_clean":"2023-07-21T22:32:00.956872+0000","last_became_active":"2023-07-21T22:32:00.955656+0000","last_became_peered":"2023-07-21T22:32:00.955656+0000","last_unstale":"2023-07-21T22:32:00.956872+0000","last_undegraded":"2023-07-21T22:32:00.956872+0000","last_fullsized":"2023-07-21T22:32:00.956872+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:54:13.720697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942555+0000","last_change":"2023-07-21T22:32:00.942555+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942555+0000","last_undegraded":"2023-07-21T22:32:00.942555+0000","last_fullsized":"2023-07-21T22:32:00.942555+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.953630+0000","last_change":"2023-07-21T22:32:00.944870+0000","last_active":"2023-07-21T22:32:00.953630+0000","last_peered":"2023-07-21T22:32:00.953630+0000","last_clean":"2023-07-21T22:32:00.953630+0000","last_became_active":"2023-07-21T22:32:00.944534+0000","last_became_peered":"2023-07-21T22:32:00.944534+0000","last_unstale":"2023-07-21T22:32:00.953630+0000","last_undegraded":"2023-07-21T22:32:00.953630+0000","last_fullsized":"2023-07-21T22:32:00.953630+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:43:59.834021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936876+0000","last_change":"2023-07-21T22:32:00.936876+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936876+0000","last_undegraded":"2023-07-21T22:32:00.936876+0000","last_fullsized":"2023-07-21T22:32:00.936876+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.948392+0000","last_change":"2023-07-21T22:32:00.946546+0000","last_active":"2023-07-21T22:32:00.948392+0000","last_peered":"2023-07-21T22:32:00.948392+0000","last_clean":"2023-07-21T22:32:00.948392+0000","last_became_active":"2023-07-21T22:32:00.946230+0000","last_became_peered":"2023-07-21T22:32:00.946230+0000","last_unstale":"2023-07-21T22:32:00.948392+0000","last_undegraded":"2023-07-21T22:32:00.948392+0000","last_fullsized":"2023-07-21T22:32:00.948392+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:14:44.561456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.934363+0000","last_change":"2023-07-21T22:32:00.934363+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.934363+0000","last_undegraded":"2023-07-21T22:32:00.934363+0000","last_fullsized":"2023-07-21T22:32:00.934363+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.951794+0000","last_change":"2023-07-21T22:32:00.948760+0000","last_active":"2023-07-21T22:32:00.951794+0000","last_peered":"2023-07-21T22:32:00.951794+0000","last_clean":"2023-07-21T22:32:00.951794+0000","last_became_active":"2023-07-21T22:32:00.948465+0000","last_became_peered":"2023-07-21T22:32:00.948465+0000","last_unstale":"2023-07-21T22:32:00.951794+0000","last_undegraded":"2023-07-21T22:32:00.951794+0000","last_fullsized":"2023-07-21T22:32:00.951794+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:02:10.700819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942388+0000","last_change":"2023-07-21T22:32:00.942388+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942388+0000","last_undegraded":"2023-07-21T22:32:00.942388+0000","last_fullsized":"2023-07-21T22:32:00.942388+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.955252+0000","last_change":"2023-07-21T22:32:00.952133+0000","last_active":"2023-07-21T22:32:00.955252+0000","last_peered":"2023-07-21T22:32:00.955252+0000","last_clean":"2023-07-21T22:32:00.955252+0000","last_became_active":"2023-07-21T22:32:00.951734+0000","last_became_peered":"2023-07-21T22:32:00.951734+0000","last_unstale":"2023-07-21T22:32:00.955252+0000","last_undegraded":"2023-07-21T22:32:00.955252+0000","last_fullsized":"2023-07-21T22:32:00.955252+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:40:24.334656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.937756+0000","last_change":"2023-07-21T22:32:00.937756+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.937756+0000","last_undegraded":"2023-07-21T22:32:00.937756+0000","last_fullsized":"2023-07-21T22:32:00.937756+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.954799+0000","last_change":"2023-07-21T22:32:00.952275+0000","last_active":"2023-07-21T22:32:00.954799+0000","last_peered":"2023-07-21T22:32:00.954799+0000","last_clean":"2023-07-21T22:32:00.954799+0000","last_became_active":"2023-07-21T22:32:00.951981+0000","last_became_peered":"2023-07-21T22:32:00.951981+0000","last_unstale":"2023-07-21T22:32:00.954799+0000","last_undegraded":"2023-07-21T22:32:00.954799+0000","last_fullsized":"2023-07-21T22:32:00.954799+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:08.224210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941696+0000","last_change":"2023-07-21T22:32:00.941696+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941696+0000","last_undegraded":"2023-07-21T22:32:00.941696+0000","last_fullsized":"2023-07-21T22:32:00.941696+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.955656+0000","last_change":"2023-07-21T22:32:00.953359+0000","last_active":"2023-07-21T22:32:00.955656+0000","last_peered":"2023-07-21T22:32:00.955656+0000","last_clean":"2023-07-21T22:32:00.955656+0000","last_became_active":"2023-07-21T22:32:00.953042+0000","last_became_peered":"2023-07-21T22:32:00.953042+0000","last_unstale":"2023-07-21T22:32:00.955656+0000","last_undegraded":"2023-07-21T22:32:00.955656+0000","last_fullsized":"2023-07-21T22:32:00.955656+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:54:58.294196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939056+0000","last_change":"2023-07-21T22:32:00.939056+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939056+0000","last_undegraded":"2023-07-21T22:32:00.939056+0000","last_fullsized":"2023-07-21T22:32:00.939056+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.949424+0000","last_change":"2023-07-21T22:32:00.943392+0000","last_active":"2023-07-21T22:32:00.949424+0000","last_peered":"2023-07-21T22:32:00.949424+0000","last_clean":"2023-07-21T22:32:00.949424+0000","last_became_active":"2023-07-21T22:32:00.943043+0000","last_became_peered":"2023-07-21T22:32:00.943043+0000","last_unstale":"2023-07-21T22:32:00.949424+0000","last_undegraded":"2023-07-21T22:32:00.949424+0000","last_fullsized":"2023-07-21T22:32:00.949424+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:44:11.097837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.943243+0000","last_change":"2023-07-21T22:32:00.943243+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.943243+0000","last_undegraded":"2023-07-21T22:32:00.943243+0000","last_fullsized":"2023-07-21T22:32:00.943243+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.958676+0000","last_change":"2023-07-21T22:32:00.954859+0000","last_active":"2023-07-21T22:32:00.958676+0000","last_peered":"2023-07-21T22:32:00.958676+0000","last_clean":"2023-07-21T22:32:00.958676+0000","last_became_active":"2023-07-21T22:32:00.954521+0000","last_became_peered":"2023-07-21T22:32:00.954521+0000","last_unstale":"2023-07-21T22:32:00.958676+0000","last_undegraded":"2023-07-21T22:32:00.958676+0000","last_fullsized":"2023-07-21T22:32:00.958676+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:24:57.280727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.938951+0000","last_change":"2023-07-21T22:32:00.938951+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.938951+0000","last_undegraded":"2023-07-21T22:32:00.938951+0000","last_fullsized":"2023-07-21T22:32:00.938951+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.961338+0000","last_change":"2023-07-21T22:32:00.957742+0000","last_active":"2023-07-21T22:32:00.961338+0000","last_peered":"2023-07-21T22:32:00.961338+0000","last_clean":"2023-07-21T22:32:00.961338+0000","last_became_active":"2023-07-21T22:32:00.957336+0000","last_became_peered":"2023-07-21T22:32:00.957336+0000","last_unstale":"2023-07-21T22:32:00.961338+0000","last_undegraded":"2023-07-21T22:32:00.961338+0000","last_fullsized":"2023-07-21T22:32:00.961338+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:18:50.663097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936147+0000","last_change":"2023-07-21T22:32:00.936147+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936147+0000","last_undegraded":"2023-07-21T22:32:00.936147+0000","last_fullsized":"2023-07-21T22:32:00.936147+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.951555+0000","last_change":"2023-07-21T22:32:00.946873+0000","last_active":"2023-07-21T22:32:00.951555+0000","last_peered":"2023-07-21T22:32:00.951555+0000","last_clean":"2023-07-21T22:32:00.951555+0000","last_became_active":"2023-07-21T22:32:00.946537+0000","last_became_peered":"2023-07-21T22:32:00.946537+0000","last_unstale":"2023-07-21T22:32:00.951555+0000","last_undegraded":"2023-07-21T22:32:00.951555+0000","last_fullsized":"2023-07-21T22:32:00.951555+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:09.629226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941276+0000","last_change":"2023-07-21T22:32:00.941276+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941276+0000","last_undegraded":"2023-07-21T22:32:00.941276+0000","last_fullsized":"2023-07-21T22:32:00.941276+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.953565+0000","last_change":"2023-07-21T22:32:00.943926+0000","last_active":"2023-07-21T22:32:00.953565+0000","last_peered":"2023-07-21T22:32:00.953565+0000","last_clean":"2023-07-21T22:32:00.953565+0000","last_became_active":"2023-07-21T22:32:00.943551+0000","last_became_peered":"2023-07-21T22:32:00.943551+0000","last_unstale":"2023-07-21T22:32:00.953565+0000","last_undegraded":"2023-07-21T22:32:00.953565+0000","last_fullsized":"2023-07-21T22:32:00.953565+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:53:58.981346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.935715+0000","last_change":"2023-07-21T22:32:00.935715+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.935715+0000","last_undegraded":"2023-07-21T22:32:00.935715+0000","last_fullsized":"2023-07-21T22:32:00.935715+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.954655+0000","last_change":"2023-07-21T22:32:00.949051+0000","last_active":"2023-07-21T22:32:00.954655+0000","last_peered":"2023-07-21T22:32:00.954655+0000","last_clean":"2023-07-21T22:32:00.954655+0000","last_became_active":"2023-07-21T22:32:00.948748+0000","last_became_peered":"2023-07-21T22:32:00.948748+0000","last_unstale":"2023-07-21T22:32:00.954655+0000","last_undegraded":"2023-07-21T22:32:00.954655+0000","last_fullsized":"2023-07-21T22:32:00.954655+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:52:54.611034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.938361+0000","last_change":"2023-07-21T22:32:00.938361+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.938361+0000","last_undegraded":"2023-07-21T22:32:00.938361+0000","last_fullsized":"2023-07-21T22:32:00.938361+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.949581+0000","last_change":"2023-07-21T22:32:00.944727+0000","last_active":"2023-07-21T22:32:00.949581+0000","last_peered":"2023-07-21T22:32:00.949581+0000","last_clean":"2023-07-21T22:32:00.949581+0000","last_became_active":"2023-07-21T22:32:00.944461+0000","last_became_peered":"2023-07-21T22:32:00.944461+0000","last_unstale":"2023-07-21T22:32:00.949581+0000","last_undegraded":"2023-07-21T22:32:00.949581+0000","last_fullsized":"2023-07-21T22:32:00.949581+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:00:22.685969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939507+0000","last_change":"2023-07-21T22:32:00.939507+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939507+0000","last_undegraded":"2023-07-21T22:32:00.939507+0000","last_fullsized":"2023-07-21T22:32:00.939507+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.951171+0000","last_change":"2023-07-21T22:32:00.947839+0000","last_active":"2023-07-21T22:32:00.951171+0000","last_peered":"2023-07-21T22:32:00.951171+0000","last_clean":"2023-07-21T22:32:00.951171+0000","last_became_active":"2023-07-21T22:32:00.947416+0000","last_became_peered":"2023-07-21T22:32:00.947416+0000","last_unstale":"2023-07-21T22:32:00.951171+0000","last_undegraded":"2023-07-21T22:32:00.951171+0000","last_fullsized":"2023-07-21T22:32:00.951171+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:52:02.423090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'139","reported_seq":327,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.940683+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:32:00.940683+0000","last_peered":"2023-07-21T22:32:00.940683+0000","last_clean":"2023-07-21T22:32:00.940683+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:32:00.940683+0000","last_undegraded":"2023-07-21T22:32:00.940683+0000","last_fullsized":"2023-07-21T22:32:00.940683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:11:53.150494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":101,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.937864+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:32:00.937864+0000","last_peered":"2023-07-21T22:32:00.937864+0000","last_clean":"2023-07-21T22:32:00.937864+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:32:00.937864+0000","last_undegraded":"2023-07-21T22:32:00.937864+0000","last_fullsized":"2023-07-21T22:32:00.937864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:55:12.047847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940048+0000","last_change":"2023-07-21T22:32:00.940048+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940048+0000","last_undegraded":"2023-07-21T22:32:00.940048+0000","last_fullsized":"2023-07-21T22:32:00.940048+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.956861+0000","last_change":"2023-07-21T22:32:00.955530+0000","last_active":"2023-07-21T22:32:00.956861+0000","last_peered":"2023-07-21T22:32:00.956861+0000","last_clean":"2023-07-21T22:32:00.956861+0000","last_became_active":"2023-07-21T22:32:00.955208+0000","last_became_peered":"2023-07-21T22:32:00.955208+0000","last_unstale":"2023-07-21T22:32:00.956861+0000","last_undegraded":"2023-07-21T22:32:00.956861+0000","last_fullsized":"2023-07-21T22:32:00.956861+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:30:23.544614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":93,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.940556+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:32:00.940556+0000","last_peered":"2023-07-21T22:32:00.940556+0000","last_clean":"2023-07-21T22:32:00.940556+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:32:00.940556+0000","last_undegraded":"2023-07-21T22:32:00.940556+0000","last_fullsized":"2023-07-21T22:32:00.940556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:48.875424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941933+0000","last_change":"2023-07-21T22:32:00.941933+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941933+0000","last_undegraded":"2023-07-21T22:32:00.941933+0000","last_fullsized":"2023-07-21T22:32:00.941933+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.951232+0000","last_change":"2023-07-21T22:32:00.947085+0000","last_active":"2023-07-21T22:32:00.951232+0000","last_peered":"2023-07-21T22:32:00.951232+0000","last_clean":"2023-07-21T22:32:00.951232+0000","last_became_active":"2023-07-21T22:32:00.946461+0000","last_became_peered":"2023-07-21T22:32:00.946461+0000","last_unstale":"2023-07-21T22:32:00.951232+0000","last_undegraded":"2023-07-21T22:32:00.951232+0000","last_fullsized":"2023-07-21T22:32:00.951232+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:14:15.195255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":91,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.936597+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:32:00.936597+0000","last_peered":"2023-07-21T22:32:00.936597+0000","last_clean":"2023-07-21T22:32:00.936597+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:32:00.936597+0000","last_undegraded":"2023-07-21T22:32:00.936597+0000","last_fullsized":"2023-07-21T22:32:00.936597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:42.565432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936152+0000","last_change":"2023-07-21T22:32:00.936152+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936152+0000","last_undegraded":"2023-07-21T22:32:00.936152+0000","last_fullsized":"2023-07-21T22:32:00.936152+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.958746+0000","last_change":"2023-07-21T22:32:00.955354+0000","last_active":"2023-07-21T22:32:00.958746+0000","last_peered":"2023-07-21T22:32:00.958746+0000","last_clean":"2023-07-21T22:32:00.958746+0000","last_became_active":"2023-07-21T22:32:00.954992+0000","last_became_peered":"2023-07-21T22:32:00.954992+0000","last_unstale":"2023-07-21T22:32:00.958746+0000","last_undegraded":"2023-07-21T22:32:00.958746+0000","last_fullsized":"2023-07-21T22:32:00.958746+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:04:18.396523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":101,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.937912+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:32:00.937912+0000","last_peered":"2023-07-21T22:32:00.937912+0000","last_clean":"2023-07-21T22:32:00.937912+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:32:00.937912+0000","last_undegraded":"2023-07-21T22:32:00.937912+0000","last_fullsized":"2023-07-21T22:32:00.937912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:28:18.043637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936271+0000","last_change":"2023-07-21T22:32:00.936271+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936271+0000","last_undegraded":"2023-07-21T22:32:00.936271+0000","last_fullsized":"2023-07-21T22:32:00.936271+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.961335+0000","last_change":"2023-07-21T22:32:00.957850+0000","last_active":"2023-07-21T22:32:00.961335+0000","last_peered":"2023-07-21T22:32:00.961335+0000","last_clean":"2023-07-21T22:32:00.961335+0000","last_became_active":"2023-07-21T22:32:00.957501+0000","last_became_peered":"2023-07-21T22:32:00.957501+0000","last_unstale":"2023-07-21T22:32:00.961335+0000","last_undegraded":"2023-07-21T22:32:00.961335+0000","last_fullsized":"2023-07-21T22:32:00.961335+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:43:24.943153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.944285+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:32:00.944285+0000","last_peered":"2023-07-21T22:32:00.944285+0000","last_clean":"2023-07-21T22:32:00.944285+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:32:00.944285+0000","last_undegraded":"2023-07-21T22:32:00.944285+0000","last_fullsized":"2023-07-21T22:32:00.944285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:13:05.154378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942001+0000","last_change":"2023-07-21T22:32:00.942001+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942001+0000","last_undegraded":"2023-07-21T22:32:00.942001+0000","last_fullsized":"2023-07-21T22:32:00.942001+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.956368+0000","last_change":"2023-07-21T22:32:00.954255+0000","last_active":"2023-07-21T22:32:00.956368+0000","last_peered":"2023-07-21T22:32:00.956368+0000","last_clean":"2023-07-21T22:32:00.956368+0000","last_became_active":"2023-07-21T22:32:00.953914+0000","last_became_peered":"2023-07-21T22:32:00.953914+0000","last_unstale":"2023-07-21T22:32:00.956368+0000","last_undegraded":"2023-07-21T22:32:00.956368+0000","last_fullsized":"2023-07-21T22:32:00.956368+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:47:25.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.944284+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:32:00.944284+0000","last_peered":"2023-07-21T22:32:00.944284+0000","last_clean":"2023-07-21T22:32:00.944284+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:32:00.944284+0000","last_undegraded":"2023-07-21T22:32:00.944284+0000","last_fullsized":"2023-07-21T22:32:00.944284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:35:37.561916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.932429+0000","last_change":"2023-07-21T22:32:00.932429+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.932429+0000","last_undegraded":"2023-07-21T22:32:00.932429+0000","last_fullsized":"2023-07-21T22:32:00.932429+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.953917+0000","last_change":"2023-07-21T22:32:00.945223+0000","last_active":"2023-07-21T22:32:00.953917+0000","last_peered":"2023-07-21T22:32:00.953917+0000","last_clean":"2023-07-21T22:32:00.953917+0000","last_became_active":"2023-07-21T22:32:00.944958+0000","last_became_peered":"2023-07-21T22:32:00.944958+0000","last_unstale":"2023-07-21T22:32:00.953917+0000","last_undegraded":"2023-07-21T22:32:00.953917+0000","last_fullsized":"2023-07-21T22:32:00.953917+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:02:35.145130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.944500+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:32:00.944500+0000","last_peered":"2023-07-21T22:32:00.944500+0000","last_clean":"2023-07-21T22:32:00.944500+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:32:00.944500+0000","last_undegraded":"2023-07-21T22:32:00.944500+0000","last_fullsized":"2023-07-21T22:32:00.944500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:26:00.376064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936183+0000","last_change":"2023-07-21T22:32:00.936183+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936183+0000","last_undegraded":"2023-07-21T22:32:00.936183+0000","last_fullsized":"2023-07-21T22:32:00.936183+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.954771+0000","last_change":"2023-07-21T22:32:00.951682+0000","last_active":"2023-07-21T22:32:00.954771+0000","last_peered":"2023-07-21T22:32:00.954771+0000","last_clean":"2023-07-21T22:32:00.954771+0000","last_became_active":"2023-07-21T22:32:00.951375+0000","last_became_peered":"2023-07-21T22:32:00.951375+0000","last_unstale":"2023-07-21T22:32:00.954771+0000","last_undegraded":"2023-07-21T22:32:00.954771+0000","last_fullsized":"2023-07-21T22:32:00.954771+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:16:13.181692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.942461+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:32:00.942461+0000","last_peered":"2023-07-21T22:32:00.942461+0000","last_clean":"2023-07-21T22:32:00.942461+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:32:00.942461+0000","last_undegraded":"2023-07-21T22:32:00.942461+0000","last_fullsized":"2023-07-21T22:32:00.942461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:35:08.506245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509604,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54520,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317320,"statfs":{"total":96636764160,"available":96580935680,"internally_reserved":0,"allocated":1359872,"data_stored":959326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.72899999999999998,"15min":0.72399999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.32600000000000001},"max":{"1min":0.91700000000000004,"5min":0.95699999999999996,"15min":1.28},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.68899999999999995,"15min":0.67800000000000005},"min":{"1min":0.436,"5min":0.39500000000000002,"15min":0.36099999999999999},"max":{"1min":0.82099999999999995,"5min":0.98399999999999999,"15min":1.131},"last":0.82099999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.379},"max":{"1min":0.877,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71999999999999997,"15min":0.71399999999999997},"min":{"1min":0.47599999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.873,"5min":1.0129999999999999,"15min":1.0409999999999999},"last":0.873}]},{"osd":2,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.749,"15min":0.73999999999999999},"min":{"1min":0.51300000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96099999999999997,"5min":0.97099999999999997,"15min":1.405},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.74299999999999999,"15min":0.751},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97699999999999998,"5min":1.0629999999999999,"15min":1.087},"last":0.86499999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.42099999999999999},"max":{"1min":0.86899999999999999,"5min":1.0189999999999999,"15min":1.2230000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.755,"15min":0.753},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.92300000000000004,"5min":0.95199999999999996,"15min":1.0189999999999999},"last":0.92300000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55200000000000005,"15min":0.57599999999999996},"min":{"1min":0.38,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":1.244},"last":0.5},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.64000000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90400000000000003,"5min":1.0309999999999999,"15min":1.3999999999999999},"last":0.57799999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.47499999999999998,"5min":0.41399999999999998,"15min":0.40300000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.98599999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65900000000000003,"15min":0.69199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.93400000000000005,"5min":0.94199999999999995,"15min":1.0129999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.5,"5min":0.46500000000000002,"15min":0.44400000000000001},"max":{"1min":0.877,"5min":0.98599999999999999,"15min":1.048},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.63,"15min":0.65100000000000002},"min":{"1min":0.434,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":0.90400000000000003,"5min":0.91300000000000003,"15min":0.98599999999999999},"last":0.85599999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542310,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":368958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78500000000000003,"15min":0.75600000000000001},"min":{"1min":0.621,"5min":0.39800000000000002,"15min":0.36599999999999999},"max":{"1min":0.93400000000000005,"5min":0.95499999999999996,"15min":1.425},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.65600000000000003,"5min":0.60399999999999998,"15min":0.437},"max":{"1min":0.95199999999999996,"5min":1.0329999999999999,"15min":2.3100000000000001},"last":0.82099999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73899999999999999,"15min":0.71299999999999997},"min":{"1min":0.495,"5min":0.45300000000000001,"15min":0.41999999999999998},"max":{"1min":0.86799999999999999,"5min":0.97099999999999997,"15min":1.022},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74099999999999999,"15min":0.82399999999999995},"min":{"1min":0.64800000000000002,"5min":0.46000000000000002,"15min":0.34399999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":8.6280000000000001},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.60499999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93700000000000006,"5min":0.997,"15min":1.55},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.79000000000000004},"min":{"1min":0.69999999999999996,"5min":0.54700000000000004,"15min":0.45500000000000002},"max":{"1min":0.97199999999999998,"5min":1.0149999999999999,"15min":1.016},"last":0.88900000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.57399999999999995,"5min":0.51400000000000001,"15min":0.5},"max":{"1min":0.90200000000000002,"5min":0.97799999999999998,"15min":1.7470000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.53100000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91700000000000004,"5min":0.95799999999999996,"15min":1.5129999999999999},"last":0.86799999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.627},"min":{"1min":0.433,"5min":0.40600000000000003,"15min":0.36599999999999999},"max":{"1min":0.86399999999999999,"5min":0.97999999999999998,"15min":3.1829999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63400000000000001,"15min":0.66300000000000003},"min":{"1min":0.48599999999999999,"5min":0.41399999999999998,"15min":0.39700000000000002},"max":{"1min":0.85199999999999998,"5min":1.0209999999999999,"15min":2.887},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.62,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78800000000000003,"5min":0.93799999999999994,"15min":1.4510000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67300000000000004,"15min":0.67600000000000005},"min":{"1min":0.54600000000000004,"5min":0.45300000000000001,"15min":0.39400000000000002},"max":{"1min":0.83299999999999996,"5min":1.0389999999999999,"15min":1.054},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.70099999999999996},"min":{"1min":0.51800000000000002,"5min":0.46899999999999997,"15min":0.443},"max":{"1min":0.94599999999999995,"5min":0.99099999999999999,"15min":1.1679999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.79100000000000004},"min":{"1min":0.51800000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88300000000000001,"5min":0.97999999999999998,"15min":8.0760000000000005},"last":0.90800000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509603,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":765952,"data_stored":368958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.73299999999999998,"15min":0.70799999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32900000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71099999999999997,"15min":0.71599999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.745}]},{"osd":1,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.71299999999999997,"15min":0.70999999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.90600000000000003,"5min":0.95799999999999996,"15min":1.0009999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73599999999999999,"15min":0.72999999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.69699999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.42999999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.034},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.79000000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78800000000000003,"15min":0.78500000000000003},"min":{"1min":0.56000000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81299999999999994,"15min":0.79800000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.91100000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57799999999999996,"15min":0.56399999999999995},"min":{"1min":0.41099999999999998,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.443},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68300000000000005,"15min":0.69199999999999995},"min":{"1min":0.52200000000000002,"5min":0.502,"15min":0.44900000000000001},"max":{"1min":0.84199999999999997,"5min":0.97499999999999998,"15min":1.038},"last":0.55900000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60599999999999998,"15min":0.60899999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.64100000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63800000000000001,"15min":0.65900000000000003},"min":{"1min":0.46300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.85499999999999998,"5min":0.96199999999999997,"15min":0.97699999999999998},"last":0.502},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.73799999999999999,"15min":0.72699999999999998},"min":{"1min":0.54000000000000004,"5min":0.52100000000000002,"15min":0.439},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.67000000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509604,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":368958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.75800000000000001,"15min":0.74199999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.40000000000000002},"max":{"1min":0.89400000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.747,"15min":0.74299999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92000000000000004,"5min":0.96099999999999997,"15min":0.99099999999999999},"last":0.69199999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70999999999999996,"15min":0.69799999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.39400000000000002},"max":{"1min":0.89100000000000001,"5min":1.002,"15min":1.0449999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71399999999999997,"15min":0.69399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86299999999999999,"5min":0.96399999999999997,"15min":1.016},"last":0.71499999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77900000000000003,"15min":0.76800000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.042},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.77300000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.33000000000000002},"max":{"1min":0.96399999999999997,"5min":1,"15min":1.0589999999999999},"last":0.755}]},{"osd":3,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97199999999999998,"5min":1.0169999999999999,"15min":1.026},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79600000000000004,"15min":0.78700000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.93000000000000005,"5min":0.99099999999999999,"15min":1.018},"last":0.82399999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.58299999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81599999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57099999999999995,"15min":0.60099999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.0680000000000001},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64200000000000002,"15min":0.65400000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.38500000000000001},"max":{"1min":0.91000000000000003,"5min":0.92200000000000004,"15min":0.96699999999999997},"last":0.875},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69899999999999995,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98999999999999999,"5min":0.997,"15min":1.272},"last":0.84899999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.627,"15min":0.67200000000000004},"min":{"1min":0.439,"5min":0.39200000000000002,"15min":0.374},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.3300000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.67800000000000005,"15min":0.70599999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95699999999999996,"5min":0.97999999999999998,"15min":1.135},"last":0.91300000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509603,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":368958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.29099999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.68400000000000005,"5min":0.749,"15min":0.76400000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.41099999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.436}]},{"osd":1,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.48199999999999998,"15min":0.47399999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.30099999999999999},"max":{"1min":0.69199999999999995,"5min":0.83499999999999996,"15min":0.871},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72299999999999998,"5min":0.86399999999999999,"15min":0.94199999999999995},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.57199999999999995,"15min":0.54600000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66700000000000004,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61599999999999999,"15min":0.59399999999999997},"min":{"1min":0.45100000000000001,"5min":0.41499999999999998,"15min":0.40999999999999998},"max":{"1min":0.69199999999999995,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.505}]},{"osd":4,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.438},"max":{"1min":0.91400000000000003,"5min":1.0620000000000001,"15min":1.3240000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.01,"5min":1.0569999999999999,"15min":1.488},"last":0.622}]},{"osd":5,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.90600000000000003,"5min":1.137,"15min":1.1919999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.048,"5min":1.081,"15min":1.302},"last":0.54500000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93500000000000005,"5min":1.056,"15min":1.3979999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.49399999999999999},"max":{"1min":0.98499999999999999,"5min":1.0740000000000001,"15min":1.3899999999999999},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.82299999999999995,"15min":0.82899999999999996},"min":{"1min":0.53400000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0780000000000001,"5min":1.097,"15min":1.335},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.83799999999999997,"15min":0.82899999999999996},"min":{"1min":0.58999999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.2130000000000001},"last":0.65800000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509605,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53928,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317912,"statfs":{"total":96636764160,"available":96581541888,"internally_reserved":0,"allocated":753664,"data_stored":362286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48399999999999999,"15min":0.47099999999999997},"min":{"1min":0.315,"5min":0.29799999999999999,"15min":0.23899999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.94199999999999995},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56599999999999995,"15min":0.54100000000000004},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36599999999999999},"max":{"1min":0.76000000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.47199999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55300000000000005,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.34499999999999997,"15min":0.28199999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59899999999999998,"15min":0.57699999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80600000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.439}]},{"osd":3,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.48499999999999999,"15min":0.47699999999999998},"min":{"1min":0.35699999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61399999999999999,"5min":0.73499999999999999,"15min":0.748},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41099999999999998,"5min":0.38900000000000001,"15min":0.34100000000000003},"max":{"1min":0.74099999999999999,"5min":0.82499999999999996,"15min":0.93100000000000005},"last":0.41899999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82699999999999996,"15min":0.80200000000000005},"min":{"1min":0.56899999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.6870000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82899999999999996,"15min":0.80400000000000005},"min":{"1min":0.58299999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.2689999999999999},"last":0.77400000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81999999999999995,"15min":0.79600000000000004},"min":{"1min":0.57799999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.026,"5min":1.169,"15min":1.2549999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.81200000000000006},"min":{"1min":0.58399999999999996,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.171,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.74099999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.81999999999999995,"15min":0.80300000000000005},"min":{"1min":0.55400000000000005,"5min":0.44900000000000001,"15min":0.40300000000000002},"max":{"1min":1.0940000000000001,"5min":1.2,"15min":1.3759999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.873,"5min":0.84399999999999997,"15min":0.81100000000000005},"min":{"1min":0.66100000000000003,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.23,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84799999999999998,"15min":0.83099999999999996},"min":{"1min":0.60099999999999998,"5min":0.51100000000000001,"15min":0.49099999999999999},"max":{"1min":1.1140000000000001,"5min":1.214,"15min":1.2909999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84099999999999997,"15min":0.81999999999999995},"min":{"1min":0.63100000000000001,"5min":0.44900000000000001,"15min":0.44700000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.3660000000000001},"last":0.66900000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509604,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":753664,"data_stored":362286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.47199999999999998,"15min":0.53900000000000003},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59599999999999997,"5min":0.84599999999999997,"15min":5.4800000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56200000000000006,"15min":0.61499999999999999},"min":{"1min":0.41099999999999998,"5min":0.377,"15min":0.36099999999999999},"max":{"1min":0.76700000000000002,"5min":0.872,"15min":5.2830000000000004},"last":0.46899999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.505,"15min":0.53700000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.64900000000000002,"5min":0.76100000000000001,"15min":3.4220000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.52400000000000002,"15min":0.53600000000000003},"min":{"1min":0.35199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.88800000000000001},"last":0.377}]},{"osd":3,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.58999999999999997,"15min":0.626},"min":{"1min":0.35799999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81599999999999995,"5min":0.86599999999999999,"15min":3.2469999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.51000000000000001,"15min":0.56999999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71799999999999997,"5min":0.77300000000000002,"15min":5.8710000000000004},"last":0.42799999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.80900000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89500000000000002,"5min":1.1930000000000001,"15min":3.6259999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78200000000000003,"15min":0.83499999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.91300000000000003,"5min":1.083,"15min":4.4100000000000001},"last":0.64200000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.77600000000000002,"15min":0.83999999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96599999999999997,"5min":1.115,"15min":5.766},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.78700000000000003,"15min":0.82599999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90400000000000003,"5min":1.2849999999999999,"15min":3.669},"last":0.70299999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95199999999999996,"5min":1.147,"15min":1.23},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77800000000000002,"15min":0.85499999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93600000000000005,"5min":1.3240000000000001,"15min":5.8200000000000003},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.79200000000000004,"15min":0.86499999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.872,"5min":1.244,"15min":5.9269999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79200000000000004,"15min":0.84299999999999997},"min":{"1min":0.52600000000000002,"5min":0.48599999999999999,"15min":0.45700000000000002},"max":{"1min":0.93400000000000005,"5min":1.3380000000000001,"15min":3.5800000000000001},"last":0.622}]}]},{"osd":0,"up_from":15,"seq":64424509606,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1359872,"data_stored":959326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.32500000000000001,"5min":0.29999999999999999,"15min":0.28000000000000003},"max":{"1min":0.754,"5min":0.81000000000000005,"15min":0.91100000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53700000000000003,"15min":0.49399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.28599999999999998},"max":{"1min":0.72699999999999998,"5min":0.77800000000000002,"15min":0.83199999999999996},"last":0.434}]},{"osd":2,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54300000000000004,"15min":0.51700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.32200000000000001},"max":{"1min":0.72799999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53800000000000003,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.33700000000000002,"15min":0.33000000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.41799999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60499999999999998,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84499999999999997,"5min":0.88100000000000001,"15min":0.91300000000000003},"last":0.499},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.53600000000000003},"min":{"1min":0.40699999999999997,"5min":0.40200000000000002,"15min":0.35599999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.85699999999999998},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.79100000000000004,"15min":0.79200000000000004},"min":{"1min":0.52700000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0760000000000001,"5min":1.1559999999999999,"15min":1.321},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.81100000000000005,"15min":0.80200000000000005},"min":{"1min":0.57799999999999996,"5min":0.52800000000000002,"15min":0.48999999999999999},"max":{"1min":1.0880000000000001,"5min":1.423,"15min":1.423},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78300000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.107,"5min":1.2669999999999999,"15min":1.28},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82599999999999996,"15min":0.81799999999999995},"min":{"1min":0.59799999999999998,"5min":0.53700000000000003,"15min":0.50700000000000001},"max":{"1min":1.0329999999999999,"5min":1.254,"15min":1.393},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.82099999999999995,"15min":0.81699999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0820000000000001,"5min":1.2290000000000001,"15min":1.28},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84199999999999997,"15min":0.82499999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.57599999999999996},"max":{"1min":1.147,"5min":1.333,"15min":1.333},"last":0.82499999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80100000000000005,"15min":0.79900000000000004},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.54000000000000004},"max":{"1min":1.087,"5min":1.121,"15min":1.2310000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85499999999999998,"15min":0.84199999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.101,"5min":1.296,"15min":1.369},"last":0.61199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:32:06.110 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:32:06.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.236+0000 7fd0cd9c5640 1 Processor -- start 2023-07-21T22:32:06.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.236+0000 7fd0cd9c5640 1 -- start start 2023-07-21T22:32:06.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.236+0000 7fd0cd9c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0c8070b70 0x7fd0c8070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:06.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.236+0000 7fd0cd9c5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd0c806b1e0 0x7fd0c80c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:06.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.236+0000 7fd0cd9c5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c80cac70 con 0x7fd0c80c21f0 2023-07-21T22:32:06.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.236+0000 7fd0cd9c5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c8071480 con 0x7fd0c806b1e0 2023-07-21T22:32:06.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.236+0000 7fd0cd9c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c80ca060 con 0x7fd0c8070b70 2023-07-21T22:32:06.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.240+0000 7fd0bffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd0c806b1e0 0x7fd0c80c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:06.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.240+0000 7fd0bffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd0c806b1e0 0x7fd0c80c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35708/0 (socket says 172.21.15.6:35708) 2023-07-21T22:32:06.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.240+0000 7fd0bffff640 1 -- 172.21.15.6:0/3525841344 learned_addr learned my addr 172.21.15.6:0/3525841344 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:06.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.240+0000 7fd0c77fe640 1 --1- 172.21.15.6:0/3525841344 >> v1:172.21.15.6:6789/0 conn(0x7fd0c80c21f0 0x7fd0c80cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53686/0 (socket says 172.21.15.6:53686) 2023-07-21T22:32:06.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.240+0000 7fd0bffff640 1 -- 172.21.15.6:0/3525841344 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0c8070b70 msgr2=0x7fd0c8070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:06.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.240+0000 7fd0c6ffd640 1 --2- 172.21.15.6:0/3525841344 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0c8070b70 0x7fd0c8070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:06.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.240+0000 7fd0bffff640 1 --2- 172.21.15.6:0/3525841344 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0c8070b70 0x7fd0c8070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.240+0000 7fd0c67fc640 1 -- 172.21.15.6:0/3525841344 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822569804 0 0) 0x7fd0c80cac70 con 0x7fd0c80c21f0 2023-07-21T22:32:06.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.240+0000 7fd0bffff640 1 -- 172.21.15.6:0/3525841344 >> v1:172.21.15.6:6789/0 conn(0x7fd0c80c21f0 legacy=0x7fd0c80cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:06.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.240+0000 7fd0bffff640 1 -- 172.21.15.6:0/3525841344 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c80ca340 con 0x7fd0c806b1e0 2023-07-21T22:32:06.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.240+0000 7fd0c6ffd640 1 --2- 172.21.15.6:0/3525841344 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0c8070b70 0x7fd0c8070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:32:06.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.240+0000 7fd0bffff640 1 --2- 172.21.15.6:0/3525841344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c806b1e0 0x7fd0c80c1cb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009870 tx=0x7fd0b001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2e6aed862321c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:06.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.240+0000 7fd0c67fc640 1 -- 172.21.15.6:0/3525841344 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b00a6040 con 0x7fd0c806b1e0 2023-07-21T22:32:06.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.240+0000 7fd0c67fc640 1 -- 172.21.15.6:0/3525841344 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b00aa600 con 0x7fd0c806b1e0 2023-07-21T22:32:06.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.240+0000 7fd0c67fc640 1 -- 172.21.15.6:0/3525841344 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b00aa990 con 0x7fd0c806b1e0 2023-07-21T22:32:06.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0cd9c5640 1 -- 172.21.15.6:0/3525841344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c806b1e0 msgr2=0x7fd0c80c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:06.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0cd9c5640 1 --2- 172.21.15.6:0/3525841344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c806b1e0 0x7fd0c80c1cb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009870 tx=0x7fd0b001c4a0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0cd9c5640 1 -- 172.21.15.6:0/3525841344 shutdown_connections 2023-07-21T22:32:06.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0cd9c5640 1 --2- 172.21.15.6:0/3525841344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c806b1e0 0x7fd0c80c1cb0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0cd9c5640 1 --2- 172.21.15.6:0/3525841344 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0c8070b70 0x7fd0c8070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0cd9c5640 1 -- 172.21.15.6:0/3525841344 >> 172.21.15.6:0/3525841344 conn(0x7fd0c80afcf0 msgr2=0x7fd0c80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:06.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0cd9c5640 1 -- 172.21.15.6:0/3525841344 shutdown_connections 2023-07-21T22:32:06.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0cd9c5640 1 -- 172.21.15.6:0/3525841344 wait complete. 2023-07-21T22:32:06.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0cd9c5640 1 Processor -- start 2023-07-21T22:32:06.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0cd9c5640 1 -- start start 2023-07-21T22:32:06.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0cd9c5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0c806b1e0 0x7fd0c80c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:06.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0cd9c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0c8070b70 0x7fd0c814eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:06.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0cd9c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c80c21f0 0x7fd0c80c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:06.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0cd9c5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c80ccb20 con 0x7fd0c80c21f0 2023-07-21T22:32:06.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0cd9c5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c814ff70 con 0x7fd0c806b1e0 2023-07-21T22:32:06.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0cd9c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c8158790 con 0x7fd0c8070b70 2023-07-21T22:32:06.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0c77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c80c21f0 0x7fd0c80c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0c77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c80c21f0 0x7fd0c80c5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35718/0 (socket says 172.21.15.6:35718) 2023-07-21T22:32:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0c77fe640 1 -- 172.21.15.6:0/3119116337 learned_addr learned my addr 172.21.15.6:0/3119116337 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0bffff640 1 --2- 172.21.15.6:0/3119116337 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0c8070b70 0x7fd0c814eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0c6ffd640 1 --2- 172.21.15.6:0/3119116337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0c806b1e0 0x7fd0c80c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0c77fe640 1 -- 172.21.15.6:0/3119116337 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0c8070b70 msgr2=0x7fd0c814eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0c77fe640 1 --2- 172.21.15.6:0/3119116337 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0c8070b70 0x7fd0c814eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0c77fe640 1 -- 172.21.15.6:0/3119116337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0c806b1e0 msgr2=0x7fd0c80c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:06.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0c77fe640 1 --2- 172.21.15.6:0/3119116337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0c806b1e0 0x7fd0c80c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0c77fe640 1 -- 172.21.15.6:0/3119116337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b00094d0 con 0x7fd0c80c21f0 2023-07-21T22:32:06.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.244+0000 7fd0c6ffd640 1 --2- 172.21.15.6:0/3119116337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0c806b1e0 0x7fd0c80c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:06.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.248+0000 7fd0c77fe640 1 --2- 172.21.15.6:0/3119116337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c80c21f0 0x7fd0c80c5230 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd0c000c780 tx=0x7fd0c000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:06.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.248+0000 7fd0c4ff9640 1 -- 172.21.15.6:0/3119116337 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c000ce30 con 0x7fd0c80c21f0 2023-07-21T22:32:06.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.248+0000 7fd0c4ff9640 1 -- 172.21.15.6:0/3119116337 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c000a640 con 0x7fd0c80c21f0 2023-07-21T22:32:06.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.248+0000 7fd0c4ff9640 1 -- 172.21.15.6:0/3119116337 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c000aa70 con 0x7fd0c80c21f0 2023-07-21T22:32:06.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.248+0000 7fd0cd9c5640 1 -- 172.21.15.6:0/3119116337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c8158a30 con 0x7fd0c80c21f0 2023-07-21T22:32:06.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.248+0000 7fd0cd9c5640 1 -- 172.21.15.6:0/3119116337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c80cc740 con 0x7fd0c80c21f0 2023-07-21T22:32:06.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.248+0000 7fd0cd9c5640 1 -- 172.21.15.6:0/3119116337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c80ccc60 con 0x7fd0c80c21f0 2023-07-21T22:32:06.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.248+0000 7fd0c4ff9640 1 -- 172.21.15.6:0/3119116337 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd0c000abd0 con 0x7fd0c80c21f0 2023-07-21T22:32:06.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.248+0000 7fd0c4ff9640 1 --2- 172.21.15.6:0/3119116337 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fd0a80663a0 0x7fd0a8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:06.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.248+0000 7fd0c4ff9640 1 -- 172.21.15.6:0/3119116337 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fd0c0083340 con 0x7fd0c80c21f0 2023-07-21T22:32:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.248+0000 7fd0c6ffd640 1 --2- 172.21.15.6:0/3119116337 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fd0a80663a0 0x7fd0a8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:06.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.252+0000 7fd0c6ffd640 1 --2- 172.21.15.6:0/3119116337 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fd0a80663a0 0x7fd0a8068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8006fd0 tx=0x7fd0b8008040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:06.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.252+0000 7fd0c4ff9640 1 -- 172.21.15.6:0/3119116337 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd0c80ccc60 con 0x7fd0c80c21f0 2023-07-21T22:32:06.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.408+0000 7fd0cd9c5640 1 -- 172.21.15.6:0/3119116337 --> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd0c80c9cf0 con 0x7fd0a80663a0 2023-07-21T22:32:06.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.416+0000 7fd0c4ff9640 1 -- 172.21.15.6:0/3119116337 <== mgr.5743 v2:172.21.15.161:6832/3740183048 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305853 (secure 0 0 0) 0x7fd0b800a7f0 con 0x7fd0a80663a0 2023-07-21T22:32:06.468 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:32:06.470 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:32:06.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.420+0000 7fd0cd9c5640 1 -- 172.21.15.6:0/3119116337 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fd0a80663a0 msgr2=0x7fd0a8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:06.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.420+0000 7fd0cd9c5640 1 --2- 172.21.15.6:0/3119116337 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fd0a80663a0 0x7fd0a8068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8006fd0 tx=0x7fd0b8008040 comp rx=0 tx=0).stop 2023-07-21T22:32:06.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.420+0000 7fd0cd9c5640 1 -- 172.21.15.6:0/3119116337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c80c21f0 msgr2=0x7fd0c80c5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:06.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.420+0000 7fd0cd9c5640 1 --2- 172.21.15.6:0/3119116337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c80c21f0 0x7fd0c80c5230 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd0c000c780 tx=0x7fd0c000cc40 comp rx=0 tx=0).stop 2023-07-21T22:32:06.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.420+0000 7fd0cd9c5640 1 -- 172.21.15.6:0/3119116337 shutdown_connections 2023-07-21T22:32:06.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.420+0000 7fd0cd9c5640 1 --2- 172.21.15.6:0/3119116337 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fd0a80663a0 0x7fd0a8068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.420+0000 7fd0cd9c5640 1 --2- 172.21.15.6:0/3119116337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0c80c21f0 0x7fd0c80c5230 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.420+0000 7fd0cd9c5640 1 --2- 172.21.15.6:0/3119116337 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0c8070b70 0x7fd0c814eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.420+0000 7fd0cd9c5640 1 --2- 172.21.15.6:0/3119116337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0c806b1e0 0x7fd0c80c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.420+0000 7fd0cd9c5640 1 -- 172.21.15.6:0/3119116337 >> 172.21.15.6:0/3119116337 conn(0x7fd0c80afcf0 msgr2=0x7fd0c80b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:06.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.420+0000 7fd0cd9c5640 1 -- 172.21.15.6:0/3119116337 shutdown_connections 2023-07-21T22:32:06.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.420+0000 7fd0cd9c5640 1 -- 172.21.15.6:0/3119116337 wait complete. 2023-07-21T22:32:06.489 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-21T22:32:05.705254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":295696,"kb_used_data":7120,"kb_used_omap":0,"kb_used_meta":288512,"kb_avail":754679024,"statfs":{"total":773094113280,"available":772791320576,"internally_reserved":0,"allocated":7290880,"data_stored":4119056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":295436288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.781878"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939046+0000","last_change":"2023-07-21T22:32:00.939046+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939046+0000","last_undegraded":"2023-07-21T22:32:00.939046+0000","last_fullsized":"2023-07-21T22:32:00.939046+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940135+0000","last_change":"2023-07-21T22:32:00.940135+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940135+0000","last_undegraded":"2023-07-21T22:32:00.940135+0000","last_fullsized":"2023-07-21T22:32:00.940135+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.935591+0000","last_change":"2023-07-21T22:32:00.935591+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.935591+0000","last_undegraded":"2023-07-21T22:32:00.935591+0000","last_fullsized":"2023-07-21T22:32:00.935591+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939384+0000","last_change":"2023-07-21T22:32:00.939384+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939384+0000","last_undegraded":"2023-07-21T22:32:00.939384+0000","last_fullsized":"2023-07-21T22:32:00.939384+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.945092+0000","last_change":"2023-07-21T22:32:00.945092+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.945092+0000","last_undegraded":"2023-07-21T22:32:00.945092+0000","last_fullsized":"2023-07-21T22:32:00.945092+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940528+0000","last_change":"2023-07-21T22:32:00.940528+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940528+0000","last_undegraded":"2023-07-21T22:32:00.940528+0000","last_fullsized":"2023-07-21T22:32:00.940528+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.931463+0000","last_change":"2023-07-21T22:32:00.931463+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.931463+0000","last_undegraded":"2023-07-21T22:32:00.931463+0000","last_fullsized":"2023-07-21T22:32:00.931463+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.943332+0000","last_change":"2023-07-21T22:32:00.943332+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.943332+0000","last_undegraded":"2023-07-21T22:32:00.943332+0000","last_fullsized":"2023-07-21T22:32:00.943332+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.943669+0000","last_change":"2023-07-21T22:32:00.943669+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.943669+0000","last_undegraded":"2023-07-21T22:32:00.943669+0000","last_fullsized":"2023-07-21T22:32:00.943669+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942369+0000","last_change":"2023-07-21T22:32:00.942369+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942369+0000","last_undegraded":"2023-07-21T22:32:00.942369+0000","last_fullsized":"2023-07-21T22:32:00.942369+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.933108+0000","last_change":"2023-07-21T22:32:00.933108+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.933108+0000","last_undegraded":"2023-07-21T22:32:00.933108+0000","last_fullsized":"2023-07-21T22:32:00.933108+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.943642+0000","last_change":"2023-07-21T22:32:00.943642+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.943642+0000","last_undegraded":"2023-07-21T22:32:00.943642+0000","last_fullsized":"2023-07-21T22:32:00.943642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939463+0000","last_change":"2023-07-21T22:32:00.939463+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939463+0000","last_undegraded":"2023-07-21T22:32:00.939463+0000","last_fullsized":"2023-07-21T22:32:00.939463+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.931137+0000","last_change":"2023-07-21T22:32:00.931137+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.931137+0000","last_undegraded":"2023-07-21T22:32:00.931137+0000","last_fullsized":"2023-07-21T22:32:00.931137+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940920+0000","last_change":"2023-07-21T22:32:00.940920+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940920+0000","last_undegraded":"2023-07-21T22:32:00.940920+0000","last_fullsized":"2023-07-21T22:32:00.940920+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941617+0000","last_change":"2023-07-21T22:32:00.941617+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941617+0000","last_undegraded":"2023-07-21T22:32:00.941617+0000","last_fullsized":"2023-07-21T22:32:00.941617+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.934576+0000","last_change":"2023-07-21T22:32:00.934576+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.934576+0000","last_undegraded":"2023-07-21T22:32:00.934576+0000","last_fullsized":"2023-07-21T22:32:00.934576+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939627+0000","last_change":"2023-07-21T22:32:00.939627+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939627+0000","last_undegraded":"2023-07-21T22:32:00.939627+0000","last_fullsized":"2023-07-21T22:32:00.939627+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.935124+0000","last_change":"2023-07-21T22:32:00.935124+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.935124+0000","last_undegraded":"2023-07-21T22:32:00.935124+0000","last_fullsized":"2023-07-21T22:32:00.935124+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940067+0000","last_change":"2023-07-21T22:32:00.940067+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940067+0000","last_undegraded":"2023-07-21T22:32:00.940067+0000","last_fullsized":"2023-07-21T22:32:00.940067+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939390+0000","last_change":"2023-07-21T22:32:00.939390+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939390+0000","last_undegraded":"2023-07-21T22:32:00.939390+0000","last_fullsized":"2023-07-21T22:32:00.939390+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942199+0000","last_change":"2023-07-21T22:32:00.942199+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942199+0000","last_undegraded":"2023-07-21T22:32:00.942199+0000","last_fullsized":"2023-07-21T22:32:00.942199+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.934188+0000","last_change":"2023-07-21T22:32:00.934188+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.934188+0000","last_undegraded":"2023-07-21T22:32:00.934188+0000","last_fullsized":"2023-07-21T22:32:00.934188+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.932446+0000","last_change":"2023-07-21T22:32:00.932446+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.932446+0000","last_undegraded":"2023-07-21T22:32:00.932446+0000","last_fullsized":"2023-07-21T22:32:00.932446+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.934081+0000","last_change":"2023-07-21T22:32:00.934081+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.934081+0000","last_undegraded":"2023-07-21T22:32:00.934081+0000","last_fullsized":"2023-07-21T22:32:00.934081+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942891+0000","last_change":"2023-07-21T22:32:00.942891+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942891+0000","last_undegraded":"2023-07-21T22:32:00.942891+0000","last_fullsized":"2023-07-21T22:32:00.942891+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941426+0000","last_change":"2023-07-21T22:32:00.941426+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941426+0000","last_undegraded":"2023-07-21T22:32:00.941426+0000","last_fullsized":"2023-07-21T22:32:00.941426+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939540+0000","last_change":"2023-07-21T22:32:00.939540+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939540+0000","last_undegraded":"2023-07-21T22:32:00.939540+0000","last_fullsized":"2023-07-21T22:32:00.939540+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.931313+0000","last_change":"2023-07-21T22:32:00.931313+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.931313+0000","last_undegraded":"2023-07-21T22:32:00.931313+0000","last_fullsized":"2023-07-21T22:32:00.931313+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942556+0000","last_change":"2023-07-21T22:32:00.942556+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942556+0000","last_undegraded":"2023-07-21T22:32:00.942556+0000","last_fullsized":"2023-07-21T22:32:00.942556+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.930989+0000","last_change":"2023-07-21T22:32:00.930989+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.930989+0000","last_undegraded":"2023-07-21T22:32:00.930989+0000","last_fullsized":"2023-07-21T22:32:00.930989+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.937353+0000","last_change":"2023-07-21T22:32:00.937353+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.937353+0000","last_undegraded":"2023-07-21T22:32:00.937353+0000","last_fullsized":"2023-07-21T22:32:00.937353+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940212+0000","last_change":"2023-07-21T22:32:00.940212+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940212+0000","last_undegraded":"2023-07-21T22:32:00.940212+0000","last_fullsized":"2023-07-21T22:32:00.940212+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.953399+0000","last_change":"2023-07-21T22:32:00.951495+0000","last_active":"2023-07-21T22:32:00.953399+0000","last_peered":"2023-07-21T22:32:00.953399+0000","last_clean":"2023-07-21T22:32:00.953399+0000","last_became_active":"2023-07-21T22:32:00.951233+0000","last_became_peered":"2023-07-21T22:32:00.951233+0000","last_unstale":"2023-07-21T22:32:00.953399+0000","last_undegraded":"2023-07-21T22:32:00.953399+0000","last_fullsized":"2023-07-21T22:32:00.953399+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:48:19.238340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936126+0000","last_change":"2023-07-21T22:32:00.936126+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936126+0000","last_undegraded":"2023-07-21T22:32:00.936126+0000","last_fullsized":"2023-07-21T22:32:00.936126+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.957667+0000","last_change":"2023-07-21T22:32:00.954953+0000","last_active":"2023-07-21T22:32:00.957667+0000","last_peered":"2023-07-21T22:32:00.957667+0000","last_clean":"2023-07-21T22:32:00.957667+0000","last_became_active":"2023-07-21T22:32:00.954668+0000","last_became_peered":"2023-07-21T22:32:00.954668+0000","last_unstale":"2023-07-21T22:32:00.957667+0000","last_undegraded":"2023-07-21T22:32:00.957667+0000","last_fullsized":"2023-07-21T22:32:00.957667+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:40:48.657491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939148+0000","last_change":"2023-07-21T22:32:00.939148+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939148+0000","last_undegraded":"2023-07-21T22:32:00.939148+0000","last_fullsized":"2023-07-21T22:32:00.939148+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.955289+0000","last_change":"2023-07-21T22:32:00.949062+0000","last_active":"2023-07-21T22:32:00.955289+0000","last_peered":"2023-07-21T22:32:00.955289+0000","last_clean":"2023-07-21T22:32:00.955289+0000","last_became_active":"2023-07-21T22:32:00.948796+0000","last_became_peered":"2023-07-21T22:32:00.948796+0000","last_unstale":"2023-07-21T22:32:00.955289+0000","last_undegraded":"2023-07-21T22:32:00.955289+0000","last_fullsized":"2023-07-21T22:32:00.955289+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:18:28.623919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942728+0000","last_change":"2023-07-21T22:32:00.942728+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942728+0000","last_undegraded":"2023-07-21T22:32:00.942728+0000","last_fullsized":"2023-07-21T22:32:00.942728+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.958912+0000","last_change":"2023-07-21T22:32:00.957955+0000","last_active":"2023-07-21T22:32:00.958912+0000","last_peered":"2023-07-21T22:32:00.958912+0000","last_clean":"2023-07-21T22:32:00.958912+0000","last_became_active":"2023-07-21T22:32:00.957647+0000","last_became_peered":"2023-07-21T22:32:00.957647+0000","last_unstale":"2023-07-21T22:32:00.958912+0000","last_undegraded":"2023-07-21T22:32:00.958912+0000","last_fullsized":"2023-07-21T22:32:00.958912+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:47:59.245516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.944136+0000","last_change":"2023-07-21T22:32:00.944136+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.944136+0000","last_undegraded":"2023-07-21T22:32:00.944136+0000","last_fullsized":"2023-07-21T22:32:00.944136+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.945045+0000","last_change":"2023-07-21T22:32:00.939672+0000","last_active":"2023-07-21T22:32:00.945045+0000","last_peered":"2023-07-21T22:32:00.945045+0000","last_clean":"2023-07-21T22:32:00.945045+0000","last_became_active":"2023-07-21T22:32:00.939377+0000","last_became_peered":"2023-07-21T22:32:00.939377+0000","last_unstale":"2023-07-21T22:32:00.945045+0000","last_undegraded":"2023-07-21T22:32:00.945045+0000","last_fullsized":"2023-07-21T22:32:00.945045+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:21:16.607665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940650+0000","last_change":"2023-07-21T22:32:00.940650+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940650+0000","last_undegraded":"2023-07-21T22:32:00.940650+0000","last_fullsized":"2023-07-21T22:32:00.940650+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.956668+0000","last_change":"2023-07-21T22:32:00.952492+0000","last_active":"2023-07-21T22:32:00.956668+0000","last_peered":"2023-07-21T22:32:00.956668+0000","last_clean":"2023-07-21T22:32:00.956668+0000","last_became_active":"2023-07-21T22:32:00.952206+0000","last_became_peered":"2023-07-21T22:32:00.952206+0000","last_unstale":"2023-07-21T22:32:00.956668+0000","last_undegraded":"2023-07-21T22:32:00.956668+0000","last_fullsized":"2023-07-21T22:32:00.956668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:23:46.523157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941817+0000","last_change":"2023-07-21T22:32:00.941817+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941817+0000","last_undegraded":"2023-07-21T22:32:00.941817+0000","last_fullsized":"2023-07-21T22:32:00.941817+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.953100+0000","last_change":"2023-07-21T22:32:00.950894+0000","last_active":"2023-07-21T22:32:00.953100+0000","last_peered":"2023-07-21T22:32:00.953100+0000","last_clean":"2023-07-21T22:32:00.953100+0000","last_became_active":"2023-07-21T22:32:00.950574+0000","last_became_peered":"2023-07-21T22:32:00.950574+0000","last_unstale":"2023-07-21T22:32:00.953100+0000","last_undegraded":"2023-07-21T22:32:00.953100+0000","last_fullsized":"2023-07-21T22:32:00.953100+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:39:22.307711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939246+0000","last_change":"2023-07-21T22:32:00.939246+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939246+0000","last_undegraded":"2023-07-21T22:32:00.939246+0000","last_fullsized":"2023-07-21T22:32:00.939246+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.954926+0000","last_change":"2023-07-21T22:32:00.950304+0000","last_active":"2023-07-21T22:32:00.954926+0000","last_peered":"2023-07-21T22:32:00.954926+0000","last_clean":"2023-07-21T22:32:00.954926+0000","last_became_active":"2023-07-21T22:32:00.949932+0000","last_became_peered":"2023-07-21T22:32:00.949932+0000","last_unstale":"2023-07-21T22:32:00.954926+0000","last_undegraded":"2023-07-21T22:32:00.954926+0000","last_fullsized":"2023-07-21T22:32:00.954926+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:33:09.061573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942335+0000","last_change":"2023-07-21T22:32:00.942335+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942335+0000","last_undegraded":"2023-07-21T22:32:00.942335+0000","last_fullsized":"2023-07-21T22:32:00.942335+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.951430+0000","last_change":"2023-07-21T22:32:00.949543+0000","last_active":"2023-07-21T22:32:00.951430+0000","last_peered":"2023-07-21T22:32:00.951430+0000","last_clean":"2023-07-21T22:32:00.951430+0000","last_became_active":"2023-07-21T22:32:00.949230+0000","last_became_peered":"2023-07-21T22:32:00.949230+0000","last_unstale":"2023-07-21T22:32:00.951430+0000","last_undegraded":"2023-07-21T22:32:00.951430+0000","last_fullsized":"2023-07-21T22:32:00.951430+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:01:13.578327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.937205+0000","last_change":"2023-07-21T22:32:00.937205+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.937205+0000","last_undegraded":"2023-07-21T22:32:00.937205+0000","last_fullsized":"2023-07-21T22:32:00.937205+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.956608+0000","last_change":"2023-07-21T22:32:00.951734+0000","last_active":"2023-07-21T22:32:00.956608+0000","last_peered":"2023-07-21T22:32:00.956608+0000","last_clean":"2023-07-21T22:32:00.956608+0000","last_became_active":"2023-07-21T22:32:00.950944+0000","last_became_peered":"2023-07-21T22:32:00.950944+0000","last_unstale":"2023-07-21T22:32:00.956608+0000","last_undegraded":"2023-07-21T22:32:00.956608+0000","last_fullsized":"2023-07-21T22:32:00.956608+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:18:12.778871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.930588+0000","last_change":"2023-07-21T22:32:00.930588+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.930588+0000","last_undegraded":"2023-07-21T22:32:00.930588+0000","last_fullsized":"2023-07-21T22:32:00.930588+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.956872+0000","last_change":"2023-07-21T22:32:00.955950+0000","last_active":"2023-07-21T22:32:00.956872+0000","last_peered":"2023-07-21T22:32:00.956872+0000","last_clean":"2023-07-21T22:32:00.956872+0000","last_became_active":"2023-07-21T22:32:00.955656+0000","last_became_peered":"2023-07-21T22:32:00.955656+0000","last_unstale":"2023-07-21T22:32:00.956872+0000","last_undegraded":"2023-07-21T22:32:00.956872+0000","last_fullsized":"2023-07-21T22:32:00.956872+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:54:13.720697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942555+0000","last_change":"2023-07-21T22:32:00.942555+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942555+0000","last_undegraded":"2023-07-21T22:32:00.942555+0000","last_fullsized":"2023-07-21T22:32:00.942555+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.953630+0000","last_change":"2023-07-21T22:32:00.944870+0000","last_active":"2023-07-21T22:32:00.953630+0000","last_peered":"2023-07-21T22:32:00.953630+0000","last_clean":"2023-07-21T22:32:00.953630+0000","last_became_active":"2023-07-21T22:32:00.944534+0000","last_became_peered":"2023-07-21T22:32:00.944534+0000","last_unstale":"2023-07-21T22:32:00.953630+0000","last_undegraded":"2023-07-21T22:32:00.953630+0000","last_fullsized":"2023-07-21T22:32:00.953630+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:43:59.834021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936876+0000","last_change":"2023-07-21T22:32:00.936876+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936876+0000","last_undegraded":"2023-07-21T22:32:00.936876+0000","last_fullsized":"2023-07-21T22:32:00.936876+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.948392+0000","last_change":"2023-07-21T22:32:00.946546+0000","last_active":"2023-07-21T22:32:00.948392+0000","last_peered":"2023-07-21T22:32:00.948392+0000","last_clean":"2023-07-21T22:32:00.948392+0000","last_became_active":"2023-07-21T22:32:00.946230+0000","last_became_peered":"2023-07-21T22:32:00.946230+0000","last_unstale":"2023-07-21T22:32:00.948392+0000","last_undegraded":"2023-07-21T22:32:00.948392+0000","last_fullsized":"2023-07-21T22:32:00.948392+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:14:44.561456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.934363+0000","last_change":"2023-07-21T22:32:00.934363+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.934363+0000","last_undegraded":"2023-07-21T22:32:00.934363+0000","last_fullsized":"2023-07-21T22:32:00.934363+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.951794+0000","last_change":"2023-07-21T22:32:00.948760+0000","last_active":"2023-07-21T22:32:00.951794+0000","last_peered":"2023-07-21T22:32:00.951794+0000","last_clean":"2023-07-21T22:32:00.951794+0000","last_became_active":"2023-07-21T22:32:00.948465+0000","last_became_peered":"2023-07-21T22:32:00.948465+0000","last_unstale":"2023-07-21T22:32:00.951794+0000","last_undegraded":"2023-07-21T22:32:00.951794+0000","last_fullsized":"2023-07-21T22:32:00.951794+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:02:10.700819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942388+0000","last_change":"2023-07-21T22:32:00.942388+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942388+0000","last_undegraded":"2023-07-21T22:32:00.942388+0000","last_fullsized":"2023-07-21T22:32:00.942388+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.955252+0000","last_change":"2023-07-21T22:32:00.952133+0000","last_active":"2023-07-21T22:32:00.955252+0000","last_peered":"2023-07-21T22:32:00.955252+0000","last_clean":"2023-07-21T22:32:00.955252+0000","last_became_active":"2023-07-21T22:32:00.951734+0000","last_became_peered":"2023-07-21T22:32:00.951734+0000","last_unstale":"2023-07-21T22:32:00.955252+0000","last_undegraded":"2023-07-21T22:32:00.955252+0000","last_fullsized":"2023-07-21T22:32:00.955252+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:40:24.334656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.937756+0000","last_change":"2023-07-21T22:32:00.937756+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.937756+0000","last_undegraded":"2023-07-21T22:32:00.937756+0000","last_fullsized":"2023-07-21T22:32:00.937756+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.954799+0000","last_change":"2023-07-21T22:32:00.952275+0000","last_active":"2023-07-21T22:32:00.954799+0000","last_peered":"2023-07-21T22:32:00.954799+0000","last_clean":"2023-07-21T22:32:00.954799+0000","last_became_active":"2023-07-21T22:32:00.951981+0000","last_became_peered":"2023-07-21T22:32:00.951981+0000","last_unstale":"2023-07-21T22:32:00.954799+0000","last_undegraded":"2023-07-21T22:32:00.954799+0000","last_fullsized":"2023-07-21T22:32:00.954799+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:08.224210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941696+0000","last_change":"2023-07-21T22:32:00.941696+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941696+0000","last_undegraded":"2023-07-21T22:32:00.941696+0000","last_fullsized":"2023-07-21T22:32:00.941696+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.955656+0000","last_change":"2023-07-21T22:32:00.953359+0000","last_active":"2023-07-21T22:32:00.955656+0000","last_peered":"2023-07-21T22:32:00.955656+0000","last_clean":"2023-07-21T22:32:00.955656+0000","last_became_active":"2023-07-21T22:32:00.953042+0000","last_became_peered":"2023-07-21T22:32:00.953042+0000","last_unstale":"2023-07-21T22:32:00.955656+0000","last_undegraded":"2023-07-21T22:32:00.955656+0000","last_fullsized":"2023-07-21T22:32:00.955656+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:54:58.294196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939056+0000","last_change":"2023-07-21T22:32:00.939056+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939056+0000","last_undegraded":"2023-07-21T22:32:00.939056+0000","last_fullsized":"2023-07-21T22:32:00.939056+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.949424+0000","last_change":"2023-07-21T22:32:00.943392+0000","last_active":"2023-07-21T22:32:00.949424+0000","last_peered":"2023-07-21T22:32:00.949424+0000","last_clean":"2023-07-21T22:32:00.949424+0000","last_became_active":"2023-07-21T22:32:00.943043+0000","last_became_peered":"2023-07-21T22:32:00.943043+0000","last_unstale":"2023-07-21T22:32:00.949424+0000","last_undegraded":"2023-07-21T22:32:00.949424+0000","last_fullsized":"2023-07-21T22:32:00.949424+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:44:11.097837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.943243+0000","last_change":"2023-07-21T22:32:00.943243+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.943243+0000","last_undegraded":"2023-07-21T22:32:00.943243+0000","last_fullsized":"2023-07-21T22:32:00.943243+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.958676+0000","last_change":"2023-07-21T22:32:00.954859+0000","last_active":"2023-07-21T22:32:00.958676+0000","last_peered":"2023-07-21T22:32:00.958676+0000","last_clean":"2023-07-21T22:32:00.958676+0000","last_became_active":"2023-07-21T22:32:00.954521+0000","last_became_peered":"2023-07-21T22:32:00.954521+0000","last_unstale":"2023-07-21T22:32:00.958676+0000","last_undegraded":"2023-07-21T22:32:00.958676+0000","last_fullsized":"2023-07-21T22:32:00.958676+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:24:57.280727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.938951+0000","last_change":"2023-07-21T22:32:00.938951+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.938951+0000","last_undegraded":"2023-07-21T22:32:00.938951+0000","last_fullsized":"2023-07-21T22:32:00.938951+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.961338+0000","last_change":"2023-07-21T22:32:00.957742+0000","last_active":"2023-07-21T22:32:00.961338+0000","last_peered":"2023-07-21T22:32:00.961338+0000","last_clean":"2023-07-21T22:32:00.961338+0000","last_became_active":"2023-07-21T22:32:00.957336+0000","last_became_peered":"2023-07-21T22:32:00.957336+0000","last_unstale":"2023-07-21T22:32:00.961338+0000","last_undegraded":"2023-07-21T22:32:00.961338+0000","last_fullsized":"2023-07-21T22:32:00.961338+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:18:50.663097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936147+0000","last_change":"2023-07-21T22:32:00.936147+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936147+0000","last_undegraded":"2023-07-21T22:32:00.936147+0000","last_fullsized":"2023-07-21T22:32:00.936147+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.951555+0000","last_change":"2023-07-21T22:32:00.946873+0000","last_active":"2023-07-21T22:32:00.951555+0000","last_peered":"2023-07-21T22:32:00.951555+0000","last_clean":"2023-07-21T22:32:00.951555+0000","last_became_active":"2023-07-21T22:32:00.946537+0000","last_became_peered":"2023-07-21T22:32:00.946537+0000","last_unstale":"2023-07-21T22:32:00.951555+0000","last_undegraded":"2023-07-21T22:32:00.951555+0000","last_fullsized":"2023-07-21T22:32:00.951555+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:09.629226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941276+0000","last_change":"2023-07-21T22:32:00.941276+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941276+0000","last_undegraded":"2023-07-21T22:32:00.941276+0000","last_fullsized":"2023-07-21T22:32:00.941276+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.953565+0000","last_change":"2023-07-21T22:32:00.943926+0000","last_active":"2023-07-21T22:32:00.953565+0000","last_peered":"2023-07-21T22:32:00.953565+0000","last_clean":"2023-07-21T22:32:00.953565+0000","last_became_active":"2023-07-21T22:32:00.943551+0000","last_became_peered":"2023-07-21T22:32:00.943551+0000","last_unstale":"2023-07-21T22:32:00.953565+0000","last_undegraded":"2023-07-21T22:32:00.953565+0000","last_fullsized":"2023-07-21T22:32:00.953565+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:53:58.981346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.935715+0000","last_change":"2023-07-21T22:32:00.935715+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.935715+0000","last_undegraded":"2023-07-21T22:32:00.935715+0000","last_fullsized":"2023-07-21T22:32:00.935715+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.954655+0000","last_change":"2023-07-21T22:32:00.949051+0000","last_active":"2023-07-21T22:32:00.954655+0000","last_peered":"2023-07-21T22:32:00.954655+0000","last_clean":"2023-07-21T22:32:00.954655+0000","last_became_active":"2023-07-21T22:32:00.948748+0000","last_became_peered":"2023-07-21T22:32:00.948748+0000","last_unstale":"2023-07-21T22:32:00.954655+0000","last_undegraded":"2023-07-21T22:32:00.954655+0000","last_fullsized":"2023-07-21T22:32:00.954655+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:52:54.611034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.938361+0000","last_change":"2023-07-21T22:32:00.938361+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.938361+0000","last_undegraded":"2023-07-21T22:32:00.938361+0000","last_fullsized":"2023-07-21T22:32:00.938361+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.949581+0000","last_change":"2023-07-21T22:32:00.944727+0000","last_active":"2023-07-21T22:32:00.949581+0000","last_peered":"2023-07-21T22:32:00.949581+0000","last_clean":"2023-07-21T22:32:00.949581+0000","last_became_active":"2023-07-21T22:32:00.944461+0000","last_became_peered":"2023-07-21T22:32:00.944461+0000","last_unstale":"2023-07-21T22:32:00.949581+0000","last_undegraded":"2023-07-21T22:32:00.949581+0000","last_fullsized":"2023-07-21T22:32:00.949581+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:00:22.685969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939507+0000","last_change":"2023-07-21T22:32:00.939507+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939507+0000","last_undegraded":"2023-07-21T22:32:00.939507+0000","last_fullsized":"2023-07-21T22:32:00.939507+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.951171+0000","last_change":"2023-07-21T22:32:00.947839+0000","last_active":"2023-07-21T22:32:00.951171+0000","last_peered":"2023-07-21T22:32:00.951171+0000","last_clean":"2023-07-21T22:32:00.951171+0000","last_became_active":"2023-07-21T22:32:00.947416+0000","last_became_peered":"2023-07-21T22:32:00.947416+0000","last_unstale":"2023-07-21T22:32:00.951171+0000","last_undegraded":"2023-07-21T22:32:00.951171+0000","last_fullsized":"2023-07-21T22:32:00.951171+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:52:02.423090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'139","reported_seq":327,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.940683+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:32:00.940683+0000","last_peered":"2023-07-21T22:32:00.940683+0000","last_clean":"2023-07-21T22:32:00.940683+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:32:00.940683+0000","last_undegraded":"2023-07-21T22:32:00.940683+0000","last_fullsized":"2023-07-21T22:32:00.940683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:11:53.150494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":101,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.937864+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:32:00.937864+0000","last_peered":"2023-07-21T22:32:00.937864+0000","last_clean":"2023-07-21T22:32:00.937864+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:32:00.937864+0000","last_undegraded":"2023-07-21T22:32:00.937864+0000","last_fullsized":"2023-07-21T22:32:00.937864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:55:12.047847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940048+0000","last_change":"2023-07-21T22:32:00.940048+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940048+0000","last_undegraded":"2023-07-21T22:32:00.940048+0000","last_fullsized":"2023-07-21T22:32:00.940048+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.956861+0000","last_change":"2023-07-21T22:32:00.955530+0000","last_active":"2023-07-21T22:32:00.956861+0000","last_peered":"2023-07-21T22:32:00.956861+0000","last_clean":"2023-07-21T22:32:00.956861+0000","last_became_active":"2023-07-21T22:32:00.955208+0000","last_became_peered":"2023-07-21T22:32:00.955208+0000","last_unstale":"2023-07-21T22:32:00.956861+0000","last_undegraded":"2023-07-21T22:32:00.956861+0000","last_fullsized":"2023-07-21T22:32:00.956861+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:30:23.544614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":93,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.940556+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:32:00.940556+0000","last_peered":"2023-07-21T22:32:00.940556+0000","last_clean":"2023-07-21T22:32:00.940556+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:32:00.940556+0000","last_undegraded":"2023-07-21T22:32:00.940556+0000","last_fullsized":"2023-07-21T22:32:00.940556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:48.875424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941933+0000","last_change":"2023-07-21T22:32:00.941933+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941933+0000","last_undegraded":"2023-07-21T22:32:00.941933+0000","last_fullsized":"2023-07-21T22:32:00.941933+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.951232+0000","last_change":"2023-07-21T22:32:00.947085+0000","last_active":"2023-07-21T22:32:00.951232+0000","last_peered":"2023-07-21T22:32:00.951232+0000","last_clean":"2023-07-21T22:32:00.951232+0000","last_became_active":"2023-07-21T22:32:00.946461+0000","last_became_peered":"2023-07-21T22:32:00.946461+0000","last_unstale":"2023-07-21T22:32:00.951232+0000","last_undegraded":"2023-07-21T22:32:00.951232+0000","last_fullsized":"2023-07-21T22:32:00.951232+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:14:15.195255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":91,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.936597+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:32:00.936597+0000","last_peered":"2023-07-21T22:32:00.936597+0000","last_clean":"2023-07-21T22:32:00.936597+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:32:00.936597+0000","last_undegraded":"2023-07-21T22:32:00.936597+0000","last_fullsized":"2023-07-21T22:32:00.936597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:42.565432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936152+0000","last_change":"2023-07-21T22:32:00.936152+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936152+0000","last_undegraded":"2023-07-21T22:32:00.936152+0000","last_fullsized":"2023-07-21T22:32:00.936152+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.958746+0000","last_change":"2023-07-21T22:32:00.955354+0000","last_active":"2023-07-21T22:32:00.958746+0000","last_peered":"2023-07-21T22:32:00.958746+0000","last_clean":"2023-07-21T22:32:00.958746+0000","last_became_active":"2023-07-21T22:32:00.954992+0000","last_became_peered":"2023-07-21T22:32:00.954992+0000","last_unstale":"2023-07-21T22:32:00.958746+0000","last_undegraded":"2023-07-21T22:32:00.958746+0000","last_fullsized":"2023-07-21T22:32:00.958746+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:04:18.396523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":101,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.937912+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:32:00.937912+0000","last_peered":"2023-07-21T22:32:00.937912+0000","last_clean":"2023-07-21T22:32:00.937912+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:32:00.937912+0000","last_undegraded":"2023-07-21T22:32:00.937912+0000","last_fullsized":"2023-07-21T22:32:00.937912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:28:18.043637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936271+0000","last_change":"2023-07-21T22:32:00.936271+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936271+0000","last_undegraded":"2023-07-21T22:32:00.936271+0000","last_fullsized":"2023-07-21T22:32:00.936271+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.961335+0000","last_change":"2023-07-21T22:32:00.957850+0000","last_active":"2023-07-21T22:32:00.961335+0000","last_peered":"2023-07-21T22:32:00.961335+0000","last_clean":"2023-07-21T22:32:00.961335+0000","last_became_active":"2023-07-21T22:32:00.957501+0000","last_became_peered":"2023-07-21T22:32:00.957501+0000","last_unstale":"2023-07-21T22:32:00.961335+0000","last_undegraded":"2023-07-21T22:32:00.961335+0000","last_fullsized":"2023-07-21T22:32:00.961335+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:43:24.943153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.944285+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:32:00.944285+0000","last_peered":"2023-07-21T22:32:00.944285+0000","last_clean":"2023-07-21T22:32:00.944285+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:32:00.944285+0000","last_undegraded":"2023-07-21T22:32:00.944285+0000","last_fullsized":"2023-07-21T22:32:00.944285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:13:05.154378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942001+0000","last_change":"2023-07-21T22:32:00.942001+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942001+0000","last_undegraded":"2023-07-21T22:32:00.942001+0000","last_fullsized":"2023-07-21T22:32:00.942001+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.956368+0000","last_change":"2023-07-21T22:32:00.954255+0000","last_active":"2023-07-21T22:32:00.956368+0000","last_peered":"2023-07-21T22:32:00.956368+0000","last_clean":"2023-07-21T22:32:00.956368+0000","last_became_active":"2023-07-21T22:32:00.953914+0000","last_became_peered":"2023-07-21T22:32:00.953914+0000","last_unstale":"2023-07-21T22:32:00.956368+0000","last_undegraded":"2023-07-21T22:32:00.956368+0000","last_fullsized":"2023-07-21T22:32:00.956368+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:47:25.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.944284+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:32:00.944284+0000","last_peered":"2023-07-21T22:32:00.944284+0000","last_clean":"2023-07-21T22:32:00.944284+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:32:00.944284+0000","last_undegraded":"2023-07-21T22:32:00.944284+0000","last_fullsized":"2023-07-21T22:32:00.944284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:35:37.561916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.932429+0000","last_change":"2023-07-21T22:32:00.932429+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.932429+0000","last_undegraded":"2023-07-21T22:32:00.932429+0000","last_fullsized":"2023-07-21T22:32:00.932429+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.953917+0000","last_change":"2023-07-21T22:32:00.945223+0000","last_active":"2023-07-21T22:32:00.953917+0000","last_peered":"2023-07-21T22:32:00.953917+0000","last_clean":"2023-07-21T22:32:00.953917+0000","last_became_active":"2023-07-21T22:32:00.944958+0000","last_became_peered":"2023-07-21T22:32:00.944958+0000","last_unstale":"2023-07-21T22:32:00.953917+0000","last_undegraded":"2023-07-21T22:32:00.953917+0000","last_fullsized":"2023-07-21T22:32:00.953917+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:02:35.145130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.944500+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:32:00.944500+0000","last_peered":"2023-07-21T22:32:00.944500+0000","last_clean":"2023-07-21T22:32:00.944500+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:32:00.944500+0000","last_undegraded":"2023-07-21T22:32:00.944500+0000","last_fullsized":"2023-07-21T22:32:00.944500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:26:00.376064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936183+0000","last_change":"2023-07-21T22:32:00.936183+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936183+0000","last_undegraded":"2023-07-21T22:32:00.936183+0000","last_fullsized":"2023-07-21T22:32:00.936183+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.954771+0000","last_change":"2023-07-21T22:32:00.951682+0000","last_active":"2023-07-21T22:32:00.954771+0000","last_peered":"2023-07-21T22:32:00.954771+0000","last_clean":"2023-07-21T22:32:00.954771+0000","last_became_active":"2023-07-21T22:32:00.951375+0000","last_became_peered":"2023-07-21T22:32:00.951375+0000","last_unstale":"2023-07-21T22:32:00.954771+0000","last_undegraded":"2023-07-21T22:32:00.954771+0000","last_fullsized":"2023-07-21T22:32:00.954771+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:16:13.181692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.942461+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:32:00.942461+0000","last_peered":"2023-07-21T22:32:00.942461+0000","last_clean":"2023-07-21T22:32:00.942461+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:32:00.942461+0000","last_undegraded":"2023-07-21T22:32:00.942461+0000","last_fullsized":"2023-07-21T22:32:00.942461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:35:08.506245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509604,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54520,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317320,"statfs":{"total":96636764160,"available":96580935680,"internally_reserved":0,"allocated":1359872,"data_stored":959326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.72899999999999998,"15min":0.72399999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.32600000000000001},"max":{"1min":0.91700000000000004,"5min":0.95699999999999996,"15min":1.28},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.68899999999999995,"15min":0.67800000000000005},"min":{"1min":0.436,"5min":0.39500000000000002,"15min":0.36099999999999999},"max":{"1min":0.82099999999999995,"5min":0.98399999999999999,"15min":1.131},"last":0.82099999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.379},"max":{"1min":0.877,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71999999999999997,"15min":0.71399999999999997},"min":{"1min":0.47599999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.873,"5min":1.0129999999999999,"15min":1.0409999999999999},"last":0.873}]},{"osd":2,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.749,"15min":0.73999999999999999},"min":{"1min":0.51300000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96099999999999997,"5min":0.97099999999999997,"15min":1.405},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.74299999999999999,"15min":0.751},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97699999999999998,"5min":1.0629999999999999,"15min":1.087},"last":0.86499999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.42099999999999999},"max":{"1min":0.86899999999999999,"5min":1.0189999999999999,"15min":1.2230000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.755,"15min":0.753},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.92300000000000004,"5min":0.95199999999999996,"15min":1.0189999999999999},"last":0.92300000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55200000000000005,"15min":0.57599999999999996},"min":{"1min":0.38,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":1.244},"last":0.5},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.64000000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90400000000000003,"5min":1.0309999999999999,"15min":1.3999999999999999},"last":0.57799999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.47499999999999998,"5min":0.41399999999999998,"15min":0.40300000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.98599999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65900000000000003,"15min":0.69199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.93400000000000005,"5min":0.94199999999999995,"15min":1.0129999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.5,"5min":0.46500000000000002,"15min":0.44400000000000001},"max":{"1min":0.877,"5min":0.98599999999999999,"15min":1.048},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.63,"15min":0.65100000000000002},"min":{"1min":0.434,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":0.90400000000000003,"5min":0.91300000000000003,"15min":0.98599999999999999},"last":0.85599999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542310,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":368958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78500000000000003,"15min":0.75600000000000001},"min":{"1min":0.621,"5min":0.39800000000000002,"15min":0.36599999999999999},"max":{"1min":0.93400000000000005,"5min":0.95499999999999996,"15min":1.425},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.65600000000000003,"5min":0.60399999999999998,"15min":0.437},"max":{"1min":0.95199999999999996,"5min":1.0329999999999999,"15min":2.3100000000000001},"last":0.82099999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73899999999999999,"15min":0.71299999999999997},"min":{"1min":0.495,"5min":0.45300000000000001,"15min":0.41999999999999998},"max":{"1min":0.86799999999999999,"5min":0.97099999999999997,"15min":1.022},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74099999999999999,"15min":0.82399999999999995},"min":{"1min":0.64800000000000002,"5min":0.46000000000000002,"15min":0.34399999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":8.6280000000000001},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.60499999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93700000000000006,"5min":0.997,"15min":1.55},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.79000000000000004},"min":{"1min":0.69999999999999996,"5min":0.54700000000000004,"15min":0.45500000000000002},"max":{"1min":0.97199999999999998,"5min":1.0149999999999999,"15min":1.016},"last":0.88900000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.57399999999999995,"5min":0.51400000000000001,"15min":0.5},"max":{"1min":0.90200000000000002,"5min":0.97799999999999998,"15min":1.7470000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.53100000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91700000000000004,"5min":0.95799999999999996,"15min":1.5129999999999999},"last":0.86799999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.627},"min":{"1min":0.433,"5min":0.40600000000000003,"15min":0.36599999999999999},"max":{"1min":0.86399999999999999,"5min":0.97999999999999998,"15min":3.1829999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63400000000000001,"15min":0.66300000000000003},"min":{"1min":0.48599999999999999,"5min":0.41399999999999998,"15min":0.39700000000000002},"max":{"1min":0.85199999999999998,"5min":1.0209999999999999,"15min":2.887},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.62,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78800000000000003,"5min":0.93799999999999994,"15min":1.4510000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67300000000000004,"15min":0.67600000000000005},"min":{"1min":0.54600000000000004,"5min":0.45300000000000001,"15min":0.39400000000000002},"max":{"1min":0.83299999999999996,"5min":1.0389999999999999,"15min":1.054},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.70099999999999996},"min":{"1min":0.51800000000000002,"5min":0.46899999999999997,"15min":0.443},"max":{"1min":0.94599999999999995,"5min":0.99099999999999999,"15min":1.1679999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.79100000000000004},"min":{"1min":0.51800000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88300000000000001,"5min":0.97999999999999998,"15min":8.0760000000000005},"last":0.90800000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509603,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":765952,"data_stored":368958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.73299999999999998,"15min":0.70799999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32900000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71099999999999997,"15min":0.71599999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.745}]},{"osd":1,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.71299999999999997,"15min":0.70999999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.90600000000000003,"5min":0.95799999999999996,"15min":1.0009999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73599999999999999,"15min":0.72999999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.69699999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.42999999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.034},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.79000000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78800000000000003,"15min":0.78500000000000003},"min":{"1min":0.56000000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81299999999999994,"15min":0.79800000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.91100000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57799999999999996,"15min":0.56399999999999995},"min":{"1min":0.41099999999999998,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.443},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68300000000000005,"15min":0.69199999999999995},"min":{"1min":0.52200000000000002,"5min":0.502,"15min":0.44900000000000001},"max":{"1min":0.84199999999999997,"5min":0.97499999999999998,"15min":1.038},"last":0.55900000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60599999999999998,"15min":0.60899999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.64100000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63800000000000001,"15min":0.65900000000000003},"min":{"1min":0.46300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.85499999999999998,"5min":0.96199999999999997,"15min":0.97699999999999998},"last":0.502},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.73799999999999999,"15min":0.72699999999999998},"min":{"1min":0.54000000000000004,"5min":0.52100000000000002,"15min":0.439},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.67000000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509604,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":368958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.75800000000000001,"15min":0.74199999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.40000000000000002},"max":{"1min":0.89400000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.747,"15min":0.74299999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92000000000000004,"5min":0.96099999999999997,"15min":0.99099999999999999},"last":0.69199999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70999999999999996,"15min":0.69799999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.39400000000000002},"max":{"1min":0.89100000000000001,"5min":1.002,"15min":1.0449999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71399999999999997,"15min":0.69399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86299999999999999,"5min":0.96399999999999997,"15min":1.016},"last":0.71499999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77900000000000003,"15min":0.76800000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.042},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.77300000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.33000000000000002},"max":{"1min":0.96399999999999997,"5min":1,"15min":1.0589999999999999},"last":0.755}]},{"osd":3,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97199999999999998,"5min":1.0169999999999999,"15min":1.026},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79600000000000004,"15min":0.78700000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.93000000000000005,"5min":0.99099999999999999,"15min":1.018},"last":0.82399999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.58299999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81599999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57099999999999995,"15min":0.60099999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.0680000000000001},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64200000000000002,"15min":0.65400000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.38500000000000001},"max":{"1min":0.91000000000000003,"5min":0.92200000000000004,"15min":0.96699999999999997},"last":0.875},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69899999999999995,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98999999999999999,"5min":0.997,"15min":1.272},"last":0.84899999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.627,"15min":0.67200000000000004},"min":{"1min":0.439,"5min":0.39200000000000002,"15min":0.374},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.3300000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.67800000000000005,"15min":0.70599999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95699999999999996,"5min":0.97999999999999998,"15min":1.135},"last":0.91300000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509603,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":368958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.29099999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.68400000000000005,"5min":0.749,"15min":0.76400000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.41099999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.436}]},{"osd":1,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.48199999999999998,"15min":0.47399999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.30099999999999999},"max":{"1min":0.69199999999999995,"5min":0.83499999999999996,"15min":0.871},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72299999999999998,"5min":0.86399999999999999,"15min":0.94199999999999995},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.57199999999999995,"15min":0.54600000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66700000000000004,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61599999999999999,"15min":0.59399999999999997},"min":{"1min":0.45100000000000001,"5min":0.41499999999999998,"15min":0.40999999999999998},"max":{"1min":0.69199999999999995,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.505}]},{"osd":4,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.438},"max":{"1min":0.91400000000000003,"5min":1.0620000000000001,"15min":1.3240000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.01,"5min":1.0569999999999999,"15min":1.488},"last":0.622}]},{"osd":5,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.90600000000000003,"5min":1.137,"15min":1.1919999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.048,"5min":1.081,"15min":1.302},"last":0.54500000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93500000000000005,"5min":1.056,"15min":1.3979999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.49399999999999999},"max":{"1min":0.98499999999999999,"5min":1.0740000000000001,"15min":1.3899999999999999},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.82299999999999995,"15min":0.82899999999999996},"min":{"1min":0.53400000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0780000000000001,"5min":1.097,"15min":1.335},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.83799999999999997,"15min":0.82899999999999996},"min":{"1min":0.58999999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.2130000000000001},"last":0.65800000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509605,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53928,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317912,"statfs":{"total":96636764160,"available":96581541888,"internally_reserved":0,"allocated":753664,"data_stored":362286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48399999999999999,"15min":0.47099999999999997},"min":{"1min":0.315,"5min":0.29799999999999999,"15min":0.23899999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.94199999999999995},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56599999999999995,"15min":0.54100000000000004},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36599999999999999},"max":{"1min":0.76000000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.47199999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55300000000000005,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.34499999999999997,"15min":0.28199999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59899999999999998,"15min":0.57699999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80600000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.439}]},{"osd":3,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.48499999999999999,"15min":0.47699999999999998},"min":{"1min":0.35699999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61399999999999999,"5min":0.73499999999999999,"15min":0.748},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41099999999999998,"5min":0.38900000000000001,"15min":0.34100000000000003},"max":{"1min":0.74099999999999999,"5min":0.82499999999999996,"15min":0.93100000000000005},"last":0.41899999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82699999999999996,"15min":0.80200000000000005},"min":{"1min":0.56899999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.6870000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82899999999999996,"15min":0.80400000000000005},"min":{"1min":0.58299999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.2689999999999999},"last":0.77400000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81999999999999995,"15min":0.79600000000000004},"min":{"1min":0.57799999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.026,"5min":1.169,"15min":1.2549999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.81200000000000006},"min":{"1min":0.58399999999999996,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.171,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.74099999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.81999999999999995,"15min":0.80300000000000005},"min":{"1min":0.55400000000000005,"5min":0.44900000000000001,"15min":0.40300000000000002},"max":{"1min":1.0940000000000001,"5min":1.2,"15min":1.3759999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.873,"5min":0.84399999999999997,"15min":0.81100000000000005},"min":{"1min":0.66100000000000003,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.23,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84799999999999998,"15min":0.83099999999999996},"min":{"1min":0.60099999999999998,"5min":0.51100000000000001,"15min":0.49099999999999999},"max":{"1min":1.1140000000000001,"5min":1.214,"15min":1.2909999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84099999999999997,"15min":0.81999999999999995},"min":{"1min":0.63100000000000001,"5min":0.44900000000000001,"15min":0.44700000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.3660000000000001},"last":0.66900000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509604,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":753664,"data_stored":362286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.47199999999999998,"15min":0.53900000000000003},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59599999999999997,"5min":0.84599999999999997,"15min":5.4800000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56200000000000006,"15min":0.61499999999999999},"min":{"1min":0.41099999999999998,"5min":0.377,"15min":0.36099999999999999},"max":{"1min":0.76700000000000002,"5min":0.872,"15min":5.2830000000000004},"last":0.46899999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.505,"15min":0.53700000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.64900000000000002,"5min":0.76100000000000001,"15min":3.4220000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.52400000000000002,"15min":0.53600000000000003},"min":{"1min":0.35199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.88800000000000001},"last":0.377}]},{"osd":3,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.58999999999999997,"15min":0.626},"min":{"1min":0.35799999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81599999999999995,"5min":0.86599999999999999,"15min":3.2469999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.51000000000000001,"15min":0.56999999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71799999999999997,"5min":0.77300000000000002,"15min":5.8710000000000004},"last":0.42799999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.80900000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89500000000000002,"5min":1.1930000000000001,"15min":3.6259999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78200000000000003,"15min":0.83499999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.91300000000000003,"5min":1.083,"15min":4.4100000000000001},"last":0.64200000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.77600000000000002,"15min":0.83999999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96599999999999997,"5min":1.115,"15min":5.766},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.78700000000000003,"15min":0.82599999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90400000000000003,"5min":1.2849999999999999,"15min":3.669},"last":0.70299999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95199999999999996,"5min":1.147,"15min":1.23},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77800000000000002,"15min":0.85499999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93600000000000005,"5min":1.3240000000000001,"15min":5.8200000000000003},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.79200000000000004,"15min":0.86499999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.872,"5min":1.244,"15min":5.9269999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79200000000000004,"15min":0.84299999999999997},"min":{"1min":0.52600000000000002,"5min":0.48599999999999999,"15min":0.45700000000000002},"max":{"1min":0.93400000000000005,"5min":1.3380000000000001,"15min":3.5800000000000001},"last":0.622}]}]},{"osd":0,"up_from":15,"seq":64424509606,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1359872,"data_stored":959326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.32500000000000001,"5min":0.29999999999999999,"15min":0.28000000000000003},"max":{"1min":0.754,"5min":0.81000000000000005,"15min":0.91100000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53700000000000003,"15min":0.49399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.28599999999999998},"max":{"1min":0.72699999999999998,"5min":0.77800000000000002,"15min":0.83199999999999996},"last":0.434}]},{"osd":2,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54300000000000004,"15min":0.51700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.32200000000000001},"max":{"1min":0.72799999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53800000000000003,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.33700000000000002,"15min":0.33000000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.41799999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60499999999999998,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84499999999999997,"5min":0.88100000000000001,"15min":0.91300000000000003},"last":0.499},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.53600000000000003},"min":{"1min":0.40699999999999997,"5min":0.40200000000000002,"15min":0.35599999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.85699999999999998},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.79100000000000004,"15min":0.79200000000000004},"min":{"1min":0.52700000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0760000000000001,"5min":1.1559999999999999,"15min":1.321},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.81100000000000005,"15min":0.80200000000000005},"min":{"1min":0.57799999999999996,"5min":0.52800000000000002,"15min":0.48999999999999999},"max":{"1min":1.0880000000000001,"5min":1.423,"15min":1.423},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78300000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.107,"5min":1.2669999999999999,"15min":1.28},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82599999999999996,"15min":0.81799999999999995},"min":{"1min":0.59799999999999998,"5min":0.53700000000000003,"15min":0.50700000000000001},"max":{"1min":1.0329999999999999,"5min":1.254,"15min":1.393},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.82099999999999995,"15min":0.81699999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0820000000000001,"5min":1.2290000000000001,"15min":1.28},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84199999999999997,"15min":0.82499999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.57599999999999996},"max":{"1min":1.147,"5min":1.333,"15min":1.333},"last":0.82499999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80100000000000005,"15min":0.79900000000000004},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.54000000000000004},"max":{"1min":1.087,"5min":1.121,"15min":1.2310000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85499999999999998,"15min":0.84199999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.101,"5min":1.296,"15min":1.369},"last":0.61199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:32:06.496 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:32:06.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.624+0000 7f3a6800b640 1 Processor -- start 2023-07-21T22:32:06.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.624+0000 7f3a6800b640 1 -- start start 2023-07-21T22:32:06.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.624+0000 7f3a6800b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3a60069430 0x7f3a60069830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.624+0000 7f3a6800b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a600c9c30 con 0x7f3a60160450 2023-07-21T22:32:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.628+0000 7f3a6800b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6015bfd0 con 0x7f3a6015bc00 2023-07-21T22:32:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.628+0000 7f3a6800b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a600c96b0 con 0x7f3a60069430 2023-07-21T22:32:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.628+0000 7f3a655a6640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3a60160450 0x7f3a6006e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53702/0 (socket says 172.21.15.6:53702) 2023-07-21T22:32:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.628+0000 7f3a655a6640 1 -- 172.21.15.6:0/3246657008 learned_addr learned my addr 172.21.15.6:0/3246657008 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:32:06.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.628+0000 7f3a665a8640 1 --2- 172.21.15.6:0/3246657008 >> v2:172.21.15.161:3300/0 conn(0x7f3a60069430 0x7f3a60069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:06.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.628+0000 7f3a64da5640 1 -- 172.21.15.6:0/3246657008 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232663242 0 0) 0x7f3a600c9c30 con 0x7f3a60160450 2023-07-21T22:32:06.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.628+0000 7f3a64da5640 1 -- 172.21.15.6:0/3246657008 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a4c003530 con 0x7f3a60160450 2023-07-21T22:32:06.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.628+0000 7f3a64da5640 1 -- 172.21.15.6:0/3246657008 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695694852 0 0) 0x7f3a6015bfd0 con 0x7f3a6015bc00 2023-07-21T22:32:06.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.628+0000 7f3a64da5640 1 -- 172.21.15.6:0/3246657008 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a600c9c30 con 0x7f3a6015bc00 2023-07-21T22:32:06.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.628+0000 7f3a64da5640 1 -- 172.21.15.6:0/3246657008 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2937624077 0 0) 0x7f3a4c003530 con 0x7f3a60160450 2023-07-21T22:32:06.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.628+0000 7f3a665a8640 1 -- 172.21.15.6:0/3246657008 >> v1:172.21.15.161:6789/0 conn(0x7f3a6015bc00 legacy=0x7f3a600ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:06.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.628+0000 7f3a665a8640 1 -- 172.21.15.6:0/3246657008 >> v1:172.21.15.6:6789/0 conn(0x7f3a60160450 legacy=0x7f3a6006e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:06.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.628+0000 7f3a665a8640 1 -- 172.21.15.6:0/3246657008 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a60069d70 con 0x7f3a60069430 2023-07-21T22:32:06.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.628+0000 7f3a665a8640 1 --2- 172.21.15.6:0/3246657008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a60069430 0x7f3a60069830 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009d90 tx=0x7f3a5801c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67a8041bf0ad36aa server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:06.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.632+0000 7f3a64da5640 1 -- 172.21.15.6:0/3246657008 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a50001680 con 0x7f3a60069430 2023-07-21T22:32:06.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.632+0000 7f3a64da5640 1 -- 172.21.15.6:0/3246657008 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a580a5680 con 0x7f3a60069430 2023-07-21T22:32:06.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.632+0000 7f3a64da5640 1 -- 172.21.15.6:0/3246657008 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580a5a10 con 0x7f3a60069430 2023-07-21T22:32:06.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.632+0000 7f3a6800b640 1 -- 172.21.15.6:0/3246657008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a60069430 msgr2=0x7f3a60069830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:06.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.632+0000 7f3a6800b640 1 --2- 172.21.15.6:0/3246657008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a60069430 0x7f3a60069830 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009d90 tx=0x7f3a5801c840 comp rx=0 tx=0).stop 2023-07-21T22:32:06.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.632+0000 7f3a6800b640 1 -- 172.21.15.6:0/3246657008 shutdown_connections 2023-07-21T22:32:06.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.632+0000 7f3a6800b640 1 --2- 172.21.15.6:0/3246657008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a60069430 0x7f3a60069830 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.632+0000 7f3a6800b640 1 -- 172.21.15.6:0/3246657008 >> 172.21.15.6:0/3246657008 conn(0x7f3a600b1840 msgr2=0x7f3a600cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:06.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.632+0000 7f3a6800b640 1 -- 172.21.15.6:0/3246657008 shutdown_connections 2023-07-21T22:32:06.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.632+0000 7f3a6800b640 1 -- 172.21.15.6:0/3246657008 wait complete. 2023-07-21T22:32:06.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.632+0000 7f3a6800b640 1 Processor -- start 2023-07-21T22:32:06.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.632+0000 7f3a6800b640 1 -- start start 2023-07-21T22:32:06.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.632+0000 7f3a6800b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a60069430 0x7f3a60152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:06.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.632+0000 7f3a6800b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a6015bc00 0x7f3a6014eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:06.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.632+0000 7f3a6800b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a60160450 0x7f3a60149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:06.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.632+0000 7f3a6800b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a601595c0 con 0x7f3a60160450 2023-07-21T22:32:06.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.632+0000 7f3a6800b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a601598a0 con 0x7f3a6015bc00 2023-07-21T22:32:06.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.632+0000 7f3a6800b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a60159b80 con 0x7f3a60069430 2023-07-21T22:32:06.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.632+0000 7f3a665a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a60160450 0x7f3a60149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:06.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.636+0000 7f3a665a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a60160450 0x7f3a60149730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35728/0 (socket says 172.21.15.6:35728) 2023-07-21T22:32:06.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.636+0000 7f3a665a8640 1 -- 172.21.15.6:0/1067122032 learned_addr learned my addr 172.21.15.6:0/1067122032 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:06.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.636+0000 7f3a655a6640 1 --2- 172.21.15.6:0/1067122032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a6015bc00 0x7f3a6014eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:06.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.636+0000 7f3a65da7640 1 --2- 172.21.15.6:0/1067122032 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a60069430 0x7f3a60152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:06.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.636+0000 7f3a665a8640 1 -- 172.21.15.6:0/1067122032 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a60069430 msgr2=0x7f3a60152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:06.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.636+0000 7f3a665a8640 1 --2- 172.21.15.6:0/1067122032 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a60069430 0x7f3a60152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.636+0000 7f3a665a8640 1 -- 172.21.15.6:0/1067122032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a6015bc00 msgr2=0x7f3a6014eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:06.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.636+0000 7f3a665a8640 1 --2- 172.21.15.6:0/1067122032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a6015bc00 0x7f3a6014eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.636+0000 7f3a665a8640 1 -- 172.21.15.6:0/1067122032 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a58009a70 con 0x7f3a60160450 2023-07-21T22:32:06.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.636+0000 7f3a665a8640 1 --2- 172.21.15.6:0/1067122032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a60160450 0x7f3a60149730 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009d90 tx=0x7f3a580195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:06.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.636+0000 7f3a567fc640 1 -- 172.21.15.6:0/1067122032 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580ad640 con 0x7f3a60160450 2023-07-21T22:32:06.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.636+0000 7f3a567fc640 1 -- 172.21.15.6:0/1067122032 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a580ad7a0 con 0x7f3a60160450 2023-07-21T22:32:06.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.636+0000 7f3a6800b640 1 -- 172.21.15.6:0/1067122032 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a60159e60 con 0x7f3a60160450 2023-07-21T22:32:06.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.636+0000 7f3a567fc640 1 -- 172.21.15.6:0/1067122032 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580adb10 con 0x7f3a60160450 2023-07-21T22:32:06.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.636+0000 7f3a6800b640 1 -- 172.21.15.6:0/1067122032 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a60152fe0 con 0x7f3a60160450 2023-07-21T22:32:06.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.636+0000 7f3a6800b640 1 -- 172.21.15.6:0/1067122032 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a60072c30 con 0x7f3a60160450 2023-07-21T22:32:06.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.636+0000 7f3a567fc640 1 -- 172.21.15.6:0/1067122032 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3a580b4070 con 0x7f3a60160450 2023-07-21T22:32:06.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.636+0000 7f3a567fc640 1 --2- 172.21.15.6:0/1067122032 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f3a440663a0 0x7f3a44068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:06.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.636+0000 7f3a567fc640 1 -- 172.21.15.6:0/1067122032 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f3a5811ed10 con 0x7f3a60160450 2023-07-21T22:32:06.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.640+0000 7f3a65da7640 1 --2- 172.21.15.6:0/1067122032 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f3a440663a0 0x7f3a44068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.640+0000 7f3a65da7640 1 --2- 172.21.15.6:0/1067122032 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f3a440663a0 0x7f3a44068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0011f0 tx=0x7f3a5c009040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.640+0000 7f3a567fc640 1 -- 172.21.15.6:0/1067122032 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3a580ec0e0 con 0x7f3a60160450 2023-07-21T22:32:06.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.796+0000 7f3a6800b640 1 -- 172.21.15.6:0/1067122032 --> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3a600678d0 con 0x7f3a440663a0 2023-07-21T22:32:06.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.804+0000 7f3a567fc640 1 -- 172.21.15.6:0/1067122032 <== mgr.5743 v2:172.21.15.161:6832/3740183048 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305853 (secure 0 0 0) 0x7f3a600678d0 con 0x7f3a440663a0 2023-07-21T22:32:06.856 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:32:06.857 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:32:06.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.808+0000 7f3a6800b640 1 -- 172.21.15.6:0/1067122032 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f3a440663a0 msgr2=0x7f3a44068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:06.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.808+0000 7f3a6800b640 1 --2- 172.21.15.6:0/1067122032 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f3a440663a0 0x7f3a44068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0011f0 tx=0x7f3a5c009040 comp rx=0 tx=0).stop 2023-07-21T22:32:06.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.808+0000 7f3a6800b640 1 -- 172.21.15.6:0/1067122032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a60160450 msgr2=0x7f3a60149730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:06.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.808+0000 7f3a6800b640 1 --2- 172.21.15.6:0/1067122032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a60160450 0x7f3a60149730 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009d90 tx=0x7f3a580195e0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.808+0000 7f3a6800b640 1 -- 172.21.15.6:0/1067122032 shutdown_connections 2023-07-21T22:32:06.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.808+0000 7f3a6800b640 1 --2- 172.21.15.6:0/1067122032 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f3a440663a0 0x7f3a44068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.808+0000 7f3a6800b640 1 --2- 172.21.15.6:0/1067122032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a60160450 0x7f3a60149730 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.808+0000 7f3a6800b640 1 --2- 172.21.15.6:0/1067122032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a6015bc00 0x7f3a6014eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.808+0000 7f3a6800b640 1 --2- 172.21.15.6:0/1067122032 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a60069430 0x7f3a60152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:06.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.808+0000 7f3a6800b640 1 -- 172.21.15.6:0/1067122032 >> 172.21.15.6:0/1067122032 conn(0x7f3a600b1840 msgr2=0x7f3a600af290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:06.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.808+0000 7f3a6800b640 1 -- 172.21.15.6:0/1067122032 shutdown_connections 2023-07-21T22:32:06.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:06.808+0000 7f3a6800b640 1 -- 172.21.15.6:0/1067122032 wait complete. 2023-07-21T22:32:06.876 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-21T22:32:05.705254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":295696,"kb_used_data":7120,"kb_used_omap":0,"kb_used_meta":288512,"kb_avail":754679024,"statfs":{"total":773094113280,"available":772791320576,"internally_reserved":0,"allocated":7290880,"data_stored":4119056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":295436288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.781878"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939046+0000","last_change":"2023-07-21T22:32:00.939046+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939046+0000","last_undegraded":"2023-07-21T22:32:00.939046+0000","last_fullsized":"2023-07-21T22:32:00.939046+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940135+0000","last_change":"2023-07-21T22:32:00.940135+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940135+0000","last_undegraded":"2023-07-21T22:32:00.940135+0000","last_fullsized":"2023-07-21T22:32:00.940135+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.935591+0000","last_change":"2023-07-21T22:32:00.935591+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.935591+0000","last_undegraded":"2023-07-21T22:32:00.935591+0000","last_fullsized":"2023-07-21T22:32:00.935591+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939384+0000","last_change":"2023-07-21T22:32:00.939384+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939384+0000","last_undegraded":"2023-07-21T22:32:00.939384+0000","last_fullsized":"2023-07-21T22:32:00.939384+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.945092+0000","last_change":"2023-07-21T22:32:00.945092+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.945092+0000","last_undegraded":"2023-07-21T22:32:00.945092+0000","last_fullsized":"2023-07-21T22:32:00.945092+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940528+0000","last_change":"2023-07-21T22:32:00.940528+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940528+0000","last_undegraded":"2023-07-21T22:32:00.940528+0000","last_fullsized":"2023-07-21T22:32:00.940528+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.931463+0000","last_change":"2023-07-21T22:32:00.931463+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.931463+0000","last_undegraded":"2023-07-21T22:32:00.931463+0000","last_fullsized":"2023-07-21T22:32:00.931463+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.943332+0000","last_change":"2023-07-21T22:32:00.943332+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.943332+0000","last_undegraded":"2023-07-21T22:32:00.943332+0000","last_fullsized":"2023-07-21T22:32:00.943332+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.943669+0000","last_change":"2023-07-21T22:32:00.943669+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.943669+0000","last_undegraded":"2023-07-21T22:32:00.943669+0000","last_fullsized":"2023-07-21T22:32:00.943669+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942369+0000","last_change":"2023-07-21T22:32:00.942369+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942369+0000","last_undegraded":"2023-07-21T22:32:00.942369+0000","last_fullsized":"2023-07-21T22:32:00.942369+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.933108+0000","last_change":"2023-07-21T22:32:00.933108+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.933108+0000","last_undegraded":"2023-07-21T22:32:00.933108+0000","last_fullsized":"2023-07-21T22:32:00.933108+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.943642+0000","last_change":"2023-07-21T22:32:00.943642+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.943642+0000","last_undegraded":"2023-07-21T22:32:00.943642+0000","last_fullsized":"2023-07-21T22:32:00.943642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939463+0000","last_change":"2023-07-21T22:32:00.939463+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939463+0000","last_undegraded":"2023-07-21T22:32:00.939463+0000","last_fullsized":"2023-07-21T22:32:00.939463+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.931137+0000","last_change":"2023-07-21T22:32:00.931137+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.931137+0000","last_undegraded":"2023-07-21T22:32:00.931137+0000","last_fullsized":"2023-07-21T22:32:00.931137+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940920+0000","last_change":"2023-07-21T22:32:00.940920+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940920+0000","last_undegraded":"2023-07-21T22:32:00.940920+0000","last_fullsized":"2023-07-21T22:32:00.940920+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941617+0000","last_change":"2023-07-21T22:32:00.941617+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941617+0000","last_undegraded":"2023-07-21T22:32:00.941617+0000","last_fullsized":"2023-07-21T22:32:00.941617+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.934576+0000","last_change":"2023-07-21T22:32:00.934576+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.934576+0000","last_undegraded":"2023-07-21T22:32:00.934576+0000","last_fullsized":"2023-07-21T22:32:00.934576+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939627+0000","last_change":"2023-07-21T22:32:00.939627+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939627+0000","last_undegraded":"2023-07-21T22:32:00.939627+0000","last_fullsized":"2023-07-21T22:32:00.939627+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.935124+0000","last_change":"2023-07-21T22:32:00.935124+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.935124+0000","last_undegraded":"2023-07-21T22:32:00.935124+0000","last_fullsized":"2023-07-21T22:32:00.935124+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940067+0000","last_change":"2023-07-21T22:32:00.940067+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940067+0000","last_undegraded":"2023-07-21T22:32:00.940067+0000","last_fullsized":"2023-07-21T22:32:00.940067+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939390+0000","last_change":"2023-07-21T22:32:00.939390+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939390+0000","last_undegraded":"2023-07-21T22:32:00.939390+0000","last_fullsized":"2023-07-21T22:32:00.939390+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942199+0000","last_change":"2023-07-21T22:32:00.942199+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942199+0000","last_undegraded":"2023-07-21T22:32:00.942199+0000","last_fullsized":"2023-07-21T22:32:00.942199+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.934188+0000","last_change":"2023-07-21T22:32:00.934188+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.934188+0000","last_undegraded":"2023-07-21T22:32:00.934188+0000","last_fullsized":"2023-07-21T22:32:00.934188+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.932446+0000","last_change":"2023-07-21T22:32:00.932446+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.932446+0000","last_undegraded":"2023-07-21T22:32:00.932446+0000","last_fullsized":"2023-07-21T22:32:00.932446+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.934081+0000","last_change":"2023-07-21T22:32:00.934081+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.934081+0000","last_undegraded":"2023-07-21T22:32:00.934081+0000","last_fullsized":"2023-07-21T22:32:00.934081+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942891+0000","last_change":"2023-07-21T22:32:00.942891+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942891+0000","last_undegraded":"2023-07-21T22:32:00.942891+0000","last_fullsized":"2023-07-21T22:32:00.942891+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941426+0000","last_change":"2023-07-21T22:32:00.941426+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941426+0000","last_undegraded":"2023-07-21T22:32:00.941426+0000","last_fullsized":"2023-07-21T22:32:00.941426+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939540+0000","last_change":"2023-07-21T22:32:00.939540+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939540+0000","last_undegraded":"2023-07-21T22:32:00.939540+0000","last_fullsized":"2023-07-21T22:32:00.939540+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.931313+0000","last_change":"2023-07-21T22:32:00.931313+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.931313+0000","last_undegraded":"2023-07-21T22:32:00.931313+0000","last_fullsized":"2023-07-21T22:32:00.931313+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942556+0000","last_change":"2023-07-21T22:32:00.942556+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942556+0000","last_undegraded":"2023-07-21T22:32:00.942556+0000","last_fullsized":"2023-07-21T22:32:00.942556+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.930989+0000","last_change":"2023-07-21T22:32:00.930989+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.930989+0000","last_undegraded":"2023-07-21T22:32:00.930989+0000","last_fullsized":"2023-07-21T22:32:00.930989+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.937353+0000","last_change":"2023-07-21T22:32:00.937353+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.937353+0000","last_undegraded":"2023-07-21T22:32:00.937353+0000","last_fullsized":"2023-07-21T22:32:00.937353+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940212+0000","last_change":"2023-07-21T22:32:00.940212+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940212+0000","last_undegraded":"2023-07-21T22:32:00.940212+0000","last_fullsized":"2023-07-21T22:32:00.940212+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.953399+0000","last_change":"2023-07-21T22:32:00.951495+0000","last_active":"2023-07-21T22:32:00.953399+0000","last_peered":"2023-07-21T22:32:00.953399+0000","last_clean":"2023-07-21T22:32:00.953399+0000","last_became_active":"2023-07-21T22:32:00.951233+0000","last_became_peered":"2023-07-21T22:32:00.951233+0000","last_unstale":"2023-07-21T22:32:00.953399+0000","last_undegraded":"2023-07-21T22:32:00.953399+0000","last_fullsized":"2023-07-21T22:32:00.953399+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:48:19.238340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936126+0000","last_change":"2023-07-21T22:32:00.936126+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936126+0000","last_undegraded":"2023-07-21T22:32:00.936126+0000","last_fullsized":"2023-07-21T22:32:00.936126+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.957667+0000","last_change":"2023-07-21T22:32:00.954953+0000","last_active":"2023-07-21T22:32:00.957667+0000","last_peered":"2023-07-21T22:32:00.957667+0000","last_clean":"2023-07-21T22:32:00.957667+0000","last_became_active":"2023-07-21T22:32:00.954668+0000","last_became_peered":"2023-07-21T22:32:00.954668+0000","last_unstale":"2023-07-21T22:32:00.957667+0000","last_undegraded":"2023-07-21T22:32:00.957667+0000","last_fullsized":"2023-07-21T22:32:00.957667+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:40:48.657491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939148+0000","last_change":"2023-07-21T22:32:00.939148+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939148+0000","last_undegraded":"2023-07-21T22:32:00.939148+0000","last_fullsized":"2023-07-21T22:32:00.939148+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.955289+0000","last_change":"2023-07-21T22:32:00.949062+0000","last_active":"2023-07-21T22:32:00.955289+0000","last_peered":"2023-07-21T22:32:00.955289+0000","last_clean":"2023-07-21T22:32:00.955289+0000","last_became_active":"2023-07-21T22:32:00.948796+0000","last_became_peered":"2023-07-21T22:32:00.948796+0000","last_unstale":"2023-07-21T22:32:00.955289+0000","last_undegraded":"2023-07-21T22:32:00.955289+0000","last_fullsized":"2023-07-21T22:32:00.955289+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:18:28.623919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942728+0000","last_change":"2023-07-21T22:32:00.942728+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942728+0000","last_undegraded":"2023-07-21T22:32:00.942728+0000","last_fullsized":"2023-07-21T22:32:00.942728+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.958912+0000","last_change":"2023-07-21T22:32:00.957955+0000","last_active":"2023-07-21T22:32:00.958912+0000","last_peered":"2023-07-21T22:32:00.958912+0000","last_clean":"2023-07-21T22:32:00.958912+0000","last_became_active":"2023-07-21T22:32:00.957647+0000","last_became_peered":"2023-07-21T22:32:00.957647+0000","last_unstale":"2023-07-21T22:32:00.958912+0000","last_undegraded":"2023-07-21T22:32:00.958912+0000","last_fullsized":"2023-07-21T22:32:00.958912+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:47:59.245516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.944136+0000","last_change":"2023-07-21T22:32:00.944136+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.944136+0000","last_undegraded":"2023-07-21T22:32:00.944136+0000","last_fullsized":"2023-07-21T22:32:00.944136+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.945045+0000","last_change":"2023-07-21T22:32:00.939672+0000","last_active":"2023-07-21T22:32:00.945045+0000","last_peered":"2023-07-21T22:32:00.945045+0000","last_clean":"2023-07-21T22:32:00.945045+0000","last_became_active":"2023-07-21T22:32:00.939377+0000","last_became_peered":"2023-07-21T22:32:00.939377+0000","last_unstale":"2023-07-21T22:32:00.945045+0000","last_undegraded":"2023-07-21T22:32:00.945045+0000","last_fullsized":"2023-07-21T22:32:00.945045+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:21:16.607665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940650+0000","last_change":"2023-07-21T22:32:00.940650+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940650+0000","last_undegraded":"2023-07-21T22:32:00.940650+0000","last_fullsized":"2023-07-21T22:32:00.940650+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.956668+0000","last_change":"2023-07-21T22:32:00.952492+0000","last_active":"2023-07-21T22:32:00.956668+0000","last_peered":"2023-07-21T22:32:00.956668+0000","last_clean":"2023-07-21T22:32:00.956668+0000","last_became_active":"2023-07-21T22:32:00.952206+0000","last_became_peered":"2023-07-21T22:32:00.952206+0000","last_unstale":"2023-07-21T22:32:00.956668+0000","last_undegraded":"2023-07-21T22:32:00.956668+0000","last_fullsized":"2023-07-21T22:32:00.956668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:23:46.523157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941817+0000","last_change":"2023-07-21T22:32:00.941817+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941817+0000","last_undegraded":"2023-07-21T22:32:00.941817+0000","last_fullsized":"2023-07-21T22:32:00.941817+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.953100+0000","last_change":"2023-07-21T22:32:00.950894+0000","last_active":"2023-07-21T22:32:00.953100+0000","last_peered":"2023-07-21T22:32:00.953100+0000","last_clean":"2023-07-21T22:32:00.953100+0000","last_became_active":"2023-07-21T22:32:00.950574+0000","last_became_peered":"2023-07-21T22:32:00.950574+0000","last_unstale":"2023-07-21T22:32:00.953100+0000","last_undegraded":"2023-07-21T22:32:00.953100+0000","last_fullsized":"2023-07-21T22:32:00.953100+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:39:22.307711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939246+0000","last_change":"2023-07-21T22:32:00.939246+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939246+0000","last_undegraded":"2023-07-21T22:32:00.939246+0000","last_fullsized":"2023-07-21T22:32:00.939246+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.954926+0000","last_change":"2023-07-21T22:32:00.950304+0000","last_active":"2023-07-21T22:32:00.954926+0000","last_peered":"2023-07-21T22:32:00.954926+0000","last_clean":"2023-07-21T22:32:00.954926+0000","last_became_active":"2023-07-21T22:32:00.949932+0000","last_became_peered":"2023-07-21T22:32:00.949932+0000","last_unstale":"2023-07-21T22:32:00.954926+0000","last_undegraded":"2023-07-21T22:32:00.954926+0000","last_fullsized":"2023-07-21T22:32:00.954926+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:33:09.061573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942335+0000","last_change":"2023-07-21T22:32:00.942335+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942335+0000","last_undegraded":"2023-07-21T22:32:00.942335+0000","last_fullsized":"2023-07-21T22:32:00.942335+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.951430+0000","last_change":"2023-07-21T22:32:00.949543+0000","last_active":"2023-07-21T22:32:00.951430+0000","last_peered":"2023-07-21T22:32:00.951430+0000","last_clean":"2023-07-21T22:32:00.951430+0000","last_became_active":"2023-07-21T22:32:00.949230+0000","last_became_peered":"2023-07-21T22:32:00.949230+0000","last_unstale":"2023-07-21T22:32:00.951430+0000","last_undegraded":"2023-07-21T22:32:00.951430+0000","last_fullsized":"2023-07-21T22:32:00.951430+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:01:13.578327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.937205+0000","last_change":"2023-07-21T22:32:00.937205+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.937205+0000","last_undegraded":"2023-07-21T22:32:00.937205+0000","last_fullsized":"2023-07-21T22:32:00.937205+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.956608+0000","last_change":"2023-07-21T22:32:00.951734+0000","last_active":"2023-07-21T22:32:00.956608+0000","last_peered":"2023-07-21T22:32:00.956608+0000","last_clean":"2023-07-21T22:32:00.956608+0000","last_became_active":"2023-07-21T22:32:00.950944+0000","last_became_peered":"2023-07-21T22:32:00.950944+0000","last_unstale":"2023-07-21T22:32:00.956608+0000","last_undegraded":"2023-07-21T22:32:00.956608+0000","last_fullsized":"2023-07-21T22:32:00.956608+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:18:12.778871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.930588+0000","last_change":"2023-07-21T22:32:00.930588+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.930588+0000","last_undegraded":"2023-07-21T22:32:00.930588+0000","last_fullsized":"2023-07-21T22:32:00.930588+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.956872+0000","last_change":"2023-07-21T22:32:00.955950+0000","last_active":"2023-07-21T22:32:00.956872+0000","last_peered":"2023-07-21T22:32:00.956872+0000","last_clean":"2023-07-21T22:32:00.956872+0000","last_became_active":"2023-07-21T22:32:00.955656+0000","last_became_peered":"2023-07-21T22:32:00.955656+0000","last_unstale":"2023-07-21T22:32:00.956872+0000","last_undegraded":"2023-07-21T22:32:00.956872+0000","last_fullsized":"2023-07-21T22:32:00.956872+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:54:13.720697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942555+0000","last_change":"2023-07-21T22:32:00.942555+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942555+0000","last_undegraded":"2023-07-21T22:32:00.942555+0000","last_fullsized":"2023-07-21T22:32:00.942555+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.953630+0000","last_change":"2023-07-21T22:32:00.944870+0000","last_active":"2023-07-21T22:32:00.953630+0000","last_peered":"2023-07-21T22:32:00.953630+0000","last_clean":"2023-07-21T22:32:00.953630+0000","last_became_active":"2023-07-21T22:32:00.944534+0000","last_became_peered":"2023-07-21T22:32:00.944534+0000","last_unstale":"2023-07-21T22:32:00.953630+0000","last_undegraded":"2023-07-21T22:32:00.953630+0000","last_fullsized":"2023-07-21T22:32:00.953630+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:43:59.834021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936876+0000","last_change":"2023-07-21T22:32:00.936876+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936876+0000","last_undegraded":"2023-07-21T22:32:00.936876+0000","last_fullsized":"2023-07-21T22:32:00.936876+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.948392+0000","last_change":"2023-07-21T22:32:00.946546+0000","last_active":"2023-07-21T22:32:00.948392+0000","last_peered":"2023-07-21T22:32:00.948392+0000","last_clean":"2023-07-21T22:32:00.948392+0000","last_became_active":"2023-07-21T22:32:00.946230+0000","last_became_peered":"2023-07-21T22:32:00.946230+0000","last_unstale":"2023-07-21T22:32:00.948392+0000","last_undegraded":"2023-07-21T22:32:00.948392+0000","last_fullsized":"2023-07-21T22:32:00.948392+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:14:44.561456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.934363+0000","last_change":"2023-07-21T22:32:00.934363+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.934363+0000","last_undegraded":"2023-07-21T22:32:00.934363+0000","last_fullsized":"2023-07-21T22:32:00.934363+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.951794+0000","last_change":"2023-07-21T22:32:00.948760+0000","last_active":"2023-07-21T22:32:00.951794+0000","last_peered":"2023-07-21T22:32:00.951794+0000","last_clean":"2023-07-21T22:32:00.951794+0000","last_became_active":"2023-07-21T22:32:00.948465+0000","last_became_peered":"2023-07-21T22:32:00.948465+0000","last_unstale":"2023-07-21T22:32:00.951794+0000","last_undegraded":"2023-07-21T22:32:00.951794+0000","last_fullsized":"2023-07-21T22:32:00.951794+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:02:10.700819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942388+0000","last_change":"2023-07-21T22:32:00.942388+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942388+0000","last_undegraded":"2023-07-21T22:32:00.942388+0000","last_fullsized":"2023-07-21T22:32:00.942388+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.955252+0000","last_change":"2023-07-21T22:32:00.952133+0000","last_active":"2023-07-21T22:32:00.955252+0000","last_peered":"2023-07-21T22:32:00.955252+0000","last_clean":"2023-07-21T22:32:00.955252+0000","last_became_active":"2023-07-21T22:32:00.951734+0000","last_became_peered":"2023-07-21T22:32:00.951734+0000","last_unstale":"2023-07-21T22:32:00.955252+0000","last_undegraded":"2023-07-21T22:32:00.955252+0000","last_fullsized":"2023-07-21T22:32:00.955252+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:40:24.334656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.937756+0000","last_change":"2023-07-21T22:32:00.937756+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.937756+0000","last_undegraded":"2023-07-21T22:32:00.937756+0000","last_fullsized":"2023-07-21T22:32:00.937756+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.954799+0000","last_change":"2023-07-21T22:32:00.952275+0000","last_active":"2023-07-21T22:32:00.954799+0000","last_peered":"2023-07-21T22:32:00.954799+0000","last_clean":"2023-07-21T22:32:00.954799+0000","last_became_active":"2023-07-21T22:32:00.951981+0000","last_became_peered":"2023-07-21T22:32:00.951981+0000","last_unstale":"2023-07-21T22:32:00.954799+0000","last_undegraded":"2023-07-21T22:32:00.954799+0000","last_fullsized":"2023-07-21T22:32:00.954799+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:08.224210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941696+0000","last_change":"2023-07-21T22:32:00.941696+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941696+0000","last_undegraded":"2023-07-21T22:32:00.941696+0000","last_fullsized":"2023-07-21T22:32:00.941696+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.955656+0000","last_change":"2023-07-21T22:32:00.953359+0000","last_active":"2023-07-21T22:32:00.955656+0000","last_peered":"2023-07-21T22:32:00.955656+0000","last_clean":"2023-07-21T22:32:00.955656+0000","last_became_active":"2023-07-21T22:32:00.953042+0000","last_became_peered":"2023-07-21T22:32:00.953042+0000","last_unstale":"2023-07-21T22:32:00.955656+0000","last_undegraded":"2023-07-21T22:32:00.955656+0000","last_fullsized":"2023-07-21T22:32:00.955656+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:54:58.294196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939056+0000","last_change":"2023-07-21T22:32:00.939056+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939056+0000","last_undegraded":"2023-07-21T22:32:00.939056+0000","last_fullsized":"2023-07-21T22:32:00.939056+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.949424+0000","last_change":"2023-07-21T22:32:00.943392+0000","last_active":"2023-07-21T22:32:00.949424+0000","last_peered":"2023-07-21T22:32:00.949424+0000","last_clean":"2023-07-21T22:32:00.949424+0000","last_became_active":"2023-07-21T22:32:00.943043+0000","last_became_peered":"2023-07-21T22:32:00.943043+0000","last_unstale":"2023-07-21T22:32:00.949424+0000","last_undegraded":"2023-07-21T22:32:00.949424+0000","last_fullsized":"2023-07-21T22:32:00.949424+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:44:11.097837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.943243+0000","last_change":"2023-07-21T22:32:00.943243+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.943243+0000","last_undegraded":"2023-07-21T22:32:00.943243+0000","last_fullsized":"2023-07-21T22:32:00.943243+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.958676+0000","last_change":"2023-07-21T22:32:00.954859+0000","last_active":"2023-07-21T22:32:00.958676+0000","last_peered":"2023-07-21T22:32:00.958676+0000","last_clean":"2023-07-21T22:32:00.958676+0000","last_became_active":"2023-07-21T22:32:00.954521+0000","last_became_peered":"2023-07-21T22:32:00.954521+0000","last_unstale":"2023-07-21T22:32:00.958676+0000","last_undegraded":"2023-07-21T22:32:00.958676+0000","last_fullsized":"2023-07-21T22:32:00.958676+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:24:57.280727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.938951+0000","last_change":"2023-07-21T22:32:00.938951+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.938951+0000","last_undegraded":"2023-07-21T22:32:00.938951+0000","last_fullsized":"2023-07-21T22:32:00.938951+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.961338+0000","last_change":"2023-07-21T22:32:00.957742+0000","last_active":"2023-07-21T22:32:00.961338+0000","last_peered":"2023-07-21T22:32:00.961338+0000","last_clean":"2023-07-21T22:32:00.961338+0000","last_became_active":"2023-07-21T22:32:00.957336+0000","last_became_peered":"2023-07-21T22:32:00.957336+0000","last_unstale":"2023-07-21T22:32:00.961338+0000","last_undegraded":"2023-07-21T22:32:00.961338+0000","last_fullsized":"2023-07-21T22:32:00.961338+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:18:50.663097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936147+0000","last_change":"2023-07-21T22:32:00.936147+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936147+0000","last_undegraded":"2023-07-21T22:32:00.936147+0000","last_fullsized":"2023-07-21T22:32:00.936147+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.951555+0000","last_change":"2023-07-21T22:32:00.946873+0000","last_active":"2023-07-21T22:32:00.951555+0000","last_peered":"2023-07-21T22:32:00.951555+0000","last_clean":"2023-07-21T22:32:00.951555+0000","last_became_active":"2023-07-21T22:32:00.946537+0000","last_became_peered":"2023-07-21T22:32:00.946537+0000","last_unstale":"2023-07-21T22:32:00.951555+0000","last_undegraded":"2023-07-21T22:32:00.951555+0000","last_fullsized":"2023-07-21T22:32:00.951555+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:09.629226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941276+0000","last_change":"2023-07-21T22:32:00.941276+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941276+0000","last_undegraded":"2023-07-21T22:32:00.941276+0000","last_fullsized":"2023-07-21T22:32:00.941276+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.953565+0000","last_change":"2023-07-21T22:32:00.943926+0000","last_active":"2023-07-21T22:32:00.953565+0000","last_peered":"2023-07-21T22:32:00.953565+0000","last_clean":"2023-07-21T22:32:00.953565+0000","last_became_active":"2023-07-21T22:32:00.943551+0000","last_became_peered":"2023-07-21T22:32:00.943551+0000","last_unstale":"2023-07-21T22:32:00.953565+0000","last_undegraded":"2023-07-21T22:32:00.953565+0000","last_fullsized":"2023-07-21T22:32:00.953565+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:53:58.981346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.935715+0000","last_change":"2023-07-21T22:32:00.935715+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.935715+0000","last_undegraded":"2023-07-21T22:32:00.935715+0000","last_fullsized":"2023-07-21T22:32:00.935715+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.954655+0000","last_change":"2023-07-21T22:32:00.949051+0000","last_active":"2023-07-21T22:32:00.954655+0000","last_peered":"2023-07-21T22:32:00.954655+0000","last_clean":"2023-07-21T22:32:00.954655+0000","last_became_active":"2023-07-21T22:32:00.948748+0000","last_became_peered":"2023-07-21T22:32:00.948748+0000","last_unstale":"2023-07-21T22:32:00.954655+0000","last_undegraded":"2023-07-21T22:32:00.954655+0000","last_fullsized":"2023-07-21T22:32:00.954655+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:52:54.611034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.938361+0000","last_change":"2023-07-21T22:32:00.938361+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.938361+0000","last_undegraded":"2023-07-21T22:32:00.938361+0000","last_fullsized":"2023-07-21T22:32:00.938361+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.949581+0000","last_change":"2023-07-21T22:32:00.944727+0000","last_active":"2023-07-21T22:32:00.949581+0000","last_peered":"2023-07-21T22:32:00.949581+0000","last_clean":"2023-07-21T22:32:00.949581+0000","last_became_active":"2023-07-21T22:32:00.944461+0000","last_became_peered":"2023-07-21T22:32:00.944461+0000","last_unstale":"2023-07-21T22:32:00.949581+0000","last_undegraded":"2023-07-21T22:32:00.949581+0000","last_fullsized":"2023-07-21T22:32:00.949581+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:00:22.685969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939507+0000","last_change":"2023-07-21T22:32:00.939507+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939507+0000","last_undegraded":"2023-07-21T22:32:00.939507+0000","last_fullsized":"2023-07-21T22:32:00.939507+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.951171+0000","last_change":"2023-07-21T22:32:00.947839+0000","last_active":"2023-07-21T22:32:00.951171+0000","last_peered":"2023-07-21T22:32:00.951171+0000","last_clean":"2023-07-21T22:32:00.951171+0000","last_became_active":"2023-07-21T22:32:00.947416+0000","last_became_peered":"2023-07-21T22:32:00.947416+0000","last_unstale":"2023-07-21T22:32:00.951171+0000","last_undegraded":"2023-07-21T22:32:00.951171+0000","last_fullsized":"2023-07-21T22:32:00.951171+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:52:02.423090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'139","reported_seq":327,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.940683+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:32:00.940683+0000","last_peered":"2023-07-21T22:32:00.940683+0000","last_clean":"2023-07-21T22:32:00.940683+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:32:00.940683+0000","last_undegraded":"2023-07-21T22:32:00.940683+0000","last_fullsized":"2023-07-21T22:32:00.940683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:11:53.150494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":101,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.937864+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:32:00.937864+0000","last_peered":"2023-07-21T22:32:00.937864+0000","last_clean":"2023-07-21T22:32:00.937864+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:32:00.937864+0000","last_undegraded":"2023-07-21T22:32:00.937864+0000","last_fullsized":"2023-07-21T22:32:00.937864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:55:12.047847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940048+0000","last_change":"2023-07-21T22:32:00.940048+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940048+0000","last_undegraded":"2023-07-21T22:32:00.940048+0000","last_fullsized":"2023-07-21T22:32:00.940048+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.956861+0000","last_change":"2023-07-21T22:32:00.955530+0000","last_active":"2023-07-21T22:32:00.956861+0000","last_peered":"2023-07-21T22:32:00.956861+0000","last_clean":"2023-07-21T22:32:00.956861+0000","last_became_active":"2023-07-21T22:32:00.955208+0000","last_became_peered":"2023-07-21T22:32:00.955208+0000","last_unstale":"2023-07-21T22:32:00.956861+0000","last_undegraded":"2023-07-21T22:32:00.956861+0000","last_fullsized":"2023-07-21T22:32:00.956861+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:30:23.544614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":93,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.940556+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:32:00.940556+0000","last_peered":"2023-07-21T22:32:00.940556+0000","last_clean":"2023-07-21T22:32:00.940556+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:32:00.940556+0000","last_undegraded":"2023-07-21T22:32:00.940556+0000","last_fullsized":"2023-07-21T22:32:00.940556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:48.875424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941933+0000","last_change":"2023-07-21T22:32:00.941933+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941933+0000","last_undegraded":"2023-07-21T22:32:00.941933+0000","last_fullsized":"2023-07-21T22:32:00.941933+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.951232+0000","last_change":"2023-07-21T22:32:00.947085+0000","last_active":"2023-07-21T22:32:00.951232+0000","last_peered":"2023-07-21T22:32:00.951232+0000","last_clean":"2023-07-21T22:32:00.951232+0000","last_became_active":"2023-07-21T22:32:00.946461+0000","last_became_peered":"2023-07-21T22:32:00.946461+0000","last_unstale":"2023-07-21T22:32:00.951232+0000","last_undegraded":"2023-07-21T22:32:00.951232+0000","last_fullsized":"2023-07-21T22:32:00.951232+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:14:15.195255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":91,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.936597+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:32:00.936597+0000","last_peered":"2023-07-21T22:32:00.936597+0000","last_clean":"2023-07-21T22:32:00.936597+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:32:00.936597+0000","last_undegraded":"2023-07-21T22:32:00.936597+0000","last_fullsized":"2023-07-21T22:32:00.936597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:42.565432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936152+0000","last_change":"2023-07-21T22:32:00.936152+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936152+0000","last_undegraded":"2023-07-21T22:32:00.936152+0000","last_fullsized":"2023-07-21T22:32:00.936152+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.958746+0000","last_change":"2023-07-21T22:32:00.955354+0000","last_active":"2023-07-21T22:32:00.958746+0000","last_peered":"2023-07-21T22:32:00.958746+0000","last_clean":"2023-07-21T22:32:00.958746+0000","last_became_active":"2023-07-21T22:32:00.954992+0000","last_became_peered":"2023-07-21T22:32:00.954992+0000","last_unstale":"2023-07-21T22:32:00.958746+0000","last_undegraded":"2023-07-21T22:32:00.958746+0000","last_fullsized":"2023-07-21T22:32:00.958746+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:04:18.396523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":101,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.937912+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:32:00.937912+0000","last_peered":"2023-07-21T22:32:00.937912+0000","last_clean":"2023-07-21T22:32:00.937912+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:32:00.937912+0000","last_undegraded":"2023-07-21T22:32:00.937912+0000","last_fullsized":"2023-07-21T22:32:00.937912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:28:18.043637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936271+0000","last_change":"2023-07-21T22:32:00.936271+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936271+0000","last_undegraded":"2023-07-21T22:32:00.936271+0000","last_fullsized":"2023-07-21T22:32:00.936271+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.961335+0000","last_change":"2023-07-21T22:32:00.957850+0000","last_active":"2023-07-21T22:32:00.961335+0000","last_peered":"2023-07-21T22:32:00.961335+0000","last_clean":"2023-07-21T22:32:00.961335+0000","last_became_active":"2023-07-21T22:32:00.957501+0000","last_became_peered":"2023-07-21T22:32:00.957501+0000","last_unstale":"2023-07-21T22:32:00.961335+0000","last_undegraded":"2023-07-21T22:32:00.961335+0000","last_fullsized":"2023-07-21T22:32:00.961335+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:43:24.943153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.944285+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:32:00.944285+0000","last_peered":"2023-07-21T22:32:00.944285+0000","last_clean":"2023-07-21T22:32:00.944285+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:32:00.944285+0000","last_undegraded":"2023-07-21T22:32:00.944285+0000","last_fullsized":"2023-07-21T22:32:00.944285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:13:05.154378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942001+0000","last_change":"2023-07-21T22:32:00.942001+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942001+0000","last_undegraded":"2023-07-21T22:32:00.942001+0000","last_fullsized":"2023-07-21T22:32:00.942001+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.956368+0000","last_change":"2023-07-21T22:32:00.954255+0000","last_active":"2023-07-21T22:32:00.956368+0000","last_peered":"2023-07-21T22:32:00.956368+0000","last_clean":"2023-07-21T22:32:00.956368+0000","last_became_active":"2023-07-21T22:32:00.953914+0000","last_became_peered":"2023-07-21T22:32:00.953914+0000","last_unstale":"2023-07-21T22:32:00.956368+0000","last_undegraded":"2023-07-21T22:32:00.956368+0000","last_fullsized":"2023-07-21T22:32:00.956368+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:47:25.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.944284+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:32:00.944284+0000","last_peered":"2023-07-21T22:32:00.944284+0000","last_clean":"2023-07-21T22:32:00.944284+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:32:00.944284+0000","last_undegraded":"2023-07-21T22:32:00.944284+0000","last_fullsized":"2023-07-21T22:32:00.944284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:35:37.561916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.932429+0000","last_change":"2023-07-21T22:32:00.932429+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.932429+0000","last_undegraded":"2023-07-21T22:32:00.932429+0000","last_fullsized":"2023-07-21T22:32:00.932429+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.953917+0000","last_change":"2023-07-21T22:32:00.945223+0000","last_active":"2023-07-21T22:32:00.953917+0000","last_peered":"2023-07-21T22:32:00.953917+0000","last_clean":"2023-07-21T22:32:00.953917+0000","last_became_active":"2023-07-21T22:32:00.944958+0000","last_became_peered":"2023-07-21T22:32:00.944958+0000","last_unstale":"2023-07-21T22:32:00.953917+0000","last_undegraded":"2023-07-21T22:32:00.953917+0000","last_fullsized":"2023-07-21T22:32:00.953917+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:02:35.145130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.944500+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:32:00.944500+0000","last_peered":"2023-07-21T22:32:00.944500+0000","last_clean":"2023-07-21T22:32:00.944500+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:32:00.944500+0000","last_undegraded":"2023-07-21T22:32:00.944500+0000","last_fullsized":"2023-07-21T22:32:00.944500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:26:00.376064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936183+0000","last_change":"2023-07-21T22:32:00.936183+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936183+0000","last_undegraded":"2023-07-21T22:32:00.936183+0000","last_fullsized":"2023-07-21T22:32:00.936183+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.954771+0000","last_change":"2023-07-21T22:32:00.951682+0000","last_active":"2023-07-21T22:32:00.954771+0000","last_peered":"2023-07-21T22:32:00.954771+0000","last_clean":"2023-07-21T22:32:00.954771+0000","last_became_active":"2023-07-21T22:32:00.951375+0000","last_became_peered":"2023-07-21T22:32:00.951375+0000","last_unstale":"2023-07-21T22:32:00.954771+0000","last_undegraded":"2023-07-21T22:32:00.954771+0000","last_fullsized":"2023-07-21T22:32:00.954771+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:16:13.181692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.942461+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:32:00.942461+0000","last_peered":"2023-07-21T22:32:00.942461+0000","last_clean":"2023-07-21T22:32:00.942461+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:32:00.942461+0000","last_undegraded":"2023-07-21T22:32:00.942461+0000","last_fullsized":"2023-07-21T22:32:00.942461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:35:08.506245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509604,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54520,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317320,"statfs":{"total":96636764160,"available":96580935680,"internally_reserved":0,"allocated":1359872,"data_stored":959326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.72899999999999998,"15min":0.72399999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.32600000000000001},"max":{"1min":0.91700000000000004,"5min":0.95699999999999996,"15min":1.28},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.68899999999999995,"15min":0.67800000000000005},"min":{"1min":0.436,"5min":0.39500000000000002,"15min":0.36099999999999999},"max":{"1min":0.82099999999999995,"5min":0.98399999999999999,"15min":1.131},"last":0.82099999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.379},"max":{"1min":0.877,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71999999999999997,"15min":0.71399999999999997},"min":{"1min":0.47599999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.873,"5min":1.0129999999999999,"15min":1.0409999999999999},"last":0.873}]},{"osd":2,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.749,"15min":0.73999999999999999},"min":{"1min":0.51300000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96099999999999997,"5min":0.97099999999999997,"15min":1.405},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.74299999999999999,"15min":0.751},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97699999999999998,"5min":1.0629999999999999,"15min":1.087},"last":0.86499999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.42099999999999999},"max":{"1min":0.86899999999999999,"5min":1.0189999999999999,"15min":1.2230000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.755,"15min":0.753},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.92300000000000004,"5min":0.95199999999999996,"15min":1.0189999999999999},"last":0.92300000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55200000000000005,"15min":0.57599999999999996},"min":{"1min":0.38,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":1.244},"last":0.5},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.64000000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90400000000000003,"5min":1.0309999999999999,"15min":1.3999999999999999},"last":0.57799999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.47499999999999998,"5min":0.41399999999999998,"15min":0.40300000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.98599999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65900000000000003,"15min":0.69199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.93400000000000005,"5min":0.94199999999999995,"15min":1.0129999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.5,"5min":0.46500000000000002,"15min":0.44400000000000001},"max":{"1min":0.877,"5min":0.98599999999999999,"15min":1.048},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.63,"15min":0.65100000000000002},"min":{"1min":0.434,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":0.90400000000000003,"5min":0.91300000000000003,"15min":0.98599999999999999},"last":0.85599999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542310,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":368958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78500000000000003,"15min":0.75600000000000001},"min":{"1min":0.621,"5min":0.39800000000000002,"15min":0.36599999999999999},"max":{"1min":0.93400000000000005,"5min":0.95499999999999996,"15min":1.425},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.65600000000000003,"5min":0.60399999999999998,"15min":0.437},"max":{"1min":0.95199999999999996,"5min":1.0329999999999999,"15min":2.3100000000000001},"last":0.82099999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73899999999999999,"15min":0.71299999999999997},"min":{"1min":0.495,"5min":0.45300000000000001,"15min":0.41999999999999998},"max":{"1min":0.86799999999999999,"5min":0.97099999999999997,"15min":1.022},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74099999999999999,"15min":0.82399999999999995},"min":{"1min":0.64800000000000002,"5min":0.46000000000000002,"15min":0.34399999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":8.6280000000000001},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.60499999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93700000000000006,"5min":0.997,"15min":1.55},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.79000000000000004},"min":{"1min":0.69999999999999996,"5min":0.54700000000000004,"15min":0.45500000000000002},"max":{"1min":0.97199999999999998,"5min":1.0149999999999999,"15min":1.016},"last":0.88900000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.57399999999999995,"5min":0.51400000000000001,"15min":0.5},"max":{"1min":0.90200000000000002,"5min":0.97799999999999998,"15min":1.7470000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.53100000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91700000000000004,"5min":0.95799999999999996,"15min":1.5129999999999999},"last":0.86799999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.627},"min":{"1min":0.433,"5min":0.40600000000000003,"15min":0.36599999999999999},"max":{"1min":0.86399999999999999,"5min":0.97999999999999998,"15min":3.1829999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63400000000000001,"15min":0.66300000000000003},"min":{"1min":0.48599999999999999,"5min":0.41399999999999998,"15min":0.39700000000000002},"max":{"1min":0.85199999999999998,"5min":1.0209999999999999,"15min":2.887},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.62,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78800000000000003,"5min":0.93799999999999994,"15min":1.4510000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67300000000000004,"15min":0.67600000000000005},"min":{"1min":0.54600000000000004,"5min":0.45300000000000001,"15min":0.39400000000000002},"max":{"1min":0.83299999999999996,"5min":1.0389999999999999,"15min":1.054},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.70099999999999996},"min":{"1min":0.51800000000000002,"5min":0.46899999999999997,"15min":0.443},"max":{"1min":0.94599999999999995,"5min":0.99099999999999999,"15min":1.1679999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.79100000000000004},"min":{"1min":0.51800000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88300000000000001,"5min":0.97999999999999998,"15min":8.0760000000000005},"last":0.90800000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509603,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":765952,"data_stored":368958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.73299999999999998,"15min":0.70799999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32900000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71099999999999997,"15min":0.71599999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.745}]},{"osd":1,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.71299999999999997,"15min":0.70999999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.90600000000000003,"5min":0.95799999999999996,"15min":1.0009999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73599999999999999,"15min":0.72999999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.69699999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.42999999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.034},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.79000000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78800000000000003,"15min":0.78500000000000003},"min":{"1min":0.56000000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81299999999999994,"15min":0.79800000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.91100000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57799999999999996,"15min":0.56399999999999995},"min":{"1min":0.41099999999999998,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.443},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68300000000000005,"15min":0.69199999999999995},"min":{"1min":0.52200000000000002,"5min":0.502,"15min":0.44900000000000001},"max":{"1min":0.84199999999999997,"5min":0.97499999999999998,"15min":1.038},"last":0.55900000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60599999999999998,"15min":0.60899999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.64100000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63800000000000001,"15min":0.65900000000000003},"min":{"1min":0.46300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.85499999999999998,"5min":0.96199999999999997,"15min":0.97699999999999998},"last":0.502},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.73799999999999999,"15min":0.72699999999999998},"min":{"1min":0.54000000000000004,"5min":0.52100000000000002,"15min":0.439},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.67000000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509604,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":368958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.75800000000000001,"15min":0.74199999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.40000000000000002},"max":{"1min":0.89400000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.747,"15min":0.74299999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92000000000000004,"5min":0.96099999999999997,"15min":0.99099999999999999},"last":0.69199999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70999999999999996,"15min":0.69799999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.39400000000000002},"max":{"1min":0.89100000000000001,"5min":1.002,"15min":1.0449999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71399999999999997,"15min":0.69399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86299999999999999,"5min":0.96399999999999997,"15min":1.016},"last":0.71499999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77900000000000003,"15min":0.76800000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.042},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.77300000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.33000000000000002},"max":{"1min":0.96399999999999997,"5min":1,"15min":1.0589999999999999},"last":0.755}]},{"osd":3,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97199999999999998,"5min":1.0169999999999999,"15min":1.026},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79600000000000004,"15min":0.78700000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.93000000000000005,"5min":0.99099999999999999,"15min":1.018},"last":0.82399999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.58299999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81599999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57099999999999995,"15min":0.60099999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.0680000000000001},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64200000000000002,"15min":0.65400000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.38500000000000001},"max":{"1min":0.91000000000000003,"5min":0.92200000000000004,"15min":0.96699999999999997},"last":0.875},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69899999999999995,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98999999999999999,"5min":0.997,"15min":1.272},"last":0.84899999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.627,"15min":0.67200000000000004},"min":{"1min":0.439,"5min":0.39200000000000002,"15min":0.374},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.3300000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.67800000000000005,"15min":0.70599999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95699999999999996,"5min":0.97999999999999998,"15min":1.135},"last":0.91300000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509603,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":368958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.29099999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.68400000000000005,"5min":0.749,"15min":0.76400000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.41099999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.436}]},{"osd":1,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.48199999999999998,"15min":0.47399999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.30099999999999999},"max":{"1min":0.69199999999999995,"5min":0.83499999999999996,"15min":0.871},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72299999999999998,"5min":0.86399999999999999,"15min":0.94199999999999995},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.57199999999999995,"15min":0.54600000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66700000000000004,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61599999999999999,"15min":0.59399999999999997},"min":{"1min":0.45100000000000001,"5min":0.41499999999999998,"15min":0.40999999999999998},"max":{"1min":0.69199999999999995,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.505}]},{"osd":4,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.438},"max":{"1min":0.91400000000000003,"5min":1.0620000000000001,"15min":1.3240000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.01,"5min":1.0569999999999999,"15min":1.488},"last":0.622}]},{"osd":5,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.90600000000000003,"5min":1.137,"15min":1.1919999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.048,"5min":1.081,"15min":1.302},"last":0.54500000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93500000000000005,"5min":1.056,"15min":1.3979999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.49399999999999999},"max":{"1min":0.98499999999999999,"5min":1.0740000000000001,"15min":1.3899999999999999},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.82299999999999995,"15min":0.82899999999999996},"min":{"1min":0.53400000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0780000000000001,"5min":1.097,"15min":1.335},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.83799999999999997,"15min":0.82899999999999996},"min":{"1min":0.58999999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.2130000000000001},"last":0.65800000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509605,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53928,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317912,"statfs":{"total":96636764160,"available":96581541888,"internally_reserved":0,"allocated":753664,"data_stored":362286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48399999999999999,"15min":0.47099999999999997},"min":{"1min":0.315,"5min":0.29799999999999999,"15min":0.23899999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.94199999999999995},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56599999999999995,"15min":0.54100000000000004},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36599999999999999},"max":{"1min":0.76000000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.47199999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55300000000000005,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.34499999999999997,"15min":0.28199999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59899999999999998,"15min":0.57699999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80600000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.439}]},{"osd":3,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.48499999999999999,"15min":0.47699999999999998},"min":{"1min":0.35699999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61399999999999999,"5min":0.73499999999999999,"15min":0.748},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41099999999999998,"5min":0.38900000000000001,"15min":0.34100000000000003},"max":{"1min":0.74099999999999999,"5min":0.82499999999999996,"15min":0.93100000000000005},"last":0.41899999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82699999999999996,"15min":0.80200000000000005},"min":{"1min":0.56899999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.6870000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82899999999999996,"15min":0.80400000000000005},"min":{"1min":0.58299999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.2689999999999999},"last":0.77400000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81999999999999995,"15min":0.79600000000000004},"min":{"1min":0.57799999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.026,"5min":1.169,"15min":1.2549999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.81200000000000006},"min":{"1min":0.58399999999999996,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.171,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.74099999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.81999999999999995,"15min":0.80300000000000005},"min":{"1min":0.55400000000000005,"5min":0.44900000000000001,"15min":0.40300000000000002},"max":{"1min":1.0940000000000001,"5min":1.2,"15min":1.3759999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.873,"5min":0.84399999999999997,"15min":0.81100000000000005},"min":{"1min":0.66100000000000003,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.23,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84799999999999998,"15min":0.83099999999999996},"min":{"1min":0.60099999999999998,"5min":0.51100000000000001,"15min":0.49099999999999999},"max":{"1min":1.1140000000000001,"5min":1.214,"15min":1.2909999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84099999999999997,"15min":0.81999999999999995},"min":{"1min":0.63100000000000001,"5min":0.44900000000000001,"15min":0.44700000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.3660000000000001},"last":0.66900000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509604,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":753664,"data_stored":362286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.47199999999999998,"15min":0.53900000000000003},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59599999999999997,"5min":0.84599999999999997,"15min":5.4800000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56200000000000006,"15min":0.61499999999999999},"min":{"1min":0.41099999999999998,"5min":0.377,"15min":0.36099999999999999},"max":{"1min":0.76700000000000002,"5min":0.872,"15min":5.2830000000000004},"last":0.46899999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.505,"15min":0.53700000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.64900000000000002,"5min":0.76100000000000001,"15min":3.4220000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.52400000000000002,"15min":0.53600000000000003},"min":{"1min":0.35199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.88800000000000001},"last":0.377}]},{"osd":3,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.58999999999999997,"15min":0.626},"min":{"1min":0.35799999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81599999999999995,"5min":0.86599999999999999,"15min":3.2469999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.51000000000000001,"15min":0.56999999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71799999999999997,"5min":0.77300000000000002,"15min":5.8710000000000004},"last":0.42799999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.80900000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89500000000000002,"5min":1.1930000000000001,"15min":3.6259999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78200000000000003,"15min":0.83499999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.91300000000000003,"5min":1.083,"15min":4.4100000000000001},"last":0.64200000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.77600000000000002,"15min":0.83999999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96599999999999997,"5min":1.115,"15min":5.766},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.78700000000000003,"15min":0.82599999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90400000000000003,"5min":1.2849999999999999,"15min":3.669},"last":0.70299999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95199999999999996,"5min":1.147,"15min":1.23},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77800000000000002,"15min":0.85499999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93600000000000005,"5min":1.3240000000000001,"15min":5.8200000000000003},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.79200000000000004,"15min":0.86499999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.872,"5min":1.244,"15min":5.9269999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79200000000000004,"15min":0.84299999999999997},"min":{"1min":0.52600000000000002,"5min":0.48599999999999999,"15min":0.45700000000000002},"max":{"1min":0.93400000000000005,"5min":1.3380000000000001,"15min":3.5800000000000001},"last":0.622}]}]},{"osd":0,"up_from":15,"seq":64424509606,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1359872,"data_stored":959326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.32500000000000001,"5min":0.29999999999999999,"15min":0.28000000000000003},"max":{"1min":0.754,"5min":0.81000000000000005,"15min":0.91100000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53700000000000003,"15min":0.49399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.28599999999999998},"max":{"1min":0.72699999999999998,"5min":0.77800000000000002,"15min":0.83199999999999996},"last":0.434}]},{"osd":2,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54300000000000004,"15min":0.51700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.32200000000000001},"max":{"1min":0.72799999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53800000000000003,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.33700000000000002,"15min":0.33000000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.41799999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60499999999999998,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84499999999999997,"5min":0.88100000000000001,"15min":0.91300000000000003},"last":0.499},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.53600000000000003},"min":{"1min":0.40699999999999997,"5min":0.40200000000000002,"15min":0.35599999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.85699999999999998},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.79100000000000004,"15min":0.79200000000000004},"min":{"1min":0.52700000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0760000000000001,"5min":1.1559999999999999,"15min":1.321},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.81100000000000005,"15min":0.80200000000000005},"min":{"1min":0.57799999999999996,"5min":0.52800000000000002,"15min":0.48999999999999999},"max":{"1min":1.0880000000000001,"5min":1.423,"15min":1.423},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78300000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.107,"5min":1.2669999999999999,"15min":1.28},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82599999999999996,"15min":0.81799999999999995},"min":{"1min":0.59799999999999998,"5min":0.53700000000000003,"15min":0.50700000000000001},"max":{"1min":1.0329999999999999,"5min":1.254,"15min":1.393},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.82099999999999995,"15min":0.81699999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0820000000000001,"5min":1.2290000000000001,"15min":1.28},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84199999999999997,"15min":0.82499999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.57599999999999996},"max":{"1min":1.147,"5min":1.333,"15min":1.333},"last":0.82499999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80100000000000005,"15min":0.79900000000000004},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.54000000000000004},"max":{"1min":1.087,"5min":1.121,"15min":1.2310000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85499999999999998,"15min":0.84199999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.101,"5min":1.296,"15min":1.369},"last":0.61199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:32:06.886 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3f is not active+clean 2023-07-21T22:32:06.886 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.939046+0000', 'last_change': '2023-07-21T22:32:00.939046+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.939046+0000', 'last_undegraded': '2023-07-21T22:32:00.939046+0000', 'last_fullsized': '2023-07-21T22:32:00.939046+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:32:06.888 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2023-07-21T22:32:06.888 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.940135+0000', 'last_change': '2023-07-21T22:32:00.940135+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.940135+0000', 'last_undegraded': '2023-07-21T22:32:00.940135+0000', 'last_fullsized': '2023-07-21T22:32:00.940135+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:32:06.889 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2023-07-21T22:32:06.890 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.935591+0000', 'last_change': '2023-07-21T22:32:00.935591+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.935591+0000', 'last_undegraded': '2023-07-21T22:32:00.935591+0000', 'last_fullsized': '2023-07-21T22:32:00.935591+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:32:06.890 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2023-07-21T22:32:06.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.939384+0000', 'last_change': '2023-07-21T22:32:00.939384+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.939384+0000', 'last_undegraded': '2023-07-21T22:32:00.939384+0000', 'last_fullsized': '2023-07-21T22:32:00.939384+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:32:06.891 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2023-07-21T22:32:06.891 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.945092+0000', 'last_change': '2023-07-21T22:32:00.945092+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.945092+0000', 'last_undegraded': '2023-07-21T22:32:00.945092+0000', 'last_fullsized': '2023-07-21T22:32:00.945092+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:32:06.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2023-07-21T22:32:06.892 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.940528+0000', 'last_change': '2023-07-21T22:32:00.940528+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.940528+0000', 'last_undegraded': '2023-07-21T22:32:00.940528+0000', 'last_fullsized': '2023-07-21T22:32:00.940528+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:32:06.892 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2023-07-21T22:32:06.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.931463+0000', 'last_change': '2023-07-21T22:32:00.931463+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.931463+0000', 'last_undegraded': '2023-07-21T22:32:00.931463+0000', 'last_fullsized': '2023-07-21T22:32:00.931463+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:32:06.893 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2023-07-21T22:32:06.893 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.943332+0000', 'last_change': '2023-07-21T22:32:00.943332+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.943332+0000', 'last_undegraded': '2023-07-21T22:32:00.943332+0000', 'last_fullsized': '2023-07-21T22:32:00.943332+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:32:06.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2023-07-21T22:32:06.894 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.943669+0000', 'last_change': '2023-07-21T22:32:00.943669+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.943669+0000', 'last_undegraded': '2023-07-21T22:32:00.943669+0000', 'last_fullsized': '2023-07-21T22:32:00.943669+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:32:06.894 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2023-07-21T22:32:06.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.942369+0000', 'last_change': '2023-07-21T22:32:00.942369+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.942369+0000', 'last_undegraded': '2023-07-21T22:32:00.942369+0000', 'last_fullsized': '2023-07-21T22:32:00.942369+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:32:06.895 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2023-07-21T22:32:06.895 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.933108+0000', 'last_change': '2023-07-21T22:32:00.933108+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.933108+0000', 'last_undegraded': '2023-07-21T22:32:00.933108+0000', 'last_fullsized': '2023-07-21T22:32:00.933108+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:32:06.896 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2023-07-21T22:32:06.896 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.943642+0000', 'last_change': '2023-07-21T22:32:00.943642+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.943642+0000', 'last_undegraded': '2023-07-21T22:32:00.943642+0000', 'last_fullsized': '2023-07-21T22:32:00.943642+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:32:06.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2023-07-21T22:32:06.897 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.939463+0000', 'last_change': '2023-07-21T22:32:00.939463+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.939463+0000', 'last_undegraded': '2023-07-21T22:32:00.939463+0000', 'last_fullsized': '2023-07-21T22:32:00.939463+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:32:06.897 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2023-07-21T22:32:06.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.931137+0000', 'last_change': '2023-07-21T22:32:00.931137+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.931137+0000', 'last_undegraded': '2023-07-21T22:32:00.931137+0000', 'last_fullsized': '2023-07-21T22:32:00.931137+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:32:06.898 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2023-07-21T22:32:06.898 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.940920+0000', 'last_change': '2023-07-21T22:32:00.940920+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.940920+0000', 'last_undegraded': '2023-07-21T22:32:00.940920+0000', 'last_fullsized': '2023-07-21T22:32:00.940920+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:32:06.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2023-07-21T22:32:06.899 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.941617+0000', 'last_change': '2023-07-21T22:32:00.941617+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.941617+0000', 'last_undegraded': '2023-07-21T22:32:00.941617+0000', 'last_fullsized': '2023-07-21T22:32:00.941617+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:32:06.899 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2023-07-21T22:32:06.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.934576+0000', 'last_change': '2023-07-21T22:32:00.934576+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.934576+0000', 'last_undegraded': '2023-07-21T22:32:00.934576+0000', 'last_fullsized': '2023-07-21T22:32:00.934576+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:32:06.900 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2023-07-21T22:32:06.900 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.939627+0000', 'last_change': '2023-07-21T22:32:00.939627+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.939627+0000', 'last_undegraded': '2023-07-21T22:32:00.939627+0000', 'last_fullsized': '2023-07-21T22:32:00.939627+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:32:06.901 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2023-07-21T22:32:06.901 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.935124+0000', 'last_change': '2023-07-21T22:32:00.935124+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.935124+0000', 'last_undegraded': '2023-07-21T22:32:00.935124+0000', 'last_fullsized': '2023-07-21T22:32:00.935124+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:32:06.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2023-07-21T22:32:06.902 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.940067+0000', 'last_change': '2023-07-21T22:32:00.940067+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.940067+0000', 'last_undegraded': '2023-07-21T22:32:00.940067+0000', 'last_fullsized': '2023-07-21T22:32:00.940067+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:32:06.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2023-07-21T22:32:06.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.939390+0000', 'last_change': '2023-07-21T22:32:00.939390+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.939390+0000', 'last_undegraded': '2023-07-21T22:32:00.939390+0000', 'last_fullsized': '2023-07-21T22:32:00.939390+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:32:06.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2023-07-21T22:32:06.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.942199+0000', 'last_change': '2023-07-21T22:32:00.942199+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.942199+0000', 'last_undegraded': '2023-07-21T22:32:00.942199+0000', 'last_fullsized': '2023-07-21T22:32:00.942199+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:32:06.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2023-07-21T22:32:06.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.934188+0000', 'last_change': '2023-07-21T22:32:00.934188+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.934188+0000', 'last_undegraded': '2023-07-21T22:32:00.934188+0000', 'last_fullsized': '2023-07-21T22:32:00.934188+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:32:06.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2023-07-21T22:32:06.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.932446+0000', 'last_change': '2023-07-21T22:32:00.932446+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.932446+0000', 'last_undegraded': '2023-07-21T22:32:00.932446+0000', 'last_fullsized': '2023-07-21T22:32:00.932446+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:32:06.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2023-07-21T22:32:06.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.934081+0000', 'last_change': '2023-07-21T22:32:00.934081+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.934081+0000', 'last_undegraded': '2023-07-21T22:32:00.934081+0000', 'last_fullsized': '2023-07-21T22:32:00.934081+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:32:06.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2023-07-21T22:32:06.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.942891+0000', 'last_change': '2023-07-21T22:32:00.942891+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.942891+0000', 'last_undegraded': '2023-07-21T22:32:00.942891+0000', 'last_fullsized': '2023-07-21T22:32:00.942891+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:32:06.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2023-07-21T22:32:06.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.941426+0000', 'last_change': '2023-07-21T22:32:00.941426+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.941426+0000', 'last_undegraded': '2023-07-21T22:32:00.941426+0000', 'last_fullsized': '2023-07-21T22:32:00.941426+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:32:06.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2023-07-21T22:32:06.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.939540+0000', 'last_change': '2023-07-21T22:32:00.939540+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.939540+0000', 'last_undegraded': '2023-07-21T22:32:00.939540+0000', 'last_fullsized': '2023-07-21T22:32:00.939540+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:32:06.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2023-07-21T22:32:06.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.931313+0000', 'last_change': '2023-07-21T22:32:00.931313+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.931313+0000', 'last_undegraded': '2023-07-21T22:32:00.931313+0000', 'last_fullsized': '2023-07-21T22:32:00.931313+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:32:06.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2023-07-21T22:32:06.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.942556+0000', 'last_change': '2023-07-21T22:32:00.942556+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.942556+0000', 'last_undegraded': '2023-07-21T22:32:00.942556+0000', 'last_fullsized': '2023-07-21T22:32:00.942556+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:32:06.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2023-07-21T22:32:06.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.930989+0000', 'last_change': '2023-07-21T22:32:00.930989+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.930989+0000', 'last_undegraded': '2023-07-21T22:32:00.930989+0000', 'last_fullsized': '2023-07-21T22:32:00.930989+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:32:06.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.20 is not active+clean 2023-07-21T22:32:06.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.937353+0000', 'last_change': '2023-07-21T22:32:00.937353+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.937353+0000', 'last_undegraded': '2023-07-21T22:32:00.937353+0000', 'last_fullsized': '2023-07-21T22:32:00.937353+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:32:06.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-07-21T22:32:06.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.940212+0000', 'last_change': '2023-07-21T22:32:00.940212+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.940212+0000', 'last_undegraded': '2023-07-21T22:32:00.940212+0000', 'last_fullsized': '2023-07-21T22:32:00.940212+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:32:06.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-07-21T22:32:06.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.936126+0000', 'last_change': '2023-07-21T22:32:00.936126+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.936126+0000', 'last_undegraded': '2023-07-21T22:32:00.936126+0000', 'last_fullsized': '2023-07-21T22:32:00.936126+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:32:06.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-07-21T22:32:06.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.939148+0000', 'last_change': '2023-07-21T22:32:00.939148+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.939148+0000', 'last_undegraded': '2023-07-21T22:32:00.939148+0000', 'last_fullsized': '2023-07-21T22:32:00.939148+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:32:06.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-07-21T22:32:06.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.942728+0000', 'last_change': '2023-07-21T22:32:00.942728+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.942728+0000', 'last_undegraded': '2023-07-21T22:32:00.942728+0000', 'last_fullsized': '2023-07-21T22:32:00.942728+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:32:06.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-07-21T22:32:06.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.944136+0000', 'last_change': '2023-07-21T22:32:00.944136+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.944136+0000', 'last_undegraded': '2023-07-21T22:32:00.944136+0000', 'last_fullsized': '2023-07-21T22:32:00.944136+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:32:06.915 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-07-21T22:32:06.915 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.940650+0000', 'last_change': '2023-07-21T22:32:00.940650+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.940650+0000', 'last_undegraded': '2023-07-21T22:32:00.940650+0000', 'last_fullsized': '2023-07-21T22:32:00.940650+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:32:06.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-07-21T22:32:06.916 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.941817+0000', 'last_change': '2023-07-21T22:32:00.941817+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.941817+0000', 'last_undegraded': '2023-07-21T22:32:00.941817+0000', 'last_fullsized': '2023-07-21T22:32:00.941817+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:32:06.916 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-07-21T22:32:06.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.939246+0000', 'last_change': '2023-07-21T22:32:00.939246+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.939246+0000', 'last_undegraded': '2023-07-21T22:32:00.939246+0000', 'last_fullsized': '2023-07-21T22:32:00.939246+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:32:06.917 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-07-21T22:32:06.917 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.942335+0000', 'last_change': '2023-07-21T22:32:00.942335+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.942335+0000', 'last_undegraded': '2023-07-21T22:32:00.942335+0000', 'last_fullsized': '2023-07-21T22:32:00.942335+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:32:06.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-07-21T22:32:06.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.937205+0000', 'last_change': '2023-07-21T22:32:00.937205+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.937205+0000', 'last_undegraded': '2023-07-21T22:32:00.937205+0000', 'last_fullsized': '2023-07-21T22:32:00.937205+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:32:06.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-07-21T22:32:06.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.930588+0000', 'last_change': '2023-07-21T22:32:00.930588+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.930588+0000', 'last_undegraded': '2023-07-21T22:32:00.930588+0000', 'last_fullsized': '2023-07-21T22:32:00.930588+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:32:06.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-07-21T22:32:06.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.942555+0000', 'last_change': '2023-07-21T22:32:00.942555+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.942555+0000', 'last_undegraded': '2023-07-21T22:32:00.942555+0000', 'last_fullsized': '2023-07-21T22:32:00.942555+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:32:06.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-07-21T22:32:06.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.936876+0000', 'last_change': '2023-07-21T22:32:00.936876+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.936876+0000', 'last_undegraded': '2023-07-21T22:32:00.936876+0000', 'last_fullsized': '2023-07-21T22:32:00.936876+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:32:06.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-07-21T22:32:06.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.934363+0000', 'last_change': '2023-07-21T22:32:00.934363+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.934363+0000', 'last_undegraded': '2023-07-21T22:32:00.934363+0000', 'last_fullsized': '2023-07-21T22:32:00.934363+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:32:06.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-07-21T22:32:06.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.942388+0000', 'last_change': '2023-07-21T22:32:00.942388+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.942388+0000', 'last_undegraded': '2023-07-21T22:32:00.942388+0000', 'last_fullsized': '2023-07-21T22:32:00.942388+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:32:06.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-07-21T22:32:06.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.937756+0000', 'last_change': '2023-07-21T22:32:00.937756+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.937756+0000', 'last_undegraded': '2023-07-21T22:32:00.937756+0000', 'last_fullsized': '2023-07-21T22:32:00.937756+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:32:06.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-07-21T22:32:06.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.941696+0000', 'last_change': '2023-07-21T22:32:00.941696+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.941696+0000', 'last_undegraded': '2023-07-21T22:32:00.941696+0000', 'last_fullsized': '2023-07-21T22:32:00.941696+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:32:06.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-07-21T22:32:06.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.939056+0000', 'last_change': '2023-07-21T22:32:00.939056+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.939056+0000', 'last_undegraded': '2023-07-21T22:32:00.939056+0000', 'last_fullsized': '2023-07-21T22:32:00.939056+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:32:06.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-07-21T22:32:06.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.943243+0000', 'last_change': '2023-07-21T22:32:00.943243+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.943243+0000', 'last_undegraded': '2023-07-21T22:32:00.943243+0000', 'last_fullsized': '2023-07-21T22:32:00.943243+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:32:06.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-07-21T22:32:06.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.938951+0000', 'last_change': '2023-07-21T22:32:00.938951+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.938951+0000', 'last_undegraded': '2023-07-21T22:32:00.938951+0000', 'last_fullsized': '2023-07-21T22:32:00.938951+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:32:06.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-07-21T22:32:06.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.936147+0000', 'last_change': '2023-07-21T22:32:00.936147+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.936147+0000', 'last_undegraded': '2023-07-21T22:32:00.936147+0000', 'last_fullsized': '2023-07-21T22:32:00.936147+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:32:06.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-07-21T22:32:06.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.941276+0000', 'last_change': '2023-07-21T22:32:00.941276+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.941276+0000', 'last_undegraded': '2023-07-21T22:32:00.941276+0000', 'last_fullsized': '2023-07-21T22:32:00.941276+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:32:06.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-07-21T22:32:06.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.935715+0000', 'last_change': '2023-07-21T22:32:00.935715+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.935715+0000', 'last_undegraded': '2023-07-21T22:32:00.935715+0000', 'last_fullsized': '2023-07-21T22:32:00.935715+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:32:06.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-07-21T22:32:06.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.938361+0000', 'last_change': '2023-07-21T22:32:00.938361+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.938361+0000', 'last_undegraded': '2023-07-21T22:32:00.938361+0000', 'last_fullsized': '2023-07-21T22:32:00.938361+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:32:06.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-07-21T22:32:06.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.939507+0000', 'last_change': '2023-07-21T22:32:00.939507+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.939507+0000', 'last_undegraded': '2023-07-21T22:32:00.939507+0000', 'last_fullsized': '2023-07-21T22:32:00.939507+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:32:06.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-07-21T22:32:06.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.940048+0000', 'last_change': '2023-07-21T22:32:00.940048+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.940048+0000', 'last_undegraded': '2023-07-21T22:32:00.940048+0000', 'last_fullsized': '2023-07-21T22:32:00.940048+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:32:06.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-07-21T22:32:06.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.941933+0000', 'last_change': '2023-07-21T22:32:00.941933+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.941933+0000', 'last_undegraded': '2023-07-21T22:32:00.941933+0000', 'last_fullsized': '2023-07-21T22:32:00.941933+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:32:06.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-07-21T22:32:06.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.936152+0000', 'last_change': '2023-07-21T22:32:00.936152+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.936152+0000', 'last_undegraded': '2023-07-21T22:32:00.936152+0000', 'last_fullsized': '2023-07-21T22:32:00.936152+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:32:06.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-07-21T22:32:06.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.936271+0000', 'last_change': '2023-07-21T22:32:00.936271+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.936271+0000', 'last_undegraded': '2023-07-21T22:32:00.936271+0000', 'last_fullsized': '2023-07-21T22:32:00.936271+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:32:06.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-07-21T22:32:06.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.942001+0000', 'last_change': '2023-07-21T22:32:00.942001+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.942001+0000', 'last_undegraded': '2023-07-21T22:32:00.942001+0000', 'last_fullsized': '2023-07-21T22:32:00.942001+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:32:06.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-07-21T22:32:06.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.932429+0000', 'last_change': '2023-07-21T22:32:00.932429+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.932429+0000', 'last_undegraded': '2023-07-21T22:32:00.932429+0000', 'last_fullsized': '2023-07-21T22:32:00.932429+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:32:06.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-07-21T22:32:06.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 65, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:32:00.936183+0000', 'last_change': '2023-07-21T22:32:00.936183+0000', 'last_active': '2023-07-21T22:32:00.917633+0000', 'last_peered': '2023-07-21T22:32:00.917633+0000', 'last_clean': '2023-07-21T22:32:00.917633+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:32:00.936183+0000', 'last_undegraded': '2023-07-21T22:32:00.936183+0000', 'last_fullsized': '2023-07-21T22:32:00.936183+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'last_clean_scrub_stamp': '2023-07-21T22:32:00.917633+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:32:06.934 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-21T22:32:06.953 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-07-21T22:32:06.904+0000 7fe79e106640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:32:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.028+0000 7f44f759e640 1 Processor -- start 2023-07-21T22:32:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.028+0000 7f44f759e640 1 -- start start 2023-07-21T22:32:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.032+0000 7f44f759e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f44f80b7d90 0x7f44f80cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.032+0000 7f44f759e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44f80d13f0 0x7f44f80ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.032+0000 7f44f759e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f80d0f60 con 0x7f44f815f3f0 2023-07-21T22:32:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.032+0000 7f44f759e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f80d0390 con 0x7f44f80b7d90 2023-07-21T22:32:07.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.032+0000 7f44f759e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f80d0630 con 0x7f44f80d13f0 2023-07-21T22:32:07.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.032+0000 7f44f6d9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44f80d13f0 0x7f44f80ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:07.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.032+0000 7f44f5d9b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f44f80b7d90 0x7f44f80cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:07.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.032+0000 7f44f659c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f44f815f3f0 0x7f44f80b7680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:57768/0 (socket says 172.21.15.6:57768) 2023-07-21T22:32:07.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.032+0000 7f44f659c640 1 -- 172.21.15.6:0/2918968153 learned_addr learned my addr 172.21.15.6:0/2918968153 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:32:07.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.032+0000 7f44f5d9b640 1 -- 172.21.15.6:0/2918968153 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44f80d13f0 msgr2=0x7f44f80ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:07.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.032+0000 7f44f5d9b640 1 --2- 172.21.15.6:0/2918968153 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44f80d13f0 0x7f44f80ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:07.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.032+0000 7f44f5d9b640 1 -- 172.21.15.6:0/2918968153 >> v1:172.21.15.161:6789/0 conn(0x7f44f815f3f0 legacy=0x7f44f80b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:07.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.032+0000 7f44f5d9b640 1 -- 172.21.15.6:0/2918968153 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f80d0910 con 0x7f44f80b7d90 2023-07-21T22:32:07.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.032+0000 7f44f559a640 1 -- 172.21.15.6:0/2918968153 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521547970 0 0) 0x7f44f80d0f60 con 0x7f44f815f3f0 2023-07-21T22:32:07.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.036+0000 7f44f5d9b640 1 --2- 172.21.15.6:0/2918968153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44f80b7d90 0x7f44f80cc9a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0097c0 tx=0x7f44ec01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1df7e36483322e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:07.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.036+0000 7f44f559a640 1 -- 172.21.15.6:0/2918968153 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec0ab600 con 0x7f44f80b7d90 2023-07-21T22:32:07.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.036+0000 7f44f559a640 1 -- 172.21.15.6:0/2918968153 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ec0a7050 con 0x7f44f80b7d90 2023-07-21T22:32:07.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.036+0000 7f44f559a640 1 -- 172.21.15.6:0/2918968153 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec0ab980 con 0x7f44f80b7d90 2023-07-21T22:32:07.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.036+0000 7f44f759e640 1 -- 172.21.15.6:0/2918968153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44f80b7d90 msgr2=0x7f44f80cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:07.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.036+0000 7f44f759e640 1 --2- 172.21.15.6:0/2918968153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44f80b7d90 0x7f44f80cc9a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0097c0 tx=0x7f44ec01c3f0 comp rx=0 tx=0).stop 2023-07-21T22:32:07.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.036+0000 7f44f759e640 1 -- 172.21.15.6:0/2918968153 shutdown_connections 2023-07-21T22:32:07.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.036+0000 7f44f759e640 1 --2- 172.21.15.6:0/2918968153 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44f80d13f0 0x7f44f80ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:07.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.036+0000 7f44f759e640 1 --2- 172.21.15.6:0/2918968153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44f80b7d90 0x7f44f80cc9a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:07.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.036+0000 7f44f759e640 1 -- 172.21.15.6:0/2918968153 >> 172.21.15.6:0/2918968153 conn(0x7f44f8069f50 msgr2=0x7f44f806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:07.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.036+0000 7f44f759e640 1 -- 172.21.15.6:0/2918968153 shutdown_connections 2023-07-21T22:32:07.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.036+0000 7f44f759e640 1 -- 172.21.15.6:0/2918968153 wait complete. 2023-07-21T22:32:07.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.036+0000 7f44f759e640 1 Processor -- start 2023-07-21T22:32:07.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.036+0000 7f44f759e640 1 -- start start 2023-07-21T22:32:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44f759e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f80b7d90 0x7f44f815b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44f759e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44f80d13f0 0x7f44f815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44f759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44f815f3f0 0x7f44f8148220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44f759e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f81662f0 con 0x7f44f80b7d90 2023-07-21T22:32:07.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44f759e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f8166710 con 0x7f44f815f3f0 2023-07-21T22:32:07.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44f759e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f8165670 con 0x7f44f80d13f0 2023-07-21T22:32:07.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44f659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f80b7d90 0x7f44f815b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:07.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44f659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f80b7d90 0x7f44f815b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35736/0 (socket says 172.21.15.6:35736) 2023-07-21T22:32:07.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44f659c640 1 -- 172.21.15.6:0/2659747472 learned_addr learned my addr 172.21.15.6:0/2659747472 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:07.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44f5d9b640 1 --2- 172.21.15.6:0/2659747472 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44f80d13f0 0x7f44f815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:07.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44f6d9d640 1 --2- 172.21.15.6:0/2659747472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44f815f3f0 0x7f44f8148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:07.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44f659c640 1 -- 172.21.15.6:0/2659747472 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44f80d13f0 msgr2=0x7f44f815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:07.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44f659c640 1 --2- 172.21.15.6:0/2659747472 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44f80d13f0 0x7f44f815b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:07.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44f659c640 1 -- 172.21.15.6:0/2659747472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44f815f3f0 msgr2=0x7f44f8148220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:07.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44f659c640 1 --2- 172.21.15.6:0/2659747472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44f815f3f0 0x7f44f8148220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:07.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44f659c640 1 -- 172.21.15.6:0/2659747472 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ec009420 con 0x7f44f80b7d90 2023-07-21T22:32:07.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44f659c640 1 --2- 172.21.15.6:0/2659747472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f80b7d90 0x7f44f815b1a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f44e800c480 tx=0x7f44e800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:07.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44e6ffd640 1 -- 172.21.15.6:0/2659747472 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e80074e0 con 0x7f44f80b7d90 2023-07-21T22:32:07.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44e6ffd640 1 -- 172.21.15.6:0/2659747472 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e8007660 con 0x7f44f80b7d90 2023-07-21T22:32:07.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44f759e640 1 -- 172.21.15.6:0/2659747472 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f8165950 con 0x7f44f80b7d90 2023-07-21T22:32:07.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44e6ffd640 1 -- 172.21.15.6:0/2659747472 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e8004a30 con 0x7f44f80b7d90 2023-07-21T22:32:07.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44f759e640 1 -- 172.21.15.6:0/2659747472 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f8165f10 con 0x7f44f80b7d90 2023-07-21T22:32:07.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44f759e640 1 -- 172.21.15.6:0/2659747472 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f80678d0 con 0x7f44f80b7d90 2023-07-21T22:32:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.040+0000 7f44e6ffd640 1 -- 172.21.15.6:0/2659747472 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f44e8004b90 con 0x7f44f80b7d90 2023-07-21T22:32:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.044+0000 7f44e6ffd640 1 --2- 172.21.15.6:0/2659747472 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f44d80663a0 0x7f44d8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.044+0000 7f44e6ffd640 1 -- 172.21.15.6:0/2659747472 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f44e80832a0 con 0x7f44f80b7d90 2023-07-21T22:32:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.044+0000 7f44f5d9b640 1 --2- 172.21.15.6:0/2659747472 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f44d80663a0 0x7f44d8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.044+0000 7f44f5d9b640 1 --2- 172.21.15.6:0/2659747472 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f44d80663a0 0x7f44d8068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0ad000 tx=0x7f44ec0a6000 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:07.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.048+0000 7f44e6ffd640 1 -- 172.21.15.6:0/2659747472 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44e8050720 con 0x7f44f80b7d90 2023-07-21T22:32:07.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.260+0000 7f44f759e640 1 -- 172.21.15.6:0/2659747472 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f44f81668d0 con 0x7f44f80b7d90 2023-07-21T22:32:07.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.260+0000 7f44e6ffd640 1 -- 172.21.15.6:0/2659747472 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3229 (secure 0 0 0) 0x7f44e8053d40 con 0x7f44f80b7d90 2023-07-21T22:32:07.308 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:32:07.308 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":829,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":67,"num_osds":8,"num_up_osds":8,"osd_up_since":1689977909,"num_in_osds":8,"osd_in_since":1689977900,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":302792704,"bytes_avail":772791320576,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":24,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":6045}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-07-21T22:31:49.701404+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-21T22:32:07.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.260+0000 7f44f759e640 1 -- 172.21.15.6:0/2659747472 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f44d80663a0 msgr2=0x7f44d8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:07.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.260+0000 7f44f759e640 1 --2- 172.21.15.6:0/2659747472 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f44d80663a0 0x7f44d8068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f44ec0ad000 tx=0x7f44ec0a6000 comp rx=0 tx=0).stop 2023-07-21T22:32:07.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.260+0000 7f44f759e640 1 -- 172.21.15.6:0/2659747472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f80b7d90 msgr2=0x7f44f815b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:07.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.260+0000 7f44f759e640 1 --2- 172.21.15.6:0/2659747472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f80b7d90 0x7f44f815b1a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f44e800c480 tx=0x7f44e800c940 comp rx=0 tx=0).stop 2023-07-21T22:32:07.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.260+0000 7f44f759e640 1 -- 172.21.15.6:0/2659747472 shutdown_connections 2023-07-21T22:32:07.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.260+0000 7f44f759e640 1 --2- 172.21.15.6:0/2659747472 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f44d80663a0 0x7f44d8068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:07.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.260+0000 7f44f759e640 1 --2- 172.21.15.6:0/2659747472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44f815f3f0 0x7f44f8148220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:07.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.260+0000 7f44f759e640 1 --2- 172.21.15.6:0/2659747472 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44f80d13f0 0x7f44f815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:07.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.260+0000 7f44f759e640 1 --2- 172.21.15.6:0/2659747472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f80b7d90 0x7f44f815b1a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:07.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.260+0000 7f44f759e640 1 -- 172.21.15.6:0/2659747472 >> 172.21.15.6:0/2659747472 conn(0x7f44f8069f50 msgr2=0x7f44f806a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:07.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.260+0000 7f44f759e640 1 -- 172.21.15.6:0/2659747472 shutdown_connections 2023-07-21T22:32:07.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.260+0000 7f44f759e640 1 -- 172.21.15.6:0/2659747472 wait complete. 2023-07-21T22:32:07.329 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-21T22:32:07.330 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:32:07.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.464+0000 7f226280b640 1 Processor -- start 2023-07-21T22:32:07.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.468+0000 7f226280b640 1 -- start start 2023-07-21T22:32:07.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.468+0000 7f226280b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f225c070b70 0x7f225c070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:07.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.468+0000 7f226280b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f225c06b1e0 0x7f225c0c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:07.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.468+0000 7f226280b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225c0cac70 con 0x7f225c0c21f0 2023-07-21T22:32:07.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.468+0000 7f226280b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225c071480 con 0x7f225c06b1e0 2023-07-21T22:32:07.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.468+0000 7f226280b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225c0ca060 con 0x7f225c070b70 2023-07-21T22:32:07.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.468+0000 7f225b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f225c06b1e0 0x7f225c0c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:07.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.468+0000 7f2260da8640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f225c0c21f0 0x7f225c0cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52540/0 (socket says 172.21.15.6:52540) 2023-07-21T22:32:07.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.468+0000 7f2260da8640 1 -- 172.21.15.6:0/262454665 learned_addr learned my addr 172.21.15.6:0/262454665 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:32:07.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.468+0000 7f225bfff640 1 --2- 172.21.15.6:0/262454665 >> v2:172.21.15.161:3300/0 conn(0x7f225c070b70 0x7f225c070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:07.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.468+0000 7f225b7fe640 1 -- 172.21.15.6:0/262454665 >> v2:172.21.15.161:3300/0 conn(0x7f225c070b70 msgr2=0x7f225c070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:07.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.468+0000 7f225b7fe640 1 --2- 172.21.15.6:0/262454665 >> v2:172.21.15.161:3300/0 conn(0x7f225c070b70 0x7f225c070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:07.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.468+0000 7f225b7fe640 1 -- 172.21.15.6:0/262454665 >> v1:172.21.15.6:6789/0 conn(0x7f225c0c21f0 legacy=0x7f225c0cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:07.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.468+0000 7f225b7fe640 1 -- 172.21.15.6:0/262454665 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c0ca340 con 0x7f225c06b1e0 2023-07-21T22:32:07.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.468+0000 7f225bfff640 1 --2- 172.21.15.6:0/262454665 >> v2:172.21.15.161:3300/0 conn(0x7f225c070b70 0x7f225c070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:07.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.468+0000 7f225affd640 1 -- 172.21.15.6:0/262454665 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984082757 0 0) 0x7f225c0cac70 con 0x7f225c0c21f0 2023-07-21T22:32:07.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.472+0000 7f225b7fe640 1 --2- 172.21.15.6:0/262454665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c06b1e0 0x7f225c0c1cb0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f225c06f1f0 tx=0x7f225001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f578656490b38a7a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:07.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.472+0000 7f225affd640 1 -- 172.21.15.6:0/262454665 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22500a7070 con 0x7f225c06b1e0 2023-07-21T22:32:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.472+0000 7f225affd640 1 -- 172.21.15.6:0/262454665 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22500ab430 con 0x7f225c06b1e0 2023-07-21T22:32:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.472+0000 7f225affd640 1 -- 172.21.15.6:0/262454665 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22500ab7c0 con 0x7f225c06b1e0 2023-07-21T22:32:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.472+0000 7f226280b640 1 -- 172.21.15.6:0/262454665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c06b1e0 msgr2=0x7f225c0c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:07.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.472+0000 7f226280b640 1 --2- 172.21.15.6:0/262454665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c06b1e0 0x7f225c0c1cb0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f225c06f1f0 tx=0x7f225001c430 comp rx=0 tx=0).stop 2023-07-21T22:32:07.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.472+0000 7f226280b640 1 -- 172.21.15.6:0/262454665 shutdown_connections 2023-07-21T22:32:07.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.472+0000 7f226280b640 1 --2- 172.21.15.6:0/262454665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c06b1e0 0x7f225c0c1cb0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:07.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.472+0000 7f226280b640 1 --2- 172.21.15.6:0/262454665 >> v2:172.21.15.161:3300/0 conn(0x7f225c070b70 0x7f225c070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:07.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.472+0000 7f226280b640 1 -- 172.21.15.6:0/262454665 >> 172.21.15.6:0/262454665 conn(0x7f225c0afcf0 msgr2=0x7f225c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:07.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.472+0000 7f226280b640 1 -- 172.21.15.6:0/262454665 shutdown_connections 2023-07-21T22:32:07.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.472+0000 7f226280b640 1 -- 172.21.15.6:0/262454665 wait complete. 2023-07-21T22:32:07.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.472+0000 7f226280b640 1 Processor -- start 2023-07-21T22:32:07.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.472+0000 7f226280b640 1 -- start start 2023-07-21T22:32:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f226280b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f225c06b1e0 0x7f225c0c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f226280b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f225c070b70 0x7f225c0c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f226280b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c0c21f0 0x7f225c0c2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f226280b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c144030 con 0x7f225c0c21f0 2023-07-21T22:32:07.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f226280b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c0c78c0 con 0x7f225c070b70 2023-07-21T22:32:07.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f226280b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c0c6ff0 con 0x7f225c06b1e0 2023-07-21T22:32:07.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f2260da8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c0c21f0 0x7f225c0c2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:07.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f2260da8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c0c21f0 0x7f225c0c2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59768/0 (socket says 172.21.15.6:59768) 2023-07-21T22:32:07.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f2260da8640 1 -- 172.21.15.6:0/2427601423 learned_addr learned my addr 172.21.15.6:0/2427601423 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:07.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f225bfff640 1 --2- 172.21.15.6:0/2427601423 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f225c06b1e0 0x7f225c0c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:07.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f2260da8640 1 -- 172.21.15.6:0/2427601423 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f225c06b1e0 msgr2=0x7f225c0c3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:07.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f2260da8640 1 --2- 172.21.15.6:0/2427601423 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f225c06b1e0 0x7f225c0c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:07.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f2260da8640 1 -- 172.21.15.6:0/2427601423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f225c070b70 msgr2=0x7f225c0c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:07.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f2260da8640 1 --2- 172.21.15.6:0/2427601423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f225c070b70 0x7f225c0c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:07.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f2260da8640 1 -- 172.21.15.6:0/2427601423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2250009420 con 0x7f225c0c21f0 2023-07-21T22:32:07.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f2260da8640 1 --2- 172.21.15.6:0/2427601423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c0c21f0 0x7f225c0c2620 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f225400c6d0 tx=0x7f225400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:07.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f2258ff9640 1 -- 172.21.15.6:0/2427601423 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254004d70 con 0x7f225c0c21f0 2023-07-21T22:32:07.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f2258ff9640 1 -- 172.21.15.6:0/2427601423 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225400a640 con 0x7f225c0c21f0 2023-07-21T22:32:07.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f226280b640 1 -- 172.21.15.6:0/2427601423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225c147040 con 0x7f225c0c21f0 2023-07-21T22:32:07.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f2258ff9640 1 -- 172.21.15.6:0/2427601423 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225400aa70 con 0x7f225c0c21f0 2023-07-21T22:32:07.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f226280b640 1 -- 172.21.15.6:0/2427601423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225c0c7550 con 0x7f225c0c21f0 2023-07-21T22:32:07.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f226280b640 1 -- 172.21.15.6:0/2427601423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225c0678d0 con 0x7f225c0c21f0 2023-07-21T22:32:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.476+0000 7f2258ff9640 1 -- 172.21.15.6:0/2427601423 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f22540070d0 con 0x7f225c0c21f0 2023-07-21T22:32:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.480+0000 7f2258ff9640 1 --2- 172.21.15.6:0/2427601423 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f22480663a0 0x7f2248068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.480+0000 7f2258ff9640 1 -- 172.21.15.6:0/2427601423 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f22540835f0 con 0x7f225c0c21f0 2023-07-21T22:32:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.480+0000 7f225bfff640 1 --2- 172.21.15.6:0/2427601423 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f22480663a0 0x7f2248068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.480+0000 7f225bfff640 1 --2- 172.21.15.6:0/2427601423 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f22480663a0 0x7f2248068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f225c0c17e0 tx=0x7f224c008040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:07.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.484+0000 7f2258ff9640 1 -- 172.21.15.6:0/2427601423 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2254050920 con 0x7f225c0c21f0 2023-07-21T22:32:07.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.636+0000 7f226280b640 1 -- 172.21.15.6:0/2427601423 --> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f225c06f5b0 con 0x7f22480663a0 2023-07-21T22:32:07.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.648+0000 7f2258ff9640 1 -- 172.21.15.6:0/2427601423 <== mgr.5743 v2:172.21.15.161:6832/3740183048 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305853 (secure 0 0 0) 0x7f224c0094e0 con 0x7f22480663a0 2023-07-21T22:32:07.699 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:32:07.701 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:32:07.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.648+0000 7f226280b640 1 -- 172.21.15.6:0/2427601423 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f22480663a0 msgr2=0x7f2248068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:07.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.648+0000 7f226280b640 1 --2- 172.21.15.6:0/2427601423 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f22480663a0 0x7f2248068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f225c0c17e0 tx=0x7f224c008040 comp rx=0 tx=0).stop 2023-07-21T22:32:07.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.648+0000 7f226280b640 1 -- 172.21.15.6:0/2427601423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c0c21f0 msgr2=0x7f225c0c2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:07.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.648+0000 7f226280b640 1 --2- 172.21.15.6:0/2427601423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c0c21f0 0x7f225c0c2620 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f225400c6d0 tx=0x7f225400cb90 comp rx=0 tx=0).stop 2023-07-21T22:32:07.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.652+0000 7f226280b640 1 -- 172.21.15.6:0/2427601423 shutdown_connections 2023-07-21T22:32:07.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.652+0000 7f226280b640 1 --2- 172.21.15.6:0/2427601423 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f22480663a0 0x7f2248068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:07.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.652+0000 7f226280b640 1 --2- 172.21.15.6:0/2427601423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c0c21f0 0x7f225c0c2620 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:07.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.652+0000 7f226280b640 1 --2- 172.21.15.6:0/2427601423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f225c070b70 0x7f225c0c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:07.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.652+0000 7f226280b640 1 --2- 172.21.15.6:0/2427601423 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f225c06b1e0 0x7f225c0c3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:07.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.652+0000 7f226280b640 1 -- 172.21.15.6:0/2427601423 >> 172.21.15.6:0/2427601423 conn(0x7f225c0afcf0 msgr2=0x7f225c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:07.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.652+0000 7f226280b640 1 -- 172.21.15.6:0/2427601423 shutdown_connections 2023-07-21T22:32:07.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:07.652+0000 7f226280b640 1 -- 172.21.15.6:0/2427601423 wait complete. 2023-07-21T22:32:07.718 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-21T22:32:05.705254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":295696,"kb_used_data":7120,"kb_used_omap":0,"kb_used_meta":288512,"kb_avail":754679024,"statfs":{"total":773094113280,"available":772791320576,"internally_reserved":0,"allocated":7290880,"data_stored":4119056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":295436288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.781878"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939046+0000","last_change":"2023-07-21T22:32:00.939046+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939046+0000","last_undegraded":"2023-07-21T22:32:00.939046+0000","last_fullsized":"2023-07-21T22:32:00.939046+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940135+0000","last_change":"2023-07-21T22:32:00.940135+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940135+0000","last_undegraded":"2023-07-21T22:32:00.940135+0000","last_fullsized":"2023-07-21T22:32:00.940135+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.935591+0000","last_change":"2023-07-21T22:32:00.935591+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.935591+0000","last_undegraded":"2023-07-21T22:32:00.935591+0000","last_fullsized":"2023-07-21T22:32:00.935591+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939384+0000","last_change":"2023-07-21T22:32:00.939384+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939384+0000","last_undegraded":"2023-07-21T22:32:00.939384+0000","last_fullsized":"2023-07-21T22:32:00.939384+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.945092+0000","last_change":"2023-07-21T22:32:00.945092+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.945092+0000","last_undegraded":"2023-07-21T22:32:00.945092+0000","last_fullsized":"2023-07-21T22:32:00.945092+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940528+0000","last_change":"2023-07-21T22:32:00.940528+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940528+0000","last_undegraded":"2023-07-21T22:32:00.940528+0000","last_fullsized":"2023-07-21T22:32:00.940528+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.931463+0000","last_change":"2023-07-21T22:32:00.931463+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.931463+0000","last_undegraded":"2023-07-21T22:32:00.931463+0000","last_fullsized":"2023-07-21T22:32:00.931463+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.943332+0000","last_change":"2023-07-21T22:32:00.943332+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.943332+0000","last_undegraded":"2023-07-21T22:32:00.943332+0000","last_fullsized":"2023-07-21T22:32:00.943332+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.943669+0000","last_change":"2023-07-21T22:32:00.943669+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.943669+0000","last_undegraded":"2023-07-21T22:32:00.943669+0000","last_fullsized":"2023-07-21T22:32:00.943669+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942369+0000","last_change":"2023-07-21T22:32:00.942369+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942369+0000","last_undegraded":"2023-07-21T22:32:00.942369+0000","last_fullsized":"2023-07-21T22:32:00.942369+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.933108+0000","last_change":"2023-07-21T22:32:00.933108+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.933108+0000","last_undegraded":"2023-07-21T22:32:00.933108+0000","last_fullsized":"2023-07-21T22:32:00.933108+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.943642+0000","last_change":"2023-07-21T22:32:00.943642+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.943642+0000","last_undegraded":"2023-07-21T22:32:00.943642+0000","last_fullsized":"2023-07-21T22:32:00.943642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939463+0000","last_change":"2023-07-21T22:32:00.939463+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939463+0000","last_undegraded":"2023-07-21T22:32:00.939463+0000","last_fullsized":"2023-07-21T22:32:00.939463+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.931137+0000","last_change":"2023-07-21T22:32:00.931137+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.931137+0000","last_undegraded":"2023-07-21T22:32:00.931137+0000","last_fullsized":"2023-07-21T22:32:00.931137+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940920+0000","last_change":"2023-07-21T22:32:00.940920+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940920+0000","last_undegraded":"2023-07-21T22:32:00.940920+0000","last_fullsized":"2023-07-21T22:32:00.940920+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941617+0000","last_change":"2023-07-21T22:32:00.941617+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941617+0000","last_undegraded":"2023-07-21T22:32:00.941617+0000","last_fullsized":"2023-07-21T22:32:00.941617+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.934576+0000","last_change":"2023-07-21T22:32:00.934576+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.934576+0000","last_undegraded":"2023-07-21T22:32:00.934576+0000","last_fullsized":"2023-07-21T22:32:00.934576+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939627+0000","last_change":"2023-07-21T22:32:00.939627+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939627+0000","last_undegraded":"2023-07-21T22:32:00.939627+0000","last_fullsized":"2023-07-21T22:32:00.939627+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.935124+0000","last_change":"2023-07-21T22:32:00.935124+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.935124+0000","last_undegraded":"2023-07-21T22:32:00.935124+0000","last_fullsized":"2023-07-21T22:32:00.935124+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940067+0000","last_change":"2023-07-21T22:32:00.940067+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940067+0000","last_undegraded":"2023-07-21T22:32:00.940067+0000","last_fullsized":"2023-07-21T22:32:00.940067+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939390+0000","last_change":"2023-07-21T22:32:00.939390+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939390+0000","last_undegraded":"2023-07-21T22:32:00.939390+0000","last_fullsized":"2023-07-21T22:32:00.939390+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942199+0000","last_change":"2023-07-21T22:32:00.942199+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942199+0000","last_undegraded":"2023-07-21T22:32:00.942199+0000","last_fullsized":"2023-07-21T22:32:00.942199+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.934188+0000","last_change":"2023-07-21T22:32:00.934188+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.934188+0000","last_undegraded":"2023-07-21T22:32:00.934188+0000","last_fullsized":"2023-07-21T22:32:00.934188+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.932446+0000","last_change":"2023-07-21T22:32:00.932446+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.932446+0000","last_undegraded":"2023-07-21T22:32:00.932446+0000","last_fullsized":"2023-07-21T22:32:00.932446+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.934081+0000","last_change":"2023-07-21T22:32:00.934081+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.934081+0000","last_undegraded":"2023-07-21T22:32:00.934081+0000","last_fullsized":"2023-07-21T22:32:00.934081+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942891+0000","last_change":"2023-07-21T22:32:00.942891+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942891+0000","last_undegraded":"2023-07-21T22:32:00.942891+0000","last_fullsized":"2023-07-21T22:32:00.942891+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941426+0000","last_change":"2023-07-21T22:32:00.941426+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941426+0000","last_undegraded":"2023-07-21T22:32:00.941426+0000","last_fullsized":"2023-07-21T22:32:00.941426+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939540+0000","last_change":"2023-07-21T22:32:00.939540+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939540+0000","last_undegraded":"2023-07-21T22:32:00.939540+0000","last_fullsized":"2023-07-21T22:32:00.939540+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.931313+0000","last_change":"2023-07-21T22:32:00.931313+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.931313+0000","last_undegraded":"2023-07-21T22:32:00.931313+0000","last_fullsized":"2023-07-21T22:32:00.931313+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942556+0000","last_change":"2023-07-21T22:32:00.942556+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942556+0000","last_undegraded":"2023-07-21T22:32:00.942556+0000","last_fullsized":"2023-07-21T22:32:00.942556+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.930989+0000","last_change":"2023-07-21T22:32:00.930989+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.930989+0000","last_undegraded":"2023-07-21T22:32:00.930989+0000","last_fullsized":"2023-07-21T22:32:00.930989+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.937353+0000","last_change":"2023-07-21T22:32:00.937353+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.937353+0000","last_undegraded":"2023-07-21T22:32:00.937353+0000","last_fullsized":"2023-07-21T22:32:00.937353+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940212+0000","last_change":"2023-07-21T22:32:00.940212+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940212+0000","last_undegraded":"2023-07-21T22:32:00.940212+0000","last_fullsized":"2023-07-21T22:32:00.940212+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.953399+0000","last_change":"2023-07-21T22:32:00.951495+0000","last_active":"2023-07-21T22:32:00.953399+0000","last_peered":"2023-07-21T22:32:00.953399+0000","last_clean":"2023-07-21T22:32:00.953399+0000","last_became_active":"2023-07-21T22:32:00.951233+0000","last_became_peered":"2023-07-21T22:32:00.951233+0000","last_unstale":"2023-07-21T22:32:00.953399+0000","last_undegraded":"2023-07-21T22:32:00.953399+0000","last_fullsized":"2023-07-21T22:32:00.953399+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:48:19.238340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936126+0000","last_change":"2023-07-21T22:32:00.936126+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936126+0000","last_undegraded":"2023-07-21T22:32:00.936126+0000","last_fullsized":"2023-07-21T22:32:00.936126+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.957667+0000","last_change":"2023-07-21T22:32:00.954953+0000","last_active":"2023-07-21T22:32:00.957667+0000","last_peered":"2023-07-21T22:32:00.957667+0000","last_clean":"2023-07-21T22:32:00.957667+0000","last_became_active":"2023-07-21T22:32:00.954668+0000","last_became_peered":"2023-07-21T22:32:00.954668+0000","last_unstale":"2023-07-21T22:32:00.957667+0000","last_undegraded":"2023-07-21T22:32:00.957667+0000","last_fullsized":"2023-07-21T22:32:00.957667+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:40:48.657491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939148+0000","last_change":"2023-07-21T22:32:00.939148+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939148+0000","last_undegraded":"2023-07-21T22:32:00.939148+0000","last_fullsized":"2023-07-21T22:32:00.939148+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.955289+0000","last_change":"2023-07-21T22:32:00.949062+0000","last_active":"2023-07-21T22:32:00.955289+0000","last_peered":"2023-07-21T22:32:00.955289+0000","last_clean":"2023-07-21T22:32:00.955289+0000","last_became_active":"2023-07-21T22:32:00.948796+0000","last_became_peered":"2023-07-21T22:32:00.948796+0000","last_unstale":"2023-07-21T22:32:00.955289+0000","last_undegraded":"2023-07-21T22:32:00.955289+0000","last_fullsized":"2023-07-21T22:32:00.955289+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:18:28.623919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942728+0000","last_change":"2023-07-21T22:32:00.942728+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942728+0000","last_undegraded":"2023-07-21T22:32:00.942728+0000","last_fullsized":"2023-07-21T22:32:00.942728+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.958912+0000","last_change":"2023-07-21T22:32:00.957955+0000","last_active":"2023-07-21T22:32:00.958912+0000","last_peered":"2023-07-21T22:32:00.958912+0000","last_clean":"2023-07-21T22:32:00.958912+0000","last_became_active":"2023-07-21T22:32:00.957647+0000","last_became_peered":"2023-07-21T22:32:00.957647+0000","last_unstale":"2023-07-21T22:32:00.958912+0000","last_undegraded":"2023-07-21T22:32:00.958912+0000","last_fullsized":"2023-07-21T22:32:00.958912+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:47:59.245516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.944136+0000","last_change":"2023-07-21T22:32:00.944136+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.944136+0000","last_undegraded":"2023-07-21T22:32:00.944136+0000","last_fullsized":"2023-07-21T22:32:00.944136+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.945045+0000","last_change":"2023-07-21T22:32:00.939672+0000","last_active":"2023-07-21T22:32:00.945045+0000","last_peered":"2023-07-21T22:32:00.945045+0000","last_clean":"2023-07-21T22:32:00.945045+0000","last_became_active":"2023-07-21T22:32:00.939377+0000","last_became_peered":"2023-07-21T22:32:00.939377+0000","last_unstale":"2023-07-21T22:32:00.945045+0000","last_undegraded":"2023-07-21T22:32:00.945045+0000","last_fullsized":"2023-07-21T22:32:00.945045+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:21:16.607665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940650+0000","last_change":"2023-07-21T22:32:00.940650+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940650+0000","last_undegraded":"2023-07-21T22:32:00.940650+0000","last_fullsized":"2023-07-21T22:32:00.940650+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.956668+0000","last_change":"2023-07-21T22:32:00.952492+0000","last_active":"2023-07-21T22:32:00.956668+0000","last_peered":"2023-07-21T22:32:00.956668+0000","last_clean":"2023-07-21T22:32:00.956668+0000","last_became_active":"2023-07-21T22:32:00.952206+0000","last_became_peered":"2023-07-21T22:32:00.952206+0000","last_unstale":"2023-07-21T22:32:00.956668+0000","last_undegraded":"2023-07-21T22:32:00.956668+0000","last_fullsized":"2023-07-21T22:32:00.956668+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:23:46.523157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941817+0000","last_change":"2023-07-21T22:32:00.941817+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941817+0000","last_undegraded":"2023-07-21T22:32:00.941817+0000","last_fullsized":"2023-07-21T22:32:00.941817+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.953100+0000","last_change":"2023-07-21T22:32:00.950894+0000","last_active":"2023-07-21T22:32:00.953100+0000","last_peered":"2023-07-21T22:32:00.953100+0000","last_clean":"2023-07-21T22:32:00.953100+0000","last_became_active":"2023-07-21T22:32:00.950574+0000","last_became_peered":"2023-07-21T22:32:00.950574+0000","last_unstale":"2023-07-21T22:32:00.953100+0000","last_undegraded":"2023-07-21T22:32:00.953100+0000","last_fullsized":"2023-07-21T22:32:00.953100+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:39:22.307711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939246+0000","last_change":"2023-07-21T22:32:00.939246+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939246+0000","last_undegraded":"2023-07-21T22:32:00.939246+0000","last_fullsized":"2023-07-21T22:32:00.939246+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.954926+0000","last_change":"2023-07-21T22:32:00.950304+0000","last_active":"2023-07-21T22:32:00.954926+0000","last_peered":"2023-07-21T22:32:00.954926+0000","last_clean":"2023-07-21T22:32:00.954926+0000","last_became_active":"2023-07-21T22:32:00.949932+0000","last_became_peered":"2023-07-21T22:32:00.949932+0000","last_unstale":"2023-07-21T22:32:00.954926+0000","last_undegraded":"2023-07-21T22:32:00.954926+0000","last_fullsized":"2023-07-21T22:32:00.954926+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:33:09.061573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942335+0000","last_change":"2023-07-21T22:32:00.942335+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942335+0000","last_undegraded":"2023-07-21T22:32:00.942335+0000","last_fullsized":"2023-07-21T22:32:00.942335+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.951430+0000","last_change":"2023-07-21T22:32:00.949543+0000","last_active":"2023-07-21T22:32:00.951430+0000","last_peered":"2023-07-21T22:32:00.951430+0000","last_clean":"2023-07-21T22:32:00.951430+0000","last_became_active":"2023-07-21T22:32:00.949230+0000","last_became_peered":"2023-07-21T22:32:00.949230+0000","last_unstale":"2023-07-21T22:32:00.951430+0000","last_undegraded":"2023-07-21T22:32:00.951430+0000","last_fullsized":"2023-07-21T22:32:00.951430+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:01:13.578327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.937205+0000","last_change":"2023-07-21T22:32:00.937205+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.937205+0000","last_undegraded":"2023-07-21T22:32:00.937205+0000","last_fullsized":"2023-07-21T22:32:00.937205+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.956608+0000","last_change":"2023-07-21T22:32:00.951734+0000","last_active":"2023-07-21T22:32:00.956608+0000","last_peered":"2023-07-21T22:32:00.956608+0000","last_clean":"2023-07-21T22:32:00.956608+0000","last_became_active":"2023-07-21T22:32:00.950944+0000","last_became_peered":"2023-07-21T22:32:00.950944+0000","last_unstale":"2023-07-21T22:32:00.956608+0000","last_undegraded":"2023-07-21T22:32:00.956608+0000","last_fullsized":"2023-07-21T22:32:00.956608+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:18:12.778871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.930588+0000","last_change":"2023-07-21T22:32:00.930588+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.930588+0000","last_undegraded":"2023-07-21T22:32:00.930588+0000","last_fullsized":"2023-07-21T22:32:00.930588+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.956872+0000","last_change":"2023-07-21T22:32:00.955950+0000","last_active":"2023-07-21T22:32:00.956872+0000","last_peered":"2023-07-21T22:32:00.956872+0000","last_clean":"2023-07-21T22:32:00.956872+0000","last_became_active":"2023-07-21T22:32:00.955656+0000","last_became_peered":"2023-07-21T22:32:00.955656+0000","last_unstale":"2023-07-21T22:32:00.956872+0000","last_undegraded":"2023-07-21T22:32:00.956872+0000","last_fullsized":"2023-07-21T22:32:00.956872+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:54:13.720697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942555+0000","last_change":"2023-07-21T22:32:00.942555+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942555+0000","last_undegraded":"2023-07-21T22:32:00.942555+0000","last_fullsized":"2023-07-21T22:32:00.942555+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.953630+0000","last_change":"2023-07-21T22:32:00.944870+0000","last_active":"2023-07-21T22:32:00.953630+0000","last_peered":"2023-07-21T22:32:00.953630+0000","last_clean":"2023-07-21T22:32:00.953630+0000","last_became_active":"2023-07-21T22:32:00.944534+0000","last_became_peered":"2023-07-21T22:32:00.944534+0000","last_unstale":"2023-07-21T22:32:00.953630+0000","last_undegraded":"2023-07-21T22:32:00.953630+0000","last_fullsized":"2023-07-21T22:32:00.953630+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:43:59.834021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936876+0000","last_change":"2023-07-21T22:32:00.936876+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936876+0000","last_undegraded":"2023-07-21T22:32:00.936876+0000","last_fullsized":"2023-07-21T22:32:00.936876+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.948392+0000","last_change":"2023-07-21T22:32:00.946546+0000","last_active":"2023-07-21T22:32:00.948392+0000","last_peered":"2023-07-21T22:32:00.948392+0000","last_clean":"2023-07-21T22:32:00.948392+0000","last_became_active":"2023-07-21T22:32:00.946230+0000","last_became_peered":"2023-07-21T22:32:00.946230+0000","last_unstale":"2023-07-21T22:32:00.948392+0000","last_undegraded":"2023-07-21T22:32:00.948392+0000","last_fullsized":"2023-07-21T22:32:00.948392+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:14:44.561456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.934363+0000","last_change":"2023-07-21T22:32:00.934363+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.934363+0000","last_undegraded":"2023-07-21T22:32:00.934363+0000","last_fullsized":"2023-07-21T22:32:00.934363+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.951794+0000","last_change":"2023-07-21T22:32:00.948760+0000","last_active":"2023-07-21T22:32:00.951794+0000","last_peered":"2023-07-21T22:32:00.951794+0000","last_clean":"2023-07-21T22:32:00.951794+0000","last_became_active":"2023-07-21T22:32:00.948465+0000","last_became_peered":"2023-07-21T22:32:00.948465+0000","last_unstale":"2023-07-21T22:32:00.951794+0000","last_undegraded":"2023-07-21T22:32:00.951794+0000","last_fullsized":"2023-07-21T22:32:00.951794+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:02:10.700819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942388+0000","last_change":"2023-07-21T22:32:00.942388+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942388+0000","last_undegraded":"2023-07-21T22:32:00.942388+0000","last_fullsized":"2023-07-21T22:32:00.942388+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.955252+0000","last_change":"2023-07-21T22:32:00.952133+0000","last_active":"2023-07-21T22:32:00.955252+0000","last_peered":"2023-07-21T22:32:00.955252+0000","last_clean":"2023-07-21T22:32:00.955252+0000","last_became_active":"2023-07-21T22:32:00.951734+0000","last_became_peered":"2023-07-21T22:32:00.951734+0000","last_unstale":"2023-07-21T22:32:00.955252+0000","last_undegraded":"2023-07-21T22:32:00.955252+0000","last_fullsized":"2023-07-21T22:32:00.955252+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:40:24.334656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.937756+0000","last_change":"2023-07-21T22:32:00.937756+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.937756+0000","last_undegraded":"2023-07-21T22:32:00.937756+0000","last_fullsized":"2023-07-21T22:32:00.937756+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.954799+0000","last_change":"2023-07-21T22:32:00.952275+0000","last_active":"2023-07-21T22:32:00.954799+0000","last_peered":"2023-07-21T22:32:00.954799+0000","last_clean":"2023-07-21T22:32:00.954799+0000","last_became_active":"2023-07-21T22:32:00.951981+0000","last_became_peered":"2023-07-21T22:32:00.951981+0000","last_unstale":"2023-07-21T22:32:00.954799+0000","last_undegraded":"2023-07-21T22:32:00.954799+0000","last_fullsized":"2023-07-21T22:32:00.954799+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:08.224210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941696+0000","last_change":"2023-07-21T22:32:00.941696+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941696+0000","last_undegraded":"2023-07-21T22:32:00.941696+0000","last_fullsized":"2023-07-21T22:32:00.941696+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.955656+0000","last_change":"2023-07-21T22:32:00.953359+0000","last_active":"2023-07-21T22:32:00.955656+0000","last_peered":"2023-07-21T22:32:00.955656+0000","last_clean":"2023-07-21T22:32:00.955656+0000","last_became_active":"2023-07-21T22:32:00.953042+0000","last_became_peered":"2023-07-21T22:32:00.953042+0000","last_unstale":"2023-07-21T22:32:00.955656+0000","last_undegraded":"2023-07-21T22:32:00.955656+0000","last_fullsized":"2023-07-21T22:32:00.955656+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:54:58.294196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939056+0000","last_change":"2023-07-21T22:32:00.939056+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939056+0000","last_undegraded":"2023-07-21T22:32:00.939056+0000","last_fullsized":"2023-07-21T22:32:00.939056+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.949424+0000","last_change":"2023-07-21T22:32:00.943392+0000","last_active":"2023-07-21T22:32:00.949424+0000","last_peered":"2023-07-21T22:32:00.949424+0000","last_clean":"2023-07-21T22:32:00.949424+0000","last_became_active":"2023-07-21T22:32:00.943043+0000","last_became_peered":"2023-07-21T22:32:00.943043+0000","last_unstale":"2023-07-21T22:32:00.949424+0000","last_undegraded":"2023-07-21T22:32:00.949424+0000","last_fullsized":"2023-07-21T22:32:00.949424+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:44:11.097837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.943243+0000","last_change":"2023-07-21T22:32:00.943243+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.943243+0000","last_undegraded":"2023-07-21T22:32:00.943243+0000","last_fullsized":"2023-07-21T22:32:00.943243+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.958676+0000","last_change":"2023-07-21T22:32:00.954859+0000","last_active":"2023-07-21T22:32:00.958676+0000","last_peered":"2023-07-21T22:32:00.958676+0000","last_clean":"2023-07-21T22:32:00.958676+0000","last_became_active":"2023-07-21T22:32:00.954521+0000","last_became_peered":"2023-07-21T22:32:00.954521+0000","last_unstale":"2023-07-21T22:32:00.958676+0000","last_undegraded":"2023-07-21T22:32:00.958676+0000","last_fullsized":"2023-07-21T22:32:00.958676+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:24:57.280727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.938951+0000","last_change":"2023-07-21T22:32:00.938951+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.938951+0000","last_undegraded":"2023-07-21T22:32:00.938951+0000","last_fullsized":"2023-07-21T22:32:00.938951+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.961338+0000","last_change":"2023-07-21T22:32:00.957742+0000","last_active":"2023-07-21T22:32:00.961338+0000","last_peered":"2023-07-21T22:32:00.961338+0000","last_clean":"2023-07-21T22:32:00.961338+0000","last_became_active":"2023-07-21T22:32:00.957336+0000","last_became_peered":"2023-07-21T22:32:00.957336+0000","last_unstale":"2023-07-21T22:32:00.961338+0000","last_undegraded":"2023-07-21T22:32:00.961338+0000","last_fullsized":"2023-07-21T22:32:00.961338+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:18:50.663097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936147+0000","last_change":"2023-07-21T22:32:00.936147+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936147+0000","last_undegraded":"2023-07-21T22:32:00.936147+0000","last_fullsized":"2023-07-21T22:32:00.936147+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.951555+0000","last_change":"2023-07-21T22:32:00.946873+0000","last_active":"2023-07-21T22:32:00.951555+0000","last_peered":"2023-07-21T22:32:00.951555+0000","last_clean":"2023-07-21T22:32:00.951555+0000","last_became_active":"2023-07-21T22:32:00.946537+0000","last_became_peered":"2023-07-21T22:32:00.946537+0000","last_unstale":"2023-07-21T22:32:00.951555+0000","last_undegraded":"2023-07-21T22:32:00.951555+0000","last_fullsized":"2023-07-21T22:32:00.951555+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:09.629226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941276+0000","last_change":"2023-07-21T22:32:00.941276+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941276+0000","last_undegraded":"2023-07-21T22:32:00.941276+0000","last_fullsized":"2023-07-21T22:32:00.941276+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.953565+0000","last_change":"2023-07-21T22:32:00.943926+0000","last_active":"2023-07-21T22:32:00.953565+0000","last_peered":"2023-07-21T22:32:00.953565+0000","last_clean":"2023-07-21T22:32:00.953565+0000","last_became_active":"2023-07-21T22:32:00.943551+0000","last_became_peered":"2023-07-21T22:32:00.943551+0000","last_unstale":"2023-07-21T22:32:00.953565+0000","last_undegraded":"2023-07-21T22:32:00.953565+0000","last_fullsized":"2023-07-21T22:32:00.953565+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:53:58.981346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.935715+0000","last_change":"2023-07-21T22:32:00.935715+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.935715+0000","last_undegraded":"2023-07-21T22:32:00.935715+0000","last_fullsized":"2023-07-21T22:32:00.935715+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.954655+0000","last_change":"2023-07-21T22:32:00.949051+0000","last_active":"2023-07-21T22:32:00.954655+0000","last_peered":"2023-07-21T22:32:00.954655+0000","last_clean":"2023-07-21T22:32:00.954655+0000","last_became_active":"2023-07-21T22:32:00.948748+0000","last_became_peered":"2023-07-21T22:32:00.948748+0000","last_unstale":"2023-07-21T22:32:00.954655+0000","last_undegraded":"2023-07-21T22:32:00.954655+0000","last_fullsized":"2023-07-21T22:32:00.954655+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:52:54.611034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.938361+0000","last_change":"2023-07-21T22:32:00.938361+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.938361+0000","last_undegraded":"2023-07-21T22:32:00.938361+0000","last_fullsized":"2023-07-21T22:32:00.938361+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.949581+0000","last_change":"2023-07-21T22:32:00.944727+0000","last_active":"2023-07-21T22:32:00.949581+0000","last_peered":"2023-07-21T22:32:00.949581+0000","last_clean":"2023-07-21T22:32:00.949581+0000","last_became_active":"2023-07-21T22:32:00.944461+0000","last_became_peered":"2023-07-21T22:32:00.944461+0000","last_unstale":"2023-07-21T22:32:00.949581+0000","last_undegraded":"2023-07-21T22:32:00.949581+0000","last_fullsized":"2023-07-21T22:32:00.949581+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:00:22.685969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.939507+0000","last_change":"2023-07-21T22:32:00.939507+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.939507+0000","last_undegraded":"2023-07-21T22:32:00.939507+0000","last_fullsized":"2023-07-21T22:32:00.939507+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.951171+0000","last_change":"2023-07-21T22:32:00.947839+0000","last_active":"2023-07-21T22:32:00.951171+0000","last_peered":"2023-07-21T22:32:00.951171+0000","last_clean":"2023-07-21T22:32:00.951171+0000","last_became_active":"2023-07-21T22:32:00.947416+0000","last_became_peered":"2023-07-21T22:32:00.947416+0000","last_unstale":"2023-07-21T22:32:00.951171+0000","last_undegraded":"2023-07-21T22:32:00.951171+0000","last_fullsized":"2023-07-21T22:32:00.951171+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:52:02.423090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'139","reported_seq":327,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.940683+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:32:00.940683+0000","last_peered":"2023-07-21T22:32:00.940683+0000","last_clean":"2023-07-21T22:32:00.940683+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:32:00.940683+0000","last_undegraded":"2023-07-21T22:32:00.940683+0000","last_fullsized":"2023-07-21T22:32:00.940683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:11:53.150494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":101,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.937864+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:32:00.937864+0000","last_peered":"2023-07-21T22:32:00.937864+0000","last_clean":"2023-07-21T22:32:00.937864+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:32:00.937864+0000","last_undegraded":"2023-07-21T22:32:00.937864+0000","last_fullsized":"2023-07-21T22:32:00.937864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:55:12.047847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.940048+0000","last_change":"2023-07-21T22:32:00.940048+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.940048+0000","last_undegraded":"2023-07-21T22:32:00.940048+0000","last_fullsized":"2023-07-21T22:32:00.940048+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.956861+0000","last_change":"2023-07-21T22:32:00.955530+0000","last_active":"2023-07-21T22:32:00.956861+0000","last_peered":"2023-07-21T22:32:00.956861+0000","last_clean":"2023-07-21T22:32:00.956861+0000","last_became_active":"2023-07-21T22:32:00.955208+0000","last_became_peered":"2023-07-21T22:32:00.955208+0000","last_unstale":"2023-07-21T22:32:00.956861+0000","last_undegraded":"2023-07-21T22:32:00.956861+0000","last_fullsized":"2023-07-21T22:32:00.956861+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:30:23.544614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":93,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.940556+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:32:00.940556+0000","last_peered":"2023-07-21T22:32:00.940556+0000","last_clean":"2023-07-21T22:32:00.940556+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:32:00.940556+0000","last_undegraded":"2023-07-21T22:32:00.940556+0000","last_fullsized":"2023-07-21T22:32:00.940556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:48.875424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.941933+0000","last_change":"2023-07-21T22:32:00.941933+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.941933+0000","last_undegraded":"2023-07-21T22:32:00.941933+0000","last_fullsized":"2023-07-21T22:32:00.941933+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.951232+0000","last_change":"2023-07-21T22:32:00.947085+0000","last_active":"2023-07-21T22:32:00.951232+0000","last_peered":"2023-07-21T22:32:00.951232+0000","last_clean":"2023-07-21T22:32:00.951232+0000","last_became_active":"2023-07-21T22:32:00.946461+0000","last_became_peered":"2023-07-21T22:32:00.946461+0000","last_unstale":"2023-07-21T22:32:00.951232+0000","last_undegraded":"2023-07-21T22:32:00.951232+0000","last_fullsized":"2023-07-21T22:32:00.951232+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:14:15.195255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":91,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.936597+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:32:00.936597+0000","last_peered":"2023-07-21T22:32:00.936597+0000","last_clean":"2023-07-21T22:32:00.936597+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:32:00.936597+0000","last_undegraded":"2023-07-21T22:32:00.936597+0000","last_fullsized":"2023-07-21T22:32:00.936597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:42.565432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936152+0000","last_change":"2023-07-21T22:32:00.936152+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936152+0000","last_undegraded":"2023-07-21T22:32:00.936152+0000","last_fullsized":"2023-07-21T22:32:00.936152+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.958746+0000","last_change":"2023-07-21T22:32:00.955354+0000","last_active":"2023-07-21T22:32:00.958746+0000","last_peered":"2023-07-21T22:32:00.958746+0000","last_clean":"2023-07-21T22:32:00.958746+0000","last_became_active":"2023-07-21T22:32:00.954992+0000","last_became_peered":"2023-07-21T22:32:00.954992+0000","last_unstale":"2023-07-21T22:32:00.958746+0000","last_undegraded":"2023-07-21T22:32:00.958746+0000","last_fullsized":"2023-07-21T22:32:00.958746+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:04:18.396523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":101,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.937912+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:32:00.937912+0000","last_peered":"2023-07-21T22:32:00.937912+0000","last_clean":"2023-07-21T22:32:00.937912+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:32:00.937912+0000","last_undegraded":"2023-07-21T22:32:00.937912+0000","last_fullsized":"2023-07-21T22:32:00.937912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:28:18.043637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936271+0000","last_change":"2023-07-21T22:32:00.936271+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936271+0000","last_undegraded":"2023-07-21T22:32:00.936271+0000","last_fullsized":"2023-07-21T22:32:00.936271+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.961335+0000","last_change":"2023-07-21T22:32:00.957850+0000","last_active":"2023-07-21T22:32:00.961335+0000","last_peered":"2023-07-21T22:32:00.961335+0000","last_clean":"2023-07-21T22:32:00.961335+0000","last_became_active":"2023-07-21T22:32:00.957501+0000","last_became_peered":"2023-07-21T22:32:00.957501+0000","last_unstale":"2023-07-21T22:32:00.961335+0000","last_undegraded":"2023-07-21T22:32:00.961335+0000","last_fullsized":"2023-07-21T22:32:00.961335+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:43:24.943153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.944285+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:32:00.944285+0000","last_peered":"2023-07-21T22:32:00.944285+0000","last_clean":"2023-07-21T22:32:00.944285+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:32:00.944285+0000","last_undegraded":"2023-07-21T22:32:00.944285+0000","last_fullsized":"2023-07-21T22:32:00.944285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:13:05.154378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.942001+0000","last_change":"2023-07-21T22:32:00.942001+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.942001+0000","last_undegraded":"2023-07-21T22:32:00.942001+0000","last_fullsized":"2023-07-21T22:32:00.942001+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.956368+0000","last_change":"2023-07-21T22:32:00.954255+0000","last_active":"2023-07-21T22:32:00.956368+0000","last_peered":"2023-07-21T22:32:00.956368+0000","last_clean":"2023-07-21T22:32:00.956368+0000","last_became_active":"2023-07-21T22:32:00.953914+0000","last_became_peered":"2023-07-21T22:32:00.953914+0000","last_unstale":"2023-07-21T22:32:00.956368+0000","last_undegraded":"2023-07-21T22:32:00.956368+0000","last_fullsized":"2023-07-21T22:32:00.956368+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:47:25.303033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.944284+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:32:00.944284+0000","last_peered":"2023-07-21T22:32:00.944284+0000","last_clean":"2023-07-21T22:32:00.944284+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:32:00.944284+0000","last_undegraded":"2023-07-21T22:32:00.944284+0000","last_fullsized":"2023-07-21T22:32:00.944284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:35:37.561916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.932429+0000","last_change":"2023-07-21T22:32:00.932429+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.932429+0000","last_undegraded":"2023-07-21T22:32:00.932429+0000","last_fullsized":"2023-07-21T22:32:00.932429+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.953917+0000","last_change":"2023-07-21T22:32:00.945223+0000","last_active":"2023-07-21T22:32:00.953917+0000","last_peered":"2023-07-21T22:32:00.953917+0000","last_clean":"2023-07-21T22:32:00.953917+0000","last_became_active":"2023-07-21T22:32:00.944958+0000","last_became_peered":"2023-07-21T22:32:00.944958+0000","last_unstale":"2023-07-21T22:32:00.953917+0000","last_undegraded":"2023-07-21T22:32:00.953917+0000","last_fullsized":"2023-07-21T22:32:00.953917+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:02:35.145130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.944500+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:32:00.944500+0000","last_peered":"2023-07-21T22:32:00.944500+0000","last_clean":"2023-07-21T22:32:00.944500+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:32:00.944500+0000","last_undegraded":"2023-07-21T22:32:00.944500+0000","last_fullsized":"2023-07-21T22:32:00.944500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:26:00.376064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2023-07-21T22:32:00.936183+0000","last_change":"2023-07-21T22:32:00.936183+0000","last_active":"2023-07-21T22:32:00.917633+0000","last_peered":"2023-07-21T22:32:00.917633+0000","last_clean":"2023-07-21T22:32:00.917633+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:32:00.936183+0000","last_undegraded":"2023-07-21T22:32:00.936183+0000","last_fullsized":"2023-07-21T22:32:00.936183+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.954771+0000","last_change":"2023-07-21T22:32:00.951682+0000","last_active":"2023-07-21T22:32:00.954771+0000","last_peered":"2023-07-21T22:32:00.954771+0000","last_clean":"2023-07-21T22:32:00.954771+0000","last_became_active":"2023-07-21T22:32:00.951375+0000","last_became_peered":"2023-07-21T22:32:00.951375+0000","last_unstale":"2023-07-21T22:32:00.954771+0000","last_undegraded":"2023-07-21T22:32:00.954771+0000","last_fullsized":"2023-07-21T22:32:00.954771+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:16:13.181692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":91,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-07-21T22:32:00.942461+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:32:00.942461+0000","last_peered":"2023-07-21T22:32:00.942461+0000","last_clean":"2023-07-21T22:32:00.942461+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:32:00.942461+0000","last_undegraded":"2023-07-21T22:32:00.942461+0000","last_fullsized":"2023-07-21T22:32:00.942461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:35:08.506245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509604,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54520,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317320,"statfs":{"total":96636764160,"available":96580935680,"internally_reserved":0,"allocated":1359872,"data_stored":959326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.72899999999999998,"15min":0.72399999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.32600000000000001},"max":{"1min":0.91700000000000004,"5min":0.95699999999999996,"15min":1.28},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.68899999999999995,"15min":0.67800000000000005},"min":{"1min":0.436,"5min":0.39500000000000002,"15min":0.36099999999999999},"max":{"1min":0.82099999999999995,"5min":0.98399999999999999,"15min":1.131},"last":0.82099999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.379},"max":{"1min":0.877,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71999999999999997,"15min":0.71399999999999997},"min":{"1min":0.47599999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.873,"5min":1.0129999999999999,"15min":1.0409999999999999},"last":0.873}]},{"osd":2,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.749,"15min":0.73999999999999999},"min":{"1min":0.51300000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96099999999999997,"5min":0.97099999999999997,"15min":1.405},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.74299999999999999,"15min":0.751},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97699999999999998,"5min":1.0629999999999999,"15min":1.087},"last":0.86499999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.42099999999999999},"max":{"1min":0.86899999999999999,"5min":1.0189999999999999,"15min":1.2230000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.755,"15min":0.753},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.92300000000000004,"5min":0.95199999999999996,"15min":1.0189999999999999},"last":0.92300000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55200000000000005,"15min":0.57599999999999996},"min":{"1min":0.38,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":1.244},"last":0.5},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.64000000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90400000000000003,"5min":1.0309999999999999,"15min":1.3999999999999999},"last":0.57799999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.47499999999999998,"5min":0.41399999999999998,"15min":0.40300000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.98599999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65900000000000003,"15min":0.69199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.93400000000000005,"5min":0.94199999999999995,"15min":1.0129999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.5,"5min":0.46500000000000002,"15min":0.44400000000000001},"max":{"1min":0.877,"5min":0.98599999999999999,"15min":1.048},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.63,"15min":0.65100000000000002},"min":{"1min":0.434,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":0.90400000000000003,"5min":0.91300000000000003,"15min":0.98599999999999999},"last":0.85599999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542310,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":368958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78500000000000003,"15min":0.75600000000000001},"min":{"1min":0.621,"5min":0.39800000000000002,"15min":0.36599999999999999},"max":{"1min":0.93400000000000005,"5min":0.95499999999999996,"15min":1.425},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.65600000000000003,"5min":0.60399999999999998,"15min":0.437},"max":{"1min":0.95199999999999996,"5min":1.0329999999999999,"15min":2.3100000000000001},"last":0.82099999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73899999999999999,"15min":0.71299999999999997},"min":{"1min":0.495,"5min":0.45300000000000001,"15min":0.41999999999999998},"max":{"1min":0.86799999999999999,"5min":0.97099999999999997,"15min":1.022},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74099999999999999,"15min":0.82399999999999995},"min":{"1min":0.64800000000000002,"5min":0.46000000000000002,"15min":0.34399999999999997},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":8.6280000000000001},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.76700000000000002},"min":{"1min":0.60499999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93700000000000006,"5min":0.997,"15min":1.55},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.80900000000000005,"15min":0.79000000000000004},"min":{"1min":0.69999999999999996,"5min":0.54700000000000004,"15min":0.45500000000000002},"max":{"1min":0.97199999999999998,"5min":1.0149999999999999,"15min":1.016},"last":0.88900000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.57399999999999995,"5min":0.51400000000000001,"15min":0.5},"max":{"1min":0.90200000000000002,"5min":0.97799999999999998,"15min":1.7470000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.53100000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91700000000000004,"5min":0.95799999999999996,"15min":1.5129999999999999},"last":0.86799999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59999999999999998,"15min":0.627},"min":{"1min":0.433,"5min":0.40600000000000003,"15min":0.36599999999999999},"max":{"1min":0.86399999999999999,"5min":0.97999999999999998,"15min":3.1829999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63400000000000001,"15min":0.66300000000000003},"min":{"1min":0.48599999999999999,"5min":0.41399999999999998,"15min":0.39700000000000002},"max":{"1min":0.85199999999999998,"5min":1.0209999999999999,"15min":2.887},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.62,"15min":0.64300000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.78800000000000003,"5min":0.93799999999999994,"15min":1.4510000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67300000000000004,"15min":0.67600000000000005},"min":{"1min":0.54600000000000004,"5min":0.45300000000000001,"15min":0.39400000000000002},"max":{"1min":0.83299999999999996,"5min":1.0389999999999999,"15min":1.054},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:30:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68500000000000005,"15min":0.70099999999999996},"min":{"1min":0.51800000000000002,"5min":0.46899999999999997,"15min":0.443},"max":{"1min":0.94599999999999995,"5min":0.99099999999999999,"15min":1.1679999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.79100000000000004},"min":{"1min":0.51800000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88300000000000001,"5min":0.97999999999999998,"15min":8.0760000000000005},"last":0.90800000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509603,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":765952,"data_stored":368958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.73299999999999998,"15min":0.70799999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32900000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71099999999999997,"15min":0.71599999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.745}]},{"osd":1,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.71299999999999997,"15min":0.70999999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.90600000000000003,"5min":0.95799999999999996,"15min":1.0009999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73599999999999999,"15min":0.72999999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.69699999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.42999999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.034},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.79000000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78800000000000003,"15min":0.78500000000000003},"min":{"1min":0.56000000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81299999999999994,"15min":0.79800000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.91100000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57799999999999996,"15min":0.56399999999999995},"min":{"1min":0.41099999999999998,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.443},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68300000000000005,"15min":0.69199999999999995},"min":{"1min":0.52200000000000002,"5min":0.502,"15min":0.44900000000000001},"max":{"1min":0.84199999999999997,"5min":0.97499999999999998,"15min":1.038},"last":0.55900000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60599999999999998,"15min":0.60899999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.64100000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63800000000000001,"15min":0.65900000000000003},"min":{"1min":0.46300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.85499999999999998,"5min":0.96199999999999997,"15min":0.97699999999999998},"last":0.502},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.73799999999999999,"15min":0.72699999999999998},"min":{"1min":0.54000000000000004,"5min":0.52100000000000002,"15min":0.439},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.67000000000000004}]}]},{"osd":4,"up_from":15,"seq":64424509604,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":368958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.75800000000000001,"15min":0.74199999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.40000000000000002},"max":{"1min":0.89400000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.747,"15min":0.74299999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92000000000000004,"5min":0.96099999999999997,"15min":0.99099999999999999},"last":0.69199999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70999999999999996,"15min":0.69799999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.39400000000000002},"max":{"1min":0.89100000000000001,"5min":1.002,"15min":1.0449999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71399999999999997,"15min":0.69399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86299999999999999,"5min":0.96399999999999997,"15min":1.016},"last":0.71499999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77900000000000003,"15min":0.76800000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.042},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.77300000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.33000000000000002},"max":{"1min":0.96399999999999997,"5min":1,"15min":1.0589999999999999},"last":0.755}]},{"osd":3,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97199999999999998,"5min":1.0169999999999999,"15min":1.026},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79600000000000004,"15min":0.78700000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.93000000000000005,"5min":0.99099999999999999,"15min":1.018},"last":0.82399999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.58299999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81599999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57099999999999995,"15min":0.60099999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.0680000000000001},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64200000000000002,"15min":0.65400000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.38500000000000001},"max":{"1min":0.91000000000000003,"5min":0.92200000000000004,"15min":0.96699999999999997},"last":0.875},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69899999999999995,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98999999999999999,"5min":0.997,"15min":1.272},"last":0.84899999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.627,"15min":0.67200000000000004},"min":{"1min":0.439,"5min":0.39200000000000002,"15min":0.374},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.3300000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.67800000000000005,"15min":0.70599999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95699999999999996,"5min":0.97999999999999998,"15min":1.135},"last":0.91300000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509603,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":368958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.29099999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.68400000000000005,"5min":0.749,"15min":0.76400000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.41099999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.436}]},{"osd":1,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.48199999999999998,"15min":0.47399999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.30099999999999999},"max":{"1min":0.69199999999999995,"5min":0.83499999999999996,"15min":0.871},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72299999999999998,"5min":0.86399999999999999,"15min":0.94199999999999995},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.57199999999999995,"15min":0.54600000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66700000000000004,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61599999999999999,"15min":0.59399999999999997},"min":{"1min":0.45100000000000001,"5min":0.41499999999999998,"15min":0.40999999999999998},"max":{"1min":0.69199999999999995,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.505}]},{"osd":4,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.438},"max":{"1min":0.91400000000000003,"5min":1.0620000000000001,"15min":1.3240000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.01,"5min":1.0569999999999999,"15min":1.488},"last":0.622}]},{"osd":5,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.90600000000000003,"5min":1.137,"15min":1.1919999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.048,"5min":1.081,"15min":1.302},"last":0.54500000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93500000000000005,"5min":1.056,"15min":1.3979999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.49399999999999999},"max":{"1min":0.98499999999999999,"5min":1.0740000000000001,"15min":1.3899999999999999},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.82299999999999995,"15min":0.82899999999999996},"min":{"1min":0.53400000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0780000000000001,"5min":1.097,"15min":1.335},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.83799999999999997,"15min":0.82899999999999996},"min":{"1min":0.58999999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.2130000000000001},"last":0.65800000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509605,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53928,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317912,"statfs":{"total":96636764160,"available":96581541888,"internally_reserved":0,"allocated":753664,"data_stored":362286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48399999999999999,"15min":0.47099999999999997},"min":{"1min":0.315,"5min":0.29799999999999999,"15min":0.23899999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.94199999999999995},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56599999999999995,"15min":0.54100000000000004},"min":{"1min":0.39000000000000001,"5min":0.36799999999999999,"15min":0.36599999999999999},"max":{"1min":0.76000000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.47199999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55300000000000005,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.34499999999999997,"15min":0.28199999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59899999999999998,"15min":0.57699999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80600000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.439}]},{"osd":3,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.48499999999999999,"15min":0.47699999999999998},"min":{"1min":0.35699999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.61399999999999999,"5min":0.73499999999999999,"15min":0.748},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41099999999999998,"5min":0.38900000000000001,"15min":0.34100000000000003},"max":{"1min":0.74099999999999999,"5min":0.82499999999999996,"15min":0.93100000000000005},"last":0.41899999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.82699999999999996,"15min":0.80200000000000005},"min":{"1min":0.56899999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.6870000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82899999999999996,"15min":0.80400000000000005},"min":{"1min":0.58299999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.2689999999999999},"last":0.77400000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81999999999999995,"15min":0.79600000000000004},"min":{"1min":0.57799999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.026,"5min":1.169,"15min":1.2549999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.81200000000000006},"min":{"1min":0.58399999999999996,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.171,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.74099999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.81999999999999995,"15min":0.80300000000000005},"min":{"1min":0.55400000000000005,"5min":0.44900000000000001,"15min":0.40300000000000002},"max":{"1min":1.0940000000000001,"5min":1.2,"15min":1.3759999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.873,"5min":0.84399999999999997,"15min":0.81100000000000005},"min":{"1min":0.66100000000000003,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.23,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84799999999999998,"15min":0.83099999999999996},"min":{"1min":0.60099999999999998,"5min":0.51100000000000001,"15min":0.49099999999999999},"max":{"1min":1.1140000000000001,"5min":1.214,"15min":1.2909999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.84099999999999997,"15min":0.81999999999999995},"min":{"1min":0.63100000000000001,"5min":0.44900000000000001,"15min":0.44700000000000001},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.3660000000000001},"last":0.66900000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509604,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31784,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340056,"statfs":{"total":96636764160,"available":96604217344,"internally_reserved":0,"allocated":753664,"data_stored":362286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.47199999999999998,"15min":0.53900000000000003},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59599999999999997,"5min":0.84599999999999997,"15min":5.4800000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56200000000000006,"15min":0.61499999999999999},"min":{"1min":0.41099999999999998,"5min":0.377,"15min":0.36099999999999999},"max":{"1min":0.76700000000000002,"5min":0.872,"15min":5.2830000000000004},"last":0.46899999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.505,"15min":0.53700000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.64900000000000002,"5min":0.76100000000000001,"15min":3.4220000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.52400000000000002,"15min":0.53600000000000003},"min":{"1min":0.35199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.88800000000000001},"last":0.377}]},{"osd":3,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.58999999999999997,"15min":0.626},"min":{"1min":0.35799999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81599999999999995,"5min":0.86599999999999999,"15min":3.2469999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.51000000000000001,"15min":0.56999999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71799999999999997,"5min":0.77300000000000002,"15min":5.8710000000000004},"last":0.42799999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.80900000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89500000000000002,"5min":1.1930000000000001,"15min":3.6259999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78200000000000003,"15min":0.83499999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.91300000000000003,"5min":1.083,"15min":4.4100000000000001},"last":0.64200000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.77600000000000002,"15min":0.83999999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96599999999999997,"5min":1.115,"15min":5.766},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.78700000000000003,"15min":0.82599999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90400000000000003,"5min":1.2849999999999999,"15min":3.669},"last":0.70299999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95199999999999996,"5min":1.147,"15min":1.23},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77800000000000002,"15min":0.85499999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93600000000000005,"5min":1.3240000000000001,"15min":5.8200000000000003},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.79200000000000004,"15min":0.86499999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.872,"5min":1.244,"15min":5.9269999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79200000000000004,"15min":0.84299999999999997},"min":{"1min":0.52600000000000002,"5min":0.48599999999999999,"15min":0.45700000000000002},"max":{"1min":0.93400000000000005,"5min":1.3380000000000001,"15min":3.5800000000000001},"last":0.622}]}]},{"osd":0,"up_from":15,"seq":64424509606,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1359872,"data_stored":959326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.32500000000000001,"5min":0.29999999999999999,"15min":0.28000000000000003},"max":{"1min":0.754,"5min":0.81000000000000005,"15min":0.91100000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53700000000000003,"15min":0.49399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.28599999999999998},"max":{"1min":0.72699999999999998,"5min":0.77800000000000002,"15min":0.83199999999999996},"last":0.434}]},{"osd":2,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54300000000000004,"15min":0.51700000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.32200000000000001},"max":{"1min":0.72799999999999998,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53800000000000003,"15min":0.51000000000000001},"min":{"1min":0.36099999999999999,"5min":0.33700000000000002,"15min":0.33000000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.41799999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60499999999999998,"15min":0.58599999999999997},"min":{"1min":0.43099999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84499999999999997,"5min":0.88100000000000001,"15min":0.91300000000000003},"last":0.499},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.53600000000000003},"min":{"1min":0.40699999999999997,"5min":0.40200000000000002,"15min":0.35599999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.85699999999999998},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.79100000000000004,"15min":0.79200000000000004},"min":{"1min":0.52700000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.0760000000000001,"5min":1.1559999999999999,"15min":1.321},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.81100000000000005,"15min":0.80200000000000005},"min":{"1min":0.57799999999999996,"5min":0.52800000000000002,"15min":0.48999999999999999},"max":{"1min":1.0880000000000001,"5min":1.423,"15min":1.423},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78300000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.107,"5min":1.2669999999999999,"15min":1.28},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82599999999999996,"15min":0.81799999999999995},"min":{"1min":0.59799999999999998,"5min":0.53700000000000003,"15min":0.50700000000000001},"max":{"1min":1.0329999999999999,"5min":1.254,"15min":1.393},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.82099999999999995,"15min":0.81699999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0820000000000001,"5min":1.2290000000000001,"15min":1.28},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84199999999999997,"15min":0.82499999999999996},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.57599999999999996},"max":{"1min":1.147,"5min":1.333,"15min":1.333},"last":0.82499999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:31:03 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80100000000000005,"15min":0.79900000000000004},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.54000000000000004},"max":{"1min":1.087,"5min":1.121,"15min":1.2310000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.85499999999999998,"15min":0.84199999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.101,"5min":1.296,"15min":1.369},"last":0.61199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:32:10.727 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:32:10.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.832+0000 7f678ab9f640 1 Processor -- start 2023-07-21T22:32:10.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.832+0000 7f678ab9f640 1 -- start start 2023-07-21T22:32:10.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.836+0000 7f678ab9f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67840ade00 0x7f678406d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:10.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.836+0000 7f678ab9f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678406cc10 con 0x7f678406e2f0 2023-07-21T22:32:10.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.836+0000 7f678ab9f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67840ae420 con 0x7f6784159b90 2023-07-21T22:32:10.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.836+0000 7f678ab9f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6784159f60 con 0x7f67840ade00 2023-07-21T22:32:10.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.836+0000 7f6783fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f678406e2f0 0x7f67840ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52544/0 (socket says 172.21.15.6:52544) 2023-07-21T22:32:10.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.836+0000 7f6783fff640 1 -- 172.21.15.6:0/4205293873 learned_addr learned my addr 172.21.15.6:0/4205293873 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:32:10.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.836+0000 7f678913c640 1 --2- 172.21.15.6:0/4205293873 >> v2:172.21.15.6:3300/0 conn(0x7f67840ade00 0x7f678406d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:10.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.836+0000 7f67837fe640 1 -- 172.21.15.6:0/4205293873 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2139399048 0 0) 0x7f678406cc10 con 0x7f678406e2f0 2023-07-21T22:32:10.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.836+0000 7f67837fe640 1 -- 172.21.15.6:0/4205293873 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6774003530 con 0x7f678406e2f0 2023-07-21T22:32:10.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.836+0000 7f678913c640 1 -- 172.21.15.6:0/4205293873 >> v1:172.21.15.161:6789/0 conn(0x7f6784159b90 legacy=0x7f678406dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:10.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.836+0000 7f678913c640 1 -- 172.21.15.6:0/4205293873 >> v1:172.21.15.6:6789/0 conn(0x7f678406e2f0 legacy=0x7f67840ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:10.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.836+0000 7f678913c640 1 -- 172.21.15.6:0/4205293873 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678406c2e0 con 0x7f67840ade00 2023-07-21T22:32:10.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.840+0000 7f678913c640 1 --2- 172.21.15.6:0/4205293873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67840ade00 0x7f678406d0a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f677c009d90 tx=0x7f677c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4aabac356ef71a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:10.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.840+0000 7f67837fe640 1 -- 172.21.15.6:0/4205293873 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c0a59e0 con 0x7f67840ade00 2023-07-21T22:32:10.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.840+0000 7f67837fe640 1 -- 172.21.15.6:0/4205293873 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c0a5b40 con 0x7f67840ade00 2023-07-21T22:32:10.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.840+0000 7f67837fe640 1 -- 172.21.15.6:0/4205293873 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c0ad440 con 0x7f67840ade00 2023-07-21T22:32:10.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.840+0000 7f678ab9f640 1 -- 172.21.15.6:0/4205293873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67840ade00 msgr2=0x7f678406d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:10.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.840+0000 7f678ab9f640 1 --2- 172.21.15.6:0/4205293873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67840ade00 0x7f678406d0a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f677c009d90 tx=0x7f677c01c920 comp rx=0 tx=0).stop 2023-07-21T22:32:10.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.840+0000 7f678ab9f640 1 -- 172.21.15.6:0/4205293873 shutdown_connections 2023-07-21T22:32:10.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.840+0000 7f678ab9f640 1 --2- 172.21.15.6:0/4205293873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67840ade00 0x7f678406d0a0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:10.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.840+0000 7f678ab9f640 1 -- 172.21.15.6:0/4205293873 >> 172.21.15.6:0/4205293873 conn(0x7f67840b1300 msgr2=0x7f67840ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.840+0000 7f678ab9f640 1 -- 172.21.15.6:0/4205293873 shutdown_connections 2023-07-21T22:32:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.840+0000 7f678ab9f640 1 -- 172.21.15.6:0/4205293873 wait complete. 2023-07-21T22:32:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.840+0000 7f678ab9f640 1 Processor -- start 2023-07-21T22:32:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.840+0000 7f678ab9f640 1 -- start start 2023-07-21T22:32:10.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f678ab9f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f678406e2f0 0x7f6784144e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:10.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f678ab9f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67840ade00 0x7f678415a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:10.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f678ab9f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6784159b90 0x7f67840b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:10.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f678ab9f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67840ae240 con 0x7f67840ade00 2023-07-21T22:32:10.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f678ab9f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67840ac540 con 0x7f6784159b90 2023-07-21T22:32:10.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f678ab9f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67840ac240 con 0x7f678406e2f0 2023-07-21T22:32:10.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f6783fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67840ade00 0x7f678415a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:10.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f6783fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67840ade00 0x7f678415a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59796/0 (socket says 172.21.15.6:59796) 2023-07-21T22:32:10.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f6783fff640 1 -- 172.21.15.6:0/2066724734 learned_addr learned my addr 172.21.15.6:0/2066724734 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:10.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f678893b640 1 --2- 172.21.15.6:0/2066724734 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f678406e2f0 0x7f6784144e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:10.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f678913c640 1 --2- 172.21.15.6:0/2066724734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6784159b90 0x7f67840b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:10.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f6783fff640 1 -- 172.21.15.6:0/2066724734 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f678406e2f0 msgr2=0x7f6784144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:10.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f6783fff640 1 --2- 172.21.15.6:0/2066724734 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f678406e2f0 0x7f6784144e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:10.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f6783fff640 1 -- 172.21.15.6:0/2066724734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6784159b90 msgr2=0x7f67840b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:10.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f6783fff640 1 --2- 172.21.15.6:0/2066724734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6784159b90 0x7f67840b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f6783fff640 1 -- 172.21.15.6:0/2066724734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c009a70 con 0x7f67840ade00 2023-07-21T22:32:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f6783fff640 1 --2- 172.21.15.6:0/2066724734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67840ade00 0x7f678415a560 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f677000c4d0 tx=0x7f677000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f67817fa640 1 -- 172.21.15.6:0/2066724734 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770005cf0 con 0x7f67840ade00 2023-07-21T22:32:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f67817fa640 1 -- 172.21.15.6:0/2066724734 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6770005e50 con 0x7f67840ade00 2023-07-21T22:32:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f678ab9f640 1 -- 172.21.15.6:0/2066724734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67840b1b10 con 0x7f67840ade00 2023-07-21T22:32:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f67817fa640 1 -- 172.21.15.6:0/2066724734 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6770007270 con 0x7f67840ade00 2023-07-21T22:32:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f678ab9f640 1 -- 172.21.15.6:0/2066724734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67840b20d0 con 0x7f67840ade00 2023-07-21T22:32:10.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.844+0000 7f678ab9f640 1 -- 172.21.15.6:0/2066724734 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67840ac680 con 0x7f67840ade00 2023-07-21T22:32:10.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.848+0000 7f67817fa640 1 -- 172.21.15.6:0/2066724734 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f67700073d0 con 0x7f67840ade00 2023-07-21T22:32:10.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.848+0000 7f67817fa640 1 --2- 172.21.15.6:0/2066724734 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f67680663a0 0x7f6768068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:10.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.848+0000 7f67817fa640 1 -- 172.21.15.6:0/2066724734 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f67700833d0 con 0x7f67840ade00 2023-07-21T22:32:10.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.848+0000 7f678893b640 1 --2- 172.21.15.6:0/2066724734 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f67680663a0 0x7f6768068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:10.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.848+0000 7f678893b640 1 --2- 172.21.15.6:0/2066724734 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f67680663a0 0x7f6768068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6778007fd0 tx=0x7f6778009040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:10.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:10.852+0000 7f67817fa640 1 -- 172.21.15.6:0/2066724734 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f67840ac680 con 0x7f67840ade00 2023-07-21T22:32:11.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.004+0000 7f678ab9f640 1 -- 172.21.15.6:0/2066724734 --> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67840ac680 con 0x7f67680663a0 2023-07-21T22:32:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.012+0000 7f67817fa640 1 -- 172.21.15.6:0/2066724734 <== mgr.5743 v2:172.21.15.161:6832/3740183048 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311179 (secure 0 0 0) 0x7f67840ac680 con 0x7f67680663a0 2023-07-21T22:32:11.063 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:32:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:32:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.016+0000 7f678ab9f640 1 -- 172.21.15.6:0/2066724734 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f67680663a0 msgr2=0x7f6768068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.016+0000 7f678ab9f640 1 --2- 172.21.15.6:0/2066724734 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f67680663a0 0x7f6768068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6778007fd0 tx=0x7f6778009040 comp rx=0 tx=0).stop 2023-07-21T22:32:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.016+0000 7f678ab9f640 1 -- 172.21.15.6:0/2066724734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67840ade00 msgr2=0x7f678415a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.016+0000 7f678ab9f640 1 --2- 172.21.15.6:0/2066724734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67840ade00 0x7f678415a560 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f677000c4d0 tx=0x7f677000c990 comp rx=0 tx=0).stop 2023-07-21T22:32:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.016+0000 7f678ab9f640 1 -- 172.21.15.6:0/2066724734 shutdown_connections 2023-07-21T22:32:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.016+0000 7f678ab9f640 1 --2- 172.21.15.6:0/2066724734 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f67680663a0 0x7f6768068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.016+0000 7f678ab9f640 1 --2- 172.21.15.6:0/2066724734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6784159b90 0x7f67840b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.016+0000 7f678ab9f640 1 --2- 172.21.15.6:0/2066724734 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67840ade00 0x7f678415a560 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.016+0000 7f678ab9f640 1 --2- 172.21.15.6:0/2066724734 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f678406e2f0 0x7f6784144e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.016+0000 7f678ab9f640 1 -- 172.21.15.6:0/2066724734 >> 172.21.15.6:0/2066724734 conn(0x7f67840b1300 msgr2=0x7f67840ae5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.016+0000 7f678ab9f640 1 -- 172.21.15.6:0/2066724734 shutdown_connections 2023-07-21T22:32:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.016+0000 7f678ab9f640 1 -- 172.21.15.6:0/2066724734 wait complete. 2023-07-21T22:32:11.084 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-07-21T22:32:09.706495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":244,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":295976,"kb_used_data":7400,"kb_used_omap":0,"kb_used_meta":288512,"kb_avail":754678744,"statfs":{"total":773094113280,"available":772791033856,"internally_reserved":0,"allocated":7577600,"data_stored":4248076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":295436288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002195"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.933375+0000","last_change":"2023-07-21T22:32:01.942379+0000","last_active":"2023-07-21T22:32:02.933375+0000","last_peered":"2023-07-21T22:32:02.933375+0000","last_clean":"2023-07-21T22:32:02.933375+0000","last_became_active":"2023-07-21T22:32:01.942087+0000","last_became_peered":"2023-07-21T22:32:01.942087+0000","last_unstale":"2023-07-21T22:32:02.933375+0000","last_undegraded":"2023-07-21T22:32:02.933375+0000","last_fullsized":"2023-07-21T22:32:02.933375+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:41:13.950934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.146612+0000","last_change":"2023-07-21T22:32:01.964851+0000","last_active":"2023-07-21T22:32:03.146612+0000","last_peered":"2023-07-21T22:32:03.146612+0000","last_clean":"2023-07-21T22:32:03.146612+0000","last_became_active":"2023-07-21T22:32:01.964587+0000","last_became_peered":"2023-07-21T22:32:01.964587+0000","last_unstale":"2023-07-21T22:32:03.146612+0000","last_undegraded":"2023-07-21T22:32:03.146612+0000","last_fullsized":"2023-07-21T22:32:03.146612+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:38:45.670832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141450+0000","last_change":"2023-07-21T22:32:01.972620+0000","last_active":"2023-07-21T22:32:03.141450+0000","last_peered":"2023-07-21T22:32:03.141450+0000","last_clean":"2023-07-21T22:32:03.141450+0000","last_became_active":"2023-07-21T22:32:01.971797+0000","last_became_peered":"2023-07-21T22:32:01.971797+0000","last_unstale":"2023-07-21T22:32:03.141450+0000","last_undegraded":"2023-07-21T22:32:03.141450+0000","last_fullsized":"2023-07-21T22:32:03.141450+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:39:24.036848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.146287+0000","last_change":"2023-07-21T22:32:01.969627+0000","last_active":"2023-07-21T22:32:03.146287+0000","last_peered":"2023-07-21T22:32:03.146287+0000","last_clean":"2023-07-21T22:32:03.146287+0000","last_became_active":"2023-07-21T22:32:01.969284+0000","last_became_peered":"2023-07-21T22:32:01.969284+0000","last_unstale":"2023-07-21T22:32:03.146287+0000","last_undegraded":"2023-07-21T22:32:03.146287+0000","last_fullsized":"2023-07-21T22:32:03.146287+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:08:07.431835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.940308+0000","last_change":"2023-07-21T22:32:01.964520+0000","last_active":"2023-07-21T22:32:02.940308+0000","last_peered":"2023-07-21T22:32:02.940308+0000","last_clean":"2023-07-21T22:32:02.940308+0000","last_became_active":"2023-07-21T22:32:01.964164+0000","last_became_peered":"2023-07-21T22:32:01.964164+0000","last_unstale":"2023-07-21T22:32:02.940308+0000","last_undegraded":"2023-07-21T22:32:02.940308+0000","last_fullsized":"2023-07-21T22:32:02.940308+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:32:02.999813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.933123+0000","last_change":"2023-07-21T22:32:01.959954+0000","last_active":"2023-07-21T22:32:02.933123+0000","last_peered":"2023-07-21T22:32:02.933123+0000","last_clean":"2023-07-21T22:32:02.933123+0000","last_became_active":"2023-07-21T22:32:01.959683+0000","last_became_peered":"2023-07-21T22:32:01.959683+0000","last_unstale":"2023-07-21T22:32:02.933123+0000","last_undegraded":"2023-07-21T22:32:02.933123+0000","last_fullsized":"2023-07-21T22:32:02.933123+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:16:14.191148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141216+0000","last_change":"2023-07-21T22:32:01.959593+0000","last_active":"2023-07-21T22:32:03.141216+0000","last_peered":"2023-07-21T22:32:03.141216+0000","last_clean":"2023-07-21T22:32:03.141216+0000","last_became_active":"2023-07-21T22:32:01.959302+0000","last_became_peered":"2023-07-21T22:32:01.959302+0000","last_unstale":"2023-07-21T22:32:03.141216+0000","last_undegraded":"2023-07-21T22:32:03.141216+0000","last_fullsized":"2023-07-21T22:32:03.141216+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:10.638681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.026950+0000","last_change":"2023-07-21T22:32:01.977080+0000","last_active":"2023-07-21T22:32:03.026950+0000","last_peered":"2023-07-21T22:32:03.026950+0000","last_clean":"2023-07-21T22:32:03.026950+0000","last_became_active":"2023-07-21T22:32:01.976808+0000","last_became_peered":"2023-07-21T22:32:01.976808+0000","last_unstale":"2023-07-21T22:32:03.026950+0000","last_undegraded":"2023-07-21T22:32:03.026950+0000","last_fullsized":"2023-07-21T22:32:03.026950+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:10:22.003031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.027539+0000","last_change":"2023-07-21T22:32:01.972152+0000","last_active":"2023-07-21T22:32:03.027539+0000","last_peered":"2023-07-21T22:32:03.027539+0000","last_clean":"2023-07-21T22:32:03.027539+0000","last_became_active":"2023-07-21T22:32:01.969624+0000","last_became_peered":"2023-07-21T22:32:01.969624+0000","last_unstale":"2023-07-21T22:32:03.027539+0000","last_undegraded":"2023-07-21T22:32:03.027539+0000","last_fullsized":"2023-07-21T22:32:03.027539+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:47:26.815431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.933347+0000","last_change":"2023-07-21T22:32:01.948972+0000","last_active":"2023-07-21T22:32:02.933347+0000","last_peered":"2023-07-21T22:32:02.933347+0000","last_clean":"2023-07-21T22:32:02.933347+0000","last_became_active":"2023-07-21T22:32:01.948492+0000","last_became_peered":"2023-07-21T22:32:01.948492+0000","last_unstale":"2023-07-21T22:32:02.933347+0000","last_undegraded":"2023-07-21T22:32:02.933347+0000","last_fullsized":"2023-07-21T22:32:02.933347+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:29.103565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141850+0000","last_change":"2023-07-21T22:32:01.960747+0000","last_active":"2023-07-21T22:32:03.141850+0000","last_peered":"2023-07-21T22:32:03.141850+0000","last_clean":"2023-07-21T22:32:03.141850+0000","last_became_active":"2023-07-21T22:32:01.960456+0000","last_became_peered":"2023-07-21T22:32:01.960456+0000","last_unstale":"2023-07-21T22:32:03.141850+0000","last_undegraded":"2023-07-21T22:32:03.141850+0000","last_fullsized":"2023-07-21T22:32:03.141850+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:52:24.206001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.027429+0000","last_change":"2023-07-21T22:32:01.955781+0000","last_active":"2023-07-21T22:32:03.027429+0000","last_peered":"2023-07-21T22:32:03.027429+0000","last_clean":"2023-07-21T22:32:03.027429+0000","last_became_active":"2023-07-21T22:32:01.950474+0000","last_became_peered":"2023-07-21T22:32:01.950474+0000","last_unstale":"2023-07-21T22:32:03.027429+0000","last_undegraded":"2023-07-21T22:32:03.027429+0000","last_fullsized":"2023-07-21T22:32:03.027429+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:50.717442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.933140+0000","last_change":"2023-07-21T22:32:01.953735+0000","last_active":"2023-07-21T22:32:02.933140+0000","last_peered":"2023-07-21T22:32:02.933140+0000","last_clean":"2023-07-21T22:32:02.933140+0000","last_became_active":"2023-07-21T22:32:01.953463+0000","last_became_peered":"2023-07-21T22:32:01.953463+0000","last_unstale":"2023-07-21T22:32:02.933140+0000","last_undegraded":"2023-07-21T22:32:02.933140+0000","last_fullsized":"2023-07-21T22:32:02.933140+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:57:37.330012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141195+0000","last_change":"2023-07-21T22:32:01.972632+0000","last_active":"2023-07-21T22:32:03.141195+0000","last_peered":"2023-07-21T22:32:03.141195+0000","last_clean":"2023-07-21T22:32:03.141195+0000","last_became_active":"2023-07-21T22:32:01.972034+0000","last_became_peered":"2023-07-21T22:32:01.972034+0000","last_unstale":"2023-07-21T22:32:03.141195+0000","last_undegraded":"2023-07-21T22:32:03.141195+0000","last_fullsized":"2023-07-21T22:32:03.141195+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:52:37.852965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.146129+0000","last_change":"2023-07-21T22:32:01.964018+0000","last_active":"2023-07-21T22:32:03.146129+0000","last_peered":"2023-07-21T22:32:03.146129+0000","last_clean":"2023-07-21T22:32:03.146129+0000","last_became_active":"2023-07-21T22:32:01.963733+0000","last_became_peered":"2023-07-21T22:32:01.963733+0000","last_unstale":"2023-07-21T22:32:03.146129+0000","last_undegraded":"2023-07-21T22:32:03.146129+0000","last_fullsized":"2023-07-21T22:32:03.146129+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:08:35.708631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.933051+0000","last_change":"2023-07-21T22:32:01.950144+0000","last_active":"2023-07-21T22:32:02.933051+0000","last_peered":"2023-07-21T22:32:02.933051+0000","last_clean":"2023-07-21T22:32:02.933051+0000","last_became_active":"2023-07-21T22:32:01.949813+0000","last_became_peered":"2023-07-21T22:32:01.949813+0000","last_unstale":"2023-07-21T22:32:02.933051+0000","last_undegraded":"2023-07-21T22:32:02.933051+0000","last_fullsized":"2023-07-21T22:32:02.933051+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:09.233666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141725+0000","last_change":"2023-07-21T22:32:01.973374+0000","last_active":"2023-07-21T22:32:03.141725+0000","last_peered":"2023-07-21T22:32:03.141725+0000","last_clean":"2023-07-21T22:32:03.141725+0000","last_became_active":"2023-07-21T22:32:01.973075+0000","last_became_peered":"2023-07-21T22:32:01.973075+0000","last_unstale":"2023-07-21T22:32:03.141725+0000","last_undegraded":"2023-07-21T22:32:03.141725+0000","last_fullsized":"2023-07-21T22:32:03.141725+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:42:34.745048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.146671+0000","last_change":"2023-07-21T22:32:01.965052+0000","last_active":"2023-07-21T22:32:03.146671+0000","last_peered":"2023-07-21T22:32:03.146671+0000","last_clean":"2023-07-21T22:32:03.146671+0000","last_became_active":"2023-07-21T22:32:01.964723+0000","last_became_peered":"2023-07-21T22:32:01.964723+0000","last_unstale":"2023-07-21T22:32:03.146671+0000","last_undegraded":"2023-07-21T22:32:03.146671+0000","last_fullsized":"2023-07-21T22:32:03.146671+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:12:18.251968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141573+0000","last_change":"2023-07-21T22:32:01.972806+0000","last_active":"2023-07-21T22:32:03.141573+0000","last_peered":"2023-07-21T22:32:03.141573+0000","last_clean":"2023-07-21T22:32:03.141573+0000","last_became_active":"2023-07-21T22:32:01.972097+0000","last_became_peered":"2023-07-21T22:32:01.972097+0000","last_unstale":"2023-07-21T22:32:03.141573+0000","last_undegraded":"2023-07-21T22:32:03.141573+0000","last_fullsized":"2023-07-21T22:32:03.141573+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:06:58.181304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.949030+0000","last_change":"2023-07-21T22:32:01.956685+0000","last_active":"2023-07-21T22:32:02.949030+0000","last_peered":"2023-07-21T22:32:02.949030+0000","last_clean":"2023-07-21T22:32:02.949030+0000","last_became_active":"2023-07-21T22:32:01.956406+0000","last_became_peered":"2023-07-21T22:32:01.956406+0000","last_unstale":"2023-07-21T22:32:02.949030+0000","last_undegraded":"2023-07-21T22:32:02.949030+0000","last_fullsized":"2023-07-21T22:32:02.949030+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:08:49.868908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.948930+0000","last_change":"2023-07-21T22:32:01.961028+0000","last_active":"2023-07-21T22:32:02.948930+0000","last_peered":"2023-07-21T22:32:02.948930+0000","last_clean":"2023-07-21T22:32:02.948930+0000","last_became_active":"2023-07-21T22:32:01.960751+0000","last_became_peered":"2023-07-21T22:32:01.960751+0000","last_unstale":"2023-07-21T22:32:02.948930+0000","last_undegraded":"2023-07-21T22:32:02.948930+0000","last_fullsized":"2023-07-21T22:32:02.948930+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:27:08.115236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.027053+0000","last_change":"2023-07-21T22:32:01.976799+0000","last_active":"2023-07-21T22:32:03.027053+0000","last_peered":"2023-07-21T22:32:03.027053+0000","last_clean":"2023-07-21T22:32:03.027053+0000","last_became_active":"2023-07-21T22:32:01.976405+0000","last_became_peered":"2023-07-21T22:32:01.976405+0000","last_unstale":"2023-07-21T22:32:03.027053+0000","last_undegraded":"2023-07-21T22:32:03.027053+0000","last_fullsized":"2023-07-21T22:32:03.027053+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:52:11.411628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.140966+0000","last_change":"2023-07-21T22:32:01.960597+0000","last_active":"2023-07-21T22:32:03.140966+0000","last_peered":"2023-07-21T22:32:03.140966+0000","last_clean":"2023-07-21T22:32:03.140966+0000","last_became_active":"2023-07-21T22:32:01.960192+0000","last_became_peered":"2023-07-21T22:32:01.960192+0000","last_unstale":"2023-07-21T22:32:03.140966+0000","last_undegraded":"2023-07-21T22:32:03.140966+0000","last_fullsized":"2023-07-21T22:32:03.140966+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:00:36.479651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141224+0000","last_change":"2023-07-21T22:32:01.967567+0000","last_active":"2023-07-21T22:32:03.141224+0000","last_peered":"2023-07-21T22:32:03.141224+0000","last_clean":"2023-07-21T22:32:03.141224+0000","last_became_active":"2023-07-21T22:32:01.967157+0000","last_became_peered":"2023-07-21T22:32:01.967157+0000","last_unstale":"2023-07-21T22:32:03.141224+0000","last_undegraded":"2023-07-21T22:32:03.141224+0000","last_fullsized":"2023-07-21T22:32:03.141224+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:47:55.206119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141867+0000","last_change":"2023-07-21T22:32:01.962496+0000","last_active":"2023-07-21T22:32:03.141867+0000","last_peered":"2023-07-21T22:32:03.141867+0000","last_clean":"2023-07-21T22:32:03.141867+0000","last_became_active":"2023-07-21T22:32:01.959181+0000","last_became_peered":"2023-07-21T22:32:01.959181+0000","last_unstale":"2023-07-21T22:32:03.141867+0000","last_undegraded":"2023-07-21T22:32:03.141867+0000","last_fullsized":"2023-07-21T22:32:03.141867+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:02:07.248578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.027414+0000","last_change":"2023-07-21T22:32:01.951622+0000","last_active":"2023-07-21T22:32:03.027414+0000","last_peered":"2023-07-21T22:32:03.027414+0000","last_clean":"2023-07-21T22:32:03.027414+0000","last_became_active":"2023-07-21T22:32:01.951028+0000","last_became_peered":"2023-07-21T22:32:01.951028+0000","last_unstale":"2023-07-21T22:32:03.027414+0000","last_undegraded":"2023-07-21T22:32:03.027414+0000","last_fullsized":"2023-07-21T22:32:03.027414+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:45:54.622808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.933474+0000","last_change":"2023-07-21T22:32:01.976951+0000","last_active":"2023-07-21T22:32:02.933474+0000","last_peered":"2023-07-21T22:32:02.933474+0000","last_clean":"2023-07-21T22:32:02.933474+0000","last_became_active":"2023-07-21T22:32:01.976682+0000","last_became_peered":"2023-07-21T22:32:01.976682+0000","last_unstale":"2023-07-21T22:32:02.933474+0000","last_undegraded":"2023-07-21T22:32:02.933474+0000","last_fullsized":"2023-07-21T22:32:02.933474+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:07:23.671962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.949144+0000","last_change":"2023-07-21T22:32:01.953667+0000","last_active":"2023-07-21T22:32:02.949144+0000","last_peered":"2023-07-21T22:32:02.949144+0000","last_clean":"2023-07-21T22:32:02.949144+0000","last_became_active":"2023-07-21T22:32:01.953394+0000","last_became_peered":"2023-07-21T22:32:01.953394+0000","last_unstale":"2023-07-21T22:32:02.949144+0000","last_undegraded":"2023-07-21T22:32:02.949144+0000","last_fullsized":"2023-07-21T22:32:02.949144+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:07:39.107101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.140983+0000","last_change":"2023-07-21T22:32:01.966449+0000","last_active":"2023-07-21T22:32:03.140983+0000","last_peered":"2023-07-21T22:32:03.140983+0000","last_clean":"2023-07-21T22:32:03.140983+0000","last_became_active":"2023-07-21T22:32:01.966142+0000","last_became_peered":"2023-07-21T22:32:01.966142+0000","last_unstale":"2023-07-21T22:32:03.140983+0000","last_undegraded":"2023-07-21T22:32:03.140983+0000","last_fullsized":"2023-07-21T22:32:03.140983+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:45:37.404149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.146224+0000","last_change":"2023-07-21T22:32:01.978778+0000","last_active":"2023-07-21T22:32:03.146224+0000","last_peered":"2023-07-21T22:32:03.146224+0000","last_clean":"2023-07-21T22:32:03.146224+0000","last_became_active":"2023-07-21T22:32:01.978462+0000","last_became_peered":"2023-07-21T22:32:01.978462+0000","last_unstale":"2023-07-21T22:32:03.146224+0000","last_undegraded":"2023-07-21T22:32:03.146224+0000","last_fullsized":"2023-07-21T22:32:03.146224+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:41:41.704421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141358+0000","last_change":"2023-07-21T22:32:01.975459+0000","last_active":"2023-07-21T22:32:03.141358+0000","last_peered":"2023-07-21T22:32:03.141358+0000","last_clean":"2023-07-21T22:32:03.141358+0000","last_became_active":"2023-07-21T22:32:01.973601+0000","last_became_peered":"2023-07-21T22:32:01.973601+0000","last_unstale":"2023-07-21T22:32:03.141358+0000","last_undegraded":"2023-07-21T22:32:03.141358+0000","last_fullsized":"2023-07-21T22:32:03.141358+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:40:49.666946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.940087+0000","last_change":"2023-07-21T22:32:01.956763+0000","last_active":"2023-07-21T22:32:02.940087+0000","last_peered":"2023-07-21T22:32:02.940087+0000","last_clean":"2023-07-21T22:32:02.940087+0000","last_became_active":"2023-07-21T22:32:01.956464+0000","last_became_peered":"2023-07-21T22:32:01.956464+0000","last_unstale":"2023-07-21T22:32:02.940087+0000","last_undegraded":"2023-07-21T22:32:02.940087+0000","last_fullsized":"2023-07-21T22:32:02.940087+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:01:37.815286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.146004+0000","last_change":"2023-07-21T22:32:01.963953+0000","last_active":"2023-07-21T22:32:03.146004+0000","last_peered":"2023-07-21T22:32:03.146004+0000","last_clean":"2023-07-21T22:32:03.146004+0000","last_became_active":"2023-07-21T22:32:01.963654+0000","last_became_peered":"2023-07-21T22:32:01.963654+0000","last_unstale":"2023-07-21T22:32:03.146004+0000","last_undegraded":"2023-07-21T22:32:03.146004+0000","last_fullsized":"2023-07-21T22:32:03.146004+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:47:26.312488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"66'4","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.949256+0000","last_change":"2023-07-21T22:32:00.951495+0000","last_active":"2023-07-21T22:32:02.949256+0000","last_peered":"2023-07-21T22:32:02.949256+0000","last_clean":"2023-07-21T22:32:02.949256+0000","last_became_active":"2023-07-21T22:32:00.951233+0000","last_became_peered":"2023-07-21T22:32:00.951233+0000","last_unstale":"2023-07-21T22:32:02.949256+0000","last_undegraded":"2023-07-21T22:32:02.949256+0000","last_fullsized":"2023-07-21T22:32:02.949256+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:00:35.470195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.939871+0000","last_change":"2023-07-21T22:32:01.962285+0000","last_active":"2023-07-21T22:32:02.939871+0000","last_peered":"2023-07-21T22:32:02.939871+0000","last_clean":"2023-07-21T22:32:02.939871+0000","last_became_active":"2023-07-21T22:32:01.962009+0000","last_became_peered":"2023-07-21T22:32:01.962009+0000","last_unstale":"2023-07-21T22:32:02.939871+0000","last_undegraded":"2023-07-21T22:32:02.939871+0000","last_fullsized":"2023-07-21T22:32:02.939871+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:44:25.133998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"66'1","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.933468+0000","last_change":"2023-07-21T22:32:00.954953+0000","last_active":"2023-07-21T22:32:02.933468+0000","last_peered":"2023-07-21T22:32:02.933468+0000","last_clean":"2023-07-21T22:32:02.933468+0000","last_became_active":"2023-07-21T22:32:00.954668+0000","last_became_peered":"2023-07-21T22:32:00.954668+0000","last_unstale":"2023-07-21T22:32:02.933468+0000","last_undegraded":"2023-07-21T22:32:02.933468+0000","last_fullsized":"2023-07-21T22:32:02.933468+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:48:42.083078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.948931+0000","last_change":"2023-07-21T22:32:01.961055+0000","last_active":"2023-07-21T22:32:02.948931+0000","last_peered":"2023-07-21T22:32:02.948931+0000","last_clean":"2023-07-21T22:32:02.948931+0000","last_became_active":"2023-07-21T22:32:01.960748+0000","last_became_peered":"2023-07-21T22:32:01.960748+0000","last_unstale":"2023-07-21T22:32:02.948931+0000","last_undegraded":"2023-07-21T22:32:02.948931+0000","last_fullsized":"2023-07-21T22:32:02.948931+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:16:09.766871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"66'2","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.933547+0000","last_change":"2023-07-21T22:32:00.949062+0000","last_active":"2023-07-21T22:32:02.933547+0000","last_peered":"2023-07-21T22:32:02.933547+0000","last_clean":"2023-07-21T22:32:02.933547+0000","last_became_active":"2023-07-21T22:32:00.948796+0000","last_became_peered":"2023-07-21T22:32:00.948796+0000","last_unstale":"2023-07-21T22:32:02.933547+0000","last_undegraded":"2023-07-21T22:32:02.933547+0000","last_fullsized":"2023-07-21T22:32:02.933547+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:56:05.202294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.027123+0000","last_change":"2023-07-21T22:32:01.947028+0000","last_active":"2023-07-21T22:32:03.027123+0000","last_peered":"2023-07-21T22:32:03.027123+0000","last_clean":"2023-07-21T22:32:03.027123+0000","last_became_active":"2023-07-21T22:32:01.946737+0000","last_became_peered":"2023-07-21T22:32:01.946737+0000","last_unstale":"2023-07-21T22:32:03.027123+0000","last_undegraded":"2023-07-21T22:32:03.027123+0000","last_fullsized":"2023-07-21T22:32:03.027123+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:59:07.164477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"66'2","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.939687+0000","last_change":"2023-07-21T22:32:00.957955+0000","last_active":"2023-07-21T22:32:02.939687+0000","last_peered":"2023-07-21T22:32:02.939687+0000","last_clean":"2023-07-21T22:32:02.939687+0000","last_became_active":"2023-07-21T22:32:00.957647+0000","last_became_peered":"2023-07-21T22:32:00.957647+0000","last_unstale":"2023-07-21T22:32:02.939687+0000","last_undegraded":"2023-07-21T22:32:02.939687+0000","last_fullsized":"2023-07-21T22:32:02.939687+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:49:45.915692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.940521+0000","last_change":"2023-07-21T22:32:01.976044+0000","last_active":"2023-07-21T22:32:02.940521+0000","last_peered":"2023-07-21T22:32:02.940521+0000","last_clean":"2023-07-21T22:32:02.940521+0000","last_became_active":"2023-07-21T22:32:01.975745+0000","last_became_peered":"2023-07-21T22:32:01.975745+0000","last_unstale":"2023-07-21T22:32:02.940521+0000","last_undegraded":"2023-07-21T22:32:02.940521+0000","last_fullsized":"2023-07-21T22:32:02.940521+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:09:10.636386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"66'1","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141295+0000","last_change":"2023-07-21T22:32:00.939672+0000","last_active":"2023-07-21T22:32:03.141295+0000","last_peered":"2023-07-21T22:32:03.141295+0000","last_clean":"2023-07-21T22:32:03.141295+0000","last_became_active":"2023-07-21T22:32:00.939377+0000","last_became_peered":"2023-07-21T22:32:00.939377+0000","last_unstale":"2023-07-21T22:32:03.141295+0000","last_undegraded":"2023-07-21T22:32:03.141295+0000","last_fullsized":"2023-07-21T22:32:03.141295+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:18:28.623919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.146433+0000","last_change":"2023-07-21T22:32:01.973840+0000","last_active":"2023-07-21T22:32:03.146433+0000","last_peered":"2023-07-21T22:32:03.146433+0000","last_clean":"2023-07-21T22:32:03.146433+0000","last_became_active":"2023-07-21T22:32:01.973571+0000","last_became_peered":"2023-07-21T22:32:01.973571+0000","last_unstale":"2023-07-21T22:32:03.146433+0000","last_undegraded":"2023-07-21T22:32:03.146433+0000","last_fullsized":"2023-07-21T22:32:03.146433+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:45:43.242450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"66'1","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.939381+0000","last_change":"2023-07-21T22:32:00.952492+0000","last_active":"2023-07-21T22:32:02.939381+0000","last_peered":"2023-07-21T22:32:02.939381+0000","last_clean":"2023-07-21T22:32:02.939381+0000","last_became_active":"2023-07-21T22:32:00.952206+0000","last_became_peered":"2023-07-21T22:32:00.952206+0000","last_unstale":"2023-07-21T22:32:02.939381+0000","last_undegraded":"2023-07-21T22:32:02.939381+0000","last_fullsized":"2023-07-21T22:32:02.939381+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:12.978741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.027553+0000","last_change":"2023-07-21T22:32:01.947211+0000","last_active":"2023-07-21T22:32:03.027553+0000","last_peered":"2023-07-21T22:32:03.027553+0000","last_clean":"2023-07-21T22:32:03.027553+0000","last_became_active":"2023-07-21T22:32:01.946915+0000","last_became_peered":"2023-07-21T22:32:01.946915+0000","last_unstale":"2023-07-21T22:32:03.027553+0000","last_undegraded":"2023-07-21T22:32:03.027553+0000","last_fullsized":"2023-07-21T22:32:03.027553+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:43:50.657162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.948910+0000","last_change":"2023-07-21T22:32:00.950894+0000","last_active":"2023-07-21T22:32:02.948910+0000","last_peered":"2023-07-21T22:32:02.948910+0000","last_clean":"2023-07-21T22:32:02.948910+0000","last_became_active":"2023-07-21T22:32:00.950574+0000","last_became_peered":"2023-07-21T22:32:00.950574+0000","last_unstale":"2023-07-21T22:32:02.948910+0000","last_undegraded":"2023-07-21T22:32:02.948910+0000","last_fullsized":"2023-07-21T22:32:02.948910+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:00:22.685969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.146594+0000","last_change":"2023-07-21T22:32:01.981263+0000","last_active":"2023-07-21T22:32:03.146594+0000","last_peered":"2023-07-21T22:32:03.146594+0000","last_clean":"2023-07-21T22:32:03.146594+0000","last_became_active":"2023-07-21T22:32:01.980961+0000","last_became_peered":"2023-07-21T22:32:01.980961+0000","last_unstale":"2023-07-21T22:32:03.146594+0000","last_undegraded":"2023-07-21T22:32:03.146594+0000","last_fullsized":"2023-07-21T22:32:03.146594+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:44:06.878885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141058+0000","last_change":"2023-07-21T22:32:00.950304+0000","last_active":"2023-07-21T22:32:03.141058+0000","last_peered":"2023-07-21T22:32:03.141058+0000","last_clean":"2023-07-21T22:32:03.141058+0000","last_became_active":"2023-07-21T22:32:00.949932+0000","last_became_peered":"2023-07-21T22:32:00.949932+0000","last_unstale":"2023-07-21T22:32:03.141058+0000","last_undegraded":"2023-07-21T22:32:03.141058+0000","last_fullsized":"2023-07-21T22:32:03.141058+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:51:27.690135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.939719+0000","last_change":"2023-07-21T22:32:01.959728+0000","last_active":"2023-07-21T22:32:02.939719+0000","last_peered":"2023-07-21T22:32:02.939719+0000","last_clean":"2023-07-21T22:32:02.939719+0000","last_became_active":"2023-07-21T22:32:01.959410+0000","last_became_peered":"2023-07-21T22:32:01.959410+0000","last_unstale":"2023-07-21T22:32:02.939719+0000","last_undegraded":"2023-07-21T22:32:02.939719+0000","last_fullsized":"2023-07-21T22:32:02.939719+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:05:43.504093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.146566+0000","last_change":"2023-07-21T22:32:00.949543+0000","last_active":"2023-07-21T22:32:03.146566+0000","last_peered":"2023-07-21T22:32:03.146566+0000","last_clean":"2023-07-21T22:32:03.146566+0000","last_became_active":"2023-07-21T22:32:00.949230+0000","last_became_peered":"2023-07-21T22:32:00.949230+0000","last_unstale":"2023-07-21T22:32:03.146566+0000","last_undegraded":"2023-07-21T22:32:03.146566+0000","last_fullsized":"2023-07-21T22:32:03.146566+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:30:20.234878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.939693+0000","last_change":"2023-07-21T22:32:01.955981+0000","last_active":"2023-07-21T22:32:02.939693+0000","last_peered":"2023-07-21T22:32:02.939693+0000","last_clean":"2023-07-21T22:32:02.939693+0000","last_became_active":"2023-07-21T22:32:01.955641+0000","last_became_peered":"2023-07-21T22:32:01.955641+0000","last_unstale":"2023-07-21T22:32:02.939693+0000","last_undegraded":"2023-07-21T22:32:02.939693+0000","last_fullsized":"2023-07-21T22:32:02.939693+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:17:00.332770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.940798+0000","last_change":"2023-07-21T22:32:00.951734+0000","last_active":"2023-07-21T22:32:02.940798+0000","last_peered":"2023-07-21T22:32:02.940798+0000","last_clean":"2023-07-21T22:32:02.940798+0000","last_became_active":"2023-07-21T22:32:00.950944+0000","last_became_peered":"2023-07-21T22:32:00.950944+0000","last_unstale":"2023-07-21T22:32:02.940798+0000","last_undegraded":"2023-07-21T22:32:02.940798+0000","last_fullsized":"2023-07-21T22:32:02.940798+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:21:55.992047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141344+0000","last_change":"2023-07-21T22:32:01.972392+0000","last_active":"2023-07-21T22:32:03.141344+0000","last_peered":"2023-07-21T22:32:03.141344+0000","last_clean":"2023-07-21T22:32:03.141344+0000","last_became_active":"2023-07-21T22:32:01.971641+0000","last_became_peered":"2023-07-21T22:32:01.971641+0000","last_unstale":"2023-07-21T22:32:03.141344+0000","last_undegraded":"2023-07-21T22:32:03.141344+0000","last_fullsized":"2023-07-21T22:32:03.141344+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:28:41.218094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"66'3","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.146534+0000","last_change":"2023-07-21T22:32:00.955950+0000","last_active":"2023-07-21T22:32:03.146534+0000","last_peered":"2023-07-21T22:32:03.146534+0000","last_clean":"2023-07-21T22:32:03.146534+0000","last_became_active":"2023-07-21T22:32:00.955656+0000","last_became_peered":"2023-07-21T22:32:00.955656+0000","last_unstale":"2023-07-21T22:32:03.146534+0000","last_undegraded":"2023-07-21T22:32:03.146534+0000","last_fullsized":"2023-07-21T22:32:03.146534+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:49:15.962023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.940316+0000","last_change":"2023-07-21T22:32:01.952331+0000","last_active":"2023-07-21T22:32:02.940316+0000","last_peered":"2023-07-21T22:32:02.940316+0000","last_clean":"2023-07-21T22:32:02.940316+0000","last_became_active":"2023-07-21T22:32:01.952023+0000","last_became_peered":"2023-07-21T22:32:01.952023+0000","last_unstale":"2023-07-21T22:32:02.940316+0000","last_undegraded":"2023-07-21T22:32:02.940316+0000","last_fullsized":"2023-07-21T22:32:02.940316+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:56:33.346078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"66'6","reported_seq":19,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.027556+0000","last_change":"2023-07-21T22:32:00.944870+0000","last_active":"2023-07-21T22:32:03.027556+0000","last_peered":"2023-07-21T22:32:03.027556+0000","last_clean":"2023-07-21T22:32:03.027556+0000","last_became_active":"2023-07-21T22:32:00.944534+0000","last_became_peered":"2023-07-21T22:32:00.944534+0000","last_unstale":"2023-07-21T22:32:03.027556+0000","last_undegraded":"2023-07-21T22:32:03.027556+0000","last_fullsized":"2023-07-21T22:32:03.027556+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:32:58.211664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.939518+0000","last_change":"2023-07-21T22:32:01.965016+0000","last_active":"2023-07-21T22:32:02.939518+0000","last_peered":"2023-07-21T22:32:02.939518+0000","last_clean":"2023-07-21T22:32:02.939518+0000","last_became_active":"2023-07-21T22:32:01.964733+0000","last_became_peered":"2023-07-21T22:32:01.964733+0000","last_unstale":"2023-07-21T22:32:02.939518+0000","last_undegraded":"2023-07-21T22:32:02.939518+0000","last_fullsized":"2023-07-21T22:32:02.939518+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:04:57.519635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"66'2","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141196+0000","last_change":"2023-07-21T22:32:00.946546+0000","last_active":"2023-07-21T22:32:03.141196+0000","last_peered":"2023-07-21T22:32:03.141196+0000","last_clean":"2023-07-21T22:32:03.141196+0000","last_became_active":"2023-07-21T22:32:00.946230+0000","last_became_peered":"2023-07-21T22:32:00.946230+0000","last_unstale":"2023-07-21T22:32:03.141196+0000","last_undegraded":"2023-07-21T22:32:03.141196+0000","last_fullsized":"2023-07-21T22:32:03.141196+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:06:29.194029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141691+0000","last_change":"2023-07-21T22:32:01.972378+0000","last_active":"2023-07-21T22:32:03.141691+0000","last_peered":"2023-07-21T22:32:03.141691+0000","last_clean":"2023-07-21T22:32:03.141691+0000","last_became_active":"2023-07-21T22:32:01.971472+0000","last_became_peered":"2023-07-21T22:32:01.971472+0000","last_unstale":"2023-07-21T22:32:03.141691+0000","last_undegraded":"2023-07-21T22:32:03.141691+0000","last_fullsized":"2023-07-21T22:32:03.141691+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:33:04.347985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.948958+0000","last_change":"2023-07-21T22:32:00.948760+0000","last_active":"2023-07-21T22:32:02.948958+0000","last_peered":"2023-07-21T22:32:02.948958+0000","last_clean":"2023-07-21T22:32:02.948958+0000","last_became_active":"2023-07-21T22:32:00.948465+0000","last_became_peered":"2023-07-21T22:32:00.948465+0000","last_unstale":"2023-07-21T22:32:02.948958+0000","last_undegraded":"2023-07-21T22:32:02.948958+0000","last_fullsized":"2023-07-21T22:32:02.948958+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:00:15.698112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.027428+0000","last_change":"2023-07-21T22:32:01.959867+0000","last_active":"2023-07-21T22:32:03.027428+0000","last_peered":"2023-07-21T22:32:03.027428+0000","last_clean":"2023-07-21T22:32:03.027428+0000","last_became_active":"2023-07-21T22:32:01.959619+0000","last_became_peered":"2023-07-21T22:32:01.959619+0000","last_unstale":"2023-07-21T22:32:03.027428+0000","last_undegraded":"2023-07-21T22:32:03.027428+0000","last_fullsized":"2023-07-21T22:32:03.027428+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:48:06.483834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.146233+0000","last_change":"2023-07-21T22:32:00.952133+0000","last_active":"2023-07-21T22:32:03.146233+0000","last_peered":"2023-07-21T22:32:03.146233+0000","last_clean":"2023-07-21T22:32:03.146233+0000","last_became_active":"2023-07-21T22:32:00.951734+0000","last_became_peered":"2023-07-21T22:32:00.951734+0000","last_unstale":"2023-07-21T22:32:03.146233+0000","last_undegraded":"2023-07-21T22:32:03.146233+0000","last_fullsized":"2023-07-21T22:32:03.146233+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:38:52.752230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141532+0000","last_change":"2023-07-21T22:32:01.966430+0000","last_active":"2023-07-21T22:32:03.141532+0000","last_peered":"2023-07-21T22:32:03.141532+0000","last_clean":"2023-07-21T22:32:03.141532+0000","last_became_active":"2023-07-21T22:32:01.966068+0000","last_became_peered":"2023-07-21T22:32:01.966068+0000","last_unstale":"2023-07-21T22:32:03.141532+0000","last_undegraded":"2023-07-21T22:32:03.141532+0000","last_fullsized":"2023-07-21T22:32:03.141532+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:18:24.353174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"66'8","reported_seq":21,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.027190+0000","last_change":"2023-07-21T22:32:00.952275+0000","last_active":"2023-07-21T22:32:03.027190+0000","last_peered":"2023-07-21T22:32:03.027190+0000","last_clean":"2023-07-21T22:32:03.027190+0000","last_became_active":"2023-07-21T22:32:00.951981+0000","last_became_peered":"2023-07-21T22:32:00.951981+0000","last_unstale":"2023-07-21T22:32:03.027190+0000","last_undegraded":"2023-07-21T22:32:03.027190+0000","last_fullsized":"2023-07-21T22:32:03.027190+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:41:53.127716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.027018+0000","last_change":"2023-07-21T22:32:01.953857+0000","last_active":"2023-07-21T22:32:03.027018+0000","last_peered":"2023-07-21T22:32:03.027018+0000","last_clean":"2023-07-21T22:32:03.027018+0000","last_became_active":"2023-07-21T22:32:01.950988+0000","last_became_peered":"2023-07-21T22:32:01.950988+0000","last_unstale":"2023-07-21T22:32:03.027018+0000","last_undegraded":"2023-07-21T22:32:03.027018+0000","last_fullsized":"2023-07-21T22:32:03.027018+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:43:38.407829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"66'1","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141864+0000","last_change":"2023-07-21T22:32:00.953359+0000","last_active":"2023-07-21T22:32:03.141864+0000","last_peered":"2023-07-21T22:32:03.141864+0000","last_clean":"2023-07-21T22:32:03.141864+0000","last_became_active":"2023-07-21T22:32:00.953042+0000","last_became_peered":"2023-07-21T22:32:00.953042+0000","last_unstale":"2023-07-21T22:32:03.141864+0000","last_undegraded":"2023-07-21T22:32:03.141864+0000","last_fullsized":"2023-07-21T22:32:03.141864+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:15:59.123276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.933051+0000","last_change":"2023-07-21T22:32:01.959374+0000","last_active":"2023-07-21T22:32:02.933051+0000","last_peered":"2023-07-21T22:32:02.933051+0000","last_clean":"2023-07-21T22:32:02.933051+0000","last_became_active":"2023-07-21T22:32:01.958988+0000","last_became_peered":"2023-07-21T22:32:01.958988+0000","last_unstale":"2023-07-21T22:32:02.933051+0000","last_undegraded":"2023-07-21T22:32:02.933051+0000","last_fullsized":"2023-07-21T22:32:02.933051+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:02:14.376813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"66'2","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.142038+0000","last_change":"2023-07-21T22:32:00.943392+0000","last_active":"2023-07-21T22:32:03.142038+0000","last_peered":"2023-07-21T22:32:03.142038+0000","last_clean":"2023-07-21T22:32:03.142038+0000","last_became_active":"2023-07-21T22:32:00.943043+0000","last_became_peered":"2023-07-21T22:32:00.943043+0000","last_unstale":"2023-07-21T22:32:03.142038+0000","last_undegraded":"2023-07-21T22:32:03.142038+0000","last_fullsized":"2023-07-21T22:32:03.142038+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:17:06.719592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.939274+0000","last_change":"2023-07-21T22:32:01.979493+0000","last_active":"2023-07-21T22:32:02.939274+0000","last_peered":"2023-07-21T22:32:02.939274+0000","last_clean":"2023-07-21T22:32:02.939274+0000","last_became_active":"2023-07-21T22:32:01.979186+0000","last_became_peered":"2023-07-21T22:32:01.979186+0000","last_unstale":"2023-07-21T22:32:02.939274+0000","last_undegraded":"2023-07-21T22:32:02.939274+0000","last_fullsized":"2023-07-21T22:32:02.939274+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:43:42.501397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"66'1","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.949211+0000","last_change":"2023-07-21T22:32:00.954859+0000","last_active":"2023-07-21T22:32:02.949211+0000","last_peered":"2023-07-21T22:32:02.949211+0000","last_clean":"2023-07-21T22:32:02.949211+0000","last_became_active":"2023-07-21T22:32:00.954521+0000","last_became_peered":"2023-07-21T22:32:00.954521+0000","last_unstale":"2023-07-21T22:32:02.949211+0000","last_undegraded":"2023-07-21T22:32:02.949211+0000","last_fullsized":"2023-07-21T22:32:02.949211+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:38:59.652094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.933296+0000","last_change":"2023-07-21T22:32:01.942325+0000","last_active":"2023-07-21T22:32:02.933296+0000","last_peered":"2023-07-21T22:32:02.933296+0000","last_clean":"2023-07-21T22:32:02.933296+0000","last_became_active":"2023-07-21T22:32:01.941992+0000","last_became_peered":"2023-07-21T22:32:01.941992+0000","last_unstale":"2023-07-21T22:32:02.933296+0000","last_undegraded":"2023-07-21T22:32:02.933296+0000","last_fullsized":"2023-07-21T22:32:02.933296+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:27:45.090981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.949226+0000","last_change":"2023-07-21T22:32:00.957742+0000","last_active":"2023-07-21T22:32:02.949226+0000","last_peered":"2023-07-21T22:32:02.949226+0000","last_clean":"2023-07-21T22:32:02.949226+0000","last_became_active":"2023-07-21T22:32:00.957336+0000","last_became_peered":"2023-07-21T22:32:00.957336+0000","last_unstale":"2023-07-21T22:32:02.949226+0000","last_undegraded":"2023-07-21T22:32:02.949226+0000","last_fullsized":"2023-07-21T22:32:02.949226+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:36:03.866383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.939591+0000","last_change":"2023-07-21T22:32:01.954574+0000","last_active":"2023-07-21T22:32:02.939591+0000","last_peered":"2023-07-21T22:32:02.939591+0000","last_clean":"2023-07-21T22:32:02.939591+0000","last_became_active":"2023-07-21T22:32:01.954271+0000","last_became_peered":"2023-07-21T22:32:01.954271+0000","last_unstale":"2023-07-21T22:32:02.939591+0000","last_undegraded":"2023-07-21T22:32:02.939591+0000","last_fullsized":"2023-07-21T22:32:02.939591+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:43:09.030555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"66'2","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.933441+0000","last_change":"2023-07-21T22:32:00.946873+0000","last_active":"2023-07-21T22:32:02.933441+0000","last_peered":"2023-07-21T22:32:02.933441+0000","last_clean":"2023-07-21T22:32:02.933441+0000","last_became_active":"2023-07-21T22:32:00.946537+0000","last_became_peered":"2023-07-21T22:32:00.946537+0000","last_unstale":"2023-07-21T22:32:02.933441+0000","last_undegraded":"2023-07-21T22:32:02.933441+0000","last_fullsized":"2023-07-21T22:32:02.933441+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:09:22.382616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.949160+0000","last_change":"2023-07-21T22:32:01.955666+0000","last_active":"2023-07-21T22:32:02.949160+0000","last_peered":"2023-07-21T22:32:02.949160+0000","last_clean":"2023-07-21T22:32:02.949160+0000","last_became_active":"2023-07-21T22:32:01.955405+0000","last_became_peered":"2023-07-21T22:32:01.955405+0000","last_unstale":"2023-07-21T22:32:02.949160+0000","last_undegraded":"2023-07-21T22:32:02.949160+0000","last_fullsized":"2023-07-21T22:32:02.949160+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:49:14.120919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.027100+0000","last_change":"2023-07-21T22:32:00.943926+0000","last_active":"2023-07-21T22:32:03.027100+0000","last_peered":"2023-07-21T22:32:03.027100+0000","last_clean":"2023-07-21T22:32:03.027100+0000","last_became_active":"2023-07-21T22:32:00.943551+0000","last_became_peered":"2023-07-21T22:32:00.943551+0000","last_unstale":"2023-07-21T22:32:03.027100+0000","last_undegraded":"2023-07-21T22:32:03.027100+0000","last_fullsized":"2023-07-21T22:32:03.027100+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:52:45.594944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.142017+0000","last_change":"2023-07-21T22:32:01.960111+0000","last_active":"2023-07-21T22:32:03.142017+0000","last_peered":"2023-07-21T22:32:03.142017+0000","last_clean":"2023-07-21T22:32:03.142017+0000","last_became_active":"2023-07-21T22:32:01.959824+0000","last_became_peered":"2023-07-21T22:32:01.959824+0000","last_unstale":"2023-07-21T22:32:03.142017+0000","last_undegraded":"2023-07-21T22:32:03.142017+0000","last_fullsized":"2023-07-21T22:32:03.142017+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:52:46.482327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141351+0000","last_change":"2023-07-21T22:32:00.949051+0000","last_active":"2023-07-21T22:32:03.141351+0000","last_peered":"2023-07-21T22:32:03.141351+0000","last_clean":"2023-07-21T22:32:03.141351+0000","last_became_active":"2023-07-21T22:32:00.948748+0000","last_became_peered":"2023-07-21T22:32:00.948748+0000","last_unstale":"2023-07-21T22:32:03.141351+0000","last_undegraded":"2023-07-21T22:32:03.141351+0000","last_fullsized":"2023-07-21T22:32:03.141351+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:26:27.805707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.933511+0000","last_change":"2023-07-21T22:32:01.952539+0000","last_active":"2023-07-21T22:32:02.933511+0000","last_peered":"2023-07-21T22:32:02.933511+0000","last_clean":"2023-07-21T22:32:02.933511+0000","last_became_active":"2023-07-21T22:32:01.952266+0000","last_became_peered":"2023-07-21T22:32:01.952266+0000","last_unstale":"2023-07-21T22:32:02.933511+0000","last_undegraded":"2023-07-21T22:32:02.933511+0000","last_fullsized":"2023-07-21T22:32:02.933511+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:01:51.569492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.140933+0000","last_change":"2023-07-21T22:32:00.944727+0000","last_active":"2023-07-21T22:32:03.140933+0000","last_peered":"2023-07-21T22:32:03.140933+0000","last_clean":"2023-07-21T22:32:03.140933+0000","last_became_active":"2023-07-21T22:32:00.944461+0000","last_became_peered":"2023-07-21T22:32:00.944461+0000","last_unstale":"2023-07-21T22:32:03.140933+0000","last_undegraded":"2023-07-21T22:32:03.140933+0000","last_fullsized":"2023-07-21T22:32:03.140933+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:36:03.866383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.948891+0000","last_change":"2023-07-21T22:32:01.952976+0000","last_active":"2023-07-21T22:32:02.948891+0000","last_peered":"2023-07-21T22:32:02.948891+0000","last_clean":"2023-07-21T22:32:02.948891+0000","last_became_active":"2023-07-21T22:32:01.952659+0000","last_became_peered":"2023-07-21T22:32:01.952659+0000","last_unstale":"2023-07-21T22:32:02.948891+0000","last_undegraded":"2023-07-21T22:32:02.948891+0000","last_fullsized":"2023-07-21T22:32:02.948891+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:09:06.226217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"67'1","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.142168+0000","last_change":"2023-07-21T22:32:00.947839+0000","last_active":"2023-07-21T22:32:03.142168+0000","last_peered":"2023-07-21T22:32:03.142168+0000","last_clean":"2023-07-21T22:32:03.142168+0000","last_became_active":"2023-07-21T22:32:00.947416+0000","last_became_peered":"2023-07-21T22:32:00.947416+0000","last_unstale":"2023-07-21T22:32:03.142168+0000","last_undegraded":"2023-07-21T22:32:03.142168+0000","last_fullsized":"2023-07-21T22:32:03.142168+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:34:33.097470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'139","reported_seq":331,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.146302+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:32:03.146302+0000","last_peered":"2023-07-21T22:32:03.146302+0000","last_clean":"2023-07-21T22:32:03.146302+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:32:03.146302+0000","last_undegraded":"2023-07-21T22:32:03.146302+0000","last_fullsized":"2023-07-21T22:32:03.146302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:17:01.808697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":105,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.939868+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:32:02.939868+0000","last_peered":"2023-07-21T22:32:02.939868+0000","last_clean":"2023-07-21T22:32:02.939868+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:32:02.939868+0000","last_undegraded":"2023-07-21T22:32:02.939868+0000","last_fullsized":"2023-07-21T22:32:02.939868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:33:43.643106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.933256+0000","last_change":"2023-07-21T22:32:01.941266+0000","last_active":"2023-07-21T22:32:02.933256+0000","last_peered":"2023-07-21T22:32:02.933256+0000","last_clean":"2023-07-21T22:32:02.933256+0000","last_became_active":"2023-07-21T22:32:01.940939+0000","last_became_peered":"2023-07-21T22:32:01.940939+0000","last_unstale":"2023-07-21T22:32:02.933256+0000","last_undegraded":"2023-07-21T22:32:02.933256+0000","last_fullsized":"2023-07-21T22:32:02.933256+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:18:12.141365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.146609+0000","last_change":"2023-07-21T22:32:00.955530+0000","last_active":"2023-07-21T22:32:03.146609+0000","last_peered":"2023-07-21T22:32:03.146609+0000","last_clean":"2023-07-21T22:32:03.146609+0000","last_became_active":"2023-07-21T22:32:00.955208+0000","last_became_peered":"2023-07-21T22:32:00.955208+0000","last_unstale":"2023-07-21T22:32:03.146609+0000","last_undegraded":"2023-07-21T22:32:03.146609+0000","last_fullsized":"2023-07-21T22:32:03.146609+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:06:16.267091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.146336+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:32:03.146336+0000","last_peered":"2023-07-21T22:32:03.146336+0000","last_clean":"2023-07-21T22:32:03.146336+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:32:03.146336+0000","last_undegraded":"2023-07-21T22:32:03.146336+0000","last_fullsized":"2023-07-21T22:32:03.146336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:42:31.262636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.027337+0000","last_change":"2023-07-21T22:32:01.953115+0000","last_active":"2023-07-21T22:32:03.027337+0000","last_peered":"2023-07-21T22:32:03.027337+0000","last_clean":"2023-07-21T22:32:03.027337+0000","last_became_active":"2023-07-21T22:32:01.952751+0000","last_became_peered":"2023-07-21T22:32:01.952751+0000","last_unstale":"2023-07-21T22:32:03.027337+0000","last_undegraded":"2023-07-21T22:32:03.027337+0000","last_fullsized":"2023-07-21T22:32:03.027337+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:03:53.210319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141179+0000","last_change":"2023-07-21T22:32:00.947085+0000","last_active":"2023-07-21T22:32:03.141179+0000","last_peered":"2023-07-21T22:32:03.141179+0000","last_clean":"2023-07-21T22:32:03.141179+0000","last_became_active":"2023-07-21T22:32:00.946461+0000","last_became_peered":"2023-07-21T22:32:00.946461+0000","last_unstale":"2023-07-21T22:32:03.141179+0000","last_undegraded":"2023-07-21T22:32:03.141179+0000","last_fullsized":"2023-07-21T22:32:03.141179+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:27:51.681751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141663+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:32:03.141663+0000","last_peered":"2023-07-21T22:32:03.141663+0000","last_clean":"2023-07-21T22:32:03.141663+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:32:03.141663+0000","last_undegraded":"2023-07-21T22:32:03.141663+0000","last_fullsized":"2023-07-21T22:32:03.141663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:57:55.489110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.939922+0000","last_change":"2023-07-21T22:32:01.948997+0000","last_active":"2023-07-21T22:32:02.939922+0000","last_peered":"2023-07-21T22:32:02.939922+0000","last_clean":"2023-07-21T22:32:02.939922+0000","last_became_active":"2023-07-21T22:32:01.948684+0000","last_became_peered":"2023-07-21T22:32:01.948684+0000","last_unstale":"2023-07-21T22:32:02.939922+0000","last_undegraded":"2023-07-21T22:32:02.939922+0000","last_fullsized":"2023-07-21T22:32:02.939922+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:26:14.714761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"66'2","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.949294+0000","last_change":"2023-07-21T22:32:00.955354+0000","last_active":"2023-07-21T22:32:02.949294+0000","last_peered":"2023-07-21T22:32:02.949294+0000","last_clean":"2023-07-21T22:32:02.949294+0000","last_became_active":"2023-07-21T22:32:00.954992+0000","last_became_peered":"2023-07-21T22:32:00.954992+0000","last_unstale":"2023-07-21T22:32:02.949294+0000","last_undegraded":"2023-07-21T22:32:02.949294+0000","last_fullsized":"2023-07-21T22:32:02.949294+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:11:18.140439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":105,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.940032+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:32:02.940032+0000","last_peered":"2023-07-21T22:32:02.940032+0000","last_clean":"2023-07-21T22:32:02.940032+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:32:02.940032+0000","last_undegraded":"2023-07-21T22:32:02.940032+0000","last_fullsized":"2023-07-21T22:32:02.940032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:27:45.242422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141903+0000","last_change":"2023-07-21T22:32:01.966950+0000","last_active":"2023-07-21T22:32:03.141903+0000","last_peered":"2023-07-21T22:32:03.141903+0000","last_clean":"2023-07-21T22:32:03.141903+0000","last_became_active":"2023-07-21T22:32:01.966671+0000","last_became_peered":"2023-07-21T22:32:01.966671+0000","last_unstale":"2023-07-21T22:32:03.141903+0000","last_undegraded":"2023-07-21T22:32:03.141903+0000","last_fullsized":"2023-07-21T22:32:03.141903+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:55:00.260067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.939255+0000","last_change":"2023-07-21T22:32:00.957850+0000","last_active":"2023-07-21T22:32:02.939255+0000","last_peered":"2023-07-21T22:32:02.939255+0000","last_clean":"2023-07-21T22:32:02.939255+0000","last_became_active":"2023-07-21T22:32:00.957501+0000","last_became_peered":"2023-07-21T22:32:00.957501+0000","last_unstale":"2023-07-21T22:32:02.939255+0000","last_undegraded":"2023-07-21T22:32:02.939255+0000","last_fullsized":"2023-07-21T22:32:02.939255+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:38:57.377958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.933187+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:32:02.933187+0000","last_peered":"2023-07-21T22:32:02.933187+0000","last_clean":"2023-07-21T22:32:02.933187+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:32:02.933187+0000","last_undegraded":"2023-07-21T22:32:02.933187+0000","last_fullsized":"2023-07-21T22:32:02.933187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:07:13.354818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.027532+0000","last_change":"2023-07-21T22:32:01.951405+0000","last_active":"2023-07-21T22:32:03.027532+0000","last_peered":"2023-07-21T22:32:03.027532+0000","last_clean":"2023-07-21T22:32:03.027532+0000","last_became_active":"2023-07-21T22:32:01.950883+0000","last_became_peered":"2023-07-21T22:32:01.950883+0000","last_unstale":"2023-07-21T22:32:03.027532+0000","last_undegraded":"2023-07-21T22:32:03.027532+0000","last_fullsized":"2023-07-21T22:32:03.027532+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:11:31.035187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.940063+0000","last_change":"2023-07-21T22:32:00.954255+0000","last_active":"2023-07-21T22:32:02.940063+0000","last_peered":"2023-07-21T22:32:02.940063+0000","last_clean":"2023-07-21T22:32:02.940063+0000","last_became_active":"2023-07-21T22:32:00.953914+0000","last_became_peered":"2023-07-21T22:32:00.953914+0000","last_unstale":"2023-07-21T22:32:02.940063+0000","last_undegraded":"2023-07-21T22:32:02.940063+0000","last_fullsized":"2023-07-21T22:32:02.940063+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:43:01.467317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.146694+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:32:03.146694+0000","last_peered":"2023-07-21T22:32:03.146694+0000","last_clean":"2023-07-21T22:32:03.146694+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:32:03.146694+0000","last_undegraded":"2023-07-21T22:32:03.146694+0000","last_fullsized":"2023-07-21T22:32:03.146694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:06:28.015023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.141138+0000","last_change":"2023-07-21T22:32:01.975576+0000","last_active":"2023-07-21T22:32:03.141138+0000","last_peered":"2023-07-21T22:32:03.141138+0000","last_clean":"2023-07-21T22:32:03.141138+0000","last_became_active":"2023-07-21T22:32:01.973507+0000","last_became_peered":"2023-07-21T22:32:01.973507+0000","last_unstale":"2023-07-21T22:32:03.141138+0000","last_undegraded":"2023-07-21T22:32:03.141138+0000","last_fullsized":"2023-07-21T22:32:03.141138+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:43:31.817447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.027271+0000","last_change":"2023-07-21T22:32:00.945223+0000","last_active":"2023-07-21T22:32:03.027271+0000","last_peered":"2023-07-21T22:32:03.027271+0000","last_clean":"2023-07-21T22:32:03.027271+0000","last_became_active":"2023-07-21T22:32:00.944958+0000","last_became_peered":"2023-07-21T22:32:00.944958+0000","last_unstale":"2023-07-21T22:32:03.027271+0000","last_undegraded":"2023-07-21T22:32:03.027271+0000","last_fullsized":"2023-07-21T22:32:03.027271+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:29:41.391974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.933590+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:32:02.933590+0000","last_peered":"2023-07-21T22:32:02.933590+0000","last_clean":"2023-07-21T22:32:02.933590+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:32:02.933590+0000","last_undegraded":"2023-07-21T22:32:02.933590+0000","last_fullsized":"2023-07-21T22:32:02.933590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:51:11.916101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.939474+0000","last_change":"2023-07-21T22:32:01.964737+0000","last_active":"2023-07-21T22:32:02.939474+0000","last_peered":"2023-07-21T22:32:02.939474+0000","last_clean":"2023-07-21T22:32:02.939474+0000","last_became_active":"2023-07-21T22:32:01.964348+0000","last_became_peered":"2023-07-21T22:32:01.964348+0000","last_unstale":"2023-07-21T22:32:02.939474+0000","last_undegraded":"2023-07-21T22:32:02.939474+0000","last_fullsized":"2023-07-21T22:32:02.939474+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:32:00.917633+0000","last_clean_scrub_stamp":"2023-07-21T22:32:00.917633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:23:40.788261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:03.027191+0000","last_change":"2023-07-21T22:32:00.951682+0000","last_active":"2023-07-21T22:32:03.027191+0000","last_peered":"2023-07-21T22:32:03.027191+0000","last_clean":"2023-07-21T22:32:03.027191+0000","last_became_active":"2023-07-21T22:32:00.951375+0000","last_became_peered":"2023-07-21T22:32:00.951375+0000","last_unstale":"2023-07-21T22:32:03.027191+0000","last_undegraded":"2023-07-21T22:32:03.027191+0000","last_fullsized":"2023-07-21T22:32:03.027191+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:31:59.908178+0000","last_clean_scrub_stamp":"2023-07-21T22:31:59.908178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:33:53.687529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-07-21T22:32:02.949386+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:32:02.949386+0000","last_peered":"2023-07-21T22:32:02.949386+0000","last_clean":"2023-07-21T22:32:02.949386+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:32:02.949386+0000","last_undegraded":"2023-07-21T22:32:02.949386+0000","last_fullsized":"2023-07-21T22:32:02.949386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:39:00.545217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509605,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54552,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317288,"statfs":{"total":96636764160,"available":96580902912,"internally_reserved":0,"allocated":1392640,"data_stored":973319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.72899999999999998,"15min":0.72399999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.32600000000000001},"max":{"1min":0.91700000000000004,"5min":0.95699999999999996,"15min":1.28},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.68899999999999995,"15min":0.67800000000000005},"min":{"1min":0.436,"5min":0.39500000000000002,"15min":0.36099999999999999},"max":{"1min":0.82099999999999995,"5min":0.98399999999999999,"15min":1.131},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.379},"max":{"1min":0.877,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71999999999999997,"15min":0.71399999999999997},"min":{"1min":0.47599999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.873,"5min":1.0129999999999999,"15min":1.0409999999999999},"last":0.83099999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.749,"15min":0.73999999999999999},"min":{"1min":0.51300000000000001,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.96099999999999997,"5min":0.97099999999999997,"15min":1.405},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.74299999999999999,"15min":0.751},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97699999999999998,"5min":1.0629999999999999,"15min":1.087},"last":0.73999999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.42099999999999999},"max":{"1min":0.86899999999999999,"5min":1.0189999999999999,"15min":1.2230000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.755,"15min":0.753},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.92300000000000004,"5min":0.95199999999999996,"15min":1.0189999999999999},"last":0.72099999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55200000000000005,"15min":0.57599999999999996},"min":{"1min":0.38,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":1.244},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61099999999999999,"15min":0.64000000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90400000000000003,"5min":1.0309999999999999,"15min":1.3999999999999999},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.47499999999999998,"5min":0.41399999999999998,"15min":0.40300000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.98599999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65900000000000003,"15min":0.69199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.93400000000000005,"5min":0.94199999999999995,"15min":1.0129999999999999},"last":0.84099999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.5,"5min":0.46500000000000002,"15min":0.44400000000000001},"max":{"1min":0.877,"5min":0.98599999999999999,"15min":1.048},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.63,"15min":0.65100000000000002},"min":{"1min":0.434,"5min":0.42699999999999999,"15min":0.40899999999999997},"max":{"1min":0.90400000000000003,"5min":0.91300000000000003,"15min":0.98599999999999999},"last":0.751}]}]},{"osd":6,"up_from":14,"seq":60129542311,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":798720,"data_stored":383479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.76800000000000002,"15min":0.75600000000000001},"min":{"1min":0.56299999999999994,"5min":0.39800000000000002,"15min":0.36599999999999999},"max":{"1min":0.88200000000000001,"5min":0.95499999999999996,"15min":1.425},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.79500000000000004,"15min":0.80700000000000005},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.437},"max":{"1min":0.88900000000000001,"5min":1.0329999999999999,"15min":2.3100000000000001},"last":0.71199999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.72799999999999998,"15min":0.71699999999999997},"min":{"1min":0.54600000000000004,"5min":0.45300000000000001,"15min":0.41999999999999998},"max":{"1min":0.90900000000000003,"5min":0.96099999999999997,"15min":1.022},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.72599999999999998,"15min":0.79800000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":0.99399999999999999,"15min":8.6280000000000001},"last":0.66800000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.746,"15min":0.76300000000000001},"min":{"1min":0.59499999999999997,"5min":0.52900000000000003,"15min":0.42799999999999999},"max":{"1min":0.90000000000000002,"5min":0.95599999999999996,"15min":1.55},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.79400000000000004,"15min":0.78800000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":0.94699999999999995,"5min":1.0149999999999999,"15min":1.016},"last":0.72799999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.752,"15min":0.76700000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93100000000000005,"5min":0.97799999999999998,"15min":1.7470000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.745},"min":{"1min":0.56000000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.93999999999999995,"5min":0.95699999999999996,"15min":1.5129999999999999},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.58599999999999997,"15min":0.61399999999999999},"min":{"1min":0.42899999999999999,"5min":0.40600000000000003,"15min":0.36599999999999999},"max":{"1min":0.79600000000000004,"5min":0.97999999999999998,"15min":3.1829999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.63100000000000001,"15min":0.65100000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.752,"5min":1.0209999999999999,"15min":2.887},"last":0.86199999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.61099999999999999,"15min":0.63300000000000001},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74399999999999999,"5min":0.93799999999999994,"15min":1.4510000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.67300000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.98799999999999999,"5min":1.0389999999999999,"15min":1.054},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:32:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.67400000000000004,"15min":0.69199999999999995},"min":{"1min":0.48299999999999998,"5min":0.46899999999999997,"15min":0.443},"max":{"1min":0.81899999999999995,"5min":0.99099999999999999,"15min":1.1679999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68400000000000005,"15min":0.76400000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90800000000000003,"5min":0.97999999999999998,"15min":8.0760000000000005},"last":0.68600000000000005}]}]},{"osd":5,"up_from":15,"seq":64424509604,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":790528,"data_stored":382827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.73299999999999998,"15min":0.70799999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.32900000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71099999999999997,"15min":0.71599999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.47999999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.71299999999999997,"15min":0.70999999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.90600000000000003,"5min":0.95799999999999996,"15min":1.0009999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73599999999999999,"15min":0.72999999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.50900000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.42999999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.034},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78800000000000003,"15min":0.78500000000000003},"min":{"1min":0.56000000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.81299999999999994,"15min":0.79800000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.66500000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.57799999999999996,"15min":0.56399999999999995},"min":{"1min":0.41099999999999998,"5min":0.378,"15min":0.35399999999999998},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68300000000000005,"15min":0.69199999999999995},"min":{"1min":0.52200000000000002,"5min":0.502,"15min":0.44900000000000001},"max":{"1min":0.84199999999999997,"5min":0.97499999999999998,"15min":1.038},"last":0.71899999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.60599999999999998,"15min":0.60899999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.59699999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63800000000000001,"15min":0.65900000000000003},"min":{"1min":0.46300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.85499999999999998,"5min":0.96199999999999997,"15min":0.97699999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.73799999999999999,"15min":0.72699999999999998},"min":{"1min":0.54000000000000004,"5min":0.52100000000000002,"15min":0.439},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.69899999999999995}]}]},{"osd":4,"up_from":15,"seq":64424509605,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":776,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":794624,"data_stored":383409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.75800000000000001,"15min":0.74199999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.40000000000000002},"max":{"1min":0.89400000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.747,"15min":0.74299999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.92000000000000004,"5min":0.96099999999999997,"15min":0.99099999999999999},"last":0.80100000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70999999999999996,"15min":0.69799999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.39400000000000002},"max":{"1min":0.89100000000000001,"5min":1.002,"15min":1.0449999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71399999999999997,"15min":0.69399999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86299999999999999,"5min":0.96399999999999997,"15min":1.016},"last":0.69699999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.77900000000000003,"15min":0.76800000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.042},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.76600000000000001,"15min":0.77300000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.33000000000000002},"max":{"1min":0.96399999999999997,"5min":1,"15min":1.0589999999999999},"last":0.82099999999999995}]},{"osd":3,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97199999999999998,"5min":1.0169999999999999,"15min":1.026},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.79600000000000004,"15min":0.78700000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.93000000000000005,"5min":0.99099999999999999,"15min":1.018},"last":0.78300000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.58299999999999996},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81599999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57099999999999995,"15min":0.60099999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.0680000000000001},"last":0.66700000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64200000000000002,"15min":0.65400000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.38500000000000001},"max":{"1min":0.91000000000000003,"5min":0.92200000000000004,"15min":0.96699999999999997},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.69899999999999995,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98999999999999999,"5min":0.997,"15min":1.272},"last":0.86799999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:31:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.627,"15min":0.67200000000000004},"min":{"1min":0.439,"5min":0.39200000000000002,"15min":0.374},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.3300000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.67800000000000005,"15min":0.70599999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95699999999999996,"5min":0.97999999999999998,"15min":1.135},"last":0.71699999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509604,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":806912,"data_stored":384413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.29099999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.68400000000000005,"5min":0.749,"15min":0.76400000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.41099999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.48199999999999998,"15min":0.47399999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.30099999999999999},"max":{"1min":0.69199999999999995,"5min":0.83499999999999996,"15min":0.871},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72299999999999998,"5min":0.86399999999999999,"15min":0.94199999999999995},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.57199999999999995,"15min":0.54600000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66700000000000004,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.61599999999999999,"15min":0.59399999999999997},"min":{"1min":0.45100000000000001,"5min":0.41499999999999998,"15min":0.40999999999999998},"max":{"1min":0.69199999999999995,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.438},"max":{"1min":0.91400000000000003,"5min":1.0620000000000001,"15min":1.3240000000000001},"last":0.624},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.01,"5min":1.0569999999999999,"15min":1.488},"last":0.75}]},{"osd":5,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.76000000000000001,"15min":0.76600000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.90600000000000003,"5min":1.137,"15min":1.1919999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.78100000000000003,"15min":0.77900000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.048,"5min":1.081,"15min":1.302},"last":0.55800000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93500000000000005,"5min":1.056,"15min":1.3979999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.76700000000000002,"15min":0.77700000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.49399999999999999},"max":{"1min":0.98499999999999999,"5min":1.0740000000000001,"15min":1.3899999999999999},"last":0.57899999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:31:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.82299999999999995,"15min":0.82899999999999996},"min":{"1min":0.53400000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0780000000000001,"5min":1.097,"15min":1.335},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.83799999999999997,"15min":0.82899999999999996},"min":{"1min":0.58999999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.2130000000000001},"last":0.70799999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509606,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53976,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317864,"statfs":{"total":96636764160,"available":96581492736,"internally_reserved":0,"allocated":802816,"data_stored":384391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.47299999999999998,"15min":0.46899999999999997},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.94199999999999995},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.496,"5min":0.55300000000000005,"15min":0.54100000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.38300000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55300000000000005,"15min":0.53800000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.28199999999999997},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.59199999999999997,"15min":0.57699999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.46400000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.47699999999999998,"15min":0.47599999999999998},"min":{"1min":0.30099999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66200000000000003,"5min":0.73499999999999999,"15min":0.748},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.48299999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.80600000000000005,"15min":0.79700000000000004},"min":{"1min":0.439,"5min":0.376,"15min":0.376},"max":{"1min":1.0629999999999999,"5min":1.2569999999999999,"15min":1.6870000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.81899999999999995,"15min":0.80000000000000004},"min":{"1min":0.501,"5min":0.432,"15min":0.432},"max":{"1min":1.107,"5min":1.1579999999999999,"15min":1.2689999999999999},"last":0.77700000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.80700000000000005,"15min":0.79300000000000004},"min":{"1min":0.55800000000000005,"5min":0.496,"15min":0.496},"max":{"1min":1.006,"5min":1.169,"15min":1.2549999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.82699999999999996,"15min":0.80900000000000005},"min":{"1min":0.47299999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1419999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.75800000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.80100000000000005,"15min":0.79600000000000004},"min":{"1min":0.45500000000000002,"5min":0.44900000000000001,"15min":0.40300000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.3759999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.82899999999999996,"15min":0.81000000000000005},"min":{"1min":0.54900000000000004,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.165,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.79400000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.83999999999999997,"15min":0.82699999999999996},"min":{"1min":0.54300000000000004,"5min":0.51100000000000001,"15min":0.49099999999999999},"max":{"1min":1.2,"5min":1.214,"15min":1.2909999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.81799999999999995,"15min":0.81499999999999995},"min":{"1min":0.5,"5min":0.44900000000000001,"15min":0.44700000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.3660000000000001},"last":0.81599999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509605,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31828,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":798720,"data_stored":382987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.47199999999999998,"15min":0.53900000000000003},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.59599999999999997,"5min":0.84599999999999997,"15min":5.4800000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.56200000000000006,"15min":0.61499999999999999},"min":{"1min":0.41099999999999998,"5min":0.377,"15min":0.36099999999999999},"max":{"1min":0.76700000000000002,"5min":0.872,"15min":5.2830000000000004},"last":0.35099999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.505,"15min":0.53700000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.64900000000000002,"5min":0.76100000000000001,"15min":3.4220000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.52400000000000002,"15min":0.53600000000000003},"min":{"1min":0.35199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.88800000000000001},"last":0.48899999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.58999999999999997,"15min":0.626},"min":{"1min":0.35799999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81599999999999995,"5min":0.86599999999999999,"15min":3.2469999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.51000000000000001,"15min":0.56999999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71799999999999997,"5min":0.77300000000000002,"15min":5.8710000000000004},"last":0.46700000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.76600000000000001,"15min":0.80900000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89500000000000002,"5min":1.1930000000000001,"15min":3.6259999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.78200000000000003,"15min":0.83499999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.91300000000000003,"5min":1.083,"15min":4.4100000000000001},"last":0.76500000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.77600000000000002,"15min":0.83999999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.96599999999999997,"5min":1.115,"15min":5.766},"last":0.751},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.78700000000000003,"15min":0.82599999999999996},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90400000000000003,"5min":1.2849999999999999,"15min":3.669},"last":0.90000000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.79500000000000004,"15min":0.80800000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.95199999999999996,"5min":1.147,"15min":1.23},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.77800000000000002,"15min":0.85499999999999998},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93600000000000005,"5min":1.3240000000000001,"15min":5.8200000000000003},"last":0.71899999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.79200000000000004,"15min":0.86499999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.872,"5min":1.244,"15min":5.9269999999999996},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79200000000000004,"15min":0.84299999999999997},"min":{"1min":0.52600000000000002,"5min":0.48599999999999999,"15min":0.45700000000000002},"max":{"1min":0.93400000000000005,"5min":1.3380000000000001,"15min":3.5800000000000001},"last":0.79700000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509607,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1392640,"data_stored":973251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46300000000000002,"15min":0.46800000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.628,"5min":0.81000000000000005,"15min":0.91100000000000003},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.51300000000000001,"15min":0.496},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.76200000000000001,"5min":0.77800000000000002,"15min":0.83199999999999996},"last":0.51500000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53700000000000003,"15min":0.52200000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.52500000000000002,"15min":0.51100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71599999999999997,"5min":0.871,"15min":0.871},"last":0.41199999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.59299999999999997,"15min":0.58599999999999997},"min":{"1min":0.35899999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77000000000000002,"5min":0.88100000000000001,"15min":0.91300000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78000000000000003,"5min":0.78400000000000003,"15min":0.85699999999999998},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.76700000000000002,"15min":0.78300000000000003},"min":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91000000000000003,"5min":1.1559999999999999,"15min":1.321},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.79700000000000004,"15min":0.79900000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94099999999999995,"5min":1.423,"15min":1.423},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.495,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95399999999999996,"5min":1.2669999999999999,"15min":1.28},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.78800000000000003,"15min":0.80700000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.88100000000000001,"5min":1.254,"15min":1.393},"last":0.55900000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.79200000000000004,"15min":0.81000000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96099999999999997,"5min":1.2290000000000001,"15min":1.28},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.82399999999999995,"15min":0.81899999999999995},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1,"5min":1.333,"15min":1.333},"last":0.69999999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:32:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.78400000000000003,"15min":0.79400000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.88800000000000001,"5min":1.087,"15min":1.2310000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.82099999999999995,"15min":0.83499999999999996},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.95699999999999996,"5min":1.296,"15min":1.369},"last":0.59799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:32:11.092 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T22:32:11.093 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-21T22:32:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.232+0000 7fb0b4c48640 1 Processor -- start 2023-07-21T22:32:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.232+0000 7fb0b4c48640 1 -- start start 2023-07-21T22:32:11.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.232+0000 7fb0b4c48640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb0b00c85a0 0x7fb0b015c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.232+0000 7fb0b4c48640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0b00cc000 0x7fb0b00cc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.232+0000 7fb0b4c48640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b015cc90 con 0x7fb0b006cff0 2023-07-21T22:32:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.232+0000 7fb0b4c48640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b0156130 con 0x7fb0b00cc000 2023-07-21T22:32:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.232+0000 7fb0b4c48640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b0158a10 con 0x7fb0b00c85a0 2023-07-21T22:32:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.232+0000 7fb0aed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0b00cc000 0x7fb0b00cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.232+0000 7fb0aed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0b00cc000 0x7fb0b00cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59812/0 (socket says 172.21.15.6:59812) 2023-07-21T22:32:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.232+0000 7fb0aed9d640 1 -- 172.21.15.6:0/2471756748 learned_addr learned my addr 172.21.15.6:0/2471756748 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.232+0000 7fb0ae59c640 1 --2- 172.21.15.6:0/2471756748 >> v2:172.21.15.161:3300/0 conn(0x7fb0b00c85a0 0x7fb0b015c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.232+0000 7fb0aed9d640 1 -- 172.21.15.6:0/2471756748 >> v2:172.21.15.161:3300/0 conn(0x7fb0b00c85a0 msgr2=0x7fb0b015c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.232+0000 7fb0aed9d640 1 --2- 172.21.15.6:0/2471756748 >> v2:172.21.15.161:3300/0 conn(0x7fb0b00c85a0 0x7fb0b015c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.232+0000 7fb0aed9d640 1 -- 172.21.15.6:0/2471756748 >> v1:172.21.15.161:6789/0 conn(0x7fb0b006cff0 legacy=0x7fb0b00c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.232+0000 7fb0aed9d640 1 -- 172.21.15.6:0/2471756748 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b0158cf0 con 0x7fb0b00cc000 2023-07-21T22:32:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.236+0000 7fb0aed9d640 1 --2- 172.21.15.6:0/2471756748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b00cc000 0x7fb0b00cc400 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0071b80 tx=0x7fb0a801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870bb2ec05f2d249 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.236+0000 7fb0add9b640 1 -- 172.21.15.6:0/2471756748 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a80a5780 con 0x7fb0b00cc000 2023-07-21T22:32:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.236+0000 7fb0add9b640 1 -- 172.21.15.6:0/2471756748 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a80a58e0 con 0x7fb0b00cc000 2023-07-21T22:32:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.236+0000 7fb0add9b640 1 -- 172.21.15.6:0/2471756748 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a80a5c70 con 0x7fb0b00cc000 2023-07-21T22:32:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.236+0000 7fb0b4c48640 1 -- 172.21.15.6:0/2471756748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b00cc000 msgr2=0x7fb0b00cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.236+0000 7fb0b4c48640 1 --2- 172.21.15.6:0/2471756748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b00cc000 0x7fb0b00cc400 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0071b80 tx=0x7fb0a801c940 comp rx=0 tx=0).stop 2023-07-21T22:32:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.236+0000 7fb0b4c48640 1 -- 172.21.15.6:0/2471756748 shutdown_connections 2023-07-21T22:32:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.236+0000 7fb0b4c48640 1 --2- 172.21.15.6:0/2471756748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b00cc000 0x7fb0b00cc400 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.236+0000 7fb0b4c48640 1 --2- 172.21.15.6:0/2471756748 >> v2:172.21.15.161:3300/0 conn(0x7fb0b00c85a0 0x7fb0b015c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.236+0000 7fb0b4c48640 1 -- 172.21.15.6:0/2471756748 >> 172.21.15.6:0/2471756748 conn(0x7fb0b00afac0 msgr2=0x7fb0b00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.236+0000 7fb0b4c48640 1 -- 172.21.15.6:0/2471756748 shutdown_connections 2023-07-21T22:32:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.236+0000 7fb0b4c48640 1 -- 172.21.15.6:0/2471756748 wait complete. 2023-07-21T22:32:11.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0b4c48640 1 Processor -- start 2023-07-21T22:32:11.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0b4c48640 1 -- start start 2023-07-21T22:32:11.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0b4c48640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0b006cff0 0x7fb0b0145430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:11.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0b4c48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0b00c85a0 0x7fb0b00c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:11.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0b4c48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b00cc000 0x7fb0b00701e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:11.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0b4c48640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00b1d20 con 0x7fb0b00cc000 2023-07-21T22:32:11.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0b4c48640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00b0dc0 con 0x7fb0b006cff0 2023-07-21T22:32:11.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0b4c48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00b10a0 con 0x7fb0b00c85a0 2023-07-21T22:32:11.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0aed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b00cc000 0x7fb0b00701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:11.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0aed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b00cc000 0x7fb0b00701e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59828/0 (socket says 172.21.15.6:59828) 2023-07-21T22:32:11.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0aed9d640 1 -- 172.21.15.6:0/3111868971 learned_addr learned my addr 172.21.15.6:0/3111868971 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:11.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0ae59c640 1 --2- 172.21.15.6:0/3111868971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0b006cff0 0x7fb0b0145430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:11.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0a7fff640 1 --2- 172.21.15.6:0/3111868971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0b00c85a0 0x7fb0b00c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:11.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0aed9d640 1 -- 172.21.15.6:0/3111868971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0b00c85a0 msgr2=0x7fb0b00c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:11.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0aed9d640 1 --2- 172.21.15.6:0/3111868971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0b00c85a0 0x7fb0b00c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0aed9d640 1 -- 172.21.15.6:0/3111868971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0b006cff0 msgr2=0x7fb0b0145430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:11.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0aed9d640 1 --2- 172.21.15.6:0/3111868971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0b006cff0 0x7fb0b0145430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0aed9d640 1 -- 172.21.15.6:0/3111868971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a8009b30 con 0x7fb0b00cc000 2023-07-21T22:32:11.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0ae59c640 1 --2- 172.21.15.6:0/3111868971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0b006cff0 0x7fb0b0145430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:11.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0aed9d640 1 --2- 172.21.15.6:0/3111868971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b00cc000 0x7fb0b00701e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8019550 tx=0x7fb0a80196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:11.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0a6ffd640 1 -- 172.21.15.6:0/3111868971 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a80b8670 con 0x7fb0b00cc000 2023-07-21T22:32:11.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0a6ffd640 1 -- 172.21.15.6:0/3111868971 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a80b87d0 con 0x7fb0b00cc000 2023-07-21T22:32:11.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0a6ffd640 1 -- 172.21.15.6:0/3111868971 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a80b8b40 con 0x7fb0b00cc000 2023-07-21T22:32:11.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0b4c48640 1 -- 172.21.15.6:0/3111868971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b00b1380 con 0x7fb0b00cc000 2023-07-21T22:32:11.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.240+0000 7fb0b4c48640 1 -- 172.21.15.6:0/3111868971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b00b1940 con 0x7fb0b00cc000 2023-07-21T22:32:11.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.244+0000 7fb0b4c48640 1 -- 172.21.15.6:0/3111868971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b00678d0 con 0x7fb0b00cc000 2023-07-21T22:32:11.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.244+0000 7fb0a6ffd640 1 -- 172.21.15.6:0/3111868971 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb0a80b8ca0 con 0x7fb0b00cc000 2023-07-21T22:32:11.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.244+0000 7fb0a6ffd640 1 --2- 172.21.15.6:0/3111868971 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fb0900663a0 0x7fb090068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:11.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.244+0000 7fb0a6ffd640 1 -- 172.21.15.6:0/3111868971 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fb0a811f3f0 con 0x7fb0b00cc000 2023-07-21T22:32:11.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.244+0000 7fb0ae59c640 1 --2- 172.21.15.6:0/3111868971 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fb0900663a0 0x7fb090068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:11.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.244+0000 7fb0ae59c640 1 --2- 172.21.15.6:0/3111868971 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fb0900663a0 0x7fb090068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000bae0 tx=0x7fb0a0008040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:11.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.248+0000 7fb0a6ffd640 1 -- 172.21.15.6:0/3111868971 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0a80ec690 con 0x7fb0b00cc000 2023-07-21T22:32:11.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.460+0000 7fb0b4c48640 1 -- 172.21.15.6:0/3111868971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb0b006b6d0 con 0x7fb0b00cc000 2023-07-21T22:32:11.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.464+0000 7fb0a6ffd640 1 -- 172.21.15.6:0/3111868971 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7fb0a80efcb0 con 0x7fb0b00cc000 2023-07-21T22:32:11.513 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-07-21T22:32:11.513 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA== 2023-07-21T22:32:11.514 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2023-07-21T22:32:11.514 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2023-07-21T22:32:11.514 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-21T22:32:11.514 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-07-21T22:32:11.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.468+0000 7fb0b4c48640 1 -- 172.21.15.6:0/3111868971 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fb0900663a0 msgr2=0x7fb090068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:11.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.468+0000 7fb0b4c48640 1 --2- 172.21.15.6:0/3111868971 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fb0900663a0 0x7fb090068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000bae0 tx=0x7fb0a0008040 comp rx=0 tx=0).stop 2023-07-21T22:32:11.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.468+0000 7fb0b4c48640 1 -- 172.21.15.6:0/3111868971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b00cc000 msgr2=0x7fb0b00701e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:11.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.468+0000 7fb0b4c48640 1 --2- 172.21.15.6:0/3111868971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b00cc000 0x7fb0b00701e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb0a8019550 tx=0x7fb0a80196e0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.468+0000 7fb0b4c48640 1 -- 172.21.15.6:0/3111868971 shutdown_connections 2023-07-21T22:32:11.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.468+0000 7fb0b4c48640 1 --2- 172.21.15.6:0/3111868971 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fb0900663a0 0x7fb090068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.468+0000 7fb0b4c48640 1 --2- 172.21.15.6:0/3111868971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0b00cc000 0x7fb0b00701e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.468+0000 7fb0b4c48640 1 --2- 172.21.15.6:0/3111868971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0b00c85a0 0x7fb0b00c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.468+0000 7fb0b4c48640 1 --2- 172.21.15.6:0/3111868971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0b006cff0 0x7fb0b0145430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.468+0000 7fb0b4c48640 1 -- 172.21.15.6:0/3111868971 >> 172.21.15.6:0/3111868971 conn(0x7fb0b00afac0 msgr2=0x7fb0b0155050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:11.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.468+0000 7fb0b4c48640 1 -- 172.21.15.6:0/3111868971 shutdown_connections 2023-07-21T22:32:11.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.468+0000 7fb0b4c48640 1 -- 172.21.15.6:0/3111868971 wait complete. 2023-07-21T22:32:11.534 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:32:11.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.628+0000 7f56bfe26640 1 Processor -- start 2023-07-21T22:32:11.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.632+0000 7f56bfe26640 1 -- start start 2023-07-21T22:32:11.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.632+0000 7f56bfe26640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56b8158ce0 0x7f56b8070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:11.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.632+0000 7f56bfe26640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56b80c8ad0 0x7f56b80c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:11.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.632+0000 7f56bfe26640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b80cc700 con 0x7f56b80c9560 2023-07-21T22:32:11.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.632+0000 7f56bfe26640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b80c99e0 con 0x7f56b80c8ad0 2023-07-21T22:32:11.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.632+0000 7f56bfe26640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b80b0ff0 con 0x7f56b8158ce0 2023-07-21T22:32:11.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.632+0000 7f56bd3c1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56b80c8ad0 0x7f56b80c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:11.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.632+0000 7f56bd3c1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56b80c8ad0 0x7f56b80c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59838/0 (socket says 172.21.15.6:59838) 2023-07-21T22:32:11.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.632+0000 7f56bd3c1640 1 -- 172.21.15.6:0/1036849871 learned_addr learned my addr 172.21.15.6:0/1036849871 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:11.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.632+0000 7f56bdbc2640 1 --2- 172.21.15.6:0/1036849871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56b8158ce0 0x7f56b8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.632+0000 7f56bd3c1640 1 -- 172.21.15.6:0/1036849871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56b8158ce0 msgr2=0x7f56b8070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.632+0000 7f56bd3c1640 1 --2- 172.21.15.6:0/1036849871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56b8158ce0 0x7f56b8070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.632+0000 7f56bd3c1640 1 -- 172.21.15.6:0/1036849871 >> v1:172.21.15.161:6789/0 conn(0x7f56b80c9560 legacy=0x7f56b80cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.632+0000 7f56bd3c1640 1 -- 172.21.15.6:0/1036849871 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b8070c80 con 0x7f56b80c8ad0 2023-07-21T22:32:11.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.636+0000 7f56bd3c1640 1 --2- 172.21.15.6:0/1036849871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b80c8ad0 0x7f56b80c9020 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009870 tx=0x7f56a801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5530f940afe97ad server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:11.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.636+0000 7f56bcbc0640 1 -- 172.21.15.6:0/1036849871 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b80cba20 con 0x7f56b80c8ad0 2023-07-21T22:32:11.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.636+0000 7f56bcbc0640 1 -- 172.21.15.6:0/1036849871 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a80ab5f0 con 0x7f56b80c8ad0 2023-07-21T22:32:11.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.636+0000 7f56bcbc0640 1 -- 172.21.15.6:0/1036849871 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a80ab980 con 0x7f56b80c8ad0 2023-07-21T22:32:11.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.636+0000 7f56bfe26640 1 -- 172.21.15.6:0/1036849871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b80c8ad0 msgr2=0x7f56b80c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:11.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.636+0000 7f56bfe26640 1 --2- 172.21.15.6:0/1036849871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b80c8ad0 0x7f56b80c9020 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009870 tx=0x7f56a801c3f0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.636+0000 7f56bfe26640 1 -- 172.21.15.6:0/1036849871 shutdown_connections 2023-07-21T22:32:11.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.636+0000 7f56bfe26640 1 --2- 172.21.15.6:0/1036849871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b80c8ad0 0x7f56b80c9020 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.636+0000 7f56bfe26640 1 --2- 172.21.15.6:0/1036849871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56b8158ce0 0x7f56b8070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.636+0000 7f56bfe26640 1 -- 172.21.15.6:0/1036849871 >> 172.21.15.6:0/1036849871 conn(0x7f56b80afcf0 msgr2=0x7f56b80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:11.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.636+0000 7f56bfe26640 1 -- 172.21.15.6:0/1036849871 shutdown_connections 2023-07-21T22:32:11.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.636+0000 7f56bfe26640 1 -- 172.21.15.6:0/1036849871 wait complete. 2023-07-21T22:32:11.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.636+0000 7f56bfe26640 1 Processor -- start 2023-07-21T22:32:11.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.636+0000 7f56bfe26640 1 -- start start 2023-07-21T22:32:11.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56bfe26640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56b80c8ad0 0x7f56b814d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:11.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56bfe26640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56b80c9560 0x7f56b80c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:11.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56bfe26640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b8158ce0 0x7f56b80c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56bfe26640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b80c6fd0 con 0x7f56b8158ce0 2023-07-21T22:32:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56bfe26640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b80c5770 con 0x7f56b80c9560 2023-07-21T22:32:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56bfe26640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b80c59f0 con 0x7f56b80c8ad0 2023-07-21T22:32:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56bdbc2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56b80c8ad0 0x7f56b814d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56bd3c1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56b80c9560 0x7f56b80c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56be3c3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b8158ce0 0x7f56b80c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56bdbc2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56b80c8ad0 0x7f56b814d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:34742/0 (socket says 172.21.15.6:34742) 2023-07-21T22:32:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56bdbc2640 1 -- 172.21.15.6:0/2339100012 learned_addr learned my addr 172.21.15.6:0/2339100012 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56be3c3640 1 -- 172.21.15.6:0/2339100012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56b80c8ad0 msgr2=0x7f56b814d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56be3c3640 1 --2- 172.21.15.6:0/2339100012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56b80c8ad0 0x7f56b814d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56be3c3640 1 -- 172.21.15.6:0/2339100012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56b80c9560 msgr2=0x7f56b80c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56be3c3640 1 --2- 172.21.15.6:0/2339100012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56b80c9560 0x7f56b80c6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56be3c3640 1 -- 172.21.15.6:0/2339100012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a80094d0 con 0x7f56b8158ce0 2023-07-21T22:32:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56be3c3640 1 --2- 172.21.15.6:0/2339100012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b8158ce0 0x7f56b80c5230 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f56b000c700 tx=0x7f56b000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56ae7fc640 1 -- 172.21.15.6:0/2339100012 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b0003b80 con 0x7f56b8158ce0 2023-07-21T22:32:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56ae7fc640 1 -- 172.21.15.6:0/2339100012 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b0003ce0 con 0x7f56b8158ce0 2023-07-21T22:32:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56bfe26640 1 -- 172.21.15.6:0/2339100012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b80c5cd0 con 0x7f56b8158ce0 2023-07-21T22:32:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56ae7fc640 1 -- 172.21.15.6:0/2339100012 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b0005310 con 0x7f56b8158ce0 2023-07-21T22:32:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56bfe26640 1 -- 172.21.15.6:0/2339100012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b80c6290 con 0x7f56b8158ce0 2023-07-21T22:32:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.640+0000 7f56bfe26640 1 -- 172.21.15.6:0/2339100012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b80ca1a0 con 0x7f56b8158ce0 2023-07-21T22:32:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.644+0000 7f56ae7fc640 1 -- 172.21.15.6:0/2339100012 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f56b0005470 con 0x7f56b8158ce0 2023-07-21T22:32:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.644+0000 7f56ae7fc640 1 --2- 172.21.15.6:0/2339100012 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f569c0663a0 0x7f569c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.644+0000 7f56ae7fc640 1 -- 172.21.15.6:0/2339100012 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f56b0084480 con 0x7f56b8158ce0 2023-07-21T22:32:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.644+0000 7f56bdbc2640 1 --2- 172.21.15.6:0/2339100012 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f569c0663a0 0x7f569c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:11.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.644+0000 7f56bdbc2640 1 --2- 172.21.15.6:0/2339100012 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f569c0663a0 0x7f569c068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f56b4007b10 tx=0x7f56b4008040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:11.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.648+0000 7f56ae7fc640 1 -- 172.21.15.6:0/2339100012 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f56b0051950 con 0x7f56b8158ce0 2023-07-21T22:32:11.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.836+0000 7f56bfe26640 1 -- 172.21.15.6:0/2339100012 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56b80678d0 con 0x7f56b8158ce0 2023-07-21T22:32:11.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.836+0000 7f56ae7fc640 1 -- 172.21.15.6:0/2339100012 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f56b0054f70 con 0x7f56b8158ce0 2023-07-21T22:32:11.884 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:32:11.884 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/2410607534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2410607534},{"type":"v1","addr":"172.21.15.161:6836","nonce":2410607534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/3696372013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":3696372013},{"type":"v1","addr":"172.21.15.161:6837","nonce":3696372013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6042,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/4134919456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4134919456},{"type":"v1","addr":"172.21.15.6:6833","nonce":4134919456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:32:01.334074+0000","modified":"2023-07-21T22:32:04.955966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6045},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6045":{"gid":6045,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2511103099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2511103099},{"type":"v1","addr":"172.21.15.6:6835","nonce":2511103099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-21T22:32:11.884 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 24 2023-07-21T22:32:11.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.836+0000 7f56bfe26640 1 -- 172.21.15.6:0/2339100012 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f569c0663a0 msgr2=0x7f569c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:11.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.836+0000 7f56bfe26640 1 --2- 172.21.15.6:0/2339100012 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f569c0663a0 0x7f569c068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f56b4007b10 tx=0x7f56b4008040 comp rx=0 tx=0).stop 2023-07-21T22:32:11.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.836+0000 7f56bfe26640 1 -- 172.21.15.6:0/2339100012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b8158ce0 msgr2=0x7f56b80c5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:11.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.836+0000 7f56bfe26640 1 --2- 172.21.15.6:0/2339100012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b8158ce0 0x7f56b80c5230 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f56b000c700 tx=0x7f56b000cbc0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.836+0000 7f56bfe26640 1 -- 172.21.15.6:0/2339100012 shutdown_connections 2023-07-21T22:32:11.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.836+0000 7f56bfe26640 1 --2- 172.21.15.6:0/2339100012 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f569c0663a0 0x7f569c068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.836+0000 7f56bfe26640 1 --2- 172.21.15.6:0/2339100012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56b8158ce0 0x7f56b80c5230 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.836+0000 7f56bfe26640 1 --2- 172.21.15.6:0/2339100012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56b80c9560 0x7f56b80c6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.836+0000 7f56bfe26640 1 --2- 172.21.15.6:0/2339100012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56b80c8ad0 0x7f56b814d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:11.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.836+0000 7f56bfe26640 1 -- 172.21.15.6:0/2339100012 >> 172.21.15.6:0/2339100012 conn(0x7f56b80afcf0 msgr2=0x7f56b806ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:11.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.836+0000 7f56bfe26640 1 -- 172.21.15.6:0/2339100012 shutdown_connections 2023-07-21T22:32:11.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:11.836+0000 7f56bfe26640 1 -- 172.21.15.6:0/2339100012 wait complete. 2023-07-21T22:32:12.307 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T22:32:01.334074+0000', 'modified': '2023-07-21T22:32:04.955966+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6045}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6045': {'gid': 6045, 'name': 'a', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/2511103099', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6834', 'nonce': 2511103099}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 2511103099}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T22:32:12.307 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T22:32:12.307 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-21T22:32:12.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.408+0000 7fb553370640 1 Processor -- start 2023-07-21T22:32:12.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.408+0000 7fb553370640 1 -- start start 2023-07-21T22:32:12.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.408+0000 7fb553370640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb54c0b42c0 0x7fb54c06a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.408+0000 7fb553370640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54c0ccee0 con 0x7fb54c0cee90 2023-07-21T22:32:12.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.408+0000 7fb553370640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54c0cc920 con 0x7fb54c0b7a10 2023-07-21T22:32:12.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.408+0000 7fb553370640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54c0cff30 con 0x7fb54c0b42c0 2023-07-21T22:32:12.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.408+0000 7fb551b6d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb54c0b42c0 0x7fb54c06a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.408+0000 7fb552b6f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb54c0cee90 0x7fb54c0d0380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52554/0 (socket says 172.21.15.6:52554) 2023-07-21T22:32:12.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.408+0000 7fb552b6f640 1 -- 172.21.15.6:0/1778446293 learned_addr learned my addr 172.21.15.6:0/1778446293 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:32:12.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.408+0000 7fb551b6d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb54c0b42c0 0x7fb54c06a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59846/0 (socket says 172.21.15.6:59846) 2023-07-21T22:32:12.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.408+0000 7fb551b6d640 1 -- 172.21.15.6:0/1778446293 >> v1:172.21.15.161:6789/0 conn(0x7fb54c0b7a10 legacy=0x7fb54c0b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:12.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.408+0000 7fb551b6d640 1 -- 172.21.15.6:0/1778446293 >> v1:172.21.15.6:6789/0 conn(0x7fb54c0cee90 legacy=0x7fb54c0d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:12.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.408+0000 7fb551b6d640 1 -- 172.21.15.6:0/1778446293 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c0ccc00 con 0x7fb54c0b42c0 2023-07-21T22:32:12.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.408+0000 7fb55136c640 1 -- 172.21.15.6:0/1778446293 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728894098 0 0) 0x7fb54c0ccee0 con 0x7fb54c0cee90 2023-07-21T22:32:12.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.412+0000 7fb551b6d640 1 --2- 172.21.15.6:0/1778446293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb54c0b42c0 0x7fb54c06a9b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0097c0 tx=0x7fb53c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab21e44dcfa263a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:12.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.412+0000 7fb55136c640 1 -- 172.21.15.6:0/1778446293 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c0ab670 con 0x7fb54c0b42c0 2023-07-21T22:32:12.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.412+0000 7fb55136c640 1 -- 172.21.15.6:0/1778446293 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53c0ab7d0 con 0x7fb54c0b42c0 2023-07-21T22:32:12.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.412+0000 7fb55136c640 1 -- 172.21.15.6:0/1778446293 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c0abb60 con 0x7fb54c0b42c0 2023-07-21T22:32:12.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.412+0000 7fb553370640 1 -- 172.21.15.6:0/1778446293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb54c0b42c0 msgr2=0x7fb54c06a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:12.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.412+0000 7fb553370640 1 --2- 172.21.15.6:0/1778446293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb54c0b42c0 0x7fb54c06a9b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0097c0 tx=0x7fb53c01c450 comp rx=0 tx=0).stop 2023-07-21T22:32:12.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.412+0000 7fb553370640 1 -- 172.21.15.6:0/1778446293 shutdown_connections 2023-07-21T22:32:12.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.412+0000 7fb553370640 1 --2- 172.21.15.6:0/1778446293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb54c0b42c0 0x7fb54c06a9b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.412+0000 7fb553370640 1 -- 172.21.15.6:0/1778446293 >> 172.21.15.6:0/1778446293 conn(0x7fb54c069ea0 msgr2=0x7fb54c06a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:12.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.412+0000 7fb553370640 1 -- 172.21.15.6:0/1778446293 shutdown_connections 2023-07-21T22:32:12.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.412+0000 7fb553370640 1 -- 172.21.15.6:0/1778446293 wait complete. 2023-07-21T22:32:12.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb553370640 1 Processor -- start 2023-07-21T22:32:12.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb553370640 1 -- start start 2023-07-21T22:32:12.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb553370640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb54c0b42c0 0x7fb54c14b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb553370640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb54c0b7a10 0x7fb54c156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb553370640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb54c0cee90 0x7fb54c1572e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb553370640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c151f90 con 0x7fb54c0b42c0 2023-07-21T22:32:12.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb553370640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c152270 con 0x7fb54c0cee90 2023-07-21T22:32:12.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb553370640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c152550 con 0x7fb54c0b7a10 2023-07-21T22:32:12.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb55236e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb54c0b42c0 0x7fb54c14b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb55236e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb54c0b42c0 0x7fb54c14b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59854/0 (socket says 172.21.15.6:59854) 2023-07-21T22:32:12.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb55236e640 1 -- 172.21.15.6:0/3592255350 learned_addr learned my addr 172.21.15.6:0/3592255350 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:12.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb551b6d640 1 --2- 172.21.15.6:0/3592255350 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb54c0b7a10 0x7fb54c156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb552b6f640 1 --2- 172.21.15.6:0/3592255350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb54c0cee90 0x7fb54c1572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb55236e640 1 -- 172.21.15.6:0/3592255350 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb54c0b7a10 msgr2=0x7fb54c156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:12.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb55236e640 1 --2- 172.21.15.6:0/3592255350 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb54c0b7a10 0x7fb54c156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb55236e640 1 -- 172.21.15.6:0/3592255350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb54c0cee90 msgr2=0x7fb54c1572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:12.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb55236e640 1 --2- 172.21.15.6:0/3592255350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb54c0cee90 0x7fb54c1572e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb55236e640 1 -- 172.21.15.6:0/3592255350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c009420 con 0x7fb54c0b42c0 2023-07-21T22:32:12.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb55236e640 1 --2- 172.21.15.6:0/3592255350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb54c0b42c0 0x7fb54c14b7e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb54800c500 tx=0x7fb54800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:12.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb542ffd640 1 -- 172.21.15.6:0/3592255350 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548005220 con 0x7fb54c0b42c0 2023-07-21T22:32:12.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb542ffd640 1 -- 172.21.15.6:0/3592255350 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb548005380 con 0x7fb54c0b42c0 2023-07-21T22:32:12.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb542ffd640 1 -- 172.21.15.6:0/3592255350 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548007270 con 0x7fb54c0b42c0 2023-07-21T22:32:12.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb553370640 1 -- 172.21.15.6:0/3592255350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c152830 con 0x7fb54c0b42c0 2023-07-21T22:32:12.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.416+0000 7fb553370640 1 -- 172.21.15.6:0/3592255350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c14f830 con 0x7fb54c0b42c0 2023-07-21T22:32:12.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.420+0000 7fb542ffd640 1 -- 172.21.15.6:0/3592255350 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb5480073d0 con 0x7fb54c0b42c0 2023-07-21T22:32:12.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.420+0000 7fb542ffd640 1 --2- 172.21.15.6:0/3592255350 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fb5300663a0 0x7fb530068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.420+0000 7fb542ffd640 1 -- 172.21.15.6:0/3592255350 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fb5480836e0 con 0x7fb54c0b42c0 2023-07-21T22:32:12.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.420+0000 7fb557921000 1 Processor -- start 2023-07-21T22:32:12.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.420+0000 7fb551b6d640 1 --2- 172.21.15.6:0/3592255350 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fb5300663a0 0x7fb530068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.420+0000 7fb557921000 1 -- start start 2023-07-21T22:32:12.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.420+0000 7fb551b6d640 1 --2- 172.21.15.6:0/3592255350 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fb5300663a0 0x7fb530068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0af000 tx=0x7fb53c0a7000 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:12.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.420+0000 7fb557921000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14acf00 0x5561f14ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.420+0000 7fb557921000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14ad810 0x5561f1463370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.420+0000 7fb557921000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14638b0 0x5561f1463c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.420+0000 7fb557921000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561f132a880 con 0x5561f14acf00 2023-07-21T22:32:12.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.420+0000 7fb557921000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561f1264840 con 0x5561f14ad810 2023-07-21T22:32:12.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.420+0000 7fb557921000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561f12b82e0 con 0x5561f14638b0 2023-07-21T22:32:12.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.420+0000 7fb55236e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14acf00 0x5561f14ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.420+0000 7fb55236e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14acf00 0x5561f14ad2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59870/0 (socket says 172.21.15.6:59870) 2023-07-21T22:32:12.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.420+0000 7fb55236e640 1 -- 172.21.15.6:0/202217412 learned_addr learned my addr 172.21.15.6:0/202217412 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:12.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb552b6f640 1 --2- 172.21.15.6:0/202217412 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14638b0 0x5561f1463c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb551b6d640 1 --2- 172.21.15.6:0/202217412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14ad810 0x5561f1463370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb55236e640 1 -- 172.21.15.6:0/202217412 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14638b0 msgr2=0x5561f1463c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:12.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb55236e640 1 --2- 172.21.15.6:0/202217412 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14638b0 0x5561f1463c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb55236e640 1 -- 172.21.15.6:0/202217412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14ad810 msgr2=0x5561f1463370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:12.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb55236e640 1 --2- 172.21.15.6:0/202217412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14ad810 0x5561f1463370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb55236e640 1 -- 172.21.15.6:0/202217412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561f0fad890 con 0x5561f14acf00 2023-07-21T22:32:12.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb552b6f640 1 --2- 172.21.15.6:0/202217412 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14638b0 0x5561f1463c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:12.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb551b6d640 1 --2- 172.21.15.6:0/202217412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14ad810 0x5561f1463370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:12.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb55236e640 1 --2- 172.21.15.6:0/202217412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14acf00 0x5561f14ad2d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb54805c470 tx=0x7fb5480077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94b1b5dbeba728d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb52ffff640 1 -- 172.21.15.6:0/202217412 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548052aa0 con 0x5561f14acf00 2023-07-21T22:32:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb52ffff640 1 -- 172.21.15.6:0/202217412 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5480819d0 con 0x5561f14acf00 2023-07-21T22:32:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb52ffff640 1 -- 172.21.15.6:0/202217412 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb548081b40 con 0x5561f14acf00 2023-07-21T22:32:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb557921000 1 -- 172.21.15.6:0/202217412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14acf00 msgr2=0x5561f14ad2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb557921000 1 --2- 172.21.15.6:0/202217412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14acf00 0x5561f14ad2d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb54805c470 tx=0x7fb5480077c0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb557921000 1 -- 172.21.15.6:0/202217412 shutdown_connections 2023-07-21T22:32:12.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb557921000 1 --2- 172.21.15.6:0/202217412 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14638b0 0x5561f1463c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb557921000 1 --2- 172.21.15.6:0/202217412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14ad810 0x5561f1463370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb557921000 1 --2- 172.21.15.6:0/202217412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14acf00 0x5561f14ad2d0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb557921000 1 -- 172.21.15.6:0/202217412 >> 172.21.15.6:0/202217412 conn(0x5561f1469a10 msgr2=0x5561f1461c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:12.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb557921000 1 -- 172.21.15.6:0/202217412 shutdown_connections 2023-07-21T22:32:12.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb557921000 1 -- 172.21.15.6:0/202217412 wait complete. 2023-07-21T22:32:12.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb557921000 1 -- start start 2023-07-21T22:32:12.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb557921000 1 Processor -- start 2023-07-21T22:32:12.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb557921000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14638b0 0x5561f14b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb557921000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14acf00 0x5561f14b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb557921000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14ad810 0x5561f146e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb557921000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561f12b1380 con 0x5561f14ad810 2023-07-21T22:32:12.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb557921000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561f126dae0 con 0x5561f14638b0 2023-07-21T22:32:12.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb557921000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561f126d780 con 0x5561f14acf00 2023-07-21T22:32:12.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb557921000 10 client.0 _ll_register_callbacks cb 0x5561f144f240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:32:12.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.424+0000 7fb552b6f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14ad810 0x5561f146e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb551b6d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14acf00 0x5561f14b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb55236e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14638b0 0x5561f14b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb55236e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14638b0 0x5561f14b4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:51626/0 (socket says 172.21.15.6:51626) 2023-07-21T22:32:12.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb552b6f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14ad810 0x5561f146e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59882/0 (socket says 172.21.15.6:59882) 2023-07-21T22:32:12.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb552b6f640 1 -- 172.21.15.6:0/2607203744 learned_addr learned my addr 172.21.15.6:0/2607203744 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:12.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb551b6d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14acf00 0x5561f14b4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:34760/0 (socket says 172.21.15.6:34760) 2023-07-21T22:32:12.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb552b6f640 1 -- 172.21.15.6:0/2607203744 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14acf00 msgr2=0x5561f14b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:12.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb552b6f640 1 --2- 172.21.15.6:0/2607203744 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14acf00 0x5561f14b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb552b6f640 1 -- 172.21.15.6:0/2607203744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14638b0 msgr2=0x5561f14b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:12.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb552b6f640 1 --2- 172.21.15.6:0/2607203744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14638b0 0x5561f14b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb552b6f640 1 -- 172.21.15.6:0/2607203744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c14f830 con 0x5561f14ad810 2023-07-21T22:32:12.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb55236e640 1 --2- 172.21.15.6:0/2607203744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14638b0 0x5561f14b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:32:12.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb551b6d640 1 --2- 172.21.15.6:0/2607203744 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14acf00 0x5561f14b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:32:12.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb552b6f640 1 --2- 172.21.15.6:0/2607203744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14ad810 0x5561f146e4f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb544007390 tx=0x7fb544007850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709a4763ff228aa7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:12.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb52d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:32:12.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb52d7fa640 1 -- 172.21.15.6:0/2607203744 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544007a40 con 0x5561f14ad810 2023-07-21T22:32:12.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb557921000 1 -- 172.21.15.6:0/2607203744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561f1278a20 con 0x5561f14ad810 2023-07-21T22:32:12.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb52d7fa640 1 -- 172.21.15.6:0/2607203744 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fb5440117d0 con 0x5561f14ad810 2023-07-21T22:32:12.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb52d7fa640 1 -- 172.21.15.6:0/2607203744 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb544011990 con 0x5561f14ad810 2023-07-21T22:32:12.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb557921000 10 client.6222 fetch_fsmap learned FSMap version 24 2023-07-21T22:32:12.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb557921000 1 -- 172.21.15.6:0/2607203744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5561f1275d10 con 0x5561f14ad810 2023-07-21T22:32:12.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb52d7fa640 1 -- 172.21.15.6:0/2607203744 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561f1278a20 con 0x5561f14ad810 2023-07-21T22:32:12.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb52d7fa640 1 -- 172.21.15.6:0/2607203744 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 24) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fb544011af0 con 0x5561f14ad810 2023-07-21T22:32:12.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb557921000 10 client.6222 fetch_fsmap finished waiting for FSMap version 24 2023-07-21T22:32:12.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb557921000 10 client.6222 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-21T22:32:12.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb557921000 20 client.6222 populate_metadata read hostname 'smithi006' 2023-07-21T22:32:12.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb557921000 1 --2- 172.21.15.6:0/2607203744 >> [v2:172.21.15.6:6834/2511103099,v1:172.21.15.6:6835/2511103099] conn(0x5561f146f290 0x5561f146f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb557921000 4 client.6222 mds_command: new command op to 6045 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:32:12.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb557921000 1 -- 172.21.15.6:0/2607203744 --> [v2:172.21.15.6:6834/2511103099,v1:172.21.15.6:6835/2511103099] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5561f12dfec0 con 0x5561f146f290 2023-07-21T22:32:12.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb55236e640 1 --2- 172.21.15.6:0/2607203744 >> [v2:172.21.15.6:6834/2511103099,v1:172.21.15.6:6835/2511103099] conn(0x5561f146f290 0x5561f146f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb55236e640 1 --2- 172.21.15.6:0/2607203744 >> [v2:172.21.15.6:6834/2511103099,v1:172.21.15.6:6835/2511103099] conn(0x5561f146f290 0x5561f146f660 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fe5c441cbd8e373 server_cookie=d28088d39f2f300c in_seq=0 out_seq=0 2023-07-21T22:32:12.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb52d7fa640 10 client.6222 ms_handle_connect on v2:172.21.15.6:6834/2511103099 2023-07-21T22:32:12.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb52d7fa640 1 -- 172.21.15.6:0/2607203744 <== mds.0 v2:172.21.15.6:6834/2511103099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5561f12dfec0 con 0x5561f146f290 2023-07-21T22:32:12.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb52d7fa640 10 client.6222 handle_command_reply: tid=0 2023-07-21T22:32:12.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb557921000 1 client.6222 shutdown 2023-07-21T22:32:12.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb557921000 1 -- 172.21.15.6:0/2607203744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14ad810 msgr2=0x5561f146e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:12.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb557921000 1 --2- 172.21.15.6:0/2607203744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14ad810 0x5561f146e4f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb544007390 tx=0x7fb544007850 comp rx=0 tx=0).stop 2023-07-21T22:32:12.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb557921000 1 -- 172.21.15.6:0/2607203744 shutdown_connections 2023-07-21T22:32:12.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb557921000 1 --2- 172.21.15.6:0/2607203744 >> [v2:172.21.15.6:6834/2511103099,v1:172.21.15.6:6835/2511103099] conn(0x5561f146f290 0x5561f146f660 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb557921000 1 --2- 172.21.15.6:0/2607203744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14ad810 0x5561f146e4f0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb557921000 1 --2- 172.21.15.6:0/2607203744 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14acf00 0x5561f14b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb557921000 1 --2- 172.21.15.6:0/2607203744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14638b0 0x5561f14b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb52d7fa640 0 client.6222 ms_handle_reset on v2:172.21.15.6:6834/2511103099 2023-07-21T22:32:12.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb557921000 1 -- 172.21.15.6:0/2607203744 >> 172.21.15.6:0/2607203744 conn(0x5561f1469a10 msgr2=0x5561f1462350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:12.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb557921000 1 -- 172.21.15.6:0/2607203744 shutdown_connections 2023-07-21T22:32:12.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.428+0000 7fb557921000 1 -- 172.21.15.6:0/2607203744 wait complete. 2023-07-21T22:32:12.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.432+0000 7fb557921000 20 client.6222 trim_cache size 0 max 16384 2023-07-21T22:32:12.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.444+0000 7fb557921000 1 Processor -- start 2023-07-21T22:32:12.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.444+0000 7fb557921000 1 -- start start 2023-07-21T22:32:12.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb557921000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14638b0 0x5561f15068c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb557921000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14acf00 0x5561f1506e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb557921000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14ad810 0x5561f1507340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb557921000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561f0f6e940 con 0x5561f14ad810 2023-07-21T22:32:12.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb557921000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561f12b9570 con 0x5561f14638b0 2023-07-21T22:32:12.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb557921000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561f12b3ee0 con 0x5561f14acf00 2023-07-21T22:32:12.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb552b6f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14ad810 0x5561f1507340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb552b6f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14ad810 0x5561f1507340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59898/0 (socket says 172.21.15.6:59898) 2023-07-21T22:32:12.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb552b6f640 1 -- 172.21.15.6:0/1458435817 learned_addr learned my addr 172.21.15.6:0/1458435817 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:12.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb551b6d640 1 --2- 172.21.15.6:0/1458435817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14acf00 0x5561f1506e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb55236e640 1 --2- 172.21.15.6:0/1458435817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14638b0 0x5561f15068c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb552b6f640 1 -- 172.21.15.6:0/1458435817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14acf00 msgr2=0x5561f1506e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:12.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb552b6f640 1 --2- 172.21.15.6:0/1458435817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14acf00 0x5561f1506e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb552b6f640 1 -- 172.21.15.6:0/1458435817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14638b0 msgr2=0x5561f15068c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:12.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb552b6f640 1 --2- 172.21.15.6:0/1458435817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14638b0 0x5561f15068c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb552b6f640 1 -- 172.21.15.6:0/1458435817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561f1465f80 con 0x5561f14ad810 2023-07-21T22:32:12.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb551b6d640 1 --2- 172.21.15.6:0/1458435817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14acf00 0x5561f1506e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:12.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb55236e640 1 --2- 172.21.15.6:0/1458435817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14638b0 0x5561f15068c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:12.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb552b6f640 1 --2- 172.21.15.6:0/1458435817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14ad810 0x5561f1507340 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb544012010 tx=0x7fb54400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5463d861fc980f7d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:12.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb540ff9640 1 -- 172.21.15.6:0/1458435817 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544011820 con 0x5561f14ad810 2023-07-21T22:32:12.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb540ff9640 1 -- 172.21.15.6:0/1458435817 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb544011980 con 0x5561f14ad810 2023-07-21T22:32:12.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb540ff9640 1 -- 172.21.15.6:0/1458435817 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544007a40 con 0x5561f14ad810 2023-07-21T22:32:12.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb557921000 1 -- 172.21.15.6:0/1458435817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14ad810 msgr2=0x5561f1507340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:12.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb557921000 1 --2- 172.21.15.6:0/1458435817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14ad810 0x5561f1507340 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb544012010 tx=0x7fb54400c000 comp rx=0 tx=0).stop 2023-07-21T22:32:12.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb557921000 1 -- 172.21.15.6:0/1458435817 shutdown_connections 2023-07-21T22:32:12.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb557921000 1 --2- 172.21.15.6:0/1458435817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14ad810 0x5561f1507340 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb557921000 1 --2- 172.21.15.6:0/1458435817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14acf00 0x5561f1506e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb557921000 1 --2- 172.21.15.6:0/1458435817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14638b0 0x5561f15068c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb557921000 1 -- 172.21.15.6:0/1458435817 >> 172.21.15.6:0/1458435817 conn(0x5561f1469a10 msgr2=0x5561f1467970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:12.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb557921000 1 -- 172.21.15.6:0/1458435817 shutdown_connections 2023-07-21T22:32:12.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb557921000 1 -- 172.21.15.6:0/1458435817 wait complete. 2023-07-21T22:32:12.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb557921000 1 -- start start 2023-07-21T22:32:12.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb557921000 1 Processor -- start 2023-07-21T22:32:12.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.448+0000 7fb557921000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14638b0 0x5561f150af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14acf00 0x5561f150b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14ad810 0x5561f14b1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561f12b0210 con 0x5561f14acf00 2023-07-21T22:32:12.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561f14baab0 con 0x5561f14638b0 2023-07-21T22:32:12.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561f14ba2e0 con 0x5561f14ad810 2023-07-21T22:32:12.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 10 client.0 _ll_register_callbacks cb 0x5561f142f430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:32:12.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb551b6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14acf00 0x5561f150b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb551b6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14acf00 0x5561f150b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59914/0 (socket says 172.21.15.6:59914) 2023-07-21T22:32:12.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb551b6d640 1 -- 172.21.15.6:0/200581368 learned_addr learned my addr 172.21.15.6:0/200581368 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:12.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb552b6f640 1 --2- 172.21.15.6:0/200581368 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14ad810 0x5561f14b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb55236e640 1 --2- 172.21.15.6:0/200581368 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14638b0 0x5561f150af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb551b6d640 1 -- 172.21.15.6:0/200581368 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14ad810 msgr2=0x5561f14b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:12.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb551b6d640 1 --2- 172.21.15.6:0/200581368 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14ad810 0x5561f14b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb551b6d640 1 -- 172.21.15.6:0/200581368 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14638b0 msgr2=0x5561f150af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:12.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb551b6d640 1 --2- 172.21.15.6:0/200581368 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14638b0 0x5561f150af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb551b6d640 1 -- 172.21.15.6:0/200581368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561f1275d10 con 0x5561f14acf00 2023-07-21T22:32:12.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb551b6d640 1 --2- 172.21.15.6:0/200581368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14acf00 0x5561f150b440 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb53c01a080 tx=0x7fb53c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2dd70c6a4bb8540 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:12.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb52d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:32:12.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb52d7fa640 1 -- 172.21.15.6:0/200581368 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c0c7040 con 0x5561f14acf00 2023-07-21T22:32:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb52d7fa640 1 -- 172.21.15.6:0/200581368 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fb53c0b68e0 con 0x5561f14acf00 2023-07-21T22:32:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 1 -- 172.21.15.6:0/200581368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561f12afcd0 con 0x5561f14acf00 2023-07-21T22:32:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb52d7fa640 1 -- 172.21.15.6:0/200581368 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb53c0b6aa0 con 0x5561f14acf00 2023-07-21T22:32:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 10 client.6228 fetch_fsmap learned FSMap version 24 2023-07-21T22:32:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 1 -- 172.21.15.6:0/200581368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x5561f125bfa0 con 0x5561f14acf00 2023-07-21T22:32:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb52d7fa640 1 -- 172.21.15.6:0/200581368 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561f12afcd0 con 0x5561f14acf00 2023-07-21T22:32:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb52d7fa640 1 -- 172.21.15.6:0/200581368 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 24) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fb53c0ca030 con 0x5561f14acf00 2023-07-21T22:32:12.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 10 client.6228 fetch_fsmap finished waiting for FSMap version 24 2023-07-21T22:32:12.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 10 client.6228 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-21T22:32:12.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 20 client.6228 populate_metadata read hostname 'smithi006' 2023-07-21T22:32:12.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 1 --2- 172.21.15.6:0/200581368 >> [v2:172.21.15.6:6834/2511103099,v1:172.21.15.6:6835/2511103099] conn(0x5561f1511d60 0x5561f1514140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 4 client.6228 mds_command: new command op to 6045 tid=0[{"prefix": "status"}] 2023-07-21T22:32:12.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 1 -- 172.21.15.6:0/200581368 --> [v2:172.21.15.6:6834/2511103099,v1:172.21.15.6:6835/2511103099] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5561f12aa360 con 0x5561f1511d60 2023-07-21T22:32:12.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb55236e640 1 --2- 172.21.15.6:0/200581368 >> [v2:172.21.15.6:6834/2511103099,v1:172.21.15.6:6835/2511103099] conn(0x5561f1511d60 0x5561f1514140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb55236e640 1 --2- 172.21.15.6:0/200581368 >> [v2:172.21.15.6:6834/2511103099,v1:172.21.15.6:6835/2511103099] conn(0x5561f1511d60 0x5561f1514140 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=360303e527de09e5 server_cookie=6cb76c2a496079e6 in_seq=0 out_seq=0 2023-07-21T22:32:12.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb52d7fa640 10 client.6228 ms_handle_connect on v2:172.21.15.6:6834/2511103099 2023-07-21T22:32:12.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb52d7fa640 1 -- 172.21.15.6:0/200581368 <== mds.0 v2:172.21.15.6:6834/2511103099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5561f12aa360 con 0x5561f1511d60 2023-07-21T22:32:12.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb52d7fa640 10 client.6228 handle_command_reply: tid=0 2023-07-21T22:32:12.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 1 client.6228 shutdown 2023-07-21T22:32:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 1 -- 172.21.15.6:0/200581368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14acf00 msgr2=0x5561f150b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 1 --2- 172.21.15.6:0/200581368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14acf00 0x5561f150b440 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb53c01a080 tx=0x7fb53c0046d0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 1 -- 172.21.15.6:0/200581368 shutdown_connections 2023-07-21T22:32:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 1 --2- 172.21.15.6:0/200581368 >> [v2:172.21.15.6:6834/2511103099,v1:172.21.15.6:6835/2511103099] conn(0x5561f1511d60 0x5561f1514140 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 1 --2- 172.21.15.6:0/200581368 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5561f14ad810 0x5561f14b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 1 --2- 172.21.15.6:0/200581368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561f14acf00 0x5561f150b440 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 1 --2- 172.21.15.6:0/200581368 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5561f14638b0 0x5561f150af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb52d7fa640 0 client.6228 ms_handle_reset on v2:172.21.15.6:6834/2511103099 2023-07-21T22:32:12.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 1 -- 172.21.15.6:0/200581368 >> 172.21.15.6:0/200581368 conn(0x5561f1469a10 msgr2=0x5561f1468200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:12.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 1 -- 172.21.15.6:0/200581368 shutdown_connections 2023-07-21T22:32:12.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 1 -- 172.21.15.6:0/200581368 wait complete. 2023-07-21T22:32:12.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.452+0000 7fb557921000 20 client.6228 trim_cache size 0 max 16384 2023-07-21T22:32:12.515 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:32:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "f3073df4-6cd1-4503-bd2e-d3e98fa18bdf", 2023-07-21T22:32:12.515 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-07-21T22:32:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 6045, 2023-07-21T22:32:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-07-21T22:32:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-07-21T22:32:12.516 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-07-21T22:32:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.508869238000001, 2023-07-21T22:32:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 24, 2023-07-21T22:32:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 67, 2023-07-21T22:32:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 67, 2023-07-21T22:32:12.517 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 16.412717831999998 2023-07-21T22:32:12.518 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:32:12.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.456+0000 7fb553370640 1 -- 172.21.15.6:0/3592255350 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fb5300663a0 msgr2=0x7fb530068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:12.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.456+0000 7fb553370640 1 --2- 172.21.15.6:0/3592255350 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fb5300663a0 0x7fb530068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0af000 tx=0x7fb53c0a7000 comp rx=0 tx=0).stop 2023-07-21T22:32:12.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.456+0000 7fb553370640 1 -- 172.21.15.6:0/3592255350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb54c0b42c0 msgr2=0x7fb54c14b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:12.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.456+0000 7fb553370640 1 --2- 172.21.15.6:0/3592255350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb54c0b42c0 0x7fb54c14b7e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb54800c500 tx=0x7fb54800c9c0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.456+0000 7fb553370640 1 -- 172.21.15.6:0/3592255350 shutdown_connections 2023-07-21T22:32:12.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.456+0000 7fb553370640 1 --2- 172.21.15.6:0/3592255350 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fb5300663a0 0x7fb530068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.456+0000 7fb553370640 1 --2- 172.21.15.6:0/3592255350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb54c0cee90 0x7fb54c1572e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.456+0000 7fb553370640 1 --2- 172.21.15.6:0/3592255350 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb54c0b7a10 0x7fb54c156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.456+0000 7fb553370640 1 --2- 172.21.15.6:0/3592255350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb54c0b42c0 0x7fb54c14b7e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.456+0000 7fb553370640 1 -- 172.21.15.6:0/3592255350 >> 172.21.15.6:0/3592255350 conn(0x7fb54c069ea0 msgr2=0x7fb54c0ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.456+0000 7fb553370640 1 -- 172.21.15.6:0/3592255350 shutdown_connections 2023-07-21T22:32:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.456+0000 7fb553370640 1 -- 172.21.15.6:0/3592255350 wait complete. 2023-07-21T22:32:12.522 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:32:12.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.616+0000 7fb62b2f9640 1 Processor -- start 2023-07-21T22:32:12.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.616+0000 7fb62b2f9640 1 -- start start 2023-07-21T22:32:12.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.620+0000 7fb62b2f9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb624158ce0 0x7fb624070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.620+0000 7fb62b2f9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb6240c8ad0 0x7fb6240c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.620+0000 7fb62b2f9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6240c99c0 con 0x7fb6240c9560 2023-07-21T22:32:12.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.620+0000 7fb62b2f9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6240cc700 con 0x7fb6240c8ad0 2023-07-21T22:32:12.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.620+0000 7fb62b2f9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6240b0ff0 con 0x7fb624158ce0 2023-07-21T22:32:12.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.620+0000 7fb628894640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb6240c8ad0 0x7fb6240c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.620+0000 7fb628894640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb6240c8ad0 0x7fb6240c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59916/0 (socket says 172.21.15.6:59916) 2023-07-21T22:32:12.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.620+0000 7fb628894640 1 -- 172.21.15.6:0/1372221604 learned_addr learned my addr 172.21.15.6:0/1372221604 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:12.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.620+0000 7fb629095640 1 --2- 172.21.15.6:0/1372221604 >> v2:172.21.15.161:3300/0 conn(0x7fb624158ce0 0x7fb624070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.620+0000 7fb628894640 1 -- 172.21.15.6:0/1372221604 >> v2:172.21.15.161:3300/0 conn(0x7fb624158ce0 msgr2=0x7fb624070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:12.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.620+0000 7fb628894640 1 --2- 172.21.15.6:0/1372221604 >> v2:172.21.15.161:3300/0 conn(0x7fb624158ce0 0x7fb624070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.620+0000 7fb628894640 1 -- 172.21.15.6:0/1372221604 >> v1:172.21.15.161:6789/0 conn(0x7fb6240c9560 legacy=0x7fb6240cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:12.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.620+0000 7fb628894640 1 -- 172.21.15.6:0/1372221604 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb624070c80 con 0x7fb6240c8ad0 2023-07-21T22:32:12.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.620+0000 7fb629095640 1 --2- 172.21.15.6:0/1372221604 >> v2:172.21.15.161:3300/0 conn(0x7fb624158ce0 0x7fb624070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:32:12.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.620+0000 7fb628894640 1 --2- 172.21.15.6:0/1372221604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6240c8ad0 0x7fb6240c9020 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb624071be0 tx=0x7fb61401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972bcfe69e0f72bc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:12.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb61bfff640 1 -- 172.21.15.6:0/1372221604 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6240cba20 con 0x7fb6240c8ad0 2023-07-21T22:32:12.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb61bfff640 1 -- 172.21.15.6:0/1372221604 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6140ac410 con 0x7fb6240c8ad0 2023-07-21T22:32:12.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb61bfff640 1 -- 172.21.15.6:0/1372221604 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6140ac7a0 con 0x7fb6240c8ad0 2023-07-21T22:32:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb62b2f9640 1 -- 172.21.15.6:0/1372221604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6240c8ad0 msgr2=0x7fb6240c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb62b2f9640 1 --2- 172.21.15.6:0/1372221604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6240c8ad0 0x7fb6240c9020 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb624071be0 tx=0x7fb61401c3b0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb62b2f9640 1 -- 172.21.15.6:0/1372221604 shutdown_connections 2023-07-21T22:32:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb62b2f9640 1 --2- 172.21.15.6:0/1372221604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6240c8ad0 0x7fb6240c9020 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb62b2f9640 1 --2- 172.21.15.6:0/1372221604 >> v2:172.21.15.161:3300/0 conn(0x7fb624158ce0 0x7fb624070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb62b2f9640 1 -- 172.21.15.6:0/1372221604 >> 172.21.15.6:0/1372221604 conn(0x7fb6240afcf0 msgr2=0x7fb6240b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb62b2f9640 1 -- 172.21.15.6:0/1372221604 shutdown_connections 2023-07-21T22:32:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb62b2f9640 1 -- 172.21.15.6:0/1372221604 wait complete. 2023-07-21T22:32:12.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb62b2f9640 1 Processor -- start 2023-07-21T22:32:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb62b2f9640 1 -- start start 2023-07-21T22:32:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb62b2f9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6240c8ad0 0x7fb62414f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb62b2f9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6240c9560 0x7fb6240b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb62b2f9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb624158ce0 0x7fb6240acb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb62b2f9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6240ab8a0 con 0x7fb6240c9560 2023-07-21T22:32:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb62b2f9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6240ac700 con 0x7fb624158ce0 2023-07-21T22:32:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb62b2f9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6240abaf0 con 0x7fb6240c8ad0 2023-07-21T22:32:12.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb628894640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6240c9560 0x7fb6240b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb628894640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6240c9560 0x7fb6240b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59930/0 (socket says 172.21.15.6:59930) 2023-07-21T22:32:12.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb628894640 1 -- 172.21.15.6:0/1411652836 learned_addr learned my addr 172.21.15.6:0/1411652836 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:12.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.624+0000 7fb629095640 1 --2- 172.21.15.6:0/1411652836 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6240c8ad0 0x7fb62414f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.628+0000 7fb629896640 1 --2- 172.21.15.6:0/1411652836 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb624158ce0 0x7fb6240acb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.628+0000 7fb628894640 1 -- 172.21.15.6:0/1411652836 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6240c8ad0 msgr2=0x7fb62414f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:12.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.628+0000 7fb628894640 1 --2- 172.21.15.6:0/1411652836 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6240c8ad0 0x7fb62414f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.628+0000 7fb628894640 1 -- 172.21.15.6:0/1411652836 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb624158ce0 msgr2=0x7fb6240acb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:12.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.628+0000 7fb628894640 1 --2- 172.21.15.6:0/1411652836 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb624158ce0 0x7fb6240acb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.628+0000 7fb628894640 1 -- 172.21.15.6:0/1411652836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6140094d0 con 0x7fb6240c9560 2023-07-21T22:32:12.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.628+0000 7fb628894640 1 --2- 172.21.15.6:0/1411652836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6240c9560 0x7fb6240b20a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb6140af040 tx=0x7fb614019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:12.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.628+0000 7fb619ffb640 1 -- 172.21.15.6:0/1411652836 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6140b45c0 con 0x7fb6240c9560 2023-07-21T22:32:12.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.628+0000 7fb619ffb640 1 -- 172.21.15.6:0/1411652836 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6140b4720 con 0x7fb6240c9560 2023-07-21T22:32:12.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.628+0000 7fb619ffb640 1 -- 172.21.15.6:0/1411652836 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6140b4ad0 con 0x7fb6240c9560 2023-07-21T22:32:12.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.628+0000 7fb62b2f9640 1 -- 172.21.15.6:0/1411652836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6240abdd0 con 0x7fb6240c9560 2023-07-21T22:32:12.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.628+0000 7fb62b2f9640 1 -- 172.21.15.6:0/1411652836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6240ac390 con 0x7fb6240c9560 2023-07-21T22:32:12.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.628+0000 7fb62b2f9640 1 -- 172.21.15.6:0/1411652836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6240ca1a0 con 0x7fb6240c9560 2023-07-21T22:32:12.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.628+0000 7fb619ffb640 1 -- 172.21.15.6:0/1411652836 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb6140b4c30 con 0x7fb6240c9560 2023-07-21T22:32:12.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.628+0000 7fb619ffb640 1 --2- 172.21.15.6:0/1411652836 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fb6080663d0 0x7fb608068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:12.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.632+0000 7fb619ffb640 1 -- 172.21.15.6:0/1411652836 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fb61411e660 con 0x7fb6240c9560 2023-07-21T22:32:12.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.632+0000 7fb629095640 1 --2- 172.21.15.6:0/1411652836 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fb6080663d0 0x7fb608068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:12.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.632+0000 7fb629095640 1 --2- 172.21.15.6:0/1411652836 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fb6080663d0 0x7fb608068880 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb620006fd0 tx=0x7fb620008040 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:12.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.632+0000 7fb619ffb640 1 -- 172.21.15.6:0/1411652836 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb6140eb900 con 0x7fb6240c9560 2023-07-21T22:32:12.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.836+0000 7fb62b2f9640 1 -- 172.21.15.6:0/1411652836 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb6240678d0 con 0x7fb6240c9560 2023-07-21T22:32:12.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.840+0000 7fb619ffb640 1 -- 172.21.15.6:0/1411652836 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb6140eef20 con 0x7fb6240c9560 2023-07-21T22:32:12.887 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T22:32:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.840+0000 7fb62b2f9640 1 -- 172.21.15.6:0/1411652836 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fb6080663d0 msgr2=0x7fb608068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.840+0000 7fb62b2f9640 1 --2- 172.21.15.6:0/1411652836 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fb6080663d0 0x7fb608068880 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb620006fd0 tx=0x7fb620008040 comp rx=0 tx=0).stop 2023-07-21T22:32:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.840+0000 7fb62b2f9640 1 -- 172.21.15.6:0/1411652836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6240c9560 msgr2=0x7fb6240b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.840+0000 7fb62b2f9640 1 --2- 172.21.15.6:0/1411652836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6240c9560 0x7fb6240b20a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb6140af040 tx=0x7fb614019150 comp rx=0 tx=0).stop 2023-07-21T22:32:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.840+0000 7fb62b2f9640 1 -- 172.21.15.6:0/1411652836 shutdown_connections 2023-07-21T22:32:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.840+0000 7fb62b2f9640 1 --2- 172.21.15.6:0/1411652836 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7fb6080663d0 0x7fb608068880 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.840+0000 7fb62b2f9640 1 --2- 172.21.15.6:0/1411652836 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb624158ce0 0x7fb6240acb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.840+0000 7fb62b2f9640 1 --2- 172.21.15.6:0/1411652836 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6240c9560 0x7fb6240b20a0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.840+0000 7fb62b2f9640 1 --2- 172.21.15.6:0/1411652836 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6240c8ad0 0x7fb62414f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:12.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.840+0000 7fb62b2f9640 1 -- 172.21.15.6:0/1411652836 >> 172.21.15.6:0/1411652836 conn(0x7fb6240afcf0 msgr2=0x7fb624153bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:12.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.840+0000 7fb62b2f9640 1 -- 172.21.15.6:0/1411652836 shutdown_connections 2023-07-21T22:32:12.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:12.840+0000 7fb62b2f9640 1 -- 172.21.15.6:0/1411652836 wait complete. 2023-07-21T22:32:12.907 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-21T22:32:12.908 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:32:12.908 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-07-21T22:32:12.908 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T22:32:12.909 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T22:32:12.909 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-21T22:32:12.909 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-21T22:32:12.909 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:32:12.910 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:32:12.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:12.910 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-07-21T22:32:12.920 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:32:12.920 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:32:12.920 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:32:12.920 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:32:12.921 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-21T22:32:12.921 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:32:12.921 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:32:12.921 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:32:12.921 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-07-21T22:32:12.921 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:32:12.921 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:32:12.921 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-07-21T22:32:12.922 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:32:12.922 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:32:12.922 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-07-21T22:32:12.922 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:32:12.922 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41312sec preferred_lft 41312sec 2023-07-21T22:32:12.922 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-07-21T22:32:12.922 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:32:12.923 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:32:12.923 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:32:12.923 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-07-21T22:32:12.923 INFO:teuthology.orchestra.run.smithi006.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:32:12.923 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:42:2f:9a:3d:15 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:32:12.923 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:32:12.923 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:32:12.923 INFO:teuthology.orchestra.run.smithi006.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:32:12.924 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-21T22:32:12.924 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T22:32:12.924 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:32:12.924 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-21T22:32:12.924 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:32:12.924 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:32:12.924 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:32:12.925 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-21T22:32:12.925 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:32:12.925 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:32:12.925 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T22:32:12.925 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-21T22:32:12.925 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:32:12.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:12.926 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:32:12.984 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:32:12.994 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-07-21T22:32:12.997 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:32:12.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:12.998 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-07-21T22:32:13.049 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-07-21T22:32:13.049 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:32:13.049 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:32:13.049 INFO:teuthology.orchestra.run.smithi006.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:32:13.049 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:32:13.049 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:32:13.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:13.050 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T22:32:13.051 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T22:32:13.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:32:13.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:32:13.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:32:13.052 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T22:32:13.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:13.144 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T22:32:13.154 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-21T22:32:13.154 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T22:32:13.156 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:32:13.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:13.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-07-21T22:32:13.243 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:32:13.243 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T22:32:13.300 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:32:13.300 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:32:13.301 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:32:13.350 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-21T22:32:13.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:13.351 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:32:13.446 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:32:13.447 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:32:13.447 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:32:13.462 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:32:13.462 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:32:13.462 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:32:13.463 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:32:13.463 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:32:13.469 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:32:13.470 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:32:13.470 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:32:13.471 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:32:13.471 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:32:13.471 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-07-21T22:32:13.472 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-07-21T22:32:13.472 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f3073df4-6cd1-4503-bd2e-d3e98fa18bdf" will pass to kernel 2023-07-21T22:32:13.473 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T22:32:13.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:13.474 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:32:13.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:13.497 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:32:13.554 INFO:teuthology.orchestra.run.smithi006.stdout:client6237 2023-07-21T22:32:13.555 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:32:13.555 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:32:13.607 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-21T22:32:13.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.752+0000 7f0cc360b640 1 Processor -- start 2023-07-21T22:32:13.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.752+0000 7f0cc360b640 1 -- start start 2023-07-21T22:32:13.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.752+0000 7f0cc360b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cbc158ce0 0x7f0cbc070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:13.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.752+0000 7f0cc360b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0cbc0c8ad0 0x7f0cbc0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:13.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.752+0000 7f0cc360b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cbc0cc700 con 0x7f0cbc0c9560 2023-07-21T22:32:13.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.752+0000 7f0cc360b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cbc0c99e0 con 0x7f0cbc0c8ad0 2023-07-21T22:32:13.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.752+0000 7f0cc360b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc0b0ff0 con 0x7f0cbc158ce0 2023-07-21T22:32:13.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.752+0000 7f0cc1ba8640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0cbc0c9560 0x7f0cbc0cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52556/0 (socket says 172.21.15.6:52556) 2023-07-21T22:32:13.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.752+0000 7f0cc1ba8640 1 -- 172.21.15.6:0/3914356002 learned_addr learned my addr 172.21.15.6:0/3914356002 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:32:13.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.752+0000 7f0cc13a7640 1 --2- 172.21.15.6:0/3914356002 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cbc158ce0 0x7f0cbc070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:13.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.752+0000 7f0cc0ba6640 1 --2- 172.21.15.6:0/3914356002 >> v2:172.21.15.161:3300/0 conn(0x7f0cbc0c8ad0 0x7f0cbc0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:13.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.752+0000 7f0cb3fff640 1 -- 172.21.15.6:0/3914356002 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845915699 0 0) 0x7f0cbc0cc700 con 0x7f0cbc0c9560 2023-07-21T22:32:13.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.752+0000 7f0cb3fff640 1 -- 172.21.15.6:0/3914356002 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ca8003530 con 0x7f0cbc0c9560 2023-07-21T22:32:13.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.752+0000 7f0cc13a7640 1 -- 172.21.15.6:0/3914356002 >> v2:172.21.15.161:3300/0 conn(0x7f0cbc0c8ad0 msgr2=0x7f0cbc0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:13.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.752+0000 7f0cc13a7640 1 --2- 172.21.15.6:0/3914356002 >> v2:172.21.15.161:3300/0 conn(0x7f0cbc0c8ad0 0x7f0cbc0c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:13.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.752+0000 7f0cc13a7640 1 -- 172.21.15.6:0/3914356002 >> v1:172.21.15.6:6789/0 conn(0x7f0cbc0c9560 legacy=0x7f0cbc0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:13.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.752+0000 7f0cc13a7640 1 -- 172.21.15.6:0/3914356002 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cbc070c80 con 0x7f0cbc158ce0 2023-07-21T22:32:13.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.756+0000 7f0cc13a7640 1 --2- 172.21.15.6:0/3914356002 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cbc158ce0 0x7f0cbc070450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80097c0 tx=0x7f0cb801e540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=492ecb60999a7d0f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:13.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.756+0000 7f0cb3fff640 1 -- 172.21.15.6:0/3914356002 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc0cba20 con 0x7f0cbc158ce0 2023-07-21T22:32:13.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.756+0000 7f0cb3fff640 1 -- 172.21.15.6:0/3914356002 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb80ad660 con 0x7f0cbc158ce0 2023-07-21T22:32:13.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.756+0000 7f0cb3fff640 1 -- 172.21.15.6:0/3914356002 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80ad9f0 con 0x7f0cbc158ce0 2023-07-21T22:32:13.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.756+0000 7f0cc360b640 1 -- 172.21.15.6:0/3914356002 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cbc158ce0 msgr2=0x7f0cbc070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:13.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.756+0000 7f0cc360b640 1 --2- 172.21.15.6:0/3914356002 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cbc158ce0 0x7f0cbc070450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80097c0 tx=0x7f0cb801e540 comp rx=0 tx=0).stop 2023-07-21T22:32:13.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.756+0000 7f0cc360b640 1 -- 172.21.15.6:0/3914356002 shutdown_connections 2023-07-21T22:32:13.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.756+0000 7f0cc360b640 1 --2- 172.21.15.6:0/3914356002 >> v2:172.21.15.161:3300/0 conn(0x7f0cbc0c8ad0 0x7f0cbc0c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:13.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.756+0000 7f0cc360b640 1 --2- 172.21.15.6:0/3914356002 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cbc158ce0 0x7f0cbc070450 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:13.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.756+0000 7f0cc360b640 1 -- 172.21.15.6:0/3914356002 >> 172.21.15.6:0/3914356002 conn(0x7f0cbc0afcf0 msgr2=0x7f0cbc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:13.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.756+0000 7f0cc360b640 1 -- 172.21.15.6:0/3914356002 shutdown_connections 2023-07-21T22:32:13.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.756+0000 7f0cc360b640 1 -- 172.21.15.6:0/3914356002 wait complete. 2023-07-21T22:32:13.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc360b640 1 Processor -- start 2023-07-21T22:32:13.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc360b640 1 -- start start 2023-07-21T22:32:13.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc360b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cbc0c8ad0 0x7f0cbc06fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:13.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc360b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cbc0c9560 0x7f0cbc14be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:13.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc360b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cbc158ce0 0x7f0cbc14c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:13.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc360b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc14d7b0 con 0x7f0cbc0c9560 2023-07-21T22:32:13.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc360b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc14cba0 con 0x7f0cbc0c8ad0 2023-07-21T22:32:13.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc360b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc14ce80 con 0x7f0cbc158ce0 2023-07-21T22:32:13.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc0ba6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cbc0c9560 0x7f0cbc14be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:13.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc0ba6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cbc0c9560 0x7f0cbc14be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59946/0 (socket says 172.21.15.6:59946) 2023-07-21T22:32:13.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc0ba6640 1 -- 172.21.15.6:0/3791626312 learned_addr learned my addr 172.21.15.6:0/3791626312 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:13.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc13a7640 1 --2- 172.21.15.6:0/3791626312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cbc0c8ad0 0x7f0cbc06fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:13.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc1ba8640 1 --2- 172.21.15.6:0/3791626312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cbc158ce0 0x7f0cbc14c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:13.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc0ba6640 1 -- 172.21.15.6:0/3791626312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cbc158ce0 msgr2=0x7f0cbc14c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:13.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc0ba6640 1 --2- 172.21.15.6:0/3791626312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cbc158ce0 0x7f0cbc14c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:13.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc0ba6640 1 -- 172.21.15.6:0/3791626312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cbc0c8ad0 msgr2=0x7f0cbc06fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc0ba6640 1 --2- 172.21.15.6:0/3791626312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cbc0c8ad0 0x7f0cbc06fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc0ba6640 1 -- 172.21.15.6:0/3791626312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb8009420 con 0x7f0cbc0c9560 2023-07-21T22:32:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc0ba6640 1 --2- 172.21.15.6:0/3791626312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cbc0c9560 0x7f0cbc14be00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0cac00e870 tx=0x7f0cac00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cb1ffb640 1 -- 172.21.15.6:0/3791626312 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac009510 con 0x7f0cbc0c9560 2023-07-21T22:32:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cb1ffb640 1 -- 172.21.15.6:0/3791626312 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cac00eec0 con 0x7f0cbc0c9560 2023-07-21T22:32:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cb1ffb640 1 -- 172.21.15.6:0/3791626312 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cac00cb40 con 0x7f0cbc0c9560 2023-07-21T22:32:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc360b640 1 -- 172.21.15.6:0/3791626312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cbc14d160 con 0x7f0cbc0c9560 2023-07-21T22:32:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.760+0000 7f0cc360b640 1 -- 172.21.15.6:0/3791626312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cbc14c880 con 0x7f0cbc0c9560 2023-07-21T22:32:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.764+0000 7f0cc360b640 1 -- 172.21.15.6:0/3791626312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cbc0ca1a0 con 0x7f0cbc0c9560 2023-07-21T22:32:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.764+0000 7f0cb1ffb640 1 -- 172.21.15.6:0/3791626312 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0cac00cca0 con 0x7f0cbc0c9560 2023-07-21T22:32:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.764+0000 7f0cb1ffb640 1 --2- 172.21.15.6:0/3791626312 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0ca00663d0 0x7f0ca0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.764+0000 7f0cb1ffb640 1 -- 172.21.15.6:0/3791626312 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f0cac083e90 con 0x7f0cbc0c9560 2023-07-21T22:32:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.764+0000 7f0cc13a7640 1 --2- 172.21.15.6:0/3791626312 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0ca00663d0 0x7f0ca0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.764+0000 7f0cc13a7640 1 --2- 172.21.15.6:0/3791626312 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0ca00663d0 0x7f0ca0068880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80b1000 tx=0x7f0cb80a9000 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:13.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.768+0000 7f0cb1ffb640 1 -- 172.21.15.6:0/3791626312 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0cac051270 con 0x7f0cbc0c9560 2023-07-21T22:32:13.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.944+0000 7f0cc360b640 1 -- 172.21.15.6:0/3791626312 --> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0cbc070990 con 0x7f0ca00663d0 2023-07-21T22:32:13.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.944+0000 7f0cb1ffb640 1 -- 172.21.15.6:0/3791626312 <== mgr.5743 v2:172.21.15.161:6832/3740183048 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f0cb80ad7d0 con 0x7f0ca00663d0 2023-07-21T22:32:13.994 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:32:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:32:13.994 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephfs" 2023-07-21T22:32:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:32:13.995 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:32:13.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.948+0000 7f0cc360b640 1 -- 172.21.15.6:0/3791626312 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0ca00663d0 msgr2=0x7f0ca0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:13.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.948+0000 7f0cc360b640 1 --2- 172.21.15.6:0/3791626312 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0ca00663d0 0x7f0ca0068880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80b1000 tx=0x7f0cb80a9000 comp rx=0 tx=0).stop 2023-07-21T22:32:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.948+0000 7f0cc360b640 1 -- 172.21.15.6:0/3791626312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cbc0c9560 msgr2=0x7f0cbc14be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.948+0000 7f0cc360b640 1 --2- 172.21.15.6:0/3791626312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cbc0c9560 0x7f0cbc14be00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0cac00e870 tx=0x7f0cac00ec70 comp rx=0 tx=0).stop 2023-07-21T22:32:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.948+0000 7f0cc360b640 1 -- 172.21.15.6:0/3791626312 shutdown_connections 2023-07-21T22:32:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.948+0000 7f0cc360b640 1 --2- 172.21.15.6:0/3791626312 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0ca00663d0 0x7f0ca0068880 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.948+0000 7f0cc360b640 1 --2- 172.21.15.6:0/3791626312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cbc158ce0 0x7f0cbc14c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.948+0000 7f0cc360b640 1 --2- 172.21.15.6:0/3791626312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cbc0c9560 0x7f0cbc14be00 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.948+0000 7f0cc360b640 1 --2- 172.21.15.6:0/3791626312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cbc0c8ad0 0x7f0cbc06fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:13.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.948+0000 7f0cc360b640 1 -- 172.21.15.6:0/3791626312 >> 172.21.15.6:0/3791626312 conn(0x7f0cbc0afcf0 msgr2=0x7f0cbc0ca6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:13.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.948+0000 7f0cc360b640 1 -- 172.21.15.6:0/3791626312 shutdown_connections 2023-07-21T22:32:13.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:13.948+0000 7f0cc360b640 1 -- 172.21.15.6:0/3791626312 wait complete. 2023-07-21T22:32:14.015 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-21T22:32:14.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.112+0000 7f48cbf9f640 1 Processor -- start 2023-07-21T22:32:14.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.112+0000 7f48cbf9f640 1 -- start start 2023-07-21T22:32:14.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48cbf9f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f48c4159500 0x7f48c40cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48cbf9f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c40b08d0 con 0x7f48c40cd670 2023-07-21T22:32:14.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48cbf9f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c4159cb0 con 0x7f48c4156560 2023-07-21T22:32:14.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48cbf9f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c41599d0 con 0x7f48c4159500 2023-07-21T22:32:14.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c953a640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f48c40cd670 0x7f48c4158df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52568/0 (socket says 172.21.15.6:52568) 2023-07-21T22:32:14.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c953a640 1 -- 172.21.15.6:0/3717135634 learned_addr learned my addr 172.21.15.6:0/3717135634 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:32:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48ca53c640 1 --2- 172.21.15.6:0/3717135634 >> v2:172.21.15.161:3300/0 conn(0x7f48c4159500 0x7f48c40cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c8d39640 1 -- 172.21.15.6:0/3717135634 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110726063 0 0) 0x7f48c40b08d0 con 0x7f48c40cd670 2023-07-21T22:32:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c8d39640 1 -- 172.21.15.6:0/3717135634 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48b0003530 con 0x7f48c40cd670 2023-07-21T22:32:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c8d39640 1 -- 172.21.15.6:0/3717135634 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 677168369 0 0) 0x7f48b0003530 con 0x7f48c40cd670 2023-07-21T22:32:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c8d39640 1 -- 172.21.15.6:0/3717135634 >> v2:172.21.15.161:3300/0 conn(0x7f48c4159500 msgr2=0x7f48c40cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c8d39640 1 --2- 172.21.15.6:0/3717135634 >> v2:172.21.15.161:3300/0 conn(0x7f48c4159500 0x7f48c40cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c8d39640 1 -- 172.21.15.6:0/3717135634 >> v1:172.21.15.161:6789/0 conn(0x7f48c4156560 legacy=0x7f48c40ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c8d39640 1 -- 172.21.15.6:0/3717135634 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c40ca900 con 0x7f48c40cd670 2023-07-21T22:32:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c8d39640 1 -- 172.21.15.6:0/3717135634 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f48b4001680 con 0x7f48c40cd670 2023-07-21T22:32:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c8d39640 1 -- 172.21.15.6:0/3717135634 >> v1:172.21.15.6:6789/0 conn(0x7f48c40cd670 legacy=0x7f48c4158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c8d39640 1 --2- 172.21.15.6:0/3717135634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48b0003980 0x7f48b0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c8d39640 1 --2- 172.21.15.6:0/3717135634 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48b00047d0 0x7f48b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c8d39640 1 --2- 172.21.15.6:0/3717135634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48b0005180 0x7f48b000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c8d39640 1 -- 172.21.15.6:0/3717135634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c41599d0 con 0x7f48b0005180 2023-07-21T22:32:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c8d39640 1 -- 172.21.15.6:0/3717135634 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b000e210 con 0x7f48b0003980 2023-07-21T22:32:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c8d39640 1 -- 172.21.15.6:0/3717135634 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b000e3d0 con 0x7f48b00047d0 2023-07-21T22:32:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48ca53c640 1 --2- 172.21.15.6:0/3717135634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48b0005180 0x7f48b000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c953a640 1 --2- 172.21.15.6:0/3717135634 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48b00047d0 0x7f48b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c9d3b640 1 --2- 172.21.15.6:0/3717135634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48b0003980 0x7f48b0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48ca53c640 1 -- 172.21.15.6:0/3717135634 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48b00047d0 msgr2=0x7f48b0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48ca53c640 1 --2- 172.21.15.6:0/3717135634 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48b00047d0 0x7f48b0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48ca53c640 1 -- 172.21.15.6:0/3717135634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48b0003980 msgr2=0x7f48b0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48ca53c640 1 --2- 172.21.15.6:0/3717135634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48b0003980 0x7f48b0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48ca53c640 1 -- 172.21.15.6:0/3717135634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b0003530 con 0x7f48b0005180 2023-07-21T22:32:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c953a640 1 --2- 172.21.15.6:0/3717135634 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48b00047d0 0x7f48b0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.116+0000 7f48c9d3b640 1 --2- 172.21.15.6:0/3717135634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48b0003980 0x7f48b0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:14.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.120+0000 7f48ca53c640 1 -- 172.21.15.6:0/3717135634 reap_dead start 2023-07-21T22:32:14.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.120+0000 7f48ca53c640 1 --2- 172.21.15.6:0/3717135634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48b0005180 0x7f48b000dba0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f48bc009f90 tx=0x7f48bc01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6d7ba0e9eae55d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:14.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.120+0000 7f48c8d39640 1 -- 172.21.15.6:0/3717135634 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc0a5c70 con 0x7f48b0005180 2023-07-21T22:32:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.120+0000 7f48c8d39640 1 -- 172.21.15.6:0/3717135634 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48bc00f040 con 0x7f48b0005180 2023-07-21T22:32:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.120+0000 7f48c8d39640 1 -- 172.21.15.6:0/3717135634 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc0039a0 con 0x7f48b0005180 2023-07-21T22:32:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.120+0000 7f48cbf9f640 1 -- 172.21.15.6:0/3717135634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48b0005180 msgr2=0x7f48b000dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.120+0000 7f48cbf9f640 1 --2- 172.21.15.6:0/3717135634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48b0005180 0x7f48b000dba0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f48bc009f90 tx=0x7f48bc01cc60 comp rx=0 tx=0).stop 2023-07-21T22:32:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.120+0000 7f48cbf9f640 1 -- 172.21.15.6:0/3717135634 shutdown_connections 2023-07-21T22:32:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.120+0000 7f48cbf9f640 1 --2- 172.21.15.6:0/3717135634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48b0005180 0x7f48b000dba0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.120+0000 7f48cbf9f640 1 -- 172.21.15.6:0/3717135634 >> 172.21.15.6:0/3717135634 conn(0x7f48c40afac0 msgr2=0x7f48c40afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.120+0000 7f48cbf9f640 1 -- 172.21.15.6:0/3717135634 shutdown_connections 2023-07-21T22:32:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.120+0000 7f48cbf9f640 1 -- 172.21.15.6:0/3717135634 wait complete. 2023-07-21T22:32:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.120+0000 7f48cbf9f640 1 Processor -- start 2023-07-21T22:32:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.120+0000 7f48cbf9f640 1 -- start start 2023-07-21T22:32:14.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48cbf9f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48b0005180 0x7f48c4150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48cbf9f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48c40b20a0 0x7f48c40cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48cbf9f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48c40b2510 0x7f48c40cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48cbf9f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c4157c40 con 0x7f48b0005180 2023-07-21T22:32:14.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48cbf9f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c41f1c20 con 0x7f48c40b2510 2023-07-21T22:32:14.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48cbf9f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c41f1940 con 0x7f48c40b20a0 2023-07-21T22:32:14.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48c9d3b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48b0005180 0x7f48c4150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48c9d3b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48b0005180 0x7f48c4150690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59956/0 (socket says 172.21.15.6:59956) 2023-07-21T22:32:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48c9d3b640 1 -- 172.21.15.6:0/1720627872 learned_addr learned my addr 172.21.15.6:0/1720627872 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48c953a640 1 --2- 172.21.15.6:0/1720627872 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48c40b20a0 0x7f48c40cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48c9d3b640 1 -- 172.21.15.6:0/1720627872 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48c40b20a0 msgr2=0x7f48c40cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48ca53c640 1 --2- 172.21.15.6:0/1720627872 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48c40b2510 0x7f48c40cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48c9d3b640 1 --2- 172.21.15.6:0/1720627872 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48c40b20a0 0x7f48c40cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48c9d3b640 1 -- 172.21.15.6:0/1720627872 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48c40b2510 msgr2=0x7f48c40cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48c9d3b640 1 --2- 172.21.15.6:0/1720627872 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48c40b2510 0x7f48c40cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48c9d3b640 1 -- 172.21.15.6:0/1720627872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c4150cf0 con 0x7f48b0005180 2023-07-21T22:32:14.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48c953a640 1 --2- 172.21.15.6:0/1720627872 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48c40b20a0 0x7f48c40cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:32:14.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48ca53c640 1 --2- 172.21.15.6:0/1720627872 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48c40b2510 0x7f48c40cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:32:14.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48c9d3b640 1 --2- 172.21.15.6:0/1720627872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48b0005180 0x7f48c4150690 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f48c000e4d0 tx=0x7f48c000e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:14.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48ba7fc640 1 -- 172.21.15.6:0/1720627872 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c00052e0 con 0x7f48b0005180 2023-07-21T22:32:14.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48ba7fc640 1 -- 172.21.15.6:0/1720627872 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c0005440 con 0x7f48b0005180 2023-07-21T22:32:14.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48cbf9f640 1 -- 172.21.15.6:0/1720627872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c4150fd0 con 0x7f48b0005180 2023-07-21T22:32:14.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48ba7fc640 1 -- 172.21.15.6:0/1720627872 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c0003820 con 0x7f48b0005180 2023-07-21T22:32:14.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48cbf9f640 1 -- 172.21.15.6:0/1720627872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c41f0cc0 con 0x7f48b0005180 2023-07-21T22:32:14.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.124+0000 7f48cbf9f640 1 -- 172.21.15.6:0/1720627872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c40cabc0 con 0x7f48b0005180 2023-07-21T22:32:14.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.128+0000 7f48ba7fc640 1 -- 172.21.15.6:0/1720627872 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f48c0003980 con 0x7f48b0005180 2023-07-21T22:32:14.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.128+0000 7f48ba7fc640 1 --2- 172.21.15.6:0/1720627872 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f48a80663d0 0x7f48a8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.128+0000 7f48ba7fc640 1 -- 172.21.15.6:0/1720627872 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f48c0083c70 con 0x7f48b0005180 2023-07-21T22:32:14.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.128+0000 7f48c953a640 1 --2- 172.21.15.6:0/1720627872 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f48a80663d0 0x7f48a8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.128+0000 7f48c953a640 1 --2- 172.21.15.6:0/1720627872 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f48a80663d0 0x7f48a8068880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f48b4001ec0 tx=0x7f48b4000ee0 comp rx=0 tx=0).ready entity=mgr.5743 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:14.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.132+0000 7f48ba7fc640 1 -- 172.21.15.6:0/1720627872 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f48c40cabc0 con 0x7f48b0005180 2023-07-21T22:32:14.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.320+0000 7f48cbf9f640 1 -- 172.21.15.6:0/1720627872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f48c40cabc0 con 0x7f48b0005180 2023-07-21T22:32:14.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.788+0000 7f48ba7fc640 1 -- 172.21.15.6:0/1720627872 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 17) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f48c0082000 con 0x7f48b0005180 2023-07-21T22:32:14.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.788+0000 7f48ba7fc640 1 -- 172.21.15.6:0/1720627872 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v17) v1 ==== 92+0+0 (secure 0 0 0) 0x7f48c006ce30 con 0x7f48b0005180 2023-07-21T22:32:14.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.792+0000 7f48cbf9f640 1 -- 172.21.15.6:0/1720627872 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f48a80663d0 msgr2=0x7f48a8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:14.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.792+0000 7f48cbf9f640 1 --2- 172.21.15.6:0/1720627872 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f48a80663d0 0x7f48a8068880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f48b4001ec0 tx=0x7f48b4000ee0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.792+0000 7f48cbf9f640 1 -- 172.21.15.6:0/1720627872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48b0005180 msgr2=0x7f48c4150690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:14.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.792+0000 7f48cbf9f640 1 --2- 172.21.15.6:0/1720627872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48b0005180 0x7f48c4150690 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f48c000e4d0 tx=0x7f48c000e990 comp rx=0 tx=0).stop 2023-07-21T22:32:14.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.792+0000 7f48cbf9f640 1 -- 172.21.15.6:0/1720627872 shutdown_connections 2023-07-21T22:32:14.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.792+0000 7f48cbf9f640 1 --2- 172.21.15.6:0/1720627872 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f48a80663d0 0x7f48a8068880 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.792+0000 7f48cbf9f640 1 --2- 172.21.15.6:0/1720627872 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48c40b2510 0x7f48c40cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.792+0000 7f48cbf9f640 1 --2- 172.21.15.6:0/1720627872 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48c40b20a0 0x7f48c40cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.792+0000 7f48cbf9f640 1 --2- 172.21.15.6:0/1720627872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48b0005180 0x7f48c4150690 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.792+0000 7f48cbf9f640 1 -- 172.21.15.6:0/1720627872 >> 172.21.15.6:0/1720627872 conn(0x7f48c40afac0 msgr2=0x7f48c406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:14.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.792+0000 7f48cbf9f640 1 -- 172.21.15.6:0/1720627872 shutdown_connections 2023-07-21T22:32:14.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.792+0000 7f48cbf9f640 1 -- 172.21.15.6:0/1720627872 wait complete. 2023-07-21T22:32:14.864 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-21T22:32:15.011 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:14.968+0000 7fa3fcc46180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:32:15.015 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:14.968+0000 7f2782cd2180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:32:15.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.968+0000 7f06a4ecb640 1 Processor -- start 2023-07-21T22:32:15.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.968+0000 7f06a4ecb640 1 -- start start 2023-07-21T22:32:15.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.968+0000 7f06a4ecb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f06a015be30 0x7f06a00d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.968+0000 7f06a4ecb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06a0160030 0x7f06a00af730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.968+0000 7f06a4ecb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a00aefc0 con 0x7f06a00d0770 2023-07-21T22:32:15.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.968+0000 7f06a4ecb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a00af2a0 con 0x7f06a015be30 2023-07-21T22:32:15.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.968+0000 7f06a4ecb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a015c200 con 0x7f06a0160030 2023-07-21T22:32:15.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.972+0000 7f069e59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f06a015be30 0x7f06a00d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:15.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.972+0000 7f069e59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f06a015be30 0x7f06a00d0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:51728/0 (socket says 172.21.15.6:51728) 2023-07-21T22:32:15.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.972+0000 7f069ed9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06a0160030 0x7f06a00af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:15.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.972+0000 7f069e59c640 1 -- 172.21.15.6:0/3557830620 learned_addr learned my addr 172.21.15.6:0/3557830620 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:15.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.972+0000 7f069e59c640 1 -- 172.21.15.6:0/3557830620 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06a0160030 msgr2=0x7f06a00af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:15.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.972+0000 7f069e59c640 1 --2- 172.21.15.6:0/3557830620 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06a0160030 0x7f06a00af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.972+0000 7f069e59c640 1 -- 172.21.15.6:0/3557830620 >> v1:172.21.15.161:6789/0 conn(0x7f06a00d0770 legacy=0x7f06a015f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:15.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.972+0000 7f069e59c640 1 -- 172.21.15.6:0/3557830620 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a00d2aa0 con 0x7f06a015be30 2023-07-21T22:32:15.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.972+0000 7f069dd9b640 1 -- 172.21.15.6:0/3557830620 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151472606 0 0) 0x7f06a00aefc0 con 0x7f06a00d0770 2023-07-21T22:32:15.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.972+0000 7f069ed9d640 1 --2- 172.21.15.6:0/3557830620 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06a0160030 0x7f06a00af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:32:15.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.972+0000 7f069e59c640 1 --2- 172.21.15.6:0/3557830620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06a015be30 0x7f06a00d0230 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0690009870 tx=0x7f069001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7de59d9ee409b658 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:15.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.976+0000 7f069dd9b640 1 -- 172.21.15.6:0/3557830620 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06900aa670 con 0x7f06a015be30 2023-07-21T22:32:15.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.976+0000 7f069dd9b640 1 -- 172.21.15.6:0/3557830620 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06900aa7d0 con 0x7f06a015be30 2023-07-21T22:32:15.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.976+0000 7f069dd9b640 1 -- 172.21.15.6:0/3557830620 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06900aab60 con 0x7f06a015be30 2023-07-21T22:32:15.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.976+0000 7f06a4ecb640 1 -- 172.21.15.6:0/3557830620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06a015be30 msgr2=0x7f06a00d0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:15.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.976+0000 7f06a4ecb640 1 --2- 172.21.15.6:0/3557830620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06a015be30 0x7f06a00d0230 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0690009870 tx=0x7f069001c510 comp rx=0 tx=0).stop 2023-07-21T22:32:15.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.976+0000 7f06a4ecb640 1 -- 172.21.15.6:0/3557830620 shutdown_connections 2023-07-21T22:32:15.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.976+0000 7f06a4ecb640 1 --2- 172.21.15.6:0/3557830620 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06a0160030 0x7f06a00af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.976+0000 7f06a4ecb640 1 --2- 172.21.15.6:0/3557830620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06a015be30 0x7f06a00d0230 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.976+0000 7f06a4ecb640 1 -- 172.21.15.6:0/3557830620 >> 172.21.15.6:0/3557830620 conn(0x7f06a00659d0 msgr2=0x7f06a009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:15.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.976+0000 7f06a4ecb640 1 -- 172.21.15.6:0/3557830620 shutdown_connections 2023-07-21T22:32:15.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.976+0000 7f06a4ecb640 1 -- 172.21.15.6:0/3557830620 wait complete. 2023-07-21T22:32:15.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.976+0000 7f06a4ecb640 1 Processor -- start 2023-07-21T22:32:15.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.976+0000 7f06a4ecb640 1 -- start start 2023-07-21T22:32:15.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.976+0000 7f06a4ecb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06a00d0770 0x7f06a014e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.976+0000 7f06a4ecb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06a015be30 0x7f06a00b6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.976+0000 7f06a4ecb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06a0160030 0x7f06a00b7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.976+0000 7f06a4ecb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a0153ae0 con 0x7f06a015be30 2023-07-21T22:32:15.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.976+0000 7f06a4ecb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a00b6520 con 0x7f06a0160030 2023-07-21T22:32:15.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.976+0000 7f06a4ecb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a0152c10 con 0x7f06a00d0770 2023-07-21T22:32:15.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.980+0000 7f0697fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06a015be30 0x7f06a00b6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:15.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.980+0000 7f069e59c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06a00d0770 0x7f06a014e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:15.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.980+0000 7f069e59c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06a00d0770 0x7f06a014e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:34872/0 (socket says 172.21.15.6:34872) 2023-07-21T22:32:15.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.980+0000 7f069e59c640 1 -- 172.21.15.6:0/1827013961 learned_addr learned my addr 172.21.15.6:0/1827013961 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:15.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.980+0000 7f069ed9d640 1 --2- 172.21.15.6:0/1827013961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06a0160030 0x7f06a00b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:15.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.980+0000 7f0697fff640 1 -- 172.21.15.6:0/1827013961 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06a00d0770 msgr2=0x7f06a014e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:15.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.980+0000 7f0697fff640 1 --2- 172.21.15.6:0/1827013961 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06a00d0770 0x7f06a014e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.980+0000 7f0697fff640 1 -- 172.21.15.6:0/1827013961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06a0160030 msgr2=0x7f06a00b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:15.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.980+0000 7f0697fff640 1 --2- 172.21.15.6:0/1827013961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06a0160030 0x7f06a00b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.980+0000 7f0697fff640 1 -- 172.21.15.6:0/1827013961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0698009a70 con 0x7f06a015be30 2023-07-21T22:32:15.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.980+0000 7f0697fff640 1 --2- 172.21.15.6:0/1827013961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06a015be30 0x7f06a00b6c70 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f068800c440 tx=0x7f068800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:15.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.980+0000 7f0696ffd640 1 -- 172.21.15.6:0/1827013961 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06880054e0 con 0x7f06a015be30 2023-07-21T22:32:15.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.980+0000 7f0696ffd640 1 -- 172.21.15.6:0/1827013961 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0688003600 con 0x7f06a015be30 2023-07-21T22:32:15.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.980+0000 7f0696ffd640 1 -- 172.21.15.6:0/1827013961 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06880039b0 con 0x7f06a015be30 2023-07-21T22:32:15.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.980+0000 7f06a4ecb640 1 -- 172.21.15.6:0/1827013961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06900094d0 con 0x7f06a015be30 2023-07-21T22:32:15.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.980+0000 7f06a4ecb640 1 -- 172.21.15.6:0/1827013961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a0153140 con 0x7f06a015be30 2023-07-21T22:32:15.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.980+0000 7f06a4ecb640 1 -- 172.21.15.6:0/1827013961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a014ebd0 con 0x7f06a015be30 2023-07-21T22:32:15.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.980+0000 7f0696ffd640 1 -- 172.21.15.6:0/1827013961 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f0688003b10 con 0x7f06a015be30 2023-07-21T22:32:15.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.984+0000 7f0696ffd640 1 --2- 172.21.15.6:0/1827013961 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0680066420 0x7f06800688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.984+0000 7f0696ffd640 1 -- 172.21.15.6:0/1827013961 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f06880837c0 con 0x7f06a015be30 2023-07-21T22:32:15.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.984+0000 7f069e59c640 1 -- 172.21.15.6:0/1827013961 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0680066420 msgr2=0x7f06800688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3740183048 2023-07-21T22:32:15.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.984+0000 7f069e59c640 1 --2- 172.21.15.6:0/1827013961 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0680066420 0x7f06800688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:32:15.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:14.988+0000 7f0696ffd640 1 -- 172.21.15.6:0/1827013961 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0688050b90 con 0x7f06a015be30 2023-07-21T22:32:15.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.144+0000 7f06a4ecb640 1 -- 172.21.15.6:0/1827013961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f06a00678d0 con 0x7f06a015be30 2023-07-21T22:32:15.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.152+0000 7f0696ffd640 1 -- 172.21.15.6:0/1827013961 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v17)=0 v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f06880541b0 con 0x7f06a015be30 2023-07-21T22:32:15.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.152+0000 7f06a4ecb640 1 -- 172.21.15.6:0/1827013961 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0680066420 msgr2=0x7f06800688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:32:15.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.152+0000 7f06a4ecb640 1 --2- 172.21.15.6:0/1827013961 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0680066420 0x7f06800688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.152+0000 7f06a4ecb640 1 -- 172.21.15.6:0/1827013961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06a015be30 msgr2=0x7f06a00b6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:15.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.152+0000 7f06a4ecb640 1 --2- 172.21.15.6:0/1827013961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06a015be30 0x7f06a00b6c70 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f068800c440 tx=0x7f068800c840 comp rx=0 tx=0).stop 2023-07-21T22:32:15.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.152+0000 7f06a4ecb640 1 -- 172.21.15.6:0/1827013961 shutdown_connections 2023-07-21T22:32:15.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.152+0000 7f06a4ecb640 1 --2- 172.21.15.6:0/1827013961 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f0680066420 0x7f06800688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.152+0000 7f06a4ecb640 1 --2- 172.21.15.6:0/1827013961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06a0160030 0x7f06a00b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.152+0000 7f06a4ecb640 1 --2- 172.21.15.6:0/1827013961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06a015be30 0x7f06a00b6c70 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.152+0000 7f06a4ecb640 1 --2- 172.21.15.6:0/1827013961 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06a00d0770 0x7f06a014e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.152+0000 7f06a4ecb640 1 -- 172.21.15.6:0/1827013961 >> 172.21.15.6:0/1827013961 conn(0x7f06a00659d0 msgr2=0x7f06a0154dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:15.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.152+0000 7f06a4ecb640 1 -- 172.21.15.6:0/1827013961 shutdown_connections 2023-07-21T22:32:15.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.152+0000 7f06a4ecb640 1 -- 172.21.15.6:0/1827013961 wait complete. 2023-07-21T22:32:15.222 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-21T22:32:15.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.320+0000 7f9a16218640 1 Processor -- start 2023-07-21T22:32:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.320+0000 7f9a16218640 1 -- start start 2023-07-21T22:32:15.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a16218640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9a1015bde0 0x7f9a100d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a16218640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a100d2fc0 0x7f9a100b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a16218640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a100b04c0 con 0x7f9a100d2300 2023-07-21T22:32:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a16218640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1015c1b0 con 0x7f9a1015bde0 2023-07-21T22:32:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a16218640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100d0aa0 con 0x7f9a100d2fc0 2023-07-21T22:32:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9a100d2300 0x7f9a100cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52570/0 (socket says 172.21.15.6:52570) 2023-07-21T22:32:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0ffff640 1 -- 172.21.15.6:0/3739255935 learned_addr learned my addr 172.21.15.6:0/3739255935 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:32:15.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0f7fe640 1 --2- 172.21.15.6:0/3739255935 >> v2:172.21.15.161:3300/0 conn(0x7f9a1015bde0 0x7f9a100d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:15.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0effd640 1 --2- 172.21.15.6:0/3739255935 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a100d2fc0 0x7f9a100b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:15.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0e7fc640 1 -- 172.21.15.6:0/3739255935 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386767211 0 0) 0x7f9a100b04c0 con 0x7f9a100d2300 2023-07-21T22:32:15.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0e7fc640 1 -- 172.21.15.6:0/3739255935 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f8003530 con 0x7f9a100d2300 2023-07-21T22:32:15.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0e7fc640 1 -- 172.21.15.6:0/3739255935 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2151130842 0 0) 0x7f99f8003530 con 0x7f9a100d2300 2023-07-21T22:32:15.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0e7fc640 1 -- 172.21.15.6:0/3739255935 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a100d2fc0 msgr2=0x7f9a100b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:15.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0e7fc640 1 --2- 172.21.15.6:0/3739255935 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a100d2fc0 0x7f9a100b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0e7fc640 1 -- 172.21.15.6:0/3739255935 >> v2:172.21.15.161:3300/0 conn(0x7f9a1015bde0 msgr2=0x7f9a100d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:15.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0e7fc640 1 --2- 172.21.15.6:0/3739255935 >> v2:172.21.15.161:3300/0 conn(0x7f9a1015bde0 0x7f9a100d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0e7fc640 1 -- 172.21.15.6:0/3739255935 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a100afb90 con 0x7f9a100d2300 2023-07-21T22:32:15.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0e7fc640 1 -- 172.21.15.6:0/3739255935 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f9a08001a00 con 0x7f9a100d2300 2023-07-21T22:32:15.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0e7fc640 1 -- 172.21.15.6:0/3739255935 >> v1:172.21.15.6:6789/0 conn(0x7f9a100d2300 legacy=0x7f9a100cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0e7fc640 1 --2- 172.21.15.6:0/3739255935 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a100d2fc0 0x7f99f8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0e7fc640 1 --2- 172.21.15.6:0/3739255935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f8003f00 0x7f99f80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0e7fc640 1 --2- 172.21.15.6:0/3739255935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99f8004d10 0x7f99f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0e7fc640 1 -- 172.21.15.6:0/3739255935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1015c1b0 con 0x7f99f8003f00 2023-07-21T22:32:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0e7fc640 1 -- 172.21.15.6:0/3739255935 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100d0aa0 con 0x7f99f8004d10 2023-07-21T22:32:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0e7fc640 1 -- 172.21.15.6:0/3739255935 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f800b990 con 0x7f9a100d2fc0 2023-07-21T22:32:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0f7fe640 1 --2- 172.21.15.6:0/3739255935 >> v2:172.21.15.161:3300/0 conn(0x7f9a1015bde0 0x7f9a100d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:32:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0effd640 1 --2- 172.21.15.6:0/3739255935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f8003f00 0x7f99f80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0ffff640 1 --2- 172.21.15.6:0/3739255935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99f8004d10 0x7f99f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0f7fe640 1 --2- 172.21.15.6:0/3739255935 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a100d2fc0 0x7f99f8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0effd640 1 -- 172.21.15.6:0/3739255935 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a100d2fc0 msgr2=0x7f99f8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0effd640 1 --2- 172.21.15.6:0/3739255935 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a100d2fc0 0x7f99f8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0effd640 1 -- 172.21.15.6:0/3739255935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99f8004d10 msgr2=0x7f99f8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0effd640 1 --2- 172.21.15.6:0/3739255935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99f8004d10 0x7f99f8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.324+0000 7f9a0effd640 1 -- 172.21.15.6:0/3739255935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f8003530 con 0x7f99f8003f00 2023-07-21T22:32:15.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.328+0000 7f9a0effd640 1 --2- 172.21.15.6:0/3739255935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f8003f00 0x7f99f80047d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009ae0 tx=0x7f9a0401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225b338699bb5eeb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:15.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.332+0000 7f9a0e7fc640 1 -- 172.21.15.6:0/3739255935 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a040a5530 con 0x7f99f8003f00 2023-07-21T22:32:15.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.332+0000 7f9a0e7fc640 1 -- 172.21.15.6:0/3739255935 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a040a5690 con 0x7f99f8003f00 2023-07-21T22:32:15.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.332+0000 7f9a0e7fc640 1 -- 172.21.15.6:0/3739255935 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a040a5a40 con 0x7f99f8003f00 2023-07-21T22:32:15.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.332+0000 7f9a16218640 1 -- 172.21.15.6:0/3739255935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f8003f00 msgr2=0x7f99f80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:15.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.332+0000 7f9a16218640 1 --2- 172.21.15.6:0/3739255935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99f8003f00 0x7f99f80047d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009ae0 tx=0x7f9a0401ca50 comp rx=0 tx=0).stop 2023-07-21T22:32:15.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.332+0000 7f9a0ffff640 1 -- 172.21.15.6:0/3739255935 reap_dead start 2023-07-21T22:32:15.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.332+0000 7f9a16218640 1 -- 172.21.15.6:0/3739255935 shutdown_connections 2023-07-21T22:32:15.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.332+0000 7f9a16218640 1 -- 172.21.15.6:0/3739255935 >> 172.21.15.6:0/3739255935 conn(0x7f9a100659d0 msgr2=0x7f9a1009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:15.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.332+0000 7f9a16218640 1 -- 172.21.15.6:0/3739255935 shutdown_connections 2023-07-21T22:32:15.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.332+0000 7f9a16218640 1 -- 172.21.15.6:0/3739255935 wait complete. 2023-07-21T22:32:15.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.332+0000 7f9a16218640 1 Processor -- start 2023-07-21T22:32:15.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.332+0000 7f9a16218640 1 -- start start 2023-07-21T22:32:15.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.332+0000 7f9a16218640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99f8003f00 0x7f9a100c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.332+0000 7f9a16218640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a100c7000 0x7f9a100c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.332+0000 7f9a16218640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a100b0850 0x7f9a100b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.332+0000 7f9a16218640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100c5ce0 con 0x7f9a100c7000 2023-07-21T22:32:15.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.332+0000 7f9a16218640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100b1200 con 0x7f9a100b0850 2023-07-21T22:32:15.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.332+0000 7f9a16218640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100c8c20 con 0x7f99f8003f00 2023-07-21T22:32:15.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.336+0000 7f9a0effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a100c7000 0x7f9a100c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:15.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.336+0000 7f9a0effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a100c7000 0x7f9a100c7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59984/0 (socket says 172.21.15.6:59984) 2023-07-21T22:32:15.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.336+0000 7f9a0effd640 1 -- 172.21.15.6:0/4202390810 learned_addr learned my addr 172.21.15.6:0/4202390810 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:15.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.336+0000 7f9a0ffff640 1 --2- 172.21.15.6:0/4202390810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a100b0850 0x7f9a100b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:15.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.336+0000 7f9a0f7fe640 1 --2- 172.21.15.6:0/4202390810 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99f8003f00 0x7f9a100c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:15.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.336+0000 7f9a0effd640 1 -- 172.21.15.6:0/4202390810 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99f8003f00 msgr2=0x7f9a100c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:15.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.336+0000 7f9a0effd640 1 --2- 172.21.15.6:0/4202390810 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99f8003f00 0x7f9a100c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.336+0000 7f9a0effd640 1 -- 172.21.15.6:0/4202390810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a100b0850 msgr2=0x7f9a100b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:15.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.336+0000 7f9a0effd640 1 --2- 172.21.15.6:0/4202390810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a100b0850 0x7f9a100b0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.336+0000 7f9a0effd640 1 -- 172.21.15.6:0/4202390810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a100c7b80 con 0x7f9a100c7000 2023-07-21T22:32:15.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.336+0000 7f9a0effd640 1 --2- 172.21.15.6:0/4202390810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a100c7000 0x7f9a100c7470 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9a0401c880 tx=0x7f99f8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:15.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.336+0000 7f99f7fff640 1 -- 172.21.15.6:0/4202390810 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a040bc070 con 0x7f9a100c7000 2023-07-21T22:32:15.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.336+0000 7f99f7fff640 1 -- 172.21.15.6:0/4202390810 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a04004020 con 0x7f9a100c7000 2023-07-21T22:32:15.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.336+0000 7f99f7fff640 1 -- 172.21.15.6:0/4202390810 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04004390 con 0x7f9a100c7000 2023-07-21T22:32:15.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.336+0000 7f9a16218640 1 -- 172.21.15.6:0/4202390810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a100c7e60 con 0x7f9a100c7000 2023-07-21T22:32:15.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.336+0000 7f9a16218640 1 -- 172.21.15.6:0/4202390810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a100c8420 con 0x7f9a100c7000 2023-07-21T22:32:15.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.336+0000 7f9a16218640 1 -- 172.21.15.6:0/4202390810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a100678d0 con 0x7f9a100c7000 2023-07-21T22:32:15.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.336+0000 7f99f7fff640 1 -- 172.21.15.6:0/4202390810 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f9a040b4040 con 0x7f9a100c7000 2023-07-21T22:32:15.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.340+0000 7f99f7fff640 1 --2- 172.21.15.6:0/4202390810 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f99fc0663f0 0x7f99fc0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.340+0000 7f99f7fff640 1 -- 172.21.15.6:0/4202390810 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f9a0411d8e0 con 0x7f9a100c7000 2023-07-21T22:32:15.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.340+0000 7f9a0f7fe640 1 -- 172.21.15.6:0/4202390810 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f99fc0663f0 msgr2=0x7f99fc0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3740183048 2023-07-21T22:32:15.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.340+0000 7f9a0f7fe640 1 --2- 172.21.15.6:0/4202390810 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f99fc0663f0 0x7f99fc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:32:15.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.348+0000 7f99f7fff640 1 -- 172.21.15.6:0/4202390810 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a040eacc0 con 0x7f9a100c7000 2023-07-21T22:32:15.431 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:15.384+0000 7fa3fcc46180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:32:15.470 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:15.420+0000 7f2782cd2180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:32:15.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.504+0000 7f9a16218640 1 -- 172.21.15.6:0/4202390810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f9a1008b000 con 0x7f9a100c7000 2023-07-21T22:32:15.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.512+0000 7f99f7fff640 1 -- 172.21.15.6:0/4202390810 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v18)=0 v18) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9a040ee2e0 con 0x7f9a100c7000 2023-07-21T22:32:15.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.516+0000 7f9a16218640 1 -- 172.21.15.6:0/4202390810 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f99fc0663f0 msgr2=0x7f99fc0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:32:15.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.516+0000 7f9a16218640 1 --2- 172.21.15.6:0/4202390810 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f99fc0663f0 0x7f99fc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.516+0000 7f9a16218640 1 -- 172.21.15.6:0/4202390810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a100c7000 msgr2=0x7f9a100c7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:15.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.516+0000 7f9a16218640 1 --2- 172.21.15.6:0/4202390810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a100c7000 0x7f9a100c7470 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f9a0401c880 tx=0x7f99f8005800 comp rx=0 tx=0).stop 2023-07-21T22:32:15.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.516+0000 7f9a16218640 1 -- 172.21.15.6:0/4202390810 shutdown_connections 2023-07-21T22:32:15.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.516+0000 7f9a16218640 1 --2- 172.21.15.6:0/4202390810 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7f99fc0663f0 0x7f99fc0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.516+0000 7f9a16218640 1 --2- 172.21.15.6:0/4202390810 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a100b0850 0x7f9a100b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.516+0000 7f9a16218640 1 --2- 172.21.15.6:0/4202390810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a100c7000 0x7f9a100c7470 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.516+0000 7f9a16218640 1 --2- 172.21.15.6:0/4202390810 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99f8003f00 0x7f9a100c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.516+0000 7f9a16218640 1 -- 172.21.15.6:0/4202390810 >> 172.21.15.6:0/4202390810 conn(0x7f9a100659d0 msgr2=0x7f9a100b54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:15.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.516+0000 7f9a16218640 1 -- 172.21.15.6:0/4202390810 shutdown_connections 2023-07-21T22:32:15.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.516+0000 7f9a16218640 1 -- 172.21.15.6:0/4202390810 wait complete. 2023-07-21T22:32:15.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:15.583 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-21T22:32:15.585 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:15.540+0000 7fa3fcc46180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:32:15.599 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-07-21T22:32:15.634 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:15.584+0000 7f2782cd2180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:32:15.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.736+0000 7efd7dad8640 1 Processor -- start 2023-07-21T22:32:15.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.736+0000 7efd7dad8640 1 -- start start 2023-07-21T22:32:15.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.736+0000 7efd7dad8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efd7815bde0 0x7efd780d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.736+0000 7efd7dad8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efd780d2fc0 0x7efd780b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.736+0000 7efd7dad8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efd780d2300 0x7efd780d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.736+0000 7efd7dad8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7815c1b0 con 0x7efd7815bde0 2023-07-21T22:32:15.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.736+0000 7efd7dad8640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd780d2cc0 con 0x7efd780d2fc0 2023-07-21T22:32:15.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.736+0000 7efd7dad8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd780b04c0 con 0x7efd780d2300 2023-07-21T22:32:15.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.736+0000 7efd777fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efd7815bde0 0x7efd780d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:15.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.736+0000 7efd777fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efd7815bde0 0x7efd780d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59988/0 (socket says 172.21.15.6:59988) 2023-07-21T22:32:15.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.736+0000 7efd777fe640 1 -- 172.21.15.6:0/3964741057 learned_addr learned my addr 172.21.15.6:0/3964741057 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:15.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.736+0000 7efd77fff640 1 --2- 172.21.15.6:0/3964741057 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efd780d2300 0x7efd780d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:15.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.736+0000 7efd76ffd640 1 --2- 172.21.15.6:0/3964741057 >> v2:172.21.15.161:3300/0 conn(0x7efd780d2fc0 0x7efd780b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:15.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.736+0000 7efd777fe640 1 -- 172.21.15.6:0/3964741057 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efd780d2300 msgr2=0x7efd780d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:15.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.736+0000 7efd777fe640 1 --2- 172.21.15.6:0/3964741057 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efd780d2300 0x7efd780d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.736+0000 7efd777fe640 1 -- 172.21.15.6:0/3964741057 >> v2:172.21.15.161:3300/0 conn(0x7efd780d2fc0 msgr2=0x7efd780b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:15.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.736+0000 7efd777fe640 1 --2- 172.21.15.6:0/3964741057 >> v2:172.21.15.161:3300/0 conn(0x7efd780d2fc0 0x7efd780b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.736+0000 7efd777fe640 1 -- 172.21.15.6:0/3964741057 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd780d0aa0 con 0x7efd7815bde0 2023-07-21T22:32:15.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.736+0000 7efd77fff640 1 --2- 172.21.15.6:0/3964741057 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efd780d2300 0x7efd780d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:15.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.736+0000 7efd76ffd640 1 --2- 172.21.15.6:0/3964741057 >> v2:172.21.15.161:3300/0 conn(0x7efd780d2fc0 0x7efd780b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:15.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.740+0000 7efd777fe640 1 --2- 172.21.15.6:0/3964741057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd7815bde0 0x7efd780d0270 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7efd7808c600 tx=0x7efd6801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e04460fbd188c32 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:15.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.740+0000 7efd767fc640 1 -- 172.21.15.6:0/3964741057 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd680aa620 con 0x7efd7815bde0 2023-07-21T22:32:15.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.740+0000 7efd767fc640 1 -- 172.21.15.6:0/3964741057 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd680aa780 con 0x7efd7815bde0 2023-07-21T22:32:15.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.740+0000 7efd767fc640 1 -- 172.21.15.6:0/3964741057 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd680aab10 con 0x7efd7815bde0 2023-07-21T22:32:15.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.740+0000 7efd7dad8640 1 -- 172.21.15.6:0/3964741057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd7815bde0 msgr2=0x7efd780d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:15.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.740+0000 7efd7dad8640 1 --2- 172.21.15.6:0/3964741057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd7815bde0 0x7efd780d0270 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7efd7808c600 tx=0x7efd6801c500 comp rx=0 tx=0).stop 2023-07-21T22:32:15.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.740+0000 7efd7dad8640 1 -- 172.21.15.6:0/3964741057 shutdown_connections 2023-07-21T22:32:15.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.740+0000 7efd7dad8640 1 --2- 172.21.15.6:0/3964741057 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efd780d2300 0x7efd780d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.740+0000 7efd7dad8640 1 --2- 172.21.15.6:0/3964741057 >> v2:172.21.15.161:3300/0 conn(0x7efd780d2fc0 0x7efd780b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.740+0000 7efd7dad8640 1 --2- 172.21.15.6:0/3964741057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd7815bde0 0x7efd780d0270 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.740+0000 7efd7dad8640 1 -- 172.21.15.6:0/3964741057 >> 172.21.15.6:0/3964741057 conn(0x7efd780659d0 msgr2=0x7efd7809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:15.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.740+0000 7efd7dad8640 1 -- 172.21.15.6:0/3964741057 shutdown_connections 2023-07-21T22:32:15.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.740+0000 7efd7dad8640 1 -- 172.21.15.6:0/3964741057 wait complete. 2023-07-21T22:32:15.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd7dad8640 1 Processor -- start 2023-07-21T22:32:15.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd7dad8640 1 -- start start 2023-07-21T22:32:15.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd7dad8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efd780d2300 0x7efd780c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd7dad8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd780d2fc0 0x7efd780cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd7dad8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd7815bde0 0x7efd780b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd7dad8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd780b61f0 con 0x7efd780d2fc0 2023-07-21T22:32:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd7dad8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd780b6a00 con 0x7efd7815bde0 2023-07-21T22:32:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd7dad8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd780b6440 con 0x7efd780d2300 2023-07-21T22:32:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd76ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd780d2fc0 0x7efd780cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd76ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd780d2fc0 0x7efd780cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60000/0 (socket says 172.21.15.6:60000) 2023-07-21T22:32:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd76ffd640 1 -- 172.21.15.6:0/283584092 learned_addr learned my addr 172.21.15.6:0/283584092 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd777fe640 1 --2- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efd780d2300 0x7efd780c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd77fff640 1 --2- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd7815bde0 0x7efd780b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd76ffd640 1 -- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efd780d2300 msgr2=0x7efd780c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd76ffd640 1 --2- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efd780d2300 0x7efd780c6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd76ffd640 1 -- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd7815bde0 msgr2=0x7efd780b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:15.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd76ffd640 1 --2- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd7815bde0 0x7efd780b6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:15.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd76ffd640 1 -- 172.21.15.6:0/283584092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd68009480 con 0x7efd780d2fc0 2023-07-21T22:32:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd76ffd640 1 --2- 172.21.15.6:0/283584092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd780d2fc0 0x7efd780cdc40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7efd6c00d800 tx=0x7efd6c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd5ffff640 1 -- 172.21.15.6:0/283584092 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c0096a0 con 0x7efd780d2fc0 2023-07-21T22:32:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd5ffff640 1 -- 172.21.15.6:0/283584092 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c009800 con 0x7efd780d2fc0 2023-07-21T22:32:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd5ffff640 1 -- 172.21.15.6:0/283584092 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c009bb0 con 0x7efd780d2fc0 2023-07-21T22:32:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd7dad8640 1 -- 172.21.15.6:0/283584092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd780b6720 con 0x7efd780d2fc0 2023-07-21T22:32:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.744+0000 7efd7dad8640 1 -- 172.21.15.6:0/283584092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd780b2000 con 0x7efd780d2fc0 2023-07-21T22:32:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.748+0000 7efd7dad8640 1 -- 172.21.15.6:0/283584092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd780b21c0 con 0x7efd780d2fc0 2023-07-21T22:32:15.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.748+0000 7efd5ffff640 1 -- 172.21.15.6:0/283584092 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 85777+0+0 (secure 0 0 0) 0x7efd6c009d10 con 0x7efd780d2fc0 2023-07-21T22:32:15.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.748+0000 7efd5ffff640 1 --2- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7efd640663f0 0x7efd640688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:15.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.748+0000 7efd5ffff640 1 -- 172.21.15.6:0/283584092 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6106+0+0 (secure 0 0 0) 0x7efd6c084320 con 0x7efd780d2fc0 2023-07-21T22:32:15.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.748+0000 7efd777fe640 1 -- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7efd640663f0 msgr2=0x7efd640688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3740183048 2023-07-21T22:32:15.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.748+0000 7efd777fe640 1 --2- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7efd640663f0 0x7efd640688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:32:15.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.760+0000 7efd5ffff640 1 -- 172.21.15.6:0/283584092 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efd6c055190 con 0x7efd780d2fc0 2023-07-21T22:32:15.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.932+0000 7efd7dad8640 1 -- 172.21.15.6:0/283584092 --> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7efd780b1ba0 con 0x7efd640663f0 2023-07-21T22:32:15.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.952+0000 7efd777fe640 1 -- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7efd640663f0 msgr2=0x7efd640688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3740183048 2023-07-21T22:32:15.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:15.952+0000 7efd777fe640 1 --2- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7efd640663f0 0x7efd640688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:32:16.067 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:16.020+0000 7fa3fcc46180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:32:16.127 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:16.080+0000 7fa3fcc46180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:32:16.152 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:16.104+0000 7f2782cd2180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:32:16.183 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:16.136+0000 7fa3fcc46180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:32:16.213 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:16.164+0000 7f2782cd2180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:32:16.268 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:16.224+0000 7fa3fcc46180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:32:16.272 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:16.224+0000 7f2782cd2180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:32:16.326 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:16.280+0000 7fa3fcc46180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:32:16.363 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:16.316+0000 7f2782cd2180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:32:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:16.356+0000 7efd777fe640 1 -- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7efd640663f0 msgr2=0x7efd640688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3740183048 2023-07-21T22:32:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:16.356+0000 7efd777fe640 1 --2- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7efd640663f0 0x7efd640688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-21T22:32:16.410 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:16.364+0000 7fa3fcc46180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:32:16.422 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:16.372+0000 7f2782cd2180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:32:16.466 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:16.420+0000 7fa3fcc46180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:32:16.510 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:16.460+0000 7f2782cd2180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:32:16.569 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:16.520+0000 7f2782cd2180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:32:16.608 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:16.564+0000 7fa3fcc46180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:32:16.665 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:16.620+0000 7fa3fcc46180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:32:16.718 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:16.668+0000 7f2782cd2180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:32:16.780 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:16.732+0000 7f2782cd2180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:32:16.905 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:32:16.906 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:32:16.906 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:32:16.914 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:16.868+0000 7fa3fcc46180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:32:17.031 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:32:17.031 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:32:17.032 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:32:17.040 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:16.992+0000 7f2782cd2180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:32:17.049 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:17.004+0000 7fa3fcc46180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:32:17.176 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:17.132+0000 7fa3fcc46180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:32:17.181 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:17.132+0000 7f2782cd2180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:32:17.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:17.160+0000 7efd777fe640 1 -- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7efd640663f0 msgr2=0x7efd640688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3740183048 2023-07-21T22:32:17.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:17.160+0000 7efd777fe640 1 --2- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7efd640663f0 0x7efd640688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-21T22:32:17.246 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:17.200+0000 7fa3fcc46180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:32:17.313 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:17.264+0000 7f2782cd2180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:32:17.379 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:17.336+0000 7fa3fcc46180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:32:17.386 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:17.336+0000 7f2782cd2180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:32:17.527 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:17.480+0000 7f2782cd2180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:32:17.920 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:17.876+0000 7fa3fcc46180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:32:18.008 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:17.964+0000 7fa3fcc46180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:32:18.098 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:18.048+0000 7f2782cd2180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:32:18.157 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:18.112+0000 7fa3fcc46180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:32:18.186 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:18.140+0000 7f2782cd2180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:32:18.241 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:18.196+0000 7fa3fcc46180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:32:18.341 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:18.292+0000 7f2782cd2180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:32:18.429 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:18.380+0000 7f2782cd2180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:32:18.513 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:18.468+0000 7fa3fcc46180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:32:18.573 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:18.528+0000 7fa3fcc46180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:32:18.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:18.536+0000 7efd5ffff640 1 -- 172.21.15.6:0/283584092 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 18) v1 ==== 85386+0+0 (secure 0 0 0) 0x7efd6c051ad0 con 0x7efd780d2fc0 2023-07-21T22:32:18.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:18.540+0000 7efd5ffff640 1 -- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7efd640663f0 msgr2=0x7efd640688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:32:18.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:18.540+0000 7efd5ffff640 1 --2- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:6832/3740183048,v1:172.21.15.161:6833/3740183048] conn(0x7efd640663f0 0x7efd640688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:18.713 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:18.668+0000 7fa37b0fa640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:32:18.714 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:18.668+0000 7fa37b0fa640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:32:18.714 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:18.668+0000 7fa37b0fa640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:32:18.714 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:18.668+0000 7fa37b0fa640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:32:18.714 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:18.668+0000 7fa37b0fa640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:32:18.715 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:18.668+0000 7fa37e100640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:32:18.715 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:18.668+0000 7fa37e100640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:32:18.715 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:18.668+0000 7fa37e100640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:32:18.715 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:18.668+0000 7fa37e100640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:32:18.715 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:32:18.668+0000 7fa37e100640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:32:18.734 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:18.684+0000 7f2782cd2180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:32:18.798 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:32:18.748+0000 7f2782cd2180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:32:19.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.544+0000 7efd5ffff640 1 -- 172.21.15.6:0/283584092 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mgrmap(e 19) v1 ==== 85513+0+0 (secure 0 0 0) 0x7efd6c082610 con 0x7efd780d2fc0 2023-07-21T22:32:19.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.544+0000 7efd5ffff640 1 --2- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7efd64034090 0x7efd64070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:19.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.544+0000 7efd5ffff640 1 -- 172.21.15.6:0/283584092 --> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7efd64070e90 con 0x7efd64034090 2023-07-21T22:32:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.548+0000 7efd777fe640 1 --2- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7efd64034090 0x7efd64070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:19.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.552+0000 7efd777fe640 1 --2- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7efd64034090 0x7efd64070950 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efd680ae000 tx=0x7efd680a7000 comp rx=0 tx=0).ready entity=mgr.5684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:19.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.608+0000 7efd5ffff640 1 -- 172.21.15.6:0/283584092 <== mgr.5684 v2:172.21.15.161:6832/582015960 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7efd64070e90 con 0x7efd64034090 2023-07-21T22:32:19.659 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule set for path snap_test_dir1 2023-07-21T22:32:19.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.612+0000 7efd7dad8640 1 -- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7efd64034090 msgr2=0x7efd64070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:19.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.612+0000 7efd7dad8640 1 --2- 172.21.15.6:0/283584092 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7efd64034090 0x7efd64070950 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efd680ae000 tx=0x7efd680a7000 comp rx=0 tx=0).stop 2023-07-21T22:32:19.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.612+0000 7efd7dad8640 1 -- 172.21.15.6:0/283584092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd780d2fc0 msgr2=0x7efd780cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:19.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.612+0000 7efd7dad8640 1 --2- 172.21.15.6:0/283584092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd780d2fc0 0x7efd780cdc40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7efd6c00d800 tx=0x7efd6c00dcc0 comp rx=0 tx=0).stop 2023-07-21T22:32:19.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.612+0000 7efd77fff640 1 -- 172.21.15.6:0/283584092 reap_dead start 2023-07-21T22:32:19.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.612+0000 7efd7dad8640 1 -- 172.21.15.6:0/283584092 shutdown_connections 2023-07-21T22:32:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.612+0000 7efd7dad8640 1 -- 172.21.15.6:0/283584092 >> 172.21.15.6:0/283584092 conn(0x7efd780659d0 msgr2=0x7efd781523c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.612+0000 7efd7dad8640 1 -- 172.21.15.6:0/283584092 shutdown_connections 2023-07-21T22:32:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.612+0000 7efd7dad8640 1 -- 172.21.15.6:0/283584092 wait complete. 2023-07-21T22:32:19.682 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-21T22:32:19.683 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 2M 2023-07-21T22:32:19.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.784+0000 7ff63ceca640 1 Processor -- start 2023-07-21T22:32:19.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.784+0000 7ff63ceca640 1 -- start start 2023-07-21T22:32:19.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.788+0000 7ff63ceca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6380aeb40 0x7ff63815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:19.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.788+0000 7ff63ceca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6381532b0 con 0x7ff638159440 2023-07-21T22:32:19.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.788+0000 7ff63ceca640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6380ca6f0 con 0x7ff6380aef10 2023-07-21T22:32:19.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.788+0000 7ff63ceca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6381599d0 con 0x7ff6380aeb40 2023-07-21T22:32:19.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.788+0000 7ff636d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff638159440 0x7ff6380c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49276/0 (socket says 172.21.15.6:49276) 2023-07-21T22:32:19.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.788+0000 7ff636d9d640 1 -- 172.21.15.6:0/86575321 learned_addr learned my addr 172.21.15.6:0/86575321 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:32:19.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.788+0000 7ff63659c640 1 --2- 172.21.15.6:0/86575321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6380aeb40 0x7ff63815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:19.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.788+0000 7ff635d9b640 1 -- 172.21.15.6:0/86575321 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272765419 0 0) 0x7ff6381532b0 con 0x7ff638159440 2023-07-21T22:32:19.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.788+0000 7ff635d9b640 1 -- 172.21.15.6:0/86575321 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff624003530 con 0x7ff638159440 2023-07-21T22:32:19.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.788+0000 7ff635d9b640 1 -- 172.21.15.6:0/86575321 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832976749 0 0) 0x7ff6380ca6f0 con 0x7ff6380aef10 2023-07-21T22:32:19.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.788+0000 7ff635d9b640 1 -- 172.21.15.6:0/86575321 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6381532b0 con 0x7ff6380aef10 2023-07-21T22:32:19.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.788+0000 7ff63659c640 1 -- 172.21.15.6:0/86575321 >> v1:172.21.15.161:6789/0 conn(0x7ff6380aef10 legacy=0x7ff638158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:19.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.788+0000 7ff63659c640 1 -- 172.21.15.6:0/86575321 >> v1:172.21.15.6:6789/0 conn(0x7ff638159440 legacy=0x7ff6380c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:19.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.788+0000 7ff63659c640 1 -- 172.21.15.6:0/86575321 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff638159cb0 con 0x7ff6380aeb40 2023-07-21T22:32:19.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.792+0000 7ff63659c640 1 --2- 172.21.15.6:0/86575321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6380aeb40 0x7ff63815cef0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff6280097f0 tx=0x7ff62801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2973ff94d7518c3e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:19.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.792+0000 7ff635d9b640 1 -- 172.21.15.6:0/86575321 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6280ab600 con 0x7ff6380aeb40 2023-07-21T22:32:19.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.792+0000 7ff635d9b640 1 -- 172.21.15.6:0/86575321 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6280ab760 con 0x7ff6380aeb40 2023-07-21T22:32:19.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.792+0000 7ff635d9b640 1 -- 172.21.15.6:0/86575321 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6280abaf0 con 0x7ff6380aeb40 2023-07-21T22:32:19.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.792+0000 7ff63ceca640 1 -- 172.21.15.6:0/86575321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6380aeb40 msgr2=0x7ff63815cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:19.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.792+0000 7ff63ceca640 1 --2- 172.21.15.6:0/86575321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6380aeb40 0x7ff63815cef0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff6280097f0 tx=0x7ff62801c400 comp rx=0 tx=0).stop 2023-07-21T22:32:19.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.792+0000 7ff63ceca640 1 -- 172.21.15.6:0/86575321 shutdown_connections 2023-07-21T22:32:19.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.792+0000 7ff63ceca640 1 --2- 172.21.15.6:0/86575321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6380aeb40 0x7ff63815cef0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:19.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.792+0000 7ff63ceca640 1 -- 172.21.15.6:0/86575321 >> 172.21.15.6:0/86575321 conn(0x7ff6380cde90 msgr2=0x7ff6380ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:19.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.792+0000 7ff63ceca640 1 -- 172.21.15.6:0/86575321 shutdown_connections 2023-07-21T22:32:19.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.792+0000 7ff63ceca640 1 -- 172.21.15.6:0/86575321 wait complete. 2023-07-21T22:32:19.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.792+0000 7ff63ceca640 1 Processor -- start 2023-07-21T22:32:19.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.792+0000 7ff63ceca640 1 -- start start 2023-07-21T22:32:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff63ceca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6380aeb40 0x7ff638147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:19.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff63ceca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6380aef10 0x7ff638157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:19.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff63ceca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff638159440 0x7ff638156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:19.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff63ceca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6381475a0 con 0x7ff6380aeb40 2023-07-21T22:32:19.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff63ceca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63815ae70 con 0x7ff638159440 2023-07-21T22:32:19.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff63ceca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63815b150 con 0x7ff6380aef10 2023-07-21T22:32:19.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff63659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6380aeb40 0x7ff638147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:19.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff63659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6380aeb40 0x7ff638147060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48916/0 (socket says 172.21.15.6:48916) 2023-07-21T22:32:19.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff63659c640 1 -- 172.21.15.6:0/1160321535 learned_addr learned my addr 172.21.15.6:0/1160321535 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:19.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff636d9d640 1 --2- 172.21.15.6:0/1160321535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff638159440 0x7ff638156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:19.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff62ffff640 1 --2- 172.21.15.6:0/1160321535 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6380aef10 0x7ff638157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:19.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff63659c640 1 -- 172.21.15.6:0/1160321535 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6380aef10 msgr2=0x7ff638157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:19.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff63659c640 1 --2- 172.21.15.6:0/1160321535 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6380aef10 0x7ff638157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:19.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff63659c640 1 -- 172.21.15.6:0/1160321535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff638159440 msgr2=0x7ff638156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:19.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff63659c640 1 --2- 172.21.15.6:0/1160321535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff638159440 0x7ff638156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:19.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff63659c640 1 -- 172.21.15.6:0/1160321535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff628009420 con 0x7ff6380aeb40 2023-07-21T22:32:19.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff636d9d640 1 --2- 172.21.15.6:0/1160321535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff638159440 0x7ff638156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:32:19.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff62ffff640 1 --2- 172.21.15.6:0/1160321535 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6380aef10 0x7ff638157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:32:19.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff63659c640 1 --2- 172.21.15.6:0/1160321535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6380aeb40 0x7ff638147060 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff6280ad040 tx=0x7ff62801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:19.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff62effd640 1 -- 172.21.15.6:0/1160321535 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6280bf610 con 0x7ff6380aeb40 2023-07-21T22:32:19.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff62effd640 1 -- 172.21.15.6:0/1160321535 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6280bf7b0 con 0x7ff6380aeb40 2023-07-21T22:32:19.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff63ceca640 1 -- 172.21.15.6:0/1160321535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63815b430 con 0x7ff6380aeb40 2023-07-21T22:32:19.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff62effd640 1 -- 172.21.15.6:0/1160321535 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6280bfb60 con 0x7ff6380aeb40 2023-07-21T22:32:19.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff63ceca640 1 -- 172.21.15.6:0/1160321535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63806bb30 con 0x7ff6380aeb40 2023-07-21T22:32:19.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff63ceca640 1 -- 172.21.15.6:0/1160321535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63806b990 con 0x7ff6380aeb40 2023-07-21T22:32:19.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.796+0000 7ff62effd640 1 -- 172.21.15.6:0/1160321535 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 19) v1 ==== 85513+0+0 (secure 0 0 0) 0x7ff6280b5400 con 0x7ff6380aeb40 2023-07-21T22:32:19.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.800+0000 7ff62effd640 1 --2- 172.21.15.6:0/1160321535 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7ff618066120 0x7ff6180685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:19.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.800+0000 7ff62effd640 1 -- 172.21.15.6:0/1160321535 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6450+0+0 (secure 0 0 0) 0x7ff62811e430 con 0x7ff6380aeb40 2023-07-21T22:32:19.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.800+0000 7ff62ffff640 1 --2- 172.21.15.6:0/1160321535 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7ff618066120 0x7ff6180685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:19.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.800+0000 7ff62ffff640 1 --2- 172.21.15.6:0/1160321535 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7ff618066120 0x7ff6180685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff6381565b0 tx=0x7ff620009040 comp rx=0 tx=0).ready entity=mgr.5684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.804+0000 7ff62effd640 1 -- 172.21.15.6:0/1160321535 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff63806b990 con 0x7ff6380aeb40 2023-07-21T22:32:20.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:19.976+0000 7ff63ceca640 1 -- 172.21.15.6:0/1160321535 --> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "2M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff63815c9d0 con 0x7ff618066120 2023-07-21T22:32:20.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.024+0000 7ff62effd640 1 -- 172.21.15.6:0/1160321535 <== mgr.5684 v2:172.21.15.161:6832/582015960 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff620001c90 con 0x7ff618066120 2023-07-21T22:32:20.075 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule set for path snap_test_dir1 2023-07-21T22:32:20.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.028+0000 7ff63ceca640 1 -- 172.21.15.6:0/1160321535 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7ff618066120 msgr2=0x7ff6180685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:20.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.028+0000 7ff63ceca640 1 --2- 172.21.15.6:0/1160321535 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7ff618066120 0x7ff6180685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff6381565b0 tx=0x7ff620009040 comp rx=0 tx=0).stop 2023-07-21T22:32:20.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.028+0000 7ff63ceca640 1 -- 172.21.15.6:0/1160321535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6380aeb40 msgr2=0x7ff638147060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:20.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.028+0000 7ff63ceca640 1 --2- 172.21.15.6:0/1160321535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6380aeb40 0x7ff638147060 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff6280ad040 tx=0x7ff62801ac40 comp rx=0 tx=0).stop 2023-07-21T22:32:20.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.028+0000 7ff63ceca640 1 -- 172.21.15.6:0/1160321535 shutdown_connections 2023-07-21T22:32:20.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.028+0000 7ff63ceca640 1 --2- 172.21.15.6:0/1160321535 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7ff618066120 0x7ff6180685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:20.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.028+0000 7ff63ceca640 1 --2- 172.21.15.6:0/1160321535 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff638159440 0x7ff638156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.028+0000 7ff63ceca640 1 --2- 172.21.15.6:0/1160321535 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6380aef10 0x7ff638157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.028+0000 7ff63ceca640 1 --2- 172.21.15.6:0/1160321535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6380aeb40 0x7ff638147060 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.028+0000 7ff63ceca640 1 -- 172.21.15.6:0/1160321535 >> 172.21.15.6:0/1160321535 conn(0x7ff6380cde90 msgr2=0x7ff6380ca910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.028+0000 7ff63ceca640 1 -- 172.21.15.6:0/1160321535 shutdown_connections 2023-07-21T22:32:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.028+0000 7ff63ceca640 1 -- 172.21.15.6:0/1160321535 wait complete. 2023-07-21T22:32:20.096 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-21T22:32:20.097 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-21-22_33_00 in ~40s... 2023-07-21T22:32:20.097 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-21-22_34_00 in ~100s... 2023-07-21T22:32:20.098 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M', '2M'], expected_retention: [] 2023-07-21T22:32:20.098 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-07-21T22:32:20.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.196+0000 7f0c651d2640 1 Processor -- start 2023-07-21T22:32:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.196+0000 7f0c651d2640 1 -- start start 2023-07-21T22:32:20.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c651d2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0c60069430 0x7f0c60069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:20.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c651d2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c60159d70 con 0x7f0c60070f30 2023-07-21T22:32:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c651d2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c60069d40 con 0x7f0c600af2b0 2023-07-21T22:32:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c651d2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c600c9c60 con 0x7f0c60069430 2023-07-21T22:32:20.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c57fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0c60070f30 0x7f0c600ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49292/0 (socket says 172.21.15.6:49292) 2023-07-21T22:32:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c57fff640 1 -- 172.21.15.6:0/1356311713 learned_addr learned my addr 172.21.15.6:0/1356311713 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:32:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5e59c640 1 -- 172.21.15.6:0/1356311713 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122821762 0 0) 0x7f0c48001120 con 0x7f0c60070f30 2023-07-21T22:32:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5e59c640 1 -- 172.21.15.6:0/1356311713 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c4c003530 con 0x7f0c60070f30 2023-07-21T22:32:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5ed9d640 1 --2- 172.21.15.6:0/1356311713 >> v2:172.21.15.161:3300/0 conn(0x7f0c60069430 0x7f0c60069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:20.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5e59c640 1 -- 172.21.15.6:0/1356311713 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2481319953 0 0) 0x7f0c4c003530 con 0x7f0c60070f30 2023-07-21T22:32:20.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5e59c640 1 -- 172.21.15.6:0/1356311713 >> v2:172.21.15.161:3300/0 conn(0x7f0c60069430 msgr2=0x7f0c60069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:20.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5e59c640 1 --2- 172.21.15.6:0/1356311713 >> v2:172.21.15.161:3300/0 conn(0x7f0c60069430 0x7f0c60069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:20.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5e59c640 1 -- 172.21.15.6:0/1356311713 >> v1:172.21.15.161:6789/0 conn(0x7f0c600af2b0 legacy=0x7f0c6015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:20.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5e59c640 1 -- 172.21.15.6:0/1356311713 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c600c9f40 con 0x7f0c60070f30 2023-07-21T22:32:20.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5e59c640 1 -- 172.21.15.6:0/1356311713 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f0c48001810 con 0x7f0c60070f30 2023-07-21T22:32:20.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5e59c640 1 -- 172.21.15.6:0/1356311713 >> v1:172.21.15.6:6789/0 conn(0x7f0c60070f30 legacy=0x7f0c600ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:20.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5e59c640 1 --2- 172.21.15.6:0/1356311713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c4c003980 0x7f0c4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:20.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5e59c640 1 --2- 172.21.15.6:0/1356311713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c4c0047d0 0x7f0c4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:20.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5e59c640 1 --2- 172.21.15.6:0/1356311713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c4c005180 0x7f0c4c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:20.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5e59c640 1 -- 172.21.15.6:0/1356311713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600c9c60 con 0x7f0c4c003980 2023-07-21T22:32:20.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5e59c640 1 -- 172.21.15.6:0/1356311713 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c00c000 con 0x7f0c4c0047d0 2023-07-21T22:32:20.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5e59c640 1 -- 172.21.15.6:0/1356311713 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4c00c1c0 con 0x7f0c4c005180 2023-07-21T22:32:20.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5ed9d640 1 --2- 172.21.15.6:0/1356311713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c4c003980 0x7f0c4c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:20.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c57fff640 1 --2- 172.21.15.6:0/1356311713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c4c0047d0 0x7f0c4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:20.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5f59e640 1 --2- 172.21.15.6:0/1356311713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c4c005180 0x7f0c4c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:20.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5ed9d640 1 -- 172.21.15.6:0/1356311713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c4c005180 msgr2=0x7f0c4c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:20.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5ed9d640 1 --2- 172.21.15.6:0/1356311713 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c4c005180 0x7f0c4c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:20.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5ed9d640 1 -- 172.21.15.6:0/1356311713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c4c0047d0 msgr2=0x7f0c4c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:20.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5ed9d640 1 --2- 172.21.15.6:0/1356311713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c4c0047d0 0x7f0c4c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:20.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5ed9d640 1 -- 172.21.15.6:0/1356311713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c003530 con 0x7f0c4c003980 2023-07-21T22:32:20.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.200+0000 7f0c5f59e640 1 -- 172.21.15.6:0/1356311713 reap_dead start 2023-07-21T22:32:20.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.204+0000 7f0c5ed9d640 1 --2- 172.21.15.6:0/1356311713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c4c003980 0x7f0c4c003d90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0c50009ae0 tx=0x7f0c5001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faca601c0db1ef7a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.204+0000 7f0c5e59c640 1 -- 172.21.15.6:0/1356311713 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c500a6430 con 0x7f0c4c003980 2023-07-21T22:32:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.204+0000 7f0c5e59c640 1 -- 172.21.15.6:0/1356311713 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c500a6590 con 0x7f0c4c003980 2023-07-21T22:32:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.204+0000 7f0c5e59c640 1 -- 172.21.15.6:0/1356311713 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c500a6940 con 0x7f0c4c003980 2023-07-21T22:32:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.204+0000 7f0c651d2640 1 -- 172.21.15.6:0/1356311713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c4c003980 msgr2=0x7f0c4c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.204+0000 7f0c651d2640 1 --2- 172.21.15.6:0/1356311713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c4c003980 0x7f0c4c003d90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f0c50009ae0 tx=0x7f0c5001ca50 comp rx=0 tx=0).stop 2023-07-21T22:32:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.204+0000 7f0c651d2640 1 -- 172.21.15.6:0/1356311713 shutdown_connections 2023-07-21T22:32:20.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.204+0000 7f0c651d2640 1 --2- 172.21.15.6:0/1356311713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c4c003980 0x7f0c4c003d90 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:20.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.204+0000 7f0c651d2640 1 -- 172.21.15.6:0/1356311713 >> 172.21.15.6:0/1356311713 conn(0x7f0c600cde90 msgr2=0x7f0c600ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:20.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.204+0000 7f0c651d2640 1 -- 172.21.15.6:0/1356311713 shutdown_connections 2023-07-21T22:32:20.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.204+0000 7f0c651d2640 1 -- 172.21.15.6:0/1356311713 wait complete. 2023-07-21T22:32:20.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c651d2640 1 Processor -- start 2023-07-21T22:32:20.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c651d2640 1 -- start start 2023-07-21T22:32:20.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c651d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c4c003980 0x7f0c6014cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:20.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c651d2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c6006b0f0 0x7f0c6006b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:20.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c651d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c60158ec0 0x7f0c60159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:20.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c651d2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6006baa0 con 0x7f0c60158ec0 2023-07-21T22:32:20.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c651d2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6014f210 con 0x7f0c6006b0f0 2023-07-21T22:32:20.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c651d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6014f4b0 con 0x7f0c4c003980 2023-07-21T22:32:20.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c5f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c60158ec0 0x7f0c60159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:20.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c57fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c6006b0f0 0x7f0c6006b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:20.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c5f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c60158ec0 0x7f0c60159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48940/0 (socket says 172.21.15.6:48940) 2023-07-21T22:32:20.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c5f59e640 1 -- 172.21.15.6:0/2357538781 learned_addr learned my addr 172.21.15.6:0/2357538781 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:32:20.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c5ed9d640 1 --2- 172.21.15.6:0/2357538781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c4c003980 0x7f0c6014cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:20.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c57fff640 1 -- 172.21.15.6:0/2357538781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c4c003980 msgr2=0x7f0c6014cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:20.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c57fff640 1 --2- 172.21.15.6:0/2357538781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c4c003980 0x7f0c6014cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:20.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c57fff640 1 -- 172.21.15.6:0/2357538781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c60158ec0 msgr2=0x7f0c60159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:20.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c57fff640 1 --2- 172.21.15.6:0/2357538781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c60158ec0 0x7f0c60159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:20.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c57fff640 1 -- 172.21.15.6:0/2357538781 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6014f790 con 0x7f0c6006b0f0 2023-07-21T22:32:20.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c5f59e640 1 --2- 172.21.15.6:0/2357538781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c60158ec0 0x7f0c60159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:32:20.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c57fff640 1 --2- 172.21.15.6:0/2357538781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c6006b0f0 0x7f0c6006b560 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0c60071f40 tx=0x7f0c48007120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:20.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c577fe640 1 -- 172.21.15.6:0/2357538781 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48012560 con 0x7f0c6006b0f0 2023-07-21T22:32:20.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c577fe640 1 -- 172.21.15.6:0/2357538781 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c480126e0 con 0x7f0c6006b0f0 2023-07-21T22:32:20.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c577fe640 1 -- 172.21.15.6:0/2357538781 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48012a90 con 0x7f0c6006b0f0 2023-07-21T22:32:20.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c651d2640 1 -- 172.21.15.6:0/2357538781 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6014fa70 con 0x7f0c6006b0f0 2023-07-21T22:32:20.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c651d2640 1 -- 172.21.15.6:0/2357538781 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6014d050 con 0x7f0c6006b0f0 2023-07-21T22:32:20.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.208+0000 7f0c651d2640 1 -- 172.21.15.6:0/2357538781 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c600678d0 con 0x7f0c6006b0f0 2023-07-21T22:32:20.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.212+0000 7f0c577fe640 1 -- 172.21.15.6:0/2357538781 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 19) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f0c48012bf0 con 0x7f0c6006b0f0 2023-07-21T22:32:20.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.212+0000 7f0c577fe640 1 --2- 172.21.15.6:0/2357538781 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f0c40066120 0x7f0c400685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:20.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.212+0000 7f0c577fe640 1 -- 172.21.15.6:0/2357538781 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f0c48083710 con 0x7f0c6006b0f0 2023-07-21T22:32:20.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.212+0000 7f0c5ed9d640 1 --2- 172.21.15.6:0/2357538781 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f0c40066120 0x7f0c400685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:20.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.212+0000 7f0c5ed9d640 1 --2- 172.21.15.6:0/2357538781 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f0c40066120 0x7f0c400685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0c500ad000 tx=0x7f0c500b2040 comp rx=0 tx=0).ready entity=mgr.5684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:20.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.216+0000 7f0c577fe640 1 -- 172.21.15.6:0/2357538781 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c48050d20 con 0x7f0c6006b0f0 2023-07-21T22:32:20.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.388+0000 7f0c651d2640 1 -- 172.21.15.6:0/2357538781 --> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0c60159d70 con 0x7f0c40066120 2023-07-21T22:32:20.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.396+0000 7f0c577fe640 1 -- 172.21.15.6:0/2357538781 <== mgr.5684 v2:172.21.15.161:6832/582015960 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+76 (secure 0 0 0) 0x7f0c60159d70 con 0x7f0c40066120 2023-07-21T22:32:20.444 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:32:20.445 INFO:teuthology.orchestra.run.smithi006.stdout:{"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-07-21T22:32:20.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.396+0000 7f0c651d2640 1 -- 172.21.15.6:0/2357538781 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f0c40066120 msgr2=0x7f0c400685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:20.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.396+0000 7f0c651d2640 1 --2- 172.21.15.6:0/2357538781 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f0c40066120 0x7f0c400685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0c500ad000 tx=0x7f0c500b2040 comp rx=0 tx=0).stop 2023-07-21T22:32:20.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.396+0000 7f0c651d2640 1 -- 172.21.15.6:0/2357538781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c6006b0f0 msgr2=0x7f0c6006b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:20.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.396+0000 7f0c651d2640 1 --2- 172.21.15.6:0/2357538781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c6006b0f0 0x7f0c6006b560 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0c60071f40 tx=0x7f0c48007120 comp rx=0 tx=0).stop 2023-07-21T22:32:20.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.396+0000 7f0c651d2640 1 -- 172.21.15.6:0/2357538781 shutdown_connections 2023-07-21T22:32:20.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.396+0000 7f0c651d2640 1 --2- 172.21.15.6:0/2357538781 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f0c40066120 0x7f0c400685d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:20.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.396+0000 7f0c651d2640 1 --2- 172.21.15.6:0/2357538781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c60158ec0 0x7f0c60159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:20.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.396+0000 7f0c651d2640 1 --2- 172.21.15.6:0/2357538781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c6006b0f0 0x7f0c6006b560 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:20.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.396+0000 7f0c651d2640 1 --2- 172.21.15.6:0/2357538781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c4c003980 0x7f0c6014cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:20.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.396+0000 7f0c651d2640 1 -- 172.21.15.6:0/2357538781 >> 172.21.15.6:0/2357538781 conn(0x7f0c600cde90 msgr2=0x7f0c60152c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:20.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.396+0000 7f0c651d2640 1 -- 172.21.15.6:0/2357538781 shutdown_connections 2023-07-21T22:32:20.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:32:20.396+0000 7f0c651d2640 1 -- 172.21.15.6:0/2357538781 wait complete. 2023-07-21T22:32:20.466 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-07-21T22:32:20.466 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M', '2M'], 'retention': [{}, {}]} 2023-07-21T22:32:20.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:20.467 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:20.478 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:20.478 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:20.479 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:21.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:21.481 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:21.493 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:21.494 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:21.494 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:22.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:22.496 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:22.508 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:22.508 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:22.509 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:23.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:23.510 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:23.522 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:23.523 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:23.523 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:24.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:24.525 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:24.537 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:24.537 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:24.537 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:25.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:25.539 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:25.552 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:25.553 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:25.553 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:26.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:26.555 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:26.567 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:26.567 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:26.568 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:27.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:27.569 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:27.581 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:27.582 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:27.582 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:28.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:28.583 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:28.596 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:28.596 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:28.596 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:29.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:29.598 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:29.611 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:29.611 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:29.612 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:30.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:30.613 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:30.625 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:30.625 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:30.626 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:31.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:31.627 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:31.640 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:31.640 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:31.641 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:32.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:32.642 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:32.654 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:32.654 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:32.654 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:33.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:33.657 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:33.670 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:33.670 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:33.670 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:34.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:34.671 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:34.683 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:34.684 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:34.684 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:35.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:35.686 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:35.697 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:35.698 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:35.698 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:36.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:36.700 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:36.712 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:36.713 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:36.713 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:37.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:37.716 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:37.729 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:37.729 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:37.730 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:38.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:38.731 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:38.743 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:38.744 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:38.744 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:39.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:39.746 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:39.758 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:39.758 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:39.759 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:40.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:40.761 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:40.773 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:40.774 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:40.774 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:41.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:41.776 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:41.789 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:41.789 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:41.789 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:42.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:42.791 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:42.802 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:42.803 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:42.803 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:43.176 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:32:43.180 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:32:43.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:43.805 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:43.817 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:43.818 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:43.818 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:44.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:44.820 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:44.832 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:44.832 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:44.833 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:45.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:45.835 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:45.847 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:45.847 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:45.848 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:46.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:46.849 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:46.863 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:46.864 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:46.864 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:47.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:47.866 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:47.878 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:47.878 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:47.878 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:48.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:48.880 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:48.892 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:48.893 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:48.893 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:49.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:49.895 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:49.908 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:49.909 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:49.909 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:50.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:50.911 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:50.923 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:50.923 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:50.924 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:51.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:51.925 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:51.938 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:51.939 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:51.939 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:52.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:52.940 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:52.952 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:52.953 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:52.953 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:53.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:53.954 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:53.966 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:53.967 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:53.967 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:54.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:54.968 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:54.981 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:54.981 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:54.981 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:55.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:55.982 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:55.994 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:55.995 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:55.995 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:56.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:56.996 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:57.008 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:57.008 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:57.009 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:58.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:58.010 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:58.024 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:58.024 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:58.025 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:32:59.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:32:59.027 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:32:59.039 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:32:59.039 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:32:59.039 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:00.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:00.041 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:00.053 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:33:00.054 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:00.054 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:00.088 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:33:00.046+0000 7fa36d0de640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:33:00.088 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:33:00.046+0000 7fa36d0de640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:33:00.088 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:33:00.046+0000 7fa36d0de640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:33:00.088 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:33:00.046+0000 7fa36d0de640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:33:00.089 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:33:00.046+0000 7fa36d0de640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:33:01.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:01.055 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:01.067 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:01.067 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:01.068 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:01.068 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:01.068 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-07-21-22_33_00_UTC'] 2023-07-21T22:33:01.069 DEBUG:tasks.cephfs.test_snap_schedules:exec=1689978740.0972557, now = 1689978781.0690715, timo = 40 2023-07-21T22:33:02.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:02.070 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:02.081 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:02.082 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:02.082 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:02.083 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:03.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:03.084 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:03.095 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:03.095 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:03.096 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:03.096 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:04.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:04.098 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:04.108 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:04.109 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:04.110 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:04.110 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:05.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:05.112 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:05.123 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:05.124 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:05.125 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:05.125 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:06.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:06.126 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:06.137 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:06.138 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:06.138 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:06.139 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:07.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:07.140 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:07.151 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:07.152 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:07.152 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:07.152 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:08.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:08.154 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:08.165 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:08.166 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:08.167 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:08.167 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:09.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:09.169 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:09.180 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:09.181 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:09.181 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:09.182 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:10.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:10.183 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:10.193 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:10.194 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:10.195 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:10.195 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:11.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:11.196 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:11.208 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:11.209 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:11.209 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:11.209 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:12.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:12.211 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:12.222 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:12.223 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:12.224 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:12.224 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:13.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:13.225 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:13.236 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:33:13.237 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:13.238 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:13.238 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:13.238 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:13.240 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:33:14.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:14.240 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:14.251 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:14.252 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:14.252 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:14.253 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:15.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:15.254 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:15.265 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:15.266 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:15.266 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:15.267 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:16.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:16.268 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:16.279 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:16.280 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:16.281 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:16.281 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:17.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:17.282 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:17.293 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:17.294 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:17.294 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:17.294 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:18.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:18.296 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:18.307 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:18.308 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:18.308 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:18.308 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:19.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:19.309 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:19.320 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:19.321 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:19.321 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:19.322 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:20.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:20.323 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:20.334 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:20.335 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:20.335 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:20.335 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:21.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:21.336 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:21.347 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:21.348 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:21.348 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:21.349 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:22.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:22.350 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:22.361 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:22.362 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:22.363 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:22.363 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:23.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:23.365 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:23.376 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:23.377 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:23.378 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:23.378 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:24.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:24.379 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:24.390 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:24.391 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:24.392 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:24.392 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:25.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:25.394 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:25.405 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:25.406 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:25.406 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:25.407 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:26.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:26.408 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:26.419 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:26.420 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:26.421 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:26.421 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:27.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:27.423 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:27.434 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:27.435 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:27.435 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:27.435 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:28.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:28.437 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:28.448 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:28.449 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:28.449 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:28.449 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:29.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:29.450 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:29.461 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:29.462 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:29.463 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:29.463 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:30.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:30.465 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:30.475 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:30.476 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:30.477 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:30.477 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:31.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:31.479 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:31.490 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:31.491 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:31.491 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:31.492 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:32.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:32.493 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:32.504 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:32.505 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:32.505 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:32.505 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:33.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:33.507 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:33.518 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:33.519 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:33.519 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:33.519 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:34.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:34.521 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:34.531 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:34.532 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:34.533 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:34.533 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:35.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:35.534 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:35.545 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:35.546 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:35.547 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:35.547 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:36.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:36.549 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:36.559 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:36.560 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:36.561 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:36.561 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:37.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:37.563 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:37.573 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:37.574 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:37.575 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:37.575 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:38.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:38.577 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:38.587 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:38.588 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:38.589 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:38.589 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:39.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:39.591 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:39.602 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:39.603 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:39.603 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:39.603 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:40.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:40.605 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:40.616 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:40.617 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:40.617 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:40.618 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:41.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:41.619 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:41.630 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:41.631 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:41.632 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:41.632 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:42.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:42.634 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:42.645 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:42.646 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:42.646 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:42.647 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:43.292 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:33:43.296 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:33:43.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:43.648 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:43.660 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:43.661 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:43.661 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:43.662 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:44.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:44.663 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:44.675 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:44.677 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:44.677 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:44.678 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:45.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:45.680 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:45.691 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:45.692 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:45.692 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:45.693 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:46.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:46.695 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:46.706 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:46.707 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:46.708 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:46.708 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:47.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:47.709 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:47.721 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:47.721 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:47.722 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:47.722 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:48.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:48.724 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:48.735 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:48.736 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:48.736 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:48.736 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:49.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:49.738 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:49.749 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:49.750 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:49.751 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:49.751 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:50.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:50.752 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:50.763 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:50.764 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:50.764 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:50.765 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:51.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:51.766 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:51.777 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:51.778 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:51.778 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:51.778 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:52.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:52.780 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:52.791 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:52.792 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:52.792 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:52.792 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:53.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:53.793 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:53.804 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:53.805 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:53.806 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:53.806 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:54.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:54.808 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:54.819 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:54.821 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:54.821 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:54.821 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:55.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:55.823 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:55.834 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:55.835 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:55.835 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:55.835 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:56.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:56.837 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:56.847 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:56.848 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:56.848 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:56.849 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:57.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:57.850 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:57.861 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:57.861 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:57.862 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:57.862 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:58.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:58.863 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:58.875 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:58.876 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:58.876 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:58.876 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:33:59.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:33:59.878 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:33:59.889 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:33:59.890 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC'} 2023-07-21T22:33:59.890 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:33:59.890 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:34:00.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:34:00.892 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:34:00.903 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:34:00.904 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_34_00_UTC 2023-07-21T22:34:00.905 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_33_00_UTC', 'scheduled-2023-07-21-22_34_00_UTC'} 2023-07-21T22:34:00.905 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-21-22_34_00_UTC'} 2023-07-21T22:34:00.906 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:34:00.906 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-07-21-22_34_00_UTC'] 2023-07-21T22:34:00.906 DEBUG:tasks.cephfs.test_snap_schedules:exec=1689978740.0972557, now = 1689978840.9068093, timo = 100 2023-07-21T22:34:01.907 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-21T22:34:02.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.019+0000 7eff26b9d640 1 Processor -- start 2023-07-21T22:34:02.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.019+0000 7eff26b9d640 1 -- start start 2023-07-21T22:34:02.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.019+0000 7eff26b9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7eff20159440 0x7eff200c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:02.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.019+0000 7eff26b9d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff201532b0 con 0x7eff200aeb40 2023-07-21T22:34:02.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.019+0000 7eff26b9d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff200ca6f0 con 0x7eff2015cef0 2023-07-21T22:34:02.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.019+0000 7eff26b9d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2015d360 con 0x7eff20159440 2023-07-21T22:34:02.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.019+0000 7eff24939640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7eff200aeb40 0x7eff200aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38906/0 (socket says 172.21.15.6:38906) 2023-07-21T22:34:02.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.019+0000 7eff24939640 1 -- 172.21.15.6:0/4120445794 learned_addr learned my addr 172.21.15.6:0/4120445794 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:02.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.019+0000 7eff2513a640 1 --2- 172.21.15.6:0/4120445794 >> v2:172.21.15.6:3300/0 conn(0x7eff20159440 0x7eff200c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:02.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.019+0000 7eff1f7fe640 1 -- 172.21.15.6:0/4120445794 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 18412178 0 0) 0x7eff201532b0 con 0x7eff200aeb40 2023-07-21T22:34:02.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.019+0000 7eff2513a640 1 -- 172.21.15.6:0/4120445794 >> v1:172.21.15.161:6789/0 conn(0x7eff2015cef0 legacy=0x7eff20158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:02.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.019+0000 7eff2513a640 1 -- 172.21.15.6:0/4120445794 >> v1:172.21.15.6:6789/0 conn(0x7eff200aeb40 legacy=0x7eff200aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:02.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.019+0000 7eff2513a640 1 -- 172.21.15.6:0/4120445794 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff201599d0 con 0x7eff20159440 2023-07-21T22:34:02.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.023+0000 7eff2513a640 1 --2- 172.21.15.6:0/4120445794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff20159440 0x7eff200c88c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7eff18009d90 tx=0x7eff1801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f940336866e12783 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:02.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.023+0000 7eff1f7fe640 1 -- 172.21.15.6:0/4120445794 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180a59a0 con 0x7eff20159440 2023-07-21T22:34:02.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.023+0000 7eff1f7fe640 1 -- 172.21.15.6:0/4120445794 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff180a5b00 con 0x7eff20159440 2023-07-21T22:34:02.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.023+0000 7eff1f7fe640 1 -- 172.21.15.6:0/4120445794 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180a5e90 con 0x7eff20159440 2023-07-21T22:34:02.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.023+0000 7eff26b9d640 1 -- 172.21.15.6:0/4120445794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff20159440 msgr2=0x7eff200c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:02.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.023+0000 7eff26b9d640 1 --2- 172.21.15.6:0/4120445794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff20159440 0x7eff200c88c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7eff18009d90 tx=0x7eff1801c8e0 comp rx=0 tx=0).stop 2023-07-21T22:34:02.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.023+0000 7eff26b9d640 1 -- 172.21.15.6:0/4120445794 shutdown_connections 2023-07-21T22:34:02.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.023+0000 7eff26b9d640 1 --2- 172.21.15.6:0/4120445794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff20159440 0x7eff200c88c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:02.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.023+0000 7eff26b9d640 1 -- 172.21.15.6:0/4120445794 >> 172.21.15.6:0/4120445794 conn(0x7eff200cde90 msgr2=0x7eff200ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:02.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.023+0000 7eff26b9d640 1 -- 172.21.15.6:0/4120445794 shutdown_connections 2023-07-21T22:34:02.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.023+0000 7eff26b9d640 1 -- 172.21.15.6:0/4120445794 wait complete. 2023-07-21T22:34:02.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff26b9d640 1 Processor -- start 2023-07-21T22:34:02.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff26b9d640 1 -- start start 2023-07-21T22:34:02.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff26b9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff200aeb40 0x7eff2015aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:02.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff26b9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff20159440 0x7eff201481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:02.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff26b9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff2015cef0 0x7eff2014d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:02.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff26b9d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2013f690 con 0x7eff2015cef0 2023-07-21T22:34:02.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff26b9d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff20147d30 con 0x7eff20159440 2023-07-21T22:34:02.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff26b9d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff200acf60 con 0x7eff200aeb40 2023-07-21T22:34:02.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff2513a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff2015cef0 0x7eff2014d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:02.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff2513a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff2015cef0 0x7eff2014d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42754/0 (socket says 172.21.15.6:42754) 2023-07-21T22:34:02.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff2513a640 1 -- 172.21.15.6:0/3067593801 learned_addr learned my addr 172.21.15.6:0/3067593801 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:02.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff1ffff640 1 --2- 172.21.15.6:0/3067593801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff20159440 0x7eff201481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:02.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff24939640 1 --2- 172.21.15.6:0/3067593801 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff200aeb40 0x7eff2015aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:02.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff2513a640 1 -- 172.21.15.6:0/3067593801 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff200aeb40 msgr2=0x7eff2015aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:02.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff2513a640 1 --2- 172.21.15.6:0/3067593801 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff200aeb40 0x7eff2015aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:02.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff2513a640 1 -- 172.21.15.6:0/3067593801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff20159440 msgr2=0x7eff201481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:02.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff2513a640 1 --2- 172.21.15.6:0/3067593801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff20159440 0x7eff201481c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:02.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff2513a640 1 -- 172.21.15.6:0/3067593801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff18009a70 con 0x7eff2015cef0 2023-07-21T22:34:02.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff2513a640 1 --2- 172.21.15.6:0/3067593801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff2015cef0 0x7eff2014d460 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7eff180194f0 tx=0x7eff18019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:02.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff1d7fa640 1 -- 172.21.15.6:0/3067593801 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180a59a0 con 0x7eff2015cef0 2023-07-21T22:34:02.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff1d7fa640 1 -- 172.21.15.6:0/3067593801 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff18009450 con 0x7eff2015cef0 2023-07-21T22:34:02.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff1d7fa640 1 -- 172.21.15.6:0/3067593801 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff18003ba0 con 0x7eff2015cef0 2023-07-21T22:34:02.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff26b9d640 1 -- 172.21.15.6:0/3067593801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff200abf90 con 0x7eff2015cef0 2023-07-21T22:34:02.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.027+0000 7eff26b9d640 1 -- 172.21.15.6:0/3067593801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff201479c0 con 0x7eff2015cef0 2023-07-21T22:34:02.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.031+0000 7eff26b9d640 1 -- 172.21.15.6:0/3067593801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff20147ec0 con 0x7eff2015cef0 2023-07-21T22:34:02.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.031+0000 7eff1d7fa640 1 -- 172.21.15.6:0/3067593801 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 22) v1 ==== 85789+0+0 (secure 0 0 0) 0x7eff180b4050 con 0x7eff2015cef0 2023-07-21T22:34:02.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.031+0000 7eff1d7fa640 1 --2- 172.21.15.6:0/3067593801 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7eff04066420 0x7eff040688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:02.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.031+0000 7eff1d7fa640 1 -- 172.21.15.6:0/3067593801 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6508+0+0 (secure 0 0 0) 0x7eff1811f490 con 0x7eff2015cef0 2023-07-21T22:34:02.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.031+0000 7eff24939640 1 --2- 172.21.15.6:0/3067593801 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7eff04066420 0x7eff040688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:02.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.031+0000 7eff24939640 1 --2- 172.21.15.6:0/3067593801 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7eff04066420 0x7eff040688d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7eff14000f70 tx=0x7eff14007b60 comp rx=0 tx=0).ready entity=mgr.5684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:02.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.035+0000 7eff1d7fa640 1 -- 172.21.15.6:0/3067593801 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7eff180ec630 con 0x7eff2015cef0 2023-07-21T22:34:02.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.211+0000 7eff26b9d640 1 -- 172.21.15.6:0/3067593801 --> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7eff2015c9d0 con 0x7eff04066420 2023-07-21T22:34:02.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.279+0000 7eff1d7fa640 1 -- 172.21.15.6:0/3067593801 <== mgr.5684 v2:172.21.15.161:6832/582015960 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7eff140071f0 con 0x7eff04066420 2023-07-21T22:34:02.329 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule removed for path snap_test_dir1 2023-07-21T22:34:02.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.279+0000 7eff26b9d640 1 -- 172.21.15.6:0/3067593801 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7eff04066420 msgr2=0x7eff040688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:02.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.279+0000 7eff26b9d640 1 --2- 172.21.15.6:0/3067593801 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7eff04066420 0x7eff040688d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7eff14000f70 tx=0x7eff14007b60 comp rx=0 tx=0).stop 2023-07-21T22:34:02.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.279+0000 7eff26b9d640 1 -- 172.21.15.6:0/3067593801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff2015cef0 msgr2=0x7eff2014d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:02.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.279+0000 7eff26b9d640 1 --2- 172.21.15.6:0/3067593801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff2015cef0 0x7eff2014d460 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7eff180194f0 tx=0x7eff18019680 comp rx=0 tx=0).stop 2023-07-21T22:34:02.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.283+0000 7eff26b9d640 1 -- 172.21.15.6:0/3067593801 shutdown_connections 2023-07-21T22:34:02.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.283+0000 7eff26b9d640 1 --2- 172.21.15.6:0/3067593801 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7eff04066420 0x7eff040688d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:02.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.283+0000 7eff26b9d640 1 --2- 172.21.15.6:0/3067593801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff2015cef0 0x7eff2014d460 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:02.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.283+0000 7eff26b9d640 1 --2- 172.21.15.6:0/3067593801 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff20159440 0x7eff201481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:02.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.283+0000 7eff26b9d640 1 --2- 172.21.15.6:0/3067593801 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff200aeb40 0x7eff2015aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:02.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.283+0000 7eff26b9d640 1 -- 172.21.15.6:0/3067593801 >> 172.21.15.6:0/3067593801 conn(0x7eff200cde90 msgr2=0x7eff200ccf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:02.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.283+0000 7eff26b9d640 1 -- 172.21.15.6:0/3067593801 shutdown_connections 2023-07-21T22:34:02.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.283+0000 7eff26b9d640 1 -- 172.21.15.6:0/3067593801 wait complete. 2023-07-21T22:34:02.349 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-21T22:34:02.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:34:02.350 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:34:02.360 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:34:02.360 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_34_00_UTC 2023-07-21T22:34:02.361 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-21-22_33_00_UTC 2023-07-21T22:34:02.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:34:02.361 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-21-22_33_00_UTC) 2023-07-21T22:34:02.416 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-21-22_34_00_UTC 2023-07-21T22:34:02.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:34:02.416 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-21-22_34_00_UTC) 2023-07-21T22:34:02.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:34:02.476 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-21T22:34:02.530 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-21T22:34:02.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.667+0000 7f74b1d9f640 1 Processor -- start 2023-07-21T22:34:02.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.667+0000 7f74b1d9f640 1 -- start start 2023-07-21T22:34:02.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.667+0000 7f74b1d9f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f74ac0d22e0 0x7f74ac0d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:02.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.667+0000 7f74b1d9f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ac0b2140 con 0x7f74ac145430 2023-07-21T22:34:02.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.667+0000 7f74b1d9f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ac0b2410 con 0x7f74ac0d06b0 2023-07-21T22:34:02.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.667+0000 7f74b1d9f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74ac0d2cc0 con 0x7f74ac0d22e0 2023-07-21T22:34:02.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.667+0000 7f74aaffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f74ac145430 0x7f74ac0b34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38908/0 (socket says 172.21.15.6:38908) 2023-07-21T22:34:02.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.667+0000 7f74aaffd640 1 -- 172.21.15.6:0/737202005 learned_addr learned my addr 172.21.15.6:0/737202005 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:02.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.667+0000 7f74abfff640 1 --2- 172.21.15.6:0/737202005 >> v2:172.21.15.161:3300/0 conn(0x7f74ac0d22e0 0x7f74ac0d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:02.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.667+0000 7f74aa7fc640 1 -- 172.21.15.6:0/737202005 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936824598 0 0) 0x7f74ac0b2140 con 0x7f74ac145430 2023-07-21T22:34:02.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.667+0000 7f74aa7fc640 1 -- 172.21.15.6:0/737202005 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7494003530 con 0x7f74ac145430 2023-07-21T22:34:02.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.667+0000 7f74abfff640 1 -- 172.21.15.6:0/737202005 >> v1:172.21.15.161:6789/0 conn(0x7f74ac0d06b0 legacy=0x7f74ac0b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:02.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.667+0000 7f74aa7fc640 1 -- 172.21.15.6:0/737202005 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1803878678 0 0) 0x7f7494003530 con 0x7f74ac145430 2023-07-21T22:34:02.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.667+0000 7f74abfff640 1 -- 172.21.15.6:0/737202005 >> v1:172.21.15.6:6789/0 conn(0x7f74ac145430 legacy=0x7f74ac0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:02.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.667+0000 7f74abfff640 1 -- 172.21.15.6:0/737202005 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac0b26f0 con 0x7f74ac0d22e0 2023-07-21T22:34:02.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.671+0000 7f74abfff640 1 --2- 172.21.15.6:0/737202005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74ac0d22e0 0x7f74ac0d2780 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009d90 tx=0x7f74a401c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a795c21a13a0229b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:02.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.671+0000 7f74aa7fc640 1 -- 172.21.15.6:0/737202005 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0001680 con 0x7f74ac0d22e0 2023-07-21T22:34:02.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.671+0000 7f74aa7fc640 1 -- 172.21.15.6:0/737202005 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a40a55c0 con 0x7f74ac0d22e0 2023-07-21T22:34:02.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.671+0000 7f74aa7fc640 1 -- 172.21.15.6:0/737202005 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a40a5950 con 0x7f74ac0d22e0 2023-07-21T22:34:02.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.671+0000 7f74b1d9f640 1 -- 172.21.15.6:0/737202005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74ac0d22e0 msgr2=0x7f74ac0d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:02.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.671+0000 7f74b1d9f640 1 --2- 172.21.15.6:0/737202005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74ac0d22e0 0x7f74ac0d2780 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009d90 tx=0x7f74a401c720 comp rx=0 tx=0).stop 2023-07-21T22:34:02.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.671+0000 7f74b1d9f640 1 -- 172.21.15.6:0/737202005 shutdown_connections 2023-07-21T22:34:02.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.671+0000 7f74b1d9f640 1 --2- 172.21.15.6:0/737202005 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74ac0d22e0 0x7f74ac0d2780 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:02.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.671+0000 7f74b1d9f640 1 -- 172.21.15.6:0/737202005 >> 172.21.15.6:0/737202005 conn(0x7f74ac0659d0 msgr2=0x7f74ac09b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:02.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.671+0000 7f74b1d9f640 1 -- 172.21.15.6:0/737202005 shutdown_connections 2023-07-21T22:34:02.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.671+0000 7f74b1d9f640 1 -- 172.21.15.6:0/737202005 wait complete. 2023-07-21T22:34:02.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74b1d9f640 1 Processor -- start 2023-07-21T22:34:02.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74b1d9f640 1 -- start start 2023-07-21T22:34:02.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74b1d9f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74ac0d06b0 0x7f74ac159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:02.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74b1d9f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74ac0d22e0 0x7f74ac0cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:02.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74b1d9f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74ac0cc530 0x7f74ac0b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:02.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74b1d9f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac159e70 con 0x7f74ac0cc530 2023-07-21T22:34:02.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74b1d9f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac0b6170 con 0x7f74ac0d06b0 2023-07-21T22:34:02.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74b1d9f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ac0b5560 con 0x7f74ac0d22e0 2023-07-21T22:34:02.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74abfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74ac0cc530 0x7f74ac0b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:02.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74abfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74ac0cc530 0x7f74ac0b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42758/0 (socket says 172.21.15.6:42758) 2023-07-21T22:34:02.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74abfff640 1 -- 172.21.15.6:0/4149743692 learned_addr learned my addr 172.21.15.6:0/4149743692 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:02.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74aaffd640 1 --2- 172.21.15.6:0/4149743692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74ac0d22e0 0x7f74ac0cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:02.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74ab7fe640 1 --2- 172.21.15.6:0/4149743692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74ac0d06b0 0x7f74ac159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:02.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74abfff640 1 -- 172.21.15.6:0/4149743692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74ac0d22e0 msgr2=0x7f74ac0cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:02.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74abfff640 1 --2- 172.21.15.6:0/4149743692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74ac0d22e0 0x7f74ac0cbff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:02.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74abfff640 1 -- 172.21.15.6:0/4149743692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74ac0d06b0 msgr2=0x7f74ac159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:02.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74abfff640 1 --2- 172.21.15.6:0/4149743692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74ac0d06b0 0x7f74ac159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:02.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74abfff640 1 -- 172.21.15.6:0/4149743692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a4009a70 con 0x7f74ac0cc530 2023-07-21T22:34:02.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74abfff640 1 --2- 172.21.15.6:0/4149743692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74ac0cc530 0x7f74ac0b3f60 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f74a40b0040 tx=0x7f74a40194c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:02.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f7493fff640 1 -- 172.21.15.6:0/4149743692 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a40adc00 con 0x7f74ac0cc530 2023-07-21T22:34:02.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f7493fff640 1 -- 172.21.15.6:0/4149743692 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a40a5e90 con 0x7f74ac0cc530 2023-07-21T22:34:02.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74b1d9f640 1 -- 172.21.15.6:0/4149743692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ac0b5840 con 0x7f74ac0cc530 2023-07-21T22:34:02.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f7493fff640 1 -- 172.21.15.6:0/4149743692 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4009450 con 0x7f74ac0cc530 2023-07-21T22:34:02.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.675+0000 7f74b1d9f640 1 -- 172.21.15.6:0/4149743692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ac0b5e00 con 0x7f74ac0cc530 2023-07-21T22:34:02.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.679+0000 7f74b1d9f640 1 -- 172.21.15.6:0/4149743692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ac0b62e0 con 0x7f74ac0cc530 2023-07-21T22:34:02.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.679+0000 7f7493fff640 1 -- 172.21.15.6:0/4149743692 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 22) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f74a40b4050 con 0x7f74ac0cc530 2023-07-21T22:34:02.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.679+0000 7f7493fff640 1 --2- 172.21.15.6:0/4149743692 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f74980663f0 0x7f74980688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:02.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.679+0000 7f7493fff640 1 -- 172.21.15.6:0/4149743692 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6508+0+0 (secure 0 0 0) 0x7f74a411e0b0 con 0x7f74ac0cc530 2023-07-21T22:34:02.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.679+0000 7f74ab7fe640 1 --2- 172.21.15.6:0/4149743692 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f74980663f0 0x7f74980688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:02.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.679+0000 7f74ab7fe640 1 --2- 172.21.15.6:0/4149743692 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f74980663f0 0x7f74980688a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f749c000c10 tx=0x7f749c0099b0 comp rx=0 tx=0).ready entity=mgr.5684 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:02.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.683+0000 7f7493fff640 1 -- 172.21.15.6:0/4149743692 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74a40eb310 con 0x7f74ac0cc530 2023-07-21T22:34:02.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:02.879+0000 7f74b1d9f640 1 -- 172.21.15.6:0/4149743692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f74ac0b2c80 con 0x7f74ac0cc530 2023-07-21T22:34:03.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:03.867+0000 7f7493fff640 1 -- 172.21.15.6:0/4149743692 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 23) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f74a411c2b0 con 0x7f74ac0cc530 2023-07-21T22:34:03.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:03.871+0000 7f7493fff640 1 -- 172.21.15.6:0/4149743692 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v23) v1 ==== 93+0+0 (secure 0 0 0) 0x7f74a40baea0 con 0x7f74ac0cc530 2023-07-21T22:34:03.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:03.871+0000 7f74b1d9f640 1 -- 172.21.15.6:0/4149743692 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f74980663f0 msgr2=0x7f74980688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:03.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:03.871+0000 7f74b1d9f640 1 --2- 172.21.15.6:0/4149743692 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f74980663f0 0x7f74980688a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f749c000c10 tx=0x7f749c0099b0 comp rx=0 tx=0).stop 2023-07-21T22:34:03.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:03.871+0000 7f74b1d9f640 1 -- 172.21.15.6:0/4149743692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74ac0cc530 msgr2=0x7f74ac0b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:03.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:03.871+0000 7f74b1d9f640 1 --2- 172.21.15.6:0/4149743692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74ac0cc530 0x7f74ac0b3f60 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f74a40b0040 tx=0x7f74a40194c0 comp rx=0 tx=0).stop 2023-07-21T22:34:03.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:03.871+0000 7f74b1d9f640 1 -- 172.21.15.6:0/4149743692 shutdown_connections 2023-07-21T22:34:03.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:03.871+0000 7f74b1d9f640 1 --2- 172.21.15.6:0/4149743692 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f74980663f0 0x7f74980688a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:03.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:03.871+0000 7f74b1d9f640 1 --2- 172.21.15.6:0/4149743692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74ac0cc530 0x7f74ac0b3f60 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:03.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:03.871+0000 7f74b1d9f640 1 --2- 172.21.15.6:0/4149743692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74ac0d22e0 0x7f74ac0cbff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:03.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:03.871+0000 7f74b1d9f640 1 --2- 172.21.15.6:0/4149743692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74ac0d06b0 0x7f74ac159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:03.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:03.871+0000 7f74b1d9f640 1 -- 172.21.15.6:0/4149743692 >> 172.21.15.6:0/4149743692 conn(0x7f74ac0659d0 msgr2=0x7f74ac0b1700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:03.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:03.871+0000 7f74b1d9f640 1 -- 172.21.15.6:0/4149743692 shutdown_connections 2023-07-21T22:34:03.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:03.871+0000 7f74b1d9f640 1 -- 172.21.15.6:0/4149743692 wait complete. 2023-07-21T22:34:03.945 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:34:03.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:34:04.030 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:34:04.096 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:04.047+0000 7fa2c0213180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:34:04.096 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:04.053+0000 7ff073a4a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:34:04.099 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:34:04.100 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:34:04.100 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:34:04.109 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:34:04.109 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:34:04.159 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:34:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.299+0000 7fbe5d92c640 1 Processor -- start 2023-07-21T22:34:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.299+0000 7fbe5d92c640 1 -- start start 2023-07-21T22:34:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.299+0000 7fbe5d92c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbe5815f500 0x7fbe5806cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.299+0000 7fbe5d92c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe5806ac50 0x7fbe580ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.299+0000 7fbe5d92c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe580cdc80 con 0x7fbe5806d430 2023-07-21T22:34:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.299+0000 7fbe5d92c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5806e4c0 con 0x7fbe5815f500 2023-07-21T22:34:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.299+0000 7fbe5d92c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5806d940 con 0x7fbe5806ac50 2023-07-21T22:34:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.299+0000 7fbe4ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbe5806d430 0x7fbe5806a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38924/0 (socket says 172.21.15.6:38924) 2023-07-21T22:34:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.299+0000 7fbe4ffff640 1 -- 172.21.15.6:0/153130586 learned_addr learned my addr 172.21.15.6:0/153130586 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.299+0000 7fbe56ffd640 1 --2- 172.21.15.6:0/153130586 >> v2:172.21.15.6:3300/0 conn(0x7fbe5815f500 0x7fbe5806cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.299+0000 7fbe577fe640 1 --2- 172.21.15.6:0/153130586 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe5806ac50 0x7fbe580ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.299+0000 7fbe567fc640 1 -- 172.21.15.6:0/153130586 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136459221 0 0) 0x7fbe580cdc80 con 0x7fbe5806d430 2023-07-21T22:34:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.299+0000 7fbe567fc640 1 -- 172.21.15.6:0/153130586 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe44003530 con 0x7fbe5806d430 2023-07-21T22:34:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.299+0000 7fbe577fe640 1 -- 172.21.15.6:0/153130586 >> v2:172.21.15.6:3300/0 conn(0x7fbe5815f500 msgr2=0x7fbe5806cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.299+0000 7fbe577fe640 1 --2- 172.21.15.6:0/153130586 >> v2:172.21.15.6:3300/0 conn(0x7fbe5815f500 0x7fbe5806cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.299+0000 7fbe577fe640 1 -- 172.21.15.6:0/153130586 >> v1:172.21.15.6:6789/0 conn(0x7fbe5806d430 legacy=0x7fbe5806a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.299+0000 7fbe577fe640 1 -- 172.21.15.6:0/153130586 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5806dc20 con 0x7fbe5806ac50 2023-07-21T22:34:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.299+0000 7fbe56ffd640 1 --2- 172.21.15.6:0/153130586 >> v2:172.21.15.6:3300/0 conn(0x7fbe5815f500 0x7fbe5806cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:04.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.303+0000 7fbe577fe640 1 --2- 172.21.15.6:0/153130586 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe5806ac50 0x7fbe580ce0f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009d90 tx=0x7fbe5001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cf7eb9a5d3be22e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:04.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.303+0000 7fbe567fc640 1 -- 172.21.15.6:0/153130586 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe500a5900 con 0x7fbe5806ac50 2023-07-21T22:34:04.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.303+0000 7fbe567fc640 1 -- 172.21.15.6:0/153130586 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe500a5a60 con 0x7fbe5806ac50 2023-07-21T22:34:04.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.303+0000 7fbe567fc640 1 -- 172.21.15.6:0/153130586 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe500a5dd0 con 0x7fbe5806ac50 2023-07-21T22:34:04.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.303+0000 7fbe5d92c640 1 -- 172.21.15.6:0/153130586 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe5806ac50 msgr2=0x7fbe580ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:04.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.303+0000 7fbe5d92c640 1 --2- 172.21.15.6:0/153130586 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe5806ac50 0x7fbe580ce0f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009d90 tx=0x7fbe5001c950 comp rx=0 tx=0).stop 2023-07-21T22:34:04.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.303+0000 7fbe5d92c640 1 -- 172.21.15.6:0/153130586 shutdown_connections 2023-07-21T22:34:04.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.303+0000 7fbe5d92c640 1 --2- 172.21.15.6:0/153130586 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe5806ac50 0x7fbe580ce0f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:04.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.303+0000 7fbe5d92c640 1 --2- 172.21.15.6:0/153130586 >> v2:172.21.15.6:3300/0 conn(0x7fbe5815f500 0x7fbe5806cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:04.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.303+0000 7fbe5d92c640 1 -- 172.21.15.6:0/153130586 >> 172.21.15.6:0/153130586 conn(0x7fbe580659d0 msgr2=0x7fbe58099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:04.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.303+0000 7fbe5d92c640 1 -- 172.21.15.6:0/153130586 shutdown_connections 2023-07-21T22:34:04.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.303+0000 7fbe5d92c640 1 -- 172.21.15.6:0/153130586 wait complete. 2023-07-21T22:34:04.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe5d92c640 1 Processor -- start 2023-07-21T22:34:04.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe5d92c640 1 -- start start 2023-07-21T22:34:04.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe5d92c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe5806ac50 0x7fbe58151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:04.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe5d92c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5806d430 0x7fbe580add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:04.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe5d92c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe5815f500 0x7fbe580ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:04.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe5d92c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe58157000 con 0x7fbe5806d430 2023-07-21T22:34:04.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe5d92c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe58156380 con 0x7fbe5806ac50 2023-07-21T22:34:04.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe5d92c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe58156660 con 0x7fbe5815f500 2023-07-21T22:34:04.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe4ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5806d430 0x7fbe580add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:04.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe4ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5806d430 0x7fbe580add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42796/0 (socket says 172.21.15.6:42796) 2023-07-21T22:34:04.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe4ffff640 1 -- 172.21.15.6:0/3441751448 learned_addr learned my addr 172.21.15.6:0/3441751448 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:04.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe577fe640 1 --2- 172.21.15.6:0/3441751448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe5815f500 0x7fbe580ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:04.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe56ffd640 1 --2- 172.21.15.6:0/3441751448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe5806ac50 0x7fbe58151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:04.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe4ffff640 1 -- 172.21.15.6:0/3441751448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe5815f500 msgr2=0x7fbe580ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:04.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe4ffff640 1 --2- 172.21.15.6:0/3441751448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe5815f500 0x7fbe580ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:04.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe4ffff640 1 -- 172.21.15.6:0/3441751448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe5806ac50 msgr2=0x7fbe58151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:04.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe4ffff640 1 --2- 172.21.15.6:0/3441751448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe5806ac50 0x7fbe58151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:04.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe4ffff640 1 -- 172.21.15.6:0/3441751448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe480093b0 con 0x7fbe5806d430 2023-07-21T22:34:04.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe577fe640 1 --2- 172.21.15.6:0/3441751448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe5815f500 0x7fbe580ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:04.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe4ffff640 1 --2- 172.21.15.6:0/3441751448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5806d430 0x7fbe580add80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000c420 tx=0x7fbe4000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:04.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe54ff9640 1 -- 172.21.15.6:0/3441751448 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe40005cf0 con 0x7fbe5806d430 2023-07-21T22:34:04.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe54ff9640 1 -- 172.21.15.6:0/3441751448 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe40005e70 con 0x7fbe5806d430 2023-07-21T22:34:04.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe54ff9640 1 -- 172.21.15.6:0/3441751448 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe400072f0 con 0x7fbe5806d430 2023-07-21T22:34:04.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe5d92c640 1 -- 172.21.15.6:0/3441751448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe50009a70 con 0x7fbe5806d430 2023-07-21T22:34:04.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.307+0000 7fbe5d92c640 1 -- 172.21.15.6:0/3441751448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe58156c20 con 0x7fbe5806d430 2023-07-21T22:34:04.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.311+0000 7fbe5d92c640 1 -- 172.21.15.6:0/3441751448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe58157140 con 0x7fbe5806d430 2023-07-21T22:34:04.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.311+0000 7fbe54ff9640 1 -- 172.21.15.6:0/3441751448 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fbe40007450 con 0x7fbe5806d430 2023-07-21T22:34:04.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.311+0000 7fbe54ff9640 1 --2- 172.21.15.6:0/3441751448 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7fbe380663d0 0x7fbe38068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:04.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.311+0000 7fbe54ff9640 1 -- 172.21.15.6:0/3441751448 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6508+0+0 (secure 0 0 0) 0x7fbe40083620 con 0x7fbe5806d430 2023-07-21T22:34:04.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.311+0000 7fbe56ffd640 1 -- 172.21.15.6:0/3441751448 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7fbe380663d0 msgr2=0x7fbe38068880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/582015960 2023-07-21T22:34:04.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.311+0000 7fbe56ffd640 1 --2- 172.21.15.6:0/3441751448 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7fbe380663d0 0x7fbe38068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:04.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.319+0000 7fbe54ff9640 1 -- 172.21.15.6:0/3441751448 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbe58157140 con 0x7fbe5806d430 2023-07-21T22:34:04.513 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:04.469+0000 7ff073a4a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:34:04.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.479+0000 7fbe5d92c640 1 -- 172.21.15.6:0/3441751448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe58157140 con 0x7fbe5806d430 2023-07-21T22:34:04.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.479+0000 7fbe54ff9640 1 -- 172.21.15.6:0/3441751448 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+18896 (secure 0 0 0) 0x7fbe58157140 con 0x7fbe5806d430 2023-07-21T22:34:04.530 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:04.530 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":70,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:33:19.805166+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:31:59.449200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-21T22:32:00.321692+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.17","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/4288088570":"2023-07-22T22:32:18.530764+0000","172.21.15.161:0/3254934176":"2023-07-22T22:32:18.530764+0000","172.21.15.161:0/2578585244":"2023-07-22T22:32:18.530764+0000","172.21.15.161:0/1830979956":"2023-07-22T22:32:18.530764+0000","172.21.15.161:0/4294109256":"2023-07-22T22:32:18.530764+0000","172.21.15.161:0/986370314":"2023-07-22T22:32:18.530764+0000","172.21.15.161:6833/3740183048":"2023-07-22T22:32:18.530764+0000","172.21.15.161:6832/3740183048":"2023-07-22T22:32:18.530764+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:34:04.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.483+0000 7fbe5d92c640 1 -- 172.21.15.6:0/3441751448 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7fbe380663d0 msgr2=0x7fbe38068880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:34:04.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.483+0000 7fbe5d92c640 1 --2- 172.21.15.6:0/3441751448 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7fbe380663d0 0x7fbe38068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:04.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.483+0000 7fbe5d92c640 1 -- 172.21.15.6:0/3441751448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5806d430 msgr2=0x7fbe580add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:04.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.483+0000 7fbe5d92c640 1 --2- 172.21.15.6:0/3441751448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5806d430 0x7fbe580add80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fbe4000c420 tx=0x7fbe4000c8e0 comp rx=0 tx=0).stop 2023-07-21T22:34:04.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.483+0000 7fbe5d92c640 1 -- 172.21.15.6:0/3441751448 shutdown_connections 2023-07-21T22:34:04.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.483+0000 7fbe5d92c640 1 --2- 172.21.15.6:0/3441751448 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7fbe380663d0 0x7fbe38068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:04.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.483+0000 7fbe5d92c640 1 --2- 172.21.15.6:0/3441751448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe5815f500 0x7fbe580ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:04.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.483+0000 7fbe5d92c640 1 --2- 172.21.15.6:0/3441751448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe5806d430 0x7fbe580add80 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:04.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.483+0000 7fbe5d92c640 1 --2- 172.21.15.6:0/3441751448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe5806ac50 0x7fbe58151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:04.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.483+0000 7fbe5d92c640 1 -- 172.21.15.6:0/3441751448 >> 172.21.15.6:0/3441751448 conn(0x7fbe580659d0 msgr2=0x7fbe5815e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:04.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.483+0000 7fbe5d92c640 1 -- 172.21.15.6:0/3441751448 shutdown_connections 2023-07-21T22:34:04.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.483+0000 7fbe5d92c640 1 -- 172.21.15.6:0/3441751448 wait complete. 2023-07-21T22:34:04.543 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:04.495+0000 7fa2c0213180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:34:04.552 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:31:59.449200+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:32:00.321692+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:34:04.553 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:34:04.662 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:04.617+0000 7ff073a4a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:34:04.702 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:04.651+0000 7fa2c0213180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:34:04.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.655+0000 7f9408340640 1 Processor -- start 2023-07-21T22:34:04.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.655+0000 7f9408340640 1 -- start start 2023-07-21T22:34:04.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.655+0000 7f9408340640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94000d2300 0x7f94000d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:04.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.655+0000 7f9408340640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94000b04c0 con 0x7f940015bde0 2023-07-21T22:34:04.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.655+0000 7f9408340640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94000b1060 con 0x7f94000d2fc0 2023-07-21T22:34:04.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.655+0000 7f9408340640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f940015c1b0 con 0x7f94000d2300 2023-07-21T22:34:04.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.655+0000 7f94068dd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94000d2300 0x7f94000d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:04.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.655+0000 7f94060dc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f940015bde0 0x7f94000d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38932/0 (socket says 172.21.15.6:38932) 2023-07-21T22:34:04.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.655+0000 7f94060dc640 1 -- 172.21.15.6:0/3948059281 learned_addr learned my addr 172.21.15.6:0/3948059281 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:04.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.655+0000 7f94068dd640 1 -- 172.21.15.6:0/3948059281 >> v1:172.21.15.161:6789/0 conn(0x7f94000d2fc0 legacy=0x7f94000b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:04.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.655+0000 7f94068dd640 1 -- 172.21.15.6:0/3948059281 >> v1:172.21.15.6:6789/0 conn(0x7f940015bde0 legacy=0x7f94000d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:04.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.655+0000 7f94068dd640 1 -- 172.21.15.6:0/3948059281 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94000d2c80 con 0x7f94000d2300 2023-07-21T22:34:04.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.655+0000 7f94050da640 1 -- 172.21.15.6:0/3948059281 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492429540 0 0) 0x7f94000b04c0 con 0x7f940015bde0 2023-07-21T22:34:04.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.659+0000 7f94068dd640 1 --2- 172.21.15.6:0/3948059281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94000d2300 0x7f94000d2740 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f93f8009d90 tx=0x7f93f801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6fc5cc6a893e9f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:04.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.659+0000 7f94050da640 1 -- 172.21.15.6:0/3948059281 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f80a5920 con 0x7f94000d2300 2023-07-21T22:34:04.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.659+0000 7f94050da640 1 -- 172.21.15.6:0/3948059281 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f80a5a80 con 0x7f94000d2300 2023-07-21T22:34:04.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.659+0000 7f94050da640 1 -- 172.21.15.6:0/3948059281 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f80a5e10 con 0x7f94000d2300 2023-07-21T22:34:04.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.659+0000 7f9408340640 1 -- 172.21.15.6:0/3948059281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94000d2300 msgr2=0x7f94000d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:04.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.659+0000 7f9408340640 1 --2- 172.21.15.6:0/3948059281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94000d2300 0x7f94000d2740 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f93f8009d90 tx=0x7f93f801c950 comp rx=0 tx=0).stop 2023-07-21T22:34:04.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.659+0000 7f9408340640 1 -- 172.21.15.6:0/3948059281 shutdown_connections 2023-07-21T22:34:04.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.659+0000 7f9408340640 1 --2- 172.21.15.6:0/3948059281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94000d2300 0x7f94000d2740 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:04.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.659+0000 7f9408340640 1 -- 172.21.15.6:0/3948059281 >> 172.21.15.6:0/3948059281 conn(0x7f94000659d0 msgr2=0x7f940009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:04.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.659+0000 7f9408340640 1 -- 172.21.15.6:0/3948059281 shutdown_connections 2023-07-21T22:34:04.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.659+0000 7f9408340640 1 -- 172.21.15.6:0/3948059281 wait complete. 2023-07-21T22:34:04.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f9408340640 1 Processor -- start 2023-07-21T22:34:04.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f9408340640 1 -- start start 2023-07-21T22:34:04.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f9408340640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94000d2300 0x7f9400156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:04.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f9408340640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94000d2fc0 0x7f94000cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:04.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f9408340640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f940015bde0 0x7f94000cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:04.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f9408340640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94000c6e00 con 0x7f940015bde0 2023-07-21T22:34:04.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f9408340640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94000c5ea0 con 0x7f94000d2300 2023-07-21T22:34:04.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f9408340640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94000c6180 con 0x7f94000d2fc0 2023-07-21T22:34:04.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f94068dd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f940015bde0 0x7f94000cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:04.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f94068dd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f940015bde0 0x7f94000cb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42808/0 (socket says 172.21.15.6:42808) 2023-07-21T22:34:04.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f94068dd640 1 -- 172.21.15.6:0/3765761435 learned_addr learned my addr 172.21.15.6:0/3765761435 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:04.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f94060dc640 1 --2- 172.21.15.6:0/3765761435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94000d2300 0x7f9400156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:04.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f94058db640 1 --2- 172.21.15.6:0/3765761435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94000d2fc0 0x7f94000cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:04.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f94068dd640 1 -- 172.21.15.6:0/3765761435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94000d2fc0 msgr2=0x7f94000cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:04.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f94068dd640 1 --2- 172.21.15.6:0/3765761435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94000d2fc0 0x7f94000cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:04.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f94068dd640 1 -- 172.21.15.6:0/3765761435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94000d2300 msgr2=0x7f9400156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:04.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f94068dd640 1 --2- 172.21.15.6:0/3765761435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94000d2300 0x7f9400156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:04.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f94068dd640 1 -- 172.21.15.6:0/3765761435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f8009a70 con 0x7f940015bde0 2023-07-21T22:34:04.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f94068dd640 1 --2- 172.21.15.6:0/3765761435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f940015bde0 0x7f94000cb840 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f93f801a580 tx=0x7f93f80196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:04.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f93f6ffd640 1 -- 172.21.15.6:0/3765761435 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f80ade40 con 0x7f940015bde0 2023-07-21T22:34:04.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f93f6ffd640 1 -- 172.21.15.6:0/3765761435 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f80b7410 con 0x7f940015bde0 2023-07-21T22:34:04.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f93f6ffd640 1 -- 172.21.15.6:0/3765761435 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f80b77a0 con 0x7f940015bde0 2023-07-21T22:34:04.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f9408340640 1 -- 172.21.15.6:0/3765761435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94000c6460 con 0x7f940015bde0 2023-07-21T22:34:04.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.663+0000 7f9408340640 1 -- 172.21.15.6:0/3765761435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94000c6a20 con 0x7f940015bde0 2023-07-21T22:34:04.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.667+0000 7f9408340640 1 -- 172.21.15.6:0/3765761435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94000c6f40 con 0x7f940015bde0 2023-07-21T22:34:04.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.667+0000 7f93f6ffd640 1 -- 172.21.15.6:0/3765761435 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f93f80b4050 con 0x7f940015bde0 2023-07-21T22:34:04.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.667+0000 7f93f6ffd640 1 --2- 172.21.15.6:0/3765761435 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f93e40663a0 0x7f93e4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:04.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.667+0000 7f93f6ffd640 1 -- 172.21.15.6:0/3765761435 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6508+0+0 (secure 0 0 0) 0x7f93f811f370 con 0x7f940015bde0 2023-07-21T22:34:04.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.667+0000 7f94060dc640 1 -- 172.21.15.6:0/3765761435 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f93e40663a0 msgr2=0x7f93e4068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/582015960 2023-07-21T22:34:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.667+0000 7f94060dc640 1 --2- 172.21.15.6:0/3765761435 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f93e40663a0 0x7f93e4068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:04.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.675+0000 7f93f6ffd640 1 -- 172.21.15.6:0/3765761435 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f94000c6f40 con 0x7f940015bde0 2023-07-21T22:34:04.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.831+0000 7f9408340640 1 -- 172.21.15.6:0/3765761435 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f94000c6f40 con 0x7f940015bde0 2023-07-21T22:34:04.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.831+0000 7f93f6ffd640 1 -- 172.21.15.6:0/3765761435 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) v1 ==== 93+0+10 (secure 0 0 0) 0x7f94000c6f40 con 0x7f940015bde0 2023-07-21T22:34:04.882 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:34:04.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.835+0000 7f9408340640 1 -- 172.21.15.6:0/3765761435 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f93e40663a0 msgr2=0x7f93e4068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:34:04.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.835+0000 7f9408340640 1 --2- 172.21.15.6:0/3765761435 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f93e40663a0 0x7f93e4068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:04.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.835+0000 7f9408340640 1 -- 172.21.15.6:0/3765761435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f940015bde0 msgr2=0x7f94000cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:04.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.835+0000 7f9408340640 1 --2- 172.21.15.6:0/3765761435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f940015bde0 0x7f94000cb840 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f93f801a580 tx=0x7f93f80196f0 comp rx=0 tx=0).stop 2023-07-21T22:34:04.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.835+0000 7f9408340640 1 -- 172.21.15.6:0/3765761435 shutdown_connections 2023-07-21T22:34:04.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.835+0000 7f9408340640 1 --2- 172.21.15.6:0/3765761435 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f93e40663a0 0x7f93e4068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:04.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.835+0000 7f9408340640 1 --2- 172.21.15.6:0/3765761435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f940015bde0 0x7f94000cb840 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:04.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.835+0000 7f9408340640 1 --2- 172.21.15.6:0/3765761435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94000d2fc0 0x7f94000cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:04.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.835+0000 7f9408340640 1 --2- 172.21.15.6:0/3765761435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94000d2300 0x7f9400156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:04.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.835+0000 7f9408340640 1 -- 172.21.15.6:0/3765761435 >> 172.21.15.6:0/3765761435 conn(0x7f94000659d0 msgr2=0x7f940015ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:04.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.835+0000 7f9408340640 1 -- 172.21.15.6:0/3765761435 shutdown_connections 2023-07-21T22:34:04.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:04.835+0000 7f9408340640 1 -- 172.21.15.6:0/3765761435 wait complete. 2023-07-21T22:34:04.904 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:34:05.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.007+0000 7ff3a5b9d640 1 Processor -- start 2023-07-21T22:34:05.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.007+0000 7ff3a5b9d640 1 -- start start 2023-07-21T22:34:05.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.007+0000 7ff3a5b9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3a015bde0 0x7ff3a00d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:05.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.007+0000 7ff3a5b9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff3a00d2fc0 0x7ff3a00b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:05.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.007+0000 7ff3a5b9d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a00b04c0 con 0x7ff3a00d2300 2023-07-21T22:34:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.007+0000 7ff3a5b9d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a015c1b0 con 0x7ff3a00d2fc0 2023-07-21T22:34:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.007+0000 7ff3a5b9d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a00d0aa0 con 0x7ff3a015bde0 2023-07-21T22:34:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.007+0000 7ff39ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff3a00d2300 0x7ff3a00cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38940/0 (socket says 172.21.15.6:38940) 2023-07-21T22:34:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.007+0000 7ff39ffff640 1 -- 172.21.15.6:0/919354488 learned_addr learned my addr 172.21.15.6:0/919354488 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.007+0000 7ff39effd640 1 --2- 172.21.15.6:0/919354488 >> v2:172.21.15.161:3300/0 conn(0x7ff3a00d2fc0 0x7ff3a00b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.007+0000 7ff39f7fe640 1 --2- 172.21.15.6:0/919354488 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3a015bde0 0x7ff3a00d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.007+0000 7ff39e7fc640 1 -- 172.21.15.6:0/919354488 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886089263 0 0) 0x7ff3a00b04c0 con 0x7ff3a00d2300 2023-07-21T22:34:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.007+0000 7ff39e7fc640 1 -- 172.21.15.6:0/919354488 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff388003530 con 0x7ff3a00d2300 2023-07-21T22:34:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.007+0000 7ff39effd640 1 -- 172.21.15.6:0/919354488 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3a015bde0 msgr2=0x7ff3a00d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.007+0000 7ff39effd640 1 --2- 172.21.15.6:0/919354488 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3a015bde0 0x7ff3a00d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.007+0000 7ff39effd640 1 -- 172.21.15.6:0/919354488 >> v1:172.21.15.6:6789/0 conn(0x7ff3a00d2300 legacy=0x7ff3a00cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.007+0000 7ff39effd640 1 -- 172.21.15.6:0/919354488 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a00afb90 con 0x7ff3a00d2fc0 2023-07-21T22:34:05.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.011+0000 7ff39effd640 1 --2- 172.21.15.6:0/919354488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3a00d2fc0 0x7ff3a00b0950 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff3940097c0 tx=0x7ff39401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c33ac26a807c0b08 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:05.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.011+0000 7ff39e7fc640 1 -- 172.21.15.6:0/919354488 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3940ab680 con 0x7ff3a00d2fc0 2023-07-21T22:34:05.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.011+0000 7ff39e7fc640 1 -- 172.21.15.6:0/919354488 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3940ab7e0 con 0x7ff3a00d2fc0 2023-07-21T22:34:05.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.011+0000 7ff39e7fc640 1 -- 172.21.15.6:0/919354488 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3940abb70 con 0x7ff3a00d2fc0 2023-07-21T22:34:05.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.011+0000 7ff3a5b9d640 1 -- 172.21.15.6:0/919354488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3a00d2fc0 msgr2=0x7ff3a00b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:05.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.011+0000 7ff3a5b9d640 1 --2- 172.21.15.6:0/919354488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3a00d2fc0 0x7ff3a00b0950 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff3940097c0 tx=0x7ff39401c480 comp rx=0 tx=0).stop 2023-07-21T22:34:05.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.011+0000 7ff3a5b9d640 1 -- 172.21.15.6:0/919354488 shutdown_connections 2023-07-21T22:34:05.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.011+0000 7ff3a5b9d640 1 --2- 172.21.15.6:0/919354488 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3a00d2fc0 0x7ff3a00b0950 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.011+0000 7ff3a5b9d640 1 --2- 172.21.15.6:0/919354488 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3a015bde0 0x7ff3a00d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.011+0000 7ff3a5b9d640 1 -- 172.21.15.6:0/919354488 >> 172.21.15.6:0/919354488 conn(0x7ff3a00659d0 msgr2=0x7ff3a009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:05.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.011+0000 7ff3a5b9d640 1 -- 172.21.15.6:0/919354488 shutdown_connections 2023-07-21T22:34:05.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.011+0000 7ff3a5b9d640 1 -- 172.21.15.6:0/919354488 wait complete. 2023-07-21T22:34:05.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff3a5b9d640 1 Processor -- start 2023-07-21T22:34:05.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff3a5b9d640 1 -- start start 2023-07-21T22:34:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff3a5b9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3a00d2300 0x7ff3a0155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff3a5b9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3a00d2fc0 0x7ff3a0159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff3a5b9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a015bde0 0x7ff3a0159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff3a5b9d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a015d360 con 0x7ff3a015bde0 2023-07-21T22:34:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff3a5b9d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a015d640 con 0x7ff3a00d2fc0 2023-07-21T22:34:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff3a5b9d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a015d920 con 0x7ff3a00d2300 2023-07-21T22:34:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff39ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a015bde0 0x7ff3a0159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff39ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a015bde0 0x7ff3a0159d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42820/0 (socket says 172.21.15.6:42820) 2023-07-21T22:34:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff39ffff640 1 -- 172.21.15.6:0/1776940830 learned_addr learned my addr 172.21.15.6:0/1776940830 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff39effd640 1 --2- 172.21.15.6:0/1776940830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3a00d2fc0 0x7ff3a0159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff39f7fe640 1 --2- 172.21.15.6:0/1776940830 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3a00d2300 0x7ff3a0155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff39ffff640 1 -- 172.21.15.6:0/1776940830 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3a00d2300 msgr2=0x7ff3a0155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff39ffff640 1 --2- 172.21.15.6:0/1776940830 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3a00d2300 0x7ff3a0155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff39ffff640 1 -- 172.21.15.6:0/1776940830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3a00d2fc0 msgr2=0x7ff3a0159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:05.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff39ffff640 1 --2- 172.21.15.6:0/1776940830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3a00d2fc0 0x7ff3a0159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff39ffff640 1 -- 172.21.15.6:0/1776940830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff394009420 con 0x7ff3a015bde0 2023-07-21T22:34:05.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff39ffff640 1 --2- 172.21.15.6:0/1776940830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a015bde0 0x7ff3a0159d40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff39800caa0 tx=0x7ff39800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:05.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff387fff640 1 -- 172.21.15.6:0/1776940830 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39800ac00 con 0x7ff3a015bde0 2023-07-21T22:34:05.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff387fff640 1 -- 172.21.15.6:0/1776940830 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39800ad60 con 0x7ff3a015bde0 2023-07-21T22:34:05.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff3a5b9d640 1 -- 172.21.15.6:0/1776940830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a015dc00 con 0x7ff3a015bde0 2023-07-21T22:34:05.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff387fff640 1 -- 172.21.15.6:0/1776940830 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff398012620 con 0x7ff3a015bde0 2023-07-21T22:34:05.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff3a5b9d640 1 -- 172.21.15.6:0/1776940830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a015e400 con 0x7ff3a015bde0 2023-07-21T22:34:05.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.015+0000 7ff3a5b9d640 1 -- 172.21.15.6:0/1776940830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a00678d0 con 0x7ff3a015bde0 2023-07-21T22:34:05.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.019+0000 7ff387fff640 1 -- 172.21.15.6:0/1776940830 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) v1 ==== 85772+0+0 (secure 0 0 0) 0x7ff398007070 con 0x7ff3a015bde0 2023-07-21T22:34:05.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.019+0000 7ff387fff640 1 --2- 172.21.15.6:0/1776940830 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7ff38c0663a0 0x7ff38c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:05.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.019+0000 7ff387fff640 1 -- 172.21.15.6:0/1776940830 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6508+0+0 (secure 0 0 0) 0x7ff398084060 con 0x7ff3a015bde0 2023-07-21T22:34:05.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.019+0000 7ff39f7fe640 1 -- 172.21.15.6:0/1776940830 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7ff38c0663a0 msgr2=0x7ff38c068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/582015960 2023-07-21T22:34:05.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.019+0000 7ff39f7fe640 1 --2- 172.21.15.6:0/1776940830 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7ff38c0663a0 0x7ff38c068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:05.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.023+0000 7ff387fff640 1 -- 172.21.15.6:0/1776940830 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff3980b4700 con 0x7ff3a015bde0 2023-07-21T22:34:05.142 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:05.097+0000 7ff073a4a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:34:05.200 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:05.153+0000 7ff073a4a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:34:05.223 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:05.175+0000 7fa2c0213180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:34:05.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.179+0000 7ff3a5b9d640 1 -- 172.21.15.6:0/1776940830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff3a008ad20 con 0x7ff3a015bde0 2023-07-21T22:34:05.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.183+0000 7ff387fff640 1 -- 172.21.15.6:0/1776940830 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v70) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff3980170a0 con 0x7ff3a015bde0 2023-07-21T22:34:05.231 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:34:05.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.183+0000 7ff3a5b9d640 1 -- 172.21.15.6:0/1776940830 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7ff38c0663a0 msgr2=0x7ff38c068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:34:05.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.183+0000 7ff3a5b9d640 1 --2- 172.21.15.6:0/1776940830 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7ff38c0663a0 0x7ff38c068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.183+0000 7ff3a5b9d640 1 -- 172.21.15.6:0/1776940830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a015bde0 msgr2=0x7ff3a0159d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:05.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.183+0000 7ff3a5b9d640 1 --2- 172.21.15.6:0/1776940830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a015bde0 0x7ff3a0159d40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff39800caa0 tx=0x7ff39800cf60 comp rx=0 tx=0).stop 2023-07-21T22:34:05.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.183+0000 7ff3a5b9d640 1 -- 172.21.15.6:0/1776940830 shutdown_connections 2023-07-21T22:34:05.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.183+0000 7ff3a5b9d640 1 --2- 172.21.15.6:0/1776940830 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7ff38c0663a0 0x7ff38c068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.183+0000 7ff3a5b9d640 1 --2- 172.21.15.6:0/1776940830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a015bde0 0x7ff3a0159d40 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.183+0000 7ff3a5b9d640 1 --2- 172.21.15.6:0/1776940830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff3a00d2fc0 0x7ff3a0159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.183+0000 7ff3a5b9d640 1 --2- 172.21.15.6:0/1776940830 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff3a00d2300 0x7ff3a0155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.183+0000 7ff3a5b9d640 1 -- 172.21.15.6:0/1776940830 >> 172.21.15.6:0/1776940830 conn(0x7ff3a00659d0 msgr2=0x7ff3a015b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:05.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.183+0000 7ff3a5b9d640 1 -- 172.21.15.6:0/1776940830 shutdown_connections 2023-07-21T22:34:05.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.183+0000 7ff3a5b9d640 1 -- 172.21.15.6:0/1776940830 wait complete. 2023-07-21T22:34:05.253 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:34:05.255 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:05.209+0000 7ff073a4a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:34:05.288 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:05.239+0000 7fa2c0213180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:34:05.339 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:05.293+0000 7ff073a4a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:34:05.348 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:05.299+0000 7fa2c0213180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:34:05.397 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:05.353+0000 7ff073a4a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:34:05.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.355+0000 7f2059096640 1 Processor -- start 2023-07-21T22:34:05.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.355+0000 7f2059096640 1 -- start start 2023-07-21T22:34:05.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.359+0000 7f2059096640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f20540d2fc0 0x7f20540b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:05.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.359+0000 7f2059096640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20540d2300 0x7f20540d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:05.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.359+0000 7f2059096640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20540b04c0 con 0x7f205415bde0 2023-07-21T22:34:05.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.359+0000 7f2059096640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f205415c1b0 con 0x7f20540d2fc0 2023-07-21T22:34:05.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.359+0000 7f2059096640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20540d2cc0 con 0x7f20540d2300 2023-07-21T22:34:05.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.359+0000 7f204bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f20540d2fc0 0x7f20540b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:05.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.359+0000 7f2052d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f205415bde0 0x7f20540d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38954/0 (socket says 172.21.15.6:38954) 2023-07-21T22:34:05.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.359+0000 7f2052d9d640 1 -- 172.21.15.6:0/61046417 learned_addr learned my addr 172.21.15.6:0/61046417 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:05.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.359+0000 7f205359e640 1 --2- 172.21.15.6:0/61046417 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20540d2300 0x7f20540d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:05.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.359+0000 7f204bfff640 1 -- 172.21.15.6:0/61046417 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20540d2300 msgr2=0x7f20540d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:05.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.359+0000 7f204bfff640 1 --2- 172.21.15.6:0/61046417 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20540d2300 0x7f20540d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.359+0000 7f204bfff640 1 -- 172.21.15.6:0/61046417 >> v1:172.21.15.6:6789/0 conn(0x7f205415bde0 legacy=0x7f20540d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:05.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.359+0000 7f204bfff640 1 -- 172.21.15.6:0/61046417 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20540d0aa0 con 0x7f20540d2fc0 2023-07-21T22:34:05.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.359+0000 7f205259c640 1 -- 172.21.15.6:0/61046417 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2858036182 0 0) 0x7f20540b04c0 con 0x7f205415bde0 2023-07-21T22:34:05.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.363+0000 7f204bfff640 1 --2- 172.21.15.6:0/61046417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20540d2fc0 0x7f20540b0950 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f203c0097c0 tx=0x7f203c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ef8e9d453b2cac server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:05.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.363+0000 7f205259c640 1 -- 172.21.15.6:0/61046417 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c0ab680 con 0x7f20540d2fc0 2023-07-21T22:34:05.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.363+0000 7f205259c640 1 -- 172.21.15.6:0/61046417 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c0ab7e0 con 0x7f20540d2fc0 2023-07-21T22:34:05.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.363+0000 7f205259c640 1 -- 172.21.15.6:0/61046417 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c0abb70 con 0x7f20540d2fc0 2023-07-21T22:34:05.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.363+0000 7f2059096640 1 -- 172.21.15.6:0/61046417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20540d2fc0 msgr2=0x7f20540b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:05.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.363+0000 7f2059096640 1 --2- 172.21.15.6:0/61046417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20540d2fc0 0x7f20540b0950 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f203c0097c0 tx=0x7f203c01c480 comp rx=0 tx=0).stop 2023-07-21T22:34:05.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.363+0000 7f2059096640 1 -- 172.21.15.6:0/61046417 shutdown_connections 2023-07-21T22:34:05.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.363+0000 7f2059096640 1 --2- 172.21.15.6:0/61046417 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20540d2300 0x7f20540d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.363+0000 7f2059096640 1 --2- 172.21.15.6:0/61046417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20540d2fc0 0x7f20540b0950 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.363+0000 7f2059096640 1 -- 172.21.15.6:0/61046417 >> 172.21.15.6:0/61046417 conn(0x7f20540659d0 msgr2=0x7f205409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:05.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.363+0000 7f2059096640 1 -- 172.21.15.6:0/61046417 shutdown_connections 2023-07-21T22:34:05.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.363+0000 7f2059096640 1 -- 172.21.15.6:0/61046417 wait complete. 2023-07-21T22:34:05.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f2059096640 1 Processor -- start 2023-07-21T22:34:05.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f2059096640 1 -- start start 2023-07-21T22:34:05.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f2059096640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20540d2300 0x7f20541532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:05.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f2059096640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20540d2fc0 0x7f2054141cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:05.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f2059096640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f205415bde0 0x7f2054152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:05.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f2059096640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2054142200 con 0x7f20540d2fc0 2023-07-21T22:34:05.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f2059096640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2054153950 con 0x7f20540d2300 2023-07-21T22:34:05.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f2059096640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2054153c30 con 0x7f205415bde0 2023-07-21T22:34:05.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f204bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20540d2fc0 0x7f2054141cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:05.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f204bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20540d2fc0 0x7f2054141cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42848/0 (socket says 172.21.15.6:42848) 2023-07-21T22:34:05.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f204bfff640 1 -- 172.21.15.6:0/64605183 learned_addr learned my addr 172.21.15.6:0/64605183 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:05.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f205359e640 1 --2- 172.21.15.6:0/64605183 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f205415bde0 0x7f2054152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:05.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f2052d9d640 1 --2- 172.21.15.6:0/64605183 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20540d2300 0x7f20541532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:05.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f204bfff640 1 -- 172.21.15.6:0/64605183 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f205415bde0 msgr2=0x7f2054152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:05.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f204bfff640 1 --2- 172.21.15.6:0/64605183 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f205415bde0 0x7f2054152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f204bfff640 1 -- 172.21.15.6:0/64605183 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20540d2300 msgr2=0x7f20541532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:05.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f204bfff640 1 --2- 172.21.15.6:0/64605183 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20540d2300 0x7f20541532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f204bfff640 1 -- 172.21.15.6:0/64605183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c009420 con 0x7f20540d2fc0 2023-07-21T22:34:05.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f204bfff640 1 --2- 172.21.15.6:0/64605183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20540d2fc0 0x7f2054141cc0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f203c01a0b0 tx=0x7f203c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:05.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f204b7fe640 1 -- 172.21.15.6:0/64605183 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c004220 con 0x7f20540d2fc0 2023-07-21T22:34:05.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f204b7fe640 1 -- 172.21.15.6:0/64605183 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203c0b9070 con 0x7f20540d2fc0 2023-07-21T22:34:05.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f204b7fe640 1 -- 172.21.15.6:0/64605183 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203c003620 con 0x7f20540d2fc0 2023-07-21T22:34:05.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f2059096640 1 -- 172.21.15.6:0/64605183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2054153f10 con 0x7f20540d2fc0 2023-07-21T22:34:05.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.367+0000 7f2059096640 1 -- 172.21.15.6:0/64605183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20541544d0 con 0x7f20540d2fc0 2023-07-21T22:34:05.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.371+0000 7f2059096640 1 -- 172.21.15.6:0/64605183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20540b6670 con 0x7f20540d2fc0 2023-07-21T22:34:05.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.371+0000 7f204b7fe640 1 -- 172.21.15.6:0/64605183 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f203c003780 con 0x7f20540d2fc0 2023-07-21T22:34:05.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.371+0000 7f204b7fe640 1 --2- 172.21.15.6:0/64605183 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f20340663a0 0x7f2034068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:05.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.371+0000 7f204b7fe640 1 -- 172.21.15.6:0/64605183 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6508+0+0 (secure 0 0 0) 0x7f203c0bb070 con 0x7f20540d2fc0 2023-07-21T22:34:05.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.371+0000 7f2052d9d640 1 -- 172.21.15.6:0/64605183 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f20340663a0 msgr2=0x7f2034068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/582015960 2023-07-21T22:34:05.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.371+0000 7f2052d9d640 1 --2- 172.21.15.6:0/64605183 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f20340663a0 0x7f2034068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:05.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.375+0000 7f204b7fe640 1 -- 172.21.15.6:0/64605183 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f203c0ebe50 con 0x7f20540d2fc0 2023-07-21T22:34:05.444 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:05.395+0000 7fa2c0213180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:34:05.480 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:05.437+0000 7ff073a4a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:34:05.504 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:05.455+0000 7fa2c0213180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:34:05.536 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:05.493+0000 7ff073a4a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:34:05.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.531+0000 7f2059096640 1 -- 172.21.15.6:0/64605183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2054153d70 con 0x7f20540d2fc0 2023-07-21T22:34:05.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.531+0000 7f204b7fe640 1 -- 172.21.15.6:0/64605183 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v70) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2054153d70 con 0x7f20540d2fc0 2023-07-21T22:34:05.582 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:34:05.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.535+0000 7f2059096640 1 -- 172.21.15.6:0/64605183 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f20340663a0 msgr2=0x7f2034068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:34:05.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.535+0000 7f2059096640 1 --2- 172.21.15.6:0/64605183 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f20340663a0 0x7f2034068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.535+0000 7f2059096640 1 -- 172.21.15.6:0/64605183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20540d2fc0 msgr2=0x7f2054141cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:05.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.535+0000 7f2059096640 1 --2- 172.21.15.6:0/64605183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20540d2fc0 0x7f2054141cc0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f203c01a0b0 tx=0x7f203c01acc0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.535+0000 7f2059096640 1 -- 172.21.15.6:0/64605183 shutdown_connections 2023-07-21T22:34:05.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.535+0000 7f2059096640 1 --2- 172.21.15.6:0/64605183 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f20340663a0 0x7f2034068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.535+0000 7f2059096640 1 --2- 172.21.15.6:0/64605183 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f205415bde0 0x7f2054152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.535+0000 7f2059096640 1 --2- 172.21.15.6:0/64605183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20540d2fc0 0x7f2054141cc0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.535+0000 7f2059096640 1 --2- 172.21.15.6:0/64605183 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20540d2300 0x7f20541532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.535+0000 7f2059096640 1 -- 172.21.15.6:0/64605183 >> 172.21.15.6:0/64605183 conn(0x7f20540659d0 msgr2=0x7f205415ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.535+0000 7f2059096640 1 -- 172.21.15.6:0/64605183 shutdown_connections 2023-07-21T22:34:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.535+0000 7f2059096640 1 -- 172.21.15.6:0/64605183 wait complete. 2023-07-21T22:34:05.594 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:05.543+0000 7fa2c0213180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:34:05.603 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:34:05.653 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:05.603+0000 7fa2c0213180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:34:05.677 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:05.633+0000 7ff073a4a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:34:05.734 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:05.689+0000 7ff073a4a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:34:05.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.743+0000 7fc554dd2640 1 Processor -- start 2023-07-21T22:34:05.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.743+0000 7fc554dd2640 1 -- start start 2023-07-21T22:34:05.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.747+0000 7fc554dd2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc55015bde0 0x7fc5500d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:05.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.747+0000 7fc554dd2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5500d2300 0x7fc5500d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:05.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.747+0000 7fc554dd2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5500b04c0 con 0x7fc5500d2fc0 2023-07-21T22:34:05.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.747+0000 7fc554dd2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc55015c1b0 con 0x7fc55015bde0 2023-07-21T22:34:05.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.747+0000 7fc554dd2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5500d2cc0 con 0x7fc5500d2300 2023-07-21T22:34:05.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.747+0000 7fc547fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc5500d2fc0 0x7fc5500b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38966/0 (socket says 172.21.15.6:38966) 2023-07-21T22:34:05.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.747+0000 7fc547fff640 1 -- 172.21.15.6:0/2872806538 learned_addr learned my addr 172.21.15.6:0/2872806538 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:05.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.747+0000 7fc54ed9d640 1 --2- 172.21.15.6:0/2872806538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5500d2300 0x7fc5500d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:05.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.747+0000 7fc54e59c640 1 --2- 172.21.15.6:0/2872806538 >> v2:172.21.15.161:3300/0 conn(0x7fc55015bde0 0x7fc5500d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:05.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.747+0000 7fc54dd9b640 1 -- 172.21.15.6:0/2872806538 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 368238701 0 0) 0x7fc5500b04c0 con 0x7fc5500d2fc0 2023-07-21T22:34:05.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.747+0000 7fc54dd9b640 1 -- 172.21.15.6:0/2872806538 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc53c003530 con 0x7fc5500d2fc0 2023-07-21T22:34:05.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.747+0000 7fc54ed9d640 1 -- 172.21.15.6:0/2872806538 >> v2:172.21.15.161:3300/0 conn(0x7fc55015bde0 msgr2=0x7fc5500d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:05.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.747+0000 7fc54ed9d640 1 --2- 172.21.15.6:0/2872806538 >> v2:172.21.15.161:3300/0 conn(0x7fc55015bde0 0x7fc5500d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.747+0000 7fc54ed9d640 1 -- 172.21.15.6:0/2872806538 >> v1:172.21.15.6:6789/0 conn(0x7fc5500d2fc0 legacy=0x7fc5500b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:05.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.747+0000 7fc54ed9d640 1 -- 172.21.15.6:0/2872806538 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5500b1060 con 0x7fc5500d2300 2023-07-21T22:34:05.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.747+0000 7fc54e59c640 1 --2- 172.21.15.6:0/2872806538 >> v2:172.21.15.161:3300/0 conn(0x7fc55015bde0 0x7fc5500d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:05.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.751+0000 7fc54ed9d640 1 --2- 172.21.15.6:0/2872806538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5500d2300 0x7fc5500d2780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc548009d90 tx=0x7fc54801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c60ba015b24aa259 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:05.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.751+0000 7fc54dd9b640 1 -- 172.21.15.6:0/2872806538 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5480a5920 con 0x7fc5500d2300 2023-07-21T22:34:05.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.751+0000 7fc54dd9b640 1 -- 172.21.15.6:0/2872806538 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5480a5a80 con 0x7fc5500d2300 2023-07-21T22:34:05.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.751+0000 7fc54dd9b640 1 -- 172.21.15.6:0/2872806538 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5480a5e10 con 0x7fc5500d2300 2023-07-21T22:34:05.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.751+0000 7fc554dd2640 1 -- 172.21.15.6:0/2872806538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5500d2300 msgr2=0x7fc5500d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:05.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.751+0000 7fc554dd2640 1 --2- 172.21.15.6:0/2872806538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5500d2300 0x7fc5500d2780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc548009d90 tx=0x7fc54801c950 comp rx=0 tx=0).stop 2023-07-21T22:34:05.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.751+0000 7fc554dd2640 1 -- 172.21.15.6:0/2872806538 shutdown_connections 2023-07-21T22:34:05.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.751+0000 7fc554dd2640 1 --2- 172.21.15.6:0/2872806538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5500d2300 0x7fc5500d2780 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.751+0000 7fc554dd2640 1 --2- 172.21.15.6:0/2872806538 >> v2:172.21.15.161:3300/0 conn(0x7fc55015bde0 0x7fc5500d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.751+0000 7fc554dd2640 1 -- 172.21.15.6:0/2872806538 >> 172.21.15.6:0/2872806538 conn(0x7fc5500659d0 msgr2=0x7fc55009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:05.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.751+0000 7fc554dd2640 1 -- 172.21.15.6:0/2872806538 shutdown_connections 2023-07-21T22:34:05.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.751+0000 7fc554dd2640 1 -- 172.21.15.6:0/2872806538 wait complete. 2023-07-21T22:34:05.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.751+0000 7fc554dd2640 1 Processor -- start 2023-07-21T22:34:05.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc554dd2640 1 -- start start 2023-07-21T22:34:05.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc554dd2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5500d2300 0x7fc550151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:05.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc554dd2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5500d2fc0 0x7fc550152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:05.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc554dd2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc55015bde0 0x7fc5500b6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:05.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc554dd2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc550152470 con 0x7fc5500d2fc0 2023-07-21T22:34:05.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc554dd2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5501529f0 con 0x7fc5500d2300 2023-07-21T22:34:05.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc554dd2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5501533c0 con 0x7fc55015bde0 2023-07-21T22:34:05.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc547fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5500d2fc0 0x7fc550152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:05.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc54e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5500d2300 0x7fc550151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:05.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc547fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5500d2fc0 0x7fc550152e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42860/0 (socket says 172.21.15.6:42860) 2023-07-21T22:34:05.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc547fff640 1 -- 172.21.15.6:0/1036530228 learned_addr learned my addr 172.21.15.6:0/1036530228 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:05.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc54ed9d640 1 --2- 172.21.15.6:0/1036530228 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc55015bde0 0x7fc5500b6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:05.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc54e59c640 1 -- 172.21.15.6:0/1036530228 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc55015bde0 msgr2=0x7fc5500b6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:05.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc54e59c640 1 --2- 172.21.15.6:0/1036530228 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc55015bde0 0x7fc5500b6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc54e59c640 1 -- 172.21.15.6:0/1036530228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5500d2fc0 msgr2=0x7fc550152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:05.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc54e59c640 1 --2- 172.21.15.6:0/1036530228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5500d2fc0 0x7fc550152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc54e59c640 1 -- 172.21.15.6:0/1036530228 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5400093b0 con 0x7fc5500d2300 2023-07-21T22:34:05.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc54e59c640 1 --2- 172.21.15.6:0/1036530228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5500d2300 0x7fc550151a80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc54000e900 tx=0x7fc54000edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:05.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc546ffd640 1 -- 172.21.15.6:0/1036530228 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54000ca00 con 0x7fc5500d2300 2023-07-21T22:34:05.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc546ffd640 1 -- 172.21.15.6:0/1036530228 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54000cb60 con 0x7fc5500d2300 2023-07-21T22:34:05.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc546ffd640 1 -- 172.21.15.6:0/1036530228 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5400059a0 con 0x7fc5500d2300 2023-07-21T22:34:05.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc554dd2640 1 -- 172.21.15.6:0/1036530228 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc548009a70 con 0x7fc5500d2300 2023-07-21T22:34:05.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc554dd2640 1 -- 172.21.15.6:0/1036530228 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5500b7640 con 0x7fc5500d2300 2023-07-21T22:34:05.808 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fa2c0213180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:34:05.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.755+0000 7fc554dd2640 1 -- 172.21.15.6:0/1036530228 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5500b7860 con 0x7fc5500d2300 2023-07-21T22:34:05.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.759+0000 7fc546ffd640 1 -- 172.21.15.6:0/1036530228 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 23) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fc540005b00 con 0x7fc5500d2300 2023-07-21T22:34:05.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.759+0000 7fc546ffd640 1 --2- 172.21.15.6:0/1036530228 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7fc5300663a0 0x7fc530068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:05.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.759+0000 7fc546ffd640 1 -- 172.21.15.6:0/1036530228 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6508+0+0 (secure 0 0 0) 0x7fc540084430 con 0x7fc5500d2300 2023-07-21T22:34:05.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.759+0000 7fc547fff640 1 -- 172.21.15.6:0/1036530228 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7fc5300663a0 msgr2=0x7fc530068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/582015960 2023-07-21T22:34:05.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.759+0000 7fc547fff640 1 --2- 172.21.15.6:0/1036530228 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7fc5300663a0 0x7fc530068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:05.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.763+0000 7fc546ffd640 1 -- 172.21.15.6:0/1036530228 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc5400515f0 con 0x7fc5500d2300 2023-07-21T22:34:05.868 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:05.819+0000 7fa2c0213180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:34:05.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.919+0000 7fc554dd2640 1 -- 172.21.15.6:0/1036530228 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc5500678d0 con 0x7fc5500d2300 2023-07-21T22:34:05.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.919+0000 7fc546ffd640 1 -- 172.21.15.6:0/1036530228 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v70) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc540054c10 con 0x7fc5500d2300 2023-07-21T22:34:05.968 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:34:05.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.919+0000 7fc554dd2640 1 -- 172.21.15.6:0/1036530228 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7fc5300663a0 msgr2=0x7fc530068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:34:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.919+0000 7fc554dd2640 1 --2- 172.21.15.6:0/1036530228 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7fc5300663a0 0x7fc530068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.919+0000 7fc554dd2640 1 -- 172.21.15.6:0/1036530228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5500d2300 msgr2=0x7fc550151a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.919+0000 7fc554dd2640 1 --2- 172.21.15.6:0/1036530228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5500d2300 0x7fc550151a80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc54000e900 tx=0x7fc54000edc0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.919+0000 7fc554dd2640 1 -- 172.21.15.6:0/1036530228 shutdown_connections 2023-07-21T22:34:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.919+0000 7fc554dd2640 1 --2- 172.21.15.6:0/1036530228 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7fc5300663a0 0x7fc530068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.919+0000 7fc554dd2640 1 --2- 172.21.15.6:0/1036530228 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc55015bde0 0x7fc5500b6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.919+0000 7fc554dd2640 1 --2- 172.21.15.6:0/1036530228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5500d2fc0 0x7fc550152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.919+0000 7fc554dd2640 1 --2- 172.21.15.6:0/1036530228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5500d2300 0x7fc550151a80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:05.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.919+0000 7fc554dd2640 1 -- 172.21.15.6:0/1036530228 >> 172.21.15.6:0/1036530228 conn(0x7fc5500659d0 msgr2=0x7fc5500cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:05.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.919+0000 7fc554dd2640 1 -- 172.21.15.6:0/1036530228 shutdown_connections 2023-07-21T22:34:05.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:05.919+0000 7fc554dd2640 1 -- 172.21.15.6:0/1036530228 wait complete. 2023-07-21T22:34:05.977 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:34:05.977 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:34:05.977 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:34:05.985 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:05.941+0000 7ff073a4a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:34:05.990 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:34:06.121 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:06.077+0000 7ff073a4a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:34:06.125 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:34:06.126 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:34:06.126 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:34:06.135 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:06.083+0000 7fa2c0213180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:34:06.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.175+0000 7fb0dd8d8640 1 Processor -- start 2023-07-21T22:34:06.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.175+0000 7fb0dd8d8640 1 -- start start 2023-07-21T22:34:06.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.175+0000 7fb0dd8d8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d8070b70 0x7fb0d8070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:06.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.175+0000 7fb0dd8d8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb0d806b1e0 0x7fb0d80c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:06.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.175+0000 7fb0dd8d8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d80cac70 con 0x7fb0d80c21f0 2023-07-21T22:34:06.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.175+0000 7fb0dd8d8640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d8071480 con 0x7fb0d806b1e0 2023-07-21T22:34:06.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.175+0000 7fb0dd8d8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d80ca060 con 0x7fb0d8070b70 2023-07-21T22:34:06.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.175+0000 7fb0cffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb0d806b1e0 0x7fb0d80c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:06.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.175+0000 7fb0d6ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d8070b70 0x7fb0d8070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:06.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.175+0000 7fb0cffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb0d806b1e0 0x7fb0d80c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:57098/0 (socket says 172.21.15.6:57098) 2023-07-21T22:34:06.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.175+0000 7fb0cffff640 1 -- 172.21.15.6:0/173635492 learned_addr learned my addr 172.21.15.6:0/173635492 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:06.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.175+0000 7fb0d77fe640 1 --1- 172.21.15.6:0/173635492 >> v1:172.21.15.161:6789/0 conn(0x7fb0d80c21f0 0x7fb0d80cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:46120/0 (socket says 172.21.15.6:46120) 2023-07-21T22:34:06.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.175+0000 7fb0d6ffd640 1 -- 172.21.15.6:0/173635492 >> v2:172.21.15.161:3300/0 conn(0x7fb0d806b1e0 msgr2=0x7fb0d80c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:06.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.175+0000 7fb0d6ffd640 1 --2- 172.21.15.6:0/173635492 >> v2:172.21.15.161:3300/0 conn(0x7fb0d806b1e0 0x7fb0d80c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:06.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.175+0000 7fb0d6ffd640 1 -- 172.21.15.6:0/173635492 >> v1:172.21.15.161:6789/0 conn(0x7fb0d80c21f0 legacy=0x7fb0d80cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:06.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.175+0000 7fb0d6ffd640 1 -- 172.21.15.6:0/173635492 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d80ca340 con 0x7fb0d8070b70 2023-07-21T22:34:06.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.179+0000 7fb0d6ffd640 1 --2- 172.21.15.6:0/173635492 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d8070b70 0x7fb0d8070f40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80097c0 tx=0x7fb0c801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c00fcd319a9ae04 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:06.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.179+0000 7fb0d67fc640 1 -- 172.21.15.6:0/173635492 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c80ac620 con 0x7fb0d8070b70 2023-07-21T22:34:06.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.179+0000 7fb0d67fc640 1 -- 172.21.15.6:0/173635492 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c80ac780 con 0x7fb0d8070b70 2023-07-21T22:34:06.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.179+0000 7fb0d67fc640 1 -- 172.21.15.6:0/173635492 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c80acb10 con 0x7fb0d8070b70 2023-07-21T22:34:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.179+0000 7fb0dd8d8640 1 -- 172.21.15.6:0/173635492 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d8070b70 msgr2=0x7fb0d8070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.179+0000 7fb0dd8d8640 1 --2- 172.21.15.6:0/173635492 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d8070b70 0x7fb0d8070f40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80097c0 tx=0x7fb0c801c3c0 comp rx=0 tx=0).stop 2023-07-21T22:34:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.179+0000 7fb0dd8d8640 1 -- 172.21.15.6:0/173635492 shutdown_connections 2023-07-21T22:34:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.179+0000 7fb0dd8d8640 1 --2- 172.21.15.6:0/173635492 >> v2:172.21.15.161:3300/0 conn(0x7fb0d806b1e0 0x7fb0d80c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.179+0000 7fb0dd8d8640 1 --2- 172.21.15.6:0/173635492 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d8070b70 0x7fb0d8070f40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.179+0000 7fb0dd8d8640 1 -- 172.21.15.6:0/173635492 >> 172.21.15.6:0/173635492 conn(0x7fb0d80afcf0 msgr2=0x7fb0d80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.179+0000 7fb0dd8d8640 1 -- 172.21.15.6:0/173635492 shutdown_connections 2023-07-21T22:34:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.179+0000 7fb0dd8d8640 1 -- 172.21.15.6:0/173635492 wait complete. 2023-07-21T22:34:06.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0dd8d8640 1 Processor -- start 2023-07-21T22:34:06.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0dd8d8640 1 -- start start 2023-07-21T22:34:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0dd8d8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d806b1e0 0x7fb0d81638e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0dd8d8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d8070b70 0x7fb0d80ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0dd8d8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0d80c21f0 0x7fb0d814dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0dd8d8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d80cd470 con 0x7fb0d80c21f0 2023-07-21T22:34:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0dd8d8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d81537b0 con 0x7fb0d806b1e0 2023-07-21T22:34:06.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0dd8d8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d8163fe0 con 0x7fb0d8070b70 2023-07-21T22:34:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0d77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0d80c21f0 0x7fb0d814dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0d6ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d806b1e0 0x7fb0d81638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0d6ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d806b1e0 0x7fb0d81638e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:57104/0 (socket says 172.21.15.6:57104) 2023-07-21T22:34:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0d6ffd640 1 -- 172.21.15.6:0/2933339125 learned_addr learned my addr 172.21.15.6:0/2933339125 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0cffff640 1 --2- 172.21.15.6:0/2933339125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d8070b70 0x7fb0d80ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0d6ffd640 1 -- 172.21.15.6:0/2933339125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d8070b70 msgr2=0x7fb0d80ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0d6ffd640 1 --2- 172.21.15.6:0/2933339125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d8070b70 0x7fb0d80ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0d6ffd640 1 -- 172.21.15.6:0/2933339125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0d80c21f0 msgr2=0x7fb0d814dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0d6ffd640 1 --2- 172.21.15.6:0/2933339125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0d80c21f0 0x7fb0d814dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0d6ffd640 1 -- 172.21.15.6:0/2933339125 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c8009420 con 0x7fb0d806b1e0 2023-07-21T22:34:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0d6ffd640 1 --2- 172.21.15.6:0/2933339125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d806b1e0 0x7fb0d81638e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80af040 tx=0x7fb0c801ac00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0d4ff9640 1 -- 172.21.15.6:0/2933339125 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c80b8450 con 0x7fb0d806b1e0 2023-07-21T22:34:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0d4ff9640 1 -- 172.21.15.6:0/2933339125 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c80b85d0 con 0x7fb0d806b1e0 2023-07-21T22:34:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0dd8d8640 1 -- 172.21.15.6:0/2933339125 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d8153a70 con 0x7fb0d806b1e0 2023-07-21T22:34:06.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0d4ff9640 1 -- 172.21.15.6:0/2933339125 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c80b8980 con 0x7fb0d806b1e0 2023-07-21T22:34:06.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0dd8d8640 1 -- 172.21.15.6:0/2933339125 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d8154030 con 0x7fb0d806b1e0 2023-07-21T22:34:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.183+0000 7fb0dd8d8640 1 -- 172.21.15.6:0/2933339125 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d80678d0 con 0x7fb0d806b1e0 2023-07-21T22:34:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.187+0000 7fb0d4ff9640 1 -- 172.21.15.6:0/2933339125 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 23) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fb0c80aa070 con 0x7fb0d806b1e0 2023-07-21T22:34:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.187+0000 7fb0d4ff9640 1 --2- 172.21.15.6:0/2933339125 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7fb0b80663f0 0x7fb0b80688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.187+0000 7fb0d4ff9640 1 -- 172.21.15.6:0/2933339125 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6508+0+0 (secure 0 0 0) 0x7fb0c811e670 con 0x7fb0d806b1e0 2023-07-21T22:34:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.187+0000 7fb0cffff640 1 -- 172.21.15.6:0/2933339125 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7fb0b80663f0 msgr2=0x7fb0b80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/582015960 2023-07-21T22:34:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.187+0000 7fb0cffff640 1 --2- 172.21.15.6:0/2933339125 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7fb0b80663f0 0x7fb0b80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:06.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.191+0000 7fb0d4ff9640 1 -- 172.21.15.6:0/2933339125 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0c80eb8c0 con 0x7fb0d806b1e0 2023-07-21T22:34:06.247 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:06.201+0000 7ff073a4a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:34:06.278 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:06.227+0000 7fa2c0213180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:34:06.317 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:06.273+0000 7ff073a4a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:34:06.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.359+0000 7fb0dd8d8640 1 -- 172.21.15.6:0/2933339125 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb0d8154220 con 0x7fb0d806b1e0 2023-07-21T22:34:06.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.359+0000 7fb0d4ff9640 1 -- 172.21.15.6:0/2933339125 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v70) v1 ==== 80+0+477 (secure 0 0 0) 0x7fb0c80eeee0 con 0x7fb0d806b1e0 2023-07-21T22:34:06.411 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/4288088570 2023-07-22T22:32:18.530764+0000 2023-07-21T22:34:06.411 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/3254934176 2023-07-22T22:32:18.530764+0000 2023-07-21T22:34:06.411 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/2578585244 2023-07-22T22:32:18.530764+0000 2023-07-21T22:34:06.412 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/1830979956 2023-07-22T22:32:18.530764+0000 2023-07-21T22:34:06.412 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/4294109256 2023-07-22T22:32:18.530764+0000 2023-07-21T22:34:06.412 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/986370314 2023-07-22T22:32:18.530764+0000 2023-07-21T22:34:06.412 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6833/3740183048 2023-07-22T22:32:18.530764+0000 2023-07-21T22:34:06.412 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6832/3740183048 2023-07-22T22:32:18.530764+0000 2023-07-21T22:34:06.412 INFO:teuthology.orchestra.run.smithi006.stderr:listed 8 entries 2023-07-21T22:34:06.413 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:06.363+0000 7fa2c0213180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:34:06.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.363+0000 7fb0dd8d8640 1 -- 172.21.15.6:0/2933339125 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7fb0b80663f0 msgr2=0x7fb0b80688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:34:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.363+0000 7fb0dd8d8640 1 --2- 172.21.15.6:0/2933339125 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7fb0b80663f0 0x7fb0b80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.363+0000 7fb0dd8d8640 1 -- 172.21.15.6:0/2933339125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d806b1e0 msgr2=0x7fb0d81638e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.363+0000 7fb0dd8d8640 1 --2- 172.21.15.6:0/2933339125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d806b1e0 0x7fb0d81638e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80af040 tx=0x7fb0c801ac00 comp rx=0 tx=0).stop 2023-07-21T22:34:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.363+0000 7fb0dd8d8640 1 -- 172.21.15.6:0/2933339125 shutdown_connections 2023-07-21T22:34:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.363+0000 7fb0dd8d8640 1 --2- 172.21.15.6:0/2933339125 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7fb0b80663f0 0x7fb0b80688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.363+0000 7fb0dd8d8640 1 --2- 172.21.15.6:0/2933339125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0d80c21f0 0x7fb0d814dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.363+0000 7fb0dd8d8640 1 --2- 172.21.15.6:0/2933339125 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0d8070b70 0x7fb0d80ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.363+0000 7fb0dd8d8640 1 --2- 172.21.15.6:0/2933339125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d806b1e0 0x7fb0d81638e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.363+0000 7fb0dd8d8640 1 -- 172.21.15.6:0/2933339125 >> 172.21.15.6:0/2933339125 conn(0x7fb0d80afcf0 msgr2=0x7fb0d80c2620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.363+0000 7fb0dd8d8640 1 -- 172.21.15.6:0/2933339125 shutdown_connections 2023-07-21T22:34:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.363+0000 7fb0dd8d8640 1 -- 172.21.15.6:0/2933339125 wait complete. 2023-07-21T22:34:06.432 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-21T22:34:06.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:34:06.433 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-21T22:34:06.451 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:06.405+0000 7ff073a4a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:34:06.491 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:06.443+0000 7fa2c0213180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:34:06.499 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:34:06.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:34:06.500 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T22:34:06.511 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:34:06.512 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:34:06.520 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:34:06.521 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:34:06.521 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:34:06.563 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:34:06.563 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:34:06.564 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:34:06.572 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:34:06.573 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:34:06.634 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:06.587+0000 7fa2c0213180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:34:06.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.703+0000 7f36b2940640 1 Processor -- start 2023-07-21T22:34:06.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.703+0000 7f36b2940640 1 -- start start 2023-07-21T22:34:06.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.703+0000 7f36b2940640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36ac0c9730 0x7f36ac1638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:06.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.703+0000 7f36b2940640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ac0cc700 con 0x7f36ac158ce0 2023-07-21T22:34:06.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.703+0000 7f36b2940640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36ac0b0ff0 con 0x7f36ac0c8ad0 2023-07-21T22:34:06.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.703+0000 7f36b2940640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac070c80 con 0x7f36ac0c9730 2023-07-21T22:34:06.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.703+0000 7f36abfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f36ac158ce0 0x7f36ac070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38970/0 (socket says 172.21.15.6:38970) 2023-07-21T22:34:06.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.703+0000 7f36abfff640 1 -- 172.21.15.6:0/2860091498 learned_addr learned my addr 172.21.15.6:0/2860091498 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:06.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.703+0000 7f36b0edd640 1 --2- 172.21.15.6:0/2860091498 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36ac0c9730 0x7f36ac1638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:06.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.703+0000 7f36aaffd640 1 -- 172.21.15.6:0/2860091498 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562582538 0 0) 0x7f36ac0cc700 con 0x7f36ac158ce0 2023-07-21T22:34:06.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.703+0000 7f36aaffd640 1 -- 172.21.15.6:0/2860091498 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3694003530 con 0x7f36ac158ce0 2023-07-21T22:34:06.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.703+0000 7f36aaffd640 1 -- 172.21.15.6:0/2860091498 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715373935 0 0) 0x7f36ac0b0ff0 con 0x7f36ac0c8ad0 2023-07-21T22:34:06.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.703+0000 7f36aaffd640 1 -- 172.21.15.6:0/2860091498 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36ac0cc700 con 0x7f36ac0c8ad0 2023-07-21T22:34:06.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.703+0000 7f36b0edd640 1 -- 172.21.15.6:0/2860091498 >> v1:172.21.15.161:6789/0 conn(0x7f36ac0c8ad0 legacy=0x7f36ac0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:06.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.703+0000 7f36b0edd640 1 -- 172.21.15.6:0/2860091498 >> v1:172.21.15.6:6789/0 conn(0x7f36ac158ce0 legacy=0x7f36ac070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:06.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.703+0000 7f36b0edd640 1 -- 172.21.15.6:0/2860091498 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac0cbdd0 con 0x7f36ac0c9730 2023-07-21T22:34:06.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.707+0000 7f36b0edd640 1 --2- 172.21.15.6:0/2860091498 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36ac0c9730 0x7f36ac1638b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009dc0 tx=0x7f36a401c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=116e7d2913fc7c62 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:06.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.711+0000 7f36aaffd640 1 -- 172.21.15.6:0/2860091498 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a40a6700 con 0x7f36ac0c9730 2023-07-21T22:34:06.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.711+0000 7f36aaffd640 1 -- 172.21.15.6:0/2860091498 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a40a6860 con 0x7f36ac0c9730 2023-07-21T22:34:06.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.711+0000 7f36aaffd640 1 -- 172.21.15.6:0/2860091498 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a40a6bf0 con 0x7f36ac0c9730 2023-07-21T22:34:06.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.711+0000 7f36b2940640 1 -- 172.21.15.6:0/2860091498 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36ac0c9730 msgr2=0x7f36ac1638b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:06.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.711+0000 7f36b2940640 1 --2- 172.21.15.6:0/2860091498 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36ac0c9730 0x7f36ac1638b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009dc0 tx=0x7f36a401c820 comp rx=0 tx=0).stop 2023-07-21T22:34:06.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.711+0000 7f36b2940640 1 -- 172.21.15.6:0/2860091498 shutdown_connections 2023-07-21T22:34:06.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.711+0000 7f36b2940640 1 --2- 172.21.15.6:0/2860091498 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36ac0c9730 0x7f36ac1638b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:06.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.711+0000 7f36b2940640 1 -- 172.21.15.6:0/2860091498 >> 172.21.15.6:0/2860091498 conn(0x7f36ac0afcf0 msgr2=0x7f36ac0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:06.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.711+0000 7f36b2940640 1 -- 172.21.15.6:0/2860091498 shutdown_connections 2023-07-21T22:34:06.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.711+0000 7f36b2940640 1 -- 172.21.15.6:0/2860091498 wait complete. 2023-07-21T22:34:06.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36b2940640 1 Processor -- start 2023-07-21T22:34:06.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36b2940640 1 -- start start 2023-07-21T22:34:06.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36b2940640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36ac0c8ad0 0x7f36ac0c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:06.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36b2940640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36ac0c9730 0x7f36ac0ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:06.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36b2940640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36ac158ce0 0x7f36ac146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:06.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36b2940640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac0acf30 con 0x7f36ac0c9730 2023-07-21T22:34:06.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36b2940640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac0ac320 con 0x7f36ac158ce0 2023-07-21T22:34:06.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36b2940640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac0ac600 con 0x7f36ac0c8ad0 2023-07-21T22:34:06.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36ab7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36ac0c9730 0x7f36ac0ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:06.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36ab7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36ac0c9730 0x7f36ac0ab8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42868/0 (socket says 172.21.15.6:42868) 2023-07-21T22:34:06.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36ab7fe640 1 -- 172.21.15.6:0/3836052980 learned_addr learned my addr 172.21.15.6:0/3836052980 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:06.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36abfff640 1 --2- 172.21.15.6:0/3836052980 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36ac0c8ad0 0x7f36ac0c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:06.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36b0edd640 1 --2- 172.21.15.6:0/3836052980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36ac158ce0 0x7f36ac146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:06.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36ab7fe640 1 -- 172.21.15.6:0/3836052980 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36ac0c8ad0 msgr2=0x7f36ac0c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:06.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36ab7fe640 1 --2- 172.21.15.6:0/3836052980 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36ac0c8ad0 0x7f36ac0c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:06.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36ab7fe640 1 -- 172.21.15.6:0/3836052980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36ac158ce0 msgr2=0x7f36ac146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:06.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36ab7fe640 1 --2- 172.21.15.6:0/3836052980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36ac158ce0 0x7f36ac146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:06.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36ab7fe640 1 -- 172.21.15.6:0/3836052980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a4009a70 con 0x7f36ac0c9730 2023-07-21T22:34:06.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36ab7fe640 1 --2- 172.21.15.6:0/3836052980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36ac0c9730 0x7f36ac0ab8a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f36a000c490 tx=0x7f36a000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:06.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36a8ff9640 1 -- 172.21.15.6:0/3836052980 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a00052d0 con 0x7f36ac0c9730 2023-07-21T22:34:06.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36a8ff9640 1 -- 172.21.15.6:0/3836052980 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a0005430 con 0x7f36ac0c9730 2023-07-21T22:34:06.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36a8ff9640 1 -- 172.21.15.6:0/3836052980 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0012870 con 0x7f36ac0c9730 2023-07-21T22:34:06.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36b2940640 1 -- 172.21.15.6:0/3836052980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ac0ac8e0 con 0x7f36ac0c9730 2023-07-21T22:34:06.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.715+0000 7f36b2940640 1 -- 172.21.15.6:0/3836052980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ac14cf50 con 0x7f36ac0c9730 2023-07-21T22:34:06.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.719+0000 7f36b2940640 1 -- 172.21.15.6:0/3836052980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ac0ca1a0 con 0x7f36ac0c9730 2023-07-21T22:34:06.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.719+0000 7f36a8ff9640 1 -- 172.21.15.6:0/3836052980 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f36a00129d0 con 0x7f36ac0c9730 2023-07-21T22:34:06.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.719+0000 7f36a8ff9640 1 --2- 172.21.15.6:0/3836052980 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f36980663a0 0x7f3698068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:06.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.719+0000 7f36a8ff9640 1 -- 172.21.15.6:0/3836052980 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6508+0+0 (secure 0 0 0) 0x7f36a0083c30 con 0x7f36ac0c9730 2023-07-21T22:34:06.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.719+0000 7f36abfff640 1 -- 172.21.15.6:0/3836052980 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f36980663a0 msgr2=0x7f3698068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/582015960 2023-07-21T22:34:06.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.719+0000 7f36abfff640 1 --2- 172.21.15.6:0/3836052980 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f36980663a0 0x7f3698068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:06.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.723+0000 7f36a8ff9640 1 -- 172.21.15.6:0/3836052980 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f36a0050d60 con 0x7f36ac0c9730 2023-07-21T22:34:06.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.919+0000 7f36b2940640 1 -- 172.21.15.6:0/3836052980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36ac0ad0e0 con 0x7f36ac0c9730 2023-07-21T22:34:06.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.919+0000 7f36a8ff9640 1 -- 172.21.15.6:0/3836052980 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f36ac0ad0e0 con 0x7f36ac0c9730 2023-07-21T22:34:06.969 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:06.969 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/2410607534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2410607534},{"type":"v1","addr":"172.21.15.161:6836","nonce":2410607534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/3696372013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":3696372013},{"type":"v1","addr":"172.21.15.161:6837","nonce":3696372013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6042,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/4134919456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4134919456},{"type":"v1","addr":"172.21.15.6:6833","nonce":4134919456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:32:01.334074+0000","modified":"2023-07-21T22:32:04.955966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6045},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6045":{"gid":6045,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2511103099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2511103099},{"type":"v1","addr":"172.21.15.6:6835","nonce":2511103099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-21T22:34:06.970 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 24 2023-07-21T22:34:06.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.923+0000 7f36abfff640 1 -- 172.21.15.6:0/3836052980 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f36980663a0 msgr2=0x7f3698068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/582015960 2023-07-21T22:34:06.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.923+0000 7f36b2940640 1 -- 172.21.15.6:0/3836052980 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f36980663a0 msgr2=0x7f3698068850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T22:34:06.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.923+0000 7f36abfff640 1 --2- 172.21.15.6:0/3836052980 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f36980663a0 0x7f3698068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:34:06.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.923+0000 7f36b2940640 1 --2- 172.21.15.6:0/3836052980 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f36980663a0 0x7f3698068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:06.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.923+0000 7f36b2940640 1 -- 172.21.15.6:0/3836052980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36ac0c9730 msgr2=0x7f36ac0ab8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:06.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.923+0000 7f36b2940640 1 --2- 172.21.15.6:0/3836052980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36ac0c9730 0x7f36ac0ab8a0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f36a000c490 tx=0x7f36a000c950 comp rx=0 tx=0).stop 2023-07-21T22:34:06.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.923+0000 7f36b2940640 1 -- 172.21.15.6:0/3836052980 shutdown_connections 2023-07-21T22:34:06.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.923+0000 7f36b2940640 1 --2- 172.21.15.6:0/3836052980 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f36980663a0 0x7f3698068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:06.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.923+0000 7f36b2940640 1 --2- 172.21.15.6:0/3836052980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36ac158ce0 0x7f36ac146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:06.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.923+0000 7f36b2940640 1 --2- 172.21.15.6:0/3836052980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36ac0c9730 0x7f36ac0ab8a0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:06.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.923+0000 7f36b2940640 1 --2- 172.21.15.6:0/3836052980 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36ac0c8ad0 0x7f36ac0c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:06.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.923+0000 7f36b2940640 1 -- 172.21.15.6:0/3836052980 >> 172.21.15.6:0/3836052980 conn(0x7f36ac0afcf0 msgr2=0x7f36ac0c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:06.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.923+0000 7f36b2940640 1 -- 172.21.15.6:0/3836052980 shutdown_connections 2023-07-21T22:34:06.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:06.923+0000 7f36b2940640 1 -- 172.21.15.6:0/3836052980 wait complete. 2023-07-21T22:34:06.992 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:34:06.995 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:06.949+0000 7ff073a4a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:34:07.079 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:07.033+0000 7ff073a4a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:34:07.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.131+0000 7f30cdcf9640 1 Processor -- start 2023-07-21T22:34:07.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.131+0000 7f30cdcf9640 1 -- start start 2023-07-21T22:34:07.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.131+0000 7f30cdcf9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30c815fd60 0x7f30c80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:07.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.131+0000 7f30cdcf9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c80ccaf0 con 0x7f30c80d1850 2023-07-21T22:34:07.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.131+0000 7f30cdcf9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c8160320 con 0x7f30c80b7c70 2023-07-21T22:34:07.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.131+0000 7f30cdcf9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c80d1190 con 0x7f30c815fd60 2023-07-21T22:34:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.131+0000 7f30c7fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f30c80d1850 0x7f30c80d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38982/0 (socket says 172.21.15.6:38982) 2023-07-21T22:34:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.131+0000 7f30c7fff640 1 -- 172.21.15.6:0/948347928 learned_addr learned my addr 172.21.15.6:0/948347928 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.131+0000 7f30c6ffd640 1 --2- 172.21.15.6:0/948347928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30c815fd60 0x7f30c80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.131+0000 7f30c67fc640 1 -- 172.21.15.6:0/948347928 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912882600 0 0) 0x7f30c80ccaf0 con 0x7f30c80d1850 2023-07-21T22:34:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.131+0000 7f30c67fc640 1 -- 172.21.15.6:0/948347928 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30b0003530 con 0x7f30c80d1850 2023-07-21T22:34:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.131+0000 7f30c67fc640 1 -- 172.21.15.6:0/948347928 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3764013104 0 0) 0x7f30c8160320 con 0x7f30c80b7c70 2023-07-21T22:34:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.131+0000 7f30c6ffd640 1 -- 172.21.15.6:0/948347928 >> v1:172.21.15.161:6789/0 conn(0x7f30c80b7c70 legacy=0x7f30c815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.131+0000 7f30c6ffd640 1 -- 172.21.15.6:0/948347928 >> v1:172.21.15.6:6789/0 conn(0x7f30c80d1850 legacy=0x7f30c80d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.131+0000 7f30c6ffd640 1 -- 172.21.15.6:0/948347928 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c80ccd90 con 0x7f30c815fd60 2023-07-21T22:34:07.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.135+0000 7f30c6ffd640 1 --2- 172.21.15.6:0/948347928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30c815fd60 0x7f30c80d0c50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0097f0 tx=0x7f30bc01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=814a9c6f8da096e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:07.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.135+0000 7f30c67fc640 1 -- 172.21.15.6:0/948347928 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc0ac630 con 0x7f30c815fd60 2023-07-21T22:34:07.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.135+0000 7f30c67fc640 1 -- 172.21.15.6:0/948347928 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30bc0ac790 con 0x7f30c815fd60 2023-07-21T22:34:07.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.135+0000 7f30c67fc640 1 -- 172.21.15.6:0/948347928 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc0acb20 con 0x7f30c815fd60 2023-07-21T22:34:07.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.135+0000 7f30cdcf9640 1 -- 172.21.15.6:0/948347928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30c815fd60 msgr2=0x7f30c80d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:07.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.135+0000 7f30cdcf9640 1 --2- 172.21.15.6:0/948347928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30c815fd60 0x7f30c80d0c50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0097f0 tx=0x7f30bc01c4c0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.135+0000 7f30cdcf9640 1 -- 172.21.15.6:0/948347928 shutdown_connections 2023-07-21T22:34:07.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.135+0000 7f30cdcf9640 1 --2- 172.21.15.6:0/948347928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30c815fd60 0x7f30c80d0c50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.135+0000 7f30cdcf9640 1 -- 172.21.15.6:0/948347928 >> 172.21.15.6:0/948347928 conn(0x7f30c80650b0 msgr2=0x7f30c80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:07.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.135+0000 7f30cdcf9640 1 -- 172.21.15.6:0/948347928 shutdown_connections 2023-07-21T22:34:07.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.135+0000 7f30cdcf9640 1 -- 172.21.15.6:0/948347928 wait complete. 2023-07-21T22:34:07.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30cdcf9640 1 Processor -- start 2023-07-21T22:34:07.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30cdcf9640 1 -- start start 2023-07-21T22:34:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30cdcf9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30c80b7c70 0x7f30c814d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30cdcf9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30c80d1850 0x7f30c80b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30cdcf9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30c815fd60 0x7f30c80b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30cdcf9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c815cd40 con 0x7f30c80d1850 2023-07-21T22:34:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30cdcf9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c814dcf0 con 0x7f30c815fd60 2023-07-21T22:34:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30cdcf9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c815d1d0 con 0x7f30c80b7c70 2023-07-21T22:34:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30c6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30c80d1850 0x7f30c80b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30c77fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30c80b7c70 0x7f30c814d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30c77fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30c80b7c70 0x7f30c814d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:35770/0 (socket says 172.21.15.6:35770) 2023-07-21T22:34:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30c77fe640 1 -- 172.21.15.6:0/1957228554 learned_addr learned my addr 172.21.15.6:0/1957228554 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30c7fff640 1 --2- 172.21.15.6:0/1957228554 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30c815fd60 0x7f30c80b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:07.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30c77fe640 1 -- 172.21.15.6:0/1957228554 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30c815fd60 msgr2=0x7f30c80b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:07.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30c77fe640 1 --2- 172.21.15.6:0/1957228554 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30c815fd60 0x7f30c80b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30c77fe640 1 -- 172.21.15.6:0/1957228554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30c80d1850 msgr2=0x7f30c80b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:07.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30c77fe640 1 --2- 172.21.15.6:0/1957228554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30c80d1850 0x7f30c80b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30c77fe640 1 -- 172.21.15.6:0/1957228554 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30bc009420 con 0x7f30c80b7c70 2023-07-21T22:34:07.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30c6ffd640 1 --2- 172.21.15.6:0/1957228554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30c80d1850 0x7f30c80b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:07.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30c77fe640 1 --2- 172.21.15.6:0/1957228554 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30c80b7c70 0x7f30c814d7b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f30b8001ec0 tx=0x7f30b800c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:07.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30affff640 1 -- 172.21.15.6:0/1957228554 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b80054e0 con 0x7f30c80b7c70 2023-07-21T22:34:07.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30affff640 1 -- 172.21.15.6:0/1957228554 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b8003600 con 0x7f30c80b7c70 2023-07-21T22:34:07.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30cdcf9640 1 -- 172.21.15.6:0/1957228554 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c815c130 con 0x7f30c80b7c70 2023-07-21T22:34:07.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30affff640 1 -- 172.21.15.6:0/1957228554 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b80039b0 con 0x7f30c80b7c70 2023-07-21T22:34:07.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.139+0000 7f30cdcf9640 1 -- 172.21.15.6:0/1957228554 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c815c6f0 con 0x7f30c80b7c70 2023-07-21T22:34:07.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.143+0000 7f30cdcf9640 1 -- 172.21.15.6:0/1957228554 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c80678d0 con 0x7f30c80b7c70 2023-07-21T22:34:07.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.143+0000 7f30affff640 1 -- 172.21.15.6:0/1957228554 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 23) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f30b8003b10 con 0x7f30c80b7c70 2023-07-21T22:34:07.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.143+0000 7f30affff640 1 --2- 172.21.15.6:0/1957228554 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f30b40663d0 0x7f30b4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:07.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.143+0000 7f30affff640 1 -- 172.21.15.6:0/1957228554 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6596+0+0 (secure 0 0 0) 0x7f30b80835f0 con 0x7f30c80b7c70 2023-07-21T22:34:07.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.143+0000 7f30c6ffd640 1 -- 172.21.15.6:0/1957228554 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f30b40663d0 msgr2=0x7f30b4068880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/582015960 2023-07-21T22:34:07.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.143+0000 7f30c6ffd640 1 --2- 172.21.15.6:0/1957228554 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f30b40663d0 0x7f30b4068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:07.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.147+0000 7f30affff640 1 -- 172.21.15.6:0/1957228554 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f30b80507e0 con 0x7f30c80b7c70 2023-07-21T22:34:07.221 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:07.171+0000 7fa2c0213180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:34:07.227 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:07.181+0000 7ff073a4a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:34:07.310 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:07.259+0000 7fa2c0213180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:34:07.311 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:07.265+0000 7ff073a4a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:34:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.303+0000 7f30cdcf9640 1 -- 172.21.15.6:0/1957228554 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30c80b18f0 con 0x7f30c80b7c70 2023-07-21T22:34:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.307+0000 7f30affff640 1 -- 172.21.15.6:0/1957228554 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+19051 (secure 0 0 0) 0x7f30b8001130 con 0x7f30c80b7c70 2023-07-21T22:34:07.356 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:07.356 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":71,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:34:06.872211+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:31:59.449200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-21T22:32:00.321692+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":4,"snap_epoch":71,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.17","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/4288088570":"2023-07-22T22:32:18.530764+0000","172.21.15.161:0/3254934176":"2023-07-22T22:32:18.530764+0000","172.21.15.161:0/2578585244":"2023-07-22T22:32:18.530764+0000","172.21.15.161:0/1830979956":"2023-07-22T22:32:18.530764+0000","172.21.15.161:0/4294109256":"2023-07-22T22:32:18.530764+0000","172.21.15.161:0/986370314":"2023-07-22T22:32:18.530764+0000","172.21.15.161:6833/3740183048":"2023-07-22T22:32:18.530764+0000","172.21.15.161:6832/3740183048":"2023-07-22T22:32:18.530764+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:34:07.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.307+0000 7f30cdcf9640 1 -- 172.21.15.6:0/1957228554 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f30b40663d0 msgr2=0x7f30b4068880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:34:07.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.307+0000 7f30cdcf9640 1 --2- 172.21.15.6:0/1957228554 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f30b40663d0 0x7f30b4068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.307+0000 7f30cdcf9640 1 -- 172.21.15.6:0/1957228554 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30c80b7c70 msgr2=0x7f30c814d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:07.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.307+0000 7f30cdcf9640 1 --2- 172.21.15.6:0/1957228554 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30c80b7c70 0x7f30c814d7b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f30b8001ec0 tx=0x7f30b800c8e0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.307+0000 7f30cdcf9640 1 -- 172.21.15.6:0/1957228554 shutdown_connections 2023-07-21T22:34:07.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.307+0000 7f30cdcf9640 1 --2- 172.21.15.6:0/1957228554 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f30b40663d0 0x7f30b4068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.307+0000 7f30cdcf9640 1 --2- 172.21.15.6:0/1957228554 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30c815fd60 0x7f30c80b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.307+0000 7f30cdcf9640 1 --2- 172.21.15.6:0/1957228554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30c80d1850 0x7f30c80b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.307+0000 7f30cdcf9640 1 --2- 172.21.15.6:0/1957228554 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30c80b7c70 0x7f30c814d7b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.307+0000 7f30cdcf9640 1 -- 172.21.15.6:0/1957228554 >> 172.21.15.6:0/1957228554 conn(0x7f30c80650b0 msgr2=0x7f30c8065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:07.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.307+0000 7f30cdcf9640 1 -- 172.21.15.6:0/1957228554 shutdown_connections 2023-07-21T22:34:07.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.307+0000 7f30cdcf9640 1 -- 172.21.15.6:0/1957228554 wait complete. 2023-07-21T22:34:07.377 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:31:59.449200+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:32:00.321692+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 4, 'snap_epoch': 71, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:34:07.378 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:34:07.468 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:07.419+0000 7fa2c0213180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:34:07.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.475+0000 7f33e6834640 1 Processor -- start 2023-07-21T22:34:07.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.475+0000 7f33e6834640 1 -- start start 2023-07-21T22:34:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.479+0000 7f33e6834640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f33e00aeb40 0x7f33e015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.479+0000 7f33e6834640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f33e0159440 0x7f33e00c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.479+0000 7f33e6834640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e01532b0 con 0x7f33e00aef10 2023-07-21T22:34:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.479+0000 7f33e6834640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e00ca6f0 con 0x7f33e00aeb40 2023-07-21T22:34:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.479+0000 7f33e6834640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e01599d0 con 0x7f33e0159440 2023-07-21T22:34:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.479+0000 7f33dffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f33e00aeb40 0x7f33e015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:07.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.479+0000 7f33dffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f33e00aeb40 0x7f33e015cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50222/0 (socket says 172.21.15.6:50222) 2023-07-21T22:34:07.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.479+0000 7f33dffff640 1 -- 172.21.15.6:0/778719432 learned_addr learned my addr 172.21.15.6:0/778719432 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:07.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.479+0000 7f33e4dd1640 1 --2- 172.21.15.6:0/778719432 >> v2:172.21.15.161:3300/0 conn(0x7f33e0159440 0x7f33e00c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:07.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.479+0000 7f33dffff640 1 -- 172.21.15.6:0/778719432 >> v2:172.21.15.161:3300/0 conn(0x7f33e0159440 msgr2=0x7f33e00c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:07.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.479+0000 7f33dffff640 1 --2- 172.21.15.6:0/778719432 >> v2:172.21.15.161:3300/0 conn(0x7f33e0159440 0x7f33e00c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.479+0000 7f33dffff640 1 -- 172.21.15.6:0/778719432 >> v1:172.21.15.161:6789/0 conn(0x7f33e00aef10 legacy=0x7f33e0158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:07.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.479+0000 7f33dffff640 1 -- 172.21.15.6:0/778719432 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e0159cb0 con 0x7f33e00aeb40 2023-07-21T22:34:07.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.483+0000 7f33dffff640 1 --2- 172.21.15.6:0/778719432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e00aeb40 0x7f33e015cef0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f33e00c8690 tx=0x7f33d001e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8fb95e5969acf6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:07.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.483+0000 7f33deffd640 1 -- 172.21.15.6:0/778719432 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d00a8620 con 0x7f33e00aeb40 2023-07-21T22:34:07.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.483+0000 7f33deffd640 1 -- 172.21.15.6:0/778719432 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d00a8780 con 0x7f33e00aeb40 2023-07-21T22:34:07.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.483+0000 7f33deffd640 1 -- 172.21.15.6:0/778719432 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d00a8b10 con 0x7f33e00aeb40 2023-07-21T22:34:07.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.483+0000 7f33e6834640 1 -- 172.21.15.6:0/778719432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e00aeb40 msgr2=0x7f33e015cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.483+0000 7f33e6834640 1 --2- 172.21.15.6:0/778719432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e00aeb40 0x7f33e015cef0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f33e00c8690 tx=0x7f33d001e650 comp rx=0 tx=0).stop 2023-07-21T22:34:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.483+0000 7f33e6834640 1 -- 172.21.15.6:0/778719432 shutdown_connections 2023-07-21T22:34:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.483+0000 7f33e6834640 1 --2- 172.21.15.6:0/778719432 >> v2:172.21.15.161:3300/0 conn(0x7f33e0159440 0x7f33e00c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.483+0000 7f33e6834640 1 --2- 172.21.15.6:0/778719432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e00aeb40 0x7f33e015cef0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.483+0000 7f33e6834640 1 -- 172.21.15.6:0/778719432 >> 172.21.15.6:0/778719432 conn(0x7f33e00cde90 msgr2=0x7f33e00ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.483+0000 7f33e6834640 1 -- 172.21.15.6:0/778719432 shutdown_connections 2023-07-21T22:34:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.483+0000 7f33e6834640 1 -- 172.21.15.6:0/778719432 wait complete. 2023-07-21T22:34:07.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.483+0000 7f33e6834640 1 Processor -- start 2023-07-21T22:34:07.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.483+0000 7f33e6834640 1 -- start start 2023-07-21T22:34:07.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33e6834640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33e00aeb40 0x7f33e0151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:07.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33e6834640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33e00aef10 0x7f33e014f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:07.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33e6834640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e0159440 0x7f33e01f7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:07.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33e6834640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e015b710 con 0x7f33e0159440 2023-07-21T22:34:07.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33e6834640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e0151ea0 con 0x7f33e00aeb40 2023-07-21T22:34:07.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33e6834640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e015ac30 con 0x7f33e00aef10 2023-07-21T22:34:07.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33e4dd1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e0159440 0x7f33e01f7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:07.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33e4dd1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e0159440 0x7f33e01f7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50234/0 (socket says 172.21.15.6:50234) 2023-07-21T22:34:07.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33e4dd1640 1 -- 172.21.15.6:0/3206244802 learned_addr learned my addr 172.21.15.6:0/3206244802 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:07.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33dffff640 1 --2- 172.21.15.6:0/3206244802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33e00aeb40 0x7f33e0151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:07.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33df7fe640 1 --2- 172.21.15.6:0/3206244802 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33e00aef10 0x7f33e014f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:07.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33e4dd1640 1 -- 172.21.15.6:0/3206244802 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33e00aef10 msgr2=0x7f33e014f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:07.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33e4dd1640 1 --2- 172.21.15.6:0/3206244802 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33e00aef10 0x7f33e014f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33e4dd1640 1 -- 172.21.15.6:0/3206244802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33e00aeb40 msgr2=0x7f33e0151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:07.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33e4dd1640 1 --2- 172.21.15.6:0/3206244802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33e00aeb40 0x7f33e0151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33e4dd1640 1 -- 172.21.15.6:0/3206244802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d00094d0 con 0x7f33e0159440 2023-07-21T22:34:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33dffff640 1 --2- 172.21.15.6:0/3206244802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33e00aeb40 0x7f33e0151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33e4dd1640 1 --2- 172.21.15.6:0/3206244802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e0159440 0x7f33e01f7d20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f33d800efc0 tx=0x7f33d800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33dcff9640 1 -- 172.21.15.6:0/3206244802 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8009ba0 con 0x7f33e0159440 2023-07-21T22:34:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33dcff9640 1 -- 172.21.15.6:0/3206244802 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d800f040 con 0x7f33e0159440 2023-07-21T22:34:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33e6834640 1 -- 172.21.15.6:0/3206244802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e015af10 con 0x7f33e0159440 2023-07-21T22:34:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33dcff9640 1 -- 172.21.15.6:0/3206244802 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d80146c0 con 0x7f33e0159440 2023-07-21T22:34:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33e6834640 1 -- 172.21.15.6:0/3206244802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e0151b90 con 0x7f33e0159440 2023-07-21T22:34:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.487+0000 7f33e6834640 1 -- 172.21.15.6:0/3206244802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e015aa90 con 0x7f33e0159440 2023-07-21T22:34:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.491+0000 7f33dcff9640 1 -- 172.21.15.6:0/3206244802 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 23) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f33d8014820 con 0x7f33e0159440 2023-07-21T22:34:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.491+0000 7f33dcff9640 1 --2- 172.21.15.6:0/3206244802 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f33cc0663a0 0x7f33cc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:07.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.491+0000 7f33dcff9640 1 -- 172.21.15.6:0/3206244802 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6596+0+0 (secure 0 0 0) 0x7f33d8084fa0 con 0x7f33e0159440 2023-07-21T22:34:07.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.491+0000 7f33dffff640 1 -- 172.21.15.6:0/3206244802 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f33cc0663a0 msgr2=0x7f33cc068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/582015960 2023-07-21T22:34:07.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.491+0000 7f33dffff640 1 --2- 172.21.15.6:0/3206244802 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f33cc0663a0 0x7f33cc068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:07.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.495+0000 7f33dcff9640 1 -- 172.21.15.6:0/3206244802 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f33e015aa90 con 0x7f33e0159440 2023-07-21T22:34:07.559 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:07.511+0000 7fa2c0213180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:34:07.581 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:07.537+0000 7ff073a4a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:34:07.643 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:07.597+0000 7ff073a4a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:34:07.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.611+0000 7f33dcff9640 1 -- 172.21.15.6:0/3206244802 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 24) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f33d80523c0 con 0x7f33e0159440 2023-07-21T22:34:07.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.611+0000 7f33dcff9640 1 -- 172.21.15.6:0/3206244802 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f33cc0663a0 msgr2=0x7f33cc068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:34:07.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.611+0000 7f33dcff9640 1 --2- 172.21.15.6:0/3206244802 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f33cc0663a0 0x7f33cc068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.679+0000 7f33e6834640 1 -- 172.21.15.6:0/3206244802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33e015aa90 con 0x7f33e0159440 2023-07-21T22:34:07.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.679+0000 7f33dcff9640 1 -- 172.21.15.6:0/3206244802 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33e015aa90 con 0x7f33e0159440 2023-07-21T22:34:07.729 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:34:07.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.679+0000 7f33e6834640 1 -- 172.21.15.6:0/3206244802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e0159440 msgr2=0x7f33e01f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:07.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.679+0000 7f33e6834640 1 --2- 172.21.15.6:0/3206244802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e0159440 0x7f33e01f7d20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f33d800efc0 tx=0x7f33d800c490 comp rx=0 tx=0).stop 2023-07-21T22:34:07.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.679+0000 7f33e6834640 1 -- 172.21.15.6:0/3206244802 shutdown_connections 2023-07-21T22:34:07.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.679+0000 7f33e6834640 1 --2- 172.21.15.6:0/3206244802 >> [v2:172.21.15.161:6832/582015960,v1:172.21.15.161:6833/582015960] conn(0x7f33cc0663a0 0x7f33cc068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.679+0000 7f33e6834640 1 --2- 172.21.15.6:0/3206244802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e0159440 0x7f33e01f7d20 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.679+0000 7f33e6834640 1 --2- 172.21.15.6:0/3206244802 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33e00aef10 0x7f33e014f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.679+0000 7f33e6834640 1 --2- 172.21.15.6:0/3206244802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33e00aeb40 0x7f33e0151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.679+0000 7f33e6834640 1 -- 172.21.15.6:0/3206244802 >> 172.21.15.6:0/3206244802 conn(0x7f33e00cde90 msgr2=0x7f33e00c4460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:07.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.679+0000 7f33e6834640 1 -- 172.21.15.6:0/3206244802 shutdown_connections 2023-07-21T22:34:07.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.679+0000 7f33e6834640 1 -- 172.21.15.6:0/3206244802 wait complete. 2023-07-21T22:34:07.734 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:07.685+0000 7feffaee9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:07.734 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:07.685+0000 7feffaee9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:07.734 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:07.685+0000 7feffaee9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:07.734 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:07.685+0000 7feffaee9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:07.734 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:07.685+0000 7feffaee9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:07.735 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:07.685+0000 7feffe6f0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:07.735 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:07.685+0000 7feffe6f0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:07.735 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:07.685+0000 7feffe6f0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:07.735 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:07.685+0000 7feffe6f0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:07.735 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:07.685+0000 7feffe6f0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:07.753 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:34:07.877 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:07.827+0000 7fa2c0213180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:34:07.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.855+0000 7f0ab0a34640 1 Processor -- start 2023-07-21T22:34:07.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.855+0000 7f0ab0a34640 1 -- start start 2023-07-21T22:34:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.855+0000 7f0ab0a34640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0aac15bde0 0x7f0aac0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.855+0000 7f0ab0a34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aac0d2fc0 0x7f0aac0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.855+0000 7f0ab0a34640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aac0b04c0 con 0x7f0aac0d2300 2023-07-21T22:34:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.855+0000 7f0ab0a34640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aac15c1b0 con 0x7f0aac15bde0 2023-07-21T22:34:07.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.855+0000 7f0ab0a34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac0d0aa0 con 0x7f0aac0d2fc0 2023-07-21T22:34:07.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.855+0000 7f0aa9d9b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aac0d2fc0 0x7f0aac0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:07.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.855+0000 7f0aaa59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0aac15bde0 0x7f0aac0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:07.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.855+0000 7f0aa9d9b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aac0d2fc0 0x7f0aac0b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:49906/0 (socket says 172.21.15.6:49906) 2023-07-21T22:34:07.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.855+0000 7f0aaa59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0aac15bde0 0x7f0aac0d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:43294/0 (socket says 172.21.15.6:43294) 2023-07-21T22:34:07.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.855+0000 7f0aa9d9b640 1 -- 172.21.15.6:0/1095489392 learned_addr learned my addr 172.21.15.6:0/1095489392 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:07.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.855+0000 7f0aaad9d640 1 --1- 172.21.15.6:0/1095489392 >> v1:172.21.15.161:6789/0 conn(0x7f0aac0d2300 0x7f0aac0cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:33760/0 (socket says 172.21.15.6:33760) 2023-07-21T22:34:07.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.855+0000 7f0aa959a640 1 -- 172.21.15.6:0/1095489392 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716108054 0 0) 0x7f0aac0b04c0 con 0x7f0aac0d2300 2023-07-21T22:34:07.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.859+0000 7f0aaa59c640 1 -- 172.21.15.6:0/1095489392 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aac0d2fc0 msgr2=0x7f0aac0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:07.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.859+0000 7f0aaa59c640 1 --2- 172.21.15.6:0/1095489392 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aac0d2fc0 0x7f0aac0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.859+0000 7f0aaa59c640 1 -- 172.21.15.6:0/1095489392 >> v1:172.21.15.161:6789/0 conn(0x7f0aac0d2300 legacy=0x7f0aac0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.859+0000 7f0aaa59c640 1 -- 172.21.15.6:0/1095489392 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aac0afb90 con 0x7f0aac15bde0 2023-07-21T22:34:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.859+0000 7f0aa9d9b640 1 --2- 172.21.15.6:0/1095489392 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aac0d2fc0 0x7f0aac0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.859+0000 7f0aaa59c640 1 --2- 172.21.15.6:0/1095489392 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0aac15bde0 0x7f0aac0d0270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0097a0 tx=0x7f0a9c01c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=448e7d363b442087 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.859+0000 7f0aa959a640 1 -- 172.21.15.6:0/1095489392 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0ab660 con 0x7f0aac15bde0 2023-07-21T22:34:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.859+0000 7f0aa959a640 1 -- 172.21.15.6:0/1095489392 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c0ab7c0 con 0x7f0aac15bde0 2023-07-21T22:34:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.859+0000 7f0aa959a640 1 -- 172.21.15.6:0/1095489392 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0abb50 con 0x7f0aac15bde0 2023-07-21T22:34:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.859+0000 7f0ab0a34640 1 -- 172.21.15.6:0/1095489392 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0aac15bde0 msgr2=0x7f0aac0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.859+0000 7f0ab0a34640 1 --2- 172.21.15.6:0/1095489392 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0aac15bde0 0x7f0aac0d0270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0097a0 tx=0x7f0a9c01c460 comp rx=0 tx=0).stop 2023-07-21T22:34:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.863+0000 7f0ab0a34640 1 -- 172.21.15.6:0/1095489392 shutdown_connections 2023-07-21T22:34:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.863+0000 7f0ab0a34640 1 --2- 172.21.15.6:0/1095489392 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aac0d2fc0 0x7f0aac0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.863+0000 7f0ab0a34640 1 --2- 172.21.15.6:0/1095489392 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0aac15bde0 0x7f0aac0d0270 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.863+0000 7f0ab0a34640 1 -- 172.21.15.6:0/1095489392 >> 172.21.15.6:0/1095489392 conn(0x7f0aac0659d0 msgr2=0x7f0aac09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:07.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.863+0000 7f0ab0a34640 1 -- 172.21.15.6:0/1095489392 shutdown_connections 2023-07-21T22:34:07.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.863+0000 7f0ab0a34640 1 -- 172.21.15.6:0/1095489392 wait complete. 2023-07-21T22:34:07.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.863+0000 7f0ab0a34640 1 Processor -- start 2023-07-21T22:34:07.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.863+0000 7f0ab0a34640 1 -- start start 2023-07-21T22:34:07.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.863+0000 7f0ab0a34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aac0d2300 0x7f0aac15cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:07.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.863+0000 7f0ab0a34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0aac0d2fc0 0x7f0aac1f7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:07.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.863+0000 7f0ab0a34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0aac15bde0 0x7f0aac0b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:07.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.863+0000 7f0ab0a34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac15d600 con 0x7f0aac0d2fc0 2023-07-21T22:34:07.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.863+0000 7f0ab0a34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac15d8e0 con 0x7f0aac15bde0 2023-07-21T22:34:07.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.863+0000 7f0ab0a34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aac15dbc0 con 0x7f0aac0d2300 2023-07-21T22:34:07.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.863+0000 7f0aa9d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0aac0d2fc0 0x7f0aac1f7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:07.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.863+0000 7f0aaa59c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aac0d2300 0x7f0aac15cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:07.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.863+0000 7f0aaad9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0aac15bde0 0x7f0aac0b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:07.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.863+0000 7f0aaa59c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aac0d2300 0x7f0aac15cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:49914/0 (socket says 172.21.15.6:49914) 2023-07-21T22:34:07.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.863+0000 7f0aaa59c640 1 -- 172.21.15.6:0/960672163 learned_addr learned my addr 172.21.15.6:0/960672163 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:07.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.867+0000 7f0aaa59c640 1 -- 172.21.15.6:0/960672163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0aac15bde0 msgr2=0x7f0aac0b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:07.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.867+0000 7f0aaa59c640 1 --2- 172.21.15.6:0/960672163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0aac15bde0 0x7f0aac0b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.867+0000 7f0aaa59c640 1 -- 172.21.15.6:0/960672163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0aac0d2fc0 msgr2=0x7f0aac1f7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:07.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.867+0000 7f0aaa59c640 1 --2- 172.21.15.6:0/960672163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0aac0d2fc0 0x7f0aac1f7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:07.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.867+0000 7f0aaa59c640 1 -- 172.21.15.6:0/960672163 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa00094d0 con 0x7f0aac0d2300 2023-07-21T22:34:07.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.867+0000 7f0aa9d9b640 1 --2- 172.21.15.6:0/960672163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0aac0d2fc0 0x7f0aac1f7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:07.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.867+0000 7f0aaa59c640 1 --2- 172.21.15.6:0/960672163 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aac0d2300 0x7f0aac15cd00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0ad040 tx=0x7f0a9c01aca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:07.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.867+0000 7f0a9affd640 1 -- 172.21.15.6:0/960672163 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c005ba0 con 0x7f0aac0d2300 2023-07-21T22:34:07.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.867+0000 7f0a9affd640 1 -- 172.21.15.6:0/960672163 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c005d00 con 0x7f0aac0d2300 2023-07-21T22:34:07.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.867+0000 7f0a9affd640 1 -- 172.21.15.6:0/960672163 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c006260 con 0x7f0aac0d2300 2023-07-21T22:34:07.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.867+0000 7f0ab0a34640 1 -- 172.21.15.6:0/960672163 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9c0093b0 con 0x7f0aac0d2300 2023-07-21T22:34:07.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.867+0000 7f0ab0a34640 1 -- 172.21.15.6:0/960672163 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aac15e180 con 0x7f0aac0d2300 2023-07-21T22:34:07.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.867+0000 7f0ab0a34640 1 -- 172.21.15.6:0/960672163 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aac0678d0 con 0x7f0aac0d2300 2023-07-21T22:34:07.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.867+0000 7f0a9affd640 1 -- 172.21.15.6:0/960672163 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 24) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f0a9c0a9070 con 0x7f0aac0d2300 2023-07-21T22:34:07.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.867+0000 7f0a9affd640 1 -- 172.21.15.6:0/960672163 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6924+0+0 (secure 0 0 0) 0x7f0a9c11e600 con 0x7f0aac0d2300 2023-07-21T22:34:07.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:07.871+0000 7f0a9affd640 1 -- 172.21.15.6:0/960672163 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0a9c0ebce0 con 0x7f0aac0d2300 2023-07-21T22:34:07.944 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:07.895+0000 7fa2c0213180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:34:08.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.031+0000 7f0ab0a34640 1 -- 172.21.15.6:0/960672163 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0aac0b7ad0 con 0x7f0aac0d2300 2023-07-21T22:34:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.031+0000 7f0a9affd640 1 -- 172.21.15.6:0/960672163 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v72) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0a9c0ef300 con 0x7f0aac0d2300 2023-07-21T22:34:08.082 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:34:08.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.035+0000 7f0ab0a34640 1 -- 172.21.15.6:0/960672163 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aac0d2300 msgr2=0x7f0aac15cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:08.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.035+0000 7f0ab0a34640 1 --2- 172.21.15.6:0/960672163 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aac0d2300 0x7f0aac15cd00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0ad040 tx=0x7f0a9c01aca0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.035+0000 7f0ab0a34640 1 -- 172.21.15.6:0/960672163 shutdown_connections 2023-07-21T22:34:08.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.035+0000 7f0ab0a34640 1 --2- 172.21.15.6:0/960672163 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0aac15bde0 0x7f0aac0b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.035+0000 7f0ab0a34640 1 --2- 172.21.15.6:0/960672163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0aac0d2fc0 0x7f0aac1f7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.035+0000 7f0ab0a34640 1 --2- 172.21.15.6:0/960672163 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0aac0d2300 0x7f0aac15cd00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.035+0000 7f0ab0a34640 1 -- 172.21.15.6:0/960672163 >> 172.21.15.6:0/960672163 conn(0x7f0aac0659d0 msgr2=0x7f0aac0ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:08.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.035+0000 7f0ab0a34640 1 -- 172.21.15.6:0/960672163 shutdown_connections 2023-07-21T22:34:08.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.035+0000 7f0ab0a34640 1 -- 172.21.15.6:0/960672163 wait complete. 2023-07-21T22:34:08.103 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:34:08.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.199+0000 7f1e7660b640 1 Processor -- start 2023-07-21T22:34:08.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.199+0000 7f1e7660b640 1 -- start start 2023-07-21T22:34:08.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.203+0000 7f1e7660b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1e700aeb40 0x7f1e7015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:08.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.203+0000 7f1e7660b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1e700aef10 0x7f1e70158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:08.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.203+0000 7f1e7660b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e70159270 0x7f1e700c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.203+0000 7f1e7660b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e701532b0 con 0x7f1e700aeb40 2023-07-21T22:34:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.203+0000 7f1e7660b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e700ca6f0 con 0x7f1e700aef10 2023-07-21T22:34:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.203+0000 7f1e7660b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e701599d0 con 0x7f1e70159270 2023-07-21T22:34:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.203+0000 7f1e6ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1e700aeb40 0x7f1e7015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.203+0000 7f1e6ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1e700aeb40 0x7f1e7015cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50250/0 (socket says 172.21.15.6:50250) 2023-07-21T22:34:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.203+0000 7f1e6ffff640 1 -- 172.21.15.6:0/220435230 learned_addr learned my addr 172.21.15.6:0/220435230 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:08.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.203+0000 7f1e74ba8640 1 --2- 172.21.15.6:0/220435230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e70159270 0x7f1e700c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:08.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.203+0000 7f1e6f7fe640 1 --2- 172.21.15.6:0/220435230 >> v2:172.21.15.161:3300/0 conn(0x7f1e700aef10 0x7f1e70158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:08.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.203+0000 7f1e6ffff640 1 -- 172.21.15.6:0/220435230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e70159270 msgr2=0x7f1e700c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:08.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.203+0000 7f1e6ffff640 1 --2- 172.21.15.6:0/220435230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e70159270 0x7f1e700c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.203+0000 7f1e6ffff640 1 -- 172.21.15.6:0/220435230 >> v2:172.21.15.161:3300/0 conn(0x7f1e700aef10 msgr2=0x7f1e70158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:08.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.203+0000 7f1e6ffff640 1 --2- 172.21.15.6:0/220435230 >> v2:172.21.15.161:3300/0 conn(0x7f1e700aef10 0x7f1e70158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.203+0000 7f1e6ffff640 1 -- 172.21.15.6:0/220435230 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e70159cb0 con 0x7f1e700aeb40 2023-07-21T22:34:08.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.207+0000 7f1e6ffff640 1 --2- 172.21.15.6:0/220435230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e700aeb40 0x7f1e7015cef0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f1e700cee90 tx=0x7f1e6001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da3ffb9fd45806a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:08.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.207+0000 7f1e6effd640 1 -- 172.21.15.6:0/220435230 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e600ab600 con 0x7f1e700aeb40 2023-07-21T22:34:08.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.207+0000 7f1e6effd640 1 -- 172.21.15.6:0/220435230 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e600ab760 con 0x7f1e700aeb40 2023-07-21T22:34:08.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.207+0000 7f1e6effd640 1 -- 172.21.15.6:0/220435230 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e600abaf0 con 0x7f1e700aeb40 2023-07-21T22:34:08.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.207+0000 7f1e7660b640 1 -- 172.21.15.6:0/220435230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e700aeb40 msgr2=0x7f1e7015cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:08.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.207+0000 7f1e7660b640 1 --2- 172.21.15.6:0/220435230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e700aeb40 0x7f1e7015cef0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f1e700cee90 tx=0x7f1e6001c440 comp rx=0 tx=0).stop 2023-07-21T22:34:08.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.207+0000 7f1e7660b640 1 -- 172.21.15.6:0/220435230 shutdown_connections 2023-07-21T22:34:08.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.207+0000 7f1e7660b640 1 --2- 172.21.15.6:0/220435230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e70159270 0x7f1e700c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.207+0000 7f1e7660b640 1 --2- 172.21.15.6:0/220435230 >> v2:172.21.15.161:3300/0 conn(0x7f1e700aef10 0x7f1e70158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.207+0000 7f1e7660b640 1 --2- 172.21.15.6:0/220435230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e700aeb40 0x7f1e7015cef0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.207+0000 7f1e7660b640 1 -- 172.21.15.6:0/220435230 >> 172.21.15.6:0/220435230 conn(0x7f1e700cde90 msgr2=0x7f1e700ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:08.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.207+0000 7f1e7660b640 1 -- 172.21.15.6:0/220435230 shutdown_connections 2023-07-21T22:34:08.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.207+0000 7f1e7660b640 1 -- 172.21.15.6:0/220435230 wait complete. 2023-07-21T22:34:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.207+0000 7f1e7660b640 1 Processor -- start 2023-07-21T22:34:08.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e7660b640 1 -- start start 2023-07-21T22:34:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e7660b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e700aeb40 0x7f1e70156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e7660b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e700aef10 0x7f1e7014d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:08.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e7660b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e70159270 0x7f1e7014dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e7660b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7006bfa0 con 0x7f1e700aef10 2023-07-21T22:34:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e7660b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e701577b0 con 0x7f1e70159270 2023-07-21T22:34:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e7660b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7006b320 con 0x7f1e700aeb40 2023-07-21T22:34:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e6f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e700aef10 0x7f1e7014d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e6f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e700aef10 0x7f1e7014d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50252/0 (socket says 172.21.15.6:50252) 2023-07-21T22:34:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e6f7fe640 1 -- 172.21.15.6:0/2548715973 learned_addr learned my addr 172.21.15.6:0/2548715973 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:08.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e6ffff640 1 --2- 172.21.15.6:0/2548715973 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e700aeb40 0x7f1e70156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:08.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e74ba8640 1 --2- 172.21.15.6:0/2548715973 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e70159270 0x7f1e7014dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:08.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e6f7fe640 1 -- 172.21.15.6:0/2548715973 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e700aeb40 msgr2=0x7f1e70156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:08.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e6f7fe640 1 --2- 172.21.15.6:0/2548715973 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e700aeb40 0x7f1e70156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e6f7fe640 1 -- 172.21.15.6:0/2548715973 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e70159270 msgr2=0x7f1e7014dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:08.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e6f7fe640 1 --2- 172.21.15.6:0/2548715973 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e70159270 0x7f1e7014dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e6f7fe640 1 -- 172.21.15.6:0/2548715973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e600094d0 con 0x7f1e700aef10 2023-07-21T22:34:08.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e6f7fe640 1 --2- 172.21.15.6:0/2548715973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e700aef10 0x7f1e7014d720 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400e930 tx=0x7f1e6400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:08.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e6cff9640 1 -- 172.21.15.6:0/2548715973 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64009690 con 0x7f1e700aef10 2023-07-21T22:34:08.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e6cff9640 1 -- 172.21.15.6:0/2548715973 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6400ca00 con 0x7f1e700aef10 2023-07-21T22:34:08.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e6cff9640 1 -- 172.21.15.6:0/2548715973 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6400cd70 con 0x7f1e700aef10 2023-07-21T22:34:08.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e7660b640 1 -- 172.21.15.6:0/2548715973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7006b600 con 0x7f1e700aef10 2023-07-21T22:34:08.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e7660b640 1 -- 172.21.15.6:0/2548715973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7006bbc0 con 0x7f1e700aef10 2023-07-21T22:34:08.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.211+0000 7f1e7660b640 1 -- 172.21.15.6:0/2548715973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7006c0e0 con 0x7f1e700aef10 2023-07-21T22:34:08.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.215+0000 7f1e6cff9640 1 -- 172.21.15.6:0/2548715973 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f1e64013470 con 0x7f1e700aef10 2023-07-21T22:34:08.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.215+0000 7f1e6cff9640 1 -- 172.21.15.6:0/2548715973 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6924+0+0 (secure 0 0 0) 0x7f1e64083e10 con 0x7f1e700aef10 2023-07-21T22:34:08.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.219+0000 7f1e6cff9640 1 -- 172.21.15.6:0/2548715973 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1e7006c0e0 con 0x7f1e700aef10 2023-07-21T22:34:08.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.371+0000 7f1e7660b640 1 -- 172.21.15.6:0/2548715973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1e7006c0e0 con 0x7f1e700aef10 2023-07-21T22:34:08.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.371+0000 7f1e6cff9640 1 -- 172.21.15.6:0/2548715973 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1e64017020 con 0x7f1e700aef10 2023-07-21T22:34:08.422 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:34:08.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.375+0000 7f1e7660b640 1 -- 172.21.15.6:0/2548715973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e700aef10 msgr2=0x7f1e7014d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:08.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.375+0000 7f1e7660b640 1 --2- 172.21.15.6:0/2548715973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e700aef10 0x7f1e7014d720 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400e930 tx=0x7f1e6400edf0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.375+0000 7f1e7660b640 1 -- 172.21.15.6:0/2548715973 shutdown_connections 2023-07-21T22:34:08.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.375+0000 7f1e7660b640 1 --2- 172.21.15.6:0/2548715973 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e70159270 0x7f1e7014dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.375+0000 7f1e7660b640 1 --2- 172.21.15.6:0/2548715973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e700aef10 0x7f1e7014d720 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.375+0000 7f1e7660b640 1 --2- 172.21.15.6:0/2548715973 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e700aeb40 0x7f1e70156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.375+0000 7f1e7660b640 1 -- 172.21.15.6:0/2548715973 >> 172.21.15.6:0/2548715973 conn(0x7f1e700cde90 msgr2=0x7f1e700ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:08.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.375+0000 7f1e7660b640 1 -- 172.21.15.6:0/2548715973 shutdown_connections 2023-07-21T22:34:08.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.375+0000 7f1e7660b640 1 -- 172.21.15.6:0/2548715973 wait complete. 2023-07-21T22:34:08.443 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:34:08.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.539+0000 7f16a25fa640 1 Processor -- start 2023-07-21T22:34:08.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.539+0000 7f16a25fa640 1 -- start start 2023-07-21T22:34:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.543+0000 7f16a25fa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f169c069430 0x7f169c069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.543+0000 7f16a25fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f169c0af2b0 0x7f169c15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.543+0000 7f16a25fa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169c159d70 con 0x7f169c070f30 2023-07-21T22:34:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.543+0000 7f16a25fa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169c069d40 con 0x7f169c069430 2023-07-21T22:34:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.543+0000 7f16a25fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c0c9c60 con 0x7f169c0af2b0 2023-07-21T22:34:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.543+0000 7f169bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f169c069430 0x7f169c069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.543+0000 7f169bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f169c069430 0x7f169c069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50254/0 (socket says 172.21.15.6:50254) 2023-07-21T22:34:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.543+0000 7f169bfff640 1 -- 172.21.15.6:0/2277200295 learned_addr learned my addr 172.21.15.6:0/2277200295 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.543+0000 7f16a0b97640 1 --2- 172.21.15.6:0/2277200295 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f169c0af2b0 0x7f169c15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.543+0000 7f169bfff640 1 -- 172.21.15.6:0/2277200295 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f169c0af2b0 msgr2=0x7f169c15a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.543+0000 7f169bfff640 1 --2- 172.21.15.6:0/2277200295 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f169c0af2b0 0x7f169c15a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.543+0000 7f169bfff640 1 -- 172.21.15.6:0/2277200295 >> v1:172.21.15.161:6789/0 conn(0x7f169c070f30 legacy=0x7f169c0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.543+0000 7f169bfff640 1 -- 172.21.15.6:0/2277200295 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c0c9f40 con 0x7f169c069430 2023-07-21T22:34:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.547+0000 7f169bfff640 1 --2- 172.21.15.6:0/2277200295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f169c069430 0x7f169c069800 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f168c009870 tx=0x7f168c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2870477aa50905b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:08.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.547+0000 7f169affd640 1 -- 172.21.15.6:0/2277200295 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c0ab650 con 0x7f169c069430 2023-07-21T22:34:08.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.547+0000 7f169affd640 1 -- 172.21.15.6:0/2277200295 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c0ab7b0 con 0x7f169c069430 2023-07-21T22:34:08.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.547+0000 7f169affd640 1 -- 172.21.15.6:0/2277200295 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c0abb40 con 0x7f169c069430 2023-07-21T22:34:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.547+0000 7f16a25fa640 1 -- 172.21.15.6:0/2277200295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f169c069430 msgr2=0x7f169c069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.547+0000 7f16a25fa640 1 --2- 172.21.15.6:0/2277200295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f169c069430 0x7f169c069800 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f168c009870 tx=0x7f168c01c540 comp rx=0 tx=0).stop 2023-07-21T22:34:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.547+0000 7f16a25fa640 1 -- 172.21.15.6:0/2277200295 shutdown_connections 2023-07-21T22:34:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.547+0000 7f16a25fa640 1 --2- 172.21.15.6:0/2277200295 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f169c0af2b0 0x7f169c15a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.547+0000 7f16a25fa640 1 --2- 172.21.15.6:0/2277200295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f169c069430 0x7f169c069800 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.547+0000 7f16a25fa640 1 -- 172.21.15.6:0/2277200295 >> 172.21.15.6:0/2277200295 conn(0x7f169c0cde90 msgr2=0x7f169c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:08.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.547+0000 7f16a25fa640 1 -- 172.21.15.6:0/2277200295 shutdown_connections 2023-07-21T22:34:08.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.547+0000 7f16a25fa640 1 -- 172.21.15.6:0/2277200295 wait complete. 2023-07-21T22:34:08.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.547+0000 7f16a25fa640 1 Processor -- start 2023-07-21T22:34:08.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.547+0000 7f16a25fa640 1 -- start start 2023-07-21T22:34:08.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f16a25fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f169c069430 0x7f169c159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:08.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f16a25fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f169c070f30 0x7f169c0b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f16a25fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f169c0af2b0 0x7f169c151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f16a25fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c0b2350 con 0x7f169c070f30 2023-07-21T22:34:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f16a25fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c0b2580 con 0x7f169c0af2b0 2023-07-21T22:34:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f16a25fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c0b2860 con 0x7f169c069430 2023-07-21T22:34:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f169b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f169c070f30 0x7f169c0b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f169b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f169c070f30 0x7f169c0b1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50260/0 (socket says 172.21.15.6:50260) 2023-07-21T22:34:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f169b7fe640 1 -- 172.21.15.6:0/1294986486 learned_addr learned my addr 172.21.15.6:0/1294986486 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:08.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f169bfff640 1 --2- 172.21.15.6:0/1294986486 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f169c069430 0x7f169c159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:08.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f16a0b97640 1 --2- 172.21.15.6:0/1294986486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f169c0af2b0 0x7f169c151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f169b7fe640 1 -- 172.21.15.6:0/1294986486 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f169c069430 msgr2=0x7f169c159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f169b7fe640 1 --2- 172.21.15.6:0/1294986486 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f169c069430 0x7f169c159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f169b7fe640 1 -- 172.21.15.6:0/1294986486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f169c0af2b0 msgr2=0x7f169c151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f169b7fe640 1 --2- 172.21.15.6:0/1294986486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f169c0af2b0 0x7f169c151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f169b7fe640 1 -- 172.21.15.6:0/1294986486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c0094d0 con 0x7f169c070f30 2023-07-21T22:34:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f169b7fe640 1 --2- 172.21.15.6:0/1294986486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f169c070f30 0x7f169c0b1e10 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f169000c500 tx=0x7f169000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f1698ff9640 1 -- 172.21.15.6:0/1294986486 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1690005220 con 0x7f169c070f30 2023-07-21T22:34:08.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f1698ff9640 1 -- 172.21.15.6:0/1294986486 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1690005380 con 0x7f169c070f30 2023-07-21T22:34:08.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f16a25fa640 1 -- 172.21.15.6:0/1294986486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169c0b2b40 con 0x7f169c070f30 2023-07-21T22:34:08.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f1698ff9640 1 -- 172.21.15.6:0/1294986486 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1690007270 con 0x7f169c070f30 2023-07-21T22:34:08.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f16a25fa640 1 -- 172.21.15.6:0/1294986486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c0b3100 con 0x7f169c070f30 2023-07-21T22:34:08.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.551+0000 7f16a25fa640 1 -- 172.21.15.6:0/1294986486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169c0b3320 con 0x7f169c070f30 2023-07-21T22:34:08.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.555+0000 7f1698ff9640 1 -- 172.21.15.6:0/1294986486 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f16900073d0 con 0x7f169c070f30 2023-07-21T22:34:08.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.555+0000 7f1698ff9640 1 -- 172.21.15.6:0/1294986486 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6924+0+0 (secure 0 0 0) 0x7f1690083290 con 0x7f169c070f30 2023-07-21T22:34:08.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.559+0000 7f1698ff9640 1 -- 172.21.15.6:0/1294986486 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1690050740 con 0x7f169c070f30 2023-07-21T22:34:08.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.611+0000 7f1698ff9640 1 -- 172.21.15.6:0/1294986486 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 25) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f16900501f0 con 0x7f169c070f30 2023-07-21T22:34:08.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.611+0000 7f1698ff9640 1 --2- 172.21.15.6:0/1294986486 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f168806c280 0x7f168806e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:08.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.611+0000 7f169bfff640 1 --2- 172.21.15.6:0/1294986486 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f168806c280 0x7f168806e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:08.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.615+0000 7f169bfff640 1 --2- 172.21.15.6:0/1294986486 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f168806c280 0x7f168806e660 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f168c0af000 tx=0x7f168c0b6040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:08.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.719+0000 7f16a25fa640 1 -- 172.21.15.6:0/1294986486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f169c159d70 con 0x7f169c070f30 2023-07-21T22:34:08.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.719+0000 7f1698ff9640 1 -- 172.21.15.6:0/1294986486 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f169c159d70 con 0x7f169c070f30 2023-07-21T22:34:08.769 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:34:08.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.719+0000 7f16a25fa640 1 -- 172.21.15.6:0/1294986486 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f168806c280 msgr2=0x7f168806e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.719+0000 7f16a25fa640 1 --2- 172.21.15.6:0/1294986486 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f168806c280 0x7f168806e660 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f168c0af000 tx=0x7f168c0b6040 comp rx=0 tx=0).stop 2023-07-21T22:34:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.719+0000 7f16a25fa640 1 -- 172.21.15.6:0/1294986486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f169c070f30 msgr2=0x7f169c0b1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.719+0000 7f16a25fa640 1 --2- 172.21.15.6:0/1294986486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f169c070f30 0x7f169c0b1e10 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f169000c500 tx=0x7f169000c9c0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.719+0000 7f16a25fa640 1 -- 172.21.15.6:0/1294986486 shutdown_connections 2023-07-21T22:34:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.719+0000 7f16a25fa640 1 --2- 172.21.15.6:0/1294986486 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f168806c280 0x7f168806e660 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.719+0000 7f16a25fa640 1 --2- 172.21.15.6:0/1294986486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f169c0af2b0 0x7f169c151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.719+0000 7f16a25fa640 1 --2- 172.21.15.6:0/1294986486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f169c070f30 0x7f169c0b1e10 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.719+0000 7f16a25fa640 1 --2- 172.21.15.6:0/1294986486 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f169c069430 0x7f169c159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.719+0000 7f16a25fa640 1 -- 172.21.15.6:0/1294986486 >> 172.21.15.6:0/1294986486 conn(0x7f169c0cde90 msgr2=0x7f169c156920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:08.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.719+0000 7f16a25fa640 1 -- 172.21.15.6:0/1294986486 shutdown_connections 2023-07-21T22:34:08.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.723+0000 7f16a25fa640 1 -- 172.21.15.6:0/1294986486 wait complete. 2023-07-21T22:34:08.790 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:34:08.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.883+0000 7f1a0b034640 1 Processor -- start 2023-07-21T22:34:08.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.883+0000 7f1a0b034640 1 -- start start 2023-07-21T22:34:08.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.887+0000 7f1a0b034640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1a0415fd60 0x7f1a040d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:08.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.887+0000 7f1a0b034640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a040ccaf0 con 0x7f1a040d1850 2023-07-21T22:34:08.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.887+0000 7f1a0b034640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a04160320 con 0x7f1a040b7c70 2023-07-21T22:34:08.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.887+0000 7f1a0b034640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a040d1190 con 0x7f1a0415fd60 2023-07-21T22:34:08.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.887+0000 7f1a095d1640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1a040d1850 0x7f1a040d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55496/0 (socket says 172.21.15.6:55496) 2023-07-21T22:34:08.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.887+0000 7f1a095d1640 1 -- 172.21.15.6:0/1343785298 learned_addr learned my addr 172.21.15.6:0/1343785298 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:08.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.887+0000 7f1a03fff640 1 --2- 172.21.15.6:0/1343785298 >> v2:172.21.15.6:3300/0 conn(0x7f1a0415fd60 0x7f1a040d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:08.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.887+0000 7f1a037fe640 1 -- 172.21.15.6:0/1343785298 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946632075 0 0) 0x7f1a040ccaf0 con 0x7f1a040d1850 2023-07-21T22:34:08.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.887+0000 7f1a037fe640 1 -- 172.21.15.6:0/1343785298 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19f4003530 con 0x7f1a040d1850 2023-07-21T22:34:08.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.887+0000 7f1a037fe640 1 -- 172.21.15.6:0/1343785298 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269950017 0 0) 0x7f1a04160320 con 0x7f1a040b7c70 2023-07-21T22:34:08.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.887+0000 7f1a03fff640 1 -- 172.21.15.6:0/1343785298 >> v1:172.21.15.161:6789/0 conn(0x7f1a040b7c70 legacy=0x7f1a0415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:08.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.887+0000 7f1a03fff640 1 -- 172.21.15.6:0/1343785298 >> v1:172.21.15.6:6789/0 conn(0x7f1a040d1850 legacy=0x7f1a040d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:08.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.887+0000 7f1a03fff640 1 -- 172.21.15.6:0/1343785298 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a040ccd90 con 0x7f1a0415fd60 2023-07-21T22:34:08.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.891+0000 7f1a03fff640 1 --2- 172.21.15.6:0/1343785298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a0415fd60 0x7f1a040d0c50 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f19f00097c0 tx=0x7f19f001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75cd4e481c940d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:08.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.891+0000 7f1a037fe640 1 -- 172.21.15.6:0/1343785298 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f00a8050 con 0x7f1a0415fd60 2023-07-21T22:34:08.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.891+0000 7f1a037fe640 1 -- 172.21.15.6:0/1343785298 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f00ac5f0 con 0x7f1a0415fd60 2023-07-21T22:34:08.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.891+0000 7f1a037fe640 1 -- 172.21.15.6:0/1343785298 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f00ac980 con 0x7f1a0415fd60 2023-07-21T22:34:08.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.891+0000 7f1a0b034640 1 -- 172.21.15.6:0/1343785298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a0415fd60 msgr2=0x7f1a040d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:08.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.891+0000 7f1a0b034640 1 --2- 172.21.15.6:0/1343785298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a0415fd60 0x7f1a040d0c50 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f19f00097c0 tx=0x7f19f001c480 comp rx=0 tx=0).stop 2023-07-21T22:34:08.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.891+0000 7f1a0b034640 1 -- 172.21.15.6:0/1343785298 shutdown_connections 2023-07-21T22:34:08.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.891+0000 7f1a0b034640 1 --2- 172.21.15.6:0/1343785298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a0415fd60 0x7f1a040d0c50 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.891+0000 7f1a0b034640 1 -- 172.21.15.6:0/1343785298 >> 172.21.15.6:0/1343785298 conn(0x7f1a040650b0 msgr2=0x7f1a040654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:08.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.891+0000 7f1a0b034640 1 -- 172.21.15.6:0/1343785298 shutdown_connections 2023-07-21T22:34:08.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.891+0000 7f1a0b034640 1 -- 172.21.15.6:0/1343785298 wait complete. 2023-07-21T22:34:08.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.891+0000 7f1a0b034640 1 Processor -- start 2023-07-21T22:34:08.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.891+0000 7f1a0b034640 1 -- start start 2023-07-21T22:34:08.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a0b034640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a040b7c70 0x7f1a0414b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a0b034640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a040d1850 0x7f1a0414eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a0b034640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a0415fd60 0x7f1a040b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a0b034640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0414f0e0 con 0x7f1a040b7c70 2023-07-21T22:34:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a0b034640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a040b6bb0 con 0x7f1a040d1850 2023-07-21T22:34:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a0b034640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a040b6e90 con 0x7f1a0415fd60 2023-07-21T22:34:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a08dd0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a040b7c70 0x7f1a0414b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a08dd0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a040b7c70 0x7f1a0414b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50278/0 (socket says 172.21.15.6:50278) 2023-07-21T22:34:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a08dd0640 1 -- 172.21.15.6:0/1550824456 learned_addr learned my addr 172.21.15.6:0/1550824456 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a03fff640 1 --2- 172.21.15.6:0/1550824456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a040d1850 0x7f1a0414eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a095d1640 1 --2- 172.21.15.6:0/1550824456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a0415fd60 0x7f1a040b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:08.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a08dd0640 1 -- 172.21.15.6:0/1550824456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a0415fd60 msgr2=0x7f1a040b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:08.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a08dd0640 1 --2- 172.21.15.6:0/1550824456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a0415fd60 0x7f1a040b62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a08dd0640 1 -- 172.21.15.6:0/1550824456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a040d1850 msgr2=0x7f1a0414eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:08.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a08dd0640 1 --2- 172.21.15.6:0/1550824456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a040d1850 0x7f1a0414eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:08.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a08dd0640 1 -- 172.21.15.6:0/1550824456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f0009420 con 0x7f1a040b7c70 2023-07-21T22:34:08.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a08dd0640 1 --2- 172.21.15.6:0/1550824456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a040b7c70 0x7f1a0414b8c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f19f8001ec0 tx=0x7f19f800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:08.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a017fa640 1 -- 172.21.15.6:0/1550824456 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f80054e0 con 0x7f1a040b7c70 2023-07-21T22:34:08.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a017fa640 1 -- 172.21.15.6:0/1550824456 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f8003600 con 0x7f1a040b7c70 2023-07-21T22:34:08.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a017fa640 1 -- 172.21.15.6:0/1550824456 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f80039b0 con 0x7f1a040b7c70 2023-07-21T22:34:08.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a0b034640 1 -- 172.21.15.6:0/1550824456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0414d480 con 0x7f1a040b7c70 2023-07-21T22:34:08.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a0b034640 1 -- 172.21.15.6:0/1550824456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a040b67f0 con 0x7f1a040b7c70 2023-07-21T22:34:08.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.895+0000 7f1a0b034640 1 -- 172.21.15.6:0/1550824456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a040c9220 con 0x7f1a040b7c70 2023-07-21T22:34:08.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.899+0000 7f1a017fa640 1 -- 172.21.15.6:0/1550824456 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f19f8003b10 con 0x7f1a040b7c70 2023-07-21T22:34:08.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.899+0000 7f1a017fa640 1 --2- 172.21.15.6:0/1550824456 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f19e80660d0 0x7f19e8068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:08.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.899+0000 7f1a017fa640 1 -- 172.21.15.6:0/1550824456 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6924+0+0 (secure 0 0 0) 0x7f19f80831f0 con 0x7f1a040b7c70 2023-07-21T22:34:08.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.899+0000 7f1a03fff640 1 --2- 172.21.15.6:0/1550824456 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f19e80660d0 0x7f19e8068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:08.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.899+0000 7f1a03fff640 1 --2- 172.21.15.6:0/1550824456 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f19e80660d0 0x7f19e8068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f19f00ae000 tx=0x7f19f00a7000 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:08.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:08.903+0000 7f1a017fa640 1 -- 172.21.15.6:0/1550824456 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f19f8050700 con 0x7f1a040b7c70 2023-07-21T22:34:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.091+0000 7f1a0b034640 1 -- 172.21.15.6:0/1550824456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a040678d0 con 0x7f1a040b7c70 2023-07-21T22:34:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.091+0000 7f1a017fa640 1 -- 172.21.15.6:0/1550824456 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f19f8017090 con 0x7f1a040b7c70 2023-07-21T22:34:09.141 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:09.142 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/2410607534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2410607534},{"type":"v1","addr":"172.21.15.161:6836","nonce":2410607534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/3696372013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":3696372013},{"type":"v1","addr":"172.21.15.161:6837","nonce":3696372013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6042,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/4134919456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4134919456},{"type":"v1","addr":"172.21.15.6:6833","nonce":4134919456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:32:01.334074+0000","modified":"2023-07-21T22:32:04.955966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6045},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6045":{"gid":6045,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2511103099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2511103099},{"type":"v1","addr":"172.21.15.6:6835","nonce":2511103099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-21T22:34:09.142 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 24 2023-07-21T22:34:09.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.095+0000 7f1a0b034640 1 -- 172.21.15.6:0/1550824456 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f19e80660d0 msgr2=0x7f19e8068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:09.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.095+0000 7f1a0b034640 1 --2- 172.21.15.6:0/1550824456 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f19e80660d0 0x7f19e8068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f19f00ae000 tx=0x7f19f00a7000 comp rx=0 tx=0).stop 2023-07-21T22:34:09.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.095+0000 7f1a0b034640 1 -- 172.21.15.6:0/1550824456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a040b7c70 msgr2=0x7f1a0414b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:09.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.095+0000 7f1a0b034640 1 --2- 172.21.15.6:0/1550824456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a040b7c70 0x7f1a0414b8c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f19f8001ec0 tx=0x7f19f800c8e0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.095+0000 7f1a0b034640 1 -- 172.21.15.6:0/1550824456 shutdown_connections 2023-07-21T22:34:09.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.095+0000 7f1a0b034640 1 --2- 172.21.15.6:0/1550824456 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f19e80660d0 0x7f19e8068580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.095+0000 7f1a0b034640 1 --2- 172.21.15.6:0/1550824456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a0415fd60 0x7f1a040b62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.095+0000 7f1a0b034640 1 --2- 172.21.15.6:0/1550824456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a040d1850 0x7f1a0414eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.095+0000 7f1a0b034640 1 --2- 172.21.15.6:0/1550824456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a040b7c70 0x7f1a0414b8c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.095+0000 7f1a0b034640 1 -- 172.21.15.6:0/1550824456 >> 172.21.15.6:0/1550824456 conn(0x7f1a040650b0 msgr2=0x7f1a0415f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:09.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.095+0000 7f1a0b034640 1 -- 172.21.15.6:0/1550824456 shutdown_connections 2023-07-21T22:34:09.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.095+0000 7f1a0b034640 1 -- 172.21.15.6:0/1550824456 wait complete. 2023-07-21T22:34:09.162 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:34:09.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.255+0000 7f1e4c448640 1 Processor -- start 2023-07-21T22:34:09.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.255+0000 7f1e4c448640 1 -- start start 2023-07-21T22:34:09.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e4c448640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1e4406b1e0 0x7f1e440c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e4c448640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e440c21f0 0x7f1e440cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e4c448640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e440cac70 con 0x7f1e44070b70 2023-07-21T22:34:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e4c448640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e440ca060 con 0x7f1e4406b1e0 2023-07-21T22:34:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e4c448640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440ca340 con 0x7f1e440c21f0 2023-07-21T22:34:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e4a1e4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1e44070b70 0x7f1e44070f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55510/0 (socket says 172.21.15.6:55510) 2023-07-21T22:34:09.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e4a1e4640 1 -- 172.21.15.6:0/811613816 learned_addr learned my addr 172.21.15.6:0/811613816 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e4a9e5640 1 --2- 172.21.15.6:0/811613816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e440c21f0 0x7f1e440cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e499e3640 1 --2- 172.21.15.6:0/811613816 >> v2:172.21.15.161:3300/0 conn(0x7f1e4406b1e0 0x7f1e440c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e491e2640 1 -- 172.21.15.6:0/811613816 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1151189167 0 0) 0x7f1e440cac70 con 0x7f1e44070b70 2023-07-21T22:34:09.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e491e2640 1 -- 172.21.15.6:0/811613816 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e30003530 con 0x7f1e44070b70 2023-07-21T22:34:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e491e2640 1 -- 172.21.15.6:0/811613816 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3053484033 0 0) 0x7f1e30003530 con 0x7f1e44070b70 2023-07-21T22:34:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e491e2640 1 -- 172.21.15.6:0/811613816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e440c21f0 msgr2=0x7f1e440cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e491e2640 1 --2- 172.21.15.6:0/811613816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e440c21f0 0x7f1e440cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e491e2640 1 -- 172.21.15.6:0/811613816 >> v2:172.21.15.161:3300/0 conn(0x7f1e4406b1e0 msgr2=0x7f1e440c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e491e2640 1 --2- 172.21.15.6:0/811613816 >> v2:172.21.15.161:3300/0 conn(0x7f1e4406b1e0 0x7f1e440c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e491e2640 1 -- 172.21.15.6:0/811613816 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e440ca620 con 0x7f1e44070b70 2023-07-21T22:34:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e491e2640 1 -- 172.21.15.6:0/811613816 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f1e40001680 con 0x7f1e44070b70 2023-07-21T22:34:09.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e491e2640 1 -- 172.21.15.6:0/811613816 >> v1:172.21.15.6:6789/0 conn(0x7f1e44070b70 legacy=0x7f1e44070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:09.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e491e2640 1 --2- 172.21.15.6:0/811613816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e440c21f0 0x7f1e30003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:09.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e491e2640 1 --2- 172.21.15.6:0/811613816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e30003f00 0x7f1e300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:09.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e491e2640 1 --2- 172.21.15.6:0/811613816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e30004d10 0x7f1e30005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:09.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e491e2640 1 -- 172.21.15.6:0/811613816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440ca060 con 0x7f1e30003f00 2023-07-21T22:34:09.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e491e2640 1 -- 172.21.15.6:0/811613816 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440ca340 con 0x7f1e30004d10 2023-07-21T22:34:09.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e491e2640 1 -- 172.21.15.6:0/811613816 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3000b990 con 0x7f1e440c21f0 2023-07-21T22:34:09.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e499e3640 1 --2- 172.21.15.6:0/811613816 >> v2:172.21.15.161:3300/0 conn(0x7f1e4406b1e0 0x7f1e440c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:09.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e499e3640 1 --2- 172.21.15.6:0/811613816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e30003f00 0x7f1e300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:09.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e4a1e4640 1 --2- 172.21.15.6:0/811613816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e440c21f0 0x7f1e30003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:09.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e4a9e5640 1 --2- 172.21.15.6:0/811613816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e30004d10 0x7f1e30005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:09.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e499e3640 1 -- 172.21.15.6:0/811613816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e440c21f0 msgr2=0x7f1e30003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:09.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e499e3640 1 --2- 172.21.15.6:0/811613816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e440c21f0 0x7f1e30003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e499e3640 1 -- 172.21.15.6:0/811613816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e30004d10 msgr2=0x7f1e30005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:09.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e499e3640 1 --2- 172.21.15.6:0/811613816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e30004d10 0x7f1e30005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.259+0000 7f1e499e3640 1 -- 172.21.15.6:0/811613816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e30003530 con 0x7f1e30003f00 2023-07-21T22:34:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.263+0000 7f1e499e3640 1 --2- 172.21.15.6:0/811613816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e30003f00 0x7f1e300047d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009c90 tx=0x7f1e3401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84160e4b77dfb63 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.263+0000 7f1e491e2640 1 -- 172.21.15.6:0/811613816 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34004020 con 0x7f1e30003f00 2023-07-21T22:34:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.263+0000 7f1e491e2640 1 -- 172.21.15.6:0/811613816 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e34004180 con 0x7f1e30003f00 2023-07-21T22:34:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.263+0000 7f1e491e2640 1 -- 172.21.15.6:0/811613816 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e340a5910 con 0x7f1e30003f00 2023-07-21T22:34:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.263+0000 7f1e4c448640 1 -- 172.21.15.6:0/811613816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e30003f00 msgr2=0x7f1e300047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:09.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.263+0000 7f1e4c448640 1 --2- 172.21.15.6:0/811613816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e30003f00 0x7f1e300047d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009c90 tx=0x7f1e3401cc50 comp rx=0 tx=0).stop 2023-07-21T22:34:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.263+0000 7f1e4a9e5640 1 -- 172.21.15.6:0/811613816 reap_dead start 2023-07-21T22:34:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.263+0000 7f1e4c448640 1 -- 172.21.15.6:0/811613816 shutdown_connections 2023-07-21T22:34:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.263+0000 7f1e4c448640 1 -- 172.21.15.6:0/811613816 >> 172.21.15.6:0/811613816 conn(0x7f1e440afcf0 msgr2=0x7f1e440b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.263+0000 7f1e4c448640 1 -- 172.21.15.6:0/811613816 shutdown_connections 2023-07-21T22:34:09.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.263+0000 7f1e4c448640 1 -- 172.21.15.6:0/811613816 wait complete. 2023-07-21T22:34:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4c448640 1 Processor -- start 2023-07-21T22:34:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4c448640 1 -- start start 2023-07-21T22:34:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4c448640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e30003f00 0x7f1e44145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4c448640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e440af5c0 0x7f1e44144580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4c448640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e44144ac0 0x7f1e44143170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:09.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4c448640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440b2d50 con 0x7f1e30003f00 2023-07-21T22:34:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4c448640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e44144f30 con 0x7f1e44144ac0 2023-07-21T22:34:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4c448640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440c52e0 con 0x7f1e440af5c0 2023-07-21T22:34:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4a1e4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e30003f00 0x7f1e44145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4a1e4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e30003f00 0x7f1e44145120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50304/0 (socket says 172.21.15.6:50304) 2023-07-21T22:34:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4a1e4640 1 -- 172.21.15.6:0/2536210603 learned_addr learned my addr 172.21.15.6:0/2536210603 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4a9e5640 1 --2- 172.21.15.6:0/2536210603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e44144ac0 0x7f1e44143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:09.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e499e3640 1 --2- 172.21.15.6:0/2536210603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e440af5c0 0x7f1e44144580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4a1e4640 1 -- 172.21.15.6:0/2536210603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e440af5c0 msgr2=0x7f1e44144580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4a1e4640 1 --2- 172.21.15.6:0/2536210603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e440af5c0 0x7f1e44144580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4a1e4640 1 -- 172.21.15.6:0/2536210603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e44144ac0 msgr2=0x7f1e44143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4a1e4640 1 --2- 172.21.15.6:0/2536210603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e44144ac0 0x7f1e44143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4a1e4640 1 -- 172.21.15.6:0/2536210603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e440b2a70 con 0x7f1e30003f00 2023-07-21T22:34:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e499e3640 1 --2- 172.21.15.6:0/2536210603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e440af5c0 0x7f1e44144580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:09.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4a9e5640 1 --2- 172.21.15.6:0/2536210603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e44144ac0 0x7f1e44143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4a1e4640 1 --2- 172.21.15.6:0/2536210603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e30003f00 0x7f1e44145120 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1e40012570 tx=0x7f1e40012a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e3affd640 1 -- 172.21.15.6:0/2536210603 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e40014810 con 0x7f1e30003f00 2023-07-21T22:34:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e3affd640 1 -- 172.21.15.6:0/2536210603 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e40014970 con 0x7f1e30003f00 2023-07-21T22:34:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e3affd640 1 -- 172.21.15.6:0/2536210603 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e40014d00 con 0x7f1e30003f00 2023-07-21T22:34:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4c448640 1 -- 172.21.15.6:0/2536210603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e44142690 con 0x7f1e30003f00 2023-07-21T22:34:09.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4c448640 1 -- 172.21.15.6:0/2536210603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e44142c50 con 0x7f1e30003f00 2023-07-21T22:34:09.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.267+0000 7f1e4c448640 1 -- 172.21.15.6:0/2536210603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e441424f0 con 0x7f1e30003f00 2023-07-21T22:34:09.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.271+0000 7f1e3affd640 1 -- 172.21.15.6:0/2536210603 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f1e40016480 con 0x7f1e30003f00 2023-07-21T22:34:09.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.271+0000 7f1e3affd640 1 --2- 172.21.15.6:0/2536210603 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f1e28066100 0x7f1e280685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:09.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.271+0000 7f1e3affd640 1 -- 172.21.15.6:0/2536210603 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6924+0+0 (secure 0 0 0) 0x7f1e40087110 con 0x7f1e30003f00 2023-07-21T22:34:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.271+0000 7f1e499e3640 1 --2- 172.21.15.6:0/2536210603 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f1e28066100 0x7f1e280685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:09.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.271+0000 7f1e499e3640 1 --2- 172.21.15.6:0/2536210603 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f1e28066100 0x7f1e280685b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1e340ae000 tx=0x7f1e340046d0 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.275+0000 7f1e3affd640 1 -- 172.21.15.6:0/2536210603 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1e441424f0 con 0x7f1e30003f00 2023-07-21T22:34:09.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.431+0000 7f1e4c448640 1 -- 172.21.15.6:0/2536210603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e441424f0 con 0x7f1e30003f00 2023-07-21T22:34:09.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.431+0000 7f1e3affd640 1 -- 172.21.15.6:0/2536210603 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+19535 (secure 0 0 0) 0x7f1e441424f0 con 0x7f1e30003f00 2023-07-21T22:34:09.481 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:09.481 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":72,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:34:07.600918+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:31:59.449200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-21T22:32:00.321692+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":72,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.17","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:6833/582015960":"2023-07-22T22:34:07.600844+0000","172.21.15.161:6832/582015960":"2023-07-22T22:34:07.600844+0000","172.21.15.161:0/1324975330":"2023-07-22T22:34:07.600844+0000","172.21.15.161:0/130845545":"2023-07-22T22:34:07.600844+0000","172.21.15.161:0/2153344840":"2023-07-22T22:34:07.600844+0000","172.21.15.161:0/3766901966":"2023-07-22T22:34:07.600844+0000","172.21.15.161:0/4118602024":"2023-07-22T22:34:07.600844+0000","172.21.15.161:0/4288088570":"2023-07-22T22:32:18.530764+0000","172.21.15.161:0/3084502217":"2023-07-22T22:34:07.600844+0000","172.21.15.161:0/3254934176":"2023-07-22T22:32:18.530764+0000","172.21.15.161:0/2578585244":"2023-07-22T22:32:18.530764+0000","172.21.15.161:0/1830979956":"2023-07-22T22:32:18.530764+0000","172.21.15.161:0/4294109256":"2023-07-22T22:32:18.530764+0000","172.21.15.161:0/986370314":"2023-07-22T22:32:18.530764+0000","172.21.15.161:6833/3740183048":"2023-07-22T22:32:18.530764+0000","172.21.15.161:6832/3740183048":"2023-07-22T22:32:18.530764+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:34:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.431+0000 7f1e4c448640 1 -- 172.21.15.6:0/2536210603 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f1e28066100 msgr2=0x7f1e280685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.431+0000 7f1e4c448640 1 --2- 172.21.15.6:0/2536210603 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f1e28066100 0x7f1e280685b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1e340ae000 tx=0x7f1e340046d0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.431+0000 7f1e4c448640 1 -- 172.21.15.6:0/2536210603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e30003f00 msgr2=0x7f1e44145120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.431+0000 7f1e4c448640 1 --2- 172.21.15.6:0/2536210603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e30003f00 0x7f1e44145120 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1e40012570 tx=0x7f1e40012a30 comp rx=0 tx=0).stop 2023-07-21T22:34:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.431+0000 7f1e4c448640 1 -- 172.21.15.6:0/2536210603 shutdown_connections 2023-07-21T22:34:09.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.431+0000 7f1e4c448640 1 --2- 172.21.15.6:0/2536210603 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f1e28066100 0x7f1e280685b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.431+0000 7f1e4c448640 1 --2- 172.21.15.6:0/2536210603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e44144ac0 0x7f1e44143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.431+0000 7f1e4c448640 1 --2- 172.21.15.6:0/2536210603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1e440af5c0 0x7f1e44144580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.431+0000 7f1e4c448640 1 --2- 172.21.15.6:0/2536210603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e30003f00 0x7f1e44145120 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.431+0000 7f1e4c448640 1 -- 172.21.15.6:0/2536210603 >> 172.21.15.6:0/2536210603 conn(0x7f1e440afcf0 msgr2=0x7f1e440cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:09.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.435+0000 7f1e4c448640 1 -- 172.21.15.6:0/2536210603 shutdown_connections 2023-07-21T22:34:09.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.435+0000 7f1e4c448640 1 -- 172.21.15.6:0/2536210603 wait complete. 2023-07-21T22:34:09.502 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-21T22:34:09.502 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:34:09.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.595+0000 7f1755a26640 1 Processor -- start 2023-07-21T22:34:09.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.599+0000 7f1755a26640 1 -- start start 2023-07-21T22:34:09.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.599+0000 7f1755a26640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f175015f500 0x7f175006cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:09.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.599+0000 7f1755a26640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f175006d430 0x7f175006a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:09.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.599+0000 7f1755a26640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f175006aa80 0x7f17500b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:09.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.599+0000 7f1755a26640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175006af20 con 0x7f175006d430 2023-07-21T22:34:09.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.599+0000 7f1755a26640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17500cdc80 con 0x7f175006aa80 2023-07-21T22:34:09.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.599+0000 7f1755a26640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175006e4c0 con 0x7f175015f500 2023-07-21T22:34:09.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.599+0000 7f174e7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f175006d430 0x7f175006a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:09.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.599+0000 7f174e7fc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f175006d430 0x7f175006a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50312/0 (socket says 172.21.15.6:50312) 2023-07-21T22:34:09.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.599+0000 7f174e7fc640 1 -- 172.21.15.6:0/2360824232 learned_addr learned my addr 172.21.15.6:0/2360824232 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:09.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.599+0000 7f174f7fe640 1 --2- 172.21.15.6:0/2360824232 >> v2:172.21.15.161:3300/0 conn(0x7f175006aa80 0x7f17500b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:09.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.599+0000 7f174effd640 1 --2- 172.21.15.6:0/2360824232 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f175015f500 0x7f175006cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:09.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.599+0000 7f174e7fc640 1 -- 172.21.15.6:0/2360824232 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f175015f500 msgr2=0x7f175006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:09.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.599+0000 7f174e7fc640 1 --2- 172.21.15.6:0/2360824232 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f175015f500 0x7f175006cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.599+0000 7f174e7fc640 1 -- 172.21.15.6:0/2360824232 >> v2:172.21.15.161:3300/0 conn(0x7f175006aa80 msgr2=0x7f17500b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:09.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.599+0000 7f174e7fc640 1 --2- 172.21.15.6:0/2360824232 >> v2:172.21.15.161:3300/0 conn(0x7f175006aa80 0x7f17500b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.599+0000 7f174e7fc640 1 -- 172.21.15.6:0/2360824232 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175006d940 con 0x7f175006d430 2023-07-21T22:34:09.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.599+0000 7f174f7fe640 1 --2- 172.21.15.6:0/2360824232 >> v2:172.21.15.161:3300/0 conn(0x7f175006aa80 0x7f17500b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:09.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.603+0000 7f174e7fc640 1 --2- 172.21.15.6:0/2360824232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f175006d430 0x7f175006a540 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f17500713b0 tx=0x7f174401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a021d4bf9a1947 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:09.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.603+0000 7f174dffb640 1 -- 172.21.15.6:0/2360824232 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17440ab600 con 0x7f175006d430 2023-07-21T22:34:09.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.603+0000 7f174dffb640 1 -- 172.21.15.6:0/2360824232 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17440a7050 con 0x7f175006d430 2023-07-21T22:34:09.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.603+0000 7f174dffb640 1 -- 172.21.15.6:0/2360824232 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17440ab980 con 0x7f175006d430 2023-07-21T22:34:09.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.603+0000 7f1755a26640 1 -- 172.21.15.6:0/2360824232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f175006d430 msgr2=0x7f175006a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:09.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.603+0000 7f1755a26640 1 --2- 172.21.15.6:0/2360824232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f175006d430 0x7f175006a540 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f17500713b0 tx=0x7f174401c240 comp rx=0 tx=0).stop 2023-07-21T22:34:09.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.603+0000 7f1755a26640 1 -- 172.21.15.6:0/2360824232 shutdown_connections 2023-07-21T22:34:09.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.603+0000 7f1755a26640 1 --2- 172.21.15.6:0/2360824232 >> v2:172.21.15.161:3300/0 conn(0x7f175006aa80 0x7f17500b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.603+0000 7f1755a26640 1 --2- 172.21.15.6:0/2360824232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f175006d430 0x7f175006a540 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.603+0000 7f1755a26640 1 --2- 172.21.15.6:0/2360824232 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f175015f500 0x7f175006cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.603+0000 7f1755a26640 1 -- 172.21.15.6:0/2360824232 >> 172.21.15.6:0/2360824232 conn(0x7f17500659d0 msgr2=0x7f1750099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:09.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.603+0000 7f1755a26640 1 -- 172.21.15.6:0/2360824232 shutdown_connections 2023-07-21T22:34:09.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.603+0000 7f1755a26640 1 -- 172.21.15.6:0/2360824232 wait complete. 2023-07-21T22:34:09.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.603+0000 7f1755a26640 1 Processor -- start 2023-07-21T22:34:09.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.603+0000 7f1755a26640 1 -- start start 2023-07-21T22:34:09.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f1755a26640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f175006aa80 0x7f17500c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:09.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f1755a26640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f175006d430 0x7f17500ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:09.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f1755a26640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f175015f500 0x7f17500c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:09.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f1755a26640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175015d200 con 0x7f175006aa80 2023-07-21T22:34:09.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f1755a26640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175015c610 con 0x7f175015f500 2023-07-21T22:34:09.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f1755a26640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175015c8d0 con 0x7f175006d430 2023-07-21T22:34:09.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f174effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f175006aa80 0x7f17500c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:09.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f174effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f175006aa80 0x7f17500c7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50324/0 (socket says 172.21.15.6:50324) 2023-07-21T22:34:09.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f174effd640 1 -- 172.21.15.6:0/4150162345 learned_addr learned my addr 172.21.15.6:0/4150162345 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:09.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f174e7fc640 1 --2- 172.21.15.6:0/4150162345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f175006d430 0x7f17500ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:09.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f174f7fe640 1 --2- 172.21.15.6:0/4150162345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f175015f500 0x7f17500c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:09.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f174effd640 1 -- 172.21.15.6:0/4150162345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f175006d430 msgr2=0x7f17500ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:09.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f174effd640 1 --2- 172.21.15.6:0/4150162345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f175006d430 0x7f17500ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f174effd640 1 -- 172.21.15.6:0/4150162345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f175015f500 msgr2=0x7f17500c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:09.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f174effd640 1 --2- 172.21.15.6:0/4150162345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f175015f500 0x7f17500c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f174effd640 1 -- 172.21.15.6:0/4150162345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17440094d0 con 0x7f175006aa80 2023-07-21T22:34:09.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f174e7fc640 1 --2- 172.21.15.6:0/4150162345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f175006d430 0x7f17500ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:09.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f174effd640 1 --2- 172.21.15.6:0/4150162345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f175006aa80 0x7f17500c7a60 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f174000d7d0 tx=0x7f174000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:09.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f1737fff640 1 -- 172.21.15.6:0/4150162345 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174000b6c0 con 0x7f175006aa80 2023-07-21T22:34:09.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f1737fff640 1 -- 172.21.15.6:0/4150162345 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174000b820 con 0x7f175006aa80 2023-07-21T22:34:09.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f1755a26640 1 -- 172.21.15.6:0/4150162345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175015cbb0 con 0x7f175006aa80 2023-07-21T22:34:09.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f1737fff640 1 -- 172.21.15.6:0/4150162345 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174000bbd0 con 0x7f175006aa80 2023-07-21T22:34:09.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f1755a26640 1 -- 172.21.15.6:0/4150162345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1750159f20 con 0x7f175006aa80 2023-07-21T22:34:09.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.607+0000 7f1755a26640 1 -- 172.21.15.6:0/4150162345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17500678d0 con 0x7f175006aa80 2023-07-21T22:34:09.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.611+0000 7f1737fff640 1 -- 172.21.15.6:0/4150162345 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f174000bd30 con 0x7f175006aa80 2023-07-21T22:34:09.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.611+0000 7f1737fff640 1 --2- 172.21.15.6:0/4150162345 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f173c0660d0 0x7f173c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:09.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.611+0000 7f1737fff640 1 -- 172.21.15.6:0/4150162345 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6924+0+0 (secure 0 0 0) 0x7f17400842f0 con 0x7f175006aa80 2023-07-21T22:34:09.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.611+0000 7f174e7fc640 1 --2- 172.21.15.6:0/4150162345 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f173c0660d0 0x7f173c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:09.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.611+0000 7f174e7fc640 1 --2- 172.21.15.6:0/4150162345 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f173c0660d0 0x7f173c068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f17440ad000 tx=0x7f1744008040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:09.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.615+0000 7f1737fff640 1 -- 172.21.15.6:0/4150162345 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1740055090 con 0x7f175006aa80 2023-07-21T22:34:09.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.803+0000 7f1755a26640 1 -- 172.21.15.6:0/4150162345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17500c6f40 con 0x7f175006aa80 2023-07-21T22:34:09.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.803+0000 7f1737fff640 1 -- 172.21.15.6:0/4150162345 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f1740054c20 con 0x7f175006aa80 2023-07-21T22:34:09.854 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:09.854 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/2410607534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2410607534},{"type":"v1","addr":"172.21.15.161:6836","nonce":2410607534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/3696372013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":3696372013},{"type":"v1","addr":"172.21.15.161:6837","nonce":3696372013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6042,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/4134919456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4134919456},{"type":"v1","addr":"172.21.15.6:6833","nonce":4134919456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:32:01.334074+0000","modified":"2023-07-21T22:32:04.955966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6045},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6045":{"gid":6045,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2511103099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2511103099},{"type":"v1","addr":"172.21.15.6:6835","nonce":2511103099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-21T22:34:09.854 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 24 2023-07-21T22:34:09.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.807+0000 7f1755a26640 1 -- 172.21.15.6:0/4150162345 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f173c0660d0 msgr2=0x7f173c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:09.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.807+0000 7f1755a26640 1 --2- 172.21.15.6:0/4150162345 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f173c0660d0 0x7f173c068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f17440ad000 tx=0x7f1744008040 comp rx=0 tx=0).stop 2023-07-21T22:34:09.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.807+0000 7f1755a26640 1 -- 172.21.15.6:0/4150162345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f175006aa80 msgr2=0x7f17500c7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:09.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.807+0000 7f1755a26640 1 --2- 172.21.15.6:0/4150162345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f175006aa80 0x7f17500c7a60 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f174000d7d0 tx=0x7f174000dc90 comp rx=0 tx=0).stop 2023-07-21T22:34:09.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.807+0000 7f1755a26640 1 -- 172.21.15.6:0/4150162345 shutdown_connections 2023-07-21T22:34:09.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.807+0000 7f1755a26640 1 --2- 172.21.15.6:0/4150162345 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f173c0660d0 0x7f173c068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.807+0000 7f1755a26640 1 --2- 172.21.15.6:0/4150162345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f175015f500 0x7f17500c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.807+0000 7f1755a26640 1 --2- 172.21.15.6:0/4150162345 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f175006d430 0x7f17500ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.807+0000 7f1755a26640 1 --2- 172.21.15.6:0/4150162345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f175006aa80 0x7f17500c7a60 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:09.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.807+0000 7f1755a26640 1 -- 172.21.15.6:0/4150162345 >> 172.21.15.6:0/4150162345 conn(0x7f17500659d0 msgr2=0x7f17500cf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:09.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.807+0000 7f1755a26640 1 -- 172.21.15.6:0/4150162345 shutdown_connections 2023-07-21T22:34:09.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.807+0000 7f1755a26640 1 -- 172.21.15.6:0/4150162345 wait complete. 2023-07-21T22:34:09.874 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:34:10.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.975+0000 7f013df34640 1 Processor -- start 2023-07-21T22:34:10.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.975+0000 7f013df34640 1 -- start start 2023-07-21T22:34:10.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.975+0000 7f013df34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01380b7d90 0x7f01380cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:10.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.975+0000 7f013df34640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f01380d13f0 0x7f01380ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:10.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.975+0000 7f013df34640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01380d0f60 con 0x7f013815f3f0 2023-07-21T22:34:10.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.975+0000 7f013df34640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01380d0390 con 0x7f01380d13f0 2023-07-21T22:34:10.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.975+0000 7f013df34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01380d0630 con 0x7f01380b7d90 2023-07-21T22:34:10.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.975+0000 7f013d733640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f01380d13f0 0x7f01380ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:10.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.975+0000 7f013d733640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f01380d13f0 0x7f01380ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50330/0 (socket says 172.21.15.6:50330) 2023-07-21T22:34:10.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.975+0000 7f013d733640 1 -- 172.21.15.6:0/958538685 learned_addr learned my addr 172.21.15.6:0/958538685 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:10.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.975+0000 7f0137fff640 1 --2- 172.21.15.6:0/958538685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01380b7d90 0x7f01380cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:10.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.975+0000 7f013d733640 1 -- 172.21.15.6:0/958538685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01380b7d90 msgr2=0x7f01380cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:10.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.975+0000 7f013d733640 1 --2- 172.21.15.6:0/958538685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01380b7d90 0x7f01380cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.975+0000 7f013d733640 1 -- 172.21.15.6:0/958538685 >> v1:172.21.15.161:6789/0 conn(0x7f013815f3f0 legacy=0x7f01380b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:10.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.975+0000 7f013d733640 1 -- 172.21.15.6:0/958538685 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01380d0910 con 0x7f01380d13f0 2023-07-21T22:34:10.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.979+0000 7f013d733640 1 --2- 172.21.15.6:0/958538685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01380d13f0 0x7f01380ccee0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f0130009e50 tx=0x7f013001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81901a5b31267fbf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:10.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.979+0000 7f01377fe640 1 -- 172.21.15.6:0/958538685 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01300a5640 con 0x7f01380d13f0 2023-07-21T22:34:10.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.979+0000 7f01377fe640 1 -- 172.21.15.6:0/958538685 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01300a57a0 con 0x7f01380d13f0 2023-07-21T22:34:10.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.979+0000 7f01377fe640 1 -- 172.21.15.6:0/958538685 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01300a5b30 con 0x7f01380d13f0 2023-07-21T22:34:10.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.979+0000 7f013df34640 1 -- 172.21.15.6:0/958538685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01380d13f0 msgr2=0x7f01380ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:10.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.979+0000 7f013df34640 1 --2- 172.21.15.6:0/958538685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01380d13f0 0x7f01380ccee0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f0130009e50 tx=0x7f013001c940 comp rx=0 tx=0).stop 2023-07-21T22:34:10.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.979+0000 7f013df34640 1 -- 172.21.15.6:0/958538685 shutdown_connections 2023-07-21T22:34:10.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.979+0000 7f013df34640 1 --2- 172.21.15.6:0/958538685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01380d13f0 0x7f01380ccee0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.979+0000 7f013df34640 1 --2- 172.21.15.6:0/958538685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01380b7d90 0x7f01380cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.979+0000 7f013df34640 1 -- 172.21.15.6:0/958538685 >> 172.21.15.6:0/958538685 conn(0x7f0138069f50 msgr2=0x7f013806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:10.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.979+0000 7f013df34640 1 -- 172.21.15.6:0/958538685 shutdown_connections 2023-07-21T22:34:10.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.979+0000 7f013df34640 1 -- 172.21.15.6:0/958538685 wait complete. 2023-07-21T22:34:10.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013df34640 1 Processor -- start 2023-07-21T22:34:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013df34640 1 -- start start 2023-07-21T22:34:10.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013df34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01380b7d90 0x7f01380b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:10.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013df34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01380d13f0 0x7f0138160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:10.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013df34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f013815f3f0 0x7f0138156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:10.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013df34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01381581b0 con 0x7f01380b7d90 2023-07-21T22:34:10.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013df34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01381586b0 con 0x7f013815f3f0 2023-07-21T22:34:10.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013df34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0138156e30 con 0x7f01380d13f0 2023-07-21T22:34:10.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013cf32640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01380b7d90 0x7f01380b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:10.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013cf32640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01380b7d90 0x7f01380b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50338/0 (socket says 172.21.15.6:50338) 2023-07-21T22:34:10.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013cf32640 1 -- 172.21.15.6:0/2968244452 learned_addr learned my addr 172.21.15.6:0/2968244452 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:10.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f0137fff640 1 --2- 172.21.15.6:0/2968244452 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01380d13f0 0x7f0138160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:10.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013d733640 1 --2- 172.21.15.6:0/2968244452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f013815f3f0 0x7f0138156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:10.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013cf32640 1 -- 172.21.15.6:0/2968244452 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01380d13f0 msgr2=0x7f0138160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:10.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013cf32640 1 --2- 172.21.15.6:0/2968244452 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01380d13f0 0x7f0138160bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013cf32640 1 -- 172.21.15.6:0/2968244452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f013815f3f0 msgr2=0x7f0138156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:10.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013cf32640 1 --2- 172.21.15.6:0/2968244452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f013815f3f0 0x7f0138156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013cf32640 1 -- 172.21.15.6:0/2968244452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0130009b30 con 0x7f01380b7d90 2023-07-21T22:34:10.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f0137fff640 1 --2- 172.21.15.6:0/2968244452 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01380d13f0 0x7f0138160bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013d733640 1 --2- 172.21.15.6:0/2968244452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f013815f3f0 0x7f0138156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013cf32640 1 --2- 172.21.15.6:0/2968244452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01380b7d90 0x7f01380b2ce0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f012c00b410 tx=0x7f012c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f01357fa640 1 -- 172.21.15.6:0/2968244452 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c004020 con 0x7f01380b7d90 2023-07-21T22:34:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f01357fa640 1 -- 172.21.15.6:0/2968244452 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012c004180 con 0x7f01380b7d90 2023-07-21T22:34:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f01357fa640 1 -- 172.21.15.6:0/2968244452 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c011630 con 0x7f01380b7d90 2023-07-21T22:34:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013df34640 1 -- 172.21.15.6:0/2968244452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0138157110 con 0x7f01380b7d90 2023-07-21T22:34:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.983+0000 7f013df34640 1 -- 172.21.15.6:0/2968244452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01381576d0 con 0x7f01380b7d90 2023-07-21T22:34:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.987+0000 7f013df34640 1 -- 172.21.15.6:0/2968244452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01380678d0 con 0x7f01380b7d90 2023-07-21T22:34:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.987+0000 7f01357fa640 1 -- 172.21.15.6:0/2968244452 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f012c011790 con 0x7f01380b7d90 2023-07-21T22:34:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.987+0000 7f01357fa640 1 --2- 172.21.15.6:0/2968244452 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f011c0663a0 0x7f011c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.987+0000 7f01357fa640 1 -- 172.21.15.6:0/2968244452 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6924+0+0 (secure 0 0 0) 0x7f012c083fb0 con 0x7f01380b7d90 2023-07-21T22:34:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.987+0000 7f0137fff640 1 --2- 172.21.15.6:0/2968244452 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f011c0663a0 0x7f011c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.987+0000 7f0137fff640 1 --2- 172.21.15.6:0/2968244452 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f011c0663a0 0x7f011c068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0138158dc0 tx=0x7f0124008040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:09.991+0000 7f01357fa640 1 -- 172.21.15.6:0/2968244452 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f012c050fb0 con 0x7f01380b7d90 2023-07-21T22:34:10.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.179+0000 7f013df34640 1 -- 172.21.15.6:0/2968244452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01380b4870 con 0x7f01380b7d90 2023-07-21T22:34:10.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.179+0000 7f01357fa640 1 -- 172.21.15.6:0/2968244452 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f012c0545d0 con 0x7f01380b7d90 2023-07-21T22:34:10.230 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:10.230 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/2410607534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2410607534},{"type":"v1","addr":"172.21.15.161:6836","nonce":2410607534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/3696372013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":3696372013},{"type":"v1","addr":"172.21.15.161:6837","nonce":3696372013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6042,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/4134919456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4134919456},{"type":"v1","addr":"172.21.15.6:6833","nonce":4134919456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:32:01.334074+0000","modified":"2023-07-21T22:32:04.955966+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6045},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6045":{"gid":6045,"name":"a","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2511103099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2511103099},{"type":"v1","addr":"172.21.15.6:6835","nonce":2511103099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-21T22:34:10.230 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 24 2023-07-21T22:34:10.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.183+0000 7f013df34640 1 -- 172.21.15.6:0/2968244452 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f011c0663a0 msgr2=0x7f011c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:10.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.183+0000 7f013df34640 1 --2- 172.21.15.6:0/2968244452 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f011c0663a0 0x7f011c068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0138158dc0 tx=0x7f0124008040 comp rx=0 tx=0).stop 2023-07-21T22:34:10.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.183+0000 7f013df34640 1 -- 172.21.15.6:0/2968244452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01380b7d90 msgr2=0x7f01380b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:10.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.183+0000 7f013df34640 1 --2- 172.21.15.6:0/2968244452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01380b7d90 0x7f01380b2ce0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f012c00b410 tx=0x7f012c00b8d0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.183+0000 7f013df34640 1 -- 172.21.15.6:0/2968244452 shutdown_connections 2023-07-21T22:34:10.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.183+0000 7f013df34640 1 --2- 172.21.15.6:0/2968244452 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f011c0663a0 0x7f011c068850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.183+0000 7f013df34640 1 --2- 172.21.15.6:0/2968244452 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f013815f3f0 0x7f0138156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.183+0000 7f013df34640 1 --2- 172.21.15.6:0/2968244452 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01380d13f0 0x7f0138160bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.183+0000 7f013df34640 1 --2- 172.21.15.6:0/2968244452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01380b7d90 0x7f01380b2ce0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.183+0000 7f013df34640 1 -- 172.21.15.6:0/2968244452 >> 172.21.15.6:0/2968244452 conn(0x7f0138069f50 msgr2=0x7f01380d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.183+0000 7f013df34640 1 -- 172.21.15.6:0/2968244452 shutdown_connections 2023-07-21T22:34:10.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.183+0000 7f013df34640 1 -- 172.21.15.6:0/2968244452 wait complete. 2023-07-21T22:34:10.251 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:34:10.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.343+0000 7f88d2648640 1 Processor -- start 2023-07-21T22:34:10.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.343+0000 7f88d2648640 1 -- start start 2023-07-21T22:34:10.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.347+0000 7f88d2648640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f88cc06a540 0x7f88cc06a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:10.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.347+0000 7f88d2648640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88cc0ce0f0 0x7f88cc0ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:10.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.347+0000 7f88d2648640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88cc0cdc80 con 0x7f88cc15f500 2023-07-21T22:34:10.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.347+0000 7f88d2648640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88cc06af00 con 0x7f88cc06a540 2023-07-21T22:34:10.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.347+0000 7f88d2648640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc06e4c0 con 0x7f88cc0ce0f0 2023-07-21T22:34:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.347+0000 7f88cb7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f88cc06a540 0x7f88cc06a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.347+0000 7f88d0be5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88cc0ce0f0 0x7f88cc0ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.347+0000 7f88cb7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f88cc06a540 0x7f88cc06a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:43396/0 (socket says 172.21.15.6:43396) 2023-07-21T22:34:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.347+0000 7f88cb7fe640 1 -- 172.21.15.6:0/1981607658 learned_addr learned my addr 172.21.15.6:0/1981607658 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.347+0000 7f88d0be5640 1 -- 172.21.15.6:0/1981607658 >> v2:172.21.15.161:3300/0 conn(0x7f88cc06a540 msgr2=0x7f88cc06a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:10.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.347+0000 7f88d0be5640 1 --2- 172.21.15.6:0/1981607658 >> v2:172.21.15.161:3300/0 conn(0x7f88cc06a540 0x7f88cc06a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.347+0000 7f88d0be5640 1 -- 172.21.15.6:0/1981607658 >> v1:172.21.15.161:6789/0 conn(0x7f88cc15f500 legacy=0x7f88cc06cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:10.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.347+0000 7f88d0be5640 1 -- 172.21.15.6:0/1981607658 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc06d940 con 0x7f88cc0ce0f0 2023-07-21T22:34:10.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.347+0000 7f88cb7fe640 1 --2- 172.21.15.6:0/1981607658 >> v2:172.21.15.161:3300/0 conn(0x7f88cc06a540 0x7f88cc06a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:10.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.351+0000 7f88d0be5640 1 --2- 172.21.15.6:0/1981607658 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88cc0ce0f0 0x7f88cc0ce570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009d90 tx=0x7f88c401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f642906ebf2a5bd3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.351+0000 7f88caffd640 1 -- 172.21.15.6:0/1981607658 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c40a5900 con 0x7f88cc0ce0f0 2023-07-21T22:34:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.351+0000 7f88caffd640 1 -- 172.21.15.6:0/1981607658 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c40a5a60 con 0x7f88cc0ce0f0 2023-07-21T22:34:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.351+0000 7f88caffd640 1 -- 172.21.15.6:0/1981607658 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c40a5df0 con 0x7f88cc0ce0f0 2023-07-21T22:34:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.351+0000 7f88d2648640 1 -- 172.21.15.6:0/1981607658 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88cc0ce0f0 msgr2=0x7f88cc0ce570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.351+0000 7f88d2648640 1 --2- 172.21.15.6:0/1981607658 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88cc0ce0f0 0x7f88cc0ce570 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009d90 tx=0x7f88c401c950 comp rx=0 tx=0).stop 2023-07-21T22:34:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.351+0000 7f88d2648640 1 -- 172.21.15.6:0/1981607658 shutdown_connections 2023-07-21T22:34:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.351+0000 7f88d2648640 1 --2- 172.21.15.6:0/1981607658 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88cc0ce0f0 0x7f88cc0ce570 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.351+0000 7f88d2648640 1 --2- 172.21.15.6:0/1981607658 >> v2:172.21.15.161:3300/0 conn(0x7f88cc06a540 0x7f88cc06a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.351+0000 7f88d2648640 1 -- 172.21.15.6:0/1981607658 >> 172.21.15.6:0/1981607658 conn(0x7f88cc0659d0 msgr2=0x7f88cc099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.351+0000 7f88d2648640 1 -- 172.21.15.6:0/1981607658 shutdown_connections 2023-07-21T22:34:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.351+0000 7f88d2648640 1 -- 172.21.15.6:0/1981607658 wait complete. 2023-07-21T22:34:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.351+0000 7f88d2648640 1 Processor -- start 2023-07-21T22:34:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.351+0000 7f88d2648640 1 -- start start 2023-07-21T22:34:10.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88d2648640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88cc06a540 0x7f88cc0c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:10.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88d2648640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88cc0ce0f0 0x7f88cc155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:10.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88d2648640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88cc15f500 0x7f88cc0c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:10.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88d2648640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc0c9be0 con 0x7f88cc0ce0f0 2023-07-21T22:34:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88d2648640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc0c9e30 con 0x7f88cc06a540 2023-07-21T22:34:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88d2648640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc0c4900 con 0x7f88cc15f500 2023-07-21T22:34:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88cb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88cc0ce0f0 0x7f88cc155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88cb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88cc0ce0f0 0x7f88cc155f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50350/0 (socket says 172.21.15.6:50350) 2023-07-21T22:34:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88cb7fe640 1 -- 172.21.15.6:0/2705370393 learned_addr learned my addr 172.21.15.6:0/2705370393 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88cbfff640 1 --2- 172.21.15.6:0/2705370393 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88cc06a540 0x7f88cc0c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88d0be5640 1 --2- 172.21.15.6:0/2705370393 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88cc15f500 0x7f88cc0c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88cb7fe640 1 -- 172.21.15.6:0/2705370393 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88cc15f500 msgr2=0x7f88cc0c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88cb7fe640 1 --2- 172.21.15.6:0/2705370393 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88cc15f500 0x7f88cc0c7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88cb7fe640 1 -- 172.21.15.6:0/2705370393 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88cc06a540 msgr2=0x7f88cc0c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88cb7fe640 1 --2- 172.21.15.6:0/2705370393 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88cc06a540 0x7f88cc0c3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88cb7fe640 1 -- 172.21.15.6:0/2705370393 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c00094d0 con 0x7f88cc0ce0f0 2023-07-21T22:34:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88cb7fe640 1 --2- 172.21.15.6:0/2705370393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88cc0ce0f0 0x7f88cc155f10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f88c000e9d0 tx=0x7f88c000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:10.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88c8ff9640 1 -- 172.21.15.6:0/2705370393 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c000ca60 con 0x7f88cc0ce0f0 2023-07-21T22:34:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88c8ff9640 1 -- 172.21.15.6:0/2705370393 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c000cbc0 con 0x7f88cc0ce0f0 2023-07-21T22:34:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88c8ff9640 1 -- 172.21.15.6:0/2705370393 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0013470 con 0x7f88cc0ce0f0 2023-07-21T22:34:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88d2648640 1 -- 172.21.15.6:0/2705370393 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c4009a70 con 0x7f88cc0ce0f0 2023-07-21T22:34:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88d2648640 1 -- 172.21.15.6:0/2705370393 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88cc0c4340 con 0x7f88cc0ce0f0 2023-07-21T22:34:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88d2648640 1 -- 172.21.15.6:0/2705370393 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88cc0c4760 con 0x7f88cc0ce0f0 2023-07-21T22:34:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.355+0000 7f88c8ff9640 1 -- 172.21.15.6:0/2705370393 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f88c00135d0 con 0x7f88cc0ce0f0 2023-07-21T22:34:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.359+0000 7f88c8ff9640 1 --2- 172.21.15.6:0/2705370393 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f88b80663a0 0x7f88b8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.359+0000 7f88c8ff9640 1 -- 172.21.15.6:0/2705370393 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6924+0+0 (secure 0 0 0) 0x7f88c0084430 con 0x7f88cc0ce0f0 2023-07-21T22:34:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.359+0000 7f88cbfff640 1 --2- 172.21.15.6:0/2705370393 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f88b80663a0 0x7f88b8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.359+0000 7f88cbfff640 1 --2- 172.21.15.6:0/2705370393 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f88b80663a0 0x7f88b8068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0c6600 tx=0x7f88bc009040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.363+0000 7f88c8ff9640 1 -- 172.21.15.6:0/2705370393 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f88cc0c4760 con 0x7f88cc0ce0f0 2023-07-21T22:34:10.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.519+0000 7f88d2648640 1 -- 172.21.15.6:0/2705370393 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88cc0c4760 con 0x7f88cc0ce0f0 2023-07-21T22:34:10.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.519+0000 7f88c8ff9640 1 -- 172.21.15.6:0/2705370393 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+19535 (secure 0 0 0) 0x7f88cc0c4760 con 0x7f88cc0ce0f0 2023-07-21T22:34:10.571 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:10.571 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":72,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:34:07.600918+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:31:59.449200+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-21T22:32:00.321692+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":72,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.c","mappings":[{"from":0,"to":6}]},{"pgid":"8.17","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:6833/582015960":"2023-07-22T22:34:07.600844+0000","172.21.15.161:6832/582015960":"2023-07-22T22:34:07.600844+0000","172.21.15.161:0/1324975330":"2023-07-22T22:34:07.600844+0000","172.21.15.161:0/130845545":"2023-07-22T22:34:07.600844+0000","172.21.15.161:0/2153344840":"2023-07-22T22:34:07.600844+0000","172.21.15.161:0/3766901966":"2023-07-22T22:34:07.600844+0000","172.21.15.161:0/4118602024":"2023-07-22T22:34:07.600844+0000","172.21.15.161:0/4288088570":"2023-07-22T22:32:18.530764+0000","172.21.15.161:0/3084502217":"2023-07-22T22:34:07.600844+0000","172.21.15.161:0/3254934176":"2023-07-22T22:32:18.530764+0000","172.21.15.161:0/2578585244":"2023-07-22T22:32:18.530764+0000","172.21.15.161:0/1830979956":"2023-07-22T22:32:18.530764+0000","172.21.15.161:0/4294109256":"2023-07-22T22:32:18.530764+0000","172.21.15.161:0/986370314":"2023-07-22T22:32:18.530764+0000","172.21.15.161:6833/3740183048":"2023-07-22T22:32:18.530764+0000","172.21.15.161:6832/3740183048":"2023-07-22T22:32:18.530764+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:34:10.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.523+0000 7f88d2648640 1 -- 172.21.15.6:0/2705370393 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f88b80663a0 msgr2=0x7f88b8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:10.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.523+0000 7f88d2648640 1 --2- 172.21.15.6:0/2705370393 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f88b80663a0 0x7f88b8068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0c6600 tx=0x7f88bc009040 comp rx=0 tx=0).stop 2023-07-21T22:34:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.523+0000 7f88d2648640 1 -- 172.21.15.6:0/2705370393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88cc0ce0f0 msgr2=0x7f88cc155f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.523+0000 7f88d2648640 1 --2- 172.21.15.6:0/2705370393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88cc0ce0f0 0x7f88cc155f10 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f88c000e9d0 tx=0x7f88c000ee90 comp rx=0 tx=0).stop 2023-07-21T22:34:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.523+0000 7f88d2648640 1 -- 172.21.15.6:0/2705370393 shutdown_connections 2023-07-21T22:34:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.523+0000 7f88d2648640 1 --2- 172.21.15.6:0/2705370393 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f88b80663a0 0x7f88b8068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.523+0000 7f88d2648640 1 --2- 172.21.15.6:0/2705370393 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88cc15f500 0x7f88cc0c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.523+0000 7f88d2648640 1 --2- 172.21.15.6:0/2705370393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88cc0ce0f0 0x7f88cc155f10 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.523+0000 7f88d2648640 1 --2- 172.21.15.6:0/2705370393 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88cc06a540 0x7f88cc0c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.523+0000 7f88d2648640 1 -- 172.21.15.6:0/2705370393 >> 172.21.15.6:0/2705370393 conn(0x7f88cc0659d0 msgr2=0x7f88cc06cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.523+0000 7f88d2648640 1 -- 172.21.15.6:0/2705370393 shutdown_connections 2023-07-21T22:34:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.523+0000 7f88d2648640 1 -- 172.21.15.6:0/2705370393 wait complete. 2023-07-21T22:34:10.592 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-21T22:34:10.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.687+0000 7efec09d2640 1 Processor -- start 2023-07-21T22:34:10.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.687+0000 7efec09d2640 1 -- start start 2023-07-21T22:34:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.687+0000 7efec09d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efebc15f3f0 0x7efebc0b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.687+0000 7efec09d2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efebc0d13f0 0x7efebc0b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.687+0000 7efec09d2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efebc0cc9a0 0x7efebc0ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.687+0000 7efec09d2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efebc0d0f60 con 0x7efebc0cc9a0 2023-07-21T22:34:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.687+0000 7efec09d2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efebc0d0390 con 0x7efebc0d13f0 2023-07-21T22:34:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.687+0000 7efec09d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0d0630 con 0x7efebc15f3f0 2023-07-21T22:34:10.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.687+0000 7efebbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efebc0cc9a0 0x7efebc0ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:10.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.687+0000 7efebbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efebc0cc9a0 0x7efebc0ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50352/0 (socket says 172.21.15.6:50352) 2023-07-21T22:34:10.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.687+0000 7efebbfff640 1 -- 172.21.15.6:0/46015574 learned_addr learned my addr 172.21.15.6:0/46015574 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:10.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.687+0000 7efebaffd640 1 --2- 172.21.15.6:0/46015574 >> v2:172.21.15.161:3300/0 conn(0x7efebc0d13f0 0x7efebc0b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:10.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.687+0000 7efebb7fe640 1 --2- 172.21.15.6:0/46015574 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efebc15f3f0 0x7efebc0b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:10.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.691+0000 7efebbfff640 1 -- 172.21.15.6:0/46015574 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efebc15f3f0 msgr2=0x7efebc0b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:10.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.691+0000 7efebbfff640 1 --2- 172.21.15.6:0/46015574 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efebc15f3f0 0x7efebc0b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.691+0000 7efebbfff640 1 -- 172.21.15.6:0/46015574 >> v2:172.21.15.161:3300/0 conn(0x7efebc0d13f0 msgr2=0x7efebc0b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:10.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.691+0000 7efebbfff640 1 --2- 172.21.15.6:0/46015574 >> v2:172.21.15.161:3300/0 conn(0x7efebc0d13f0 0x7efebc0b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.691+0000 7efebbfff640 1 -- 172.21.15.6:0/46015574 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc0d0910 con 0x7efebc0cc9a0 2023-07-21T22:34:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.691+0000 7efebbfff640 1 --2- 172.21.15.6:0/46015574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efebc0cc9a0 0x7efebc0ccdd0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7efebc066090 tx=0x7efeb401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b6f2bc6519fe82 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.691+0000 7efeba7fc640 1 -- 172.21.15.6:0/46015574 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb40a5640 con 0x7efebc0cc9a0 2023-07-21T22:34:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.691+0000 7efeba7fc640 1 -- 172.21.15.6:0/46015574 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb40a57a0 con 0x7efebc0cc9a0 2023-07-21T22:34:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.691+0000 7efeba7fc640 1 -- 172.21.15.6:0/46015574 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb40a5b30 con 0x7efebc0cc9a0 2023-07-21T22:34:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.691+0000 7efec09d2640 1 -- 172.21.15.6:0/46015574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efebc0cc9a0 msgr2=0x7efebc0ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.691+0000 7efec09d2640 1 --2- 172.21.15.6:0/46015574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efebc0cc9a0 0x7efebc0ccdd0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7efebc066090 tx=0x7efeb401c940 comp rx=0 tx=0).stop 2023-07-21T22:34:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.691+0000 7efec09d2640 1 -- 172.21.15.6:0/46015574 shutdown_connections 2023-07-21T22:34:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.691+0000 7efec09d2640 1 --2- 172.21.15.6:0/46015574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efebc0cc9a0 0x7efebc0ccdd0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.691+0000 7efec09d2640 1 --2- 172.21.15.6:0/46015574 >> v2:172.21.15.161:3300/0 conn(0x7efebc0d13f0 0x7efebc0b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.691+0000 7efec09d2640 1 --2- 172.21.15.6:0/46015574 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efebc15f3f0 0x7efebc0b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.691+0000 7efec09d2640 1 -- 172.21.15.6:0/46015574 >> 172.21.15.6:0/46015574 conn(0x7efebc069f50 msgr2=0x7efebc06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:10.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efec09d2640 1 -- 172.21.15.6:0/46015574 shutdown_connections 2023-07-21T22:34:10.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efec09d2640 1 -- 172.21.15.6:0/46015574 wait complete. 2023-07-21T22:34:10.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efec09d2640 1 Processor -- start 2023-07-21T22:34:10.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efec09d2640 1 -- start start 2023-07-21T22:34:10.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efec09d2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efebc0cc9a0 0x7efebc158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:10.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efec09d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efebc0d13f0 0x7efebc1516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:10.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efec09d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efebc15f3f0 0x7efebc0cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efec09d2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0c9290 con 0x7efebc0d13f0 2023-07-21T22:34:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efec09d2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0c9530 con 0x7efebc0cc9a0 2023-07-21T22:34:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efec09d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0c9810 con 0x7efebc15f3f0 2023-07-21T22:34:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efebaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efebc0d13f0 0x7efebc1516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efebaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efebc0d13f0 0x7efebc1516d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50354/0 (socket says 172.21.15.6:50354) 2023-07-21T22:34:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efebaffd640 1 -- 172.21.15.6:0/3855571121 learned_addr learned my addr 172.21.15.6:0/3855571121 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efebb7fe640 1 --2- 172.21.15.6:0/3855571121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efebc0cc9a0 0x7efebc158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efebbfff640 1 --2- 172.21.15.6:0/3855571121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efebc15f3f0 0x7efebc0cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efebaffd640 1 -- 172.21.15.6:0/3855571121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efebc15f3f0 msgr2=0x7efebc0cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efebaffd640 1 --2- 172.21.15.6:0/3855571121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efebc15f3f0 0x7efebc0cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efebaffd640 1 -- 172.21.15.6:0/3855571121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efebc0cc9a0 msgr2=0x7efebc158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efebaffd640 1 --2- 172.21.15.6:0/3855571121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efebc0cc9a0 0x7efebc158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efebaffd640 1 -- 172.21.15.6:0/3855571121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb4009b30 con 0x7efebc0d13f0 2023-07-21T22:34:10.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efebb7fe640 1 --2- 172.21.15.6:0/3855571121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efebc0cc9a0 0x7efebc158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:10.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efebaffd640 1 --2- 172.21.15.6:0/3855571121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efebc0d13f0 0x7efebc1516d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7efeb000d800 tx=0x7efeb000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:10.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efea3fff640 1 -- 172.21.15.6:0/3855571121 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb00096a0 con 0x7efebc0d13f0 2023-07-21T22:34:10.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efea3fff640 1 -- 172.21.15.6:0/3855571121 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb0009800 con 0x7efebc0d13f0 2023-07-21T22:34:10.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efec09d2640 1 -- 172.21.15.6:0/3855571121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efebc0c9af0 con 0x7efebc0d13f0 2023-07-21T22:34:10.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.695+0000 7efea3fff640 1 -- 172.21.15.6:0/3855571121 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb0009b70 con 0x7efebc0d13f0 2023-07-21T22:34:10.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.699+0000 7efec09d2640 1 -- 172.21.15.6:0/3855571121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efebc0ca0b0 con 0x7efebc0d13f0 2023-07-21T22:34:10.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.699+0000 7efec09d2640 1 -- 172.21.15.6:0/3855571121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efebc1f3ea0 con 0x7efebc0d13f0 2023-07-21T22:34:10.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.699+0000 7efea3fff640 1 -- 172.21.15.6:0/3855571121 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efeb0009cd0 con 0x7efebc0d13f0 2023-07-21T22:34:10.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.699+0000 7efea3fff640 1 --2- 172.21.15.6:0/3855571121 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7efea80663a0 0x7efea8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:10.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.699+0000 7efea3fff640 1 -- 172.21.15.6:0/3855571121 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6924+0+0 (secure 0 0 0) 0x7efeb0084930 con 0x7efebc0d13f0 2023-07-21T22:34:10.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.699+0000 7efebb7fe640 1 --2- 172.21.15.6:0/3855571121 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7efea80663a0 0x7efea8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:10.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.699+0000 7efebb7fe640 1 --2- 172.21.15.6:0/3855571121 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7efea80663a0 0x7efea8068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efebc1549c0 tx=0x7efeac008040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:10.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.703+0000 7efea3fff640 1 -- 172.21.15.6:0/3855571121 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efeb00518a0 con 0x7efebc0d13f0 2023-07-21T22:34:10.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.891+0000 7efec09d2640 1 -- 172.21.15.6:0/3855571121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efebc0678d0 con 0x7efebc0d13f0 2023-07-21T22:34:10.942 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-07-21T22:34:10.891+0000 7f195e836640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-21T22:34:10.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.903+0000 7efea3fff640 1 -- 172.21.15.6:0/3855571121 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7efeb0054ec0 con 0x7efebc0d13f0 2023-07-21T22:34:10.954 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-21T22:34:10.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.907+0000 7efec09d2640 1 -- 172.21.15.6:0/3855571121 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7efea80663a0 msgr2=0x7efea8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:10.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.907+0000 7efec09d2640 1 --2- 172.21.15.6:0/3855571121 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7efea80663a0 0x7efea8068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efebc1549c0 tx=0x7efeac008040 comp rx=0 tx=0).stop 2023-07-21T22:34:10.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.907+0000 7efec09d2640 1 -- 172.21.15.6:0/3855571121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efebc0d13f0 msgr2=0x7efebc1516d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:10.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.907+0000 7efec09d2640 1 --2- 172.21.15.6:0/3855571121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efebc0d13f0 0x7efebc1516d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7efeb000d800 tx=0x7efeb000dcc0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.907+0000 7efec09d2640 1 -- 172.21.15.6:0/3855571121 shutdown_connections 2023-07-21T22:34:10.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.907+0000 7efec09d2640 1 --2- 172.21.15.6:0/3855571121 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7efea80663a0 0x7efea8068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.907+0000 7efec09d2640 1 --2- 172.21.15.6:0/3855571121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efebc15f3f0 0x7efebc0cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.907+0000 7efec09d2640 1 --2- 172.21.15.6:0/3855571121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efebc0d13f0 0x7efebc1516d0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.907+0000 7efec09d2640 1 --2- 172.21.15.6:0/3855571121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efebc0cc9a0 0x7efebc158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:10.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.907+0000 7efec09d2640 1 -- 172.21.15.6:0/3855571121 >> 172.21.15.6:0/3855571121 conn(0x7efebc069f50 msgr2=0x7efebc15b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:10.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.907+0000 7efec09d2640 1 -- 172.21.15.6:0/3855571121 shutdown_connections 2023-07-21T22:34:10.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:10.907+0000 7efec09d2640 1 -- 172.21.15.6:0/3855571121 wait complete. 2023-07-21T22:34:10.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-21T22:34:11.031 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-07-21T22:34:11.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.087+0000 7f0b06f74640 1 Processor -- start 2023-07-21T22:34:11.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.087+0000 7f0b06f74640 1 -- start start 2023-07-21T22:34:11.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.087+0000 7f0b06f74640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b000ce620 0x7f0b000ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:11.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.087+0000 7f0b06f74640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0b0015c050 0x7f0b0015f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:11.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.087+0000 7f0b06f74640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b000c6140 con 0x7f0b0015fee0 2023-07-21T22:34:11.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.087+0000 7f0b06f74640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b0006c3f0 con 0x7f0b0015c050 2023-07-21T22:34:11.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.087+0000 7f0b06f74640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000cef30 con 0x7f0b000ce620 2023-07-21T22:34:11.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.087+0000 7f0afffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0b0015c050 0x7f0b0015f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:11.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.087+0000 7f0b04d10640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b000ce620 0x7f0b000ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:11.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.087+0000 7f0b05511640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0b0015fee0 0x7f0b0006e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:33820/0 (socket says 172.21.15.6:33820) 2023-07-21T22:34:11.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.087+0000 7f0b05511640 1 -- 172.21.15.6:0/2354459296 learned_addr learned my addr 172.21.15.6:0/2354459296 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:11.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.087+0000 7f0afffff640 1 -- 172.21.15.6:0/2354459296 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b000ce620 msgr2=0x7f0b000ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:11.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.087+0000 7f0afffff640 1 --2- 172.21.15.6:0/2354459296 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b000ce620 0x7f0b000ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:11.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.087+0000 7f0afffff640 1 -- 172.21.15.6:0/2354459296 >> v1:172.21.15.161:6789/0 conn(0x7f0b0015fee0 legacy=0x7f0b0006e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:11.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.087+0000 7f0afffff640 1 -- 172.21.15.6:0/2354459296 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0006dab0 con 0x7f0b0015c050 2023-07-21T22:34:11.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.091+0000 7f0afffff640 1 --2- 172.21.15.6:0/2354459296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b0015c050 0x7f0b0015f9a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0097c0 tx=0x7f0aec01c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7b209cf347ece19 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:11.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.091+0000 7f0aff7fe640 1 -- 172.21.15.6:0/2354459296 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec0ab600 con 0x7f0b0015c050 2023-07-21T22:34:11.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.091+0000 7f0aff7fe640 1 -- 172.21.15.6:0/2354459296 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aec0a7050 con 0x7f0b0015c050 2023-07-21T22:34:11.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.091+0000 7f0aff7fe640 1 -- 172.21.15.6:0/2354459296 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec0ab980 con 0x7f0b0015c050 2023-07-21T22:34:11.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.091+0000 7f0b06f74640 1 -- 172.21.15.6:0/2354459296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b0015c050 msgr2=0x7f0b0015f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:11.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.091+0000 7f0b06f74640 1 --2- 172.21.15.6:0/2354459296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b0015c050 0x7f0b0015f9a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0097c0 tx=0x7f0aec01c310 comp rx=0 tx=0).stop 2023-07-21T22:34:11.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.091+0000 7f0b06f74640 1 -- 172.21.15.6:0/2354459296 shutdown_connections 2023-07-21T22:34:11.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.091+0000 7f0b06f74640 1 --2- 172.21.15.6:0/2354459296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b0015c050 0x7f0b0015f9a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:11.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.091+0000 7f0b06f74640 1 --2- 172.21.15.6:0/2354459296 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b000ce620 0x7f0b000ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:11.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.091+0000 7f0b06f74640 1 -- 172.21.15.6:0/2354459296 >> 172.21.15.6:0/2354459296 conn(0x7f0b000cc9a0 msgr2=0x7f0b000cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:11.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.091+0000 7f0b06f74640 1 -- 172.21.15.6:0/2354459296 shutdown_connections 2023-07-21T22:34:11.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.091+0000 7f0b06f74640 1 -- 172.21.15.6:0/2354459296 wait complete. 2023-07-21T22:34:11.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b06f74640 1 Processor -- start 2023-07-21T22:34:11.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b06f74640 1 -- start start 2023-07-21T22:34:11.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b06f74640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b000ce620 0x7f0b0015f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:11.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b06f74640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b0015c050 0x7f0b001f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:11.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b06f74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b0015fee0 0x7f0b00155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:11.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b06f74640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000c55f0 con 0x7f0b0015fee0 2023-07-21T22:34:11.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b06f74640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b001f5210 con 0x7f0b0015c050 2023-07-21T22:34:11.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b06f74640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b001f54b0 con 0x7f0b000ce620 2023-07-21T22:34:11.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b05511640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b0015fee0 0x7f0b00155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:11.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0afffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b0015c050 0x7f0b001f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:11.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b05511640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b0015fee0 0x7f0b00155330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50376/0 (socket says 172.21.15.6:50376) 2023-07-21T22:34:11.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0afffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b0015c050 0x7f0b001f1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:43476/0 (socket says 172.21.15.6:43476) 2023-07-21T22:34:11.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b05511640 1 -- 172.21.15.6:0/2991697887 learned_addr learned my addr 172.21.15.6:0/2991697887 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:11.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b04d10640 1 --2- 172.21.15.6:0/2991697887 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b000ce620 0x7f0b0015f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:11.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b05511640 1 -- 172.21.15.6:0/2991697887 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b000ce620 msgr2=0x7f0b0015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:11.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b05511640 1 --2- 172.21.15.6:0/2991697887 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b000ce620 0x7f0b0015f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:11.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b05511640 1 -- 172.21.15.6:0/2991697887 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b0015c050 msgr2=0x7f0b001f1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:11.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b05511640 1 --2- 172.21.15.6:0/2991697887 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b0015c050 0x7f0b001f1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:11.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b05511640 1 -- 172.21.15.6:0/2991697887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec009420 con 0x7f0b0015fee0 2023-07-21T22:34:11.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b05511640 1 --2- 172.21.15.6:0/2991697887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b0015fee0 0x7f0b00155330 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f0af800e550 tx=0x7f0af800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:11.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0afd7fa640 1 -- 172.21.15.6:0/2991697887 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8009500 con 0x7f0b0015fee0 2023-07-21T22:34:11.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0afd7fa640 1 -- 172.21.15.6:0/2991697887 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af8009660 con 0x7f0b0015fee0 2023-07-21T22:34:11.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b06f74640 1 -- 172.21.15.6:0/2991697887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b001f2160 con 0x7f0b0015fee0 2023-07-21T22:34:11.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0afd7fa640 1 -- 172.21.15.6:0/2991697887 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8009a10 con 0x7f0b0015fee0 2023-07-21T22:34:11.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b06f74640 1 -- 172.21.15.6:0/2991697887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b001f26c0 con 0x7f0b0015fee0 2023-07-21T22:34:11.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.095+0000 7f0b06f74640 1 -- 172.21.15.6:0/2991697887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b001f5620 con 0x7f0b0015fee0 2023-07-21T22:34:11.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.099+0000 7f0afd7fa640 1 -- 172.21.15.6:0/2991697887 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0af8013480 con 0x7f0b0015fee0 2023-07-21T22:34:11.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.099+0000 7f0afd7fa640 1 --2- 172.21.15.6:0/2991697887 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f0ae40663a0 0x7f0ae4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:11.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.099+0000 7f0afd7fa640 1 -- 172.21.15.6:0/2991697887 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6966+0+0 (secure 0 0 0) 0x7f0af8087380 con 0x7f0b0015fee0 2023-07-21T22:34:11.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.099+0000 7f0b04d10640 1 --2- 172.21.15.6:0/2991697887 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f0ae40663a0 0x7f0ae4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:11.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.099+0000 7f0b04d10640 1 --2- 172.21.15.6:0/2991697887 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f0ae40663a0 0x7f0ae4068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009b60 tx=0x7f0af4009190 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:11.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.103+0000 7f0afd7fa640 1 -- 172.21.15.6:0/2991697887 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0af8054400 con 0x7f0b0015fee0 2023-07-21T22:34:11.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.287+0000 7f0b06f74640 1 -- 172.21.15.6:0/2991697887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0b000678d0 con 0x7f0b0015fee0 2023-07-21T22:34:11.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.911+0000 7f0afd7fa640 1 -- 172.21.15.6:0/2991697887 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0af8057a20 con 0x7f0b0015fee0 2023-07-21T22:34:11.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.915+0000 7f0b06f74640 1 -- 172.21.15.6:0/2991697887 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f0ae40663a0 msgr2=0x7f0ae4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:11.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.915+0000 7f0b06f74640 1 --2- 172.21.15.6:0/2991697887 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f0ae40663a0 0x7f0ae4068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009b60 tx=0x7f0af4009190 comp rx=0 tx=0).stop 2023-07-21T22:34:11.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.915+0000 7f0b06f74640 1 -- 172.21.15.6:0/2991697887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b0015fee0 msgr2=0x7f0b00155330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:11.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.915+0000 7f0b06f74640 1 --2- 172.21.15.6:0/2991697887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b0015fee0 0x7f0b00155330 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f0af800e550 tx=0x7f0af800ea10 comp rx=0 tx=0).stop 2023-07-21T22:34:11.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.915+0000 7f0b06f74640 1 -- 172.21.15.6:0/2991697887 shutdown_connections 2023-07-21T22:34:11.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.915+0000 7f0b06f74640 1 --2- 172.21.15.6:0/2991697887 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f0ae40663a0 0x7f0ae4068850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:11.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.915+0000 7f0b06f74640 1 --2- 172.21.15.6:0/2991697887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b0015fee0 0x7f0b00155330 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:11.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.915+0000 7f0b06f74640 1 --2- 172.21.15.6:0/2991697887 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b0015c050 0x7f0b001f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:11.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.915+0000 7f0b06f74640 1 --2- 172.21.15.6:0/2991697887 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b000ce620 0x7f0b0015f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:11.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.915+0000 7f0b06f74640 1 -- 172.21.15.6:0/2991697887 >> 172.21.15.6:0/2991697887 conn(0x7f0b000cc9a0 msgr2=0x7f0b000cb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:11.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.915+0000 7f0b06f74640 1 -- 172.21.15.6:0/2991697887 shutdown_connections 2023-07-21T22:34:11.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:11.915+0000 7f0b06f74640 1 -- 172.21.15.6:0/2991697887 wait complete. 2023-07-21T22:34:11.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-21T22:34:12.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.127+0000 7ff5d9848640 1 Processor -- start 2023-07-21T22:34:12.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.127+0000 7ff5d9848640 1 -- start start 2023-07-21T22:34:12.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.127+0000 7ff5d9848640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff5d4070f30 0x7ff5d40ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:12.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.127+0000 7ff5d9848640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d4159d70 con 0x7ff5d4069430 2023-07-21T22:34:12.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.127+0000 7ff5d9848640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d40c9c60 con 0x7ff5d40af2b0 2023-07-21T22:34:12.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.127+0000 7ff5d9848640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d40c9f40 con 0x7ff5d4070f30 2023-07-21T22:34:12.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.127+0000 7ff5cbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff5d4070f30 0x7ff5d40ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:12.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.127+0000 7ff5cbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff5d4070f30 0x7ff5d40ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50382/0 (socket says 172.21.15.6:50382) 2023-07-21T22:34:12.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.127+0000 7ff5cbfff640 1 -- 172.21.15.6:0/3835269222 learned_addr learned my addr 172.21.15.6:0/3835269222 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:12.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.127+0000 7ff5cbfff640 1 -- 172.21.15.6:0/3835269222 >> v1:172.21.15.161:6789/0 conn(0x7ff5d40af2b0 legacy=0x7ff5d415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:12.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.127+0000 7ff5cbfff640 1 -- 172.21.15.6:0/3835269222 >> v1:172.21.15.6:6789/0 conn(0x7ff5d4069430 legacy=0x7ff5d4069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:12.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.131+0000 7ff5cbfff640 1 -- 172.21.15.6:0/3835269222 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d40ca220 con 0x7ff5d4070f30 2023-07-21T22:34:12.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.131+0000 7ff5cbfff640 1 --2- 172.21.15.6:0/3835269222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5d4070f30 0x7ff5d40ad6f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009870 tx=0x7ff5bc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdb93d4b2224118 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:12.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.131+0000 7ff5d27fc640 1 -- 172.21.15.6:0/3835269222 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc0aa660 con 0x7ff5d4070f30 2023-07-21T22:34:12.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.131+0000 7ff5d27fc640 1 -- 172.21.15.6:0/3835269222 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc0aa7c0 con 0x7ff5d4070f30 2023-07-21T22:34:12.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.131+0000 7ff5d27fc640 1 -- 172.21.15.6:0/3835269222 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc0aab50 con 0x7ff5d4070f30 2023-07-21T22:34:12.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.131+0000 7ff5d9848640 1 -- 172.21.15.6:0/3835269222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5d4070f30 msgr2=0x7ff5d40ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:12.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.131+0000 7ff5d9848640 1 --2- 172.21.15.6:0/3835269222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5d4070f30 0x7ff5d40ad6f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009870 tx=0x7ff5bc01c500 comp rx=0 tx=0).stop 2023-07-21T22:34:12.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.131+0000 7ff5d9848640 1 -- 172.21.15.6:0/3835269222 shutdown_connections 2023-07-21T22:34:12.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.131+0000 7ff5d9848640 1 --2- 172.21.15.6:0/3835269222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5d4070f30 0x7ff5d40ad6f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:12.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.131+0000 7ff5d9848640 1 -- 172.21.15.6:0/3835269222 >> 172.21.15.6:0/3835269222 conn(0x7ff5d40cde90 msgr2=0x7ff5d40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:12.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.131+0000 7ff5d9848640 1 -- 172.21.15.6:0/3835269222 shutdown_connections 2023-07-21T22:34:12.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.131+0000 7ff5d9848640 1 -- 172.21.15.6:0/3835269222 wait complete. 2023-07-21T22:34:12.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d9848640 1 Processor -- start 2023-07-21T22:34:12.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d9848640 1 -- start start 2023-07-21T22:34:12.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d9848640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5d4069430 0x7ff5d40cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:12.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d9848640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5d4070f30 0x7ff5d40b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:12.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d9848640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5d40af2b0 0x7ff5d414db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:12.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d9848640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40b3d10 con 0x7ff5d4069430 2023-07-21T22:34:12.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d9848640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40c68b0 con 0x7ff5d4070f30 2023-07-21T22:34:12.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d9848640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40c6b90 con 0x7ff5d40af2b0 2023-07-21T22:34:12.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5d4069430 0x7ff5d40cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:12.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5d4069430 0x7ff5d40cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50390/0 (socket says 172.21.15.6:50390) 2023-07-21T22:34:12.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d2ffd640 1 -- 172.21.15.6:0/4090456340 learned_addr learned my addr 172.21.15.6:0/4090456340 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:12.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5cbfff640 1 --2- 172.21.15.6:0/4090456340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5d4070f30 0x7ff5d40b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:12.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d37fe640 1 --2- 172.21.15.6:0/4090456340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5d40af2b0 0x7ff5d414db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:12.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d2ffd640 1 -- 172.21.15.6:0/4090456340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5d40af2b0 msgr2=0x7ff5d414db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:12.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d2ffd640 1 --2- 172.21.15.6:0/4090456340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5d40af2b0 0x7ff5d414db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:12.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d2ffd640 1 -- 172.21.15.6:0/4090456340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5d4070f30 msgr2=0x7ff5d40b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:12.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d2ffd640 1 --2- 172.21.15.6:0/4090456340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5d4070f30 0x7ff5d40b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:12.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d2ffd640 1 -- 172.21.15.6:0/4090456340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc0094d0 con 0x7ff5d4069430 2023-07-21T22:34:12.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5cbfff640 1 --2- 172.21.15.6:0/4090456340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5d4070f30 0x7ff5d40b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:12.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d2ffd640 1 --2- 172.21.15.6:0/4090456340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5d4069430 0x7ff5d40cb150 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400c3c0 tx=0x7ff5c400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:12.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d0ff9640 1 -- 172.21.15.6:0/4090456340 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40052d0 con 0x7ff5d4069430 2023-07-21T22:34:12.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d0ff9640 1 -- 172.21.15.6:0/4090456340 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c4005430 con 0x7ff5d4069430 2023-07-21T22:34:12.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d0ff9640 1 -- 172.21.15.6:0/4090456340 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4003840 con 0x7ff5d4069430 2023-07-21T22:34:12.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d9848640 1 -- 172.21.15.6:0/4090456340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d40c6e70 con 0x7ff5d4069430 2023-07-21T22:34:12.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.135+0000 7ff5d9848640 1 -- 172.21.15.6:0/4090456340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d40c7430 con 0x7ff5d4069430 2023-07-21T22:34:12.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.139+0000 7ff5d9848640 1 -- 172.21.15.6:0/4090456340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d40678d0 con 0x7ff5d4069430 2023-07-21T22:34:12.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.139+0000 7ff5d0ff9640 1 -- 172.21.15.6:0/4090456340 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff5c40039a0 con 0x7ff5d4069430 2023-07-21T22:34:12.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.139+0000 7ff5d0ff9640 1 --2- 172.21.15.6:0/4090456340 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ff5b40663a0 0x7ff5b4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:12.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.139+0000 7ff5d0ff9640 1 -- 172.21.15.6:0/4090456340 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6966+0+0 (secure 0 0 0) 0x7ff5c4083650 con 0x7ff5d4069430 2023-07-21T22:34:12.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.139+0000 7ff5cbfff640 1 --2- 172.21.15.6:0/4090456340 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ff5b40663a0 0x7ff5b4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:12.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.139+0000 7ff5cbfff640 1 --2- 172.21.15.6:0/4090456340 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ff5b40663a0 0x7ff5b4068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0ae000 tx=0x7ff5bc0a7000 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:12.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.143+0000 7ff5d0ff9640 1 -- 172.21.15.6:0/4090456340 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5c4050590 con 0x7ff5d4069430 2023-07-21T22:34:12.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.299+0000 7ff5d9848640 1 -- 172.21.15.6:0/4090456340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff5d4159d70 con 0x7ff5d4069430 2023-07-21T22:34:12.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.803+0000 7ff5d0ff9640 1 -- 172.21.15.6:0/4090456340 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v74) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff5d4159d70 con 0x7ff5d4069430 2023-07-21T22:34:12.853 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-07-21T22:34:12.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.807+0000 7ff5d9848640 1 -- 172.21.15.6:0/4090456340 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ff5b40663a0 msgr2=0x7ff5b4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:12.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.807+0000 7ff5d9848640 1 --2- 172.21.15.6:0/4090456340 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ff5b40663a0 0x7ff5b4068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0ae000 tx=0x7ff5bc0a7000 comp rx=0 tx=0).stop 2023-07-21T22:34:12.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.807+0000 7ff5d9848640 1 -- 172.21.15.6:0/4090456340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5d4069430 msgr2=0x7ff5d40cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:12.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.807+0000 7ff5d9848640 1 --2- 172.21.15.6:0/4090456340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5d4069430 0x7ff5d40cb150 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400c3c0 tx=0x7ff5c400c880 comp rx=0 tx=0).stop 2023-07-21T22:34:12.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.807+0000 7ff5d9848640 1 -- 172.21.15.6:0/4090456340 shutdown_connections 2023-07-21T22:34:12.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.807+0000 7ff5d9848640 1 --2- 172.21.15.6:0/4090456340 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ff5b40663a0 0x7ff5b4068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:12.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.807+0000 7ff5d9848640 1 --2- 172.21.15.6:0/4090456340 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5d40af2b0 0x7ff5d414db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:12.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.807+0000 7ff5d9848640 1 --2- 172.21.15.6:0/4090456340 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5d4070f30 0x7ff5d40b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:12.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.807+0000 7ff5d9848640 1 --2- 172.21.15.6:0/4090456340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5d4069430 0x7ff5d40cb150 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:12.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.807+0000 7ff5d9848640 1 -- 172.21.15.6:0/4090456340 >> 172.21.15.6:0/4090456340 conn(0x7ff5d40cde90 msgr2=0x7ff5d406b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:12.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.807+0000 7ff5d9848640 1 -- 172.21.15.6:0/4090456340 shutdown_connections 2023-07-21T22:34:12.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.807+0000 7ff5d9848640 1 -- 172.21.15.6:0/4090456340 wait complete. 2023-07-21T22:34:12.880 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-21T22:34:13.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc98b11640 1 Processor -- start 2023-07-21T22:34:13.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc98b11640 1 -- start start 2023-07-21T22:34:13.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc98b11640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdc9415bde0 0x7fdc940d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc98b11640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc940b04c0 con 0x7fdc940d2300 2023-07-21T22:34:13.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc98b11640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc940b1060 con 0x7fdc940d2fc0 2023-07-21T22:34:13.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc98b11640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc9415c1b0 con 0x7fdc9415bde0 2023-07-21T22:34:13.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc92d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdc940d2300 0x7fdc940cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55542/0 (socket says 172.21.15.6:55542) 2023-07-21T22:34:13.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc92d9d640 1 -- 172.21.15.6:0/1740070971 learned_addr learned my addr 172.21.15.6:0/1740070971 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:13.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc9259c640 1 --2- 172.21.15.6:0/1740070971 >> v2:172.21.15.161:3300/0 conn(0x7fdc9415bde0 0x7fdc940d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc91d9b640 1 -- 172.21.15.6:0/1740070971 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790063190 0 0) 0x7fdc940b04c0 con 0x7fdc940d2300 2023-07-21T22:34:13.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc91d9b640 1 -- 172.21.15.6:0/1740070971 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc80003530 con 0x7fdc940d2300 2023-07-21T22:34:13.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc91d9b640 1 -- 172.21.15.6:0/1740070971 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 477448688 0 0) 0x7fdc80003530 con 0x7fdc940d2300 2023-07-21T22:34:13.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc91d9b640 1 -- 172.21.15.6:0/1740070971 >> v2:172.21.15.161:3300/0 conn(0x7fdc9415bde0 msgr2=0x7fdc940d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:13.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc91d9b640 1 --2- 172.21.15.6:0/1740070971 >> v2:172.21.15.161:3300/0 conn(0x7fdc9415bde0 0x7fdc940d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc91d9b640 1 -- 172.21.15.6:0/1740070971 >> v1:172.21.15.161:6789/0 conn(0x7fdc940d2fc0 legacy=0x7fdc940b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:13.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc91d9b640 1 -- 172.21.15.6:0/1740070971 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc940d0aa0 con 0x7fdc940d2300 2023-07-21T22:34:13.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc91d9b640 1 -- 172.21.15.6:0/1740070971 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fdc8c001a00 con 0x7fdc940d2300 2023-07-21T22:34:13.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc91d9b640 1 -- 172.21.15.6:0/1740070971 >> v1:172.21.15.6:6789/0 conn(0x7fdc940d2300 legacy=0x7fdc940cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:13.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc91d9b640 1 --2- 172.21.15.6:0/1740070971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc80003980 0x7fdc80003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc91d9b640 1 --2- 172.21.15.6:0/1740070971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc800047d0 0x7fdc80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc91d9b640 1 --2- 172.21.15.6:0/1740070971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc80005180 0x7fdc8000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc91d9b640 1 -- 172.21.15.6:0/1740070971 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9415c1b0 con 0x7fdc80005180 2023-07-21T22:34:13.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc91d9b640 1 -- 172.21.15.6:0/1740070971 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8000c000 con 0x7fdc800047d0 2023-07-21T22:34:13.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.983+0000 7fdc91d9b640 1 -- 172.21.15.6:0/1740070971 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8000c1c0 con 0x7fdc80003980 2023-07-21T22:34:13.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.987+0000 7fdc92d9d640 1 --2- 172.21.15.6:0/1740070971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc80005180 0x7fdc8000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.987+0000 7fdc9259c640 1 --2- 172.21.15.6:0/1740070971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc80003980 0x7fdc80003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.987+0000 7fdc8bfff640 1 --2- 172.21.15.6:0/1740070971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc800047d0 0x7fdc80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.987+0000 7fdc9259c640 1 -- 172.21.15.6:0/1740070971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc800047d0 msgr2=0x7fdc80004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:13.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.987+0000 7fdc9259c640 1 --2- 172.21.15.6:0/1740070971 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc800047d0 0x7fdc80004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.987+0000 7fdc9259c640 1 -- 172.21.15.6:0/1740070971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc80005180 msgr2=0x7fdc8000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:13.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.987+0000 7fdc9259c640 1 --2- 172.21.15.6:0/1740070971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc80005180 0x7fdc8000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.987+0000 7fdc9259c640 1 -- 172.21.15.6:0/1740070971 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc80003530 con 0x7fdc80003980 2023-07-21T22:34:13.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.987+0000 7fdc92d9d640 1 -- 172.21.15.6:0/1740070971 reap_dead start 2023-07-21T22:34:13.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.987+0000 7fdc9259c640 1 --2- 172.21.15.6:0/1740070971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc80003980 0x7fdc80003d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009ac0 tx=0x7fdc8401ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e894d7d4e57c2347 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:13.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.987+0000 7fdc91d9b640 1 -- 172.21.15.6:0/1740070971 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc840059a0 con 0x7fdc80003980 2023-07-21T22:34:13.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.987+0000 7fdc91d9b640 1 -- 172.21.15.6:0/1740070971 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc84005b00 con 0x7fdc80003980 2023-07-21T22:34:13.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.987+0000 7fdc91d9b640 1 -- 172.21.15.6:0/1740070971 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc84006030 con 0x7fdc80003980 2023-07-21T22:34:13.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc98b11640 1 -- 172.21.15.6:0/1740070971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc80003980 msgr2=0x7fdc80003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:13.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc98b11640 1 --2- 172.21.15.6:0/1740070971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc80003980 0x7fdc80003d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009ac0 tx=0x7fdc8401ca30 comp rx=0 tx=0).stop 2023-07-21T22:34:13.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc98b11640 1 -- 172.21.15.6:0/1740070971 shutdown_connections 2023-07-21T22:34:13.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc98b11640 1 --2- 172.21.15.6:0/1740070971 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc80003980 0x7fdc80003d90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc98b11640 1 -- 172.21.15.6:0/1740070971 >> 172.21.15.6:0/1740070971 conn(0x7fdc940659d0 msgr2=0x7fdc9409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:13.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc98b11640 1 -- 172.21.15.6:0/1740070971 shutdown_connections 2023-07-21T22:34:13.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc98b11640 1 -- 172.21.15.6:0/1740070971 wait complete. 2023-07-21T22:34:13.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc98b11640 1 Processor -- start 2023-07-21T22:34:13.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc98b11640 1 -- start start 2023-07-21T22:34:13.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc98b11640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc80003980 0x7fdc94147730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc98b11640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc940c7870 0x7fdc940c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc98b11640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc940aefc0 0x7fdc940af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc98b11640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc94158560 con 0x7fdc80003980 2023-07-21T22:34:13.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc98b11640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc940af970 con 0x7fdc940aefc0 2023-07-21T22:34:13.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc98b11640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc94147c70 con 0x7fdc940c7870 2023-07-21T22:34:13.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc9259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc80003980 0x7fdc94147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc9259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc80003980 0x7fdc94147730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50402/0 (socket says 172.21.15.6:50402) 2023-07-21T22:34:13.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc9259c640 1 -- 172.21.15.6:0/2948539677 learned_addr learned my addr 172.21.15.6:0/2948539677 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:13.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc92d9d640 1 --2- 172.21.15.6:0/2948539677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc940aefc0 0x7fdc940af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc8bfff640 1 --2- 172.21.15.6:0/2948539677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc940c7870 0x7fdc940c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc9259c640 1 -- 172.21.15.6:0/2948539677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc940c7870 msgr2=0x7fdc940c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:13.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc9259c640 1 --2- 172.21.15.6:0/2948539677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc940c7870 0x7fdc940c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc9259c640 1 -- 172.21.15.6:0/2948539677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc940aefc0 msgr2=0x7fdc940af430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:13.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.991+0000 7fdc9259c640 1 --2- 172.21.15.6:0/2948539677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc940aefc0 0x7fdc940af430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.995+0000 7fdc9259c640 1 -- 172.21.15.6:0/2948539677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc940c82c0 con 0x7fdc80003980 2023-07-21T22:34:13.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.995+0000 7fdc92d9d640 1 --2- 172.21.15.6:0/2948539677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc940aefc0 0x7fdc940af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:13.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.995+0000 7fdc8bfff640 1 --2- 172.21.15.6:0/2948539677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc940c7870 0x7fdc940c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:13.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.995+0000 7fdc9259c640 1 --2- 172.21.15.6:0/2948539677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc80003980 0x7fdc94147730 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdc840af040 tx=0x7fdc840197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:13.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.995+0000 7fdc8affd640 1 -- 172.21.15.6:0/2948539677 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc84006730 con 0x7fdc80003980 2023-07-21T22:34:13.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.995+0000 7fdc8affd640 1 -- 172.21.15.6:0/2948539677 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc84006890 con 0x7fdc80003980 2023-07-21T22:34:13.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.995+0000 7fdc8affd640 1 -- 172.21.15.6:0/2948539677 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc84005e90 con 0x7fdc80003980 2023-07-21T22:34:13.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.995+0000 7fdc98b11640 1 -- 172.21.15.6:0/2948539677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc940c85a0 con 0x7fdc80003980 2023-07-21T22:34:13.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.995+0000 7fdc98b11640 1 -- 172.21.15.6:0/2948539677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc94158180 con 0x7fdc80003980 2023-07-21T22:34:13.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.995+0000 7fdc98b11640 1 -- 172.21.15.6:0/2948539677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc940678d0 con 0x7fdc80003980 2023-07-21T22:34:13.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.995+0000 7fdc8affd640 1 -- 172.21.15.6:0/2948539677 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdc840a5540 con 0x7fdc80003980 2023-07-21T22:34:13.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.995+0000 7fdc8affd640 1 --2- 172.21.15.6:0/2948539677 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fdc74066390 0x7fdc74068840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.995+0000 7fdc8affd640 1 -- 172.21.15.6:0/2948539677 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6528+0+0 (secure 0 0 0) 0x7fdc8411ed20 con 0x7fdc80003980 2023-07-21T22:34:13.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.999+0000 7fdc8bfff640 1 --2- 172.21.15.6:0/2948539677 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fdc74066390 0x7fdc74068840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.999+0000 7fdc8bfff640 1 --2- 172.21.15.6:0/2948539677 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fdc74066390 0x7fdc74068840 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c000c10 tx=0x7fdc7c009040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:13.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:12.999+0000 7fdc8affd640 1 -- 172.21.15.6:0/2948539677 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdc840ebf60 con 0x7fdc80003980 2023-07-21T22:34:13.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:13.163+0000 7fdc98b11640 1 -- 172.21.15.6:0/2948539677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdc940c8e20 con 0x7fdc80003980 2023-07-21T22:34:13.347 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:34:13.351 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:34:13.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:13.915+0000 7fdc8affd640 1 -- 172.21.15.6:0/2948539677 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v75) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdc840bc020 con 0x7fdc80003980 2023-07-21T22:34:13.966 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-07-21T22:34:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:13.919+0000 7fdc98b11640 1 -- 172.21.15.6:0/2948539677 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fdc74066390 msgr2=0x7fdc74068840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:13.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:13.919+0000 7fdc98b11640 1 --2- 172.21.15.6:0/2948539677 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fdc74066390 0x7fdc74068840 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c000c10 tx=0x7fdc7c009040 comp rx=0 tx=0).stop 2023-07-21T22:34:13.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:13.919+0000 7fdc98b11640 1 -- 172.21.15.6:0/2948539677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc80003980 msgr2=0x7fdc94147730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:13.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:13.919+0000 7fdc98b11640 1 --2- 172.21.15.6:0/2948539677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc80003980 0x7fdc94147730 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdc840af040 tx=0x7fdc840197d0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:13.919+0000 7fdc98b11640 1 -- 172.21.15.6:0/2948539677 shutdown_connections 2023-07-21T22:34:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:13.919+0000 7fdc98b11640 1 --2- 172.21.15.6:0/2948539677 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fdc74066390 0x7fdc74068840 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:13.919+0000 7fdc98b11640 1 --2- 172.21.15.6:0/2948539677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc940aefc0 0x7fdc940af430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:13.919+0000 7fdc98b11640 1 --2- 172.21.15.6:0/2948539677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc940c7870 0x7fdc940c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:13.919+0000 7fdc98b11640 1 --2- 172.21.15.6:0/2948539677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc80003980 0x7fdc94147730 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:13.919+0000 7fdc98b11640 1 -- 172.21.15.6:0/2948539677 >> 172.21.15.6:0/2948539677 conn(0x7fdc940659d0 msgr2=0x7fdc940b6220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:13.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:13.919+0000 7fdc98b11640 1 -- 172.21.15.6:0/2948539677 shutdown_connections 2023-07-21T22:34:13.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:13.919+0000 7fdc98b11640 1 -- 172.21.15.6:0/2948539677 wait complete. 2023-07-21T22:34:13.994 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-21T22:34:14.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.095+0000 7f63f2ed8640 1 Processor -- start 2023-07-21T22:34:14.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.095+0000 7f63f2ed8640 1 -- start start 2023-07-21T22:34:14.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.095+0000 7f63f2ed8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f63ec0ce620 0x7f63ec0ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:14.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.095+0000 7f63f2ed8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63ec15c050 0x7f63ec15f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:14.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.095+0000 7f63f2ed8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f63ec15fee0 0x7f63ec06e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:14.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.095+0000 7f63f2ed8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ec06c3f0 con 0x7f63ec15fee0 2023-07-21T22:34:14.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.095+0000 7f63f2ed8640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ec0c6140 con 0x7f63ec0ce620 2023-07-21T22:34:14.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.095+0000 7f63f2ed8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0cef30 con 0x7f63ec15c050 2023-07-21T22:34:14.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.095+0000 7f63f1475640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f63ec15fee0 0x7f63ec06e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:14.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.095+0000 7f63f1475640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f63ec15fee0 0x7f63ec06e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50418/0 (socket says 172.21.15.6:50418) 2023-07-21T22:34:14.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.095+0000 7f63f1475640 1 -- 172.21.15.6:0/3344864703 learned_addr learned my addr 172.21.15.6:0/3344864703 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:14.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.095+0000 7f63f0c74640 1 --2- 172.21.15.6:0/3344864703 >> v2:172.21.15.161:3300/0 conn(0x7f63ec0ce620 0x7f63ec0ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:14.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.095+0000 7f63ebfff640 1 --2- 172.21.15.6:0/3344864703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63ec15c050 0x7f63ec15f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:14.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.095+0000 7f63f1475640 1 -- 172.21.15.6:0/3344864703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63ec15c050 msgr2=0x7f63ec15f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:14.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.095+0000 7f63f1475640 1 --2- 172.21.15.6:0/3344864703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63ec15c050 0x7f63ec15f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.095+0000 7f63f1475640 1 -- 172.21.15.6:0/3344864703 >> v2:172.21.15.161:3300/0 conn(0x7f63ec0ce620 msgr2=0x7f63ec0ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:14.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.095+0000 7f63f1475640 1 --2- 172.21.15.6:0/3344864703 >> v2:172.21.15.161:3300/0 conn(0x7f63ec0ce620 0x7f63ec0ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.095+0000 7f63f1475640 1 -- 172.21.15.6:0/3344864703 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec06dab0 con 0x7f63ec15fee0 2023-07-21T22:34:14.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.095+0000 7f63ebfff640 1 --2- 172.21.15.6:0/3344864703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63ec15c050 0x7f63ec15f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:14.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.095+0000 7f63f0c74640 1 --2- 172.21.15.6:0/3344864703 >> v2:172.21.15.161:3300/0 conn(0x7f63ec0ce620 0x7f63ec0ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:14.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.099+0000 7f63f1475640 1 --2- 172.21.15.6:0/3344864703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ec15fee0 0x7f63ec06e700 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0cf1f0 tx=0x7f63e401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58448e2898baff1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:14.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.099+0000 7f63eb7fe640 1 -- 172.21.15.6:0/3344864703 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e40a6460 con 0x7f63ec15fee0 2023-07-21T22:34:14.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.099+0000 7f63eb7fe640 1 -- 172.21.15.6:0/3344864703 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e40a65c0 con 0x7f63ec15fee0 2023-07-21T22:34:14.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.099+0000 7f63eb7fe640 1 -- 172.21.15.6:0/3344864703 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e40a6950 con 0x7f63ec15fee0 2023-07-21T22:34:14.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.099+0000 7f63f2ed8640 1 -- 172.21.15.6:0/3344864703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ec15fee0 msgr2=0x7f63ec06e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:14.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.099+0000 7f63f2ed8640 1 --2- 172.21.15.6:0/3344864703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ec15fee0 0x7f63ec06e700 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f63ec0cf1f0 tx=0x7f63e401c9a0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.099+0000 7f63f2ed8640 1 -- 172.21.15.6:0/3344864703 shutdown_connections 2023-07-21T22:34:14.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.099+0000 7f63f2ed8640 1 --2- 172.21.15.6:0/3344864703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ec15fee0 0x7f63ec06e700 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.099+0000 7f63f2ed8640 1 --2- 172.21.15.6:0/3344864703 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63ec15c050 0x7f63ec15f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.099+0000 7f63f2ed8640 1 --2- 172.21.15.6:0/3344864703 >> v2:172.21.15.161:3300/0 conn(0x7f63ec0ce620 0x7f63ec0ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.099+0000 7f63f2ed8640 1 -- 172.21.15.6:0/3344864703 >> 172.21.15.6:0/3344864703 conn(0x7f63ec0cc9a0 msgr2=0x7f63ec0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:14.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.099+0000 7f63f2ed8640 1 -- 172.21.15.6:0/3344864703 shutdown_connections 2023-07-21T22:34:14.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.099+0000 7f63f2ed8640 1 -- 172.21.15.6:0/3344864703 wait complete. 2023-07-21T22:34:14.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.099+0000 7f63f2ed8640 1 Processor -- start 2023-07-21T22:34:14.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63f2ed8640 1 -- start start 2023-07-21T22:34:14.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63f2ed8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63ec0ce620 0x7f63ec14aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:14.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63f2ed8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ec15c050 0x7f63ec15c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:14.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63f2ed8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63ec15fee0 0x7f63ec14be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:14.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63f2ed8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec14cc70 con 0x7f63ec15c050 2023-07-21T22:34:14.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63f2ed8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec15ef20 con 0x7f63ec15fee0 2023-07-21T22:34:14.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63f2ed8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec15f200 con 0x7f63ec0ce620 2023-07-21T22:34:14.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63ebfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ec15c050 0x7f63ec15c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:14.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63ebfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ec15c050 0x7f63ec15c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50424/0 (socket says 172.21.15.6:50424) 2023-07-21T22:34:14.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63ebfff640 1 -- 172.21.15.6:0/686919619 learned_addr learned my addr 172.21.15.6:0/686919619 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:14.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63f1475640 1 --2- 172.21.15.6:0/686919619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63ec15fee0 0x7f63ec14be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:14.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63f0c74640 1 --2- 172.21.15.6:0/686919619 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63ec0ce620 0x7f63ec14aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:14.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63ebfff640 1 -- 172.21.15.6:0/686919619 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63ec0ce620 msgr2=0x7f63ec14aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:14.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63ebfff640 1 --2- 172.21.15.6:0/686919619 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63ec0ce620 0x7f63ec14aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63ebfff640 1 -- 172.21.15.6:0/686919619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63ec15fee0 msgr2=0x7f63ec14be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:14.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63ebfff640 1 --2- 172.21.15.6:0/686919619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63ec15fee0 0x7f63ec14be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63ebfff640 1 -- 172.21.15.6:0/686919619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e4009b30 con 0x7f63ec15c050 2023-07-21T22:34:14.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63ebfff640 1 --2- 172.21.15.6:0/686919619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ec15c050 0x7f63ec15c420 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f63d800e810 tx=0x7f63d800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:14.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63e97fa640 1 -- 172.21.15.6:0/686919619 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d800c8d0 con 0x7f63ec15c050 2023-07-21T22:34:14.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63e97fa640 1 -- 172.21.15.6:0/686919619 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d800ca30 con 0x7f63ec15c050 2023-07-21T22:34:14.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63e97fa640 1 -- 172.21.15.6:0/686919619 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d800cda0 con 0x7f63ec15c050 2023-07-21T22:34:14.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63f2ed8640 1 -- 172.21.15.6:0/686919619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ec14b350 con 0x7f63ec15c050 2023-07-21T22:34:14.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63f2ed8640 1 -- 172.21.15.6:0/686919619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ec14b910 con 0x7f63ec15c050 2023-07-21T22:34:14.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.103+0000 7f63f2ed8640 1 -- 172.21.15.6:0/686919619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ec0678d0 con 0x7f63ec15c050 2023-07-21T22:34:14.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.107+0000 7f63e97fa640 1 -- 172.21.15.6:0/686919619 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f63d8013410 con 0x7f63ec15c050 2023-07-21T22:34:14.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.107+0000 7f63e97fa640 1 --2- 172.21.15.6:0/686919619 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f63d00663a0 0x7f63d0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:14.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.107+0000 7f63e97fa640 1 -- 172.21.15.6:0/686919619 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6028+0+0 (secure 0 0 0) 0x7f63d8083d40 con 0x7f63ec15c050 2023-07-21T22:34:14.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.107+0000 7f63f0c74640 1 --2- 172.21.15.6:0/686919619 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f63d00663a0 0x7f63d0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:14.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.107+0000 7f63f0c74640 1 --2- 172.21.15.6:0/686919619 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f63d00663a0 0x7f63d0068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f63e00098d0 tx=0x7f63e0008040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:14.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.111+0000 7f63e97fa640 1 -- 172.21.15.6:0/686919619 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f63d8050fd0 con 0x7f63ec15c050 2023-07-21T22:34:14.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.287+0000 7f63f2ed8640 1 -- 172.21.15.6:0/686919619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f63ec071790 con 0x7f63ec15c050 2023-07-21T22:34:14.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.291+0000 7f63e97fa640 1 -- 172.21.15.6:0/686919619 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v19) v1 ==== 115+0+0 (secure 0 0 0) 0x7f63d80545f0 con 0x7f63ec15c050 2023-07-21T22:34:14.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.291+0000 7f63f2ed8640 1 -- 172.21.15.6:0/686919619 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f63d00663a0 msgr2=0x7f63d0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:14.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.291+0000 7f63f2ed8640 1 --2- 172.21.15.6:0/686919619 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f63d00663a0 0x7f63d0068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f63e00098d0 tx=0x7f63e0008040 comp rx=0 tx=0).stop 2023-07-21T22:34:14.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.291+0000 7f63f2ed8640 1 -- 172.21.15.6:0/686919619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ec15c050 msgr2=0x7f63ec15c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:14.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.291+0000 7f63f2ed8640 1 --2- 172.21.15.6:0/686919619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ec15c050 0x7f63ec15c420 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f63d800e810 tx=0x7f63d800ecd0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.291+0000 7f63f2ed8640 1 -- 172.21.15.6:0/686919619 shutdown_connections 2023-07-21T22:34:14.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.291+0000 7f63f2ed8640 1 --2- 172.21.15.6:0/686919619 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f63d00663a0 0x7f63d0068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.291+0000 7f63f2ed8640 1 --2- 172.21.15.6:0/686919619 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63ec15fee0 0x7f63ec14be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.291+0000 7f63f2ed8640 1 --2- 172.21.15.6:0/686919619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63ec15c050 0x7f63ec15c420 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.291+0000 7f63f2ed8640 1 --2- 172.21.15.6:0/686919619 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63ec0ce620 0x7f63ec14aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.291+0000 7f63f2ed8640 1 -- 172.21.15.6:0/686919619 >> 172.21.15.6:0/686919619 conn(0x7f63ec0cc9a0 msgr2=0x7f63ec0cb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:14.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.295+0000 7f63f2ed8640 1 -- 172.21.15.6:0/686919619 shutdown_connections 2023-07-21T22:34:14.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.295+0000 7f63f2ed8640 1 -- 172.21.15.6:0/686919619 wait complete. 2023-07-21T22:34:14.362 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-21T22:34:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.459+0000 7fa32e669640 1 Processor -- start 2023-07-21T22:34:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.459+0000 7fa32e669640 1 -- start start 2023-07-21T22:34:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.459+0000 7fa32e669640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa3280b1620 0x7fa3280ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.459+0000 7fa32e669640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa328160750 0x7fa32815c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.459+0000 7fa32e669640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3280cf430 con 0x7fa3280cc960 2023-07-21T22:34:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.459+0000 7fa32e669640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3280cf710 con 0x7fa3280b1620 2023-07-21T22:34:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.459+0000 7fa32e669640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32815fc70 con 0x7fa328160750 2023-07-21T22:34:14.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.459+0000 7fa32ce66640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa3280b1620 0x7fa3280ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:14.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.459+0000 7fa32ce66640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa3280b1620 0x7fa3280ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50438/0 (socket says 172.21.15.6:50438) 2023-07-21T22:34:14.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.459+0000 7fa32ce66640 1 -- 172.21.15.6:0/3494676766 learned_addr learned my addr 172.21.15.6:0/3494676766 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:14.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.459+0000 7fa32de68640 1 --2- 172.21.15.6:0/3494676766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa328160750 0x7fa32815c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:14.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.459+0000 7fa32ce66640 1 -- 172.21.15.6:0/3494676766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa328160750 msgr2=0x7fa32815c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:14.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.459+0000 7fa32ce66640 1 --2- 172.21.15.6:0/3494676766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa328160750 0x7fa32815c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.459+0000 7fa32ce66640 1 -- 172.21.15.6:0/3494676766 >> v1:172.21.15.161:6789/0 conn(0x7fa3280cc960 legacy=0x7fa3280ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:14.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.459+0000 7fa32ce66640 1 -- 172.21.15.6:0/3494676766 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32815ff50 con 0x7fa3280b1620 2023-07-21T22:34:14.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.459+0000 7fa32de68640 1 --2- 172.21.15.6:0/3494676766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa328160750 0x7fa32815c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:14.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.463+0000 7fa32ce66640 1 --2- 172.21.15.6:0/3494676766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3280b1620 0x7fa3280ce950 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa318009870 tx=0x7fa31801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dece0455d3ed220 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:14.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.463+0000 7fa31ffff640 1 -- 172.21.15.6:0/3494676766 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3180a95f0 con 0x7fa3280b1620 2023-07-21T22:34:14.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.463+0000 7fa31ffff640 1 -- 172.21.15.6:0/3494676766 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3180a9750 con 0x7fa3280b1620 2023-07-21T22:34:14.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.463+0000 7fa31ffff640 1 -- 172.21.15.6:0/3494676766 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3180a9ae0 con 0x7fa3280b1620 2023-07-21T22:34:14.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.463+0000 7fa32e669640 1 -- 172.21.15.6:0/3494676766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3280b1620 msgr2=0x7fa3280ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:14.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.463+0000 7fa32e669640 1 --2- 172.21.15.6:0/3494676766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3280b1620 0x7fa3280ce950 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa318009870 tx=0x7fa31801c510 comp rx=0 tx=0).stop 2023-07-21T22:34:14.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.463+0000 7fa32e669640 1 -- 172.21.15.6:0/3494676766 shutdown_connections 2023-07-21T22:34:14.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.463+0000 7fa32e669640 1 --2- 172.21.15.6:0/3494676766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa328160750 0x7fa32815c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.463+0000 7fa32e669640 1 --2- 172.21.15.6:0/3494676766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3280b1620 0x7fa3280ce950 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.463+0000 7fa32e669640 1 -- 172.21.15.6:0/3494676766 >> 172.21.15.6:0/3494676766 conn(0x7fa328069f50 msgr2=0x7fa32806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:14.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.463+0000 7fa32e669640 1 -- 172.21.15.6:0/3494676766 shutdown_connections 2023-07-21T22:34:14.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.463+0000 7fa32e669640 1 -- 172.21.15.6:0/3494676766 wait complete. 2023-07-21T22:34:14.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32e669640 1 Processor -- start 2023-07-21T22:34:14.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32e669640 1 -- start start 2023-07-21T22:34:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32e669640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3280b1620 0x7fa3281552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32e669640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3280cc960 0x7fa3280c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32e669640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa328160750 0x7fa328155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32e669640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3280c8270 con 0x7fa3280cc960 2023-07-21T22:34:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32e669640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3281557e0 con 0x7fa3280b1620 2023-07-21T22:34:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32e669640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3280c75f0 con 0x7fa328160750 2023-07-21T22:34:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32ce66640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3280cc960 0x7fa3280c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:14.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32ce66640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3280cc960 0x7fa3280c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50440/0 (socket says 172.21.15.6:50440) 2023-07-21T22:34:14.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32ce66640 1 -- 172.21.15.6:0/2640795211 learned_addr learned my addr 172.21.15.6:0/2640795211 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:14.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32de68640 1 --2- 172.21.15.6:0/2640795211 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa328160750 0x7fa328155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:14.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32d667640 1 --2- 172.21.15.6:0/2640795211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3280b1620 0x7fa3281552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32ce66640 1 -- 172.21.15.6:0/2640795211 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa328160750 msgr2=0x7fa328155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32ce66640 1 --2- 172.21.15.6:0/2640795211 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa328160750 0x7fa328155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32ce66640 1 -- 172.21.15.6:0/2640795211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3280b1620 msgr2=0x7fa3281552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:14.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32ce66640 1 --2- 172.21.15.6:0/2640795211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3280b1620 0x7fa3281552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32ce66640 1 -- 172.21.15.6:0/2640795211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3180094d0 con 0x7fa3280cc960 2023-07-21T22:34:14.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32ce66640 1 --2- 172.21.15.6:0/2640795211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3280cc960 0x7fa3280c8690 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fa3180ab040 tx=0x7fa31801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:14.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa31dffb640 1 -- 172.21.15.6:0/2640795211 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3180b1900 con 0x7fa3280cc960 2023-07-21T22:34:14.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa31dffb640 1 -- 172.21.15.6:0/2640795211 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3180b1a60 con 0x7fa3280cc960 2023-07-21T22:34:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32e669640 1 -- 172.21.15.6:0/2640795211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3280c78d0 con 0x7fa3280cc960 2023-07-21T22:34:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa31dffb640 1 -- 172.21.15.6:0/2640795211 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3180b1e10 con 0x7fa3280cc960 2023-07-21T22:34:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32e669640 1 -- 172.21.15.6:0/2640795211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3280c7e90 con 0x7fa3280cc960 2023-07-21T22:34:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.467+0000 7fa32e669640 1 -- 172.21.15.6:0/2640795211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3280c83b0 con 0x7fa3280cc960 2023-07-21T22:34:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.471+0000 7fa31dffb640 1 -- 172.21.15.6:0/2640795211 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa3180bc450 con 0x7fa3280cc960 2023-07-21T22:34:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.471+0000 7fa31dffb640 1 --2- 172.21.15.6:0/2640795211 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fa30c0663a0 0x7fa30c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.471+0000 7fa31dffb640 1 -- 172.21.15.6:0/2640795211 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6028+0+0 (secure 0 0 0) 0x7fa31811ed60 con 0x7fa3280cc960 2023-07-21T22:34:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.471+0000 7fa32d667640 1 --2- 172.21.15.6:0/2640795211 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fa30c0663a0 0x7fa30c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.471+0000 7fa32d667640 1 --2- 172.21.15.6:0/2640795211 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fa30c0663a0 0x7fa30c068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa324007fd0 tx=0x7fa324009040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:14.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.475+0000 7fa31dffb640 1 -- 172.21.15.6:0/2640795211 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa3280c83b0 con 0x7fa3280cc960 2023-07-21T22:34:14.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.627+0000 7fa32e669640 1 -- 172.21.15.6:0/2640795211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fa3280c83b0 con 0x7fa3280cc960 2023-07-21T22:34:14.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.635+0000 7fa31dffb640 1 -- 172.21.15.6:0/2640795211 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v20) v1 ==== 120+0+0 (secure 0 0 0) 0x7fa3280c83b0 con 0x7fa3280cc960 2023-07-21T22:34:14.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.635+0000 7fa32e669640 1 -- 172.21.15.6:0/2640795211 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fa30c0663a0 msgr2=0x7fa30c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:14.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.635+0000 7fa32e669640 1 --2- 172.21.15.6:0/2640795211 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fa30c0663a0 0x7fa30c068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa324007fd0 tx=0x7fa324009040 comp rx=0 tx=0).stop 2023-07-21T22:34:14.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.635+0000 7fa32e669640 1 -- 172.21.15.6:0/2640795211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3280cc960 msgr2=0x7fa3280c8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:14.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.635+0000 7fa32e669640 1 --2- 172.21.15.6:0/2640795211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3280cc960 0x7fa3280c8690 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fa3180ab040 tx=0x7fa31801ad50 comp rx=0 tx=0).stop 2023-07-21T22:34:14.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.635+0000 7fa32e669640 1 -- 172.21.15.6:0/2640795211 shutdown_connections 2023-07-21T22:34:14.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.635+0000 7fa32e669640 1 --2- 172.21.15.6:0/2640795211 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fa30c0663a0 0x7fa30c068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.635+0000 7fa32e669640 1 --2- 172.21.15.6:0/2640795211 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa328160750 0x7fa328155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.635+0000 7fa32e669640 1 --2- 172.21.15.6:0/2640795211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3280cc960 0x7fa3280c8690 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.635+0000 7fa32e669640 1 --2- 172.21.15.6:0/2640795211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3280b1620 0x7fa3281552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.635+0000 7fa32e669640 1 -- 172.21.15.6:0/2640795211 >> 172.21.15.6:0/2640795211 conn(0x7fa328069f50 msgr2=0x7fa32815f520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:14.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.635+0000 7fa32e669640 1 -- 172.21.15.6:0/2640795211 shutdown_connections 2023-07-21T22:34:14.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.635+0000 7fa32e669640 1 -- 172.21.15.6:0/2640795211 wait complete. 2023-07-21T22:34:14.705 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-21T22:34:14.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.799+0000 7f0cb75fa640 1 Processor -- start 2023-07-21T22:34:14.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.799+0000 7f0cb75fa640 1 -- start start 2023-07-21T22:34:14.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.803+0000 7f0cb75fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cb015bd50 0x7f0cb0069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:14.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.803+0000 7f0cb75fa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0cb006fcf0 0x7f0cb0070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:14.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.803+0000 7f0cb75fa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb0069970 con 0x7f0cb006cc80 2023-07-21T22:34:14.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.803+0000 7f0cb75fa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb015fa90 con 0x7f0cb006fcf0 2023-07-21T22:34:14.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.803+0000 7f0cb75fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb015fd70 con 0x7f0cb015bd50 2023-07-21T22:34:14.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.803+0000 7f0cb5b97640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0cb006fcf0 0x7f0cb0070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:14.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.803+0000 7f0cb4b95640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cb015bd50 0x7f0cb0069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:14.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.803+0000 7f0cb5396640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0cb006cc80 0x7f0cb006d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:33850/0 (socket says 172.21.15.6:33850) 2023-07-21T22:34:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.803+0000 7f0cb5396640 1 -- 172.21.15.6:0/2731074513 learned_addr learned my addr 172.21.15.6:0/2731074513 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.803+0000 7f0cb5b97640 1 -- 172.21.15.6:0/2731074513 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cb015bd50 msgr2=0x7f0cb0069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.803+0000 7f0cb5b97640 1 --2- 172.21.15.6:0/2731074513 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cb015bd50 0x7f0cb0069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.803+0000 7f0cb5b97640 1 -- 172.21.15.6:0/2731074513 >> v1:172.21.15.161:6789/0 conn(0x7f0cb006cc80 legacy=0x7f0cb006d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:14.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.803+0000 7f0cb5b97640 1 -- 172.21.15.6:0/2731074513 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb0160050 con 0x7f0cb006fcf0 2023-07-21T22:34:14.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.807+0000 7f0cb5b97640 1 --2- 172.21.15.6:0/2731074513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cb006fcf0 0x7f0cb0070190 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009d90 tx=0x7f0ca801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43759b8cae9927e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:14.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.807+0000 7f0ca7fff640 1 -- 172.21.15.6:0/2731074513 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca80a5a00 con 0x7f0cb006fcf0 2023-07-21T22:34:14.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.807+0000 7f0ca7fff640 1 -- 172.21.15.6:0/2731074513 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca80a5b60 con 0x7f0cb006fcf0 2023-07-21T22:34:14.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.807+0000 7f0ca7fff640 1 -- 172.21.15.6:0/2731074513 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca80ad440 con 0x7f0cb006fcf0 2023-07-21T22:34:14.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.807+0000 7f0cb75fa640 1 -- 172.21.15.6:0/2731074513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cb006fcf0 msgr2=0x7f0cb0070190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:14.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.807+0000 7f0cb75fa640 1 --2- 172.21.15.6:0/2731074513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cb006fcf0 0x7f0cb0070190 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009d90 tx=0x7f0ca801c920 comp rx=0 tx=0).stop 2023-07-21T22:34:14.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.807+0000 7f0cb75fa640 1 -- 172.21.15.6:0/2731074513 shutdown_connections 2023-07-21T22:34:14.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.807+0000 7f0cb75fa640 1 --2- 172.21.15.6:0/2731074513 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cb006fcf0 0x7f0cb0070190 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.807+0000 7f0cb75fa640 1 --2- 172.21.15.6:0/2731074513 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cb015bd50 0x7f0cb0069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.807+0000 7f0cb75fa640 1 -- 172.21.15.6:0/2731074513 >> 172.21.15.6:0/2731074513 conn(0x7f0cb00b0490 msgr2=0x7f0cb00b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:14.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.807+0000 7f0cb75fa640 1 -- 172.21.15.6:0/2731074513 shutdown_connections 2023-07-21T22:34:14.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.807+0000 7f0cb75fa640 1 -- 172.21.15.6:0/2731074513 wait complete. 2023-07-21T22:34:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.807+0000 7f0cb75fa640 1 Processor -- start 2023-07-21T22:34:14.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb75fa640 1 -- start start 2023-07-21T22:34:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb75fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cb006cc80 0x7f0cb014e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:14.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb75fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cb006fcf0 0x7f0cb0150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:14.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb75fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cb015bd50 0x7f0cb014d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:14.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb75fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb014e530 con 0x7f0cb015bd50 2023-07-21T22:34:14.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb75fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb0150ba0 con 0x7f0cb006cc80 2023-07-21T22:34:14.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb75fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb00b3aa0 con 0x7f0cb006fcf0 2023-07-21T22:34:14.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb5b97640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cb015bd50 0x7f0cb014d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:14.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb5b97640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cb015bd50 0x7f0cb014d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50444/0 (socket says 172.21.15.6:50444) 2023-07-21T22:34:14.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb5b97640 1 -- 172.21.15.6:0/524680316 learned_addr learned my addr 172.21.15.6:0/524680316 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:14.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb5396640 1 --2- 172.21.15.6:0/524680316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cb006cc80 0x7f0cb014e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:14.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb4b95640 1 --2- 172.21.15.6:0/524680316 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cb006fcf0 0x7f0cb0150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:14.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb5b97640 1 -- 172.21.15.6:0/524680316 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cb006fcf0 msgr2=0x7f0cb0150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:14.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb5b97640 1 --2- 172.21.15.6:0/524680316 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cb006fcf0 0x7f0cb0150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb5b97640 1 -- 172.21.15.6:0/524680316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cb006cc80 msgr2=0x7f0cb014e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:14.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb5b97640 1 --2- 172.21.15.6:0/524680316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cb006cc80 0x7f0cb014e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:14.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb5b97640 1 -- 172.21.15.6:0/524680316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca8009a70 con 0x7f0cb015bd50 2023-07-21T22:34:14.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb4b95640 1 --2- 172.21.15.6:0/524680316 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cb006fcf0 0x7f0cb0150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:14.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb5396640 1 --2- 172.21.15.6:0/524680316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cb006cc80 0x7f0cb014e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:14.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb5b97640 1 --2- 172.21.15.6:0/524680316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cb015bd50 0x7f0cb014d120 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80b0040 tx=0x7f0ca80196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:14.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0ca5ffb640 1 -- 172.21.15.6:0/524680316 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca80add90 con 0x7f0cb015bd50 2023-07-21T22:34:14.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0ca5ffb640 1 -- 172.21.15.6:0/524680316 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca8009450 con 0x7f0cb015bd50 2023-07-21T22:34:14.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0ca5ffb640 1 -- 172.21.15.6:0/524680316 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca80b7650 con 0x7f0cb015bd50 2023-07-21T22:34:14.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb75fa640 1 -- 172.21.15.6:0/524680316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb014fcf0 con 0x7f0cb015bd50 2023-07-21T22:34:14.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb75fa640 1 -- 172.21.15.6:0/524680316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb01502b0 con 0x7f0cb015bd50 2023-07-21T22:34:14.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.811+0000 7f0cb75fa640 1 -- 172.21.15.6:0/524680316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb014e6a0 con 0x7f0cb015bd50 2023-07-21T22:34:14.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.815+0000 7f0ca5ffb640 1 -- 172.21.15.6:0/524680316 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0ca80b4050 con 0x7f0cb015bd50 2023-07-21T22:34:14.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.815+0000 7f0ca5ffb640 1 --2- 172.21.15.6:0/524680316 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f0c940663a0 0x7f0c94068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:14.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.815+0000 7f0ca5ffb640 1 -- 172.21.15.6:0/524680316 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6028+0+0 (secure 0 0 0) 0x7f0ca811f5b0 con 0x7f0cb015bd50 2023-07-21T22:34:14.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.815+0000 7f0cb5396640 1 --2- 172.21.15.6:0/524680316 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f0c940663a0 0x7f0c94068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:14.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.815+0000 7f0cb5396640 1 --2- 172.21.15.6:0/524680316 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f0c940663a0 0x7f0c94068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0cac005890 tx=0x7f0cac009040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:14.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.819+0000 7f0ca5ffb640 1 -- 172.21.15.6:0/524680316 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ca80ec930 con 0x7f0cb015bd50 2023-07-21T22:34:15.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.975+0000 7f0cb75fa640 1 -- 172.21.15.6:0/524680316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0cb00678d0 con 0x7f0cb015bd50 2023-07-21T22:34:15.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.983+0000 7f0ca5ffb640 1 -- 172.21.15.6:0/524680316 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0ca80eff50 con 0x7f0cb015bd50 2023-07-21T22:34:15.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.983+0000 7f0cb75fa640 1 -- 172.21.15.6:0/524680316 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f0c940663a0 msgr2=0x7f0c94068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:15.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.983+0000 7f0cb75fa640 1 --2- 172.21.15.6:0/524680316 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f0c940663a0 0x7f0c94068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0cac005890 tx=0x7f0cac009040 comp rx=0 tx=0).stop 2023-07-21T22:34:15.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.983+0000 7f0cb75fa640 1 -- 172.21.15.6:0/524680316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cb015bd50 msgr2=0x7f0cb014d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:15.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.983+0000 7f0cb75fa640 1 --2- 172.21.15.6:0/524680316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cb015bd50 0x7f0cb014d120 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0ca80b0040 tx=0x7f0ca80196c0 comp rx=0 tx=0).stop 2023-07-21T22:34:15.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.987+0000 7f0cb75fa640 1 -- 172.21.15.6:0/524680316 shutdown_connections 2023-07-21T22:34:15.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.987+0000 7f0cb75fa640 1 --2- 172.21.15.6:0/524680316 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f0c940663a0 0x7f0c94068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:15.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.987+0000 7f0cb75fa640 1 --2- 172.21.15.6:0/524680316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cb015bd50 0x7f0cb014d120 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:15.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.987+0000 7f0cb75fa640 1 --2- 172.21.15.6:0/524680316 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0cb006fcf0 0x7f0cb0150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:15.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.987+0000 7f0cb75fa640 1 --2- 172.21.15.6:0/524680316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0cb006cc80 0x7f0cb014e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:15.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.987+0000 7f0cb75fa640 1 -- 172.21.15.6:0/524680316 >> 172.21.15.6:0/524680316 conn(0x7f0cb00b0490 msgr2=0x7f0cb00b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:15.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.987+0000 7f0cb75fa640 1 -- 172.21.15.6:0/524680316 shutdown_connections 2023-07-21T22:34:15.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:14.987+0000 7f0cb75fa640 1 -- 172.21.15.6:0/524680316 wait complete. 2023-07-21T22:34:15.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-07-21T22:34:15.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.151+0000 7f038807b640 1 Processor -- start 2023-07-21T22:34:15.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.151+0000 7f038807b640 1 -- start start 2023-07-21T22:34:15.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.151+0000 7f038807b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0380070b70 0x7f0380070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:15.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.151+0000 7f038807b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f03800cb100 0x7f03800cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:15.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.151+0000 7f038807b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03800cbac0 con 0x7f038006b1e0 2023-07-21T22:34:15.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.151+0000 7f038807b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03800cac70 con 0x7f03800cb100 2023-07-21T22:34:15.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.151+0000 7f038807b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0380071480 con 0x7f0380070b70 2023-07-21T22:34:15.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.151+0000 7f0386618640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f03800cb100 0x7f03800cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:15.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.151+0000 7f0385616640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f038006b1e0 0x7f03800c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55552/0 (socket says 172.21.15.6:55552) 2023-07-21T22:34:15.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.151+0000 7f0386618640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f03800cb100 0x7f03800cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50448/0 (socket says 172.21.15.6:50448) 2023-07-21T22:34:15.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.151+0000 7f0385616640 1 -- 172.21.15.6:0/3605518900 learned_addr learned my addr 172.21.15.6:0/3605518900 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:15.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.151+0000 7f0385e17640 1 --2- 172.21.15.6:0/3605518900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0380070b70 0x7f0380070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:15.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.151+0000 7f0386618640 1 -- 172.21.15.6:0/3605518900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0380070b70 msgr2=0x7f0380070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:15.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.151+0000 7f0386618640 1 --2- 172.21.15.6:0/3605518900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0380070b70 0x7f0380070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:15.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.151+0000 7f0386618640 1 -- 172.21.15.6:0/3605518900 >> v1:172.21.15.6:6789/0 conn(0x7f038006b1e0 legacy=0x7f03800c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:15.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.151+0000 7f0386618640 1 -- 172.21.15.6:0/3605518900 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03800ca060 con 0x7f03800cb100 2023-07-21T22:34:15.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.151+0000 7f0384e15640 1 -- 172.21.15.6:0/3605518900 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538156264 0 0) 0x7f0370001120 con 0x7f038006b1e0 2023-07-21T22:34:15.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.155+0000 7f0386618640 1 --2- 172.21.15.6:0/3605518900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03800cb100 0x7f03800cb580 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0378009d90 tx=0x7f037801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef103326e4df85a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:15.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.155+0000 7f0384e15640 1 -- 172.21.15.6:0/3605518900 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03780a5950 con 0x7f03800cb100 2023-07-21T22:34:15.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.155+0000 7f0384e15640 1 -- 172.21.15.6:0/3605518900 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03780a5ab0 con 0x7f03800cb100 2023-07-21T22:34:15.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.155+0000 7f0384e15640 1 -- 172.21.15.6:0/3605518900 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03780a5e40 con 0x7f03800cb100 2023-07-21T22:34:15.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.155+0000 7f038807b640 1 -- 172.21.15.6:0/3605518900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03800cb100 msgr2=0x7f03800cb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:15.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.155+0000 7f038807b640 1 --2- 172.21.15.6:0/3605518900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03800cb100 0x7f03800cb580 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0378009d90 tx=0x7f037801c890 comp rx=0 tx=0).stop 2023-07-21T22:34:15.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.155+0000 7f038807b640 1 -- 172.21.15.6:0/3605518900 shutdown_connections 2023-07-21T22:34:15.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.155+0000 7f038807b640 1 --2- 172.21.15.6:0/3605518900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03800cb100 0x7f03800cb580 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:15.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.155+0000 7f038807b640 1 --2- 172.21.15.6:0/3605518900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0380070b70 0x7f0380070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.155+0000 7f038807b640 1 -- 172.21.15.6:0/3605518900 >> 172.21.15.6:0/3605518900 conn(0x7f03800afcf0 msgr2=0x7f03800b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.155+0000 7f038807b640 1 -- 172.21.15.6:0/3605518900 shutdown_connections 2023-07-21T22:34:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.155+0000 7f038807b640 1 -- 172.21.15.6:0/3605518900 wait complete. 2023-07-21T22:34:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f038807b640 1 Processor -- start 2023-07-21T22:34:15.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f038807b640 1 -- start start 2023-07-21T22:34:15.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f038807b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f038006b1e0 0x7f03800aab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:15.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f038807b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0380070b70 0x7f03800c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:15.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f038807b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03800cb100 0x7f0380144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:15.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f038807b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03801f4370 con 0x7f03800cb100 2023-07-21T22:34:15.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f038807b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03801f4560 con 0x7f038006b1e0 2023-07-21T22:34:15.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f038807b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03801f4840 con 0x7f0380070b70 2023-07-21T22:34:15.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f0386618640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03800cb100 0x7f0380144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:15.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f0386618640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03800cb100 0x7f0380144050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50464/0 (socket says 172.21.15.6:50464) 2023-07-21T22:34:15.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f0386618640 1 -- 172.21.15.6:0/3824028337 learned_addr learned my addr 172.21.15.6:0/3824028337 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:15.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f0385616640 1 --2- 172.21.15.6:0/3824028337 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0380070b70 0x7f03800c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:15.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f0385e17640 1 --2- 172.21.15.6:0/3824028337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f038006b1e0 0x7f03800aab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:15.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f0386618640 1 -- 172.21.15.6:0/3824028337 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0380070b70 msgr2=0x7f03800c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:15.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f0386618640 1 --2- 172.21.15.6:0/3824028337 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0380070b70 0x7f03800c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:15.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f0386618640 1 -- 172.21.15.6:0/3824028337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f038006b1e0 msgr2=0x7f03800aab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:15.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f0386618640 1 --2- 172.21.15.6:0/3824028337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f038006b1e0 0x7f03800aab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:15.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f0386618640 1 -- 172.21.15.6:0/3824028337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0378009a70 con 0x7f03800cb100 2023-07-21T22:34:15.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f0385616640 1 --2- 172.21.15.6:0/3824028337 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0380070b70 0x7f03800c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:15.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f0386618640 1 --2- 172.21.15.6:0/3824028337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03800cb100 0x7f0380144050 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f037801af40 tx=0x7f0378019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:15.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f03767fc640 1 -- 172.21.15.6:0/3824028337 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03780add10 con 0x7f03800cb100 2023-07-21T22:34:15.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f03767fc640 1 -- 172.21.15.6:0/3824028337 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03780ade70 con 0x7f03800cb100 2023-07-21T22:34:15.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f03767fc640 1 -- 172.21.15.6:0/3824028337 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03780b9650 con 0x7f03800cb100 2023-07-21T22:34:15.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f038807b640 1 -- 172.21.15.6:0/3824028337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03801f4b20 con 0x7f03800cb100 2023-07-21T22:34:15.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.159+0000 7f038807b640 1 -- 172.21.15.6:0/3824028337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03801f50e0 con 0x7f03800cb100 2023-07-21T22:34:15.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.163+0000 7f038807b640 1 -- 172.21.15.6:0/3824028337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03801f52d0 con 0x7f03800cb100 2023-07-21T22:34:15.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.163+0000 7f03767fc640 1 -- 172.21.15.6:0/3824028337 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f03780b97b0 con 0x7f03800cb100 2023-07-21T22:34:15.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.163+0000 7f03767fc640 1 --2- 172.21.15.6:0/3824028337 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f03640663a0 0x7f0364068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:15.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.163+0000 7f03767fc640 1 -- 172.21.15.6:0/3824028337 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6028+0+0 (secure 0 0 0) 0x7f037811f5c0 con 0x7f03800cb100 2023-07-21T22:34:15.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.163+0000 7f0385e17640 1 --2- 172.21.15.6:0/3824028337 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f03640663a0 0x7f0364068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:15.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.163+0000 7f0385e17640 1 --2- 172.21.15.6:0/3824028337 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f03640663a0 0x7f0364068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f037c009b60 tx=0x7f037c009190 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:15.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.167+0000 7f03767fc640 1 -- 172.21.15.6:0/3824028337 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f03780ec9d0 con 0x7f03800cb100 2023-07-21T22:34:15.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.383+0000 7f038807b640 1 -- 172.21.15.6:0/3824028337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f03800c2390 con 0x7f03800cb100 2023-07-21T22:34:15.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.919+0000 7f03767fc640 1 -- 172.21.15.6:0/3824028337 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v568) v1 ==== 154+0+0 (secure 0 0 0) 0x7f0378009450 con 0x7f03800cb100 2023-07-21T22:34:15.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.919+0000 7f038807b640 1 -- 172.21.15.6:0/3824028337 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f03640663a0 msgr2=0x7f0364068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:15.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.919+0000 7f038807b640 1 --2- 172.21.15.6:0/3824028337 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f03640663a0 0x7f0364068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f037c009b60 tx=0x7f037c009190 comp rx=0 tx=0).stop 2023-07-21T22:34:15.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.919+0000 7f038807b640 1 -- 172.21.15.6:0/3824028337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03800cb100 msgr2=0x7f0380144050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:15.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.919+0000 7f038807b640 1 --2- 172.21.15.6:0/3824028337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03800cb100 0x7f0380144050 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f037801af40 tx=0x7f0378019630 comp rx=0 tx=0).stop 2023-07-21T22:34:15.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.919+0000 7f038807b640 1 -- 172.21.15.6:0/3824028337 shutdown_connections 2023-07-21T22:34:15.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.919+0000 7f038807b640 1 --2- 172.21.15.6:0/3824028337 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f03640663a0 0x7f0364068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:15.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.919+0000 7f038807b640 1 --2- 172.21.15.6:0/3824028337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03800cb100 0x7f0380144050 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:15.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.919+0000 7f038807b640 1 --2- 172.21.15.6:0/3824028337 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0380070b70 0x7f03800c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:15.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.919+0000 7f038807b640 1 --2- 172.21.15.6:0/3824028337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f038006b1e0 0x7f03800aab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:15.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.919+0000 7f038807b640 1 -- 172.21.15.6:0/3824028337 >> 172.21.15.6:0/3824028337 conn(0x7f03800afcf0 msgr2=0x7f03800cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:15.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.923+0000 7f038807b640 1 -- 172.21.15.6:0/3824028337 shutdown_connections 2023-07-21T22:34:15.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:15.923+0000 7f038807b640 1 -- 172.21.15.6:0/3824028337 wait complete. 2023-07-21T22:34:15.994 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ok 2023-07-21T22:34:15.994 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing non-existing snap schedules failure 2023-07-21T22:34:15.994 INFO:tasks.cephfs_test_runner:test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-21T22:34:15.995 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-07-21T22:34:16.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.095+0000 7fc858c0b640 1 Processor -- start 2023-07-21T22:34:16.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.095+0000 7fc858c0b640 1 -- start start 2023-07-21T22:34:16.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.095+0000 7fc858c0b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc8540b7c70 0x7fc8540d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:16.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.095+0000 7fc858c0b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8540ccaf0 con 0x7fc85415fd60 2023-07-21T22:34:16.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.095+0000 7fc858c0b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc854160320 con 0x7fc8540d1850 2023-07-21T22:34:16.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.095+0000 7fc858c0b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8540d1190 con 0x7fc8540b7c70 2023-07-21T22:34:16.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.095+0000 7fc852d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc85415fd60 0x7fc8540d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55558/0 (socket says 172.21.15.6:55558) 2023-07-21T22:34:16.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.095+0000 7fc852d9d640 1 -- 172.21.15.6:0/1471362372 learned_addr learned my addr 172.21.15.6:0/1471362372 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:16.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.095+0000 7fc85259c640 1 --2- 172.21.15.6:0/1471362372 >> v2:172.21.15.161:3300/0 conn(0x7fc8540b7c70 0x7fc8540d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:16.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.095+0000 7fc851d9b640 1 -- 172.21.15.6:0/1471362372 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373122965 0 0) 0x7fc8540ccaf0 con 0x7fc85415fd60 2023-07-21T22:34:16.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.095+0000 7fc851d9b640 1 -- 172.21.15.6:0/1471362372 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc840003530 con 0x7fc85415fd60 2023-07-21T22:34:16.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.095+0000 7fc851d9b640 1 -- 172.21.15.6:0/1471362372 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2695933830 0 0) 0x7fc840003530 con 0x7fc85415fd60 2023-07-21T22:34:16.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.095+0000 7fc851d9b640 1 -- 172.21.15.6:0/1471362372 >> v2:172.21.15.161:3300/0 conn(0x7fc8540b7c70 msgr2=0x7fc8540d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:16.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.095+0000 7fc851d9b640 1 --2- 172.21.15.6:0/1471362372 >> v2:172.21.15.161:3300/0 conn(0x7fc8540b7c70 0x7fc8540d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:16.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.095+0000 7fc851d9b640 1 -- 172.21.15.6:0/1471362372 >> v1:172.21.15.161:6789/0 conn(0x7fc8540d1850 legacy=0x7fc85415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:16.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc851d9b640 1 -- 172.21.15.6:0/1471362372 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8540ccd90 con 0x7fc85415fd60 2023-07-21T22:34:16.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc851d9b640 1 -- 172.21.15.6:0/1471362372 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fc84c001a00 con 0x7fc85415fd60 2023-07-21T22:34:16.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc851d9b640 1 -- 172.21.15.6:0/1471362372 >> v1:172.21.15.6:6789/0 conn(0x7fc85415fd60 legacy=0x7fc8540d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:16.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc851d9b640 1 --2- 172.21.15.6:0/1471362372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc840003980 0x7fc840003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:16.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc851d9b640 1 --2- 172.21.15.6:0/1471362372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc840004370 0x7fc840004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:16.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc851d9b640 1 --2- 172.21.15.6:0/1471362372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc840005030 0x7fc84000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:16.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc851d9b640 1 -- 172.21.15.6:0/1471362372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84000bf80 con 0x7fc840005030 2023-07-21T22:34:16.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc851d9b640 1 -- 172.21.15.6:0/1471362372 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84000c0c0 con 0x7fc840003980 2023-07-21T22:34:16.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc851d9b640 1 -- 172.21.15.6:0/1471362372 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84000c280 con 0x7fc840004370 2023-07-21T22:34:16.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc85259c640 1 --2- 172.21.15.6:0/1471362372 >> v2:172.21.15.161:3300/0 conn(0x7fc8540b7c70 0x7fc8540d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:16.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc852d9d640 1 --2- 172.21.15.6:0/1471362372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc840005030 0x7fc84000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:16.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc84bfff640 1 --2- 172.21.15.6:0/1471362372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc840004370 0x7fc840004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:16.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc85259c640 1 --2- 172.21.15.6:0/1471362372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc840003980 0x7fc840003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:16.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc852d9d640 1 -- 172.21.15.6:0/1471362372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc840004370 msgr2=0x7fc840004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:16.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc852d9d640 1 --2- 172.21.15.6:0/1471362372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc840004370 0x7fc840004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:16.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc852d9d640 1 -- 172.21.15.6:0/1471362372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc840003980 msgr2=0x7fc840003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:16.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc852d9d640 1 --2- 172.21.15.6:0/1471362372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc840003980 0x7fc840003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:16.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc852d9d640 1 -- 172.21.15.6:0/1471362372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc840003530 con 0x7fc840005030 2023-07-21T22:34:16.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc852d9d640 1 -- 172.21.15.6:0/1471362372 reap_dead start 2023-07-21T22:34:16.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc852d9d640 1 --2- 172.21.15.6:0/1471362372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc840005030 0x7fc84000b990 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00a830 tx=0x7fc84c01faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a16b3be88c19d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:16.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc851d9b640 1 -- 172.21.15.6:0/1471362372 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c0af070 con 0x7fc840005030 2023-07-21T22:34:16.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.099+0000 7fc851d9b640 1 -- 172.21.15.6:0/1471362372 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84c0aa4d0 con 0x7fc840005030 2023-07-21T22:34:16.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc851d9b640 1 -- 172.21.15.6:0/1471362372 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c0aa8a0 con 0x7fc840005030 2023-07-21T22:34:16.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc858c0b640 1 -- 172.21.15.6:0/1471362372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc840005030 msgr2=0x7fc84000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:16.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc858c0b640 1 --2- 172.21.15.6:0/1471362372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc840005030 0x7fc84000b990 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00a830 tx=0x7fc84c01faa0 comp rx=0 tx=0).stop 2023-07-21T22:34:16.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc858c0b640 1 -- 172.21.15.6:0/1471362372 shutdown_connections 2023-07-21T22:34:16.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc858c0b640 1 --2- 172.21.15.6:0/1471362372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc840005030 0x7fc84000b990 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:16.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc858c0b640 1 -- 172.21.15.6:0/1471362372 >> 172.21.15.6:0/1471362372 conn(0x7fc8540650b0 msgr2=0x7fc8540654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:16.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc858c0b640 1 -- 172.21.15.6:0/1471362372 shutdown_connections 2023-07-21T22:34:16.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc858c0b640 1 -- 172.21.15.6:0/1471362372 wait complete. 2023-07-21T22:34:16.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc858c0b640 1 Processor -- start 2023-07-21T22:34:16.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc858c0b640 1 -- start start 2023-07-21T22:34:16.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc858c0b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc840005030 0x7fc85415bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:16.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc858c0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8540c63e0 0x7fc8541f3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:16.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc858c0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8541f1280 0x7fc8540d2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:16.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc858c0b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8541f0e60 con 0x7fc8540c63e0 2023-07-21T22:34:16.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc858c0b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8541f4500 con 0x7fc840005030 2023-07-21T22:34:16.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc858c0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8541f4780 con 0x7fc8541f1280 2023-07-21T22:34:16.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc84bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8540c63e0 0x7fc8541f3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:16.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc84bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8540c63e0 0x7fc8541f3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50484/0 (socket says 172.21.15.6:50484) 2023-07-21T22:34:16.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc84bfff640 1 -- 172.21.15.6:0/821802748 learned_addr learned my addr 172.21.15.6:0/821802748 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:16.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc85259c640 1 --2- 172.21.15.6:0/821802748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc840005030 0x7fc85415bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:16.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.103+0000 7fc852d9d640 1 --2- 172.21.15.6:0/821802748 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8541f1280 0x7fc8540d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:16.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.107+0000 7fc84bfff640 1 -- 172.21.15.6:0/821802748 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8541f1280 msgr2=0x7fc8540d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:16.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.107+0000 7fc84bfff640 1 --2- 172.21.15.6:0/821802748 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8541f1280 0x7fc8540d2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:16.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.107+0000 7fc84bfff640 1 -- 172.21.15.6:0/821802748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc840005030 msgr2=0x7fc85415bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:16.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.107+0000 7fc84bfff640 1 --2- 172.21.15.6:0/821802748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc840005030 0x7fc85415bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:16.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.107+0000 7fc84bfff640 1 -- 172.21.15.6:0/821802748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8541f4a60 con 0x7fc8540c63e0 2023-07-21T22:34:16.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.107+0000 7fc85259c640 1 --2- 172.21.15.6:0/821802748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc840005030 0x7fc85415bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:16.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.107+0000 7fc84bfff640 1 --2- 172.21.15.6:0/821802748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8540c63e0 0x7fc8541f3fc0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00f7f0 tx=0x7fc83c00fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:16.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.107+0000 7fc84affd640 1 -- 172.21.15.6:0/821802748 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c00fea0 con 0x7fc8540c63e0 2023-07-21T22:34:16.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.107+0000 7fc84affd640 1 -- 172.21.15.6:0/821802748 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83c0052e0 con 0x7fc8540c63e0 2023-07-21T22:34:16.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.107+0000 7fc84affd640 1 -- 172.21.15.6:0/821802748 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c00d970 con 0x7fc8540c63e0 2023-07-21T22:34:16.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.107+0000 7fc858c0b640 1 -- 172.21.15.6:0/821802748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8541f4d40 con 0x7fc8540c63e0 2023-07-21T22:34:16.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.107+0000 7fc858c0b640 1 -- 172.21.15.6:0/821802748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8541f0a10 con 0x7fc8540c63e0 2023-07-21T22:34:16.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.107+0000 7fc858c0b640 1 -- 172.21.15.6:0/821802748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8540678d0 con 0x7fc8540c63e0 2023-07-21T22:34:16.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.107+0000 7fc84affd640 1 -- 172.21.15.6:0/821802748 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc83c00dad0 con 0x7fc8540c63e0 2023-07-21T22:34:16.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.107+0000 7fc84affd640 1 --2- 172.21.15.6:0/821802748 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fc8340663a0 0x7fc834068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:16.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.107+0000 7fc84affd640 1 -- 172.21.15.6:0/821802748 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6028+0+0 (secure 0 0 0) 0x7fc83c083e70 con 0x7fc8540c63e0 2023-07-21T22:34:16.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.107+0000 7fc85259c640 1 --2- 172.21.15.6:0/821802748 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fc8340663a0 0x7fc834068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:16.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.111+0000 7fc85259c640 1 --2- 172.21.15.6:0/821802748 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fc8340663a0 0x7fc834068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc844009b60 tx=0x7fc844008040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:16.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.111+0000 7fc84affd640 1 -- 172.21.15.6:0/821802748 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc83c0511f0 con 0x7fc8540c63e0 2023-07-21T22:34:16.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.319+0000 7fc858c0b640 1 -- 172.21.15.6:0/821802748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7fc8540d1f00 con 0x7fc8540c63e0 2023-07-21T22:34:16.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.919+0000 7fc84affd640 1 -- 172.21.15.6:0/821802748 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v569) v1 ==== 159+0+0 (secure 0 0 0) 0x7fc83c054810 con 0x7fc8540c63e0 2023-07-21T22:34:16.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.923+0000 7fc858c0b640 1 -- 172.21.15.6:0/821802748 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fc8340663a0 msgr2=0x7fc834068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:16.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.923+0000 7fc858c0b640 1 --2- 172.21.15.6:0/821802748 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fc8340663a0 0x7fc834068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc844009b60 tx=0x7fc844008040 comp rx=0 tx=0).stop 2023-07-21T22:34:16.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.923+0000 7fc858c0b640 1 -- 172.21.15.6:0/821802748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8540c63e0 msgr2=0x7fc8541f3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:16.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.923+0000 7fc858c0b640 1 --2- 172.21.15.6:0/821802748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8540c63e0 0x7fc8541f3fc0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fc83c00f7f0 tx=0x7fc83c00fcb0 comp rx=0 tx=0).stop 2023-07-21T22:34:16.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.923+0000 7fc858c0b640 1 -- 172.21.15.6:0/821802748 shutdown_connections 2023-07-21T22:34:16.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.923+0000 7fc858c0b640 1 --2- 172.21.15.6:0/821802748 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fc8340663a0 0x7fc834068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:16.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.923+0000 7fc858c0b640 1 --2- 172.21.15.6:0/821802748 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8541f1280 0x7fc8540d2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:16.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.923+0000 7fc858c0b640 1 --2- 172.21.15.6:0/821802748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8540c63e0 0x7fc8541f3fc0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:16.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.923+0000 7fc858c0b640 1 --2- 172.21.15.6:0/821802748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc840005030 0x7fc85415bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:16.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.923+0000 7fc858c0b640 1 -- 172.21.15.6:0/821802748 >> 172.21.15.6:0/821802748 conn(0x7fc8540650b0 msgr2=0x7fc8540cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:16.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.923+0000 7fc858c0b640 1 -- 172.21.15.6:0/821802748 shutdown_connections 2023-07-21T22:34:16.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:16.923+0000 7fc858c0b640 1 -- 172.21.15.6:0/821802748 wait complete. 2023-07-21T22:34:16.995 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-21T22:34:17.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.099+0000 7f88261c5640 1 Processor -- start 2023-07-21T22:34:17.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.099+0000 7f88261c5640 1 -- start start 2023-07-21T22:34:17.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.099+0000 7f88261c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f882015b9c0 0x7f88200c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:17.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.099+0000 7f88261c5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8820069430 0x7f88200cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:17.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.099+0000 7f88261c5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88200c37e0 con 0x7f8820069880 2023-07-21T22:34:17.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.099+0000 7f88261c5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88200c3ac0 con 0x7f8820069430 2023-07-21T22:34:17.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.099+0000 7f88261c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88200c3da0 con 0x7f882015b9c0 2023-07-21T22:34:17.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.099+0000 7f881effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8820069430 0x7f88200cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:17.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.099+0000 7f881ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8820069880 0x7f8820159930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:55560/0 (socket says 172.21.15.6:55560) 2023-07-21T22:34:17.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.099+0000 7f881effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8820069430 0x7f88200cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50490/0 (socket says 172.21.15.6:50490) 2023-07-21T22:34:17.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.099+0000 7f881ffff640 1 -- 172.21.15.6:0/1394322313 learned_addr learned my addr 172.21.15.6:0/1394322313 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:17.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.099+0000 7f881f7fe640 1 --2- 172.21.15.6:0/1394322313 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f882015b9c0 0x7f88200c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:17.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.099+0000 7f881effd640 1 -- 172.21.15.6:0/1394322313 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f882015b9c0 msgr2=0x7f88200c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:17.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.099+0000 7f881effd640 1 --2- 172.21.15.6:0/1394322313 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f882015b9c0 0x7f88200c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.099+0000 7f881effd640 1 -- 172.21.15.6:0/1394322313 >> v1:172.21.15.6:6789/0 conn(0x7f8820069880 legacy=0x7f8820159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:17.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.099+0000 7f881effd640 1 -- 172.21.15.6:0/1394322313 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88200c4080 con 0x7f8820069430 2023-07-21T22:34:17.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.099+0000 7f881e7fc640 1 -- 172.21.15.6:0/1394322313 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081824095 0 0) 0x7f88200c37e0 con 0x7f8820069880 2023-07-21T22:34:17.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.103+0000 7f881effd640 1 --2- 172.21.15.6:0/1394322313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8820069430 0x7f88200cba60 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f881400ba60 tx=0x7f881401eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6780a892c1756442 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:17.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.103+0000 7f881e7fc640 1 -- 172.21.15.6:0/1394322313 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88140a7990 con 0x7f8820069430 2023-07-21T22:34:17.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.103+0000 7f881e7fc640 1 -- 172.21.15.6:0/1394322313 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88140a7af0 con 0x7f8820069430 2023-07-21T22:34:17.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.103+0000 7f881e7fc640 1 -- 172.21.15.6:0/1394322313 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88140a7e80 con 0x7f8820069430 2023-07-21T22:34:17.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.103+0000 7f88261c5640 1 -- 172.21.15.6:0/1394322313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8820069430 msgr2=0x7f88200cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:17.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.103+0000 7f88261c5640 1 --2- 172.21.15.6:0/1394322313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8820069430 0x7f88200cba60 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f881400ba60 tx=0x7f881401eac0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.103+0000 7f88261c5640 1 -- 172.21.15.6:0/1394322313 shutdown_connections 2023-07-21T22:34:17.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.103+0000 7f88261c5640 1 --2- 172.21.15.6:0/1394322313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8820069430 0x7f88200cba60 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.103+0000 7f88261c5640 1 --2- 172.21.15.6:0/1394322313 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f882015b9c0 0x7f88200c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.103+0000 7f88261c5640 1 -- 172.21.15.6:0/1394322313 >> 172.21.15.6:0/1394322313 conn(0x7f88200cde90 msgr2=0x7f88200ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:17.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.103+0000 7f88261c5640 1 -- 172.21.15.6:0/1394322313 shutdown_connections 2023-07-21T22:34:17.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.103+0000 7f88261c5640 1 -- 172.21.15.6:0/1394322313 wait complete. 2023-07-21T22:34:17.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.103+0000 7f88261c5640 1 Processor -- start 2023-07-21T22:34:17.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f88261c5640 1 -- start start 2023-07-21T22:34:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f88261c5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8820069430 0x7f8820156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f88261c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8820069880 0x7f882014e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f88261c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f882015b9c0 0x7f882014a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f88261c5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882014ef30 con 0x7f8820069880 2023-07-21T22:34:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f88261c5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882014ec90 con 0x7f8820069430 2023-07-21T22:34:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f88261c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882014c8c0 con 0x7f882015b9c0 2023-07-21T22:34:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f881effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8820069880 0x7f882014e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f881effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8820069880 0x7f882014e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50496/0 (socket says 172.21.15.6:50496) 2023-07-21T22:34:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f881effd640 1 -- 172.21.15.6:0/3936728018 learned_addr learned my addr 172.21.15.6:0/3936728018 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f881f7fe640 1 --2- 172.21.15.6:0/3936728018 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8820069430 0x7f8820156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f881ffff640 1 --2- 172.21.15.6:0/3936728018 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f882015b9c0 0x7f882014a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:17.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f881effd640 1 -- 172.21.15.6:0/3936728018 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f882015b9c0 msgr2=0x7f882014a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:17.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f881effd640 1 --2- 172.21.15.6:0/3936728018 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f882015b9c0 0x7f882014a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f881effd640 1 -- 172.21.15.6:0/3936728018 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8820069430 msgr2=0x7f8820156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:17.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f881effd640 1 --2- 172.21.15.6:0/3936728018 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8820069430 0x7f8820156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f881effd640 1 -- 172.21.15.6:0/3936728018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881400b6c0 con 0x7f8820069880 2023-07-21T22:34:17.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f881effd640 1 --2- 172.21.15.6:0/3936728018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8820069880 0x7f882014e750 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f881401c6f0 tx=0x7f881401d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:17.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f8807fff640 1 -- 172.21.15.6:0/3936728018 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8814004230 con 0x7f8820069880 2023-07-21T22:34:17.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f8807fff640 1 -- 172.21.15.6:0/3936728018 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8814004390 con 0x7f8820069880 2023-07-21T22:34:17.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f8807fff640 1 -- 172.21.15.6:0/3936728018 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8814003820 con 0x7f8820069880 2023-07-21T22:34:17.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f88261c5640 1 -- 172.21.15.6:0/3936728018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882014cba0 con 0x7f8820069880 2023-07-21T22:34:17.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f88261c5640 1 -- 172.21.15.6:0/3936728018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f882014d160 con 0x7f8820069880 2023-07-21T22:34:17.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.107+0000 7f88261c5640 1 -- 172.21.15.6:0/3936728018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88200714b0 con 0x7f8820069880 2023-07-21T22:34:17.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.111+0000 7f8807fff640 1 -- 172.21.15.6:0/3936728018 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f88140b6040 con 0x7f8820069880 2023-07-21T22:34:17.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.111+0000 7f8807fff640 1 --2- 172.21.15.6:0/3936728018 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f880c0663a0 0x7f880c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:17.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.111+0000 7f8807fff640 1 -- 172.21.15.6:0/3936728018 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6028+0+0 (secure 0 0 0) 0x7f881411f350 con 0x7f8820069880 2023-07-21T22:34:17.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.111+0000 7f881f7fe640 1 --2- 172.21.15.6:0/3936728018 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f880c0663a0 0x7f880c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:17.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.111+0000 7f881f7fe640 1 --2- 172.21.15.6:0/3936728018 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f880c0663a0 0x7f880c068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8810006aa0 tx=0x7f8810008040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:17.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.115+0000 7f8807fff640 1 -- 172.21.15.6:0/3936728018 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f88140ec8a0 con 0x7f8820069880 2023-07-21T22:34:17.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.271+0000 7f88261c5640 1 -- 172.21.15.6:0/3936728018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f882014d350 con 0x7f8820069880 2023-07-21T22:34:17.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.275+0000 7f8807fff640 1 -- 172.21.15.6:0/3936728018 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8814006e20 con 0x7f8820069880 2023-07-21T22:34:17.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.279+0000 7f88261c5640 1 -- 172.21.15.6:0/3936728018 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f880c0663a0 msgr2=0x7f880c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:17.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.279+0000 7f88261c5640 1 --2- 172.21.15.6:0/3936728018 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f880c0663a0 0x7f880c068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8810006aa0 tx=0x7f8810008040 comp rx=0 tx=0).stop 2023-07-21T22:34:17.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.279+0000 7f88261c5640 1 -- 172.21.15.6:0/3936728018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8820069880 msgr2=0x7f882014e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:17.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.279+0000 7f88261c5640 1 --2- 172.21.15.6:0/3936728018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8820069880 0x7f882014e750 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f881401c6f0 tx=0x7f881401d300 comp rx=0 tx=0).stop 2023-07-21T22:34:17.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.279+0000 7f88261c5640 1 -- 172.21.15.6:0/3936728018 shutdown_connections 2023-07-21T22:34:17.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.279+0000 7f88261c5640 1 --2- 172.21.15.6:0/3936728018 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f880c0663a0 0x7f880c068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.279+0000 7f88261c5640 1 --2- 172.21.15.6:0/3936728018 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f882015b9c0 0x7f882014a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.279+0000 7f88261c5640 1 --2- 172.21.15.6:0/3936728018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8820069880 0x7f882014e750 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.279+0000 7f88261c5640 1 --2- 172.21.15.6:0/3936728018 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8820069430 0x7f8820156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.279+0000 7f88261c5640 1 -- 172.21.15.6:0/3936728018 >> 172.21.15.6:0/3936728018 conn(0x7f88200cde90 msgr2=0x7f88200ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:17.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.279+0000 7f88261c5640 1 -- 172.21.15.6:0/3936728018 shutdown_connections 2023-07-21T22:34:17.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.279+0000 7f88261c5640 1 -- 172.21.15.6:0/3936728018 wait complete. 2023-07-21T22:34:17.348 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:34:17.348 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:34:17.434 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:34:17.507 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:34:17.507 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:34:17.508 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:34:17.517 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:34:17.517 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:34:17.518 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:34:17.527 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:34:17.527 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:34:17.528 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:34:17.571 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:34:17.571 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:34:17.572 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:34:17.581 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:34:17.581 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-21T22:34:17.581 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:34:17.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.707+0000 7fd98b848640 1 Processor -- start 2023-07-21T22:34:17.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.707+0000 7fd98b848640 1 -- start start 2023-07-21T22:34:17.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.711+0000 7fd98b848640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd984158ce0 0x7fd984070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:17.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.711+0000 7fd98b848640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd9840c8ad0 0x7fd9840c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:17.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.711+0000 7fd98b848640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd9840c9560 0x7fd9840cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:17.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.711+0000 7fd98b848640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9840c99e0 con 0x7fd9840c9560 2023-07-21T22:34:17.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.711+0000 7fd98b848640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9840cc700 con 0x7fd9840c8ad0 2023-07-21T22:34:17.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.711+0000 7fd98b848640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9840b0ff0 con 0x7fd984158ce0 2023-07-21T22:34:17.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.711+0000 7fd989de5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd9840c9560 0x7fd9840cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:17.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.711+0000 7fd989de5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd9840c9560 0x7fd9840cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44478/0 (socket says 172.21.15.6:44478) 2023-07-21T22:34:17.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.711+0000 7fd989de5640 1 -- 172.21.15.6:0/3929731894 learned_addr learned my addr 172.21.15.6:0/3929731894 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:17.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.711+0000 7fd9895e4640 1 --2- 172.21.15.6:0/3929731894 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd984158ce0 0x7fd984070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:17.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.711+0000 7fd988de3640 1 --2- 172.21.15.6:0/3929731894 >> v2:172.21.15.161:3300/0 conn(0x7fd9840c8ad0 0x7fd9840c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:17.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.711+0000 7fd989de5640 1 -- 172.21.15.6:0/3929731894 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd984158ce0 msgr2=0x7fd984070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:17.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.711+0000 7fd989de5640 1 --2- 172.21.15.6:0/3929731894 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd984158ce0 0x7fd984070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.711+0000 7fd989de5640 1 -- 172.21.15.6:0/3929731894 >> v2:172.21.15.161:3300/0 conn(0x7fd9840c8ad0 msgr2=0x7fd9840c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:17.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.711+0000 7fd989de5640 1 --2- 172.21.15.6:0/3929731894 >> v2:172.21.15.161:3300/0 conn(0x7fd9840c8ad0 0x7fd9840c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.711+0000 7fd989de5640 1 -- 172.21.15.6:0/3929731894 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd984070c80 con 0x7fd9840c9560 2023-07-21T22:34:17.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd989de5640 1 --2- 172.21.15.6:0/3929731894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9840c9560 0x7fd9840cab00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd98406a6d0 tx=0x7fd97c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfef6b253f0c9f88 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:17.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd97bfff640 1 -- 172.21.15.6:0/3929731894 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0a5610 con 0x7fd9840c9560 2023-07-21T22:34:17.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd97bfff640 1 -- 172.21.15.6:0/3929731894 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97c0a5770 con 0x7fd9840c9560 2023-07-21T22:34:17.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd97bfff640 1 -- 172.21.15.6:0/3929731894 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0a5b00 con 0x7fd9840c9560 2023-07-21T22:34:17.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd98b848640 1 -- 172.21.15.6:0/3929731894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9840c9560 msgr2=0x7fd9840cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:17.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd98b848640 1 --2- 172.21.15.6:0/3929731894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9840c9560 0x7fd9840cab00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd98406a6d0 tx=0x7fd97c01c880 comp rx=0 tx=0).stop 2023-07-21T22:34:17.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd98b848640 1 -- 172.21.15.6:0/3929731894 shutdown_connections 2023-07-21T22:34:17.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd98b848640 1 --2- 172.21.15.6:0/3929731894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9840c9560 0x7fd9840cab00 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd98b848640 1 --2- 172.21.15.6:0/3929731894 >> v2:172.21.15.161:3300/0 conn(0x7fd9840c8ad0 0x7fd9840c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd98b848640 1 --2- 172.21.15.6:0/3929731894 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd984158ce0 0x7fd984070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd98b848640 1 -- 172.21.15.6:0/3929731894 >> 172.21.15.6:0/3929731894 conn(0x7fd9840afcf0 msgr2=0x7fd9840b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:17.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd98b848640 1 -- 172.21.15.6:0/3929731894 shutdown_connections 2023-07-21T22:34:17.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd98b848640 1 -- 172.21.15.6:0/3929731894 wait complete. 2023-07-21T22:34:17.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd98b848640 1 Processor -- start 2023-07-21T22:34:17.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd98b848640 1 -- start start 2023-07-21T22:34:17.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd98b848640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9840c8ad0 0x7fd9840b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:17.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd98b848640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9840c9560 0x7fd9841f3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:17.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd98b848640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd984158ce0 0x7fd98414e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:17.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd98b848640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd984145c90 con 0x7fd984158ce0 2023-07-21T22:34:17.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd98b848640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd984156e10 con 0x7fd9840c8ad0 2023-07-21T22:34:17.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.715+0000 7fd98b848640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9840b34b0 con 0x7fd9840c9560 2023-07-21T22:34:17.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.719+0000 7fd989de5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd984158ce0 0x7fd98414e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:17.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.719+0000 7fd989de5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd984158ce0 0x7fd98414e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44484/0 (socket says 172.21.15.6:44484) 2023-07-21T22:34:17.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.719+0000 7fd989de5640 1 -- 172.21.15.6:0/1324419545 learned_addr learned my addr 172.21.15.6:0/1324419545 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:17.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.719+0000 7fd988de3640 1 --2- 172.21.15.6:0/1324419545 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9840c9560 0x7fd9841f3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:17.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.719+0000 7fd9895e4640 1 --2- 172.21.15.6:0/1324419545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9840c8ad0 0x7fd9840b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:17.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.719+0000 7fd989de5640 1 -- 172.21.15.6:0/1324419545 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9840c9560 msgr2=0x7fd9841f3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:17.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.719+0000 7fd989de5640 1 --2- 172.21.15.6:0/1324419545 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9840c9560 0x7fd9841f3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.719+0000 7fd989de5640 1 -- 172.21.15.6:0/1324419545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9840c8ad0 msgr2=0x7fd9840b1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:17.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.719+0000 7fd989de5640 1 --2- 172.21.15.6:0/1324419545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9840c8ad0 0x7fd9840b1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.719+0000 7fd989de5640 1 -- 172.21.15.6:0/1324419545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c009b30 con 0x7fd984158ce0 2023-07-21T22:34:17.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.719+0000 7fd9895e4640 1 --2- 172.21.15.6:0/1324419545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9840c8ad0 0x7fd9840b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:17.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.719+0000 7fd989de5640 1 --2- 172.21.15.6:0/1324419545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd984158ce0 0x7fd98414e140 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0af040 tx=0x7fd97c019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:17.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.719+0000 7fd979ffb640 1 -- 172.21.15.6:0/1324419545 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0a5610 con 0x7fd984158ce0 2023-07-21T22:34:17.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.719+0000 7fd979ffb640 1 -- 172.21.15.6:0/1324419545 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97c0b8670 con 0x7fd984158ce0 2023-07-21T22:34:17.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.719+0000 7fd98b848640 1 -- 172.21.15.6:0/1324419545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9840b3790 con 0x7fd984158ce0 2023-07-21T22:34:17.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.719+0000 7fd979ffb640 1 -- 172.21.15.6:0/1324419545 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0b8a20 con 0x7fd984158ce0 2023-07-21T22:34:17.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.719+0000 7fd98b848640 1 -- 172.21.15.6:0/1324419545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9840b2280 con 0x7fd984158ce0 2023-07-21T22:34:17.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.719+0000 7fd98b848640 1 -- 172.21.15.6:0/1324419545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9840ca1a0 con 0x7fd984158ce0 2023-07-21T22:34:17.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.719+0000 7fd979ffb640 1 -- 172.21.15.6:0/1324419545 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd97c0b8b80 con 0x7fd984158ce0 2023-07-21T22:34:17.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.723+0000 7fd979ffb640 1 --2- 172.21.15.6:0/1324419545 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fd9680663a0 0x7fd968068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:17.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.723+0000 7fd979ffb640 1 -- 172.21.15.6:0/1324419545 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6028+0+0 (secure 0 0 0) 0x7fd97c11f270 con 0x7fd984158ce0 2023-07-21T22:34:17.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.723+0000 7fd9895e4640 1 --2- 172.21.15.6:0/1324419545 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fd9680663a0 0x7fd968068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:17.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.723+0000 7fd9895e4640 1 --2- 172.21.15.6:0/1324419545 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fd9680663a0 0x7fd968068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd980009a90 tx=0x7fd980008040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:17.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.727+0000 7fd979ffb640 1 -- 172.21.15.6:0/1324419545 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd97c0ec680 con 0x7fd984158ce0 2023-07-21T22:34:17.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.911+0000 7fd98b848640 1 -- 172.21.15.6:0/1324419545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd984156f80 con 0x7fd984158ce0 2023-07-21T22:34:17.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.911+0000 7fd979ffb640 1 -- 172.21.15.6:0/1324419545 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fd97c009510 con 0x7fd984158ce0 2023-07-21T22:34:17.963 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:17.963 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5558,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/2410607534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2410607534},{"type":"v1","addr":"172.21.15.161:6836","nonce":2410607534}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5561,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/3696372013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":3696372013},{"type":"v1","addr":"172.21.15.161:6837","nonce":3696372013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6042,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/4134919456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4134919456},{"type":"v1","addr":"172.21.15.6:6833","nonce":4134919456}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":6516,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/4098465485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":4098465485},{"type":"v1","addr":"172.21.15.6:6835","nonce":4098465485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2023-07-21T22:34:17.963 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2023-07-21T22:34:17.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.915+0000 7fd98b848640 1 -- 172.21.15.6:0/1324419545 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fd9680663a0 msgr2=0x7fd968068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:17.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.915+0000 7fd98b848640 1 --2- 172.21.15.6:0/1324419545 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fd9680663a0 0x7fd968068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd980009a90 tx=0x7fd980008040 comp rx=0 tx=0).stop 2023-07-21T22:34:17.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.915+0000 7fd98b848640 1 -- 172.21.15.6:0/1324419545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd984158ce0 msgr2=0x7fd98414e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:17.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.915+0000 7fd98b848640 1 --2- 172.21.15.6:0/1324419545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd984158ce0 0x7fd98414e140 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0af040 tx=0x7fd97c019620 comp rx=0 tx=0).stop 2023-07-21T22:34:17.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.915+0000 7fd98b848640 1 -- 172.21.15.6:0/1324419545 shutdown_connections 2023-07-21T22:34:17.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.915+0000 7fd98b848640 1 --2- 172.21.15.6:0/1324419545 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fd9680663a0 0x7fd968068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.915+0000 7fd98b848640 1 --2- 172.21.15.6:0/1324419545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd984158ce0 0x7fd98414e140 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.915+0000 7fd98b848640 1 --2- 172.21.15.6:0/1324419545 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd9840c9560 0x7fd9841f3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.915+0000 7fd98b848640 1 --2- 172.21.15.6:0/1324419545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9840c8ad0 0x7fd9840b1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:17.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.915+0000 7fd98b848640 1 -- 172.21.15.6:0/1324419545 >> 172.21.15.6:0/1324419545 conn(0x7fd9840afcf0 msgr2=0x7fd9840ae190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.915+0000 7fd98b848640 1 -- 172.21.15.6:0/1324419545 shutdown_connections 2023-07-21T22:34:17.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:17.915+0000 7fd98b848640 1 -- 172.21.15.6:0/1324419545 wait complete. 2023-07-21T22:34:17.984 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-21T22:34:17.984 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-21T22:34:17.984 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-21T22:34:17.985 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:34:17.985 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-21T22:34:17.985 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-21T22:34:17.985 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-21T22:34:17.985 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:34:17.986 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-21T22:34:17.986 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-21T22:34:17.986 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-21T22:34:17.986 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:34:17.987 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-21T22:34:17.987 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-21T22:34:17.987 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-21T22:34:17.987 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:34:18.000 INFO:tasks.ceph.mds.a:Stopped 2023-07-21T22:34:18.001 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-21T22:34:18.002 INFO:tasks.ceph.mds.c:Stopped 2023-07-21T22:34:18.002 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-21T22:34:18.003 INFO:tasks.ceph.mds.b:Stopped 2023-07-21T22:34:18.003 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-21T22:34:18.004 INFO:tasks.ceph.mds.d:Stopped 2023-07-21T22:34:18.004 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-21T22:34:18.045 INFO:tasks.ceph.mds.a:Started 2023-07-21T22:34:18.046 DEBUG:teuthology.parallel:result is None 2023-07-21T22:34:18.047 INFO:tasks.ceph.mds.c:Started 2023-07-21T22:34:18.048 DEBUG:teuthology.parallel:result is None 2023-07-21T22:34:18.051 INFO:tasks.ceph.mds.b:Started 2023-07-21T22:34:18.051 DEBUG:teuthology.parallel:result is None 2023-07-21T22:34:18.053 INFO:tasks.ceph.mds.d:Started 2023-07-21T22:34:18.053 DEBUG:teuthology.parallel:result is None 2023-07-21T22:34:18.054 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-21T22:34:18.135 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-21T22:34:18.136 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-07-21T22:34:18.146 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-07-21T22:34:18.147 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2023-07-21T22:34:18.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.155+0000 7f02da1f6640 1 Processor -- start 2023-07-21T22:34:18.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.155+0000 7f02da1f6640 1 -- start start 2023-07-21T22:34:18.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.155+0000 7f02da1f6640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f02d40b7c70 0x7f02d40d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:18.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.155+0000 7f02da1f6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02d40d1850 0x7f02d415f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:18.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.155+0000 7f02da1f6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d40ccaf0 con 0x7f02d40d1300 2023-07-21T22:34:18.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.155+0000 7f02da1f6640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d40d1190 con 0x7f02d40b7c70 2023-07-21T22:34:18.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.155+0000 7f02da1f6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d4160600 con 0x7f02d40d1850 2023-07-21T22:34:18.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.155+0000 7f02d3fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f02d40d1300 0x7f02d40d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60564/0 (socket says 172.21.15.6:60564) 2023-07-21T22:34:18.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.155+0000 7f02d3fff640 1 -- 172.21.15.6:0/914507711 learned_addr learned my addr 172.21.15.6:0/914507711 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:18.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.155+0000 7f02d37fe640 1 --2- 172.21.15.6:0/914507711 >> v2:172.21.15.161:3300/0 conn(0x7f02d40b7c70 0x7f02d40d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:18.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.155+0000 7f02d2ffd640 1 --2- 172.21.15.6:0/914507711 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02d40d1850 0x7f02d415f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:18.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.159+0000 7f02d27fc640 1 -- 172.21.15.6:0/914507711 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687681010 0 0) 0x7f02d40ccaf0 con 0x7f02d40d1300 2023-07-21T22:34:18.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.159+0000 7f02d27fc640 1 -- 172.21.15.6:0/914507711 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02bc003530 con 0x7f02d40d1300 2023-07-21T22:34:18.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.159+0000 7f02d37fe640 1 -- 172.21.15.6:0/914507711 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02d40d1850 msgr2=0x7f02d415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:18.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.159+0000 7f02d37fe640 1 --2- 172.21.15.6:0/914507711 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02d40d1850 0x7f02d415f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:18.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.159+0000 7f02d37fe640 1 -- 172.21.15.6:0/914507711 >> v1:172.21.15.6:6789/0 conn(0x7f02d40d1300 legacy=0x7f02d40d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:18.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.159+0000 7f02d37fe640 1 -- 172.21.15.6:0/914507711 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d4160320 con 0x7f02d40b7c70 2023-07-21T22:34:18.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.159+0000 7f02d37fe640 1 --2- 172.21.15.6:0/914507711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02d40b7c70 0x7f02d40d0c50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f02c40097f0 tx=0x7f02c401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c750ab0ce4dc75b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:18.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.159+0000 7f02d27fc640 1 -- 172.21.15.6:0/914507711 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40ad660 con 0x7f02d40b7c70 2023-07-21T22:34:18.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.159+0000 7f02d27fc640 1 -- 172.21.15.6:0/914507711 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c40ad7c0 con 0x7f02d40b7c70 2023-07-21T22:34:18.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.159+0000 7f02d27fc640 1 -- 172.21.15.6:0/914507711 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40adb30 con 0x7f02d40b7c70 2023-07-21T22:34:18.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02da1f6640 1 -- 172.21.15.6:0/914507711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02d40b7c70 msgr2=0x7f02d40d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:18.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02da1f6640 1 --2- 172.21.15.6:0/914507711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02d40b7c70 0x7f02d40d0c50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f02c40097f0 tx=0x7f02c401c450 comp rx=0 tx=0).stop 2023-07-21T22:34:18.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02da1f6640 1 -- 172.21.15.6:0/914507711 shutdown_connections 2023-07-21T22:34:18.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02da1f6640 1 --2- 172.21.15.6:0/914507711 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02d40d1850 0x7f02d415f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:18.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02da1f6640 1 --2- 172.21.15.6:0/914507711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02d40b7c70 0x7f02d40d0c50 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:18.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02da1f6640 1 -- 172.21.15.6:0/914507711 >> 172.21.15.6:0/914507711 conn(0x7f02d40650b0 msgr2=0x7f02d40654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:18.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02da1f6640 1 -- 172.21.15.6:0/914507711 shutdown_connections 2023-07-21T22:34:18.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02da1f6640 1 -- 172.21.15.6:0/914507711 wait complete. 2023-07-21T22:34:18.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02da1f6640 1 Processor -- start 2023-07-21T22:34:18.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02da1f6640 1 -- start start 2023-07-21T22:34:18.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02da1f6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02d40b7c70 0x7f02d414c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:18.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02da1f6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02d40d1300 0x7f02d415b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:18.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02da1f6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d40d1850 0x7f02d40b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:18.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02da1f6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d415eb70 con 0x7f02d40d1850 2023-07-21T22:34:18.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02da1f6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d415dff0 con 0x7f02d40d1300 2023-07-21T22:34:18.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02da1f6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d415e2d0 con 0x7f02d40b7c70 2023-07-21T22:34:18.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02d3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d40d1850 0x7f02d40b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:18.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02d3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d40d1850 0x7f02d40b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44522/0 (socket says 172.21.15.6:44522) 2023-07-21T22:34:18.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02d3fff640 1 -- 172.21.15.6:0/3984918661 learned_addr learned my addr 172.21.15.6:0/3984918661 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:18.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02d37fe640 1 --2- 172.21.15.6:0/3984918661 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02d40b7c70 0x7f02d414c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:18.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.163+0000 7f02d2ffd640 1 --2- 172.21.15.6:0/3984918661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02d40d1300 0x7f02d415b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:18.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.167+0000 7f02d3fff640 1 -- 172.21.15.6:0/3984918661 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02d40b7c70 msgr2=0x7f02d414c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:18.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.167+0000 7f02d3fff640 1 --2- 172.21.15.6:0/3984918661 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02d40b7c70 0x7f02d414c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:18.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.167+0000 7f02d3fff640 1 -- 172.21.15.6:0/3984918661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02d40d1300 msgr2=0x7f02d415b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:18.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.167+0000 7f02d3fff640 1 --2- 172.21.15.6:0/3984918661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02d40d1300 0x7f02d415b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:18.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.167+0000 7f02d3fff640 1 -- 172.21.15.6:0/3984918661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c4009420 con 0x7f02d40d1850 2023-07-21T22:34:18.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.167+0000 7f02d3fff640 1 --2- 172.21.15.6:0/3984918661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d40d1850 0x7f02d40b2b10 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00caa0 tx=0x7f02cc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:18.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.167+0000 7f02bbfff640 1 -- 172.21.15.6:0/3984918661 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc00ac00 con 0x7f02d40d1850 2023-07-21T22:34:18.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.167+0000 7f02bbfff640 1 -- 172.21.15.6:0/3984918661 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc00ad60 con 0x7f02d40d1850 2023-07-21T22:34:18.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.167+0000 7f02bbfff640 1 -- 172.21.15.6:0/3984918661 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc012620 con 0x7f02d40d1850 2023-07-21T22:34:18.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.167+0000 7f02da1f6640 1 -- 172.21.15.6:0/3984918661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d415e5b0 con 0x7f02d40d1850 2023-07-21T22:34:18.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.167+0000 7f02da1f6640 1 -- 172.21.15.6:0/3984918661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d41553b0 con 0x7f02d40d1850 2023-07-21T22:34:18.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.167+0000 7f02da1f6640 1 -- 172.21.15.6:0/3984918661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d41555d0 con 0x7f02d40d1850 2023-07-21T22:34:18.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.167+0000 7f02bbfff640 1 -- 172.21.15.6:0/3984918661 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f02cc007070 con 0x7f02d40d1850 2023-07-21T22:34:18.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.167+0000 7f02bbfff640 1 --2- 172.21.15.6:0/3984918661 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f02c00663a0 0x7f02c0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:18.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.167+0000 7f02bbfff640 1 -- 172.21.15.6:0/3984918661 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6028+0+0 (secure 0 0 0) 0x7f02cc083d60 con 0x7f02d40d1850 2023-07-21T22:34:18.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.167+0000 7f02d37fe640 1 --2- 172.21.15.6:0/3984918661 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f02c00663a0 0x7f02c0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:18.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.171+0000 7f02d37fe640 1 --2- 172.21.15.6:0/3984918661 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f02c00663a0 0x7f02c0068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f02c40af000 tx=0x7f02c40a7000 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:18.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.171+0000 7f02bbfff640 1 -- 172.21.15.6:0/3984918661 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f02cc051190 con 0x7f02d40d1850 2023-07-21T22:34:18.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:18.343+0000 7f02da1f6640 1 -- 172.21.15.6:0/3984918661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f02d40678d0 con 0x7f02d40d1850 2023-07-21T22:34:19.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.307+0000 7f02bbfff640 1 -- 172.21.15.6:0/3984918661 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v80) v1 ==== 97+0+0 (secure 0 0 0) 0x7f02cc017080 con 0x7f02d40d1850 2023-07-21T22:34:19.357 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-07-21T22:34:19.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.311+0000 7f02da1f6640 1 -- 172.21.15.6:0/3984918661 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f02c00663a0 msgr2=0x7f02c0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:19.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.311+0000 7f02da1f6640 1 --2- 172.21.15.6:0/3984918661 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f02c00663a0 0x7f02c0068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f02c40af000 tx=0x7f02c40a7000 comp rx=0 tx=0).stop 2023-07-21T22:34:19.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.311+0000 7f02da1f6640 1 -- 172.21.15.6:0/3984918661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d40d1850 msgr2=0x7f02d40b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:19.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.311+0000 7f02da1f6640 1 --2- 172.21.15.6:0/3984918661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d40d1850 0x7f02d40b2b10 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00caa0 tx=0x7f02cc00cf60 comp rx=0 tx=0).stop 2023-07-21T22:34:19.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.311+0000 7f02da1f6640 1 -- 172.21.15.6:0/3984918661 shutdown_connections 2023-07-21T22:34:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.311+0000 7f02da1f6640 1 --2- 172.21.15.6:0/3984918661 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f02c00663a0 0x7f02c0068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.311+0000 7f02da1f6640 1 --2- 172.21.15.6:0/3984918661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02d40d1850 0x7f02d40b2b10 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.311+0000 7f02da1f6640 1 --2- 172.21.15.6:0/3984918661 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02d40d1300 0x7f02d415b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.311+0000 7f02da1f6640 1 --2- 172.21.15.6:0/3984918661 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02d40b7c70 0x7f02d414c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.311+0000 7f02da1f6640 1 -- 172.21.15.6:0/3984918661 >> 172.21.15.6:0/3984918661 conn(0x7f02d40650b0 msgr2=0x7f02d4065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.311+0000 7f02da1f6640 1 -- 172.21.15.6:0/3984918661 shutdown_connections 2023-07-21T22:34:19.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.311+0000 7f02da1f6640 1 -- 172.21.15.6:0/3984918661 wait complete. 2023-07-21T22:34:19.383 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-21T22:34:19.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.483+0000 7fa76c66d640 1 Processor -- start 2023-07-21T22:34:19.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.483+0000 7fa76c66d640 1 -- start start 2023-07-21T22:34:19.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.483+0000 7fa76c66d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa7640ae1f0 0x7fa7640b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:19.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.483+0000 7fa76c66d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa76406e160 0x7fa76406bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:19.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.483+0000 7fa76c66d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76406a440 con 0x7fa76406c260 2023-07-21T22:34:19.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.483+0000 7fa76c66d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76406c660 con 0x7fa7640ae1f0 2023-07-21T22:34:19.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.483+0000 7fa76c66d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7640b24f0 con 0x7fa76406e160 2023-07-21T22:34:19.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.483+0000 7fa76a409640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa7640ae1f0 0x7fa7640b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:19.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.487+0000 7fa76a409640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa7640ae1f0 0x7fa7640b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44534/0 (socket says 172.21.15.6:44534) 2023-07-21T22:34:19.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.487+0000 7fa76a409640 1 -- 172.21.15.6:0/1317927927 learned_addr learned my addr 172.21.15.6:0/1317927927 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:19.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.487+0000 7fa769c08640 1 --2- 172.21.15.6:0/1317927927 >> v2:172.21.15.161:3300/0 conn(0x7fa76406e160 0x7fa76406bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:19.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.487+0000 7fa76a409640 1 -- 172.21.15.6:0/1317927927 >> v2:172.21.15.161:3300/0 conn(0x7fa76406e160 msgr2=0x7fa76406bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:19.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.487+0000 7fa76a409640 1 --2- 172.21.15.6:0/1317927927 >> v2:172.21.15.161:3300/0 conn(0x7fa76406e160 0x7fa76406bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:19.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.487+0000 7fa76a409640 1 -- 172.21.15.6:0/1317927927 >> v1:172.21.15.161:6789/0 conn(0x7fa76406c260 legacy=0x7fa76415f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:19.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.487+0000 7fa76a409640 1 -- 172.21.15.6:0/1317927927 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7640b27d0 con 0x7fa7640ae1f0 2023-07-21T22:34:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.487+0000 7fa76a409640 1 --2- 172.21.15.6:0/1317927927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7640ae1f0 0x7fa7640b1e60 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa7640cf720 tx=0x7fa76001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d249769160ec22c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.487+0000 7fa769407640 1 -- 172.21.15.6:0/1317927927 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7600ac410 con 0x7fa7640ae1f0 2023-07-21T22:34:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.487+0000 7fa769407640 1 -- 172.21.15.6:0/1317927927 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7600ac570 con 0x7fa7640ae1f0 2023-07-21T22:34:19.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.487+0000 7fa769407640 1 -- 172.21.15.6:0/1317927927 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7600ac900 con 0x7fa7640ae1f0 2023-07-21T22:34:19.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa76c66d640 1 -- 172.21.15.6:0/1317927927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7640ae1f0 msgr2=0x7fa7640b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:19.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa76c66d640 1 --2- 172.21.15.6:0/1317927927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7640ae1f0 0x7fa7640b1e60 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa7640cf720 tx=0x7fa76001c490 comp rx=0 tx=0).stop 2023-07-21T22:34:19.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa76c66d640 1 -- 172.21.15.6:0/1317927927 shutdown_connections 2023-07-21T22:34:19.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa76c66d640 1 --2- 172.21.15.6:0/1317927927 >> v2:172.21.15.161:3300/0 conn(0x7fa76406e160 0x7fa76406bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:19.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa76c66d640 1 --2- 172.21.15.6:0/1317927927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7640ae1f0 0x7fa7640b1e60 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:19.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa76c66d640 1 -- 172.21.15.6:0/1317927927 >> 172.21.15.6:0/1317927927 conn(0x7fa7640b1300 msgr2=0x7fa7640ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:19.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa76c66d640 1 -- 172.21.15.6:0/1317927927 shutdown_connections 2023-07-21T22:34:19.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa76c66d640 1 -- 172.21.15.6:0/1317927927 wait complete. 2023-07-21T22:34:19.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa76c66d640 1 Processor -- start 2023-07-21T22:34:19.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa76c66d640 1 -- start start 2023-07-21T22:34:19.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa76c66d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa76406c260 0x7fa764139620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:19.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa76c66d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa76406e160 0x7fa7641411d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:19.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa76c66d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7640ae1f0 0x7fa764141710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:19.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa76c66d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76413da40 con 0x7fa76406e160 2023-07-21T22:34:19.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa76c66d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76413ee70 con 0x7fa76406c260 2023-07-21T22:34:19.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa76c66d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa764140d40 con 0x7fa7640ae1f0 2023-07-21T22:34:19.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa769c08640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa76406e160 0x7fa7641411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:19.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa769c08640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa76406e160 0x7fa7641411d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44544/0 (socket says 172.21.15.6:44544) 2023-07-21T22:34:19.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa769c08640 1 -- 172.21.15.6:0/2107179441 learned_addr learned my addr 172.21.15.6:0/2107179441 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:19.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa76a409640 1 --2- 172.21.15.6:0/2107179441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa76406c260 0x7fa764139620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:19.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa76ac0a640 1 --2- 172.21.15.6:0/2107179441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7640ae1f0 0x7fa764141710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:19.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa769c08640 1 -- 172.21.15.6:0/2107179441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7640ae1f0 msgr2=0x7fa764141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:19.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa769c08640 1 --2- 172.21.15.6:0/2107179441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7640ae1f0 0x7fa764141710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:19.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa769c08640 1 -- 172.21.15.6:0/2107179441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa76406c260 msgr2=0x7fa764139620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:19.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa769c08640 1 --2- 172.21.15.6:0/2107179441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa76406c260 0x7fa764139620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:19.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.491+0000 7fa769c08640 1 -- 172.21.15.6:0/2107179441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7600094d0 con 0x7fa76406e160 2023-07-21T22:34:19.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.495+0000 7fa769c08640 1 --2- 172.21.15.6:0/2107179441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa76406e160 0x7fa7641411d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa75400d830 tx=0x7fa75400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:19.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.495+0000 7fa75affd640 1 -- 172.21.15.6:0/2107179441 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75400b6c0 con 0x7fa76406e160 2023-07-21T22:34:19.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.495+0000 7fa75affd640 1 -- 172.21.15.6:0/2107179441 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75400b820 con 0x7fa76406e160 2023-07-21T22:34:19.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.495+0000 7fa75affd640 1 -- 172.21.15.6:0/2107179441 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75400bb90 con 0x7fa76406e160 2023-07-21T22:34:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.495+0000 7fa76c66d640 1 -- 172.21.15.6:0/2107179441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76413d4c0 con 0x7fa76406e160 2023-07-21T22:34:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.495+0000 7fa76c66d640 1 -- 172.21.15.6:0/2107179441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7640ce480 con 0x7fa76406e160 2023-07-21T22:34:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.495+0000 7fa76c66d640 1 -- 172.21.15.6:0/2107179441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa764140ed0 con 0x7fa76406e160 2023-07-21T22:34:19.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.495+0000 7fa75affd640 1 -- 172.21.15.6:0/2107179441 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa75401e460 con 0x7fa76406e160 2023-07-21T22:34:19.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.495+0000 7fa75affd640 1 --2- 172.21.15.6:0/2107179441 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fa7480663a0 0x7fa748068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:19.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.495+0000 7fa75affd640 1 -- 172.21.15.6:0/2107179441 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5254+0+0 (secure 0 0 0) 0x7fa7540842b0 con 0x7fa76406e160 2023-07-21T22:34:19.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.495+0000 7fa76a409640 1 --2- 172.21.15.6:0/2107179441 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fa7480663a0 0x7fa748068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:19.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.499+0000 7fa76a409640 1 --2- 172.21.15.6:0/2107179441 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fa7480663a0 0x7fa748068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa7600ae000 tx=0x7fa760009040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:19.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.499+0000 7fa75affd640 1 -- 172.21.15.6:0/2107179441 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa754051930 con 0x7fa76406e160 2023-07-21T22:34:19.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.707+0000 7fa76c66d640 1 -- 172.21.15.6:0/2107179441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa764140b30 con 0x7fa76406e160 2023-07-21T22:34:19.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.707+0000 7fa75affd640 1 -- 172.21.15.6:0/2107179441 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa754054f50 con 0x7fa76406e160 2023-07-21T22:34:19.758 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:19.758 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:34:19.758 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-07-21T22:34:19.758 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:19.758 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-07-21T22:34:19.758 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkHn5HNxAADk0AaSGwZfEj3SwNvEm8hw==", 2023-07-21T22:34:19.758 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:19.759 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:34:19.759 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:34:19.759 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:34:19.759 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:19.759 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:19.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:19.759 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:19.760 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-07-21T22:34:19.760 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkQFvXCBAANxf0/I2RQcHy4iYiydjkcg==", 2023-07-21T22:34:19.760 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:19.760 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:34:19.760 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:34:19.760 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:34:19.760 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:19.760 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:19.761 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:19.761 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:19.761 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-07-21T22:34:19.761 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkYtGXAxAAy+RDDBSvc1FeZq+eg23tRA==", 2023-07-21T22:34:19.761 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:19.761 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:34:19.761 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:34:19.761 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:34:19.762 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:19.762 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:19.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:19.762 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:19.762 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-07-21T22:34:19.762 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkH+Y1EBAAl+qTqd+gFrB9LtJWwD5dgA==", 2023-07-21T22:34:19.762 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:19.763 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:34:19.763 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:34:19.763 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:34:19.763 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:19.763 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:19.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:19.763 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:19.763 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-07-21T22:34:19.764 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAKBLtkPwZrLBAAQHZECi2zHST1MKYgGoa/Iw==", 2023-07-21T22:34:19.764 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:19.764 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:34:19.764 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:34:19.764 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:19.764 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:19.764 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:19.764 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:19.765 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-07-21T22:34:19.765 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQANBLtkvwgwNBAApurMm8c3pSlX2r16Gli/Ag==", 2023-07-21T22:34:19.765 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:19.765 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:34:19.765 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:34:19.765 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:19.765 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:19.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:19.766 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:19.766 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-07-21T22:34:19.766 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAQBLtkf2p1OxAAcKYw2RixFefYAwcfkGnOKQ==", 2023-07-21T22:34:19.766 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:19.766 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:34:19.766 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:34:19.766 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:19.766 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:19.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:19.767 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:19.767 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-07-21T22:34:19.767 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAUBLtkQUl6BhAAXXT1ZK1h9aZEcp6qIHsLiA==", 2023-07-21T22:34:19.767 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:19.767 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:34:19.767 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:34:19.768 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:19.768 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:19.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:19.768 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:19.768 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-07-21T22:34:19.768 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAaBLtkc1VfExAAPzDz2k/c0qVePG9h1saQCw==", 2023-07-21T22:34:19.768 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:19.769 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:34:19.769 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:34:19.769 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:19.769 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:19.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:19.769 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:19.769 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-07-21T22:34:19.769 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAdBLtkJ6fcGhAAglVSJIQS04WYBv4APhl57g==", 2023-07-21T22:34:19.770 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:19.770 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:34:19.770 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:34:19.770 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:19.770 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:19.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:19.770 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:19.771 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-07-21T22:34:19.771 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAgBLtkPINGIRAAWKs1RNQIdhZYlDAzDgUkNw==", 2023-07-21T22:34:19.771 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:19.771 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:34:19.771 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:34:19.771 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:19.771 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:19.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:19.772 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:19.772 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-07-21T22:34:19.772 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAjBLtk83MCKBAAZH2NhMBphVv4QkRzy+NDgg==", 2023-07-21T22:34:19.772 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:19.772 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:34:19.772 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:34:19.772 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:19.772 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:19.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:19.773 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:19.773 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-07-21T22:34:19.773 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA==", 2023-07-21T22:34:19.773 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:19.773 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:34:19.773 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-07-21T22:34:19.773 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-21T22:34:19.774 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:19.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:19.774 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:19.774 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-07-21T22:34:19.774 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkPVXTHhAAYmkzwAvqsfrowpAucTnlUQ==", 2023-07-21T22:34:19.774 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:19.774 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:34:19.775 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:34:19.775 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:34:19.775 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:34:19.775 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:19.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:19.775 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:19.775 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-07-21T22:34:19.775 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkd7wSGxAArvSYwe+k48vgRzb3fQAEAQ==", 2023-07-21T22:34:19.776 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:19.776 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:34:19.776 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:34:19.776 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:34:19.776 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:34:19.776 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:19.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:19.776 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:19.777 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-07-21T22:34:19.777 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkoZ4YJRAAX4yh0Q1pR4wY7yEV6kg9QA==", 2023-07-21T22:34:19.777 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:19.777 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:34:19.777 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:34:19.777 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:34:19.777 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:34:19.777 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:19.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:19.778 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:19.778 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-07-21T22:34:19.778 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtk0ILFGhAAQZ+8lGNFVdOtZYOuLlfkoQ==", 2023-07-21T22:34:19.778 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:19.778 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:34:19.778 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:34:19.778 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:34:19.779 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:19.779 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:19.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:19.779 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:19.779 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-07-21T22:34:19.779 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkdobtMhAAQbwi3cvsrW9P0t3d52oEKw==", 2023-07-21T22:34:19.779 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:19.780 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:34:19.780 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T22:34:19.780 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:19.780 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:19.780 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:19.780 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:19.780 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-07-21T22:34:19.780 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkHhzpLhAAZTx4Vrc0Htk88104SzuAxQ==", 2023-07-21T22:34:19.781 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:19.781 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:34:19.781 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T22:34:19.781 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:19.781 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:19.782 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:19.782 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-07-21T22:34:19.782 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:34:19.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.711+0000 7fa76c66d640 1 -- 172.21.15.6:0/2107179441 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fa7480663a0 msgr2=0x7fa748068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:19.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.711+0000 7fa76c66d640 1 --2- 172.21.15.6:0/2107179441 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fa7480663a0 0x7fa748068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa7600ae000 tx=0x7fa760009040 comp rx=0 tx=0).stop 2023-07-21T22:34:19.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.711+0000 7fa76c66d640 1 -- 172.21.15.6:0/2107179441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa76406e160 msgr2=0x7fa7641411d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:19.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.711+0000 7fa76c66d640 1 --2- 172.21.15.6:0/2107179441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa76406e160 0x7fa7641411d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa75400d830 tx=0x7fa75400dcf0 comp rx=0 tx=0).stop 2023-07-21T22:34:19.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.711+0000 7fa76c66d640 1 -- 172.21.15.6:0/2107179441 shutdown_connections 2023-07-21T22:34:19.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.711+0000 7fa76c66d640 1 --2- 172.21.15.6:0/2107179441 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fa7480663a0 0x7fa748068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:19.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.711+0000 7fa76c66d640 1 --2- 172.21.15.6:0/2107179441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7640ae1f0 0x7fa764141710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:19.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.711+0000 7fa76c66d640 1 --2- 172.21.15.6:0/2107179441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa76406e160 0x7fa7641411d0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:19.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.711+0000 7fa76c66d640 1 --2- 172.21.15.6:0/2107179441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa76406c260 0x7fa764139620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:19.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.711+0000 7fa76c66d640 1 -- 172.21.15.6:0/2107179441 >> 172.21.15.6:0/2107179441 conn(0x7fa7640b1300 msgr2=0x7fa7640accb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:19.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.711+0000 7fa76c66d640 1 -- 172.21.15.6:0/2107179441 shutdown_connections 2023-07-21T22:34:19.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.711+0000 7fa76c66d640 1 -- 172.21.15.6:0/2107179441 wait complete. 2023-07-21T22:34:19.785 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:34:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.879+0000 7f7a4519f640 1 Processor -- start 2023-07-21T22:34:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.879+0000 7f7a4519f640 1 -- start start 2023-07-21T22:34:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.883+0000 7f7a4519f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7a400affc0 0x7f7a4006fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.883+0000 7f7a4519f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a4006ffb0 0x7f7a400c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.883+0000 7f7a4519f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a40158a50 con 0x7f7a40158680 2023-07-21T22:34:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.883+0000 7f7a4519f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a401599b0 con 0x7f7a400affc0 2023-07-21T22:34:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.883+0000 7f7a4519f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4015d170 con 0x7f7a4006ffb0 2023-07-21T22:34:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.883+0000 7f7a3f7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7a400affc0 0x7f7a4006fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.883+0000 7f7a4499e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a4006ffb0 0x7f7a400c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.883+0000 7f7a3f7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7a400affc0 0x7f7a4006fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:53676/0 (socket says 172.21.15.6:53676) 2023-07-21T22:34:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.883+0000 7f7a3f7fe640 1 -- 172.21.15.6:0/1675273775 learned_addr learned my addr 172.21.15.6:0/1675273775 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.883+0000 7f7a3ffff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7a40158680 0x7f7a400af8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:36500/0 (socket says 172.21.15.6:36500) 2023-07-21T22:34:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.883+0000 7f7a3f7fe640 1 -- 172.21.15.6:0/1675273775 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a4006ffb0 msgr2=0x7f7a400c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.883+0000 7f7a3f7fe640 1 --2- 172.21.15.6:0/1675273775 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a4006ffb0 0x7f7a400c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.883+0000 7f7a3f7fe640 1 -- 172.21.15.6:0/1675273775 >> v1:172.21.15.161:6789/0 conn(0x7f7a40158680 legacy=0x7f7a400af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.883+0000 7f7a3f7fe640 1 -- 172.21.15.6:0/1675273775 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a40158d30 con 0x7f7a400affc0 2023-07-21T22:34:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.883+0000 7f7a3effd640 1 -- 172.21.15.6:0/1675273775 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1602877005 0 0) 0x7f7a40158a50 con 0x7f7a40158680 2023-07-21T22:34:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.887+0000 7f7a3f7fe640 1 --2- 172.21.15.6:0/1675273775 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a400affc0 0x7f7a4006fa70 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009870 tx=0x7f7a3401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16f5d6bdeff3a620 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.887+0000 7f7a3effd640 1 -- 172.21.15.6:0/1675273775 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a340aa670 con 0x7f7a400affc0 2023-07-21T22:34:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.887+0000 7f7a3effd640 1 -- 172.21.15.6:0/1675273775 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a340aa7d0 con 0x7f7a400affc0 2023-07-21T22:34:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.887+0000 7f7a3effd640 1 -- 172.21.15.6:0/1675273775 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a340aab60 con 0x7f7a400affc0 2023-07-21T22:34:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.887+0000 7f7a4519f640 1 -- 172.21.15.6:0/1675273775 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a400affc0 msgr2=0x7f7a4006fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.887+0000 7f7a4519f640 1 --2- 172.21.15.6:0/1675273775 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a400affc0 0x7f7a4006fa70 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009870 tx=0x7f7a3401c510 comp rx=0 tx=0).stop 2023-07-21T22:34:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.887+0000 7f7a4519f640 1 -- 172.21.15.6:0/1675273775 shutdown_connections 2023-07-21T22:34:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.887+0000 7f7a4519f640 1 --2- 172.21.15.6:0/1675273775 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a4006ffb0 0x7f7a400c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.887+0000 7f7a4519f640 1 --2- 172.21.15.6:0/1675273775 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a400affc0 0x7f7a4006fa70 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.887+0000 7f7a4519f640 1 -- 172.21.15.6:0/1675273775 >> 172.21.15.6:0/1675273775 conn(0x7f7a400ca8b0 msgr2=0x7f7a400cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:19.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.887+0000 7f7a4519f640 1 -- 172.21.15.6:0/1675273775 shutdown_connections 2023-07-21T22:34:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.887+0000 7f7a4519f640 1 -- 172.21.15.6:0/1675273775 wait complete. 2023-07-21T22:34:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.887+0000 7f7a4519f640 1 Processor -- start 2023-07-21T22:34:19.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.887+0000 7f7a4519f640 1 -- start start 2023-07-21T22:34:19.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a4519f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a4006ffb0 0x7f7a401572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:19.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a4519f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a400affc0 0x7f7a40154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:19.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a4519f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a40158680 0x7f7a401552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:19.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a4519f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400c5b70 con 0x7f7a400affc0 2023-07-21T22:34:19.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a4519f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400c4fa0 con 0x7f7a4006ffb0 2023-07-21T22:34:19.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a4519f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a400c5240 con 0x7f7a40158680 2023-07-21T22:34:19.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a3f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a400affc0 0x7f7a40154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:19.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a3f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a400affc0 0x7f7a40154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44546/0 (socket says 172.21.15.6:44546) 2023-07-21T22:34:19.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a3f7fe640 1 -- 172.21.15.6:0/2481130356 learned_addr learned my addr 172.21.15.6:0/2481130356 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:19.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a3ffff640 1 --2- 172.21.15.6:0/2481130356 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a4006ffb0 0x7f7a401572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a4499e640 1 --2- 172.21.15.6:0/2481130356 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a40158680 0x7f7a401552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a3f7fe640 1 -- 172.21.15.6:0/2481130356 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a40158680 msgr2=0x7f7a401552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a3f7fe640 1 --2- 172.21.15.6:0/2481130356 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a40158680 0x7f7a401552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a3f7fe640 1 -- 172.21.15.6:0/2481130356 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a4006ffb0 msgr2=0x7f7a401572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a3f7fe640 1 --2- 172.21.15.6:0/2481130356 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a4006ffb0 0x7f7a401572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a3f7fe640 1 -- 172.21.15.6:0/2481130356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a340094d0 con 0x7f7a400affc0 2023-07-21T22:34:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a3f7fe640 1 --2- 172.21.15.6:0/2481130356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a400affc0 0x7f7a40154d70 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f7a340ac040 tx=0x7f7a3401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:19.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a3cff9640 1 -- 172.21.15.6:0/2481130356 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a340b3800 con 0x7f7a400affc0 2023-07-21T22:34:19.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a3cff9640 1 -- 172.21.15.6:0/2481130356 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a340b3960 con 0x7f7a400affc0 2023-07-21T22:34:19.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a4519f640 1 -- 172.21.15.6:0/2481130356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a400c5520 con 0x7f7a400affc0 2023-07-21T22:34:19.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a3cff9640 1 -- 172.21.15.6:0/2481130356 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a340b3d10 con 0x7f7a400affc0 2023-07-21T22:34:19.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a4519f640 1 -- 172.21.15.6:0/2481130356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a40149b50 con 0x7f7a400affc0 2023-07-21T22:34:19.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.891+0000 7f7a4519f640 1 -- 172.21.15.6:0/2481130356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a400678d0 con 0x7f7a400affc0 2023-07-21T22:34:19.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.895+0000 7f7a3cff9640 1 -- 172.21.15.6:0/2481130356 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7a340b2380 con 0x7f7a400affc0 2023-07-21T22:34:19.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.895+0000 7f7a3cff9640 1 --2- 172.21.15.6:0/2481130356 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f7a2c0663a0 0x7f7a2c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:19.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.895+0000 7f7a3cff9640 1 -- 172.21.15.6:0/2481130356 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5254+0+0 (secure 0 0 0) 0x7f7a3411e600 con 0x7f7a400affc0 2023-07-21T22:34:19.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.895+0000 7f7a3ffff640 1 --2- 172.21.15.6:0/2481130356 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f7a2c0663a0 0x7f7a2c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:19.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.895+0000 7f7a3ffff640 1 --2- 172.21.15.6:0/2481130356 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f7a2c0663a0 0x7f7a2c068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7a30000f70 tx=0x7f7a30007df0 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:19.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:19.899+0000 7f7a3cff9640 1 -- 172.21.15.6:0/2481130356 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7a340ebba0 con 0x7f7a400affc0 2023-07-21T22:34:20.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.059+0000 7f7a4519f640 1 -- 172.21.15.6:0/2481130356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a4014f5a0 con 0x7f7a400affc0 2023-07-21T22:34:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.059+0000 7f7a3cff9640 1 -- 172.21.15.6:0/2481130356 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+14637 (secure 0 0 0) 0x7f7a340ef1c0 con 0x7f7a400affc0 2023-07-21T22:34:20.108 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:20.109 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":80,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:34:19.305679+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:34:20.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.059+0000 7f7a4519f640 1 -- 172.21.15.6:0/2481130356 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f7a2c0663a0 msgr2=0x7f7a2c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:20.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.059+0000 7f7a4519f640 1 --2- 172.21.15.6:0/2481130356 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f7a2c0663a0 0x7f7a2c068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7a30000f70 tx=0x7f7a30007df0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.059+0000 7f7a4519f640 1 -- 172.21.15.6:0/2481130356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a400affc0 msgr2=0x7f7a40154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:20.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.059+0000 7f7a4519f640 1 --2- 172.21.15.6:0/2481130356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a400affc0 0x7f7a40154d70 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f7a340ac040 tx=0x7f7a3401ad50 comp rx=0 tx=0).stop 2023-07-21T22:34:20.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.059+0000 7f7a4519f640 1 -- 172.21.15.6:0/2481130356 shutdown_connections 2023-07-21T22:34:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.059+0000 7f7a4519f640 1 --2- 172.21.15.6:0/2481130356 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f7a2c0663a0 0x7f7a2c068850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.059+0000 7f7a4519f640 1 --2- 172.21.15.6:0/2481130356 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7a40158680 0x7f7a401552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.059+0000 7f7a4519f640 1 --2- 172.21.15.6:0/2481130356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a400affc0 0x7f7a40154d70 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.059+0000 7f7a4519f640 1 --2- 172.21.15.6:0/2481130356 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7a4006ffb0 0x7f7a401572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.059+0000 7f7a4519f640 1 -- 172.21.15.6:0/2481130356 >> 172.21.15.6:0/2481130356 conn(0x7f7a400ca8b0 msgr2=0x7f7a400cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.059+0000 7f7a4519f640 1 -- 172.21.15.6:0/2481130356 shutdown_connections 2023-07-21T22:34:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.059+0000 7f7a4519f640 1 -- 172.21.15.6:0/2481130356 wait complete. 2023-07-21T22:34:20.130 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:34:20.130 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:34:20.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.227+0000 7fae97dfa640 1 Processor -- start 2023-07-21T22:34:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.227+0000 7fae97dfa640 1 -- start start 2023-07-21T22:34:20.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae97dfa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fae90069430 0x7fae90069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae97dfa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae90070f30 0x7fae900ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae97dfa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae90159d70 con 0x7fae900af2b0 2023-07-21T22:34:20.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae97dfa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae90069d40 con 0x7fae90069430 2023-07-21T22:34:20.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae97dfa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae900c9c60 con 0x7fae90070f30 2023-07-21T22:34:20.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae96397640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fae900af2b0 0x7fae9015a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60580/0 (socket says 172.21.15.6:60580) 2023-07-21T22:34:20.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae96397640 1 -- 172.21.15.6:0/361863482 learned_addr learned my addr 172.21.15.6:0/361863482 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:20.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae95b96640 1 --2- 172.21.15.6:0/361863482 >> v2:172.21.15.161:3300/0 conn(0x7fae90069430 0x7fae90069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae95395640 1 --2- 172.21.15.6:0/361863482 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae90070f30 0x7fae900ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae94b94640 1 -- 172.21.15.6:0/361863482 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709157037 0 0) 0x7fae880014a0 con 0x7fae900af2b0 2023-07-21T22:34:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae94b94640 1 -- 172.21.15.6:0/361863482 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae7c003530 con 0x7fae900af2b0 2023-07-21T22:34:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae94b94640 1 -- 172.21.15.6:0/361863482 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3867959949 0 0) 0x7fae7c003530 con 0x7fae900af2b0 2023-07-21T22:34:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae94b94640 1 -- 172.21.15.6:0/361863482 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae90070f30 msgr2=0x7fae900ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae94b94640 1 --2- 172.21.15.6:0/361863482 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae90070f30 0x7fae900ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae94b94640 1 -- 172.21.15.6:0/361863482 >> v2:172.21.15.161:3300/0 conn(0x7fae90069430 msgr2=0x7fae90069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae94b94640 1 --2- 172.21.15.6:0/361863482 >> v2:172.21.15.161:3300/0 conn(0x7fae90069430 0x7fae90069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae94b94640 1 -- 172.21.15.6:0/361863482 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae900c9f40 con 0x7fae900af2b0 2023-07-21T22:34:20.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae94b94640 1 -- 172.21.15.6:0/361863482 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fae88001b90 con 0x7fae900af2b0 2023-07-21T22:34:20.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae94b94640 1 -- 172.21.15.6:0/361863482 >> v1:172.21.15.6:6789/0 conn(0x7fae900af2b0 legacy=0x7fae9015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:20.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae94b94640 1 --2- 172.21.15.6:0/361863482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae7c003980 0x7fae7c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae94b94640 1 --2- 172.21.15.6:0/361863482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae7c0043b0 0x7fae7c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae94b94640 1 --2- 172.21.15.6:0/361863482 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae90070f30 0x7fae7c004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae94b94640 1 -- 172.21.15.6:0/361863482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae90069d40 con 0x7fae7c0043b0 2023-07-21T22:34:20.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae94b94640 1 -- 172.21.15.6:0/361863482 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae900c9c60 con 0x7fae7c003980 2023-07-21T22:34:20.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae94b94640 1 -- 172.21.15.6:0/361863482 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c00b990 con 0x7fae90070f30 2023-07-21T22:34:20.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae95395640 1 --2- 172.21.15.6:0/361863482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae7c0043b0 0x7fae7c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae95b96640 1 --2- 172.21.15.6:0/361863482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae7c003980 0x7fae7c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae96397640 1 --2- 172.21.15.6:0/361863482 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae90070f30 0x7fae7c004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae95395640 1 -- 172.21.15.6:0/361863482 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae90070f30 msgr2=0x7fae7c004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:20.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae95395640 1 --2- 172.21.15.6:0/361863482 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae90070f30 0x7fae7c004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae95395640 1 -- 172.21.15.6:0/361863482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae7c003980 msgr2=0x7fae7c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:20.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae95395640 1 --2- 172.21.15.6:0/361863482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae7c003980 0x7fae7c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.231+0000 7fae95395640 1 -- 172.21.15.6:0/361863482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c003530 con 0x7fae7c0043b0 2023-07-21T22:34:20.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.235+0000 7fae95395640 1 --2- 172.21.15.6:0/361863482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae7c0043b0 0x7fae7c004870 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fae80009ae0 tx=0x7fae8001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d66306aea53c0b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:20.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.235+0000 7fae94b94640 1 -- 172.21.15.6:0/361863482 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae800a5640 con 0x7fae7c0043b0 2023-07-21T22:34:20.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.235+0000 7fae94b94640 1 -- 172.21.15.6:0/361863482 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae800a57a0 con 0x7fae7c0043b0 2023-07-21T22:34:20.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.235+0000 7fae94b94640 1 -- 172.21.15.6:0/361863482 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae800a5b50 con 0x7fae7c0043b0 2023-07-21T22:34:20.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.235+0000 7fae97dfa640 1 -- 172.21.15.6:0/361863482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae7c0043b0 msgr2=0x7fae7c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:20.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.235+0000 7fae97dfa640 1 --2- 172.21.15.6:0/361863482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae7c0043b0 0x7fae7c004870 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fae80009ae0 tx=0x7fae8001ca50 comp rx=0 tx=0).stop 2023-07-21T22:34:20.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.235+0000 7fae96397640 1 -- 172.21.15.6:0/361863482 reap_dead start 2023-07-21T22:34:20.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.235+0000 7fae97dfa640 1 -- 172.21.15.6:0/361863482 shutdown_connections 2023-07-21T22:34:20.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.235+0000 7fae97dfa640 1 -- 172.21.15.6:0/361863482 >> 172.21.15.6:0/361863482 conn(0x7fae900cde90 msgr2=0x7fae900ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:20.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.235+0000 7fae97dfa640 1 -- 172.21.15.6:0/361863482 shutdown_connections 2023-07-21T22:34:20.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.235+0000 7fae97dfa640 1 -- 172.21.15.6:0/361863482 wait complete. 2023-07-21T22:34:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.235+0000 7fae97dfa640 1 Processor -- start 2023-07-21T22:34:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.235+0000 7fae97dfa640 1 -- start start 2023-07-21T22:34:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae97dfa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae7c0043b0 0x7fae90155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae97dfa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae900c65b0 0x7fae900ac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae97dfa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae900c6a20 0x7fae900aced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae97dfa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae900b1150 con 0x7fae900c65b0 2023-07-21T22:34:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae97dfa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae90156040 con 0x7fae900c6a20 2023-07-21T22:34:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae97dfa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae900ab930 con 0x7fae7c0043b0 2023-07-21T22:34:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae95395640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae900c65b0 0x7fae900ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae95395640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae900c65b0 0x7fae900ac990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44558/0 (socket says 172.21.15.6:44558) 2023-07-21T22:34:20.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae95395640 1 -- 172.21.15.6:0/850437813 learned_addr learned my addr 172.21.15.6:0/850437813 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:20.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae96397640 1 --2- 172.21.15.6:0/850437813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae900c6a20 0x7fae900aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae95b96640 1 --2- 172.21.15.6:0/850437813 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae7c0043b0 0x7fae90155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae95395640 1 -- 172.21.15.6:0/850437813 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae7c0043b0 msgr2=0x7fae90155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae95395640 1 --2- 172.21.15.6:0/850437813 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae7c0043b0 0x7fae90155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae95395640 1 -- 172.21.15.6:0/850437813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae900c6a20 msgr2=0x7fae900aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae95395640 1 --2- 172.21.15.6:0/850437813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae900c6a20 0x7fae900aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae95395640 1 -- 172.21.15.6:0/850437813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae900abbd0 con 0x7fae900c65b0 2023-07-21T22:34:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae95395640 1 --2- 172.21.15.6:0/850437813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae900c65b0 0x7fae900ac990 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fae800b0040 tx=0x7fae7c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae867fc640 1 -- 172.21.15.6:0/850437813 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae80004220 con 0x7fae900c65b0 2023-07-21T22:34:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae867fc640 1 -- 172.21.15.6:0/850437813 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae800043a0 con 0x7fae900c65b0 2023-07-21T22:34:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae97dfa640 1 -- 172.21.15.6:0/850437813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae900b1150 con 0x7fae900c65b0 2023-07-21T22:34:20.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae867fc640 1 -- 172.21.15.6:0/850437813 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae80004510 con 0x7fae900c65b0 2023-07-21T22:34:20.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae97dfa640 1 -- 172.21.15.6:0/850437813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae900ac190 con 0x7fae900c65b0 2023-07-21T22:34:20.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae97dfa640 1 -- 172.21.15.6:0/850437813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae900678d0 con 0x7fae900c65b0 2023-07-21T22:34:20.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.239+0000 7fae867fc640 1 -- 172.21.15.6:0/850437813 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fae800b4040 con 0x7fae900c65b0 2023-07-21T22:34:20.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.243+0000 7fae867fc640 1 --2- 172.21.15.6:0/850437813 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fae740663a0 0x7fae74068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.243+0000 7fae867fc640 1 -- 172.21.15.6:0/850437813 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5254+0+0 (secure 0 0 0) 0x7fae8011e480 con 0x7fae900c65b0 2023-07-21T22:34:20.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.243+0000 7fae95b96640 1 --2- 172.21.15.6:0/850437813 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fae740663a0 0x7fae74068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.243+0000 7fae95b96640 1 --2- 172.21.15.6:0/850437813 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fae740663a0 0x7fae74068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fae900cd240 tx=0x7fae8c008040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:20.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.247+0000 7fae867fc640 1 -- 172.21.15.6:0/850437813 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fae800ebbb0 con 0x7fae900c65b0 2023-07-21T22:34:20.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.403+0000 7fae97dfa640 1 -- 172.21.15.6:0/850437813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae900aeb80 con 0x7fae900c65b0 2023-07-21T22:34:20.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.403+0000 7fae867fc640 1 -- 172.21.15.6:0/850437813 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7fae800ef1d0 con 0x7fae900c65b0 2023-07-21T22:34:20.452 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:34:20.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.403+0000 7fae97dfa640 1 -- 172.21.15.6:0/850437813 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fae740663a0 msgr2=0x7fae74068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:20.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.403+0000 7fae97dfa640 1 --2- 172.21.15.6:0/850437813 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fae740663a0 0x7fae74068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fae900cd240 tx=0x7fae8c008040 comp rx=0 tx=0).stop 2023-07-21T22:34:20.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.403+0000 7fae97dfa640 1 -- 172.21.15.6:0/850437813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae900c65b0 msgr2=0x7fae900ac990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:20.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.403+0000 7fae97dfa640 1 --2- 172.21.15.6:0/850437813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae900c65b0 0x7fae900ac990 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fae800b0040 tx=0x7fae7c005800 comp rx=0 tx=0).stop 2023-07-21T22:34:20.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.403+0000 7fae97dfa640 1 -- 172.21.15.6:0/850437813 shutdown_connections 2023-07-21T22:34:20.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.403+0000 7fae97dfa640 1 --2- 172.21.15.6:0/850437813 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fae740663a0 0x7fae74068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.403+0000 7fae97dfa640 1 --2- 172.21.15.6:0/850437813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae900c6a20 0x7fae900aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.403+0000 7fae97dfa640 1 --2- 172.21.15.6:0/850437813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae900c65b0 0x7fae900ac990 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.403+0000 7fae97dfa640 1 --2- 172.21.15.6:0/850437813 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae7c0043b0 0x7fae90155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.403+0000 7fae97dfa640 1 -- 172.21.15.6:0/850437813 >> 172.21.15.6:0/850437813 conn(0x7fae900cde90 msgr2=0x7fae9006f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:20.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.403+0000 7fae97dfa640 1 -- 172.21.15.6:0/850437813 shutdown_connections 2023-07-21T22:34:20.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.403+0000 7fae97dfa640 1 -- 172.21.15.6:0/850437813 wait complete. 2023-07-21T22:34:20.473 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:34:20.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.571+0000 7fb78b51e640 1 Processor -- start 2023-07-21T22:34:20.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.571+0000 7fb78b51e640 1 -- start start 2023-07-21T22:34:20.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.571+0000 7fb78b51e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb7840c3ac0 0x7fb7840c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.571+0000 7fb78b51e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7840cd120 0x7fb7840cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.571+0000 7fb78b51e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7840695b0 con 0x7fb7840af2b0 2023-07-21T22:34:20.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.571+0000 7fb78b51e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb784069890 con 0x7fb7840c3ac0 2023-07-21T22:34:20.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.571+0000 7fb78b51e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb784069b70 con 0x7fb7840cd120 2023-07-21T22:34:20.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.571+0000 7fb7892ba640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb7840c3ac0 0x7fb7840c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.571+0000 7fb788ab9640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb7840af2b0 0x7fb7840ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60592/0 (socket says 172.21.15.6:60592) 2023-07-21T22:34:20.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.571+0000 7fb788ab9640 1 -- 172.21.15.6:0/4162174889 learned_addr learned my addr 172.21.15.6:0/4162174889 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.571+0000 7fb789abb640 1 --2- 172.21.15.6:0/4162174889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7840cd120 0x7fb7840cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.571+0000 7fb7892ba640 1 -- 172.21.15.6:0/4162174889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7840cd120 msgr2=0x7fb7840cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.571+0000 7fb7892ba640 1 --2- 172.21.15.6:0/4162174889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7840cd120 0x7fb7840cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.571+0000 7fb7892ba640 1 -- 172.21.15.6:0/4162174889 >> v1:172.21.15.6:6789/0 conn(0x7fb7840af2b0 legacy=0x7fb7840ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.571+0000 7fb7892ba640 1 -- 172.21.15.6:0/4162174889 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb784069e50 con 0x7fb7840c3ac0 2023-07-21T22:34:20.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.571+0000 7fb77bfff640 1 -- 172.21.15.6:0/4162174889 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674026632 0 0) 0x7fb7840695b0 con 0x7fb7840af2b0 2023-07-21T22:34:20.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.575+0000 7fb7892ba640 1 --2- 172.21.15.6:0/4162174889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7840c3ac0 0x7fb7840c2d30 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb7800097c0 tx=0x7fb78001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c42f3956e00485b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:20.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.575+0000 7fb77bfff640 1 -- 172.21.15.6:0/4162174889 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7800ab610 con 0x7fb7840c3ac0 2023-07-21T22:34:20.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.575+0000 7fb77bfff640 1 -- 172.21.15.6:0/4162174889 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7800ab770 con 0x7fb7840c3ac0 2023-07-21T22:34:20.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.575+0000 7fb77bfff640 1 -- 172.21.15.6:0/4162174889 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7800abb00 con 0x7fb7840c3ac0 2023-07-21T22:34:20.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.575+0000 7fb78b51e640 1 -- 172.21.15.6:0/4162174889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7840c3ac0 msgr2=0x7fb7840c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:20.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.575+0000 7fb78b51e640 1 --2- 172.21.15.6:0/4162174889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7840c3ac0 0x7fb7840c2d30 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb7800097c0 tx=0x7fb78001c3f0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.575+0000 7fb78b51e640 1 -- 172.21.15.6:0/4162174889 shutdown_connections 2023-07-21T22:34:20.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.575+0000 7fb78b51e640 1 --2- 172.21.15.6:0/4162174889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7840cd120 0x7fb7840cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.575+0000 7fb78b51e640 1 --2- 172.21.15.6:0/4162174889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7840c3ac0 0x7fb7840c2d30 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.575+0000 7fb78b51e640 1 -- 172.21.15.6:0/4162174889 >> 172.21.15.6:0/4162174889 conn(0x7fb7840cde90 msgr2=0x7fb7840ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:20.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.575+0000 7fb78b51e640 1 -- 172.21.15.6:0/4162174889 shutdown_connections 2023-07-21T22:34:20.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.575+0000 7fb78b51e640 1 -- 172.21.15.6:0/4162174889 wait complete. 2023-07-21T22:34:20.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb78b51e640 1 Processor -- start 2023-07-21T22:34:20.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb78b51e640 1 -- start start 2023-07-21T22:34:20.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb78b51e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7840af2b0 0x7fb784147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb78b51e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7840c3ac0 0x7fb7840b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb78b51e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7840cd120 0x7fb7840c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb78b51e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7840b26a0 con 0x7fb7840cd120 2023-07-21T22:34:20.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb78b51e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7840b1780 con 0x7fb7840c3ac0 2023-07-21T22:34:20.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb78b51e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7840b1a20 con 0x7fb7840af2b0 2023-07-21T22:34:20.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb789abb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7840cd120 0x7fb7840c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb789abb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7840cd120 0x7fb7840c6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44572/0 (socket says 172.21.15.6:44572) 2023-07-21T22:34:20.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb789abb640 1 -- 172.21.15.6:0/531123211 learned_addr learned my addr 172.21.15.6:0/531123211 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:20.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb7892ba640 1 --2- 172.21.15.6:0/531123211 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7840af2b0 0x7fb784147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb788ab9640 1 --2- 172.21.15.6:0/531123211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7840c3ac0 0x7fb7840b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb789abb640 1 -- 172.21.15.6:0/531123211 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7840af2b0 msgr2=0x7fb784147130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:20.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb789abb640 1 --2- 172.21.15.6:0/531123211 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7840af2b0 0x7fb784147130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb789abb640 1 -- 172.21.15.6:0/531123211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7840c3ac0 msgr2=0x7fb7840b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:20.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb789abb640 1 --2- 172.21.15.6:0/531123211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7840c3ac0 0x7fb7840b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb789abb640 1 -- 172.21.15.6:0/531123211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb780009420 con 0x7fb7840cd120 2023-07-21T22:34:20.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb788ab9640 1 --2- 172.21.15.6:0/531123211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7840c3ac0 0x7fb7840b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:20.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb789abb640 1 --2- 172.21.15.6:0/531123211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7840cd120 0x7fb7840c6dd0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb77c007e60 tx=0x7fb77c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:20.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb779ffb640 1 -- 172.21.15.6:0/531123211 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c014420 con 0x7fb7840cd120 2023-07-21T22:34:20.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb779ffb640 1 -- 172.21.15.6:0/531123211 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77c0145a0 con 0x7fb7840cd120 2023-07-21T22:34:20.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb779ffb640 1 -- 172.21.15.6:0/531123211 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c014950 con 0x7fb7840cd120 2023-07-21T22:34:20.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb78b51e640 1 -- 172.21.15.6:0/531123211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7840b1d00 con 0x7fb7840cd120 2023-07-21T22:34:20.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb78b51e640 1 -- 172.21.15.6:0/531123211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7840b22c0 con 0x7fb7840cd120 2023-07-21T22:34:20.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.579+0000 7fb78b51e640 1 -- 172.21.15.6:0/531123211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7840678d0 con 0x7fb7840cd120 2023-07-21T22:34:20.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.583+0000 7fb779ffb640 1 -- 172.21.15.6:0/531123211 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb77c014ab0 con 0x7fb7840cd120 2023-07-21T22:34:20.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.583+0000 7fb779ffb640 1 --2- 172.21.15.6:0/531123211 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fb7680663d0 0x7fb768068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.583+0000 7fb779ffb640 1 -- 172.21.15.6:0/531123211 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5254+0+0 (secure 0 0 0) 0x7fb77c084550 con 0x7fb7840cd120 2023-07-21T22:34:20.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.583+0000 7fb7892ba640 1 --2- 172.21.15.6:0/531123211 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fb7680663d0 0x7fb768068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.583+0000 7fb7892ba640 1 --2- 172.21.15.6:0/531123211 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fb7680663d0 0x7fb768068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb7800af000 tx=0x7fb7800a7000 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:20.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.587+0000 7fb779ffb640 1 -- 172.21.15.6:0/531123211 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb77c051ab0 con 0x7fb7840cd120 2023-07-21T22:34:20.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.739+0000 7fb78b51e640 1 -- 172.21.15.6:0/531123211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb7840aeb80 con 0x7fb7840cd120 2023-07-21T22:34:20.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.739+0000 7fb779ffb640 1 -- 172.21.15.6:0/531123211 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v80) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb77c0550d0 con 0x7fb7840cd120 2023-07-21T22:34:20.791 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:34:20.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.743+0000 7fb78b51e640 1 -- 172.21.15.6:0/531123211 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fb7680663d0 msgr2=0x7fb768068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:20.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.743+0000 7fb78b51e640 1 --2- 172.21.15.6:0/531123211 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fb7680663d0 0x7fb768068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb7800af000 tx=0x7fb7800a7000 comp rx=0 tx=0).stop 2023-07-21T22:34:20.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.743+0000 7fb78b51e640 1 -- 172.21.15.6:0/531123211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7840cd120 msgr2=0x7fb7840c6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:20.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.743+0000 7fb78b51e640 1 --2- 172.21.15.6:0/531123211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7840cd120 0x7fb7840c6dd0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb77c007e60 tx=0x7fb77c00e4b0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.743+0000 7fb78b51e640 1 -- 172.21.15.6:0/531123211 shutdown_connections 2023-07-21T22:34:20.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.743+0000 7fb78b51e640 1 --2- 172.21.15.6:0/531123211 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fb7680663d0 0x7fb768068880 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.743+0000 7fb78b51e640 1 --2- 172.21.15.6:0/531123211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7840cd120 0x7fb7840c6dd0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.743+0000 7fb78b51e640 1 --2- 172.21.15.6:0/531123211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7840c3ac0 0x7fb7840b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.743+0000 7fb78b51e640 1 --2- 172.21.15.6:0/531123211 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7840af2b0 0x7fb784147130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.743+0000 7fb78b51e640 1 -- 172.21.15.6:0/531123211 >> 172.21.15.6:0/531123211 conn(0x7fb7840cde90 msgr2=0x7fb7840c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.743+0000 7fb78b51e640 1 -- 172.21.15.6:0/531123211 shutdown_connections 2023-07-21T22:34:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.743+0000 7fb78b51e640 1 -- 172.21.15.6:0/531123211 wait complete. 2023-07-21T22:34:20.812 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T22:34:20.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.907+0000 7ffa32940640 1 Processor -- start 2023-07-21T22:34:20.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.907+0000 7ffa32940640 1 -- start start 2023-07-21T22:34:20.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.907+0000 7ffa32940640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa2c15f500 0x7ffa2c06cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.907+0000 7ffa32940640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffa2c06d430 0x7ffa2c06a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.907+0000 7ffa32940640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ffa2c06aa80 0x7ffa2c0b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.907+0000 7ffa32940640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa2c06af20 con 0x7ffa2c06d430 2023-07-21T22:34:20.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.907+0000 7ffa32940640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa2c0cdc80 con 0x7ffa2c06aa80 2023-07-21T22:34:20.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.907+0000 7ffa32940640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c06e4c0 con 0x7ffa2c15f500 2023-07-21T22:34:20.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.907+0000 7ffa2b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffa2c06d430 0x7ffa2c06a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.907+0000 7ffa2b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ffa2c06d430 0x7ffa2c06a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44586/0 (socket says 172.21.15.6:44586) 2023-07-21T22:34:20.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.907+0000 7ffa2b7fe640 1 -- 172.21.15.6:0/265263458 learned_addr learned my addr 172.21.15.6:0/265263458 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:20.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.907+0000 7ffa2bfff640 1 --2- 172.21.15.6:0/265263458 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa2c15f500 0x7ffa2c06cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.907+0000 7ffa30edd640 1 --2- 172.21.15.6:0/265263458 >> v2:172.21.15.161:3300/0 conn(0x7ffa2c06aa80 0x7ffa2c0b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.907+0000 7ffa2b7fe640 1 -- 172.21.15.6:0/265263458 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa2c15f500 msgr2=0x7ffa2c06cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:20.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.907+0000 7ffa2b7fe640 1 --2- 172.21.15.6:0/265263458 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa2c15f500 0x7ffa2c06cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.907+0000 7ffa2b7fe640 1 -- 172.21.15.6:0/265263458 >> v2:172.21.15.161:3300/0 conn(0x7ffa2c06aa80 msgr2=0x7ffa2c0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:20.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.907+0000 7ffa2b7fe640 1 --2- 172.21.15.6:0/265263458 >> v2:172.21.15.161:3300/0 conn(0x7ffa2c06aa80 0x7ffa2c0b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.907+0000 7ffa2b7fe640 1 -- 172.21.15.6:0/265263458 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2c06d940 con 0x7ffa2c06d430 2023-07-21T22:34:20.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.907+0000 7ffa30edd640 1 --2- 172.21.15.6:0/265263458 >> v2:172.21.15.161:3300/0 conn(0x7ffa2c06aa80 0x7ffa2c0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:20.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.911+0000 7ffa2b7fe640 1 --2- 172.21.15.6:0/265263458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa2c06d430 0x7ffa2c06a540 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0713b0 tx=0x7ffa2001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96aaecf104e3666 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:20.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.911+0000 7ffa2affd640 1 -- 172.21.15.6:0/265263458 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa200ab600 con 0x7ffa2c06d430 2023-07-21T22:34:20.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.911+0000 7ffa2affd640 1 -- 172.21.15.6:0/265263458 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa200a7050 con 0x7ffa2c06d430 2023-07-21T22:34:20.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.911+0000 7ffa2affd640 1 -- 172.21.15.6:0/265263458 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa200ab980 con 0x7ffa2c06d430 2023-07-21T22:34:20.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.911+0000 7ffa32940640 1 -- 172.21.15.6:0/265263458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa2c06d430 msgr2=0x7ffa2c06a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:20.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.911+0000 7ffa32940640 1 --2- 172.21.15.6:0/265263458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa2c06d430 0x7ffa2c06a540 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c0713b0 tx=0x7ffa2001c240 comp rx=0 tx=0).stop 2023-07-21T22:34:20.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.911+0000 7ffa32940640 1 -- 172.21.15.6:0/265263458 shutdown_connections 2023-07-21T22:34:20.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.911+0000 7ffa32940640 1 --2- 172.21.15.6:0/265263458 >> v2:172.21.15.161:3300/0 conn(0x7ffa2c06aa80 0x7ffa2c0b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.911+0000 7ffa32940640 1 --2- 172.21.15.6:0/265263458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa2c06d430 0x7ffa2c06a540 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.911+0000 7ffa32940640 1 --2- 172.21.15.6:0/265263458 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa2c15f500 0x7ffa2c06cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.911+0000 7ffa32940640 1 -- 172.21.15.6:0/265263458 >> 172.21.15.6:0/265263458 conn(0x7ffa2c0659d0 msgr2=0x7ffa2c099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.911+0000 7ffa32940640 1 -- 172.21.15.6:0/265263458 shutdown_connections 2023-07-21T22:34:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.911+0000 7ffa32940640 1 -- 172.21.15.6:0/265263458 wait complete. 2023-07-21T22:34:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa32940640 1 Processor -- start 2023-07-21T22:34:20.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa32940640 1 -- start start 2023-07-21T22:34:20.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa32940640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa2c06aa80 0x7ffa2c14df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa32940640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa2c06d430 0x7ffa2c0ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa32940640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa2c15f500 0x7ffa2c0cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa32940640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c14e470 con 0x7ffa2c06aa80 2023-07-21T22:34:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa32940640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c14e8e0 con 0x7ffa2c15f500 2023-07-21T22:34:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa32940640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2c15a400 con 0x7ffa2c06d430 2023-07-21T22:34:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa2bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa2c06aa80 0x7ffa2c14df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa2bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa2c06aa80 0x7ffa2c14df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44596/0 (socket says 172.21.15.6:44596) 2023-07-21T22:34:20.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa2bfff640 1 -- 172.21.15.6:0/723702249 learned_addr learned my addr 172.21.15.6:0/723702249 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:20.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa30edd640 1 --2- 172.21.15.6:0/723702249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa2c15f500 0x7ffa2c0cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa2b7fe640 1 --2- 172.21.15.6:0/723702249 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa2c06d430 0x7ffa2c0ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa2bfff640 1 -- 172.21.15.6:0/723702249 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa2c06d430 msgr2=0x7ffa2c0ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:20.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa2bfff640 1 --2- 172.21.15.6:0/723702249 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa2c06d430 0x7ffa2c0ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa2bfff640 1 -- 172.21.15.6:0/723702249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa2c15f500 msgr2=0x7ffa2c0cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:20.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa2bfff640 1 --2- 172.21.15.6:0/723702249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa2c15f500 0x7ffa2c0cac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:20.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa2bfff640 1 -- 172.21.15.6:0/723702249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa200094d0 con 0x7ffa2c06aa80 2023-07-21T22:34:20.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa2bfff640 1 --2- 172.21.15.6:0/723702249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa2c06aa80 0x7ffa2c14df30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00d7d0 tx=0x7ffa1c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:20.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa28ff9640 1 -- 172.21.15.6:0/723702249 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c00b6c0 con 0x7ffa2c06aa80 2023-07-21T22:34:20.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa28ff9640 1 -- 172.21.15.6:0/723702249 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1c00b820 con 0x7ffa2c06aa80 2023-07-21T22:34:20.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa28ff9640 1 -- 172.21.15.6:0/723702249 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c00bbd0 con 0x7ffa2c06aa80 2023-07-21T22:34:20.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa32940640 1 -- 172.21.15.6:0/723702249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2c15a6e0 con 0x7ffa2c06aa80 2023-07-21T22:34:20.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa32940640 1 -- 172.21.15.6:0/723702249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2c0b3250 con 0x7ffa2c06aa80 2023-07-21T22:34:20.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.915+0000 7ffa32940640 1 -- 172.21.15.6:0/723702249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa2c0678d0 con 0x7ffa2c06aa80 2023-07-21T22:34:20.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.919+0000 7ffa28ff9640 1 -- 172.21.15.6:0/723702249 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ffa1c00bd30 con 0x7ffa2c06aa80 2023-07-21T22:34:20.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.919+0000 7ffa28ff9640 1 --2- 172.21.15.6:0/723702249 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ffa180663a0 0x7ffa18068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:20.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.919+0000 7ffa28ff9640 1 -- 172.21.15.6:0/723702249 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5254+0+0 (secure 0 0 0) 0x7ffa1c083fe0 con 0x7ffa2c06aa80 2023-07-21T22:34:20.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.919+0000 7ffa2b7fe640 1 --2- 172.21.15.6:0/723702249 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ffa180663a0 0x7ffa18068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:20.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.919+0000 7ffa2b7fe640 1 --2- 172.21.15.6:0/723702249 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ffa180663a0 0x7ffa18068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ffa200ad000 tx=0x7ffa20008040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:20.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:20.923+0000 7ffa28ff9640 1 -- 172.21.15.6:0/723702249 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffa1c055130 con 0x7ffa2c06aa80 2023-07-21T22:34:21.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.079+0000 7ffa32940640 1 -- 172.21.15.6:0/723702249 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ffa2c14eb30 con 0x7ffa2c06aa80 2023-07-21T22:34:21.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.079+0000 7ffa28ff9640 1 -- 172.21.15.6:0/723702249 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) v1 ==== 84+0+126 (secure 0 0 0) 0x7ffa1c054cc0 con 0x7ffa2c06aa80 2023-07-21T22:34:21.131 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:21.131 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:34:21.131 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:21.131 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-07-21T22:34:21.131 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-07-21T22:34:21.131 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:21.132 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:21.132 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-07-21T22:34:21.132 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-07-21T22:34:21.132 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:21.132 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:34:21.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.083+0000 7ffa32940640 1 -- 172.21.15.6:0/723702249 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ffa180663a0 msgr2=0x7ffa18068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:21.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.083+0000 7ffa32940640 1 --2- 172.21.15.6:0/723702249 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ffa180663a0 0x7ffa18068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ffa200ad000 tx=0x7ffa20008040 comp rx=0 tx=0).stop 2023-07-21T22:34:21.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.083+0000 7ffa32940640 1 -- 172.21.15.6:0/723702249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa2c06aa80 msgr2=0x7ffa2c14df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:21.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.083+0000 7ffa32940640 1 --2- 172.21.15.6:0/723702249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa2c06aa80 0x7ffa2c14df30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00d7d0 tx=0x7ffa1c00dc90 comp rx=0 tx=0).stop 2023-07-21T22:34:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.083+0000 7ffa32940640 1 -- 172.21.15.6:0/723702249 shutdown_connections 2023-07-21T22:34:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.083+0000 7ffa32940640 1 --2- 172.21.15.6:0/723702249 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ffa180663a0 0x7ffa18068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.083+0000 7ffa32940640 1 --2- 172.21.15.6:0/723702249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa2c15f500 0x7ffa2c0cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.083+0000 7ffa32940640 1 --2- 172.21.15.6:0/723702249 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffa2c06d430 0x7ffa2c0ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.083+0000 7ffa32940640 1 --2- 172.21.15.6:0/723702249 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa2c06aa80 0x7ffa2c14df30 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.083+0000 7ffa32940640 1 -- 172.21.15.6:0/723702249 >> 172.21.15.6:0/723702249 conn(0x7ffa2c0659d0 msgr2=0x7ffa2c157d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.083+0000 7ffa32940640 1 -- 172.21.15.6:0/723702249 shutdown_connections 2023-07-21T22:34:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.083+0000 7ffa32940640 1 -- 172.21.15.6:0/723702249 wait complete. 2023-07-21T22:34:21.152 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-21T22:34:21.152 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-21T22:34:21.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.251+0000 7fd276967640 1 Processor -- start 2023-07-21T22:34:21.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.251+0000 7fd276967640 1 -- start start 2023-07-21T22:34:21.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.251+0000 7fd276967640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd27015bde0 0x7fd2700d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:21.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.251+0000 7fd276967640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2700d2300 0x7fd2700d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:21.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.251+0000 7fd276967640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2700b04c0 con 0x7fd2700d2fc0 2023-07-21T22:34:21.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.251+0000 7fd276967640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27015c1b0 con 0x7fd2700d2300 2023-07-21T22:34:21.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.251+0000 7fd276967640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2700b1060 con 0x7fd27015bde0 2023-07-21T22:34:21.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.251+0000 7fd274f04640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2700d2300 0x7fd2700d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:21.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.255+0000 7fd274f04640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2700d2300 0x7fd2700d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44610/0 (socket says 172.21.15.6:44610) 2023-07-21T22:34:21.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.255+0000 7fd274f04640 1 -- 172.21.15.6:0/1902096473 learned_addr learned my addr 172.21.15.6:0/1902096473 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:21.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.255+0000 7fd26ffff640 1 --2- 172.21.15.6:0/1902096473 >> v2:172.21.15.161:3300/0 conn(0x7fd27015bde0 0x7fd2700d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:21.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.255+0000 7fd274f04640 1 -- 172.21.15.6:0/1902096473 >> v2:172.21.15.161:3300/0 conn(0x7fd27015bde0 msgr2=0x7fd2700d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:21.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.255+0000 7fd274f04640 1 --2- 172.21.15.6:0/1902096473 >> v2:172.21.15.161:3300/0 conn(0x7fd27015bde0 0x7fd2700d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:21.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.255+0000 7fd274f04640 1 -- 172.21.15.6:0/1902096473 >> v1:172.21.15.161:6789/0 conn(0x7fd2700d2fc0 legacy=0x7fd2700b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:21.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.255+0000 7fd274f04640 1 -- 172.21.15.6:0/1902096473 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2700d2c80 con 0x7fd2700d2300 2023-07-21T22:34:21.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.255+0000 7fd274f04640 1 --2- 172.21.15.6:0/1902096473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2700d2300 0x7fd2700d2740 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd27008b210 tx=0x7fd26801c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1f3709463397f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:21.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.255+0000 7fd26effd640 1 -- 172.21.15.6:0/1902096473 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2680a5760 con 0x7fd2700d2300 2023-07-21T22:34:21.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.255+0000 7fd26effd640 1 -- 172.21.15.6:0/1902096473 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2680a58c0 con 0x7fd2700d2300 2023-07-21T22:34:21.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.255+0000 7fd26effd640 1 -- 172.21.15.6:0/1902096473 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2680a5c50 con 0x7fd2700d2300 2023-07-21T22:34:21.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.259+0000 7fd276967640 1 -- 172.21.15.6:0/1902096473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2700d2300 msgr2=0x7fd2700d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:21.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.259+0000 7fd276967640 1 --2- 172.21.15.6:0/1902096473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2700d2300 0x7fd2700d2740 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fd27008b210 tx=0x7fd26801c990 comp rx=0 tx=0).stop 2023-07-21T22:34:21.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.259+0000 7fd276967640 1 -- 172.21.15.6:0/1902096473 shutdown_connections 2023-07-21T22:34:21.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.259+0000 7fd276967640 1 --2- 172.21.15.6:0/1902096473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2700d2300 0x7fd2700d2740 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:21.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.259+0000 7fd276967640 1 --2- 172.21.15.6:0/1902096473 >> v2:172.21.15.161:3300/0 conn(0x7fd27015bde0 0x7fd2700d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:21.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.259+0000 7fd276967640 1 -- 172.21.15.6:0/1902096473 >> 172.21.15.6:0/1902096473 conn(0x7fd2700659d0 msgr2=0x7fd27009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:21.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.259+0000 7fd276967640 1 -- 172.21.15.6:0/1902096473 shutdown_connections 2023-07-21T22:34:21.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.259+0000 7fd276967640 1 -- 172.21.15.6:0/1902096473 wait complete. 2023-07-21T22:34:21.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.259+0000 7fd276967640 1 Processor -- start 2023-07-21T22:34:21.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.259+0000 7fd276967640 1 -- start start 2023-07-21T22:34:21.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.259+0000 7fd276967640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2700d2300 0x7fd27015d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:21.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.259+0000 7fd276967640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2700d2fc0 0x7fd2700b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:21.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.259+0000 7fd276967640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd27015bde0 0x7fd2701f7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:21.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.259+0000 7fd276967640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27015eb70 con 0x7fd2700d2300 2023-07-21T22:34:21.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.259+0000 7fd276967640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27015df60 con 0x7fd27015bde0 2023-07-21T22:34:21.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.259+0000 7fd276967640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27015e240 con 0x7fd2700d2fc0 2023-07-21T22:34:21.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.259+0000 7fd26ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2700d2300 0x7fd27015d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:21.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.259+0000 7fd26ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2700d2300 0x7fd27015d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44624/0 (socket says 172.21.15.6:44624) 2023-07-21T22:34:21.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.259+0000 7fd26ffff640 1 -- 172.21.15.6:0/1704177287 learned_addr learned my addr 172.21.15.6:0/1704177287 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:21.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.259+0000 7fd26f7fe640 1 --2- 172.21.15.6:0/1704177287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2700d2fc0 0x7fd2700b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:21.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.263+0000 7fd274f04640 1 --2- 172.21.15.6:0/1704177287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd27015bde0 0x7fd2701f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:21.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.263+0000 7fd26ffff640 1 -- 172.21.15.6:0/1704177287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2700d2fc0 msgr2=0x7fd2700b7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.263+0000 7fd26ffff640 1 --2- 172.21.15.6:0/1704177287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2700d2fc0 0x7fd2700b7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.263+0000 7fd26ffff640 1 -- 172.21.15.6:0/1704177287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd27015bde0 msgr2=0x7fd2701f7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.263+0000 7fd26ffff640 1 --2- 172.21.15.6:0/1704177287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd27015bde0 0x7fd2701f7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.263+0000 7fd26ffff640 1 -- 172.21.15.6:0/1704177287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd268009b30 con 0x7fd2700d2300 2023-07-21T22:34:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.263+0000 7fd274f04640 1 --2- 172.21.15.6:0/1704177287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd27015bde0 0x7fd2701f7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.263+0000 7fd26ffff640 1 --2- 172.21.15.6:0/1704177287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2700d2300 0x7fd27015d610 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd26000d7d0 tx=0x7fd26000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:21.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.263+0000 7fd26cff9640 1 -- 172.21.15.6:0/1704177287 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26000b6c0 con 0x7fd2700d2300 2023-07-21T22:34:21.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.263+0000 7fd26cff9640 1 -- 172.21.15.6:0/1704177287 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26000b820 con 0x7fd2700d2300 2023-07-21T22:34:21.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.263+0000 7fd276967640 1 -- 172.21.15.6:0/1704177287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27015e520 con 0x7fd2700d2300 2023-07-21T22:34:21.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.263+0000 7fd26cff9640 1 -- 172.21.15.6:0/1704177287 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26000bbd0 con 0x7fd2700d2300 2023-07-21T22:34:21.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.263+0000 7fd276967640 1 -- 172.21.15.6:0/1704177287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27015db50 con 0x7fd2700d2300 2023-07-21T22:34:21.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.263+0000 7fd276967640 1 -- 172.21.15.6:0/1704177287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27015dd10 con 0x7fd2700d2300 2023-07-21T22:34:21.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.263+0000 7fd26cff9640 1 -- 172.21.15.6:0/1704177287 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd26000bd30 con 0x7fd2700d2300 2023-07-21T22:34:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.267+0000 7fd26cff9640 1 --2- 172.21.15.6:0/1704177287 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fd25c0663d0 0x7fd25c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.267+0000 7fd26cff9640 1 -- 172.21.15.6:0/1704177287 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5254+0+0 (secure 0 0 0) 0x7fd260083fe0 con 0x7fd2700d2300 2023-07-21T22:34:21.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.267+0000 7fd26f7fe640 1 --2- 172.21.15.6:0/1704177287 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fd25c0663d0 0x7fd25c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:21.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.267+0000 7fd26f7fe640 1 --2- 172.21.15.6:0/1704177287 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fd25c0663d0 0x7fd25c068880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd2701f7380 tx=0x7fd264007e40 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:21.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.271+0000 7fd26cff9640 1 -- 172.21.15.6:0/1704177287 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd2600550a0 con 0x7fd2700d2300 2023-07-21T22:34:21.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.427+0000 7fd276967640 1 -- 172.21.15.6:0/1704177287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd2700678d0 con 0x7fd2700d2300 2023-07-21T22:34:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.943+0000 7fd26cff9640 1 -- 172.21.15.6:0/1704177287 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v81) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd260054c30 con 0x7fd2700d2300 2023-07-21T22:34:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-07-21T22:34:21.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.943+0000 7fd276967640 1 -- 172.21.15.6:0/1704177287 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fd25c0663d0 msgr2=0x7fd25c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:21.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.943+0000 7fd276967640 1 --2- 172.21.15.6:0/1704177287 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fd25c0663d0 0x7fd25c068880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd2701f7380 tx=0x7fd264007e40 comp rx=0 tx=0).stop 2023-07-21T22:34:21.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.943+0000 7fd276967640 1 -- 172.21.15.6:0/1704177287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2700d2300 msgr2=0x7fd27015d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:21.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.943+0000 7fd276967640 1 --2- 172.21.15.6:0/1704177287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2700d2300 0x7fd27015d610 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd26000d7d0 tx=0x7fd26000dc90 comp rx=0 tx=0).stop 2023-07-21T22:34:21.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.943+0000 7fd276967640 1 -- 172.21.15.6:0/1704177287 shutdown_connections 2023-07-21T22:34:21.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.943+0000 7fd276967640 1 --2- 172.21.15.6:0/1704177287 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fd25c0663d0 0x7fd25c068880 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:21.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.943+0000 7fd276967640 1 --2- 172.21.15.6:0/1704177287 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd27015bde0 0x7fd2701f7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:21.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.943+0000 7fd276967640 1 --2- 172.21.15.6:0/1704177287 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2700d2fc0 0x7fd2700b7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:21.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.943+0000 7fd276967640 1 --2- 172.21.15.6:0/1704177287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2700d2300 0x7fd27015d610 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:21.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.943+0000 7fd276967640 1 -- 172.21.15.6:0/1704177287 >> 172.21.15.6:0/1704177287 conn(0x7fd2700659d0 msgr2=0x7fd27006afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:21.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.943+0000 7fd276967640 1 -- 172.21.15.6:0/1704177287 shutdown_connections 2023-07-21T22:34:21.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:21.943+0000 7fd276967640 1 -- 172.21.15.6:0/1704177287 wait complete. 2023-07-21T22:34:22.019 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T22:34:22.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.119+0000 7ff7c207b640 1 Processor -- start 2023-07-21T22:34:22.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.123+0000 7ff7c207b640 1 -- start start 2023-07-21T22:34:22.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.123+0000 7ff7c207b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff7bc15bec0 0x7ff7bc0cf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:22.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.123+0000 7ff7c207b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7bc0d29f0 0x7ff7bc0b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:22.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.123+0000 7ff7c207b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7bc0d0aa0 con 0x7ff7bc0d0250 2023-07-21T22:34:22.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.123+0000 7ff7c207b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7bc0d07c0 con 0x7ff7bc15bec0 2023-07-21T22:34:22.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.123+0000 7ff7c207b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc0b1dc0 con 0x7ff7bc0d29f0 2023-07-21T22:34:22.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.123+0000 7ff7bb7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff7bc15bec0 0x7ff7bc0cf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:22.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.123+0000 7ff7bb7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff7bc15bec0 0x7ff7bc0cf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:53774/0 (socket says 172.21.15.6:53774) 2023-07-21T22:34:22.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.123+0000 7ff7bb7fe640 1 -- 172.21.15.6:0/73951270 learned_addr learned my addr 172.21.15.6:0/73951270 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:22.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.123+0000 7ff7bbfff640 1 --2- 172.21.15.6:0/73951270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7bc0d29f0 0x7ff7bc0b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:22.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.123+0000 7ff7bb7fe640 1 -- 172.21.15.6:0/73951270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7bc0d29f0 msgr2=0x7ff7bc0b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:22.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.123+0000 7ff7bb7fe640 1 --2- 172.21.15.6:0/73951270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7bc0d29f0 0x7ff7bc0b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:22.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.123+0000 7ff7bb7fe640 1 -- 172.21.15.6:0/73951270 >> v1:172.21.15.161:6789/0 conn(0x7ff7bc0d0250 legacy=0x7ff7bc0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:22.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.123+0000 7ff7bb7fe640 1 -- 172.21.15.6:0/73951270 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc0b20a0 con 0x7ff7bc15bec0 2023-07-21T22:34:22.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.127+0000 7ff7bb7fe640 1 --2- 172.21.15.6:0/73951270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7bc15bec0 0x7ff7bc0cf610 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009870 tx=0x7ff7ac01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c637220a025e50b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:22.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.127+0000 7ff7ba7fc640 1 -- 172.21.15.6:0/73951270 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0aa610 con 0x7ff7bc15bec0 2023-07-21T22:34:22.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.127+0000 7ff7ba7fc640 1 -- 172.21.15.6:0/73951270 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ac0a6040 con 0x7ff7bc15bec0 2023-07-21T22:34:22.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.127+0000 7ff7ba7fc640 1 -- 172.21.15.6:0/73951270 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac0aa990 con 0x7ff7bc15bec0 2023-07-21T22:34:22.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.127+0000 7ff7c207b640 1 -- 172.21.15.6:0/73951270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7bc15bec0 msgr2=0x7ff7bc0cf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:22.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.127+0000 7ff7c207b640 1 --2- 172.21.15.6:0/73951270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7bc15bec0 0x7ff7bc0cf610 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009870 tx=0x7ff7ac01c510 comp rx=0 tx=0).stop 2023-07-21T22:34:22.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.127+0000 7ff7c207b640 1 -- 172.21.15.6:0/73951270 shutdown_connections 2023-07-21T22:34:22.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.127+0000 7ff7c207b640 1 --2- 172.21.15.6:0/73951270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7bc0d29f0 0x7ff7bc0b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:22.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.127+0000 7ff7c207b640 1 --2- 172.21.15.6:0/73951270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7bc15bec0 0x7ff7bc0cf610 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:22.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.127+0000 7ff7c207b640 1 -- 172.21.15.6:0/73951270 >> 172.21.15.6:0/73951270 conn(0x7ff7bc0659d0 msgr2=0x7ff7bc09b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:22.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.127+0000 7ff7c207b640 1 -- 172.21.15.6:0/73951270 shutdown_connections 2023-07-21T22:34:22.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.127+0000 7ff7c207b640 1 -- 172.21.15.6:0/73951270 wait complete. 2023-07-21T22:34:22.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.127+0000 7ff7c207b640 1 Processor -- start 2023-07-21T22:34:22.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7c207b640 1 -- start start 2023-07-21T22:34:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7c207b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7bc0d0250 0x7ff7bc06a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7c207b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7bc0d29f0 0x7ff7bc154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:22.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7c207b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7bc15bec0 0x7ff7bc0b7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:22.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7c207b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc0b6240 con 0x7ff7bc15bec0 2023-07-21T22:34:22.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7c207b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc154090 con 0x7ff7bc0d29f0 2023-07-21T22:34:22.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7c207b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc153780 con 0x7ff7bc0d0250 2023-07-21T22:34:22.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7bbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7bc15bec0 0x7ff7bc0b7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:22.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7baffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7bc0d29f0 0x7ff7bc154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:22.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7bb7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7bc0d0250 0x7ff7bc06a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:22.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7bbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7bc15bec0 0x7ff7bc0b7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44628/0 (socket says 172.21.15.6:44628) 2023-07-21T22:34:22.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7bbfff640 1 -- 172.21.15.6:0/1059459038 learned_addr learned my addr 172.21.15.6:0/1059459038 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:22.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7bbfff640 1 -- 172.21.15.6:0/1059459038 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7bc0d0250 msgr2=0x7ff7bc06a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:22.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7bbfff640 1 --2- 172.21.15.6:0/1059459038 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7bc0d0250 0x7ff7bc06a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:22.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7bbfff640 1 -- 172.21.15.6:0/1059459038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7bc0d29f0 msgr2=0x7ff7bc154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:22.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7bbfff640 1 --2- 172.21.15.6:0/1059459038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7bc0d29f0 0x7ff7bc154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:22.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7bbfff640 1 -- 172.21.15.6:0/1059459038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac0094d0 con 0x7ff7bc15bec0 2023-07-21T22:34:22.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7baffd640 1 --2- 172.21.15.6:0/1059459038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7bc0d29f0 0x7ff7bc154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:22.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7bbfff640 1 --2- 172.21.15.6:0/1059459038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7bc15bec0 0x7ff7bc0b7410 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400ef90 tx=0x7ff7b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:22.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7a3fff640 1 -- 172.21.15.6:0/1059459038 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b4009ca0 con 0x7ff7bc15bec0 2023-07-21T22:34:22.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7a3fff640 1 -- 172.21.15.6:0/1059459038 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b400f040 con 0x7ff7bc15bec0 2023-07-21T22:34:22.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7a3fff640 1 -- 172.21.15.6:0/1059459038 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40146c0 con 0x7ff7bc15bec0 2023-07-21T22:34:22.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7c207b640 1 -- 172.21.15.6:0/1059459038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc0b7ed0 con 0x7ff7bc15bec0 2023-07-21T22:34:22.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7c207b640 1 -- 172.21.15.6:0/1059459038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc153d20 con 0x7ff7bc15bec0 2023-07-21T22:34:22.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.131+0000 7ff7c207b640 1 -- 172.21.15.6:0/1059459038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7bc154220 con 0x7ff7bc15bec0 2023-07-21T22:34:22.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.135+0000 7ff7a3fff640 1 -- 172.21.15.6:0/1059459038 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff7b4014820 con 0x7ff7bc15bec0 2023-07-21T22:34:22.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.135+0000 7ff7a3fff640 1 --2- 172.21.15.6:0/1059459038 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ff7a80663a0 0x7ff7a8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:22.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.135+0000 7ff7a3fff640 1 -- 172.21.15.6:0/1059459038 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5624+0+0 (secure 0 0 0) 0x7ff7b4084bf0 con 0x7ff7bc15bec0 2023-07-21T22:34:22.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.135+0000 7ff7bb7fe640 1 --2- 172.21.15.6:0/1059459038 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ff7a80663a0 0x7ff7a8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:22.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.135+0000 7ff7bb7fe640 1 --2- 172.21.15.6:0/1059459038 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ff7a80663a0 0x7ff7a8068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0ae000 tx=0x7ff7ac0b5040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:22.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.139+0000 7ff7a3fff640 1 -- 172.21.15.6:0/1059459038 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff7b4052010 con 0x7ff7bc15bec0 2023-07-21T22:34:22.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.295+0000 7ff7c207b640 1 -- 172.21.15.6:0/1059459038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff7bc0678d0 con 0x7ff7bc15bec0 2023-07-21T22:34:23.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.951+0000 7ff7a3fff640 1 -- 172.21.15.6:0/1059459038 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v82) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff7b40180d0 con 0x7ff7bc15bec0 2023-07-21T22:34:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-07-21T22:34:23.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.963+0000 7ff7c207b640 1 -- 172.21.15.6:0/1059459038 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ff7a80663a0 msgr2=0x7ff7a8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:23.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.963+0000 7ff7c207b640 1 --2- 172.21.15.6:0/1059459038 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ff7a80663a0 0x7ff7a8068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0ae000 tx=0x7ff7ac0b5040 comp rx=0 tx=0).stop 2023-07-21T22:34:23.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.963+0000 7ff7c207b640 1 -- 172.21.15.6:0/1059459038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7bc15bec0 msgr2=0x7ff7bc0b7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:23.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.963+0000 7ff7c207b640 1 --2- 172.21.15.6:0/1059459038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7bc15bec0 0x7ff7bc0b7410 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400ef90 tx=0x7ff7b400c490 comp rx=0 tx=0).stop 2023-07-21T22:34:23.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.963+0000 7ff7c207b640 1 -- 172.21.15.6:0/1059459038 shutdown_connections 2023-07-21T22:34:23.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.963+0000 7ff7c207b640 1 --2- 172.21.15.6:0/1059459038 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ff7a80663a0 0x7ff7a8068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:23.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.963+0000 7ff7c207b640 1 --2- 172.21.15.6:0/1059459038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7bc15bec0 0x7ff7bc0b7410 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:23.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.963+0000 7ff7c207b640 1 --2- 172.21.15.6:0/1059459038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7bc0d29f0 0x7ff7bc154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:23.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.963+0000 7ff7c207b640 1 --2- 172.21.15.6:0/1059459038 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7bc0d0250 0x7ff7bc06a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:23.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.963+0000 7ff7c207b640 1 -- 172.21.15.6:0/1059459038 >> 172.21.15.6:0/1059459038 conn(0x7ff7bc0659d0 msgr2=0x7ff7bc0aefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.967+0000 7ff7c207b640 1 -- 172.21.15.6:0/1059459038 shutdown_connections 2023-07-21T22:34:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:22.967+0000 7ff7c207b640 1 -- 172.21.15.6:0/1059459038 wait complete. 2023-07-21T22:34:23.046 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-21T22:34:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.147+0000 7f85f4bd2640 1 Processor -- start 2023-07-21T22:34:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.147+0000 7f85f4bd2640 1 -- start start 2023-07-21T22:34:23.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.147+0000 7f85f4bd2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f01453a0 0x7f85f00b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:23.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.147+0000 7f85f4bd2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f006c040 con 0x7f85f006a440 2023-07-21T22:34:23.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.147+0000 7f85f4bd2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f0160600 con 0x7f85f015f690 2023-07-21T22:34:23.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.147+0000 7f85f4bd2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f0160170 con 0x7f85f01453a0 2023-07-21T22:34:23.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.147+0000 7f85edd9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f85f006a440 0x7f85f006c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60594/0 (socket says 172.21.15.6:60594) 2023-07-21T22:34:23.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.147+0000 7f85edd9b640 1 -- 172.21.15.6:0/1535585634 learned_addr learned my addr 172.21.15.6:0/1535585634 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:23.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.147+0000 7f85eed9d640 1 --2- 172.21.15.6:0/1535585634 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f01453a0 0x7f85f00b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:23.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.147+0000 7f85ed59a640 1 -- 172.21.15.6:0/1535585634 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820655734 0 0) 0x7f85f006c040 con 0x7f85f006a440 2023-07-21T22:34:23.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.147+0000 7f85ed59a640 1 -- 172.21.15.6:0/1535585634 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85d8003530 con 0x7f85f006a440 2023-07-21T22:34:23.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.147+0000 7f85ed59a640 1 -- 172.21.15.6:0/1535585634 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3480893782 0 0) 0x7f85f0160600 con 0x7f85f015f690 2023-07-21T22:34:23.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.147+0000 7f85ed59a640 1 -- 172.21.15.6:0/1535585634 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85f006c040 con 0x7f85f015f690 2023-07-21T22:34:23.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.147+0000 7f85eed9d640 1 -- 172.21.15.6:0/1535585634 >> v1:172.21.15.161:6789/0 conn(0x7f85f015f690 legacy=0x7f85f015fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:23.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.147+0000 7f85ed59a640 1 -- 172.21.15.6:0/1535585634 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1793923320 0 0) 0x7f85d8003530 con 0x7f85f006a440 2023-07-21T22:34:23.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.147+0000 7f85eed9d640 1 -- 172.21.15.6:0/1535585634 >> v1:172.21.15.6:6789/0 conn(0x7f85f006a440 legacy=0x7f85f006c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:23.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.147+0000 7f85eed9d640 1 -- 172.21.15.6:0/1535585634 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f0160360 con 0x7f85f01453a0 2023-07-21T22:34:23.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.151+0000 7f85eed9d640 1 --2- 172.21.15.6:0/1535585634 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f01453a0 0x7f85f00b1890 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f85e8009dc0 tx=0x7f85e801c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f65ee1afc4ee1bba server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:23.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.151+0000 7f85ed59a640 1 -- 172.21.15.6:0/1535585634 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e4001680 con 0x7f85f01453a0 2023-07-21T22:34:23.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.151+0000 7f85ed59a640 1 -- 172.21.15.6:0/1535585634 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e80a5610 con 0x7f85f01453a0 2023-07-21T22:34:23.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.151+0000 7f85ed59a640 1 -- 172.21.15.6:0/1535585634 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e80a5980 con 0x7f85f01453a0 2023-07-21T22:34:23.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.151+0000 7f85f4bd2640 1 -- 172.21.15.6:0/1535585634 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f01453a0 msgr2=0x7f85f00b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:23.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.151+0000 7f85f4bd2640 1 --2- 172.21.15.6:0/1535585634 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f01453a0 0x7f85f00b1890 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f85e8009dc0 tx=0x7f85e801c7d0 comp rx=0 tx=0).stop 2023-07-21T22:34:23.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.151+0000 7f85f4bd2640 1 -- 172.21.15.6:0/1535585634 shutdown_connections 2023-07-21T22:34:23.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.151+0000 7f85f4bd2640 1 --2- 172.21.15.6:0/1535585634 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f01453a0 0x7f85f00b1890 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:23.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.151+0000 7f85f4bd2640 1 -- 172.21.15.6:0/1535585634 >> 172.21.15.6:0/1535585634 conn(0x7f85f00b1210 msgr2=0x7f85f00ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:23.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.151+0000 7f85f4bd2640 1 -- 172.21.15.6:0/1535585634 shutdown_connections 2023-07-21T22:34:23.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.151+0000 7f85f4bd2640 1 -- 172.21.15.6:0/1535585634 wait complete. 2023-07-21T22:34:23.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85f4bd2640 1 Processor -- start 2023-07-21T22:34:23.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85f4bd2640 1 -- start start 2023-07-21T22:34:23.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85f4bd2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85f006a440 0x7f85f014a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:23.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85f4bd2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85f01453a0 0x7f85f01436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:23.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85f4bd2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f015f690 0x7f85f0141da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:23.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85f4bd2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f014a5f0 con 0x7f85f006a440 2023-07-21T22:34:23.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85f4bd2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f0140d00 con 0x7f85f01453a0 2023-07-21T22:34:23.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85f4bd2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f0140fe0 con 0x7f85f015f690 2023-07-21T22:34:23.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85ee59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85f006a440 0x7f85f014a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:23.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85ee59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85f006a440 0x7f85f014a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44642/0 (socket says 172.21.15.6:44642) 2023-07-21T22:34:23.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85ee59c640 1 -- 172.21.15.6:0/435944414 learned_addr learned my addr 172.21.15.6:0/435944414 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:23.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85edd9b640 1 --2- 172.21.15.6:0/435944414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85f01453a0 0x7f85f01436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:23.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85eed9d640 1 --2- 172.21.15.6:0/435944414 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f015f690 0x7f85f0141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:23.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85ee59c640 1 -- 172.21.15.6:0/435944414 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f015f690 msgr2=0x7f85f0141da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:23.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85ee59c640 1 --2- 172.21.15.6:0/435944414 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f015f690 0x7f85f0141da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:23.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85ee59c640 1 -- 172.21.15.6:0/435944414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85f01453a0 msgr2=0x7f85f01436d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:23.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85ee59c640 1 --2- 172.21.15.6:0/435944414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85f01453a0 0x7f85f01436d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:23.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85ee59c640 1 -- 172.21.15.6:0/435944414 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e8009a70 con 0x7f85f006a440 2023-07-21T22:34:23.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85ee59c640 1 --2- 172.21.15.6:0/435944414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85f006a440 0x7f85f014a0b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f85e000c500 tx=0x7f85e000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:23.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85deffd640 1 -- 172.21.15.6:0/435944414 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00052d0 con 0x7f85f006a440 2023-07-21T22:34:23.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85deffd640 1 -- 172.21.15.6:0/435944414 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e0005450 con 0x7f85f006a440 2023-07-21T22:34:23.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85deffd640 1 -- 172.21.15.6:0/435944414 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0012870 con 0x7f85f006a440 2023-07-21T22:34:23.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85f4bd2640 1 -- 172.21.15.6:0/435944414 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f01412c0 con 0x7f85f006a440 2023-07-21T22:34:23.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.155+0000 7f85f4bd2640 1 -- 172.21.15.6:0/435944414 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f0141880 con 0x7f85f006a440 2023-07-21T22:34:23.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.159+0000 7f85f4bd2640 1 -- 172.21.15.6:0/435944414 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f00678d0 con 0x7f85f006a440 2023-07-21T22:34:23.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.159+0000 7f85deffd640 1 -- 172.21.15.6:0/435944414 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f85e00129d0 con 0x7f85f006a440 2023-07-21T22:34:23.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.159+0000 7f85deffd640 1 --2- 172.21.15.6:0/435944414 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f85d00663a0 0x7f85d0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:23.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.159+0000 7f85deffd640 1 -- 172.21.15.6:0/435944414 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f85e0084480 con 0x7f85f006a440 2023-07-21T22:34:23.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.159+0000 7f85edd9b640 1 --2- 172.21.15.6:0/435944414 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f85d00663a0 0x7f85d0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:23.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.159+0000 7f85edd9b640 1 --2- 172.21.15.6:0/435944414 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f85d00663a0 0x7f85d0068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85f013fa90 tx=0x7f85e40019c0 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:23.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.163+0000 7f85deffd640 1 -- 172.21.15.6:0/435944414 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85e00518c0 con 0x7f85f006a440 2023-07-21T22:34:23.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.351+0000 7f85f4bd2640 1 -- 172.21.15.6:0/435944414 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f85f013c320 con 0x7f85f006a440 2023-07-21T22:34:24.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.979+0000 7f85deffd640 1 -- 172.21.15.6:0/435944414 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v28) v1 ==== 173+0+0 (secure 0 0 0) 0x7f85e0054ee0 con 0x7f85f006a440 2023-07-21T22:34:24.033 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 9 and data pool 10 2023-07-21T22:34:24.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.987+0000 7f85f4bd2640 1 -- 172.21.15.6:0/435944414 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f85d00663a0 msgr2=0x7f85d0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:24.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.987+0000 7f85f4bd2640 1 --2- 172.21.15.6:0/435944414 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f85d00663a0 0x7f85d0068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f85f013fa90 tx=0x7f85e40019c0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.987+0000 7f85f4bd2640 1 -- 172.21.15.6:0/435944414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85f006a440 msgr2=0x7f85f014a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:24.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.987+0000 7f85f4bd2640 1 --2- 172.21.15.6:0/435944414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85f006a440 0x7f85f014a0b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f85e000c500 tx=0x7f85e000c9c0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.991+0000 7f85f4bd2640 1 -- 172.21.15.6:0/435944414 shutdown_connections 2023-07-21T22:34:24.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.991+0000 7f85f4bd2640 1 --2- 172.21.15.6:0/435944414 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f85d00663a0 0x7f85d0068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.991+0000 7f85f4bd2640 1 --2- 172.21.15.6:0/435944414 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f85f015f690 0x7f85f0141da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.991+0000 7f85f4bd2640 1 --2- 172.21.15.6:0/435944414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f85f01453a0 0x7f85f01436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.991+0000 7f85f4bd2640 1 --2- 172.21.15.6:0/435944414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85f006a440 0x7f85f014a0b0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.991+0000 7f85f4bd2640 1 -- 172.21.15.6:0/435944414 >> 172.21.15.6:0/435944414 conn(0x7f85f00b1210 msgr2=0x7f85f0143fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:24.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.991+0000 7f85f4bd2640 1 -- 172.21.15.6:0/435944414 shutdown_connections 2023-07-21T22:34:24.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:23.991+0000 7f85f4bd2640 1 -- 172.21.15.6:0/435944414 wait complete. 2023-07-21T22:34:24.063 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:34:24.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.159+0000 7f0607e48640 1 Processor -- start 2023-07-21T22:34:24.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.159+0000 7f0607e48640 1 -- start start 2023-07-21T22:34:24.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.159+0000 7f0607e48640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f06000c9730 0x7f06001638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:24.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.159+0000 7f0607e48640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06000cc700 con 0x7f06000c8ad0 2023-07-21T22:34:24.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.159+0000 7f0607e48640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06000b0ff0 con 0x7f0600158ce0 2023-07-21T22:34:24.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.159+0000 7f0607e48640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0600070c80 con 0x7f06000c9730 2023-07-21T22:34:24.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.159+0000 7f06053e3640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f06000c8ad0 0x7f06000c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60602/0 (socket says 172.21.15.6:60602) 2023-07-21T22:34:24.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.159+0000 7f06053e3640 1 -- 172.21.15.6:0/2327710272 learned_addr learned my addr 172.21.15.6:0/2327710272 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.163+0000 7f06063e5640 1 --2- 172.21.15.6:0/2327710272 >> v2:172.21.15.161:3300/0 conn(0x7f06000c9730 0x7f06001638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.163+0000 7f0604be2640 1 -- 172.21.15.6:0/2327710272 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961820305 0 0) 0x7f06000cc700 con 0x7f06000c8ad0 2023-07-21T22:34:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.163+0000 7f0604be2640 1 -- 172.21.15.6:0/2327710272 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05ec003530 con 0x7f06000c8ad0 2023-07-21T22:34:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.163+0000 7f06063e5640 1 -- 172.21.15.6:0/2327710272 >> v1:172.21.15.161:6789/0 conn(0x7f0600158ce0 legacy=0x7f0600070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.163+0000 7f06063e5640 1 -- 172.21.15.6:0/2327710272 >> v1:172.21.15.6:6789/0 conn(0x7f06000c8ad0 legacy=0x7f06000c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.163+0000 7f06063e5640 1 -- 172.21.15.6:0/2327710272 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06000cbdd0 con 0x7f06000c9730 2023-07-21T22:34:24.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.163+0000 7f06063e5640 1 --2- 172.21.15.6:0/2327710272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06000c9730 0x7f06001638b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009d90 tx=0x7f05f801ea10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51b11dde3f7cd836 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:24.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.167+0000 7f0604be2640 1 -- 172.21.15.6:0/2327710272 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f80a78f0 con 0x7f06000c9730 2023-07-21T22:34:24.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.167+0000 7f0604be2640 1 -- 172.21.15.6:0/2327710272 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f80a7a50 con 0x7f06000c9730 2023-07-21T22:34:24.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.167+0000 7f0604be2640 1 -- 172.21.15.6:0/2327710272 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f80a7de0 con 0x7f06000c9730 2023-07-21T22:34:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.167+0000 7f0607e48640 1 -- 172.21.15.6:0/2327710272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06000c9730 msgr2=0x7f06001638b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.167+0000 7f0607e48640 1 --2- 172.21.15.6:0/2327710272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06000c9730 0x7f06001638b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009d90 tx=0x7f05f801ea10 comp rx=0 tx=0).stop 2023-07-21T22:34:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.167+0000 7f0607e48640 1 -- 172.21.15.6:0/2327710272 shutdown_connections 2023-07-21T22:34:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.167+0000 7f0607e48640 1 --2- 172.21.15.6:0/2327710272 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06000c9730 0x7f06001638b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.167+0000 7f0607e48640 1 -- 172.21.15.6:0/2327710272 >> 172.21.15.6:0/2327710272 conn(0x7f06000afcf0 msgr2=0x7f06000b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.167+0000 7f0607e48640 1 -- 172.21.15.6:0/2327710272 shutdown_connections 2023-07-21T22:34:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.167+0000 7f0607e48640 1 -- 172.21.15.6:0/2327710272 wait complete. 2023-07-21T22:34:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.167+0000 7f0607e48640 1 Processor -- start 2023-07-21T22:34:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.167+0000 7f0607e48640 1 -- start start 2023-07-21T22:34:24.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.167+0000 7f0607e48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06000c8ad0 0x7f06001f8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.167+0000 7f0607e48640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06000c9730 0x7f06001595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.167+0000 7f0607e48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0600158ce0 0x7f060014c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.167+0000 7f0607e48640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0600159c20 con 0x7f06000c8ad0 2023-07-21T22:34:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.167+0000 7f0607e48640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06000c7460 con 0x7f06000c9730 2023-07-21T22:34:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.167+0000 7f0607e48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0600159e70 con 0x7f0600158ce0 2023-07-21T22:34:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.167+0000 7f0605be4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06000c8ad0 0x7f06001f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.171+0000 7f0605be4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06000c8ad0 0x7f06001f8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44654/0 (socket says 172.21.15.6:44654) 2023-07-21T22:34:24.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.171+0000 7f0605be4640 1 -- 172.21.15.6:0/3162757915 learned_addr learned my addr 172.21.15.6:0/3162757915 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:24.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.171+0000 7f06053e3640 1 --2- 172.21.15.6:0/3162757915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06000c9730 0x7f06001595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:24.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.171+0000 7f06063e5640 1 --2- 172.21.15.6:0/3162757915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0600158ce0 0x7f060014c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:24.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.171+0000 7f0605be4640 1 -- 172.21.15.6:0/3162757915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0600158ce0 msgr2=0x7f060014c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:24.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.171+0000 7f0605be4640 1 --2- 172.21.15.6:0/3162757915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0600158ce0 0x7f060014c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.171+0000 7f0605be4640 1 -- 172.21.15.6:0/3162757915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06000c9730 msgr2=0x7f06001595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:24.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.171+0000 7f0605be4640 1 --2- 172.21.15.6:0/3162757915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06000c9730 0x7f06001595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.171+0000 7f0605be4640 1 -- 172.21.15.6:0/3162757915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f8009a70 con 0x7f06000c8ad0 2023-07-21T22:34:24.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.171+0000 7f0605be4640 1 --2- 172.21.15.6:0/3162757915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06000c8ad0 0x7f06001f8230 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00c3c0 tx=0x7f05fc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:24.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.171+0000 7f05f67fc640 1 -- 172.21.15.6:0/3162757915 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc0052d0 con 0x7f06000c8ad0 2023-07-21T22:34:24.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.171+0000 7f05f67fc640 1 -- 172.21.15.6:0/3162757915 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05fc005430 con 0x7f06000c8ad0 2023-07-21T22:34:24.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.171+0000 7f05f67fc640 1 -- 172.21.15.6:0/3162757915 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc003840 con 0x7f06000c8ad0 2023-07-21T22:34:24.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.171+0000 7f0607e48640 1 -- 172.21.15.6:0/3162757915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06000c7700 con 0x7f06000c8ad0 2023-07-21T22:34:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.171+0000 7f0607e48640 1 -- 172.21.15.6:0/3162757915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060014c9f0 con 0x7f06000c8ad0 2023-07-21T22:34:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.171+0000 7f0607e48640 1 -- 172.21.15.6:0/3162757915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06000ca1a0 con 0x7f06000c8ad0 2023-07-21T22:34:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.171+0000 7f05f67fc640 1 -- 172.21.15.6:0/3162757915 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f05fc0039a0 con 0x7f06000c8ad0 2023-07-21T22:34:24.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.171+0000 7f05f67fc640 1 --2- 172.21.15.6:0/3162757915 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f05e40663a0 0x7f05e4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:24.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.171+0000 7f05f67fc640 1 -- 172.21.15.6:0/3162757915 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f05fc0833f0 con 0x7f06000c8ad0 2023-07-21T22:34:24.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.175+0000 7f06053e3640 1 --2- 172.21.15.6:0/3162757915 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f05e40663a0 0x7f05e4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:24.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.175+0000 7f06053e3640 1 --2- 172.21.15.6:0/3162757915 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f05e40663a0 0x7f05e4068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f06000708d0 tx=0x7f05f0009040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:24.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.175+0000 7f05f67fc640 1 -- 172.21.15.6:0/3162757915 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05fc050720 con 0x7f06000c8ad0 2023-07-21T22:34:24.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.331+0000 7f0607e48640 1 -- 172.21.15.6:0/3162757915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06000678d0 con 0x7f06000c8ad0 2023-07-21T22:34:24.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.331+0000 7f05f67fc640 1 -- 172.21.15.6:0/3162757915 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+18304 (secure 0 0 0) 0x7f05fc053d40 con 0x7f06000c8ad0 2023-07-21T22:34:24.383 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:24.383 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":83,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:34:23.355372+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:34:21.475741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T22:34:22.347392+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:34:24.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.335+0000 7f0607e48640 1 -- 172.21.15.6:0/3162757915 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f05e40663a0 msgr2=0x7f05e4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:24.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.335+0000 7f0607e48640 1 --2- 172.21.15.6:0/3162757915 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f05e40663a0 0x7f05e4068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f06000708d0 tx=0x7f05f0009040 comp rx=0 tx=0).stop 2023-07-21T22:34:24.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.335+0000 7f0607e48640 1 -- 172.21.15.6:0/3162757915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06000c8ad0 msgr2=0x7f06001f8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:24.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.335+0000 7f0607e48640 1 --2- 172.21.15.6:0/3162757915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06000c8ad0 0x7f06001f8230 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00c3c0 tx=0x7f05fc00c880 comp rx=0 tx=0).stop 2023-07-21T22:34:24.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.335+0000 7f0607e48640 1 -- 172.21.15.6:0/3162757915 shutdown_connections 2023-07-21T22:34:24.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.335+0000 7f0607e48640 1 --2- 172.21.15.6:0/3162757915 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f05e40663a0 0x7f05e4068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.335+0000 7f0607e48640 1 --2- 172.21.15.6:0/3162757915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0600158ce0 0x7f060014c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.335+0000 7f0607e48640 1 --2- 172.21.15.6:0/3162757915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06000c9730 0x7f06001595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.335+0000 7f0607e48640 1 --2- 172.21.15.6:0/3162757915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06000c8ad0 0x7f06001f8230 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.335+0000 7f0607e48640 1 -- 172.21.15.6:0/3162757915 >> 172.21.15.6:0/3162757915 conn(0x7f06000afcf0 msgr2=0x7f06000cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.335+0000 7f0607e48640 1 -- 172.21.15.6:0/3162757915 shutdown_connections 2023-07-21T22:34:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.335+0000 7f0607e48640 1 -- 172.21.15.6:0/3162757915 wait complete. 2023-07-21T22:34:24.404 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:34:24.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b886a640 1 Processor -- start 2023-07-21T22:34:24.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b886a640 1 -- start start 2023-07-21T22:34:24.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b886a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f11b406a9c0 0x7f11b40ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:24.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b886a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b40cdc80 con 0x7f11b415f500 2023-07-21T22:34:24.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b886a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b406e4c0 con 0x7f11b406a540 2023-07-21T22:34:24.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b886a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b406d940 con 0x7f11b406a9c0 2023-07-21T22:34:24.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b259c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f11b415f500 0x7f11b406cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60618/0 (socket says 172.21.15.6:60618) 2023-07-21T22:34:24.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b259c640 1 -- 172.21.15.6:0/4283580096 learned_addr learned my addr 172.21.15.6:0/4283580096 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:24.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b2d9d640 1 --2- 172.21.15.6:0/4283580096 >> v2:172.21.15.161:3300/0 conn(0x7f11b406a9c0 0x7f11b40ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:24.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b1d9b640 1 -- 172.21.15.6:0/4283580096 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017743177 0 0) 0x7f11b40cdc80 con 0x7f11b415f500 2023-07-21T22:34:24.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b1d9b640 1 -- 172.21.15.6:0/4283580096 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11a0003530 con 0x7f11b415f500 2023-07-21T22:34:24.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b1d9b640 1 -- 172.21.15.6:0/4283580096 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1580449828 0 0) 0x7f11a0003530 con 0x7f11b415f500 2023-07-21T22:34:24.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b1d9b640 1 -- 172.21.15.6:0/4283580096 >> v2:172.21.15.161:3300/0 conn(0x7f11b406a9c0 msgr2=0x7f11b40ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:24.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b1d9b640 1 --2- 172.21.15.6:0/4283580096 >> v2:172.21.15.161:3300/0 conn(0x7f11b406a9c0 0x7f11b40ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b1d9b640 1 -- 172.21.15.6:0/4283580096 >> v1:172.21.15.161:6789/0 conn(0x7f11b406a540 legacy=0x7f11b40ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:24.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b1d9b640 1 -- 172.21.15.6:0/4283580096 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b406dc20 con 0x7f11b415f500 2023-07-21T22:34:24.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b1d9b640 1 -- 172.21.15.6:0/4283580096 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f11a4001800 con 0x7f11b415f500 2023-07-21T22:34:24.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b1d9b640 1 -- 172.21.15.6:0/4283580096 >> v1:172.21.15.6:6789/0 conn(0x7f11b415f500 legacy=0x7f11b406cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:24.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b1d9b640 1 --2- 172.21.15.6:0/4283580096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11a0003980 0x7f11a0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:24.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b1d9b640 1 --2- 172.21.15.6:0/4283580096 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11a00047d0 0x7f11a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:24.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b1d9b640 1 --2- 172.21.15.6:0/4283580096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11a0005180 0x7f11a000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:24.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b1d9b640 1 -- 172.21.15.6:0/4283580096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b406d940 con 0x7f11a0003980 2023-07-21T22:34:24.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b1d9b640 1 -- 172.21.15.6:0/4283580096 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a000c000 con 0x7f11a0005180 2023-07-21T22:34:24.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b1d9b640 1 -- 172.21.15.6:0/4283580096 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a000c1c0 con 0x7f11a00047d0 2023-07-21T22:34:24.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.499+0000 7f11b259c640 1 --2- 172.21.15.6:0/4283580096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11a0003980 0x7f11a0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:24.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.503+0000 7f11b2d9d640 1 --2- 172.21.15.6:0/4283580096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11a0005180 0x7f11a000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:24.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.503+0000 7f11abfff640 1 --2- 172.21.15.6:0/4283580096 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11a00047d0 0x7f11a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:24.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.503+0000 7f11b259c640 1 -- 172.21.15.6:0/4283580096 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11a00047d0 msgr2=0x7f11a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:24.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.503+0000 7f11b259c640 1 --2- 172.21.15.6:0/4283580096 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11a00047d0 0x7f11a0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.503+0000 7f11b259c640 1 -- 172.21.15.6:0/4283580096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11a0005180 msgr2=0x7f11a000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:24.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.503+0000 7f11b259c640 1 --2- 172.21.15.6:0/4283580096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11a0005180 0x7f11a000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.503+0000 7f11b259c640 1 -- 172.21.15.6:0/4283580096 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a0003530 con 0x7f11a0003980 2023-07-21T22:34:24.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.503+0000 7f11b2d9d640 1 -- 172.21.15.6:0/4283580096 reap_dead start 2023-07-21T22:34:24.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.503+0000 7f11b259c640 1 --2- 172.21.15.6:0/4283580096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11a0003980 0x7f11a0003d90 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f11a400c240 tx=0x7f11a401cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaffb502c78d56d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:24.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.503+0000 7f11b1d9b640 1 -- 172.21.15.6:0/4283580096 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4007270 con 0x7f11a0003980 2023-07-21T22:34:24.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.503+0000 7f11b1d9b640 1 -- 172.21.15.6:0/4283580096 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a40073f0 con 0x7f11a0003980 2023-07-21T22:34:24.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.503+0000 7f11b1d9b640 1 -- 172.21.15.6:0/4283580096 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a40057b0 con 0x7f11a0003980 2023-07-21T22:34:24.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.503+0000 7f11b886a640 1 -- 172.21.15.6:0/4283580096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11a0003980 msgr2=0x7f11a0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:24.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.503+0000 7f11b886a640 1 --2- 172.21.15.6:0/4283580096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11a0003980 0x7f11a0003d90 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f11a400c240 tx=0x7f11a401cba0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b886a640 1 -- 172.21.15.6:0/4283580096 shutdown_connections 2023-07-21T22:34:24.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b886a640 1 --2- 172.21.15.6:0/4283580096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11a0003980 0x7f11a0003d90 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b886a640 1 -- 172.21.15.6:0/4283580096 >> 172.21.15.6:0/4283580096 conn(0x7f11b40659d0 msgr2=0x7f11b4099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:24.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b886a640 1 -- 172.21.15.6:0/4283580096 shutdown_connections 2023-07-21T22:34:24.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b886a640 1 -- 172.21.15.6:0/4283580096 wait complete. 2023-07-21T22:34:24.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b886a640 1 Processor -- start 2023-07-21T22:34:24.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b886a640 1 -- start start 2023-07-21T22:34:24.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b886a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11a0003980 0x7f11b40acd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:24.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b886a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11b40b35d0 0x7f11b40ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:24.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b886a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11b4158ba0 0x7f11b40d0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:24.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b886a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b40b3a20 con 0x7f11b4158ba0 2023-07-21T22:34:24.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b886a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b40aea10 con 0x7f11a0003980 2023-07-21T22:34:24.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b886a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b40ad380 con 0x7f11b40b35d0 2023-07-21T22:34:24.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11b4158ba0 0x7f11b40d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:24.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11b4158ba0 0x7f11b40d0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44674/0 (socket says 172.21.15.6:44674) 2023-07-21T22:34:24.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b2d9d640 1 -- 172.21.15.6:0/1066496669 learned_addr learned my addr 172.21.15.6:0/1066496669 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:24.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b259c640 1 --2- 172.21.15.6:0/1066496669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11a0003980 0x7f11b40acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:24.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11abfff640 1 --2- 172.21.15.6:0/1066496669 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11b40b35d0 0x7f11b40ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:24.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b2d9d640 1 -- 172.21.15.6:0/1066496669 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11b40b35d0 msgr2=0x7f11b40ae4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:24.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b2d9d640 1 --2- 172.21.15.6:0/1066496669 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11b40b35d0 0x7f11b40ae4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b2d9d640 1 -- 172.21.15.6:0/1066496669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11a0003980 msgr2=0x7f11b40acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:24.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b2d9d640 1 --2- 172.21.15.6:0/1066496669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11a0003980 0x7f11b40acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b2d9d640 1 -- 172.21.15.6:0/1066496669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b40ad660 con 0x7f11b4158ba0 2023-07-21T22:34:24.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b259c640 1 --2- 172.21.15.6:0/1066496669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11a0003980 0x7f11b40acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:24.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.507+0000 7f11b2d9d640 1 --2- 172.21.15.6:0/1066496669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11b4158ba0 0x7f11b40d0140 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f11b406c4e0 tx=0x7f11ac011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:24.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.511+0000 7f11aaffd640 1 -- 172.21.15.6:0/1066496669 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac00e040 con 0x7f11b4158ba0 2023-07-21T22:34:24.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.511+0000 7f11aaffd640 1 -- 172.21.15.6:0/1066496669 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac00f040 con 0x7f11b4158ba0 2023-07-21T22:34:24.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.511+0000 7f11aaffd640 1 -- 172.21.15.6:0/1066496669 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac015a80 con 0x7f11b4158ba0 2023-07-21T22:34:24.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.511+0000 7f11b886a640 1 -- 172.21.15.6:0/1066496669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b40ad940 con 0x7f11b4158ba0 2023-07-21T22:34:24.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.511+0000 7f11b886a640 1 -- 172.21.15.6:0/1066496669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b40ca780 con 0x7f11b4158ba0 2023-07-21T22:34:24.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.511+0000 7f11b886a640 1 -- 172.21.15.6:0/1066496669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b40678d0 con 0x7f11b4158ba0 2023-07-21T22:34:24.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.511+0000 7f11aaffd640 1 -- 172.21.15.6:0/1066496669 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f11ac015be0 con 0x7f11b4158ba0 2023-07-21T22:34:24.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.511+0000 7f11aaffd640 1 --2- 172.21.15.6:0/1066496669 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f11940663d0 0x7f1194068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:24.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.511+0000 7f11aaffd640 1 -- 172.21.15.6:0/1066496669 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f11ac083fe0 con 0x7f11b4158ba0 2023-07-21T22:34:24.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.515+0000 7f11b259c640 1 --2- 172.21.15.6:0/1066496669 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f11940663d0 0x7f1194068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:24.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.515+0000 7f11b259c640 1 --2- 172.21.15.6:0/1066496669 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f11940663d0 0x7f1194068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f11a40ab000 tx=0x7f11a40a7070 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:24.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.519+0000 7f11aaffd640 1 -- 172.21.15.6:0/1066496669 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f11ac054c60 con 0x7f11b4158ba0 2023-07-21T22:34:24.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.675+0000 7f11b886a640 1 -- 172.21.15.6:0/1066496669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11b40ca2d0 con 0x7f11b4158ba0 2023-07-21T22:34:24.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.675+0000 7f11aaffd640 1 -- 172.21.15.6:0/1066496669 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+18304 (secure 0 0 0) 0x7f11ac0547f0 con 0x7f11b4158ba0 2023-07-21T22:34:24.725 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:24.725 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":83,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:34:23.355372+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:34:21.475741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T22:34:22.347392+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:34:24.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.675+0000 7f11b886a640 1 -- 172.21.15.6:0/1066496669 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f11940663d0 msgr2=0x7f1194068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:24.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.675+0000 7f11b886a640 1 --2- 172.21.15.6:0/1066496669 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f11940663d0 0x7f1194068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f11a40ab000 tx=0x7f11a40a7070 comp rx=0 tx=0).stop 2023-07-21T22:34:24.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.675+0000 7f11b886a640 1 -- 172.21.15.6:0/1066496669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11b4158ba0 msgr2=0x7f11b40d0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:24.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.675+0000 7f11b886a640 1 --2- 172.21.15.6:0/1066496669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11b4158ba0 0x7f11b40d0140 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f11b406c4e0 tx=0x7f11ac011cb0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.675+0000 7f11b886a640 1 -- 172.21.15.6:0/1066496669 shutdown_connections 2023-07-21T22:34:24.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.675+0000 7f11b886a640 1 --2- 172.21.15.6:0/1066496669 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f11940663d0 0x7f1194068880 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.675+0000 7f11b886a640 1 --2- 172.21.15.6:0/1066496669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11b4158ba0 0x7f11b40d0140 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.675+0000 7f11b886a640 1 --2- 172.21.15.6:0/1066496669 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11b40b35d0 0x7f11b40ae4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.675+0000 7f11b886a640 1 --2- 172.21.15.6:0/1066496669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11a0003980 0x7f11b40acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.675+0000 7f11b886a640 1 -- 172.21.15.6:0/1066496669 >> 172.21.15.6:0/1066496669 conn(0x7f11b40659d0 msgr2=0x7f11b40b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:24.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.675+0000 7f11b886a640 1 -- 172.21.15.6:0/1066496669 shutdown_connections 2023-07-21T22:34:24.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.675+0000 7f11b886a640 1 -- 172.21.15.6:0/1066496669 wait complete. 2023-07-21T22:34:24.746 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-21T22:34:24.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.843+0000 7f84cca6d640 1 Processor -- start 2023-07-21T22:34:24.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.843+0000 7f84cca6d640 1 -- start start 2023-07-21T22:34:24.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.843+0000 7f84cca6d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f84c8069430 0x7f84c8069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:24.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.847+0000 7f84cca6d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84c8070f30 0x7f84c80ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:24.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.847+0000 7f84cca6d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c8159d70 con 0x7f84c80af2b0 2023-07-21T22:34:24.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.847+0000 7f84cca6d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c8069d40 con 0x7f84c8069430 2023-07-21T22:34:24.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.847+0000 7f84cca6d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c80c9c60 con 0x7f84c8070f30 2023-07-21T22:34:24.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.847+0000 7f84c659c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f84c8069430 0x7f84c8069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:24.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.847+0000 7f84c6d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f84c80af2b0 0x7f84c815a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60624/0 (socket says 172.21.15.6:60624) 2023-07-21T22:34:24.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.847+0000 7f84c6d9d640 1 -- 172.21.15.6:0/3322280916 learned_addr learned my addr 172.21.15.6:0/3322280916 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:24.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.847+0000 7f84bffff640 1 --2- 172.21.15.6:0/3322280916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84c8070f30 0x7f84c80ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:24.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.847+0000 7f84c5d9b640 1 -- 172.21.15.6:0/3322280916 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270585856 0 0) 0x7f84c00014a0 con 0x7f84c80af2b0 2023-07-21T22:34:24.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.847+0000 7f84c5d9b640 1 -- 172.21.15.6:0/3322280916 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84b4003530 con 0x7f84c80af2b0 2023-07-21T22:34:24.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.847+0000 7f84c659c640 1 -- 172.21.15.6:0/3322280916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84c8070f30 msgr2=0x7f84c80ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:24.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.847+0000 7f84c659c640 1 --2- 172.21.15.6:0/3322280916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84c8070f30 0x7f84c80ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.847+0000 7f84c659c640 1 -- 172.21.15.6:0/3322280916 >> v1:172.21.15.6:6789/0 conn(0x7f84c80af2b0 legacy=0x7f84c815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:24.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.847+0000 7f84c659c640 1 -- 172.21.15.6:0/3322280916 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c80c9f40 con 0x7f84c8069430 2023-07-21T22:34:24.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.847+0000 7f84bffff640 1 --2- 172.21.15.6:0/3322280916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84c8070f30 0x7f84c80ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:24.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.847+0000 7f84c659c640 1 --2- 172.21.15.6:0/3322280916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84c8069430 0x7f84c8069800 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f84b80097c0 tx=0x7f84b801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873db1a929c12c1e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:24.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84c5d9b640 1 -- 172.21.15.6:0/3322280916 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b80ad640 con 0x7f84c8069430 2023-07-21T22:34:24.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84c5d9b640 1 -- 172.21.15.6:0/3322280916 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b80ad7a0 con 0x7f84c8069430 2023-07-21T22:34:24.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84c5d9b640 1 -- 172.21.15.6:0/3322280916 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b80adb10 con 0x7f84c8069430 2023-07-21T22:34:24.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84cca6d640 1 -- 172.21.15.6:0/3322280916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84c8069430 msgr2=0x7f84c8069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:24.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84cca6d640 1 --2- 172.21.15.6:0/3322280916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84c8069430 0x7f84c8069800 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f84b80097c0 tx=0x7f84b801c480 comp rx=0 tx=0).stop 2023-07-21T22:34:24.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84cca6d640 1 -- 172.21.15.6:0/3322280916 shutdown_connections 2023-07-21T22:34:24.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84cca6d640 1 --2- 172.21.15.6:0/3322280916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84c8070f30 0x7f84c80ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84cca6d640 1 --2- 172.21.15.6:0/3322280916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84c8069430 0x7f84c8069800 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84cca6d640 1 -- 172.21.15.6:0/3322280916 >> 172.21.15.6:0/3322280916 conn(0x7f84c80cde90 msgr2=0x7f84c80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:24.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84cca6d640 1 -- 172.21.15.6:0/3322280916 shutdown_connections 2023-07-21T22:34:24.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84cca6d640 1 -- 172.21.15.6:0/3322280916 wait complete. 2023-07-21T22:34:24.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84cca6d640 1 Processor -- start 2023-07-21T22:34:24.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84cca6d640 1 -- start start 2023-07-21T22:34:24.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84cca6d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84c8069430 0x7f84c80c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:24.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84cca6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84c8070f30 0x7f84c80c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:24.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84cca6d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84c80af2b0 0x7f84c814d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:24.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84cca6d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c80b0fa0 con 0x7f84c8070f30 2023-07-21T22:34:24.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84cca6d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c80c3f20 con 0x7f84c80af2b0 2023-07-21T22:34:24.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84cca6d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c814ddb0 con 0x7f84c8069430 2023-07-21T22:34:24.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84bffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84c8070f30 0x7f84c80c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:24.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84bffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84c8070f30 0x7f84c80c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44696/0 (socket says 172.21.15.6:44696) 2023-07-21T22:34:24.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.851+0000 7f84bffff640 1 -- 172.21.15.6:0/860146446 learned_addr learned my addr 172.21.15.6:0/860146446 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:24.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.855+0000 7f84c659c640 1 --2- 172.21.15.6:0/860146446 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84c8069430 0x7f84c80c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:24.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.855+0000 7f84c6d9d640 1 --2- 172.21.15.6:0/860146446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84c80af2b0 0x7f84c814d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:24.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.855+0000 7f84bffff640 1 -- 172.21.15.6:0/860146446 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84c8069430 msgr2=0x7f84c80c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:24.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.855+0000 7f84bffff640 1 --2- 172.21.15.6:0/860146446 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84c8069430 0x7f84c80c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.855+0000 7f84bffff640 1 -- 172.21.15.6:0/860146446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84c80af2b0 msgr2=0x7f84c814d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:24.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.855+0000 7f84bffff640 1 --2- 172.21.15.6:0/860146446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84c80af2b0 0x7f84c814d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:24.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.855+0000 7f84bffff640 1 -- 172.21.15.6:0/860146446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b8009420 con 0x7f84c8070f30 2023-07-21T22:34:24.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.855+0000 7f84c6d9d640 1 --2- 172.21.15.6:0/860146446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84c80af2b0 0x7f84c814d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:24.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.855+0000 7f84bffff640 1 --2- 172.21.15.6:0/860146446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84c8070f30 0x7f84c80c39e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f84b000e840 tx=0x7f84b000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:24.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.855+0000 7f84beffd640 1 -- 172.21.15.6:0/860146446 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b000c8d0 con 0x7f84c8070f30 2023-07-21T22:34:24.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.855+0000 7f84beffd640 1 -- 172.21.15.6:0/860146446 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b000ca30 con 0x7f84c8070f30 2023-07-21T22:34:24.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.855+0000 7f84beffd640 1 -- 172.21.15.6:0/860146446 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b000cde0 con 0x7f84c8070f30 2023-07-21T22:34:24.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.855+0000 7f84cca6d640 1 -- 172.21.15.6:0/860146446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c80c6070 con 0x7f84c8070f30 2023-07-21T22:34:24.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.855+0000 7f84cca6d640 1 -- 172.21.15.6:0/860146446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c80c6630 con 0x7f84c8070f30 2023-07-21T22:34:24.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.855+0000 7f84cca6d640 1 -- 172.21.15.6:0/860146446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c80678d0 con 0x7f84c8070f30 2023-07-21T22:34:24.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.855+0000 7f84beffd640 1 -- 172.21.15.6:0/860146446 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f84b0013410 con 0x7f84c8070f30 2023-07-21T22:34:24.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.859+0000 7f84beffd640 1 --2- 172.21.15.6:0/860146446 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f84a80663a0 0x7f84a8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:24.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.859+0000 7f84beffd640 1 -- 172.21.15.6:0/860146446 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f84b0083df0 con 0x7f84c8070f30 2023-07-21T22:34:24.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.859+0000 7f84c659c640 1 --2- 172.21.15.6:0/860146446 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f84a80663a0 0x7f84a8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:24.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.859+0000 7f84c659c640 1 --2- 172.21.15.6:0/860146446 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f84a80663a0 0x7f84a8068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f84b80af000 tx=0x7f84b80a7070 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:24.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:24.863+0000 7f84beffd640 1 -- 172.21.15.6:0/860146446 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f84b0051010 con 0x7f84c8070f30 2023-07-21T22:34:25.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:25.051+0000 7f84cca6d640 1 -- 172.21.15.6:0/860146446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f84c80aeb80 con 0x7f84c8070f30 2023-07-21T22:34:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:25.991+0000 7f84beffd640 1 -- 172.21.15.6:0/860146446 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7f84b0054630 con 0x7f84c8070f30 2023-07-21T22:34:26.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:25.991+0000 7f84cca6d640 1 -- 172.21.15.6:0/860146446 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f84a80663a0 msgr2=0x7f84a8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:26.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:25.991+0000 7f84cca6d640 1 --2- 172.21.15.6:0/860146446 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f84a80663a0 0x7f84a8068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f84b80af000 tx=0x7f84b80a7070 comp rx=0 tx=0).stop 2023-07-21T22:34:26.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:25.991+0000 7f84cca6d640 1 -- 172.21.15.6:0/860146446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84c8070f30 msgr2=0x7f84c80c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:26.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:25.991+0000 7f84cca6d640 1 --2- 172.21.15.6:0/860146446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84c8070f30 0x7f84c80c39e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f84b000e840 tx=0x7f84b000ed00 comp rx=0 tx=0).stop 2023-07-21T22:34:26.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:25.995+0000 7f84cca6d640 1 -- 172.21.15.6:0/860146446 shutdown_connections 2023-07-21T22:34:26.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:25.995+0000 7f84cca6d640 1 --2- 172.21.15.6:0/860146446 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f84a80663a0 0x7f84a8068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:26.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:25.995+0000 7f84cca6d640 1 --2- 172.21.15.6:0/860146446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f84c80af2b0 0x7f84c814d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:26.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:25.995+0000 7f84cca6d640 1 --2- 172.21.15.6:0/860146446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84c8070f30 0x7f84c80c39e0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:26.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:25.995+0000 7f84cca6d640 1 --2- 172.21.15.6:0/860146446 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f84c8069430 0x7f84c80c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:26.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:25.995+0000 7f84cca6d640 1 -- 172.21.15.6:0/860146446 >> 172.21.15.6:0/860146446 conn(0x7f84c80cde90 msgr2=0x7f84c8151a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:26.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:25.995+0000 7f84cca6d640 1 -- 172.21.15.6:0/860146446 shutdown_connections 2023-07-21T22:34:26.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:25.995+0000 7f84cca6d640 1 -- 172.21.15.6:0/860146446 wait complete. 2023-07-21T22:34:26.066 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-21T22:34:26.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-21T22:34:26.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.167+0000 7f982da18640 1 Processor -- start 2023-07-21T22:34:26.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.171+0000 7f982da18640 1 -- start start 2023-07-21T22:34:26.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.171+0000 7f982da18640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f982815cef0 0x7f9828158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:26.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.171+0000 7f982da18640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9828159270 0x7f98280c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:26.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.171+0000 7f982da18640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98281532b0 con 0x7f98280aeb40 2023-07-21T22:34:26.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.171+0000 7f982da18640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982815d360 con 0x7f982815cef0 2023-07-21T22:34:26.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.171+0000 7f982da18640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98280ca6f0 con 0x7f9828159270 2023-07-21T22:34:26.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.171+0000 7f981ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f982815cef0 0x7f9828158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:26.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.171+0000 7f9826ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f98280aeb40 0x7f98280aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60636/0 (socket says 172.21.15.6:60636) 2023-07-21T22:34:26.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.171+0000 7f9826ffd640 1 -- 172.21.15.6:0/2538110753 learned_addr learned my addr 172.21.15.6:0/2538110753 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:26.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.171+0000 7f98277fe640 1 --2- 172.21.15.6:0/2538110753 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9828159270 0x7f98280c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:26.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.171+0000 7f981ffff640 1 -- 172.21.15.6:0/2538110753 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9828159270 msgr2=0x7f98280c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:26.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.171+0000 7f981ffff640 1 --2- 172.21.15.6:0/2538110753 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9828159270 0x7f98280c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:26.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.171+0000 7f981ffff640 1 -- 172.21.15.6:0/2538110753 >> v1:172.21.15.6:6789/0 conn(0x7f98280aeb40 legacy=0x7f98280aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:26.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.171+0000 7f981ffff640 1 -- 172.21.15.6:0/2538110753 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98281599d0 con 0x7f982815cef0 2023-07-21T22:34:26.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.171+0000 7f98277fe640 1 --2- 172.21.15.6:0/2538110753 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9828159270 0x7f98280c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:26.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.175+0000 7f981ffff640 1 --2- 172.21.15.6:0/2538110753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982815cef0 0x7f9828158d30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f98100097c0 tx=0x7f981001e660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8c57cda781e496 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:26.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.175+0000 7f98267fc640 1 -- 172.21.15.6:0/2538110753 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98100a8630 con 0x7f982815cef0 2023-07-21T22:34:26.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.175+0000 7f98267fc640 1 -- 172.21.15.6:0/2538110753 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98100a8790 con 0x7f982815cef0 2023-07-21T22:34:26.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.175+0000 7f98267fc640 1 -- 172.21.15.6:0/2538110753 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98100a8b20 con 0x7f982815cef0 2023-07-21T22:34:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.175+0000 7f982da18640 1 -- 172.21.15.6:0/2538110753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982815cef0 msgr2=0x7f9828158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.175+0000 7f982da18640 1 --2- 172.21.15.6:0/2538110753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982815cef0 0x7f9828158d30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f98100097c0 tx=0x7f981001e660 comp rx=0 tx=0).stop 2023-07-21T22:34:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.175+0000 7f982da18640 1 -- 172.21.15.6:0/2538110753 shutdown_connections 2023-07-21T22:34:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.175+0000 7f982da18640 1 --2- 172.21.15.6:0/2538110753 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9828159270 0x7f98280c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.175+0000 7f982da18640 1 --2- 172.21.15.6:0/2538110753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982815cef0 0x7f9828158d30 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:26.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.175+0000 7f982da18640 1 -- 172.21.15.6:0/2538110753 >> 172.21.15.6:0/2538110753 conn(0x7f98280cde90 msgr2=0x7f98280ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:26.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.175+0000 7f982da18640 1 -- 172.21.15.6:0/2538110753 shutdown_connections 2023-07-21T22:34:26.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.175+0000 7f982da18640 1 -- 172.21.15.6:0/2538110753 wait complete. 2023-07-21T22:34:26.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.175+0000 7f982da18640 1 Processor -- start 2023-07-21T22:34:26.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.175+0000 7f982da18640 1 -- start start 2023-07-21T22:34:26.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f982da18640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98280aeb40 0x7f982806b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:26.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f982da18640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9828159270 0x7f9828162c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:26.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f982da18640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982815cef0 0x7f98280700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:26.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f982da18640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98280b0e60 con 0x7f982815cef0 2023-07-21T22:34:26.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f982da18640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98280b1140 con 0x7f98280aeb40 2023-07-21T22:34:26.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f982da18640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98280b1420 con 0x7f9828159270 2023-07-21T22:34:26.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f98277fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982815cef0 0x7f98280700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:26.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f98277fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982815cef0 0x7f98280700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44716/0 (socket says 172.21.15.6:44716) 2023-07-21T22:34:26.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f98277fe640 1 -- 172.21.15.6:0/1618368309 learned_addr learned my addr 172.21.15.6:0/1618368309 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:26.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f981ffff640 1 --2- 172.21.15.6:0/1618368309 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9828159270 0x7f9828162c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:26.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f9826ffd640 1 --2- 172.21.15.6:0/1618368309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98280aeb40 0x7f982806b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f98277fe640 1 -- 172.21.15.6:0/1618368309 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9828159270 msgr2=0x7f9828162c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f98277fe640 1 --2- 172.21.15.6:0/1618368309 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9828159270 0x7f9828162c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f98277fe640 1 -- 172.21.15.6:0/1618368309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98280aeb40 msgr2=0x7f982806b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f98277fe640 1 --2- 172.21.15.6:0/1618368309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98280aeb40 0x7f982806b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f98277fe640 1 -- 172.21.15.6:0/1618368309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9810009420 con 0x7f982815cef0 2023-07-21T22:34:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f981ffff640 1 --2- 172.21.15.6:0/1618368309 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9828159270 0x7f9828162c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f9826ffd640 1 --2- 172.21.15.6:0/1618368309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98280aeb40 0x7f982806b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:26.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f98277fe640 1 --2- 172.21.15.6:0/1618368309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982815cef0 0x7f98280700b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9820009fa0 tx=0x7f982000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:26.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f9824ff9640 1 -- 172.21.15.6:0/1618368309 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820003ba0 con 0x7f982815cef0 2023-07-21T22:34:26.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f9824ff9640 1 -- 172.21.15.6:0/1618368309 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982000f040 con 0x7f982815cef0 2023-07-21T22:34:26.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f982da18640 1 -- 172.21.15.6:0/1618368309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98281632d0 con 0x7f982815cef0 2023-07-21T22:34:26.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f9824ff9640 1 -- 172.21.15.6:0/1618368309 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820004030 con 0x7f982815cef0 2023-07-21T22:34:26.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f982da18640 1 -- 172.21.15.6:0/1618368309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98280707c0 con 0x7f982815cef0 2023-07-21T22:34:26.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.179+0000 7f982da18640 1 -- 172.21.15.6:0/1618368309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98280678d0 con 0x7f982815cef0 2023-07-21T22:34:26.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.183+0000 7f9824ff9640 1 -- 172.21.15.6:0/1618368309 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9820004190 con 0x7f982815cef0 2023-07-21T22:34:26.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.183+0000 7f9824ff9640 1 --2- 172.21.15.6:0/1618368309 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f98080663a0 0x7f9808068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:26.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.183+0000 7f9824ff9640 1 -- 172.21.15.6:0/1618368309 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f9820084370 con 0x7f982815cef0 2023-07-21T22:34:26.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.183+0000 7f9826ffd640 1 --2- 172.21.15.6:0/1618368309 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f98080663a0 0x7f9808068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:26.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.183+0000 7f9826ffd640 1 --2- 172.21.15.6:0/1618368309 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f98080663a0 0x7f9808068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9818005890 tx=0x7f9818009040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:26.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.187+0000 7f9824ff9640 1 -- 172.21.15.6:0/1618368309 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9820051590 con 0x7f982815cef0 2023-07-21T22:34:26.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.375+0000 7f982da18640 1 -- 172.21.15.6:0/1618368309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f98280b0fa0 con 0x7f982815cef0 2023-07-21T22:34:27.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:26.999+0000 7f9824ff9640 1 -- 172.21.15.6:0/1618368309 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f98280b0fa0 con 0x7f982815cef0 2023-07-21T22:34:27.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.003+0000 7f982da18640 1 -- 172.21.15.6:0/1618368309 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f98080663a0 msgr2=0x7f9808068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.003+0000 7f982da18640 1 --2- 172.21.15.6:0/1618368309 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f98080663a0 0x7f9808068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9818005890 tx=0x7f9818009040 comp rx=0 tx=0).stop 2023-07-21T22:34:27.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.003+0000 7f982da18640 1 -- 172.21.15.6:0/1618368309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982815cef0 msgr2=0x7f98280700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.003+0000 7f982da18640 1 --2- 172.21.15.6:0/1618368309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982815cef0 0x7f98280700b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f9820009fa0 tx=0x7f982000d560 comp rx=0 tx=0).stop 2023-07-21T22:34:27.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.003+0000 7f982da18640 1 -- 172.21.15.6:0/1618368309 shutdown_connections 2023-07-21T22:34:27.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.003+0000 7f982da18640 1 --2- 172.21.15.6:0/1618368309 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f98080663a0 0x7f9808068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.003+0000 7f982da18640 1 --2- 172.21.15.6:0/1618368309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982815cef0 0x7f98280700b0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.003+0000 7f982da18640 1 --2- 172.21.15.6:0/1618368309 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9828159270 0x7f9828162c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.003+0000 7f982da18640 1 --2- 172.21.15.6:0/1618368309 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98280aeb40 0x7f982806b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.003+0000 7f982da18640 1 -- 172.21.15.6:0/1618368309 >> 172.21.15.6:0/1618368309 conn(0x7f98280cde90 msgr2=0x7f98280ae090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:27.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.003+0000 7f982da18640 1 -- 172.21.15.6:0/1618368309 shutdown_connections 2023-07-21T22:34:27.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.003+0000 7f982da18640 1 -- 172.21.15.6:0/1618368309 wait complete. 2023-07-21T22:34:27.074 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-21T22:34:27.075 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:34:27.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.171+0000 7fbf672ca640 1 Processor -- start 2023-07-21T22:34:27.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.171+0000 7fbf672ca640 1 -- start start 2023-07-21T22:34:27.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.175+0000 7fbf672ca640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbf6015d0c0 0x7fbf6006cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.175+0000 7fbf672ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf600ce390 0x7fbf600ad0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.175+0000 7fbf672ca640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6006d940 con 0x7fbf6006d430 2023-07-21T22:34:27.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.175+0000 7fbf672ca640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf6006dc20 con 0x7fbf6015d0c0 2023-07-21T22:34:27.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.175+0000 7fbf672ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6006df00 con 0x7fbf600ce390 2023-07-21T22:34:27.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.175+0000 7fbf65066640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbf6015d0c0 0x7fbf6006cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.175+0000 7fbf65066640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbf6015d0c0 0x7fbf6006cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:53858/0 (socket says 172.21.15.6:53858) 2023-07-21T22:34:27.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.175+0000 7fbf65066640 1 -- 172.21.15.6:0/1129765842 learned_addr learned my addr 172.21.15.6:0/1129765842 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:27.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.175+0000 7fbf65867640 1 --2- 172.21.15.6:0/1129765842 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf600ce390 0x7fbf600ad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.175+0000 7fbf65066640 1 -- 172.21.15.6:0/1129765842 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf600ce390 msgr2=0x7fbf600ad0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:27.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.175+0000 7fbf65066640 1 --2- 172.21.15.6:0/1129765842 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf600ce390 0x7fbf600ad0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.175+0000 7fbf65066640 1 -- 172.21.15.6:0/1129765842 >> v1:172.21.15.161:6789/0 conn(0x7fbf6006d430 legacy=0x7fbf600cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.175+0000 7fbf65066640 1 -- 172.21.15.6:0/1129765842 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6006e1e0 con 0x7fbf6015d0c0 2023-07-21T22:34:27.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.175+0000 7fbf57fff640 1 -- 172.21.15.6:0/1129765842 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172879337 0 0) 0x7fbf6006d940 con 0x7fbf6006d430 2023-07-21T22:34:27.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.179+0000 7fbf65066640 1 --2- 172.21.15.6:0/1129765842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf6015d0c0 0x7fbf6006cef0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c006fd0 tx=0x7fbf5c01c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=227f449a98e58ad8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:27.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.179+0000 7fbf57fff640 1 -- 172.21.15.6:0/1129765842 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c0a7070 con 0x7fbf6015d0c0 2023-07-21T22:34:27.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.179+0000 7fbf57fff640 1 -- 172.21.15.6:0/1129765842 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5c0ab430 con 0x7fbf6015d0c0 2023-07-21T22:34:27.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.179+0000 7fbf57fff640 1 -- 172.21.15.6:0/1129765842 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5c0ab7c0 con 0x7fbf6015d0c0 2023-07-21T22:34:27.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.179+0000 7fbf672ca640 1 -- 172.21.15.6:0/1129765842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf6015d0c0 msgr2=0x7fbf6006cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.179+0000 7fbf672ca640 1 --2- 172.21.15.6:0/1129765842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf6015d0c0 0x7fbf6006cef0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c006fd0 tx=0x7fbf5c01c520 comp rx=0 tx=0).stop 2023-07-21T22:34:27.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.179+0000 7fbf672ca640 1 -- 172.21.15.6:0/1129765842 shutdown_connections 2023-07-21T22:34:27.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.179+0000 7fbf672ca640 1 --2- 172.21.15.6:0/1129765842 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf600ce390 0x7fbf600ad0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.179+0000 7fbf672ca640 1 --2- 172.21.15.6:0/1129765842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf6015d0c0 0x7fbf6006cef0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.179+0000 7fbf672ca640 1 -- 172.21.15.6:0/1129765842 >> 172.21.15.6:0/1129765842 conn(0x7fbf600659d0 msgr2=0x7fbf60099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:27.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.179+0000 7fbf672ca640 1 -- 172.21.15.6:0/1129765842 shutdown_connections 2023-07-21T22:34:27.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.179+0000 7fbf672ca640 1 -- 172.21.15.6:0/1129765842 wait complete. 2023-07-21T22:34:27.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.179+0000 7fbf672ca640 1 Processor -- start 2023-07-21T22:34:27.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.179+0000 7fbf672ca640 1 -- start start 2023-07-21T22:34:27.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf672ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf6006d430 0x7fbf601598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf672ca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf600ce390 0x7fbf600c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf672ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf6015d0c0 0x7fbf600cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf672ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6006a890 con 0x7fbf6015d0c0 2023-07-21T22:34:27.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf672ca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6006ab70 con 0x7fbf600ce390 2023-07-21T22:34:27.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf672ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6006ae50 con 0x7fbf6006d430 2023-07-21T22:34:27.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf65867640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf6015d0c0 0x7fbf600cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf65867640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf6015d0c0 0x7fbf600cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44724/0 (socket says 172.21.15.6:44724) 2023-07-21T22:34:27.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf65867640 1 -- 172.21.15.6:0/3158687515 learned_addr learned my addr 172.21.15.6:0/3158687515 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:27.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf65066640 1 --2- 172.21.15.6:0/3158687515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf6006d430 0x7fbf601598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf64865640 1 --2- 172.21.15.6:0/3158687515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf600ce390 0x7fbf600c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf65867640 1 -- 172.21.15.6:0/3158687515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf6006d430 msgr2=0x7fbf601598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf65867640 1 --2- 172.21.15.6:0/3158687515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf6006d430 0x7fbf601598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf65867640 1 -- 172.21.15.6:0/3158687515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf600ce390 msgr2=0x7fbf600c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf65867640 1 --2- 172.21.15.6:0/3158687515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf600ce390 0x7fbf600c7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf65867640 1 -- 172.21.15.6:0/3158687515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5c009480 con 0x7fbf6015d0c0 2023-07-21T22:34:27.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf65066640 1 --2- 172.21.15.6:0/3158687515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf6006d430 0x7fbf601598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:27.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf65867640 1 --2- 172.21.15.6:0/3158687515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf6015d0c0 0x7fbf600cc2f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fbf5800efc0 tx=0x7fbf5800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:27.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf55ffb640 1 -- 172.21.15.6:0/3158687515 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf58009ca0 con 0x7fbf6015d0c0 2023-07-21T22:34:27.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf55ffb640 1 -- 172.21.15.6:0/3158687515 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5800f040 con 0x7fbf6015d0c0 2023-07-21T22:34:27.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf55ffb640 1 -- 172.21.15.6:0/3158687515 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf580146c0 con 0x7fbf6015d0c0 2023-07-21T22:34:27.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf672ca640 1 -- 172.21.15.6:0/3158687515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6006b130 con 0x7fbf6015d0c0 2023-07-21T22:34:27.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf672ca640 1 -- 172.21.15.6:0/3158687515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6006a540 con 0x7fbf6015d0c0 2023-07-21T22:34:27.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.183+0000 7fbf672ca640 1 -- 172.21.15.6:0/3158687515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf600678d0 con 0x7fbf6015d0c0 2023-07-21T22:34:27.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.187+0000 7fbf55ffb640 1 -- 172.21.15.6:0/3158687515 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbf58014820 con 0x7fbf6015d0c0 2023-07-21T22:34:27.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.187+0000 7fbf55ffb640 1 --2- 172.21.15.6:0/3158687515 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fbf440663d0 0x7fbf44068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.187+0000 7fbf55ffb640 1 -- 172.21.15.6:0/3158687515 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fbf58084e40 con 0x7fbf6015d0c0 2023-07-21T22:34:27.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.187+0000 7fbf65066640 1 --2- 172.21.15.6:0/3158687515 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fbf440663d0 0x7fbf44068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.187+0000 7fbf65066640 1 --2- 172.21.15.6:0/3158687515 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fbf440663d0 0x7fbf44068880 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c0af000 tx=0x7fbf5c0a7000 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:27.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.191+0000 7fbf55ffb640 1 -- 172.21.15.6:0/3158687515 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbf58051ff0 con 0x7fbf6015d0c0 2023-07-21T22:34:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.375+0000 7fbf672ca640 1 -- 172.21.15.6:0/3158687515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf6006b5e0 con 0x7fbf6015d0c0 2023-07-21T22:34:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.379+0000 7fbf55ffb640 1 -- 172.21.15.6:0/3158687515 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4666 (secure 0 0 0) 0x7fbf58018020 con 0x7fbf6015d0c0 2023-07-21T22:34:27.428 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:27.428 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5960,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1945082031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1945082031},{"type":"v1","addr":"172.21.15.6:6835","nonce":1945082031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5963,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/778272832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":778272832},{"type":"v1","addr":"172.21.15.161:6836","nonce":778272832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/728409440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":728409440},{"type":"v1","addr":"172.21.15.161:6837","nonce":728409440}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:34:23.355700+0000","modified":"2023-07-21T22:34:26.993451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6585},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6585":{"gid":6585,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/1769681869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1769681869},{"type":"v1","addr":"172.21.15.6:6833","nonce":1769681869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-21T22:34:27.429 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 32 2023-07-21T22:34:27.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.379+0000 7fbf672ca640 1 -- 172.21.15.6:0/3158687515 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fbf440663d0 msgr2=0x7fbf44068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.379+0000 7fbf672ca640 1 --2- 172.21.15.6:0/3158687515 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fbf440663d0 0x7fbf44068880 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbf5c0af000 tx=0x7fbf5c0a7000 comp rx=0 tx=0).stop 2023-07-21T22:34:27.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.379+0000 7fbf672ca640 1 -- 172.21.15.6:0/3158687515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf6015d0c0 msgr2=0x7fbf600cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.379+0000 7fbf672ca640 1 --2- 172.21.15.6:0/3158687515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf6015d0c0 0x7fbf600cc2f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fbf5800efc0 tx=0x7fbf5800c490 comp rx=0 tx=0).stop 2023-07-21T22:34:27.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.379+0000 7fbf672ca640 1 -- 172.21.15.6:0/3158687515 shutdown_connections 2023-07-21T22:34:27.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.379+0000 7fbf672ca640 1 --2- 172.21.15.6:0/3158687515 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fbf440663d0 0x7fbf44068880 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.379+0000 7fbf672ca640 1 --2- 172.21.15.6:0/3158687515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf6015d0c0 0x7fbf600cc2f0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.379+0000 7fbf672ca640 1 --2- 172.21.15.6:0/3158687515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf600ce390 0x7fbf600c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.379+0000 7fbf672ca640 1 --2- 172.21.15.6:0/3158687515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf6006d430 0x7fbf601598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.379+0000 7fbf672ca640 1 -- 172.21.15.6:0/3158687515 >> 172.21.15.6:0/3158687515 conn(0x7fbf600659d0 msgr2=0x7fbf600b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:27.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.379+0000 7fbf672ca640 1 -- 172.21.15.6:0/3158687515 shutdown_connections 2023-07-21T22:34:27.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.379+0000 7fbf672ca640 1 -- 172.21.15.6:0/3158687515 wait complete. 2023-07-21T22:34:27.448 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:34:27.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.543+0000 7f25bb26d640 1 Processor -- start 2023-07-21T22:34:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.543+0000 7f25bb26d640 1 -- start start 2023-07-21T22:34:27.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.543+0000 7f25bb26d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f25b4145430 0x7f25b40b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.543+0000 7f25bb26d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b40b2140 con 0x7f25b40d06b0 2023-07-21T22:34:27.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.543+0000 7f25bb26d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b40b2410 con 0x7f25b40b39f0 2023-07-21T22:34:27.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.543+0000 7f25bb26d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b40b26f0 con 0x7f25b4145430 2023-07-21T22:34:27.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.543+0000 7f25b9009640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f25b40d06b0 0x7f25b40b1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54518/0 (socket says 172.21.15.6:54518) 2023-07-21T22:34:27.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.543+0000 7f25b9009640 1 -- 172.21.15.6:0/4142443816 learned_addr learned my addr 172.21.15.6:0/4142443816 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:27.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.543+0000 7f25b8808640 1 --2- 172.21.15.6:0/4142443816 >> v2:172.21.15.161:3300/0 conn(0x7f25b4145430 0x7f25b40b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.543+0000 7f25abfff640 1 -- 172.21.15.6:0/4142443816 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2727220138 0 0) 0x7f25b40b2140 con 0x7f25b40d06b0 2023-07-21T22:34:27.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.543+0000 7f25abfff640 1 -- 172.21.15.6:0/4142443816 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25a0003530 con 0x7f25b40d06b0 2023-07-21T22:34:27.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.547+0000 7f25abfff640 1 -- 172.21.15.6:0/4142443816 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 811071644 0 0) 0x7f25a0003530 con 0x7f25b40d06b0 2023-07-21T22:34:27.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.547+0000 7f25b8808640 1 -- 172.21.15.6:0/4142443816 >> v1:172.21.15.161:6789/0 conn(0x7f25b40b39f0 legacy=0x7f25b40d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.547+0000 7f25b8808640 1 -- 172.21.15.6:0/4142443816 >> v1:172.21.15.6:6789/0 conn(0x7f25b40d06b0 legacy=0x7f25b40b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.547+0000 7f25b8808640 1 -- 172.21.15.6:0/4142443816 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b40b29d0 con 0x7f25b4145430 2023-07-21T22:34:27.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.547+0000 7f25b8808640 1 --2- 172.21.15.6:0/4142443816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25b4145430 0x7f25b40b34b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f25a40097c0 tx=0x7f25a401c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e5446ac64871420 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:27.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.547+0000 7f25abfff640 1 -- 172.21.15.6:0/4142443816 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0001680 con 0x7f25b4145430 2023-07-21T22:34:27.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.547+0000 7f25abfff640 1 -- 172.21.15.6:0/4142443816 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a40a7050 con 0x7f25b4145430 2023-07-21T22:34:27.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.547+0000 7f25abfff640 1 -- 172.21.15.6:0/4142443816 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40ab620 con 0x7f25b4145430 2023-07-21T22:34:27.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.547+0000 7f25bb26d640 1 -- 172.21.15.6:0/4142443816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25b4145430 msgr2=0x7f25b40b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.547+0000 7f25bb26d640 1 --2- 172.21.15.6:0/4142443816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25b4145430 0x7f25b40b34b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f25a40097c0 tx=0x7f25a401c370 comp rx=0 tx=0).stop 2023-07-21T22:34:27.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.547+0000 7f25bb26d640 1 -- 172.21.15.6:0/4142443816 shutdown_connections 2023-07-21T22:34:27.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.547+0000 7f25bb26d640 1 --2- 172.21.15.6:0/4142443816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25b4145430 0x7f25b40b34b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.547+0000 7f25bb26d640 1 -- 172.21.15.6:0/4142443816 >> 172.21.15.6:0/4142443816 conn(0x7f25b40659d0 msgr2=0x7f25b409b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:27.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25bb26d640 1 -- 172.21.15.6:0/4142443816 shutdown_connections 2023-07-21T22:34:27.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25bb26d640 1 -- 172.21.15.6:0/4142443816 wait complete. 2023-07-21T22:34:27.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25bb26d640 1 Processor -- start 2023-07-21T22:34:27.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25bb26d640 1 -- start start 2023-07-21T22:34:27.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25bb26d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25b40b39f0 0x7f25b4152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25bb26d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25b40d06b0 0x7f25b415e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25bb26d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25b4154570 0x7f25b415ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25bb26d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b4154ae0 con 0x7f25b40b39f0 2023-07-21T22:34:27.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25bb26d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b4153850 con 0x7f25b40d06b0 2023-07-21T22:34:27.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25bb26d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b4158750 con 0x7f25b4154570 2023-07-21T22:34:27.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25b9009640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25b40b39f0 0x7f25b4152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25b9009640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25b40b39f0 0x7f25b4152810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54090/0 (socket says 172.21.15.6:54090) 2023-07-21T22:34:27.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25b9009640 1 -- 172.21.15.6:0/3882912736 learned_addr learned my addr 172.21.15.6:0/3882912736 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:27.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25b980a640 1 --2- 172.21.15.6:0/3882912736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25b4154570 0x7f25b415ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25b8808640 1 --2- 172.21.15.6:0/3882912736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25b40d06b0 0x7f25b415e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25b9009640 1 -- 172.21.15.6:0/3882912736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25b4154570 msgr2=0x7f25b415ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25b9009640 1 --2- 172.21.15.6:0/3882912736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25b4154570 0x7f25b415ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25b9009640 1 -- 172.21.15.6:0/3882912736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25b40d06b0 msgr2=0x7f25b415e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25b9009640 1 --2- 172.21.15.6:0/3882912736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25b40d06b0 0x7f25b415e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25b9009640 1 -- 172.21.15.6:0/3882912736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a4009420 con 0x7f25b40b39f0 2023-07-21T22:34:27.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25b9009640 1 --2- 172.21.15.6:0/3882912736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25b40b39f0 0x7f25b4152810 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f25b000c760 tx=0x7f25b000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:27.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25a9ffb640 1 -- 172.21.15.6:0/3882912736 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0005ae0 con 0x7f25b40b39f0 2023-07-21T22:34:27.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.551+0000 7f25a9ffb640 1 -- 172.21.15.6:0/3882912736 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b0005c40 con 0x7f25b40b39f0 2023-07-21T22:34:27.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.555+0000 7f25bb26d640 1 -- 172.21.15.6:0/3882912736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b4158a30 con 0x7f25b40b39f0 2023-07-21T22:34:27.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.555+0000 7f25a9ffb640 1 -- 172.21.15.6:0/3882912736 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0007070 con 0x7f25b40b39f0 2023-07-21T22:34:27.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.555+0000 7f25bb26d640 1 -- 172.21.15.6:0/3882912736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b4153330 con 0x7f25b40b39f0 2023-07-21T22:34:27.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.555+0000 7f25bb26d640 1 -- 172.21.15.6:0/3882912736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b4153520 con 0x7f25b40b39f0 2023-07-21T22:34:27.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.555+0000 7f25a9ffb640 1 -- 172.21.15.6:0/3882912736 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f25b00071f0 con 0x7f25b40b39f0 2023-07-21T22:34:27.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.555+0000 7f25a9ffb640 1 --2- 172.21.15.6:0/3882912736 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f25980663d0 0x7f2598068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.555+0000 7f25a9ffb640 1 -- 172.21.15.6:0/3882912736 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f25b00837d0 con 0x7f25b40b39f0 2023-07-21T22:34:27.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.555+0000 7f25b8808640 1 --2- 172.21.15.6:0/3882912736 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f25980663d0 0x7f2598068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.559+0000 7f25b8808640 1 --2- 172.21.15.6:0/3882912736 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f25980663d0 0x7f2598068880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f25a40ad000 tx=0x7f25a40a6000 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:27.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.559+0000 7f25a9ffb640 1 -- 172.21.15.6:0/3882912736 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f25b0054500 con 0x7f25b40b39f0 2023-07-21T22:34:27.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.715+0000 7f25bb26d640 1 -- 172.21.15.6:0/3882912736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25b40678d0 con 0x7f25b40b39f0 2023-07-21T22:34:27.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.719+0000 7f25a9ffb640 1 -- 172.21.15.6:0/3882912736 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+18291 (secure 0 0 0) 0x7f25b0054090 con 0x7f25b40b39f0 2023-07-21T22:34:27.768 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:27.768 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:34:24.966766+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:34:21.475741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T22:34:22.347392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:34:27.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.719+0000 7f25bb26d640 1 -- 172.21.15.6:0/3882912736 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f25980663d0 msgr2=0x7f2598068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.719+0000 7f25bb26d640 1 --2- 172.21.15.6:0/3882912736 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f25980663d0 0x7f2598068880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f25a40ad000 tx=0x7f25a40a6000 comp rx=0 tx=0).stop 2023-07-21T22:34:27.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.719+0000 7f25bb26d640 1 -- 172.21.15.6:0/3882912736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25b40b39f0 msgr2=0x7f25b4152810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.719+0000 7f25bb26d640 1 --2- 172.21.15.6:0/3882912736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25b40b39f0 0x7f25b4152810 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f25b000c760 tx=0x7f25b000cc20 comp rx=0 tx=0).stop 2023-07-21T22:34:27.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.719+0000 7f25bb26d640 1 -- 172.21.15.6:0/3882912736 shutdown_connections 2023-07-21T22:34:27.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.719+0000 7f25bb26d640 1 --2- 172.21.15.6:0/3882912736 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f25980663d0 0x7f2598068880 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.719+0000 7f25bb26d640 1 --2- 172.21.15.6:0/3882912736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25b4154570 0x7f25b415ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.719+0000 7f25bb26d640 1 --2- 172.21.15.6:0/3882912736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25b40d06b0 0x7f25b415e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.719+0000 7f25bb26d640 1 --2- 172.21.15.6:0/3882912736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25b40b39f0 0x7f25b4152810 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.719+0000 7f25bb26d640 1 -- 172.21.15.6:0/3882912736 >> 172.21.15.6:0/3882912736 conn(0x7f25b40659d0 msgr2=0x7f25b406b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.719+0000 7f25bb26d640 1 -- 172.21.15.6:0/3882912736 shutdown_connections 2023-07-21T22:34:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.719+0000 7f25bb26d640 1 -- 172.21.15.6:0/3882912736 wait complete. 2023-07-21T22:34:27.790 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T22:34:27.790 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:34:27.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.883+0000 7f8838c93640 1 Processor -- start 2023-07-21T22:34:27.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.883+0000 7f8838c93640 1 -- start start 2023-07-21T22:34:27.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.887+0000 7f8838c93640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f88340cb780 0x7f88340cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.887+0000 7f8838c93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f883406b8f0 0x7f88340cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.887+0000 7f8838c93640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883406f900 con 0x7f883415b7c0 2023-07-21T22:34:27.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.887+0000 7f8838c93640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88340cdce0 con 0x7f88340cb780 2023-07-21T22:34:27.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.887+0000 7f8838c93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88340ca830 con 0x7f883406b8f0 2023-07-21T22:34:27.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.887+0000 7f883259c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f883415b7c0 0x7f883406b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54520/0 (socket says 172.21.15.6:54520) 2023-07-21T22:34:27.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.887+0000 7f883259c640 1 -- 172.21.15.6:0/4108719110 learned_addr learned my addr 172.21.15.6:0/4108719110 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:27.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.887+0000 7f882bfff640 1 --2- 172.21.15.6:0/4108719110 >> v2:172.21.15.6:3300/0 conn(0x7f88340cb780 0x7f88340cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.887+0000 7f8831d9b640 1 -- 172.21.15.6:0/4108719110 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43859166 0 0) 0x7f883406f900 con 0x7f883415b7c0 2023-07-21T22:34:27.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.887+0000 7f8832d9d640 1 --2- 172.21.15.6:0/4108719110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f883406b8f0 0x7f88340cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.887+0000 7f8831d9b640 1 -- 172.21.15.6:0/4108719110 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8820003530 con 0x7f883415b7c0 2023-07-21T22:34:27.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.887+0000 7f882bfff640 1 -- 172.21.15.6:0/4108719110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f883406b8f0 msgr2=0x7f88340cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:27.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.887+0000 7f882bfff640 1 --2- 172.21.15.6:0/4108719110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f883406b8f0 0x7f88340cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.887+0000 7f882bfff640 1 -- 172.21.15.6:0/4108719110 >> v1:172.21.15.6:6789/0 conn(0x7f883415b7c0 legacy=0x7f883406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.887+0000 7f882bfff640 1 -- 172.21.15.6:0/4108719110 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883415bb90 con 0x7f88340cb780 2023-07-21T22:34:27.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.887+0000 7f8832d9d640 1 --2- 172.21.15.6:0/4108719110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f883406b8f0 0x7f88340cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:27.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.891+0000 7f882bfff640 1 --2- 172.21.15.6:0/4108719110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88340cb780 0x7f88340cbd30 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f881c0097c0 tx=0x7f881c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fec412c5fbd3a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:27.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.891+0000 7f8831d9b640 1 -- 172.21.15.6:0/4108719110 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c0ab600 con 0x7f88340cb780 2023-07-21T22:34:27.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.891+0000 7f8831d9b640 1 -- 172.21.15.6:0/4108719110 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c0a7050 con 0x7f88340cb780 2023-07-21T22:34:27.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.891+0000 7f8831d9b640 1 -- 172.21.15.6:0/4108719110 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c0ab980 con 0x7f88340cb780 2023-07-21T22:34:27.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.891+0000 7f8838c93640 1 -- 172.21.15.6:0/4108719110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88340cb780 msgr2=0x7f88340cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.891+0000 7f8838c93640 1 --2- 172.21.15.6:0/4108719110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88340cb780 0x7f88340cbd30 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f881c0097c0 tx=0x7f881c01c450 comp rx=0 tx=0).stop 2023-07-21T22:34:27.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.891+0000 7f8838c93640 1 -- 172.21.15.6:0/4108719110 shutdown_connections 2023-07-21T22:34:27.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.891+0000 7f8838c93640 1 --2- 172.21.15.6:0/4108719110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f883406b8f0 0x7f88340cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.891+0000 7f8838c93640 1 --2- 172.21.15.6:0/4108719110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88340cb780 0x7f88340cbd30 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.891+0000 7f8838c93640 1 -- 172.21.15.6:0/4108719110 >> 172.21.15.6:0/4108719110 conn(0x7f88340afcf0 msgr2=0x7f88340b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:27.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.891+0000 7f8838c93640 1 -- 172.21.15.6:0/4108719110 shutdown_connections 2023-07-21T22:34:27.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.891+0000 7f8838c93640 1 -- 172.21.15.6:0/4108719110 wait complete. 2023-07-21T22:34:27.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.891+0000 7f8838c93640 1 Processor -- start 2023-07-21T22:34:27.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.891+0000 7f8838c93640 1 -- start start 2023-07-21T22:34:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f8838c93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f883406b8f0 0x7f88341556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f8838c93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f883415b7c0 0x7f88340adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f8838c93640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88340ae530 0x7f88340aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f8838c93640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8834165be0 con 0x7f883415b7c0 2023-07-21T22:34:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f8838c93640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8834165e80 con 0x7f88340ae530 2023-07-21T22:34:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f8838c93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8834166160 con 0x7f883406b8f0 2023-07-21T22:34:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f882bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f883415b7c0 0x7f88340adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f882bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f883415b7c0 0x7f88340adff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54104/0 (socket says 172.21.15.6:54104) 2023-07-21T22:34:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f882bfff640 1 -- 172.21.15.6:0/1784032807 learned_addr learned my addr 172.21.15.6:0/1784032807 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f883259c640 1 --2- 172.21.15.6:0/1784032807 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f883406b8f0 0x7f88341556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f8832d9d640 1 --2- 172.21.15.6:0/1784032807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88340ae530 0x7f88340aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f882bfff640 1 -- 172.21.15.6:0/1784032807 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f883406b8f0 msgr2=0x7f88341556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f882bfff640 1 --2- 172.21.15.6:0/1784032807 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f883406b8f0 0x7f88341556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f882bfff640 1 -- 172.21.15.6:0/1784032807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88340ae530 msgr2=0x7f88340aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f882bfff640 1 --2- 172.21.15.6:0/1784032807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88340ae530 0x7f88340aef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f882bfff640 1 -- 172.21.15.6:0/1784032807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c009420 con 0x7f883415b7c0 2023-07-21T22:34:27.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f8832d9d640 1 --2- 172.21.15.6:0/1784032807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88340ae530 0x7f88340aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:27.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f882bfff640 1 --2- 172.21.15.6:0/1784032807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f883415b7c0 0x7f88340adff0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f881c0ae040 tx=0x7f881c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:27.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f882affd640 1 -- 172.21.15.6:0/1784032807 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c0b4430 con 0x7f883415b7c0 2023-07-21T22:34:27.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f882affd640 1 -- 172.21.15.6:0/1784032807 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c0b45b0 con 0x7f883415b7c0 2023-07-21T22:34:27.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f8838c93640 1 -- 172.21.15.6:0/1784032807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88340ae9d0 con 0x7f883415b7c0 2023-07-21T22:34:27.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f882affd640 1 -- 172.21.15.6:0/1784032807 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c0b4960 con 0x7f883415b7c0 2023-07-21T22:34:27.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f8838c93640 1 -- 172.21.15.6:0/1784032807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88341650e0 con 0x7f883415b7c0 2023-07-21T22:34:27.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.895+0000 7f8838c93640 1 -- 172.21.15.6:0/1784032807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88340678d0 con 0x7f883415b7c0 2023-07-21T22:34:27.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.899+0000 7f882affd640 1 -- 172.21.15.6:0/1784032807 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f881c0b2040 con 0x7f883415b7c0 2023-07-21T22:34:27.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.899+0000 7f882affd640 1 --2- 172.21.15.6:0/1784032807 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f88140663d0 0x7f8814068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.899+0000 7f882affd640 1 -- 172.21.15.6:0/1784032807 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f881c11de70 con 0x7f883415b7c0 2023-07-21T22:34:27.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.899+0000 7f883259c640 1 --2- 172.21.15.6:0/1784032807 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f88140663d0 0x7f8814068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.899+0000 7f883259c640 1 --2- 172.21.15.6:0/1784032807 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f88140663d0 0x7f8814068880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f88240011f0 tx=0x7f8824009040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:27.903+0000 7f882affd640 1 -- 172.21.15.6:0/1784032807 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f881c0eb090 con 0x7f883415b7c0 2023-07-21T22:34:28.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.059+0000 7f8838c93640 1 -- 172.21.15.6:0/1784032807 --> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8834165330 con 0x7f88140663d0 2023-07-21T22:34:28.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.067+0000 7f882affd640 1 -- 172.21.15.6:0/1784032807 <== mgr.5768 v2:172.21.15.161:6832/3045187557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305752 (secure 0 0 0) 0x7f8834165330 con 0x7f88140663d0 2023-07-21T22:34:28.120 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:34:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.071+0000 7f8838c93640 1 -- 172.21.15.6:0/1784032807 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f88140663d0 msgr2=0x7f8814068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.071+0000 7f8838c93640 1 --2- 172.21.15.6:0/1784032807 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f88140663d0 0x7f8814068880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f88240011f0 tx=0x7f8824009040 comp rx=0 tx=0).stop 2023-07-21T22:34:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.071+0000 7f8838c93640 1 -- 172.21.15.6:0/1784032807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f883415b7c0 msgr2=0x7f88340adff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.071+0000 7f8838c93640 1 --2- 172.21.15.6:0/1784032807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f883415b7c0 0x7f88340adff0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f881c0ae040 tx=0x7f881c0191f0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.071+0000 7f8838c93640 1 -- 172.21.15.6:0/1784032807 shutdown_connections 2023-07-21T22:34:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.071+0000 7f8838c93640 1 --2- 172.21.15.6:0/1784032807 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f88140663d0 0x7f8814068880 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.071+0000 7f8838c93640 1 --2- 172.21.15.6:0/1784032807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88340ae530 0x7f88340aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.071+0000 7f8838c93640 1 --2- 172.21.15.6:0/1784032807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f883415b7c0 0x7f88340adff0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.071+0000 7f8838c93640 1 --2- 172.21.15.6:0/1784032807 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f883406b8f0 0x7f88341556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.071+0000 7f8838c93640 1 -- 172.21.15.6:0/1784032807 >> 172.21.15.6:0/1784032807 conn(0x7f88340afcf0 msgr2=0x7f88340ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.071+0000 7f8838c93640 1 -- 172.21.15.6:0/1784032807 shutdown_connections 2023-07-21T22:34:28.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.071+0000 7f8838c93640 1 -- 172.21.15.6:0/1784032807 wait complete. 2023-07-21T22:34:28.140 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-21T22:34:27.633929+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":301476,"kb_used_data":8804,"kb_used_omap":0,"kb_used_meta":292608,"kb_avail":754673244,"statfs":{"total":773094113280,"available":772785401856,"internally_reserved":0,"allocated":9015296,"data_stored":5030720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":299630592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.682484"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.960487+0000","last_change":"2023-07-21T22:34:22.960487+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.960487+0000","last_undegraded":"2023-07-21T22:34:22.960487+0000","last_fullsized":"2023-07-21T22:34:22.960487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.959374+0000","last_change":"2023-07-21T22:34:22.959374+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.959374+0000","last_undegraded":"2023-07-21T22:34:22.959374+0000","last_fullsized":"2023-07-21T22:34:22.959374+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.971829+0000","last_change":"2023-07-21T22:34:22.971829+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.971829+0000","last_undegraded":"2023-07-21T22:34:22.971829+0000","last_fullsized":"2023-07-21T22:34:22.971829+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.973347+0000","last_change":"2023-07-21T22:34:22.973347+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.973347+0000","last_undegraded":"2023-07-21T22:34:22.973347+0000","last_fullsized":"2023-07-21T22:34:22.973347+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.973406+0000","last_change":"2023-07-21T22:34:22.973406+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.973406+0000","last_undegraded":"2023-07-21T22:34:22.973406+0000","last_fullsized":"2023-07-21T22:34:22.973406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.964323+0000","last_change":"2023-07-21T22:34:22.964323+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.964323+0000","last_undegraded":"2023-07-21T22:34:22.964323+0000","last_fullsized":"2023-07-21T22:34:22.964323+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965480+0000","last_change":"2023-07-21T22:34:22.965480+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965480+0000","last_undegraded":"2023-07-21T22:34:22.965480+0000","last_fullsized":"2023-07-21T22:34:22.965480+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.964672+0000","last_change":"2023-07-21T22:34:22.964672+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.964672+0000","last_undegraded":"2023-07-21T22:34:22.964672+0000","last_fullsized":"2023-07-21T22:34:22.964672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.972662+0000","last_change":"2023-07-21T22:34:22.972662+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.972662+0000","last_undegraded":"2023-07-21T22:34:22.972662+0000","last_fullsized":"2023-07-21T22:34:22.972662+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.968212+0000","last_change":"2023-07-21T22:34:22.968212+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.968212+0000","last_undegraded":"2023-07-21T22:34:22.968212+0000","last_fullsized":"2023-07-21T22:34:22.968212+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.978022+0000","last_change":"2023-07-21T22:34:22.978022+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.978022+0000","last_undegraded":"2023-07-21T22:34:22.978022+0000","last_fullsized":"2023-07-21T22:34:22.978022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965579+0000","last_change":"2023-07-21T22:34:22.965579+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965579+0000","last_undegraded":"2023-07-21T22:34:22.965579+0000","last_fullsized":"2023-07-21T22:34:22.965579+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965320+0000","last_change":"2023-07-21T22:34:22.965320+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965320+0000","last_undegraded":"2023-07-21T22:34:22.965320+0000","last_fullsized":"2023-07-21T22:34:22.965320+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.972531+0000","last_change":"2023-07-21T22:34:22.972531+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.972531+0000","last_undegraded":"2023-07-21T22:34:22.972531+0000","last_fullsized":"2023-07-21T22:34:22.972531+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.968640+0000","last_change":"2023-07-21T22:34:22.968640+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.968640+0000","last_undegraded":"2023-07-21T22:34:22.968640+0000","last_fullsized":"2023-07-21T22:34:22.968640+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965009+0000","last_change":"2023-07-21T22:34:22.965009+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965009+0000","last_undegraded":"2023-07-21T22:34:22.965009+0000","last_fullsized":"2023-07-21T22:34:22.965009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.959901+0000","last_change":"2023-07-21T22:34:22.959901+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.959901+0000","last_undegraded":"2023-07-21T22:34:22.959901+0000","last_fullsized":"2023-07-21T22:34:22.959901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.975064+0000","last_change":"2023-07-21T22:34:22.975064+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.975064+0000","last_undegraded":"2023-07-21T22:34:22.975064+0000","last_fullsized":"2023-07-21T22:34:22.975064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.974975+0000","last_change":"2023-07-21T22:34:22.974975+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.974975+0000","last_undegraded":"2023-07-21T22:34:22.974975+0000","last_fullsized":"2023-07-21T22:34:22.974975+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.960589+0000","last_change":"2023-07-21T22:34:22.960589+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.960589+0000","last_undegraded":"2023-07-21T22:34:22.960589+0000","last_fullsized":"2023-07-21T22:34:22.960589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.964751+0000","last_change":"2023-07-21T22:34:22.964751+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.964751+0000","last_undegraded":"2023-07-21T22:34:22.964751+0000","last_fullsized":"2023-07-21T22:34:22.964751+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.962349+0000","last_change":"2023-07-21T22:34:22.962349+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.962349+0000","last_undegraded":"2023-07-21T22:34:22.962349+0000","last_fullsized":"2023-07-21T22:34:22.962349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.961322+0000","last_change":"2023-07-21T22:34:22.961322+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.961322+0000","last_undegraded":"2023-07-21T22:34:22.961322+0000","last_fullsized":"2023-07-21T22:34:22.961322+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.968031+0000","last_change":"2023-07-21T22:34:22.968031+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.968031+0000","last_undegraded":"2023-07-21T22:34:22.968031+0000","last_fullsized":"2023-07-21T22:34:22.968031+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965968+0000","last_change":"2023-07-21T22:34:22.965968+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965968+0000","last_undegraded":"2023-07-21T22:34:22.965968+0000","last_fullsized":"2023-07-21T22:34:22.965968+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965623+0000","last_change":"2023-07-21T22:34:22.965623+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965623+0000","last_undegraded":"2023-07-21T22:34:22.965623+0000","last_fullsized":"2023-07-21T22:34:22.965623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.969852+0000","last_change":"2023-07-21T22:34:22.969852+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.969852+0000","last_undegraded":"2023-07-21T22:34:22.969852+0000","last_fullsized":"2023-07-21T22:34:22.969852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.960796+0000","last_change":"2023-07-21T22:34:22.960796+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.960796+0000","last_undegraded":"2023-07-21T22:34:22.960796+0000","last_fullsized":"2023-07-21T22:34:22.960796+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.967988+0000","last_change":"2023-07-21T22:34:22.967988+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.967988+0000","last_undegraded":"2023-07-21T22:34:22.967988+0000","last_fullsized":"2023-07-21T22:34:22.967988+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965428+0000","last_change":"2023-07-21T22:34:22.965428+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965428+0000","last_undegraded":"2023-07-21T22:34:22.965428+0000","last_fullsized":"2023-07-21T22:34:22.965428+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.978018+0000","last_change":"2023-07-21T22:34:22.978018+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.978018+0000","last_undegraded":"2023-07-21T22:34:22.978018+0000","last_fullsized":"2023-07-21T22:34:22.978018+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965294+0000","last_change":"2023-07-21T22:34:22.965294+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965294+0000","last_undegraded":"2023-07-21T22:34:22.965294+0000","last_fullsized":"2023-07-21T22:34:22.965294+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.970806+0000","last_change":"2023-07-21T22:34:22.970806+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.970806+0000","last_undegraded":"2023-07-21T22:34:22.970806+0000","last_fullsized":"2023-07-21T22:34:22.970806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.980302+0000","last_change":"2023-07-21T22:34:22.979497+0000","last_active":"2023-07-21T22:34:22.980302+0000","last_peered":"2023-07-21T22:34:22.980302+0000","last_clean":"2023-07-21T22:34:22.980302+0000","last_became_active":"2023-07-21T22:34:22.979085+0000","last_became_peered":"2023-07-21T22:34:22.979085+0000","last_unstale":"2023-07-21T22:34:22.980302+0000","last_undegraded":"2023-07-21T22:34:22.980302+0000","last_fullsized":"2023-07-21T22:34:22.980302+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:30:48.994293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.969246+0000","last_change":"2023-07-21T22:34:22.969246+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.969246+0000","last_undegraded":"2023-07-21T22:34:22.969246+0000","last_fullsized":"2023-07-21T22:34:22.969246+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.982510+0000","last_change":"2023-07-21T22:34:22.981336+0000","last_active":"2023-07-21T22:34:22.982510+0000","last_peered":"2023-07-21T22:34:22.982510+0000","last_clean":"2023-07-21T22:34:22.982510+0000","last_became_active":"2023-07-21T22:34:22.981041+0000","last_became_peered":"2023-07-21T22:34:22.981041+0000","last_unstale":"2023-07-21T22:34:22.982510+0000","last_undegraded":"2023-07-21T22:34:22.982510+0000","last_fullsized":"2023-07-21T22:34:22.982510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:05:55.966697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.963558+0000","last_change":"2023-07-21T22:34:22.963558+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.963558+0000","last_undegraded":"2023-07-21T22:34:22.963558+0000","last_fullsized":"2023-07-21T22:34:22.963558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.978672+0000","last_change":"2023-07-21T22:34:22.977004+0000","last_active":"2023-07-21T22:34:22.978672+0000","last_peered":"2023-07-21T22:34:22.978672+0000","last_clean":"2023-07-21T22:34:22.978672+0000","last_became_active":"2023-07-21T22:34:22.976750+0000","last_became_peered":"2023-07-21T22:34:22.976750+0000","last_unstale":"2023-07-21T22:34:22.978672+0000","last_undegraded":"2023-07-21T22:34:22.978672+0000","last_fullsized":"2023-07-21T22:34:22.978672+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:48:45.337373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.973226+0000","last_change":"2023-07-21T22:34:22.973226+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.973226+0000","last_undegraded":"2023-07-21T22:34:22.973226+0000","last_fullsized":"2023-07-21T22:34:22.973226+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.972392+0000","last_change":"2023-07-21T22:34:22.970084+0000","last_active":"2023-07-21T22:34:22.972392+0000","last_peered":"2023-07-21T22:34:22.972392+0000","last_clean":"2023-07-21T22:34:22.972392+0000","last_became_active":"2023-07-21T22:34:22.969773+0000","last_became_peered":"2023-07-21T22:34:22.969773+0000","last_unstale":"2023-07-21T22:34:22.972392+0000","last_undegraded":"2023-07-21T22:34:22.972392+0000","last_fullsized":"2023-07-21T22:34:22.972392+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:03:38.882654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.964405+0000","last_change":"2023-07-21T22:34:22.964405+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.964405+0000","last_undegraded":"2023-07-21T22:34:22.964405+0000","last_fullsized":"2023-07-21T22:34:22.964405+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.972601+0000","last_change":"2023-07-21T22:34:22.970835+0000","last_active":"2023-07-21T22:34:22.972601+0000","last_peered":"2023-07-21T22:34:22.972601+0000","last_clean":"2023-07-21T22:34:22.972601+0000","last_became_active":"2023-07-21T22:34:22.970540+0000","last_became_peered":"2023-07-21T22:34:22.970540+0000","last_unstale":"2023-07-21T22:34:22.972601+0000","last_undegraded":"2023-07-21T22:34:22.972601+0000","last_fullsized":"2023-07-21T22:34:22.972601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:12.812980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.959151+0000","last_change":"2023-07-21T22:34:22.959151+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.959151+0000","last_undegraded":"2023-07-21T22:34:22.959151+0000","last_fullsized":"2023-07-21T22:34:22.959151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.969785+0000","last_change":"2023-07-21T22:34:22.968964+0000","last_active":"2023-07-21T22:34:22.969785+0000","last_peered":"2023-07-21T22:34:22.969785+0000","last_clean":"2023-07-21T22:34:22.969785+0000","last_became_active":"2023-07-21T22:34:22.968672+0000","last_became_peered":"2023-07-21T22:34:22.968672+0000","last_unstale":"2023-07-21T22:34:22.969785+0000","last_undegraded":"2023-07-21T22:34:22.969785+0000","last_fullsized":"2023-07-21T22:34:22.969785+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:30:48.994293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.972074+0000","last_change":"2023-07-21T22:34:22.972074+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.972074+0000","last_undegraded":"2023-07-21T22:34:22.972074+0000","last_fullsized":"2023-07-21T22:34:22.972074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.978608+0000","last_change":"2023-07-21T22:34:22.975818+0000","last_active":"2023-07-21T22:34:22.978608+0000","last_peered":"2023-07-21T22:34:22.978608+0000","last_clean":"2023-07-21T22:34:22.978608+0000","last_became_active":"2023-07-21T22:34:22.975533+0000","last_became_peered":"2023-07-21T22:34:22.975533+0000","last_unstale":"2023-07-21T22:34:22.978608+0000","last_undegraded":"2023-07-21T22:34:22.978608+0000","last_fullsized":"2023-07-21T22:34:22.978608+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:01:04.819418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.960392+0000","last_change":"2023-07-21T22:34:22.960392+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.960392+0000","last_undegraded":"2023-07-21T22:34:22.960392+0000","last_fullsized":"2023-07-21T22:34:22.960392+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.986187+0000","last_change":"2023-07-21T22:34:22.982821+0000","last_active":"2023-07-21T22:34:22.986187+0000","last_peered":"2023-07-21T22:34:22.986187+0000","last_clean":"2023-07-21T22:34:22.986187+0000","last_became_active":"2023-07-21T22:34:22.982493+0000","last_became_peered":"2023-07-21T22:34:22.982493+0000","last_unstale":"2023-07-21T22:34:22.986187+0000","last_undegraded":"2023-07-21T22:34:22.986187+0000","last_fullsized":"2023-07-21T22:34:22.986187+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:25:07.434309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.960328+0000","last_change":"2023-07-21T22:34:22.960328+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.960328+0000","last_undegraded":"2023-07-21T22:34:22.960328+0000","last_fullsized":"2023-07-21T22:34:22.960328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.988365+0000","last_change":"2023-07-21T22:34:22.984655+0000","last_active":"2023-07-21T22:34:22.988365+0000","last_peered":"2023-07-21T22:34:22.988365+0000","last_clean":"2023-07-21T22:34:22.988365+0000","last_became_active":"2023-07-21T22:34:22.984018+0000","last_became_peered":"2023-07-21T22:34:22.984018+0000","last_unstale":"2023-07-21T22:34:22.988365+0000","last_undegraded":"2023-07-21T22:34:22.988365+0000","last_fullsized":"2023-07-21T22:34:22.988365+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:06:10.217482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.960181+0000","last_change":"2023-07-21T22:34:22.960181+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.960181+0000","last_undegraded":"2023-07-21T22:34:22.960181+0000","last_fullsized":"2023-07-21T22:34:22.960181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.987231+0000","last_change":"2023-07-21T22:34:22.980664+0000","last_active":"2023-07-21T22:34:22.987231+0000","last_peered":"2023-07-21T22:34:22.987231+0000","last_clean":"2023-07-21T22:34:22.987231+0000","last_became_active":"2023-07-21T22:34:22.980400+0000","last_became_peered":"2023-07-21T22:34:22.980400+0000","last_unstale":"2023-07-21T22:34:22.987231+0000","last_undegraded":"2023-07-21T22:34:22.987231+0000","last_fullsized":"2023-07-21T22:34:22.987231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:58:26.952281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.971347+0000","last_change":"2023-07-21T22:34:22.971347+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.971347+0000","last_undegraded":"2023-07-21T22:34:22.971347+0000","last_fullsized":"2023-07-21T22:34:22.971347+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.986677+0000","last_change":"2023-07-21T22:34:22.983166+0000","last_active":"2023-07-21T22:34:22.986677+0000","last_peered":"2023-07-21T22:34:22.986677+0000","last_clean":"2023-07-21T22:34:22.986677+0000","last_became_active":"2023-07-21T22:34:22.982456+0000","last_became_peered":"2023-07-21T22:34:22.982456+0000","last_unstale":"2023-07-21T22:34:22.986677+0000","last_undegraded":"2023-07-21T22:34:22.986677+0000","last_fullsized":"2023-07-21T22:34:22.986677+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:35:17.609604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.970705+0000","last_change":"2023-07-21T22:34:22.970705+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.970705+0000","last_undegraded":"2023-07-21T22:34:22.970705+0000","last_fullsized":"2023-07-21T22:34:22.970705+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.984644+0000","last_change":"2023-07-21T22:34:22.983569+0000","last_active":"2023-07-21T22:34:22.984644+0000","last_peered":"2023-07-21T22:34:22.984644+0000","last_clean":"2023-07-21T22:34:22.984644+0000","last_became_active":"2023-07-21T22:34:22.983277+0000","last_became_peered":"2023-07-21T22:34:22.983277+0000","last_unstale":"2023-07-21T22:34:22.984644+0000","last_undegraded":"2023-07-21T22:34:22.984644+0000","last_fullsized":"2023-07-21T22:34:22.984644+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:15:56.139290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.969465+0000","last_change":"2023-07-21T22:34:22.969465+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.969465+0000","last_undegraded":"2023-07-21T22:34:22.969465+0000","last_fullsized":"2023-07-21T22:34:22.969465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.988415+0000","last_change":"2023-07-21T22:34:22.985264+0000","last_active":"2023-07-21T22:34:22.988415+0000","last_peered":"2023-07-21T22:34:22.988415+0000","last_clean":"2023-07-21T22:34:22.988415+0000","last_became_active":"2023-07-21T22:34:22.984946+0000","last_became_peered":"2023-07-21T22:34:22.984946+0000","last_unstale":"2023-07-21T22:34:22.988415+0000","last_undegraded":"2023-07-21T22:34:22.988415+0000","last_fullsized":"2023-07-21T22:34:22.988415+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:26:07.917220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.966612+0000","last_change":"2023-07-21T22:34:22.966612+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.966612+0000","last_undegraded":"2023-07-21T22:34:22.966612+0000","last_fullsized":"2023-07-21T22:34:22.966612+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.983406+0000","last_change":"2023-07-21T22:34:22.978391+0000","last_active":"2023-07-21T22:34:22.983406+0000","last_peered":"2023-07-21T22:34:22.983406+0000","last_clean":"2023-07-21T22:34:22.983406+0000","last_became_active":"2023-07-21T22:34:22.978125+0000","last_became_peered":"2023-07-21T22:34:22.978125+0000","last_unstale":"2023-07-21T22:34:22.983406+0000","last_undegraded":"2023-07-21T22:34:22.983406+0000","last_fullsized":"2023-07-21T22:34:22.983406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:33:37.265284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.971653+0000","last_change":"2023-07-21T22:34:22.971653+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.971653+0000","last_undegraded":"2023-07-21T22:34:22.971653+0000","last_fullsized":"2023-07-21T22:34:22.971653+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.986670+0000","last_change":"2023-07-21T22:34:22.983579+0000","last_active":"2023-07-21T22:34:22.986670+0000","last_peered":"2023-07-21T22:34:22.986670+0000","last_clean":"2023-07-21T22:34:22.986670+0000","last_became_active":"2023-07-21T22:34:22.983241+0000","last_became_peered":"2023-07-21T22:34:22.983241+0000","last_unstale":"2023-07-21T22:34:22.986670+0000","last_undegraded":"2023-07-21T22:34:22.986670+0000","last_fullsized":"2023-07-21T22:34:22.986670+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:49:29.136005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.959044+0000","last_change":"2023-07-21T22:34:22.959044+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.959044+0000","last_undegraded":"2023-07-21T22:34:22.959044+0000","last_fullsized":"2023-07-21T22:34:22.959044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.987706+0000","last_change":"2023-07-21T22:34:22.985768+0000","last_active":"2023-07-21T22:34:22.987706+0000","last_peered":"2023-07-21T22:34:22.987706+0000","last_clean":"2023-07-21T22:34:22.987706+0000","last_became_active":"2023-07-21T22:34:22.985453+0000","last_became_peered":"2023-07-21T22:34:22.985453+0000","last_unstale":"2023-07-21T22:34:22.987706+0000","last_undegraded":"2023-07-21T22:34:22.987706+0000","last_fullsized":"2023-07-21T22:34:22.987706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:56:31.677979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.963788+0000","last_change":"2023-07-21T22:34:22.963788+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.963788+0000","last_undegraded":"2023-07-21T22:34:22.963788+0000","last_fullsized":"2023-07-21T22:34:22.963788+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.987643+0000","last_change":"2023-07-21T22:34:22.982600+0000","last_active":"2023-07-21T22:34:22.987643+0000","last_peered":"2023-07-21T22:34:22.987643+0000","last_clean":"2023-07-21T22:34:22.987643+0000","last_became_active":"2023-07-21T22:34:22.982315+0000","last_became_peered":"2023-07-21T22:34:22.982315+0000","last_unstale":"2023-07-21T22:34:22.987643+0000","last_undegraded":"2023-07-21T22:34:22.987643+0000","last_fullsized":"2023-07-21T22:34:22.987643+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:19.158521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.966518+0000","last_change":"2023-07-21T22:34:22.966518+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.966518+0000","last_undegraded":"2023-07-21T22:34:22.966518+0000","last_fullsized":"2023-07-21T22:34:22.966518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.983344+0000","last_change":"2023-07-21T22:34:22.979042+0000","last_active":"2023-07-21T22:34:22.983344+0000","last_peered":"2023-07-21T22:34:22.983344+0000","last_clean":"2023-07-21T22:34:22.983344+0000","last_became_active":"2023-07-21T22:34:22.978740+0000","last_became_peered":"2023-07-21T22:34:22.978740+0000","last_unstale":"2023-07-21T22:34:22.983344+0000","last_undegraded":"2023-07-21T22:34:22.983344+0000","last_fullsized":"2023-07-21T22:34:22.983344+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:01:46.331107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965071+0000","last_change":"2023-07-21T22:34:22.965071+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965071+0000","last_undegraded":"2023-07-21T22:34:22.965071+0000","last_fullsized":"2023-07-21T22:34:22.965071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.978194+0000","last_change":"2023-07-21T22:34:22.977004+0000","last_active":"2023-07-21T22:34:22.978194+0000","last_peered":"2023-07-21T22:34:22.978194+0000","last_clean":"2023-07-21T22:34:22.978194+0000","last_became_active":"2023-07-21T22:34:22.976697+0000","last_became_peered":"2023-07-21T22:34:22.976697+0000","last_unstale":"2023-07-21T22:34:22.978194+0000","last_undegraded":"2023-07-21T22:34:22.978194+0000","last_fullsized":"2023-07-21T22:34:22.978194+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:49:11.617598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.970155+0000","last_change":"2023-07-21T22:34:22.970155+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.970155+0000","last_undegraded":"2023-07-21T22:34:22.970155+0000","last_fullsized":"2023-07-21T22:34:22.970155+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.984663+0000","last_change":"2023-07-21T22:34:22.983643+0000","last_active":"2023-07-21T22:34:22.984663+0000","last_peered":"2023-07-21T22:34:22.984663+0000","last_clean":"2023-07-21T22:34:22.984663+0000","last_became_active":"2023-07-21T22:34:22.983314+0000","last_became_peered":"2023-07-21T22:34:22.983314+0000","last_unstale":"2023-07-21T22:34:22.984663+0000","last_undegraded":"2023-07-21T22:34:22.984663+0000","last_fullsized":"2023-07-21T22:34:22.984663+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:01:04.819418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.973144+0000","last_change":"2023-07-21T22:34:22.973144+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.973144+0000","last_undegraded":"2023-07-21T22:34:22.973144+0000","last_fullsized":"2023-07-21T22:34:22.973144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.986725+0000","last_change":"2023-07-21T22:34:22.982875+0000","last_active":"2023-07-21T22:34:22.986725+0000","last_peered":"2023-07-21T22:34:22.986725+0000","last_clean":"2023-07-21T22:34:22.986725+0000","last_became_active":"2023-07-21T22:34:22.982387+0000","last_became_peered":"2023-07-21T22:34:22.982387+0000","last_unstale":"2023-07-21T22:34:22.986725+0000","last_undegraded":"2023-07-21T22:34:22.986725+0000","last_fullsized":"2023-07-21T22:34:22.986725+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:07:10.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.970000+0000","last_change":"2023-07-21T22:34:22.970000+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.970000+0000","last_undegraded":"2023-07-21T22:34:22.970000+0000","last_fullsized":"2023-07-21T22:34:22.970000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.969651+0000","last_change":"2023-07-21T22:34:22.967847+0000","last_active":"2023-07-21T22:34:22.969651+0000","last_peered":"2023-07-21T22:34:22.969651+0000","last_clean":"2023-07-21T22:34:22.969651+0000","last_became_active":"2023-07-21T22:34:22.967434+0000","last_became_peered":"2023-07-21T22:34:22.967434+0000","last_unstale":"2023-07-21T22:34:22.969651+0000","last_undegraded":"2023-07-21T22:34:22.969651+0000","last_fullsized":"2023-07-21T22:34:22.969651+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:44.868411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.959025+0000","last_change":"2023-07-21T22:34:22.959025+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.959025+0000","last_undegraded":"2023-07-21T22:34:22.959025+0000","last_fullsized":"2023-07-21T22:34:22.959025+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.977760+0000","last_change":"2023-07-21T22:34:22.976249+0000","last_active":"2023-07-21T22:34:22.977760+0000","last_peered":"2023-07-21T22:34:22.977760+0000","last_clean":"2023-07-21T22:34:22.977760+0000","last_became_active":"2023-07-21T22:34:22.975817+0000","last_became_peered":"2023-07-21T22:34:22.975817+0000","last_unstale":"2023-07-21T22:34:22.977760+0000","last_undegraded":"2023-07-21T22:34:22.977760+0000","last_fullsized":"2023-07-21T22:34:22.977760+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:15:56.139290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.966153+0000","last_change":"2023-07-21T22:34:22.966153+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.966153+0000","last_undegraded":"2023-07-21T22:34:22.966153+0000","last_fullsized":"2023-07-21T22:34:22.966153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.978805+0000","last_change":"2023-07-21T22:34:22.976771+0000","last_active":"2023-07-21T22:34:22.978805+0000","last_peered":"2023-07-21T22:34:22.978805+0000","last_clean":"2023-07-21T22:34:22.978805+0000","last_became_active":"2023-07-21T22:34:22.976478+0000","last_became_peered":"2023-07-21T22:34:22.976478+0000","last_unstale":"2023-07-21T22:34:22.978805+0000","last_undegraded":"2023-07-21T22:34:22.978805+0000","last_fullsized":"2023-07-21T22:34:22.978805+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:05:09.796569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.972967+0000","last_change":"2023-07-21T22:34:22.972967+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.972967+0000","last_undegraded":"2023-07-21T22:34:22.972967+0000","last_fullsized":"2023-07-21T22:34:22.972967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.973819+0000","last_change":"2023-07-21T22:34:22.971793+0000","last_active":"2023-07-21T22:34:22.973819+0000","last_peered":"2023-07-21T22:34:22.973819+0000","last_clean":"2023-07-21T22:34:22.973819+0000","last_became_active":"2023-07-21T22:34:22.971485+0000","last_became_peered":"2023-07-21T22:34:22.971485+0000","last_unstale":"2023-07-21T22:34:22.973819+0000","last_undegraded":"2023-07-21T22:34:22.973819+0000","last_fullsized":"2023-07-21T22:34:22.973819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:22:11.349369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"72'161","reported_seq":436,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.975168+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:34:22.975168+0000","last_peered":"2023-07-21T22:34:22.975168+0000","last_clean":"2023-07-21T22:34:22.975168+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:34:22.975168+0000","last_undegraded":"2023-07-21T22:34:22.975168+0000","last_fullsized":"2023-07-21T22:34:22.975168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:46:27.179436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":134,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.973841+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:34:22.973841+0000","last_peered":"2023-07-21T22:34:22.973841+0000","last_clean":"2023-07-21T22:34:22.973841+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:34:22.973841+0000","last_undegraded":"2023-07-21T22:34:22.973841+0000","last_fullsized":"2023-07-21T22:34:22.973841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:41:19.821082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.964867+0000","last_change":"2023-07-21T22:34:22.964867+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.964867+0000","last_undegraded":"2023-07-21T22:34:22.964867+0000","last_fullsized":"2023-07-21T22:34:22.964867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.979996+0000","last_change":"2023-07-21T22:34:22.978762+0000","last_active":"2023-07-21T22:34:22.979996+0000","last_peered":"2023-07-21T22:34:22.979996+0000","last_clean":"2023-07-21T22:34:22.979996+0000","last_became_active":"2023-07-21T22:34:22.978367+0000","last_became_peered":"2023-07-21T22:34:22.978367+0000","last_unstale":"2023-07-21T22:34:22.979996+0000","last_undegraded":"2023-07-21T22:34:22.979996+0000","last_fullsized":"2023-07-21T22:34:22.979996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:10:17.406840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.975023+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:34:22.975023+0000","last_peered":"2023-07-21T22:34:22.975023+0000","last_clean":"2023-07-21T22:34:22.975023+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:34:22.975023+0000","last_undegraded":"2023-07-21T22:34:22.975023+0000","last_fullsized":"2023-07-21T22:34:22.975023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:27:19.100104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.966137+0000","last_change":"2023-07-21T22:34:22.966137+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.966137+0000","last_undegraded":"2023-07-21T22:34:22.966137+0000","last_fullsized":"2023-07-21T22:34:22.966137+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.983387+0000","last_change":"2023-07-21T22:34:22.977887+0000","last_active":"2023-07-21T22:34:22.983387+0000","last_peered":"2023-07-21T22:34:22.983387+0000","last_clean":"2023-07-21T22:34:22.983387+0000","last_became_active":"2023-07-21T22:34:22.977599+0000","last_became_peered":"2023-07-21T22:34:22.977599+0000","last_unstale":"2023-07-21T22:34:22.983387+0000","last_undegraded":"2023-07-21T22:34:22.983387+0000","last_fullsized":"2023-07-21T22:34:22.983387+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:49:14.669970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":120,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.965779+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:34:22.965779+0000","last_peered":"2023-07-21T22:34:22.965779+0000","last_clean":"2023-07-21T22:34:22.965779+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:34:22.965779+0000","last_undegraded":"2023-07-21T22:34:22.965779+0000","last_fullsized":"2023-07-21T22:34:22.965779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:59:15.005858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.971203+0000","last_change":"2023-07-21T22:34:22.971203+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.971203+0000","last_undegraded":"2023-07-21T22:34:22.971203+0000","last_fullsized":"2023-07-21T22:34:22.971203+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.982560+0000","last_change":"2023-07-21T22:34:22.981350+0000","last_active":"2023-07-21T22:34:22.982560+0000","last_peered":"2023-07-21T22:34:22.982560+0000","last_clean":"2023-07-21T22:34:22.982560+0000","last_became_active":"2023-07-21T22:34:22.981023+0000","last_became_peered":"2023-07-21T22:34:22.981023+0000","last_unstale":"2023-07-21T22:34:22.982560+0000","last_undegraded":"2023-07-21T22:34:22.982560+0000","last_fullsized":"2023-07-21T22:34:22.982560+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:31:22.360596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":134,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.969433+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:34:22.969433+0000","last_peered":"2023-07-21T22:34:22.969433+0000","last_clean":"2023-07-21T22:34:22.969433+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:34:22.969433+0000","last_undegraded":"2023-07-21T22:34:22.969433+0000","last_fullsized":"2023-07-21T22:34:22.969433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:14:54.887911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.972267+0000","last_change":"2023-07-21T22:34:22.972267+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.972267+0000","last_undegraded":"2023-07-21T22:34:22.972267+0000","last_fullsized":"2023-07-21T22:34:22.972267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.983318+0000","last_change":"2023-07-21T22:34:22.978160+0000","last_active":"2023-07-21T22:34:22.983318+0000","last_peered":"2023-07-21T22:34:22.983318+0000","last_clean":"2023-07-21T22:34:22.983318+0000","last_became_active":"2023-07-21T22:34:22.977862+0000","last_became_peered":"2023-07-21T22:34:22.977862+0000","last_unstale":"2023-07-21T22:34:22.983318+0000","last_undegraded":"2023-07-21T22:34:22.983318+0000","last_fullsized":"2023-07-21T22:34:22.983318+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:59:01.611604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":130,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.956755+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:34:22.956755+0000","last_peered":"2023-07-21T22:34:22.956755+0000","last_clean":"2023-07-21T22:34:22.956755+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:34:22.956755+0000","last_undegraded":"2023-07-21T22:34:22.956755+0000","last_fullsized":"2023-07-21T22:34:22.956755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:11:00.189296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.970837+0000","last_change":"2023-07-21T22:34:22.970837+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.970837+0000","last_undegraded":"2023-07-21T22:34:22.970837+0000","last_fullsized":"2023-07-21T22:34:22.970837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.988827+0000","last_change":"2023-07-21T22:34:22.987856+0000","last_active":"2023-07-21T22:34:22.988827+0000","last_peered":"2023-07-21T22:34:22.988827+0000","last_clean":"2023-07-21T22:34:22.988827+0000","last_became_active":"2023-07-21T22:34:22.987572+0000","last_became_peered":"2023-07-21T22:34:22.987572+0000","last_unstale":"2023-07-21T22:34:22.988827+0000","last_undegraded":"2023-07-21T22:34:22.988827+0000","last_fullsized":"2023-07-21T22:34:22.988827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:03:52.170931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":124,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.976477+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:34:22.976477+0000","last_peered":"2023-07-21T22:34:22.976477+0000","last_clean":"2023-07-21T22:34:22.976477+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:34:22.976477+0000","last_undegraded":"2023-07-21T22:34:22.976477+0000","last_fullsized":"2023-07-21T22:34:22.976477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:52:26.545137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.971005+0000","last_change":"2023-07-21T22:34:22.971005+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.971005+0000","last_undegraded":"2023-07-21T22:34:22.971005+0000","last_fullsized":"2023-07-21T22:34:22.971005+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.986696+0000","last_change":"2023-07-21T22:34:22.983383+0000","last_active":"2023-07-21T22:34:22.986696+0000","last_peered":"2023-07-21T22:34:22.986696+0000","last_clean":"2023-07-21T22:34:22.986696+0000","last_became_active":"2023-07-21T22:34:22.982810+0000","last_became_peered":"2023-07-21T22:34:22.982810+0000","last_unstale":"2023-07-21T22:34:22.986696+0000","last_undegraded":"2023-07-21T22:34:22.986696+0000","last_fullsized":"2023-07-21T22:34:22.986696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:50:18.545123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":130,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.956416+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:34:22.956416+0000","last_peered":"2023-07-21T22:34:22.956416+0000","last_clean":"2023-07-21T22:34:22.956416+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:34:22.956416+0000","last_undegraded":"2023-07-21T22:34:22.956416+0000","last_fullsized":"2023-07-21T22:34:22.956416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:49:28.133865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.969581+0000","last_change":"2023-07-21T22:34:22.969581+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.969581+0000","last_undegraded":"2023-07-21T22:34:22.969581+0000","last_fullsized":"2023-07-21T22:34:22.969581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.984208+0000","last_change":"2023-07-21T22:34:22.983391+0000","last_active":"2023-07-21T22:34:22.984208+0000","last_peered":"2023-07-21T22:34:22.984208+0000","last_clean":"2023-07-21T22:34:22.984208+0000","last_became_active":"2023-07-21T22:34:22.983074+0000","last_became_peered":"2023-07-21T22:34:22.983074+0000","last_unstale":"2023-07-21T22:34:22.984208+0000","last_undegraded":"2023-07-21T22:34:22.984208+0000","last_fullsized":"2023-07-21T22:34:22.984208+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:05:09.796569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":122,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.970473+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:34:22.970473+0000","last_peered":"2023-07-21T22:34:22.970473+0000","last_clean":"2023-07-21T22:34:22.970473+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:34:22.970473+0000","last_undegraded":"2023-07-21T22:34:22.970473+0000","last_fullsized":"2023-07-21T22:34:22.970473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:48:28.934992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509631,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54732,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317108,"statfs":{"total":96636764160,"available":96580718592,"internally_reserved":0,"allocated":1576960,"data_stored":1074115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.752,"15min":0.73999999999999999},"min":{"1min":0.53600000000000003,"5min":0.35299999999999998,"15min":0.32600000000000001},"max":{"1min":0.96399999999999997,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71499999999999997,"15min":0.69599999999999995},"min":{"1min":0.55300000000000005,"5min":0.39500000000000002,"15min":0.36099999999999999},"max":{"1min":0.94399999999999995,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.63}]},{"osd":1,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.73699999999999999},"min":{"1min":0.46800000000000003,"5min":0.432,"15min":0.379},"max":{"1min":1.0680000000000001,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.56799999999999995,"5min":0.44,"15min":0.44},"max":{"1min":0.95099999999999996,"5min":1.0129999999999999,"15min":1.0409999999999999},"last":0.73999999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73799999999999999,"15min":0.74299999999999999},"min":{"1min":0.53100000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.405},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73599999999999999,"15min":0.752},"min":{"1min":0.59399999999999997,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94599999999999995,"5min":1.409,"15min":1.409},"last":0.78700000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.754,"15min":0.76600000000000001},"min":{"1min":0.58399999999999996,"5min":0.504,"15min":0.42099999999999999},"max":{"1min":1.0409999999999999,"5min":1.46,"15min":1.46},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.75900000000000001,"15min":0.75800000000000001},"min":{"1min":0.63400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54900000000000004,"15min":0.56200000000000006},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.90000000000000002,"5min":0.90500000000000003,"15min":1.244},"last":0.495},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.62,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97399999999999998,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63800000000000001,"15min":0.61899999999999999},"min":{"1min":0.51800000000000002,"5min":0.40400000000000003,"15min":0.40300000000000002},"max":{"1min":0.81200000000000006,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66300000000000003,"15min":0.68000000000000005},"min":{"1min":0.49299999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91300000000000003,"5min":1.506,"15min":1.506},"last":0.71699999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.66900000000000004,"15min":0.68000000000000005},"min":{"1min":0.57099999999999995,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93999999999999995,"5min":0.94399999999999995,"15min":1.048},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61699999999999999,"15min":0.63900000000000001},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.98599999999999999},"last":0.58099999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542337,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":983040,"data_stored":483747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76700000000000002,"15min":0.76500000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.425},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.59199999999999997,"5min":0.57899999999999996,"15min":0.437},"max":{"1min":1.0289999999999999,"5min":1.1180000000000001,"15min":2.3100000000000001},"last":0.90400000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.55700000000000005,"5min":0.45300000000000001,"15min":0.41999999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.99199999999999999,"5min":0.99399999999999999,"15min":8.6280000000000001},"last":0.80600000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.55600000000000005,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.55},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.80700000000000005,"15min":0.79600000000000004},"min":{"1min":0.59699999999999998,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":1.097,"15min":1.097},"last":0.753}]},{"osd":3,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.60399999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.7470000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.58399999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92800000000000005,"5min":1.0049999999999999,"15min":1.5129999999999999},"last":0.72899999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.374,"15min":0.36599999999999999},"max":{"1min":0.93400000000000005,"5min":1.0229999999999999,"15min":3.1829999999999998},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.80100000000000005,"5min":0.86199999999999999,"15min":2.887},"last":0.871}]},{"osd":5,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60899999999999999,"15min":0.61899999999999999},"min":{"1min":0.437,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82799999999999996,"5min":0.96299999999999997,"15min":1.4510000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.50900000000000001,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.88400000000000001,"5min":0.98799999999999999,"15min":1.054},"last":0.85899999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.52400000000000002,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":0.93600000000000005,"5min":1.079,"15min":1.1679999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68899999999999995,"15min":0.71499999999999997},"min":{"1min":0.54100000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82499999999999996,"5min":1.0449999999999999,"15min":8.0760000000000005},"last":0.83799999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509630,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":970752,"data_stored":477083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72799999999999998,"15min":0.71599999999999997},"min":{"1min":0.53000000000000003,"5min":0.35699999999999998,"15min":0.32900000000000001},"max":{"1min":1,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47599999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.59999999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69399999999999995,"15min":0.71399999999999997},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.505,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":1.617,"15min":1.617},"last":0.67600000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71799999999999997,"15min":0.73599999999999999},"min":{"1min":0.53300000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.92800000000000005,"5min":1.0109999999999999,"15min":1.034},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.53300000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.90800000000000003,"5min":1.512,"15min":1.512},"last":0.86399999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.77200000000000002,"15min":0.78700000000000003},"min":{"1min":0.61299999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98599999999999999,"5min":1.472,"15min":1.472},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.80300000000000005,"15min":0.79700000000000004},"min":{"1min":0.56899999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.022,"5min":1.556,"15min":1.556},"last":0.90800000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.48899999999999999,"5min":0.48599999999999999,"15min":0.44900000000000001},"max":{"1min":0.92400000000000004,"5min":1.012,"15min":1.038},"last":0.88200000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70499999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.62,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92500000000000004,"5min":1.02,"15min":1.02},"last":0.747}]},{"osd":7,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.64800000000000002,"15min":0.65200000000000002},"min":{"1min":0.55500000000000005,"5min":0.374,"15min":0.374},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.72499999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.85899999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.999}]}]},{"osd":4,"up_from":15,"seq":64424509631,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":970752,"data_stored":477083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.746,"15min":0.747},"min":{"1min":0.55700000000000005,"5min":0.438,"15min":0.40000000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.0429999999999999},"last":0.623},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.746,"15min":0.746},"min":{"1min":0.55000000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95099999999999996,"5min":0.96099999999999997,"15min":0.99099999999999999},"last":0.65000000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70499999999999996,"15min":0.70399999999999996},"min":{"1min":0.53400000000000003,"5min":0.43099999999999999,"15min":0.39400000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.0449999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.60899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93000000000000005,"5min":0.94299999999999995,"15min":1.016},"last":0.67200000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.59299999999999997,"5min":0.371,"15min":0.371},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.57799999999999996,"5min":0.41999999999999998,"15min":0.33000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.505,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":1.026},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.80200000000000005,"15min":0.79200000000000004},"min":{"1min":0.70399999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.996,"5min":0.996,"15min":1.018},"last":0.871}]},{"osd":5,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.441,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72299999999999998,"5min":0.81599999999999995,"15min":0.94299999999999995},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.59299999999999997},"min":{"1min":0.38800000000000001,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.79600000000000004,"5min":0.91000000000000003,"15min":1.0680000000000001},"last":0.59499999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.45800000000000002,"5min":0.41299999999999998,"15min":0.38500000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70099999999999996,"15min":0.72599999999999998},"min":{"1min":0.52200000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91400000000000003,"5min":0.98999999999999999,"15min":1.272},"last":0.83399999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.628,"15min":0.65800000000000003},"min":{"1min":0.499,"5min":0.39200000000000002,"15min":0.374},"max":{"1min":0.91300000000000003,"5min":1.0069999999999999,"15min":1.3300000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68000000000000005,"15min":0.69299999999999995},"min":{"1min":0.53100000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.135},"last":0.81399999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509630,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":970752,"data_stored":477083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.48799999999999999,"15min":0.48099999999999998},"min":{"1min":0.35099999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70499999999999996,"5min":0.73099999999999998,"15min":0.76400000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.43099999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.30099999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.871},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.94199999999999995},"last":0.30199999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82899999999999996,"5min":1.0449999999999999,"15min":1.1140000000000001},"last":0.378},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45500000000000002,"5min":0.45100000000000001,"15min":0.40999999999999998},"max":{"1min":0.84399999999999997,"5min":0.95399999999999996,"15min":0.99199999999999999},"last":0.41399999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.57599999999999996,"5min":0.48299999999999998,"15min":0.438},"max":{"1min":1.093,"5min":1.093,"15min":1.3240000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82199999999999995,"15min":0.83299999999999996},"min":{"1min":0.68799999999999994,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.488},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.60699999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0669999999999999,"5min":1.137,"15min":1.1919999999999999},"last":0.501},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.60399999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0649999999999999,"15min":1.302},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79200000000000004,"15min":0.80100000000000005},"min":{"1min":0.68000000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.02,"5min":1.056,"15min":1.3979999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76500000000000001,"15min":0.78000000000000003},"min":{"1min":0.56899999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0269999999999999,"5min":1.1120000000000001,"15min":1.3899999999999999},"last":0.53100000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.81000000000000005,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0089999999999999,"5min":1.087,"15min":1.335},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.873,"5min":0.83699999999999997,"15min":0.83499999999999996},"min":{"1min":0.66100000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.2130000000000001},"last":0.69099999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509632,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54152,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317688,"statfs":{"total":96636764160,"available":96581312512,"internally_reserved":0,"allocated":983040,"data_stored":483747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.29099999999999998,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.69399999999999995,"5min":0.81200000000000006,"15min":0.94199999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53600000000000003,"15min":0.54900000000000004},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.88300000000000001,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.28199999999999997},"max":{"1min":0.82999999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80700000000000005,"5min":1.085,"15min":1.085},"last":0.48699999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.37,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.379},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55300000000000005,"15min":0.56899999999999995},"min":{"1min":0.43099999999999999,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":1.161,"15min":1.161},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.67600000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.1579999999999999,"5min":1.2569999999999999,"15min":1.6870000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.79400000000000004,"15min":0.80200000000000005},"min":{"1min":0.57699999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.175,"5min":1.1950000000000001,"15min":1.2689999999999999},"last":0.60799999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.63200000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.2549999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.60599999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.107,"5min":1.206,"15min":1.3089999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.78600000000000003,"15min":0.79800000000000004},"min":{"1min":0.69399999999999995,"5min":0.45500000000000002,"15min":0.40300000000000002},"max":{"1min":1.089,"5min":1.282,"15min":1.3759999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.64300000000000002,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.1339999999999999,"5min":1.23,"15min":1.2649999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.80900000000000005,"15min":0.82899999999999996},"min":{"1min":0.64900000000000002,"5min":0.51100000000000001,"15min":0.49099999999999999},"max":{"1min":1.143,"5min":1.2,"15min":1.2909999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.60999999999999999,"5min":0.44900000000000001,"15min":0.44700000000000001},"max":{"1min":1.091,"5min":1.216,"15min":1.3660000000000001},"last":0.68899999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509631,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":983040,"data_stored":483747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48899999999999999,"15min":0.504},"min":{"1min":0.32600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.66700000000000004,"5min":0.84599999999999997,"15min":5.4800000000000004},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.58799999999999997},"min":{"1min":0.49399999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.872,"15min":5.2830000000000004},"last":0.626}]},{"osd":2,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.39900000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72999999999999998,"5min":0.76100000000000001,"15min":3.4220000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.29099999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.88800000000000001},"last":0.68500000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59499999999999997,"15min":0.60999999999999999},"min":{"1min":0.48899999999999999,"5min":0.35799999999999998,"15min":0.33400000000000002},"max":{"1min":0.73499999999999999,"5min":0.84299999999999997,"15min":3.2469999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51700000000000002,"15min":0.53700000000000003},"min":{"1min":0.36799999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":5.8710000000000004},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.58699999999999997,"5min":0.432,"15min":0.432},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":3.6259999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.63100000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.97399999999999998,"5min":1.083,"15min":4.4100000000000001},"last":0.77000000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.77600000000000002,"15min":0.80200000000000005},"min":{"1min":0.64800000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0609999999999999,"5min":1.115,"15min":5.766},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.80100000000000005,"15min":0.81299999999999994},"min":{"1min":0.57899999999999996,"5min":0.376,"15min":0.376},"max":{"1min":1.0980000000000001,"5min":1.1279999999999999,"15min":3.669},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.66700000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0429999999999999,"5min":1.085,"15min":1.23},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77800000000000002,"15min":0.81499999999999995},"min":{"1min":0.55100000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.083,"5min":1.1020000000000001,"15min":5.8200000000000003},"last":0.747}]},{"osd":7,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.79800000000000004,"15min":0.83099999999999996},"min":{"1min":0.59599999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.028,"5min":1.103,"15min":5.9269999999999996},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.60299999999999998,"5min":0.52600000000000002,"15min":0.45700000000000002},"max":{"1min":1.115,"5min":1.115,"15min":3.5800000000000001},"last":0.78900000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509633,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1576960,"data_stored":1074115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.50800000000000001},"min":{"1min":0.35899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.67900000000000005,"5min":0.77800000000000002,"15min":0.83199999999999996},"last":0.502}]},{"osd":2,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70999999999999996,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.44,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58199999999999996,"5min":0.871,"15min":0.871},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.35899999999999999,"15min":0.34899999999999998},"max":{"1min":0.76500000000000001,"5min":0.88100000000000001,"15min":0.91300000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.434,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73999999999999999,"5min":1.038,"15min":1.038},"last":0.55300000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.76100000000000001,"15min":0.78100000000000003},"min":{"1min":0.59299999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.321},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.60099999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.093,"5min":1.423,"15min":1.423},"last":0.97299999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.60299999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0960000000000001,"5min":1.2669999999999999,"15min":1.28},"last":1.036},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.78400000000000003,"15min":0.80900000000000005},"min":{"1min":0.70599999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.393},"last":0.95699999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78500000000000003,"15min":0.81299999999999994},"min":{"1min":0.61799999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.28},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81399999999999995,"15min":0.81999999999999995},"min":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.131,"5min":1.333,"15min":1.333},"last":0.92600000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.65900000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.2310000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.80900000000000005,"15min":0.83399999999999996},"min":{"1min":0.60599999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1930000000000001,"5min":1.296,"15min":1.369},"last":0.90500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:34:28.149 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:34:28.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.279+0000 7f72e1219640 1 Processor -- start 2023-07-21T22:34:28.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.279+0000 7f72e1219640 1 -- start start 2023-07-21T22:34:28.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.279+0000 7f72e1219640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f72dc15f3f0 0x7f72dc0b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:28.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.283+0000 7f72e1219640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f72dc0b7bc0 0x7f72dc0cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:28.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.283+0000 7f72e1219640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72dc0b8020 con 0x7f72dc0d13f0 2023-07-21T22:34:28.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.283+0000 7f72e1219640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72dc0d0f60 con 0x7f72dc0b7bc0 2023-07-21T22:34:28.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.283+0000 7f72e1219640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72dc0d0390 con 0x7f72dc15f3f0 2023-07-21T22:34:28.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.283+0000 7f72e0a18640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f72dc0b7bc0 0x7f72dc0cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:28.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.283+0000 7f72e0a18640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f72dc0b7bc0 0x7f72dc0cd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54108/0 (socket says 172.21.15.6:54108) 2023-07-21T22:34:28.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.283+0000 7f72e0a18640 1 -- 172.21.15.6:0/867791161 learned_addr learned my addr 172.21.15.6:0/867791161 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:28.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.283+0000 7f72dbfff640 1 --2- 172.21.15.6:0/867791161 >> v2:172.21.15.161:3300/0 conn(0x7f72dc15f3f0 0x7f72dc0b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:28.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.283+0000 7f72e0a18640 1 -- 172.21.15.6:0/867791161 >> v2:172.21.15.161:3300/0 conn(0x7f72dc15f3f0 msgr2=0x7f72dc0b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:28.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.283+0000 7f72e0a18640 1 --2- 172.21.15.6:0/867791161 >> v2:172.21.15.161:3300/0 conn(0x7f72dc15f3f0 0x7f72dc0b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.283+0000 7f72e0a18640 1 -- 172.21.15.6:0/867791161 >> v1:172.21.15.161:6789/0 conn(0x7f72dc0d13f0 legacy=0x7f72dc0cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:28.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.283+0000 7f72e0a18640 1 -- 172.21.15.6:0/867791161 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc0d0630 con 0x7f72dc0b7bc0 2023-07-21T22:34:28.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.283+0000 7f72e0a18640 1 --2- 172.21.15.6:0/867791161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc0b7bc0 0x7f72dc0cd0b0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0cf890 tx=0x7f72d401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6408e1197666ec server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:28.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.283+0000 7f72daffd640 1 -- 172.21.15.6:0/867791161 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d40a56f0 con 0x7f72dc0b7bc0 2023-07-21T22:34:28.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72daffd640 1 -- 172.21.15.6:0/867791161 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d40a5850 con 0x7f72dc0b7bc0 2023-07-21T22:34:28.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72daffd640 1 -- 172.21.15.6:0/867791161 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d40a5be0 con 0x7f72dc0b7bc0 2023-07-21T22:34:28.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72e1219640 1 -- 172.21.15.6:0/867791161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc0b7bc0 msgr2=0x7f72dc0cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:28.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72e1219640 1 --2- 172.21.15.6:0/867791161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc0b7bc0 0x7f72dc0cd0b0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0cf890 tx=0x7f72d401c940 comp rx=0 tx=0).stop 2023-07-21T22:34:28.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72e1219640 1 -- 172.21.15.6:0/867791161 shutdown_connections 2023-07-21T22:34:28.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72e1219640 1 --2- 172.21.15.6:0/867791161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc0b7bc0 0x7f72dc0cd0b0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72e1219640 1 --2- 172.21.15.6:0/867791161 >> v2:172.21.15.161:3300/0 conn(0x7f72dc15f3f0 0x7f72dc0b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72e1219640 1 -- 172.21.15.6:0/867791161 >> 172.21.15.6:0/867791161 conn(0x7f72dc069f50 msgr2=0x7f72dc06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:28.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72e1219640 1 -- 172.21.15.6:0/867791161 shutdown_connections 2023-07-21T22:34:28.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72e1219640 1 -- 172.21.15.6:0/867791161 wait complete. 2023-07-21T22:34:28.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72e1219640 1 Processor -- start 2023-07-21T22:34:28.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72e1219640 1 -- start start 2023-07-21T22:34:28.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72e1219640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc0b7bc0 0x7f72dc154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:28.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72e1219640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72dc0d13f0 0x7f72dc154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:28.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72e1219640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72dc15f3f0 0x7f72dc159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:28.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72e1219640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc155cb0 con 0x7f72dc0b7bc0 2023-07-21T22:34:28.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72e1219640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc1550a0 con 0x7f72dc15f3f0 2023-07-21T22:34:28.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72e1219640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc155380 con 0x7f72dc0d13f0 2023-07-21T22:34:28.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72dbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc0b7bc0 0x7f72dc154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:28.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72dbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc0b7bc0 0x7f72dc154ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54110/0 (socket says 172.21.15.6:54110) 2023-07-21T22:34:28.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.287+0000 7f72dbfff640 1 -- 172.21.15.6:0/3795244208 learned_addr learned my addr 172.21.15.6:0/3795244208 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:28.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.291+0000 7f72e0a18640 1 --2- 172.21.15.6:0/3795244208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72dc15f3f0 0x7f72dc159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:28.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.291+0000 7f72db7fe640 1 --2- 172.21.15.6:0/3795244208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72dc0d13f0 0x7f72dc154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:28.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.291+0000 7f72dbfff640 1 -- 172.21.15.6:0/3795244208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72dc0d13f0 msgr2=0x7f72dc154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:28.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.291+0000 7f72dbfff640 1 --2- 172.21.15.6:0/3795244208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72dc0d13f0 0x7f72dc154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.291+0000 7f72dbfff640 1 -- 172.21.15.6:0/3795244208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72dc15f3f0 msgr2=0x7f72dc159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:28.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.291+0000 7f72dbfff640 1 --2- 172.21.15.6:0/3795244208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72dc15f3f0 0x7f72dc159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.291+0000 7f72dbfff640 1 -- 172.21.15.6:0/3795244208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d4009b30 con 0x7f72dc0b7bc0 2023-07-21T22:34:28.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.291+0000 7f72db7fe640 1 --2- 172.21.15.6:0/3795244208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72dc0d13f0 0x7f72dc154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:28.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.291+0000 7f72dbfff640 1 --2- 172.21.15.6:0/3795244208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc0b7bc0 0x7f72dc154ac0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00e870 tx=0x7f72cc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:28.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.291+0000 7f72d8ff9640 1 -- 172.21.15.6:0/3795244208 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc009510 con 0x7f72dc0b7bc0 2023-07-21T22:34:28.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.291+0000 7f72d8ff9640 1 -- 172.21.15.6:0/3795244208 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc00eec0 con 0x7f72dc0b7bc0 2023-07-21T22:34:28.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.291+0000 7f72d8ff9640 1 -- 172.21.15.6:0/3795244208 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc00cb40 con 0x7f72dc0b7bc0 2023-07-21T22:34:28.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.291+0000 7f72e1219640 1 -- 172.21.15.6:0/3795244208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72dc155660 con 0x7f72dc0b7bc0 2023-07-21T22:34:28.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.291+0000 7f72e1219640 1 -- 172.21.15.6:0/3795244208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72dc154660 con 0x7f72dc0b7bc0 2023-07-21T22:34:28.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.291+0000 7f72e1219640 1 -- 172.21.15.6:0/3795244208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72dc0678d0 con 0x7f72dc0b7bc0 2023-07-21T22:34:28.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.291+0000 7f72d8ff9640 1 -- 172.21.15.6:0/3795244208 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f72cc00cca0 con 0x7f72dc0b7bc0 2023-07-21T22:34:28.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.291+0000 7f72d8ff9640 1 --2- 172.21.15.6:0/3795244208 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f72c80663a0 0x7f72c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:28.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.291+0000 7f72d8ff9640 1 -- 172.21.15.6:0/3795244208 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f72cc083ff0 con 0x7f72dc0b7bc0 2023-07-21T22:34:28.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.295+0000 7f72db7fe640 1 --2- 172.21.15.6:0/3795244208 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f72c80663a0 0x7f72c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:28.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.295+0000 7f72db7fe640 1 --2- 172.21.15.6:0/3795244208 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f72c80663a0 0x7f72c8068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f72dc1f7620 tx=0x7f72d0009040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:28.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.295+0000 7f72d8ff9640 1 -- 172.21.15.6:0/3795244208 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72cc0b4700 con 0x7f72dc0b7bc0 2023-07-21T22:34:28.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.451+0000 7f72e1219640 1 -- 172.21.15.6:0/3795244208 --> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f72dc15f7c0 con 0x7f72c80663a0 2023-07-21T22:34:28.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.463+0000 7f72d8ff9640 1 -- 172.21.15.6:0/3795244208 <== mgr.5768 v2:172.21.15.161:6832/3045187557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305752 (secure 0 0 0) 0x7f72d0001cc0 con 0x7f72c80663a0 2023-07-21T22:34:28.511 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:28.513 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:34:28.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.463+0000 7f72e1219640 1 -- 172.21.15.6:0/3795244208 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f72c80663a0 msgr2=0x7f72c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:28.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.463+0000 7f72e1219640 1 --2- 172.21.15.6:0/3795244208 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f72c80663a0 0x7f72c8068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f72dc1f7620 tx=0x7f72d0009040 comp rx=0 tx=0).stop 2023-07-21T22:34:28.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.463+0000 7f72e1219640 1 -- 172.21.15.6:0/3795244208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc0b7bc0 msgr2=0x7f72dc154ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:28.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.463+0000 7f72e1219640 1 --2- 172.21.15.6:0/3795244208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc0b7bc0 0x7f72dc154ac0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00e870 tx=0x7f72cc00ec70 comp rx=0 tx=0).stop 2023-07-21T22:34:28.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.463+0000 7f72e1219640 1 -- 172.21.15.6:0/3795244208 shutdown_connections 2023-07-21T22:34:28.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.463+0000 7f72e1219640 1 --2- 172.21.15.6:0/3795244208 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f72c80663a0 0x7f72c8068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.463+0000 7f72e1219640 1 --2- 172.21.15.6:0/3795244208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72dc15f3f0 0x7f72dc159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.463+0000 7f72e1219640 1 --2- 172.21.15.6:0/3795244208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72dc0d13f0 0x7f72dc154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.463+0000 7f72e1219640 1 --2- 172.21.15.6:0/3795244208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72dc0b7bc0 0x7f72dc154ac0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.463+0000 7f72e1219640 1 -- 172.21.15.6:0/3795244208 >> 172.21.15.6:0/3795244208 conn(0x7f72dc069f50 msgr2=0x7f72dc0b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:28.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.463+0000 7f72e1219640 1 -- 172.21.15.6:0/3795244208 shutdown_connections 2023-07-21T22:34:28.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.463+0000 7f72e1219640 1 -- 172.21.15.6:0/3795244208 wait complete. 2023-07-21T22:34:28.532 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-21T22:34:27.633929+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":301476,"kb_used_data":8804,"kb_used_omap":0,"kb_used_meta":292608,"kb_avail":754673244,"statfs":{"total":773094113280,"available":772785401856,"internally_reserved":0,"allocated":9015296,"data_stored":5030720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":299630592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.682484"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.960487+0000","last_change":"2023-07-21T22:34:22.960487+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.960487+0000","last_undegraded":"2023-07-21T22:34:22.960487+0000","last_fullsized":"2023-07-21T22:34:22.960487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.959374+0000","last_change":"2023-07-21T22:34:22.959374+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.959374+0000","last_undegraded":"2023-07-21T22:34:22.959374+0000","last_fullsized":"2023-07-21T22:34:22.959374+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.971829+0000","last_change":"2023-07-21T22:34:22.971829+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.971829+0000","last_undegraded":"2023-07-21T22:34:22.971829+0000","last_fullsized":"2023-07-21T22:34:22.971829+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.973347+0000","last_change":"2023-07-21T22:34:22.973347+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.973347+0000","last_undegraded":"2023-07-21T22:34:22.973347+0000","last_fullsized":"2023-07-21T22:34:22.973347+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.973406+0000","last_change":"2023-07-21T22:34:22.973406+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.973406+0000","last_undegraded":"2023-07-21T22:34:22.973406+0000","last_fullsized":"2023-07-21T22:34:22.973406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.964323+0000","last_change":"2023-07-21T22:34:22.964323+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.964323+0000","last_undegraded":"2023-07-21T22:34:22.964323+0000","last_fullsized":"2023-07-21T22:34:22.964323+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965480+0000","last_change":"2023-07-21T22:34:22.965480+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965480+0000","last_undegraded":"2023-07-21T22:34:22.965480+0000","last_fullsized":"2023-07-21T22:34:22.965480+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.964672+0000","last_change":"2023-07-21T22:34:22.964672+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.964672+0000","last_undegraded":"2023-07-21T22:34:22.964672+0000","last_fullsized":"2023-07-21T22:34:22.964672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.972662+0000","last_change":"2023-07-21T22:34:22.972662+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.972662+0000","last_undegraded":"2023-07-21T22:34:22.972662+0000","last_fullsized":"2023-07-21T22:34:22.972662+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.968212+0000","last_change":"2023-07-21T22:34:22.968212+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.968212+0000","last_undegraded":"2023-07-21T22:34:22.968212+0000","last_fullsized":"2023-07-21T22:34:22.968212+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.978022+0000","last_change":"2023-07-21T22:34:22.978022+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.978022+0000","last_undegraded":"2023-07-21T22:34:22.978022+0000","last_fullsized":"2023-07-21T22:34:22.978022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965579+0000","last_change":"2023-07-21T22:34:22.965579+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965579+0000","last_undegraded":"2023-07-21T22:34:22.965579+0000","last_fullsized":"2023-07-21T22:34:22.965579+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965320+0000","last_change":"2023-07-21T22:34:22.965320+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965320+0000","last_undegraded":"2023-07-21T22:34:22.965320+0000","last_fullsized":"2023-07-21T22:34:22.965320+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.972531+0000","last_change":"2023-07-21T22:34:22.972531+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.972531+0000","last_undegraded":"2023-07-21T22:34:22.972531+0000","last_fullsized":"2023-07-21T22:34:22.972531+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.968640+0000","last_change":"2023-07-21T22:34:22.968640+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.968640+0000","last_undegraded":"2023-07-21T22:34:22.968640+0000","last_fullsized":"2023-07-21T22:34:22.968640+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965009+0000","last_change":"2023-07-21T22:34:22.965009+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965009+0000","last_undegraded":"2023-07-21T22:34:22.965009+0000","last_fullsized":"2023-07-21T22:34:22.965009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.959901+0000","last_change":"2023-07-21T22:34:22.959901+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.959901+0000","last_undegraded":"2023-07-21T22:34:22.959901+0000","last_fullsized":"2023-07-21T22:34:22.959901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.975064+0000","last_change":"2023-07-21T22:34:22.975064+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.975064+0000","last_undegraded":"2023-07-21T22:34:22.975064+0000","last_fullsized":"2023-07-21T22:34:22.975064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.974975+0000","last_change":"2023-07-21T22:34:22.974975+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.974975+0000","last_undegraded":"2023-07-21T22:34:22.974975+0000","last_fullsized":"2023-07-21T22:34:22.974975+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.960589+0000","last_change":"2023-07-21T22:34:22.960589+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.960589+0000","last_undegraded":"2023-07-21T22:34:22.960589+0000","last_fullsized":"2023-07-21T22:34:22.960589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.964751+0000","last_change":"2023-07-21T22:34:22.964751+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.964751+0000","last_undegraded":"2023-07-21T22:34:22.964751+0000","last_fullsized":"2023-07-21T22:34:22.964751+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.962349+0000","last_change":"2023-07-21T22:34:22.962349+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.962349+0000","last_undegraded":"2023-07-21T22:34:22.962349+0000","last_fullsized":"2023-07-21T22:34:22.962349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.961322+0000","last_change":"2023-07-21T22:34:22.961322+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.961322+0000","last_undegraded":"2023-07-21T22:34:22.961322+0000","last_fullsized":"2023-07-21T22:34:22.961322+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.968031+0000","last_change":"2023-07-21T22:34:22.968031+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.968031+0000","last_undegraded":"2023-07-21T22:34:22.968031+0000","last_fullsized":"2023-07-21T22:34:22.968031+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965968+0000","last_change":"2023-07-21T22:34:22.965968+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965968+0000","last_undegraded":"2023-07-21T22:34:22.965968+0000","last_fullsized":"2023-07-21T22:34:22.965968+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965623+0000","last_change":"2023-07-21T22:34:22.965623+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965623+0000","last_undegraded":"2023-07-21T22:34:22.965623+0000","last_fullsized":"2023-07-21T22:34:22.965623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.969852+0000","last_change":"2023-07-21T22:34:22.969852+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.969852+0000","last_undegraded":"2023-07-21T22:34:22.969852+0000","last_fullsized":"2023-07-21T22:34:22.969852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.960796+0000","last_change":"2023-07-21T22:34:22.960796+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.960796+0000","last_undegraded":"2023-07-21T22:34:22.960796+0000","last_fullsized":"2023-07-21T22:34:22.960796+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.967988+0000","last_change":"2023-07-21T22:34:22.967988+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.967988+0000","last_undegraded":"2023-07-21T22:34:22.967988+0000","last_fullsized":"2023-07-21T22:34:22.967988+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965428+0000","last_change":"2023-07-21T22:34:22.965428+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965428+0000","last_undegraded":"2023-07-21T22:34:22.965428+0000","last_fullsized":"2023-07-21T22:34:22.965428+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.978018+0000","last_change":"2023-07-21T22:34:22.978018+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.978018+0000","last_undegraded":"2023-07-21T22:34:22.978018+0000","last_fullsized":"2023-07-21T22:34:22.978018+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965294+0000","last_change":"2023-07-21T22:34:22.965294+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965294+0000","last_undegraded":"2023-07-21T22:34:22.965294+0000","last_fullsized":"2023-07-21T22:34:22.965294+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.970806+0000","last_change":"2023-07-21T22:34:22.970806+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.970806+0000","last_undegraded":"2023-07-21T22:34:22.970806+0000","last_fullsized":"2023-07-21T22:34:22.970806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.980302+0000","last_change":"2023-07-21T22:34:22.979497+0000","last_active":"2023-07-21T22:34:22.980302+0000","last_peered":"2023-07-21T22:34:22.980302+0000","last_clean":"2023-07-21T22:34:22.980302+0000","last_became_active":"2023-07-21T22:34:22.979085+0000","last_became_peered":"2023-07-21T22:34:22.979085+0000","last_unstale":"2023-07-21T22:34:22.980302+0000","last_undegraded":"2023-07-21T22:34:22.980302+0000","last_fullsized":"2023-07-21T22:34:22.980302+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:30:48.994293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.969246+0000","last_change":"2023-07-21T22:34:22.969246+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.969246+0000","last_undegraded":"2023-07-21T22:34:22.969246+0000","last_fullsized":"2023-07-21T22:34:22.969246+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.982510+0000","last_change":"2023-07-21T22:34:22.981336+0000","last_active":"2023-07-21T22:34:22.982510+0000","last_peered":"2023-07-21T22:34:22.982510+0000","last_clean":"2023-07-21T22:34:22.982510+0000","last_became_active":"2023-07-21T22:34:22.981041+0000","last_became_peered":"2023-07-21T22:34:22.981041+0000","last_unstale":"2023-07-21T22:34:22.982510+0000","last_undegraded":"2023-07-21T22:34:22.982510+0000","last_fullsized":"2023-07-21T22:34:22.982510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:05:55.966697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.963558+0000","last_change":"2023-07-21T22:34:22.963558+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.963558+0000","last_undegraded":"2023-07-21T22:34:22.963558+0000","last_fullsized":"2023-07-21T22:34:22.963558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.978672+0000","last_change":"2023-07-21T22:34:22.977004+0000","last_active":"2023-07-21T22:34:22.978672+0000","last_peered":"2023-07-21T22:34:22.978672+0000","last_clean":"2023-07-21T22:34:22.978672+0000","last_became_active":"2023-07-21T22:34:22.976750+0000","last_became_peered":"2023-07-21T22:34:22.976750+0000","last_unstale":"2023-07-21T22:34:22.978672+0000","last_undegraded":"2023-07-21T22:34:22.978672+0000","last_fullsized":"2023-07-21T22:34:22.978672+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:48:45.337373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.973226+0000","last_change":"2023-07-21T22:34:22.973226+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.973226+0000","last_undegraded":"2023-07-21T22:34:22.973226+0000","last_fullsized":"2023-07-21T22:34:22.973226+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.972392+0000","last_change":"2023-07-21T22:34:22.970084+0000","last_active":"2023-07-21T22:34:22.972392+0000","last_peered":"2023-07-21T22:34:22.972392+0000","last_clean":"2023-07-21T22:34:22.972392+0000","last_became_active":"2023-07-21T22:34:22.969773+0000","last_became_peered":"2023-07-21T22:34:22.969773+0000","last_unstale":"2023-07-21T22:34:22.972392+0000","last_undegraded":"2023-07-21T22:34:22.972392+0000","last_fullsized":"2023-07-21T22:34:22.972392+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:03:38.882654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.964405+0000","last_change":"2023-07-21T22:34:22.964405+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.964405+0000","last_undegraded":"2023-07-21T22:34:22.964405+0000","last_fullsized":"2023-07-21T22:34:22.964405+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.972601+0000","last_change":"2023-07-21T22:34:22.970835+0000","last_active":"2023-07-21T22:34:22.972601+0000","last_peered":"2023-07-21T22:34:22.972601+0000","last_clean":"2023-07-21T22:34:22.972601+0000","last_became_active":"2023-07-21T22:34:22.970540+0000","last_became_peered":"2023-07-21T22:34:22.970540+0000","last_unstale":"2023-07-21T22:34:22.972601+0000","last_undegraded":"2023-07-21T22:34:22.972601+0000","last_fullsized":"2023-07-21T22:34:22.972601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:12.812980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.959151+0000","last_change":"2023-07-21T22:34:22.959151+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.959151+0000","last_undegraded":"2023-07-21T22:34:22.959151+0000","last_fullsized":"2023-07-21T22:34:22.959151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.969785+0000","last_change":"2023-07-21T22:34:22.968964+0000","last_active":"2023-07-21T22:34:22.969785+0000","last_peered":"2023-07-21T22:34:22.969785+0000","last_clean":"2023-07-21T22:34:22.969785+0000","last_became_active":"2023-07-21T22:34:22.968672+0000","last_became_peered":"2023-07-21T22:34:22.968672+0000","last_unstale":"2023-07-21T22:34:22.969785+0000","last_undegraded":"2023-07-21T22:34:22.969785+0000","last_fullsized":"2023-07-21T22:34:22.969785+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:30:48.994293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.972074+0000","last_change":"2023-07-21T22:34:22.972074+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.972074+0000","last_undegraded":"2023-07-21T22:34:22.972074+0000","last_fullsized":"2023-07-21T22:34:22.972074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.978608+0000","last_change":"2023-07-21T22:34:22.975818+0000","last_active":"2023-07-21T22:34:22.978608+0000","last_peered":"2023-07-21T22:34:22.978608+0000","last_clean":"2023-07-21T22:34:22.978608+0000","last_became_active":"2023-07-21T22:34:22.975533+0000","last_became_peered":"2023-07-21T22:34:22.975533+0000","last_unstale":"2023-07-21T22:34:22.978608+0000","last_undegraded":"2023-07-21T22:34:22.978608+0000","last_fullsized":"2023-07-21T22:34:22.978608+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:01:04.819418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.960392+0000","last_change":"2023-07-21T22:34:22.960392+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.960392+0000","last_undegraded":"2023-07-21T22:34:22.960392+0000","last_fullsized":"2023-07-21T22:34:22.960392+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.986187+0000","last_change":"2023-07-21T22:34:22.982821+0000","last_active":"2023-07-21T22:34:22.986187+0000","last_peered":"2023-07-21T22:34:22.986187+0000","last_clean":"2023-07-21T22:34:22.986187+0000","last_became_active":"2023-07-21T22:34:22.982493+0000","last_became_peered":"2023-07-21T22:34:22.982493+0000","last_unstale":"2023-07-21T22:34:22.986187+0000","last_undegraded":"2023-07-21T22:34:22.986187+0000","last_fullsized":"2023-07-21T22:34:22.986187+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:25:07.434309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.960328+0000","last_change":"2023-07-21T22:34:22.960328+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.960328+0000","last_undegraded":"2023-07-21T22:34:22.960328+0000","last_fullsized":"2023-07-21T22:34:22.960328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.988365+0000","last_change":"2023-07-21T22:34:22.984655+0000","last_active":"2023-07-21T22:34:22.988365+0000","last_peered":"2023-07-21T22:34:22.988365+0000","last_clean":"2023-07-21T22:34:22.988365+0000","last_became_active":"2023-07-21T22:34:22.984018+0000","last_became_peered":"2023-07-21T22:34:22.984018+0000","last_unstale":"2023-07-21T22:34:22.988365+0000","last_undegraded":"2023-07-21T22:34:22.988365+0000","last_fullsized":"2023-07-21T22:34:22.988365+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:06:10.217482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.960181+0000","last_change":"2023-07-21T22:34:22.960181+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.960181+0000","last_undegraded":"2023-07-21T22:34:22.960181+0000","last_fullsized":"2023-07-21T22:34:22.960181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.987231+0000","last_change":"2023-07-21T22:34:22.980664+0000","last_active":"2023-07-21T22:34:22.987231+0000","last_peered":"2023-07-21T22:34:22.987231+0000","last_clean":"2023-07-21T22:34:22.987231+0000","last_became_active":"2023-07-21T22:34:22.980400+0000","last_became_peered":"2023-07-21T22:34:22.980400+0000","last_unstale":"2023-07-21T22:34:22.987231+0000","last_undegraded":"2023-07-21T22:34:22.987231+0000","last_fullsized":"2023-07-21T22:34:22.987231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:58:26.952281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.971347+0000","last_change":"2023-07-21T22:34:22.971347+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.971347+0000","last_undegraded":"2023-07-21T22:34:22.971347+0000","last_fullsized":"2023-07-21T22:34:22.971347+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.986677+0000","last_change":"2023-07-21T22:34:22.983166+0000","last_active":"2023-07-21T22:34:22.986677+0000","last_peered":"2023-07-21T22:34:22.986677+0000","last_clean":"2023-07-21T22:34:22.986677+0000","last_became_active":"2023-07-21T22:34:22.982456+0000","last_became_peered":"2023-07-21T22:34:22.982456+0000","last_unstale":"2023-07-21T22:34:22.986677+0000","last_undegraded":"2023-07-21T22:34:22.986677+0000","last_fullsized":"2023-07-21T22:34:22.986677+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:35:17.609604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.970705+0000","last_change":"2023-07-21T22:34:22.970705+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.970705+0000","last_undegraded":"2023-07-21T22:34:22.970705+0000","last_fullsized":"2023-07-21T22:34:22.970705+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.984644+0000","last_change":"2023-07-21T22:34:22.983569+0000","last_active":"2023-07-21T22:34:22.984644+0000","last_peered":"2023-07-21T22:34:22.984644+0000","last_clean":"2023-07-21T22:34:22.984644+0000","last_became_active":"2023-07-21T22:34:22.983277+0000","last_became_peered":"2023-07-21T22:34:22.983277+0000","last_unstale":"2023-07-21T22:34:22.984644+0000","last_undegraded":"2023-07-21T22:34:22.984644+0000","last_fullsized":"2023-07-21T22:34:22.984644+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:15:56.139290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.969465+0000","last_change":"2023-07-21T22:34:22.969465+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.969465+0000","last_undegraded":"2023-07-21T22:34:22.969465+0000","last_fullsized":"2023-07-21T22:34:22.969465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.988415+0000","last_change":"2023-07-21T22:34:22.985264+0000","last_active":"2023-07-21T22:34:22.988415+0000","last_peered":"2023-07-21T22:34:22.988415+0000","last_clean":"2023-07-21T22:34:22.988415+0000","last_became_active":"2023-07-21T22:34:22.984946+0000","last_became_peered":"2023-07-21T22:34:22.984946+0000","last_unstale":"2023-07-21T22:34:22.988415+0000","last_undegraded":"2023-07-21T22:34:22.988415+0000","last_fullsized":"2023-07-21T22:34:22.988415+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:26:07.917220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.966612+0000","last_change":"2023-07-21T22:34:22.966612+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.966612+0000","last_undegraded":"2023-07-21T22:34:22.966612+0000","last_fullsized":"2023-07-21T22:34:22.966612+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.983406+0000","last_change":"2023-07-21T22:34:22.978391+0000","last_active":"2023-07-21T22:34:22.983406+0000","last_peered":"2023-07-21T22:34:22.983406+0000","last_clean":"2023-07-21T22:34:22.983406+0000","last_became_active":"2023-07-21T22:34:22.978125+0000","last_became_peered":"2023-07-21T22:34:22.978125+0000","last_unstale":"2023-07-21T22:34:22.983406+0000","last_undegraded":"2023-07-21T22:34:22.983406+0000","last_fullsized":"2023-07-21T22:34:22.983406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:33:37.265284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.971653+0000","last_change":"2023-07-21T22:34:22.971653+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.971653+0000","last_undegraded":"2023-07-21T22:34:22.971653+0000","last_fullsized":"2023-07-21T22:34:22.971653+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.986670+0000","last_change":"2023-07-21T22:34:22.983579+0000","last_active":"2023-07-21T22:34:22.986670+0000","last_peered":"2023-07-21T22:34:22.986670+0000","last_clean":"2023-07-21T22:34:22.986670+0000","last_became_active":"2023-07-21T22:34:22.983241+0000","last_became_peered":"2023-07-21T22:34:22.983241+0000","last_unstale":"2023-07-21T22:34:22.986670+0000","last_undegraded":"2023-07-21T22:34:22.986670+0000","last_fullsized":"2023-07-21T22:34:22.986670+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:49:29.136005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.959044+0000","last_change":"2023-07-21T22:34:22.959044+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.959044+0000","last_undegraded":"2023-07-21T22:34:22.959044+0000","last_fullsized":"2023-07-21T22:34:22.959044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.987706+0000","last_change":"2023-07-21T22:34:22.985768+0000","last_active":"2023-07-21T22:34:22.987706+0000","last_peered":"2023-07-21T22:34:22.987706+0000","last_clean":"2023-07-21T22:34:22.987706+0000","last_became_active":"2023-07-21T22:34:22.985453+0000","last_became_peered":"2023-07-21T22:34:22.985453+0000","last_unstale":"2023-07-21T22:34:22.987706+0000","last_undegraded":"2023-07-21T22:34:22.987706+0000","last_fullsized":"2023-07-21T22:34:22.987706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:56:31.677979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.963788+0000","last_change":"2023-07-21T22:34:22.963788+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.963788+0000","last_undegraded":"2023-07-21T22:34:22.963788+0000","last_fullsized":"2023-07-21T22:34:22.963788+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.987643+0000","last_change":"2023-07-21T22:34:22.982600+0000","last_active":"2023-07-21T22:34:22.987643+0000","last_peered":"2023-07-21T22:34:22.987643+0000","last_clean":"2023-07-21T22:34:22.987643+0000","last_became_active":"2023-07-21T22:34:22.982315+0000","last_became_peered":"2023-07-21T22:34:22.982315+0000","last_unstale":"2023-07-21T22:34:22.987643+0000","last_undegraded":"2023-07-21T22:34:22.987643+0000","last_fullsized":"2023-07-21T22:34:22.987643+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:19.158521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.966518+0000","last_change":"2023-07-21T22:34:22.966518+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.966518+0000","last_undegraded":"2023-07-21T22:34:22.966518+0000","last_fullsized":"2023-07-21T22:34:22.966518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.983344+0000","last_change":"2023-07-21T22:34:22.979042+0000","last_active":"2023-07-21T22:34:22.983344+0000","last_peered":"2023-07-21T22:34:22.983344+0000","last_clean":"2023-07-21T22:34:22.983344+0000","last_became_active":"2023-07-21T22:34:22.978740+0000","last_became_peered":"2023-07-21T22:34:22.978740+0000","last_unstale":"2023-07-21T22:34:22.983344+0000","last_undegraded":"2023-07-21T22:34:22.983344+0000","last_fullsized":"2023-07-21T22:34:22.983344+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:01:46.331107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965071+0000","last_change":"2023-07-21T22:34:22.965071+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965071+0000","last_undegraded":"2023-07-21T22:34:22.965071+0000","last_fullsized":"2023-07-21T22:34:22.965071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.978194+0000","last_change":"2023-07-21T22:34:22.977004+0000","last_active":"2023-07-21T22:34:22.978194+0000","last_peered":"2023-07-21T22:34:22.978194+0000","last_clean":"2023-07-21T22:34:22.978194+0000","last_became_active":"2023-07-21T22:34:22.976697+0000","last_became_peered":"2023-07-21T22:34:22.976697+0000","last_unstale":"2023-07-21T22:34:22.978194+0000","last_undegraded":"2023-07-21T22:34:22.978194+0000","last_fullsized":"2023-07-21T22:34:22.978194+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:49:11.617598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.970155+0000","last_change":"2023-07-21T22:34:22.970155+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.970155+0000","last_undegraded":"2023-07-21T22:34:22.970155+0000","last_fullsized":"2023-07-21T22:34:22.970155+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.984663+0000","last_change":"2023-07-21T22:34:22.983643+0000","last_active":"2023-07-21T22:34:22.984663+0000","last_peered":"2023-07-21T22:34:22.984663+0000","last_clean":"2023-07-21T22:34:22.984663+0000","last_became_active":"2023-07-21T22:34:22.983314+0000","last_became_peered":"2023-07-21T22:34:22.983314+0000","last_unstale":"2023-07-21T22:34:22.984663+0000","last_undegraded":"2023-07-21T22:34:22.984663+0000","last_fullsized":"2023-07-21T22:34:22.984663+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:01:04.819418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.973144+0000","last_change":"2023-07-21T22:34:22.973144+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.973144+0000","last_undegraded":"2023-07-21T22:34:22.973144+0000","last_fullsized":"2023-07-21T22:34:22.973144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.986725+0000","last_change":"2023-07-21T22:34:22.982875+0000","last_active":"2023-07-21T22:34:22.986725+0000","last_peered":"2023-07-21T22:34:22.986725+0000","last_clean":"2023-07-21T22:34:22.986725+0000","last_became_active":"2023-07-21T22:34:22.982387+0000","last_became_peered":"2023-07-21T22:34:22.982387+0000","last_unstale":"2023-07-21T22:34:22.986725+0000","last_undegraded":"2023-07-21T22:34:22.986725+0000","last_fullsized":"2023-07-21T22:34:22.986725+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:07:10.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.970000+0000","last_change":"2023-07-21T22:34:22.970000+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.970000+0000","last_undegraded":"2023-07-21T22:34:22.970000+0000","last_fullsized":"2023-07-21T22:34:22.970000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.969651+0000","last_change":"2023-07-21T22:34:22.967847+0000","last_active":"2023-07-21T22:34:22.969651+0000","last_peered":"2023-07-21T22:34:22.969651+0000","last_clean":"2023-07-21T22:34:22.969651+0000","last_became_active":"2023-07-21T22:34:22.967434+0000","last_became_peered":"2023-07-21T22:34:22.967434+0000","last_unstale":"2023-07-21T22:34:22.969651+0000","last_undegraded":"2023-07-21T22:34:22.969651+0000","last_fullsized":"2023-07-21T22:34:22.969651+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:44.868411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.959025+0000","last_change":"2023-07-21T22:34:22.959025+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.959025+0000","last_undegraded":"2023-07-21T22:34:22.959025+0000","last_fullsized":"2023-07-21T22:34:22.959025+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.977760+0000","last_change":"2023-07-21T22:34:22.976249+0000","last_active":"2023-07-21T22:34:22.977760+0000","last_peered":"2023-07-21T22:34:22.977760+0000","last_clean":"2023-07-21T22:34:22.977760+0000","last_became_active":"2023-07-21T22:34:22.975817+0000","last_became_peered":"2023-07-21T22:34:22.975817+0000","last_unstale":"2023-07-21T22:34:22.977760+0000","last_undegraded":"2023-07-21T22:34:22.977760+0000","last_fullsized":"2023-07-21T22:34:22.977760+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:15:56.139290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.966153+0000","last_change":"2023-07-21T22:34:22.966153+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.966153+0000","last_undegraded":"2023-07-21T22:34:22.966153+0000","last_fullsized":"2023-07-21T22:34:22.966153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.978805+0000","last_change":"2023-07-21T22:34:22.976771+0000","last_active":"2023-07-21T22:34:22.978805+0000","last_peered":"2023-07-21T22:34:22.978805+0000","last_clean":"2023-07-21T22:34:22.978805+0000","last_became_active":"2023-07-21T22:34:22.976478+0000","last_became_peered":"2023-07-21T22:34:22.976478+0000","last_unstale":"2023-07-21T22:34:22.978805+0000","last_undegraded":"2023-07-21T22:34:22.978805+0000","last_fullsized":"2023-07-21T22:34:22.978805+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:05:09.796569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.972967+0000","last_change":"2023-07-21T22:34:22.972967+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.972967+0000","last_undegraded":"2023-07-21T22:34:22.972967+0000","last_fullsized":"2023-07-21T22:34:22.972967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.973819+0000","last_change":"2023-07-21T22:34:22.971793+0000","last_active":"2023-07-21T22:34:22.973819+0000","last_peered":"2023-07-21T22:34:22.973819+0000","last_clean":"2023-07-21T22:34:22.973819+0000","last_became_active":"2023-07-21T22:34:22.971485+0000","last_became_peered":"2023-07-21T22:34:22.971485+0000","last_unstale":"2023-07-21T22:34:22.973819+0000","last_undegraded":"2023-07-21T22:34:22.973819+0000","last_fullsized":"2023-07-21T22:34:22.973819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:22:11.349369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"72'161","reported_seq":436,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.975168+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:34:22.975168+0000","last_peered":"2023-07-21T22:34:22.975168+0000","last_clean":"2023-07-21T22:34:22.975168+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:34:22.975168+0000","last_undegraded":"2023-07-21T22:34:22.975168+0000","last_fullsized":"2023-07-21T22:34:22.975168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:46:27.179436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":134,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.973841+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:34:22.973841+0000","last_peered":"2023-07-21T22:34:22.973841+0000","last_clean":"2023-07-21T22:34:22.973841+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:34:22.973841+0000","last_undegraded":"2023-07-21T22:34:22.973841+0000","last_fullsized":"2023-07-21T22:34:22.973841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:41:19.821082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.964867+0000","last_change":"2023-07-21T22:34:22.964867+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.964867+0000","last_undegraded":"2023-07-21T22:34:22.964867+0000","last_fullsized":"2023-07-21T22:34:22.964867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.979996+0000","last_change":"2023-07-21T22:34:22.978762+0000","last_active":"2023-07-21T22:34:22.979996+0000","last_peered":"2023-07-21T22:34:22.979996+0000","last_clean":"2023-07-21T22:34:22.979996+0000","last_became_active":"2023-07-21T22:34:22.978367+0000","last_became_peered":"2023-07-21T22:34:22.978367+0000","last_unstale":"2023-07-21T22:34:22.979996+0000","last_undegraded":"2023-07-21T22:34:22.979996+0000","last_fullsized":"2023-07-21T22:34:22.979996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:10:17.406840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.975023+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:34:22.975023+0000","last_peered":"2023-07-21T22:34:22.975023+0000","last_clean":"2023-07-21T22:34:22.975023+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:34:22.975023+0000","last_undegraded":"2023-07-21T22:34:22.975023+0000","last_fullsized":"2023-07-21T22:34:22.975023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:27:19.100104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.966137+0000","last_change":"2023-07-21T22:34:22.966137+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.966137+0000","last_undegraded":"2023-07-21T22:34:22.966137+0000","last_fullsized":"2023-07-21T22:34:22.966137+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.983387+0000","last_change":"2023-07-21T22:34:22.977887+0000","last_active":"2023-07-21T22:34:22.983387+0000","last_peered":"2023-07-21T22:34:22.983387+0000","last_clean":"2023-07-21T22:34:22.983387+0000","last_became_active":"2023-07-21T22:34:22.977599+0000","last_became_peered":"2023-07-21T22:34:22.977599+0000","last_unstale":"2023-07-21T22:34:22.983387+0000","last_undegraded":"2023-07-21T22:34:22.983387+0000","last_fullsized":"2023-07-21T22:34:22.983387+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:49:14.669970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":120,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.965779+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:34:22.965779+0000","last_peered":"2023-07-21T22:34:22.965779+0000","last_clean":"2023-07-21T22:34:22.965779+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:34:22.965779+0000","last_undegraded":"2023-07-21T22:34:22.965779+0000","last_fullsized":"2023-07-21T22:34:22.965779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:59:15.005858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.971203+0000","last_change":"2023-07-21T22:34:22.971203+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.971203+0000","last_undegraded":"2023-07-21T22:34:22.971203+0000","last_fullsized":"2023-07-21T22:34:22.971203+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.982560+0000","last_change":"2023-07-21T22:34:22.981350+0000","last_active":"2023-07-21T22:34:22.982560+0000","last_peered":"2023-07-21T22:34:22.982560+0000","last_clean":"2023-07-21T22:34:22.982560+0000","last_became_active":"2023-07-21T22:34:22.981023+0000","last_became_peered":"2023-07-21T22:34:22.981023+0000","last_unstale":"2023-07-21T22:34:22.982560+0000","last_undegraded":"2023-07-21T22:34:22.982560+0000","last_fullsized":"2023-07-21T22:34:22.982560+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:31:22.360596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":134,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.969433+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:34:22.969433+0000","last_peered":"2023-07-21T22:34:22.969433+0000","last_clean":"2023-07-21T22:34:22.969433+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:34:22.969433+0000","last_undegraded":"2023-07-21T22:34:22.969433+0000","last_fullsized":"2023-07-21T22:34:22.969433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:14:54.887911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.972267+0000","last_change":"2023-07-21T22:34:22.972267+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.972267+0000","last_undegraded":"2023-07-21T22:34:22.972267+0000","last_fullsized":"2023-07-21T22:34:22.972267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.983318+0000","last_change":"2023-07-21T22:34:22.978160+0000","last_active":"2023-07-21T22:34:22.983318+0000","last_peered":"2023-07-21T22:34:22.983318+0000","last_clean":"2023-07-21T22:34:22.983318+0000","last_became_active":"2023-07-21T22:34:22.977862+0000","last_became_peered":"2023-07-21T22:34:22.977862+0000","last_unstale":"2023-07-21T22:34:22.983318+0000","last_undegraded":"2023-07-21T22:34:22.983318+0000","last_fullsized":"2023-07-21T22:34:22.983318+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:59:01.611604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":130,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.956755+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:34:22.956755+0000","last_peered":"2023-07-21T22:34:22.956755+0000","last_clean":"2023-07-21T22:34:22.956755+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:34:22.956755+0000","last_undegraded":"2023-07-21T22:34:22.956755+0000","last_fullsized":"2023-07-21T22:34:22.956755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:11:00.189296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.970837+0000","last_change":"2023-07-21T22:34:22.970837+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.970837+0000","last_undegraded":"2023-07-21T22:34:22.970837+0000","last_fullsized":"2023-07-21T22:34:22.970837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.988827+0000","last_change":"2023-07-21T22:34:22.987856+0000","last_active":"2023-07-21T22:34:22.988827+0000","last_peered":"2023-07-21T22:34:22.988827+0000","last_clean":"2023-07-21T22:34:22.988827+0000","last_became_active":"2023-07-21T22:34:22.987572+0000","last_became_peered":"2023-07-21T22:34:22.987572+0000","last_unstale":"2023-07-21T22:34:22.988827+0000","last_undegraded":"2023-07-21T22:34:22.988827+0000","last_fullsized":"2023-07-21T22:34:22.988827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:03:52.170931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":124,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.976477+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:34:22.976477+0000","last_peered":"2023-07-21T22:34:22.976477+0000","last_clean":"2023-07-21T22:34:22.976477+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:34:22.976477+0000","last_undegraded":"2023-07-21T22:34:22.976477+0000","last_fullsized":"2023-07-21T22:34:22.976477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:52:26.545137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.971005+0000","last_change":"2023-07-21T22:34:22.971005+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.971005+0000","last_undegraded":"2023-07-21T22:34:22.971005+0000","last_fullsized":"2023-07-21T22:34:22.971005+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.986696+0000","last_change":"2023-07-21T22:34:22.983383+0000","last_active":"2023-07-21T22:34:22.986696+0000","last_peered":"2023-07-21T22:34:22.986696+0000","last_clean":"2023-07-21T22:34:22.986696+0000","last_became_active":"2023-07-21T22:34:22.982810+0000","last_became_peered":"2023-07-21T22:34:22.982810+0000","last_unstale":"2023-07-21T22:34:22.986696+0000","last_undegraded":"2023-07-21T22:34:22.986696+0000","last_fullsized":"2023-07-21T22:34:22.986696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:50:18.545123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":130,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.956416+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:34:22.956416+0000","last_peered":"2023-07-21T22:34:22.956416+0000","last_clean":"2023-07-21T22:34:22.956416+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:34:22.956416+0000","last_undegraded":"2023-07-21T22:34:22.956416+0000","last_fullsized":"2023-07-21T22:34:22.956416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:49:28.133865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.969581+0000","last_change":"2023-07-21T22:34:22.969581+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.969581+0000","last_undegraded":"2023-07-21T22:34:22.969581+0000","last_fullsized":"2023-07-21T22:34:22.969581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.984208+0000","last_change":"2023-07-21T22:34:22.983391+0000","last_active":"2023-07-21T22:34:22.984208+0000","last_peered":"2023-07-21T22:34:22.984208+0000","last_clean":"2023-07-21T22:34:22.984208+0000","last_became_active":"2023-07-21T22:34:22.983074+0000","last_became_peered":"2023-07-21T22:34:22.983074+0000","last_unstale":"2023-07-21T22:34:22.984208+0000","last_undegraded":"2023-07-21T22:34:22.984208+0000","last_fullsized":"2023-07-21T22:34:22.984208+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:05:09.796569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":122,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.970473+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:34:22.970473+0000","last_peered":"2023-07-21T22:34:22.970473+0000","last_clean":"2023-07-21T22:34:22.970473+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:34:22.970473+0000","last_undegraded":"2023-07-21T22:34:22.970473+0000","last_fullsized":"2023-07-21T22:34:22.970473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:48:28.934992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509631,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54732,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317108,"statfs":{"total":96636764160,"available":96580718592,"internally_reserved":0,"allocated":1576960,"data_stored":1074115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.752,"15min":0.73999999999999999},"min":{"1min":0.53600000000000003,"5min":0.35299999999999998,"15min":0.32600000000000001},"max":{"1min":0.96399999999999997,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71499999999999997,"15min":0.69599999999999995},"min":{"1min":0.55300000000000005,"5min":0.39500000000000002,"15min":0.36099999999999999},"max":{"1min":0.94399999999999995,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.63}]},{"osd":1,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.73699999999999999},"min":{"1min":0.46800000000000003,"5min":0.432,"15min":0.379},"max":{"1min":1.0680000000000001,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.56799999999999995,"5min":0.44,"15min":0.44},"max":{"1min":0.95099999999999996,"5min":1.0129999999999999,"15min":1.0409999999999999},"last":0.73999999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73799999999999999,"15min":0.74299999999999999},"min":{"1min":0.53100000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.405},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73599999999999999,"15min":0.752},"min":{"1min":0.59399999999999997,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94599999999999995,"5min":1.409,"15min":1.409},"last":0.78700000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.754,"15min":0.76600000000000001},"min":{"1min":0.58399999999999996,"5min":0.504,"15min":0.42099999999999999},"max":{"1min":1.0409999999999999,"5min":1.46,"15min":1.46},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.75900000000000001,"15min":0.75800000000000001},"min":{"1min":0.63400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54900000000000004,"15min":0.56200000000000006},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.90000000000000002,"5min":0.90500000000000003,"15min":1.244},"last":0.495},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.62,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97399999999999998,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63800000000000001,"15min":0.61899999999999999},"min":{"1min":0.51800000000000002,"5min":0.40400000000000003,"15min":0.40300000000000002},"max":{"1min":0.81200000000000006,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66300000000000003,"15min":0.68000000000000005},"min":{"1min":0.49299999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91300000000000003,"5min":1.506,"15min":1.506},"last":0.71699999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.66900000000000004,"15min":0.68000000000000005},"min":{"1min":0.57099999999999995,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93999999999999995,"5min":0.94399999999999995,"15min":1.048},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61699999999999999,"15min":0.63900000000000001},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.98599999999999999},"last":0.58099999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542337,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":983040,"data_stored":483747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76700000000000002,"15min":0.76500000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.425},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.59199999999999997,"5min":0.57899999999999996,"15min":0.437},"max":{"1min":1.0289999999999999,"5min":1.1180000000000001,"15min":2.3100000000000001},"last":0.90400000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.55700000000000005,"5min":0.45300000000000001,"15min":0.41999999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.99199999999999999,"5min":0.99399999999999999,"15min":8.6280000000000001},"last":0.80600000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.55600000000000005,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.55},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.80700000000000005,"15min":0.79600000000000004},"min":{"1min":0.59699999999999998,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":1.097,"15min":1.097},"last":0.753}]},{"osd":3,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.60399999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.7470000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.58399999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92800000000000005,"5min":1.0049999999999999,"15min":1.5129999999999999},"last":0.72899999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.374,"15min":0.36599999999999999},"max":{"1min":0.93400000000000005,"5min":1.0229999999999999,"15min":3.1829999999999998},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.80100000000000005,"5min":0.86199999999999999,"15min":2.887},"last":0.871}]},{"osd":5,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60899999999999999,"15min":0.61899999999999999},"min":{"1min":0.437,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82799999999999996,"5min":0.96299999999999997,"15min":1.4510000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.50900000000000001,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.88400000000000001,"5min":0.98799999999999999,"15min":1.054},"last":0.85899999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.52400000000000002,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":0.93600000000000005,"5min":1.079,"15min":1.1679999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68899999999999995,"15min":0.71499999999999997},"min":{"1min":0.54100000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82499999999999996,"5min":1.0449999999999999,"15min":8.0760000000000005},"last":0.83799999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509630,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":970752,"data_stored":477083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72799999999999998,"15min":0.71599999999999997},"min":{"1min":0.53000000000000003,"5min":0.35699999999999998,"15min":0.32900000000000001},"max":{"1min":1,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47599999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.59999999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69399999999999995,"15min":0.71399999999999997},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.505,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":1.617,"15min":1.617},"last":0.67600000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71799999999999997,"15min":0.73599999999999999},"min":{"1min":0.53300000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.92800000000000005,"5min":1.0109999999999999,"15min":1.034},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.53300000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.90800000000000003,"5min":1.512,"15min":1.512},"last":0.86399999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.77200000000000002,"15min":0.78700000000000003},"min":{"1min":0.61299999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98599999999999999,"5min":1.472,"15min":1.472},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.80300000000000005,"15min":0.79700000000000004},"min":{"1min":0.56899999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.022,"5min":1.556,"15min":1.556},"last":0.90800000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.48899999999999999,"5min":0.48599999999999999,"15min":0.44900000000000001},"max":{"1min":0.92400000000000004,"5min":1.012,"15min":1.038},"last":0.88200000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70499999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.62,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92500000000000004,"5min":1.02,"15min":1.02},"last":0.747}]},{"osd":7,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.64800000000000002,"15min":0.65200000000000002},"min":{"1min":0.55500000000000005,"5min":0.374,"15min":0.374},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.72499999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.85899999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.999}]}]},{"osd":4,"up_from":15,"seq":64424509631,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":970752,"data_stored":477083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.746,"15min":0.747},"min":{"1min":0.55700000000000005,"5min":0.438,"15min":0.40000000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.0429999999999999},"last":0.623},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.746,"15min":0.746},"min":{"1min":0.55000000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95099999999999996,"5min":0.96099999999999997,"15min":0.99099999999999999},"last":0.65000000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70499999999999996,"15min":0.70399999999999996},"min":{"1min":0.53400000000000003,"5min":0.43099999999999999,"15min":0.39400000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.0449999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.60899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93000000000000005,"5min":0.94299999999999995,"15min":1.016},"last":0.67200000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.59299999999999997,"5min":0.371,"15min":0.371},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.57799999999999996,"5min":0.41999999999999998,"15min":0.33000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.505,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":1.026},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.80200000000000005,"15min":0.79200000000000004},"min":{"1min":0.70399999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.996,"5min":0.996,"15min":1.018},"last":0.871}]},{"osd":5,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.441,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72299999999999998,"5min":0.81599999999999995,"15min":0.94299999999999995},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.59299999999999997},"min":{"1min":0.38800000000000001,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.79600000000000004,"5min":0.91000000000000003,"15min":1.0680000000000001},"last":0.59499999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.45800000000000002,"5min":0.41299999999999998,"15min":0.38500000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70099999999999996,"15min":0.72599999999999998},"min":{"1min":0.52200000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91400000000000003,"5min":0.98999999999999999,"15min":1.272},"last":0.83399999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.628,"15min":0.65800000000000003},"min":{"1min":0.499,"5min":0.39200000000000002,"15min":0.374},"max":{"1min":0.91300000000000003,"5min":1.0069999999999999,"15min":1.3300000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68000000000000005,"15min":0.69299999999999995},"min":{"1min":0.53100000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.135},"last":0.81399999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509630,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":970752,"data_stored":477083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.48799999999999999,"15min":0.48099999999999998},"min":{"1min":0.35099999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70499999999999996,"5min":0.73099999999999998,"15min":0.76400000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.43099999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.30099999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.871},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.94199999999999995},"last":0.30199999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82899999999999996,"5min":1.0449999999999999,"15min":1.1140000000000001},"last":0.378},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45500000000000002,"5min":0.45100000000000001,"15min":0.40999999999999998},"max":{"1min":0.84399999999999997,"5min":0.95399999999999996,"15min":0.99199999999999999},"last":0.41399999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.57599999999999996,"5min":0.48299999999999998,"15min":0.438},"max":{"1min":1.093,"5min":1.093,"15min":1.3240000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82199999999999995,"15min":0.83299999999999996},"min":{"1min":0.68799999999999994,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.488},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.60699999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0669999999999999,"5min":1.137,"15min":1.1919999999999999},"last":0.501},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.60399999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0649999999999999,"15min":1.302},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79200000000000004,"15min":0.80100000000000005},"min":{"1min":0.68000000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.02,"5min":1.056,"15min":1.3979999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76500000000000001,"15min":0.78000000000000003},"min":{"1min":0.56899999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0269999999999999,"5min":1.1120000000000001,"15min":1.3899999999999999},"last":0.53100000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.81000000000000005,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0089999999999999,"5min":1.087,"15min":1.335},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.873,"5min":0.83699999999999997,"15min":0.83499999999999996},"min":{"1min":0.66100000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.2130000000000001},"last":0.69099999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509632,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54152,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317688,"statfs":{"total":96636764160,"available":96581312512,"internally_reserved":0,"allocated":983040,"data_stored":483747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.29099999999999998,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.69399999999999995,"5min":0.81200000000000006,"15min":0.94199999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53600000000000003,"15min":0.54900000000000004},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.88300000000000001,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.28199999999999997},"max":{"1min":0.82999999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80700000000000005,"5min":1.085,"15min":1.085},"last":0.48699999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.37,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.379},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55300000000000005,"15min":0.56899999999999995},"min":{"1min":0.43099999999999999,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":1.161,"15min":1.161},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.67600000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.1579999999999999,"5min":1.2569999999999999,"15min":1.6870000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.79400000000000004,"15min":0.80200000000000005},"min":{"1min":0.57699999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.175,"5min":1.1950000000000001,"15min":1.2689999999999999},"last":0.60799999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.63200000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.2549999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.60599999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.107,"5min":1.206,"15min":1.3089999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.78600000000000003,"15min":0.79800000000000004},"min":{"1min":0.69399999999999995,"5min":0.45500000000000002,"15min":0.40300000000000002},"max":{"1min":1.089,"5min":1.282,"15min":1.3759999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.64300000000000002,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.1339999999999999,"5min":1.23,"15min":1.2649999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.80900000000000005,"15min":0.82899999999999996},"min":{"1min":0.64900000000000002,"5min":0.51100000000000001,"15min":0.49099999999999999},"max":{"1min":1.143,"5min":1.2,"15min":1.2909999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.60999999999999999,"5min":0.44900000000000001,"15min":0.44700000000000001},"max":{"1min":1.091,"5min":1.216,"15min":1.3660000000000001},"last":0.68899999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509631,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":983040,"data_stored":483747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48899999999999999,"15min":0.504},"min":{"1min":0.32600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.66700000000000004,"5min":0.84599999999999997,"15min":5.4800000000000004},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.58799999999999997},"min":{"1min":0.49399999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.872,"15min":5.2830000000000004},"last":0.626}]},{"osd":2,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.39900000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72999999999999998,"5min":0.76100000000000001,"15min":3.4220000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.29099999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.88800000000000001},"last":0.68500000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59499999999999997,"15min":0.60999999999999999},"min":{"1min":0.48899999999999999,"5min":0.35799999999999998,"15min":0.33400000000000002},"max":{"1min":0.73499999999999999,"5min":0.84299999999999997,"15min":3.2469999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51700000000000002,"15min":0.53700000000000003},"min":{"1min":0.36799999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":5.8710000000000004},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.58699999999999997,"5min":0.432,"15min":0.432},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":3.6259999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.63100000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.97399999999999998,"5min":1.083,"15min":4.4100000000000001},"last":0.77000000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.77600000000000002,"15min":0.80200000000000005},"min":{"1min":0.64800000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0609999999999999,"5min":1.115,"15min":5.766},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.80100000000000005,"15min":0.81299999999999994},"min":{"1min":0.57899999999999996,"5min":0.376,"15min":0.376},"max":{"1min":1.0980000000000001,"5min":1.1279999999999999,"15min":3.669},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.66700000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0429999999999999,"5min":1.085,"15min":1.23},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77800000000000002,"15min":0.81499999999999995},"min":{"1min":0.55100000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.083,"5min":1.1020000000000001,"15min":5.8200000000000003},"last":0.747}]},{"osd":7,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.79800000000000004,"15min":0.83099999999999996},"min":{"1min":0.59599999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.028,"5min":1.103,"15min":5.9269999999999996},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.60299999999999998,"5min":0.52600000000000002,"15min":0.45700000000000002},"max":{"1min":1.115,"5min":1.115,"15min":3.5800000000000001},"last":0.78900000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509633,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1576960,"data_stored":1074115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.50800000000000001},"min":{"1min":0.35899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.67900000000000005,"5min":0.77800000000000002,"15min":0.83199999999999996},"last":0.502}]},{"osd":2,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70999999999999996,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.44,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58199999999999996,"5min":0.871,"15min":0.871},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.35899999999999999,"15min":0.34899999999999998},"max":{"1min":0.76500000000000001,"5min":0.88100000000000001,"15min":0.91300000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.434,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73999999999999999,"5min":1.038,"15min":1.038},"last":0.55300000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.76100000000000001,"15min":0.78100000000000003},"min":{"1min":0.59299999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.321},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.60099999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.093,"5min":1.423,"15min":1.423},"last":0.97299999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.60299999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0960000000000001,"5min":1.2669999999999999,"15min":1.28},"last":1.036},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.78400000000000003,"15min":0.80900000000000005},"min":{"1min":0.70599999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.393},"last":0.95699999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78500000000000003,"15min":0.81299999999999994},"min":{"1min":0.61799999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.28},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81399999999999995,"15min":0.81999999999999995},"min":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.131,"5min":1.333,"15min":1.333},"last":0.92600000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.65900000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.2310000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.80900000000000005,"15min":0.83399999999999996},"min":{"1min":0.60599999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1930000000000001,"5min":1.296,"15min":1.369},"last":0.90500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:34:28.540 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:34:28.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.667+0000 7f57b4c96640 1 Processor -- start 2023-07-21T22:34:28.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.667+0000 7f57b4c96640 1 -- start start 2023-07-21T22:34:28.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57b4c96640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57b00c9e20 0x7f57b00ad720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:28.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57b4c96640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b00ca300 con 0x7f57b015f240 2023-07-21T22:34:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57b4c96640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b00ca5e0 con 0x7f57b00cbef0 2023-07-21T22:34:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57b4c96640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b00caba0 con 0x7f57b00c9e20 2023-07-21T22:34:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57ae59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f57b015f240 0x7f57b015fd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54534/0 (socket says 172.21.15.6:54534) 2023-07-21T22:34:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57ae59c640 1 -- 172.21.15.6:0/3213026549 learned_addr learned my addr 172.21.15.6:0/3213026549 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57a7fff640 1 --2- 172.21.15.6:0/3213026549 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57b00c9e20 0x7f57b00ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:28.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57add9b640 1 -- 172.21.15.6:0/3213026549 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2804726390 0 0) 0x7f57b00ca300 con 0x7f57b015f240 2023-07-21T22:34:28.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57add9b640 1 -- 172.21.15.6:0/3213026549 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f579c003530 con 0x7f57b015f240 2023-07-21T22:34:28.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57add9b640 1 -- 172.21.15.6:0/3213026549 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3999363426 0 0) 0x7f579c003530 con 0x7f57b015f240 2023-07-21T22:34:28.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57add9b640 1 -- 172.21.15.6:0/3213026549 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57b00c9e20 msgr2=0x7f57b00ad720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:28.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57add9b640 1 --2- 172.21.15.6:0/3213026549 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57b00c9e20 0x7f57b00ad720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57add9b640 1 -- 172.21.15.6:0/3213026549 >> v1:172.21.15.161:6789/0 conn(0x7f57b00cbef0 legacy=0x7f57b00cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:28.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57add9b640 1 -- 172.21.15.6:0/3213026549 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b00ca8c0 con 0x7f57b015f240 2023-07-21T22:34:28.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57add9b640 1 -- 172.21.15.6:0/3213026549 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f57a0001680 con 0x7f57b015f240 2023-07-21T22:34:28.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57add9b640 1 -- 172.21.15.6:0/3213026549 >> v1:172.21.15.6:6789/0 conn(0x7f57b015f240 legacy=0x7f57b015fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:28.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57add9b640 1 --2- 172.21.15.6:0/3213026549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f579c0039b0 0x7f579c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:28.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57add9b640 1 --2- 172.21.15.6:0/3213026549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f579c0047d0 0x7f579c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:28.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57add9b640 1 --2- 172.21.15.6:0/3213026549 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57b00c9e20 0x7f579c0051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:28.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57add9b640 1 -- 172.21.15.6:0/3213026549 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b00caba0 con 0x7f579c0047d0 2023-07-21T22:34:28.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57add9b640 1 -- 172.21.15.6:0/3213026549 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c00ba90 con 0x7f579c0039b0 2023-07-21T22:34:28.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57add9b640 1 -- 172.21.15.6:0/3213026549 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c00bc50 con 0x7f57b00c9e20 2023-07-21T22:34:28.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57a7fff640 1 --2- 172.21.15.6:0/3213026549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f579c0047d0 0x7f579c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:28.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57ae59c640 1 --2- 172.21.15.6:0/3213026549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f579c0039b0 0x7f579c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:28.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57aed9d640 1 --2- 172.21.15.6:0/3213026549 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57b00c9e20 0x7f579c0051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:28.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57a7fff640 1 -- 172.21.15.6:0/3213026549 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57b00c9e20 msgr2=0x7f579c0051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:28.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57a7fff640 1 --2- 172.21.15.6:0/3213026549 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57b00c9e20 0x7f579c0051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57a7fff640 1 -- 172.21.15.6:0/3213026549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f579c0039b0 msgr2=0x7f579c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:28.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57a7fff640 1 --2- 172.21.15.6:0/3213026549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f579c0039b0 0x7f579c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.671+0000 7f57a7fff640 1 -- 172.21.15.6:0/3213026549 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c003530 con 0x7f579c0047d0 2023-07-21T22:34:28.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.675+0000 7f57a7fff640 1 --2- 172.21.15.6:0/3213026549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f579c0047d0 0x7f579c004c40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f5798009ab0 tx=0x7f579801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23cead861c8a62c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:28.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.675+0000 7f57add9b640 1 -- 172.21.15.6:0/3213026549 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57980a5510 con 0x7f579c0047d0 2023-07-21T22:34:28.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.675+0000 7f57add9b640 1 -- 172.21.15.6:0/3213026549 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57980a5670 con 0x7f579c0047d0 2023-07-21T22:34:28.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.675+0000 7f57add9b640 1 -- 172.21.15.6:0/3213026549 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57980a5a20 con 0x7f579c0047d0 2023-07-21T22:34:28.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.675+0000 7f57b4c96640 1 -- 172.21.15.6:0/3213026549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f579c0047d0 msgr2=0x7f579c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:28.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.675+0000 7f57b4c96640 1 --2- 172.21.15.6:0/3213026549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f579c0047d0 0x7f579c004c40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f5798009ab0 tx=0x7f579801ca30 comp rx=0 tx=0).stop 2023-07-21T22:34:28.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.675+0000 7f57aed9d640 1 -- 172.21.15.6:0/3213026549 reap_dead start 2023-07-21T22:34:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.675+0000 7f57b4c96640 1 -- 172.21.15.6:0/3213026549 shutdown_connections 2023-07-21T22:34:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.675+0000 7f57b4c96640 1 -- 172.21.15.6:0/3213026549 >> 172.21.15.6:0/3213026549 conn(0x7f57b00cada0 msgr2=0x7f57b00cb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.675+0000 7f57b4c96640 1 -- 172.21.15.6:0/3213026549 shutdown_connections 2023-07-21T22:34:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.675+0000 7f57b4c96640 1 -- 172.21.15.6:0/3213026549 wait complete. 2023-07-21T22:34:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57b4c96640 1 Processor -- start 2023-07-21T22:34:28.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57b4c96640 1 -- start start 2023-07-21T22:34:28.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57b4c96640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f579c0047d0 0x7f57b0162450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:28.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57b4c96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57b0157850 0x7f57b0153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:28.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57b4c96640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57b0160790 0x7f57b0160c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:28.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57b4c96640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b0157cc0 con 0x7f57b0157850 2023-07-21T22:34:28.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57b4c96640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b015d090 con 0x7f57b0160790 2023-07-21T22:34:28.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57b4c96640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b0161140 con 0x7f579c0047d0 2023-07-21T22:34:28.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57a7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57b0157850 0x7f57b0153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:28.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57a7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57b0157850 0x7f57b0153b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54128/0 (socket says 172.21.15.6:54128) 2023-07-21T22:34:28.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57a7fff640 1 -- 172.21.15.6:0/1623324608 learned_addr learned my addr 172.21.15.6:0/1623324608 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:28.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57ae59c640 1 --2- 172.21.15.6:0/1623324608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f579c0047d0 0x7f57b0162450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:28.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57aed9d640 1 --2- 172.21.15.6:0/1623324608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57b0160790 0x7f57b0160c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:28.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57a7fff640 1 -- 172.21.15.6:0/1623324608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f579c0047d0 msgr2=0x7f57b0162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:28.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57a7fff640 1 --2- 172.21.15.6:0/1623324608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f579c0047d0 0x7f57b0162450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57a7fff640 1 -- 172.21.15.6:0/1623324608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57b0160790 msgr2=0x7f57b0160c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:28.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57a7fff640 1 --2- 172.21.15.6:0/1623324608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57b0160790 0x7f57b0160c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57a7fff640 1 -- 172.21.15.6:0/1623324608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b0158460 con 0x7f57b0157850 2023-07-21T22:34:28.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57a7fff640 1 --2- 172.21.15.6:0/1623324608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57b0157850 0x7f57b0153b00 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f57980b0040 tx=0x7f579c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:28.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57a6ffd640 1 -- 172.21.15.6:0/1623324608 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579800f000 con 0x7f57b0157850 2023-07-21T22:34:28.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57a6ffd640 1 -- 172.21.15.6:0/1623324608 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5798004020 con 0x7f57b0157850 2023-07-21T22:34:28.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57a6ffd640 1 -- 172.21.15.6:0/1623324608 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57980043d0 con 0x7f57b0157850 2023-07-21T22:34:28.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57b4c96640 1 -- 172.21.15.6:0/1623324608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b0157ea0 con 0x7f57b0157850 2023-07-21T22:34:28.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57b4c96640 1 -- 172.21.15.6:0/1623324608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b00c60d0 con 0x7f57b0157850 2023-07-21T22:34:28.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.679+0000 7f57b4c96640 1 -- 172.21.15.6:0/1623324608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b00c5f30 con 0x7f57b0157850 2023-07-21T22:34:28.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.683+0000 7f57a6ffd640 1 -- 172.21.15.6:0/1623324608 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f57980b4040 con 0x7f57b0157850 2023-07-21T22:34:28.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.683+0000 7f57a6ffd640 1 --2- 172.21.15.6:0/1623324608 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f57900663d0 0x7f5790068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:28.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.683+0000 7f57a6ffd640 1 -- 172.21.15.6:0/1623324608 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f579811d410 con 0x7f57b0157850 2023-07-21T22:34:28.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.683+0000 7f57ae59c640 1 --2- 172.21.15.6:0/1623324608 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f57900663d0 0x7f5790068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:28.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.683+0000 7f57ae59c640 1 --2- 172.21.15.6:0/1623324608 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f57900663d0 0x7f5790068880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f57a0001060 tx=0x7f57a0000f90 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:28.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.687+0000 7f57a6ffd640 1 -- 172.21.15.6:0/1623324608 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f57b00c5f30 con 0x7f57b0157850 2023-07-21T22:34:28.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.839+0000 7f57b4c96640 1 -- 172.21.15.6:0/1623324608 --> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f57b00cdcf0 con 0x7f57900663d0 2023-07-21T22:34:28.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.847+0000 7f57a6ffd640 1 -- 172.21.15.6:0/1623324608 <== mgr.5768 v2:172.21.15.161:6832/3045187557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305752 (secure 0 0 0) 0x7f57a0007df0 con 0x7f57900663d0 2023-07-21T22:34:28.898 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:28.900 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:34:28.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.851+0000 7f57b4c96640 1 -- 172.21.15.6:0/1623324608 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f57900663d0 msgr2=0x7f5790068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:28.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.851+0000 7f57b4c96640 1 --2- 172.21.15.6:0/1623324608 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f57900663d0 0x7f5790068880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f57a0001060 tx=0x7f57a0000f90 comp rx=0 tx=0).stop 2023-07-21T22:34:28.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.851+0000 7f57b4c96640 1 -- 172.21.15.6:0/1623324608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57b0157850 msgr2=0x7f57b0153b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:28.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.851+0000 7f57b4c96640 1 --2- 172.21.15.6:0/1623324608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57b0157850 0x7f57b0153b00 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f57980b0040 tx=0x7f579c005800 comp rx=0 tx=0).stop 2023-07-21T22:34:28.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.851+0000 7f57b4c96640 1 -- 172.21.15.6:0/1623324608 shutdown_connections 2023-07-21T22:34:28.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.851+0000 7f57b4c96640 1 --2- 172.21.15.6:0/1623324608 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f57900663d0 0x7f5790068880 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.851+0000 7f57b4c96640 1 --2- 172.21.15.6:0/1623324608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57b0160790 0x7f57b0160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.851+0000 7f57b4c96640 1 --2- 172.21.15.6:0/1623324608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57b0157850 0x7f57b0153b00 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.851+0000 7f57b4c96640 1 --2- 172.21.15.6:0/1623324608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f579c0047d0 0x7f57b0162450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:28.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.851+0000 7f57b4c96640 1 -- 172.21.15.6:0/1623324608 >> 172.21.15.6:0/1623324608 conn(0x7f57b00cada0 msgr2=0x7f57b00c8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:28.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.851+0000 7f57b4c96640 1 -- 172.21.15.6:0/1623324608 shutdown_connections 2023-07-21T22:34:28.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:28.851+0000 7f57b4c96640 1 -- 172.21.15.6:0/1623324608 wait complete. 2023-07-21T22:34:28.919 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-21T22:34:27.633929+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":301476,"kb_used_data":8804,"kb_used_omap":0,"kb_used_meta":292608,"kb_avail":754673244,"statfs":{"total":773094113280,"available":772785401856,"internally_reserved":0,"allocated":9015296,"data_stored":5030720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":299630592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.682484"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.960487+0000","last_change":"2023-07-21T22:34:22.960487+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.960487+0000","last_undegraded":"2023-07-21T22:34:22.960487+0000","last_fullsized":"2023-07-21T22:34:22.960487+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.959374+0000","last_change":"2023-07-21T22:34:22.959374+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.959374+0000","last_undegraded":"2023-07-21T22:34:22.959374+0000","last_fullsized":"2023-07-21T22:34:22.959374+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.971829+0000","last_change":"2023-07-21T22:34:22.971829+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.971829+0000","last_undegraded":"2023-07-21T22:34:22.971829+0000","last_fullsized":"2023-07-21T22:34:22.971829+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.973347+0000","last_change":"2023-07-21T22:34:22.973347+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.973347+0000","last_undegraded":"2023-07-21T22:34:22.973347+0000","last_fullsized":"2023-07-21T22:34:22.973347+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.973406+0000","last_change":"2023-07-21T22:34:22.973406+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.973406+0000","last_undegraded":"2023-07-21T22:34:22.973406+0000","last_fullsized":"2023-07-21T22:34:22.973406+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.964323+0000","last_change":"2023-07-21T22:34:22.964323+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.964323+0000","last_undegraded":"2023-07-21T22:34:22.964323+0000","last_fullsized":"2023-07-21T22:34:22.964323+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965480+0000","last_change":"2023-07-21T22:34:22.965480+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965480+0000","last_undegraded":"2023-07-21T22:34:22.965480+0000","last_fullsized":"2023-07-21T22:34:22.965480+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.964672+0000","last_change":"2023-07-21T22:34:22.964672+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.964672+0000","last_undegraded":"2023-07-21T22:34:22.964672+0000","last_fullsized":"2023-07-21T22:34:22.964672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.972662+0000","last_change":"2023-07-21T22:34:22.972662+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.972662+0000","last_undegraded":"2023-07-21T22:34:22.972662+0000","last_fullsized":"2023-07-21T22:34:22.972662+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.968212+0000","last_change":"2023-07-21T22:34:22.968212+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.968212+0000","last_undegraded":"2023-07-21T22:34:22.968212+0000","last_fullsized":"2023-07-21T22:34:22.968212+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.978022+0000","last_change":"2023-07-21T22:34:22.978022+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.978022+0000","last_undegraded":"2023-07-21T22:34:22.978022+0000","last_fullsized":"2023-07-21T22:34:22.978022+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965579+0000","last_change":"2023-07-21T22:34:22.965579+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965579+0000","last_undegraded":"2023-07-21T22:34:22.965579+0000","last_fullsized":"2023-07-21T22:34:22.965579+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965320+0000","last_change":"2023-07-21T22:34:22.965320+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965320+0000","last_undegraded":"2023-07-21T22:34:22.965320+0000","last_fullsized":"2023-07-21T22:34:22.965320+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.972531+0000","last_change":"2023-07-21T22:34:22.972531+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.972531+0000","last_undegraded":"2023-07-21T22:34:22.972531+0000","last_fullsized":"2023-07-21T22:34:22.972531+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.968640+0000","last_change":"2023-07-21T22:34:22.968640+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.968640+0000","last_undegraded":"2023-07-21T22:34:22.968640+0000","last_fullsized":"2023-07-21T22:34:22.968640+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965009+0000","last_change":"2023-07-21T22:34:22.965009+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965009+0000","last_undegraded":"2023-07-21T22:34:22.965009+0000","last_fullsized":"2023-07-21T22:34:22.965009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.959901+0000","last_change":"2023-07-21T22:34:22.959901+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.959901+0000","last_undegraded":"2023-07-21T22:34:22.959901+0000","last_fullsized":"2023-07-21T22:34:22.959901+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.975064+0000","last_change":"2023-07-21T22:34:22.975064+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.975064+0000","last_undegraded":"2023-07-21T22:34:22.975064+0000","last_fullsized":"2023-07-21T22:34:22.975064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.974975+0000","last_change":"2023-07-21T22:34:22.974975+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.974975+0000","last_undegraded":"2023-07-21T22:34:22.974975+0000","last_fullsized":"2023-07-21T22:34:22.974975+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.960589+0000","last_change":"2023-07-21T22:34:22.960589+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.960589+0000","last_undegraded":"2023-07-21T22:34:22.960589+0000","last_fullsized":"2023-07-21T22:34:22.960589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.964751+0000","last_change":"2023-07-21T22:34:22.964751+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.964751+0000","last_undegraded":"2023-07-21T22:34:22.964751+0000","last_fullsized":"2023-07-21T22:34:22.964751+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.962349+0000","last_change":"2023-07-21T22:34:22.962349+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.962349+0000","last_undegraded":"2023-07-21T22:34:22.962349+0000","last_fullsized":"2023-07-21T22:34:22.962349+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.961322+0000","last_change":"2023-07-21T22:34:22.961322+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.961322+0000","last_undegraded":"2023-07-21T22:34:22.961322+0000","last_fullsized":"2023-07-21T22:34:22.961322+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.968031+0000","last_change":"2023-07-21T22:34:22.968031+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.968031+0000","last_undegraded":"2023-07-21T22:34:22.968031+0000","last_fullsized":"2023-07-21T22:34:22.968031+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965968+0000","last_change":"2023-07-21T22:34:22.965968+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965968+0000","last_undegraded":"2023-07-21T22:34:22.965968+0000","last_fullsized":"2023-07-21T22:34:22.965968+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965623+0000","last_change":"2023-07-21T22:34:22.965623+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965623+0000","last_undegraded":"2023-07-21T22:34:22.965623+0000","last_fullsized":"2023-07-21T22:34:22.965623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.969852+0000","last_change":"2023-07-21T22:34:22.969852+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.969852+0000","last_undegraded":"2023-07-21T22:34:22.969852+0000","last_fullsized":"2023-07-21T22:34:22.969852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.960796+0000","last_change":"2023-07-21T22:34:22.960796+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.960796+0000","last_undegraded":"2023-07-21T22:34:22.960796+0000","last_fullsized":"2023-07-21T22:34:22.960796+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.967988+0000","last_change":"2023-07-21T22:34:22.967988+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.967988+0000","last_undegraded":"2023-07-21T22:34:22.967988+0000","last_fullsized":"2023-07-21T22:34:22.967988+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965428+0000","last_change":"2023-07-21T22:34:22.965428+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965428+0000","last_undegraded":"2023-07-21T22:34:22.965428+0000","last_fullsized":"2023-07-21T22:34:22.965428+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.978018+0000","last_change":"2023-07-21T22:34:22.978018+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.978018+0000","last_undegraded":"2023-07-21T22:34:22.978018+0000","last_fullsized":"2023-07-21T22:34:22.978018+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965294+0000","last_change":"2023-07-21T22:34:22.965294+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965294+0000","last_undegraded":"2023-07-21T22:34:22.965294+0000","last_fullsized":"2023-07-21T22:34:22.965294+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.970806+0000","last_change":"2023-07-21T22:34:22.970806+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.970806+0000","last_undegraded":"2023-07-21T22:34:22.970806+0000","last_fullsized":"2023-07-21T22:34:22.970806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.980302+0000","last_change":"2023-07-21T22:34:22.979497+0000","last_active":"2023-07-21T22:34:22.980302+0000","last_peered":"2023-07-21T22:34:22.980302+0000","last_clean":"2023-07-21T22:34:22.980302+0000","last_became_active":"2023-07-21T22:34:22.979085+0000","last_became_peered":"2023-07-21T22:34:22.979085+0000","last_unstale":"2023-07-21T22:34:22.980302+0000","last_undegraded":"2023-07-21T22:34:22.980302+0000","last_fullsized":"2023-07-21T22:34:22.980302+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:30:48.994293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.969246+0000","last_change":"2023-07-21T22:34:22.969246+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.969246+0000","last_undegraded":"2023-07-21T22:34:22.969246+0000","last_fullsized":"2023-07-21T22:34:22.969246+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.982510+0000","last_change":"2023-07-21T22:34:22.981336+0000","last_active":"2023-07-21T22:34:22.982510+0000","last_peered":"2023-07-21T22:34:22.982510+0000","last_clean":"2023-07-21T22:34:22.982510+0000","last_became_active":"2023-07-21T22:34:22.981041+0000","last_became_peered":"2023-07-21T22:34:22.981041+0000","last_unstale":"2023-07-21T22:34:22.982510+0000","last_undegraded":"2023-07-21T22:34:22.982510+0000","last_fullsized":"2023-07-21T22:34:22.982510+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:05:55.966697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.963558+0000","last_change":"2023-07-21T22:34:22.963558+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.963558+0000","last_undegraded":"2023-07-21T22:34:22.963558+0000","last_fullsized":"2023-07-21T22:34:22.963558+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.978672+0000","last_change":"2023-07-21T22:34:22.977004+0000","last_active":"2023-07-21T22:34:22.978672+0000","last_peered":"2023-07-21T22:34:22.978672+0000","last_clean":"2023-07-21T22:34:22.978672+0000","last_became_active":"2023-07-21T22:34:22.976750+0000","last_became_peered":"2023-07-21T22:34:22.976750+0000","last_unstale":"2023-07-21T22:34:22.978672+0000","last_undegraded":"2023-07-21T22:34:22.978672+0000","last_fullsized":"2023-07-21T22:34:22.978672+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:48:45.337373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.973226+0000","last_change":"2023-07-21T22:34:22.973226+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.973226+0000","last_undegraded":"2023-07-21T22:34:22.973226+0000","last_fullsized":"2023-07-21T22:34:22.973226+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.972392+0000","last_change":"2023-07-21T22:34:22.970084+0000","last_active":"2023-07-21T22:34:22.972392+0000","last_peered":"2023-07-21T22:34:22.972392+0000","last_clean":"2023-07-21T22:34:22.972392+0000","last_became_active":"2023-07-21T22:34:22.969773+0000","last_became_peered":"2023-07-21T22:34:22.969773+0000","last_unstale":"2023-07-21T22:34:22.972392+0000","last_undegraded":"2023-07-21T22:34:22.972392+0000","last_fullsized":"2023-07-21T22:34:22.972392+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:03:38.882654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.964405+0000","last_change":"2023-07-21T22:34:22.964405+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.964405+0000","last_undegraded":"2023-07-21T22:34:22.964405+0000","last_fullsized":"2023-07-21T22:34:22.964405+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.972601+0000","last_change":"2023-07-21T22:34:22.970835+0000","last_active":"2023-07-21T22:34:22.972601+0000","last_peered":"2023-07-21T22:34:22.972601+0000","last_clean":"2023-07-21T22:34:22.972601+0000","last_became_active":"2023-07-21T22:34:22.970540+0000","last_became_peered":"2023-07-21T22:34:22.970540+0000","last_unstale":"2023-07-21T22:34:22.972601+0000","last_undegraded":"2023-07-21T22:34:22.972601+0000","last_fullsized":"2023-07-21T22:34:22.972601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:12.812980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.959151+0000","last_change":"2023-07-21T22:34:22.959151+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.959151+0000","last_undegraded":"2023-07-21T22:34:22.959151+0000","last_fullsized":"2023-07-21T22:34:22.959151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.969785+0000","last_change":"2023-07-21T22:34:22.968964+0000","last_active":"2023-07-21T22:34:22.969785+0000","last_peered":"2023-07-21T22:34:22.969785+0000","last_clean":"2023-07-21T22:34:22.969785+0000","last_became_active":"2023-07-21T22:34:22.968672+0000","last_became_peered":"2023-07-21T22:34:22.968672+0000","last_unstale":"2023-07-21T22:34:22.969785+0000","last_undegraded":"2023-07-21T22:34:22.969785+0000","last_fullsized":"2023-07-21T22:34:22.969785+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:30:48.994293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.972074+0000","last_change":"2023-07-21T22:34:22.972074+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.972074+0000","last_undegraded":"2023-07-21T22:34:22.972074+0000","last_fullsized":"2023-07-21T22:34:22.972074+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.978608+0000","last_change":"2023-07-21T22:34:22.975818+0000","last_active":"2023-07-21T22:34:22.978608+0000","last_peered":"2023-07-21T22:34:22.978608+0000","last_clean":"2023-07-21T22:34:22.978608+0000","last_became_active":"2023-07-21T22:34:22.975533+0000","last_became_peered":"2023-07-21T22:34:22.975533+0000","last_unstale":"2023-07-21T22:34:22.978608+0000","last_undegraded":"2023-07-21T22:34:22.978608+0000","last_fullsized":"2023-07-21T22:34:22.978608+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:01:04.819418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.960392+0000","last_change":"2023-07-21T22:34:22.960392+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.960392+0000","last_undegraded":"2023-07-21T22:34:22.960392+0000","last_fullsized":"2023-07-21T22:34:22.960392+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.986187+0000","last_change":"2023-07-21T22:34:22.982821+0000","last_active":"2023-07-21T22:34:22.986187+0000","last_peered":"2023-07-21T22:34:22.986187+0000","last_clean":"2023-07-21T22:34:22.986187+0000","last_became_active":"2023-07-21T22:34:22.982493+0000","last_became_peered":"2023-07-21T22:34:22.982493+0000","last_unstale":"2023-07-21T22:34:22.986187+0000","last_undegraded":"2023-07-21T22:34:22.986187+0000","last_fullsized":"2023-07-21T22:34:22.986187+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:25:07.434309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.960328+0000","last_change":"2023-07-21T22:34:22.960328+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.960328+0000","last_undegraded":"2023-07-21T22:34:22.960328+0000","last_fullsized":"2023-07-21T22:34:22.960328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.988365+0000","last_change":"2023-07-21T22:34:22.984655+0000","last_active":"2023-07-21T22:34:22.988365+0000","last_peered":"2023-07-21T22:34:22.988365+0000","last_clean":"2023-07-21T22:34:22.988365+0000","last_became_active":"2023-07-21T22:34:22.984018+0000","last_became_peered":"2023-07-21T22:34:22.984018+0000","last_unstale":"2023-07-21T22:34:22.988365+0000","last_undegraded":"2023-07-21T22:34:22.988365+0000","last_fullsized":"2023-07-21T22:34:22.988365+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:06:10.217482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.960181+0000","last_change":"2023-07-21T22:34:22.960181+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.960181+0000","last_undegraded":"2023-07-21T22:34:22.960181+0000","last_fullsized":"2023-07-21T22:34:22.960181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.987231+0000","last_change":"2023-07-21T22:34:22.980664+0000","last_active":"2023-07-21T22:34:22.987231+0000","last_peered":"2023-07-21T22:34:22.987231+0000","last_clean":"2023-07-21T22:34:22.987231+0000","last_became_active":"2023-07-21T22:34:22.980400+0000","last_became_peered":"2023-07-21T22:34:22.980400+0000","last_unstale":"2023-07-21T22:34:22.987231+0000","last_undegraded":"2023-07-21T22:34:22.987231+0000","last_fullsized":"2023-07-21T22:34:22.987231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:58:26.952281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.971347+0000","last_change":"2023-07-21T22:34:22.971347+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.971347+0000","last_undegraded":"2023-07-21T22:34:22.971347+0000","last_fullsized":"2023-07-21T22:34:22.971347+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.986677+0000","last_change":"2023-07-21T22:34:22.983166+0000","last_active":"2023-07-21T22:34:22.986677+0000","last_peered":"2023-07-21T22:34:22.986677+0000","last_clean":"2023-07-21T22:34:22.986677+0000","last_became_active":"2023-07-21T22:34:22.982456+0000","last_became_peered":"2023-07-21T22:34:22.982456+0000","last_unstale":"2023-07-21T22:34:22.986677+0000","last_undegraded":"2023-07-21T22:34:22.986677+0000","last_fullsized":"2023-07-21T22:34:22.986677+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:35:17.609604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.970705+0000","last_change":"2023-07-21T22:34:22.970705+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.970705+0000","last_undegraded":"2023-07-21T22:34:22.970705+0000","last_fullsized":"2023-07-21T22:34:22.970705+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.984644+0000","last_change":"2023-07-21T22:34:22.983569+0000","last_active":"2023-07-21T22:34:22.984644+0000","last_peered":"2023-07-21T22:34:22.984644+0000","last_clean":"2023-07-21T22:34:22.984644+0000","last_became_active":"2023-07-21T22:34:22.983277+0000","last_became_peered":"2023-07-21T22:34:22.983277+0000","last_unstale":"2023-07-21T22:34:22.984644+0000","last_undegraded":"2023-07-21T22:34:22.984644+0000","last_fullsized":"2023-07-21T22:34:22.984644+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:15:56.139290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.969465+0000","last_change":"2023-07-21T22:34:22.969465+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.969465+0000","last_undegraded":"2023-07-21T22:34:22.969465+0000","last_fullsized":"2023-07-21T22:34:22.969465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.988415+0000","last_change":"2023-07-21T22:34:22.985264+0000","last_active":"2023-07-21T22:34:22.988415+0000","last_peered":"2023-07-21T22:34:22.988415+0000","last_clean":"2023-07-21T22:34:22.988415+0000","last_became_active":"2023-07-21T22:34:22.984946+0000","last_became_peered":"2023-07-21T22:34:22.984946+0000","last_unstale":"2023-07-21T22:34:22.988415+0000","last_undegraded":"2023-07-21T22:34:22.988415+0000","last_fullsized":"2023-07-21T22:34:22.988415+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:26:07.917220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.966612+0000","last_change":"2023-07-21T22:34:22.966612+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.966612+0000","last_undegraded":"2023-07-21T22:34:22.966612+0000","last_fullsized":"2023-07-21T22:34:22.966612+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.983406+0000","last_change":"2023-07-21T22:34:22.978391+0000","last_active":"2023-07-21T22:34:22.983406+0000","last_peered":"2023-07-21T22:34:22.983406+0000","last_clean":"2023-07-21T22:34:22.983406+0000","last_became_active":"2023-07-21T22:34:22.978125+0000","last_became_peered":"2023-07-21T22:34:22.978125+0000","last_unstale":"2023-07-21T22:34:22.983406+0000","last_undegraded":"2023-07-21T22:34:22.983406+0000","last_fullsized":"2023-07-21T22:34:22.983406+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:33:37.265284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.971653+0000","last_change":"2023-07-21T22:34:22.971653+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.971653+0000","last_undegraded":"2023-07-21T22:34:22.971653+0000","last_fullsized":"2023-07-21T22:34:22.971653+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.986670+0000","last_change":"2023-07-21T22:34:22.983579+0000","last_active":"2023-07-21T22:34:22.986670+0000","last_peered":"2023-07-21T22:34:22.986670+0000","last_clean":"2023-07-21T22:34:22.986670+0000","last_became_active":"2023-07-21T22:34:22.983241+0000","last_became_peered":"2023-07-21T22:34:22.983241+0000","last_unstale":"2023-07-21T22:34:22.986670+0000","last_undegraded":"2023-07-21T22:34:22.986670+0000","last_fullsized":"2023-07-21T22:34:22.986670+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:49:29.136005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.959044+0000","last_change":"2023-07-21T22:34:22.959044+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.959044+0000","last_undegraded":"2023-07-21T22:34:22.959044+0000","last_fullsized":"2023-07-21T22:34:22.959044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.987706+0000","last_change":"2023-07-21T22:34:22.985768+0000","last_active":"2023-07-21T22:34:22.987706+0000","last_peered":"2023-07-21T22:34:22.987706+0000","last_clean":"2023-07-21T22:34:22.987706+0000","last_became_active":"2023-07-21T22:34:22.985453+0000","last_became_peered":"2023-07-21T22:34:22.985453+0000","last_unstale":"2023-07-21T22:34:22.987706+0000","last_undegraded":"2023-07-21T22:34:22.987706+0000","last_fullsized":"2023-07-21T22:34:22.987706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:56:31.677979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.963788+0000","last_change":"2023-07-21T22:34:22.963788+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.963788+0000","last_undegraded":"2023-07-21T22:34:22.963788+0000","last_fullsized":"2023-07-21T22:34:22.963788+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.987643+0000","last_change":"2023-07-21T22:34:22.982600+0000","last_active":"2023-07-21T22:34:22.987643+0000","last_peered":"2023-07-21T22:34:22.987643+0000","last_clean":"2023-07-21T22:34:22.987643+0000","last_became_active":"2023-07-21T22:34:22.982315+0000","last_became_peered":"2023-07-21T22:34:22.982315+0000","last_unstale":"2023-07-21T22:34:22.987643+0000","last_undegraded":"2023-07-21T22:34:22.987643+0000","last_fullsized":"2023-07-21T22:34:22.987643+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:19.158521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.966518+0000","last_change":"2023-07-21T22:34:22.966518+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.966518+0000","last_undegraded":"2023-07-21T22:34:22.966518+0000","last_fullsized":"2023-07-21T22:34:22.966518+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.983344+0000","last_change":"2023-07-21T22:34:22.979042+0000","last_active":"2023-07-21T22:34:22.983344+0000","last_peered":"2023-07-21T22:34:22.983344+0000","last_clean":"2023-07-21T22:34:22.983344+0000","last_became_active":"2023-07-21T22:34:22.978740+0000","last_became_peered":"2023-07-21T22:34:22.978740+0000","last_unstale":"2023-07-21T22:34:22.983344+0000","last_undegraded":"2023-07-21T22:34:22.983344+0000","last_fullsized":"2023-07-21T22:34:22.983344+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:01:46.331107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.965071+0000","last_change":"2023-07-21T22:34:22.965071+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.965071+0000","last_undegraded":"2023-07-21T22:34:22.965071+0000","last_fullsized":"2023-07-21T22:34:22.965071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.978194+0000","last_change":"2023-07-21T22:34:22.977004+0000","last_active":"2023-07-21T22:34:22.978194+0000","last_peered":"2023-07-21T22:34:22.978194+0000","last_clean":"2023-07-21T22:34:22.978194+0000","last_became_active":"2023-07-21T22:34:22.976697+0000","last_became_peered":"2023-07-21T22:34:22.976697+0000","last_unstale":"2023-07-21T22:34:22.978194+0000","last_undegraded":"2023-07-21T22:34:22.978194+0000","last_fullsized":"2023-07-21T22:34:22.978194+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:49:11.617598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.970155+0000","last_change":"2023-07-21T22:34:22.970155+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.970155+0000","last_undegraded":"2023-07-21T22:34:22.970155+0000","last_fullsized":"2023-07-21T22:34:22.970155+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.984663+0000","last_change":"2023-07-21T22:34:22.983643+0000","last_active":"2023-07-21T22:34:22.984663+0000","last_peered":"2023-07-21T22:34:22.984663+0000","last_clean":"2023-07-21T22:34:22.984663+0000","last_became_active":"2023-07-21T22:34:22.983314+0000","last_became_peered":"2023-07-21T22:34:22.983314+0000","last_unstale":"2023-07-21T22:34:22.984663+0000","last_undegraded":"2023-07-21T22:34:22.984663+0000","last_fullsized":"2023-07-21T22:34:22.984663+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:01:04.819418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.973144+0000","last_change":"2023-07-21T22:34:22.973144+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.973144+0000","last_undegraded":"2023-07-21T22:34:22.973144+0000","last_fullsized":"2023-07-21T22:34:22.973144+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.986725+0000","last_change":"2023-07-21T22:34:22.982875+0000","last_active":"2023-07-21T22:34:22.986725+0000","last_peered":"2023-07-21T22:34:22.986725+0000","last_clean":"2023-07-21T22:34:22.986725+0000","last_became_active":"2023-07-21T22:34:22.982387+0000","last_became_peered":"2023-07-21T22:34:22.982387+0000","last_unstale":"2023-07-21T22:34:22.986725+0000","last_undegraded":"2023-07-21T22:34:22.986725+0000","last_fullsized":"2023-07-21T22:34:22.986725+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:07:10.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.970000+0000","last_change":"2023-07-21T22:34:22.970000+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.970000+0000","last_undegraded":"2023-07-21T22:34:22.970000+0000","last_fullsized":"2023-07-21T22:34:22.970000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.969651+0000","last_change":"2023-07-21T22:34:22.967847+0000","last_active":"2023-07-21T22:34:22.969651+0000","last_peered":"2023-07-21T22:34:22.969651+0000","last_clean":"2023-07-21T22:34:22.969651+0000","last_became_active":"2023-07-21T22:34:22.967434+0000","last_became_peered":"2023-07-21T22:34:22.967434+0000","last_unstale":"2023-07-21T22:34:22.969651+0000","last_undegraded":"2023-07-21T22:34:22.969651+0000","last_fullsized":"2023-07-21T22:34:22.969651+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:44.868411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.959025+0000","last_change":"2023-07-21T22:34:22.959025+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.959025+0000","last_undegraded":"2023-07-21T22:34:22.959025+0000","last_fullsized":"2023-07-21T22:34:22.959025+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.977760+0000","last_change":"2023-07-21T22:34:22.976249+0000","last_active":"2023-07-21T22:34:22.977760+0000","last_peered":"2023-07-21T22:34:22.977760+0000","last_clean":"2023-07-21T22:34:22.977760+0000","last_became_active":"2023-07-21T22:34:22.975817+0000","last_became_peered":"2023-07-21T22:34:22.975817+0000","last_unstale":"2023-07-21T22:34:22.977760+0000","last_undegraded":"2023-07-21T22:34:22.977760+0000","last_fullsized":"2023-07-21T22:34:22.977760+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:15:56.139290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.966153+0000","last_change":"2023-07-21T22:34:22.966153+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.966153+0000","last_undegraded":"2023-07-21T22:34:22.966153+0000","last_fullsized":"2023-07-21T22:34:22.966153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.978805+0000","last_change":"2023-07-21T22:34:22.976771+0000","last_active":"2023-07-21T22:34:22.978805+0000","last_peered":"2023-07-21T22:34:22.978805+0000","last_clean":"2023-07-21T22:34:22.978805+0000","last_became_active":"2023-07-21T22:34:22.976478+0000","last_became_peered":"2023-07-21T22:34:22.976478+0000","last_unstale":"2023-07-21T22:34:22.978805+0000","last_undegraded":"2023-07-21T22:34:22.978805+0000","last_fullsized":"2023-07-21T22:34:22.978805+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:05:09.796569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.972967+0000","last_change":"2023-07-21T22:34:22.972967+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.972967+0000","last_undegraded":"2023-07-21T22:34:22.972967+0000","last_fullsized":"2023-07-21T22:34:22.972967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.973819+0000","last_change":"2023-07-21T22:34:22.971793+0000","last_active":"2023-07-21T22:34:22.973819+0000","last_peered":"2023-07-21T22:34:22.973819+0000","last_clean":"2023-07-21T22:34:22.973819+0000","last_became_active":"2023-07-21T22:34:22.971485+0000","last_became_peered":"2023-07-21T22:34:22.971485+0000","last_unstale":"2023-07-21T22:34:22.973819+0000","last_undegraded":"2023-07-21T22:34:22.973819+0000","last_fullsized":"2023-07-21T22:34:22.973819+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:22:11.349369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"72'161","reported_seq":436,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.975168+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:34:22.975168+0000","last_peered":"2023-07-21T22:34:22.975168+0000","last_clean":"2023-07-21T22:34:22.975168+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:34:22.975168+0000","last_undegraded":"2023-07-21T22:34:22.975168+0000","last_fullsized":"2023-07-21T22:34:22.975168+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:46:27.179436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":134,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.973841+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:34:22.973841+0000","last_peered":"2023-07-21T22:34:22.973841+0000","last_clean":"2023-07-21T22:34:22.973841+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:34:22.973841+0000","last_undegraded":"2023-07-21T22:34:22.973841+0000","last_fullsized":"2023-07-21T22:34:22.973841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:41:19.821082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.964867+0000","last_change":"2023-07-21T22:34:22.964867+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.964867+0000","last_undegraded":"2023-07-21T22:34:22.964867+0000","last_fullsized":"2023-07-21T22:34:22.964867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.979996+0000","last_change":"2023-07-21T22:34:22.978762+0000","last_active":"2023-07-21T22:34:22.979996+0000","last_peered":"2023-07-21T22:34:22.979996+0000","last_clean":"2023-07-21T22:34:22.979996+0000","last_became_active":"2023-07-21T22:34:22.978367+0000","last_became_peered":"2023-07-21T22:34:22.978367+0000","last_unstale":"2023-07-21T22:34:22.979996+0000","last_undegraded":"2023-07-21T22:34:22.979996+0000","last_fullsized":"2023-07-21T22:34:22.979996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:10:17.406840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":124,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.975023+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:34:22.975023+0000","last_peered":"2023-07-21T22:34:22.975023+0000","last_clean":"2023-07-21T22:34:22.975023+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:34:22.975023+0000","last_undegraded":"2023-07-21T22:34:22.975023+0000","last_fullsized":"2023-07-21T22:34:22.975023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:27:19.100104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.966137+0000","last_change":"2023-07-21T22:34:22.966137+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.966137+0000","last_undegraded":"2023-07-21T22:34:22.966137+0000","last_fullsized":"2023-07-21T22:34:22.966137+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.983387+0000","last_change":"2023-07-21T22:34:22.977887+0000","last_active":"2023-07-21T22:34:22.983387+0000","last_peered":"2023-07-21T22:34:22.983387+0000","last_clean":"2023-07-21T22:34:22.983387+0000","last_became_active":"2023-07-21T22:34:22.977599+0000","last_became_peered":"2023-07-21T22:34:22.977599+0000","last_unstale":"2023-07-21T22:34:22.983387+0000","last_undegraded":"2023-07-21T22:34:22.983387+0000","last_fullsized":"2023-07-21T22:34:22.983387+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:49:14.669970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":120,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.965779+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:34:22.965779+0000","last_peered":"2023-07-21T22:34:22.965779+0000","last_clean":"2023-07-21T22:34:22.965779+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:34:22.965779+0000","last_undegraded":"2023-07-21T22:34:22.965779+0000","last_fullsized":"2023-07-21T22:34:22.965779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:59:15.005858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.971203+0000","last_change":"2023-07-21T22:34:22.971203+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.971203+0000","last_undegraded":"2023-07-21T22:34:22.971203+0000","last_fullsized":"2023-07-21T22:34:22.971203+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.982560+0000","last_change":"2023-07-21T22:34:22.981350+0000","last_active":"2023-07-21T22:34:22.982560+0000","last_peered":"2023-07-21T22:34:22.982560+0000","last_clean":"2023-07-21T22:34:22.982560+0000","last_became_active":"2023-07-21T22:34:22.981023+0000","last_became_peered":"2023-07-21T22:34:22.981023+0000","last_unstale":"2023-07-21T22:34:22.982560+0000","last_undegraded":"2023-07-21T22:34:22.982560+0000","last_fullsized":"2023-07-21T22:34:22.982560+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:31:22.360596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":134,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.969433+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:34:22.969433+0000","last_peered":"2023-07-21T22:34:22.969433+0000","last_clean":"2023-07-21T22:34:22.969433+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:34:22.969433+0000","last_undegraded":"2023-07-21T22:34:22.969433+0000","last_fullsized":"2023-07-21T22:34:22.969433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:14:54.887911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.972267+0000","last_change":"2023-07-21T22:34:22.972267+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.972267+0000","last_undegraded":"2023-07-21T22:34:22.972267+0000","last_fullsized":"2023-07-21T22:34:22.972267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.983318+0000","last_change":"2023-07-21T22:34:22.978160+0000","last_active":"2023-07-21T22:34:22.983318+0000","last_peered":"2023-07-21T22:34:22.983318+0000","last_clean":"2023-07-21T22:34:22.983318+0000","last_became_active":"2023-07-21T22:34:22.977862+0000","last_became_peered":"2023-07-21T22:34:22.977862+0000","last_unstale":"2023-07-21T22:34:22.983318+0000","last_undegraded":"2023-07-21T22:34:22.983318+0000","last_fullsized":"2023-07-21T22:34:22.983318+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:59:01.611604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":130,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.956755+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:34:22.956755+0000","last_peered":"2023-07-21T22:34:22.956755+0000","last_clean":"2023-07-21T22:34:22.956755+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:34:22.956755+0000","last_undegraded":"2023-07-21T22:34:22.956755+0000","last_fullsized":"2023-07-21T22:34:22.956755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:11:00.189296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.970837+0000","last_change":"2023-07-21T22:34:22.970837+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.970837+0000","last_undegraded":"2023-07-21T22:34:22.970837+0000","last_fullsized":"2023-07-21T22:34:22.970837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.988827+0000","last_change":"2023-07-21T22:34:22.987856+0000","last_active":"2023-07-21T22:34:22.988827+0000","last_peered":"2023-07-21T22:34:22.988827+0000","last_clean":"2023-07-21T22:34:22.988827+0000","last_became_active":"2023-07-21T22:34:22.987572+0000","last_became_peered":"2023-07-21T22:34:22.987572+0000","last_unstale":"2023-07-21T22:34:22.988827+0000","last_undegraded":"2023-07-21T22:34:22.988827+0000","last_fullsized":"2023-07-21T22:34:22.988827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:03:52.170931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":124,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.976477+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:34:22.976477+0000","last_peered":"2023-07-21T22:34:22.976477+0000","last_clean":"2023-07-21T22:34:22.976477+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:34:22.976477+0000","last_undegraded":"2023-07-21T22:34:22.976477+0000","last_fullsized":"2023-07-21T22:34:22.976477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:52:26.545137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.971005+0000","last_change":"2023-07-21T22:34:22.971005+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.971005+0000","last_undegraded":"2023-07-21T22:34:22.971005+0000","last_fullsized":"2023-07-21T22:34:22.971005+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.986696+0000","last_change":"2023-07-21T22:34:22.983383+0000","last_active":"2023-07-21T22:34:22.986696+0000","last_peered":"2023-07-21T22:34:22.986696+0000","last_clean":"2023-07-21T22:34:22.986696+0000","last_became_active":"2023-07-21T22:34:22.982810+0000","last_became_peered":"2023-07-21T22:34:22.982810+0000","last_unstale":"2023-07-21T22:34:22.986696+0000","last_undegraded":"2023-07-21T22:34:22.986696+0000","last_fullsized":"2023-07-21T22:34:22.986696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:50:18.545123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":130,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.956416+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:34:22.956416+0000","last_peered":"2023-07-21T22:34:22.956416+0000","last_clean":"2023-07-21T22:34:22.956416+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:34:22.956416+0000","last_undegraded":"2023-07-21T22:34:22.956416+0000","last_fullsized":"2023-07-21T22:34:22.956416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:49:28.133865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":82,"state":"creating+peering","last_fresh":"2023-07-21T22:34:22.969581+0000","last_change":"2023-07-21T22:34:22.969581+0000","last_active":"2023-07-21T22:34:22.943038+0000","last_peered":"2023-07-21T22:34:22.943038+0000","last_clean":"2023-07-21T22:34:22.943038+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:34:22.969581+0000","last_undegraded":"2023-07-21T22:34:22.969581+0000","last_fullsized":"2023-07-21T22:34:22.969581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.984208+0000","last_change":"2023-07-21T22:34:22.983391+0000","last_active":"2023-07-21T22:34:22.984208+0000","last_peered":"2023-07-21T22:34:22.984208+0000","last_clean":"2023-07-21T22:34:22.984208+0000","last_became_active":"2023-07-21T22:34:22.983074+0000","last_became_peered":"2023-07-21T22:34:22.983074+0000","last_unstale":"2023-07-21T22:34:22.984208+0000","last_undegraded":"2023-07-21T22:34:22.984208+0000","last_fullsized":"2023-07-21T22:34:22.984208+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:05:09.796569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":122,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-07-21T22:34:22.970473+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:34:22.970473+0000","last_peered":"2023-07-21T22:34:22.970473+0000","last_clean":"2023-07-21T22:34:22.970473+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:34:22.970473+0000","last_undegraded":"2023-07-21T22:34:22.970473+0000","last_fullsized":"2023-07-21T22:34:22.970473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:48:28.934992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509631,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54732,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317108,"statfs":{"total":96636764160,"available":96580718592,"internally_reserved":0,"allocated":1576960,"data_stored":1074115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.752,"15min":0.73999999999999999},"min":{"1min":0.53600000000000003,"5min":0.35299999999999998,"15min":0.32600000000000001},"max":{"1min":0.96399999999999997,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71499999999999997,"15min":0.69599999999999995},"min":{"1min":0.55300000000000005,"5min":0.39500000000000002,"15min":0.36099999999999999},"max":{"1min":0.94399999999999995,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.63}]},{"osd":1,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.73699999999999999},"min":{"1min":0.46800000000000003,"5min":0.432,"15min":0.379},"max":{"1min":1.0680000000000001,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.56799999999999995,"5min":0.44,"15min":0.44},"max":{"1min":0.95099999999999996,"5min":1.0129999999999999,"15min":1.0409999999999999},"last":0.73999999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73799999999999999,"15min":0.74299999999999999},"min":{"1min":0.53100000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.405},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73599999999999999,"15min":0.752},"min":{"1min":0.59399999999999997,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94599999999999995,"5min":1.409,"15min":1.409},"last":0.78700000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.754,"15min":0.76600000000000001},"min":{"1min":0.58399999999999996,"5min":0.504,"15min":0.42099999999999999},"max":{"1min":1.0409999999999999,"5min":1.46,"15min":1.46},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.75900000000000001,"15min":0.75800000000000001},"min":{"1min":0.63400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54900000000000004,"15min":0.56200000000000006},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.90000000000000002,"5min":0.90500000000000003,"15min":1.244},"last":0.495},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.62,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97399999999999998,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63800000000000001,"15min":0.61899999999999999},"min":{"1min":0.51800000000000002,"5min":0.40400000000000003,"15min":0.40300000000000002},"max":{"1min":0.81200000000000006,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66300000000000003,"15min":0.68000000000000005},"min":{"1min":0.49299999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91300000000000003,"5min":1.506,"15min":1.506},"last":0.71699999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.66900000000000004,"15min":0.68000000000000005},"min":{"1min":0.57099999999999995,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93999999999999995,"5min":0.94399999999999995,"15min":1.048},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61699999999999999,"15min":0.63900000000000001},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.98599999999999999},"last":0.58099999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542337,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":983040,"data_stored":483747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76700000000000002,"15min":0.76500000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.425},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.59199999999999997,"5min":0.57899999999999996,"15min":0.437},"max":{"1min":1.0289999999999999,"5min":1.1180000000000001,"15min":2.3100000000000001},"last":0.90400000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.55700000000000005,"5min":0.45300000000000001,"15min":0.41999999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.99199999999999999,"5min":0.99399999999999999,"15min":8.6280000000000001},"last":0.80600000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.55600000000000005,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.55},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.80700000000000005,"15min":0.79600000000000004},"min":{"1min":0.59699999999999998,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":1.097,"15min":1.097},"last":0.753}]},{"osd":3,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.60399999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.7470000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.58399999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92800000000000005,"5min":1.0049999999999999,"15min":1.5129999999999999},"last":0.72899999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.374,"15min":0.36599999999999999},"max":{"1min":0.93400000000000005,"5min":1.0229999999999999,"15min":3.1829999999999998},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.80100000000000005,"5min":0.86199999999999999,"15min":2.887},"last":0.871}]},{"osd":5,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60899999999999999,"15min":0.61899999999999999},"min":{"1min":0.437,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82799999999999996,"5min":0.96299999999999997,"15min":1.4510000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.50900000000000001,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.88400000000000001,"5min":0.98799999999999999,"15min":1.054},"last":0.85899999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.52400000000000002,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":0.93600000000000005,"5min":1.079,"15min":1.1679999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68899999999999995,"15min":0.71499999999999997},"min":{"1min":0.54100000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82499999999999996,"5min":1.0449999999999999,"15min":8.0760000000000005},"last":0.83799999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509630,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":970752,"data_stored":477083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72799999999999998,"15min":0.71599999999999997},"min":{"1min":0.53000000000000003,"5min":0.35699999999999998,"15min":0.32900000000000001},"max":{"1min":1,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47599999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.59999999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69399999999999995,"15min":0.71399999999999997},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.505,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":1.617,"15min":1.617},"last":0.67600000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71799999999999997,"15min":0.73599999999999999},"min":{"1min":0.53300000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.92800000000000005,"5min":1.0109999999999999,"15min":1.034},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.53300000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.90800000000000003,"5min":1.512,"15min":1.512},"last":0.86399999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.77200000000000002,"15min":0.78700000000000003},"min":{"1min":0.61299999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98599999999999999,"5min":1.472,"15min":1.472},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.80300000000000005,"15min":0.79700000000000004},"min":{"1min":0.56899999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.022,"5min":1.556,"15min":1.556},"last":0.90800000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.48899999999999999,"5min":0.48599999999999999,"15min":0.44900000000000001},"max":{"1min":0.92400000000000004,"5min":1.012,"15min":1.038},"last":0.88200000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70499999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.62,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92500000000000004,"5min":1.02,"15min":1.02},"last":0.747}]},{"osd":7,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.64800000000000002,"15min":0.65200000000000002},"min":{"1min":0.55500000000000005,"5min":0.374,"15min":0.374},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.72499999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.85899999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.999}]}]},{"osd":4,"up_from":15,"seq":64424509631,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":970752,"data_stored":477083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.746,"15min":0.747},"min":{"1min":0.55700000000000005,"5min":0.438,"15min":0.40000000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.0429999999999999},"last":0.623},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.746,"15min":0.746},"min":{"1min":0.55000000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95099999999999996,"5min":0.96099999999999997,"15min":0.99099999999999999},"last":0.65000000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70499999999999996,"15min":0.70399999999999996},"min":{"1min":0.53400000000000003,"5min":0.43099999999999999,"15min":0.39400000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.0449999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.60899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93000000000000005,"5min":0.94299999999999995,"15min":1.016},"last":0.67200000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.59299999999999997,"5min":0.371,"15min":0.371},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.57799999999999996,"5min":0.41999999999999998,"15min":0.33000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.505,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":1.026},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.80200000000000005,"15min":0.79200000000000004},"min":{"1min":0.70399999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.996,"5min":0.996,"15min":1.018},"last":0.871}]},{"osd":5,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.441,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72299999999999998,"5min":0.81599999999999995,"15min":0.94299999999999995},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.59299999999999997},"min":{"1min":0.38800000000000001,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.79600000000000004,"5min":0.91000000000000003,"15min":1.0680000000000001},"last":0.59499999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.45800000000000002,"5min":0.41299999999999998,"15min":0.38500000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70099999999999996,"15min":0.72599999999999998},"min":{"1min":0.52200000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91400000000000003,"5min":0.98999999999999999,"15min":1.272},"last":0.83399999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.628,"15min":0.65800000000000003},"min":{"1min":0.499,"5min":0.39200000000000002,"15min":0.374},"max":{"1min":0.91300000000000003,"5min":1.0069999999999999,"15min":1.3300000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68000000000000005,"15min":0.69299999999999995},"min":{"1min":0.53100000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.135},"last":0.81399999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509630,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":970752,"data_stored":477083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.48799999999999999,"15min":0.48099999999999998},"min":{"1min":0.35099999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70499999999999996,"5min":0.73099999999999998,"15min":0.76400000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.43099999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.30099999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.871},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.94199999999999995},"last":0.30199999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82899999999999996,"5min":1.0449999999999999,"15min":1.1140000000000001},"last":0.378},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45500000000000002,"5min":0.45100000000000001,"15min":0.40999999999999998},"max":{"1min":0.84399999999999997,"5min":0.95399999999999996,"15min":0.99199999999999999},"last":0.41399999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.57599999999999996,"5min":0.48299999999999998,"15min":0.438},"max":{"1min":1.093,"5min":1.093,"15min":1.3240000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82199999999999995,"15min":0.83299999999999996},"min":{"1min":0.68799999999999994,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.488},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.60699999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0669999999999999,"5min":1.137,"15min":1.1919999999999999},"last":0.501},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.60399999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0649999999999999,"15min":1.302},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79200000000000004,"15min":0.80100000000000005},"min":{"1min":0.68000000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.02,"5min":1.056,"15min":1.3979999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76500000000000001,"15min":0.78000000000000003},"min":{"1min":0.56899999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0269999999999999,"5min":1.1120000000000001,"15min":1.3899999999999999},"last":0.53100000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.81000000000000005,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0089999999999999,"5min":1.087,"15min":1.335},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.873,"5min":0.83699999999999997,"15min":0.83499999999999996},"min":{"1min":0.66100000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.2130000000000001},"last":0.69099999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509632,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54152,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317688,"statfs":{"total":96636764160,"available":96581312512,"internally_reserved":0,"allocated":983040,"data_stored":483747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.29099999999999998,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.69399999999999995,"5min":0.81200000000000006,"15min":0.94199999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53600000000000003,"15min":0.54900000000000004},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.88300000000000001,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.28199999999999997},"max":{"1min":0.82999999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80700000000000005,"5min":1.085,"15min":1.085},"last":0.48699999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.37,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.379},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55300000000000005,"15min":0.56899999999999995},"min":{"1min":0.43099999999999999,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":1.161,"15min":1.161},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.67600000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.1579999999999999,"5min":1.2569999999999999,"15min":1.6870000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.79400000000000004,"15min":0.80200000000000005},"min":{"1min":0.57699999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.175,"5min":1.1950000000000001,"15min":1.2689999999999999},"last":0.60799999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.63200000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.2549999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.60599999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.107,"5min":1.206,"15min":1.3089999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.78600000000000003,"15min":0.79800000000000004},"min":{"1min":0.69399999999999995,"5min":0.45500000000000002,"15min":0.40300000000000002},"max":{"1min":1.089,"5min":1.282,"15min":1.3759999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.64300000000000002,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.1339999999999999,"5min":1.23,"15min":1.2649999999999999},"last":0.65200000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.80900000000000005,"15min":0.82899999999999996},"min":{"1min":0.64900000000000002,"5min":0.51100000000000001,"15min":0.49099999999999999},"max":{"1min":1.143,"5min":1.2,"15min":1.2909999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.60999999999999999,"5min":0.44900000000000001,"15min":0.44700000000000001},"max":{"1min":1.091,"5min":1.216,"15min":1.3660000000000001},"last":0.68899999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509631,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":983040,"data_stored":483747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48899999999999999,"15min":0.504},"min":{"1min":0.32600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.66700000000000004,"5min":0.84599999999999997,"15min":5.4800000000000004},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.58799999999999997},"min":{"1min":0.49399999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.872,"15min":5.2830000000000004},"last":0.626}]},{"osd":2,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.39900000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72999999999999998,"5min":0.76100000000000001,"15min":3.4220000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.29099999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.88800000000000001},"last":0.68500000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59499999999999997,"15min":0.60999999999999999},"min":{"1min":0.48899999999999999,"5min":0.35799999999999998,"15min":0.33400000000000002},"max":{"1min":0.73499999999999999,"5min":0.84299999999999997,"15min":3.2469999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51700000000000002,"15min":0.53700000000000003},"min":{"1min":0.36799999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":5.8710000000000004},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.58699999999999997,"5min":0.432,"15min":0.432},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":3.6259999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.63100000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.97399999999999998,"5min":1.083,"15min":4.4100000000000001},"last":0.77000000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.77600000000000002,"15min":0.80200000000000005},"min":{"1min":0.64800000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0609999999999999,"5min":1.115,"15min":5.766},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.80100000000000005,"15min":0.81299999999999994},"min":{"1min":0.57899999999999996,"5min":0.376,"15min":0.376},"max":{"1min":1.0980000000000001,"5min":1.1279999999999999,"15min":3.669},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.66700000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0429999999999999,"5min":1.085,"15min":1.23},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77800000000000002,"15min":0.81499999999999995},"min":{"1min":0.55100000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.083,"5min":1.1020000000000001,"15min":5.8200000000000003},"last":0.747}]},{"osd":7,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.79800000000000004,"15min":0.83099999999999996},"min":{"1min":0.59599999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.028,"5min":1.103,"15min":5.9269999999999996},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.60299999999999998,"5min":0.52600000000000002,"15min":0.45700000000000002},"max":{"1min":1.115,"5min":1.115,"15min":3.5800000000000001},"last":0.78900000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509633,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1576960,"data_stored":1074115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.50800000000000001},"min":{"1min":0.35899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.67900000000000005,"5min":0.77800000000000002,"15min":0.83199999999999996},"last":0.502}]},{"osd":2,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70999999999999996,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.44,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58199999999999996,"5min":0.871,"15min":0.871},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.35899999999999999,"15min":0.34899999999999998},"max":{"1min":0.76500000000000001,"5min":0.88100000000000001,"15min":0.91300000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.434,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73999999999999999,"5min":1.038,"15min":1.038},"last":0.55300000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.76100000000000001,"15min":0.78100000000000003},"min":{"1min":0.59299999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.321},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.60099999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.093,"5min":1.423,"15min":1.423},"last":0.97299999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.60299999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0960000000000001,"5min":1.2669999999999999,"15min":1.28},"last":1.036},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.78400000000000003,"15min":0.80900000000000005},"min":{"1min":0.70599999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.393},"last":0.95699999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78500000000000003,"15min":0.81299999999999994},"min":{"1min":0.61799999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.28},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81399999999999995,"15min":0.81999999999999995},"min":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.131,"5min":1.333,"15min":1.333},"last":0.92600000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.65900000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.2310000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.80900000000000005,"15min":0.83399999999999996},"min":{"1min":0.60599999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1930000000000001,"5min":1.296,"15min":1.369},"last":0.90500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:34:28.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3f is not active+clean 2023-07-21T22:34:28.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.960487+0000', 'last_change': '2023-07-21T22:34:22.960487+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.960487+0000', 'last_undegraded': '2023-07-21T22:34:22.960487+0000', 'last_fullsized': '2023-07-21T22:34:22.960487+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:34:28.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3e is not active+clean 2023-07-21T22:34:28.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.959374+0000', 'last_change': '2023-07-21T22:34:22.959374+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.959374+0000', 'last_undegraded': '2023-07-21T22:34:22.959374+0000', 'last_fullsized': '2023-07-21T22:34:22.959374+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:34:28.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3d is not active+clean 2023-07-21T22:34:28.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.971829+0000', 'last_change': '2023-07-21T22:34:22.971829+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.971829+0000', 'last_undegraded': '2023-07-21T22:34:22.971829+0000', 'last_fullsized': '2023-07-21T22:34:22.971829+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:34:28.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3c is not active+clean 2023-07-21T22:34:28.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.973347+0000', 'last_change': '2023-07-21T22:34:22.973347+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.973347+0000', 'last_undegraded': '2023-07-21T22:34:22.973347+0000', 'last_fullsized': '2023-07-21T22:34:22.973347+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:34:28.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3b is not active+clean 2023-07-21T22:34:28.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.973406+0000', 'last_change': '2023-07-21T22:34:22.973406+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.973406+0000', 'last_undegraded': '2023-07-21T22:34:22.973406+0000', 'last_fullsized': '2023-07-21T22:34:22.973406+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:34:28.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3a is not active+clean 2023-07-21T22:34:28.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.964323+0000', 'last_change': '2023-07-21T22:34:22.964323+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.964323+0000', 'last_undegraded': '2023-07-21T22:34:22.964323+0000', 'last_fullsized': '2023-07-21T22:34:22.964323+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:34:28.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.39 is not active+clean 2023-07-21T22:34:28.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.965480+0000', 'last_change': '2023-07-21T22:34:22.965480+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.965480+0000', 'last_undegraded': '2023-07-21T22:34:22.965480+0000', 'last_fullsized': '2023-07-21T22:34:22.965480+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:34:28.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2023-07-21T22:34:28.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.964672+0000', 'last_change': '2023-07-21T22:34:22.964672+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.964672+0000', 'last_undegraded': '2023-07-21T22:34:22.964672+0000', 'last_fullsized': '2023-07-21T22:34:22.964672+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:34:28.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2023-07-21T22:34:28.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.972662+0000', 'last_change': '2023-07-21T22:34:22.972662+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.972662+0000', 'last_undegraded': '2023-07-21T22:34:22.972662+0000', 'last_fullsized': '2023-07-21T22:34:22.972662+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:34:28.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.36 is not active+clean 2023-07-21T22:34:28.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.968212+0000', 'last_change': '2023-07-21T22:34:22.968212+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.968212+0000', 'last_undegraded': '2023-07-21T22:34:22.968212+0000', 'last_fullsized': '2023-07-21T22:34:22.968212+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:34:28.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.35 is not active+clean 2023-07-21T22:34:28.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.978022+0000', 'last_change': '2023-07-21T22:34:22.978022+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.978022+0000', 'last_undegraded': '2023-07-21T22:34:22.978022+0000', 'last_fullsized': '2023-07-21T22:34:22.978022+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:34:28.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2023-07-21T22:34:28.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.965579+0000', 'last_change': '2023-07-21T22:34:22.965579+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.965579+0000', 'last_undegraded': '2023-07-21T22:34:22.965579+0000', 'last_fullsized': '2023-07-21T22:34:22.965579+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:34:28.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.33 is not active+clean 2023-07-21T22:34:28.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.965320+0000', 'last_change': '2023-07-21T22:34:22.965320+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.965320+0000', 'last_undegraded': '2023-07-21T22:34:22.965320+0000', 'last_fullsized': '2023-07-21T22:34:22.965320+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:34:28.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.32 is not active+clean 2023-07-21T22:34:28.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.972531+0000', 'last_change': '2023-07-21T22:34:22.972531+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.972531+0000', 'last_undegraded': '2023-07-21T22:34:22.972531+0000', 'last_fullsized': '2023-07-21T22:34:22.972531+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:34:28.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.31 is not active+clean 2023-07-21T22:34:28.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.968640+0000', 'last_change': '2023-07-21T22:34:22.968640+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.968640+0000', 'last_undegraded': '2023-07-21T22:34:22.968640+0000', 'last_fullsized': '2023-07-21T22:34:22.968640+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:34:28.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.30 is not active+clean 2023-07-21T22:34:28.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.965009+0000', 'last_change': '2023-07-21T22:34:22.965009+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.965009+0000', 'last_undegraded': '2023-07-21T22:34:22.965009+0000', 'last_fullsized': '2023-07-21T22:34:22.965009+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:34:28.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2f is not active+clean 2023-07-21T22:34:28.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.959901+0000', 'last_change': '2023-07-21T22:34:22.959901+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.959901+0000', 'last_undegraded': '2023-07-21T22:34:22.959901+0000', 'last_fullsized': '2023-07-21T22:34:22.959901+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:34:28.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2e is not active+clean 2023-07-21T22:34:28.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.975064+0000', 'last_change': '2023-07-21T22:34:22.975064+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.975064+0000', 'last_undegraded': '2023-07-21T22:34:22.975064+0000', 'last_fullsized': '2023-07-21T22:34:22.975064+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:34:28.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2d is not active+clean 2023-07-21T22:34:28.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.974975+0000', 'last_change': '2023-07-21T22:34:22.974975+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.974975+0000', 'last_undegraded': '2023-07-21T22:34:22.974975+0000', 'last_fullsized': '2023-07-21T22:34:22.974975+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:34:28.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2c is not active+clean 2023-07-21T22:34:28.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.960589+0000', 'last_change': '2023-07-21T22:34:22.960589+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.960589+0000', 'last_undegraded': '2023-07-21T22:34:22.960589+0000', 'last_fullsized': '2023-07-21T22:34:22.960589+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:34:28.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2b is not active+clean 2023-07-21T22:34:28.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.964751+0000', 'last_change': '2023-07-21T22:34:22.964751+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.964751+0000', 'last_undegraded': '2023-07-21T22:34:22.964751+0000', 'last_fullsized': '2023-07-21T22:34:22.964751+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:34:28.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2a is not active+clean 2023-07-21T22:34:28.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.962349+0000', 'last_change': '2023-07-21T22:34:22.962349+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.962349+0000', 'last_undegraded': '2023-07-21T22:34:22.962349+0000', 'last_fullsized': '2023-07-21T22:34:22.962349+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:34:28.943 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.29 is not active+clean 2023-07-21T22:34:28.943 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.961322+0000', 'last_change': '2023-07-21T22:34:22.961322+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.961322+0000', 'last_undegraded': '2023-07-21T22:34:22.961322+0000', 'last_fullsized': '2023-07-21T22:34:22.961322+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:34:28.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.28 is not active+clean 2023-07-21T22:34:28.944 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.968031+0000', 'last_change': '2023-07-21T22:34:22.968031+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.968031+0000', 'last_undegraded': '2023-07-21T22:34:22.968031+0000', 'last_fullsized': '2023-07-21T22:34:22.968031+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:34:28.944 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.27 is not active+clean 2023-07-21T22:34:28.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.965968+0000', 'last_change': '2023-07-21T22:34:22.965968+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.965968+0000', 'last_undegraded': '2023-07-21T22:34:22.965968+0000', 'last_fullsized': '2023-07-21T22:34:22.965968+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:34:28.945 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.26 is not active+clean 2023-07-21T22:34:28.945 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.965623+0000', 'last_change': '2023-07-21T22:34:22.965623+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.965623+0000', 'last_undegraded': '2023-07-21T22:34:22.965623+0000', 'last_fullsized': '2023-07-21T22:34:22.965623+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:34:28.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.25 is not active+clean 2023-07-21T22:34:28.946 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.969852+0000', 'last_change': '2023-07-21T22:34:22.969852+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.969852+0000', 'last_undegraded': '2023-07-21T22:34:22.969852+0000', 'last_fullsized': '2023-07-21T22:34:22.969852+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:34:28.946 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.24 is not active+clean 2023-07-21T22:34:28.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.960796+0000', 'last_change': '2023-07-21T22:34:22.960796+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.960796+0000', 'last_undegraded': '2023-07-21T22:34:22.960796+0000', 'last_fullsized': '2023-07-21T22:34:22.960796+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:34:28.947 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2023-07-21T22:34:28.947 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.967988+0000', 'last_change': '2023-07-21T22:34:22.967988+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.967988+0000', 'last_undegraded': '2023-07-21T22:34:22.967988+0000', 'last_fullsized': '2023-07-21T22:34:22.967988+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:34:28.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.22 is not active+clean 2023-07-21T22:34:28.948 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.965428+0000', 'last_change': '2023-07-21T22:34:22.965428+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.965428+0000', 'last_undegraded': '2023-07-21T22:34:22.965428+0000', 'last_fullsized': '2023-07-21T22:34:22.965428+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:34:28.948 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.21 is not active+clean 2023-07-21T22:34:28.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.978018+0000', 'last_change': '2023-07-21T22:34:22.978018+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.978018+0000', 'last_undegraded': '2023-07-21T22:34:22.978018+0000', 'last_fullsized': '2023-07-21T22:34:22.978018+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:34:28.949 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.20 is not active+clean 2023-07-21T22:34:28.949 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.965294+0000', 'last_change': '2023-07-21T22:34:22.965294+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.965294+0000', 'last_undegraded': '2023-07-21T22:34:22.965294+0000', 'last_fullsized': '2023-07-21T22:34:22.965294+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:34:28.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-07-21T22:34:28.950 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.970806+0000', 'last_change': '2023-07-21T22:34:22.970806+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.970806+0000', 'last_undegraded': '2023-07-21T22:34:22.970806+0000', 'last_fullsized': '2023-07-21T22:34:22.970806+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:34:28.950 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-07-21T22:34:28.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.969246+0000', 'last_change': '2023-07-21T22:34:22.969246+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.969246+0000', 'last_undegraded': '2023-07-21T22:34:22.969246+0000', 'last_fullsized': '2023-07-21T22:34:22.969246+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:34:28.951 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-07-21T22:34:28.951 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.963558+0000', 'last_change': '2023-07-21T22:34:22.963558+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.963558+0000', 'last_undegraded': '2023-07-21T22:34:22.963558+0000', 'last_fullsized': '2023-07-21T22:34:22.963558+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:34:28.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-07-21T22:34:28.952 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.973226+0000', 'last_change': '2023-07-21T22:34:22.973226+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.973226+0000', 'last_undegraded': '2023-07-21T22:34:22.973226+0000', 'last_fullsized': '2023-07-21T22:34:22.973226+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:34:28.952 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-07-21T22:34:28.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.964405+0000', 'last_change': '2023-07-21T22:34:22.964405+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.964405+0000', 'last_undegraded': '2023-07-21T22:34:22.964405+0000', 'last_fullsized': '2023-07-21T22:34:22.964405+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:34:28.953 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-07-21T22:34:28.953 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.959151+0000', 'last_change': '2023-07-21T22:34:22.959151+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.959151+0000', 'last_undegraded': '2023-07-21T22:34:22.959151+0000', 'last_fullsized': '2023-07-21T22:34:22.959151+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:34:28.954 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-07-21T22:34:28.954 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.972074+0000', 'last_change': '2023-07-21T22:34:22.972074+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.972074+0000', 'last_undegraded': '2023-07-21T22:34:22.972074+0000', 'last_fullsized': '2023-07-21T22:34:22.972074+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:34:28.955 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-07-21T22:34:28.955 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.960392+0000', 'last_change': '2023-07-21T22:34:22.960392+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.960392+0000', 'last_undegraded': '2023-07-21T22:34:22.960392+0000', 'last_fullsized': '2023-07-21T22:34:22.960392+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:34:28.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-07-21T22:34:28.956 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.960328+0000', 'last_change': '2023-07-21T22:34:22.960328+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.960328+0000', 'last_undegraded': '2023-07-21T22:34:22.960328+0000', 'last_fullsized': '2023-07-21T22:34:22.960328+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:34:28.956 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-07-21T22:34:28.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.960181+0000', 'last_change': '2023-07-21T22:34:22.960181+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.960181+0000', 'last_undegraded': '2023-07-21T22:34:22.960181+0000', 'last_fullsized': '2023-07-21T22:34:22.960181+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:34:28.957 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-07-21T22:34:28.957 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.971347+0000', 'last_change': '2023-07-21T22:34:22.971347+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.971347+0000', 'last_undegraded': '2023-07-21T22:34:22.971347+0000', 'last_fullsized': '2023-07-21T22:34:22.971347+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:34:28.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-07-21T22:34:28.958 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.970705+0000', 'last_change': '2023-07-21T22:34:22.970705+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.970705+0000', 'last_undegraded': '2023-07-21T22:34:22.970705+0000', 'last_fullsized': '2023-07-21T22:34:22.970705+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:34:28.958 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-07-21T22:34:28.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.969465+0000', 'last_change': '2023-07-21T22:34:22.969465+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.969465+0000', 'last_undegraded': '2023-07-21T22:34:22.969465+0000', 'last_fullsized': '2023-07-21T22:34:22.969465+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:34:28.959 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-07-21T22:34:28.959 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.966612+0000', 'last_change': '2023-07-21T22:34:22.966612+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.966612+0000', 'last_undegraded': '2023-07-21T22:34:22.966612+0000', 'last_fullsized': '2023-07-21T22:34:22.966612+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:34:28.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-07-21T22:34:28.960 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.971653+0000', 'last_change': '2023-07-21T22:34:22.971653+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.971653+0000', 'last_undegraded': '2023-07-21T22:34:22.971653+0000', 'last_fullsized': '2023-07-21T22:34:22.971653+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:34:28.960 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-07-21T22:34:28.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.959044+0000', 'last_change': '2023-07-21T22:34:22.959044+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.959044+0000', 'last_undegraded': '2023-07-21T22:34:22.959044+0000', 'last_fullsized': '2023-07-21T22:34:22.959044+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:34:28.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-07-21T22:34:28.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.963788+0000', 'last_change': '2023-07-21T22:34:22.963788+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.963788+0000', 'last_undegraded': '2023-07-21T22:34:22.963788+0000', 'last_fullsized': '2023-07-21T22:34:22.963788+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:34:28.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-07-21T22:34:28.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.966518+0000', 'last_change': '2023-07-21T22:34:22.966518+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.966518+0000', 'last_undegraded': '2023-07-21T22:34:22.966518+0000', 'last_fullsized': '2023-07-21T22:34:22.966518+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:34:28.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-07-21T22:34:28.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.965071+0000', 'last_change': '2023-07-21T22:34:22.965071+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.965071+0000', 'last_undegraded': '2023-07-21T22:34:22.965071+0000', 'last_fullsized': '2023-07-21T22:34:22.965071+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:34:28.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-07-21T22:34:28.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.970155+0000', 'last_change': '2023-07-21T22:34:22.970155+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.970155+0000', 'last_undegraded': '2023-07-21T22:34:22.970155+0000', 'last_fullsized': '2023-07-21T22:34:22.970155+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:34:28.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-07-21T22:34:28.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.973144+0000', 'last_change': '2023-07-21T22:34:22.973144+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.973144+0000', 'last_undegraded': '2023-07-21T22:34:22.973144+0000', 'last_fullsized': '2023-07-21T22:34:22.973144+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:34:28.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-07-21T22:34:28.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.970000+0000', 'last_change': '2023-07-21T22:34:22.970000+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.970000+0000', 'last_undegraded': '2023-07-21T22:34:22.970000+0000', 'last_fullsized': '2023-07-21T22:34:22.970000+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:34:28.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-07-21T22:34:28.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.959025+0000', 'last_change': '2023-07-21T22:34:22.959025+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.959025+0000', 'last_undegraded': '2023-07-21T22:34:22.959025+0000', 'last_fullsized': '2023-07-21T22:34:22.959025+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:34:28.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-07-21T22:34:28.966 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.966153+0000', 'last_change': '2023-07-21T22:34:22.966153+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.966153+0000', 'last_undegraded': '2023-07-21T22:34:22.966153+0000', 'last_fullsized': '2023-07-21T22:34:22.966153+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:34:28.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-07-21T22:34:28.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.972967+0000', 'last_change': '2023-07-21T22:34:22.972967+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.972967+0000', 'last_undegraded': '2023-07-21T22:34:22.972967+0000', 'last_fullsized': '2023-07-21T22:34:22.972967+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:34:28.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-07-21T22:34:28.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.964867+0000', 'last_change': '2023-07-21T22:34:22.964867+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.964867+0000', 'last_undegraded': '2023-07-21T22:34:22.964867+0000', 'last_fullsized': '2023-07-21T22:34:22.964867+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:34:28.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-07-21T22:34:28.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.966137+0000', 'last_change': '2023-07-21T22:34:22.966137+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.966137+0000', 'last_undegraded': '2023-07-21T22:34:22.966137+0000', 'last_fullsized': '2023-07-21T22:34:22.966137+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:34:28.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-07-21T22:34:28.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.971203+0000', 'last_change': '2023-07-21T22:34:22.971203+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.971203+0000', 'last_undegraded': '2023-07-21T22:34:22.971203+0000', 'last_fullsized': '2023-07-21T22:34:22.971203+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:34:28.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-07-21T22:34:28.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.972267+0000', 'last_change': '2023-07-21T22:34:22.972267+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.972267+0000', 'last_undegraded': '2023-07-21T22:34:22.972267+0000', 'last_fullsized': '2023-07-21T22:34:22.972267+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:34:28.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-07-21T22:34:28.970 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.970837+0000', 'last_change': '2023-07-21T22:34:22.970837+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.970837+0000', 'last_undegraded': '2023-07-21T22:34:22.970837+0000', 'last_fullsized': '2023-07-21T22:34:22.970837+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:34:28.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-07-21T22:34:28.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.971005+0000', 'last_change': '2023-07-21T22:34:22.971005+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.971005+0000', 'last_undegraded': '2023-07-21T22:34:22.971005+0000', 'last_fullsized': '2023-07-21T22:34:22.971005+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:34:28.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-07-21T22:34:28.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 82, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:34:22.969581+0000', 'last_change': '2023-07-21T22:34:22.969581+0000', 'last_active': '2023-07-21T22:34:22.943038+0000', 'last_peered': '2023-07-21T22:34:22.943038+0000', 'last_clean': '2023-07-21T22:34:22.943038+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:34:22.969581+0000', 'last_undegraded': '2023-07-21T22:34:22.969581+0000', 'last_fullsized': '2023-07-21T22:34:22.969581+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'last_clean_scrub_stamp': '2023-07-21T22:34:22.943038+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:34:28.972 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-21T22:34:28.979 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-07-21T22:34:28.931+0000 7f6c26e2b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:34:29.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.067+0000 7f4a25e0b640 1 Processor -- start 2023-07-21T22:34:29.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.067+0000 7f4a25e0b640 1 -- start start 2023-07-21T22:34:29.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.067+0000 7f4a25e0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a2014f200 0x7f4a20069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:29.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.067+0000 7f4a25e0b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4a200b2bd0 0x7f4a200adee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:29.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.067+0000 7f4a25e0b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a2006c0c0 con 0x7f4a200adab0 2023-07-21T22:34:29.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.067+0000 7f4a25e0b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a2014f5d0 con 0x7f4a200b2bd0 2023-07-21T22:34:29.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.067+0000 7f4a25e0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a200ae420 con 0x7f4a2014f200 2023-07-21T22:34:29.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.071+0000 7f4a1ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4a200b2bd0 0x7f4a200adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:29.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.071+0000 7f4a1f7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a2014f200 0x7f4a20069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:29.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.071+0000 7f4a1ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4a200b2bd0 0x7f4a200adee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:54918/0 (socket says 172.21.15.6:54918) 2023-07-21T22:34:29.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.071+0000 7f4a1ffff640 1 -- 172.21.15.6:0/2418208329 learned_addr learned my addr 172.21.15.6:0/2418208329 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:29.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.071+0000 7f4a1effd640 1 --1- 172.21.15.6:0/2418208329 >> v1:172.21.15.161:6789/0 conn(0x7f4a200adab0 0x7f4a200b24c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:39564/0 (socket says 172.21.15.6:39564) 2023-07-21T22:34:29.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.071+0000 7f4a1f7fe640 1 -- 172.21.15.6:0/2418208329 >> v2:172.21.15.161:3300/0 conn(0x7f4a200b2bd0 msgr2=0x7f4a200adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:29.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.071+0000 7f4a1f7fe640 1 --2- 172.21.15.6:0/2418208329 >> v2:172.21.15.161:3300/0 conn(0x7f4a200b2bd0 0x7f4a200adee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:29.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.071+0000 7f4a1f7fe640 1 -- 172.21.15.6:0/2418208329 >> v1:172.21.15.161:6789/0 conn(0x7f4a200adab0 legacy=0x7f4a200b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:29.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.071+0000 7f4a1f7fe640 1 -- 172.21.15.6:0/2418208329 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2006bdc0 con 0x7f4a2014f200 2023-07-21T22:34:29.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.071+0000 7f4a1ffff640 1 --2- 172.21.15.6:0/2418208329 >> v2:172.21.15.161:3300/0 conn(0x7f4a200b2bd0 0x7f4a200adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:29.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.071+0000 7f4a1f7fe640 1 --2- 172.21.15.6:0/2418208329 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a2014f200 0x7f4a20069430 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4a100097c0 tx=0x7f4a1001e690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8184f5a07a4b7a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:29.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a1e7fc640 1 -- 172.21.15.6:0/2418208329 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100ab5f0 con 0x7f4a2014f200 2023-07-21T22:34:29.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a1e7fc640 1 -- 172.21.15.6:0/2418208329 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a100ab750 con 0x7f4a2014f200 2023-07-21T22:34:29.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a1e7fc640 1 -- 172.21.15.6:0/2418208329 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a100abae0 con 0x7f4a2014f200 2023-07-21T22:34:29.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a25e0b640 1 -- 172.21.15.6:0/2418208329 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a2014f200 msgr2=0x7f4a20069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:29.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a25e0b640 1 --2- 172.21.15.6:0/2418208329 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a2014f200 0x7f4a20069430 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4a100097c0 tx=0x7f4a1001e690 comp rx=0 tx=0).stop 2023-07-21T22:34:29.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a25e0b640 1 -- 172.21.15.6:0/2418208329 shutdown_connections 2023-07-21T22:34:29.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a25e0b640 1 --2- 172.21.15.6:0/2418208329 >> v2:172.21.15.161:3300/0 conn(0x7f4a200b2bd0 0x7f4a200adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:29.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a25e0b640 1 --2- 172.21.15.6:0/2418208329 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a2014f200 0x7f4a20069430 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:29.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a25e0b640 1 -- 172.21.15.6:0/2418208329 >> 172.21.15.6:0/2418208329 conn(0x7f4a200b1300 msgr2=0x7f4a200ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:29.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a25e0b640 1 -- 172.21.15.6:0/2418208329 shutdown_connections 2023-07-21T22:34:29.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a25e0b640 1 -- 172.21.15.6:0/2418208329 wait complete. 2023-07-21T22:34:29.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a25e0b640 1 Processor -- start 2023-07-21T22:34:29.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a25e0b640 1 -- start start 2023-07-21T22:34:29.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a25e0b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a200adab0 0x7f4a20158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:29.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a25e0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a200b2bd0 0x7f4a20154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:29.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a25e0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a2014f200 0x7f4a20152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:29.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a25e0b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a20135470 con 0x7f4a200b2bd0 2023-07-21T22:34:29.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a25e0b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a20158680 con 0x7f4a200adab0 2023-07-21T22:34:29.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a25e0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a20154ec0 con 0x7f4a2014f200 2023-07-21T22:34:29.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a1effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a200b2bd0 0x7f4a20154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:29.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a1effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a200b2bd0 0x7f4a20154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54144/0 (socket says 172.21.15.6:54144) 2023-07-21T22:34:29.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.075+0000 7f4a1effd640 1 -- 172.21.15.6:0/4274101066 learned_addr learned my addr 172.21.15.6:0/4274101066 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:29.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.079+0000 7f4a1ffff640 1 --2- 172.21.15.6:0/4274101066 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a2014f200 0x7f4a20152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:29.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.079+0000 7f4a1f7fe640 1 --2- 172.21.15.6:0/4274101066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a200adab0 0x7f4a20158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:29.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.079+0000 7f4a1effd640 1 -- 172.21.15.6:0/4274101066 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a2014f200 msgr2=0x7f4a20152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:29.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.079+0000 7f4a1effd640 1 --2- 172.21.15.6:0/4274101066 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a2014f200 0x7f4a20152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:29.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.079+0000 7f4a1effd640 1 -- 172.21.15.6:0/4274101066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a200adab0 msgr2=0x7f4a20158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:29.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.079+0000 7f4a1effd640 1 --2- 172.21.15.6:0/4274101066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a200adab0 0x7f4a20158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:29.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.079+0000 7f4a1effd640 1 -- 172.21.15.6:0/4274101066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a18009b30 con 0x7f4a200b2bd0 2023-07-21T22:34:29.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.079+0000 7f4a1effd640 1 --2- 172.21.15.6:0/4274101066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a200b2bd0 0x7f4a20154980 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400c490 tx=0x7f4a1400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:29.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.079+0000 7f4a07fff640 1 -- 172.21.15.6:0/4274101066 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a14007480 con 0x7f4a200b2bd0 2023-07-21T22:34:29.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.079+0000 7f4a07fff640 1 -- 172.21.15.6:0/4274101066 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a140075e0 con 0x7f4a200b2bd0 2023-07-21T22:34:29.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.079+0000 7f4a07fff640 1 -- 172.21.15.6:0/4274101066 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a14004a10 con 0x7f4a200b2bd0 2023-07-21T22:34:29.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.079+0000 7f4a25e0b640 1 -- 172.21.15.6:0/4274101066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a10009420 con 0x7f4a200b2bd0 2023-07-21T22:34:29.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.079+0000 7f4a25e0b640 1 -- 172.21.15.6:0/4274101066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a20155740 con 0x7f4a200b2bd0 2023-07-21T22:34:29.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.079+0000 7f4a25e0b640 1 -- 172.21.15.6:0/4274101066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a20135620 con 0x7f4a200b2bd0 2023-07-21T22:34:29.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.079+0000 7f4a07fff640 1 -- 172.21.15.6:0/4274101066 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4a14004b70 con 0x7f4a200b2bd0 2023-07-21T22:34:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.083+0000 7f4a07fff640 1 --2- 172.21.15.6:0/4274101066 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f4a0c0663d0 0x7f4a0c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.083+0000 7f4a07fff640 1 -- 172.21.15.6:0/4274101066 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f4a14082f00 con 0x7f4a200b2bd0 2023-07-21T22:34:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.083+0000 7f4a1f7fe640 1 --2- 172.21.15.6:0/4274101066 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f4a0c0663d0 0x7f4a0c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.083+0000 7f4a1f7fe640 1 --2- 172.21.15.6:0/4274101066 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f4a0c0663d0 0x7f4a0c068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4a100b0000 tx=0x7f4a100b5040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:29.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.087+0000 7f4a07fff640 1 -- 172.21.15.6:0/4274101066 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4a20135620 con 0x7f4a200b2bd0 2023-07-21T22:34:29.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.295+0000 7f4a25e0b640 1 -- 172.21.15.6:0/4274101066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4a200678d0 con 0x7f4a200b2bd0 2023-07-21T22:34:29.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.295+0000 7f4a07fff640 1 -- 172.21.15.6:0/4274101066 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3229 (secure 0 0 0) 0x7f4a14018cb0 con 0x7f4a200b2bd0 2023-07-21T22:34:29.344 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:29.344 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":971,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":84,"num_osds":8,"num_up_osds":8,"osd_up_since":1689977909,"num_in_osds":8,"osd_in_since":1689977900,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":308711424,"bytes_avail":772785401856,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":32,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":6585}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-07-21T22:34:11.630065+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-21T22:34:29.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.295+0000 7f4a25e0b640 1 -- 172.21.15.6:0/4274101066 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f4a0c0663d0 msgr2=0x7f4a0c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:29.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.295+0000 7f4a25e0b640 1 --2- 172.21.15.6:0/4274101066 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f4a0c0663d0 0x7f4a0c068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4a100b0000 tx=0x7f4a100b5040 comp rx=0 tx=0).stop 2023-07-21T22:34:29.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.295+0000 7f4a25e0b640 1 -- 172.21.15.6:0/4274101066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a200b2bd0 msgr2=0x7f4a20154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:29.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.295+0000 7f4a25e0b640 1 --2- 172.21.15.6:0/4274101066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a200b2bd0 0x7f4a20154980 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400c490 tx=0x7f4a1400c950 comp rx=0 tx=0).stop 2023-07-21T22:34:29.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.295+0000 7f4a25e0b640 1 -- 172.21.15.6:0/4274101066 shutdown_connections 2023-07-21T22:34:29.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.295+0000 7f4a25e0b640 1 --2- 172.21.15.6:0/4274101066 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f4a0c0663d0 0x7f4a0c068880 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:29.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.295+0000 7f4a25e0b640 1 --2- 172.21.15.6:0/4274101066 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a2014f200 0x7f4a20152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:29.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.295+0000 7f4a25e0b640 1 --2- 172.21.15.6:0/4274101066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a200b2bd0 0x7f4a20154980 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:29.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.295+0000 7f4a25e0b640 1 --2- 172.21.15.6:0/4274101066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a200adab0 0x7f4a20158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:29.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.295+0000 7f4a25e0b640 1 -- 172.21.15.6:0/4274101066 >> 172.21.15.6:0/4274101066 conn(0x7f4a200b1300 msgr2=0x7f4a201562b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:29.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.295+0000 7f4a25e0b640 1 -- 172.21.15.6:0/4274101066 shutdown_connections 2023-07-21T22:34:29.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.295+0000 7f4a25e0b640 1 -- 172.21.15.6:0/4274101066 wait complete. 2023-07-21T22:34:29.365 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-21T22:34:29.366 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:34:29.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.499+0000 7f35637f6640 1 Processor -- start 2023-07-21T22:34:29.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.499+0000 7f35637f6640 1 -- start start 2023-07-21T22:34:29.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.503+0000 7f35637f6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f355c070b70 0x7f355c070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:29.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.503+0000 7f35637f6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f355c06b1e0 0x7f355c0c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:29.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.503+0000 7f35637f6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355c0cac70 con 0x7f355c0c21f0 2023-07-21T22:34:29.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.503+0000 7f35637f6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355c071480 con 0x7f355c06b1e0 2023-07-21T22:34:29.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.503+0000 7f35637f6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355c0ca060 con 0x7f355c070b70 2023-07-21T22:34:29.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.503+0000 7f3560d91640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f355c06b1e0 0x7f355c0c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:29.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.503+0000 7f3561d93640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f355c0c21f0 0x7f355c0cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54536/0 (socket says 172.21.15.6:54536) 2023-07-21T22:34:29.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.503+0000 7f3561d93640 1 -- 172.21.15.6:0/1034720919 learned_addr learned my addr 172.21.15.6:0/1034720919 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:29.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.503+0000 7f3561592640 1 --2- 172.21.15.6:0/1034720919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f355c070b70 0x7f355c070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:29.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.503+0000 7f3553fff640 1 -- 172.21.15.6:0/1034720919 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 850331228 0 0) 0x7f355c0cac70 con 0x7f355c0c21f0 2023-07-21T22:34:29.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.503+0000 7f3553fff640 1 -- 172.21.15.6:0/1034720919 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3548003530 con 0x7f355c0c21f0 2023-07-21T22:34:29.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.503+0000 7f3560d91640 1 -- 172.21.15.6:0/1034720919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f355c070b70 msgr2=0x7f355c070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:29.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.503+0000 7f3560d91640 1 --2- 172.21.15.6:0/1034720919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f355c070b70 0x7f355c070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:29.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.503+0000 7f3560d91640 1 -- 172.21.15.6:0/1034720919 >> v1:172.21.15.6:6789/0 conn(0x7f355c0c21f0 legacy=0x7f355c0cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:29.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.503+0000 7f3560d91640 1 -- 172.21.15.6:0/1034720919 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c0ca340 con 0x7f355c06b1e0 2023-07-21T22:34:29.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.503+0000 7f3560d91640 1 --2- 172.21.15.6:0/1034720919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f355c06b1e0 0x7f355c0c1cb0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f354c0097c0 tx=0x7f354c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c2ef83c0ea1f1b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.507+0000 7f3553fff640 1 -- 172.21.15.6:0/1034720919 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c0ac620 con 0x7f355c06b1e0 2023-07-21T22:34:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.507+0000 7f3553fff640 1 -- 172.21.15.6:0/1034720919 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354c0ac780 con 0x7f355c06b1e0 2023-07-21T22:34:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.507+0000 7f3553fff640 1 -- 172.21.15.6:0/1034720919 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c0acaf0 con 0x7f355c06b1e0 2023-07-21T22:34:29.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.507+0000 7f35637f6640 1 -- 172.21.15.6:0/1034720919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f355c06b1e0 msgr2=0x7f355c0c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:29.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.507+0000 7f35637f6640 1 --2- 172.21.15.6:0/1034720919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f355c06b1e0 0x7f355c0c1cb0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f354c0097c0 tx=0x7f354c01c3c0 comp rx=0 tx=0).stop 2023-07-21T22:34:29.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.507+0000 7f35637f6640 1 -- 172.21.15.6:0/1034720919 shutdown_connections 2023-07-21T22:34:29.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.507+0000 7f35637f6640 1 --2- 172.21.15.6:0/1034720919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f355c06b1e0 0x7f355c0c1cb0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:29.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.507+0000 7f35637f6640 1 --2- 172.21.15.6:0/1034720919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f355c070b70 0x7f355c070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:29.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.507+0000 7f35637f6640 1 -- 172.21.15.6:0/1034720919 >> 172.21.15.6:0/1034720919 conn(0x7f355c0afcf0 msgr2=0x7f355c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:29.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.507+0000 7f35637f6640 1 -- 172.21.15.6:0/1034720919 shutdown_connections 2023-07-21T22:34:29.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.507+0000 7f35637f6640 1 -- 172.21.15.6:0/1034720919 wait complete. 2023-07-21T22:34:29.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.507+0000 7f35637f6640 1 Processor -- start 2023-07-21T22:34:29.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.507+0000 7f35637f6640 1 -- start start 2023-07-21T22:34:29.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.507+0000 7f35637f6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f355c06b1e0 0x7f355c150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:29.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.507+0000 7f35637f6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f355c070b70 0x7f355c13f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:29.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.507+0000 7f35637f6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f355c0c21f0 0x7f355c151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:29.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.507+0000 7f35637f6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c13f920 con 0x7f355c06b1e0 2023-07-21T22:34:29.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.507+0000 7f35637f6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c151770 con 0x7f355c0c21f0 2023-07-21T22:34:29.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.507+0000 7f35637f6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355c150b60 con 0x7f355c070b70 2023-07-21T22:34:29.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.507+0000 7f3561592640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f355c06b1e0 0x7f355c150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:29.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.511+0000 7f3561592640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f355c06b1e0 0x7f355c150580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54160/0 (socket says 172.21.15.6:54160) 2023-07-21T22:34:29.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.511+0000 7f3561592640 1 -- 172.21.15.6:0/3903666017 learned_addr learned my addr 172.21.15.6:0/3903666017 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.511+0000 7f3560d91640 1 --2- 172.21.15.6:0/3903666017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f355c070b70 0x7f355c13f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.511+0000 7f3561d93640 1 --2- 172.21.15.6:0/3903666017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f355c0c21f0 0x7f355c151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.511+0000 7f3561592640 1 -- 172.21.15.6:0/3903666017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f355c070b70 msgr2=0x7f355c13f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.511+0000 7f3561592640 1 --2- 172.21.15.6:0/3903666017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f355c070b70 0x7f355c13f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.511+0000 7f3561592640 1 -- 172.21.15.6:0/3903666017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f355c0c21f0 msgr2=0x7f355c151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.511+0000 7f3561592640 1 --2- 172.21.15.6:0/3903666017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f355c0c21f0 0x7f355c151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.511+0000 7f3561592640 1 -- 172.21.15.6:0/3903666017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354c009420 con 0x7f355c06b1e0 2023-07-21T22:34:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.511+0000 7f3560d91640 1 --2- 172.21.15.6:0/3903666017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f355c070b70 0x7f355c13f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.511+0000 7f3561d93640 1 --2- 172.21.15.6:0/3903666017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f355c0c21f0 0x7f355c151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.511+0000 7f3561592640 1 --2- 172.21.15.6:0/3903666017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f355c06b1e0 0x7f355c150580 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f355800e930 tx=0x7f355800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.511+0000 7f3551ffb640 1 -- 172.21.15.6:0/3903666017 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558009690 con 0x7f355c06b1e0 2023-07-21T22:34:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.511+0000 7f3551ffb640 1 -- 172.21.15.6:0/3903666017 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355800c9a0 con 0x7f355c06b1e0 2023-07-21T22:34:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.511+0000 7f35637f6640 1 -- 172.21.15.6:0/3903666017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f355c150e40 con 0x7f355c06b1e0 2023-07-21T22:34:29.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.511+0000 7f3551ffb640 1 -- 172.21.15.6:0/3903666017 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355800cd10 con 0x7f355c06b1e0 2023-07-21T22:34:29.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.511+0000 7f35637f6640 1 -- 172.21.15.6:0/3903666017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355c151400 con 0x7f355c06b1e0 2023-07-21T22:34:29.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.511+0000 7f35637f6640 1 -- 172.21.15.6:0/3903666017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355c0678d0 con 0x7f355c06b1e0 2023-07-21T22:34:29.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.511+0000 7f3551ffb640 1 -- 172.21.15.6:0/3903666017 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3558013470 con 0x7f355c06b1e0 2023-07-21T22:34:29.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.515+0000 7f3551ffb640 1 --2- 172.21.15.6:0/3903666017 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f35400663a0 0x7f3540068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:29.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.515+0000 7f3551ffb640 1 -- 172.21.15.6:0/3903666017 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f3558084100 con 0x7f355c06b1e0 2023-07-21T22:34:29.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.515+0000 7f3560d91640 1 --2- 172.21.15.6:0/3903666017 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f35400663a0 0x7f3540068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:29.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.515+0000 7f3560d91640 1 --2- 172.21.15.6:0/3903666017 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f35400663a0 0x7f3540068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f354c0ae000 tx=0x7f354c0a7000 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:29.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.519+0000 7f3551ffb640 1 -- 172.21.15.6:0/3903666017 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3558051500 con 0x7f355c06b1e0 2023-07-21T22:34:29.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.671+0000 7f35637f6640 1 -- 172.21.15.6:0/3903666017 --> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f355c0c9cf0 con 0x7f35400663a0 2023-07-21T22:34:29.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.679+0000 7f3551ffb640 1 -- 172.21.15.6:0/3903666017 <== mgr.5768 v2:172.21.15.161:6832/3045187557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311094 (secure 0 0 0) 0x7f354c0b5400 con 0x7f35400663a0 2023-07-21T22:34:29.732 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:29.733 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:34:29.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.683+0000 7f35637f6640 1 -- 172.21.15.6:0/3903666017 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f35400663a0 msgr2=0x7f3540068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:29.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.683+0000 7f35637f6640 1 --2- 172.21.15.6:0/3903666017 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f35400663a0 0x7f3540068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f354c0ae000 tx=0x7f354c0a7000 comp rx=0 tx=0).stop 2023-07-21T22:34:29.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.683+0000 7f35637f6640 1 -- 172.21.15.6:0/3903666017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f355c06b1e0 msgr2=0x7f355c150580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:29.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.683+0000 7f35637f6640 1 --2- 172.21.15.6:0/3903666017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f355c06b1e0 0x7f355c150580 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f355800e930 tx=0x7f355800edf0 comp rx=0 tx=0).stop 2023-07-21T22:34:29.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.683+0000 7f35637f6640 1 -- 172.21.15.6:0/3903666017 shutdown_connections 2023-07-21T22:34:29.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.683+0000 7f35637f6640 1 --2- 172.21.15.6:0/3903666017 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f35400663a0 0x7f3540068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:29.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.683+0000 7f35637f6640 1 --2- 172.21.15.6:0/3903666017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f355c0c21f0 0x7f355c151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:29.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.683+0000 7f35637f6640 1 --2- 172.21.15.6:0/3903666017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f355c070b70 0x7f355c13f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:29.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.683+0000 7f35637f6640 1 --2- 172.21.15.6:0/3903666017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f355c06b1e0 0x7f355c150580 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:29.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.683+0000 7f35637f6640 1 -- 172.21.15.6:0/3903666017 >> 172.21.15.6:0/3903666017 conn(0x7f355c0afcf0 msgr2=0x7f355c0c2620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:29.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.683+0000 7f35637f6640 1 -- 172.21.15.6:0/3903666017 shutdown_connections 2023-07-21T22:34:29.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:29.683+0000 7f35637f6640 1 -- 172.21.15.6:0/3903666017 wait complete. 2023-07-21T22:34:29.753 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-21T22:34:29.634366+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":284,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":301768,"kb_used_data":9096,"kb_used_omap":0,"kb_used_meta":292608,"kb_avail":754672952,"statfs":{"total":773094113280,"available":772785102848,"internally_reserved":0,"allocated":9314304,"data_stored":5166388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":299630592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.672328"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378094+0000","last_change":"2023-07-21T22:34:23.972557+0000","last_active":"2023-07-21T22:34:25.378094+0000","last_peered":"2023-07-21T22:34:25.378094+0000","last_clean":"2023-07-21T22:34:25.378094+0000","last_became_active":"2023-07-21T22:34:23.970855+0000","last_became_peered":"2023-07-21T22:34:23.970855+0000","last_unstale":"2023-07-21T22:34:25.378094+0000","last_undegraded":"2023-07-21T22:34:25.378094+0000","last_fullsized":"2023-07-21T22:34:25.378094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:20.702469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378043+0000","last_change":"2023-07-21T22:34:23.979164+0000","last_active":"2023-07-21T22:34:25.378043+0000","last_peered":"2023-07-21T22:34:25.378043+0000","last_clean":"2023-07-21T22:34:25.378043+0000","last_became_active":"2023-07-21T22:34:23.978841+0000","last_became_peered":"2023-07-21T22:34:23.978841+0000","last_unstale":"2023-07-21T22:34:25.378043+0000","last_undegraded":"2023-07-21T22:34:25.378043+0000","last_fullsized":"2023-07-21T22:34:25.378043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:04:38.724441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976587+0000","last_change":"2023-07-21T22:34:23.993905+0000","last_active":"2023-07-21T22:34:24.976587+0000","last_peered":"2023-07-21T22:34:24.976587+0000","last_clean":"2023-07-21T22:34:24.976587+0000","last_became_active":"2023-07-21T22:34:23.993636+0000","last_became_peered":"2023-07-21T22:34:23.993636+0000","last_unstale":"2023-07-21T22:34:24.976587+0000","last_undegraded":"2023-07-21T22:34:24.976587+0000","last_fullsized":"2023-07-21T22:34:24.976587+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:08:58.793372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976787+0000","last_change":"2023-07-21T22:34:23.983073+0000","last_active":"2023-07-21T22:34:24.976787+0000","last_peered":"2023-07-21T22:34:24.976787+0000","last_clean":"2023-07-21T22:34:24.976787+0000","last_became_active":"2023-07-21T22:34:23.982808+0000","last_became_peered":"2023-07-21T22:34:23.982808+0000","last_unstale":"2023-07-21T22:34:24.976787+0000","last_undegraded":"2023-07-21T22:34:24.976787+0000","last_fullsized":"2023-07-21T22:34:24.976787+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:14:14.000715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381556+0000","last_change":"2023-07-21T22:34:23.983330+0000","last_active":"2023-07-21T22:34:25.381556+0000","last_peered":"2023-07-21T22:34:25.381556+0000","last_clean":"2023-07-21T22:34:25.381556+0000","last_became_active":"2023-07-21T22:34:23.982892+0000","last_became_peered":"2023-07-21T22:34:23.982892+0000","last_unstale":"2023-07-21T22:34:25.381556+0000","last_undegraded":"2023-07-21T22:34:25.381556+0000","last_fullsized":"2023-07-21T22:34:25.381556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:17:45.177459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377816+0000","last_change":"2023-07-21T22:34:23.993702+0000","last_active":"2023-07-21T22:34:25.377816+0000","last_peered":"2023-07-21T22:34:25.377816+0000","last_clean":"2023-07-21T22:34:25.377816+0000","last_became_active":"2023-07-21T22:34:23.993273+0000","last_became_peered":"2023-07-21T22:34:23.993273+0000","last_unstale":"2023-07-21T22:34:25.377816+0000","last_undegraded":"2023-07-21T22:34:25.377816+0000","last_fullsized":"2023-07-21T22:34:25.377816+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:24:02.389155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.244513+0000","last_change":"2023-07-21T22:34:23.988159+0000","last_active":"2023-07-21T22:34:25.244513+0000","last_peered":"2023-07-21T22:34:25.244513+0000","last_clean":"2023-07-21T22:34:25.244513+0000","last_became_active":"2023-07-21T22:34:23.987833+0000","last_became_peered":"2023-07-21T22:34:23.987833+0000","last_unstale":"2023-07-21T22:34:25.244513+0000","last_undegraded":"2023-07-21T22:34:25.244513+0000","last_fullsized":"2023-07-21T22:34:25.244513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:57:06.456983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381702+0000","last_change":"2023-07-21T22:34:23.988974+0000","last_active":"2023-07-21T22:34:25.381702+0000","last_peered":"2023-07-21T22:34:25.381702+0000","last_clean":"2023-07-21T22:34:25.381702+0000","last_became_active":"2023-07-21T22:34:23.988694+0000","last_became_peered":"2023-07-21T22:34:23.988694+0000","last_unstale":"2023-07-21T22:34:25.381702+0000","last_undegraded":"2023-07-21T22:34:25.381702+0000","last_fullsized":"2023-07-21T22:34:25.381702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:40:23.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976870+0000","last_change":"2023-07-21T22:34:24.001260+0000","last_active":"2023-07-21T22:34:24.976870+0000","last_peered":"2023-07-21T22:34:24.976870+0000","last_clean":"2023-07-21T22:34:24.976870+0000","last_became_active":"2023-07-21T22:34:24.000725+0000","last_became_peered":"2023-07-21T22:34:24.000725+0000","last_unstale":"2023-07-21T22:34:24.976870+0000","last_undegraded":"2023-07-21T22:34:24.976870+0000","last_fullsized":"2023-07-21T22:34:24.976870+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:09.929761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976852+0000","last_change":"2023-07-21T22:34:23.987611+0000","last_active":"2023-07-21T22:34:24.976852+0000","last_peered":"2023-07-21T22:34:24.976852+0000","last_clean":"2023-07-21T22:34:24.976852+0000","last_became_active":"2023-07-21T22:34:23.987284+0000","last_became_peered":"2023-07-21T22:34:23.987284+0000","last_unstale":"2023-07-21T22:34:24.976852+0000","last_undegraded":"2023-07-21T22:34:24.976852+0000","last_fullsized":"2023-07-21T22:34:24.976852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:38:29.028319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977302+0000","last_change":"2023-07-21T22:34:23.986342+0000","last_active":"2023-07-21T22:34:24.977302+0000","last_peered":"2023-07-21T22:34:24.977302+0000","last_clean":"2023-07-21T22:34:24.977302+0000","last_became_active":"2023-07-21T22:34:23.986055+0000","last_became_peered":"2023-07-21T22:34:23.986055+0000","last_unstale":"2023-07-21T22:34:24.977302+0000","last_undegraded":"2023-07-21T22:34:24.977302+0000","last_fullsized":"2023-07-21T22:34:24.977302+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:51:03.664662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381837+0000","last_change":"2023-07-21T22:34:23.989735+0000","last_active":"2023-07-21T22:34:25.381837+0000","last_peered":"2023-07-21T22:34:25.381837+0000","last_clean":"2023-07-21T22:34:25.381837+0000","last_became_active":"2023-07-21T22:34:23.989266+0000","last_became_peered":"2023-07-21T22:34:23.989266+0000","last_unstale":"2023-07-21T22:34:25.381837+0000","last_undegraded":"2023-07-21T22:34:25.381837+0000","last_fullsized":"2023-07-21T22:34:25.381837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:46:38.257359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382011+0000","last_change":"2023-07-21T22:34:23.988124+0000","last_active":"2023-07-21T22:34:25.382011+0000","last_peered":"2023-07-21T22:34:25.382011+0000","last_clean":"2023-07-21T22:34:25.382011+0000","last_became_active":"2023-07-21T22:34:23.987825+0000","last_became_peered":"2023-07-21T22:34:23.987825+0000","last_unstale":"2023-07-21T22:34:25.382011+0000","last_undegraded":"2023-07-21T22:34:25.382011+0000","last_fullsized":"2023-07-21T22:34:25.382011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:39:35.479896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977509+0000","last_change":"2023-07-21T22:34:23.996854+0000","last_active":"2023-07-21T22:34:24.977509+0000","last_peered":"2023-07-21T22:34:24.977509+0000","last_clean":"2023-07-21T22:34:24.977509+0000","last_became_active":"2023-07-21T22:34:23.996469+0000","last_became_peered":"2023-07-21T22:34:23.996469+0000","last_unstale":"2023-07-21T22:34:24.977509+0000","last_undegraded":"2023-07-21T22:34:24.977509+0000","last_fullsized":"2023-07-21T22:34:24.977509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:39:25.499566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976230+0000","last_change":"2023-07-21T22:34:23.990138+0000","last_active":"2023-07-21T22:34:24.976230+0000","last_peered":"2023-07-21T22:34:24.976230+0000","last_clean":"2023-07-21T22:34:24.976230+0000","last_became_active":"2023-07-21T22:34:23.989823+0000","last_became_peered":"2023-07-21T22:34:23.989823+0000","last_unstale":"2023-07-21T22:34:24.976230+0000","last_undegraded":"2023-07-21T22:34:24.976230+0000","last_fullsized":"2023-07-21T22:34:24.976230+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:21:01.787807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.244536+0000","last_change":"2023-07-21T22:34:23.977077+0000","last_active":"2023-07-21T22:34:25.244536+0000","last_peered":"2023-07-21T22:34:25.244536+0000","last_clean":"2023-07-21T22:34:25.244536+0000","last_became_active":"2023-07-21T22:34:23.976770+0000","last_became_peered":"2023-07-21T22:34:23.976770+0000","last_unstale":"2023-07-21T22:34:25.244536+0000","last_undegraded":"2023-07-21T22:34:25.244536+0000","last_fullsized":"2023-07-21T22:34:25.244536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:20:38.879292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378224+0000","last_change":"2023-07-21T22:34:23.992061+0000","last_active":"2023-07-21T22:34:25.378224+0000","last_peered":"2023-07-21T22:34:25.378224+0000","last_clean":"2023-07-21T22:34:25.378224+0000","last_became_active":"2023-07-21T22:34:23.990501+0000","last_became_peered":"2023-07-21T22:34:23.990501+0000","last_unstale":"2023-07-21T22:34:25.378224+0000","last_undegraded":"2023-07-21T22:34:25.378224+0000","last_fullsized":"2023-07-21T22:34:25.378224+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:36:54.905796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977601+0000","last_change":"2023-07-21T22:34:23.988875+0000","last_active":"2023-07-21T22:34:24.977601+0000","last_peered":"2023-07-21T22:34:24.977601+0000","last_clean":"2023-07-21T22:34:24.977601+0000","last_became_active":"2023-07-21T22:34:23.988567+0000","last_became_peered":"2023-07-21T22:34:23.988567+0000","last_unstale":"2023-07-21T22:34:24.977601+0000","last_undegraded":"2023-07-21T22:34:24.977601+0000","last_fullsized":"2023-07-21T22:34:24.977601+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:04:11.295033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382203+0000","last_change":"2023-07-21T22:34:23.978808+0000","last_active":"2023-07-21T22:34:25.382203+0000","last_peered":"2023-07-21T22:34:25.382203+0000","last_clean":"2023-07-21T22:34:25.382203+0000","last_became_active":"2023-07-21T22:34:23.978449+0000","last_became_peered":"2023-07-21T22:34:23.978449+0000","last_unstale":"2023-07-21T22:34:25.382203+0000","last_undegraded":"2023-07-21T22:34:25.382203+0000","last_fullsized":"2023-07-21T22:34:25.382203+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:29:13.739884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973582+0000","last_change":"2023-07-21T22:34:23.970577+0000","last_active":"2023-07-21T22:34:24.973582+0000","last_peered":"2023-07-21T22:34:24.973582+0000","last_clean":"2023-07-21T22:34:24.973582+0000","last_became_active":"2023-07-21T22:34:23.970310+0000","last_became_peered":"2023-07-21T22:34:23.970310+0000","last_unstale":"2023-07-21T22:34:24.973582+0000","last_undegraded":"2023-07-21T22:34:24.973582+0000","last_fullsized":"2023-07-21T22:34:24.973582+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:20.702469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381902+0000","last_change":"2023-07-21T22:34:23.979347+0000","last_active":"2023-07-21T22:34:25.381902+0000","last_peered":"2023-07-21T22:34:25.381902+0000","last_clean":"2023-07-21T22:34:25.381902+0000","last_became_active":"2023-07-21T22:34:23.979016+0000","last_became_peered":"2023-07-21T22:34:23.979016+0000","last_unstale":"2023-07-21T22:34:25.381902+0000","last_undegraded":"2023-07-21T22:34:25.381902+0000","last_fullsized":"2023-07-21T22:34:25.381902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:05.505188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973263+0000","last_change":"2023-07-21T22:34:23.985384+0000","last_active":"2023-07-21T22:34:24.973263+0000","last_peered":"2023-07-21T22:34:24.973263+0000","last_clean":"2023-07-21T22:34:24.973263+0000","last_became_active":"2023-07-21T22:34:23.985069+0000","last_became_peered":"2023-07-21T22:34:23.985069+0000","last_unstale":"2023-07-21T22:34:24.973263+0000","last_undegraded":"2023-07-21T22:34:24.973263+0000","last_fullsized":"2023-07-21T22:34:24.973263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:48:32.426770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973220+0000","last_change":"2023-07-21T22:34:23.990262+0000","last_active":"2023-07-21T22:34:24.973220+0000","last_peered":"2023-07-21T22:34:24.973220+0000","last_clean":"2023-07-21T22:34:24.973220+0000","last_became_active":"2023-07-21T22:34:23.989959+0000","last_became_peered":"2023-07-21T22:34:23.989959+0000","last_unstale":"2023-07-21T22:34:24.973220+0000","last_undegraded":"2023-07-21T22:34:24.973220+0000","last_fullsized":"2023-07-21T22:34:24.973220+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:41:01.186425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976182+0000","last_change":"2023-07-21T22:34:23.996184+0000","last_active":"2023-07-21T22:34:24.976182+0000","last_peered":"2023-07-21T22:34:24.976182+0000","last_clean":"2023-07-21T22:34:24.976182+0000","last_became_active":"2023-07-21T22:34:23.995804+0000","last_became_peered":"2023-07-21T22:34:23.995804+0000","last_unstale":"2023-07-21T22:34:24.976182+0000","last_undegraded":"2023-07-21T22:34:24.976182+0000","last_fullsized":"2023-07-21T22:34:24.976182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:14.434853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382387+0000","last_change":"2023-07-21T22:34:23.973544+0000","last_active":"2023-07-21T22:34:25.382387+0000","last_peered":"2023-07-21T22:34:25.382387+0000","last_clean":"2023-07-21T22:34:25.382387+0000","last_became_active":"2023-07-21T22:34:23.973231+0000","last_became_peered":"2023-07-21T22:34:23.973231+0000","last_unstale":"2023-07-21T22:34:25.382387+0000","last_undegraded":"2023-07-21T22:34:25.382387+0000","last_fullsized":"2023-07-21T22:34:25.382387+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:23:21.645743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382436+0000","last_change":"2023-07-21T22:34:23.973606+0000","last_active":"2023-07-21T22:34:25.382436+0000","last_peered":"2023-07-21T22:34:25.382436+0000","last_clean":"2023-07-21T22:34:25.382436+0000","last_became_active":"2023-07-21T22:34:23.973049+0000","last_became_peered":"2023-07-21T22:34:23.973049+0000","last_unstale":"2023-07-21T22:34:25.382436+0000","last_undegraded":"2023-07-21T22:34:25.382436+0000","last_fullsized":"2023-07-21T22:34:25.382436+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:02:32.259845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977505+0000","last_change":"2023-07-21T22:34:23.986667+0000","last_active":"2023-07-21T22:34:24.977505+0000","last_peered":"2023-07-21T22:34:24.977505+0000","last_clean":"2023-07-21T22:34:24.977505+0000","last_became_active":"2023-07-21T22:34:23.986282+0000","last_became_peered":"2023-07-21T22:34:23.986282+0000","last_unstale":"2023-07-21T22:34:24.977505+0000","last_undegraded":"2023-07-21T22:34:24.977505+0000","last_fullsized":"2023-07-21T22:34:24.977505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:54:25.142343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377791+0000","last_change":"2023-07-21T22:34:23.972840+0000","last_active":"2023-07-21T22:34:25.377791+0000","last_peered":"2023-07-21T22:34:25.377791+0000","last_clean":"2023-07-21T22:34:25.377791+0000","last_became_active":"2023-07-21T22:34:23.970765+0000","last_became_peered":"2023-07-21T22:34:23.970765+0000","last_unstale":"2023-07-21T22:34:25.377791+0000","last_undegraded":"2023-07-21T22:34:25.377791+0000","last_fullsized":"2023-07-21T22:34:25.377791+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:15:40.314935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977198+0000","last_change":"2023-07-21T22:34:24.001006+0000","last_active":"2023-07-21T22:34:24.977198+0000","last_peered":"2023-07-21T22:34:24.977198+0000","last_clean":"2023-07-21T22:34:24.977198+0000","last_became_active":"2023-07-21T22:34:24.000366+0000","last_became_peered":"2023-07-21T22:34:24.000366+0000","last_unstale":"2023-07-21T22:34:24.977198+0000","last_undegraded":"2023-07-21T22:34:24.977198+0000","last_fullsized":"2023-07-21T22:34:24.977198+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:09:07.184904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381837+0000","last_change":"2023-07-21T22:34:23.997526+0000","last_active":"2023-07-21T22:34:25.381837+0000","last_peered":"2023-07-21T22:34:25.381837+0000","last_clean":"2023-07-21T22:34:25.381837+0000","last_became_active":"2023-07-21T22:34:23.997244+0000","last_became_peered":"2023-07-21T22:34:23.997244+0000","last_unstale":"2023-07-21T22:34:25.381837+0000","last_undegraded":"2023-07-21T22:34:25.381837+0000","last_fullsized":"2023-07-21T22:34:25.381837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:50.175867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976228+0000","last_change":"2023-07-21T22:34:23.982191+0000","last_active":"2023-07-21T22:34:24.976228+0000","last_peered":"2023-07-21T22:34:24.976228+0000","last_clean":"2023-07-21T22:34:24.976228+0000","last_became_active":"2023-07-21T22:34:23.981848+0000","last_became_peered":"2023-07-21T22:34:23.981848+0000","last_unstale":"2023-07-21T22:34:24.976228+0000","last_undegraded":"2023-07-21T22:34:24.976228+0000","last_fullsized":"2023-07-21T22:34:24.976228+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:43:52.864506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377523+0000","last_change":"2023-07-21T22:34:23.987622+0000","last_active":"2023-07-21T22:34:25.377523+0000","last_peered":"2023-07-21T22:34:25.377523+0000","last_clean":"2023-07-21T22:34:25.377523+0000","last_became_active":"2023-07-21T22:34:23.987169+0000","last_became_peered":"2023-07-21T22:34:23.987169+0000","last_unstale":"2023-07-21T22:34:25.377523+0000","last_undegraded":"2023-07-21T22:34:25.377523+0000","last_fullsized":"2023-07-21T22:34:25.377523+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:45.875486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382465+0000","last_change":"2023-07-21T22:34:23.972399+0000","last_active":"2023-07-21T22:34:25.382465+0000","last_peered":"2023-07-21T22:34:25.382465+0000","last_clean":"2023-07-21T22:34:25.382465+0000","last_became_active":"2023-07-21T22:34:23.971735+0000","last_became_peered":"2023-07-21T22:34:23.971735+0000","last_unstale":"2023-07-21T22:34:25.382465+0000","last_undegraded":"2023-07-21T22:34:25.382465+0000","last_fullsized":"2023-07-21T22:34:25.382465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:49:31.415751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"83'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378305+0000","last_change":"2023-07-21T22:34:22.979497+0000","last_active":"2023-07-21T22:34:25.378305+0000","last_peered":"2023-07-21T22:34:25.378305+0000","last_clean":"2023-07-21T22:34:25.378305+0000","last_became_active":"2023-07-21T22:34:22.979085+0000","last_became_peered":"2023-07-21T22:34:22.979085+0000","last_unstale":"2023-07-21T22:34:25.378305+0000","last_undegraded":"2023-07-21T22:34:25.378305+0000","last_fullsized":"2023-07-21T22:34:25.378305+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:22:34.537168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977634+0000","last_change":"2023-07-21T22:34:23.980205+0000","last_active":"2023-07-21T22:34:24.977634+0000","last_peered":"2023-07-21T22:34:24.977634+0000","last_clean":"2023-07-21T22:34:24.977634+0000","last_became_active":"2023-07-21T22:34:23.979897+0000","last_became_peered":"2023-07-21T22:34:23.979897+0000","last_unstale":"2023-07-21T22:34:24.977634+0000","last_undegraded":"2023-07-21T22:34:24.977634+0000","last_fullsized":"2023-07-21T22:34:24.977634+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:03:42.054358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"83'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378261+0000","last_change":"2023-07-21T22:34:22.981336+0000","last_active":"2023-07-21T22:34:25.378261+0000","last_peered":"2023-07-21T22:34:25.378261+0000","last_clean":"2023-07-21T22:34:25.378261+0000","last_became_active":"2023-07-21T22:34:22.981041+0000","last_became_peered":"2023-07-21T22:34:22.981041+0000","last_unstale":"2023-07-21T22:34:25.378261+0000","last_undegraded":"2023-07-21T22:34:25.378261+0000","last_fullsized":"2023-07-21T22:34:25.378261+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:41:24.958079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377968+0000","last_change":"2023-07-21T22:34:23.986733+0000","last_active":"2023-07-21T22:34:25.377968+0000","last_peered":"2023-07-21T22:34:25.377968+0000","last_clean":"2023-07-21T22:34:25.377968+0000","last_became_active":"2023-07-21T22:34:23.986453+0000","last_became_peered":"2023-07-21T22:34:23.986453+0000","last_unstale":"2023-07-21T22:34:25.377968+0000","last_undegraded":"2023-07-21T22:34:25.377968+0000","last_fullsized":"2023-07-21T22:34:25.377968+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:31:39.959672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378208+0000","last_change":"2023-07-21T22:34:22.977004+0000","last_active":"2023-07-21T22:34:25.378208+0000","last_peered":"2023-07-21T22:34:25.378208+0000","last_clean":"2023-07-21T22:34:25.378208+0000","last_became_active":"2023-07-21T22:34:22.976750+0000","last_became_peered":"2023-07-21T22:34:22.976750+0000","last_unstale":"2023-07-21T22:34:25.378208+0000","last_undegraded":"2023-07-21T22:34:25.378208+0000","last_fullsized":"2023-07-21T22:34:25.378208+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:28.111216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976672+0000","last_change":"2023-07-21T22:34:23.987599+0000","last_active":"2023-07-21T22:34:24.976672+0000","last_peered":"2023-07-21T22:34:24.976672+0000","last_clean":"2023-07-21T22:34:24.976672+0000","last_became_active":"2023-07-21T22:34:23.987298+0000","last_became_peered":"2023-07-21T22:34:23.987298+0000","last_unstale":"2023-07-21T22:34:24.976672+0000","last_undegraded":"2023-07-21T22:34:24.976672+0000","last_fullsized":"2023-07-21T22:34:24.976672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:21:22.785583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377963+0000","last_change":"2023-07-21T22:34:22.970084+0000","last_active":"2023-07-21T22:34:25.377963+0000","last_peered":"2023-07-21T22:34:25.377963+0000","last_clean":"2023-07-21T22:34:25.377963+0000","last_became_active":"2023-07-21T22:34:22.969773+0000","last_became_peered":"2023-07-21T22:34:22.969773+0000","last_unstale":"2023-07-21T22:34:25.377963+0000","last_undegraded":"2023-07-21T22:34:25.377963+0000","last_fullsized":"2023-07-21T22:34:25.377963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:25:27.833620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.244669+0000","last_change":"2023-07-21T22:34:23.971038+0000","last_active":"2023-07-21T22:34:25.244669+0000","last_peered":"2023-07-21T22:34:25.244669+0000","last_clean":"2023-07-21T22:34:25.244669+0000","last_became_active":"2023-07-21T22:34:23.970652+0000","last_became_peered":"2023-07-21T22:34:23.970652+0000","last_unstale":"2023-07-21T22:34:25.244669+0000","last_undegraded":"2023-07-21T22:34:25.244669+0000","last_fullsized":"2023-07-21T22:34:25.244669+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:40:31.195176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"83'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973418+0000","last_change":"2023-07-21T22:34:22.970835+0000","last_active":"2023-07-21T22:34:24.973418+0000","last_peered":"2023-07-21T22:34:24.973418+0000","last_clean":"2023-07-21T22:34:24.973418+0000","last_became_active":"2023-07-21T22:34:22.970540+0000","last_became_peered":"2023-07-21T22:34:22.970540+0000","last_unstale":"2023-07-21T22:34:24.973418+0000","last_undegraded":"2023-07-21T22:34:24.973418+0000","last_fullsized":"2023-07-21T22:34:24.973418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:24:28.818398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377306+0000","last_change":"2023-07-21T22:34:23.986252+0000","last_active":"2023-07-21T22:34:25.377306+0000","last_peered":"2023-07-21T22:34:25.377306+0000","last_clean":"2023-07-21T22:34:25.377306+0000","last_became_active":"2023-07-21T22:34:23.985928+0000","last_became_peered":"2023-07-21T22:34:23.985928+0000","last_unstale":"2023-07-21T22:34:25.377306+0000","last_undegraded":"2023-07-21T22:34:25.377306+0000","last_fullsized":"2023-07-21T22:34:25.377306+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:03:20.027035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"83'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973624+0000","last_change":"2023-07-21T22:34:22.968964+0000","last_active":"2023-07-21T22:34:24.973624+0000","last_peered":"2023-07-21T22:34:24.973624+0000","last_clean":"2023-07-21T22:34:24.973624+0000","last_became_active":"2023-07-21T22:34:22.968672+0000","last_became_peered":"2023-07-21T22:34:22.968672+0000","last_unstale":"2023-07-21T22:34:24.973624+0000","last_undegraded":"2023-07-21T22:34:24.973624+0000","last_fullsized":"2023-07-21T22:34:24.973624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:35:25.577952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381587+0000","last_change":"2023-07-21T22:34:23.981967+0000","last_active":"2023-07-21T22:34:25.381587+0000","last_peered":"2023-07-21T22:34:25.381587+0000","last_clean":"2023-07-21T22:34:25.381587+0000","last_became_active":"2023-07-21T22:34:23.981661+0000","last_became_peered":"2023-07-21T22:34:23.981661+0000","last_unstale":"2023-07-21T22:34:25.381587+0000","last_undegraded":"2023-07-21T22:34:25.381587+0000","last_fullsized":"2023-07-21T22:34:25.381587+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:23:30.445380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973339+0000","last_change":"2023-07-21T22:34:22.975818+0000","last_active":"2023-07-21T22:34:24.973339+0000","last_peered":"2023-07-21T22:34:24.973339+0000","last_clean":"2023-07-21T22:34:24.973339+0000","last_became_active":"2023-07-21T22:34:22.975533+0000","last_became_peered":"2023-07-21T22:34:22.975533+0000","last_unstale":"2023-07-21T22:34:24.973339+0000","last_undegraded":"2023-07-21T22:34:24.973339+0000","last_fullsized":"2023-07-21T22:34:24.973339+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:41.027795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973425+0000","last_change":"2023-07-21T22:34:23.978627+0000","last_active":"2023-07-21T22:34:24.973425+0000","last_peered":"2023-07-21T22:34:24.973425+0000","last_clean":"2023-07-21T22:34:24.973425+0000","last_became_active":"2023-07-21T22:34:23.978343+0000","last_became_peered":"2023-07-21T22:34:23.978343+0000","last_unstale":"2023-07-21T22:34:24.973425+0000","last_undegraded":"2023-07-21T22:34:24.973425+0000","last_fullsized":"2023-07-21T22:34:24.973425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:15:40.314935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381699+0000","last_change":"2023-07-21T22:34:22.982821+0000","last_active":"2023-07-21T22:34:25.381699+0000","last_peered":"2023-07-21T22:34:25.381699+0000","last_clean":"2023-07-21T22:34:25.381699+0000","last_became_active":"2023-07-21T22:34:22.982493+0000","last_became_peered":"2023-07-21T22:34:22.982493+0000","last_unstale":"2023-07-21T22:34:25.381699+0000","last_undegraded":"2023-07-21T22:34:25.381699+0000","last_fullsized":"2023-07-21T22:34:25.381699+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:19:11.821675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377932+0000","last_change":"2023-07-21T22:34:23.975636+0000","last_active":"2023-07-21T22:34:25.377932+0000","last_peered":"2023-07-21T22:34:25.377932+0000","last_clean":"2023-07-21T22:34:25.377932+0000","last_became_active":"2023-07-21T22:34:23.974498+0000","last_became_peered":"2023-07-21T22:34:23.974498+0000","last_unstale":"2023-07-21T22:34:25.377932+0000","last_undegraded":"2023-07-21T22:34:25.377932+0000","last_fullsized":"2023-07-21T22:34:25.377932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:24:29.825473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976727+0000","last_change":"2023-07-21T22:34:22.984655+0000","last_active":"2023-07-21T22:34:24.976727+0000","last_peered":"2023-07-21T22:34:24.976727+0000","last_clean":"2023-07-21T22:34:24.976727+0000","last_became_active":"2023-07-21T22:34:22.984018+0000","last_became_peered":"2023-07-21T22:34:22.984018+0000","last_unstale":"2023-07-21T22:34:24.976727+0000","last_undegraded":"2023-07-21T22:34:24.976727+0000","last_fullsized":"2023-07-21T22:34:24.976727+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:42:31.358322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973521+0000","last_change":"2023-07-21T22:34:23.973718+0000","last_active":"2023-07-21T22:34:24.973521+0000","last_peered":"2023-07-21T22:34:24.973521+0000","last_clean":"2023-07-21T22:34:24.973521+0000","last_became_active":"2023-07-21T22:34:23.973399+0000","last_became_peered":"2023-07-21T22:34:23.973399+0000","last_unstale":"2023-07-21T22:34:24.973521+0000","last_undegraded":"2023-07-21T22:34:24.973521+0000","last_fullsized":"2023-07-21T22:34:24.973521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:03:29.728340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977829+0000","last_change":"2023-07-21T22:34:22.980664+0000","last_active":"2023-07-21T22:34:24.977829+0000","last_peered":"2023-07-21T22:34:24.977829+0000","last_clean":"2023-07-21T22:34:24.977829+0000","last_became_active":"2023-07-21T22:34:22.980400+0000","last_became_peered":"2023-07-21T22:34:22.980400+0000","last_unstale":"2023-07-21T22:34:24.977829+0000","last_undegraded":"2023-07-21T22:34:24.977829+0000","last_fullsized":"2023-07-21T22:34:24.977829+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:23:01.635751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382560+0000","last_change":"2023-07-21T22:34:23.980040+0000","last_active":"2023-07-21T22:34:25.382560+0000","last_peered":"2023-07-21T22:34:25.382560+0000","last_clean":"2023-07-21T22:34:25.382560+0000","last_became_active":"2023-07-21T22:34:23.979773+0000","last_became_peered":"2023-07-21T22:34:23.979773+0000","last_unstale":"2023-07-21T22:34:25.382560+0000","last_undegraded":"2023-07-21T22:34:25.382560+0000","last_fullsized":"2023-07-21T22:34:25.382560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:30:02.222355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"83'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976878+0000","last_change":"2023-07-21T22:34:22.983166+0000","last_active":"2023-07-21T22:34:24.976878+0000","last_peered":"2023-07-21T22:34:24.976878+0000","last_clean":"2023-07-21T22:34:24.976878+0000","last_became_active":"2023-07-21T22:34:22.982456+0000","last_became_peered":"2023-07-21T22:34:22.982456+0000","last_unstale":"2023-07-21T22:34:24.976878+0000","last_undegraded":"2023-07-21T22:34:24.976878+0000","last_fullsized":"2023-07-21T22:34:24.976878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:03:05.392480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977967+0000","last_change":"2023-07-21T22:34:23.981036+0000","last_active":"2023-07-21T22:34:24.977967+0000","last_peered":"2023-07-21T22:34:24.977967+0000","last_clean":"2023-07-21T22:34:24.977967+0000","last_became_active":"2023-07-21T22:34:23.980729+0000","last_became_peered":"2023-07-21T22:34:23.980729+0000","last_unstale":"2023-07-21T22:34:24.977967+0000","last_undegraded":"2023-07-21T22:34:24.977967+0000","last_fullsized":"2023-07-21T22:34:24.977967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:41:34.837525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"83'6","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378076+0000","last_change":"2023-07-21T22:34:22.983569+0000","last_active":"2023-07-21T22:34:25.378076+0000","last_peered":"2023-07-21T22:34:25.378076+0000","last_clean":"2023-07-21T22:34:25.378076+0000","last_became_active":"2023-07-21T22:34:22.983277+0000","last_became_peered":"2023-07-21T22:34:22.983277+0000","last_unstale":"2023-07-21T22:34:25.378076+0000","last_undegraded":"2023-07-21T22:34:25.378076+0000","last_fullsized":"2023-07-21T22:34:25.378076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:03:28.721266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977036+0000","last_change":"2023-07-21T22:34:23.996942+0000","last_active":"2023-07-21T22:34:24.977036+0000","last_peered":"2023-07-21T22:34:24.977036+0000","last_clean":"2023-07-21T22:34:24.977036+0000","last_became_active":"2023-07-21T22:34:23.996603+0000","last_became_peered":"2023-07-21T22:34:23.996603+0000","last_unstale":"2023-07-21T22:34:24.977036+0000","last_undegraded":"2023-07-21T22:34:24.977036+0000","last_fullsized":"2023-07-21T22:34:24.977036+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:01:19.870056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977358+0000","last_change":"2023-07-21T22:34:22.985264+0000","last_active":"2023-07-21T22:34:24.977358+0000","last_peered":"2023-07-21T22:34:24.977358+0000","last_clean":"2023-07-21T22:34:24.977358+0000","last_became_active":"2023-07-21T22:34:22.984946+0000","last_became_peered":"2023-07-21T22:34:22.984946+0000","last_unstale":"2023-07-21T22:34:24.977358+0000","last_undegraded":"2023-07-21T22:34:24.977358+0000","last_fullsized":"2023-07-21T22:34:24.977358+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:41:41.930342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381517+0000","last_change":"2023-07-21T22:34:23.979766+0000","last_active":"2023-07-21T22:34:25.381517+0000","last_peered":"2023-07-21T22:34:25.381517+0000","last_clean":"2023-07-21T22:34:25.381517+0000","last_became_active":"2023-07-21T22:34:23.978981+0000","last_became_peered":"2023-07-21T22:34:23.978981+0000","last_unstale":"2023-07-21T22:34:25.381517+0000","last_undegraded":"2023-07-21T22:34:25.381517+0000","last_fullsized":"2023-07-21T22:34:25.381517+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:39:09.619306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381870+0000","last_change":"2023-07-21T22:34:22.978391+0000","last_active":"2023-07-21T22:34:25.381870+0000","last_peered":"2023-07-21T22:34:25.381870+0000","last_clean":"2023-07-21T22:34:25.381870+0000","last_became_active":"2023-07-21T22:34:22.978125+0000","last_became_peered":"2023-07-21T22:34:22.978125+0000","last_unstale":"2023-07-21T22:34:25.381870+0000","last_undegraded":"2023-07-21T22:34:25.381870+0000","last_fullsized":"2023-07-21T22:34:25.381870+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:07:47.116457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381494+0000","last_change":"2023-07-21T22:34:23.975311+0000","last_active":"2023-07-21T22:34:25.381494+0000","last_peered":"2023-07-21T22:34:25.381494+0000","last_clean":"2023-07-21T22:34:25.381494+0000","last_became_active":"2023-07-21T22:34:23.974987+0000","last_became_peered":"2023-07-21T22:34:23.974987+0000","last_unstale":"2023-07-21T22:34:25.381494+0000","last_undegraded":"2023-07-21T22:34:25.381494+0000","last_fullsized":"2023-07-21T22:34:25.381494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:02:20.149470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976243+0000","last_change":"2023-07-21T22:34:22.983579+0000","last_active":"2023-07-21T22:34:24.976243+0000","last_peered":"2023-07-21T22:34:24.976243+0000","last_clean":"2023-07-21T22:34:24.976243+0000","last_became_active":"2023-07-21T22:34:22.983241+0000","last_became_peered":"2023-07-21T22:34:22.983241+0000","last_unstale":"2023-07-21T22:34:24.976243+0000","last_undegraded":"2023-07-21T22:34:24.976243+0000","last_fullsized":"2023-07-21T22:34:24.976243+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:32:25.290199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377615+0000","last_change":"2023-07-21T22:34:23.993703+0000","last_active":"2023-07-21T22:34:25.377615+0000","last_peered":"2023-07-21T22:34:25.377615+0000","last_clean":"2023-07-21T22:34:25.377615+0000","last_became_active":"2023-07-21T22:34:23.993410+0000","last_became_peered":"2023-07-21T22:34:23.993410+0000","last_unstale":"2023-07-21T22:34:25.377615+0000","last_undegraded":"2023-07-21T22:34:25.377615+0000","last_fullsized":"2023-07-21T22:34:25.377615+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:44:38.717538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"83'8","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977183+0000","last_change":"2023-07-21T22:34:22.985768+0000","last_active":"2023-07-21T22:34:24.977183+0000","last_peered":"2023-07-21T22:34:24.977183+0000","last_clean":"2023-07-21T22:34:24.977183+0000","last_became_active":"2023-07-21T22:34:22.985453+0000","last_became_peered":"2023-07-21T22:34:22.985453+0000","last_unstale":"2023-07-21T22:34:24.977183+0000","last_undegraded":"2023-07-21T22:34:24.977183+0000","last_fullsized":"2023-07-21T22:34:24.977183+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:35:17.465512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377853+0000","last_change":"2023-07-21T22:34:23.980311+0000","last_active":"2023-07-21T22:34:25.377853+0000","last_peered":"2023-07-21T22:34:25.377853+0000","last_clean":"2023-07-21T22:34:25.377853+0000","last_became_active":"2023-07-21T22:34:23.980043+0000","last_became_peered":"2023-07-21T22:34:23.980043+0000","last_unstale":"2023-07-21T22:34:25.377853+0000","last_undegraded":"2023-07-21T22:34:25.377853+0000","last_fullsized":"2023-07-21T22:34:25.377853+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:34:24.285854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382682+0000","last_change":"2023-07-21T22:34:22.982600+0000","last_active":"2023-07-21T22:34:25.382682+0000","last_peered":"2023-07-21T22:34:25.382682+0000","last_clean":"2023-07-21T22:34:25.382682+0000","last_became_active":"2023-07-21T22:34:22.982315+0000","last_became_peered":"2023-07-21T22:34:22.982315+0000","last_unstale":"2023-07-21T22:34:25.382682+0000","last_undegraded":"2023-07-21T22:34:25.382682+0000","last_fullsized":"2023-07-21T22:34:25.382682+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:27.446542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.244739+0000","last_change":"2023-07-21T22:34:23.978397+0000","last_active":"2023-07-21T22:34:25.244739+0000","last_peered":"2023-07-21T22:34:25.244739+0000","last_clean":"2023-07-21T22:34:25.244739+0000","last_became_active":"2023-07-21T22:34:23.978109+0000","last_became_peered":"2023-07-21T22:34:23.978109+0000","last_unstale":"2023-07-21T22:34:25.244739+0000","last_undegraded":"2023-07-21T22:34:25.244739+0000","last_fullsized":"2023-07-21T22:34:25.244739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:01:07.753504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382638+0000","last_change":"2023-07-21T22:34:22.979042+0000","last_active":"2023-07-21T22:34:25.382638+0000","last_peered":"2023-07-21T22:34:25.382638+0000","last_clean":"2023-07-21T22:34:25.382638+0000","last_became_active":"2023-07-21T22:34:22.978740+0000","last_became_peered":"2023-07-21T22:34:22.978740+0000","last_unstale":"2023-07-21T22:34:25.382638+0000","last_undegraded":"2023-07-21T22:34:25.382638+0000","last_fullsized":"2023-07-21T22:34:25.382638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:16:21.371057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382462+0000","last_change":"2023-07-21T22:34:23.983684+0000","last_active":"2023-07-21T22:34:25.382462+0000","last_peered":"2023-07-21T22:34:25.382462+0000","last_clean":"2023-07-21T22:34:25.382462+0000","last_became_active":"2023-07-21T22:34:23.983428+0000","last_became_peered":"2023-07-21T22:34:23.983428+0000","last_unstale":"2023-07-21T22:34:25.382462+0000","last_undegraded":"2023-07-21T22:34:25.382462+0000","last_fullsized":"2023-07-21T22:34:25.382462+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:21:13.260605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378168+0000","last_change":"2023-07-21T22:34:22.977004+0000","last_active":"2023-07-21T22:34:25.378168+0000","last_peered":"2023-07-21T22:34:25.378168+0000","last_clean":"2023-07-21T22:34:25.378168+0000","last_became_active":"2023-07-21T22:34:22.976697+0000","last_became_peered":"2023-07-21T22:34:22.976697+0000","last_unstale":"2023-07-21T22:34:25.378168+0000","last_undegraded":"2023-07-21T22:34:25.378168+0000","last_fullsized":"2023-07-21T22:34:25.378168+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:20:44.813322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382231+0000","last_change":"2023-07-21T22:34:23.976202+0000","last_active":"2023-07-21T22:34:25.382231+0000","last_peered":"2023-07-21T22:34:25.382231+0000","last_clean":"2023-07-21T22:34:25.382231+0000","last_became_active":"2023-07-21T22:34:23.975840+0000","last_became_peered":"2023-07-21T22:34:23.975840+0000","last_unstale":"2023-07-21T22:34:25.382231+0000","last_undegraded":"2023-07-21T22:34:25.382231+0000","last_fullsized":"2023-07-21T22:34:25.382231+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:03:23.404248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378198+0000","last_change":"2023-07-21T22:34:22.983643+0000","last_active":"2023-07-21T22:34:25.378198+0000","last_peered":"2023-07-21T22:34:25.378198+0000","last_clean":"2023-07-21T22:34:25.378198+0000","last_became_active":"2023-07-21T22:34:22.983314+0000","last_became_peered":"2023-07-21T22:34:22.983314+0000","last_unstale":"2023-07-21T22:34:25.378198+0000","last_undegraded":"2023-07-21T22:34:25.378198+0000","last_fullsized":"2023-07-21T22:34:25.378198+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:30:11.604700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381461+0000","last_change":"2023-07-21T22:34:23.975201+0000","last_active":"2023-07-21T22:34:25.381461+0000","last_peered":"2023-07-21T22:34:25.381461+0000","last_clean":"2023-07-21T22:34:25.381461+0000","last_became_active":"2023-07-21T22:34:23.974886+0000","last_became_peered":"2023-07-21T22:34:23.974886+0000","last_unstale":"2023-07-21T22:34:25.381461+0000","last_undegraded":"2023-07-21T22:34:25.381461+0000","last_fullsized":"2023-07-21T22:34:25.381461+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:47:07.038679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977388+0000","last_change":"2023-07-21T22:34:22.982875+0000","last_active":"2023-07-21T22:34:24.977388+0000","last_peered":"2023-07-21T22:34:24.977388+0000","last_clean":"2023-07-21T22:34:24.977388+0000","last_became_active":"2023-07-21T22:34:22.982387+0000","last_became_peered":"2023-07-21T22:34:22.982387+0000","last_unstale":"2023-07-21T22:34:24.977388+0000","last_undegraded":"2023-07-21T22:34:24.977388+0000","last_fullsized":"2023-07-21T22:34:24.977388+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:10:46.817282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976369+0000","last_change":"2023-07-21T22:34:23.993975+0000","last_active":"2023-07-21T22:34:24.976369+0000","last_peered":"2023-07-21T22:34:24.976369+0000","last_clean":"2023-07-21T22:34:24.976369+0000","last_became_active":"2023-07-21T22:34:23.993694+0000","last_became_peered":"2023-07-21T22:34:23.993694+0000","last_unstale":"2023-07-21T22:34:24.976369+0000","last_undegraded":"2023-07-21T22:34:24.976369+0000","last_fullsized":"2023-07-21T22:34:24.976369+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:58:24.669979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973397+0000","last_change":"2023-07-21T22:34:22.967847+0000","last_active":"2023-07-21T22:34:24.973397+0000","last_peered":"2023-07-21T22:34:24.973397+0000","last_clean":"2023-07-21T22:34:24.973397+0000","last_became_active":"2023-07-21T22:34:22.967434+0000","last_became_peered":"2023-07-21T22:34:22.967434+0000","last_unstale":"2023-07-21T22:34:24.973397+0000","last_undegraded":"2023-07-21T22:34:24.973397+0000","last_fullsized":"2023-07-21T22:34:24.973397+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:44:37.710464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377393+0000","last_change":"2023-07-21T22:34:23.986576+0000","last_active":"2023-07-21T22:34:25.377393+0000","last_peered":"2023-07-21T22:34:25.377393+0000","last_clean":"2023-07-21T22:34:25.377393+0000","last_became_active":"2023-07-21T22:34:23.986278+0000","last_became_peered":"2023-07-21T22:34:23.986278+0000","last_unstale":"2023-07-21T22:34:25.377393+0000","last_undegraded":"2023-07-21T22:34:25.377393+0000","last_fullsized":"2023-07-21T22:34:25.377393+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:42.034870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973269+0000","last_change":"2023-07-21T22:34:22.976249+0000","last_active":"2023-07-21T22:34:24.973269+0000","last_peered":"2023-07-21T22:34:24.973269+0000","last_clean":"2023-07-21T22:34:24.973269+0000","last_became_active":"2023-07-21T22:34:22.975817+0000","last_became_peered":"2023-07-21T22:34:22.975817+0000","last_unstale":"2023-07-21T22:34:24.973269+0000","last_undegraded":"2023-07-21T22:34:24.973269+0000","last_fullsized":"2023-07-21T22:34:24.973269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:03:19.019961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.244534+0000","last_change":"2023-07-21T22:34:23.979900+0000","last_active":"2023-07-21T22:34:25.244534+0000","last_peered":"2023-07-21T22:34:25.244534+0000","last_clean":"2023-07-21T22:34:25.244534+0000","last_became_active":"2023-07-21T22:34:23.979633+0000","last_became_peered":"2023-07-21T22:34:23.979633+0000","last_unstale":"2023-07-21T22:34:25.244534+0000","last_undegraded":"2023-07-21T22:34:25.244534+0000","last_fullsized":"2023-07-21T22:34:25.244534+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:24:26.617289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377261+0000","last_change":"2023-07-21T22:34:22.976771+0000","last_active":"2023-07-21T22:34:25.377261+0000","last_peered":"2023-07-21T22:34:25.377261+0000","last_clean":"2023-07-21T22:34:25.377261+0000","last_became_active":"2023-07-21T22:34:22.976478+0000","last_became_peered":"2023-07-21T22:34:22.976478+0000","last_unstale":"2023-07-21T22:34:25.377261+0000","last_undegraded":"2023-07-21T22:34:25.377261+0000","last_fullsized":"2023-07-21T22:34:25.377261+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:48:31.419695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381914+0000","last_change":"2023-07-21T22:34:23.974607+0000","last_active":"2023-07-21T22:34:25.381914+0000","last_peered":"2023-07-21T22:34:25.381914+0000","last_clean":"2023-07-21T22:34:25.381914+0000","last_became_active":"2023-07-21T22:34:23.974329+0000","last_became_peered":"2023-07-21T22:34:23.974329+0000","last_unstale":"2023-07-21T22:34:25.381914+0000","last_undegraded":"2023-07-21T22:34:25.381914+0000","last_fullsized":"2023-07-21T22:34:25.381914+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:44:00.203211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973194+0000","last_change":"2023-07-21T22:34:22.971793+0000","last_active":"2023-07-21T22:34:24.973194+0000","last_peered":"2023-07-21T22:34:24.973194+0000","last_clean":"2023-07-21T22:34:24.973194+0000","last_became_active":"2023-07-21T22:34:22.971485+0000","last_became_peered":"2023-07-21T22:34:22.971485+0000","last_unstale":"2023-07-21T22:34:24.973194+0000","last_undegraded":"2023-07-21T22:34:24.973194+0000","last_fullsized":"2023-07-21T22:34:24.973194+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:54:08.810157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"72'161","reported_seq":440,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976463+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:34:24.976463+0000","last_peered":"2023-07-21T22:34:24.976463+0000","last_clean":"2023-07-21T22:34:24.976463+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:34:24.976463+0000","last_undegraded":"2023-07-21T22:34:24.976463+0000","last_fullsized":"2023-07-21T22:34:24.976463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:06:05.620846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382036+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:34:25.382036+0000","last_peered":"2023-07-21T22:34:25.382036+0000","last_clean":"2023-07-21T22:34:25.382036+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:34:25.382036+0000","last_undegraded":"2023-07-21T22:34:25.382036+0000","last_fullsized":"2023-07-21T22:34:25.382036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:12:37.450061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377572+0000","last_change":"2023-07-21T22:34:23.987435+0000","last_active":"2023-07-21T22:34:25.377572+0000","last_peered":"2023-07-21T22:34:25.377572+0000","last_clean":"2023-07-21T22:34:25.377572+0000","last_became_active":"2023-07-21T22:34:23.986712+0000","last_became_peered":"2023-07-21T22:34:23.986712+0000","last_unstale":"2023-07-21T22:34:25.377572+0000","last_undegraded":"2023-07-21T22:34:25.377572+0000","last_fullsized":"2023-07-21T22:34:25.377572+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:41:22.787768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377536+0000","last_change":"2023-07-21T22:34:22.978762+0000","last_active":"2023-07-21T22:34:25.377536+0000","last_peered":"2023-07-21T22:34:25.377536+0000","last_clean":"2023-07-21T22:34:25.377536+0000","last_became_active":"2023-07-21T22:34:22.978367+0000","last_became_peered":"2023-07-21T22:34:22.978367+0000","last_unstale":"2023-07-21T22:34:25.377536+0000","last_undegraded":"2023-07-21T22:34:25.377536+0000","last_fullsized":"2023-07-21T22:34:25.377536+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:22:27.207819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":128,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976321+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:34:24.976321+0000","last_peered":"2023-07-21T22:34:24.976321+0000","last_clean":"2023-07-21T22:34:24.976321+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:34:24.976321+0000","last_undegraded":"2023-07-21T22:34:24.976321+0000","last_fullsized":"2023-07-21T22:34:24.976321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:21:24.825644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381694+0000","last_change":"2023-07-21T22:34:23.976069+0000","last_active":"2023-07-21T22:34:25.381694+0000","last_peered":"2023-07-21T22:34:25.381694+0000","last_clean":"2023-07-21T22:34:25.381694+0000","last_became_active":"2023-07-21T22:34:23.975778+0000","last_became_peered":"2023-07-21T22:34:23.975778+0000","last_unstale":"2023-07-21T22:34:25.381694+0000","last_undegraded":"2023-07-21T22:34:25.381694+0000","last_fullsized":"2023-07-21T22:34:25.381694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:31:45.523353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382046+0000","last_change":"2023-07-21T22:34:22.977887+0000","last_active":"2023-07-21T22:34:25.382046+0000","last_peered":"2023-07-21T22:34:25.382046+0000","last_clean":"2023-07-21T22:34:25.382046+0000","last_became_active":"2023-07-21T22:34:22.977599+0000","last_became_peered":"2023-07-21T22:34:22.977599+0000","last_unstale":"2023-07-21T22:34:25.382046+0000","last_undegraded":"2023-07-21T22:34:25.382046+0000","last_fullsized":"2023-07-21T22:34:25.382046+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:02:17.037056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":124,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.244653+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:34:25.244653+0000","last_peered":"2023-07-21T22:34:25.244653+0000","last_clean":"2023-07-21T22:34:25.244653+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:34:25.244653+0000","last_undegraded":"2023-07-21T22:34:25.244653+0000","last_fullsized":"2023-07-21T22:34:25.244653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:17:30.700055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381658+0000","last_change":"2023-07-21T22:34:23.981172+0000","last_active":"2023-07-21T22:34:25.381658+0000","last_peered":"2023-07-21T22:34:25.381658+0000","last_clean":"2023-07-21T22:34:25.381658+0000","last_became_active":"2023-07-21T22:34:23.980894+0000","last_became_peered":"2023-07-21T22:34:23.980894+0000","last_unstale":"2023-07-21T22:34:25.381658+0000","last_undegraded":"2023-07-21T22:34:25.381658+0000","last_fullsized":"2023-07-21T22:34:25.381658+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:04:25.187714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377500+0000","last_change":"2023-07-21T22:34:22.981350+0000","last_active":"2023-07-21T22:34:25.377500+0000","last_peered":"2023-07-21T22:34:25.377500+0000","last_clean":"2023-07-21T22:34:25.377500+0000","last_became_active":"2023-07-21T22:34:22.981023+0000","last_became_peered":"2023-07-21T22:34:22.981023+0000","last_unstale":"2023-07-21T22:34:25.377500+0000","last_undegraded":"2023-07-21T22:34:25.377500+0000","last_fullsized":"2023-07-21T22:34:25.377500+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:30:48.994293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382015+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:34:25.382015+0000","last_peered":"2023-07-21T22:34:25.382015+0000","last_clean":"2023-07-21T22:34:25.382015+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:34:25.382015+0000","last_undegraded":"2023-07-21T22:34:25.382015+0000","last_fullsized":"2023-07-21T22:34:25.382015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:16:42.113002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976563+0000","last_change":"2023-07-21T22:34:23.994520+0000","last_active":"2023-07-21T22:34:24.976563+0000","last_peered":"2023-07-21T22:34:24.976563+0000","last_clean":"2023-07-21T22:34:24.976563+0000","last_became_active":"2023-07-21T22:34:23.994236+0000","last_became_peered":"2023-07-21T22:34:23.994236+0000","last_unstale":"2023-07-21T22:34:24.976563+0000","last_undegraded":"2023-07-21T22:34:24.976563+0000","last_fullsized":"2023-07-21T22:34:24.976563+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:47:33.497295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"83'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382541+0000","last_change":"2023-07-21T22:34:22.978160+0000","last_active":"2023-07-21T22:34:25.382541+0000","last_peered":"2023-07-21T22:34:25.382541+0000","last_clean":"2023-07-21T22:34:25.382541+0000","last_became_active":"2023-07-21T22:34:22.977862+0000","last_became_peered":"2023-07-21T22:34:22.977862+0000","last_unstale":"2023-07-21T22:34:25.382541+0000","last_undegraded":"2023-07-21T22:34:25.382541+0000","last_fullsized":"2023-07-21T22:34:25.382541+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:15:27.797496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":134,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378306+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:34:25.378306+0000","last_peered":"2023-07-21T22:34:25.378306+0000","last_clean":"2023-07-21T22:34:25.378306+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:34:25.378306+0000","last_undegraded":"2023-07-21T22:34:25.378306+0000","last_fullsized":"2023-07-21T22:34:25.378306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:16:07.957187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382252+0000","last_change":"2023-07-21T22:34:23.983677+0000","last_active":"2023-07-21T22:34:25.382252+0000","last_peered":"2023-07-21T22:34:25.382252+0000","last_clean":"2023-07-21T22:34:25.382252+0000","last_became_active":"2023-07-21T22:34:23.983076+0000","last_became_peered":"2023-07-21T22:34:23.983076+0000","last_unstale":"2023-07-21T22:34:25.382252+0000","last_undegraded":"2023-07-21T22:34:25.382252+0000","last_fullsized":"2023-07-21T22:34:25.382252+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:00:10.544232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976642+0000","last_change":"2023-07-21T22:34:22.987856+0000","last_active":"2023-07-21T22:34:24.976642+0000","last_peered":"2023-07-21T22:34:24.976642+0000","last_clean":"2023-07-21T22:34:24.976642+0000","last_became_active":"2023-07-21T22:34:22.987572+0000","last_became_peered":"2023-07-21T22:34:22.987572+0000","last_unstale":"2023-07-21T22:34:24.976642+0000","last_undegraded":"2023-07-21T22:34:24.976642+0000","last_fullsized":"2023-07-21T22:34:24.976642+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:37:53.063513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977179+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:34:24.977179+0000","last_peered":"2023-07-21T22:34:24.977179+0000","last_clean":"2023-07-21T22:34:24.977179+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:34:24.977179+0000","last_undegraded":"2023-07-21T22:34:24.977179+0000","last_fullsized":"2023-07-21T22:34:24.977179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:42:46.823866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977793+0000","last_change":"2023-07-21T22:34:23.980559+0000","last_active":"2023-07-21T22:34:24.977793+0000","last_peered":"2023-07-21T22:34:24.977793+0000","last_clean":"2023-07-21T22:34:24.977793+0000","last_became_active":"2023-07-21T22:34:23.980283+0000","last_became_peered":"2023-07-21T22:34:23.980283+0000","last_unstale":"2023-07-21T22:34:24.977793+0000","last_undegraded":"2023-07-21T22:34:24.977793+0000","last_fullsized":"2023-07-21T22:34:24.977793+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:17:00.717082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"83'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977022+0000","last_change":"2023-07-21T22:34:22.983383+0000","last_active":"2023-07-21T22:34:24.977022+0000","last_peered":"2023-07-21T22:34:24.977022+0000","last_clean":"2023-07-21T22:34:24.977022+0000","last_became_active":"2023-07-21T22:34:22.982810+0000","last_became_peered":"2023-07-21T22:34:22.982810+0000","last_unstale":"2023-07-21T22:34:24.977022+0000","last_undegraded":"2023-07-21T22:34:24.977022+0000","last_fullsized":"2023-07-21T22:34:24.977022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:43:14.697493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":134,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378169+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:34:25.378169+0000","last_peered":"2023-07-21T22:34:25.378169+0000","last_clean":"2023-07-21T22:34:25.378169+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:34:25.378169+0000","last_undegraded":"2023-07-21T22:34:25.378169+0000","last_fullsized":"2023-07-21T22:34:25.378169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:19:40.898837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382236+0000","last_change":"2023-07-21T22:34:23.975888+0000","last_active":"2023-07-21T22:34:25.382236+0000","last_peered":"2023-07-21T22:34:25.382236+0000","last_clean":"2023-07-21T22:34:25.382236+0000","last_became_active":"2023-07-21T22:34:23.975065+0000","last_became_peered":"2023-07-21T22:34:23.975065+0000","last_unstale":"2023-07-21T22:34:25.382236+0000","last_undegraded":"2023-07-21T22:34:25.382236+0000","last_fullsized":"2023-07-21T22:34:25.382236+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:56.416293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973486+0000","last_change":"2023-07-21T22:34:22.983391+0000","last_active":"2023-07-21T22:34:24.973486+0000","last_peered":"2023-07-21T22:34:24.973486+0000","last_clean":"2023-07-21T22:34:24.973486+0000","last_became_active":"2023-07-21T22:34:22.983074+0000","last_became_peered":"2023-07-21T22:34:22.983074+0000","last_unstale":"2023-07-21T22:34:24.973486+0000","last_undegraded":"2023-07-21T22:34:24.973486+0000","last_fullsized":"2023-07-21T22:34:24.973486+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:04:37.717366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":126,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382380+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:34:25.382380+0000","last_peered":"2023-07-21T22:34:25.382380+0000","last_clean":"2023-07-21T22:34:25.382380+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:34:25.382380+0000","last_undegraded":"2023-07-21T22:34:25.382380+0000","last_fullsized":"2023-07-21T22:34:25.382380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:28:57.991858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509632,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54772,"kb_used_data":1580,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317068,"statfs":{"total":96636764160,"available":96580677632,"internally_reserved":0,"allocated":1617920,"data_stored":1088760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.752,"15min":0.73999999999999999},"min":{"1min":0.53600000000000003,"5min":0.35299999999999998,"15min":0.32600000000000001},"max":{"1min":0.96399999999999997,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.755},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71499999999999997,"15min":0.69599999999999995},"min":{"1min":0.55300000000000005,"5min":0.39500000000000002,"15min":0.36099999999999999},"max":{"1min":0.94399999999999995,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.67900000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.73699999999999999},"min":{"1min":0.46800000000000003,"5min":0.432,"15min":0.379},"max":{"1min":1.0680000000000001,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.56799999999999995,"5min":0.44,"15min":0.44},"max":{"1min":0.95099999999999996,"5min":1.0129999999999999,"15min":1.0409999999999999},"last":0.82599999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73799999999999999,"15min":0.74299999999999999},"min":{"1min":0.53100000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.405},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73599999999999999,"15min":0.752},"min":{"1min":0.59399999999999997,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94599999999999995,"5min":1.409,"15min":1.409},"last":0.80600000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.754,"15min":0.76600000000000001},"min":{"1min":0.58399999999999996,"5min":0.504,"15min":0.42099999999999999},"max":{"1min":1.0409999999999999,"5min":1.46,"15min":1.46},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.75900000000000001,"15min":0.75800000000000001},"min":{"1min":0.63400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.88100000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54900000000000004,"15min":0.56200000000000006},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.90000000000000002,"5min":0.90500000000000003,"15min":1.244},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.62,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97399999999999998,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.53500000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63800000000000001,"15min":0.61899999999999999},"min":{"1min":0.51800000000000002,"5min":0.40400000000000003,"15min":0.40300000000000002},"max":{"1min":0.81200000000000006,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66300000000000003,"15min":0.68000000000000005},"min":{"1min":0.49299999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91300000000000003,"5min":1.506,"15min":1.506},"last":0.71499999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.66900000000000004,"15min":0.68000000000000005},"min":{"1min":0.57099999999999995,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93999999999999995,"5min":0.94399999999999995,"15min":1.048},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61699999999999999,"15min":0.63900000000000001},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.98599999999999999},"last":0.48799999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542338,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":1011712,"data_stored":497650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76700000000000002,"15min":0.76500000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.425},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.59199999999999997,"5min":0.57899999999999996,"15min":0.437},"max":{"1min":1.0289999999999999,"5min":1.1180000000000001,"15min":2.3100000000000001},"last":0.71299999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.55700000000000005,"5min":0.45300000000000001,"15min":0.41999999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.99199999999999999,"5min":0.99399999999999999,"15min":8.6280000000000001},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.55600000000000005,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.55},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.80700000000000005,"15min":0.79600000000000004},"min":{"1min":0.59699999999999998,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":1.097,"15min":1.097},"last":0.74099999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.60399999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.7470000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.58399999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92800000000000005,"5min":1.0049999999999999,"15min":1.5129999999999999},"last":0.58999999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.374,"15min":0.36599999999999999},"max":{"1min":0.93400000000000005,"5min":1.0229999999999999,"15min":3.1829999999999998},"last":0.496},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.80100000000000005,"5min":0.86199999999999999,"15min":2.887},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60899999999999999,"15min":0.61899999999999999},"min":{"1min":0.437,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82799999999999996,"5min":0.96299999999999997,"15min":1.4510000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.50900000000000001,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.88400000000000001,"5min":0.98799999999999999,"15min":1.054},"last":0.57499999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.52400000000000002,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":0.93600000000000005,"5min":1.079,"15min":1.1679999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68899999999999995,"15min":0.71499999999999997},"min":{"1min":0.54100000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82499999999999996,"5min":1.0449999999999999,"15min":8.0760000000000005},"last":0.67700000000000005}]}]},{"osd":5,"up_from":15,"seq":64424509631,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":1011712,"data_stored":497638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72799999999999998,"15min":0.71599999999999997},"min":{"1min":0.53000000000000003,"5min":0.35699999999999998,"15min":0.32900000000000001},"max":{"1min":1,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47599999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.59499999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69399999999999995,"15min":0.71399999999999997},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.505},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.505,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":1.617,"15min":1.617},"last":0.66600000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71799999999999997,"15min":0.73599999999999999},"min":{"1min":0.53300000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.92800000000000005,"5min":1.0109999999999999,"15min":1.034},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.53300000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.90800000000000003,"5min":1.512,"15min":1.512},"last":0.63800000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.77200000000000002,"15min":0.78700000000000003},"min":{"1min":0.61299999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98599999999999999,"5min":1.472,"15min":1.472},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.80300000000000005,"15min":0.79700000000000004},"min":{"1min":0.56899999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.022,"5min":1.556,"15min":1.556},"last":0.71699999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.623},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.48899999999999999,"5min":0.48599999999999999,"15min":0.44900000000000001},"max":{"1min":0.92400000000000004,"5min":1.012,"15min":1.038},"last":0.69499999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70499999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.62,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92500000000000004,"5min":1.02,"15min":1.02},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.64800000000000002,"15min":0.65200000000000002},"min":{"1min":0.55500000000000005,"5min":0.374,"15min":0.374},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.72499999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.85899999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.80800000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509632,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":1019904,"data_stored":499180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.746,"15min":0.747},"min":{"1min":0.55700000000000005,"5min":0.438,"15min":0.40000000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.0429999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.746,"15min":0.746},"min":{"1min":0.55000000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95099999999999996,"5min":0.96099999999999997,"15min":0.99099999999999999},"last":0.61199999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70499999999999996,"15min":0.70399999999999996},"min":{"1min":0.53400000000000003,"5min":0.43099999999999999,"15min":0.39400000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.0449999999999999},"last":0.627},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.60899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93000000000000005,"5min":0.94299999999999995,"15min":1.016},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.59299999999999997,"5min":0.371,"15min":0.371},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.57799999999999996,"5min":0.41999999999999998,"15min":0.33000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.67100000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.505,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":1.026},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.80200000000000005,"15min":0.79200000000000004},"min":{"1min":0.70399999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.996,"5min":0.996,"15min":1.018},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.441,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72299999999999998,"5min":0.81599999999999995,"15min":0.94299999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.59299999999999997},"min":{"1min":0.38800000000000001,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.79600000000000004,"5min":0.91000000000000003,"15min":1.0680000000000001},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.45800000000000002,"5min":0.41299999999999998,"15min":0.38500000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.442},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70099999999999996,"15min":0.72599999999999998},"min":{"1min":0.52200000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91400000000000003,"5min":0.98999999999999999,"15min":1.272},"last":0.69499999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.628,"15min":0.65800000000000003},"min":{"1min":0.499,"5min":0.39200000000000002,"15min":0.374},"max":{"1min":0.91300000000000003,"5min":1.0069999999999999,"15min":1.3300000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68000000000000005,"15min":0.69299999999999995},"min":{"1min":0.53100000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.135},"last":0.50800000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509631,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":1007616,"data_stored":497616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.48799999999999999,"15min":0.48099999999999998},"min":{"1min":0.35099999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70499999999999996,"5min":0.73099999999999998,"15min":0.76400000000000001},"last":0.314},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.57499999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.30099999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.871},"last":0.44},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.94199999999999995},"last":0.42399999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82899999999999996,"5min":1.0449999999999999,"15min":1.1140000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45500000000000002,"5min":0.45100000000000001,"15min":0.40999999999999998},"max":{"1min":0.84399999999999997,"5min":0.95399999999999996,"15min":0.99199999999999999},"last":0.5}]},{"osd":4,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.57599999999999996,"5min":0.48299999999999998,"15min":0.438},"max":{"1min":1.093,"5min":1.093,"15min":1.3240000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82199999999999995,"15min":0.83299999999999996},"min":{"1min":0.68799999999999994,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.488},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.60699999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0669999999999999,"5min":1.137,"15min":1.1919999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.60399999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0649999999999999,"15min":1.302},"last":0.55900000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79200000000000004,"15min":0.80100000000000005},"min":{"1min":0.68000000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.02,"5min":1.056,"15min":1.3979999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76500000000000001,"15min":0.78000000000000003},"min":{"1min":0.56899999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0269999999999999,"5min":1.1120000000000001,"15min":1.3899999999999999},"last":0.63300000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.81000000000000005,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0089999999999999,"5min":1.087,"15min":1.335},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.873,"5min":0.83699999999999997,"15min":0.83499999999999996},"min":{"1min":0.66100000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.2130000000000001},"last":0.59499999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509633,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54176,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317664,"statfs":{"total":96636764160,"available":96581287936,"internally_reserved":0,"allocated":1007616,"data_stored":497616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.29099999999999998,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.69399999999999995,"5min":0.81200000000000006,"15min":0.94199999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53600000000000003,"15min":0.54900000000000004},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.88300000000000001,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.28199999999999997},"max":{"1min":0.82999999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80700000000000005,"5min":1.085,"15min":1.085},"last":0.505}]},{"osd":3,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.37,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55300000000000005,"15min":0.56899999999999995},"min":{"1min":0.43099999999999999,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":1.161,"15min":1.161},"last":0.40999999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.67600000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.1579999999999999,"5min":1.2569999999999999,"15min":1.6870000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.79400000000000004,"15min":0.80200000000000005},"min":{"1min":0.57699999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.175,"5min":1.1950000000000001,"15min":1.2689999999999999},"last":0.84099999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.63200000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.2549999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.60599999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.107,"5min":1.206,"15min":1.3089999999999999},"last":0.88900000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.78600000000000003,"15min":0.79800000000000004},"min":{"1min":0.69399999999999995,"5min":0.45500000000000002,"15min":0.40300000000000002},"max":{"1min":1.089,"5min":1.282,"15min":1.3759999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.64300000000000002,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.1339999999999999,"5min":1.23,"15min":1.2649999999999999},"last":0.81899999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.80900000000000005,"15min":0.82899999999999996},"min":{"1min":0.64900000000000002,"5min":0.51100000000000001,"15min":0.49099999999999999},"max":{"1min":1.143,"5min":1.2,"15min":1.2909999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.60999999999999999,"5min":0.44900000000000001,"15min":0.44700000000000001},"max":{"1min":1.091,"5min":1.216,"15min":1.3660000000000001},"last":0.76100000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509632,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":1036288,"data_stored":499944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48899999999999999,"15min":0.504},"min":{"1min":0.32600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.66700000000000004,"5min":0.84599999999999997,"15min":5.4800000000000004},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.58799999999999997},"min":{"1min":0.49399999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.872,"15min":5.2830000000000004},"last":0.39600000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.39900000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72999999999999998,"5min":0.76100000000000001,"15min":3.4220000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.29099999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.88800000000000001},"last":0.34999999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59499999999999997,"15min":0.60999999999999999},"min":{"1min":0.48899999999999999,"5min":0.35799999999999998,"15min":0.33400000000000002},"max":{"1min":0.73499999999999999,"5min":0.84299999999999997,"15min":3.2469999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51700000000000002,"15min":0.53700000000000003},"min":{"1min":0.36799999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":5.8710000000000004},"last":0.435}]},{"osd":4,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.58699999999999997,"5min":0.432,"15min":0.432},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":3.6259999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.63100000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.97399999999999998,"5min":1.083,"15min":4.4100000000000001},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.77600000000000002,"15min":0.80200000000000005},"min":{"1min":0.64800000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0609999999999999,"5min":1.115,"15min":5.766},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.80100000000000005,"15min":0.81299999999999994},"min":{"1min":0.57899999999999996,"5min":0.376,"15min":0.376},"max":{"1min":1.0980000000000001,"5min":1.1279999999999999,"15min":3.669},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.66700000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0429999999999999,"5min":1.085,"15min":1.23},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77800000000000002,"15min":0.81499999999999995},"min":{"1min":0.55100000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.083,"5min":1.1020000000000001,"15min":5.8200000000000003},"last":0.80700000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.79800000000000004,"15min":0.83099999999999996},"min":{"1min":0.59599999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.028,"5min":1.103,"15min":5.9269999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.60299999999999998,"5min":0.52600000000000002,"15min":0.45700000000000002},"max":{"1min":1.115,"5min":1.115,"15min":3.5800000000000001},"last":0.74299999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509634,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":1564,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1601536,"data_stored":1087984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.50800000000000001},"min":{"1min":0.35899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.67900000000000005,"5min":0.77800000000000002,"15min":0.83199999999999996},"last":0.48699999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70999999999999996,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.44,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58199999999999996,"5min":0.871,"15min":0.871},"last":0.503}]},{"osd":3,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.35899999999999999,"15min":0.34899999999999998},"max":{"1min":0.76500000000000001,"5min":0.88100000000000001,"15min":0.91300000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.434,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73999999999999999,"5min":1.038,"15min":1.038},"last":0.433}]},{"osd":4,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.76100000000000001,"15min":0.78100000000000003},"min":{"1min":0.59299999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.321},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.60099999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.093,"5min":1.423,"15min":1.423},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.60299999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0960000000000001,"5min":1.2669999999999999,"15min":1.28},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.78400000000000003,"15min":0.80900000000000005},"min":{"1min":0.70599999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.393},"last":0.57699999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78500000000000003,"15min":0.81299999999999994},"min":{"1min":0.61799999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.28},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81399999999999995,"15min":0.81999999999999995},"min":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.131,"5min":1.333,"15min":1.333},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.65900000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.2310000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.80900000000000005,"15min":0.83399999999999996},"min":{"1min":0.60599999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1930000000000001,"5min":1.296,"15min":1.369},"last":0.61399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:34:32.760 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:34:32.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.866+0000 7f9655537640 1 Processor -- start 2023-07-21T22:34:32.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.866+0000 7f9655537640 1 -- start start 2023-07-21T22:34:32.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f9655537640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f96500c8ad0 0x7f96500c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:32.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f9655537640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96500c9560 0x7f96500ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:32.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f9655537640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96500cc700 con 0x7f9650158ce0 2023-07-21T22:34:32.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f9655537640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96500c99e0 con 0x7f96500c8ad0 2023-07-21T22:34:32.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f9655537640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96500b0ff0 con 0x7f96500c9560 2023-07-21T22:34:32.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964effd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9650158ce0 0x7f9650070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54552/0 (socket says 172.21.15.6:54552) 2023-07-21T22:34:32.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964effd640 1 -- 172.21.15.6:0/3351685800 learned_addr learned my addr 172.21.15.6:0/3351685800 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:32.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964e7fc640 1 -- 172.21.15.6:0/3351685800 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888099624 0 0) 0x7f96500cc700 con 0x7f9650158ce0 2023-07-21T22:34:32.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964f7fe640 1 --2- 172.21.15.6:0/3351685800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96500c9560 0x7f96500ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:32.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f9647fff640 1 --2- 172.21.15.6:0/3351685800 >> v2:172.21.15.161:3300/0 conn(0x7f96500c8ad0 0x7f96500c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:32.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964e7fc640 1 -- 172.21.15.6:0/3351685800 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f963c003530 con 0x7f9650158ce0 2023-07-21T22:34:32.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964e7fc640 1 -- 172.21.15.6:0/3351685800 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2916426899 0 0) 0x7f963c003530 con 0x7f9650158ce0 2023-07-21T22:34:32.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964e7fc640 1 -- 172.21.15.6:0/3351685800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96500c9560 msgr2=0x7f96500ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:32.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964e7fc640 1 --2- 172.21.15.6:0/3351685800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96500c9560 0x7f96500ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:32.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964e7fc640 1 -- 172.21.15.6:0/3351685800 >> v2:172.21.15.161:3300/0 conn(0x7f96500c8ad0 msgr2=0x7f96500c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:32.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964e7fc640 1 --2- 172.21.15.6:0/3351685800 >> v2:172.21.15.161:3300/0 conn(0x7f96500c8ad0 0x7f96500c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:32.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964e7fc640 1 -- 172.21.15.6:0/3351685800 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9650070c80 con 0x7f9650158ce0 2023-07-21T22:34:32.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964e7fc640 1 -- 172.21.15.6:0/3351685800 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f9640001680 con 0x7f9650158ce0 2023-07-21T22:34:32.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964e7fc640 1 -- 172.21.15.6:0/3351685800 >> v1:172.21.15.6:6789/0 conn(0x7f9650158ce0 legacy=0x7f9650070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:32.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964e7fc640 1 --2- 172.21.15.6:0/3351685800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f963c003980 0x7f963c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:32.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964e7fc640 1 --2- 172.21.15.6:0/3351685800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f963c0047d0 0x7f963c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:32.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964e7fc640 1 --2- 172.21.15.6:0/3351685800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96500c9560 0x7f963c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:32.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964e7fc640 1 -- 172.21.15.6:0/3351685800 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96500c99e0 con 0x7f963c003980 2023-07-21T22:34:32.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964e7fc640 1 -- 172.21.15.6:0/3351685800 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96500b0ff0 con 0x7f963c0047d0 2023-07-21T22:34:32.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964e7fc640 1 -- 172.21.15.6:0/3351685800 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963c00dc20 con 0x7f96500c9560 2023-07-21T22:34:32.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964effd640 1 --2- 172.21.15.6:0/3351685800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f963c003980 0x7f963c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:32.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f9647fff640 1 --2- 172.21.15.6:0/3351685800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f963c0047d0 0x7f963c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:32.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964f7fe640 1 --2- 172.21.15.6:0/3351685800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96500c9560 0x7f963c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:32.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964effd640 1 -- 172.21.15.6:0/3351685800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96500c9560 msgr2=0x7f963c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:32.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964effd640 1 --2- 172.21.15.6:0/3351685800 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96500c9560 0x7f963c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:32.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964effd640 1 -- 172.21.15.6:0/3351685800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f963c0047d0 msgr2=0x7f963c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:32.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964effd640 1 --2- 172.21.15.6:0/3351685800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f963c0047d0 0x7f963c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:32.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f964effd640 1 -- 172.21.15.6:0/3351685800 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963c003530 con 0x7f963c003980 2023-07-21T22:34:32.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.870+0000 7f9647fff640 1 --2- 172.21.15.6:0/3351685800 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f963c0047d0 0x7f963c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:32.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.874+0000 7f964effd640 1 --2- 172.21.15.6:0/3351685800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f963c003980 0x7f963c003d90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f964000c240 tx=0x7f964001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343463b3e62aa6e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:32.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.874+0000 7f964e7fc640 1 -- 172.21.15.6:0/3351685800 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96400058e0 con 0x7f963c003980 2023-07-21T22:34:32.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.874+0000 7f964e7fc640 1 -- 172.21.15.6:0/3351685800 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9640005a40 con 0x7f963c003980 2023-07-21T22:34:32.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.874+0000 7f964e7fc640 1 -- 172.21.15.6:0/3351685800 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9640005e10 con 0x7f963c003980 2023-07-21T22:34:32.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.874+0000 7f9655537640 1 -- 172.21.15.6:0/3351685800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f963c003980 msgr2=0x7f963c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:32.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.874+0000 7f9655537640 1 --2- 172.21.15.6:0/3351685800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f963c003980 0x7f963c003d90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f964000c240 tx=0x7f964001cc60 comp rx=0 tx=0).stop 2023-07-21T22:34:32.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.874+0000 7f964f7fe640 1 -- 172.21.15.6:0/3351685800 reap_dead start 2023-07-21T22:34:32.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.874+0000 7f9655537640 1 -- 172.21.15.6:0/3351685800 shutdown_connections 2023-07-21T22:34:32.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.874+0000 7f9655537640 1 -- 172.21.15.6:0/3351685800 >> 172.21.15.6:0/3351685800 conn(0x7f96500afcf0 msgr2=0x7f96500b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:32.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.874+0000 7f9655537640 1 -- 172.21.15.6:0/3351685800 shutdown_connections 2023-07-21T22:34:32.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.874+0000 7f9655537640 1 -- 172.21.15.6:0/3351685800 wait complete. 2023-07-21T22:34:32.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.874+0000 7f9655537640 1 Processor -- start 2023-07-21T22:34:32.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.874+0000 7f9655537640 1 -- start start 2023-07-21T22:34:32.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f9655537640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f963c003980 0x7f9650151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:32.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f9655537640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9650152460 0x7f96500ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:32.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f9655537640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96500adbe0 0x7f96500ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:32.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f9655537640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96501528d0 con 0x7f963c003980 2023-07-21T22:34:32.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f9655537640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96501f4030 con 0x7f96500adbe0 2023-07-21T22:34:32.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f9655537640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96500af8d0 con 0x7f9650152460 2023-07-21T22:34:32.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f964effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f963c003980 0x7f9650151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:32.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f964effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f963c003980 0x7f9650151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54174/0 (socket says 172.21.15.6:54174) 2023-07-21T22:34:32.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f964effd640 1 -- 172.21.15.6:0/3304336816 learned_addr learned my addr 172.21.15.6:0/3304336816 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:32.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f964effd640 1 -- 172.21.15.6:0/3304336816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9650152460 msgr2=0x7f96500ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:32.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f9647fff640 1 --2- 172.21.15.6:0/3304336816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9650152460 0x7f96500ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:32.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f964f7fe640 1 --2- 172.21.15.6:0/3304336816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96500adbe0 0x7f96500ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:32.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f964effd640 1 --2- 172.21.15.6:0/3304336816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9650152460 0x7f96500ad6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:32.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f964effd640 1 -- 172.21.15.6:0/3304336816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96500adbe0 msgr2=0x7f96500ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:32.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f964effd640 1 --2- 172.21.15.6:0/3304336816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96500adbe0 0x7f96500ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:32.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f964effd640 1 -- 172.21.15.6:0/3304336816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9650155c20 con 0x7f963c003980 2023-07-21T22:34:32.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f964f7fe640 1 --2- 172.21.15.6:0/3304336816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96500adbe0 0x7f96500ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:32.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f9647fff640 1 --2- 172.21.15.6:0/3304336816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9650152460 0x7f96500ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:32.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f964effd640 1 --2- 172.21.15.6:0/3304336816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f963c003980 0x7f9650151f20 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f9640007040 tx=0x7f963c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:32.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f96477fe640 1 -- 172.21.15.6:0/3304336816 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9640005db0 con 0x7f963c003980 2023-07-21T22:34:32.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f96477fe640 1 -- 172.21.15.6:0/3304336816 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96400047f0 con 0x7f963c003980 2023-07-21T22:34:32.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f96477fe640 1 -- 172.21.15.6:0/3304336816 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9640004b60 con 0x7f963c003980 2023-07-21T22:34:32.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f9655537640 1 -- 172.21.15.6:0/3304336816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9650155f00 con 0x7f963c003980 2023-07-21T22:34:32.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f9655537640 1 -- 172.21.15.6:0/3304336816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96501564c0 con 0x7f963c003980 2023-07-21T22:34:32.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.878+0000 7f9655537640 1 -- 172.21.15.6:0/3304336816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96500ca1a0 con 0x7f963c003980 2023-07-21T22:34:32.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.882+0000 7f96477fe640 1 -- 172.21.15.6:0/3304336816 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9640004cc0 con 0x7f963c003980 2023-07-21T22:34:32.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.882+0000 7f96477fe640 1 --2- 172.21.15.6:0/3304336816 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f96300663d0 0x7f9630068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:32.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.882+0000 7f96477fe640 1 -- 172.21.15.6:0/3304336816 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f964011d7c0 con 0x7f963c003980 2023-07-21T22:34:32.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.882+0000 7f9647fff640 1 --2- 172.21.15.6:0/3304336816 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f96300663d0 0x7f9630068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:32.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.882+0000 7f9647fff640 1 --2- 172.21.15.6:0/3304336816 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f96300663d0 0x7f9630068880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f96500af540 tx=0x7f9638008040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:32.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:32.886+0000 7f96477fe640 1 -- 172.21.15.6:0/3304336816 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f96400eaaf0 con 0x7f963c003980 2023-07-21T22:34:33.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.038+0000 7f9655537640 1 -- 172.21.15.6:0/3304336816 --> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f96501590b0 con 0x7f96300663d0 2023-07-21T22:34:33.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.046+0000 7f96477fe640 1 -- 172.21.15.6:0/3304336816 <== mgr.5768 v2:172.21.15.161:6832/3045187557 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311094 (secure 0 0 0) 0x7f9638012950 con 0x7f96300663d0 2023-07-21T22:34:33.101 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:33.102 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:34:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.050+0000 7f9655537640 1 -- 172.21.15.6:0/3304336816 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f96300663d0 msgr2=0x7f9630068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.050+0000 7f9655537640 1 --2- 172.21.15.6:0/3304336816 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f96300663d0 0x7f9630068880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f96500af540 tx=0x7f9638008040 comp rx=0 tx=0).stop 2023-07-21T22:34:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.050+0000 7f9655537640 1 -- 172.21.15.6:0/3304336816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f963c003980 msgr2=0x7f9650151f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:33.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.050+0000 7f9655537640 1 --2- 172.21.15.6:0/3304336816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f963c003980 0x7f9650151f20 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f9640007040 tx=0x7f963c005800 comp rx=0 tx=0).stop 2023-07-21T22:34:33.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.050+0000 7f9655537640 1 -- 172.21.15.6:0/3304336816 shutdown_connections 2023-07-21T22:34:33.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.050+0000 7f9655537640 1 --2- 172.21.15.6:0/3304336816 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f96300663d0 0x7f9630068880 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.050+0000 7f9655537640 1 --2- 172.21.15.6:0/3304336816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96500adbe0 0x7f96500ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.050+0000 7f9655537640 1 --2- 172.21.15.6:0/3304336816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9650152460 0x7f96500ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.050+0000 7f9655537640 1 --2- 172.21.15.6:0/3304336816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f963c003980 0x7f9650151f20 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.050+0000 7f9655537640 1 -- 172.21.15.6:0/3304336816 >> 172.21.15.6:0/3304336816 conn(0x7f96500afcf0 msgr2=0x7f965006fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:33.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.050+0000 7f9655537640 1 -- 172.21.15.6:0/3304336816 shutdown_connections 2023-07-21T22:34:33.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.050+0000 7f9655537640 1 -- 172.21.15.6:0/3304336816 wait complete. 2023-07-21T22:34:33.121 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-21T22:34:31.635224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":284,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":301768,"kb_used_data":9096,"kb_used_omap":0,"kb_used_meta":292608,"kb_avail":754672952,"statfs":{"total":773094113280,"available":772785102848,"internally_reserved":0,"allocated":9314304,"data_stored":5166388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":299630592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002563"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378094+0000","last_change":"2023-07-21T22:34:23.972557+0000","last_active":"2023-07-21T22:34:25.378094+0000","last_peered":"2023-07-21T22:34:25.378094+0000","last_clean":"2023-07-21T22:34:25.378094+0000","last_became_active":"2023-07-21T22:34:23.970855+0000","last_became_peered":"2023-07-21T22:34:23.970855+0000","last_unstale":"2023-07-21T22:34:25.378094+0000","last_undegraded":"2023-07-21T22:34:25.378094+0000","last_fullsized":"2023-07-21T22:34:25.378094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:20.702469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378043+0000","last_change":"2023-07-21T22:34:23.979164+0000","last_active":"2023-07-21T22:34:25.378043+0000","last_peered":"2023-07-21T22:34:25.378043+0000","last_clean":"2023-07-21T22:34:25.378043+0000","last_became_active":"2023-07-21T22:34:23.978841+0000","last_became_peered":"2023-07-21T22:34:23.978841+0000","last_unstale":"2023-07-21T22:34:25.378043+0000","last_undegraded":"2023-07-21T22:34:25.378043+0000","last_fullsized":"2023-07-21T22:34:25.378043+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:04:38.724441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976587+0000","last_change":"2023-07-21T22:34:23.993905+0000","last_active":"2023-07-21T22:34:24.976587+0000","last_peered":"2023-07-21T22:34:24.976587+0000","last_clean":"2023-07-21T22:34:24.976587+0000","last_became_active":"2023-07-21T22:34:23.993636+0000","last_became_peered":"2023-07-21T22:34:23.993636+0000","last_unstale":"2023-07-21T22:34:24.976587+0000","last_undegraded":"2023-07-21T22:34:24.976587+0000","last_fullsized":"2023-07-21T22:34:24.976587+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:08:58.793372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976787+0000","last_change":"2023-07-21T22:34:23.983073+0000","last_active":"2023-07-21T22:34:24.976787+0000","last_peered":"2023-07-21T22:34:24.976787+0000","last_clean":"2023-07-21T22:34:24.976787+0000","last_became_active":"2023-07-21T22:34:23.982808+0000","last_became_peered":"2023-07-21T22:34:23.982808+0000","last_unstale":"2023-07-21T22:34:24.976787+0000","last_undegraded":"2023-07-21T22:34:24.976787+0000","last_fullsized":"2023-07-21T22:34:24.976787+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:14:14.000715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381556+0000","last_change":"2023-07-21T22:34:23.983330+0000","last_active":"2023-07-21T22:34:25.381556+0000","last_peered":"2023-07-21T22:34:25.381556+0000","last_clean":"2023-07-21T22:34:25.381556+0000","last_became_active":"2023-07-21T22:34:23.982892+0000","last_became_peered":"2023-07-21T22:34:23.982892+0000","last_unstale":"2023-07-21T22:34:25.381556+0000","last_undegraded":"2023-07-21T22:34:25.381556+0000","last_fullsized":"2023-07-21T22:34:25.381556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:17:45.177459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377816+0000","last_change":"2023-07-21T22:34:23.993702+0000","last_active":"2023-07-21T22:34:25.377816+0000","last_peered":"2023-07-21T22:34:25.377816+0000","last_clean":"2023-07-21T22:34:25.377816+0000","last_became_active":"2023-07-21T22:34:23.993273+0000","last_became_peered":"2023-07-21T22:34:23.993273+0000","last_unstale":"2023-07-21T22:34:25.377816+0000","last_undegraded":"2023-07-21T22:34:25.377816+0000","last_fullsized":"2023-07-21T22:34:25.377816+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:24:02.389155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.244513+0000","last_change":"2023-07-21T22:34:23.988159+0000","last_active":"2023-07-21T22:34:25.244513+0000","last_peered":"2023-07-21T22:34:25.244513+0000","last_clean":"2023-07-21T22:34:25.244513+0000","last_became_active":"2023-07-21T22:34:23.987833+0000","last_became_peered":"2023-07-21T22:34:23.987833+0000","last_unstale":"2023-07-21T22:34:25.244513+0000","last_undegraded":"2023-07-21T22:34:25.244513+0000","last_fullsized":"2023-07-21T22:34:25.244513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:57:06.456983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381702+0000","last_change":"2023-07-21T22:34:23.988974+0000","last_active":"2023-07-21T22:34:25.381702+0000","last_peered":"2023-07-21T22:34:25.381702+0000","last_clean":"2023-07-21T22:34:25.381702+0000","last_became_active":"2023-07-21T22:34:23.988694+0000","last_became_peered":"2023-07-21T22:34:23.988694+0000","last_unstale":"2023-07-21T22:34:25.381702+0000","last_undegraded":"2023-07-21T22:34:25.381702+0000","last_fullsized":"2023-07-21T22:34:25.381702+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:40:23.728388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976870+0000","last_change":"2023-07-21T22:34:24.001260+0000","last_active":"2023-07-21T22:34:24.976870+0000","last_peered":"2023-07-21T22:34:24.976870+0000","last_clean":"2023-07-21T22:34:24.976870+0000","last_became_active":"2023-07-21T22:34:24.000725+0000","last_became_peered":"2023-07-21T22:34:24.000725+0000","last_unstale":"2023-07-21T22:34:24.976870+0000","last_undegraded":"2023-07-21T22:34:24.976870+0000","last_fullsized":"2023-07-21T22:34:24.976870+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:09.929761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976852+0000","last_change":"2023-07-21T22:34:23.987611+0000","last_active":"2023-07-21T22:34:24.976852+0000","last_peered":"2023-07-21T22:34:24.976852+0000","last_clean":"2023-07-21T22:34:24.976852+0000","last_became_active":"2023-07-21T22:34:23.987284+0000","last_became_peered":"2023-07-21T22:34:23.987284+0000","last_unstale":"2023-07-21T22:34:24.976852+0000","last_undegraded":"2023-07-21T22:34:24.976852+0000","last_fullsized":"2023-07-21T22:34:24.976852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:38:29.028319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977302+0000","last_change":"2023-07-21T22:34:23.986342+0000","last_active":"2023-07-21T22:34:24.977302+0000","last_peered":"2023-07-21T22:34:24.977302+0000","last_clean":"2023-07-21T22:34:24.977302+0000","last_became_active":"2023-07-21T22:34:23.986055+0000","last_became_peered":"2023-07-21T22:34:23.986055+0000","last_unstale":"2023-07-21T22:34:24.977302+0000","last_undegraded":"2023-07-21T22:34:24.977302+0000","last_fullsized":"2023-07-21T22:34:24.977302+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:51:03.664662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381837+0000","last_change":"2023-07-21T22:34:23.989735+0000","last_active":"2023-07-21T22:34:25.381837+0000","last_peered":"2023-07-21T22:34:25.381837+0000","last_clean":"2023-07-21T22:34:25.381837+0000","last_became_active":"2023-07-21T22:34:23.989266+0000","last_became_peered":"2023-07-21T22:34:23.989266+0000","last_unstale":"2023-07-21T22:34:25.381837+0000","last_undegraded":"2023-07-21T22:34:25.381837+0000","last_fullsized":"2023-07-21T22:34:25.381837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:46:38.257359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382011+0000","last_change":"2023-07-21T22:34:23.988124+0000","last_active":"2023-07-21T22:34:25.382011+0000","last_peered":"2023-07-21T22:34:25.382011+0000","last_clean":"2023-07-21T22:34:25.382011+0000","last_became_active":"2023-07-21T22:34:23.987825+0000","last_became_peered":"2023-07-21T22:34:23.987825+0000","last_unstale":"2023-07-21T22:34:25.382011+0000","last_undegraded":"2023-07-21T22:34:25.382011+0000","last_fullsized":"2023-07-21T22:34:25.382011+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:39:35.479896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977509+0000","last_change":"2023-07-21T22:34:23.996854+0000","last_active":"2023-07-21T22:34:24.977509+0000","last_peered":"2023-07-21T22:34:24.977509+0000","last_clean":"2023-07-21T22:34:24.977509+0000","last_became_active":"2023-07-21T22:34:23.996469+0000","last_became_peered":"2023-07-21T22:34:23.996469+0000","last_unstale":"2023-07-21T22:34:24.977509+0000","last_undegraded":"2023-07-21T22:34:24.977509+0000","last_fullsized":"2023-07-21T22:34:24.977509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:39:25.499566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976230+0000","last_change":"2023-07-21T22:34:23.990138+0000","last_active":"2023-07-21T22:34:24.976230+0000","last_peered":"2023-07-21T22:34:24.976230+0000","last_clean":"2023-07-21T22:34:24.976230+0000","last_became_active":"2023-07-21T22:34:23.989823+0000","last_became_peered":"2023-07-21T22:34:23.989823+0000","last_unstale":"2023-07-21T22:34:24.976230+0000","last_undegraded":"2023-07-21T22:34:24.976230+0000","last_fullsized":"2023-07-21T22:34:24.976230+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:21:01.787807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.244536+0000","last_change":"2023-07-21T22:34:23.977077+0000","last_active":"2023-07-21T22:34:25.244536+0000","last_peered":"2023-07-21T22:34:25.244536+0000","last_clean":"2023-07-21T22:34:25.244536+0000","last_became_active":"2023-07-21T22:34:23.976770+0000","last_became_peered":"2023-07-21T22:34:23.976770+0000","last_unstale":"2023-07-21T22:34:25.244536+0000","last_undegraded":"2023-07-21T22:34:25.244536+0000","last_fullsized":"2023-07-21T22:34:25.244536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:20:38.879292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378224+0000","last_change":"2023-07-21T22:34:23.992061+0000","last_active":"2023-07-21T22:34:25.378224+0000","last_peered":"2023-07-21T22:34:25.378224+0000","last_clean":"2023-07-21T22:34:25.378224+0000","last_became_active":"2023-07-21T22:34:23.990501+0000","last_became_peered":"2023-07-21T22:34:23.990501+0000","last_unstale":"2023-07-21T22:34:25.378224+0000","last_undegraded":"2023-07-21T22:34:25.378224+0000","last_fullsized":"2023-07-21T22:34:25.378224+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:36:54.905796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977601+0000","last_change":"2023-07-21T22:34:23.988875+0000","last_active":"2023-07-21T22:34:24.977601+0000","last_peered":"2023-07-21T22:34:24.977601+0000","last_clean":"2023-07-21T22:34:24.977601+0000","last_became_active":"2023-07-21T22:34:23.988567+0000","last_became_peered":"2023-07-21T22:34:23.988567+0000","last_unstale":"2023-07-21T22:34:24.977601+0000","last_undegraded":"2023-07-21T22:34:24.977601+0000","last_fullsized":"2023-07-21T22:34:24.977601+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:04:11.295033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382203+0000","last_change":"2023-07-21T22:34:23.978808+0000","last_active":"2023-07-21T22:34:25.382203+0000","last_peered":"2023-07-21T22:34:25.382203+0000","last_clean":"2023-07-21T22:34:25.382203+0000","last_became_active":"2023-07-21T22:34:23.978449+0000","last_became_peered":"2023-07-21T22:34:23.978449+0000","last_unstale":"2023-07-21T22:34:25.382203+0000","last_undegraded":"2023-07-21T22:34:25.382203+0000","last_fullsized":"2023-07-21T22:34:25.382203+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:29:13.739884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973582+0000","last_change":"2023-07-21T22:34:23.970577+0000","last_active":"2023-07-21T22:34:24.973582+0000","last_peered":"2023-07-21T22:34:24.973582+0000","last_clean":"2023-07-21T22:34:24.973582+0000","last_became_active":"2023-07-21T22:34:23.970310+0000","last_became_peered":"2023-07-21T22:34:23.970310+0000","last_unstale":"2023-07-21T22:34:24.973582+0000","last_undegraded":"2023-07-21T22:34:24.973582+0000","last_fullsized":"2023-07-21T22:34:24.973582+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:20.702469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381902+0000","last_change":"2023-07-21T22:34:23.979347+0000","last_active":"2023-07-21T22:34:25.381902+0000","last_peered":"2023-07-21T22:34:25.381902+0000","last_clean":"2023-07-21T22:34:25.381902+0000","last_became_active":"2023-07-21T22:34:23.979016+0000","last_became_peered":"2023-07-21T22:34:23.979016+0000","last_unstale":"2023-07-21T22:34:25.381902+0000","last_undegraded":"2023-07-21T22:34:25.381902+0000","last_fullsized":"2023-07-21T22:34:25.381902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:05.505188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973263+0000","last_change":"2023-07-21T22:34:23.985384+0000","last_active":"2023-07-21T22:34:24.973263+0000","last_peered":"2023-07-21T22:34:24.973263+0000","last_clean":"2023-07-21T22:34:24.973263+0000","last_became_active":"2023-07-21T22:34:23.985069+0000","last_became_peered":"2023-07-21T22:34:23.985069+0000","last_unstale":"2023-07-21T22:34:24.973263+0000","last_undegraded":"2023-07-21T22:34:24.973263+0000","last_fullsized":"2023-07-21T22:34:24.973263+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:48:32.426770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973220+0000","last_change":"2023-07-21T22:34:23.990262+0000","last_active":"2023-07-21T22:34:24.973220+0000","last_peered":"2023-07-21T22:34:24.973220+0000","last_clean":"2023-07-21T22:34:24.973220+0000","last_became_active":"2023-07-21T22:34:23.989959+0000","last_became_peered":"2023-07-21T22:34:23.989959+0000","last_unstale":"2023-07-21T22:34:24.973220+0000","last_undegraded":"2023-07-21T22:34:24.973220+0000","last_fullsized":"2023-07-21T22:34:24.973220+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:41:01.186425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976182+0000","last_change":"2023-07-21T22:34:23.996184+0000","last_active":"2023-07-21T22:34:24.976182+0000","last_peered":"2023-07-21T22:34:24.976182+0000","last_clean":"2023-07-21T22:34:24.976182+0000","last_became_active":"2023-07-21T22:34:23.995804+0000","last_became_peered":"2023-07-21T22:34:23.995804+0000","last_unstale":"2023-07-21T22:34:24.976182+0000","last_undegraded":"2023-07-21T22:34:24.976182+0000","last_fullsized":"2023-07-21T22:34:24.976182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:09:14.434853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382387+0000","last_change":"2023-07-21T22:34:23.973544+0000","last_active":"2023-07-21T22:34:25.382387+0000","last_peered":"2023-07-21T22:34:25.382387+0000","last_clean":"2023-07-21T22:34:25.382387+0000","last_became_active":"2023-07-21T22:34:23.973231+0000","last_became_peered":"2023-07-21T22:34:23.973231+0000","last_unstale":"2023-07-21T22:34:25.382387+0000","last_undegraded":"2023-07-21T22:34:25.382387+0000","last_fullsized":"2023-07-21T22:34:25.382387+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:23:21.645743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382436+0000","last_change":"2023-07-21T22:34:23.973606+0000","last_active":"2023-07-21T22:34:25.382436+0000","last_peered":"2023-07-21T22:34:25.382436+0000","last_clean":"2023-07-21T22:34:25.382436+0000","last_became_active":"2023-07-21T22:34:23.973049+0000","last_became_peered":"2023-07-21T22:34:23.973049+0000","last_unstale":"2023-07-21T22:34:25.382436+0000","last_undegraded":"2023-07-21T22:34:25.382436+0000","last_fullsized":"2023-07-21T22:34:25.382436+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:02:32.259845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977505+0000","last_change":"2023-07-21T22:34:23.986667+0000","last_active":"2023-07-21T22:34:24.977505+0000","last_peered":"2023-07-21T22:34:24.977505+0000","last_clean":"2023-07-21T22:34:24.977505+0000","last_became_active":"2023-07-21T22:34:23.986282+0000","last_became_peered":"2023-07-21T22:34:23.986282+0000","last_unstale":"2023-07-21T22:34:24.977505+0000","last_undegraded":"2023-07-21T22:34:24.977505+0000","last_fullsized":"2023-07-21T22:34:24.977505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:54:25.142343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377791+0000","last_change":"2023-07-21T22:34:23.972840+0000","last_active":"2023-07-21T22:34:25.377791+0000","last_peered":"2023-07-21T22:34:25.377791+0000","last_clean":"2023-07-21T22:34:25.377791+0000","last_became_active":"2023-07-21T22:34:23.970765+0000","last_became_peered":"2023-07-21T22:34:23.970765+0000","last_unstale":"2023-07-21T22:34:25.377791+0000","last_undegraded":"2023-07-21T22:34:25.377791+0000","last_fullsized":"2023-07-21T22:34:25.377791+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:15:40.314935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977198+0000","last_change":"2023-07-21T22:34:24.001006+0000","last_active":"2023-07-21T22:34:24.977198+0000","last_peered":"2023-07-21T22:34:24.977198+0000","last_clean":"2023-07-21T22:34:24.977198+0000","last_became_active":"2023-07-21T22:34:24.000366+0000","last_became_peered":"2023-07-21T22:34:24.000366+0000","last_unstale":"2023-07-21T22:34:24.977198+0000","last_undegraded":"2023-07-21T22:34:24.977198+0000","last_fullsized":"2023-07-21T22:34:24.977198+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:09:07.184904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381837+0000","last_change":"2023-07-21T22:34:23.997526+0000","last_active":"2023-07-21T22:34:25.381837+0000","last_peered":"2023-07-21T22:34:25.381837+0000","last_clean":"2023-07-21T22:34:25.381837+0000","last_became_active":"2023-07-21T22:34:23.997244+0000","last_became_peered":"2023-07-21T22:34:23.997244+0000","last_unstale":"2023-07-21T22:34:25.381837+0000","last_undegraded":"2023-07-21T22:34:25.381837+0000","last_fullsized":"2023-07-21T22:34:25.381837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:50.175867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976228+0000","last_change":"2023-07-21T22:34:23.982191+0000","last_active":"2023-07-21T22:34:24.976228+0000","last_peered":"2023-07-21T22:34:24.976228+0000","last_clean":"2023-07-21T22:34:24.976228+0000","last_became_active":"2023-07-21T22:34:23.981848+0000","last_became_peered":"2023-07-21T22:34:23.981848+0000","last_unstale":"2023-07-21T22:34:24.976228+0000","last_undegraded":"2023-07-21T22:34:24.976228+0000","last_fullsized":"2023-07-21T22:34:24.976228+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:43:52.864506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377523+0000","last_change":"2023-07-21T22:34:23.987622+0000","last_active":"2023-07-21T22:34:25.377523+0000","last_peered":"2023-07-21T22:34:25.377523+0000","last_clean":"2023-07-21T22:34:25.377523+0000","last_became_active":"2023-07-21T22:34:23.987169+0000","last_became_peered":"2023-07-21T22:34:23.987169+0000","last_unstale":"2023-07-21T22:34:25.377523+0000","last_undegraded":"2023-07-21T22:34:25.377523+0000","last_fullsized":"2023-07-21T22:34:25.377523+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:45.875486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382465+0000","last_change":"2023-07-21T22:34:23.972399+0000","last_active":"2023-07-21T22:34:25.382465+0000","last_peered":"2023-07-21T22:34:25.382465+0000","last_clean":"2023-07-21T22:34:25.382465+0000","last_became_active":"2023-07-21T22:34:23.971735+0000","last_became_peered":"2023-07-21T22:34:23.971735+0000","last_unstale":"2023-07-21T22:34:25.382465+0000","last_undegraded":"2023-07-21T22:34:25.382465+0000","last_fullsized":"2023-07-21T22:34:25.382465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:49:31.415751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"83'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378305+0000","last_change":"2023-07-21T22:34:22.979497+0000","last_active":"2023-07-21T22:34:25.378305+0000","last_peered":"2023-07-21T22:34:25.378305+0000","last_clean":"2023-07-21T22:34:25.378305+0000","last_became_active":"2023-07-21T22:34:22.979085+0000","last_became_peered":"2023-07-21T22:34:22.979085+0000","last_unstale":"2023-07-21T22:34:25.378305+0000","last_undegraded":"2023-07-21T22:34:25.378305+0000","last_fullsized":"2023-07-21T22:34:25.378305+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:22:34.537168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977634+0000","last_change":"2023-07-21T22:34:23.980205+0000","last_active":"2023-07-21T22:34:24.977634+0000","last_peered":"2023-07-21T22:34:24.977634+0000","last_clean":"2023-07-21T22:34:24.977634+0000","last_became_active":"2023-07-21T22:34:23.979897+0000","last_became_peered":"2023-07-21T22:34:23.979897+0000","last_unstale":"2023-07-21T22:34:24.977634+0000","last_undegraded":"2023-07-21T22:34:24.977634+0000","last_fullsized":"2023-07-21T22:34:24.977634+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:03:42.054358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"83'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378261+0000","last_change":"2023-07-21T22:34:22.981336+0000","last_active":"2023-07-21T22:34:25.378261+0000","last_peered":"2023-07-21T22:34:25.378261+0000","last_clean":"2023-07-21T22:34:25.378261+0000","last_became_active":"2023-07-21T22:34:22.981041+0000","last_became_peered":"2023-07-21T22:34:22.981041+0000","last_unstale":"2023-07-21T22:34:25.378261+0000","last_undegraded":"2023-07-21T22:34:25.378261+0000","last_fullsized":"2023-07-21T22:34:25.378261+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:41:24.958079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377968+0000","last_change":"2023-07-21T22:34:23.986733+0000","last_active":"2023-07-21T22:34:25.377968+0000","last_peered":"2023-07-21T22:34:25.377968+0000","last_clean":"2023-07-21T22:34:25.377968+0000","last_became_active":"2023-07-21T22:34:23.986453+0000","last_became_peered":"2023-07-21T22:34:23.986453+0000","last_unstale":"2023-07-21T22:34:25.377968+0000","last_undegraded":"2023-07-21T22:34:25.377968+0000","last_fullsized":"2023-07-21T22:34:25.377968+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:31:39.959672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378208+0000","last_change":"2023-07-21T22:34:22.977004+0000","last_active":"2023-07-21T22:34:25.378208+0000","last_peered":"2023-07-21T22:34:25.378208+0000","last_clean":"2023-07-21T22:34:25.378208+0000","last_became_active":"2023-07-21T22:34:22.976750+0000","last_became_peered":"2023-07-21T22:34:22.976750+0000","last_unstale":"2023-07-21T22:34:25.378208+0000","last_undegraded":"2023-07-21T22:34:25.378208+0000","last_fullsized":"2023-07-21T22:34:25.378208+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:28.111216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976672+0000","last_change":"2023-07-21T22:34:23.987599+0000","last_active":"2023-07-21T22:34:24.976672+0000","last_peered":"2023-07-21T22:34:24.976672+0000","last_clean":"2023-07-21T22:34:24.976672+0000","last_became_active":"2023-07-21T22:34:23.987298+0000","last_became_peered":"2023-07-21T22:34:23.987298+0000","last_unstale":"2023-07-21T22:34:24.976672+0000","last_undegraded":"2023-07-21T22:34:24.976672+0000","last_fullsized":"2023-07-21T22:34:24.976672+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:21:22.785583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377963+0000","last_change":"2023-07-21T22:34:22.970084+0000","last_active":"2023-07-21T22:34:25.377963+0000","last_peered":"2023-07-21T22:34:25.377963+0000","last_clean":"2023-07-21T22:34:25.377963+0000","last_became_active":"2023-07-21T22:34:22.969773+0000","last_became_peered":"2023-07-21T22:34:22.969773+0000","last_unstale":"2023-07-21T22:34:25.377963+0000","last_undegraded":"2023-07-21T22:34:25.377963+0000","last_fullsized":"2023-07-21T22:34:25.377963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:25:27.833620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.244669+0000","last_change":"2023-07-21T22:34:23.971038+0000","last_active":"2023-07-21T22:34:25.244669+0000","last_peered":"2023-07-21T22:34:25.244669+0000","last_clean":"2023-07-21T22:34:25.244669+0000","last_became_active":"2023-07-21T22:34:23.970652+0000","last_became_peered":"2023-07-21T22:34:23.970652+0000","last_unstale":"2023-07-21T22:34:25.244669+0000","last_undegraded":"2023-07-21T22:34:25.244669+0000","last_fullsized":"2023-07-21T22:34:25.244669+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:40:31.195176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"83'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973418+0000","last_change":"2023-07-21T22:34:22.970835+0000","last_active":"2023-07-21T22:34:24.973418+0000","last_peered":"2023-07-21T22:34:24.973418+0000","last_clean":"2023-07-21T22:34:24.973418+0000","last_became_active":"2023-07-21T22:34:22.970540+0000","last_became_peered":"2023-07-21T22:34:22.970540+0000","last_unstale":"2023-07-21T22:34:24.973418+0000","last_undegraded":"2023-07-21T22:34:24.973418+0000","last_fullsized":"2023-07-21T22:34:24.973418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:24:28.818398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377306+0000","last_change":"2023-07-21T22:34:23.986252+0000","last_active":"2023-07-21T22:34:25.377306+0000","last_peered":"2023-07-21T22:34:25.377306+0000","last_clean":"2023-07-21T22:34:25.377306+0000","last_became_active":"2023-07-21T22:34:23.985928+0000","last_became_peered":"2023-07-21T22:34:23.985928+0000","last_unstale":"2023-07-21T22:34:25.377306+0000","last_undegraded":"2023-07-21T22:34:25.377306+0000","last_fullsized":"2023-07-21T22:34:25.377306+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:03:20.027035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"83'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973624+0000","last_change":"2023-07-21T22:34:22.968964+0000","last_active":"2023-07-21T22:34:24.973624+0000","last_peered":"2023-07-21T22:34:24.973624+0000","last_clean":"2023-07-21T22:34:24.973624+0000","last_became_active":"2023-07-21T22:34:22.968672+0000","last_became_peered":"2023-07-21T22:34:22.968672+0000","last_unstale":"2023-07-21T22:34:24.973624+0000","last_undegraded":"2023-07-21T22:34:24.973624+0000","last_fullsized":"2023-07-21T22:34:24.973624+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:35:25.577952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381587+0000","last_change":"2023-07-21T22:34:23.981967+0000","last_active":"2023-07-21T22:34:25.381587+0000","last_peered":"2023-07-21T22:34:25.381587+0000","last_clean":"2023-07-21T22:34:25.381587+0000","last_became_active":"2023-07-21T22:34:23.981661+0000","last_became_peered":"2023-07-21T22:34:23.981661+0000","last_unstale":"2023-07-21T22:34:25.381587+0000","last_undegraded":"2023-07-21T22:34:25.381587+0000","last_fullsized":"2023-07-21T22:34:25.381587+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:23:30.445380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973339+0000","last_change":"2023-07-21T22:34:22.975818+0000","last_active":"2023-07-21T22:34:24.973339+0000","last_peered":"2023-07-21T22:34:24.973339+0000","last_clean":"2023-07-21T22:34:24.973339+0000","last_became_active":"2023-07-21T22:34:22.975533+0000","last_became_peered":"2023-07-21T22:34:22.975533+0000","last_unstale":"2023-07-21T22:34:24.973339+0000","last_undegraded":"2023-07-21T22:34:24.973339+0000","last_fullsized":"2023-07-21T22:34:24.973339+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:41.027795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973425+0000","last_change":"2023-07-21T22:34:23.978627+0000","last_active":"2023-07-21T22:34:24.973425+0000","last_peered":"2023-07-21T22:34:24.973425+0000","last_clean":"2023-07-21T22:34:24.973425+0000","last_became_active":"2023-07-21T22:34:23.978343+0000","last_became_peered":"2023-07-21T22:34:23.978343+0000","last_unstale":"2023-07-21T22:34:24.973425+0000","last_undegraded":"2023-07-21T22:34:24.973425+0000","last_fullsized":"2023-07-21T22:34:24.973425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:15:40.314935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381699+0000","last_change":"2023-07-21T22:34:22.982821+0000","last_active":"2023-07-21T22:34:25.381699+0000","last_peered":"2023-07-21T22:34:25.381699+0000","last_clean":"2023-07-21T22:34:25.381699+0000","last_became_active":"2023-07-21T22:34:22.982493+0000","last_became_peered":"2023-07-21T22:34:22.982493+0000","last_unstale":"2023-07-21T22:34:25.381699+0000","last_undegraded":"2023-07-21T22:34:25.381699+0000","last_fullsized":"2023-07-21T22:34:25.381699+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:19:11.821675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377932+0000","last_change":"2023-07-21T22:34:23.975636+0000","last_active":"2023-07-21T22:34:25.377932+0000","last_peered":"2023-07-21T22:34:25.377932+0000","last_clean":"2023-07-21T22:34:25.377932+0000","last_became_active":"2023-07-21T22:34:23.974498+0000","last_became_peered":"2023-07-21T22:34:23.974498+0000","last_unstale":"2023-07-21T22:34:25.377932+0000","last_undegraded":"2023-07-21T22:34:25.377932+0000","last_fullsized":"2023-07-21T22:34:25.377932+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:24:29.825473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976727+0000","last_change":"2023-07-21T22:34:22.984655+0000","last_active":"2023-07-21T22:34:24.976727+0000","last_peered":"2023-07-21T22:34:24.976727+0000","last_clean":"2023-07-21T22:34:24.976727+0000","last_became_active":"2023-07-21T22:34:22.984018+0000","last_became_peered":"2023-07-21T22:34:22.984018+0000","last_unstale":"2023-07-21T22:34:24.976727+0000","last_undegraded":"2023-07-21T22:34:24.976727+0000","last_fullsized":"2023-07-21T22:34:24.976727+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:42:31.358322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973521+0000","last_change":"2023-07-21T22:34:23.973718+0000","last_active":"2023-07-21T22:34:24.973521+0000","last_peered":"2023-07-21T22:34:24.973521+0000","last_clean":"2023-07-21T22:34:24.973521+0000","last_became_active":"2023-07-21T22:34:23.973399+0000","last_became_peered":"2023-07-21T22:34:23.973399+0000","last_unstale":"2023-07-21T22:34:24.973521+0000","last_undegraded":"2023-07-21T22:34:24.973521+0000","last_fullsized":"2023-07-21T22:34:24.973521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:03:29.728340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977829+0000","last_change":"2023-07-21T22:34:22.980664+0000","last_active":"2023-07-21T22:34:24.977829+0000","last_peered":"2023-07-21T22:34:24.977829+0000","last_clean":"2023-07-21T22:34:24.977829+0000","last_became_active":"2023-07-21T22:34:22.980400+0000","last_became_peered":"2023-07-21T22:34:22.980400+0000","last_unstale":"2023-07-21T22:34:24.977829+0000","last_undegraded":"2023-07-21T22:34:24.977829+0000","last_fullsized":"2023-07-21T22:34:24.977829+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:23:01.635751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382560+0000","last_change":"2023-07-21T22:34:23.980040+0000","last_active":"2023-07-21T22:34:25.382560+0000","last_peered":"2023-07-21T22:34:25.382560+0000","last_clean":"2023-07-21T22:34:25.382560+0000","last_became_active":"2023-07-21T22:34:23.979773+0000","last_became_peered":"2023-07-21T22:34:23.979773+0000","last_unstale":"2023-07-21T22:34:25.382560+0000","last_undegraded":"2023-07-21T22:34:25.382560+0000","last_fullsized":"2023-07-21T22:34:25.382560+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:30:02.222355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"83'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976878+0000","last_change":"2023-07-21T22:34:22.983166+0000","last_active":"2023-07-21T22:34:24.976878+0000","last_peered":"2023-07-21T22:34:24.976878+0000","last_clean":"2023-07-21T22:34:24.976878+0000","last_became_active":"2023-07-21T22:34:22.982456+0000","last_became_peered":"2023-07-21T22:34:22.982456+0000","last_unstale":"2023-07-21T22:34:24.976878+0000","last_undegraded":"2023-07-21T22:34:24.976878+0000","last_fullsized":"2023-07-21T22:34:24.976878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:03:05.392480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977967+0000","last_change":"2023-07-21T22:34:23.981036+0000","last_active":"2023-07-21T22:34:24.977967+0000","last_peered":"2023-07-21T22:34:24.977967+0000","last_clean":"2023-07-21T22:34:24.977967+0000","last_became_active":"2023-07-21T22:34:23.980729+0000","last_became_peered":"2023-07-21T22:34:23.980729+0000","last_unstale":"2023-07-21T22:34:24.977967+0000","last_undegraded":"2023-07-21T22:34:24.977967+0000","last_fullsized":"2023-07-21T22:34:24.977967+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:41:34.837525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"83'6","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378076+0000","last_change":"2023-07-21T22:34:22.983569+0000","last_active":"2023-07-21T22:34:25.378076+0000","last_peered":"2023-07-21T22:34:25.378076+0000","last_clean":"2023-07-21T22:34:25.378076+0000","last_became_active":"2023-07-21T22:34:22.983277+0000","last_became_peered":"2023-07-21T22:34:22.983277+0000","last_unstale":"2023-07-21T22:34:25.378076+0000","last_undegraded":"2023-07-21T22:34:25.378076+0000","last_fullsized":"2023-07-21T22:34:25.378076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:03:28.721266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977036+0000","last_change":"2023-07-21T22:34:23.996942+0000","last_active":"2023-07-21T22:34:24.977036+0000","last_peered":"2023-07-21T22:34:24.977036+0000","last_clean":"2023-07-21T22:34:24.977036+0000","last_became_active":"2023-07-21T22:34:23.996603+0000","last_became_peered":"2023-07-21T22:34:23.996603+0000","last_unstale":"2023-07-21T22:34:24.977036+0000","last_undegraded":"2023-07-21T22:34:24.977036+0000","last_fullsized":"2023-07-21T22:34:24.977036+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:01:19.870056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977358+0000","last_change":"2023-07-21T22:34:22.985264+0000","last_active":"2023-07-21T22:34:24.977358+0000","last_peered":"2023-07-21T22:34:24.977358+0000","last_clean":"2023-07-21T22:34:24.977358+0000","last_became_active":"2023-07-21T22:34:22.984946+0000","last_became_peered":"2023-07-21T22:34:22.984946+0000","last_unstale":"2023-07-21T22:34:24.977358+0000","last_undegraded":"2023-07-21T22:34:24.977358+0000","last_fullsized":"2023-07-21T22:34:24.977358+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:41:41.930342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381517+0000","last_change":"2023-07-21T22:34:23.979766+0000","last_active":"2023-07-21T22:34:25.381517+0000","last_peered":"2023-07-21T22:34:25.381517+0000","last_clean":"2023-07-21T22:34:25.381517+0000","last_became_active":"2023-07-21T22:34:23.978981+0000","last_became_peered":"2023-07-21T22:34:23.978981+0000","last_unstale":"2023-07-21T22:34:25.381517+0000","last_undegraded":"2023-07-21T22:34:25.381517+0000","last_fullsized":"2023-07-21T22:34:25.381517+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:39:09.619306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381870+0000","last_change":"2023-07-21T22:34:22.978391+0000","last_active":"2023-07-21T22:34:25.381870+0000","last_peered":"2023-07-21T22:34:25.381870+0000","last_clean":"2023-07-21T22:34:25.381870+0000","last_became_active":"2023-07-21T22:34:22.978125+0000","last_became_peered":"2023-07-21T22:34:22.978125+0000","last_unstale":"2023-07-21T22:34:25.381870+0000","last_undegraded":"2023-07-21T22:34:25.381870+0000","last_fullsized":"2023-07-21T22:34:25.381870+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:07:47.116457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381494+0000","last_change":"2023-07-21T22:34:23.975311+0000","last_active":"2023-07-21T22:34:25.381494+0000","last_peered":"2023-07-21T22:34:25.381494+0000","last_clean":"2023-07-21T22:34:25.381494+0000","last_became_active":"2023-07-21T22:34:23.974987+0000","last_became_peered":"2023-07-21T22:34:23.974987+0000","last_unstale":"2023-07-21T22:34:25.381494+0000","last_undegraded":"2023-07-21T22:34:25.381494+0000","last_fullsized":"2023-07-21T22:34:25.381494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:02:20.149470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976243+0000","last_change":"2023-07-21T22:34:22.983579+0000","last_active":"2023-07-21T22:34:24.976243+0000","last_peered":"2023-07-21T22:34:24.976243+0000","last_clean":"2023-07-21T22:34:24.976243+0000","last_became_active":"2023-07-21T22:34:22.983241+0000","last_became_peered":"2023-07-21T22:34:22.983241+0000","last_unstale":"2023-07-21T22:34:24.976243+0000","last_undegraded":"2023-07-21T22:34:24.976243+0000","last_fullsized":"2023-07-21T22:34:24.976243+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:32:25.290199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377615+0000","last_change":"2023-07-21T22:34:23.993703+0000","last_active":"2023-07-21T22:34:25.377615+0000","last_peered":"2023-07-21T22:34:25.377615+0000","last_clean":"2023-07-21T22:34:25.377615+0000","last_became_active":"2023-07-21T22:34:23.993410+0000","last_became_peered":"2023-07-21T22:34:23.993410+0000","last_unstale":"2023-07-21T22:34:25.377615+0000","last_undegraded":"2023-07-21T22:34:25.377615+0000","last_fullsized":"2023-07-21T22:34:25.377615+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:44:38.717538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"83'8","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977183+0000","last_change":"2023-07-21T22:34:22.985768+0000","last_active":"2023-07-21T22:34:24.977183+0000","last_peered":"2023-07-21T22:34:24.977183+0000","last_clean":"2023-07-21T22:34:24.977183+0000","last_became_active":"2023-07-21T22:34:22.985453+0000","last_became_peered":"2023-07-21T22:34:22.985453+0000","last_unstale":"2023-07-21T22:34:24.977183+0000","last_undegraded":"2023-07-21T22:34:24.977183+0000","last_fullsized":"2023-07-21T22:34:24.977183+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:35:17.465512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377853+0000","last_change":"2023-07-21T22:34:23.980311+0000","last_active":"2023-07-21T22:34:25.377853+0000","last_peered":"2023-07-21T22:34:25.377853+0000","last_clean":"2023-07-21T22:34:25.377853+0000","last_became_active":"2023-07-21T22:34:23.980043+0000","last_became_peered":"2023-07-21T22:34:23.980043+0000","last_unstale":"2023-07-21T22:34:25.377853+0000","last_undegraded":"2023-07-21T22:34:25.377853+0000","last_fullsized":"2023-07-21T22:34:25.377853+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:34:24.285854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382682+0000","last_change":"2023-07-21T22:34:22.982600+0000","last_active":"2023-07-21T22:34:25.382682+0000","last_peered":"2023-07-21T22:34:25.382682+0000","last_clean":"2023-07-21T22:34:25.382682+0000","last_became_active":"2023-07-21T22:34:22.982315+0000","last_became_peered":"2023-07-21T22:34:22.982315+0000","last_unstale":"2023-07-21T22:34:25.382682+0000","last_undegraded":"2023-07-21T22:34:25.382682+0000","last_fullsized":"2023-07-21T22:34:25.382682+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:27.446542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.244739+0000","last_change":"2023-07-21T22:34:23.978397+0000","last_active":"2023-07-21T22:34:25.244739+0000","last_peered":"2023-07-21T22:34:25.244739+0000","last_clean":"2023-07-21T22:34:25.244739+0000","last_became_active":"2023-07-21T22:34:23.978109+0000","last_became_peered":"2023-07-21T22:34:23.978109+0000","last_unstale":"2023-07-21T22:34:25.244739+0000","last_undegraded":"2023-07-21T22:34:25.244739+0000","last_fullsized":"2023-07-21T22:34:25.244739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:01:07.753504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382638+0000","last_change":"2023-07-21T22:34:22.979042+0000","last_active":"2023-07-21T22:34:25.382638+0000","last_peered":"2023-07-21T22:34:25.382638+0000","last_clean":"2023-07-21T22:34:25.382638+0000","last_became_active":"2023-07-21T22:34:22.978740+0000","last_became_peered":"2023-07-21T22:34:22.978740+0000","last_unstale":"2023-07-21T22:34:25.382638+0000","last_undegraded":"2023-07-21T22:34:25.382638+0000","last_fullsized":"2023-07-21T22:34:25.382638+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:16:21.371057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382462+0000","last_change":"2023-07-21T22:34:23.983684+0000","last_active":"2023-07-21T22:34:25.382462+0000","last_peered":"2023-07-21T22:34:25.382462+0000","last_clean":"2023-07-21T22:34:25.382462+0000","last_became_active":"2023-07-21T22:34:23.983428+0000","last_became_peered":"2023-07-21T22:34:23.983428+0000","last_unstale":"2023-07-21T22:34:25.382462+0000","last_undegraded":"2023-07-21T22:34:25.382462+0000","last_fullsized":"2023-07-21T22:34:25.382462+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:21:13.260605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378168+0000","last_change":"2023-07-21T22:34:22.977004+0000","last_active":"2023-07-21T22:34:25.378168+0000","last_peered":"2023-07-21T22:34:25.378168+0000","last_clean":"2023-07-21T22:34:25.378168+0000","last_became_active":"2023-07-21T22:34:22.976697+0000","last_became_peered":"2023-07-21T22:34:22.976697+0000","last_unstale":"2023-07-21T22:34:25.378168+0000","last_undegraded":"2023-07-21T22:34:25.378168+0000","last_fullsized":"2023-07-21T22:34:25.378168+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:20:44.813322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382231+0000","last_change":"2023-07-21T22:34:23.976202+0000","last_active":"2023-07-21T22:34:25.382231+0000","last_peered":"2023-07-21T22:34:25.382231+0000","last_clean":"2023-07-21T22:34:25.382231+0000","last_became_active":"2023-07-21T22:34:23.975840+0000","last_became_peered":"2023-07-21T22:34:23.975840+0000","last_unstale":"2023-07-21T22:34:25.382231+0000","last_undegraded":"2023-07-21T22:34:25.382231+0000","last_fullsized":"2023-07-21T22:34:25.382231+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:03:23.404248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378198+0000","last_change":"2023-07-21T22:34:22.983643+0000","last_active":"2023-07-21T22:34:25.378198+0000","last_peered":"2023-07-21T22:34:25.378198+0000","last_clean":"2023-07-21T22:34:25.378198+0000","last_became_active":"2023-07-21T22:34:22.983314+0000","last_became_peered":"2023-07-21T22:34:22.983314+0000","last_unstale":"2023-07-21T22:34:25.378198+0000","last_undegraded":"2023-07-21T22:34:25.378198+0000","last_fullsized":"2023-07-21T22:34:25.378198+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:30:11.604700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381461+0000","last_change":"2023-07-21T22:34:23.975201+0000","last_active":"2023-07-21T22:34:25.381461+0000","last_peered":"2023-07-21T22:34:25.381461+0000","last_clean":"2023-07-21T22:34:25.381461+0000","last_became_active":"2023-07-21T22:34:23.974886+0000","last_became_peered":"2023-07-21T22:34:23.974886+0000","last_unstale":"2023-07-21T22:34:25.381461+0000","last_undegraded":"2023-07-21T22:34:25.381461+0000","last_fullsized":"2023-07-21T22:34:25.381461+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:47:07.038679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977388+0000","last_change":"2023-07-21T22:34:22.982875+0000","last_active":"2023-07-21T22:34:24.977388+0000","last_peered":"2023-07-21T22:34:24.977388+0000","last_clean":"2023-07-21T22:34:24.977388+0000","last_became_active":"2023-07-21T22:34:22.982387+0000","last_became_peered":"2023-07-21T22:34:22.982387+0000","last_unstale":"2023-07-21T22:34:24.977388+0000","last_undegraded":"2023-07-21T22:34:24.977388+0000","last_fullsized":"2023-07-21T22:34:24.977388+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:10:46.817282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976369+0000","last_change":"2023-07-21T22:34:23.993975+0000","last_active":"2023-07-21T22:34:24.976369+0000","last_peered":"2023-07-21T22:34:24.976369+0000","last_clean":"2023-07-21T22:34:24.976369+0000","last_became_active":"2023-07-21T22:34:23.993694+0000","last_became_peered":"2023-07-21T22:34:23.993694+0000","last_unstale":"2023-07-21T22:34:24.976369+0000","last_undegraded":"2023-07-21T22:34:24.976369+0000","last_fullsized":"2023-07-21T22:34:24.976369+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:58:24.669979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973397+0000","last_change":"2023-07-21T22:34:22.967847+0000","last_active":"2023-07-21T22:34:24.973397+0000","last_peered":"2023-07-21T22:34:24.973397+0000","last_clean":"2023-07-21T22:34:24.973397+0000","last_became_active":"2023-07-21T22:34:22.967434+0000","last_became_peered":"2023-07-21T22:34:22.967434+0000","last_unstale":"2023-07-21T22:34:24.973397+0000","last_undegraded":"2023-07-21T22:34:24.973397+0000","last_fullsized":"2023-07-21T22:34:24.973397+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:44:37.710464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377393+0000","last_change":"2023-07-21T22:34:23.986576+0000","last_active":"2023-07-21T22:34:25.377393+0000","last_peered":"2023-07-21T22:34:25.377393+0000","last_clean":"2023-07-21T22:34:25.377393+0000","last_became_active":"2023-07-21T22:34:23.986278+0000","last_became_peered":"2023-07-21T22:34:23.986278+0000","last_unstale":"2023-07-21T22:34:25.377393+0000","last_undegraded":"2023-07-21T22:34:25.377393+0000","last_fullsized":"2023-07-21T22:34:25.377393+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:42.034870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973269+0000","last_change":"2023-07-21T22:34:22.976249+0000","last_active":"2023-07-21T22:34:24.973269+0000","last_peered":"2023-07-21T22:34:24.973269+0000","last_clean":"2023-07-21T22:34:24.973269+0000","last_became_active":"2023-07-21T22:34:22.975817+0000","last_became_peered":"2023-07-21T22:34:22.975817+0000","last_unstale":"2023-07-21T22:34:24.973269+0000","last_undegraded":"2023-07-21T22:34:24.973269+0000","last_fullsized":"2023-07-21T22:34:24.973269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:03:19.019961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.244534+0000","last_change":"2023-07-21T22:34:23.979900+0000","last_active":"2023-07-21T22:34:25.244534+0000","last_peered":"2023-07-21T22:34:25.244534+0000","last_clean":"2023-07-21T22:34:25.244534+0000","last_became_active":"2023-07-21T22:34:23.979633+0000","last_became_peered":"2023-07-21T22:34:23.979633+0000","last_unstale":"2023-07-21T22:34:25.244534+0000","last_undegraded":"2023-07-21T22:34:25.244534+0000","last_fullsized":"2023-07-21T22:34:25.244534+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:24:26.617289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377261+0000","last_change":"2023-07-21T22:34:22.976771+0000","last_active":"2023-07-21T22:34:25.377261+0000","last_peered":"2023-07-21T22:34:25.377261+0000","last_clean":"2023-07-21T22:34:25.377261+0000","last_became_active":"2023-07-21T22:34:22.976478+0000","last_became_peered":"2023-07-21T22:34:22.976478+0000","last_unstale":"2023-07-21T22:34:25.377261+0000","last_undegraded":"2023-07-21T22:34:25.377261+0000","last_fullsized":"2023-07-21T22:34:25.377261+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:48:31.419695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381914+0000","last_change":"2023-07-21T22:34:23.974607+0000","last_active":"2023-07-21T22:34:25.381914+0000","last_peered":"2023-07-21T22:34:25.381914+0000","last_clean":"2023-07-21T22:34:25.381914+0000","last_became_active":"2023-07-21T22:34:23.974329+0000","last_became_peered":"2023-07-21T22:34:23.974329+0000","last_unstale":"2023-07-21T22:34:25.381914+0000","last_undegraded":"2023-07-21T22:34:25.381914+0000","last_fullsized":"2023-07-21T22:34:25.381914+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:44:00.203211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973194+0000","last_change":"2023-07-21T22:34:22.971793+0000","last_active":"2023-07-21T22:34:24.973194+0000","last_peered":"2023-07-21T22:34:24.973194+0000","last_clean":"2023-07-21T22:34:24.973194+0000","last_became_active":"2023-07-21T22:34:22.971485+0000","last_became_peered":"2023-07-21T22:34:22.971485+0000","last_unstale":"2023-07-21T22:34:24.973194+0000","last_undegraded":"2023-07-21T22:34:24.973194+0000","last_fullsized":"2023-07-21T22:34:24.973194+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:54:08.810157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"72'161","reported_seq":440,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976463+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:34:24.976463+0000","last_peered":"2023-07-21T22:34:24.976463+0000","last_clean":"2023-07-21T22:34:24.976463+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:34:24.976463+0000","last_undegraded":"2023-07-21T22:34:24.976463+0000","last_fullsized":"2023-07-21T22:34:24.976463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:06:05.620846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382036+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:34:25.382036+0000","last_peered":"2023-07-21T22:34:25.382036+0000","last_clean":"2023-07-21T22:34:25.382036+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:34:25.382036+0000","last_undegraded":"2023-07-21T22:34:25.382036+0000","last_fullsized":"2023-07-21T22:34:25.382036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:12:37.450061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377572+0000","last_change":"2023-07-21T22:34:23.987435+0000","last_active":"2023-07-21T22:34:25.377572+0000","last_peered":"2023-07-21T22:34:25.377572+0000","last_clean":"2023-07-21T22:34:25.377572+0000","last_became_active":"2023-07-21T22:34:23.986712+0000","last_became_peered":"2023-07-21T22:34:23.986712+0000","last_unstale":"2023-07-21T22:34:25.377572+0000","last_undegraded":"2023-07-21T22:34:25.377572+0000","last_fullsized":"2023-07-21T22:34:25.377572+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:41:22.787768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377536+0000","last_change":"2023-07-21T22:34:22.978762+0000","last_active":"2023-07-21T22:34:25.377536+0000","last_peered":"2023-07-21T22:34:25.377536+0000","last_clean":"2023-07-21T22:34:25.377536+0000","last_became_active":"2023-07-21T22:34:22.978367+0000","last_became_peered":"2023-07-21T22:34:22.978367+0000","last_unstale":"2023-07-21T22:34:25.377536+0000","last_undegraded":"2023-07-21T22:34:25.377536+0000","last_fullsized":"2023-07-21T22:34:25.377536+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:22:27.207819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":128,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976321+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:34:24.976321+0000","last_peered":"2023-07-21T22:34:24.976321+0000","last_clean":"2023-07-21T22:34:24.976321+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:34:24.976321+0000","last_undegraded":"2023-07-21T22:34:24.976321+0000","last_fullsized":"2023-07-21T22:34:24.976321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:21:24.825644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381694+0000","last_change":"2023-07-21T22:34:23.976069+0000","last_active":"2023-07-21T22:34:25.381694+0000","last_peered":"2023-07-21T22:34:25.381694+0000","last_clean":"2023-07-21T22:34:25.381694+0000","last_became_active":"2023-07-21T22:34:23.975778+0000","last_became_peered":"2023-07-21T22:34:23.975778+0000","last_unstale":"2023-07-21T22:34:25.381694+0000","last_undegraded":"2023-07-21T22:34:25.381694+0000","last_fullsized":"2023-07-21T22:34:25.381694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:31:45.523353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382046+0000","last_change":"2023-07-21T22:34:22.977887+0000","last_active":"2023-07-21T22:34:25.382046+0000","last_peered":"2023-07-21T22:34:25.382046+0000","last_clean":"2023-07-21T22:34:25.382046+0000","last_became_active":"2023-07-21T22:34:22.977599+0000","last_became_peered":"2023-07-21T22:34:22.977599+0000","last_unstale":"2023-07-21T22:34:25.382046+0000","last_undegraded":"2023-07-21T22:34:25.382046+0000","last_fullsized":"2023-07-21T22:34:25.382046+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:02:17.037056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":124,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.244653+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:34:25.244653+0000","last_peered":"2023-07-21T22:34:25.244653+0000","last_clean":"2023-07-21T22:34:25.244653+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:34:25.244653+0000","last_undegraded":"2023-07-21T22:34:25.244653+0000","last_fullsized":"2023-07-21T22:34:25.244653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:17:30.700055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.381658+0000","last_change":"2023-07-21T22:34:23.981172+0000","last_active":"2023-07-21T22:34:25.381658+0000","last_peered":"2023-07-21T22:34:25.381658+0000","last_clean":"2023-07-21T22:34:25.381658+0000","last_became_active":"2023-07-21T22:34:23.980894+0000","last_became_peered":"2023-07-21T22:34:23.980894+0000","last_unstale":"2023-07-21T22:34:25.381658+0000","last_undegraded":"2023-07-21T22:34:25.381658+0000","last_fullsized":"2023-07-21T22:34:25.381658+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:04:25.187714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.377500+0000","last_change":"2023-07-21T22:34:22.981350+0000","last_active":"2023-07-21T22:34:25.377500+0000","last_peered":"2023-07-21T22:34:25.377500+0000","last_clean":"2023-07-21T22:34:25.377500+0000","last_became_active":"2023-07-21T22:34:22.981023+0000","last_became_peered":"2023-07-21T22:34:22.981023+0000","last_unstale":"2023-07-21T22:34:25.377500+0000","last_undegraded":"2023-07-21T22:34:25.377500+0000","last_fullsized":"2023-07-21T22:34:25.377500+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:30:48.994293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382015+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:34:25.382015+0000","last_peered":"2023-07-21T22:34:25.382015+0000","last_clean":"2023-07-21T22:34:25.382015+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:34:25.382015+0000","last_undegraded":"2023-07-21T22:34:25.382015+0000","last_fullsized":"2023-07-21T22:34:25.382015+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:16:42.113002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976563+0000","last_change":"2023-07-21T22:34:23.994520+0000","last_active":"2023-07-21T22:34:24.976563+0000","last_peered":"2023-07-21T22:34:24.976563+0000","last_clean":"2023-07-21T22:34:24.976563+0000","last_became_active":"2023-07-21T22:34:23.994236+0000","last_became_peered":"2023-07-21T22:34:23.994236+0000","last_unstale":"2023-07-21T22:34:24.976563+0000","last_undegraded":"2023-07-21T22:34:24.976563+0000","last_fullsized":"2023-07-21T22:34:24.976563+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:47:33.497295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"83'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382541+0000","last_change":"2023-07-21T22:34:22.978160+0000","last_active":"2023-07-21T22:34:25.382541+0000","last_peered":"2023-07-21T22:34:25.382541+0000","last_clean":"2023-07-21T22:34:25.382541+0000","last_became_active":"2023-07-21T22:34:22.977862+0000","last_became_peered":"2023-07-21T22:34:22.977862+0000","last_unstale":"2023-07-21T22:34:25.382541+0000","last_undegraded":"2023-07-21T22:34:25.382541+0000","last_fullsized":"2023-07-21T22:34:25.382541+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:15:27.797496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":134,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378306+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:34:25.378306+0000","last_peered":"2023-07-21T22:34:25.378306+0000","last_clean":"2023-07-21T22:34:25.378306+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:34:25.378306+0000","last_undegraded":"2023-07-21T22:34:25.378306+0000","last_fullsized":"2023-07-21T22:34:25.378306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:16:07.957187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382252+0000","last_change":"2023-07-21T22:34:23.983677+0000","last_active":"2023-07-21T22:34:25.382252+0000","last_peered":"2023-07-21T22:34:25.382252+0000","last_clean":"2023-07-21T22:34:25.382252+0000","last_became_active":"2023-07-21T22:34:23.983076+0000","last_became_peered":"2023-07-21T22:34:23.983076+0000","last_unstale":"2023-07-21T22:34:25.382252+0000","last_undegraded":"2023-07-21T22:34:25.382252+0000","last_fullsized":"2023-07-21T22:34:25.382252+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:00:10.544232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.976642+0000","last_change":"2023-07-21T22:34:22.987856+0000","last_active":"2023-07-21T22:34:24.976642+0000","last_peered":"2023-07-21T22:34:24.976642+0000","last_clean":"2023-07-21T22:34:24.976642+0000","last_became_active":"2023-07-21T22:34:22.987572+0000","last_became_peered":"2023-07-21T22:34:22.987572+0000","last_unstale":"2023-07-21T22:34:24.976642+0000","last_undegraded":"2023-07-21T22:34:24.976642+0000","last_fullsized":"2023-07-21T22:34:24.976642+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:37:53.063513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977179+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:34:24.977179+0000","last_peered":"2023-07-21T22:34:24.977179+0000","last_clean":"2023-07-21T22:34:24.977179+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:34:24.977179+0000","last_undegraded":"2023-07-21T22:34:24.977179+0000","last_fullsized":"2023-07-21T22:34:24.977179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:42:46.823866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977793+0000","last_change":"2023-07-21T22:34:23.980559+0000","last_active":"2023-07-21T22:34:24.977793+0000","last_peered":"2023-07-21T22:34:24.977793+0000","last_clean":"2023-07-21T22:34:24.977793+0000","last_became_active":"2023-07-21T22:34:23.980283+0000","last_became_peered":"2023-07-21T22:34:23.980283+0000","last_unstale":"2023-07-21T22:34:24.977793+0000","last_undegraded":"2023-07-21T22:34:24.977793+0000","last_fullsized":"2023-07-21T22:34:24.977793+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:17:00.717082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"83'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.977022+0000","last_change":"2023-07-21T22:34:22.983383+0000","last_active":"2023-07-21T22:34:24.977022+0000","last_peered":"2023-07-21T22:34:24.977022+0000","last_clean":"2023-07-21T22:34:24.977022+0000","last_became_active":"2023-07-21T22:34:22.982810+0000","last_became_peered":"2023-07-21T22:34:22.982810+0000","last_unstale":"2023-07-21T22:34:24.977022+0000","last_undegraded":"2023-07-21T22:34:24.977022+0000","last_fullsized":"2023-07-21T22:34:24.977022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:43:14.697493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":134,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.378169+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:34:25.378169+0000","last_peered":"2023-07-21T22:34:25.378169+0000","last_clean":"2023-07-21T22:34:25.378169+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:34:25.378169+0000","last_undegraded":"2023-07-21T22:34:25.378169+0000","last_fullsized":"2023-07-21T22:34:25.378169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:19:40.898837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382236+0000","last_change":"2023-07-21T22:34:23.975888+0000","last_active":"2023-07-21T22:34:25.382236+0000","last_peered":"2023-07-21T22:34:25.382236+0000","last_clean":"2023-07-21T22:34:25.382236+0000","last_became_active":"2023-07-21T22:34:23.975065+0000","last_became_peered":"2023-07-21T22:34:23.975065+0000","last_unstale":"2023-07-21T22:34:25.382236+0000","last_undegraded":"2023-07-21T22:34:25.382236+0000","last_fullsized":"2023-07-21T22:34:25.382236+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:22.943038+0000","last_clean_scrub_stamp":"2023-07-21T22:34:22.943038+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:56.416293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:24.973486+0000","last_change":"2023-07-21T22:34:22.983391+0000","last_active":"2023-07-21T22:34:24.973486+0000","last_peered":"2023-07-21T22:34:24.973486+0000","last_clean":"2023-07-21T22:34:24.973486+0000","last_became_active":"2023-07-21T22:34:22.983074+0000","last_became_peered":"2023-07-21T22:34:22.983074+0000","last_unstale":"2023-07-21T22:34:24.973486+0000","last_undegraded":"2023-07-21T22:34:24.973486+0000","last_fullsized":"2023-07-21T22:34:24.973486+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:34:21.935964+0000","last_clean_scrub_stamp":"2023-07-21T22:34:21.935964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:04:37.717366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":126,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-07-21T22:34:25.382380+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:34:25.382380+0000","last_peered":"2023-07-21T22:34:25.382380+0000","last_clean":"2023-07-21T22:34:25.382380+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:34:25.382380+0000","last_undegraded":"2023-07-21T22:34:25.382380+0000","last_fullsized":"2023-07-21T22:34:25.382380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:28:57.991858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509632,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54772,"kb_used_data":1580,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317068,"statfs":{"total":96636764160,"available":96580677632,"internally_reserved":0,"allocated":1617920,"data_stored":1088760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.752,"15min":0.73999999999999999},"min":{"1min":0.53600000000000003,"5min":0.35299999999999998,"15min":0.32600000000000001},"max":{"1min":0.96399999999999997,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.755},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71499999999999997,"15min":0.69599999999999995},"min":{"1min":0.55300000000000005,"5min":0.39500000000000002,"15min":0.36099999999999999},"max":{"1min":0.94399999999999995,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.67900000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.73699999999999999},"min":{"1min":0.46800000000000003,"5min":0.432,"15min":0.379},"max":{"1min":1.0680000000000001,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.56799999999999995,"5min":0.44,"15min":0.44},"max":{"1min":0.95099999999999996,"5min":1.0129999999999999,"15min":1.0409999999999999},"last":0.82599999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.73799999999999999,"15min":0.74299999999999999},"min":{"1min":0.53100000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.405},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.73599999999999999,"15min":0.752},"min":{"1min":0.59399999999999997,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.94599999999999995,"5min":1.409,"15min":1.409},"last":0.80600000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.754,"15min":0.76600000000000001},"min":{"1min":0.58399999999999996,"5min":0.504,"15min":0.42099999999999999},"max":{"1min":1.0409999999999999,"5min":1.46,"15min":1.46},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.75900000000000001,"15min":0.75800000000000001},"min":{"1min":0.63400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.88100000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54900000000000004,"15min":0.56200000000000006},"min":{"1min":0.42399999999999999,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.90000000000000002,"5min":0.90500000000000003,"15min":1.244},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.62,"15min":0.625},"min":{"1min":0.45600000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97399999999999998,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.53500000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63800000000000001,"15min":0.61899999999999999},"min":{"1min":0.51800000000000002,"5min":0.40400000000000003,"15min":0.40300000000000002},"max":{"1min":0.81200000000000006,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66300000000000003,"15min":0.68000000000000005},"min":{"1min":0.49299999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91300000000000003,"5min":1.506,"15min":1.506},"last":0.71499999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:33:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.66900000000000004,"15min":0.68000000000000005},"min":{"1min":0.57099999999999995,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93999999999999995,"5min":0.94399999999999995,"15min":1.048},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61699999999999999,"15min":0.63900000000000001},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.98599999999999999},"last":0.48799999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542338,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":1011712,"data_stored":497650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76700000000000002,"15min":0.76500000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.425},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.59199999999999997,"5min":0.57899999999999996,"15min":0.437},"max":{"1min":1.0289999999999999,"5min":1.1180000000000001,"15min":2.3100000000000001},"last":0.71299999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.55700000000000005,"5min":0.45300000000000001,"15min":0.41999999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.99199999999999999,"5min":0.99399999999999999,"15min":8.6280000000000001},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.55600000000000005,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.55},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.80700000000000005,"15min":0.79600000000000004},"min":{"1min":0.59699999999999998,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":1.097,"15min":1.097},"last":0.74099999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.60399999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.7470000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.58399999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92800000000000005,"5min":1.0049999999999999,"15min":1.5129999999999999},"last":0.58999999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.374,"15min":0.36599999999999999},"max":{"1min":0.93400000000000005,"5min":1.0229999999999999,"15min":3.1829999999999998},"last":0.496},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.80100000000000005,"5min":0.86199999999999999,"15min":2.887},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60899999999999999,"15min":0.61899999999999999},"min":{"1min":0.437,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82799999999999996,"5min":0.96299999999999997,"15min":1.4510000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.50900000000000001,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.88400000000000001,"5min":0.98799999999999999,"15min":1.054},"last":0.57499999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.52400000000000002,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":0.93600000000000005,"5min":1.079,"15min":1.1679999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68899999999999995,"15min":0.71499999999999997},"min":{"1min":0.54100000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82499999999999996,"5min":1.0449999999999999,"15min":8.0760000000000005},"last":0.67700000000000005}]}]},{"osd":5,"up_from":15,"seq":64424509631,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":988,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":1011712,"data_stored":497638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72799999999999998,"15min":0.71599999999999997},"min":{"1min":0.53000000000000003,"5min":0.35699999999999998,"15min":0.32900000000000001},"max":{"1min":1,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47599999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.59499999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69399999999999995,"15min":0.71399999999999997},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.505},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.505,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":1.617,"15min":1.617},"last":0.66600000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71799999999999997,"15min":0.73599999999999999},"min":{"1min":0.53300000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.92800000000000005,"5min":1.0109999999999999,"15min":1.034},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.53300000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.90800000000000003,"5min":1.512,"15min":1.512},"last":0.63800000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.77200000000000002,"15min":0.78700000000000003},"min":{"1min":0.61299999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98599999999999999,"5min":1.472,"15min":1.472},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.80300000000000005,"15min":0.79700000000000004},"min":{"1min":0.56899999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.022,"5min":1.556,"15min":1.556},"last":0.71699999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.623},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.48899999999999999,"5min":0.48599999999999999,"15min":0.44900000000000001},"max":{"1min":0.92400000000000004,"5min":1.012,"15min":1.038},"last":0.69499999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70499999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.62,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92500000000000004,"5min":1.02,"15min":1.02},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.64800000000000002,"15min":0.65200000000000002},"min":{"1min":0.55500000000000005,"5min":0.374,"15min":0.374},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.72499999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.85899999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.80800000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509632,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":1019904,"data_stored":499180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.746,"15min":0.747},"min":{"1min":0.55700000000000005,"5min":0.438,"15min":0.40000000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":1.0429999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.746,"15min":0.746},"min":{"1min":0.55000000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95099999999999996,"5min":0.96099999999999997,"15min":0.99099999999999999},"last":0.61199999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70499999999999996,"15min":0.70399999999999996},"min":{"1min":0.53400000000000003,"5min":0.43099999999999999,"15min":0.39400000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.0449999999999999},"last":0.627},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.60899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.93000000000000005,"5min":0.94299999999999995,"15min":1.016},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.59299999999999997,"5min":0.371,"15min":0.371},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.57799999999999996,"5min":0.41999999999999998,"15min":0.33000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.67100000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.505,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":1.026},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.80200000000000005,"15min":0.79200000000000004},"min":{"1min":0.70399999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.996,"5min":0.996,"15min":1.018},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56399999999999995,"15min":0.57599999999999996},"min":{"1min":0.441,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72299999999999998,"5min":0.81599999999999995,"15min":0.94299999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.59299999999999997},"min":{"1min":0.38800000000000001,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.79600000000000004,"5min":0.91000000000000003,"15min":1.0680000000000001},"last":0.48499999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64300000000000002,"15min":0.65200000000000002},"min":{"1min":0.45800000000000002,"5min":0.41299999999999998,"15min":0.38500000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.442},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70099999999999996,"15min":0.72599999999999998},"min":{"1min":0.52200000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91400000000000003,"5min":0.98999999999999999,"15min":1.272},"last":0.69499999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:33:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.628,"15min":0.65800000000000003},"min":{"1min":0.499,"5min":0.39200000000000002,"15min":0.374},"max":{"1min":0.91300000000000003,"5min":1.0069999999999999,"15min":1.3300000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68000000000000005,"15min":0.69299999999999995},"min":{"1min":0.53100000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.135},"last":0.50800000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509631,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":1007616,"data_stored":497616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.48799999999999999,"15min":0.48099999999999998},"min":{"1min":0.35099999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70499999999999996,"5min":0.73099999999999998,"15min":0.76400000000000001},"last":0.314},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.57499999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.30099999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.871},"last":0.44},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.94199999999999995},"last":0.42399999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82899999999999996,"5min":1.0449999999999999,"15min":1.1140000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45500000000000002,"5min":0.45100000000000001,"15min":0.40999999999999998},"max":{"1min":0.84399999999999997,"5min":0.95399999999999996,"15min":0.99199999999999999},"last":0.5}]},{"osd":4,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.57599999999999996,"5min":0.48299999999999998,"15min":0.438},"max":{"1min":1.093,"5min":1.093,"15min":1.3240000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82199999999999995,"15min":0.83299999999999996},"min":{"1min":0.68799999999999994,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.488},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.60699999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0669999999999999,"5min":1.137,"15min":1.1919999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.60399999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0649999999999999,"15min":1.302},"last":0.55900000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79200000000000004,"15min":0.80100000000000005},"min":{"1min":0.68000000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.02,"5min":1.056,"15min":1.3979999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76500000000000001,"15min":0.78000000000000003},"min":{"1min":0.56899999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0269999999999999,"5min":1.1120000000000001,"15min":1.3899999999999999},"last":0.63300000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.81000000000000005,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0089999999999999,"5min":1.087,"15min":1.335},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.873,"5min":0.83699999999999997,"15min":0.83499999999999996},"min":{"1min":0.66100000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.2130000000000001},"last":0.59499999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509633,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54176,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317664,"statfs":{"total":96636764160,"available":96581287936,"internally_reserved":0,"allocated":1007616,"data_stored":497616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.29099999999999998,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.69399999999999995,"5min":0.81200000000000006,"15min":0.94199999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53600000000000003,"15min":0.54900000000000004},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.88300000000000001,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.28199999999999997},"max":{"1min":0.82999999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80700000000000005,"5min":1.085,"15min":1.085},"last":0.505}]},{"osd":3,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.37,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55300000000000005,"15min":0.56899999999999995},"min":{"1min":0.43099999999999999,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":1.161,"15min":1.161},"last":0.40999999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.67600000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.1579999999999999,"5min":1.2569999999999999,"15min":1.6870000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.79400000000000004,"15min":0.80200000000000005},"min":{"1min":0.57699999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.175,"5min":1.1950000000000001,"15min":1.2689999999999999},"last":0.84099999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.63200000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.2549999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.60599999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.107,"5min":1.206,"15min":1.3089999999999999},"last":0.88900000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.78600000000000003,"15min":0.79800000000000004},"min":{"1min":0.69399999999999995,"5min":0.45500000000000002,"15min":0.40300000000000002},"max":{"1min":1.089,"5min":1.282,"15min":1.3759999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.64300000000000002,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.1339999999999999,"5min":1.23,"15min":1.2649999999999999},"last":0.81899999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.80900000000000005,"15min":0.82899999999999996},"min":{"1min":0.64900000000000002,"5min":0.51100000000000001,"15min":0.49099999999999999},"max":{"1min":1.143,"5min":1.2,"15min":1.2909999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.60999999999999999,"5min":0.44900000000000001,"15min":0.44700000000000001},"max":{"1min":1.091,"5min":1.216,"15min":1.3660000000000001},"last":0.76100000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509632,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":1036288,"data_stored":499944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48899999999999999,"15min":0.504},"min":{"1min":0.32600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.66700000000000004,"5min":0.84599999999999997,"15min":5.4800000000000004},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.58799999999999997},"min":{"1min":0.49399999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.872,"15min":5.2830000000000004},"last":0.39600000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.39900000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72999999999999998,"5min":0.76100000000000001,"15min":3.4220000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.39800000000000002,"5min":0.35199999999999998,"15min":0.29099999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.88800000000000001},"last":0.34999999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59499999999999997,"15min":0.60999999999999999},"min":{"1min":0.48899999999999999,"5min":0.35799999999999998,"15min":0.33400000000000002},"max":{"1min":0.73499999999999999,"5min":0.84299999999999997,"15min":3.2469999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51700000000000002,"15min":0.53700000000000003},"min":{"1min":0.36799999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":5.8710000000000004},"last":0.435}]},{"osd":4,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.58699999999999997,"5min":0.432,"15min":0.432},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":3.6259999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.63100000000000001,"5min":0.498,"15min":0.498},"max":{"1min":0.97399999999999998,"5min":1.083,"15min":4.4100000000000001},"last":0.73499999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.77600000000000002,"15min":0.80200000000000005},"min":{"1min":0.64800000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0609999999999999,"5min":1.115,"15min":5.766},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.80100000000000005,"15min":0.81299999999999994},"min":{"1min":0.57899999999999996,"5min":0.376,"15min":0.376},"max":{"1min":1.0980000000000001,"5min":1.1279999999999999,"15min":3.669},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.79900000000000004,"15min":0.81299999999999994},"min":{"1min":0.66700000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0429999999999999,"5min":1.085,"15min":1.23},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77800000000000002,"15min":0.81499999999999995},"min":{"1min":0.55100000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.083,"5min":1.1020000000000001,"15min":5.8200000000000003},"last":0.80700000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:34:00 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.79800000000000004,"15min":0.83099999999999996},"min":{"1min":0.59599999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.028,"5min":1.103,"15min":5.9269999999999996},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80600000000000005,"15min":0.82399999999999995},"min":{"1min":0.60299999999999998,"5min":0.52600000000000002,"15min":0.45700000000000002},"max":{"1min":1.115,"5min":1.115,"15min":3.5800000000000001},"last":0.74299999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509634,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":1564,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1601536,"data_stored":1087984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.50800000000000001},"min":{"1min":0.35899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.67900000000000005,"5min":0.77800000000000002,"15min":0.83199999999999996},"last":0.48699999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70999999999999996,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.44,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58199999999999996,"5min":0.871,"15min":0.871},"last":0.503}]},{"osd":3,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.35899999999999999,"15min":0.34899999999999998},"max":{"1min":0.76500000000000001,"5min":0.88100000000000001,"15min":0.91300000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.434,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73999999999999999,"5min":1.038,"15min":1.038},"last":0.433}]},{"osd":4,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.76100000000000001,"15min":0.78100000000000003},"min":{"1min":0.59299999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.321},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.60099999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.093,"5min":1.423,"15min":1.423},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.60299999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0960000000000001,"5min":1.2669999999999999,"15min":1.28},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.78400000000000003,"15min":0.80900000000000005},"min":{"1min":0.70599999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.393},"last":0.57699999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78500000000000003,"15min":0.81299999999999994},"min":{"1min":0.61799999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.28},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81399999999999995,"15min":0.81999999999999995},"min":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.131,"5min":1.333,"15min":1.333},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.65900000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.2310000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.80900000000000005,"15min":0.83399999999999996},"min":{"1min":0.60599999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1930000000000001,"5min":1.296,"15min":1.369},"last":0.61399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:34:33.128 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T22:34:33.129 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-21T22:34:33.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.262+0000 7f72c5448640 1 Processor -- start 2023-07-21T22:34:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.262+0000 7f72c5448640 1 -- start start 2023-07-21T22:34:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.262+0000 7f72c5448640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72c00d0250 0x7f72c00d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:33.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.262+0000 7f72c5448640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c00d0aa0 con 0x7f72c015bec0 2023-07-21T22:34:33.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.262+0000 7f72c5448640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c00d07c0 con 0x7f72c00d2820 2023-07-21T22:34:33.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.262+0000 7f72c5448640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00d2ca0 con 0x7f72c00d0250 2023-07-21T22:34:33.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.262+0000 7f72beffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f72c015bec0 0x7f72c00cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54554/0 (socket says 172.21.15.6:54554) 2023-07-21T22:34:33.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.262+0000 7f72beffd640 1 -- 172.21.15.6:0/2512419223 learned_addr learned my addr 172.21.15.6:0/2512419223 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:33.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.262+0000 7f72be7fc640 1 -- 172.21.15.6:0/2512419223 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 839481801 0 0) 0x7f72b0001120 con 0x7f72c015bec0 2023-07-21T22:34:33.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.262+0000 7f72be7fc640 1 -- 172.21.15.6:0/2512419223 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72ac003530 con 0x7f72c015bec0 2023-07-21T22:34:33.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.262+0000 7f72b67fc640 1 --2- 172.21.15.6:0/2512419223 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72c00d0250 0x7f72c00d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:33.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.262+0000 7f72be7fc640 1 -- 172.21.15.6:0/2512419223 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3896919133 0 0) 0x7f72ac003530 con 0x7f72c015bec0 2023-07-21T22:34:33.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.262+0000 7f72be7fc640 1 -- 172.21.15.6:0/2512419223 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72c00d0250 msgr2=0x7f72c00d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:33.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.262+0000 7f72be7fc640 1 --2- 172.21.15.6:0/2512419223 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72c00d0250 0x7f72c00d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.262+0000 7f72be7fc640 1 -- 172.21.15.6:0/2512419223 >> v1:172.21.15.161:6789/0 conn(0x7f72c00d2820 legacy=0x7f72c00b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.262+0000 7f72be7fc640 1 -- 172.21.15.6:0/2512419223 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c00b1dc0 con 0x7f72c015bec0 2023-07-21T22:34:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.262+0000 7f72be7fc640 1 -- 172.21.15.6:0/2512419223 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f72b0001810 con 0x7f72c015bec0 2023-07-21T22:34:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.262+0000 7f72be7fc640 1 -- 172.21.15.6:0/2512419223 >> v1:172.21.15.6:6789/0 conn(0x7f72c015bec0 legacy=0x7f72c00cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.262+0000 7f72be7fc640 1 --2- 172.21.15.6:0/2512419223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0039b0 0x7f72ac003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.266+0000 7f72be7fc640 1 --2- 172.21.15.6:0/2512419223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72ac0047d0 0x7f72ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.266+0000 7f72be7fc640 1 --2- 172.21.15.6:0/2512419223 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72c00d0250 0x7f72ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.266+0000 7f72be7fc640 1 -- 172.21.15.6:0/2512419223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00d2ca0 con 0x7f72ac0039b0 2023-07-21T22:34:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.266+0000 7f72be7fc640 1 -- 172.21.15.6:0/2512419223 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac00bac0 con 0x7f72ac0047d0 2023-07-21T22:34:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.266+0000 7f72be7fc640 1 -- 172.21.15.6:0/2512419223 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac00bc80 con 0x7f72c00d0250 2023-07-21T22:34:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.266+0000 7f72beffd640 1 --2- 172.21.15.6:0/2512419223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0039b0 0x7f72ac003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.266+0000 7f72b67fc640 1 --2- 172.21.15.6:0/2512419223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72ac0047d0 0x7f72ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.266+0000 7f72bf7fe640 1 --2- 172.21.15.6:0/2512419223 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72c00d0250 0x7f72ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.266+0000 7f72beffd640 1 -- 172.21.15.6:0/2512419223 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72c00d0250 msgr2=0x7f72ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.266+0000 7f72beffd640 1 --2- 172.21.15.6:0/2512419223 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72c00d0250 0x7f72ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.266+0000 7f72beffd640 1 -- 172.21.15.6:0/2512419223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72ac0047d0 msgr2=0x7f72ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.266+0000 7f72beffd640 1 --2- 172.21.15.6:0/2512419223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72ac0047d0 0x7f72ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.266+0000 7f72beffd640 1 -- 172.21.15.6:0/2512419223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac003530 con 0x7f72ac0039b0 2023-07-21T22:34:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.266+0000 7f72b67fc640 1 --2- 172.21.15.6:0/2512419223 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72ac0047d0 0x7f72ac004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.266+0000 7f72beffd640 1 --2- 172.21.15.6:0/2512419223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0039b0 0x7f72ac003dc0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f72b000c240 tx=0x7f72b001cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2564153b05f60c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.266+0000 7f72be7fc640 1 -- 172.21.15.6:0/2512419223 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0005ae0 con 0x7f72ac0039b0 2023-07-21T22:34:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.266+0000 7f72be7fc640 1 -- 172.21.15.6:0/2512419223 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b0005c60 con 0x7f72ac0039b0 2023-07-21T22:34:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.266+0000 7f72be7fc640 1 -- 172.21.15.6:0/2512419223 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0007070 con 0x7f72ac0039b0 2023-07-21T22:34:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.270+0000 7f72c5448640 1 -- 172.21.15.6:0/2512419223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0039b0 msgr2=0x7f72ac003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.270+0000 7f72c5448640 1 --2- 172.21.15.6:0/2512419223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0039b0 0x7f72ac003dc0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f72b000c240 tx=0x7f72b001cb50 comp rx=0 tx=0).stop 2023-07-21T22:34:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.270+0000 7f72bf7fe640 1 -- 172.21.15.6:0/2512419223 reap_dead start 2023-07-21T22:34:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.270+0000 7f72c5448640 1 -- 172.21.15.6:0/2512419223 shutdown_connections 2023-07-21T22:34:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.270+0000 7f72c5448640 1 -- 172.21.15.6:0/2512419223 >> 172.21.15.6:0/2512419223 conn(0x7f72c00659d0 msgr2=0x7f72c009b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.270+0000 7f72c5448640 1 -- 172.21.15.6:0/2512419223 shutdown_connections 2023-07-21T22:34:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.270+0000 7f72c5448640 1 -- 172.21.15.6:0/2512419223 wait complete. 2023-07-21T22:34:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.270+0000 7f72c5448640 1 Processor -- start 2023-07-21T22:34:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.270+0000 7f72c5448640 1 -- start start 2023-07-21T22:34:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.270+0000 7f72c5448640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0039b0 0x7f72c0154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.270+0000 7f72c5448640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72c0153130 0x7f72c01f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.270+0000 7f72c5448640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72c00b5f70 0x7f72c0157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.270+0000 7f72c5448640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c0155300 con 0x7f72ac0039b0 2023-07-21T22:34:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.270+0000 7f72c5448640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c015a200 con 0x7f72c00b5f70 2023-07-21T22:34:33.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.270+0000 7f72c5448640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c01595f0 con 0x7f72c0153130 2023-07-21T22:34:33.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.270+0000 7f72beffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0039b0 0x7f72c0154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:33.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.270+0000 7f72beffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0039b0 0x7f72c0154020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54196/0 (socket says 172.21.15.6:54196) 2023-07-21T22:34:33.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.270+0000 7f72beffd640 1 -- 172.21.15.6:0/4091891633 learned_addr learned my addr 172.21.15.6:0/4091891633 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:33.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.270+0000 7f72b67fc640 1 --2- 172.21.15.6:0/4091891633 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72c0153130 0x7f72c01f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:33.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.270+0000 7f72bf7fe640 1 --2- 172.21.15.6:0/4091891633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72c00b5f70 0x7f72c0157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:33.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.274+0000 7f72beffd640 1 -- 172.21.15.6:0/4091891633 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72c0153130 msgr2=0x7f72c01f3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:33.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.274+0000 7f72beffd640 1 --2- 172.21.15.6:0/4091891633 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72c0153130 0x7f72c01f3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.274+0000 7f72beffd640 1 -- 172.21.15.6:0/4091891633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72c00b5f70 msgr2=0x7f72c0157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:33.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.274+0000 7f72beffd640 1 --2- 172.21.15.6:0/4091891633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72c00b5f70 0x7f72c0157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.274+0000 7f72beffd640 1 -- 172.21.15.6:0/4091891633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c01598d0 con 0x7f72ac0039b0 2023-07-21T22:34:33.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.274+0000 7f72beffd640 1 --2- 172.21.15.6:0/4091891633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0039b0 0x7f72c0154020 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f72b001c980 tx=0x7f72ac005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:33.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.274+0000 7f72b7fff640 1 -- 172.21.15.6:0/4091891633 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b00b4070 con 0x7f72ac0039b0 2023-07-21T22:34:33.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.274+0000 7f72b7fff640 1 -- 172.21.15.6:0/4091891633 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b0005dd0 con 0x7f72ac0039b0 2023-07-21T22:34:33.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.274+0000 7f72c5448640 1 -- 172.21.15.6:0/4091891633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c0159bb0 con 0x7f72ac0039b0 2023-07-21T22:34:33.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.274+0000 7f72b7fff640 1 -- 172.21.15.6:0/4091891633 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0001810 con 0x7f72ac0039b0 2023-07-21T22:34:33.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.274+0000 7f72c5448640 1 -- 172.21.15.6:0/4091891633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c01f4420 con 0x7f72ac0039b0 2023-07-21T22:34:33.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.274+0000 7f72c5448640 1 -- 172.21.15.6:0/4091891633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c00678d0 con 0x7f72ac0039b0 2023-07-21T22:34:33.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.274+0000 7f72b7fff640 1 -- 172.21.15.6:0/4091891633 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f72b00a5740 con 0x7f72ac0039b0 2023-07-21T22:34:33.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.274+0000 7f72b7fff640 1 --2- 172.21.15.6:0/4091891633 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f72a00663a0 0x7f72a0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:33.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.274+0000 7f72b7fff640 1 -- 172.21.15.6:0/4091891633 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f72b011d6a0 con 0x7f72ac0039b0 2023-07-21T22:34:33.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.278+0000 7f72b67fc640 1 --2- 172.21.15.6:0/4091891633 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f72a00663a0 0x7f72a0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:33.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.278+0000 7f72b67fc640 1 --2- 172.21.15.6:0/4091891633 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f72a00663a0 0x7f72a0068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f72c0158cb0 tx=0x7f72a8008040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:33.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.278+0000 7f72b7fff640 1 -- 172.21.15.6:0/4091891633 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72b00eaa80 con 0x7f72ac0039b0 2023-07-21T22:34:33.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.490+0000 7f72c5448640 1 -- 172.21.15.6:0/4091891633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f72c00d0aa0 con 0x7f72ac0039b0 2023-07-21T22:34:33.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.494+0000 7f72b7fff640 1 -- 172.21.15.6:0/4091891633 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7f72c00d0aa0 con 0x7f72ac0039b0 2023-07-21T22:34:33.544 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-07-21T22:34:33.545 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA== 2023-07-21T22:34:33.545 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2023-07-21T22:34:33.545 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2023-07-21T22:34:33.545 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-21T22:34:33.546 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-07-21T22:34:33.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.494+0000 7f72c5448640 1 -- 172.21.15.6:0/4091891633 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f72a00663a0 msgr2=0x7f72a0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.494+0000 7f72c5448640 1 --2- 172.21.15.6:0/4091891633 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f72a00663a0 0x7f72a0068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f72c0158cb0 tx=0x7f72a8008040 comp rx=0 tx=0).stop 2023-07-21T22:34:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.494+0000 7f72c5448640 1 -- 172.21.15.6:0/4091891633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0039b0 msgr2=0x7f72c0154020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.494+0000 7f72c5448640 1 --2- 172.21.15.6:0/4091891633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0039b0 0x7f72c0154020 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f72b001c980 tx=0x7f72ac005800 comp rx=0 tx=0).stop 2023-07-21T22:34:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.494+0000 7f72c5448640 1 -- 172.21.15.6:0/4091891633 shutdown_connections 2023-07-21T22:34:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.494+0000 7f72c5448640 1 --2- 172.21.15.6:0/4091891633 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f72a00663a0 0x7f72a0068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.494+0000 7f72c5448640 1 --2- 172.21.15.6:0/4091891633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72c00b5f70 0x7f72c0157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.494+0000 7f72c5448640 1 --2- 172.21.15.6:0/4091891633 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72c0153130 0x7f72c01f3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.494+0000 7f72c5448640 1 --2- 172.21.15.6:0/4091891633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0039b0 0x7f72c0154020 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.494+0000 7f72c5448640 1 -- 172.21.15.6:0/4091891633 >> 172.21.15.6:0/4091891633 conn(0x7f72c00659d0 msgr2=0x7f72c015f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:33.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.494+0000 7f72c5448640 1 -- 172.21.15.6:0/4091891633 shutdown_connections 2023-07-21T22:34:33.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.494+0000 7f72c5448640 1 -- 172.21.15.6:0/4091891633 wait complete. 2023-07-21T22:34:33.565 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:34:33.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.662+0000 7ff405296640 1 Processor -- start 2023-07-21T22:34:33.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.662+0000 7ff405296640 1 -- start start 2023-07-21T22:34:33.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.662+0000 7ff405296640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40015bc00 0x7ff4000ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:33.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.662+0000 7ff405296640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff400160450 0x7ff40006e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:33.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.662+0000 7ff405296640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4000c9c30 con 0x7ff400069430 2023-07-21T22:34:33.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.662+0000 7ff405296640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4000c96b0 con 0x7ff400160450 2023-07-21T22:34:33.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.662+0000 7ff405296640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40015bfd0 con 0x7ff40015bc00 2023-07-21T22:34:33.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.662+0000 7ff3f7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff400160450 0x7ff40006e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:33.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.662+0000 7ff3ff7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff400069430 0x7ff4000702c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54564/0 (socket says 172.21.15.6:54564) 2023-07-21T22:34:33.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.662+0000 7ff3ff7fe640 1 -- 172.21.15.6:0/912102701 learned_addr learned my addr 172.21.15.6:0/912102701 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:33.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.662+0000 7ff3feffd640 1 --2- 172.21.15.6:0/912102701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40015bc00 0x7ff4000ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:33.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.662+0000 7ff3f7fff640 1 -- 172.21.15.6:0/912102701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40015bc00 msgr2=0x7ff4000ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:33.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.662+0000 7ff3f7fff640 1 --2- 172.21.15.6:0/912102701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40015bc00 0x7ff4000ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.662+0000 7ff3f7fff640 1 -- 172.21.15.6:0/912102701 >> v1:172.21.15.6:6789/0 conn(0x7ff400069430 legacy=0x7ff4000702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:33.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.662+0000 7ff3f7fff640 1 -- 172.21.15.6:0/912102701 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4000cee30 con 0x7ff400160450 2023-07-21T22:34:33.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.662+0000 7ff3fe7fc640 1 -- 172.21.15.6:0/912102701 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938794248 0 0) 0x7ff4000c9c30 con 0x7ff400069430 2023-07-21T22:34:33.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.666+0000 7ff3f7fff640 1 --2- 172.21.15.6:0/912102701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff400160450 0x7ff40006e690 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80097c0 tx=0x7ff3e801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed52b723eda421fa server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:33.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.666+0000 7ff3fe7fc640 1 -- 172.21.15.6:0/912102701 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80ab650 con 0x7ff400160450 2023-07-21T22:34:33.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.666+0000 7ff3fe7fc640 1 -- 172.21.15.6:0/912102701 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e80ab7b0 con 0x7ff400160450 2023-07-21T22:34:33.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.666+0000 7ff3fe7fc640 1 -- 172.21.15.6:0/912102701 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80abb40 con 0x7ff400160450 2023-07-21T22:34:33.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.666+0000 7ff405296640 1 -- 172.21.15.6:0/912102701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff400160450 msgr2=0x7ff40006e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:33.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.666+0000 7ff405296640 1 --2- 172.21.15.6:0/912102701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff400160450 0x7ff40006e690 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80097c0 tx=0x7ff3e801c450 comp rx=0 tx=0).stop 2023-07-21T22:34:33.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.666+0000 7ff405296640 1 -- 172.21.15.6:0/912102701 shutdown_connections 2023-07-21T22:34:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.666+0000 7ff405296640 1 --2- 172.21.15.6:0/912102701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff400160450 0x7ff40006e690 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.666+0000 7ff405296640 1 --2- 172.21.15.6:0/912102701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff40015bc00 0x7ff4000ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.666+0000 7ff405296640 1 -- 172.21.15.6:0/912102701 >> 172.21.15.6:0/912102701 conn(0x7ff4000b1840 msgr2=0x7ff4000cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.666+0000 7ff405296640 1 -- 172.21.15.6:0/912102701 shutdown_connections 2023-07-21T22:34:33.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.666+0000 7ff405296640 1 -- 172.21.15.6:0/912102701 wait complete. 2023-07-21T22:34:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.666+0000 7ff405296640 1 Processor -- start 2023-07-21T22:34:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.666+0000 7ff405296640 1 -- start start 2023-07-21T22:34:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff405296640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff400069430 0x7ff40006c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff405296640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40015bc00 0x7ff40006cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff405296640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff400160450 0x7ff4000c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:33.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff405296640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4000b1f20 con 0x7ff40015bc00 2023-07-21T22:34:33.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff405296640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4000c79a0 con 0x7ff400160450 2023-07-21T22:34:33.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff405296640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4000c8800 con 0x7ff400069430 2023-07-21T22:34:33.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff3f7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40015bc00 0x7ff40006cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:33.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff3f7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40015bc00 0x7ff40006cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54218/0 (socket says 172.21.15.6:54218) 2023-07-21T22:34:33.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff3f7fff640 1 -- 172.21.15.6:0/2218385944 learned_addr learned my addr 172.21.15.6:0/2218385944 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:33.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff3f7fff640 1 -- 172.21.15.6:0/2218385944 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff400069430 msgr2=0x7ff40006c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:33.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff3f7fff640 1 --2- 172.21.15.6:0/2218385944 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff400069430 0x7ff40006c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff3f7fff640 1 -- 172.21.15.6:0/2218385944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff400160450 msgr2=0x7ff4000c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:33.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff3ff7fe640 1 --2- 172.21.15.6:0/2218385944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff400160450 0x7ff4000c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:33.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff3f7fff640 1 --2- 172.21.15.6:0/2218385944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff400160450 0x7ff4000c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff3f7fff640 1 -- 172.21.15.6:0/2218385944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e8009420 con 0x7ff40015bc00 2023-07-21T22:34:33.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff3ff7fe640 1 --2- 172.21.15.6:0/2218385944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff400160450 0x7ff4000c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:33.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff3f7fff640 1 --2- 172.21.15.6:0/2218385944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40015bc00 0x7ff40006cf10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80ad040 tx=0x7ff3e801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:33.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff3f77fe640 1 -- 172.21.15.6:0/2218385944 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80bf610 con 0x7ff40015bc00 2023-07-21T22:34:33.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff3f77fe640 1 -- 172.21.15.6:0/2218385944 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e80bf790 con 0x7ff40015bc00 2023-07-21T22:34:33.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff3f77fe640 1 -- 172.21.15.6:0/2218385944 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80bfb40 con 0x7ff40015bc00 2023-07-21T22:34:33.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff405296640 1 -- 172.21.15.6:0/2218385944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4000c7bf0 con 0x7ff40015bc00 2023-07-21T22:34:33.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff405296640 1 -- 172.21.15.6:0/2218385944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4000c81b0 con 0x7ff40015bc00 2023-07-21T22:34:33.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.670+0000 7ff405296640 1 -- 172.21.15.6:0/2218385944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4000678d0 con 0x7ff40015bc00 2023-07-21T22:34:33.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.674+0000 7ff3f77fe640 1 -- 172.21.15.6:0/2218385944 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff3e80b5400 con 0x7ff40015bc00 2023-07-21T22:34:33.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.674+0000 7ff3f77fe640 1 --2- 172.21.15.6:0/2218385944 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ff3e00663a0 0x7ff3e0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:33.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.674+0000 7ff3f77fe640 1 -- 172.21.15.6:0/2218385944 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6106+0+0 (secure 0 0 0) 0x7ff3e811ec50 con 0x7ff40015bc00 2023-07-21T22:34:33.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.674+0000 7ff3feffd640 1 --2- 172.21.15.6:0/2218385944 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ff3e00663a0 0x7ff3e0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:33.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.674+0000 7ff3feffd640 1 --2- 172.21.15.6:0/2218385944 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ff3e00663a0 0x7ff3e0068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00098f0 tx=0x7ff3f0008040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:33.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.678+0000 7ff3f77fe640 1 -- 172.21.15.6:0/2218385944 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff3e80ebef0 con 0x7ff40015bc00 2023-07-21T22:34:33.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.866+0000 7ff405296640 1 -- 172.21.15.6:0/2218385944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4000c8970 con 0x7ff40015bc00 2023-07-21T22:34:33.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.866+0000 7ff3f77fe640 1 -- 172.21.15.6:0/2218385944 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4666 (secure 0 0 0) 0x7ff3e80ef510 con 0x7ff40015bc00 2023-07-21T22:34:33.917 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:33.917 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5960,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1945082031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1945082031},{"type":"v1","addr":"172.21.15.6:6835","nonce":1945082031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5963,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/778272832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":778272832},{"type":"v1","addr":"172.21.15.161:6836","nonce":778272832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/728409440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":728409440},{"type":"v1","addr":"172.21.15.161:6837","nonce":728409440}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:34:23.355700+0000","modified":"2023-07-21T22:34:26.993451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6585},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6585":{"gid":6585,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/1769681869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1769681869},{"type":"v1","addr":"172.21.15.6:6833","nonce":1769681869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-21T22:34:33.917 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 32 2023-07-21T22:34:33.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.866+0000 7ff405296640 1 -- 172.21.15.6:0/2218385944 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ff3e00663a0 msgr2=0x7ff3e0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:33.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.866+0000 7ff405296640 1 --2- 172.21.15.6:0/2218385944 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ff3e00663a0 0x7ff3e0068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00098f0 tx=0x7ff3f0008040 comp rx=0 tx=0).stop 2023-07-21T22:34:33.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.866+0000 7ff405296640 1 -- 172.21.15.6:0/2218385944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40015bc00 msgr2=0x7ff40006cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:33.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.866+0000 7ff405296640 1 --2- 172.21.15.6:0/2218385944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40015bc00 0x7ff40006cf10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80ad040 tx=0x7ff3e801ac90 comp rx=0 tx=0).stop 2023-07-21T22:34:33.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.866+0000 7ff405296640 1 -- 172.21.15.6:0/2218385944 shutdown_connections 2023-07-21T22:34:33.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.866+0000 7ff405296640 1 --2- 172.21.15.6:0/2218385944 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7ff3e00663a0 0x7ff3e0068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.866+0000 7ff405296640 1 --2- 172.21.15.6:0/2218385944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff400160450 0x7ff4000c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.866+0000 7ff405296640 1 --2- 172.21.15.6:0/2218385944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff40015bc00 0x7ff40006cf10 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.866+0000 7ff405296640 1 --2- 172.21.15.6:0/2218385944 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff400069430 0x7ff40006c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:33.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.866+0000 7ff405296640 1 -- 172.21.15.6:0/2218385944 >> 172.21.15.6:0/2218385944 conn(0x7ff4000b1840 msgr2=0x7ff4000cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:33.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.866+0000 7ff405296640 1 -- 172.21.15.6:0/2218385944 shutdown_connections 2023-07-21T22:34:33.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:33.866+0000 7ff405296640 1 -- 172.21.15.6:0/2218385944 wait complete. 2023-07-21T22:34:34.340 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T22:34:23.355700+0000', 'modified': '2023-07-21T22:34:26.993451+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6585}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6585': {'gid': 6585, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6833/1769681869', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 1769681869}, {'type': 'v1', 'addr': '172.21.15.6:6833', 'nonce': 1769681869}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T22:34:34.340 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T22:34:34.341 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-21T22:34:34.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.438+0000 7f6849a9c640 1 Processor -- start 2023-07-21T22:34:34.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.438+0000 7f6849a9c640 1 -- start start 2023-07-21T22:34:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.438+0000 7f6849a9c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f684415bdf0 0x7f68440ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.438+0000 7f6849a9c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f68440c9e80 0x7f684415fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.438+0000 7f6849a9c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6844160330 con 0x7f684415f970 2023-07-21T22:34:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.438+0000 7f6849a9c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68440cb2e0 con 0x7f68440c9e80 2023-07-21T22:34:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.438+0000 7f6849a9c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68440cb5c0 con 0x7f684415bdf0 2023-07-21T22:34:34.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.438+0000 7f6842ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f684415f970 0x7f684406b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54572/0 (socket says 172.21.15.6:54572) 2023-07-21T22:34:34.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.442+0000 7f6842ffd640 1 -- 172.21.15.6:0/1900820759 learned_addr learned my addr 172.21.15.6:0/1900820759 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:34.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.442+0000 7f6843fff640 1 --2- 172.21.15.6:0/1900820759 >> v2:172.21.15.6:3300/0 conn(0x7f68440c9e80 0x7f684415fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.442+0000 7f68437fe640 1 --2- 172.21.15.6:0/1900820759 >> v2:172.21.15.161:3300/0 conn(0x7f684415bdf0 0x7f68440ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.442+0000 7f6843fff640 1 -- 172.21.15.6:0/1900820759 >> v2:172.21.15.161:3300/0 conn(0x7f684415bdf0 msgr2=0x7f68440ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:34.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.442+0000 7f6843fff640 1 --2- 172.21.15.6:0/1900820759 >> v2:172.21.15.161:3300/0 conn(0x7f684415bdf0 0x7f68440ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.442+0000 7f6843fff640 1 -- 172.21.15.6:0/1900820759 >> v1:172.21.15.6:6789/0 conn(0x7f684415f970 legacy=0x7f684406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:34.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.442+0000 7f6843fff640 1 -- 172.21.15.6:0/1900820759 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68440cb8a0 con 0x7f68440c9e80 2023-07-21T22:34:34.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.442+0000 7f68427fc640 1 -- 172.21.15.6:0/1900820759 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609335269 0 0) 0x7f6838001120 con 0x7f684415f970 2023-07-21T22:34:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.442+0000 7f6843fff640 1 --2- 172.21.15.6:0/1900820759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68440c9e80 0x7f684415fdf0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f684406a7c0 tx=0x7f683c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5553c9cf8a7ee29a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.442+0000 7f68427fc640 1 -- 172.21.15.6:0/1900820759 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c0a5850 con 0x7f68440c9e80 2023-07-21T22:34:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.442+0000 7f68427fc640 1 -- 172.21.15.6:0/1900820759 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683c0a59b0 con 0x7f68440c9e80 2023-07-21T22:34:34.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.442+0000 7f68427fc640 1 -- 172.21.15.6:0/1900820759 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c0a5d40 con 0x7f68440c9e80 2023-07-21T22:34:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6849a9c640 1 -- 172.21.15.6:0/1900820759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68440c9e80 msgr2=0x7f684415fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6849a9c640 1 --2- 172.21.15.6:0/1900820759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68440c9e80 0x7f684415fdf0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f684406a7c0 tx=0x7f683c01c850 comp rx=0 tx=0).stop 2023-07-21T22:34:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6849a9c640 1 -- 172.21.15.6:0/1900820759 shutdown_connections 2023-07-21T22:34:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6849a9c640 1 --2- 172.21.15.6:0/1900820759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68440c9e80 0x7f684415fdf0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6849a9c640 1 --2- 172.21.15.6:0/1900820759 >> v2:172.21.15.161:3300/0 conn(0x7f684415bdf0 0x7f68440ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6849a9c640 1 -- 172.21.15.6:0/1900820759 >> 172.21.15.6:0/1900820759 conn(0x7f68440afcf0 msgr2=0x7f68440b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:34.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6849a9c640 1 -- 172.21.15.6:0/1900820759 shutdown_connections 2023-07-21T22:34:34.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6849a9c640 1 -- 172.21.15.6:0/1900820759 wait complete. 2023-07-21T22:34:34.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6849a9c640 1 Processor -- start 2023-07-21T22:34:34.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6849a9c640 1 -- start start 2023-07-21T22:34:34.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6849a9c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f684415bdf0 0x7f684414f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6849a9c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f684415f970 0x7f684415a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6849a9c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f684415abc0 0x7f6844156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6849a9c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68440c2bb0 con 0x7f684415abc0 2023-07-21T22:34:34.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6849a9c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68440c53d0 con 0x7f684415bdf0 2023-07-21T22:34:34.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6849a9c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68440c1c50 con 0x7f684415f970 2023-07-21T22:34:34.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6843fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f684415abc0 0x7f6844156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6843fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f684415abc0 0x7f6844156930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54242/0 (socket says 172.21.15.6:54242) 2023-07-21T22:34:34.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6843fff640 1 -- 172.21.15.6:0/3661723280 learned_addr learned my addr 172.21.15.6:0/3661723280 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:34.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6843fff640 1 -- 172.21.15.6:0/3661723280 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f684415f970 msgr2=0x7f684415a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:34.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6843fff640 1 --2- 172.21.15.6:0/3661723280 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f684415f970 0x7f684415a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6843fff640 1 -- 172.21.15.6:0/3661723280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f684415bdf0 msgr2=0x7f684414f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:34.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6843fff640 1 --2- 172.21.15.6:0/3661723280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f684415bdf0 0x7f684414f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.446+0000 7f6843fff640 1 -- 172.21.15.6:0/3661723280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683c009a70 con 0x7f684415abc0 2023-07-21T22:34:34.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.450+0000 7f6843fff640 1 --2- 172.21.15.6:0/3661723280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f684415abc0 0x7f6844156930 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f683c0b0040 tx=0x7f683c0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:34.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.450+0000 7f682bfff640 1 -- 172.21.15.6:0/3661723280 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c0b9860 con 0x7f684415abc0 2023-07-21T22:34:34.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.450+0000 7f682bfff640 1 -- 172.21.15.6:0/3661723280 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683c0b99c0 con 0x7f684415abc0 2023-07-21T22:34:34.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.450+0000 7f682bfff640 1 -- 172.21.15.6:0/3661723280 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c0b9d50 con 0x7f684415abc0 2023-07-21T22:34:34.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.450+0000 7f6849a9c640 1 -- 172.21.15.6:0/3661723280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68440c1f30 con 0x7f684415abc0 2023-07-21T22:34:34.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.450+0000 7f6849a9c640 1 -- 172.21.15.6:0/3661723280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68440c24f0 con 0x7f684415abc0 2023-07-21T22:34:34.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.450+0000 7f682bfff640 1 -- 172.21.15.6:0/3661723280 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f683c0ad440 con 0x7f684415abc0 2023-07-21T22:34:34.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f682bfff640 1 --2- 172.21.15.6:0/3661723280 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f68300663d0 0x7f6830068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f682bfff640 1 -- 172.21.15.6:0/3661723280 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f683c11ed00 con 0x7f684415abc0 2023-07-21T22:34:34.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f68437fe640 1 --2- 172.21.15.6:0/3661723280 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f68300663d0 0x7f6830068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f684ce0c000 1 Processor -- start 2023-07-21T22:34:34.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f684ce0c000 1 -- start start 2023-07-21T22:34:34.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f68437fe640 1 --2- 172.21.15.6:0/3661723280 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f68300663d0 0x7f6830068880 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6844158f90 tx=0x7f6834008040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:34.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f684ce0c000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x559db266bf00 0x559db266c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f684ce0c000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db2622370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f684ce0c000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db26228b0 0x559db2622c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f684ce0c000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db24e9880 con 0x559db266c810 2023-07-21T22:34:34.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f684ce0c000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db2423840 con 0x559db26228b0 2023-07-21T22:34:34.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f684ce0c000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x559db24772e0 con 0x559db266bf00 2023-07-21T22:34:34.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f6842ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db2622370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f6842ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db2622370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54246/0 (socket says 172.21.15.6:54246) 2023-07-21T22:34:34.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f6842ffd640 1 -- 172.21.15.6:0/1302220248 learned_addr learned my addr 172.21.15.6:0/1302220248 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:34.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f68437fe640 1 --2- 172.21.15.6:0/1302220248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x559db266bf00 0x559db266c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f6843fff640 1 --2- 172.21.15.6:0/1302220248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db26228b0 0x559db2622c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f6842ffd640 1 -- 172.21.15.6:0/1302220248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x559db266bf00 msgr2=0x559db266c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:34.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f6842ffd640 1 --2- 172.21.15.6:0/1302220248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x559db266bf00 0x559db266c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f6842ffd640 1 -- 172.21.15.6:0/1302220248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db26228b0 msgr2=0x559db2622c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:34.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f6842ffd640 1 --2- 172.21.15.6:0/1302220248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db26228b0 0x559db2622c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f6842ffd640 1 -- 172.21.15.6:0/1302220248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559db216c890 con 0x559db266c810 2023-07-21T22:34:34.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f6842ffd640 1 --2- 172.21.15.6:0/1302220248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db2622370 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f68380015b0 tx=0x7f6838001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3edda4fd97b22f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:34.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f6829ffb640 1 -- 172.21.15.6:0/1302220248 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68380072d0 con 0x559db266c810 2023-07-21T22:34:34.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f6829ffb640 1 -- 172.21.15.6:0/1302220248 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6838007430 con 0x559db266c810 2023-07-21T22:34:34.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f6829ffb640 1 -- 172.21.15.6:0/1302220248 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68380047f0 con 0x559db266c810 2023-07-21T22:34:34.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f684ce0c000 1 -- 172.21.15.6:0/1302220248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 msgr2=0x559db2622370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:34.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.454+0000 7f684ce0c000 1 --2- 172.21.15.6:0/1302220248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db2622370 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f68380015b0 tx=0x7f6838001a70 comp rx=0 tx=0).stop 2023-07-21T22:34:34.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 1 -- 172.21.15.6:0/1302220248 shutdown_connections 2023-07-21T22:34:34.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 1 --2- 172.21.15.6:0/1302220248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db26228b0 0x559db2622c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 1 --2- 172.21.15.6:0/1302220248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db2622370 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 1 --2- 172.21.15.6:0/1302220248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x559db266bf00 0x559db266c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 1 -- 172.21.15.6:0/1302220248 >> 172.21.15.6:0/1302220248 conn(0x559db2628a10 msgr2=0x559db2620c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:34.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 1 -- 172.21.15.6:0/1302220248 shutdown_connections 2023-07-21T22:34:34.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 1 -- 172.21.15.6:0/1302220248 wait complete. 2023-07-21T22:34:34.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 1 -- start start 2023-07-21T22:34:34.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 1 Processor -- start 2023-07-21T22:34:34.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x559db26228b0 0x559db2672e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db266bf00 0x559db2673390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db262d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db2470380 con 0x559db266c810 2023-07-21T22:34:34.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db242cae0 con 0x559db266bf00 2023-07-21T22:34:34.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x559db242c780 con 0x559db26228b0 2023-07-21T22:34:34.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 10 client.0 _ll_register_callbacks cb 0x559db260e240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:34:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f6843fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db262d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f6843fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db262d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54260/0 (socket says 172.21.15.6:54260) 2023-07-21T22:34:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f6842ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db266bf00 0x559db2673390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f68437fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x559db26228b0 0x559db2672e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f6843fff640 1 -- 172.21.15.6:0/651397834 learned_addr learned my addr 172.21.15.6:0/651397834 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f6843fff640 1 -- 172.21.15.6:0/651397834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x559db26228b0 msgr2=0x559db2672e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f6843fff640 1 --2- 172.21.15.6:0/651397834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x559db26228b0 0x559db2672e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f6843fff640 1 -- 172.21.15.6:0/651397834 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db266bf00 msgr2=0x559db2673390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:34.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f6843fff640 1 --2- 172.21.15.6:0/651397834 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db266bf00 0x559db2673390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f6843fff640 1 -- 172.21.15.6:0/651397834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6838001210 con 0x559db266c810 2023-07-21T22:34:34.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f6842ffd640 1 --2- 172.21.15.6:0/651397834 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db266bf00 0x559db2673390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:34.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f6843fff640 1 --2- 172.21.15.6:0/651397834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db262d4f0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f683c01c890 tx=0x7f683c0f80f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb0c0bdf3b94efa server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:34.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f68227fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:34:34.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f68227fc640 1 -- 172.21.15.6:0/651397834 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c0ef350 con 0x559db266c810 2023-07-21T22:34:34.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 1 -- 172.21.15.6:0/651397834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559db2437a20 con 0x559db266c810 2023-07-21T22:34:34.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f68227fc640 1 -- 172.21.15.6:0/651397834 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f683c0f7b20 con 0x559db266c810 2023-07-21T22:34:34.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f68227fc640 1 -- 172.21.15.6:0/651397834 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f683c0f7ce0 con 0x559db266c810 2023-07-21T22:34:34.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 10 client.6756 fetch_fsmap learned FSMap version 32 2023-07-21T22:34:34.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 1 -- 172.21.15.6:0/651397834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x559db2434d10 con 0x559db266c810 2023-07-21T22:34:34.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f68227fc640 1 -- 172.21.15.6:0/651397834 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559db2437a20 con 0x559db266c810 2023-07-21T22:34:34.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f68227fc640 1 -- 172.21.15.6:0/651397834 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 32) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f683c005d20 con 0x559db266c810 2023-07-21T22:34:34.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 10 client.6756 fetch_fsmap finished waiting for FSMap version 32 2023-07-21T22:34:34.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 10 client.6756 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-21T22:34:34.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 20 client.6756 populate_metadata read hostname 'smithi006' 2023-07-21T22:34:34.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 1 --2- 172.21.15.6:0/651397834 >> [v2:172.21.15.6:6832/1769681869,v1:172.21.15.6:6833/1769681869] conn(0x559db262df00 0x559db262e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 4 client.6756 mds_command: new command op to 6585 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:34:34.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.458+0000 7f684ce0c000 1 -- 172.21.15.6:0/651397834 --> [v2:172.21.15.6:6832/1769681869,v1:172.21.15.6:6833/1769681869] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559db249eec0 con 0x559db262df00 2023-07-21T22:34:34.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.462+0000 7f68437fe640 1 --2- 172.21.15.6:0/651397834 >> [v2:172.21.15.6:6832/1769681869,v1:172.21.15.6:6833/1769681869] conn(0x559db262df00 0x559db262e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.462+0000 7f68437fe640 1 --2- 172.21.15.6:0/651397834 >> [v2:172.21.15.6:6832/1769681869,v1:172.21.15.6:6833/1769681869] conn(0x559db262df00 0x559db262e2d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=430e4c71b34178b0 server_cookie=4cb55dd27b712ba1 in_seq=0 out_seq=0 2023-07-21T22:34:34.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.462+0000 7f68227fc640 10 client.6756 ms_handle_connect on v2:172.21.15.6:6832/1769681869 2023-07-21T22:34:34.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.462+0000 7f68227fc640 1 -- 172.21.15.6:0/651397834 <== mds.0 v2:172.21.15.6:6832/1769681869 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559db249eec0 con 0x559db262df00 2023-07-21T22:34:34.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.462+0000 7f68227fc640 10 client.6756 handle_command_reply: tid=0 2023-07-21T22:34:34.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.462+0000 7f684ce0c000 1 client.6756 shutdown 2023-07-21T22:34:34.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.462+0000 7f684ce0c000 1 -- 172.21.15.6:0/651397834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 msgr2=0x559db262d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:34.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.462+0000 7f684ce0c000 1 --2- 172.21.15.6:0/651397834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db262d4f0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f683c01c890 tx=0x7f683c0f80f0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.462+0000 7f684ce0c000 1 -- 172.21.15.6:0/651397834 shutdown_connections 2023-07-21T22:34:34.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.462+0000 7f684ce0c000 1 --2- 172.21.15.6:0/651397834 >> [v2:172.21.15.6:6832/1769681869,v1:172.21.15.6:6833/1769681869] conn(0x559db262df00 0x559db262e2d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.462+0000 7f684ce0c000 1 --2- 172.21.15.6:0/651397834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db262d4f0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.462+0000 7f684ce0c000 1 --2- 172.21.15.6:0/651397834 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db266bf00 0x559db2673390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.462+0000 7f684ce0c000 1 --2- 172.21.15.6:0/651397834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x559db26228b0 0x559db2672e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.462+0000 7f684ce0c000 1 -- 172.21.15.6:0/651397834 >> 172.21.15.6:0/651397834 conn(0x559db2628a10 msgr2=0x559db2621350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:34.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.462+0000 7f68227fc640 0 client.6756 ms_handle_reset on v2:172.21.15.6:6832/1769681869 2023-07-21T22:34:34.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.462+0000 7f684ce0c000 1 -- 172.21.15.6:0/651397834 shutdown_connections 2023-07-21T22:34:34.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.462+0000 7f684ce0c000 1 -- 172.21.15.6:0/651397834 wait complete. 2023-07-21T22:34:34.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.462+0000 7f684ce0c000 20 client.6756 trim_cache size 0 max 16384 2023-07-21T22:34:34.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f684ce0c000 1 Processor -- start 2023-07-21T22:34:34.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f684ce0c000 1 -- start start 2023-07-21T22:34:34.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f684ce0c000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db26228b0 0x559db26c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f684ce0c000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x559db266bf00 0x559db26c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f684ce0c000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db26c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f684ce0c000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db212d940 con 0x559db266c810 2023-07-21T22:34:34.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f684ce0c000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db2474380 con 0x559db26228b0 2023-07-21T22:34:34.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f684ce0c000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x559db246d780 con 0x559db266bf00 2023-07-21T22:34:34.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f6843fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db26c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f6843fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db26c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54276/0 (socket says 172.21.15.6:54276) 2023-07-21T22:34:34.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f6843fff640 1 -- 172.21.15.6:0/1509863195 learned_addr learned my addr 172.21.15.6:0/1509863195 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:34.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f68437fe640 1 --2- 172.21.15.6:0/1509863195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db26228b0 0x559db26c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f6842ffd640 1 --2- 172.21.15.6:0/1509863195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x559db266bf00 0x559db26c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f6843fff640 1 -- 172.21.15.6:0/1509863195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x559db266bf00 msgr2=0x559db26c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:34.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f6843fff640 1 --2- 172.21.15.6:0/1509863195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x559db266bf00 0x559db26c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f6843fff640 1 -- 172.21.15.6:0/1509863195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db26228b0 msgr2=0x559db26c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:34.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f6843fff640 1 --2- 172.21.15.6:0/1509863195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db26228b0 0x559db26c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f6843fff640 1 -- 172.21.15.6:0/1509863195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559db241afa0 con 0x559db266c810 2023-07-21T22:34:34.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f6843fff640 1 --2- 172.21.15.6:0/1509863195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db26c6130 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f683c0ec160 tx=0x7f683c0bb000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5abd6041259bbb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:34.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f682a7fc640 1 -- 172.21.15.6:0/1509863195 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c0ef7a0 con 0x559db266c810 2023-07-21T22:34:34.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f682a7fc640 1 -- 172.21.15.6:0/1509863195 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683c0f7b20 con 0x559db266c810 2023-07-21T22:34:34.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.478+0000 7f682a7fc640 1 -- 172.21.15.6:0/1509863195 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c0ef150 con 0x559db266c810 2023-07-21T22:34:34.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 -- 172.21.15.6:0/1509863195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 msgr2=0x559db26c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:34.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 --2- 172.21.15.6:0/1509863195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db26c6130 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f683c0ec160 tx=0x7f683c0bb000 comp rx=0 tx=0).stop 2023-07-21T22:34:34.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 -- 172.21.15.6:0/1509863195 shutdown_connections 2023-07-21T22:34:34.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 --2- 172.21.15.6:0/1509863195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db26c6130 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 --2- 172.21.15.6:0/1509863195 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x559db266bf00 0x559db26c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 --2- 172.21.15.6:0/1509863195 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db26228b0 0x559db26c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 -- 172.21.15.6:0/1509863195 >> 172.21.15.6:0/1509863195 conn(0x559db2628a10 msgr2=0x559db2627cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:34.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 -- 172.21.15.6:0/1509863195 shutdown_connections 2023-07-21T22:34:34.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 -- 172.21.15.6:0/1509863195 wait complete. 2023-07-21T22:34:34.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 -- start start 2023-07-21T22:34:34.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 Processor -- start 2023-07-21T22:34:34.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x559db26228b0 0x559db2670350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db266bf00 0x559db2670890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db2670dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db2418450 con 0x559db266c810 2023-07-21T22:34:34.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db26223d0 con 0x559db266bf00 2023-07-21T22:34:34.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x559db24382f0 con 0x559db26228b0 2023-07-21T22:34:34.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 10 client.0 _ll_register_callbacks cb 0x559db25ee430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:34:34.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f6843fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db2670dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f6843fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db2670dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54284/0 (socket says 172.21.15.6:54284) 2023-07-21T22:34:34.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f6843fff640 1 -- 172.21.15.6:0/2995235793 learned_addr learned my addr 172.21.15.6:0/2995235793 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:34.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f68437fe640 1 --2- 172.21.15.6:0/2995235793 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x559db26228b0 0x559db2670350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f6842ffd640 1 --2- 172.21.15.6:0/2995235793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db266bf00 0x559db2670890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f6843fff640 1 -- 172.21.15.6:0/2995235793 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x559db26228b0 msgr2=0x559db2670350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f6843fff640 1 --2- 172.21.15.6:0/2995235793 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x559db26228b0 0x559db2670350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f6843fff640 1 -- 172.21.15.6:0/2995235793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db266bf00 msgr2=0x559db2670890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f6843fff640 1 --2- 172.21.15.6:0/2995235793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db266bf00 0x559db2670890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f6843fff640 1 -- 172.21.15.6:0/2995235793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559db2434d10 con 0x559db266c810 2023-07-21T22:34:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f6842ffd640 1 --2- 172.21.15.6:0/2995235793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db266bf00 0x559db2670890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f6843fff640 1 --2- 172.21.15.6:0/2995235793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db2670dd0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f683c0f3ca0 tx=0x7f683c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a25cc4006737fa0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f68227fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:34:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f68227fc640 1 -- 172.21.15.6:0/2995235793 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c0ebcf0 con 0x559db266c810 2023-07-21T22:34:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f68227fc640 1 -- 172.21.15.6:0/2995235793 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f683c1070d0 con 0x559db266c810 2023-07-21T22:34:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 -- 172.21.15.6:0/2995235793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559db246ecd0 con 0x559db266c810 2023-07-21T22:34:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f68227fc640 1 -- 172.21.15.6:0/2995235793 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f683c0ec430 con 0x559db266c810 2023-07-21T22:34:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 10 client.6762 fetch_fsmap learned FSMap version 32 2023-07-21T22:34:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 -- 172.21.15.6:0/2995235793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x559db216ccc0 con 0x559db266c810 2023-07-21T22:34:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f68227fc640 1 -- 172.21.15.6:0/2995235793 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559db246ecd0 con 0x559db266c810 2023-07-21T22:34:34.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f68227fc640 1 -- 172.21.15.6:0/2995235793 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 32) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f683c1072d0 con 0x559db266c810 2023-07-21T22:34:34.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 10 client.6762 fetch_fsmap finished waiting for FSMap version 32 2023-07-21T22:34:34.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 10 client.6762 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-21T22:34:34.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 20 client.6762 populate_metadata read hostname 'smithi006' 2023-07-21T22:34:34.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 --2- 172.21.15.6:0/2995235793 >> [v2:172.21.15.6:6832/1769681869,v1:172.21.15.6:6833/1769681869] conn(0x559db2671790 0x559db26d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 4 client.6762 mds_command: new command op to 6585 tid=0[{"prefix": "status"}] 2023-07-21T22:34:34.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f684ce0c000 1 -- 172.21.15.6:0/2995235793 --> [v2:172.21.15.6:6832/1769681869,v1:172.21.15.6:6833/1769681869] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559db2469360 con 0x559db2671790 2023-07-21T22:34:34.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.482+0000 7f68437fe640 1 --2- 172.21.15.6:0/2995235793 >> [v2:172.21.15.6:6832/1769681869,v1:172.21.15.6:6833/1769681869] conn(0x559db2671790 0x559db26d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f68437fe640 1 --2- 172.21.15.6:0/2995235793 >> [v2:172.21.15.6:6832/1769681869,v1:172.21.15.6:6833/1769681869] conn(0x559db2671790 0x559db26d1940 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f70e9383dfc6a45 server_cookie=5da4e85f749570c2 in_seq=0 out_seq=0 2023-07-21T22:34:34.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f68227fc640 10 client.6762 ms_handle_connect on v2:172.21.15.6:6832/1769681869 2023-07-21T22:34:34.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f68227fc640 1 -- 172.21.15.6:0/2995235793 <== mds.0 v2:172.21.15.6:6832/1769681869 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x559db2469360 con 0x559db2671790 2023-07-21T22:34:34.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f68227fc640 10 client.6762 handle_command_reply: tid=0 2023-07-21T22:34:34.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f684ce0c000 1 client.6762 shutdown 2023-07-21T22:34:34.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f684ce0c000 1 -- 172.21.15.6:0/2995235793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 msgr2=0x559db2670dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:34.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f684ce0c000 1 --2- 172.21.15.6:0/2995235793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db2670dd0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f683c0f3ca0 tx=0x7f683c009580 comp rx=0 tx=0).stop 2023-07-21T22:34:34.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f684ce0c000 1 -- 172.21.15.6:0/2995235793 shutdown_connections 2023-07-21T22:34:34.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f684ce0c000 1 --2- 172.21.15.6:0/2995235793 >> [v2:172.21.15.6:6832/1769681869,v1:172.21.15.6:6833/1769681869] conn(0x559db2671790 0x559db26d1940 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f684ce0c000 1 --2- 172.21.15.6:0/2995235793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559db266c810 0x559db2670dd0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f684ce0c000 1 --2- 172.21.15.6:0/2995235793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x559db266bf00 0x559db2670890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f684ce0c000 1 --2- 172.21.15.6:0/2995235793 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x559db26228b0 0x559db2670350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f68227fc640 0 client.6762 ms_handle_reset on v2:172.21.15.6:6832/1769681869 2023-07-21T22:34:34.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f684ce0c000 1 -- 172.21.15.6:0/2995235793 >> 172.21.15.6:0/2995235793 conn(0x559db2628a10 msgr2=0x559db266a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:34.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f684ce0c000 1 -- 172.21.15.6:0/2995235793 shutdown_connections 2023-07-21T22:34:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f684ce0c000 1 -- 172.21.15.6:0/2995235793 wait complete. 2023-07-21T22:34:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f684ce0c000 20 client.6762 trim_cache size 0 max 16384 2023-07-21T22:34:34.546 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:34:34.546 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "f3073df4-6cd1-4503-bd2e-d3e98fa18bdf", 2023-07-21T22:34:34.546 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-07-21T22:34:34.547 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 6585, 2023-07-21T22:34:34.547 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-07-21T22:34:34.547 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-07-21T22:34:34.547 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-07-21T22:34:34.547 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.522575541, 2023-07-21T22:34:34.547 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 32, 2023-07-21T22:34:34.547 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 84, 2023-07-21T22:34:34.547 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 84, 2023-07-21T22:34:34.548 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 16.397047038 2023-07-21T22:34:34.548 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:34:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f6849a9c640 1 -- 172.21.15.6:0/3661723280 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f68300663d0 msgr2=0x7f6830068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f6849a9c640 1 --2- 172.21.15.6:0/3661723280 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f68300663d0 0x7f6830068880 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6844158f90 tx=0x7f6834008040 comp rx=0 tx=0).stop 2023-07-21T22:34:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f6849a9c640 1 -- 172.21.15.6:0/3661723280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f684415abc0 msgr2=0x7f6844156930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f6849a9c640 1 --2- 172.21.15.6:0/3661723280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f684415abc0 0x7f6844156930 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f683c0b0040 tx=0x7f683c0195f0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f6849a9c640 1 -- 172.21.15.6:0/3661723280 shutdown_connections 2023-07-21T22:34:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f6849a9c640 1 --2- 172.21.15.6:0/3661723280 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f68300663d0 0x7f6830068880 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f6849a9c640 1 --2- 172.21.15.6:0/3661723280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f684415abc0 0x7f6844156930 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f6849a9c640 1 --2- 172.21.15.6:0/3661723280 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f684415f970 0x7f684415a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f6849a9c640 1 --2- 172.21.15.6:0/3661723280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f684415bdf0 0x7f684414f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f6849a9c640 1 -- 172.21.15.6:0/3661723280 >> 172.21.15.6:0/3661723280 conn(0x7f68440afcf0 msgr2=0x7f684406b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f6849a9c640 1 -- 172.21.15.6:0/3661723280 shutdown_connections 2023-07-21T22:34:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.486+0000 7f6849a9c640 1 -- 172.21.15.6:0/3661723280 wait complete. 2023-07-21T22:34:34.556 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:34:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.650+0000 7f8c8b493640 1 Processor -- start 2023-07-21T22:34:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.650+0000 7f8c8b493640 1 -- start start 2023-07-21T22:34:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.650+0000 7f8c8b493640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8c840d0570 0x7f8c840afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.650+0000 7f8c8b493640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c840aee80 con 0x7f8c840ad6b0 2023-07-21T22:34:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.650+0000 7f8c8b493640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c840adde0 con 0x7f8c840cdcd0 2023-07-21T22:34:34.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.650+0000 7f8c8b493640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c840ae0c0 con 0x7f8c840d0570 2023-07-21T22:34:34.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.650+0000 7f8c88a2e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8c840ad6b0 0x7f8c840af640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54578/0 (socket says 172.21.15.6:54578) 2023-07-21T22:34:34.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.650+0000 7f8c88a2e640 1 -- 172.21.15.6:0/682775431 learned_addr learned my addr 172.21.15.6:0/682775431 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:34.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.650+0000 7f8c89a30640 1 --2- 172.21.15.6:0/682775431 >> v2:172.21.15.161:3300/0 conn(0x7f8c840d0570 0x7f8c840afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.654+0000 7f8c7bfff640 1 -- 172.21.15.6:0/682775431 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168229100 0 0) 0x7f8c840aee80 con 0x7f8c840ad6b0 2023-07-21T22:34:34.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.654+0000 7f8c7bfff640 1 -- 172.21.15.6:0/682775431 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c70003530 con 0x7f8c840ad6b0 2023-07-21T22:34:34.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.654+0000 7f8c89a30640 1 -- 172.21.15.6:0/682775431 >> v1:172.21.15.161:6789/0 conn(0x7f8c840cdcd0 legacy=0x7f8c840ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:34.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.654+0000 7f8c89a30640 1 -- 172.21.15.6:0/682775431 >> v1:172.21.15.6:6789/0 conn(0x7f8c840ad6b0 legacy=0x7f8c840af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:34.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.654+0000 7f8c89a30640 1 -- 172.21.15.6:0/682775431 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c840ae3a0 con 0x7f8c840d0570 2023-07-21T22:34:34.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.654+0000 7f8c89a30640 1 --2- 172.21.15.6:0/682775431 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c840d0570 0x7f8c840afd50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c009d90 tx=0x7f8c7c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=450a9dfa63e9e5ae server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:34.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.654+0000 7f8c7bfff640 1 -- 172.21.15.6:0/682775431 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c0a59e0 con 0x7f8c840d0570 2023-07-21T22:34:34.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.654+0000 7f8c7bfff640 1 -- 172.21.15.6:0/682775431 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7c0a5b40 con 0x7f8c840d0570 2023-07-21T22:34:34.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.654+0000 7f8c7bfff640 1 -- 172.21.15.6:0/682775431 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c0ad440 con 0x7f8c840d0570 2023-07-21T22:34:34.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c8b493640 1 -- 172.21.15.6:0/682775431 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c840d0570 msgr2=0x7f8c840afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:34.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c8b493640 1 --2- 172.21.15.6:0/682775431 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c840d0570 0x7f8c840afd50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c009d90 tx=0x7f8c7c01c920 comp rx=0 tx=0).stop 2023-07-21T22:34:34.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c8b493640 1 -- 172.21.15.6:0/682775431 shutdown_connections 2023-07-21T22:34:34.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c8b493640 1 --2- 172.21.15.6:0/682775431 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c840d0570 0x7f8c840afd50 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c8b493640 1 -- 172.21.15.6:0/682775431 >> 172.21.15.6:0/682775431 conn(0x7f8c84099490 msgr2=0x7f8c84089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:34.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c8b493640 1 -- 172.21.15.6:0/682775431 shutdown_connections 2023-07-21T22:34:34.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c8b493640 1 -- 172.21.15.6:0/682775431 wait complete. 2023-07-21T22:34:34.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c8b493640 1 Processor -- start 2023-07-21T22:34:34.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c8b493640 1 -- start start 2023-07-21T22:34:34.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c8b493640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c840ad6b0 0x7f8c84154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c8b493640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c840cdcd0 0x7f8c841537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c8b493640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c840d0570 0x7f8c840cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c8b493640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c840b32f0 con 0x7f8c840cdcd0 2023-07-21T22:34:34.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c8b493640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c840b35d0 con 0x7f8c840ad6b0 2023-07-21T22:34:34.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c8b493640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c840b38b0 con 0x7f8c840d0570 2023-07-21T22:34:34.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c88a2e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c840cdcd0 0x7f8c841537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c88a2e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c840cdcd0 0x7f8c841537e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54288/0 (socket says 172.21.15.6:54288) 2023-07-21T22:34:34.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c88a2e640 1 -- 172.21.15.6:0/2134546659 learned_addr learned my addr 172.21.15.6:0/2134546659 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:34.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c8922f640 1 --2- 172.21.15.6:0/2134546659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c840ad6b0 0x7f8c84154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c89a30640 1 --2- 172.21.15.6:0/2134546659 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c840d0570 0x7f8c840cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c88a2e640 1 -- 172.21.15.6:0/2134546659 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c840d0570 msgr2=0x7f8c840cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:34.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c88a2e640 1 --2- 172.21.15.6:0/2134546659 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c840d0570 0x7f8c840cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c88a2e640 1 -- 172.21.15.6:0/2134546659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c840ad6b0 msgr2=0x7f8c84154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:34.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c88a2e640 1 --2- 172.21.15.6:0/2134546659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c840ad6b0 0x7f8c84154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.658+0000 7f8c88a2e640 1 -- 172.21.15.6:0/2134546659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c009a70 con 0x7f8c840cdcd0 2023-07-21T22:34:34.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.662+0000 7f8c88a2e640 1 --2- 172.21.15.6:0/2134546659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c840cdcd0 0x7f8c841537e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400c4d0 tx=0x7f8c7400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:34.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.662+0000 7f8c79ffb640 1 -- 172.21.15.6:0/2134546659 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74005cf0 con 0x7f8c840cdcd0 2023-07-21T22:34:34.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.662+0000 7f8c79ffb640 1 -- 172.21.15.6:0/2134546659 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c74005e50 con 0x7f8c840cdcd0 2023-07-21T22:34:34.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.662+0000 7f8c79ffb640 1 -- 172.21.15.6:0/2134546659 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74007270 con 0x7f8c840cdcd0 2023-07-21T22:34:34.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.662+0000 7f8c8b493640 1 -- 172.21.15.6:0/2134546659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c840b3b90 con 0x7f8c840cdcd0 2023-07-21T22:34:34.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.662+0000 7f8c8b493640 1 -- 172.21.15.6:0/2134546659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c84153d20 con 0x7f8c840cdcd0 2023-07-21T22:34:34.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.662+0000 7f8c8b493640 1 -- 172.21.15.6:0/2134546659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c84159410 con 0x7f8c840cdcd0 2023-07-21T22:34:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.662+0000 7f8c79ffb640 1 -- 172.21.15.6:0/2134546659 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8c740073d0 con 0x7f8c840cdcd0 2023-07-21T22:34:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.662+0000 7f8c79ffb640 1 --2- 172.21.15.6:0/2134546659 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f8c680663a0 0x7f8c68068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.662+0000 7f8c79ffb640 1 -- 172.21.15.6:0/2134546659 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f8c74083460 con 0x7f8c840cdcd0 2023-07-21T22:34:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.662+0000 7f8c8922f640 1 --2- 172.21.15.6:0/2134546659 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f8c680663a0 0x7f8c68068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:34.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.666+0000 7f8c8922f640 1 --2- 172.21.15.6:0/2134546659 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f8c680663a0 0x7f8c68068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c840b2ab0 tx=0x7f8c80009040 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:34.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.666+0000 7f8c79ffb640 1 -- 172.21.15.6:0/2134546659 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8c740507b0 con 0x7f8c840cdcd0 2023-07-21T22:34:34.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.858+0000 7f8c8b493640 1 -- 172.21.15.6:0/2134546659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8c840b6010 con 0x7f8c840cdcd0 2023-07-21T22:34:34.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.858+0000 7f8c79ffb640 1 -- 172.21.15.6:0/2134546659 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8c74053dd0 con 0x7f8c840cdcd0 2023-07-21T22:34:34.911 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T22:34:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.862+0000 7f8c8b493640 1 -- 172.21.15.6:0/2134546659 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f8c680663a0 msgr2=0x7f8c68068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:34.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.862+0000 7f8c8b493640 1 --2- 172.21.15.6:0/2134546659 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f8c680663a0 0x7f8c68068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8c840b2ab0 tx=0x7f8c80009040 comp rx=0 tx=0).stop 2023-07-21T22:34:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.862+0000 7f8c8b493640 1 -- 172.21.15.6:0/2134546659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c840cdcd0 msgr2=0x7f8c841537e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.862+0000 7f8c8b493640 1 --2- 172.21.15.6:0/2134546659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c840cdcd0 0x7f8c841537e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400c4d0 tx=0x7f8c7400c990 comp rx=0 tx=0).stop 2023-07-21T22:34:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.862+0000 7f8c8b493640 1 -- 172.21.15.6:0/2134546659 shutdown_connections 2023-07-21T22:34:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.862+0000 7f8c8b493640 1 --2- 172.21.15.6:0/2134546659 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f8c680663a0 0x7f8c68068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.862+0000 7f8c8b493640 1 --2- 172.21.15.6:0/2134546659 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c840d0570 0x7f8c840cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.862+0000 7f8c8b493640 1 --2- 172.21.15.6:0/2134546659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c840cdcd0 0x7f8c841537e0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.862+0000 7f8c8b493640 1 --2- 172.21.15.6:0/2134546659 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c840ad6b0 0x7f8c84154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:34.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.862+0000 7f8c8b493640 1 -- 172.21.15.6:0/2134546659 >> 172.21.15.6:0/2134546659 conn(0x7f8c84099490 msgr2=0x7f8c841567d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:34.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.862+0000 7f8c8b493640 1 -- 172.21.15.6:0/2134546659 shutdown_connections 2023-07-21T22:34:34.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:34.862+0000 7f8c8b493640 1 -- 172.21.15.6:0/2134546659 wait complete. 2023-07-21T22:34:34.931 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-21T22:34:34.932 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:34:34.932 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-07-21T22:34:34.932 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T22:34:34.933 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T22:34:34.933 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-21T22:34:34.933 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-21T22:34:34.934 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:34:34.934 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:34:34.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:34:34.935 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-07-21T22:34:34.946 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:34:34.946 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:34:34.946 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:34:34.946 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:34:34.947 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-21T22:34:34.947 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:34:34.947 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:34:34.947 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:34:34.947 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-07-21T22:34:34.947 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:34:34.947 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:34:34.948 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-07-21T22:34:34.948 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:34:34.948 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:34:34.948 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-07-21T22:34:34.948 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:34:34.948 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41170sec preferred_lft 41170sec 2023-07-21T22:34:34.948 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-07-21T22:34:34.948 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:34:34.949 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:34:34.949 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:34:34.949 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-07-21T22:34:34.949 INFO:teuthology.orchestra.run.smithi006.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:34:34.949 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:42:2f:9a:3d:15 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:34:34.949 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:34:34.949 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:34:34.950 INFO:teuthology.orchestra.run.smithi006.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:34:34.950 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-21T22:34:34.950 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T22:34:34.950 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:34:34.950 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-21T22:34:34.950 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:34:34.950 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:34:34.950 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:34:34.951 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-21T22:34:34.951 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:34:34.951 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:34:34.951 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T22:34:34.951 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-21T22:34:34.951 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:34:34.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:34:34.952 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:34:35.006 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-07-21T22:34:35.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:34:35.008 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-07-21T22:34:35.064 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-07-21T22:34:35.064 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:34:35.064 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:34:35.065 INFO:teuthology.orchestra.run.smithi006.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:34:35.065 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:34:35.065 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:34:35.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:34:35.066 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T22:34:35.066 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T22:34:35.066 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:34:35.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:34:35.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:34:35.067 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T22:34:35.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:34:35.161 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T22:34:35.170 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-21T22:34:35.170 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T22:34:35.171 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:34:35.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:34:35.172 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-07-21T22:34:35.236 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:34:35.236 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T22:34:35.289 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:34:35.290 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:34:35.290 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:34:35.343 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-21T22:34:35.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:34:35.344 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:34:35.439 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:34:35.439 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:34:35.440 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:34:35.454 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:34:35.455 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:34:35.455 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:34:35.455 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:34:35.455 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:34:35.464 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:34:35.465 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:34:35.465 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:34:35.465 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:34:35.465 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:34:35.465 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-07-21T22:34:35.465 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-07-21T22:34:35.466 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f3073df4-6cd1-4503-bd2e-d3e98fa18bdf" will pass to kernel 2023-07-21T22:34:35.469 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T22:34:35.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:34:35.470 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:34:35.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:34:35.492 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:34:35.554 INFO:teuthology.orchestra.run.smithi006.stdout:client6086 2023-07-21T22:34:35.555 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:34:35.555 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:34:35.607 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-21T22:34:35.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.746+0000 7f0794226640 1 Processor -- start 2023-07-21T22:34:35.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.746+0000 7f0794226640 1 -- start start 2023-07-21T22:34:35.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.746+0000 7f0794226640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f078c15bdf0 0x7f078c0ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:35.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.746+0000 7f0794226640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c06c000 con 0x7f078c15f970 2023-07-21T22:34:35.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.746+0000 7f0794226640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c0cb2e0 con 0x7f078c0c9e80 2023-07-21T22:34:35.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.746+0000 7f0794226640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078c0cb5c0 con 0x7f078c15bdf0 2023-07-21T22:34:35.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.746+0000 7f07917c1640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f078c15f970 0x7f078c06b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:54580/0 (socket says 172.21.15.6:54580) 2023-07-21T22:34:35.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.746+0000 7f07917c1640 1 -- 172.21.15.6:0/1848354947 learned_addr learned my addr 172.21.15.6:0/1848354947 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:35.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.746+0000 7f0791fc2640 1 --2- 172.21.15.6:0/1848354947 >> v2:172.21.15.161:3300/0 conn(0x7f078c15bdf0 0x7f078c0ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:35.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.746+0000 7f0790fc0640 1 -- 172.21.15.6:0/1848354947 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3566371748 0 0) 0x7f078c06c000 con 0x7f078c15f970 2023-07-21T22:34:35.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.746+0000 7f0790fc0640 1 -- 172.21.15.6:0/1848354947 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0778003530 con 0x7f078c15f970 2023-07-21T22:34:35.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.746+0000 7f0791fc2640 1 -- 172.21.15.6:0/1848354947 >> v1:172.21.15.161:6789/0 conn(0x7f078c0c9e80 legacy=0x7f078c06b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:35.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.746+0000 7f0790fc0640 1 -- 172.21.15.6:0/1848354947 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964453235 0 0) 0x7f078c0cb2e0 con 0x7f078c0c9e80 2023-07-21T22:34:35.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.746+0000 7f0791fc2640 1 -- 172.21.15.6:0/1848354947 >> v1:172.21.15.6:6789/0 conn(0x7f078c15f970 legacy=0x7f078c06b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:35.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.746+0000 7f0791fc2640 1 -- 172.21.15.6:0/1848354947 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c0cb8a0 con 0x7f078c15bdf0 2023-07-21T22:34:35.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.750+0000 7f0791fc2640 1 --2- 172.21.15.6:0/1848354947 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f078c15bdf0 0x7f078c0ca970 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f07880097c0 tx=0x7f078801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9da9a7b563dec83b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:35.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.750+0000 7f0790fc0640 1 -- 172.21.15.6:0/1848354947 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07880ac640 con 0x7f078c15bdf0 2023-07-21T22:34:35.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.750+0000 7f0790fc0640 1 -- 172.21.15.6:0/1848354947 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07880ac7a0 con 0x7f078c15bdf0 2023-07-21T22:34:35.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.750+0000 7f0790fc0640 1 -- 172.21.15.6:0/1848354947 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07880acb30 con 0x7f078c15bdf0 2023-07-21T22:34:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.750+0000 7f0794226640 1 -- 172.21.15.6:0/1848354947 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f078c15bdf0 msgr2=0x7f078c0ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.750+0000 7f0794226640 1 --2- 172.21.15.6:0/1848354947 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f078c15bdf0 0x7f078c0ca970 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f07880097c0 tx=0x7f078801c3c0 comp rx=0 tx=0).stop 2023-07-21T22:34:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.750+0000 7f0794226640 1 -- 172.21.15.6:0/1848354947 shutdown_connections 2023-07-21T22:34:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.750+0000 7f0794226640 1 --2- 172.21.15.6:0/1848354947 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f078c15bdf0 0x7f078c0ca970 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:35.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.750+0000 7f0794226640 1 -- 172.21.15.6:0/1848354947 >> 172.21.15.6:0/1848354947 conn(0x7f078c0afcf0 msgr2=0x7f078c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:35.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.750+0000 7f0794226640 1 -- 172.21.15.6:0/1848354947 shutdown_connections 2023-07-21T22:34:35.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.750+0000 7f0794226640 1 -- 172.21.15.6:0/1848354947 wait complete. 2023-07-21T22:34:35.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f0794226640 1 Processor -- start 2023-07-21T22:34:35.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f0794226640 1 -- start start 2023-07-21T22:34:35.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f0794226640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f078c15bdf0 0x7f078c14a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:35.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f0794226640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f078c15f970 0x7f078c0c2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:35.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f0794226640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f078c1463b0 0x7f078c0c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:35.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f0794226640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c14aa80 con 0x7f078c15f970 2023-07-21T22:34:35.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f0794226640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c0c4420 con 0x7f078c1463b0 2023-07-21T22:34:35.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f0794226640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078c0c4700 con 0x7f078c15bdf0 2023-07-21T22:34:35.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f07917c1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f078c15f970 0x7f078c0c2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f07917c1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f078c15f970 0x7f078c0c2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54296/0 (socket says 172.21.15.6:54296) 2023-07-21T22:34:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f07917c1640 1 -- 172.21.15.6:0/1985646558 learned_addr learned my addr 172.21.15.6:0/1985646558 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:35.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f0791fc2640 1 --2- 172.21.15.6:0/1985646558 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f078c15bdf0 0x7f078c14a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:35.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f07927c3640 1 --2- 172.21.15.6:0/1985646558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f078c1463b0 0x7f078c0c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:35.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f07917c1640 1 -- 172.21.15.6:0/1985646558 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f078c15bdf0 msgr2=0x7f078c14a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:35.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f07917c1640 1 --2- 172.21.15.6:0/1985646558 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f078c15bdf0 0x7f078c14a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:35.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f07917c1640 1 -- 172.21.15.6:0/1985646558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f078c1463b0 msgr2=0x7f078c0c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:35.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f07917c1640 1 --2- 172.21.15.6:0/1985646558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f078c1463b0 0x7f078c0c1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:35.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f07917c1640 1 -- 172.21.15.6:0/1985646558 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0788009420 con 0x7f078c15f970 2023-07-21T22:34:35.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f07917c1640 1 --2- 172.21.15.6:0/1985646558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f078c15f970 0x7f078c0c2810 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f077c00c3c0 tx=0x7f077c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:35.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f07827fc640 1 -- 172.21.15.6:0/1985646558 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c005cf0 con 0x7f078c15f970 2023-07-21T22:34:35.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f07827fc640 1 -- 172.21.15.6:0/1985646558 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077c005e50 con 0x7f078c15f970 2023-07-21T22:34:35.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f0794226640 1 -- 172.21.15.6:0/1985646558 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078c151af0 con 0x7f078c15f970 2023-07-21T22:34:35.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f07827fc640 1 -- 172.21.15.6:0/1985646558 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c0072f0 con 0x7f078c15f970 2023-07-21T22:34:35.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.754+0000 7f0794226640 1 -- 172.21.15.6:0/1985646558 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078c0c49e0 con 0x7f078c15f970 2023-07-21T22:34:35.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.758+0000 7f0794226640 1 -- 172.21.15.6:0/1985646558 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078c151d30 con 0x7f078c15f970 2023-07-21T22:34:35.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.758+0000 7f07827fc640 1 -- 172.21.15.6:0/1985646558 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f077c007450 con 0x7f078c15f970 2023-07-21T22:34:35.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.758+0000 7f07827fc640 1 --2- 172.21.15.6:0/1985646558 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f07700663d0 0x7f0770068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:35.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.758+0000 7f07827fc640 1 -- 172.21.15.6:0/1985646558 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f077c083540 con 0x7f078c15f970 2023-07-21T22:34:35.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.758+0000 7f0791fc2640 1 --2- 172.21.15.6:0/1985646558 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f07700663d0 0x7f0770068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:35.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.758+0000 7f0791fc2640 1 --2- 172.21.15.6:0/1985646558 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f07700663d0 0x7f0770068880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f07880ae000 tx=0x7f07880a7000 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:35.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.762+0000 7f07827fc640 1 -- 172.21.15.6:0/1985646558 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f078c151d30 con 0x7f078c15f970 2023-07-21T22:34:35.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.938+0000 7f0794226640 1 -- 172.21.15.6:0/1985646558 --> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f078c0caeb0 con 0x7f07700663d0 2023-07-21T22:34:35.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.942+0000 7f07827fc640 1 -- 172.21.15.6:0/1985646558 <== mgr.5768 v2:172.21.15.161:6832/3045187557 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f07880ac910 con 0x7f07700663d0 2023-07-21T22:34:35.992 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:34:35.992 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:35.993 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephfs" 2023-07-21T22:34:35.993 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:35.993 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:34:35.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.942+0000 7f0794226640 1 -- 172.21.15.6:0/1985646558 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f07700663d0 msgr2=0x7f0770068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:35.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.942+0000 7f0794226640 1 --2- 172.21.15.6:0/1985646558 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f07700663d0 0x7f0770068880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f07880ae000 tx=0x7f07880a7000 comp rx=0 tx=0).stop 2023-07-21T22:34:35.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.942+0000 7f0794226640 1 -- 172.21.15.6:0/1985646558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f078c15f970 msgr2=0x7f078c0c2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:35.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.942+0000 7f0794226640 1 --2- 172.21.15.6:0/1985646558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f078c15f970 0x7f078c0c2810 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f077c00c3c0 tx=0x7f077c00c880 comp rx=0 tx=0).stop 2023-07-21T22:34:35.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.942+0000 7f0794226640 1 -- 172.21.15.6:0/1985646558 shutdown_connections 2023-07-21T22:34:35.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.942+0000 7f0794226640 1 --2- 172.21.15.6:0/1985646558 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f07700663d0 0x7f0770068880 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:35.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.942+0000 7f0794226640 1 --2- 172.21.15.6:0/1985646558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f078c1463b0 0x7f078c0c1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:35.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.942+0000 7f0794226640 1 --2- 172.21.15.6:0/1985646558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f078c15f970 0x7f078c0c2810 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:35.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.942+0000 7f0794226640 1 --2- 172.21.15.6:0/1985646558 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f078c15bdf0 0x7f078c14a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:35.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.942+0000 7f0794226640 1 -- 172.21.15.6:0/1985646558 >> 172.21.15.6:0/1985646558 conn(0x7f078c0afcf0 msgr2=0x7f078c0af5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:35.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.942+0000 7f0794226640 1 -- 172.21.15.6:0/1985646558 shutdown_connections 2023-07-21T22:34:35.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:35.942+0000 7f0794226640 1 -- 172.21.15.6:0/1985646558 wait complete. 2023-07-21T22:34:36.013 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-21T22:34:36.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.110+0000 7f75bf140640 1 Processor -- start 2023-07-21T22:34:36.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.110+0000 7f75bf140640 1 -- start start 2023-07-21T22:34:36.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.110+0000 7f75bf140640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f75b8156560 0x7f75b80cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:36.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.110+0000 7f75bf140640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75b80ccf60 0x7f75b80cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:36.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.110+0000 7f75bf140640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f75b8158df0 0x7f75b8159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:36.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.110+0000 7f75bf140640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b81597b0 con 0x7f75b8156560 2023-07-21T22:34:36.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.110+0000 7f75bf140640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b80b08d0 con 0x7f75b8158df0 2023-07-21T22:34:36.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.110+0000 7f75bf140640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80cd8d0 con 0x7f75b80ccf60 2023-07-21T22:34:36.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.110+0000 7f75bcedc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f75b8156560 0x7f75b80cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:36.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.110+0000 7f75bcedc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f75b8156560 0x7f75b80cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54310/0 (socket says 172.21.15.6:54310) 2023-07-21T22:34:36.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.110+0000 7f75bcedc640 1 -- 172.21.15.6:0/1983218677 learned_addr learned my addr 172.21.15.6:0/1983218677 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:36.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.110+0000 7f75bcedc640 1 -- 172.21.15.6:0/1983218677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75b80ccf60 msgr2=0x7f75b80cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:36.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.110+0000 7f75b7fff640 1 --2- 172.21.15.6:0/1983218677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75b80ccf60 0x7f75b80cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:36.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.110+0000 7f75bd6dd640 1 --2- 172.21.15.6:0/1983218677 >> v2:172.21.15.161:3300/0 conn(0x7f75b8158df0 0x7f75b8159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:36.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.110+0000 7f75bcedc640 1 --2- 172.21.15.6:0/1983218677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75b80ccf60 0x7f75b80cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:36.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.110+0000 7f75bcedc640 1 -- 172.21.15.6:0/1983218677 >> v2:172.21.15.161:3300/0 conn(0x7f75b8158df0 msgr2=0x7f75b8159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:36.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.110+0000 7f75bcedc640 1 --2- 172.21.15.6:0/1983218677 >> v2:172.21.15.161:3300/0 conn(0x7f75b8158df0 0x7f75b8159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:36.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.110+0000 7f75bcedc640 1 -- 172.21.15.6:0/1983218677 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b8159cb0 con 0x7f75b8156560 2023-07-21T22:34:36.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.110+0000 7f75b7fff640 1 --2- 172.21.15.6:0/1983218677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75b80ccf60 0x7f75b80cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.110+0000 7f75bd6dd640 1 --2- 172.21.15.6:0/1983218677 >> v2:172.21.15.161:3300/0 conn(0x7f75b8158df0 0x7f75b8159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.114+0000 7f75bcedc640 1 --2- 172.21.15.6:0/1983218677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b8156560 0x7f75b80cb3e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0098a0 tx=0x7f75ac01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d492e6a4a3de1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.114+0000 7f75b77fe640 1 -- 172.21.15.6:0/1983218677 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac0ab670 con 0x7f75b8156560 2023-07-21T22:34:36.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.114+0000 7f75b77fe640 1 -- 172.21.15.6:0/1983218677 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac0ab7d0 con 0x7f75b8156560 2023-07-21T22:34:36.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.114+0000 7f75b77fe640 1 -- 172.21.15.6:0/1983218677 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac0abb60 con 0x7f75b8156560 2023-07-21T22:34:36.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.114+0000 7f75bf140640 1 -- 172.21.15.6:0/1983218677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b8156560 msgr2=0x7f75b80cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.114+0000 7f75bf140640 1 --2- 172.21.15.6:0/1983218677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b8156560 0x7f75b80cb3e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0098a0 tx=0x7f75ac01c4b0 comp rx=0 tx=0).stop 2023-07-21T22:34:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.114+0000 7f75bf140640 1 -- 172.21.15.6:0/1983218677 shutdown_connections 2023-07-21T22:34:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.114+0000 7f75bf140640 1 --2- 172.21.15.6:0/1983218677 >> v2:172.21.15.161:3300/0 conn(0x7f75b8158df0 0x7f75b8159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.114+0000 7f75bf140640 1 --2- 172.21.15.6:0/1983218677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75b80ccf60 0x7f75b80cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.114+0000 7f75bf140640 1 --2- 172.21.15.6:0/1983218677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b8156560 0x7f75b80cb3e0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.114+0000 7f75bf140640 1 -- 172.21.15.6:0/1983218677 >> 172.21.15.6:0/1983218677 conn(0x7f75b80afac0 msgr2=0x7f75b80afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.114+0000 7f75bf140640 1 -- 172.21.15.6:0/1983218677 shutdown_connections 2023-07-21T22:34:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.114+0000 7f75bf140640 1 -- 172.21.15.6:0/1983218677 wait complete. 2023-07-21T22:34:36.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75bf140640 1 Processor -- start 2023-07-21T22:34:36.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75bf140640 1 -- start start 2023-07-21T22:34:36.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75bf140640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75b80ccf60 0x7f75b814e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:36.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75bf140640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b8156560 0x7f75b814cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:36.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75bf140640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75b8158df0 0x7f75b80ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:36.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75bf140640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b814ea50 con 0x7f75b8156560 2023-07-21T22:34:36.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75bf140640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b814da00 con 0x7f75b80ccf60 2023-07-21T22:34:36.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75bf140640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b815ca40 con 0x7f75b8158df0 2023-07-21T22:34:36.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75b7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b8156560 0x7f75b814cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:36.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75b7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b8156560 0x7f75b814cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54322/0 (socket says 172.21.15.6:54322) 2023-07-21T22:34:36.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75b7fff640 1 -- 172.21.15.6:0/324219720 learned_addr learned my addr 172.21.15.6:0/324219720 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:36.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75bd6dd640 1 --2- 172.21.15.6:0/324219720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75b8158df0 0x7f75b80ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:36.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75bcedc640 1 --2- 172.21.15.6:0/324219720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75b80ccf60 0x7f75b814e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:36.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75b7fff640 1 -- 172.21.15.6:0/324219720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75b8158df0 msgr2=0x7f75b80ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:36.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75b7fff640 1 --2- 172.21.15.6:0/324219720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75b8158df0 0x7f75b80ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:36.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75b7fff640 1 -- 172.21.15.6:0/324219720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75b80ccf60 msgr2=0x7f75b814e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:36.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75b7fff640 1 --2- 172.21.15.6:0/324219720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75b80ccf60 0x7f75b814e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:36.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75b7fff640 1 -- 172.21.15.6:0/324219720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac0094d0 con 0x7f75b8156560 2023-07-21T22:34:36.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75bcedc640 1 --2- 172.21.15.6:0/324219720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75b80ccf60 0x7f75b814e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75b7fff640 1 --2- 172.21.15.6:0/324219720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b8156560 0x7f75b814cf80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f75a400c7c0 tx=0x7f75a400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75b57fa640 1 -- 172.21.15.6:0/324219720 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a4007a30 con 0x7f75b8156560 2023-07-21T22:34:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75b57fa640 1 -- 172.21.15.6:0/324219720 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a4007b90 con 0x7f75b8156560 2023-07-21T22:34:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75b57fa640 1 -- 172.21.15.6:0/324219720 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a400ce70 con 0x7f75b8156560 2023-07-21T22:34:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75bf140640 1 -- 172.21.15.6:0/324219720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b814d4c0 con 0x7f75b8156560 2023-07-21T22:34:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.118+0000 7f75bf140640 1 -- 172.21.15.6:0/324219720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b815c110 con 0x7f75b8156560 2023-07-21T22:34:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.122+0000 7f75bf140640 1 -- 172.21.15.6:0/324219720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b80678d0 con 0x7f75b8156560 2023-07-21T22:34:36.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.122+0000 7f75b57fa640 1 -- 172.21.15.6:0/324219720 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f75a40113f0 con 0x7f75b8156560 2023-07-21T22:34:36.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.122+0000 7f75b57fa640 1 --2- 172.21.15.6:0/324219720 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f759c0663d0 0x7f759c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:36.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.122+0000 7f75b57fa640 1 -- 172.21.15.6:0/324219720 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f75a4084320 con 0x7f75b8156560 2023-07-21T22:34:36.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.122+0000 7f75bcedc640 1 --2- 172.21.15.6:0/324219720 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f759c0663d0 0x7f759c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:36.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.122+0000 7f75bcedc640 1 --2- 172.21.15.6:0/324219720 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f759c0663d0 0x7f759c068880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0af000 tx=0x7f75ac0a7000 comp rx=0 tx=0).ready entity=mgr.5768 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:36.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.126+0000 7f75b57fa640 1 -- 172.21.15.6:0/324219720 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f75a4051690 con 0x7f75b8156560 2023-07-21T22:34:36.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.318+0000 7f75bf140640 1 -- 172.21.15.6:0/324219720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f75b815cb80 con 0x7f75b8156560 2023-07-21T22:34:36.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.834+0000 7f75b57fa640 1 -- 172.21.15.6:0/324219720 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 27) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f75a40826b0 con 0x7f75b8156560 2023-07-21T22:34:36.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.834+0000 7f75b57fa640 1 -- 172.21.15.6:0/324219720 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v27) v1 ==== 92+0+0 (secure 0 0 0) 0x7f75a406ef50 con 0x7f75b8156560 2023-07-21T22:34:36.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.838+0000 7f75bf140640 1 -- 172.21.15.6:0/324219720 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f759c0663d0 msgr2=0x7f759c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:36.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.838+0000 7f75bf140640 1 --2- 172.21.15.6:0/324219720 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f759c0663d0 0x7f759c068880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0af000 tx=0x7f75ac0a7000 comp rx=0 tx=0).stop 2023-07-21T22:34:36.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.838+0000 7f75bf140640 1 -- 172.21.15.6:0/324219720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b8156560 msgr2=0x7f75b814cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:36.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.838+0000 7f75bf140640 1 --2- 172.21.15.6:0/324219720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b8156560 0x7f75b814cf80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f75a400c7c0 tx=0x7f75a400cc80 comp rx=0 tx=0).stop 2023-07-21T22:34:36.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.838+0000 7f75bf140640 1 -- 172.21.15.6:0/324219720 shutdown_connections 2023-07-21T22:34:36.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.838+0000 7f75bf140640 1 --2- 172.21.15.6:0/324219720 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f759c0663d0 0x7f759c068880 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:36.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.838+0000 7f75bf140640 1 --2- 172.21.15.6:0/324219720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75b8158df0 0x7f75b80ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:36.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.838+0000 7f75bf140640 1 --2- 172.21.15.6:0/324219720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75b8156560 0x7f75b814cf80 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:36.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.838+0000 7f75bf140640 1 --2- 172.21.15.6:0/324219720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75b80ccf60 0x7f75b814e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:36.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.838+0000 7f75bf140640 1 -- 172.21.15.6:0/324219720 >> 172.21.15.6:0/324219720 conn(0x7f75b80afac0 msgr2=0x7f75b80ade10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:36.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.838+0000 7f75bf140640 1 -- 172.21.15.6:0/324219720 shutdown_connections 2023-07-21T22:34:36.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:36.838+0000 7f75bf140640 1 -- 172.21.15.6:0/324219720 wait complete. 2023-07-21T22:34:36.911 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-21T22:34:37.062 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:37.016+0000 7faf86a46180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:34:37.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.014+0000 7f4b61911640 1 Processor -- start 2023-07-21T22:34:37.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.014+0000 7f4b61911640 1 -- start start 2023-07-21T22:34:37.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.014+0000 7f4b61911640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b5c0d2fc0 0x7f4b5c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:37.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.014+0000 7f4b61911640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b5c0d2300 0x7f4b5c0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:37.065 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:37.014+0000 7f78e2448180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:34:37.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.014+0000 7f4b61911640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b5c0b04c0 con 0x7f4b5c15bde0 2023-07-21T22:34:37.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.014+0000 7f4b61911640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b5c0d2ce0 con 0x7f4b5c0d2300 2023-07-21T22:34:37.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.014+0000 7f4b61911640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c15c1b0 con 0x7f4b5c0d2fc0 2023-07-21T22:34:37.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.014+0000 7f4b5b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b5c0d2300 0x7f4b5c0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:37.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.014+0000 7f4b53fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b5c0d2fc0 0x7f4b5c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:37.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.014+0000 7f4b5affd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f4b5c15bde0 0x7f4b5c0d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:39598/0 (socket says 172.21.15.6:39598) 2023-07-21T22:34:37.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.014+0000 7f4b5b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b5c0d2300 0x7f4b5c0d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54358/0 (socket says 172.21.15.6:54358) 2023-07-21T22:34:37.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.014+0000 7f4b5affd640 1 -- 172.21.15.6:0/111871853 learned_addr learned my addr 172.21.15.6:0/111871853 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:37.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.014+0000 7f4b5b7fe640 1 -- 172.21.15.6:0/111871853 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b5c0d2fc0 msgr2=0x7f4b5c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:37.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.014+0000 7f4b5b7fe640 1 --2- 172.21.15.6:0/111871853 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b5c0d2fc0 0x7f4b5c0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.014+0000 7f4b5b7fe640 1 -- 172.21.15.6:0/111871853 >> v1:172.21.15.161:6789/0 conn(0x7f4b5c15bde0 legacy=0x7f4b5c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:37.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.014+0000 7f4b5b7fe640 1 -- 172.21.15.6:0/111871853 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5c0d0aa0 con 0x7f4b5c0d2300 2023-07-21T22:34:37.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.014+0000 7f4b5a7fc640 1 -- 172.21.15.6:0/111871853 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813796042 0 0) 0x7f4b5c0b04c0 con 0x7f4b5c15bde0 2023-07-21T22:34:37.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.018+0000 7f4b5b7fe640 1 --2- 172.21.15.6:0/111871853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c0d2300 0x7f4b5c0d27a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009d90 tx=0x7f4b5401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf9e96e92b143fce server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:37.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.018+0000 7f4b5a7fc640 1 -- 172.21.15.6:0/111871853 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b540a5a10 con 0x7f4b5c0d2300 2023-07-21T22:34:37.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.018+0000 7f4b5a7fc640 1 -- 172.21.15.6:0/111871853 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b540a5b70 con 0x7f4b5c0d2300 2023-07-21T22:34:37.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.018+0000 7f4b5a7fc640 1 -- 172.21.15.6:0/111871853 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b540ad440 con 0x7f4b5c0d2300 2023-07-21T22:34:37.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.018+0000 7f4b61911640 1 -- 172.21.15.6:0/111871853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c0d2300 msgr2=0x7f4b5c0d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:37.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.018+0000 7f4b61911640 1 --2- 172.21.15.6:0/111871853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c0d2300 0x7f4b5c0d27a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009d90 tx=0x7f4b5401c950 comp rx=0 tx=0).stop 2023-07-21T22:34:37.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.018+0000 7f4b61911640 1 -- 172.21.15.6:0/111871853 shutdown_connections 2023-07-21T22:34:37.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.018+0000 7f4b61911640 1 --2- 172.21.15.6:0/111871853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c0d2300 0x7f4b5c0d27a0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.018+0000 7f4b61911640 1 --2- 172.21.15.6:0/111871853 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b5c0d2fc0 0x7f4b5c0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.018+0000 7f4b61911640 1 -- 172.21.15.6:0/111871853 >> 172.21.15.6:0/111871853 conn(0x7f4b5c0659d0 msgr2=0x7f4b5c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:37.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.018+0000 7f4b61911640 1 -- 172.21.15.6:0/111871853 shutdown_connections 2023-07-21T22:34:37.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.018+0000 7f4b61911640 1 -- 172.21.15.6:0/111871853 wait complete. 2023-07-21T22:34:37.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b61911640 1 Processor -- start 2023-07-21T22:34:37.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b61911640 1 -- start start 2023-07-21T22:34:37.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b61911640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b5c0d2300 0x7f4b5c0b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:37.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b61911640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b5c0d2fc0 0x7f4b5c14feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:37.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b61911640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c15bde0 0x7f4b5c0b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:37.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b61911640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0b8010 con 0x7f4b5c15bde0 2023-07-21T22:34:37.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b61911640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c1503f0 con 0x7f4b5c0d2300 2023-07-21T22:34:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b61911640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0b4180 con 0x7f4b5c0d2fc0 2023-07-21T22:34:37.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b5b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c15bde0 0x7f4b5c0b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b5affd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b5c0d2300 0x7f4b5c0b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b5b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c15bde0 0x7f4b5c0b3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54368/0 (socket says 172.21.15.6:54368) 2023-07-21T22:34:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b5b7fe640 1 -- 172.21.15.6:0/41682126 learned_addr learned my addr 172.21.15.6:0/41682126 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b53fff640 1 --2- 172.21.15.6:0/41682126 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b5c0d2fc0 0x7f4b5c14feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b53fff640 1 -- 172.21.15.6:0/41682126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b5c0d2300 msgr2=0x7f4b5c0b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:37.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b53fff640 1 --2- 172.21.15.6:0/41682126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b5c0d2300 0x7f4b5c0b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b53fff640 1 -- 172.21.15.6:0/41682126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c15bde0 msgr2=0x7f4b5c0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b53fff640 1 --2- 172.21.15.6:0/41682126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c15bde0 0x7f4b5c0b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b53fff640 1 -- 172.21.15.6:0/41682126 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b54009a70 con 0x7f4b5c0d2fc0 2023-07-21T22:34:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b5affd640 1 --2- 172.21.15.6:0/41682126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b5c0d2300 0x7f4b5c0b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b5b7fe640 1 --2- 172.21.15.6:0/41682126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c15bde0 0x7f4b5c0b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b53fff640 1 --2- 172.21.15.6:0/41682126 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b5c0d2fc0 0x7f4b5c14feb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4b4400e8a0 tx=0x7f4b4400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b58ff9640 1 -- 172.21.15.6:0/41682126 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44009e80 con 0x7f4b5c0d2fc0 2023-07-21T22:34:37.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b58ff9640 1 -- 172.21.15.6:0/41682126 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4400c940 con 0x7f4b5c0d2fc0 2023-07-21T22:34:37.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b61911640 1 -- 172.21.15.6:0/41682126 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5c0b51a0 con 0x7f4b5c0d2fc0 2023-07-21T22:34:37.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b58ff9640 1 -- 172.21.15.6:0/41682126 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4400ccb0 con 0x7f4b5c0d2fc0 2023-07-21T22:34:37.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b61911640 1 -- 172.21.15.6:0/41682126 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c0b5440 con 0x7f4b5c0d2fc0 2023-07-21T22:34:37.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.022+0000 7f4b61911640 1 -- 172.21.15.6:0/41682126 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5c152f80 con 0x7f4b5c0d2fc0 2023-07-21T22:34:37.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.026+0000 7f4b58ff9640 1 -- 172.21.15.6:0/41682126 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 27) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f4b44013470 con 0x7f4b5c0d2fc0 2023-07-21T22:34:37.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.026+0000 7f4b58ff9640 1 --2- 172.21.15.6:0/41682126 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f4b3c0663f0 0x7f4b3c0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:37.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.026+0000 7f4b58ff9640 1 -- 172.21.15.6:0/41682126 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f4b44084300 con 0x7f4b5c0d2fc0 2023-07-21T22:34:37.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.026+0000 7f4b5affd640 1 -- 172.21.15.6:0/41682126 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f4b3c0663f0 msgr2=0x7f4b3c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3045187557 2023-07-21T22:34:37.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.026+0000 7f4b5affd640 1 --2- 172.21.15.6:0/41682126 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f4b3c0663f0 0x7f4b3c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:37.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.030+0000 7f4b58ff9640 1 -- 172.21.15.6:0/41682126 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4b44051650 con 0x7f4b5c0d2fc0 2023-07-21T22:34:37.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.190+0000 7f4b61911640 1 -- 172.21.15.6:0/41682126 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f4b5c0678d0 con 0x7f4b5c0d2fc0 2023-07-21T22:34:37.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.198+0000 7f4b58ff9640 1 -- 172.21.15.6:0/41682126 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4b44054c70 con 0x7f4b5c0d2fc0 2023-07-21T22:34:37.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.202+0000 7f4b61911640 1 -- 172.21.15.6:0/41682126 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f4b3c0663f0 msgr2=0x7f4b3c0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:34:37.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.202+0000 7f4b61911640 1 --2- 172.21.15.6:0/41682126 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f4b3c0663f0 0x7f4b3c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.202+0000 7f4b61911640 1 -- 172.21.15.6:0/41682126 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b5c0d2fc0 msgr2=0x7f4b5c14feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:37.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.202+0000 7f4b61911640 1 --2- 172.21.15.6:0/41682126 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b5c0d2fc0 0x7f4b5c14feb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4b4400e8a0 tx=0x7f4b4400ed60 comp rx=0 tx=0).stop 2023-07-21T22:34:37.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.202+0000 7f4b61911640 1 -- 172.21.15.6:0/41682126 shutdown_connections 2023-07-21T22:34:37.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.202+0000 7f4b61911640 1 --2- 172.21.15.6:0/41682126 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f4b3c0663f0 0x7f4b3c0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.202+0000 7f4b61911640 1 --2- 172.21.15.6:0/41682126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b5c15bde0 0x7f4b5c0b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.202+0000 7f4b61911640 1 --2- 172.21.15.6:0/41682126 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b5c0d2fc0 0x7f4b5c14feb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.202+0000 7f4b61911640 1 --2- 172.21.15.6:0/41682126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b5c0d2300 0x7f4b5c0b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.202+0000 7f4b61911640 1 -- 172.21.15.6:0/41682126 >> 172.21.15.6:0/41682126 conn(0x7f4b5c0659d0 msgr2=0x7f4b5c15a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:37.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.202+0000 7f4b61911640 1 -- 172.21.15.6:0/41682126 shutdown_connections 2023-07-21T22:34:37.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.202+0000 7f4b61911640 1 -- 172.21.15.6:0/41682126 wait complete. 2023-07-21T22:34:37.271 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-21T22:34:37.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.370+0000 7f20b3893640 1 Processor -- start 2023-07-21T22:34:37.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.370+0000 7f20b3893640 1 -- start start 2023-07-21T22:34:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.374+0000 7f20b3893640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20ac15bde0 0x7f20ac0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.374+0000 7f20b3893640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f20ac0d2fc0 0x7f20ac0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.374+0000 7f20b3893640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f20ac0d2300 0x7f20ac0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.374+0000 7f20b3893640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ac0d2ce0 con 0x7f20ac0d2300 2023-07-21T22:34:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.374+0000 7f20b3893640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20ac15c1b0 con 0x7f20ac0d2fc0 2023-07-21T22:34:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.374+0000 7f20b3893640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac0b04c0 con 0x7f20ac15bde0 2023-07-21T22:34:37.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.374+0000 7f20b1e30640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f20ac0d2300 0x7f20ac0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:37.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.374+0000 7f20b1e30640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f20ac0d2300 0x7f20ac0d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54376/0 (socket says 172.21.15.6:54376) 2023-07-21T22:34:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.374+0000 7f20b1e30640 1 -- 172.21.15.6:0/2071416138 learned_addr learned my addr 172.21.15.6:0/2071416138 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.374+0000 7f20b162f640 1 --2- 172.21.15.6:0/2071416138 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20ac15bde0 0x7f20ac0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.374+0000 7f20b0e2e640 1 --2- 172.21.15.6:0/2071416138 >> v2:172.21.15.161:3300/0 conn(0x7f20ac0d2fc0 0x7f20ac0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.374+0000 7f20b1e30640 1 -- 172.21.15.6:0/2071416138 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20ac15bde0 msgr2=0x7f20ac0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.374+0000 7f20b1e30640 1 --2- 172.21.15.6:0/2071416138 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20ac15bde0 0x7f20ac0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.374+0000 7f20b1e30640 1 -- 172.21.15.6:0/2071416138 >> v2:172.21.15.161:3300/0 conn(0x7f20ac0d2fc0 msgr2=0x7f20ac0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.374+0000 7f20b1e30640 1 --2- 172.21.15.6:0/2071416138 >> v2:172.21.15.161:3300/0 conn(0x7f20ac0d2fc0 0x7f20ac0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.374+0000 7f20b1e30640 1 -- 172.21.15.6:0/2071416138 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ac0d0aa0 con 0x7f20ac0d2300 2023-07-21T22:34:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.374+0000 7f20b1e30640 1 --2- 172.21.15.6:0/2071416138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20ac0d2300 0x7f20ac0d27a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f20ac08af30 tx=0x7f20a401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ff7453f65f53e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.378+0000 7f20a3fff640 1 -- 172.21.15.6:0/2071416138 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a40a5850 con 0x7f20ac0d2300 2023-07-21T22:34:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.378+0000 7f20a3fff640 1 -- 172.21.15.6:0/2071416138 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a40a59b0 con 0x7f20ac0d2300 2023-07-21T22:34:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.378+0000 7f20a3fff640 1 -- 172.21.15.6:0/2071416138 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a40a5d40 con 0x7f20ac0d2300 2023-07-21T22:34:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.378+0000 7f20b3893640 1 -- 172.21.15.6:0/2071416138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20ac0d2300 msgr2=0x7f20ac0d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.378+0000 7f20b3893640 1 --2- 172.21.15.6:0/2071416138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20ac0d2300 0x7f20ac0d27a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f20ac08af30 tx=0x7f20a401c9d0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.378+0000 7f20b3893640 1 -- 172.21.15.6:0/2071416138 shutdown_connections 2023-07-21T22:34:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.378+0000 7f20b3893640 1 --2- 172.21.15.6:0/2071416138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20ac0d2300 0x7f20ac0d27a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.378+0000 7f20b3893640 1 --2- 172.21.15.6:0/2071416138 >> v2:172.21.15.161:3300/0 conn(0x7f20ac0d2fc0 0x7f20ac0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.378+0000 7f20b3893640 1 --2- 172.21.15.6:0/2071416138 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20ac15bde0 0x7f20ac0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.378+0000 7f20b3893640 1 -- 172.21.15.6:0/2071416138 >> 172.21.15.6:0/2071416138 conn(0x7f20ac0659d0 msgr2=0x7f20ac09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.378+0000 7f20b3893640 1 -- 172.21.15.6:0/2071416138 shutdown_connections 2023-07-21T22:34:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.378+0000 7f20b3893640 1 -- 172.21.15.6:0/2071416138 wait complete. 2023-07-21T22:34:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.378+0000 7f20b3893640 1 Processor -- start 2023-07-21T22:34:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.378+0000 7f20b3893640 1 -- start start 2023-07-21T22:34:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.378+0000 7f20b3893640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20ac0d2300 0x7f20ac0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:37.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.378+0000 7f20b3893640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20ac0d2fc0 0x7f20ac0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:37.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.378+0000 7f20b3893640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20ac15bde0 0x7f20ac0cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:37.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.378+0000 7f20b3893640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac0ca380 con 0x7f20ac0d2fc0 2023-07-21T22:34:37.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.378+0000 7f20b3893640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac0b4110 con 0x7f20ac15bde0 2023-07-21T22:34:37.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.378+0000 7f20b3893640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac0b3ed0 con 0x7f20ac0d2300 2023-07-21T22:34:37.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.382+0000 7f20b162f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20ac0d2300 0x7f20ac0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:37.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.382+0000 7f20b0e2e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20ac0d2fc0 0x7f20ac0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:37.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.382+0000 7f20b162f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20ac0d2300 0x7f20ac0b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:33458/0 (socket says 172.21.15.6:33458) 2023-07-21T22:34:37.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.382+0000 7f20b162f640 1 -- 172.21.15.6:0/3811798293 learned_addr learned my addr 172.21.15.6:0/3811798293 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.382+0000 7f20b1e30640 1 --2- 172.21.15.6:0/3811798293 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20ac15bde0 0x7f20ac0cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.382+0000 7f20b162f640 1 -- 172.21.15.6:0/3811798293 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20ac15bde0 msgr2=0x7f20ac0cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.382+0000 7f20b162f640 1 --2- 172.21.15.6:0/3811798293 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20ac15bde0 0x7f20ac0cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.382+0000 7f20b162f640 1 -- 172.21.15.6:0/3811798293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20ac0d2fc0 msgr2=0x7f20ac0b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.382+0000 7f20b162f640 1 --2- 172.21.15.6:0/3811798293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20ac0d2fc0 0x7f20ac0b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.382+0000 7f20b162f640 1 -- 172.21.15.6:0/3811798293 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a4009b30 con 0x7f20ac0d2300 2023-07-21T22:34:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.382+0000 7f20b0e2e640 1 --2- 172.21.15.6:0/3811798293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20ac0d2fc0 0x7f20ac0b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.382+0000 7f20b1e30640 1 --2- 172.21.15.6:0/3811798293 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20ac15bde0 0x7f20ac0cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.382+0000 7f20b162f640 1 --2- 172.21.15.6:0/3811798293 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20ac0d2300 0x7f20ac0b3990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f20a800e9b0 tx=0x7f20a800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.382+0000 7f20a1ffb640 1 -- 172.21.15.6:0/3811798293 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a8009670 con 0x7f20ac0d2300 2023-07-21T22:34:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.382+0000 7f20a1ffb640 1 -- 172.21.15.6:0/3811798293 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a800c9a0 con 0x7f20ac0d2300 2023-07-21T22:34:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.382+0000 7f20b3893640 1 -- 172.21.15.6:0/3811798293 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ac0b26b0 con 0x7f20ac0d2300 2023-07-21T22:34:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.382+0000 7f20a1ffb640 1 -- 172.21.15.6:0/3811798293 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a800cd10 con 0x7f20ac0d2300 2023-07-21T22:34:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.382+0000 7f20b3893640 1 -- 172.21.15.6:0/3811798293 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ac0b1690 con 0x7f20ac0d2300 2023-07-21T22:34:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.382+0000 7f20b3893640 1 -- 172.21.15.6:0/3811798293 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ac0678d0 con 0x7f20ac0d2300 2023-07-21T22:34:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.382+0000 7f20a1ffb640 1 -- 172.21.15.6:0/3811798293 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 27) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f20a8013470 con 0x7f20ac0d2300 2023-07-21T22:34:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.386+0000 7f20a1ffb640 1 --2- 172.21.15.6:0/3811798293 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f2090066440 0x7f20900688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.386+0000 7f20a1ffb640 1 -- 172.21.15.6:0/3811798293 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f20a80842e0 con 0x7f20ac0d2300 2023-07-21T22:34:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.386+0000 7f20b0e2e640 1 -- 172.21.15.6:0/3811798293 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f2090066440 msgr2=0x7f20900688f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3045187557 2023-07-21T22:34:37.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.386+0000 7f20b0e2e640 1 --2- 172.21.15.6:0/3811798293 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f2090066440 0x7f20900688f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.390+0000 7f20a1ffb640 1 -- 172.21.15.6:0/3811798293 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f20a80516b0 con 0x7f20ac0d2300 2023-07-21T22:34:37.478 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:37.432+0000 7faf86a46180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:34:37.515 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:37.466+0000 7f78e2448180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:34:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.546+0000 7f20b3893640 1 -- 172.21.15.6:0/3811798293 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f20ac0b26b0 con 0x7f20ac0d2300 2023-07-21T22:34:37.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.558+0000 7f20a1ffb640 1 -- 172.21.15.6:0/3811798293 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7f20ac0b26b0 con 0x7f20ac0d2300 2023-07-21T22:34:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.558+0000 7f20b3893640 1 -- 172.21.15.6:0/3811798293 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f2090066440 msgr2=0x7f20900688f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:34:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.558+0000 7f20b3893640 1 --2- 172.21.15.6:0/3811798293 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f2090066440 0x7f20900688f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.558+0000 7f20b3893640 1 -- 172.21.15.6:0/3811798293 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20ac0d2300 msgr2=0x7f20ac0b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.558+0000 7f20b3893640 1 --2- 172.21.15.6:0/3811798293 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20ac0d2300 0x7f20ac0b3990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f20a800e9b0 tx=0x7f20a800ee70 comp rx=0 tx=0).stop 2023-07-21T22:34:37.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.558+0000 7f20b3893640 1 -- 172.21.15.6:0/3811798293 shutdown_connections 2023-07-21T22:34:37.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.558+0000 7f20b3893640 1 --2- 172.21.15.6:0/3811798293 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7f2090066440 0x7f20900688f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.558+0000 7f20b3893640 1 --2- 172.21.15.6:0/3811798293 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20ac15bde0 0x7f20ac0cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.558+0000 7f20b3893640 1 --2- 172.21.15.6:0/3811798293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20ac0d2fc0 0x7f20ac0b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.558+0000 7f20b3893640 1 --2- 172.21.15.6:0/3811798293 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20ac0d2300 0x7f20ac0b3990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.558+0000 7f20b3893640 1 -- 172.21.15.6:0/3811798293 >> 172.21.15.6:0/3811798293 conn(0x7f20ac0659d0 msgr2=0x7f20ac0cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:37.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.558+0000 7f20b3893640 1 -- 172.21.15.6:0/3811798293 shutdown_connections 2023-07-21T22:34:37.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.558+0000 7f20b3893640 1 -- 172.21.15.6:0/3811798293 wait complete. 2023-07-21T22:34:37.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:34:37.629 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-21T22:34:37.630 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:37.584+0000 7faf86a46180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:34:37.645 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-07-21T22:34:37.675 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:37.626+0000 7f78e2448180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:34:37.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.774+0000 7fbcbac48640 1 Processor -- start 2023-07-21T22:34:37.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.774+0000 7fbcbac48640 1 -- start start 2023-07-21T22:34:37.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.774+0000 7fbcbac48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcb40d2fc0 0x7fbcb40b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:37.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.774+0000 7fbcbac48640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb40b04c0 con 0x7fbcb415bde0 2023-07-21T22:34:37.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.774+0000 7fbcbac48640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb40d0aa0 con 0x7fbcb40d2300 2023-07-21T22:34:37.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.774+0000 7fbcbac48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb415c1b0 con 0x7fbcb40d2fc0 2023-07-21T22:34:37.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.774+0000 7fbcb89e4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbcb415bde0 0x7fbcb40d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34414/0 (socket says 172.21.15.6:34414) 2023-07-21T22:34:37.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.774+0000 7fbcb89e4640 1 -- 172.21.15.6:0/651670575 learned_addr learned my addr 172.21.15.6:0/651670575 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:37.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.774+0000 7fbcb3fff640 1 --2- 172.21.15.6:0/651670575 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcb40d2fc0 0x7fbcb40b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:37.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.774+0000 7fbcb37fe640 1 -- 172.21.15.6:0/651670575 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532781760 0 0) 0x7fbcb40b04c0 con 0x7fbcb415bde0 2023-07-21T22:34:37.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.774+0000 7fbcb37fe640 1 -- 172.21.15.6:0/651670575 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbca4003530 con 0x7fbcb415bde0 2023-07-21T22:34:37.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.774+0000 7fbcb37fe640 1 -- 172.21.15.6:0/651670575 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778817201 0 0) 0x7fbcb40d0aa0 con 0x7fbcb40d2300 2023-07-21T22:34:37.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.774+0000 7fbcb37fe640 1 -- 172.21.15.6:0/651670575 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcb40b04c0 con 0x7fbcb40d2300 2023-07-21T22:34:37.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.774+0000 7fbcb3fff640 1 -- 172.21.15.6:0/651670575 >> v1:172.21.15.161:6789/0 conn(0x7fbcb40d2300 legacy=0x7fbcb40cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:37.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.774+0000 7fbcb3fff640 1 -- 172.21.15.6:0/651670575 >> v1:172.21.15.6:6789/0 conn(0x7fbcb415bde0 legacy=0x7fbcb40d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:37.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.774+0000 7fbcb3fff640 1 -- 172.21.15.6:0/651670575 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb40afb90 con 0x7fbcb40d2fc0 2023-07-21T22:34:37.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.778+0000 7fbcb3fff640 1 --2- 172.21.15.6:0/651670575 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcb40d2fc0 0x7fbcb40b0950 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbca00097f0 tx=0x7fbca001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=600ffa15f198f57e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:37.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.778+0000 7fbcb37fe640 1 -- 172.21.15.6:0/651670575 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca00aa620 con 0x7fbcb40d2fc0 2023-07-21T22:34:37.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.778+0000 7fbcb37fe640 1 -- 172.21.15.6:0/651670575 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca00aa780 con 0x7fbcb40d2fc0 2023-07-21T22:34:37.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.778+0000 7fbcb37fe640 1 -- 172.21.15.6:0/651670575 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca00aab10 con 0x7fbcb40d2fc0 2023-07-21T22:34:37.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.778+0000 7fbcbac48640 1 -- 172.21.15.6:0/651670575 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcb40d2fc0 msgr2=0x7fbcb40b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:37.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.778+0000 7fbcbac48640 1 --2- 172.21.15.6:0/651670575 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcb40d2fc0 0x7fbcb40b0950 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbca00097f0 tx=0x7fbca001c4c0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.778+0000 7fbcbac48640 1 -- 172.21.15.6:0/651670575 shutdown_connections 2023-07-21T22:34:37.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.778+0000 7fbcbac48640 1 --2- 172.21.15.6:0/651670575 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcb40d2fc0 0x7fbcb40b0950 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.778+0000 7fbcbac48640 1 -- 172.21.15.6:0/651670575 >> 172.21.15.6:0/651670575 conn(0x7fbcb40659d0 msgr2=0x7fbcb409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:37.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.778+0000 7fbcbac48640 1 -- 172.21.15.6:0/651670575 shutdown_connections 2023-07-21T22:34:37.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.778+0000 7fbcbac48640 1 -- 172.21.15.6:0/651670575 wait complete. 2023-07-21T22:34:37.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcbac48640 1 Processor -- start 2023-07-21T22:34:37.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcbac48640 1 -- start start 2023-07-21T22:34:37.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcbac48640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcb40d2300 0x7fbcb415dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:37.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcbac48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcb40d2fc0 0x7fbcb40ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:37.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcbac48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcb415bde0 0x7fbcb415c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:37.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcbac48640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb415d910 con 0x7fbcb40d2fc0 2023-07-21T22:34:37.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcbac48640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb415cd00 con 0x7fbcb40d2300 2023-07-21T22:34:37.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcbac48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb415cfe0 con 0x7fbcb415bde0 2023-07-21T22:34:37.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcb3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcb40d2fc0 0x7fbcb40ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:37.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcb3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcb40d2fc0 0x7fbcb40ce280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38642/0 (socket says 172.21.15.6:38642) 2023-07-21T22:34:37.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcb3fff640 1 -- 172.21.15.6:0/1119014225 learned_addr learned my addr 172.21.15.6:0/1119014225 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:37.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcb89e4640 1 --2- 172.21.15.6:0/1119014225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcb40d2300 0x7fbcb415dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:37.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcb91e5640 1 --2- 172.21.15.6:0/1119014225 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcb415bde0 0x7fbcb415c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:37.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcb3fff640 1 -- 172.21.15.6:0/1119014225 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcb415bde0 msgr2=0x7fbcb415c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:37.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcb3fff640 1 --2- 172.21.15.6:0/1119014225 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbcb415bde0 0x7fbcb415c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcb3fff640 1 -- 172.21.15.6:0/1119014225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcb40d2300 msgr2=0x7fbcb415dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:37.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcb3fff640 1 --2- 172.21.15.6:0/1119014225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbcb40d2300 0x7fbcb415dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:37.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcb3fff640 1 -- 172.21.15.6:0/1119014225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca0009420 con 0x7fbcb40d2fc0 2023-07-21T22:34:37.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcb3fff640 1 --2- 172.21.15.6:0/1119014225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcb40d2fc0 0x7fbcb40ce280 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fbca00190d0 tx=0x7fbca001ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:37.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcb17fa640 1 -- 172.21.15.6:0/1119014225 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca00aadc0 con 0x7fbcb40d2fc0 2023-07-21T22:34:37.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcb17fa640 1 -- 172.21.15.6:0/1119014225 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca00be410 con 0x7fbcb40d2fc0 2023-07-21T22:34:37.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcbac48640 1 -- 172.21.15.6:0/1119014225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb415d2c0 con 0x7fbcb40d2fc0 2023-07-21T22:34:37.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.782+0000 7fbcb17fa640 1 -- 172.21.15.6:0/1119014225 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca00be7c0 con 0x7fbcb40d2fc0 2023-07-21T22:34:37.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.786+0000 7fbcbac48640 1 -- 172.21.15.6:0/1119014225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb415e2e0 con 0x7fbcb40d2fc0 2023-07-21T22:34:37.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.786+0000 7fbcbac48640 1 -- 172.21.15.6:0/1119014225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb415da80 con 0x7fbcb40d2fc0 2023-07-21T22:34:37.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.786+0000 7fbcb17fa640 1 -- 172.21.15.6:0/1119014225 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 27) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fbca00be920 con 0x7fbcb40d2fc0 2023-07-21T22:34:37.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.786+0000 7fbcb17fa640 1 --2- 172.21.15.6:0/1119014225 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fbc980663f0 0x7fbc980688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:37.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.786+0000 7fbcb17fa640 1 -- 172.21.15.6:0/1119014225 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fbca011e370 con 0x7fbcb40d2fc0 2023-07-21T22:34:37.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.786+0000 7fbcb89e4640 1 -- 172.21.15.6:0/1119014225 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fbc980663f0 msgr2=0x7fbc980688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3045187557 2023-07-21T22:34:37.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.786+0000 7fbcb89e4640 1 --2- 172.21.15.6:0/1119014225 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fbc980663f0 0x7fbc980688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:37.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.794+0000 7fbcb17fa640 1 -- 172.21.15.6:0/1119014225 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbca00eb5b0 con 0x7fbcb40d2fc0 2023-07-21T22:34:38.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.974+0000 7fbcbac48640 1 -- 172.21.15.6:0/1119014225 --> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fbcb40b0e90 con 0x7fbc980663f0 2023-07-21T22:34:38.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.990+0000 7fbcb89e4640 1 -- 172.21.15.6:0/1119014225 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fbc980663f0 msgr2=0x7fbc980688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3045187557 2023-07-21T22:34:38.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:37.990+0000 7fbcb89e4640 1 --2- 172.21.15.6:0/1119014225 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fbc980663f0 0x7fbc980688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:34:38.109 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:38.064+0000 7faf86a46180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:34:38.169 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:38.124+0000 7faf86a46180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:34:38.192 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:38.142+0000 7f78e2448180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:34:38.224 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:38.176+0000 7faf86a46180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:34:38.253 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:38.202+0000 7f78e2448180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:34:38.309 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:38.264+0000 7faf86a46180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:34:38.311 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:38.262+0000 7f78e2448180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:34:38.366 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:38.320+0000 7faf86a46180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:34:38.402 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:38.350+0000 7f78e2448180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:34:38.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:38.394+0000 7fbcb89e4640 1 -- 172.21.15.6:0/1119014225 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fbc980663f0 msgr2=0x7fbc980688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3045187557 2023-07-21T22:34:38.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:38.394+0000 7fbcb89e4640 1 --2- 172.21.15.6:0/1119014225 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fbc980663f0 0x7fbc980688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-21T22:34:38.451 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:38.404+0000 7faf86a46180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:34:38.461 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:38.410+0000 7f78e2448180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:34:38.505 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:38.460+0000 7faf86a46180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:34:38.549 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:38.498+0000 7f78e2448180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:34:38.608 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:38.558+0000 7f78e2448180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:34:38.644 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:38.600+0000 7faf86a46180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:34:38.702 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:38.656+0000 7faf86a46180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:34:38.758 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:38.706+0000 7f78e2448180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:34:38.818 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:38.766+0000 7f78e2448180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:34:38.940 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:34:38.941 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:34:38.941 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:34:38.949 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:38.904+0000 7faf86a46180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:34:39.071 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:34:39.071 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:34:39.071 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:34:39.080 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:39.030+0000 7f78e2448180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:34:39.083 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:39.036+0000 7faf86a46180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:34:39.208 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:39.160+0000 7faf86a46180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:34:39.220 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:39.170+0000 7f78e2448180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:34:39.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:39.198+0000 7fbcb89e4640 1 -- 172.21.15.6:0/1119014225 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fbc980663f0 msgr2=0x7fbc980688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3045187557 2023-07-21T22:34:39.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:39.198+0000 7fbcb89e4640 1 --2- 172.21.15.6:0/1119014225 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fbc980663f0 0x7fbc980688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-21T22:34:39.277 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:39.232+0000 7faf86a46180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:34:39.351 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:39.302+0000 7f78e2448180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:34:39.410 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:39.364+0000 7faf86a46180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:34:39.424 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:39.374+0000 7f78e2448180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:34:39.565 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:39.514+0000 7f78e2448180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:34:39.940 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:39.892+0000 7faf86a46180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:34:40.028 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:39.984+0000 7faf86a46180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:34:40.132 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:40.082+0000 7f78e2448180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:34:40.179 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:40.132+0000 7faf86a46180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:34:40.220 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:40.170+0000 7f78e2448180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:34:40.261 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:40.216+0000 7faf86a46180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:34:40.375 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:40.322+0000 7f78e2448180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:34:40.462 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:40.410+0000 7f78e2448180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:34:40.526 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:40.480+0000 7faf86a46180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:34:40.585 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:40.540+0000 7faf86a46180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:34:40.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:40.546+0000 7fbcb17fa640 1 -- 172.21.15.6:0/1119014225 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 28) v1 ==== 85386+0+0 (secure 0 0 0) 0x7fbca00eb980 con 0x7fbcb40d2fc0 2023-07-21T22:34:40.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:40.546+0000 7fbcb17fa640 1 -- 172.21.15.6:0/1119014225 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fbc980663f0 msgr2=0x7fbc980688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:34:40.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:40.546+0000 7fbcb17fa640 1 --2- 172.21.15.6:0/1119014225 >> [v2:172.21.15.161:6832/3045187557,v1:172.21.15.161:6833/3045187557] conn(0x7fbc980663f0 0x7fbc980688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.720 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:40.672+0000 7faf07ea8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:40.721 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:40.672+0000 7faf07ea8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:40.721 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:40.672+0000 7faf07ea8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:40.721 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:40.672+0000 7faf07ea8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:40.721 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:40.672+0000 7faf07ea8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:40.721 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:40.676+0000 7faf04ea2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:40.721 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:40.676+0000 7faf04ea2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:40.721 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:40.676+0000 7faf04ea2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:40.722 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:40.676+0000 7faf04ea2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:40.722 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:40.676+0000 7faf04ea2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:40.763 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:40.710+0000 7f78e2448180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:34:40.826 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:40.774+0000 7f78e2448180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:34:41.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.554+0000 7fbcb17fa640 1 -- 172.21.15.6:0/1119014225 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mgrmap(e 29) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fbca00a8d20 con 0x7fbcb40d2fc0 2023-07-21T22:34:41.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.554+0000 7fbcb17fa640 1 --2- 172.21.15.6:0/1119014225 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7fbc98034090 0x7fbc98070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:41.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.554+0000 7fbcb17fa640 1 -- 172.21.15.6:0/1119014225 --> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc98070e90 con 0x7fbc98034090 2023-07-21T22:34:41.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.558+0000 7fbcb89e4640 1 --2- 172.21.15.6:0/1119014225 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7fbc98034090 0x7fbc98070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:41.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.566+0000 7fbcb89e4640 1 --2- 172.21.15.6:0/1119014225 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7fbc98034090 0x7fbc98070950 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbca8001010 tx=0x7fbca8007c30 comp rx=0 tx=0).ready entity=mgr.6685 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:41.623 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:41.576+0000 7faf0eeb6640 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-07-21T22:34:41.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.574+0000 7fbcb17fa640 1 -- 172.21.15.6:0/1119014225 <== mgr.6685 v2:172.21.15.161:6832/3509960293 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fbc98070e90 con 0x7fbc98034090 2023-07-21T22:34:41.624 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-07-21T22:34:41.633 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-07-21T22:34:41.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:34:41.634 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-21T22:34:41.646 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-21T22:34:41.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.786+0000 7fd4f479f640 1 Processor -- start 2023-07-21T22:34:41.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.786+0000 7fd4f479f640 1 -- start start 2023-07-21T22:34:41.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.786+0000 7fd4f479f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4ec0ccff0 0x7fd4ec15e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:41.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.786+0000 7fd4f479f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ec0cbe50 con 0x7fd4ec071030 2023-07-21T22:34:41.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.786+0000 7fd4f479f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ec0cd410 con 0x7fd4ec159a70 2023-07-21T22:34:41.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.786+0000 7fd4f479f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ec15e5a0 con 0x7fd4ec0ccff0 2023-07-21T22:34:41.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.786+0000 7fd4f1d3a640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd4ec071030 0x7fd4ec0c9da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34420/0 (socket says 172.21.15.6:34420) 2023-07-21T22:34:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.786+0000 7fd4f1d3a640 1 -- 172.21.15.6:0/1367159250 learned_addr learned my addr 172.21.15.6:0/1367159250 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.786+0000 7fd4f2d3c640 1 --2- 172.21.15.6:0/1367159250 >> v2:172.21.15.6:3300/0 conn(0x7fd4ec0ccff0 0x7fd4ec15e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.786+0000 7fd4f2d3c640 1 -- 172.21.15.6:0/1367159250 >> v1:172.21.15.161:6789/0 conn(0x7fd4ec159a70 legacy=0x7fd4ec070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.786+0000 7fd4f2d3c640 1 -- 172.21.15.6:0/1367159250 >> v1:172.21.15.6:6789/0 conn(0x7fd4ec071030 legacy=0x7fd4ec0c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:41.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.786+0000 7fd4f2d3c640 1 -- 172.21.15.6:0/1367159250 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec0cd660 con 0x7fd4ec0ccff0 2023-07-21T22:34:41.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.790+0000 7fd4f2d3c640 1 --2- 172.21.15.6:0/1367159250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4ec0ccff0 0x7fd4ec15e060 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4009d90 tx=0x7fd4e401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6472b79dbd56b8d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:41.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.790+0000 7fd4f1539640 1 -- 172.21.15.6:0/1367159250 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e40a5970 con 0x7fd4ec0ccff0 2023-07-21T22:34:41.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.790+0000 7fd4f1539640 1 -- 172.21.15.6:0/1367159250 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e40a5ad0 con 0x7fd4ec0ccff0 2023-07-21T22:34:41.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.790+0000 7fd4f1539640 1 -- 172.21.15.6:0/1367159250 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e40a5e60 con 0x7fd4ec0ccff0 2023-07-21T22:34:41.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.790+0000 7fd4f479f640 1 -- 172.21.15.6:0/1367159250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4ec0ccff0 msgr2=0x7fd4ec15e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.790+0000 7fd4f479f640 1 --2- 172.21.15.6:0/1367159250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4ec0ccff0 0x7fd4ec15e060 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4009d90 tx=0x7fd4e401c890 comp rx=0 tx=0).stop 2023-07-21T22:34:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.790+0000 7fd4f479f640 1 -- 172.21.15.6:0/1367159250 shutdown_connections 2023-07-21T22:34:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.790+0000 7fd4f479f640 1 --2- 172.21.15.6:0/1367159250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4ec0ccff0 0x7fd4ec15e060 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.790+0000 7fd4f479f640 1 -- 172.21.15.6:0/1367159250 >> 172.21.15.6:0/1367159250 conn(0x7fd4ec0afac0 msgr2=0x7fd4ec0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.790+0000 7fd4f479f640 1 -- 172.21.15.6:0/1367159250 shutdown_connections 2023-07-21T22:34:41.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.790+0000 7fd4f479f640 1 -- 172.21.15.6:0/1367159250 wait complete. 2023-07-21T22:34:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f479f640 1 Processor -- start 2023-07-21T22:34:41.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f479f640 1 -- start start 2023-07-21T22:34:41.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f479f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4ec071030 0x7fd4ec14c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:41.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f479f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4ec0ccff0 0x7fd4ec15aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:41.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f479f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4ec159a70 0x7fd4ec0aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:41.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f479f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec15b820 con 0x7fd4ec0ccff0 2023-07-21T22:34:41.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f479f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec15bb00 con 0x7fd4ec071030 2023-07-21T22:34:41.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f479f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec15bde0 con 0x7fd4ec159a70 2023-07-21T22:34:41.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f1d3a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4ec0ccff0 0x7fd4ec15aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:41.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f1d3a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4ec0ccff0 0x7fd4ec15aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38662/0 (socket says 172.21.15.6:38662) 2023-07-21T22:34:41.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f1d3a640 1 -- 172.21.15.6:0/3887253296 learned_addr learned my addr 172.21.15.6:0/3887253296 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:41.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f2d3c640 1 --2- 172.21.15.6:0/3887253296 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4ec159a70 0x7fd4ec0aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:41.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f253b640 1 --2- 172.21.15.6:0/3887253296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4ec071030 0x7fd4ec14c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:41.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f1d3a640 1 -- 172.21.15.6:0/3887253296 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4ec159a70 msgr2=0x7fd4ec0aeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:41.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f1d3a640 1 --2- 172.21.15.6:0/3887253296 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4ec159a70 0x7fd4ec0aeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:41.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f1d3a640 1 -- 172.21.15.6:0/3887253296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4ec071030 msgr2=0x7fd4ec14c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:41.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f1d3a640 1 --2- 172.21.15.6:0/3887253296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4ec071030 0x7fd4ec14c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:41.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f1d3a640 1 -- 172.21.15.6:0/3887253296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e4009a70 con 0x7fd4ec0ccff0 2023-07-21T22:34:41.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f1d3a640 1 --2- 172.21.15.6:0/3887253296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4ec0ccff0 0x7fd4ec15aed0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00c500 tx=0x7fd4dc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:41.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4e2ffd640 1 -- 172.21.15.6:0/3887253296 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc005cf0 con 0x7fd4ec0ccff0 2023-07-21T22:34:41.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4e2ffd640 1 -- 172.21.15.6:0/3887253296 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4dc005e50 con 0x7fd4ec0ccff0 2023-07-21T22:34:41.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4e2ffd640 1 -- 172.21.15.6:0/3887253296 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0072f0 con 0x7fd4ec0ccff0 2023-07-21T22:34:41.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f479f640 1 -- 172.21.15.6:0/3887253296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ec15c0c0 con 0x7fd4ec0ccff0 2023-07-21T22:34:41.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.794+0000 7fd4f479f640 1 -- 172.21.15.6:0/3887253296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ec15b410 con 0x7fd4ec0ccff0 2023-07-21T22:34:41.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.798+0000 7fd4f479f640 1 -- 172.21.15.6:0/3887253296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ec072c70 con 0x7fd4ec0ccff0 2023-07-21T22:34:41.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.798+0000 7fd4e2ffd640 1 -- 172.21.15.6:0/3887253296 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 29) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fd4dc007450 con 0x7fd4ec0ccff0 2023-07-21T22:34:41.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.798+0000 7fd4e2ffd640 1 --2- 172.21.15.6:0/3887253296 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7fd4d0066120 0x7fd4d00685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:41.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.798+0000 7fd4e2ffd640 1 -- 172.21.15.6:0/3887253296 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6450+0+0 (secure 0 0 0) 0x7fd4dc083100 con 0x7fd4ec0ccff0 2023-07-21T22:34:41.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.798+0000 7fd4f253b640 1 --2- 172.21.15.6:0/3887253296 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7fd4d0066120 0x7fd4d00685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:41.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.798+0000 7fd4f253b640 1 --2- 172.21.15.6:0/3887253296 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7fd4d0066120 0x7fd4d00685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8007fd0 tx=0x7fd4e8009040 comp rx=0 tx=0).ready entity=mgr.6685 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:41.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.802+0000 7fd4e2ffd640 1 -- 172.21.15.6:0/3887253296 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd4dc050710 con 0x7fd4ec0ccff0 2023-07-21T22:34:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:41.998+0000 7fd4f479f640 1 -- 172.21.15.6:0/3887253296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fd4ec15c2b0 con 0x7fd4ec0ccff0 2023-07-21T22:34:42.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.602+0000 7fd4e2ffd640 1 -- 172.21.15.6:0/3887253296 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 30) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fd4dc050ae0 con 0x7fd4ec0ccff0 2023-07-21T22:34:42.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.602+0000 7fd4e2ffd640 1 -- 172.21.15.6:0/3887253296 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v30) v1 ==== 93+0+0 (secure 0 0 0) 0x7fd4dc070130 con 0x7fd4ec0ccff0 2023-07-21T22:34:42.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.606+0000 7fd4f479f640 1 -- 172.21.15.6:0/3887253296 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7fd4d0066120 msgr2=0x7fd4d00685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:42.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.606+0000 7fd4f479f640 1 --2- 172.21.15.6:0/3887253296 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7fd4d0066120 0x7fd4d00685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8007fd0 tx=0x7fd4e8009040 comp rx=0 tx=0).stop 2023-07-21T22:34:42.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.606+0000 7fd4f479f640 1 -- 172.21.15.6:0/3887253296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4ec0ccff0 msgr2=0x7fd4ec15aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:42.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.606+0000 7fd4f479f640 1 --2- 172.21.15.6:0/3887253296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4ec0ccff0 0x7fd4ec15aed0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00c500 tx=0x7fd4dc00c9c0 comp rx=0 tx=0).stop 2023-07-21T22:34:42.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.606+0000 7fd4f479f640 1 -- 172.21.15.6:0/3887253296 shutdown_connections 2023-07-21T22:34:42.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.606+0000 7fd4f479f640 1 --2- 172.21.15.6:0/3887253296 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7fd4d0066120 0x7fd4d00685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:42.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.606+0000 7fd4f479f640 1 --2- 172.21.15.6:0/3887253296 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4ec159a70 0x7fd4ec0aeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:42.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.606+0000 7fd4f479f640 1 --2- 172.21.15.6:0/3887253296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4ec0ccff0 0x7fd4ec15aed0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:42.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.606+0000 7fd4f479f640 1 --2- 172.21.15.6:0/3887253296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4ec071030 0x7fd4ec14c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:42.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.606+0000 7fd4f479f640 1 -- 172.21.15.6:0/3887253296 >> 172.21.15.6:0/3887253296 conn(0x7fd4ec0afac0 msgr2=0x7fd4ec158320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:42.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.606+0000 7fd4f479f640 1 -- 172.21.15.6:0/3887253296 shutdown_connections 2023-07-21T22:34:42.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.606+0000 7fd4f479f640 1 -- 172.21.15.6:0/3887253296 wait complete. 2023-07-21T22:34:42.681 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:34:42.682 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:34:42.742 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:34:42.799 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:34:42.800 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:34:42.800 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:34:42.810 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:34:42.811 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:34:42.832 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:42.782+0000 7fd39c82c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:34:42.833 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:42.788+0000 7f80aab24180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:34:42.842 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:34:43.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.978+0000 7f25f9540640 1 Processor -- start 2023-07-21T22:34:43.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.978+0000 7f25f9540640 1 -- start start 2023-07-21T22:34:43.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.978+0000 7f25f9540640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f25f4145430 0x7f25f40b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:43.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.978+0000 7f25f9540640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f40b2140 con 0x7f25f40d06b0 2023-07-21T22:34:43.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.978+0000 7f25f9540640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f40b2410 con 0x7f25f40b39f0 2023-07-21T22:34:43.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.978+0000 7f25f9540640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f40b26f0 con 0x7f25f4145430 2023-07-21T22:34:43.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.978+0000 7f25ebfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f25f4145430 0x7f25f40b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:43.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.978+0000 7f25ebfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f25f4145430 0x7f25f40b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38694/0 (socket says 172.21.15.6:38694) 2023-07-21T22:34:43.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.978+0000 7f25ebfff640 1 -- 172.21.15.6:0/3736290292 learned_addr learned my addr 172.21.15.6:0/3736290292 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:43.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.978+0000 7f25f2ffd640 1 --1- 172.21.15.6:0/3736290292 >> v1:172.21.15.6:6789/0 conn(0x7f25f40d06b0 0x7f25f40b1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34436/0 (socket says 172.21.15.6:34436) 2023-07-21T22:34:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.982+0000 7f25ebfff640 1 -- 172.21.15.6:0/3736290292 >> v1:172.21.15.161:6789/0 conn(0x7f25f40b39f0 legacy=0x7f25f40d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.982+0000 7f25ebfff640 1 -- 172.21.15.6:0/3736290292 >> v1:172.21.15.6:6789/0 conn(0x7f25f40d06b0 legacy=0x7f25f40b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:43.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.982+0000 7f25ebfff640 1 -- 172.21.15.6:0/3736290292 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f40b29d0 con 0x7f25f4145430 2023-07-21T22:34:43.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.982+0000 7f25ebfff640 1 --2- 172.21.15.6:0/3736290292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25f4145430 0x7f25f40b34b0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f25dc009870 tx=0x7f25dc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0b4a019822c7f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.982+0000 7f25f27fc640 1 -- 172.21.15.6:0/3736290292 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc0aa670 con 0x7f25f4145430 2023-07-21T22:34:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.982+0000 7f25f27fc640 1 -- 172.21.15.6:0/3736290292 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc0aa7d0 con 0x7f25f4145430 2023-07-21T22:34:43.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.982+0000 7f25f27fc640 1 -- 172.21.15.6:0/3736290292 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc0aab60 con 0x7f25f4145430 2023-07-21T22:34:43.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25f9540640 1 -- 172.21.15.6:0/3736290292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25f4145430 msgr2=0x7f25f40b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:43.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25f9540640 1 --2- 172.21.15.6:0/3736290292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25f4145430 0x7f25f40b34b0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f25dc009870 tx=0x7f25dc01c510 comp rx=0 tx=0).stop 2023-07-21T22:34:43.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25f9540640 1 -- 172.21.15.6:0/3736290292 shutdown_connections 2023-07-21T22:34:43.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25f9540640 1 --2- 172.21.15.6:0/3736290292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25f4145430 0x7f25f40b34b0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25f9540640 1 -- 172.21.15.6:0/3736290292 >> 172.21.15.6:0/3736290292 conn(0x7f25f40659d0 msgr2=0x7f25f409b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:43.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25f9540640 1 -- 172.21.15.6:0/3736290292 shutdown_connections 2023-07-21T22:34:43.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25f9540640 1 -- 172.21.15.6:0/3736290292 wait complete. 2023-07-21T22:34:43.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25f9540640 1 Processor -- start 2023-07-21T22:34:43.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25f9540640 1 -- start start 2023-07-21T22:34:43.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25f9540640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25f40b39f0 0x7f25f40c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:43.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25f9540640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25f40d06b0 0x7f25f415dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:43.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25f9540640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25f415e1c0 0x7f25f40afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:43.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25f9540640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4153960 con 0x7f25f40d06b0 2023-07-21T22:34:43.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25f9540640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4152ce0 con 0x7f25f40b39f0 2023-07-21T22:34:43.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25f9540640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4152fc0 con 0x7f25f415e1c0 2023-07-21T22:34:43.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25ebfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25f40d06b0 0x7f25f415dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:43.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25ebfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25f40d06b0 0x7f25f415dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38710/0 (socket says 172.21.15.6:38710) 2023-07-21T22:34:43.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25ebfff640 1 -- 172.21.15.6:0/945849194 learned_addr learned my addr 172.21.15.6:0/945849194 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:43.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25f2ffd640 1 --2- 172.21.15.6:0/945849194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25f40b39f0 0x7f25f40c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:43.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25f37fe640 1 --2- 172.21.15.6:0/945849194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25f415e1c0 0x7f25f40afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:43.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25ebfff640 1 -- 172.21.15.6:0/945849194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25f415e1c0 msgr2=0x7f25f40afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:43.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25ebfff640 1 --2- 172.21.15.6:0/945849194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25f415e1c0 0x7f25f40afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25ebfff640 1 -- 172.21.15.6:0/945849194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25f40b39f0 msgr2=0x7f25f40c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:43.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25ebfff640 1 --2- 172.21.15.6:0/945849194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25f40b39f0 0x7f25f40c4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25ebfff640 1 -- 172.21.15.6:0/945849194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25dc0094d0 con 0x7f25f40d06b0 2023-07-21T22:34:43.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25f37fe640 1 --2- 172.21.15.6:0/945849194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25f415e1c0 0x7f25f40afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:43.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.986+0000 7f25ebfff640 1 --2- 172.21.15.6:0/945849194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25f40d06b0 0x7f25f415dc80 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f25dc019120 tx=0x7f25dc01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:43.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.990+0000 7f25eb7fe640 1 -- 172.21.15.6:0/945849194 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc0b38c0 con 0x7f25f40d06b0 2023-07-21T22:34:43.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.990+0000 7f25eb7fe640 1 -- 172.21.15.6:0/945849194 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc0b3a20 con 0x7f25f40d06b0 2023-07-21T22:34:43.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.990+0000 7f25eb7fe640 1 -- 172.21.15.6:0/945849194 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc0b3dd0 con 0x7f25f40d06b0 2023-07-21T22:34:43.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.990+0000 7f25f9540640 1 -- 172.21.15.6:0/945849194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f41532a0 con 0x7f25f40d06b0 2023-07-21T22:34:43.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.990+0000 7f25f9540640 1 -- 172.21.15.6:0/945849194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f40b7430 con 0x7f25f40d06b0 2023-07-21T22:34:43.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.990+0000 7f25f9540640 1 -- 172.21.15.6:0/945849194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f40b7620 con 0x7f25f40d06b0 2023-07-21T22:34:43.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.990+0000 7f25eb7fe640 1 -- 172.21.15.6:0/945849194 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 30) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f25dc0b2380 con 0x7f25f40d06b0 2023-07-21T22:34:43.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.990+0000 7f25eb7fe640 1 --2- 172.21.15.6:0/945849194 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f25d4066460 0x7f25d4068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:43.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.990+0000 7f25eb7fe640 1 -- 172.21.15.6:0/945849194 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f25dc11ec70 con 0x7f25f40d06b0 2023-07-21T22:34:43.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.990+0000 7f25f2ffd640 1 -- 172.21.15.6:0/945849194 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f25d4066460 msgr2=0x7f25d4068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3509960293 2023-07-21T22:34:43.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.990+0000 7f25f2ffd640 1 --2- 172.21.15.6:0/945849194 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f25d4066460 0x7f25d4068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:43.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:42.994+0000 7f25eb7fe640 1 -- 172.21.15.6:0/945849194 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f25f40b7620 con 0x7f25f40d06b0 2023-07-21T22:34:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.154+0000 7f25f9540640 1 -- 172.21.15.6:0/945849194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25f4153aa0 con 0x7f25f40d06b0 2023-07-21T22:34:43.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.154+0000 7f25eb7fe640 1 -- 172.21.15.6:0/945849194 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+18800 (secure 0 0 0) 0x7f25f4153aa0 con 0x7f25f40d06b0 2023-07-21T22:34:43.205 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:43.205 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":85,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:34:40.542753+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:34:21.475741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T22:34:22.347392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/2233957867":"2023-07-22T22:34:40.542719+0000","172.21.15.161:0/1213690087":"2023-07-22T22:34:40.542719+0000","172.21.15.161:6833/3045187557":"2023-07-22T22:34:40.542719+0000","172.21.15.161:0/4231263708":"2023-07-22T22:34:40.542719+0000","172.21.15.161:6832/3045187557":"2023-07-22T22:34:40.542719+0000","172.21.15.161:0/2666620273":"2023-07-22T22:34:40.542719+0000","172.21.15.161:0/1660078658":"2023-07-22T22:34:40.542719+0000","172.21.15.161:0/2609870133":"2023-07-22T22:34:40.542719+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:34:43.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.154+0000 7f25f9540640 1 -- 172.21.15.6:0/945849194 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f25d4066460 msgr2=0x7f25d4068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:34:43.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.154+0000 7f25f9540640 1 --2- 172.21.15.6:0/945849194 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f25d4066460 0x7f25d4068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.154+0000 7f25f9540640 1 -- 172.21.15.6:0/945849194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25f40d06b0 msgr2=0x7f25f415dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:43.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.154+0000 7f25f9540640 1 --2- 172.21.15.6:0/945849194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25f40d06b0 0x7f25f415dc80 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f25dc019120 tx=0x7f25dc01ad50 comp rx=0 tx=0).stop 2023-07-21T22:34:43.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.154+0000 7f25f9540640 1 -- 172.21.15.6:0/945849194 shutdown_connections 2023-07-21T22:34:43.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.154+0000 7f25f9540640 1 --2- 172.21.15.6:0/945849194 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f25d4066460 0x7f25d4068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.154+0000 7f25f9540640 1 --2- 172.21.15.6:0/945849194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f25f415e1c0 0x7f25f40afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.154+0000 7f25f9540640 1 --2- 172.21.15.6:0/945849194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25f40d06b0 0x7f25f415dc80 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.154+0000 7f25f9540640 1 --2- 172.21.15.6:0/945849194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25f40b39f0 0x7f25f40c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.154+0000 7f25f9540640 1 -- 172.21.15.6:0/945849194 >> 172.21.15.6:0/945849194 conn(0x7f25f40659d0 msgr2=0x7f25f415bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:43.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.158+0000 7f25f9540640 1 -- 172.21.15.6:0/945849194 shutdown_connections 2023-07-21T22:34:43.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.158+0000 7f25f9540640 1 -- 172.21.15.6:0/945849194 wait complete. 2023-07-21T22:34:43.228 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:34:21.475741+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:34:22.347392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:34:43.229 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:34:43.254 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:43.208+0000 7f80aab24180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:34:43.287 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:43.238+0000 7fd39c82c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:34:43.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.330+0000 7f0c924f9640 1 Processor -- start 2023-07-21T22:34:43.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.330+0000 7f0c924f9640 1 -- start start 2023-07-21T22:34:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.330+0000 7f0c924f9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8c15bde0 0x7f0c8c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.330+0000 7f0c924f9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0c8c0d2300 0x7f0c8c0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.330+0000 7f0c924f9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8c0b04c0 con 0x7f0c8c0d2fc0 2023-07-21T22:34:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.330+0000 7f0c924f9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8c0d2ce0 con 0x7f0c8c0d2300 2023-07-21T22:34:43.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.330+0000 7f0c924f9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c15c1b0 con 0x7f0c8c15bde0 2023-07-21T22:34:43.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.330+0000 7f0c8b7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0c8c0d2fc0 0x7f0c8c0b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34446/0 (socket says 172.21.15.6:34446) 2023-07-21T22:34:43.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.330+0000 7f0c8b7fe640 1 -- 172.21.15.6:0/3531930284 learned_addr learned my addr 172.21.15.6:0/3531930284 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:43.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.330+0000 7f0c8bfff640 1 --2- 172.21.15.6:0/3531930284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8c15bde0 0x7f0c8c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:43.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.330+0000 7f0c90a96640 1 --2- 172.21.15.6:0/3531930284 >> v2:172.21.15.161:3300/0 conn(0x7f0c8c0d2300 0x7f0c8c0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:43.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.330+0000 7f0c8affd640 1 -- 172.21.15.6:0/3531930284 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144469419 0 0) 0x7f0c8c0b04c0 con 0x7f0c8c0d2fc0 2023-07-21T22:34:43.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.330+0000 7f0c8affd640 1 -- 172.21.15.6:0/3531930284 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c74003530 con 0x7f0c8c0d2fc0 2023-07-21T22:34:43.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.330+0000 7f0c90a96640 1 -- 172.21.15.6:0/3531930284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8c15bde0 msgr2=0x7f0c8c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:43.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.330+0000 7f0c90a96640 1 --2- 172.21.15.6:0/3531930284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8c15bde0 0x7f0c8c0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.330+0000 7f0c90a96640 1 -- 172.21.15.6:0/3531930284 >> v1:172.21.15.6:6789/0 conn(0x7f0c8c0d2fc0 legacy=0x7f0c8c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:43.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.330+0000 7f0c90a96640 1 -- 172.21.15.6:0/3531930284 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c0b1060 con 0x7f0c8c0d2300 2023-07-21T22:34:43.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.330+0000 7f0c8bfff640 1 --2- 172.21.15.6:0/3531930284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8c15bde0 0x7f0c8c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.334+0000 7f0c90a96640 1 --2- 172.21.15.6:0/3531930284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c8c0d2300 0x7f0c8c0d27a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009d90 tx=0x7f0c8401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=222cd9f5d48047d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.334+0000 7f0c8affd640 1 -- 172.21.15.6:0/3531930284 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c840a5920 con 0x7f0c8c0d2300 2023-07-21T22:34:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.334+0000 7f0c8affd640 1 -- 172.21.15.6:0/3531930284 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c840a5a80 con 0x7f0c8c0d2300 2023-07-21T22:34:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.334+0000 7f0c8affd640 1 -- 172.21.15.6:0/3531930284 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c840a5df0 con 0x7f0c8c0d2300 2023-07-21T22:34:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.334+0000 7f0c924f9640 1 -- 172.21.15.6:0/3531930284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c8c0d2300 msgr2=0x7f0c8c0d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.334+0000 7f0c924f9640 1 --2- 172.21.15.6:0/3531930284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c8c0d2300 0x7f0c8c0d27a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009d90 tx=0x7f0c8401c950 comp rx=0 tx=0).stop 2023-07-21T22:34:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.334+0000 7f0c924f9640 1 -- 172.21.15.6:0/3531930284 shutdown_connections 2023-07-21T22:34:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.334+0000 7f0c924f9640 1 --2- 172.21.15.6:0/3531930284 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c8c0d2300 0x7f0c8c0d27a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.334+0000 7f0c924f9640 1 --2- 172.21.15.6:0/3531930284 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8c15bde0 0x7f0c8c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.334+0000 7f0c924f9640 1 -- 172.21.15.6:0/3531930284 >> 172.21.15.6:0/3531930284 conn(0x7f0c8c0659d0 msgr2=0x7f0c8c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.334+0000 7f0c924f9640 1 -- 172.21.15.6:0/3531930284 shutdown_connections 2023-07-21T22:34:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.334+0000 7f0c924f9640 1 -- 172.21.15.6:0/3531930284 wait complete. 2023-07-21T22:34:43.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c924f9640 1 Processor -- start 2023-07-21T22:34:43.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c924f9640 1 -- start start 2023-07-21T22:34:43.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c924f9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8c0d2300 0x7f0c8c153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:43.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c924f9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c8c0d2fc0 0x7f0c8c15c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:43.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c924f9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c8c15bde0 0x7f0c8c159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:43.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c924f9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c142bb0 con 0x7f0c8c0d2fc0 2023-07-21T22:34:43.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c924f9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c153f10 con 0x7f0c8c15bde0 2023-07-21T22:34:43.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c924f9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c141f30 con 0x7f0c8c0d2300 2023-07-21T22:34:43.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c8b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c8c0d2fc0 0x7f0c8c15c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:43.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c8b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c8c0d2fc0 0x7f0c8c15c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38712/0 (socket says 172.21.15.6:38712) 2023-07-21T22:34:43.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c8b7fe640 1 -- 172.21.15.6:0/4033265015 learned_addr learned my addr 172.21.15.6:0/4033265015 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:43.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c8bfff640 1 --2- 172.21.15.6:0/4033265015 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8c0d2300 0x7f0c8c153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:43.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c90a96640 1 --2- 172.21.15.6:0/4033265015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c8c15bde0 0x7f0c8c159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:43.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c8b7fe640 1 -- 172.21.15.6:0/4033265015 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8c0d2300 msgr2=0x7f0c8c153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:43.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c8b7fe640 1 --2- 172.21.15.6:0/4033265015 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8c0d2300 0x7f0c8c153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c8b7fe640 1 -- 172.21.15.6:0/4033265015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c8c15bde0 msgr2=0x7f0c8c159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:43.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c8b7fe640 1 --2- 172.21.15.6:0/4033265015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c8c15bde0 0x7f0c8c159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c8b7fe640 1 -- 172.21.15.6:0/4033265015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7c0093b0 con 0x7f0c8c0d2fc0 2023-07-21T22:34:43.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c8b7fe640 1 --2- 172.21.15.6:0/4033265015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c8c0d2fc0 0x7f0c8c15c4d0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000c450 tx=0x7f0c8000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:43.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c88ff9640 1 -- 172.21.15.6:0/4033265015 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c80005cf0 con 0x7f0c8c0d2fc0 2023-07-21T22:34:43.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c88ff9640 1 -- 172.21.15.6:0/4033265015 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c80005e50 con 0x7f0c8c0d2fc0 2023-07-21T22:34:43.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c88ff9640 1 -- 172.21.15.6:0/4033265015 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c80007290 con 0x7f0c8c0d2fc0 2023-07-21T22:34:43.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c924f9640 1 -- 172.21.15.6:0/4033265015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c84009a70 con 0x7f0c8c0d2fc0 2023-07-21T22:34:43.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.338+0000 7f0c924f9640 1 -- 172.21.15.6:0/4033265015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8c1424f0 con 0x7f0c8c0d2fc0 2023-07-21T22:34:43.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.342+0000 7f0c924f9640 1 -- 172.21.15.6:0/4033265015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8c142cf0 con 0x7f0c8c0d2fc0 2023-07-21T22:34:43.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.342+0000 7f0c88ff9640 1 -- 172.21.15.6:0/4033265015 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 30) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f0c800073f0 con 0x7f0c8c0d2fc0 2023-07-21T22:34:43.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.342+0000 7f0c88ff9640 1 --2- 172.21.15.6:0/4033265015 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f0c78066430 0x7f0c780688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:43.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.342+0000 7f0c88ff9640 1 -- 172.21.15.6:0/4033265015 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f0c80083710 con 0x7f0c8c0d2fc0 2023-07-21T22:34:43.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.342+0000 7f0c8bfff640 1 -- 172.21.15.6:0/4033265015 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f0c78066430 msgr2=0x7f0c780688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3509960293 2023-07-21T22:34:43.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.342+0000 7f0c8bfff640 1 --2- 172.21.15.6:0/4033265015 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f0c78066430 0x7f0c780688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:43.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.346+0000 7f0c88ff9640 1 -- 172.21.15.6:0/4033265015 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c8c142cf0 con 0x7f0c8c0d2fc0 2023-07-21T22:34:43.405 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:43.360+0000 7f80aab24180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:34:43.411 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:34:43.416 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:34:43.454 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:43.402+0000 7fd39c82c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:34:43.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.502+0000 7f0c924f9640 1 -- 172.21.15.6:0/4033265015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c8c142cf0 con 0x7f0c8c0d2fc0 2023-07-21T22:34:43.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.502+0000 7f0c88ff9640 1 -- 172.21.15.6:0/4033265015 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c80017020 con 0x7f0c8c0d2fc0 2023-07-21T22:34:43.554 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:34:43.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.506+0000 7f0c924f9640 1 -- 172.21.15.6:0/4033265015 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f0c78066430 msgr2=0x7f0c780688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:34:43.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.506+0000 7f0c924f9640 1 --2- 172.21.15.6:0/4033265015 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f0c78066430 0x7f0c780688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.506+0000 7f0c924f9640 1 -- 172.21.15.6:0/4033265015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c8c0d2fc0 msgr2=0x7f0c8c15c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.506+0000 7f0c924f9640 1 --2- 172.21.15.6:0/4033265015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c8c0d2fc0 0x7f0c8c15c4d0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000c450 tx=0x7f0c8000c910 comp rx=0 tx=0).stop 2023-07-21T22:34:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.506+0000 7f0c924f9640 1 -- 172.21.15.6:0/4033265015 shutdown_connections 2023-07-21T22:34:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.506+0000 7f0c924f9640 1 --2- 172.21.15.6:0/4033265015 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f0c78066430 0x7f0c780688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.506+0000 7f0c924f9640 1 --2- 172.21.15.6:0/4033265015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c8c15bde0 0x7f0c8c159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.506+0000 7f0c924f9640 1 --2- 172.21.15.6:0/4033265015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c8c0d2fc0 0x7f0c8c15c4d0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.506+0000 7f0c924f9640 1 --2- 172.21.15.6:0/4033265015 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c8c0d2300 0x7f0c8c153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.506+0000 7f0c924f9640 1 -- 172.21.15.6:0/4033265015 >> 172.21.15.6:0/4033265015 conn(0x7f0c8c0659d0 msgr2=0x7f0c8c0cdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.506+0000 7f0c924f9640 1 -- 172.21.15.6:0/4033265015 shutdown_connections 2023-07-21T22:34:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.506+0000 7f0c924f9640 1 -- 172.21.15.6:0/4033265015 wait complete. 2023-07-21T22:34:43.576 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:34:43.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.674+0000 7f8307103640 1 Processor -- start 2023-07-21T22:34:43.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.674+0000 7f8307103640 1 -- start start 2023-07-21T22:34:43.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.678+0000 7f8307103640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f83000d2300 0x7f83000d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:43.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.678+0000 7f8307103640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83000b04c0 con 0x7f830015bde0 2023-07-21T22:34:43.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.678+0000 7f8307103640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83000b1060 con 0x7f83000d2fc0 2023-07-21T22:34:43.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.678+0000 7f8307103640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f830015c1b0 con 0x7f83000d2300 2023-07-21T22:34:43.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.678+0000 7f8304e9f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f830015bde0 0x7f83000d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34450/0 (socket says 172.21.15.6:34450) 2023-07-21T22:34:43.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.678+0000 7f8304e9f640 1 -- 172.21.15.6:0/1804976080 learned_addr learned my addr 172.21.15.6:0/1804976080 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:43.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.678+0000 7f83056a0640 1 --2- 172.21.15.6:0/1804976080 >> v2:172.21.15.161:3300/0 conn(0x7f83000d2300 0x7f83000d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:43.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.678+0000 7f82ff7fe640 1 -- 172.21.15.6:0/1804976080 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144747706 0 0) 0x7f83000b04c0 con 0x7f830015bde0 2023-07-21T22:34:43.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.678+0000 7f82ff7fe640 1 -- 172.21.15.6:0/1804976080 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82f0003530 con 0x7f830015bde0 2023-07-21T22:34:43.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.678+0000 7f83056a0640 1 -- 172.21.15.6:0/1804976080 >> v1:172.21.15.161:6789/0 conn(0x7f83000d2fc0 legacy=0x7f83000b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:43.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.678+0000 7f83056a0640 1 -- 172.21.15.6:0/1804976080 >> v1:172.21.15.6:6789/0 conn(0x7f830015bde0 legacy=0x7f83000d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:43.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.678+0000 7f83056a0640 1 -- 172.21.15.6:0/1804976080 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83000d2c80 con 0x7f83000d2300 2023-07-21T22:34:43.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.682+0000 7f83056a0640 1 --2- 172.21.15.6:0/1804976080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83000d2300 0x7f83000d2740 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f82f8009d90 tx=0x7f82f801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1675c3a641291a52 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:43.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.682+0000 7f82ff7fe640 1 -- 172.21.15.6:0/1804976080 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f80a5920 con 0x7f83000d2300 2023-07-21T22:34:43.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.682+0000 7f82ff7fe640 1 -- 172.21.15.6:0/1804976080 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f80a5a80 con 0x7f83000d2300 2023-07-21T22:34:43.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.682+0000 7f82ff7fe640 1 -- 172.21.15.6:0/1804976080 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f80a5df0 con 0x7f83000d2300 2023-07-21T22:34:43.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.682+0000 7f8307103640 1 -- 172.21.15.6:0/1804976080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83000d2300 msgr2=0x7f83000d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:43.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.682+0000 7f8307103640 1 --2- 172.21.15.6:0/1804976080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83000d2300 0x7f83000d2740 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f82f8009d90 tx=0x7f82f801c950 comp rx=0 tx=0).stop 2023-07-21T22:34:43.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.682+0000 7f8307103640 1 -- 172.21.15.6:0/1804976080 shutdown_connections 2023-07-21T22:34:43.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.682+0000 7f8307103640 1 --2- 172.21.15.6:0/1804976080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83000d2300 0x7f83000d2740 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.682+0000 7f8307103640 1 -- 172.21.15.6:0/1804976080 >> 172.21.15.6:0/1804976080 conn(0x7f83000659d0 msgr2=0x7f830009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:43.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.682+0000 7f8307103640 1 -- 172.21.15.6:0/1804976080 shutdown_connections 2023-07-21T22:34:43.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.682+0000 7f8307103640 1 -- 172.21.15.6:0/1804976080 wait complete. 2023-07-21T22:34:43.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.682+0000 7f8307103640 1 Processor -- start 2023-07-21T22:34:43.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.682+0000 7f8307103640 1 -- start start 2023-07-21T22:34:43.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f8307103640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83000d2300 0x7f83000b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:43.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f8307103640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83000d2fc0 0x7f83000b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:43.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f8307103640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f830015bde0 0x7f8300152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:43.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f8307103640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83000b23b0 con 0x7f830015bde0 2023-07-21T22:34:43.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f8307103640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83000b25c0 con 0x7f83000d2300 2023-07-21T22:34:43.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f8307103640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83000b2b00 con 0x7f83000d2fc0 2023-07-21T22:34:43.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f83056a0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f830015bde0 0x7f8300152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:43.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f83056a0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f830015bde0 0x7f8300152b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38726/0 (socket says 172.21.15.6:38726) 2023-07-21T22:34:43.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f83056a0640 1 -- 172.21.15.6:0/1561484216 learned_addr learned my addr 172.21.15.6:0/1561484216 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:43.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f8304e9f640 1 --2- 172.21.15.6:0/1561484216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83000d2300 0x7f83000b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:43.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f82fffff640 1 --2- 172.21.15.6:0/1561484216 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83000d2fc0 0x7f83000b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:43.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f83056a0640 1 -- 172.21.15.6:0/1561484216 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83000d2fc0 msgr2=0x7f83000b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:43.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f83056a0640 1 --2- 172.21.15.6:0/1561484216 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83000d2fc0 0x7f83000b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f83056a0640 1 -- 172.21.15.6:0/1561484216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83000d2300 msgr2=0x7f83000b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:43.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f83056a0640 1 --2- 172.21.15.6:0/1561484216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83000d2300 0x7f83000b6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f83056a0640 1 -- 172.21.15.6:0/1561484216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f8009a70 con 0x7f830015bde0 2023-07-21T22:34:43.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f83056a0640 1 --2- 172.21.15.6:0/1561484216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f830015bde0 0x7f8300152b80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f82f8009d90 tx=0x7f82f80196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:43.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f82fd7fa640 1 -- 172.21.15.6:0/1561484216 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8003db0 con 0x7f830015bde0 2023-07-21T22:34:43.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f82fd7fa640 1 -- 172.21.15.6:0/1561484216 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f8004040 con 0x7f830015bde0 2023-07-21T22:34:43.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f8307103640 1 -- 172.21.15.6:0/1561484216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83000b2de0 con 0x7f830015bde0 2023-07-21T22:34:43.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f82fd7fa640 1 -- 172.21.15.6:0/1561484216 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f80043b0 con 0x7f830015bde0 2023-07-21T22:34:43.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f8307103640 1 -- 172.21.15.6:0/1561484216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83000b33a0 con 0x7f830015bde0 2023-07-21T22:34:43.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.686+0000 7f8307103640 1 -- 172.21.15.6:0/1561484216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83000b3590 con 0x7f830015bde0 2023-07-21T22:34:43.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.690+0000 7f82fd7fa640 1 -- 172.21.15.6:0/1561484216 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 30) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f82f80b4070 con 0x7f830015bde0 2023-07-21T22:34:43.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.690+0000 7f82fd7fa640 1 --2- 172.21.15.6:0/1561484216 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f82e4066430 0x7f82e40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:43.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.690+0000 7f82fd7fa640 1 -- 172.21.15.6:0/1561484216 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f82f811eda0 con 0x7f830015bde0 2023-07-21T22:34:43.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.690+0000 7f8304e9f640 1 -- 172.21.15.6:0/1561484216 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f82e4066430 msgr2=0x7f82e40688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3509960293 2023-07-21T22:34:43.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.690+0000 7f8304e9f640 1 --2- 172.21.15.6:0/1561484216 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f82e4066430 0x7f82e40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:43.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.698+0000 7f82fd7fa640 1 -- 172.21.15.6:0/1561484216 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f82f80ebe20 con 0x7f830015bde0 2023-07-21T22:34:43.893 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:43.848+0000 7f80aab24180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:34:43.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.850+0000 7f8307103640 1 -- 172.21.15.6:0/1561484216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f83000b3590 con 0x7f830015bde0 2023-07-21T22:34:43.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.850+0000 7f82fd7fa640 1 -- 172.21.15.6:0/1561484216 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v85) v1 ==== 92+0+10 (secure 0 0 0) 0x7f82f80b2020 con 0x7f830015bde0 2023-07-21T22:34:43.903 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:34:43.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.854+0000 7f8307103640 1 -- 172.21.15.6:0/1561484216 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f82e4066430 msgr2=0x7f82e40688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:34:43.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.854+0000 7f8307103640 1 --2- 172.21.15.6:0/1561484216 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f82e4066430 0x7f82e40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.854+0000 7f8307103640 1 -- 172.21.15.6:0/1561484216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f830015bde0 msgr2=0x7f8300152b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:43.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.854+0000 7f8307103640 1 --2- 172.21.15.6:0/1561484216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f830015bde0 0x7f8300152b80 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f82f8009d90 tx=0x7f82f80196f0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.854+0000 7f8307103640 1 -- 172.21.15.6:0/1561484216 shutdown_connections 2023-07-21T22:34:43.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.854+0000 7f8307103640 1 --2- 172.21.15.6:0/1561484216 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f82e4066430 0x7f82e40688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.854+0000 7f8307103640 1 --2- 172.21.15.6:0/1561484216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f830015bde0 0x7f8300152b80 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.854+0000 7f8307103640 1 --2- 172.21.15.6:0/1561484216 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83000d2fc0 0x7f83000b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.854+0000 7f8307103640 1 --2- 172.21.15.6:0/1561484216 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83000d2300 0x7f83000b6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:43.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.854+0000 7f8307103640 1 -- 172.21.15.6:0/1561484216 >> 172.21.15.6:0/1561484216 conn(0x7f83000659d0 msgr2=0x7f83000cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:43.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.854+0000 7f8307103640 1 -- 172.21.15.6:0/1561484216 shutdown_connections 2023-07-21T22:34:43.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:43.854+0000 7f8307103640 1 -- 172.21.15.6:0/1561484216 wait complete. 2023-07-21T22:34:43.926 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:34:43.952 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:43.904+0000 7f80aab24180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:34:43.988 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:43.938+0000 7fd39c82c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:34:44.008 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:43.960+0000 7f80aab24180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:34:44.053 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:44.002+0000 7fd39c82c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:34:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.026+0000 7fc326767640 1 Processor -- start 2023-07-21T22:34:44.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.026+0000 7fc326767640 1 -- start start 2023-07-21T22:34:44.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.026+0000 7fc326767640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc3200d2fc0 0x7fc3200b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:44.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.026+0000 7fc326767640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3200d2300 0x7fc3200d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:44.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.026+0000 7fc326767640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3200b04c0 con 0x7fc32015bde0 2023-07-21T22:34:44.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.026+0000 7fc326767640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32015c1b0 con 0x7fc3200d2fc0 2023-07-21T22:34:44.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.026+0000 7fc326767640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3200d2cc0 con 0x7fc3200d2300 2023-07-21T22:34:44.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.026+0000 7fc31ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc32015bde0 0x7fc3200d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34462/0 (socket says 172.21.15.6:34462) 2023-07-21T22:34:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.026+0000 7fc31ffff640 1 -- 172.21.15.6:0/2159028137 learned_addr learned my addr 172.21.15.6:0/2159028137 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.026+0000 7fc31f7fe640 1 --2- 172.21.15.6:0/2159028137 >> v2:172.21.15.161:3300/0 conn(0x7fc3200d2fc0 0x7fc3200b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.026+0000 7fc324d04640 1 --2- 172.21.15.6:0/2159028137 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3200d2300 0x7fc3200d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:44.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.026+0000 7fc31f7fe640 1 -- 172.21.15.6:0/2159028137 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3200d2300 msgr2=0x7fc3200d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.026+0000 7fc31f7fe640 1 --2- 172.21.15.6:0/2159028137 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3200d2300 0x7fc3200d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.026+0000 7fc31f7fe640 1 -- 172.21.15.6:0/2159028137 >> v1:172.21.15.6:6789/0 conn(0x7fc32015bde0 legacy=0x7fc3200d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.026+0000 7fc31effd640 1 -- 172.21.15.6:0/2159028137 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124301833 0 0) 0x7fc3200b04c0 con 0x7fc32015bde0 2023-07-21T22:34:44.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.026+0000 7fc31f7fe640 1 -- 172.21.15.6:0/2159028137 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3200d0aa0 con 0x7fc3200d2fc0 2023-07-21T22:34:44.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.030+0000 7fc31f7fe640 1 --2- 172.21.15.6:0/2159028137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3200d2fc0 0x7fc3200b0950 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc3140097c0 tx=0x7fc31401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58b3314fd60992b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:44.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.030+0000 7fc31effd640 1 -- 172.21.15.6:0/2159028137 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3140ab680 con 0x7fc3200d2fc0 2023-07-21T22:34:44.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.030+0000 7fc31effd640 1 -- 172.21.15.6:0/2159028137 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3140ab7e0 con 0x7fc3200d2fc0 2023-07-21T22:34:44.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.030+0000 7fc31effd640 1 -- 172.21.15.6:0/2159028137 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3140abb70 con 0x7fc3200d2fc0 2023-07-21T22:34:44.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.030+0000 7fc326767640 1 -- 172.21.15.6:0/2159028137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3200d2fc0 msgr2=0x7fc3200b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:44.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.030+0000 7fc326767640 1 --2- 172.21.15.6:0/2159028137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3200d2fc0 0x7fc3200b0950 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc3140097c0 tx=0x7fc31401c480 comp rx=0 tx=0).stop 2023-07-21T22:34:44.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.030+0000 7fc326767640 1 -- 172.21.15.6:0/2159028137 shutdown_connections 2023-07-21T22:34:44.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.030+0000 7fc326767640 1 --2- 172.21.15.6:0/2159028137 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3200d2300 0x7fc3200d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.030+0000 7fc326767640 1 --2- 172.21.15.6:0/2159028137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3200d2fc0 0x7fc3200b0950 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.030+0000 7fc326767640 1 -- 172.21.15.6:0/2159028137 >> 172.21.15.6:0/2159028137 conn(0x7fc3200659d0 msgr2=0x7fc32009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:44.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.030+0000 7fc326767640 1 -- 172.21.15.6:0/2159028137 shutdown_connections 2023-07-21T22:34:44.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.030+0000 7fc326767640 1 -- 172.21.15.6:0/2159028137 wait complete. 2023-07-21T22:34:44.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc326767640 1 Processor -- start 2023-07-21T22:34:44.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc326767640 1 -- start start 2023-07-21T22:34:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc326767640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3200d2300 0x7fc3201588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc326767640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3200d2fc0 0x7fc32015db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc326767640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc32015bde0 0x7fc3200c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc326767640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3200b1230 con 0x7fc3200d2300 2023-07-21T22:34:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc326767640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3200b1510 con 0x7fc32015bde0 2023-07-21T22:34:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc326767640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3200b17f0 con 0x7fc3200d2fc0 2023-07-21T22:34:44.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc31ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3200d2300 0x7fc3201588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc31ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3200d2300 0x7fc3201588f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38728/0 (socket says 172.21.15.6:38728) 2023-07-21T22:34:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc324d04640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc32015bde0 0x7fc3200c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc31ffff640 1 -- 172.21.15.6:0/2102596819 learned_addr learned my addr 172.21.15.6:0/2102596819 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:44.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc31f7fe640 1 --2- 172.21.15.6:0/2102596819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3200d2fc0 0x7fc32015db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:44.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc31ffff640 1 -- 172.21.15.6:0/2102596819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3200d2fc0 msgr2=0x7fc32015db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:44.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc31ffff640 1 --2- 172.21.15.6:0/2102596819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3200d2fc0 0x7fc32015db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc31ffff640 1 -- 172.21.15.6:0/2102596819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc32015bde0 msgr2=0x7fc3200c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:44.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc31ffff640 1 --2- 172.21.15.6:0/2102596819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc32015bde0 0x7fc3200c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc31ffff640 1 -- 172.21.15.6:0/2102596819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc314009420 con 0x7fc3200d2300 2023-07-21T22:34:44.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc324d04640 1 --2- 172.21.15.6:0/2102596819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc32015bde0 0x7fc3200c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:44.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc31ffff640 1 --2- 172.21.15.6:0/2102596819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3200d2300 0x7fc3201588f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc3100010f0 tx=0x7fc31000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:44.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc31cff9640 1 -- 172.21.15.6:0/2102596819 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310007270 con 0x7fc3200d2300 2023-07-21T22:34:44.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc31cff9640 1 -- 172.21.15.6:0/2102596819 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3100073d0 con 0x7fc3200d2300 2023-07-21T22:34:44.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc31cff9640 1 -- 172.21.15.6:0/2102596819 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3100057b0 con 0x7fc3200d2300 2023-07-21T22:34:44.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc326767640 1 -- 172.21.15.6:0/2102596819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3200b1ad0 con 0x7fc3200d2300 2023-07-21T22:34:44.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.034+0000 7fc326767640 1 -- 172.21.15.6:0/2102596819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32015f0b0 con 0x7fc3200d2300 2023-07-21T22:34:44.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.038+0000 7fc326767640 1 -- 172.21.15.6:0/2102596819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3200678d0 con 0x7fc3200d2300 2023-07-21T22:34:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.038+0000 7fc31cff9640 1 -- 172.21.15.6:0/2102596819 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 30) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fc310005910 con 0x7fc3200d2300 2023-07-21T22:34:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.038+0000 7fc31cff9640 1 --2- 172.21.15.6:0/2102596819 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7fc30c066430 0x7fc30c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.038+0000 7fc31cff9640 1 -- 172.21.15.6:0/2102596819 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6450+0+0 (secure 0 0 0) 0x7fc310083630 con 0x7fc3200d2300 2023-07-21T22:34:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.038+0000 7fc31f7fe640 1 -- 172.21.15.6:0/2102596819 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7fc30c066430 msgr2=0x7fc30c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3509960293 2023-07-21T22:34:44.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.038+0000 7fc31f7fe640 1 --2- 172.21.15.6:0/2102596819 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7fc30c066430 0x7fc30c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:44.094 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:44.048+0000 7f80aab24180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:34:44.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.046+0000 7fc31cff9640 1 -- 172.21.15.6:0/2102596819 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc310050890 con 0x7fc3200d2300 2023-07-21T22:34:44.120 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:44.070+0000 7fd39c82c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:34:44.153 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:44.108+0000 7f80aab24180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:34:44.212 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:44.162+0000 7fd39c82c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:34:44.238 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:44.192+0000 7f80aab24180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:34:44.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.202+0000 7fc326767640 1 -- 172.21.15.6:0/2102596819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3200cc7a0 con 0x7fc3200d2300 2023-07-21T22:34:44.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.206+0000 7fc31cff9640 1 -- 172.21.15.6:0/2102596819 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc310053eb0 con 0x7fc3200d2300 2023-07-21T22:34:44.256 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:34:44.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.206+0000 7fc326767640 1 -- 172.21.15.6:0/2102596819 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7fc30c066430 msgr2=0x7fc30c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:34:44.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.206+0000 7fc326767640 1 --2- 172.21.15.6:0/2102596819 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7fc30c066430 0x7fc30c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.206+0000 7fc326767640 1 -- 172.21.15.6:0/2102596819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3200d2300 msgr2=0x7fc3201588f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:44.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.206+0000 7fc326767640 1 --2- 172.21.15.6:0/2102596819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3200d2300 0x7fc3201588f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fc3100010f0 tx=0x7fc31000cbe0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.206+0000 7fc326767640 1 -- 172.21.15.6:0/2102596819 shutdown_connections 2023-07-21T22:34:44.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.206+0000 7fc326767640 1 --2- 172.21.15.6:0/2102596819 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7fc30c066430 0x7fc30c0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.206+0000 7fc326767640 1 --2- 172.21.15.6:0/2102596819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc32015bde0 0x7fc3200c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.206+0000 7fc326767640 1 --2- 172.21.15.6:0/2102596819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3200d2fc0 0x7fc32015db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.206+0000 7fc326767640 1 --2- 172.21.15.6:0/2102596819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3200d2300 0x7fc3201588f0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.206+0000 7fc326767640 1 -- 172.21.15.6:0/2102596819 >> 172.21.15.6:0/2102596819 conn(0x7fc3200659d0 msgr2=0x7fc3200cd970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.206+0000 7fc326767640 1 -- 172.21.15.6:0/2102596819 shutdown_connections 2023-07-21T22:34:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.206+0000 7fc326767640 1 -- 172.21.15.6:0/2102596819 wait complete. 2023-07-21T22:34:44.274 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:44.222+0000 7fd39c82c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:34:44.277 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:34:44.294 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:44.248+0000 7f80aab24180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:34:44.366 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:44.314+0000 7fd39c82c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:34:44.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.374+0000 7f699526d640 1 Processor -- start 2023-07-21T22:34:44.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.374+0000 7f699526d640 1 -- start start 2023-07-21T22:34:44.427 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:44.378+0000 7fd39c82c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:34:44.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.378+0000 7f699526d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6990069430 0x7f6990069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:44.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.378+0000 7f699526d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6990070f30 0x7f69900ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:44.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.378+0000 7f699526d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6990159d70 con 0x7f69900af2b0 2023-07-21T22:34:44.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.378+0000 7f699526d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6990069d40 con 0x7f6990069430 2023-07-21T22:34:44.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.378+0000 7f699526d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69900c9c60 con 0x7f6990070f30 2023-07-21T22:34:44.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.378+0000 7f698effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6990069430 0x7f6990069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:44.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.378+0000 7f698effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6990069430 0x7f6990069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38736/0 (socket says 172.21.15.6:38736) 2023-07-21T22:34:44.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.378+0000 7f698effd640 1 -- 172.21.15.6:0/1210529473 learned_addr learned my addr 172.21.15.6:0/1210529473 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:44.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.378+0000 7f698f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f69900af2b0 0x7f699015a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34476/0 (socket says 172.21.15.6:34476) 2023-07-21T22:34:44.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.378+0000 7f6987fff640 1 --2- 172.21.15.6:0/1210529473 >> v2:172.21.15.161:3300/0 conn(0x7f6990070f30 0x7f69900ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:44.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.378+0000 7f698effd640 1 -- 172.21.15.6:0/1210529473 >> v2:172.21.15.161:3300/0 conn(0x7f6990070f30 msgr2=0x7f69900ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:44.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.378+0000 7f698effd640 1 --2- 172.21.15.6:0/1210529473 >> v2:172.21.15.161:3300/0 conn(0x7f6990070f30 0x7f69900ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.378+0000 7f698effd640 1 -- 172.21.15.6:0/1210529473 >> v1:172.21.15.6:6789/0 conn(0x7f69900af2b0 legacy=0x7f699015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:44.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.378+0000 7f698effd640 1 -- 172.21.15.6:0/1210529473 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69900c9f40 con 0x7f6990069430 2023-07-21T22:34:44.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.382+0000 7f698effd640 1 --2- 172.21.15.6:0/1210529473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6990069430 0x7f6990069800 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f69900c9830 tx=0x7f698001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff350469e6ba714 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:44.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.382+0000 7f698e7fc640 1 -- 172.21.15.6:0/1210529473 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69800ab610 con 0x7f6990069430 2023-07-21T22:34:44.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.382+0000 7f698e7fc640 1 -- 172.21.15.6:0/1210529473 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69800ab770 con 0x7f6990069430 2023-07-21T22:34:44.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.382+0000 7f698e7fc640 1 -- 172.21.15.6:0/1210529473 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69800abb00 con 0x7f6990069430 2023-07-21T22:34:44.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.382+0000 7f699526d640 1 -- 172.21.15.6:0/1210529473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6990069430 msgr2=0x7f6990069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:44.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.382+0000 7f699526d640 1 --2- 172.21.15.6:0/1210529473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6990069430 0x7f6990069800 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f69900c9830 tx=0x7f698001c500 comp rx=0 tx=0).stop 2023-07-21T22:34:44.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.382+0000 7f699526d640 1 -- 172.21.15.6:0/1210529473 shutdown_connections 2023-07-21T22:34:44.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.382+0000 7f699526d640 1 --2- 172.21.15.6:0/1210529473 >> v2:172.21.15.161:3300/0 conn(0x7f6990070f30 0x7f69900ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.382+0000 7f699526d640 1 --2- 172.21.15.6:0/1210529473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6990069430 0x7f6990069800 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.382+0000 7f699526d640 1 -- 172.21.15.6:0/1210529473 >> 172.21.15.6:0/1210529473 conn(0x7f69900cde90 msgr2=0x7f69900ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:44.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.382+0000 7f699526d640 1 -- 172.21.15.6:0/1210529473 shutdown_connections 2023-07-21T22:34:44.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.382+0000 7f699526d640 1 -- 172.21.15.6:0/1210529473 wait complete. 2023-07-21T22:34:44.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.382+0000 7f699526d640 1 Processor -- start 2023-07-21T22:34:44.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.382+0000 7f699526d640 1 -- start start 2023-07-21T22:34:44.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f699526d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6990069430 0x7f699014d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:44.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f699526d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6990070f30 0x7f699014b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:44.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f699526d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69900af2b0 0x7f69901579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:44.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f699526d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699014cf60 con 0x7f69900af2b0 2023-07-21T22:34:44.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f699526d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6990158710 con 0x7f6990070f30 2023-07-21T22:34:44.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f699526d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699014bd00 con 0x7f6990069430 2023-07-21T22:34:44.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f698f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69900af2b0 0x7f69901579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:44.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f698f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69900af2b0 0x7f69901579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38744/0 (socket says 172.21.15.6:38744) 2023-07-21T22:34:44.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f698f7fe640 1 -- 172.21.15.6:0/2016738065 learned_addr learned my addr 172.21.15.6:0/2016738065 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:44.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f6987fff640 1 --2- 172.21.15.6:0/2016738065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6990070f30 0x7f699014b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:44.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f698effd640 1 --2- 172.21.15.6:0/2016738065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6990069430 0x7f699014d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:44.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f698f7fe640 1 -- 172.21.15.6:0/2016738065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6990069430 msgr2=0x7f699014d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:44.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f698f7fe640 1 --2- 172.21.15.6:0/2016738065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6990069430 0x7f699014d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f698f7fe640 1 -- 172.21.15.6:0/2016738065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6990070f30 msgr2=0x7f699014b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:44.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f698f7fe640 1 --2- 172.21.15.6:0/2016738065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6990070f30 0x7f699014b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f698f7fe640 1 -- 172.21.15.6:0/2016738065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69800094d0 con 0x7f69900af2b0 2023-07-21T22:34:44.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f698f7fe640 1 --2- 172.21.15.6:0/2016738065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69900af2b0 0x7f69901579c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f698800c7a0 tx=0x7f698800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:44.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f69877fe640 1 -- 172.21.15.6:0/2016738065 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698800a640 con 0x7f69900af2b0 2023-07-21T22:34:44.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f69877fe640 1 -- 172.21.15.6:0/2016738065 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698800a7a0 con 0x7f69900af2b0 2023-07-21T22:34:44.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f699526d640 1 -- 172.21.15.6:0/2016738065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6990150050 con 0x7f69900af2b0 2023-07-21T22:34:44.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f69877fe640 1 -- 172.21.15.6:0/2016738065 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698800ab10 con 0x7f69900af2b0 2023-07-21T22:34:44.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f699526d640 1 -- 172.21.15.6:0/2016738065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699014c910 con 0x7f69900af2b0 2023-07-21T22:34:44.440 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:44.392+0000 7f80aab24180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:34:44.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.386+0000 7f699526d640 1 -- 172.21.15.6:0/2016738065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f699014d0d0 con 0x7f69900af2b0 2023-07-21T22:34:44.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.390+0000 7f69877fe640 1 -- 172.21.15.6:0/2016738065 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 30) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f698800ac70 con 0x7f69900af2b0 2023-07-21T22:34:44.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.390+0000 7f69877fe640 1 --2- 172.21.15.6:0/2016738065 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f6970066430 0x7f69700688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:44.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.390+0000 7f69877fe640 1 -- 172.21.15.6:0/2016738065 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f6988083790 con 0x7f69900af2b0 2023-07-21T22:34:44.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.390+0000 7f698effd640 1 -- 172.21.15.6:0/2016738065 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f6970066430 msgr2=0x7f69700688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3509960293 2023-07-21T22:34:44.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.390+0000 7f698effd640 1 --2- 172.21.15.6:0/2016738065 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f6970066430 0x7f69700688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:44.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.394+0000 7f69877fe640 1 -- 172.21.15.6:0/2016738065 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6988050960 con 0x7f69900af2b0 2023-07-21T22:34:44.496 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:44.448+0000 7f80aab24180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:34:44.583 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:44.534+0000 7fd39c82c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:34:44.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.550+0000 7f699526d640 1 -- 172.21.15.6:0/2016738065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6990159d70 con 0x7f69900af2b0 2023-07-21T22:34:44.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.554+0000 7f69877fe640 1 -- 172.21.15.6:0/2016738065 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6990159d70 con 0x7f69900af2b0 2023-07-21T22:34:44.604 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:34:44.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.554+0000 7f699526d640 1 -- 172.21.15.6:0/2016738065 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f6970066430 msgr2=0x7f69700688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:34:44.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.554+0000 7f699526d640 1 --2- 172.21.15.6:0/2016738065 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f6970066430 0x7f69700688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.554+0000 7f699526d640 1 -- 172.21.15.6:0/2016738065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69900af2b0 msgr2=0x7f69901579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:44.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.554+0000 7f699526d640 1 --2- 172.21.15.6:0/2016738065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69900af2b0 0x7f69901579c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f698800c7a0 tx=0x7f698800cc60 comp rx=0 tx=0).stop 2023-07-21T22:34:44.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.554+0000 7f699526d640 1 -- 172.21.15.6:0/2016738065 shutdown_connections 2023-07-21T22:34:44.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.554+0000 7f699526d640 1 --2- 172.21.15.6:0/2016738065 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f6970066430 0x7f69700688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.554+0000 7f699526d640 1 --2- 172.21.15.6:0/2016738065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69900af2b0 0x7f69901579c0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.554+0000 7f699526d640 1 --2- 172.21.15.6:0/2016738065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6990070f30 0x7f699014b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.554+0000 7f699526d640 1 --2- 172.21.15.6:0/2016738065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6990069430 0x7f699014d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.554+0000 7f699526d640 1 -- 172.21.15.6:0/2016738065 >> 172.21.15.6:0/2016738065 conn(0x7f69900cde90 msgr2=0x7f699006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:44.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.554+0000 7f699526d640 1 -- 172.21.15.6:0/2016738065 shutdown_connections 2023-07-21T22:34:44.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.554+0000 7f699526d640 1 -- 172.21.15.6:0/2016738065 wait complete. 2023-07-21T22:34:44.625 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:34:44.647 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:44.598+0000 7fd39c82c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:34:44.737 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:34:44.737 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:34:44.737 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:34:44.745 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:44.700+0000 7f80aab24180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:34:44.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.722+0000 7f2260974640 1 Processor -- start 2023-07-21T22:34:44.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.722+0000 7f2260974640 1 -- start start 2023-07-21T22:34:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.722+0000 7f2260974640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f225c15fd60 0x7f225c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.722+0000 7f2260974640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225c0ccaf0 con 0x7f225c0d1850 2023-07-21T22:34:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.722+0000 7f2260974640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225c160320 con 0x7f225c0b7c70 2023-07-21T22:34:44.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.722+0000 7f2260974640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225c0d1190 con 0x7f225c15fd60 2023-07-21T22:34:44.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.726+0000 7f2259d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f225c15fd60 0x7f225c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:44.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.726+0000 7f225ad9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f225c0d1850 0x7f225c0d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34486/0 (socket says 172.21.15.6:34486) 2023-07-21T22:34:44.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.726+0000 7f225ad9d640 1 -- 172.21.15.6:0/1161924490 learned_addr learned my addr 172.21.15.6:0/1161924490 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:44.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.726+0000 7f225959a640 1 -- 172.21.15.6:0/1161924490 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602628577 0 0) 0x7f225c0ccaf0 con 0x7f225c0d1850 2023-07-21T22:34:44.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.726+0000 7f225959a640 1 -- 172.21.15.6:0/1161924490 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2244003530 con 0x7f225c0d1850 2023-07-21T22:34:44.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.726+0000 7f225959a640 1 -- 172.21.15.6:0/1161924490 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511078976 0 0) 0x7f225c160320 con 0x7f225c0b7c70 2023-07-21T22:34:44.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.726+0000 7f225959a640 1 -- 172.21.15.6:0/1161924490 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f225c0ccaf0 con 0x7f225c0b7c70 2023-07-21T22:34:44.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.726+0000 7f2259d9b640 1 -- 172.21.15.6:0/1161924490 >> v1:172.21.15.161:6789/0 conn(0x7f225c0b7c70 legacy=0x7f225c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:44.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.726+0000 7f2259d9b640 1 -- 172.21.15.6:0/1161924490 >> v1:172.21.15.6:6789/0 conn(0x7f225c0d1850 legacy=0x7f225c0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:44.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.726+0000 7f2259d9b640 1 -- 172.21.15.6:0/1161924490 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c0ccd90 con 0x7f225c15fd60 2023-07-21T22:34:44.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.726+0000 7f2259d9b640 1 --2- 172.21.15.6:0/1161924490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c15fd60 0x7f225c0d0c50 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f22500097c0 tx=0x7f225001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a418dc3427f789a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.726+0000 7f225959a640 1 -- 172.21.15.6:0/1161924490 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22500a8050 con 0x7f225c15fd60 2023-07-21T22:34:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.726+0000 7f225959a640 1 -- 172.21.15.6:0/1161924490 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22500ac5f0 con 0x7f225c15fd60 2023-07-21T22:34:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.726+0000 7f225959a640 1 -- 172.21.15.6:0/1161924490 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22500ac960 con 0x7f225c15fd60 2023-07-21T22:34:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.730+0000 7f2260974640 1 -- 172.21.15.6:0/1161924490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c15fd60 msgr2=0x7f225c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.730+0000 7f2260974640 1 --2- 172.21.15.6:0/1161924490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c15fd60 0x7f225c0d0c50 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f22500097c0 tx=0x7f225001c480 comp rx=0 tx=0).stop 2023-07-21T22:34:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.730+0000 7f2260974640 1 -- 172.21.15.6:0/1161924490 shutdown_connections 2023-07-21T22:34:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.730+0000 7f2260974640 1 --2- 172.21.15.6:0/1161924490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c15fd60 0x7f225c0d0c50 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.730+0000 7f2260974640 1 -- 172.21.15.6:0/1161924490 >> 172.21.15.6:0/1161924490 conn(0x7f225c0650b0 msgr2=0x7f225c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.730+0000 7f2260974640 1 -- 172.21.15.6:0/1161924490 shutdown_connections 2023-07-21T22:34:44.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.730+0000 7f2260974640 1 -- 172.21.15.6:0/1161924490 wait complete. 2023-07-21T22:34:44.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.730+0000 7f2260974640 1 Processor -- start 2023-07-21T22:34:44.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.730+0000 7f2260974640 1 -- start start 2023-07-21T22:34:44.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.730+0000 7f2260974640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f225c0b7c70 0x7f225c0b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:44.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.730+0000 7f2260974640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c0d1850 0x7f225c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:44.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.730+0000 7f2260974640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f225c15fd60 0x7f225c146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:44.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.730+0000 7f2260974640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c14d1b0 con 0x7f225c0d1850 2023-07-21T22:34:44.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.730+0000 7f2260974640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c156460 con 0x7f225c15fd60 2023-07-21T22:34:44.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.730+0000 7f2260974640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c14d400 con 0x7f225c0b7c70 2023-07-21T22:34:44.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.734+0000 7f2259d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c0d1850 0x7f225c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:44.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.734+0000 7f2259d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c0d1850 0x7f225c155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38766/0 (socket says 172.21.15.6:38766) 2023-07-21T22:34:44.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.734+0000 7f2259d9b640 1 -- 172.21.15.6:0/1787354436 learned_addr learned my addr 172.21.15.6:0/1787354436 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:44.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.734+0000 7f225ad9d640 1 --2- 172.21.15.6:0/1787354436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f225c15fd60 0x7f225c146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:44.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.734+0000 7f225a59c640 1 --2- 172.21.15.6:0/1787354436 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f225c0b7c70 0x7f225c0b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:44.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.734+0000 7f2259d9b640 1 -- 172.21.15.6:0/1787354436 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f225c0b7c70 msgr2=0x7f225c0b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:44.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.734+0000 7f2259d9b640 1 --2- 172.21.15.6:0/1787354436 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f225c0b7c70 0x7f225c0b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.734+0000 7f2259d9b640 1 -- 172.21.15.6:0/1787354436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f225c15fd60 msgr2=0x7f225c146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:44.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.734+0000 7f2259d9b640 1 --2- 172.21.15.6:0/1787354436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f225c15fd60 0x7f225c146660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:44.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.734+0000 7f2259d9b640 1 -- 172.21.15.6:0/1787354436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2250009420 con 0x7f225c0d1850 2023-07-21T22:34:44.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.734+0000 7f2259d9b640 1 --2- 172.21.15.6:0/1787354436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c0d1850 0x7f225c155b80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f225001a0b0 tx=0x7f2250019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:44.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.734+0000 7f224affd640 1 -- 172.21.15.6:0/1787354436 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22500b7690 con 0x7f225c0d1850 2023-07-21T22:34:44.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.734+0000 7f224affd640 1 -- 172.21.15.6:0/1787354436 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22500b77f0 con 0x7f225c0d1850 2023-07-21T22:34:44.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.734+0000 7f224affd640 1 -- 172.21.15.6:0/1787354436 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22500b7b80 con 0x7f225c0d1850 2023-07-21T22:34:44.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.734+0000 7f2260974640 1 -- 172.21.15.6:0/1787354436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225c14d6e0 con 0x7f225c0d1850 2023-07-21T22:34:44.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.734+0000 7f2260974640 1 -- 172.21.15.6:0/1787354436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225c1560c0 con 0x7f225c0d1850 2023-07-21T22:34:44.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.734+0000 7f2260974640 1 -- 172.21.15.6:0/1787354436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225c0c9220 con 0x7f225c0d1850 2023-07-21T22:34:44.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.734+0000 7f224affd640 1 -- 172.21.15.6:0/1787354436 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 30) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f22500b3040 con 0x7f225c0d1850 2023-07-21T22:34:44.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.738+0000 7f224affd640 1 --2- 172.21.15.6:0/1787354436 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f223c066430 0x7f223c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:44.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.738+0000 7f224affd640 1 -- 172.21.15.6:0/1787354436 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f225011ea50 con 0x7f225c0d1850 2023-07-21T22:34:44.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.738+0000 7f225a59c640 1 -- 172.21.15.6:0/1787354436 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f223c066430 msgr2=0x7f223c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3509960293 2023-07-21T22:34:44.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.738+0000 7f225a59c640 1 --2- 172.21.15.6:0/1787354436 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f223c066430 0x7f223c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:44.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.742+0000 7f224affd640 1 -- 172.21.15.6:0/1787354436 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f22500ebaf0 con 0x7f225c0d1850 2023-07-21T22:34:44.879 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:44.832+0000 7f80aab24180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:34:44.907 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:34:44.907 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:34:44.907 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:34:44.916 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:44.866+0000 7fd39c82c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:34:44.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.942+0000 7f225a59c640 1 -- 172.21.15.6:0/1787354436 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f223c066430 msgr2=0x7f223c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3509960293 2023-07-21T22:34:44.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.942+0000 7f225a59c640 1 --2- 172.21.15.6:0/1787354436 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f223c066430 0x7f223c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:34:45.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.950+0000 7f2260974640 1 -- 172.21.15.6:0/1787354436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f225c0678d0 con 0x7f225c0d1850 2023-07-21T22:34:45.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.950+0000 7f224affd640 1 -- 172.21.15.6:0/1787354436 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v85) v1 ==== 80+0+478 (secure 0 0 0) 0x7f22500b11f0 con 0x7f225c0d1850 2023-07-21T22:34:45.003 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/2233957867 2023-07-22T22:34:40.542719+0000 2023-07-21T22:34:45.003 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/1213690087 2023-07-22T22:34:40.542719+0000 2023-07-21T22:34:45.003 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6833/3045187557 2023-07-22T22:34:40.542719+0000 2023-07-21T22:34:45.003 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/4231263708 2023-07-22T22:34:40.542719+0000 2023-07-21T22:34:45.004 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6832/3045187557 2023-07-22T22:34:40.542719+0000 2023-07-21T22:34:45.004 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/2666620273 2023-07-22T22:34:40.542719+0000 2023-07-21T22:34:45.004 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/1660078658 2023-07-22T22:34:40.542719+0000 2023-07-21T22:34:45.004 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/2609870133 2023-07-22T22:34:40.542719+0000 2023-07-21T22:34:45.005 INFO:teuthology.orchestra.run.smithi006.stderr:listed 8 entries 2023-07-21T22:34:45.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.954+0000 7f2260974640 1 -- 172.21.15.6:0/1787354436 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f223c066430 msgr2=0x7f223c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:34:45.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.954+0000 7f2260974640 1 --2- 172.21.15.6:0/1787354436 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f223c066430 0x7f223c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.954+0000 7f2260974640 1 -- 172.21.15.6:0/1787354436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c0d1850 msgr2=0x7f225c155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:45.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.954+0000 7f2260974640 1 --2- 172.21.15.6:0/1787354436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c0d1850 0x7f225c155b80 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f225001a0b0 tx=0x7f2250019220 comp rx=0 tx=0).stop 2023-07-21T22:34:45.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.954+0000 7f2260974640 1 -- 172.21.15.6:0/1787354436 shutdown_connections 2023-07-21T22:34:45.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.954+0000 7f2260974640 1 --2- 172.21.15.6:0/1787354436 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f223c066430 0x7f223c0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.954+0000 7f2260974640 1 --2- 172.21.15.6:0/1787354436 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f225c15fd60 0x7f225c146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.954+0000 7f2260974640 1 --2- 172.21.15.6:0/1787354436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f225c0d1850 0x7f225c155b80 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.954+0000 7f2260974640 1 --2- 172.21.15.6:0/1787354436 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f225c0b7c70 0x7f225c0b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.954+0000 7f2260974640 1 -- 172.21.15.6:0/1787354436 >> 172.21.15.6:0/1787354436 conn(0x7f225c0650b0 msgr2=0x7f225c0b26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:45.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.954+0000 7f2260974640 1 -- 172.21.15.6:0/1787354436 shutdown_connections 2023-07-21T22:34:45.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:44.954+0000 7f2260974640 1 -- 172.21.15.6:0/1787354436 wait complete. 2023-07-21T22:34:45.007 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:44.960+0000 7f80aab24180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:34:45.024 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-21T22:34:45.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:34:45.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-21T22:34:45.060 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:45.010+0000 7fd39c82c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:34:45.074 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:45.028+0000 7f80aab24180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:34:45.131 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:34:45.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:34:45.132 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T22:34:45.142 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:34:45.142 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:34:45.151 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:34:45.151 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:34:45.152 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:34:45.191 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:34:45.191 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:34:45.192 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:34:45.196 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:45.146+0000 7fd39c82c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:34:45.201 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:34:45.201 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:34:45.210 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:45.164+0000 7f80aab24180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:34:45.273 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:45.222+0000 7fd39c82c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:34:45.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.294+0000 7f89a3c9c640 1 Processor -- start 2023-07-21T22:34:45.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.298+0000 7f89a3c9c640 1 -- start start 2023-07-21T22:34:45.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.298+0000 7f89a3c9c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f899c0d06b0 0x7f899c0b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:45.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.298+0000 7f89a3c9c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f899c145430 0x7f899c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:45.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.298+0000 7f89a3c9c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899c0b2410 con 0x7f899c0b1f70 2023-07-21T22:34:45.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.298+0000 7f89a3c9c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899c0b26f0 con 0x7f899c0d06b0 2023-07-21T22:34:45.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.298+0000 7f89a3c9c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0b29d0 con 0x7f899c145430 2023-07-21T22:34:45.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.298+0000 7f89a2239640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f899c0b1f70 0x7f899c0d22e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34494/0 (socket says 172.21.15.6:34494) 2023-07-21T22:34:45.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.298+0000 7f89a2239640 1 -- 172.21.15.6:0/2174659191 learned_addr learned my addr 172.21.15.6:0/2174659191 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:45.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.298+0000 7f89a1a38640 1 --2- 172.21.15.6:0/2174659191 >> v2:172.21.15.161:3300/0 conn(0x7f899c0d06b0 0x7f899c0b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:45.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.298+0000 7f89a1237640 1 --2- 172.21.15.6:0/2174659191 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f899c145430 0x7f899c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:45.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.298+0000 7f89a0a36640 1 -- 172.21.15.6:0/2174659191 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876777654 0 0) 0x7f899c0b2410 con 0x7f899c0b1f70 2023-07-21T22:34:45.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.298+0000 7f89a0a36640 1 -- 172.21.15.6:0/2174659191 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8988003530 con 0x7f899c0b1f70 2023-07-21T22:34:45.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.298+0000 7f89a1237640 1 -- 172.21.15.6:0/2174659191 >> v2:172.21.15.161:3300/0 conn(0x7f899c0d06b0 msgr2=0x7f899c0b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:45.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.298+0000 7f89a1237640 1 --2- 172.21.15.6:0/2174659191 >> v2:172.21.15.161:3300/0 conn(0x7f899c0d06b0 0x7f899c0b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.298+0000 7f89a1237640 1 -- 172.21.15.6:0/2174659191 >> v1:172.21.15.6:6789/0 conn(0x7f899c0b1f70 legacy=0x7f899c0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:45.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.298+0000 7f89a1237640 1 -- 172.21.15.6:0/2174659191 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c0b2cb0 con 0x7f899c145430 2023-07-21T22:34:45.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.298+0000 7f89a1a38640 1 --2- 172.21.15.6:0/2174659191 >> v2:172.21.15.161:3300/0 conn(0x7f899c0d06b0 0x7f899c0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:45.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.302+0000 7f89a1237640 1 --2- 172.21.15.6:0/2174659191 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f899c145430 0x7f899c0b34b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f898c0097c0 tx=0x7f898c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6726118d4bfdebce server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:45.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.302+0000 7f89a0a36640 1 -- 172.21.15.6:0/2174659191 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c0ab670 con 0x7f899c145430 2023-07-21T22:34:45.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.302+0000 7f89a0a36640 1 -- 172.21.15.6:0/2174659191 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c0ab7d0 con 0x7f899c145430 2023-07-21T22:34:45.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.302+0000 7f89a0a36640 1 -- 172.21.15.6:0/2174659191 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c0abb40 con 0x7f899c145430 2023-07-21T22:34:45.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.302+0000 7f89a3c9c640 1 -- 172.21.15.6:0/2174659191 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f899c145430 msgr2=0x7f899c0b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.302+0000 7f89a3c9c640 1 --2- 172.21.15.6:0/2174659191 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f899c145430 0x7f899c0b34b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f898c0097c0 tx=0x7f898c01c450 comp rx=0 tx=0).stop 2023-07-21T22:34:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.302+0000 7f89a3c9c640 1 -- 172.21.15.6:0/2174659191 shutdown_connections 2023-07-21T22:34:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.302+0000 7f89a3c9c640 1 --2- 172.21.15.6:0/2174659191 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f899c145430 0x7f899c0b34b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.302+0000 7f89a3c9c640 1 --2- 172.21.15.6:0/2174659191 >> v2:172.21.15.161:3300/0 conn(0x7f899c0d06b0 0x7f899c0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.302+0000 7f89a3c9c640 1 -- 172.21.15.6:0/2174659191 >> 172.21.15.6:0/2174659191 conn(0x7f899c0659d0 msgr2=0x7f899c09b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.302+0000 7f89a3c9c640 1 -- 172.21.15.6:0/2174659191 shutdown_connections 2023-07-21T22:34:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.302+0000 7f89a3c9c640 1 -- 172.21.15.6:0/2174659191 wait complete. 2023-07-21T22:34:45.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a3c9c640 1 Processor -- start 2023-07-21T22:34:45.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a3c9c640 1 -- start start 2023-07-21T22:34:45.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a3c9c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f899c0b1f70 0x7f899c153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:45.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a3c9c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f899c0d06b0 0x7f899c0b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:45.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a3c9c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f899c0b6cf0 0x7f899c0b7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:45.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a3c9c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c154640 con 0x7f899c0b1f70 2023-07-21T22:34:45.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a3c9c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0b76d0 con 0x7f899c0d06b0 2023-07-21T22:34:45.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a3c9c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899c15bdf0 con 0x7f899c0b6cf0 2023-07-21T22:34:45.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a1a38640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f899c0b1f70 0x7f899c153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:45.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a1a38640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f899c0b1f70 0x7f899c153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38782/0 (socket says 172.21.15.6:38782) 2023-07-21T22:34:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a1a38640 1 -- 172.21.15.6:0/266056230 learned_addr learned my addr 172.21.15.6:0/266056230 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a1237640 1 --2- 172.21.15.6:0/266056230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f899c0d06b0 0x7f899c0b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:45.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a2239640 1 --2- 172.21.15.6:0/266056230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f899c0b6cf0 0x7f899c0b7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a1a38640 1 -- 172.21.15.6:0/266056230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f899c0b6cf0 msgr2=0x7f899c0b7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a1a38640 1 --2- 172.21.15.6:0/266056230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f899c0b6cf0 0x7f899c0b7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a1a38640 1 -- 172.21.15.6:0/266056230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f899c0d06b0 msgr2=0x7f899c0b67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:45.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a1a38640 1 --2- 172.21.15.6:0/266056230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f899c0d06b0 0x7f899c0b67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a1a38640 1 -- 172.21.15.6:0/266056230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8998009420 con 0x7f899c0b1f70 2023-07-21T22:34:45.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a1a38640 1 --2- 172.21.15.6:0/266056230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f899c0b1f70 0x7f899c153620 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f899800ebe0 tx=0x7f899800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:45.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89927fc640 1 -- 172.21.15.6:0/266056230 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899800eee0 con 0x7f899c0b1f70 2023-07-21T22:34:45.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89927fc640 1 -- 172.21.15.6:0/266056230 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899800cc30 con 0x7f899c0b1f70 2023-07-21T22:34:45.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89927fc640 1 -- 172.21.15.6:0/266056230 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998013470 con 0x7f899c0b1f70 2023-07-21T22:34:45.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a3c9c640 1 -- 172.21.15.6:0/266056230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f898c009420 con 0x7f899c0b1f70 2023-07-21T22:34:45.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.306+0000 7f89a3c9c640 1 -- 172.21.15.6:0/266056230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899c154260 con 0x7f899c0b1f70 2023-07-21T22:34:45.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.310+0000 7f89a3c9c640 1 -- 172.21.15.6:0/266056230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f899c072e70 con 0x7f899c0b1f70 2023-07-21T22:34:45.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.310+0000 7f89927fc640 1 -- 172.21.15.6:0/266056230 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 30) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f89980135d0 con 0x7f899c0b1f70 2023-07-21T22:34:45.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.310+0000 7f89927fc640 1 --2- 172.21.15.6:0/266056230 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f8980066460 0x7f8980068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:45.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.310+0000 7f89927fc640 1 -- 172.21.15.6:0/266056230 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f8998084390 con 0x7f899c0b1f70 2023-07-21T22:34:45.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.310+0000 7f89a1237640 1 -- 172.21.15.6:0/266056230 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f8980066460 msgr2=0x7f8980068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3509960293 2023-07-21T22:34:45.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.310+0000 7f89a1237640 1 --2- 172.21.15.6:0/266056230 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f8980066460 0x7f8980068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:45.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.314+0000 7f89927fc640 1 -- 172.21.15.6:0/266056230 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f89980514c0 con 0x7f899c0b1f70 2023-07-21T22:34:45.451 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:45.402+0000 7fd39c82c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:34:45.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.514+0000 7f89a1237640 1 -- 172.21.15.6:0/266056230 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f8980066460 msgr2=0x7f8980068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3509960293 2023-07-21T22:34:45.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.514+0000 7f89a1237640 1 --2- 172.21.15.6:0/266056230 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f8980066460 0x7f8980068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:34:45.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.538+0000 7f89a3c9c640 1 -- 172.21.15.6:0/266056230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f899c153de0 con 0x7f899c0b1f70 2023-07-21T22:34:45.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.538+0000 7f89927fc640 1 -- 172.21.15.6:0/266056230 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4666 (secure 0 0 0) 0x7f899c153de0 con 0x7f899c0b1f70 2023-07-21T22:34:45.588 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:45.589 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5960,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1945082031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1945082031},{"type":"v1","addr":"172.21.15.6:6835","nonce":1945082031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5963,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/778272832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":778272832},{"type":"v1","addr":"172.21.15.161:6836","nonce":778272832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/728409440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":728409440},{"type":"v1","addr":"172.21.15.161:6837","nonce":728409440}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:34:23.355700+0000","modified":"2023-07-21T22:34:26.993451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6585},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6585":{"gid":6585,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/1769681869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1769681869},{"type":"v1","addr":"172.21.15.6:6833","nonce":1769681869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-21T22:34:45.589 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 32 2023-07-21T22:34:45.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.538+0000 7f89a3c9c640 1 -- 172.21.15.6:0/266056230 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f8980066460 msgr2=0x7f8980068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:34:45.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.538+0000 7f89a3c9c640 1 --2- 172.21.15.6:0/266056230 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f8980066460 0x7f8980068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.538+0000 7f89a3c9c640 1 -- 172.21.15.6:0/266056230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f899c0b1f70 msgr2=0x7f899c153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:45.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.538+0000 7f89a3c9c640 1 --2- 172.21.15.6:0/266056230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f899c0b1f70 0x7f899c153620 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f899800ebe0 tx=0x7f899800c520 comp rx=0 tx=0).stop 2023-07-21T22:34:45.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.538+0000 7f89a3c9c640 1 -- 172.21.15.6:0/266056230 shutdown_connections 2023-07-21T22:34:45.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.538+0000 7f89a3c9c640 1 --2- 172.21.15.6:0/266056230 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f8980066460 0x7f8980068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.538+0000 7f89a3c9c640 1 --2- 172.21.15.6:0/266056230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f899c0b6cf0 0x7f899c0b7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.538+0000 7f89a3c9c640 1 --2- 172.21.15.6:0/266056230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f899c0d06b0 0x7f899c0b67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.538+0000 7f89a3c9c640 1 --2- 172.21.15.6:0/266056230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f899c0b1f70 0x7f899c153620 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.538+0000 7f89a3c9c640 1 -- 172.21.15.6:0/266056230 >> 172.21.15.6:0/266056230 conn(0x7f899c0659d0 msgr2=0x7f899c06b160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:45.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.538+0000 7f89a3c9c640 1 -- 172.21.15.6:0/266056230 shutdown_connections 2023-07-21T22:34:45.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.538+0000 7f89a3c9c640 1 -- 172.21.15.6:0/266056230 wait complete. 2023-07-21T22:34:45.610 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:34:45.753 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:45.708+0000 7f80aab24180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:34:45.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.706+0000 7f2afc19d640 1 Processor -- start 2023-07-21T22:34:45.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.706+0000 7f2afc19d640 1 -- start start 2023-07-21T22:34:45.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.706+0000 7f2afc19d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2af415fd60 0x7f2af40d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:45.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.706+0000 7f2afc19d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2af40d1850 0x7f2af40d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:45.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.706+0000 7f2afc19d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af40ccaf0 con 0x7f2af40b7c70 2023-07-21T22:34:45.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.706+0000 7f2afc19d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af40d1190 con 0x7f2af415fd60 2023-07-21T22:34:45.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.706+0000 7f2afc19d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af4160600 con 0x7f2af40d1850 2023-07-21T22:34:45.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.706+0000 7f2af9f39640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2af40b7c70 0x7f2af415f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34500/0 (socket says 172.21.15.6:34500) 2023-07-21T22:34:45.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.706+0000 7f2af9f39640 1 -- 172.21.15.6:0/4124848764 learned_addr learned my addr 172.21.15.6:0/4124848764 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:45.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.706+0000 7f2af9738640 1 --2- 172.21.15.6:0/4124848764 >> v2:172.21.15.161:3300/0 conn(0x7f2af415fd60 0x7f2af40d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.706+0000 7f2afa73a640 1 --2- 172.21.15.6:0/4124848764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2af40d1850 0x7f2af40d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.706+0000 7f2af8f37640 1 -- 172.21.15.6:0/4124848764 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635564190 0 0) 0x7f2af40ccaf0 con 0x7f2af40b7c70 2023-07-21T22:34:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.706+0000 7f2af8f37640 1 -- 172.21.15.6:0/4124848764 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ae0003530 con 0x7f2af40b7c70 2023-07-21T22:34:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.710+0000 7f2af9738640 1 -- 172.21.15.6:0/4124848764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2af40d1850 msgr2=0x7f2af40d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.710+0000 7f2af9738640 1 --2- 172.21.15.6:0/4124848764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2af40d1850 0x7f2af40d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.710+0000 7f2af9738640 1 -- 172.21.15.6:0/4124848764 >> v1:172.21.15.6:6789/0 conn(0x7f2af40b7c70 legacy=0x7f2af415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.710+0000 7f2af9738640 1 -- 172.21.15.6:0/4124848764 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af4160320 con 0x7f2af415fd60 2023-07-21T22:34:45.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.710+0000 7f2af9738640 1 --2- 172.21.15.6:0/4124848764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2af415fd60 0x7f2af40d0c50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40097c0 tx=0x7f2ae401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45ce9301e2f19122 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.710+0000 7f2af8f37640 1 -- 172.21.15.6:0/4124848764 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae40ab670 con 0x7f2af415fd60 2023-07-21T22:34:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.710+0000 7f2af8f37640 1 -- 172.21.15.6:0/4124848764 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae40ab7d0 con 0x7f2af415fd60 2023-07-21T22:34:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.710+0000 7f2af8f37640 1 -- 172.21.15.6:0/4124848764 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae40abb60 con 0x7f2af415fd60 2023-07-21T22:34:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.710+0000 7f2afc19d640 1 -- 172.21.15.6:0/4124848764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2af415fd60 msgr2=0x7f2af40d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.710+0000 7f2afc19d640 1 --2- 172.21.15.6:0/4124848764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2af415fd60 0x7f2af40d0c50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40097c0 tx=0x7f2ae401c450 comp rx=0 tx=0).stop 2023-07-21T22:34:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.710+0000 7f2afc19d640 1 -- 172.21.15.6:0/4124848764 shutdown_connections 2023-07-21T22:34:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afc19d640 1 --2- 172.21.15.6:0/4124848764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2af40d1850 0x7f2af40d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afc19d640 1 --2- 172.21.15.6:0/4124848764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2af415fd60 0x7f2af40d0c50 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afc19d640 1 -- 172.21.15.6:0/4124848764 >> 172.21.15.6:0/4124848764 conn(0x7f2af40650b0 msgr2=0x7f2af40654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afc19d640 1 -- 172.21.15.6:0/4124848764 shutdown_connections 2023-07-21T22:34:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afc19d640 1 -- 172.21.15.6:0/4124848764 wait complete. 2023-07-21T22:34:45.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afc19d640 1 Processor -- start 2023-07-21T22:34:45.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afc19d640 1 -- start start 2023-07-21T22:34:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afc19d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2af40b7c70 0x7f2af40c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afc19d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2af40d1850 0x7f2af415d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afc19d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2af415fd60 0x7f2af40ce550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afc19d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af415ea50 con 0x7f2af415fd60 2023-07-21T22:34:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afc19d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af415de40 con 0x7f2af40b7c70 2023-07-21T22:34:45.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afc19d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af415e120 con 0x7f2af40d1850 2023-07-21T22:34:45.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afa73a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2af415fd60 0x7f2af40ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:45.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afa73a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2af415fd60 0x7f2af40ce550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38792/0 (socket says 172.21.15.6:38792) 2023-07-21T22:34:45.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afa73a640 1 -- 172.21.15.6:0/3901535265 learned_addr learned my addr 172.21.15.6:0/3901535265 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:45.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2af9f39640 1 --2- 172.21.15.6:0/3901535265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2af40b7c70 0x7f2af40c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:45.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2af9738640 1 --2- 172.21.15.6:0/3901535265 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2af40d1850 0x7f2af415d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:45.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afa73a640 1 -- 172.21.15.6:0/3901535265 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2af40d1850 msgr2=0x7f2af415d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:45.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afa73a640 1 --2- 172.21.15.6:0/3901535265 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2af40d1850 0x7f2af415d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afa73a640 1 -- 172.21.15.6:0/3901535265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2af40b7c70 msgr2=0x7f2af40c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afa73a640 1 --2- 172.21.15.6:0/3901535265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2af40b7c70 0x7f2af40c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.714+0000 7f2afa73a640 1 -- 172.21.15.6:0/3901535265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae4009420 con 0x7f2af415fd60 2023-07-21T22:34:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.718+0000 7f2afa73a640 1 --2- 172.21.15.6:0/3901535265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2af415fd60 0x7f2af40ce550 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00efc0 tx=0x7f2aec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.718+0000 7f2aea7fc640 1 -- 172.21.15.6:0/3901535265 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec009ba0 con 0x7f2af415fd60 2023-07-21T22:34:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.718+0000 7f2aea7fc640 1 -- 172.21.15.6:0/3901535265 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec00f040 con 0x7f2af415fd60 2023-07-21T22:34:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.718+0000 7f2aea7fc640 1 -- 172.21.15.6:0/3901535265 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec0146c0 con 0x7f2af415fd60 2023-07-21T22:34:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.718+0000 7f2afc19d640 1 -- 172.21.15.6:0/3901535265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af415e400 con 0x7f2af415fd60 2023-07-21T22:34:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.718+0000 7f2afc19d640 1 -- 172.21.15.6:0/3901535265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af40c8be0 con 0x7f2af415fd60 2023-07-21T22:34:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.718+0000 7f2afc19d640 1 -- 172.21.15.6:0/3901535265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af415ebc0 con 0x7f2af415fd60 2023-07-21T22:34:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.718+0000 7f2aea7fc640 1 -- 172.21.15.6:0/3901535265 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 30) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f2aec014820 con 0x7f2af415fd60 2023-07-21T22:34:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.718+0000 7f2aea7fc640 1 --2- 172.21.15.6:0/3901535265 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f2ad8066400 0x7f2ad80688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.718+0000 7f2aea7fc640 1 -- 172.21.15.6:0/3901535265 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f2aec084c80 con 0x7f2af415fd60 2023-07-21T22:34:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.718+0000 7f2af9f39640 1 -- 172.21.15.6:0/3901535265 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f2ad8066400 msgr2=0x7f2ad80688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3509960293 2023-07-21T22:34:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.718+0000 7f2af9f39640 1 --2- 172.21.15.6:0/3901535265 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f2ad8066400 0x7f2ad80688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:45.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.722+0000 7f2aea7fc640 1 -- 172.21.15.6:0/3901535265 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2aec051c80 con 0x7f2af415fd60 2023-07-21T22:34:45.838 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:45.792+0000 7f80aab24180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:34:45.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.882+0000 7f2afc19d640 1 -- 172.21.15.6:0/3901535265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2af40678d0 con 0x7f2af415fd60 2023-07-21T22:34:45.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.882+0000 7f2aea7fc640 1 -- 172.21.15.6:0/3901535265 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+18800 (secure 0 0 0) 0x7f2aec0552a0 con 0x7f2af415fd60 2023-07-21T22:34:45.934 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:45.934 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":85,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:34:40.542753+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:34:21.475741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T22:34:22.347392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/2233957867":"2023-07-22T22:34:40.542719+0000","172.21.15.161:0/1213690087":"2023-07-22T22:34:40.542719+0000","172.21.15.161:6833/3045187557":"2023-07-22T22:34:40.542719+0000","172.21.15.161:0/4231263708":"2023-07-22T22:34:40.542719+0000","172.21.15.161:6832/3045187557":"2023-07-22T22:34:40.542719+0000","172.21.15.161:0/2666620273":"2023-07-22T22:34:40.542719+0000","172.21.15.161:0/1660078658":"2023-07-22T22:34:40.542719+0000","172.21.15.161:0/2609870133":"2023-07-22T22:34:40.542719+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:34:45.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.886+0000 7f2afc19d640 1 -- 172.21.15.6:0/3901535265 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f2ad8066400 msgr2=0x7f2ad80688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:34:45.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.886+0000 7f2afc19d640 1 --2- 172.21.15.6:0/3901535265 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f2ad8066400 0x7f2ad80688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.886+0000 7f2afc19d640 1 -- 172.21.15.6:0/3901535265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2af415fd60 msgr2=0x7f2af40ce550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:45.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.886+0000 7f2afc19d640 1 --2- 172.21.15.6:0/3901535265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2af415fd60 0x7f2af40ce550 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00efc0 tx=0x7f2aec00c490 comp rx=0 tx=0).stop 2023-07-21T22:34:45.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.886+0000 7f2afc19d640 1 -- 172.21.15.6:0/3901535265 shutdown_connections 2023-07-21T22:34:45.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.886+0000 7f2afc19d640 1 --2- 172.21.15.6:0/3901535265 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f2ad8066400 0x7f2ad80688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.886+0000 7f2afc19d640 1 --2- 172.21.15.6:0/3901535265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2af415fd60 0x7f2af40ce550 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.886+0000 7f2afc19d640 1 --2- 172.21.15.6:0/3901535265 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2af40d1850 0x7f2af415d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.886+0000 7f2afc19d640 1 --2- 172.21.15.6:0/3901535265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2af40b7c70 0x7f2af40c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:45.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.886+0000 7f2afc19d640 1 -- 172.21.15.6:0/3901535265 >> 172.21.15.6:0/3901535265 conn(0x7f2af40650b0 msgr2=0x7f2af40cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:45.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.886+0000 7f2afc19d640 1 -- 172.21.15.6:0/3901535265 shutdown_connections 2023-07-21T22:34:45.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:45.886+0000 7f2afc19d640 1 -- 172.21.15.6:0/3901535265 wait complete. 2023-07-21T22:34:45.956 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:34:21.475741+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:34:22.347392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:34:45.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:34:45.985 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:45.940+0000 7f80aab24180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:34:46.036 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:45.986+0000 7fd39c82c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:34:46.071 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:46.024+0000 7f80aab24180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:34:46.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.058+0000 7f057c7d2640 1 Processor -- start 2023-07-21T22:34:46.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.058+0000 7f057c7d2640 1 -- start start 2023-07-21T22:34:46.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.058+0000 7f057c7d2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f05740d2fc0 0x7f05740b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:46.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.058+0000 7f057c7d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05740d2300 0x7f05740d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:46.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.058+0000 7f057c7d2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05740b04c0 con 0x7f057415bde0 2023-07-21T22:34:46.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.058+0000 7f057c7d2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057415c1b0 con 0x7f05740d2fc0 2023-07-21T22:34:46.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.058+0000 7f057c7d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05740d2cc0 con 0x7f05740d2300 2023-07-21T22:34:46.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.058+0000 7f057a56e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f057415bde0 0x7f05740d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34516/0 (socket says 172.21.15.6:34516) 2023-07-21T22:34:46.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.058+0000 7f057a56e640 1 -- 172.21.15.6:0/2054245557 learned_addr learned my addr 172.21.15.6:0/2054245557 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:46.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.058+0000 7f0579d6d640 1 --2- 172.21.15.6:0/2054245557 >> v2:172.21.15.161:3300/0 conn(0x7f05740d2fc0 0x7f05740b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:46.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.058+0000 7f057ad6f640 1 --2- 172.21.15.6:0/2054245557 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05740d2300 0x7f05740d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:46.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.058+0000 7f057956c640 1 -- 172.21.15.6:0/2054245557 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776024353 0 0) 0x7f05740b04c0 con 0x7f057415bde0 2023-07-21T22:34:46.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.058+0000 7f057956c640 1 -- 172.21.15.6:0/2054245557 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0560003530 con 0x7f057415bde0 2023-07-21T22:34:46.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.058+0000 7f0579d6d640 1 -- 172.21.15.6:0/2054245557 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05740d2300 msgr2=0x7f05740d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:46.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.058+0000 7f0579d6d640 1 --2- 172.21.15.6:0/2054245557 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05740d2300 0x7f05740d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.058+0000 7f0579d6d640 1 -- 172.21.15.6:0/2054245557 >> v1:172.21.15.6:6789/0 conn(0x7f057415bde0 legacy=0x7f05740d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:46.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.058+0000 7f0579d6d640 1 -- 172.21.15.6:0/2054245557 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05740d0aa0 con 0x7f05740d2fc0 2023-07-21T22:34:46.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.062+0000 7f0579d6d640 1 --2- 172.21.15.6:0/2054245557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05740d2fc0 0x7f05740b0950 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f05640097c0 tx=0x7f056401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b1a1965708b07c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:46.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.062+0000 7f057956c640 1 -- 172.21.15.6:0/2054245557 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05640ab680 con 0x7f05740d2fc0 2023-07-21T22:34:46.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.062+0000 7f057956c640 1 -- 172.21.15.6:0/2054245557 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05640ab7e0 con 0x7f05740d2fc0 2023-07-21T22:34:46.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.062+0000 7f057956c640 1 -- 172.21.15.6:0/2054245557 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05640abb50 con 0x7f05740d2fc0 2023-07-21T22:34:46.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.062+0000 7f057c7d2640 1 -- 172.21.15.6:0/2054245557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05740d2fc0 msgr2=0x7f05740b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:46.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.062+0000 7f057c7d2640 1 --2- 172.21.15.6:0/2054245557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05740d2fc0 0x7f05740b0950 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f05640097c0 tx=0x7f056401c480 comp rx=0 tx=0).stop 2023-07-21T22:34:46.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.062+0000 7f057c7d2640 1 -- 172.21.15.6:0/2054245557 shutdown_connections 2023-07-21T22:34:46.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.062+0000 7f057c7d2640 1 --2- 172.21.15.6:0/2054245557 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05740d2300 0x7f05740d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.062+0000 7f057c7d2640 1 --2- 172.21.15.6:0/2054245557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05740d2fc0 0x7f05740b0950 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.062+0000 7f057c7d2640 1 -- 172.21.15.6:0/2054245557 >> 172.21.15.6:0/2054245557 conn(0x7f05740659d0 msgr2=0x7f057409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.062+0000 7f057c7d2640 1 -- 172.21.15.6:0/2054245557 shutdown_connections 2023-07-21T22:34:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.062+0000 7f057c7d2640 1 -- 172.21.15.6:0/2054245557 wait complete. 2023-07-21T22:34:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f057c7d2640 1 Processor -- start 2023-07-21T22:34:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f057c7d2640 1 -- start start 2023-07-21T22:34:46.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f057c7d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05740d2300 0x7f057415cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:46.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f057c7d2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05740d2fc0 0x7f0574153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:46.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f057c7d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f057415bde0 0x7f05741540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:46.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f057c7d2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0574155a60 con 0x7f05740d2300 2023-07-21T22:34:46.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f057c7d2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057415ece0 con 0x7f05740d2fc0 2023-07-21T22:34:46.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f057c7d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057415efc0 con 0x7f057415bde0 2023-07-21T22:34:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f057a56e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05740d2300 0x7f057415cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f057a56e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05740d2300 0x7f057415cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38798/0 (socket says 172.21.15.6:38798) 2023-07-21T22:34:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f057a56e640 1 -- 172.21.15.6:0/829413993 learned_addr learned my addr 172.21.15.6:0/829413993 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f0579d6d640 1 --2- 172.21.15.6:0/829413993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05740d2fc0 0x7f0574153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f057ad6f640 1 --2- 172.21.15.6:0/829413993 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f057415bde0 0x7f05741540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f057a56e640 1 -- 172.21.15.6:0/829413993 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f057415bde0 msgr2=0x7f05741540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f057a56e640 1 --2- 172.21.15.6:0/829413993 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f057415bde0 0x7f05741540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f057a56e640 1 -- 172.21.15.6:0/829413993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05740d2fc0 msgr2=0x7f0574153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f057a56e640 1 --2- 172.21.15.6:0/829413993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05740d2fc0 0x7f0574153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f057a56e640 1 -- 172.21.15.6:0/829413993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0564009420 con 0x7f05740d2300 2023-07-21T22:34:46.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f0579d6d640 1 --2- 172.21.15.6:0/829413993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05740d2fc0 0x7f0574153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:46.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f057a56e640 1 --2- 172.21.15.6:0/829413993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05740d2300 0x7f057415cd00 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f0570004b10 tx=0x7f057000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:46.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f056affd640 1 -- 172.21.15.6:0/829413993 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570005cf0 con 0x7f05740d2300 2023-07-21T22:34:46.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f056affd640 1 -- 172.21.15.6:0/829413993 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0570005e50 con 0x7f05740d2300 2023-07-21T22:34:46.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f056affd640 1 -- 172.21.15.6:0/829413993 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05700072b0 con 0x7f05740d2300 2023-07-21T22:34:46.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f057c7d2640 1 -- 172.21.15.6:0/829413993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05740b77f0 con 0x7f05740d2300 2023-07-21T22:34:46.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.066+0000 7f057c7d2640 1 -- 172.21.15.6:0/829413993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057415e900 con 0x7f05740d2300 2023-07-21T22:34:46.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.070+0000 7f057c7d2640 1 -- 172.21.15.6:0/829413993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057415f190 con 0x7f05740d2300 2023-07-21T22:34:46.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.070+0000 7f056affd640 1 -- 172.21.15.6:0/829413993 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 30) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f0570007410 con 0x7f05740d2300 2023-07-21T22:34:46.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.070+0000 7f056affd640 1 --2- 172.21.15.6:0/829413993 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f0558066460 0x7f0558068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:46.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.070+0000 7f0579d6d640 1 -- 172.21.15.6:0/829413993 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f0558066460 msgr2=0x7f0558068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3509960293 2023-07-21T22:34:46.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.070+0000 7f056affd640 1 -- 172.21.15.6:0/829413993 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f05700836c0 con 0x7f05740d2300 2023-07-21T22:34:46.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.070+0000 7f0579d6d640 1 --2- 172.21.15.6:0/829413993 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f0558066460 0x7f0558068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:34:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.074+0000 7f056affd640 1 -- 172.21.15.6:0/829413993 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05700507f0 con 0x7f05740d2300 2023-07-21T22:34:46.131 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:46.082+0000 7fd39c82c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:34:46.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.230+0000 7f057c7d2640 1 -- 172.21.15.6:0/829413993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05740678d0 con 0x7f05740d2300 2023-07-21T22:34:46.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.230+0000 7f056affd640 1 -- 172.21.15.6:0/829413993 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0570053e10 con 0x7f05740d2300 2023-07-21T22:34:46.283 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:34:46.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.234+0000 7f057c7d2640 1 -- 172.21.15.6:0/829413993 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f0558066460 msgr2=0x7f0558068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:34:46.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.234+0000 7f057c7d2640 1 --2- 172.21.15.6:0/829413993 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f0558066460 0x7f0558068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.234+0000 7f057c7d2640 1 -- 172.21.15.6:0/829413993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05740d2300 msgr2=0x7f057415cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:46.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.234+0000 7f057c7d2640 1 --2- 172.21.15.6:0/829413993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05740d2300 0x7f057415cd00 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f0570004b10 tx=0x7f057000c960 comp rx=0 tx=0).stop 2023-07-21T22:34:46.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.234+0000 7f057c7d2640 1 -- 172.21.15.6:0/829413993 shutdown_connections 2023-07-21T22:34:46.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.234+0000 7f057c7d2640 1 --2- 172.21.15.6:0/829413993 >> [v2:172.21.15.161:6832/3509960293,v1:172.21.15.161:6833/3509960293] conn(0x7f0558066460 0x7f0558068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.234+0000 7f057c7d2640 1 --2- 172.21.15.6:0/829413993 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f057415bde0 0x7f05741540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.234+0000 7f057c7d2640 1 --2- 172.21.15.6:0/829413993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05740d2fc0 0x7f0574153ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.234+0000 7f057c7d2640 1 --2- 172.21.15.6:0/829413993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05740d2300 0x7f057415cd00 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.234+0000 7f057c7d2640 1 -- 172.21.15.6:0/829413993 >> 172.21.15.6:0/829413993 conn(0x7f05740659d0 msgr2=0x7f05740cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:46.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.234+0000 7f057c7d2640 1 -- 172.21.15.6:0/829413993 shutdown_connections 2023-07-21T22:34:46.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.234+0000 7f057c7d2640 1 -- 172.21.15.6:0/829413993 wait complete. 2023-07-21T22:34:46.290 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:46.238+0000 7fd39c82c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:34:46.305 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:34:46.343 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:46.296+0000 7f80aab24180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:34:46.382 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:46.330+0000 7fd39c82c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:34:46.403 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:46.356+0000 7f80aab24180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:34:46.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.410+0000 7f2f08f74640 1 Processor -- start 2023-07-21T22:34:46.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.410+0000 7f2f08f74640 1 -- start start 2023-07-21T22:34:46.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.410+0000 7f2f08f74640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2f0415bde0 0x7f2f040d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:46.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.410+0000 7f2f08f74640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f040b04c0 con 0x7f2f040d2300 2023-07-21T22:34:46.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.410+0000 7f2f08f74640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f040b1060 con 0x7f2f040d2fc0 2023-07-21T22:34:46.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.410+0000 7f2f08f74640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0415c1b0 con 0x7f2f0415bde0 2023-07-21T22:34:46.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.410+0000 7f2f0259c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2f0415bde0 0x7f2f040d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:46.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.410+0000 7f2f02d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2f040d2300 0x7f2f040cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34528/0 (socket says 172.21.15.6:34528) 2023-07-21T22:34:46.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.410+0000 7f2f02d9d640 1 -- 172.21.15.6:0/1420184147 learned_addr learned my addr 172.21.15.6:0/1420184147 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:46.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.410+0000 7f2f01d9b640 1 -- 172.21.15.6:0/1420184147 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3040639378 0 0) 0x7f2f040b04c0 con 0x7f2f040d2300 2023-07-21T22:34:46.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.410+0000 7f2f01d9b640 1 -- 172.21.15.6:0/1420184147 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ef0003530 con 0x7f2f040d2300 2023-07-21T22:34:46.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.414+0000 7f2f0259c640 1 -- 172.21.15.6:0/1420184147 >> v1:172.21.15.161:6789/0 conn(0x7f2f040d2fc0 legacy=0x7f2f040b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:46.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.414+0000 7f2f01d9b640 1 -- 172.21.15.6:0/1420184147 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127384214 0 0) 0x7f2f040b1060 con 0x7f2f040d2fc0 2023-07-21T22:34:46.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.414+0000 7f2f0259c640 1 -- 172.21.15.6:0/1420184147 >> v1:172.21.15.6:6789/0 conn(0x7f2f040d2300 legacy=0x7f2f040cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:46.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.414+0000 7f2f0259c640 1 -- 172.21.15.6:0/1420184147 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f040d0aa0 con 0x7f2f0415bde0 2023-07-21T22:34:46.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.414+0000 7f2f0259c640 1 --2- 172.21.15.6:0/1420184147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f0415bde0 0x7f2f040d0270 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40097a0 tx=0x7f2ef401c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1d46854f8cd615a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:46.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.414+0000 7f2f01d9b640 1 -- 172.21.15.6:0/1420184147 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef40ab660 con 0x7f2f0415bde0 2023-07-21T22:34:46.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.414+0000 7f2f01d9b640 1 -- 172.21.15.6:0/1420184147 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef40ab7c0 con 0x7f2f0415bde0 2023-07-21T22:34:46.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.414+0000 7f2f01d9b640 1 -- 172.21.15.6:0/1420184147 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef40abb50 con 0x7f2f0415bde0 2023-07-21T22:34:46.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.418+0000 7f2f08f74640 1 -- 172.21.15.6:0/1420184147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f0415bde0 msgr2=0x7f2f040d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:46.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.418+0000 7f2f08f74640 1 --2- 172.21.15.6:0/1420184147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f0415bde0 0x7f2f040d0270 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40097a0 tx=0x7f2ef401c460 comp rx=0 tx=0).stop 2023-07-21T22:34:46.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.418+0000 7f2f08f74640 1 -- 172.21.15.6:0/1420184147 shutdown_connections 2023-07-21T22:34:46.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.418+0000 7f2f08f74640 1 --2- 172.21.15.6:0/1420184147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f0415bde0 0x7f2f040d0270 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.418+0000 7f2f08f74640 1 -- 172.21.15.6:0/1420184147 >> 172.21.15.6:0/1420184147 conn(0x7f2f040659d0 msgr2=0x7f2f0409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:46.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.418+0000 7f2f08f74640 1 -- 172.21.15.6:0/1420184147 shutdown_connections 2023-07-21T22:34:46.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.418+0000 7f2f08f74640 1 -- 172.21.15.6:0/1420184147 wait complete. 2023-07-21T22:34:46.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.418+0000 7f2f08f74640 1 Processor -- start 2023-07-21T22:34:46.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.418+0000 7f2f08f74640 1 -- start start 2023-07-21T22:34:46.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.418+0000 7f2f08f74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f040d2300 0x7f2f040cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:46.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2f08f74640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f040d2fc0 0x7f2f040ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:46.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2f08f74640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f0415bde0 0x7f2f0415c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:46.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2f08f74640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f04152e60 con 0x7f2f040d2300 2023-07-21T22:34:46.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2f08f74640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f04151ae0 con 0x7f2f040d2fc0 2023-07-21T22:34:46.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2f08f74640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f04151dc0 con 0x7f2f0415bde0 2023-07-21T22:34:46.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2f0259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f040d2300 0x7f2f040cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:46.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2f0259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f040d2300 0x7f2f040cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38802/0 (socket says 172.21.15.6:38802) 2023-07-21T22:34:46.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2f0259c640 1 -- 172.21.15.6:0/2512052365 learned_addr learned my addr 172.21.15.6:0/2512052365 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:46.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2efbfff640 1 --2- 172.21.15.6:0/2512052365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f040d2fc0 0x7f2f040ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:46.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2f02d9d640 1 --2- 172.21.15.6:0/2512052365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f0415bde0 0x7f2f0415c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:46.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2f0259c640 1 -- 172.21.15.6:0/2512052365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f0415bde0 msgr2=0x7f2f0415c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:46.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2f0259c640 1 --2- 172.21.15.6:0/2512052365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f0415bde0 0x7f2f0415c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2f0259c640 1 -- 172.21.15.6:0/2512052365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f040d2fc0 msgr2=0x7f2f040ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:46.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2f0259c640 1 --2- 172.21.15.6:0/2512052365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f040d2fc0 0x7f2f040ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2f0259c640 1 -- 172.21.15.6:0/2512052365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef40093b0 con 0x7f2f040d2300 2023-07-21T22:34:46.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2f0259c640 1 --2- 172.21.15.6:0/2512052365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f040d2300 0x7f2f040cbd20 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40ad040 tx=0x7f2ef401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:46.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2efaffd640 1 -- 172.21.15.6:0/2512052365 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4004220 con 0x7f2f040d2300 2023-07-21T22:34:46.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2efaffd640 1 -- 172.21.15.6:0/2512052365 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef4004380 con 0x7f2f040d2300 2023-07-21T22:34:46.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2efaffd640 1 -- 172.21.15.6:0/2512052365 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4003860 con 0x7f2f040d2300 2023-07-21T22:34:46.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2f08f74640 1 -- 172.21.15.6:0/2512052365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f041520a0 con 0x7f2f040d2300 2023-07-21T22:34:46.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2f08f74640 1 -- 172.21.15.6:0/2512052365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f04152660 con 0x7f2f040d2300 2023-07-21T22:34:46.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.422+0000 7f2f08f74640 1 -- 172.21.15.6:0/2512052365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f040678d0 con 0x7f2f040d2300 2023-07-21T22:34:46.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.426+0000 7f2efaffd640 1 -- 172.21.15.6:0/2512052365 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 31) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f2ef40a9070 con 0x7f2f040d2300 2023-07-21T22:34:46.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.426+0000 7f2efaffd640 1 -- 172.21.15.6:0/2512052365 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6837+0+0 (secure 0 0 0) 0x7f2ef411dc20 con 0x7f2f040d2300 2023-07-21T22:34:46.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.434+0000 7f2efaffd640 1 -- 172.21.15.6:0/2512052365 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2ef40eb2c0 con 0x7f2f040d2300 2023-07-21T22:34:46.487 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:46.440+0000 7f8036ba4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:46.487 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:46.440+0000 7f8036ba4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:46.487 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:46.440+0000 7f8036ba4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:46.487 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:46.440+0000 7f8036ba4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:46.487 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:46.440+0000 7f8036ba4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:46.488 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:46.440+0000 7f803339d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:46.488 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:46.440+0000 7f803339d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:46.488 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:46.440+0000 7f803339d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:46.488 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:46.440+0000 7f803339d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:46.488 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:34:46.440+0000 7f803339d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:34:46.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.594+0000 7f2f08f74640 1 -- 172.21.15.6:0/2512052365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2f0408b090 con 0x7f2f040d2300 2023-07-21T22:34:46.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.594+0000 7f2efaffd640 1 -- 172.21.15.6:0/2512052365 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v86) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2ef40044f0 con 0x7f2f040d2300 2023-07-21T22:34:46.644 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:34:46.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.594+0000 7f2f08f74640 1 -- 172.21.15.6:0/2512052365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f040d2300 msgr2=0x7f2f040cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:46.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.594+0000 7f2f08f74640 1 --2- 172.21.15.6:0/2512052365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f040d2300 0x7f2f040cbd20 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40ad040 tx=0x7f2ef401aca0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.594+0000 7f2f08f74640 1 -- 172.21.15.6:0/2512052365 shutdown_connections 2023-07-21T22:34:46.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.594+0000 7f2f08f74640 1 --2- 172.21.15.6:0/2512052365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f0415bde0 0x7f2f0415c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.594+0000 7f2f08f74640 1 --2- 172.21.15.6:0/2512052365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f040d2fc0 0x7f2f040ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.594+0000 7f2f08f74640 1 --2- 172.21.15.6:0/2512052365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f040d2300 0x7f2f040cbd20 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.594+0000 7f2f08f74640 1 -- 172.21.15.6:0/2512052365 >> 172.21.15.6:0/2512052365 conn(0x7f2f040659d0 msgr2=0x7f2f040cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:46.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.594+0000 7f2f08f74640 1 -- 172.21.15.6:0/2512052365 shutdown_connections 2023-07-21T22:34:46.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.594+0000 7f2f08f74640 1 -- 172.21.15.6:0/2512052365 wait complete. 2023-07-21T22:34:46.665 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:34:46.696 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:46.646+0000 7fd39c82c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:34:46.761 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:34:46.710+0000 7fd39c82c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:34:46.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.766+0000 7f6116137640 1 Processor -- start 2023-07-21T22:34:46.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.766+0000 7f6116137640 1 -- start start 2023-07-21T22:34:46.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.766+0000 7f6116137640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f61100aeb40 0x7f611015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:46.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.766+0000 7f6116137640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6110159440 0x7f61100c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:46.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.766+0000 7f6116137640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61101532b0 con 0x7f61100aef10 2023-07-21T22:34:46.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.766+0000 7f6116137640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61100ca6f0 con 0x7f6110159440 2023-07-21T22:34:46.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.766+0000 7f6116137640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61101599d0 con 0x7f61100aeb40 2023-07-21T22:34:46.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.766+0000 7f610ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6110159440 0x7f61100c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:46.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.766+0000 7f610ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6110159440 0x7f61100c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38806/0 (socket says 172.21.15.6:38806) 2023-07-21T22:34:46.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.766+0000 7f610ffff640 1 -- 172.21.15.6:0/994145537 learned_addr learned my addr 172.21.15.6:0/994145537 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:46.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.766+0000 7f610f7fe640 1 --2- 172.21.15.6:0/994145537 >> v2:172.21.15.161:3300/0 conn(0x7f61100aeb40 0x7f611015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:46.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.766+0000 7f610ffff640 1 -- 172.21.15.6:0/994145537 >> v2:172.21.15.161:3300/0 conn(0x7f61100aeb40 msgr2=0x7f611015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:46.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.766+0000 7f610ffff640 1 --2- 172.21.15.6:0/994145537 >> v2:172.21.15.161:3300/0 conn(0x7f61100aeb40 0x7f611015cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.766+0000 7f610ffff640 1 -- 172.21.15.6:0/994145537 >> v1:172.21.15.161:6789/0 conn(0x7f61100aef10 legacy=0x7f6110158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:46.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.766+0000 7f610ffff640 1 -- 172.21.15.6:0/994145537 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6110159cb0 con 0x7f6110159440 2023-07-21T22:34:46.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.770+0000 7f610ffff640 1 --2- 172.21.15.6:0/994145537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6110159440 0x7f61100c88c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6110071ad0 tx=0x7f610801eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7373edf3b27543b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:46.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.770+0000 7f610effd640 1 -- 172.21.15.6:0/994145537 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610800b2d0 con 0x7f6110159440 2023-07-21T22:34:46.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.770+0000 7f610effd640 1 -- 172.21.15.6:0/994145537 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610800b430 con 0x7f6110159440 2023-07-21T22:34:46.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.770+0000 7f610effd640 1 -- 172.21.15.6:0/994145537 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61080a7c00 con 0x7f6110159440 2023-07-21T22:34:46.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.770+0000 7f6116137640 1 -- 172.21.15.6:0/994145537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6110159440 msgr2=0x7f61100c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:46.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.770+0000 7f6116137640 1 --2- 172.21.15.6:0/994145537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6110159440 0x7f61100c88c0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f6110071ad0 tx=0x7f610801eb10 comp rx=0 tx=0).stop 2023-07-21T22:34:46.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.770+0000 7f6116137640 1 -- 172.21.15.6:0/994145537 shutdown_connections 2023-07-21T22:34:46.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.770+0000 7f6116137640 1 --2- 172.21.15.6:0/994145537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6110159440 0x7f61100c88c0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.770+0000 7f6116137640 1 --2- 172.21.15.6:0/994145537 >> v2:172.21.15.161:3300/0 conn(0x7f61100aeb40 0x7f611015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.770+0000 7f6116137640 1 -- 172.21.15.6:0/994145537 >> 172.21.15.6:0/994145537 conn(0x7f61100cde90 msgr2=0x7f61100ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:46.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.770+0000 7f6116137640 1 -- 172.21.15.6:0/994145537 shutdown_connections 2023-07-21T22:34:46.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.770+0000 7f6116137640 1 -- 172.21.15.6:0/994145537 wait complete. 2023-07-21T22:34:46.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f6116137640 1 Processor -- start 2023-07-21T22:34:46.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f6116137640 1 -- start start 2023-07-21T22:34:46.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f6116137640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61100aeb40 0x7f61100b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f6116137640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61100aef10 0x7f61100b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f6116137640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6110159440 0x7f61100c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f6116137640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611006f1e0 con 0x7f61100aeb40 2023-07-21T22:34:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f6116137640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611006f4c0 con 0x7f6110159440 2023-07-21T22:34:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f6116137640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611006f7a0 con 0x7f61100aef10 2023-07-21T22:34:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f610f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61100aeb40 0x7f61100b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:46.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f610f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61100aeb40 0x7f61100b0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38816/0 (socket says 172.21.15.6:38816) 2023-07-21T22:34:46.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f610f7fe640 1 -- 172.21.15.6:0/1083195201 learned_addr learned my addr 172.21.15.6:0/1083195201 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:46.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f610f7fe640 1 -- 172.21.15.6:0/1083195201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61100aef10 msgr2=0x7f61100b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:46.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f6107fff640 1 --2- 172.21.15.6:0/1083195201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61100aef10 0x7f61100b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:46.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f610f7fe640 1 --2- 172.21.15.6:0/1083195201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61100aef10 0x7f61100b3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f610f7fe640 1 -- 172.21.15.6:0/1083195201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6110159440 msgr2=0x7f61100c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:46.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f610f7fe640 1 --2- 172.21.15.6:0/1083195201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6110159440 0x7f61100c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f610f7fe640 1 -- 172.21.15.6:0/1083195201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610800bd40 con 0x7f61100aeb40 2023-07-21T22:34:46.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f610f7fe640 1 --2- 172.21.15.6:0/1083195201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61100aeb40 0x7f61100b0dc0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f610000e930 tx=0x7f610000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:46.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f610cff9640 1 -- 172.21.15.6:0/1083195201 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100009690 con 0x7f61100aeb40 2023-07-21T22:34:46.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f610cff9640 1 -- 172.21.15.6:0/1083195201 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610000ca00 con 0x7f61100aeb40 2023-07-21T22:34:46.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f610cff9640 1 -- 172.21.15.6:0/1083195201 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610000cd70 con 0x7f61100aeb40 2023-07-21T22:34:46.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f6116137640 1 -- 172.21.15.6:0/1083195201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611006fa80 con 0x7f61100aeb40 2023-07-21T22:34:46.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.774+0000 7f6116137640 1 -- 172.21.15.6:0/1083195201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61100b1300 con 0x7f61100aeb40 2023-07-21T22:34:46.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.778+0000 7f6116137640 1 -- 172.21.15.6:0/1083195201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61100678d0 con 0x7f61100aeb40 2023-07-21T22:34:46.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.778+0000 7f610cff9640 1 -- 172.21.15.6:0/1083195201 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 31) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f6100013470 con 0x7f61100aeb40 2023-07-21T22:34:46.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.778+0000 7f610cff9640 1 -- 172.21.15.6:0/1083195201 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6837+0+0 (secure 0 0 0) 0x7f6100083e10 con 0x7f61100aeb40 2023-07-21T22:34:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.782+0000 7f610cff9640 1 -- 172.21.15.6:0/1083195201 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6100087030 con 0x7f61100aeb40 2023-07-21T22:34:46.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.942+0000 7f6116137640 1 -- 172.21.15.6:0/1083195201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61100c2ee0 con 0x7f61100aeb40 2023-07-21T22:34:46.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.942+0000 7f610cff9640 1 -- 172.21.15.6:0/1083195201 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6100017020 con 0x7f61100aeb40 2023-07-21T22:34:46.992 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:34:46.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.942+0000 7f6116137640 1 -- 172.21.15.6:0/1083195201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61100aeb40 msgr2=0x7f61100b0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:46.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.942+0000 7f6116137640 1 --2- 172.21.15.6:0/1083195201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61100aeb40 0x7f61100b0dc0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f610000e930 tx=0x7f610000edf0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.942+0000 7f6116137640 1 -- 172.21.15.6:0/1083195201 shutdown_connections 2023-07-21T22:34:46.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.942+0000 7f6116137640 1 --2- 172.21.15.6:0/1083195201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6110159440 0x7f61100c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.942+0000 7f6116137640 1 --2- 172.21.15.6:0/1083195201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61100aef10 0x7f61100b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.942+0000 7f6116137640 1 --2- 172.21.15.6:0/1083195201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61100aeb40 0x7f61100b0dc0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:46.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.942+0000 7f6116137640 1 -- 172.21.15.6:0/1083195201 >> 172.21.15.6:0/1083195201 conn(0x7f61100cde90 msgr2=0x7f61100c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:46.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.942+0000 7f6116137640 1 -- 172.21.15.6:0/1083195201 shutdown_connections 2023-07-21T22:34:46.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:46.942+0000 7f6116137640 1 -- 172.21.15.6:0/1083195201 wait complete. 2023-07-21T22:34:47.012 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:34:47.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.150+0000 7f02647fa640 1 Processor -- start 2023-07-21T22:34:47.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.150+0000 7f02647fa640 1 -- start start 2023-07-21T22:34:47.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.150+0000 7f02647fa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f025c15cef0 0x7f025c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:47.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.150+0000 7f02647fa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f025c159270 0x7f025c0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:47.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.150+0000 7f02647fa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f025c1532b0 con 0x7f025c0aeb40 2023-07-21T22:34:47.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.150+0000 7f02647fa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025c15d360 con 0x7f025c159270 2023-07-21T22:34:47.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.150+0000 7f02647fa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025c0ca6f0 con 0x7f025c15cef0 2023-07-21T22:34:47.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.150+0000 7f0262596640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f025c0aeb40 0x7f025c0aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34532/0 (socket says 172.21.15.6:34532) 2023-07-21T22:34:47.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.150+0000 7f0262596640 1 -- 172.21.15.6:0/1220483915 learned_addr learned my addr 172.21.15.6:0/1220483915 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:47.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.150+0000 7f0262d97640 1 --2- 172.21.15.6:0/1220483915 >> v2:172.21.15.6:3300/0 conn(0x7f025c159270 0x7f025c0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:47.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.150+0000 7f0261d95640 1 --2- 172.21.15.6:0/1220483915 >> v2:172.21.15.161:3300/0 conn(0x7f025c15cef0 0x7f025c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:47.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.150+0000 7f0262d97640 1 -- 172.21.15.6:0/1220483915 >> v2:172.21.15.161:3300/0 conn(0x7f025c15cef0 msgr2=0x7f025c158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:47.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.150+0000 7f0262d97640 1 --2- 172.21.15.6:0/1220483915 >> v2:172.21.15.161:3300/0 conn(0x7f025c15cef0 0x7f025c158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:47.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.150+0000 7f0262d97640 1 -- 172.21.15.6:0/1220483915 >> v1:172.21.15.6:6789/0 conn(0x7f025c0aeb40 legacy=0x7f025c0aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:47.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.150+0000 7f0262d97640 1 -- 172.21.15.6:0/1220483915 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c1599d0 con 0x7f025c159270 2023-07-21T22:34:47.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.150+0000 7f0261594640 1 -- 172.21.15.6:0/1220483915 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780320232 0 0) 0x7f025c1532b0 con 0x7f025c0aeb40 2023-07-21T22:34:47.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.154+0000 7f0262d97640 1 --2- 172.21.15.6:0/1220483915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f025c159270 0x7f025c0c88c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f025c0cee90 tx=0x7f025401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6dfa20d4c9e063 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:47.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.154+0000 7f0261594640 1 -- 172.21.15.6:0/1220483915 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02540a59a0 con 0x7f025c159270 2023-07-21T22:34:47.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.154+0000 7f0261594640 1 -- 172.21.15.6:0/1220483915 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02540a5b00 con 0x7f025c159270 2023-07-21T22:34:47.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.154+0000 7f0261594640 1 -- 172.21.15.6:0/1220483915 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02540a5e90 con 0x7f025c159270 2023-07-21T22:34:47.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.154+0000 7f02647fa640 1 -- 172.21.15.6:0/1220483915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f025c159270 msgr2=0x7f025c0c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:47.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.154+0000 7f02647fa640 1 --2- 172.21.15.6:0/1220483915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f025c159270 0x7f025c0c88c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f025c0cee90 tx=0x7f025401c8e0 comp rx=0 tx=0).stop 2023-07-21T22:34:47.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.154+0000 7f02647fa640 1 -- 172.21.15.6:0/1220483915 shutdown_connections 2023-07-21T22:34:47.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.154+0000 7f02647fa640 1 --2- 172.21.15.6:0/1220483915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f025c159270 0x7f025c0c88c0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:47.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.154+0000 7f02647fa640 1 --2- 172.21.15.6:0/1220483915 >> v2:172.21.15.161:3300/0 conn(0x7f025c15cef0 0x7f025c158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:47.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.154+0000 7f02647fa640 1 -- 172.21.15.6:0/1220483915 >> 172.21.15.6:0/1220483915 conn(0x7f025c0cde90 msgr2=0x7f025c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:47.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.154+0000 7f02647fa640 1 -- 172.21.15.6:0/1220483915 shutdown_connections 2023-07-21T22:34:47.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.154+0000 7f02647fa640 1 -- 172.21.15.6:0/1220483915 wait complete. 2023-07-21T22:34:47.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f02647fa640 1 Processor -- start 2023-07-21T22:34:47.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f02647fa640 1 -- start start 2023-07-21T22:34:47.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f02647fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f025c0aeb40 0x7f025c0cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:47.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f02647fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f025c159270 0x7f025c153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:47.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f02647fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f025c15cef0 0x7f025c153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:47.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f02647fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c1543b0 con 0x7f025c0aeb40 2023-07-21T22:34:47.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f02647fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c0ab890 con 0x7f025c159270 2023-07-21T22:34:47.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f02647fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c0abaa0 con 0x7f025c15cef0 2023-07-21T22:34:47.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f0262596640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f025c0aeb40 0x7f025c0cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:47.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f0262596640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f025c0aeb40 0x7f025c0cb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38836/0 (socket says 172.21.15.6:38836) 2023-07-21T22:34:47.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f0262596640 1 -- 172.21.15.6:0/2826560722 learned_addr learned my addr 172.21.15.6:0/2826560722 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:47.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f0262596640 1 -- 172.21.15.6:0/2826560722 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f025c15cef0 msgr2=0x7f025c153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f0262596640 1 --2- 172.21.15.6:0/2826560722 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f025c15cef0 0x7f025c153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f0262596640 1 -- 172.21.15.6:0/2826560722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f025c159270 msgr2=0x7f025c153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f0262596640 1 --2- 172.21.15.6:0/2826560722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f025c159270 0x7f025c153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f0262596640 1 -- 172.21.15.6:0/2826560722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0254009a70 con 0x7f025c0aeb40 2023-07-21T22:34:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f0262596640 1 --2- 172.21.15.6:0/2826560722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f025c0aeb40 0x7f025c0cb3a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f02580011f0 tx=0x7f025800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:47.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f0252ffd640 1 -- 172.21.15.6:0/2826560722 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02580074e0 con 0x7f025c0aeb40 2023-07-21T22:34:47.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f0252ffd640 1 -- 172.21.15.6:0/2826560722 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0258007640 con 0x7f025c0aeb40 2023-07-21T22:34:47.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f02647fa640 1 -- 172.21.15.6:0/2826560722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f025c0abd80 con 0x7f025c0aeb40 2023-07-21T22:34:47.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f0252ffd640 1 -- 172.21.15.6:0/2826560722 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258004a10 con 0x7f025c0aeb40 2023-07-21T22:34:47.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.158+0000 7f02647fa640 1 -- 172.21.15.6:0/2826560722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025c0ac620 con 0x7f025c0aeb40 2023-07-21T22:34:47.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.162+0000 7f02647fa640 1 -- 172.21.15.6:0/2826560722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f025c0abf70 con 0x7f025c0aeb40 2023-07-21T22:34:47.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.162+0000 7f0252ffd640 1 -- 172.21.15.6:0/2826560722 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 31) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f0258004b70 con 0x7f025c0aeb40 2023-07-21T22:34:47.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.162+0000 7f0252ffd640 1 -- 172.21.15.6:0/2826560722 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6837+0+0 (secure 0 0 0) 0x7f0258082d70 con 0x7f025c0aeb40 2023-07-21T22:34:47.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.166+0000 7f0252ffd640 1 -- 172.21.15.6:0/2826560722 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0258050330 con 0x7f025c0aeb40 2023-07-21T22:34:47.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.322+0000 7f02647fa640 1 -- 172.21.15.6:0/2826560722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f025c0ac170 con 0x7f025c0aeb40 2023-07-21T22:34:47.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.322+0000 7f0252ffd640 1 -- 172.21.15.6:0/2826560722 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0258018070 con 0x7f025c0aeb40 2023-07-21T22:34:47.372 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:34:47.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.322+0000 7f02647fa640 1 -- 172.21.15.6:0/2826560722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f025c0aeb40 msgr2=0x7f025c0cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:47.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.322+0000 7f02647fa640 1 --2- 172.21.15.6:0/2826560722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f025c0aeb40 0x7f025c0cb3a0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f02580011f0 tx=0x7f025800c9b0 comp rx=0 tx=0).stop 2023-07-21T22:34:47.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.322+0000 7f02647fa640 1 -- 172.21.15.6:0/2826560722 shutdown_connections 2023-07-21T22:34:47.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.322+0000 7f02647fa640 1 --2- 172.21.15.6:0/2826560722 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f025c15cef0 0x7f025c153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:47.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.322+0000 7f02647fa640 1 --2- 172.21.15.6:0/2826560722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f025c159270 0x7f025c153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:47.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.322+0000 7f02647fa640 1 --2- 172.21.15.6:0/2826560722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f025c0aeb40 0x7f025c0cb3a0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.322+0000 7f02647fa640 1 -- 172.21.15.6:0/2826560722 >> 172.21.15.6:0/2826560722 conn(0x7f025c0cde90 msgr2=0x7f025c1529a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.322+0000 7f02647fa640 1 -- 172.21.15.6:0/2826560722 shutdown_connections 2023-07-21T22:34:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.322+0000 7f02647fa640 1 -- 172.21.15.6:0/2826560722 wait complete. 2023-07-21T22:34:47.393 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:34:47.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.490+0000 7f91c5eec640 1 Processor -- start 2023-07-21T22:34:47.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.490+0000 7f91c5eec640 1 -- start start 2023-07-21T22:34:47.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.490+0000 7f91c5eec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91c00d1850 0x7f91c00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:47.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.490+0000 7f91c5eec640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c00ccaf0 con 0x7f91c015fd60 2023-07-21T22:34:47.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.490+0000 7f91c5eec640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c0160320 con 0x7f91c00b7c70 2023-07-21T22:34:47.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.490+0000 7f91c5eec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00d1190 con 0x7f91c00d1850 2023-07-21T22:34:47.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.490+0000 7f91beffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f91c015fd60 0x7f91c00d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56488/0 (socket says 172.21.15.6:56488) 2023-07-21T22:34:47.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.490+0000 7f91beffd640 1 -- 172.21.15.6:0/2355602008 learned_addr learned my addr 172.21.15.6:0/2355602008 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:47.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.490+0000 7f91bffff640 1 --2- 172.21.15.6:0/2355602008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91c00d1850 0x7f91c00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:47.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.490+0000 7f91be7fc640 1 -- 172.21.15.6:0/2355602008 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754019370 0 0) 0x7f91c00ccaf0 con 0x7f91c015fd60 2023-07-21T22:34:47.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.490+0000 7f91be7fc640 1 -- 172.21.15.6:0/2355602008 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91a8003530 con 0x7f91c015fd60 2023-07-21T22:34:47.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.490+0000 7f91be7fc640 1 -- 172.21.15.6:0/2355602008 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396317708 0 0) 0x7f91c0160320 con 0x7f91c00b7c70 2023-07-21T22:34:47.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.490+0000 7f91be7fc640 1 -- 172.21.15.6:0/2355602008 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91c00ccaf0 con 0x7f91c00b7c70 2023-07-21T22:34:47.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.490+0000 7f91bffff640 1 -- 172.21.15.6:0/2355602008 >> v1:172.21.15.161:6789/0 conn(0x7f91c00b7c70 legacy=0x7f91c015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:47.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.490+0000 7f91bffff640 1 -- 172.21.15.6:0/2355602008 >> v1:172.21.15.6:6789/0 conn(0x7f91c015fd60 legacy=0x7f91c00d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:47.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.490+0000 7f91bffff640 1 -- 172.21.15.6:0/2355602008 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c00ccd90 con 0x7f91c00d1850 2023-07-21T22:34:47.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.494+0000 7f91bffff640 1 --2- 172.21.15.6:0/2355602008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91c00d1850 0x7f91c00d0c50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009dc0 tx=0x7f91b801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b1ceacda284ad9b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:47.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.494+0000 7f91be7fc640 1 -- 172.21.15.6:0/2355602008 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b80a5940 con 0x7f91c00d1850 2023-07-21T22:34:47.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.494+0000 7f91be7fc640 1 -- 172.21.15.6:0/2355602008 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b80a5aa0 con 0x7f91c00d1850 2023-07-21T22:34:47.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.494+0000 7f91be7fc640 1 -- 172.21.15.6:0/2355602008 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b80a5e10 con 0x7f91c00d1850 2023-07-21T22:34:47.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.494+0000 7f91c5eec640 1 -- 172.21.15.6:0/2355602008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91c00d1850 msgr2=0x7f91c00d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:47.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.494+0000 7f91c5eec640 1 --2- 172.21.15.6:0/2355602008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91c00d1850 0x7f91c00d0c50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009dc0 tx=0x7f91b801c970 comp rx=0 tx=0).stop 2023-07-21T22:34:47.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.494+0000 7f91c5eec640 1 -- 172.21.15.6:0/2355602008 shutdown_connections 2023-07-21T22:34:47.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.494+0000 7f91c5eec640 1 --2- 172.21.15.6:0/2355602008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91c00d1850 0x7f91c00d0c50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:47.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.494+0000 7f91c5eec640 1 -- 172.21.15.6:0/2355602008 >> 172.21.15.6:0/2355602008 conn(0x7f91c00650b0 msgr2=0x7f91c00654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:47.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.494+0000 7f91c5eec640 1 -- 172.21.15.6:0/2355602008 shutdown_connections 2023-07-21T22:34:47.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.494+0000 7f91c5eec640 1 -- 172.21.15.6:0/2355602008 wait complete. 2023-07-21T22:34:47.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91c5eec640 1 Processor -- start 2023-07-21T22:34:47.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91c5eec640 1 -- start start 2023-07-21T22:34:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91c5eec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91c00b7c70 0x7f91c014b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:47.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91c5eec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91c00d1850 0x7f91c0149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:47.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91c5eec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91c015fd60 0x7f91c014abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:47.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91c5eec640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c014a4b0 con 0x7f91c00d1850 2023-07-21T22:34:47.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91c5eec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00b5130 con 0x7f91c00b7c70 2023-07-21T22:34:47.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91c5eec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00b5410 con 0x7f91c015fd60 2023-07-21T22:34:47.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91beffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91c00d1850 0x7f91c0149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:47.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91beffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91c00d1850 0x7f91c0149f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45840/0 (socket says 172.21.15.6:45840) 2023-07-21T22:34:47.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91beffd640 1 -- 172.21.15.6:0/1898434402 learned_addr learned my addr 172.21.15.6:0/1898434402 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:47.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91bf7fe640 1 --2- 172.21.15.6:0/1898434402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91c00b7c70 0x7f91c014b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:47.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91bffff640 1 --2- 172.21.15.6:0/1898434402 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91c015fd60 0x7f91c014abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:47.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91beffd640 1 -- 172.21.15.6:0/1898434402 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91c015fd60 msgr2=0x7f91c014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:47.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91beffd640 1 --2- 172.21.15.6:0/1898434402 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91c015fd60 0x7f91c014abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:47.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91beffd640 1 -- 172.21.15.6:0/1898434402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91c00b7c70 msgr2=0x7f91c014b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:47.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91beffd640 1 --2- 172.21.15.6:0/1898434402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91c00b7c70 0x7f91c014b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:47.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91beffd640 1 -- 172.21.15.6:0/1898434402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b8009a70 con 0x7f91c00d1850 2023-07-21T22:34:47.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91bffff640 1 --2- 172.21.15.6:0/1898434402 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91c015fd60 0x7f91c014abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:47.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91beffd640 1 --2- 172.21.15.6:0/1898434402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91c00d1850 0x7f91c0149f70 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f91b400c4d0 tx=0x7f91b400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:47.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91a7fff640 1 -- 172.21.15.6:0/1898434402 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b4005cf0 con 0x7f91c00d1850 2023-07-21T22:34:47.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.498+0000 7f91a7fff640 1 -- 172.21.15.6:0/1898434402 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b4005e50 con 0x7f91c00d1850 2023-07-21T22:34:47.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.502+0000 7f91c5eec640 1 -- 172.21.15.6:0/1898434402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c00b56f0 con 0x7f91c00d1850 2023-07-21T22:34:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.502+0000 7f91a7fff640 1 -- 172.21.15.6:0/1898434402 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b40072b0 con 0x7f91c00d1850 2023-07-21T22:34:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.502+0000 7f91c5eec640 1 -- 172.21.15.6:0/1898434402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c00b5cb0 con 0x7f91c00d1850 2023-07-21T22:34:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.502+0000 7f91c5eec640 1 -- 172.21.15.6:0/1898434402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c00678d0 con 0x7f91c00d1850 2023-07-21T22:34:47.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.502+0000 7f91a7fff640 1 -- 172.21.15.6:0/1898434402 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 32) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f91b4007410 con 0x7f91c00d1850 2023-07-21T22:34:47.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.502+0000 7f91a7fff640 1 --2- 172.21.15.6:0/1898434402 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f91ac0660d0 0x7f91ac068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:47.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.502+0000 7f91a7fff640 1 -- 172.21.15.6:0/1898434402 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6837+0+0 (secure 0 0 0) 0x7f91b40832b0 con 0x7f91c00d1850 2023-07-21T22:34:47.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.502+0000 7f91bf7fe640 1 --2- 172.21.15.6:0/1898434402 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f91ac0660d0 0x7f91ac068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:47.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.502+0000 7f91bf7fe640 1 --2- 172.21.15.6:0/1898434402 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f91ac0660d0 0x7f91ac068580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f91b00011f0 tx=0x7f91b0009040 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:47.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.506+0000 7f91a7fff640 1 -- 172.21.15.6:0/1898434402 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f91b4050740 con 0x7f91c00d1850 2023-07-21T22:34:47.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.694+0000 7f91c5eec640 1 -- 172.21.15.6:0/1898434402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91c00c9240 con 0x7f91c00d1850 2023-07-21T22:34:47.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.694+0000 7f91a7fff640 1 -- 172.21.15.6:0/1898434402 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4666 (secure 0 0 0) 0x7f91b4053d60 con 0x7f91c00d1850 2023-07-21T22:34:47.746 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:47.746 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5960,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1945082031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1945082031},{"type":"v1","addr":"172.21.15.6:6835","nonce":1945082031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5963,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/778272832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":778272832},{"type":"v1","addr":"172.21.15.161:6836","nonce":778272832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/728409440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":728409440},{"type":"v1","addr":"172.21.15.161:6837","nonce":728409440}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:34:23.355700+0000","modified":"2023-07-21T22:34:26.993451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6585},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6585":{"gid":6585,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/1769681869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1769681869},{"type":"v1","addr":"172.21.15.6:6833","nonce":1769681869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-21T22:34:47.747 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 32 2023-07-21T22:34:47.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.698+0000 7f91c5eec640 1 -- 172.21.15.6:0/1898434402 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f91ac0660d0 msgr2=0x7f91ac068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:47.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.698+0000 7f91c5eec640 1 --2- 172.21.15.6:0/1898434402 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f91ac0660d0 0x7f91ac068580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f91b00011f0 tx=0x7f91b0009040 comp rx=0 tx=0).stop 2023-07-21T22:34:47.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.698+0000 7f91c5eec640 1 -- 172.21.15.6:0/1898434402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91c00d1850 msgr2=0x7f91c0149f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:47.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.698+0000 7f91c5eec640 1 --2- 172.21.15.6:0/1898434402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91c00d1850 0x7f91c0149f70 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f91b400c4d0 tx=0x7f91b400c990 comp rx=0 tx=0).stop 2023-07-21T22:34:47.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.698+0000 7f91c5eec640 1 -- 172.21.15.6:0/1898434402 shutdown_connections 2023-07-21T22:34:47.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.698+0000 7f91c5eec640 1 --2- 172.21.15.6:0/1898434402 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f91ac0660d0 0x7f91ac068580 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:47.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.698+0000 7f91c5eec640 1 --2- 172.21.15.6:0/1898434402 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f91c015fd60 0x7f91c014abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.698+0000 7f91c5eec640 1 --2- 172.21.15.6:0/1898434402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91c00d1850 0x7f91c0149f70 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.698+0000 7f91c5eec640 1 --2- 172.21.15.6:0/1898434402 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f91c00b7c70 0x7f91c014b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.698+0000 7f91c5eec640 1 -- 172.21.15.6:0/1898434402 >> 172.21.15.6:0/1898434402 conn(0x7f91c00650b0 msgr2=0x7f91c00b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.698+0000 7f91c5eec640 1 -- 172.21.15.6:0/1898434402 shutdown_connections 2023-07-21T22:34:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.698+0000 7f91c5eec640 1 -- 172.21.15.6:0/1898434402 wait complete. 2023-07-21T22:34:47.767 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:34:47.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.862+0000 7fc9cecca640 1 Processor -- start 2023-07-21T22:34:47.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.862+0000 7fc9cecca640 1 -- start start 2023-07-21T22:34:47.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.862+0000 7fc9cecca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c80d1850 0x7fc9c80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:47.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.862+0000 7fc9cecca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c80ccaf0 con 0x7fc9c80b7c70 2023-07-21T22:34:47.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.862+0000 7fc9cecca640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c8160320 con 0x7fc9c815fd60 2023-07-21T22:34:47.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.862+0000 7fc9cecca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80d1190 con 0x7fc9c80d1850 2023-07-21T22:34:47.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.862+0000 7fc9cca66640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc9c80b7c70 0x7fc9c815f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56498/0 (socket says 172.21.15.6:56498) 2023-07-21T22:34:47.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.862+0000 7fc9cca66640 1 -- 172.21.15.6:0/1069967233 learned_addr learned my addr 172.21.15.6:0/1069967233 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.862+0000 7fc9cd267640 1 --2- 172.21.15.6:0/1069967233 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c80d1850 0x7fc9c80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.862+0000 7fc9c77fe640 1 -- 172.21.15.6:0/1069967233 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215433384 0 0) 0x7fc9c80ccaf0 con 0x7fc9c80b7c70 2023-07-21T22:34:47.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.862+0000 7fc9c77fe640 1 -- 172.21.15.6:0/1069967233 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9b8003530 con 0x7fc9c80b7c70 2023-07-21T22:34:47.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.862+0000 7fc9c77fe640 1 -- 172.21.15.6:0/1069967233 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641530523 0 0) 0x7fc9c8160320 con 0x7fc9c815fd60 2023-07-21T22:34:47.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.862+0000 7fc9c77fe640 1 -- 172.21.15.6:0/1069967233 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9c80ccaf0 con 0x7fc9c815fd60 2023-07-21T22:34:47.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.862+0000 7fc9cd267640 1 -- 172.21.15.6:0/1069967233 >> v1:172.21.15.161:6789/0 conn(0x7fc9c815fd60 legacy=0x7fc9c80d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:47.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.862+0000 7fc9c77fe640 1 -- 172.21.15.6:0/1069967233 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3708854737 0 0) 0x7fc9b8003530 con 0x7fc9c80b7c70 2023-07-21T22:34:47.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.862+0000 7fc9cd267640 1 -- 172.21.15.6:0/1069967233 >> v1:172.21.15.6:6789/0 conn(0x7fc9c80b7c70 legacy=0x7fc9c815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:47.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.862+0000 7fc9cd267640 1 -- 172.21.15.6:0/1069967233 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c80ccd90 con 0x7fc9c80d1850 2023-07-21T22:34:47.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.866+0000 7fc9cd267640 1 --2- 172.21.15.6:0/1069967233 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c80d1850 0x7fc9c80d0c50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009dc0 tx=0x7fc9c001c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83be1b5fdcf81ac8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:47.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.866+0000 7fc9c77fe640 1 -- 172.21.15.6:0/1069967233 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc001680 con 0x7fc9c80d1850 2023-07-21T22:34:47.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.866+0000 7fc9c77fe640 1 -- 172.21.15.6:0/1069967233 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c00a55e0 con 0x7fc9c80d1850 2023-07-21T22:34:47.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.866+0000 7fc9c77fe640 1 -- 172.21.15.6:0/1069967233 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c00a5970 con 0x7fc9c80d1850 2023-07-21T22:34:47.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.866+0000 7fc9cecca640 1 -- 172.21.15.6:0/1069967233 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c80d1850 msgr2=0x7fc9c80d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:47.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.866+0000 7fc9cecca640 1 --2- 172.21.15.6:0/1069967233 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c80d1850 0x7fc9c80d0c50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009dc0 tx=0x7fc9c001c890 comp rx=0 tx=0).stop 2023-07-21T22:34:47.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.866+0000 7fc9cecca640 1 -- 172.21.15.6:0/1069967233 shutdown_connections 2023-07-21T22:34:47.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.866+0000 7fc9cecca640 1 --2- 172.21.15.6:0/1069967233 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c80d1850 0x7fc9c80d0c50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:47.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.866+0000 7fc9cecca640 1 -- 172.21.15.6:0/1069967233 >> 172.21.15.6:0/1069967233 conn(0x7fc9c80650b0 msgr2=0x7fc9c80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:47.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.870+0000 7fc9cecca640 1 -- 172.21.15.6:0/1069967233 shutdown_connections 2023-07-21T22:34:47.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.870+0000 7fc9cecca640 1 -- 172.21.15.6:0/1069967233 wait complete. 2023-07-21T22:34:47.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.870+0000 7fc9cecca640 1 Processor -- start 2023-07-21T22:34:47.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.870+0000 7fc9cecca640 1 -- start start 2023-07-21T22:34:47.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.870+0000 7fc9cecca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c80b7c70 0x7fc9c80b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:47.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.870+0000 7fc9cecca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c80d1850 0x7fc9c815c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:47.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.870+0000 7fc9cecca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9c815fd60 0x7fc9c814a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:47.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.870+0000 7fc9cecca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c815c630 con 0x7fc9c80b7c70 2023-07-21T22:34:47.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.870+0000 7fc9cecca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c814a990 con 0x7fc9c815fd60 2023-07-21T22:34:47.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.870+0000 7fc9cecca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c815c860 con 0x7fc9c80d1850 2023-07-21T22:34:47.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.870+0000 7fc9cca66640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c80b7c70 0x7fc9c80b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:47.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.870+0000 7fc9cca66640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c80b7c70 0x7fc9c80b6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45850/0 (socket says 172.21.15.6:45850) 2023-07-21T22:34:47.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.870+0000 7fc9cca66640 1 -- 172.21.15.6:0/157813992 learned_addr learned my addr 172.21.15.6:0/157813992 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:47.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.870+0000 7fc9cca66640 1 -- 172.21.15.6:0/157813992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c80d1850 msgr2=0x7fc9c815c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:47.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.870+0000 7fc9cca66640 1 --2- 172.21.15.6:0/157813992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c80d1850 0x7fc9c815c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:47.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.870+0000 7fc9cca66640 1 -- 172.21.15.6:0/157813992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9c815fd60 msgr2=0x7fc9c814a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:47.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.870+0000 7fc9cca66640 1 --2- 172.21.15.6:0/157813992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9c815fd60 0x7fc9c814a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:47.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.870+0000 7fc9cca66640 1 -- 172.21.15.6:0/157813992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c0009a70 con 0x7fc9c80b7c70 2023-07-21T22:34:47.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.870+0000 7fc9cca66640 1 --2- 172.21.15.6:0/157813992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c80b7c70 0x7fc9c80b6c00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00c750 tx=0x7fc9bc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:47.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.874+0000 7fc9c57fa640 1 -- 172.21.15.6:0/157813992 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc005ae0 con 0x7fc9c80b7c70 2023-07-21T22:34:47.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.874+0000 7fc9c57fa640 1 -- 172.21.15.6:0/157813992 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9bc005c40 con 0x7fc9c80b7c70 2023-07-21T22:34:47.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.874+0000 7fc9c57fa640 1 -- 172.21.15.6:0/157813992 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc007070 con 0x7fc9c80b7c70 2023-07-21T22:34:47.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.874+0000 7fc9cecca640 1 -- 172.21.15.6:0/157813992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c815cb40 con 0x7fc9c80b7c70 2023-07-21T22:34:47.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.874+0000 7fc9cecca640 1 -- 172.21.15.6:0/157813992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c815d100 con 0x7fc9c80b7c70 2023-07-21T22:34:47.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.874+0000 7fc9cecca640 1 -- 172.21.15.6:0/157813992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c80678d0 con 0x7fc9c80b7c70 2023-07-21T22:34:47.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.874+0000 7fc9c57fa640 1 -- 172.21.15.6:0/157813992 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 32) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fc9bc0071d0 con 0x7fc9c80b7c70 2023-07-21T22:34:47.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.874+0000 7fc9c57fa640 1 --2- 172.21.15.6:0/157813992 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fc9ac0660d0 0x7fc9ac068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:47.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.874+0000 7fc9c57fa640 1 -- 172.21.15.6:0/157813992 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6837+0+0 (secure 0 0 0) 0x7fc9bc083970 con 0x7fc9c80b7c70 2023-07-21T22:34:47.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.874+0000 7fc9c7fff640 1 --2- 172.21.15.6:0/157813992 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fc9ac0660d0 0x7fc9ac068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:47.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.878+0000 7fc9c7fff640 1 --2- 172.21.15.6:0/157813992 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fc9ac0660d0 0x7fc9ac068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4007fd0 tx=0x7fc9b4007960 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:47.878+0000 7fc9c57fa640 1 -- 172.21.15.6:0/157813992 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc9bc050e20 con 0x7fc9c80b7c70 2023-07-21T22:34:48.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.038+0000 7fc9cecca640 1 -- 172.21.15.6:0/157813992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9c80d04e0 con 0x7fc9c80b7c70 2023-07-21T22:34:48.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.042+0000 7fc9c57fa640 1 -- 172.21.15.6:0/157813992 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+19373 (secure 0 0 0) 0x7fc9bc054440 con 0x7fc9c80b7c70 2023-07-21T22:34:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:48.091 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:34:46.361087+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:34:21.475741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T22:34:22.347392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/3801622008":"2023-07-22T22:34:46.361032+0000","172.21.15.161:0/2551095790":"2023-07-22T22:34:46.361032+0000","172.21.15.161:0/3820490940":"2023-07-22T22:34:46.361032+0000","172.21.15.161:0/3150959489":"2023-07-22T22:34:46.361032+0000","172.21.15.161:0/3961178672":"2023-07-22T22:34:46.361032+0000","172.21.15.161:0/2986364953":"2023-07-22T22:34:46.361032+0000","172.21.15.161:0/2233957867":"2023-07-22T22:34:40.542719+0000","172.21.15.161:6833/3509960293":"2023-07-22T22:34:46.361032+0000","172.21.15.161:0/1213690087":"2023-07-22T22:34:40.542719+0000","172.21.15.161:6832/3509960293":"2023-07-22T22:34:46.361032+0000","172.21.15.161:6833/3045187557":"2023-07-22T22:34:40.542719+0000","172.21.15.161:0/1153636449":"2023-07-22T22:34:46.361032+0000","172.21.15.161:0/4231263708":"2023-07-22T22:34:40.542719+0000","172.21.15.161:6832/3045187557":"2023-07-22T22:34:40.542719+0000","172.21.15.161:0/2666620273":"2023-07-22T22:34:40.542719+0000","172.21.15.161:0/1660078658":"2023-07-22T22:34:40.542719+0000","172.21.15.161:0/2609870133":"2023-07-22T22:34:40.542719+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:34:48.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.042+0000 7fc9cecca640 1 -- 172.21.15.6:0/157813992 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fc9ac0660d0 msgr2=0x7fc9ac068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:48.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.042+0000 7fc9cecca640 1 --2- 172.21.15.6:0/157813992 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fc9ac0660d0 0x7fc9ac068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4007fd0 tx=0x7fc9b4007960 comp rx=0 tx=0).stop 2023-07-21T22:34:48.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.042+0000 7fc9cecca640 1 -- 172.21.15.6:0/157813992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c80b7c70 msgr2=0x7fc9c80b6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:48.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.042+0000 7fc9cecca640 1 --2- 172.21.15.6:0/157813992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c80b7c70 0x7fc9c80b6c00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00c750 tx=0x7fc9bc00cc10 comp rx=0 tx=0).stop 2023-07-21T22:34:48.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.042+0000 7fc9cecca640 1 -- 172.21.15.6:0/157813992 shutdown_connections 2023-07-21T22:34:48.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.042+0000 7fc9cecca640 1 --2- 172.21.15.6:0/157813992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9c815fd60 0x7fc9c814a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.042+0000 7fc9cecca640 1 --2- 172.21.15.6:0/157813992 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fc9ac0660d0 0x7fc9ac068580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.042+0000 7fc9cecca640 1 --2- 172.21.15.6:0/157813992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9c80d1850 0x7fc9c815c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.042+0000 7fc9cecca640 1 --2- 172.21.15.6:0/157813992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c80b7c70 0x7fc9c80b6c00 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.042+0000 7fc9cecca640 1 -- 172.21.15.6:0/157813992 >> 172.21.15.6:0/157813992 conn(0x7fc9c80650b0 msgr2=0x7fc9c8065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:48.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.042+0000 7fc9cecca640 1 -- 172.21.15.6:0/157813992 shutdown_connections 2023-07-21T22:34:48.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.042+0000 7fc9cecca640 1 -- 172.21.15.6:0/157813992 wait complete. 2023-07-21T22:34:48.112 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-21T22:34:48.113 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:34:48.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.206+0000 7f3bfc2cb640 1 Processor -- start 2023-07-21T22:34:48.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.206+0000 7f3bfc2cb640 1 -- start start 2023-07-21T22:34:48.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.206+0000 7f3bfc2cb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bf4160450 0x7f3bf406e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:48.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.206+0000 7f3bfc2cb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3bf4069430 0x7f3bf4069890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:48.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.206+0000 7f3bfc2cb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf4069dd0 con 0x7f3bf415bc00 2023-07-21T22:34:48.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.206+0000 7f3bfc2cb640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf40c96b0 con 0x7f3bf4069430 2023-07-21T22:34:48.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.206+0000 7f3bfc2cb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf40c9c30 con 0x7f3bf4160450 2023-07-21T22:34:48.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.206+0000 7f3bfa868640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3bf4069430 0x7f3bf4069890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:48.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.206+0000 7f3bfa868640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3bf4069430 0x7f3bf4069890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45864/0 (socket says 172.21.15.6:45864) 2023-07-21T22:34:48.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.206+0000 7f3bfa868640 1 -- 172.21.15.6:0/3666163018 learned_addr learned my addr 172.21.15.6:0/3666163018 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:48.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.206+0000 7f3bf9866640 1 --2- 172.21.15.6:0/3666163018 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bf4160450 0x7f3bf406e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:48.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.206+0000 7f3bfa868640 1 -- 172.21.15.6:0/3666163018 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bf4160450 msgr2=0x7f3bf406e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:48.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.206+0000 7f3bfa868640 1 --2- 172.21.15.6:0/3666163018 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bf4160450 0x7f3bf406e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.206+0000 7f3bfa868640 1 -- 172.21.15.6:0/3666163018 >> v1:172.21.15.161:6789/0 conn(0x7f3bf415bc00 legacy=0x7f3bf40ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:48.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.206+0000 7f3bfa868640 1 -- 172.21.15.6:0/3666163018 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf415bfd0 con 0x7f3bf4069430 2023-07-21T22:34:48.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.206+0000 7f3bf9866640 1 --2- 172.21.15.6:0/3666163018 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bf4160450 0x7f3bf406e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:48.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.210+0000 7f3bfa868640 1 --2- 172.21.15.6:0/3666163018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bf4069430 0x7f3bf4069890 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f3bec009e50 tx=0x7f3bec01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8714991c979766 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:48.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.210+0000 7f3bf9065640 1 -- 172.21.15.6:0/3666163018 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec0a5820 con 0x7f3bf4069430 2023-07-21T22:34:48.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.210+0000 7f3bf9065640 1 -- 172.21.15.6:0/3666163018 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec0a5980 con 0x7f3bf4069430 2023-07-21T22:34:48.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.210+0000 7f3bf9065640 1 -- 172.21.15.6:0/3666163018 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec0a5d10 con 0x7f3bf4069430 2023-07-21T22:34:48.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.210+0000 7f3bfc2cb640 1 -- 172.21.15.6:0/3666163018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bf4069430 msgr2=0x7f3bf4069890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:48.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.210+0000 7f3bfc2cb640 1 --2- 172.21.15.6:0/3666163018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bf4069430 0x7f3bf4069890 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f3bec009e50 tx=0x7f3bec01c9a0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.210+0000 7f3bfc2cb640 1 -- 172.21.15.6:0/3666163018 shutdown_connections 2023-07-21T22:34:48.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.210+0000 7f3bfc2cb640 1 --2- 172.21.15.6:0/3666163018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bf4069430 0x7f3bf4069890 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.210+0000 7f3bfc2cb640 1 --2- 172.21.15.6:0/3666163018 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bf4160450 0x7f3bf406e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.210+0000 7f3bfc2cb640 1 -- 172.21.15.6:0/3666163018 >> 172.21.15.6:0/3666163018 conn(0x7f3bf40b1840 msgr2=0x7f3bf40cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:48.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.210+0000 7f3bfc2cb640 1 -- 172.21.15.6:0/3666163018 shutdown_connections 2023-07-21T22:34:48.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.210+0000 7f3bfc2cb640 1 -- 172.21.15.6:0/3666163018 wait complete. 2023-07-21T22:34:48.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bfc2cb640 1 Processor -- start 2023-07-21T22:34:48.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bfc2cb640 1 -- start start 2023-07-21T22:34:48.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bfc2cb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bf4069430 0x7f3bf406d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:48.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bfc2cb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bf415bc00 0x7f3bf4143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:48.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bfc2cb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bf4160450 0x7f3bf414fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bfc2cb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf414f580 con 0x7f3bf415bc00 2023-07-21T22:34:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bfc2cb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf4143a70 con 0x7f3bf4160450 2023-07-21T22:34:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bfc2cb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf4150d10 con 0x7f3bf4069430 2023-07-21T22:34:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bf9866640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bf415bc00 0x7f3bf4143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:48.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bf9866640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bf415bc00 0x7f3bf4143530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45880/0 (socket says 172.21.15.6:45880) 2023-07-21T22:34:48.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bf9866640 1 -- 172.21.15.6:0/868053938 learned_addr learned my addr 172.21.15.6:0/868053938 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:48.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bfa868640 1 --2- 172.21.15.6:0/868053938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bf4160450 0x7f3bf414fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:48.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bfa067640 1 --2- 172.21.15.6:0/868053938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bf4069430 0x7f3bf406d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:48.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bf9866640 1 -- 172.21.15.6:0/868053938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bf4069430 msgr2=0x7f3bf406d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:48.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bf9866640 1 --2- 172.21.15.6:0/868053938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bf4069430 0x7f3bf406d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bf9866640 1 -- 172.21.15.6:0/868053938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bf4160450 msgr2=0x7f3bf414fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:48.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bf9866640 1 --2- 172.21.15.6:0/868053938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bf4160450 0x7f3bf414fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bf9866640 1 -- 172.21.15.6:0/868053938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec009b30 con 0x7f3bf415bc00 2023-07-21T22:34:48.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bfa067640 1 --2- 172.21.15.6:0/868053938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bf4069430 0x7f3bf406d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:48.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bf9866640 1 --2- 172.21.15.6:0/868053938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bf415bc00 0x7f3bf4143530 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3be400c7f0 tx=0x7f3be400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:48.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3beaffd640 1 -- 172.21.15.6:0/868053938 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be4007820 con 0x7f3bf415bc00 2023-07-21T22:34:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3beaffd640 1 -- 172.21.15.6:0/868053938 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be4007980 con 0x7f3bf415bc00 2023-07-21T22:34:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3beaffd640 1 -- 172.21.15.6:0/868053938 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be4007d30 con 0x7f3bf415bc00 2023-07-21T22:34:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bfc2cb640 1 -- 172.21.15.6:0/868053938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf4150a30 con 0x7f3bf415bc00 2023-07-21T22:34:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.214+0000 7f3bfc2cb640 1 -- 172.21.15.6:0/868053938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf414f210 con 0x7f3bf415bc00 2023-07-21T22:34:48.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.218+0000 7f3bfc2cb640 1 -- 172.21.15.6:0/868053938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf40c9500 con 0x7f3bf415bc00 2023-07-21T22:34:48.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.218+0000 7f3beaffd640 1 -- 172.21.15.6:0/868053938 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 32) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f3be40113f0 con 0x7f3bf415bc00 2023-07-21T22:34:48.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.218+0000 7f3beaffd640 1 --2- 172.21.15.6:0/868053938 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f3bd80660d0 0x7f3bd8068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:48.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.218+0000 7f3beaffd640 1 -- 172.21.15.6:0/868053938 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6837+0+0 (secure 0 0 0) 0x7f3be4083fe0 con 0x7f3bf415bc00 2023-07-21T22:34:48.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.218+0000 7f3bfa067640 1 --2- 172.21.15.6:0/868053938 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f3bd80660d0 0x7f3bd8068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:48.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.222+0000 7f3bfa067640 1 --2- 172.21.15.6:0/868053938 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f3bd80660d0 0x7f3bd8068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0003ec0 tx=0x7f3bf0009040 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:48.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.222+0000 7f3beaffd640 1 -- 172.21.15.6:0/868053938 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3be40514b0 con 0x7f3bf415bc00 2023-07-21T22:34:48.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.410+0000 7f3bfc2cb640 1 -- 172.21.15.6:0/868053938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bf40c98c0 con 0x7f3bf415bc00 2023-07-21T22:34:48.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.410+0000 7f3beaffd640 1 -- 172.21.15.6:0/868053938 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4666 (secure 0 0 0) 0x7f3be401f090 con 0x7f3bf415bc00 2023-07-21T22:34:48.463 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:48.463 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5960,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1945082031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1945082031},{"type":"v1","addr":"172.21.15.6:6835","nonce":1945082031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5963,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/778272832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":778272832},{"type":"v1","addr":"172.21.15.161:6836","nonce":778272832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/728409440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":728409440},{"type":"v1","addr":"172.21.15.161:6837","nonce":728409440}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:34:23.355700+0000","modified":"2023-07-21T22:34:26.993451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6585},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6585":{"gid":6585,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/1769681869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1769681869},{"type":"v1","addr":"172.21.15.6:6833","nonce":1769681869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-21T22:34:48.463 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 32 2023-07-21T22:34:48.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.414+0000 7f3bfc2cb640 1 -- 172.21.15.6:0/868053938 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f3bd80660d0 msgr2=0x7f3bd8068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:48.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.414+0000 7f3bfc2cb640 1 --2- 172.21.15.6:0/868053938 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f3bd80660d0 0x7f3bd8068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0003ec0 tx=0x7f3bf0009040 comp rx=0 tx=0).stop 2023-07-21T22:34:48.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.414+0000 7f3bfc2cb640 1 -- 172.21.15.6:0/868053938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bf415bc00 msgr2=0x7f3bf4143530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:48.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.414+0000 7f3bfc2cb640 1 --2- 172.21.15.6:0/868053938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bf415bc00 0x7f3bf4143530 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f3be400c7f0 tx=0x7f3be400ccb0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.414+0000 7f3bfc2cb640 1 -- 172.21.15.6:0/868053938 shutdown_connections 2023-07-21T22:34:48.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.414+0000 7f3bfc2cb640 1 --2- 172.21.15.6:0/868053938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3bf4160450 0x7f3bf414fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.414+0000 7f3bfc2cb640 1 --2- 172.21.15.6:0/868053938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bf415bc00 0x7f3bf4143530 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.414+0000 7f3bfc2cb640 1 --2- 172.21.15.6:0/868053938 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f3bd80660d0 0x7f3bd8068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.414+0000 7f3bfc2cb640 1 --2- 172.21.15.6:0/868053938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3bf4069430 0x7f3bf406d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.414+0000 7f3bfc2cb640 1 -- 172.21.15.6:0/868053938 >> 172.21.15.6:0/868053938 conn(0x7f3bf40b1840 msgr2=0x7f3bf40af510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:48.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.414+0000 7f3bfc2cb640 1 -- 172.21.15.6:0/868053938 shutdown_connections 2023-07-21T22:34:48.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.414+0000 7f3bfc2cb640 1 -- 172.21.15.6:0/868053938 wait complete. 2023-07-21T22:34:48.483 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:34:48.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.578+0000 7fdc29dd2640 1 Processor -- start 2023-07-21T22:34:48.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.578+0000 7fdc29dd2640 1 -- start start 2023-07-21T22:34:48.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.578+0000 7fdc29dd2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc240c8ad0 0x7fdc240c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:48.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.578+0000 7fdc29dd2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdc240c9560 0x7fdc240ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:48.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.578+0000 7fdc29dd2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc240cc700 con 0x7fdc24158ce0 2023-07-21T22:34:48.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.578+0000 7fdc29dd2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc240c99e0 con 0x7fdc240c9560 2023-07-21T22:34:48.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.578+0000 7fdc29dd2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240b0ff0 con 0x7fdc240c8ad0 2023-07-21T22:34:48.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.578+0000 7fdc237fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdc24158ce0 0x7fdc24070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56514/0 (socket says 172.21.15.6:56514) 2023-07-21T22:34:48.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.578+0000 7fdc237fe640 1 -- 172.21.15.6:0/4275715173 learned_addr learned my addr 172.21.15.6:0/4275715173 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:48.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.578+0000 7fdc23fff640 1 --2- 172.21.15.6:0/4275715173 >> v2:172.21.15.6:3300/0 conn(0x7fdc240c9560 0x7fdc240ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:48.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.578+0000 7fdc22ffd640 1 --2- 172.21.15.6:0/4275715173 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc240c8ad0 0x7fdc240c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:48.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.578+0000 7fdc227fc640 1 -- 172.21.15.6:0/4275715173 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028919971 0 0) 0x7fdc240cc700 con 0x7fdc24158ce0 2023-07-21T22:34:48.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.578+0000 7fdc227fc640 1 -- 172.21.15.6:0/4275715173 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc0c005740 con 0x7fdc24158ce0 2023-07-21T22:34:48.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.578+0000 7fdc23fff640 1 -- 172.21.15.6:0/4275715173 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc240c8ad0 msgr2=0x7fdc240c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:48.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.578+0000 7fdc23fff640 1 --2- 172.21.15.6:0/4275715173 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc240c8ad0 0x7fdc240c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.578+0000 7fdc23fff640 1 -- 172.21.15.6:0/4275715173 >> v1:172.21.15.6:6789/0 conn(0x7fdc24158ce0 legacy=0x7fdc24070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:48.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.578+0000 7fdc23fff640 1 -- 172.21.15.6:0/4275715173 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc24070c80 con 0x7fdc240c9560 2023-07-21T22:34:48.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.582+0000 7fdc23fff640 1 --2- 172.21.15.6:0/4275715173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc240c9560 0x7fdc240ccb90 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c009d90 tx=0x7fdc1c01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44435803b1828821 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:48.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.582+0000 7fdc227fc640 1 -- 172.21.15.6:0/4275715173 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c0a57d0 con 0x7fdc240c9560 2023-07-21T22:34:48.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.582+0000 7fdc227fc640 1 -- 172.21.15.6:0/4275715173 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c0a5930 con 0x7fdc240c9560 2023-07-21T22:34:48.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.582+0000 7fdc227fc640 1 -- 172.21.15.6:0/4275715173 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c0a5cc0 con 0x7fdc240c9560 2023-07-21T22:34:48.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.582+0000 7fdc29dd2640 1 -- 172.21.15.6:0/4275715173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc240c9560 msgr2=0x7fdc240ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:48.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.582+0000 7fdc29dd2640 1 --2- 172.21.15.6:0/4275715173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc240c9560 0x7fdc240ccb90 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c009d90 tx=0x7fdc1c01c800 comp rx=0 tx=0).stop 2023-07-21T22:34:48.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.582+0000 7fdc29dd2640 1 -- 172.21.15.6:0/4275715173 shutdown_connections 2023-07-21T22:34:48.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.582+0000 7fdc29dd2640 1 --2- 172.21.15.6:0/4275715173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc240c9560 0x7fdc240ccb90 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.582+0000 7fdc29dd2640 1 --2- 172.21.15.6:0/4275715173 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc240c8ad0 0x7fdc240c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.582+0000 7fdc29dd2640 1 -- 172.21.15.6:0/4275715173 >> 172.21.15.6:0/4275715173 conn(0x7fdc240afcf0 msgr2=0x7fdc240b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.582+0000 7fdc29dd2640 1 -- 172.21.15.6:0/4275715173 shutdown_connections 2023-07-21T22:34:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.582+0000 7fdc29dd2640 1 -- 172.21.15.6:0/4275715173 wait complete. 2023-07-21T22:34:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc29dd2640 1 Processor -- start 2023-07-21T22:34:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc29dd2640 1 -- start start 2023-07-21T22:34:48.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc29dd2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc240c8ad0 0x7fdc240aee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc29dd2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc240c9560 0x7fdc240ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc29dd2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc24158ce0 0x7fdc2414c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc29dd2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2414e390 con 0x7fdc240c8ad0 2023-07-21T22:34:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc29dd2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240af680 con 0x7fdc24158ce0 2023-07-21T22:34:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc29dd2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240af960 con 0x7fdc240c9560 2023-07-21T22:34:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc237fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc240c8ad0 0x7fdc240aee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc237fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc240c8ad0 0x7fdc240aee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45904/0 (socket says 172.21.15.6:45904) 2023-07-21T22:34:48.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc237fe640 1 -- 172.21.15.6:0/4051090352 learned_addr learned my addr 172.21.15.6:0/4051090352 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:48.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc23fff640 1 --2- 172.21.15.6:0/4051090352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc24158ce0 0x7fdc2414c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:48.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc22ffd640 1 --2- 172.21.15.6:0/4051090352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc240c9560 0x7fdc240ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:48.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc237fe640 1 -- 172.21.15.6:0/4051090352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc240c9560 msgr2=0x7fdc240ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:48.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc237fe640 1 --2- 172.21.15.6:0/4051090352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc240c9560 0x7fdc240ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc237fe640 1 -- 172.21.15.6:0/4051090352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc24158ce0 msgr2=0x7fdc2414c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:48.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc237fe640 1 --2- 172.21.15.6:0/4051090352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc24158ce0 0x7fdc2414c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc237fe640 1 -- 172.21.15.6:0/4051090352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c009a70 con 0x7fdc240c8ad0 2023-07-21T22:34:48.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc23fff640 1 --2- 172.21.15.6:0/4051090352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc24158ce0 0x7fdc2414c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:48.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc237fe640 1 --2- 172.21.15.6:0/4051090352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc240c8ad0 0x7fdc240aee10 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400c420 tx=0x7fdc1400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:48.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc0bfff640 1 -- 172.21.15.6:0/4051090352 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14005cf0 con 0x7fdc240c8ad0 2023-07-21T22:34:48.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc0bfff640 1 -- 172.21.15.6:0/4051090352 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc14005e50 con 0x7fdc240c8ad0 2023-07-21T22:34:48.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.586+0000 7fdc0bfff640 1 -- 172.21.15.6:0/4051090352 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc140072d0 con 0x7fdc240c8ad0 2023-07-21T22:34:48.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.590+0000 7fdc29dd2640 1 -- 172.21.15.6:0/4051090352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc2414e5a0 con 0x7fdc240c8ad0 2023-07-21T22:34:48.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.590+0000 7fdc29dd2640 1 -- 172.21.15.6:0/4051090352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc240af350 con 0x7fdc240c8ad0 2023-07-21T22:34:48.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.590+0000 7fdc29dd2640 1 -- 172.21.15.6:0/4051090352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc240ca1a0 con 0x7fdc240c8ad0 2023-07-21T22:34:48.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.590+0000 7fdc0bfff640 1 -- 172.21.15.6:0/4051090352 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 32) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fdc14007430 con 0x7fdc240c8ad0 2023-07-21T22:34:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.590+0000 7fdc0bfff640 1 --2- 172.21.15.6:0/4051090352 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fdc100660d0 0x7fdc10068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.590+0000 7fdc0bfff640 1 -- 172.21.15.6:0/4051090352 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6837+0+0 (secure 0 0 0) 0x7fdc14083290 con 0x7fdc240c8ad0 2023-07-21T22:34:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.590+0000 7fdc22ffd640 1 --2- 172.21.15.6:0/4051090352 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fdc100660d0 0x7fdc10068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.594+0000 7fdc22ffd640 1 --2- 172.21.15.6:0/4051090352 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fdc100660d0 0x7fdc10068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdc240ab870 tx=0x7fdc18008040 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:48.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.594+0000 7fdc0bfff640 1 -- 172.21.15.6:0/4051090352 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdc14050720 con 0x7fdc240c8ad0 2023-07-21T22:34:48.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.786+0000 7fdc29dd2640 1 -- 172.21.15.6:0/4051090352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc240678d0 con 0x7fdc240c8ad0 2023-07-21T22:34:48.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.786+0000 7fdc0bfff640 1 -- 172.21.15.6:0/4051090352 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4666 (secure 0 0 0) 0x7fdc14053d40 con 0x7fdc240c8ad0 2023-07-21T22:34:48.836 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:48.837 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5960,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1945082031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1945082031},{"type":"v1","addr":"172.21.15.6:6835","nonce":1945082031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5963,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/778272832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":778272832},{"type":"v1","addr":"172.21.15.161:6836","nonce":778272832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/728409440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":728409440},{"type":"v1","addr":"172.21.15.161:6837","nonce":728409440}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:34:23.355700+0000","modified":"2023-07-21T22:34:26.993451+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6585},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6585":{"gid":6585,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/1769681869","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1769681869},{"type":"v1","addr":"172.21.15.6:6833","nonce":1769681869}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-21T22:34:48.837 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 32 2023-07-21T22:34:48.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.786+0000 7fdc29dd2640 1 -- 172.21.15.6:0/4051090352 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fdc100660d0 msgr2=0x7fdc10068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:48.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.786+0000 7fdc29dd2640 1 --2- 172.21.15.6:0/4051090352 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fdc100660d0 0x7fdc10068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdc240ab870 tx=0x7fdc18008040 comp rx=0 tx=0).stop 2023-07-21T22:34:48.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.786+0000 7fdc29dd2640 1 -- 172.21.15.6:0/4051090352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc240c8ad0 msgr2=0x7fdc240aee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:48.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.786+0000 7fdc29dd2640 1 --2- 172.21.15.6:0/4051090352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc240c8ad0 0x7fdc240aee10 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400c420 tx=0x7fdc1400c8e0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.786+0000 7fdc29dd2640 1 -- 172.21.15.6:0/4051090352 shutdown_connections 2023-07-21T22:34:48.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.786+0000 7fdc29dd2640 1 --2- 172.21.15.6:0/4051090352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdc24158ce0 0x7fdc2414c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.786+0000 7fdc29dd2640 1 --2- 172.21.15.6:0/4051090352 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fdc100660d0 0x7fdc10068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.786+0000 7fdc29dd2640 1 --2- 172.21.15.6:0/4051090352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdc240c9560 0x7fdc240ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.786+0000 7fdc29dd2640 1 --2- 172.21.15.6:0/4051090352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc240c8ad0 0x7fdc240aee10 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:48.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.786+0000 7fdc29dd2640 1 -- 172.21.15.6:0/4051090352 >> 172.21.15.6:0/4051090352 conn(0x7fdc240afcf0 msgr2=0x7fdc24151870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:48.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.786+0000 7fdc29dd2640 1 -- 172.21.15.6:0/4051090352 shutdown_connections 2023-07-21T22:34:48.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.786+0000 7fdc29dd2640 1 -- 172.21.15.6:0/4051090352 wait complete. 2023-07-21T22:34:48.857 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:34:49.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.954+0000 7f39f9512640 1 Processor -- start 2023-07-21T22:34:49.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.954+0000 7f39f9512640 1 -- start start 2023-07-21T22:34:49.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.954+0000 7f39f9512640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f39f415f3f0 0x7f39f40b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:49.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.954+0000 7f39f9512640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f39f40b7bc0 0x7f39f40cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:49.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.954+0000 7f39f9512640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f40b8020 con 0x7f39f40d13f0 2023-07-21T22:34:49.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.954+0000 7f39f9512640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f40d0f60 con 0x7f39f415f3f0 2023-07-21T22:34:49.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.954+0000 7f39f9512640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f40d0390 con 0x7f39f40b7bc0 2023-07-21T22:34:49.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.954+0000 7f39f3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f39f415f3f0 0x7f39f40b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:49.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.954+0000 7f39f37fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f39f40d13f0 0x7f39f40cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56524/0 (socket says 172.21.15.6:56524) 2023-07-21T22:34:49.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.954+0000 7f39f37fe640 1 -- 172.21.15.6:0/3346331136 learned_addr learned my addr 172.21.15.6:0/3346331136 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:49.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.954+0000 7f39f3fff640 1 -- 172.21.15.6:0/3346331136 >> v2:172.21.15.161:3300/0 conn(0x7f39f40b7bc0 msgr2=0x7f39f40cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:49.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.954+0000 7f39f2ffd640 1 -- 172.21.15.6:0/3346331136 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685845486 0 0) 0x7f39f40b8020 con 0x7f39f40d13f0 2023-07-21T22:34:49.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.954+0000 7f39f8d11640 1 --2- 172.21.15.6:0/3346331136 >> v2:172.21.15.161:3300/0 conn(0x7f39f40b7bc0 0x7f39f40cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:49.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.954+0000 7f39f3fff640 1 --2- 172.21.15.6:0/3346331136 >> v2:172.21.15.161:3300/0 conn(0x7f39f40b7bc0 0x7f39f40cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.954+0000 7f39f3fff640 1 -- 172.21.15.6:0/3346331136 >> v1:172.21.15.6:6789/0 conn(0x7f39f40d13f0 legacy=0x7f39f40cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:49.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.954+0000 7f39f3fff640 1 -- 172.21.15.6:0/3346331136 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f40d0630 con 0x7f39f415f3f0 2023-07-21T22:34:49.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.954+0000 7f39f8d11640 1 --2- 172.21.15.6:0/3346331136 >> v2:172.21.15.161:3300/0 conn(0x7f39f40b7bc0 0x7f39f40cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:49.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.958+0000 7f39f3fff640 1 --2- 172.21.15.6:0/3346331136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f415f3f0 0x7f39f40b7680 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f39f40ce1e0 tx=0x7f39e401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83a2a8d04993deb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:49.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.958+0000 7f39f2ffd640 1 -- 172.21.15.6:0/3346331136 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e40ab600 con 0x7f39f415f3f0 2023-07-21T22:34:49.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.958+0000 7f39f2ffd640 1 -- 172.21.15.6:0/3346331136 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e40a7050 con 0x7f39f415f3f0 2023-07-21T22:34:49.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.958+0000 7f39f2ffd640 1 -- 172.21.15.6:0/3346331136 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e40ab980 con 0x7f39f415f3f0 2023-07-21T22:34:49.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.958+0000 7f39f9512640 1 -- 172.21.15.6:0/3346331136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f415f3f0 msgr2=0x7f39f40b7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:49.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.958+0000 7f39f9512640 1 --2- 172.21.15.6:0/3346331136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f415f3f0 0x7f39f40b7680 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f39f40ce1e0 tx=0x7f39e401c3d0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.958+0000 7f39f9512640 1 -- 172.21.15.6:0/3346331136 shutdown_connections 2023-07-21T22:34:49.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.958+0000 7f39f9512640 1 --2- 172.21.15.6:0/3346331136 >> v2:172.21.15.161:3300/0 conn(0x7f39f40b7bc0 0x7f39f40cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.958+0000 7f39f9512640 1 --2- 172.21.15.6:0/3346331136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f415f3f0 0x7f39f40b7680 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.958+0000 7f39f9512640 1 -- 172.21.15.6:0/3346331136 >> 172.21.15.6:0/3346331136 conn(0x7f39f4069f50 msgr2=0x7f39f406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:49.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.958+0000 7f39f9512640 1 -- 172.21.15.6:0/3346331136 shutdown_connections 2023-07-21T22:34:49.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.958+0000 7f39f9512640 1 -- 172.21.15.6:0/3346331136 wait complete. 2023-07-21T22:34:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.958+0000 7f39f9512640 1 Processor -- start 2023-07-21T22:34:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f9512640 1 -- start start 2023-07-21T22:34:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f9512640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39f40b7bc0 0x7f39f415fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f9512640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f40d13f0 0x7f39f41476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f9512640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39f415f3f0 0x7f39f415a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f9512640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f40c95e0 con 0x7f39f40d13f0 2023-07-21T22:34:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f9512640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f415d2b0 con 0x7f39f40b7bc0 2023-07-21T22:34:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f9512640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f415d590 con 0x7f39f415f3f0 2023-07-21T22:34:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f40d13f0 0x7f39f41476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f40d13f0 0x7f39f41476a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45932/0 (socket says 172.21.15.6:45932) 2023-07-21T22:34:49.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f37fe640 1 -- 172.21.15.6:0/1979412109 learned_addr learned my addr 172.21.15.6:0/1979412109 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:49.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f3fff640 1 --2- 172.21.15.6:0/1979412109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39f40b7bc0 0x7f39f415fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:49.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f8d11640 1 --2- 172.21.15.6:0/1979412109 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39f415f3f0 0x7f39f415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:49.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f37fe640 1 -- 172.21.15.6:0/1979412109 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39f415f3f0 msgr2=0x7f39f415a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:49.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f37fe640 1 --2- 172.21.15.6:0/1979412109 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39f415f3f0 0x7f39f415a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f37fe640 1 -- 172.21.15.6:0/1979412109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39f40b7bc0 msgr2=0x7f39f415fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:49.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f37fe640 1 --2- 172.21.15.6:0/1979412109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39f40b7bc0 0x7f39f415fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f37fe640 1 -- 172.21.15.6:0/1979412109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e4009420 con 0x7f39f40d13f0 2023-07-21T22:34:49.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f37fe640 1 --2- 172.21.15.6:0/1979412109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f40d13f0 0x7f39f41476a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f39e80011f0 tx=0x7f39e800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:49.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f0ff9640 1 -- 172.21.15.6:0/1979412109 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e80074e0 con 0x7f39f40d13f0 2023-07-21T22:34:49.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f0ff9640 1 -- 172.21.15.6:0/1979412109 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e8007640 con 0x7f39f40d13f0 2023-07-21T22:34:49.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f0ff9640 1 -- 172.21.15.6:0/1979412109 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e8004a10 con 0x7f39f40d13f0 2023-07-21T22:34:49.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f9512640 1 -- 172.21.15.6:0/1979412109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f415d870 con 0x7f39f40d13f0 2023-07-21T22:34:49.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f9512640 1 -- 172.21.15.6:0/1979412109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f4158bf0 con 0x7f39f40d13f0 2023-07-21T22:34:49.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.962+0000 7f39f9512640 1 -- 172.21.15.6:0/1979412109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f40c9720 con 0x7f39f40d13f0 2023-07-21T22:34:49.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.966+0000 7f39f0ff9640 1 -- 172.21.15.6:0/1979412109 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f39e8004b70 con 0x7f39f40d13f0 2023-07-21T22:34:49.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.966+0000 7f39f0ff9640 1 --2- 172.21.15.6:0/1979412109 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f39e00663a0 0x7f39e0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:49.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.966+0000 7f39f0ff9640 1 -- 172.21.15.6:0/1979412109 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6837+0+0 (secure 0 0 0) 0x7f39e8083460 con 0x7f39f40d13f0 2023-07-21T22:34:49.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.966+0000 7f39f3fff640 1 --2- 172.21.15.6:0/1979412109 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f39e00663a0 0x7f39e0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:49.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.966+0000 7f39f3fff640 1 --2- 172.21.15.6:0/1979412109 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f39e00663a0 0x7f39e0068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f39e40ad000 tx=0x7f39e40a6000 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:49.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:48.970+0000 7f39f0ff9640 1 -- 172.21.15.6:0/1979412109 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f39f40c9720 con 0x7f39f40d13f0 2023-07-21T22:34:49.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.122+0000 7f39f9512640 1 -- 172.21.15.6:0/1979412109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39f40c9720 con 0x7f39f40d13f0 2023-07-21T22:34:49.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.126+0000 7f39f0ff9640 1 -- 172.21.15.6:0/1979412109 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+19373 (secure 0 0 0) 0x7f39f40c9720 con 0x7f39f40d13f0 2023-07-21T22:34:49.176 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:49.176 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:34:46.361087+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:34:21.475741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-21T22:34:22.347392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/3801622008":"2023-07-22T22:34:46.361032+0000","172.21.15.161:0/2551095790":"2023-07-22T22:34:46.361032+0000","172.21.15.161:0/3820490940":"2023-07-22T22:34:46.361032+0000","172.21.15.161:0/3150959489":"2023-07-22T22:34:46.361032+0000","172.21.15.161:0/3961178672":"2023-07-22T22:34:46.361032+0000","172.21.15.161:0/2986364953":"2023-07-22T22:34:46.361032+0000","172.21.15.161:0/2233957867":"2023-07-22T22:34:40.542719+0000","172.21.15.161:6833/3509960293":"2023-07-22T22:34:46.361032+0000","172.21.15.161:0/1213690087":"2023-07-22T22:34:40.542719+0000","172.21.15.161:6832/3509960293":"2023-07-22T22:34:46.361032+0000","172.21.15.161:6833/3045187557":"2023-07-22T22:34:40.542719+0000","172.21.15.161:0/1153636449":"2023-07-22T22:34:46.361032+0000","172.21.15.161:0/4231263708":"2023-07-22T22:34:40.542719+0000","172.21.15.161:6832/3045187557":"2023-07-22T22:34:40.542719+0000","172.21.15.161:0/2666620273":"2023-07-22T22:34:40.542719+0000","172.21.15.161:0/1660078658":"2023-07-22T22:34:40.542719+0000","172.21.15.161:0/2609870133":"2023-07-22T22:34:40.542719+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:34:49.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.126+0000 7f39f9512640 1 -- 172.21.15.6:0/1979412109 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f39e00663a0 msgr2=0x7f39e0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:49.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.126+0000 7f39f9512640 1 --2- 172.21.15.6:0/1979412109 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f39e00663a0 0x7f39e0068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f39e40ad000 tx=0x7f39e40a6000 comp rx=0 tx=0).stop 2023-07-21T22:34:49.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.126+0000 7f39f9512640 1 -- 172.21.15.6:0/1979412109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f40d13f0 msgr2=0x7f39f41476a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:49.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.126+0000 7f39f9512640 1 --2- 172.21.15.6:0/1979412109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f40d13f0 0x7f39f41476a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f39e80011f0 tx=0x7f39e800c9b0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.126+0000 7f39f9512640 1 -- 172.21.15.6:0/1979412109 shutdown_connections 2023-07-21T22:34:49.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.126+0000 7f39f9512640 1 --2- 172.21.15.6:0/1979412109 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f39e00663a0 0x7f39e0068850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.126+0000 7f39f9512640 1 --2- 172.21.15.6:0/1979412109 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39f415f3f0 0x7f39f415a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.126+0000 7f39f9512640 1 --2- 172.21.15.6:0/1979412109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39f40d13f0 0x7f39f41476a0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.126+0000 7f39f9512640 1 --2- 172.21.15.6:0/1979412109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39f40b7bc0 0x7f39f415fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.126+0000 7f39f9512640 1 -- 172.21.15.6:0/1979412109 >> 172.21.15.6:0/1979412109 conn(0x7f39f4069f50 msgr2=0x7f39f40d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:49.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.126+0000 7f39f9512640 1 -- 172.21.15.6:0/1979412109 shutdown_connections 2023-07-21T22:34:49.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.126+0000 7f39f9512640 1 -- 172.21.15.6:0/1979412109 wait complete. 2023-07-21T22:34:49.198 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-21T22:34:49.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.290+0000 7f79af0d8640 1 Processor -- start 2023-07-21T22:34:49.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.294+0000 7f79af0d8640 1 -- start start 2023-07-21T22:34:49.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.294+0000 7f79af0d8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79a806b1e0 0x7f79a80c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:49.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.294+0000 7f79af0d8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a80cac70 con 0x7f79a80c21f0 2023-07-21T22:34:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.294+0000 7f79af0d8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a80ca060 con 0x7f79a8070b70 2023-07-21T22:34:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.294+0000 7f79af0d8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80ca340 con 0x7f79a806b1e0 2023-07-21T22:34:49.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.294+0000 7f79ad675640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f79a80c21f0 0x7f79a80cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56532/0 (socket says 172.21.15.6:56532) 2023-07-21T22:34:49.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.294+0000 7f79ad675640 1 -- 172.21.15.6:0/2836201701 learned_addr learned my addr 172.21.15.6:0/2836201701 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:49.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.294+0000 7f79a7fff640 1 --2- 172.21.15.6:0/2836201701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79a806b1e0 0x7f79a80c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:49.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.294+0000 7f79a77fe640 1 -- 172.21.15.6:0/2836201701 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427180643 0 0) 0x7f79a80cac70 con 0x7f79a80c21f0 2023-07-21T22:34:49.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.294+0000 7f79a77fe640 1 -- 172.21.15.6:0/2836201701 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7998003530 con 0x7f79a80c21f0 2023-07-21T22:34:49.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.294+0000 7f79a77fe640 1 -- 172.21.15.6:0/2836201701 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183567986 0 0) 0x7f79a80ca060 con 0x7f79a8070b70 2023-07-21T22:34:49.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.294+0000 7f79a77fe640 1 -- 172.21.15.6:0/2836201701 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79a80cac70 con 0x7f79a8070b70 2023-07-21T22:34:49.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.294+0000 7f79a7fff640 1 -- 172.21.15.6:0/2836201701 >> v1:172.21.15.161:6789/0 conn(0x7f79a8070b70 legacy=0x7f79a8070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:49.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.294+0000 7f79a7fff640 1 -- 172.21.15.6:0/2836201701 >> v1:172.21.15.6:6789/0 conn(0x7f79a80c21f0 legacy=0x7f79a80cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:49.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.294+0000 7f79a7fff640 1 -- 172.21.15.6:0/2836201701 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a80ca620 con 0x7f79a806b1e0 2023-07-21T22:34:49.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.298+0000 7f79a7fff640 1 --2- 172.21.15.6:0/2836201701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79a806b1e0 0x7f79a80c1cb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f79940097f0 tx=0x7f799401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0fb2f0471ae4ba7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:49.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.298+0000 7f79a77fe640 1 -- 172.21.15.6:0/2836201701 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79940ab600 con 0x7f79a806b1e0 2023-07-21T22:34:49.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.298+0000 7f79a77fe640 1 -- 172.21.15.6:0/2836201701 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79940ab760 con 0x7f79a806b1e0 2023-07-21T22:34:49.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.298+0000 7f79a77fe640 1 -- 172.21.15.6:0/2836201701 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79940abad0 con 0x7f79a806b1e0 2023-07-21T22:34:49.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.298+0000 7f79af0d8640 1 -- 172.21.15.6:0/2836201701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79a806b1e0 msgr2=0x7f79a80c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:49.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.298+0000 7f79af0d8640 1 --2- 172.21.15.6:0/2836201701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79a806b1e0 0x7f79a80c1cb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f79940097f0 tx=0x7f799401c400 comp rx=0 tx=0).stop 2023-07-21T22:34:49.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.298+0000 7f79af0d8640 1 -- 172.21.15.6:0/2836201701 shutdown_connections 2023-07-21T22:34:49.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.298+0000 7f79af0d8640 1 --2- 172.21.15.6:0/2836201701 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79a806b1e0 0x7f79a80c1cb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.298+0000 7f79af0d8640 1 -- 172.21.15.6:0/2836201701 >> 172.21.15.6:0/2836201701 conn(0x7f79a80afcf0 msgr2=0x7f79a80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:49.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.298+0000 7f79af0d8640 1 -- 172.21.15.6:0/2836201701 shutdown_connections 2023-07-21T22:34:49.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.298+0000 7f79af0d8640 1 -- 172.21.15.6:0/2836201701 wait complete. 2023-07-21T22:34:49.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.298+0000 7f79af0d8640 1 Processor -- start 2023-07-21T22:34:49.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.298+0000 7f79af0d8640 1 -- start start 2023-07-21T22:34:49.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79af0d8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79a806b1e0 0x7f79a8149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:49.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79af0d8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79a8070b70 0x7f79a81500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:49.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79af0d8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79a80c21f0 0x7f79a81523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:49.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79af0d8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a8159880 con 0x7f79a80c21f0 2023-07-21T22:34:49.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79af0d8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80cc740 con 0x7f79a806b1e0 2023-07-21T22:34:49.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79af0d8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a80cca20 con 0x7f79a8070b70 2023-07-21T22:34:49.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79ad675640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79a80c21f0 0x7f79a81523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:49.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79a7fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79a8070b70 0x7f79a81500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:49.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79ace74640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79a806b1e0 0x7f79a8149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:49.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79ad675640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79a80c21f0 0x7f79a81523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45942/0 (socket says 172.21.15.6:45942) 2023-07-21T22:34:49.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79a7fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79a8070b70 0x7f79a81500f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:52802/0 (socket says 172.21.15.6:52802) 2023-07-21T22:34:49.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79ad675640 1 -- 172.21.15.6:0/3876141503 learned_addr learned my addr 172.21.15.6:0/3876141503 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:49.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79ace74640 1 -- 172.21.15.6:0/3876141503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79a8070b70 msgr2=0x7f79a81500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:49.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79ace74640 1 --2- 172.21.15.6:0/3876141503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79a8070b70 0x7f79a81500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79ace74640 1 -- 172.21.15.6:0/3876141503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79a80c21f0 msgr2=0x7f79a81523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:49.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79ace74640 1 --2- 172.21.15.6:0/3876141503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79a80c21f0 0x7f79a81523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79ace74640 1 -- 172.21.15.6:0/3876141503 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7994009420 con 0x7f79a806b1e0 2023-07-21T22:34:49.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79ad675640 1 --2- 172.21.15.6:0/3876141503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79a80c21f0 0x7f79a81523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:49.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79ace74640 1 --2- 172.21.15.6:0/3876141503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79a806b1e0 0x7f79a8149c80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f799c00c430 tx=0x7f799c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:49.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79a57fa640 1 -- 172.21.15.6:0/3876141503 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c0052d0 con 0x7f79a806b1e0 2023-07-21T22:34:49.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79a57fa640 1 -- 172.21.15.6:0/3876141503 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c005430 con 0x7f79a806b1e0 2023-07-21T22:34:49.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79a57fa640 1 -- 172.21.15.6:0/3876141503 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c003840 con 0x7f79a806b1e0 2023-07-21T22:34:49.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79af0d8640 1 -- 172.21.15.6:0/3876141503 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a80ccd00 con 0x7f79a806b1e0 2023-07-21T22:34:49.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79af0d8640 1 -- 172.21.15.6:0/3876141503 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a814f8f0 con 0x7f79a806b1e0 2023-07-21T22:34:49.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.302+0000 7f79af0d8640 1 -- 172.21.15.6:0/3876141503 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a814f470 con 0x7f79a806b1e0 2023-07-21T22:34:49.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.306+0000 7f79a57fa640 1 -- 172.21.15.6:0/3876141503 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f799c0039a0 con 0x7f79a806b1e0 2023-07-21T22:34:49.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.306+0000 7f79a57fa640 1 --2- 172.21.15.6:0/3876141503 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f798c0663d0 0x7f798c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:49.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.306+0000 7f79a57fa640 1 -- 172.21.15.6:0/3876141503 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6837+0+0 (secure 0 0 0) 0x7f799c083740 con 0x7f79a806b1e0 2023-07-21T22:34:49.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.306+0000 7f79a7fff640 1 --2- 172.21.15.6:0/3876141503 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f798c0663d0 0x7f798c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:49.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.306+0000 7f79a7fff640 1 --2- 172.21.15.6:0/3876141503 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f798c0663d0 0x7f798c068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f79940af000 tx=0x7f79940a7000 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:49.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.310+0000 7f79a57fa640 1 -- 172.21.15.6:0/3876141503 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f79a814f470 con 0x7f79a806b1e0 2023-07-21T22:34:49.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.502+0000 7f79af0d8640 1 -- 172.21.15.6:0/3876141503 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f79a814f470 con 0x7f79a806b1e0 2023-07-21T22:34:49.552 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-07-21T22:34:49.502+0000 7f195e836640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-21T22:34:49.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.510+0000 7f79a57fa640 1 -- 172.21.15.6:0/3876141503 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7f79a814f470 con 0x7f79a806b1e0 2023-07-21T22:34:49.561 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-21T22:34:49.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.510+0000 7f79af0d8640 1 -- 172.21.15.6:0/3876141503 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f798c0663d0 msgr2=0x7f798c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:49.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.510+0000 7f79af0d8640 1 --2- 172.21.15.6:0/3876141503 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f798c0663d0 0x7f798c068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f79940af000 tx=0x7f79940a7000 comp rx=0 tx=0).stop 2023-07-21T22:34:49.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.510+0000 7f79af0d8640 1 -- 172.21.15.6:0/3876141503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79a806b1e0 msgr2=0x7f79a8149c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:49.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.510+0000 7f79af0d8640 1 --2- 172.21.15.6:0/3876141503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79a806b1e0 0x7f79a8149c80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f799c00c430 tx=0x7f799c00c8f0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.514+0000 7f79af0d8640 1 -- 172.21.15.6:0/3876141503 shutdown_connections 2023-07-21T22:34:49.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.514+0000 7f79af0d8640 1 --2- 172.21.15.6:0/3876141503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79a80c21f0 0x7f79a81523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.514+0000 7f79af0d8640 1 --2- 172.21.15.6:0/3876141503 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f798c0663d0 0x7f798c068880 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.514+0000 7f79af0d8640 1 --2- 172.21.15.6:0/3876141503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79a8070b70 0x7f79a81500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.514+0000 7f79af0d8640 1 --2- 172.21.15.6:0/3876141503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79a806b1e0 0x7f79a8149c80 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.514+0000 7f79af0d8640 1 -- 172.21.15.6:0/3876141503 >> 172.21.15.6:0/3876141503 conn(0x7f79a80afcf0 msgr2=0x7f79a80ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:49.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.514+0000 7f79af0d8640 1 -- 172.21.15.6:0/3876141503 shutdown_connections 2023-07-21T22:34:49.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.514+0000 7f79af0d8640 1 -- 172.21.15.6:0/3876141503 wait complete. 2023-07-21T22:34:49.567 INFO:tasks.ceph.mds.c.smithi006.stderr: -3934> 2023-07-21T22:34:28.931+0000 7f6c26e2b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:34:49.583 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-21T22:34:49.618 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-21T22:34:49.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.682+0000 7f75067fa640 1 Processor -- start 2023-07-21T22:34:49.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.682+0000 7f75067fa640 1 -- start start 2023-07-21T22:34:49.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.682+0000 7f75067fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7500159a70 0x7f75000ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:49.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.682+0000 7f75067fa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f750015e060 0x7f7500070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:49.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.682+0000 7f75067fa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75000cbe50 con 0x7f7500070e60 2023-07-21T22:34:49.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.682+0000 7f75067fa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75000cd660 con 0x7f750015e060 2023-07-21T22:34:49.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.682+0000 7f75067fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75000cc0a0 con 0x7f7500159a70 2023-07-21T22:34:49.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.682+0000 7f7504d97640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7500070e60 0x7f75000c85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56552/0 (socket says 172.21.15.6:56552) 2023-07-21T22:34:49.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.682+0000 7f7504d97640 1 -- 172.21.15.6:0/465246627 learned_addr learned my addr 172.21.15.6:0/465246627 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:49.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.686+0000 7f74fffff640 1 --2- 172.21.15.6:0/465246627 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7500159a70 0x7f75000ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.686+0000 7f74ff7fe640 1 --2- 172.21.15.6:0/465246627 >> v2:172.21.15.161:3300/0 conn(0x7f750015e060 0x7f7500070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.686+0000 7f74feffd640 1 -- 172.21.15.6:0/465246627 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323203000 0 0) 0x7f75000cbe50 con 0x7f7500070e60 2023-07-21T22:34:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.686+0000 7f74feffd640 1 -- 172.21.15.6:0/465246627 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74e8003530 con 0x7f7500070e60 2023-07-21T22:34:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.686+0000 7f74fffff640 1 -- 172.21.15.6:0/465246627 >> v2:172.21.15.161:3300/0 conn(0x7f750015e060 msgr2=0x7f7500070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.686+0000 7f74fffff640 1 --2- 172.21.15.6:0/465246627 >> v2:172.21.15.161:3300/0 conn(0x7f750015e060 0x7f7500070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.686+0000 7f74feffd640 1 -- 172.21.15.6:0/465246627 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3749365996 0 0) 0x7f74e8003530 con 0x7f7500070e60 2023-07-21T22:34:49.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.686+0000 7f74fffff640 1 -- 172.21.15.6:0/465246627 >> v1:172.21.15.6:6789/0 conn(0x7f7500070e60 legacy=0x7f75000c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:49.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.686+0000 7f74fffff640 1 -- 172.21.15.6:0/465246627 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75000cc380 con 0x7f7500159a70 2023-07-21T22:34:49.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.686+0000 7f74fffff640 1 --2- 172.21.15.6:0/465246627 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7500159a70 0x7f75000ccff0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f74f00097c0 tx=0x7f74f001c250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95834915e65bc744 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:49.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.686+0000 7f74feffd640 1 -- 172.21.15.6:0/465246627 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f8001a00 con 0x7f7500159a70 2023-07-21T22:34:49.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.686+0000 7f74feffd640 1 -- 172.21.15.6:0/465246627 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f00a7050 con 0x7f7500159a70 2023-07-21T22:34:49.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.686+0000 7f74feffd640 1 -- 172.21.15.6:0/465246627 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f00ab620 con 0x7f7500159a70 2023-07-21T22:34:49.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.690+0000 7f75067fa640 1 -- 172.21.15.6:0/465246627 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7500159a70 msgr2=0x7f75000ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:49.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.690+0000 7f75067fa640 1 --2- 172.21.15.6:0/465246627 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7500159a70 0x7f75000ccff0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f74f00097c0 tx=0x7f74f001c250 comp rx=0 tx=0).stop 2023-07-21T22:34:49.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.690+0000 7f75067fa640 1 -- 172.21.15.6:0/465246627 shutdown_connections 2023-07-21T22:34:49.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.690+0000 7f75067fa640 1 --2- 172.21.15.6:0/465246627 >> v2:172.21.15.161:3300/0 conn(0x7f750015e060 0x7f7500070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.690+0000 7f75067fa640 1 --2- 172.21.15.6:0/465246627 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7500159a70 0x7f75000ccff0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.690+0000 7f75067fa640 1 -- 172.21.15.6:0/465246627 >> 172.21.15.6:0/465246627 conn(0x7f75000afac0 msgr2=0x7f75000afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:49.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.690+0000 7f75067fa640 1 -- 172.21.15.6:0/465246627 shutdown_connections 2023-07-21T22:34:49.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.690+0000 7f75067fa640 1 -- 172.21.15.6:0/465246627 wait complete. 2023-07-21T22:34:49.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.690+0000 7f75067fa640 1 Processor -- start 2023-07-21T22:34:49.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.690+0000 7f75067fa640 1 -- start start 2023-07-21T22:34:49.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.690+0000 7f75067fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7500070e60 0x7f750014a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:49.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.690+0000 7f75067fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7500159a70 0x7f75000c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:49.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.690+0000 7f75067fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f750015e060 0x7f75000b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:49.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.690+0000 7f75067fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75001f71e0 con 0x7f7500159a70 2023-07-21T22:34:49.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.690+0000 7f75067fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75001f7480 con 0x7f750015e060 2023-07-21T22:34:49.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.690+0000 7f75067fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75001f7760 con 0x7f7500070e60 2023-07-21T22:34:49.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.690+0000 7f74ff7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7500159a70 0x7f75000c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:49.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.690+0000 7f74ff7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7500159a70 0x7f75000c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45964/0 (socket says 172.21.15.6:45964) 2023-07-21T22:34:49.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.690+0000 7f74ff7fe640 1 -- 172.21.15.6:0/1442289238 learned_addr learned my addr 172.21.15.6:0/1442289238 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:49.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.694+0000 7f74fffff640 1 --2- 172.21.15.6:0/1442289238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7500070e60 0x7f750014a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:49.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.694+0000 7f7504d97640 1 --2- 172.21.15.6:0/1442289238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f750015e060 0x7f75000b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:49.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.694+0000 7f74ff7fe640 1 -- 172.21.15.6:0/1442289238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7500070e60 msgr2=0x7f750014a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:49.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.694+0000 7f74ff7fe640 1 --2- 172.21.15.6:0/1442289238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7500070e60 0x7f750014a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.694+0000 7f74ff7fe640 1 -- 172.21.15.6:0/1442289238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f750015e060 msgr2=0x7f75000b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:49.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.694+0000 7f74ff7fe640 1 --2- 172.21.15.6:0/1442289238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f750015e060 0x7f75000b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:49.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.694+0000 7f74ff7fe640 1 -- 172.21.15.6:0/1442289238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f0009420 con 0x7f7500159a70 2023-07-21T22:34:49.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.694+0000 7f7504d97640 1 --2- 172.21.15.6:0/1442289238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f750015e060 0x7f75000b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:49.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.694+0000 7f74ff7fe640 1 --2- 172.21.15.6:0/1442289238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7500159a70 0x7f75000c7880 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f74f400e870 tx=0x7f74f400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:49.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.694+0000 7f74fcff9640 1 -- 172.21.15.6:0/1442289238 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f4009510 con 0x7f7500159a70 2023-07-21T22:34:49.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.694+0000 7f74fcff9640 1 -- 172.21.15.6:0/1442289238 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f400eec0 con 0x7f7500159a70 2023-07-21T22:34:49.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.694+0000 7f74fcff9640 1 -- 172.21.15.6:0/1442289238 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f400cb40 con 0x7f7500159a70 2023-07-21T22:34:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.694+0000 7f75067fa640 1 -- 172.21.15.6:0/1442289238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75001f7a40 con 0x7f7500159a70 2023-07-21T22:34:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.694+0000 7f75067fa640 1 -- 172.21.15.6:0/1442289238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750014a720 con 0x7f7500159a70 2023-07-21T22:34:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.694+0000 7f75067fa640 1 -- 172.21.15.6:0/1442289238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75000678d0 con 0x7f7500159a70 2023-07-21T22:34:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.694+0000 7f74fcff9640 1 -- 172.21.15.6:0/1442289238 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f74f400cca0 con 0x7f7500159a70 2023-07-21T22:34:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.698+0000 7f74fcff9640 1 --2- 172.21.15.6:0/1442289238 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f74ec0663a0 0x7f74ec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.698+0000 7f74fcff9640 1 -- 172.21.15.6:0/1442289238 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6923+0+0 (secure 0 0 0) 0x7f74f4084230 con 0x7f7500159a70 2023-07-21T22:34:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.698+0000 7f74fffff640 1 --2- 172.21.15.6:0/1442289238 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f74ec0663a0 0x7f74ec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.698+0000 7f74fffff640 1 --2- 172.21.15.6:0/1442289238 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f74ec0663a0 0x7f74ec068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f74f00ad000 tx=0x7f74f00a6000 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:49.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.698+0000 7f74fcff9640 1 -- 172.21.15.6:0/1442289238 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74f40512e0 con 0x7f7500159a70 2023-07-21T22:34:49.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:49.886+0000 7f75067fa640 1 -- 172.21.15.6:0/1442289238 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f75000adbb0 con 0x7f7500159a70 2023-07-21T22:34:50.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.510+0000 7f74fcff9640 1 -- 172.21.15.6:0/1442289238 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7f74f4054900 con 0x7f7500159a70 2023-07-21T22:34:50.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.510+0000 7f75067fa640 1 -- 172.21.15.6:0/1442289238 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f74ec0663a0 msgr2=0x7f74ec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.510+0000 7f75067fa640 1 --2- 172.21.15.6:0/1442289238 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f74ec0663a0 0x7f74ec068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f74f00ad000 tx=0x7f74f00a6000 comp rx=0 tx=0).stop 2023-07-21T22:34:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.510+0000 7f75067fa640 1 -- 172.21.15.6:0/1442289238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7500159a70 msgr2=0x7f75000c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.510+0000 7f75067fa640 1 --2- 172.21.15.6:0/1442289238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7500159a70 0x7f75000c7880 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f74f400e870 tx=0x7f74f400ec70 comp rx=0 tx=0).stop 2023-07-21T22:34:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.510+0000 7f75067fa640 1 -- 172.21.15.6:0/1442289238 shutdown_connections 2023-07-21T22:34:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.510+0000 7f75067fa640 1 --2- 172.21.15.6:0/1442289238 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f750015e060 0x7f75000b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.510+0000 7f75067fa640 1 --2- 172.21.15.6:0/1442289238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7500159a70 0x7f75000c7880 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:50.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.510+0000 7f75067fa640 1 --2- 172.21.15.6:0/1442289238 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f74ec0663a0 0x7f74ec068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:50.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.510+0000 7f75067fa640 1 --2- 172.21.15.6:0/1442289238 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7500070e60 0x7f750014a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:50.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.510+0000 7f75067fa640 1 -- 172.21.15.6:0/1442289238 >> 172.21.15.6:0/1442289238 conn(0x7f75000afac0 msgr2=0x7f7500158cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:50.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.510+0000 7f75067fa640 1 -- 172.21.15.6:0/1442289238 shutdown_connections 2023-07-21T22:34:50.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.510+0000 7f75067fa640 1 -- 172.21.15.6:0/1442289238 wait complete. 2023-07-21T22:34:50.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-21T22:34:50.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.730+0000 7f7584b40640 1 Processor -- start 2023-07-21T22:34:51.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.730+0000 7f7584b40640 1 -- start start 2023-07-21T22:34:51.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.730+0000 7f7584b40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75800aeb40 0x7f758015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:51.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.730+0000 7f7584b40640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7580159440 0x7f75800c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:51.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.730+0000 7f7584b40640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75801532b0 con 0x7f75800aef10 2023-07-21T22:34:51.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.730+0000 7f7584b40640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75800ca6f0 con 0x7f7580159440 2023-07-21T22:34:51.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.730+0000 7f7584b40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75801599d0 con 0x7f75800aeb40 2023-07-21T22:34:51.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f7577fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f75800aef10 0x7f7580158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56568/0 (socket says 172.21.15.6:56568) 2023-07-21T22:34:51.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f7577fff640 1 -- 172.21.15.6:0/2409028948 learned_addr learned my addr 172.21.15.6:0/2409028948 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:51.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757ed9d640 1 --2- 172.21.15.6:0/2409028948 >> v2:172.21.15.161:3300/0 conn(0x7f7580159440 0x7f75800c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:51.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757e59c640 1 --2- 172.21.15.6:0/2409028948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75800aeb40 0x7f758015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:51.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757dd9b640 1 -- 172.21.15.6:0/2409028948 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342733041 0 0) 0x7f75801532b0 con 0x7f75800aef10 2023-07-21T22:34:51.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757dd9b640 1 -- 172.21.15.6:0/2409028948 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f756c003530 con 0x7f75800aef10 2023-07-21T22:34:51.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757dd9b640 1 -- 172.21.15.6:0/2409028948 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1206331411 0 0) 0x7f756c003530 con 0x7f75800aef10 2023-07-21T22:34:51.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757dd9b640 1 -- 172.21.15.6:0/2409028948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75800aeb40 msgr2=0x7f758015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:51.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757dd9b640 1 --2- 172.21.15.6:0/2409028948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75800aeb40 0x7f758015cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:51.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757dd9b640 1 -- 172.21.15.6:0/2409028948 >> v2:172.21.15.161:3300/0 conn(0x7f7580159440 msgr2=0x7f75800c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:51.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757dd9b640 1 --2- 172.21.15.6:0/2409028948 >> v2:172.21.15.161:3300/0 conn(0x7f7580159440 0x7f75800c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:51.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757dd9b640 1 -- 172.21.15.6:0/2409028948 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7580159cb0 con 0x7f75800aef10 2023-07-21T22:34:51.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757dd9b640 1 -- 172.21.15.6:0/2409028948 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f7568001680 con 0x7f75800aef10 2023-07-21T22:34:51.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757dd9b640 1 -- 172.21.15.6:0/2409028948 >> v1:172.21.15.6:6789/0 conn(0x7f75800aef10 legacy=0x7f7580158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:51.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757dd9b640 1 --2- 172.21.15.6:0/2409028948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f756c003980 0x7f756c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:51.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757dd9b640 1 --2- 172.21.15.6:0/2409028948 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f756c004360 0x7f756c004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:51.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757dd9b640 1 --2- 172.21.15.6:0/2409028948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f756c004f40 0x7f756c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:51.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757dd9b640 1 -- 172.21.15.6:0/2409028948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75800ca6f0 con 0x7f756c004f40 2023-07-21T22:34:51.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757dd9b640 1 -- 172.21.15.6:0/2409028948 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75801599d0 con 0x7f756c004360 2023-07-21T22:34:51.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757dd9b640 1 -- 172.21.15.6:0/2409028948 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756c00bed0 con 0x7f756c003980 2023-07-21T22:34:51.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757ed9d640 1 --2- 172.21.15.6:0/2409028948 >> v2:172.21.15.161:3300/0 conn(0x7f7580159440 0x7f75800c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:51.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757e59c640 1 --2- 172.21.15.6:0/2409028948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f756c003980 0x7f756c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:51.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757ed9d640 1 --2- 172.21.15.6:0/2409028948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f756c004f40 0x7f756c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:51.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f7577fff640 1 --2- 172.21.15.6:0/2409028948 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f756c004360 0x7f756c004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:51.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757ed9d640 1 -- 172.21.15.6:0/2409028948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f756c003980 msgr2=0x7f756c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:51.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757ed9d640 1 --2- 172.21.15.6:0/2409028948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f756c003980 0x7f756c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:51.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757ed9d640 1 -- 172.21.15.6:0/2409028948 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f756c004360 msgr2=0x7f756c004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:51.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757ed9d640 1 --2- 172.21.15.6:0/2409028948 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f756c004360 0x7f756c004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:51.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.734+0000 7f757ed9d640 1 -- 172.21.15.6:0/2409028948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c003530 con 0x7f756c004f40 2023-07-21T22:34:51.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.738+0000 7f757ed9d640 1 --2- 172.21.15.6:0/2409028948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f756c004f40 0x7f756c00b990 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f757800e380 tx=0x7f757801ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba10aa25cfe56d08 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:51.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.738+0000 7f757dd9b640 1 -- 172.21.15.6:0/2409028948 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75780a5e30 con 0x7f756c004f40 2023-07-21T22:34:51.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.738+0000 7f757dd9b640 1 -- 172.21.15.6:0/2409028948 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757800f040 con 0x7f756c004f40 2023-07-21T22:34:51.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.738+0000 7f757dd9b640 1 -- 172.21.15.6:0/2409028948 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7578003ba0 con 0x7f756c004f40 2023-07-21T22:34:51.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.738+0000 7f7584b40640 1 -- 172.21.15.6:0/2409028948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f756c004f40 msgr2=0x7f756c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:51.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.738+0000 7f7584b40640 1 --2- 172.21.15.6:0/2409028948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f756c004f40 0x7f756c00b990 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f757800e380 tx=0x7f757801ce20 comp rx=0 tx=0).stop 2023-07-21T22:34:51.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.738+0000 7f757ed9d640 1 -- 172.21.15.6:0/2409028948 reap_dead start 2023-07-21T22:34:51.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.738+0000 7f7584b40640 1 -- 172.21.15.6:0/2409028948 shutdown_connections 2023-07-21T22:34:51.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.738+0000 7f7584b40640 1 -- 172.21.15.6:0/2409028948 >> 172.21.15.6:0/2409028948 conn(0x7f75800cde90 msgr2=0x7f75800ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:51.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.738+0000 7f7584b40640 1 -- 172.21.15.6:0/2409028948 shutdown_connections 2023-07-21T22:34:51.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.738+0000 7f7584b40640 1 -- 172.21.15.6:0/2409028948 wait complete. 2023-07-21T22:34:51.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.738+0000 7f7584b40640 1 Processor -- start 2023-07-21T22:34:51.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.738+0000 7f7584b40640 1 -- start start 2023-07-21T22:34:51.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7584b40640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f756c004f40 0x7f7580159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:51.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7584b40640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7580143890 0x7f7580157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:51.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7584b40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75800cce20 0x7f758013f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:51.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7584b40640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75801569a0 con 0x7f7580143890 2023-07-21T22:34:51.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7584b40640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758015a9c0 con 0x7f756c004f40 2023-07-21T22:34:51.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7584b40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758015a410 con 0x7f75800cce20 2023-07-21T22:34:51.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7577fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7580143890 0x7f7580157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:51.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7577fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7580143890 0x7f7580157660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45990/0 (socket says 172.21.15.6:45990) 2023-07-21T22:34:51.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7577fff640 1 -- 172.21.15.6:0/255643760 learned_addr learned my addr 172.21.15.6:0/255643760 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:51.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f757e59c640 1 --2- 172.21.15.6:0/255643760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f756c004f40 0x7f7580159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:51.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f757ed9d640 1 --2- 172.21.15.6:0/255643760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75800cce20 0x7f758013f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:51.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7577fff640 1 -- 172.21.15.6:0/255643760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75800cce20 msgr2=0x7f758013f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:51.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7577fff640 1 --2- 172.21.15.6:0/255643760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75800cce20 0x7f758013f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:51.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7577fff640 1 -- 172.21.15.6:0/255643760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f756c004f40 msgr2=0x7f7580159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:51.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7577fff640 1 --2- 172.21.15.6:0/255643760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f756c004f40 0x7f7580159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:51.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7577fff640 1 -- 172.21.15.6:0/255643760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758015a6e0 con 0x7f7580143890 2023-07-21T22:34:51.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f757ed9d640 1 --2- 172.21.15.6:0/255643760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75800cce20 0x7f758013f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:51.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7577fff640 1 --2- 172.21.15.6:0/255643760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7580143890 0x7f7580157660 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f7568012520 tx=0x7f75680129e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:51.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7576ffd640 1 -- 172.21.15.6:0/255643760 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7568014810 con 0x7f7580143890 2023-07-21T22:34:51.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7576ffd640 1 -- 172.21.15.6:0/255643760 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7568014990 con 0x7f7580143890 2023-07-21T22:34:51.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7576ffd640 1 -- 172.21.15.6:0/255643760 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7568014d40 con 0x7f7580143890 2023-07-21T22:34:51.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7584b40640 1 -- 172.21.15.6:0/255643760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7580156b80 con 0x7f7580143890 2023-07-21T22:34:51.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7584b40640 1 -- 172.21.15.6:0/255643760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7580157140 con 0x7f7580143890 2023-07-21T22:34:51.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7584b40640 1 -- 172.21.15.6:0/255643760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75800678d0 con 0x7f7580143890 2023-07-21T22:34:51.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.742+0000 7f7576ffd640 1 -- 172.21.15.6:0/255643760 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7568016480 con 0x7f7580143890 2023-07-21T22:34:51.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.746+0000 7f7576ffd640 1 --2- 172.21.15.6:0/255643760 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f75600663d0 0x7f7560068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:51.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.746+0000 7f7576ffd640 1 -- 172.21.15.6:0/255643760 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6923+0+0 (secure 0 0 0) 0x7f75680876f0 con 0x7f7580143890 2023-07-21T22:34:51.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.746+0000 7f757e59c640 1 --2- 172.21.15.6:0/255643760 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f75600663d0 0x7f7560068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:51.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.746+0000 7f757e59c640 1 --2- 172.21.15.6:0/255643760 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f75600663d0 0x7f7560068880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7580071ad0 tx=0x7f7570008040 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:51.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.750+0000 7f7576ffd640 1 -- 172.21.15.6:0/255643760 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7568054670 con 0x7f7580143890 2023-07-21T22:34:51.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:50.902+0000 7f7584b40640 1 -- 172.21.15.6:0/255643760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f75800c2ee0 con 0x7f7580143890 2023-07-21T22:34:51.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.638+0000 7f7576ffd640 1 -- 172.21.15.6:0/255643760 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v88) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7568057c90 con 0x7f7580143890 2023-07-21T22:34:51.689 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-07-21T22:34:51.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.642+0000 7f7584b40640 1 -- 172.21.15.6:0/255643760 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f75600663d0 msgr2=0x7f7560068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:51.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.642+0000 7f7584b40640 1 --2- 172.21.15.6:0/255643760 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f75600663d0 0x7f7560068880 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7580071ad0 tx=0x7f7570008040 comp rx=0 tx=0).stop 2023-07-21T22:34:51.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.642+0000 7f7584b40640 1 -- 172.21.15.6:0/255643760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7580143890 msgr2=0x7f7580157660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:51.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.642+0000 7f7584b40640 1 --2- 172.21.15.6:0/255643760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7580143890 0x7f7580157660 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f7568012520 tx=0x7f75680129e0 comp rx=0 tx=0).stop 2023-07-21T22:34:51.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.642+0000 7f7584b40640 1 -- 172.21.15.6:0/255643760 shutdown_connections 2023-07-21T22:34:51.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.642+0000 7f7584b40640 1 --2- 172.21.15.6:0/255643760 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f75600663d0 0x7f7560068880 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:51.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.642+0000 7f7584b40640 1 --2- 172.21.15.6:0/255643760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75800cce20 0x7f758013f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:51.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.642+0000 7f7584b40640 1 --2- 172.21.15.6:0/255643760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7580143890 0x7f7580157660 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:51.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.642+0000 7f7584b40640 1 --2- 172.21.15.6:0/255643760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f756c004f40 0x7f7580159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:51.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.642+0000 7f7584b40640 1 -- 172.21.15.6:0/255643760 >> 172.21.15.6:0/255643760 conn(0x7f75800cde90 msgr2=0x7f75800c8880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:51.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.642+0000 7f7584b40640 1 -- 172.21.15.6:0/255643760 shutdown_connections 2023-07-21T22:34:51.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.642+0000 7f7584b40640 1 -- 172.21.15.6:0/255643760 wait complete. 2023-07-21T22:34:51.717 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-21T22:34:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.818+0000 7efc0e5d2640 1 Processor -- start 2023-07-21T22:34:51.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.818+0000 7efc0e5d2640 1 -- start start 2023-07-21T22:34:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.818+0000 7efc0e5d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc08069430 0x7efc08069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.818+0000 7efc0e5d2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc08159d70 con 0x7efc08070f30 2023-07-21T22:34:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.818+0000 7efc0e5d2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc08069d40 con 0x7efc080af2b0 2023-07-21T22:34:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.818+0000 7efc0e5d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc080c9c60 con 0x7efc08069430 2023-07-21T22:34:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.822+0000 7efc077fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efc08070f30 0x7efc080ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56580/0 (socket says 172.21.15.6:56580) 2023-07-21T22:34:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.822+0000 7efc077fe640 1 -- 172.21.15.6:0/4216238198 learned_addr learned my addr 172.21.15.6:0/4216238198 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.822+0000 7efc07fff640 1 --2- 172.21.15.6:0/4216238198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc08069430 0x7efc08069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.822+0000 7efc06ffd640 1 -- 172.21.15.6:0/4216238198 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974020932 0 0) 0x7efbfc001120 con 0x7efc08070f30 2023-07-21T22:34:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.822+0000 7efc06ffd640 1 -- 172.21.15.6:0/4216238198 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbf0003530 con 0x7efc08070f30 2023-07-21T22:34:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.822+0000 7efc06ffd640 1 -- 172.21.15.6:0/4216238198 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2432427174 0 0) 0x7efc08069d40 con 0x7efc080af2b0 2023-07-21T22:34:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.822+0000 7efc06ffd640 1 -- 172.21.15.6:0/4216238198 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbfc001120 con 0x7efc080af2b0 2023-07-21T22:34:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.822+0000 7efc07fff640 1 -- 172.21.15.6:0/4216238198 >> v1:172.21.15.161:6789/0 conn(0x7efc080af2b0 legacy=0x7efc0815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.822+0000 7efc07fff640 1 -- 172.21.15.6:0/4216238198 >> v1:172.21.15.6:6789/0 conn(0x7efc08070f30 legacy=0x7efc080ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.822+0000 7efc07fff640 1 -- 172.21.15.6:0/4216238198 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc080c9f40 con 0x7efc08069430 2023-07-21T22:34:51.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.822+0000 7efc07fff640 1 --2- 172.21.15.6:0/4216238198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc08069430 0x7efc08069800 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efbf80097f0 tx=0x7efbf801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d497099ebdab064 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:51.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.826+0000 7efc06ffd640 1 -- 172.21.15.6:0/4216238198 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf80ac630 con 0x7efc08069430 2023-07-21T22:34:51.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.826+0000 7efc06ffd640 1 -- 172.21.15.6:0/4216238198 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf80ac790 con 0x7efc08069430 2023-07-21T22:34:51.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.826+0000 7efc06ffd640 1 -- 172.21.15.6:0/4216238198 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf80acb20 con 0x7efc08069430 2023-07-21T22:34:51.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.826+0000 7efc0e5d2640 1 -- 172.21.15.6:0/4216238198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc08069430 msgr2=0x7efc08069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:51.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.826+0000 7efc0e5d2640 1 --2- 172.21.15.6:0/4216238198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc08069430 0x7efc08069800 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efbf80097f0 tx=0x7efbf801c4c0 comp rx=0 tx=0).stop 2023-07-21T22:34:51.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.826+0000 7efc0e5d2640 1 -- 172.21.15.6:0/4216238198 shutdown_connections 2023-07-21T22:34:51.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.826+0000 7efc0e5d2640 1 --2- 172.21.15.6:0/4216238198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc08069430 0x7efc08069800 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:51.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.826+0000 7efc0e5d2640 1 -- 172.21.15.6:0/4216238198 >> 172.21.15.6:0/4216238198 conn(0x7efc080cde90 msgr2=0x7efc080ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:51.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.826+0000 7efc0e5d2640 1 -- 172.21.15.6:0/4216238198 shutdown_connections 2023-07-21T22:34:51.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.826+0000 7efc0e5d2640 1 -- 172.21.15.6:0/4216238198 wait complete. 2023-07-21T22:34:51.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.826+0000 7efc0e5d2640 1 Processor -- start 2023-07-21T22:34:51.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.826+0000 7efc0e5d2640 1 -- start start 2023-07-21T22:34:51.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.826+0000 7efc0e5d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc08069430 0x7efc08147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:51.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.826+0000 7efc0e5d2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc08070f30 0x7efc08148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:51.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.826+0000 7efc0e5d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc080af2b0 0x7efc080c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:51.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc0e5d2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc08152040 con 0x7efc080af2b0 2023-07-21T22:34:51.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc0e5d2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc081517a0 con 0x7efc08070f30 2023-07-21T22:34:51.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc0e5d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc08151a80 con 0x7efc08069430 2023-07-21T22:34:51.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc0cb6f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc080af2b0 0x7efc080c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:51.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc0cb6f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc080af2b0 0x7efc080c3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46002/0 (socket says 172.21.15.6:46002) 2023-07-21T22:34:51.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc0cb6f640 1 -- 172.21.15.6:0/1587286242 learned_addr learned my addr 172.21.15.6:0/1587286242 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:51.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc07fff640 1 --2- 172.21.15.6:0/1587286242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc08069430 0x7efc08147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:51.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc077fe640 1 --2- 172.21.15.6:0/1587286242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc08070f30 0x7efc08148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:51.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc0cb6f640 1 -- 172.21.15.6:0/1587286242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc08069430 msgr2=0x7efc08147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:51.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc0cb6f640 1 --2- 172.21.15.6:0/1587286242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc08069430 0x7efc08147a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:51.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc0cb6f640 1 -- 172.21.15.6:0/1587286242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc08070f30 msgr2=0x7efc08148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:51.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc0cb6f640 1 --2- 172.21.15.6:0/1587286242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc08070f30 0x7efc08148270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:51.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc0cb6f640 1 -- 172.21.15.6:0/1587286242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf8009420 con 0x7efc080af2b0 2023-07-21T22:34:51.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc0cb6f640 1 --2- 172.21.15.6:0/1587286242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc080af2b0 0x7efc080c3360 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7efc0000c790 tx=0x7efc0000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:51.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc04ff9640 1 -- 172.21.15.6:0/1587286242 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0000cea0 con 0x7efc080af2b0 2023-07-21T22:34:51.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc04ff9640 1 -- 172.21.15.6:0/1587286242 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc00003b80 con 0x7efc080af2b0 2023-07-21T22:34:51.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc04ff9640 1 -- 172.21.15.6:0/1587286242 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0000a850 con 0x7efc080af2b0 2023-07-21T22:34:51.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc0e5d2640 1 -- 172.21.15.6:0/1587286242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc08151d60 con 0x7efc080af2b0 2023-07-21T22:34:51.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc0e5d2640 1 -- 172.21.15.6:0/1587286242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc08151430 con 0x7efc080af2b0 2023-07-21T22:34:51.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc0e5d2640 1 -- 172.21.15.6:0/1587286242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0806d100 con 0x7efc080af2b0 2023-07-21T22:34:51.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.830+0000 7efc04ff9640 1 -- 172.21.15.6:0/1587286242 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efc0000a9b0 con 0x7efc080af2b0 2023-07-21T22:34:51.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.834+0000 7efc04ff9640 1 --2- 172.21.15.6:0/1587286242 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7efbf40663a0 0x7efbf4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:51.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.834+0000 7efc04ff9640 1 -- 172.21.15.6:0/1587286242 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6485+0+0 (secure 0 0 0) 0x7efc00083f30 con 0x7efc080af2b0 2023-07-21T22:34:51.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.834+0000 7efc07fff640 1 --2- 172.21.15.6:0/1587286242 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7efbf40663a0 0x7efbf4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:51.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.834+0000 7efc07fff640 1 --2- 172.21.15.6:0/1587286242 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7efbf40663a0 0x7efbf4068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efbf80ae000 tx=0x7efbf80a7000 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:51.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.838+0000 7efc04ff9640 1 -- 172.21.15.6:0/1587286242 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efc000510f0 con 0x7efc080af2b0 2023-07-21T22:34:52.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:51.990+0000 7efc0e5d2640 1 -- 172.21.15.6:0/1587286242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efc080678d0 con 0x7efc080af2b0 2023-07-21T22:34:52.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.654+0000 7efc04ff9640 1 -- 172.21.15.6:0/1587286242 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v89) v1 ==== 169+0+0 (secure 0 0 0) 0x7efc00054710 con 0x7efc080af2b0 2023-07-21T22:34:52.707 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-07-21T22:34:52.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.658+0000 7efc0e5d2640 1 -- 172.21.15.6:0/1587286242 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7efbf40663a0 msgr2=0x7efbf4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:52.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.658+0000 7efc0e5d2640 1 --2- 172.21.15.6:0/1587286242 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7efbf40663a0 0x7efbf4068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efbf80ae000 tx=0x7efbf80a7000 comp rx=0 tx=0).stop 2023-07-21T22:34:52.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.658+0000 7efc0e5d2640 1 -- 172.21.15.6:0/1587286242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc080af2b0 msgr2=0x7efc080c3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:52.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.658+0000 7efc0e5d2640 1 --2- 172.21.15.6:0/1587286242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc080af2b0 0x7efc080c3360 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7efc0000c790 tx=0x7efc0000cc50 comp rx=0 tx=0).stop 2023-07-21T22:34:52.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.658+0000 7efc0e5d2640 1 -- 172.21.15.6:0/1587286242 shutdown_connections 2023-07-21T22:34:52.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.658+0000 7efc0e5d2640 1 --2- 172.21.15.6:0/1587286242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc080af2b0 0x7efc080c3360 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:52.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.658+0000 7efc0e5d2640 1 --2- 172.21.15.6:0/1587286242 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc08070f30 0x7efc08148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:52.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.658+0000 7efc0e5d2640 1 --2- 172.21.15.6:0/1587286242 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7efbf40663a0 0x7efbf4068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:52.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.658+0000 7efc0e5d2640 1 --2- 172.21.15.6:0/1587286242 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc08069430 0x7efc08147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:52.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.658+0000 7efc0e5d2640 1 -- 172.21.15.6:0/1587286242 >> 172.21.15.6:0/1587286242 conn(0x7efc080cde90 msgr2=0x7efc0814ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:52.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.658+0000 7efc0e5d2640 1 -- 172.21.15.6:0/1587286242 shutdown_connections 2023-07-21T22:34:52.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.658+0000 7efc0e5d2640 1 -- 172.21.15.6:0/1587286242 wait complete. 2023-07-21T22:34:52.734 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-21T22:34:52.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.834+0000 7effa8174640 1 Processor -- start 2023-07-21T22:34:52.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.834+0000 7effa8174640 1 -- start start 2023-07-21T22:34:52.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.834+0000 7effa8174640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7effa00d06b0 0x7effa00b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:52.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.834+0000 7effa8174640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effa00b1f70 0x7effa00d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:52.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.834+0000 7effa8174640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa00b2410 con 0x7effa0145430 2023-07-21T22:34:52.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.834+0000 7effa8174640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa00b26f0 con 0x7effa00d06b0 2023-07-21T22:34:52.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.834+0000 7effa8174640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa00b29d0 con 0x7effa00b1f70 2023-07-21T22:34:52.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.834+0000 7effa5f10640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7effa00d06b0 0x7effa00b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:52.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.834+0000 7effa5f10640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7effa00d06b0 0x7effa00b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46008/0 (socket says 172.21.15.6:46008) 2023-07-21T22:34:52.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.834+0000 7effa5f10640 1 -- 172.21.15.6:0/2930522948 learned_addr learned my addr 172.21.15.6:0/2930522948 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:52.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.834+0000 7effa6711640 1 --2- 172.21.15.6:0/2930522948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effa00b1f70 0x7effa00d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:52.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.834+0000 7effa5f10640 1 -- 172.21.15.6:0/2930522948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effa00b1f70 msgr2=0x7effa00d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:52.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.834+0000 7effa5f10640 1 --2- 172.21.15.6:0/2930522948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effa00b1f70 0x7effa00d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:52.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.834+0000 7effa5f10640 1 -- 172.21.15.6:0/2930522948 >> v1:172.21.15.161:6789/0 conn(0x7effa0145430 legacy=0x7effa00b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:52.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.834+0000 7effa5f10640 1 -- 172.21.15.6:0/2930522948 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa00b2cb0 con 0x7effa00d06b0 2023-07-21T22:34:52.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.842+0000 7effa5f10640 1 --2- 172.21.15.6:0/2930522948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa00d06b0 0x7effa00b1a30 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009870 tx=0x7eff9c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a212e08b025ebc9e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:52.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.842+0000 7effa4f0e640 1 -- 172.21.15.6:0/2930522948 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c0ab620 con 0x7effa00d06b0 2023-07-21T22:34:52.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.842+0000 7effa4f0e640 1 -- 172.21.15.6:0/2930522948 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c0ab780 con 0x7effa00d06b0 2023-07-21T22:34:52.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.842+0000 7effa4f0e640 1 -- 172.21.15.6:0/2930522948 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c0abb10 con 0x7effa00d06b0 2023-07-21T22:34:52.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.846+0000 7effa8174640 1 -- 172.21.15.6:0/2930522948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa00d06b0 msgr2=0x7effa00b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:52.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.846+0000 7effa8174640 1 --2- 172.21.15.6:0/2930522948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa00d06b0 0x7effa00b1a30 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009870 tx=0x7eff9c01c510 comp rx=0 tx=0).stop 2023-07-21T22:34:52.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.846+0000 7effa8174640 1 -- 172.21.15.6:0/2930522948 shutdown_connections 2023-07-21T22:34:52.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.846+0000 7effa8174640 1 --2- 172.21.15.6:0/2930522948 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effa00b1f70 0x7effa00d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:52.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.846+0000 7effa8174640 1 --2- 172.21.15.6:0/2930522948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa00d06b0 0x7effa00b1a30 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:52.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.846+0000 7effa8174640 1 -- 172.21.15.6:0/2930522948 >> 172.21.15.6:0/2930522948 conn(0x7effa00659d0 msgr2=0x7effa009b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:52.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.850+0000 7effa8174640 1 -- 172.21.15.6:0/2930522948 shutdown_connections 2023-07-21T22:34:52.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.850+0000 7effa8174640 1 -- 172.21.15.6:0/2930522948 wait complete. 2023-07-21T22:34:52.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.854+0000 7effa8174640 1 Processor -- start 2023-07-21T22:34:52.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.854+0000 7effa8174640 1 -- start start 2023-07-21T22:34:52.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.854+0000 7effa8174640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa00b1f70 0x7effa015a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:52.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.854+0000 7effa5f10640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa00b1f70 0x7effa015a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:52.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.854+0000 7effa5f10640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa00b1f70 0x7effa015a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46018/0 (socket says 172.21.15.6:46018) 2023-07-21T22:34:52.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.854+0000 7effa5f10640 1 -- 172.21.15.6:0/25383394 learned_addr learned my addr 172.21.15.6:0/25383394 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:52.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.854+0000 7effa8174640 1 --2- 172.21.15.6:0/25383394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effa00d06b0 0x7effa01591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:52.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.854+0000 7effa8174640 1 --2- 172.21.15.6:0/25383394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effa01599e0 0x7effa00c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:52.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.854+0000 7effa8174640 1 -- 172.21.15.6:0/25383394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa015b0e0 con 0x7effa00b1f70 2023-07-21T22:34:52.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.854+0000 7effa8174640 1 -- 172.21.15.6:0/25383394 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa015b3c0 con 0x7effa00d06b0 2023-07-21T22:34:52.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.854+0000 7effa8174640 1 -- 172.21.15.6:0/25383394 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa015b6a0 con 0x7effa01599e0 2023-07-21T22:34:52.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.854+0000 7effa570f640 1 --2- 172.21.15.6:0/25383394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effa00d06b0 0x7effa01591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:52.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.854+0000 7effa6711640 1 --2- 172.21.15.6:0/25383394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effa01599e0 0x7effa00c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:52.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.854+0000 7effa570f640 1 -- 172.21.15.6:0/25383394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effa01599e0 msgr2=0x7effa00c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:52.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.854+0000 7effa570f640 1 --2- 172.21.15.6:0/25383394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effa01599e0 0x7effa00c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:52.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.858+0000 7effa570f640 1 -- 172.21.15.6:0/25383394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa00b1f70 msgr2=0x7effa015a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:52.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.858+0000 7effa570f640 1 --2- 172.21.15.6:0/25383394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa00b1f70 0x7effa015a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:52.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.858+0000 7effa570f640 1 -- 172.21.15.6:0/25383394 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c0094d0 con 0x7effa00d06b0 2023-07-21T22:34:52.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.858+0000 7effa570f640 1 --2- 172.21.15.6:0/25383394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effa00d06b0 0x7effa01591b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7eff9000c3c0 tx=0x7eff9000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:52.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.858+0000 7eff967fc640 1 -- 172.21.15.6:0/25383394 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90016070 con 0x7effa00d06b0 2023-07-21T22:34:52.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.858+0000 7eff967fc640 1 -- 172.21.15.6:0/25383394 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff90007020 con 0x7effa00d06b0 2023-07-21T22:34:52.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.858+0000 7eff967fc640 1 -- 172.21.15.6:0/25383394 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff900073d0 con 0x7effa00d06b0 2023-07-21T22:34:52.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.858+0000 7effa8174640 1 -- 172.21.15.6:0/25383394 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa015b980 con 0x7effa00d06b0 2023-07-21T22:34:52.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.858+0000 7effa8174640 1 -- 172.21.15.6:0/25383394 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa015ae00 con 0x7effa00d06b0 2023-07-21T22:34:52.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.858+0000 7effa8174640 1 -- 172.21.15.6:0/25383394 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa0072e70 con 0x7effa00d06b0 2023-07-21T22:34:52.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.858+0000 7eff967fc640 1 -- 172.21.15.6:0/25383394 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7eff90007530 con 0x7effa00d06b0 2023-07-21T22:34:52.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.862+0000 7eff967fc640 1 --2- 172.21.15.6:0/25383394 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7eff840663a0 0x7eff84068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:52.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.862+0000 7eff967fc640 1 -- 172.21.15.6:0/25383394 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6071+0+0 (secure 0 0 0) 0x7eff900831c0 con 0x7effa00d06b0 2023-07-21T22:34:52.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.862+0000 7effa5f10640 1 --2- 172.21.15.6:0/25383394 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7eff840663a0 0x7eff84068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:52.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.862+0000 7effa5f10640 1 --2- 172.21.15.6:0/25383394 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7eff840663a0 0x7eff84068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7eff9c01c550 tx=0x7eff9c0b6040 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:52.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:52.866+0000 7eff967fc640 1 -- 172.21.15.6:0/25383394 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7eff900504a0 con 0x7effa00d06b0 2023-07-21T22:34:53.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.022+0000 7effa8174640 1 -- 172.21.15.6:0/25383394 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7effa015bea0 con 0x7effa00d06b0 2023-07-21T22:34:53.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.026+0000 7eff967fc640 1 -- 172.21.15.6:0/25383394 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v25) v1 ==== 115+0+0 (secure 0 0 0) 0x7effa015bea0 con 0x7effa00d06b0 2023-07-21T22:34:53.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.030+0000 7effa8174640 1 -- 172.21.15.6:0/25383394 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7eff840663a0 msgr2=0x7eff84068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.030+0000 7effa8174640 1 --2- 172.21.15.6:0/25383394 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7eff840663a0 0x7eff84068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7eff9c01c550 tx=0x7eff9c0b6040 comp rx=0 tx=0).stop 2023-07-21T22:34:53.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.030+0000 7effa8174640 1 -- 172.21.15.6:0/25383394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effa00d06b0 msgr2=0x7effa01591b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.030+0000 7effa8174640 1 --2- 172.21.15.6:0/25383394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effa00d06b0 0x7effa01591b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7eff9000c3c0 tx=0x7eff9000c880 comp rx=0 tx=0).stop 2023-07-21T22:34:53.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.030+0000 7effa8174640 1 -- 172.21.15.6:0/25383394 shutdown_connections 2023-07-21T22:34:53.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.030+0000 7effa8174640 1 --2- 172.21.15.6:0/25383394 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7eff840663a0 0x7eff84068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.030+0000 7effa8174640 1 --2- 172.21.15.6:0/25383394 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7effa01599e0 0x7effa00c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.030+0000 7effa8174640 1 --2- 172.21.15.6:0/25383394 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effa00d06b0 0x7effa01591b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.030+0000 7effa8174640 1 --2- 172.21.15.6:0/25383394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa00b1f70 0x7effa015a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.030+0000 7effa8174640 1 -- 172.21.15.6:0/25383394 >> 172.21.15.6:0/25383394 conn(0x7effa00659d0 msgr2=0x7effa015fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:53.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.030+0000 7effa8174640 1 -- 172.21.15.6:0/25383394 shutdown_connections 2023-07-21T22:34:53.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.030+0000 7effa8174640 1 -- 172.21.15.6:0/25383394 wait complete. 2023-07-21T22:34:53.099 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-21T22:34:53.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.194+0000 7f92859a9640 1 Processor -- start 2023-07-21T22:34:53.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.194+0000 7f92859a9640 1 -- start start 2023-07-21T22:34:53.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.194+0000 7f92859a9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f928015fd60 0x7f92800af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.194+0000 7f92859a9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9280070fe0 0x7f92801638c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.194+0000 7f92859a9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92800afe90 con 0x7f92800c13d0 2023-07-21T22:34:53.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.194+0000 7f92859a9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928006d470 con 0x7f928015fd60 2023-07-21T22:34:53.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.194+0000 7f92859a9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92800b0170 con 0x7f9280070fe0 2023-07-21T22:34:53.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.194+0000 7f92849a7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f928015fd60 0x7f92800af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.198+0000 7f927ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f92800c13d0 0x7f92800708d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56596/0 (socket says 172.21.15.6:56596) 2023-07-21T22:34:53.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.198+0000 7f927ffff640 1 -- 172.21.15.6:0/1100676013 learned_addr learned my addr 172.21.15.6:0/1100676013 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:53.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.198+0000 7f92851a8640 1 --2- 172.21.15.6:0/1100676013 >> v2:172.21.15.161:3300/0 conn(0x7f9280070fe0 0x7f92801638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.198+0000 7f92849a7640 1 -- 172.21.15.6:0/1100676013 >> v2:172.21.15.161:3300/0 conn(0x7f9280070fe0 msgr2=0x7f92801638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:53.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.198+0000 7f92849a7640 1 --2- 172.21.15.6:0/1100676013 >> v2:172.21.15.161:3300/0 conn(0x7f9280070fe0 0x7f92801638c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.198+0000 7f92849a7640 1 -- 172.21.15.6:0/1100676013 >> v1:172.21.15.6:6789/0 conn(0x7f92800c13d0 legacy=0x7f92800708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.198+0000 7f92849a7640 1 -- 172.21.15.6:0/1100676013 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928006c990 con 0x7f928015fd60 2023-07-21T22:34:53.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.198+0000 7f927f7fe640 1 -- 172.21.15.6:0/1100676013 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241236596 0 0) 0x7f92800afe90 con 0x7f92800c13d0 2023-07-21T22:34:53.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.198+0000 7f92849a7640 1 --2- 172.21.15.6:0/1100676013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928015fd60 0x7f92800af8b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f928006c750 tx=0x7f927401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c26a016e74d8ca server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:53.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.198+0000 7f927f7fe640 1 -- 172.21.15.6:0/1100676013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92740ab600 con 0x7f928015fd60 2023-07-21T22:34:53.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.198+0000 7f927f7fe640 1 -- 172.21.15.6:0/1100676013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92740a7050 con 0x7f928015fd60 2023-07-21T22:34:53.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.198+0000 7f927f7fe640 1 -- 172.21.15.6:0/1100676013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92740ab980 con 0x7f928015fd60 2023-07-21T22:34:53.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f92859a9640 1 -- 172.21.15.6:0/1100676013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928015fd60 msgr2=0x7f92800af8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f92859a9640 1 --2- 172.21.15.6:0/1100676013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928015fd60 0x7f92800af8b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f928006c750 tx=0x7f927401c460 comp rx=0 tx=0).stop 2023-07-21T22:34:53.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f92859a9640 1 -- 172.21.15.6:0/1100676013 shutdown_connections 2023-07-21T22:34:53.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f92859a9640 1 --2- 172.21.15.6:0/1100676013 >> v2:172.21.15.161:3300/0 conn(0x7f9280070fe0 0x7f92801638c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f92859a9640 1 --2- 172.21.15.6:0/1100676013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928015fd60 0x7f92800af8b0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f92859a9640 1 -- 172.21.15.6:0/1100676013 >> 172.21.15.6:0/1100676013 conn(0x7f92800ca8b0 msgr2=0x7f92800cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:53.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f92859a9640 1 -- 172.21.15.6:0/1100676013 shutdown_connections 2023-07-21T22:34:53.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f92859a9640 1 -- 172.21.15.6:0/1100676013 wait complete. 2023-07-21T22:34:53.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f92859a9640 1 Processor -- start 2023-07-21T22:34:53.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f92859a9640 1 -- start start 2023-07-21T22:34:53.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f92859a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9280070fe0 0x7f9280159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f92859a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92800c13d0 0x7f92800b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f92859a9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928015fd60 0x7f928015c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f92859a9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9280161d90 con 0x7f928015fd60 2023-07-21T22:34:53.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f92859a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9280161110 con 0x7f92800c13d0 2023-07-21T22:34:53.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f92859a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92801613f0 con 0x7f9280070fe0 2023-07-21T22:34:53.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f92851a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928015fd60 0x7f928015c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f92851a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928015fd60 0x7f928015c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46028/0 (socket says 172.21.15.6:46028) 2023-07-21T22:34:53.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f92851a8640 1 -- 172.21.15.6:0/1984272617 learned_addr learned my addr 172.21.15.6:0/1984272617 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:53.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f927ffff640 1 --2- 172.21.15.6:0/1984272617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92800c13d0 0x7f92800b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.202+0000 7f92849a7640 1 --2- 172.21.15.6:0/1984272617 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9280070fe0 0x7f9280159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.206+0000 7f92851a8640 1 -- 172.21.15.6:0/1984272617 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9280070fe0 msgr2=0x7f9280159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.206+0000 7f92851a8640 1 --2- 172.21.15.6:0/1984272617 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9280070fe0 0x7f9280159590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.206+0000 7f92851a8640 1 -- 172.21.15.6:0/1984272617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92800c13d0 msgr2=0x7f92800b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.206+0000 7f92851a8640 1 --2- 172.21.15.6:0/1984272617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92800c13d0 0x7f92800b3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.206+0000 7f92851a8640 1 -- 172.21.15.6:0/1984272617 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9274009420 con 0x7f928015fd60 2023-07-21T22:34:53.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.206+0000 7f92851a8640 1 --2- 172.21.15.6:0/1984272617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928015fd60 0x7f928015c520 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f927800efc0 tx=0x7f927800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:53.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.206+0000 7f927d7fa640 1 -- 172.21.15.6:0/1984272617 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9278014480 con 0x7f928015fd60 2023-07-21T22:34:53.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.206+0000 7f927d7fa640 1 -- 172.21.15.6:0/1984272617 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927800f040 con 0x7f928015fd60 2023-07-21T22:34:53.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.206+0000 7f927d7fa640 1 -- 172.21.15.6:0/1984272617 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9278014820 con 0x7f928015fd60 2023-07-21T22:34:53.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.206+0000 7f92859a9640 1 -- 172.21.15.6:0/1984272617 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92801616d0 con 0x7f928015fd60 2023-07-21T22:34:53.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.206+0000 7f92859a9640 1 -- 172.21.15.6:0/1984272617 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92801621b0 con 0x7f928015fd60 2023-07-21T22:34:53.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.206+0000 7f92859a9640 1 -- 172.21.15.6:0/1984272617 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9280161ed0 con 0x7f928015fd60 2023-07-21T22:34:53.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.206+0000 7f927d7fa640 1 -- 172.21.15.6:0/1984272617 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9278014980 con 0x7f928015fd60 2023-07-21T22:34:53.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.206+0000 7f927d7fa640 1 --2- 172.21.15.6:0/1984272617 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f92640663a0 0x7f9264068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.206+0000 7f927d7fa640 1 -- 172.21.15.6:0/1984272617 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6071+0+0 (secure 0 0 0) 0x7f9278084d20 con 0x7f928015fd60 2023-07-21T22:34:53.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.206+0000 7f92849a7640 1 --2- 172.21.15.6:0/1984272617 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f92640663a0 0x7f9264068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.210+0000 7f92849a7640 1 --2- 172.21.15.6:0/1984272617 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f92640663a0 0x7f9264068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f92740ad000 tx=0x7f92740a6000 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:53.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.210+0000 7f927d7fa640 1 -- 172.21.15.6:0/1984272617 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9280161ed0 con 0x7f928015fd60 2023-07-21T22:34:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.366+0000 7f92859a9640 1 -- 172.21.15.6:0/1984272617 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f9280161ed0 con 0x7f928015fd60 2023-07-21T22:34:53.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.370+0000 7f927d7fa640 1 -- 172.21.15.6:0/1984272617 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v26) v1 ==== 120+0+0 (secure 0 0 0) 0x7f9280161ed0 con 0x7f928015fd60 2023-07-21T22:34:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.374+0000 7f92859a9640 1 -- 172.21.15.6:0/1984272617 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f92640663a0 msgr2=0x7f9264068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.374+0000 7f92859a9640 1 --2- 172.21.15.6:0/1984272617 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f92640663a0 0x7f9264068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f92740ad000 tx=0x7f92740a6000 comp rx=0 tx=0).stop 2023-07-21T22:34:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.374+0000 7f92859a9640 1 -- 172.21.15.6:0/1984272617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928015fd60 msgr2=0x7f928015c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.374+0000 7f92859a9640 1 --2- 172.21.15.6:0/1984272617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928015fd60 0x7f928015c520 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f927800efc0 tx=0x7f927800c490 comp rx=0 tx=0).stop 2023-07-21T22:34:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.374+0000 7f92859a9640 1 -- 172.21.15.6:0/1984272617 shutdown_connections 2023-07-21T22:34:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.374+0000 7f92859a9640 1 --2- 172.21.15.6:0/1984272617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f928015fd60 0x7f928015c520 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.374+0000 7f92859a9640 1 --2- 172.21.15.6:0/1984272617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92800c13d0 0x7f92800b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.374+0000 7f92859a9640 1 --2- 172.21.15.6:0/1984272617 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f92640663a0 0x7f9264068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.374+0000 7f92859a9640 1 --2- 172.21.15.6:0/1984272617 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9280070fe0 0x7f9280159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.374+0000 7f92859a9640 1 -- 172.21.15.6:0/1984272617 >> 172.21.15.6:0/1984272617 conn(0x7f92800ca8b0 msgr2=0x7f928015f150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:53.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.374+0000 7f92859a9640 1 -- 172.21.15.6:0/1984272617 shutdown_connections 2023-07-21T22:34:53.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.374+0000 7f92859a9640 1 -- 172.21.15.6:0/1984272617 wait complete. 2023-07-21T22:34:53.444 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-21T22:34:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.538+0000 7f9ae0868640 1 Processor -- start 2023-07-21T22:34:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.538+0000 7f9ae0868640 1 -- start start 2023-07-21T22:34:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.542+0000 7f9ae0868640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9adc0cc960 0x7f9adc0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.542+0000 7f9ae0868640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9adc0b1620 0x7f9adc0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.542+0000 7f9ae0868640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9adc0cd270 con 0x7f9adc160750 2023-07-21T22:34:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.542+0000 7f9ae0868640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9adc0cf710 con 0x7f9adc0b1620 2023-07-21T22:34:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.542+0000 7f9ae0868640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9adc0cf430 con 0x7f9adc0cc960 2023-07-21T22:34:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.542+0000 7f9adaffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9adc0b1620 0x7f9adc0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.542+0000 7f9adbfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9adc160750 0x7f9adc0b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56612/0 (socket says 172.21.15.6:56612) 2023-07-21T22:34:53.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.542+0000 7f9adbfff640 1 -- 172.21.15.6:0/527104033 learned_addr learned my addr 172.21.15.6:0/527104033 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:53.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.542+0000 7f9adb7fe640 1 --2- 172.21.15.6:0/527104033 >> v2:172.21.15.161:3300/0 conn(0x7f9adc0cc960 0x7f9adc0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.542+0000 7f9adaffd640 1 -- 172.21.15.6:0/527104033 >> v2:172.21.15.161:3300/0 conn(0x7f9adc0cc960 msgr2=0x7f9adc0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:53.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.542+0000 7f9adaffd640 1 --2- 172.21.15.6:0/527104033 >> v2:172.21.15.161:3300/0 conn(0x7f9adc0cc960 0x7f9adc0ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.542+0000 7f9adaffd640 1 -- 172.21.15.6:0/527104033 >> v1:172.21.15.6:6789/0 conn(0x7f9adc160750 legacy=0x7f9adc0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.542+0000 7f9adaffd640 1 -- 172.21.15.6:0/527104033 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9adc15fc70 con 0x7f9adc0b1620 2023-07-21T22:34:53.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.542+0000 7f9ada7fc640 1 -- 172.21.15.6:0/527104033 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 959673936 0 0) 0x7f9adc0cd270 con 0x7f9adc160750 2023-07-21T22:34:53.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.546+0000 7f9adaffd640 1 --2- 172.21.15.6:0/527104033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9adc0b1620 0x7f9adc0ce950 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0cc930 tx=0x7f9ad001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e86381781a1715 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:53.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.546+0000 7f9ada7fc640 1 -- 172.21.15.6:0/527104033 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad00a7070 con 0x7f9adc0b1620 2023-07-21T22:34:53.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.546+0000 7f9ada7fc640 1 -- 172.21.15.6:0/527104033 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad00ab430 con 0x7f9adc0b1620 2023-07-21T22:34:53.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.546+0000 7f9ada7fc640 1 -- 172.21.15.6:0/527104033 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad00ab7c0 con 0x7f9adc0b1620 2023-07-21T22:34:53.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.546+0000 7f9ae0868640 1 -- 172.21.15.6:0/527104033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9adc0b1620 msgr2=0x7f9adc0ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.546+0000 7f9ae0868640 1 --2- 172.21.15.6:0/527104033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9adc0b1620 0x7f9adc0ce950 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0cc930 tx=0x7f9ad001c430 comp rx=0 tx=0).stop 2023-07-21T22:34:53.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.546+0000 7f9ae0868640 1 -- 172.21.15.6:0/527104033 shutdown_connections 2023-07-21T22:34:53.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.546+0000 7f9ae0868640 1 --2- 172.21.15.6:0/527104033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9adc0b1620 0x7f9adc0ce950 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.546+0000 7f9ae0868640 1 --2- 172.21.15.6:0/527104033 >> v2:172.21.15.161:3300/0 conn(0x7f9adc0cc960 0x7f9adc0ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.546+0000 7f9ae0868640 1 -- 172.21.15.6:0/527104033 >> 172.21.15.6:0/527104033 conn(0x7f9adc069f50 msgr2=0x7f9adc06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:53.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.546+0000 7f9ae0868640 1 -- 172.21.15.6:0/527104033 shutdown_connections 2023-07-21T22:34:53.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.546+0000 7f9ae0868640 1 -- 172.21.15.6:0/527104033 wait complete. 2023-07-21T22:34:53.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.546+0000 7f9ae0868640 1 Processor -- start 2023-07-21T22:34:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.546+0000 7f9ae0868640 1 -- start start 2023-07-21T22:34:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.546+0000 7f9ae0868640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9adc0b1620 0x7f9adc14f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.546+0000 7f9ae0868640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9adc0cc960 0x7f9adc155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.546+0000 7f9ae0868640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9adc160750 0x7f9adc0c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.546+0000 7f9ae0868640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc0b19f0 con 0x7f9adc0cc960 2023-07-21T22:34:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.546+0000 7f9ae0868640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc0b1c40 con 0x7f9adc160750 2023-07-21T22:34:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.546+0000 7f9ae0868640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc0b1f20 con 0x7f9adc0b1620 2023-07-21T22:34:53.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.550+0000 7f9adaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9adc0cc960 0x7f9adc155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.550+0000 7f9adaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9adc0cc960 0x7f9adc155e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46036/0 (socket says 172.21.15.6:46036) 2023-07-21T22:34:53.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.550+0000 7f9adaffd640 1 -- 172.21.15.6:0/630542988 learned_addr learned my addr 172.21.15.6:0/630542988 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:53.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.550+0000 7f9adb7fe640 1 --2- 172.21.15.6:0/630542988 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9adc0b1620 0x7f9adc14f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.550+0000 7f9adbfff640 1 --2- 172.21.15.6:0/630542988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9adc160750 0x7f9adc0c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.550+0000 7f9adaffd640 1 -- 172.21.15.6:0/630542988 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9adc0b1620 msgr2=0x7f9adc14f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.550+0000 7f9adaffd640 1 --2- 172.21.15.6:0/630542988 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9adc0b1620 0x7f9adc14f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.550+0000 7f9adaffd640 1 -- 172.21.15.6:0/630542988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9adc160750 msgr2=0x7f9adc0c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.550+0000 7f9adaffd640 1 --2- 172.21.15.6:0/630542988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9adc160750 0x7f9adc0c9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.550+0000 7f9adaffd640 1 -- 172.21.15.6:0/630542988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad0009420 con 0x7f9adc0cc960 2023-07-21T22:34:53.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.550+0000 7f9adbfff640 1 --2- 172.21.15.6:0/630542988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9adc160750 0x7f9adc0c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:53.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.550+0000 7f9adaffd640 1 --2- 172.21.15.6:0/630542988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9adc0cc960 0x7f9adc155e70 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0019040 tx=0x7f9ad001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:53.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.550+0000 7f9ac3fff640 1 -- 172.21.15.6:0/630542988 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad00b5610 con 0x7f9adc0cc960 2023-07-21T22:34:53.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.550+0000 7f9ac3fff640 1 -- 172.21.15.6:0/630542988 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad00b5790 con 0x7f9adc0cc960 2023-07-21T22:34:53.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.550+0000 7f9ac3fff640 1 -- 172.21.15.6:0/630542988 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad00b5b40 con 0x7f9adc0cc960 2023-07-21T22:34:53.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.550+0000 7f9ae0868640 1 -- 172.21.15.6:0/630542988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9adc0b2200 con 0x7f9adc0cc960 2023-07-21T22:34:53.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.550+0000 7f9ae0868640 1 -- 172.21.15.6:0/630542988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9adc0b27c0 con 0x7f9adc0cc960 2023-07-21T22:34:53.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.550+0000 7f9ae0868640 1 -- 172.21.15.6:0/630542988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9adc0b29b0 con 0x7f9adc0cc960 2023-07-21T22:34:53.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.550+0000 7f9ac3fff640 1 -- 172.21.15.6:0/630542988 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9ad00b5ca0 con 0x7f9adc0cc960 2023-07-21T22:34:53.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.554+0000 7f9ac3fff640 1 --2- 172.21.15.6:0/630542988 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f9ac80663a0 0x7f9ac8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.554+0000 7f9ac3fff640 1 -- 172.21.15.6:0/630542988 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6071+0+0 (secure 0 0 0) 0x7f9ad011e790 con 0x7f9adc0cc960 2023-07-21T22:34:53.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.554+0000 7f9adb7fe640 1 --2- 172.21.15.6:0/630542988 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f9ac80663a0 0x7f9ac8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.554+0000 7f9adb7fe640 1 --2- 172.21.15.6:0/630542988 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f9ac80663a0 0x7f9ac8068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9acc009b60 tx=0x7f9acc009190 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:53.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.554+0000 7f9ac3fff640 1 -- 172.21.15.6:0/630542988 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ad00eba80 con 0x7f9adc0cc960 2023-07-21T22:34:53.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.714+0000 7f9ae0868640 1 -- 172.21.15.6:0/630542988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9adc04e020 con 0x7f9adc0cc960 2023-07-21T22:34:53.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.722+0000 7f9ac3fff640 1 -- 172.21.15.6:0/630542988 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9ad00b4390 con 0x7f9adc0cc960 2023-07-21T22:34:53.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.722+0000 7f9ae0868640 1 -- 172.21.15.6:0/630542988 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f9ac80663a0 msgr2=0x7f9ac8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.722+0000 7f9ae0868640 1 --2- 172.21.15.6:0/630542988 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f9ac80663a0 0x7f9ac8068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9acc009b60 tx=0x7f9acc009190 comp rx=0 tx=0).stop 2023-07-21T22:34:53.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.722+0000 7f9ae0868640 1 -- 172.21.15.6:0/630542988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9adc0cc960 msgr2=0x7f9adc155e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.722+0000 7f9ae0868640 1 --2- 172.21.15.6:0/630542988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9adc0cc960 0x7f9adc155e70 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0019040 tx=0x7f9ad001ac70 comp rx=0 tx=0).stop 2023-07-21T22:34:53.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.722+0000 7f9ae0868640 1 -- 172.21.15.6:0/630542988 shutdown_connections 2023-07-21T22:34:53.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.722+0000 7f9ae0868640 1 --2- 172.21.15.6:0/630542988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9adc160750 0x7f9adc0c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.722+0000 7f9ae0868640 1 --2- 172.21.15.6:0/630542988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9adc0cc960 0x7f9adc155e70 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.722+0000 7f9ae0868640 1 --2- 172.21.15.6:0/630542988 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f9ac80663a0 0x7f9ac8068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.722+0000 7f9ae0868640 1 --2- 172.21.15.6:0/630542988 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9adc0b1620 0x7f9adc14f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.722+0000 7f9ae0868640 1 -- 172.21.15.6:0/630542988 >> 172.21.15.6:0/630542988 conn(0x7f9adc069f50 msgr2=0x7f9adc0b6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:53.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.722+0000 7f9ae0868640 1 -- 172.21.15.6:0/630542988 shutdown_connections 2023-07-21T22:34:53.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.722+0000 7f9ae0868640 1 -- 172.21.15.6:0/630542988 wait complete. 2023-07-21T22:34:53.793 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-07-21T22:34:53.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.886+0000 7f316c25c640 1 Processor -- start 2023-07-21T22:34:53.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.886+0000 7f316c25c640 1 -- start start 2023-07-21T22:34:53.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.886+0000 7f316c25c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3164158ce0 0x7f3164070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.886+0000 7f316c25c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31640c8ad0 0x7f31640c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.886+0000 7f316c25c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31640c99c0 con 0x7f31640c9560 2023-07-21T22:34:53.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.886+0000 7f316c25c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31640cc700 con 0x7f31640c8ad0 2023-07-21T22:34:53.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.886+0000 7f316c25c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31640b0ff0 con 0x7f3164158ce0 2023-07-21T22:34:53.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.890+0000 7f31697f7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31640c8ad0 0x7f31640c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.890+0000 7f316a7f9640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f31640c9560 0x7f31640cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56616/0 (socket says 172.21.15.6:56616) 2023-07-21T22:34:53.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.890+0000 7f316a7f9640 1 -- 172.21.15.6:0/2887486575 learned_addr learned my addr 172.21.15.6:0/2887486575 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:53.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.890+0000 7f3169ff8640 1 --2- 172.21.15.6:0/2887486575 >> v2:172.21.15.161:3300/0 conn(0x7f3164158ce0 0x7f3164070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.890+0000 7f31697f7640 1 -- 172.21.15.6:0/2887486575 >> v2:172.21.15.161:3300/0 conn(0x7f3164158ce0 msgr2=0x7f3164070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:53.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.890+0000 7f31697f7640 1 --2- 172.21.15.6:0/2887486575 >> v2:172.21.15.161:3300/0 conn(0x7f3164158ce0 0x7f3164070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.890+0000 7f31697f7640 1 -- 172.21.15.6:0/2887486575 >> v1:172.21.15.6:6789/0 conn(0x7f31640c9560 legacy=0x7f31640cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.890+0000 7f31697f7640 1 -- 172.21.15.6:0/2887486575 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3164070c80 con 0x7f31640c8ad0 2023-07-21T22:34:53.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.890+0000 7f3168ff6640 1 -- 172.21.15.6:0/2887486575 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771482385 0 0) 0x7f31640c99c0 con 0x7f31640c9560 2023-07-21T22:34:53.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.890+0000 7f31697f7640 1 --2- 172.21.15.6:0/2887486575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31640c8ad0 0x7f31640c9020 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f3164071be0 tx=0x7f315401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ecb8bcccf621a90 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:53.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.890+0000 7f3168ff6640 1 -- 172.21.15.6:0/2887486575 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31640cba20 con 0x7f31640c8ad0 2023-07-21T22:34:53.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.890+0000 7f3168ff6640 1 -- 172.21.15.6:0/2887486575 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31540ac640 con 0x7f31640c8ad0 2023-07-21T22:34:53.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.890+0000 7f3168ff6640 1 -- 172.21.15.6:0/2887486575 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31540ac9d0 con 0x7f31640c8ad0 2023-07-21T22:34:53.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f316c25c640 1 -- 172.21.15.6:0/2887486575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31640c8ad0 msgr2=0x7f31640c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f316c25c640 1 --2- 172.21.15.6:0/2887486575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31640c8ad0 0x7f31640c9020 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f3164071be0 tx=0x7f315401c310 comp rx=0 tx=0).stop 2023-07-21T22:34:53.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f316c25c640 1 -- 172.21.15.6:0/2887486575 shutdown_connections 2023-07-21T22:34:53.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f316c25c640 1 --2- 172.21.15.6:0/2887486575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31640c8ad0 0x7f31640c9020 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f316c25c640 1 --2- 172.21.15.6:0/2887486575 >> v2:172.21.15.161:3300/0 conn(0x7f3164158ce0 0x7f3164070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f316c25c640 1 -- 172.21.15.6:0/2887486575 >> 172.21.15.6:0/2887486575 conn(0x7f31640afcf0 msgr2=0x7f31640b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:53.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f316c25c640 1 -- 172.21.15.6:0/2887486575 shutdown_connections 2023-07-21T22:34:53.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f316c25c640 1 -- 172.21.15.6:0/2887486575 wait complete. 2023-07-21T22:34:53.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f316c25c640 1 Processor -- start 2023-07-21T22:34:53.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f316c25c640 1 -- start start 2023-07-21T22:34:53.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f316c25c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31640c8ad0 0x7f31640c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f316c25c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31640c9560 0x7f31640ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f316c25c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3164158ce0 0x7f31640cab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f316c25c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31640c2a20 con 0x7f31640c8ad0 2023-07-21T22:34:53.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f316c25c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31641f7ae0 con 0x7f31640c9560 2023-07-21T22:34:53.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f316c25c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31641f7dc0 con 0x7f3164158ce0 2023-07-21T22:34:53.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f3169ff8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31640c8ad0 0x7f31640c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f3169ff8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31640c8ad0 0x7f31640c24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46054/0 (socket says 172.21.15.6:46054) 2023-07-21T22:34:53.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f3169ff8640 1 -- 172.21.15.6:0/1127535070 learned_addr learned my addr 172.21.15.6:0/1127535070 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:53.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f3169ff8640 1 -- 172.21.15.6:0/1127535070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3164158ce0 msgr2=0x7f31640cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f3169ff8640 1 --2- 172.21.15.6:0/1127535070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3164158ce0 0x7f31640cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f3169ff8640 1 -- 172.21.15.6:0/1127535070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31640c9560 msgr2=0x7f31640ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f3169ff8640 1 --2- 172.21.15.6:0/1127535070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31640c9560 0x7f31640ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.894+0000 7f3169ff8640 1 -- 172.21.15.6:0/1127535070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3154009420 con 0x7f31640c8ad0 2023-07-21T22:34:53.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.898+0000 7f3169ff8640 1 --2- 172.21.15.6:0/1127535070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31640c8ad0 0x7f31640c24e0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f316000d800 tx=0x7f316000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:53.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.898+0000 7f315a7fc640 1 -- 172.21.15.6:0/1127535070 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316000b6c0 con 0x7f31640c8ad0 2023-07-21T22:34:53.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.898+0000 7f315a7fc640 1 -- 172.21.15.6:0/1127535070 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316000b820 con 0x7f31640c8ad0 2023-07-21T22:34:53.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.898+0000 7f315a7fc640 1 -- 172.21.15.6:0/1127535070 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316000bb90 con 0x7f31640c8ad0 2023-07-21T22:34:53.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.898+0000 7f316c25c640 1 -- 172.21.15.6:0/1127535070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31641f80a0 con 0x7f31640c8ad0 2023-07-21T22:34:53.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.898+0000 7f316c25c640 1 -- 172.21.15.6:0/1127535070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31641f8660 con 0x7f31640c8ad0 2023-07-21T22:34:53.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.898+0000 7f316c25c640 1 -- 172.21.15.6:0/1127535070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31641f8820 con 0x7f31640c8ad0 2023-07-21T22:34:53.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.898+0000 7f315a7fc640 1 -- 172.21.15.6:0/1127535070 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f316000bcf0 con 0x7f31640c8ad0 2023-07-21T22:34:53.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.898+0000 7f315a7fc640 1 --2- 172.21.15.6:0/1127535070 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f31480663a0 0x7f3148068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.898+0000 7f315a7fc640 1 -- 172.21.15.6:0/1127535070 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6071+0+0 (secure 0 0 0) 0x7f3160084450 con 0x7f31640c8ad0 2023-07-21T22:34:53.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.898+0000 7f31697f7640 1 --2- 172.21.15.6:0/1127535070 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f31480663a0 0x7f3148068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.902+0000 7f31697f7640 1 --2- 172.21.15.6:0/1127535070 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f31480663a0 0x7f3148068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f31540ae000 tx=0x7f3154004740 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:53.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:53.902+0000 7f315a7fc640 1 -- 172.21.15.6:0/1127535070 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3160055230 con 0x7f31640c8ad0 2023-07-21T22:34:54.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.110+0000 7f316c25c640 1 -- 172.21.15.6:0/1127535070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f31640ca1a0 con 0x7f31640c8ad0 2023-07-21T22:34:54.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.662+0000 7f315a7fc640 1 -- 172.21.15.6:0/1127535070 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v603) v1 ==== 156+0+0 (secure 0 0 0) 0x7f3160054dc0 con 0x7f31640c8ad0 2023-07-21T22:34:54.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.662+0000 7f316c25c640 1 -- 172.21.15.6:0/1127535070 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f31480663a0 msgr2=0x7f3148068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:54.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.662+0000 7f316c25c640 1 --2- 172.21.15.6:0/1127535070 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f31480663a0 0x7f3148068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f31540ae000 tx=0x7f3154004740 comp rx=0 tx=0).stop 2023-07-21T22:34:54.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.662+0000 7f316c25c640 1 -- 172.21.15.6:0/1127535070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31640c8ad0 msgr2=0x7f31640c24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:54.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.662+0000 7f316c25c640 1 --2- 172.21.15.6:0/1127535070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31640c8ad0 0x7f31640c24e0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f316000d800 tx=0x7f316000dcc0 comp rx=0 tx=0).stop 2023-07-21T22:34:54.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.662+0000 7f316c25c640 1 -- 172.21.15.6:0/1127535070 shutdown_connections 2023-07-21T22:34:54.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.662+0000 7f316c25c640 1 --2- 172.21.15.6:0/1127535070 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f31480663a0 0x7f3148068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:54.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.662+0000 7f316c25c640 1 --2- 172.21.15.6:0/1127535070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3164158ce0 0x7f31640cab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:54.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.662+0000 7f316c25c640 1 --2- 172.21.15.6:0/1127535070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31640c9560 0x7f31640ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:54.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.662+0000 7f316c25c640 1 --2- 172.21.15.6:0/1127535070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31640c8ad0 0x7f31640c24e0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:54.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.662+0000 7f316c25c640 1 -- 172.21.15.6:0/1127535070 >> 172.21.15.6:0/1127535070 conn(0x7f31640afcf0 msgr2=0x7f31640aca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:54.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.662+0000 7f316c25c640 1 -- 172.21.15.6:0/1127535070 shutdown_connections 2023-07-21T22:34:54.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.662+0000 7f316c25c640 1 -- 172.21.15.6:0/1127535070 wait complete. 2023-07-21T22:34:54.735 INFO:tasks.cephfs_test_runner:Test listing non-existing snap schedules failure ... ok 2023-07-21T22:34:54.736 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules on a non-existing filesystem path failure 2023-07-21T22:34:54.736 INFO:tasks.cephfs_test_runner:test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-21T22:34:54.736 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-07-21T22:34:54.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f3718574640 1 Processor -- start 2023-07-21T22:34:54.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f3718574640 1 -- start start 2023-07-21T22:34:54.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f3718574640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f371006a540 0x7f371006a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:54.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f3718574640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37100ca750 0x7f37100cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:54.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f3718574640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371006ae50 con 0x7f37100cdcd0 2023-07-21T22:34:54.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f3718574640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37100cef10 con 0x7f371006a540 2023-07-21T22:34:54.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f3718574640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37100cfaf0 con 0x7f37100ca750 2023-07-21T22:34:54.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f3715b0f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f37100cdcd0 0x7f37100cf2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56624/0 (socket says 172.21.15.6:56624) 2023-07-21T22:34:54.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f3715b0f640 1 -- 172.21.15.6:0/3472783739 learned_addr learned my addr 172.21.15.6:0/3472783739 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:54.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f3716310640 1 --2- 172.21.15.6:0/3472783739 >> v2:172.21.15.161:3300/0 conn(0x7f371006a540 0x7f371006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:54.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f3716b11640 1 --2- 172.21.15.6:0/3472783739 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37100ca750 0x7f37100cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:54.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f371530e640 1 -- 172.21.15.6:0/3472783739 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1412149869 0 0) 0x7f371006ae50 con 0x7f37100cdcd0 2023-07-21T22:34:54.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f371530e640 1 -- 172.21.15.6:0/3472783739 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36fc003530 con 0x7f37100cdcd0 2023-07-21T22:34:54.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f371530e640 1 -- 172.21.15.6:0/3472783739 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 75439589 0 0) 0x7f36fc003530 con 0x7f37100cdcd0 2023-07-21T22:34:54.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f371530e640 1 -- 172.21.15.6:0/3472783739 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37100ca750 msgr2=0x7f37100cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:54.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f371530e640 1 --2- 172.21.15.6:0/3472783739 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37100ca750 0x7f37100cabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:54.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f371530e640 1 -- 172.21.15.6:0/3472783739 >> v2:172.21.15.161:3300/0 conn(0x7f371006a540 msgr2=0x7f371006a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:54.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f371530e640 1 --2- 172.21.15.6:0/3472783739 >> v2:172.21.15.161:3300/0 conn(0x7f371006a540 0x7f371006a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:54.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f371530e640 1 -- 172.21.15.6:0/3472783739 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37100cfdd0 con 0x7f37100cdcd0 2023-07-21T22:34:54.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f371530e640 1 -- 172.21.15.6:0/3472783739 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f3700001680 con 0x7f37100cdcd0 2023-07-21T22:34:54.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f371530e640 1 -- 172.21.15.6:0/3472783739 >> v1:172.21.15.6:6789/0 conn(0x7f37100cdcd0 legacy=0x7f37100cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:54.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f371530e640 1 --2- 172.21.15.6:0/3472783739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36fc003980 0x7f36fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:54.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f371530e640 1 --2- 172.21.15.6:0/3472783739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36fc0043b0 0x7f36fc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:54.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f371530e640 1 --2- 172.21.15.6:0/3472783739 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37100ca750 0x7f36fc004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:54.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f371530e640 1 -- 172.21.15.6:0/3472783739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37100cef10 con 0x7f36fc003980 2023-07-21T22:34:54.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f371530e640 1 -- 172.21.15.6:0/3472783739 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37100cfaf0 con 0x7f36fc0043b0 2023-07-21T22:34:54.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f371530e640 1 -- 172.21.15.6:0/3472783739 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc00b990 con 0x7f37100ca750 2023-07-21T22:34:54.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f3716310640 1 --2- 172.21.15.6:0/3472783739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36fc003980 0x7f36fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:54.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f3716b11640 1 --2- 172.21.15.6:0/3472783739 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37100ca750 0x7f36fc004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:54.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f3715b0f640 1 --2- 172.21.15.6:0/3472783739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36fc0043b0 0x7f36fc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:54.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f3716310640 1 -- 172.21.15.6:0/3472783739 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37100ca750 msgr2=0x7f36fc004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:54.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f3716310640 1 --2- 172.21.15.6:0/3472783739 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f37100ca750 0x7f36fc004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:54.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f3716310640 1 -- 172.21.15.6:0/3472783739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36fc0043b0 msgr2=0x7f36fc004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:54.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f3716310640 1 --2- 172.21.15.6:0/3472783739 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36fc0043b0 0x7f36fc004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:54.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.834+0000 7f3716310640 1 -- 172.21.15.6:0/3472783739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc003530 con 0x7f36fc003980 2023-07-21T22:34:54.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.838+0000 7f3716310640 1 --2- 172.21.15.6:0/3472783739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36fc003980 0x7f36fc003d90 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f370c009ac0 tx=0x7f370c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9cdbd057d364676 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:54.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.838+0000 7f371530e640 1 -- 172.21.15.6:0/3472783739 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c0059a0 con 0x7f36fc003980 2023-07-21T22:34:54.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.838+0000 7f371530e640 1 -- 172.21.15.6:0/3472783739 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c005b00 con 0x7f36fc003980 2023-07-21T22:34:54.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.838+0000 7f371530e640 1 -- 172.21.15.6:0/3472783739 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c006030 con 0x7f36fc003980 2023-07-21T22:34:54.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.838+0000 7f3718574640 1 -- 172.21.15.6:0/3472783739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36fc003980 msgr2=0x7f36fc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:54.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.838+0000 7f3718574640 1 --2- 172.21.15.6:0/3472783739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36fc003980 0x7f36fc003d90 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f370c009ac0 tx=0x7f370c01ca70 comp rx=0 tx=0).stop 2023-07-21T22:34:54.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.838+0000 7f3716b11640 1 -- 172.21.15.6:0/3472783739 reap_dead start 2023-07-21T22:34:54.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.838+0000 7f3718574640 1 -- 172.21.15.6:0/3472783739 shutdown_connections 2023-07-21T22:34:54.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.838+0000 7f3718574640 1 -- 172.21.15.6:0/3472783739 >> 172.21.15.6:0/3472783739 conn(0x7f3710099490 msgr2=0x7f3710089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:54.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.838+0000 7f3718574640 1 -- 172.21.15.6:0/3472783739 shutdown_connections 2023-07-21T22:34:54.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.838+0000 7f3718574640 1 -- 172.21.15.6:0/3472783739 wait complete. 2023-07-21T22:34:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3718574640 1 Processor -- start 2023-07-21T22:34:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3718574640 1 -- start start 2023-07-21T22:34:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3718574640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36fc003980 0x7f371015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3718574640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37100c7b10 0x7f37100b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:54.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3718574640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37100b5700 0x7f37100cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:54.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3718574640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371015a720 con 0x7f37100b5700 2023-07-21T22:34:54.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3718574640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37100b5c30 con 0x7f37100c7b10 2023-07-21T22:34:54.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3718574640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37100b2fd0 con 0x7f36fc003980 2023-07-21T22:34:54.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3716b11640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37100b5700 0x7f37100cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:54.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3716b11640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37100b5700 0x7f37100cc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46070/0 (socket says 172.21.15.6:46070) 2023-07-21T22:34:54.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3716b11640 1 -- 172.21.15.6:0/1484768558 learned_addr learned my addr 172.21.15.6:0/1484768558 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:54.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3715b0f640 1 --2- 172.21.15.6:0/1484768558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37100c7b10 0x7f37100b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:54.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3716310640 1 --2- 172.21.15.6:0/1484768558 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36fc003980 0x7f371015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:54.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3716b11640 1 -- 172.21.15.6:0/1484768558 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36fc003980 msgr2=0x7f371015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:54.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3716b11640 1 --2- 172.21.15.6:0/1484768558 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36fc003980 0x7f371015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:54.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3716b11640 1 -- 172.21.15.6:0/1484768558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37100c7b10 msgr2=0x7f37100b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:54.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3716b11640 1 --2- 172.21.15.6:0/1484768558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37100c7b10 0x7f37100b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:54.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3716b11640 1 -- 172.21.15.6:0/1484768558 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37100b32b0 con 0x7f37100b5700 2023-07-21T22:34:54.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3716310640 1 --2- 172.21.15.6:0/1484768558 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36fc003980 0x7f371015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:54.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3715b0f640 1 --2- 172.21.15.6:0/1484768558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37100c7b10 0x7f37100b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:54.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3716b11640 1 --2- 172.21.15.6:0/1484768558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37100b5700 0x7f37100cc770 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f37100ce0a0 tx=0x7f3708011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:54.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3706ffd640 1 -- 172.21.15.6:0/1484768558 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370800e040 con 0x7f37100b5700 2023-07-21T22:34:54.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3706ffd640 1 -- 172.21.15.6:0/1484768558 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370800f040 con 0x7f37100b5700 2023-07-21T22:34:54.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3706ffd640 1 -- 172.21.15.6:0/1484768558 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708015b60 con 0x7f37100b5700 2023-07-21T22:34:54.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3718574640 1 -- 172.21.15.6:0/1484768558 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37100b3590 con 0x7f37100b5700 2023-07-21T22:34:54.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.842+0000 7f3718574640 1 -- 172.21.15.6:0/1484768558 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37100b3ab0 con 0x7f37100b5700 2023-07-21T22:34:54.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.846+0000 7f3718574640 1 -- 172.21.15.6:0/1484768558 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37100678d0 con 0x7f37100b5700 2023-07-21T22:34:54.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.846+0000 7f3706ffd640 1 -- 172.21.15.6:0/1484768558 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3708015cc0 con 0x7f37100b5700 2023-07-21T22:34:54.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.846+0000 7f3706ffd640 1 --2- 172.21.15.6:0/1484768558 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f36f40663a0 0x7f36f4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:54.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.846+0000 7f3706ffd640 1 -- 172.21.15.6:0/1484768558 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6071+0+0 (secure 0 0 0) 0x7f37080840c0 con 0x7f37100b5700 2023-07-21T22:34:54.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.846+0000 7f3716310640 1 --2- 172.21.15.6:0/1484768558 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f36f40663a0 0x7f36f4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:54.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.846+0000 7f3716310640 1 --2- 172.21.15.6:0/1484768558 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f36f40663a0 0x7f36f4068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f370c0ae000 tx=0x7f370c0046d0 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:54.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:54.850+0000 7f3706ffd640 1 -- 172.21.15.6:0/1484768558 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3708051270 con 0x7f37100b5700 2023-07-21T22:34:55.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.058+0000 7f3718574640 1 -- 172.21.15.6:0/1484768558 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f37100b3780 con 0x7f37100b5700 2023-07-21T22:34:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.662+0000 7f3706ffd640 1 -- 172.21.15.6:0/1484768558 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v604) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3708054890 con 0x7f37100b5700 2023-07-21T22:34:55.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.666+0000 7f3718574640 1 -- 172.21.15.6:0/1484768558 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f36f40663a0 msgr2=0x7f36f4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:55.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.666+0000 7f3718574640 1 --2- 172.21.15.6:0/1484768558 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f36f40663a0 0x7f36f4068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f370c0ae000 tx=0x7f370c0046d0 comp rx=0 tx=0).stop 2023-07-21T22:34:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.666+0000 7f3718574640 1 -- 172.21.15.6:0/1484768558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37100b5700 msgr2=0x7f37100cc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.666+0000 7f3718574640 1 --2- 172.21.15.6:0/1484768558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37100b5700 0x7f37100cc770 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f37100ce0a0 tx=0x7f3708011d40 comp rx=0 tx=0).stop 2023-07-21T22:34:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.666+0000 7f3718574640 1 -- 172.21.15.6:0/1484768558 shutdown_connections 2023-07-21T22:34:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.666+0000 7f3718574640 1 --2- 172.21.15.6:0/1484768558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37100b5700 0x7f37100cc770 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.666+0000 7f3718574640 1 --2- 172.21.15.6:0/1484768558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37100c7b10 0x7f37100b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.666+0000 7f3718574640 1 --2- 172.21.15.6:0/1484768558 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f36f40663a0 0x7f36f4068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.666+0000 7f3718574640 1 --2- 172.21.15.6:0/1484768558 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36fc003980 0x7f371015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:55.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.666+0000 7f3718574640 1 -- 172.21.15.6:0/1484768558 >> 172.21.15.6:0/1484768558 conn(0x7f3710099490 msgr2=0x7f371006d510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:55.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.666+0000 7f3718574640 1 -- 172.21.15.6:0/1484768558 shutdown_connections 2023-07-21T22:34:55.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.666+0000 7f3718574640 1 -- 172.21.15.6:0/1484768558 wait complete. 2023-07-21T22:34:55.740 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-21T22:34:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.842+0000 7ff7ca9fa640 1 Processor -- start 2023-07-21T22:34:55.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.842+0000 7ff7ca9fa640 1 -- start start 2023-07-21T22:34:55.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.842+0000 7ff7ca9fa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7c415bde0 0x7ff7c40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:55.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.842+0000 7ff7ca9fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7c40d2300 0x7ff7c40d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:55.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.842+0000 7ff7ca9fa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7c40b04c0 con 0x7ff7c40d2fc0 2023-07-21T22:34:55.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.842+0000 7ff7ca9fa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7c415c1b0 con 0x7ff7c415bde0 2023-07-21T22:34:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.842+0000 7ff7ca9fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40d2cc0 con 0x7ff7c40d2300 2023-07-21T22:34:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.842+0000 7ff7c3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7c415bde0 0x7ff7c40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.842+0000 7ff7c3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7c415bde0 0x7ff7c40d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46078/0 (socket says 172.21.15.6:46078) 2023-07-21T22:34:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.842+0000 7ff7c3fff640 1 -- 172.21.15.6:0/2785506907 learned_addr learned my addr 172.21.15.6:0/2785506907 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.842+0000 7ff7c8f97640 1 --2- 172.21.15.6:0/2785506907 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7c40d2300 0x7ff7c40d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:55.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.842+0000 7ff7c3fff640 1 -- 172.21.15.6:0/2785506907 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7c40d2300 msgr2=0x7ff7c40d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:55.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.842+0000 7ff7c3fff640 1 --2- 172.21.15.6:0/2785506907 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7c40d2300 0x7ff7c40d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:55.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.842+0000 7ff7c3fff640 1 -- 172.21.15.6:0/2785506907 >> v1:172.21.15.161:6789/0 conn(0x7ff7c40d2fc0 legacy=0x7ff7c40b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:55.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.842+0000 7ff7c3fff640 1 -- 172.21.15.6:0/2785506907 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c40b1060 con 0x7ff7c415bde0 2023-07-21T22:34:55.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.846+0000 7ff7c3fff640 1 --2- 172.21.15.6:0/2785506907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c415bde0 0x7ff7c40d0270 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4006fd0 tx=0x7ff7b401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fcfaf84d9134cf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:55.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.846+0000 7ff7c2ffd640 1 -- 172.21.15.6:0/2785506907 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40a7070 con 0x7ff7c415bde0 2023-07-21T22:34:55.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.846+0000 7ff7c2ffd640 1 -- 172.21.15.6:0/2785506907 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b40ab430 con 0x7ff7c415bde0 2023-07-21T22:34:55.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.846+0000 7ff7c2ffd640 1 -- 172.21.15.6:0/2785506907 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b40ab7c0 con 0x7ff7c415bde0 2023-07-21T22:34:55.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.846+0000 7ff7ca9fa640 1 -- 172.21.15.6:0/2785506907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c415bde0 msgr2=0x7ff7c40d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:55.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.846+0000 7ff7ca9fa640 1 --2- 172.21.15.6:0/2785506907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c415bde0 0x7ff7c40d0270 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4006fd0 tx=0x7ff7b401c520 comp rx=0 tx=0).stop 2023-07-21T22:34:55.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.846+0000 7ff7ca9fa640 1 -- 172.21.15.6:0/2785506907 shutdown_connections 2023-07-21T22:34:55.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.846+0000 7ff7ca9fa640 1 --2- 172.21.15.6:0/2785506907 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7c40d2300 0x7ff7c40d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:55.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.846+0000 7ff7ca9fa640 1 --2- 172.21.15.6:0/2785506907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c415bde0 0x7ff7c40d0270 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:55.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.846+0000 7ff7ca9fa640 1 -- 172.21.15.6:0/2785506907 >> 172.21.15.6:0/2785506907 conn(0x7ff7c40659d0 msgr2=0x7ff7c409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:55.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.846+0000 7ff7ca9fa640 1 -- 172.21.15.6:0/2785506907 shutdown_connections 2023-07-21T22:34:55.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.846+0000 7ff7ca9fa640 1 -- 172.21.15.6:0/2785506907 wait complete. 2023-07-21T22:34:55.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7ca9fa640 1 Processor -- start 2023-07-21T22:34:55.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7ca9fa640 1 -- start start 2023-07-21T22:34:55.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7ca9fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7c40d2300 0x7ff7c414e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:55.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7ca9fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c40d2fc0 0x7ff7c4153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:55.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7ca9fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7c415bde0 0x7ff7c40b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:55.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7ca9fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c40c8f40 con 0x7ff7c40d2fc0 2023-07-21T22:34:55.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7ca9fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c41540d0 con 0x7ff7c40d2300 2023-07-21T22:34:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7ca9fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c4153830 con 0x7ff7c415bde0 2023-07-21T22:34:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7c37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c40d2fc0 0x7ff7c4153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7c37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c40d2fc0 0x7ff7c4153130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46088/0 (socket says 172.21.15.6:46088) 2023-07-21T22:34:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7c37fe640 1 -- 172.21.15.6:0/3593619519 learned_addr learned my addr 172.21.15.6:0/3593619519 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7c3fff640 1 --2- 172.21.15.6:0/3593619519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7c40d2300 0x7ff7c414e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7c8f97640 1 --2- 172.21.15.6:0/3593619519 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7c415bde0 0x7ff7c40b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7c37fe640 1 -- 172.21.15.6:0/3593619519 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7c415bde0 msgr2=0x7ff7c40b7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7c37fe640 1 --2- 172.21.15.6:0/3593619519 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7c415bde0 0x7ff7c40b7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7c37fe640 1 -- 172.21.15.6:0/3593619519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7c40d2300 msgr2=0x7ff7c414e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7c37fe640 1 --2- 172.21.15.6:0/3593619519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7c40d2300 0x7ff7c414e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7c37fe640 1 -- 172.21.15.6:0/3593619519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b4009480 con 0x7ff7c40d2fc0 2023-07-21T22:34:55.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7c37fe640 1 --2- 172.21.15.6:0/3593619519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c40d2fc0 0x7ff7c4153130 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800c390 tx=0x7ff7b800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:55.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7c0ff9640 1 -- 172.21.15.6:0/3593619519 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b80052d0 con 0x7ff7c40d2fc0 2023-07-21T22:34:55.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7c0ff9640 1 -- 172.21.15.6:0/3593619519 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b8005430 con 0x7ff7c40d2fc0 2023-07-21T22:34:55.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7c0ff9640 1 -- 172.21.15.6:0/3593619519 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8003820 con 0x7ff7c40d2fc0 2023-07-21T22:34:55.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7ca9fa640 1 -- 172.21.15.6:0/3593619519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7c4153b10 con 0x7ff7c40d2fc0 2023-07-21T22:34:55.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.850+0000 7ff7ca9fa640 1 -- 172.21.15.6:0/3593619519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7c40c6040 con 0x7ff7c40d2fc0 2023-07-21T22:34:55.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.854+0000 7ff7ca9fa640 1 -- 172.21.15.6:0/3593619519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7c40c5ea0 con 0x7ff7c40d2fc0 2023-07-21T22:34:55.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.854+0000 7ff7c0ff9640 1 -- 172.21.15.6:0/3593619519 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff7b8003980 con 0x7ff7c40d2fc0 2023-07-21T22:34:55.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.854+0000 7ff7c0ff9640 1 --2- 172.21.15.6:0/3593619519 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7ff7b00663a0 0x7ff7b0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:55.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.854+0000 7ff7c0ff9640 1 -- 172.21.15.6:0/3593619519 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6071+0+0 (secure 0 0 0) 0x7ff7b80833d0 con 0x7ff7c40d2fc0 2023-07-21T22:34:55.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.854+0000 7ff7c3fff640 1 --2- 172.21.15.6:0/3593619519 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7ff7b00663a0 0x7ff7b0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:55.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.858+0000 7ff7c3fff640 1 --2- 172.21.15.6:0/3593619519 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7ff7b00663a0 0x7ff7b0068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40af000 tx=0x7ff7b40a7000 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:55.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:55.858+0000 7ff7c0ff9640 1 -- 172.21.15.6:0/3593619519 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff7c40c5ea0 con 0x7ff7c40d2fc0 2023-07-21T22:34:56.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.014+0000 7ff7ca9fa640 1 -- 172.21.15.6:0/3593619519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff7c40c5ea0 con 0x7ff7c40d2fc0 2023-07-21T22:34:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.022+0000 7ff7c0ff9640 1 -- 172.21.15.6:0/3593619519 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff7c40c5ea0 con 0x7ff7c40d2fc0 2023-07-21T22:34:56.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.022+0000 7ff7ca9fa640 1 -- 172.21.15.6:0/3593619519 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7ff7b00663a0 msgr2=0x7ff7b0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:56.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.022+0000 7ff7ca9fa640 1 --2- 172.21.15.6:0/3593619519 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7ff7b00663a0 0x7ff7b0068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40af000 tx=0x7ff7b40a7000 comp rx=0 tx=0).stop 2023-07-21T22:34:56.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.022+0000 7ff7ca9fa640 1 -- 172.21.15.6:0/3593619519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c40d2fc0 msgr2=0x7ff7c4153130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:56.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.022+0000 7ff7ca9fa640 1 --2- 172.21.15.6:0/3593619519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c40d2fc0 0x7ff7c4153130 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff7b800c390 tx=0x7ff7b800c850 comp rx=0 tx=0).stop 2023-07-21T22:34:56.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.022+0000 7ff7ca9fa640 1 -- 172.21.15.6:0/3593619519 shutdown_connections 2023-07-21T22:34:56.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.022+0000 7ff7ca9fa640 1 --2- 172.21.15.6:0/3593619519 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7ff7b00663a0 0x7ff7b0068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:56.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.022+0000 7ff7ca9fa640 1 --2- 172.21.15.6:0/3593619519 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7c415bde0 0x7ff7c40b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:56.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.022+0000 7ff7ca9fa640 1 --2- 172.21.15.6:0/3593619519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7c40d2fc0 0x7ff7c4153130 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:56.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.022+0000 7ff7ca9fa640 1 --2- 172.21.15.6:0/3593619519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7c40d2300 0x7ff7c414e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:56.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.022+0000 7ff7ca9fa640 1 -- 172.21.15.6:0/3593619519 >> 172.21.15.6:0/3593619519 conn(0x7ff7c40659d0 msgr2=0x7ff7c40cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:56.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.022+0000 7ff7ca9fa640 1 -- 172.21.15.6:0/3593619519 shutdown_connections 2023-07-21T22:34:56.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.022+0000 7ff7ca9fa640 1 -- 172.21.15.6:0/3593619519 wait complete. 2023-07-21T22:34:56.092 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:34:56.093 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:34:56.161 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:34:56.227 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:34:56.227 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:34:56.228 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:34:56.237 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:34:56.237 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:34:56.237 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:34:56.247 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:34:56.247 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:34:56.247 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:34:56.288 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:34:56.289 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:34:56.289 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:34:56.300 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:34:56.301 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-21T22:34:56.301 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:34:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.422+0000 7fb3eeaf9640 1 Processor -- start 2023-07-21T22:34:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.422+0000 7fb3eeaf9640 1 -- start start 2023-07-21T22:34:56.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.426+0000 7fb3eeaf9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3e8158ce0 0x7fb3e8070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:56.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.426+0000 7fb3eeaf9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3e80c8ad0 0x7fb3e80c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:56.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.426+0000 7fb3eeaf9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e80cc700 con 0x7fb3e80c9560 2023-07-21T22:34:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.426+0000 7fb3eeaf9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e80c99e0 con 0x7fb3e8158ce0 2023-07-21T22:34:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.426+0000 7fb3eeaf9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80b0ff0 con 0x7fb3e80c8ad0 2023-07-21T22:34:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.426+0000 7fb3ec895640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3e8158ce0 0x7fb3e8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.426+0000 7fb3ed096640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb3e80c9560 0x7fb3e80cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56630/0 (socket says 172.21.15.6:56630) 2023-07-21T22:34:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.426+0000 7fb3ed096640 1 -- 172.21.15.6:0/1742421253 learned_addr learned my addr 172.21.15.6:0/1742421253 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:56.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.426+0000 7fb3e7fff640 1 --2- 172.21.15.6:0/1742421253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3e80c8ad0 0x7fb3e80c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:56.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.426+0000 7fb3e77fe640 1 -- 172.21.15.6:0/1742421253 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3894115474 0 0) 0x7fb3e80cc700 con 0x7fb3e80c9560 2023-07-21T22:34:56.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.426+0000 7fb3e77fe640 1 -- 172.21.15.6:0/1742421253 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3d8003530 con 0x7fb3e80c9560 2023-07-21T22:34:56.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.426+0000 7fb3ec895640 1 -- 172.21.15.6:0/1742421253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3e80c8ad0 msgr2=0x7fb3e80c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.426+0000 7fb3ec895640 1 --2- 172.21.15.6:0/1742421253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3e80c8ad0 0x7fb3e80c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.426+0000 7fb3ec895640 1 -- 172.21.15.6:0/1742421253 >> v1:172.21.15.6:6789/0 conn(0x7fb3e80c9560 legacy=0x7fb3e80cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.426+0000 7fb3ec895640 1 -- 172.21.15.6:0/1742421253 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e8070c80 con 0x7fb3e8158ce0 2023-07-21T22:34:56.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.430+0000 7fb3ec895640 1 --2- 172.21.15.6:0/1742421253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3e8158ce0 0x7fb3e8070450 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0097c0 tx=0x7fb3dc01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26bdf53a67a0306 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:56.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.430+0000 7fb3e77fe640 1 -- 172.21.15.6:0/1742421253 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e80cba20 con 0x7fb3e8158ce0 2023-07-21T22:34:56.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.430+0000 7fb3e77fe640 1 -- 172.21.15.6:0/1742421253 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3dc0a7050 con 0x7fb3e8158ce0 2023-07-21T22:34:56.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.430+0000 7fb3e77fe640 1 -- 172.21.15.6:0/1742421253 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc0ab820 con 0x7fb3e8158ce0 2023-07-21T22:34:56.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.430+0000 7fb3eeaf9640 1 -- 172.21.15.6:0/1742421253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3e8158ce0 msgr2=0x7fb3e8070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:56.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.430+0000 7fb3eeaf9640 1 --2- 172.21.15.6:0/1742421253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3e8158ce0 0x7fb3e8070450 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0097c0 tx=0x7fb3dc01c330 comp rx=0 tx=0).stop 2023-07-21T22:34:56.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.430+0000 7fb3eeaf9640 1 -- 172.21.15.6:0/1742421253 shutdown_connections 2023-07-21T22:34:56.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.430+0000 7fb3eeaf9640 1 --2- 172.21.15.6:0/1742421253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3e80c8ad0 0x7fb3e80c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:56.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.430+0000 7fb3eeaf9640 1 --2- 172.21.15.6:0/1742421253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3e8158ce0 0x7fb3e8070450 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:56.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.430+0000 7fb3eeaf9640 1 -- 172.21.15.6:0/1742421253 >> 172.21.15.6:0/1742421253 conn(0x7fb3e80afcf0 msgr2=0x7fb3e80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:56.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.430+0000 7fb3eeaf9640 1 -- 172.21.15.6:0/1742421253 shutdown_connections 2023-07-21T22:34:56.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.430+0000 7fb3eeaf9640 1 -- 172.21.15.6:0/1742421253 wait complete. 2023-07-21T22:34:56.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.430+0000 7fb3eeaf9640 1 Processor -- start 2023-07-21T22:34:56.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.430+0000 7fb3eeaf9640 1 -- start start 2023-07-21T22:34:56.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3eeaf9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3e80c8ad0 0x7fb3e8151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3eeaf9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3e80c9560 0x7fb3e80c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3eeaf9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3e8158ce0 0x7fb3e80c1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3eeaf9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e815afe0 con 0x7fb3e8158ce0 2023-07-21T22:34:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3eeaf9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e815a3d0 con 0x7fb3e80c9560 2023-07-21T22:34:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3eeaf9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e815a6b0 con 0x7fb3e80c8ad0 2023-07-21T22:34:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3ed096640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3e8158ce0 0x7fb3e80c1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:56.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3ed096640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3e8158ce0 0x7fb3e80c1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46110/0 (socket says 172.21.15.6:46110) 2023-07-21T22:34:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3ec895640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3e80c8ad0 0x7fb3e8151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3ed096640 1 -- 172.21.15.6:0/3734273444 learned_addr learned my addr 172.21.15.6:0/3734273444 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3e7fff640 1 --2- 172.21.15.6:0/3734273444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3e80c9560 0x7fb3e80c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3ed096640 1 -- 172.21.15.6:0/3734273444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3e80c8ad0 msgr2=0x7fb3e8151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3ed096640 1 --2- 172.21.15.6:0/3734273444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3e80c8ad0 0x7fb3e8151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3ed096640 1 -- 172.21.15.6:0/3734273444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3e80c9560 msgr2=0x7fb3e80c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3ed096640 1 --2- 172.21.15.6:0/3734273444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3e80c9560 0x7fb3e80c4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3ed096640 1 -- 172.21.15.6:0/3734273444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc009420 con 0x7fb3e8158ce0 2023-07-21T22:34:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3ed096640 1 --2- 172.21.15.6:0/3734273444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3e8158ce0 0x7fb3e80c1f70 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000caa0 tx=0x7fb3e000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3e57fa640 1 -- 172.21.15.6:0/3734273444 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e000ac00 con 0x7fb3e8158ce0 2023-07-21T22:34:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3e57fa640 1 -- 172.21.15.6:0/3734273444 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e000ad60 con 0x7fb3e8158ce0 2023-07-21T22:34:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3e57fa640 1 -- 172.21.15.6:0/3734273444 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0012620 con 0x7fb3e8158ce0 2023-07-21T22:34:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3eeaf9640 1 -- 172.21.15.6:0/3734273444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e815a990 con 0x7fb3e8158ce0 2023-07-21T22:34:56.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3eeaf9640 1 -- 172.21.15.6:0/3734273444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e8151660 con 0x7fb3e8158ce0 2023-07-21T22:34:56.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3eeaf9640 1 -- 172.21.15.6:0/3734273444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e80ca1a0 con 0x7fb3e8158ce0 2023-07-21T22:34:56.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.434+0000 7fb3e57fa640 1 -- 172.21.15.6:0/3734273444 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb3e0007070 con 0x7fb3e8158ce0 2023-07-21T22:34:56.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.438+0000 7fb3e57fa640 1 --2- 172.21.15.6:0/3734273444 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fb3cc0663d0 0x7fb3cc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:56.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.438+0000 7fb3e57fa640 1 -- 172.21.15.6:0/3734273444 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6071+0+0 (secure 0 0 0) 0x7fb3e0083dd0 con 0x7fb3e8158ce0 2023-07-21T22:34:56.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.438+0000 7fb3ec895640 1 --2- 172.21.15.6:0/3734273444 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fb3cc0663d0 0x7fb3cc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:56.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.438+0000 7fb3ec895640 1 --2- 172.21.15.6:0/3734273444 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fb3cc0663d0 0x7fb3cc068880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0ad000 tx=0x7fb3dc0a6000 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:56.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.442+0000 7fb3e57fa640 1 -- 172.21.15.6:0/3734273444 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb3e0051140 con 0x7fb3e8158ce0 2023-07-21T22:34:56.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.630+0000 7fb3eeaf9640 1 -- 172.21.15.6:0/3734273444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3e80c1c90 con 0x7fb3e8158ce0 2023-07-21T22:34:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.630+0000 7fb3e57fa640 1 -- 172.21.15.6:0/3734273444 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3520 (secure 0 0 0) 0x7fb3e0017dd0 con 0x7fb3e8158ce0 2023-07-21T22:34:56.681 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:56.681 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5960,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1945082031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1945082031},{"type":"v1","addr":"172.21.15.6:6835","nonce":1945082031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5963,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/778272832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":778272832},{"type":"v1","addr":"172.21.15.161:6836","nonce":778272832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/728409440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":728409440},{"type":"v1","addr":"172.21.15.161:6837","nonce":728409440}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":7047,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/778834964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":778834964},{"type":"v1","addr":"172.21.15.6:6833","nonce":778834964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[]} 2023-07-21T22:34:56.682 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 34 2023-07-21T22:34:56.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.630+0000 7fb3eeaf9640 1 -- 172.21.15.6:0/3734273444 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fb3cc0663d0 msgr2=0x7fb3cc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:56.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.630+0000 7fb3eeaf9640 1 --2- 172.21.15.6:0/3734273444 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fb3cc0663d0 0x7fb3cc068880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0ad000 tx=0x7fb3dc0a6000 comp rx=0 tx=0).stop 2023-07-21T22:34:56.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.630+0000 7fb3eeaf9640 1 -- 172.21.15.6:0/3734273444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3e8158ce0 msgr2=0x7fb3e80c1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:56.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.630+0000 7fb3eeaf9640 1 --2- 172.21.15.6:0/3734273444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3e8158ce0 0x7fb3e80c1f70 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000caa0 tx=0x7fb3e000cf60 comp rx=0 tx=0).stop 2023-07-21T22:34:56.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.630+0000 7fb3eeaf9640 1 -- 172.21.15.6:0/3734273444 shutdown_connections 2023-07-21T22:34:56.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.630+0000 7fb3eeaf9640 1 --2- 172.21.15.6:0/3734273444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3e8158ce0 0x7fb3e80c1f70 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:56.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.630+0000 7fb3eeaf9640 1 --2- 172.21.15.6:0/3734273444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3e80c9560 0x7fb3e80c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:56.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.630+0000 7fb3eeaf9640 1 --2- 172.21.15.6:0/3734273444 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fb3cc0663d0 0x7fb3cc068880 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:56.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.630+0000 7fb3eeaf9640 1 --2- 172.21.15.6:0/3734273444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3e80c8ad0 0x7fb3e8151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:56.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.630+0000 7fb3eeaf9640 1 -- 172.21.15.6:0/3734273444 >> 172.21.15.6:0/3734273444 conn(0x7fb3e80afcf0 msgr2=0x7fb3e806f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:56.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.630+0000 7fb3eeaf9640 1 -- 172.21.15.6:0/3734273444 shutdown_connections 2023-07-21T22:34:56.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.630+0000 7fb3eeaf9640 1 -- 172.21.15.6:0/3734273444 wait complete. 2023-07-21T22:34:56.702 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-21T22:34:56.702 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-21T22:34:56.702 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-21T22:34:56.703 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:34:56.703 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-21T22:34:56.703 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-21T22:34:56.703 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-21T22:34:56.704 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:34:56.704 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-21T22:34:56.704 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-21T22:34:56.704 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-21T22:34:56.704 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:34:56.705 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-21T22:34:56.705 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-21T22:34:56.705 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-21T22:34:56.705 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:34:56.715 INFO:tasks.ceph.mds.a:Stopped 2023-07-21T22:34:56.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-21T22:34:56.718 INFO:tasks.ceph.mds.c:Stopped 2023-07-21T22:34:56.718 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-21T22:34:56.724 INFO:tasks.ceph.mds.d:Stopped 2023-07-21T22:34:56.725 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-21T22:34:56.725 INFO:tasks.ceph.mds.b:Stopped 2023-07-21T22:34:56.726 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-21T22:34:56.765 INFO:tasks.ceph.mds.a:Started 2023-07-21T22:34:56.766 DEBUG:teuthology.parallel:result is None 2023-07-21T22:34:56.768 INFO:tasks.ceph.mds.c:Started 2023-07-21T22:34:56.768 DEBUG:teuthology.parallel:result is None 2023-07-21T22:34:56.775 INFO:tasks.ceph.mds.d:Started 2023-07-21T22:34:56.775 DEBUG:teuthology.parallel:result is None 2023-07-21T22:34:56.777 INFO:tasks.ceph.mds.b:Started 2023-07-21T22:34:56.777 DEBUG:teuthology.parallel:result is None 2023-07-21T22:34:56.778 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-21T22:34:56.854 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-07-21T22:34:56.856 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-21T22:34:56.868 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-07-21T22:34:56.868 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2023-07-21T22:34:56.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.874+0000 7f9787574640 1 Processor -- start 2023-07-21T22:34:56.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.874+0000 7f9787574640 1 -- start start 2023-07-21T22:34:56.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.878+0000 7f9787574640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f978014f200 0x7f9780069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:56.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.878+0000 7f9787574640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f97800adab0 0x7f97800adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:56.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.878+0000 7f9787574640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97800ae450 con 0x7f97800b24c0 2023-07-21T22:34:56.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.878+0000 7f9787574640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978014f5d0 con 0x7f978014f200 2023-07-21T22:34:56.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.878+0000 7f9787574640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978006c0c0 con 0x7f97800adab0 2023-07-21T22:34:56.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.878+0000 7f9785310640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f978014f200 0x7f9780069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:56.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.878+0000 7f9785310640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f978014f200 0x7f9780069430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46148/0 (socket says 172.21.15.6:46148) 2023-07-21T22:34:56.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.878+0000 7f9785310640 1 -- 172.21.15.6:0/1952141468 learned_addr learned my addr 172.21.15.6:0/1952141468 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:56.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.878+0000 7f9784b0f640 1 --2- 172.21.15.6:0/1952141468 >> v2:172.21.15.161:3300/0 conn(0x7f97800adab0 0x7f97800adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:56.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.878+0000 7f9785310640 1 -- 172.21.15.6:0/1952141468 >> v2:172.21.15.161:3300/0 conn(0x7f97800adab0 msgr2=0x7f97800adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:56.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.878+0000 7f9785310640 1 --2- 172.21.15.6:0/1952141468 >> v2:172.21.15.161:3300/0 conn(0x7f97800adab0 0x7f97800adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:56.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.878+0000 7f9785310640 1 -- 172.21.15.6:0/1952141468 >> v1:172.21.15.161:6789/0 conn(0x7f97800b24c0 legacy=0x7f97800b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:56.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.878+0000 7f9785310640 1 -- 172.21.15.6:0/1952141468 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978006bdc0 con 0x7f978014f200 2023-07-21T22:34:56.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.878+0000 7f9784b0f640 1 --2- 172.21.15.6:0/1952141468 >> v2:172.21.15.161:3300/0 conn(0x7f97800adab0 0x7f97800adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:56.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.882+0000 7f9785310640 1 --2- 172.21.15.6:0/1952141468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f978014f200 0x7f9780069430 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f97800b1f90 tx=0x7f977c01eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26452a167488588f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:56.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.882+0000 7f9777fff640 1 -- 172.21.15.6:0/1952141468 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c0a7be0 con 0x7f978014f200 2023-07-21T22:34:56.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.882+0000 7f9777fff640 1 -- 172.21.15.6:0/1952141468 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977c0a7d40 con 0x7f978014f200 2023-07-21T22:34:56.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.882+0000 7f9777fff640 1 -- 172.21.15.6:0/1952141468 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c0af660 con 0x7f978014f200 2023-07-21T22:34:56.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.882+0000 7f9787574640 1 -- 172.21.15.6:0/1952141468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f978014f200 msgr2=0x7f9780069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:56.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.882+0000 7f9787574640 1 --2- 172.21.15.6:0/1952141468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f978014f200 0x7f9780069430 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f97800b1f90 tx=0x7f977c01eb90 comp rx=0 tx=0).stop 2023-07-21T22:34:56.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.882+0000 7f9787574640 1 -- 172.21.15.6:0/1952141468 shutdown_connections 2023-07-21T22:34:56.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.882+0000 7f9787574640 1 --2- 172.21.15.6:0/1952141468 >> v2:172.21.15.161:3300/0 conn(0x7f97800adab0 0x7f97800adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:56.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.882+0000 7f9787574640 1 --2- 172.21.15.6:0/1952141468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f978014f200 0x7f9780069430 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:56.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.882+0000 7f9787574640 1 -- 172.21.15.6:0/1952141468 >> 172.21.15.6:0/1952141468 conn(0x7f97800b1300 msgr2=0x7f97800ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:56.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.882+0000 7f9787574640 1 -- 172.21.15.6:0/1952141468 shutdown_connections 2023-07-21T22:34:56.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.882+0000 7f9787574640 1 -- 172.21.15.6:0/1952141468 wait complete. 2023-07-21T22:34:56.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.882+0000 7f9787574640 1 Processor -- start 2023-07-21T22:34:56.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.882+0000 7f9787574640 1 -- start start 2023-07-21T22:34:56.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9787574640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97800adab0 0x7f978014b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:56.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9787574640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97800b24c0 0x7f978006cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:56.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9787574640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f978014f200 0x7f978006d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:56.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9787574640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9780154430 con 0x7f97800adab0 2023-07-21T22:34:56.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9787574640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9780150ea0 con 0x7f97800b24c0 2023-07-21T22:34:56.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9787574640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9780150b70 con 0x7f978014f200 2023-07-21T22:34:56.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9785310640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97800adab0 0x7f978014b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:56.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9785310640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97800adab0 0x7f978014b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46160/0 (socket says 172.21.15.6:46160) 2023-07-21T22:34:56.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9785310640 1 -- 172.21.15.6:0/687088759 learned_addr learned my addr 172.21.15.6:0/687088759 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:56.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9785b11640 1 --2- 172.21.15.6:0/687088759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f978014f200 0x7f978006d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:56.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9784b0f640 1 --2- 172.21.15.6:0/687088759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97800b24c0 0x7f978006cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9785310640 1 -- 172.21.15.6:0/687088759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f978014f200 msgr2=0x7f978006d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9785310640 1 --2- 172.21.15.6:0/687088759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f978014f200 0x7f978006d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9785310640 1 -- 172.21.15.6:0/687088759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97800b24c0 msgr2=0x7f978006cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9785310640 1 --2- 172.21.15.6:0/687088759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97800b24c0 0x7f978006cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:56.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9785310640 1 -- 172.21.15.6:0/687088759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c00b770 con 0x7f97800adab0 2023-07-21T22:34:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9785310640 1 --2- 172.21.15.6:0/687088759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97800adab0 0x7f978014b780 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f977c01c7c0 tx=0x7f977c01b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9775ffb640 1 -- 172.21.15.6:0/687088759 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c0ba640 con 0x7f97800adab0 2023-07-21T22:34:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9775ffb640 1 -- 172.21.15.6:0/687088759 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977c0ba7c0 con 0x7f97800adab0 2023-07-21T22:34:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9775ffb640 1 -- 172.21.15.6:0/687088759 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c0bab70 con 0x7f97800adab0 2023-07-21T22:34:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9787574640 1 -- 172.21.15.6:0/687088759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978014bcc0 con 0x7f97800adab0 2023-07-21T22:34:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9787574640 1 -- 172.21.15.6:0/687088759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9780153e70 con 0x7f97800adab0 2023-07-21T22:34:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.886+0000 7f9787574640 1 -- 172.21.15.6:0/687088759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97800678d0 con 0x7f97800adab0 2023-07-21T22:34:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.890+0000 7f9775ffb640 1 -- 172.21.15.6:0/687088759 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f977c0b6040 con 0x7f97800adab0 2023-07-21T22:34:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.890+0000 7f9775ffb640 1 --2- 172.21.15.6:0/687088759 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f97640663d0 0x7f9764068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.890+0000 7f9775ffb640 1 -- 172.21.15.6:0/687088759 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6071+0+0 (secure 0 0 0) 0x7f977c121220 con 0x7f97800adab0 2023-07-21T22:34:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.890+0000 7f9784b0f640 1 --2- 172.21.15.6:0/687088759 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f97640663d0 0x7f9764068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.890+0000 7f9784b0f640 1 --2- 172.21.15.6:0/687088759 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f97640663d0 0x7f9764068880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f97801547f0 tx=0x7f9770008040 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:56.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:56.894+0000 7f9775ffb640 1 -- 172.21.15.6:0/687088759 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f977c0ee590 con 0x7f97800adab0 2023-07-21T22:34:57.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:57.066+0000 7f9787574640 1 -- 172.21.15.6:0/687088759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f97800678d0 con 0x7f97800adab0 2023-07-21T22:34:58.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.058+0000 7f9775ffb640 1 -- 172.21.15.6:0/687088759 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v94) v1 ==== 97+0+0 (secure 0 0 0) 0x7f977c0f1bb0 con 0x7f97800adab0 2023-07-21T22:34:58.108 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-07-21T22:34:58.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.062+0000 7f9787574640 1 -- 172.21.15.6:0/687088759 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f97640663d0 msgr2=0x7f9764068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:58.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.062+0000 7f9787574640 1 --2- 172.21.15.6:0/687088759 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f97640663d0 0x7f9764068880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f97801547f0 tx=0x7f9770008040 comp rx=0 tx=0).stop 2023-07-21T22:34:58.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.062+0000 7f9787574640 1 -- 172.21.15.6:0/687088759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97800adab0 msgr2=0x7f978014b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:58.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.062+0000 7f9787574640 1 --2- 172.21.15.6:0/687088759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97800adab0 0x7f978014b780 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f977c01c7c0 tx=0x7f977c01b930 comp rx=0 tx=0).stop 2023-07-21T22:34:58.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.062+0000 7f9787574640 1 -- 172.21.15.6:0/687088759 shutdown_connections 2023-07-21T22:34:58.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.062+0000 7f9787574640 1 --2- 172.21.15.6:0/687088759 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f97640663d0 0x7f9764068880 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.062+0000 7f9787574640 1 --2- 172.21.15.6:0/687088759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f978014f200 0x7f978006d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.062+0000 7f9787574640 1 --2- 172.21.15.6:0/687088759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97800b24c0 0x7f978006cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.062+0000 7f9787574640 1 --2- 172.21.15.6:0/687088759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97800adab0 0x7f978014b780 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.062+0000 7f9787574640 1 -- 172.21.15.6:0/687088759 >> 172.21.15.6:0/687088759 conn(0x7f97800b1300 msgr2=0x7f97800aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:58.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.062+0000 7f9787574640 1 -- 172.21.15.6:0/687088759 shutdown_connections 2023-07-21T22:34:58.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.062+0000 7f9787574640 1 -- 172.21.15.6:0/687088759 wait complete. 2023-07-21T22:34:58.134 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-21T22:34:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.234+0000 7fb2bcc76640 1 Processor -- start 2023-07-21T22:34:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.234+0000 7fb2bcc76640 1 -- start start 2023-07-21T22:34:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.234+0000 7fb2bcc76640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2b80b42c0 0x7fb2b806a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.234+0000 7fb2bcc76640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb2b80cee90 0x7fb2b80d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.234+0000 7fb2bcc76640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b80cf310 con 0x7fb2b80b7a10 2023-07-21T22:34:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.234+0000 7fb2bcc76640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b80cff30 con 0x7fb2b80cee90 2023-07-21T22:34:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.234+0000 7fb2bcc76640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b80ccee0 con 0x7fb2b80b42c0 2023-07-21T22:34:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.234+0000 7fb2b7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb2b80cee90 0x7fb2b80d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.234+0000 7fb2b77fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb2b80b7a10 0x7fb2b80b3bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59792/0 (socket says 172.21.15.6:59792) 2023-07-21T22:34:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.234+0000 7fb2b77fe640 1 -- 172.21.15.6:0/1575731401 learned_addr learned my addr 172.21.15.6:0/1575731401 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:58.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.234+0000 7fb2b6ffd640 1 --2- 172.21.15.6:0/1575731401 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2b80b42c0 0x7fb2b806a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:58.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.234+0000 7fb2b7fff640 1 -- 172.21.15.6:0/1575731401 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2b80b42c0 msgr2=0x7fb2b806a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:58.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.234+0000 7fb2b7fff640 1 --2- 172.21.15.6:0/1575731401 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2b80b42c0 0x7fb2b806a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.234+0000 7fb2b7fff640 1 -- 172.21.15.6:0/1575731401 >> v1:172.21.15.6:6789/0 conn(0x7fb2b80b7a10 legacy=0x7fb2b80b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:58.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.234+0000 7fb2b7fff640 1 -- 172.21.15.6:0/1575731401 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b80cc920 con 0x7fb2b80cee90 2023-07-21T22:34:58.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.234+0000 7fb2b67fc640 1 -- 172.21.15.6:0/1575731401 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249095420 0 0) 0x7fb2b80cf310 con 0x7fb2b80b7a10 2023-07-21T22:34:58.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.234+0000 7fb2b6ffd640 1 --2- 172.21.15.6:0/1575731401 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2b80b42c0 0x7fb2b806a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:58.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.238+0000 7fb2b7fff640 1 --2- 172.21.15.6:0/1575731401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b80cee90 0x7fb2b80d0380 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0009d90 tx=0x7fb2b001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37fbdb188feb9b4e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:58.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.238+0000 7fb2b67fc640 1 -- 172.21.15.6:0/1575731401 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b00a5a00 con 0x7fb2b80cee90 2023-07-21T22:34:58.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.238+0000 7fb2b67fc640 1 -- 172.21.15.6:0/1575731401 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b00a5b60 con 0x7fb2b80cee90 2023-07-21T22:34:58.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.238+0000 7fb2b67fc640 1 -- 172.21.15.6:0/1575731401 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b00ad440 con 0x7fb2b80cee90 2023-07-21T22:34:58.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.238+0000 7fb2bcc76640 1 -- 172.21.15.6:0/1575731401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b80cee90 msgr2=0x7fb2b80d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:58.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.238+0000 7fb2bcc76640 1 --2- 172.21.15.6:0/1575731401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b80cee90 0x7fb2b80d0380 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0009d90 tx=0x7fb2b001c920 comp rx=0 tx=0).stop 2023-07-21T22:34:58.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.238+0000 7fb2bcc76640 1 -- 172.21.15.6:0/1575731401 shutdown_connections 2023-07-21T22:34:58.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.238+0000 7fb2bcc76640 1 --2- 172.21.15.6:0/1575731401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b80cee90 0x7fb2b80d0380 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.238+0000 7fb2bcc76640 1 --2- 172.21.15.6:0/1575731401 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2b80b42c0 0x7fb2b806a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.238+0000 7fb2bcc76640 1 -- 172.21.15.6:0/1575731401 >> 172.21.15.6:0/1575731401 conn(0x7fb2b8069ea0 msgr2=0x7fb2b806a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:58.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.238+0000 7fb2bcc76640 1 -- 172.21.15.6:0/1575731401 shutdown_connections 2023-07-21T22:34:58.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.238+0000 7fb2bcc76640 1 -- 172.21.15.6:0/1575731401 wait complete. 2023-07-21T22:34:58.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.238+0000 7fb2bcc76640 1 Processor -- start 2023-07-21T22:34:58.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2bcc76640 1 -- start start 2023-07-21T22:34:58.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2bcc76640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b80b42c0 0x7fb2b80c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:58.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2bcc76640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2b80b7a10 0x7fb2b80b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:58.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2bcc76640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2b80cee90 0x7fb2b814f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:58.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2bcc76640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b80b40b0 con 0x7fb2b80b42c0 2023-07-21T22:34:58.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2bcc76640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b80ca6e0 con 0x7fb2b80b7a10 2023-07-21T22:34:58.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2bcc76640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b80b3010 con 0x7fb2b80cee90 2023-07-21T22:34:58.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2b77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b80b42c0 0x7fb2b80c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:58.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2b77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b80b42c0 0x7fb2b80c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34448/0 (socket says 172.21.15.6:34448) 2023-07-21T22:34:58.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2b77fe640 1 -- 172.21.15.6:0/2983677022 learned_addr learned my addr 172.21.15.6:0/2983677022 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:58.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2b7fff640 1 --2- 172.21.15.6:0/2983677022 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2b80cee90 0x7fb2b814f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:58.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2b6ffd640 1 --2- 172.21.15.6:0/2983677022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2b80b7a10 0x7fb2b80b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:58.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2b77fe640 1 -- 172.21.15.6:0/2983677022 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2b80cee90 msgr2=0x7fb2b814f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:58.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2b77fe640 1 --2- 172.21.15.6:0/2983677022 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2b80cee90 0x7fb2b814f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2b77fe640 1 -- 172.21.15.6:0/2983677022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2b80b7a10 msgr2=0x7fb2b80b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:58.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2b77fe640 1 --2- 172.21.15.6:0/2983677022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2b80b7a10 0x7fb2b80b60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2b77fe640 1 -- 172.21.15.6:0/2983677022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b0009a70 con 0x7fb2b80b42c0 2023-07-21T22:34:58.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2b6ffd640 1 --2- 172.21.15.6:0/2983677022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2b80b7a10 0x7fb2b80b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2b7fff640 1 --2- 172.21.15.6:0/2983677022 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2b80cee90 0x7fb2b814f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:34:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2b77fe640 1 --2- 172.21.15.6:0/2983677022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b80b42c0 0x7fb2b80c9bc0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80011f0 tx=0x7fb2a800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:58.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb29ffff640 1 -- 172.21.15.6:0/2983677022 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a80074e0 con 0x7fb2b80b42c0 2023-07-21T22:34:58.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb29ffff640 1 -- 172.21.15.6:0/2983677022 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a8007640 con 0x7fb2b80b42c0 2023-07-21T22:34:58.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb29ffff640 1 -- 172.21.15.6:0/2983677022 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8004a10 con 0x7fb2b80b42c0 2023-07-21T22:34:58.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2bcc76640 1 -- 172.21.15.6:0/2983677022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b80b32f0 con 0x7fb2b80b42c0 2023-07-21T22:34:58.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2bcc76640 1 -- 172.21.15.6:0/2983677022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b80b38b0 con 0x7fb2b80b42c0 2023-07-21T22:34:58.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.242+0000 7fb2bcc76640 1 -- 172.21.15.6:0/2983677022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b80678d0 con 0x7fb2b80b42c0 2023-07-21T22:34:58.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.246+0000 7fb29ffff640 1 -- 172.21.15.6:0/2983677022 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb2a8004b70 con 0x7fb2b80b42c0 2023-07-21T22:34:58.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.246+0000 7fb29ffff640 1 --2- 172.21.15.6:0/2983677022 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fb2a40663a0 0x7fb2a4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:58.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.246+0000 7fb29ffff640 1 -- 172.21.15.6:0/2983677022 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5254+0+0 (secure 0 0 0) 0x7fb2a8082ed0 con 0x7fb2b80b42c0 2023-07-21T22:34:58.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.246+0000 7fb2b6ffd640 1 --2- 172.21.15.6:0/2983677022 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fb2a40663a0 0x7fb2a4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:58.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.246+0000 7fb2b6ffd640 1 --2- 172.21.15.6:0/2983677022 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fb2a40663a0 0x7fb2a4068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8159d00 tx=0x7fb2ac008040 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:58.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.250+0000 7fb29ffff640 1 -- 172.21.15.6:0/2983677022 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb2a80504c0 con 0x7fb2b80b42c0 2023-07-21T22:34:58.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.458+0000 7fb2bcc76640 1 -- 172.21.15.6:0/2983677022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb2b80b7ee0 con 0x7fb2b80b42c0 2023-07-21T22:34:58.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.458+0000 7fb29ffff640 1 -- 172.21.15.6:0/2983677022 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb2a8018070 con 0x7fb2b80b42c0 2023-07-21T22:34:58.510 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:58.510 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:34:58.510 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-07-21T22:34:58.510 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:58.510 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-07-21T22:34:58.510 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkHn5HNxAADk0AaSGwZfEj3SwNvEm8hw==", 2023-07-21T22:34:58.510 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:58.511 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:34:58.511 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:34:58.511 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:34:58.511 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:58.511 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:58.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:58.511 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:58.512 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-07-21T22:34:58.512 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkQFvXCBAANxf0/I2RQcHy4iYiydjkcg==", 2023-07-21T22:34:58.512 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:58.512 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:34:58.512 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:34:58.512 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:34:58.512 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:58.512 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:58.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:58.513 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:58.513 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-07-21T22:34:58.513 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkYtGXAxAAy+RDDBSvc1FeZq+eg23tRA==", 2023-07-21T22:34:58.513 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:58.513 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:34:58.513 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:34:58.513 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:34:58.514 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:58.514 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:58.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:58.514 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:58.514 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-07-21T22:34:58.514 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkH+Y1EBAAl+qTqd+gFrB9LtJWwD5dgA==", 2023-07-21T22:34:58.514 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:58.514 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:34:58.515 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:34:58.515 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:34:58.515 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:58.515 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:58.515 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:58.515 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:58.515 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-07-21T22:34:58.515 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAKBLtkPwZrLBAAQHZECi2zHST1MKYgGoa/Iw==", 2023-07-21T22:34:58.516 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:58.516 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:34:58.516 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:34:58.516 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:58.516 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:58.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:58.516 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:58.517 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-07-21T22:34:58.517 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQANBLtkvwgwNBAApurMm8c3pSlX2r16Gli/Ag==", 2023-07-21T22:34:58.517 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:58.517 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:34:58.517 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:34:58.517 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:58.517 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:58.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:58.518 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:58.518 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-07-21T22:34:58.518 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAQBLtkf2p1OxAAcKYw2RixFefYAwcfkGnOKQ==", 2023-07-21T22:34:58.518 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:58.518 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:34:58.518 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:34:58.518 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:58.518 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:58.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:58.519 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:58.519 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-07-21T22:34:58.519 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAUBLtkQUl6BhAAXXT1ZK1h9aZEcp6qIHsLiA==", 2023-07-21T22:34:58.519 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:58.519 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:34:58.519 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:34:58.519 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:58.520 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:58.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:58.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:58.520 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-07-21T22:34:58.520 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAaBLtkc1VfExAAPzDz2k/c0qVePG9h1saQCw==", 2023-07-21T22:34:58.520 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:58.520 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:34:58.521 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:34:58.521 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:58.521 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:58.521 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:58.521 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:58.521 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-07-21T22:34:58.521 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAdBLtkJ6fcGhAAglVSJIQS04WYBv4APhl57g==", 2023-07-21T22:34:58.521 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:58.522 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:34:58.522 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:34:58.522 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:58.522 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:58.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:58.522 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:58.522 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-07-21T22:34:58.522 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAgBLtkPINGIRAAWKs1RNQIdhZYlDAzDgUkNw==", 2023-07-21T22:34:58.523 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:58.523 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:34:58.523 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:34:58.523 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:58.523 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:58.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:58.523 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:58.523 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-07-21T22:34:58.524 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAjBLtk83MCKBAAZH2NhMBphVv4QkRzy+NDgg==", 2023-07-21T22:34:58.524 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:58.524 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:34:58.524 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:34:58.524 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:58.524 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:58.524 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:58.524 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:58.525 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-07-21T22:34:58.525 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA==", 2023-07-21T22:34:58.525 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:58.525 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:34:58.525 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-07-21T22:34:58.525 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-21T22:34:58.525 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:58.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:58.526 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:58.526 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-07-21T22:34:58.526 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkPVXTHhAAYmkzwAvqsfrowpAucTnlUQ==", 2023-07-21T22:34:58.526 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:58.526 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:34:58.526 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:34:58.526 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:34:58.527 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:34:58.527 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:58.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:58.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:58.527 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-07-21T22:34:58.527 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkd7wSGxAArvSYwe+k48vgRzb3fQAEAQ==", 2023-07-21T22:34:58.527 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:58.527 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:34:58.528 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:34:58.528 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:34:58.528 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:34:58.528 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:58.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:58.528 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:58.529 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-07-21T22:34:58.529 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkoZ4YJRAAX4yh0Q1pR4wY7yEV6kg9QA==", 2023-07-21T22:34:58.529 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:58.529 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:34:58.529 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:34:58.529 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:34:58.529 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:34:58.529 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:58.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:58.530 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:58.530 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-07-21T22:34:58.530 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtk0ILFGhAAQZ+8lGNFVdOtZYOuLlfkoQ==", 2023-07-21T22:34:58.530 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:58.530 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:34:58.530 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:34:58.531 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:34:58.531 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:58.531 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:58.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:58.531 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:58.531 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-07-21T22:34:58.531 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkdobtMhAAQbwi3cvsrW9P0t3d52oEKw==", 2023-07-21T22:34:58.532 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:58.532 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:34:58.532 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T22:34:58.532 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:58.532 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:58.532 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:58.532 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:58.532 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-07-21T22:34:58.533 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkHhzpLhAAZTx4Vrc0Htk88104SzuAxQ==", 2023-07-21T22:34:58.533 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:34:58.533 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:34:58.533 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T22:34:58.533 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:34:58.533 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:58.533 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:58.533 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-07-21T22:34:58.534 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:34:58.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.462+0000 7fb2bcc76640 1 -- 172.21.15.6:0/2983677022 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fb2a40663a0 msgr2=0x7fb2a4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:58.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.462+0000 7fb2bcc76640 1 --2- 172.21.15.6:0/2983677022 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fb2a40663a0 0x7fb2a4068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8159d00 tx=0x7fb2ac008040 comp rx=0 tx=0).stop 2023-07-21T22:34:58.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.462+0000 7fb2bcc76640 1 -- 172.21.15.6:0/2983677022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b80b42c0 msgr2=0x7fb2b80c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:58.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.462+0000 7fb2bcc76640 1 --2- 172.21.15.6:0/2983677022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b80b42c0 0x7fb2b80c9bc0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fb2a80011f0 tx=0x7fb2a800c9b0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.462+0000 7fb2bcc76640 1 -- 172.21.15.6:0/2983677022 shutdown_connections 2023-07-21T22:34:58.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.462+0000 7fb2bcc76640 1 --2- 172.21.15.6:0/2983677022 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fb2a40663a0 0x7fb2a4068850 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.462+0000 7fb2bcc76640 1 --2- 172.21.15.6:0/2983677022 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2b80cee90 0x7fb2b814f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.462+0000 7fb2bcc76640 1 --2- 172.21.15.6:0/2983677022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2b80b7a10 0x7fb2b80b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.462+0000 7fb2bcc76640 1 --2- 172.21.15.6:0/2983677022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2b80b42c0 0x7fb2b80c9bc0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.462+0000 7fb2bcc76640 1 -- 172.21.15.6:0/2983677022 >> 172.21.15.6:0/2983677022 conn(0x7fb2b8069ea0 msgr2=0x7fb2b80b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:58.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.462+0000 7fb2bcc76640 1 -- 172.21.15.6:0/2983677022 shutdown_connections 2023-07-21T22:34:58.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.462+0000 7fb2bcc76640 1 -- 172.21.15.6:0/2983677022 wait complete. 2023-07-21T22:34:58.537 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:34:58.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.630+0000 7f32085fa640 1 Processor -- start 2023-07-21T22:34:58.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.630+0000 7f32085fa640 1 -- start start 2023-07-21T22:34:58.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.630+0000 7f32085fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3200158ce0 0x7f3200070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:58.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.630+0000 7f32085fa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f32000c8ad0 0x7f32000c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:58.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.630+0000 7f32085fa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32000cc700 con 0x7f32000c9560 2023-07-21T22:34:58.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.630+0000 7f32085fa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32000c99e0 con 0x7f32000c8ad0 2023-07-21T22:34:58.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.630+0000 7f32085fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32000b0ff0 con 0x7f3200158ce0 2023-07-21T22:34:58.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.634+0000 7f3205b95640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f32000c8ad0 0x7f32000c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:58.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.634+0000 7f3206b97640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f32000c9560 0x7f32000cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:36410/0 (socket says 172.21.15.6:36410) 2023-07-21T22:34:58.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.634+0000 7f3206b97640 1 -- 172.21.15.6:0/2030453374 learned_addr learned my addr 172.21.15.6:0/2030453374 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:58.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.634+0000 7f3206396640 1 --2- 172.21.15.6:0/2030453374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3200158ce0 0x7f3200070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:58.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.634+0000 7f3205b95640 1 -- 172.21.15.6:0/2030453374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3200158ce0 msgr2=0x7f3200070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:58.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.634+0000 7f3205b95640 1 --2- 172.21.15.6:0/2030453374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3200158ce0 0x7f3200070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.634+0000 7f3205b95640 1 -- 172.21.15.6:0/2030453374 >> v1:172.21.15.161:6789/0 conn(0x7f32000c9560 legacy=0x7f32000cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:58.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.634+0000 7f3205b95640 1 -- 172.21.15.6:0/2030453374 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3200070c80 con 0x7f32000c8ad0 2023-07-21T22:34:58.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.634+0000 7f3205394640 1 -- 172.21.15.6:0/2030453374 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444088472 0 0) 0x7f32000cc700 con 0x7f32000c9560 2023-07-21T22:34:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.634+0000 7f3205b95640 1 --2- 172.21.15.6:0/2030453374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32000c8ad0 0x7f32000c9020 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f31f00097c0 tx=0x7f31f001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=444cfa94a27bb915 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:58.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f3205394640 1 -- 172.21.15.6:0/2030453374 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32000cba20 con 0x7f32000c8ad0 2023-07-21T22:34:58.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f3205394640 1 -- 172.21.15.6:0/2030453374 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f00a7050 con 0x7f32000c8ad0 2023-07-21T22:34:58.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f3205394640 1 -- 172.21.15.6:0/2030453374 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f00ab820 con 0x7f32000c8ad0 2023-07-21T22:34:58.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f32085fa640 1 -- 172.21.15.6:0/2030453374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32000c8ad0 msgr2=0x7f32000c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:58.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f32085fa640 1 --2- 172.21.15.6:0/2030453374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32000c8ad0 0x7f32000c9020 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f31f00097c0 tx=0x7f31f001c330 comp rx=0 tx=0).stop 2023-07-21T22:34:58.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f32085fa640 1 -- 172.21.15.6:0/2030453374 shutdown_connections 2023-07-21T22:34:58.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f32085fa640 1 --2- 172.21.15.6:0/2030453374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32000c8ad0 0x7f32000c9020 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f32085fa640 1 --2- 172.21.15.6:0/2030453374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3200158ce0 0x7f3200070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f32085fa640 1 -- 172.21.15.6:0/2030453374 >> 172.21.15.6:0/2030453374 conn(0x7f32000afcf0 msgr2=0x7f32000b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:58.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f32085fa640 1 -- 172.21.15.6:0/2030453374 shutdown_connections 2023-07-21T22:34:58.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f32085fa640 1 -- 172.21.15.6:0/2030453374 wait complete. 2023-07-21T22:34:58.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f32085fa640 1 Processor -- start 2023-07-21T22:34:58.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f32085fa640 1 -- start start 2023-07-21T22:34:58.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f32085fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32000c8ad0 0x7f3200144220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:58.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f32085fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32000c9560 0x7f32000c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:58.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f32085fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3200158ce0 0x7f320014ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:58.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f32085fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3200149fb0 con 0x7f32000c9560 2023-07-21T22:34:58.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f32085fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3200149c80 con 0x7f32000c8ad0 2023-07-21T22:34:58.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f32085fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32000b3000 con 0x7f3200158ce0 2023-07-21T22:34:58.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f3205b95640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32000c9560 0x7f32000c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:58.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f3205b95640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32000c9560 0x7f32000c5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34452/0 (socket says 172.21.15.6:34452) 2023-07-21T22:34:58.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.638+0000 7f3205b95640 1 -- 172.21.15.6:0/1184560060 learned_addr learned my addr 172.21.15.6:0/1184560060 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:58.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.642+0000 7f3206b97640 1 --2- 172.21.15.6:0/1184560060 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3200158ce0 0x7f320014ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:58.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.642+0000 7f3206396640 1 --2- 172.21.15.6:0/1184560060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32000c8ad0 0x7f3200144220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:58.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.642+0000 7f3205b95640 1 -- 172.21.15.6:0/1184560060 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3200158ce0 msgr2=0x7f320014ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:58.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.642+0000 7f3205b95640 1 --2- 172.21.15.6:0/1184560060 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3200158ce0 0x7f320014ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.642+0000 7f3205b95640 1 -- 172.21.15.6:0/1184560060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32000c8ad0 msgr2=0x7f3200144220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:58.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.642+0000 7f3205b95640 1 --2- 172.21.15.6:0/1184560060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32000c8ad0 0x7f3200144220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.642+0000 7f3205b95640 1 -- 172.21.15.6:0/1184560060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f0009420 con 0x7f32000c9560 2023-07-21T22:34:58.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.642+0000 7f3205b95640 1 --2- 172.21.15.6:0/1184560060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32000c9560 0x7f32000c5230 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f31f00ae040 tx=0x7f31f00190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:58.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.642+0000 7f31f6ffd640 1 -- 172.21.15.6:0/1184560060 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f00b4410 con 0x7f32000c9560 2023-07-21T22:34:58.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.642+0000 7f31f6ffd640 1 -- 172.21.15.6:0/1184560060 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f00b4570 con 0x7f32000c9560 2023-07-21T22:34:58.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.642+0000 7f31f6ffd640 1 -- 172.21.15.6:0/1184560060 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f00b4920 con 0x7f32000c9560 2023-07-21T22:34:58.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.642+0000 7f32085fa640 1 -- 172.21.15.6:0/1184560060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32000b32e0 con 0x7f32000c9560 2023-07-21T22:34:58.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.642+0000 7f32085fa640 1 -- 172.21.15.6:0/1184560060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32000b2860 con 0x7f32000c9560 2023-07-21T22:34:58.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.642+0000 7f32085fa640 1 -- 172.21.15.6:0/1184560060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32000ca1a0 con 0x7f32000c9560 2023-07-21T22:34:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.642+0000 7f31f6ffd640 1 -- 172.21.15.6:0/1184560060 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f31f00b2040 con 0x7f32000c9560 2023-07-21T22:34:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.642+0000 7f31f6ffd640 1 --2- 172.21.15.6:0/1184560060 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f31e40663a0 0x7f31e4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.646+0000 7f31f6ffd640 1 -- 172.21.15.6:0/1184560060 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5254+0+0 (secure 0 0 0) 0x7f31f011dc80 con 0x7f32000c9560 2023-07-21T22:34:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.646+0000 7f3206396640 1 --2- 172.21.15.6:0/1184560060 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f31e40663a0 0x7f31e4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.646+0000 7f3206396640 1 --2- 172.21.15.6:0/1184560060 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f31e40663a0 0x7f31e4068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009b60 tx=0x7f31fc009190 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:58.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.646+0000 7f31f6ffd640 1 -- 172.21.15.6:0/1184560060 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f31f00eb210 con 0x7f32000c9560 2023-07-21T22:34:58.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.810+0000 7f32085fa640 1 -- 172.21.15.6:0/1184560060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32000678d0 con 0x7f32000c9560 2023-07-21T22:34:58.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.810+0000 7f31f6ffd640 1 -- 172.21.15.6:0/1184560060 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+14638 (secure 0 0 0) 0x7f31f00b0090 con 0x7f32000c9560 2023-07-21T22:34:58.861 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:58.861 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":94,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:34:58.053920+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:34:58.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.810+0000 7f32085fa640 1 -- 172.21.15.6:0/1184560060 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f31e40663a0 msgr2=0x7f31e4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:58.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.810+0000 7f32085fa640 1 --2- 172.21.15.6:0/1184560060 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f31e40663a0 0x7f31e4068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009b60 tx=0x7f31fc009190 comp rx=0 tx=0).stop 2023-07-21T22:34:58.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.810+0000 7f32085fa640 1 -- 172.21.15.6:0/1184560060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32000c9560 msgr2=0x7f32000c5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:58.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.810+0000 7f32085fa640 1 --2- 172.21.15.6:0/1184560060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32000c9560 0x7f32000c5230 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f31f00ae040 tx=0x7f31f00190d0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.810+0000 7f32085fa640 1 -- 172.21.15.6:0/1184560060 shutdown_connections 2023-07-21T22:34:58.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.810+0000 7f32085fa640 1 --2- 172.21.15.6:0/1184560060 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f31e40663a0 0x7f31e4068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.810+0000 7f32085fa640 1 --2- 172.21.15.6:0/1184560060 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3200158ce0 0x7f320014ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.810+0000 7f32085fa640 1 --2- 172.21.15.6:0/1184560060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32000c9560 0x7f32000c5230 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.810+0000 7f32085fa640 1 --2- 172.21.15.6:0/1184560060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32000c8ad0 0x7f3200144220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:58.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.810+0000 7f32085fa640 1 -- 172.21.15.6:0/1184560060 >> 172.21.15.6:0/1184560060 conn(0x7f32000afcf0 msgr2=0x7f32000add40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:58.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.810+0000 7f32085fa640 1 -- 172.21.15.6:0/1184560060 shutdown_connections 2023-07-21T22:34:58.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.810+0000 7f32085fa640 1 -- 172.21.15.6:0/1184560060 wait complete. 2023-07-21T22:34:58.882 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:34:58.883 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:34:59.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.978+0000 7f48e440b640 1 Processor -- start 2023-07-21T22:34:59.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.978+0000 7f48e440b640 1 -- start start 2023-07-21T22:34:59.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.982+0000 7f48e440b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f48dc15f690 0x7f48dc0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.982+0000 7f48e440b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48dc06a440 0x7f48dc06c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.982+0000 7f48e440b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48dc06c040 con 0x7f48dc1453a0 2023-07-21T22:34:59.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.982+0000 7f48e440b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48dc160170 con 0x7f48dc15f690 2023-07-21T22:34:59.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.982+0000 7f48e440b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc160600 con 0x7f48dc06a440 2023-07-21T22:34:59.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.982+0000 7f48e21a7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f48dc15f690 0x7f48dc0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.982+0000 7f48e21a7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f48dc15f690 0x7f48dc0b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:42072/0 (socket says 172.21.15.6:42072) 2023-07-21T22:34:59.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.982+0000 7f48e29a8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48dc06a440 0x7f48dc06c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.982+0000 7f48e19a6640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f48dc1453a0 0x7f48dc15fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:36424/0 (socket says 172.21.15.6:36424) 2023-07-21T22:34:59.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.982+0000 7f48e21a7640 1 -- 172.21.15.6:0/699310407 learned_addr learned my addr 172.21.15.6:0/699310407 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:59.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.982+0000 7f48e21a7640 1 -- 172.21.15.6:0/699310407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48dc06a440 msgr2=0x7f48dc06c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:59.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.982+0000 7f48e21a7640 1 --2- 172.21.15.6:0/699310407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48dc06a440 0x7f48dc06c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.982+0000 7f48e21a7640 1 -- 172.21.15.6:0/699310407 >> v1:172.21.15.161:6789/0 conn(0x7f48dc1453a0 legacy=0x7f48dc15fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:59.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.982+0000 7f48e21a7640 1 -- 172.21.15.6:0/699310407 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48dc160360 con 0x7f48dc15f690 2023-07-21T22:34:59.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.986+0000 7f48e21a7640 1 --2- 172.21.15.6:0/699310407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48dc15f690 0x7f48dc0b1890 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f48d8009870 tx=0x7f48d801c210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9ebdc4e0fef88b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:59.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.986+0000 7f48e11a5640 1 -- 172.21.15.6:0/699310407 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d80ab600 con 0x7f48dc15f690 2023-07-21T22:34:59.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.986+0000 7f48e11a5640 1 -- 172.21.15.6:0/699310407 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d80a7050 con 0x7f48dc15f690 2023-07-21T22:34:59.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.986+0000 7f48e11a5640 1 -- 172.21.15.6:0/699310407 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d80ab980 con 0x7f48dc15f690 2023-07-21T22:34:59.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.986+0000 7f48e440b640 1 -- 172.21.15.6:0/699310407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48dc15f690 msgr2=0x7f48dc0b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:59.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.986+0000 7f48e440b640 1 --2- 172.21.15.6:0/699310407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48dc15f690 0x7f48dc0b1890 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f48d8009870 tx=0x7f48d801c210 comp rx=0 tx=0).stop 2023-07-21T22:34:59.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.986+0000 7f48e440b640 1 -- 172.21.15.6:0/699310407 shutdown_connections 2023-07-21T22:34:59.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.986+0000 7f48e440b640 1 --2- 172.21.15.6:0/699310407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48dc06a440 0x7f48dc06c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.986+0000 7f48e440b640 1 --2- 172.21.15.6:0/699310407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48dc15f690 0x7f48dc0b1890 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.986+0000 7f48e440b640 1 -- 172.21.15.6:0/699310407 >> 172.21.15.6:0/699310407 conn(0x7f48dc0b1210 msgr2=0x7f48dc0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:59.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.986+0000 7f48e440b640 1 -- 172.21.15.6:0/699310407 shutdown_connections 2023-07-21T22:34:59.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.986+0000 7f48e440b640 1 -- 172.21.15.6:0/699310407 wait complete. 2023-07-21T22:34:59.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.986+0000 7f48e440b640 1 Processor -- start 2023-07-21T22:34:59.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.986+0000 7f48e440b640 1 -- start start 2023-07-21T22:34:59.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48e440b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48dc06a440 0x7f48dc15eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48e440b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48dc1453a0 0x7f48dc13ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48e440b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48dc15f690 0x7f48dc15caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48e440b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc15d030 con 0x7f48dc15f690 2023-07-21T22:34:59.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48e440b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc15d220 con 0x7f48dc1453a0 2023-07-21T22:34:59.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48e440b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48dc142650 con 0x7f48dc06a440 2023-07-21T22:34:59.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48e29a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48dc15f690 0x7f48dc15caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48e29a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48dc15f690 0x7f48dc15caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34466/0 (socket says 172.21.15.6:34466) 2023-07-21T22:34:59.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48e29a8640 1 -- 172.21.15.6:0/1278025342 learned_addr learned my addr 172.21.15.6:0/1278025342 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:59.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48e21a7640 1 --2- 172.21.15.6:0/1278025342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48dc06a440 0x7f48dc15eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48e19a6640 1 --2- 172.21.15.6:0/1278025342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48dc1453a0 0x7f48dc13ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48e29a8640 1 -- 172.21.15.6:0/1278025342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48dc06a440 msgr2=0x7f48dc15eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:59.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48e29a8640 1 --2- 172.21.15.6:0/1278025342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48dc06a440 0x7f48dc15eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48e29a8640 1 -- 172.21.15.6:0/1278025342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48dc1453a0 msgr2=0x7f48dc13ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:59.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48e29a8640 1 --2- 172.21.15.6:0/1278025342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48dc1453a0 0x7f48dc13ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48e29a8640 1 -- 172.21.15.6:0/1278025342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d80094d0 con 0x7f48dc15f690 2023-07-21T22:34:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48e29a8640 1 --2- 172.21.15.6:0/1278025342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48dc15f690 0x7f48dc15caf0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f48d400efc0 tx=0x7f48d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48d2ffd640 1 -- 172.21.15.6:0/1278025342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d4009ba0 con 0x7f48dc15f690 2023-07-21T22:34:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48d2ffd640 1 -- 172.21.15.6:0/1278025342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d400f040 con 0x7f48dc15f690 2023-07-21T22:34:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48e440b640 1 -- 172.21.15.6:0/1278025342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48dc142930 con 0x7f48dc15f690 2023-07-21T22:34:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48d2ffd640 1 -- 172.21.15.6:0/1278025342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d40146c0 con 0x7f48dc15f690 2023-07-21T22:34:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48e440b640 1 -- 172.21.15.6:0/1278025342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48dc142ef0 con 0x7f48dc15f690 2023-07-21T22:34:59.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.990+0000 7f48e440b640 1 -- 172.21.15.6:0/1278025342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48dc143110 con 0x7f48dc15f690 2023-07-21T22:34:59.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.994+0000 7f48d2ffd640 1 -- 172.21.15.6:0/1278025342 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f48d4014820 con 0x7f48dc15f690 2023-07-21T22:34:59.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.994+0000 7f48d2ffd640 1 --2- 172.21.15.6:0/1278025342 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f48c00663a0 0x7f48c0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.994+0000 7f48d2ffd640 1 -- 172.21.15.6:0/1278025342 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5254+0+0 (secure 0 0 0) 0x7f48d40846a0 con 0x7f48dc15f690 2023-07-21T22:34:59.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.994+0000 7f48e21a7640 1 --2- 172.21.15.6:0/1278025342 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f48c00663a0 0x7f48c0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.994+0000 7f48e21a7640 1 --2- 172.21.15.6:0/1278025342 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f48c00663a0 0x7f48c0068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f48d80ad000 tx=0x7f48d80a6000 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:59.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:58.998+0000 7f48d2ffd640 1 -- 172.21.15.6:0/1278025342 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f48d4051c40 con 0x7f48dc15f690 2023-07-21T22:34:59.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.150+0000 7f48e440b640 1 -- 172.21.15.6:0/1278025342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f48dc0678d0 con 0x7f48dc15f690 2023-07-21T22:34:59.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.154+0000 7f48d2ffd640 1 -- 172.21.15.6:0/1278025342 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f48d4055260 con 0x7f48dc15f690 2023-07-21T22:34:59.203 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:34:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.154+0000 7f48e440b640 1 -- 172.21.15.6:0/1278025342 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f48c00663a0 msgr2=0x7f48c0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.154+0000 7f48e440b640 1 --2- 172.21.15.6:0/1278025342 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f48c00663a0 0x7f48c0068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f48d80ad000 tx=0x7f48d80a6000 comp rx=0 tx=0).stop 2023-07-21T22:34:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.154+0000 7f48e440b640 1 -- 172.21.15.6:0/1278025342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48dc15f690 msgr2=0x7f48dc15caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.154+0000 7f48e440b640 1 --2- 172.21.15.6:0/1278025342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48dc15f690 0x7f48dc15caf0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f48d400efc0 tx=0x7f48d400c490 comp rx=0 tx=0).stop 2023-07-21T22:34:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.154+0000 7f48e440b640 1 -- 172.21.15.6:0/1278025342 shutdown_connections 2023-07-21T22:34:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.154+0000 7f48e440b640 1 --2- 172.21.15.6:0/1278025342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48dc15f690 0x7f48dc15caf0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.154+0000 7f48e440b640 1 --2- 172.21.15.6:0/1278025342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48dc1453a0 0x7f48dc13ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.154+0000 7f48e440b640 1 --2- 172.21.15.6:0/1278025342 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f48c00663a0 0x7f48c0068850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.154+0000 7f48e440b640 1 --2- 172.21.15.6:0/1278025342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48dc06a440 0x7f48dc15eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.154+0000 7f48e440b640 1 -- 172.21.15.6:0/1278025342 >> 172.21.15.6:0/1278025342 conn(0x7f48dc0b1210 msgr2=0x7f48dc141250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.154+0000 7f48e440b640 1 -- 172.21.15.6:0/1278025342 shutdown_connections 2023-07-21T22:34:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.154+0000 7f48e440b640 1 -- 172.21.15.6:0/1278025342 wait complete. 2023-07-21T22:34:59.224 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:34:59.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.318+0000 7f3fbba9c640 1 Processor -- start 2023-07-21T22:34:59.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.318+0000 7f3fbba9c640 1 -- start start 2023-07-21T22:34:59.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fbba9c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3fb40c3ac0 0x7f3fb40c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fbba9c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fb40af2b0 0x7f3fb40ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fbba9c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb40ca540 con 0x7f3fb40cd120 2023-07-21T22:34:59.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fbba9c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb40695b0 con 0x7f3fb40c3ac0 2023-07-21T22:34:59.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fbba9c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb4069890 con 0x7f3fb40af2b0 2023-07-21T22:34:59.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fba039640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3fb40cd120 0x7f3fb40cd5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59808/0 (socket says 172.21.15.6:59808) 2023-07-21T22:34:59.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fba039640 1 -- 172.21.15.6:0/3185139152 learned_addr learned my addr 172.21.15.6:0/3185139152 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:34:59.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb8836640 1 -- 172.21.15.6:0/3185139152 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964053437 0 0) 0x7f3fb40ca540 con 0x7f3fb40cd120 2023-07-21T22:34:59.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb9838640 1 --2- 172.21.15.6:0/3185139152 >> v2:172.21.15.161:3300/0 conn(0x7f3fb40c3ac0 0x7f3fb40c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb8836640 1 -- 172.21.15.6:0/3185139152 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fa0003530 con 0x7f3fb40cd120 2023-07-21T22:34:59.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb9037640 1 --2- 172.21.15.6:0/3185139152 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fb40af2b0 0x7f3fb40ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb8836640 1 -- 172.21.15.6:0/3185139152 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3746322277 0 0) 0x7f3fa0003530 con 0x7f3fb40cd120 2023-07-21T22:34:59.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb8836640 1 -- 172.21.15.6:0/3185139152 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fb40af2b0 msgr2=0x7f3fb40ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:59.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb8836640 1 --2- 172.21.15.6:0/3185139152 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fb40af2b0 0x7f3fb40ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb8836640 1 -- 172.21.15.6:0/3185139152 >> v2:172.21.15.161:3300/0 conn(0x7f3fb40c3ac0 msgr2=0x7f3fb40c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:59.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb8836640 1 --2- 172.21.15.6:0/3185139152 >> v2:172.21.15.161:3300/0 conn(0x7f3fb40c3ac0 0x7f3fb40c2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb8836640 1 -- 172.21.15.6:0/3185139152 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb4069b70 con 0x7f3fb40cd120 2023-07-21T22:34:59.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb8836640 1 -- 172.21.15.6:0/3185139152 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f3fac001a00 con 0x7f3fb40cd120 2023-07-21T22:34:59.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb8836640 1 -- 172.21.15.6:0/3185139152 >> v1:172.21.15.6:6789/0 conn(0x7f3fb40cd120 legacy=0x7f3fb40cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:59.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb8836640 1 --2- 172.21.15.6:0/3185139152 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fa0003980 0x7f3fa0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb8836640 1 --2- 172.21.15.6:0/3185139152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fa0004360 0x7f3fa0004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb8836640 1 --2- 172.21.15.6:0/3185139152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa0004f50 0x7f3fa000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb8836640 1 -- 172.21.15.6:0/3185139152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb40695b0 con 0x7f3fa0004f50 2023-07-21T22:34:59.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb8836640 1 -- 172.21.15.6:0/3185139152 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb4069890 con 0x7f3fa0004360 2023-07-21T22:34:59.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb8836640 1 -- 172.21.15.6:0/3185139152 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa000bed0 con 0x7f3fa0003980 2023-07-21T22:34:59.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb9037640 1 --2- 172.21.15.6:0/3185139152 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fb40af2b0 0x7f3fb40ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:59.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fba039640 1 --2- 172.21.15.6:0/3185139152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa0004f50 0x7f3fa000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb9838640 1 --2- 172.21.15.6:0/3185139152 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fa0003980 0x7f3fa0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fb9037640 1 --2- 172.21.15.6:0/3185139152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fa0004360 0x7f3fa0004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fba039640 1 -- 172.21.15.6:0/3185139152 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fa0003980 msgr2=0x7f3fa0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:59.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fba039640 1 --2- 172.21.15.6:0/3185139152 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fa0003980 0x7f3fa0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fba039640 1 -- 172.21.15.6:0/3185139152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fa0004360 msgr2=0x7f3fa0004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:59.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fba039640 1 --2- 172.21.15.6:0/3185139152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fa0004360 0x7f3fa0004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.322+0000 7f3fba039640 1 -- 172.21.15.6:0/3185139152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa0003530 con 0x7f3fa0004f50 2023-07-21T22:34:59.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.326+0000 7f3fba039640 1 --2- 172.21.15.6:0/3185139152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa0004f50 0x7f3fa000b990 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00a860 tx=0x7f3fac01d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c999d9c100ea1412 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:59.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.326+0000 7f3fb8836640 1 -- 172.21.15.6:0/3185139152 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac0ad630 con 0x7f3fa0004f50 2023-07-21T22:34:59.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.326+0000 7f3fb8836640 1 -- 172.21.15.6:0/3185139152 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac0a8070 con 0x7f3fa0004f50 2023-07-21T22:34:59.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.326+0000 7f3fb8836640 1 -- 172.21.15.6:0/3185139152 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac0ada30 con 0x7f3fa0004f50 2023-07-21T22:34:59.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.326+0000 7f3fbba9c640 1 -- 172.21.15.6:0/3185139152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa0004f50 msgr2=0x7f3fa000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:59.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.326+0000 7f3fbba9c640 1 --2- 172.21.15.6:0/3185139152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa0004f50 0x7f3fa000b990 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00a860 tx=0x7f3fac01d360 comp rx=0 tx=0).stop 2023-07-21T22:34:59.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.326+0000 7f3fba039640 1 -- 172.21.15.6:0/3185139152 reap_dead start 2023-07-21T22:34:59.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.326+0000 7f3fbba9c640 1 -- 172.21.15.6:0/3185139152 shutdown_connections 2023-07-21T22:34:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.326+0000 7f3fbba9c640 1 -- 172.21.15.6:0/3185139152 >> 172.21.15.6:0/3185139152 conn(0x7f3fb40cde90 msgr2=0x7f3fb40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.326+0000 7f3fbba9c640 1 -- 172.21.15.6:0/3185139152 shutdown_connections 2023-07-21T22:34:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.326+0000 7f3fbba9c640 1 -- 172.21.15.6:0/3185139152 wait complete. 2023-07-21T22:34:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.326+0000 7f3fbba9c640 1 Processor -- start 2023-07-21T22:34:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.326+0000 7f3fbba9c640 1 -- start start 2023-07-21T22:34:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fbba9c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa0004f50 0x7f3fb414e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fbba9c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fb40b0dc0 0x7f3fb40b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fbba9c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fb406fcc0 0x7f3fb4070130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fbba9c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb4070670 con 0x7f3fa0004f50 2023-07-21T22:34:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fbba9c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb40b2400 con 0x7f3fb406fcc0 2023-07-21T22:34:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fbba9c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb4151ec0 con 0x7f3fb40b0dc0 2023-07-21T22:34:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fb9838640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa0004f50 0x7f3fb414e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fb9838640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa0004f50 0x7f3fb414e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34484/0 (socket says 172.21.15.6:34484) 2023-07-21T22:34:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fb9838640 1 -- 172.21.15.6:0/4066770656 learned_addr learned my addr 172.21.15.6:0/4066770656 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fb9037640 1 --2- 172.21.15.6:0/4066770656 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fb40b0dc0 0x7f3fb40b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fba039640 1 --2- 172.21.15.6:0/4066770656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fb406fcc0 0x7f3fb4070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fb9838640 1 -- 172.21.15.6:0/4066770656 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fb40b0dc0 msgr2=0x7f3fb40b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:59.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fb9838640 1 --2- 172.21.15.6:0/4066770656 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fb40b0dc0 0x7f3fb40b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fb9838640 1 -- 172.21.15.6:0/4066770656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fb406fcc0 msgr2=0x7f3fb4070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:59.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fb9838640 1 --2- 172.21.15.6:0/4066770656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fb406fcc0 0x7f3fb4070130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fb9838640 1 -- 172.21.15.6:0/4066770656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb40b1880 con 0x7f3fa0004f50 2023-07-21T22:34:59.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fb9037640 1 --2- 172.21.15.6:0/4066770656 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fb40b0dc0 0x7f3fb40b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:59.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fba039640 1 --2- 172.21.15.6:0/4066770656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fb406fcc0 0x7f3fb4070130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:59.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fb9838640 1 --2- 172.21.15.6:0/4066770656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa0004f50 0x7f3fb414e4e0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00119d0 tx=0x7f3fb0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:59.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3faa7fc640 1 -- 172.21.15.6:0/4066770656 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb000fb50 con 0x7f3fa0004f50 2023-07-21T22:34:59.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3faa7fc640 1 -- 172.21.15.6:0/4066770656 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb000fcb0 con 0x7f3fa0004f50 2023-07-21T22:34:59.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3faa7fc640 1 -- 172.21.15.6:0/4066770656 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0014440 con 0x7f3fa0004f50 2023-07-21T22:34:59.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fbba9c640 1 -- 172.21.15.6:0/4066770656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb40b1b60 con 0x7f3fa0004f50 2023-07-21T22:34:59.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fbba9c640 1 -- 172.21.15.6:0/4066770656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb40b2120 con 0x7f3fa0004f50 2023-07-21T22:34:59.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.330+0000 7f3fbba9c640 1 -- 172.21.15.6:0/4066770656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb4152000 con 0x7f3fa0004f50 2023-07-21T22:34:59.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.334+0000 7f3faa7fc640 1 -- 172.21.15.6:0/4066770656 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3fb00145a0 con 0x7f3fa0004f50 2023-07-21T22:34:59.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.334+0000 7f3faa7fc640 1 --2- 172.21.15.6:0/4066770656 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f3f980663d0 0x7f3f98068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.334+0000 7f3faa7fc640 1 -- 172.21.15.6:0/4066770656 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5254+0+0 (secure 0 0 0) 0x7f3fb0084450 con 0x7f3fa0004f50 2023-07-21T22:34:59.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.334+0000 7f3fb9037640 1 --2- 172.21.15.6:0/4066770656 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f3f980663d0 0x7f3f98068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.334+0000 7f3fb9037640 1 --2- 172.21.15.6:0/4066770656 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f3f980663d0 0x7f3f98068880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4163760 tx=0x7f3fa4008040 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:59.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.338+0000 7f3faa7fc640 1 -- 172.21.15.6:0/4066770656 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3fb0051ba0 con 0x7f3fa0004f50 2023-07-21T22:34:59.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.490+0000 7f3fbba9c640 1 -- 172.21.15.6:0/4066770656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3fb40678d0 con 0x7f3fa0004f50 2023-07-21T22:34:59.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.490+0000 7f3faa7fc640 1 -- 172.21.15.6:0/4066770656 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v94) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3fb00551c0 con 0x7f3fa0004f50 2023-07-21T22:34:59.542 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:34:59.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.494+0000 7f3fbba9c640 1 -- 172.21.15.6:0/4066770656 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f3f980663d0 msgr2=0x7f3f98068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:59.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.494+0000 7f3fbba9c640 1 --2- 172.21.15.6:0/4066770656 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f3f980663d0 0x7f3f98068880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3fb4163760 tx=0x7f3fa4008040 comp rx=0 tx=0).stop 2023-07-21T22:34:59.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.494+0000 7f3fbba9c640 1 -- 172.21.15.6:0/4066770656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa0004f50 msgr2=0x7f3fb414e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:59.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.494+0000 7f3fbba9c640 1 --2- 172.21.15.6:0/4066770656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa0004f50 0x7f3fb414e4e0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00119d0 tx=0x7f3fb0011e90 comp rx=0 tx=0).stop 2023-07-21T22:34:59.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.494+0000 7f3fbba9c640 1 -- 172.21.15.6:0/4066770656 shutdown_connections 2023-07-21T22:34:59.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.494+0000 7f3fbba9c640 1 --2- 172.21.15.6:0/4066770656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3fb406fcc0 0x7f3fb4070130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.494+0000 7f3fbba9c640 1 --2- 172.21.15.6:0/4066770656 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f3f980663d0 0x7f3f98068880 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.494+0000 7f3fbba9c640 1 --2- 172.21.15.6:0/4066770656 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3fb40b0dc0 0x7f3fb40b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.494+0000 7f3fbba9c640 1 --2- 172.21.15.6:0/4066770656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fa0004f50 0x7f3fb414e4e0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.494+0000 7f3fbba9c640 1 -- 172.21.15.6:0/4066770656 >> 172.21.15.6:0/4066770656 conn(0x7f3fb40cde90 msgr2=0x7f3fb40ce530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:59.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.494+0000 7f3fbba9c640 1 -- 172.21.15.6:0/4066770656 shutdown_connections 2023-07-21T22:34:59.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.494+0000 7f3fbba9c640 1 -- 172.21.15.6:0/4066770656 wait complete. 2023-07-21T22:34:59.563 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T22:34:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.654+0000 7f98f1103640 1 Processor -- start 2023-07-21T22:34:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.654+0000 7f98f1103640 1 -- start start 2023-07-21T22:34:59.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.658+0000 7f98f1103640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98ec0ae1f0 0x7f98ec0b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.658+0000 7f98f1103640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f98ec06e160 0x7f98ec06bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.658+0000 7f98f1103640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f98ec06c260 0x7f98ec15f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.658+0000 7f98f1103640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ec06c680 con 0x7f98ec06e160 2023-07-21T22:34:59.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.658+0000 7f98f1103640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ec0b24f0 con 0x7f98ec06c260 2023-07-21T22:34:59.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.658+0000 7f98f1103640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec0b27d0 con 0x7f98ec0ae1f0 2023-07-21T22:34:59.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.658+0000 7f98e3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f98ec06e160 0x7f98ec06bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.658+0000 7f98e3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f98ec06e160 0x7f98ec06bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34496/0 (socket says 172.21.15.6:34496) 2023-07-21T22:34:59.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.658+0000 7f98e3fff640 1 -- 172.21.15.6:0/3939517770 learned_addr learned my addr 172.21.15.6:0/3939517770 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:59.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.658+0000 7f98eb59e640 1 --2- 172.21.15.6:0/3939517770 >> v2:172.21.15.161:3300/0 conn(0x7f98ec06c260 0x7f98ec15f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.658+0000 7f98ead9d640 1 --2- 172.21.15.6:0/3939517770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98ec0ae1f0 0x7f98ec0b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.658+0000 7f98e3fff640 1 -- 172.21.15.6:0/3939517770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98ec0ae1f0 msgr2=0x7f98ec0b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:59.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.658+0000 7f98e3fff640 1 --2- 172.21.15.6:0/3939517770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98ec0ae1f0 0x7f98ec0b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.658+0000 7f98e3fff640 1 -- 172.21.15.6:0/3939517770 >> v2:172.21.15.161:3300/0 conn(0x7f98ec06c260 msgr2=0x7f98ec15f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:59.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.658+0000 7f98e3fff640 1 --2- 172.21.15.6:0/3939517770 >> v2:172.21.15.161:3300/0 conn(0x7f98ec06c260 0x7f98ec15f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.658+0000 7f98e3fff640 1 -- 172.21.15.6:0/3939517770 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec0b2ab0 con 0x7f98ec06e160 2023-07-21T22:34:59.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98e3fff640 1 --2- 172.21.15.6:0/3939517770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ec06e160 0x7f98ec06bd20 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f98ec06fc20 tx=0x7f98d401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda1c00596076371 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:59.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98ea59c640 1 -- 172.21.15.6:0/3939517770 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d40ab600 con 0x7f98ec06e160 2023-07-21T22:34:59.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98ea59c640 1 -- 172.21.15.6:0/3939517770 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d40a7050 con 0x7f98ec06e160 2023-07-21T22:34:59.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98ea59c640 1 -- 172.21.15.6:0/3939517770 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d40ab980 con 0x7f98ec06e160 2023-07-21T22:34:59.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98f1103640 1 -- 172.21.15.6:0/3939517770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ec06e160 msgr2=0x7f98ec06bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:59.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98f1103640 1 --2- 172.21.15.6:0/3939517770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ec06e160 0x7f98ec06bd20 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f98ec06fc20 tx=0x7f98d401c210 comp rx=0 tx=0).stop 2023-07-21T22:34:59.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98f1103640 1 -- 172.21.15.6:0/3939517770 shutdown_connections 2023-07-21T22:34:59.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98f1103640 1 --2- 172.21.15.6:0/3939517770 >> v2:172.21.15.161:3300/0 conn(0x7f98ec06c260 0x7f98ec15f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98f1103640 1 --2- 172.21.15.6:0/3939517770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ec06e160 0x7f98ec06bd20 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98f1103640 1 --2- 172.21.15.6:0/3939517770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98ec0ae1f0 0x7f98ec0b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98f1103640 1 -- 172.21.15.6:0/3939517770 >> 172.21.15.6:0/3939517770 conn(0x7f98ec0b1300 msgr2=0x7f98ec0ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:59.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98f1103640 1 -- 172.21.15.6:0/3939517770 shutdown_connections 2023-07-21T22:34:59.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98f1103640 1 -- 172.21.15.6:0/3939517770 wait complete. 2023-07-21T22:34:59.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98f1103640 1 Processor -- start 2023-07-21T22:34:59.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98f1103640 1 -- start start 2023-07-21T22:34:59.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98f1103640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98ec06c260 0x7f98ec15ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98f1103640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ec06e160 0x7f98ec0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98f1103640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98ec0ae1f0 0x7f98ec0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98f1103640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec1658a0 con 0x7f98ec06e160 2023-07-21T22:34:59.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98f1103640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec164d20 con 0x7f98ec0ae1f0 2023-07-21T22:34:59.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.662+0000 7f98f1103640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec165000 con 0x7f98ec06c260 2023-07-21T22:34:59.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.666+0000 7f98e3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ec06e160 0x7f98ec0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.666+0000 7f98e3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ec06e160 0x7f98ec0aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34512/0 (socket says 172.21.15.6:34512) 2023-07-21T22:34:59.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.666+0000 7f98e3fff640 1 -- 172.21.15.6:0/1202223575 learned_addr learned my addr 172.21.15.6:0/1202223575 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:34:59.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.666+0000 7f98ead9d640 1 --2- 172.21.15.6:0/1202223575 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98ec06c260 0x7f98ec15ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.666+0000 7f98eb59e640 1 --2- 172.21.15.6:0/1202223575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98ec0ae1f0 0x7f98ec0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.666+0000 7f98e3fff640 1 -- 172.21.15.6:0/1202223575 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98ec06c260 msgr2=0x7f98ec15ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:59.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.666+0000 7f98e3fff640 1 --2- 172.21.15.6:0/1202223575 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98ec06c260 0x7f98ec15ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.666+0000 7f98e3fff640 1 -- 172.21.15.6:0/1202223575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98ec0ae1f0 msgr2=0x7f98ec0af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:59.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.666+0000 7f98e3fff640 1 --2- 172.21.15.6:0/1202223575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98ec0ae1f0 0x7f98ec0af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.666+0000 7f98e3fff640 1 -- 172.21.15.6:0/1202223575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d40094d0 con 0x7f98ec06e160 2023-07-21T22:34:59.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.666+0000 7f98e3fff640 1 --2- 172.21.15.6:0/1202223575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ec06e160 0x7f98ec0aeda0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f98d401a8c0 tx=0x7f98d4018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:59.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.666+0000 7f98e37fe640 1 -- 172.21.15.6:0/1202223575 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d40b6650 con 0x7f98ec06e160 2023-07-21T22:34:59.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.666+0000 7f98e37fe640 1 -- 172.21.15.6:0/1202223575 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d40b67d0 con 0x7f98ec06e160 2023-07-21T22:34:59.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.666+0000 7f98e37fe640 1 -- 172.21.15.6:0/1202223575 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d40b6b80 con 0x7f98ec06e160 2023-07-21T22:34:59.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.666+0000 7f98f1103640 1 -- 172.21.15.6:0/1202223575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ec0b3710 con 0x7f98ec06e160 2023-07-21T22:34:59.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.666+0000 7f98f1103640 1 -- 172.21.15.6:0/1202223575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ec1655c0 con 0x7f98ec06e160 2023-07-21T22:34:59.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.666+0000 7f98f1103640 1 -- 172.21.15.6:0/1202223575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ec160900 con 0x7f98ec06e160 2023-07-21T22:34:59.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.666+0000 7f98e37fe640 1 -- 172.21.15.6:0/1202223575 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f98d40b2040 con 0x7f98ec06e160 2023-07-21T22:34:59.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.670+0000 7f98e37fe640 1 --2- 172.21.15.6:0/1202223575 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f98cc0663a0 0x7f98cc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:59.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.670+0000 7f98e37fe640 1 -- 172.21.15.6:0/1202223575 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5254+0+0 (secure 0 0 0) 0x7f98d411d8e0 con 0x7f98ec06e160 2023-07-21T22:34:59.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.670+0000 7f98ead9d640 1 --2- 172.21.15.6:0/1202223575 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f98cc0663a0 0x7f98cc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:59.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.670+0000 7f98ead9d640 1 --2- 172.21.15.6:0/1202223575 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f98cc0663a0 0x7f98cc068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f98dc007940 tx=0x7f98dc008040 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:59.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.674+0000 7f98e37fe640 1 -- 172.21.15.6:0/1202223575 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f98d40eb0b0 con 0x7f98ec06e160 2023-07-21T22:34:59.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.826+0000 7f98f1103640 1 -- 172.21.15.6:0/1202223575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f98ec0678d0 con 0x7f98ec06e160 2023-07-21T22:34:59.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.830+0000 7f98e37fe640 1 -- 172.21.15.6:0/1202223575 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v94) v1 ==== 84+0+126 (secure 0 0 0) 0x7f98d40ee6d0 con 0x7f98ec06e160 2023-07-21T22:34:59.880 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:34:59.880 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:34:59.880 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:59.880 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-07-21T22:34:59.880 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-07-21T22:34:59.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:34:59.881 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:34:59.881 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-07-21T22:34:59.881 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-07-21T22:34:59.881 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:34:59.881 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:34:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.830+0000 7f98f1103640 1 -- 172.21.15.6:0/1202223575 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f98cc0663a0 msgr2=0x7f98cc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.830+0000 7f98f1103640 1 --2- 172.21.15.6:0/1202223575 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f98cc0663a0 0x7f98cc068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f98dc007940 tx=0x7f98dc008040 comp rx=0 tx=0).stop 2023-07-21T22:34:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.830+0000 7f98f1103640 1 -- 172.21.15.6:0/1202223575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ec06e160 msgr2=0x7f98ec0aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.830+0000 7f98f1103640 1 --2- 172.21.15.6:0/1202223575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ec06e160 0x7f98ec0aeda0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f98d401a8c0 tx=0x7f98d4018fb0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.830+0000 7f98f1103640 1 -- 172.21.15.6:0/1202223575 shutdown_connections 2023-07-21T22:34:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.830+0000 7f98f1103640 1 --2- 172.21.15.6:0/1202223575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98ec0ae1f0 0x7f98ec0af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.830+0000 7f98f1103640 1 --2- 172.21.15.6:0/1202223575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ec06e160 0x7f98ec0aeda0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.830+0000 7f98f1103640 1 --2- 172.21.15.6:0/1202223575 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f98cc0663a0 0x7f98cc068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.830+0000 7f98f1103640 1 --2- 172.21.15.6:0/1202223575 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f98ec06c260 0x7f98ec15ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.830+0000 7f98f1103640 1 -- 172.21.15.6:0/1202223575 >> 172.21.15.6:0/1202223575 conn(0x7f98ec0b1300 msgr2=0x7f98ec0acbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.830+0000 7f98f1103640 1 -- 172.21.15.6:0/1202223575 shutdown_connections 2023-07-21T22:34:59.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.830+0000 7f98f1103640 1 -- 172.21.15.6:0/1202223575 wait complete. 2023-07-21T22:34:59.900 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-21T22:34:59.901 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-21T22:35:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.998+0000 7f3396c26640 1 Processor -- start 2023-07-21T22:35:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.998+0000 7f3396c26640 1 -- start start 2023-07-21T22:35:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.998+0000 7f3396c26640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f339015bde0 0x7f33900d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.998+0000 7f3396c26640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f33900d2fc0 0x7f33900b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.998+0000 7f3396c26640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33900b04c0 con 0x7f33900d2300 2023-07-21T22:35:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.998+0000 7f3396c26640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f339015c1b0 con 0x7f33900d2fc0 2023-07-21T22:35:00.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.998+0000 7f3396c26640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33900d0aa0 con 0x7f339015bde0 2023-07-21T22:35:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.998+0000 7f33949c2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f339015bde0 0x7f33900d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.998+0000 7f33951c3640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f33900d2300 0x7f33900cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:36426/0 (socket says 172.21.15.6:36426) 2023-07-21T22:35:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.998+0000 7f33949c2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f339015bde0 0x7f33900d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:55408/0 (socket says 172.21.15.6:55408) 2023-07-21T22:35:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.998+0000 7f33949c2640 1 -- 172.21.15.6:0/79994214 learned_addr learned my addr 172.21.15.6:0/79994214 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:34:59.998+0000 7f338ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f33900d2fc0 0x7f33900b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.002+0000 7f33949c2640 1 -- 172.21.15.6:0/79994214 >> v2:172.21.15.161:3300/0 conn(0x7f33900d2fc0 msgr2=0x7f33900b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.002+0000 7f33949c2640 1 --2- 172.21.15.6:0/79994214 >> v2:172.21.15.161:3300/0 conn(0x7f33900d2fc0 0x7f33900b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.002+0000 7f338f7fe640 1 -- 172.21.15.6:0/79994214 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328504685 0 0) 0x7f33900b04c0 con 0x7f33900d2300 2023-07-21T22:35:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.002+0000 7f33949c2640 1 -- 172.21.15.6:0/79994214 >> v1:172.21.15.161:6789/0 conn(0x7f33900d2300 legacy=0x7f33900cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.002+0000 7f33949c2640 1 -- 172.21.15.6:0/79994214 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33900afb90 con 0x7f339015bde0 2023-07-21T22:35:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.002+0000 7f33949c2640 1 --2- 172.21.15.6:0/79994214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f339015bde0 0x7f33900d0270 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3384006fd0 tx=0x7f338401c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f2afcce01ccec5b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.002+0000 7f338f7fe640 1 -- 172.21.15.6:0/79994214 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33840aa680 con 0x7f339015bde0 2023-07-21T22:35:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.002+0000 7f338f7fe640 1 -- 172.21.15.6:0/79994214 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33840aa7e0 con 0x7f339015bde0 2023-07-21T22:35:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.002+0000 7f338f7fe640 1 -- 172.21.15.6:0/79994214 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33840aab70 con 0x7f339015bde0 2023-07-21T22:35:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f3396c26640 1 -- 172.21.15.6:0/79994214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f339015bde0 msgr2=0x7f33900d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:00.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f3396c26640 1 --2- 172.21.15.6:0/79994214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f339015bde0 0x7f33900d0270 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3384006fd0 tx=0x7f338401c520 comp rx=0 tx=0).stop 2023-07-21T22:35:00.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f3396c26640 1 -- 172.21.15.6:0/79994214 shutdown_connections 2023-07-21T22:35:00.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f3396c26640 1 --2- 172.21.15.6:0/79994214 >> v2:172.21.15.161:3300/0 conn(0x7f33900d2fc0 0x7f33900b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:00.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f3396c26640 1 --2- 172.21.15.6:0/79994214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f339015bde0 0x7f33900d0270 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:00.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f3396c26640 1 -- 172.21.15.6:0/79994214 >> 172.21.15.6:0/79994214 conn(0x7f33900659d0 msgr2=0x7f339009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:00.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f3396c26640 1 -- 172.21.15.6:0/79994214 shutdown_connections 2023-07-21T22:35:00.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f3396c26640 1 -- 172.21.15.6:0/79994214 wait complete. 2023-07-21T22:35:00.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f3396c26640 1 Processor -- start 2023-07-21T22:35:00.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f3396c26640 1 -- start start 2023-07-21T22:35:00.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f3396c26640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33900d2300 0x7f339014e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:00.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f3396c26640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33900d2fc0 0x7f33900b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:00.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f3396c26640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f339015bde0 0x7f339014c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:00.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f3396c26640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33900b3890 con 0x7f33900d2300 2023-07-21T22:35:00.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f3396c26640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33900b3ad0 con 0x7f33900d2fc0 2023-07-21T22:35:00.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f3396c26640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33900b3db0 con 0x7f339015bde0 2023-07-21T22:35:00.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f33949c2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33900d2300 0x7f339014e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:00.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f33949c2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33900d2300 0x7f339014e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34528/0 (socket says 172.21.15.6:34528) 2023-07-21T22:35:00.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f33949c2640 1 -- 172.21.15.6:0/2287460565 learned_addr learned my addr 172.21.15.6:0/2287460565 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:00.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f33951c3640 1 --2- 172.21.15.6:0/2287460565 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f339015bde0 0x7f339014c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:00.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.006+0000 7f338ffff640 1 --2- 172.21.15.6:0/2287460565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33900d2fc0 0x7f33900b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:00.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.010+0000 7f33949c2640 1 -- 172.21.15.6:0/2287460565 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f339015bde0 msgr2=0x7f339014c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:00.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.010+0000 7f33949c2640 1 --2- 172.21.15.6:0/2287460565 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f339015bde0 0x7f339014c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:00.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.010+0000 7f33949c2640 1 -- 172.21.15.6:0/2287460565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33900d2fc0 msgr2=0x7f33900b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:00.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.010+0000 7f33949c2640 1 --2- 172.21.15.6:0/2287460565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33900d2fc0 0x7f33900b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:00.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.010+0000 7f33949c2640 1 -- 172.21.15.6:0/2287460565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3384009480 con 0x7f33900d2300 2023-07-21T22:35:00.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.010+0000 7f33949c2640 1 --2- 172.21.15.6:0/2287460565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33900d2300 0x7f339014e800 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f338401a150 tx=0x7f33840192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:00.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.010+0000 7f338d7fa640 1 -- 172.21.15.6:0/2287460565 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33840aad60 con 0x7f33900d2300 2023-07-21T22:35:00.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.010+0000 7f338d7fa640 1 -- 172.21.15.6:0/2287460565 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33840aa640 con 0x7f33900d2300 2023-07-21T22:35:00.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.010+0000 7f338d7fa640 1 -- 172.21.15.6:0/2287460565 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384003860 con 0x7f33900d2300 2023-07-21T22:35:00.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.010+0000 7f3396c26640 1 -- 172.21.15.6:0/2287460565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33900b4090 con 0x7f33900d2300 2023-07-21T22:35:00.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.010+0000 7f3396c26640 1 -- 172.21.15.6:0/2287460565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33900b5a60 con 0x7f33900d2300 2023-07-21T22:35:00.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.010+0000 7f3396c26640 1 -- 172.21.15.6:0/2287460565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339014ed40 con 0x7f33900d2300 2023-07-21T22:35:00.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.010+0000 7f338d7fa640 1 -- 172.21.15.6:0/2287460565 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f33840039c0 con 0x7f33900d2300 2023-07-21T22:35:00.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.010+0000 7f338d7fa640 1 --2- 172.21.15.6:0/2287460565 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f33740663a0 0x7f3374068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:00.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.010+0000 7f338d7fa640 1 -- 172.21.15.6:0/2287460565 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5254+0+0 (secure 0 0 0) 0x7f338411e720 con 0x7f33900d2300 2023-07-21T22:35:00.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.014+0000 7f338ffff640 1 --2- 172.21.15.6:0/2287460565 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f33740663a0 0x7f3374068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:00.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.014+0000 7f338ffff640 1 --2- 172.21.15.6:0/2287460565 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f33740663a0 0x7f3374068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f33900d03b0 tx=0x7f337c008040 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:00.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.014+0000 7f338d7fa640 1 -- 172.21.15.6:0/2287460565 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f33840ebc00 con 0x7f33900d2300 2023-07-21T22:35:00.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.170+0000 7f3396c26640 1 -- 172.21.15.6:0/2287460565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f33900678d0 con 0x7f33900d2300 2023-07-21T22:35:00.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.690+0000 7f338d7fa640 1 -- 172.21.15.6:0/2287460565 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v95) v1 ==== 138+0+0 (secure 0 0 0) 0x7f33840ef220 con 0x7f33900d2300 2023-07-21T22:35:00.742 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-07-21T22:35:00.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.698+0000 7f3396c26640 1 -- 172.21.15.6:0/2287460565 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f33740663a0 msgr2=0x7f3374068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:00.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.698+0000 7f3396c26640 1 --2- 172.21.15.6:0/2287460565 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f33740663a0 0x7f3374068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f33900d03b0 tx=0x7f337c008040 comp rx=0 tx=0).stop 2023-07-21T22:35:00.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.698+0000 7f3396c26640 1 -- 172.21.15.6:0/2287460565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33900d2300 msgr2=0x7f339014e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:00.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.698+0000 7f3396c26640 1 --2- 172.21.15.6:0/2287460565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33900d2300 0x7f339014e800 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f338401a150 tx=0x7f33840192c0 comp rx=0 tx=0).stop 2023-07-21T22:35:00.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.698+0000 7f3396c26640 1 -- 172.21.15.6:0/2287460565 shutdown_connections 2023-07-21T22:35:00.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.698+0000 7f3396c26640 1 --2- 172.21.15.6:0/2287460565 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f33740663a0 0x7f3374068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:00.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.698+0000 7f3396c26640 1 --2- 172.21.15.6:0/2287460565 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f339015bde0 0x7f339014c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:00.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.698+0000 7f3396c26640 1 --2- 172.21.15.6:0/2287460565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33900d2fc0 0x7f33900b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:00.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.698+0000 7f3396c26640 1 --2- 172.21.15.6:0/2287460565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33900d2300 0x7f339014e800 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:00.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.698+0000 7f3396c26640 1 -- 172.21.15.6:0/2287460565 >> 172.21.15.6:0/2287460565 conn(0x7f33900659d0 msgr2=0x7f33900af190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:00.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.698+0000 7f3396c26640 1 -- 172.21.15.6:0/2287460565 shutdown_connections 2023-07-21T22:35:00.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.698+0000 7f3396c26640 1 -- 172.21.15.6:0/2287460565 wait complete. 2023-07-21T22:35:00.770 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T22:35:00.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.870+0000 7fdf74293640 1 Processor -- start 2023-07-21T22:35:00.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.870+0000 7fdf74293640 1 -- start start 2023-07-21T22:35:00.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.874+0000 7fdf74293640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf6c06a540 0x7fdf6c0cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:00.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.874+0000 7fdf74293640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdf6c1601f0 0x7fdf6c0cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:00.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.874+0000 7fdf74293640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf6c0ccf50 con 0x7fdf6c06a910 2023-07-21T22:35:00.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.874+0000 7fdf74293640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf6c0cd1f0 con 0x7fdf6c1601f0 2023-07-21T22:35:00.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.874+0000 7fdf74293640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c0cd4d0 con 0x7fdf6c06a540 2023-07-21T22:35:00.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.874+0000 7fdf72830640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdf6c06a910 0x7fdf6c0d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59818/0 (socket says 172.21.15.6:59818) 2023-07-21T22:35:00.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.874+0000 7fdf72830640 1 -- 172.21.15.6:0/1339105592 learned_addr learned my addr 172.21.15.6:0/1339105592 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:00.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.874+0000 7fdf7202f640 1 --2- 172.21.15.6:0/1339105592 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf6c06a540 0x7fdf6c0cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:00.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.874+0000 7fdf7182e640 1 --2- 172.21.15.6:0/1339105592 >> v2:172.21.15.161:3300/0 conn(0x7fdf6c1601f0 0x7fdf6c0cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:00.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.874+0000 7fdf7102d640 1 -- 172.21.15.6:0/1339105592 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421731801 0 0) 0x7fdf6c0ccf50 con 0x7fdf6c06a910 2023-07-21T22:35:00.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.874+0000 7fdf7102d640 1 -- 172.21.15.6:0/1339105592 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf58003530 con 0x7fdf6c06a910 2023-07-21T22:35:00.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.874+0000 7fdf7202f640 1 -- 172.21.15.6:0/1339105592 >> v2:172.21.15.161:3300/0 conn(0x7fdf6c1601f0 msgr2=0x7fdf6c0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:00.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.874+0000 7fdf7202f640 1 --2- 172.21.15.6:0/1339105592 >> v2:172.21.15.161:3300/0 conn(0x7fdf6c1601f0 0x7fdf6c0cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:00.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.874+0000 7fdf7202f640 1 -- 172.21.15.6:0/1339105592 >> v1:172.21.15.6:6789/0 conn(0x7fdf6c06a910 legacy=0x7fdf6c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:00.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.874+0000 7fdf7202f640 1 -- 172.21.15.6:0/1339105592 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c0cd7b0 con 0x7fdf6c06a540 2023-07-21T22:35:00.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.874+0000 7fdf7182e640 1 --2- 172.21.15.6:0/1339105592 >> v2:172.21.15.161:3300/0 conn(0x7fdf6c1601f0 0x7fdf6c0cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:00.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.878+0000 7fdf7202f640 1 --2- 172.21.15.6:0/1339105592 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf6c06a540 0x7fdf6c0cdcd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdf680097a0 tx=0x7fdf6801c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b0884adac5bc1ae server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:00.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.878+0000 7fdf7102d640 1 -- 172.21.15.6:0/1339105592 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf680ab600 con 0x7fdf6c06a540 2023-07-21T22:35:00.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.878+0000 7fdf7102d640 1 -- 172.21.15.6:0/1339105592 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf680a7050 con 0x7fdf6c06a540 2023-07-21T22:35:00.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.878+0000 7fdf7102d640 1 -- 172.21.15.6:0/1339105592 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf680ab960 con 0x7fdf6c06a540 2023-07-21T22:35:00.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.878+0000 7fdf74293640 1 -- 172.21.15.6:0/1339105592 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf6c06a540 msgr2=0x7fdf6c0cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:00.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.878+0000 7fdf74293640 1 --2- 172.21.15.6:0/1339105592 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf6c06a540 0x7fdf6c0cdcd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdf680097a0 tx=0x7fdf6801c3a0 comp rx=0 tx=0).stop 2023-07-21T22:35:00.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.878+0000 7fdf74293640 1 -- 172.21.15.6:0/1339105592 shutdown_connections 2023-07-21T22:35:00.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.878+0000 7fdf74293640 1 --2- 172.21.15.6:0/1339105592 >> v2:172.21.15.161:3300/0 conn(0x7fdf6c1601f0 0x7fdf6c0cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:00.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.878+0000 7fdf74293640 1 --2- 172.21.15.6:0/1339105592 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf6c06a540 0x7fdf6c0cdcd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:00.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.878+0000 7fdf74293640 1 -- 172.21.15.6:0/1339105592 >> 172.21.15.6:0/1339105592 conn(0x7fdf6c099490 msgr2=0x7fdf6c089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:00.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.878+0000 7fdf74293640 1 -- 172.21.15.6:0/1339105592 shutdown_connections 2023-07-21T22:35:00.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.878+0000 7fdf74293640 1 -- 172.21.15.6:0/1339105592 wait complete. 2023-07-21T22:35:00.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.878+0000 7fdf74293640 1 Processor -- start 2023-07-21T22:35:00.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.878+0000 7fdf74293640 1 -- start start 2023-07-21T22:35:00.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf74293640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf6c06a540 0x7fdf6c14d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:00.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf74293640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf6c06a910 0x7fdf6c0ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:00.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf74293640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf6c1601f0 0x7fdf6c0ad830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:00.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf74293640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c157720 con 0x7fdf6c1601f0 2023-07-21T22:35:00.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf74293640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c157a00 con 0x7fdf6c06a540 2023-07-21T22:35:00.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf74293640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6c157ce0 con 0x7fdf6c06a910 2023-07-21T22:35:00.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf72830640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf6c1601f0 0x7fdf6c0ad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:00.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf72830640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf6c1601f0 0x7fdf6c0ad830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34544/0 (socket says 172.21.15.6:34544) 2023-07-21T22:35:00.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf72830640 1 -- 172.21.15.6:0/1409659789 learned_addr learned my addr 172.21.15.6:0/1409659789 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:00.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf7202f640 1 --2- 172.21.15.6:0/1409659789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf6c06a540 0x7fdf6c14d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:00.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf7182e640 1 --2- 172.21.15.6:0/1409659789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf6c06a910 0x7fdf6c0ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:00.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf72830640 1 -- 172.21.15.6:0/1409659789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf6c06a910 msgr2=0x7fdf6c0ad2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:00.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf72830640 1 --2- 172.21.15.6:0/1409659789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf6c06a910 0x7fdf6c0ad2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:00.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf72830640 1 -- 172.21.15.6:0/1409659789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf6c06a540 msgr2=0x7fdf6c14d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:00.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf72830640 1 --2- 172.21.15.6:0/1409659789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf6c06a540 0x7fdf6c14d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:00.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf72830640 1 -- 172.21.15.6:0/1409659789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c009420 con 0x7fdf6c1601f0 2023-07-21T22:35:00.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf7182e640 1 --2- 172.21.15.6:0/1409659789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf6c06a910 0x7fdf6c0ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:00.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf7202f640 1 --2- 172.21.15.6:0/1409659789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf6c06a540 0x7fdf6c14d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:00.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf72830640 1 --2- 172.21.15.6:0/1409659789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf6c1601f0 0x7fdf6c0ad830 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400caa0 tx=0x7fdf6400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf62ffd640 1 -- 172.21.15.6:0/1409659789 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6400ac00 con 0x7fdf6c1601f0 2023-07-21T22:35:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf62ffd640 1 -- 172.21.15.6:0/1409659789 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6400ad60 con 0x7fdf6c1601f0 2023-07-21T22:35:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf62ffd640 1 -- 172.21.15.6:0/1409659789 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf64012620 con 0x7fdf6c1601f0 2023-07-21T22:35:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf74293640 1 -- 172.21.15.6:0/1409659789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf680093b0 con 0x7fdf6c1601f0 2023-07-21T22:35:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf74293640 1 -- 172.21.15.6:0/1409659789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf6c1582a0 con 0x7fdf6c1601f0 2023-07-21T22:35:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf74293640 1 -- 172.21.15.6:0/1409659789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf6c0678d0 con 0x7fdf6c1601f0 2023-07-21T22:35:00.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.882+0000 7fdf62ffd640 1 -- 172.21.15.6:0/1409659789 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdf64007070 con 0x7fdf6c1601f0 2023-07-21T22:35:00.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.886+0000 7fdf62ffd640 1 --2- 172.21.15.6:0/1409659789 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fdf500663a0 0x7fdf50068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:00.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.886+0000 7fdf62ffd640 1 -- 172.21.15.6:0/1409659789 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5624+0+0 (secure 0 0 0) 0x7fdf64083cf0 con 0x7fdf6c1601f0 2023-07-21T22:35:00.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.886+0000 7fdf7202f640 1 --2- 172.21.15.6:0/1409659789 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fdf500663a0 0x7fdf50068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:00.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.886+0000 7fdf7202f640 1 --2- 172.21.15.6:0/1409659789 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fdf500663a0 0x7fdf50068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdf680ad000 tx=0x7fdf680a6000 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:00.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:00.890+0000 7fdf62ffd640 1 -- 172.21.15.6:0/1409659789 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdf64051200 con 0x7fdf6c1601f0 2023-07-21T22:35:01.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.046+0000 7fdf74293640 1 -- 172.21.15.6:0/1409659789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdf6c158490 con 0x7fdf6c1601f0 2023-07-21T22:35:01.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.706+0000 7fdf62ffd640 1 -- 172.21.15.6:0/1409659789 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v96) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdf640170d0 con 0x7fdf6c1601f0 2023-07-21T22:35:01.764 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-07-21T22:35:01.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.722+0000 7fdf74293640 1 -- 172.21.15.6:0/1409659789 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fdf500663a0 msgr2=0x7fdf50068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:01.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.722+0000 7fdf74293640 1 --2- 172.21.15.6:0/1409659789 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fdf500663a0 0x7fdf50068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdf680ad000 tx=0x7fdf680a6000 comp rx=0 tx=0).stop 2023-07-21T22:35:01.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.722+0000 7fdf74293640 1 -- 172.21.15.6:0/1409659789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf6c1601f0 msgr2=0x7fdf6c0ad830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:01.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.722+0000 7fdf74293640 1 --2- 172.21.15.6:0/1409659789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf6c1601f0 0x7fdf6c0ad830 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400caa0 tx=0x7fdf6400cf60 comp rx=0 tx=0).stop 2023-07-21T22:35:01.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.722+0000 7fdf74293640 1 -- 172.21.15.6:0/1409659789 shutdown_connections 2023-07-21T22:35:01.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.722+0000 7fdf74293640 1 --2- 172.21.15.6:0/1409659789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf6c1601f0 0x7fdf6c0ad830 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:01.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.722+0000 7fdf74293640 1 --2- 172.21.15.6:0/1409659789 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fdf500663a0 0x7fdf50068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:01.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.722+0000 7fdf74293640 1 --2- 172.21.15.6:0/1409659789 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf6c06a910 0x7fdf6c0ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:01.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.722+0000 7fdf74293640 1 --2- 172.21.15.6:0/1409659789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf6c06a540 0x7fdf6c14d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:01.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.722+0000 7fdf74293640 1 -- 172.21.15.6:0/1409659789 >> 172.21.15.6:0/1409659789 conn(0x7fdf6c099490 msgr2=0x7fdf6c0b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:01.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.722+0000 7fdf74293640 1 -- 172.21.15.6:0/1409659789 shutdown_connections 2023-07-21T22:35:01.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.722+0000 7fdf74293640 1 -- 172.21.15.6:0/1409659789 wait complete. 2023-07-21T22:35:01.794 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-21T22:35:01.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.890+0000 7f5775831640 1 Processor -- start 2023-07-21T22:35:01.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.890+0000 7f5775831640 1 -- start start 2023-07-21T22:35:01.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.894+0000 7f5775831640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57700cc960 0x7f57700ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:01.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.894+0000 7f5775831640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f57700b1620 0x7f57700ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:01.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.894+0000 7f5775831640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5770160750 0x7f57700b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:01.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.894+0000 7f5775831640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57700cf710 con 0x7f57700b1620 2023-07-21T22:35:01.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.894+0000 7f5775831640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57700cd270 con 0x7f5770160750 2023-07-21T22:35:01.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.894+0000 7f5775831640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57700cf430 con 0x7f57700cc960 2023-07-21T22:35:01.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.894+0000 7f576ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f57700b1620 0x7f57700ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:01.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.894+0000 7f576ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f57700b1620 0x7f57700ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34554/0 (socket says 172.21.15.6:34554) 2023-07-21T22:35:01.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.894+0000 7f576ffff640 1 -- 172.21.15.6:0/1613529006 learned_addr learned my addr 172.21.15.6:0/1613529006 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:01.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.894+0000 7f5775030640 1 --2- 172.21.15.6:0/1613529006 >> v2:172.21.15.161:3300/0 conn(0x7f5770160750 0x7f57700b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:01.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.894+0000 7f577482f640 1 --2- 172.21.15.6:0/1613529006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57700cc960 0x7f57700ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:01.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.894+0000 7f576ffff640 1 -- 172.21.15.6:0/1613529006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57700cc960 msgr2=0x7f57700ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:01.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.894+0000 7f576ffff640 1 --2- 172.21.15.6:0/1613529006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57700cc960 0x7f57700ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:01.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.894+0000 7f576ffff640 1 -- 172.21.15.6:0/1613529006 >> v2:172.21.15.161:3300/0 conn(0x7f5770160750 msgr2=0x7f57700b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:01.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.894+0000 7f576ffff640 1 --2- 172.21.15.6:0/1613529006 >> v2:172.21.15.161:3300/0 conn(0x7f5770160750 0x7f57700b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:01.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.894+0000 7f576ffff640 1 -- 172.21.15.6:0/1613529006 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577015fc70 con 0x7f57700b1620 2023-07-21T22:35:01.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.898+0000 7f576ffff640 1 --2- 172.21.15.6:0/1613529006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57700b1620 0x7f57700ce950 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f577008b5d0 tx=0x7f575c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1efc2e5c00ff07 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:01.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.898+0000 7f576f7fe640 1 -- 172.21.15.6:0/1613529006 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c0aa5f0 con 0x7f57700b1620 2023-07-21T22:35:01.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.898+0000 7f576f7fe640 1 -- 172.21.15.6:0/1613529006 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c0aa750 con 0x7f57700b1620 2023-07-21T22:35:01.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.898+0000 7f576f7fe640 1 -- 172.21.15.6:0/1613529006 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c0aaae0 con 0x7f57700b1620 2023-07-21T22:35:01.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.898+0000 7f5775831640 1 -- 172.21.15.6:0/1613529006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57700b1620 msgr2=0x7f57700ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:01.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.898+0000 7f5775831640 1 --2- 172.21.15.6:0/1613529006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57700b1620 0x7f57700ce950 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f577008b5d0 tx=0x7f575c01c4d0 comp rx=0 tx=0).stop 2023-07-21T22:35:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.898+0000 7f5775831640 1 -- 172.21.15.6:0/1613529006 shutdown_connections 2023-07-21T22:35:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.898+0000 7f5775831640 1 --2- 172.21.15.6:0/1613529006 >> v2:172.21.15.161:3300/0 conn(0x7f5770160750 0x7f57700b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.898+0000 7f5775831640 1 --2- 172.21.15.6:0/1613529006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57700b1620 0x7f57700ce950 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.898+0000 7f5775831640 1 --2- 172.21.15.6:0/1613529006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57700cc960 0x7f57700ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.898+0000 7f5775831640 1 -- 172.21.15.6:0/1613529006 >> 172.21.15.6:0/1613529006 conn(0x7f5770069f50 msgr2=0x7f577006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.898+0000 7f5775831640 1 -- 172.21.15.6:0/1613529006 shutdown_connections 2023-07-21T22:35:01.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.898+0000 7f5775831640 1 -- 172.21.15.6:0/1613529006 wait complete. 2023-07-21T22:35:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.898+0000 7f5775831640 1 Processor -- start 2023-07-21T22:35:01.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.898+0000 7f5775831640 1 -- start start 2023-07-21T22:35:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.898+0000 7f5775831640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57700b1620 0x7f5770150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f5775831640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57700cc960 0x7f57700b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f5775831640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5770160750 0x7f57700b6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f5775831640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5770151250 con 0x7f57700cc960 2023-07-21T22:35:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f5775831640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5770158960 con 0x7f57700b1620 2023-07-21T22:35:01.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f5775831640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577015ad00 con 0x7f5770160750 2023-07-21T22:35:01.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f576ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57700cc960 0x7f57700b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f5775030640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5770160750 0x7f57700b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f577482f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57700b1620 0x7f5770150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f5775030640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5770160750 0x7f57700b6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:55458/0 (socket says 172.21.15.6:55458) 2023-07-21T22:35:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f5775030640 1 -- 172.21.15.6:0/2015308313 learned_addr learned my addr 172.21.15.6:0/2015308313 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f576ffff640 1 -- 172.21.15.6:0/2015308313 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5770160750 msgr2=0x7f57700b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f576ffff640 1 --2- 172.21.15.6:0/2015308313 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5770160750 0x7f57700b6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:01.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f576ffff640 1 -- 172.21.15.6:0/2015308313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57700b1620 msgr2=0x7f5770150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:01.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f576ffff640 1 --2- 172.21.15.6:0/2015308313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57700b1620 0x7f5770150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:01.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f576ffff640 1 -- 172.21.15.6:0/2015308313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575c0094d0 con 0x7f57700cc960 2023-07-21T22:35:01.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f576ffff640 1 --2- 172.21.15.6:0/2015308313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57700cc960 0x7f57700b6110 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f575c0ab000 tx=0x7f575c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:01.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f576d7fa640 1 -- 172.21.15.6:0/2015308313 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c0b3800 con 0x7f57700cc960 2023-07-21T22:35:01.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f576d7fa640 1 -- 172.21.15.6:0/2015308313 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c0b3980 con 0x7f57700cc960 2023-07-21T22:35:01.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f5775831640 1 -- 172.21.15.6:0/2015308313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577015afe0 con 0x7f57700cc960 2023-07-21T22:35:01.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f576d7fa640 1 -- 172.21.15.6:0/2015308313 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c0b3d30 con 0x7f57700cc960 2023-07-21T22:35:01.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f5775831640 1 -- 172.21.15.6:0/2015308313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577015b5a0 con 0x7f57700cc960 2023-07-21T22:35:01.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.902+0000 7f5775831640 1 -- 172.21.15.6:0/2015308313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577015b790 con 0x7f57700cc960 2023-07-21T22:35:01.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.906+0000 7f576d7fa640 1 -- 172.21.15.6:0/2015308313 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f575c0c6440 con 0x7f57700cc960 2023-07-21T22:35:01.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.906+0000 7f576d7fa640 1 --2- 172.21.15.6:0/2015308313 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f57540663a0 0x7f5754068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:01.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.906+0000 7f576d7fa640 1 -- 172.21.15.6:0/2015308313 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f575c0a7070 con 0x7f57700cc960 2023-07-21T22:35:01.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.906+0000 7f577482f640 1 --2- 172.21.15.6:0/2015308313 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f57540663a0 0x7f5754068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:01.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.906+0000 7f577482f640 1 --2- 172.21.15.6:0/2015308313 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f57540663a0 0x7f5754068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5764007a60 tx=0x7f5764008040 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:01.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:01.906+0000 7f576d7fa640 1 -- 172.21.15.6:0/2015308313 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f575c0ec1a0 con 0x7f57700cc960 2023-07-21T22:35:02.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.094+0000 7f5775831640 1 -- 172.21.15.6:0/2015308313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f577004e020 con 0x7f57700cc960 2023-07-21T22:35:02.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.722+0000 7f576d7fa640 1 -- 172.21.15.6:0/2015308313 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v36) v1 ==== 174+0+0 (secure 0 0 0) 0x7f575c0ef7c0 con 0x7f57700cc960 2023-07-21T22:35:02.785 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 11 and data pool 12 2023-07-21T22:35:02.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.738+0000 7f5775831640 1 -- 172.21.15.6:0/2015308313 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f57540663a0 msgr2=0x7f5754068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:02.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.738+0000 7f5775831640 1 --2- 172.21.15.6:0/2015308313 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f57540663a0 0x7f5754068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5764007a60 tx=0x7f5764008040 comp rx=0 tx=0).stop 2023-07-21T22:35:02.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.738+0000 7f5775831640 1 -- 172.21.15.6:0/2015308313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57700cc960 msgr2=0x7f57700b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:02.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.738+0000 7f5775831640 1 --2- 172.21.15.6:0/2015308313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57700cc960 0x7f57700b6110 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f575c0ab000 tx=0x7f575c01ad10 comp rx=0 tx=0).stop 2023-07-21T22:35:02.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.738+0000 7f5775831640 1 -- 172.21.15.6:0/2015308313 shutdown_connections 2023-07-21T22:35:02.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.738+0000 7f5775831640 1 --2- 172.21.15.6:0/2015308313 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f57540663a0 0x7f5754068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:02.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.742+0000 7f5775831640 1 --2- 172.21.15.6:0/2015308313 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5770160750 0x7f57700b6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:02.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.742+0000 7f5775831640 1 --2- 172.21.15.6:0/2015308313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57700cc960 0x7f57700b6110 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:02.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.742+0000 7f5775831640 1 --2- 172.21.15.6:0/2015308313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57700b1620 0x7f5770150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:02.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.742+0000 7f5775831640 1 -- 172.21.15.6:0/2015308313 >> 172.21.15.6:0/2015308313 conn(0x7f5770069f50 msgr2=0x7f577015d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:02.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.742+0000 7f5775831640 1 -- 172.21.15.6:0/2015308313 shutdown_connections 2023-07-21T22:35:02.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.742+0000 7f5775831640 1 -- 172.21.15.6:0/2015308313 wait complete. 2023-07-21T22:35:02.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:35:02.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.914+0000 7f48835c5640 1 Processor -- start 2023-07-21T22:35:02.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.914+0000 7f48835c5640 1 -- start start 2023-07-21T22:35:02.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.914+0000 7f48835c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f487c0c8ad0 0x7f487c0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:02.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.914+0000 7f48835c5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f487c0c9560 0x7f487c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:02.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.914+0000 7f48835c5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f487c0cc700 con 0x7f487c158ce0 2023-07-21T22:35:02.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.914+0000 7f48835c5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487c0c99e0 con 0x7f487c0c9560 2023-07-21T22:35:02.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.914+0000 7f48835c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c0b0ff0 con 0x7f487c0c8ad0 2023-07-21T22:35:02.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.918+0000 7f4880b60640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f487c0c8ad0 0x7f487c0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:02.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.918+0000 7f4880b60640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f487c0c8ad0 0x7f487c0c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:55472/0 (socket says 172.21.15.6:55472) 2023-07-21T22:35:02.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.918+0000 7f4880b60640 1 -- 172.21.15.6:0/2846174021 learned_addr learned my addr 172.21.15.6:0/2846174021 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:02.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.918+0000 7f4881b62640 1 --2- 172.21.15.6:0/2846174021 >> v2:172.21.15.161:3300/0 conn(0x7f487c0c9560 0x7f487c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:02.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.918+0000 7f4881361640 1 --1- 172.21.15.6:0/2846174021 >> v1:172.21.15.161:6789/0 conn(0x7f487c158ce0 0x7f487c070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:36442/0 (socket says 172.21.15.6:36442) 2023-07-21T22:35:02.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.918+0000 7f4873fff640 1 -- 172.21.15.6:0/2846174021 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296382481 0 0) 0x7f487c0cc700 con 0x7f487c158ce0 2023-07-21T22:35:02.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.918+0000 7f4880b60640 1 -- 172.21.15.6:0/2846174021 >> v2:172.21.15.161:3300/0 conn(0x7f487c0c9560 msgr2=0x7f487c0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:02.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.918+0000 7f4880b60640 1 --2- 172.21.15.6:0/2846174021 >> v2:172.21.15.161:3300/0 conn(0x7f487c0c9560 0x7f487c0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:02.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.918+0000 7f4880b60640 1 -- 172.21.15.6:0/2846174021 >> v1:172.21.15.161:6789/0 conn(0x7f487c158ce0 legacy=0x7f487c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:02.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.918+0000 7f4880b60640 1 -- 172.21.15.6:0/2846174021 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c070c80 con 0x7f487c0c8ad0 2023-07-21T22:35:02.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.918+0000 7f4881b62640 1 --2- 172.21.15.6:0/2846174021 >> v2:172.21.15.161:3300/0 conn(0x7f487c0c9560 0x7f487c0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:02.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.922+0000 7f4880b60640 1 --2- 172.21.15.6:0/2846174021 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f487c0c8ad0 0x7f487c0c9020 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f486c00bb10 tx=0x7f486c01eac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99ab0d86f363396 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:02.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.922+0000 7f4873fff640 1 -- 172.21.15.6:0/2846174021 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c0a7b90 con 0x7f487c0c8ad0 2023-07-21T22:35:02.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.922+0000 7f4873fff640 1 -- 172.21.15.6:0/2846174021 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c0a7cf0 con 0x7f487c0c8ad0 2023-07-21T22:35:02.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.922+0000 7f4873fff640 1 -- 172.21.15.6:0/2846174021 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c0af660 con 0x7f487c0c8ad0 2023-07-21T22:35:02.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.922+0000 7f48835c5640 1 -- 172.21.15.6:0/2846174021 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f487c0c8ad0 msgr2=0x7f487c0c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:02.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.922+0000 7f48835c5640 1 --2- 172.21.15.6:0/2846174021 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f487c0c8ad0 0x7f487c0c9020 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f486c00bb10 tx=0x7f486c01eac0 comp rx=0 tx=0).stop 2023-07-21T22:35:02.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.922+0000 7f48835c5640 1 -- 172.21.15.6:0/2846174021 shutdown_connections 2023-07-21T22:35:02.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.922+0000 7f48835c5640 1 --2- 172.21.15.6:0/2846174021 >> v2:172.21.15.161:3300/0 conn(0x7f487c0c9560 0x7f487c0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:02.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.922+0000 7f48835c5640 1 --2- 172.21.15.6:0/2846174021 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f487c0c8ad0 0x7f487c0c9020 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:02.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.922+0000 7f48835c5640 1 -- 172.21.15.6:0/2846174021 >> 172.21.15.6:0/2846174021 conn(0x7f487c0afcf0 msgr2=0x7f487c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:02.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.922+0000 7f48835c5640 1 -- 172.21.15.6:0/2846174021 shutdown_connections 2023-07-21T22:35:02.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.922+0000 7f48835c5640 1 -- 172.21.15.6:0/2846174021 wait complete. 2023-07-21T22:35:02.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.922+0000 7f48835c5640 1 Processor -- start 2023-07-21T22:35:02.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.922+0000 7f48835c5640 1 -- start start 2023-07-21T22:35:02.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.922+0000 7f48835c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f487c0c8ad0 0x7f487c147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:02.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.922+0000 7f48835c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f487c0c9560 0x7f487c14d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:02.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.922+0000 7f48835c5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f487c158ce0 0x7f487c14de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:02.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.922+0000 7f48835c5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c15acd0 con 0x7f487c0c9560 2023-07-21T22:35:02.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.922+0000 7f48835c5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c15a9a0 con 0x7f487c158ce0 2023-07-21T22:35:02.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.922+0000 7f48835c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487c14fa50 con 0x7f487c0c8ad0 2023-07-21T22:35:02.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.926+0000 7f4880b60640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f487c0c9560 0x7f487c14d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:02.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.926+0000 7f4880b60640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f487c0c9560 0x7f487c14d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34574/0 (socket says 172.21.15.6:34574) 2023-07-21T22:35:02.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.926+0000 7f4880b60640 1 -- 172.21.15.6:0/4088194655 learned_addr learned my addr 172.21.15.6:0/4088194655 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:02.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.926+0000 7f4881361640 1 --2- 172.21.15.6:0/4088194655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f487c0c8ad0 0x7f487c147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:02.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.926+0000 7f4881b62640 1 --2- 172.21.15.6:0/4088194655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f487c158ce0 0x7f487c14de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:02.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.926+0000 7f4880b60640 1 -- 172.21.15.6:0/4088194655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f487c0c8ad0 msgr2=0x7f487c147130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:02.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.926+0000 7f4880b60640 1 --2- 172.21.15.6:0/4088194655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f487c0c8ad0 0x7f487c147130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:02.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.926+0000 7f4880b60640 1 -- 172.21.15.6:0/4088194655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f487c158ce0 msgr2=0x7f487c14de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:02.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.926+0000 7f4880b60640 1 --2- 172.21.15.6:0/4088194655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f487c158ce0 0x7f487c14de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:02.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.926+0000 7f4880b60640 1 -- 172.21.15.6:0/4088194655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4874009a70 con 0x7f487c0c9560 2023-07-21T22:35:02.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.926+0000 7f4880b60640 1 --2- 172.21.15.6:0/4088194655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f487c0c9560 0x7f487c14d930 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f486c01b6d0 tx=0x7f486c01b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:02.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.926+0000 7f4871ffb640 1 -- 172.21.15.6:0/4088194655 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c0afd90 con 0x7f487c0c9560 2023-07-21T22:35:02.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.926+0000 7f4871ffb640 1 -- 172.21.15.6:0/4088194655 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c0b8420 con 0x7f487c0c9560 2023-07-21T22:35:02.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.926+0000 7f4871ffb640 1 -- 172.21.15.6:0/4088194655 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c0b87d0 con 0x7f487c0c9560 2023-07-21T22:35:02.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.926+0000 7f48835c5640 1 -- 172.21.15.6:0/4088194655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486c00b770 con 0x7f487c0c9560 2023-07-21T22:35:02.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.926+0000 7f48835c5640 1 -- 172.21.15.6:0/4088194655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c14f490 con 0x7f487c0c9560 2023-07-21T22:35:02.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.926+0000 7f48835c5640 1 -- 172.21.15.6:0/4088194655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487c0ca1a0 con 0x7f487c0c9560 2023-07-21T22:35:02.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.926+0000 7f4871ffb640 1 -- 172.21.15.6:0/4088194655 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f486c0b6070 con 0x7f487c0c9560 2023-07-21T22:35:02.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.930+0000 7f4871ffb640 1 --2- 172.21.15.6:0/4088194655 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f48600663a0 0x7f4860068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:02.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.930+0000 7f4871ffb640 1 -- 172.21.15.6:0/4088194655 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f486c11e510 con 0x7f487c0c9560 2023-07-21T22:35:02.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.930+0000 7f4881361640 1 --2- 172.21.15.6:0/4088194655 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f48600663a0 0x7f4860068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:02.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.930+0000 7f4881361640 1 --2- 172.21.15.6:0/4088194655 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f48600663a0 0x7f4860068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4878000f70 tx=0x7f4878007240 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:02.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:02.934+0000 7f4871ffb640 1 -- 172.21.15.6:0/4088194655 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f486c0eba00 con 0x7f487c0c9560 2023-07-21T22:35:03.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.090+0000 7f48835c5640 1 -- 172.21.15.6:0/4088194655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f487c15ae10 con 0x7f487c0c9560 2023-07-21T22:35:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.090+0000 7f4871ffb640 1 -- 172.21.15.6:0/4088194655 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+18365 (secure 0 0 0) 0x7f487c15ae10 con 0x7f487c0c9560 2023-07-21T22:35:03.141 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:03.141 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":97,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:35:02.101794+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:35:00.223294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-21T22:35:01.098128+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:35:03.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.090+0000 7f48835c5640 1 -- 172.21.15.6:0/4088194655 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f48600663a0 msgr2=0x7f4860068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:03.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.090+0000 7f48835c5640 1 --2- 172.21.15.6:0/4088194655 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f48600663a0 0x7f4860068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4878000f70 tx=0x7f4878007240 comp rx=0 tx=0).stop 2023-07-21T22:35:03.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.090+0000 7f48835c5640 1 -- 172.21.15.6:0/4088194655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f487c0c9560 msgr2=0x7f487c14d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:03.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.090+0000 7f48835c5640 1 --2- 172.21.15.6:0/4088194655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f487c0c9560 0x7f487c14d930 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f486c01b6d0 tx=0x7f486c01b860 comp rx=0 tx=0).stop 2023-07-21T22:35:03.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.090+0000 7f48835c5640 1 -- 172.21.15.6:0/4088194655 shutdown_connections 2023-07-21T22:35:03.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.090+0000 7f48835c5640 1 --2- 172.21.15.6:0/4088194655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f487c158ce0 0x7f487c14de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:03.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.090+0000 7f48835c5640 1 --2- 172.21.15.6:0/4088194655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f487c0c9560 0x7f487c14d930 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:03.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.090+0000 7f48835c5640 1 --2- 172.21.15.6:0/4088194655 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f48600663a0 0x7f4860068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:03.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.090+0000 7f48835c5640 1 --2- 172.21.15.6:0/4088194655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f487c0c8ad0 0x7f487c147130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:03.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.090+0000 7f48835c5640 1 -- 172.21.15.6:0/4088194655 >> 172.21.15.6:0/4088194655 conn(0x7f487c0afcf0 msgr2=0x7f487c0af520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:03.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.094+0000 7f48835c5640 1 -- 172.21.15.6:0/4088194655 shutdown_connections 2023-07-21T22:35:03.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.094+0000 7f48835c5640 1 -- 172.21.15.6:0/4088194655 wait complete. 2023-07-21T22:35:03.162 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:35:03.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.254+0000 7f22bcddf640 1 Processor -- start 2023-07-21T22:35:03.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.254+0000 7f22bcddf640 1 -- start start 2023-07-21T22:35:03.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.254+0000 7f22bcddf640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f22b815fd60 0x7f22b80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:03.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.254+0000 7f22bcddf640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b80ccaf0 con 0x7f22b80b7c70 2023-07-21T22:35:03.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.254+0000 7f22bcddf640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b8160320 con 0x7f22b80d1850 2023-07-21T22:35:03.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.254+0000 7f22bcddf640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b80d1190 con 0x7f22b815fd60 2023-07-21T22:35:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.258+0000 7f22b659c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f22b80b7c70 0x7f22b815f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59830/0 (socket says 172.21.15.6:59830) 2023-07-21T22:35:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.258+0000 7f22b659c640 1 -- 172.21.15.6:0/2807155135 learned_addr learned my addr 172.21.15.6:0/2807155135 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.258+0000 7f22b5d9b640 1 --2- 172.21.15.6:0/2807155135 >> v2:172.21.15.161:3300/0 conn(0x7f22b815fd60 0x7f22b80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:03.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.258+0000 7f22b559a640 1 -- 172.21.15.6:0/2807155135 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2452608823 0 0) 0x7f22b80ccaf0 con 0x7f22b80b7c70 2023-07-21T22:35:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.258+0000 7f22b559a640 1 -- 172.21.15.6:0/2807155135 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22a0003530 con 0x7f22b80b7c70 2023-07-21T22:35:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.258+0000 7f22b5d9b640 1 -- 172.21.15.6:0/2807155135 >> v1:172.21.15.161:6789/0 conn(0x7f22b80d1850 legacy=0x7f22b80d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.258+0000 7f22b559a640 1 -- 172.21.15.6:0/2807155135 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304638811 0 0) 0x7f22b8160320 con 0x7f22b80d1850 2023-07-21T22:35:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.258+0000 7f22b5d9b640 1 -- 172.21.15.6:0/2807155135 >> v1:172.21.15.6:6789/0 conn(0x7f22b80b7c70 legacy=0x7f22b815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:03.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.258+0000 7f22b5d9b640 1 -- 172.21.15.6:0/2807155135 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b80ccd90 con 0x7f22b815fd60 2023-07-21T22:35:03.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.258+0000 7f22b5d9b640 1 --2- 172.21.15.6:0/2807155135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22b815fd60 0x7f22b80d0c50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0097c0 tx=0x7f22ac01c2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75111aba17a0a817 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:03.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22b559a640 1 -- 172.21.15.6:0/2807155135 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8001600 con 0x7f22b815fd60 2023-07-21T22:35:03.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22b559a640 1 -- 172.21.15.6:0/2807155135 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac0a7050 con 0x7f22b815fd60 2023-07-21T22:35:03.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22b559a640 1 -- 172.21.15.6:0/2807155135 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac0ab600 con 0x7f22b815fd60 2023-07-21T22:35:03.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22bcddf640 1 -- 172.21.15.6:0/2807155135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22b815fd60 msgr2=0x7f22b80d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:03.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22bcddf640 1 --2- 172.21.15.6:0/2807155135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22b815fd60 0x7f22b80d0c50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0097c0 tx=0x7f22ac01c2c0 comp rx=0 tx=0).stop 2023-07-21T22:35:03.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22bcddf640 1 -- 172.21.15.6:0/2807155135 shutdown_connections 2023-07-21T22:35:03.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22bcddf640 1 --2- 172.21.15.6:0/2807155135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22b815fd60 0x7f22b80d0c50 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:03.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22bcddf640 1 -- 172.21.15.6:0/2807155135 >> 172.21.15.6:0/2807155135 conn(0x7f22b80650b0 msgr2=0x7f22b80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:03.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22bcddf640 1 -- 172.21.15.6:0/2807155135 shutdown_connections 2023-07-21T22:35:03.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22bcddf640 1 -- 172.21.15.6:0/2807155135 wait complete. 2023-07-21T22:35:03.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22bcddf640 1 Processor -- start 2023-07-21T22:35:03.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22bcddf640 1 -- start start 2023-07-21T22:35:03.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22bcddf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22b80b7c70 0x7f22b814d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:03.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22bcddf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22b80d1850 0x7f22b8153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:03.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22bcddf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22b815fd60 0x7f22b815ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:03.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22bcddf640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b815efc0 con 0x7f22b80b7c70 2023-07-21T22:35:03.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22bcddf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b80b2d20 con 0x7f22b80d1850 2023-07-21T22:35:03.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22bcddf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b8152870 con 0x7f22b815fd60 2023-07-21T22:35:03.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22b659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22b80b7c70 0x7f22b814d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:03.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22b659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22b80b7c70 0x7f22b814d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34580/0 (socket says 172.21.15.6:34580) 2023-07-21T22:35:03.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.262+0000 7f22b659c640 1 -- 172.21.15.6:0/4078151254 learned_addr learned my addr 172.21.15.6:0/4078151254 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:03.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.266+0000 7f22b5d9b640 1 --2- 172.21.15.6:0/4078151254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22b80d1850 0x7f22b8153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:03.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.266+0000 7f22b6d9d640 1 --2- 172.21.15.6:0/4078151254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22b815fd60 0x7f22b815ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:03.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.266+0000 7f22b659c640 1 -- 172.21.15.6:0/4078151254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22b815fd60 msgr2=0x7f22b815ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:03.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.266+0000 7f22b659c640 1 --2- 172.21.15.6:0/4078151254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22b815fd60 0x7f22b815ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:03.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.266+0000 7f22b659c640 1 -- 172.21.15.6:0/4078151254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22b80d1850 msgr2=0x7f22b8153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:03.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.266+0000 7f22b659c640 1 --2- 172.21.15.6:0/4078151254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22b80d1850 0x7f22b8153350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.266+0000 7f22b659c640 1 -- 172.21.15.6:0/4078151254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac009420 con 0x7f22b80b7c70 2023-07-21T22:35:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.266+0000 7f22b6d9d640 1 --2- 172.21.15.6:0/4078151254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22b815fd60 0x7f22b815ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.266+0000 7f22b659c640 1 --2- 172.21.15.6:0/4078151254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22b80b7c70 0x7f22b814d4e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f22a800c680 tx=0x7f22a800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.266+0000 7f22a6ffd640 1 -- 172.21.15.6:0/4078151254 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a80072d0 con 0x7f22b80b7c70 2023-07-21T22:35:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.266+0000 7f22a6ffd640 1 -- 172.21.15.6:0/4078151254 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a8007450 con 0x7f22b80b7c70 2023-07-21T22:35:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.266+0000 7f22bcddf640 1 -- 172.21.15.6:0/4078151254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b8152b50 con 0x7f22b80b7c70 2023-07-21T22:35:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.266+0000 7f22a6ffd640 1 -- 172.21.15.6:0/4078151254 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a80047f0 con 0x7f22b80b7c70 2023-07-21T22:35:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.266+0000 7f22bcddf640 1 -- 172.21.15.6:0/4078151254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b80b2920 con 0x7f22b80b7c70 2023-07-21T22:35:03.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.266+0000 7f22bcddf640 1 -- 172.21.15.6:0/4078151254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b80678d0 con 0x7f22b80b7c70 2023-07-21T22:35:03.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.266+0000 7f22a6ffd640 1 -- 172.21.15.6:0/4078151254 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f22a8004950 con 0x7f22b80b7c70 2023-07-21T22:35:03.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.270+0000 7f22a6ffd640 1 --2- 172.21.15.6:0/4078151254 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f22980663a0 0x7f2298068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:03.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.270+0000 7f22a6ffd640 1 -- 172.21.15.6:0/4078151254 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f22a8083180 con 0x7f22b80b7c70 2023-07-21T22:35:03.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.270+0000 7f22b5d9b640 1 --2- 172.21.15.6:0/4078151254 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f22980663a0 0x7f2298068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:03.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.270+0000 7f22b5d9b640 1 --2- 172.21.15.6:0/4078151254 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f22980663a0 0x7f2298068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0ad000 tx=0x7f22ac0a6000 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:03.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.274+0000 7f22a6ffd640 1 -- 172.21.15.6:0/4078151254 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f22a8050600 con 0x7f22b80b7c70 2023-07-21T22:35:03.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.426+0000 7f22bcddf640 1 -- 172.21.15.6:0/4078151254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22b80c5780 con 0x7f22b80b7c70 2023-07-21T22:35:03.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.426+0000 7f22a6ffd640 1 -- 172.21.15.6:0/4078151254 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+18365 (secure 0 0 0) 0x7f22a8053c20 con 0x7f22b80b7c70 2023-07-21T22:35:03.479 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:03.479 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":97,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:35:02.101794+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:35:00.223294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-21T22:35:01.098128+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:35:03.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.430+0000 7f22bcddf640 1 -- 172.21.15.6:0/4078151254 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f22980663a0 msgr2=0x7f2298068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:03.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.430+0000 7f22bcddf640 1 --2- 172.21.15.6:0/4078151254 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f22980663a0 0x7f2298068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0ad000 tx=0x7f22ac0a6000 comp rx=0 tx=0).stop 2023-07-21T22:35:03.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.430+0000 7f22bcddf640 1 -- 172.21.15.6:0/4078151254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22b80b7c70 msgr2=0x7f22b814d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:03.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.430+0000 7f22bcddf640 1 --2- 172.21.15.6:0/4078151254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22b80b7c70 0x7f22b814d4e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f22a800c680 tx=0x7f22a800cb40 comp rx=0 tx=0).stop 2023-07-21T22:35:03.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.430+0000 7f22bcddf640 1 -- 172.21.15.6:0/4078151254 shutdown_connections 2023-07-21T22:35:03.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.430+0000 7f22bcddf640 1 --2- 172.21.15.6:0/4078151254 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f22980663a0 0x7f2298068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:03.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.430+0000 7f22bcddf640 1 --2- 172.21.15.6:0/4078151254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22b815fd60 0x7f22b815ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:03.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.430+0000 7f22bcddf640 1 --2- 172.21.15.6:0/4078151254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22b80d1850 0x7f22b8153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:03.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.430+0000 7f22bcddf640 1 --2- 172.21.15.6:0/4078151254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22b80b7c70 0x7f22b814d4e0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:03.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.430+0000 7f22bcddf640 1 -- 172.21.15.6:0/4078151254 >> 172.21.15.6:0/4078151254 conn(0x7f22b80650b0 msgr2=0x7f22b8154400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:03.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.430+0000 7f22bcddf640 1 -- 172.21.15.6:0/4078151254 shutdown_connections 2023-07-21T22:35:03.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.430+0000 7f22bcddf640 1 -- 172.21.15.6:0/4078151254 wait complete. 2023-07-21T22:35:03.501 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-21T22:35:03.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.594+0000 7f3237c34640 1 Processor -- start 2023-07-21T22:35:03.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.598+0000 7f3237c34640 1 -- start start 2023-07-21T22:35:03.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.598+0000 7f3237c34640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f323006a540 0x7f323006a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:03.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.598+0000 7f3237c34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32300cf2e0 0x7f32300cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:03.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.598+0000 7f3237c34640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32300cb7a0 con 0x7f32300cc9c0 2023-07-21T22:35:03.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.598+0000 7f3237c34640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32300d0920 con 0x7f323006a540 2023-07-21T22:35:03.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.598+0000 7f3237c34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323015bfd0 con 0x7f32300cf2e0 2023-07-21T22:35:03.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.598+0000 7f32359d0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f323006a540 0x7f323006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:03.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.598+0000 7f32359d0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f323006a540 0x7f323006a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34594/0 (socket says 172.21.15.6:34594) 2023-07-21T22:35:03.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.598+0000 7f32359d0640 1 -- 172.21.15.6:0/2466852302 learned_addr learned my addr 172.21.15.6:0/2466852302 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:03.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.598+0000 7f32351cf640 1 --2- 172.21.15.6:0/2466852302 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32300cf2e0 0x7f32300cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:03.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.598+0000 7f32359d0640 1 -- 172.21.15.6:0/2466852302 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32300cf2e0 msgr2=0x7f32300cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:03.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.598+0000 7f32359d0640 1 --2- 172.21.15.6:0/2466852302 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32300cf2e0 0x7f32300cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:03.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.598+0000 7f32359d0640 1 -- 172.21.15.6:0/2466852302 >> v1:172.21.15.161:6789/0 conn(0x7f32300cc9c0 legacy=0x7f32300cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:03.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.598+0000 7f32359d0640 1 -- 172.21.15.6:0/2466852302 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323006ae50 con 0x7f323006a540 2023-07-21T22:35:03.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.598+0000 7f32351cf640 1 --2- 172.21.15.6:0/2466852302 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32300cf2e0 0x7f32300cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:03.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.602+0000 7f32359d0640 1 --2- 172.21.15.6:0/2466852302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f323006a540 0x7f323006a910 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f322c009870 tx=0x7f322c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a01ec1f80628ab1f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:03.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.602+0000 7f32349ce640 1 -- 172.21.15.6:0/2466852302 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c0aa670 con 0x7f323006a540 2023-07-21T22:35:03.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.602+0000 7f32349ce640 1 -- 172.21.15.6:0/2466852302 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c0aa7d0 con 0x7f323006a540 2023-07-21T22:35:03.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.602+0000 7f32349ce640 1 -- 172.21.15.6:0/2466852302 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c0aab60 con 0x7f323006a540 2023-07-21T22:35:03.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.602+0000 7f3237c34640 1 -- 172.21.15.6:0/2466852302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f323006a540 msgr2=0x7f323006a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:03.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.602+0000 7f3237c34640 1 --2- 172.21.15.6:0/2466852302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f323006a540 0x7f323006a910 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f322c009870 tx=0x7f322c01c510 comp rx=0 tx=0).stop 2023-07-21T22:35:03.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.602+0000 7f3237c34640 1 -- 172.21.15.6:0/2466852302 shutdown_connections 2023-07-21T22:35:03.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.602+0000 7f3237c34640 1 --2- 172.21.15.6:0/2466852302 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32300cf2e0 0x7f32300cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:03.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.602+0000 7f3237c34640 1 --2- 172.21.15.6:0/2466852302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f323006a540 0x7f323006a910 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:03.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.602+0000 7f3237c34640 1 -- 172.21.15.6:0/2466852302 >> 172.21.15.6:0/2466852302 conn(0x7f3230099490 msgr2=0x7f3230089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:03.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.602+0000 7f3237c34640 1 -- 172.21.15.6:0/2466852302 shutdown_connections 2023-07-21T22:35:03.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.602+0000 7f3237c34640 1 -- 172.21.15.6:0/2466852302 wait complete. 2023-07-21T22:35:03.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.602+0000 7f3237c34640 1 Processor -- start 2023-07-21T22:35:03.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.602+0000 7f3237c34640 1 -- start start 2023-07-21T22:35:03.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f3237c34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f323006a540 0x7f32301f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f3237c34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32300cc9c0 0x7f32300b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f3237c34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32300cf2e0 0x7f32300cded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f3237c34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32301f76e0 con 0x7f32300cf2e0 2023-07-21T22:35:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f3237c34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323015c140 con 0x7f323006a540 2023-07-21T22:35:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f3237c34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323015c420 con 0x7f32300cc9c0 2023-07-21T22:35:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f32361d1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32300cf2e0 0x7f32300cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f32361d1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32300cf2e0 0x7f32300cded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34598/0 (socket says 172.21.15.6:34598) 2023-07-21T22:35:03.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f32361d1640 1 -- 172.21.15.6:0/2514772407 learned_addr learned my addr 172.21.15.6:0/2514772407 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:03.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f32351cf640 1 --2- 172.21.15.6:0/2514772407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32300cc9c0 0x7f32300b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:03.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f32359d0640 1 --2- 172.21.15.6:0/2514772407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f323006a540 0x7f32301f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:03.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f32361d1640 1 -- 172.21.15.6:0/2514772407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32300cc9c0 msgr2=0x7f32300b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:03.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f32361d1640 1 --2- 172.21.15.6:0/2514772407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32300cc9c0 0x7f32300b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:03.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f32361d1640 1 -- 172.21.15.6:0/2514772407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f323006a540 msgr2=0x7f32301f71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:03.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f32361d1640 1 --2- 172.21.15.6:0/2514772407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f323006a540 0x7f32301f71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:03.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f32361d1640 1 -- 172.21.15.6:0/2514772407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c0094d0 con 0x7f32300cf2e0 2023-07-21T22:35:03.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f32359d0640 1 --2- 172.21.15.6:0/2514772407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f323006a540 0x7f32301f71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f32361d1640 1 --2- 172.21.15.6:0/2514772407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32300cf2e0 0x7f32300cded0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f322800c730 tx=0x7f322800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f32267fc640 1 -- 172.21.15.6:0/2514772407 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228003b80 con 0x7f32300cf2e0 2023-07-21T22:35:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f32267fc640 1 -- 172.21.15.6:0/2514772407 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3228003ce0 con 0x7f32300cf2e0 2023-07-21T22:35:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f32267fc640 1 -- 172.21.15.6:0/2514772407 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228005310 con 0x7f32300cf2e0 2023-07-21T22:35:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f3237c34640 1 -- 172.21.15.6:0/2514772407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323015c700 con 0x7f32300cf2e0 2023-07-21T22:35:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f3237c34640 1 -- 172.21.15.6:0/2514772407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32300b4e20 con 0x7f32300cf2e0 2023-07-21T22:35:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f3237c34640 1 -- 172.21.15.6:0/2514772407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323015cf00 con 0x7f32300cf2e0 2023-07-21T22:35:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.606+0000 7f32267fc640 1 -- 172.21.15.6:0/2514772407 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3228005680 con 0x7f32300cf2e0 2023-07-21T22:35:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.610+0000 7f32267fc640 1 --2- 172.21.15.6:0/2514772407 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f32140663a0 0x7f3214068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.610+0000 7f32267fc640 1 -- 172.21.15.6:0/2514772407 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f3228083d30 con 0x7f32300cf2e0 2023-07-21T22:35:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.610+0000 7f32359d0640 1 --2- 172.21.15.6:0/2514772407 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f32140663a0 0x7f3214068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:03.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.610+0000 7f32359d0640 1 --2- 172.21.15.6:0/2514772407 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f32140663a0 0x7f3214068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f322c0ae000 tx=0x7f322c0a7000 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:03.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.614+0000 7f32267fc640 1 -- 172.21.15.6:0/2514772407 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f323015cf00 con 0x7f32300cf2e0 2023-07-21T22:35:03.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:03.802+0000 7f3237c34640 1 -- 172.21.15.6:0/2514772407 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f323015cf00 con 0x7f32300cf2e0 2023-07-21T22:35:04.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.726+0000 7f32267fc640 1 -- 172.21.15.6:0/2514772407 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v38) v1 ==== 118+0+0 (secure 0 0 0) 0x7f323015cf00 con 0x7f32300cf2e0 2023-07-21T22:35:04.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.730+0000 7f3237c34640 1 -- 172.21.15.6:0/2514772407 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f32140663a0 msgr2=0x7f3214068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:04.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.730+0000 7f3237c34640 1 --2- 172.21.15.6:0/2514772407 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f32140663a0 0x7f3214068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f322c0ae000 tx=0x7f322c0a7000 comp rx=0 tx=0).stop 2023-07-21T22:35:04.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.730+0000 7f3237c34640 1 -- 172.21.15.6:0/2514772407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32300cf2e0 msgr2=0x7f32300cded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:04.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.730+0000 7f3237c34640 1 --2- 172.21.15.6:0/2514772407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32300cf2e0 0x7f32300cded0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f322800c730 tx=0x7f322800cbf0 comp rx=0 tx=0).stop 2023-07-21T22:35:04.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.730+0000 7f3237c34640 1 -- 172.21.15.6:0/2514772407 shutdown_connections 2023-07-21T22:35:04.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.730+0000 7f3237c34640 1 --2- 172.21.15.6:0/2514772407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32300cf2e0 0x7f32300cded0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:04.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.730+0000 7f3237c34640 1 --2- 172.21.15.6:0/2514772407 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f32140663a0 0x7f3214068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:04.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.730+0000 7f3237c34640 1 --2- 172.21.15.6:0/2514772407 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32300cc9c0 0x7f32300b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:04.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.730+0000 7f3237c34640 1 --2- 172.21.15.6:0/2514772407 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f323006a540 0x7f32301f71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:04.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.730+0000 7f3237c34640 1 -- 172.21.15.6:0/2514772407 >> 172.21.15.6:0/2514772407 conn(0x7f3230099490 msgr2=0x7f323015b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:04.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.730+0000 7f3237c34640 1 -- 172.21.15.6:0/2514772407 shutdown_connections 2023-07-21T22:35:04.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.730+0000 7f3237c34640 1 -- 172.21.15.6:0/2514772407 wait complete. 2023-07-21T22:35:04.803 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-21T22:35:04.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-21T22:35:04.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.906+0000 7f6c12740640 1 Processor -- start 2023-07-21T22:35:04.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.906+0000 7f6c12740640 1 -- start start 2023-07-21T22:35:04.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.906+0000 7f6c12740640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c0c15bba0 0x7f6c0c0c4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:04.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.906+0000 7f6c12740640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6c0c0c2d30 0x7f6c0c0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:04.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.906+0000 7f6c12740640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c0c15bf70 con 0x7f6c0c0ad280 2023-07-21T22:35:04.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.906+0000 7f6c12740640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c0c0ad700 con 0x7f6c0c15bba0 2023-07-21T22:35:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.906+0000 7f6c12740640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c0c1600e0 con 0x7f6c0c0c2d30 2023-07-21T22:35:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.906+0000 7f6c10cdd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6c0c0ad280 0x7f6c0c0ab890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59832/0 (socket says 172.21.15.6:59832) 2023-07-21T22:35:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.906+0000 7f6c10cdd640 1 -- 172.21.15.6:0/1160438993 learned_addr learned my addr 172.21.15.6:0/1160438993 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.906+0000 7f6c0bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c0c15bba0 0x7f6c0c0c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.906+0000 7f6c0b7fe640 1 --2- 172.21.15.6:0/1160438993 >> v2:172.21.15.161:3300/0 conn(0x7f6c0c0c2d30 0x7f6c0c0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.906+0000 7f6c0bfff640 1 -- 172.21.15.6:0/1160438993 >> v2:172.21.15.161:3300/0 conn(0x7f6c0c0c2d30 msgr2=0x7f6c0c0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.906+0000 7f6c0bfff640 1 --2- 172.21.15.6:0/1160438993 >> v2:172.21.15.161:3300/0 conn(0x7f6c0c0c2d30 0x7f6c0c0acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.906+0000 7f6c0bfff640 1 -- 172.21.15.6:0/1160438993 >> v1:172.21.15.6:6789/0 conn(0x7f6c0c0ad280 legacy=0x7f6c0c0ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.906+0000 7f6c0bfff640 1 -- 172.21.15.6:0/1160438993 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c0c4d00 con 0x7f6c0c15bba0 2023-07-21T22:35:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.906+0000 7f6c0affd640 1 -- 172.21.15.6:0/1160438993 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 155140698 0 0) 0x7f6c0c15bf70 con 0x7f6c0c0ad280 2023-07-21T22:35:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.910+0000 7f6c0bfff640 1 --2- 172.21.15.6:0/1160438993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c0c15bba0 0x7f6c0c0c4620 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0b4080 tx=0x7f6bfc01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6fcc8857fb1b41a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.910+0000 7f6c0affd640 1 -- 172.21.15.6:0/1160438993 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc0ab600 con 0x7f6c0c15bba0 2023-07-21T22:35:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.910+0000 7f6c0affd640 1 -- 172.21.15.6:0/1160438993 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bfc0a7050 con 0x7f6c0c15bba0 2023-07-21T22:35:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.910+0000 7f6c0affd640 1 -- 172.21.15.6:0/1160438993 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc0ab980 con 0x7f6c0c15bba0 2023-07-21T22:35:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.910+0000 7f6c12740640 1 -- 172.21.15.6:0/1160438993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c0c15bba0 msgr2=0x7f6c0c0c4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.910+0000 7f6c12740640 1 --2- 172.21.15.6:0/1160438993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c0c15bba0 0x7f6c0c0c4620 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0b4080 tx=0x7f6bfc01c340 comp rx=0 tx=0).stop 2023-07-21T22:35:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.910+0000 7f6c12740640 1 -- 172.21.15.6:0/1160438993 shutdown_connections 2023-07-21T22:35:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.910+0000 7f6c12740640 1 --2- 172.21.15.6:0/1160438993 >> v2:172.21.15.161:3300/0 conn(0x7f6c0c0c2d30 0x7f6c0c0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.910+0000 7f6c12740640 1 --2- 172.21.15.6:0/1160438993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c0c15bba0 0x7f6c0c0c4620 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.910+0000 7f6c12740640 1 -- 172.21.15.6:0/1160438993 >> 172.21.15.6:0/1160438993 conn(0x7f6c0c0cde90 msgr2=0x7f6c0c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.910+0000 7f6c12740640 1 -- 172.21.15.6:0/1160438993 shutdown_connections 2023-07-21T22:35:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.910+0000 7f6c12740640 1 -- 172.21.15.6:0/1160438993 wait complete. 2023-07-21T22:35:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c12740640 1 Processor -- start 2023-07-21T22:35:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c12740640 1 -- start start 2023-07-21T22:35:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c12740640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c0c0ad280 0x7f6c0c15dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c12740640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c0c0c2d30 0x7f6c0c153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c12740640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c0c15bba0 0x7f6c0c155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c12740640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c15d980 con 0x7f6c0c0c2d30 2023-07-21T22:35:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c12740640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c154160 con 0x7f6c0c0ad280 2023-07-21T22:35:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c12740640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c15cd00 con 0x7f6c0c15bba0 2023-07-21T22:35:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c0b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c0c0c2d30 0x7f6c0c153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c0b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c0c0c2d30 0x7f6c0c153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34628/0 (socket says 172.21.15.6:34628) 2023-07-21T22:35:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c0b7fe640 1 -- 172.21.15.6:0/892104009 learned_addr learned my addr 172.21.15.6:0/892104009 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:04.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c0bfff640 1 --2- 172.21.15.6:0/892104009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c0c0ad280 0x7f6c0c15dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:04.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c0b7fe640 1 -- 172.21.15.6:0/892104009 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c0c15bba0 msgr2=0x7f6c0c155460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:04.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c10cdd640 1 --2- 172.21.15.6:0/892104009 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c0c15bba0 0x7f6c0c155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:04.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c0b7fe640 1 --2- 172.21.15.6:0/892104009 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c0c15bba0 0x7f6c0c155460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c0b7fe640 1 -- 172.21.15.6:0/892104009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c0c0ad280 msgr2=0x7f6c0c15dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c0b7fe640 1 --2- 172.21.15.6:0/892104009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c0c0ad280 0x7f6c0c15dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c0b7fe640 1 -- 172.21.15.6:0/892104009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc009420 con 0x7f6c0c0c2d30 2023-07-21T22:35:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c0bfff640 1 --2- 172.21.15.6:0/892104009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c0c0ad280 0x7f6c0c15dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c10cdd640 1 --2- 172.21.15.6:0/892104009 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c0c15bba0 0x7f6c0c155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c0b7fe640 1 --2- 172.21.15.6:0/892104009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c0c0c2d30 0x7f6c0c153c20 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000d5f0 tx=0x7f6c0000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c08ff9640 1 -- 172.21.15.6:0/892104009 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c000125f0 con 0x7f6c0c0c2d30 2023-07-21T22:35:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c08ff9640 1 -- 172.21.15.6:0/892104009 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c00012750 con 0x7f6c0c0c2d30 2023-07-21T22:35:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c12740640 1 -- 172.21.15.6:0/892104009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0c15cfe0 con 0x7f6c0c0c2d30 2023-07-21T22:35:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c08ff9640 1 -- 172.21.15.6:0/892104009 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c00012ae0 con 0x7f6c0c0c2d30 2023-07-21T22:35:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.914+0000 7f6c12740640 1 -- 172.21.15.6:0/892104009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0c15d5a0 con 0x7f6c0c0c2d30 2023-07-21T22:35:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.918+0000 7f6c12740640 1 -- 172.21.15.6:0/892104009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0c15dac0 con 0x7f6c0c0c2d30 2023-07-21T22:35:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.918+0000 7f6c08ff9640 1 -- 172.21.15.6:0/892104009 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6c00012c40 con 0x7f6c0c0c2d30 2023-07-21T22:35:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.918+0000 7f6c08ff9640 1 --2- 172.21.15.6:0/892104009 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f6bf80663a0 0x7f6bf8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.918+0000 7f6c08ff9640 1 -- 172.21.15.6:0/892104009 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f6c00084410 con 0x7f6c0c0c2d30 2023-07-21T22:35:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.918+0000 7f6c0bfff640 1 --2- 172.21.15.6:0/892104009 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f6bf80663a0 0x7f6bf8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.918+0000 7f6c0bfff640 1 --2- 172.21.15.6:0/892104009 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f6bf80663a0 0x7f6bf8068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0ad000 tx=0x7f6bfc0a6000 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:04.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:04.922+0000 7f6c08ff9640 1 -- 172.21.15.6:0/892104009 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6c0c15dac0 con 0x7f6c0c0c2d30 2023-07-21T22:35:05.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.110+0000 7f6c12740640 1 -- 172.21.15.6:0/892104009 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6c0c15dac0 con 0x7f6c0c0c2d30 2023-07-21T22:35:05.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.730+0000 7f6c08ff9640 1 -- 172.21.15.6:0/892104009 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v39) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6c0c15dac0 con 0x7f6c0c0c2d30 2023-07-21T22:35:05.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.734+0000 7f6c12740640 1 -- 172.21.15.6:0/892104009 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f6bf80663a0 msgr2=0x7f6bf8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:05.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.734+0000 7f6c12740640 1 --2- 172.21.15.6:0/892104009 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f6bf80663a0 0x7f6bf8068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0ad000 tx=0x7f6bfc0a6000 comp rx=0 tx=0).stop 2023-07-21T22:35:05.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.734+0000 7f6c12740640 1 -- 172.21.15.6:0/892104009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c0c0c2d30 msgr2=0x7f6c0c153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:05.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.734+0000 7f6c12740640 1 --2- 172.21.15.6:0/892104009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c0c0c2d30 0x7f6c0c153c20 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000d5f0 tx=0x7f6c0000dab0 comp rx=0 tx=0).stop 2023-07-21T22:35:05.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.734+0000 7f6c12740640 1 -- 172.21.15.6:0/892104009 shutdown_connections 2023-07-21T22:35:05.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.734+0000 7f6c12740640 1 --2- 172.21.15.6:0/892104009 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f6bf80663a0 0x7f6bf8068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:05.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.734+0000 7f6c12740640 1 --2- 172.21.15.6:0/892104009 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c0c15bba0 0x7f6c0c155460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:05.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.734+0000 7f6c12740640 1 --2- 172.21.15.6:0/892104009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c0c0c2d30 0x7f6c0c153c20 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:05.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.734+0000 7f6c12740640 1 --2- 172.21.15.6:0/892104009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c0c0ad280 0x7f6c0c15dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:05.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.734+0000 7f6c12740640 1 -- 172.21.15.6:0/892104009 >> 172.21.15.6:0/892104009 conn(0x7f6c0c0cde90 msgr2=0x7f6c0c154b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:05.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.734+0000 7f6c12740640 1 -- 172.21.15.6:0/892104009 shutdown_connections 2023-07-21T22:35:05.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.734+0000 7f6c12740640 1 -- 172.21.15.6:0/892104009 wait complete. 2023-07-21T22:35:05.807 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-21T22:35:05.807 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:35:05.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.906+0000 7f1116448640 1 Processor -- start 2023-07-21T22:35:05.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.906+0000 7f1116448640 1 -- start start 2023-07-21T22:35:05.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.906+0000 7f1116448640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f111015b7c0 0x7f111006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:05.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.906+0000 7f1116448640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f111006f900 con 0x7f11100cb780 2023-07-21T22:35:05.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.906+0000 7f1116448640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f111015bb90 con 0x7f111006b720 2023-07-21T22:35:05.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.906+0000 7f1116448640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11100cdce0 con 0x7f111015b7c0 2023-07-21T22:35:05.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.906+0000 7f110ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f111015b7c0 0x7f111006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:05.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.906+0000 7f110f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f11100cb780 0x7f111006fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59848/0 (socket says 172.21.15.6:59848) 2023-07-21T22:35:05.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.906+0000 7f110f7fe640 1 -- 172.21.15.6:0/1765922861 learned_addr learned my addr 172.21.15.6:0/1765922861 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:05.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.906+0000 7f110ffff640 1 -- 172.21.15.6:0/1765922861 >> v1:172.21.15.161:6789/0 conn(0x7f111006b720 legacy=0x7f11100ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:05.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.906+0000 7f110ffff640 1 -- 172.21.15.6:0/1765922861 >> v1:172.21.15.6:6789/0 conn(0x7f11100cb780 legacy=0x7f111006fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:05.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.906+0000 7f110ffff640 1 -- 172.21.15.6:0/1765922861 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11100cd450 con 0x7f111015b7c0 2023-07-21T22:35:05.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.910+0000 7f110ffff640 1 --2- 172.21.15.6:0/1765922861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f111015b7c0 0x7f111006b1e0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f11000097c0 tx=0x7f110001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5938b5654f38c1f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:05.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.910+0000 7f110effd640 1 -- 172.21.15.6:0/1765922861 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11000ab600 con 0x7f111015b7c0 2023-07-21T22:35:05.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.910+0000 7f110effd640 1 -- 172.21.15.6:0/1765922861 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11000a7050 con 0x7f111015b7c0 2023-07-21T22:35:05.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.910+0000 7f110effd640 1 -- 172.21.15.6:0/1765922861 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11000ab980 con 0x7f111015b7c0 2023-07-21T22:35:05.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.910+0000 7f1116448640 1 -- 172.21.15.6:0/1765922861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f111015b7c0 msgr2=0x7f111006b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:05.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.910+0000 7f1116448640 1 --2- 172.21.15.6:0/1765922861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f111015b7c0 0x7f111006b1e0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f11000097c0 tx=0x7f110001c440 comp rx=0 tx=0).stop 2023-07-21T22:35:05.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.910+0000 7f1116448640 1 -- 172.21.15.6:0/1765922861 shutdown_connections 2023-07-21T22:35:05.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.910+0000 7f1116448640 1 --2- 172.21.15.6:0/1765922861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f111015b7c0 0x7f111006b1e0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:05.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.910+0000 7f1116448640 1 -- 172.21.15.6:0/1765922861 >> 172.21.15.6:0/1765922861 conn(0x7f11100afcf0 msgr2=0x7f11100b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:05.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.910+0000 7f1116448640 1 -- 172.21.15.6:0/1765922861 shutdown_connections 2023-07-21T22:35:05.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.910+0000 7f1116448640 1 -- 172.21.15.6:0/1765922861 wait complete. 2023-07-21T22:35:05.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.910+0000 7f1116448640 1 Processor -- start 2023-07-21T22:35:05.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f1116448640 1 -- start start 2023-07-21T22:35:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f1116448640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f111006b720 0x7f111014b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f1116448640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f111015b7c0 0x7f1110154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f1116448640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1110154760 0x7f1110156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:05.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f1116448640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11101f9aa0 con 0x7f111015b7c0 2023-07-21T22:35:05.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f1116448640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111014bb90 con 0x7f1110154760 2023-07-21T22:35:05.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f1116448640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11101f9170 con 0x7f111006b720 2023-07-21T22:35:05.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f110f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f111015b7c0 0x7f1110154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:05.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f110f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f111015b7c0 0x7f1110154220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34646/0 (socket says 172.21.15.6:34646) 2023-07-21T22:35:05.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f110f7fe640 1 -- 172.21.15.6:0/3964832999 learned_addr learned my addr 172.21.15.6:0/3964832999 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:05.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f110ffff640 1 --2- 172.21.15.6:0/3964832999 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f111006b720 0x7f111014b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:05.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f11149e5640 1 --2- 172.21.15.6:0/3964832999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1110154760 0x7f1110156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:05.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f110f7fe640 1 -- 172.21.15.6:0/3964832999 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f111006b720 msgr2=0x7f111014b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:05.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f110f7fe640 1 --2- 172.21.15.6:0/3964832999 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f111006b720 0x7f111014b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:05.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f110f7fe640 1 -- 172.21.15.6:0/3964832999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1110154760 msgr2=0x7f1110156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:05.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f110f7fe640 1 --2- 172.21.15.6:0/3964832999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1110154760 0x7f1110156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:05.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f110f7fe640 1 -- 172.21.15.6:0/3964832999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1100009420 con 0x7f111015b7c0 2023-07-21T22:35:05.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f110f7fe640 1 --2- 172.21.15.6:0/3964832999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f111015b7c0 0x7f1110154220 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f110400c500 tx=0x7f110400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:05.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f110cff9640 1 -- 172.21.15.6:0/3964832999 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1104005cf0 con 0x7f111015b7c0 2023-07-21T22:35:05.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f110cff9640 1 -- 172.21.15.6:0/3964832999 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1104005e50 con 0x7f111015b7c0 2023-07-21T22:35:05.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f1116448640 1 -- 172.21.15.6:0/3964832999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11101f9450 con 0x7f111015b7c0 2023-07-21T22:35:05.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f110cff9640 1 -- 172.21.15.6:0/3964832999 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11040072f0 con 0x7f111015b7c0 2023-07-21T22:35:05.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f1116448640 1 -- 172.21.15.6:0/3964832999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11101f8e40 con 0x7f111015b7c0 2023-07-21T22:35:05.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.914+0000 7f1116448640 1 -- 172.21.15.6:0/3964832999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11100c8dc0 con 0x7f111015b7c0 2023-07-21T22:35:05.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.918+0000 7f110cff9640 1 -- 172.21.15.6:0/3964832999 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1104007450 con 0x7f111015b7c0 2023-07-21T22:35:05.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.918+0000 7f110cff9640 1 --2- 172.21.15.6:0/3964832999 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f10fc0663a0 0x7f10fc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:05.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.918+0000 7f110cff9640 1 -- 172.21.15.6:0/3964832999 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f11040832d0 con 0x7f111015b7c0 2023-07-21T22:35:05.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.918+0000 7f110ffff640 1 --2- 172.21.15.6:0/3964832999 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f10fc0663a0 0x7f10fc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:05.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.918+0000 7f110ffff640 1 --2- 172.21.15.6:0/3964832999 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f10fc0663a0 0x7f10fc068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f11000ad000 tx=0x7f11000a6000 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:05.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:05.922+0000 7f110cff9640 1 -- 172.21.15.6:0/3964832999 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1104050750 con 0x7f111015b7c0 2023-07-21T22:35:06.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.110+0000 7f1116448640 1 -- 172.21.15.6:0/3964832999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11101f9c50 con 0x7f111015b7c0 2023-07-21T22:35:06.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.110+0000 7f110cff9640 1 -- 172.21.15.6:0/3964832999 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4670 (secure 0 0 0) 0x7f1104053d70 con 0x7f111015b7c0 2023-07-21T22:35:06.161 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:06.161 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/750234701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":750234701},{"type":"v1","addr":"172.21.15.6:6835","nonce":750234701}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1418940969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1418940969},{"type":"v1","addr":"172.21.15.161:6837","nonce":1418940969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6976,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3127204881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3127204881},{"type":"v1","addr":"172.21.15.161:6836","nonce":3127204881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:35:02.102268+0000","modified":"2023-07-21T22:35:05.730598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7131},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7131":{"gid":7131,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/4157903762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4157903762},{"type":"v1","addr":"172.21.15.6:6833","nonce":4157903762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-21T22:35:06.162 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 39 2023-07-21T22:35:06.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.110+0000 7f1116448640 1 -- 172.21.15.6:0/3964832999 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f10fc0663a0 msgr2=0x7f10fc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.110+0000 7f1116448640 1 --2- 172.21.15.6:0/3964832999 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f10fc0663a0 0x7f10fc068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f11000ad000 tx=0x7f11000a6000 comp rx=0 tx=0).stop 2023-07-21T22:35:06.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.110+0000 7f1116448640 1 -- 172.21.15.6:0/3964832999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f111015b7c0 msgr2=0x7f1110154220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.110+0000 7f1116448640 1 --2- 172.21.15.6:0/3964832999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f111015b7c0 0x7f1110154220 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f110400c500 tx=0x7f110400c9c0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.110+0000 7f1116448640 1 -- 172.21.15.6:0/3964832999 shutdown_connections 2023-07-21T22:35:06.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.110+0000 7f1116448640 1 --2- 172.21.15.6:0/3964832999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1110154760 0x7f1110156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.110+0000 7f1116448640 1 --2- 172.21.15.6:0/3964832999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f111015b7c0 0x7f1110154220 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.110+0000 7f1116448640 1 --2- 172.21.15.6:0/3964832999 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f10fc0663a0 0x7f10fc068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.110+0000 7f1116448640 1 --2- 172.21.15.6:0/3964832999 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f111006b720 0x7f111014b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.110+0000 7f1116448640 1 -- 172.21.15.6:0/3964832999 >> 172.21.15.6:0/3964832999 conn(0x7f11100afcf0 msgr2=0x7f11100ccc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:06.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.110+0000 7f1116448640 1 -- 172.21.15.6:0/3964832999 shutdown_connections 2023-07-21T22:35:06.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.110+0000 7f1116448640 1 -- 172.21.15.6:0/3964832999 wait complete. 2023-07-21T22:35:06.182 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:35:06.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.278+0000 7efe24f9f640 1 Processor -- start 2023-07-21T22:35:06.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.278+0000 7efe24f9f640 1 -- start start 2023-07-21T22:35:06.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.278+0000 7efe24f9f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe200b7c70 0x7efe200d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.278+0000 7efe24f9f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efe2015fd60 0x7efe200d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.278+0000 7efe24f9f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe200ccaf0 con 0x7efe200d1850 2023-07-21T22:35:06.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.278+0000 7efe24f9f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe200d1190 con 0x7efe200b7c70 2023-07-21T22:35:06.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.278+0000 7efe24f9f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe20160600 con 0x7efe2015fd60 2023-07-21T22:35:06.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.278+0000 7efe1e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe200b7c70 0x7efe200d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.278+0000 7efe1e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe200b7c70 0x7efe200d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34656/0 (socket says 172.21.15.6:34656) 2023-07-21T22:35:06.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.278+0000 7efe1e59c640 1 -- 172.21.15.6:0/2338820439 learned_addr learned my addr 172.21.15.6:0/2338820439 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:06.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.278+0000 7efe1ed9d640 1 --2- 172.21.15.6:0/2338820439 >> v2:172.21.15.161:3300/0 conn(0x7efe2015fd60 0x7efe200d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.278+0000 7efe1e59c640 1 -- 172.21.15.6:0/2338820439 >> v2:172.21.15.161:3300/0 conn(0x7efe2015fd60 msgr2=0x7efe200d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:06.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.278+0000 7efe1e59c640 1 --2- 172.21.15.6:0/2338820439 >> v2:172.21.15.161:3300/0 conn(0x7efe2015fd60 0x7efe200d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.278+0000 7efe1e59c640 1 -- 172.21.15.6:0/2338820439 >> v1:172.21.15.161:6789/0 conn(0x7efe200d1850 legacy=0x7efe2015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.278+0000 7efe1e59c640 1 -- 172.21.15.6:0/2338820439 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe20160320 con 0x7efe200b7c70 2023-07-21T22:35:06.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.282+0000 7efe1e59c640 1 --2- 172.21.15.6:0/2338820439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe200b7c70 0x7efe200d0c50 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7efe200b4040 tx=0x7efe1001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd646c6062deca server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:06.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.282+0000 7efe1dd9b640 1 -- 172.21.15.6:0/2338820439 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe100aa650 con 0x7efe200b7c70 2023-07-21T22:35:06.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.282+0000 7efe1dd9b640 1 -- 172.21.15.6:0/2338820439 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe100aa7b0 con 0x7efe200b7c70 2023-07-21T22:35:06.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.282+0000 7efe1dd9b640 1 -- 172.21.15.6:0/2338820439 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe100aab40 con 0x7efe200b7c70 2023-07-21T22:35:06.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.282+0000 7efe24f9f640 1 -- 172.21.15.6:0/2338820439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe200b7c70 msgr2=0x7efe200d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.282+0000 7efe24f9f640 1 --2- 172.21.15.6:0/2338820439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe200b7c70 0x7efe200d0c50 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7efe200b4040 tx=0x7efe1001c4d0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.282+0000 7efe24f9f640 1 -- 172.21.15.6:0/2338820439 shutdown_connections 2023-07-21T22:35:06.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.282+0000 7efe24f9f640 1 --2- 172.21.15.6:0/2338820439 >> v2:172.21.15.161:3300/0 conn(0x7efe2015fd60 0x7efe200d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.282+0000 7efe24f9f640 1 --2- 172.21.15.6:0/2338820439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe200b7c70 0x7efe200d0c50 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.282+0000 7efe24f9f640 1 -- 172.21.15.6:0/2338820439 >> 172.21.15.6:0/2338820439 conn(0x7efe200650b0 msgr2=0x7efe200654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:06.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.282+0000 7efe24f9f640 1 -- 172.21.15.6:0/2338820439 shutdown_connections 2023-07-21T22:35:06.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.282+0000 7efe24f9f640 1 -- 172.21.15.6:0/2338820439 wait complete. 2023-07-21T22:35:06.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe24f9f640 1 Processor -- start 2023-07-21T22:35:06.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe24f9f640 1 -- start start 2023-07-21T22:35:06.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe24f9f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe200b7c70 0x7efe2015e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe24f9f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe200d1850 0x7efe20159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe24f9f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe2015fd60 0x7efe2015a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe24f9f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2015e860 con 0x7efe2015fd60 2023-07-21T22:35:06.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe24f9f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe200b6f40 con 0x7efe200b7c70 2023-07-21T22:35:06.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe24f9f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2015ea90 con 0x7efe200d1850 2023-07-21T22:35:06.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe1ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe2015fd60 0x7efe2015a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe1ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe2015fd60 0x7efe2015a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34670/0 (socket says 172.21.15.6:34670) 2023-07-21T22:35:06.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe1ed9d640 1 -- 172.21.15.6:0/209676614 learned_addr learned my addr 172.21.15.6:0/209676614 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:06.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe1e59c640 1 --2- 172.21.15.6:0/209676614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe200b7c70 0x7efe2015e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe17fff640 1 --2- 172.21.15.6:0/209676614 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe200d1850 0x7efe20159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe1ed9d640 1 -- 172.21.15.6:0/209676614 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe200d1850 msgr2=0x7efe20159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe1ed9d640 1 --2- 172.21.15.6:0/209676614 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe200d1850 0x7efe20159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe1ed9d640 1 -- 172.21.15.6:0/209676614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe200b7c70 msgr2=0x7efe2015e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe1ed9d640 1 --2- 172.21.15.6:0/209676614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe200b7c70 0x7efe2015e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe1ed9d640 1 -- 172.21.15.6:0/209676614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe100094d0 con 0x7efe2015fd60 2023-07-21T22:35:06.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe1ed9d640 1 --2- 172.21.15.6:0/209676614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe2015fd60 0x7efe2015a510 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7efe18007e40 tx=0x7efe1800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:06.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe16ffd640 1 -- 172.21.15.6:0/209676614 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe18014620 con 0x7efe2015fd60 2023-07-21T22:35:06.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe16ffd640 1 -- 172.21.15.6:0/209676614 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1800ee90 con 0x7efe2015fd60 2023-07-21T22:35:06.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe16ffd640 1 -- 172.21.15.6:0/209676614 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe180149e0 con 0x7efe2015fd60 2023-07-21T22:35:06.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe24f9f640 1 -- 172.21.15.6:0/209676614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2015ed70 con 0x7efe2015fd60 2023-07-21T22:35:06.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.286+0000 7efe24f9f640 1 -- 172.21.15.6:0/209676614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe20154570 con 0x7efe2015fd60 2023-07-21T22:35:06.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.290+0000 7efe24f9f640 1 -- 172.21.15.6:0/209676614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe201540f0 con 0x7efe2015fd60 2023-07-21T22:35:06.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.290+0000 7efe16ffd640 1 -- 172.21.15.6:0/209676614 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efe18014b40 con 0x7efe2015fd60 2023-07-21T22:35:06.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.290+0000 7efe16ffd640 1 --2- 172.21.15.6:0/209676614 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7efe000663a0 0x7efe00068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.290+0000 7efe16ffd640 1 -- 172.21.15.6:0/209676614 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6106+0+0 (secure 0 0 0) 0x7efe18084780 con 0x7efe2015fd60 2023-07-21T22:35:06.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.290+0000 7efe1e59c640 1 --2- 172.21.15.6:0/209676614 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7efe000663a0 0x7efe00068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.290+0000 7efe1e59c640 1 --2- 172.21.15.6:0/209676614 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7efe000663a0 0x7efe00068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efe100ae000 tx=0x7efe100b5040 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:06.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.294+0000 7efe16ffd640 1 -- 172.21.15.6:0/209676614 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efe201540f0 con 0x7efe2015fd60 2023-07-21T22:35:06.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.450+0000 7efe24f9f640 1 -- 172.21.15.6:0/209676614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe201540f0 con 0x7efe2015fd60 2023-07-21T22:35:06.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.454+0000 7efe16ffd640 1 -- 172.21.15.6:0/209676614 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18352 (secure 0 0 0) 0x7efe201540f0 con 0x7efe2015fd60 2023-07-21T22:35:06.504 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:06.504 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":98,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:35:03.704304+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:35:00.223294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-21T22:35:01.098128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:35:06.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.454+0000 7efe24f9f640 1 -- 172.21.15.6:0/209676614 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7efe000663a0 msgr2=0x7efe00068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.454+0000 7efe24f9f640 1 --2- 172.21.15.6:0/209676614 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7efe000663a0 0x7efe00068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efe100ae000 tx=0x7efe100b5040 comp rx=0 tx=0).stop 2023-07-21T22:35:06.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.454+0000 7efe24f9f640 1 -- 172.21.15.6:0/209676614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe2015fd60 msgr2=0x7efe2015a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.454+0000 7efe24f9f640 1 --2- 172.21.15.6:0/209676614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe2015fd60 0x7efe2015a510 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7efe18007e40 tx=0x7efe1800e4b0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.454+0000 7efe24f9f640 1 -- 172.21.15.6:0/209676614 shutdown_connections 2023-07-21T22:35:06.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.454+0000 7efe24f9f640 1 --2- 172.21.15.6:0/209676614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe2015fd60 0x7efe2015a510 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.454+0000 7efe24f9f640 1 --2- 172.21.15.6:0/209676614 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7efe000663a0 0x7efe00068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.454+0000 7efe24f9f640 1 --2- 172.21.15.6:0/209676614 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe200d1850 0x7efe20159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.454+0000 7efe24f9f640 1 --2- 172.21.15.6:0/209676614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe200b7c70 0x7efe2015e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.454+0000 7efe24f9f640 1 -- 172.21.15.6:0/209676614 >> 172.21.15.6:0/209676614 conn(0x7efe200650b0 msgr2=0x7efe200cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:06.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.454+0000 7efe24f9f640 1 -- 172.21.15.6:0/209676614 shutdown_connections 2023-07-21T22:35:06.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.454+0000 7efe24f9f640 1 -- 172.21.15.6:0/209676614 wait complete. 2023-07-21T22:35:06.525 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T22:35:06.525 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:35:06.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.618+0000 7fc4a347b640 1 Processor -- start 2023-07-21T22:35:06.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.618+0000 7fc4a347b640 1 -- start start 2023-07-21T22:35:06.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.618+0000 7fc4a347b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc49c158ce0 0x7fc49c070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.618+0000 7fc4a347b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c0c9730 0x7fc49c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.618+0000 7fc4a347b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc49c0cc700 con 0x7fc49c0c8ad0 2023-07-21T22:35:06.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.618+0000 7fc4a347b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc49c0b0ff0 con 0x7fc49c158ce0 2023-07-21T22:35:06.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.618+0000 7fc4a347b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c070c80 con 0x7fc49c0c9730 2023-07-21T22:35:06.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.618+0000 7fc4a1217640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc49c158ce0 0x7fc49c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.618+0000 7fc4a1217640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc49c158ce0 0x7fc49c070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34676/0 (socket says 172.21.15.6:34676) 2023-07-21T22:35:06.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.618+0000 7fc4a1217640 1 -- 172.21.15.6:0/779246803 learned_addr learned my addr 172.21.15.6:0/779246803 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:06.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.618+0000 7fc4a1a18640 1 --2- 172.21.15.6:0/779246803 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c0c9730 0x7fc49c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.622+0000 7fc4a1217640 1 -- 172.21.15.6:0/779246803 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c0c9730 msgr2=0x7fc49c0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.622+0000 7fc4a1217640 1 --2- 172.21.15.6:0/779246803 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c0c9730 0x7fc49c0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.622+0000 7fc4a1217640 1 -- 172.21.15.6:0/779246803 >> v1:172.21.15.161:6789/0 conn(0x7fc49c0c8ad0 legacy=0x7fc49c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.622+0000 7fc4a1217640 1 -- 172.21.15.6:0/779246803 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c0cbdd0 con 0x7fc49c158ce0 2023-07-21T22:35:06.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.622+0000 7fc4a1a18640 1 --2- 172.21.15.6:0/779246803 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c0c9730 0x7fc49c0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:06.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.622+0000 7fc4a1217640 1 --2- 172.21.15.6:0/779246803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c158ce0 0x7fc49c070450 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc498009870 tx=0x7fc49801e600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e949fcd44e21c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:06.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.622+0000 7fc493fff640 1 -- 172.21.15.6:0/779246803 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4980ac680 con 0x7fc49c158ce0 2023-07-21T22:35:06.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.622+0000 7fc493fff640 1 -- 172.21.15.6:0/779246803 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4980ac7e0 con 0x7fc49c158ce0 2023-07-21T22:35:06.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.622+0000 7fc493fff640 1 -- 172.21.15.6:0/779246803 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4980acb70 con 0x7fc49c158ce0 2023-07-21T22:35:06.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.622+0000 7fc4a347b640 1 -- 172.21.15.6:0/779246803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c158ce0 msgr2=0x7fc49c070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.622+0000 7fc4a347b640 1 --2- 172.21.15.6:0/779246803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c158ce0 0x7fc49c070450 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc498009870 tx=0x7fc49801e600 comp rx=0 tx=0).stop 2023-07-21T22:35:06.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.622+0000 7fc4a347b640 1 -- 172.21.15.6:0/779246803 shutdown_connections 2023-07-21T22:35:06.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.622+0000 7fc4a347b640 1 --2- 172.21.15.6:0/779246803 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c0c9730 0x7fc49c0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.622+0000 7fc4a347b640 1 --2- 172.21.15.6:0/779246803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c158ce0 0x7fc49c070450 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.622+0000 7fc4a347b640 1 -- 172.21.15.6:0/779246803 >> 172.21.15.6:0/779246803 conn(0x7fc49c0afcf0 msgr2=0x7fc49c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:06.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a347b640 1 -- 172.21.15.6:0/779246803 shutdown_connections 2023-07-21T22:35:06.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a347b640 1 -- 172.21.15.6:0/779246803 wait complete. 2023-07-21T22:35:06.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a347b640 1 Processor -- start 2023-07-21T22:35:06.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a347b640 1 -- start start 2023-07-21T22:35:06.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a347b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c0c8ad0 0x7fc49c0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a347b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc49c0c9730 0x7fc49c14c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a347b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c158ce0 0x7fc49c150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a347b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c153250 con 0x7fc49c158ce0 2023-07-21T22:35:06.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a347b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c14cec0 con 0x7fc49c0c9730 2023-07-21T22:35:06.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a347b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c14d660 con 0x7fc49c0c8ad0 2023-07-21T22:35:06.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a1a18640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c158ce0 0x7fc49c150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a1a18640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c158ce0 0x7fc49c150660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34690/0 (socket says 172.21.15.6:34690) 2023-07-21T22:35:06.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a1a18640 1 -- 172.21.15.6:0/154168023 learned_addr learned my addr 172.21.15.6:0/154168023 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:06.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a1217640 1 --2- 172.21.15.6:0/154168023 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c0c8ad0 0x7fc49c0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a0a16640 1 --2- 172.21.15.6:0/154168023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc49c0c9730 0x7fc49c14c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a1a18640 1 -- 172.21.15.6:0/154168023 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c0c8ad0 msgr2=0x7fc49c0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a1a18640 1 --2- 172.21.15.6:0/154168023 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c0c8ad0 0x7fc49c0c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a1a18640 1 -- 172.21.15.6:0/154168023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc49c0c9730 msgr2=0x7fc49c14c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a1a18640 1 --2- 172.21.15.6:0/154168023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc49c0c9730 0x7fc49c14c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a1a18640 1 -- 172.21.15.6:0/154168023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4980094d0 con 0x7fc49c158ce0 2023-07-21T22:35:06.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc4a1a18640 1 --2- 172.21.15.6:0/154168023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c158ce0 0x7fc49c150660 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc494007ef0 tx=0x7fc49400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:06.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.626+0000 7fc491ffb640 1 -- 172.21.15.6:0/154168023 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc494003ba0 con 0x7fc49c158ce0 2023-07-21T22:35:06.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.630+0000 7fc491ffb640 1 -- 172.21.15.6:0/154168023 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49400f040 con 0x7fc49c158ce0 2023-07-21T22:35:06.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.630+0000 7fc491ffb640 1 -- 172.21.15.6:0/154168023 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc494004030 con 0x7fc49c158ce0 2023-07-21T22:35:06.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.630+0000 7fc4a347b640 1 -- 172.21.15.6:0/154168023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49c14d940 con 0x7fc49c158ce0 2023-07-21T22:35:06.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.630+0000 7fc4a347b640 1 -- 172.21.15.6:0/154168023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49c14dc20 con 0x7fc49c158ce0 2023-07-21T22:35:06.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.630+0000 7fc4a347b640 1 -- 172.21.15.6:0/154168023 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49c072d90 con 0x7fc49c158ce0 2023-07-21T22:35:06.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.630+0000 7fc491ffb640 1 -- 172.21.15.6:0/154168023 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc494004190 con 0x7fc49c158ce0 2023-07-21T22:35:06.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.630+0000 7fc491ffb640 1 --2- 172.21.15.6:0/154168023 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fc4800663a0 0x7fc480068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.630+0000 7fc491ffb640 1 -- 172.21.15.6:0/154168023 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fc494084300 con 0x7fc49c158ce0 2023-07-21T22:35:06.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.630+0000 7fc4a1217640 1 --2- 172.21.15.6:0/154168023 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fc4800663a0 0x7fc480068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.634+0000 7fc4a1217640 1 --2- 172.21.15.6:0/154168023 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fc4800663a0 0x7fc480068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc4980b0000 tx=0x7fc4980a9000 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:06.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.634+0000 7fc491ffb640 1 -- 172.21.15.6:0/154168023 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc494051530 con 0x7fc49c158ce0 2023-07-21T22:35:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.790+0000 7fc4a347b640 1 -- 172.21.15.6:0/154168023 --> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc49c1590b0 con 0x7fc4800663a0 2023-07-21T22:35:06.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.802+0000 7fc491ffb640 1 -- 172.21.15.6:0/154168023 <== mgr.6763 v2:172.21.15.161:6832/3267017989 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305830 (secure 0 0 0) 0x7fc4980ac600 con 0x7fc4800663a0 2023-07-21T22:35:06.854 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:06.856 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:35:06.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.806+0000 7fc4a347b640 1 -- 172.21.15.6:0/154168023 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fc4800663a0 msgr2=0x7fc480068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.806+0000 7fc4a347b640 1 --2- 172.21.15.6:0/154168023 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fc4800663a0 0x7fc480068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc4980b0000 tx=0x7fc4980a9000 comp rx=0 tx=0).stop 2023-07-21T22:35:06.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.806+0000 7fc4a347b640 1 -- 172.21.15.6:0/154168023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c158ce0 msgr2=0x7fc49c150660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.806+0000 7fc4a347b640 1 --2- 172.21.15.6:0/154168023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c158ce0 0x7fc49c150660 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc494007ef0 tx=0x7fc49400d4a0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.806+0000 7fc4a347b640 1 -- 172.21.15.6:0/154168023 shutdown_connections 2023-07-21T22:35:06.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.806+0000 7fc4a347b640 1 --2- 172.21.15.6:0/154168023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc49c158ce0 0x7fc49c150660 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.806+0000 7fc4a347b640 1 --2- 172.21.15.6:0/154168023 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc49c0c9730 0x7fc49c14c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.806+0000 7fc4a347b640 1 --2- 172.21.15.6:0/154168023 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fc4800663a0 0x7fc480068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.806+0000 7fc4a347b640 1 --2- 172.21.15.6:0/154168023 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc49c0c8ad0 0x7fc49c0c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.806+0000 7fc4a347b640 1 -- 172.21.15.6:0/154168023 >> 172.21.15.6:0/154168023 conn(0x7fc49c0afcf0 msgr2=0x7fc49c1573a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:06.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.806+0000 7fc4a347b640 1 -- 172.21.15.6:0/154168023 shutdown_connections 2023-07-21T22:35:06.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:06.806+0000 7fc4a347b640 1 -- 172.21.15.6:0/154168023 wait complete. 2023-07-21T22:35:06.875 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-21T22:35:06.394540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":311076,"kb_used_data":10212,"kb_used_omap":0,"kb_used_meta":300800,"kb_avail":754663644,"statfs":{"total":773094113280,"available":772775571456,"internally_reserved":0,"allocated":10457088,"data_stored":5777968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308019200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.699228"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712231+0000","last_change":"2023-07-21T22:35:01.712231+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712231+0000","last_undegraded":"2023-07-21T22:35:01.712231+0000","last_fullsized":"2023-07-21T22:35:01.712231+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.708569+0000","last_change":"2023-07-21T22:35:01.708569+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.708569+0000","last_undegraded":"2023-07-21T22:35:01.708569+0000","last_fullsized":"2023-07-21T22:35:01.708569+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714258+0000","last_change":"2023-07-21T22:35:01.714258+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714258+0000","last_undegraded":"2023-07-21T22:35:01.714258+0000","last_fullsized":"2023-07-21T22:35:01.714258+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710591+0000","last_change":"2023-07-21T22:35:01.710591+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710591+0000","last_undegraded":"2023-07-21T22:35:01.710591+0000","last_fullsized":"2023-07-21T22:35:01.710591+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712175+0000","last_change":"2023-07-21T22:35:01.712175+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712175+0000","last_undegraded":"2023-07-21T22:35:01.712175+0000","last_fullsized":"2023-07-21T22:35:01.712175+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.720890+0000","last_change":"2023-07-21T22:35:01.720890+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.720890+0000","last_undegraded":"2023-07-21T22:35:01.720890+0000","last_fullsized":"2023-07-21T22:35:01.720890+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714747+0000","last_change":"2023-07-21T22:35:01.714747+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714747+0000","last_undegraded":"2023-07-21T22:35:01.714747+0000","last_fullsized":"2023-07-21T22:35:01.714747+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.711437+0000","last_change":"2023-07-21T22:35:01.711437+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.711437+0000","last_undegraded":"2023-07-21T22:35:01.711437+0000","last_fullsized":"2023-07-21T22:35:01.711437+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714480+0000","last_change":"2023-07-21T22:35:01.714480+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714480+0000","last_undegraded":"2023-07-21T22:35:01.714480+0000","last_fullsized":"2023-07-21T22:35:01.714480+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710651+0000","last_change":"2023-07-21T22:35:01.710651+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710651+0000","last_undegraded":"2023-07-21T22:35:01.710651+0000","last_fullsized":"2023-07-21T22:35:01.710651+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.706954+0000","last_change":"2023-07-21T22:35:01.706954+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.706954+0000","last_undegraded":"2023-07-21T22:35:01.706954+0000","last_fullsized":"2023-07-21T22:35:01.706954+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710152+0000","last_change":"2023-07-21T22:35:01.710152+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710152+0000","last_undegraded":"2023-07-21T22:35:01.710152+0000","last_fullsized":"2023-07-21T22:35:01.710152+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710870+0000","last_change":"2023-07-21T22:35:01.710870+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710870+0000","last_undegraded":"2023-07-21T22:35:01.710870+0000","last_fullsized":"2023-07-21T22:35:01.710870+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.720413+0000","last_change":"2023-07-21T22:35:01.720413+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.720413+0000","last_undegraded":"2023-07-21T22:35:01.720413+0000","last_fullsized":"2023-07-21T22:35:01.720413+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.706015+0000","last_change":"2023-07-21T22:35:01.706015+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.706015+0000","last_undegraded":"2023-07-21T22:35:01.706015+0000","last_fullsized":"2023-07-21T22:35:01.706015+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.713065+0000","last_change":"2023-07-21T22:35:01.713065+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.713065+0000","last_undegraded":"2023-07-21T22:35:01.713065+0000","last_fullsized":"2023-07-21T22:35:01.713065+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.711317+0000","last_change":"2023-07-21T22:35:01.711317+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.711317+0000","last_undegraded":"2023-07-21T22:35:01.711317+0000","last_fullsized":"2023-07-21T22:35:01.711317+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714428+0000","last_change":"2023-07-21T22:35:01.714428+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714428+0000","last_undegraded":"2023-07-21T22:35:01.714428+0000","last_fullsized":"2023-07-21T22:35:01.714428+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.711409+0000","last_change":"2023-07-21T22:35:01.711409+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.711409+0000","last_undegraded":"2023-07-21T22:35:01.711409+0000","last_fullsized":"2023-07-21T22:35:01.711409+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.713783+0000","last_change":"2023-07-21T22:35:01.713783+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.713783+0000","last_undegraded":"2023-07-21T22:35:01.713783+0000","last_fullsized":"2023-07-21T22:35:01.713783+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.715249+0000","last_change":"2023-07-21T22:35:01.715249+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.715249+0000","last_undegraded":"2023-07-21T22:35:01.715249+0000","last_fullsized":"2023-07-21T22:35:01.715249+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714470+0000","last_change":"2023-07-21T22:35:01.714470+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714470+0000","last_undegraded":"2023-07-21T22:35:01.714470+0000","last_fullsized":"2023-07-21T22:35:01.714470+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.715801+0000","last_change":"2023-07-21T22:35:01.715801+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.715801+0000","last_undegraded":"2023-07-21T22:35:01.715801+0000","last_fullsized":"2023-07-21T22:35:01.715801+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.705924+0000","last_change":"2023-07-21T22:35:01.705924+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.705924+0000","last_undegraded":"2023-07-21T22:35:01.705924+0000","last_fullsized":"2023-07-21T22:35:01.705924+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.705356+0000","last_change":"2023-07-21T22:35:01.705356+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.705356+0000","last_undegraded":"2023-07-21T22:35:01.705356+0000","last_fullsized":"2023-07-21T22:35:01.705356+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.709816+0000","last_change":"2023-07-21T22:35:01.709816+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.709816+0000","last_undegraded":"2023-07-21T22:35:01.709816+0000","last_fullsized":"2023-07-21T22:35:01.709816+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.713111+0000","last_change":"2023-07-21T22:35:01.713111+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.713111+0000","last_undegraded":"2023-07-21T22:35:01.713111+0000","last_fullsized":"2023-07-21T22:35:01.713111+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710226+0000","last_change":"2023-07-21T22:35:01.710226+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710226+0000","last_undegraded":"2023-07-21T22:35:01.710226+0000","last_fullsized":"2023-07-21T22:35:01.710226+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.706650+0000","last_change":"2023-07-21T22:35:01.706650+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.706650+0000","last_undegraded":"2023-07-21T22:35:01.706650+0000","last_fullsized":"2023-07-21T22:35:01.706650+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712564+0000","last_change":"2023-07-21T22:35:01.712564+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712564+0000","last_undegraded":"2023-07-21T22:35:01.712564+0000","last_fullsized":"2023-07-21T22:35:01.712564+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714162+0000","last_change":"2023-07-21T22:35:01.714162+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714162+0000","last_undegraded":"2023-07-21T22:35:01.714162+0000","last_fullsized":"2023-07-21T22:35:01.714162+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712159+0000","last_change":"2023-07-21T22:35:01.712159+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712159+0000","last_undegraded":"2023-07-21T22:35:01.712159+0000","last_fullsized":"2023-07-21T22:35:01.712159+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712963+0000","last_change":"2023-07-21T22:35:01.712963+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712963+0000","last_undegraded":"2023-07-21T22:35:01.712963+0000","last_fullsized":"2023-07-21T22:35:01.712963+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.725098+0000","last_change":"2023-07-21T22:35:01.722906+0000","last_active":"2023-07-21T22:35:01.725098+0000","last_peered":"2023-07-21T22:35:01.725098+0000","last_clean":"2023-07-21T22:35:01.725098+0000","last_became_active":"2023-07-21T22:35:01.722556+0000","last_became_peered":"2023-07-21T22:35:01.722556+0000","last_unstale":"2023-07-21T22:35:01.725098+0000","last_undegraded":"2023-07-21T22:35:01.725098+0000","last_fullsized":"2023-07-21T22:35:01.725098+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:19:54.269059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.705333+0000","last_change":"2023-07-21T22:35:01.705333+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.705333+0000","last_undegraded":"2023-07-21T22:35:01.705333+0000","last_fullsized":"2023-07-21T22:35:01.705333+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.732652+0000","last_change":"2023-07-21T22:35:01.730971+0000","last_active":"2023-07-21T22:35:01.732652+0000","last_peered":"2023-07-21T22:35:01.732652+0000","last_clean":"2023-07-21T22:35:01.732652+0000","last_became_active":"2023-07-21T22:35:01.730651+0000","last_became_peered":"2023-07-21T22:35:01.730651+0000","last_unstale":"2023-07-21T22:35:01.732652+0000","last_undegraded":"2023-07-21T22:35:01.732652+0000","last_fullsized":"2023-07-21T22:35:01.732652+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:42:28.676838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.715674+0000","last_change":"2023-07-21T22:35:01.715674+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.715674+0000","last_undegraded":"2023-07-21T22:35:01.715674+0000","last_fullsized":"2023-07-21T22:35:01.715674+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.730566+0000","last_change":"2023-07-21T22:35:01.728487+0000","last_active":"2023-07-21T22:35:01.730566+0000","last_peered":"2023-07-21T22:35:01.730566+0000","last_clean":"2023-07-21T22:35:01.730566+0000","last_became_active":"2023-07-21T22:35:01.728216+0000","last_became_peered":"2023-07-21T22:35:01.728216+0000","last_unstale":"2023-07-21T22:35:01.730566+0000","last_undegraded":"2023-07-21T22:35:01.730566+0000","last_fullsized":"2023-07-21T22:35:01.730566+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:06.598803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714804+0000","last_change":"2023-07-21T22:35:01.714804+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714804+0000","last_undegraded":"2023-07-21T22:35:01.714804+0000","last_fullsized":"2023-07-21T22:35:01.714804+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.731827+0000","last_change":"2023-07-21T22:35:01.727508+0000","last_active":"2023-07-21T22:35:01.731827+0000","last_peered":"2023-07-21T22:35:01.731827+0000","last_clean":"2023-07-21T22:35:01.731827+0000","last_became_active":"2023-07-21T22:35:01.726844+0000","last_became_peered":"2023-07-21T22:35:01.726844+0000","last_unstale":"2023-07-21T22:35:01.731827+0000","last_undegraded":"2023-07-21T22:35:01.731827+0000","last_fullsized":"2023-07-21T22:35:01.731827+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:54:47.554576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.706889+0000","last_change":"2023-07-21T22:35:01.706889+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.706889+0000","last_undegraded":"2023-07-21T22:35:01.706889+0000","last_fullsized":"2023-07-21T22:35:01.706889+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.724799+0000","last_change":"2023-07-21T22:35:01.723132+0000","last_active":"2023-07-21T22:35:01.724799+0000","last_peered":"2023-07-21T22:35:01.724799+0000","last_clean":"2023-07-21T22:35:01.724799+0000","last_became_active":"2023-07-21T22:35:01.722696+0000","last_became_peered":"2023-07-21T22:35:01.722696+0000","last_unstale":"2023-07-21T22:35:01.724799+0000","last_undegraded":"2023-07-21T22:35:01.724799+0000","last_fullsized":"2023-07-21T22:35:01.724799+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:26:28.209364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.706455+0000","last_change":"2023-07-21T22:35:01.706455+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.706455+0000","last_undegraded":"2023-07-21T22:35:01.706455+0000","last_fullsized":"2023-07-21T22:35:01.706455+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.729052+0000","last_change":"2023-07-21T22:35:01.725943+0000","last_active":"2023-07-21T22:35:01.729052+0000","last_peered":"2023-07-21T22:35:01.729052+0000","last_clean":"2023-07-21T22:35:01.729052+0000","last_became_active":"2023-07-21T22:35:01.725603+0000","last_became_peered":"2023-07-21T22:35:01.725603+0000","last_unstale":"2023-07-21T22:35:01.729052+0000","last_undegraded":"2023-07-21T22:35:01.729052+0000","last_fullsized":"2023-07-21T22:35:01.729052+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:06:44.768542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.716076+0000","last_change":"2023-07-21T22:35:01.716076+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.716076+0000","last_undegraded":"2023-07-21T22:35:01.716076+0000","last_fullsized":"2023-07-21T22:35:01.716076+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.718307+0000","last_change":"2023-07-21T22:35:01.714572+0000","last_active":"2023-07-21T22:35:01.718307+0000","last_peered":"2023-07-21T22:35:01.718307+0000","last_clean":"2023-07-21T22:35:01.718307+0000","last_became_active":"2023-07-21T22:35:01.714302+0000","last_became_peered":"2023-07-21T22:35:01.714302+0000","last_unstale":"2023-07-21T22:35:01.718307+0000","last_undegraded":"2023-07-21T22:35:01.718307+0000","last_fullsized":"2023-07-21T22:35:01.718307+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:57:16.396822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.717583+0000","last_change":"2023-07-21T22:35:01.717583+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.717583+0000","last_undegraded":"2023-07-21T22:35:01.717583+0000","last_fullsized":"2023-07-21T22:35:01.717583+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.724153+0000","last_change":"2023-07-21T22:35:01.716458+0000","last_active":"2023-07-21T22:35:01.724153+0000","last_peered":"2023-07-21T22:35:01.724153+0000","last_clean":"2023-07-21T22:35:01.724153+0000","last_became_active":"2023-07-21T22:35:01.716115+0000","last_became_peered":"2023-07-21T22:35:01.716115+0000","last_unstale":"2023-07-21T22:35:01.724153+0000","last_undegraded":"2023-07-21T22:35:01.724153+0000","last_fullsized":"2023-07-21T22:35:01.724153+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:21:54.817971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.705327+0000","last_change":"2023-07-21T22:35:01.705327+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.705327+0000","last_undegraded":"2023-07-21T22:35:01.705327+0000","last_fullsized":"2023-07-21T22:35:01.705327+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.732688+0000","last_change":"2023-07-21T22:35:01.731125+0000","last_active":"2023-07-21T22:35:01.732688+0000","last_peered":"2023-07-21T22:35:01.732688+0000","last_clean":"2023-07-21T22:35:01.732688+0000","last_became_active":"2023-07-21T22:35:01.730807+0000","last_became_peered":"2023-07-21T22:35:01.730807+0000","last_unstale":"2023-07-21T22:35:01.732688+0000","last_undegraded":"2023-07-21T22:35:01.732688+0000","last_fullsized":"2023-07-21T22:35:01.732688+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:23:26.713435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.709509+0000","last_change":"2023-07-21T22:35:01.709509+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.709509+0000","last_undegraded":"2023-07-21T22:35:01.709509+0000","last_fullsized":"2023-07-21T22:35:01.709509+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.721870+0000","last_change":"2023-07-21T22:35:01.719096+0000","last_active":"2023-07-21T22:35:01.721870+0000","last_peered":"2023-07-21T22:35:01.721870+0000","last_clean":"2023-07-21T22:35:01.721870+0000","last_became_active":"2023-07-21T22:35:01.718805+0000","last_became_peered":"2023-07-21T22:35:01.718805+0000","last_unstale":"2023-07-21T22:35:01.721870+0000","last_undegraded":"2023-07-21T22:35:01.721870+0000","last_fullsized":"2023-07-21T22:35:01.721870+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:40:07.824667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.719701+0000","last_change":"2023-07-21T22:35:01.719701+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.719701+0000","last_undegraded":"2023-07-21T22:35:01.719701+0000","last_fullsized":"2023-07-21T22:35:01.719701+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.724973+0000","last_change":"2023-07-21T22:35:01.717629+0000","last_active":"2023-07-21T22:35:01.724973+0000","last_peered":"2023-07-21T22:35:01.724973+0000","last_clean":"2023-07-21T22:35:01.724973+0000","last_became_active":"2023-07-21T22:35:01.717342+0000","last_became_peered":"2023-07-21T22:35:01.717342+0000","last_unstale":"2023-07-21T22:35:01.724973+0000","last_undegraded":"2023-07-21T22:35:01.724973+0000","last_fullsized":"2023-07-21T22:35:01.724973+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:41:40.920279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.711573+0000","last_change":"2023-07-21T22:35:01.711573+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.711573+0000","last_undegraded":"2023-07-21T22:35:01.711573+0000","last_fullsized":"2023-07-21T22:35:01.711573+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.731807+0000","last_change":"2023-07-21T22:35:01.727312+0000","last_active":"2023-07-21T22:35:01.731807+0000","last_peered":"2023-07-21T22:35:01.731807+0000","last_clean":"2023-07-21T22:35:01.731807+0000","last_became_active":"2023-07-21T22:35:01.726466+0000","last_became_peered":"2023-07-21T22:35:01.726466+0000","last_unstale":"2023-07-21T22:35:01.731807+0000","last_undegraded":"2023-07-21T22:35:01.731807+0000","last_fullsized":"2023-07-21T22:35:01.731807+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:28:27.414887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.709509+0000","last_change":"2023-07-21T22:35:01.709509+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.709509+0000","last_undegraded":"2023-07-21T22:35:01.709509+0000","last_fullsized":"2023-07-21T22:35:01.709509+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.723408+0000","last_change":"2023-07-21T22:35:01.722302+0000","last_active":"2023-07-21T22:35:01.723408+0000","last_peered":"2023-07-21T22:35:01.723408+0000","last_clean":"2023-07-21T22:35:01.723408+0000","last_became_active":"2023-07-21T22:35:01.722024+0000","last_became_peered":"2023-07-21T22:35:01.722024+0000","last_unstale":"2023-07-21T22:35:01.723408+0000","last_undegraded":"2023-07-21T22:35:01.723408+0000","last_fullsized":"2023-07-21T22:35:01.723408+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:59:22.353202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.716885+0000","last_change":"2023-07-21T22:35:01.716885+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.716885+0000","last_undegraded":"2023-07-21T22:35:01.716885+0000","last_fullsized":"2023-07-21T22:35:01.716885+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.731394+0000","last_change":"2023-07-21T22:35:01.729518+0000","last_active":"2023-07-21T22:35:01.731394+0000","last_peered":"2023-07-21T22:35:01.731394+0000","last_clean":"2023-07-21T22:35:01.731394+0000","last_became_active":"2023-07-21T22:35:01.729250+0000","last_became_peered":"2023-07-21T22:35:01.729250+0000","last_unstale":"2023-07-21T22:35:01.731394+0000","last_undegraded":"2023-07-21T22:35:01.731394+0000","last_fullsized":"2023-07-21T22:35:01.731394+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:16:08.858192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.716467+0000","last_change":"2023-07-21T22:35:01.716467+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.716467+0000","last_undegraded":"2023-07-21T22:35:01.716467+0000","last_fullsized":"2023-07-21T22:35:01.716467+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.725822+0000","last_change":"2023-07-21T22:35:01.723235+0000","last_active":"2023-07-21T22:35:01.725822+0000","last_peered":"2023-07-21T22:35:01.725822+0000","last_clean":"2023-07-21T22:35:01.725822+0000","last_became_active":"2023-07-21T22:35:01.722975+0000","last_became_peered":"2023-07-21T22:35:01.722975+0000","last_unstale":"2023-07-21T22:35:01.725822+0000","last_undegraded":"2023-07-21T22:35:01.725822+0000","last_fullsized":"2023-07-21T22:35:01.725822+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:49:52.024403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.717111+0000","last_change":"2023-07-21T22:35:01.717111+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.717111+0000","last_undegraded":"2023-07-21T22:35:01.717111+0000","last_fullsized":"2023-07-21T22:35:01.717111+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.724785+0000","last_change":"2023-07-21T22:35:01.723581+0000","last_active":"2023-07-21T22:35:01.724785+0000","last_peered":"2023-07-21T22:35:01.724785+0000","last_clean":"2023-07-21T22:35:01.724785+0000","last_became_active":"2023-07-21T22:35:01.723291+0000","last_became_peered":"2023-07-21T22:35:01.723291+0000","last_unstale":"2023-07-21T22:35:01.724785+0000","last_undegraded":"2023-07-21T22:35:01.724785+0000","last_fullsized":"2023-07-21T22:35:01.724785+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:22:14.187151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714232+0000","last_change":"2023-07-21T22:35:01.714232+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714232+0000","last_undegraded":"2023-07-21T22:35:01.714232+0000","last_fullsized":"2023-07-21T22:35:01.714232+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.726298+0000","last_change":"2023-07-21T22:35:01.723963+0000","last_active":"2023-07-21T22:35:01.726298+0000","last_peered":"2023-07-21T22:35:01.726298+0000","last_clean":"2023-07-21T22:35:01.726298+0000","last_became_active":"2023-07-21T22:35:01.723692+0000","last_became_peered":"2023-07-21T22:35:01.723692+0000","last_unstale":"2023-07-21T22:35:01.726298+0000","last_undegraded":"2023-07-21T22:35:01.726298+0000","last_fullsized":"2023-07-21T22:35:01.726298+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:07:52.499504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714235+0000","last_change":"2023-07-21T22:35:01.714235+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714235+0000","last_undegraded":"2023-07-21T22:35:01.714235+0000","last_fullsized":"2023-07-21T22:35:01.714235+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.721208+0000","last_change":"2023-07-21T22:35:01.716816+0000","last_active":"2023-07-21T22:35:01.721208+0000","last_peered":"2023-07-21T22:35:01.721208+0000","last_clean":"2023-07-21T22:35:01.721208+0000","last_became_active":"2023-07-21T22:35:01.716553+0000","last_became_peered":"2023-07-21T22:35:01.716553+0000","last_unstale":"2023-07-21T22:35:01.721208+0000","last_undegraded":"2023-07-21T22:35:01.721208+0000","last_fullsized":"2023-07-21T22:35:01.721208+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:18:23.614312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.713670+0000","last_change":"2023-07-21T22:35:01.713670+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.713670+0000","last_undegraded":"2023-07-21T22:35:01.713670+0000","last_fullsized":"2023-07-21T22:35:01.713670+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.729147+0000","last_change":"2023-07-21T22:35:01.725547+0000","last_active":"2023-07-21T22:35:01.729147+0000","last_peered":"2023-07-21T22:35:01.729147+0000","last_clean":"2023-07-21T22:35:01.729147+0000","last_became_active":"2023-07-21T22:35:01.725139+0000","last_became_peered":"2023-07-21T22:35:01.725139+0000","last_unstale":"2023-07-21T22:35:01.729147+0000","last_undegraded":"2023-07-21T22:35:01.729147+0000","last_fullsized":"2023-07-21T22:35:01.729147+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:09:06.750535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.705531+0000","last_change":"2023-07-21T22:35:01.705531+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.705531+0000","last_undegraded":"2023-07-21T22:35:01.705531+0000","last_fullsized":"2023-07-21T22:35:01.705531+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.732948+0000","last_change":"2023-07-21T22:35:01.731236+0000","last_active":"2023-07-21T22:35:01.732948+0000","last_peered":"2023-07-21T22:35:01.732948+0000","last_clean":"2023-07-21T22:35:01.732948+0000","last_became_active":"2023-07-21T22:35:01.730896+0000","last_became_peered":"2023-07-21T22:35:01.730896+0000","last_unstale":"2023-07-21T22:35:01.732948+0000","last_undegraded":"2023-07-21T22:35:01.732948+0000","last_fullsized":"2023-07-21T22:35:01.732948+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:38:05.731089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.715945+0000","last_change":"2023-07-21T22:35:01.715945+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.715945+0000","last_undegraded":"2023-07-21T22:35:01.715945+0000","last_fullsized":"2023-07-21T22:35:01.715945+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.731825+0000","last_change":"2023-07-21T22:35:01.726833+0000","last_active":"2023-07-21T22:35:01.731825+0000","last_peered":"2023-07-21T22:35:01.731825+0000","last_clean":"2023-07-21T22:35:01.731825+0000","last_became_active":"2023-07-21T22:35:01.726449+0000","last_became_peered":"2023-07-21T22:35:01.726449+0000","last_unstale":"2023-07-21T22:35:01.731825+0000","last_undegraded":"2023-07-21T22:35:01.731825+0000","last_fullsized":"2023-07-21T22:35:01.731825+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:54:24.226939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.716399+0000","last_change":"2023-07-21T22:35:01.716399+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.716399+0000","last_undegraded":"2023-07-21T22:35:01.716399+0000","last_fullsized":"2023-07-21T22:35:01.716399+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.726641+0000","last_change":"2023-07-21T22:35:01.723928+0000","last_active":"2023-07-21T22:35:01.726641+0000","last_peered":"2023-07-21T22:35:01.726641+0000","last_clean":"2023-07-21T22:35:01.726641+0000","last_became_active":"2023-07-21T22:35:01.723645+0000","last_became_peered":"2023-07-21T22:35:01.723645+0000","last_unstale":"2023-07-21T22:35:01.726641+0000","last_undegraded":"2023-07-21T22:35:01.726641+0000","last_fullsized":"2023-07-21T22:35:01.726641+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:38:25.024926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.713064+0000","last_change":"2023-07-21T22:35:01.713064+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.713064+0000","last_undegraded":"2023-07-21T22:35:01.713064+0000","last_fullsized":"2023-07-21T22:35:01.713064+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.731913+0000","last_change":"2023-07-21T22:35:01.728315+0000","last_active":"2023-07-21T22:35:01.731913+0000","last_peered":"2023-07-21T22:35:01.731913+0000","last_clean":"2023-07-21T22:35:01.731913+0000","last_became_active":"2023-07-21T22:35:01.728026+0000","last_became_peered":"2023-07-21T22:35:01.728026+0000","last_unstale":"2023-07-21T22:35:01.731913+0000","last_undegraded":"2023-07-21T22:35:01.731913+0000","last_fullsized":"2023-07-21T22:35:01.731913+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:11:42.430007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712453+0000","last_change":"2023-07-21T22:35:01.712453+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712453+0000","last_undegraded":"2023-07-21T22:35:01.712453+0000","last_fullsized":"2023-07-21T22:35:01.712453+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.726579+0000","last_change":"2023-07-21T22:35:01.724682+0000","last_active":"2023-07-21T22:35:01.726579+0000","last_peered":"2023-07-21T22:35:01.726579+0000","last_clean":"2023-07-21T22:35:01.726579+0000","last_became_active":"2023-07-21T22:35:01.724374+0000","last_became_peered":"2023-07-21T22:35:01.724374+0000","last_unstale":"2023-07-21T22:35:01.726579+0000","last_undegraded":"2023-07-21T22:35:01.726579+0000","last_fullsized":"2023-07-21T22:35:01.726579+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:56:36.405734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712551+0000","last_change":"2023-07-21T22:35:01.712551+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712551+0000","last_undegraded":"2023-07-21T22:35:01.712551+0000","last_fullsized":"2023-07-21T22:35:01.712551+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.729360+0000","last_change":"2023-07-21T22:35:01.727387+0000","last_active":"2023-07-21T22:35:01.729360+0000","last_peered":"2023-07-21T22:35:01.729360+0000","last_clean":"2023-07-21T22:35:01.729360+0000","last_became_active":"2023-07-21T22:35:01.727122+0000","last_became_peered":"2023-07-21T22:35:01.727122+0000","last_unstale":"2023-07-21T22:35:01.729360+0000","last_undegraded":"2023-07-21T22:35:01.729360+0000","last_fullsized":"2023-07-21T22:35:01.729360+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:02:10.200109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"86'183","reported_seq":541,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.719536+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:35:01.719536+0000","last_peered":"2023-07-21T22:35:01.719536+0000","last_clean":"2023-07-21T22:35:01.719536+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:35:01.719536+0000","last_undegraded":"2023-07-21T22:35:01.719536+0000","last_fullsized":"2023-07-21T22:35:01.719536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:11:18.738652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":160,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.711179+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:35:01.711179+0000","last_peered":"2023-07-21T22:35:01.711179+0000","last_clean":"2023-07-21T22:35:01.711179+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:35:01.711179+0000","last_undegraded":"2023-07-21T22:35:01.711179+0000","last_fullsized":"2023-07-21T22:35:01.711179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:47:55.539033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.706360+0000","last_change":"2023-07-21T22:35:01.706360+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.706360+0000","last_undegraded":"2023-07-21T22:35:01.706360+0000","last_fullsized":"2023-07-21T22:35:01.706360+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.729392+0000","last_change":"2023-07-21T22:35:01.728192+0000","last_active":"2023-07-21T22:35:01.729392+0000","last_peered":"2023-07-21T22:35:01.729392+0000","last_clean":"2023-07-21T22:35:01.729392+0000","last_became_active":"2023-07-21T22:35:01.727821+0000","last_became_peered":"2023-07-21T22:35:01.727821+0000","last_unstale":"2023-07-21T22:35:01.729392+0000","last_undegraded":"2023-07-21T22:35:01.729392+0000","last_fullsized":"2023-07-21T22:35:01.729392+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:02.387612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":151,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.719404+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:35:01.719404+0000","last_peered":"2023-07-21T22:35:01.719404+0000","last_clean":"2023-07-21T22:35:01.719404+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:35:01.719404+0000","last_undegraded":"2023-07-21T22:35:01.719404+0000","last_fullsized":"2023-07-21T22:35:01.719404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:20.634736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.716563+0000","last_change":"2023-07-21T22:35:01.716563+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.716563+0000","last_undegraded":"2023-07-21T22:35:01.716563+0000","last_fullsized":"2023-07-21T22:35:01.716563+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.729384+0000","last_change":"2023-07-21T22:35:01.727413+0000","last_active":"2023-07-21T22:35:01.729384+0000","last_peered":"2023-07-21T22:35:01.729384+0000","last_clean":"2023-07-21T22:35:01.729384+0000","last_became_active":"2023-07-21T22:35:01.727047+0000","last_became_peered":"2023-07-21T22:35:01.727047+0000","last_unstale":"2023-07-21T22:35:01.729384+0000","last_undegraded":"2023-07-21T22:35:01.729384+0000","last_fullsized":"2023-07-21T22:35:01.729384+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:38:13.262742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":146,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.707935+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:35:01.707935+0000","last_peered":"2023-07-21T22:35:01.707935+0000","last_clean":"2023-07-21T22:35:01.707935+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:35:01.707935+0000","last_undegraded":"2023-07-21T22:35:01.707935+0000","last_fullsized":"2023-07-21T22:35:01.707935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:05:23.835793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.705682+0000","last_change":"2023-07-21T22:35:01.705682+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.705682+0000","last_undegraded":"2023-07-21T22:35:01.705682+0000","last_fullsized":"2023-07-21T22:35:01.705682+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.724343+0000","last_change":"2023-07-21T22:35:01.721862+0000","last_active":"2023-07-21T22:35:01.724343+0000","last_peered":"2023-07-21T22:35:01.724343+0000","last_clean":"2023-07-21T22:35:01.724343+0000","last_became_active":"2023-07-21T22:35:01.721408+0000","last_became_peered":"2023-07-21T22:35:01.721408+0000","last_unstale":"2023-07-21T22:35:01.724343+0000","last_undegraded":"2023-07-21T22:35:01.724343+0000","last_fullsized":"2023-07-21T22:35:01.724343+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:00:53.717366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":160,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.711418+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:35:01.711418+0000","last_peered":"2023-07-21T22:35:01.711418+0000","last_clean":"2023-07-21T22:35:01.711418+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:35:01.711418+0000","last_undegraded":"2023-07-21T22:35:01.711418+0000","last_fullsized":"2023-07-21T22:35:01.711418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:25:55.112091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710601+0000","last_change":"2023-07-21T22:35:01.710601+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710601+0000","last_undegraded":"2023-07-21T22:35:01.710601+0000","last_fullsized":"2023-07-21T22:35:01.710601+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.724072+0000","last_change":"2023-07-21T22:35:01.716440+0000","last_active":"2023-07-21T22:35:01.724072+0000","last_peered":"2023-07-21T22:35:01.724072+0000","last_clean":"2023-07-21T22:35:01.724072+0000","last_became_active":"2023-07-21T22:35:01.715933+0000","last_became_peered":"2023-07-21T22:35:01.715933+0000","last_unstale":"2023-07-21T22:35:01.724072+0000","last_undegraded":"2023-07-21T22:35:01.724072+0000","last_fullsized":"2023-07-21T22:35:01.724072+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:30:48.422621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":152,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.710289+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:35:01.710289+0000","last_peered":"2023-07-21T22:35:01.710289+0000","last_clean":"2023-07-21T22:35:01.710289+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:35:01.710289+0000","last_undegraded":"2023-07-21T22:35:01.710289+0000","last_fullsized":"2023-07-21T22:35:01.710289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:55:36.920566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712139+0000","last_change":"2023-07-21T22:35:01.712139+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712139+0000","last_undegraded":"2023-07-21T22:35:01.712139+0000","last_fullsized":"2023-07-21T22:35:01.712139+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.727716+0000","last_change":"2023-07-21T22:35:01.725616+0000","last_active":"2023-07-21T22:35:01.727716+0000","last_peered":"2023-07-21T22:35:01.727716+0000","last_clean":"2023-07-21T22:35:01.727716+0000","last_became_active":"2023-07-21T22:35:01.725346+0000","last_became_peered":"2023-07-21T22:35:01.725346+0000","last_unstale":"2023-07-21T22:35:01.727716+0000","last_undegraded":"2023-07-21T22:35:01.727716+0000","last_fullsized":"2023-07-21T22:35:01.727716+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:06:01.167052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":150,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.720917+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:35:01.720917+0000","last_peered":"2023-07-21T22:35:01.720917+0000","last_clean":"2023-07-21T22:35:01.720917+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:35:01.720917+0000","last_undegraded":"2023-07-21T22:35:01.720917+0000","last_fullsized":"2023-07-21T22:35:01.720917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:19:48.326950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.713905+0000","last_change":"2023-07-21T22:35:01.713905+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.713905+0000","last_undegraded":"2023-07-21T22:35:01.713905+0000","last_fullsized":"2023-07-21T22:35:01.713905+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.730178+0000","last_change":"2023-07-21T22:35:01.727961+0000","last_active":"2023-07-21T22:35:01.730178+0000","last_peered":"2023-07-21T22:35:01.730178+0000","last_clean":"2023-07-21T22:35:01.730178+0000","last_became_active":"2023-07-21T22:35:01.727557+0000","last_became_peered":"2023-07-21T22:35:01.727557+0000","last_unstale":"2023-07-21T22:35:01.730178+0000","last_undegraded":"2023-07-21T22:35:01.730178+0000","last_fullsized":"2023-07-21T22:35:01.730178+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:19:40.452038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":152,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.709997+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:35:01.709997+0000","last_peered":"2023-07-21T22:35:01.709997+0000","last_clean":"2023-07-21T22:35:01.709997+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:35:01.709997+0000","last_undegraded":"2023-07-21T22:35:01.709997+0000","last_fullsized":"2023-07-21T22:35:01.709997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:26:53.851830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710828+0000","last_change":"2023-07-21T22:35:01.710828+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710828+0000","last_undegraded":"2023-07-21T22:35:01.710828+0000","last_fullsized":"2023-07-21T22:35:01.710828+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.728606+0000","last_change":"2023-07-21T22:35:01.725476+0000","last_active":"2023-07-21T22:35:01.728606+0000","last_peered":"2023-07-21T22:35:01.728606+0000","last_clean":"2023-07-21T22:35:01.728606+0000","last_became_active":"2023-07-21T22:35:01.725132+0000","last_became_peered":"2023-07-21T22:35:01.725132+0000","last_unstale":"2023-07-21T22:35:01.728606+0000","last_undegraded":"2023-07-21T22:35:01.728606+0000","last_fullsized":"2023-07-21T22:35:01.728606+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:08.737155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":144,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.717882+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:35:01.717882+0000","last_peered":"2023-07-21T22:35:01.717882+0000","last_clean":"2023-07-21T22:35:01.717882+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:35:01.717882+0000","last_undegraded":"2023-07-21T22:35:01.717882+0000","last_fullsized":"2023-07-21T22:35:01.717882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:25:15.500236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509638,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59004,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312836,"statfs":{"total":96636764160,"available":96576344064,"internally_reserved":0,"allocated":1757184,"data_stored":1167524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73299999999999998,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.35299999999999998,"15min":0.32600000000000001},"max":{"1min":1.1180000000000001,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.751},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.36099999999999999},"max":{"1min":0.90900000000000003,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.57299999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.432,"15min":0.379},"max":{"1min":1.0509999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72399999999999998,"15min":0.74299999999999999},"min":{"1min":0.51300000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.405},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72899999999999998,"15min":0.752},"min":{"1min":0.47999999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95699999999999996,"5min":1.409,"15min":1.409},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.504,"15min":0.42099999999999999},"max":{"1min":1.1539999999999999,"5min":1.46,"15min":1.46},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.02,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.59399999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55400000000000005,"15min":0.55900000000000005},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.89900000000000002,"5min":0.90500000000000003,"15min":0.94999999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90400000000000003,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.61299999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64500000000000002,"15min":0.61799999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.56499999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.052,"5min":1.506,"15min":1.506},"last":0.77800000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.048},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.434,"15min":0.42599999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.73399999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542344,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1163264,"data_stored":577156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76700000000000002,"15min":0.76500000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.425},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.59199999999999997,"5min":0.57899999999999996,"15min":0.437},"max":{"1min":1.0289999999999999,"5min":1.1180000000000001,"15min":2.3100000000000001},"last":0.67600000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.55700000000000005,"5min":0.45300000000000001,"15min":0.41999999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.99199999999999999,"5min":0.99399999999999999,"15min":8.6280000000000001},"last":0.85199999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.55600000000000005,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.55},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.80700000000000005,"15min":0.79600000000000004},"min":{"1min":0.59699999999999998,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":1.097,"15min":1.097},"last":0.65600000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.60399999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.7470000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.58399999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92800000000000005,"5min":1.0049999999999999,"15min":1.5129999999999999},"last":0.623}]},{"osd":4,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.374,"15min":0.36599999999999999},"max":{"1min":0.93400000000000005,"5min":1.0229999999999999,"15min":3.1829999999999998},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.80100000000000005,"5min":0.86199999999999999,"15min":2.887},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60899999999999999,"15min":0.61899999999999999},"min":{"1min":0.437,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82799999999999996,"5min":0.96299999999999997,"15min":1.4510000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.50900000000000001,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.88400000000000001,"5min":0.98799999999999999,"15min":1.054},"last":0.69999999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.52400000000000002,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":0.93600000000000005,"5min":1.079,"15min":1.1679999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68899999999999995,"15min":0.71499999999999997},"min":{"1min":0.54100000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82499999999999996,"5min":1.0449999999999999,"15min":8.0760000000000005},"last":0.79000000000000004}]}]},{"osd":5,"up_from":15,"seq":64424509637,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1150976,"data_stored":570484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72799999999999998,"15min":0.71599999999999997},"min":{"1min":0.53000000000000003,"5min":0.35699999999999998,"15min":0.32900000000000001},"max":{"1min":1,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47599999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.76600000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69399999999999995,"15min":0.71399999999999997},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.626},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.505,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":1.617,"15min":1.617},"last":0.70499999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71799999999999997,"15min":0.73599999999999999},"min":{"1min":0.53300000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.92800000000000005,"5min":1.0109999999999999,"15min":1.034},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.53300000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.90800000000000003,"5min":1.512,"15min":1.512},"last":0.78000000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.77200000000000002,"15min":0.78700000000000003},"min":{"1min":0.61299999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98599999999999999,"5min":1.472,"15min":1.472},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.80300000000000005,"15min":0.79700000000000004},"min":{"1min":0.56899999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.022,"5min":1.556,"15min":1.556},"last":0.80700000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.48899999999999999,"5min":0.48599999999999999,"15min":0.44900000000000001},"max":{"1min":0.92400000000000004,"5min":1.012,"15min":1.038},"last":0.65500000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70499999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.62,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92500000000000004,"5min":1.02,"15min":1.02},"last":0.52400000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.64800000000000002,"15min":0.65200000000000002},"min":{"1min":0.55500000000000005,"5min":0.374,"15min":0.374},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.72499999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.85899999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.73799999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509638,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1163264,"data_stored":577156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71999999999999997,"15min":0.74299999999999999},"min":{"1min":0.51200000000000001,"5min":0.438,"15min":0.40000000000000002},"max":{"1min":0.80900000000000005,"5min":0.99399999999999999,"15min":1.0429999999999999},"last":0.62},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73299999999999998,"15min":0.74299999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.83599999999999997,"5min":0.96099999999999997,"15min":0.97599999999999998},"last":0.80700000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.39400000000000002},"max":{"1min":0.85499999999999998,"5min":1.002,"15min":1.0449999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.69399999999999995,"15min":0.69999999999999996},"min":{"1min":0.47299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.872,"5min":0.94299999999999995,"15min":1.016},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.51200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.95899999999999996,"5min":1.048,"15min":1.048},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.53000000000000003,"5min":0.41999999999999998,"15min":0.33000000000000002},"max":{"1min":1.006,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.75900000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72899999999999998,"15min":0.73699999999999999},"min":{"1min":0.51000000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94099999999999995,"5min":0.97999999999999998,"15min":1.026},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58399999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.69699999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.45100000000000001,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98899999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.38500000000000001},"max":{"1min":0.94699999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.57099999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.79200000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64400000000000002,"15min":0.65100000000000002},"min":{"1min":0.45500000000000002,"5min":0.39900000000000002,"15min":0.374},"max":{"1min":0.92100000000000004,"5min":1.0069999999999999,"15min":1.0429999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.135},"last":0.83599999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509637,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1163264,"data_stored":577156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.48799999999999999,"15min":0.48099999999999998},"min":{"1min":0.35099999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70499999999999996,"5min":0.73099999999999998,"15min":0.76400000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.48399999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.30099999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.871},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.94199999999999995},"last":0.42599999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82899999999999996,"5min":1.0449999999999999,"15min":1.1140000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45500000000000002,"5min":0.45100000000000001,"15min":0.40999999999999998},"max":{"1min":0.84399999999999997,"5min":0.95399999999999996,"15min":0.99199999999999999},"last":0.504}]},{"osd":4,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.57599999999999996,"5min":0.48299999999999998,"15min":0.438},"max":{"1min":1.093,"5min":1.093,"15min":1.3240000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82199999999999995,"15min":0.83299999999999996},"min":{"1min":0.68799999999999994,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.488},"last":0.68400000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.60699999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0669999999999999,"5min":1.137,"15min":1.1919999999999999},"last":0.751},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.60399999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0649999999999999,"15min":1.302},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79200000000000004,"15min":0.80100000000000005},"min":{"1min":0.68000000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.02,"5min":1.056,"15min":1.3979999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76500000000000001,"15min":0.78000000000000003},"min":{"1min":0.56899999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0269999999999999,"5min":1.1120000000000001,"15min":1.3899999999999999},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.81000000000000005,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0089999999999999,"5min":1.087,"15min":1.335},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.83699999999999997,"15min":0.83499999999999996},"min":{"1min":0.66100000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.2130000000000001},"last":0.72899999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509639,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54328,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317512,"statfs":{"total":96636764160,"available":96581132288,"internally_reserved":0,"allocated":1163264,"data_stored":577156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.29099999999999998,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.69399999999999995,"5min":0.81200000000000006,"15min":0.94199999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53600000000000003,"15min":0.54900000000000004},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.88300000000000001,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.28199999999999997},"max":{"1min":0.82999999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.436},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80700000000000005,"5min":1.085,"15min":1.085},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.37,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55300000000000005,"15min":0.56899999999999995},"min":{"1min":0.43099999999999999,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":1.161,"15min":1.161},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.67600000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.1579999999999999,"5min":1.2569999999999999,"15min":1.6870000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.79400000000000004,"15min":0.80200000000000005},"min":{"1min":0.57699999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.175,"5min":1.1950000000000001,"15min":1.2689999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.63200000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.2549999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.60599999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.107,"5min":1.206,"15min":1.3089999999999999},"last":0.90300000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.78600000000000003,"15min":0.79800000000000004},"min":{"1min":0.69399999999999995,"5min":0.45500000000000002,"15min":0.40300000000000002},"max":{"1min":1.089,"5min":1.282,"15min":1.3759999999999999},"last":0.75},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.64300000000000002,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.1339999999999999,"5min":1.23,"15min":1.2649999999999999},"last":0.74299999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.80900000000000005,"15min":0.82899999999999996},"min":{"1min":0.64900000000000002,"5min":0.51100000000000001,"15min":0.49099999999999999},"max":{"1min":1.143,"5min":1.2,"15min":1.2909999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.60999999999999999,"5min":0.44900000000000001,"15min":0.44700000000000001},"max":{"1min":1.091,"5min":1.216,"15min":1.3660000000000001},"last":0.67400000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509638,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1150976,"data_stored":570484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.28299999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53500000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.626,"5min":0.872,"15min":0.872},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.5,"15min":0.50700000000000001},"min":{"1min":0.33700000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63200000000000001,"5min":0.76100000000000001,"15min":0.81000000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.29099999999999998},"max":{"1min":0.78900000000000003,"5min":0.83599999999999997,"15min":0.88800000000000001},"last":0.39400000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.57599999999999996,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35799999999999998,"15min":0.33400000000000002},"max":{"1min":0.70799999999999996,"5min":0.84299999999999997,"15min":0.98899999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.505,"15min":0.51700000000000002},"min":{"1min":0.33100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.64200000000000002,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.37}]},{"osd":4,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.748,"15min":0.77000000000000002},"min":{"1min":0.53100000000000003,"5min":0.432,"15min":0.432},"max":{"1min":0.91400000000000003,"5min":1.0860000000000001,"15min":1.234},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.57499999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.014,"5min":1.083,"15min":1.155},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75600000000000001,"15min":0.77800000000000002},"min":{"1min":0.53500000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92500000000000004,"5min":1.0609999999999999,"15min":1.1919999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78500000000000003,"15min":0.80000000000000004},"min":{"1min":0.55200000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.044,"5min":1.121,"15min":1.2849999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78600000000000003,"15min":0.81000000000000005},"min":{"1min":0.57199999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0229999999999999,"5min":1.0580000000000001,"15min":1.23},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76300000000000001,"15min":0.79000000000000004},"min":{"1min":0.50900000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0449999999999999,"5min":1.1020000000000001,"15min":1.3240000000000001},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78600000000000003,"15min":0.80900000000000005},"min":{"1min":0.58599999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.99299999999999999,"5min":1.103,"15min":1.3149999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79000000000000004,"15min":0.80800000000000005},"min":{"1min":0.55500000000000005,"5min":0.52600000000000002,"15min":0.45700000000000002},"max":{"1min":0.97499999999999998,"5min":1.115,"15min":1.3380000000000001},"last":0.71699999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509640,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36848,"kb_used_data":1704,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334992,"statfs":{"total":96636764160,"available":96599031808,"internally_reserved":0,"allocated":1744896,"data_stored":1160852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.50800000000000001},"min":{"1min":0.35899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.67900000000000005,"5min":0.77800000000000002,"15min":0.83199999999999996},"last":0.625}]},{"osd":2,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70999999999999996,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.44,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58199999999999996,"5min":0.871,"15min":0.871},"last":0.58399999999999996}]},{"osd":3,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.35899999999999999,"15min":0.34899999999999998},"max":{"1min":0.76500000000000001,"5min":0.88100000000000001,"15min":0.91300000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.434,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73999999999999999,"5min":1.038,"15min":1.038},"last":0.53600000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.76100000000000001,"15min":0.78100000000000003},"min":{"1min":0.59299999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.321},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.60099999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.093,"5min":1.423,"15min":1.423},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.60299999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0960000000000001,"5min":1.2669999999999999,"15min":1.28},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.78400000000000003,"15min":0.80900000000000005},"min":{"1min":0.70599999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.393},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78500000000000003,"15min":0.81299999999999994},"min":{"1min":0.61799999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.28},"last":0.753},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81399999999999995,"15min":0.81999999999999995},"min":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.131,"5min":1.333,"15min":1.333},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.65900000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.2310000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.80900000000000005,"15min":0.83399999999999996},"min":{"1min":0.60599999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1930000000000001,"5min":1.296,"15min":1.369},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:35:06.883 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:35:07.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.014+0000 7f10c5ddf640 1 Processor -- start 2023-07-21T22:35:07.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.014+0000 7f10c5ddf640 1 -- start start 2023-07-21T22:35:07.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.014+0000 7f10c5ddf640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f10c00ae1f0 0x7f10c00b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.014+0000 7f10c5ddf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10c006e160 0x7f10c006bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.014+0000 7f10c5ddf640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c006a440 con 0x7f10c006c260 2023-07-21T22:35:07.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.014+0000 7f10c5ddf640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c006c680 con 0x7f10c00ae1f0 2023-07-21T22:35:07.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.014+0000 7f10c5ddf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c00b24f0 con 0x7f10c006e160 2023-07-21T22:35:07.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10bffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f10c006c260 0x7f10c015f7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59856/0 (socket says 172.21.15.6:59856) 2023-07-21T22:35:07.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10bffff640 1 -- 172.21.15.6:0/2032580993 learned_addr learned my addr 172.21.15.6:0/2032580993 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:07.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10bf7fe640 1 --2- 172.21.15.6:0/2032580993 >> v2:172.21.15.161:3300/0 conn(0x7f10c00ae1f0 0x7f10c00b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10beffd640 1 --2- 172.21.15.6:0/2032580993 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10c006e160 0x7f10c006bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10be7fc640 1 -- 172.21.15.6:0/2032580993 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3909474249 0 0) 0x7f10c006a440 con 0x7f10c006c260 2023-07-21T22:35:07.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10be7fc640 1 -- 172.21.15.6:0/2032580993 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10a8003530 con 0x7f10c006c260 2023-07-21T22:35:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10be7fc640 1 -- 172.21.15.6:0/2032580993 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2332616155 0 0) 0x7f10a8003530 con 0x7f10c006c260 2023-07-21T22:35:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10be7fc640 1 -- 172.21.15.6:0/2032580993 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10c006e160 msgr2=0x7f10c006bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10be7fc640 1 --2- 172.21.15.6:0/2032580993 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10c006e160 0x7f10c006bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10be7fc640 1 -- 172.21.15.6:0/2032580993 >> v2:172.21.15.161:3300/0 conn(0x7f10c00ae1f0 msgr2=0x7f10c00b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10be7fc640 1 --2- 172.21.15.6:0/2032580993 >> v2:172.21.15.161:3300/0 conn(0x7f10c00ae1f0 0x7f10c00b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10be7fc640 1 -- 172.21.15.6:0/2032580993 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c00b27d0 con 0x7f10c006c260 2023-07-21T22:35:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10be7fc640 1 -- 172.21.15.6:0/2032580993 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f10b8001a00 con 0x7f10c006c260 2023-07-21T22:35:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10be7fc640 1 -- 172.21.15.6:0/2032580993 >> v1:172.21.15.6:6789/0 conn(0x7f10c006c260 legacy=0x7f10c015f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10be7fc640 1 --2- 172.21.15.6:0/2032580993 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10c006e160 0x7f10a8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10be7fc640 1 --2- 172.21.15.6:0/2032580993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10a8003f00 0x7f10a80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10be7fc640 1 --2- 172.21.15.6:0/2032580993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10a8004d10 0x7f10a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10be7fc640 1 -- 172.21.15.6:0/2032580993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c006c680 con 0x7f10a8004d10 2023-07-21T22:35:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10be7fc640 1 -- 172.21.15.6:0/2032580993 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c00b24f0 con 0x7f10a8003f00 2023-07-21T22:35:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10be7fc640 1 -- 172.21.15.6:0/2032580993 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a800b990 con 0x7f10c006e160 2023-07-21T22:35:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10bffff640 1 --2- 172.21.15.6:0/2032580993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10a8004d10 0x7f10a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10bf7fe640 1 --2- 172.21.15.6:0/2032580993 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10c006e160 0x7f10a8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10beffd640 1 --2- 172.21.15.6:0/2032580993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10a8003f00 0x7f10a80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10bffff640 1 -- 172.21.15.6:0/2032580993 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10c006e160 msgr2=0x7f10a8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:07.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10bffff640 1 --2- 172.21.15.6:0/2032580993 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10c006e160 0x7f10a8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10bffff640 1 -- 172.21.15.6:0/2032580993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10a8003f00 msgr2=0x7f10a80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:07.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10bffff640 1 --2- 172.21.15.6:0/2032580993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10a8003f00 0x7f10a80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10bffff640 1 -- 172.21.15.6:0/2032580993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a8003530 con 0x7f10a8004d10 2023-07-21T22:35:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.018+0000 7f10beffd640 1 --2- 172.21.15.6:0/2032580993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10a8003f00 0x7f10a80047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.022+0000 7f10bffff640 1 --2- 172.21.15.6:0/2032580993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10a8004d10 0x7f10a8005180 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f10b800a860 tx=0x7f10b801d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d1db5b53eb9d18 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:07.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.022+0000 7f10be7fc640 1 -- 172.21.15.6:0/2032580993 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b80ad630 con 0x7f10a8004d10 2023-07-21T22:35:07.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.022+0000 7f10be7fc640 1 -- 172.21.15.6:0/2032580993 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b80a8070 con 0x7f10a8004d10 2023-07-21T22:35:07.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.022+0000 7f10be7fc640 1 -- 172.21.15.6:0/2032580993 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b80ada30 con 0x7f10a8004d10 2023-07-21T22:35:07.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.022+0000 7f10c5ddf640 1 -- 172.21.15.6:0/2032580993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10a8004d10 msgr2=0x7f10a8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:07.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.022+0000 7f10c5ddf640 1 --2- 172.21.15.6:0/2032580993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10a8004d10 0x7f10a8005180 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f10b800a860 tx=0x7f10b801d360 comp rx=0 tx=0).stop 2023-07-21T22:35:07.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.022+0000 7f10bffff640 1 -- 172.21.15.6:0/2032580993 reap_dead start 2023-07-21T22:35:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.022+0000 7f10c5ddf640 1 -- 172.21.15.6:0/2032580993 shutdown_connections 2023-07-21T22:35:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.022+0000 7f10c5ddf640 1 -- 172.21.15.6:0/2032580993 >> 172.21.15.6:0/2032580993 conn(0x7f10c00b1300 msgr2=0x7f10c00ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.022+0000 7f10c5ddf640 1 -- 172.21.15.6:0/2032580993 shutdown_connections 2023-07-21T22:35:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.022+0000 7f10c5ddf640 1 -- 172.21.15.6:0/2032580993 wait complete. 2023-07-21T22:35:07.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.022+0000 7f10c5ddf640 1 Processor -- start 2023-07-21T22:35:07.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.022+0000 7f10c5ddf640 1 -- start start 2023-07-21T22:35:07.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10c5ddf640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10a8004d10 0x7f10c015ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10c5ddf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10c00abae0 0x7f10c00abf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10c5ddf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10c0131740 0x7f10c0131bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10c5ddf640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c00ac490 con 0x7f10c0131740 2023-07-21T22:35:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10c5ddf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c0132490 con 0x7f10c00abae0 2023-07-21T22:35:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10c5ddf640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c01f4cd0 con 0x7f10a8004d10 2023-07-21T22:35:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10bffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10c0131740 0x7f10c0131bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10beffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10c00abae0 0x7f10c00abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10bf7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10a8004d10 0x7f10c015ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10beffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10c00abae0 0x7f10c00abf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:42308/0 (socket says 172.21.15.6:42308) 2023-07-21T22:35:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10beffd640 1 -- 172.21.15.6:0/1281304832 learned_addr learned my addr 172.21.15.6:0/1281304832 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10bffff640 1 -- 172.21.15.6:0/1281304832 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10a8004d10 msgr2=0x7f10c015ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10bffff640 1 --2- 172.21.15.6:0/1281304832 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10a8004d10 0x7f10c015ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10bffff640 1 -- 172.21.15.6:0/1281304832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10c00abae0 msgr2=0x7f10c00abf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10bffff640 1 --2- 172.21.15.6:0/1281304832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10c00abae0 0x7f10c00abf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10bffff640 1 -- 172.21.15.6:0/1281304832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c015f370 con 0x7f10c0131740 2023-07-21T22:35:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10beffd640 1 --2- 172.21.15.6:0/1281304832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10c00abae0 0x7f10c00abf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10bffff640 1 --2- 172.21.15.6:0/1281304832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10c0131740 0x7f10c0131bb0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f10a8004650 tx=0x7f10a8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:07.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10a7fff640 1 -- 172.21.15.6:0/1281304832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b80019c0 con 0x7f10c0131740 2023-07-21T22:35:07.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10a7fff640 1 -- 172.21.15.6:0/1281304832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b8001fe0 con 0x7f10c0131740 2023-07-21T22:35:07.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10a7fff640 1 -- 172.21.15.6:0/1281304832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b80ad630 con 0x7f10c0131740 2023-07-21T22:35:07.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10c5ddf640 1 -- 172.21.15.6:0/1281304832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c01f5160 con 0x7f10c0131740 2023-07-21T22:35:07.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10c5ddf640 1 -- 172.21.15.6:0/1281304832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c01f4680 con 0x7f10c0131740 2023-07-21T22:35:07.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.026+0000 7f10c5ddf640 1 -- 172.21.15.6:0/1281304832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c00678d0 con 0x7f10c0131740 2023-07-21T22:35:07.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.030+0000 7f10a7fff640 1 -- 172.21.15.6:0/1281304832 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f10b80aa030 con 0x7f10c0131740 2023-07-21T22:35:07.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.030+0000 7f10a7fff640 1 --2- 172.21.15.6:0/1281304832 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f10ac0663a0 0x7f10ac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.030+0000 7f10a7fff640 1 -- 172.21.15.6:0/1281304832 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f10b811d8f0 con 0x7f10c0131740 2023-07-21T22:35:07.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.030+0000 7f10bf7fe640 1 --2- 172.21.15.6:0/1281304832 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f10ac0663a0 0x7f10ac068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.030+0000 7f10bf7fe640 1 --2- 172.21.15.6:0/1281304832 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f10ac0663a0 0x7f10ac068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f10c00cde60 tx=0x7f10b0009190 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:07.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.034+0000 7f10a7fff640 1 -- 172.21.15.6:0/1281304832 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f10b80eac60 con 0x7f10c0131740 2023-07-21T22:35:07.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.186+0000 7f10c5ddf640 1 -- 172.21.15.6:0/1281304832 --> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10c00b2d90 con 0x7f10ac0663a0 2023-07-21T22:35:07.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.194+0000 7f10a7fff640 1 -- 172.21.15.6:0/1281304832 <== mgr.6763 v2:172.21.15.161:6832/3267017989 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305830 (secure 0 0 0) 0x7f10b0019070 con 0x7f10ac0663a0 2023-07-21T22:35:07.248 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:07.249 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:35:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.198+0000 7f10c5ddf640 1 -- 172.21.15.6:0/1281304832 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f10ac0663a0 msgr2=0x7f10ac068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.198+0000 7f10c5ddf640 1 --2- 172.21.15.6:0/1281304832 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f10ac0663a0 0x7f10ac068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f10c00cde60 tx=0x7f10b0009190 comp rx=0 tx=0).stop 2023-07-21T22:35:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.198+0000 7f10c5ddf640 1 -- 172.21.15.6:0/1281304832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10c0131740 msgr2=0x7f10c0131bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.198+0000 7f10c5ddf640 1 --2- 172.21.15.6:0/1281304832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10c0131740 0x7f10c0131bb0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f10a8004650 tx=0x7f10a8005800 comp rx=0 tx=0).stop 2023-07-21T22:35:07.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.198+0000 7f10c5ddf640 1 -- 172.21.15.6:0/1281304832 shutdown_connections 2023-07-21T22:35:07.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.198+0000 7f10c5ddf640 1 --2- 172.21.15.6:0/1281304832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10c0131740 0x7f10c0131bb0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.198+0000 7f10c5ddf640 1 --2- 172.21.15.6:0/1281304832 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10c00abae0 0x7f10c00abf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.198+0000 7f10c5ddf640 1 --2- 172.21.15.6:0/1281304832 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f10ac0663a0 0x7f10ac068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.198+0000 7f10c5ddf640 1 --2- 172.21.15.6:0/1281304832 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10a8004d10 0x7f10c015ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.198+0000 7f10c5ddf640 1 -- 172.21.15.6:0/1281304832 >> 172.21.15.6:0/1281304832 conn(0x7f10c00b1300 msgr2=0x7f10c00ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:07.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.198+0000 7f10c5ddf640 1 -- 172.21.15.6:0/1281304832 shutdown_connections 2023-07-21T22:35:07.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.198+0000 7f10c5ddf640 1 -- 172.21.15.6:0/1281304832 wait complete. 2023-07-21T22:35:07.269 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-21T22:35:06.394540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":311076,"kb_used_data":10212,"kb_used_omap":0,"kb_used_meta":300800,"kb_avail":754663644,"statfs":{"total":773094113280,"available":772775571456,"internally_reserved":0,"allocated":10457088,"data_stored":5777968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308019200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.699228"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712231+0000","last_change":"2023-07-21T22:35:01.712231+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712231+0000","last_undegraded":"2023-07-21T22:35:01.712231+0000","last_fullsized":"2023-07-21T22:35:01.712231+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.708569+0000","last_change":"2023-07-21T22:35:01.708569+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.708569+0000","last_undegraded":"2023-07-21T22:35:01.708569+0000","last_fullsized":"2023-07-21T22:35:01.708569+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714258+0000","last_change":"2023-07-21T22:35:01.714258+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714258+0000","last_undegraded":"2023-07-21T22:35:01.714258+0000","last_fullsized":"2023-07-21T22:35:01.714258+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710591+0000","last_change":"2023-07-21T22:35:01.710591+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710591+0000","last_undegraded":"2023-07-21T22:35:01.710591+0000","last_fullsized":"2023-07-21T22:35:01.710591+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712175+0000","last_change":"2023-07-21T22:35:01.712175+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712175+0000","last_undegraded":"2023-07-21T22:35:01.712175+0000","last_fullsized":"2023-07-21T22:35:01.712175+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.720890+0000","last_change":"2023-07-21T22:35:01.720890+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.720890+0000","last_undegraded":"2023-07-21T22:35:01.720890+0000","last_fullsized":"2023-07-21T22:35:01.720890+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714747+0000","last_change":"2023-07-21T22:35:01.714747+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714747+0000","last_undegraded":"2023-07-21T22:35:01.714747+0000","last_fullsized":"2023-07-21T22:35:01.714747+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.711437+0000","last_change":"2023-07-21T22:35:01.711437+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.711437+0000","last_undegraded":"2023-07-21T22:35:01.711437+0000","last_fullsized":"2023-07-21T22:35:01.711437+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714480+0000","last_change":"2023-07-21T22:35:01.714480+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714480+0000","last_undegraded":"2023-07-21T22:35:01.714480+0000","last_fullsized":"2023-07-21T22:35:01.714480+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710651+0000","last_change":"2023-07-21T22:35:01.710651+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710651+0000","last_undegraded":"2023-07-21T22:35:01.710651+0000","last_fullsized":"2023-07-21T22:35:01.710651+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.706954+0000","last_change":"2023-07-21T22:35:01.706954+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.706954+0000","last_undegraded":"2023-07-21T22:35:01.706954+0000","last_fullsized":"2023-07-21T22:35:01.706954+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710152+0000","last_change":"2023-07-21T22:35:01.710152+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710152+0000","last_undegraded":"2023-07-21T22:35:01.710152+0000","last_fullsized":"2023-07-21T22:35:01.710152+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710870+0000","last_change":"2023-07-21T22:35:01.710870+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710870+0000","last_undegraded":"2023-07-21T22:35:01.710870+0000","last_fullsized":"2023-07-21T22:35:01.710870+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.720413+0000","last_change":"2023-07-21T22:35:01.720413+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.720413+0000","last_undegraded":"2023-07-21T22:35:01.720413+0000","last_fullsized":"2023-07-21T22:35:01.720413+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.706015+0000","last_change":"2023-07-21T22:35:01.706015+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.706015+0000","last_undegraded":"2023-07-21T22:35:01.706015+0000","last_fullsized":"2023-07-21T22:35:01.706015+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.713065+0000","last_change":"2023-07-21T22:35:01.713065+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.713065+0000","last_undegraded":"2023-07-21T22:35:01.713065+0000","last_fullsized":"2023-07-21T22:35:01.713065+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.711317+0000","last_change":"2023-07-21T22:35:01.711317+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.711317+0000","last_undegraded":"2023-07-21T22:35:01.711317+0000","last_fullsized":"2023-07-21T22:35:01.711317+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714428+0000","last_change":"2023-07-21T22:35:01.714428+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714428+0000","last_undegraded":"2023-07-21T22:35:01.714428+0000","last_fullsized":"2023-07-21T22:35:01.714428+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.711409+0000","last_change":"2023-07-21T22:35:01.711409+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.711409+0000","last_undegraded":"2023-07-21T22:35:01.711409+0000","last_fullsized":"2023-07-21T22:35:01.711409+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.713783+0000","last_change":"2023-07-21T22:35:01.713783+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.713783+0000","last_undegraded":"2023-07-21T22:35:01.713783+0000","last_fullsized":"2023-07-21T22:35:01.713783+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.715249+0000","last_change":"2023-07-21T22:35:01.715249+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.715249+0000","last_undegraded":"2023-07-21T22:35:01.715249+0000","last_fullsized":"2023-07-21T22:35:01.715249+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714470+0000","last_change":"2023-07-21T22:35:01.714470+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714470+0000","last_undegraded":"2023-07-21T22:35:01.714470+0000","last_fullsized":"2023-07-21T22:35:01.714470+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.715801+0000","last_change":"2023-07-21T22:35:01.715801+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.715801+0000","last_undegraded":"2023-07-21T22:35:01.715801+0000","last_fullsized":"2023-07-21T22:35:01.715801+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.705924+0000","last_change":"2023-07-21T22:35:01.705924+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.705924+0000","last_undegraded":"2023-07-21T22:35:01.705924+0000","last_fullsized":"2023-07-21T22:35:01.705924+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.705356+0000","last_change":"2023-07-21T22:35:01.705356+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.705356+0000","last_undegraded":"2023-07-21T22:35:01.705356+0000","last_fullsized":"2023-07-21T22:35:01.705356+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.709816+0000","last_change":"2023-07-21T22:35:01.709816+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.709816+0000","last_undegraded":"2023-07-21T22:35:01.709816+0000","last_fullsized":"2023-07-21T22:35:01.709816+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.713111+0000","last_change":"2023-07-21T22:35:01.713111+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.713111+0000","last_undegraded":"2023-07-21T22:35:01.713111+0000","last_fullsized":"2023-07-21T22:35:01.713111+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710226+0000","last_change":"2023-07-21T22:35:01.710226+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710226+0000","last_undegraded":"2023-07-21T22:35:01.710226+0000","last_fullsized":"2023-07-21T22:35:01.710226+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.706650+0000","last_change":"2023-07-21T22:35:01.706650+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.706650+0000","last_undegraded":"2023-07-21T22:35:01.706650+0000","last_fullsized":"2023-07-21T22:35:01.706650+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712564+0000","last_change":"2023-07-21T22:35:01.712564+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712564+0000","last_undegraded":"2023-07-21T22:35:01.712564+0000","last_fullsized":"2023-07-21T22:35:01.712564+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714162+0000","last_change":"2023-07-21T22:35:01.714162+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714162+0000","last_undegraded":"2023-07-21T22:35:01.714162+0000","last_fullsized":"2023-07-21T22:35:01.714162+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712159+0000","last_change":"2023-07-21T22:35:01.712159+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712159+0000","last_undegraded":"2023-07-21T22:35:01.712159+0000","last_fullsized":"2023-07-21T22:35:01.712159+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712963+0000","last_change":"2023-07-21T22:35:01.712963+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712963+0000","last_undegraded":"2023-07-21T22:35:01.712963+0000","last_fullsized":"2023-07-21T22:35:01.712963+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.725098+0000","last_change":"2023-07-21T22:35:01.722906+0000","last_active":"2023-07-21T22:35:01.725098+0000","last_peered":"2023-07-21T22:35:01.725098+0000","last_clean":"2023-07-21T22:35:01.725098+0000","last_became_active":"2023-07-21T22:35:01.722556+0000","last_became_peered":"2023-07-21T22:35:01.722556+0000","last_unstale":"2023-07-21T22:35:01.725098+0000","last_undegraded":"2023-07-21T22:35:01.725098+0000","last_fullsized":"2023-07-21T22:35:01.725098+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:19:54.269059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.705333+0000","last_change":"2023-07-21T22:35:01.705333+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.705333+0000","last_undegraded":"2023-07-21T22:35:01.705333+0000","last_fullsized":"2023-07-21T22:35:01.705333+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.732652+0000","last_change":"2023-07-21T22:35:01.730971+0000","last_active":"2023-07-21T22:35:01.732652+0000","last_peered":"2023-07-21T22:35:01.732652+0000","last_clean":"2023-07-21T22:35:01.732652+0000","last_became_active":"2023-07-21T22:35:01.730651+0000","last_became_peered":"2023-07-21T22:35:01.730651+0000","last_unstale":"2023-07-21T22:35:01.732652+0000","last_undegraded":"2023-07-21T22:35:01.732652+0000","last_fullsized":"2023-07-21T22:35:01.732652+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:42:28.676838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.715674+0000","last_change":"2023-07-21T22:35:01.715674+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.715674+0000","last_undegraded":"2023-07-21T22:35:01.715674+0000","last_fullsized":"2023-07-21T22:35:01.715674+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.730566+0000","last_change":"2023-07-21T22:35:01.728487+0000","last_active":"2023-07-21T22:35:01.730566+0000","last_peered":"2023-07-21T22:35:01.730566+0000","last_clean":"2023-07-21T22:35:01.730566+0000","last_became_active":"2023-07-21T22:35:01.728216+0000","last_became_peered":"2023-07-21T22:35:01.728216+0000","last_unstale":"2023-07-21T22:35:01.730566+0000","last_undegraded":"2023-07-21T22:35:01.730566+0000","last_fullsized":"2023-07-21T22:35:01.730566+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:06.598803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714804+0000","last_change":"2023-07-21T22:35:01.714804+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714804+0000","last_undegraded":"2023-07-21T22:35:01.714804+0000","last_fullsized":"2023-07-21T22:35:01.714804+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.731827+0000","last_change":"2023-07-21T22:35:01.727508+0000","last_active":"2023-07-21T22:35:01.731827+0000","last_peered":"2023-07-21T22:35:01.731827+0000","last_clean":"2023-07-21T22:35:01.731827+0000","last_became_active":"2023-07-21T22:35:01.726844+0000","last_became_peered":"2023-07-21T22:35:01.726844+0000","last_unstale":"2023-07-21T22:35:01.731827+0000","last_undegraded":"2023-07-21T22:35:01.731827+0000","last_fullsized":"2023-07-21T22:35:01.731827+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:54:47.554576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.706889+0000","last_change":"2023-07-21T22:35:01.706889+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.706889+0000","last_undegraded":"2023-07-21T22:35:01.706889+0000","last_fullsized":"2023-07-21T22:35:01.706889+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.724799+0000","last_change":"2023-07-21T22:35:01.723132+0000","last_active":"2023-07-21T22:35:01.724799+0000","last_peered":"2023-07-21T22:35:01.724799+0000","last_clean":"2023-07-21T22:35:01.724799+0000","last_became_active":"2023-07-21T22:35:01.722696+0000","last_became_peered":"2023-07-21T22:35:01.722696+0000","last_unstale":"2023-07-21T22:35:01.724799+0000","last_undegraded":"2023-07-21T22:35:01.724799+0000","last_fullsized":"2023-07-21T22:35:01.724799+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:26:28.209364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.706455+0000","last_change":"2023-07-21T22:35:01.706455+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.706455+0000","last_undegraded":"2023-07-21T22:35:01.706455+0000","last_fullsized":"2023-07-21T22:35:01.706455+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.729052+0000","last_change":"2023-07-21T22:35:01.725943+0000","last_active":"2023-07-21T22:35:01.729052+0000","last_peered":"2023-07-21T22:35:01.729052+0000","last_clean":"2023-07-21T22:35:01.729052+0000","last_became_active":"2023-07-21T22:35:01.725603+0000","last_became_peered":"2023-07-21T22:35:01.725603+0000","last_unstale":"2023-07-21T22:35:01.729052+0000","last_undegraded":"2023-07-21T22:35:01.729052+0000","last_fullsized":"2023-07-21T22:35:01.729052+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:06:44.768542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.716076+0000","last_change":"2023-07-21T22:35:01.716076+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.716076+0000","last_undegraded":"2023-07-21T22:35:01.716076+0000","last_fullsized":"2023-07-21T22:35:01.716076+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.718307+0000","last_change":"2023-07-21T22:35:01.714572+0000","last_active":"2023-07-21T22:35:01.718307+0000","last_peered":"2023-07-21T22:35:01.718307+0000","last_clean":"2023-07-21T22:35:01.718307+0000","last_became_active":"2023-07-21T22:35:01.714302+0000","last_became_peered":"2023-07-21T22:35:01.714302+0000","last_unstale":"2023-07-21T22:35:01.718307+0000","last_undegraded":"2023-07-21T22:35:01.718307+0000","last_fullsized":"2023-07-21T22:35:01.718307+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:57:16.396822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.717583+0000","last_change":"2023-07-21T22:35:01.717583+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.717583+0000","last_undegraded":"2023-07-21T22:35:01.717583+0000","last_fullsized":"2023-07-21T22:35:01.717583+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.724153+0000","last_change":"2023-07-21T22:35:01.716458+0000","last_active":"2023-07-21T22:35:01.724153+0000","last_peered":"2023-07-21T22:35:01.724153+0000","last_clean":"2023-07-21T22:35:01.724153+0000","last_became_active":"2023-07-21T22:35:01.716115+0000","last_became_peered":"2023-07-21T22:35:01.716115+0000","last_unstale":"2023-07-21T22:35:01.724153+0000","last_undegraded":"2023-07-21T22:35:01.724153+0000","last_fullsized":"2023-07-21T22:35:01.724153+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:21:54.817971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.705327+0000","last_change":"2023-07-21T22:35:01.705327+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.705327+0000","last_undegraded":"2023-07-21T22:35:01.705327+0000","last_fullsized":"2023-07-21T22:35:01.705327+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.732688+0000","last_change":"2023-07-21T22:35:01.731125+0000","last_active":"2023-07-21T22:35:01.732688+0000","last_peered":"2023-07-21T22:35:01.732688+0000","last_clean":"2023-07-21T22:35:01.732688+0000","last_became_active":"2023-07-21T22:35:01.730807+0000","last_became_peered":"2023-07-21T22:35:01.730807+0000","last_unstale":"2023-07-21T22:35:01.732688+0000","last_undegraded":"2023-07-21T22:35:01.732688+0000","last_fullsized":"2023-07-21T22:35:01.732688+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:23:26.713435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.709509+0000","last_change":"2023-07-21T22:35:01.709509+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.709509+0000","last_undegraded":"2023-07-21T22:35:01.709509+0000","last_fullsized":"2023-07-21T22:35:01.709509+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.721870+0000","last_change":"2023-07-21T22:35:01.719096+0000","last_active":"2023-07-21T22:35:01.721870+0000","last_peered":"2023-07-21T22:35:01.721870+0000","last_clean":"2023-07-21T22:35:01.721870+0000","last_became_active":"2023-07-21T22:35:01.718805+0000","last_became_peered":"2023-07-21T22:35:01.718805+0000","last_unstale":"2023-07-21T22:35:01.721870+0000","last_undegraded":"2023-07-21T22:35:01.721870+0000","last_fullsized":"2023-07-21T22:35:01.721870+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:40:07.824667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.719701+0000","last_change":"2023-07-21T22:35:01.719701+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.719701+0000","last_undegraded":"2023-07-21T22:35:01.719701+0000","last_fullsized":"2023-07-21T22:35:01.719701+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.724973+0000","last_change":"2023-07-21T22:35:01.717629+0000","last_active":"2023-07-21T22:35:01.724973+0000","last_peered":"2023-07-21T22:35:01.724973+0000","last_clean":"2023-07-21T22:35:01.724973+0000","last_became_active":"2023-07-21T22:35:01.717342+0000","last_became_peered":"2023-07-21T22:35:01.717342+0000","last_unstale":"2023-07-21T22:35:01.724973+0000","last_undegraded":"2023-07-21T22:35:01.724973+0000","last_fullsized":"2023-07-21T22:35:01.724973+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:41:40.920279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.711573+0000","last_change":"2023-07-21T22:35:01.711573+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.711573+0000","last_undegraded":"2023-07-21T22:35:01.711573+0000","last_fullsized":"2023-07-21T22:35:01.711573+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.731807+0000","last_change":"2023-07-21T22:35:01.727312+0000","last_active":"2023-07-21T22:35:01.731807+0000","last_peered":"2023-07-21T22:35:01.731807+0000","last_clean":"2023-07-21T22:35:01.731807+0000","last_became_active":"2023-07-21T22:35:01.726466+0000","last_became_peered":"2023-07-21T22:35:01.726466+0000","last_unstale":"2023-07-21T22:35:01.731807+0000","last_undegraded":"2023-07-21T22:35:01.731807+0000","last_fullsized":"2023-07-21T22:35:01.731807+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:28:27.414887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.709509+0000","last_change":"2023-07-21T22:35:01.709509+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.709509+0000","last_undegraded":"2023-07-21T22:35:01.709509+0000","last_fullsized":"2023-07-21T22:35:01.709509+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.723408+0000","last_change":"2023-07-21T22:35:01.722302+0000","last_active":"2023-07-21T22:35:01.723408+0000","last_peered":"2023-07-21T22:35:01.723408+0000","last_clean":"2023-07-21T22:35:01.723408+0000","last_became_active":"2023-07-21T22:35:01.722024+0000","last_became_peered":"2023-07-21T22:35:01.722024+0000","last_unstale":"2023-07-21T22:35:01.723408+0000","last_undegraded":"2023-07-21T22:35:01.723408+0000","last_fullsized":"2023-07-21T22:35:01.723408+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:59:22.353202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.716885+0000","last_change":"2023-07-21T22:35:01.716885+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.716885+0000","last_undegraded":"2023-07-21T22:35:01.716885+0000","last_fullsized":"2023-07-21T22:35:01.716885+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.731394+0000","last_change":"2023-07-21T22:35:01.729518+0000","last_active":"2023-07-21T22:35:01.731394+0000","last_peered":"2023-07-21T22:35:01.731394+0000","last_clean":"2023-07-21T22:35:01.731394+0000","last_became_active":"2023-07-21T22:35:01.729250+0000","last_became_peered":"2023-07-21T22:35:01.729250+0000","last_unstale":"2023-07-21T22:35:01.731394+0000","last_undegraded":"2023-07-21T22:35:01.731394+0000","last_fullsized":"2023-07-21T22:35:01.731394+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:16:08.858192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.716467+0000","last_change":"2023-07-21T22:35:01.716467+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.716467+0000","last_undegraded":"2023-07-21T22:35:01.716467+0000","last_fullsized":"2023-07-21T22:35:01.716467+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.725822+0000","last_change":"2023-07-21T22:35:01.723235+0000","last_active":"2023-07-21T22:35:01.725822+0000","last_peered":"2023-07-21T22:35:01.725822+0000","last_clean":"2023-07-21T22:35:01.725822+0000","last_became_active":"2023-07-21T22:35:01.722975+0000","last_became_peered":"2023-07-21T22:35:01.722975+0000","last_unstale":"2023-07-21T22:35:01.725822+0000","last_undegraded":"2023-07-21T22:35:01.725822+0000","last_fullsized":"2023-07-21T22:35:01.725822+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:49:52.024403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.717111+0000","last_change":"2023-07-21T22:35:01.717111+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.717111+0000","last_undegraded":"2023-07-21T22:35:01.717111+0000","last_fullsized":"2023-07-21T22:35:01.717111+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.724785+0000","last_change":"2023-07-21T22:35:01.723581+0000","last_active":"2023-07-21T22:35:01.724785+0000","last_peered":"2023-07-21T22:35:01.724785+0000","last_clean":"2023-07-21T22:35:01.724785+0000","last_became_active":"2023-07-21T22:35:01.723291+0000","last_became_peered":"2023-07-21T22:35:01.723291+0000","last_unstale":"2023-07-21T22:35:01.724785+0000","last_undegraded":"2023-07-21T22:35:01.724785+0000","last_fullsized":"2023-07-21T22:35:01.724785+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:22:14.187151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714232+0000","last_change":"2023-07-21T22:35:01.714232+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714232+0000","last_undegraded":"2023-07-21T22:35:01.714232+0000","last_fullsized":"2023-07-21T22:35:01.714232+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.726298+0000","last_change":"2023-07-21T22:35:01.723963+0000","last_active":"2023-07-21T22:35:01.726298+0000","last_peered":"2023-07-21T22:35:01.726298+0000","last_clean":"2023-07-21T22:35:01.726298+0000","last_became_active":"2023-07-21T22:35:01.723692+0000","last_became_peered":"2023-07-21T22:35:01.723692+0000","last_unstale":"2023-07-21T22:35:01.726298+0000","last_undegraded":"2023-07-21T22:35:01.726298+0000","last_fullsized":"2023-07-21T22:35:01.726298+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:07:52.499504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714235+0000","last_change":"2023-07-21T22:35:01.714235+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714235+0000","last_undegraded":"2023-07-21T22:35:01.714235+0000","last_fullsized":"2023-07-21T22:35:01.714235+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.721208+0000","last_change":"2023-07-21T22:35:01.716816+0000","last_active":"2023-07-21T22:35:01.721208+0000","last_peered":"2023-07-21T22:35:01.721208+0000","last_clean":"2023-07-21T22:35:01.721208+0000","last_became_active":"2023-07-21T22:35:01.716553+0000","last_became_peered":"2023-07-21T22:35:01.716553+0000","last_unstale":"2023-07-21T22:35:01.721208+0000","last_undegraded":"2023-07-21T22:35:01.721208+0000","last_fullsized":"2023-07-21T22:35:01.721208+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:18:23.614312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.713670+0000","last_change":"2023-07-21T22:35:01.713670+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.713670+0000","last_undegraded":"2023-07-21T22:35:01.713670+0000","last_fullsized":"2023-07-21T22:35:01.713670+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.729147+0000","last_change":"2023-07-21T22:35:01.725547+0000","last_active":"2023-07-21T22:35:01.729147+0000","last_peered":"2023-07-21T22:35:01.729147+0000","last_clean":"2023-07-21T22:35:01.729147+0000","last_became_active":"2023-07-21T22:35:01.725139+0000","last_became_peered":"2023-07-21T22:35:01.725139+0000","last_unstale":"2023-07-21T22:35:01.729147+0000","last_undegraded":"2023-07-21T22:35:01.729147+0000","last_fullsized":"2023-07-21T22:35:01.729147+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:09:06.750535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.705531+0000","last_change":"2023-07-21T22:35:01.705531+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.705531+0000","last_undegraded":"2023-07-21T22:35:01.705531+0000","last_fullsized":"2023-07-21T22:35:01.705531+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.732948+0000","last_change":"2023-07-21T22:35:01.731236+0000","last_active":"2023-07-21T22:35:01.732948+0000","last_peered":"2023-07-21T22:35:01.732948+0000","last_clean":"2023-07-21T22:35:01.732948+0000","last_became_active":"2023-07-21T22:35:01.730896+0000","last_became_peered":"2023-07-21T22:35:01.730896+0000","last_unstale":"2023-07-21T22:35:01.732948+0000","last_undegraded":"2023-07-21T22:35:01.732948+0000","last_fullsized":"2023-07-21T22:35:01.732948+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:38:05.731089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.715945+0000","last_change":"2023-07-21T22:35:01.715945+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.715945+0000","last_undegraded":"2023-07-21T22:35:01.715945+0000","last_fullsized":"2023-07-21T22:35:01.715945+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.731825+0000","last_change":"2023-07-21T22:35:01.726833+0000","last_active":"2023-07-21T22:35:01.731825+0000","last_peered":"2023-07-21T22:35:01.731825+0000","last_clean":"2023-07-21T22:35:01.731825+0000","last_became_active":"2023-07-21T22:35:01.726449+0000","last_became_peered":"2023-07-21T22:35:01.726449+0000","last_unstale":"2023-07-21T22:35:01.731825+0000","last_undegraded":"2023-07-21T22:35:01.731825+0000","last_fullsized":"2023-07-21T22:35:01.731825+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:54:24.226939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.716399+0000","last_change":"2023-07-21T22:35:01.716399+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.716399+0000","last_undegraded":"2023-07-21T22:35:01.716399+0000","last_fullsized":"2023-07-21T22:35:01.716399+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.726641+0000","last_change":"2023-07-21T22:35:01.723928+0000","last_active":"2023-07-21T22:35:01.726641+0000","last_peered":"2023-07-21T22:35:01.726641+0000","last_clean":"2023-07-21T22:35:01.726641+0000","last_became_active":"2023-07-21T22:35:01.723645+0000","last_became_peered":"2023-07-21T22:35:01.723645+0000","last_unstale":"2023-07-21T22:35:01.726641+0000","last_undegraded":"2023-07-21T22:35:01.726641+0000","last_fullsized":"2023-07-21T22:35:01.726641+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:38:25.024926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.713064+0000","last_change":"2023-07-21T22:35:01.713064+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.713064+0000","last_undegraded":"2023-07-21T22:35:01.713064+0000","last_fullsized":"2023-07-21T22:35:01.713064+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.731913+0000","last_change":"2023-07-21T22:35:01.728315+0000","last_active":"2023-07-21T22:35:01.731913+0000","last_peered":"2023-07-21T22:35:01.731913+0000","last_clean":"2023-07-21T22:35:01.731913+0000","last_became_active":"2023-07-21T22:35:01.728026+0000","last_became_peered":"2023-07-21T22:35:01.728026+0000","last_unstale":"2023-07-21T22:35:01.731913+0000","last_undegraded":"2023-07-21T22:35:01.731913+0000","last_fullsized":"2023-07-21T22:35:01.731913+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:11:42.430007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712453+0000","last_change":"2023-07-21T22:35:01.712453+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712453+0000","last_undegraded":"2023-07-21T22:35:01.712453+0000","last_fullsized":"2023-07-21T22:35:01.712453+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.726579+0000","last_change":"2023-07-21T22:35:01.724682+0000","last_active":"2023-07-21T22:35:01.726579+0000","last_peered":"2023-07-21T22:35:01.726579+0000","last_clean":"2023-07-21T22:35:01.726579+0000","last_became_active":"2023-07-21T22:35:01.724374+0000","last_became_peered":"2023-07-21T22:35:01.724374+0000","last_unstale":"2023-07-21T22:35:01.726579+0000","last_undegraded":"2023-07-21T22:35:01.726579+0000","last_fullsized":"2023-07-21T22:35:01.726579+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:56:36.405734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712551+0000","last_change":"2023-07-21T22:35:01.712551+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712551+0000","last_undegraded":"2023-07-21T22:35:01.712551+0000","last_fullsized":"2023-07-21T22:35:01.712551+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.729360+0000","last_change":"2023-07-21T22:35:01.727387+0000","last_active":"2023-07-21T22:35:01.729360+0000","last_peered":"2023-07-21T22:35:01.729360+0000","last_clean":"2023-07-21T22:35:01.729360+0000","last_became_active":"2023-07-21T22:35:01.727122+0000","last_became_peered":"2023-07-21T22:35:01.727122+0000","last_unstale":"2023-07-21T22:35:01.729360+0000","last_undegraded":"2023-07-21T22:35:01.729360+0000","last_fullsized":"2023-07-21T22:35:01.729360+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:02:10.200109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"86'183","reported_seq":541,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.719536+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:35:01.719536+0000","last_peered":"2023-07-21T22:35:01.719536+0000","last_clean":"2023-07-21T22:35:01.719536+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:35:01.719536+0000","last_undegraded":"2023-07-21T22:35:01.719536+0000","last_fullsized":"2023-07-21T22:35:01.719536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:11:18.738652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":160,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.711179+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:35:01.711179+0000","last_peered":"2023-07-21T22:35:01.711179+0000","last_clean":"2023-07-21T22:35:01.711179+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:35:01.711179+0000","last_undegraded":"2023-07-21T22:35:01.711179+0000","last_fullsized":"2023-07-21T22:35:01.711179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:47:55.539033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.706360+0000","last_change":"2023-07-21T22:35:01.706360+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.706360+0000","last_undegraded":"2023-07-21T22:35:01.706360+0000","last_fullsized":"2023-07-21T22:35:01.706360+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.729392+0000","last_change":"2023-07-21T22:35:01.728192+0000","last_active":"2023-07-21T22:35:01.729392+0000","last_peered":"2023-07-21T22:35:01.729392+0000","last_clean":"2023-07-21T22:35:01.729392+0000","last_became_active":"2023-07-21T22:35:01.727821+0000","last_became_peered":"2023-07-21T22:35:01.727821+0000","last_unstale":"2023-07-21T22:35:01.729392+0000","last_undegraded":"2023-07-21T22:35:01.729392+0000","last_fullsized":"2023-07-21T22:35:01.729392+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:02.387612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":151,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.719404+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:35:01.719404+0000","last_peered":"2023-07-21T22:35:01.719404+0000","last_clean":"2023-07-21T22:35:01.719404+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:35:01.719404+0000","last_undegraded":"2023-07-21T22:35:01.719404+0000","last_fullsized":"2023-07-21T22:35:01.719404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:20.634736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.716563+0000","last_change":"2023-07-21T22:35:01.716563+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.716563+0000","last_undegraded":"2023-07-21T22:35:01.716563+0000","last_fullsized":"2023-07-21T22:35:01.716563+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.729384+0000","last_change":"2023-07-21T22:35:01.727413+0000","last_active":"2023-07-21T22:35:01.729384+0000","last_peered":"2023-07-21T22:35:01.729384+0000","last_clean":"2023-07-21T22:35:01.729384+0000","last_became_active":"2023-07-21T22:35:01.727047+0000","last_became_peered":"2023-07-21T22:35:01.727047+0000","last_unstale":"2023-07-21T22:35:01.729384+0000","last_undegraded":"2023-07-21T22:35:01.729384+0000","last_fullsized":"2023-07-21T22:35:01.729384+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:38:13.262742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":146,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.707935+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:35:01.707935+0000","last_peered":"2023-07-21T22:35:01.707935+0000","last_clean":"2023-07-21T22:35:01.707935+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:35:01.707935+0000","last_undegraded":"2023-07-21T22:35:01.707935+0000","last_fullsized":"2023-07-21T22:35:01.707935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:05:23.835793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.705682+0000","last_change":"2023-07-21T22:35:01.705682+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.705682+0000","last_undegraded":"2023-07-21T22:35:01.705682+0000","last_fullsized":"2023-07-21T22:35:01.705682+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.724343+0000","last_change":"2023-07-21T22:35:01.721862+0000","last_active":"2023-07-21T22:35:01.724343+0000","last_peered":"2023-07-21T22:35:01.724343+0000","last_clean":"2023-07-21T22:35:01.724343+0000","last_became_active":"2023-07-21T22:35:01.721408+0000","last_became_peered":"2023-07-21T22:35:01.721408+0000","last_unstale":"2023-07-21T22:35:01.724343+0000","last_undegraded":"2023-07-21T22:35:01.724343+0000","last_fullsized":"2023-07-21T22:35:01.724343+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:00:53.717366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":160,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.711418+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:35:01.711418+0000","last_peered":"2023-07-21T22:35:01.711418+0000","last_clean":"2023-07-21T22:35:01.711418+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:35:01.711418+0000","last_undegraded":"2023-07-21T22:35:01.711418+0000","last_fullsized":"2023-07-21T22:35:01.711418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:25:55.112091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710601+0000","last_change":"2023-07-21T22:35:01.710601+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710601+0000","last_undegraded":"2023-07-21T22:35:01.710601+0000","last_fullsized":"2023-07-21T22:35:01.710601+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.724072+0000","last_change":"2023-07-21T22:35:01.716440+0000","last_active":"2023-07-21T22:35:01.724072+0000","last_peered":"2023-07-21T22:35:01.724072+0000","last_clean":"2023-07-21T22:35:01.724072+0000","last_became_active":"2023-07-21T22:35:01.715933+0000","last_became_peered":"2023-07-21T22:35:01.715933+0000","last_unstale":"2023-07-21T22:35:01.724072+0000","last_undegraded":"2023-07-21T22:35:01.724072+0000","last_fullsized":"2023-07-21T22:35:01.724072+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:30:48.422621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":152,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.710289+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:35:01.710289+0000","last_peered":"2023-07-21T22:35:01.710289+0000","last_clean":"2023-07-21T22:35:01.710289+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:35:01.710289+0000","last_undegraded":"2023-07-21T22:35:01.710289+0000","last_fullsized":"2023-07-21T22:35:01.710289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:55:36.920566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712139+0000","last_change":"2023-07-21T22:35:01.712139+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712139+0000","last_undegraded":"2023-07-21T22:35:01.712139+0000","last_fullsized":"2023-07-21T22:35:01.712139+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.727716+0000","last_change":"2023-07-21T22:35:01.725616+0000","last_active":"2023-07-21T22:35:01.727716+0000","last_peered":"2023-07-21T22:35:01.727716+0000","last_clean":"2023-07-21T22:35:01.727716+0000","last_became_active":"2023-07-21T22:35:01.725346+0000","last_became_peered":"2023-07-21T22:35:01.725346+0000","last_unstale":"2023-07-21T22:35:01.727716+0000","last_undegraded":"2023-07-21T22:35:01.727716+0000","last_fullsized":"2023-07-21T22:35:01.727716+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:06:01.167052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":150,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.720917+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:35:01.720917+0000","last_peered":"2023-07-21T22:35:01.720917+0000","last_clean":"2023-07-21T22:35:01.720917+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:35:01.720917+0000","last_undegraded":"2023-07-21T22:35:01.720917+0000","last_fullsized":"2023-07-21T22:35:01.720917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:19:48.326950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.713905+0000","last_change":"2023-07-21T22:35:01.713905+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.713905+0000","last_undegraded":"2023-07-21T22:35:01.713905+0000","last_fullsized":"2023-07-21T22:35:01.713905+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.730178+0000","last_change":"2023-07-21T22:35:01.727961+0000","last_active":"2023-07-21T22:35:01.730178+0000","last_peered":"2023-07-21T22:35:01.730178+0000","last_clean":"2023-07-21T22:35:01.730178+0000","last_became_active":"2023-07-21T22:35:01.727557+0000","last_became_peered":"2023-07-21T22:35:01.727557+0000","last_unstale":"2023-07-21T22:35:01.730178+0000","last_undegraded":"2023-07-21T22:35:01.730178+0000","last_fullsized":"2023-07-21T22:35:01.730178+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:19:40.452038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":152,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.709997+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:35:01.709997+0000","last_peered":"2023-07-21T22:35:01.709997+0000","last_clean":"2023-07-21T22:35:01.709997+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:35:01.709997+0000","last_undegraded":"2023-07-21T22:35:01.709997+0000","last_fullsized":"2023-07-21T22:35:01.709997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:26:53.851830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710828+0000","last_change":"2023-07-21T22:35:01.710828+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710828+0000","last_undegraded":"2023-07-21T22:35:01.710828+0000","last_fullsized":"2023-07-21T22:35:01.710828+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.728606+0000","last_change":"2023-07-21T22:35:01.725476+0000","last_active":"2023-07-21T22:35:01.728606+0000","last_peered":"2023-07-21T22:35:01.728606+0000","last_clean":"2023-07-21T22:35:01.728606+0000","last_became_active":"2023-07-21T22:35:01.725132+0000","last_became_peered":"2023-07-21T22:35:01.725132+0000","last_unstale":"2023-07-21T22:35:01.728606+0000","last_undegraded":"2023-07-21T22:35:01.728606+0000","last_fullsized":"2023-07-21T22:35:01.728606+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:08.737155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":144,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.717882+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:35:01.717882+0000","last_peered":"2023-07-21T22:35:01.717882+0000","last_clean":"2023-07-21T22:35:01.717882+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:35:01.717882+0000","last_undegraded":"2023-07-21T22:35:01.717882+0000","last_fullsized":"2023-07-21T22:35:01.717882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:25:15.500236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509638,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59004,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312836,"statfs":{"total":96636764160,"available":96576344064,"internally_reserved":0,"allocated":1757184,"data_stored":1167524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73299999999999998,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.35299999999999998,"15min":0.32600000000000001},"max":{"1min":1.1180000000000001,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.751},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.36099999999999999},"max":{"1min":0.90900000000000003,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.57299999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.432,"15min":0.379},"max":{"1min":1.0509999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72399999999999998,"15min":0.74299999999999999},"min":{"1min":0.51300000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.405},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72899999999999998,"15min":0.752},"min":{"1min":0.47999999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95699999999999996,"5min":1.409,"15min":1.409},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.504,"15min":0.42099999999999999},"max":{"1min":1.1539999999999999,"5min":1.46,"15min":1.46},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.02,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.59399999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55400000000000005,"15min":0.55900000000000005},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.89900000000000002,"5min":0.90500000000000003,"15min":0.94999999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90400000000000003,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.61299999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64500000000000002,"15min":0.61799999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.56499999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.052,"5min":1.506,"15min":1.506},"last":0.77800000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.048},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.434,"15min":0.42599999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.73399999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542344,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1163264,"data_stored":577156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76700000000000002,"15min":0.76500000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.425},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.59199999999999997,"5min":0.57899999999999996,"15min":0.437},"max":{"1min":1.0289999999999999,"5min":1.1180000000000001,"15min":2.3100000000000001},"last":0.67600000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.55700000000000005,"5min":0.45300000000000001,"15min":0.41999999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.99199999999999999,"5min":0.99399999999999999,"15min":8.6280000000000001},"last":0.85199999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.55600000000000005,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.55},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.80700000000000005,"15min":0.79600000000000004},"min":{"1min":0.59699999999999998,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":1.097,"15min":1.097},"last":0.65600000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.60399999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.7470000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.58399999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92800000000000005,"5min":1.0049999999999999,"15min":1.5129999999999999},"last":0.623}]},{"osd":4,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.374,"15min":0.36599999999999999},"max":{"1min":0.93400000000000005,"5min":1.0229999999999999,"15min":3.1829999999999998},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.80100000000000005,"5min":0.86199999999999999,"15min":2.887},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60899999999999999,"15min":0.61899999999999999},"min":{"1min":0.437,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82799999999999996,"5min":0.96299999999999997,"15min":1.4510000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.50900000000000001,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.88400000000000001,"5min":0.98799999999999999,"15min":1.054},"last":0.69999999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.52400000000000002,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":0.93600000000000005,"5min":1.079,"15min":1.1679999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68899999999999995,"15min":0.71499999999999997},"min":{"1min":0.54100000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82499999999999996,"5min":1.0449999999999999,"15min":8.0760000000000005},"last":0.79000000000000004}]}]},{"osd":5,"up_from":15,"seq":64424509637,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1150976,"data_stored":570484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72799999999999998,"15min":0.71599999999999997},"min":{"1min":0.53000000000000003,"5min":0.35699999999999998,"15min":0.32900000000000001},"max":{"1min":1,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47599999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.76600000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69399999999999995,"15min":0.71399999999999997},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.626},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.505,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":1.617,"15min":1.617},"last":0.70499999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71799999999999997,"15min":0.73599999999999999},"min":{"1min":0.53300000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.92800000000000005,"5min":1.0109999999999999,"15min":1.034},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.53300000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.90800000000000003,"5min":1.512,"15min":1.512},"last":0.78000000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.77200000000000002,"15min":0.78700000000000003},"min":{"1min":0.61299999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98599999999999999,"5min":1.472,"15min":1.472},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.80300000000000005,"15min":0.79700000000000004},"min":{"1min":0.56899999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.022,"5min":1.556,"15min":1.556},"last":0.80700000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.48899999999999999,"5min":0.48599999999999999,"15min":0.44900000000000001},"max":{"1min":0.92400000000000004,"5min":1.012,"15min":1.038},"last":0.65500000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70499999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.62,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92500000000000004,"5min":1.02,"15min":1.02},"last":0.52400000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.64800000000000002,"15min":0.65200000000000002},"min":{"1min":0.55500000000000005,"5min":0.374,"15min":0.374},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.72499999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.85899999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.73799999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509638,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1163264,"data_stored":577156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71999999999999997,"15min":0.74299999999999999},"min":{"1min":0.51200000000000001,"5min":0.438,"15min":0.40000000000000002},"max":{"1min":0.80900000000000005,"5min":0.99399999999999999,"15min":1.0429999999999999},"last":0.62},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73299999999999998,"15min":0.74299999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.83599999999999997,"5min":0.96099999999999997,"15min":0.97599999999999998},"last":0.80700000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.39400000000000002},"max":{"1min":0.85499999999999998,"5min":1.002,"15min":1.0449999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.69399999999999995,"15min":0.69999999999999996},"min":{"1min":0.47299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.872,"5min":0.94299999999999995,"15min":1.016},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.51200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.95899999999999996,"5min":1.048,"15min":1.048},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.53000000000000003,"5min":0.41999999999999998,"15min":0.33000000000000002},"max":{"1min":1.006,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.75900000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72899999999999998,"15min":0.73699999999999999},"min":{"1min":0.51000000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94099999999999995,"5min":0.97999999999999998,"15min":1.026},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58399999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.69699999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.45100000000000001,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98899999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.38500000000000001},"max":{"1min":0.94699999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.57099999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.79200000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64400000000000002,"15min":0.65100000000000002},"min":{"1min":0.45500000000000002,"5min":0.39900000000000002,"15min":0.374},"max":{"1min":0.92100000000000004,"5min":1.0069999999999999,"15min":1.0429999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.135},"last":0.83599999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509637,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1163264,"data_stored":577156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.48799999999999999,"15min":0.48099999999999998},"min":{"1min":0.35099999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70499999999999996,"5min":0.73099999999999998,"15min":0.76400000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.48399999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.30099999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.871},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.94199999999999995},"last":0.42599999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82899999999999996,"5min":1.0449999999999999,"15min":1.1140000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45500000000000002,"5min":0.45100000000000001,"15min":0.40999999999999998},"max":{"1min":0.84399999999999997,"5min":0.95399999999999996,"15min":0.99199999999999999},"last":0.504}]},{"osd":4,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.57599999999999996,"5min":0.48299999999999998,"15min":0.438},"max":{"1min":1.093,"5min":1.093,"15min":1.3240000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82199999999999995,"15min":0.83299999999999996},"min":{"1min":0.68799999999999994,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.488},"last":0.68400000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.60699999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0669999999999999,"5min":1.137,"15min":1.1919999999999999},"last":0.751},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.60399999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0649999999999999,"15min":1.302},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79200000000000004,"15min":0.80100000000000005},"min":{"1min":0.68000000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.02,"5min":1.056,"15min":1.3979999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76500000000000001,"15min":0.78000000000000003},"min":{"1min":0.56899999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0269999999999999,"5min":1.1120000000000001,"15min":1.3899999999999999},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.81000000000000005,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0089999999999999,"5min":1.087,"15min":1.335},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.83699999999999997,"15min":0.83499999999999996},"min":{"1min":0.66100000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.2130000000000001},"last":0.72899999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509639,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54328,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317512,"statfs":{"total":96636764160,"available":96581132288,"internally_reserved":0,"allocated":1163264,"data_stored":577156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.29099999999999998,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.69399999999999995,"5min":0.81200000000000006,"15min":0.94199999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53600000000000003,"15min":0.54900000000000004},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.88300000000000001,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.28199999999999997},"max":{"1min":0.82999999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.436},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80700000000000005,"5min":1.085,"15min":1.085},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.37,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55300000000000005,"15min":0.56899999999999995},"min":{"1min":0.43099999999999999,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":1.161,"15min":1.161},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.67600000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.1579999999999999,"5min":1.2569999999999999,"15min":1.6870000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.79400000000000004,"15min":0.80200000000000005},"min":{"1min":0.57699999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.175,"5min":1.1950000000000001,"15min":1.2689999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.63200000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.2549999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.60599999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.107,"5min":1.206,"15min":1.3089999999999999},"last":0.90300000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.78600000000000003,"15min":0.79800000000000004},"min":{"1min":0.69399999999999995,"5min":0.45500000000000002,"15min":0.40300000000000002},"max":{"1min":1.089,"5min":1.282,"15min":1.3759999999999999},"last":0.75},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.64300000000000002,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.1339999999999999,"5min":1.23,"15min":1.2649999999999999},"last":0.74299999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.80900000000000005,"15min":0.82899999999999996},"min":{"1min":0.64900000000000002,"5min":0.51100000000000001,"15min":0.49099999999999999},"max":{"1min":1.143,"5min":1.2,"15min":1.2909999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.60999999999999999,"5min":0.44900000000000001,"15min":0.44700000000000001},"max":{"1min":1.091,"5min":1.216,"15min":1.3660000000000001},"last":0.67400000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509638,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1150976,"data_stored":570484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.28299999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53500000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.626,"5min":0.872,"15min":0.872},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.5,"15min":0.50700000000000001},"min":{"1min":0.33700000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63200000000000001,"5min":0.76100000000000001,"15min":0.81000000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.29099999999999998},"max":{"1min":0.78900000000000003,"5min":0.83599999999999997,"15min":0.88800000000000001},"last":0.39400000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.57599999999999996,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35799999999999998,"15min":0.33400000000000002},"max":{"1min":0.70799999999999996,"5min":0.84299999999999997,"15min":0.98899999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.505,"15min":0.51700000000000002},"min":{"1min":0.33100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.64200000000000002,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.37}]},{"osd":4,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.748,"15min":0.77000000000000002},"min":{"1min":0.53100000000000003,"5min":0.432,"15min":0.432},"max":{"1min":0.91400000000000003,"5min":1.0860000000000001,"15min":1.234},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.57499999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.014,"5min":1.083,"15min":1.155},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75600000000000001,"15min":0.77800000000000002},"min":{"1min":0.53500000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92500000000000004,"5min":1.0609999999999999,"15min":1.1919999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78500000000000003,"15min":0.80000000000000004},"min":{"1min":0.55200000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.044,"5min":1.121,"15min":1.2849999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78600000000000003,"15min":0.81000000000000005},"min":{"1min":0.57199999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0229999999999999,"5min":1.0580000000000001,"15min":1.23},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76300000000000001,"15min":0.79000000000000004},"min":{"1min":0.50900000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0449999999999999,"5min":1.1020000000000001,"15min":1.3240000000000001},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78600000000000003,"15min":0.80900000000000005},"min":{"1min":0.58599999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.99299999999999999,"5min":1.103,"15min":1.3149999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79000000000000004,"15min":0.80800000000000005},"min":{"1min":0.55500000000000005,"5min":0.52600000000000002,"15min":0.45700000000000002},"max":{"1min":0.97499999999999998,"5min":1.115,"15min":1.3380000000000001},"last":0.71699999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509640,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36848,"kb_used_data":1704,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334992,"statfs":{"total":96636764160,"available":96599031808,"internally_reserved":0,"allocated":1744896,"data_stored":1160852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.50800000000000001},"min":{"1min":0.35899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.67900000000000005,"5min":0.77800000000000002,"15min":0.83199999999999996},"last":0.625}]},{"osd":2,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70999999999999996,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.44,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58199999999999996,"5min":0.871,"15min":0.871},"last":0.58399999999999996}]},{"osd":3,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.35899999999999999,"15min":0.34899999999999998},"max":{"1min":0.76500000000000001,"5min":0.88100000000000001,"15min":0.91300000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.434,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73999999999999999,"5min":1.038,"15min":1.038},"last":0.53600000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.76100000000000001,"15min":0.78100000000000003},"min":{"1min":0.59299999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.321},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.60099999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.093,"5min":1.423,"15min":1.423},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.60299999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0960000000000001,"5min":1.2669999999999999,"15min":1.28},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.78400000000000003,"15min":0.80900000000000005},"min":{"1min":0.70599999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.393},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78500000000000003,"15min":0.81299999999999994},"min":{"1min":0.61799999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.28},"last":0.753},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81399999999999995,"15min":0.81999999999999995},"min":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.131,"5min":1.333,"15min":1.333},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.65900000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.2310000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.80900000000000005,"15min":0.83399999999999996},"min":{"1min":0.60599999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1930000000000001,"5min":1.296,"15min":1.369},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:35:07.276 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:35:07.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.406+0000 7fb981140640 1 Processor -- start 2023-07-21T22:35:07.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.406+0000 7fb981140640 1 -- start start 2023-07-21T22:35:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.406+0000 7fb981140640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb97c0c8ad0 0x7fb97c0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.406+0000 7fb981140640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97c0cc700 con 0x7fb97c158ce0 2023-07-21T22:35:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.406+0000 7fb981140640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97c0b0ff0 con 0x7fb97c0c9560 2023-07-21T22:35:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.406+0000 7fb981140640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c0c99e0 con 0x7fb97c0c8ad0 2023-07-21T22:35:07.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb97ad9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb97c158ce0 0x7fb97c070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59858/0 (socket says 172.21.15.6:59858) 2023-07-21T22:35:07.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb97ad9d640 1 -- 172.21.15.6:0/1273727586 learned_addr learned my addr 172.21.15.6:0/1273727586 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:07.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb97a59c640 1 --2- 172.21.15.6:0/1273727586 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb97c0c8ad0 0x7fb97c0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb979d9b640 1 -- 172.21.15.6:0/1273727586 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176867828 0 0) 0x7fb97c0cc700 con 0x7fb97c158ce0 2023-07-21T22:35:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb979d9b640 1 -- 172.21.15.6:0/1273727586 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb964003530 con 0x7fb97c158ce0 2023-07-21T22:35:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb979d9b640 1 -- 172.21.15.6:0/1273727586 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095197381 0 0) 0x7fb97c0b0ff0 con 0x7fb97c0c9560 2023-07-21T22:35:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb979d9b640 1 -- 172.21.15.6:0/1273727586 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb97c0cc700 con 0x7fb97c0c9560 2023-07-21T22:35:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb979d9b640 1 -- 172.21.15.6:0/1273727586 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3752385570 0 0) 0x7fb964003530 con 0x7fb97c158ce0 2023-07-21T22:35:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb979d9b640 1 -- 172.21.15.6:0/1273727586 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb97c0c8ad0 msgr2=0x7fb97c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb979d9b640 1 --2- 172.21.15.6:0/1273727586 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb97c0c8ad0 0x7fb97c0c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb979d9b640 1 -- 172.21.15.6:0/1273727586 >> v1:172.21.15.161:6789/0 conn(0x7fb97c0c9560 legacy=0x7fb97c0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:07.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb979d9b640 1 -- 172.21.15.6:0/1273727586 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c070c80 con 0x7fb97c158ce0 2023-07-21T22:35:07.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb979d9b640 1 -- 172.21.15.6:0/1273727586 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fb96c001680 con 0x7fb97c158ce0 2023-07-21T22:35:07.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb979d9b640 1 -- 172.21.15.6:0/1273727586 >> v1:172.21.15.6:6789/0 conn(0x7fb97c158ce0 legacy=0x7fb97c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:07.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb979d9b640 1 --2- 172.21.15.6:0/1273727586 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb97c0c8ad0 0x7fb964003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb979d9b640 1 --2- 172.21.15.6:0/1273727586 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9640040a0 0x7fb9640047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb979d9b640 1 --2- 172.21.15.6:0/1273727586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb964004d10 0x7fb964005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb979d9b640 1 -- 172.21.15.6:0/1273727586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c0c99e0 con 0x7fb964004d10 2023-07-21T22:35:07.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb979d9b640 1 -- 172.21.15.6:0/1273727586 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96400bb80 con 0x7fb9640040a0 2023-07-21T22:35:07.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb979d9b640 1 -- 172.21.15.6:0/1273727586 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96400bd40 con 0x7fb97c0c8ad0 2023-07-21T22:35:07.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb97b59e640 1 --2- 172.21.15.6:0/1273727586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb964004d10 0x7fb964005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb97ad9d640 1 --2- 172.21.15.6:0/1273727586 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb97c0c8ad0 0x7fb964003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb97a59c640 1 --2- 172.21.15.6:0/1273727586 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9640040a0 0x7fb9640047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb97b59e640 1 -- 172.21.15.6:0/1273727586 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb97c0c8ad0 msgr2=0x7fb964003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:07.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb97b59e640 1 --2- 172.21.15.6:0/1273727586 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb97c0c8ad0 0x7fb964003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb97b59e640 1 -- 172.21.15.6:0/1273727586 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9640040a0 msgr2=0x7fb9640047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:07.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb97b59e640 1 --2- 172.21.15.6:0/1273727586 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb9640040a0 0x7fb9640047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.410+0000 7fb97b59e640 1 -- 172.21.15.6:0/1273727586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb964003530 con 0x7fb964004d10 2023-07-21T22:35:07.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.414+0000 7fb97b59e640 1 --2- 172.21.15.6:0/1273727586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb964004d10 0x7fb964005180 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fb974007fd0 tx=0x7fb97401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f651039aa88caa server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:07.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.414+0000 7fb979d9b640 1 -- 172.21.15.6:0/1273727586 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb974003b80 con 0x7fb964004d10 2023-07-21T22:35:07.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.414+0000 7fb979d9b640 1 -- 172.21.15.6:0/1273727586 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb974003d00 con 0x7fb964004d10 2023-07-21T22:35:07.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.414+0000 7fb979d9b640 1 -- 172.21.15.6:0/1273727586 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb974005310 con 0x7fb964004d10 2023-07-21T22:35:07.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.414+0000 7fb981140640 1 -- 172.21.15.6:0/1273727586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb964004d10 msgr2=0x7fb964005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:07.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.414+0000 7fb981140640 1 --2- 172.21.15.6:0/1273727586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb964004d10 0x7fb964005180 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fb974007fd0 tx=0x7fb97401c890 comp rx=0 tx=0).stop 2023-07-21T22:35:07.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.414+0000 7fb97b59e640 1 -- 172.21.15.6:0/1273727586 reap_dead start 2023-07-21T22:35:07.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.414+0000 7fb981140640 1 -- 172.21.15.6:0/1273727586 shutdown_connections 2023-07-21T22:35:07.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.414+0000 7fb981140640 1 -- 172.21.15.6:0/1273727586 >> 172.21.15.6:0/1273727586 conn(0x7fb97c0afcf0 msgr2=0x7fb97c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:07.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.414+0000 7fb981140640 1 -- 172.21.15.6:0/1273727586 shutdown_connections 2023-07-21T22:35:07.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.414+0000 7fb981140640 1 -- 172.21.15.6:0/1273727586 wait complete. 2023-07-21T22:35:07.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.414+0000 7fb981140640 1 Processor -- start 2023-07-21T22:35:07.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.414+0000 7fb981140640 1 -- start start 2023-07-21T22:35:07.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb981140640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb964004d10 0x7fb97c1f49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb981140640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb97c14f920 0x7fb97c152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb981140640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb97c0c2380 0x7fb97c0c2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb981140640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c0c2d60 con 0x7fb97c0c2380 2023-07-21T22:35:07.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb981140640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c0c63b0 con 0x7fb97c14f920 2023-07-21T22:35:07.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb981140640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c1f5050 con 0x7fb964004d10 2023-07-21T22:35:07.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb97ad9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb964004d10 0x7fb97c1f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb97ad9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb964004d10 0x7fb97c1f49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:52640/0 (socket says 172.21.15.6:52640) 2023-07-21T22:35:07.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb97ad9d640 1 -- 172.21.15.6:0/3166679312 learned_addr learned my addr 172.21.15.6:0/3166679312 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:07.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb97a59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb97c14f920 0x7fb97c152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb97b59e640 1 --2- 172.21.15.6:0/3166679312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb97c0c2380 0x7fb97c0c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb97ad9d640 1 -- 172.21.15.6:0/3166679312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb97c14f920 msgr2=0x7fb97c152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:07.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb97ad9d640 1 --2- 172.21.15.6:0/3166679312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb97c14f920 0x7fb97c152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb97ad9d640 1 -- 172.21.15.6:0/3166679312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb97c0c2380 msgr2=0x7fb97c0c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:07.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb97ad9d640 1 --2- 172.21.15.6:0/3166679312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb97c0c2380 0x7fb97c0c2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb97ad9d640 1 -- 172.21.15.6:0/3166679312 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c1f5330 con 0x7fb964004d10 2023-07-21T22:35:07.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb97b59e640 1 --2- 172.21.15.6:0/3166679312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb97c0c2380 0x7fb97c0c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:07.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb97ad9d640 1 --2- 172.21.15.6:0/3166679312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb964004d10 0x7fb97c1f49c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb96c007310 tx=0x7fb96c007710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:07.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb9637fe640 1 -- 172.21.15.6:0/3166679312 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c0015e0 con 0x7fb964004d10 2023-07-21T22:35:07.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb9637fe640 1 -- 172.21.15.6:0/3166679312 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c00f9c0 con 0x7fb964004d10 2023-07-21T22:35:07.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb9637fe640 1 -- 172.21.15.6:0/3166679312 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c00fd30 con 0x7fb964004d10 2023-07-21T22:35:07.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb981140640 1 -- 172.21.15.6:0/3166679312 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97c1f5610 con 0x7fb964004d10 2023-07-21T22:35:07.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb981140640 1 -- 172.21.15.6:0/3166679312 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97c153220 con 0x7fb964004d10 2023-07-21T22:35:07.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.418+0000 7fb981140640 1 -- 172.21.15.6:0/3166679312 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97c0ca1a0 con 0x7fb964004d10 2023-07-21T22:35:07.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.422+0000 7fb9637fe640 1 -- 172.21.15.6:0/3166679312 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb96c01d460 con 0x7fb964004d10 2023-07-21T22:35:07.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.422+0000 7fb9637fe640 1 --2- 172.21.15.6:0/3166679312 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fb9680663d0 0x7fb968068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.422+0000 7fb9637fe640 1 -- 172.21.15.6:0/3166679312 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fb96c084a40 con 0x7fb964004d10 2023-07-21T22:35:07.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.422+0000 7fb97a59c640 1 --2- 172.21.15.6:0/3166679312 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fb9680663d0 0x7fb968068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.422+0000 7fb97a59c640 1 --2- 172.21.15.6:0/3166679312 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fb9680663d0 0x7fb968068880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0cad40 tx=0x7fb970009190 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:07.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.426+0000 7fb9637fe640 1 -- 172.21.15.6:0/3166679312 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb96c051d60 con 0x7fb964004d10 2023-07-21T22:35:07.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.574+0000 7fb981140640 1 -- 172.21.15.6:0/3166679312 --> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb97c1590b0 con 0x7fb9680663d0 2023-07-21T22:35:07.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.586+0000 7fb9637fe640 1 -- 172.21.15.6:0/3166679312 <== mgr.6763 v2:172.21.15.161:6832/3267017989 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305830 (secure 0 0 0) 0x7fb970011be0 con 0x7fb9680663d0 2023-07-21T22:35:07.638 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:07.639 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:35:07.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.590+0000 7fb981140640 1 -- 172.21.15.6:0/3166679312 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fb9680663d0 msgr2=0x7fb968068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:07.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.590+0000 7fb981140640 1 --2- 172.21.15.6:0/3166679312 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fb9680663d0 0x7fb968068880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0cad40 tx=0x7fb970009190 comp rx=0 tx=0).stop 2023-07-21T22:35:07.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.590+0000 7fb981140640 1 -- 172.21.15.6:0/3166679312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb964004d10 msgr2=0x7fb97c1f49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:07.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.590+0000 7fb981140640 1 --2- 172.21.15.6:0/3166679312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb964004d10 0x7fb97c1f49c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb96c007310 tx=0x7fb96c007710 comp rx=0 tx=0).stop 2023-07-21T22:35:07.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.590+0000 7fb981140640 1 -- 172.21.15.6:0/3166679312 shutdown_connections 2023-07-21T22:35:07.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.590+0000 7fb981140640 1 --2- 172.21.15.6:0/3166679312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb97c0c2380 0x7fb97c0c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.590+0000 7fb981140640 1 --2- 172.21.15.6:0/3166679312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb97c14f920 0x7fb97c152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.590+0000 7fb981140640 1 --2- 172.21.15.6:0/3166679312 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7fb9680663d0 0x7fb968068880 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.590+0000 7fb981140640 1 --2- 172.21.15.6:0/3166679312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb964004d10 0x7fb97c1f49c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.590+0000 7fb981140640 1 -- 172.21.15.6:0/3166679312 >> 172.21.15.6:0/3166679312 conn(0x7fb97c0afcf0 msgr2=0x7fb97c15d640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:07.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.590+0000 7fb981140640 1 -- 172.21.15.6:0/3166679312 shutdown_connections 2023-07-21T22:35:07.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.590+0000 7fb981140640 1 -- 172.21.15.6:0/3166679312 wait complete. 2023-07-21T22:35:07.658 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-21T22:35:06.394540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":311076,"kb_used_data":10212,"kb_used_omap":0,"kb_used_meta":300800,"kb_avail":754663644,"statfs":{"total":773094113280,"available":772775571456,"internally_reserved":0,"allocated":10457088,"data_stored":5777968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308019200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.699228"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712231+0000","last_change":"2023-07-21T22:35:01.712231+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712231+0000","last_undegraded":"2023-07-21T22:35:01.712231+0000","last_fullsized":"2023-07-21T22:35:01.712231+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.708569+0000","last_change":"2023-07-21T22:35:01.708569+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.708569+0000","last_undegraded":"2023-07-21T22:35:01.708569+0000","last_fullsized":"2023-07-21T22:35:01.708569+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714258+0000","last_change":"2023-07-21T22:35:01.714258+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714258+0000","last_undegraded":"2023-07-21T22:35:01.714258+0000","last_fullsized":"2023-07-21T22:35:01.714258+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710591+0000","last_change":"2023-07-21T22:35:01.710591+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710591+0000","last_undegraded":"2023-07-21T22:35:01.710591+0000","last_fullsized":"2023-07-21T22:35:01.710591+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712175+0000","last_change":"2023-07-21T22:35:01.712175+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712175+0000","last_undegraded":"2023-07-21T22:35:01.712175+0000","last_fullsized":"2023-07-21T22:35:01.712175+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.720890+0000","last_change":"2023-07-21T22:35:01.720890+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.720890+0000","last_undegraded":"2023-07-21T22:35:01.720890+0000","last_fullsized":"2023-07-21T22:35:01.720890+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714747+0000","last_change":"2023-07-21T22:35:01.714747+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714747+0000","last_undegraded":"2023-07-21T22:35:01.714747+0000","last_fullsized":"2023-07-21T22:35:01.714747+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.711437+0000","last_change":"2023-07-21T22:35:01.711437+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.711437+0000","last_undegraded":"2023-07-21T22:35:01.711437+0000","last_fullsized":"2023-07-21T22:35:01.711437+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714480+0000","last_change":"2023-07-21T22:35:01.714480+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714480+0000","last_undegraded":"2023-07-21T22:35:01.714480+0000","last_fullsized":"2023-07-21T22:35:01.714480+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710651+0000","last_change":"2023-07-21T22:35:01.710651+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710651+0000","last_undegraded":"2023-07-21T22:35:01.710651+0000","last_fullsized":"2023-07-21T22:35:01.710651+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.706954+0000","last_change":"2023-07-21T22:35:01.706954+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.706954+0000","last_undegraded":"2023-07-21T22:35:01.706954+0000","last_fullsized":"2023-07-21T22:35:01.706954+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710152+0000","last_change":"2023-07-21T22:35:01.710152+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710152+0000","last_undegraded":"2023-07-21T22:35:01.710152+0000","last_fullsized":"2023-07-21T22:35:01.710152+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710870+0000","last_change":"2023-07-21T22:35:01.710870+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710870+0000","last_undegraded":"2023-07-21T22:35:01.710870+0000","last_fullsized":"2023-07-21T22:35:01.710870+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.720413+0000","last_change":"2023-07-21T22:35:01.720413+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.720413+0000","last_undegraded":"2023-07-21T22:35:01.720413+0000","last_fullsized":"2023-07-21T22:35:01.720413+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.706015+0000","last_change":"2023-07-21T22:35:01.706015+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.706015+0000","last_undegraded":"2023-07-21T22:35:01.706015+0000","last_fullsized":"2023-07-21T22:35:01.706015+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.713065+0000","last_change":"2023-07-21T22:35:01.713065+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.713065+0000","last_undegraded":"2023-07-21T22:35:01.713065+0000","last_fullsized":"2023-07-21T22:35:01.713065+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.711317+0000","last_change":"2023-07-21T22:35:01.711317+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.711317+0000","last_undegraded":"2023-07-21T22:35:01.711317+0000","last_fullsized":"2023-07-21T22:35:01.711317+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714428+0000","last_change":"2023-07-21T22:35:01.714428+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714428+0000","last_undegraded":"2023-07-21T22:35:01.714428+0000","last_fullsized":"2023-07-21T22:35:01.714428+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.711409+0000","last_change":"2023-07-21T22:35:01.711409+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.711409+0000","last_undegraded":"2023-07-21T22:35:01.711409+0000","last_fullsized":"2023-07-21T22:35:01.711409+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.713783+0000","last_change":"2023-07-21T22:35:01.713783+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.713783+0000","last_undegraded":"2023-07-21T22:35:01.713783+0000","last_fullsized":"2023-07-21T22:35:01.713783+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.715249+0000","last_change":"2023-07-21T22:35:01.715249+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.715249+0000","last_undegraded":"2023-07-21T22:35:01.715249+0000","last_fullsized":"2023-07-21T22:35:01.715249+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714470+0000","last_change":"2023-07-21T22:35:01.714470+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714470+0000","last_undegraded":"2023-07-21T22:35:01.714470+0000","last_fullsized":"2023-07-21T22:35:01.714470+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.715801+0000","last_change":"2023-07-21T22:35:01.715801+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.715801+0000","last_undegraded":"2023-07-21T22:35:01.715801+0000","last_fullsized":"2023-07-21T22:35:01.715801+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.705924+0000","last_change":"2023-07-21T22:35:01.705924+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.705924+0000","last_undegraded":"2023-07-21T22:35:01.705924+0000","last_fullsized":"2023-07-21T22:35:01.705924+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.705356+0000","last_change":"2023-07-21T22:35:01.705356+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.705356+0000","last_undegraded":"2023-07-21T22:35:01.705356+0000","last_fullsized":"2023-07-21T22:35:01.705356+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.709816+0000","last_change":"2023-07-21T22:35:01.709816+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.709816+0000","last_undegraded":"2023-07-21T22:35:01.709816+0000","last_fullsized":"2023-07-21T22:35:01.709816+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.713111+0000","last_change":"2023-07-21T22:35:01.713111+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.713111+0000","last_undegraded":"2023-07-21T22:35:01.713111+0000","last_fullsized":"2023-07-21T22:35:01.713111+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710226+0000","last_change":"2023-07-21T22:35:01.710226+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710226+0000","last_undegraded":"2023-07-21T22:35:01.710226+0000","last_fullsized":"2023-07-21T22:35:01.710226+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.706650+0000","last_change":"2023-07-21T22:35:01.706650+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.706650+0000","last_undegraded":"2023-07-21T22:35:01.706650+0000","last_fullsized":"2023-07-21T22:35:01.706650+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712564+0000","last_change":"2023-07-21T22:35:01.712564+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712564+0000","last_undegraded":"2023-07-21T22:35:01.712564+0000","last_fullsized":"2023-07-21T22:35:01.712564+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714162+0000","last_change":"2023-07-21T22:35:01.714162+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714162+0000","last_undegraded":"2023-07-21T22:35:01.714162+0000","last_fullsized":"2023-07-21T22:35:01.714162+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712159+0000","last_change":"2023-07-21T22:35:01.712159+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712159+0000","last_undegraded":"2023-07-21T22:35:01.712159+0000","last_fullsized":"2023-07-21T22:35:01.712159+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712963+0000","last_change":"2023-07-21T22:35:01.712963+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712963+0000","last_undegraded":"2023-07-21T22:35:01.712963+0000","last_fullsized":"2023-07-21T22:35:01.712963+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.725098+0000","last_change":"2023-07-21T22:35:01.722906+0000","last_active":"2023-07-21T22:35:01.725098+0000","last_peered":"2023-07-21T22:35:01.725098+0000","last_clean":"2023-07-21T22:35:01.725098+0000","last_became_active":"2023-07-21T22:35:01.722556+0000","last_became_peered":"2023-07-21T22:35:01.722556+0000","last_unstale":"2023-07-21T22:35:01.725098+0000","last_undegraded":"2023-07-21T22:35:01.725098+0000","last_fullsized":"2023-07-21T22:35:01.725098+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:19:54.269059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.705333+0000","last_change":"2023-07-21T22:35:01.705333+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.705333+0000","last_undegraded":"2023-07-21T22:35:01.705333+0000","last_fullsized":"2023-07-21T22:35:01.705333+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.732652+0000","last_change":"2023-07-21T22:35:01.730971+0000","last_active":"2023-07-21T22:35:01.732652+0000","last_peered":"2023-07-21T22:35:01.732652+0000","last_clean":"2023-07-21T22:35:01.732652+0000","last_became_active":"2023-07-21T22:35:01.730651+0000","last_became_peered":"2023-07-21T22:35:01.730651+0000","last_unstale":"2023-07-21T22:35:01.732652+0000","last_undegraded":"2023-07-21T22:35:01.732652+0000","last_fullsized":"2023-07-21T22:35:01.732652+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:42:28.676838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.715674+0000","last_change":"2023-07-21T22:35:01.715674+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.715674+0000","last_undegraded":"2023-07-21T22:35:01.715674+0000","last_fullsized":"2023-07-21T22:35:01.715674+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.730566+0000","last_change":"2023-07-21T22:35:01.728487+0000","last_active":"2023-07-21T22:35:01.730566+0000","last_peered":"2023-07-21T22:35:01.730566+0000","last_clean":"2023-07-21T22:35:01.730566+0000","last_became_active":"2023-07-21T22:35:01.728216+0000","last_became_peered":"2023-07-21T22:35:01.728216+0000","last_unstale":"2023-07-21T22:35:01.730566+0000","last_undegraded":"2023-07-21T22:35:01.730566+0000","last_fullsized":"2023-07-21T22:35:01.730566+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:06.598803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714804+0000","last_change":"2023-07-21T22:35:01.714804+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714804+0000","last_undegraded":"2023-07-21T22:35:01.714804+0000","last_fullsized":"2023-07-21T22:35:01.714804+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.731827+0000","last_change":"2023-07-21T22:35:01.727508+0000","last_active":"2023-07-21T22:35:01.731827+0000","last_peered":"2023-07-21T22:35:01.731827+0000","last_clean":"2023-07-21T22:35:01.731827+0000","last_became_active":"2023-07-21T22:35:01.726844+0000","last_became_peered":"2023-07-21T22:35:01.726844+0000","last_unstale":"2023-07-21T22:35:01.731827+0000","last_undegraded":"2023-07-21T22:35:01.731827+0000","last_fullsized":"2023-07-21T22:35:01.731827+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:54:47.554576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.706889+0000","last_change":"2023-07-21T22:35:01.706889+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.706889+0000","last_undegraded":"2023-07-21T22:35:01.706889+0000","last_fullsized":"2023-07-21T22:35:01.706889+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.724799+0000","last_change":"2023-07-21T22:35:01.723132+0000","last_active":"2023-07-21T22:35:01.724799+0000","last_peered":"2023-07-21T22:35:01.724799+0000","last_clean":"2023-07-21T22:35:01.724799+0000","last_became_active":"2023-07-21T22:35:01.722696+0000","last_became_peered":"2023-07-21T22:35:01.722696+0000","last_unstale":"2023-07-21T22:35:01.724799+0000","last_undegraded":"2023-07-21T22:35:01.724799+0000","last_fullsized":"2023-07-21T22:35:01.724799+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:26:28.209364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.706455+0000","last_change":"2023-07-21T22:35:01.706455+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.706455+0000","last_undegraded":"2023-07-21T22:35:01.706455+0000","last_fullsized":"2023-07-21T22:35:01.706455+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.729052+0000","last_change":"2023-07-21T22:35:01.725943+0000","last_active":"2023-07-21T22:35:01.729052+0000","last_peered":"2023-07-21T22:35:01.729052+0000","last_clean":"2023-07-21T22:35:01.729052+0000","last_became_active":"2023-07-21T22:35:01.725603+0000","last_became_peered":"2023-07-21T22:35:01.725603+0000","last_unstale":"2023-07-21T22:35:01.729052+0000","last_undegraded":"2023-07-21T22:35:01.729052+0000","last_fullsized":"2023-07-21T22:35:01.729052+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:06:44.768542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.716076+0000","last_change":"2023-07-21T22:35:01.716076+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.716076+0000","last_undegraded":"2023-07-21T22:35:01.716076+0000","last_fullsized":"2023-07-21T22:35:01.716076+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.718307+0000","last_change":"2023-07-21T22:35:01.714572+0000","last_active":"2023-07-21T22:35:01.718307+0000","last_peered":"2023-07-21T22:35:01.718307+0000","last_clean":"2023-07-21T22:35:01.718307+0000","last_became_active":"2023-07-21T22:35:01.714302+0000","last_became_peered":"2023-07-21T22:35:01.714302+0000","last_unstale":"2023-07-21T22:35:01.718307+0000","last_undegraded":"2023-07-21T22:35:01.718307+0000","last_fullsized":"2023-07-21T22:35:01.718307+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:57:16.396822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.717583+0000","last_change":"2023-07-21T22:35:01.717583+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.717583+0000","last_undegraded":"2023-07-21T22:35:01.717583+0000","last_fullsized":"2023-07-21T22:35:01.717583+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.724153+0000","last_change":"2023-07-21T22:35:01.716458+0000","last_active":"2023-07-21T22:35:01.724153+0000","last_peered":"2023-07-21T22:35:01.724153+0000","last_clean":"2023-07-21T22:35:01.724153+0000","last_became_active":"2023-07-21T22:35:01.716115+0000","last_became_peered":"2023-07-21T22:35:01.716115+0000","last_unstale":"2023-07-21T22:35:01.724153+0000","last_undegraded":"2023-07-21T22:35:01.724153+0000","last_fullsized":"2023-07-21T22:35:01.724153+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:21:54.817971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.705327+0000","last_change":"2023-07-21T22:35:01.705327+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.705327+0000","last_undegraded":"2023-07-21T22:35:01.705327+0000","last_fullsized":"2023-07-21T22:35:01.705327+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.732688+0000","last_change":"2023-07-21T22:35:01.731125+0000","last_active":"2023-07-21T22:35:01.732688+0000","last_peered":"2023-07-21T22:35:01.732688+0000","last_clean":"2023-07-21T22:35:01.732688+0000","last_became_active":"2023-07-21T22:35:01.730807+0000","last_became_peered":"2023-07-21T22:35:01.730807+0000","last_unstale":"2023-07-21T22:35:01.732688+0000","last_undegraded":"2023-07-21T22:35:01.732688+0000","last_fullsized":"2023-07-21T22:35:01.732688+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:23:26.713435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.709509+0000","last_change":"2023-07-21T22:35:01.709509+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.709509+0000","last_undegraded":"2023-07-21T22:35:01.709509+0000","last_fullsized":"2023-07-21T22:35:01.709509+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.721870+0000","last_change":"2023-07-21T22:35:01.719096+0000","last_active":"2023-07-21T22:35:01.721870+0000","last_peered":"2023-07-21T22:35:01.721870+0000","last_clean":"2023-07-21T22:35:01.721870+0000","last_became_active":"2023-07-21T22:35:01.718805+0000","last_became_peered":"2023-07-21T22:35:01.718805+0000","last_unstale":"2023-07-21T22:35:01.721870+0000","last_undegraded":"2023-07-21T22:35:01.721870+0000","last_fullsized":"2023-07-21T22:35:01.721870+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:40:07.824667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.719701+0000","last_change":"2023-07-21T22:35:01.719701+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.719701+0000","last_undegraded":"2023-07-21T22:35:01.719701+0000","last_fullsized":"2023-07-21T22:35:01.719701+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.724973+0000","last_change":"2023-07-21T22:35:01.717629+0000","last_active":"2023-07-21T22:35:01.724973+0000","last_peered":"2023-07-21T22:35:01.724973+0000","last_clean":"2023-07-21T22:35:01.724973+0000","last_became_active":"2023-07-21T22:35:01.717342+0000","last_became_peered":"2023-07-21T22:35:01.717342+0000","last_unstale":"2023-07-21T22:35:01.724973+0000","last_undegraded":"2023-07-21T22:35:01.724973+0000","last_fullsized":"2023-07-21T22:35:01.724973+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:41:40.920279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.711573+0000","last_change":"2023-07-21T22:35:01.711573+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.711573+0000","last_undegraded":"2023-07-21T22:35:01.711573+0000","last_fullsized":"2023-07-21T22:35:01.711573+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.731807+0000","last_change":"2023-07-21T22:35:01.727312+0000","last_active":"2023-07-21T22:35:01.731807+0000","last_peered":"2023-07-21T22:35:01.731807+0000","last_clean":"2023-07-21T22:35:01.731807+0000","last_became_active":"2023-07-21T22:35:01.726466+0000","last_became_peered":"2023-07-21T22:35:01.726466+0000","last_unstale":"2023-07-21T22:35:01.731807+0000","last_undegraded":"2023-07-21T22:35:01.731807+0000","last_fullsized":"2023-07-21T22:35:01.731807+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:28:27.414887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.709509+0000","last_change":"2023-07-21T22:35:01.709509+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.709509+0000","last_undegraded":"2023-07-21T22:35:01.709509+0000","last_fullsized":"2023-07-21T22:35:01.709509+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.723408+0000","last_change":"2023-07-21T22:35:01.722302+0000","last_active":"2023-07-21T22:35:01.723408+0000","last_peered":"2023-07-21T22:35:01.723408+0000","last_clean":"2023-07-21T22:35:01.723408+0000","last_became_active":"2023-07-21T22:35:01.722024+0000","last_became_peered":"2023-07-21T22:35:01.722024+0000","last_unstale":"2023-07-21T22:35:01.723408+0000","last_undegraded":"2023-07-21T22:35:01.723408+0000","last_fullsized":"2023-07-21T22:35:01.723408+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:59:22.353202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.716885+0000","last_change":"2023-07-21T22:35:01.716885+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.716885+0000","last_undegraded":"2023-07-21T22:35:01.716885+0000","last_fullsized":"2023-07-21T22:35:01.716885+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.731394+0000","last_change":"2023-07-21T22:35:01.729518+0000","last_active":"2023-07-21T22:35:01.731394+0000","last_peered":"2023-07-21T22:35:01.731394+0000","last_clean":"2023-07-21T22:35:01.731394+0000","last_became_active":"2023-07-21T22:35:01.729250+0000","last_became_peered":"2023-07-21T22:35:01.729250+0000","last_unstale":"2023-07-21T22:35:01.731394+0000","last_undegraded":"2023-07-21T22:35:01.731394+0000","last_fullsized":"2023-07-21T22:35:01.731394+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:16:08.858192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.716467+0000","last_change":"2023-07-21T22:35:01.716467+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.716467+0000","last_undegraded":"2023-07-21T22:35:01.716467+0000","last_fullsized":"2023-07-21T22:35:01.716467+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.725822+0000","last_change":"2023-07-21T22:35:01.723235+0000","last_active":"2023-07-21T22:35:01.725822+0000","last_peered":"2023-07-21T22:35:01.725822+0000","last_clean":"2023-07-21T22:35:01.725822+0000","last_became_active":"2023-07-21T22:35:01.722975+0000","last_became_peered":"2023-07-21T22:35:01.722975+0000","last_unstale":"2023-07-21T22:35:01.725822+0000","last_undegraded":"2023-07-21T22:35:01.725822+0000","last_fullsized":"2023-07-21T22:35:01.725822+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:49:52.024403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.717111+0000","last_change":"2023-07-21T22:35:01.717111+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.717111+0000","last_undegraded":"2023-07-21T22:35:01.717111+0000","last_fullsized":"2023-07-21T22:35:01.717111+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.724785+0000","last_change":"2023-07-21T22:35:01.723581+0000","last_active":"2023-07-21T22:35:01.724785+0000","last_peered":"2023-07-21T22:35:01.724785+0000","last_clean":"2023-07-21T22:35:01.724785+0000","last_became_active":"2023-07-21T22:35:01.723291+0000","last_became_peered":"2023-07-21T22:35:01.723291+0000","last_unstale":"2023-07-21T22:35:01.724785+0000","last_undegraded":"2023-07-21T22:35:01.724785+0000","last_fullsized":"2023-07-21T22:35:01.724785+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:22:14.187151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714232+0000","last_change":"2023-07-21T22:35:01.714232+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714232+0000","last_undegraded":"2023-07-21T22:35:01.714232+0000","last_fullsized":"2023-07-21T22:35:01.714232+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.726298+0000","last_change":"2023-07-21T22:35:01.723963+0000","last_active":"2023-07-21T22:35:01.726298+0000","last_peered":"2023-07-21T22:35:01.726298+0000","last_clean":"2023-07-21T22:35:01.726298+0000","last_became_active":"2023-07-21T22:35:01.723692+0000","last_became_peered":"2023-07-21T22:35:01.723692+0000","last_unstale":"2023-07-21T22:35:01.726298+0000","last_undegraded":"2023-07-21T22:35:01.726298+0000","last_fullsized":"2023-07-21T22:35:01.726298+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:07:52.499504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.714235+0000","last_change":"2023-07-21T22:35:01.714235+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.714235+0000","last_undegraded":"2023-07-21T22:35:01.714235+0000","last_fullsized":"2023-07-21T22:35:01.714235+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.721208+0000","last_change":"2023-07-21T22:35:01.716816+0000","last_active":"2023-07-21T22:35:01.721208+0000","last_peered":"2023-07-21T22:35:01.721208+0000","last_clean":"2023-07-21T22:35:01.721208+0000","last_became_active":"2023-07-21T22:35:01.716553+0000","last_became_peered":"2023-07-21T22:35:01.716553+0000","last_unstale":"2023-07-21T22:35:01.721208+0000","last_undegraded":"2023-07-21T22:35:01.721208+0000","last_fullsized":"2023-07-21T22:35:01.721208+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:18:23.614312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.713670+0000","last_change":"2023-07-21T22:35:01.713670+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.713670+0000","last_undegraded":"2023-07-21T22:35:01.713670+0000","last_fullsized":"2023-07-21T22:35:01.713670+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.729147+0000","last_change":"2023-07-21T22:35:01.725547+0000","last_active":"2023-07-21T22:35:01.729147+0000","last_peered":"2023-07-21T22:35:01.729147+0000","last_clean":"2023-07-21T22:35:01.729147+0000","last_became_active":"2023-07-21T22:35:01.725139+0000","last_became_peered":"2023-07-21T22:35:01.725139+0000","last_unstale":"2023-07-21T22:35:01.729147+0000","last_undegraded":"2023-07-21T22:35:01.729147+0000","last_fullsized":"2023-07-21T22:35:01.729147+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:09:06.750535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.705531+0000","last_change":"2023-07-21T22:35:01.705531+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.705531+0000","last_undegraded":"2023-07-21T22:35:01.705531+0000","last_fullsized":"2023-07-21T22:35:01.705531+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.732948+0000","last_change":"2023-07-21T22:35:01.731236+0000","last_active":"2023-07-21T22:35:01.732948+0000","last_peered":"2023-07-21T22:35:01.732948+0000","last_clean":"2023-07-21T22:35:01.732948+0000","last_became_active":"2023-07-21T22:35:01.730896+0000","last_became_peered":"2023-07-21T22:35:01.730896+0000","last_unstale":"2023-07-21T22:35:01.732948+0000","last_undegraded":"2023-07-21T22:35:01.732948+0000","last_fullsized":"2023-07-21T22:35:01.732948+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:38:05.731089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.715945+0000","last_change":"2023-07-21T22:35:01.715945+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.715945+0000","last_undegraded":"2023-07-21T22:35:01.715945+0000","last_fullsized":"2023-07-21T22:35:01.715945+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.731825+0000","last_change":"2023-07-21T22:35:01.726833+0000","last_active":"2023-07-21T22:35:01.731825+0000","last_peered":"2023-07-21T22:35:01.731825+0000","last_clean":"2023-07-21T22:35:01.731825+0000","last_became_active":"2023-07-21T22:35:01.726449+0000","last_became_peered":"2023-07-21T22:35:01.726449+0000","last_unstale":"2023-07-21T22:35:01.731825+0000","last_undegraded":"2023-07-21T22:35:01.731825+0000","last_fullsized":"2023-07-21T22:35:01.731825+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:54:24.226939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.716399+0000","last_change":"2023-07-21T22:35:01.716399+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.716399+0000","last_undegraded":"2023-07-21T22:35:01.716399+0000","last_fullsized":"2023-07-21T22:35:01.716399+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.726641+0000","last_change":"2023-07-21T22:35:01.723928+0000","last_active":"2023-07-21T22:35:01.726641+0000","last_peered":"2023-07-21T22:35:01.726641+0000","last_clean":"2023-07-21T22:35:01.726641+0000","last_became_active":"2023-07-21T22:35:01.723645+0000","last_became_peered":"2023-07-21T22:35:01.723645+0000","last_unstale":"2023-07-21T22:35:01.726641+0000","last_undegraded":"2023-07-21T22:35:01.726641+0000","last_fullsized":"2023-07-21T22:35:01.726641+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:38:25.024926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.713064+0000","last_change":"2023-07-21T22:35:01.713064+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.713064+0000","last_undegraded":"2023-07-21T22:35:01.713064+0000","last_fullsized":"2023-07-21T22:35:01.713064+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.731913+0000","last_change":"2023-07-21T22:35:01.728315+0000","last_active":"2023-07-21T22:35:01.731913+0000","last_peered":"2023-07-21T22:35:01.731913+0000","last_clean":"2023-07-21T22:35:01.731913+0000","last_became_active":"2023-07-21T22:35:01.728026+0000","last_became_peered":"2023-07-21T22:35:01.728026+0000","last_unstale":"2023-07-21T22:35:01.731913+0000","last_undegraded":"2023-07-21T22:35:01.731913+0000","last_fullsized":"2023-07-21T22:35:01.731913+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:11:42.430007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712453+0000","last_change":"2023-07-21T22:35:01.712453+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712453+0000","last_undegraded":"2023-07-21T22:35:01.712453+0000","last_fullsized":"2023-07-21T22:35:01.712453+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.726579+0000","last_change":"2023-07-21T22:35:01.724682+0000","last_active":"2023-07-21T22:35:01.726579+0000","last_peered":"2023-07-21T22:35:01.726579+0000","last_clean":"2023-07-21T22:35:01.726579+0000","last_became_active":"2023-07-21T22:35:01.724374+0000","last_became_peered":"2023-07-21T22:35:01.724374+0000","last_unstale":"2023-07-21T22:35:01.726579+0000","last_undegraded":"2023-07-21T22:35:01.726579+0000","last_fullsized":"2023-07-21T22:35:01.726579+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:56:36.405734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712551+0000","last_change":"2023-07-21T22:35:01.712551+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712551+0000","last_undegraded":"2023-07-21T22:35:01.712551+0000","last_fullsized":"2023-07-21T22:35:01.712551+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.729360+0000","last_change":"2023-07-21T22:35:01.727387+0000","last_active":"2023-07-21T22:35:01.729360+0000","last_peered":"2023-07-21T22:35:01.729360+0000","last_clean":"2023-07-21T22:35:01.729360+0000","last_became_active":"2023-07-21T22:35:01.727122+0000","last_became_peered":"2023-07-21T22:35:01.727122+0000","last_unstale":"2023-07-21T22:35:01.729360+0000","last_undegraded":"2023-07-21T22:35:01.729360+0000","last_fullsized":"2023-07-21T22:35:01.729360+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:02:10.200109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"86'183","reported_seq":541,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.719536+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:35:01.719536+0000","last_peered":"2023-07-21T22:35:01.719536+0000","last_clean":"2023-07-21T22:35:01.719536+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:35:01.719536+0000","last_undegraded":"2023-07-21T22:35:01.719536+0000","last_fullsized":"2023-07-21T22:35:01.719536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:11:18.738652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":160,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.711179+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:35:01.711179+0000","last_peered":"2023-07-21T22:35:01.711179+0000","last_clean":"2023-07-21T22:35:01.711179+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:35:01.711179+0000","last_undegraded":"2023-07-21T22:35:01.711179+0000","last_fullsized":"2023-07-21T22:35:01.711179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:47:55.539033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.706360+0000","last_change":"2023-07-21T22:35:01.706360+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.706360+0000","last_undegraded":"2023-07-21T22:35:01.706360+0000","last_fullsized":"2023-07-21T22:35:01.706360+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.729392+0000","last_change":"2023-07-21T22:35:01.728192+0000","last_active":"2023-07-21T22:35:01.729392+0000","last_peered":"2023-07-21T22:35:01.729392+0000","last_clean":"2023-07-21T22:35:01.729392+0000","last_became_active":"2023-07-21T22:35:01.727821+0000","last_became_peered":"2023-07-21T22:35:01.727821+0000","last_unstale":"2023-07-21T22:35:01.729392+0000","last_undegraded":"2023-07-21T22:35:01.729392+0000","last_fullsized":"2023-07-21T22:35:01.729392+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:02.387612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":151,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.719404+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:35:01.719404+0000","last_peered":"2023-07-21T22:35:01.719404+0000","last_clean":"2023-07-21T22:35:01.719404+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:35:01.719404+0000","last_undegraded":"2023-07-21T22:35:01.719404+0000","last_fullsized":"2023-07-21T22:35:01.719404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:20.634736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.716563+0000","last_change":"2023-07-21T22:35:01.716563+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.716563+0000","last_undegraded":"2023-07-21T22:35:01.716563+0000","last_fullsized":"2023-07-21T22:35:01.716563+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.729384+0000","last_change":"2023-07-21T22:35:01.727413+0000","last_active":"2023-07-21T22:35:01.729384+0000","last_peered":"2023-07-21T22:35:01.729384+0000","last_clean":"2023-07-21T22:35:01.729384+0000","last_became_active":"2023-07-21T22:35:01.727047+0000","last_became_peered":"2023-07-21T22:35:01.727047+0000","last_unstale":"2023-07-21T22:35:01.729384+0000","last_undegraded":"2023-07-21T22:35:01.729384+0000","last_fullsized":"2023-07-21T22:35:01.729384+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:38:13.262742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":146,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.707935+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:35:01.707935+0000","last_peered":"2023-07-21T22:35:01.707935+0000","last_clean":"2023-07-21T22:35:01.707935+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:35:01.707935+0000","last_undegraded":"2023-07-21T22:35:01.707935+0000","last_fullsized":"2023-07-21T22:35:01.707935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:05:23.835793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.705682+0000","last_change":"2023-07-21T22:35:01.705682+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.705682+0000","last_undegraded":"2023-07-21T22:35:01.705682+0000","last_fullsized":"2023-07-21T22:35:01.705682+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.724343+0000","last_change":"2023-07-21T22:35:01.721862+0000","last_active":"2023-07-21T22:35:01.724343+0000","last_peered":"2023-07-21T22:35:01.724343+0000","last_clean":"2023-07-21T22:35:01.724343+0000","last_became_active":"2023-07-21T22:35:01.721408+0000","last_became_peered":"2023-07-21T22:35:01.721408+0000","last_unstale":"2023-07-21T22:35:01.724343+0000","last_undegraded":"2023-07-21T22:35:01.724343+0000","last_fullsized":"2023-07-21T22:35:01.724343+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:00:53.717366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":160,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.711418+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:35:01.711418+0000","last_peered":"2023-07-21T22:35:01.711418+0000","last_clean":"2023-07-21T22:35:01.711418+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:35:01.711418+0000","last_undegraded":"2023-07-21T22:35:01.711418+0000","last_fullsized":"2023-07-21T22:35:01.711418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:25:55.112091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710601+0000","last_change":"2023-07-21T22:35:01.710601+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710601+0000","last_undegraded":"2023-07-21T22:35:01.710601+0000","last_fullsized":"2023-07-21T22:35:01.710601+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.724072+0000","last_change":"2023-07-21T22:35:01.716440+0000","last_active":"2023-07-21T22:35:01.724072+0000","last_peered":"2023-07-21T22:35:01.724072+0000","last_clean":"2023-07-21T22:35:01.724072+0000","last_became_active":"2023-07-21T22:35:01.715933+0000","last_became_peered":"2023-07-21T22:35:01.715933+0000","last_unstale":"2023-07-21T22:35:01.724072+0000","last_undegraded":"2023-07-21T22:35:01.724072+0000","last_fullsized":"2023-07-21T22:35:01.724072+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:30:48.422621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":152,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.710289+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:35:01.710289+0000","last_peered":"2023-07-21T22:35:01.710289+0000","last_clean":"2023-07-21T22:35:01.710289+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:35:01.710289+0000","last_undegraded":"2023-07-21T22:35:01.710289+0000","last_fullsized":"2023-07-21T22:35:01.710289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:55:36.920566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.712139+0000","last_change":"2023-07-21T22:35:01.712139+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.712139+0000","last_undegraded":"2023-07-21T22:35:01.712139+0000","last_fullsized":"2023-07-21T22:35:01.712139+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.727716+0000","last_change":"2023-07-21T22:35:01.725616+0000","last_active":"2023-07-21T22:35:01.727716+0000","last_peered":"2023-07-21T22:35:01.727716+0000","last_clean":"2023-07-21T22:35:01.727716+0000","last_became_active":"2023-07-21T22:35:01.725346+0000","last_became_peered":"2023-07-21T22:35:01.725346+0000","last_unstale":"2023-07-21T22:35:01.727716+0000","last_undegraded":"2023-07-21T22:35:01.727716+0000","last_fullsized":"2023-07-21T22:35:01.727716+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:06:01.167052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":150,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.720917+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:35:01.720917+0000","last_peered":"2023-07-21T22:35:01.720917+0000","last_clean":"2023-07-21T22:35:01.720917+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:35:01.720917+0000","last_undegraded":"2023-07-21T22:35:01.720917+0000","last_fullsized":"2023-07-21T22:35:01.720917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:19:48.326950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.713905+0000","last_change":"2023-07-21T22:35:01.713905+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.713905+0000","last_undegraded":"2023-07-21T22:35:01.713905+0000","last_fullsized":"2023-07-21T22:35:01.713905+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.730178+0000","last_change":"2023-07-21T22:35:01.727961+0000","last_active":"2023-07-21T22:35:01.730178+0000","last_peered":"2023-07-21T22:35:01.730178+0000","last_clean":"2023-07-21T22:35:01.730178+0000","last_became_active":"2023-07-21T22:35:01.727557+0000","last_became_peered":"2023-07-21T22:35:01.727557+0000","last_unstale":"2023-07-21T22:35:01.730178+0000","last_undegraded":"2023-07-21T22:35:01.730178+0000","last_fullsized":"2023-07-21T22:35:01.730178+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:19:40.452038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":152,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.709997+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:35:01.709997+0000","last_peered":"2023-07-21T22:35:01.709997+0000","last_clean":"2023-07-21T22:35:01.709997+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:35:01.709997+0000","last_undegraded":"2023-07-21T22:35:01.709997+0000","last_fullsized":"2023-07-21T22:35:01.709997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:26:53.851830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":96,"state":"creating+peering","last_fresh":"2023-07-21T22:35:01.710828+0000","last_change":"2023-07-21T22:35:01.710828+0000","last_active":"2023-07-21T22:35:01.690272+0000","last_peered":"2023-07-21T22:35:01.690272+0000","last_clean":"2023-07-21T22:35:01.690272+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:01.710828+0000","last_undegraded":"2023-07-21T22:35:01.710828+0000","last_fullsized":"2023-07-21T22:35:01.710828+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.728606+0000","last_change":"2023-07-21T22:35:01.725476+0000","last_active":"2023-07-21T22:35:01.728606+0000","last_peered":"2023-07-21T22:35:01.728606+0000","last_clean":"2023-07-21T22:35:01.728606+0000","last_became_active":"2023-07-21T22:35:01.725132+0000","last_became_peered":"2023-07-21T22:35:01.725132+0000","last_unstale":"2023-07-21T22:35:01.728606+0000","last_undegraded":"2023-07-21T22:35:01.728606+0000","last_fullsized":"2023-07-21T22:35:01.728606+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:08.737155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":144,"reported_epoch":96,"state":"active+clean","last_fresh":"2023-07-21T22:35:01.717882+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:35:01.717882+0000","last_peered":"2023-07-21T22:35:01.717882+0000","last_clean":"2023-07-21T22:35:01.717882+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:35:01.717882+0000","last_undegraded":"2023-07-21T22:35:01.717882+0000","last_fullsized":"2023-07-21T22:35:01.717882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:25:15.500236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509638,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59004,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312836,"statfs":{"total":96636764160,"available":96576344064,"internally_reserved":0,"allocated":1757184,"data_stored":1167524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73299999999999998,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.35299999999999998,"15min":0.32600000000000001},"max":{"1min":1.1180000000000001,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.751},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.36099999999999999},"max":{"1min":0.90900000000000003,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.57299999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.432,"15min":0.379},"max":{"1min":1.0509999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72399999999999998,"15min":0.74299999999999999},"min":{"1min":0.51300000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.405},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72899999999999998,"15min":0.752},"min":{"1min":0.47999999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95699999999999996,"5min":1.409,"15min":1.409},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.504,"15min":0.42099999999999999},"max":{"1min":1.1539999999999999,"5min":1.46,"15min":1.46},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.02,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.59399999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55400000000000005,"15min":0.55900000000000005},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.89900000000000002,"5min":0.90500000000000003,"15min":0.94999999999999996},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90400000000000003,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.61299999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64500000000000002,"15min":0.61799999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.56499999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.052,"5min":1.506,"15min":1.506},"last":0.77800000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.048},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.434,"15min":0.42599999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.73399999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542344,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1163264,"data_stored":577156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76700000000000002,"15min":0.76500000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.425},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.59199999999999997,"5min":0.57899999999999996,"15min":0.437},"max":{"1min":1.0289999999999999,"5min":1.1180000000000001,"15min":2.3100000000000001},"last":0.67600000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.55700000000000005,"5min":0.45300000000000001,"15min":0.41999999999999998},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":0.76000000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.99199999999999999,"5min":0.99399999999999999,"15min":8.6280000000000001},"last":0.85199999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.55600000000000005,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.55},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.80700000000000005,"15min":0.79600000000000004},"min":{"1min":0.59699999999999998,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":1.097,"15min":1.097},"last":0.65600000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.748,"15min":0.76400000000000001},"min":{"1min":0.60399999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.7470000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73499999999999999,"15min":0.745},"min":{"1min":0.58399999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92800000000000005,"5min":1.0049999999999999,"15min":1.5129999999999999},"last":0.623}]},{"osd":4,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.45500000000000002,"5min":0.374,"15min":0.36599999999999999},"max":{"1min":0.93400000000000005,"5min":1.0229999999999999,"15min":3.1829999999999998},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.628,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.80100000000000005,"5min":0.86199999999999999,"15min":2.887},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60899999999999999,"15min":0.61899999999999999},"min":{"1min":0.437,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82799999999999996,"5min":0.96299999999999997,"15min":1.4510000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.66200000000000003},"min":{"1min":0.50900000000000001,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.88400000000000001,"5min":0.98799999999999999,"15min":1.054},"last":0.69999999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.52400000000000002,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":0.93600000000000005,"5min":1.079,"15min":1.1679999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68899999999999995,"15min":0.71499999999999997},"min":{"1min":0.54100000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82499999999999996,"5min":1.0449999999999999,"15min":8.0760000000000005},"last":0.79000000000000004}]}]},{"osd":5,"up_from":15,"seq":64424509637,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1150976,"data_stored":570484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72799999999999998,"15min":0.71599999999999997},"min":{"1min":0.53000000000000003,"5min":0.35699999999999998,"15min":0.32900000000000001},"max":{"1min":1,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.47599999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.76600000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69399999999999995,"15min":0.71399999999999997},"min":{"1min":0.45600000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.626},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72999999999999998,"15min":0.73399999999999999},"min":{"1min":0.505,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":1.617,"15min":1.617},"last":0.70499999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71799999999999997,"15min":0.73599999999999999},"min":{"1min":0.53300000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.92800000000000005,"5min":1.0109999999999999,"15min":1.034},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.73799999999999999,"15min":0.75},"min":{"1min":0.53300000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.90800000000000003,"5min":1.512,"15min":1.512},"last":0.78000000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.77200000000000002,"15min":0.78700000000000003},"min":{"1min":0.61299999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.98599999999999999,"5min":1.472,"15min":1.472},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.80300000000000005,"15min":0.79700000000000004},"min":{"1min":0.56899999999999995,"5min":0.496,"15min":0.496},"max":{"1min":1.022,"5min":1.556,"15min":1.556},"last":0.80700000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35399999999999998},"max":{"1min":0.88400000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.48899999999999999,"5min":0.48599999999999999,"15min":0.44900000000000001},"max":{"1min":0.92400000000000004,"5min":1.012,"15min":1.038},"last":0.65500000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.45000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70499999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.62,"15min":0.60899999999999999},"min":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92500000000000004,"5min":1.02,"15min":1.02},"last":0.52400000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:34:04 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.64800000000000002,"15min":0.65200000000000002},"min":{"1min":0.55500000000000005,"5min":0.374,"15min":0.374},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.72499999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.85899999999999999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.73799999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509638,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1163264,"data_stored":577156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71999999999999997,"15min":0.74299999999999999},"min":{"1min":0.51200000000000001,"5min":0.438,"15min":0.40000000000000002},"max":{"1min":0.80900000000000005,"5min":0.99399999999999999,"15min":1.0429999999999999},"last":0.62},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73299999999999998,"15min":0.74299999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.83599999999999997,"5min":0.96099999999999997,"15min":0.97599999999999998},"last":0.80700000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.39400000000000002},"max":{"1min":0.85499999999999998,"5min":1.002,"15min":1.0449999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.69399999999999995,"15min":0.69999999999999996},"min":{"1min":0.47299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.872,"5min":0.94299999999999995,"15min":1.016},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.51200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.95899999999999996,"5min":1.048,"15min":1.048},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.53000000000000003,"5min":0.41999999999999998,"15min":0.33000000000000002},"max":{"1min":1.006,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.75900000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72899999999999998,"15min":0.73699999999999999},"min":{"1min":0.51000000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94099999999999995,"5min":0.97999999999999998,"15min":1.026},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58399999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.69699999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.45100000000000001,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98899999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.38500000000000001},"max":{"1min":0.94699999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.57099999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.79200000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64400000000000002,"15min":0.65100000000000002},"min":{"1min":0.45500000000000002,"5min":0.39900000000000002,"15min":0.374},"max":{"1min":0.92100000000000004,"5min":1.0069999999999999,"15min":1.0429999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.135},"last":0.83599999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509637,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1163264,"data_stored":577156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.48799999999999999,"15min":0.48099999999999998},"min":{"1min":0.35099999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70499999999999996,"5min":0.73099999999999998,"15min":0.76400000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.48399999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.30099999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.871},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.94199999999999995},"last":0.42599999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82899999999999996,"5min":1.0449999999999999,"15min":1.1140000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45500000000000002,"5min":0.45100000000000001,"15min":0.40999999999999998},"max":{"1min":0.84399999999999997,"5min":0.95399999999999996,"15min":0.99199999999999999},"last":0.504}]},{"osd":4,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.57599999999999996,"5min":0.48299999999999998,"15min":0.438},"max":{"1min":1.093,"5min":1.093,"15min":1.3240000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82199999999999995,"15min":0.83299999999999996},"min":{"1min":0.68799999999999994,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.488},"last":0.68400000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.60699999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0669999999999999,"5min":1.137,"15min":1.1919999999999999},"last":0.751},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.60399999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0649999999999999,"15min":1.302},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79200000000000004,"15min":0.80100000000000005},"min":{"1min":0.68000000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.02,"5min":1.056,"15min":1.3979999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76500000000000001,"15min":0.78000000000000003},"min":{"1min":0.56899999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0269999999999999,"5min":1.1120000000000001,"15min":1.3899999999999999},"last":0.73799999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.81000000000000005,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0089999999999999,"5min":1.087,"15min":1.335},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.83699999999999997,"15min":0.83499999999999996},"min":{"1min":0.66100000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.2130000000000001},"last":0.72899999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509639,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54328,"kb_used_data":1136,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317512,"statfs":{"total":96636764160,"available":96581132288,"internally_reserved":0,"allocated":1163264,"data_stored":577156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.29099999999999998,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.69399999999999995,"5min":0.81200000000000006,"15min":0.94199999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53600000000000003,"15min":0.54900000000000004},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.88300000000000001,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.28199999999999997},"max":{"1min":0.82999999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.436},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80700000000000005,"5min":1.085,"15min":1.085},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.37,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55300000000000005,"15min":0.56899999999999995},"min":{"1min":0.43099999999999999,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":1.161,"15min":1.161},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.67600000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.1579999999999999,"5min":1.2569999999999999,"15min":1.6870000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.79400000000000004,"15min":0.80200000000000005},"min":{"1min":0.57699999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.175,"5min":1.1950000000000001,"15min":1.2689999999999999},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.63200000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.2549999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.60599999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.107,"5min":1.206,"15min":1.3089999999999999},"last":0.90300000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.78600000000000003,"15min":0.79800000000000004},"min":{"1min":0.69399999999999995,"5min":0.45500000000000002,"15min":0.40300000000000002},"max":{"1min":1.089,"5min":1.282,"15min":1.3759999999999999},"last":0.75},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.64300000000000002,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.1339999999999999,"5min":1.23,"15min":1.2649999999999999},"last":0.74299999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.80900000000000005,"15min":0.82899999999999996},"min":{"1min":0.64900000000000002,"5min":0.51100000000000001,"15min":0.49099999999999999},"max":{"1min":1.143,"5min":1.2,"15min":1.2909999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.60999999999999999,"5min":0.44900000000000001,"15min":0.44700000000000001},"max":{"1min":1.091,"5min":1.216,"15min":1.3660000000000001},"last":0.67400000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509638,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":1124,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1150976,"data_stored":570484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.28299999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53500000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.626,"5min":0.872,"15min":0.872},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.5,"15min":0.50700000000000001},"min":{"1min":0.33700000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63200000000000001,"5min":0.76100000000000001,"15min":0.81000000000000005},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.29099999999999998},"max":{"1min":0.78900000000000003,"5min":0.83599999999999997,"15min":0.88800000000000001},"last":0.39400000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.57599999999999996,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35799999999999998,"15min":0.33400000000000002},"max":{"1min":0.70799999999999996,"5min":0.84299999999999997,"15min":0.98899999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.505,"15min":0.51700000000000002},"min":{"1min":0.33100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.64200000000000002,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.37}]},{"osd":4,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.748,"15min":0.77000000000000002},"min":{"1min":0.53100000000000003,"5min":0.432,"15min":0.432},"max":{"1min":0.91400000000000003,"5min":1.0860000000000001,"15min":1.234},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.57499999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.014,"5min":1.083,"15min":1.155},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75600000000000001,"15min":0.77800000000000002},"min":{"1min":0.53500000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92500000000000004,"5min":1.0609999999999999,"15min":1.1919999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78500000000000003,"15min":0.80000000000000004},"min":{"1min":0.55200000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.044,"5min":1.121,"15min":1.2849999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78600000000000003,"15min":0.81000000000000005},"min":{"1min":0.57199999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0229999999999999,"5min":1.0580000000000001,"15min":1.23},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76300000000000001,"15min":0.79000000000000004},"min":{"1min":0.50900000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0449999999999999,"5min":1.1020000000000001,"15min":1.3240000000000001},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78600000000000003,"15min":0.80900000000000005},"min":{"1min":0.58599999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.99299999999999999,"5min":1.103,"15min":1.3149999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79000000000000004,"15min":0.80800000000000005},"min":{"1min":0.55500000000000005,"5min":0.52600000000000002,"15min":0.45700000000000002},"max":{"1min":0.97499999999999998,"5min":1.115,"15min":1.3380000000000001},"last":0.71699999999999997}]}]},{"osd":0,"up_from":15,"seq":64424509640,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36848,"kb_used_data":1704,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334992,"statfs":{"total":96636764160,"available":96599031808,"internally_reserved":0,"allocated":1744896,"data_stored":1160852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.50800000000000001},"min":{"1min":0.35899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.67900000000000005,"5min":0.77800000000000002,"15min":0.83199999999999996},"last":0.625}]},{"osd":2,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70999999999999996,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.44,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58199999999999996,"5min":0.871,"15min":0.871},"last":0.58399999999999996}]},{"osd":3,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.35899999999999999,"15min":0.34899999999999998},"max":{"1min":0.76500000000000001,"5min":0.88100000000000001,"15min":0.91300000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.434,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73999999999999999,"5min":1.038,"15min":1.038},"last":0.53600000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.76100000000000001,"15min":0.78100000000000003},"min":{"1min":0.59299999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.321},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.60099999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.093,"5min":1.423,"15min":1.423},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.60299999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0960000000000001,"5min":1.2669999999999999,"15min":1.28},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.78400000000000003,"15min":0.80900000000000005},"min":{"1min":0.70599999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.393},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78500000000000003,"15min":0.81299999999999994},"min":{"1min":0.61799999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.28},"last":0.753},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81399999999999995,"15min":0.81999999999999995},"min":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.131,"5min":1.333,"15min":1.333},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.65900000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.2310000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.80900000000000005,"15min":0.83399999999999996},"min":{"1min":0.60599999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1930000000000001,"5min":1.296,"15min":1.369},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:35:07.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2023-07-21T22:35:07.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.712231+0000', 'last_change': '2023-07-21T22:35:01.712231+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.712231+0000', 'last_undegraded': '2023-07-21T22:35:01.712231+0000', 'last_fullsized': '2023-07-21T22:35:01.712231+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:35:07.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3e is not active+clean 2023-07-21T22:35:07.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.708569+0000', 'last_change': '2023-07-21T22:35:01.708569+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.708569+0000', 'last_undegraded': '2023-07-21T22:35:01.708569+0000', 'last_fullsized': '2023-07-21T22:35:01.708569+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:07.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3d is not active+clean 2023-07-21T22:35:07.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.714258+0000', 'last_change': '2023-07-21T22:35:01.714258+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.714258+0000', 'last_undegraded': '2023-07-21T22:35:01.714258+0000', 'last_fullsized': '2023-07-21T22:35:01.714258+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:35:07.667 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3c is not active+clean 2023-07-21T22:35:07.667 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.710591+0000', 'last_change': '2023-07-21T22:35:01.710591+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.710591+0000', 'last_undegraded': '2023-07-21T22:35:01.710591+0000', 'last_fullsized': '2023-07-21T22:35:01.710591+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:35:07.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3b is not active+clean 2023-07-21T22:35:07.668 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.712175+0000', 'last_change': '2023-07-21T22:35:01.712175+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.712175+0000', 'last_undegraded': '2023-07-21T22:35:01.712175+0000', 'last_fullsized': '2023-07-21T22:35:01.712175+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:35:07.668 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3a is not active+clean 2023-07-21T22:35:07.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.720890+0000', 'last_change': '2023-07-21T22:35:01.720890+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.720890+0000', 'last_undegraded': '2023-07-21T22:35:01.720890+0000', 'last_fullsized': '2023-07-21T22:35:01.720890+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:35:07.669 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.39 is not active+clean 2023-07-21T22:35:07.669 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.714747+0000', 'last_change': '2023-07-21T22:35:01.714747+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.714747+0000', 'last_undegraded': '2023-07-21T22:35:01.714747+0000', 'last_fullsized': '2023-07-21T22:35:01.714747+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:35:07.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.38 is not active+clean 2023-07-21T22:35:07.670 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.711437+0000', 'last_change': '2023-07-21T22:35:01.711437+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.711437+0000', 'last_undegraded': '2023-07-21T22:35:01.711437+0000', 'last_fullsized': '2023-07-21T22:35:01.711437+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:35:07.670 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.37 is not active+clean 2023-07-21T22:35:07.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.714480+0000', 'last_change': '2023-07-21T22:35:01.714480+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.714480+0000', 'last_undegraded': '2023-07-21T22:35:01.714480+0000', 'last_fullsized': '2023-07-21T22:35:01.714480+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:35:07.671 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.36 is not active+clean 2023-07-21T22:35:07.671 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.710651+0000', 'last_change': '2023-07-21T22:35:01.710651+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.710651+0000', 'last_undegraded': '2023-07-21T22:35:01.710651+0000', 'last_fullsized': '2023-07-21T22:35:01.710651+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:35:07.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.35 is not active+clean 2023-07-21T22:35:07.672 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.706954+0000', 'last_change': '2023-07-21T22:35:01.706954+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.706954+0000', 'last_undegraded': '2023-07-21T22:35:01.706954+0000', 'last_fullsized': '2023-07-21T22:35:01.706954+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:07.672 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.34 is not active+clean 2023-07-21T22:35:07.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.710152+0000', 'last_change': '2023-07-21T22:35:01.710152+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.710152+0000', 'last_undegraded': '2023-07-21T22:35:01.710152+0000', 'last_fullsized': '2023-07-21T22:35:01.710152+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:35:07.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.33 is not active+clean 2023-07-21T22:35:07.673 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.710870+0000', 'last_change': '2023-07-21T22:35:01.710870+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.710870+0000', 'last_undegraded': '2023-07-21T22:35:01.710870+0000', 'last_fullsized': '2023-07-21T22:35:01.710870+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:35:07.673 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.32 is not active+clean 2023-07-21T22:35:07.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.720413+0000', 'last_change': '2023-07-21T22:35:01.720413+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.720413+0000', 'last_undegraded': '2023-07-21T22:35:01.720413+0000', 'last_fullsized': '2023-07-21T22:35:01.720413+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:35:07.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.31 is not active+clean 2023-07-21T22:35:07.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.706015+0000', 'last_change': '2023-07-21T22:35:01.706015+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.706015+0000', 'last_undegraded': '2023-07-21T22:35:01.706015+0000', 'last_fullsized': '2023-07-21T22:35:01.706015+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:07.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2023-07-21T22:35:07.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.713065+0000', 'last_change': '2023-07-21T22:35:01.713065+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.713065+0000', 'last_undegraded': '2023-07-21T22:35:01.713065+0000', 'last_fullsized': '2023-07-21T22:35:01.713065+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:35:07.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2f is not active+clean 2023-07-21T22:35:07.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.711317+0000', 'last_change': '2023-07-21T22:35:01.711317+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.711317+0000', 'last_undegraded': '2023-07-21T22:35:01.711317+0000', 'last_fullsized': '2023-07-21T22:35:01.711317+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:35:07.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2e is not active+clean 2023-07-21T22:35:07.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.714428+0000', 'last_change': '2023-07-21T22:35:01.714428+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.714428+0000', 'last_undegraded': '2023-07-21T22:35:01.714428+0000', 'last_fullsized': '2023-07-21T22:35:01.714428+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:35:07.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2d is not active+clean 2023-07-21T22:35:07.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.711409+0000', 'last_change': '2023-07-21T22:35:01.711409+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.711409+0000', 'last_undegraded': '2023-07-21T22:35:01.711409+0000', 'last_fullsized': '2023-07-21T22:35:01.711409+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:35:07.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2c is not active+clean 2023-07-21T22:35:07.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.713783+0000', 'last_change': '2023-07-21T22:35:01.713783+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.713783+0000', 'last_undegraded': '2023-07-21T22:35:01.713783+0000', 'last_fullsized': '2023-07-21T22:35:01.713783+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:35:07.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2b is not active+clean 2023-07-21T22:35:07.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.715249+0000', 'last_change': '2023-07-21T22:35:01.715249+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.715249+0000', 'last_undegraded': '2023-07-21T22:35:01.715249+0000', 'last_fullsized': '2023-07-21T22:35:01.715249+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:35:07.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2a is not active+clean 2023-07-21T22:35:07.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.714470+0000', 'last_change': '2023-07-21T22:35:01.714470+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.714470+0000', 'last_undegraded': '2023-07-21T22:35:01.714470+0000', 'last_fullsized': '2023-07-21T22:35:01.714470+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:35:07.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.29 is not active+clean 2023-07-21T22:35:07.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.715801+0000', 'last_change': '2023-07-21T22:35:01.715801+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.715801+0000', 'last_undegraded': '2023-07-21T22:35:01.715801+0000', 'last_fullsized': '2023-07-21T22:35:01.715801+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:35:07.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.28 is not active+clean 2023-07-21T22:35:07.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.705924+0000', 'last_change': '2023-07-21T22:35:01.705924+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.705924+0000', 'last_undegraded': '2023-07-21T22:35:01.705924+0000', 'last_fullsized': '2023-07-21T22:35:01.705924+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:07.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.27 is not active+clean 2023-07-21T22:35:07.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.705356+0000', 'last_change': '2023-07-21T22:35:01.705356+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.705356+0000', 'last_undegraded': '2023-07-21T22:35:01.705356+0000', 'last_fullsized': '2023-07-21T22:35:01.705356+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:07.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.26 is not active+clean 2023-07-21T22:35:07.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.709816+0000', 'last_change': '2023-07-21T22:35:01.709816+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.709816+0000', 'last_undegraded': '2023-07-21T22:35:01.709816+0000', 'last_fullsized': '2023-07-21T22:35:01.709816+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:35:07.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2023-07-21T22:35:07.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.713111+0000', 'last_change': '2023-07-21T22:35:01.713111+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.713111+0000', 'last_undegraded': '2023-07-21T22:35:01.713111+0000', 'last_fullsized': '2023-07-21T22:35:01.713111+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:35:07.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.24 is not active+clean 2023-07-21T22:35:07.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.710226+0000', 'last_change': '2023-07-21T22:35:01.710226+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.710226+0000', 'last_undegraded': '2023-07-21T22:35:01.710226+0000', 'last_fullsized': '2023-07-21T22:35:01.710226+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:35:07.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.23 is not active+clean 2023-07-21T22:35:07.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.706650+0000', 'last_change': '2023-07-21T22:35:01.706650+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.706650+0000', 'last_undegraded': '2023-07-21T22:35:01.706650+0000', 'last_fullsized': '2023-07-21T22:35:01.706650+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:07.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2023-07-21T22:35:07.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.712564+0000', 'last_change': '2023-07-21T22:35:01.712564+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.712564+0000', 'last_undegraded': '2023-07-21T22:35:01.712564+0000', 'last_fullsized': '2023-07-21T22:35:01.712564+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:35:07.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.21 is not active+clean 2023-07-21T22:35:07.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.714162+0000', 'last_change': '2023-07-21T22:35:01.714162+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.714162+0000', 'last_undegraded': '2023-07-21T22:35:01.714162+0000', 'last_fullsized': '2023-07-21T22:35:01.714162+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:35:07.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2023-07-21T22:35:07.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.712159+0000', 'last_change': '2023-07-21T22:35:01.712159+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.712159+0000', 'last_undegraded': '2023-07-21T22:35:01.712159+0000', 'last_fullsized': '2023-07-21T22:35:01.712159+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:35:07.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2023-07-21T22:35:07.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.712963+0000', 'last_change': '2023-07-21T22:35:01.712963+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.712963+0000', 'last_undegraded': '2023-07-21T22:35:01.712963+0000', 'last_fullsized': '2023-07-21T22:35:01.712963+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:35:07.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-07-21T22:35:07.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.705333+0000', 'last_change': '2023-07-21T22:35:01.705333+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.705333+0000', 'last_undegraded': '2023-07-21T22:35:01.705333+0000', 'last_fullsized': '2023-07-21T22:35:01.705333+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:07.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-07-21T22:35:07.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.715674+0000', 'last_change': '2023-07-21T22:35:01.715674+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.715674+0000', 'last_undegraded': '2023-07-21T22:35:01.715674+0000', 'last_fullsized': '2023-07-21T22:35:01.715674+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:35:07.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-07-21T22:35:07.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.714804+0000', 'last_change': '2023-07-21T22:35:01.714804+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.714804+0000', 'last_undegraded': '2023-07-21T22:35:01.714804+0000', 'last_fullsized': '2023-07-21T22:35:01.714804+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:35:07.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-07-21T22:35:07.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.706889+0000', 'last_change': '2023-07-21T22:35:01.706889+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.706889+0000', 'last_undegraded': '2023-07-21T22:35:01.706889+0000', 'last_fullsized': '2023-07-21T22:35:01.706889+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:07.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-07-21T22:35:07.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.706455+0000', 'last_change': '2023-07-21T22:35:01.706455+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.706455+0000', 'last_undegraded': '2023-07-21T22:35:01.706455+0000', 'last_fullsized': '2023-07-21T22:35:01.706455+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:07.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-07-21T22:35:07.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.716076+0000', 'last_change': '2023-07-21T22:35:01.716076+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.716076+0000', 'last_undegraded': '2023-07-21T22:35:01.716076+0000', 'last_fullsized': '2023-07-21T22:35:01.716076+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:35:07.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-07-21T22:35:07.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.717583+0000', 'last_change': '2023-07-21T22:35:01.717583+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.717583+0000', 'last_undegraded': '2023-07-21T22:35:01.717583+0000', 'last_fullsized': '2023-07-21T22:35:01.717583+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:35:07.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-07-21T22:35:07.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.705327+0000', 'last_change': '2023-07-21T22:35:01.705327+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.705327+0000', 'last_undegraded': '2023-07-21T22:35:01.705327+0000', 'last_fullsized': '2023-07-21T22:35:01.705327+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:07.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-07-21T22:35:07.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.709509+0000', 'last_change': '2023-07-21T22:35:01.709509+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.709509+0000', 'last_undegraded': '2023-07-21T22:35:01.709509+0000', 'last_fullsized': '2023-07-21T22:35:01.709509+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:35:07.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-07-21T22:35:07.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.719701+0000', 'last_change': '2023-07-21T22:35:01.719701+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.719701+0000', 'last_undegraded': '2023-07-21T22:35:01.719701+0000', 'last_fullsized': '2023-07-21T22:35:01.719701+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:35:07.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2023-07-21T22:35:07.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.711573+0000', 'last_change': '2023-07-21T22:35:01.711573+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.711573+0000', 'last_undegraded': '2023-07-21T22:35:01.711573+0000', 'last_fullsized': '2023-07-21T22:35:01.711573+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:35:07.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-07-21T22:35:07.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.709509+0000', 'last_change': '2023-07-21T22:35:01.709509+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.709509+0000', 'last_undegraded': '2023-07-21T22:35:01.709509+0000', 'last_fullsized': '2023-07-21T22:35:01.709509+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:35:07.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-07-21T22:35:07.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.716885+0000', 'last_change': '2023-07-21T22:35:01.716885+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.716885+0000', 'last_undegraded': '2023-07-21T22:35:01.716885+0000', 'last_fullsized': '2023-07-21T22:35:01.716885+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:35:07.695 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-07-21T22:35:07.695 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.716467+0000', 'last_change': '2023-07-21T22:35:01.716467+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.716467+0000', 'last_undegraded': '2023-07-21T22:35:01.716467+0000', 'last_fullsized': '2023-07-21T22:35:01.716467+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:35:07.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-07-21T22:35:07.696 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.717111+0000', 'last_change': '2023-07-21T22:35:01.717111+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.717111+0000', 'last_undegraded': '2023-07-21T22:35:01.717111+0000', 'last_fullsized': '2023-07-21T22:35:01.717111+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:35:07.696 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-07-21T22:35:07.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.714232+0000', 'last_change': '2023-07-21T22:35:01.714232+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.714232+0000', 'last_undegraded': '2023-07-21T22:35:01.714232+0000', 'last_fullsized': '2023-07-21T22:35:01.714232+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:35:07.697 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-07-21T22:35:07.697 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.714235+0000', 'last_change': '2023-07-21T22:35:01.714235+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.714235+0000', 'last_undegraded': '2023-07-21T22:35:01.714235+0000', 'last_fullsized': '2023-07-21T22:35:01.714235+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:35:07.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-07-21T22:35:07.698 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.713670+0000', 'last_change': '2023-07-21T22:35:01.713670+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.713670+0000', 'last_undegraded': '2023-07-21T22:35:01.713670+0000', 'last_fullsized': '2023-07-21T22:35:01.713670+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:35:07.698 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-07-21T22:35:07.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.705531+0000', 'last_change': '2023-07-21T22:35:01.705531+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.705531+0000', 'last_undegraded': '2023-07-21T22:35:01.705531+0000', 'last_fullsized': '2023-07-21T22:35:01.705531+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:07.699 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-07-21T22:35:07.699 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.715945+0000', 'last_change': '2023-07-21T22:35:01.715945+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.715945+0000', 'last_undegraded': '2023-07-21T22:35:01.715945+0000', 'last_fullsized': '2023-07-21T22:35:01.715945+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:35:07.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-07-21T22:35:07.700 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.716399+0000', 'last_change': '2023-07-21T22:35:01.716399+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.716399+0000', 'last_undegraded': '2023-07-21T22:35:01.716399+0000', 'last_fullsized': '2023-07-21T22:35:01.716399+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:35:07.700 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2023-07-21T22:35:07.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.713064+0000', 'last_change': '2023-07-21T22:35:01.713064+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.713064+0000', 'last_undegraded': '2023-07-21T22:35:01.713064+0000', 'last_fullsized': '2023-07-21T22:35:01.713064+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:35:07.701 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2023-07-21T22:35:07.701 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.712453+0000', 'last_change': '2023-07-21T22:35:01.712453+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.712453+0000', 'last_undegraded': '2023-07-21T22:35:01.712453+0000', 'last_fullsized': '2023-07-21T22:35:01.712453+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:35:07.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-07-21T22:35:07.702 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.712551+0000', 'last_change': '2023-07-21T22:35:01.712551+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.712551+0000', 'last_undegraded': '2023-07-21T22:35:01.712551+0000', 'last_fullsized': '2023-07-21T22:35:01.712551+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:35:07.702 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-07-21T22:35:07.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.706360+0000', 'last_change': '2023-07-21T22:35:01.706360+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.706360+0000', 'last_undegraded': '2023-07-21T22:35:01.706360+0000', 'last_fullsized': '2023-07-21T22:35:01.706360+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:07.703 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-07-21T22:35:07.703 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.716563+0000', 'last_change': '2023-07-21T22:35:01.716563+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.716563+0000', 'last_undegraded': '2023-07-21T22:35:01.716563+0000', 'last_fullsized': '2023-07-21T22:35:01.716563+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:35:07.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-07-21T22:35:07.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.705682+0000', 'last_change': '2023-07-21T22:35:01.705682+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.705682+0000', 'last_undegraded': '2023-07-21T22:35:01.705682+0000', 'last_fullsized': '2023-07-21T22:35:01.705682+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:07.704 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-07-21T22:35:07.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.710601+0000', 'last_change': '2023-07-21T22:35:01.710601+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.710601+0000', 'last_undegraded': '2023-07-21T22:35:01.710601+0000', 'last_fullsized': '2023-07-21T22:35:01.710601+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:35:07.705 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2023-07-21T22:35:07.705 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.712139+0000', 'last_change': '2023-07-21T22:35:01.712139+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.712139+0000', 'last_undegraded': '2023-07-21T22:35:01.712139+0000', 'last_fullsized': '2023-07-21T22:35:01.712139+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:35:07.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-07-21T22:35:07.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.713905+0000', 'last_change': '2023-07-21T22:35:01.713905+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.713905+0000', 'last_undegraded': '2023-07-21T22:35:01.713905+0000', 'last_fullsized': '2023-07-21T22:35:01.713905+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:35:07.706 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2023-07-21T22:35:07.706 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 96, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:01.710828+0000', 'last_change': '2023-07-21T22:35:01.710828+0000', 'last_active': '2023-07-21T22:35:01.690272+0000', 'last_peered': '2023-07-21T22:35:01.690272+0000', 'last_clean': '2023-07-21T22:35:01.690272+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:01.710828+0000', 'last_undegraded': '2023-07-21T22:35:01.710828+0000', 'last_fullsized': '2023-07-21T22:35:01.710828+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:01.690272+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:35:07.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-21T22:35:07.722 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-07-21T22:35:07.670+0000 7f2ad1da4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:35:07.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.802+0000 7ff7efa93640 1 Processor -- start 2023-07-21T22:35:07.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.802+0000 7ff7efa93640 1 -- start start 2023-07-21T22:35:07.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.802+0000 7ff7efa93640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7e8158ce0 0x7ff7e8070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.802+0000 7ff7efa93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7e80c8ad0 0x7ff7e80c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.802+0000 7ff7efa93640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e80cc700 con 0x7ff7e80c9560 2023-07-21T22:35:07.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.802+0000 7ff7efa93640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e80c99e0 con 0x7ff7e8158ce0 2023-07-21T22:35:07.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.802+0000 7ff7efa93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e80b0ff0 con 0x7ff7e80c8ad0 2023-07-21T22:35:07.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.802+0000 7ff7ed82f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7e8158ce0 0x7ff7e8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.802+0000 7ff7ed82f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7e8158ce0 0x7ff7e8070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39216/0 (socket says 172.21.15.6:39216) 2023-07-21T22:35:07.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.802+0000 7ff7ed82f640 1 -- 172.21.15.6:0/1744945140 learned_addr learned my addr 172.21.15.6:0/1744945140 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:07.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.802+0000 7ff7ed02e640 1 --2- 172.21.15.6:0/1744945140 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7e80c8ad0 0x7ff7e80c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.802+0000 7ff7ed82f640 1 -- 172.21.15.6:0/1744945140 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7e80c8ad0 msgr2=0x7ff7e80c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:07.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.802+0000 7ff7ed82f640 1 --2- 172.21.15.6:0/1744945140 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7e80c8ad0 0x7ff7e80c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.802+0000 7ff7ed82f640 1 -- 172.21.15.6:0/1744945140 >> v1:172.21.15.161:6789/0 conn(0x7ff7e80c9560 legacy=0x7ff7e80cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:07.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.802+0000 7ff7ed82f640 1 -- 172.21.15.6:0/1744945140 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e8070c80 con 0x7ff7e8158ce0 2023-07-21T22:35:07.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.806+0000 7ff7ed82f640 1 --2- 172.21.15.6:0/1744945140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e8158ce0 0x7ff7e8070450 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4009870 tx=0x7ff7e401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6616d71f32db0cf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:07.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.806+0000 7ff7ec82d640 1 -- 172.21.15.6:0/1744945140 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e80cba20 con 0x7ff7e8158ce0 2023-07-21T22:35:07.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.806+0000 7ff7ec82d640 1 -- 172.21.15.6:0/1744945140 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e40a7050 con 0x7ff7e8158ce0 2023-07-21T22:35:07.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.806+0000 7ff7ec82d640 1 -- 172.21.15.6:0/1744945140 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40ab820 con 0x7ff7e8158ce0 2023-07-21T22:35:07.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.806+0000 7ff7efa93640 1 -- 172.21.15.6:0/1744945140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e8158ce0 msgr2=0x7ff7e8070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:07.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.806+0000 7ff7efa93640 1 --2- 172.21.15.6:0/1744945140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e8158ce0 0x7ff7e8070450 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4009870 tx=0x7ff7e401c3f0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.806+0000 7ff7efa93640 1 -- 172.21.15.6:0/1744945140 shutdown_connections 2023-07-21T22:35:07.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.806+0000 7ff7efa93640 1 --2- 172.21.15.6:0/1744945140 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7e80c8ad0 0x7ff7e80c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.806+0000 7ff7efa93640 1 --2- 172.21.15.6:0/1744945140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e8158ce0 0x7ff7e8070450 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.806+0000 7ff7efa93640 1 -- 172.21.15.6:0/1744945140 >> 172.21.15.6:0/1744945140 conn(0x7ff7e80afcf0 msgr2=0x7ff7e80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:07.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.806+0000 7ff7efa93640 1 -- 172.21.15.6:0/1744945140 shutdown_connections 2023-07-21T22:35:07.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.806+0000 7ff7efa93640 1 -- 172.21.15.6:0/1744945140 wait complete. 2023-07-21T22:35:07.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7efa93640 1 Processor -- start 2023-07-21T22:35:07.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7efa93640 1 -- start start 2023-07-21T22:35:07.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7efa93640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7e80c8ad0 0x7ff7e814bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7efa93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7e80c9560 0x7ff7e8150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7efa93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e8158ce0 0x7ff7e80c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7efa93640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e814c530 con 0x7ff7e8158ce0 2023-07-21T22:35:07.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7efa93640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e80c5f20 con 0x7ff7e80c8ad0 2023-07-21T22:35:07.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7efa93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e8151040 con 0x7ff7e80c9560 2023-07-21T22:35:07.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7ee030640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e8158ce0 0x7ff7e80c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7ed82f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7e80c8ad0 0x7ff7e814bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7ee030640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e8158ce0 0x7ff7e80c6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39226/0 (socket says 172.21.15.6:39226) 2023-07-21T22:35:07.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7ee030640 1 -- 172.21.15.6:0/453434133 learned_addr learned my addr 172.21.15.6:0/453434133 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:07.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7ed02e640 1 --2- 172.21.15.6:0/453434133 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7e80c9560 0x7ff7e8150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7ee030640 1 -- 172.21.15.6:0/453434133 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7e80c9560 msgr2=0x7ff7e8150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:07.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7ee030640 1 --2- 172.21.15.6:0/453434133 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7e80c9560 0x7ff7e8150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7ee030640 1 -- 172.21.15.6:0/453434133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7e80c8ad0 msgr2=0x7ff7e814bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:07.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7ee030640 1 --2- 172.21.15.6:0/453434133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7e80c8ad0 0x7ff7e814bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:07.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7ee030640 1 -- 172.21.15.6:0/453434133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e40094d0 con 0x7ff7e8158ce0 2023-07-21T22:35:07.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7ee030640 1 --2- 172.21.15.6:0/453434133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e8158ce0 0x7ff7e80c6f10 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000c730 tx=0x7ff7e000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:07.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7de7fc640 1 -- 172.21.15.6:0/453434133 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0003b80 con 0x7ff7e8158ce0 2023-07-21T22:35:07.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7de7fc640 1 -- 172.21.15.6:0/453434133 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e0003ce0 con 0x7ff7e8158ce0 2023-07-21T22:35:07.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7de7fc640 1 -- 172.21.15.6:0/453434133 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e000aa30 con 0x7ff7e8158ce0 2023-07-21T22:35:07.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7efa93640 1 -- 172.21.15.6:0/453434133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e81512c0 con 0x7ff7e8158ce0 2023-07-21T22:35:07.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.810+0000 7ff7efa93640 1 -- 172.21.15.6:0/453434133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e80c6430 con 0x7ff7e8158ce0 2023-07-21T22:35:07.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.814+0000 7ff7efa93640 1 -- 172.21.15.6:0/453434133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e80ca1a0 con 0x7ff7e8158ce0 2023-07-21T22:35:07.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.814+0000 7ff7de7fc640 1 -- 172.21.15.6:0/453434133 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff7e000ab90 con 0x7ff7e8158ce0 2023-07-21T22:35:07.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.814+0000 7ff7de7fc640 1 --2- 172.21.15.6:0/453434133 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7ff7cc0663a0 0x7ff7cc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:07.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.814+0000 7ff7de7fc640 1 -- 172.21.15.6:0/453434133 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6106+0+0 (secure 0 0 0) 0x7ff7e0083b70 con 0x7ff7e8158ce0 2023-07-21T22:35:07.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.814+0000 7ff7ed82f640 1 --2- 172.21.15.6:0/453434133 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7ff7cc0663a0 0x7ff7cc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:07.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.818+0000 7ff7ed82f640 1 --2- 172.21.15.6:0/453434133 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7ff7cc0663a0 0x7ff7cc068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40ad000 tx=0x7ff7e40a4f90 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:07.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:07.818+0000 7ff7de7fc640 1 -- 172.21.15.6:0/453434133 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff7e0050f60 con 0x7ff7e8158ce0 2023-07-21T22:35:08.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.030+0000 7ff7efa93640 1 -- 172.21.15.6:0/453434133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff7e80678d0 con 0x7ff7e8158ce0 2023-07-21T22:35:08.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.030+0000 7ff7de7fc640 1 -- 172.21.15.6:0/453434133 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3230 (secure 0 0 0) 0x7ff7e0054580 con 0x7ff7e8158ce0 2023-07-21T22:35:08.081 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:08.081 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1010,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":98,"num_osds":8,"num_up_osds":8,"osd_up_since":1689977909,"num_in_osds":8,"osd_in_since":1689977900,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":318541824,"bytes_avail":772775571456,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":39,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":7131}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2023-07-21T22:34:50.390355+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-21T22:35:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.030+0000 7ff7efa93640 1 -- 172.21.15.6:0/453434133 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7ff7cc0663a0 msgr2=0x7ff7cc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.030+0000 7ff7efa93640 1 --2- 172.21.15.6:0/453434133 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7ff7cc0663a0 0x7ff7cc068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40ad000 tx=0x7ff7e40a4f90 comp rx=0 tx=0).stop 2023-07-21T22:35:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.030+0000 7ff7efa93640 1 -- 172.21.15.6:0/453434133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e8158ce0 msgr2=0x7ff7e80c6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:08.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.030+0000 7ff7efa93640 1 --2- 172.21.15.6:0/453434133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e8158ce0 0x7ff7e80c6f10 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000c730 tx=0x7ff7e000cbf0 comp rx=0 tx=0).stop 2023-07-21T22:35:08.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.030+0000 7ff7efa93640 1 -- 172.21.15.6:0/453434133 shutdown_connections 2023-07-21T22:35:08.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.030+0000 7ff7efa93640 1 --2- 172.21.15.6:0/453434133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e8158ce0 0x7ff7e80c6f10 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:08.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.030+0000 7ff7efa93640 1 --2- 172.21.15.6:0/453434133 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7ff7cc0663a0 0x7ff7cc068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:08.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.030+0000 7ff7efa93640 1 --2- 172.21.15.6:0/453434133 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7e80c9560 0x7ff7e8150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:08.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.030+0000 7ff7efa93640 1 --2- 172.21.15.6:0/453434133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff7e80c8ad0 0x7ff7e814bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:08.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.030+0000 7ff7efa93640 1 -- 172.21.15.6:0/453434133 >> 172.21.15.6:0/453434133 conn(0x7ff7e80afcf0 msgr2=0x7ff7e80ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:08.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.030+0000 7ff7efa93640 1 -- 172.21.15.6:0/453434133 shutdown_connections 2023-07-21T22:35:08.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.030+0000 7ff7efa93640 1 -- 172.21.15.6:0/453434133 wait complete. 2023-07-21T22:35:08.101 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-21T22:35:08.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:35:08.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.234+0000 7f54b7ae6640 1 Processor -- start 2023-07-21T22:35:08.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.234+0000 7f54b7ae6640 1 -- start start 2023-07-21T22:35:08.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.234+0000 7f54b7ae6640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f54b00c8ad0 0x7f54b00c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:08.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.234+0000 7f54b7ae6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b00c99c0 con 0x7f54b00c9560 2023-07-21T22:35:08.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.234+0000 7f54b7ae6640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b00cc700 con 0x7f54b0158ce0 2023-07-21T22:35:08.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.234+0000 7f54b7ae6640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b00b0ff0 con 0x7f54b00c8ad0 2023-07-21T22:35:08.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.234+0000 7f54b6083640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f54b00c9560 0x7f54b00ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52708/0 (socket says 172.21.15.6:52708) 2023-07-21T22:35:08.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.234+0000 7f54b6083640 1 -- 172.21.15.6:0/1212031070 learned_addr learned my addr 172.21.15.6:0/1212031070 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:08.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b5081640 1 --2- 172.21.15.6:0/1212031070 >> v2:172.21.15.161:3300/0 conn(0x7f54b00c8ad0 0x7f54b00c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:08.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b4880640 1 -- 172.21.15.6:0/1212031070 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606568530 0 0) 0x7f54b00c99c0 con 0x7f54b00c9560 2023-07-21T22:35:08.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b4880640 1 -- 172.21.15.6:0/1212031070 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f549c003530 con 0x7f54b00c9560 2023-07-21T22:35:08.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b4880640 1 -- 172.21.15.6:0/1212031070 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080037461 0 0) 0x7f54b00cc700 con 0x7f54b0158ce0 2023-07-21T22:35:08.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b4880640 1 -- 172.21.15.6:0/1212031070 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54b00c99c0 con 0x7f54b0158ce0 2023-07-21T22:35:08.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b4880640 1 -- 172.21.15.6:0/1212031070 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1229485506 0 0) 0x7f549c003530 con 0x7f54b00c9560 2023-07-21T22:35:08.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b4880640 1 -- 172.21.15.6:0/1212031070 >> v2:172.21.15.161:3300/0 conn(0x7f54b00c8ad0 msgr2=0x7f54b00c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:08.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b4880640 1 --2- 172.21.15.6:0/1212031070 >> v2:172.21.15.161:3300/0 conn(0x7f54b00c8ad0 0x7f54b00c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:08.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b4880640 1 -- 172.21.15.6:0/1212031070 >> v1:172.21.15.161:6789/0 conn(0x7f54b0158ce0 legacy=0x7f54b0070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:08.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b4880640 1 -- 172.21.15.6:0/1212031070 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b0070c80 con 0x7f54b00c9560 2023-07-21T22:35:08.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b4880640 1 -- 172.21.15.6:0/1212031070 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f54a8001a00 con 0x7f54b00c9560 2023-07-21T22:35:08.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b4880640 1 -- 172.21.15.6:0/1212031070 >> v1:172.21.15.6:6789/0 conn(0x7f54b00c9560 legacy=0x7f54b00ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:08.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b4880640 1 --2- 172.21.15.6:0/1212031070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f549c003b10 0x7f549c003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:08.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b4880640 1 --2- 172.21.15.6:0/1212031070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0047d0 0x7f549c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:08.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b4880640 1 --2- 172.21.15.6:0/1212031070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f549c0051f0 0x7f549c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:08.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b4880640 1 -- 172.21.15.6:0/1212031070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b00b0ff0 con 0x7f549c0047d0 2023-07-21T22:35:08.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b4880640 1 -- 172.21.15.6:0/1212031070 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c00e340 con 0x7f549c003b10 2023-07-21T22:35:08.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b4880640 1 -- 172.21.15.6:0/1212031070 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549c00e500 con 0x7f549c0051f0 2023-07-21T22:35:08.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b5081640 1 --2- 172.21.15.6:0/1212031070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0047d0 0x7f549c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:08.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b5882640 1 --2- 172.21.15.6:0/1212031070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f549c003b10 0x7f549c003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:08.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b6083640 1 --2- 172.21.15.6:0/1212031070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f549c0051f0 0x7f549c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:08.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b5081640 1 -- 172.21.15.6:0/1212031070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f549c0051f0 msgr2=0x7f549c00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:08.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b5081640 1 --2- 172.21.15.6:0/1212031070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f549c0051f0 0x7f549c00dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:08.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b5081640 1 -- 172.21.15.6:0/1212031070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f549c003b10 msgr2=0x7f549c003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:08.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b5081640 1 --2- 172.21.15.6:0/1212031070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f549c003b10 0x7f549c003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:08.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b5081640 1 -- 172.21.15.6:0/1212031070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c003530 con 0x7f549c0047d0 2023-07-21T22:35:08.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b6083640 1 --2- 172.21.15.6:0/1212031070 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f549c0051f0 0x7f549c00dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:08.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.238+0000 7f54b6083640 1 -- 172.21.15.6:0/1212031070 reap_dead start 2023-07-21T22:35:08.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.242+0000 7f54b5081640 1 --2- 172.21.15.6:0/1212031070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0047d0 0x7f549c004c40 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f54a0009ae0 tx=0x7f54a001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11cd50cbb5b1d13c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:08.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.242+0000 7f54b4880640 1 -- 172.21.15.6:0/1212031070 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a00a6510 con 0x7f549c0047d0 2023-07-21T22:35:08.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.242+0000 7f54b4880640 1 -- 172.21.15.6:0/1212031070 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a00a6670 con 0x7f549c0047d0 2023-07-21T22:35:08.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.242+0000 7f54b4880640 1 -- 172.21.15.6:0/1212031070 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a00a6a20 con 0x7f549c0047d0 2023-07-21T22:35:08.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.242+0000 7f54b7ae6640 1 -- 172.21.15.6:0/1212031070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0047d0 msgr2=0x7f549c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:08.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.242+0000 7f54b7ae6640 1 --2- 172.21.15.6:0/1212031070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0047d0 0x7f549c004c40 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f54a0009ae0 tx=0x7f54a001ca20 comp rx=0 tx=0).stop 2023-07-21T22:35:08.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.242+0000 7f54b7ae6640 1 -- 172.21.15.6:0/1212031070 shutdown_connections 2023-07-21T22:35:08.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.242+0000 7f54b7ae6640 1 --2- 172.21.15.6:0/1212031070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0047d0 0x7f549c004c40 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:08.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.242+0000 7f54b7ae6640 1 -- 172.21.15.6:0/1212031070 >> 172.21.15.6:0/1212031070 conn(0x7f54b00afcf0 msgr2=0x7f54b00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:08.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.242+0000 7f54b7ae6640 1 -- 172.21.15.6:0/1212031070 shutdown_connections 2023-07-21T22:35:08.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.242+0000 7f54b7ae6640 1 -- 172.21.15.6:0/1212031070 wait complete. 2023-07-21T22:35:08.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.242+0000 7f54b7ae6640 1 Processor -- start 2023-07-21T22:35:08.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.242+0000 7f54b7ae6640 1 -- start start 2023-07-21T22:35:08.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.242+0000 7f54b7ae6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f549c0047d0 0x7f54b01f4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:08.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.242+0000 7f54b7ae6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54b01efd00 0x7f54b00c2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:08.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.242+0000 7f54b7ae6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54b00c3250 0x7f54b00c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:08.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.242+0000 7f54b7ae6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b00c36c0 con 0x7f54b00c3250 2023-07-21T22:35:08.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.242+0000 7f54b7ae6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b01f48d0 con 0x7f54b01efd00 2023-07-21T22:35:08.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.242+0000 7f54b7ae6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b014fef0 con 0x7f549c0047d0 2023-07-21T22:35:08.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.246+0000 7f54b6083640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54b00c3250 0x7f54b00c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:08.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.246+0000 7f54b6083640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54b00c3250 0x7f54b00c1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39246/0 (socket says 172.21.15.6:39246) 2023-07-21T22:35:08.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.246+0000 7f54b6083640 1 -- 172.21.15.6:0/1340263745 learned_addr learned my addr 172.21.15.6:0/1340263745 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:08.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.246+0000 7f54b5081640 1 --2- 172.21.15.6:0/1340263745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54b01efd00 0x7f54b00c2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:08.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.246+0000 7f54b5882640 1 --2- 172.21.15.6:0/1340263745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f549c0047d0 0x7f54b01f4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:08.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.246+0000 7f54b6083640 1 -- 172.21.15.6:0/1340263745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f549c0047d0 msgr2=0x7f54b01f4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:08.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.246+0000 7f54b6083640 1 --2- 172.21.15.6:0/1340263745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f549c0047d0 0x7f54b01f4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:08.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.246+0000 7f54b6083640 1 -- 172.21.15.6:0/1340263745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54b01efd00 msgr2=0x7f54b00c2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:08.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.246+0000 7f54b6083640 1 --2- 172.21.15.6:0/1340263745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54b01efd00 0x7f54b00c2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:08.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.246+0000 7f54b6083640 1 -- 172.21.15.6:0/1340263745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b01501d0 con 0x7f54b00c3250 2023-07-21T22:35:08.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.246+0000 7f54b6083640 1 --2- 172.21.15.6:0/1340263745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54b00c3250 0x7f54b00c1c90 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f54b0066260 tx=0x7f54a8007640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:08.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.246+0000 7f54a67fc640 1 -- 172.21.15.6:0/1340263745 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8014480 con 0x7f54b00c3250 2023-07-21T22:35:08.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.246+0000 7f54a67fc640 1 -- 172.21.15.6:0/1340263745 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a80145e0 con 0x7f54b00c3250 2023-07-21T22:35:08.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.246+0000 7f54a67fc640 1 -- 172.21.15.6:0/1340263745 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8014990 con 0x7f54b00c3250 2023-07-21T22:35:08.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.246+0000 7f54b7ae6640 1 -- 172.21.15.6:0/1340263745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b0150fd0 con 0x7f54b00c3250 2023-07-21T22:35:08.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.246+0000 7f54b7ae6640 1 -- 172.21.15.6:0/1340263745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b01504b0 con 0x7f54b00c3250 2023-07-21T22:35:08.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.246+0000 7f54b7ae6640 1 -- 172.21.15.6:0/1340263745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b0151480 con 0x7f54b00c3250 2023-07-21T22:35:08.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.246+0000 7f54a67fc640 1 -- 172.21.15.6:0/1340263745 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f54a8012380 con 0x7f54b00c3250 2023-07-21T22:35:08.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.250+0000 7f54a67fc640 1 --2- 172.21.15.6:0/1340263745 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f54940663a0 0x7f5494068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:08.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.250+0000 7f54a67fc640 1 -- 172.21.15.6:0/1340263745 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f54a8083100 con 0x7f54b00c3250 2023-07-21T22:35:08.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.250+0000 7f54b5882640 1 --2- 172.21.15.6:0/1340263745 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f54940663a0 0x7f5494068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:08.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.250+0000 7f54b5882640 1 --2- 172.21.15.6:0/1340263745 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f54940663a0 0x7f5494068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0010f0 tx=0x7f54ac009040 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:08.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.254+0000 7f54a67fc640 1 -- 172.21.15.6:0/1340263745 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f54b0151480 con 0x7f54b00c3250 2023-07-21T22:35:08.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.402+0000 7f54b7ae6640 1 -- 172.21.15.6:0/1340263745 --> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54b0150700 con 0x7f54940663a0 2023-07-21T22:35:08.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.414+0000 7f54a67fc640 1 -- 172.21.15.6:0/1340263745 <== mgr.6763 v2:172.21.15.161:6832/3267017989 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311000 (secure 0 0 0) 0x7f54ac012890 con 0x7f54940663a0 2023-07-21T22:35:08.466 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:08.467 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:35:08.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.414+0000 7f54b7ae6640 1 -- 172.21.15.6:0/1340263745 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f54940663a0 msgr2=0x7f5494068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:08.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.414+0000 7f54b7ae6640 1 --2- 172.21.15.6:0/1340263745 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f54940663a0 0x7f5494068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0010f0 tx=0x7f54ac009040 comp rx=0 tx=0).stop 2023-07-21T22:35:08.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.414+0000 7f54b7ae6640 1 -- 172.21.15.6:0/1340263745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54b00c3250 msgr2=0x7f54b00c1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:08.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.414+0000 7f54b7ae6640 1 --2- 172.21.15.6:0/1340263745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54b00c3250 0x7f54b00c1c90 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f54b0066260 tx=0x7f54a8007640 comp rx=0 tx=0).stop 2023-07-21T22:35:08.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.414+0000 7f54b7ae6640 1 -- 172.21.15.6:0/1340263745 shutdown_connections 2023-07-21T22:35:08.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.414+0000 7f54b7ae6640 1 --2- 172.21.15.6:0/1340263745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54b00c3250 0x7f54b00c1c90 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:08.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.414+0000 7f54b7ae6640 1 --2- 172.21.15.6:0/1340263745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54b01efd00 0x7f54b00c2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:08.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.414+0000 7f54b7ae6640 1 --2- 172.21.15.6:0/1340263745 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f54940663a0 0x7f5494068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:08.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.414+0000 7f54b7ae6640 1 --2- 172.21.15.6:0/1340263745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f549c0047d0 0x7f54b01f4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:08.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.414+0000 7f54b7ae6640 1 -- 172.21.15.6:0/1340263745 >> 172.21.15.6:0/1340263745 conn(0x7f54b00afcf0 msgr2=0x7f54b00af010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:08.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.414+0000 7f54b7ae6640 1 -- 172.21.15.6:0/1340263745 shutdown_connections 2023-07-21T22:35:08.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:08.414+0000 7f54b7ae6640 1 -- 172.21.15.6:0/1340263745 wait complete. 2023-07-21T22:35:08.485 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-21T22:35:08.395049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":324,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":311368,"kb_used_data":10504,"kb_used_omap":0,"kb_used_meta":300800,"kb_avail":754663352,"statfs":{"total":773094113280,"available":772775272448,"internally_reserved":0,"allocated":10756096,"data_stored":5913660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308019200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.688181"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259587+0000","last_change":"2023-07-21T22:35:02.729207+0000","last_active":"2023-07-21T22:35:04.259587+0000","last_peered":"2023-07-21T22:35:04.259587+0000","last_clean":"2023-07-21T22:35:04.259587+0000","last_became_active":"2023-07-21T22:35:02.728920+0000","last_became_peered":"2023-07-21T22:35:02.728920+0000","last_unstale":"2023-07-21T22:35:04.259587+0000","last_undegraded":"2023-07-21T22:35:04.259587+0000","last_fullsized":"2023-07-21T22:35:04.259587+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:59:56.146587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255218+0000","last_change":"2023-07-21T22:35:02.744705+0000","last_active":"2023-07-21T22:35:04.255218+0000","last_peered":"2023-07-21T22:35:04.255218+0000","last_clean":"2023-07-21T22:35:04.255218+0000","last_became_active":"2023-07-21T22:35:02.738241+0000","last_became_peered":"2023-07-21T22:35:02.738241+0000","last_unstale":"2023-07-21T22:35:04.255218+0000","last_undegraded":"2023-07-21T22:35:04.255218+0000","last_fullsized":"2023-07-21T22:35:04.255218+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:42:39.597364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.709329+0000","last_change":"2023-07-21T22:35:02.746565+0000","last_active":"2023-07-21T22:35:03.709329+0000","last_peered":"2023-07-21T22:35:03.709329+0000","last_clean":"2023-07-21T22:35:03.709329+0000","last_became_active":"2023-07-21T22:35:02.746281+0000","last_became_peered":"2023-07-21T22:35:02.746281+0000","last_unstale":"2023-07-21T22:35:03.709329+0000","last_undegraded":"2023-07-21T22:35:03.709329+0000","last_fullsized":"2023-07-21T22:35:03.709329+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:28:02.565265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718666+0000","last_change":"2023-07-21T22:35:02.718289+0000","last_active":"2023-07-21T22:35:03.718666+0000","last_peered":"2023-07-21T22:35:03.718666+0000","last_clean":"2023-07-21T22:35:03.718666+0000","last_became_active":"2023-07-21T22:35:02.717984+0000","last_became_peered":"2023-07-21T22:35:02.717984+0000","last_unstale":"2023-07-21T22:35:03.718666+0000","last_undegraded":"2023-07-21T22:35:03.718666+0000","last_fullsized":"2023-07-21T22:35:03.718666+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:22:28.056862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254514+0000","last_change":"2023-07-21T22:35:02.725176+0000","last_active":"2023-07-21T22:35:04.254514+0000","last_peered":"2023-07-21T22:35:04.254514+0000","last_clean":"2023-07-21T22:35:04.254514+0000","last_became_active":"2023-07-21T22:35:02.724863+0000","last_became_peered":"2023-07-21T22:35:02.724863+0000","last_unstale":"2023-07-21T22:35:04.254514+0000","last_undegraded":"2023-07-21T22:35:04.254514+0000","last_fullsized":"2023-07-21T22:35:04.254514+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:45:49.543975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.753673+0000","last_change":"2023-07-21T22:35:02.726566+0000","last_active":"2023-07-21T22:35:03.753673+0000","last_peered":"2023-07-21T22:35:03.753673+0000","last_clean":"2023-07-21T22:35:03.753673+0000","last_became_active":"2023-07-21T22:35:02.726072+0000","last_became_peered":"2023-07-21T22:35:02.726072+0000","last_unstale":"2023-07-21T22:35:03.753673+0000","last_undegraded":"2023-07-21T22:35:03.753673+0000","last_fullsized":"2023-07-21T22:35:03.753673+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:37.473658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259260+0000","last_change":"2023-07-21T22:35:02.742038+0000","last_active":"2023-07-21T22:35:04.259260+0000","last_peered":"2023-07-21T22:35:04.259260+0000","last_clean":"2023-07-21T22:35:04.259260+0000","last_became_active":"2023-07-21T22:35:02.741461+0000","last_became_peered":"2023-07-21T22:35:02.741461+0000","last_unstale":"2023-07-21T22:35:04.259260+0000","last_undegraded":"2023-07-21T22:35:04.259260+0000","last_fullsized":"2023-07-21T22:35:04.259260+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:03.145040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254160+0000","last_change":"2023-07-21T22:35:02.725156+0000","last_active":"2023-07-21T22:35:04.254160+0000","last_peered":"2023-07-21T22:35:04.254160+0000","last_clean":"2023-07-21T22:35:04.254160+0000","last_became_active":"2023-07-21T22:35:02.724896+0000","last_became_peered":"2023-07-21T22:35:02.724896+0000","last_unstale":"2023-07-21T22:35:04.254160+0000","last_undegraded":"2023-07-21T22:35:04.254160+0000","last_fullsized":"2023-07-21T22:35:04.254160+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:10:25.231833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718019+0000","last_change":"2023-07-21T22:35:02.736381+0000","last_active":"2023-07-21T22:35:03.718019+0000","last_peered":"2023-07-21T22:35:03.718019+0000","last_clean":"2023-07-21T22:35:03.718019+0000","last_became_active":"2023-07-21T22:35:02.736106+0000","last_became_peered":"2023-07-21T22:35:02.736106+0000","last_unstale":"2023-07-21T22:35:03.718019+0000","last_undegraded":"2023-07-21T22:35:03.718019+0000","last_fullsized":"2023-07-21T22:35:03.718019+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:24:13.927749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718662+0000","last_change":"2023-07-21T22:35:02.732205+0000","last_active":"2023-07-21T22:35:03.718662+0000","last_peered":"2023-07-21T22:35:03.718662+0000","last_clean":"2023-07-21T22:35:03.718662+0000","last_became_active":"2023-07-21T22:35:02.731942+0000","last_became_peered":"2023-07-21T22:35:02.731942+0000","last_unstale":"2023-07-21T22:35:03.718662+0000","last_undegraded":"2023-07-21T22:35:03.718662+0000","last_fullsized":"2023-07-21T22:35:03.718662+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:40:53.249037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254669+0000","last_change":"2023-07-21T22:35:02.739257+0000","last_active":"2023-07-21T22:35:04.254669+0000","last_peered":"2023-07-21T22:35:04.254669+0000","last_clean":"2023-07-21T22:35:04.254669+0000","last_became_active":"2023-07-21T22:35:02.738637+0000","last_became_peered":"2023-07-21T22:35:02.738637+0000","last_unstale":"2023-07-21T22:35:04.254669+0000","last_undegraded":"2023-07-21T22:35:04.254669+0000","last_fullsized":"2023-07-21T22:35:04.254669+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:48:53.014284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718671+0000","last_change":"2023-07-21T22:35:02.733610+0000","last_active":"2023-07-21T22:35:03.718671+0000","last_peered":"2023-07-21T22:35:03.718671+0000","last_clean":"2023-07-21T22:35:03.718671+0000","last_became_active":"2023-07-21T22:35:02.733207+0000","last_became_peered":"2023-07-21T22:35:02.733207+0000","last_unstale":"2023-07-21T22:35:03.718671+0000","last_undegraded":"2023-07-21T22:35:03.718671+0000","last_fullsized":"2023-07-21T22:35:03.718671+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:50:16.151669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254665+0000","last_change":"2023-07-21T22:35:02.731782+0000","last_active":"2023-07-21T22:35:04.254665+0000","last_peered":"2023-07-21T22:35:04.254665+0000","last_clean":"2023-07-21T22:35:04.254665+0000","last_became_active":"2023-07-21T22:35:02.731443+0000","last_became_peered":"2023-07-21T22:35:02.731443+0000","last_unstale":"2023-07-21T22:35:04.254665+0000","last_undegraded":"2023-07-21T22:35:04.254665+0000","last_fullsized":"2023-07-21T22:35:04.254665+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:00:40.887996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.753820+0000","last_change":"2023-07-21T22:35:02.725295+0000","last_active":"2023-07-21T22:35:03.753820+0000","last_peered":"2023-07-21T22:35:03.753820+0000","last_clean":"2023-07-21T22:35:03.753820+0000","last_became_active":"2023-07-21T22:35:02.724166+0000","last_became_peered":"2023-07-21T22:35:02.724166+0000","last_unstale":"2023-07-21T22:35:03.753820+0000","last_undegraded":"2023-07-21T22:35:03.753820+0000","last_fullsized":"2023-07-21T22:35:03.753820+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:48:28.279323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254907+0000","last_change":"2023-07-21T22:35:02.735546+0000","last_active":"2023-07-21T22:35:04.254907+0000","last_peered":"2023-07-21T22:35:04.254907+0000","last_clean":"2023-07-21T22:35:04.254907+0000","last_became_active":"2023-07-21T22:35:02.735244+0000","last_became_peered":"2023-07-21T22:35:02.735244+0000","last_unstale":"2023-07-21T22:35:04.254907+0000","last_undegraded":"2023-07-21T22:35:04.254907+0000","last_fullsized":"2023-07-21T22:35:04.254907+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:21:41.132396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.258523+0000","last_change":"2023-07-21T22:35:02.726961+0000","last_active":"2023-07-21T22:35:04.258523+0000","last_peered":"2023-07-21T22:35:04.258523+0000","last_clean":"2023-07-21T22:35:04.258523+0000","last_became_active":"2023-07-21T22:35:02.726659+0000","last_became_peered":"2023-07-21T22:35:02.726659+0000","last_unstale":"2023-07-21T22:35:04.258523+0000","last_undegraded":"2023-07-21T22:35:04.258523+0000","last_fullsized":"2023-07-21T22:35:04.258523+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:29:16.096124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254490+0000","last_change":"2023-07-21T22:35:02.729177+0000","last_active":"2023-07-21T22:35:04.254490+0000","last_peered":"2023-07-21T22:35:04.254490+0000","last_clean":"2023-07-21T22:35:04.254490+0000","last_became_active":"2023-07-21T22:35:02.728839+0000","last_became_peered":"2023-07-21T22:35:02.728839+0000","last_unstale":"2023-07-21T22:35:04.254490+0000","last_undegraded":"2023-07-21T22:35:04.254490+0000","last_fullsized":"2023-07-21T22:35:04.254490+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:39:04.776706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.709227+0000","last_change":"2023-07-21T22:35:02.723554+0000","last_active":"2023-07-21T22:35:03.709227+0000","last_peered":"2023-07-21T22:35:03.709227+0000","last_clean":"2023-07-21T22:35:03.709227+0000","last_became_active":"2023-07-21T22:35:02.723257+0000","last_became_peered":"2023-07-21T22:35:02.723257+0000","last_unstale":"2023-07-21T22:35:03.709227+0000","last_undegraded":"2023-07-21T22:35:03.709227+0000","last_fullsized":"2023-07-21T22:35:03.709227+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:39:05.212414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.754026+0000","last_change":"2023-07-21T22:35:02.737744+0000","last_active":"2023-07-21T22:35:03.754026+0000","last_peered":"2023-07-21T22:35:03.754026+0000","last_clean":"2023-07-21T22:35:03.754026+0000","last_became_active":"2023-07-21T22:35:02.737439+0000","last_became_peered":"2023-07-21T22:35:02.737439+0000","last_unstale":"2023-07-21T22:35:03.754026+0000","last_undegraded":"2023-07-21T22:35:03.754026+0000","last_fullsized":"2023-07-21T22:35:03.754026+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:06:02.176941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254595+0000","last_change":"2023-07-21T22:35:02.718301+0000","last_active":"2023-07-21T22:35:04.254595+0000","last_peered":"2023-07-21T22:35:04.254595+0000","last_clean":"2023-07-21T22:35:04.254595+0000","last_became_active":"2023-07-21T22:35:02.717897+0000","last_became_peered":"2023-07-21T22:35:02.717897+0000","last_unstale":"2023-07-21T22:35:04.254595+0000","last_undegraded":"2023-07-21T22:35:04.254595+0000","last_fullsized":"2023-07-21T22:35:04.254595+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:13:55.160321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.717488+0000","last_change":"2023-07-21T22:35:02.722780+0000","last_active":"2023-07-21T22:35:03.717488+0000","last_peered":"2023-07-21T22:35:03.717488+0000","last_clean":"2023-07-21T22:35:03.717488+0000","last_became_active":"2023-07-21T22:35:02.722458+0000","last_became_peered":"2023-07-21T22:35:02.722458+0000","last_unstale":"2023-07-21T22:35:03.717488+0000","last_undegraded":"2023-07-21T22:35:03.717488+0000","last_fullsized":"2023-07-21T22:35:03.717488+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:11:24.954614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255438+0000","last_change":"2023-07-21T22:35:02.731666+0000","last_active":"2023-07-21T22:35:04.255438+0000","last_peered":"2023-07-21T22:35:04.255438+0000","last_clean":"2023-07-21T22:35:04.255438+0000","last_became_active":"2023-07-21T22:35:02.731377+0000","last_became_peered":"2023-07-21T22:35:02.731377+0000","last_unstale":"2023-07-21T22:35:04.255438+0000","last_undegraded":"2023-07-21T22:35:04.255438+0000","last_fullsized":"2023-07-21T22:35:04.255438+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:57.761212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.717596+0000","last_change":"2023-07-21T22:35:02.725013+0000","last_active":"2023-07-21T22:35:03.717596+0000","last_peered":"2023-07-21T22:35:03.717596+0000","last_clean":"2023-07-21T22:35:03.717596+0000","last_became_active":"2023-07-21T22:35:02.724673+0000","last_became_peered":"2023-07-21T22:35:02.724673+0000","last_unstale":"2023-07-21T22:35:03.717596+0000","last_undegraded":"2023-07-21T22:35:03.717596+0000","last_fullsized":"2023-07-21T22:35:03.717596+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:28:51.439204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254570+0000","last_change":"2023-07-21T22:35:02.739317+0000","last_active":"2023-07-21T22:35:04.254570+0000","last_peered":"2023-07-21T22:35:04.254570+0000","last_clean":"2023-07-21T22:35:04.254570+0000","last_became_active":"2023-07-21T22:35:02.739013+0000","last_became_peered":"2023-07-21T22:35:02.739013+0000","last_unstale":"2023-07-21T22:35:04.254570+0000","last_undegraded":"2023-07-21T22:35:04.254570+0000","last_fullsized":"2023-07-21T22:35:04.254570+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:57:56.400416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255251+0000","last_change":"2023-07-21T22:35:02.738739+0000","last_active":"2023-07-21T22:35:04.255251+0000","last_peered":"2023-07-21T22:35:04.255251+0000","last_clean":"2023-07-21T22:35:04.255251+0000","last_became_active":"2023-07-21T22:35:02.738356+0000","last_became_peered":"2023-07-21T22:35:02.738356+0000","last_unstale":"2023-07-21T22:35:04.255251+0000","last_undegraded":"2023-07-21T22:35:04.255251+0000","last_fullsized":"2023-07-21T22:35:04.255251+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:27:15.425767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718756+0000","last_change":"2023-07-21T22:35:02.743814+0000","last_active":"2023-07-21T22:35:03.718756+0000","last_peered":"2023-07-21T22:35:03.718756+0000","last_clean":"2023-07-21T22:35:03.718756+0000","last_became_active":"2023-07-21T22:35:02.743499+0000","last_became_peered":"2023-07-21T22:35:02.743499+0000","last_unstale":"2023-07-21T22:35:03.718756+0000","last_undegraded":"2023-07-21T22:35:03.718756+0000","last_fullsized":"2023-07-21T22:35:03.718756+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:56:05.238349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.258866+0000","last_change":"2023-07-21T22:35:02.726749+0000","last_active":"2023-07-21T22:35:04.258866+0000","last_peered":"2023-07-21T22:35:04.258866+0000","last_clean":"2023-07-21T22:35:04.258866+0000","last_became_active":"2023-07-21T22:35:02.726463+0000","last_became_peered":"2023-07-21T22:35:02.726463+0000","last_unstale":"2023-07-21T22:35:04.258866+0000","last_undegraded":"2023-07-21T22:35:04.258866+0000","last_fullsized":"2023-07-21T22:35:04.258866+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:04:22.942189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254742+0000","last_change":"2023-07-21T22:35:02.716783+0000","last_active":"2023-07-21T22:35:04.254742+0000","last_peered":"2023-07-21T22:35:04.254742+0000","last_clean":"2023-07-21T22:35:04.254742+0000","last_became_active":"2023-07-21T22:35:02.716497+0000","last_became_peered":"2023-07-21T22:35:02.716497+0000","last_unstale":"2023-07-21T22:35:04.254742+0000","last_undegraded":"2023-07-21T22:35:04.254742+0000","last_fullsized":"2023-07-21T22:35:04.254742+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:41:32.758801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254631+0000","last_change":"2023-07-21T22:35:02.745153+0000","last_active":"2023-07-21T22:35:04.254631+0000","last_peered":"2023-07-21T22:35:04.254631+0000","last_clean":"2023-07-21T22:35:04.254631+0000","last_became_active":"2023-07-21T22:35:02.744802+0000","last_became_peered":"2023-07-21T22:35:02.744802+0000","last_unstale":"2023-07-21T22:35:04.254631+0000","last_undegraded":"2023-07-21T22:35:04.254631+0000","last_fullsized":"2023-07-21T22:35:04.254631+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:15:11.300238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259007+0000","last_change":"2023-07-21T22:35:02.735124+0000","last_active":"2023-07-21T22:35:04.259007+0000","last_peered":"2023-07-21T22:35:04.259007+0000","last_clean":"2023-07-21T22:35:04.259007+0000","last_became_active":"2023-07-21T22:35:02.734820+0000","last_became_peered":"2023-07-21T22:35:02.734820+0000","last_unstale":"2023-07-21T22:35:04.259007+0000","last_undegraded":"2023-07-21T22:35:04.259007+0000","last_fullsized":"2023-07-21T22:35:04.259007+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:08:51.341351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.709032+0000","last_change":"2023-07-21T22:35:02.728381+0000","last_active":"2023-07-21T22:35:03.709032+0000","last_peered":"2023-07-21T22:35:03.709032+0000","last_clean":"2023-07-21T22:35:03.709032+0000","last_became_active":"2023-07-21T22:35:02.728087+0000","last_became_peered":"2023-07-21T22:35:02.728087+0000","last_unstale":"2023-07-21T22:35:03.709032+0000","last_undegraded":"2023-07-21T22:35:03.709032+0000","last_fullsized":"2023-07-21T22:35:03.709032+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:43:30.826056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.258596+0000","last_change":"2023-07-21T22:35:02.729192+0000","last_active":"2023-07-21T22:35:04.258596+0000","last_peered":"2023-07-21T22:35:04.258596+0000","last_clean":"2023-07-21T22:35:04.258596+0000","last_became_active":"2023-07-21T22:35:02.728910+0000","last_became_peered":"2023-07-21T22:35:02.728910+0000","last_unstale":"2023-07-21T22:35:04.258596+0000","last_undegraded":"2023-07-21T22:35:04.258596+0000","last_fullsized":"2023-07-21T22:35:04.258596+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:39:17.130510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.708942+0000","last_change":"2023-07-21T22:35:02.725533+0000","last_active":"2023-07-21T22:35:03.708942+0000","last_peered":"2023-07-21T22:35:03.708942+0000","last_clean":"2023-07-21T22:35:03.708942+0000","last_became_active":"2023-07-21T22:35:02.725243+0000","last_became_peered":"2023-07-21T22:35:02.725243+0000","last_unstale":"2023-07-21T22:35:03.708942+0000","last_undegraded":"2023-07-21T22:35:03.708942+0000","last_fullsized":"2023-07-21T22:35:03.708942+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:55:16.470609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"97'4","reported_seq":17,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254634+0000","last_change":"2023-07-21T22:35:01.722906+0000","last_active":"2023-07-21T22:35:04.254634+0000","last_peered":"2023-07-21T22:35:04.254634+0000","last_clean":"2023-07-21T22:35:04.254634+0000","last_became_active":"2023-07-21T22:35:01.722556+0000","last_became_peered":"2023-07-21T22:35:01.722556+0000","last_unstale":"2023-07-21T22:35:04.254634+0000","last_undegraded":"2023-07-21T22:35:04.254634+0000","last_fullsized":"2023-07-21T22:35:04.254634+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:45:44.006693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255062+0000","last_change":"2023-07-21T22:35:02.733645+0000","last_active":"2023-07-21T22:35:04.255062+0000","last_peered":"2023-07-21T22:35:04.255062+0000","last_clean":"2023-07-21T22:35:04.255062+0000","last_became_active":"2023-07-21T22:35:02.733365+0000","last_became_peered":"2023-07-21T22:35:02.733365+0000","last_unstale":"2023-07-21T22:35:04.255062+0000","last_undegraded":"2023-07-21T22:35:04.255062+0000","last_fullsized":"2023-07-21T22:35:04.255062+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:59:16.663454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259495+0000","last_change":"2023-07-21T22:35:01.730971+0000","last_active":"2023-07-21T22:35:04.259495+0000","last_peered":"2023-07-21T22:35:04.259495+0000","last_clean":"2023-07-21T22:35:04.259495+0000","last_became_active":"2023-07-21T22:35:01.730651+0000","last_became_peered":"2023-07-21T22:35:01.730651+0000","last_unstale":"2023-07-21T22:35:04.259495+0000","last_undegraded":"2023-07-21T22:35:04.259495+0000","last_fullsized":"2023-07-21T22:35:04.259495+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:04:50.708614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.717512+0000","last_change":"2023-07-21T22:35:02.729056+0000","last_active":"2023-07-21T22:35:03.717512+0000","last_peered":"2023-07-21T22:35:03.717512+0000","last_clean":"2023-07-21T22:35:03.717512+0000","last_became_active":"2023-07-21T22:35:02.728202+0000","last_became_peered":"2023-07-21T22:35:02.728202+0000","last_unstale":"2023-07-21T22:35:03.717512+0000","last_undegraded":"2023-07-21T22:35:03.717512+0000","last_fullsized":"2023-07-21T22:35:03.717512+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:27:47.681082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259009+0000","last_change":"2023-07-21T22:35:01.728487+0000","last_active":"2023-07-21T22:35:04.259009+0000","last_peered":"2023-07-21T22:35:04.259009+0000","last_clean":"2023-07-21T22:35:04.259009+0000","last_became_active":"2023-07-21T22:35:01.728216+0000","last_became_peered":"2023-07-21T22:35:01.728216+0000","last_unstale":"2023-07-21T22:35:04.259009+0000","last_undegraded":"2023-07-21T22:35:04.259009+0000","last_fullsized":"2023-07-21T22:35:04.259009+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:49:01.703956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.717522+0000","last_change":"2023-07-21T22:35:02.721920+0000","last_active":"2023-07-21T22:35:03.717522+0000","last_peered":"2023-07-21T22:35:03.717522+0000","last_clean":"2023-07-21T22:35:03.717522+0000","last_became_active":"2023-07-21T22:35:02.721618+0000","last_became_peered":"2023-07-21T22:35:02.721618+0000","last_unstale":"2023-07-21T22:35:03.717522+0000","last_undegraded":"2023-07-21T22:35:03.717522+0000","last_fullsized":"2023-07-21T22:35:03.717522+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:02:43.799086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259421+0000","last_change":"2023-07-21T22:35:01.727508+0000","last_active":"2023-07-21T22:35:04.259421+0000","last_peered":"2023-07-21T22:35:04.259421+0000","last_clean":"2023-07-21T22:35:04.259421+0000","last_became_active":"2023-07-21T22:35:01.726844+0000","last_became_peered":"2023-07-21T22:35:01.726844+0000","last_unstale":"2023-07-21T22:35:04.259421+0000","last_undegraded":"2023-07-21T22:35:04.259421+0000","last_fullsized":"2023-07-21T22:35:04.259421+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:34:20.483385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255153+0000","last_change":"2023-07-21T22:35:02.744065+0000","last_active":"2023-07-21T22:35:04.255153+0000","last_peered":"2023-07-21T22:35:04.255153+0000","last_clean":"2023-07-21T22:35:04.255153+0000","last_became_active":"2023-07-21T22:35:02.738489+0000","last_became_peered":"2023-07-21T22:35:02.738489+0000","last_unstale":"2023-07-21T22:35:04.255153+0000","last_undegraded":"2023-07-21T22:35:04.255153+0000","last_fullsized":"2023-07-21T22:35:04.255153+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:43:56.848816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.717751+0000","last_change":"2023-07-21T22:35:01.723132+0000","last_active":"2023-07-21T22:35:03.717751+0000","last_peered":"2023-07-21T22:35:03.717751+0000","last_clean":"2023-07-21T22:35:03.717751+0000","last_became_active":"2023-07-21T22:35:01.722696+0000","last_became_peered":"2023-07-21T22:35:01.722696+0000","last_unstale":"2023-07-21T22:35:03.717751+0000","last_undegraded":"2023-07-21T22:35:03.717751+0000","last_fullsized":"2023-07-21T22:35:03.717751+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:27:18.994856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254806+0000","last_change":"2023-07-21T22:35:02.744449+0000","last_active":"2023-07-21T22:35:04.254806+0000","last_peered":"2023-07-21T22:35:04.254806+0000","last_clean":"2023-07-21T22:35:04.254806+0000","last_became_active":"2023-07-21T22:35:02.744095+0000","last_became_peered":"2023-07-21T22:35:02.744095+0000","last_unstale":"2023-07-21T22:35:04.254806+0000","last_undegraded":"2023-07-21T22:35:04.254806+0000","last_fullsized":"2023-07-21T22:35:04.254806+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:03.397502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718350+0000","last_change":"2023-07-21T22:35:01.725943+0000","last_active":"2023-07-21T22:35:03.718350+0000","last_peered":"2023-07-21T22:35:03.718350+0000","last_clean":"2023-07-21T22:35:03.718350+0000","last_became_active":"2023-07-21T22:35:01.725603+0000","last_became_peered":"2023-07-21T22:35:01.725603+0000","last_unstale":"2023-07-21T22:35:03.718350+0000","last_undegraded":"2023-07-21T22:35:03.718350+0000","last_fullsized":"2023-07-21T22:35:03.718350+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:33:12.629584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718058+0000","last_change":"2023-07-21T22:35:02.730354+0000","last_active":"2023-07-21T22:35:03.718058+0000","last_peered":"2023-07-21T22:35:03.718058+0000","last_clean":"2023-07-21T22:35:03.718058+0000","last_became_active":"2023-07-21T22:35:02.730089+0000","last_became_peered":"2023-07-21T22:35:02.730089+0000","last_unstale":"2023-07-21T22:35:03.718058+0000","last_undegraded":"2023-07-21T22:35:03.718058+0000","last_fullsized":"2023-07-21T22:35:03.718058+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:12:36.178143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255131+0000","last_change":"2023-07-21T22:35:01.714572+0000","last_active":"2023-07-21T22:35:04.255131+0000","last_peered":"2023-07-21T22:35:04.255131+0000","last_clean":"2023-07-21T22:35:04.255131+0000","last_became_active":"2023-07-21T22:35:01.714302+0000","last_became_peered":"2023-07-21T22:35:01.714302+0000","last_unstale":"2023-07-21T22:35:04.255131+0000","last_undegraded":"2023-07-21T22:35:04.255131+0000","last_fullsized":"2023-07-21T22:35:04.255131+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:40:00.909109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259827+0000","last_change":"2023-07-21T22:35:02.742036+0000","last_active":"2023-07-21T22:35:04.259827+0000","last_peered":"2023-07-21T22:35:04.259827+0000","last_clean":"2023-07-21T22:35:04.259827+0000","last_became_active":"2023-07-21T22:35:02.741649+0000","last_became_peered":"2023-07-21T22:35:02.741649+0000","last_unstale":"2023-07-21T22:35:04.259827+0000","last_undegraded":"2023-07-21T22:35:04.259827+0000","last_fullsized":"2023-07-21T22:35:04.259827+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:43:06.444699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254235+0000","last_change":"2023-07-21T22:35:01.716458+0000","last_active":"2023-07-21T22:35:04.254235+0000","last_peered":"2023-07-21T22:35:04.254235+0000","last_clean":"2023-07-21T22:35:04.254235+0000","last_became_active":"2023-07-21T22:35:01.716115+0000","last_became_peered":"2023-07-21T22:35:01.716115+0000","last_unstale":"2023-07-21T22:35:04.254235+0000","last_undegraded":"2023-07-21T22:35:04.254235+0000","last_fullsized":"2023-07-21T22:35:04.254235+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:45:07.622541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254720+0000","last_change":"2023-07-21T22:35:02.731357+0000","last_active":"2023-07-21T22:35:04.254720+0000","last_peered":"2023-07-21T22:35:04.254720+0000","last_clean":"2023-07-21T22:35:04.254720+0000","last_became_active":"2023-07-21T22:35:02.731047+0000","last_became_peered":"2023-07-21T22:35:02.731047+0000","last_unstale":"2023-07-21T22:35:04.254720+0000","last_undegraded":"2023-07-21T22:35:04.254720+0000","last_fullsized":"2023-07-21T22:35:04.254720+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:00:54.727256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259667+0000","last_change":"2023-07-21T22:35:01.731125+0000","last_active":"2023-07-21T22:35:04.259667+0000","last_peered":"2023-07-21T22:35:04.259667+0000","last_clean":"2023-07-21T22:35:04.259667+0000","last_became_active":"2023-07-21T22:35:01.730807+0000","last_became_peered":"2023-07-21T22:35:01.730807+0000","last_unstale":"2023-07-21T22:35:04.259667+0000","last_undegraded":"2023-07-21T22:35:04.259667+0000","last_fullsized":"2023-07-21T22:35:04.259667+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:19:22.571142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718423+0000","last_change":"2023-07-21T22:35:02.718067+0000","last_active":"2023-07-21T22:35:03.718423+0000","last_peered":"2023-07-21T22:35:03.718423+0000","last_clean":"2023-07-21T22:35:03.718423+0000","last_became_active":"2023-07-21T22:35:02.717754+0000","last_became_peered":"2023-07-21T22:35:02.717754+0000","last_unstale":"2023-07-21T22:35:03.718423+0000","last_undegraded":"2023-07-21T22:35:03.718423+0000","last_fullsized":"2023-07-21T22:35:03.718423+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:13:07.420757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718841+0000","last_change":"2023-07-21T22:35:01.719096+0000","last_active":"2023-07-21T22:35:03.718841+0000","last_peered":"2023-07-21T22:35:03.718841+0000","last_clean":"2023-07-21T22:35:03.718841+0000","last_became_active":"2023-07-21T22:35:01.718805+0000","last_became_peered":"2023-07-21T22:35:01.718805+0000","last_unstale":"2023-07-21T22:35:03.718841+0000","last_undegraded":"2023-07-21T22:35:03.718841+0000","last_fullsized":"2023-07-21T22:35:03.718841+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:11:01.713928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.754125+0000","last_change":"2023-07-21T22:35:02.728713+0000","last_active":"2023-07-21T22:35:03.754125+0000","last_peered":"2023-07-21T22:35:03.754125+0000","last_clean":"2023-07-21T22:35:03.754125+0000","last_became_active":"2023-07-21T22:35:02.728407+0000","last_became_peered":"2023-07-21T22:35:02.728407+0000","last_unstale":"2023-07-21T22:35:03.754125+0000","last_undegraded":"2023-07-21T22:35:03.754125+0000","last_fullsized":"2023-07-21T22:35:03.754125+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:12:01.353989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"97'3","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254664+0000","last_change":"2023-07-21T22:35:01.717629+0000","last_active":"2023-07-21T22:35:04.254664+0000","last_peered":"2023-07-21T22:35:04.254664+0000","last_clean":"2023-07-21T22:35:04.254664+0000","last_became_active":"2023-07-21T22:35:01.717342+0000","last_became_peered":"2023-07-21T22:35:01.717342+0000","last_unstale":"2023-07-21T22:35:04.254664+0000","last_undegraded":"2023-07-21T22:35:04.254664+0000","last_fullsized":"2023-07-21T22:35:04.254664+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:00:40.729376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.709278+0000","last_change":"2023-07-21T22:35:02.746582+0000","last_active":"2023-07-21T22:35:03.709278+0000","last_peered":"2023-07-21T22:35:03.709278+0000","last_clean":"2023-07-21T22:35:03.709278+0000","last_became_active":"2023-07-21T22:35:02.746290+0000","last_became_peered":"2023-07-21T22:35:02.746290+0000","last_unstale":"2023-07-21T22:35:03.709278+0000","last_undegraded":"2023-07-21T22:35:03.709278+0000","last_fullsized":"2023-07-21T22:35:03.709278+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:03:52.989180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"97'6","reported_seq":19,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259568+0000","last_change":"2023-07-21T22:35:01.727312+0000","last_active":"2023-07-21T22:35:04.259568+0000","last_peered":"2023-07-21T22:35:04.259568+0000","last_clean":"2023-07-21T22:35:04.259568+0000","last_became_active":"2023-07-21T22:35:01.726466+0000","last_became_peered":"2023-07-21T22:35:01.726466+0000","last_unstale":"2023-07-21T22:35:04.259568+0000","last_undegraded":"2023-07-21T22:35:04.259568+0000","last_fullsized":"2023-07-21T22:35:04.259568+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:39:24.563720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718848+0000","last_change":"2023-07-21T22:35:02.724351+0000","last_active":"2023-07-21T22:35:03.718848+0000","last_peered":"2023-07-21T22:35:03.718848+0000","last_clean":"2023-07-21T22:35:03.718848+0000","last_became_active":"2023-07-21T22:35:02.724054+0000","last_became_peered":"2023-07-21T22:35:02.724054+0000","last_unstale":"2023-07-21T22:35:03.718848+0000","last_undegraded":"2023-07-21T22:35:03.718848+0000","last_fullsized":"2023-07-21T22:35:03.718848+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:13:45.068159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718450+0000","last_change":"2023-07-21T22:35:01.722302+0000","last_active":"2023-07-21T22:35:03.718450+0000","last_peered":"2023-07-21T22:35:03.718450+0000","last_clean":"2023-07-21T22:35:03.718450+0000","last_became_active":"2023-07-21T22:35:01.722024+0000","last_became_peered":"2023-07-21T22:35:01.722024+0000","last_unstale":"2023-07-21T22:35:03.718450+0000","last_undegraded":"2023-07-21T22:35:03.718450+0000","last_fullsized":"2023-07-21T22:35:03.718450+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:22:16.286713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259627+0000","last_change":"2023-07-21T22:35:02.731520+0000","last_active":"2023-07-21T22:35:04.259627+0000","last_peered":"2023-07-21T22:35:04.259627+0000","last_clean":"2023-07-21T22:35:04.259627+0000","last_became_active":"2023-07-21T22:35:02.731222+0000","last_became_peered":"2023-07-21T22:35:02.731222+0000","last_unstale":"2023-07-21T22:35:04.259627+0000","last_undegraded":"2023-07-21T22:35:04.259627+0000","last_fullsized":"2023-07-21T22:35:04.259627+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:11:03.242898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.258670+0000","last_change":"2023-07-21T22:35:01.729518+0000","last_active":"2023-07-21T22:35:04.258670+0000","last_peered":"2023-07-21T22:35:04.258670+0000","last_clean":"2023-07-21T22:35:04.258670+0000","last_became_active":"2023-07-21T22:35:01.729250+0000","last_became_peered":"2023-07-21T22:35:01.729250+0000","last_unstale":"2023-07-21T22:35:04.258670+0000","last_undegraded":"2023-07-21T22:35:04.258670+0000","last_fullsized":"2023-07-21T22:35:04.258670+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:01:16.881614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259039+0000","last_change":"2023-07-21T22:35:02.730810+0000","last_active":"2023-07-21T22:35:04.259039+0000","last_peered":"2023-07-21T22:35:04.259039+0000","last_clean":"2023-07-21T22:35:04.259039+0000","last_became_active":"2023-07-21T22:35:02.730500+0000","last_became_peered":"2023-07-21T22:35:02.730500+0000","last_unstale":"2023-07-21T22:35:04.259039+0000","last_undegraded":"2023-07-21T22:35:04.259039+0000","last_fullsized":"2023-07-21T22:35:04.259039+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:49.251935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254256+0000","last_change":"2023-07-21T22:35:01.723235+0000","last_active":"2023-07-21T22:35:04.254256+0000","last_peered":"2023-07-21T22:35:04.254256+0000","last_clean":"2023-07-21T22:35:04.254256+0000","last_became_active":"2023-07-21T22:35:01.722975+0000","last_became_peered":"2023-07-21T22:35:01.722975+0000","last_unstale":"2023-07-21T22:35:04.254256+0000","last_undegraded":"2023-07-21T22:35:04.254256+0000","last_fullsized":"2023-07-21T22:35:04.254256+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:58:54.396517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259892+0000","last_change":"2023-07-21T22:35:02.736452+0000","last_active":"2023-07-21T22:35:04.259892+0000","last_peered":"2023-07-21T22:35:04.259892+0000","last_clean":"2023-07-21T22:35:04.259892+0000","last_became_active":"2023-07-21T22:35:02.736117+0000","last_became_peered":"2023-07-21T22:35:02.736117+0000","last_unstale":"2023-07-21T22:35:04.259892+0000","last_undegraded":"2023-07-21T22:35:04.259892+0000","last_fullsized":"2023-07-21T22:35:04.259892+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:30:50.117072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"97'8","reported_seq":21,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254853+0000","last_change":"2023-07-21T22:35:01.723581+0000","last_active":"2023-07-21T22:35:04.254853+0000","last_peered":"2023-07-21T22:35:04.254853+0000","last_clean":"2023-07-21T22:35:04.254853+0000","last_became_active":"2023-07-21T22:35:01.723291+0000","last_became_peered":"2023-07-21T22:35:01.723291+0000","last_unstale":"2023-07-21T22:35:04.254853+0000","last_undegraded":"2023-07-21T22:35:04.254853+0000","last_fullsized":"2023-07-21T22:35:04.254853+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:38:13.262742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.717477+0000","last_change":"2023-07-21T22:35:02.731407+0000","last_active":"2023-07-21T22:35:03.717477+0000","last_peered":"2023-07-21T22:35:03.717477+0000","last_clean":"2023-07-21T22:35:03.717477+0000","last_became_active":"2023-07-21T22:35:02.731093+0000","last_became_peered":"2023-07-21T22:35:02.731093+0000","last_unstale":"2023-07-21T22:35:03.717477+0000","last_undegraded":"2023-07-21T22:35:03.717477+0000","last_fullsized":"2023-07-21T22:35:03.717477+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:15:24.817403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718863+0000","last_change":"2023-07-21T22:35:01.723963+0000","last_active":"2023-07-21T22:35:03.718863+0000","last_peered":"2023-07-21T22:35:03.718863+0000","last_clean":"2023-07-21T22:35:03.718863+0000","last_became_active":"2023-07-21T22:35:01.723692+0000","last_became_peered":"2023-07-21T22:35:01.723692+0000","last_unstale":"2023-07-21T22:35:03.718863+0000","last_undegraded":"2023-07-21T22:35:03.718863+0000","last_fullsized":"2023-07-21T22:35:03.718863+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:27:48.316599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259300+0000","last_change":"2023-07-21T22:35:02.737036+0000","last_active":"2023-07-21T22:35:04.259300+0000","last_peered":"2023-07-21T22:35:04.259300+0000","last_clean":"2023-07-21T22:35:04.259300+0000","last_became_active":"2023-07-21T22:35:02.736725+0000","last_became_peered":"2023-07-21T22:35:02.736725+0000","last_unstale":"2023-07-21T22:35:04.259300+0000","last_undegraded":"2023-07-21T22:35:04.259300+0000","last_fullsized":"2023-07-21T22:35:04.259300+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:29:55.427187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"98'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255391+0000","last_change":"2023-07-21T22:35:01.716816+0000","last_active":"2023-07-21T22:35:04.255391+0000","last_peered":"2023-07-21T22:35:04.255391+0000","last_clean":"2023-07-21T22:35:04.255391+0000","last_became_active":"2023-07-21T22:35:01.716553+0000","last_became_peered":"2023-07-21T22:35:01.716553+0000","last_unstale":"2023-07-21T22:35:04.255391+0000","last_undegraded":"2023-07-21T22:35:04.255391+0000","last_fullsized":"2023-07-21T22:35:04.255391+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:02:25.745807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.717586+0000","last_change":"2023-07-21T22:35:02.722797+0000","last_active":"2023-07-21T22:35:03.717586+0000","last_peered":"2023-07-21T22:35:03.717586+0000","last_clean":"2023-07-21T22:35:03.717586+0000","last_became_active":"2023-07-21T22:35:02.722475+0000","last_became_peered":"2023-07-21T22:35:02.722475+0000","last_unstale":"2023-07-21T22:35:03.717586+0000","last_undegraded":"2023-07-21T22:35:03.717586+0000","last_fullsized":"2023-07-21T22:35:03.717586+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:57:48.795407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259176+0000","last_change":"2023-07-21T22:35:01.725547+0000","last_active":"2023-07-21T22:35:04.259176+0000","last_peered":"2023-07-21T22:35:04.259176+0000","last_clean":"2023-07-21T22:35:04.259176+0000","last_became_active":"2023-07-21T22:35:01.725139+0000","last_became_peered":"2023-07-21T22:35:01.725139+0000","last_unstale":"2023-07-21T22:35:04.259176+0000","last_undegraded":"2023-07-21T22:35:04.259176+0000","last_fullsized":"2023-07-21T22:35:04.259176+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:18:14.711004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254773+0000","last_change":"2023-07-21T22:35:02.731453+0000","last_active":"2023-07-21T22:35:04.254773+0000","last_peered":"2023-07-21T22:35:04.254773+0000","last_clean":"2023-07-21T22:35:04.254773+0000","last_became_active":"2023-07-21T22:35:02.731155+0000","last_became_peered":"2023-07-21T22:35:02.731155+0000","last_unstale":"2023-07-21T22:35:04.254773+0000","last_undegraded":"2023-07-21T22:35:04.254773+0000","last_fullsized":"2023-07-21T22:35:04.254773+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:02:11.209998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.258791+0000","last_change":"2023-07-21T22:35:01.731236+0000","last_active":"2023-07-21T22:35:04.258791+0000","last_peered":"2023-07-21T22:35:04.258791+0000","last_clean":"2023-07-21T22:35:04.258791+0000","last_became_active":"2023-07-21T22:35:01.730896+0000","last_became_peered":"2023-07-21T22:35:01.730896+0000","last_unstale":"2023-07-21T22:35:04.258791+0000","last_undegraded":"2023-07-21T22:35:04.258791+0000","last_fullsized":"2023-07-21T22:35:04.258791+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:20:24.298409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259267+0000","last_change":"2023-07-21T22:35:02.736441+0000","last_active":"2023-07-21T22:35:04.259267+0000","last_peered":"2023-07-21T22:35:04.259267+0000","last_clean":"2023-07-21T22:35:04.259267+0000","last_became_active":"2023-07-21T22:35:02.736111+0000","last_became_peered":"2023-07-21T22:35:02.736111+0000","last_unstale":"2023-07-21T22:35:04.259267+0000","last_undegraded":"2023-07-21T22:35:04.259267+0000","last_fullsized":"2023-07-21T22:35:04.259267+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:03:59.635210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259491+0000","last_change":"2023-07-21T22:35:01.726833+0000","last_active":"2023-07-21T22:35:04.259491+0000","last_peered":"2023-07-21T22:35:04.259491+0000","last_clean":"2023-07-21T22:35:04.259491+0000","last_became_active":"2023-07-21T22:35:01.726449+0000","last_became_peered":"2023-07-21T22:35:01.726449+0000","last_unstale":"2023-07-21T22:35:04.259491+0000","last_undegraded":"2023-07-21T22:35:04.259491+0000","last_fullsized":"2023-07-21T22:35:04.259491+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:49:38.700325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259483+0000","last_change":"2023-07-21T22:35:02.742207+0000","last_active":"2023-07-21T22:35:04.259483+0000","last_peered":"2023-07-21T22:35:04.259483+0000","last_clean":"2023-07-21T22:35:04.259483+0000","last_became_active":"2023-07-21T22:35:02.741556+0000","last_became_peered":"2023-07-21T22:35:02.741556+0000","last_unstale":"2023-07-21T22:35:04.259483+0000","last_undegraded":"2023-07-21T22:35:04.259483+0000","last_fullsized":"2023-07-21T22:35:04.259483+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:20:02.027053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255486+0000","last_change":"2023-07-21T22:35:01.723928+0000","last_active":"2023-07-21T22:35:04.255486+0000","last_peered":"2023-07-21T22:35:04.255486+0000","last_clean":"2023-07-21T22:35:04.255486+0000","last_became_active":"2023-07-21T22:35:01.723645+0000","last_became_peered":"2023-07-21T22:35:01.723645+0000","last_unstale":"2023-07-21T22:35:04.255486+0000","last_undegraded":"2023-07-21T22:35:04.255486+0000","last_fullsized":"2023-07-21T22:35:04.255486+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:25:17.852306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.709370+0000","last_change":"2023-07-21T22:35:02.743236+0000","last_active":"2023-07-21T22:35:03.709370+0000","last_peered":"2023-07-21T22:35:03.709370+0000","last_clean":"2023-07-21T22:35:03.709370+0000","last_became_active":"2023-07-21T22:35:02.742895+0000","last_became_peered":"2023-07-21T22:35:02.742895+0000","last_unstale":"2023-07-21T22:35:03.709370+0000","last_undegraded":"2023-07-21T22:35:03.709370+0000","last_fullsized":"2023-07-21T22:35:03.709370+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:05:17.792574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259394+0000","last_change":"2023-07-21T22:35:01.728315+0000","last_active":"2023-07-21T22:35:04.259394+0000","last_peered":"2023-07-21T22:35:04.259394+0000","last_clean":"2023-07-21T22:35:04.259394+0000","last_became_active":"2023-07-21T22:35:01.728026+0000","last_became_peered":"2023-07-21T22:35:01.728026+0000","last_unstale":"2023-07-21T22:35:04.259394+0000","last_undegraded":"2023-07-21T22:35:04.259394+0000","last_fullsized":"2023-07-21T22:35:04.259394+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:11:01.647456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.709173+0000","last_change":"2023-07-21T22:35:02.724443+0000","last_active":"2023-07-21T22:35:03.709173+0000","last_peered":"2023-07-21T22:35:03.709173+0000","last_clean":"2023-07-21T22:35:03.709173+0000","last_became_active":"2023-07-21T22:35:02.724163+0000","last_became_peered":"2023-07-21T22:35:02.724163+0000","last_unstale":"2023-07-21T22:35:03.709173+0000","last_undegraded":"2023-07-21T22:35:03.709173+0000","last_fullsized":"2023-07-21T22:35:03.709173+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:52:20.995176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.708927+0000","last_change":"2023-07-21T22:35:01.724682+0000","last_active":"2023-07-21T22:35:03.708927+0000","last_peered":"2023-07-21T22:35:03.708927+0000","last_clean":"2023-07-21T22:35:03.708927+0000","last_became_active":"2023-07-21T22:35:01.724374+0000","last_became_peered":"2023-07-21T22:35:01.724374+0000","last_unstale":"2023-07-21T22:35:03.708927+0000","last_undegraded":"2023-07-21T22:35:03.708927+0000","last_fullsized":"2023-07-21T22:35:03.708927+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:49:54.385455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259398+0000","last_change":"2023-07-21T22:35:02.734158+0000","last_active":"2023-07-21T22:35:04.259398+0000","last_peered":"2023-07-21T22:35:04.259398+0000","last_clean":"2023-07-21T22:35:04.259398+0000","last_became_active":"2023-07-21T22:35:02.733849+0000","last_became_peered":"2023-07-21T22:35:02.733849+0000","last_unstale":"2023-07-21T22:35:04.259398+0000","last_undegraded":"2023-07-21T22:35:04.259398+0000","last_fullsized":"2023-07-21T22:35:04.259398+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:50:13.783927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.753956+0000","last_change":"2023-07-21T22:35:01.727387+0000","last_active":"2023-07-21T22:35:03.753956+0000","last_peered":"2023-07-21T22:35:03.753956+0000","last_clean":"2023-07-21T22:35:03.753956+0000","last_became_active":"2023-07-21T22:35:01.727122+0000","last_became_peered":"2023-07-21T22:35:01.727122+0000","last_unstale":"2023-07-21T22:35:03.753956+0000","last_undegraded":"2023-07-21T22:35:03.753956+0000","last_fullsized":"2023-07-21T22:35:03.753956+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:43:17.275364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"86'183","reported_seq":545,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.258901+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:35:04.258901+0000","last_peered":"2023-07-21T22:35:04.258901+0000","last_clean":"2023-07-21T22:35:04.258901+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:35:04.258901+0000","last_undegraded":"2023-07-21T22:35:04.258901+0000","last_fullsized":"2023-07-21T22:35:04.258901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:27:39.062885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":164,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718415+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:35:03.718415+0000","last_peered":"2023-07-21T22:35:03.718415+0000","last_clean":"2023-07-21T22:35:03.718415+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:35:03.718415+0000","last_undegraded":"2023-07-21T22:35:03.718415+0000","last_fullsized":"2023-07-21T22:35:03.718415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:25:13.479332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255303+0000","last_change":"2023-07-21T22:35:02.729668+0000","last_active":"2023-07-21T22:35:04.255303+0000","last_peered":"2023-07-21T22:35:04.255303+0000","last_clean":"2023-07-21T22:35:04.255303+0000","last_became_active":"2023-07-21T22:35:02.729355+0000","last_became_peered":"2023-07-21T22:35:02.729355+0000","last_unstale":"2023-07-21T22:35:04.255303+0000","last_undegraded":"2023-07-21T22:35:04.255303+0000","last_fullsized":"2023-07-21T22:35:04.255303+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:01.868048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.753687+0000","last_change":"2023-07-21T22:35:01.728192+0000","last_active":"2023-07-21T22:35:03.753687+0000","last_peered":"2023-07-21T22:35:03.753687+0000","last_clean":"2023-07-21T22:35:03.753687+0000","last_became_active":"2023-07-21T22:35:01.727821+0000","last_became_peered":"2023-07-21T22:35:01.727821+0000","last_unstale":"2023-07-21T22:35:03.753687+0000","last_undegraded":"2023-07-21T22:35:03.753687+0000","last_fullsized":"2023-07-21T22:35:03.753687+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:57:53.384523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":155,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.258765+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:35:04.258765+0000","last_peered":"2023-07-21T22:35:04.258765+0000","last_clean":"2023-07-21T22:35:04.258765+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:35:04.258765+0000","last_undegraded":"2023-07-21T22:35:04.258765+0000","last_fullsized":"2023-07-21T22:35:04.258765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:05:39.298897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259917+0000","last_change":"2023-07-21T22:35:02.730917+0000","last_active":"2023-07-21T22:35:04.259917+0000","last_peered":"2023-07-21T22:35:04.259917+0000","last_clean":"2023-07-21T22:35:04.259917+0000","last_became_active":"2023-07-21T22:35:02.730548+0000","last_became_peered":"2023-07-21T22:35:02.730548+0000","last_unstale":"2023-07-21T22:35:04.259917+0000","last_undegraded":"2023-07-21T22:35:04.259917+0000","last_fullsized":"2023-07-21T22:35:04.259917+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:46:03.816997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.753636+0000","last_change":"2023-07-21T22:35:01.727413+0000","last_active":"2023-07-21T22:35:03.753636+0000","last_peered":"2023-07-21T22:35:03.753636+0000","last_clean":"2023-07-21T22:35:03.753636+0000","last_became_active":"2023-07-21T22:35:01.727047+0000","last_became_peered":"2023-07-21T22:35:01.727047+0000","last_unstale":"2023-07-21T22:35:03.753636+0000","last_undegraded":"2023-07-21T22:35:03.753636+0000","last_fullsized":"2023-07-21T22:35:03.753636+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:01:13.260563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":150,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254350+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:35:04.254350+0000","last_peered":"2023-07-21T22:35:04.254350+0000","last_clean":"2023-07-21T22:35:04.254350+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:35:04.254350+0000","last_undegraded":"2023-07-21T22:35:04.254350+0000","last_fullsized":"2023-07-21T22:35:04.254350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:54:06.382354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255249+0000","last_change":"2023-07-21T22:35:02.728916+0000","last_active":"2023-07-21T22:35:04.255249+0000","last_peered":"2023-07-21T22:35:04.255249+0000","last_clean":"2023-07-21T22:35:04.255249+0000","last_became_active":"2023-07-21T22:35:02.728611+0000","last_became_peered":"2023-07-21T22:35:02.728611+0000","last_unstale":"2023-07-21T22:35:04.255249+0000","last_undegraded":"2023-07-21T22:35:04.255249+0000","last_fullsized":"2023-07-21T22:35:04.255249+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:10:02.001306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.753925+0000","last_change":"2023-07-21T22:35:01.721862+0000","last_active":"2023-07-21T22:35:03.753925+0000","last_peered":"2023-07-21T22:35:03.753925+0000","last_clean":"2023-07-21T22:35:03.753925+0000","last_became_active":"2023-07-21T22:35:01.721408+0000","last_became_peered":"2023-07-21T22:35:01.721408+0000","last_unstale":"2023-07-21T22:35:03.753925+0000","last_undegraded":"2023-07-21T22:35:03.753925+0000","last_fullsized":"2023-07-21T22:35:03.753925+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:35:02.657021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":164,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718420+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:35:03.718420+0000","last_peered":"2023-07-21T22:35:03.718420+0000","last_clean":"2023-07-21T22:35:03.718420+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:35:03.718420+0000","last_undegraded":"2023-07-21T22:35:03.718420+0000","last_fullsized":"2023-07-21T22:35:03.718420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:03:35.895122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255408+0000","last_change":"2023-07-21T22:35:02.730067+0000","last_active":"2023-07-21T22:35:04.255408+0000","last_peered":"2023-07-21T22:35:04.255408+0000","last_clean":"2023-07-21T22:35:04.255408+0000","last_became_active":"2023-07-21T22:35:02.729770+0000","last_became_peered":"2023-07-21T22:35:02.729770+0000","last_unstale":"2023-07-21T22:35:04.255408+0000","last_undegraded":"2023-07-21T22:35:04.255408+0000","last_fullsized":"2023-07-21T22:35:04.255408+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:18.203921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254802+0000","last_change":"2023-07-21T22:35:01.716440+0000","last_active":"2023-07-21T22:35:04.254802+0000","last_peered":"2023-07-21T22:35:04.254802+0000","last_clean":"2023-07-21T22:35:04.254802+0000","last_became_active":"2023-07-21T22:35:01.715933+0000","last_became_peered":"2023-07-21T22:35:01.715933+0000","last_unstale":"2023-07-21T22:35:04.254802+0000","last_undegraded":"2023-07-21T22:35:04.254802+0000","last_fullsized":"2023-07-21T22:35:04.254802+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:45:33.466783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":156,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.709445+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:35:03.709445+0000","last_peered":"2023-07-21T22:35:03.709445+0000","last_clean":"2023-07-21T22:35:03.709445+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:35:03.709445+0000","last_undegraded":"2023-07-21T22:35:03.709445+0000","last_fullsized":"2023-07-21T22:35:03.709445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:28:13.915208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.753949+0000","last_change":"2023-07-21T22:35:02.738338+0000","last_active":"2023-07-21T22:35:03.753949+0000","last_peered":"2023-07-21T22:35:03.753949+0000","last_clean":"2023-07-21T22:35:03.753949+0000","last_became_active":"2023-07-21T22:35:02.738059+0000","last_became_peered":"2023-07-21T22:35:02.738059+0000","last_unstale":"2023-07-21T22:35:03.753949+0000","last_undegraded":"2023-07-21T22:35:03.753949+0000","last_fullsized":"2023-07-21T22:35:03.753949+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:56:37.415624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.709107+0000","last_change":"2023-07-21T22:35:01.725616+0000","last_active":"2023-07-21T22:35:03.709107+0000","last_peered":"2023-07-21T22:35:03.709107+0000","last_clean":"2023-07-21T22:35:03.709107+0000","last_became_active":"2023-07-21T22:35:01.725346+0000","last_became_peered":"2023-07-21T22:35:01.725346+0000","last_unstale":"2023-07-21T22:35:03.709107+0000","last_undegraded":"2023-07-21T22:35:03.709107+0000","last_fullsized":"2023-07-21T22:35:03.709107+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:22:40.526144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259290+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:35:04.259290+0000","last_peered":"2023-07-21T22:35:04.259290+0000","last_clean":"2023-07-21T22:35:04.259290+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:35:04.259290+0000","last_undegraded":"2023-07-21T22:35:04.259290+0000","last_fullsized":"2023-07-21T22:35:04.259290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:59:54.904363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.753641+0000","last_change":"2023-07-21T22:35:02.729764+0000","last_active":"2023-07-21T22:35:03.753641+0000","last_peered":"2023-07-21T22:35:03.753641+0000","last_clean":"2023-07-21T22:35:03.753641+0000","last_became_active":"2023-07-21T22:35:02.729430+0000","last_became_peered":"2023-07-21T22:35:02.729430+0000","last_unstale":"2023-07-21T22:35:03.753641+0000","last_undegraded":"2023-07-21T22:35:03.753641+0000","last_fullsized":"2023-07-21T22:35:03.753641+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:59:13.166385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259728+0000","last_change":"2023-07-21T22:35:01.727961+0000","last_active":"2023-07-21T22:35:04.259728+0000","last_peered":"2023-07-21T22:35:04.259728+0000","last_clean":"2023-07-21T22:35:04.259728+0000","last_became_active":"2023-07-21T22:35:01.727557+0000","last_became_peered":"2023-07-21T22:35:01.727557+0000","last_unstale":"2023-07-21T22:35:04.259728+0000","last_undegraded":"2023-07-21T22:35:04.259728+0000","last_fullsized":"2023-07-21T22:35:04.259728+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:23:38.002856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":156,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.709404+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:35:03.709404+0000","last_peered":"2023-07-21T22:35:03.709404+0000","last_clean":"2023-07-21T22:35:03.709404+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:35:03.709404+0000","last_undegraded":"2023-07-21T22:35:03.709404+0000","last_fullsized":"2023-07-21T22:35:03.709404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:11:40.031850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254209+0000","last_change":"2023-07-21T22:35:02.729048+0000","last_active":"2023-07-21T22:35:04.254209+0000","last_peered":"2023-07-21T22:35:04.254209+0000","last_clean":"2023-07-21T22:35:04.254209+0000","last_became_active":"2023-07-21T22:35:02.728745+0000","last_became_peered":"2023-07-21T22:35:02.728745+0000","last_unstale":"2023-07-21T22:35:04.254209+0000","last_undegraded":"2023-07-21T22:35:04.254209+0000","last_fullsized":"2023-07-21T22:35:04.254209+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:38:11.768348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718086+0000","last_change":"2023-07-21T22:35:01.725476+0000","last_active":"2023-07-21T22:35:03.718086+0000","last_peered":"2023-07-21T22:35:03.718086+0000","last_clean":"2023-07-21T22:35:03.718086+0000","last_became_active":"2023-07-21T22:35:01.725132+0000","last_became_peered":"2023-07-21T22:35:01.725132+0000","last_unstale":"2023-07-21T22:35:03.718086+0000","last_undegraded":"2023-07-21T22:35:03.718086+0000","last_fullsized":"2023-07-21T22:35:03.718086+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:01:48.151551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":148,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259983+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:35:04.259983+0000","last_peered":"2023-07-21T22:35:04.259983+0000","last_clean":"2023-07-21T22:35:04.259983+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:35:04.259983+0000","last_undegraded":"2023-07-21T22:35:04.259983+0000","last_fullsized":"2023-07-21T22:35:04.259983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:40:51.495007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509639,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59032,"kb_used_data":1744,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312808,"statfs":{"total":96636764160,"available":96576315392,"internally_reserved":0,"allocated":1785856,"data_stored":1181415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73299999999999998,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.35299999999999998,"15min":0.32600000000000001},"max":{"1min":1.1180000000000001,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.36099999999999999},"max":{"1min":0.90900000000000003,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.68000000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.432,"15min":0.379},"max":{"1min":1.0509999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.41899999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72399999999999998,"15min":0.74299999999999999},"min":{"1min":0.51300000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.405},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72899999999999998,"15min":0.752},"min":{"1min":0.47999999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95699999999999996,"5min":1.409,"15min":1.409},"last":0.58099999999999996}]},{"osd":3,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.504,"15min":0.42099999999999999},"max":{"1min":1.1539999999999999,"5min":1.46,"15min":1.46},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.02,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63400000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55400000000000005,"15min":0.55900000000000005},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.89900000000000002,"5min":0.90500000000000003,"15min":0.94999999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90400000000000003,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.77700000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64500000000000002,"15min":0.61799999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.56499999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.052,"5min":1.506,"15min":1.506},"last":0.751}]},{"osd":6,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.048},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.434,"15min":0.42599999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.61499999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542345,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1200128,"data_stored":592589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.73599999999999999,"15min":0.76100000000000001},"min":{"1min":0.495,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.97599999999999998,"5min":1.016,"15min":1.016},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77700000000000002,"15min":0.79300000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.437},"max":{"1min":0.94699999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.745}]},{"osd":1,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.41999999999999998},"max":{"1min":0.90500000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.94599999999999995,"5min":0.99399999999999999,"15min":1.117},"last":0.47799999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.72999999999999998,"15min":0.75},"min":{"1min":0.499,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.96299999999999997,"5min":0.98099999999999998,"15min":1.0269999999999999},"last":0.499},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.0149999999999999,"5min":1.097,"15min":1.097},"last":0.71999999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.76100000000000001},"min":{"1min":0.57899999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92800000000000005,"5min":1.048,"15min":1.048},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72499999999999998,"15min":0.74099999999999999},"min":{"1min":0.505,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88600000000000001,"5min":1.0049999999999999,"15min":1.054},"last":0.66200000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60299999999999998,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.374,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.441,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.048},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89600000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.91900000000000004,"5min":0.98799999999999999,"15min":1.054},"last":0.77300000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68500000000000005,"15min":0.67700000000000005},"min":{"1min":0.498,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":0.95699999999999996,"5min":1.079,"15min":1.079},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.70099999999999996,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96499999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69799999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509638,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1191936,"data_stored":591059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.70699999999999996,"15min":0.71299999999999997},"min":{"1min":0.436,"5min":0.35699999999999998,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.70799999999999996,"15min":0.72199999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83999999999999997,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.72199999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66800000000000004,"15min":0.71099999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90600000000000003,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.71099999999999997,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77900000000000003,"5min":1.617,"15min":1.617},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.70999999999999996,"15min":0.73499999999999999},"min":{"1min":0.45100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.99399999999999999,"5min":1.0109999999999999,"15min":1.034},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.71399999999999997,"15min":0.747},"min":{"1min":0.498,"5min":0.377,"15min":0.377},"max":{"1min":0.86399999999999999,"5min":1.512,"15min":1.512},"last":0.749}]},{"osd":3,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.76100000000000001,"15min":0.78500000000000003},"min":{"1min":0.56299999999999994,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86199999999999999,"5min":1.472,"15min":1.472},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.59999999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.90800000000000003,"5min":1.556,"15min":1.556},"last":0.70799999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88900000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89200000000000002,"5min":1.012,"15min":1.038},"last":0.83399999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95499999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.622,"15min":0.60999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93799999999999994,"5min":1.02,"15min":1.02},"last":0.81100000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66100000000000003,"15min":0.65000000000000002},"min":{"1min":0.42399999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.91900000000000004,"5min":1.042,"15min":1.042},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.57899999999999996,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.64600000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509639,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1208320,"data_stored":592693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71999999999999997,"15min":0.74299999999999999},"min":{"1min":0.51200000000000001,"5min":0.438,"15min":0.40000000000000002},"max":{"1min":0.80900000000000005,"5min":0.99399999999999999,"15min":1.0429999999999999},"last":0.748},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73299999999999998,"15min":0.74299999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.83599999999999997,"5min":0.96099999999999997,"15min":0.97599999999999998},"last":0.70299999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.39400000000000002},"max":{"1min":0.85499999999999998,"5min":1.002,"15min":1.0449999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.69399999999999995,"15min":0.69999999999999996},"min":{"1min":0.47299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.872,"5min":0.94299999999999995,"15min":1.016},"last":0.51700000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.51200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.95899999999999996,"5min":1.048,"15min":1.048},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.53000000000000003,"5min":0.41999999999999998,"15min":0.33000000000000002},"max":{"1min":1.006,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72899999999999998,"15min":0.73699999999999999},"min":{"1min":0.51000000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94099999999999995,"5min":0.97999999999999998,"15min":1.026},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58399999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.72899999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.45100000000000001,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98899999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.38500000000000001},"max":{"1min":0.94699999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.57099999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.83199999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64400000000000002,"15min":0.65100000000000002},"min":{"1min":0.45500000000000002,"5min":0.39900000000000002,"15min":0.374},"max":{"1min":0.92100000000000004,"5min":1.0069999999999999,"15min":1.0429999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.135},"last":0.78000000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509638,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1191936,"data_stored":591607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.48799999999999999,"15min":0.48099999999999998},"min":{"1min":0.35099999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70499999999999996,"5min":0.73099999999999998,"15min":0.76400000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.439}]},{"osd":1,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.30099999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.871},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.94199999999999995},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82899999999999996,"5min":1.0449999999999999,"15min":1.1140000000000001},"last":0.379},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45500000000000002,"5min":0.45100000000000001,"15min":0.40999999999999998},"max":{"1min":0.84399999999999997,"5min":0.95399999999999996,"15min":0.99199999999999999},"last":0.50600000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.57599999999999996,"5min":0.48299999999999998,"15min":0.438},"max":{"1min":1.093,"5min":1.093,"15min":1.3240000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82199999999999995,"15min":0.83299999999999996},"min":{"1min":0.68799999999999994,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.488},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.60699999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0669999999999999,"5min":1.137,"15min":1.1919999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.60399999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0649999999999999,"15min":1.302},"last":0.75600000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79200000000000004,"15min":0.80100000000000005},"min":{"1min":0.68000000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.02,"5min":1.056,"15min":1.3979999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76500000000000001,"15min":0.78000000000000003},"min":{"1min":0.56899999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0269999999999999,"5min":1.1120000000000001,"15min":1.3899999999999999},"last":0.72699999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.81000000000000005,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0089999999999999,"5min":1.087,"15min":1.335},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.83699999999999997,"15min":0.83499999999999996},"min":{"1min":0.66100000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.2130000000000001},"last":0.77700000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509640,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54364,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317476,"statfs":{"total":96636764160,"available":96581095424,"internally_reserved":0,"allocated":1200128,"data_stored":591767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.29099999999999998,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.69399999999999995,"5min":0.81200000000000006,"15min":0.94199999999999995},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53600000000000003,"15min":0.54900000000000004},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.88300000000000001,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.54300000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.28199999999999997},"max":{"1min":0.82999999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80700000000000005,"5min":1.085,"15min":1.085},"last":0.59199999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.37,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55300000000000005,"15min":0.56899999999999995},"min":{"1min":0.43099999999999999,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":1.161,"15min":1.161},"last":0.52600000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.67600000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.1579999999999999,"5min":1.2569999999999999,"15min":1.6870000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.79400000000000004,"15min":0.80200000000000005},"min":{"1min":0.57699999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.175,"5min":1.1950000000000001,"15min":1.2689999999999999},"last":0.68500000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.63200000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.2549999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.60599999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.107,"5min":1.206,"15min":1.3089999999999999},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.78600000000000003,"15min":0.79800000000000004},"min":{"1min":0.69399999999999995,"5min":0.45500000000000002,"15min":0.40300000000000002},"max":{"1min":1.089,"5min":1.282,"15min":1.3759999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.64300000000000002,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.1339999999999999,"5min":1.23,"15min":1.2649999999999999},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.80900000000000005,"15min":0.82899999999999996},"min":{"1min":0.64900000000000002,"5min":0.51100000000000001,"15min":0.49099999999999999},"max":{"1min":1.143,"5min":1.2,"15min":1.2909999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.60999999999999999,"5min":0.44900000000000001,"15min":0.44700000000000001},"max":{"1min":1.091,"5min":1.216,"15min":1.3660000000000001},"last":0.755}]}]},{"osd":1,"up_from":15,"seq":64424509639,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1196032,"data_stored":591137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.28299999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53500000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.373},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.626,"5min":0.872,"15min":0.872},"last":0.52600000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.5,"15min":0.50700000000000001},"min":{"1min":0.33700000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63200000000000001,"5min":0.76100000000000001,"15min":0.81000000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.29099999999999998},"max":{"1min":0.78900000000000003,"5min":0.83599999999999997,"15min":0.88800000000000001},"last":0.40600000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.57599999999999996,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35799999999999998,"15min":0.33400000000000002},"max":{"1min":0.70799999999999996,"5min":0.84299999999999997,"15min":0.98899999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.505,"15min":0.51700000000000002},"min":{"1min":0.33100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.64200000000000002,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.42599999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.748,"15min":0.77000000000000002},"min":{"1min":0.53100000000000003,"5min":0.432,"15min":0.432},"max":{"1min":0.91400000000000003,"5min":1.0860000000000001,"15min":1.234},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.57499999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.014,"5min":1.083,"15min":1.155},"last":0.79900000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75600000000000001,"15min":0.77800000000000002},"min":{"1min":0.53500000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92500000000000004,"5min":1.0609999999999999,"15min":1.1919999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78500000000000003,"15min":0.80000000000000004},"min":{"1min":0.55200000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.044,"5min":1.121,"15min":1.2849999999999999},"last":0.86399999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78600000000000003,"15min":0.81000000000000005},"min":{"1min":0.57199999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0229999999999999,"5min":1.0580000000000001,"15min":1.23},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76300000000000001,"15min":0.79000000000000004},"min":{"1min":0.50900000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0449999999999999,"5min":1.1020000000000001,"15min":1.3240000000000001},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78600000000000003,"15min":0.80900000000000005},"min":{"1min":0.58599999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.99299999999999999,"5min":1.103,"15min":1.3149999999999999},"last":0.877},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79000000000000004,"15min":0.80800000000000005},"min":{"1min":0.55500000000000005,"5min":0.52600000000000002,"15min":0.45700000000000002},"max":{"1min":0.97499999999999998,"5min":1.115,"15min":1.3380000000000001},"last":0.76100000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509641,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36884,"kb_used_data":1740,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334956,"statfs":{"total":96636764160,"available":96598994944,"internally_reserved":0,"allocated":1781760,"data_stored":1181393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.50800000000000001},"min":{"1min":0.35899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.67900000000000005,"5min":0.77800000000000002,"15min":0.83199999999999996},"last":0.44900000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70999999999999996,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.44,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58199999999999996,"5min":0.871,"15min":0.871},"last":0.372}]},{"osd":3,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.35899999999999999,"15min":0.34899999999999998},"max":{"1min":0.76500000000000001,"5min":0.88100000000000001,"15min":0.91300000000000003},"last":0.502},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.434,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73999999999999999,"5min":1.038,"15min":1.038},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.76100000000000001,"15min":0.78100000000000003},"min":{"1min":0.59299999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.321},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.60099999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.093,"5min":1.423,"15min":1.423},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.60299999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0960000000000001,"5min":1.2669999999999999,"15min":1.28},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.78400000000000003,"15min":0.80900000000000005},"min":{"1min":0.70599999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.393},"last":0.58799999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78500000000000003,"15min":0.81299999999999994},"min":{"1min":0.61799999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.28},"last":0.624},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81399999999999995,"15min":0.81999999999999995},"min":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.131,"5min":1.333,"15min":1.333},"last":0.67400000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.65900000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.2310000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.80900000000000005,"15min":0.83399999999999996},"min":{"1min":0.60599999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1930000000000001,"5min":1.296,"15min":1.369},"last":0.53500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:35:11.492 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:35:11.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.598+0000 7efca0dfa640 1 Processor -- start 2023-07-21T22:35:11.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.598+0000 7efca0dfa640 1 -- start start 2023-07-21T22:35:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.598+0000 7efca0dfa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efc9c15f500 0x7efc9c06cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.598+0000 7efca0dfa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efc9c06d430 0x7efc9c06a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.598+0000 7efca0dfa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9c0cdc80 con 0x7efc9c06aa80 2023-07-21T22:35:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.598+0000 7efca0dfa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9c06af00 con 0x7efc9c06d430 2023-07-21T22:35:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.598+0000 7efca0dfa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9c06e4c0 con 0x7efc9c15f500 2023-07-21T22:35:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.598+0000 7efc9ad9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efc9c06aa80 0x7efc9c0b1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52712/0 (socket says 172.21.15.6:52712) 2023-07-21T22:35:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.598+0000 7efc9ad9d640 1 -- 172.21.15.6:0/705660325 learned_addr learned my addr 172.21.15.6:0/705660325 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.598+0000 7efc93fff640 1 --2- 172.21.15.6:0/705660325 >> v2:172.21.15.6:3300/0 conn(0x7efc9c06d430 0x7efc9c06a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:11.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.598+0000 7efc9a59c640 1 --2- 172.21.15.6:0/705660325 >> v2:172.21.15.161:3300/0 conn(0x7efc9c15f500 0x7efc9c06cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:11.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.598+0000 7efc93fff640 1 -- 172.21.15.6:0/705660325 >> v2:172.21.15.161:3300/0 conn(0x7efc9c15f500 msgr2=0x7efc9c06cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:11.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.598+0000 7efc93fff640 1 --2- 172.21.15.6:0/705660325 >> v2:172.21.15.161:3300/0 conn(0x7efc9c15f500 0x7efc9c06cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:11.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.598+0000 7efc93fff640 1 -- 172.21.15.6:0/705660325 >> v1:172.21.15.6:6789/0 conn(0x7efc9c06aa80 legacy=0x7efc9c0b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:11.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.602+0000 7efc93fff640 1 -- 172.21.15.6:0/705660325 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c06d940 con 0x7efc9c06d430 2023-07-21T22:35:11.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.598+0000 7efc99d9b640 1 -- 172.21.15.6:0/705660325 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2455416893 0 0) 0x7efc9c0cdc80 con 0x7efc9c06aa80 2023-07-21T22:35:11.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.602+0000 7efc93fff640 1 --2- 172.21.15.6:0/705660325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c06d430 0x7efc9c06a540 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7efc9c0b2c40 tx=0x7efc8401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b06603e53188d69 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:11.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.602+0000 7efc99d9b640 1 -- 172.21.15.6:0/705660325 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84004230 con 0x7efc9c06d430 2023-07-21T22:35:11.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.602+0000 7efc99d9b640 1 -- 172.21.15.6:0/705660325 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc840a7050 con 0x7efc9c06d430 2023-07-21T22:35:11.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.602+0000 7efc99d9b640 1 -- 172.21.15.6:0/705660325 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84003620 con 0x7efc9c06d430 2023-07-21T22:35:11.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.602+0000 7efca0dfa640 1 -- 172.21.15.6:0/705660325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c06d430 msgr2=0x7efc9c06a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:11.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.602+0000 7efca0dfa640 1 --2- 172.21.15.6:0/705660325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c06d430 0x7efc9c06a540 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7efc9c0b2c40 tx=0x7efc8401c460 comp rx=0 tx=0).stop 2023-07-21T22:35:11.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.602+0000 7efca0dfa640 1 -- 172.21.15.6:0/705660325 shutdown_connections 2023-07-21T22:35:11.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.602+0000 7efca0dfa640 1 --2- 172.21.15.6:0/705660325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c06d430 0x7efc9c06a540 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:11.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.602+0000 7efca0dfa640 1 --2- 172.21.15.6:0/705660325 >> v2:172.21.15.161:3300/0 conn(0x7efc9c15f500 0x7efc9c06cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:11.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.602+0000 7efca0dfa640 1 -- 172.21.15.6:0/705660325 >> 172.21.15.6:0/705660325 conn(0x7efc9c0659d0 msgr2=0x7efc9c099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:11.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.602+0000 7efca0dfa640 1 -- 172.21.15.6:0/705660325 shutdown_connections 2023-07-21T22:35:11.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.602+0000 7efca0dfa640 1 -- 172.21.15.6:0/705660325 wait complete. 2023-07-21T22:35:11.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efca0dfa640 1 Processor -- start 2023-07-21T22:35:11.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efca0dfa640 1 -- start start 2023-07-21T22:35:11.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efca0dfa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c06aa80 0x7efc9c151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:11.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efca0dfa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc9c06d430 0x7efc9c15e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:11.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efca0dfa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc9c15f500 0x7efc9c152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:11.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efca0dfa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c14e250 con 0x7efc9c06aa80 2023-07-21T22:35:11.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efca0dfa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c14e530 con 0x7efc9c15f500 2023-07-21T22:35:11.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efca0dfa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c14e810 con 0x7efc9c06d430 2023-07-21T22:35:11.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efc9a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c06aa80 0x7efc9c151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:11.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efc9a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c06aa80 0x7efc9c151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39258/0 (socket says 172.21.15.6:39258) 2023-07-21T22:35:11.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efc9a59c640 1 -- 172.21.15.6:0/1547618928 learned_addr learned my addr 172.21.15.6:0/1547618928 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:11.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efc9ad9d640 1 --2- 172.21.15.6:0/1547618928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc9c15f500 0x7efc9c152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:11.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efc93fff640 1 --2- 172.21.15.6:0/1547618928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc9c06d430 0x7efc9c15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:11.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efc9a59c640 1 -- 172.21.15.6:0/1547618928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc9c06d430 msgr2=0x7efc9c15e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:11.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efc9a59c640 1 --2- 172.21.15.6:0/1547618928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc9c06d430 0x7efc9c15e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:11.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efc9a59c640 1 -- 172.21.15.6:0/1547618928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc9c15f500 msgr2=0x7efc9c152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:11.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efc9a59c640 1 --2- 172.21.15.6:0/1547618928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc9c15f500 0x7efc9c152970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:11.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efc9a59c640 1 -- 172.21.15.6:0/1547618928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc84009420 con 0x7efc9c06aa80 2023-07-21T22:35:11.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efc9a59c640 1 --2- 172.21.15.6:0/1547618928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c06aa80 0x7efc9c151e60 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00d7d0 tx=0x7efc8c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:11.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efc92ffd640 1 -- 172.21.15.6:0/1547618928 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c00b6c0 con 0x7efc9c06aa80 2023-07-21T22:35:11.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efc92ffd640 1 -- 172.21.15.6:0/1547618928 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c00b820 con 0x7efc9c06aa80 2023-07-21T22:35:11.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efc92ffd640 1 -- 172.21.15.6:0/1547618928 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c00bbd0 con 0x7efc9c06aa80 2023-07-21T22:35:11.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.606+0000 7efca0dfa640 1 -- 172.21.15.6:0/1547618928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9c14eaf0 con 0x7efc9c06aa80 2023-07-21T22:35:11.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.610+0000 7efca0dfa640 1 -- 172.21.15.6:0/1547618928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9c15eb50 con 0x7efc9c06aa80 2023-07-21T22:35:11.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.610+0000 7efca0dfa640 1 -- 172.21.15.6:0/1547618928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9c0678d0 con 0x7efc9c06aa80 2023-07-21T22:35:11.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.610+0000 7efc92ffd640 1 -- 172.21.15.6:0/1547618928 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efc8c00bd30 con 0x7efc9c06aa80 2023-07-21T22:35:11.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.610+0000 7efc92ffd640 1 --2- 172.21.15.6:0/1547618928 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7efc7c0663a0 0x7efc7c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:11.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.610+0000 7efc92ffd640 1 -- 172.21.15.6:0/1547618928 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6106+0+0 (secure 0 0 0) 0x7efc8c084460 con 0x7efc9c06aa80 2023-07-21T22:35:11.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.610+0000 7efc93fff640 1 --2- 172.21.15.6:0/1547618928 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7efc7c0663a0 0x7efc7c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:11.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.610+0000 7efc93fff640 1 --2- 172.21.15.6:0/1547618928 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7efc7c0663a0 0x7efc7c068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efc840ad000 tx=0x7efc840a6000 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:11.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.614+0000 7efc92ffd640 1 -- 172.21.15.6:0/1547618928 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efc8c055190 con 0x7efc9c06aa80 2023-07-21T22:35:11.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.766+0000 7efca0dfa640 1 -- 172.21.15.6:0/1547618928 --> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc9c14e6a0 con 0x7efc7c0663a0 2023-07-21T22:35:11.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.778+0000 7efc92ffd640 1 -- 172.21.15.6:0/1547618928 <== mgr.6763 v2:172.21.15.161:6832/3267017989 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311000 (secure 0 0 0) 0x7efc9c14e6a0 con 0x7efc7c0663a0 2023-07-21T22:35:11.827 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:11.829 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:35:11.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.778+0000 7efca0dfa640 1 -- 172.21.15.6:0/1547618928 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7efc7c0663a0 msgr2=0x7efc7c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:11.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.778+0000 7efca0dfa640 1 --2- 172.21.15.6:0/1547618928 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7efc7c0663a0 0x7efc7c068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efc840ad000 tx=0x7efc840a6000 comp rx=0 tx=0).stop 2023-07-21T22:35:11.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.778+0000 7efca0dfa640 1 -- 172.21.15.6:0/1547618928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c06aa80 msgr2=0x7efc9c151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:11.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.778+0000 7efca0dfa640 1 --2- 172.21.15.6:0/1547618928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c06aa80 0x7efc9c151e60 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00d7d0 tx=0x7efc8c00dc90 comp rx=0 tx=0).stop 2023-07-21T22:35:11.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.778+0000 7efca0dfa640 1 -- 172.21.15.6:0/1547618928 shutdown_connections 2023-07-21T22:35:11.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.778+0000 7efca0dfa640 1 --2- 172.21.15.6:0/1547618928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc9c15f500 0x7efc9c152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:11.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.778+0000 7efca0dfa640 1 --2- 172.21.15.6:0/1547618928 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7efc7c0663a0 0x7efc7c068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:11.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.778+0000 7efca0dfa640 1 --2- 172.21.15.6:0/1547618928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc9c06d430 0x7efc9c15e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:11.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.778+0000 7efca0dfa640 1 --2- 172.21.15.6:0/1547618928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c06aa80 0x7efc9c151e60 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:11.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.778+0000 7efca0dfa640 1 -- 172.21.15.6:0/1547618928 >> 172.21.15.6:0/1547618928 conn(0x7efc9c0659d0 msgr2=0x7efc9c0cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:11.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.778+0000 7efca0dfa640 1 -- 172.21.15.6:0/1547618928 shutdown_connections 2023-07-21T22:35:11.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.778+0000 7efca0dfa640 1 -- 172.21.15.6:0/1547618928 wait complete. 2023-07-21T22:35:11.848 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-21T22:35:10.395852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":324,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":311368,"kb_used_data":10504,"kb_used_omap":0,"kb_used_meta":300800,"kb_avail":754663352,"statfs":{"total":773094113280,"available":772775272448,"internally_reserved":0,"allocated":10756096,"data_stored":5913660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308019200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002507"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259587+0000","last_change":"2023-07-21T22:35:02.729207+0000","last_active":"2023-07-21T22:35:04.259587+0000","last_peered":"2023-07-21T22:35:04.259587+0000","last_clean":"2023-07-21T22:35:04.259587+0000","last_became_active":"2023-07-21T22:35:02.728920+0000","last_became_peered":"2023-07-21T22:35:02.728920+0000","last_unstale":"2023-07-21T22:35:04.259587+0000","last_undegraded":"2023-07-21T22:35:04.259587+0000","last_fullsized":"2023-07-21T22:35:04.259587+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:59:56.146587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255218+0000","last_change":"2023-07-21T22:35:02.744705+0000","last_active":"2023-07-21T22:35:04.255218+0000","last_peered":"2023-07-21T22:35:04.255218+0000","last_clean":"2023-07-21T22:35:04.255218+0000","last_became_active":"2023-07-21T22:35:02.738241+0000","last_became_peered":"2023-07-21T22:35:02.738241+0000","last_unstale":"2023-07-21T22:35:04.255218+0000","last_undegraded":"2023-07-21T22:35:04.255218+0000","last_fullsized":"2023-07-21T22:35:04.255218+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:42:39.597364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.709329+0000","last_change":"2023-07-21T22:35:02.746565+0000","last_active":"2023-07-21T22:35:03.709329+0000","last_peered":"2023-07-21T22:35:03.709329+0000","last_clean":"2023-07-21T22:35:03.709329+0000","last_became_active":"2023-07-21T22:35:02.746281+0000","last_became_peered":"2023-07-21T22:35:02.746281+0000","last_unstale":"2023-07-21T22:35:03.709329+0000","last_undegraded":"2023-07-21T22:35:03.709329+0000","last_fullsized":"2023-07-21T22:35:03.709329+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:28:02.565265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718666+0000","last_change":"2023-07-21T22:35:02.718289+0000","last_active":"2023-07-21T22:35:03.718666+0000","last_peered":"2023-07-21T22:35:03.718666+0000","last_clean":"2023-07-21T22:35:03.718666+0000","last_became_active":"2023-07-21T22:35:02.717984+0000","last_became_peered":"2023-07-21T22:35:02.717984+0000","last_unstale":"2023-07-21T22:35:03.718666+0000","last_undegraded":"2023-07-21T22:35:03.718666+0000","last_fullsized":"2023-07-21T22:35:03.718666+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:22:28.056862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254514+0000","last_change":"2023-07-21T22:35:02.725176+0000","last_active":"2023-07-21T22:35:04.254514+0000","last_peered":"2023-07-21T22:35:04.254514+0000","last_clean":"2023-07-21T22:35:04.254514+0000","last_became_active":"2023-07-21T22:35:02.724863+0000","last_became_peered":"2023-07-21T22:35:02.724863+0000","last_unstale":"2023-07-21T22:35:04.254514+0000","last_undegraded":"2023-07-21T22:35:04.254514+0000","last_fullsized":"2023-07-21T22:35:04.254514+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:45:49.543975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.753673+0000","last_change":"2023-07-21T22:35:02.726566+0000","last_active":"2023-07-21T22:35:03.753673+0000","last_peered":"2023-07-21T22:35:03.753673+0000","last_clean":"2023-07-21T22:35:03.753673+0000","last_became_active":"2023-07-21T22:35:02.726072+0000","last_became_peered":"2023-07-21T22:35:02.726072+0000","last_unstale":"2023-07-21T22:35:03.753673+0000","last_undegraded":"2023-07-21T22:35:03.753673+0000","last_fullsized":"2023-07-21T22:35:03.753673+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:37.473658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259260+0000","last_change":"2023-07-21T22:35:02.742038+0000","last_active":"2023-07-21T22:35:04.259260+0000","last_peered":"2023-07-21T22:35:04.259260+0000","last_clean":"2023-07-21T22:35:04.259260+0000","last_became_active":"2023-07-21T22:35:02.741461+0000","last_became_peered":"2023-07-21T22:35:02.741461+0000","last_unstale":"2023-07-21T22:35:04.259260+0000","last_undegraded":"2023-07-21T22:35:04.259260+0000","last_fullsized":"2023-07-21T22:35:04.259260+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:03.145040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254160+0000","last_change":"2023-07-21T22:35:02.725156+0000","last_active":"2023-07-21T22:35:04.254160+0000","last_peered":"2023-07-21T22:35:04.254160+0000","last_clean":"2023-07-21T22:35:04.254160+0000","last_became_active":"2023-07-21T22:35:02.724896+0000","last_became_peered":"2023-07-21T22:35:02.724896+0000","last_unstale":"2023-07-21T22:35:04.254160+0000","last_undegraded":"2023-07-21T22:35:04.254160+0000","last_fullsized":"2023-07-21T22:35:04.254160+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:10:25.231833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718019+0000","last_change":"2023-07-21T22:35:02.736381+0000","last_active":"2023-07-21T22:35:03.718019+0000","last_peered":"2023-07-21T22:35:03.718019+0000","last_clean":"2023-07-21T22:35:03.718019+0000","last_became_active":"2023-07-21T22:35:02.736106+0000","last_became_peered":"2023-07-21T22:35:02.736106+0000","last_unstale":"2023-07-21T22:35:03.718019+0000","last_undegraded":"2023-07-21T22:35:03.718019+0000","last_fullsized":"2023-07-21T22:35:03.718019+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:24:13.927749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718662+0000","last_change":"2023-07-21T22:35:02.732205+0000","last_active":"2023-07-21T22:35:03.718662+0000","last_peered":"2023-07-21T22:35:03.718662+0000","last_clean":"2023-07-21T22:35:03.718662+0000","last_became_active":"2023-07-21T22:35:02.731942+0000","last_became_peered":"2023-07-21T22:35:02.731942+0000","last_unstale":"2023-07-21T22:35:03.718662+0000","last_undegraded":"2023-07-21T22:35:03.718662+0000","last_fullsized":"2023-07-21T22:35:03.718662+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:40:53.249037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254669+0000","last_change":"2023-07-21T22:35:02.739257+0000","last_active":"2023-07-21T22:35:04.254669+0000","last_peered":"2023-07-21T22:35:04.254669+0000","last_clean":"2023-07-21T22:35:04.254669+0000","last_became_active":"2023-07-21T22:35:02.738637+0000","last_became_peered":"2023-07-21T22:35:02.738637+0000","last_unstale":"2023-07-21T22:35:04.254669+0000","last_undegraded":"2023-07-21T22:35:04.254669+0000","last_fullsized":"2023-07-21T22:35:04.254669+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:48:53.014284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718671+0000","last_change":"2023-07-21T22:35:02.733610+0000","last_active":"2023-07-21T22:35:03.718671+0000","last_peered":"2023-07-21T22:35:03.718671+0000","last_clean":"2023-07-21T22:35:03.718671+0000","last_became_active":"2023-07-21T22:35:02.733207+0000","last_became_peered":"2023-07-21T22:35:02.733207+0000","last_unstale":"2023-07-21T22:35:03.718671+0000","last_undegraded":"2023-07-21T22:35:03.718671+0000","last_fullsized":"2023-07-21T22:35:03.718671+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:50:16.151669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254665+0000","last_change":"2023-07-21T22:35:02.731782+0000","last_active":"2023-07-21T22:35:04.254665+0000","last_peered":"2023-07-21T22:35:04.254665+0000","last_clean":"2023-07-21T22:35:04.254665+0000","last_became_active":"2023-07-21T22:35:02.731443+0000","last_became_peered":"2023-07-21T22:35:02.731443+0000","last_unstale":"2023-07-21T22:35:04.254665+0000","last_undegraded":"2023-07-21T22:35:04.254665+0000","last_fullsized":"2023-07-21T22:35:04.254665+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:00:40.887996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.753820+0000","last_change":"2023-07-21T22:35:02.725295+0000","last_active":"2023-07-21T22:35:03.753820+0000","last_peered":"2023-07-21T22:35:03.753820+0000","last_clean":"2023-07-21T22:35:03.753820+0000","last_became_active":"2023-07-21T22:35:02.724166+0000","last_became_peered":"2023-07-21T22:35:02.724166+0000","last_unstale":"2023-07-21T22:35:03.753820+0000","last_undegraded":"2023-07-21T22:35:03.753820+0000","last_fullsized":"2023-07-21T22:35:03.753820+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:48:28.279323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254907+0000","last_change":"2023-07-21T22:35:02.735546+0000","last_active":"2023-07-21T22:35:04.254907+0000","last_peered":"2023-07-21T22:35:04.254907+0000","last_clean":"2023-07-21T22:35:04.254907+0000","last_became_active":"2023-07-21T22:35:02.735244+0000","last_became_peered":"2023-07-21T22:35:02.735244+0000","last_unstale":"2023-07-21T22:35:04.254907+0000","last_undegraded":"2023-07-21T22:35:04.254907+0000","last_fullsized":"2023-07-21T22:35:04.254907+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:21:41.132396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.258523+0000","last_change":"2023-07-21T22:35:02.726961+0000","last_active":"2023-07-21T22:35:04.258523+0000","last_peered":"2023-07-21T22:35:04.258523+0000","last_clean":"2023-07-21T22:35:04.258523+0000","last_became_active":"2023-07-21T22:35:02.726659+0000","last_became_peered":"2023-07-21T22:35:02.726659+0000","last_unstale":"2023-07-21T22:35:04.258523+0000","last_undegraded":"2023-07-21T22:35:04.258523+0000","last_fullsized":"2023-07-21T22:35:04.258523+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:29:16.096124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254490+0000","last_change":"2023-07-21T22:35:02.729177+0000","last_active":"2023-07-21T22:35:04.254490+0000","last_peered":"2023-07-21T22:35:04.254490+0000","last_clean":"2023-07-21T22:35:04.254490+0000","last_became_active":"2023-07-21T22:35:02.728839+0000","last_became_peered":"2023-07-21T22:35:02.728839+0000","last_unstale":"2023-07-21T22:35:04.254490+0000","last_undegraded":"2023-07-21T22:35:04.254490+0000","last_fullsized":"2023-07-21T22:35:04.254490+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:39:04.776706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.709227+0000","last_change":"2023-07-21T22:35:02.723554+0000","last_active":"2023-07-21T22:35:03.709227+0000","last_peered":"2023-07-21T22:35:03.709227+0000","last_clean":"2023-07-21T22:35:03.709227+0000","last_became_active":"2023-07-21T22:35:02.723257+0000","last_became_peered":"2023-07-21T22:35:02.723257+0000","last_unstale":"2023-07-21T22:35:03.709227+0000","last_undegraded":"2023-07-21T22:35:03.709227+0000","last_fullsized":"2023-07-21T22:35:03.709227+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:39:05.212414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.754026+0000","last_change":"2023-07-21T22:35:02.737744+0000","last_active":"2023-07-21T22:35:03.754026+0000","last_peered":"2023-07-21T22:35:03.754026+0000","last_clean":"2023-07-21T22:35:03.754026+0000","last_became_active":"2023-07-21T22:35:02.737439+0000","last_became_peered":"2023-07-21T22:35:02.737439+0000","last_unstale":"2023-07-21T22:35:03.754026+0000","last_undegraded":"2023-07-21T22:35:03.754026+0000","last_fullsized":"2023-07-21T22:35:03.754026+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:06:02.176941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254595+0000","last_change":"2023-07-21T22:35:02.718301+0000","last_active":"2023-07-21T22:35:04.254595+0000","last_peered":"2023-07-21T22:35:04.254595+0000","last_clean":"2023-07-21T22:35:04.254595+0000","last_became_active":"2023-07-21T22:35:02.717897+0000","last_became_peered":"2023-07-21T22:35:02.717897+0000","last_unstale":"2023-07-21T22:35:04.254595+0000","last_undegraded":"2023-07-21T22:35:04.254595+0000","last_fullsized":"2023-07-21T22:35:04.254595+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:13:55.160321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.717488+0000","last_change":"2023-07-21T22:35:02.722780+0000","last_active":"2023-07-21T22:35:03.717488+0000","last_peered":"2023-07-21T22:35:03.717488+0000","last_clean":"2023-07-21T22:35:03.717488+0000","last_became_active":"2023-07-21T22:35:02.722458+0000","last_became_peered":"2023-07-21T22:35:02.722458+0000","last_unstale":"2023-07-21T22:35:03.717488+0000","last_undegraded":"2023-07-21T22:35:03.717488+0000","last_fullsized":"2023-07-21T22:35:03.717488+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:11:24.954614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255438+0000","last_change":"2023-07-21T22:35:02.731666+0000","last_active":"2023-07-21T22:35:04.255438+0000","last_peered":"2023-07-21T22:35:04.255438+0000","last_clean":"2023-07-21T22:35:04.255438+0000","last_became_active":"2023-07-21T22:35:02.731377+0000","last_became_peered":"2023-07-21T22:35:02.731377+0000","last_unstale":"2023-07-21T22:35:04.255438+0000","last_undegraded":"2023-07-21T22:35:04.255438+0000","last_fullsized":"2023-07-21T22:35:04.255438+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:57.761212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.717596+0000","last_change":"2023-07-21T22:35:02.725013+0000","last_active":"2023-07-21T22:35:03.717596+0000","last_peered":"2023-07-21T22:35:03.717596+0000","last_clean":"2023-07-21T22:35:03.717596+0000","last_became_active":"2023-07-21T22:35:02.724673+0000","last_became_peered":"2023-07-21T22:35:02.724673+0000","last_unstale":"2023-07-21T22:35:03.717596+0000","last_undegraded":"2023-07-21T22:35:03.717596+0000","last_fullsized":"2023-07-21T22:35:03.717596+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:28:51.439204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254570+0000","last_change":"2023-07-21T22:35:02.739317+0000","last_active":"2023-07-21T22:35:04.254570+0000","last_peered":"2023-07-21T22:35:04.254570+0000","last_clean":"2023-07-21T22:35:04.254570+0000","last_became_active":"2023-07-21T22:35:02.739013+0000","last_became_peered":"2023-07-21T22:35:02.739013+0000","last_unstale":"2023-07-21T22:35:04.254570+0000","last_undegraded":"2023-07-21T22:35:04.254570+0000","last_fullsized":"2023-07-21T22:35:04.254570+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:57:56.400416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255251+0000","last_change":"2023-07-21T22:35:02.738739+0000","last_active":"2023-07-21T22:35:04.255251+0000","last_peered":"2023-07-21T22:35:04.255251+0000","last_clean":"2023-07-21T22:35:04.255251+0000","last_became_active":"2023-07-21T22:35:02.738356+0000","last_became_peered":"2023-07-21T22:35:02.738356+0000","last_unstale":"2023-07-21T22:35:04.255251+0000","last_undegraded":"2023-07-21T22:35:04.255251+0000","last_fullsized":"2023-07-21T22:35:04.255251+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:27:15.425767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718756+0000","last_change":"2023-07-21T22:35:02.743814+0000","last_active":"2023-07-21T22:35:03.718756+0000","last_peered":"2023-07-21T22:35:03.718756+0000","last_clean":"2023-07-21T22:35:03.718756+0000","last_became_active":"2023-07-21T22:35:02.743499+0000","last_became_peered":"2023-07-21T22:35:02.743499+0000","last_unstale":"2023-07-21T22:35:03.718756+0000","last_undegraded":"2023-07-21T22:35:03.718756+0000","last_fullsized":"2023-07-21T22:35:03.718756+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:56:05.238349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.258866+0000","last_change":"2023-07-21T22:35:02.726749+0000","last_active":"2023-07-21T22:35:04.258866+0000","last_peered":"2023-07-21T22:35:04.258866+0000","last_clean":"2023-07-21T22:35:04.258866+0000","last_became_active":"2023-07-21T22:35:02.726463+0000","last_became_peered":"2023-07-21T22:35:02.726463+0000","last_unstale":"2023-07-21T22:35:04.258866+0000","last_undegraded":"2023-07-21T22:35:04.258866+0000","last_fullsized":"2023-07-21T22:35:04.258866+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:04:22.942189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254742+0000","last_change":"2023-07-21T22:35:02.716783+0000","last_active":"2023-07-21T22:35:04.254742+0000","last_peered":"2023-07-21T22:35:04.254742+0000","last_clean":"2023-07-21T22:35:04.254742+0000","last_became_active":"2023-07-21T22:35:02.716497+0000","last_became_peered":"2023-07-21T22:35:02.716497+0000","last_unstale":"2023-07-21T22:35:04.254742+0000","last_undegraded":"2023-07-21T22:35:04.254742+0000","last_fullsized":"2023-07-21T22:35:04.254742+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:41:32.758801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254631+0000","last_change":"2023-07-21T22:35:02.745153+0000","last_active":"2023-07-21T22:35:04.254631+0000","last_peered":"2023-07-21T22:35:04.254631+0000","last_clean":"2023-07-21T22:35:04.254631+0000","last_became_active":"2023-07-21T22:35:02.744802+0000","last_became_peered":"2023-07-21T22:35:02.744802+0000","last_unstale":"2023-07-21T22:35:04.254631+0000","last_undegraded":"2023-07-21T22:35:04.254631+0000","last_fullsized":"2023-07-21T22:35:04.254631+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:15:11.300238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259007+0000","last_change":"2023-07-21T22:35:02.735124+0000","last_active":"2023-07-21T22:35:04.259007+0000","last_peered":"2023-07-21T22:35:04.259007+0000","last_clean":"2023-07-21T22:35:04.259007+0000","last_became_active":"2023-07-21T22:35:02.734820+0000","last_became_peered":"2023-07-21T22:35:02.734820+0000","last_unstale":"2023-07-21T22:35:04.259007+0000","last_undegraded":"2023-07-21T22:35:04.259007+0000","last_fullsized":"2023-07-21T22:35:04.259007+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:08:51.341351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.709032+0000","last_change":"2023-07-21T22:35:02.728381+0000","last_active":"2023-07-21T22:35:03.709032+0000","last_peered":"2023-07-21T22:35:03.709032+0000","last_clean":"2023-07-21T22:35:03.709032+0000","last_became_active":"2023-07-21T22:35:02.728087+0000","last_became_peered":"2023-07-21T22:35:02.728087+0000","last_unstale":"2023-07-21T22:35:03.709032+0000","last_undegraded":"2023-07-21T22:35:03.709032+0000","last_fullsized":"2023-07-21T22:35:03.709032+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:43:30.826056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.258596+0000","last_change":"2023-07-21T22:35:02.729192+0000","last_active":"2023-07-21T22:35:04.258596+0000","last_peered":"2023-07-21T22:35:04.258596+0000","last_clean":"2023-07-21T22:35:04.258596+0000","last_became_active":"2023-07-21T22:35:02.728910+0000","last_became_peered":"2023-07-21T22:35:02.728910+0000","last_unstale":"2023-07-21T22:35:04.258596+0000","last_undegraded":"2023-07-21T22:35:04.258596+0000","last_fullsized":"2023-07-21T22:35:04.258596+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:39:17.130510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.708942+0000","last_change":"2023-07-21T22:35:02.725533+0000","last_active":"2023-07-21T22:35:03.708942+0000","last_peered":"2023-07-21T22:35:03.708942+0000","last_clean":"2023-07-21T22:35:03.708942+0000","last_became_active":"2023-07-21T22:35:02.725243+0000","last_became_peered":"2023-07-21T22:35:02.725243+0000","last_unstale":"2023-07-21T22:35:03.708942+0000","last_undegraded":"2023-07-21T22:35:03.708942+0000","last_fullsized":"2023-07-21T22:35:03.708942+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:55:16.470609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"97'4","reported_seq":17,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254634+0000","last_change":"2023-07-21T22:35:01.722906+0000","last_active":"2023-07-21T22:35:04.254634+0000","last_peered":"2023-07-21T22:35:04.254634+0000","last_clean":"2023-07-21T22:35:04.254634+0000","last_became_active":"2023-07-21T22:35:01.722556+0000","last_became_peered":"2023-07-21T22:35:01.722556+0000","last_unstale":"2023-07-21T22:35:04.254634+0000","last_undegraded":"2023-07-21T22:35:04.254634+0000","last_fullsized":"2023-07-21T22:35:04.254634+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:45:44.006693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255062+0000","last_change":"2023-07-21T22:35:02.733645+0000","last_active":"2023-07-21T22:35:04.255062+0000","last_peered":"2023-07-21T22:35:04.255062+0000","last_clean":"2023-07-21T22:35:04.255062+0000","last_became_active":"2023-07-21T22:35:02.733365+0000","last_became_peered":"2023-07-21T22:35:02.733365+0000","last_unstale":"2023-07-21T22:35:04.255062+0000","last_undegraded":"2023-07-21T22:35:04.255062+0000","last_fullsized":"2023-07-21T22:35:04.255062+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:59:16.663454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259495+0000","last_change":"2023-07-21T22:35:01.730971+0000","last_active":"2023-07-21T22:35:04.259495+0000","last_peered":"2023-07-21T22:35:04.259495+0000","last_clean":"2023-07-21T22:35:04.259495+0000","last_became_active":"2023-07-21T22:35:01.730651+0000","last_became_peered":"2023-07-21T22:35:01.730651+0000","last_unstale":"2023-07-21T22:35:04.259495+0000","last_undegraded":"2023-07-21T22:35:04.259495+0000","last_fullsized":"2023-07-21T22:35:04.259495+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:04:50.708614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.717512+0000","last_change":"2023-07-21T22:35:02.729056+0000","last_active":"2023-07-21T22:35:03.717512+0000","last_peered":"2023-07-21T22:35:03.717512+0000","last_clean":"2023-07-21T22:35:03.717512+0000","last_became_active":"2023-07-21T22:35:02.728202+0000","last_became_peered":"2023-07-21T22:35:02.728202+0000","last_unstale":"2023-07-21T22:35:03.717512+0000","last_undegraded":"2023-07-21T22:35:03.717512+0000","last_fullsized":"2023-07-21T22:35:03.717512+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:27:47.681082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259009+0000","last_change":"2023-07-21T22:35:01.728487+0000","last_active":"2023-07-21T22:35:04.259009+0000","last_peered":"2023-07-21T22:35:04.259009+0000","last_clean":"2023-07-21T22:35:04.259009+0000","last_became_active":"2023-07-21T22:35:01.728216+0000","last_became_peered":"2023-07-21T22:35:01.728216+0000","last_unstale":"2023-07-21T22:35:04.259009+0000","last_undegraded":"2023-07-21T22:35:04.259009+0000","last_fullsized":"2023-07-21T22:35:04.259009+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:49:01.703956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.717522+0000","last_change":"2023-07-21T22:35:02.721920+0000","last_active":"2023-07-21T22:35:03.717522+0000","last_peered":"2023-07-21T22:35:03.717522+0000","last_clean":"2023-07-21T22:35:03.717522+0000","last_became_active":"2023-07-21T22:35:02.721618+0000","last_became_peered":"2023-07-21T22:35:02.721618+0000","last_unstale":"2023-07-21T22:35:03.717522+0000","last_undegraded":"2023-07-21T22:35:03.717522+0000","last_fullsized":"2023-07-21T22:35:03.717522+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:02:43.799086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259421+0000","last_change":"2023-07-21T22:35:01.727508+0000","last_active":"2023-07-21T22:35:04.259421+0000","last_peered":"2023-07-21T22:35:04.259421+0000","last_clean":"2023-07-21T22:35:04.259421+0000","last_became_active":"2023-07-21T22:35:01.726844+0000","last_became_peered":"2023-07-21T22:35:01.726844+0000","last_unstale":"2023-07-21T22:35:04.259421+0000","last_undegraded":"2023-07-21T22:35:04.259421+0000","last_fullsized":"2023-07-21T22:35:04.259421+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:34:20.483385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255153+0000","last_change":"2023-07-21T22:35:02.744065+0000","last_active":"2023-07-21T22:35:04.255153+0000","last_peered":"2023-07-21T22:35:04.255153+0000","last_clean":"2023-07-21T22:35:04.255153+0000","last_became_active":"2023-07-21T22:35:02.738489+0000","last_became_peered":"2023-07-21T22:35:02.738489+0000","last_unstale":"2023-07-21T22:35:04.255153+0000","last_undegraded":"2023-07-21T22:35:04.255153+0000","last_fullsized":"2023-07-21T22:35:04.255153+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:43:56.848816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.717751+0000","last_change":"2023-07-21T22:35:01.723132+0000","last_active":"2023-07-21T22:35:03.717751+0000","last_peered":"2023-07-21T22:35:03.717751+0000","last_clean":"2023-07-21T22:35:03.717751+0000","last_became_active":"2023-07-21T22:35:01.722696+0000","last_became_peered":"2023-07-21T22:35:01.722696+0000","last_unstale":"2023-07-21T22:35:03.717751+0000","last_undegraded":"2023-07-21T22:35:03.717751+0000","last_fullsized":"2023-07-21T22:35:03.717751+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:27:18.994856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254806+0000","last_change":"2023-07-21T22:35:02.744449+0000","last_active":"2023-07-21T22:35:04.254806+0000","last_peered":"2023-07-21T22:35:04.254806+0000","last_clean":"2023-07-21T22:35:04.254806+0000","last_became_active":"2023-07-21T22:35:02.744095+0000","last_became_peered":"2023-07-21T22:35:02.744095+0000","last_unstale":"2023-07-21T22:35:04.254806+0000","last_undegraded":"2023-07-21T22:35:04.254806+0000","last_fullsized":"2023-07-21T22:35:04.254806+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:03.397502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718350+0000","last_change":"2023-07-21T22:35:01.725943+0000","last_active":"2023-07-21T22:35:03.718350+0000","last_peered":"2023-07-21T22:35:03.718350+0000","last_clean":"2023-07-21T22:35:03.718350+0000","last_became_active":"2023-07-21T22:35:01.725603+0000","last_became_peered":"2023-07-21T22:35:01.725603+0000","last_unstale":"2023-07-21T22:35:03.718350+0000","last_undegraded":"2023-07-21T22:35:03.718350+0000","last_fullsized":"2023-07-21T22:35:03.718350+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:33:12.629584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718058+0000","last_change":"2023-07-21T22:35:02.730354+0000","last_active":"2023-07-21T22:35:03.718058+0000","last_peered":"2023-07-21T22:35:03.718058+0000","last_clean":"2023-07-21T22:35:03.718058+0000","last_became_active":"2023-07-21T22:35:02.730089+0000","last_became_peered":"2023-07-21T22:35:02.730089+0000","last_unstale":"2023-07-21T22:35:03.718058+0000","last_undegraded":"2023-07-21T22:35:03.718058+0000","last_fullsized":"2023-07-21T22:35:03.718058+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:12:36.178143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255131+0000","last_change":"2023-07-21T22:35:01.714572+0000","last_active":"2023-07-21T22:35:04.255131+0000","last_peered":"2023-07-21T22:35:04.255131+0000","last_clean":"2023-07-21T22:35:04.255131+0000","last_became_active":"2023-07-21T22:35:01.714302+0000","last_became_peered":"2023-07-21T22:35:01.714302+0000","last_unstale":"2023-07-21T22:35:04.255131+0000","last_undegraded":"2023-07-21T22:35:04.255131+0000","last_fullsized":"2023-07-21T22:35:04.255131+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:40:00.909109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259827+0000","last_change":"2023-07-21T22:35:02.742036+0000","last_active":"2023-07-21T22:35:04.259827+0000","last_peered":"2023-07-21T22:35:04.259827+0000","last_clean":"2023-07-21T22:35:04.259827+0000","last_became_active":"2023-07-21T22:35:02.741649+0000","last_became_peered":"2023-07-21T22:35:02.741649+0000","last_unstale":"2023-07-21T22:35:04.259827+0000","last_undegraded":"2023-07-21T22:35:04.259827+0000","last_fullsized":"2023-07-21T22:35:04.259827+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:43:06.444699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254235+0000","last_change":"2023-07-21T22:35:01.716458+0000","last_active":"2023-07-21T22:35:04.254235+0000","last_peered":"2023-07-21T22:35:04.254235+0000","last_clean":"2023-07-21T22:35:04.254235+0000","last_became_active":"2023-07-21T22:35:01.716115+0000","last_became_peered":"2023-07-21T22:35:01.716115+0000","last_unstale":"2023-07-21T22:35:04.254235+0000","last_undegraded":"2023-07-21T22:35:04.254235+0000","last_fullsized":"2023-07-21T22:35:04.254235+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:45:07.622541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254720+0000","last_change":"2023-07-21T22:35:02.731357+0000","last_active":"2023-07-21T22:35:04.254720+0000","last_peered":"2023-07-21T22:35:04.254720+0000","last_clean":"2023-07-21T22:35:04.254720+0000","last_became_active":"2023-07-21T22:35:02.731047+0000","last_became_peered":"2023-07-21T22:35:02.731047+0000","last_unstale":"2023-07-21T22:35:04.254720+0000","last_undegraded":"2023-07-21T22:35:04.254720+0000","last_fullsized":"2023-07-21T22:35:04.254720+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:00:54.727256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259667+0000","last_change":"2023-07-21T22:35:01.731125+0000","last_active":"2023-07-21T22:35:04.259667+0000","last_peered":"2023-07-21T22:35:04.259667+0000","last_clean":"2023-07-21T22:35:04.259667+0000","last_became_active":"2023-07-21T22:35:01.730807+0000","last_became_peered":"2023-07-21T22:35:01.730807+0000","last_unstale":"2023-07-21T22:35:04.259667+0000","last_undegraded":"2023-07-21T22:35:04.259667+0000","last_fullsized":"2023-07-21T22:35:04.259667+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:19:22.571142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718423+0000","last_change":"2023-07-21T22:35:02.718067+0000","last_active":"2023-07-21T22:35:03.718423+0000","last_peered":"2023-07-21T22:35:03.718423+0000","last_clean":"2023-07-21T22:35:03.718423+0000","last_became_active":"2023-07-21T22:35:02.717754+0000","last_became_peered":"2023-07-21T22:35:02.717754+0000","last_unstale":"2023-07-21T22:35:03.718423+0000","last_undegraded":"2023-07-21T22:35:03.718423+0000","last_fullsized":"2023-07-21T22:35:03.718423+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:13:07.420757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718841+0000","last_change":"2023-07-21T22:35:01.719096+0000","last_active":"2023-07-21T22:35:03.718841+0000","last_peered":"2023-07-21T22:35:03.718841+0000","last_clean":"2023-07-21T22:35:03.718841+0000","last_became_active":"2023-07-21T22:35:01.718805+0000","last_became_peered":"2023-07-21T22:35:01.718805+0000","last_unstale":"2023-07-21T22:35:03.718841+0000","last_undegraded":"2023-07-21T22:35:03.718841+0000","last_fullsized":"2023-07-21T22:35:03.718841+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:11:01.713928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.754125+0000","last_change":"2023-07-21T22:35:02.728713+0000","last_active":"2023-07-21T22:35:03.754125+0000","last_peered":"2023-07-21T22:35:03.754125+0000","last_clean":"2023-07-21T22:35:03.754125+0000","last_became_active":"2023-07-21T22:35:02.728407+0000","last_became_peered":"2023-07-21T22:35:02.728407+0000","last_unstale":"2023-07-21T22:35:03.754125+0000","last_undegraded":"2023-07-21T22:35:03.754125+0000","last_fullsized":"2023-07-21T22:35:03.754125+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:12:01.353989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"97'3","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254664+0000","last_change":"2023-07-21T22:35:01.717629+0000","last_active":"2023-07-21T22:35:04.254664+0000","last_peered":"2023-07-21T22:35:04.254664+0000","last_clean":"2023-07-21T22:35:04.254664+0000","last_became_active":"2023-07-21T22:35:01.717342+0000","last_became_peered":"2023-07-21T22:35:01.717342+0000","last_unstale":"2023-07-21T22:35:04.254664+0000","last_undegraded":"2023-07-21T22:35:04.254664+0000","last_fullsized":"2023-07-21T22:35:04.254664+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:00:40.729376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.709278+0000","last_change":"2023-07-21T22:35:02.746582+0000","last_active":"2023-07-21T22:35:03.709278+0000","last_peered":"2023-07-21T22:35:03.709278+0000","last_clean":"2023-07-21T22:35:03.709278+0000","last_became_active":"2023-07-21T22:35:02.746290+0000","last_became_peered":"2023-07-21T22:35:02.746290+0000","last_unstale":"2023-07-21T22:35:03.709278+0000","last_undegraded":"2023-07-21T22:35:03.709278+0000","last_fullsized":"2023-07-21T22:35:03.709278+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:03:52.989180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"97'6","reported_seq":19,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259568+0000","last_change":"2023-07-21T22:35:01.727312+0000","last_active":"2023-07-21T22:35:04.259568+0000","last_peered":"2023-07-21T22:35:04.259568+0000","last_clean":"2023-07-21T22:35:04.259568+0000","last_became_active":"2023-07-21T22:35:01.726466+0000","last_became_peered":"2023-07-21T22:35:01.726466+0000","last_unstale":"2023-07-21T22:35:04.259568+0000","last_undegraded":"2023-07-21T22:35:04.259568+0000","last_fullsized":"2023-07-21T22:35:04.259568+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:39:24.563720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718848+0000","last_change":"2023-07-21T22:35:02.724351+0000","last_active":"2023-07-21T22:35:03.718848+0000","last_peered":"2023-07-21T22:35:03.718848+0000","last_clean":"2023-07-21T22:35:03.718848+0000","last_became_active":"2023-07-21T22:35:02.724054+0000","last_became_peered":"2023-07-21T22:35:02.724054+0000","last_unstale":"2023-07-21T22:35:03.718848+0000","last_undegraded":"2023-07-21T22:35:03.718848+0000","last_fullsized":"2023-07-21T22:35:03.718848+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:13:45.068159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718450+0000","last_change":"2023-07-21T22:35:01.722302+0000","last_active":"2023-07-21T22:35:03.718450+0000","last_peered":"2023-07-21T22:35:03.718450+0000","last_clean":"2023-07-21T22:35:03.718450+0000","last_became_active":"2023-07-21T22:35:01.722024+0000","last_became_peered":"2023-07-21T22:35:01.722024+0000","last_unstale":"2023-07-21T22:35:03.718450+0000","last_undegraded":"2023-07-21T22:35:03.718450+0000","last_fullsized":"2023-07-21T22:35:03.718450+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:22:16.286713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259627+0000","last_change":"2023-07-21T22:35:02.731520+0000","last_active":"2023-07-21T22:35:04.259627+0000","last_peered":"2023-07-21T22:35:04.259627+0000","last_clean":"2023-07-21T22:35:04.259627+0000","last_became_active":"2023-07-21T22:35:02.731222+0000","last_became_peered":"2023-07-21T22:35:02.731222+0000","last_unstale":"2023-07-21T22:35:04.259627+0000","last_undegraded":"2023-07-21T22:35:04.259627+0000","last_fullsized":"2023-07-21T22:35:04.259627+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:11:03.242898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.258670+0000","last_change":"2023-07-21T22:35:01.729518+0000","last_active":"2023-07-21T22:35:04.258670+0000","last_peered":"2023-07-21T22:35:04.258670+0000","last_clean":"2023-07-21T22:35:04.258670+0000","last_became_active":"2023-07-21T22:35:01.729250+0000","last_became_peered":"2023-07-21T22:35:01.729250+0000","last_unstale":"2023-07-21T22:35:04.258670+0000","last_undegraded":"2023-07-21T22:35:04.258670+0000","last_fullsized":"2023-07-21T22:35:04.258670+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:01:16.881614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259039+0000","last_change":"2023-07-21T22:35:02.730810+0000","last_active":"2023-07-21T22:35:04.259039+0000","last_peered":"2023-07-21T22:35:04.259039+0000","last_clean":"2023-07-21T22:35:04.259039+0000","last_became_active":"2023-07-21T22:35:02.730500+0000","last_became_peered":"2023-07-21T22:35:02.730500+0000","last_unstale":"2023-07-21T22:35:04.259039+0000","last_undegraded":"2023-07-21T22:35:04.259039+0000","last_fullsized":"2023-07-21T22:35:04.259039+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:49.251935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254256+0000","last_change":"2023-07-21T22:35:01.723235+0000","last_active":"2023-07-21T22:35:04.254256+0000","last_peered":"2023-07-21T22:35:04.254256+0000","last_clean":"2023-07-21T22:35:04.254256+0000","last_became_active":"2023-07-21T22:35:01.722975+0000","last_became_peered":"2023-07-21T22:35:01.722975+0000","last_unstale":"2023-07-21T22:35:04.254256+0000","last_undegraded":"2023-07-21T22:35:04.254256+0000","last_fullsized":"2023-07-21T22:35:04.254256+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:58:54.396517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259892+0000","last_change":"2023-07-21T22:35:02.736452+0000","last_active":"2023-07-21T22:35:04.259892+0000","last_peered":"2023-07-21T22:35:04.259892+0000","last_clean":"2023-07-21T22:35:04.259892+0000","last_became_active":"2023-07-21T22:35:02.736117+0000","last_became_peered":"2023-07-21T22:35:02.736117+0000","last_unstale":"2023-07-21T22:35:04.259892+0000","last_undegraded":"2023-07-21T22:35:04.259892+0000","last_fullsized":"2023-07-21T22:35:04.259892+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:30:50.117072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"97'8","reported_seq":21,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254853+0000","last_change":"2023-07-21T22:35:01.723581+0000","last_active":"2023-07-21T22:35:04.254853+0000","last_peered":"2023-07-21T22:35:04.254853+0000","last_clean":"2023-07-21T22:35:04.254853+0000","last_became_active":"2023-07-21T22:35:01.723291+0000","last_became_peered":"2023-07-21T22:35:01.723291+0000","last_unstale":"2023-07-21T22:35:04.254853+0000","last_undegraded":"2023-07-21T22:35:04.254853+0000","last_fullsized":"2023-07-21T22:35:04.254853+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:38:13.262742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.717477+0000","last_change":"2023-07-21T22:35:02.731407+0000","last_active":"2023-07-21T22:35:03.717477+0000","last_peered":"2023-07-21T22:35:03.717477+0000","last_clean":"2023-07-21T22:35:03.717477+0000","last_became_active":"2023-07-21T22:35:02.731093+0000","last_became_peered":"2023-07-21T22:35:02.731093+0000","last_unstale":"2023-07-21T22:35:03.717477+0000","last_undegraded":"2023-07-21T22:35:03.717477+0000","last_fullsized":"2023-07-21T22:35:03.717477+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:15:24.817403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718863+0000","last_change":"2023-07-21T22:35:01.723963+0000","last_active":"2023-07-21T22:35:03.718863+0000","last_peered":"2023-07-21T22:35:03.718863+0000","last_clean":"2023-07-21T22:35:03.718863+0000","last_became_active":"2023-07-21T22:35:01.723692+0000","last_became_peered":"2023-07-21T22:35:01.723692+0000","last_unstale":"2023-07-21T22:35:03.718863+0000","last_undegraded":"2023-07-21T22:35:03.718863+0000","last_fullsized":"2023-07-21T22:35:03.718863+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:27:48.316599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259300+0000","last_change":"2023-07-21T22:35:02.737036+0000","last_active":"2023-07-21T22:35:04.259300+0000","last_peered":"2023-07-21T22:35:04.259300+0000","last_clean":"2023-07-21T22:35:04.259300+0000","last_became_active":"2023-07-21T22:35:02.736725+0000","last_became_peered":"2023-07-21T22:35:02.736725+0000","last_unstale":"2023-07-21T22:35:04.259300+0000","last_undegraded":"2023-07-21T22:35:04.259300+0000","last_fullsized":"2023-07-21T22:35:04.259300+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:29:55.427187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"98'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255391+0000","last_change":"2023-07-21T22:35:01.716816+0000","last_active":"2023-07-21T22:35:04.255391+0000","last_peered":"2023-07-21T22:35:04.255391+0000","last_clean":"2023-07-21T22:35:04.255391+0000","last_became_active":"2023-07-21T22:35:01.716553+0000","last_became_peered":"2023-07-21T22:35:01.716553+0000","last_unstale":"2023-07-21T22:35:04.255391+0000","last_undegraded":"2023-07-21T22:35:04.255391+0000","last_fullsized":"2023-07-21T22:35:04.255391+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:02:25.745807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.717586+0000","last_change":"2023-07-21T22:35:02.722797+0000","last_active":"2023-07-21T22:35:03.717586+0000","last_peered":"2023-07-21T22:35:03.717586+0000","last_clean":"2023-07-21T22:35:03.717586+0000","last_became_active":"2023-07-21T22:35:02.722475+0000","last_became_peered":"2023-07-21T22:35:02.722475+0000","last_unstale":"2023-07-21T22:35:03.717586+0000","last_undegraded":"2023-07-21T22:35:03.717586+0000","last_fullsized":"2023-07-21T22:35:03.717586+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:57:48.795407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259176+0000","last_change":"2023-07-21T22:35:01.725547+0000","last_active":"2023-07-21T22:35:04.259176+0000","last_peered":"2023-07-21T22:35:04.259176+0000","last_clean":"2023-07-21T22:35:04.259176+0000","last_became_active":"2023-07-21T22:35:01.725139+0000","last_became_peered":"2023-07-21T22:35:01.725139+0000","last_unstale":"2023-07-21T22:35:04.259176+0000","last_undegraded":"2023-07-21T22:35:04.259176+0000","last_fullsized":"2023-07-21T22:35:04.259176+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:18:14.711004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254773+0000","last_change":"2023-07-21T22:35:02.731453+0000","last_active":"2023-07-21T22:35:04.254773+0000","last_peered":"2023-07-21T22:35:04.254773+0000","last_clean":"2023-07-21T22:35:04.254773+0000","last_became_active":"2023-07-21T22:35:02.731155+0000","last_became_peered":"2023-07-21T22:35:02.731155+0000","last_unstale":"2023-07-21T22:35:04.254773+0000","last_undegraded":"2023-07-21T22:35:04.254773+0000","last_fullsized":"2023-07-21T22:35:04.254773+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:02:11.209998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.258791+0000","last_change":"2023-07-21T22:35:01.731236+0000","last_active":"2023-07-21T22:35:04.258791+0000","last_peered":"2023-07-21T22:35:04.258791+0000","last_clean":"2023-07-21T22:35:04.258791+0000","last_became_active":"2023-07-21T22:35:01.730896+0000","last_became_peered":"2023-07-21T22:35:01.730896+0000","last_unstale":"2023-07-21T22:35:04.258791+0000","last_undegraded":"2023-07-21T22:35:04.258791+0000","last_fullsized":"2023-07-21T22:35:04.258791+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:20:24.298409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259267+0000","last_change":"2023-07-21T22:35:02.736441+0000","last_active":"2023-07-21T22:35:04.259267+0000","last_peered":"2023-07-21T22:35:04.259267+0000","last_clean":"2023-07-21T22:35:04.259267+0000","last_became_active":"2023-07-21T22:35:02.736111+0000","last_became_peered":"2023-07-21T22:35:02.736111+0000","last_unstale":"2023-07-21T22:35:04.259267+0000","last_undegraded":"2023-07-21T22:35:04.259267+0000","last_fullsized":"2023-07-21T22:35:04.259267+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:03:59.635210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259491+0000","last_change":"2023-07-21T22:35:01.726833+0000","last_active":"2023-07-21T22:35:04.259491+0000","last_peered":"2023-07-21T22:35:04.259491+0000","last_clean":"2023-07-21T22:35:04.259491+0000","last_became_active":"2023-07-21T22:35:01.726449+0000","last_became_peered":"2023-07-21T22:35:01.726449+0000","last_unstale":"2023-07-21T22:35:04.259491+0000","last_undegraded":"2023-07-21T22:35:04.259491+0000","last_fullsized":"2023-07-21T22:35:04.259491+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:49:38.700325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259483+0000","last_change":"2023-07-21T22:35:02.742207+0000","last_active":"2023-07-21T22:35:04.259483+0000","last_peered":"2023-07-21T22:35:04.259483+0000","last_clean":"2023-07-21T22:35:04.259483+0000","last_became_active":"2023-07-21T22:35:02.741556+0000","last_became_peered":"2023-07-21T22:35:02.741556+0000","last_unstale":"2023-07-21T22:35:04.259483+0000","last_undegraded":"2023-07-21T22:35:04.259483+0000","last_fullsized":"2023-07-21T22:35:04.259483+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:20:02.027053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255486+0000","last_change":"2023-07-21T22:35:01.723928+0000","last_active":"2023-07-21T22:35:04.255486+0000","last_peered":"2023-07-21T22:35:04.255486+0000","last_clean":"2023-07-21T22:35:04.255486+0000","last_became_active":"2023-07-21T22:35:01.723645+0000","last_became_peered":"2023-07-21T22:35:01.723645+0000","last_unstale":"2023-07-21T22:35:04.255486+0000","last_undegraded":"2023-07-21T22:35:04.255486+0000","last_fullsized":"2023-07-21T22:35:04.255486+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:25:17.852306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.709370+0000","last_change":"2023-07-21T22:35:02.743236+0000","last_active":"2023-07-21T22:35:03.709370+0000","last_peered":"2023-07-21T22:35:03.709370+0000","last_clean":"2023-07-21T22:35:03.709370+0000","last_became_active":"2023-07-21T22:35:02.742895+0000","last_became_peered":"2023-07-21T22:35:02.742895+0000","last_unstale":"2023-07-21T22:35:03.709370+0000","last_undegraded":"2023-07-21T22:35:03.709370+0000","last_fullsized":"2023-07-21T22:35:03.709370+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:05:17.792574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259394+0000","last_change":"2023-07-21T22:35:01.728315+0000","last_active":"2023-07-21T22:35:04.259394+0000","last_peered":"2023-07-21T22:35:04.259394+0000","last_clean":"2023-07-21T22:35:04.259394+0000","last_became_active":"2023-07-21T22:35:01.728026+0000","last_became_peered":"2023-07-21T22:35:01.728026+0000","last_unstale":"2023-07-21T22:35:04.259394+0000","last_undegraded":"2023-07-21T22:35:04.259394+0000","last_fullsized":"2023-07-21T22:35:04.259394+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:11:01.647456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.709173+0000","last_change":"2023-07-21T22:35:02.724443+0000","last_active":"2023-07-21T22:35:03.709173+0000","last_peered":"2023-07-21T22:35:03.709173+0000","last_clean":"2023-07-21T22:35:03.709173+0000","last_became_active":"2023-07-21T22:35:02.724163+0000","last_became_peered":"2023-07-21T22:35:02.724163+0000","last_unstale":"2023-07-21T22:35:03.709173+0000","last_undegraded":"2023-07-21T22:35:03.709173+0000","last_fullsized":"2023-07-21T22:35:03.709173+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:52:20.995176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.708927+0000","last_change":"2023-07-21T22:35:01.724682+0000","last_active":"2023-07-21T22:35:03.708927+0000","last_peered":"2023-07-21T22:35:03.708927+0000","last_clean":"2023-07-21T22:35:03.708927+0000","last_became_active":"2023-07-21T22:35:01.724374+0000","last_became_peered":"2023-07-21T22:35:01.724374+0000","last_unstale":"2023-07-21T22:35:03.708927+0000","last_undegraded":"2023-07-21T22:35:03.708927+0000","last_fullsized":"2023-07-21T22:35:03.708927+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:49:54.385455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259398+0000","last_change":"2023-07-21T22:35:02.734158+0000","last_active":"2023-07-21T22:35:04.259398+0000","last_peered":"2023-07-21T22:35:04.259398+0000","last_clean":"2023-07-21T22:35:04.259398+0000","last_became_active":"2023-07-21T22:35:02.733849+0000","last_became_peered":"2023-07-21T22:35:02.733849+0000","last_unstale":"2023-07-21T22:35:04.259398+0000","last_undegraded":"2023-07-21T22:35:04.259398+0000","last_fullsized":"2023-07-21T22:35:04.259398+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:50:13.783927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.753956+0000","last_change":"2023-07-21T22:35:01.727387+0000","last_active":"2023-07-21T22:35:03.753956+0000","last_peered":"2023-07-21T22:35:03.753956+0000","last_clean":"2023-07-21T22:35:03.753956+0000","last_became_active":"2023-07-21T22:35:01.727122+0000","last_became_peered":"2023-07-21T22:35:01.727122+0000","last_unstale":"2023-07-21T22:35:03.753956+0000","last_undegraded":"2023-07-21T22:35:03.753956+0000","last_fullsized":"2023-07-21T22:35:03.753956+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:43:17.275364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"86'183","reported_seq":545,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.258901+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:35:04.258901+0000","last_peered":"2023-07-21T22:35:04.258901+0000","last_clean":"2023-07-21T22:35:04.258901+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:35:04.258901+0000","last_undegraded":"2023-07-21T22:35:04.258901+0000","last_fullsized":"2023-07-21T22:35:04.258901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:27:39.062885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":164,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718415+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:35:03.718415+0000","last_peered":"2023-07-21T22:35:03.718415+0000","last_clean":"2023-07-21T22:35:03.718415+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:35:03.718415+0000","last_undegraded":"2023-07-21T22:35:03.718415+0000","last_fullsized":"2023-07-21T22:35:03.718415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:25:13.479332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255303+0000","last_change":"2023-07-21T22:35:02.729668+0000","last_active":"2023-07-21T22:35:04.255303+0000","last_peered":"2023-07-21T22:35:04.255303+0000","last_clean":"2023-07-21T22:35:04.255303+0000","last_became_active":"2023-07-21T22:35:02.729355+0000","last_became_peered":"2023-07-21T22:35:02.729355+0000","last_unstale":"2023-07-21T22:35:04.255303+0000","last_undegraded":"2023-07-21T22:35:04.255303+0000","last_fullsized":"2023-07-21T22:35:04.255303+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:01.868048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.753687+0000","last_change":"2023-07-21T22:35:01.728192+0000","last_active":"2023-07-21T22:35:03.753687+0000","last_peered":"2023-07-21T22:35:03.753687+0000","last_clean":"2023-07-21T22:35:03.753687+0000","last_became_active":"2023-07-21T22:35:01.727821+0000","last_became_peered":"2023-07-21T22:35:01.727821+0000","last_unstale":"2023-07-21T22:35:03.753687+0000","last_undegraded":"2023-07-21T22:35:03.753687+0000","last_fullsized":"2023-07-21T22:35:03.753687+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:57:53.384523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":155,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.258765+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:35:04.258765+0000","last_peered":"2023-07-21T22:35:04.258765+0000","last_clean":"2023-07-21T22:35:04.258765+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:35:04.258765+0000","last_undegraded":"2023-07-21T22:35:04.258765+0000","last_fullsized":"2023-07-21T22:35:04.258765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:05:39.298897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259917+0000","last_change":"2023-07-21T22:35:02.730917+0000","last_active":"2023-07-21T22:35:04.259917+0000","last_peered":"2023-07-21T22:35:04.259917+0000","last_clean":"2023-07-21T22:35:04.259917+0000","last_became_active":"2023-07-21T22:35:02.730548+0000","last_became_peered":"2023-07-21T22:35:02.730548+0000","last_unstale":"2023-07-21T22:35:04.259917+0000","last_undegraded":"2023-07-21T22:35:04.259917+0000","last_fullsized":"2023-07-21T22:35:04.259917+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:46:03.816997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.753636+0000","last_change":"2023-07-21T22:35:01.727413+0000","last_active":"2023-07-21T22:35:03.753636+0000","last_peered":"2023-07-21T22:35:03.753636+0000","last_clean":"2023-07-21T22:35:03.753636+0000","last_became_active":"2023-07-21T22:35:01.727047+0000","last_became_peered":"2023-07-21T22:35:01.727047+0000","last_unstale":"2023-07-21T22:35:03.753636+0000","last_undegraded":"2023-07-21T22:35:03.753636+0000","last_fullsized":"2023-07-21T22:35:03.753636+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:01:13.260563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":150,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254350+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:35:04.254350+0000","last_peered":"2023-07-21T22:35:04.254350+0000","last_clean":"2023-07-21T22:35:04.254350+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:35:04.254350+0000","last_undegraded":"2023-07-21T22:35:04.254350+0000","last_fullsized":"2023-07-21T22:35:04.254350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:54:06.382354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255249+0000","last_change":"2023-07-21T22:35:02.728916+0000","last_active":"2023-07-21T22:35:04.255249+0000","last_peered":"2023-07-21T22:35:04.255249+0000","last_clean":"2023-07-21T22:35:04.255249+0000","last_became_active":"2023-07-21T22:35:02.728611+0000","last_became_peered":"2023-07-21T22:35:02.728611+0000","last_unstale":"2023-07-21T22:35:04.255249+0000","last_undegraded":"2023-07-21T22:35:04.255249+0000","last_fullsized":"2023-07-21T22:35:04.255249+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:10:02.001306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.753925+0000","last_change":"2023-07-21T22:35:01.721862+0000","last_active":"2023-07-21T22:35:03.753925+0000","last_peered":"2023-07-21T22:35:03.753925+0000","last_clean":"2023-07-21T22:35:03.753925+0000","last_became_active":"2023-07-21T22:35:01.721408+0000","last_became_peered":"2023-07-21T22:35:01.721408+0000","last_unstale":"2023-07-21T22:35:03.753925+0000","last_undegraded":"2023-07-21T22:35:03.753925+0000","last_fullsized":"2023-07-21T22:35:03.753925+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:35:02.657021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":164,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718420+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:35:03.718420+0000","last_peered":"2023-07-21T22:35:03.718420+0000","last_clean":"2023-07-21T22:35:03.718420+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:35:03.718420+0000","last_undegraded":"2023-07-21T22:35:03.718420+0000","last_fullsized":"2023-07-21T22:35:03.718420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:03:35.895122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.255408+0000","last_change":"2023-07-21T22:35:02.730067+0000","last_active":"2023-07-21T22:35:04.255408+0000","last_peered":"2023-07-21T22:35:04.255408+0000","last_clean":"2023-07-21T22:35:04.255408+0000","last_became_active":"2023-07-21T22:35:02.729770+0000","last_became_peered":"2023-07-21T22:35:02.729770+0000","last_unstale":"2023-07-21T22:35:04.255408+0000","last_undegraded":"2023-07-21T22:35:04.255408+0000","last_fullsized":"2023-07-21T22:35:04.255408+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:18.203921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254802+0000","last_change":"2023-07-21T22:35:01.716440+0000","last_active":"2023-07-21T22:35:04.254802+0000","last_peered":"2023-07-21T22:35:04.254802+0000","last_clean":"2023-07-21T22:35:04.254802+0000","last_became_active":"2023-07-21T22:35:01.715933+0000","last_became_peered":"2023-07-21T22:35:01.715933+0000","last_unstale":"2023-07-21T22:35:04.254802+0000","last_undegraded":"2023-07-21T22:35:04.254802+0000","last_fullsized":"2023-07-21T22:35:04.254802+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:45:33.466783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":156,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.709445+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:35:03.709445+0000","last_peered":"2023-07-21T22:35:03.709445+0000","last_clean":"2023-07-21T22:35:03.709445+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:35:03.709445+0000","last_undegraded":"2023-07-21T22:35:03.709445+0000","last_fullsized":"2023-07-21T22:35:03.709445+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:28:13.915208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.753949+0000","last_change":"2023-07-21T22:35:02.738338+0000","last_active":"2023-07-21T22:35:03.753949+0000","last_peered":"2023-07-21T22:35:03.753949+0000","last_clean":"2023-07-21T22:35:03.753949+0000","last_became_active":"2023-07-21T22:35:02.738059+0000","last_became_peered":"2023-07-21T22:35:02.738059+0000","last_unstale":"2023-07-21T22:35:03.753949+0000","last_undegraded":"2023-07-21T22:35:03.753949+0000","last_fullsized":"2023-07-21T22:35:03.753949+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:56:37.415624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.709107+0000","last_change":"2023-07-21T22:35:01.725616+0000","last_active":"2023-07-21T22:35:03.709107+0000","last_peered":"2023-07-21T22:35:03.709107+0000","last_clean":"2023-07-21T22:35:03.709107+0000","last_became_active":"2023-07-21T22:35:01.725346+0000","last_became_peered":"2023-07-21T22:35:01.725346+0000","last_unstale":"2023-07-21T22:35:03.709107+0000","last_undegraded":"2023-07-21T22:35:03.709107+0000","last_fullsized":"2023-07-21T22:35:03.709107+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:22:40.526144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259290+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:35:04.259290+0000","last_peered":"2023-07-21T22:35:04.259290+0000","last_clean":"2023-07-21T22:35:04.259290+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:35:04.259290+0000","last_undegraded":"2023-07-21T22:35:04.259290+0000","last_fullsized":"2023-07-21T22:35:04.259290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:59:54.904363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.753641+0000","last_change":"2023-07-21T22:35:02.729764+0000","last_active":"2023-07-21T22:35:03.753641+0000","last_peered":"2023-07-21T22:35:03.753641+0000","last_clean":"2023-07-21T22:35:03.753641+0000","last_became_active":"2023-07-21T22:35:02.729430+0000","last_became_peered":"2023-07-21T22:35:02.729430+0000","last_unstale":"2023-07-21T22:35:03.753641+0000","last_undegraded":"2023-07-21T22:35:03.753641+0000","last_fullsized":"2023-07-21T22:35:03.753641+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:59:13.166385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"97'1","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259728+0000","last_change":"2023-07-21T22:35:01.727961+0000","last_active":"2023-07-21T22:35:04.259728+0000","last_peered":"2023-07-21T22:35:04.259728+0000","last_clean":"2023-07-21T22:35:04.259728+0000","last_became_active":"2023-07-21T22:35:01.727557+0000","last_became_peered":"2023-07-21T22:35:01.727557+0000","last_unstale":"2023-07-21T22:35:04.259728+0000","last_undegraded":"2023-07-21T22:35:04.259728+0000","last_fullsized":"2023-07-21T22:35:04.259728+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:23:38.002856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":156,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.709404+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:35:03.709404+0000","last_peered":"2023-07-21T22:35:03.709404+0000","last_clean":"2023-07-21T22:35:03.709404+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:35:03.709404+0000","last_undegraded":"2023-07-21T22:35:03.709404+0000","last_fullsized":"2023-07-21T22:35:03.709404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:11:40.031850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.254209+0000","last_change":"2023-07-21T22:35:02.729048+0000","last_active":"2023-07-21T22:35:04.254209+0000","last_peered":"2023-07-21T22:35:04.254209+0000","last_clean":"2023-07-21T22:35:04.254209+0000","last_became_active":"2023-07-21T22:35:02.728745+0000","last_became_peered":"2023-07-21T22:35:02.728745+0000","last_unstale":"2023-07-21T22:35:04.254209+0000","last_undegraded":"2023-07-21T22:35:04.254209+0000","last_fullsized":"2023-07-21T22:35:04.254209+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:01.690272+0000","last_clean_scrub_stamp":"2023-07-21T22:35:01.690272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:38:11.768348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"97'2","reported_seq":15,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:03.718086+0000","last_change":"2023-07-21T22:35:01.725476+0000","last_active":"2023-07-21T22:35:03.718086+0000","last_peered":"2023-07-21T22:35:03.718086+0000","last_clean":"2023-07-21T22:35:03.718086+0000","last_became_active":"2023-07-21T22:35:01.725132+0000","last_became_peered":"2023-07-21T22:35:01.725132+0000","last_unstale":"2023-07-21T22:35:03.718086+0000","last_undegraded":"2023-07-21T22:35:03.718086+0000","last_fullsized":"2023-07-21T22:35:03.718086+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:00.680383+0000","last_clean_scrub_stamp":"2023-07-21T22:35:00.680383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:01:48.151551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":148,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-07-21T22:35:04.259983+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:35:04.259983+0000","last_peered":"2023-07-21T22:35:04.259983+0000","last_clean":"2023-07-21T22:35:04.259983+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:35:04.259983+0000","last_undegraded":"2023-07-21T22:35:04.259983+0000","last_fullsized":"2023-07-21T22:35:04.259983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:40:51.495007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509639,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59032,"kb_used_data":1744,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312808,"statfs":{"total":96636764160,"available":96576315392,"internally_reserved":0,"allocated":1785856,"data_stored":1181415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73299999999999998,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.35299999999999998,"15min":0.32600000000000001},"max":{"1min":1.1180000000000001,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.36099999999999999},"max":{"1min":0.90900000000000003,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.68000000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.432,"15min":0.379},"max":{"1min":1.0509999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.41899999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72399999999999998,"15min":0.74299999999999999},"min":{"1min":0.51300000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.405},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72899999999999998,"15min":0.752},"min":{"1min":0.47999999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95699999999999996,"5min":1.409,"15min":1.409},"last":0.58099999999999996}]},{"osd":3,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.504,"15min":0.42099999999999999},"max":{"1min":1.1539999999999999,"5min":1.46,"15min":1.46},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.02,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63400000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55400000000000005,"15min":0.55900000000000005},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.89900000000000002,"5min":0.90500000000000003,"15min":0.94999999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90400000000000003,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.77700000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64500000000000002,"15min":0.61799999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.56499999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.052,"5min":1.506,"15min":1.506},"last":0.751}]},{"osd":6,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.048},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.434,"15min":0.42599999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.61499999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542345,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1200128,"data_stored":592589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.73599999999999999,"15min":0.76100000000000001},"min":{"1min":0.495,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.97599999999999998,"5min":1.016,"15min":1.016},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77700000000000002,"15min":0.79300000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.437},"max":{"1min":0.94699999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.745}]},{"osd":1,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.41999999999999998},"max":{"1min":0.90500000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.94599999999999995,"5min":0.99399999999999999,"15min":1.117},"last":0.47799999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.72999999999999998,"15min":0.75},"min":{"1min":0.499,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.96299999999999997,"5min":0.98099999999999998,"15min":1.0269999999999999},"last":0.499},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.0149999999999999,"5min":1.097,"15min":1.097},"last":0.71999999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.76100000000000001},"min":{"1min":0.57899999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92800000000000005,"5min":1.048,"15min":1.048},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72499999999999998,"15min":0.74099999999999999},"min":{"1min":0.505,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88600000000000001,"5min":1.0049999999999999,"15min":1.054},"last":0.66200000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60299999999999998,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.374,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.441,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.048},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89600000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.91900000000000004,"5min":0.98799999999999999,"15min":1.054},"last":0.77300000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68500000000000005,"15min":0.67700000000000005},"min":{"1min":0.498,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":0.95699999999999996,"5min":1.079,"15min":1.079},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.70099999999999996,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96499999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69799999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509638,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1191936,"data_stored":591059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.70699999999999996,"15min":0.71299999999999997},"min":{"1min":0.436,"5min":0.35699999999999998,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.70799999999999996,"15min":0.72199999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83999999999999997,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.72199999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66800000000000004,"15min":0.71099999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90600000000000003,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.71099999999999997,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77900000000000003,"5min":1.617,"15min":1.617},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.70999999999999996,"15min":0.73499999999999999},"min":{"1min":0.45100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.99399999999999999,"5min":1.0109999999999999,"15min":1.034},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.71399999999999997,"15min":0.747},"min":{"1min":0.498,"5min":0.377,"15min":0.377},"max":{"1min":0.86399999999999999,"5min":1.512,"15min":1.512},"last":0.749}]},{"osd":3,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.76100000000000001,"15min":0.78500000000000003},"min":{"1min":0.56299999999999994,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86199999999999999,"5min":1.472,"15min":1.472},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.59999999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.90800000000000003,"5min":1.556,"15min":1.556},"last":0.70799999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88900000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89200000000000002,"5min":1.012,"15min":1.038},"last":0.83399999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95499999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.622,"15min":0.60999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93799999999999994,"5min":1.02,"15min":1.02},"last":0.81100000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66100000000000003,"15min":0.65000000000000002},"min":{"1min":0.42399999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.91900000000000004,"5min":1.042,"15min":1.042},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.57899999999999996,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.64600000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509639,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1208320,"data_stored":592693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71999999999999997,"15min":0.74299999999999999},"min":{"1min":0.51200000000000001,"5min":0.438,"15min":0.40000000000000002},"max":{"1min":0.80900000000000005,"5min":0.99399999999999999,"15min":1.0429999999999999},"last":0.748},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73299999999999998,"15min":0.74299999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.83599999999999997,"5min":0.96099999999999997,"15min":0.97599999999999998},"last":0.70299999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.39400000000000002},"max":{"1min":0.85499999999999998,"5min":1.002,"15min":1.0449999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.69399999999999995,"15min":0.69999999999999996},"min":{"1min":0.47299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.872,"5min":0.94299999999999995,"15min":1.016},"last":0.51700000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.51200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.95899999999999996,"5min":1.048,"15min":1.048},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.53000000000000003,"5min":0.41999999999999998,"15min":0.33000000000000002},"max":{"1min":1.006,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72899999999999998,"15min":0.73699999999999999},"min":{"1min":0.51000000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94099999999999995,"5min":0.97999999999999998,"15min":1.026},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58399999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.72899999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.45100000000000001,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98899999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.38500000000000001},"max":{"1min":0.94699999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.57099999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.83199999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64400000000000002,"15min":0.65100000000000002},"min":{"1min":0.45500000000000002,"5min":0.39900000000000002,"15min":0.374},"max":{"1min":0.92100000000000004,"5min":1.0069999999999999,"15min":1.0429999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.135},"last":0.78000000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509638,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32212,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339628,"statfs":{"total":96636764160,"available":96603779072,"internally_reserved":0,"allocated":1191936,"data_stored":591607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.48799999999999999,"15min":0.48099999999999998},"min":{"1min":0.35099999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.70499999999999996,"5min":0.73099999999999998,"15min":0.76400000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.42999999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.439}]},{"osd":1,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.30099999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.871},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.34300000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.94199999999999995},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.45700000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82899999999999996,"5min":1.0449999999999999,"15min":1.1140000000000001},"last":0.379},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.45500000000000002,"5min":0.45100000000000001,"15min":0.40999999999999998},"max":{"1min":0.84399999999999997,"5min":0.95399999999999996,"15min":0.99199999999999999},"last":0.50600000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.57599999999999996,"5min":0.48299999999999998,"15min":0.438},"max":{"1min":1.093,"5min":1.093,"15min":1.3240000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82199999999999995,"15min":0.83299999999999996},"min":{"1min":0.68799999999999994,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.488},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77300000000000002,"15min":0.77900000000000003},"min":{"1min":0.60699999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0669999999999999,"5min":1.137,"15min":1.1919999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.60399999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98999999999999999,"5min":1.0649999999999999,"15min":1.302},"last":0.75600000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79200000000000004,"15min":0.80100000000000005},"min":{"1min":0.68000000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.02,"5min":1.056,"15min":1.3979999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76500000000000001,"15min":0.78000000000000003},"min":{"1min":0.56899999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0269999999999999,"5min":1.1120000000000001,"15min":1.3899999999999999},"last":0.72699999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:34:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.81000000000000005,"15min":0.83099999999999996},"min":{"1min":0.61399999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0089999999999999,"5min":1.087,"15min":1.335},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.873,"5min":0.83699999999999997,"15min":0.83499999999999996},"min":{"1min":0.66100000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.2130000000000001},"last":0.77700000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509640,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54364,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317476,"statfs":{"total":96636764160,"available":96581095424,"internally_reserved":0,"allocated":1200128,"data_stored":591767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.29099999999999998,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.69399999999999995,"5min":0.81200000000000006,"15min":0.94199999999999995},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53600000000000003,"15min":0.54900000000000004},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.88300000000000001,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.54300000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.28199999999999997},"max":{"1min":0.82999999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.46400000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80700000000000005,"5min":1.085,"15min":1.085},"last":0.59199999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.46899999999999997,"15min":0.47999999999999998},"min":{"1min":0.37,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55300000000000005,"15min":0.56899999999999995},"min":{"1min":0.43099999999999999,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":0.76800000000000002,"5min":1.161,"15min":1.161},"last":0.52600000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.67600000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.1579999999999999,"5min":1.2569999999999999,"15min":1.6870000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.79400000000000004,"15min":0.80200000000000005},"min":{"1min":0.57699999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.175,"5min":1.1950000000000001,"15min":1.2689999999999999},"last":0.68500000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.63200000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.2549999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.60599999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.107,"5min":1.206,"15min":1.3089999999999999},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.78600000000000003,"15min":0.79800000000000004},"min":{"1min":0.69399999999999995,"5min":0.45500000000000002,"15min":0.40300000000000002},"max":{"1min":1.089,"5min":1.282,"15min":1.3759999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.64300000000000002,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.1339999999999999,"5min":1.23,"15min":1.2649999999999999},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:34:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.80900000000000005,"15min":0.82899999999999996},"min":{"1min":0.64900000000000002,"5min":0.51100000000000001,"15min":0.49099999999999999},"max":{"1min":1.143,"5min":1.2,"15min":1.2909999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.60999999999999999,"5min":0.44900000000000001,"15min":0.44700000000000001},"max":{"1min":1.091,"5min":1.216,"15min":1.3660000000000001},"last":0.755}]}]},{"osd":1,"up_from":15,"seq":64424509639,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1196032,"data_stored":591137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.28299999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53500000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.373},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.626,"5min":0.872,"15min":0.872},"last":0.52600000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.5,"15min":0.50700000000000001},"min":{"1min":0.33700000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63200000000000001,"5min":0.76100000000000001,"15min":0.81000000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.29099999999999998},"max":{"1min":0.78900000000000003,"5min":0.83599999999999997,"15min":0.88800000000000001},"last":0.40600000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.57599999999999996,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35799999999999998,"15min":0.33400000000000002},"max":{"1min":0.70799999999999996,"5min":0.84299999999999997,"15min":0.98899999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.505,"15min":0.51700000000000002},"min":{"1min":0.33100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.64200000000000002,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.42599999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.748,"15min":0.77000000000000002},"min":{"1min":0.53100000000000003,"5min":0.432,"15min":0.432},"max":{"1min":0.91400000000000003,"5min":1.0860000000000001,"15min":1.234},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.749,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.57499999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.014,"5min":1.083,"15min":1.155},"last":0.79900000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75600000000000001,"15min":0.77800000000000002},"min":{"1min":0.53500000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92500000000000004,"5min":1.0609999999999999,"15min":1.1919999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78500000000000003,"15min":0.80000000000000004},"min":{"1min":0.55200000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.044,"5min":1.121,"15min":1.2849999999999999},"last":0.86399999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78600000000000003,"15min":0.81000000000000005},"min":{"1min":0.57199999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0229999999999999,"5min":1.0580000000000001,"15min":1.23},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76300000000000001,"15min":0.79000000000000004},"min":{"1min":0.50900000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0449999999999999,"5min":1.1020000000000001,"15min":1.3240000000000001},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78600000000000003,"15min":0.80900000000000005},"min":{"1min":0.58599999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.99299999999999999,"5min":1.103,"15min":1.3149999999999999},"last":0.877},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79000000000000004,"15min":0.80800000000000005},"min":{"1min":0.55500000000000005,"5min":0.52600000000000002,"15min":0.45700000000000002},"max":{"1min":0.97499999999999998,"5min":1.115,"15min":1.3380000000000001},"last":0.76100000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509641,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36884,"kb_used_data":1740,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334956,"statfs":{"total":96636764160,"available":96598994944,"internally_reserved":0,"allocated":1781760,"data_stored":1181393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.47499999999999998},"min":{"1min":0.32900000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.50800000000000001},"min":{"1min":0.35899999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.67900000000000005,"5min":0.77800000000000002,"15min":0.83199999999999996},"last":0.44900000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70999999999999996,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51800000000000002,"15min":0.51600000000000001},"min":{"1min":0.44,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58199999999999996,"5min":0.871,"15min":0.871},"last":0.372}]},{"osd":3,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59199999999999997,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.35899999999999999,"15min":0.34899999999999998},"max":{"1min":0.76500000000000001,"5min":0.88100000000000001,"15min":0.91300000000000003},"last":0.502},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55600000000000005,"15min":0.55300000000000005},"min":{"1min":0.434,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73999999999999999,"5min":1.038,"15min":1.038},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.76100000000000001,"15min":0.78100000000000003},"min":{"1min":0.59299999999999997,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.321},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.79600000000000004,"15min":0.80100000000000005},"min":{"1min":0.60099999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.093,"5min":1.423,"15min":1.423},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.60299999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0960000000000001,"5min":1.2669999999999999,"15min":1.28},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.78400000000000003,"15min":0.80900000000000005},"min":{"1min":0.70599999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.393},"last":0.58799999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.78500000000000003,"15min":0.81299999999999994},"min":{"1min":0.61799999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.28},"last":0.624},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81399999999999995,"15min":0.81999999999999995},"min":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.131,"5min":1.333,"15min":1.333},"last":0.67400000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:34:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78900000000000003,"15min":0.79700000000000004},"min":{"1min":0.65900000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.2310000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.80900000000000005,"15min":0.83399999999999996},"min":{"1min":0.60599999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1930000000000001,"5min":1.296,"15min":1.369},"last":0.53500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:35:11.855 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T22:35:11.856 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-21T22:35:12.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.990+0000 7f5240493640 1 Processor -- start 2023-07-21T22:35:12.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.990+0000 7f5240493640 1 -- start start 2023-07-21T22:35:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.990+0000 7f5240493640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f52380d29f0 0x7f5238166980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.990+0000 7f5240493640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52380d0aa0 con 0x7f523815bec0 2023-07-21T22:35:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.990+0000 7f5240493640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52380d07c0 con 0x7f52380d0250 2023-07-21T22:35:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.990+0000 7f5240493640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52380b1dc0 con 0x7f52380d29f0 2023-07-21T22:35:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.990+0000 7f523e22f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f523815bec0 0x7f52380cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52728/0 (socket says 172.21.15.6:52728) 2023-07-21T22:35:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.990+0000 7f523e22f640 1 -- 172.21.15.6:0/563452587 learned_addr learned my addr 172.21.15.6:0/563452587 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:12.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.990+0000 7f523ea30640 1 --2- 172.21.15.6:0/563452587 >> v2:172.21.15.161:3300/0 conn(0x7f52380d29f0 0x7f5238166980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:12.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.990+0000 7f523d22d640 1 -- 172.21.15.6:0/563452587 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131645154 0 0) 0x7f5234001120 con 0x7f523815bec0 2023-07-21T22:35:12.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.990+0000 7f523d22d640 1 -- 172.21.15.6:0/563452587 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5224003530 con 0x7f523815bec0 2023-07-21T22:35:12.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.990+0000 7f523d22d640 1 -- 172.21.15.6:0/563452587 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130570763 0 0) 0x7f52380d07c0 con 0x7f52380d0250 2023-07-21T22:35:12.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.990+0000 7f523d22d640 1 -- 172.21.15.6:0/563452587 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5234001120 con 0x7f52380d0250 2023-07-21T22:35:12.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.990+0000 7f523ea30640 1 -- 172.21.15.6:0/563452587 >> v1:172.21.15.161:6789/0 conn(0x7f52380d0250 legacy=0x7f52380d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:12.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.990+0000 7f523ea30640 1 -- 172.21.15.6:0/563452587 >> v1:172.21.15.6:6789/0 conn(0x7f523815bec0 legacy=0x7f52380cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:12.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.990+0000 7f523d22d640 1 -- 172.21.15.6:0/563452587 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 26033008 0 0) 0x7f5224003530 con 0x7f523815bec0 2023-07-21T22:35:12.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.990+0000 7f523ea30640 1 -- 172.21.15.6:0/563452587 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52380b20a0 con 0x7f52380d29f0 2023-07-21T22:35:12.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.994+0000 7f523ea30640 1 --2- 172.21.15.6:0/563452587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52380d29f0 0x7f5238166980 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5230009d90 tx=0x7f523001c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb449ba3bd7cb6b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:12.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.994+0000 7f523d22d640 1 -- 172.21.15.6:0/563452587 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5234001810 con 0x7f52380d29f0 2023-07-21T22:35:12.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.994+0000 7f523d22d640 1 -- 172.21.15.6:0/563452587 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52300a5590 con 0x7f52380d29f0 2023-07-21T22:35:12.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.994+0000 7f523d22d640 1 -- 172.21.15.6:0/563452587 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52300a5920 con 0x7f52380d29f0 2023-07-21T22:35:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.994+0000 7f5240493640 1 -- 172.21.15.6:0/563452587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52380d29f0 msgr2=0x7f5238166980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.994+0000 7f5240493640 1 --2- 172.21.15.6:0/563452587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52380d29f0 0x7f5238166980 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5230009d90 tx=0x7f523001c840 comp rx=0 tx=0).stop 2023-07-21T22:35:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.994+0000 7f5240493640 1 -- 172.21.15.6:0/563452587 shutdown_connections 2023-07-21T22:35:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.994+0000 7f5240493640 1 --2- 172.21.15.6:0/563452587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52380d29f0 0x7f5238166980 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.994+0000 7f5240493640 1 -- 172.21.15.6:0/563452587 >> 172.21.15.6:0/563452587 conn(0x7f52380659d0 msgr2=0x7f523809b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:12.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.994+0000 7f5240493640 1 -- 172.21.15.6:0/563452587 shutdown_connections 2023-07-21T22:35:12.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f5240493640 1 -- 172.21.15.6:0/563452587 wait complete. 2023-07-21T22:35:12.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f5240493640 1 Processor -- start 2023-07-21T22:35:12.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f5240493640 1 -- start start 2023-07-21T22:35:12.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f5240493640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52380d0250 0x7f52381507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:12.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f5240493640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52380d29f0 0x7f5238151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:12.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f5240493640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f523815bec0 0x7f52380b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:12.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f5240493640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523815da60 con 0x7f52380d0250 2023-07-21T22:35:12.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f5240493640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523815dd40 con 0x7f52380d29f0 2023-07-21T22:35:12.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f5240493640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523815e020 con 0x7f523815bec0 2023-07-21T22:35:12.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f523e22f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52380d0250 0x7f52381507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:12.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f523e22f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52380d0250 0x7f52381507c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39270/0 (socket says 172.21.15.6:39270) 2023-07-21T22:35:12.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f523e22f640 1 -- 172.21.15.6:0/445989743 learned_addr learned my addr 172.21.15.6:0/445989743 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:12.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f523ea30640 1 --2- 172.21.15.6:0/445989743 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f523815bec0 0x7f52380b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:12.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f523da2e640 1 --2- 172.21.15.6:0/445989743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52380d29f0 0x7f5238151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:12.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f523e22f640 1 -- 172.21.15.6:0/445989743 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f523815bec0 msgr2=0x7f52380b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:12.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f523e22f640 1 --2- 172.21.15.6:0/445989743 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f523815bec0 0x7f52380b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:12.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f523e22f640 1 -- 172.21.15.6:0/445989743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52380d29f0 msgr2=0x7f5238151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:12.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f523e22f640 1 --2- 172.21.15.6:0/445989743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52380d29f0 0x7f5238151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:12.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f523e22f640 1 -- 172.21.15.6:0/445989743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5230009a70 con 0x7f52380d0250 2023-07-21T22:35:12.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f523e22f640 1 --2- 172.21.15.6:0/445989743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52380d0250 0x7f52381507c0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f523400cad0 tx=0x7f523400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:12.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f522effd640 1 -- 172.21.15.6:0/445989743 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5234005cf0 con 0x7f52380d0250 2023-07-21T22:35:12.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f522effd640 1 -- 172.21.15.6:0/445989743 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5234005e50 con 0x7f52380d0250 2023-07-21T22:35:12.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f522effd640 1 -- 172.21.15.6:0/445989743 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52340072b0 con 0x7f52380d0250 2023-07-21T22:35:12.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:11.998+0000 7f5240493640 1 -- 172.21.15.6:0/445989743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523815e300 con 0x7f52380d0250 2023-07-21T22:35:12.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.002+0000 7f5240493640 1 -- 172.21.15.6:0/445989743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5238150d00 con 0x7f52380d0250 2023-07-21T22:35:12.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.002+0000 7f5240493640 1 -- 172.21.15.6:0/445989743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52380678d0 con 0x7f52380d0250 2023-07-21T22:35:12.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.002+0000 7f522effd640 1 -- 172.21.15.6:0/445989743 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5234007410 con 0x7f52380d0250 2023-07-21T22:35:12.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.002+0000 7f522effd640 1 --2- 172.21.15.6:0/445989743 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f521c0663a0 0x7f521c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:12.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.002+0000 7f522effd640 1 -- 172.21.15.6:0/445989743 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f5234083bf0 con 0x7f52380d0250 2023-07-21T22:35:12.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.002+0000 7f523da2e640 1 --2- 172.21.15.6:0/445989743 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f521c0663a0 0x7f521c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:12.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.006+0000 7f523da2e640 1 --2- 172.21.15.6:0/445989743 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f521c0663a0 0x7f521c068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f52381f7580 tx=0x7f5228009040 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:12.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.006+0000 7f522effd640 1 -- 172.21.15.6:0/445989743 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5234050f30 con 0x7f52380d0250 2023-07-21T22:35:12.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.214+0000 7f5240493640 1 -- 172.21.15.6:0/445989743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f52380d0aa0 con 0x7f52380d0250 2023-07-21T22:35:12.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.222+0000 7f522effd640 1 -- 172.21.15.6:0/445989743 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7f52380d0aa0 con 0x7f52380d0250 2023-07-21T22:35:12.272 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-07-21T22:35:12.272 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA== 2023-07-21T22:35:12.272 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2023-07-21T22:35:12.272 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2023-07-21T22:35:12.272 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-21T22:35:12.272 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-07-21T22:35:12.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.222+0000 7f5240493640 1 -- 172.21.15.6:0/445989743 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f521c0663a0 msgr2=0x7f521c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:12.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.222+0000 7f5240493640 1 --2- 172.21.15.6:0/445989743 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f521c0663a0 0x7f521c068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f52381f7580 tx=0x7f5228009040 comp rx=0 tx=0).stop 2023-07-21T22:35:12.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.222+0000 7f5240493640 1 -- 172.21.15.6:0/445989743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52380d0250 msgr2=0x7f52381507c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:12.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.222+0000 7f5240493640 1 --2- 172.21.15.6:0/445989743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52380d0250 0x7f52381507c0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f523400cad0 tx=0x7f523400cf90 comp rx=0 tx=0).stop 2023-07-21T22:35:12.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.222+0000 7f5240493640 1 -- 172.21.15.6:0/445989743 shutdown_connections 2023-07-21T22:35:12.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.222+0000 7f5240493640 1 --2- 172.21.15.6:0/445989743 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f521c0663a0 0x7f521c068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:12.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.222+0000 7f5240493640 1 --2- 172.21.15.6:0/445989743 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f523815bec0 0x7f52380b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:12.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.222+0000 7f5240493640 1 --2- 172.21.15.6:0/445989743 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52380d29f0 0x7f5238151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:12.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.222+0000 7f5240493640 1 --2- 172.21.15.6:0/445989743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52380d0250 0x7f52381507c0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:12.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.222+0000 7f5240493640 1 -- 172.21.15.6:0/445989743 >> 172.21.15.6:0/445989743 conn(0x7f52380659d0 msgr2=0x7f523815ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:12.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.222+0000 7f5240493640 1 -- 172.21.15.6:0/445989743 shutdown_connections 2023-07-21T22:35:12.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.222+0000 7f5240493640 1 -- 172.21.15.6:0/445989743 wait complete. 2023-07-21T22:35:12.292 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:35:12.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d1eb00640 1 Processor -- start 2023-07-21T22:35:12.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d1eb00640 1 -- start start 2023-07-21T22:35:12.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d1eb00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7d180d1850 0x7f7d180d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:12.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d1eb00640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d180ccaf0 con 0x7f7d1815fd60 2023-07-21T22:35:12.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d1eb00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d18160320 con 0x7f7d180b7c70 2023-07-21T22:35:12.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d1eb00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d180d1190 con 0x7f7d180d1850 2023-07-21T22:35:12.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d17fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7d1815fd60 0x7f7d180d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52734/0 (socket says 172.21.15.6:52734) 2023-07-21T22:35:12.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d17fff640 1 -- 172.21.15.6:0/1702629952 learned_addr learned my addr 172.21.15.6:0/1702629952 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:12.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d1d09d640 1 --2- 172.21.15.6:0/1702629952 >> v2:172.21.15.161:3300/0 conn(0x7f7d180d1850 0x7f7d180d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:12.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d177fe640 1 -- 172.21.15.6:0/1702629952 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879963615 0 0) 0x7f7d180ccaf0 con 0x7f7d1815fd60 2023-07-21T22:35:12.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d177fe640 1 -- 172.21.15.6:0/1702629952 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d08003530 con 0x7f7d1815fd60 2023-07-21T22:35:12.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d177fe640 1 -- 172.21.15.6:0/1702629952 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2100802228 0 0) 0x7f7d08003530 con 0x7f7d1815fd60 2023-07-21T22:35:12.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d177fe640 1 -- 172.21.15.6:0/1702629952 >> v2:172.21.15.161:3300/0 conn(0x7f7d180d1850 msgr2=0x7f7d180d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:12.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d177fe640 1 --2- 172.21.15.6:0/1702629952 >> v2:172.21.15.161:3300/0 conn(0x7f7d180d1850 0x7f7d180d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:12.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d177fe640 1 -- 172.21.15.6:0/1702629952 >> v1:172.21.15.161:6789/0 conn(0x7f7d180b7c70 legacy=0x7f7d1815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:12.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d177fe640 1 -- 172.21.15.6:0/1702629952 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d180ccd90 con 0x7f7d1815fd60 2023-07-21T22:35:12.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d177fe640 1 -- 172.21.15.6:0/1702629952 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f7d04001680 con 0x7f7d1815fd60 2023-07-21T22:35:12.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d177fe640 1 -- 172.21.15.6:0/1702629952 >> v1:172.21.15.6:6789/0 conn(0x7f7d1815fd60 legacy=0x7f7d180d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:12.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d177fe640 1 --2- 172.21.15.6:0/1702629952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7d08003980 0x7f7d08003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:12.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d177fe640 1 --2- 172.21.15.6:0/1702629952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d08004370 0x7f7d08004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:12.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d177fe640 1 --2- 172.21.15.6:0/1702629952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d08005030 0x7f7d0800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:12.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d177fe640 1 -- 172.21.15.6:0/1702629952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0800bf80 con 0x7f7d08005030 2023-07-21T22:35:12.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d177fe640 1 -- 172.21.15.6:0/1702629952 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0800c0c0 con 0x7f7d08004370 2023-07-21T22:35:12.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d177fe640 1 -- 172.21.15.6:0/1702629952 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0800c280 con 0x7f7d08003980 2023-07-21T22:35:12.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d1d09d640 1 --2- 172.21.15.6:0/1702629952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d08005030 0x7f7d0800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:12.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d1c89c640 1 --2- 172.21.15.6:0/1702629952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7d08003980 0x7f7d08003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:12.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d17fff640 1 --2- 172.21.15.6:0/1702629952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d08004370 0x7f7d08004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:12.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d1d09d640 1 -- 172.21.15.6:0/1702629952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7d08003980 msgr2=0x7f7d08003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:12.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d1d09d640 1 --2- 172.21.15.6:0/1702629952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7d08003980 0x7f7d08003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:12.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d1d09d640 1 -- 172.21.15.6:0/1702629952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d08004370 msgr2=0x7f7d08004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:12.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d1d09d640 1 --2- 172.21.15.6:0/1702629952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d08004370 0x7f7d08004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:12.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.386+0000 7f7d1d09d640 1 -- 172.21.15.6:0/1702629952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d08003530 con 0x7f7d08005030 2023-07-21T22:35:12.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.390+0000 7f7d1d09d640 1 -- 172.21.15.6:0/1702629952 reap_dead start 2023-07-21T22:35:12.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.390+0000 7f7d1d09d640 1 --2- 172.21.15.6:0/1702629952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d08005030 0x7f7d0800b990 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009fc0 tx=0x7f7d1001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf09d325e01ec8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:12.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.390+0000 7f7d177fe640 1 -- 172.21.15.6:0/1702629952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10003ba0 con 0x7f7d08005030 2023-07-21T22:35:12.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.390+0000 7f7d177fe640 1 -- 172.21.15.6:0/1702629952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1000f040 con 0x7f7d08005030 2023-07-21T22:35:12.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.390+0000 7f7d177fe640 1 -- 172.21.15.6:0/1702629952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d100a59a0 con 0x7f7d08005030 2023-07-21T22:35:12.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.390+0000 7f7d1eb00640 1 -- 172.21.15.6:0/1702629952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d08005030 msgr2=0x7f7d0800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:12.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.390+0000 7f7d1eb00640 1 --2- 172.21.15.6:0/1702629952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d08005030 0x7f7d0800b990 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009fc0 tx=0x7f7d1001cca0 comp rx=0 tx=0).stop 2023-07-21T22:35:12.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.390+0000 7f7d1eb00640 1 -- 172.21.15.6:0/1702629952 shutdown_connections 2023-07-21T22:35:12.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.390+0000 7f7d1eb00640 1 --2- 172.21.15.6:0/1702629952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d08005030 0x7f7d0800b990 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:12.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.390+0000 7f7d1eb00640 1 -- 172.21.15.6:0/1702629952 >> 172.21.15.6:0/1702629952 conn(0x7f7d180650b0 msgr2=0x7f7d180654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:12.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.390+0000 7f7d1eb00640 1 -- 172.21.15.6:0/1702629952 shutdown_connections 2023-07-21T22:35:12.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.390+0000 7f7d1eb00640 1 -- 172.21.15.6:0/1702629952 wait complete. 2023-07-21T22:35:12.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d1eb00640 1 Processor -- start 2023-07-21T22:35:12.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d1eb00640 1 -- start start 2023-07-21T22:35:12.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d1eb00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d08005030 0x7f7d180c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:12.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d1eb00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d180c6370 0x7f7d181442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:12.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d1eb00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7d18144830 0x7f7d181f0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:12.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d1eb00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d18158ea0 con 0x7f7d180c6370 2023-07-21T22:35:12.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d1eb00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d18158290 con 0x7f7d08005030 2023-07-21T22:35:12.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d1eb00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d18158570 con 0x7f7d18144830 2023-07-21T22:35:12.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d17fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d180c6370 0x7f7d181442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:12.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d17fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d180c6370 0x7f7d181442f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39296/0 (socket says 172.21.15.6:39296) 2023-07-21T22:35:12.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d17fff640 1 -- 172.21.15.6:0/1869912208 learned_addr learned my addr 172.21.15.6:0/1869912208 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:12.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d1d09d640 1 --2- 172.21.15.6:0/1869912208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7d18144830 0x7f7d181f0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:12.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d1c89c640 1 --2- 172.21.15.6:0/1869912208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d08005030 0x7f7d180c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:12.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d17fff640 1 -- 172.21.15.6:0/1869912208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7d18144830 msgr2=0x7f7d181f0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:12.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d17fff640 1 --2- 172.21.15.6:0/1869912208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7d18144830 0x7f7d181f0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:12.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d17fff640 1 -- 172.21.15.6:0/1869912208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d08005030 msgr2=0x7f7d180c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:12.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d17fff640 1 --2- 172.21.15.6:0/1869912208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d08005030 0x7f7d180c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:12.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d17fff640 1 -- 172.21.15.6:0/1869912208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d18158850 con 0x7f7d180c6370 2023-07-21T22:35:12.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d1c89c640 1 --2- 172.21.15.6:0/1869912208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d08005030 0x7f7d180c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:12.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d17fff640 1 --2- 172.21.15.6:0/1869912208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d180c6370 0x7f7d181442f0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f7d04011810 tx=0x7f7d04011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:12.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d157fa640 1 -- 172.21.15.6:0/1869912208 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0400fb00 con 0x7f7d180c6370 2023-07-21T22:35:12.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d157fa640 1 -- 172.21.15.6:0/1869912208 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d0400fc60 con 0x7f7d180c6370 2023-07-21T22:35:12.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d1eb00640 1 -- 172.21.15.6:0/1869912208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d18158b30 con 0x7f7d180c6370 2023-07-21T22:35:12.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d157fa640 1 -- 172.21.15.6:0/1869912208 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d04015410 con 0x7f7d180c6370 2023-07-21T22:35:12.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.394+0000 7f7d1eb00640 1 -- 172.21.15.6:0/1869912208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d181f0a80 con 0x7f7d180c6370 2023-07-21T22:35:12.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.398+0000 7f7d1eb00640 1 -- 172.21.15.6:0/1869912208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d18144c00 con 0x7f7d180c6370 2023-07-21T22:35:12.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.398+0000 7f7d157fa640 1 -- 172.21.15.6:0/1869912208 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7d04015570 con 0x7f7d180c6370 2023-07-21T22:35:12.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.398+0000 7f7d157fa640 1 --2- 172.21.15.6:0/1869912208 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f7cfc0663a0 0x7f7cfc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:12.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.398+0000 7f7d157fa640 1 -- 172.21.15.6:0/1869912208 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f7d040871b0 con 0x7f7d180c6370 2023-07-21T22:35:12.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.398+0000 7f7d1c89c640 1 --2- 172.21.15.6:0/1869912208 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f7cfc0663a0 0x7f7cfc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:12.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.398+0000 7f7d1c89c640 1 --2- 172.21.15.6:0/1869912208 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f7cfc0663a0 0x7f7cfc068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7d180c9270 tx=0x7f7d0c007b60 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:12.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.402+0000 7f7d157fa640 1 -- 172.21.15.6:0/1869912208 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7d04054450 con 0x7f7d180c6370 2023-07-21T22:35:12.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.590+0000 7f7d1eb00640 1 -- 172.21.15.6:0/1869912208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d180d1280 con 0x7f7d180c6370 2023-07-21T22:35:12.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.590+0000 7f7d157fa640 1 -- 172.21.15.6:0/1869912208 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4670 (secure 0 0 0) 0x7f7d04057a70 con 0x7f7d180c6370 2023-07-21T22:35:12.641 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:12.641 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/750234701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":750234701},{"type":"v1","addr":"172.21.15.6:6835","nonce":750234701}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1418940969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1418940969},{"type":"v1","addr":"172.21.15.161:6837","nonce":1418940969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6976,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3127204881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3127204881},{"type":"v1","addr":"172.21.15.161:6836","nonce":3127204881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:35:02.102268+0000","modified":"2023-07-21T22:35:05.730598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7131},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7131":{"gid":7131,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/4157903762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4157903762},{"type":"v1","addr":"172.21.15.6:6833","nonce":4157903762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-21T22:35:12.641 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 39 2023-07-21T22:35:12.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.590+0000 7f7d1eb00640 1 -- 172.21.15.6:0/1869912208 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f7cfc0663a0 msgr2=0x7f7cfc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.590+0000 7f7d1eb00640 1 --2- 172.21.15.6:0/1869912208 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f7cfc0663a0 0x7f7cfc068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7d180c9270 tx=0x7f7d0c007b60 comp rx=0 tx=0).stop 2023-07-21T22:35:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.590+0000 7f7d1eb00640 1 -- 172.21.15.6:0/1869912208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d180c6370 msgr2=0x7f7d181442f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.590+0000 7f7d1eb00640 1 --2- 172.21.15.6:0/1869912208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d180c6370 0x7f7d181442f0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f7d04011810 tx=0x7f7d04011cd0 comp rx=0 tx=0).stop 2023-07-21T22:35:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.590+0000 7f7d1eb00640 1 -- 172.21.15.6:0/1869912208 shutdown_connections 2023-07-21T22:35:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.590+0000 7f7d1eb00640 1 --2- 172.21.15.6:0/1869912208 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f7cfc0663a0 0x7f7cfc068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.590+0000 7f7d1eb00640 1 --2- 172.21.15.6:0/1869912208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7d18144830 0x7f7d181f0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.590+0000 7f7d1eb00640 1 --2- 172.21.15.6:0/1869912208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d180c6370 0x7f7d181442f0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:12.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.590+0000 7f7d1eb00640 1 --2- 172.21.15.6:0/1869912208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d08005030 0x7f7d180c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:12.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.590+0000 7f7d1eb00640 1 -- 172.21.15.6:0/1869912208 >> 172.21.15.6:0/1869912208 conn(0x7f7d180650b0 msgr2=0x7f7d180d2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:12.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.590+0000 7f7d1eb00640 1 -- 172.21.15.6:0/1869912208 shutdown_connections 2023-07-21T22:35:12.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:12.590+0000 7f7d1eb00640 1 -- 172.21.15.6:0/1869912208 wait complete. 2023-07-21T22:35:13.063 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T22:35:02.102268+0000', 'modified': '2023-07-21T22:35:05.730598+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7131}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7131': {'gid': 7131, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6833/4157903762', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6832', 'nonce': 4157903762}, {'type': 'v1', 'addr': '172.21.15.6:6833', 'nonce': 4157903762}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T22:35:13.064 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T22:35:13.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-21T22:35:13.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.162+0000 7f2271711640 1 Processor -- start 2023-07-21T22:35:13.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.162+0000 7f2271711640 1 -- start start 2023-07-21T22:35:13.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.162+0000 7f2271711640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f226c15b7c0 0x7f226c06b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.162+0000 7f2271711640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f226c0cb780 0x7f226c06b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.162+0000 7f2271711640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226c06f900 con 0x7f226c06fd90 2023-07-21T22:35:13.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.162+0000 7f2271711640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226c0cdce0 con 0x7f226c0cb780 2023-07-21T22:35:13.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.162+0000 7f2271711640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226c0ca830 con 0x7f226c15b7c0 2023-07-21T22:35:13.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.162+0000 7f2263fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f226c0cb780 0x7f226c06b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.162+0000 7f2263fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f226c0cb780 0x7f226c06b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39306/0 (socket says 172.21.15.6:39306) 2023-07-21T22:35:13.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.162+0000 7f2263fff640 1 -- 172.21.15.6:0/803772690 learned_addr learned my addr 172.21.15.6:0/803772690 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.162+0000 7f226affd640 1 --2- 172.21.15.6:0/803772690 >> v2:172.21.15.161:3300/0 conn(0x7f226c15b7c0 0x7f226c06b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.162+0000 7f2263fff640 1 -- 172.21.15.6:0/803772690 >> v2:172.21.15.161:3300/0 conn(0x7f226c15b7c0 msgr2=0x7f226c06b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.162+0000 7f2263fff640 1 --2- 172.21.15.6:0/803772690 >> v2:172.21.15.161:3300/0 conn(0x7f226c15b7c0 0x7f226c06b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.162+0000 7f2263fff640 1 -- 172.21.15.6:0/803772690 >> v1:172.21.15.161:6789/0 conn(0x7f226c06fd90 legacy=0x7f226c070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:13.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.162+0000 7f2263fff640 1 -- 172.21.15.6:0/803772690 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c15bb90 con 0x7f226c0cb780 2023-07-21T22:35:13.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.166+0000 7f2263fff640 1 --2- 172.21.15.6:0/803772690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c0cb780 0x7f226c06b720 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f226c066260 tx=0x7f225401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bb7849e4c21a66 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:13.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.166+0000 7f226a7fc640 1 -- 172.21.15.6:0/803772690 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22540aa430 con 0x7f226c0cb780 2023-07-21T22:35:13.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.166+0000 7f226a7fc640 1 -- 172.21.15.6:0/803772690 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22540aa590 con 0x7f226c0cb780 2023-07-21T22:35:13.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.166+0000 7f226a7fc640 1 -- 172.21.15.6:0/803772690 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22540aa920 con 0x7f226c0cb780 2023-07-21T22:35:13.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.166+0000 7f2271711640 1 -- 172.21.15.6:0/803772690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c0cb780 msgr2=0x7f226c06b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:13.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.166+0000 7f2271711640 1 --2- 172.21.15.6:0/803772690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c0cb780 0x7f226c06b720 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f226c066260 tx=0x7f225401c4d0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.166+0000 7f2271711640 1 -- 172.21.15.6:0/803772690 shutdown_connections 2023-07-21T22:35:13.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.166+0000 7f2271711640 1 --2- 172.21.15.6:0/803772690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c0cb780 0x7f226c06b720 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.166+0000 7f2271711640 1 --2- 172.21.15.6:0/803772690 >> v2:172.21.15.161:3300/0 conn(0x7f226c15b7c0 0x7f226c06b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.166+0000 7f2271711640 1 -- 172.21.15.6:0/803772690 >> 172.21.15.6:0/803772690 conn(0x7f226c0afcf0 msgr2=0x7f226c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:13.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.166+0000 7f2271711640 1 -- 172.21.15.6:0/803772690 shutdown_connections 2023-07-21T22:35:13.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.166+0000 7f2271711640 1 -- 172.21.15.6:0/803772690 wait complete. 2023-07-21T22:35:13.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f2271711640 1 Processor -- start 2023-07-21T22:35:13.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f2271711640 1 -- start start 2023-07-21T22:35:13.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f2271711640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f226c06fd90 0x7f226c0c26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f2271711640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f226c15b7c0 0x7f226c0add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f2271711640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c0af720 0x7f226c0ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f2271711640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0c8150 con 0x7f226c0af720 2023-07-21T22:35:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f2271711640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0c2c10 con 0x7f226c06fd90 2023-07-21T22:35:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f2271711640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0c4070 con 0x7f226c15b7c0 2023-07-21T22:35:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f226b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c0af720 0x7f226c0ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f226affd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f226c06fd90 0x7f226c0c26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f226b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c0af720 0x7f226c0ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39322/0 (socket says 172.21.15.6:39322) 2023-07-21T22:35:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f226b7fe640 1 -- 172.21.15.6:0/3957737933 learned_addr learned my addr 172.21.15.6:0/3957737933 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f2263fff640 1 --2- 172.21.15.6:0/3957737933 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f226c15b7c0 0x7f226c0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f226b7fe640 1 -- 172.21.15.6:0/3957737933 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f226c15b7c0 msgr2=0x7f226c0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f226b7fe640 1 --2- 172.21.15.6:0/3957737933 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f226c15b7c0 0x7f226c0add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f226b7fe640 1 -- 172.21.15.6:0/3957737933 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f226c06fd90 msgr2=0x7f226c0c26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f226b7fe640 1 --2- 172.21.15.6:0/3957737933 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f226c06fd90 0x7f226c0c26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f226b7fe640 1 -- 172.21.15.6:0/3957737933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22540094d0 con 0x7f226c0af720 2023-07-21T22:35:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f226b7fe640 1 --2- 172.21.15.6:0/3957737933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c0af720 0x7f226c0ae2c0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f226400c7a0 tx=0x7f226400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f22637fe640 1 -- 172.21.15.6:0/3957737933 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2264003b80 con 0x7f226c0af720 2023-07-21T22:35:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f22637fe640 1 -- 172.21.15.6:0/3957737933 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2264003ce0 con 0x7f226c0af720 2023-07-21T22:35:13.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f22637fe640 1 -- 172.21.15.6:0/3957737933 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226400aa90 con 0x7f226c0af720 2023-07-21T22:35:13.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f2271711640 1 -- 172.21.15.6:0/3957737933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226c0c4310 con 0x7f226c0af720 2023-07-21T22:35:13.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.170+0000 7f2271711640 1 -- 172.21.15.6:0/3957737933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226c0c7b90 con 0x7f226c0af720 2023-07-21T22:35:13.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.174+0000 7f22637fe640 1 -- 172.21.15.6:0/3957737933 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f226400abf0 con 0x7f226c0af720 2023-07-21T22:35:13.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.174+0000 7f22637fe640 1 --2- 172.21.15.6:0/3957737933 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f224c0663a0 0x7f224c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.174+0000 7f22637fe640 1 -- 172.21.15.6:0/3957737933 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f2264083bc0 con 0x7f226c0af720 2023-07-21T22:35:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.174+0000 7f2274a71000 1 Processor -- start 2023-07-21T22:35:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f226affd640 1 --2- 172.21.15.6:0/3957737933 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f224c0663a0 0x7f224c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2274a71000 1 -- start start 2023-07-21T22:35:13.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f226affd640 1 --2- 172.21.15.6:0/3957737933 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f224c0663a0 0x7f224c068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f225c0079c0 tx=0x7f225c008040 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:13.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2274a71000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a83005ff00 0x55a8300602d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2274a71000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a830060810 0x55a830016370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2274a71000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55a8300168b0 0x55a830016c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2274a71000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82fedd880 con 0x55a83005ff00 2023-07-21T22:35:13.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2274a71000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82fe17840 con 0x55a830060810 2023-07-21T22:35:13.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2274a71000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a82fe6b2e0 con 0x55a8300168b0 2023-07-21T22:35:13.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f226affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a83005ff00 0x55a8300602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f226affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a83005ff00 0x55a8300602d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39326/0 (socket says 172.21.15.6:39326) 2023-07-21T22:35:13.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f226affd640 1 -- 172.21.15.6:0/4158468074 learned_addr learned my addr 172.21.15.6:0/4158468074 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:13.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f226b7fe640 1 --2- 172.21.15.6:0/4158468074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55a8300168b0 0x55a830016c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2263fff640 1 --2- 172.21.15.6:0/4158468074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a830060810 0x55a830016370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f226affd640 1 -- 172.21.15.6:0/4158468074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55a8300168b0 msgr2=0x55a830016c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:13.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f226affd640 1 --2- 172.21.15.6:0/4158468074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55a8300168b0 0x55a830016c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f226affd640 1 -- 172.21.15.6:0/4158468074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a830060810 msgr2=0x55a830016370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:13.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f226affd640 1 --2- 172.21.15.6:0/4158468074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a830060810 0x55a830016370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f226affd640 1 -- 172.21.15.6:0/4158468074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a82fb60890 con 0x55a83005ff00 2023-07-21T22:35:13.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f226affd640 1 --2- 172.21.15.6:0/4158468074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a83005ff00 0x55a8300602d0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f225c010ac0 tx=0x7f225c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf1f0fcb8439b06 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:13.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2260ff9640 1 -- 172.21.15.6:0/4158468074 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c016c10 con 0x55a83005ff00 2023-07-21T22:35:13.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2260ff9640 1 -- 172.21.15.6:0/4158468074 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c01a070 con 0x55a83005ff00 2023-07-21T22:35:13.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2260ff9640 1 -- 172.21.15.6:0/4158468074 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c021440 con 0x55a83005ff00 2023-07-21T22:35:13.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2274a71000 1 -- 172.21.15.6:0/4158468074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a83005ff00 msgr2=0x55a8300602d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:13.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2274a71000 1 --2- 172.21.15.6:0/4158468074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a83005ff00 0x55a8300602d0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f225c010ac0 tx=0x7f225c013000 comp rx=0 tx=0).stop 2023-07-21T22:35:13.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2274a71000 1 -- 172.21.15.6:0/4158468074 shutdown_connections 2023-07-21T22:35:13.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2274a71000 1 --2- 172.21.15.6:0/4158468074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55a8300168b0 0x55a830016c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2274a71000 1 --2- 172.21.15.6:0/4158468074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a830060810 0x55a830016370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2274a71000 1 --2- 172.21.15.6:0/4158468074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a83005ff00 0x55a8300602d0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2274a71000 1 -- 172.21.15.6:0/4158468074 >> 172.21.15.6:0/4158468074 conn(0x55a83001ca10 msgr2=0x55a830014c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:13.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2274a71000 1 -- 172.21.15.6:0/4158468074 shutdown_connections 2023-07-21T22:35:13.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2274a71000 1 -- 172.21.15.6:0/4158468074 wait complete. 2023-07-21T22:35:13.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.178+0000 7f2274a71000 1 -- start start 2023-07-21T22:35:13.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2274a71000 1 Processor -- start 2023-07-21T22:35:13.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2274a71000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8300168b0 0x55a830067030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2274a71000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55a83005ff00 0x55a830067570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2274a71000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a830060810 0x55a8300214f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2274a71000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82fe64380 con 0x55a8300168b0 2023-07-21T22:35:13.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2274a71000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82fe20ae0 con 0x55a830060810 2023-07-21T22:35:13.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2274a71000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a82fe20780 con 0x55a83005ff00 2023-07-21T22:35:13.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2274a71000 10 client.0 _ll_register_callbacks cb 0x55a830002240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:35:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f226affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8300168b0 0x55a830067030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f226affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8300168b0 0x55a830067030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39330/0 (socket says 172.21.15.6:39330) 2023-07-21T22:35:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f226affd640 1 -- 172.21.15.6:0/1199261061 learned_addr learned my addr 172.21.15.6:0/1199261061 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f226b7fe640 1 --2- 172.21.15.6:0/1199261061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a830060810 0x55a8300214f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2263fff640 1 --2- 172.21.15.6:0/1199261061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55a83005ff00 0x55a830067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f226affd640 1 -- 172.21.15.6:0/1199261061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55a83005ff00 msgr2=0x55a830067570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:13.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f226affd640 1 --2- 172.21.15.6:0/1199261061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55a83005ff00 0x55a830067570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f226affd640 1 -- 172.21.15.6:0/1199261061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a830060810 msgr2=0x55a8300214f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f226affd640 1 --2- 172.21.15.6:0/1199261061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a830060810 0x55a8300214f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f226affd640 1 -- 172.21.15.6:0/1199261061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225c00e040 con 0x55a8300168b0 2023-07-21T22:35:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f226b7fe640 1 --2- 172.21.15.6:0/1199261061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a830060810 0x55a8300214f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f226affd640 1 --2- 172.21.15.6:0/1199261061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8300168b0 0x55a830067030 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f225c0216f0 tx=0x7f225c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adafc99da8fe9f60 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:13.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2249ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:35:13.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2249ffb640 1 -- 172.21.15.6:0/1199261061 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c021ae0 con 0x55a8300168b0 2023-07-21T22:35:13.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2274a71000 1 -- 172.21.15.6:0/1199261061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a82fe2ba20 con 0x55a8300168b0 2023-07-21T22:35:13.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2249ffb640 1 -- 172.21.15.6:0/1199261061 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f225c021c40 con 0x55a8300168b0 2023-07-21T22:35:13.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2249ffb640 1 -- 172.21.15.6:0/1199261061 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f225c021e40 con 0x55a8300168b0 2023-07-21T22:35:13.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2274a71000 10 client.7293 fetch_fsmap learned FSMap version 39 2023-07-21T22:35:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2274a71000 1 -- 172.21.15.6:0/1199261061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55a82fe28d10 con 0x55a8300168b0 2023-07-21T22:35:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2249ffb640 1 -- 172.21.15.6:0/1199261061 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a82fe2ba20 con 0x55a8300168b0 2023-07-21T22:35:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2249ffb640 1 -- 172.21.15.6:0/1199261061 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 39) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f225c034460 con 0x55a8300168b0 2023-07-21T22:35:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2274a71000 10 client.7293 fetch_fsmap finished waiting for FSMap version 39 2023-07-21T22:35:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2274a71000 10 client.7293 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-21T22:35:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2274a71000 20 client.7293 populate_metadata read hostname 'smithi006' 2023-07-21T22:35:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2274a71000 1 --2- 172.21.15.6:0/1199261061 >> [v2:172.21.15.6:6832/4157903762,v1:172.21.15.6:6833/4157903762] conn(0x55a830022260 0x55a830022630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2274a71000 4 client.7293 mds_command: new command op to 7131 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:35:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2274a71000 1 -- 172.21.15.6:0/1199261061 --> [v2:172.21.15.6:6832/4157903762,v1:172.21.15.6:6833/4157903762] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a82fe92ec0 con 0x55a830022260 2023-07-21T22:35:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2263fff640 1 --2- 172.21.15.6:0/1199261061 >> [v2:172.21.15.6:6832/4157903762,v1:172.21.15.6:6833/4157903762] conn(0x55a830022260 0x55a830022630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2263fff640 1 --2- 172.21.15.6:0/1199261061 >> [v2:172.21.15.6:6832/4157903762,v1:172.21.15.6:6833/4157903762] conn(0x55a830022260 0x55a830022630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51cce96180a9b530 server_cookie=f78ea3db0d183e5f in_seq=0 out_seq=0 2023-07-21T22:35:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.182+0000 7f2249ffb640 10 client.7293 ms_handle_connect on v2:172.21.15.6:6832/4157903762 2023-07-21T22:35:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.186+0000 7f2249ffb640 1 -- 172.21.15.6:0/1199261061 <== mds.0 v2:172.21.15.6:6832/4157903762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a82fe92ec0 con 0x55a830022260 2023-07-21T22:35:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.186+0000 7f2249ffb640 10 client.7293 handle_command_reply: tid=0 2023-07-21T22:35:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.186+0000 7f2274a71000 1 client.7293 shutdown 2023-07-21T22:35:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.186+0000 7f2274a71000 1 -- 172.21.15.6:0/1199261061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8300168b0 msgr2=0x55a830067030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.186+0000 7f2274a71000 1 --2- 172.21.15.6:0/1199261061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8300168b0 0x55a830067030 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f225c0216f0 tx=0x7f225c004740 comp rx=0 tx=0).stop 2023-07-21T22:35:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.186+0000 7f2274a71000 1 -- 172.21.15.6:0/1199261061 shutdown_connections 2023-07-21T22:35:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.186+0000 7f2274a71000 1 --2- 172.21.15.6:0/1199261061 >> [v2:172.21.15.6:6832/4157903762,v1:172.21.15.6:6833/4157903762] conn(0x55a830022260 0x55a830022630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.186+0000 7f2274a71000 1 --2- 172.21.15.6:0/1199261061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a830060810 0x55a8300214f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.186+0000 7f2274a71000 1 --2- 172.21.15.6:0/1199261061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55a83005ff00 0x55a830067570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.186+0000 7f2274a71000 1 --2- 172.21.15.6:0/1199261061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8300168b0 0x55a830067030 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.186+0000 7f2249ffb640 0 client.7293 ms_handle_reset on v2:172.21.15.6:6832/4157903762 2023-07-21T22:35:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.186+0000 7f2274a71000 1 -- 172.21.15.6:0/1199261061 >> 172.21.15.6:0/1199261061 conn(0x55a83001ca10 msgr2=0x55a830015350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.186+0000 7f2274a71000 1 -- 172.21.15.6:0/1199261061 shutdown_connections 2023-07-21T22:35:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.186+0000 7f2274a71000 1 -- 172.21.15.6:0/1199261061 wait complete. 2023-07-21T22:35:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.186+0000 7f2274a71000 20 client.7293 trim_cache size 0 max 16384 2023-07-21T22:35:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f2274a71000 1 Processor -- start 2023-07-21T22:35:13.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f2274a71000 1 -- start start 2023-07-21T22:35:13.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f2274a71000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55a8300168b0 0x55a8300b98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f2274a71000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a83005ff00 0x55a8300b9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f2274a71000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a830060810 0x55a8300ba340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f2274a71000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82fb21940 con 0x55a830060810 2023-07-21T22:35:13.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f2274a71000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82fe0c450 con 0x55a83005ff00 2023-07-21T22:35:13.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f2274a71000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a83006d0b0 con 0x55a8300168b0 2023-07-21T22:35:13.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f226b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a830060810 0x55a8300ba340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f226b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a830060810 0x55a8300ba340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39342/0 (socket says 172.21.15.6:39342) 2023-07-21T22:35:13.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f226b7fe640 1 -- 172.21.15.6:0/1224051100 learned_addr learned my addr 172.21.15.6:0/1224051100 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:13.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f226affd640 1 --2- 172.21.15.6:0/1224051100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55a8300168b0 0x55a8300b98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f2263fff640 1 --2- 172.21.15.6:0/1224051100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a83005ff00 0x55a8300b9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f226b7fe640 1 -- 172.21.15.6:0/1224051100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55a8300168b0 msgr2=0x55a8300b98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:13.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f226b7fe640 1 --2- 172.21.15.6:0/1224051100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55a8300168b0 0x55a8300b98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f226b7fe640 1 -- 172.21.15.6:0/1224051100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a83005ff00 msgr2=0x55a8300b9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:13.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f226b7fe640 1 --2- 172.21.15.6:0/1224051100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a83005ff00 0x55a8300b9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f226b7fe640 1 -- 172.21.15.6:0/1224051100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a830018f80 con 0x55a830060810 2023-07-21T22:35:13.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f226b7fe640 1 --2- 172.21.15.6:0/1224051100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a830060810 0x55a8300ba340 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f226400a430 tx=0x7f226405a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3291d0a83bed4161 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:13.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f22617fa640 1 -- 172.21.15.6:0/1224051100 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2264081f50 con 0x55a830060810 2023-07-21T22:35:13.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f22617fa640 1 -- 172.21.15.6:0/1224051100 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22640820b0 con 0x55a830060810 2023-07-21T22:35:13.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f22617fa640 1 -- 172.21.15.6:0/1224051100 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226406c100 con 0x55a830060810 2023-07-21T22:35:13.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f2274a71000 1 -- 172.21.15.6:0/1224051100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a830060810 msgr2=0x55a8300ba340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:13.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f2274a71000 1 --2- 172.21.15.6:0/1224051100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a830060810 0x55a8300ba340 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f226400a430 tx=0x7f226405a040 comp rx=0 tx=0).stop 2023-07-21T22:35:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f2274a71000 1 -- 172.21.15.6:0/1224051100 shutdown_connections 2023-07-21T22:35:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f2274a71000 1 --2- 172.21.15.6:0/1224051100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a830060810 0x55a8300ba340 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f2274a71000 1 --2- 172.21.15.6:0/1224051100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a83005ff00 0x55a8300b9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f2274a71000 1 --2- 172.21.15.6:0/1224051100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55a8300168b0 0x55a8300b98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f2274a71000 1 -- 172.21.15.6:0/1224051100 >> 172.21.15.6:0/1224051100 conn(0x55a83001ca10 msgr2=0x55a83001bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f2274a71000 1 -- 172.21.15.6:0/1224051100 shutdown_connections 2023-07-21T22:35:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f2274a71000 1 -- 172.21.15.6:0/1224051100 wait complete. 2023-07-21T22:35:13.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.202+0000 7f2274a71000 1 -- start start 2023-07-21T22:35:13.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2274a71000 1 Processor -- start 2023-07-21T22:35:13.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2274a71000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55a8300168b0 0x55a8300643c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2274a71000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a83005ff00 0x55a830064900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2274a71000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a830060810 0x55a830064e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2274a71000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a83006dab0 con 0x55a83005ff00 2023-07-21T22:35:13.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2274a71000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8300163d0 con 0x55a830060810 2023-07-21T22:35:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2274a71000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a830066b00 con 0x55a8300168b0 2023-07-21T22:35:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2274a71000 10 client.0 _ll_register_callbacks cb 0x55a82ffe2430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:35:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2263fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a83005ff00 0x55a830064900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2263fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a83005ff00 0x55a830064900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39350/0 (socket says 172.21.15.6:39350) 2023-07-21T22:35:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2263fff640 1 -- 172.21.15.6:0/569196788 learned_addr learned my addr 172.21.15.6:0/569196788 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f226affd640 1 --2- 172.21.15.6:0/569196788 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55a8300168b0 0x55a8300643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f226b7fe640 1 --2- 172.21.15.6:0/569196788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a830060810 0x55a830064e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2263fff640 1 -- 172.21.15.6:0/569196788 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55a8300168b0 msgr2=0x55a8300643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2263fff640 1 --2- 172.21.15.6:0/569196788 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55a8300168b0 0x55a8300643c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2263fff640 1 -- 172.21.15.6:0/569196788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a830060810 msgr2=0x55a830064e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2263fff640 1 --2- 172.21.15.6:0/569196788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a830060810 0x55a830064e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2263fff640 1 -- 172.21.15.6:0/569196788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226c0c7b90 con 0x55a83005ff00 2023-07-21T22:35:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2263fff640 1 --2- 172.21.15.6:0/569196788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a83005ff00 0x55a830064900 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f22540ac040 tx=0x7f22540046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357def8f67fe6826 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2249ffb640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:35:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2249ffb640 1 -- 172.21.15.6:0/569196788 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22540aaea0 con 0x55a83005ff00 2023-07-21T22:35:13.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2249ffb640 1 -- 172.21.15.6:0/569196788 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f22540b8040 con 0x55a83005ff00 2023-07-21T22:35:13.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2274a71000 1 -- 172.21.15.6:0/569196788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a82fe62cd0 con 0x55a83005ff00 2023-07-21T22:35:13.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2249ffb640 1 -- 172.21.15.6:0/569196788 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22540c2b10 con 0x55a83005ff00 2023-07-21T22:35:13.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2274a71000 10 client.7299 fetch_fsmap learned FSMap version 39 2023-07-21T22:35:13.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2274a71000 1 -- 172.21.15.6:0/569196788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55a82fe0efa0 con 0x55a83005ff00 2023-07-21T22:35:13.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2249ffb640 1 -- 172.21.15.6:0/569196788 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a82fe62cd0 con 0x55a83005ff00 2023-07-21T22:35:13.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2249ffb640 1 -- 172.21.15.6:0/569196788 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 39) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f22540c2c70 con 0x55a83005ff00 2023-07-21T22:35:13.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2274a71000 10 client.7299 fetch_fsmap finished waiting for FSMap version 39 2023-07-21T22:35:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2274a71000 10 client.7299 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-21T22:35:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2274a71000 20 client.7299 populate_metadata read hostname 'smithi006' 2023-07-21T22:35:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2274a71000 1 --2- 172.21.15.6:0/569196788 >> [v2:172.21.15.6:6832/4157903762,v1:172.21.15.6:6833/4157903762] conn(0x55a8300657a0 0x55a8300c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2274a71000 4 client.7299 mds_command: new command op to 7131 tid=0[{"prefix": "status"}] 2023-07-21T22:35:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2274a71000 1 -- 172.21.15.6:0/569196788 --> [v2:172.21.15.6:6832/4157903762,v1:172.21.15.6:6833/4157903762] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a82fe5d360 con 0x55a8300657a0 2023-07-21T22:35:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f226affd640 1 --2- 172.21.15.6:0/569196788 >> [v2:172.21.15.6:6832/4157903762,v1:172.21.15.6:6833/4157903762] conn(0x55a8300657a0 0x55a8300c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f226affd640 1 --2- 172.21.15.6:0/569196788 >> [v2:172.21.15.6:6832/4157903762,v1:172.21.15.6:6833/4157903762] conn(0x55a8300657a0 0x55a8300c5b50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=801490558bcfc823 server_cookie=3e8d766e787f8ae7 in_seq=0 out_seq=0 2023-07-21T22:35:13.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2249ffb640 10 client.7299 ms_handle_connect on v2:172.21.15.6:6832/4157903762 2023-07-21T22:35:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2249ffb640 1 -- 172.21.15.6:0/569196788 <== mds.0 v2:172.21.15.6:6832/4157903762 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55a82fe5d360 con 0x55a8300657a0 2023-07-21T22:35:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.206+0000 7f2249ffb640 10 client.7299 handle_command_reply: tid=0 2023-07-21T22:35:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2274a71000 1 client.7299 shutdown 2023-07-21T22:35:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2274a71000 1 -- 172.21.15.6:0/569196788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a83005ff00 msgr2=0x55a830064900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2274a71000 1 --2- 172.21.15.6:0/569196788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a83005ff00 0x55a830064900 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f22540ac040 tx=0x7f22540046d0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2274a71000 1 -- 172.21.15.6:0/569196788 shutdown_connections 2023-07-21T22:35:13.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2274a71000 1 --2- 172.21.15.6:0/569196788 >> [v2:172.21.15.6:6832/4157903762,v1:172.21.15.6:6833/4157903762] conn(0x55a8300657a0 0x55a8300c5b50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2274a71000 1 --2- 172.21.15.6:0/569196788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55a830060810 0x55a830064e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2274a71000 1 --2- 172.21.15.6:0/569196788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a83005ff00 0x55a830064900 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2274a71000 1 --2- 172.21.15.6:0/569196788 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55a8300168b0 0x55a8300643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2249ffb640 0 client.7299 ms_handle_reset on v2:172.21.15.6:6832/4157903762 2023-07-21T22:35:13.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2274a71000 1 -- 172.21.15.6:0/569196788 >> 172.21.15.6:0/569196788 conn(0x55a83001ca10 msgr2=0x55a83005e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:13.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2274a71000 1 -- 172.21.15.6:0/569196788 shutdown_connections 2023-07-21T22:35:13.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2274a71000 1 -- 172.21.15.6:0/569196788 wait complete. 2023-07-21T22:35:13.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2274a71000 20 client.7299 trim_cache size 0 max 16384 2023-07-21T22:35:13.267 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:35:13.267 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "f3073df4-6cd1-4503-bd2e-d3e98fa18bdf", 2023-07-21T22:35:13.267 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-07-21T22:35:13.267 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 7131, 2023-07-21T22:35:13.267 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-07-21T22:35:13.267 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-07-21T22:35:13.268 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-07-21T22:35:13.268 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.488417349000001, 2023-07-21T22:35:13.268 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 39, 2023-07-21T22:35:13.268 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 98, 2023-07-21T22:35:13.268 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 98, 2023-07-21T22:35:13.268 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 16.400490279 2023-07-21T22:35:13.268 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:35:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2271711640 1 -- 172.21.15.6:0/3957737933 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f224c0663a0 msgr2=0x7f224c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2271711640 1 --2- 172.21.15.6:0/3957737933 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f224c0663a0 0x7f224c068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f225c0079c0 tx=0x7f225c008040 comp rx=0 tx=0).stop 2023-07-21T22:35:13.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2271711640 1 -- 172.21.15.6:0/3957737933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c0af720 msgr2=0x7f226c0ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2271711640 1 --2- 172.21.15.6:0/3957737933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c0af720 0x7f226c0ae2c0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f226400c7a0 tx=0x7f226400cc60 comp rx=0 tx=0).stop 2023-07-21T22:35:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2271711640 1 -- 172.21.15.6:0/3957737933 shutdown_connections 2023-07-21T22:35:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2271711640 1 --2- 172.21.15.6:0/3957737933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f226c0af720 0x7f226c0ae2c0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2271711640 1 --2- 172.21.15.6:0/3957737933 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f224c0663a0 0x7f224c068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2271711640 1 --2- 172.21.15.6:0/3957737933 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f226c15b7c0 0x7f226c0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2271711640 1 --2- 172.21.15.6:0/3957737933 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f226c06fd90 0x7f226c0c26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2271711640 1 -- 172.21.15.6:0/3957737933 >> 172.21.15.6:0/3957737933 conn(0x7f226c0afcf0 msgr2=0x7f226c070210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2271711640 1 -- 172.21.15.6:0/3957737933 shutdown_connections 2023-07-21T22:35:13.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.210+0000 7f2271711640 1 -- 172.21.15.6:0/3957737933 wait complete. 2023-07-21T22:35:13.279 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:35:13.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.370+0000 7f90ef3fa640 1 Processor -- start 2023-07-21T22:35:13.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.374+0000 7f90ef3fa640 1 -- start start 2023-07-21T22:35:13.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.374+0000 7f90ef3fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90e80b7c70 0x7f90e80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.374+0000 7f90ef3fa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f90e80d1850 0x7f90e815f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.374+0000 7f90ef3fa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e80ccaf0 con 0x7f90e80d1300 2023-07-21T22:35:13.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.374+0000 7f90ef3fa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e80d1190 con 0x7f90e80d1850 2023-07-21T22:35:13.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.374+0000 7f90ef3fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e8160600 con 0x7f90e80b7c70 2023-07-21T22:35:13.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.374+0000 7f90ed997640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f90e80d1300 0x7f90e80d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52736/0 (socket says 172.21.15.6:52736) 2023-07-21T22:35:13.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.374+0000 7f90ed997640 1 -- 172.21.15.6:0/2979760657 learned_addr learned my addr 172.21.15.6:0/2979760657 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:13.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.374+0000 7f90ec995640 1 --2- 172.21.15.6:0/2979760657 >> v2:172.21.15.6:3300/0 conn(0x7f90e80d1850 0x7f90e815f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.374+0000 7f90ed196640 1 --2- 172.21.15.6:0/2979760657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90e80b7c70 0x7f90e80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.374+0000 7f90dffff640 1 -- 172.21.15.6:0/2979760657 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362296641 0 0) 0x7f90e80ccaf0 con 0x7f90e80d1300 2023-07-21T22:35:13.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.374+0000 7f90dffff640 1 -- 172.21.15.6:0/2979760657 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90d4003530 con 0x7f90e80d1300 2023-07-21T22:35:13.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.374+0000 7f90ec995640 1 -- 172.21.15.6:0/2979760657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90e80b7c70 msgr2=0x7f90e80d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:13.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.374+0000 7f90ec995640 1 --2- 172.21.15.6:0/2979760657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90e80b7c70 0x7f90e80d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.374+0000 7f90ec995640 1 -- 172.21.15.6:0/2979760657 >> v1:172.21.15.6:6789/0 conn(0x7f90e80d1300 legacy=0x7f90e80d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:13.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.374+0000 7f90ec995640 1 -- 172.21.15.6:0/2979760657 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e8160320 con 0x7f90e80d1850 2023-07-21T22:35:13.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.374+0000 7f90ed196640 1 --2- 172.21.15.6:0/2979760657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90e80b7c70 0x7f90e80d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:13.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.378+0000 7f90ec995640 1 --2- 172.21.15.6:0/2979760657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90e80d1850 0x7f90e815f650 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f90d80097f0 tx=0x7f90d801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59afca48e15536b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:13.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.378+0000 7f90dffff640 1 -- 172.21.15.6:0/2979760657 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80ad660 con 0x7f90e80d1850 2023-07-21T22:35:13.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.378+0000 7f90dffff640 1 -- 172.21.15.6:0/2979760657 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d80ad7c0 con 0x7f90e80d1850 2023-07-21T22:35:13.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.378+0000 7f90dffff640 1 -- 172.21.15.6:0/2979760657 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80adb50 con 0x7f90e80d1850 2023-07-21T22:35:13.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.378+0000 7f90ef3fa640 1 -- 172.21.15.6:0/2979760657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90e80d1850 msgr2=0x7f90e815f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:13.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.378+0000 7f90ef3fa640 1 --2- 172.21.15.6:0/2979760657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90e80d1850 0x7f90e815f650 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f90d80097f0 tx=0x7f90d801c450 comp rx=0 tx=0).stop 2023-07-21T22:35:13.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.378+0000 7f90ef3fa640 1 -- 172.21.15.6:0/2979760657 shutdown_connections 2023-07-21T22:35:13.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.378+0000 7f90ef3fa640 1 --2- 172.21.15.6:0/2979760657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90e80d1850 0x7f90e815f650 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.378+0000 7f90ef3fa640 1 --2- 172.21.15.6:0/2979760657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90e80b7c70 0x7f90e80d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.378+0000 7f90ef3fa640 1 -- 172.21.15.6:0/2979760657 >> 172.21.15.6:0/2979760657 conn(0x7f90e80650b0 msgr2=0x7f90e80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:13.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.378+0000 7f90ef3fa640 1 -- 172.21.15.6:0/2979760657 shutdown_connections 2023-07-21T22:35:13.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.378+0000 7f90ef3fa640 1 -- 172.21.15.6:0/2979760657 wait complete. 2023-07-21T22:35:13.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.378+0000 7f90ef3fa640 1 Processor -- start 2023-07-21T22:35:13.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.378+0000 7f90ef3fa640 1 -- start start 2023-07-21T22:35:13.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ef3fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90e80b7c70 0x7f90e80c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ef3fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90e80d1300 0x7f90e80c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ef3fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90e80d1850 0x7f90e80b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ef3fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e814abb0 con 0x7f90e80d1300 2023-07-21T22:35:13.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ef3fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e814ae90 con 0x7f90e80d1850 2023-07-21T22:35:13.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ef3fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e814b170 con 0x7f90e80b7c70 2023-07-21T22:35:13.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ec995640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90e80d1300 0x7f90e80c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ec995640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90e80d1300 0x7f90e80c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39370/0 (socket says 172.21.15.6:39370) 2023-07-21T22:35:13.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ec995640 1 -- 172.21.15.6:0/4262562518 learned_addr learned my addr 172.21.15.6:0/4262562518 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:13.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ed196640 1 --2- 172.21.15.6:0/4262562518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90e80b7c70 0x7f90e80c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ed997640 1 --2- 172.21.15.6:0/4262562518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90e80d1850 0x7f90e80b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ec995640 1 -- 172.21.15.6:0/4262562518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90e80b7c70 msgr2=0x7f90e80c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:13.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ec995640 1 --2- 172.21.15.6:0/4262562518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90e80b7c70 0x7f90e80c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ec995640 1 -- 172.21.15.6:0/4262562518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90e80d1850 msgr2=0x7f90e80b2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:13.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ec995640 1 --2- 172.21.15.6:0/4262562518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90e80d1850 0x7f90e80b2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ec995640 1 -- 172.21.15.6:0/4262562518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d8009420 con 0x7f90e80d1300 2023-07-21T22:35:13.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ec995640 1 --2- 172.21.15.6:0/4262562518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90e80d1300 0x7f90e80c6370 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f90d80b0040 tx=0x7f90d80191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:13.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ddffb640 1 -- 172.21.15.6:0/4262562518 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80bc070 con 0x7f90e80d1300 2023-07-21T22:35:13.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ddffb640 1 -- 172.21.15.6:0/4262562518 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d80b6410 con 0x7f90e80d1300 2023-07-21T22:35:13.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ddffb640 1 -- 172.21.15.6:0/4262562518 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80b67c0 con 0x7f90e80d1300 2023-07-21T22:35:13.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ef3fa640 1 -- 172.21.15.6:0/4262562518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e814b450 con 0x7f90e80d1300 2023-07-21T22:35:13.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ef3fa640 1 -- 172.21.15.6:0/4262562518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e814a680 con 0x7f90e80d1300 2023-07-21T22:35:13.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.382+0000 7f90ef3fa640 1 -- 172.21.15.6:0/4262562518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e80678d0 con 0x7f90e80d1300 2023-07-21T22:35:13.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.386+0000 7f90ddffb640 1 -- 172.21.15.6:0/4262562518 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f90d80b4040 con 0x7f90e80d1300 2023-07-21T22:35:13.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.386+0000 7f90ddffb640 1 --2- 172.21.15.6:0/4262562518 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f90cc0663a0 0x7f90cc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:13.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.386+0000 7f90ddffb640 1 -- 172.21.15.6:0/4262562518 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f90d811dad0 con 0x7f90e80d1300 2023-07-21T22:35:13.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.386+0000 7f90ed196640 1 --2- 172.21.15.6:0/4262562518 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f90cc0663a0 0x7f90cc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:13.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.386+0000 7f90ed196640 1 --2- 172.21.15.6:0/4262562518 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f90cc0663a0 0x7f90cc068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f90e4006e90 tx=0x7f90e4008040 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:13.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.390+0000 7f90ddffb640 1 -- 172.21.15.6:0/4262562518 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f90d80eada0 con 0x7f90e80d1300 2023-07-21T22:35:13.475 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:35:13.480 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:35:13.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.582+0000 7f90ef3fa640 1 -- 172.21.15.6:0/4262562518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f90e814a870 con 0x7f90e80d1300 2023-07-21T22:35:13.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.582+0000 7f90ddffb640 1 -- 172.21.15.6:0/4262562518 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) v1 ==== 53+0+73 (secure 0 0 0) 0x7f90d80ee3c0 con 0x7f90e80d1300 2023-07-21T22:35:13.634 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T22:35:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.586+0000 7f90ef3fa640 1 -- 172.21.15.6:0/4262562518 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f90cc0663a0 msgr2=0x7f90cc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.586+0000 7f90ef3fa640 1 --2- 172.21.15.6:0/4262562518 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f90cc0663a0 0x7f90cc068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f90e4006e90 tx=0x7f90e4008040 comp rx=0 tx=0).stop 2023-07-21T22:35:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.586+0000 7f90ef3fa640 1 -- 172.21.15.6:0/4262562518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90e80d1300 msgr2=0x7f90e80c6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.586+0000 7f90ef3fa640 1 --2- 172.21.15.6:0/4262562518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90e80d1300 0x7f90e80c6370 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f90d80b0040 tx=0x7f90d80191f0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.586+0000 7f90ef3fa640 1 -- 172.21.15.6:0/4262562518 shutdown_connections 2023-07-21T22:35:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.586+0000 7f90ef3fa640 1 --2- 172.21.15.6:0/4262562518 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f90e80d1850 0x7f90e80b2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.586+0000 7f90ef3fa640 1 --2- 172.21.15.6:0/4262562518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f90e80d1300 0x7f90e80c6370 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.586+0000 7f90ef3fa640 1 --2- 172.21.15.6:0/4262562518 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f90cc0663a0 0x7f90cc068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.586+0000 7f90ef3fa640 1 --2- 172.21.15.6:0/4262562518 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90e80b7c70 0x7f90e80c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.586+0000 7f90ef3fa640 1 -- 172.21.15.6:0/4262562518 >> 172.21.15.6:0/4262562518 conn(0x7f90e80650b0 msgr2=0x7f90e80ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.586+0000 7f90ef3fa640 1 -- 172.21.15.6:0/4262562518 shutdown_connections 2023-07-21T22:35:13.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:13.586+0000 7f90ef3fa640 1 -- 172.21.15.6:0/4262562518 wait complete. 2023-07-21T22:35:13.655 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-21T22:35:13.655 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:35:13.655 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-07-21T22:35:13.656 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T22:35:13.656 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T22:35:13.656 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-21T22:35:13.657 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-21T22:35:13.657 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:35:13.657 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:35:13.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:35:13.658 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-07-21T22:35:13.668 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:35:13.668 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:35:13.668 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:35:13.668 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:35:13.668 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-21T22:35:13.669 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:35:13.669 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:35:13.669 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:35:13.669 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-07-21T22:35:13.669 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:35:13.669 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:35:13.669 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-07-21T22:35:13.669 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:35:13.670 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:35:13.670 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-07-21T22:35:13.670 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:35:13.670 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41132sec preferred_lft 41132sec 2023-07-21T22:35:13.670 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-07-21T22:35:13.670 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:35:13.670 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:35:13.671 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:35:13.671 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-07-21T22:35:13.671 INFO:teuthology.orchestra.run.smithi006.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:35:13.671 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:42:2f:9a:3d:15 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:35:13.671 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:35:13.671 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:35:13.671 INFO:teuthology.orchestra.run.smithi006.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:35:13.671 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-21T22:35:13.672 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T22:35:13.672 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:35:13.672 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-21T22:35:13.672 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:35:13.672 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:35:13.672 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:35:13.672 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-21T22:35:13.672 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:35:13.673 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:35:13.673 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T22:35:13.673 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-21T22:35:13.673 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:35:13.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:35:13.674 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:35:13.738 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-07-21T22:35:13.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:35:13.741 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-07-21T22:35:13.797 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-07-21T22:35:13.797 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:35:13.797 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:35:13.798 INFO:teuthology.orchestra.run.smithi006.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:35:13.798 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:35:13.798 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:35:13.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:35:13.799 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T22:35:13.800 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T22:35:13.800 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:35:13.801 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:35:13.801 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:35:13.801 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T22:35:13.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:35:13.893 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T22:35:13.902 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-21T22:35:13.902 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T22:35:13.903 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:35:13.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:35:13.903 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-07-21T22:35:13.968 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:35:13.969 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T22:35:14.019 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:35:14.020 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:35:14.020 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:35:14.070 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-21T22:35:14.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:35:14.071 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:35:14.163 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:35:14.164 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:35:14.164 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:35:14.179 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:35:14.179 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:35:14.179 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:35:14.180 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:35:14.180 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:35:14.188 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:35:14.188 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:35:14.188 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:35:14.188 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:35:14.188 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:35:14.188 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-07-21T22:35:14.189 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-07-21T22:35:14.189 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f3073df4-6cd1-4503-bd2e-d3e98fa18bdf" will pass to kernel 2023-07-21T22:35:14.191 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T22:35:14.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:35:14.192 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:35:14.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:35:14.214 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:35:14.275 INFO:teuthology.orchestra.run.smithi006.stdout:client7150 2023-07-21T22:35:14.275 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:35:14.276 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:35:14.327 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-21T22:35:14.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.466+0000 7f5aae496640 1 Processor -- start 2023-07-21T22:35:14.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.466+0000 7f5aae496640 1 -- start start 2023-07-21T22:35:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.466+0000 7f5aae496640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5aa815f500 0x7f5aa806cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.466+0000 7f5aae496640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5aa806d430 0x7f5aa806a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.466+0000 7f5aae496640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa80cdc80 con 0x7f5aa806aa80 2023-07-21T22:35:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.466+0000 7f5aae496640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa806af00 con 0x7f5aa815f500 2023-07-21T22:35:14.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.466+0000 7f5aae496640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa806e4c0 con 0x7f5aa806d430 2023-07-21T22:35:14.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.466+0000 7f5aa7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5aa815f500 0x7f5aa806cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:14.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.466+0000 7f5aaca33640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5aa806aa80 0x7f5aa80b1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52750/0 (socket says 172.21.15.6:52750) 2023-07-21T22:35:14.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.466+0000 7f5aaca33640 1 -- 172.21.15.6:0/2003624974 learned_addr learned my addr 172.21.15.6:0/2003624974 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.466+0000 7f5aa77fe640 1 --2- 172.21.15.6:0/2003624974 >> v2:172.21.15.161:3300/0 conn(0x7f5aa806d430 0x7f5aa806a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.466+0000 7f5aa7fff640 1 -- 172.21.15.6:0/2003624974 >> v2:172.21.15.161:3300/0 conn(0x7f5aa806d430 msgr2=0x7f5aa806a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.466+0000 7f5aa7fff640 1 --2- 172.21.15.6:0/2003624974 >> v2:172.21.15.161:3300/0 conn(0x7f5aa806d430 0x7f5aa806a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.466+0000 7f5aa7fff640 1 -- 172.21.15.6:0/2003624974 >> v1:172.21.15.6:6789/0 conn(0x7f5aa806aa80 legacy=0x7f5aa80b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:14.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.466+0000 7f5aa7fff640 1 -- 172.21.15.6:0/2003624974 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa806d940 con 0x7f5aa815f500 2023-07-21T22:35:14.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.470+0000 7f5aa7fff640 1 --2- 172.21.15.6:0/2003624974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa815f500 0x7f5aa806cef0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80d1190 tx=0x7f5a9801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ba915d2051ea01 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.470+0000 7f5aa6ffd640 1 -- 172.21.15.6:0/2003624974 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a980ab600 con 0x7f5aa815f500 2023-07-21T22:35:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.470+0000 7f5aa6ffd640 1 -- 172.21.15.6:0/2003624974 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a980a7050 con 0x7f5aa815f500 2023-07-21T22:35:14.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.470+0000 7f5aa6ffd640 1 -- 172.21.15.6:0/2003624974 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a980ab980 con 0x7f5aa815f500 2023-07-21T22:35:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.470+0000 7f5aae496640 1 -- 172.21.15.6:0/2003624974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa815f500 msgr2=0x7f5aa806cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.470+0000 7f5aae496640 1 --2- 172.21.15.6:0/2003624974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa815f500 0x7f5aa806cef0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f5aa80d1190 tx=0x7f5a9801c440 comp rx=0 tx=0).stop 2023-07-21T22:35:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.470+0000 7f5aae496640 1 -- 172.21.15.6:0/2003624974 shutdown_connections 2023-07-21T22:35:14.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.470+0000 7f5aae496640 1 --2- 172.21.15.6:0/2003624974 >> v2:172.21.15.161:3300/0 conn(0x7f5aa806d430 0x7f5aa806a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.470+0000 7f5aae496640 1 --2- 172.21.15.6:0/2003624974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa815f500 0x7f5aa806cef0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.470+0000 7f5aae496640 1 -- 172.21.15.6:0/2003624974 >> 172.21.15.6:0/2003624974 conn(0x7f5aa80659d0 msgr2=0x7f5aa8099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.470+0000 7f5aae496640 1 -- 172.21.15.6:0/2003624974 shutdown_connections 2023-07-21T22:35:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.470+0000 7f5aae496640 1 -- 172.21.15.6:0/2003624974 wait complete. 2023-07-21T22:35:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aae496640 1 Processor -- start 2023-07-21T22:35:14.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aae496640 1 -- start start 2023-07-21T22:35:14.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aae496640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa806aa80 0x7f5aa8146b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:14.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aae496640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5aa806d430 0x7f5aa80ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:14.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aae496640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa815f500 0x7f5aa81fbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:14.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aae496640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa80b0c50 con 0x7f5aa815f500 2023-07-21T22:35:14.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aae496640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa80affd0 con 0x7f5aa806d430 2023-07-21T22:35:14.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aae496640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa80b02b0 con 0x7f5aa806aa80 2023-07-21T22:35:14.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aaca33640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa815f500 0x7f5aa81fbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:14.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aaca33640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa815f500 0x7f5aa81fbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39384/0 (socket says 172.21.15.6:39384) 2023-07-21T22:35:14.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aaca33640 1 -- 172.21.15.6:0/1129736246 learned_addr learned my addr 172.21.15.6:0/1129736246 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aa77fe640 1 --2- 172.21.15.6:0/1129736246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5aa806d430 0x7f5aa80ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aa7fff640 1 --2- 172.21.15.6:0/1129736246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa806aa80 0x7f5aa8146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aaca33640 1 -- 172.21.15.6:0/1129736246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa806aa80 msgr2=0x7f5aa8146b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aaca33640 1 --2- 172.21.15.6:0/1129736246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa806aa80 0x7f5aa8146b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aaca33640 1 -- 172.21.15.6:0/1129736246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5aa806d430 msgr2=0x7f5aa80ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aaca33640 1 --2- 172.21.15.6:0/1129736246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5aa806d430 0x7f5aa80ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aaca33640 1 -- 172.21.15.6:0/1129736246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a980093b0 con 0x7f5aa815f500 2023-07-21T22:35:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aa7fff640 1 --2- 172.21.15.6:0/1129736246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa806aa80 0x7f5aa8146b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aaca33640 1 --2- 172.21.15.6:0/1129736246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa815f500 0x7f5aa81fbf50 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f5aa000cbc0 tx=0x7f5aa000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aa4ff9640 1 -- 172.21.15.6:0/1129736246 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa000ad40 con 0x7f5aa815f500 2023-07-21T22:35:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aa4ff9640 1 -- 172.21.15.6:0/1129736246 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa0012400 con 0x7f5aa815f500 2023-07-21T22:35:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aae496640 1 -- 172.21.15.6:0/1129736246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa80b0590 con 0x7f5aa815f500 2023-07-21T22:35:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aa4ff9640 1 -- 172.21.15.6:0/1129736246 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa000aea0 con 0x7f5aa815f500 2023-07-21T22:35:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.474+0000 7f5aae496640 1 -- 172.21.15.6:0/1129736246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa80cac20 con 0x7f5aa815f500 2023-07-21T22:35:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.478+0000 7f5aae496640 1 -- 172.21.15.6:0/1129736246 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa80b0d90 con 0x7f5aa815f500 2023-07-21T22:35:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.478+0000 7f5aa4ff9640 1 -- 172.21.15.6:0/1129736246 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5aa0007070 con 0x7f5aa815f500 2023-07-21T22:35:14.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.478+0000 7f5aa4ff9640 1 --2- 172.21.15.6:0/1129736246 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f5a940663a0 0x7f5a94068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:14.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.478+0000 7f5aa4ff9640 1 -- 172.21.15.6:0/1129736246 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f5aa0083d90 con 0x7f5aa815f500 2023-07-21T22:35:14.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.478+0000 7f5aa7fff640 1 --2- 172.21.15.6:0/1129736246 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f5a940663a0 0x7f5a94068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:14.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.478+0000 7f5aa7fff640 1 --2- 172.21.15.6:0/1129736246 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f5a940663a0 0x7f5a94068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5a980ad000 tx=0x7f5a98008040 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:14.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.482+0000 7f5aa4ff9640 1 -- 172.21.15.6:0/1129736246 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5aa80b0d90 con 0x7f5aa815f500 2023-07-21T22:35:14.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.658+0000 7f5aae496640 1 -- 172.21.15.6:0/1129736246 --> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f5aa80b0420 con 0x7f5a940663a0 2023-07-21T22:35:14.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.658+0000 7f5aa4ff9640 1 -- 172.21.15.6:0/1129736246 <== mgr.6763 v2:172.21.15.161:6832/3267017989 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f5aa80b0420 con 0x7f5a940663a0 2023-07-21T22:35:14.711 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:35:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:14.712 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephfs" 2023-07-21T22:35:14.713 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:14.713 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:35:14.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.662+0000 7f5aae496640 1 -- 172.21.15.6:0/1129736246 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f5a940663a0 msgr2=0x7f5a94068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:14.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.662+0000 7f5aae496640 1 --2- 172.21.15.6:0/1129736246 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f5a940663a0 0x7f5a94068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5a980ad000 tx=0x7f5a98008040 comp rx=0 tx=0).stop 2023-07-21T22:35:14.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.662+0000 7f5aae496640 1 -- 172.21.15.6:0/1129736246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa815f500 msgr2=0x7f5aa81fbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:14.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.662+0000 7f5aae496640 1 --2- 172.21.15.6:0/1129736246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa815f500 0x7f5aa81fbf50 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f5aa000cbc0 tx=0x7f5aa000a430 comp rx=0 tx=0).stop 2023-07-21T22:35:14.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.662+0000 7f5aae496640 1 -- 172.21.15.6:0/1129736246 shutdown_connections 2023-07-21T22:35:14.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.662+0000 7f5aae496640 1 --2- 172.21.15.6:0/1129736246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5aa815f500 0x7f5aa81fbf50 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:14.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.662+0000 7f5aae496640 1 --2- 172.21.15.6:0/1129736246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5aa806d430 0x7f5aa80ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:14.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.662+0000 7f5aae496640 1 --2- 172.21.15.6:0/1129736246 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f5a940663a0 0x7f5a94068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:14.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.662+0000 7f5aae496640 1 --2- 172.21.15.6:0/1129736246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5aa806aa80 0x7f5aa8146b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:14.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.662+0000 7f5aae496640 1 -- 172.21.15.6:0/1129736246 >> 172.21.15.6:0/1129736246 conn(0x7f5aa80659d0 msgr2=0x7f5aa80ae680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:14.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.662+0000 7f5aae496640 1 -- 172.21.15.6:0/1129736246 shutdown_connections 2023-07-21T22:35:14.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.662+0000 7f5aae496640 1 -- 172.21.15.6:0/1129736246 wait complete. 2023-07-21T22:35:14.732 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-21T22:35:14.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.826+0000 7f791cb37640 1 Processor -- start 2023-07-21T22:35:14.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.826+0000 7f791cb37640 1 -- start start 2023-07-21T22:35:14.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.830+0000 7f791cb37640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f791806cf10 0x7f791815c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:14.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.830+0000 7f791cb37640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79181586e0 con 0x7f79180c85a0 2023-07-21T22:35:14.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.830+0000 7f791cb37640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79181560a0 con 0x7f79180cc000 2023-07-21T22:35:14.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.830+0000 7f791cb37640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79181595a0 con 0x7f791806cf10 2023-07-21T22:35:14.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.830+0000 7f791659c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f79180c85a0 0x7f79180c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52760/0 (socket says 172.21.15.6:52760) 2023-07-21T22:35:14.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.830+0000 7f791659c640 1 -- 172.21.15.6:0/1439524446 learned_addr learned my addr 172.21.15.6:0/1439524446 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:14.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.830+0000 7f790ffff640 1 --2- 172.21.15.6:0/1439524446 >> v2:172.21.15.6:3300/0 conn(0x7f791806cf10 0x7f791815c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:14.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.830+0000 7f7915d9b640 1 -- 172.21.15.6:0/1439524446 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447058949 0 0) 0x7f7908001120 con 0x7f79180c85a0 2023-07-21T22:35:14.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.830+0000 7f7915d9b640 1 -- 172.21.15.6:0/1439524446 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7904003530 con 0x7f79180c85a0 2023-07-21T22:35:14.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.830+0000 7f790ffff640 1 -- 172.21.15.6:0/1439524446 >> v1:172.21.15.161:6789/0 conn(0x7f79180cc000 legacy=0x7f79180cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:14.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.830+0000 7f790ffff640 1 -- 172.21.15.6:0/1439524446 >> v1:172.21.15.6:6789/0 conn(0x7f79180c85a0 legacy=0x7f79180c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:14.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.830+0000 7f790ffff640 1 -- 172.21.15.6:0/1439524446 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7918158920 con 0x7f791806cf10 2023-07-21T22:35:14.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.834+0000 7f790ffff640 1 --2- 172.21.15.6:0/1439524446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f791806cf10 0x7f791815c730 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f79000097c0 tx=0x7f790001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64bd43fe788292a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:14.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.834+0000 7f7915d9b640 1 -- 172.21.15.6:0/1439524446 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79000ab600 con 0x7f791806cf10 2023-07-21T22:35:14.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.834+0000 7f7915d9b640 1 -- 172.21.15.6:0/1439524446 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79000a7050 con 0x7f791806cf10 2023-07-21T22:35:14.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.834+0000 7f7915d9b640 1 -- 172.21.15.6:0/1439524446 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79000ab960 con 0x7f791806cf10 2023-07-21T22:35:14.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.834+0000 7f791cb37640 1 -- 172.21.15.6:0/1439524446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f791806cf10 msgr2=0x7f791815c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:14.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.834+0000 7f791cb37640 1 --2- 172.21.15.6:0/1439524446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f791806cf10 0x7f791815c730 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f79000097c0 tx=0x7f790001c360 comp rx=0 tx=0).stop 2023-07-21T22:35:14.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.834+0000 7f791cb37640 1 -- 172.21.15.6:0/1439524446 shutdown_connections 2023-07-21T22:35:14.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.834+0000 7f791cb37640 1 --2- 172.21.15.6:0/1439524446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f791806cf10 0x7f791815c730 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:14.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.834+0000 7f791cb37640 1 -- 172.21.15.6:0/1439524446 >> 172.21.15.6:0/1439524446 conn(0x7f79180afac0 msgr2=0x7f79180afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:14.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.834+0000 7f791cb37640 1 -- 172.21.15.6:0/1439524446 shutdown_connections 2023-07-21T22:35:14.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.834+0000 7f791cb37640 1 -- 172.21.15.6:0/1439524446 wait complete. 2023-07-21T22:35:14.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.834+0000 7f791cb37640 1 Processor -- start 2023-07-21T22:35:14.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.834+0000 7f791cb37640 1 -- start start 2023-07-21T22:35:14.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f791cb37640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f791806cf10 0x7f7918152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:14.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f791cb37640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79180c85a0 0x7f7918144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:14.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f791cb37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79180cc000 0x7f79180c1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:14.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f791cb37640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7918144880 con 0x7f79180cc000 2023-07-21T22:35:14.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f791cb37640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79180c48b0 con 0x7f79180c85a0 2023-07-21T22:35:14.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f791cb37640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791815b7a0 con 0x7f791806cf10 2023-07-21T22:35:14.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f7916d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79180cc000 0x7f79180c1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:14.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f7916d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79180cc000 0x7f79180c1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39398/0 (socket says 172.21.15.6:39398) 2023-07-21T22:35:14.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f7916d9d640 1 -- 172.21.15.6:0/2301783342 learned_addr learned my addr 172.21.15.6:0/2301783342 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:14.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f791659c640 1 --2- 172.21.15.6:0/2301783342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f791806cf10 0x7f7918152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:14.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f790ffff640 1 --2- 172.21.15.6:0/2301783342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79180c85a0 0x7f7918144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:14.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f7916d9d640 1 -- 172.21.15.6:0/2301783342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f791806cf10 msgr2=0x7f7918152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:14.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f7916d9d640 1 --2- 172.21.15.6:0/2301783342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f791806cf10 0x7f7918152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:14.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f7916d9d640 1 -- 172.21.15.6:0/2301783342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79180c85a0 msgr2=0x7f7918144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:14.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f7916d9d640 1 --2- 172.21.15.6:0/2301783342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79180c85a0 0x7f7918144340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:14.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f7916d9d640 1 -- 172.21.15.6:0/2301783342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7900009420 con 0x7f79180cc000 2023-07-21T22:35:14.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f7916d9d640 1 --2- 172.21.15.6:0/2301783342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79180cc000 0x7f79180c1a80 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f791000c730 tx=0x7f791000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:14.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f790effd640 1 -- 172.21.15.6:0/2301783342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910003b80 con 0x7f79180cc000 2023-07-21T22:35:14.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f790effd640 1 -- 172.21.15.6:0/2301783342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7910003ce0 con 0x7f79180cc000 2023-07-21T22:35:14.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f790effd640 1 -- 172.21.15.6:0/2301783342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791000aa30 con 0x7f79180cc000 2023-07-21T22:35:14.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f791cb37640 1 -- 172.21.15.6:0/2301783342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791815ba80 con 0x7f79180cc000 2023-07-21T22:35:14.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f791cb37640 1 -- 172.21.15.6:0/2301783342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79180c4390 con 0x7f79180cc000 2023-07-21T22:35:14.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f791cb37640 1 -- 172.21.15.6:0/2301783342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79180c4580 con 0x7f79180cc000 2023-07-21T22:35:14.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.838+0000 7f790effd640 1 -- 172.21.15.6:0/2301783342 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f791000ab90 con 0x7f79180cc000 2023-07-21T22:35:14.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.842+0000 7f790effd640 1 --2- 172.21.15.6:0/2301783342 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f78f80663a0 0x7f78f8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:14.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.842+0000 7f790effd640 1 -- 172.21.15.6:0/2301783342 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f7910083be0 con 0x7f79180cc000 2023-07-21T22:35:14.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.842+0000 7f791659c640 1 --2- 172.21.15.6:0/2301783342 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f78f80663a0 0x7f78f8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:14.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.842+0000 7f791659c640 1 --2- 172.21.15.6:0/2301783342 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f78f80663a0 0x7f78f8068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7908001280 tx=0x7f7908007bc0 comp rx=0 tx=0).ready entity=mgr.6763 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:14.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:14.846+0000 7f790effd640 1 -- 172.21.15.6:0/2301783342 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7910050f30 con 0x7f79180cc000 2023-07-21T22:35:15.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.034+0000 7f791cb37640 1 -- 172.21.15.6:0/2301783342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f79180678d0 con 0x7f79180cc000 2023-07-21T22:35:15.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.462+0000 7f790effd640 1 -- 172.21.15.6:0/2301783342 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 34) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f7910051300 con 0x7f79180cc000 2023-07-21T22:35:15.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.462+0000 7f790effd640 1 -- 172.21.15.6:0/2301783342 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v34) v1 ==== 92+0+0 (secure 0 0 0) 0x7f7910070540 con 0x7f79180cc000 2023-07-21T22:35:15.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.466+0000 7f791cb37640 1 -- 172.21.15.6:0/2301783342 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f78f80663a0 msgr2=0x7f78f8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:15.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.466+0000 7f791cb37640 1 --2- 172.21.15.6:0/2301783342 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f78f80663a0 0x7f78f8068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7908001280 tx=0x7f7908007bc0 comp rx=0 tx=0).stop 2023-07-21T22:35:15.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.466+0000 7f791cb37640 1 -- 172.21.15.6:0/2301783342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79180cc000 msgr2=0x7f79180c1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:15.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.466+0000 7f791cb37640 1 --2- 172.21.15.6:0/2301783342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79180cc000 0x7f79180c1a80 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f791000c730 tx=0x7f791000cbf0 comp rx=0 tx=0).stop 2023-07-21T22:35:15.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.466+0000 7f791cb37640 1 -- 172.21.15.6:0/2301783342 shutdown_connections 2023-07-21T22:35:15.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.466+0000 7f791cb37640 1 --2- 172.21.15.6:0/2301783342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79180cc000 0x7f79180c1a80 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:15.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.466+0000 7f791cb37640 1 --2- 172.21.15.6:0/2301783342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79180c85a0 0x7f7918144340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:15.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.466+0000 7f791cb37640 1 --2- 172.21.15.6:0/2301783342 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f78f80663a0 0x7f78f8068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:15.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.466+0000 7f791cb37640 1 --2- 172.21.15.6:0/2301783342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f791806cf10 0x7f7918152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:15.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.466+0000 7f791cb37640 1 -- 172.21.15.6:0/2301783342 >> 172.21.15.6:0/2301783342 conn(0x7f79180afac0 msgr2=0x7f79181551e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:15.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.466+0000 7f791cb37640 1 -- 172.21.15.6:0/2301783342 shutdown_connections 2023-07-21T22:35:15.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.466+0000 7f791cb37640 1 -- 172.21.15.6:0/2301783342 wait complete. 2023-07-21T22:35:15.539 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-21T22:35:15.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.638+0000 7f54e99c5640 1 Processor -- start 2023-07-21T22:35:15.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.638+0000 7f54e99c5640 1 -- start start 2023-07-21T22:35:15.691 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:15.638+0000 7fbe7edd4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:35:15.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.642+0000 7f54e99c5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f54e415bde0 0x7f54e40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:15.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.642+0000 7f54e99c5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f54e40d2fc0 0x7f54e40b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:15.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.642+0000 7f54e99c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54e40d2300 0x7f54e40d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:15.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.642+0000 7f54e99c5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e415c1b0 con 0x7f54e415bde0 2023-07-21T22:35:15.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.642+0000 7f54e99c5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e40d2cc0 con 0x7f54e40d2fc0 2023-07-21T22:35:15.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.642+0000 7f54e99c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e40b04c0 con 0x7f54e40d2300 2023-07-21T22:35:15.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.642+0000 7f54e2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f54e415bde0 0x7f54e40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.642+0000 7f54e2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f54e415bde0 0x7f54e40d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39432/0 (socket says 172.21.15.6:39432) 2023-07-21T22:35:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.642+0000 7f54e2ffd640 1 -- 172.21.15.6:0/2666886055 learned_addr learned my addr 172.21.15.6:0/2666886055 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.642+0000 7f54e37fe640 1 --2- 172.21.15.6:0/2666886055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54e40d2300 0x7f54e40d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.642+0000 7f54dbfff640 1 --2- 172.21.15.6:0/2666886055 >> v2:172.21.15.161:3300/0 conn(0x7f54e40d2fc0 0x7f54e40b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.642+0000 7f54e2ffd640 1 -- 172.21.15.6:0/2666886055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54e40d2300 msgr2=0x7f54e40d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.642+0000 7f54e2ffd640 1 --2- 172.21.15.6:0/2666886055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54e40d2300 0x7f54e40d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.642+0000 7f54e2ffd640 1 -- 172.21.15.6:0/2666886055 >> v2:172.21.15.161:3300/0 conn(0x7f54e40d2fc0 msgr2=0x7f54e40b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:15.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.642+0000 7f54e2ffd640 1 --2- 172.21.15.6:0/2666886055 >> v2:172.21.15.161:3300/0 conn(0x7f54e40d2fc0 0x7f54e40b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:15.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.642+0000 7f54e2ffd640 1 -- 172.21.15.6:0/2666886055 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e40d0aa0 con 0x7f54e415bde0 2023-07-21T22:35:15.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.642+0000 7f54dbfff640 1 --2- 172.21.15.6:0/2666886055 >> v2:172.21.15.161:3300/0 conn(0x7f54e40d2fc0 0x7f54e40b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:15.695 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:15.647+0000 7f4abda62180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:35:15.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.646+0000 7f54e2ffd640 1 --2- 172.21.15.6:0/2666886055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e415bde0 0x7f54e40d0270 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f54e408c600 tx=0x7f54d401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba305f4492be6379 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:15.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.646+0000 7f54e27fc640 1 -- 172.21.15.6:0/2666886055 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d40aa620 con 0x7f54e415bde0 2023-07-21T22:35:15.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.646+0000 7f54e27fc640 1 -- 172.21.15.6:0/2666886055 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d40aa780 con 0x7f54e415bde0 2023-07-21T22:35:15.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.646+0000 7f54e27fc640 1 -- 172.21.15.6:0/2666886055 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d40aab10 con 0x7f54e415bde0 2023-07-21T22:35:15.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.646+0000 7f54e99c5640 1 -- 172.21.15.6:0/2666886055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e415bde0 msgr2=0x7f54e40d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:15.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.646+0000 7f54e99c5640 1 --2- 172.21.15.6:0/2666886055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e415bde0 0x7f54e40d0270 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f54e408c600 tx=0x7f54d401c500 comp rx=0 tx=0).stop 2023-07-21T22:35:15.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.646+0000 7f54e99c5640 1 -- 172.21.15.6:0/2666886055 shutdown_connections 2023-07-21T22:35:15.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.646+0000 7f54e99c5640 1 --2- 172.21.15.6:0/2666886055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54e40d2300 0x7f54e40d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:15.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.646+0000 7f54e99c5640 1 --2- 172.21.15.6:0/2666886055 >> v2:172.21.15.161:3300/0 conn(0x7f54e40d2fc0 0x7f54e40b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:15.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.646+0000 7f54e99c5640 1 --2- 172.21.15.6:0/2666886055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e415bde0 0x7f54e40d0270 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:15.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.646+0000 7f54e99c5640 1 -- 172.21.15.6:0/2666886055 >> 172.21.15.6:0/2666886055 conn(0x7f54e40659d0 msgr2=0x7f54e409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:15.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.646+0000 7f54e99c5640 1 -- 172.21.15.6:0/2666886055 shutdown_connections 2023-07-21T22:35:15.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.646+0000 7f54e99c5640 1 -- 172.21.15.6:0/2666886055 wait complete. 2023-07-21T22:35:15.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.646+0000 7f54e99c5640 1 Processor -- start 2023-07-21T22:35:15.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.646+0000 7f54e99c5640 1 -- start start 2023-07-21T22:35:15.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e99c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e40d2300 0x7f54e4155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:15.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e99c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54e40d2fc0 0x7f54e4144e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:15.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e99c5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54e415bde0 0x7f54e40cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:15.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e99c5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e4156330 con 0x7f54e40d2300 2023-07-21T22:35:15.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e99c5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e41573e0 con 0x7f54e415bde0 2023-07-21T22:35:15.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e99c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e4145370 con 0x7f54e40d2fc0 2023-07-21T22:35:15.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e40d2300 0x7f54e4155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:15.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e40d2300 0x7f54e4155df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39440/0 (socket says 172.21.15.6:39440) 2023-07-21T22:35:15.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e2ffd640 1 -- 172.21.15.6:0/2761702029 learned_addr learned my addr 172.21.15.6:0/2761702029 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:15.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54dbfff640 1 --2- 172.21.15.6:0/2761702029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54e40d2fc0 0x7f54e4144e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:15.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e37fe640 1 --2- 172.21.15.6:0/2761702029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54e415bde0 0x7f54e40cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:15.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e2ffd640 1 -- 172.21.15.6:0/2761702029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54e40d2fc0 msgr2=0x7f54e4144e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:15.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e2ffd640 1 --2- 172.21.15.6:0/2761702029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54e40d2fc0 0x7f54e4144e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:15.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e2ffd640 1 -- 172.21.15.6:0/2761702029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54e415bde0 msgr2=0x7f54e40cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:15.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e2ffd640 1 --2- 172.21.15.6:0/2761702029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54e415bde0 0x7f54e40cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:15.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e2ffd640 1 -- 172.21.15.6:0/2761702029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d4009480 con 0x7f54e40d2300 2023-07-21T22:35:15.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e2ffd640 1 --2- 172.21.15.6:0/2761702029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e40d2300 0x7f54e4155df0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f54d401c9e0 tx=0x7f54d40192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:15.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e0ff9640 1 -- 172.21.15.6:0/2761702029 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d40044d0 con 0x7f54e40d2300 2023-07-21T22:35:15.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e0ff9640 1 -- 172.21.15.6:0/2761702029 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d40059a0 con 0x7f54e40d2300 2023-07-21T22:35:15.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e0ff9640 1 -- 172.21.15.6:0/2761702029 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d4005d50 con 0x7f54e40d2300 2023-07-21T22:35:15.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e99c5640 1 -- 172.21.15.6:0/2761702029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e41567d0 con 0x7f54e40d2300 2023-07-21T22:35:15.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e99c5640 1 -- 172.21.15.6:0/2761702029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e4156d90 con 0x7f54e40d2300 2023-07-21T22:35:15.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.650+0000 7f54e99c5640 1 -- 172.21.15.6:0/2761702029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e40678d0 con 0x7f54e40d2300 2023-07-21T22:35:15.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.654+0000 7f54e0ff9640 1 -- 172.21.15.6:0/2761702029 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 34) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f54d40aa8f0 con 0x7f54e40d2300 2023-07-21T22:35:15.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.654+0000 7f54e0ff9640 1 --2- 172.21.15.6:0/2761702029 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f54c4066420 0x7f54c40688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:15.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.654+0000 7f54e0ff9640 1 -- 172.21.15.6:0/2761702029 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f54d411db70 con 0x7f54e40d2300 2023-07-21T22:35:15.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.654+0000 7f54dbfff640 1 -- 172.21.15.6:0/2761702029 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f54c4066420 msgr2=0x7f54c40688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3267017989 2023-07-21T22:35:15.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.654+0000 7f54dbfff640 1 --2- 172.21.15.6:0/2761702029 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f54c4066420 0x7f54c40688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:35:15.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.658+0000 7f54e0ff9640 1 -- 172.21.15.6:0/2761702029 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f54d40eadb0 con 0x7f54e40d2300 2023-07-21T22:35:15.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.818+0000 7f54e99c5640 1 -- 172.21.15.6:0/2761702029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f54e40b5ae0 con 0x7f54e40d2300 2023-07-21T22:35:15.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.822+0000 7f54e0ff9640 1 -- 172.21.15.6:0/2761702029 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f54d40bd020 con 0x7f54e40d2300 2023-07-21T22:35:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.826+0000 7f54e99c5640 1 -- 172.21.15.6:0/2761702029 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f54c4066420 msgr2=0x7f54c40688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:35:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.826+0000 7f54e99c5640 1 --2- 172.21.15.6:0/2761702029 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f54c4066420 0x7f54c40688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.826+0000 7f54e99c5640 1 -- 172.21.15.6:0/2761702029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e40d2300 msgr2=0x7f54e4155df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.826+0000 7f54e99c5640 1 --2- 172.21.15.6:0/2761702029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e40d2300 0x7f54e4155df0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f54d401c9e0 tx=0x7f54d40192a0 comp rx=0 tx=0).stop 2023-07-21T22:35:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.826+0000 7f54e99c5640 1 -- 172.21.15.6:0/2761702029 shutdown_connections 2023-07-21T22:35:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.826+0000 7f54e99c5640 1 --2- 172.21.15.6:0/2761702029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f54e415bde0 0x7f54e40cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.826+0000 7f54e99c5640 1 --2- 172.21.15.6:0/2761702029 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f54c4066420 0x7f54c40688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.826+0000 7f54e99c5640 1 --2- 172.21.15.6:0/2761702029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f54e40d2fc0 0x7f54e4144e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.826+0000 7f54e99c5640 1 --2- 172.21.15.6:0/2761702029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54e40d2300 0x7f54e4155df0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.826+0000 7f54e99c5640 1 -- 172.21.15.6:0/2761702029 >> 172.21.15.6:0/2761702029 conn(0x7f54e40659d0 msgr2=0x7f54e415ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.826+0000 7f54e99c5640 1 -- 172.21.15.6:0/2761702029 shutdown_connections 2023-07-21T22:35:15.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.826+0000 7f54e99c5640 1 -- 172.21.15.6:0/2761702029 wait complete. 2023-07-21T22:35:15.896 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-21T22:35:16.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.994+0000 7f5bc3a7b640 1 Processor -- start 2023-07-21T22:35:16.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.994+0000 7f5bc3a7b640 1 -- start start 2023-07-21T22:35:16.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.994+0000 7f5bc3a7b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5bbc0d2fc0 0x7f5bbc0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:16.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.994+0000 7f5bc3a7b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5bbc0d2300 0x7f5bbc0d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:16.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.994+0000 7f5bc3a7b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bbc0b04c0 con 0x7f5bbc15bde0 2023-07-21T22:35:16.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.994+0000 7f5bc3a7b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bbc15c1b0 con 0x7f5bbc0d2300 2023-07-21T22:35:16.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.994+0000 7f5bc3a7b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bbc0d2c80 con 0x7f5bbc0d2fc0 2023-07-21T22:35:16.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.994+0000 7f5bc2018640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5bbc0d2300 0x7f5bbc0d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:16.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.994+0000 7f5bc2018640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5bbc0d2300 0x7f5bbc0d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39456/0 (socket says 172.21.15.6:39456) 2023-07-21T22:35:16.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.994+0000 7f5bc2018640 1 -- 172.21.15.6:0/3263047342 learned_addr learned my addr 172.21.15.6:0/3263047342 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:16.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.998+0000 7f5bc1016640 1 --2- 172.21.15.6:0/3263047342 >> v2:172.21.15.161:3300/0 conn(0x7f5bbc0d2fc0 0x7f5bbc0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:16.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.998+0000 7f5bc2018640 1 -- 172.21.15.6:0/3263047342 >> v2:172.21.15.161:3300/0 conn(0x7f5bbc0d2fc0 msgr2=0x7f5bbc0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:16.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.998+0000 7f5bc2018640 1 --2- 172.21.15.6:0/3263047342 >> v2:172.21.15.161:3300/0 conn(0x7f5bbc0d2fc0 0x7f5bbc0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:16.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.998+0000 7f5bc2018640 1 -- 172.21.15.6:0/3263047342 >> v1:172.21.15.161:6789/0 conn(0x7f5bbc15bde0 legacy=0x7f5bbc0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:16.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.998+0000 7f5bc2018640 1 -- 172.21.15.6:0/3263047342 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc0d0aa0 con 0x7f5bbc0d2300 2023-07-21T22:35:16.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.998+0000 7f5bc2018640 1 --2- 172.21.15.6:0/3263047342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bbc0d2300 0x7f5bbc0d2740 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc08c600 tx=0x7f5bb401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42834bc1e9b93541 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:16.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.998+0000 7f5bc0815640 1 -- 172.21.15.6:0/3263047342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb40a5890 con 0x7f5bbc0d2300 2023-07-21T22:35:16.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.998+0000 7f5bc0815640 1 -- 172.21.15.6:0/3263047342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb40a59f0 con 0x7f5bbc0d2300 2023-07-21T22:35:16.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:15.998+0000 7f5bc0815640 1 -- 172.21.15.6:0/3263047342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb40a5d80 con 0x7f5bbc0d2300 2023-07-21T22:35:16.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc3a7b640 1 -- 172.21.15.6:0/3263047342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bbc0d2300 msgr2=0x7f5bbc0d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:16.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc3a7b640 1 --2- 172.21.15.6:0/3263047342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bbc0d2300 0x7f5bbc0d2740 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc08c600 tx=0x7f5bb401c9d0 comp rx=0 tx=0).stop 2023-07-21T22:35:16.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc3a7b640 1 -- 172.21.15.6:0/3263047342 shutdown_connections 2023-07-21T22:35:16.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc3a7b640 1 --2- 172.21.15.6:0/3263047342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bbc0d2300 0x7f5bbc0d2740 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:16.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc3a7b640 1 --2- 172.21.15.6:0/3263047342 >> v2:172.21.15.161:3300/0 conn(0x7f5bbc0d2fc0 0x7f5bbc0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:16.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc3a7b640 1 -- 172.21.15.6:0/3263047342 >> 172.21.15.6:0/3263047342 conn(0x7f5bbc0659d0 msgr2=0x7f5bbc09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:16.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc3a7b640 1 -- 172.21.15.6:0/3263047342 shutdown_connections 2023-07-21T22:35:16.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc3a7b640 1 -- 172.21.15.6:0/3263047342 wait complete. 2023-07-21T22:35:16.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc3a7b640 1 Processor -- start 2023-07-21T22:35:16.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc3a7b640 1 -- start start 2023-07-21T22:35:16.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc3a7b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bbc0d2300 0x7f5bbc154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:16.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc3a7b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bbc0d2fc0 0x7f5bbc0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:16.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc3a7b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bbc15bde0 0x7f5bbc0cf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:16.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc3a7b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc15dc10 con 0x7f5bbc0d2300 2023-07-21T22:35:16.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc3a7b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc15def0 con 0x7f5bbc0d2fc0 2023-07-21T22:35:16.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc3a7b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc15e1d0 con 0x7f5bbc15bde0 2023-07-21T22:35:16.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc1817640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bbc0d2300 0x7f5bbc154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:16.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc1817640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bbc0d2300 0x7f5bbc154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39462/0 (socket says 172.21.15.6:39462) 2023-07-21T22:35:16.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc1817640 1 -- 172.21.15.6:0/1981570807 learned_addr learned my addr 172.21.15.6:0/1981570807 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:16.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc1016640 1 --2- 172.21.15.6:0/1981570807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bbc0d2fc0 0x7f5bbc0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:16.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc2018640 1 --2- 172.21.15.6:0/1981570807 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bbc15bde0 0x7f5bbc0cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:16.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.002+0000 7f5bc1817640 1 -- 172.21.15.6:0/1981570807 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bbc15bde0 msgr2=0x7f5bbc0cf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:16.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.006+0000 7f5bc1817640 1 --2- 172.21.15.6:0/1981570807 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bbc15bde0 0x7f5bbc0cf380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:16.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.006+0000 7f5bc1817640 1 -- 172.21.15.6:0/1981570807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bbc0d2fc0 msgr2=0x7f5bbc0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:16.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.006+0000 7f5bc1817640 1 --2- 172.21.15.6:0/1981570807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bbc0d2fc0 0x7f5bbc0cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:16.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.006+0000 7f5bc1817640 1 -- 172.21.15.6:0/1981570807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb4009b30 con 0x7f5bbc0d2300 2023-07-21T22:35:16.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.006+0000 7f5bc1817640 1 --2- 172.21.15.6:0/1981570807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bbc0d2300 0x7f5bbc154080 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800c450 tx=0x7f5bb800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:16.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.006+0000 7f5bb27fc640 1 -- 172.21.15.6:0/1981570807 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb80052d0 con 0x7f5bbc0d2300 2023-07-21T22:35:16.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.006+0000 7f5bb27fc640 1 -- 172.21.15.6:0/1981570807 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb8005430 con 0x7f5bbc0d2300 2023-07-21T22:35:16.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.006+0000 7f5bb27fc640 1 -- 172.21.15.6:0/1981570807 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8003890 con 0x7f5bbc0d2300 2023-07-21T22:35:16.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.006+0000 7f5bc3a7b640 1 -- 172.21.15.6:0/1981570807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bbc0b1a60 con 0x7f5bbc0d2300 2023-07-21T22:35:16.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.006+0000 7f5bc3a7b640 1 -- 172.21.15.6:0/1981570807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bbc1545c0 con 0x7f5bbc0d2300 2023-07-21T22:35:16.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.006+0000 7f5bc3a7b640 1 -- 172.21.15.6:0/1981570807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bbc0b1c80 con 0x7f5bbc0d2300 2023-07-21T22:35:16.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.006+0000 7f5bb27fc640 1 -- 172.21.15.6:0/1981570807 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 34) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f5bb80039f0 con 0x7f5bbc0d2300 2023-07-21T22:35:16.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.010+0000 7f5bb27fc640 1 --2- 172.21.15.6:0/1981570807 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f5ba00663f0 0x7f5ba00688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:16.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.010+0000 7f5bb27fc640 1 -- 172.21.15.6:0/1981570807 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f5bb8083970 con 0x7f5bbc0d2300 2023-07-21T22:35:16.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.010+0000 7f5bc1016640 1 -- 172.21.15.6:0/1981570807 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f5ba00663f0 msgr2=0x7f5ba00688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3267017989 2023-07-21T22:35:16.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.010+0000 7f5bc1016640 1 --2- 172.21.15.6:0/1981570807 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f5ba00663f0 0x7f5ba00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:35:16.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.014+0000 7f5bb27fc640 1 -- 172.21.15.6:0/1981570807 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5bb8050d50 con 0x7f5bbc0d2300 2023-07-21T22:35:16.114 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:16.067+0000 7f4abda62180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:35:16.142 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:16.090+0000 7fbe7edd4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:35:16.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.170+0000 7f5bc3a7b640 1 -- 172.21.15.6:0/1981570807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f5bbc0678d0 con 0x7f5bbc0d2300 2023-07-21T22:35:16.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.178+0000 7f5bb27fc640 1 -- 172.21.15.6:0/1981570807 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5bb8054370 con 0x7f5bbc0d2300 2023-07-21T22:35:16.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.178+0000 7f5bc3a7b640 1 -- 172.21.15.6:0/1981570807 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f5ba00663f0 msgr2=0x7f5ba00688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:35:16.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.178+0000 7f5bc3a7b640 1 --2- 172.21.15.6:0/1981570807 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f5ba00663f0 0x7f5ba00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:16.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.178+0000 7f5bc3a7b640 1 -- 172.21.15.6:0/1981570807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bbc0d2300 msgr2=0x7f5bbc154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:16.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.178+0000 7f5bc3a7b640 1 --2- 172.21.15.6:0/1981570807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bbc0d2300 0x7f5bbc154080 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800c450 tx=0x7f5bb800c910 comp rx=0 tx=0).stop 2023-07-21T22:35:16.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.178+0000 7f5bc3a7b640 1 -- 172.21.15.6:0/1981570807 shutdown_connections 2023-07-21T22:35:16.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.178+0000 7f5bc3a7b640 1 --2- 172.21.15.6:0/1981570807 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f5ba00663f0 0x7f5ba00688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:16.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.178+0000 7f5bc3a7b640 1 --2- 172.21.15.6:0/1981570807 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bbc15bde0 0x7f5bbc0cf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:16.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.178+0000 7f5bc3a7b640 1 --2- 172.21.15.6:0/1981570807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bbc0d2fc0 0x7f5bbc0cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:16.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.178+0000 7f5bc3a7b640 1 --2- 172.21.15.6:0/1981570807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bbc0d2300 0x7f5bbc154080 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:16.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.178+0000 7f5bc3a7b640 1 -- 172.21.15.6:0/1981570807 >> 172.21.15.6:0/1981570807 conn(0x7f5bbc0659d0 msgr2=0x7f5bbc0cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:16.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.178+0000 7f5bc3a7b640 1 -- 172.21.15.6:0/1981570807 shutdown_connections 2023-07-21T22:35:16.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.178+0000 7f5bc3a7b640 1 -- 172.21.15.6:0/1981570807 wait complete. 2023-07-21T22:35:16.249 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-07-21T22:35:16.268 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:16.219+0000 7f4abda62180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:35:16.305 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:16.254+0000 7fbe7edd4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:35:16.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.354+0000 7f12530f9640 1 Processor -- start 2023-07-21T22:35:16.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.354+0000 7f12530f9640 1 -- start start 2023-07-21T22:35:16.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.354+0000 7f12530f9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f124c0aeb40 0x7f124c15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:16.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.354+0000 7f12530f9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f124c0aef10 0x7f124c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:16.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.354+0000 7f12530f9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f124c1532b0 con 0x7f124c159270 2023-07-21T22:35:16.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.354+0000 7f12530f9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f124c0ca6f0 con 0x7f124c0aef10 2023-07-21T22:35:16.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.354+0000 7f12530f9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124c1599d0 con 0x7f124c0aeb40 2023-07-21T22:35:16.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.354+0000 7f124bfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f124c0aef10 0x7f124c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:16.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.354+0000 7f1250e95640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f124c0aeb40 0x7f124c15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:16.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.354+0000 7f1251696640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f124c159270 0x7f124c0c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:46602/0 (socket says 172.21.15.6:46602) 2023-07-21T22:35:16.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.354+0000 7f1251696640 1 -- 172.21.15.6:0/1538812972 learned_addr learned my addr 172.21.15.6:0/1538812972 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:16.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.354+0000 7f1250e95640 1 -- 172.21.15.6:0/1538812972 >> v2:172.21.15.161:3300/0 conn(0x7f124c0aef10 msgr2=0x7f124c158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:16.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.354+0000 7f1250e95640 1 --2- 172.21.15.6:0/1538812972 >> v2:172.21.15.161:3300/0 conn(0x7f124c0aef10 0x7f124c158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:16.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.354+0000 7f1250e95640 1 -- 172.21.15.6:0/1538812972 >> v1:172.21.15.161:6789/0 conn(0x7f124c159270 legacy=0x7f124c0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:16.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.354+0000 7f1250e95640 1 -- 172.21.15.6:0/1538812972 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c159cb0 con 0x7f124c0aeb40 2023-07-21T22:35:16.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.354+0000 7f124b7fe640 1 -- 172.21.15.6:0/1538812972 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3485941497 0 0) 0x7f124c1532b0 con 0x7f124c159270 2023-07-21T22:35:16.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.354+0000 7f124bfff640 1 --2- 172.21.15.6:0/1538812972 >> v2:172.21.15.161:3300/0 conn(0x7f124c0aef10 0x7f124c158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:16.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.358+0000 7f1250e95640 1 --2- 172.21.15.6:0/1538812972 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f124c0aeb40 0x7f124c15cef0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f12400097c0 tx=0x7f124001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d0cb941c87b6710 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:16.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.358+0000 7f124b7fe640 1 -- 172.21.15.6:0/1538812972 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12400ac620 con 0x7f124c0aeb40 2023-07-21T22:35:16.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.358+0000 7f124b7fe640 1 -- 172.21.15.6:0/1538812972 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12400ac780 con 0x7f124c0aeb40 2023-07-21T22:35:16.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.358+0000 7f124b7fe640 1 -- 172.21.15.6:0/1538812972 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12400acb10 con 0x7f124c0aeb40 2023-07-21T22:35:16.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.358+0000 7f12530f9640 1 -- 172.21.15.6:0/1538812972 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f124c0aeb40 msgr2=0x7f124c15cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:16.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.358+0000 7f12530f9640 1 --2- 172.21.15.6:0/1538812972 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f124c0aeb40 0x7f124c15cef0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f12400097c0 tx=0x7f124001c3c0 comp rx=0 tx=0).stop 2023-07-21T22:35:16.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.358+0000 7f12530f9640 1 -- 172.21.15.6:0/1538812972 shutdown_connections 2023-07-21T22:35:16.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.358+0000 7f12530f9640 1 --2- 172.21.15.6:0/1538812972 >> v2:172.21.15.161:3300/0 conn(0x7f124c0aef10 0x7f124c158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:16.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.358+0000 7f12530f9640 1 --2- 172.21.15.6:0/1538812972 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f124c0aeb40 0x7f124c15cef0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:16.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.358+0000 7f12530f9640 1 -- 172.21.15.6:0/1538812972 >> 172.21.15.6:0/1538812972 conn(0x7f124c0cde90 msgr2=0x7f124c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:16.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.358+0000 7f12530f9640 1 -- 172.21.15.6:0/1538812972 shutdown_connections 2023-07-21T22:35:16.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.358+0000 7f12530f9640 1 -- 172.21.15.6:0/1538812972 wait complete. 2023-07-21T22:35:16.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f12530f9640 1 Processor -- start 2023-07-21T22:35:16.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f12530f9640 1 -- start start 2023-07-21T22:35:16.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f12530f9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f124c0aeb40 0x7f124c14eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:16.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f12530f9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c0aef10 0x7f124c15b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:16.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f12530f9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f124c159270 0x7f124c0abc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:16.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f12530f9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c06f100 con 0x7f124c0aef10 2023-07-21T22:35:16.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f12530f9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c06f3a0 con 0x7f124c159270 2023-07-21T22:35:16.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f12530f9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124c06f680 con 0x7f124c0aeb40 2023-07-21T22:35:16.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f1250e95640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f124c0aeb40 0x7f124c14eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:16.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f1250e95640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f124c0aeb40 0x7f124c14eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:52850/0 (socket says 172.21.15.6:52850) 2023-07-21T22:35:16.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f124bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c0aef10 0x7f124c15b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:16.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f1250e95640 1 -- 172.21.15.6:0/4139236364 learned_addr learned my addr 172.21.15.6:0/4139236364 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:16.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f1251696640 1 --2- 172.21.15.6:0/4139236364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f124c159270 0x7f124c0abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:16.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f1250e95640 1 -- 172.21.15.6:0/4139236364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f124c159270 msgr2=0x7f124c0abc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:16.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f1250e95640 1 --2- 172.21.15.6:0/4139236364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f124c159270 0x7f124c0abc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:16.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f1250e95640 1 -- 172.21.15.6:0/4139236364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c0aef10 msgr2=0x7f124c15b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:16.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f1250e95640 1 --2- 172.21.15.6:0/4139236364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c0aef10 0x7f124c15b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:16.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f1250e95640 1 -- 172.21.15.6:0/4139236364 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1238009420 con 0x7f124c0aeb40 2023-07-21T22:35:16.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f1250e95640 1 --2- 172.21.15.6:0/4139236364 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f124c0aeb40 0x7f124c14eb60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f12400af040 tx=0x7f124001ac00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:16.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f12497fa640 1 -- 172.21.15.6:0/4139236364 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12400b8450 con 0x7f124c0aeb40 2023-07-21T22:35:16.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f12497fa640 1 -- 172.21.15.6:0/4139236364 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12400b85d0 con 0x7f124c0aeb40 2023-07-21T22:35:16.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f12497fa640 1 -- 172.21.15.6:0/4139236364 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12400b8980 con 0x7f124c0aeb40 2023-07-21T22:35:16.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f12530f9640 1 -- 172.21.15.6:0/4139236364 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1240009420 con 0x7f124c0aeb40 2023-07-21T22:35:16.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.362+0000 7f12530f9640 1 -- 172.21.15.6:0/4139236364 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124c15bce0 con 0x7f124c0aeb40 2023-07-21T22:35:16.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.366+0000 7f12530f9640 1 -- 172.21.15.6:0/4139236364 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124c0678d0 con 0x7f124c0aeb40 2023-07-21T22:35:16.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.366+0000 7f12497fa640 1 -- 172.21.15.6:0/4139236364 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 34) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f12400aa070 con 0x7f124c0aeb40 2023-07-21T22:35:16.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.366+0000 7f12497fa640 1 --2- 172.21.15.6:0/4139236364 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f12300663f0 0x7f12300688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:16.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.366+0000 7f12497fa640 1 -- 172.21.15.6:0/4139236364 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f124011e540 con 0x7f124c0aeb40 2023-07-21T22:35:16.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.366+0000 7f124bfff640 1 -- 172.21.15.6:0/4139236364 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f12300663f0 msgr2=0x7f12300688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3267017989 2023-07-21T22:35:16.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.366+0000 7f124bfff640 1 --2- 172.21.15.6:0/4139236364 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f12300663f0 0x7f12300688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:35:16.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.370+0000 7f12497fa640 1 -- 172.21.15.6:0/4139236364 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f12400eb820 con 0x7f124c0aeb40 2023-07-21T22:35:16.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.546+0000 7f12530f9640 1 -- 172.21.15.6:0/4139236364 --> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f124c06f510 con 0x7f12300663f0 2023-07-21T22:35:16.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.570+0000 7f124bfff640 1 -- 172.21.15.6:0/4139236364 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f12300663f0 msgr2=0x7f12300688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3267017989 2023-07-21T22:35:16.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.570+0000 7f124bfff640 1 --2- 172.21.15.6:0/4139236364 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f12300663f0 0x7f12300688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:35:16.748 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:16.703+0000 7f4abda62180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:35:16.807 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:16.759+0000 7f4abda62180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:35:16.814 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:16.762+0000 7fbe7edd4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:35:16.863 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:16.815+0000 7f4abda62180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:35:16.875 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:16.826+0000 7fbe7edd4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:35:16.934 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:16.882+0000 7fbe7edd4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:35:16.949 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:16.903+0000 7f4abda62180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:35:17.008 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:16.959+0000 7f4abda62180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:35:17.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.974+0000 7f124bfff640 1 -- 172.21.15.6:0/4139236364 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f12300663f0 msgr2=0x7f12300688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3267017989 2023-07-21T22:35:17.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:16.974+0000 7f124bfff640 1 --2- 172.21.15.6:0/4139236364 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f12300663f0 0x7f12300688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-21T22:35:17.024 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:16.974+0000 7fbe7edd4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:35:17.084 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:17.034+0000 7fbe7edd4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:35:17.092 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:17.047+0000 7f4abda62180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:35:17.149 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:17.103+0000 7f4abda62180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:35:17.172 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:17.122+0000 7fbe7edd4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:35:17.231 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:17.182+0000 7fbe7edd4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:35:17.292 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:17.243+0000 7f4abda62180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:35:17.350 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:17.303+0000 7f4abda62180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:35:17.380 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:17.330+0000 7fbe7edd4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:35:17.441 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:17.390+0000 7fbe7edd4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:35:17.590 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:35:17.590 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:35:17.590 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:35:17.598 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:17.551+0000 7f4abda62180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:35:17.691 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:35:17.692 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:35:17.692 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:35:17.700 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:17.650+0000 7fbe7edd4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:35:17.731 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:17.683+0000 7f4abda62180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:35:17.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:17.778+0000 7f124bfff640 1 -- 172.21.15.6:0/4139236364 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f12300663f0 msgr2=0x7f12300688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3267017989 2023-07-21T22:35:17.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:17.778+0000 7f124bfff640 1 --2- 172.21.15.6:0/4139236364 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f12300663f0 0x7f12300688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-21T22:35:17.842 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:17.790+0000 7fbe7edd4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:35:17.859 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:17.811+0000 7f4abda62180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:35:17.931 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:17.883+0000 7f4abda62180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:35:17.975 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:17.922+0000 7fbe7edd4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:35:18.049 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:17.998+0000 7fbe7edd4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:35:18.066 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:18.019+0000 7f4abda62180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:35:18.189 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:18.138+0000 7fbe7edd4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:35:18.608 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:18.563+0000 7f4abda62180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:35:18.693 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:18.647+0000 7f4abda62180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:35:18.754 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:18.702+0000 7fbe7edd4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:35:18.845 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:18.794+0000 7fbe7edd4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:35:18.845 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:18.799+0000 7f4abda62180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:35:18.929 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:18.883+0000 7f4abda62180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:35:19.000 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:18.950+0000 7fbe7edd4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:35:19.087 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:19.038+0000 7fbe7edd4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:35:19.199 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:19.151+0000 7f4abda62180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:35:19.260 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:19.211+0000 7f4abda62180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:35:19.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:19.222+0000 7f12497fa640 1 -- 172.21.15.6:0/4139236364 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mgrmap(e 35) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f124011c8d0 con 0x7f124c0aeb40 2023-07-21T22:35:19.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:19.222+0000 7f12497fa640 1 -- 172.21.15.6:0/4139236364 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f12300663f0 msgr2=0x7f12300688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:35:19.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:19.222+0000 7f12497fa640 1 --2- 172.21.15.6:0/4139236364 >> [v2:172.21.15.161:6832/3267017989,v1:172.21.15.161:6833/3267017989] conn(0x7f12300663f0 0x7f12300688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:19.390 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:19.338+0000 7fbe7edd4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:35:19.399 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:19.351+0000 7f4a3f3be640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:19.399 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:19.351+0000 7f4a3f3be640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:19.399 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:19.351+0000 7f4a3f3be640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:19.400 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:19.351+0000 7f4a3f3be640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:19.400 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:19.351+0000 7f4a3f3be640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:19.400 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:19.351+0000 7f4a3b3b6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:19.400 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:19.351+0000 7f4a3b3b6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:19.400 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:19.351+0000 7f4a3b3b6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:19.400 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:19.351+0000 7f4a3b3b6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:19.400 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:19.351+0000 7f4a3b3b6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:19.454 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:19.402+0000 7fbe7edd4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:35:20.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.230+0000 7f12497fa640 1 -- 172.21.15.6:0/4139236364 <== mon.2 v2:172.21.15.161:3301/0 8 ==== mgrmap(e 36) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f12400ebbf0 con 0x7f124c0aeb40 2023-07-21T22:35:20.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.230+0000 7f12497fa640 1 --2- 172.21.15.6:0/4139236364 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f1230033e70 0x7f1230070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:20.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.230+0000 7f12497fa640 1 -- 172.21.15.6:0/4139236364 --> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f124c06f510 con 0x7f1230033e70 2023-07-21T22:35:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.230+0000 7f124bfff640 1 --2- 172.21.15.6:0/4139236364 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f1230033e70 0x7f1230070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:20.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.242+0000 7f124bfff640 1 --2- 172.21.15.6:0/4139236364 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f1230033e70 0x7f1230070950 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f124c0ccc90 tx=0x7f1238009190 comp rx=0 tx=0).ready entity=mgr.7174 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:20.298 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:20.251+0000 7f4a46bcd640 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-07-21T22:35:20.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.246+0000 7f12497fa640 1 -- 172.21.15.6:0/4139236364 <== mgr.7174 v2:172.21.15.161:6832/3485676193 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f124c06f510 con 0x7f1230033e70 2023-07-21T22:35:20.299 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-07-21T22:35:20.308 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-07-21T22:35:20.309 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-21T22:35:20.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.410+0000 7fcff8e7b640 1 Processor -- start 2023-07-21T22:35:20.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.410+0000 7fcff8e7b640 1 -- start start 2023-07-21T22:35:20.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.410+0000 7fcff8e7b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcff406a540 0x7fcff40cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:20.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.410+0000 7fcff8e7b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff40cd1f0 con 0x7fcff406a910 2023-07-21T22:35:20.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.410+0000 7fcff8e7b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff40cd4d0 con 0x7fcff41601f0 2023-07-21T22:35:20.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.410+0000 7fcff8e7b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff40cd7b0 con 0x7fcff406a540 2023-07-21T22:35:20.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.410+0000 7fcff259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcff406a540 0x7fcff40cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:20.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.410+0000 7fcff259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcff406a540 0x7fcff40cdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58890/0 (socket says 172.21.15.6:58890) 2023-07-21T22:35:20.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.410+0000 7fcff2d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcff406a910 0x7fcff40d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46548/0 (socket says 172.21.15.6:46548) 2023-07-21T22:35:20.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.410+0000 7fcff259c640 1 -- 172.21.15.6:0/170955514 learned_addr learned my addr 172.21.15.6:0/170955514 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.410+0000 7fcff259c640 1 -- 172.21.15.6:0/170955514 >> v1:172.21.15.161:6789/0 conn(0x7fcff41601f0 legacy=0x7fcff40cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.410+0000 7fcff259c640 1 -- 172.21.15.6:0/170955514 >> v1:172.21.15.6:6789/0 conn(0x7fcff406a910 legacy=0x7fcff40d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.410+0000 7fcff259c640 1 -- 172.21.15.6:0/170955514 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff40cfe40 con 0x7fcff406a540 2023-07-21T22:35:20.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.410+0000 7fcff159a640 1 -- 172.21.15.6:0/170955514 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326576690 0 0) 0x7fcff40cd1f0 con 0x7fcff406a910 2023-07-21T22:35:20.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.414+0000 7fcff259c640 1 --2- 172.21.15.6:0/170955514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcff406a540 0x7fcff40cdcd0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009870 tx=0x7fcfe401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f745b25a25e82f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.414+0000 7fcff159a640 1 -- 172.21.15.6:0/170955514 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe40ab620 con 0x7fcff406a540 2023-07-21T22:35:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.414+0000 7fcff159a640 1 -- 172.21.15.6:0/170955514 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe40ab780 con 0x7fcff406a540 2023-07-21T22:35:20.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.414+0000 7fcff159a640 1 -- 172.21.15.6:0/170955514 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe40abb10 con 0x7fcff406a540 2023-07-21T22:35:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.414+0000 7fcff8e7b640 1 -- 172.21.15.6:0/170955514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcff406a540 msgr2=0x7fcff40cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.414+0000 7fcff8e7b640 1 --2- 172.21.15.6:0/170955514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcff406a540 0x7fcff40cdcd0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009870 tx=0x7fcfe401c400 comp rx=0 tx=0).stop 2023-07-21T22:35:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.414+0000 7fcff8e7b640 1 -- 172.21.15.6:0/170955514 shutdown_connections 2023-07-21T22:35:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.414+0000 7fcff8e7b640 1 --2- 172.21.15.6:0/170955514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcff406a540 0x7fcff40cdcd0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.414+0000 7fcff8e7b640 1 -- 172.21.15.6:0/170955514 >> 172.21.15.6:0/170955514 conn(0x7fcff4099490 msgr2=0x7fcff4089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.414+0000 7fcff8e7b640 1 -- 172.21.15.6:0/170955514 shutdown_connections 2023-07-21T22:35:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.414+0000 7fcff8e7b640 1 -- 172.21.15.6:0/170955514 wait complete. 2023-07-21T22:35:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff8e7b640 1 Processor -- start 2023-07-21T22:35:20.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff8e7b640 1 -- start start 2023-07-21T22:35:20.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff8e7b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcff406a540 0x7fcff40b5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:20.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff8e7b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcff406a910 0x7fcff4157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:20.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff8e7b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcff41601f0 0x7fcff4159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:20.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff8e7b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff4157b90 con 0x7fcff406a540 2023-07-21T22:35:20.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff8e7b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff415a440 con 0x7fcff41601f0 2023-07-21T22:35:20.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff8e7b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff415a720 con 0x7fcff406a910 2023-07-21T22:35:20.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcff406a540 0x7fcff40b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcff406a540 0x7fcff40b5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58896/0 (socket says 172.21.15.6:58896) 2023-07-21T22:35:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff259c640 1 -- 172.21.15.6:0/4269591197 learned_addr learned my addr 172.21.15.6:0/4269591197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff1d9b640 1 --2- 172.21.15.6:0/4269591197 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcff406a910 0x7fcff4157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:20.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff2d9d640 1 --2- 172.21.15.6:0/4269591197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcff41601f0 0x7fcff4159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff259c640 1 -- 172.21.15.6:0/4269591197 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcff406a910 msgr2=0x7fcff4157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff259c640 1 --2- 172.21.15.6:0/4269591197 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcff406a910 0x7fcff4157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff259c640 1 -- 172.21.15.6:0/4269591197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcff41601f0 msgr2=0x7fcff4159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:20.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff259c640 1 --2- 172.21.15.6:0/4269591197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcff41601f0 0x7fcff4159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff259c640 1 -- 172.21.15.6:0/4269591197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe4009480 con 0x7fcff406a540 2023-07-21T22:35:20.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff259c640 1 --2- 172.21.15.6:0/4269591197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcff406a540 0x7fcff40b5930 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fcfe401a030 tx=0x7fcfe40191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:20.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcfe2ffd640 1 -- 172.21.15.6:0/4269591197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4004510 con 0x7fcff406a540 2023-07-21T22:35:20.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcfe2ffd640 1 -- 172.21.15.6:0/4269591197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe40ab8f0 con 0x7fcff406a540 2023-07-21T22:35:20.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcfe2ffd640 1 -- 172.21.15.6:0/4269591197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe40abca0 con 0x7fcff406a540 2023-07-21T22:35:20.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff8e7b640 1 -- 172.21.15.6:0/4269591197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff415aa00 con 0x7fcff406a540 2023-07-21T22:35:20.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.418+0000 7fcff8e7b640 1 -- 172.21.15.6:0/4269591197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff415afc0 con 0x7fcff406a540 2023-07-21T22:35:20.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.422+0000 7fcff8e7b640 1 -- 172.21.15.6:0/4269591197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff40678d0 con 0x7fcff406a540 2023-07-21T22:35:20.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.422+0000 7fcfe2ffd640 1 -- 172.21.15.6:0/4269591197 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 36) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fcfe4003620 con 0x7fcff406a540 2023-07-21T22:35:20.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.422+0000 7fcfe2ffd640 1 --2- 172.21.15.6:0/4269591197 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7fcfd4066120 0x7fcfd40685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:20.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.422+0000 7fcfe2ffd640 1 -- 172.21.15.6:0/4269591197 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6450+0+0 (secure 0 0 0) 0x7fcfe411e4a0 con 0x7fcff406a540 2023-07-21T22:35:20.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.422+0000 7fcff1d9b640 1 --2- 172.21.15.6:0/4269591197 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7fcfd4066120 0x7fcfd40685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:20.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.422+0000 7fcff1d9b640 1 --2- 172.21.15.6:0/4269591197 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7fcfd4066120 0x7fcfd40685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8007fd0 tx=0x7fcfe8009040 comp rx=0 tx=0).ready entity=mgr.7174 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.426+0000 7fcfe2ffd640 1 -- 172.21.15.6:0/4269591197 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcfe40ebc40 con 0x7fcff406a540 2023-07-21T22:35:20.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:20.622+0000 7fcff8e7b640 1 -- 172.21.15.6:0/4269591197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fcff40cf8a0 con 0x7fcff406a540 2023-07-21T22:35:21.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.274+0000 7fcfe2ffd640 1 -- 172.21.15.6:0/4269591197 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 37) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fcfe40ec010 con 0x7fcff406a540 2023-07-21T22:35:21.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.278+0000 7fcfe2ffd640 1 -- 172.21.15.6:0/4269591197 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v37) v1 ==== 93+0+0 (secure 0 0 0) 0x7fcfe40bf480 con 0x7fcff406a540 2023-07-21T22:35:21.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.278+0000 7fcff8e7b640 1 -- 172.21.15.6:0/4269591197 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7fcfd4066120 msgr2=0x7fcfd40685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:21.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.278+0000 7fcff8e7b640 1 --2- 172.21.15.6:0/4269591197 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7fcfd4066120 0x7fcfd40685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8007fd0 tx=0x7fcfe8009040 comp rx=0 tx=0).stop 2023-07-21T22:35:21.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.278+0000 7fcff8e7b640 1 -- 172.21.15.6:0/4269591197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcff406a540 msgr2=0x7fcff40b5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:21.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.278+0000 7fcff8e7b640 1 --2- 172.21.15.6:0/4269591197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcff406a540 0x7fcff40b5930 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fcfe401a030 tx=0x7fcfe40191a0 comp rx=0 tx=0).stop 2023-07-21T22:35:21.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.278+0000 7fcff8e7b640 1 -- 172.21.15.6:0/4269591197 shutdown_connections 2023-07-21T22:35:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.278+0000 7fcff8e7b640 1 --2- 172.21.15.6:0/4269591197 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7fcfd4066120 0x7fcfd40685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.278+0000 7fcff8e7b640 1 --2- 172.21.15.6:0/4269591197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcff41601f0 0x7fcff4159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.278+0000 7fcff8e7b640 1 --2- 172.21.15.6:0/4269591197 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcff406a910 0x7fcff4157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.278+0000 7fcff8e7b640 1 --2- 172.21.15.6:0/4269591197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcff406a540 0x7fcff40b5930 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.278+0000 7fcff8e7b640 1 -- 172.21.15.6:0/4269591197 >> 172.21.15.6:0/4269591197 conn(0x7fcff4099490 msgr2=0x7fcff40b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.278+0000 7fcff8e7b640 1 -- 172.21.15.6:0/4269591197 shutdown_connections 2023-07-21T22:35:21.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.278+0000 7fcff8e7b640 1 -- 172.21.15.6:0/4269591197 wait complete. 2023-07-21T22:35:21.355 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:35:21.568 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:35:21.570 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:21.455+0000 7f6a7a30b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:35:21.570 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:21.458+0000 7f9411646180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:35:21.646 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:35:21.691 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:35:21.692 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:35:21.692 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:35:21.702 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:35:21.703 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:35:21.752 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:35:21.914 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:21.867+0000 7f6a7a30b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:35:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.890+0000 7f765df9d640 1 Processor -- start 2023-07-21T22:35:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.890+0000 7f765df9d640 1 -- start start 2023-07-21T22:35:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.890+0000 7f765df9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f76580b7c70 0x7f76580d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.890+0000 7f765df9d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76580ccaf0 con 0x7f76580d1850 2023-07-21T22:35:21.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.890+0000 7f765df9d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7658160320 con 0x7f765815fd60 2023-07-21T22:35:21.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.890+0000 7f765df9d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76580d1190 con 0x7f76580b7c70 2023-07-21T22:35:21.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.890+0000 7f76577fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f76580b7c70 0x7f76580d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:21.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.890+0000 7f76577fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f76580b7c70 0x7f76580d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58918/0 (socket says 172.21.15.6:58918) 2023-07-21T22:35:21.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.890+0000 7f76577fe640 1 -- 172.21.15.6:0/1764247174 learned_addr learned my addr 172.21.15.6:0/1764247174 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.890+0000 7f76577fe640 1 -- 172.21.15.6:0/1764247174 >> v1:172.21.15.161:6789/0 conn(0x7f765815fd60 legacy=0x7f76580d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.890+0000 7f76577fe640 1 -- 172.21.15.6:0/1764247174 >> v1:172.21.15.6:6789/0 conn(0x7f76580d1850 legacy=0x7f765815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.890+0000 7f76577fe640 1 -- 172.21.15.6:0/1764247174 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76580ccd90 con 0x7f76580b7c70 2023-07-21T22:35:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.890+0000 7f7656ffd640 1 -- 172.21.15.6:0/1764247174 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2929977944 0 0) 0x7f76580ccaf0 con 0x7f76580d1850 2023-07-21T22:35:21.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.894+0000 7f76577fe640 1 --2- 172.21.15.6:0/1764247174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76580b7c70 0x7f76580d0c50 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f7648009870 tx=0x7f764801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eade19a10b548e97 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:21.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.894+0000 7f7656ffd640 1 -- 172.21.15.6:0/1764247174 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76480ab650 con 0x7f76580b7c70 2023-07-21T22:35:21.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.894+0000 7f7656ffd640 1 -- 172.21.15.6:0/1764247174 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76480ab7b0 con 0x7f76580b7c70 2023-07-21T22:35:21.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.894+0000 7f7656ffd640 1 -- 172.21.15.6:0/1764247174 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76480abb40 con 0x7f76580b7c70 2023-07-21T22:35:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.894+0000 7f765df9d640 1 -- 172.21.15.6:0/1764247174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76580b7c70 msgr2=0x7f76580d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.894+0000 7f765df9d640 1 --2- 172.21.15.6:0/1764247174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76580b7c70 0x7f76580d0c50 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f7648009870 tx=0x7f764801c540 comp rx=0 tx=0).stop 2023-07-21T22:35:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.894+0000 7f765df9d640 1 -- 172.21.15.6:0/1764247174 shutdown_connections 2023-07-21T22:35:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.894+0000 7f765df9d640 1 --2- 172.21.15.6:0/1764247174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76580b7c70 0x7f76580d0c50 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.894+0000 7f765df9d640 1 -- 172.21.15.6:0/1764247174 >> 172.21.15.6:0/1764247174 conn(0x7f76580650b0 msgr2=0x7f76580654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.894+0000 7f765df9d640 1 -- 172.21.15.6:0/1764247174 shutdown_connections 2023-07-21T22:35:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.894+0000 7f765df9d640 1 -- 172.21.15.6:0/1764247174 wait complete. 2023-07-21T22:35:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f765df9d640 1 Processor -- start 2023-07-21T22:35:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f765df9d640 1 -- start start 2023-07-21T22:35:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f765df9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76580b7c70 0x7f765814c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f765df9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76580d1850 0x7f76580b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f765df9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f765815fd60 0x7f76580b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f765df9d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76580c7b50 con 0x7f76580b7c70 2023-07-21T22:35:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f765df9d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76580c76c0 con 0x7f76580d1850 2023-07-21T22:35:21.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f765df9d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76580c6ab0 con 0x7f765815fd60 2023-07-21T22:35:21.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f76577fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76580b7c70 0x7f765814c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:21.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f764ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76580d1850 0x7f76580b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:21.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f76577fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76580b7c70 0x7f765814c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58934/0 (socket says 172.21.15.6:58934) 2023-07-21T22:35:21.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f76577fe640 1 -- 172.21.15.6:0/3931476066 learned_addr learned my addr 172.21.15.6:0/3931476066 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:21.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f7657fff640 1 --2- 172.21.15.6:0/3931476066 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f765815fd60 0x7f76580b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:21.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f764ffff640 1 -- 172.21.15.6:0/3931476066 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f765815fd60 msgr2=0x7f76580b2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:21.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f764ffff640 1 --2- 172.21.15.6:0/3931476066 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f765815fd60 0x7f76580b2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f764ffff640 1 -- 172.21.15.6:0/3931476066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76580b7c70 msgr2=0x7f765814c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f764ffff640 1 --2- 172.21.15.6:0/3931476066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76580b7c70 0x7f765814c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f764ffff640 1 -- 172.21.15.6:0/3931476066 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76480094d0 con 0x7f76580d1850 2023-07-21T22:35:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f76577fe640 1 --2- 172.21.15.6:0/3931476066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76580b7c70 0x7f765814c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f764ffff640 1 --2- 172.21.15.6:0/3931476066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76580d1850 0x7f76580b2440 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f764000c3e0 tx=0x7f764000c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f7654ff9640 1 -- 172.21.15.6:0/3931476066 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76400054e0 con 0x7f76580d1850 2023-07-21T22:35:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f7654ff9640 1 -- 172.21.15.6:0/3931476066 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7640003600 con 0x7f76580d1850 2023-07-21T22:35:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f765df9d640 1 -- 172.21.15.6:0/3931476066 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76580c6d90 con 0x7f76580d1850 2023-07-21T22:35:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f7654ff9640 1 -- 172.21.15.6:0/3931476066 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7640003990 con 0x7f76580d1850 2023-07-21T22:35:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.898+0000 7f765df9d640 1 -- 172.21.15.6:0/3931476066 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76580c7350 con 0x7f76580d1850 2023-07-21T22:35:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.902+0000 7f765df9d640 1 -- 172.21.15.6:0/3931476066 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76580c7850 con 0x7f76580d1850 2023-07-21T22:35:21.953 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:21.902+0000 7f9411646180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:35:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.902+0000 7f7654ff9640 1 -- 172.21.15.6:0/3931476066 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 37) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f7640003af0 con 0x7f76580d1850 2023-07-21T22:35:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.902+0000 7f7654ff9640 1 --2- 172.21.15.6:0/3931476066 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f7638066430 0x7f76380688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.902+0000 7f7654ff9640 1 -- 172.21.15.6:0/3931476066 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f76400836a0 con 0x7f76580d1850 2023-07-21T22:35:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.902+0000 7f76577fe640 1 -- 172.21.15.6:0/3931476066 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f7638066430 msgr2=0x7f76380688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3485676193 2023-07-21T22:35:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.902+0000 7f76577fe640 1 --2- 172.21.15.6:0/3931476066 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f7638066430 0x7f76380688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:35:21.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:21.906+0000 7f7654ff9640 1 -- 172.21.15.6:0/3931476066 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76400507d0 con 0x7f76580d1850 2023-07-21T22:35:22.065 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:22.019+0000 7f6a7a30b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:35:22.112 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:22.062+0000 7f9411646180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:35:22.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.066+0000 7f765df9d640 1 -- 172.21.15.6:0/3931476066 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76580678d0 con 0x7f76580d1850 2023-07-21T22:35:22.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.066+0000 7f7654ff9640 1 -- 172.21.15.6:0/3931476066 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+18860 (secure 0 0 0) 0x7f7640053df0 con 0x7f76580d1850 2023-07-21T22:35:22.118 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:22.119 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":99,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:35:19.216652+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:35:00.223294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-21T22:35:01.098128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/2603665139":"2023-07-22T22:35:19.216600+0000","172.21.15.161:0/2022432677":"2023-07-22T22:35:19.216600+0000","172.21.15.161:0/567935630":"2023-07-22T22:35:19.216600+0000","172.21.15.161:0/2968204385":"2023-07-22T22:35:19.216600+0000","172.21.15.161:0/2475523917":"2023-07-22T22:35:19.216600+0000","172.21.15.161:0/1706579505":"2023-07-22T22:35:19.216600+0000","172.21.15.161:6833/3267017989":"2023-07-22T22:35:19.216600+0000","172.21.15.161:6832/3267017989":"2023-07-22T22:35:19.216600+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:35:22.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.070+0000 7f765df9d640 1 -- 172.21.15.6:0/3931476066 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f7638066430 msgr2=0x7f76380688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:35:22.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.070+0000 7f765df9d640 1 --2- 172.21.15.6:0/3931476066 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f7638066430 0x7f76380688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.070+0000 7f765df9d640 1 -- 172.21.15.6:0/3931476066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76580d1850 msgr2=0x7f76580b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:22.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.070+0000 7f765df9d640 1 --2- 172.21.15.6:0/3931476066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76580d1850 0x7f76580b2440 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f764000c3e0 tx=0x7f764000c8a0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.070+0000 7f765df9d640 1 -- 172.21.15.6:0/3931476066 shutdown_connections 2023-07-21T22:35:22.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.070+0000 7f765df9d640 1 --2- 172.21.15.6:0/3931476066 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f7638066430 0x7f76380688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.070+0000 7f765df9d640 1 --2- 172.21.15.6:0/3931476066 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f765815fd60 0x7f76580b2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.070+0000 7f765df9d640 1 --2- 172.21.15.6:0/3931476066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76580d1850 0x7f76580b2440 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.070+0000 7f765df9d640 1 --2- 172.21.15.6:0/3931476066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76580b7c70 0x7f765814c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.070+0000 7f765df9d640 1 -- 172.21.15.6:0/3931476066 >> 172.21.15.6:0/3931476066 conn(0x7f76580650b0 msgr2=0x7f7658065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:22.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.070+0000 7f765df9d640 1 -- 172.21.15.6:0/3931476066 shutdown_connections 2023-07-21T22:35:22.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.070+0000 7f765df9d640 1 -- 172.21.15.6:0/3931476066 wait complete. 2023-07-21T22:35:22.141 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:35:00.223294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:35:01.098128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:35:22.142 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:35:22.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.238+0000 7f513dfc4640 1 Processor -- start 2023-07-21T22:35:22.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.238+0000 7f513dfc4640 1 -- start start 2023-07-21T22:35:22.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.242+0000 7f513dfc4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f51380cc960 0x7f51380ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:22.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.242+0000 7f513dfc4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5138160750 0x7f513815c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:22.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.242+0000 7f513dfc4640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51380cd270 con 0x7f51380b1620 2023-07-21T22:35:22.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.242+0000 7f513dfc4640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51380cf710 con 0x7f51380cc960 2023-07-21T22:35:22.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.242+0000 7f513dfc4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51380cf430 con 0x7f5138160750 2023-07-21T22:35:22.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.242+0000 7f513cfc2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f51380cc960 0x7f51380ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:22.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.242+0000 7f513d7c3640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5138160750 0x7f513815c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:22.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.242+0000 7f5137fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f51380b1620 0x7f51380ce950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:36106/0 (socket says 172.21.15.6:36106) 2023-07-21T22:35:22.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.242+0000 7f5137fff640 1 -- 172.21.15.6:0/3718835333 learned_addr learned my addr 172.21.15.6:0/3718835333 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:22.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.242+0000 7f513cfc2640 1 -- 172.21.15.6:0/3718835333 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5138160750 msgr2=0x7f513815c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:22.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.242+0000 7f513cfc2640 1 --2- 172.21.15.6:0/3718835333 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5138160750 0x7f513815c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.242+0000 7f513cfc2640 1 -- 172.21.15.6:0/3718835333 >> v1:172.21.15.161:6789/0 conn(0x7f51380b1620 legacy=0x7f51380ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:22.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.242+0000 7f513cfc2640 1 -- 172.21.15.6:0/3718835333 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513815fc70 con 0x7f51380cc960 2023-07-21T22:35:22.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.246+0000 7f513cfc2640 1 --2- 172.21.15.6:0/3718835333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51380cc960 0x7f51380ccd30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f512c0097c0 tx=0x7f512c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21c1388e21cba8f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:22.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.246+0000 7f51377fe640 1 -- 172.21.15.6:0/3718835333 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0ab650 con 0x7f51380cc960 2023-07-21T22:35:22.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.246+0000 7f51377fe640 1 -- 172.21.15.6:0/3718835333 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c0ab7b0 con 0x7f51380cc960 2023-07-21T22:35:22.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.246+0000 7f51377fe640 1 -- 172.21.15.6:0/3718835333 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0abb40 con 0x7f51380cc960 2023-07-21T22:35:22.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.246+0000 7f513dfc4640 1 -- 172.21.15.6:0/3718835333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51380cc960 msgr2=0x7f51380ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:22.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.246+0000 7f513dfc4640 1 --2- 172.21.15.6:0/3718835333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51380cc960 0x7f51380ccd30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f512c0097c0 tx=0x7f512c01c450 comp rx=0 tx=0).stop 2023-07-21T22:35:22.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.246+0000 7f513dfc4640 1 -- 172.21.15.6:0/3718835333 shutdown_connections 2023-07-21T22:35:22.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.246+0000 7f513dfc4640 1 --2- 172.21.15.6:0/3718835333 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5138160750 0x7f513815c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.246+0000 7f513dfc4640 1 --2- 172.21.15.6:0/3718835333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51380cc960 0x7f51380ccd30 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.246+0000 7f513dfc4640 1 -- 172.21.15.6:0/3718835333 >> 172.21.15.6:0/3718835333 conn(0x7f5138069f50 msgr2=0x7f513806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:22.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.246+0000 7f513dfc4640 1 -- 172.21.15.6:0/3718835333 shutdown_connections 2023-07-21T22:35:22.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.246+0000 7f513dfc4640 1 -- 172.21.15.6:0/3718835333 wait complete. 2023-07-21T22:35:22.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.246+0000 7f513dfc4640 1 Processor -- start 2023-07-21T22:35:22.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.246+0000 7f513dfc4640 1 -- start start 2023-07-21T22:35:22.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f513dfc4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51380b1620 0x7f5138156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:22.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f513dfc4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51380cc960 0x7f5138152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:22.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f513dfc4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5138160750 0x7f51381527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:22.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f513dfc4640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5138153b90 con 0x7f5138160750 2023-07-21T22:35:22.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f513dfc4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51381544a0 con 0x7f51380b1620 2023-07-21T22:35:22.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f513dfc4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5138154780 con 0x7f51380cc960 2023-07-21T22:35:22.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f513cfc2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51380b1620 0x7f5138156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:22.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f5137fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51380cc960 0x7f5138152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:22.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f513cfc2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51380b1620 0x7f5138156d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35140/0 (socket says 172.21.15.6:35140) 2023-07-21T22:35:22.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f513cfc2640 1 -- 172.21.15.6:0/2011969079 learned_addr learned my addr 172.21.15.6:0/2011969079 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:22.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f513d7c3640 1 --2- 172.21.15.6:0/2011969079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5138160750 0x7f51381527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:22.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f513cfc2640 1 -- 172.21.15.6:0/2011969079 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51380cc960 msgr2=0x7f5138152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:22.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f513cfc2640 1 --2- 172.21.15.6:0/2011969079 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51380cc960 0x7f5138152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f513cfc2640 1 -- 172.21.15.6:0/2011969079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5138160750 msgr2=0x7f51381527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:22.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f513cfc2640 1 --2- 172.21.15.6:0/2011969079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5138160750 0x7f51381527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f513cfc2640 1 -- 172.21.15.6:0/2011969079 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512c009420 con 0x7f51380b1620 2023-07-21T22:35:22.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f5137fff640 1 --2- 172.21.15.6:0/2011969079 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51380cc960 0x7f5138152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:22.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f513cfc2640 1 --2- 172.21.15.6:0/2011969079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51380b1620 0x7f5138156d00 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f512c0ad040 tx=0x7f512c01ac90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:22.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f51357fa640 1 -- 172.21.15.6:0/2011969079 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0bf610 con 0x7f51380b1620 2023-07-21T22:35:22.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f51357fa640 1 -- 172.21.15.6:0/2011969079 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c0bf790 con 0x7f51380b1620 2023-07-21T22:35:22.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f513dfc4640 1 -- 172.21.15.6:0/2011969079 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5138152e90 con 0x7f51380b1620 2023-07-21T22:35:22.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f51357fa640 1 -- 172.21.15.6:0/2011969079 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0bfb40 con 0x7f51380b1620 2023-07-21T22:35:22.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f513dfc4640 1 -- 172.21.15.6:0/2011969079 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5138153450 con 0x7f51380b1620 2023-07-21T22:35:22.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f513dfc4640 1 -- 172.21.15.6:0/2011969079 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f513804e020 con 0x7f51380b1620 2023-07-21T22:35:22.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.250+0000 7f51357fa640 1 -- 172.21.15.6:0/2011969079 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 37) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f512c0b5400 con 0x7f51380b1620 2023-07-21T22:35:22.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.254+0000 7f51357fa640 1 --2- 172.21.15.6:0/2011969079 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f511c066460 0x7f511c068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:22.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.254+0000 7f51357fa640 1 -- 172.21.15.6:0/2011969079 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f512c11f300 con 0x7f51380b1620 2023-07-21T22:35:22.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.254+0000 7f5137fff640 1 -- 172.21.15.6:0/2011969079 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f511c066460 msgr2=0x7f511c068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3485676193 2023-07-21T22:35:22.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.254+0000 7f5137fff640 1 --2- 172.21.15.6:0/2011969079 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f511c066460 0x7f511c068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:35:22.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.258+0000 7f51357fa640 1 -- 172.21.15.6:0/2011969079 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f512c0ec550 con 0x7f51380b1620 2023-07-21T22:35:22.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.418+0000 7f513dfc4640 1 -- 172.21.15.6:0/2011969079 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51380cfad0 con 0x7f51380b1620 2023-07-21T22:35:22.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.418+0000 7f51357fa640 1 -- 172.21.15.6:0/2011969079 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) v1 ==== 93+0+10 (secure 0 0 0) 0x7f512c0efb70 con 0x7f51380b1620 2023-07-21T22:35:22.469 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:35:22.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.418+0000 7f513dfc4640 1 -- 172.21.15.6:0/2011969079 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f511c066460 msgr2=0x7f511c068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:35:22.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.418+0000 7f513dfc4640 1 --2- 172.21.15.6:0/2011969079 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f511c066460 0x7f511c068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.418+0000 7f513dfc4640 1 -- 172.21.15.6:0/2011969079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51380b1620 msgr2=0x7f5138156d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:22.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.418+0000 7f513dfc4640 1 --2- 172.21.15.6:0/2011969079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51380b1620 0x7f5138156d00 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f512c0ad040 tx=0x7f512c01ac90 comp rx=0 tx=0).stop 2023-07-21T22:35:22.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.418+0000 7f513dfc4640 1 -- 172.21.15.6:0/2011969079 shutdown_connections 2023-07-21T22:35:22.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.418+0000 7f513dfc4640 1 --2- 172.21.15.6:0/2011969079 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f511c066460 0x7f511c068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.418+0000 7f513dfc4640 1 --2- 172.21.15.6:0/2011969079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5138160750 0x7f51381527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.418+0000 7f513dfc4640 1 --2- 172.21.15.6:0/2011969079 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51380cc960 0x7f5138152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.418+0000 7f513dfc4640 1 --2- 172.21.15.6:0/2011969079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f51380b1620 0x7f5138156d00 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.418+0000 7f513dfc4640 1 -- 172.21.15.6:0/2011969079 >> 172.21.15.6:0/2011969079 conn(0x7f5138069f50 msgr2=0x7f513815d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:22.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.418+0000 7f513dfc4640 1 -- 172.21.15.6:0/2011969079 shutdown_connections 2023-07-21T22:35:22.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.418+0000 7f513dfc4640 1 -- 172.21.15.6:0/2011969079 wait complete. 2023-07-21T22:35:22.490 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:35:22.544 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:22.495+0000 7f6a7a30b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:35:22.603 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:22.555+0000 7f6a7a30b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:35:22.632 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:22.582+0000 7f9411646180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:35:22.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.590+0000 7f8c997df640 1 Processor -- start 2023-07-21T22:35:22.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.590+0000 7f8c997df640 1 -- start start 2023-07-21T22:35:22.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.590+0000 7f8c997df640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8c940d04d0 0x7f8c940b1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:22.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.590+0000 7f8c997df640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c940b07d0 0x7f8c940b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:22.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.590+0000 7f8c997df640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c940b19e0 con 0x7f8c9415bb30 2023-07-21T22:35:22.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.590+0000 7f8c997df640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c940b17d0 con 0x7f8c940b07d0 2023-07-21T22:35:22.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.590+0000 7f8c997df640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c940b1cc0 con 0x7f8c940d04d0 2023-07-21T22:35:22.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.590+0000 7f8c937fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c940b07d0 0x7f8c940b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:22.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.590+0000 7f8c92ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8c9415bb30 0x7f8c940cfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46576/0 (socket says 172.21.15.6:46576) 2023-07-21T22:35:22.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.590+0000 7f8c92ffd640 1 -- 172.21.15.6:0/4095767739 learned_addr learned my addr 172.21.15.6:0/4095767739 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:22.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.590+0000 7f8c8bfff640 1 --2- 172.21.15.6:0/4095767739 >> v2:172.21.15.161:3300/0 conn(0x7f8c940d04d0 0x7f8c940b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:22.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.590+0000 7f8c937fe640 1 -- 172.21.15.6:0/4095767739 >> v2:172.21.15.161:3300/0 conn(0x7f8c940d04d0 msgr2=0x7f8c940b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:22.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.590+0000 7f8c937fe640 1 --2- 172.21.15.6:0/4095767739 >> v2:172.21.15.161:3300/0 conn(0x7f8c940d04d0 0x7f8c940b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.590+0000 7f8c937fe640 1 -- 172.21.15.6:0/4095767739 >> v1:172.21.15.6:6789/0 conn(0x7f8c9415bb30 legacy=0x7f8c940cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:22.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.590+0000 7f8c937fe640 1 -- 172.21.15.6:0/4095767739 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c940b1fa0 con 0x7f8c940b07d0 2023-07-21T22:35:22.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.594+0000 7f8c937fe640 1 --2- 172.21.15.6:0/4095767739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c940b07d0 0x7f8c940b27a0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8c940b82a0 tx=0x7f8c8c01d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b928641f318f35 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:22.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.594+0000 7f8c927fc640 1 -- 172.21.15.6:0/4095767739 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0a59c0 con 0x7f8c940b07d0 2023-07-21T22:35:22.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.594+0000 7f8c927fc640 1 -- 172.21.15.6:0/4095767739 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c0a5b20 con 0x7f8c940b07d0 2023-07-21T22:35:22.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.594+0000 7f8c927fc640 1 -- 172.21.15.6:0/4095767739 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0ad440 con 0x7f8c940b07d0 2023-07-21T22:35:22.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.594+0000 7f8c997df640 1 -- 172.21.15.6:0/4095767739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c940b07d0 msgr2=0x7f8c940b27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:22.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.594+0000 7f8c997df640 1 --2- 172.21.15.6:0/4095767739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c940b07d0 0x7f8c940b27a0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8c940b82a0 tx=0x7f8c8c01d340 comp rx=0 tx=0).stop 2023-07-21T22:35:22.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.594+0000 7f8c997df640 1 -- 172.21.15.6:0/4095767739 shutdown_connections 2023-07-21T22:35:22.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.594+0000 7f8c997df640 1 --2- 172.21.15.6:0/4095767739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c940b07d0 0x7f8c940b27a0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.594+0000 7f8c997df640 1 --2- 172.21.15.6:0/4095767739 >> v2:172.21.15.161:3300/0 conn(0x7f8c940d04d0 0x7f8c940b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.594+0000 7f8c997df640 1 -- 172.21.15.6:0/4095767739 >> 172.21.15.6:0/4095767739 conn(0x7f8c9409b4c0 msgr2=0x7f8c940d21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:22.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.594+0000 7f8c997df640 1 -- 172.21.15.6:0/4095767739 shutdown_connections 2023-07-21T22:35:22.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.594+0000 7f8c997df640 1 -- 172.21.15.6:0/4095767739 wait complete. 2023-07-21T22:35:22.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c997df640 1 Processor -- start 2023-07-21T22:35:22.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c997df640 1 -- start start 2023-07-21T22:35:22.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c997df640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c940b07d0 0x7f8c9414c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:22.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c997df640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c940d04d0 0x7f8c94147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:22.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c997df640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c9415bb30 0x7f8c9414d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:22.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c997df640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9414b220 con 0x7f8c940d04d0 2023-07-21T22:35:22.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c997df640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9414b500 con 0x7f8c9415bb30 2023-07-21T22:35:22.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c997df640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9414b7e0 con 0x7f8c940b07d0 2023-07-21T22:35:22.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c8bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c940d04d0 0x7f8c94147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:22.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c8bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c940d04d0 0x7f8c94147d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58956/0 (socket says 172.21.15.6:58956) 2023-07-21T22:35:22.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c92ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c940b07d0 0x7f8c9414c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:22.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c8bfff640 1 -- 172.21.15.6:0/39245652 learned_addr learned my addr 172.21.15.6:0/39245652 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:22.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c937fe640 1 --2- 172.21.15.6:0/39245652 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c9415bb30 0x7f8c9414d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:22.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c92ffd640 1 -- 172.21.15.6:0/39245652 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c9415bb30 msgr2=0x7f8c9414d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:22.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c92ffd640 1 --2- 172.21.15.6:0/39245652 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c9415bb30 0x7f8c9414d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c92ffd640 1 -- 172.21.15.6:0/39245652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c940d04d0 msgr2=0x7f8c94147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:22.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c92ffd640 1 --2- 172.21.15.6:0/39245652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c940d04d0 0x7f8c94147d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c92ffd640 1 -- 172.21.15.6:0/39245652 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c009a70 con 0x7f8c940b07d0 2023-07-21T22:35:22.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c92ffd640 1 --2- 172.21.15.6:0/39245652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c940b07d0 0x7f8c9414c2c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400c340 tx=0x7f8c8400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:22.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c8b7fe640 1 -- 172.21.15.6:0/39245652 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c84005cf0 con 0x7f8c940b07d0 2023-07-21T22:35:22.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c8b7fe640 1 -- 172.21.15.6:0/39245652 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c84005e50 con 0x7f8c940b07d0 2023-07-21T22:35:22.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c8b7fe640 1 -- 172.21.15.6:0/39245652 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c840072d0 con 0x7f8c940b07d0 2023-07-21T22:35:22.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c997df640 1 -- 172.21.15.6:0/39245652 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9414bac0 con 0x7f8c940b07d0 2023-07-21T22:35:22.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c997df640 1 -- 172.21.15.6:0/39245652 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c941f80e0 con 0x7f8c940b07d0 2023-07-21T22:35:22.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.598+0000 7f8c997df640 1 -- 172.21.15.6:0/39245652 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9404e020 con 0x7f8c940b07d0 2023-07-21T22:35:22.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.602+0000 7f8c8b7fe640 1 -- 172.21.15.6:0/39245652 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 37) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f8c84007430 con 0x7f8c940b07d0 2023-07-21T22:35:22.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.602+0000 7f8c8b7fe640 1 --2- 172.21.15.6:0/39245652 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f8c74066430 0x7f8c740688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:22.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.602+0000 7f8c8b7fe640 1 -- 172.21.15.6:0/39245652 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f8c840835d0 con 0x7f8c940b07d0 2023-07-21T22:35:22.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.602+0000 7f8c8bfff640 1 -- 172.21.15.6:0/39245652 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f8c74066430 msgr2=0x7f8c740688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3485676193 2023-07-21T22:35:22.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.602+0000 7f8c8bfff640 1 --2- 172.21.15.6:0/39245652 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f8c74066430 0x7f8c740688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:35:22.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.606+0000 7f8c8b7fe640 1 -- 172.21.15.6:0/39245652 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8c84050700 con 0x7f8c940b07d0 2023-07-21T22:35:22.659 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:22.611+0000 7f6a7a30b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:35:22.697 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:22.646+0000 7f9411646180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:35:22.745 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:22.699+0000 7f6a7a30b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:35:22.756 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:22.706+0000 7f9411646180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:35:22.804 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:22.755+0000 7f6a7a30b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:35:22.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.766+0000 7f8c997df640 1 -- 172.21.15.6:0/39245652 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8c9414b920 con 0x7f8c940b07d0 2023-07-21T22:35:22.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.766+0000 7f8c8b7fe640 1 -- 172.21.15.6:0/39245652 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v99) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8c9414b920 con 0x7f8c940b07d0 2023-07-21T22:35:22.818 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:35:22.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.770+0000 7f8c997df640 1 -- 172.21.15.6:0/39245652 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f8c74066430 msgr2=0x7f8c740688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:35:22.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.770+0000 7f8c997df640 1 --2- 172.21.15.6:0/39245652 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f8c74066430 0x7f8c740688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.770+0000 7f8c997df640 1 -- 172.21.15.6:0/39245652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c940b07d0 msgr2=0x7f8c9414c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:22.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.770+0000 7f8c997df640 1 --2- 172.21.15.6:0/39245652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c940b07d0 0x7f8c9414c2c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400c340 tx=0x7f8c8400c800 comp rx=0 tx=0).stop 2023-07-21T22:35:22.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.770+0000 7f8c997df640 1 -- 172.21.15.6:0/39245652 shutdown_connections 2023-07-21T22:35:22.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.770+0000 7f8c997df640 1 --2- 172.21.15.6:0/39245652 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f8c74066430 0x7f8c740688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.770+0000 7f8c997df640 1 --2- 172.21.15.6:0/39245652 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c9415bb30 0x7f8c9414d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.770+0000 7f8c997df640 1 --2- 172.21.15.6:0/39245652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c940d04d0 0x7f8c94147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.770+0000 7f8c997df640 1 --2- 172.21.15.6:0/39245652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c940b07d0 0x7f8c9414c2c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.770+0000 7f8c997df640 1 -- 172.21.15.6:0/39245652 >> 172.21.15.6:0/39245652 conn(0x7f8c9409b4c0 msgr2=0x7f8c94155b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:22.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.770+0000 7f8c997df640 1 -- 172.21.15.6:0/39245652 shutdown_connections 2023-07-21T22:35:22.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.770+0000 7f8c997df640 1 -- 172.21.15.6:0/39245652 wait complete. 2023-07-21T22:35:22.840 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:35:22.850 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:22.798+0000 7f9411646180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:35:22.889 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:22.843+0000 7f6a7a30b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:35:22.912 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:22.862+0000 7f9411646180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:35:22.945 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:22.899+0000 7f6a7a30b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:35:22.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.938+0000 7ff897967640 1 Processor -- start 2023-07-21T22:35:22.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.938+0000 7ff897967640 1 -- start start 2023-07-21T22:35:22.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.942+0000 7ff897967640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff89015bde0 0x7ff8900d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:22.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.942+0000 7ff897967640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff8900d2300 0x7ff8900d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:22.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.942+0000 7ff897967640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8900b04c0 con 0x7ff8900d2fc0 2023-07-21T22:35:22.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.942+0000 7ff897967640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8900d2ce0 con 0x7ff8900d2300 2023-07-21T22:35:22.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.942+0000 7ff897967640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89015c1b0 con 0x7ff89015bde0 2023-07-21T22:35:22.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.942+0000 7ff895703640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff89015bde0 0x7ff8900d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:22.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.942+0000 7ff895f04640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff8900d2300 0x7ff8900d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:22.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.942+0000 7ff895703640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff89015bde0 0x7ff8900d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:46036/0 (socket says 172.21.15.6:46036) 2023-07-21T22:35:22.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.942+0000 7ff895703640 1 -- 172.21.15.6:0/823144874 learned_addr learned my addr 172.21.15.6:0/823144874 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:22.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.942+0000 7ff895703640 1 -- 172.21.15.6:0/823144874 >> v2:172.21.15.161:3300/0 conn(0x7ff8900d2300 msgr2=0x7ff8900d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:22.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.942+0000 7ff895703640 1 --2- 172.21.15.6:0/823144874 >> v2:172.21.15.161:3300/0 conn(0x7ff8900d2300 0x7ff8900d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.942+0000 7ff895703640 1 -- 172.21.15.6:0/823144874 >> v1:172.21.15.161:6789/0 conn(0x7ff8900d2fc0 legacy=0x7ff8900b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:22.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.942+0000 7ff895703640 1 -- 172.21.15.6:0/823144874 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8900b1060 con 0x7ff89015bde0 2023-07-21T22:35:22.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.946+0000 7ff895703640 1 --2- 172.21.15.6:0/823144874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff89015bde0 0x7ff8900d0270 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff88c006fd0 tx=0x7ff88c01c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcfd28a56d00b5b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:22.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.946+0000 7ff887fff640 1 -- 172.21.15.6:0/823144874 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c0a7070 con 0x7ff89015bde0 2023-07-21T22:35:22.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.946+0000 7ff887fff640 1 -- 172.21.15.6:0/823144874 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88c0ab430 con 0x7ff89015bde0 2023-07-21T22:35:22.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.946+0000 7ff887fff640 1 -- 172.21.15.6:0/823144874 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c0ab7c0 con 0x7ff89015bde0 2023-07-21T22:35:22.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.946+0000 7ff897967640 1 -- 172.21.15.6:0/823144874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff89015bde0 msgr2=0x7ff8900d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:22.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.946+0000 7ff897967640 1 --2- 172.21.15.6:0/823144874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff89015bde0 0x7ff8900d0270 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff88c006fd0 tx=0x7ff88c01c520 comp rx=0 tx=0).stop 2023-07-21T22:35:22.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.946+0000 7ff897967640 1 -- 172.21.15.6:0/823144874 shutdown_connections 2023-07-21T22:35:22.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.946+0000 7ff897967640 1 --2- 172.21.15.6:0/823144874 >> v2:172.21.15.161:3300/0 conn(0x7ff8900d2300 0x7ff8900d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.946+0000 7ff897967640 1 --2- 172.21.15.6:0/823144874 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff89015bde0 0x7ff8900d0270 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:22.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.946+0000 7ff897967640 1 -- 172.21.15.6:0/823144874 >> 172.21.15.6:0/823144874 conn(0x7ff8900659d0 msgr2=0x7ff89009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:22.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.946+0000 7ff897967640 1 -- 172.21.15.6:0/823144874 shutdown_connections 2023-07-21T22:35:22.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.946+0000 7ff897967640 1 -- 172.21.15.6:0/823144874 wait complete. 2023-07-21T22:35:22.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.946+0000 7ff897967640 1 Processor -- start 2023-07-21T22:35:22.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.946+0000 7ff897967640 1 -- start start 2023-07-21T22:35:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff897967640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8900d2300 0x7ff8900c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff897967640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8900d2fc0 0x7ff8900c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff897967640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff89015bde0 0x7ff89014cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:23.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff897967640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89014cc00 con 0x7ff8900d2fc0 2023-07-21T22:35:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff897967640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89013a2f0 con 0x7ff8900d2300 2023-07-21T22:35:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff897967640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89013a5d0 con 0x7ff89015bde0 2023-07-21T22:35:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff895703640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8900d2300 0x7ff8900c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff895f04640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff89015bde0 0x7ff89014cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff895703640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8900d2300 0x7ff8900c5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35174/0 (socket says 172.21.15.6:35174) 2023-07-21T22:35:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff895703640 1 -- 172.21.15.6:0/377756994 learned_addr learned my addr 172.21.15.6:0/377756994 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:23.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff894f02640 1 --2- 172.21.15.6:0/377756994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8900d2fc0 0x7ff8900c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:23.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff895f04640 1 -- 172.21.15.6:0/377756994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8900d2300 msgr2=0x7ff8900c5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff895f04640 1 --2- 172.21.15.6:0/377756994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8900d2300 0x7ff8900c5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff895f04640 1 -- 172.21.15.6:0/377756994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8900d2fc0 msgr2=0x7ff8900c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff895f04640 1 --2- 172.21.15.6:0/377756994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8900d2fc0 0x7ff8900c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff895f04640 1 -- 172.21.15.6:0/377756994 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88c009480 con 0x7ff89015bde0 2023-07-21T22:35:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff895703640 1 --2- 172.21.15.6:0/377756994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8900d2300 0x7ff8900c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff895f04640 1 --2- 172.21.15.6:0/377756994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff89015bde0 0x7ff89014cda0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff88800ebd0 tx=0x7ff88800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:23.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff885ffb640 1 -- 172.21.15.6:0/377756994 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88800cd20 con 0x7ff89015bde0 2023-07-21T22:35:23.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff885ffb640 1 -- 172.21.15.6:0/377756994 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88800f040 con 0x7ff89015bde0 2023-07-21T22:35:23.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff885ffb640 1 -- 172.21.15.6:0/377756994 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8880146c0 con 0x7ff89015bde0 2023-07-21T22:35:23.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff897967640 1 -- 172.21.15.6:0/377756994 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89013a8b0 con 0x7ff89015bde0 2023-07-21T22:35:23.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff897967640 1 -- 172.21.15.6:0/377756994 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89013ae70 con 0x7ff89015bde0 2023-07-21T22:35:23.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.950+0000 7ff897967640 1 -- 172.21.15.6:0/377756994 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff89013b090 con 0x7ff89015bde0 2023-07-21T22:35:23.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.954+0000 7ff885ffb640 1 -- 172.21.15.6:0/377756994 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 37) v1 ==== 85817+0+0 (secure 0 0 0) 0x7ff888014820 con 0x7ff89015bde0 2023-07-21T22:35:23.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.954+0000 7ff885ffb640 1 --2- 172.21.15.6:0/377756994 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7ff874066430 0x7ff8740688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:23.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.954+0000 7ff885ffb640 1 -- 172.21.15.6:0/377756994 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6450+0+0 (secure 0 0 0) 0x7ff888084f60 con 0x7ff89015bde0 2023-07-21T22:35:23.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.954+0000 7ff895703640 1 -- 172.21.15.6:0/377756994 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7ff874066430 msgr2=0x7ff8740688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3485676193 2023-07-21T22:35:23.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.954+0000 7ff895703640 1 --2- 172.21.15.6:0/377756994 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7ff874066430 0x7ff8740688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:35:23.006 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:22.954+0000 7f9411646180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:35:23.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:22.958+0000 7ff885ffb640 1 -- 172.21.15.6:0/377756994 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff888051ed0 con 0x7ff89015bde0 2023-07-21T22:35:23.081 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:23.030+0000 7f9411646180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:35:23.088 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:23.043+0000 7f6a7a30b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:35:23.146 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:23.099+0000 7f6a7a30b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:35:23.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.130+0000 7ff897967640 1 -- 172.21.15.6:0/377756994 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff8900678d0 con 0x7ff89015bde0 2023-07-21T22:35:23.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.134+0000 7ff885ffb640 1 -- 172.21.15.6:0/377756994 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v99) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff888018020 con 0x7ff89015bde0 2023-07-21T22:35:23.185 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:35:23.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.134+0000 7ff897967640 1 -- 172.21.15.6:0/377756994 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7ff874066430 msgr2=0x7ff8740688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:35:23.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.134+0000 7ff897967640 1 --2- 172.21.15.6:0/377756994 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7ff874066430 0x7ff8740688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.134+0000 7ff897967640 1 -- 172.21.15.6:0/377756994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff89015bde0 msgr2=0x7ff89014cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:23.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.134+0000 7ff897967640 1 --2- 172.21.15.6:0/377756994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff89015bde0 0x7ff89014cda0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff88800ebd0 tx=0x7ff88800c490 comp rx=0 tx=0).stop 2023-07-21T22:35:23.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.134+0000 7ff897967640 1 -- 172.21.15.6:0/377756994 shutdown_connections 2023-07-21T22:35:23.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.134+0000 7ff897967640 1 --2- 172.21.15.6:0/377756994 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7ff874066430 0x7ff8740688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.134+0000 7ff897967640 1 --2- 172.21.15.6:0/377756994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff89015bde0 0x7ff89014cda0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.134+0000 7ff897967640 1 --2- 172.21.15.6:0/377756994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8900d2fc0 0x7ff8900c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.134+0000 7ff897967640 1 --2- 172.21.15.6:0/377756994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8900d2300 0x7ff8900c5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.134+0000 7ff897967640 1 -- 172.21.15.6:0/377756994 >> 172.21.15.6:0/377756994 conn(0x7ff8900659d0 msgr2=0x7ff89006afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:23.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.134+0000 7ff897967640 1 -- 172.21.15.6:0/377756994 shutdown_connections 2023-07-21T22:35:23.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.134+0000 7ff897967640 1 -- 172.21.15.6:0/377756994 wait complete. 2023-07-21T22:35:23.214 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:35:23.244 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:23.194+0000 7f9411646180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:35:23.306 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:23.254+0000 7f9411646180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:35:23.387 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:35:23.388 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:35:23.388 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:35:23.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.342+0000 7f5748f40640 1 Processor -- start 2023-07-21T22:35:23.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.342+0000 7f5748f40640 1 -- start start 2023-07-21T22:35:23.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.342+0000 7f5748f40640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f57440d2fc0 0x7f57440b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:23.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.342+0000 7f5748f40640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f57440d2300 0x7f57440d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:23.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.342+0000 7f5748f40640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57440b04c0 con 0x7f574415bde0 2023-07-21T22:35:23.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.342+0000 7f5748f40640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574415c1b0 con 0x7f57440d2fc0 2023-07-21T22:35:23.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.342+0000 7f5748f40640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57440d2c80 con 0x7f57440d2300 2023-07-21T22:35:23.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.342+0000 7f5741d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f57440d2fc0 0x7f57440b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:23.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.342+0000 7f5741d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f57440d2fc0 0x7f57440b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58980/0 (socket says 172.21.15.6:58980) 2023-07-21T22:35:23.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.342+0000 7f5741d9b640 1 -- 172.21.15.6:0/953269281 learned_addr learned my addr 172.21.15.6:0/953269281 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:23.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.342+0000 7f5742d9d640 1 --2- 172.21.15.6:0/953269281 >> v2:172.21.15.161:3300/0 conn(0x7f57440d2300 0x7f57440d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:23.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.342+0000 7f5741d9b640 1 -- 172.21.15.6:0/953269281 >> v2:172.21.15.161:3300/0 conn(0x7f57440d2300 msgr2=0x7f57440d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:23.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.342+0000 7f5741d9b640 1 --2- 172.21.15.6:0/953269281 >> v2:172.21.15.161:3300/0 conn(0x7f57440d2300 0x7f57440d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.342+0000 7f5741d9b640 1 -- 172.21.15.6:0/953269281 >> v1:172.21.15.6:6789/0 conn(0x7f574415bde0 legacy=0x7f57440d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:23.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.342+0000 7f5741d9b640 1 -- 172.21.15.6:0/953269281 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57440d0aa0 con 0x7f57440d2fc0 2023-07-21T22:35:23.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.342+0000 7f574159a640 1 -- 172.21.15.6:0/953269281 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479507137 0 0) 0x7f57440b04c0 con 0x7f574415bde0 2023-07-21T22:35:23.396 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:23.347+0000 7f6a7a30b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:35:23.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.346+0000 7f5741d9b640 1 --2- 172.21.15.6:0/953269281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57440d2fc0 0x7f57440b0950 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f574408c820 tx=0x7f573801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa68a166ccd8d71d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:23.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.346+0000 7f574159a640 1 -- 172.21.15.6:0/953269281 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57380aa660 con 0x7f57440d2fc0 2023-07-21T22:35:23.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.346+0000 7f574159a640 1 -- 172.21.15.6:0/953269281 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57380aa7c0 con 0x7f57440d2fc0 2023-07-21T22:35:23.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.346+0000 7f574159a640 1 -- 172.21.15.6:0/953269281 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57380aab50 con 0x7f57440d2fc0 2023-07-21T22:35:23.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.346+0000 7f5748f40640 1 -- 172.21.15.6:0/953269281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57440d2fc0 msgr2=0x7f57440b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:23.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.346+0000 7f5748f40640 1 --2- 172.21.15.6:0/953269281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57440d2fc0 0x7f57440b0950 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f574408c820 tx=0x7f573801c500 comp rx=0 tx=0).stop 2023-07-21T22:35:23.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.346+0000 7f5748f40640 1 -- 172.21.15.6:0/953269281 shutdown_connections 2023-07-21T22:35:23.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.346+0000 7f5748f40640 1 --2- 172.21.15.6:0/953269281 >> v2:172.21.15.161:3300/0 conn(0x7f57440d2300 0x7f57440d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.346+0000 7f5748f40640 1 --2- 172.21.15.6:0/953269281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57440d2fc0 0x7f57440b0950 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.346+0000 7f5748f40640 1 -- 172.21.15.6:0/953269281 >> 172.21.15.6:0/953269281 conn(0x7f57440659d0 msgr2=0x7f574409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:23.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.350+0000 7f5748f40640 1 -- 172.21.15.6:0/953269281 shutdown_connections 2023-07-21T22:35:23.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.350+0000 7f5748f40640 1 -- 172.21.15.6:0/953269281 wait complete. 2023-07-21T22:35:23.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.350+0000 7f5748f40640 1 Processor -- start 2023-07-21T22:35:23.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.350+0000 7f5748f40640 1 -- start start 2023-07-21T22:35:23.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f5748f40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57440d2300 0x7f5744154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:23.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f5748f40640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57440d2fc0 0x7f574414c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:23.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f5748f40640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f574415bde0 0x7f574414caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:23.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f5748f40640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57440c8cc0 con 0x7f574415bde0 2023-07-21T22:35:23.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f5748f40640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574414d030 con 0x7f57440d2fc0 2023-07-21T22:35:23.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f5748f40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57440cc580 con 0x7f57440d2300 2023-07-21T22:35:23.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f5742d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f574415bde0 0x7f574414caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:23.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f5742d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f574415bde0 0x7f574414caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58988/0 (socket says 172.21.15.6:58988) 2023-07-21T22:35:23.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f5742d9d640 1 -- 172.21.15.6:0/3645186040 learned_addr learned my addr 172.21.15.6:0/3645186040 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:23.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f574259c640 1 --2- 172.21.15.6:0/3645186040 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57440d2300 0x7f5744154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:23.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f5741d9b640 1 --2- 172.21.15.6:0/3645186040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57440d2fc0 0x7f574414c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:23.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f574259c640 1 -- 172.21.15.6:0/3645186040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57440d2fc0 msgr2=0x7f574414c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:23.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f574259c640 1 --2- 172.21.15.6:0/3645186040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57440d2fc0 0x7f574414c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f574259c640 1 -- 172.21.15.6:0/3645186040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f574415bde0 msgr2=0x7f574414caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:23.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f574259c640 1 --2- 172.21.15.6:0/3645186040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f574415bde0 0x7f574414caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f574259c640 1 -- 172.21.15.6:0/3645186040 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57380094d0 con 0x7f57440d2300 2023-07-21T22:35:23.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f574259c640 1 --2- 172.21.15.6:0/3645186040 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57440d2300 0x7f5744154d60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f573400c3e0 tx=0x7f573400c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:23.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f5732ffd640 1 -- 172.21.15.6:0/3645186040 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57340054e0 con 0x7f57440d2300 2023-07-21T22:35:23.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f5732ffd640 1 -- 172.21.15.6:0/3645186040 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5734003600 con 0x7f57440d2300 2023-07-21T22:35:23.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f5748f40640 1 -- 172.21.15.6:0/3645186040 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57440c8320 con 0x7f57440d2300 2023-07-21T22:35:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f5732ffd640 1 -- 172.21.15.6:0/3645186040 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57340039d0 con 0x7f57440d2300 2023-07-21T22:35:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f5748f40640 1 -- 172.21.15.6:0/3645186040 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57440c88e0 con 0x7f57440d2300 2023-07-21T22:35:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.354+0000 7f5748f40640 1 -- 172.21.15.6:0/3645186040 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57440c8e00 con 0x7f57440d2300 2023-07-21T22:35:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.358+0000 7f5732ffd640 1 -- 172.21.15.6:0/3645186040 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 37) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f5734003b30 con 0x7f57440d2300 2023-07-21T22:35:23.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.358+0000 7f5732ffd640 1 --2- 172.21.15.6:0/3645186040 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f5724066430 0x7f57240688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:23.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.358+0000 7f5732ffd640 1 -- 172.21.15.6:0/3645186040 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f57340835f0 con 0x7f57440d2300 2023-07-21T22:35:23.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.358+0000 7f5741d9b640 1 -- 172.21.15.6:0/3645186040 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f5724066430 msgr2=0x7f57240688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3485676193 2023-07-21T22:35:23.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.358+0000 7f5741d9b640 1 --2- 172.21.15.6:0/3645186040 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f5724066430 0x7f57240688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:35:23.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.362+0000 7f5732ffd640 1 -- 172.21.15.6:0/3645186040 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5734050720 con 0x7f57440d2300 2023-07-21T22:35:23.529 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:23.483+0000 7f6a7a30b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:35:23.567 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:35:23.567 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:35:23.568 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:35:23.576 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:23.526+0000 7f9411646180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:35:23.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.558+0000 7f5748f40640 1 -- 172.21.15.6:0/3645186040 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f57440678d0 con 0x7f57440d2300 2023-07-21T22:35:23.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.558+0000 7f5732ffd640 1 -- 172.21.15.6:0/3645186040 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v99) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5734053d40 con 0x7f57440d2300 2023-07-21T22:35:23.610 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:35:23.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.562+0000 7f5741d9b640 1 -- 172.21.15.6:0/3645186040 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f5724066430 msgr2=0x7f57240688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3485676193 2023-07-21T22:35:23.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.562+0000 7f5741d9b640 1 --2- 172.21.15.6:0/3645186040 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f5724066430 0x7f57240688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:35:23.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.562+0000 7f5748f40640 1 -- 172.21.15.6:0/3645186040 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f5724066430 msgr2=0x7f57240688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:35:23.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.562+0000 7f5748f40640 1 --2- 172.21.15.6:0/3645186040 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f5724066430 0x7f57240688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.562+0000 7f5748f40640 1 -- 172.21.15.6:0/3645186040 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57440d2300 msgr2=0x7f5744154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:23.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.562+0000 7f5748f40640 1 --2- 172.21.15.6:0/3645186040 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57440d2300 0x7f5744154d60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f573400c3e0 tx=0x7f573400c8a0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.562+0000 7f5748f40640 1 -- 172.21.15.6:0/3645186040 shutdown_connections 2023-07-21T22:35:23.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.562+0000 7f5748f40640 1 --2- 172.21.15.6:0/3645186040 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f5724066430 0x7f57240688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.562+0000 7f5748f40640 1 --2- 172.21.15.6:0/3645186040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f574415bde0 0x7f574414caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.562+0000 7f5748f40640 1 --2- 172.21.15.6:0/3645186040 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57440d2fc0 0x7f574414c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.562+0000 7f5748f40640 1 --2- 172.21.15.6:0/3645186040 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57440d2300 0x7f5744154d60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.562+0000 7f5748f40640 1 -- 172.21.15.6:0/3645186040 >> 172.21.15.6:0/3645186040 conn(0x7f57440659d0 msgr2=0x7f57440b51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:23.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.562+0000 7f5748f40640 1 -- 172.21.15.6:0/3645186040 shutdown_connections 2023-07-21T22:35:23.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.562+0000 7f5748f40640 1 -- 172.21.15.6:0/3645186040 wait complete. 2023-07-21T22:35:23.632 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:35:23.653 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:23.607+0000 7f6a7a30b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:35:23.720 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:23.670+0000 7f9411646180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:35:23.723 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:23.675+0000 7f6a7a30b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:35:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.726+0000 7f004e40b640 1 Processor -- start 2023-07-21T22:35:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.730+0000 7f004e40b640 1 -- start start 2023-07-21T22:35:23.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.730+0000 7f004e40b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00480b7c70 0x7f00480d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:23.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.730+0000 7f004e40b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00480ccaf0 con 0x7f00480d1850 2023-07-21T22:35:23.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.730+0000 7f004e40b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0048160320 con 0x7f004815fd60 2023-07-21T22:35:23.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.730+0000 7f004e40b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00480d1190 con 0x7f00480b7c70 2023-07-21T22:35:23.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.730+0000 7f0047fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00480b7c70 0x7f00480d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:23.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.730+0000 7f0047fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00480b7c70 0x7f00480d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58996/0 (socket says 172.21.15.6:58996) 2023-07-21T22:35:23.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.730+0000 7f0047fff640 1 -- 172.21.15.6:0/1099366913 learned_addr learned my addr 172.21.15.6:0/1099366913 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:23.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.730+0000 7f0047fff640 1 -- 172.21.15.6:0/1099366913 >> v1:172.21.15.161:6789/0 conn(0x7f004815fd60 legacy=0x7f00480d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:23.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.730+0000 7f0047fff640 1 -- 172.21.15.6:0/1099366913 >> v1:172.21.15.6:6789/0 conn(0x7f00480d1850 legacy=0x7f004815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:23.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.730+0000 7f0047fff640 1 -- 172.21.15.6:0/1099366913 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00480ccd90 con 0x7f00480b7c70 2023-07-21T22:35:23.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.730+0000 7f0046ffd640 1 -- 172.21.15.6:0/1099366913 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294696627 0 0) 0x7f00480ccaf0 con 0x7f00480d1850 2023-07-21T22:35:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.734+0000 7f0047fff640 1 --2- 172.21.15.6:0/1099366913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00480b7c70 0x7f00480d0c50 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f0038009870 tx=0x7f003801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53cebbc503d97282 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.734+0000 7f0046ffd640 1 -- 172.21.15.6:0/1099366913 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00380ab650 con 0x7f00480b7c70 2023-07-21T22:35:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.734+0000 7f0046ffd640 1 -- 172.21.15.6:0/1099366913 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00380ab7b0 con 0x7f00480b7c70 2023-07-21T22:35:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.734+0000 7f0046ffd640 1 -- 172.21.15.6:0/1099366913 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00380abb40 con 0x7f00480b7c70 2023-07-21T22:35:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.734+0000 7f004e40b640 1 -- 172.21.15.6:0/1099366913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00480b7c70 msgr2=0x7f00480d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.734+0000 7f004e40b640 1 --2- 172.21.15.6:0/1099366913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00480b7c70 0x7f00480d0c50 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f0038009870 tx=0x7f003801c540 comp rx=0 tx=0).stop 2023-07-21T22:35:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.734+0000 7f004e40b640 1 -- 172.21.15.6:0/1099366913 shutdown_connections 2023-07-21T22:35:23.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.734+0000 7f004e40b640 1 --2- 172.21.15.6:0/1099366913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00480b7c70 0x7f00480d0c50 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.734+0000 7f004e40b640 1 -- 172.21.15.6:0/1099366913 >> 172.21.15.6:0/1099366913 conn(0x7f00480650b0 msgr2=0x7f00480654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:23.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.734+0000 7f004e40b640 1 -- 172.21.15.6:0/1099366913 shutdown_connections 2023-07-21T22:35:23.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.734+0000 7f004e40b640 1 -- 172.21.15.6:0/1099366913 wait complete. 2023-07-21T22:35:23.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.734+0000 7f004e40b640 1 Processor -- start 2023-07-21T22:35:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f004e40b640 1 -- start start 2023-07-21T22:35:23.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f004e40b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00480b7c70 0x7f0048153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:23.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f004e40b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00480d1850 0x7f00480b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:23.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f004e40b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f004815fd60 0x7f0048157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:23.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f004e40b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00480b3270 con 0x7f00480b7c70 2023-07-21T22:35:23.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f004e40b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00481535d0 con 0x7f00480d1850 2023-07-21T22:35:23.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f004e40b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00480b2a10 con 0x7f004815fd60 2023-07-21T22:35:23.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f0047fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00480b7c70 0x7f0048153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:23.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f0047fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00480b7c70 0x7f0048153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59002/0 (socket says 172.21.15.6:59002) 2023-07-21T22:35:23.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f0047fff640 1 -- 172.21.15.6:0/1615592202 learned_addr learned my addr 172.21.15.6:0/1615592202 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:23.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f00477fe640 1 --2- 172.21.15.6:0/1615592202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00480d1850 0x7f00480b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:23.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f004c9a8640 1 --2- 172.21.15.6:0/1615592202 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f004815fd60 0x7f0048157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:23.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f0047fff640 1 -- 172.21.15.6:0/1615592202 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f004815fd60 msgr2=0x7f0048157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:23.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f0047fff640 1 --2- 172.21.15.6:0/1615592202 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f004815fd60 0x7f0048157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f0047fff640 1 -- 172.21.15.6:0/1615592202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00480d1850 msgr2=0x7f00480b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:23.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f0047fff640 1 --2- 172.21.15.6:0/1615592202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00480d1850 0x7f00480b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f0047fff640 1 -- 172.21.15.6:0/1615592202 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00380094d0 con 0x7f00480b7c70 2023-07-21T22:35:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f0047fff640 1 --2- 172.21.15.6:0/1615592202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00480b7c70 0x7f0048153090 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0038009870 tx=0x7f003801ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f0044ff9640 1 -- 172.21.15.6:0/1615592202 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038004230 con 0x7f00480b7c70 2023-07-21T22:35:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f0044ff9640 1 -- 172.21.15.6:0/1615592202 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00380b8070 con 0x7f00480b7c70 2023-07-21T22:35:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f0044ff9640 1 -- 172.21.15.6:0/1615592202 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038003620 con 0x7f00480b7c70 2023-07-21T22:35:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f004e40b640 1 -- 172.21.15.6:0/1615592202 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00480b2cb0 con 0x7f00480b7c70 2023-07-21T22:35:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.738+0000 7f004e40b640 1 -- 172.21.15.6:0/1615592202 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0048152890 con 0x7f00480b7c70 2023-07-21T22:35:23.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.742+0000 7f004e40b640 1 -- 172.21.15.6:0/1615592202 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00480678d0 con 0x7f00480b7c70 2023-07-21T22:35:23.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.742+0000 7f0044ff9640 1 -- 172.21.15.6:0/1615592202 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 37) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f0038003780 con 0x7f00480b7c70 2023-07-21T22:35:23.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.742+0000 7f0044ff9640 1 --2- 172.21.15.6:0/1615592202 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f0034066430 0x7f00340688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:23.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.742+0000 7f0044ff9640 1 -- 172.21.15.6:0/1615592202 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f003811e460 con 0x7f00480b7c70 2023-07-21T22:35:23.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.742+0000 7f00477fe640 1 -- 172.21.15.6:0/1615592202 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f0034066430 msgr2=0x7f00340688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3485676193 2023-07-21T22:35:23.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.742+0000 7f00477fe640 1 --2- 172.21.15.6:0/1615592202 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f0034066430 0x7f00340688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:35:23.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.746+0000 7f0044ff9640 1 -- 172.21.15.6:0/1615592202 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00380eb6b0 con 0x7f00480b7c70 2023-07-21T22:35:23.857 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:23.811+0000 7f6a7a30b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:35:23.857 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:23.806+0000 7f9411646180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:35:23.931 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:23.882+0000 7f9411646180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:35:23.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.914+0000 7f004e40b640 1 -- 172.21.15.6:0/1615592202 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f00480730b0 con 0x7f00480b7c70 2023-07-21T22:35:23.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.914+0000 7f0044ff9640 1 -- 172.21.15.6:0/1615592202 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v99) v1 ==== 80+0+477 (secure 0 0 0) 0x7f00380eecd0 con 0x7f00480b7c70 2023-07-21T22:35:23.966 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/2603665139 2023-07-22T22:35:19.216600+0000 2023-07-21T22:35:23.966 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/2022432677 2023-07-22T22:35:19.216600+0000 2023-07-21T22:35:23.966 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/567935630 2023-07-22T22:35:19.216600+0000 2023-07-21T22:35:23.966 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/2968204385 2023-07-22T22:35:19.216600+0000 2023-07-21T22:35:23.966 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/2475523917 2023-07-22T22:35:19.216600+0000 2023-07-21T22:35:23.966 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/1706579505 2023-07-22T22:35:19.216600+0000 2023-07-21T22:35:23.967 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6833/3267017989 2023-07-22T22:35:19.216600+0000 2023-07-21T22:35:23.967 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6832/3267017989 2023-07-22T22:35:19.216600+0000 2023-07-21T22:35:23.967 INFO:teuthology.orchestra.run.smithi006.stderr:listed 8 entries 2023-07-21T22:35:23.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.918+0000 7f004e40b640 1 -- 172.21.15.6:0/1615592202 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f0034066430 msgr2=0x7f00340688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:35:23.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.918+0000 7f004e40b640 1 --2- 172.21.15.6:0/1615592202 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f0034066430 0x7f00340688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.918+0000 7f004e40b640 1 -- 172.21.15.6:0/1615592202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00480b7c70 msgr2=0x7f0048153090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:23.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.918+0000 7f004e40b640 1 --2- 172.21.15.6:0/1615592202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00480b7c70 0x7f0048153090 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0038009870 tx=0x7f003801ad80 comp rx=0 tx=0).stop 2023-07-21T22:35:23.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.918+0000 7f004e40b640 1 -- 172.21.15.6:0/1615592202 shutdown_connections 2023-07-21T22:35:23.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.918+0000 7f004e40b640 1 --2- 172.21.15.6:0/1615592202 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f0034066430 0x7f00340688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.918+0000 7f004e40b640 1 --2- 172.21.15.6:0/1615592202 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f004815fd60 0x7f0048157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.918+0000 7f004e40b640 1 --2- 172.21.15.6:0/1615592202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00480d1850 0x7f00480b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.918+0000 7f004e40b640 1 --2- 172.21.15.6:0/1615592202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00480b7c70 0x7f0048153090 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:23.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.918+0000 7f004e40b640 1 -- 172.21.15.6:0/1615592202 >> 172.21.15.6:0/1615592202 conn(0x7f00480650b0 msgr2=0x7f00480b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:23.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.918+0000 7f004e40b640 1 -- 172.21.15.6:0/1615592202 shutdown_connections 2023-07-21T22:35:23.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:23.918+0000 7f004e40b640 1 -- 172.21.15.6:0/1615592202 wait complete. 2023-07-21T22:35:23.988 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-21T22:35:23.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:35:23.988 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-21T22:35:24.039 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:35:24.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:35:24.040 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T22:35:24.049 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:35:24.050 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:35:24.059 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:35:24.059 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:35:24.060 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:35:24.077 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:24.026+0000 7f9411646180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:35:24.085 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:35:24.086 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:35:24.086 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:35:24.108 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:35:24.109 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:35:24.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.218+0000 7f899ae34640 1 Processor -- start 2023-07-21T22:35:24.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.218+0000 7f899ae34640 1 -- start start 2023-07-21T22:35:24.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.222+0000 7f899ae34640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8994158ce0 0x7f8994070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:24.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.222+0000 7f899ae34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89940c9730 0x7f89940ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:24.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.222+0000 7f899ae34640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89940cc700 con 0x7f89940c8ad0 2023-07-21T22:35:24.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.222+0000 7f899ae34640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89940b0ff0 con 0x7f8994158ce0 2023-07-21T22:35:24.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.222+0000 7f899ae34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8994070c80 con 0x7f89940c9730 2023-07-21T22:35:24.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.222+0000 7f8993fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f89940c8ad0 0x7f89940c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46602/0 (socket says 172.21.15.6:46602) 2023-07-21T22:35:24.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.222+0000 7f8993fff640 1 -- 172.21.15.6:0/968309537 learned_addr learned my addr 172.21.15.6:0/968309537 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:24.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.222+0000 7f8998bd0640 1 --2- 172.21.15.6:0/968309537 >> v2:172.21.15.161:3300/0 conn(0x7f8994158ce0 0x7f8994070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:24.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.222+0000 7f89993d1640 1 --2- 172.21.15.6:0/968309537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89940c9730 0x7f89940ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:24.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.222+0000 7f89937fe640 1 -- 172.21.15.6:0/968309537 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143052517 0 0) 0x7f89940cc700 con 0x7f89940c8ad0 2023-07-21T22:35:24.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.222+0000 7f89937fe640 1 -- 172.21.15.6:0/968309537 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8984003530 con 0x7f89940c8ad0 2023-07-21T22:35:24.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.222+0000 7f8998bd0640 1 -- 172.21.15.6:0/968309537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89940c9730 msgr2=0x7f89940ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:24.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.222+0000 7f8998bd0640 1 --2- 172.21.15.6:0/968309537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89940c9730 0x7f89940ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.222+0000 7f8998bd0640 1 -- 172.21.15.6:0/968309537 >> v1:172.21.15.6:6789/0 conn(0x7f89940c8ad0 legacy=0x7f89940c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:24.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.222+0000 7f8998bd0640 1 -- 172.21.15.6:0/968309537 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89940cbdd0 con 0x7f8994158ce0 2023-07-21T22:35:24.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.222+0000 7f89993d1640 1 --2- 172.21.15.6:0/968309537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89940c9730 0x7f89940ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.226+0000 7f8998bd0640 1 --2- 172.21.15.6:0/968309537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8994158ce0 0x7f8994070450 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f89880097c0 tx=0x7f898801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eee5971b0ab445fd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.226+0000 7f89937fe640 1 -- 172.21.15.6:0/968309537 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89880ab600 con 0x7f8994158ce0 2023-07-21T22:35:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.226+0000 7f89937fe640 1 -- 172.21.15.6:0/968309537 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89880a7050 con 0x7f8994158ce0 2023-07-21T22:35:24.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.226+0000 7f89937fe640 1 -- 172.21.15.6:0/968309537 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89880ab960 con 0x7f8994158ce0 2023-07-21T22:35:24.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.226+0000 7f899ae34640 1 -- 172.21.15.6:0/968309537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8994158ce0 msgr2=0x7f8994070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:24.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.226+0000 7f899ae34640 1 --2- 172.21.15.6:0/968309537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8994158ce0 0x7f8994070450 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f89880097c0 tx=0x7f898801c330 comp rx=0 tx=0).stop 2023-07-21T22:35:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.226+0000 7f899ae34640 1 -- 172.21.15.6:0/968309537 shutdown_connections 2023-07-21T22:35:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.226+0000 7f899ae34640 1 --2- 172.21.15.6:0/968309537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89940c9730 0x7f89940ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.226+0000 7f899ae34640 1 --2- 172.21.15.6:0/968309537 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8994158ce0 0x7f8994070450 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.226+0000 7f899ae34640 1 -- 172.21.15.6:0/968309537 >> 172.21.15.6:0/968309537 conn(0x7f89940afcf0 msgr2=0x7f89940b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.226+0000 7f899ae34640 1 -- 172.21.15.6:0/968309537 shutdown_connections 2023-07-21T22:35:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.226+0000 7f899ae34640 1 -- 172.21.15.6:0/968309537 wait complete. 2023-07-21T22:35:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.226+0000 7f899ae34640 1 Processor -- start 2023-07-21T22:35:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f899ae34640 1 -- start start 2023-07-21T22:35:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f899ae34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89940c8ad0 0x7f899415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f899ae34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89940c9730 0x7f899414b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f899ae34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8994158ce0 0x7f8994150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:24.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f899ae34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899415ab30 con 0x7f8994158ce0 2023-07-21T22:35:24.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f899ae34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8994153a80 con 0x7f89940c8ad0 2023-07-21T22:35:24.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f899ae34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899415ad10 con 0x7f89940c9730 2023-07-21T22:35:24.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f89993d1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8994158ce0 0x7f8994150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:24.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f89993d1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8994158ce0 0x7f8994150670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59012/0 (socket says 172.21.15.6:59012) 2023-07-21T22:35:24.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f89993d1640 1 -- 172.21.15.6:0/2482011179 learned_addr learned my addr 172.21.15.6:0/2482011179 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:24.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f8998bd0640 1 --2- 172.21.15.6:0/2482011179 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89940c8ad0 0x7f899415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f8993fff640 1 --2- 172.21.15.6:0/2482011179 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89940c9730 0x7f899414b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f89993d1640 1 -- 172.21.15.6:0/2482011179 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89940c9730 msgr2=0x7f899414b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f89993d1640 1 --2- 172.21.15.6:0/2482011179 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89940c9730 0x7f899414b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f89993d1640 1 -- 172.21.15.6:0/2482011179 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89940c8ad0 msgr2=0x7f899415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f89993d1640 1 --2- 172.21.15.6:0/2482011179 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89940c8ad0 0x7f899415bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f89993d1640 1 -- 172.21.15.6:0/2482011179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c009a70 con 0x7f8994158ce0 2023-07-21T22:35:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f8993fff640 1 --2- 172.21.15.6:0/2482011179 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89940c9730 0x7f899414b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f89993d1640 1 --2- 172.21.15.6:0/2482011179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8994158ce0 0x7f8994150670 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f898c00efc0 tx=0x7f898c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f89917fa640 1 -- 172.21.15.6:0/2482011179 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c00cdf0 con 0x7f8994158ce0 2023-07-21T22:35:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f89917fa640 1 -- 172.21.15.6:0/2482011179 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c00f040 con 0x7f8994158ce0 2023-07-21T22:35:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f899ae34640 1 -- 172.21.15.6:0/2482011179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8988009420 con 0x7f8994158ce0 2023-07-21T22:35:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f89917fa640 1 -- 172.21.15.6:0/2482011179 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c003be0 con 0x7f8994158ce0 2023-07-21T22:35:24.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f899ae34640 1 -- 172.21.15.6:0/2482011179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899415b2d0 con 0x7f8994158ce0 2023-07-21T22:35:24.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.230+0000 7f899ae34640 1 -- 172.21.15.6:0/2482011179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89940ca1a0 con 0x7f8994158ce0 2023-07-21T22:35:24.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.234+0000 7f89917fa640 1 -- 172.21.15.6:0/2482011179 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 37) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f898c03a030 con 0x7f8994158ce0 2023-07-21T22:35:24.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.234+0000 7f89917fa640 1 --2- 172.21.15.6:0/2482011179 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f8978066460 0x7f8978068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:24.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.234+0000 7f89917fa640 1 -- 172.21.15.6:0/2482011179 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f898c085990 con 0x7f8994158ce0 2023-07-21T22:35:24.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.234+0000 7f8998bd0640 1 -- 172.21.15.6:0/2482011179 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f8978066460 msgr2=0x7f8978068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3485676193 2023-07-21T22:35:24.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.234+0000 7f8998bd0640 1 --2- 172.21.15.6:0/2482011179 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f8978066460 0x7f8978068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:35:24.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.238+0000 7f89917fa640 1 -- 172.21.15.6:0/2482011179 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f898c0528d0 con 0x7f8994158ce0 2023-07-21T22:35:24.395 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:24.347+0000 7f6a7a30b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:35:24.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.426+0000 7f899ae34640 1 -- 172.21.15.6:0/2482011179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89940b0810 con 0x7f8994158ce0 2023-07-21T22:35:24.479 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:24.431+0000 7f6a7a30b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:35:24.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.426+0000 7f89917fa640 1 -- 172.21.15.6:0/2482011179 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4670 (secure 0 0 0) 0x7f898c055ef0 con 0x7f8994158ce0 2023-07-21T22:35:24.480 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:24.480 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/750234701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":750234701},{"type":"v1","addr":"172.21.15.6:6835","nonce":750234701}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1418940969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1418940969},{"type":"v1","addr":"172.21.15.161:6837","nonce":1418940969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6976,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3127204881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3127204881},{"type":"v1","addr":"172.21.15.161:6836","nonce":3127204881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:35:02.102268+0000","modified":"2023-07-21T22:35:05.730598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7131},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7131":{"gid":7131,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/4157903762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4157903762},{"type":"v1","addr":"172.21.15.6:6833","nonce":4157903762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-21T22:35:24.482 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 39 2023-07-21T22:35:24.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.430+0000 7f899ae34640 1 -- 172.21.15.6:0/2482011179 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f8978066460 msgr2=0x7f8978068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:35:24.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.430+0000 7f899ae34640 1 --2- 172.21.15.6:0/2482011179 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f8978066460 0x7f8978068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.430+0000 7f899ae34640 1 -- 172.21.15.6:0/2482011179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8994158ce0 msgr2=0x7f8994150670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:24.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.430+0000 7f899ae34640 1 --2- 172.21.15.6:0/2482011179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8994158ce0 0x7f8994150670 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f898c00efc0 tx=0x7f898c00c490 comp rx=0 tx=0).stop 2023-07-21T22:35:24.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.430+0000 7f899ae34640 1 -- 172.21.15.6:0/2482011179 shutdown_connections 2023-07-21T22:35:24.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.430+0000 7f899ae34640 1 --2- 172.21.15.6:0/2482011179 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f8978066460 0x7f8978068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.430+0000 7f899ae34640 1 --2- 172.21.15.6:0/2482011179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8994158ce0 0x7f8994150670 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.430+0000 7f899ae34640 1 --2- 172.21.15.6:0/2482011179 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89940c9730 0x7f899414b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.430+0000 7f899ae34640 1 --2- 172.21.15.6:0/2482011179 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89940c8ad0 0x7f899415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.430+0000 7f899ae34640 1 -- 172.21.15.6:0/2482011179 >> 172.21.15.6:0/2482011179 conn(0x7f89940afcf0 msgr2=0x7f89940ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:24.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.430+0000 7f899ae34640 1 -- 172.21.15.6:0/2482011179 shutdown_connections 2023-07-21T22:35:24.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.430+0000 7f899ae34640 1 -- 172.21.15.6:0/2482011179 wait complete. 2023-07-21T22:35:24.502 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:35:24.624 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:24.575+0000 7f6a7a30b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:35:24.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.594+0000 7f4cdbbad640 1 Processor -- start 2023-07-21T22:35:24.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.594+0000 7f4cdbbad640 1 -- start start 2023-07-21T22:35:24.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.598+0000 7f4cdbbad640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4cd40b7c70 0x7f4cd40d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:24.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.598+0000 7f4cdbbad640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4cd415fd60 0x7f4cd40d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:24.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.598+0000 7f4cdbbad640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd40ccaf0 con 0x7f4cd40d1850 2023-07-21T22:35:24.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.598+0000 7f4cdbbad640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd40d1190 con 0x7f4cd40b7c70 2023-07-21T22:35:24.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.598+0000 7f4cdbbad640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd4160600 con 0x7f4cd415fd60 2023-07-21T22:35:24.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.598+0000 7f4cd9949640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4cd40b7c70 0x7f4cd40d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:24.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.598+0000 7f4cd9949640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4cd40b7c70 0x7f4cd40d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59026/0 (socket says 172.21.15.6:59026) 2023-07-21T22:35:24.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.598+0000 7f4cd9949640 1 -- 172.21.15.6:0/3960240094 learned_addr learned my addr 172.21.15.6:0/3960240094 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:24.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.598+0000 7f4cda14a640 1 --2- 172.21.15.6:0/3960240094 >> v2:172.21.15.161:3300/0 conn(0x7f4cd415fd60 0x7f4cd40d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:24.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.598+0000 7f4cd9949640 1 -- 172.21.15.6:0/3960240094 >> v2:172.21.15.161:3300/0 conn(0x7f4cd415fd60 msgr2=0x7f4cd40d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:24.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.598+0000 7f4cd9949640 1 --2- 172.21.15.6:0/3960240094 >> v2:172.21.15.161:3300/0 conn(0x7f4cd415fd60 0x7f4cd40d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.598+0000 7f4cd9949640 1 -- 172.21.15.6:0/3960240094 >> v1:172.21.15.161:6789/0 conn(0x7f4cd40d1850 legacy=0x7f4cd415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:24.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.598+0000 7f4cd9949640 1 -- 172.21.15.6:0/3960240094 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd4160320 con 0x7f4cd40b7c70 2023-07-21T22:35:24.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.602+0000 7f4cd9949640 1 --2- 172.21.15.6:0/3960240094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cd40b7c70 0x7f4cd40d0c50 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f4cd40b4040 tx=0x7f4cd001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41d2bd96ddf01b1e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:24.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.602+0000 7f4cd8947640 1 -- 172.21.15.6:0/3960240094 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd00aa650 con 0x7f4cd40b7c70 2023-07-21T22:35:24.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.602+0000 7f4cd8947640 1 -- 172.21.15.6:0/3960240094 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd00aa7b0 con 0x7f4cd40b7c70 2023-07-21T22:35:24.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.602+0000 7f4cd8947640 1 -- 172.21.15.6:0/3960240094 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd00aab40 con 0x7f4cd40b7c70 2023-07-21T22:35:24.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.602+0000 7f4cdbbad640 1 -- 172.21.15.6:0/3960240094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cd40b7c70 msgr2=0x7f4cd40d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:24.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.602+0000 7f4cdbbad640 1 --2- 172.21.15.6:0/3960240094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cd40b7c70 0x7f4cd40d0c50 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f4cd40b4040 tx=0x7f4cd001c4d0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.602+0000 7f4cdbbad640 1 -- 172.21.15.6:0/3960240094 shutdown_connections 2023-07-21T22:35:24.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.602+0000 7f4cdbbad640 1 --2- 172.21.15.6:0/3960240094 >> v2:172.21.15.161:3300/0 conn(0x7f4cd415fd60 0x7f4cd40d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.602+0000 7f4cdbbad640 1 --2- 172.21.15.6:0/3960240094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cd40b7c70 0x7f4cd40d0c50 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.602+0000 7f4cdbbad640 1 -- 172.21.15.6:0/3960240094 >> 172.21.15.6:0/3960240094 conn(0x7f4cd40650b0 msgr2=0x7f4cd40654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:24.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.602+0000 7f4cdbbad640 1 -- 172.21.15.6:0/3960240094 shutdown_connections 2023-07-21T22:35:24.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.602+0000 7f4cdbbad640 1 -- 172.21.15.6:0/3960240094 wait complete. 2023-07-21T22:35:24.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.602+0000 7f4cdbbad640 1 Processor -- start 2023-07-21T22:35:24.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.602+0000 7f4cdbbad640 1 -- start start 2023-07-21T22:35:24.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cdbbad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cd40b7c70 0x7f4cd415e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cdbbad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4cd40d1850 0x7f4cd4159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cdbbad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cd415fd60 0x7f4cd415a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cdbbad640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd415e860 con 0x7f4cd415fd60 2023-07-21T22:35:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cdbbad640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd40b6f40 con 0x7f4cd40b7c70 2023-07-21T22:35:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cdbbad640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd415ea90 con 0x7f4cd40d1850 2023-07-21T22:35:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cda14a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cd415fd60 0x7f4cd415a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cd9949640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cd40b7c70 0x7f4cd415e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cd9949640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cd40b7c70 0x7f4cd415e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35234/0 (socket says 172.21.15.6:35234) 2023-07-21T22:35:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cd9949640 1 -- 172.21.15.6:0/1948457923 learned_addr learned my addr 172.21.15.6:0/1948457923 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cd9148640 1 --2- 172.21.15.6:0/1948457923 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4cd40d1850 0x7f4cd4159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cd9949640 1 -- 172.21.15.6:0/1948457923 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4cd40d1850 msgr2=0x7f4cd4159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cd9949640 1 --2- 172.21.15.6:0/1948457923 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4cd40d1850 0x7f4cd4159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cd9949640 1 -- 172.21.15.6:0/1948457923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cd415fd60 msgr2=0x7f4cd415a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:24.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cd9949640 1 --2- 172.21.15.6:0/1948457923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cd415fd60 0x7f4cd415a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cd9949640 1 -- 172.21.15.6:0/1948457923 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd00094d0 con 0x7f4cd40b7c70 2023-07-21T22:35:24.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cd9949640 1 --2- 172.21.15.6:0/1948457923 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cd40b7c70 0x7f4cd415e320 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4cd00ac040 tx=0x7f4cd001ad10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:24.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cca7fc640 1 -- 172.21.15.6:0/1948457923 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd00b3800 con 0x7f4cd40b7c70 2023-07-21T22:35:24.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cca7fc640 1 -- 172.21.15.6:0/1948457923 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd00b3980 con 0x7f4cd40b7c70 2023-07-21T22:35:24.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cca7fc640 1 -- 172.21.15.6:0/1948457923 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd00b3d30 con 0x7f4cd40b7c70 2023-07-21T22:35:24.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cdbbad640 1 -- 172.21.15.6:0/1948457923 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd415ed70 con 0x7f4cd40b7c70 2023-07-21T22:35:24.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cdbbad640 1 -- 172.21.15.6:0/1948457923 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd4154570 con 0x7f4cd40b7c70 2023-07-21T22:35:24.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.606+0000 7f4cdbbad640 1 -- 172.21.15.6:0/1948457923 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd41540f0 con 0x7f4cd40b7c70 2023-07-21T22:35:24.662 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:24.610+0000 7f9411646180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:35:24.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.610+0000 7f4cca7fc640 1 -- 172.21.15.6:0/1948457923 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 37) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f4cd00b2380 con 0x7f4cd40b7c70 2023-07-21T22:35:24.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.610+0000 7f4cca7fc640 1 --2- 172.21.15.6:0/1948457923 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f4cb8066430 0x7f4cb80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:24.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.610+0000 7f4cca7fc640 1 -- 172.21.15.6:0/1948457923 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f4cd011e8c0 con 0x7f4cd40b7c70 2023-07-21T22:35:24.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.610+0000 7f4cd9148640 1 -- 172.21.15.6:0/1948457923 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f4cb8066430 msgr2=0x7f4cb80688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3485676193 2023-07-21T22:35:24.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.610+0000 7f4cd9148640 1 --2- 172.21.15.6:0/1948457923 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f4cb8066430 0x7f4cb80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:35:24.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.614+0000 7f4cca7fc640 1 -- 172.21.15.6:0/1948457923 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4cd41540f0 con 0x7f4cd40b7c70 2023-07-21T22:35:24.708 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:24.659+0000 7f6a7a30b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:35:24.750 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:24.698+0000 7f9411646180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:35:24.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.770+0000 7f4cdbbad640 1 -- 172.21.15.6:0/1948457923 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4cd41540f0 con 0x7f4cd40b7c70 2023-07-21T22:35:24.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.774+0000 7f4cca7fc640 1 -- 172.21.15.6:0/1948457923 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+18860 (secure 0 0 0) 0x7f4cd41540f0 con 0x7f4cd40b7c70 2023-07-21T22:35:24.824 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:24.824 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":99,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:35:19.216652+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:35:00.223294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-21T22:35:01.098128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/2603665139":"2023-07-22T22:35:19.216600+0000","172.21.15.161:0/2022432677":"2023-07-22T22:35:19.216600+0000","172.21.15.161:0/567935630":"2023-07-22T22:35:19.216600+0000","172.21.15.161:0/2968204385":"2023-07-22T22:35:19.216600+0000","172.21.15.161:0/2475523917":"2023-07-22T22:35:19.216600+0000","172.21.15.161:0/1706579505":"2023-07-22T22:35:19.216600+0000","172.21.15.161:6833/3267017989":"2023-07-22T22:35:19.216600+0000","172.21.15.161:6832/3267017989":"2023-07-22T22:35:19.216600+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:35:24.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.774+0000 7f4cdbbad640 1 -- 172.21.15.6:0/1948457923 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f4cb8066430 msgr2=0x7f4cb80688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:35:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.774+0000 7f4cdbbad640 1 --2- 172.21.15.6:0/1948457923 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f4cb8066430 0x7f4cb80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.774+0000 7f4cdbbad640 1 -- 172.21.15.6:0/1948457923 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cd40b7c70 msgr2=0x7f4cd415e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.774+0000 7f4cdbbad640 1 --2- 172.21.15.6:0/1948457923 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cd40b7c70 0x7f4cd415e320 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4cd00ac040 tx=0x7f4cd001ad10 comp rx=0 tx=0).stop 2023-07-21T22:35:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.774+0000 7f4cdbbad640 1 -- 172.21.15.6:0/1948457923 shutdown_connections 2023-07-21T22:35:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.774+0000 7f4cdbbad640 1 --2- 172.21.15.6:0/1948457923 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7f4cb8066430 0x7f4cb80688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.774+0000 7f4cdbbad640 1 --2- 172.21.15.6:0/1948457923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4cd415fd60 0x7f4cd415a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.774+0000 7f4cdbbad640 1 --2- 172.21.15.6:0/1948457923 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4cd40d1850 0x7f4cd4159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.774+0000 7f4cdbbad640 1 --2- 172.21.15.6:0/1948457923 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cd40b7c70 0x7f4cd415e320 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:24.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.774+0000 7f4cdbbad640 1 -- 172.21.15.6:0/1948457923 >> 172.21.15.6:0/1948457923 conn(0x7f4cd40650b0 msgr2=0x7f4cd40cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:24.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.774+0000 7f4cdbbad640 1 -- 172.21.15.6:0/1948457923 shutdown_connections 2023-07-21T22:35:24.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.774+0000 7f4cdbbad640 1 -- 172.21.15.6:0/1948457923 wait complete. 2023-07-21T22:35:24.846 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:35:00.223294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:35:01.098128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:35:24.847 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:35:24.908 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:24.858+0000 7f9411646180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:35:24.976 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:24.927+0000 7f6a7a30b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:35:24.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.946+0000 7ff663434640 1 Processor -- start 2023-07-21T22:35:24.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.946+0000 7ff663434640 1 -- start start 2023-07-21T22:35:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.946+0000 7ff663434640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff65c15bde0 0x7ff65c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.946+0000 7ff663434640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff65c0d2fc0 0x7ff65c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.946+0000 7ff663434640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff65c0d2300 0x7ff65c0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.946+0000 7ff663434640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65c0d2ce0 con 0x7ff65c0d2300 2023-07-21T22:35:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.946+0000 7ff663434640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65c15c1b0 con 0x7ff65c0d2fc0 2023-07-21T22:35:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.946+0000 7ff663434640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0b04c0 con 0x7ff65c15bde0 2023-07-21T22:35:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.946+0000 7ff6619d1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff65c0d2300 0x7ff65c0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.946+0000 7ff6609cf640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff65c0d2fc0 0x7ff65c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.946+0000 7ff6609cf640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff65c0d2fc0 0x7ff65c0b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35238/0 (socket says 172.21.15.6:35238) 2023-07-21T22:35:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.946+0000 7ff6619d1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff65c0d2300 0x7ff65c0d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59034/0 (socket says 172.21.15.6:59034) 2023-07-21T22:35:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.946+0000 7ff6609cf640 1 -- 172.21.15.6:0/3879564749 learned_addr learned my addr 172.21.15.6:0/3879564749 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:24.999 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:24.946+0000 7f9411646180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:35:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.946+0000 7ff6611d0640 1 --2- 172.21.15.6:0/3879564749 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff65c15bde0 0x7ff65c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.946+0000 7ff6619d1640 1 -- 172.21.15.6:0/3879564749 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff65c15bde0 msgr2=0x7ff65c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.946+0000 7ff6619d1640 1 --2- 172.21.15.6:0/3879564749 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff65c15bde0 0x7ff65c0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.946+0000 7ff6619d1640 1 -- 172.21.15.6:0/3879564749 >> v2:172.21.15.161:3300/0 conn(0x7ff65c0d2fc0 msgr2=0x7ff65c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:25.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.946+0000 7ff6619d1640 1 --2- 172.21.15.6:0/3879564749 >> v2:172.21.15.161:3300/0 conn(0x7ff65c0d2fc0 0x7ff65c0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.946+0000 7ff6619d1640 1 -- 172.21.15.6:0/3879564749 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65c0d0aa0 con 0x7ff65c0d2300 2023-07-21T22:35:25.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.954+0000 7ff6619d1640 1 --2- 172.21.15.6:0/3879564749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff65c0d2300 0x7ff65c0d27a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ff65c08af30 tx=0x7ff65401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1471cd4924f208b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:25.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.954+0000 7ff653fff640 1 -- 172.21.15.6:0/3879564749 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6540a5990 con 0x7ff65c0d2300 2023-07-21T22:35:25.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.954+0000 7ff653fff640 1 -- 172.21.15.6:0/3879564749 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6540a5af0 con 0x7ff65c0d2300 2023-07-21T22:35:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.954+0000 7ff653fff640 1 -- 172.21.15.6:0/3879564749 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6540a5e80 con 0x7ff65c0d2300 2023-07-21T22:35:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.954+0000 7ff663434640 1 -- 172.21.15.6:0/3879564749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff65c0d2300 msgr2=0x7ff65c0d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.954+0000 7ff663434640 1 --2- 172.21.15.6:0/3879564749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff65c0d2300 0x7ff65c0d27a0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7ff65c08af30 tx=0x7ff65401c910 comp rx=0 tx=0).stop 2023-07-21T22:35:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.954+0000 7ff663434640 1 -- 172.21.15.6:0/3879564749 shutdown_connections 2023-07-21T22:35:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.954+0000 7ff663434640 1 --2- 172.21.15.6:0/3879564749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff65c0d2300 0x7ff65c0d27a0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.954+0000 7ff663434640 1 --2- 172.21.15.6:0/3879564749 >> v2:172.21.15.161:3300/0 conn(0x7ff65c0d2fc0 0x7ff65c0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.954+0000 7ff663434640 1 --2- 172.21.15.6:0/3879564749 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff65c15bde0 0x7ff65c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.954+0000 7ff663434640 1 -- 172.21.15.6:0/3879564749 >> 172.21.15.6:0/3879564749 conn(0x7ff65c0659d0 msgr2=0x7ff65c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.954+0000 7ff663434640 1 -- 172.21.15.6:0/3879564749 shutdown_connections 2023-07-21T22:35:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.954+0000 7ff663434640 1 -- 172.21.15.6:0/3879564749 wait complete. 2023-07-21T22:35:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.954+0000 7ff663434640 1 Processor -- start 2023-07-21T22:35:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.954+0000 7ff663434640 1 -- start start 2023-07-21T22:35:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff663434640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff65c0d2300 0x7ff65c0b7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff663434640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff65c0d2fc0 0x7ff65c0cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff663434640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff65c15bde0 0x7ff65c157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff663434640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0b5bb0 con 0x7ff65c15bde0 2023-07-21T22:35:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff663434640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0cb210 con 0x7ff65c0d2fc0 2023-07-21T22:35:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff663434640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65c0b5dc0 con 0x7ff65c0d2300 2023-07-21T22:35:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff6619d1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff65c15bde0 0x7ff65c157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff6609cf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff65c0d2fc0 0x7ff65c0cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff6619d1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff65c15bde0 0x7ff65c157180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59048/0 (socket says 172.21.15.6:59048) 2023-07-21T22:35:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff6619d1640 1 -- 172.21.15.6:0/214309500 learned_addr learned my addr 172.21.15.6:0/214309500 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff6611d0640 1 --2- 172.21.15.6:0/214309500 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff65c0d2300 0x7ff65c0b7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff6619d1640 1 -- 172.21.15.6:0/214309500 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff65c0d2300 msgr2=0x7ff65c0b7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff6619d1640 1 --2- 172.21.15.6:0/214309500 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff65c0d2300 0x7ff65c0b7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff6619d1640 1 -- 172.21.15.6:0/214309500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff65c0d2fc0 msgr2=0x7ff65c0cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff6619d1640 1 --2- 172.21.15.6:0/214309500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff65c0d2fc0 0x7ff65c0cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff6619d1640 1 -- 172.21.15.6:0/214309500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff654009a70 con 0x7ff65c15bde0 2023-07-21T22:35:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff6609cf640 1 --2- 172.21.15.6:0/214309500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff65c0d2fc0 0x7ff65c0cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff6619d1640 1 --2- 172.21.15.6:0/214309500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff65c15bde0 0x7ff65c157180 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7ff6540b0040 tx=0x7ff6540196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:25.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff651ffb640 1 -- 172.21.15.6:0/214309500 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6540adcc0 con 0x7ff65c15bde0 2023-07-21T22:35:25.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff651ffb640 1 -- 172.21.15.6:0/214309500 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6540ade20 con 0x7ff65c15bde0 2023-07-21T22:35:25.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff663434640 1 -- 172.21.15.6:0/214309500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65c0b60a0 con 0x7ff65c15bde0 2023-07-21T22:35:25.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff651ffb640 1 -- 172.21.15.6:0/214309500 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6540b9690 con 0x7ff65c15bde0 2023-07-21T22:35:25.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff663434640 1 -- 172.21.15.6:0/214309500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65c0b6660 con 0x7ff65c15bde0 2023-07-21T22:35:25.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.958+0000 7ff663434640 1 -- 172.21.15.6:0/214309500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65c0b6850 con 0x7ff65c15bde0 2023-07-21T22:35:25.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.962+0000 7ff651ffb640 1 -- 172.21.15.6:0/214309500 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 37) v1 ==== 85817+0+0 (secure 0 0 0) 0x7ff6540b97f0 con 0x7ff65c15bde0 2023-07-21T22:35:25.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.962+0000 7ff651ffb640 1 --2- 172.21.15.6:0/214309500 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7ff640066430 0x7ff6400688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:25.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.962+0000 7ff651ffb640 1 -- 172.21.15.6:0/214309500 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6450+0+0 (secure 0 0 0) 0x7ff65411f750 con 0x7ff65c15bde0 2023-07-21T22:35:25.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.962+0000 7ff6611d0640 1 -- 172.21.15.6:0/214309500 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7ff640066430 msgr2=0x7ff6400688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3485676193 2023-07-21T22:35:25.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.962+0000 7ff6611d0640 1 --2- 172.21.15.6:0/214309500 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7ff640066430 0x7ff6400688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:35:25.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.966+0000 7ff651ffb640 1 -- 172.21.15.6:0/214309500 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff6540ec7d0 con 0x7ff65c15bde0 2023-07-21T22:35:25.036 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:24.987+0000 7f6a7a30b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:35:25.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.998+0000 7ff651ffb640 1 -- 172.21.15.6:0/214309500 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 38) v1 ==== 85369+0+0 (secure 0 0 0) 0x7ff6540ecba0 con 0x7ff65c15bde0 2023-07-21T22:35:25.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.998+0000 7ff651ffb640 1 -- 172.21.15.6:0/214309500 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7ff640066430 msgr2=0x7ff6400688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:35:25.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:24.998+0000 7ff651ffb640 1 --2- 172.21.15.6:0/214309500 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7ff640066430 0x7ff6400688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.119 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:25.071+0000 7f6a05c8f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:25.119 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:25.071+0000 7f6a02c89640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:25.120 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:25.071+0000 7f6a05c8f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:25.120 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:25.071+0000 7f6a02c89640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:25.120 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:25.071+0000 7f6a02c89640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:25.120 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:25.071+0000 7f6a02c89640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:25.120 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:25.071+0000 7f6a05c8f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:25.120 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:25.071+0000 7f6a05c8f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:25.121 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:25.071+0000 7f6a05c8f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:25.121 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:25.071+0000 7f6a02c89640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:25.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.134+0000 7ff663434640 1 -- 172.21.15.6:0/214309500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff65c0678d0 con 0x7ff65c15bde0 2023-07-21T22:35:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.134+0000 7ff651ffb640 1 -- 172.21.15.6:0/214309500 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v100) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6540f2ce0 con 0x7ff65c15bde0 2023-07-21T22:35:25.187 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:35:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.138+0000 7ff663434640 1 -- 172.21.15.6:0/214309500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff65c15bde0 msgr2=0x7ff65c157180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:25.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.138+0000 7ff663434640 1 --2- 172.21.15.6:0/214309500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff65c15bde0 0x7ff65c157180 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7ff6540b0040 tx=0x7ff6540196b0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.138+0000 7ff663434640 1 -- 172.21.15.6:0/214309500 shutdown_connections 2023-07-21T22:35:25.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.138+0000 7ff663434640 1 --2- 172.21.15.6:0/214309500 >> [v2:172.21.15.161:6832/3485676193,v1:172.21.15.161:6833/3485676193] conn(0x7ff640066430 0x7ff6400688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.138+0000 7ff663434640 1 --2- 172.21.15.6:0/214309500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff65c15bde0 0x7ff65c157180 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.138+0000 7ff663434640 1 --2- 172.21.15.6:0/214309500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff65c0d2fc0 0x7ff65c0cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.138+0000 7ff663434640 1 --2- 172.21.15.6:0/214309500 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff65c0d2300 0x7ff65c0b7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.138+0000 7ff663434640 1 -- 172.21.15.6:0/214309500 >> 172.21.15.6:0/214309500 conn(0x7ff65c0659d0 msgr2=0x7ff65c15ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:25.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.138+0000 7ff663434640 1 -- 172.21.15.6:0/214309500 shutdown_connections 2023-07-21T22:35:25.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.138+0000 7ff663434640 1 -- 172.21.15.6:0/214309500 wait complete. 2023-07-21T22:35:25.208 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:35:25.304 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:25.254+0000 7f9411646180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:35:25.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.306+0000 7f9832e19640 1 Processor -- start 2023-07-21T22:35:25.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.306+0000 7f9832e19640 1 -- start start 2023-07-21T22:35:25.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.306+0000 7f9832e19640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f982c0b7980 0x7f982c06a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:25.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.306+0000 7f9832e19640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f982c0cee50 0x7f982c0b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:25.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.306+0000 7f9832e19640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f982c0cff30 con 0x7f982c0b40f0 2023-07-21T22:35:25.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.306+0000 7f9832e19640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982c0cf550 con 0x7f982c0b7980 2023-07-21T22:35:25.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.306+0000 7f9832e19640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0b4570 con 0x7f982c0cee50 2023-07-21T22:35:25.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.310+0000 7f9831e17640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f982c0b7980 0x7f982c06a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:25.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.310+0000 7f9831e17640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f982c0b7980 0x7f982c06a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59058/0 (socket says 172.21.15.6:59058) 2023-07-21T22:35:25.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.310+0000 7f9831e17640 1 -- 172.21.15.6:0/2543814445 learned_addr learned my addr 172.21.15.6:0/2543814445 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:25.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.310+0000 7f9831616640 1 --2- 172.21.15.6:0/2543814445 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f982c0cee50 0x7f982c0b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:25.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.310+0000 7f9831e17640 1 -- 172.21.15.6:0/2543814445 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f982c0cee50 msgr2=0x7f982c0b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:25.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.310+0000 7f9831e17640 1 --2- 172.21.15.6:0/2543814445 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f982c0cee50 0x7f982c0b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.310+0000 7f9831e17640 1 -- 172.21.15.6:0/2543814445 >> v1:172.21.15.161:6789/0 conn(0x7f982c0b40f0 legacy=0x7f982c15f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:25.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.310+0000 7f9831e17640 1 -- 172.21.15.6:0/2543814445 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c0ccee0 con 0x7f982c0b7980 2023-07-21T22:35:25.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.310+0000 7f9831e17640 1 --2- 172.21.15.6:0/2543814445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982c0b7980 0x7f982c06a9b0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f9828009870 tx=0x7f982801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7243704009f0eff3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:25.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.310+0000 7f9830e15640 1 -- 172.21.15.6:0/2543814445 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98280a9400 con 0x7f982c0b7980 2023-07-21T22:35:25.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.310+0000 7f9830e15640 1 -- 172.21.15.6:0/2543814445 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98280a9560 con 0x7f982c0b7980 2023-07-21T22:35:25.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.310+0000 7f9830e15640 1 -- 172.21.15.6:0/2543814445 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98280a98f0 con 0x7f982c0b7980 2023-07-21T22:35:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9832e19640 1 -- 172.21.15.6:0/2543814445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982c0b7980 msgr2=0x7f982c06a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9832e19640 1 --2- 172.21.15.6:0/2543814445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982c0b7980 0x7f982c06a9b0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f9828009870 tx=0x7f982801c540 comp rx=0 tx=0).stop 2023-07-21T22:35:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9832e19640 1 -- 172.21.15.6:0/2543814445 shutdown_connections 2023-07-21T22:35:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9832e19640 1 --2- 172.21.15.6:0/2543814445 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f982c0cee50 0x7f982c0b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9832e19640 1 --2- 172.21.15.6:0/2543814445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982c0b7980 0x7f982c06a9b0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9832e19640 1 -- 172.21.15.6:0/2543814445 >> 172.21.15.6:0/2543814445 conn(0x7f982c069ea0 msgr2=0x7f982c06a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:25.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9832e19640 1 -- 172.21.15.6:0/2543814445 shutdown_connections 2023-07-21T22:35:25.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9832e19640 1 -- 172.21.15.6:0/2543814445 wait complete. 2023-07-21T22:35:25.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9832e19640 1 Processor -- start 2023-07-21T22:35:25.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9832e19640 1 -- start start 2023-07-21T22:35:25.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9832e19640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f982c0b40f0 0x7f982c14ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:25.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9832e19640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982c0b7980 0x7f982c14f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:25.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9832e19640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f982c0cee50 0x7f982c0d1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:25.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9832e19640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0c5d00 con 0x7f982c0b7980 2023-07-21T22:35:25.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9832e19640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0c5fa0 con 0x7f982c0cee50 2023-07-21T22:35:25.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9832e19640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982c0c6280 con 0x7f982c0b40f0 2023-07-21T22:35:25.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9831616640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982c0b7980 0x7f982c14f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:25.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9831e17640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f982c0b40f0 0x7f982c14ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:25.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9831616640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982c0b7980 0x7f982c14f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59070/0 (socket says 172.21.15.6:59070) 2023-07-21T22:35:25.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9831616640 1 -- 172.21.15.6:0/526484716 learned_addr learned my addr 172.21.15.6:0/526484716 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:25.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.314+0000 7f9832618640 1 --2- 172.21.15.6:0/526484716 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f982c0cee50 0x7f982c0d1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:25.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.318+0000 7f9831616640 1 -- 172.21.15.6:0/526484716 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f982c0b40f0 msgr2=0x7f982c14ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:25.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.318+0000 7f9831616640 1 --2- 172.21.15.6:0/526484716 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f982c0b40f0 0x7f982c14ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.318+0000 7f9831616640 1 -- 172.21.15.6:0/526484716 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f982c0cee50 msgr2=0x7f982c0d1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:25.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.318+0000 7f9831616640 1 --2- 172.21.15.6:0/526484716 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f982c0cee50 0x7f982c0d1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.318+0000 7f9831616640 1 -- 172.21.15.6:0/526484716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98280094d0 con 0x7f982c0b7980 2023-07-21T22:35:25.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.318+0000 7f9831616640 1 --2- 172.21.15.6:0/526484716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982c0b7980 0x7f982c14f490 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f981c00d5f0 tx=0x7f981c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.318+0000 7f98227fc640 1 -- 172.21.15.6:0/526484716 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c0125f0 con 0x7f982c0b7980 2023-07-21T22:35:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.318+0000 7f98227fc640 1 -- 172.21.15.6:0/526484716 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c012750 con 0x7f982c0b7980 2023-07-21T22:35:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.318+0000 7f98227fc640 1 -- 172.21.15.6:0/526484716 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c012ae0 con 0x7f982c0b7980 2023-07-21T22:35:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.318+0000 7f9832e19640 1 -- 172.21.15.6:0/526484716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982c0c6560 con 0x7f982c0b7980 2023-07-21T22:35:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.318+0000 7f9832e19640 1 -- 172.21.15.6:0/526484716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982c14f220 con 0x7f982c0b7980 2023-07-21T22:35:25.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.318+0000 7f9832e19640 1 -- 172.21.15.6:0/526484716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982c04e020 con 0x7f982c0b7980 2023-07-21T22:35:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.318+0000 7f98227fc640 1 -- 172.21.15.6:0/526484716 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 38) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f981c012c40 con 0x7f982c0b7980 2023-07-21T22:35:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.318+0000 7f98227fc640 1 -- 172.21.15.6:0/526484716 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6837+0+0 (secure 0 0 0) 0x7f981c083f70 con 0x7f982c0b7980 2023-07-21T22:35:25.371 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:25.322+0000 7f9411646180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:35:25.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.322+0000 7f98227fc640 1 -- 172.21.15.6:0/526484716 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f981c0514f0 con 0x7f982c0b7980 2023-07-21T22:35:25.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.478+0000 7f9832e19640 1 -- 172.21.15.6:0/526484716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f982c06a370 con 0x7f982c0b7980 2023-07-21T22:35:25.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.482+0000 7f98227fc640 1 -- 172.21.15.6:0/526484716 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v100) v1 ==== 92+0+10 (secure 0 0 0) 0x7f981c007380 con 0x7f982c0b7980 2023-07-21T22:35:25.531 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:35:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.482+0000 7f9832e19640 1 -- 172.21.15.6:0/526484716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982c0b7980 msgr2=0x7f982c14f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.482+0000 7f9832e19640 1 --2- 172.21.15.6:0/526484716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982c0b7980 0x7f982c14f490 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f981c00d5f0 tx=0x7f981c00dab0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.482+0000 7f9832e19640 1 -- 172.21.15.6:0/526484716 shutdown_connections 2023-07-21T22:35:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.482+0000 7f9832e19640 1 --2- 172.21.15.6:0/526484716 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f982c0cee50 0x7f982c0d1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.482+0000 7f9832e19640 1 --2- 172.21.15.6:0/526484716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f982c0b7980 0x7f982c14f490 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.482+0000 7f9832e19640 1 --2- 172.21.15.6:0/526484716 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f982c0b40f0 0x7f982c14ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.482+0000 7f9832e19640 1 -- 172.21.15.6:0/526484716 >> 172.21.15.6:0/526484716 conn(0x7f982c069ea0 msgr2=0x7f982c0b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:25.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.482+0000 7f9832e19640 1 -- 172.21.15.6:0/526484716 shutdown_connections 2023-07-21T22:35:25.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.482+0000 7f9832e19640 1 -- 172.21.15.6:0/526484716 wait complete. 2023-07-21T22:35:25.552 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:35:25.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.646+0000 7f32053d2640 1 Processor -- start 2023-07-21T22:35:25.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.646+0000 7f32053d2640 1 -- start start 2023-07-21T22:35:25.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.650+0000 7f32053d2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f320006a540 0x7f320006a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:25.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.650+0000 7f32053d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32000cf710 0x7f32000cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:25.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.650+0000 7f32053d2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32000cb7a0 con 0x7f32000cf2e0 2023-07-21T22:35:25.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.650+0000 7f32053d2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32000d0920 con 0x7f320006a540 2023-07-21T22:35:25.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.650+0000 7f32053d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320015bfd0 con 0x7f32000cf710 2023-07-21T22:35:25.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.650+0000 7f31feffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f320006a540 0x7f320006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:25.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.650+0000 7f31ff7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32000cf710 0x7f32000cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:25.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.650+0000 7f31feffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f320006a540 0x7f320006a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35254/0 (socket says 172.21.15.6:35254) 2023-07-21T22:35:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.650+0000 7f31ff7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32000cf710 0x7f32000cd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:46134/0 (socket says 172.21.15.6:46134) 2023-07-21T22:35:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.650+0000 7f31feffd640 1 -- 172.21.15.6:0/3159874102 learned_addr learned my addr 172.21.15.6:0/3159874102 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.650+0000 7f31f7fff640 1 --1- 172.21.15.6:0/3159874102 >> v1:172.21.15.161:6789/0 conn(0x7f32000cf2e0 0x7f32000cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:36166/0 (socket says 172.21.15.6:36166) 2023-07-21T22:35:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.650+0000 7f31ff7fe640 1 -- 172.21.15.6:0/3159874102 >> v2:172.21.15.161:3300/0 conn(0x7f320006a540 msgr2=0x7f320006a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.650+0000 7f31ff7fe640 1 --2- 172.21.15.6:0/3159874102 >> v2:172.21.15.161:3300/0 conn(0x7f320006a540 0x7f320006a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.650+0000 7f31ff7fe640 1 -- 172.21.15.6:0/3159874102 >> v1:172.21.15.161:6789/0 conn(0x7f32000cf2e0 legacy=0x7f32000cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.650+0000 7f31ff7fe640 1 -- 172.21.15.6:0/3159874102 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320006ae50 con 0x7f32000cf710 2023-07-21T22:35:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.650+0000 7f31fe7fc640 1 -- 172.21.15.6:0/3159874102 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125007902 0 0) 0x7f32000cb7a0 con 0x7f32000cf2e0 2023-07-21T22:35:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.650+0000 7f31feffd640 1 --2- 172.21.15.6:0/3159874102 >> v2:172.21.15.161:3300/0 conn(0x7f320006a540 0x7f320006a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:25.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.654+0000 7f31ff7fe640 1 --2- 172.21.15.6:0/3159874102 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32000cf710 0x7f32000cd0d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009d90 tx=0x7f31f801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca1703fc31b3f76 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:25.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.654+0000 7f31fe7fc640 1 -- 172.21.15.6:0/3159874102 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f80a59e0 con 0x7f32000cf710 2023-07-21T22:35:25.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.654+0000 7f31fe7fc640 1 -- 172.21.15.6:0/3159874102 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f80a5b40 con 0x7f32000cf710 2023-07-21T22:35:25.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.654+0000 7f31fe7fc640 1 -- 172.21.15.6:0/3159874102 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f80ad440 con 0x7f32000cf710 2023-07-21T22:35:25.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.654+0000 7f32053d2640 1 -- 172.21.15.6:0/3159874102 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32000cf710 msgr2=0x7f32000cd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.654+0000 7f32053d2640 1 --2- 172.21.15.6:0/3159874102 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32000cf710 0x7f32000cd0d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009d90 tx=0x7f31f801c920 comp rx=0 tx=0).stop 2023-07-21T22:35:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.654+0000 7f32053d2640 1 -- 172.21.15.6:0/3159874102 shutdown_connections 2023-07-21T22:35:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.654+0000 7f32053d2640 1 --2- 172.21.15.6:0/3159874102 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32000cf710 0x7f32000cd0d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.654+0000 7f32053d2640 1 --2- 172.21.15.6:0/3159874102 >> v2:172.21.15.161:3300/0 conn(0x7f320006a540 0x7f320006a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.654+0000 7f32053d2640 1 -- 172.21.15.6:0/3159874102 >> 172.21.15.6:0/3159874102 conn(0x7f3200099490 msgr2=0x7f3200089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.654+0000 7f32053d2640 1 -- 172.21.15.6:0/3159874102 shutdown_connections 2023-07-21T22:35:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.654+0000 7f32053d2640 1 -- 172.21.15.6:0/3159874102 wait complete. 2023-07-21T22:35:25.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.654+0000 7f32053d2640 1 Processor -- start 2023-07-21T22:35:25.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f32053d2640 1 -- start start 2023-07-21T22:35:25.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f32053d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320006a540 0x7f320014a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:25.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f32053d2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32000cf2e0 0x7f32000b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:25.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f32053d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32000cf710 0x7f32000c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:25.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f32053d2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320014ae40 con 0x7f320006a540 2023-07-21T22:35:25.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f32053d2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320014afa0 con 0x7f32000cf2e0 2023-07-21T22:35:25.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f32053d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f320014b1f0 con 0x7f32000cf710 2023-07-21T22:35:25.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f31feffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320006a540 0x7f320014a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:25.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f31f7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32000cf2e0 0x7f32000b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:25.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f31feffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320006a540 0x7f320014a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59072/0 (socket says 172.21.15.6:59072) 2023-07-21T22:35:25.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f31feffd640 1 -- 172.21.15.6:0/3079615461 learned_addr learned my addr 172.21.15.6:0/3079615461 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:25.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f31ff7fe640 1 --2- 172.21.15.6:0/3079615461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32000cf710 0x7f32000c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:25.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f31feffd640 1 -- 172.21.15.6:0/3079615461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32000cf710 msgr2=0x7f32000c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:25.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f31feffd640 1 --2- 172.21.15.6:0/3079615461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32000cf710 0x7f32000c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f31feffd640 1 -- 172.21.15.6:0/3079615461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32000cf2e0 msgr2=0x7f32000b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:25.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f31feffd640 1 --2- 172.21.15.6:0/3079615461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32000cf2e0 0x7f32000b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f31feffd640 1 -- 172.21.15.6:0/3079615461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f00094d0 con 0x7f320006a540 2023-07-21T22:35:25.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f31feffd640 1 --2- 172.21.15.6:0/3079615461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320006a540 0x7f320014a900 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f31f000e960 tx=0x7f31f000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:25.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f31f77fe640 1 -- 172.21.15.6:0/3079615461 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000ca00 con 0x7f320006a540 2023-07-21T22:35:25.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f31f77fe640 1 -- 172.21.15.6:0/3079615461 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f000cb60 con 0x7f320006a540 2023-07-21T22:35:25.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f31f77fe640 1 -- 172.21.15.6:0/3079615461 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000ced0 con 0x7f320006a540 2023-07-21T22:35:25.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f32053d2640 1 -- 172.21.15.6:0/3079615461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f8009a70 con 0x7f320006a540 2023-07-21T22:35:25.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f32053d2640 1 -- 172.21.15.6:0/3079615461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320014b7b0 con 0x7f320006a540 2023-07-21T22:35:25.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.658+0000 7f32053d2640 1 -- 172.21.15.6:0/3079615461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32000678d0 con 0x7f320006a540 2023-07-21T22:35:25.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.662+0000 7f31f77fe640 1 -- 172.21.15.6:0/3079615461 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 38) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f31f0013470 con 0x7f320006a540 2023-07-21T22:35:25.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.662+0000 7f31f77fe640 1 -- 172.21.15.6:0/3079615461 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6837+0+0 (secure 0 0 0) 0x7f31f0083cc0 con 0x7f320006a540 2023-07-21T22:35:25.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.666+0000 7f31f77fe640 1 -- 172.21.15.6:0/3079615461 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f31f008a080 con 0x7f320006a540 2023-07-21T22:35:25.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.822+0000 7f32053d2640 1 -- 172.21.15.6:0/3079615461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f32000b14e0 con 0x7f320006a540 2023-07-21T22:35:25.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.822+0000 7f31f77fe640 1 -- 172.21.15.6:0/3079615461 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v100) v1 ==== 104+0+11 (secure 0 0 0) 0x7f31f0017020 con 0x7f320006a540 2023-07-21T22:35:25.873 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:35:25.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.822+0000 7f32053d2640 1 -- 172.21.15.6:0/3079615461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320006a540 msgr2=0x7f320014a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.822+0000 7f32053d2640 1 --2- 172.21.15.6:0/3079615461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320006a540 0x7f320014a900 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f31f000e960 tx=0x7f31f000ee20 comp rx=0 tx=0).stop 2023-07-21T22:35:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.822+0000 7f32053d2640 1 -- 172.21.15.6:0/3079615461 shutdown_connections 2023-07-21T22:35:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.822+0000 7f32053d2640 1 --2- 172.21.15.6:0/3079615461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32000cf710 0x7f32000c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.822+0000 7f32053d2640 1 --2- 172.21.15.6:0/3079615461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32000cf2e0 0x7f32000b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.822+0000 7f32053d2640 1 --2- 172.21.15.6:0/3079615461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320006a540 0x7f320014a900 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.822+0000 7f32053d2640 1 -- 172.21.15.6:0/3079615461 >> 172.21.15.6:0/3079615461 conn(0x7f3200099490 msgr2=0x7f32000af0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.822+0000 7f32053d2640 1 -- 172.21.15.6:0/3079615461 shutdown_connections 2023-07-21T22:35:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.822+0000 7f32053d2640 1 -- 172.21.15.6:0/3079615461 wait complete. 2023-07-21T22:35:25.893 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:35:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.990+0000 7f411baca640 1 Processor -- start 2023-07-21T22:35:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.990+0000 7f411baca640 1 -- start start 2023-07-21T22:35:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.990+0000 7f411baca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41140af2b0 0x7f41140c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:26.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.990+0000 7f411baca640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f41140cd120 0x7f41140cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:26.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.990+0000 7f411baca640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41140695b0 con 0x7f41140c3ac0 2023-07-21T22:35:26.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.990+0000 7f411baca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4114069890 con 0x7f41140af2b0 2023-07-21T22:35:26.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.990+0000 7f411baca640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4114069b70 con 0x7f41140cd120 2023-07-21T22:35:26.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.990+0000 7f4119065640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41140af2b0 0x7f41140c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:26.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.990+0000 7f4119065640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41140af2b0 0x7f41140c2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59080/0 (socket says 172.21.15.6:59080) 2023-07-21T22:35:26.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.990+0000 7f4119065640 1 -- 172.21.15.6:0/3822285098 learned_addr learned my addr 172.21.15.6:0/3822285098 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:26.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.990+0000 7f411a067640 1 --2- 172.21.15.6:0/3822285098 >> v2:172.21.15.161:3300/0 conn(0x7f41140cd120 0x7f41140cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:26.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.990+0000 7f4119065640 1 -- 172.21.15.6:0/3822285098 >> v2:172.21.15.161:3300/0 conn(0x7f41140cd120 msgr2=0x7f41140cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:26.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.990+0000 7f4119065640 1 --2- 172.21.15.6:0/3822285098 >> v2:172.21.15.161:3300/0 conn(0x7f41140cd120 0x7f41140cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.990+0000 7f4119065640 1 -- 172.21.15.6:0/3822285098 >> v1:172.21.15.161:6789/0 conn(0x7f41140c3ac0 legacy=0x7f41140ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:26.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.990+0000 7f4119065640 1 -- 172.21.15.6:0/3822285098 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4114069e50 con 0x7f41140af2b0 2023-07-21T22:35:26.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.994+0000 7f4119065640 1 --2- 172.21.15.6:0/3822285098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140af2b0 0x7f41140c2d30 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f41140718e0 tx=0x7f410401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784359763a41435c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:26.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.994+0000 7f4118864640 1 -- 172.21.15.6:0/3822285098 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41040ab650 con 0x7f41140af2b0 2023-07-21T22:35:26.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.994+0000 7f4118864640 1 -- 172.21.15.6:0/3822285098 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41040ab7b0 con 0x7f41140af2b0 2023-07-21T22:35:26.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.994+0000 7f4118864640 1 -- 172.21.15.6:0/3822285098 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41040abb40 con 0x7f41140af2b0 2023-07-21T22:35:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.994+0000 7f411baca640 1 -- 172.21.15.6:0/3822285098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140af2b0 msgr2=0x7f41140c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.994+0000 7f411baca640 1 --2- 172.21.15.6:0/3822285098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140af2b0 0x7f41140c2d30 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f41140718e0 tx=0x7f410401c430 comp rx=0 tx=0).stop 2023-07-21T22:35:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.994+0000 7f411baca640 1 -- 172.21.15.6:0/3822285098 shutdown_connections 2023-07-21T22:35:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.994+0000 7f411baca640 1 --2- 172.21.15.6:0/3822285098 >> v2:172.21.15.161:3300/0 conn(0x7f41140cd120 0x7f41140cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.994+0000 7f411baca640 1 --2- 172.21.15.6:0/3822285098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140af2b0 0x7f41140c2d30 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.994+0000 7f411baca640 1 -- 172.21.15.6:0/3822285098 >> 172.21.15.6:0/3822285098 conn(0x7f41140cde90 msgr2=0x7f41140ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.994+0000 7f411baca640 1 -- 172.21.15.6:0/3822285098 shutdown_connections 2023-07-21T22:35:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.994+0000 7f411baca640 1 -- 172.21.15.6:0/3822285098 wait complete. 2023-07-21T22:35:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.998+0000 7f411baca640 1 Processor -- start 2023-07-21T22:35:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.998+0000 7f411baca640 1 -- start start 2023-07-21T22:35:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.998+0000 7f411baca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41140af2b0 0x7f4114146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.998+0000 7f411baca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140c3ac0 0x7f41140c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.998+0000 7f411baca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41140cd120 0x7f41140c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.998+0000 7f411baca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41140b1e10 con 0x7f41140c3ac0 2023-07-21T22:35:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.998+0000 7f411baca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41140c5c20 con 0x7f41140af2b0 2023-07-21T22:35:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.998+0000 7f411baca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41140c5f00 con 0x7f41140cd120 2023-07-21T22:35:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.998+0000 7f4119065640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140c3ac0 0x7f41140c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:26.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.998+0000 7f4119065640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140c3ac0 0x7f41140c6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59086/0 (socket says 172.21.15.6:59086) 2023-07-21T22:35:26.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.998+0000 7f4119866640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41140af2b0 0x7f4114146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:26.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.998+0000 7f4119065640 1 -- 172.21.15.6:0/1564974817 learned_addr learned my addr 172.21.15.6:0/1564974817 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:26.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.998+0000 7f411a067640 1 --2- 172.21.15.6:0/1564974817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41140cd120 0x7f41140c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:26.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.998+0000 7f4119065640 1 -- 172.21.15.6:0/1564974817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41140cd120 msgr2=0x7f41140c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:26.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.998+0000 7f4119065640 1 --2- 172.21.15.6:0/1564974817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41140cd120 0x7f41140c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.998+0000 7f4119065640 1 -- 172.21.15.6:0/1564974817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41140af2b0 msgr2=0x7f4114146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:26.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.998+0000 7f4119065640 1 --2- 172.21.15.6:0/1564974817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41140af2b0 0x7f4114146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.998+0000 7f4119065640 1 -- 172.21.15.6:0/1564974817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41040094d0 con 0x7f41140c3ac0 2023-07-21T22:35:26.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:25.998+0000 7f4119065640 1 --2- 172.21.15.6:0/1564974817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140c3ac0 0x7f41140c6e60 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f410401a060 tx=0x7f410401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.002+0000 7f410a7fc640 1 -- 172.21.15.6:0/1564974817 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41040aa980 con 0x7f41140c3ac0 2023-07-21T22:35:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.002+0000 7f410a7fc640 1 -- 172.21.15.6:0/1564974817 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41040aaae0 con 0x7f41140c3ac0 2023-07-21T22:35:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.002+0000 7f411baca640 1 -- 172.21.15.6:0/1564974817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41140c61e0 con 0x7f41140c3ac0 2023-07-21T22:35:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.002+0000 7f410a7fc640 1 -- 172.21.15.6:0/1564974817 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41040aae90 con 0x7f41140c3ac0 2023-07-21T22:35:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.006+0000 7f411baca640 1 -- 172.21.15.6:0/1564974817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4114147500 con 0x7f41140c3ac0 2023-07-21T22:35:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.006+0000 7f411baca640 1 -- 172.21.15.6:0/1564974817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41140678d0 con 0x7f41140c3ac0 2023-07-21T22:35:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.006+0000 7f410a7fc640 1 -- 172.21.15.6:0/1564974817 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f41040be3f0 con 0x7f41140c3ac0 2023-07-21T22:35:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.006+0000 7f410a7fc640 1 --2- 172.21.15.6:0/1564974817 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f40f80660d0 0x7f40f8068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.006+0000 7f410a7fc640 1 -- 172.21.15.6:0/1564974817 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6837+0+0 (secure 0 0 0) 0x7f410411ebc0 con 0x7f41140c3ac0 2023-07-21T22:35:26.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.010+0000 7f4119866640 1 --2- 172.21.15.6:0/1564974817 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f40f80660d0 0x7f40f8068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:26.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.010+0000 7f410a7fc640 1 -- 172.21.15.6:0/1564974817 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f41040ec120 con 0x7f41140c3ac0 2023-07-21T22:35:26.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.014+0000 7f4119866640 1 --2- 172.21.15.6:0/1564974817 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f40f80660d0 0x7f40f8068580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4110007fd0 tx=0x7f4110007e40 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:26.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.166+0000 7f411baca640 1 -- 172.21.15.6:0/1564974817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f41140aeb80 con 0x7f41140c3ac0 2023-07-21T22:35:26.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.166+0000 7f410a7fc640 1 -- 172.21.15.6:0/1564974817 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v100) v1 ==== 100+0+11 (secure 0 0 0) 0x7f41040ef740 con 0x7f41140c3ac0 2023-07-21T22:35:26.216 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:35:26.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.166+0000 7f411baca640 1 -- 172.21.15.6:0/1564974817 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f40f80660d0 msgr2=0x7f40f8068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:26.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.166+0000 7f411baca640 1 --2- 172.21.15.6:0/1564974817 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f40f80660d0 0x7f40f8068580 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4110007fd0 tx=0x7f4110007e40 comp rx=0 tx=0).stop 2023-07-21T22:35:26.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.166+0000 7f411baca640 1 -- 172.21.15.6:0/1564974817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140c3ac0 msgr2=0x7f41140c6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:26.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.166+0000 7f411baca640 1 --2- 172.21.15.6:0/1564974817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140c3ac0 0x7f41140c6e60 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f410401a060 tx=0x7f410401ac70 comp rx=0 tx=0).stop 2023-07-21T22:35:26.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.166+0000 7f411baca640 1 -- 172.21.15.6:0/1564974817 shutdown_connections 2023-07-21T22:35:26.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.166+0000 7f411baca640 1 --2- 172.21.15.6:0/1564974817 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f40f80660d0 0x7f40f8068580 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.166+0000 7f411baca640 1 --2- 172.21.15.6:0/1564974817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41140cd120 0x7f41140c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.166+0000 7f411baca640 1 --2- 172.21.15.6:0/1564974817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140c3ac0 0x7f41140c6e60 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.166+0000 7f411baca640 1 --2- 172.21.15.6:0/1564974817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41140af2b0 0x7f4114146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.166+0000 7f411baca640 1 -- 172.21.15.6:0/1564974817 >> 172.21.15.6:0/1564974817 conn(0x7f41140cde90 msgr2=0x7f411406cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:26.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.166+0000 7f411baca640 1 -- 172.21.15.6:0/1564974817 shutdown_connections 2023-07-21T22:35:26.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.166+0000 7f411baca640 1 -- 172.21.15.6:0/1564974817 wait complete. 2023-07-21T22:35:26.237 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:35:26.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.330+0000 7f091720b640 1 Processor -- start 2023-07-21T22:35:26.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.334+0000 7f091720b640 1 -- start start 2023-07-21T22:35:26.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.334+0000 7f091720b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f091015f3f0 0x7f09100b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:26.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.334+0000 7f091720b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f09100d13f0 0x7f09100b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:26.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.334+0000 7f091720b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f09100cc9a0 0x7f09100ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:26.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.334+0000 7f091720b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09100d0f60 con 0x7f091015f3f0 2023-07-21T22:35:26.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.334+0000 7f091720b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09100d0390 con 0x7f09100cc9a0 2023-07-21T22:35:26.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.334+0000 7f091720b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09100d0630 con 0x7f09100d13f0 2023-07-21T22:35:26.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.334+0000 7f0916209640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f091015f3f0 0x7f09100b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:26.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.334+0000 7f0916209640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f091015f3f0 0x7f09100b7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59100/0 (socket says 172.21.15.6:59100) 2023-07-21T22:35:26.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.334+0000 7f0916209640 1 -- 172.21.15.6:0/347422374 learned_addr learned my addr 172.21.15.6:0/347422374 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:26.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.334+0000 7f0916a0a640 1 --2- 172.21.15.6:0/347422374 >> v2:172.21.15.161:3300/0 conn(0x7f09100cc9a0 0x7f09100ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:26.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.334+0000 7f0915a08640 1 --2- 172.21.15.6:0/347422374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f09100d13f0 0x7f09100b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:26.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.334+0000 7f0916209640 1 -- 172.21.15.6:0/347422374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f09100d13f0 msgr2=0x7f09100b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:26.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.334+0000 7f0916209640 1 --2- 172.21.15.6:0/347422374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f09100d13f0 0x7f09100b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.334+0000 7f0916209640 1 -- 172.21.15.6:0/347422374 >> v2:172.21.15.161:3300/0 conn(0x7f09100cc9a0 msgr2=0x7f09100ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:26.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.334+0000 7f0916209640 1 --2- 172.21.15.6:0/347422374 >> v2:172.21.15.161:3300/0 conn(0x7f09100cc9a0 0x7f09100ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.334+0000 7f0916209640 1 -- 172.21.15.6:0/347422374 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09100d0910 con 0x7f091015f3f0 2023-07-21T22:35:26.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.334+0000 7f0916a0a640 1 --2- 172.21.15.6:0/347422374 >> v2:172.21.15.161:3300/0 conn(0x7f09100cc9a0 0x7f09100ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.338+0000 7f0916209640 1 --2- 172.21.15.6:0/347422374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f091015f3f0 0x7f09100b7680 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f091008a220 tx=0x7f090c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3874db071ddca23b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.338+0000 7f0915207640 1 -- 172.21.15.6:0/347422374 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0ab600 con 0x7f091015f3f0 2023-07-21T22:35:26.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.338+0000 7f0915207640 1 -- 172.21.15.6:0/347422374 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c0a7050 con 0x7f091015f3f0 2023-07-21T22:35:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.338+0000 7f0915207640 1 -- 172.21.15.6:0/347422374 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0ab980 con 0x7f091015f3f0 2023-07-21T22:35:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.338+0000 7f091720b640 1 -- 172.21.15.6:0/347422374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f091015f3f0 msgr2=0x7f09100b7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:26.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.338+0000 7f091720b640 1 --2- 172.21.15.6:0/347422374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f091015f3f0 0x7f09100b7680 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f091008a220 tx=0x7f090c01c470 comp rx=0 tx=0).stop 2023-07-21T22:35:26.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.338+0000 7f091720b640 1 -- 172.21.15.6:0/347422374 shutdown_connections 2023-07-21T22:35:26.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.338+0000 7f091720b640 1 --2- 172.21.15.6:0/347422374 >> v2:172.21.15.161:3300/0 conn(0x7f09100cc9a0 0x7f09100ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.338+0000 7f091720b640 1 --2- 172.21.15.6:0/347422374 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f09100d13f0 0x7f09100b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.338+0000 7f091720b640 1 --2- 172.21.15.6:0/347422374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f091015f3f0 0x7f09100b7680 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.338+0000 7f091720b640 1 -- 172.21.15.6:0/347422374 >> 172.21.15.6:0/347422374 conn(0x7f0910069f50 msgr2=0x7f091006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:26.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.338+0000 7f091720b640 1 -- 172.21.15.6:0/347422374 shutdown_connections 2023-07-21T22:35:26.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.338+0000 7f091720b640 1 -- 172.21.15.6:0/347422374 wait complete. 2023-07-21T22:35:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.338+0000 7f091720b640 1 Processor -- start 2023-07-21T22:35:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.338+0000 7f091720b640 1 -- start start 2023-07-21T22:35:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f091720b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09100cc9a0 0x7f0910151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f091720b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09100d13f0 0x7f091015cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f091720b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f091015f3f0 0x7f091015d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:26.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f091720b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09100cc4c0 con 0x7f09100d13f0 2023-07-21T22:35:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f091720b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09100cb420 con 0x7f09100cc9a0 2023-07-21T22:35:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f091720b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09100cb700 con 0x7f091015f3f0 2023-07-21T22:35:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f0915a08640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09100d13f0 0x7f091015cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f0915a08640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09100d13f0 0x7f091015cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59108/0 (socket says 172.21.15.6:59108) 2023-07-21T22:35:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f0915a08640 1 -- 172.21.15.6:0/1323391772 learned_addr learned my addr 172.21.15.6:0/1323391772 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f0916209640 1 --2- 172.21.15.6:0/1323391772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09100cc9a0 0x7f0910151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:26.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f0916a0a640 1 --2- 172.21.15.6:0/1323391772 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f091015f3f0 0x7f091015d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:26.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f0915a08640 1 -- 172.21.15.6:0/1323391772 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f091015f3f0 msgr2=0x7f091015d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:26.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f0915a08640 1 --2- 172.21.15.6:0/1323391772 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f091015f3f0 0x7f091015d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f0915a08640 1 -- 172.21.15.6:0/1323391772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09100cc9a0 msgr2=0x7f0910151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:26.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f0915a08640 1 --2- 172.21.15.6:0/1323391772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09100cc9a0 0x7f0910151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f0915a08640 1 -- 172.21.15.6:0/1323391772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c0094d0 con 0x7f09100d13f0 2023-07-21T22:35:26.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f0915a08640 1 --2- 172.21.15.6:0/1323391772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09100d13f0 0x7f091015cd10 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f090000d800 tx=0x7f090000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:26.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f0906ffd640 1 -- 172.21.15.6:0/1323391772 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000b6c0 con 0x7f09100d13f0 2023-07-21T22:35:26.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f0906ffd640 1 -- 172.21.15.6:0/1323391772 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090000b820 con 0x7f09100d13f0 2023-07-21T22:35:26.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f0906ffd640 1 -- 172.21.15.6:0/1323391772 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000bb90 con 0x7f09100d13f0 2023-07-21T22:35:26.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f091720b640 1 -- 172.21.15.6:0/1323391772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09100cb9e0 con 0x7f09100d13f0 2023-07-21T22:35:26.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f091720b640 1 -- 172.21.15.6:0/1323391772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09100cbfa0 con 0x7f09100d13f0 2023-07-21T22:35:26.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.342+0000 7f091720b640 1 -- 172.21.15.6:0/1323391772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09100678d0 con 0x7f09100d13f0 2023-07-21T22:35:26.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.346+0000 7f0906ffd640 1 -- 172.21.15.6:0/1323391772 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f090000bcf0 con 0x7f09100d13f0 2023-07-21T22:35:26.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.346+0000 7f0906ffd640 1 --2- 172.21.15.6:0/1323391772 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f08f40660d0 0x7f08f4068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:26.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.346+0000 7f0906ffd640 1 -- 172.21.15.6:0/1323391772 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6837+0+0 (secure 0 0 0) 0x7f0900084080 con 0x7f09100d13f0 2023-07-21T22:35:26.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.346+0000 7f0916209640 1 --2- 172.21.15.6:0/1323391772 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f08f40660d0 0x7f08f4068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:26.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.346+0000 7f0916209640 1 --2- 172.21.15.6:0/1323391772 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f08f40660d0 0x7f08f4068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f090c0ad000 tx=0x7f090c008040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:26.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.350+0000 7f0906ffd640 1 -- 172.21.15.6:0/1323391772 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0900055070 con 0x7f09100d13f0 2023-07-21T22:35:26.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.534+0000 7f091720b640 1 -- 172.21.15.6:0/1323391772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09100b5b70 con 0x7f09100d13f0 2023-07-21T22:35:26.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.534+0000 7f0906ffd640 1 -- 172.21.15.6:0/1323391772 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4670 (secure 0 0 0) 0x7f0900054c00 con 0x7f09100d13f0 2023-07-21T22:35:26.586 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:26.587 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/750234701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":750234701},{"type":"v1","addr":"172.21.15.6:6835","nonce":750234701}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1418940969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1418940969},{"type":"v1","addr":"172.21.15.161:6837","nonce":1418940969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6976,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3127204881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3127204881},{"type":"v1","addr":"172.21.15.161:6836","nonce":3127204881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:35:02.102268+0000","modified":"2023-07-21T22:35:05.730598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7131},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7131":{"gid":7131,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/4157903762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4157903762},{"type":"v1","addr":"172.21.15.6:6833","nonce":4157903762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-21T22:35:26.587 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 39 2023-07-21T22:35:26.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.538+0000 7f091720b640 1 -- 172.21.15.6:0/1323391772 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f08f40660d0 msgr2=0x7f08f4068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:26.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.538+0000 7f091720b640 1 --2- 172.21.15.6:0/1323391772 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f08f40660d0 0x7f08f4068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f090c0ad000 tx=0x7f090c008040 comp rx=0 tx=0).stop 2023-07-21T22:35:26.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.538+0000 7f091720b640 1 -- 172.21.15.6:0/1323391772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09100d13f0 msgr2=0x7f091015cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:26.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.538+0000 7f091720b640 1 --2- 172.21.15.6:0/1323391772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09100d13f0 0x7f091015cd10 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f090000d800 tx=0x7f090000dcc0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.538+0000 7f091720b640 1 -- 172.21.15.6:0/1323391772 shutdown_connections 2023-07-21T22:35:26.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.538+0000 7f091720b640 1 --2- 172.21.15.6:0/1323391772 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f08f40660d0 0x7f08f4068580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.538+0000 7f091720b640 1 --2- 172.21.15.6:0/1323391772 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f091015f3f0 0x7f091015d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.538+0000 7f091720b640 1 --2- 172.21.15.6:0/1323391772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09100d13f0 0x7f091015cd10 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.538+0000 7f091720b640 1 --2- 172.21.15.6:0/1323391772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09100cc9a0 0x7f0910151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.538+0000 7f091720b640 1 -- 172.21.15.6:0/1323391772 >> 172.21.15.6:0/1323391772 conn(0x7f0910069f50 msgr2=0x7f09100b7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:26.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.538+0000 7f091720b640 1 -- 172.21.15.6:0/1323391772 shutdown_connections 2023-07-21T22:35:26.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.538+0000 7f091720b640 1 -- 172.21.15.6:0/1323391772 wait complete. 2023-07-21T22:35:26.608 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:35:26.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.702+0000 7ff2c2034640 1 Processor -- start 2023-07-21T22:35:26.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.706+0000 7ff2c2034640 1 -- start start 2023-07-21T22:35:26.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.706+0000 7ff2c2034640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2bc0d13f0 0x7ff2bc0cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:26.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.706+0000 7ff2c2034640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2bc0d0f60 con 0x7ff2bc0b7d90 2023-07-21T22:35:26.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.706+0000 7ff2c2034640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2bc0d0390 con 0x7ff2bc15f3f0 2023-07-21T22:35:26.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.706+0000 7ff2c2034640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc0d0630 con 0x7ff2bc0d13f0 2023-07-21T22:35:26.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.706+0000 7ff2c0831640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff2bc0b7d90 0x7ff2bc0cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46610/0 (socket says 172.21.15.6:46610) 2023-07-21T22:35:26.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.706+0000 7ff2c0831640 1 -- 172.21.15.6:0/1777476597 learned_addr learned my addr 172.21.15.6:0/1777476597 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:26.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.706+0000 7ff2c1833640 1 --2- 172.21.15.6:0/1777476597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2bc0d13f0 0x7ff2bc0cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:26.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.706+0000 7ff2b3fff640 1 -- 172.21.15.6:0/1777476597 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77917902 0 0) 0x7ff2bc0d0f60 con 0x7ff2bc0b7d90 2023-07-21T22:35:26.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.706+0000 7ff2b3fff640 1 -- 172.21.15.6:0/1777476597 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2a8003530 con 0x7ff2bc0b7d90 2023-07-21T22:35:26.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.706+0000 7ff2b3fff640 1 -- 172.21.15.6:0/1777476597 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1837222174 0 0) 0x7ff2bc0d0390 con 0x7ff2bc15f3f0 2023-07-21T22:35:26.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.706+0000 7ff2b3fff640 1 -- 172.21.15.6:0/1777476597 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2bc0d0f60 con 0x7ff2bc15f3f0 2023-07-21T22:35:26.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.706+0000 7ff2c1833640 1 -- 172.21.15.6:0/1777476597 >> v1:172.21.15.161:6789/0 conn(0x7ff2bc15f3f0 legacy=0x7ff2bc0b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:26.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.706+0000 7ff2c1833640 1 -- 172.21.15.6:0/1777476597 >> v1:172.21.15.6:6789/0 conn(0x7ff2bc0b7d90 legacy=0x7ff2bc0cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:26.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.706+0000 7ff2c1833640 1 -- 172.21.15.6:0/1777476597 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2bc0d0910 con 0x7ff2bc0d13f0 2023-07-21T22:35:26.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.710+0000 7ff2c1833640 1 --2- 172.21.15.6:0/1777476597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2bc0d13f0 0x7ff2bc0cd0b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009dc0 tx=0x7ff2b401c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca8bedc627226d7c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:26.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.710+0000 7ff2b3fff640 1 -- 172.21.15.6:0/1777476597 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b40a5820 con 0x7ff2bc0d13f0 2023-07-21T22:35:26.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.710+0000 7ff2b3fff640 1 -- 172.21.15.6:0/1777476597 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b40a5980 con 0x7ff2bc0d13f0 2023-07-21T22:35:26.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.710+0000 7ff2b3fff640 1 -- 172.21.15.6:0/1777476597 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b40a5d10 con 0x7ff2bc0d13f0 2023-07-21T22:35:26.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.710+0000 7ff2c2034640 1 -- 172.21.15.6:0/1777476597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2bc0d13f0 msgr2=0x7ff2bc0cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:26.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.710+0000 7ff2c2034640 1 --2- 172.21.15.6:0/1777476597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2bc0d13f0 0x7ff2bc0cd0b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009dc0 tx=0x7ff2b401c8e0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.710+0000 7ff2c2034640 1 -- 172.21.15.6:0/1777476597 shutdown_connections 2023-07-21T22:35:26.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.710+0000 7ff2c2034640 1 --2- 172.21.15.6:0/1777476597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2bc0d13f0 0x7ff2bc0cd0b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.710+0000 7ff2c2034640 1 -- 172.21.15.6:0/1777476597 >> 172.21.15.6:0/1777476597 conn(0x7ff2bc069f50 msgr2=0x7ff2bc06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:26.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.710+0000 7ff2c2034640 1 -- 172.21.15.6:0/1777476597 shutdown_connections 2023-07-21T22:35:26.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.710+0000 7ff2c2034640 1 -- 172.21.15.6:0/1777476597 wait complete. 2023-07-21T22:35:26.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c2034640 1 Processor -- start 2023-07-21T22:35:26.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c2034640 1 -- start start 2023-07-21T22:35:26.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c2034640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2bc0b7d90 0x7ff2bc156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:26.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c2034640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2bc0d13f0 0x7ff2bc0b2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:26.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c2034640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2bc15f3f0 0x7ff2bc0c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:26.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c2034640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc1f5c50 con 0x7ff2bc0b7d90 2023-07-21T22:35:26.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c2034640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc0ca0e0 con 0x7ff2bc0d13f0 2023-07-21T22:35:26.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c2034640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc0b2b30 con 0x7ff2bc15f3f0 2023-07-21T22:35:26.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c1032640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2bc0b7d90 0x7ff2bc156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:26.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c1032640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2bc0b7d90 0x7ff2bc156920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59124/0 (socket says 172.21.15.6:59124) 2023-07-21T22:35:26.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c1032640 1 -- 172.21.15.6:0/1081258597 learned_addr learned my addr 172.21.15.6:0/1081258597 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:26.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c0831640 1 --2- 172.21.15.6:0/1081258597 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2bc0d13f0 0x7ff2bc0b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:26.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c1833640 1 --2- 172.21.15.6:0/1081258597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2bc15f3f0 0x7ff2bc0c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:26.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c1032640 1 -- 172.21.15.6:0/1081258597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2bc15f3f0 msgr2=0x7ff2bc0c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:26.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c1032640 1 --2- 172.21.15.6:0/1081258597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2bc15f3f0 0x7ff2bc0c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c1032640 1 -- 172.21.15.6:0/1081258597 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2bc0d13f0 msgr2=0x7ff2bc0b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:26.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c1032640 1 --2- 172.21.15.6:0/1081258597 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2bc0d13f0 0x7ff2bc0b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c1032640 1 -- 172.21.15.6:0/1081258597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b4009a70 con 0x7ff2bc0b7d90 2023-07-21T22:35:26.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c0831640 1 --2- 172.21.15.6:0/1081258597 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2bc0d13f0 0x7ff2bc0b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:26.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c1032640 1 --2- 172.21.15.6:0/1081258597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2bc0b7d90 0x7ff2bc156920 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800c430 tx=0x7ff2b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:26.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2b1ffb640 1 -- 172.21.15.6:0/1081258597 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b80052d0 con 0x7ff2bc0b7d90 2023-07-21T22:35:26.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2b1ffb640 1 -- 172.21.15.6:0/1081258597 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b8005450 con 0x7ff2bc0b7d90 2023-07-21T22:35:26.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2b1ffb640 1 -- 172.21.15.6:0/1081258597 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8003840 con 0x7ff2bc0b7d90 2023-07-21T22:35:26.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c2034640 1 -- 172.21.15.6:0/1081258597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc0b2e10 con 0x7ff2bc0b7d90 2023-07-21T22:35:26.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c2034640 1 -- 172.21.15.6:0/1081258597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2bc0b33d0 con 0x7ff2bc0b7d90 2023-07-21T22:35:26.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.714+0000 7ff2c2034640 1 -- 172.21.15.6:0/1081258597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2bc0678d0 con 0x7ff2bc0b7d90 2023-07-21T22:35:26.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.718+0000 7ff2b1ffb640 1 -- 172.21.15.6:0/1081258597 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 85496+0+0 (secure 0 0 0) 0x7ff2b80039a0 con 0x7ff2bc0b7d90 2023-07-21T22:35:26.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.718+0000 7ff2b1ffb640 1 --2- 172.21.15.6:0/1081258597 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7ff2a00660d0 0x7ff2a0068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:26.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.718+0000 7ff2b1ffb640 1 -- 172.21.15.6:0/1081258597 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6837+0+0 (secure 0 0 0) 0x7ff2b80832c0 con 0x7ff2bc0b7d90 2023-07-21T22:35:26.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.718+0000 7ff2c0831640 1 --2- 172.21.15.6:0/1081258597 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7ff2a00660d0 0x7ff2a0068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:26.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.718+0000 7ff2c0831640 1 --2- 172.21.15.6:0/1081258597 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7ff2a00660d0 0x7ff2a0068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc0cf680 tx=0x7ff2ac009040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:26.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.722+0000 7ff2b1ffb640 1 -- 172.21.15.6:0/1081258597 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff2b8050750 con 0x7ff2bc0b7d90 2023-07-21T22:35:26.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.882+0000 7ff2c2034640 1 -- 172.21.15.6:0/1081258597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2bc0cc5d0 con 0x7ff2bc0b7d90 2023-07-21T22:35:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.882+0000 7ff2b1ffb640 1 -- 172.21.15.6:0/1081258597 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+19432 (secure 0 0 0) 0x7ff2b8053d70 con 0x7ff2bc0b7d90 2023-07-21T22:35:26.933 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:26.933 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":100,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:35:24.993729+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:35:00.223294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-21T22:35:01.098128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/3132041694":"2023-07-22T22:35:24.993674+0000","172.21.15.161:6833/3485676193":"2023-07-22T22:35:24.993674+0000","172.21.15.161:6832/3485676193":"2023-07-22T22:35:24.993674+0000","172.21.15.161:0/1718502794":"2023-07-22T22:35:24.993674+0000","172.21.15.161:0/1425014400":"2023-07-22T22:35:24.993674+0000","172.21.15.161:0/2079743043":"2023-07-22T22:35:24.993674+0000","172.21.15.161:0/504326695":"2023-07-22T22:35:24.993674+0000","172.21.15.161:0/363819523":"2023-07-22T22:35:24.993674+0000","172.21.15.161:0/2603665139":"2023-07-22T22:35:19.216600+0000","172.21.15.161:0/2870923080":"2023-07-22T22:35:24.993674+0000","172.21.15.161:0/2022432677":"2023-07-22T22:35:19.216600+0000","172.21.15.161:0/567935630":"2023-07-22T22:35:19.216600+0000","172.21.15.161:0/2968204385":"2023-07-22T22:35:19.216600+0000","172.21.15.161:0/2475523917":"2023-07-22T22:35:19.216600+0000","172.21.15.161:0/1706579505":"2023-07-22T22:35:19.216600+0000","172.21.15.161:6833/3267017989":"2023-07-22T22:35:19.216600+0000","172.21.15.161:6832/3267017989":"2023-07-22T22:35:19.216600+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:35:26.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.882+0000 7ff2c2034640 1 -- 172.21.15.6:0/1081258597 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7ff2a00660d0 msgr2=0x7ff2a0068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:26.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.882+0000 7ff2c2034640 1 --2- 172.21.15.6:0/1081258597 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7ff2a00660d0 0x7ff2a0068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc0cf680 tx=0x7ff2ac009040 comp rx=0 tx=0).stop 2023-07-21T22:35:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.882+0000 7ff2c2034640 1 -- 172.21.15.6:0/1081258597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2bc0b7d90 msgr2=0x7ff2bc156920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.882+0000 7ff2c2034640 1 --2- 172.21.15.6:0/1081258597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2bc0b7d90 0x7ff2bc156920 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff2b800c430 tx=0x7ff2b800c8f0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.882+0000 7ff2c2034640 1 -- 172.21.15.6:0/1081258597 shutdown_connections 2023-07-21T22:35:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.882+0000 7ff2c2034640 1 --2- 172.21.15.6:0/1081258597 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7ff2a00660d0 0x7ff2a0068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.882+0000 7ff2c2034640 1 --2- 172.21.15.6:0/1081258597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2bc15f3f0 0x7ff2bc0c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.882+0000 7ff2c2034640 1 --2- 172.21.15.6:0/1081258597 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2bc0d13f0 0x7ff2bc0b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.882+0000 7ff2c2034640 1 --2- 172.21.15.6:0/1081258597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2bc0b7d90 0x7ff2bc156920 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:26.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.882+0000 7ff2c2034640 1 -- 172.21.15.6:0/1081258597 >> 172.21.15.6:0/1081258597 conn(0x7ff2bc069f50 msgr2=0x7ff2bc0c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:26.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.882+0000 7ff2c2034640 1 -- 172.21.15.6:0/1081258597 shutdown_connections 2023-07-21T22:35:26.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:26.882+0000 7ff2c2034640 1 -- 172.21.15.6:0/1081258597 wait complete. 2023-07-21T22:35:26.953 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-21T22:35:26.954 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:35:27.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.050+0000 7fed8e66a640 1 Processor -- start 2023-07-21T22:35:27.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.050+0000 7fed8e66a640 1 -- start start 2023-07-21T22:35:27.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.050+0000 7fed8e66a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed8813eac0 0x7fed8806de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.050+0000 7fed8e66a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed8806c430 0x7fed8815f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.050+0000 7fed8e66a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8815d210 con 0x7fed8806e370 2023-07-21T22:35:27.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.050+0000 7fed8e66a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed8815c690 con 0x7fed8813eac0 2023-07-21T22:35:27.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.050+0000 7fed8e66a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8815c970 con 0x7fed8806c430 2023-07-21T22:35:27.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.050+0000 7fed87fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed8813eac0 0x7fed8806de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.050+0000 7fed877fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fed8806e370 0x7fed8806bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46616/0 (socket says 172.21.15.6:46616) 2023-07-21T22:35:27.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.050+0000 7fed87fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed8813eac0 0x7fed8806de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59132/0 (socket says 172.21.15.6:59132) 2023-07-21T22:35:27.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.050+0000 7fed877fe640 1 -- 172.21.15.6:0/3074340324 learned_addr learned my addr 172.21.15.6:0/3074340324 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:27.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.050+0000 7fed8cc07640 1 --2- 172.21.15.6:0/3074340324 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed8806c430 0x7fed8815f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.050+0000 7fed87fff640 1 -- 172.21.15.6:0/3074340324 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed8806c430 msgr2=0x7fed8815f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:27.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.050+0000 7fed87fff640 1 --2- 172.21.15.6:0/3074340324 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed8806c430 0x7fed8815f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.050+0000 7fed87fff640 1 -- 172.21.15.6:0/3074340324 >> v1:172.21.15.6:6789/0 conn(0x7fed8806e370 legacy=0x7fed8806bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:27.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.050+0000 7fed87fff640 1 -- 172.21.15.6:0/3074340324 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8815cc50 con 0x7fed8813eac0 2023-07-21T22:35:27.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.054+0000 7fed87fff640 1 --2- 172.21.15.6:0/3074340324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed8813eac0 0x7fed8806de30 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fed780097c0 tx=0x7fed7801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96e57197079f4db server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:27.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.054+0000 7fed86ffd640 1 -- 172.21.15.6:0/3074340324 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed780ab670 con 0x7fed8813eac0 2023-07-21T22:35:27.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.054+0000 7fed86ffd640 1 -- 172.21.15.6:0/3074340324 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8813f0a0 con 0x7fed8813eac0 2023-07-21T22:35:27.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.054+0000 7fed86ffd640 1 -- 172.21.15.6:0/3074340324 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed780ab9f0 con 0x7fed8813eac0 2023-07-21T22:35:27.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.054+0000 7fed8e66a640 1 -- 172.21.15.6:0/3074340324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed8813eac0 msgr2=0x7fed8806de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:27.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.054+0000 7fed8e66a640 1 --2- 172.21.15.6:0/3074340324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed8813eac0 0x7fed8806de30 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fed780097c0 tx=0x7fed7801c450 comp rx=0 tx=0).stop 2023-07-21T22:35:27.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.054+0000 7fed8e66a640 1 -- 172.21.15.6:0/3074340324 shutdown_connections 2023-07-21T22:35:27.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.054+0000 7fed8e66a640 1 --2- 172.21.15.6:0/3074340324 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed8806c430 0x7fed8815f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.054+0000 7fed8e66a640 1 --2- 172.21.15.6:0/3074340324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed8813eac0 0x7fed8806de30 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.054+0000 7fed8e66a640 1 -- 172.21.15.6:0/3074340324 >> 172.21.15.6:0/3074340324 conn(0x7fed880b1300 msgr2=0x7fed880ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:27.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.054+0000 7fed8e66a640 1 -- 172.21.15.6:0/3074340324 shutdown_connections 2023-07-21T22:35:27.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.054+0000 7fed8e66a640 1 -- 172.21.15.6:0/3074340324 wait complete. 2023-07-21T22:35:27.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed8e66a640 1 Processor -- start 2023-07-21T22:35:27.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed8e66a640 1 -- start start 2023-07-21T22:35:27.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed8e66a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed8806c430 0x7fed880b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed8e66a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed8806e370 0x7fed88139850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed8e66a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed8813eac0 0x7fed88141460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed8e66a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed880b3670 con 0x7fed8806e370 2023-07-21T22:35:27.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed8e66a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed880ccac0 con 0x7fed8806c430 2023-07-21T22:35:27.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed8e66a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed880ccda0 con 0x7fed8813eac0 2023-07-21T22:35:27.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed877fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed8806e370 0x7fed88139850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed877fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed8806e370 0x7fed88139850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59138/0 (socket says 172.21.15.6:59138) 2023-07-21T22:35:27.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed877fe640 1 -- 172.21.15.6:0/3739937914 learned_addr learned my addr 172.21.15.6:0/3739937914 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:27.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed8cc07640 1 --2- 172.21.15.6:0/3739937914 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed8813eac0 0x7fed88141460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed87fff640 1 --2- 172.21.15.6:0/3739937914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed8806c430 0x7fed880b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed877fe640 1 -- 172.21.15.6:0/3739937914 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed8813eac0 msgr2=0x7fed88141460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:27.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed877fe640 1 --2- 172.21.15.6:0/3739937914 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed8813eac0 0x7fed88141460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed877fe640 1 -- 172.21.15.6:0/3739937914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed8806c430 msgr2=0x7fed880b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:27.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed877fe640 1 --2- 172.21.15.6:0/3739937914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed8806c430 0x7fed880b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed877fe640 1 -- 172.21.15.6:0/3739937914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed78009420 con 0x7fed8806e370 2023-07-21T22:35:27.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed877fe640 1 --2- 172.21.15.6:0/3739937914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed8806e370 0x7fed88139850 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00c4d0 tx=0x7fed7c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:27.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed84ff9640 1 -- 172.21.15.6:0/3739937914 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c005cf0 con 0x7fed8806e370 2023-07-21T22:35:27.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed84ff9640 1 -- 172.21.15.6:0/3739937914 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7c005e50 con 0x7fed8806e370 2023-07-21T22:35:27.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed84ff9640 1 -- 172.21.15.6:0/3739937914 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c007270 con 0x7fed8806e370 2023-07-21T22:35:27.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed8e66a640 1 -- 172.21.15.6:0/3739937914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed880cd080 con 0x7fed8806e370 2023-07-21T22:35:27.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed8e66a640 1 -- 172.21.15.6:0/3739937914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed880b2a20 con 0x7fed8806e370 2023-07-21T22:35:27.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.058+0000 7fed8e66a640 1 -- 172.21.15.6:0/3739937914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed880678d0 con 0x7fed8806e370 2023-07-21T22:35:27.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.062+0000 7fed84ff9640 1 -- 172.21.15.6:0/3739937914 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fed7c0073d0 con 0x7fed8806e370 2023-07-21T22:35:27.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.062+0000 7fed84ff9640 1 --2- 172.21.15.6:0/3739937914 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fed740660d0 0x7fed74068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.062+0000 7fed84ff9640 1 -- 172.21.15.6:0/3739937914 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6837+0+0 (secure 0 0 0) 0x7fed7c083130 con 0x7fed8806e370 2023-07-21T22:35:27.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.062+0000 7fed87fff640 1 --2- 172.21.15.6:0/3739937914 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fed740660d0 0x7fed74068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.062+0000 7fed87fff640 1 --2- 172.21.15.6:0/3739937914 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fed740660d0 0x7fed74068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fed780af000 tx=0x7fed780a7000 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:27.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.066+0000 7fed84ff9640 1 -- 172.21.15.6:0/3739937914 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed7c0505c0 con 0x7fed8806e370 2023-07-21T22:35:27.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.254+0000 7fed8e66a640 1 -- 172.21.15.6:0/3739937914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed880b3ba0 con 0x7fed8806e370 2023-07-21T22:35:27.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.254+0000 7fed84ff9640 1 -- 172.21.15.6:0/3739937914 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4670 (secure 0 0 0) 0x7fed7c053be0 con 0x7fed8806e370 2023-07-21T22:35:27.306 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:27.307 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/750234701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":750234701},{"type":"v1","addr":"172.21.15.6:6835","nonce":750234701}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1418940969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1418940969},{"type":"v1","addr":"172.21.15.161:6837","nonce":1418940969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6976,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3127204881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3127204881},{"type":"v1","addr":"172.21.15.161:6836","nonce":3127204881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:35:02.102268+0000","modified":"2023-07-21T22:35:05.730598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7131},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7131":{"gid":7131,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/4157903762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4157903762},{"type":"v1","addr":"172.21.15.6:6833","nonce":4157903762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-21T22:35:27.307 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 39 2023-07-21T22:35:27.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.258+0000 7fed8e66a640 1 -- 172.21.15.6:0/3739937914 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fed740660d0 msgr2=0x7fed74068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:27.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.258+0000 7fed8e66a640 1 --2- 172.21.15.6:0/3739937914 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fed740660d0 0x7fed74068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fed780af000 tx=0x7fed780a7000 comp rx=0 tx=0).stop 2023-07-21T22:35:27.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.258+0000 7fed8e66a640 1 -- 172.21.15.6:0/3739937914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed8806e370 msgr2=0x7fed88139850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:27.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.258+0000 7fed8e66a640 1 --2- 172.21.15.6:0/3739937914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed8806e370 0x7fed88139850 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fed7c00c4d0 tx=0x7fed7c00c990 comp rx=0 tx=0).stop 2023-07-21T22:35:27.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.258+0000 7fed8e66a640 1 -- 172.21.15.6:0/3739937914 shutdown_connections 2023-07-21T22:35:27.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.258+0000 7fed8e66a640 1 --2- 172.21.15.6:0/3739937914 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fed740660d0 0x7fed74068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.258+0000 7fed8e66a640 1 --2- 172.21.15.6:0/3739937914 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed8813eac0 0x7fed88141460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.258+0000 7fed8e66a640 1 --2- 172.21.15.6:0/3739937914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed8806e370 0x7fed88139850 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.258+0000 7fed8e66a640 1 --2- 172.21.15.6:0/3739937914 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed8806c430 0x7fed880b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.258+0000 7fed8e66a640 1 -- 172.21.15.6:0/3739937914 >> 172.21.15.6:0/3739937914 conn(0x7fed880b1300 msgr2=0x7fed8815db80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:27.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.258+0000 7fed8e66a640 1 -- 172.21.15.6:0/3739937914 shutdown_connections 2023-07-21T22:35:27.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.258+0000 7fed8e66a640 1 -- 172.21.15.6:0/3739937914 wait complete. 2023-07-21T22:35:27.327 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:35:27.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.422+0000 7f3f32100640 1 Processor -- start 2023-07-21T22:35:27.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.422+0000 7f3f32100640 1 -- start start 2023-07-21T22:35:27.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.422+0000 7f3f32100640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f2c0c8ad0 0x7f3f2c0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.422+0000 7f3f32100640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3f2c0c9560 0x7f3f2c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.422+0000 7f3f32100640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f2c0cc700 con 0x7f3f2c158ce0 2023-07-21T22:35:27.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.422+0000 7f3f32100640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f2c0c99e0 con 0x7f3f2c0c9560 2023-07-21T22:35:27.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.422+0000 7f3f32100640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c0b0ff0 con 0x7f3f2c0c8ad0 2023-07-21T22:35:27.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.422+0000 7f3f2b7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3f2c158ce0 0x7f3f2c070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53874/0 (socket says 172.21.15.6:53874) 2023-07-21T22:35:27.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.422+0000 7f3f2b7fe640 1 -- 172.21.15.6:0/352842073 learned_addr learned my addr 172.21.15.6:0/352842073 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:27.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2bfff640 1 --2- 172.21.15.6:0/352842073 >> v2:172.21.15.161:3300/0 conn(0x7f3f2c0c9560 0x7f3f2c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2affd640 1 --2- 172.21.15.6:0/352842073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f2c0c8ad0 0x7f3f2c0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2a7fc640 1 -- 172.21.15.6:0/352842073 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823673470 0 0) 0x7f3f2c0cc700 con 0x7f3f2c158ce0 2023-07-21T22:35:27.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2a7fc640 1 -- 172.21.15.6:0/352842073 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f14003530 con 0x7f3f2c158ce0 2023-07-21T22:35:27.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2a7fc640 1 -- 172.21.15.6:0/352842073 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3152621643 0 0) 0x7f3f14003530 con 0x7f3f2c158ce0 2023-07-21T22:35:27.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2a7fc640 1 -- 172.21.15.6:0/352842073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f2c0c8ad0 msgr2=0x7f3f2c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:27.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2a7fc640 1 --2- 172.21.15.6:0/352842073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f2c0c8ad0 0x7f3f2c0c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2a7fc640 1 -- 172.21.15.6:0/352842073 >> v2:172.21.15.161:3300/0 conn(0x7f3f2c0c9560 msgr2=0x7f3f2c0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:27.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2a7fc640 1 --2- 172.21.15.6:0/352842073 >> v2:172.21.15.161:3300/0 conn(0x7f3f2c0c9560 0x7f3f2c0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2a7fc640 1 -- 172.21.15.6:0/352842073 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c070c80 con 0x7f3f2c158ce0 2023-07-21T22:35:27.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2a7fc640 1 -- 172.21.15.6:0/352842073 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f3f1c001680 con 0x7f3f2c158ce0 2023-07-21T22:35:27.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2a7fc640 1 -- 172.21.15.6:0/352842073 >> v1:172.21.15.6:6789/0 conn(0x7f3f2c158ce0 legacy=0x7f3f2c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:27.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2a7fc640 1 --2- 172.21.15.6:0/352842073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f14003980 0x7f3f14003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2a7fc640 1 --2- 172.21.15.6:0/352842073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f140047d0 0x7f3f14004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2a7fc640 1 --2- 172.21.15.6:0/352842073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f2c0c8ad0 0x7f3f14005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2a7fc640 1 -- 172.21.15.6:0/352842073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c0c99e0 con 0x7f3f140047d0 2023-07-21T22:35:27.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2a7fc640 1 -- 172.21.15.6:0/352842073 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c0b0ff0 con 0x7f3f14003980 2023-07-21T22:35:27.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2a7fc640 1 -- 172.21.15.6:0/352842073 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1400dc20 con 0x7f3f2c0c8ad0 2023-07-21T22:35:27.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2affd640 1 --2- 172.21.15.6:0/352842073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f140047d0 0x7f3f14004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2bfff640 1 --2- 172.21.15.6:0/352842073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f2c0c8ad0 0x7f3f14005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2b7fe640 1 --2- 172.21.15.6:0/352842073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f14003980 0x7f3f14003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2affd640 1 -- 172.21.15.6:0/352842073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f2c0c8ad0 msgr2=0x7f3f14005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:27.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2affd640 1 --2- 172.21.15.6:0/352842073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f2c0c8ad0 0x7f3f14005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2affd640 1 -- 172.21.15.6:0/352842073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f14003980 msgr2=0x7f3f14003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:27.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2affd640 1 --2- 172.21.15.6:0/352842073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f14003980 0x7f3f14003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.426+0000 7f3f2affd640 1 -- 172.21.15.6:0/352842073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f14003530 con 0x7f3f140047d0 2023-07-21T22:35:27.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.430+0000 7f3f2affd640 1 --2- 172.21.15.6:0/352842073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f140047d0 0x7f3f14004c40 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f3f20009ae0 tx=0x7f3f2001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982949241c5ef807 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:27.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.430+0000 7f3f2a7fc640 1 -- 172.21.15.6:0/352842073 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f200a6510 con 0x7f3f140047d0 2023-07-21T22:35:27.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.430+0000 7f3f2a7fc640 1 -- 172.21.15.6:0/352842073 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f200a6670 con 0x7f3f140047d0 2023-07-21T22:35:27.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.430+0000 7f3f2a7fc640 1 -- 172.21.15.6:0/352842073 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f200a6a20 con 0x7f3f140047d0 2023-07-21T22:35:27.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.430+0000 7f3f32100640 1 -- 172.21.15.6:0/352842073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f140047d0 msgr2=0x7f3f14004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:27.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.430+0000 7f3f32100640 1 --2- 172.21.15.6:0/352842073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f140047d0 0x7f3f14004c40 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f3f20009ae0 tx=0x7f3f2001ca20 comp rx=0 tx=0).stop 2023-07-21T22:35:27.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.430+0000 7f3f2bfff640 1 -- 172.21.15.6:0/352842073 reap_dead start 2023-07-21T22:35:27.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.430+0000 7f3f32100640 1 -- 172.21.15.6:0/352842073 shutdown_connections 2023-07-21T22:35:27.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.430+0000 7f3f32100640 1 -- 172.21.15.6:0/352842073 >> 172.21.15.6:0/352842073 conn(0x7f3f2c0afcf0 msgr2=0x7f3f2c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:27.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.430+0000 7f3f32100640 1 -- 172.21.15.6:0/352842073 shutdown_connections 2023-07-21T22:35:27.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.430+0000 7f3f32100640 1 -- 172.21.15.6:0/352842073 wait complete. 2023-07-21T22:35:27.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.430+0000 7f3f32100640 1 Processor -- start 2023-07-21T22:35:27.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.430+0000 7f3f32100640 1 -- start start 2023-07-21T22:35:27.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f32100640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f140047d0 0x7f3f2c0c3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f32100640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f2c0c6520 0x7f3f2c0c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f32100640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f2c1f77e0 0x7f3f2c1f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f32100640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c154f10 con 0x7f3f140047d0 2023-07-21T22:35:27.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f32100640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c1f8190 con 0x7f3f2c0c6520 2023-07-21T22:35:27.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f32100640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2c0c5760 con 0x7f3f2c1f77e0 2023-07-21T22:35:27.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f2b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f140047d0 0x7f3f2c0c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f2b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f140047d0 0x7f3f2c0c3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52774/0 (socket says 172.21.15.6:52774) 2023-07-21T22:35:27.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f2b7fe640 1 -- 172.21.15.6:0/1545106976 learned_addr learned my addr 172.21.15.6:0/1545106976 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:27.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f2affd640 1 --2- 172.21.15.6:0/1545106976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f2c0c6520 0x7f3f2c0c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f2bfff640 1 --2- 172.21.15.6:0/1545106976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f2c1f77e0 0x7f3f2c1f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f2b7fe640 1 -- 172.21.15.6:0/1545106976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f2c1f77e0 msgr2=0x7f3f2c1f7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:27.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f2b7fe640 1 --2- 172.21.15.6:0/1545106976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f2c1f77e0 0x7f3f2c1f7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f2b7fe640 1 -- 172.21.15.6:0/1545106976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f2c0c6520 msgr2=0x7f3f2c0c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:27.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f2b7fe640 1 --2- 172.21.15.6:0/1545106976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f2c0c6520 0x7f3f2c0c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f2b7fe640 1 -- 172.21.15.6:0/1545106976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2c0c5a40 con 0x7f3f140047d0 2023-07-21T22:35:27.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f2bfff640 1 --2- 172.21.15.6:0/1545106976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f2c1f77e0 0x7f3f2c1f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:27.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f2b7fe640 1 --2- 172.21.15.6:0/1545106976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f140047d0 0x7f3f2c0c3230 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c007310 tx=0x7f3f1c0077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:27.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f13fff640 1 -- 172.21.15.6:0/1545106976 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c007e00 con 0x7f3f140047d0 2023-07-21T22:35:27.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f13fff640 1 -- 172.21.15.6:0/1545106976 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1c00f960 con 0x7f3f140047d0 2023-07-21T22:35:27.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f13fff640 1 -- 172.21.15.6:0/1545106976 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c00fd10 con 0x7f3f140047d0 2023-07-21T22:35:27.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f32100640 1 -- 172.21.15.6:0/1545106976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f2c0c5d20 con 0x7f3f140047d0 2023-07-21T22:35:27.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f32100640 1 -- 172.21.15.6:0/1545106976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f2c0c7fd0 con 0x7f3f140047d0 2023-07-21T22:35:27.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f32100640 1 -- 172.21.15.6:0/1545106976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2c0ca1a0 con 0x7f3f140047d0 2023-07-21T22:35:27.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.434+0000 7f3f13fff640 1 -- 172.21.15.6:0/1545106976 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3f1c01d460 con 0x7f3f140047d0 2023-07-21T22:35:27.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.438+0000 7f3f13fff640 1 --2- 172.21.15.6:0/1545106976 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f3f180663d0 0x7f3f18068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.438+0000 7f3f13fff640 1 -- 172.21.15.6:0/1545106976 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6837+0+0 (secure 0 0 0) 0x7f3f1c084330 con 0x7f3f140047d0 2023-07-21T22:35:27.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.438+0000 7f3f2affd640 1 --2- 172.21.15.6:0/1545106976 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f3f180663d0 0x7f3f18068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.438+0000 7f3f2affd640 1 --2- 172.21.15.6:0/1545106976 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f3f180663d0 0x7f3f18068880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3f200af000 tx=0x7f3f200046d0 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:27.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.442+0000 7f3f13fff640 1 -- 172.21.15.6:0/1545106976 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3f1c0512f0 con 0x7f3f140047d0 2023-07-21T22:35:27.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.630+0000 7f3f32100640 1 -- 172.21.15.6:0/1545106976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f2c0678d0 con 0x7f3f140047d0 2023-07-21T22:35:27.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.634+0000 7f3f13fff640 1 -- 172.21.15.6:0/1545106976 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4670 (secure 0 0 0) 0x7f3f1c054910 con 0x7f3f140047d0 2023-07-21T22:35:27.683 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:27.683 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":39,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/750234701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":750234701},{"type":"v1","addr":"172.21.15.6:6835","nonce":750234701}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1418940969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1418940969},{"type":"v1","addr":"172.21.15.161:6837","nonce":1418940969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6976,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3127204881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3127204881},{"type":"v1","addr":"172.21.15.161:6836","nonce":3127204881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:35:02.102268+0000","modified":"2023-07-21T22:35:05.730598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7131},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7131":{"gid":7131,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6833/4157903762","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":4157903762},{"type":"v1","addr":"172.21.15.6:6833","nonce":4157903762}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-21T22:35:27.684 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 39 2023-07-21T22:35:27.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.634+0000 7f3f32100640 1 -- 172.21.15.6:0/1545106976 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f3f180663d0 msgr2=0x7f3f18068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:27.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.634+0000 7f3f32100640 1 --2- 172.21.15.6:0/1545106976 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f3f180663d0 0x7f3f18068880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3f200af000 tx=0x7f3f200046d0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.634+0000 7f3f32100640 1 -- 172.21.15.6:0/1545106976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f140047d0 msgr2=0x7f3f2c0c3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:27.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.634+0000 7f3f32100640 1 --2- 172.21.15.6:0/1545106976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f140047d0 0x7f3f2c0c3230 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c007310 tx=0x7f3f1c0077d0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.634+0000 7f3f32100640 1 -- 172.21.15.6:0/1545106976 shutdown_connections 2023-07-21T22:35:27.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.634+0000 7f3f32100640 1 --2- 172.21.15.6:0/1545106976 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f3f180663d0 0x7f3f18068880 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.634+0000 7f3f32100640 1 --2- 172.21.15.6:0/1545106976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f2c1f77e0 0x7f3f2c1f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.634+0000 7f3f32100640 1 --2- 172.21.15.6:0/1545106976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f2c0c6520 0x7f3f2c0c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.634+0000 7f3f32100640 1 --2- 172.21.15.6:0/1545106976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f140047d0 0x7f3f2c0c3230 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.634+0000 7f3f32100640 1 -- 172.21.15.6:0/1545106976 >> 172.21.15.6:0/1545106976 conn(0x7f3f2c0afcf0 msgr2=0x7f3f2c157fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:27.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.634+0000 7f3f32100640 1 -- 172.21.15.6:0/1545106976 shutdown_connections 2023-07-21T22:35:27.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.634+0000 7f3f32100640 1 -- 172.21.15.6:0/1545106976 wait complete. 2023-07-21T22:35:27.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:35:27.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.798+0000 7fc9c4959640 1 Processor -- start 2023-07-21T22:35:27.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.798+0000 7fc9c4959640 1 -- start start 2023-07-21T22:35:27.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.798+0000 7fc9c4959640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc9c0160450 0x7fc9c006e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.798+0000 7fc9c4959640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c00c9c30 con 0x7fc9c015bc00 2023-07-21T22:35:27.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.798+0000 7fc9c4959640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c015bfd0 con 0x7fc9c0069430 2023-07-21T22:35:27.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.798+0000 7fc9c4959640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c00c96b0 con 0x7fc9c0160450 2023-07-21T22:35:27.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.798+0000 7fc9be59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc9c015bc00 0x7fc9c00ce8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53882/0 (socket says 172.21.15.6:53882) 2023-07-21T22:35:27.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.798+0000 7fc9be59c640 1 -- 172.21.15.6:0/3217105282 learned_addr learned my addr 172.21.15.6:0/3217105282 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:27.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.798+0000 7fc9b7fff640 1 --2- 172.21.15.6:0/3217105282 >> v2:172.21.15.161:3300/0 conn(0x7fc9c0160450 0x7fc9c006e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.798+0000 7fc9bdd9b640 1 -- 172.21.15.6:0/3217105282 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2251278619 0 0) 0x7fc9c00c9c30 con 0x7fc9c015bc00 2023-07-21T22:35:27.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.798+0000 7fc9bdd9b640 1 -- 172.21.15.6:0/3217105282 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9ac003530 con 0x7fc9c015bc00 2023-07-21T22:35:27.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9bdd9b640 1 -- 172.21.15.6:0/3217105282 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1402894492 0 0) 0x7fc9ac003530 con 0x7fc9c015bc00 2023-07-21T22:35:27.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9bdd9b640 1 -- 172.21.15.6:0/3217105282 >> v2:172.21.15.161:3300/0 conn(0x7fc9c0160450 msgr2=0x7fc9c006e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:27.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9bdd9b640 1 --2- 172.21.15.6:0/3217105282 >> v2:172.21.15.161:3300/0 conn(0x7fc9c0160450 0x7fc9c006e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9bdd9b640 1 -- 172.21.15.6:0/3217105282 >> v1:172.21.15.161:6789/0 conn(0x7fc9c0069430 legacy=0x7fc9c0069830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:27.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9bdd9b640 1 -- 172.21.15.6:0/3217105282 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c00cf910 con 0x7fc9c015bc00 2023-07-21T22:35:27.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9bdd9b640 1 -- 172.21.15.6:0/3217105282 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fc9b0001680 con 0x7fc9c015bc00 2023-07-21T22:35:27.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9bdd9b640 1 -- 172.21.15.6:0/3217105282 >> v1:172.21.15.6:6789/0 conn(0x7fc9c015bc00 legacy=0x7fc9c00ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:27.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9bdd9b640 1 --2- 172.21.15.6:0/3217105282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9ac003980 0x7fc9ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9bdd9b640 1 --2- 172.21.15.6:0/3217105282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9ac0047d0 0x7fc9ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9bdd9b640 1 --2- 172.21.15.6:0/3217105282 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9ac005180 0x7fc9ac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9bdd9b640 1 -- 172.21.15.6:0/3217105282 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c00c96b0 con 0x7fc9ac003980 2023-07-21T22:35:27.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9bdd9b640 1 -- 172.21.15.6:0/3217105282 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac00c000 con 0x7fc9ac0047d0 2023-07-21T22:35:27.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9bdd9b640 1 -- 172.21.15.6:0/3217105282 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ac00c1c0 con 0x7fc9ac005180 2023-07-21T22:35:27.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9be59c640 1 --2- 172.21.15.6:0/3217105282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9ac003980 0x7fc9ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9b7fff640 1 --2- 172.21.15.6:0/3217105282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9ac0047d0 0x7fc9ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9bed9d640 1 --2- 172.21.15.6:0/3217105282 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9ac005180 0x7fc9ac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9be59c640 1 -- 172.21.15.6:0/3217105282 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9ac005180 msgr2=0x7fc9ac00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:27.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9be59c640 1 --2- 172.21.15.6:0/3217105282 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9ac005180 0x7fc9ac00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9be59c640 1 -- 172.21.15.6:0/3217105282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9ac0047d0 msgr2=0x7fc9ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:27.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9be59c640 1 --2- 172.21.15.6:0/3217105282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9ac0047d0 0x7fc9ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9be59c640 1 -- 172.21.15.6:0/3217105282 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac003530 con 0x7fc9ac003980 2023-07-21T22:35:27.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9b7fff640 1 --2- 172.21.15.6:0/3217105282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9ac0047d0 0x7fc9ac004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:27.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9bed9d640 1 -- 172.21.15.6:0/3217105282 reap_dead start 2023-07-21T22:35:27.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9be59c640 1 --2- 172.21.15.6:0/3217105282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9ac003980 0x7fc9ac003d90 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000c240 tx=0x7fc9b001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c47e53cb73958 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:27.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9bdd9b640 1 -- 172.21.15.6:0/3217105282 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0005ae0 con 0x7fc9ac003980 2023-07-21T22:35:27.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9bdd9b640 1 -- 172.21.15.6:0/3217105282 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b0005c40 con 0x7fc9ac003980 2023-07-21T22:35:27.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.802+0000 7fc9bdd9b640 1 -- 172.21.15.6:0/3217105282 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00072b0 con 0x7fc9ac003980 2023-07-21T22:35:27.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.806+0000 7fc9c4959640 1 -- 172.21.15.6:0/3217105282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9ac003980 msgr2=0x7fc9ac003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:27.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.806+0000 7fc9c4959640 1 --2- 172.21.15.6:0/3217105282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9ac003980 0x7fc9ac003d90 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000c240 tx=0x7fc9b001cc10 comp rx=0 tx=0).stop 2023-07-21T22:35:27.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.806+0000 7fc9c4959640 1 -- 172.21.15.6:0/3217105282 shutdown_connections 2023-07-21T22:35:27.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.806+0000 7fc9c4959640 1 --2- 172.21.15.6:0/3217105282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9ac003980 0x7fc9ac003d90 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.806+0000 7fc9c4959640 1 -- 172.21.15.6:0/3217105282 >> 172.21.15.6:0/3217105282 conn(0x7fc9c00b1840 msgr2=0x7fc9c00cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:27.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.806+0000 7fc9c4959640 1 -- 172.21.15.6:0/3217105282 shutdown_connections 2023-07-21T22:35:27.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.806+0000 7fc9c4959640 1 -- 172.21.15.6:0/3217105282 wait complete. 2023-07-21T22:35:27.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.806+0000 7fc9c4959640 1 Processor -- start 2023-07-21T22:35:27.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.806+0000 7fc9c4959640 1 -- start start 2023-07-21T22:35:27.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.806+0000 7fc9c4959640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9ac003980 0x7fc9c014eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.806+0000 7fc9c4959640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c014f090 0x7fc9c00b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.806+0000 7fc9c4959640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9c00b2e00 0x7fc9c00afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.806+0000 7fc9c4959640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c00b3eb0 con 0x7fc9c014f090 2023-07-21T22:35:27.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.806+0000 7fc9c4959640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c00b32a0 con 0x7fc9c00b2e00 2023-07-21T22:35:27.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.806+0000 7fc9c4959640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c00b3580 con 0x7fc9ac003980 2023-07-21T22:35:27.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.806+0000 7fc9b7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c014f090 0x7fc9c00b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.806+0000 7fc9b7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c014f090 0x7fc9c00b28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52792/0 (socket says 172.21.15.6:52792) 2023-07-21T22:35:27.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.806+0000 7fc9b7fff640 1 -- 172.21.15.6:0/158246716 learned_addr learned my addr 172.21.15.6:0/158246716 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:27.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.810+0000 7fc9be59c640 1 --2- 172.21.15.6:0/158246716 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9ac003980 0x7fc9c014eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.810+0000 7fc9bed9d640 1 --2- 172.21.15.6:0/158246716 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9c00b2e00 0x7fc9c00afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.810+0000 7fc9b7fff640 1 -- 172.21.15.6:0/158246716 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9ac003980 msgr2=0x7fc9c014eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:27.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.810+0000 7fc9b7fff640 1 --2- 172.21.15.6:0/158246716 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9ac003980 0x7fc9c014eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.810+0000 7fc9b7fff640 1 -- 172.21.15.6:0/158246716 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9c00b2e00 msgr2=0x7fc9c00afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:27.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.810+0000 7fc9b7fff640 1 --2- 172.21.15.6:0/158246716 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9c00b2e00 0x7fc9c00afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:27.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.810+0000 7fc9b7fff640 1 -- 172.21.15.6:0/158246716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c00b3860 con 0x7fc9c014f090 2023-07-21T22:35:27.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.810+0000 7fc9bed9d640 1 --2- 172.21.15.6:0/158246716 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9c00b2e00 0x7fc9c00afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:27.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.810+0000 7fc9b7fff640 1 --2- 172.21.15.6:0/158246716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c014f090 0x7fc9c00b28c0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80118d0 tx=0x7fc9a8011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:27.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.810+0000 7fc9b6ffd640 1 -- 172.21.15.6:0/158246716 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a8004220 con 0x7fc9c014f090 2023-07-21T22:35:27.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.810+0000 7fc9b6ffd640 1 -- 172.21.15.6:0/158246716 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a8004380 con 0x7fc9c014f090 2023-07-21T22:35:27.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.810+0000 7fc9c4959640 1 -- 172.21.15.6:0/158246716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c00b3b40 con 0x7fc9c014f090 2023-07-21T22:35:27.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.810+0000 7fc9b6ffd640 1 -- 172.21.15.6:0/158246716 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a800fbd0 con 0x7fc9c014f090 2023-07-21T22:35:27.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.810+0000 7fc9c4959640 1 -- 172.21.15.6:0/158246716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c015e6a0 con 0x7fc9c014f090 2023-07-21T22:35:27.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.810+0000 7fc9c4959640 1 -- 172.21.15.6:0/158246716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c00c9500 con 0x7fc9c014f090 2023-07-21T22:35:27.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.810+0000 7fc9b6ffd640 1 -- 172.21.15.6:0/158246716 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc9a800fd30 con 0x7fc9c014f090 2023-07-21T22:35:27.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.810+0000 7fc9b6ffd640 1 --2- 172.21.15.6:0/158246716 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fc9a00663a0 0x7fc9a0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:27.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.810+0000 7fc9b6ffd640 1 -- 172.21.15.6:0/158246716 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6837+0+0 (secure 0 0 0) 0x7fc9a80847c0 con 0x7fc9c014f090 2023-07-21T22:35:27.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.814+0000 7fc9be59c640 1 --2- 172.21.15.6:0/158246716 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fc9a00663a0 0x7fc9a0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:27.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.814+0000 7fc9be59c640 1 --2- 172.21.15.6:0/158246716 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fc9a00663a0 0x7fc9a0068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc9b00ab000 tx=0x7fc9b00b1040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:27.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.814+0000 7fc9b6ffd640 1 -- 172.21.15.6:0/158246716 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc9a8051780 con 0x7fc9c014f090 2023-07-21T22:35:28.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.974+0000 7fc9c4959640 1 -- 172.21.15.6:0/158246716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9c015f490 con 0x7fc9c014f090 2023-07-21T22:35:28.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.974+0000 7fc9b6ffd640 1 -- 172.21.15.6:0/158246716 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+19432 (secure 0 0 0) 0x7fc9a8054da0 con 0x7fc9c014f090 2023-07-21T22:35:28.027 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:28.027 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":100,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:35:24.993729+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:35:00.223294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-21T22:35:01.098128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/3132041694":"2023-07-22T22:35:24.993674+0000","172.21.15.161:6833/3485676193":"2023-07-22T22:35:24.993674+0000","172.21.15.161:6832/3485676193":"2023-07-22T22:35:24.993674+0000","172.21.15.161:0/1718502794":"2023-07-22T22:35:24.993674+0000","172.21.15.161:0/1425014400":"2023-07-22T22:35:24.993674+0000","172.21.15.161:0/2079743043":"2023-07-22T22:35:24.993674+0000","172.21.15.161:0/504326695":"2023-07-22T22:35:24.993674+0000","172.21.15.161:0/363819523":"2023-07-22T22:35:24.993674+0000","172.21.15.161:0/2603665139":"2023-07-22T22:35:19.216600+0000","172.21.15.161:0/2870923080":"2023-07-22T22:35:24.993674+0000","172.21.15.161:0/2022432677":"2023-07-22T22:35:19.216600+0000","172.21.15.161:0/567935630":"2023-07-22T22:35:19.216600+0000","172.21.15.161:0/2968204385":"2023-07-22T22:35:19.216600+0000","172.21.15.161:0/2475523917":"2023-07-22T22:35:19.216600+0000","172.21.15.161:0/1706579505":"2023-07-22T22:35:19.216600+0000","172.21.15.161:6833/3267017989":"2023-07-22T22:35:19.216600+0000","172.21.15.161:6832/3267017989":"2023-07-22T22:35:19.216600+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:35:28.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.978+0000 7fc9c4959640 1 -- 172.21.15.6:0/158246716 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fc9a00663a0 msgr2=0x7fc9a0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:28.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.978+0000 7fc9c4959640 1 --2- 172.21.15.6:0/158246716 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fc9a00663a0 0x7fc9a0068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc9b00ab000 tx=0x7fc9b00b1040 comp rx=0 tx=0).stop 2023-07-21T22:35:28.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.978+0000 7fc9c4959640 1 -- 172.21.15.6:0/158246716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c014f090 msgr2=0x7fc9c00b28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:28.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.978+0000 7fc9c4959640 1 --2- 172.21.15.6:0/158246716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c014f090 0x7fc9c00b28c0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fc9a80118d0 tx=0x7fc9a8011d90 comp rx=0 tx=0).stop 2023-07-21T22:35:28.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.978+0000 7fc9c4959640 1 -- 172.21.15.6:0/158246716 shutdown_connections 2023-07-21T22:35:28.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.978+0000 7fc9c4959640 1 --2- 172.21.15.6:0/158246716 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fc9a00663a0 0x7fc9a0068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.978+0000 7fc9c4959640 1 --2- 172.21.15.6:0/158246716 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9c00b2e00 0x7fc9c00afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.978+0000 7fc9c4959640 1 --2- 172.21.15.6:0/158246716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9c014f090 0x7fc9c00b28c0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.978+0000 7fc9c4959640 1 --2- 172.21.15.6:0/158246716 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9ac003980 0x7fc9c014eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.978+0000 7fc9c4959640 1 -- 172.21.15.6:0/158246716 >> 172.21.15.6:0/158246716 conn(0x7fc9c00b1840 msgr2=0x7fc9c006cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:28.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.978+0000 7fc9c4959640 1 -- 172.21.15.6:0/158246716 shutdown_connections 2023-07-21T22:35:28.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:27.978+0000 7fc9c4959640 1 -- 172.21.15.6:0/158246716 wait complete. 2023-07-21T22:35:28.048 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-21T22:35:28.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.142+0000 7fe730d40640 1 Processor -- start 2023-07-21T22:35:28.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.142+0000 7fe730d40640 1 -- start start 2023-07-21T22:35:28.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.142+0000 7fe730d40640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe72c158ce0 0x7fe72c070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:28.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.142+0000 7fe730d40640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe72c0c9730 0x7fe72c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:28.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.142+0000 7fe730d40640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe72c0cc700 con 0x7fe72c0c8ad0 2023-07-21T22:35:28.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.142+0000 7fe730d40640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72c0b0ff0 con 0x7fe72c0c9730 2023-07-21T22:35:28.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.142+0000 7fe730d40640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe72c070c80 con 0x7fe72c158ce0 2023-07-21T22:35:28.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.142+0000 7fe72ad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe72c0c9730 0x7fe72c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:28.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.142+0000 7fe72ad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe72c0c9730 0x7fe72c0ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52798/0 (socket says 172.21.15.6:52798) 2023-07-21T22:35:28.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.142+0000 7fe72ad9d640 1 -- 172.21.15.6:0/2666669862 learned_addr learned my addr 172.21.15.6:0/2666669862 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:28.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.142+0000 7fe72a59c640 1 --2- 172.21.15.6:0/2666669862 >> v2:172.21.15.161:3300/0 conn(0x7fe72c158ce0 0x7fe72c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:28.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.146+0000 7fe72ad9d640 1 -- 172.21.15.6:0/2666669862 >> v2:172.21.15.161:3300/0 conn(0x7fe72c158ce0 msgr2=0x7fe72c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:28.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.146+0000 7fe72ad9d640 1 --2- 172.21.15.6:0/2666669862 >> v2:172.21.15.161:3300/0 conn(0x7fe72c158ce0 0x7fe72c070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.146+0000 7fe72ad9d640 1 -- 172.21.15.6:0/2666669862 >> v1:172.21.15.161:6789/0 conn(0x7fe72c0c8ad0 legacy=0x7fe72c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:28.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.146+0000 7fe72ad9d640 1 -- 172.21.15.6:0/2666669862 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72c0cbdd0 con 0x7fe72c0c9730 2023-07-21T22:35:28.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.146+0000 7fe72a59c640 1 --2- 172.21.15.6:0/2666669862 >> v2:172.21.15.161:3300/0 conn(0x7fe72c158ce0 0x7fe72c070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:28.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.146+0000 7fe72ad9d640 1 --2- 172.21.15.6:0/2666669862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe72c0c9730 0x7fe72c0ccb90 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fe72c071be0 tx=0x7fe72401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7097b9d22ff3e870 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:28.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.146+0000 7fe729d9b640 1 -- 172.21.15.6:0/2666669862 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7240a5650 con 0x7fe72c0c9730 2023-07-21T22:35:28.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.146+0000 7fe729d9b640 1 -- 172.21.15.6:0/2666669862 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7240a57b0 con 0x7fe72c0c9730 2023-07-21T22:35:28.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.146+0000 7fe729d9b640 1 -- 172.21.15.6:0/2666669862 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7240a5b40 con 0x7fe72c0c9730 2023-07-21T22:35:28.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.146+0000 7fe730d40640 1 -- 172.21.15.6:0/2666669862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe72c0c9730 msgr2=0x7fe72c0ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:28.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.146+0000 7fe730d40640 1 --2- 172.21.15.6:0/2666669862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe72c0c9730 0x7fe72c0ccb90 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fe72c071be0 tx=0x7fe72401c880 comp rx=0 tx=0).stop 2023-07-21T22:35:28.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.146+0000 7fe730d40640 1 -- 172.21.15.6:0/2666669862 shutdown_connections 2023-07-21T22:35:28.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.146+0000 7fe730d40640 1 --2- 172.21.15.6:0/2666669862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe72c0c9730 0x7fe72c0ccb90 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.146+0000 7fe730d40640 1 --2- 172.21.15.6:0/2666669862 >> v2:172.21.15.161:3300/0 conn(0x7fe72c158ce0 0x7fe72c070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.146+0000 7fe730d40640 1 -- 172.21.15.6:0/2666669862 >> 172.21.15.6:0/2666669862 conn(0x7fe72c0afcf0 msgr2=0x7fe72c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:28.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.146+0000 7fe730d40640 1 -- 172.21.15.6:0/2666669862 shutdown_connections 2023-07-21T22:35:28.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.146+0000 7fe730d40640 1 -- 172.21.15.6:0/2666669862 wait complete. 2023-07-21T22:35:28.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.150+0000 7fe730d40640 1 Processor -- start 2023-07-21T22:35:28.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.150+0000 7fe730d40640 1 -- start start 2023-07-21T22:35:28.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.150+0000 7fe730d40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe72c0c8ad0 0x7fe72c15ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:28.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.150+0000 7fe730d40640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe72c0c9730 0x7fe72c0ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:28.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.150+0000 7fe730d40640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe72c158ce0 0x7fe72c146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:28.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.150+0000 7fe730d40640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c0b3ec0 con 0x7fe72c158ce0 2023-07-21T22:35:28.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.150+0000 7fe730d40640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c0c1130 con 0x7fe72c0c9730 2023-07-21T22:35:28.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.150+0000 7fe730d40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72c0b35d0 con 0x7fe72c0c8ad0 2023-07-21T22:35:28.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.150+0000 7fe72ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe72c158ce0 0x7fe72c146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:28.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.150+0000 7fe72ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe72c158ce0 0x7fe72c146cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52802/0 (socket says 172.21.15.6:52802) 2023-07-21T22:35:28.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.150+0000 7fe72ad9d640 1 -- 172.21.15.6:0/2142069474 learned_addr learned my addr 172.21.15.6:0/2142069474 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:28.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.150+0000 7fe72a59c640 1 --2- 172.21.15.6:0/2142069474 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe72c0c8ad0 0x7fe72c15ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:28.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.150+0000 7fe723fff640 1 --2- 172.21.15.6:0/2142069474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe72c0c9730 0x7fe72c0ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:28.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.150+0000 7fe72ad9d640 1 -- 172.21.15.6:0/2142069474 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe72c0c8ad0 msgr2=0x7fe72c15ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:28.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.150+0000 7fe72ad9d640 1 --2- 172.21.15.6:0/2142069474 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe72c0c8ad0 0x7fe72c15ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.150+0000 7fe72ad9d640 1 -- 172.21.15.6:0/2142069474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe72c0c9730 msgr2=0x7fe72c0ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:28.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.150+0000 7fe72ad9d640 1 --2- 172.21.15.6:0/2142069474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe72c0c9730 0x7fe72c0ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.150+0000 7fe72ad9d640 1 -- 172.21.15.6:0/2142069474 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe724009b30 con 0x7fe72c158ce0 2023-07-21T22:35:28.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.150+0000 7fe723fff640 1 --2- 172.21.15.6:0/2142069474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe72c0c9730 0x7fe72c0ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:28.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.150+0000 7fe72ad9d640 1 --2- 172.21.15.6:0/2142069474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe72c158ce0 0x7fe72c146cf0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe7240af040 tx=0x7fe724019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:28.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.154+0000 7fe722ffd640 1 -- 172.21.15.6:0/2142069474 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7240b8670 con 0x7fe72c158ce0 2023-07-21T22:35:28.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.154+0000 7fe722ffd640 1 -- 172.21.15.6:0/2142069474 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7240b87d0 con 0x7fe72c158ce0 2023-07-21T22:35:28.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.154+0000 7fe730d40640 1 -- 172.21.15.6:0/2142069474 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe72c0b3870 con 0x7fe72c158ce0 2023-07-21T22:35:28.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.154+0000 7fe722ffd640 1 -- 172.21.15.6:0/2142069474 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7240b8b80 con 0x7fe72c158ce0 2023-07-21T22:35:28.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.154+0000 7fe730d40640 1 -- 172.21.15.6:0/2142069474 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe72c15c050 con 0x7fe72c158ce0 2023-07-21T22:35:28.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.154+0000 7fe730d40640 1 -- 172.21.15.6:0/2142069474 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe72c0ca1a0 con 0x7fe72c158ce0 2023-07-21T22:35:28.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.154+0000 7fe722ffd640 1 -- 172.21.15.6:0/2142069474 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe7240b8ce0 con 0x7fe72c158ce0 2023-07-21T22:35:28.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.154+0000 7fe722ffd640 1 --2- 172.21.15.6:0/2142069474 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fe70c0663a0 0x7fe70c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:28.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.154+0000 7fe722ffd640 1 -- 172.21.15.6:0/2142069474 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6837+0+0 (secure 0 0 0) 0x7fe72411f670 con 0x7fe72c158ce0 2023-07-21T22:35:28.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.154+0000 7fe72a59c640 1 --2- 172.21.15.6:0/2142069474 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fe70c0663a0 0x7fe70c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:28.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.158+0000 7fe72a59c640 1 --2- 172.21.15.6:0/2142069474 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fe70c0663a0 0x7fe70c068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe71c006e90 tx=0x7fe71c008040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:28.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.158+0000 7fe722ffd640 1 -- 172.21.15.6:0/2142069474 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe7240ec6f0 con 0x7fe72c158ce0 2023-07-21T22:35:28.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.350+0000 7fe730d40640 1 -- 172.21.15.6:0/2142069474 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe72c0b4070 con 0x7fe72c158ce0 2023-07-21T22:35:28.400 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-07-21T22:35:28.350+0000 7f195e836640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-21T22:35:28.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.354+0000 7fe722ffd640 1 -- 172.21.15.6:0/2142069474 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe72c0b4070 con 0x7fe72c158ce0 2023-07-21T22:35:28.406 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-21T22:35:28.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.358+0000 7fe730d40640 1 -- 172.21.15.6:0/2142069474 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fe70c0663a0 msgr2=0x7fe70c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:28.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.358+0000 7fe730d40640 1 --2- 172.21.15.6:0/2142069474 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fe70c0663a0 0x7fe70c068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe71c006e90 tx=0x7fe71c008040 comp rx=0 tx=0).stop 2023-07-21T22:35:28.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.358+0000 7fe730d40640 1 -- 172.21.15.6:0/2142069474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe72c158ce0 msgr2=0x7fe72c146cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:28.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.358+0000 7fe730d40640 1 --2- 172.21.15.6:0/2142069474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe72c158ce0 0x7fe72c146cf0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe7240af040 tx=0x7fe724019620 comp rx=0 tx=0).stop 2023-07-21T22:35:28.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.358+0000 7fe730d40640 1 -- 172.21.15.6:0/2142069474 shutdown_connections 2023-07-21T22:35:28.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.358+0000 7fe730d40640 1 --2- 172.21.15.6:0/2142069474 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fe70c0663a0 0x7fe70c068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.358+0000 7fe730d40640 1 --2- 172.21.15.6:0/2142069474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe72c158ce0 0x7fe72c146cf0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.358+0000 7fe730d40640 1 --2- 172.21.15.6:0/2142069474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe72c0c9730 0x7fe72c0ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.358+0000 7fe730d40640 1 --2- 172.21.15.6:0/2142069474 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe72c0c8ad0 0x7fe72c15ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.358+0000 7fe730d40640 1 -- 172.21.15.6:0/2142069474 >> 172.21.15.6:0/2142069474 conn(0x7fe72c0afcf0 msgr2=0x7fe72c06ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:28.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.358+0000 7fe730d40640 1 -- 172.21.15.6:0/2142069474 shutdown_connections 2023-07-21T22:35:28.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.358+0000 7fe730d40640 1 -- 172.21.15.6:0/2142069474 wait complete. 2023-07-21T22:35:28.410 INFO:tasks.ceph.mds.a.smithi006.stderr: -2644> 2023-07-21T22:35:07.670+0000 7f2ad1da4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:35:28.428 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-21T22:35:28.458 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-07-21T22:35:28.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.526+0000 7f109e20b640 1 Processor -- start 2023-07-21T22:35:28.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.526+0000 7f109e20b640 1 -- start start 2023-07-21T22:35:28.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.526+0000 7f109e20b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f10980c85a0 0x7f109815c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:28.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.526+0000 7f109e20b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f109806cf10 0x7f10980c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:28.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.526+0000 7f109e20b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f109806b8f0 0x7f109806bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:28.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.526+0000 7f109e20b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10981595a0 con 0x7f10980c85a0 2023-07-21T22:35:28.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.526+0000 7f109e20b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109815cc70 con 0x7f109806cf10 2023-07-21T22:35:28.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.526+0000 7f109e20b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10981586e0 con 0x7f109806b8f0 2023-07-21T22:35:28.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.530+0000 7f10977fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f10980c85a0 0x7f109815c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:28.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.530+0000 7f10977fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f10980c85a0 0x7f109815c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52828/0 (socket says 172.21.15.6:52828) 2023-07-21T22:35:28.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.530+0000 7f10977fe640 1 -- 172.21.15.6:0/3189477616 learned_addr learned my addr 172.21.15.6:0/3189477616 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:28.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.530+0000 7f1096ffd640 1 --2- 172.21.15.6:0/3189477616 >> v2:172.21.15.161:3300/0 conn(0x7f109806cf10 0x7f10980c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:28.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.530+0000 7f1097fff640 1 --2- 172.21.15.6:0/3189477616 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f109806b8f0 0x7f109806bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:28.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.530+0000 7f10977fe640 1 -- 172.21.15.6:0/3189477616 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f109806b8f0 msgr2=0x7f109806bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:28.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.530+0000 7f10977fe640 1 --2- 172.21.15.6:0/3189477616 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f109806b8f0 0x7f109806bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.530+0000 7f10977fe640 1 -- 172.21.15.6:0/3189477616 >> v2:172.21.15.161:3300/0 conn(0x7f109806cf10 msgr2=0x7f10980c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:28.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.530+0000 7f10977fe640 1 --2- 172.21.15.6:0/3189477616 >> v2:172.21.15.161:3300/0 conn(0x7f109806cf10 0x7f10980c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.530+0000 7f10977fe640 1 -- 172.21.15.6:0/3189477616 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10981560a0 con 0x7f10980c85a0 2023-07-21T22:35:28.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.530+0000 7f1097fff640 1 --2- 172.21.15.6:0/3189477616 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f109806b8f0 0x7f109806bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:28.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.530+0000 7f1096ffd640 1 --2- 172.21.15.6:0/3189477616 >> v2:172.21.15.161:3300/0 conn(0x7f109806cf10 0x7f10980c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:28.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.530+0000 7f10977fe640 1 --2- 172.21.15.6:0/3189477616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10980c85a0 0x7f109815c730 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f10980c9f00 tx=0x7f108801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3adad144ff35fe server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:28.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f10967fc640 1 -- 172.21.15.6:0/3189477616 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10880ac600 con 0x7f10980c85a0 2023-07-21T22:35:28.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f10967fc640 1 -- 172.21.15.6:0/3189477616 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10880a8050 con 0x7f10980c85a0 2023-07-21T22:35:28.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f10967fc640 1 -- 172.21.15.6:0/3189477616 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10880ac980 con 0x7f10980c85a0 2023-07-21T22:35:28.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f109e20b640 1 -- 172.21.15.6:0/3189477616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10980c85a0 msgr2=0x7f109815c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:28.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f109e20b640 1 --2- 172.21.15.6:0/3189477616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10980c85a0 0x7f109815c730 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f10980c9f00 tx=0x7f108801c3e0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f109e20b640 1 -- 172.21.15.6:0/3189477616 shutdown_connections 2023-07-21T22:35:28.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f109e20b640 1 --2- 172.21.15.6:0/3189477616 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f109806b8f0 0x7f109806bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f109e20b640 1 --2- 172.21.15.6:0/3189477616 >> v2:172.21.15.161:3300/0 conn(0x7f109806cf10 0x7f10980c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f109e20b640 1 --2- 172.21.15.6:0/3189477616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10980c85a0 0x7f109815c730 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f109e20b640 1 -- 172.21.15.6:0/3189477616 >> 172.21.15.6:0/3189477616 conn(0x7f10980afac0 msgr2=0x7f10980afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:28.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f109e20b640 1 -- 172.21.15.6:0/3189477616 shutdown_connections 2023-07-21T22:35:28.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f109e20b640 1 -- 172.21.15.6:0/3189477616 wait complete. 2023-07-21T22:35:28.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f109e20b640 1 Processor -- start 2023-07-21T22:35:28.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f109e20b640 1 -- start start 2023-07-21T22:35:28.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f109e20b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f109806b8f0 0x7f10980b3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:28.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f109e20b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f109806cf10 0x7f10981464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:28.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f109e20b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10980c85a0 0x7f10980b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:28.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f109e20b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10980b2300 con 0x7f10980c85a0 2023-07-21T22:35:28.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f109e20b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1098071340 con 0x7f109806cf10 2023-07-21T22:35:28.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f109e20b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10981f3aa0 con 0x7f109806b8f0 2023-07-21T22:35:28.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f1097fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10980c85a0 0x7f10980b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:28.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f1097fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10980c85a0 0x7f10980b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52838/0 (socket says 172.21.15.6:52838) 2023-07-21T22:35:28.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.534+0000 7f1097fff640 1 -- 172.21.15.6:0/1297644058 learned_addr learned my addr 172.21.15.6:0/1297644058 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.538+0000 7f1096ffd640 1 --2- 172.21.15.6:0/1297644058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f109806cf10 0x7f10981464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.538+0000 7f1097fff640 1 -- 172.21.15.6:0/1297644058 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f109806b8f0 msgr2=0x7f10980b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.538+0000 7f10977fe640 1 --2- 172.21.15.6:0/1297644058 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f109806b8f0 0x7f10980b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.538+0000 7f1097fff640 1 --2- 172.21.15.6:0/1297644058 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f109806b8f0 0x7f10980b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.538+0000 7f1097fff640 1 -- 172.21.15.6:0/1297644058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f109806cf10 msgr2=0x7f10981464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.538+0000 7f1097fff640 1 --2- 172.21.15.6:0/1297644058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f109806cf10 0x7f10981464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.538+0000 7f1097fff640 1 -- 172.21.15.6:0/1297644058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10880094d0 con 0x7f10980c85a0 2023-07-21T22:35:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.538+0000 7f1096ffd640 1 --2- 172.21.15.6:0/1297644058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f109806cf10 0x7f10981464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.538+0000 7f10977fe640 1 --2- 172.21.15.6:0/1297644058 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f109806b8f0 0x7f10980b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.538+0000 7f1097fff640 1 --2- 172.21.15.6:0/1297644058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10980c85a0 0x7f10980b1a20 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f109000cd10 tx=0x7f109000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.538+0000 7f107ffff640 1 -- 172.21.15.6:0/1297644058 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109000f680 con 0x7f10980c85a0 2023-07-21T22:35:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.538+0000 7f107ffff640 1 -- 172.21.15.6:0/1297644058 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109000f800 con 0x7f10980c85a0 2023-07-21T22:35:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.538+0000 7f107ffff640 1 -- 172.21.15.6:0/1297644058 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109000fbb0 con 0x7f10980c85a0 2023-07-21T22:35:28.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.538+0000 7f109e20b640 1 -- 172.21.15.6:0/1297644058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10981f4620 con 0x7f10980c85a0 2023-07-21T22:35:28.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.538+0000 7f109e20b640 1 -- 172.21.15.6:0/1297644058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10981f3fd0 con 0x7f10980c85a0 2023-07-21T22:35:28.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.538+0000 7f109e20b640 1 -- 172.21.15.6:0/1297644058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10980c9b40 con 0x7f10980c85a0 2023-07-21T22:35:28.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.538+0000 7f107ffff640 1 -- 172.21.15.6:0/1297644058 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f109000b040 con 0x7f10980c85a0 2023-07-21T22:35:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.538+0000 7f107ffff640 1 --2- 172.21.15.6:0/1297644058 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f10840663d0 0x7f1084068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.538+0000 7f107ffff640 1 -- 172.21.15.6:0/1297644058 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6923+0+0 (secure 0 0 0) 0x7f1090084c40 con 0x7f10980c85a0 2023-07-21T22:35:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.542+0000 7f10977fe640 1 --2- 172.21.15.6:0/1297644058 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f10840663d0 0x7f1084068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.542+0000 7f10977fe640 1 --2- 172.21.15.6:0/1297644058 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f10840663d0 0x7f1084068880 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f10880ae000 tx=0x7f1088008040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:28.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.542+0000 7f107ffff640 1 -- 172.21.15.6:0/1297644058 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1090051b30 con 0x7f10980c85a0 2023-07-21T22:35:28.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:28.734+0000 7f109e20b640 1 -- 172.21.15.6:0/1297644058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f10981f47b0 con 0x7f10980c85a0 2023-07-21T22:35:29.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.358+0000 7f107ffff640 1 -- 172.21.15.6:0/1297644058 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1090055150 con 0x7f10980c85a0 2023-07-21T22:35:29.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.362+0000 7f109e20b640 1 -- 172.21.15.6:0/1297644058 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f10840663d0 msgr2=0x7f1084068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:29.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.362+0000 7f109e20b640 1 --2- 172.21.15.6:0/1297644058 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f10840663d0 0x7f1084068880 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f10880ae000 tx=0x7f1088008040 comp rx=0 tx=0).stop 2023-07-21T22:35:29.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.362+0000 7f109e20b640 1 -- 172.21.15.6:0/1297644058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10980c85a0 msgr2=0x7f10980b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:29.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.362+0000 7f109e20b640 1 --2- 172.21.15.6:0/1297644058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10980c85a0 0x7f10980b1a20 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f109000cd10 tx=0x7f109000a650 comp rx=0 tx=0).stop 2023-07-21T22:35:29.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.362+0000 7f109e20b640 1 -- 172.21.15.6:0/1297644058 shutdown_connections 2023-07-21T22:35:29.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.362+0000 7f109e20b640 1 --2- 172.21.15.6:0/1297644058 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f10840663d0 0x7f1084068880 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:29.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.362+0000 7f109e20b640 1 --2- 172.21.15.6:0/1297644058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10980c85a0 0x7f10980b1a20 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:29.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.362+0000 7f109e20b640 1 --2- 172.21.15.6:0/1297644058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f109806cf10 0x7f10981464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:29.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.362+0000 7f109e20b640 1 --2- 172.21.15.6:0/1297644058 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f109806b8f0 0x7f10980b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:29.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.362+0000 7f109e20b640 1 -- 172.21.15.6:0/1297644058 >> 172.21.15.6:0/1297644058 conn(0x7f10980afac0 msgr2=0x7f109806f770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:29.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.362+0000 7f109e20b640 1 -- 172.21.15.6:0/1297644058 shutdown_connections 2023-07-21T22:35:29.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.362+0000 7f109e20b640 1 -- 172.21.15.6:0/1297644058 wait complete. 2023-07-21T22:35:29.435 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-21T22:35:29.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.582+0000 7f01a199d640 1 Processor -- start 2023-07-21T22:35:29.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.582+0000 7f01a199d640 1 -- start start 2023-07-21T22:35:29.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.586+0000 7f01a199d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f019c159440 0x7f019c0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:29.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.586+0000 7f01a199d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019c1532b0 con 0x7f019c15cef0 2023-07-21T22:35:29.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.586+0000 7f01a199d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019c0ca6f0 con 0x7f019c0aeb40 2023-07-21T22:35:29.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.586+0000 7f01a199d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019c15d360 con 0x7f019c159440 2023-07-21T22:35:29.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.586+0000 7f019b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f019c159440 0x7f019c0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:29.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.586+0000 7f0193fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f019c15cef0 0x7f019c158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53904/0 (socket says 172.21.15.6:53904) 2023-07-21T22:35:29.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.586+0000 7f019b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f019c159440 0x7f019c0c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52854/0 (socket says 172.21.15.6:52854) 2023-07-21T22:35:29.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.586+0000 7f0193fff640 1 -- 172.21.15.6:0/1637564670 learned_addr learned my addr 172.21.15.6:0/1637564670 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:29.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.586+0000 7f019b7fe640 1 -- 172.21.15.6:0/1637564670 >> v1:172.21.15.161:6789/0 conn(0x7f019c0aeb40 legacy=0x7f019c0aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:29.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.586+0000 7f019b7fe640 1 -- 172.21.15.6:0/1637564670 >> v1:172.21.15.6:6789/0 conn(0x7f019c15cef0 legacy=0x7f019c158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:29.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.586+0000 7f019b7fe640 1 -- 172.21.15.6:0/1637564670 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019c1599d0 con 0x7f019c159440 2023-07-21T22:35:29.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.586+0000 7f019a7fc640 1 -- 172.21.15.6:0/1637564670 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435962656 0 0) 0x7f019c1532b0 con 0x7f019c15cef0 2023-07-21T22:35:29.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.590+0000 7f019b7fe640 1 --2- 172.21.15.6:0/1637564670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c159440 0x7f019c0c88c0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f0194009d90 tx=0x7f019401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c2ff7d3b1d7c0b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:29.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.590+0000 7f019a7fc640 1 -- 172.21.15.6:0/1637564670 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01940a59e0 con 0x7f019c159440 2023-07-21T22:35:29.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.590+0000 7f019a7fc640 1 -- 172.21.15.6:0/1637564670 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01940a5b40 con 0x7f019c159440 2023-07-21T22:35:29.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.590+0000 7f019a7fc640 1 -- 172.21.15.6:0/1637564670 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01940ad440 con 0x7f019c159440 2023-07-21T22:35:29.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.590+0000 7f01a199d640 1 -- 172.21.15.6:0/1637564670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c159440 msgr2=0x7f019c0c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:29.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.590+0000 7f01a199d640 1 --2- 172.21.15.6:0/1637564670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c159440 0x7f019c0c88c0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f0194009d90 tx=0x7f019401c920 comp rx=0 tx=0).stop 2023-07-21T22:35:29.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.590+0000 7f01a199d640 1 -- 172.21.15.6:0/1637564670 shutdown_connections 2023-07-21T22:35:29.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.590+0000 7f01a199d640 1 --2- 172.21.15.6:0/1637564670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c159440 0x7f019c0c88c0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:29.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.590+0000 7f01a199d640 1 -- 172.21.15.6:0/1637564670 >> 172.21.15.6:0/1637564670 conn(0x7f019c0cde90 msgr2=0x7f019c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:29.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.590+0000 7f01a199d640 1 -- 172.21.15.6:0/1637564670 shutdown_connections 2023-07-21T22:35:29.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.590+0000 7f01a199d640 1 -- 172.21.15.6:0/1637564670 wait complete. 2023-07-21T22:35:29.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.590+0000 7f01a199d640 1 Processor -- start 2023-07-21T22:35:29.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.590+0000 7f01a199d640 1 -- start start 2023-07-21T22:35:29.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.590+0000 7f01a199d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f019c0aeb40 0x7f019c06d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:29.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.590+0000 7f01a199d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f019c159440 0x7f019c14fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:29.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.590+0000 7f01a199d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c15cef0 0x7f019c14d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:29.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.590+0000 7f01a199d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c1504c0 con 0x7f019c15cef0 2023-07-21T22:35:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.590+0000 7f01a199d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c156b40 con 0x7f019c159440 2023-07-21T22:35:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.590+0000 7f01a199d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019c1502b0 con 0x7f019c0aeb40 2023-07-21T22:35:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.594+0000 7f019b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c15cef0 0x7f019c14d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.594+0000 7f019b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c15cef0 0x7f019c14d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52868/0 (socket says 172.21.15.6:52868) 2023-07-21T22:35:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.594+0000 7f019b7fe640 1 -- 172.21.15.6:0/1768962379 learned_addr learned my addr 172.21.15.6:0/1768962379 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:29.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.594+0000 7f019affd640 1 --2- 172.21.15.6:0/1768962379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f019c0aeb40 0x7f019c06d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:29.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.594+0000 7f0193fff640 1 --2- 172.21.15.6:0/1768962379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f019c159440 0x7f019c14fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:29.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.594+0000 7f019b7fe640 1 -- 172.21.15.6:0/1768962379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f019c0aeb40 msgr2=0x7f019c06d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:29.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.594+0000 7f019b7fe640 1 --2- 172.21.15.6:0/1768962379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f019c0aeb40 0x7f019c06d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:29.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.594+0000 7f019b7fe640 1 -- 172.21.15.6:0/1768962379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f019c159440 msgr2=0x7f019c14fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:29.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.594+0000 7f019b7fe640 1 --2- 172.21.15.6:0/1768962379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f019c159440 0x7f019c14fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:29.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.594+0000 7f019b7fe640 1 -- 172.21.15.6:0/1768962379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0194009a70 con 0x7f019c15cef0 2023-07-21T22:35:29.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.594+0000 7f0193fff640 1 --2- 172.21.15.6:0/1768962379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f019c159440 0x7f019c14fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:29.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.594+0000 7f019b7fe640 1 --2- 172.21.15.6:0/1768962379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c15cef0 0x7f019c14d910 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f0194009d90 tx=0x7f01940196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:29.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.594+0000 7f0198ff9640 1 -- 172.21.15.6:0/1768962379 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01940ade40 con 0x7f019c15cef0 2023-07-21T22:35:29.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.594+0000 7f0198ff9640 1 -- 172.21.15.6:0/1768962379 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01940b9450 con 0x7f019c15cef0 2023-07-21T22:35:29.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.594+0000 7f01a199d640 1 -- 172.21.15.6:0/1768962379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019c06c1a0 con 0x7f019c15cef0 2023-07-21T22:35:29.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.594+0000 7f0198ff9640 1 -- 172.21.15.6:0/1768962379 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01940b9800 con 0x7f019c15cef0 2023-07-21T22:35:29.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.594+0000 7f01a199d640 1 -- 172.21.15.6:0/1768962379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019c06c760 con 0x7f019c15cef0 2023-07-21T22:35:29.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.594+0000 7f01a199d640 1 -- 172.21.15.6:0/1768962379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019c156c80 con 0x7f019c15cef0 2023-07-21T22:35:29.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.594+0000 7f0198ff9640 1 -- 172.21.15.6:0/1768962379 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f019c0c9610 con 0x7f019c15cef0 2023-07-21T22:35:29.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.598+0000 7f0198ff9640 1 --2- 172.21.15.6:0/1768962379 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f017c0663a0 0x7f017c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:29.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.598+0000 7f0198ff9640 1 -- 172.21.15.6:0/1768962379 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6923+0+0 (secure 0 0 0) 0x7f019411f7f0 con 0x7f019c15cef0 2023-07-21T22:35:29.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.598+0000 7f019affd640 1 --2- 172.21.15.6:0/1768962379 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f017c0663a0 0x7f017c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:29.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.598+0000 7f019affd640 1 --2- 172.21.15.6:0/1768962379 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f017c0663a0 0x7f017c068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f018c007fd0 tx=0x7f018c009040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:29.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.602+0000 7f0198ff9640 1 -- 172.21.15.6:0/1768962379 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f019c156c80 con 0x7f019c15cef0 2023-07-21T22:35:29.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:29.754+0000 7f01a199d640 1 -- 172.21.15.6:0/1768962379 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f019c156c80 con 0x7f019c15cef0 2023-07-21T22:35:30.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.362+0000 7f0198ff9640 1 -- 172.21.15.6:0/1768962379 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v102) v1 ==== 181+0+0 (secure 0 0 0) 0x7f019c156c80 con 0x7f019c15cef0 2023-07-21T22:35:30.414 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-07-21T22:35:30.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.366+0000 7f01a199d640 1 -- 172.21.15.6:0/1768962379 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f017c0663a0 msgr2=0x7f017c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:30.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.366+0000 7f01a199d640 1 --2- 172.21.15.6:0/1768962379 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f017c0663a0 0x7f017c068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f018c007fd0 tx=0x7f018c009040 comp rx=0 tx=0).stop 2023-07-21T22:35:30.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.366+0000 7f01a199d640 1 -- 172.21.15.6:0/1768962379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c15cef0 msgr2=0x7f019c14d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:30.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.366+0000 7f01a199d640 1 --2- 172.21.15.6:0/1768962379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c15cef0 0x7f019c14d910 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f0194009d90 tx=0x7f01940196c0 comp rx=0 tx=0).stop 2023-07-21T22:35:30.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.366+0000 7f01a199d640 1 -- 172.21.15.6:0/1768962379 shutdown_connections 2023-07-21T22:35:30.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.366+0000 7f01a199d640 1 --2- 172.21.15.6:0/1768962379 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f017c0663a0 0x7f017c068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:30.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.366+0000 7f01a199d640 1 --2- 172.21.15.6:0/1768962379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c15cef0 0x7f019c14d910 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:30.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.366+0000 7f01a199d640 1 --2- 172.21.15.6:0/1768962379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f019c159440 0x7f019c14fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:30.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.366+0000 7f01a199d640 1 --2- 172.21.15.6:0/1768962379 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f019c0aeb40 0x7f019c06d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:30.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.366+0000 7f01a199d640 1 -- 172.21.15.6:0/1768962379 >> 172.21.15.6:0/1768962379 conn(0x7f019c0cde90 msgr2=0x7f019c0aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:30.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.366+0000 7f01a199d640 1 -- 172.21.15.6:0/1768962379 shutdown_connections 2023-07-21T22:35:30.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.366+0000 7f01a199d640 1 -- 172.21.15.6:0/1768962379 wait complete. 2023-07-21T22:35:30.440 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-21T22:35:30.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.538+0000 7f955b140640 1 Processor -- start 2023-07-21T22:35:30.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.538+0000 7f955b140640 1 -- start start 2023-07-21T22:35:30.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.538+0000 7f955b140640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f955415cef0 0x7f9554158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:30.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.538+0000 7f955b140640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95541532b0 con 0x7f95540aeb40 2023-07-21T22:35:30.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f955b140640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95540ca6f0 con 0x7f9554159270 2023-07-21T22:35:30.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f955b140640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955415d360 con 0x7f955415cef0 2023-07-21T22:35:30.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f9558edc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f95540aeb40 0x7f95540aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53912/0 (socket says 172.21.15.6:53912) 2023-07-21T22:35:30.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f9558edc640 1 -- 172.21.15.6:0/2443397958 learned_addr learned my addr 172.21.15.6:0/2443397958 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:30.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f9553fff640 1 --2- 172.21.15.6:0/2443397958 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f955415cef0 0x7f9554158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:30.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f95537fe640 1 -- 172.21.15.6:0/2443397958 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065385896 0 0) 0x7f95541532b0 con 0x7f95540aeb40 2023-07-21T22:35:30.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f95537fe640 1 -- 172.21.15.6:0/2443397958 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9544005740 con 0x7f95540aeb40 2023-07-21T22:35:30.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f95537fe640 1 -- 172.21.15.6:0/2443397958 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4250768824 0 0) 0x7f95540ca6f0 con 0x7f9554159270 2023-07-21T22:35:30.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f95537fe640 1 -- 172.21.15.6:0/2443397958 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95541532b0 con 0x7f9554159270 2023-07-21T22:35:30.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f95537fe640 1 -- 172.21.15.6:0/2443397958 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1313658718 0 0) 0x7f9544005740 con 0x7f95540aeb40 2023-07-21T22:35:30.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f95537fe640 1 -- 172.21.15.6:0/2443397958 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f955415cef0 msgr2=0x7f9554158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:30.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f95537fe640 1 --2- 172.21.15.6:0/2443397958 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f955415cef0 0x7f9554158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:30.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f95537fe640 1 -- 172.21.15.6:0/2443397958 >> v1:172.21.15.161:6789/0 conn(0x7f9554159270 legacy=0x7f95540c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:30.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f95537fe640 1 -- 172.21.15.6:0/2443397958 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95541599d0 con 0x7f95540aeb40 2023-07-21T22:35:30.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f95537fe640 1 -- 172.21.15.6:0/2443397958 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f9548001680 con 0x7f95540aeb40 2023-07-21T22:35:30.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f95537fe640 1 -- 172.21.15.6:0/2443397958 >> v1:172.21.15.6:6789/0 conn(0x7f95540aeb40 legacy=0x7f95540aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:30.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f95537fe640 1 --2- 172.21.15.6:0/2443397958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9544005d50 0x7f9544006140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:30.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f95537fe640 1 --2- 172.21.15.6:0/2443397958 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95440069e0 0x7f9544006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:30.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f95537fe640 1 --2- 172.21.15.6:0/2443397958 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9544007390 0x7f954400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:30.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f95537fe640 1 -- 172.21.15.6:0/2443397958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955415d360 con 0x7f9544005d50 2023-07-21T22:35:30.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f95537fe640 1 -- 172.21.15.6:0/2443397958 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954400e160 con 0x7f95440069e0 2023-07-21T22:35:30.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f95537fe640 1 -- 172.21.15.6:0/2443397958 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954400e320 con 0x7f9544007390 2023-07-21T22:35:30.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f9553fff640 1 --2- 172.21.15.6:0/2443397958 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f955415cef0 0x7f9554158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:30.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f9558edc640 1 --2- 172.21.15.6:0/2443397958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9544005d50 0x7f9544006140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:30.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f95596dd640 1 --2- 172.21.15.6:0/2443397958 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9544007390 0x7f954400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:30.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f9553fff640 1 --2- 172.21.15.6:0/2443397958 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95440069e0 0x7f9544006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:30.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f9558edc640 1 -- 172.21.15.6:0/2443397958 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9544007390 msgr2=0x7f954400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:30.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f9558edc640 1 --2- 172.21.15.6:0/2443397958 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9544007390 0x7f954400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:30.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f9558edc640 1 -- 172.21.15.6:0/2443397958 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95440069e0 msgr2=0x7f9544006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:30.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f9558edc640 1 --2- 172.21.15.6:0/2443397958 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95440069e0 0x7f9544006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:30.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f9558edc640 1 -- 172.21.15.6:0/2443397958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9544005740 con 0x7f9544005d50 2023-07-21T22:35:30.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.542+0000 7f9553fff640 1 --2- 172.21.15.6:0/2443397958 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95440069e0 0x7f9544006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:30.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.546+0000 7f9558edc640 1 --2- 172.21.15.6:0/2443397958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9544005d50 0x7f9544006140 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f954800c160 tx=0x7f954801cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6dde1ab66a1cd6f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:30.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.546+0000 7f95537fe640 1 -- 172.21.15.6:0/2443397958 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95480058e0 con 0x7f9544005d50 2023-07-21T22:35:30.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.546+0000 7f95537fe640 1 -- 172.21.15.6:0/2443397958 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9548005a60 con 0x7f9544005d50 2023-07-21T22:35:30.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.546+0000 7f95537fe640 1 -- 172.21.15.6:0/2443397958 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9548005e10 con 0x7f9544005d50 2023-07-21T22:35:30.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.546+0000 7f955b140640 1 -- 172.21.15.6:0/2443397958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9544005d50 msgr2=0x7f9544006140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:30.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.546+0000 7f955b140640 1 --2- 172.21.15.6:0/2443397958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9544005d50 0x7f9544006140 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f954800c160 tx=0x7f954801cad0 comp rx=0 tx=0).stop 2023-07-21T22:35:30.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.546+0000 7f95596dd640 1 -- 172.21.15.6:0/2443397958 reap_dead start 2023-07-21T22:35:30.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.546+0000 7f955b140640 1 -- 172.21.15.6:0/2443397958 shutdown_connections 2023-07-21T22:35:30.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.546+0000 7f955b140640 1 -- 172.21.15.6:0/2443397958 >> 172.21.15.6:0/2443397958 conn(0x7f95540cde90 msgr2=0x7f95540ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:30.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.546+0000 7f955b140640 1 -- 172.21.15.6:0/2443397958 shutdown_connections 2023-07-21T22:35:30.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.546+0000 7f955b140640 1 -- 172.21.15.6:0/2443397958 wait complete. 2023-07-21T22:35:30.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.550+0000 7f955b140640 1 Processor -- start 2023-07-21T22:35:30.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.550+0000 7f955b140640 1 -- start start 2023-07-21T22:35:30.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.550+0000 7f955b140640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9544005d50 0x7f955414ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:30.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.550+0000 7f955b140640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f955414b1a0 0x7f955414cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:30.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.550+0000 7f955b140640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f955414d040 0x7f955415e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:30.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.550+0000 7f955b140640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955406fa70 con 0x7f955414b1a0 2023-07-21T22:35:30.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.550+0000 7f955b140640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955406fcc0 con 0x7f9544005d50 2023-07-21T22:35:30.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.550+0000 7f955b140640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955406ffa0 con 0x7f955414d040 2023-07-21T22:35:30.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.550+0000 7f9553fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f955414b1a0 0x7f955414cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:30.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.550+0000 7f9553fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f955414b1a0 0x7f955414cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52886/0 (socket says 172.21.15.6:52886) 2023-07-21T22:35:30.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.550+0000 7f9553fff640 1 -- 172.21.15.6:0/1705242946 learned_addr learned my addr 172.21.15.6:0/1705242946 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:30.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.554+0000 7f9558edc640 1 --2- 172.21.15.6:0/1705242946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9544005d50 0x7f955414ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:30.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.554+0000 7f95596dd640 1 --2- 172.21.15.6:0/1705242946 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f955414d040 0x7f955415e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:30.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.554+0000 7f9553fff640 1 -- 172.21.15.6:0/1705242946 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f955414d040 msgr2=0x7f955415e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:30.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.554+0000 7f9553fff640 1 --2- 172.21.15.6:0/1705242946 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f955414d040 0x7f955415e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:30.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.554+0000 7f9553fff640 1 -- 172.21.15.6:0/1705242946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9544005d50 msgr2=0x7f955414ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:30.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.554+0000 7f9553fff640 1 --2- 172.21.15.6:0/1705242946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9544005d50 0x7f955414ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:30.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.554+0000 7f9553fff640 1 -- 172.21.15.6:0/1705242946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9554070280 con 0x7f955414b1a0 2023-07-21T22:35:30.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.554+0000 7f9553fff640 1 --2- 172.21.15.6:0/1705242946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f955414b1a0 0x7f955414cb00 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f95400118b0 tx=0x7f95400119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:30.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.554+0000 7f95517fa640 1 -- 172.21.15.6:0/1705242946 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9540015870 con 0x7f955414b1a0 2023-07-21T22:35:30.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.554+0000 7f95517fa640 1 -- 172.21.15.6:0/1705242946 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95400159d0 con 0x7f955414b1a0 2023-07-21T22:35:30.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.554+0000 7f955b140640 1 -- 172.21.15.6:0/1705242946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9554070560 con 0x7f955414b1a0 2023-07-21T22:35:30.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.554+0000 7f95517fa640 1 -- 172.21.15.6:0/1705242946 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9540015d40 con 0x7f955414b1a0 2023-07-21T22:35:30.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.554+0000 7f955b140640 1 -- 172.21.15.6:0/1705242946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9554070c50 con 0x7f955414b1a0 2023-07-21T22:35:30.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.554+0000 7f955b140640 1 -- 172.21.15.6:0/1705242946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95540678d0 con 0x7f955414b1a0 2023-07-21T22:35:30.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.554+0000 7f95517fa640 1 -- 172.21.15.6:0/1705242946 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9540013400 con 0x7f955414b1a0 2023-07-21T22:35:30.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.558+0000 7f95517fa640 1 --2- 172.21.15.6:0/1705242946 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f95380663a0 0x7f9538068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:30.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.558+0000 7f95517fa640 1 -- 172.21.15.6:0/1705242946 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6485+0+0 (secure 0 0 0) 0x7f95400843e0 con 0x7f955414b1a0 2023-07-21T22:35:30.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.558+0000 7f9558edc640 1 --2- 172.21.15.6:0/1705242946 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f95380663a0 0x7f9538068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:30.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.558+0000 7f9558edc640 1 --2- 172.21.15.6:0/1705242946 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f95380663a0 0x7f9538068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f95480aa000 tx=0x7f9548001a00 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:30.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.562+0000 7f95517fa640 1 -- 172.21.15.6:0/1705242946 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95400515b0 con 0x7f955414b1a0 2023-07-21T22:35:30.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:30.714+0000 7f955b140640 1 -- 172.21.15.6:0/1705242946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f95540c88c0 con 0x7f955414b1a0 2023-07-21T22:35:31.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.370+0000 7f95517fa640 1 -- 172.21.15.6:0/1705242946 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v103) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9540054bd0 con 0x7f955414b1a0 2023-07-21T22:35:31.422 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-07-21T22:35:31.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.374+0000 7f955b140640 1 -- 172.21.15.6:0/1705242946 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f95380663a0 msgr2=0x7f9538068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:31.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.374+0000 7f955b140640 1 --2- 172.21.15.6:0/1705242946 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f95380663a0 0x7f9538068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f95480aa000 tx=0x7f9548001a00 comp rx=0 tx=0).stop 2023-07-21T22:35:31.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.374+0000 7f955b140640 1 -- 172.21.15.6:0/1705242946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f955414b1a0 msgr2=0x7f955414cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:31.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.374+0000 7f955b140640 1 --2- 172.21.15.6:0/1705242946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f955414b1a0 0x7f955414cb00 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f95400118b0 tx=0x7f95400119a0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.374+0000 7f955b140640 1 -- 172.21.15.6:0/1705242946 shutdown_connections 2023-07-21T22:35:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.374+0000 7f955b140640 1 --2- 172.21.15.6:0/1705242946 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f95380663a0 0x7f9538068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.374+0000 7f955b140640 1 --2- 172.21.15.6:0/1705242946 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f955414d040 0x7f955415e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.374+0000 7f955b140640 1 --2- 172.21.15.6:0/1705242946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f955414b1a0 0x7f955414cb00 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.374+0000 7f955b140640 1 --2- 172.21.15.6:0/1705242946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9544005d50 0x7f955414ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.374+0000 7f955b140640 1 -- 172.21.15.6:0/1705242946 >> 172.21.15.6:0/1705242946 conn(0x7f95540cde90 msgr2=0x7f9554069430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.374+0000 7f955b140640 1 -- 172.21.15.6:0/1705242946 shutdown_connections 2023-07-21T22:35:31.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.374+0000 7f955b140640 1 -- 172.21.15.6:0/1705242946 wait complete. 2023-07-21T22:35:31.449 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-21T22:35:31.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.546+0000 7f1352e6d640 1 Processor -- start 2023-07-21T22:35:31.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.546+0000 7f1352e6d640 1 -- start start 2023-07-21T22:35:31.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.546+0000 7f1352e6d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f134c0d06b0 0x7f134c0b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:31.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.546+0000 7f1352e6d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f134c0b1f70 0x7f134c0d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:31.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.546+0000 7f1352e6d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f134c0b2410 con 0x7f134c145430 2023-07-21T22:35:31.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.546+0000 7f1352e6d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f134c0b26f0 con 0x7f134c0b1f70 2023-07-21T22:35:31.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.546+0000 7f1352e6d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f134c0b29d0 con 0x7f134c0d06b0 2023-07-21T22:35:31.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.546+0000 7f134bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f134c145430 0x7f134c0b34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53914/0 (socket says 172.21.15.6:53914) 2023-07-21T22:35:31.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.546+0000 7f134bfff640 1 -- 172.21.15.6:0/3683906903 learned_addr learned my addr 172.21.15.6:0/3683906903 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:31.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.546+0000 7f135140a640 1 --2- 172.21.15.6:0/3683906903 >> v2:172.21.15.6:3300/0 conn(0x7f134c0b1f70 0x7f134c0d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:31.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.546+0000 7f1350c09640 1 --2- 172.21.15.6:0/3683906903 >> v2:172.21.15.161:3300/0 conn(0x7f134c0d06b0 0x7f134c0b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:31.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.546+0000 7f135140a640 1 -- 172.21.15.6:0/3683906903 >> v2:172.21.15.161:3300/0 conn(0x7f134c0d06b0 msgr2=0x7f134c0b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:31.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.546+0000 7f135140a640 1 --2- 172.21.15.6:0/3683906903 >> v2:172.21.15.161:3300/0 conn(0x7f134c0d06b0 0x7f134c0b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.546+0000 7f135140a640 1 -- 172.21.15.6:0/3683906903 >> v1:172.21.15.6:6789/0 conn(0x7f134c145430 legacy=0x7f134c0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:31.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.546+0000 7f135140a640 1 -- 172.21.15.6:0/3683906903 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134c0b2cb0 con 0x7f134c0b1f70 2023-07-21T22:35:31.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.546+0000 7f134b7fe640 1 -- 172.21.15.6:0/3683906903 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195593783 0 0) 0x7f134c0b2410 con 0x7f134c145430 2023-07-21T22:35:31.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.550+0000 7f135140a640 1 --2- 172.21.15.6:0/3683906903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134c0b1f70 0x7f134c0d22e0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f134c08b420 tx=0x7f134401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad923899ff4a38e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:31.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.550+0000 7f134b7fe640 1 -- 172.21.15.6:0/3683906903 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13440a58b0 con 0x7f134c0b1f70 2023-07-21T22:35:31.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.550+0000 7f134b7fe640 1 -- 172.21.15.6:0/3683906903 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13440a5a10 con 0x7f134c0b1f70 2023-07-21T22:35:31.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.550+0000 7f134b7fe640 1 -- 172.21.15.6:0/3683906903 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13440a5da0 con 0x7f134c0b1f70 2023-07-21T22:35:31.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.550+0000 7f1352e6d640 1 -- 172.21.15.6:0/3683906903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134c0b1f70 msgr2=0x7f134c0d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:31.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.550+0000 7f1352e6d640 1 --2- 172.21.15.6:0/3683906903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134c0b1f70 0x7f134c0d22e0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f134c08b420 tx=0x7f134401c8e0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.550+0000 7f1352e6d640 1 -- 172.21.15.6:0/3683906903 shutdown_connections 2023-07-21T22:35:31.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.550+0000 7f1352e6d640 1 --2- 172.21.15.6:0/3683906903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134c0b1f70 0x7f134c0d22e0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.550+0000 7f1352e6d640 1 --2- 172.21.15.6:0/3683906903 >> v2:172.21.15.161:3300/0 conn(0x7f134c0d06b0 0x7f134c0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.550+0000 7f1352e6d640 1 -- 172.21.15.6:0/3683906903 >> 172.21.15.6:0/3683906903 conn(0x7f134c0659d0 msgr2=0x7f134c09b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:31.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.550+0000 7f1352e6d640 1 -- 172.21.15.6:0/3683906903 shutdown_connections 2023-07-21T22:35:31.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.550+0000 7f1352e6d640 1 -- 172.21.15.6:0/3683906903 wait complete. 2023-07-21T22:35:31.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f1352e6d640 1 Processor -- start 2023-07-21T22:35:31.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f1352e6d640 1 -- start start 2023-07-21T22:35:31.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f1352e6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134c0b1f70 0x7f134c0c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:31.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f1352e6d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f134c0d06b0 0x7f134c157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:31.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f1352e6d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f134c1589c0 0x7f134c158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:31.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f1352e6d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134c1585a0 con 0x7f134c0b1f70 2023-07-21T22:35:31.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f1352e6d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134c1593a0 con 0x7f134c1589c0 2023-07-21T22:35:31.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f1352e6d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134c159780 con 0x7f134c0d06b0 2023-07-21T22:35:31.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f1350c09640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134c0b1f70 0x7f134c0c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:31.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f1350c09640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134c0b1f70 0x7f134c0c88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52906/0 (socket says 172.21.15.6:52906) 2023-07-21T22:35:31.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f1350c09640 1 -- 172.21.15.6:0/142084987 learned_addr learned my addr 172.21.15.6:0/142084987 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:31.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f134bfff640 1 --2- 172.21.15.6:0/142084987 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f134c0d06b0 0x7f134c157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:31.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f135140a640 1 --2- 172.21.15.6:0/142084987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f134c1589c0 0x7f134c158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:31.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f1350c09640 1 -- 172.21.15.6:0/142084987 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f134c0d06b0 msgr2=0x7f134c157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:31.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f1350c09640 1 --2- 172.21.15.6:0/142084987 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f134c0d06b0 0x7f134c157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f1350c09640 1 -- 172.21.15.6:0/142084987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f134c1589c0 msgr2=0x7f134c158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:31.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f1350c09640 1 --2- 172.21.15.6:0/142084987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f134c1589c0 0x7f134c158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f1350c09640 1 -- 172.21.15.6:0/142084987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1344009a70 con 0x7f134c0b1f70 2023-07-21T22:35:31.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f135140a640 1 --2- 172.21.15.6:0/142084987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f134c1589c0 0x7f134c158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:31.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f1350c09640 1 --2- 172.21.15.6:0/142084987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134c0b1f70 0x7f134c0c88f0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f134000e930 tx=0x7f134000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:31.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f13497fa640 1 -- 172.21.15.6:0/142084987 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340009690 con 0x7f134c0b1f70 2023-07-21T22:35:31.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f13497fa640 1 -- 172.21.15.6:0/142084987 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134000ca00 con 0x7f134c0b1f70 2023-07-21T22:35:31.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f13497fa640 1 -- 172.21.15.6:0/142084987 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134000cd70 con 0x7f134c0b1f70 2023-07-21T22:35:31.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f1352e6d640 1 -- 172.21.15.6:0/142084987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134c0c8e30 con 0x7f134c0b1f70 2023-07-21T22:35:31.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.554+0000 7f1352e6d640 1 -- 172.21.15.6:0/142084987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134c157ee0 con 0x7f134c0b1f70 2023-07-21T22:35:31.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.558+0000 7f1352e6d640 1 -- 172.21.15.6:0/142084987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134c072e70 con 0x7f134c0b1f70 2023-07-21T22:35:31.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.558+0000 7f13497fa640 1 -- 172.21.15.6:0/142084987 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1340013470 con 0x7f134c0b1f70 2023-07-21T22:35:31.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.558+0000 7f13497fa640 1 --2- 172.21.15.6:0/142084987 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f13300663a0 0x7f1330068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:31.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.558+0000 7f13497fa640 1 -- 172.21.15.6:0/142084987 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6071+0+0 (secure 0 0 0) 0x7f1340084120 con 0x7f134c0b1f70 2023-07-21T22:35:31.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.558+0000 7f134bfff640 1 --2- 172.21.15.6:0/142084987 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f13300663a0 0x7f1330068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:31.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.558+0000 7f134bfff640 1 --2- 172.21.15.6:0/142084987 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f13300663a0 0x7f1330068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f134c06a750 tx=0x7f1338007b60 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:31.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.562+0000 7f13497fa640 1 -- 172.21.15.6:0/142084987 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f13400514a0 con 0x7f134c0b1f70 2023-07-21T22:35:31.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.718+0000 7f1352e6d640 1 -- 172.21.15.6:0/142084987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f134c158810 con 0x7f134c0b1f70 2023-07-21T22:35:31.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.722+0000 7f13497fa640 1 -- 172.21.15.6:0/142084987 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v31) v1 ==== 115+0+0 (secure 0 0 0) 0x7f1340054ac0 con 0x7f134c0b1f70 2023-07-21T22:35:31.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.726+0000 7f1352e6d640 1 -- 172.21.15.6:0/142084987 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f13300663a0 msgr2=0x7f1330068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:31.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.726+0000 7f1352e6d640 1 --2- 172.21.15.6:0/142084987 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f13300663a0 0x7f1330068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f134c06a750 tx=0x7f1338007b60 comp rx=0 tx=0).stop 2023-07-21T22:35:31.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.726+0000 7f1352e6d640 1 -- 172.21.15.6:0/142084987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134c0b1f70 msgr2=0x7f134c0c88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:31.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.726+0000 7f1352e6d640 1 --2- 172.21.15.6:0/142084987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134c0b1f70 0x7f134c0c88f0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f134000e930 tx=0x7f134000edf0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.726+0000 7f1352e6d640 1 -- 172.21.15.6:0/142084987 shutdown_connections 2023-07-21T22:35:31.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.726+0000 7f1352e6d640 1 --2- 172.21.15.6:0/142084987 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f13300663a0 0x7f1330068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.726+0000 7f1352e6d640 1 --2- 172.21.15.6:0/142084987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f134c1589c0 0x7f134c158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.726+0000 7f1352e6d640 1 --2- 172.21.15.6:0/142084987 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f134c0d06b0 0x7f134c157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.726+0000 7f1352e6d640 1 --2- 172.21.15.6:0/142084987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f134c0b1f70 0x7f134c0c88f0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.726+0000 7f1352e6d640 1 -- 172.21.15.6:0/142084987 >> 172.21.15.6:0/142084987 conn(0x7f134c0659d0 msgr2=0x7f134c0cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:31.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.726+0000 7f1352e6d640 1 -- 172.21.15.6:0/142084987 shutdown_connections 2023-07-21T22:35:31.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.726+0000 7f1352e6d640 1 -- 172.21.15.6:0/142084987 wait complete. 2023-07-21T22:35:31.795 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-21T22:35:31.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.890+0000 7f9f0fb9d640 1 Processor -- start 2023-07-21T22:35:31.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.890+0000 7f9f0fb9d640 1 -- start start 2023-07-21T22:35:31.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.890+0000 7f9f0fb9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f08071030 0x7f9f080ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:31.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.890+0000 7f9f0fb9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9f0815e060 0x7f9f080c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:31.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.890+0000 7f9f0fb9d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f080cbe50 con 0x7f9f08159a70 2023-07-21T22:35:31.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.890+0000 7f9f0fb9d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f080cd660 con 0x7f9f08071030 2023-07-21T22:35:31.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.890+0000 7f9f0fb9d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f080cc0a0 con 0x7f9f0815e060 2023-07-21T22:35:31.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.890+0000 7f9f0d138640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f08071030 0x7f9f080ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:31.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.890+0000 7f9f0d138640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9f08071030 0x7f9f080ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52914/0 (socket says 172.21.15.6:52914) 2023-07-21T22:35:31.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.890+0000 7f9f0d138640 1 -- 172.21.15.6:0/959167179 learned_addr learned my addr 172.21.15.6:0/959167179 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:31.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.894+0000 7f9f0e13a640 1 --2- 172.21.15.6:0/959167179 >> v2:172.21.15.161:3300/0 conn(0x7f9f0815e060 0x7f9f080c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:31.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.894+0000 7f9f0d138640 1 -- 172.21.15.6:0/959167179 >> v2:172.21.15.161:3300/0 conn(0x7f9f0815e060 msgr2=0x7f9f080c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:31.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.894+0000 7f9f0d138640 1 --2- 172.21.15.6:0/959167179 >> v2:172.21.15.161:3300/0 conn(0x7f9f0815e060 0x7f9f080c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.894+0000 7f9f0d138640 1 -- 172.21.15.6:0/959167179 >> v1:172.21.15.161:6789/0 conn(0x7f9f08159a70 legacy=0x7f9f08070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:31.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.894+0000 7f9f0d138640 1 -- 172.21.15.6:0/959167179 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f080cc380 con 0x7f9f08071030 2023-07-21T22:35:31.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.894+0000 7f9f0d138640 1 --2- 172.21.15.6:0/959167179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f08071030 0x7f9f080ccff0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f9f080b4020 tx=0x7f9ef801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed66bd60329ea366 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:31.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.894+0000 7f9f0c937640 1 -- 172.21.15.6:0/959167179 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef80ac640 con 0x7f9f08071030 2023-07-21T22:35:31.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.894+0000 7f9f0c937640 1 -- 172.21.15.6:0/959167179 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef80ac7a0 con 0x7f9f08071030 2023-07-21T22:35:31.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.894+0000 7f9f0c937640 1 -- 172.21.15.6:0/959167179 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef80acb30 con 0x7f9f08071030 2023-07-21T22:35:31.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.894+0000 7f9f0fb9d640 1 -- 172.21.15.6:0/959167179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f08071030 msgr2=0x7f9f080ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:31.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.894+0000 7f9f0fb9d640 1 --2- 172.21.15.6:0/959167179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f08071030 0x7f9f080ccff0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f9f080b4020 tx=0x7f9ef801c370 comp rx=0 tx=0).stop 2023-07-21T22:35:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0fb9d640 1 -- 172.21.15.6:0/959167179 shutdown_connections 2023-07-21T22:35:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0fb9d640 1 --2- 172.21.15.6:0/959167179 >> v2:172.21.15.161:3300/0 conn(0x7f9f0815e060 0x7f9f080c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0fb9d640 1 --2- 172.21.15.6:0/959167179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f08071030 0x7f9f080ccff0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0fb9d640 1 -- 172.21.15.6:0/959167179 >> 172.21.15.6:0/959167179 conn(0x7f9f080afac0 msgr2=0x7f9f080afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0fb9d640 1 -- 172.21.15.6:0/959167179 shutdown_connections 2023-07-21T22:35:31.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0fb9d640 1 -- 172.21.15.6:0/959167179 wait complete. 2023-07-21T22:35:31.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0fb9d640 1 Processor -- start 2023-07-21T22:35:31.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0fb9d640 1 -- start start 2023-07-21T22:35:31.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0fb9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f08071030 0x7f9f08151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:31.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0fb9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f08159a70 0x7f9f080b3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:31.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0fb9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f0815e060 0x7f9f0806c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:31.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0fb9d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f08151d70 con 0x7f9f0815e060 2023-07-21T22:35:31.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0fb9d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f080b1e60 con 0x7f9f08159a70 2023-07-21T22:35:31.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0fb9d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f080b2140 con 0x7f9f08071030 2023-07-21T22:35:31.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0e13a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f0815e060 0x7f9f0806c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:31.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0e13a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f0815e060 0x7f9f0806c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52930/0 (socket says 172.21.15.6:52930) 2023-07-21T22:35:31.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0e13a640 1 -- 172.21.15.6:0/4280184611 learned_addr learned my addr 172.21.15.6:0/4280184611 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:31.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0d138640 1 --2- 172.21.15.6:0/4280184611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f08159a70 0x7f9f080b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:31.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0d939640 1 --2- 172.21.15.6:0/4280184611 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f08071030 0x7f9f08151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:31.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0e13a640 1 -- 172.21.15.6:0/4280184611 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f08071030 msgr2=0x7f9f08151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:31.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0e13a640 1 --2- 172.21.15.6:0/4280184611 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f08071030 0x7f9f08151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0e13a640 1 -- 172.21.15.6:0/4280184611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f08159a70 msgr2=0x7f9f080b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:31.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0e13a640 1 --2- 172.21.15.6:0/4280184611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f08159a70 0x7f9f080b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:31.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0e13a640 1 -- 172.21.15.6:0/4280184611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef80094d0 con 0x7f9f0815e060 2023-07-21T22:35:31.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0d939640 1 --2- 172.21.15.6:0/4280184611 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f08071030 0x7f9f08151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:31.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.898+0000 7f9f0e13a640 1 --2- 172.21.15.6:0/4280184611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f0815e060 0x7f9f0806c980 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f9f00007e40 tx=0x7f9f0000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:31.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.902+0000 7f9efe7fc640 1 -- 172.21.15.6:0/4280184611 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f00014620 con 0x7f9f0815e060 2023-07-21T22:35:31.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.902+0000 7f9efe7fc640 1 -- 172.21.15.6:0/4280184611 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0000ee90 con 0x7f9f0815e060 2023-07-21T22:35:31.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.902+0000 7f9efe7fc640 1 -- 172.21.15.6:0/4280184611 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f000149e0 con 0x7f9f0815e060 2023-07-21T22:35:31.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.902+0000 7f9f0fb9d640 1 -- 172.21.15.6:0/4280184611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f080b2420 con 0x7f9f0815e060 2023-07-21T22:35:31.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.902+0000 7f9f0fb9d640 1 -- 172.21.15.6:0/4280184611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f081f3ff0 con 0x7f9f0815e060 2023-07-21T22:35:31.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.902+0000 7f9f0fb9d640 1 -- 172.21.15.6:0/4280184611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f080b2610 con 0x7f9f0815e060 2023-07-21T22:35:31.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.902+0000 7f9efe7fc640 1 -- 172.21.15.6:0/4280184611 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9f00014b40 con 0x7f9f0815e060 2023-07-21T22:35:31.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.902+0000 7f9efe7fc640 1 --2- 172.21.15.6:0/4280184611 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f9eec0663a0 0x7f9eec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:31.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.902+0000 7f9efe7fc640 1 -- 172.21.15.6:0/4280184611 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6071+0+0 (secure 0 0 0) 0x7f9f000847b0 con 0x7f9f0815e060 2023-07-21T22:35:31.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.906+0000 7f9f0d939640 1 --2- 172.21.15.6:0/4280184611 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f9eec0663a0 0x7f9eec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:31.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.906+0000 7f9f0d939640 1 --2- 172.21.15.6:0/4280184611 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f9eec0663a0 0x7f9eec068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9f080cb330 tx=0x7f9f04009040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:31.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:31.906+0000 7f9efe7fc640 1 -- 172.21.15.6:0/4280184611 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9f00051b00 con 0x7f9f0815e060 2023-07-21T22:35:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.062+0000 7f9f0fb9d640 1 -- 172.21.15.6:0/4280184611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f9f080678d0 con 0x7f9f0815e060 2023-07-21T22:35:32.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.066+0000 7f9efe7fc640 1 -- 172.21.15.6:0/4280184611 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v32) v1 ==== 120+0+0 (secure 0 0 0) 0x7f9f00055120 con 0x7f9f0815e060 2023-07-21T22:35:32.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.066+0000 7f9f0fb9d640 1 -- 172.21.15.6:0/4280184611 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f9eec0663a0 msgr2=0x7f9eec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:32.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.066+0000 7f9f0fb9d640 1 --2- 172.21.15.6:0/4280184611 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f9eec0663a0 0x7f9eec068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9f080cb330 tx=0x7f9f04009040 comp rx=0 tx=0).stop 2023-07-21T22:35:32.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.066+0000 7f9f0fb9d640 1 -- 172.21.15.6:0/4280184611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f0815e060 msgr2=0x7f9f0806c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:32.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.066+0000 7f9f0fb9d640 1 --2- 172.21.15.6:0/4280184611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f0815e060 0x7f9f0806c980 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f9f00007e40 tx=0x7f9f0000e4b0 comp rx=0 tx=0).stop 2023-07-21T22:35:32.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.066+0000 7f9f0fb9d640 1 -- 172.21.15.6:0/4280184611 shutdown_connections 2023-07-21T22:35:32.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.066+0000 7f9f0fb9d640 1 --2- 172.21.15.6:0/4280184611 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f9eec0663a0 0x7f9eec068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:32.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.066+0000 7f9f0fb9d640 1 --2- 172.21.15.6:0/4280184611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f0815e060 0x7f9f0806c980 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:32.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.066+0000 7f9f0fb9d640 1 --2- 172.21.15.6:0/4280184611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f08159a70 0x7f9f080b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:32.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.066+0000 7f9f0fb9d640 1 --2- 172.21.15.6:0/4280184611 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f08071030 0x7f9f08151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:32.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.066+0000 7f9f0fb9d640 1 -- 172.21.15.6:0/4280184611 >> 172.21.15.6:0/4280184611 conn(0x7f9f080afac0 msgr2=0x7f9f080c9430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:32.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.066+0000 7f9f0fb9d640 1 -- 172.21.15.6:0/4280184611 shutdown_connections 2023-07-21T22:35:32.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.066+0000 7f9f0fb9d640 1 -- 172.21.15.6:0/4280184611 wait complete. 2023-07-21T22:35:32.138 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-21T22:35:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.238+0000 7f73a4ed8640 1 Processor -- start 2023-07-21T22:35:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.238+0000 7f73a4ed8640 1 -- start start 2023-07-21T22:35:32.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.238+0000 7f73a4ed8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73a0145430 0x7f73a00b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:32.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.238+0000 7f73a4ed8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f73a00b39f0 0x7f73a00d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:32.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.238+0000 7f73a4ed8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a00b2140 con 0x7f73a00d06b0 2023-07-21T22:35:32.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.238+0000 7f73a4ed8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a00b2410 con 0x7f73a00b39f0 2023-07-21T22:35:32.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.238+0000 7f73a4ed8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a00b26f0 con 0x7f73a0145430 2023-07-21T22:35:32.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.238+0000 7f739ed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f73a00b39f0 0x7f73a00d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:32.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.238+0000 7f739e59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f73a00d06b0 0x7f73a00b1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53916/0 (socket says 172.21.15.6:53916) 2023-07-21T22:35:32.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.238+0000 7f739e59c640 1 -- 172.21.15.6:0/1851053158 learned_addr learned my addr 172.21.15.6:0/1851053158 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:32.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.238+0000 7f7397fff640 1 --2- 172.21.15.6:0/1851053158 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73a0145430 0x7f73a00b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:32.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.238+0000 7f739ed9d640 1 -- 172.21.15.6:0/1851053158 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73a0145430 msgr2=0x7f73a00b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:32.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.238+0000 7f739ed9d640 1 --2- 172.21.15.6:0/1851053158 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73a0145430 0x7f73a00b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:32.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.238+0000 7f739ed9d640 1 -- 172.21.15.6:0/1851053158 >> v1:172.21.15.6:6789/0 conn(0x7f73a00d06b0 legacy=0x7f73a00b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:32.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.238+0000 7f739ed9d640 1 -- 172.21.15.6:0/1851053158 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a00b29d0 con 0x7f73a00b39f0 2023-07-21T22:35:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.242+0000 7f739ed9d640 1 --2- 172.21.15.6:0/1851053158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a00b39f0 0x7f73a00d22e0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f7398009d90 tx=0x7f739801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9608bb9dd6c534a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:32.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.242+0000 7f739dd9b640 1 -- 172.21.15.6:0/1851053158 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73980a58f0 con 0x7f73a00b39f0 2023-07-21T22:35:32.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.242+0000 7f739dd9b640 1 -- 172.21.15.6:0/1851053158 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73980a5a50 con 0x7f73a00b39f0 2023-07-21T22:35:32.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.242+0000 7f739dd9b640 1 -- 172.21.15.6:0/1851053158 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73980a5de0 con 0x7f73a00b39f0 2023-07-21T22:35:32.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.242+0000 7f73a4ed8640 1 -- 172.21.15.6:0/1851053158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a00b39f0 msgr2=0x7f73a00d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:32.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.242+0000 7f73a4ed8640 1 --2- 172.21.15.6:0/1851053158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a00b39f0 0x7f73a00d22e0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f7398009d90 tx=0x7f739801c920 comp rx=0 tx=0).stop 2023-07-21T22:35:32.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.242+0000 7f73a4ed8640 1 -- 172.21.15.6:0/1851053158 shutdown_connections 2023-07-21T22:35:32.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.242+0000 7f73a4ed8640 1 --2- 172.21.15.6:0/1851053158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a00b39f0 0x7f73a00d22e0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:32.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.242+0000 7f73a4ed8640 1 --2- 172.21.15.6:0/1851053158 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73a0145430 0x7f73a00b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:32.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.242+0000 7f73a4ed8640 1 -- 172.21.15.6:0/1851053158 >> 172.21.15.6:0/1851053158 conn(0x7f73a00659d0 msgr2=0x7f73a009b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:32.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.242+0000 7f73a4ed8640 1 -- 172.21.15.6:0/1851053158 shutdown_connections 2023-07-21T22:35:32.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.242+0000 7f73a4ed8640 1 -- 172.21.15.6:0/1851053158 wait complete. 2023-07-21T22:35:32.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f73a4ed8640 1 Processor -- start 2023-07-21T22:35:32.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f73a4ed8640 1 -- start start 2023-07-21T22:35:32.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f73a4ed8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73a00b39f0 0x7f73a00c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f73a4ed8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73a00d06b0 0x7f73a00b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f73a4ed8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a00b7610 0x7f73a00b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f73a4ed8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a01564a0 con 0x7f73a00b7610 2023-07-21T22:35:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f73a4ed8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a0156780 con 0x7f73a00d06b0 2023-07-21T22:35:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f73a4ed8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a0156a60 con 0x7f73a00b39f0 2023-07-21T22:35:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f739ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a00b7610 0x7f73a00b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f739ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a00b7610 0x7f73a00b7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52954/0 (socket says 172.21.15.6:52954) 2023-07-21T22:35:32.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f739ed9d640 1 -- 172.21.15.6:0/3401416061 learned_addr learned my addr 172.21.15.6:0/3401416061 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:32.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f739e59c640 1 --2- 172.21.15.6:0/3401416061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73a00b39f0 0x7f73a00c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:32.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f7397fff640 1 --2- 172.21.15.6:0/3401416061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73a00d06b0 0x7f73a00b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:32.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f739ed9d640 1 -- 172.21.15.6:0/3401416061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73a00b39f0 msgr2=0x7f73a00c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:32.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f739ed9d640 1 --2- 172.21.15.6:0/3401416061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73a00b39f0 0x7f73a00c4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:32.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f739ed9d640 1 -- 172.21.15.6:0/3401416061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73a00d06b0 msgr2=0x7f73a00b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:32.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f739ed9d640 1 --2- 172.21.15.6:0/3401416061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73a00d06b0 0x7f73a00b5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:32.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f739ed9d640 1 -- 172.21.15.6:0/3401416061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7398009a70 con 0x7f73a00b7610 2023-07-21T22:35:32.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f7397fff640 1 --2- 172.21.15.6:0/3401416061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73a00d06b0 0x7f73a00b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:32.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f739ed9d640 1 --2- 172.21.15.6:0/3401416061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a00b7610 0x7f73a00b7a90 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f73980b0040 tx=0x7f73980196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:32.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f7396ffd640 1 -- 172.21.15.6:0/3401416061 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73980b9860 con 0x7f73a00b7610 2023-07-21T22:35:32.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f7396ffd640 1 -- 172.21.15.6:0/3401416061 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73980b99c0 con 0x7f73a00b7610 2023-07-21T22:35:32.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f7396ffd640 1 -- 172.21.15.6:0/3401416061 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73980b9d50 con 0x7f73a00b7610 2023-07-21T22:35:32.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.246+0000 7f73a4ed8640 1 -- 172.21.15.6:0/3401416061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a0156d40 con 0x7f73a00b7610 2023-07-21T22:35:32.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.250+0000 7f73a4ed8640 1 -- 172.21.15.6:0/3401416061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a00b7fd0 con 0x7f73a00b7610 2023-07-21T22:35:32.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.250+0000 7f73a4ed8640 1 -- 172.21.15.6:0/3401416061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a0072e70 con 0x7f73a00b7610 2023-07-21T22:35:32.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.250+0000 7f7396ffd640 1 -- 172.21.15.6:0/3401416061 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f73980ad440 con 0x7f73a00b7610 2023-07-21T22:35:32.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.250+0000 7f7396ffd640 1 --2- 172.21.15.6:0/3401416061 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f73800663a0 0x7f7380068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:32.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.250+0000 7f7396ffd640 1 -- 172.21.15.6:0/3401416061 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6071+0+0 (secure 0 0 0) 0x7f739811f1b0 con 0x7f73a00b7610 2023-07-21T22:35:32.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.250+0000 7f739e59c640 1 --2- 172.21.15.6:0/3401416061 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f73800663a0 0x7f7380068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:32.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.254+0000 7f739e59c640 1 --2- 172.21.15.6:0/3401416061 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f73800663a0 0x7f7380068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7390005890 tx=0x7f7390009040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:32.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.254+0000 7f7396ffd640 1 -- 172.21.15.6:0/3401416061 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f73980ec500 con 0x7f73a00b7610 2023-07-21T22:35:32.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.410+0000 7f73a4ed8640 1 -- 172.21.15.6:0/3401416061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f73a0157260 con 0x7f73a00b7610 2023-07-21T22:35:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.414+0000 7f7396ffd640 1 -- 172.21.15.6:0/3401416061 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f73a0157260 con 0x7f73a00b7610 2023-07-21T22:35:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.418+0000 7f73a4ed8640 1 -- 172.21.15.6:0/3401416061 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f73800663a0 msgr2=0x7f7380068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.418+0000 7f73a4ed8640 1 --2- 172.21.15.6:0/3401416061 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f73800663a0 0x7f7380068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7390005890 tx=0x7f7390009040 comp rx=0 tx=0).stop 2023-07-21T22:35:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.418+0000 7f73a4ed8640 1 -- 172.21.15.6:0/3401416061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a00b7610 msgr2=0x7f73a00b7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.418+0000 7f73a4ed8640 1 --2- 172.21.15.6:0/3401416061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a00b7610 0x7f73a00b7a90 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f73980b0040 tx=0x7f73980196c0 comp rx=0 tx=0).stop 2023-07-21T22:35:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.418+0000 7f73a4ed8640 1 -- 172.21.15.6:0/3401416061 shutdown_connections 2023-07-21T22:35:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.418+0000 7f73a4ed8640 1 --2- 172.21.15.6:0/3401416061 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f73800663a0 0x7f7380068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.418+0000 7f73a4ed8640 1 --2- 172.21.15.6:0/3401416061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a00b7610 0x7f73a00b7a90 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.418+0000 7f73a4ed8640 1 --2- 172.21.15.6:0/3401416061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f73a00d06b0 0x7f73a00b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.418+0000 7f73a4ed8640 1 --2- 172.21.15.6:0/3401416061 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f73a00b39f0 0x7f73a00c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.418+0000 7f73a4ed8640 1 -- 172.21.15.6:0/3401416061 >> 172.21.15.6:0/3401416061 conn(0x7f73a00659d0 msgr2=0x7f73a00b1700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.418+0000 7f73a4ed8640 1 -- 172.21.15.6:0/3401416061 shutdown_connections 2023-07-21T22:35:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.418+0000 7f73a4ed8640 1 -- 172.21.15.6:0/3401416061 wait complete. 2023-07-21T22:35:32.486 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-07-21T22:35:32.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.586+0000 7fa7d0a26640 1 Processor -- start 2023-07-21T22:35:32.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.586+0000 7fa7d0a26640 1 -- start start 2023-07-21T22:35:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.590+0000 7fa7d0a26640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7cc06c430 0x7fa7cc0b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.590+0000 7fa7d0a26640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa7cc06e160 0x7fa7cc069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:32.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.590+0000 7fa7d0a26640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7cc0b24f0 con 0x7fa7cc0ae1f0 2023-07-21T22:35:32.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.590+0000 7fa7d0a26640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7cc0b27d0 con 0x7fa7cc06e160 2023-07-21T22:35:32.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.590+0000 7fa7d0a26640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc0b2ab0 con 0x7fa7cc06c430 2023-07-21T22:35:32.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.590+0000 7fa7cad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa7cc06e160 0x7fa7cc069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:32.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.590+0000 7fa7ca59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa7cc0ae1f0 0x7fa7cc06bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53924/0 (socket says 172.21.15.6:53924) 2023-07-21T22:35:32.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.590+0000 7fa7ca59c640 1 -- 172.21.15.6:0/1401201652 learned_addr learned my addr 172.21.15.6:0/1401201652 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:32.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.590+0000 7fa7c9d9b640 1 --2- 172.21.15.6:0/1401201652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7cc06c430 0x7fa7cc0b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:32.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.590+0000 7fa7cad9d640 1 -- 172.21.15.6:0/1401201652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7cc06c430 msgr2=0x7fa7cc0b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:32.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.590+0000 7fa7cad9d640 1 --2- 172.21.15.6:0/1401201652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7cc06c430 0x7fa7cc0b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:32.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.590+0000 7fa7cad9d640 1 -- 172.21.15.6:0/1401201652 >> v1:172.21.15.6:6789/0 conn(0x7fa7cc0ae1f0 legacy=0x7fa7cc06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:32.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.590+0000 7fa7c959a640 1 -- 172.21.15.6:0/1401201652 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205145964 0 0) 0x7fa7cc0b24f0 con 0x7fa7cc0ae1f0 2023-07-21T22:35:32.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.590+0000 7fa7cad9d640 1 -- 172.21.15.6:0/1401201652 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7cc0b2d90 con 0x7fa7cc06e160 2023-07-21T22:35:32.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.590+0000 7fa7c9d9b640 1 --2- 172.21.15.6:0/1401201652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7cc06c430 0x7fa7cc0b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:32.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.594+0000 7fa7cad9d640 1 --2- 172.21.15.6:0/1401201652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc06e160 0x7fa7cc069430 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009d90 tx=0x7fa7c401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd560ac3c264380f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:32.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.594+0000 7fa7c959a640 1 -- 172.21.15.6:0/1401201652 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c40a5970 con 0x7fa7cc06e160 2023-07-21T22:35:32.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.594+0000 7fa7c959a640 1 -- 172.21.15.6:0/1401201652 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c40a5ad0 con 0x7fa7cc06e160 2023-07-21T22:35:32.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.594+0000 7fa7c959a640 1 -- 172.21.15.6:0/1401201652 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c40a5e60 con 0x7fa7cc06e160 2023-07-21T22:35:32.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.594+0000 7fa7d0a26640 1 -- 172.21.15.6:0/1401201652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc06e160 msgr2=0x7fa7cc069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:32.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.594+0000 7fa7d0a26640 1 --2- 172.21.15.6:0/1401201652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc06e160 0x7fa7cc069430 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4009d90 tx=0x7fa7c401c920 comp rx=0 tx=0).stop 2023-07-21T22:35:32.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.594+0000 7fa7d0a26640 1 -- 172.21.15.6:0/1401201652 shutdown_connections 2023-07-21T22:35:32.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.594+0000 7fa7d0a26640 1 --2- 172.21.15.6:0/1401201652 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc06e160 0x7fa7cc069430 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:32.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.594+0000 7fa7d0a26640 1 --2- 172.21.15.6:0/1401201652 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7cc06c430 0x7fa7cc0b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:32.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.594+0000 7fa7d0a26640 1 -- 172.21.15.6:0/1401201652 >> 172.21.15.6:0/1401201652 conn(0x7fa7cc0b1300 msgr2=0x7fa7cc0ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:32.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.594+0000 7fa7d0a26640 1 -- 172.21.15.6:0/1401201652 shutdown_connections 2023-07-21T22:35:32.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.594+0000 7fa7d0a26640 1 -- 172.21.15.6:0/1401201652 wait complete. 2023-07-21T22:35:32.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.594+0000 7fa7d0a26640 1 Processor -- start 2023-07-21T22:35:32.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.594+0000 7fa7d0a26640 1 -- start start 2023-07-21T22:35:32.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7d0a26640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc06c430 0x7fa7cc13fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:32.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7d0a26640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7cc06e160 0x7fa7cc13de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:32.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7d0a26640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7cc0ae1f0 0x7fa7cc165be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:32.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7d0a26640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc141370 con 0x7fa7cc06c430 2023-07-21T22:35:32.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7d0a26640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc1406f0 con 0x7fa7cc06e160 2023-07-21T22:35:32.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7d0a26640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc1409d0 con 0x7fa7cc0ae1f0 2023-07-21T22:35:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7ca59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc06c430 0x7fa7cc13fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7ca59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc06c430 0x7fa7cc13fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52966/0 (socket says 172.21.15.6:52966) 2023-07-21T22:35:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7ca59c640 1 -- 172.21.15.6:0/2498854078 learned_addr learned my addr 172.21.15.6:0/2498854078 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:32.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7cad9d640 1 --2- 172.21.15.6:0/2498854078 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7cc0ae1f0 0x7fa7cc165be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:32.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7c9d9b640 1 --2- 172.21.15.6:0/2498854078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7cc06e160 0x7fa7cc13de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:32.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7ca59c640 1 -- 172.21.15.6:0/2498854078 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7cc0ae1f0 msgr2=0x7fa7cc165be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:32.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7ca59c640 1 --2- 172.21.15.6:0/2498854078 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7cc0ae1f0 0x7fa7cc165be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7ca59c640 1 -- 172.21.15.6:0/2498854078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7cc06e160 msgr2=0x7fa7cc13de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7ca59c640 1 --2- 172.21.15.6:0/2498854078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7cc06e160 0x7fa7cc13de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7ca59c640 1 -- 172.21.15.6:0/2498854078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c4009a70 con 0x7fa7cc06c430 2023-07-21T22:35:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7cad9d640 1 --2- 172.21.15.6:0/2498854078 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7cc0ae1f0 0x7fa7cc165be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7c9d9b640 1 --2- 172.21.15.6:0/2498854078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7cc06e160 0x7fa7cc13de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7ca59c640 1 --2- 172.21.15.6:0/2498854078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc06c430 0x7fa7cc13fec0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00c480 tx=0x7fa7bc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7baffd640 1 -- 172.21.15.6:0/2498854078 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc0074e0 con 0x7fa7cc06c430 2023-07-21T22:35:32.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7baffd640 1 -- 172.21.15.6:0/2498854078 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7bc007660 con 0x7fa7cc06c430 2023-07-21T22:35:32.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7baffd640 1 -- 172.21.15.6:0/2498854078 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc004a30 con 0x7fa7cc06c430 2023-07-21T22:35:32.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7d0a26640 1 -- 172.21.15.6:0/2498854078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7cc0b3710 con 0x7fa7cc06c430 2023-07-21T22:35:32.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7d0a26640 1 -- 172.21.15.6:0/2498854078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7cc140f90 con 0x7fa7cc06c430 2023-07-21T22:35:32.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.598+0000 7fa7d0a26640 1 -- 172.21.15.6:0/2498854078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7cc1414b0 con 0x7fa7cc06c430 2023-07-21T22:35:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.602+0000 7fa7baffd640 1 -- 172.21.15.6:0/2498854078 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa7bc004b90 con 0x7fa7cc06c430 2023-07-21T22:35:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.602+0000 7fa7baffd640 1 --2- 172.21.15.6:0/2498854078 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fa7ac0663a0 0x7fa7ac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.602+0000 7fa7baffd640 1 -- 172.21.15.6:0/2498854078 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6071+0+0 (secure 0 0 0) 0x7fa7bc0830a0 con 0x7fa7cc06c430 2023-07-21T22:35:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.602+0000 7fa7c9d9b640 1 --2- 172.21.15.6:0/2498854078 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fa7ac0663a0 0x7fa7ac068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.602+0000 7fa7c9d9b640 1 --2- 172.21.15.6:0/2498854078 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fa7ac0663a0 0x7fa7ac068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc15d680 tx=0x7fa7c0008040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:32.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.606+0000 7fa7baffd640 1 -- 172.21.15.6:0/2498854078 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa7bc053e80 con 0x7fa7cc06c430 2023-07-21T22:35:32.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:32.814+0000 7fa7d0a26640 1 -- 172.21.15.6:0/2498854078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7fa7cc0678d0 con 0x7fa7cc06c430 2023-07-21T22:35:33.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.374+0000 7fa7baffd640 1 -- 172.21.15.6:0/2498854078 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v638) v1 ==== 166+0+0 (secure 0 0 0) 0x7fa7bc0180e0 con 0x7fa7cc06c430 2023-07-21T22:35:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.378+0000 7fa7d0a26640 1 -- 172.21.15.6:0/2498854078 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fa7ac0663a0 msgr2=0x7fa7ac068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.378+0000 7fa7d0a26640 1 --2- 172.21.15.6:0/2498854078 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fa7ac0663a0 0x7fa7ac068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc15d680 tx=0x7fa7c0008040 comp rx=0 tx=0).stop 2023-07-21T22:35:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.378+0000 7fa7d0a26640 1 -- 172.21.15.6:0/2498854078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc06c430 msgr2=0x7fa7cc13fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.378+0000 7fa7d0a26640 1 --2- 172.21.15.6:0/2498854078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc06c430 0x7fa7cc13fec0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00c480 tx=0x7fa7bc00c940 comp rx=0 tx=0).stop 2023-07-21T22:35:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.378+0000 7fa7d0a26640 1 -- 172.21.15.6:0/2498854078 shutdown_connections 2023-07-21T22:35:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.378+0000 7fa7d0a26640 1 --2- 172.21.15.6:0/2498854078 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fa7ac0663a0 0x7fa7ac068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.378+0000 7fa7d0a26640 1 --2- 172.21.15.6:0/2498854078 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7cc0ae1f0 0x7fa7cc165be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.378+0000 7fa7d0a26640 1 --2- 172.21.15.6:0/2498854078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7cc06e160 0x7fa7cc13de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.378+0000 7fa7d0a26640 1 --2- 172.21.15.6:0/2498854078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7cc06c430 0x7fa7cc13fec0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.378+0000 7fa7d0a26640 1 -- 172.21.15.6:0/2498854078 >> 172.21.15.6:0/2498854078 conn(0x7fa7cc0b1300 msgr2=0x7fa7cc06bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.378+0000 7fa7d0a26640 1 -- 172.21.15.6:0/2498854078 shutdown_connections 2023-07-21T22:35:33.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.378+0000 7fa7d0a26640 1 -- 172.21.15.6:0/2498854078 wait complete. 2023-07-21T22:35:33.450 INFO:tasks.cephfs_test_runner:Test listing snap schedules on a non-existing filesystem path failure ... ok 2023-07-21T22:35:33.451 INFO:tasks.cephfs_test_runner:Starting test: test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-21T22:35:33.451 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-07-21T22:35:33.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.546+0000 7f9f3679f640 1 Processor -- start 2023-07-21T22:35:33.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.546+0000 7f9f3679f640 1 -- start start 2023-07-21T22:35:33.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.550+0000 7f9f3679f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f3006c430 0x7f9f300b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.550+0000 7f9f3679f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9f3006e160 0x7f9f30069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.550+0000 7f9f3679f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f300b24f0 con 0x7f9f300ae1f0 2023-07-21T22:35:33.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.550+0000 7f9f3679f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f300b27d0 con 0x7f9f3006e160 2023-07-21T22:35:33.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.550+0000 7f9f3679f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300b2ab0 con 0x7f9f3006c430 2023-07-21T22:35:33.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.550+0000 7f9f2f7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f3006c430 0x7f9f300b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.550+0000 7f9f34d3c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9f3006e160 0x7f9f30069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.550+0000 7f9f2f7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f3006c430 0x7f9f300b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:56564/0 (socket says 172.21.15.6:56564) 2023-07-21T22:35:33.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.550+0000 7f9f2f7fe640 1 -- 172.21.15.6:0/685314082 learned_addr learned my addr 172.21.15.6:0/685314082 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:33.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.550+0000 7f9f34d3c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9f3006e160 0x7f9f30069430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:37352/0 (socket says 172.21.15.6:37352) 2023-07-21T22:35:33.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.550+0000 7f9f2ffff640 1 --1- 172.21.15.6:0/685314082 >> v1:172.21.15.161:6789/0 conn(0x7f9f300ae1f0 0x7f9f3006bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:55876/0 (socket says 172.21.15.6:55876) 2023-07-21T22:35:33.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.550+0000 7f9f2f7fe640 1 -- 172.21.15.6:0/685314082 >> v2:172.21.15.161:3300/0 conn(0x7f9f3006e160 msgr2=0x7f9f30069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:33.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.550+0000 7f9f2f7fe640 1 --2- 172.21.15.6:0/685314082 >> v2:172.21.15.161:3300/0 conn(0x7f9f3006e160 0x7f9f30069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.550+0000 7f9f2f7fe640 1 -- 172.21.15.6:0/685314082 >> v1:172.21.15.161:6789/0 conn(0x7f9f300ae1f0 legacy=0x7f9f3006bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:33.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.550+0000 7f9f2f7fe640 1 -- 172.21.15.6:0/685314082 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f300b2d90 con 0x7f9f3006c430 2023-07-21T22:35:33.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.550+0000 7f9f34d3c640 1 --2- 172.21.15.6:0/685314082 >> v2:172.21.15.161:3300/0 conn(0x7f9f3006e160 0x7f9f30069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:33.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.554+0000 7f9f2f7fe640 1 --2- 172.21.15.6:0/685314082 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f3006c430 0x7f9f300b1e60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009870 tx=0x7f9f2401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=460fa3f2c16bca0f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.554+0000 7f9f2effd640 1 -- 172.21.15.6:0/685314082 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240a95f0 con 0x7f9f3006c430 2023-07-21T22:35:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.554+0000 7f9f2effd640 1 -- 172.21.15.6:0/685314082 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f240a9750 con 0x7f9f3006c430 2023-07-21T22:35:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.554+0000 7f9f2effd640 1 -- 172.21.15.6:0/685314082 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240a9ae0 con 0x7f9f3006c430 2023-07-21T22:35:33.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.554+0000 7f9f3679f640 1 -- 172.21.15.6:0/685314082 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f3006c430 msgr2=0x7f9f300b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:33.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.554+0000 7f9f3679f640 1 --2- 172.21.15.6:0/685314082 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f3006c430 0x7f9f300b1e60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009870 tx=0x7f9f2401c510 comp rx=0 tx=0).stop 2023-07-21T22:35:33.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.554+0000 7f9f3679f640 1 -- 172.21.15.6:0/685314082 shutdown_connections 2023-07-21T22:35:33.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.554+0000 7f9f3679f640 1 --2- 172.21.15.6:0/685314082 >> v2:172.21.15.161:3300/0 conn(0x7f9f3006e160 0x7f9f30069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.554+0000 7f9f3679f640 1 --2- 172.21.15.6:0/685314082 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f3006c430 0x7f9f300b1e60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.554+0000 7f9f3679f640 1 -- 172.21.15.6:0/685314082 >> 172.21.15.6:0/685314082 conn(0x7f9f300b1300 msgr2=0x7f9f300ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.554+0000 7f9f3679f640 1 -- 172.21.15.6:0/685314082 shutdown_connections 2023-07-21T22:35:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.554+0000 7f9f3679f640 1 -- 172.21.15.6:0/685314082 wait complete. 2023-07-21T22:35:33.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.554+0000 7f9f3679f640 1 Processor -- start 2023-07-21T22:35:33.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.554+0000 7f9f3679f640 1 -- start start 2023-07-21T22:35:33.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f3679f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f3006c430 0x7f9f300cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f3679f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3006e160 0x7f9f3015a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f3679f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f300ae1f0 0x7f9f300ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f3679f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300cb8d0 con 0x7f9f3006e160 2023-07-21T22:35:33.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f3679f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300cbae0 con 0x7f9f3006c430 2023-07-21T22:35:33.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f3679f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300cbdc0 con 0x7f9f300ae1f0 2023-07-21T22:35:33.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f2f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3006e160 0x7f9f3015a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f2ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f3006c430 0x7f9f300cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f2f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3006e160 0x7f9f3015a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52968/0 (socket says 172.21.15.6:52968) 2023-07-21T22:35:33.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f2f7fe640 1 -- 172.21.15.6:0/479302840 learned_addr learned my addr 172.21.15.6:0/479302840 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:33.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f2ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f3006c430 0x7f9f300cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:37364/0 (socket says 172.21.15.6:37364) 2023-07-21T22:35:33.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f34d3c640 1 --2- 172.21.15.6:0/479302840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f300ae1f0 0x7f9f300ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f2f7fe640 1 -- 172.21.15.6:0/479302840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f300ae1f0 msgr2=0x7f9f300ccb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:33.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f2f7fe640 1 --2- 172.21.15.6:0/479302840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f300ae1f0 0x7f9f300ccb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f2f7fe640 1 -- 172.21.15.6:0/479302840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f3006c430 msgr2=0x7f9f300cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:33.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f2f7fe640 1 --2- 172.21.15.6:0/479302840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f3006c430 0x7f9f300cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f2f7fe640 1 -- 172.21.15.6:0/479302840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f28009a70 con 0x7f9f3006e160 2023-07-21T22:35:33.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f2f7fe640 1 --2- 172.21.15.6:0/479302840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3006e160 0x7f9f3015a480 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f9f2401abc0 tx=0x7f9f240192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:33.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f2cff9640 1 -- 172.21.15.6:0/479302840 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240b9620 con 0x7f9f3006e160 2023-07-21T22:35:33.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f2cff9640 1 -- 172.21.15.6:0/479302840 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f240b9780 con 0x7f9f3006e160 2023-07-21T22:35:33.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f3679f640 1 -- 172.21.15.6:0/479302840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f240094d0 con 0x7f9f3006e160 2023-07-21T22:35:33.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f2cff9640 1 -- 172.21.15.6:0/479302840 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240b9b30 con 0x7f9f3006e160 2023-07-21T22:35:33.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f3679f640 1 -- 172.21.15.6:0/479302840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f300b3710 con 0x7f9f3006e160 2023-07-21T22:35:33.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f3679f640 1 -- 172.21.15.6:0/479302840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f300678d0 con 0x7f9f3006e160 2023-07-21T22:35:33.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.558+0000 7f9f2cff9640 1 -- 172.21.15.6:0/479302840 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9f240b13f0 con 0x7f9f3006e160 2023-07-21T22:35:33.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.562+0000 7f9f2cff9640 1 --2- 172.21.15.6:0/479302840 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f9f1c0663a0 0x7f9f1c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.562+0000 7f9f2cff9640 1 -- 172.21.15.6:0/479302840 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6071+0+0 (secure 0 0 0) 0x7f9f2411e070 con 0x7f9f3006e160 2023-07-21T22:35:33.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.562+0000 7f9f2ffff640 1 --2- 172.21.15.6:0/479302840 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f9f1c0663a0 0x7f9f1c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.562+0000 7f9f2ffff640 1 --2- 172.21.15.6:0/479302840 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f9f1c0663a0 0x7f9f1c068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9f20000f70 tx=0x7f9f20007e50 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:33.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.566+0000 7f9f2cff9640 1 -- 172.21.15.6:0/479302840 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9f240eb3e0 con 0x7f9f3006e160 2023-07-21T22:35:33.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:33.774+0000 7f9f3679f640 1 -- 172.21.15.6:0/479302840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f9f30066810 con 0x7f9f3006e160 2023-07-21T22:35:34.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.378+0000 7f9f2cff9640 1 -- 172.21.15.6:0/479302840 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v639) v1 ==== 186+0+0 (secure 0 0 0) 0x7f9f240eea00 con 0x7f9f3006e160 2023-07-21T22:35:34.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.378+0000 7f9f3679f640 1 -- 172.21.15.6:0/479302840 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f9f1c0663a0 msgr2=0x7f9f1c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:34.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.378+0000 7f9f3679f640 1 --2- 172.21.15.6:0/479302840 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f9f1c0663a0 0x7f9f1c068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9f20000f70 tx=0x7f9f20007e50 comp rx=0 tx=0).stop 2023-07-21T22:35:34.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.378+0000 7f9f3679f640 1 -- 172.21.15.6:0/479302840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3006e160 msgr2=0x7f9f3015a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:34.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.378+0000 7f9f3679f640 1 --2- 172.21.15.6:0/479302840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3006e160 0x7f9f3015a480 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f9f2401abc0 tx=0x7f9f240192b0 comp rx=0 tx=0).stop 2023-07-21T22:35:34.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.378+0000 7f9f3679f640 1 -- 172.21.15.6:0/479302840 shutdown_connections 2023-07-21T22:35:34.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.378+0000 7f9f3679f640 1 --2- 172.21.15.6:0/479302840 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f9f1c0663a0 0x7f9f1c068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:34.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.378+0000 7f9f3679f640 1 --2- 172.21.15.6:0/479302840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f300ae1f0 0x7f9f300ccb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:34.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.378+0000 7f9f3679f640 1 --2- 172.21.15.6:0/479302840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f3006e160 0x7f9f3015a480 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:34.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.378+0000 7f9f3679f640 1 --2- 172.21.15.6:0/479302840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f3006c430 0x7f9f300cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:34.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.378+0000 7f9f3679f640 1 -- 172.21.15.6:0/479302840 >> 172.21.15.6:0/479302840 conn(0x7f9f300b1300 msgr2=0x7f9f3006bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:34.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.378+0000 7f9f3679f640 1 -- 172.21.15.6:0/479302840 shutdown_connections 2023-07-21T22:35:34.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.378+0000 7f9f3679f640 1 -- 172.21.15.6:0/479302840 wait complete. 2023-07-21T22:35:34.454 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-21T22:35:34.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.554+0000 7f97ac27b640 1 Processor -- start 2023-07-21T22:35:34.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.554+0000 7f97ac27b640 1 -- start start 2023-07-21T22:35:34.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.554+0000 7f97ac27b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97a40aeb40 0x7f97a415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:34.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.554+0000 7f97ac27b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f97a40aef10 0x7f97a4158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:34.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.558+0000 7f97ac27b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a41532b0 con 0x7f97a4159270 2023-07-21T22:35:34.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.558+0000 7f97ac27b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a40ca6f0 con 0x7f97a40aeb40 2023-07-21T22:35:34.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.558+0000 7f97ac27b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a41599d0 con 0x7f97a40aef10 2023-07-21T22:35:34.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.558+0000 7f97aa017640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97a40aeb40 0x7f97a415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:34.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.558+0000 7f97aa017640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97a40aeb40 0x7f97a415cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52984/0 (socket says 172.21.15.6:52984) 2023-07-21T22:35:34.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.558+0000 7f97aa017640 1 -- 172.21.15.6:0/780373267 learned_addr learned my addr 172.21.15.6:0/780373267 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:34.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.558+0000 7f97a9816640 1 --2- 172.21.15.6:0/780373267 >> v2:172.21.15.161:3300/0 conn(0x7f97a40aef10 0x7f97a4158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:34.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.558+0000 7f97aa017640 1 -- 172.21.15.6:0/780373267 >> v2:172.21.15.161:3300/0 conn(0x7f97a40aef10 msgr2=0x7f97a4158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:34.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.558+0000 7f97aa017640 1 --2- 172.21.15.6:0/780373267 >> v2:172.21.15.161:3300/0 conn(0x7f97a40aef10 0x7f97a4158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:34.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.558+0000 7f97aa017640 1 -- 172.21.15.6:0/780373267 >> v1:172.21.15.161:6789/0 conn(0x7f97a4159270 legacy=0x7f97a40c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:34.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.558+0000 7f97aa017640 1 -- 172.21.15.6:0/780373267 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a4159cb0 con 0x7f97a40aeb40 2023-07-21T22:35:34.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.558+0000 7f97aa017640 1 --2- 172.21.15.6:0/780373267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a40aeb40 0x7f97a415cef0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f97a40cee90 tx=0x7f97a001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68e45db72e23bfc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:34.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.558+0000 7f97a9015640 1 -- 172.21.15.6:0/780373267 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a00ab600 con 0x7f97a40aeb40 2023-07-21T22:35:34.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.558+0000 7f97a9015640 1 -- 172.21.15.6:0/780373267 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a00ab760 con 0x7f97a40aeb40 2023-07-21T22:35:34.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.558+0000 7f97a9015640 1 -- 172.21.15.6:0/780373267 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a00abaf0 con 0x7f97a40aeb40 2023-07-21T22:35:34.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.562+0000 7f97ac27b640 1 -- 172.21.15.6:0/780373267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a40aeb40 msgr2=0x7f97a415cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:34.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.562+0000 7f97ac27b640 1 --2- 172.21.15.6:0/780373267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a40aeb40 0x7f97a415cef0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f97a40cee90 tx=0x7f97a001c400 comp rx=0 tx=0).stop 2023-07-21T22:35:34.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.562+0000 7f97ac27b640 1 -- 172.21.15.6:0/780373267 shutdown_connections 2023-07-21T22:35:34.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.562+0000 7f97ac27b640 1 --2- 172.21.15.6:0/780373267 >> v2:172.21.15.161:3300/0 conn(0x7f97a40aef10 0x7f97a4158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:34.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.562+0000 7f97ac27b640 1 --2- 172.21.15.6:0/780373267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a40aeb40 0x7f97a415cef0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:34.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.562+0000 7f97ac27b640 1 -- 172.21.15.6:0/780373267 >> 172.21.15.6:0/780373267 conn(0x7f97a40cde90 msgr2=0x7f97a40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:34.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.562+0000 7f97ac27b640 1 -- 172.21.15.6:0/780373267 shutdown_connections 2023-07-21T22:35:34.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.562+0000 7f97ac27b640 1 -- 172.21.15.6:0/780373267 wait complete. 2023-07-21T22:35:34.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.562+0000 7f97ac27b640 1 Processor -- start 2023-07-21T22:35:34.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.562+0000 7f97ac27b640 1 -- start start 2023-07-21T22:35:34.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.562+0000 7f97ac27b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a40aeb40 0x7f97a406fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:34.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.562+0000 7f97ac27b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97a40aef10 0x7f97a414fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:34.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.562+0000 7f97ac27b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97a4159270 0x7f97a41579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:34.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.562+0000 7f97ac27b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a4151e40 con 0x7f97a40aeb40 2023-07-21T22:35:34.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.562+0000 7f97ac27b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a4151650 con 0x7f97a4159270 2023-07-21T22:35:34.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.562+0000 7f97ac27b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a4070da0 con 0x7f97a40aef10 2023-07-21T22:35:34.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.562+0000 7f97aa017640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a40aeb40 0x7f97a406fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:34.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.562+0000 7f97aa017640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a40aeb40 0x7f97a406fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52992/0 (socket says 172.21.15.6:52992) 2023-07-21T22:35:34.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.562+0000 7f97aa017640 1 -- 172.21.15.6:0/2765685076 learned_addr learned my addr 172.21.15.6:0/2765685076 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:34.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.566+0000 7f97aa017640 1 -- 172.21.15.6:0/2765685076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97a40aef10 msgr2=0x7f97a414fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:34.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.566+0000 7f97aa017640 1 --2- 172.21.15.6:0/2765685076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97a40aef10 0x7f97a414fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:34.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.566+0000 7f97aa017640 1 -- 172.21.15.6:0/2765685076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97a4159270 msgr2=0x7f97a41579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:34.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.566+0000 7f97aa017640 1 --2- 172.21.15.6:0/2765685076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97a4159270 0x7f97a41579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:34.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.566+0000 7f97aa017640 1 -- 172.21.15.6:0/2765685076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a00094d0 con 0x7f97a40aeb40 2023-07-21T22:35:34.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.566+0000 7f97aa017640 1 --2- 172.21.15.6:0/2765685076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a40aeb40 0x7f97a406fa20 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f97a00ad040 tx=0x7f97a001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:34.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.566+0000 7f979affd640 1 -- 172.21.15.6:0/2765685076 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a00b4800 con 0x7f97a40aeb40 2023-07-21T22:35:34.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.566+0000 7f979affd640 1 -- 172.21.15.6:0/2765685076 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a00b4960 con 0x7f97a40aeb40 2023-07-21T22:35:34.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.566+0000 7f97ac27b640 1 -- 172.21.15.6:0/2765685076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a4070a70 con 0x7f97a40aeb40 2023-07-21T22:35:34.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.566+0000 7f979affd640 1 -- 172.21.15.6:0/2765685076 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a00b4d10 con 0x7f97a40aeb40 2023-07-21T22:35:34.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.566+0000 7f97ac27b640 1 -- 172.21.15.6:0/2765685076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a4151880 con 0x7f97a40aeb40 2023-07-21T22:35:34.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.566+0000 7f97ac27b640 1 -- 172.21.15.6:0/2765685076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a40708d0 con 0x7f97a40aeb40 2023-07-21T22:35:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.566+0000 7f979affd640 1 -- 172.21.15.6:0/2765685076 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f97a00c7440 con 0x7f97a40aeb40 2023-07-21T22:35:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.566+0000 7f979affd640 1 --2- 172.21.15.6:0/2765685076 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f97880663a0 0x7f9788068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.566+0000 7f979affd640 1 -- 172.21.15.6:0/2765685076 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6071+0+0 (secure 0 0 0) 0x7f97a011ea90 con 0x7f97a40aeb40 2023-07-21T22:35:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.570+0000 7f97a9816640 1 --2- 172.21.15.6:0/2765685076 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f97880663a0 0x7f9788068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:34.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.570+0000 7f97a9816640 1 --2- 172.21.15.6:0/2765685076 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f97880663a0 0x7f9788068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f97a4163660 tx=0x7f9794008040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:34.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.570+0000 7f979affd640 1 -- 172.21.15.6:0/2765685076 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f97a40708d0 con 0x7f97a40aeb40 2023-07-21T22:35:34.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.726+0000 7f97ac27b640 1 -- 172.21.15.6:0/2765685076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f97a40708d0 con 0x7f97a40aeb40 2023-07-21T22:35:34.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.734+0000 7f979affd640 1 -- 172.21.15.6:0/2765685076 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f97a40708d0 con 0x7f97a40aeb40 2023-07-21T22:35:34.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.734+0000 7f97ac27b640 1 -- 172.21.15.6:0/2765685076 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f97880663a0 msgr2=0x7f9788068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:34.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.734+0000 7f97ac27b640 1 --2- 172.21.15.6:0/2765685076 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f97880663a0 0x7f9788068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f97a4163660 tx=0x7f9794008040 comp rx=0 tx=0).stop 2023-07-21T22:35:34.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.734+0000 7f97ac27b640 1 -- 172.21.15.6:0/2765685076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a40aeb40 msgr2=0x7f97a406fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:34.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.734+0000 7f97ac27b640 1 --2- 172.21.15.6:0/2765685076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a40aeb40 0x7f97a406fa20 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f97a00ad040 tx=0x7f97a001ac40 comp rx=0 tx=0).stop 2023-07-21T22:35:34.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.734+0000 7f97ac27b640 1 -- 172.21.15.6:0/2765685076 shutdown_connections 2023-07-21T22:35:34.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.734+0000 7f97ac27b640 1 --2- 172.21.15.6:0/2765685076 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f97880663a0 0x7f9788068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:34.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.734+0000 7f97ac27b640 1 --2- 172.21.15.6:0/2765685076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97a4159270 0x7f97a41579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.734+0000 7f97ac27b640 1 --2- 172.21.15.6:0/2765685076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97a40aef10 0x7f97a414fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.734+0000 7f97ac27b640 1 --2- 172.21.15.6:0/2765685076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97a40aeb40 0x7f97a406fa20 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.734+0000 7f97ac27b640 1 -- 172.21.15.6:0/2765685076 >> 172.21.15.6:0/2765685076 conn(0x7f97a40cde90 msgr2=0x7f97a4152780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.734+0000 7f97ac27b640 1 -- 172.21.15.6:0/2765685076 shutdown_connections 2023-07-21T22:35:34.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:34.734+0000 7f97ac27b640 1 -- 172.21.15.6:0/2765685076 wait complete. 2023-07-21T22:35:34.805 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:35:34.805 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:35:34.854 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:35:34.915 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:35:34.916 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:35:34.916 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:35:34.925 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:35:34.926 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:35:34.926 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:35:34.935 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:35:34.936 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:35:34.936 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:35:34.979 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:35:34.979 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:35:34.980 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:35:34.989 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:35:34.989 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-21T22:35:34.989 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:35:35.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.114+0000 7ff4b5b59640 1 Processor -- start 2023-07-21T22:35:35.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.114+0000 7ff4b5b59640 1 -- start start 2023-07-21T22:35:35.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.118+0000 7ff4b5b59640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4b0070b70 0x7ff4b0070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:35.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.118+0000 7ff4b5b59640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff4b006b1e0 0x7ff4b00c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:35.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.118+0000 7ff4b5b59640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b00cac70 con 0x7ff4b00c21f0 2023-07-21T22:35:35.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.118+0000 7ff4b5b59640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b0071480 con 0x7ff4b006b1e0 2023-07-21T22:35:35.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.118+0000 7ff4b5b59640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b00ca060 con 0x7ff4b0070b70 2023-07-21T22:35:35.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.118+0000 7ff4affff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff4b00c21f0 0x7ff4b00cb100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53940/0 (socket says 172.21.15.6:53940) 2023-07-21T22:35:35.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.118+0000 7ff4affff640 1 -- 172.21.15.6:0/3458035834 learned_addr learned my addr 172.21.15.6:0/3458035834 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:35.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.118+0000 7ff4aeffd640 1 --2- 172.21.15.6:0/3458035834 >> v2:172.21.15.161:3300/0 conn(0x7ff4b006b1e0 0x7ff4b00c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:35.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.118+0000 7ff4af7fe640 1 --2- 172.21.15.6:0/3458035834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4b0070b70 0x7ff4b0070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:35.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.118+0000 7ff4ae7fc640 1 -- 172.21.15.6:0/3458035834 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1395432108 0 0) 0x7ff4b00cac70 con 0x7ff4b00c21f0 2023-07-21T22:35:35.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.118+0000 7ff4ae7fc640 1 -- 172.21.15.6:0/3458035834 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff498003530 con 0x7ff4b00c21f0 2023-07-21T22:35:35.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.118+0000 7ff4ae7fc640 1 -- 172.21.15.6:0/3458035834 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2867276234 0 0) 0x7ff498003530 con 0x7ff4b00c21f0 2023-07-21T22:35:35.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.118+0000 7ff4af7fe640 1 -- 172.21.15.6:0/3458035834 >> v2:172.21.15.161:3300/0 conn(0x7ff4b006b1e0 msgr2=0x7ff4b00c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:35.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.118+0000 7ff4af7fe640 1 --2- 172.21.15.6:0/3458035834 >> v2:172.21.15.161:3300/0 conn(0x7ff4b006b1e0 0x7ff4b00c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:35.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.118+0000 7ff4af7fe640 1 -- 172.21.15.6:0/3458035834 >> v1:172.21.15.6:6789/0 conn(0x7ff4b00c21f0 legacy=0x7ff4b00cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:35.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.118+0000 7ff4af7fe640 1 -- 172.21.15.6:0/3458035834 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b00ca340 con 0x7ff4b0070b70 2023-07-21T22:35:35.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.118+0000 7ff4aeffd640 1 --2- 172.21.15.6:0/3458035834 >> v2:172.21.15.161:3300/0 conn(0x7ff4b006b1e0 0x7ff4b00c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:35.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.122+0000 7ff4af7fe640 1 --2- 172.21.15.6:0/3458035834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4b0070b70 0x7ff4b0070f40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff4a00097c0 tx=0x7ff4a001c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a053567efd666e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:35.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.122+0000 7ff4ae7fc640 1 -- 172.21.15.6:0/3458035834 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8001a00 con 0x7ff4b0070b70 2023-07-21T22:35:35.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.122+0000 7ff4ae7fc640 1 -- 172.21.15.6:0/3458035834 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a00a7050 con 0x7ff4b0070b70 2023-07-21T22:35:35.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.122+0000 7ff4ae7fc640 1 -- 172.21.15.6:0/3458035834 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a00ab620 con 0x7ff4b0070b70 2023-07-21T22:35:35.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.122+0000 7ff4b5b59640 1 -- 172.21.15.6:0/3458035834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4b0070b70 msgr2=0x7ff4b0070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:35.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.122+0000 7ff4b5b59640 1 --2- 172.21.15.6:0/3458035834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4b0070b70 0x7ff4b0070f40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff4a00097c0 tx=0x7ff4a001c2e0 comp rx=0 tx=0).stop 2023-07-21T22:35:35.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.122+0000 7ff4b5b59640 1 -- 172.21.15.6:0/3458035834 shutdown_connections 2023-07-21T22:35:35.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.122+0000 7ff4b5b59640 1 --2- 172.21.15.6:0/3458035834 >> v2:172.21.15.161:3300/0 conn(0x7ff4b006b1e0 0x7ff4b00c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:35.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.122+0000 7ff4b5b59640 1 --2- 172.21.15.6:0/3458035834 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4b0070b70 0x7ff4b0070f40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:35.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.122+0000 7ff4b5b59640 1 -- 172.21.15.6:0/3458035834 >> 172.21.15.6:0/3458035834 conn(0x7ff4b00afcf0 msgr2=0x7ff4b00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:35.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.122+0000 7ff4b5b59640 1 -- 172.21.15.6:0/3458035834 shutdown_connections 2023-07-21T22:35:35.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.122+0000 7ff4b5b59640 1 -- 172.21.15.6:0/3458035834 wait complete. 2023-07-21T22:35:35.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.122+0000 7ff4b5b59640 1 Processor -- start 2023-07-21T22:35:35.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4b5b59640 1 -- start start 2023-07-21T22:35:35.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4b5b59640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b006b1e0 0x7ff4b00b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:35.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4b5b59640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4b0070b70 0x7ff4b014f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:35.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4b5b59640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4b00c21f0 0x7ff4b0143210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:35.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4b5b59640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b01450c0 con 0x7ff4b006b1e0 2023-07-21T22:35:35.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4b5b59640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b014f9f0 con 0x7ff4b0070b70 2023-07-21T22:35:35.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4b5b59640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b014fcd0 con 0x7ff4b00c21f0 2023-07-21T22:35:35.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4af7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b006b1e0 0x7ff4b00b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:35.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4af7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b006b1e0 0x7ff4b00b3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52998/0 (socket says 172.21.15.6:52998) 2023-07-21T22:35:35.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4af7fe640 1 -- 172.21.15.6:0/429243100 learned_addr learned my addr 172.21.15.6:0/429243100 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:35.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4aeffd640 1 --2- 172.21.15.6:0/429243100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4b0070b70 0x7ff4b014f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:35.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4affff640 1 --2- 172.21.15.6:0/429243100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4b00c21f0 0x7ff4b0143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:35.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4af7fe640 1 -- 172.21.15.6:0/429243100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4b00c21f0 msgr2=0x7ff4b0143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:35.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4af7fe640 1 --2- 172.21.15.6:0/429243100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4b00c21f0 0x7ff4b0143210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:35.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4af7fe640 1 -- 172.21.15.6:0/429243100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4b0070b70 msgr2=0x7ff4b014f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:35.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4af7fe640 1 --2- 172.21.15.6:0/429243100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4b0070b70 0x7ff4b014f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:35.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4af7fe640 1 -- 172.21.15.6:0/429243100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a4009420 con 0x7ff4b006b1e0 2023-07-21T22:35:35.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4af7fe640 1 --2- 172.21.15.6:0/429243100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b006b1e0 0x7ff4b00b3ae0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ff4a00ae040 tx=0x7ff4a001ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:35.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff497fff640 1 -- 172.21.15.6:0/429243100 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a00b7450 con 0x7ff4b006b1e0 2023-07-21T22:35:35.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff497fff640 1 -- 172.21.15.6:0/429243100 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a00b75d0 con 0x7ff4b006b1e0 2023-07-21T22:35:35.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4b5b59640 1 -- 172.21.15.6:0/429243100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a0009420 con 0x7ff4b006b1e0 2023-07-21T22:35:35.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff497fff640 1 -- 172.21.15.6:0/429243100 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a00b7980 con 0x7ff4b006b1e0 2023-07-21T22:35:35.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4b5b59640 1 -- 172.21.15.6:0/429243100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b00c2ce0 con 0x7ff4b006b1e0 2023-07-21T22:35:35.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.126+0000 7ff4b5b59640 1 -- 172.21.15.6:0/429243100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b01501f0 con 0x7ff4b006b1e0 2023-07-21T22:35:35.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.130+0000 7ff497fff640 1 -- 172.21.15.6:0/429243100 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff4a00b7ae0 con 0x7ff4b006b1e0 2023-07-21T22:35:35.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.130+0000 7ff497fff640 1 --2- 172.21.15.6:0/429243100 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7ff49c0663a0 0x7ff49c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:35.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.130+0000 7ff497fff640 1 -- 172.21.15.6:0/429243100 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6071+0+0 (secure 0 0 0) 0x7ff4a011e7d0 con 0x7ff4b006b1e0 2023-07-21T22:35:35.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.130+0000 7ff4aeffd640 1 --2- 172.21.15.6:0/429243100 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7ff49c0663a0 0x7ff49c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:35.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.130+0000 7ff4aeffd640 1 --2- 172.21.15.6:0/429243100 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7ff49c0663a0 0x7ff49c068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00b3a90 tx=0x7ff4a4009190 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:35.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.134+0000 7ff497fff640 1 -- 172.21.15.6:0/429243100 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff4a00ebbe0 con 0x7ff4b006b1e0 2023-07-21T22:35:35.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.318+0000 7ff4b5b59640 1 -- 172.21.15.6:0/429243100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4b00678d0 con 0x7ff4b006b1e0 2023-07-21T22:35:35.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.318+0000 7ff497fff640 1 -- 172.21.15.6:0/429243100 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3526 (secure 0 0 0) 0x7ff4a00bbde0 con 0x7ff4b006b1e0 2023-07-21T22:35:35.370 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:35.370 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6332,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/750234701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":750234701},{"type":"v1","addr":"172.21.15.6:6835","nonce":750234701}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6341,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1418940969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1418940969},{"type":"v1","addr":"172.21.15.161:6837","nonce":1418940969}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6976,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3127204881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3127204881},{"type":"v1","addr":"172.21.15.161:6836","nonce":3127204881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7569,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/2882306702","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2882306702},{"type":"v1","addr":"172.21.15.6:6833","nonce":2882306702}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[]} 2023-07-21T22:35:35.370 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 41 2023-07-21T22:35:35.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.322+0000 7ff4b5b59640 1 -- 172.21.15.6:0/429243100 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7ff49c0663a0 msgr2=0x7ff49c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:35.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.322+0000 7ff4b5b59640 1 --2- 172.21.15.6:0/429243100 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7ff49c0663a0 0x7ff49c068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff4b00b3a90 tx=0x7ff4a4009190 comp rx=0 tx=0).stop 2023-07-21T22:35:35.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.322+0000 7ff4b5b59640 1 -- 172.21.15.6:0/429243100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b006b1e0 msgr2=0x7ff4b00b3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:35.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.322+0000 7ff4b5b59640 1 --2- 172.21.15.6:0/429243100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b006b1e0 0x7ff4b00b3ae0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ff4a00ae040 tx=0x7ff4a001ab20 comp rx=0 tx=0).stop 2023-07-21T22:35:35.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.322+0000 7ff4b5b59640 1 -- 172.21.15.6:0/429243100 shutdown_connections 2023-07-21T22:35:35.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.322+0000 7ff4b5b59640 1 --2- 172.21.15.6:0/429243100 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7ff49c0663a0 0x7ff49c068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:35.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.322+0000 7ff4b5b59640 1 --2- 172.21.15.6:0/429243100 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4b00c21f0 0x7ff4b0143210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:35.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.322+0000 7ff4b5b59640 1 --2- 172.21.15.6:0/429243100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4b0070b70 0x7ff4b014f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:35.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.322+0000 7ff4b5b59640 1 --2- 172.21.15.6:0/429243100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b006b1e0 0x7ff4b00b3ae0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:35.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.322+0000 7ff4b5b59640 1 -- 172.21.15.6:0/429243100 >> 172.21.15.6:0/429243100 conn(0x7ff4b00afcf0 msgr2=0x7ff4b00c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:35.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.322+0000 7ff4b5b59640 1 -- 172.21.15.6:0/429243100 shutdown_connections 2023-07-21T22:35:35.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.322+0000 7ff4b5b59640 1 -- 172.21.15.6:0/429243100 wait complete. 2023-07-21T22:35:35.391 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-21T22:35:35.391 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-21T22:35:35.392 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-21T22:35:35.392 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:35:35.392 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-21T22:35:35.392 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-21T22:35:35.393 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-21T22:35:35.393 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:35:35.393 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-21T22:35:35.393 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-21T22:35:35.394 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-21T22:35:35.394 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:35:35.394 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-21T22:35:35.394 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-21T22:35:35.395 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-21T22:35:35.395 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:35:35.404 INFO:tasks.ceph.mds.a:Stopped 2023-07-21T22:35:35.404 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-21T22:35:35.405 INFO:tasks.ceph.mds.c:Stopped 2023-07-21T22:35:35.406 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-21T22:35:35.409 INFO:tasks.ceph.mds.b:Stopped 2023-07-21T22:35:35.409 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-21T22:35:35.410 INFO:tasks.ceph.mds.d:Stopped 2023-07-21T22:35:35.410 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-21T22:35:35.453 INFO:tasks.ceph.mds.a:Started 2023-07-21T22:35:35.454 DEBUG:teuthology.parallel:result is None 2023-07-21T22:35:35.456 INFO:tasks.ceph.mds.c:Started 2023-07-21T22:35:35.456 DEBUG:teuthology.parallel:result is None 2023-07-21T22:35:35.459 INFO:tasks.ceph.mds.b:Started 2023-07-21T22:35:35.460 DEBUG:teuthology.parallel:result is None 2023-07-21T22:35:35.461 INFO:tasks.ceph.mds.d:Started 2023-07-21T22:35:35.462 DEBUG:teuthology.parallel:result is None 2023-07-21T22:35:35.462 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-21T22:35:35.542 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-07-21T22:35:35.545 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-21T22:35:35.550 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2023-07-21T22:35:35.552 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-07-21T22:35:35.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.566+0000 7f38f9293640 1 Processor -- start 2023-07-21T22:35:35.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.566+0000 7f38f9293640 1 -- start start 2023-07-21T22:35:35.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.566+0000 7f38f9293640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38f406b1e0 0x7f38f40c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.566+0000 7f38f9293640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f38f40c21f0 0x7f38f40cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.566+0000 7f38f9293640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f40cac70 con 0x7f38f4070b70 2023-07-21T22:35:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.566+0000 7f38f9293640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f40ca060 con 0x7f38f40c21f0 2023-07-21T22:35:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.566+0000 7f38f9293640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f40ca340 con 0x7f38f406b1e0 2023-07-21T22:35:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.566+0000 7f38f2ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f38f4070b70 0x7f38f4070f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53966/0 (socket says 172.21.15.6:53966) 2023-07-21T22:35:35.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.566+0000 7f38f2ffd640 1 -- 172.21.15.6:0/1838596006 learned_addr learned my addr 172.21.15.6:0/1838596006 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:35.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.566+0000 7f38f37fe640 1 --2- 172.21.15.6:0/1838596006 >> v2:172.21.15.161:3300/0 conn(0x7f38f40c21f0 0x7f38f40cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:35.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.566+0000 7f38f27fc640 1 --2- 172.21.15.6:0/1838596006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38f406b1e0 0x7f38f40c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:35.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.566+0000 7f38f1ffb640 1 -- 172.21.15.6:0/1838596006 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226798904 0 0) 0x7f38f40cac70 con 0x7f38f4070b70 2023-07-21T22:35:35.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.566+0000 7f38f1ffb640 1 -- 172.21.15.6:0/1838596006 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38dc003530 con 0x7f38f4070b70 2023-07-21T22:35:35.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.566+0000 7f38f37fe640 1 -- 172.21.15.6:0/1838596006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38f406b1e0 msgr2=0x7f38f40c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:35.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.566+0000 7f38f37fe640 1 --2- 172.21.15.6:0/1838596006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38f406b1e0 0x7f38f40c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:35.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.566+0000 7f38f37fe640 1 -- 172.21.15.6:0/1838596006 >> v1:172.21.15.6:6789/0 conn(0x7f38f4070b70 legacy=0x7f38f4070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:35.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.566+0000 7f38f37fe640 1 -- 172.21.15.6:0/1838596006 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f40ca620 con 0x7f38f40c21f0 2023-07-21T22:35:35.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.570+0000 7f38f37fe640 1 --2- 172.21.15.6:0/1838596006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38f40c21f0 0x7f38f40cb100 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009d90 tx=0x7f38ec01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=febbf067ce5c8d7e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:35.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.570+0000 7f38f1ffb640 1 -- 172.21.15.6:0/1838596006 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec0a5970 con 0x7f38f40c21f0 2023-07-21T22:35:35.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.570+0000 7f38f1ffb640 1 -- 172.21.15.6:0/1838596006 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ec0a5ad0 con 0x7f38f40c21f0 2023-07-21T22:35:35.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.570+0000 7f38f1ffb640 1 -- 172.21.15.6:0/1838596006 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec0a5e60 con 0x7f38f40c21f0 2023-07-21T22:35:35.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.570+0000 7f38f9293640 1 -- 172.21.15.6:0/1838596006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38f40c21f0 msgr2=0x7f38f40cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:35.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.570+0000 7f38f9293640 1 --2- 172.21.15.6:0/1838596006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38f40c21f0 0x7f38f40cb100 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009d90 tx=0x7f38ec01c890 comp rx=0 tx=0).stop 2023-07-21T22:35:35.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.570+0000 7f38f9293640 1 -- 172.21.15.6:0/1838596006 shutdown_connections 2023-07-21T22:35:35.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.570+0000 7f38f9293640 1 --2- 172.21.15.6:0/1838596006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38f40c21f0 0x7f38f40cb100 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:35.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.570+0000 7f38f9293640 1 --2- 172.21.15.6:0/1838596006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38f406b1e0 0x7f38f40c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:35.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.570+0000 7f38f9293640 1 -- 172.21.15.6:0/1838596006 >> 172.21.15.6:0/1838596006 conn(0x7f38f40afcf0 msgr2=0x7f38f40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:35.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.570+0000 7f38f9293640 1 -- 172.21.15.6:0/1838596006 shutdown_connections 2023-07-21T22:35:35.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.570+0000 7f38f9293640 1 -- 172.21.15.6:0/1838596006 wait complete. 2023-07-21T22:35:35.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f9293640 1 Processor -- start 2023-07-21T22:35:35.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f9293640 1 -- start start 2023-07-21T22:35:35.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f9293640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f406b1e0 0x7f38f4153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:35.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f9293640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38f4070b70 0x7f38f40a7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:35.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f9293640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38f40c21f0 0x7f38f4154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:35.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f9293640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f4153740 con 0x7f38f406b1e0 2023-07-21T22:35:35.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f9293640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f40c3570 con 0x7f38f4070b70 2023-07-21T22:35:35.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f9293640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f40a79d0 con 0x7f38f40c21f0 2023-07-21T22:35:35.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f406b1e0 0x7f38f4153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:35.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f406b1e0 0x7f38f4153200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53020/0 (socket says 172.21.15.6:53020) 2023-07-21T22:35:35.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f2ffd640 1 -- 172.21.15.6:0/452891403 learned_addr learned my addr 172.21.15.6:0/452891403 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:35.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f27fc640 1 --2- 172.21.15.6:0/452891403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38f4070b70 0x7f38f40a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:35.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f37fe640 1 --2- 172.21.15.6:0/452891403 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38f40c21f0 0x7f38f4154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:35.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f2ffd640 1 -- 172.21.15.6:0/452891403 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38f40c21f0 msgr2=0x7f38f4154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:35.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f2ffd640 1 --2- 172.21.15.6:0/452891403 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38f40c21f0 0x7f38f4154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:35.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f2ffd640 1 -- 172.21.15.6:0/452891403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38f4070b70 msgr2=0x7f38f40a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:35.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f2ffd640 1 --2- 172.21.15.6:0/452891403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38f4070b70 0x7f38f40a7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:35.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f2ffd640 1 -- 172.21.15.6:0/452891403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ec009a70 con 0x7f38f406b1e0 2023-07-21T22:35:35.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f2ffd640 1 --2- 172.21.15.6:0/452891403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f406b1e0 0x7f38f4153200 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f38e400c500 tx=0x7f38e400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:35.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38db7fe640 1 -- 172.21.15.6:0/452891403 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e4005cf0 con 0x7f38f406b1e0 2023-07-21T22:35:35.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38db7fe640 1 -- 172.21.15.6:0/452891403 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e4005e50 con 0x7f38f406b1e0 2023-07-21T22:35:35.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38db7fe640 1 -- 172.21.15.6:0/452891403 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e40072f0 con 0x7f38f406b1e0 2023-07-21T22:35:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f9293640 1 -- 172.21.15.6:0/452891403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f40b1090 con 0x7f38f406b1e0 2023-07-21T22:35:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f9293640 1 -- 172.21.15.6:0/452891403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f40b1330 con 0x7f38f406b1e0 2023-07-21T22:35:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.574+0000 7f38f9293640 1 -- 172.21.15.6:0/452891403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f40678d0 con 0x7f38f406b1e0 2023-07-21T22:35:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.578+0000 7f38db7fe640 1 -- 172.21.15.6:0/452891403 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f38e4007450 con 0x7f38f406b1e0 2023-07-21T22:35:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.578+0000 7f38db7fe640 1 --2- 172.21.15.6:0/452891403 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f38e00663a0 0x7f38e0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.578+0000 7f38db7fe640 1 -- 172.21.15.6:0/452891403 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6071+0+0 (secure 0 0 0) 0x7f38e40833c0 con 0x7f38f406b1e0 2023-07-21T22:35:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.578+0000 7f38f27fc640 1 --2- 172.21.15.6:0/452891403 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f38e00663a0 0x7f38e0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.578+0000 7f38f27fc640 1 --2- 172.21.15.6:0/452891403 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f38e00663a0 0x7f38e0068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f38f40cdae0 tx=0x7f38e8009190 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:35.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.582+0000 7f38db7fe640 1 -- 172.21.15.6:0/452891403 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f38e40507c0 con 0x7f38f406b1e0 2023-07-21T22:35:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:35.750+0000 7f38f9293640 1 -- 172.21.15.6:0/452891403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f38f4066810 con 0x7f38f406b1e0 2023-07-21T22:35:36.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.758+0000 7f38db7fe640 1 -- 172.21.15.6:0/452891403 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v108) v1 ==== 97+0+0 (secure 0 0 0) 0x7f38e4053de0 con 0x7f38f406b1e0 2023-07-21T22:35:36.809 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-07-21T22:35:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.762+0000 7f38f9293640 1 -- 172.21.15.6:0/452891403 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f38e00663a0 msgr2=0x7f38e0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.762+0000 7f38f9293640 1 --2- 172.21.15.6:0/452891403 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f38e00663a0 0x7f38e0068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f38f40cdae0 tx=0x7f38e8009190 comp rx=0 tx=0).stop 2023-07-21T22:35:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.762+0000 7f38f9293640 1 -- 172.21.15.6:0/452891403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f406b1e0 msgr2=0x7f38f4153200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.762+0000 7f38f9293640 1 --2- 172.21.15.6:0/452891403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f406b1e0 0x7f38f4153200 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f38e400c500 tx=0x7f38e400c9c0 comp rx=0 tx=0).stop 2023-07-21T22:35:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.762+0000 7f38f9293640 1 -- 172.21.15.6:0/452891403 shutdown_connections 2023-07-21T22:35:36.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.762+0000 7f38f9293640 1 --2- 172.21.15.6:0/452891403 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f38e00663a0 0x7f38e0068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:36.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.762+0000 7f38f9293640 1 --2- 172.21.15.6:0/452891403 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38f40c21f0 0x7f38f4154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:36.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.762+0000 7f38f9293640 1 --2- 172.21.15.6:0/452891403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38f4070b70 0x7f38f40a7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:36.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.762+0000 7f38f9293640 1 --2- 172.21.15.6:0/452891403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f406b1e0 0x7f38f4153200 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:36.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.762+0000 7f38f9293640 1 -- 172.21.15.6:0/452891403 >> 172.21.15.6:0/452891403 conn(0x7f38f40afcf0 msgr2=0x7f38f40ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:36.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.762+0000 7f38f9293640 1 -- 172.21.15.6:0/452891403 shutdown_connections 2023-07-21T22:35:36.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.762+0000 7f38f9293640 1 -- 172.21.15.6:0/452891403 wait complete. 2023-07-21T22:35:36.836 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-21T22:35:36.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f452bb9d640 1 Processor -- start 2023-07-21T22:35:36.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f452bb9d640 1 -- start start 2023-07-21T22:35:36.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f452bb9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45240b7c70 0x7f45240d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:36.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f452bb9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f45240d1850 0x7f452415f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:36.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f452bb9d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45240ccaf0 con 0x7f45240d1300 2023-07-21T22:35:36.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f452bb9d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45240d1190 con 0x7f45240d1850 2023-07-21T22:35:36.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f452bb9d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4524160600 con 0x7f45240b7c70 2023-07-21T22:35:36.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f452a13a640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f45240d1300 0x7f45240d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53972/0 (socket says 172.21.15.6:53972) 2023-07-21T22:35:36.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f452a13a640 1 -- 172.21.15.6:0/1916270655 learned_addr learned my addr 172.21.15.6:0/1916270655 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f4529138640 1 --2- 172.21.15.6:0/1916270655 >> v2:172.21.15.161:3300/0 conn(0x7f45240d1850 0x7f452415f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f4529939640 1 --2- 172.21.15.6:0/1916270655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45240b7c70 0x7f45240d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f4528937640 1 -- 172.21.15.6:0/1916270655 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292110949 0 0) 0x7f45240ccaf0 con 0x7f45240d1300 2023-07-21T22:35:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f4528937640 1 -- 172.21.15.6:0/1916270655 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4510003530 con 0x7f45240d1300 2023-07-21T22:35:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f4528937640 1 -- 172.21.15.6:0/1916270655 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1490127334 0 0) 0x7f4510003530 con 0x7f45240d1300 2023-07-21T22:35:36.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f4528937640 1 -- 172.21.15.6:0/1916270655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45240b7c70 msgr2=0x7f45240d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f4528937640 1 --2- 172.21.15.6:0/1916270655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45240b7c70 0x7f45240d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f4528937640 1 -- 172.21.15.6:0/1916270655 >> v2:172.21.15.161:3300/0 conn(0x7f45240d1850 msgr2=0x7f452415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f4528937640 1 --2- 172.21.15.6:0/1916270655 >> v2:172.21.15.161:3300/0 conn(0x7f45240d1850 0x7f452415f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f4528937640 1 -- 172.21.15.6:0/1916270655 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4524160320 con 0x7f45240d1300 2023-07-21T22:35:36.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f4528937640 1 -- 172.21.15.6:0/1916270655 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f451c001a00 con 0x7f45240d1300 2023-07-21T22:35:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f4528937640 1 -- 172.21.15.6:0/1916270655 >> v1:172.21.15.6:6789/0 conn(0x7f45240d1300 legacy=0x7f45240d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f4528937640 1 --2- 172.21.15.6:0/1916270655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45100039b0 0x7f4510003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f4528937640 1 --2- 172.21.15.6:0/1916270655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45240b7c70 0x7f45100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f4528937640 1 --2- 172.21.15.6:0/1916270655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4510004d10 0x7f4510005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f4528937640 1 -- 172.21.15.6:0/1916270655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4524160600 con 0x7f4510004d10 2023-07-21T22:35:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f4528937640 1 -- 172.21.15.6:0/1916270655 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451000b990 con 0x7f45100039b0 2023-07-21T22:35:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f4528937640 1 -- 172.21.15.6:0/1916270655 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451000bad0 con 0x7f45240b7c70 2023-07-21T22:35:36.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.934+0000 7f452a13a640 1 --2- 172.21.15.6:0/1916270655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4510004d10 0x7f4510005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:36.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.938+0000 7f4529939640 1 --2- 172.21.15.6:0/1916270655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45100039b0 0x7f4510003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:36.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.938+0000 7f4529138640 1 --2- 172.21.15.6:0/1916270655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45240b7c70 0x7f45100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:36.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.938+0000 7f452a13a640 1 -- 172.21.15.6:0/1916270655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45240b7c70 msgr2=0x7f45100047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:36.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.938+0000 7f452a13a640 1 --2- 172.21.15.6:0/1916270655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45240b7c70 0x7f45100047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:36.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.938+0000 7f452a13a640 1 -- 172.21.15.6:0/1916270655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45100039b0 msgr2=0x7f4510003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:36.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.938+0000 7f452a13a640 1 --2- 172.21.15.6:0/1916270655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45100039b0 0x7f4510003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:36.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.938+0000 7f452a13a640 1 -- 172.21.15.6:0/1916270655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4510003530 con 0x7f4510004d10 2023-07-21T22:35:36.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.938+0000 7f4529138640 1 --2- 172.21.15.6:0/1916270655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45240b7c70 0x7f45100047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.938+0000 7f452a13a640 1 --2- 172.21.15.6:0/1916270655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4510004d10 0x7f4510005180 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f451c00a830 tx=0x7f451c01d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20239cab8377b057 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.938+0000 7f4528937640 1 -- 172.21.15.6:0/1916270655 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c0072d0 con 0x7f4510004d10 2023-07-21T22:35:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.938+0000 7f4528937640 1 -- 172.21.15.6:0/1916270655 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451c0a8070 con 0x7f4510004d10 2023-07-21T22:35:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.938+0000 7f4528937640 1 -- 172.21.15.6:0/1916270655 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c0076b0 con 0x7f4510004d10 2023-07-21T22:35:36.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.938+0000 7f452bb9d640 1 -- 172.21.15.6:0/1916270655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4510004d10 msgr2=0x7f4510005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:36.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.938+0000 7f452bb9d640 1 --2- 172.21.15.6:0/1916270655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4510004d10 0x7f4510005180 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f451c00a830 tx=0x7f451c01d2e0 comp rx=0 tx=0).stop 2023-07-21T22:35:36.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.938+0000 7f452a13a640 1 -- 172.21.15.6:0/1916270655 reap_dead start 2023-07-21T22:35:36.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f452bb9d640 1 -- 172.21.15.6:0/1916270655 shutdown_connections 2023-07-21T22:35:36.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f452bb9d640 1 -- 172.21.15.6:0/1916270655 >> 172.21.15.6:0/1916270655 conn(0x7f45240650b0 msgr2=0x7f45240654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:36.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f452bb9d640 1 -- 172.21.15.6:0/1916270655 shutdown_connections 2023-07-21T22:35:36.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f452bb9d640 1 -- 172.21.15.6:0/1916270655 wait complete. 2023-07-21T22:35:36.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f452bb9d640 1 Processor -- start 2023-07-21T22:35:36.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f452bb9d640 1 -- start start 2023-07-21T22:35:36.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f452bb9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4510004d10 0x7f4524159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:36.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f452bb9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45240c93d0 0x7f45240cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:36.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f452bb9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45240c9d90 0x7f45240cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:36.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f452bb9d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45240c5e30 con 0x7f45240c93d0 2023-07-21T22:35:36.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f452bb9d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45240cc490 con 0x7f45240c9d90 2023-07-21T22:35:36.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f452bb9d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45240ca350 con 0x7f4510004d10 2023-07-21T22:35:36.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f4529138640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45240c93d0 0x7f45240cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:36.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f4529138640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45240c93d0 0x7f45240cba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53038/0 (socket says 172.21.15.6:53038) 2023-07-21T22:35:36.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f4529138640 1 -- 172.21.15.6:0/3043728209 learned_addr learned my addr 172.21.15.6:0/3043728209 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:36.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f452a13a640 1 --2- 172.21.15.6:0/3043728209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45240c9d90 0x7f45240cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:36.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f4529939640 1 --2- 172.21.15.6:0/3043728209 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4510004d10 0x7f4524159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:36.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f4529138640 1 -- 172.21.15.6:0/3043728209 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4510004d10 msgr2=0x7f4524159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:36.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f4529138640 1 --2- 172.21.15.6:0/3043728209 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4510004d10 0x7f4524159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:36.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f4529138640 1 -- 172.21.15.6:0/3043728209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45240c9d90 msgr2=0x7f45240cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:36.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f4529138640 1 --2- 172.21.15.6:0/3043728209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45240c9d90 0x7f45240cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:36.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f4529138640 1 -- 172.21.15.6:0/3043728209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45240c6080 con 0x7f45240c93d0 2023-07-21T22:35:36.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f452a13a640 1 --2- 172.21.15.6:0/3043728209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45240c9d90 0x7f45240cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:36.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.942+0000 7f4529138640 1 --2- 172.21.15.6:0/3043728209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45240c93d0 0x7f45240cba10 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f45140116a0 tx=0x7f4514011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:36.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.946+0000 7f451a7fc640 1 -- 172.21.15.6:0/3043728209 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514004220 con 0x7f45240c93d0 2023-07-21T22:35:36.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.946+0000 7f451a7fc640 1 -- 172.21.15.6:0/3043728209 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4514004380 con 0x7f45240c93d0 2023-07-21T22:35:36.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.946+0000 7f452bb9d640 1 -- 172.21.15.6:0/3043728209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45240c6360 con 0x7f45240c93d0 2023-07-21T22:35:36.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.946+0000 7f451a7fc640 1 -- 172.21.15.6:0/3043728209 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451400f980 con 0x7f45240c93d0 2023-07-21T22:35:36.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.946+0000 7f452bb9d640 1 -- 172.21.15.6:0/3043728209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f452415a160 con 0x7f45240c93d0 2023-07-21T22:35:36.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.946+0000 7f452bb9d640 1 -- 172.21.15.6:0/3043728209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45240678d0 con 0x7f45240c93d0 2023-07-21T22:35:37.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.946+0000 7f451a7fc640 1 -- 172.21.15.6:0/3043728209 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f451400fae0 con 0x7f45240c93d0 2023-07-21T22:35:37.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.946+0000 7f451a7fc640 1 --2- 172.21.15.6:0/3043728209 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f45080663a0 0x7f4508068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:37.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.946+0000 7f451a7fc640 1 -- 172.21.15.6:0/3043728209 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5254+0+0 (secure 0 0 0) 0x7f45140841c0 con 0x7f45240c93d0 2023-07-21T22:35:37.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.946+0000 7f4529939640 1 --2- 172.21.15.6:0/3043728209 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f45080663a0 0x7f4508068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:37.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.950+0000 7f4529939640 1 --2- 172.21.15.6:0/3043728209 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f45080663a0 0x7f4508068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4520009aa0 tx=0x7f4520008040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:37.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:36.950+0000 7f451a7fc640 1 -- 172.21.15.6:0/3043728209 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4514051840 con 0x7f45240c93d0 2023-07-21T22:35:37.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.158+0000 7f452bb9d640 1 -- 172.21.15.6:0/3043728209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f45240b7670 con 0x7f45240c93d0 2023-07-21T22:35:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.158+0000 7f451a7fc640 1 -- 172.21.15.6:0/3043728209 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4514054e60 con 0x7f45240c93d0 2023-07-21T22:35:37.209 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:37.209 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:35:37.209 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-07-21T22:35:37.209 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:37.209 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-07-21T22:35:37.209 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkHn5HNxAADk0AaSGwZfEj3SwNvEm8hw==", 2023-07-21T22:35:37.210 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:35:37.210 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:35:37.210 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:35:37.210 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:35:37.210 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:35:37.210 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:37.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:35:37.211 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:37.211 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-07-21T22:35:37.211 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkQFvXCBAANxf0/I2RQcHy4iYiydjkcg==", 2023-07-21T22:35:37.211 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:35:37.211 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:35:37.211 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:35:37.212 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:35:37.212 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:35:37.212 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:37.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:35:37.212 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:37.212 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-07-21T22:35:37.212 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkYtGXAxAAy+RDDBSvc1FeZq+eg23tRA==", 2023-07-21T22:35:37.213 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:35:37.213 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:35:37.213 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:35:37.213 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:35:37.213 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:35:37.213 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:37.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:35:37.214 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:37.214 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-07-21T22:35:37.214 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkH+Y1EBAAl+qTqd+gFrB9LtJWwD5dgA==", 2023-07-21T22:35:37.214 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:35:37.214 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:35:37.215 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:35:37.215 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:35:37.215 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:35:37.215 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:37.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:35:37.215 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:37.216 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-07-21T22:35:37.216 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAKBLtkPwZrLBAAQHZECi2zHST1MKYgGoa/Iw==", 2023-07-21T22:35:37.216 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:35:37.216 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:35:37.216 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:35:37.216 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:35:37.216 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:37.217 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:35:37.217 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:37.217 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-07-21T22:35:37.217 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQANBLtkvwgwNBAApurMm8c3pSlX2r16Gli/Ag==", 2023-07-21T22:35:37.217 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:35:37.217 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:35:37.218 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:35:37.218 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:35:37.218 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:37.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:35:37.219 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:37.219 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-07-21T22:35:37.219 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAQBLtkf2p1OxAAcKYw2RixFefYAwcfkGnOKQ==", 2023-07-21T22:35:37.219 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:35:37.220 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:35:37.220 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:35:37.220 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:35:37.220 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:37.220 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:35:37.221 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:37.221 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-07-21T22:35:37.221 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAUBLtkQUl6BhAAXXT1ZK1h9aZEcp6qIHsLiA==", 2023-07-21T22:35:37.221 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:35:37.221 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:35:37.222 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:35:37.222 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:35:37.222 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:37.222 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:35:37.223 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:37.223 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-07-21T22:35:37.223 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAaBLtkc1VfExAAPzDz2k/c0qVePG9h1saQCw==", 2023-07-21T22:35:37.223 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:35:37.223 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:35:37.224 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:35:37.224 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:35:37.224 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:37.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:35:37.224 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:37.225 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-07-21T22:35:37.225 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAdBLtkJ6fcGhAAglVSJIQS04WYBv4APhl57g==", 2023-07-21T22:35:37.225 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:35:37.225 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:35:37.225 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:35:37.225 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:35:37.225 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:37.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:35:37.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:37.226 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-07-21T22:35:37.226 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAgBLtkPINGIRAAWKs1RNQIdhZYlDAzDgUkNw==", 2023-07-21T22:35:37.227 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:35:37.227 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:35:37.227 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:35:37.227 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:35:37.227 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:37.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:35:37.228 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:37.228 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-07-21T22:35:37.228 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAjBLtk83MCKBAAZH2NhMBphVv4QkRzy+NDgg==", 2023-07-21T22:35:37.228 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:35:37.228 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:35:37.229 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:35:37.229 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:35:37.229 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:37.229 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:35:37.229 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:37.229 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-07-21T22:35:37.229 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA==", 2023-07-21T22:35:37.230 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:35:37.230 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:35:37.230 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-07-21T22:35:37.230 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-21T22:35:37.230 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:37.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:35:37.230 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:37.230 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-07-21T22:35:37.231 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkPVXTHhAAYmkzwAvqsfrowpAucTnlUQ==", 2023-07-21T22:35:37.231 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:35:37.231 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:35:37.231 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:35:37.231 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:35:37.231 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:35:37.232 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:37.232 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:35:37.232 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:37.232 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-07-21T22:35:37.232 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkd7wSGxAArvSYwe+k48vgRzb3fQAEAQ==", 2023-07-21T22:35:37.232 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:35:37.233 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:35:37.233 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:35:37.233 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:35:37.233 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:35:37.233 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:37.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:35:37.234 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:37.234 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-07-21T22:35:37.234 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkoZ4YJRAAX4yh0Q1pR4wY7yEV6kg9QA==", 2023-07-21T22:35:37.234 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:35:37.235 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:35:37.235 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:35:37.235 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:35:37.235 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:35:37.235 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:37.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:35:37.235 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:37.236 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-07-21T22:35:37.236 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtk0ILFGhAAQZ+8lGNFVdOtZYOuLlfkoQ==", 2023-07-21T22:35:37.236 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:35:37.236 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:35:37.236 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:35:37.236 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:35:37.237 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:35:37.237 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:37.237 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:35:37.237 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:37.237 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-07-21T22:35:37.238 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkdobtMhAAQbwi3cvsrW9P0t3d52oEKw==", 2023-07-21T22:35:37.238 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:35:37.238 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:35:37.238 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T22:35:37.238 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:35:37.238 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:37.239 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:35:37.239 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:37.239 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-07-21T22:35:37.239 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkHhzpLhAAZTx4Vrc0Htk88104SzuAxQ==", 2023-07-21T22:35:37.239 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:35:37.239 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:35:37.239 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T22:35:37.240 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:35:37.240 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:37.240 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:37.240 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-07-21T22:35:37.240 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:35:37.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.158+0000 7f452bb9d640 1 -- 172.21.15.6:0/3043728209 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f45080663a0 msgr2=0x7f4508068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:37.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.158+0000 7f452bb9d640 1 --2- 172.21.15.6:0/3043728209 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f45080663a0 0x7f4508068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4520009aa0 tx=0x7f4520008040 comp rx=0 tx=0).stop 2023-07-21T22:35:37.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.158+0000 7f452bb9d640 1 -- 172.21.15.6:0/3043728209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45240c93d0 msgr2=0x7f45240cba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:37.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.158+0000 7f452bb9d640 1 --2- 172.21.15.6:0/3043728209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45240c93d0 0x7f45240cba10 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f45140116a0 tx=0x7f4514011b60 comp rx=0 tx=0).stop 2023-07-21T22:35:37.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.158+0000 7f452bb9d640 1 -- 172.21.15.6:0/3043728209 shutdown_connections 2023-07-21T22:35:37.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.158+0000 7f452bb9d640 1 --2- 172.21.15.6:0/3043728209 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f45080663a0 0x7f4508068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.158+0000 7f452bb9d640 1 --2- 172.21.15.6:0/3043728209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45240c9d90 0x7f45240cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.158+0000 7f452bb9d640 1 --2- 172.21.15.6:0/3043728209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45240c93d0 0x7f45240cba10 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.158+0000 7f452bb9d640 1 --2- 172.21.15.6:0/3043728209 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4510004d10 0x7f4524159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.158+0000 7f452bb9d640 1 -- 172.21.15.6:0/3043728209 >> 172.21.15.6:0/3043728209 conn(0x7f45240650b0 msgr2=0x7f45240b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:37.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.158+0000 7f452bb9d640 1 -- 172.21.15.6:0/3043728209 shutdown_connections 2023-07-21T22:35:37.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.158+0000 7f452bb9d640 1 -- 172.21.15.6:0/3043728209 wait complete. 2023-07-21T22:35:37.244 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:35:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.338+0000 7f203199f640 1 Processor -- start 2023-07-21T22:35:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.338+0000 7f203199f640 1 -- start start 2023-07-21T22:35:37.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.338+0000 7f203199f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f202c0ae1f0 0x7f202c0b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:37.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.338+0000 7f203199f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202c0b24f0 con 0x7f202c06e160 2023-07-21T22:35:37.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.338+0000 7f203199f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202c0b27d0 con 0x7f202c06c430 2023-07-21T22:35:37.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.338+0000 7f203199f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202c0b2ab0 con 0x7f202c0ae1f0 2023-07-21T22:35:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.338+0000 7f202affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f202c0ae1f0 0x7f202c0b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.338+0000 7f2023fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f202c06e160 0x7f202c06bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53976/0 (socket says 172.21.15.6:53976) 2023-07-21T22:35:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.338+0000 7f2023fff640 1 -- 172.21.15.6:0/172840796 learned_addr learned my addr 172.21.15.6:0/172840796 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:37.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.338+0000 7f202affd640 1 -- 172.21.15.6:0/172840796 >> v1:172.21.15.161:6789/0 conn(0x7f202c06c430 legacy=0x7f202c069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:37.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.338+0000 7f202affd640 1 -- 172.21.15.6:0/172840796 >> v1:172.21.15.6:6789/0 conn(0x7f202c06e160 legacy=0x7f202c06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:37.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.338+0000 7f202affd640 1 -- 172.21.15.6:0/172840796 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c0b2d90 con 0x7f202c0ae1f0 2023-07-21T22:35:37.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.338+0000 7f202a7fc640 1 -- 172.21.15.6:0/172840796 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061288922 0 0) 0x7f202c0b24f0 con 0x7f202c06e160 2023-07-21T22:35:37.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.342+0000 7f202affd640 1 --2- 172.21.15.6:0/172840796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f202c0ae1f0 0x7f202c0b1e60 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f201c0097c0 tx=0x7f201c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714944f5bd798d8f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:37.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.342+0000 7f202a7fc640 1 -- 172.21.15.6:0/172840796 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c0ab670 con 0x7f202c0ae1f0 2023-07-21T22:35:37.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.342+0000 7f202a7fc640 1 -- 172.21.15.6:0/172840796 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c0ab7d0 con 0x7f202c0ae1f0 2023-07-21T22:35:37.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.342+0000 7f202a7fc640 1 -- 172.21.15.6:0/172840796 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c0abb60 con 0x7f202c0ae1f0 2023-07-21T22:35:37.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.342+0000 7f203199f640 1 -- 172.21.15.6:0/172840796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f202c0ae1f0 msgr2=0x7f202c0b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:37.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.342+0000 7f203199f640 1 --2- 172.21.15.6:0/172840796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f202c0ae1f0 0x7f202c0b1e60 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f201c0097c0 tx=0x7f201c01c450 comp rx=0 tx=0).stop 2023-07-21T22:35:37.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.342+0000 7f203199f640 1 -- 172.21.15.6:0/172840796 shutdown_connections 2023-07-21T22:35:37.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.342+0000 7f203199f640 1 --2- 172.21.15.6:0/172840796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f202c0ae1f0 0x7f202c0b1e60 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.342+0000 7f203199f640 1 -- 172.21.15.6:0/172840796 >> 172.21.15.6:0/172840796 conn(0x7f202c0b1300 msgr2=0x7f202c0ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:37.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.342+0000 7f203199f640 1 -- 172.21.15.6:0/172840796 shutdown_connections 2023-07-21T22:35:37.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.342+0000 7f203199f640 1 -- 172.21.15.6:0/172840796 wait complete. 2023-07-21T22:35:37.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f203199f640 1 Processor -- start 2023-07-21T22:35:37.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f203199f640 1 -- start start 2023-07-21T22:35:37.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f203199f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f202c06c430 0x7f202c13d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:37.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f203199f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f202c06e160 0x7f202c0ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:37.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f203199f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f202c0ae1f0 0x7f202c1403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:37.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f203199f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0cb390 con 0x7f202c06c430 2023-07-21T22:35:37.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f203199f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c144a00 con 0x7f202c0ae1f0 2023-07-21T22:35:37.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f203199f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c1427a0 con 0x7f202c06e160 2023-07-21T22:35:37.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f202affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f202c06c430 0x7f202c13d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:37.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f202affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f202c06c430 0x7f202c13d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53048/0 (socket says 172.21.15.6:53048) 2023-07-21T22:35:37.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f202affd640 1 -- 172.21.15.6:0/1180210008 learned_addr learned my addr 172.21.15.6:0/1180210008 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:37.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f202b7fe640 1 --2- 172.21.15.6:0/1180210008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f202c0ae1f0 0x7f202c1403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f2023fff640 1 --2- 172.21.15.6:0/1180210008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f202c06e160 0x7f202c0ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f202affd640 1 -- 172.21.15.6:0/1180210008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f202c06e160 msgr2=0x7f202c0ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f202affd640 1 --2- 172.21.15.6:0/1180210008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f202c06e160 0x7f202c0ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f202affd640 1 -- 172.21.15.6:0/1180210008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f202c0ae1f0 msgr2=0x7f202c1403d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f202affd640 1 --2- 172.21.15.6:0/1180210008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f202c0ae1f0 0x7f202c1403d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f202affd640 1 -- 172.21.15.6:0/1180210008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c009420 con 0x7f202c06c430 2023-07-21T22:35:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f202b7fe640 1 --2- 172.21.15.6:0/1180210008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f202c0ae1f0 0x7f202c1403d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f2023fff640 1 --2- 172.21.15.6:0/1180210008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f202c06e160 0x7f202c0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f202affd640 1 --2- 172.21.15.6:0/1180210008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f202c06c430 0x7f202c13d6a0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f201c0ad040 tx=0x7f201c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f2028ff9640 1 -- 172.21.15.6:0/1180210008 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c0b5810 con 0x7f202c06c430 2023-07-21T22:35:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f2028ff9640 1 -- 172.21.15.6:0/1180210008 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c0b5970 con 0x7f202c06c430 2023-07-21T22:35:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f2028ff9640 1 -- 172.21.15.6:0/1180210008 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c0b5d00 con 0x7f202c06c430 2023-07-21T22:35:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f203199f640 1 -- 172.21.15.6:0/1180210008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202c0b3710 con 0x7f202c06c430 2023-07-21T22:35:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.346+0000 7f203199f640 1 -- 172.21.15.6:0/1180210008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202c13dbe0 con 0x7f202c06c430 2023-07-21T22:35:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.350+0000 7f203199f640 1 -- 172.21.15.6:0/1180210008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202c0cd4d0 con 0x7f202c06c430 2023-07-21T22:35:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.350+0000 7f2028ff9640 1 -- 172.21.15.6:0/1180210008 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f201c0b4390 con 0x7f202c06c430 2023-07-21T22:35:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.350+0000 7f2028ff9640 1 --2- 172.21.15.6:0/1180210008 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f200c0663a0 0x7f200c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.350+0000 7f2028ff9640 1 -- 172.21.15.6:0/1180210008 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5254+0+0 (secure 0 0 0) 0x7f201c11e680 con 0x7f202c06c430 2023-07-21T22:35:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.350+0000 7f2023fff640 1 --2- 172.21.15.6:0/1180210008 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f200c0663a0 0x7f200c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.350+0000 7f2023fff640 1 --2- 172.21.15.6:0/1180210008 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f200c0663a0 0x7f200c068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f202c0ac370 tx=0x7f2014009040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:37.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.354+0000 7f2028ff9640 1 -- 172.21.15.6:0/1180210008 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f201c0ebc80 con 0x7f202c06c430 2023-07-21T22:35:37.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.510+0000 7f203199f640 1 -- 172.21.15.6:0/1180210008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f202c142570 con 0x7f202c06c430 2023-07-21T22:35:37.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.514+0000 7f2028ff9640 1 -- 172.21.15.6:0/1180210008 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+14639 (secure 0 0 0) 0x7f202c142570 con 0x7f202c06c430 2023-07-21T22:35:37.564 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:37.564 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":108,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:35:36.758198+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:35:37.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.514+0000 7f203199f640 1 -- 172.21.15.6:0/1180210008 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f200c0663a0 msgr2=0x7f200c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:37.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.514+0000 7f203199f640 1 --2- 172.21.15.6:0/1180210008 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f200c0663a0 0x7f200c068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f202c0ac370 tx=0x7f2014009040 comp rx=0 tx=0).stop 2023-07-21T22:35:37.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.514+0000 7f203199f640 1 -- 172.21.15.6:0/1180210008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f202c06c430 msgr2=0x7f202c13d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:37.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.514+0000 7f203199f640 1 --2- 172.21.15.6:0/1180210008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f202c06c430 0x7f202c13d6a0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f201c0ad040 tx=0x7f201c01ac90 comp rx=0 tx=0).stop 2023-07-21T22:35:37.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.514+0000 7f203199f640 1 -- 172.21.15.6:0/1180210008 shutdown_connections 2023-07-21T22:35:37.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.514+0000 7f203199f640 1 --2- 172.21.15.6:0/1180210008 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f200c0663a0 0x7f200c068850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.514+0000 7f203199f640 1 --2- 172.21.15.6:0/1180210008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f202c0ae1f0 0x7f202c1403d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.514+0000 7f203199f640 1 --2- 172.21.15.6:0/1180210008 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f202c06e160 0x7f202c0ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.514+0000 7f203199f640 1 --2- 172.21.15.6:0/1180210008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f202c06c430 0x7f202c13d6a0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.514+0000 7f203199f640 1 -- 172.21.15.6:0/1180210008 >> 172.21.15.6:0/1180210008 conn(0x7f202c0b1300 msgr2=0x7f202c06bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.514+0000 7f203199f640 1 -- 172.21.15.6:0/1180210008 shutdown_connections 2023-07-21T22:35:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.514+0000 7f203199f640 1 -- 172.21.15.6:0/1180210008 wait complete. 2023-07-21T22:35:37.585 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:35:37.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:35:37.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.682+0000 7f3b7bc0b640 1 Processor -- start 2023-07-21T22:35:37.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.682+0000 7f3b7bc0b640 1 -- start start 2023-07-21T22:35:37.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.682+0000 7f3b7bc0b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3b740cf2e0 0x7f3b740cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:37.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.682+0000 7f3b7bc0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b740ca790 0x7f3b740cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:37.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.682+0000 7f3b7bc0b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b740d0920 con 0x7f3b7406a540 2023-07-21T22:35:37.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.682+0000 7f3b7bc0b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7415bfd0 con 0x7f3b740cf2e0 2023-07-21T22:35:37.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.682+0000 7f3b7bc0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b740cfd10 con 0x7f3b740ca790 2023-07-21T22:35:37.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.682+0000 7f3b791a6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3b740cf2e0 0x7f3b740cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:37.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.686+0000 7f3b791a6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3b740cf2e0 0x7f3b740cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48376/0 (socket says 172.21.15.6:48376) 2023-07-21T22:35:37.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.686+0000 7f3b791a6640 1 -- 172.21.15.6:0/902731693 learned_addr learned my addr 172.21.15.6:0/902731693 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:37.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.686+0000 7f3b7a1a8640 1 --2- 172.21.15.6:0/902731693 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b740ca790 0x7f3b740cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:37.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.686+0000 7f3b791a6640 1 -- 172.21.15.6:0/902731693 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b740ca790 msgr2=0x7f3b740cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:37.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.686+0000 7f3b791a6640 1 --2- 172.21.15.6:0/902731693 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b740ca790 0x7f3b740cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.686+0000 7f3b791a6640 1 -- 172.21.15.6:0/902731693 >> v1:172.21.15.161:6789/0 conn(0x7f3b7406a540 legacy=0x7f3b7406a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:37.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.686+0000 7f3b791a6640 1 -- 172.21.15.6:0/902731693 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b740cfff0 con 0x7f3b740cf2e0 2023-07-21T22:35:37.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.686+0000 7f3b791a6640 1 --2- 172.21.15.6:0/902731693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b740cf2e0 0x7f3b740cf710 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f3b64009870 tx=0x7f3b6401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd0d2c85a3db01 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:37.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.686+0000 7f3b789a5640 1 -- 172.21.15.6:0/902731693 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b640aa670 con 0x7f3b740cf2e0 2023-07-21T22:35:37.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.686+0000 7f3b789a5640 1 -- 172.21.15.6:0/902731693 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b640aa7d0 con 0x7f3b740cf2e0 2023-07-21T22:35:37.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.686+0000 7f3b789a5640 1 -- 172.21.15.6:0/902731693 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b640aab60 con 0x7f3b740cf2e0 2023-07-21T22:35:37.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7bc0b640 1 -- 172.21.15.6:0/902731693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b740cf2e0 msgr2=0x7f3b740cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:37.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7bc0b640 1 --2- 172.21.15.6:0/902731693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b740cf2e0 0x7f3b740cf710 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f3b64009870 tx=0x7f3b6401c510 comp rx=0 tx=0).stop 2023-07-21T22:35:37.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7bc0b640 1 -- 172.21.15.6:0/902731693 shutdown_connections 2023-07-21T22:35:37.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7bc0b640 1 --2- 172.21.15.6:0/902731693 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b740ca790 0x7f3b740cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7bc0b640 1 --2- 172.21.15.6:0/902731693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b740cf2e0 0x7f3b740cf710 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7bc0b640 1 -- 172.21.15.6:0/902731693 >> 172.21.15.6:0/902731693 conn(0x7f3b74099490 msgr2=0x7f3b74089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:37.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7bc0b640 1 -- 172.21.15.6:0/902731693 shutdown_connections 2023-07-21T22:35:37.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7bc0b640 1 -- 172.21.15.6:0/902731693 wait complete. 2023-07-21T22:35:37.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7bc0b640 1 Processor -- start 2023-07-21T22:35:37.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7bc0b640 1 -- start start 2023-07-21T22:35:37.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7bc0b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b7406a540 0x7f3b740b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:37.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7bc0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b740ca790 0x7f3b7415a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:37.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7bc0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b740cf2e0 0x7f3b7406e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:37.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7bc0b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7414bed0 con 0x7f3b740cf2e0 2023-07-21T22:35:37.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7bc0b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7415b380 con 0x7f3b7406a540 2023-07-21T22:35:37.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7bc0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b740af490 con 0x7f3b740ca790 2023-07-21T22:35:37.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7a1a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b740cf2e0 0x7f3b7406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:37.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7a1a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b740cf2e0 0x7f3b7406e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48380/0 (socket says 172.21.15.6:48380) 2023-07-21T22:35:37.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7a1a8640 1 -- 172.21.15.6:0/4029426845 learned_addr learned my addr 172.21.15.6:0/4029426845 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:37.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b791a6640 1 --2- 172.21.15.6:0/4029426845 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b740ca790 0x7f3b7415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:37.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b799a7640 1 --2- 172.21.15.6:0/4029426845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b7406a540 0x7f3b740b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:37.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7a1a8640 1 -- 172.21.15.6:0/4029426845 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b740ca790 msgr2=0x7f3b7415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:37.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7a1a8640 1 --2- 172.21.15.6:0/4029426845 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b740ca790 0x7f3b7415a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7a1a8640 1 -- 172.21.15.6:0/4029426845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b7406a540 msgr2=0x7f3b740b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:37.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7a1a8640 1 --2- 172.21.15.6:0/4029426845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b7406a540 0x7f3b740b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.690+0000 7f3b7a1a8640 1 -- 172.21.15.6:0/4029426845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b640094d0 con 0x7f3b740cf2e0 2023-07-21T22:35:37.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.694+0000 7f3b7a1a8640 1 --2- 172.21.15.6:0/4029426845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b740cf2e0 0x7f3b7406e560 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c007e40 tx=0x7f3b6c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:37.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.694+0000 7f3b6a7fc640 1 -- 172.21.15.6:0/4029426845 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c014620 con 0x7f3b740cf2e0 2023-07-21T22:35:37.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.694+0000 7f3b6a7fc640 1 -- 172.21.15.6:0/4029426845 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c00ee90 con 0x7f3b740cf2e0 2023-07-21T22:35:37.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.694+0000 7f3b6a7fc640 1 -- 172.21.15.6:0/4029426845 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c0149e0 con 0x7f3b740cf2e0 2023-07-21T22:35:37.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.694+0000 7f3b7bc0b640 1 -- 172.21.15.6:0/4029426845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7415aae0 con 0x7f3b740cf2e0 2023-07-21T22:35:37.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.694+0000 7f3b7bc0b640 1 -- 172.21.15.6:0/4029426845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7415b0a0 con 0x7f3b740cf2e0 2023-07-21T22:35:37.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.694+0000 7f3b7bc0b640 1 -- 172.21.15.6:0/4029426845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b740678d0 con 0x7f3b740cf2e0 2023-07-21T22:35:37.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.694+0000 7f3b6a7fc640 1 -- 172.21.15.6:0/4029426845 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3b6c014b40 con 0x7f3b740cf2e0 2023-07-21T22:35:37.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.694+0000 7f3b6a7fc640 1 --2- 172.21.15.6:0/4029426845 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f3b580663d0 0x7f3b58068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:37.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.694+0000 7f3b6a7fc640 1 -- 172.21.15.6:0/4029426845 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5254+0+0 (secure 0 0 0) 0x7f3b6c0842a0 con 0x7f3b740cf2e0 2023-07-21T22:35:37.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.694+0000 7f3b799a7640 1 --2- 172.21.15.6:0/4029426845 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f3b580663d0 0x7f3b58068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:37.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.698+0000 7f3b799a7640 1 --2- 172.21.15.6:0/4029426845 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f3b580663d0 0x7f3b58068880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3b70007fd0 tx=0x7f3b70009040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:37.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.698+0000 7f3b6a7fc640 1 -- 172.21.15.6:0/4029426845 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3b6c051a70 con 0x7f3b740cf2e0 2023-07-21T22:35:37.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.854+0000 7f3b7bc0b640 1 -- 172.21.15.6:0/4029426845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b7414eb30 con 0x7f3b740cf2e0 2023-07-21T22:35:37.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.854+0000 7f3b6a7fc640 1 -- 172.21.15.6:0/4029426845 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v108) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b6c055090 con 0x7f3b740cf2e0 2023-07-21T22:35:37.906 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:35:37.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.858+0000 7f3b7bc0b640 1 -- 172.21.15.6:0/4029426845 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f3b580663d0 msgr2=0x7f3b58068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:37.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.858+0000 7f3b7bc0b640 1 --2- 172.21.15.6:0/4029426845 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f3b580663d0 0x7f3b58068880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3b70007fd0 tx=0x7f3b70009040 comp rx=0 tx=0).stop 2023-07-21T22:35:37.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.858+0000 7f3b7bc0b640 1 -- 172.21.15.6:0/4029426845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b740cf2e0 msgr2=0x7f3b7406e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:37.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.858+0000 7f3b7bc0b640 1 --2- 172.21.15.6:0/4029426845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b740cf2e0 0x7f3b7406e560 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c007e40 tx=0x7f3b6c00e4b0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.858+0000 7f3b7bc0b640 1 -- 172.21.15.6:0/4029426845 shutdown_connections 2023-07-21T22:35:37.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.858+0000 7f3b7bc0b640 1 --2- 172.21.15.6:0/4029426845 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f3b580663d0 0x7f3b58068880 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.858+0000 7f3b7bc0b640 1 --2- 172.21.15.6:0/4029426845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b740cf2e0 0x7f3b7406e560 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.858+0000 7f3b7bc0b640 1 --2- 172.21.15.6:0/4029426845 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3b740ca790 0x7f3b7415a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.858+0000 7f3b7bc0b640 1 --2- 172.21.15.6:0/4029426845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3b7406a540 0x7f3b740b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:37.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.858+0000 7f3b7bc0b640 1 -- 172.21.15.6:0/4029426845 >> 172.21.15.6:0/4029426845 conn(0x7f3b74099490 msgr2=0x7f3b740cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:37.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.858+0000 7f3b7bc0b640 1 -- 172.21.15.6:0/4029426845 shutdown_connections 2023-07-21T22:35:37.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:37.858+0000 7f3b7bc0b640 1 -- 172.21.15.6:0/4029426845 wait complete. 2023-07-21T22:35:37.927 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:35:38.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.022+0000 7fdead26d640 1 Processor -- start 2023-07-21T22:35:38.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.022+0000 7fdead26d640 1 -- start start 2023-07-21T22:35:38.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.026+0000 7fdead26d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdea8145540 0x7fdea80cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:38.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.026+0000 7fdead26d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdea80ccd20 0x7fdea80d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:38.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.026+0000 7fdead26d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea80cd1a0 con 0x7fdea80d06e0 2023-07-21T22:35:38.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.026+0000 7fdead26d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea80d0f10 con 0x7fdea80ccd20 2023-07-21T22:35:38.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.026+0000 7fdead26d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea80d11f0 con 0x7fdea8145540 2023-07-21T22:35:38.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.026+0000 7fde9ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdea80ccd20 0x7fdea80d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:38.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.026+0000 7fde9ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdea80ccd20 0x7fdea80d01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48394/0 (socket says 172.21.15.6:48394) 2023-07-21T22:35:38.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.026+0000 7fde9ffff640 1 -- 172.21.15.6:0/2847777268 learned_addr learned my addr 172.21.15.6:0/2847777268 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:38.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.026+0000 7fdea6ffd640 1 --2- 172.21.15.6:0/2847777268 >> v2:172.21.15.161:3300/0 conn(0x7fdea8145540 0x7fdea80cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:38.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.026+0000 7fde9ffff640 1 -- 172.21.15.6:0/2847777268 >> v2:172.21.15.161:3300/0 conn(0x7fdea8145540 msgr2=0x7fdea80cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:38.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.026+0000 7fde9ffff640 1 --2- 172.21.15.6:0/2847777268 >> v2:172.21.15.161:3300/0 conn(0x7fdea8145540 0x7fdea80cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:38.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.026+0000 7fde9ffff640 1 -- 172.21.15.6:0/2847777268 >> v1:172.21.15.6:6789/0 conn(0x7fdea80d06e0 legacy=0x7fdea80b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:38.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.026+0000 7fde9ffff640 1 -- 172.21.15.6:0/2847777268 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea80d14d0 con 0x7fdea80ccd20 2023-07-21T22:35:38.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.030+0000 7fde9ffff640 1 --2- 172.21.15.6:0/2847777268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea80ccd20 0x7fdea80d01a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fdea80b4db0 tx=0x7fde9001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8811e00cfad3c1e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:38.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.030+0000 7fdea67fc640 1 -- 172.21.15.6:0/2847777268 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde900aa430 con 0x7fdea80ccd20 2023-07-21T22:35:38.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.030+0000 7fdea67fc640 1 -- 172.21.15.6:0/2847777268 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde900aa590 con 0x7fdea80ccd20 2023-07-21T22:35:38.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.030+0000 7fdea67fc640 1 -- 172.21.15.6:0/2847777268 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde900aa920 con 0x7fdea80ccd20 2023-07-21T22:35:38.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.030+0000 7fdead26d640 1 -- 172.21.15.6:0/2847777268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea80ccd20 msgr2=0x7fdea80d01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:38.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.030+0000 7fdead26d640 1 --2- 172.21.15.6:0/2847777268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea80ccd20 0x7fdea80d01a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fdea80b4db0 tx=0x7fde9001c4d0 comp rx=0 tx=0).stop 2023-07-21T22:35:38.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.030+0000 7fdead26d640 1 -- 172.21.15.6:0/2847777268 shutdown_connections 2023-07-21T22:35:38.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.030+0000 7fdead26d640 1 --2- 172.21.15.6:0/2847777268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea80ccd20 0x7fdea80d01a0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:38.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.030+0000 7fdead26d640 1 --2- 172.21.15.6:0/2847777268 >> v2:172.21.15.161:3300/0 conn(0x7fdea8145540 0x7fdea80cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:38.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.030+0000 7fdead26d640 1 -- 172.21.15.6:0/2847777268 >> 172.21.15.6:0/2847777268 conn(0x7fdea80d2220 msgr2=0x7fdea80d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:38.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.030+0000 7fdead26d640 1 -- 172.21.15.6:0/2847777268 shutdown_connections 2023-07-21T22:35:38.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.030+0000 7fdead26d640 1 -- 172.21.15.6:0/2847777268 wait complete. 2023-07-21T22:35:38.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.030+0000 7fdead26d640 1 Processor -- start 2023-07-21T22:35:38.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.030+0000 7fdead26d640 1 -- start start 2023-07-21T22:35:38.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.030+0000 7fdead26d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdea80ccd20 0x7fdea8153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:38.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.030+0000 7fdead26d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdea80d06e0 0x7fdea81539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:38.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.030+0000 7fdead26d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea8145540 0x7fdea80c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:38.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.030+0000 7fdead26d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea8153ee0 con 0x7fdea8145540 2023-07-21T22:35:38.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.030+0000 7fdead26d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea8158440 con 0x7fdea80d06e0 2023-07-21T22:35:38.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.030+0000 7fdead26d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea80c8760 con 0x7fdea80ccd20 2023-07-21T22:35:38.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.034+0000 7fdea77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea8145540 0x7fdea80c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:38.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.034+0000 7fdea77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea8145540 0x7fdea80c66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48406/0 (socket says 172.21.15.6:48406) 2023-07-21T22:35:38.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.034+0000 7fdea77fe640 1 -- 172.21.15.6:0/2960936133 learned_addr learned my addr 172.21.15.6:0/2960936133 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:38.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.034+0000 7fde9ffff640 1 --2- 172.21.15.6:0/2960936133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdea80d06e0 0x7fdea81539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:38.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.034+0000 7fdea6ffd640 1 --2- 172.21.15.6:0/2960936133 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdea80ccd20 0x7fdea8153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:38.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.034+0000 7fdea77fe640 1 -- 172.21.15.6:0/2960936133 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdea80ccd20 msgr2=0x7fdea8153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:38.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.034+0000 7fdea77fe640 1 --2- 172.21.15.6:0/2960936133 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdea80ccd20 0x7fdea8153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.034+0000 7fdea77fe640 1 -- 172.21.15.6:0/2960936133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdea80d06e0 msgr2=0x7fdea81539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.034+0000 7fdea77fe640 1 --2- 172.21.15.6:0/2960936133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdea80d06e0 0x7fdea81539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.034+0000 7fdea77fe640 1 -- 172.21.15.6:0/2960936133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde900094d0 con 0x7fdea8145540 2023-07-21T22:35:38.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.034+0000 7fdea77fe640 1 --2- 172.21.15.6:0/2960936133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea8145540 0x7fdea80c66d0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fdea000c7a0 tx=0x7fdea000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.034+0000 7fde9f7fe640 1 -- 172.21.15.6:0/2960936133 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea0003b80 con 0x7fdea8145540 2023-07-21T22:35:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.034+0000 7fde9f7fe640 1 -- 172.21.15.6:0/2960936133 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea0003ce0 con 0x7fdea8145540 2023-07-21T22:35:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.034+0000 7fde9f7fe640 1 -- 172.21.15.6:0/2960936133 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea000aa90 con 0x7fdea8145540 2023-07-21T22:35:38.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.034+0000 7fdead26d640 1 -- 172.21.15.6:0/2960936133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea8155940 con 0x7fdea8145540 2023-07-21T22:35:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.034+0000 7fdead26d640 1 -- 172.21.15.6:0/2960936133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea80c8d00 con 0x7fdea8145540 2023-07-21T22:35:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.034+0000 7fdead26d640 1 -- 172.21.15.6:0/2960936133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea80c9c70 con 0x7fdea8145540 2023-07-21T22:35:38.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.034+0000 7fde9f7fe640 1 -- 172.21.15.6:0/2960936133 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdea000abf0 con 0x7fdea8145540 2023-07-21T22:35:38.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.038+0000 7fde9f7fe640 1 --2- 172.21.15.6:0/2960936133 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fde880663a0 0x7fde88068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:38.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.038+0000 7fde9f7fe640 1 -- 172.21.15.6:0/2960936133 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5254+0+0 (secure 0 0 0) 0x7fdea0083800 con 0x7fdea8145540 2023-07-21T22:35:38.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.038+0000 7fdea6ffd640 1 --2- 172.21.15.6:0/2960936133 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fde880663a0 0x7fde88068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:38.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.038+0000 7fdea6ffd640 1 --2- 172.21.15.6:0/2960936133 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fde880663a0 0x7fde88068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fde980079c0 tx=0x7fde98008040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:38.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.042+0000 7fde9f7fe640 1 -- 172.21.15.6:0/2960936133 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdea80c9c70 con 0x7fdea8145540 2023-07-21T22:35:38.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.198+0000 7fdead26d640 1 -- 172.21.15.6:0/2960936133 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdea80c9c70 con 0x7fdea8145540 2023-07-21T22:35:38.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.198+0000 7fde9f7fe640 1 -- 172.21.15.6:0/2960936133 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v108) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdea80c9c70 con 0x7fdea8145540 2023-07-21T22:35:38.249 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:35:38.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.198+0000 7fdead26d640 1 -- 172.21.15.6:0/2960936133 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fde880663a0 msgr2=0x7fde88068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:38.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.198+0000 7fdead26d640 1 --2- 172.21.15.6:0/2960936133 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fde880663a0 0x7fde88068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fde980079c0 tx=0x7fde98008040 comp rx=0 tx=0).stop 2023-07-21T22:35:38.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.198+0000 7fdead26d640 1 -- 172.21.15.6:0/2960936133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea8145540 msgr2=0x7fdea80c66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:38.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.202+0000 7fdead26d640 1 --2- 172.21.15.6:0/2960936133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea8145540 0x7fdea80c66d0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fdea000c7a0 tx=0x7fdea000cc60 comp rx=0 tx=0).stop 2023-07-21T22:35:38.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.202+0000 7fdead26d640 1 -- 172.21.15.6:0/2960936133 shutdown_connections 2023-07-21T22:35:38.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.202+0000 7fdead26d640 1 --2- 172.21.15.6:0/2960936133 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fde880663a0 0x7fde88068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:38.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.202+0000 7fdead26d640 1 --2- 172.21.15.6:0/2960936133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdea8145540 0x7fdea80c66d0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:38.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.202+0000 7fdead26d640 1 --2- 172.21.15.6:0/2960936133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdea80d06e0 0x7fdea81539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:38.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.202+0000 7fdead26d640 1 --2- 172.21.15.6:0/2960936133 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdea80ccd20 0x7fdea8153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:38.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.202+0000 7fdead26d640 1 -- 172.21.15.6:0/2960936133 >> 172.21.15.6:0/2960936133 conn(0x7fdea80d2220 msgr2=0x7fdea80d25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:38.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.202+0000 7fdead26d640 1 -- 172.21.15.6:0/2960936133 shutdown_connections 2023-07-21T22:35:38.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.202+0000 7fdead26d640 1 -- 172.21.15.6:0/2960936133 wait complete. 2023-07-21T22:35:38.270 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T22:35:38.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.362+0000 7fddaf1fa640 1 Processor -- start 2023-07-21T22:35:38.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.362+0000 7fddaf1fa640 1 -- start start 2023-07-21T22:35:38.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.366+0000 7fddaf1fa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdda815bdf0 0x7fdda80ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:38.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.366+0000 7fddaf1fa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda806c000 con 0x7fdda815f970 2023-07-21T22:35:38.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.366+0000 7fddaf1fa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda80cb2e0 con 0x7fdda80c9e80 2023-07-21T22:35:38.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.366+0000 7fddaf1fa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda80cb5c0 con 0x7fdda815bdf0 2023-07-21T22:35:38.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.366+0000 7fddacf96640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdda815bdf0 0x7fdda80ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:38.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.366+0000 7fddacf96640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdda815bdf0 0x7fdda80ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48410/0 (socket says 172.21.15.6:48410) 2023-07-21T22:35:38.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.366+0000 7fddacf96640 1 -- 172.21.15.6:0/3389728617 learned_addr learned my addr 172.21.15.6:0/3389728617 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:38.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.366+0000 7fddacf96640 1 -- 172.21.15.6:0/3389728617 >> v1:172.21.15.161:6789/0 conn(0x7fdda80c9e80 legacy=0x7fdda806b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:38.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.366+0000 7fddacf96640 1 -- 172.21.15.6:0/3389728617 >> v1:172.21.15.6:6789/0 conn(0x7fdda815f970 legacy=0x7fdda806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:38.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.366+0000 7fddacf96640 1 -- 172.21.15.6:0/3389728617 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda80cb8a0 con 0x7fdda815bdf0 2023-07-21T22:35:38.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.366+0000 7fddacf96640 1 --2- 172.21.15.6:0/3389728617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdda815bdf0 0x7fdda80ca970 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c009870 tx=0x7fdd9c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b780f5c2890c5b24 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:38.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.366+0000 7fdda77fe640 1 -- 172.21.15.6:0/3389728617 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c0ab660 con 0x7fdda815bdf0 2023-07-21T22:35:38.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fdda77fe640 1 -- 172.21.15.6:0/3389728617 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9c0ab7c0 con 0x7fdda815bdf0 2023-07-21T22:35:38.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fdda77fe640 1 -- 172.21.15.6:0/3389728617 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c0abb50 con 0x7fdda815bdf0 2023-07-21T22:35:38.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fddaf1fa640 1 -- 172.21.15.6:0/3389728617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdda815bdf0 msgr2=0x7fdda80ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:38.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fddaf1fa640 1 --2- 172.21.15.6:0/3389728617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdda815bdf0 0x7fdda80ca970 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c009870 tx=0x7fdd9c01c440 comp rx=0 tx=0).stop 2023-07-21T22:35:38.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fddaf1fa640 1 -- 172.21.15.6:0/3389728617 shutdown_connections 2023-07-21T22:35:38.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fddaf1fa640 1 --2- 172.21.15.6:0/3389728617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdda815bdf0 0x7fdda80ca970 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:38.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fddaf1fa640 1 -- 172.21.15.6:0/3389728617 >> 172.21.15.6:0/3389728617 conn(0x7fdda80afcf0 msgr2=0x7fdda80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:38.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fddaf1fa640 1 -- 172.21.15.6:0/3389728617 shutdown_connections 2023-07-21T22:35:38.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fddaf1fa640 1 -- 172.21.15.6:0/3389728617 wait complete. 2023-07-21T22:35:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fddaf1fa640 1 Processor -- start 2023-07-21T22:35:38.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fddaf1fa640 1 -- start start 2023-07-21T22:35:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fddaf1fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdda815bdf0 0x7fdda815c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:38.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fddaf1fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdda815f970 0x7fdda814a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:38.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fddaf1fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdda80c5230 0x7fdda80c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:38.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fddaf1fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda814a6a0 con 0x7fdda815bdf0 2023-07-21T22:35:38.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fddaf1fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda80c5cf0 con 0x7fdda815f970 2023-07-21T22:35:38.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fddaf1fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda80c5fd0 con 0x7fdda80c5230 2023-07-21T22:35:38.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fddacf96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdda815bdf0 0x7fdda815c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:38.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fddacf96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdda815bdf0 0x7fdda815c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48418/0 (socket says 172.21.15.6:48418) 2023-07-21T22:35:38.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fddacf96640 1 -- 172.21.15.6:0/3677188286 learned_addr learned my addr 172.21.15.6:0/3677188286 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:38.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fddad797640 1 --2- 172.21.15.6:0/3677188286 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdda80c5230 0x7fdda80c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:38.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fdda7fff640 1 --2- 172.21.15.6:0/3677188286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdda815f970 0x7fdda814a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:38.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.370+0000 7fddacf96640 1 -- 172.21.15.6:0/3677188286 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdda80c5230 msgr2=0x7fdda80c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:38.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.374+0000 7fddacf96640 1 --2- 172.21.15.6:0/3677188286 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdda80c5230 0x7fdda80c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:38.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.374+0000 7fddacf96640 1 -- 172.21.15.6:0/3677188286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdda815f970 msgr2=0x7fdda814a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:38.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.374+0000 7fddacf96640 1 --2- 172.21.15.6:0/3677188286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdda815f970 0x7fdda814a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:38.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.374+0000 7fddacf96640 1 -- 172.21.15.6:0/3677188286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c0094d0 con 0x7fdda815bdf0 2023-07-21T22:35:38.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.374+0000 7fdda7fff640 1 --2- 172.21.15.6:0/3677188286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdda815f970 0x7fdda814a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:38.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.374+0000 7fddacf96640 1 --2- 172.21.15.6:0/3677188286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdda815bdf0 0x7fdda815c4a0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0ad040 tx=0x7fdd9c01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:38.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.374+0000 7fdda57fa640 1 -- 172.21.15.6:0/3677188286 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c0b48c0 con 0x7fdda815bdf0 2023-07-21T22:35:38.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.374+0000 7fdda57fa640 1 -- 172.21.15.6:0/3677188286 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9c0b4a40 con 0x7fdda815bdf0 2023-07-21T22:35:38.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.374+0000 7fdda57fa640 1 -- 172.21.15.6:0/3677188286 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c0b4df0 con 0x7fdda815bdf0 2023-07-21T22:35:38.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.374+0000 7fddaf1fa640 1 -- 172.21.15.6:0/3677188286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda8151420 con 0x7fdda815bdf0 2023-07-21T22:35:38.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.374+0000 7fddaf1fa640 1 -- 172.21.15.6:0/3677188286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda81519e0 con 0x7fdda815bdf0 2023-07-21T22:35:38.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.374+0000 7fddaf1fa640 1 -- 172.21.15.6:0/3677188286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda80678d0 con 0x7fdda815bdf0 2023-07-21T22:35:38.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.374+0000 7fdda57fa640 1 -- 172.21.15.6:0/3677188286 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdd9c0a9070 con 0x7fdda815bdf0 2023-07-21T22:35:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.374+0000 7fdda57fa640 1 --2- 172.21.15.6:0/3677188286 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fdd8c0663a0 0x7fdd8c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.374+0000 7fdda57fa640 1 -- 172.21.15.6:0/3677188286 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5254+0+0 (secure 0 0 0) 0x7fdd9c11e350 con 0x7fdda815bdf0 2023-07-21T22:35:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.374+0000 7fdda7fff640 1 --2- 172.21.15.6:0/3677188286 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fdd8c0663a0 0x7fdd8c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:38.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.378+0000 7fdda7fff640 1 --2- 172.21.15.6:0/3677188286 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fdd8c0663a0 0x7fdd8c068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdda80c5190 tx=0x7fdd94009040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:38.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.378+0000 7fdda57fa640 1 -- 172.21.15.6:0/3677188286 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdd9c0eba00 con 0x7fdda815bdf0 2023-07-21T22:35:38.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.538+0000 7fddaf1fa640 1 -- 172.21.15.6:0/3677188286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdda806c380 con 0x7fdda815bdf0 2023-07-21T22:35:38.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.538+0000 7fdda57fa640 1 -- 172.21.15.6:0/3677188286 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v108) v1 ==== 84+0+126 (secure 0 0 0) 0x7fdd9c0ef020 con 0x7fdda815bdf0 2023-07-21T22:35:38.590 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:38.591 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:35:38.591 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:38.591 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-07-21T22:35:38.591 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-07-21T22:35:38.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:35:38.592 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:38.592 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-07-21T22:35:38.592 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-07-21T22:35:38.592 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:38.593 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:35:38.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.542+0000 7fddaf1fa640 1 -- 172.21.15.6:0/3677188286 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fdd8c0663a0 msgr2=0x7fdd8c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:38.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.542+0000 7fddaf1fa640 1 --2- 172.21.15.6:0/3677188286 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fdd8c0663a0 0x7fdd8c068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdda80c5190 tx=0x7fdd94009040 comp rx=0 tx=0).stop 2023-07-21T22:35:38.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.542+0000 7fddaf1fa640 1 -- 172.21.15.6:0/3677188286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdda815bdf0 msgr2=0x7fdda815c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:38.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.542+0000 7fddaf1fa640 1 --2- 172.21.15.6:0/3677188286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdda815bdf0 0x7fdda815c4a0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0ad040 tx=0x7fdd9c01ac80 comp rx=0 tx=0).stop 2023-07-21T22:35:38.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.542+0000 7fddaf1fa640 1 -- 172.21.15.6:0/3677188286 shutdown_connections 2023-07-21T22:35:38.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.542+0000 7fddaf1fa640 1 --2- 172.21.15.6:0/3677188286 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fdd8c0663a0 0x7fdd8c068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:38.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.542+0000 7fddaf1fa640 1 --2- 172.21.15.6:0/3677188286 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdda80c5230 0x7fdda80c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:38.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.542+0000 7fddaf1fa640 1 --2- 172.21.15.6:0/3677188286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdda815f970 0x7fdda814a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:38.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.542+0000 7fddaf1fa640 1 --2- 172.21.15.6:0/3677188286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdda815bdf0 0x7fdda815c4a0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:38.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.542+0000 7fddaf1fa640 1 -- 172.21.15.6:0/3677188286 >> 172.21.15.6:0/3677188286 conn(0x7fdda80afcf0 msgr2=0x7fdda80adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:38.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.542+0000 7fddaf1fa640 1 -- 172.21.15.6:0/3677188286 shutdown_connections 2023-07-21T22:35:38.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.542+0000 7fddaf1fa640 1 -- 172.21.15.6:0/3677188286 wait complete. 2023-07-21T22:35:38.611 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-21T22:35:38.612 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-21T22:35:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.710+0000 7f67cbb11640 1 Processor -- start 2023-07-21T22:35:38.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.710+0000 7f67cbb11640 1 -- start start 2023-07-21T22:35:38.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.710+0000 7f67cbb11640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67c40af2b0 0x7f67c40c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:38.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.710+0000 7f67cbb11640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c40695b0 con 0x7f67c40cd120 2023-07-21T22:35:38.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.710+0000 7f67cbb11640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c4069890 con 0x7f67c40c3ac0 2023-07-21T22:35:38.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.710+0000 7f67cbb11640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c4069b70 con 0x7f67c40af2b0 2023-07-21T22:35:38.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.710+0000 7f67c90ac640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67c40af2b0 0x7f67c40c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:38.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.710+0000 7f67c90ac640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67c40af2b0 0x7f67c40c2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48432/0 (socket says 172.21.15.6:48432) 2023-07-21T22:35:38.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.710+0000 7f67c90ac640 1 -- 172.21.15.6:0/3050147790 learned_addr learned my addr 172.21.15.6:0/3050147790 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:38.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.710+0000 7f67c90ac640 1 -- 172.21.15.6:0/3050147790 >> v1:172.21.15.161:6789/0 conn(0x7f67c40c3ac0 legacy=0x7f67c40ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:38.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.710+0000 7f67c90ac640 1 -- 172.21.15.6:0/3050147790 >> v1:172.21.15.6:6789/0 conn(0x7f67c40cd120 legacy=0x7f67c40cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:38.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.710+0000 7f67c90ac640 1 -- 172.21.15.6:0/3050147790 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c4069e50 con 0x7f67c40af2b0 2023-07-21T22:35:38.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.714+0000 7f67c90ac640 1 --2- 172.21.15.6:0/3050147790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c40af2b0 0x7f67c40c2d30 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f67b4009870 tx=0x7f67b401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2e83a752d219a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:38.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.714+0000 7f67c88ab640 1 -- 172.21.15.6:0/3050147790 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b40aa680 con 0x7f67c40af2b0 2023-07-21T22:35:38.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.714+0000 7f67c88ab640 1 -- 172.21.15.6:0/3050147790 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b40aa7e0 con 0x7f67c40af2b0 2023-07-21T22:35:38.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.714+0000 7f67c88ab640 1 -- 172.21.15.6:0/3050147790 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b40aab70 con 0x7f67c40af2b0 2023-07-21T22:35:38.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.714+0000 7f67cbb11640 1 -- 172.21.15.6:0/3050147790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c40af2b0 msgr2=0x7f67c40c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:38.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.714+0000 7f67cbb11640 1 --2- 172.21.15.6:0/3050147790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c40af2b0 0x7f67c40c2d30 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f67b4009870 tx=0x7f67b401c500 comp rx=0 tx=0).stop 2023-07-21T22:35:38.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.714+0000 7f67cbb11640 1 -- 172.21.15.6:0/3050147790 shutdown_connections 2023-07-21T22:35:38.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.714+0000 7f67cbb11640 1 --2- 172.21.15.6:0/3050147790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c40af2b0 0x7f67c40c2d30 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:38.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.714+0000 7f67cbb11640 1 -- 172.21.15.6:0/3050147790 >> 172.21.15.6:0/3050147790 conn(0x7f67c40cde90 msgr2=0x7f67c40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:38.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.714+0000 7f67cbb11640 1 -- 172.21.15.6:0/3050147790 shutdown_connections 2023-07-21T22:35:38.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.714+0000 7f67cbb11640 1 -- 172.21.15.6:0/3050147790 wait complete. 2023-07-21T22:35:38.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67cbb11640 1 Processor -- start 2023-07-21T22:35:38.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67cbb11640 1 -- start start 2023-07-21T22:35:38.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67cbb11640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c40af2b0 0x7f67c4145130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67cbb11640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67c40c3ac0 0x7f67c40b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67cbb11640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f67c40cd120 0x7f67c4159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67cbb11640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c40c5d40 con 0x7f67c40af2b0 2023-07-21T22:35:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67cbb11640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c41f8080 con 0x7f67c40c3ac0 2023-07-21T22:35:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67cbb11640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c40c5100 con 0x7f67c40cd120 2023-07-21T22:35:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67c98ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c40af2b0 0x7f67c4145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67c98ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c40af2b0 0x7f67c4145130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48440/0 (socket says 172.21.15.6:48440) 2023-07-21T22:35:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67c98ad640 1 -- 172.21.15.6:0/3399460735 learned_addr learned my addr 172.21.15.6:0/3399460735 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67c90ac640 1 --2- 172.21.15.6:0/3399460735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67c40c3ac0 0x7f67c40b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67ca0ae640 1 --2- 172.21.15.6:0/3399460735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f67c40cd120 0x7f67c4159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:38.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67c98ad640 1 -- 172.21.15.6:0/3399460735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f67c40cd120 msgr2=0x7f67c4159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:38.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67c98ad640 1 --2- 172.21.15.6:0/3399460735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f67c40cd120 0x7f67c4159d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:38.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67c98ad640 1 -- 172.21.15.6:0/3399460735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67c40c3ac0 msgr2=0x7f67c40b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:38.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67c98ad640 1 --2- 172.21.15.6:0/3399460735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67c40c3ac0 0x7f67c40b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:38.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67c98ad640 1 -- 172.21.15.6:0/3399460735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b40094d0 con 0x7f67c40af2b0 2023-07-21T22:35:38.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67ca0ae640 1 --2- 172.21.15.6:0/3399460735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f67c40cd120 0x7f67c4159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:38.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67c98ad640 1 --2- 172.21.15.6:0/3399460735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c40af2b0 0x7f67c4145130 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f67c000c480 tx=0x7f67c000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:38.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67ba7fc640 1 -- 172.21.15.6:0/3399460735 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c0012830 con 0x7f67c40af2b0 2023-07-21T22:35:38.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67ba7fc640 1 -- 172.21.15.6:0/3399460735 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c00129b0 con 0x7f67c40af2b0 2023-07-21T22:35:38.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67ba7fc640 1 -- 172.21.15.6:0/3399460735 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c0012d60 con 0x7f67c40af2b0 2023-07-21T22:35:38.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67cbb11640 1 -- 172.21.15.6:0/3399460735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c40c53a0 con 0x7f67c40af2b0 2023-07-21T22:35:38.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.718+0000 7f67cbb11640 1 -- 172.21.15.6:0/3399460735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c40c5960 con 0x7f67c40af2b0 2023-07-21T22:35:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.722+0000 7f67cbb11640 1 -- 172.21.15.6:0/3399460735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c40ae700 con 0x7f67c40af2b0 2023-07-21T22:35:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.722+0000 7f67ba7fc640 1 -- 172.21.15.6:0/3399460735 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f67c001c460 con 0x7f67c40af2b0 2023-07-21T22:35:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.722+0000 7f67ba7fc640 1 --2- 172.21.15.6:0/3399460735 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f67a80663a0 0x7f67a8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.722+0000 7f67ba7fc640 1 -- 172.21.15.6:0/3399460735 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5254+0+0 (secure 0 0 0) 0x7f67c00839a0 con 0x7f67c40af2b0 2023-07-21T22:35:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.722+0000 7f67c90ac640 1 --2- 172.21.15.6:0/3399460735 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f67a80663a0 0x7f67a8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.722+0000 7f67c90ac640 1 --2- 172.21.15.6:0/3399460735 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f67a80663a0 0x7f67a8068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f67b40ae000 tx=0x7f67b40b5040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.726+0000 7f67ba7fc640 1 -- 172.21.15.6:0/3399460735 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f67c0051020 con 0x7f67c40af2b0 2023-07-21T22:35:38.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:38.882+0000 7f67cbb11640 1 -- 172.21.15.6:0/3399460735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f67c40678d0 con 0x7f67c40af2b0 2023-07-21T22:35:39.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.402+0000 7f67ba7fc640 1 -- 172.21.15.6:0/3399460735 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v109) v1 ==== 138+0+0 (secure 0 0 0) 0x7f67c0054640 con 0x7f67c40af2b0 2023-07-21T22:35:39.453 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-07-21T22:35:39.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.406+0000 7f67cbb11640 1 -- 172.21.15.6:0/3399460735 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f67a80663a0 msgr2=0x7f67a8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:39.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.406+0000 7f67cbb11640 1 --2- 172.21.15.6:0/3399460735 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f67a80663a0 0x7f67a8068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f67b40ae000 tx=0x7f67b40b5040 comp rx=0 tx=0).stop 2023-07-21T22:35:39.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.406+0000 7f67cbb11640 1 -- 172.21.15.6:0/3399460735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c40af2b0 msgr2=0x7f67c4145130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:39.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.406+0000 7f67cbb11640 1 --2- 172.21.15.6:0/3399460735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c40af2b0 0x7f67c4145130 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f67c000c480 tx=0x7f67c000c940 comp rx=0 tx=0).stop 2023-07-21T22:35:39.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.406+0000 7f67cbb11640 1 -- 172.21.15.6:0/3399460735 shutdown_connections 2023-07-21T22:35:39.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.406+0000 7f67cbb11640 1 --2- 172.21.15.6:0/3399460735 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f67a80663a0 0x7f67a8068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:39.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.406+0000 7f67cbb11640 1 --2- 172.21.15.6:0/3399460735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f67c40cd120 0x7f67c4159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:39.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.406+0000 7f67cbb11640 1 --2- 172.21.15.6:0/3399460735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67c40c3ac0 0x7f67c40b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:39.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.406+0000 7f67cbb11640 1 --2- 172.21.15.6:0/3399460735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c40af2b0 0x7f67c4145130 secure :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f67c000c480 tx=0x7f67c000c940 comp rx=0 tx=0).stop 2023-07-21T22:35:39.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.406+0000 7f67cbb11640 1 -- 172.21.15.6:0/3399460735 >> 172.21.15.6:0/3399460735 conn(0x7f67c40cde90 msgr2=0x7f67c406f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:39.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.406+0000 7f67cbb11640 1 -- 172.21.15.6:0/3399460735 shutdown_connections 2023-07-21T22:35:39.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.406+0000 7f67cbb11640 1 -- 172.21.15.6:0/3399460735 wait complete. 2023-07-21T22:35:39.479 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T22:35:39.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.582+0000 7f4b80967640 1 Processor -- start 2023-07-21T22:35:39.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.582+0000 7f4b80967640 1 -- start start 2023-07-21T22:35:39.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.582+0000 7f4b80967640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b7c158a40 0x7f4b7c0cb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:39.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.582+0000 7f4b80967640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b7c0cd670 0x7f4b7c06fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:39.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.582+0000 7f4b80967640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7c0c8e20 con 0x7f4b7c0c8940 2023-07-21T22:35:39.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.582+0000 7f4b80967640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7c0711b0 con 0x7f4b7c0cd670 2023-07-21T22:35:39.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.582+0000 7f4b80967640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c0c9100 con 0x7f4b7c158a40 2023-07-21T22:35:39.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.582+0000 7f4b7ad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b7c0cd670 0x7f4b7c06fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:39.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.582+0000 7f4b7ad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4b7c0cd670 0x7f4b7c06fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48442/0 (socket says 172.21.15.6:48442) 2023-07-21T22:35:39.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.582+0000 7f4b7ad9d640 1 -- 172.21.15.6:0/2188382691 learned_addr learned my addr 172.21.15.6:0/2188382691 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:39.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.582+0000 7f4b7a59c640 1 --2- 172.21.15.6:0/2188382691 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b7c158a40 0x7f4b7c0cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:39.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.582+0000 7f4b7ad9d640 1 -- 172.21.15.6:0/2188382691 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b7c158a40 msgr2=0x7f4b7c0cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:39.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.582+0000 7f4b7ad9d640 1 --2- 172.21.15.6:0/2188382691 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b7c158a40 0x7f4b7c0cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:39.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.582+0000 7f4b7ad9d640 1 -- 172.21.15.6:0/2188382691 >> v1:172.21.15.161:6789/0 conn(0x7f4b7c0c8940 legacy=0x7f4b7c0ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:39.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.582+0000 7f4b7ad9d640 1 -- 172.21.15.6:0/2188382691 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c0c93e0 con 0x7f4b7c0cd670 2023-07-21T22:35:39.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.586+0000 7f4b7ad9d640 1 --2- 172.21.15.6:0/2188382691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b7c0cd670 0x7f4b7c06fc00 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009e50 tx=0x7f4b7401ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901182d41b04ac9a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:39.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.586+0000 7f4b79d9b640 1 -- 172.21.15.6:0/2188382691 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b740a7ac0 con 0x7f4b7c0cd670 2023-07-21T22:35:39.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.586+0000 7f4b79d9b640 1 -- 172.21.15.6:0/2188382691 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b740a7c20 con 0x7f4b7c0cd670 2023-07-21T22:35:39.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.586+0000 7f4b79d9b640 1 -- 172.21.15.6:0/2188382691 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b740af3f0 con 0x7f4b7c0cd670 2023-07-21T22:35:39.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.586+0000 7f4b80967640 1 -- 172.21.15.6:0/2188382691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b7c0cd670 msgr2=0x7f4b7c06fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:39.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.586+0000 7f4b80967640 1 --2- 172.21.15.6:0/2188382691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b7c0cd670 0x7f4b7c06fc00 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f4b74009e50 tx=0x7f4b7401ebf0 comp rx=0 tx=0).stop 2023-07-21T22:35:39.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.586+0000 7f4b80967640 1 -- 172.21.15.6:0/2188382691 shutdown_connections 2023-07-21T22:35:39.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.586+0000 7f4b80967640 1 --2- 172.21.15.6:0/2188382691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b7c0cd670 0x7f4b7c06fc00 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:39.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.586+0000 7f4b80967640 1 --2- 172.21.15.6:0/2188382691 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b7c158a40 0x7f4b7c0cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:39.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.586+0000 7f4b80967640 1 -- 172.21.15.6:0/2188382691 >> 172.21.15.6:0/2188382691 conn(0x7f4b7c0afac0 msgr2=0x7f4b7c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:39.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.586+0000 7f4b80967640 1 -- 172.21.15.6:0/2188382691 shutdown_connections 2023-07-21T22:35:39.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.586+0000 7f4b80967640 1 -- 172.21.15.6:0/2188382691 wait complete. 2023-07-21T22:35:39.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b80967640 1 Processor -- start 2023-07-21T22:35:39.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b80967640 1 -- start start 2023-07-21T22:35:39.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b80967640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b7c0c8940 0x7f4b7c157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:39.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b80967640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b7c0cd670 0x7f4b7c14cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:39.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b80967640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b7c14dd70 0x7f4b7c14fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:39.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b80967640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c156ed0 con 0x7f4b7c0cd670 2023-07-21T22:35:39.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b80967640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c153950 con 0x7f4b7c0c8940 2023-07-21T22:35:39.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b80967640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c1570b0 con 0x7f4b7c14dd70 2023-07-21T22:35:39.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b73fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b7c0cd670 0x7f4b7c14cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:39.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b73fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b7c0cd670 0x7f4b7c14cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48452/0 (socket says 172.21.15.6:48452) 2023-07-21T22:35:39.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b73fff640 1 -- 172.21.15.6:0/3882388878 learned_addr learned my addr 172.21.15.6:0/3882388878 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:39.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b7ad9d640 1 --2- 172.21.15.6:0/3882388878 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b7c14dd70 0x7f4b7c14fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:39.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b7a59c640 1 --2- 172.21.15.6:0/3882388878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b7c0c8940 0x7f4b7c157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:39.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b73fff640 1 -- 172.21.15.6:0/3882388878 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b7c14dd70 msgr2=0x7f4b7c14fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:39.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b73fff640 1 --2- 172.21.15.6:0/3882388878 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b7c14dd70 0x7f4b7c14fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:39.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b73fff640 1 -- 172.21.15.6:0/3882388878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b7c0c8940 msgr2=0x7f4b7c157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:39.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b73fff640 1 --2- 172.21.15.6:0/3882388878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b7c0c8940 0x7f4b7c157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:39.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b73fff640 1 -- 172.21.15.6:0/3882388878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b74009b30 con 0x7f4b7c0cd670 2023-07-21T22:35:39.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b73fff640 1 --2- 172.21.15.6:0/3882388878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b7c0cd670 0x7f4b7c14cf80 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400c500 tx=0x7f4b6400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:39.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b72ffd640 1 -- 172.21.15.6:0/3882388878 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b640052d0 con 0x7f4b7c0cd670 2023-07-21T22:35:39.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b72ffd640 1 -- 172.21.15.6:0/3882388878 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b64005430 con 0x7f4b7c0cd670 2023-07-21T22:35:39.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b72ffd640 1 -- 172.21.15.6:0/3882388878 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b64012830 con 0x7f4b7c0cd670 2023-07-21T22:35:39.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b80967640 1 -- 172.21.15.6:0/3882388878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7c153670 con 0x7f4b7c0cd670 2023-07-21T22:35:39.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.590+0000 7f4b80967640 1 -- 172.21.15.6:0/3882388878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7c157630 con 0x7f4b7c0cd670 2023-07-21T22:35:39.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.594+0000 7f4b80967640 1 -- 172.21.15.6:0/3882388878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7c1582c0 con 0x7f4b7c0cd670 2023-07-21T22:35:39.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.594+0000 7f4b72ffd640 1 -- 172.21.15.6:0/3882388878 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4b64012990 con 0x7f4b7c0cd670 2023-07-21T22:35:39.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.594+0000 7f4b72ffd640 1 --2- 172.21.15.6:0/3882388878 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f4b5c0663a0 0x7f4b5c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:39.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.594+0000 7f4b72ffd640 1 -- 172.21.15.6:0/3882388878 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5624+0+0 (secure 0 0 0) 0x7f4b64083750 con 0x7f4b7c0cd670 2023-07-21T22:35:39.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.594+0000 7f4b7a59c640 1 --2- 172.21.15.6:0/3882388878 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f4b5c0663a0 0x7f4b5c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:39.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.594+0000 7f4b7a59c640 1 --2- 172.21.15.6:0/3882388878 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f4b5c0663a0 0x7f4b5c068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0079c0 tx=0x7f4b6c008040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:39.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.598+0000 7f4b72ffd640 1 -- 172.21.15.6:0/3882388878 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4b64050c90 con 0x7f4b7c0cd670 2023-07-21T22:35:39.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:39.754+0000 7f4b80967640 1 -- 172.21.15.6:0/3882388878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4b7c0678d0 con 0x7f4b7c0cd670 2023-07-21T22:35:40.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.410+0000 7f4b72ffd640 1 -- 172.21.15.6:0/3882388878 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v110) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4b640542b0 con 0x7f4b7c0cd670 2023-07-21T22:35:40.462 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-07-21T22:35:40.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.418+0000 7f4b80967640 1 -- 172.21.15.6:0/3882388878 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f4b5c0663a0 msgr2=0x7f4b5c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:40.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.418+0000 7f4b80967640 1 --2- 172.21.15.6:0/3882388878 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f4b5c0663a0 0x7f4b5c068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0079c0 tx=0x7f4b6c008040 comp rx=0 tx=0).stop 2023-07-21T22:35:40.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.418+0000 7f4b80967640 1 -- 172.21.15.6:0/3882388878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b7c0cd670 msgr2=0x7f4b7c14cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:40.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.418+0000 7f4b80967640 1 --2- 172.21.15.6:0/3882388878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b7c0cd670 0x7f4b7c14cf80 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400c500 tx=0x7f4b6400c9c0 comp rx=0 tx=0).stop 2023-07-21T22:35:40.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.422+0000 7f4b80967640 1 -- 172.21.15.6:0/3882388878 shutdown_connections 2023-07-21T22:35:40.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.422+0000 7f4b80967640 1 --2- 172.21.15.6:0/3882388878 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f4b5c0663a0 0x7f4b5c068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:40.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.422+0000 7f4b80967640 1 --2- 172.21.15.6:0/3882388878 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b7c14dd70 0x7f4b7c14fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:40.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.422+0000 7f4b80967640 1 --2- 172.21.15.6:0/3882388878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b7c0cd670 0x7f4b7c14cf80 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:40.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.422+0000 7f4b80967640 1 --2- 172.21.15.6:0/3882388878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b7c0c8940 0x7f4b7c157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:40.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.422+0000 7f4b80967640 1 -- 172.21.15.6:0/3882388878 >> 172.21.15.6:0/3882388878 conn(0x7f4b7c0afac0 msgr2=0x7f4b7c1516f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:40.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.426+0000 7f4b80967640 1 -- 172.21.15.6:0/3882388878 shutdown_connections 2023-07-21T22:35:40.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.426+0000 7f4b80967640 1 -- 172.21.15.6:0/3882388878 wait complete. 2023-07-21T22:35:40.505 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-21T22:35:40.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.602+0000 7f647871e640 1 Processor -- start 2023-07-21T22:35:40.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.602+0000 7f647871e640 1 -- start start 2023-07-21T22:35:40.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.602+0000 7f647871e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64700aeb40 0x7f647015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:40.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.602+0000 7f647871e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f64700aef10 0x7f6470158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:40.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.602+0000 7f647871e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64701532b0 con 0x7f6470159270 2023-07-21T22:35:40.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.602+0000 7f647871e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64700ca6f0 con 0x7f64700aef10 2023-07-21T22:35:40.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.602+0000 7f647871e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64701599d0 con 0x7f64700aeb40 2023-07-21T22:35:40.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.606+0000 7f6475cb9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f64700aef10 0x7f6470158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.606+0000 7f64764ba640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64700aeb40 0x7f647015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.606+0000 7f6475cb9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f64700aef10 0x7f6470158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35372/0 (socket says 172.21.15.6:35372) 2023-07-21T22:35:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.606+0000 7f64764ba640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64700aeb40 0x7f647015cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:51820/0 (socket says 172.21.15.6:51820) 2023-07-21T22:35:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.606+0000 7f6475cb9640 1 -- 172.21.15.6:0/326226012 learned_addr learned my addr 172.21.15.6:0/326226012 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.606+0000 7f6476cbb640 1 --1- 172.21.15.6:0/326226012 >> v1:172.21.15.161:6789/0 conn(0x7f6470159270 0x7f64700c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:38332/0 (socket says 172.21.15.6:38332) 2023-07-21T22:35:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.606+0000 7f6475cb9640 1 -- 172.21.15.6:0/326226012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64700aeb40 msgr2=0x7f647015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:40.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.606+0000 7f6475cb9640 1 --2- 172.21.15.6:0/326226012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64700aeb40 0x7f647015cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:40.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.606+0000 7f6475cb9640 1 -- 172.21.15.6:0/326226012 >> v1:172.21.15.161:6789/0 conn(0x7f6470159270 legacy=0x7f64700c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:40.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.606+0000 7f6475cb9640 1 -- 172.21.15.6:0/326226012 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6470159cb0 con 0x7f64700aef10 2023-07-21T22:35:40.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.606+0000 7f64764ba640 1 --2- 172.21.15.6:0/326226012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64700aeb40 0x7f647015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:40.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.606+0000 7f64754b8640 1 -- 172.21.15.6:0/326226012 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306966467 0 0) 0x7f64701532b0 con 0x7f6470159270 2023-07-21T22:35:40.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.606+0000 7f6475cb9640 1 --2- 172.21.15.6:0/326226012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64700aef10 0x7f6470158d30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6460009870 tx=0x7f646001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0f815ed7af0cc9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:40.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.606+0000 7f64754b8640 1 -- 172.21.15.6:0/326226012 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64600ab680 con 0x7f64700aef10 2023-07-21T22:35:40.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f64754b8640 1 -- 172.21.15.6:0/326226012 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64600ab7e0 con 0x7f64700aef10 2023-07-21T22:35:40.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f64754b8640 1 -- 172.21.15.6:0/326226012 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64600abb70 con 0x7f64700aef10 2023-07-21T22:35:40.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f647871e640 1 -- 172.21.15.6:0/326226012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64700aef10 msgr2=0x7f6470158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:40.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f647871e640 1 --2- 172.21.15.6:0/326226012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64700aef10 0x7f6470158d30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6460009870 tx=0x7f646001c480 comp rx=0 tx=0).stop 2023-07-21T22:35:40.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f647871e640 1 -- 172.21.15.6:0/326226012 shutdown_connections 2023-07-21T22:35:40.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f647871e640 1 --2- 172.21.15.6:0/326226012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64700aef10 0x7f6470158d30 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:40.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f647871e640 1 --2- 172.21.15.6:0/326226012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64700aeb40 0x7f647015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:40.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f647871e640 1 -- 172.21.15.6:0/326226012 >> 172.21.15.6:0/326226012 conn(0x7f64700cde90 msgr2=0x7f64700ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:40.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f647871e640 1 -- 172.21.15.6:0/326226012 shutdown_connections 2023-07-21T22:35:40.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f647871e640 1 -- 172.21.15.6:0/326226012 wait complete. 2023-07-21T22:35:40.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f647871e640 1 Processor -- start 2023-07-21T22:35:40.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f647871e640 1 -- start start 2023-07-21T22:35:40.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f647871e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64700aeb40 0x7f6470149960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:40.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f647871e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64700aef10 0x7f647014d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:40.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f647871e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6470159270 0x7f647014dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:40.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f647871e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647006f3b0 con 0x7f6470159270 2023-07-21T22:35:40.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f647871e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647006f690 con 0x7f64700aeb40 2023-07-21T22:35:40.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f647871e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647006f970 con 0x7f64700aef10 2023-07-21T22:35:40.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f6476cbb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6470159270 0x7f647014dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:40.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f6476cbb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6470159270 0x7f647014dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48462/0 (socket says 172.21.15.6:48462) 2023-07-21T22:35:40.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.610+0000 7f6476cbb640 1 -- 172.21.15.6:0/4270541265 learned_addr learned my addr 172.21.15.6:0/4270541265 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:40.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.614+0000 7f6475cb9640 1 --2- 172.21.15.6:0/4270541265 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64700aef10 0x7f647014d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:40.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.614+0000 7f64764ba640 1 --2- 172.21.15.6:0/4270541265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64700aeb40 0x7f6470149960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:40.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.614+0000 7f6476cbb640 1 -- 172.21.15.6:0/4270541265 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64700aef10 msgr2=0x7f647014d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:40.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.614+0000 7f6476cbb640 1 --2- 172.21.15.6:0/4270541265 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64700aef10 0x7f647014d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:40.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.614+0000 7f6476cbb640 1 -- 172.21.15.6:0/4270541265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64700aeb40 msgr2=0x7f6470149960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:40.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.614+0000 7f6476cbb640 1 --2- 172.21.15.6:0/4270541265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64700aeb40 0x7f6470149960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:40.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.614+0000 7f6476cbb640 1 -- 172.21.15.6:0/4270541265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c009420 con 0x7f6470159270 2023-07-21T22:35:40.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.614+0000 7f64764ba640 1 --2- 172.21.15.6:0/4270541265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64700aeb40 0x7f6470149960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:40.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.614+0000 7f6476cbb640 1 --2- 172.21.15.6:0/4270541265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6470159270 0x7f647014dbe0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f646800c700 tx=0x7f646800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:40.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.614+0000 7f6466ffd640 1 -- 172.21.15.6:0/4270541265 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646800ce10 con 0x7f6470159270 2023-07-21T22:35:40.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.614+0000 7f6466ffd640 1 -- 172.21.15.6:0/4270541265 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646800a640 con 0x7f6470159270 2023-07-21T22:35:40.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.614+0000 7f6466ffd640 1 -- 172.21.15.6:0/4270541265 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646800aa70 con 0x7f6470159270 2023-07-21T22:35:40.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.614+0000 7f647871e640 1 -- 172.21.15.6:0/4270541265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64600094d0 con 0x7f6470159270 2023-07-21T22:35:40.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.614+0000 7f647871e640 1 -- 172.21.15.6:0/4270541265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647006ff30 con 0x7f6470159270 2023-07-21T22:35:40.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.614+0000 7f647871e640 1 -- 172.21.15.6:0/4270541265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64700678d0 con 0x7f6470159270 2023-07-21T22:35:40.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.614+0000 7f6466ffd640 1 -- 172.21.15.6:0/4270541265 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f646800abd0 con 0x7f6470159270 2023-07-21T22:35:40.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.618+0000 7f6466ffd640 1 --2- 172.21.15.6:0/4270541265 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f64540663a0 0x7f6454068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:40.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.618+0000 7f6466ffd640 1 -- 172.21.15.6:0/4270541265 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f6468083830 con 0x7f6470159270 2023-07-21T22:35:40.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.618+0000 7f64764ba640 1 --2- 172.21.15.6:0/4270541265 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f64540663a0 0x7f6454068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:40.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.618+0000 7f64764ba640 1 --2- 172.21.15.6:0/4270541265 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f64540663a0 0x7f6454068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f647014f3a0 tx=0x7f646c008040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:40.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.618+0000 7f6466ffd640 1 -- 172.21.15.6:0/4270541265 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6468050bc0 con 0x7f6470159270 2023-07-21T22:35:40.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:40.806+0000 7f647871e640 1 -- 172.21.15.6:0/4270541265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6470070120 con 0x7f6470159270 2023-07-21T22:35:41.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.466+0000 7f6466ffd640 1 -- 172.21.15.6:0/4270541265 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v43) v1 ==== 174+0+0 (secure 0 0 0) 0x7f64680541e0 con 0x7f6470159270 2023-07-21T22:35:41.519 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 13 and data pool 14 2023-07-21T22:35:41.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.474+0000 7f647871e640 1 -- 172.21.15.6:0/4270541265 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f64540663a0 msgr2=0x7f6454068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:41.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.474+0000 7f647871e640 1 --2- 172.21.15.6:0/4270541265 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f64540663a0 0x7f6454068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f647014f3a0 tx=0x7f646c008040 comp rx=0 tx=0).stop 2023-07-21T22:35:41.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.474+0000 7f647871e640 1 -- 172.21.15.6:0/4270541265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6470159270 msgr2=0x7f647014dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:41.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.474+0000 7f647871e640 1 --2- 172.21.15.6:0/4270541265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6470159270 0x7f647014dbe0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f646800c700 tx=0x7f646800cbc0 comp rx=0 tx=0).stop 2023-07-21T22:35:41.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.474+0000 7f647871e640 1 -- 172.21.15.6:0/4270541265 shutdown_connections 2023-07-21T22:35:41.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.474+0000 7f647871e640 1 --2- 172.21.15.6:0/4270541265 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f64540663a0 0x7f6454068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:41.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.474+0000 7f647871e640 1 --2- 172.21.15.6:0/4270541265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6470159270 0x7f647014dbe0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:41.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.474+0000 7f647871e640 1 --2- 172.21.15.6:0/4270541265 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64700aef10 0x7f647014d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:41.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.474+0000 7f647871e640 1 --2- 172.21.15.6:0/4270541265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f64700aeb40 0x7f6470149960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:41.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.474+0000 7f647871e640 1 -- 172.21.15.6:0/4270541265 >> 172.21.15.6:0/4270541265 conn(0x7f64700cde90 msgr2=0x7f6470152660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:41.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.474+0000 7f647871e640 1 -- 172.21.15.6:0/4270541265 shutdown_connections 2023-07-21T22:35:41.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.474+0000 7f647871e640 1 -- 172.21.15.6:0/4270541265 wait complete. 2023-07-21T22:35:41.551 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:35:41.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.646+0000 7f3ca0c93640 1 Processor -- start 2023-07-21T22:35:41.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.646+0000 7f3ca0c93640 1 -- start start 2023-07-21T22:35:41.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.646+0000 7f3ca0c93640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3c9c0b7c70 0x7f3c9c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:41.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.646+0000 7f3ca0c93640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c9c15fd60 0x7f3c9c0d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:41.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.646+0000 7f3ca0c93640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c9c0ccaf0 con 0x7f3c9c0d1850 2023-07-21T22:35:41.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.646+0000 7f3ca0c93640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c9c0d1190 con 0x7f3c9c15fd60 2023-07-21T22:35:41.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.646+0000 7f3ca0c93640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c9c160600 con 0x7f3c9c0b7c70 2023-07-21T22:35:41.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.646+0000 7f3c9ad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c9c15fd60 0x7f3c9c0d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:41.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.646+0000 7f3c9ad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c9c15fd60 0x7f3c9c0d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48474/0 (socket says 172.21.15.6:48474) 2023-07-21T22:35:41.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.646+0000 7f3c9ad9d640 1 -- 172.21.15.6:0/933807775 learned_addr learned my addr 172.21.15.6:0/933807775 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:41.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.646+0000 7f3c9a59c640 1 --2- 172.21.15.6:0/933807775 >> v2:172.21.15.161:3300/0 conn(0x7f3c9c0b7c70 0x7f3c9c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:41.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.646+0000 7f3c9ad9d640 1 -- 172.21.15.6:0/933807775 >> v2:172.21.15.161:3300/0 conn(0x7f3c9c0b7c70 msgr2=0x7f3c9c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:41.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.646+0000 7f3c9ad9d640 1 --2- 172.21.15.6:0/933807775 >> v2:172.21.15.161:3300/0 conn(0x7f3c9c0b7c70 0x7f3c9c0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:41.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.646+0000 7f3c9ad9d640 1 -- 172.21.15.6:0/933807775 >> v1:172.21.15.6:6789/0 conn(0x7f3c9c0d1850 legacy=0x7f3c9c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:41.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.646+0000 7f3c9ad9d640 1 -- 172.21.15.6:0/933807775 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c160320 con 0x7f3c9c15fd60 2023-07-21T22:35:41.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.650+0000 7f3c9ad9d640 1 --2- 172.21.15.6:0/933807775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c15fd60 0x7f3c9c0d1da0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0b40a0 tx=0x7f3c9401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e66af863582ac58 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:41.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.650+0000 7f3c99d9b640 1 -- 172.21.15.6:0/933807775 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c940a5880 con 0x7f3c9c15fd60 2023-07-21T22:35:41.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.650+0000 7f3c99d9b640 1 -- 172.21.15.6:0/933807775 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c940a59e0 con 0x7f3c9c15fd60 2023-07-21T22:35:41.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.650+0000 7f3c99d9b640 1 -- 172.21.15.6:0/933807775 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c940a5d70 con 0x7f3c9c15fd60 2023-07-21T22:35:41.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.650+0000 7f3ca0c93640 1 -- 172.21.15.6:0/933807775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c15fd60 msgr2=0x7f3c9c0d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:41.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.650+0000 7f3ca0c93640 1 --2- 172.21.15.6:0/933807775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c15fd60 0x7f3c9c0d1da0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0b40a0 tx=0x7f3c9401c9a0 comp rx=0 tx=0).stop 2023-07-21T22:35:41.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.650+0000 7f3ca0c93640 1 -- 172.21.15.6:0/933807775 shutdown_connections 2023-07-21T22:35:41.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.650+0000 7f3ca0c93640 1 --2- 172.21.15.6:0/933807775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c15fd60 0x7f3c9c0d1da0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:41.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.650+0000 7f3ca0c93640 1 --2- 172.21.15.6:0/933807775 >> v2:172.21.15.161:3300/0 conn(0x7f3c9c0b7c70 0x7f3c9c0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:41.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.650+0000 7f3ca0c93640 1 -- 172.21.15.6:0/933807775 >> 172.21.15.6:0/933807775 conn(0x7f3c9c0650b0 msgr2=0x7f3c9c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:41.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.650+0000 7f3ca0c93640 1 -- 172.21.15.6:0/933807775 shutdown_connections 2023-07-21T22:35:41.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.650+0000 7f3ca0c93640 1 -- 172.21.15.6:0/933807775 wait complete. 2023-07-21T22:35:41.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3ca0c93640 1 Processor -- start 2023-07-21T22:35:41.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3ca0c93640 1 -- start start 2023-07-21T22:35:41.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3ca0c93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c0b7c70 0x7f3c9c14d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:41.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3ca0c93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c9c0d1850 0x7f3c9c15db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:41.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3ca0c93640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c9c15fd60 0x7f3c9c15cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:41.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3ca0c93640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c14dd90 con 0x7f3c9c0b7c70 2023-07-21T22:35:41.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3ca0c93640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c139e30 con 0x7f3c9c15fd60 2023-07-21T22:35:41.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3ca0c93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c13a110 con 0x7f3c9c0d1850 2023-07-21T22:35:41.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3c9a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c0b7c70 0x7f3c9c14d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:41.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3c9a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c0b7c70 0x7f3c9c14d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48476/0 (socket says 172.21.15.6:48476) 2023-07-21T22:35:41.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3c9a59c640 1 -- 172.21.15.6:0/2021848928 learned_addr learned my addr 172.21.15.6:0/2021848928 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:41.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3c9ad9d640 1 --2- 172.21.15.6:0/2021848928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c9c15fd60 0x7f3c9c15cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:41.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3c93fff640 1 --2- 172.21.15.6:0/2021848928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c9c0d1850 0x7f3c9c15db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:41.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3c9a59c640 1 -- 172.21.15.6:0/2021848928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c9c0d1850 msgr2=0x7f3c9c15db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:41.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3c9a59c640 1 --2- 172.21.15.6:0/2021848928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c9c0d1850 0x7f3c9c15db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:41.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3c9a59c640 1 -- 172.21.15.6:0/2021848928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c9c15fd60 msgr2=0x7f3c9c15cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:41.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3c9a59c640 1 --2- 172.21.15.6:0/2021848928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c9c15fd60 0x7f3c9c15cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:41.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3c9a59c640 1 -- 172.21.15.6:0/2021848928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c94009b30 con 0x7f3c9c0b7c70 2023-07-21T22:35:41.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3c9ad9d640 1 --2- 172.21.15.6:0/2021848928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c9c15fd60 0x7f3c9c15cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:41.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3c9a59c640 1 --2- 172.21.15.6:0/2021848928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c0b7c70 0x7f3c9c14d850 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c00d620 tx=0x7f3c8c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:41.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3c92ffd640 1 -- 172.21.15.6:0/2021848928 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c00b620 con 0x7f3c9c0b7c70 2023-07-21T22:35:41.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3c92ffd640 1 -- 172.21.15.6:0/2021848928 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8c00b780 con 0x7f3c9c0b7c70 2023-07-21T22:35:41.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3c92ffd640 1 -- 172.21.15.6:0/2021848928 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c00bb10 con 0x7f3c9c0b7c70 2023-07-21T22:35:41.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3ca0c93640 1 -- 172.21.15.6:0/2021848928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c9c15e400 con 0x7f3c9c0b7c70 2023-07-21T22:35:41.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3ca0c93640 1 -- 172.21.15.6:0/2021848928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9c15e9c0 con 0x7f3c9c0b7c70 2023-07-21T22:35:41.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.654+0000 7f3ca0c93640 1 -- 172.21.15.6:0/2021848928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c9c0678d0 con 0x7f3c9c0b7c70 2023-07-21T22:35:41.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.658+0000 7f3c92ffd640 1 -- 172.21.15.6:0/2021848928 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3c8c00bc70 con 0x7f3c9c0b7c70 2023-07-21T22:35:41.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.658+0000 7f3c92ffd640 1 --2- 172.21.15.6:0/2021848928 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f3c7c0663d0 0x7f3c7c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:41.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.658+0000 7f3c92ffd640 1 -- 172.21.15.6:0/2021848928 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f3c8c0844b0 con 0x7f3c9c0b7c70 2023-07-21T22:35:41.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.658+0000 7f3c93fff640 1 --2- 172.21.15.6:0/2021848928 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f3c7c0663d0 0x7f3c7c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:41.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.658+0000 7f3c93fff640 1 --2- 172.21.15.6:0/2021848928 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f3c7c0663d0 0x7f3c7c068880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0d0750 tx=0x7f3c84009040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:41.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.662+0000 7f3c92ffd640 1 -- 172.21.15.6:0/2021848928 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3c8c0516d0 con 0x7f3c9c0b7c70 2023-07-21T22:35:41.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.818+0000 7f3ca0c93640 1 -- 172.21.15.6:0/2021848928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c9c0b1950 con 0x7f3c9c0b7c70 2023-07-21T22:35:41.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.822+0000 7f3c92ffd640 1 -- 172.21.15.6:0/2021848928 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+18316 (secure 0 0 0) 0x7f3c8c007380 con 0x7f3c9c0b7c70 2023-07-21T22:35:41.871 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:41.871 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":111,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:35:40.811901+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:35:38.932763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-21T22:35:39.805137+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:35:41.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.822+0000 7f3ca0c93640 1 -- 172.21.15.6:0/2021848928 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f3c7c0663d0 msgr2=0x7f3c7c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:41.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.822+0000 7f3ca0c93640 1 --2- 172.21.15.6:0/2021848928 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f3c7c0663d0 0x7f3c7c068880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0d0750 tx=0x7f3c84009040 comp rx=0 tx=0).stop 2023-07-21T22:35:41.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.822+0000 7f3ca0c93640 1 -- 172.21.15.6:0/2021848928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c0b7c70 msgr2=0x7f3c9c14d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:41.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.822+0000 7f3ca0c93640 1 --2- 172.21.15.6:0/2021848928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c0b7c70 0x7f3c9c14d850 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c00d620 tx=0x7f3c8c00dae0 comp rx=0 tx=0).stop 2023-07-21T22:35:41.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.822+0000 7f3ca0c93640 1 -- 172.21.15.6:0/2021848928 shutdown_connections 2023-07-21T22:35:41.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.822+0000 7f3ca0c93640 1 --2- 172.21.15.6:0/2021848928 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f3c7c0663d0 0x7f3c7c068880 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:41.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.822+0000 7f3ca0c93640 1 --2- 172.21.15.6:0/2021848928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c9c15fd60 0x7f3c9c15cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:41.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.822+0000 7f3ca0c93640 1 --2- 172.21.15.6:0/2021848928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c9c0d1850 0x7f3c9c15db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:41.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.822+0000 7f3ca0c93640 1 --2- 172.21.15.6:0/2021848928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c9c0b7c70 0x7f3c9c14d850 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:41.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.822+0000 7f3ca0c93640 1 -- 172.21.15.6:0/2021848928 >> 172.21.15.6:0/2021848928 conn(0x7f3c9c0650b0 msgr2=0x7f3c9c065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:41.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.822+0000 7f3ca0c93640 1 -- 172.21.15.6:0/2021848928 shutdown_connections 2023-07-21T22:35:41.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.822+0000 7f3ca0c93640 1 -- 172.21.15.6:0/2021848928 wait complete. 2023-07-21T22:35:41.893 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:35:42.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.986+0000 7fed82bc5640 1 Processor -- start 2023-07-21T22:35:42.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.986+0000 7fed82bc5640 1 -- start start 2023-07-21T22:35:42.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.986+0000 7fed82bc5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed7c0c8ad0 0x7fed7c0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:42.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.986+0000 7fed82bc5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed7c0c9560 0x7fed7c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:42.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.986+0000 7fed82bc5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed7c0cc700 con 0x7fed7c158ce0 2023-07-21T22:35:42.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.986+0000 7fed82bc5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed7c0c99e0 con 0x7fed7c0c8ad0 2023-07-21T22:35:42.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.986+0000 7fed82bc5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c0b0ff0 con 0x7fed7c0c9560 2023-07-21T22:35:42.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.986+0000 7fed7bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed7c0c8ad0 0x7fed7c0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:42.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.986+0000 7fed7bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed7c0c8ad0 0x7fed7c0c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48482/0 (socket says 172.21.15.6:48482) 2023-07-21T22:35:42.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.986+0000 7fed7bfff640 1 -- 172.21.15.6:0/3717571761 learned_addr learned my addr 172.21.15.6:0/3717571761 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:42.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.990+0000 7fed7bfff640 1 -- 172.21.15.6:0/3717571761 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed7c0c9560 msgr2=0x7fed7c0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:42.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.990+0000 7fed7bfff640 1 --2- 172.21.15.6:0/3717571761 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed7c0c9560 0x7fed7c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:42.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.990+0000 7fed7bfff640 1 -- 172.21.15.6:0/3717571761 >> v1:172.21.15.6:6789/0 conn(0x7fed7c158ce0 legacy=0x7fed7c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:42.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.990+0000 7fed7bfff640 1 -- 172.21.15.6:0/3717571761 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7c070c80 con 0x7fed7c0c8ad0 2023-07-21T22:35:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.990+0000 7fed7bfff640 1 --2- 172.21.15.6:0/3717571761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c0c8ad0 0x7fed7c0c9020 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fed68009870 tx=0x7fed6801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a92806ca6291cc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.990+0000 7fed7b7fe640 1 -- 172.21.15.6:0/3717571761 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed680ab5f0 con 0x7fed7c0c8ad0 2023-07-21T22:35:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.990+0000 7fed7b7fe640 1 -- 172.21.15.6:0/3717571761 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed680ab750 con 0x7fed7c0c8ad0 2023-07-21T22:35:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.990+0000 7fed7b7fe640 1 -- 172.21.15.6:0/3717571761 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed680abae0 con 0x7fed7c0c8ad0 2023-07-21T22:35:42.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.990+0000 7fed82bc5640 1 -- 172.21.15.6:0/3717571761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c0c8ad0 msgr2=0x7fed7c0c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:42.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.990+0000 7fed82bc5640 1 --2- 172.21.15.6:0/3717571761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c0c8ad0 0x7fed7c0c9020 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fed68009870 tx=0x7fed6801c3f0 comp rx=0 tx=0).stop 2023-07-21T22:35:42.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.990+0000 7fed82bc5640 1 -- 172.21.15.6:0/3717571761 shutdown_connections 2023-07-21T22:35:42.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.990+0000 7fed82bc5640 1 --2- 172.21.15.6:0/3717571761 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed7c0c9560 0x7fed7c0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:42.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.990+0000 7fed82bc5640 1 --2- 172.21.15.6:0/3717571761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c0c8ad0 0x7fed7c0c9020 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:42.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.990+0000 7fed82bc5640 1 -- 172.21.15.6:0/3717571761 >> 172.21.15.6:0/3717571761 conn(0x7fed7c0afcf0 msgr2=0x7fed7c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:42.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed82bc5640 1 -- 172.21.15.6:0/3717571761 shutdown_connections 2023-07-21T22:35:42.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed82bc5640 1 -- 172.21.15.6:0/3717571761 wait complete. 2023-07-21T22:35:42.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed82bc5640 1 Processor -- start 2023-07-21T22:35:42.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed82bc5640 1 -- start start 2023-07-21T22:35:42.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed82bc5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed7c0c8ad0 0x7fed7c0ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:42.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed82bc5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c0c9560 0x7fed7c14d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:42.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed82bc5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed7c158ce0 0x7fed7c0c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:42.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed82bc5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c0aec10 con 0x7fed7c0c9560 2023-07-21T22:35:42.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed82bc5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c14e4f0 con 0x7fed7c0c8ad0 2023-07-21T22:35:42.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed82bc5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c0ae640 con 0x7fed7c158ce0 2023-07-21T22:35:42.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed7bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c0c9560 0x7fed7c14d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:42.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed7bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c0c9560 0x7fed7c14d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48492/0 (socket says 172.21.15.6:48492) 2023-07-21T22:35:42.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed7bfff640 1 -- 172.21.15.6:0/2643854680 learned_addr learned my addr 172.21.15.6:0/2643854680 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:42.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed80961640 1 --2- 172.21.15.6:0/2643854680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed7c0c8ad0 0x7fed7c0ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:42.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed81162640 1 --2- 172.21.15.6:0/2643854680 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed7c158ce0 0x7fed7c0c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed7bfff640 1 -- 172.21.15.6:0/2643854680 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed7c158ce0 msgr2=0x7fed7c0c31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed7bfff640 1 --2- 172.21.15.6:0/2643854680 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed7c158ce0 0x7fed7c0c31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed7bfff640 1 -- 172.21.15.6:0/2643854680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed7c0c8ad0 msgr2=0x7fed7c0ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed7bfff640 1 --2- 172.21.15.6:0/2643854680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed7c0c8ad0 0x7fed7c0ad6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed7bfff640 1 -- 172.21.15.6:0/2643854680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed680094d0 con 0x7fed7c0c9560 2023-07-21T22:35:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed81162640 1 --2- 172.21.15.6:0/2643854680 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed7c158ce0 0x7fed7c0c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.994+0000 7fed80961640 1 --2- 172.21.15.6:0/2643854680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed7c0c8ad0 0x7fed7c0ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.998+0000 7fed7bfff640 1 --2- 172.21.15.6:0/2643854680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c0c9560 0x7fed7c14d970 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fed6801a020 tx=0x7fed6801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.998+0000 7fed797fa640 1 -- 172.21.15.6:0/2643854680 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed680b4800 con 0x7fed7c0c9560 2023-07-21T22:35:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.998+0000 7fed797fa640 1 -- 172.21.15.6:0/2643854680 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed680b4980 con 0x7fed7c0c9560 2023-07-21T22:35:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.998+0000 7fed797fa640 1 -- 172.21.15.6:0/2643854680 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed680b4d30 con 0x7fed7c0c9560 2023-07-21T22:35:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.998+0000 7fed82bc5640 1 -- 172.21.15.6:0/2643854680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed7c0adda0 con 0x7fed7c0c9560 2023-07-21T22:35:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.998+0000 7fed82bc5640 1 -- 172.21.15.6:0/2643854680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7c0ae360 con 0x7fed7c0c9560 2023-07-21T22:35:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.998+0000 7fed82bc5640 1 -- 172.21.15.6:0/2643854680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed7c0ca1a0 con 0x7fed7c0c9560 2023-07-21T22:35:42.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.998+0000 7fed797fa640 1 -- 172.21.15.6:0/2643854680 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fed680c7440 con 0x7fed7c0c9560 2023-07-21T22:35:42.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.998+0000 7fed797fa640 1 --2- 172.21.15.6:0/2643854680 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fed600663a0 0x7fed60068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:42.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.998+0000 7fed797fa640 1 -- 172.21.15.6:0/2643854680 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fed680a8050 con 0x7fed7c0c9560 2023-07-21T22:35:42.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:41.998+0000 7fed80961640 1 --2- 172.21.15.6:0/2643854680 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fed600663a0 0x7fed60068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:42.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.002+0000 7fed80961640 1 --2- 172.21.15.6:0/2643854680 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fed600663a0 0x7fed60068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fed7c157760 tx=0x7fed70009040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:42.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.002+0000 7fed797fa640 1 -- 172.21.15.6:0/2643854680 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed680ebd20 con 0x7fed7c0c9560 2023-07-21T22:35:42.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.158+0000 7fed82bc5640 1 -- 172.21.15.6:0/2643854680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed7c0678d0 con 0x7fed7c0c9560 2023-07-21T22:35:42.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.158+0000 7fed797fa640 1 -- 172.21.15.6:0/2643854680 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+18316 (secure 0 0 0) 0x7fed680ef340 con 0x7fed7c0c9560 2023-07-21T22:35:42.211 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:42.211 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":111,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:35:40.811901+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:35:38.932763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-21T22:35:39.805137+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:35:42.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.162+0000 7fed82bc5640 1 -- 172.21.15.6:0/2643854680 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fed600663a0 msgr2=0x7fed60068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:42.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.162+0000 7fed82bc5640 1 --2- 172.21.15.6:0/2643854680 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fed600663a0 0x7fed60068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fed7c157760 tx=0x7fed70009040 comp rx=0 tx=0).stop 2023-07-21T22:35:42.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.162+0000 7fed82bc5640 1 -- 172.21.15.6:0/2643854680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c0c9560 msgr2=0x7fed7c14d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:42.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.162+0000 7fed82bc5640 1 --2- 172.21.15.6:0/2643854680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c0c9560 0x7fed7c14d970 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fed6801a020 tx=0x7fed6801ac30 comp rx=0 tx=0).stop 2023-07-21T22:35:42.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.162+0000 7fed82bc5640 1 -- 172.21.15.6:0/2643854680 shutdown_connections 2023-07-21T22:35:42.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.162+0000 7fed82bc5640 1 --2- 172.21.15.6:0/2643854680 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fed600663a0 0x7fed60068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:42.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.162+0000 7fed82bc5640 1 --2- 172.21.15.6:0/2643854680 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed7c158ce0 0x7fed7c0c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:42.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.162+0000 7fed82bc5640 1 --2- 172.21.15.6:0/2643854680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed7c0c9560 0x7fed7c14d970 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:42.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.162+0000 7fed82bc5640 1 --2- 172.21.15.6:0/2643854680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed7c0c8ad0 0x7fed7c0ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:42.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.162+0000 7fed82bc5640 1 -- 172.21.15.6:0/2643854680 >> 172.21.15.6:0/2643854680 conn(0x7fed7c0afcf0 msgr2=0x7fed7c0ac720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:42.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.162+0000 7fed82bc5640 1 -- 172.21.15.6:0/2643854680 shutdown_connections 2023-07-21T22:35:42.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.162+0000 7fed82bc5640 1 -- 172.21.15.6:0/2643854680 wait complete. 2023-07-21T22:35:42.232 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-21T22:35:42.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.330+0000 7efdd22ec640 1 Processor -- start 2023-07-21T22:35:42.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.330+0000 7efdd22ec640 1 -- start start 2023-07-21T22:35:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.330+0000 7efdd22ec640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efdcc1590a0 0x7efdcc0c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.330+0000 7efdd22ec640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efdcc15b9c0 0x7efdcc159930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.330+0000 7efdd22ec640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdcc0c37e0 con 0x7efdcc0cba60 2023-07-21T22:35:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.330+0000 7efdd22ec640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdcc0c3ac0 con 0x7efdcc15b9c0 2023-07-21T22:35:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.330+0000 7efdd22ec640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdcc0c3da0 con 0x7efdcc1590a0 2023-07-21T22:35:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.330+0000 7efdd0889640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efdcc15b9c0 0x7efdcc159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.330+0000 7efdd0889640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efdcc15b9c0 0x7efdcc159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48496/0 (socket says 172.21.15.6:48496) 2023-07-21T22:35:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.330+0000 7efdd0889640 1 -- 172.21.15.6:0/3153240381 learned_addr learned my addr 172.21.15.6:0/3153240381 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.330+0000 7efdcb7fe640 1 --2- 172.21.15.6:0/3153240381 >> v2:172.21.15.161:3300/0 conn(0x7efdcc1590a0 0x7efdcc0c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.330+0000 7efdd0889640 1 -- 172.21.15.6:0/3153240381 >> v2:172.21.15.161:3300/0 conn(0x7efdcc1590a0 msgr2=0x7efdcc0c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.330+0000 7efdd0889640 1 --2- 172.21.15.6:0/3153240381 >> v2:172.21.15.161:3300/0 conn(0x7efdcc1590a0 0x7efdcc0c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.330+0000 7efdd0889640 1 -- 172.21.15.6:0/3153240381 >> v1:172.21.15.161:6789/0 conn(0x7efdcc0cba60 legacy=0x7efdcc0cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:42.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.330+0000 7efdd0889640 1 -- 172.21.15.6:0/3153240381 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc0c4080 con 0x7efdcc15b9c0 2023-07-21T22:35:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.334+0000 7efdd0889640 1 --2- 172.21.15.6:0/3153240381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdcc15b9c0 0x7efdcc159930 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0cde60 tx=0x7efdc401eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaae414b81cc452f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.334+0000 7efdcaffd640 1 -- 172.21.15.6:0/3153240381 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc40a7bb0 con 0x7efdcc15b9c0 2023-07-21T22:35:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.334+0000 7efdcaffd640 1 -- 172.21.15.6:0/3153240381 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc40ab070 con 0x7efdcc15b9c0 2023-07-21T22:35:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.334+0000 7efdcaffd640 1 -- 172.21.15.6:0/3153240381 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc40b1400 con 0x7efdcc15b9c0 2023-07-21T22:35:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.334+0000 7efdd22ec640 1 -- 172.21.15.6:0/3153240381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdcc15b9c0 msgr2=0x7efdcc159930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.334+0000 7efdd22ec640 1 --2- 172.21.15.6:0/3153240381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdcc15b9c0 0x7efdcc159930 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0cde60 tx=0x7efdc401eb00 comp rx=0 tx=0).stop 2023-07-21T22:35:42.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.334+0000 7efdd22ec640 1 -- 172.21.15.6:0/3153240381 shutdown_connections 2023-07-21T22:35:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.334+0000 7efdd22ec640 1 --2- 172.21.15.6:0/3153240381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdcc15b9c0 0x7efdcc159930 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.334+0000 7efdd22ec640 1 --2- 172.21.15.6:0/3153240381 >> v2:172.21.15.161:3300/0 conn(0x7efdcc1590a0 0x7efdcc0c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.334+0000 7efdd22ec640 1 -- 172.21.15.6:0/3153240381 >> 172.21.15.6:0/3153240381 conn(0x7efdcc0cde90 msgr2=0x7efdcc0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.334+0000 7efdd22ec640 1 -- 172.21.15.6:0/3153240381 shutdown_connections 2023-07-21T22:35:42.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.334+0000 7efdd22ec640 1 -- 172.21.15.6:0/3153240381 wait complete. 2023-07-21T22:35:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.334+0000 7efdd22ec640 1 Processor -- start 2023-07-21T22:35:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdd22ec640 1 -- start start 2023-07-21T22:35:42.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdd22ec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdcc0cba60 0x7efdcc161460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:42.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdd22ec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdcc1590a0 0x7efdcc1506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:42.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdd22ec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdcc15b9c0 0x7efdcc152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:42.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdd22ec640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc1f4620 con 0x7efdcc1590a0 2023-07-21T22:35:42.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdd22ec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc0b3ce0 con 0x7efdcc0cba60 2023-07-21T22:35:42.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdd22ec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc161c90 con 0x7efdcc15b9c0 2023-07-21T22:35:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdcb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdcc1590a0 0x7efdcc1506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdcb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdcc1590a0 0x7efdcc1506a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48498/0 (socket says 172.21.15.6:48498) 2023-07-21T22:35:42.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdcb7fe640 1 -- 172.21.15.6:0/2326936439 learned_addr learned my addr 172.21.15.6:0/2326936439 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdcb7fe640 1 -- 172.21.15.6:0/2326936439 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdcc15b9c0 msgr2=0x7efdcc152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdcb7fe640 1 --2- 172.21.15.6:0/2326936439 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdcc15b9c0 0x7efdcc152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdcb7fe640 1 -- 172.21.15.6:0/2326936439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdcc0cba60 msgr2=0x7efdcc161460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdcb7fe640 1 --2- 172.21.15.6:0/2326936439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdcc0cba60 0x7efdcc161460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdcb7fe640 1 -- 172.21.15.6:0/2326936439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc400bd40 con 0x7efdcc1590a0 2023-07-21T22:35:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdcb7fe640 1 --2- 172.21.15.6:0/2326936439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdcc1590a0 0x7efdcc1506a0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7efdc000d830 tx=0x7efdc000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdc8ff9640 1 -- 172.21.15.6:0/2326936439 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc000b6c0 con 0x7efdcc1590a0 2023-07-21T22:35:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdc8ff9640 1 -- 172.21.15.6:0/2326936439 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc000b860 con 0x7efdcc1590a0 2023-07-21T22:35:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdc8ff9640 1 -- 172.21.15.6:0/2326936439 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc000bc10 con 0x7efdcc1590a0 2023-07-21T22:35:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdd22ec640 1 -- 172.21.15.6:0/2326936439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdcc0b3720 con 0x7efdcc1590a0 2023-07-21T22:35:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdd22ec640 1 -- 172.21.15.6:0/2326936439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdcc1619a0 con 0x7efdcc1590a0 2023-07-21T22:35:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.338+0000 7efdd22ec640 1 -- 172.21.15.6:0/2326936439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdcc0714b0 con 0x7efdcc1590a0 2023-07-21T22:35:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.342+0000 7efdc8ff9640 1 -- 172.21.15.6:0/2326936439 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efdc001e460 con 0x7efdcc1590a0 2023-07-21T22:35:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.342+0000 7efdc8ff9640 1 --2- 172.21.15.6:0/2326936439 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7efdb80663a0 0x7efdb8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.342+0000 7efdc8ff9640 1 -- 172.21.15.6:0/2326936439 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6106+0+0 (secure 0 0 0) 0x7efdc0084750 con 0x7efdcc1590a0 2023-07-21T22:35:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.342+0000 7efdcbfff640 1 --2- 172.21.15.6:0/2326936439 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7efdb80663a0 0x7efdb8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.342+0000 7efdcbfff640 1 --2- 172.21.15.6:0/2326936439 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7efdb80663a0 0x7efdb8068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efdbc000f70 tx=0x7efdbc0079c0 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:42.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.346+0000 7efdc8ff9640 1 -- 172.21.15.6:0/2326936439 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efdc00519f0 con 0x7efdcc1590a0 2023-07-21T22:35:42.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:42.534+0000 7efdd22ec640 1 -- 172.21.15.6:0/2326936439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efdcc0b3580 con 0x7efdcc1590a0 2023-07-21T22:35:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.470+0000 7efdc8ff9640 1 -- 172.21.15.6:0/2326936439 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v46) v1 ==== 118+0+0 (secure 0 0 0) 0x7efdcc0b3580 con 0x7efdcc1590a0 2023-07-21T22:35:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.474+0000 7efdd22ec640 1 -- 172.21.15.6:0/2326936439 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7efdb80663a0 msgr2=0x7efdb8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.474+0000 7efdd22ec640 1 --2- 172.21.15.6:0/2326936439 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7efdb80663a0 0x7efdb8068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efdbc000f70 tx=0x7efdbc0079c0 comp rx=0 tx=0).stop 2023-07-21T22:35:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.474+0000 7efdd22ec640 1 -- 172.21.15.6:0/2326936439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdcc1590a0 msgr2=0x7efdcc1506a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.474+0000 7efdd22ec640 1 --2- 172.21.15.6:0/2326936439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdcc1590a0 0x7efdcc1506a0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7efdc000d830 tx=0x7efdc000dcf0 comp rx=0 tx=0).stop 2023-07-21T22:35:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.474+0000 7efdd22ec640 1 -- 172.21.15.6:0/2326936439 shutdown_connections 2023-07-21T22:35:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.474+0000 7efdd22ec640 1 --2- 172.21.15.6:0/2326936439 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7efdb80663a0 0x7efdb8068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.474+0000 7efdd22ec640 1 --2- 172.21.15.6:0/2326936439 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdcc15b9c0 0x7efdcc152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.474+0000 7efdd22ec640 1 --2- 172.21.15.6:0/2326936439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdcc1590a0 0x7efdcc1506a0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.474+0000 7efdd22ec640 1 --2- 172.21.15.6:0/2326936439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdcc0cba60 0x7efdcc161460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.474+0000 7efdd22ec640 1 -- 172.21.15.6:0/2326936439 >> 172.21.15.6:0/2326936439 conn(0x7efdcc0cde90 msgr2=0x7efdcc06b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.474+0000 7efdd22ec640 1 -- 172.21.15.6:0/2326936439 shutdown_connections 2023-07-21T22:35:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.474+0000 7efdd22ec640 1 -- 172.21.15.6:0/2326936439 wait complete. 2023-07-21T22:35:43.538 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:35:43.542 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:35:43.545 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-21T22:35:43.545 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-21T22:35:43.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.686+0000 7f066c59d640 1 Processor -- start 2023-07-21T22:35:43.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.686+0000 7f066c59d640 1 -- start start 2023-07-21T22:35:43.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.690+0000 7f066c59d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0664069430 0x7f0664069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:43.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.690+0000 7f066c59d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0664070f30 0x7f06640ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:43.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.690+0000 7f066c59d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0664159d70 con 0x7f06640af2b0 2023-07-21T22:35:43.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.690+0000 7f066c59d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0664069d40 con 0x7f0664070f30 2023-07-21T22:35:43.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.690+0000 7f066c59d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06640c9c60 con 0x7f0664069430 2023-07-21T22:35:43.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.690+0000 7f066a339640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0664069430 0x7f0664069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:43.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.690+0000 7f0669b38640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0664070f30 0x7f06640ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:43.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.690+0000 7f0669b38640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0664070f30 0x7f06640ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35436/0 (socket says 172.21.15.6:35436) 2023-07-21T22:35:43.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.690+0000 7f066ab3a640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f06640af2b0 0x7f066415a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:38354/0 (socket says 172.21.15.6:38354) 2023-07-21T22:35:43.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.690+0000 7f0669b38640 1 -- 172.21.15.6:0/2235486584 learned_addr learned my addr 172.21.15.6:0/2235486584 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:43.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.690+0000 7f066a339640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0664069430 0x7f0664069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:51884/0 (socket says 172.21.15.6:51884) 2023-07-21T22:35:43.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.690+0000 7f066a339640 1 -- 172.21.15.6:0/2235486584 >> v2:172.21.15.161:3300/0 conn(0x7f0664070f30 msgr2=0x7f06640ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:43.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.690+0000 7f066a339640 1 --2- 172.21.15.6:0/2235486584 >> v2:172.21.15.161:3300/0 conn(0x7f0664070f30 0x7f06640ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:43.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.690+0000 7f066a339640 1 -- 172.21.15.6:0/2235486584 >> v1:172.21.15.161:6789/0 conn(0x7f06640af2b0 legacy=0x7f066415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:43.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.690+0000 7f066a339640 1 -- 172.21.15.6:0/2235486584 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06640c9f40 con 0x7f0664069430 2023-07-21T22:35:43.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.690+0000 7f0669b38640 1 --2- 172.21.15.6:0/2235486584 >> v2:172.21.15.161:3300/0 conn(0x7f0664070f30 0x7f06640ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:43.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.694+0000 7f066a339640 1 --2- 172.21.15.6:0/2235486584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0664069430 0x7f0664069800 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f06600097c0 tx=0x7f066001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1899d90256855d1c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:43.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.694+0000 7f0669337640 1 -- 172.21.15.6:0/2235486584 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06600ad640 con 0x7f0664069430 2023-07-21T22:35:43.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.694+0000 7f0669337640 1 -- 172.21.15.6:0/2235486584 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06600ad7a0 con 0x7f0664069430 2023-07-21T22:35:43.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.694+0000 7f0669337640 1 -- 172.21.15.6:0/2235486584 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06600adb30 con 0x7f0664069430 2023-07-21T22:35:43.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.694+0000 7f066c59d640 1 -- 172.21.15.6:0/2235486584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0664069430 msgr2=0x7f0664069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:43.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.694+0000 7f066c59d640 1 --2- 172.21.15.6:0/2235486584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0664069430 0x7f0664069800 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f06600097c0 tx=0x7f066001c480 comp rx=0 tx=0).stop 2023-07-21T22:35:43.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.694+0000 7f066c59d640 1 -- 172.21.15.6:0/2235486584 shutdown_connections 2023-07-21T22:35:43.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.694+0000 7f066c59d640 1 --2- 172.21.15.6:0/2235486584 >> v2:172.21.15.161:3300/0 conn(0x7f0664070f30 0x7f06640ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:43.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.694+0000 7f066c59d640 1 --2- 172.21.15.6:0/2235486584 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0664069430 0x7f0664069800 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:43.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.694+0000 7f066c59d640 1 -- 172.21.15.6:0/2235486584 >> 172.21.15.6:0/2235486584 conn(0x7f06640cde90 msgr2=0x7f06640ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:43.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.694+0000 7f066c59d640 1 -- 172.21.15.6:0/2235486584 shutdown_connections 2023-07-21T22:35:43.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.694+0000 7f066c59d640 1 -- 172.21.15.6:0/2235486584 wait complete. 2023-07-21T22:35:43.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f066c59d640 1 Processor -- start 2023-07-21T22:35:43.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f066c59d640 1 -- start start 2023-07-21T22:35:43.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f066c59d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0664069430 0x7f06640c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:43.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f066c59d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0664070f30 0x7f06641f4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:43.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f066c59d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06640af2b0 0x7f06640c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:43.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f066c59d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06641f47a0 con 0x7f0664070f30 2023-07-21T22:35:43.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f066c59d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06640c7670 con 0x7f0664069430 2023-07-21T22:35:43.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f066c59d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06640c7950 con 0x7f06640af2b0 2023-07-21T22:35:43.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f0669b38640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0664070f30 0x7f06641f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:43.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f0669b38640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0664070f30 0x7f06641f4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48504/0 (socket says 172.21.15.6:48504) 2023-07-21T22:35:43.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f0669b38640 1 -- 172.21.15.6:0/117646815 learned_addr learned my addr 172.21.15.6:0/117646815 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:43.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f066a339640 1 --2- 172.21.15.6:0/117646815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0664069430 0x7f06640c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:43.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f066ab3a640 1 --2- 172.21.15.6:0/117646815 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06640af2b0 0x7f06640c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:43.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f0669b38640 1 -- 172.21.15.6:0/117646815 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06640af2b0 msgr2=0x7f06640c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:43.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f0669b38640 1 --2- 172.21.15.6:0/117646815 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06640af2b0 0x7f06640c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:43.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f0669b38640 1 -- 172.21.15.6:0/117646815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0664069430 msgr2=0x7f06640c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:43.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f0669b38640 1 --2- 172.21.15.6:0/117646815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0664069430 0x7f06640c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:43.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f0669b38640 1 -- 172.21.15.6:0/117646815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06540094d0 con 0x7f0664070f30 2023-07-21T22:35:43.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f0669b38640 1 --2- 172.21.15.6:0/117646815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0664070f30 0x7f06641f4260 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f065400e9d0 tx=0x7f065400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:43.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f065affd640 1 -- 172.21.15.6:0/117646815 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065400ca60 con 0x7f0664070f30 2023-07-21T22:35:43.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f065affd640 1 -- 172.21.15.6:0/117646815 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065400cbc0 con 0x7f0664070f30 2023-07-21T22:35:43.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f065affd640 1 -- 172.21.15.6:0/117646815 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654013470 con 0x7f0664070f30 2023-07-21T22:35:43.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f066c59d640 1 -- 172.21.15.6:0/117646815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0660009420 con 0x7f0664070f30 2023-07-21T22:35:43.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f066c59d640 1 -- 172.21.15.6:0/117646815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06641414f0 con 0x7f0664070f30 2023-07-21T22:35:43.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.698+0000 7f066c59d640 1 -- 172.21.15.6:0/117646815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06640678d0 con 0x7f0664070f30 2023-07-21T22:35:43.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.702+0000 7f065affd640 1 -- 172.21.15.6:0/117646815 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f06540135d0 con 0x7f0664070f30 2023-07-21T22:35:43.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.702+0000 7f065affd640 1 --2- 172.21.15.6:0/117646815 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f06480663a0 0x7f0648068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:43.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.702+0000 7f065affd640 1 -- 172.21.15.6:0/117646815 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f0654084190 con 0x7f0664070f30 2023-07-21T22:35:43.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.702+0000 7f066a339640 1 --2- 172.21.15.6:0/117646815 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f06480663a0 0x7f0648068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:43.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.702+0000 7f066a339640 1 --2- 172.21.15.6:0/117646815 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f06480663a0 0x7f0648068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f06600af000 tx=0x7f0660008040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:43.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.706+0000 7f065affd640 1 -- 172.21.15.6:0/117646815 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f06540514e0 con 0x7f0664070f30 2023-07-21T22:35:43.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:43.894+0000 7f066c59d640 1 -- 172.21.15.6:0/117646815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f06640ad9a0 con 0x7f0664070f30 2023-07-21T22:35:44.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:44.850+0000 7f065affd640 1 -- 172.21.15.6:0/117646815 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v47) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0654054b00 con 0x7f0664070f30 2023-07-21T22:35:44.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:44.854+0000 7f066c59d640 1 -- 172.21.15.6:0/117646815 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f06480663a0 msgr2=0x7f0648068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:44.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:44.854+0000 7f066c59d640 1 --2- 172.21.15.6:0/117646815 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f06480663a0 0x7f0648068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f06600af000 tx=0x7f0660008040 comp rx=0 tx=0).stop 2023-07-21T22:35:44.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:44.854+0000 7f066c59d640 1 -- 172.21.15.6:0/117646815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0664070f30 msgr2=0x7f06641f4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:44.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:44.854+0000 7f066c59d640 1 --2- 172.21.15.6:0/117646815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0664070f30 0x7f06641f4260 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f065400e9d0 tx=0x7f065400ee90 comp rx=0 tx=0).stop 2023-07-21T22:35:44.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:44.854+0000 7f066c59d640 1 -- 172.21.15.6:0/117646815 shutdown_connections 2023-07-21T22:35:44.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:44.854+0000 7f066c59d640 1 --2- 172.21.15.6:0/117646815 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f06480663a0 0x7f0648068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:44.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:44.854+0000 7f066c59d640 1 --2- 172.21.15.6:0/117646815 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06640af2b0 0x7f06640c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:44.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:44.854+0000 7f066c59d640 1 --2- 172.21.15.6:0/117646815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0664070f30 0x7f06641f4260 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:44.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:44.854+0000 7f066c59d640 1 --2- 172.21.15.6:0/117646815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0664069430 0x7f06640c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:44.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:44.854+0000 7f066c59d640 1 -- 172.21.15.6:0/117646815 >> 172.21.15.6:0/117646815 conn(0x7f06640cde90 msgr2=0x7f06640cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:44.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:44.854+0000 7f066c59d640 1 -- 172.21.15.6:0/117646815 shutdown_connections 2023-07-21T22:35:44.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:44.854+0000 7f066c59d640 1 -- 172.21.15.6:0/117646815 wait complete. 2023-07-21T22:35:44.926 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-21T22:35:44.927 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:35:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.026+0000 7f4187340640 1 Processor -- start 2023-07-21T22:35:45.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.026+0000 7f4187340640 1 -- start start 2023-07-21T22:35:45.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.026+0000 7f4187340640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f41800b7c70 0x7f41800d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.026+0000 7f4187340640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f418015fd60 0x7f41800d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.026+0000 7f4187340640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41800ccaf0 con 0x7f41800d1850 2023-07-21T22:35:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.026+0000 7f4187340640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41800d1190 con 0x7f418015fd60 2023-07-21T22:35:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.026+0000 7f4187340640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4180160600 con 0x7f41800b7c70 2023-07-21T22:35:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.026+0000 7f41858dd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f418015fd60 0x7f41800d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.026+0000 7f41858dd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f418015fd60 0x7f41800d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48516/0 (socket says 172.21.15.6:48516) 2023-07-21T22:35:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.026+0000 7f41858dd640 1 -- 172.21.15.6:0/1176468517 learned_addr learned my addr 172.21.15.6:0/1176468517 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.026+0000 7f41850dc640 1 --2- 172.21.15.6:0/1176468517 >> v2:172.21.15.161:3300/0 conn(0x7f41800b7c70 0x7f41800d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.026+0000 7f41858dd640 1 -- 172.21.15.6:0/1176468517 >> v2:172.21.15.161:3300/0 conn(0x7f41800b7c70 msgr2=0x7f41800d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:45.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.026+0000 7f41858dd640 1 --2- 172.21.15.6:0/1176468517 >> v2:172.21.15.161:3300/0 conn(0x7f41800b7c70 0x7f41800d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.026+0000 7f41858dd640 1 -- 172.21.15.6:0/1176468517 >> v1:172.21.15.161:6789/0 conn(0x7f41800d1850 legacy=0x7f418015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:45.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.026+0000 7f41858dd640 1 -- 172.21.15.6:0/1176468517 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4180160320 con 0x7f418015fd60 2023-07-21T22:35:45.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.030+0000 7f41858dd640 1 --2- 172.21.15.6:0/1176468517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418015fd60 0x7f41800d1da0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f41800b40a0 tx=0x7f417801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5bc7e309d13ef2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:45.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.030+0000 7f4177fff640 1 -- 172.21.15.6:0/1176468517 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41780a5880 con 0x7f418015fd60 2023-07-21T22:35:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.030+0000 7f4177fff640 1 -- 172.21.15.6:0/1176468517 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41780a59e0 con 0x7f418015fd60 2023-07-21T22:35:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.030+0000 7f4177fff640 1 -- 172.21.15.6:0/1176468517 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41780a5d70 con 0x7f418015fd60 2023-07-21T22:35:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.030+0000 7f4187340640 1 -- 172.21.15.6:0/1176468517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418015fd60 msgr2=0x7f41800d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.030+0000 7f4187340640 1 --2- 172.21.15.6:0/1176468517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418015fd60 0x7f41800d1da0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f41800b40a0 tx=0x7f417801c9a0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.030+0000 7f4187340640 1 -- 172.21.15.6:0/1176468517 shutdown_connections 2023-07-21T22:35:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.030+0000 7f4187340640 1 --2- 172.21.15.6:0/1176468517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418015fd60 0x7f41800d1da0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.030+0000 7f4187340640 1 --2- 172.21.15.6:0/1176468517 >> v2:172.21.15.161:3300/0 conn(0x7f41800b7c70 0x7f41800d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.030+0000 7f4187340640 1 -- 172.21.15.6:0/1176468517 >> 172.21.15.6:0/1176468517 conn(0x7f41800650b0 msgr2=0x7f41800654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.030+0000 7f4187340640 1 -- 172.21.15.6:0/1176468517 shutdown_connections 2023-07-21T22:35:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.030+0000 7f4187340640 1 -- 172.21.15.6:0/1176468517 wait complete. 2023-07-21T22:35:45.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f4187340640 1 Processor -- start 2023-07-21T22:35:45.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f4187340640 1 -- start start 2023-07-21T22:35:45.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f4187340640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41800b7c70 0x7f4180154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:45.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f4187340640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41800d1850 0x7f41800cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:45.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f4187340640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f418015fd60 0x7f41800cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:45.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f4187340640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41800ca230 con 0x7f41800d1850 2023-07-21T22:35:45.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f4187340640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41800cc140 con 0x7f418015fd60 2023-07-21T22:35:45.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f4187340640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41800c9470 con 0x7f41800b7c70 2023-07-21T22:35:45.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f41848db640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41800d1850 0x7f41800cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:45.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f41848db640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41800d1850 0x7f41800cb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48520/0 (socket says 172.21.15.6:48520) 2023-07-21T22:35:45.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f41848db640 1 -- 172.21.15.6:0/2094034891 learned_addr learned my addr 172.21.15.6:0/2094034891 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:45.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f41858dd640 1 --2- 172.21.15.6:0/2094034891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f418015fd60 0x7f41800cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:45.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f41850dc640 1 --2- 172.21.15.6:0/2094034891 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41800b7c70 0x7f4180154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:45.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f41848db640 1 -- 172.21.15.6:0/2094034891 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41800b7c70 msgr2=0x7f4180154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:45.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f41848db640 1 --2- 172.21.15.6:0/2094034891 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41800b7c70 0x7f4180154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f41848db640 1 -- 172.21.15.6:0/2094034891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f418015fd60 msgr2=0x7f41800cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:45.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f41848db640 1 --2- 172.21.15.6:0/2094034891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f418015fd60 0x7f41800cbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f41848db640 1 -- 172.21.15.6:0/2094034891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4178009b30 con 0x7f41800d1850 2023-07-21T22:35:45.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f41850dc640 1 --2- 172.21.15.6:0/2094034891 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41800b7c70 0x7f4180154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:45.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f41848db640 1 --2- 172.21.15.6:0/2094034891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41800d1850 0x7f41800cb5f0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f417000c3c0 tx=0x7f417000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:45.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f4175ffb640 1 -- 172.21.15.6:0/2094034891 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700052d0 con 0x7f41800d1850 2023-07-21T22:35:45.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f4175ffb640 1 -- 172.21.15.6:0/2094034891 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4170005430 con 0x7f41800d1850 2023-07-21T22:35:45.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f4175ffb640 1 -- 172.21.15.6:0/2094034891 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170003840 con 0x7f41800d1850 2023-07-21T22:35:45.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.034+0000 7f4187340640 1 -- 172.21.15.6:0/2094034891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41800c9750 con 0x7f41800d1850 2023-07-21T22:35:45.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.038+0000 7f4187340640 1 -- 172.21.15.6:0/2094034891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41800c9d10 con 0x7f41800d1850 2023-07-21T22:35:45.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.038+0000 7f4187340640 1 -- 172.21.15.6:0/2094034891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41800678d0 con 0x7f41800d1850 2023-07-21T22:35:45.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.038+0000 7f4175ffb640 1 -- 172.21.15.6:0/2094034891 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f41700039a0 con 0x7f41800d1850 2023-07-21T22:35:45.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.038+0000 7f4175ffb640 1 --2- 172.21.15.6:0/2094034891 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f41640663a0 0x7f4164068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:45.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.038+0000 7f4175ffb640 1 -- 172.21.15.6:0/2094034891 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f41700833b0 con 0x7f41800d1850 2023-07-21T22:35:45.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.038+0000 7f41850dc640 1 --2- 172.21.15.6:0/2094034891 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f41640663a0 0x7f4164068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:45.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.038+0000 7f41850dc640 1 --2- 172.21.15.6:0/2094034891 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f41640663a0 0x7f4164068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f417c009b10 tx=0x7f417c008040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:45.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.042+0000 7f4175ffb640 1 -- 172.21.15.6:0/2094034891 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4170050700 con 0x7f41800d1850 2023-07-21T22:35:45.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.230+0000 7f4187340640 1 -- 172.21.15.6:0/2094034891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41800d2ec0 con 0x7f41800d1850 2023-07-21T22:35:45.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.230+0000 7f4175ffb640 1 -- 172.21.15.6:0/2094034891 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4667 (secure 0 0 0) 0x7f4170053d20 con 0x7f41800d1850 2023-07-21T22:35:45.280 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:45.281 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6716,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/128364815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":128364815},{"type":"v1","addr":"172.21.15.161:6836","nonce":128364815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6719,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1447795142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1447795142},{"type":"v1","addr":"172.21.15.161:6837","nonce":1447795142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7653,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/921116259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":921116259},{"type":"v1","addr":"172.21.15.6:6833","nonce":921116259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:35:40.812228+0000","modified":"2023-07-21T22:35:44.851097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2789884551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2789884551},{"type":"v1","addr":"172.21.15.6:6835","nonce":2789884551}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-21T22:35:45.281 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 47 2023-07-21T22:35:45.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.230+0000 7f4187340640 1 -- 172.21.15.6:0/2094034891 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f41640663a0 msgr2=0x7f4164068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:45.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.230+0000 7f4187340640 1 --2- 172.21.15.6:0/2094034891 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f41640663a0 0x7f4164068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f417c009b10 tx=0x7f417c008040 comp rx=0 tx=0).stop 2023-07-21T22:35:45.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.230+0000 7f4187340640 1 -- 172.21.15.6:0/2094034891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41800d1850 msgr2=0x7f41800cb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:45.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.230+0000 7f4187340640 1 --2- 172.21.15.6:0/2094034891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41800d1850 0x7f41800cb5f0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f417000c3c0 tx=0x7f417000c880 comp rx=0 tx=0).stop 2023-07-21T22:35:45.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.230+0000 7f4187340640 1 -- 172.21.15.6:0/2094034891 shutdown_connections 2023-07-21T22:35:45.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.230+0000 7f4187340640 1 --2- 172.21.15.6:0/2094034891 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f41640663a0 0x7f4164068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.230+0000 7f4187340640 1 --2- 172.21.15.6:0/2094034891 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f418015fd60 0x7f41800cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.230+0000 7f4187340640 1 --2- 172.21.15.6:0/2094034891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41800d1850 0x7f41800cb5f0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.230+0000 7f4187340640 1 --2- 172.21.15.6:0/2094034891 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41800b7c70 0x7f4180154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.230+0000 7f4187340640 1 -- 172.21.15.6:0/2094034891 >> 172.21.15.6:0/2094034891 conn(0x7f41800650b0 msgr2=0x7f4180065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:45.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.230+0000 7f4187340640 1 -- 172.21.15.6:0/2094034891 shutdown_connections 2023-07-21T22:35:45.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.230+0000 7f4187340640 1 -- 172.21.15.6:0/2094034891 wait complete. 2023-07-21T22:35:45.302 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:35:45.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.394+0000 7f8a779d2640 1 Processor -- start 2023-07-21T22:35:45.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.394+0000 7f8a779d2640 1 -- start start 2023-07-21T22:35:45.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.398+0000 7f8a779d2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8a700ae1f0 0x7f8a700b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:45.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.398+0000 7f8a779d2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8a7006c430 0x7f8a70069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:45.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.398+0000 7f8a779d2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a700b24f0 con 0x7f8a7006e160 2023-07-21T22:35:45.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.398+0000 7f8a779d2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a700b27d0 con 0x7f8a700ae1f0 2023-07-21T22:35:45.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.398+0000 7f8a779d2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a700b2ab0 con 0x7f8a7006c430 2023-07-21T22:35:45.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.398+0000 7f8a7576e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8a700ae1f0 0x7f8a700b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:45.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.398+0000 7f8a7576e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8a700ae1f0 0x7f8a700b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48536/0 (socket says 172.21.15.6:48536) 2023-07-21T22:35:45.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.398+0000 7f8a7576e640 1 -- 172.21.15.6:0/1289782116 learned_addr learned my addr 172.21.15.6:0/1289782116 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:45.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.398+0000 7f8a74f6d640 1 --1- 172.21.15.6:0/1289782116 >> v1:172.21.15.6:6789/0 conn(0x7f8a7006e160 0x7f8a7006bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36946/0 (socket says 172.21.15.6:36946) 2023-07-21T22:35:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.398+0000 7f8a75f6f640 1 --2- 172.21.15.6:0/1289782116 >> v2:172.21.15.161:3300/0 conn(0x7f8a7006c430 0x7f8a70069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.398+0000 7f8a7576e640 1 -- 172.21.15.6:0/1289782116 >> v2:172.21.15.161:3300/0 conn(0x7f8a7006c430 msgr2=0x7f8a70069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.398+0000 7f8a7576e640 1 --2- 172.21.15.6:0/1289782116 >> v2:172.21.15.161:3300/0 conn(0x7f8a7006c430 0x7f8a70069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.398+0000 7f8a7576e640 1 -- 172.21.15.6:0/1289782116 >> v1:172.21.15.6:6789/0 conn(0x7f8a7006e160 legacy=0x7f8a7006bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:45.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.398+0000 7f8a7576e640 1 -- 172.21.15.6:0/1289782116 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a700b2d90 con 0x7f8a700ae1f0 2023-07-21T22:35:45.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.398+0000 7f8a7576e640 1 --2- 172.21.15.6:0/1289782116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a700ae1f0 0x7f8a700b1e60 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f8a700658f0 tx=0x7f8a6c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65eecea52ac7db7f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:45.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a67fff640 1 -- 172.21.15.6:0/1289782116 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c0aa650 con 0x7f8a700ae1f0 2023-07-21T22:35:45.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a67fff640 1 -- 172.21.15.6:0/1289782116 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6c0aa7b0 con 0x7f8a700ae1f0 2023-07-21T22:35:45.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a67fff640 1 -- 172.21.15.6:0/1289782116 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c0aab40 con 0x7f8a700ae1f0 2023-07-21T22:35:45.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a779d2640 1 -- 172.21.15.6:0/1289782116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a700ae1f0 msgr2=0x7f8a700b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a779d2640 1 --2- 172.21.15.6:0/1289782116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a700ae1f0 0x7f8a700b1e60 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f8a700658f0 tx=0x7f8a6c01c4d0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a779d2640 1 -- 172.21.15.6:0/1289782116 shutdown_connections 2023-07-21T22:35:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a779d2640 1 --2- 172.21.15.6:0/1289782116 >> v2:172.21.15.161:3300/0 conn(0x7f8a7006c430 0x7f8a70069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a779d2640 1 --2- 172.21.15.6:0/1289782116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a700ae1f0 0x7f8a700b1e60 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a779d2640 1 -- 172.21.15.6:0/1289782116 >> 172.21.15.6:0/1289782116 conn(0x7f8a700b1300 msgr2=0x7f8a700ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:45.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a779d2640 1 -- 172.21.15.6:0/1289782116 shutdown_connections 2023-07-21T22:35:45.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a779d2640 1 -- 172.21.15.6:0/1289782116 wait complete. 2023-07-21T22:35:45.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a779d2640 1 Processor -- start 2023-07-21T22:35:45.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a779d2640 1 -- start start 2023-07-21T22:35:45.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a779d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a7006c430 0x7f8a7013e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:45.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a779d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a7006e160 0x7f8a700cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:45.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a779d2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a700ae1f0 0x7f8a700af630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:45.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a779d2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7015d3e0 con 0x7f8a7006e160 2023-07-21T22:35:45.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a779d2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7015c340 con 0x7f8a700ae1f0 2023-07-21T22:35:45.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a779d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7015c620 con 0x7f8a7006c430 2023-07-21T22:35:45.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a74f6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a7006e160 0x7f8a700cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:45.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a74f6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a7006e160 0x7f8a700cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48548/0 (socket says 172.21.15.6:48548) 2023-07-21T22:35:45.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a74f6d640 1 -- 172.21.15.6:0/3887720817 learned_addr learned my addr 172.21.15.6:0/3887720817 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:45.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a7576e640 1 --2- 172.21.15.6:0/3887720817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a7006c430 0x7f8a7013e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:45.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.402+0000 7f8a75f6f640 1 --2- 172.21.15.6:0/3887720817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a700ae1f0 0x7f8a700af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:45.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.406+0000 7f8a74f6d640 1 -- 172.21.15.6:0/3887720817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a7006c430 msgr2=0x7f8a7013e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:45.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.406+0000 7f8a74f6d640 1 --2- 172.21.15.6:0/3887720817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a7006c430 0x7f8a7013e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.406+0000 7f8a74f6d640 1 -- 172.21.15.6:0/3887720817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a700ae1f0 msgr2=0x7f8a700af630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:45.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.406+0000 7f8a74f6d640 1 --2- 172.21.15.6:0/3887720817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a700ae1f0 0x7f8a700af630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.406+0000 7f8a74f6d640 1 -- 172.21.15.6:0/3887720817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c0094d0 con 0x7f8a7006e160 2023-07-21T22:35:45.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.406+0000 7f8a74f6d640 1 --2- 172.21.15.6:0/3887720817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a7006e160 0x7f8a700cddf0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000c490 tx=0x7f8a6000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:45.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.406+0000 7f8a65ffb640 1 -- 172.21.15.6:0/3887720817 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a60007480 con 0x7f8a7006e160 2023-07-21T22:35:45.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.406+0000 7f8a65ffb640 1 -- 172.21.15.6:0/3887720817 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a600075e0 con 0x7f8a7006e160 2023-07-21T22:35:45.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.406+0000 7f8a65ffb640 1 -- 172.21.15.6:0/3887720817 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a60004a10 con 0x7f8a7006e160 2023-07-21T22:35:45.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.406+0000 7f8a779d2640 1 -- 172.21.15.6:0/3887720817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a700b3710 con 0x7f8a7006e160 2023-07-21T22:35:45.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.406+0000 7f8a779d2640 1 -- 172.21.15.6:0/3887720817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a7015cbe0 con 0x7f8a7006e160 2023-07-21T22:35:45.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.406+0000 7f8a779d2640 1 -- 172.21.15.6:0/3887720817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a700678d0 con 0x7f8a7006e160 2023-07-21T22:35:45.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.406+0000 7f8a65ffb640 1 -- 172.21.15.6:0/3887720817 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8a60004b70 con 0x7f8a7006e160 2023-07-21T22:35:45.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.406+0000 7f8a65ffb640 1 --2- 172.21.15.6:0/3887720817 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f8a540663a0 0x7f8a54068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:45.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.406+0000 7f8a65ffb640 1 -- 172.21.15.6:0/3887720817 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f8a600830f0 con 0x7f8a7006e160 2023-07-21T22:35:45.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.410+0000 7f8a7576e640 1 --2- 172.21.15.6:0/3887720817 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f8a540663a0 0x7f8a54068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:45.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.410+0000 7f8a7576e640 1 --2- 172.21.15.6:0/3887720817 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f8a540663a0 0x7f8a54068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0ae000 tx=0x7f8a6c0b5040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:45.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.410+0000 7f8a65ffb640 1 -- 172.21.15.6:0/3887720817 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8a600503b0 con 0x7f8a7006e160 2023-07-21T22:35:45.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.566+0000 7f8a779d2640 1 -- 172.21.15.6:0/3887720817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a70066810 con 0x7f8a7006e160 2023-07-21T22:35:45.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.570+0000 7f8a65ffb640 1 -- 172.21.15.6:0/3887720817 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+18303 (secure 0 0 0) 0x7f8a600539d0 con 0x7f8a7006e160 2023-07-21T22:35:45.620 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:45.620 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":112,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:35:42.454086+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:35:38.932763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-21T22:35:39.805137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:35:45.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.570+0000 7f8a779d2640 1 -- 172.21.15.6:0/3887720817 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f8a540663a0 msgr2=0x7f8a54068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:45.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.570+0000 7f8a779d2640 1 --2- 172.21.15.6:0/3887720817 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f8a540663a0 0x7f8a54068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0ae000 tx=0x7f8a6c0b5040 comp rx=0 tx=0).stop 2023-07-21T22:35:45.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.570+0000 7f8a779d2640 1 -- 172.21.15.6:0/3887720817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a7006e160 msgr2=0x7f8a700cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:45.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.570+0000 7f8a779d2640 1 --2- 172.21.15.6:0/3887720817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a7006e160 0x7f8a700cddf0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000c490 tx=0x7f8a6000c950 comp rx=0 tx=0).stop 2023-07-21T22:35:45.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.570+0000 7f8a779d2640 1 -- 172.21.15.6:0/3887720817 shutdown_connections 2023-07-21T22:35:45.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.570+0000 7f8a779d2640 1 --2- 172.21.15.6:0/3887720817 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f8a540663a0 0x7f8a54068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.570+0000 7f8a779d2640 1 --2- 172.21.15.6:0/3887720817 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8a700ae1f0 0x7f8a700af630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.570+0000 7f8a779d2640 1 --2- 172.21.15.6:0/3887720817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a7006e160 0x7f8a700cddf0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.570+0000 7f8a779d2640 1 --2- 172.21.15.6:0/3887720817 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8a7006c430 0x7f8a7013e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.570+0000 7f8a779d2640 1 -- 172.21.15.6:0/3887720817 >> 172.21.15.6:0/3887720817 conn(0x7f8a700b1300 msgr2=0x7f8a70142370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:45.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.570+0000 7f8a779d2640 1 -- 172.21.15.6:0/3887720817 shutdown_connections 2023-07-21T22:35:45.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.570+0000 7f8a779d2640 1 -- 172.21.15.6:0/3887720817 wait complete. 2023-07-21T22:35:45.640 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T22:35:45.641 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:35:45.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.734+0000 7f005ed03640 1 Processor -- start 2023-07-21T22:35:45.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.734+0000 7f005ed03640 1 -- start start 2023-07-21T22:35:45.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.738+0000 7f005ed03640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0058158ce0 0x7f0058070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:45.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.738+0000 7f005ed03640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00580c8ad0 0x7f00580c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:45.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.738+0000 7f005ed03640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f00580c9560 0x7f00580cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:45.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.738+0000 7f005ed03640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00580c99e0 con 0x7f00580c8ad0 2023-07-21T22:35:45.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.738+0000 7f005ed03640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00580cc700 con 0x7f00580c9560 2023-07-21T22:35:45.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.738+0000 7f005ed03640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00580b0ff0 con 0x7f0058158ce0 2023-07-21T22:35:45.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.738+0000 7f0057fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00580c8ad0 0x7f00580c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:45.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.738+0000 7f0057fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f00580c8ad0 0x7f00580c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48552/0 (socket says 172.21.15.6:48552) 2023-07-21T22:35:45.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.738+0000 7f0057fff640 1 -- 172.21.15.6:0/1179467583 learned_addr learned my addr 172.21.15.6:0/1179467583 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:45.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.738+0000 7f005ca9f640 1 --2- 172.21.15.6:0/1179467583 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0058158ce0 0x7f0058070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:45.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.738+0000 7f005d2a0640 1 --2- 172.21.15.6:0/1179467583 >> v2:172.21.15.161:3300/0 conn(0x7f00580c9560 0x7f00580cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:45.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.738+0000 7f0057fff640 1 -- 172.21.15.6:0/1179467583 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0058158ce0 msgr2=0x7f0058070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:45.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.738+0000 7f0057fff640 1 --2- 172.21.15.6:0/1179467583 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0058158ce0 0x7f0058070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.738+0000 7f0057fff640 1 -- 172.21.15.6:0/1179467583 >> v2:172.21.15.161:3300/0 conn(0x7f00580c9560 msgr2=0x7f00580cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:45.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.738+0000 7f0057fff640 1 --2- 172.21.15.6:0/1179467583 >> v2:172.21.15.161:3300/0 conn(0x7f00580c9560 0x7f00580cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.738+0000 7f0057fff640 1 -- 172.21.15.6:0/1179467583 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0058070c80 con 0x7f00580c8ad0 2023-07-21T22:35:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.738+0000 7f005d2a0640 1 --2- 172.21.15.6:0/1179467583 >> v2:172.21.15.161:3300/0 conn(0x7f00580c9560 0x7f00580cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.738+0000 7f005ca9f640 1 --2- 172.21.15.6:0/1179467583 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0058158ce0 0x7f0058070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.738+0000 7f0057fff640 1 --2- 172.21.15.6:0/1179467583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00580c8ad0 0x7f00580c9020 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f00580c17e0 tx=0x7f004401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3ae1ff7eaccbab server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f00577fe640 1 -- 172.21.15.6:0/1179467583 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00440ab600 con 0x7f00580c8ad0 2023-07-21T22:35:45.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f00577fe640 1 -- 172.21.15.6:0/1179467583 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00440a7050 con 0x7f00580c8ad0 2023-07-21T22:35:45.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f00577fe640 1 -- 172.21.15.6:0/1179467583 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00440ab980 con 0x7f00580c8ad0 2023-07-21T22:35:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f005ed03640 1 -- 172.21.15.6:0/1179467583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00580c8ad0 msgr2=0x7f00580c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f005ed03640 1 --2- 172.21.15.6:0/1179467583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00580c8ad0 0x7f00580c9020 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f00580c17e0 tx=0x7f004401c3b0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f005ed03640 1 -- 172.21.15.6:0/1179467583 shutdown_connections 2023-07-21T22:35:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f005ed03640 1 --2- 172.21.15.6:0/1179467583 >> v2:172.21.15.161:3300/0 conn(0x7f00580c9560 0x7f00580cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f005ed03640 1 --2- 172.21.15.6:0/1179467583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00580c8ad0 0x7f00580c9020 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f005ed03640 1 --2- 172.21.15.6:0/1179467583 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0058158ce0 0x7f0058070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f005ed03640 1 -- 172.21.15.6:0/1179467583 >> 172.21.15.6:0/1179467583 conn(0x7f00580afcf0 msgr2=0x7f00580b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f005ed03640 1 -- 172.21.15.6:0/1179467583 shutdown_connections 2023-07-21T22:35:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f005ed03640 1 -- 172.21.15.6:0/1179467583 wait complete. 2023-07-21T22:35:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f005ed03640 1 Processor -- start 2023-07-21T22:35:45.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f005ed03640 1 -- start start 2023-07-21T22:35:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f005ed03640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00580c8ad0 0x7f00580c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f005ed03640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00580c9560 0x7f0058151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f005ed03640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0058158ce0 0x7f00581502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f005ed03640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00580c5230 con 0x7f00580c8ad0 2023-07-21T22:35:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f005ed03640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00580c2e00 con 0x7f00580c9560 2023-07-21T22:35:45.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f005ed03640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00580c30e0 con 0x7f0058158ce0 2023-07-21T22:35:45.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f005ca9f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00580c8ad0 0x7f00580c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:45.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.742+0000 7f005ca9f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00580c8ad0 0x7f00580c3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48560/0 (socket says 172.21.15.6:48560) 2023-07-21T22:35:45.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.746+0000 7f005ca9f640 1 -- 172.21.15.6:0/629825783 learned_addr learned my addr 172.21.15.6:0/629825783 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:45.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.746+0000 7f005ca9f640 1 -- 172.21.15.6:0/629825783 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0058158ce0 msgr2=0x7f00581502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:45.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.746+0000 7f005d2a0640 1 --2- 172.21.15.6:0/629825783 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0058158ce0 0x7f00581502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:45.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.746+0000 7f005ca9f640 1 --2- 172.21.15.6:0/629825783 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0058158ce0 0x7f00581502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.746+0000 7f0057fff640 1 --2- 172.21.15.6:0/629825783 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00580c9560 0x7f0058151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:45.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.746+0000 7f005ca9f640 1 -- 172.21.15.6:0/629825783 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00580c9560 msgr2=0x7f0058151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:45.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.746+0000 7f005ca9f640 1 --2- 172.21.15.6:0/629825783 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00580c9560 0x7f0058151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.746+0000 7f005ca9f640 1 -- 172.21.15.6:0/629825783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00440094d0 con 0x7f00580c8ad0 2023-07-21T22:35:45.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.746+0000 7f005d2a0640 1 --2- 172.21.15.6:0/629825783 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0058158ce0 0x7f00581502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:45.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.746+0000 7f0057fff640 1 --2- 172.21.15.6:0/629825783 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00580c9560 0x7f0058151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:45.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.746+0000 7f005ca9f640 1 --2- 172.21.15.6:0/629825783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00580c8ad0 0x7f00580c3b00 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f004c00c7f0 tx=0x7f004c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:45.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.746+0000 7f00557fa640 1 -- 172.21.15.6:0/629825783 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c007820 con 0x7f00580c8ad0 2023-07-21T22:35:45.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.746+0000 7f00557fa640 1 -- 172.21.15.6:0/629825783 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c007980 con 0x7f00580c8ad0 2023-07-21T22:35:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.746+0000 7f00557fa640 1 -- 172.21.15.6:0/629825783 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c007d30 con 0x7f00580c8ad0 2023-07-21T22:35:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.746+0000 7f005ed03640 1 -- 172.21.15.6:0/629825783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00580c33c0 con 0x7f00580c8ad0 2023-07-21T22:35:45.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.746+0000 7f005ed03640 1 -- 172.21.15.6:0/629825783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005814fa70 con 0x7f00580c8ad0 2023-07-21T22:35:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.746+0000 7f005ed03640 1 -- 172.21.15.6:0/629825783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00580ca1a0 con 0x7f00580c8ad0 2023-07-21T22:35:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.746+0000 7f00557fa640 1 -- 172.21.15.6:0/629825783 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f004c0113f0 con 0x7f00580c8ad0 2023-07-21T22:35:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.750+0000 7f00557fa640 1 --2- 172.21.15.6:0/629825783 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f003c0663d0 0x7f003c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.750+0000 7f00557fa640 1 -- 172.21.15.6:0/629825783 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f004c084310 con 0x7f00580c8ad0 2023-07-21T22:35:45.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.750+0000 7f0057fff640 1 --2- 172.21.15.6:0/629825783 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f003c0663d0 0x7f003c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:45.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.750+0000 7f0057fff640 1 --2- 172.21.15.6:0/629825783 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f003c0663d0 0x7f003c068880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f00440ad000 tx=0x7f0044008040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:45.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.754+0000 7f00557fa640 1 -- 172.21.15.6:0/629825783 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f004c0514a0 con 0x7f00580c8ad0 2023-07-21T22:35:45.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.902+0000 7f005ed03640 1 -- 172.21.15.6:0/629825783 --> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00580c3250 con 0x7f003c0663d0 2023-07-21T22:35:45.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.918+0000 7f00557fa640 1 -- 172.21.15.6:0/629825783 <== mgr.7255 v2:172.21.15.161:6832/3891612664 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305945 (secure 0 0 0) 0x7f00580c3250 con 0x7f003c0663d0 2023-07-21T22:35:45.968 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:45.969 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:35:45.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.918+0000 7f005ed03640 1 -- 172.21.15.6:0/629825783 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f003c0663d0 msgr2=0x7f003c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:45.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.918+0000 7f005ed03640 1 --2- 172.21.15.6:0/629825783 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f003c0663d0 0x7f003c068880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f00440ad000 tx=0x7f0044008040 comp rx=0 tx=0).stop 2023-07-21T22:35:45.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.918+0000 7f005ed03640 1 -- 172.21.15.6:0/629825783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00580c8ad0 msgr2=0x7f00580c3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:45.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.918+0000 7f005ed03640 1 --2- 172.21.15.6:0/629825783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00580c8ad0 0x7f00580c3b00 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f004c00c7f0 tx=0x7f004c00ccb0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.918+0000 7f005ed03640 1 -- 172.21.15.6:0/629825783 shutdown_connections 2023-07-21T22:35:45.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.918+0000 7f005ed03640 1 --2- 172.21.15.6:0/629825783 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f003c0663d0 0x7f003c068880 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.918+0000 7f005ed03640 1 --2- 172.21.15.6:0/629825783 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0058158ce0 0x7f00581502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.918+0000 7f005ed03640 1 --2- 172.21.15.6:0/629825783 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00580c9560 0x7f0058151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.918+0000 7f005ed03640 1 --2- 172.21.15.6:0/629825783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00580c8ad0 0x7f00580c3b00 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:45.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.918+0000 7f005ed03640 1 -- 172.21.15.6:0/629825783 >> 172.21.15.6:0/629825783 conn(0x7f00580afcf0 msgr2=0x7f00580c1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:45.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.918+0000 7f005ed03640 1 -- 172.21.15.6:0/629825783 shutdown_connections 2023-07-21T22:35:45.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:45.918+0000 7f005ed03640 1 -- 172.21.15.6:0/629825783 wait complete. 2023-07-21T22:35:45.988 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-21T22:35:45.025581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":312484,"kb_used_data":11620,"kb_used_omap":0,"kb_used_meta":300800,"kb_avail":754662236,"statfs":{"total":773094113280,"available":772774129664,"internally_reserved":0,"allocated":11898880,"data_stored":6525240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308019200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.615934"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.423025+0000","last_change":"2023-07-21T22:35:40.423025+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.423025+0000","last_undegraded":"2023-07-21T22:35:40.423025+0000","last_fullsized":"2023-07-21T22:35:40.423025+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420047+0000","last_change":"2023-07-21T22:35:40.420047+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420047+0000","last_undegraded":"2023-07-21T22:35:40.420047+0000","last_fullsized":"2023-07-21T22:35:40.420047+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.421225+0000","last_change":"2023-07-21T22:35:40.421225+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.421225+0000","last_undegraded":"2023-07-21T22:35:40.421225+0000","last_fullsized":"2023-07-21T22:35:40.421225+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.421779+0000","last_change":"2023-07-21T22:35:40.421779+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.421779+0000","last_undegraded":"2023-07-21T22:35:40.421779+0000","last_fullsized":"2023-07-21T22:35:40.421779+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.429598+0000","last_change":"2023-07-21T22:35:40.429598+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.429598+0000","last_undegraded":"2023-07-21T22:35:40.429598+0000","last_fullsized":"2023-07-21T22:35:40.429598+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.430526+0000","last_change":"2023-07-21T22:35:40.430526+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.430526+0000","last_undegraded":"2023-07-21T22:35:40.430526+0000","last_fullsized":"2023-07-21T22:35:40.430526+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424526+0000","last_change":"2023-07-21T22:35:40.424526+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424526+0000","last_undegraded":"2023-07-21T22:35:40.424526+0000","last_fullsized":"2023-07-21T22:35:40.424526+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420838+0000","last_change":"2023-07-21T22:35:40.420838+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420838+0000","last_undegraded":"2023-07-21T22:35:40.420838+0000","last_fullsized":"2023-07-21T22:35:40.420838+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424353+0000","last_change":"2023-07-21T22:35:40.424353+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424353+0000","last_undegraded":"2023-07-21T22:35:40.424353+0000","last_fullsized":"2023-07-21T22:35:40.424353+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.418763+0000","last_change":"2023-07-21T22:35:40.418763+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.418763+0000","last_undegraded":"2023-07-21T22:35:40.418763+0000","last_fullsized":"2023-07-21T22:35:40.418763+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.430089+0000","last_change":"2023-07-21T22:35:40.430089+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.430089+0000","last_undegraded":"2023-07-21T22:35:40.430089+0000","last_fullsized":"2023-07-21T22:35:40.430089+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.418675+0000","last_change":"2023-07-21T22:35:40.418675+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.418675+0000","last_undegraded":"2023-07-21T22:35:40.418675+0000","last_fullsized":"2023-07-21T22:35:40.418675+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420385+0000","last_change":"2023-07-21T22:35:40.420385+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420385+0000","last_undegraded":"2023-07-21T22:35:40.420385+0000","last_fullsized":"2023-07-21T22:35:40.420385+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.429283+0000","last_change":"2023-07-21T22:35:40.429283+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.429283+0000","last_undegraded":"2023-07-21T22:35:40.429283+0000","last_fullsized":"2023-07-21T22:35:40.429283+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.422505+0000","last_change":"2023-07-21T22:35:40.422505+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.422505+0000","last_undegraded":"2023-07-21T22:35:40.422505+0000","last_fullsized":"2023-07-21T22:35:40.422505+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.427423+0000","last_change":"2023-07-21T22:35:40.427423+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.427423+0000","last_undegraded":"2023-07-21T22:35:40.427423+0000","last_fullsized":"2023-07-21T22:35:40.427423+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.428251+0000","last_change":"2023-07-21T22:35:40.428251+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.428251+0000","last_undegraded":"2023-07-21T22:35:40.428251+0000","last_fullsized":"2023-07-21T22:35:40.428251+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.425699+0000","last_change":"2023-07-21T22:35:40.425699+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.425699+0000","last_undegraded":"2023-07-21T22:35:40.425699+0000","last_fullsized":"2023-07-21T22:35:40.425699+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424851+0000","last_change":"2023-07-21T22:35:40.424851+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424851+0000","last_undegraded":"2023-07-21T22:35:40.424851+0000","last_fullsized":"2023-07-21T22:35:40.424851+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.421317+0000","last_change":"2023-07-21T22:35:40.421317+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.421317+0000","last_undegraded":"2023-07-21T22:35:40.421317+0000","last_fullsized":"2023-07-21T22:35:40.421317+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.425277+0000","last_change":"2023-07-21T22:35:40.425277+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.425277+0000","last_undegraded":"2023-07-21T22:35:40.425277+0000","last_fullsized":"2023-07-21T22:35:40.425277+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.428797+0000","last_change":"2023-07-21T22:35:40.428797+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.428797+0000","last_undegraded":"2023-07-21T22:35:40.428797+0000","last_fullsized":"2023-07-21T22:35:40.428797+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424752+0000","last_change":"2023-07-21T22:35:40.424752+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424752+0000","last_undegraded":"2023-07-21T22:35:40.424752+0000","last_fullsized":"2023-07-21T22:35:40.424752+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420692+0000","last_change":"2023-07-21T22:35:40.420692+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420692+0000","last_undegraded":"2023-07-21T22:35:40.420692+0000","last_fullsized":"2023-07-21T22:35:40.420692+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420732+0000","last_change":"2023-07-21T22:35:40.420732+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420732+0000","last_undegraded":"2023-07-21T22:35:40.420732+0000","last_fullsized":"2023-07-21T22:35:40.420732+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.430470+0000","last_change":"2023-07-21T22:35:40.430470+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.430470+0000","last_undegraded":"2023-07-21T22:35:40.430470+0000","last_fullsized":"2023-07-21T22:35:40.430470+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.418305+0000","last_change":"2023-07-21T22:35:40.418305+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.418305+0000","last_undegraded":"2023-07-21T22:35:40.418305+0000","last_fullsized":"2023-07-21T22:35:40.418305+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420896+0000","last_change":"2023-07-21T22:35:40.420896+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420896+0000","last_undegraded":"2023-07-21T22:35:40.420896+0000","last_fullsized":"2023-07-21T22:35:40.420896+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.425095+0000","last_change":"2023-07-21T22:35:40.425095+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.425095+0000","last_undegraded":"2023-07-21T22:35:40.425095+0000","last_fullsized":"2023-07-21T22:35:40.425095+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.428282+0000","last_change":"2023-07-21T22:35:40.428282+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.428282+0000","last_undegraded":"2023-07-21T22:35:40.428282+0000","last_fullsized":"2023-07-21T22:35:40.428282+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.421437+0000","last_change":"2023-07-21T22:35:40.421437+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.421437+0000","last_undegraded":"2023-07-21T22:35:40.421437+0000","last_fullsized":"2023-07-21T22:35:40.421437+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.426901+0000","last_change":"2023-07-21T22:35:40.426901+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.426901+0000","last_undegraded":"2023-07-21T22:35:40.426901+0000","last_fullsized":"2023-07-21T22:35:40.426901+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.429666+0000","last_change":"2023-07-21T22:35:40.429666+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.429666+0000","last_undegraded":"2023-07-21T22:35:40.429666+0000","last_fullsized":"2023-07-21T22:35:40.429666+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440773+0000","last_change":"2023-07-21T22:35:40.437895+0000","last_active":"2023-07-21T22:35:40.440773+0000","last_peered":"2023-07-21T22:35:40.440773+0000","last_clean":"2023-07-21T22:35:40.440773+0000","last_became_active":"2023-07-21T22:35:40.436744+0000","last_became_peered":"2023-07-21T22:35:40.436744+0000","last_unstale":"2023-07-21T22:35:40.440773+0000","last_undegraded":"2023-07-21T22:35:40.440773+0000","last_fullsized":"2023-07-21T22:35:40.440773+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:04:30.695462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.427873+0000","last_change":"2023-07-21T22:35:40.427873+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.427873+0000","last_undegraded":"2023-07-21T22:35:40.427873+0000","last_fullsized":"2023-07-21T22:35:40.427873+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.439030+0000","last_change":"2023-07-21T22:35:40.436147+0000","last_active":"2023-07-21T22:35:40.439030+0000","last_peered":"2023-07-21T22:35:40.439030+0000","last_clean":"2023-07-21T22:35:40.439030+0000","last_became_active":"2023-07-21T22:35:40.435878+0000","last_became_peered":"2023-07-21T22:35:40.435878+0000","last_unstale":"2023-07-21T22:35:40.439030+0000","last_undegraded":"2023-07-21T22:35:40.439030+0000","last_fullsized":"2023-07-21T22:35:40.439030+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:10:23.638420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.427840+0000","last_change":"2023-07-21T22:35:40.427840+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.427840+0000","last_undegraded":"2023-07-21T22:35:40.427840+0000","last_fullsized":"2023-07-21T22:35:40.427840+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.441589+0000","last_change":"2023-07-21T22:35:40.440062+0000","last_active":"2023-07-21T22:35:40.441589+0000","last_peered":"2023-07-21T22:35:40.441589+0000","last_clean":"2023-07-21T22:35:40.441589+0000","last_became_active":"2023-07-21T22:35:40.439791+0000","last_became_peered":"2023-07-21T22:35:40.439791+0000","last_unstale":"2023-07-21T22:35:40.441589+0000","last_undegraded":"2023-07-21T22:35:40.441589+0000","last_fullsized":"2023-07-21T22:35:40.441589+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:12:02.163677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.427792+0000","last_change":"2023-07-21T22:35:40.427792+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.427792+0000","last_undegraded":"2023-07-21T22:35:40.427792+0000","last_fullsized":"2023-07-21T22:35:40.427792+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440795+0000","last_change":"2023-07-21T22:35:40.437899+0000","last_active":"2023-07-21T22:35:40.440795+0000","last_peered":"2023-07-21T22:35:40.440795+0000","last_clean":"2023-07-21T22:35:40.440795+0000","last_became_active":"2023-07-21T22:35:40.437604+0000","last_became_peered":"2023-07-21T22:35:40.437604+0000","last_unstale":"2023-07-21T22:35:40.440795+0000","last_undegraded":"2023-07-21T22:35:40.440795+0000","last_fullsized":"2023-07-21T22:35:40.440795+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:39:42.918696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.422116+0000","last_change":"2023-07-21T22:35:40.422116+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.422116+0000","last_undegraded":"2023-07-21T22:35:40.422116+0000","last_fullsized":"2023-07-21T22:35:40.422116+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.441407+0000","last_change":"2023-07-21T22:35:40.439578+0000","last_active":"2023-07-21T22:35:40.441407+0000","last_peered":"2023-07-21T22:35:40.441407+0000","last_clean":"2023-07-21T22:35:40.441407+0000","last_became_active":"2023-07-21T22:35:40.439264+0000","last_became_peered":"2023-07-21T22:35:40.439264+0000","last_unstale":"2023-07-21T22:35:40.441407+0000","last_undegraded":"2023-07-21T22:35:40.441407+0000","last_fullsized":"2023-07-21T22:35:40.441407+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:44:32.158083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.423601+0000","last_change":"2023-07-21T22:35:40.423601+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.423601+0000","last_undegraded":"2023-07-21T22:35:40.423601+0000","last_fullsized":"2023-07-21T22:35:40.423601+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.438717+0000","last_change":"2023-07-21T22:35:40.434147+0000","last_active":"2023-07-21T22:35:40.438717+0000","last_peered":"2023-07-21T22:35:40.438717+0000","last_clean":"2023-07-21T22:35:40.438717+0000","last_became_active":"2023-07-21T22:35:40.433804+0000","last_became_peered":"2023-07-21T22:35:40.433804+0000","last_unstale":"2023-07-21T22:35:40.438717+0000","last_undegraded":"2023-07-21T22:35:40.438717+0000","last_fullsized":"2023-07-21T22:35:40.438717+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:15:30.169233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.428001+0000","last_change":"2023-07-21T22:35:40.428001+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.428001+0000","last_undegraded":"2023-07-21T22:35:40.428001+0000","last_fullsized":"2023-07-21T22:35:40.428001+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.432160+0000","last_change":"2023-07-21T22:35:40.429279+0000","last_active":"2023-07-21T22:35:40.432160+0000","last_peered":"2023-07-21T22:35:40.432160+0000","last_clean":"2023-07-21T22:35:40.432160+0000","last_became_active":"2023-07-21T22:35:40.428980+0000","last_became_peered":"2023-07-21T22:35:40.428980+0000","last_unstale":"2023-07-21T22:35:40.432160+0000","last_undegraded":"2023-07-21T22:35:40.432160+0000","last_fullsized":"2023-07-21T22:35:40.432160+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:18:25.057533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.419933+0000","last_change":"2023-07-21T22:35:40.419933+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.419933+0000","last_undegraded":"2023-07-21T22:35:40.419933+0000","last_fullsized":"2023-07-21T22:35:40.419933+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.441067+0000","last_change":"2023-07-21T22:35:40.439163+0000","last_active":"2023-07-21T22:35:40.441067+0000","last_peered":"2023-07-21T22:35:40.441067+0000","last_clean":"2023-07-21T22:35:40.441067+0000","last_became_active":"2023-07-21T22:35:40.438863+0000","last_became_peered":"2023-07-21T22:35:40.438863+0000","last_unstale":"2023-07-21T22:35:40.441067+0000","last_undegraded":"2023-07-21T22:35:40.441067+0000","last_fullsized":"2023-07-21T22:35:40.441067+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:42:44.074458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.423511+0000","last_change":"2023-07-21T22:35:40.423511+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.423511+0000","last_undegraded":"2023-07-21T22:35:40.423511+0000","last_fullsized":"2023-07-21T22:35:40.423511+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.434812+0000","last_change":"2023-07-21T22:35:40.429995+0000","last_active":"2023-07-21T22:35:40.434812+0000","last_peered":"2023-07-21T22:35:40.434812+0000","last_clean":"2023-07-21T22:35:40.434812+0000","last_became_active":"2023-07-21T22:35:40.429725+0000","last_became_peered":"2023-07-21T22:35:40.429725+0000","last_unstale":"2023-07-21T22:35:40.434812+0000","last_undegraded":"2023-07-21T22:35:40.434812+0000","last_fullsized":"2023-07-21T22:35:40.434812+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:42:10.458404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.425900+0000","last_change":"2023-07-21T22:35:40.425900+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.425900+0000","last_undegraded":"2023-07-21T22:35:40.425900+0000","last_fullsized":"2023-07-21T22:35:40.425900+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.439075+0000","last_change":"2023-07-21T22:35:40.434725+0000","last_active":"2023-07-21T22:35:40.439075+0000","last_peered":"2023-07-21T22:35:40.439075+0000","last_clean":"2023-07-21T22:35:40.439075+0000","last_became_active":"2023-07-21T22:35:40.434401+0000","last_became_peered":"2023-07-21T22:35:40.434401+0000","last_unstale":"2023-07-21T22:35:40.439075+0000","last_undegraded":"2023-07-21T22:35:40.439075+0000","last_fullsized":"2023-07-21T22:35:40.439075+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:34:40.402810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420142+0000","last_change":"2023-07-21T22:35:40.420142+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420142+0000","last_undegraded":"2023-07-21T22:35:40.420142+0000","last_fullsized":"2023-07-21T22:35:40.420142+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.444169+0000","last_change":"2023-07-21T22:35:40.441811+0000","last_active":"2023-07-21T22:35:40.444169+0000","last_peered":"2023-07-21T22:35:40.444169+0000","last_clean":"2023-07-21T22:35:40.444169+0000","last_became_active":"2023-07-21T22:35:40.441488+0000","last_became_peered":"2023-07-21T22:35:40.441488+0000","last_unstale":"2023-07-21T22:35:40.444169+0000","last_undegraded":"2023-07-21T22:35:40.444169+0000","last_fullsized":"2023-07-21T22:35:40.444169+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:42:59.390932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.419867+0000","last_change":"2023-07-21T22:35:40.419867+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.419867+0000","last_undegraded":"2023-07-21T22:35:40.419867+0000","last_fullsized":"2023-07-21T22:35:40.419867+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.435766+0000","last_change":"2023-07-21T22:35:40.431340+0000","last_active":"2023-07-21T22:35:40.435766+0000","last_peered":"2023-07-21T22:35:40.435766+0000","last_clean":"2023-07-21T22:35:40.435766+0000","last_became_active":"2023-07-21T22:35:40.430803+0000","last_became_peered":"2023-07-21T22:35:40.430803+0000","last_unstale":"2023-07-21T22:35:40.435766+0000","last_undegraded":"2023-07-21T22:35:40.435766+0000","last_fullsized":"2023-07-21T22:35:40.435766+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:21:07.099124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.421665+0000","last_change":"2023-07-21T22:35:40.421665+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.421665+0000","last_undegraded":"2023-07-21T22:35:40.421665+0000","last_fullsized":"2023-07-21T22:35:40.421665+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440900+0000","last_change":"2023-07-21T22:35:40.438909+0000","last_active":"2023-07-21T22:35:40.440900+0000","last_peered":"2023-07-21T22:35:40.440900+0000","last_clean":"2023-07-21T22:35:40.440900+0000","last_became_active":"2023-07-21T22:35:40.438607+0000","last_became_peered":"2023-07-21T22:35:40.438607+0000","last_unstale":"2023-07-21T22:35:40.440900+0000","last_undegraded":"2023-07-21T22:35:40.440900+0000","last_fullsized":"2023-07-21T22:35:40.440900+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:36:16.312658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.423470+0000","last_change":"2023-07-21T22:35:40.423470+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.423470+0000","last_undegraded":"2023-07-21T22:35:40.423470+0000","last_fullsized":"2023-07-21T22:35:40.423470+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.439493+0000","last_change":"2023-07-21T22:35:40.435925+0000","last_active":"2023-07-21T22:35:40.439493+0000","last_peered":"2023-07-21T22:35:40.439493+0000","last_clean":"2023-07-21T22:35:40.439493+0000","last_became_active":"2023-07-21T22:35:40.435648+0000","last_became_peered":"2023-07-21T22:35:40.435648+0000","last_unstale":"2023-07-21T22:35:40.439493+0000","last_undegraded":"2023-07-21T22:35:40.439493+0000","last_fullsized":"2023-07-21T22:35:40.439493+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:49:32.823030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.418106+0000","last_change":"2023-07-21T22:35:40.418106+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.418106+0000","last_undegraded":"2023-07-21T22:35:40.418106+0000","last_fullsized":"2023-07-21T22:35:40.418106+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.438412+0000","last_change":"2023-07-21T22:35:40.433893+0000","last_active":"2023-07-21T22:35:40.438412+0000","last_peered":"2023-07-21T22:35:40.438412+0000","last_clean":"2023-07-21T22:35:40.438412+0000","last_became_active":"2023-07-21T22:35:40.433550+0000","last_became_peered":"2023-07-21T22:35:40.433550+0000","last_unstale":"2023-07-21T22:35:40.438412+0000","last_undegraded":"2023-07-21T22:35:40.438412+0000","last_fullsized":"2023-07-21T22:35:40.438412+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:51:25.969683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.418169+0000","last_change":"2023-07-21T22:35:40.418169+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.418169+0000","last_undegraded":"2023-07-21T22:35:40.418169+0000","last_fullsized":"2023-07-21T22:35:40.418169+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.439718+0000","last_change":"2023-07-21T22:35:40.435977+0000","last_active":"2023-07-21T22:35:40.439718+0000","last_peered":"2023-07-21T22:35:40.439718+0000","last_clean":"2023-07-21T22:35:40.439718+0000","last_became_active":"2023-07-21T22:35:40.435683+0000","last_became_peered":"2023-07-21T22:35:40.435683+0000","last_unstale":"2023-07-21T22:35:40.439718+0000","last_undegraded":"2023-07-21T22:35:40.439718+0000","last_fullsized":"2023-07-21T22:35:40.439718+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:44:28.111054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424484+0000","last_change":"2023-07-21T22:35:40.424484+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424484+0000","last_undegraded":"2023-07-21T22:35:40.424484+0000","last_fullsized":"2023-07-21T22:35:40.424484+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440853+0000","last_change":"2023-07-21T22:35:40.437173+0000","last_active":"2023-07-21T22:35:40.440853+0000","last_peered":"2023-07-21T22:35:40.440853+0000","last_clean":"2023-07-21T22:35:40.440853+0000","last_became_active":"2023-07-21T22:35:40.435532+0000","last_became_peered":"2023-07-21T22:35:40.435532+0000","last_unstale":"2023-07-21T22:35:40.440853+0000","last_undegraded":"2023-07-21T22:35:40.440853+0000","last_fullsized":"2023-07-21T22:35:40.440853+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:03.193160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.427422+0000","last_change":"2023-07-21T22:35:40.427422+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.427422+0000","last_undegraded":"2023-07-21T22:35:40.427422+0000","last_fullsized":"2023-07-21T22:35:40.427422+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.439013+0000","last_change":"2023-07-21T22:35:40.436051+0000","last_active":"2023-07-21T22:35:40.439013+0000","last_peered":"2023-07-21T22:35:40.439013+0000","last_clean":"2023-07-21T22:35:40.439013+0000","last_became_active":"2023-07-21T22:35:40.435765+0000","last_became_peered":"2023-07-21T22:35:40.435765+0000","last_unstale":"2023-07-21T22:35:40.439013+0000","last_undegraded":"2023-07-21T22:35:40.439013+0000","last_fullsized":"2023-07-21T22:35:40.439013+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:59:48.963572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.429872+0000","last_change":"2023-07-21T22:35:40.429872+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.429872+0000","last_undegraded":"2023-07-21T22:35:40.429872+0000","last_fullsized":"2023-07-21T22:35:40.429872+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440447+0000","last_change":"2023-07-21T22:35:40.439003+0000","last_active":"2023-07-21T22:35:40.440447+0000","last_peered":"2023-07-21T22:35:40.440447+0000","last_clean":"2023-07-21T22:35:40.440447+0000","last_became_active":"2023-07-21T22:35:40.438479+0000","last_became_peered":"2023-07-21T22:35:40.438479+0000","last_unstale":"2023-07-21T22:35:40.440447+0000","last_undegraded":"2023-07-21T22:35:40.440447+0000","last_fullsized":"2023-07-21T22:35:40.440447+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:02:26.383277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420230+0000","last_change":"2023-07-21T22:35:40.420230+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420230+0000","last_undegraded":"2023-07-21T22:35:40.420230+0000","last_fullsized":"2023-07-21T22:35:40.420230+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.443552+0000","last_change":"2023-07-21T22:35:40.440675+0000","last_active":"2023-07-21T22:35:40.443552+0000","last_peered":"2023-07-21T22:35:40.443552+0000","last_clean":"2023-07-21T22:35:40.443552+0000","last_became_active":"2023-07-21T22:35:40.440191+0000","last_became_peered":"2023-07-21T22:35:40.440191+0000","last_unstale":"2023-07-21T22:35:40.443552+0000","last_undegraded":"2023-07-21T22:35:40.443552+0000","last_fullsized":"2023-07-21T22:35:40.443552+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:52:58.701458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.418423+0000","last_change":"2023-07-21T22:35:40.418423+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.418423+0000","last_undegraded":"2023-07-21T22:35:40.418423+0000","last_fullsized":"2023-07-21T22:35:40.418423+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440153+0000","last_change":"2023-07-21T22:35:40.438483+0000","last_active":"2023-07-21T22:35:40.440153+0000","last_peered":"2023-07-21T22:35:40.440153+0000","last_clean":"2023-07-21T22:35:40.440153+0000","last_became_active":"2023-07-21T22:35:40.438212+0000","last_became_peered":"2023-07-21T22:35:40.438212+0000","last_unstale":"2023-07-21T22:35:40.440153+0000","last_undegraded":"2023-07-21T22:35:40.440153+0000","last_fullsized":"2023-07-21T22:35:40.440153+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:44:33.640689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.421211+0000","last_change":"2023-07-21T22:35:40.421211+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.421211+0000","last_undegraded":"2023-07-21T22:35:40.421211+0000","last_fullsized":"2023-07-21T22:35:40.421211+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.434865+0000","last_change":"2023-07-21T22:35:40.431308+0000","last_active":"2023-07-21T22:35:40.434865+0000","last_peered":"2023-07-21T22:35:40.434865+0000","last_clean":"2023-07-21T22:35:40.434865+0000","last_became_active":"2023-07-21T22:35:40.430971+0000","last_became_peered":"2023-07-21T22:35:40.430971+0000","last_unstale":"2023-07-21T22:35:40.434865+0000","last_undegraded":"2023-07-21T22:35:40.434865+0000","last_fullsized":"2023-07-21T22:35:40.434865+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:03:53.221395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.423889+0000","last_change":"2023-07-21T22:35:40.423889+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.423889+0000","last_undegraded":"2023-07-21T22:35:40.423889+0000","last_fullsized":"2023-07-21T22:35:40.423889+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.441877+0000","last_change":"2023-07-21T22:35:40.440037+0000","last_active":"2023-07-21T22:35:40.441877+0000","last_peered":"2023-07-21T22:35:40.441877+0000","last_clean":"2023-07-21T22:35:40.441877+0000","last_became_active":"2023-07-21T22:35:40.439762+0000","last_became_peered":"2023-07-21T22:35:40.439762+0000","last_unstale":"2023-07-21T22:35:40.441877+0000","last_undegraded":"2023-07-21T22:35:40.441877+0000","last_fullsized":"2023-07-21T22:35:40.441877+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:23:19.242316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.430522+0000","last_change":"2023-07-21T22:35:40.430522+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.430522+0000","last_undegraded":"2023-07-21T22:35:40.430522+0000","last_fullsized":"2023-07-21T22:35:40.430522+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.436063+0000","last_change":"2023-07-21T22:35:40.434129+0000","last_active":"2023-07-21T22:35:40.436063+0000","last_peered":"2023-07-21T22:35:40.436063+0000","last_clean":"2023-07-21T22:35:40.436063+0000","last_became_active":"2023-07-21T22:35:40.433862+0000","last_became_peered":"2023-07-21T22:35:40.433862+0000","last_unstale":"2023-07-21T22:35:40.436063+0000","last_undegraded":"2023-07-21T22:35:40.436063+0000","last_fullsized":"2023-07-21T22:35:40.436063+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:28:03.521963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.427652+0000","last_change":"2023-07-21T22:35:40.427652+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.427652+0000","last_undegraded":"2023-07-21T22:35:40.427652+0000","last_fullsized":"2023-07-21T22:35:40.427652+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.438468+0000","last_change":"2023-07-21T22:35:40.433064+0000","last_active":"2023-07-21T22:35:40.438468+0000","last_peered":"2023-07-21T22:35:40.438468+0000","last_clean":"2023-07-21T22:35:40.438468+0000","last_became_active":"2023-07-21T22:35:40.432727+0000","last_became_peered":"2023-07-21T22:35:40.432727+0000","last_unstale":"2023-07-21T22:35:40.438468+0000","last_undegraded":"2023-07-21T22:35:40.438468+0000","last_fullsized":"2023-07-21T22:35:40.438468+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:21:03.267520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"100'205","reported_seq":643,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.426835+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:35:40.426835+0000","last_peered":"2023-07-21T22:35:40.426835+0000","last_clean":"2023-07-21T22:35:40.426835+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:35:40.426835+0000","last_undegraded":"2023-07-21T22:35:40.426835+0000","last_fullsized":"2023-07-21T22:35:40.426835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:36:01.986411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.422451+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:35:40.422451+0000","last_peered":"2023-07-21T22:35:40.422451+0000","last_clean":"2023-07-21T22:35:40.422451+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:35:40.422451+0000","last_undegraded":"2023-07-21T22:35:40.422451+0000","last_fullsized":"2023-07-21T22:35:40.422451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:18:31.491085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424857+0000","last_change":"2023-07-21T22:35:40.424857+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424857+0000","last_undegraded":"2023-07-21T22:35:40.424857+0000","last_fullsized":"2023-07-21T22:35:40.424857+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.435040+0000","last_change":"2023-07-21T22:35:40.433828+0000","last_active":"2023-07-21T22:35:40.435040+0000","last_peered":"2023-07-21T22:35:40.435040+0000","last_clean":"2023-07-21T22:35:40.435040+0000","last_became_active":"2023-07-21T22:35:40.433537+0000","last_became_peered":"2023-07-21T22:35:40.433537+0000","last_unstale":"2023-07-21T22:35:40.435040+0000","last_undegraded":"2023-07-21T22:35:40.435040+0000","last_fullsized":"2023-07-21T22:35:40.435040+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:28:40.271547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.426718+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:35:40.426718+0000","last_peered":"2023-07-21T22:35:40.426718+0000","last_clean":"2023-07-21T22:35:40.426718+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:35:40.426718+0000","last_undegraded":"2023-07-21T22:35:40.426718+0000","last_fullsized":"2023-07-21T22:35:40.426718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:45.947440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.423880+0000","last_change":"2023-07-21T22:35:40.423880+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.423880+0000","last_undegraded":"2023-07-21T22:35:40.423880+0000","last_fullsized":"2023-07-21T22:35:40.423880+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440208+0000","last_change":"2023-07-21T22:35:40.435800+0000","last_active":"2023-07-21T22:35:40.440208+0000","last_peered":"2023-07-21T22:35:40.440208+0000","last_clean":"2023-07-21T22:35:40.440208+0000","last_became_active":"2023-07-21T22:35:40.435483+0000","last_became_peered":"2023-07-21T22:35:40.435483+0000","last_unstale":"2023-07-21T22:35:40.440208+0000","last_undegraded":"2023-07-21T22:35:40.440208+0000","last_fullsized":"2023-07-21T22:35:40.440208+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:03:30.720838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.413259+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:35:40.413259+0000","last_peered":"2023-07-21T22:35:40.413259+0000","last_clean":"2023-07-21T22:35:40.413259+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:35:40.413259+0000","last_undegraded":"2023-07-21T22:35:40.413259+0000","last_fullsized":"2023-07-21T22:35:40.413259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:02:00.190778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.430023+0000","last_change":"2023-07-21T22:35:40.430023+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.430023+0000","last_undegraded":"2023-07-21T22:35:40.430023+0000","last_fullsized":"2023-07-21T22:35:40.430023+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440425+0000","last_change":"2023-07-21T22:35:40.438789+0000","last_active":"2023-07-21T22:35:40.440425+0000","last_peered":"2023-07-21T22:35:40.440425+0000","last_clean":"2023-07-21T22:35:40.440425+0000","last_became_active":"2023-07-21T22:35:40.438114+0000","last_became_peered":"2023-07-21T22:35:40.438114+0000","last_unstale":"2023-07-21T22:35:40.440425+0000","last_undegraded":"2023-07-21T22:35:40.440425+0000","last_fullsized":"2023-07-21T22:35:40.440425+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:04:22.853070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.421978+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:35:40.421978+0000","last_peered":"2023-07-21T22:35:40.421978+0000","last_clean":"2023-07-21T22:35:40.421978+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:35:40.421978+0000","last_undegraded":"2023-07-21T22:35:40.421978+0000","last_fullsized":"2023-07-21T22:35:40.421978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:21:07.585851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424669+0000","last_change":"2023-07-21T22:35:40.424669+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424669+0000","last_undegraded":"2023-07-21T22:35:40.424669+0000","last_fullsized":"2023-07-21T22:35:40.424669+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.434924+0000","last_change":"2023-07-21T22:35:40.431423+0000","last_active":"2023-07-21T22:35:40.434924+0000","last_peered":"2023-07-21T22:35:40.434924+0000","last_clean":"2023-07-21T22:35:40.434924+0000","last_became_active":"2023-07-21T22:35:40.431123+0000","last_became_peered":"2023-07-21T22:35:40.431123+0000","last_unstale":"2023-07-21T22:35:40.434924+0000","last_undegraded":"2023-07-21T22:35:40.434924+0000","last_fullsized":"2023-07-21T22:35:40.434924+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:21:17.845810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.422041+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:35:40.422041+0000","last_peered":"2023-07-21T22:35:40.422041+0000","last_clean":"2023-07-21T22:35:40.422041+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:35:40.422041+0000","last_undegraded":"2023-07-21T22:35:40.422041+0000","last_fullsized":"2023-07-21T22:35:40.422041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:08:46.780739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.419952+0000","last_change":"2023-07-21T22:35:40.419952+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.419952+0000","last_undegraded":"2023-07-21T22:35:40.419952+0000","last_fullsized":"2023-07-21T22:35:40.419952+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.435195+0000","last_change":"2023-07-21T22:35:40.429195+0000","last_active":"2023-07-21T22:35:40.435195+0000","last_peered":"2023-07-21T22:35:40.435195+0000","last_clean":"2023-07-21T22:35:40.435195+0000","last_became_active":"2023-07-21T22:35:40.428906+0000","last_became_peered":"2023-07-21T22:35:40.428906+0000","last_unstale":"2023-07-21T22:35:40.435195+0000","last_undegraded":"2023-07-21T22:35:40.435195+0000","last_fullsized":"2023-07-21T22:35:40.435195+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:44.549024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.428271+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:35:40.428271+0000","last_peered":"2023-07-21T22:35:40.428271+0000","last_clean":"2023-07-21T22:35:40.428271+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:35:40.428271+0000","last_undegraded":"2023-07-21T22:35:40.428271+0000","last_fullsized":"2023-07-21T22:35:40.428271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:46:48.050930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.419934+0000","last_change":"2023-07-21T22:35:40.419934+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.419934+0000","last_undegraded":"2023-07-21T22:35:40.419934+0000","last_fullsized":"2023-07-21T22:35:40.419934+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440734+0000","last_change":"2023-07-21T22:35:40.436820+0000","last_active":"2023-07-21T22:35:40.440734+0000","last_peered":"2023-07-21T22:35:40.440734+0000","last_clean":"2023-07-21T22:35:40.440734+0000","last_became_active":"2023-07-21T22:35:40.436510+0000","last_became_peered":"2023-07-21T22:35:40.436510+0000","last_unstale":"2023-07-21T22:35:40.440734+0000","last_undegraded":"2023-07-21T22:35:40.440734+0000","last_fullsized":"2023-07-21T22:35:40.440734+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:15.357847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.419587+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:35:40.419587+0000","last_peered":"2023-07-21T22:35:40.419587+0000","last_clean":"2023-07-21T22:35:40.419587+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:35:40.419587+0000","last_undegraded":"2023-07-21T22:35:40.419587+0000","last_fullsized":"2023-07-21T22:35:40.419587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:31:49.740583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.431032+0000","last_change":"2023-07-21T22:35:40.431032+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.431032+0000","last_undegraded":"2023-07-21T22:35:40.431032+0000","last_fullsized":"2023-07-21T22:35:40.431032+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.434986+0000","last_change":"2023-07-21T22:35:40.423934+0000","last_active":"2023-07-21T22:35:40.434986+0000","last_peered":"2023-07-21T22:35:40.434986+0000","last_clean":"2023-07-21T22:35:40.434986+0000","last_became_active":"2023-07-21T22:35:40.423649+0000","last_became_peered":"2023-07-21T22:35:40.423649+0000","last_unstale":"2023-07-21T22:35:40.434986+0000","last_undegraded":"2023-07-21T22:35:40.434986+0000","last_fullsized":"2023-07-21T22:35:40.434986+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:22:52.903323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.426526+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:35:40.426526+0000","last_peered":"2023-07-21T22:35:40.426526+0000","last_clean":"2023-07-21T22:35:40.426526+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:35:40.426526+0000","last_undegraded":"2023-07-21T22:35:40.426526+0000","last_fullsized":"2023-07-21T22:35:40.426526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:48:53.359151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509645,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59180,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312660,"statfs":{"total":96636764160,"available":96576163840,"internally_reserved":0,"allocated":1937408,"data_stored":1260933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73299999999999998,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.35299999999999998,"15min":0.32600000000000001},"max":{"1min":1.1180000000000001,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.36099999999999999},"max":{"1min":0.90900000000000003,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.432,"15min":0.379},"max":{"1min":1.0509999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.85199999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72399999999999998,"15min":0.74299999999999999},"min":{"1min":0.51300000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.405},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72899999999999998,"15min":0.752},"min":{"1min":0.47999999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95699999999999996,"5min":1.409,"15min":1.409},"last":0.64500000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.504,"15min":0.42099999999999999},"max":{"1min":1.1539999999999999,"5min":1.46,"15min":1.46},"last":0.75},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.02,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.88}]},{"osd":4,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55400000000000005,"15min":0.55900000000000005},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.89900000000000002,"5min":0.90500000000000003,"15min":0.94999999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90400000000000003,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64500000000000002,"15min":0.61799999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.56499999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.052,"5min":1.506,"15min":1.506},"last":0.91900000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.048},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.434,"15min":0.42599999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.72699999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542351,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1343488,"data_stored":670565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.73599999999999999,"15min":0.76100000000000001},"min":{"1min":0.495,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.97599999999999998,"5min":1.016,"15min":1.016},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77700000000000002,"15min":0.79300000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.437},"max":{"1min":0.94699999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.56100000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.41999999999999998},"max":{"1min":0.90500000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.94599999999999995,"5min":0.99399999999999999,"15min":1.117},"last":0.60499999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.72999999999999998,"15min":0.75},"min":{"1min":0.499,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.96299999999999997,"5min":0.98099999999999998,"15min":1.0269999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.0149999999999999,"5min":1.097,"15min":1.097},"last":0.621}]},{"osd":3,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.76100000000000001},"min":{"1min":0.57899999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92800000000000005,"5min":1.048,"15min":1.048},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72499999999999998,"15min":0.74099999999999999},"min":{"1min":0.505,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88600000000000001,"5min":1.0049999999999999,"15min":1.054},"last":0.495}]},{"osd":4,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60299999999999998,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.374,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.441,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.048},"last":0.42999999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89600000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.91900000000000004,"5min":0.98799999999999999,"15min":1.054},"last":0.46800000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68500000000000005,"15min":0.67700000000000005},"min":{"1min":0.498,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":0.95699999999999996,"5min":1.079,"15min":1.079},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.70099999999999996,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96499999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.64800000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509644,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1343488,"data_stored":670565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.70699999999999996,"15min":0.71299999999999997},"min":{"1min":0.436,"5min":0.35699999999999998,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.70799999999999996,"15min":0.72199999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83999999999999997,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.75800000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66800000000000004,"15min":0.71099999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90600000000000003,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.71099999999999997,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77900000000000003,"5min":1.617,"15min":1.617},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.70999999999999996,"15min":0.73499999999999999},"min":{"1min":0.45100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.99399999999999999,"5min":1.0109999999999999,"15min":1.034},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.71399999999999997,"15min":0.747},"min":{"1min":0.498,"5min":0.377,"15min":0.377},"max":{"1min":0.86399999999999999,"5min":1.512,"15min":1.512},"last":0.84299999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.76100000000000001,"15min":0.78500000000000003},"min":{"1min":0.56299999999999994,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86199999999999999,"5min":1.472,"15min":1.472},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.59999999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.90800000000000003,"5min":1.556,"15min":1.556},"last":0.67700000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88900000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89200000000000002,"5min":1.012,"15min":1.038},"last":0.89800000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95499999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.622,"15min":0.60999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93799999999999994,"5min":1.02,"15min":1.02},"last":0.70699999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66100000000000003,"15min":0.65000000000000002},"min":{"1min":0.42399999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.91900000000000004,"5min":1.042,"15min":1.042},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.57899999999999996,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.88300000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509645,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1343488,"data_stored":670565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71999999999999997,"15min":0.74299999999999999},"min":{"1min":0.51200000000000001,"5min":0.438,"15min":0.40000000000000002},"max":{"1min":0.80900000000000005,"5min":0.99399999999999999,"15min":1.0429999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73299999999999998,"15min":0.74299999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.83599999999999997,"5min":0.96099999999999997,"15min":0.97599999999999998},"last":0.76600000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.39400000000000002},"max":{"1min":0.85499999999999998,"5min":1.002,"15min":1.0449999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.69399999999999995,"15min":0.69999999999999996},"min":{"1min":0.47299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.872,"5min":0.94299999999999995,"15min":1.016},"last":0.72899999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.51200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.95899999999999996,"5min":1.048,"15min":1.048},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.53000000000000003,"5min":0.41999999999999998,"15min":0.33000000000000002},"max":{"1min":1.006,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.85299999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72899999999999998,"15min":0.73699999999999999},"min":{"1min":0.51000000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94099999999999995,"5min":0.97999999999999998,"15min":1.026},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58399999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.78100000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.45100000000000001,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98899999999999999},"last":0.436}]},{"osd":6,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.38500000000000001},"max":{"1min":0.94699999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.57099999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.79400000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64400000000000002,"15min":0.65100000000000002},"min":{"1min":0.45500000000000002,"5min":0.39900000000000002,"15min":0.374},"max":{"1min":0.92100000000000004,"5min":1.0069999999999999,"15min":1.0429999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.135},"last":0.62}]}]},{"osd":3,"up_from":15,"seq":64424509644,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1331200,"data_stored":663893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.28599999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.55500000000000005,"5min":0.73099999999999998,"15min":0.76400000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.66300000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.371}]},{"osd":1,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.46899999999999997,"15min":0.47899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71799999999999997,"5min":0.754,"15min":0.83499999999999996},"last":0.312},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.54600000000000004,"15min":0.55500000000000005},"min":{"1min":0.30199999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.82599999999999996,"15min":0.90100000000000002},"last":0.29199999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54800000000000004,"15min":0.56000000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.997,"5min":0.997,"15min":1.1140000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.59099999999999997,"15min":0.59999999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69499999999999995,"5min":0.91800000000000004,"15min":0.99199999999999999},"last":0.39600000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0569999999999999,"5min":1.093,"15min":1.159},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.80200000000000005,"15min":0.82699999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0429999999999999,"5min":1.1459999999999999,"15min":1.3620000000000001},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.749,"15min":0.77600000000000002},"min":{"1min":0.501,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0029999999999999,"5min":1.0740000000000001,"15min":1.137},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.51300000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98199999999999998,"5min":1.048,"15min":1.2789999999999999},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.77400000000000002,"15min":0.79500000000000004},"min":{"1min":0.55700000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0289999999999999,"5min":1.056,"15min":1.3979999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.77500000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97099999999999997,"5min":1.1120000000000001,"15min":1.2450000000000001},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.79400000000000004,"15min":0.82499999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.024,"5min":1.087,"15min":1.335},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.81399999999999995,"15min":0.82999999999999996},"min":{"1min":0.57699999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.081,"5min":1.113,"15min":1.2130000000000001},"last":0.81399999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509646,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54492,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317348,"statfs":{"total":96636764160,"available":96580964352,"internally_reserved":0,"allocated":1331200,"data_stored":663893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45200000000000001,"15min":0.47099999999999997},"min":{"1min":0.27700000000000002,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.75,"5min":0.81200000000000006,"15min":0.94199999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.52400000000000002,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.84799999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.48799999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86699999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55800000000000005,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.012,"5min":1.085,"15min":1.085},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46999999999999997,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.30099999999999999,"15min":0.29699999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55000000000000004,"15min":0.56899999999999995},"min":{"1min":0.39300000000000002,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.77900000000000003,"15min":0.79600000000000004},"min":{"1min":0.49099999999999999,"5min":0.439,"15min":0.376},"max":{"1min":0.93500000000000005,"5min":1.2569999999999999,"15min":1.3420000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79200000000000004,"15min":0.80100000000000005},"min":{"1min":0.56000000000000005,"5min":0.501,"15min":0.432},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.58599999999999997,"5min":0.55800000000000005,"15min":0.496},"max":{"1min":0.93200000000000005,"5min":1.0600000000000001,"15min":1.1879999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80000000000000004,"15min":0.81100000000000005},"min":{"1min":0.54400000000000004,"5min":0.47299999999999998,"15min":0.46400000000000002},"max":{"1min":0.97599999999999998,"5min":1.171,"15min":1.3089999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.502,"5min":0.45500000000000002,"15min":0.40300000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.79700000000000004,"15min":0.81200000000000006},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.45600000000000002},"max":{"1min":0.88400000000000001,"5min":1.23,"15min":1.2649999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79900000000000004,"15min":0.82399999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.49099999999999999},"max":{"1min":0.90000000000000002,"5min":1.2,"15min":1.2909999999999999},"last":0.755},{"interface":"front","average":{"1min":0.75,"5min":0.79900000000000004,"15min":0.81599999999999995},"min":{"1min":0.57599999999999996,"5min":0.5,"15min":0.44700000000000001},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.65000000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509645,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1331200,"data_stored":663893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.28299999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53500000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.626,"5min":0.872,"15min":0.872},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.5,"15min":0.50700000000000001},"min":{"1min":0.33700000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63200000000000001,"5min":0.76100000000000001,"15min":0.81000000000000005},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.29099999999999998},"max":{"1min":0.78900000000000003,"5min":0.83599999999999997,"15min":0.88800000000000001},"last":0.42699999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.57599999999999996,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35799999999999998,"15min":0.33400000000000002},"max":{"1min":0.70799999999999996,"5min":0.84299999999999997,"15min":0.98899999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.505,"15min":0.51700000000000002},"min":{"1min":0.33100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.64200000000000002,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.748,"15min":0.77000000000000002},"min":{"1min":0.53100000000000003,"5min":0.432,"15min":0.432},"max":{"1min":0.91400000000000003,"5min":1.0860000000000001,"15min":1.234},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.57499999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.014,"5min":1.083,"15min":1.155},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75600000000000001,"15min":0.77800000000000002},"min":{"1min":0.53500000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92500000000000004,"5min":1.0609999999999999,"15min":1.1919999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78500000000000003,"15min":0.80000000000000004},"min":{"1min":0.55200000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.044,"5min":1.121,"15min":1.2849999999999999},"last":0.56899999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78600000000000003,"15min":0.81000000000000005},"min":{"1min":0.57199999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0229999999999999,"5min":1.0580000000000001,"15min":1.23},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76300000000000001,"15min":0.79000000000000004},"min":{"1min":0.50900000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0449999999999999,"5min":1.1020000000000001,"15min":1.3240000000000001},"last":0.61399999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78600000000000003,"15min":0.80900000000000005},"min":{"1min":0.58599999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.99299999999999999,"5min":1.103,"15min":1.3149999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79000000000000004,"15min":0.80800000000000005},"min":{"1min":0.55500000000000005,"5min":0.52600000000000002,"15min":0.45700000000000002},"max":{"1min":0.97499999999999998,"5min":1.115,"15min":1.3380000000000001},"last":0.64900000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509647,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37036,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334804,"statfs":{"total":96636764160,"available":96598839296,"internally_reserved":0,"allocated":1937408,"data_stored":1260933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.47399999999999998,"15min":0.47099999999999997},"min":{"1min":0.28399999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.64700000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.499,"15min":0.51300000000000001},"min":{"1min":0.374,"5min":0.247,"15min":0.247},"max":{"1min":0.63100000000000001,"5min":0.76200000000000001,"15min":0.79400000000000004},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71499999999999997,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51200000000000001,"15min":0.51700000000000002},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67000000000000004,"5min":0.871,"15min":0.871},"last":0.437}]},{"osd":3,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70899999999999996,"5min":0.84499999999999997,"15min":0.91300000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67700000000000005,"5min":1.038,"15min":1.038},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.754,"15min":0.77800000000000002},"min":{"1min":0.58099999999999996,"5min":0.46200000000000002,"15min":0.45200000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.321},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.78400000000000003,"15min":0.79800000000000004},"min":{"1min":0.55600000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.423},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76300000000000001,"15min":0.78100000000000003},"min":{"1min":0.55600000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.036,"5min":1.107,"15min":1.28},"last":0.627},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77600000000000002,"15min":0.80700000000000005},"min":{"1min":0.57699999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.24,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.67800000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76800000000000002,"15min":0.81200000000000006},"min":{"1min":0.53800000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.81699999999999995},"min":{"1min":0.60699999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0169999999999999,"5min":1.147,"15min":1.333},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78600000000000003,"15min":0.79800000000000004},"min":{"1min":0.54300000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.042,"5min":1.159,"15min":1.2310000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.79100000000000004,"15min":0.82899999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0609999999999999,"5min":1.1930000000000001,"15min":1.369},"last":0.70699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:35:45.995 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:35:46.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.126+0000 7fa8af5fa640 1 Processor -- start 2023-07-21T22:35:46.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.126+0000 7fa8af5fa640 1 -- start start 2023-07-21T22:35:46.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.126+0000 7fa8af5fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a80c9730 0x7fa8a81638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.126+0000 7fa8af5fa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a80cc700 con 0x7fa8a8158ce0 2023-07-21T22:35:46.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.126+0000 7fa8af5fa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a80b0ff0 con 0x7fa8a80c8ad0 2023-07-21T22:35:46.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.126+0000 7fa8af5fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a8070c80 con 0x7fa8a80c9730 2023-07-21T22:35:46.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.130+0000 7fa8ad396640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa8a8158ce0 0x7fa8a8070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36950/0 (socket says 172.21.15.6:36950) 2023-07-21T22:35:46.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.130+0000 7fa8ad396640 1 -- 172.21.15.6:0/2215197696 learned_addr learned my addr 172.21.15.6:0/2215197696 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.130+0000 7fa8adb97640 1 --2- 172.21.15.6:0/2215197696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a80c9730 0x7fa8a81638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.130+0000 7fa89ffff640 1 -- 172.21.15.6:0/2215197696 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1017234874 0 0) 0x7fa8a80cc700 con 0x7fa8a8158ce0 2023-07-21T22:35:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.130+0000 7fa89ffff640 1 -- 172.21.15.6:0/2215197696 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa894003530 con 0x7fa8a8158ce0 2023-07-21T22:35:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.130+0000 7fa89ffff640 1 -- 172.21.15.6:0/2215197696 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350097985 0 0) 0x7fa8a80b0ff0 con 0x7fa8a80c8ad0 2023-07-21T22:35:46.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.130+0000 7fa89ffff640 1 -- 172.21.15.6:0/2215197696 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8a80cc700 con 0x7fa8a80c8ad0 2023-07-21T22:35:46.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.130+0000 7fa8adb97640 1 -- 172.21.15.6:0/2215197696 >> v1:172.21.15.161:6789/0 conn(0x7fa8a80c8ad0 legacy=0x7fa8a80c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.130+0000 7fa8adb97640 1 -- 172.21.15.6:0/2215197696 >> v1:172.21.15.6:6789/0 conn(0x7fa8a8158ce0 legacy=0x7fa8a8070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.130+0000 7fa89ffff640 1 -- 172.21.15.6:0/2215197696 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1581225135 0 0) 0x7fa894003530 con 0x7fa8a8158ce0 2023-07-21T22:35:46.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.130+0000 7fa8adb97640 1 -- 172.21.15.6:0/2215197696 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a80cbdd0 con 0x7fa8a80c9730 2023-07-21T22:35:46.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.134+0000 7fa8adb97640 1 --2- 172.21.15.6:0/2215197696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a80c9730 0x7fa8a81638b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009dc0 tx=0x7fa8a001c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63b6bf7ed6d2c497 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.134+0000 7fa89ffff640 1 -- 172.21.15.6:0/2215197696 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4001680 con 0x7fa8a80c9730 2023-07-21T22:35:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.134+0000 7fa89ffff640 1 -- 172.21.15.6:0/2215197696 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a00a64a0 con 0x7fa8a80c9730 2023-07-21T22:35:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.134+0000 7fa89ffff640 1 -- 172.21.15.6:0/2215197696 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a00a6830 con 0x7fa8a80c9730 2023-07-21T22:35:46.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.134+0000 7fa8af5fa640 1 -- 172.21.15.6:0/2215197696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a80c9730 msgr2=0x7fa8a81638b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.134+0000 7fa8af5fa640 1 --2- 172.21.15.6:0/2215197696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a80c9730 0x7fa8a81638b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009dc0 tx=0x7fa8a001c740 comp rx=0 tx=0).stop 2023-07-21T22:35:46.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.134+0000 7fa8af5fa640 1 -- 172.21.15.6:0/2215197696 shutdown_connections 2023-07-21T22:35:46.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.134+0000 7fa8af5fa640 1 --2- 172.21.15.6:0/2215197696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a80c9730 0x7fa8a81638b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.134+0000 7fa8af5fa640 1 -- 172.21.15.6:0/2215197696 >> 172.21.15.6:0/2215197696 conn(0x7fa8a80afcf0 msgr2=0x7fa8a80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.134+0000 7fa8af5fa640 1 -- 172.21.15.6:0/2215197696 shutdown_connections 2023-07-21T22:35:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.134+0000 7fa8af5fa640 1 -- 172.21.15.6:0/2215197696 wait complete. 2023-07-21T22:35:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.134+0000 7fa8af5fa640 1 Processor -- start 2023-07-21T22:35:46.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.134+0000 7fa8af5fa640 1 -- start start 2023-07-21T22:35:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8af5fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a80c8ad0 0x7fa8a814b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8af5fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8a80c9730 0x7fa8a814fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8af5fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a8158ce0 0x7fa8a80c2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8af5fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a81574b0 con 0x7fa8a8158ce0 2023-07-21T22:35:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8af5fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a81f3ed0 con 0x7fa8a80c9730 2023-07-21T22:35:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8af5fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a8156830 con 0x7fa8a80c8ad0 2023-07-21T22:35:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8adb97640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a8158ce0 0x7fa8a80c2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8adb97640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a8158ce0 0x7fa8a80c2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48566/0 (socket says 172.21.15.6:48566) 2023-07-21T22:35:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8adb97640 1 -- 172.21.15.6:0/549158917 learned_addr learned my addr 172.21.15.6:0/549158917 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:46.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8ad396640 1 --2- 172.21.15.6:0/549158917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a80c8ad0 0x7fa8a814b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8acb95640 1 --2- 172.21.15.6:0/549158917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8a80c9730 0x7fa8a814fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8adb97640 1 -- 172.21.15.6:0/549158917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a80c8ad0 msgr2=0x7fa8a814b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8adb97640 1 --2- 172.21.15.6:0/549158917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a80c8ad0 0x7fa8a814b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8adb97640 1 -- 172.21.15.6:0/549158917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8a80c9730 msgr2=0x7fa8a814fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8adb97640 1 --2- 172.21.15.6:0/549158917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8a80c9730 0x7fa8a814fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8adb97640 1 -- 172.21.15.6:0/549158917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a0009a70 con 0x7fa8a8158ce0 2023-07-21T22:35:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8acb95640 1 --2- 172.21.15.6:0/549158917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8a80c9730 0x7fa8a814fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8adb97640 1 --2- 172.21.15.6:0/549158917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a8158ce0 0x7fa8a80c2430 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fa8a001cc20 tx=0x7fa8a00194e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa89dffb640 1 -- 172.21.15.6:0/549158917 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a00b7070 con 0x7fa8a8158ce0 2023-07-21T22:35:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa89dffb640 1 -- 172.21.15.6:0/549158917 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a0009450 con 0x7fa8a8158ce0 2023-07-21T22:35:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8af5fa640 1 -- 172.21.15.6:0/549158917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a8156b10 con 0x7fa8a8158ce0 2023-07-21T22:35:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa89dffb640 1 -- 172.21.15.6:0/549158917 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0003ba0 con 0x7fa8a8158ce0 2023-07-21T22:35:46.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8af5fa640 1 -- 172.21.15.6:0/549158917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a81570d0 con 0x7fa8a8158ce0 2023-07-21T22:35:46.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa8af5fa640 1 -- 172.21.15.6:0/549158917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a80ca1a0 con 0x7fa8a8158ce0 2023-07-21T22:35:46.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.138+0000 7fa89dffb640 1 -- 172.21.15.6:0/549158917 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa8a0003d00 con 0x7fa8a8158ce0 2023-07-21T22:35:46.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.142+0000 7fa89dffb640 1 --2- 172.21.15.6:0/549158917 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fa88c0663a0 0x7fa88c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.142+0000 7fa89dffb640 1 -- 172.21.15.6:0/549158917 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fa8a011e750 con 0x7fa8a8158ce0 2023-07-21T22:35:46.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.142+0000 7fa8ad396640 1 --2- 172.21.15.6:0/549158917 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fa88c0663a0 0x7fa88c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.142+0000 7fa8ad396640 1 --2- 172.21.15.6:0/549158917 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fa88c0663a0 0x7fa88c068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40011f0 tx=0x7fa8a4009040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:46.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.146+0000 7fa89dffb640 1 -- 172.21.15.6:0/549158917 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa8a00ebb30 con 0x7fa8a8158ce0 2023-07-21T22:35:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.298+0000 7fa8af5fa640 1 -- 172.21.15.6:0/549158917 --> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa8a81590b0 con 0x7fa88c0663a0 2023-07-21T22:35:46.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.306+0000 7fa89dffb640 1 -- 172.21.15.6:0/549158917 <== mgr.7255 v2:172.21.15.161:6832/3891612664 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305945 (secure 0 0 0) 0x7fa8a4001bd0 con 0x7fa88c0663a0 2023-07-21T22:35:46.360 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:46.362 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:35:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.310+0000 7fa8af5fa640 1 -- 172.21.15.6:0/549158917 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fa88c0663a0 msgr2=0x7fa88c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.310+0000 7fa8af5fa640 1 --2- 172.21.15.6:0/549158917 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fa88c0663a0 0x7fa88c068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40011f0 tx=0x7fa8a4009040 comp rx=0 tx=0).stop 2023-07-21T22:35:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.310+0000 7fa8af5fa640 1 -- 172.21.15.6:0/549158917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a8158ce0 msgr2=0x7fa8a80c2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.310+0000 7fa8af5fa640 1 --2- 172.21.15.6:0/549158917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a8158ce0 0x7fa8a80c2430 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fa8a001cc20 tx=0x7fa8a00194e0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.310+0000 7fa8af5fa640 1 -- 172.21.15.6:0/549158917 shutdown_connections 2023-07-21T22:35:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.310+0000 7fa8af5fa640 1 --2- 172.21.15.6:0/549158917 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fa88c0663a0 0x7fa88c068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.310+0000 7fa8af5fa640 1 --2- 172.21.15.6:0/549158917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a8158ce0 0x7fa8a80c2430 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.310+0000 7fa8af5fa640 1 --2- 172.21.15.6:0/549158917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8a80c9730 0x7fa8a814fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.310+0000 7fa8af5fa640 1 --2- 172.21.15.6:0/549158917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a80c8ad0 0x7fa8a814b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.310+0000 7fa8af5fa640 1 -- 172.21.15.6:0/549158917 >> 172.21.15.6:0/549158917 conn(0x7fa8a80afcf0 msgr2=0x7fa8a8155200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:46.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.310+0000 7fa8af5fa640 1 -- 172.21.15.6:0/549158917 shutdown_connections 2023-07-21T22:35:46.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.310+0000 7fa8af5fa640 1 -- 172.21.15.6:0/549158917 wait complete. 2023-07-21T22:35:46.381 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-21T22:35:45.025581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":312484,"kb_used_data":11620,"kb_used_omap":0,"kb_used_meta":300800,"kb_avail":754662236,"statfs":{"total":773094113280,"available":772774129664,"internally_reserved":0,"allocated":11898880,"data_stored":6525240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308019200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.615934"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.423025+0000","last_change":"2023-07-21T22:35:40.423025+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.423025+0000","last_undegraded":"2023-07-21T22:35:40.423025+0000","last_fullsized":"2023-07-21T22:35:40.423025+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420047+0000","last_change":"2023-07-21T22:35:40.420047+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420047+0000","last_undegraded":"2023-07-21T22:35:40.420047+0000","last_fullsized":"2023-07-21T22:35:40.420047+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.421225+0000","last_change":"2023-07-21T22:35:40.421225+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.421225+0000","last_undegraded":"2023-07-21T22:35:40.421225+0000","last_fullsized":"2023-07-21T22:35:40.421225+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.421779+0000","last_change":"2023-07-21T22:35:40.421779+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.421779+0000","last_undegraded":"2023-07-21T22:35:40.421779+0000","last_fullsized":"2023-07-21T22:35:40.421779+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.429598+0000","last_change":"2023-07-21T22:35:40.429598+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.429598+0000","last_undegraded":"2023-07-21T22:35:40.429598+0000","last_fullsized":"2023-07-21T22:35:40.429598+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.430526+0000","last_change":"2023-07-21T22:35:40.430526+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.430526+0000","last_undegraded":"2023-07-21T22:35:40.430526+0000","last_fullsized":"2023-07-21T22:35:40.430526+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424526+0000","last_change":"2023-07-21T22:35:40.424526+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424526+0000","last_undegraded":"2023-07-21T22:35:40.424526+0000","last_fullsized":"2023-07-21T22:35:40.424526+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420838+0000","last_change":"2023-07-21T22:35:40.420838+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420838+0000","last_undegraded":"2023-07-21T22:35:40.420838+0000","last_fullsized":"2023-07-21T22:35:40.420838+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424353+0000","last_change":"2023-07-21T22:35:40.424353+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424353+0000","last_undegraded":"2023-07-21T22:35:40.424353+0000","last_fullsized":"2023-07-21T22:35:40.424353+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.418763+0000","last_change":"2023-07-21T22:35:40.418763+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.418763+0000","last_undegraded":"2023-07-21T22:35:40.418763+0000","last_fullsized":"2023-07-21T22:35:40.418763+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.430089+0000","last_change":"2023-07-21T22:35:40.430089+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.430089+0000","last_undegraded":"2023-07-21T22:35:40.430089+0000","last_fullsized":"2023-07-21T22:35:40.430089+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.418675+0000","last_change":"2023-07-21T22:35:40.418675+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.418675+0000","last_undegraded":"2023-07-21T22:35:40.418675+0000","last_fullsized":"2023-07-21T22:35:40.418675+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420385+0000","last_change":"2023-07-21T22:35:40.420385+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420385+0000","last_undegraded":"2023-07-21T22:35:40.420385+0000","last_fullsized":"2023-07-21T22:35:40.420385+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.429283+0000","last_change":"2023-07-21T22:35:40.429283+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.429283+0000","last_undegraded":"2023-07-21T22:35:40.429283+0000","last_fullsized":"2023-07-21T22:35:40.429283+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.422505+0000","last_change":"2023-07-21T22:35:40.422505+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.422505+0000","last_undegraded":"2023-07-21T22:35:40.422505+0000","last_fullsized":"2023-07-21T22:35:40.422505+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.427423+0000","last_change":"2023-07-21T22:35:40.427423+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.427423+0000","last_undegraded":"2023-07-21T22:35:40.427423+0000","last_fullsized":"2023-07-21T22:35:40.427423+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.428251+0000","last_change":"2023-07-21T22:35:40.428251+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.428251+0000","last_undegraded":"2023-07-21T22:35:40.428251+0000","last_fullsized":"2023-07-21T22:35:40.428251+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.425699+0000","last_change":"2023-07-21T22:35:40.425699+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.425699+0000","last_undegraded":"2023-07-21T22:35:40.425699+0000","last_fullsized":"2023-07-21T22:35:40.425699+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424851+0000","last_change":"2023-07-21T22:35:40.424851+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424851+0000","last_undegraded":"2023-07-21T22:35:40.424851+0000","last_fullsized":"2023-07-21T22:35:40.424851+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.421317+0000","last_change":"2023-07-21T22:35:40.421317+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.421317+0000","last_undegraded":"2023-07-21T22:35:40.421317+0000","last_fullsized":"2023-07-21T22:35:40.421317+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.425277+0000","last_change":"2023-07-21T22:35:40.425277+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.425277+0000","last_undegraded":"2023-07-21T22:35:40.425277+0000","last_fullsized":"2023-07-21T22:35:40.425277+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.428797+0000","last_change":"2023-07-21T22:35:40.428797+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.428797+0000","last_undegraded":"2023-07-21T22:35:40.428797+0000","last_fullsized":"2023-07-21T22:35:40.428797+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424752+0000","last_change":"2023-07-21T22:35:40.424752+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424752+0000","last_undegraded":"2023-07-21T22:35:40.424752+0000","last_fullsized":"2023-07-21T22:35:40.424752+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420692+0000","last_change":"2023-07-21T22:35:40.420692+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420692+0000","last_undegraded":"2023-07-21T22:35:40.420692+0000","last_fullsized":"2023-07-21T22:35:40.420692+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420732+0000","last_change":"2023-07-21T22:35:40.420732+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420732+0000","last_undegraded":"2023-07-21T22:35:40.420732+0000","last_fullsized":"2023-07-21T22:35:40.420732+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.430470+0000","last_change":"2023-07-21T22:35:40.430470+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.430470+0000","last_undegraded":"2023-07-21T22:35:40.430470+0000","last_fullsized":"2023-07-21T22:35:40.430470+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.418305+0000","last_change":"2023-07-21T22:35:40.418305+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.418305+0000","last_undegraded":"2023-07-21T22:35:40.418305+0000","last_fullsized":"2023-07-21T22:35:40.418305+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420896+0000","last_change":"2023-07-21T22:35:40.420896+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420896+0000","last_undegraded":"2023-07-21T22:35:40.420896+0000","last_fullsized":"2023-07-21T22:35:40.420896+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.425095+0000","last_change":"2023-07-21T22:35:40.425095+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.425095+0000","last_undegraded":"2023-07-21T22:35:40.425095+0000","last_fullsized":"2023-07-21T22:35:40.425095+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.428282+0000","last_change":"2023-07-21T22:35:40.428282+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.428282+0000","last_undegraded":"2023-07-21T22:35:40.428282+0000","last_fullsized":"2023-07-21T22:35:40.428282+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.421437+0000","last_change":"2023-07-21T22:35:40.421437+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.421437+0000","last_undegraded":"2023-07-21T22:35:40.421437+0000","last_fullsized":"2023-07-21T22:35:40.421437+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.426901+0000","last_change":"2023-07-21T22:35:40.426901+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.426901+0000","last_undegraded":"2023-07-21T22:35:40.426901+0000","last_fullsized":"2023-07-21T22:35:40.426901+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.429666+0000","last_change":"2023-07-21T22:35:40.429666+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.429666+0000","last_undegraded":"2023-07-21T22:35:40.429666+0000","last_fullsized":"2023-07-21T22:35:40.429666+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440773+0000","last_change":"2023-07-21T22:35:40.437895+0000","last_active":"2023-07-21T22:35:40.440773+0000","last_peered":"2023-07-21T22:35:40.440773+0000","last_clean":"2023-07-21T22:35:40.440773+0000","last_became_active":"2023-07-21T22:35:40.436744+0000","last_became_peered":"2023-07-21T22:35:40.436744+0000","last_unstale":"2023-07-21T22:35:40.440773+0000","last_undegraded":"2023-07-21T22:35:40.440773+0000","last_fullsized":"2023-07-21T22:35:40.440773+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:04:30.695462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.427873+0000","last_change":"2023-07-21T22:35:40.427873+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.427873+0000","last_undegraded":"2023-07-21T22:35:40.427873+0000","last_fullsized":"2023-07-21T22:35:40.427873+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.439030+0000","last_change":"2023-07-21T22:35:40.436147+0000","last_active":"2023-07-21T22:35:40.439030+0000","last_peered":"2023-07-21T22:35:40.439030+0000","last_clean":"2023-07-21T22:35:40.439030+0000","last_became_active":"2023-07-21T22:35:40.435878+0000","last_became_peered":"2023-07-21T22:35:40.435878+0000","last_unstale":"2023-07-21T22:35:40.439030+0000","last_undegraded":"2023-07-21T22:35:40.439030+0000","last_fullsized":"2023-07-21T22:35:40.439030+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:10:23.638420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.427840+0000","last_change":"2023-07-21T22:35:40.427840+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.427840+0000","last_undegraded":"2023-07-21T22:35:40.427840+0000","last_fullsized":"2023-07-21T22:35:40.427840+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.441589+0000","last_change":"2023-07-21T22:35:40.440062+0000","last_active":"2023-07-21T22:35:40.441589+0000","last_peered":"2023-07-21T22:35:40.441589+0000","last_clean":"2023-07-21T22:35:40.441589+0000","last_became_active":"2023-07-21T22:35:40.439791+0000","last_became_peered":"2023-07-21T22:35:40.439791+0000","last_unstale":"2023-07-21T22:35:40.441589+0000","last_undegraded":"2023-07-21T22:35:40.441589+0000","last_fullsized":"2023-07-21T22:35:40.441589+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:12:02.163677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.427792+0000","last_change":"2023-07-21T22:35:40.427792+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.427792+0000","last_undegraded":"2023-07-21T22:35:40.427792+0000","last_fullsized":"2023-07-21T22:35:40.427792+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440795+0000","last_change":"2023-07-21T22:35:40.437899+0000","last_active":"2023-07-21T22:35:40.440795+0000","last_peered":"2023-07-21T22:35:40.440795+0000","last_clean":"2023-07-21T22:35:40.440795+0000","last_became_active":"2023-07-21T22:35:40.437604+0000","last_became_peered":"2023-07-21T22:35:40.437604+0000","last_unstale":"2023-07-21T22:35:40.440795+0000","last_undegraded":"2023-07-21T22:35:40.440795+0000","last_fullsized":"2023-07-21T22:35:40.440795+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:39:42.918696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.422116+0000","last_change":"2023-07-21T22:35:40.422116+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.422116+0000","last_undegraded":"2023-07-21T22:35:40.422116+0000","last_fullsized":"2023-07-21T22:35:40.422116+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.441407+0000","last_change":"2023-07-21T22:35:40.439578+0000","last_active":"2023-07-21T22:35:40.441407+0000","last_peered":"2023-07-21T22:35:40.441407+0000","last_clean":"2023-07-21T22:35:40.441407+0000","last_became_active":"2023-07-21T22:35:40.439264+0000","last_became_peered":"2023-07-21T22:35:40.439264+0000","last_unstale":"2023-07-21T22:35:40.441407+0000","last_undegraded":"2023-07-21T22:35:40.441407+0000","last_fullsized":"2023-07-21T22:35:40.441407+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:44:32.158083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.423601+0000","last_change":"2023-07-21T22:35:40.423601+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.423601+0000","last_undegraded":"2023-07-21T22:35:40.423601+0000","last_fullsized":"2023-07-21T22:35:40.423601+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.438717+0000","last_change":"2023-07-21T22:35:40.434147+0000","last_active":"2023-07-21T22:35:40.438717+0000","last_peered":"2023-07-21T22:35:40.438717+0000","last_clean":"2023-07-21T22:35:40.438717+0000","last_became_active":"2023-07-21T22:35:40.433804+0000","last_became_peered":"2023-07-21T22:35:40.433804+0000","last_unstale":"2023-07-21T22:35:40.438717+0000","last_undegraded":"2023-07-21T22:35:40.438717+0000","last_fullsized":"2023-07-21T22:35:40.438717+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:15:30.169233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.428001+0000","last_change":"2023-07-21T22:35:40.428001+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.428001+0000","last_undegraded":"2023-07-21T22:35:40.428001+0000","last_fullsized":"2023-07-21T22:35:40.428001+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.432160+0000","last_change":"2023-07-21T22:35:40.429279+0000","last_active":"2023-07-21T22:35:40.432160+0000","last_peered":"2023-07-21T22:35:40.432160+0000","last_clean":"2023-07-21T22:35:40.432160+0000","last_became_active":"2023-07-21T22:35:40.428980+0000","last_became_peered":"2023-07-21T22:35:40.428980+0000","last_unstale":"2023-07-21T22:35:40.432160+0000","last_undegraded":"2023-07-21T22:35:40.432160+0000","last_fullsized":"2023-07-21T22:35:40.432160+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:18:25.057533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.419933+0000","last_change":"2023-07-21T22:35:40.419933+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.419933+0000","last_undegraded":"2023-07-21T22:35:40.419933+0000","last_fullsized":"2023-07-21T22:35:40.419933+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.441067+0000","last_change":"2023-07-21T22:35:40.439163+0000","last_active":"2023-07-21T22:35:40.441067+0000","last_peered":"2023-07-21T22:35:40.441067+0000","last_clean":"2023-07-21T22:35:40.441067+0000","last_became_active":"2023-07-21T22:35:40.438863+0000","last_became_peered":"2023-07-21T22:35:40.438863+0000","last_unstale":"2023-07-21T22:35:40.441067+0000","last_undegraded":"2023-07-21T22:35:40.441067+0000","last_fullsized":"2023-07-21T22:35:40.441067+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:42:44.074458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.423511+0000","last_change":"2023-07-21T22:35:40.423511+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.423511+0000","last_undegraded":"2023-07-21T22:35:40.423511+0000","last_fullsized":"2023-07-21T22:35:40.423511+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.434812+0000","last_change":"2023-07-21T22:35:40.429995+0000","last_active":"2023-07-21T22:35:40.434812+0000","last_peered":"2023-07-21T22:35:40.434812+0000","last_clean":"2023-07-21T22:35:40.434812+0000","last_became_active":"2023-07-21T22:35:40.429725+0000","last_became_peered":"2023-07-21T22:35:40.429725+0000","last_unstale":"2023-07-21T22:35:40.434812+0000","last_undegraded":"2023-07-21T22:35:40.434812+0000","last_fullsized":"2023-07-21T22:35:40.434812+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:42:10.458404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.425900+0000","last_change":"2023-07-21T22:35:40.425900+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.425900+0000","last_undegraded":"2023-07-21T22:35:40.425900+0000","last_fullsized":"2023-07-21T22:35:40.425900+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.439075+0000","last_change":"2023-07-21T22:35:40.434725+0000","last_active":"2023-07-21T22:35:40.439075+0000","last_peered":"2023-07-21T22:35:40.439075+0000","last_clean":"2023-07-21T22:35:40.439075+0000","last_became_active":"2023-07-21T22:35:40.434401+0000","last_became_peered":"2023-07-21T22:35:40.434401+0000","last_unstale":"2023-07-21T22:35:40.439075+0000","last_undegraded":"2023-07-21T22:35:40.439075+0000","last_fullsized":"2023-07-21T22:35:40.439075+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:34:40.402810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420142+0000","last_change":"2023-07-21T22:35:40.420142+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420142+0000","last_undegraded":"2023-07-21T22:35:40.420142+0000","last_fullsized":"2023-07-21T22:35:40.420142+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.444169+0000","last_change":"2023-07-21T22:35:40.441811+0000","last_active":"2023-07-21T22:35:40.444169+0000","last_peered":"2023-07-21T22:35:40.444169+0000","last_clean":"2023-07-21T22:35:40.444169+0000","last_became_active":"2023-07-21T22:35:40.441488+0000","last_became_peered":"2023-07-21T22:35:40.441488+0000","last_unstale":"2023-07-21T22:35:40.444169+0000","last_undegraded":"2023-07-21T22:35:40.444169+0000","last_fullsized":"2023-07-21T22:35:40.444169+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:42:59.390932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.419867+0000","last_change":"2023-07-21T22:35:40.419867+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.419867+0000","last_undegraded":"2023-07-21T22:35:40.419867+0000","last_fullsized":"2023-07-21T22:35:40.419867+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.435766+0000","last_change":"2023-07-21T22:35:40.431340+0000","last_active":"2023-07-21T22:35:40.435766+0000","last_peered":"2023-07-21T22:35:40.435766+0000","last_clean":"2023-07-21T22:35:40.435766+0000","last_became_active":"2023-07-21T22:35:40.430803+0000","last_became_peered":"2023-07-21T22:35:40.430803+0000","last_unstale":"2023-07-21T22:35:40.435766+0000","last_undegraded":"2023-07-21T22:35:40.435766+0000","last_fullsized":"2023-07-21T22:35:40.435766+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:21:07.099124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.421665+0000","last_change":"2023-07-21T22:35:40.421665+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.421665+0000","last_undegraded":"2023-07-21T22:35:40.421665+0000","last_fullsized":"2023-07-21T22:35:40.421665+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440900+0000","last_change":"2023-07-21T22:35:40.438909+0000","last_active":"2023-07-21T22:35:40.440900+0000","last_peered":"2023-07-21T22:35:40.440900+0000","last_clean":"2023-07-21T22:35:40.440900+0000","last_became_active":"2023-07-21T22:35:40.438607+0000","last_became_peered":"2023-07-21T22:35:40.438607+0000","last_unstale":"2023-07-21T22:35:40.440900+0000","last_undegraded":"2023-07-21T22:35:40.440900+0000","last_fullsized":"2023-07-21T22:35:40.440900+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:36:16.312658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.423470+0000","last_change":"2023-07-21T22:35:40.423470+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.423470+0000","last_undegraded":"2023-07-21T22:35:40.423470+0000","last_fullsized":"2023-07-21T22:35:40.423470+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.439493+0000","last_change":"2023-07-21T22:35:40.435925+0000","last_active":"2023-07-21T22:35:40.439493+0000","last_peered":"2023-07-21T22:35:40.439493+0000","last_clean":"2023-07-21T22:35:40.439493+0000","last_became_active":"2023-07-21T22:35:40.435648+0000","last_became_peered":"2023-07-21T22:35:40.435648+0000","last_unstale":"2023-07-21T22:35:40.439493+0000","last_undegraded":"2023-07-21T22:35:40.439493+0000","last_fullsized":"2023-07-21T22:35:40.439493+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:49:32.823030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.418106+0000","last_change":"2023-07-21T22:35:40.418106+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.418106+0000","last_undegraded":"2023-07-21T22:35:40.418106+0000","last_fullsized":"2023-07-21T22:35:40.418106+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.438412+0000","last_change":"2023-07-21T22:35:40.433893+0000","last_active":"2023-07-21T22:35:40.438412+0000","last_peered":"2023-07-21T22:35:40.438412+0000","last_clean":"2023-07-21T22:35:40.438412+0000","last_became_active":"2023-07-21T22:35:40.433550+0000","last_became_peered":"2023-07-21T22:35:40.433550+0000","last_unstale":"2023-07-21T22:35:40.438412+0000","last_undegraded":"2023-07-21T22:35:40.438412+0000","last_fullsized":"2023-07-21T22:35:40.438412+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:51:25.969683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.418169+0000","last_change":"2023-07-21T22:35:40.418169+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.418169+0000","last_undegraded":"2023-07-21T22:35:40.418169+0000","last_fullsized":"2023-07-21T22:35:40.418169+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.439718+0000","last_change":"2023-07-21T22:35:40.435977+0000","last_active":"2023-07-21T22:35:40.439718+0000","last_peered":"2023-07-21T22:35:40.439718+0000","last_clean":"2023-07-21T22:35:40.439718+0000","last_became_active":"2023-07-21T22:35:40.435683+0000","last_became_peered":"2023-07-21T22:35:40.435683+0000","last_unstale":"2023-07-21T22:35:40.439718+0000","last_undegraded":"2023-07-21T22:35:40.439718+0000","last_fullsized":"2023-07-21T22:35:40.439718+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:44:28.111054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424484+0000","last_change":"2023-07-21T22:35:40.424484+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424484+0000","last_undegraded":"2023-07-21T22:35:40.424484+0000","last_fullsized":"2023-07-21T22:35:40.424484+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440853+0000","last_change":"2023-07-21T22:35:40.437173+0000","last_active":"2023-07-21T22:35:40.440853+0000","last_peered":"2023-07-21T22:35:40.440853+0000","last_clean":"2023-07-21T22:35:40.440853+0000","last_became_active":"2023-07-21T22:35:40.435532+0000","last_became_peered":"2023-07-21T22:35:40.435532+0000","last_unstale":"2023-07-21T22:35:40.440853+0000","last_undegraded":"2023-07-21T22:35:40.440853+0000","last_fullsized":"2023-07-21T22:35:40.440853+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:03.193160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.427422+0000","last_change":"2023-07-21T22:35:40.427422+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.427422+0000","last_undegraded":"2023-07-21T22:35:40.427422+0000","last_fullsized":"2023-07-21T22:35:40.427422+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.439013+0000","last_change":"2023-07-21T22:35:40.436051+0000","last_active":"2023-07-21T22:35:40.439013+0000","last_peered":"2023-07-21T22:35:40.439013+0000","last_clean":"2023-07-21T22:35:40.439013+0000","last_became_active":"2023-07-21T22:35:40.435765+0000","last_became_peered":"2023-07-21T22:35:40.435765+0000","last_unstale":"2023-07-21T22:35:40.439013+0000","last_undegraded":"2023-07-21T22:35:40.439013+0000","last_fullsized":"2023-07-21T22:35:40.439013+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:59:48.963572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.429872+0000","last_change":"2023-07-21T22:35:40.429872+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.429872+0000","last_undegraded":"2023-07-21T22:35:40.429872+0000","last_fullsized":"2023-07-21T22:35:40.429872+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440447+0000","last_change":"2023-07-21T22:35:40.439003+0000","last_active":"2023-07-21T22:35:40.440447+0000","last_peered":"2023-07-21T22:35:40.440447+0000","last_clean":"2023-07-21T22:35:40.440447+0000","last_became_active":"2023-07-21T22:35:40.438479+0000","last_became_peered":"2023-07-21T22:35:40.438479+0000","last_unstale":"2023-07-21T22:35:40.440447+0000","last_undegraded":"2023-07-21T22:35:40.440447+0000","last_fullsized":"2023-07-21T22:35:40.440447+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:02:26.383277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420230+0000","last_change":"2023-07-21T22:35:40.420230+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420230+0000","last_undegraded":"2023-07-21T22:35:40.420230+0000","last_fullsized":"2023-07-21T22:35:40.420230+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.443552+0000","last_change":"2023-07-21T22:35:40.440675+0000","last_active":"2023-07-21T22:35:40.443552+0000","last_peered":"2023-07-21T22:35:40.443552+0000","last_clean":"2023-07-21T22:35:40.443552+0000","last_became_active":"2023-07-21T22:35:40.440191+0000","last_became_peered":"2023-07-21T22:35:40.440191+0000","last_unstale":"2023-07-21T22:35:40.443552+0000","last_undegraded":"2023-07-21T22:35:40.443552+0000","last_fullsized":"2023-07-21T22:35:40.443552+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:52:58.701458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.418423+0000","last_change":"2023-07-21T22:35:40.418423+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.418423+0000","last_undegraded":"2023-07-21T22:35:40.418423+0000","last_fullsized":"2023-07-21T22:35:40.418423+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440153+0000","last_change":"2023-07-21T22:35:40.438483+0000","last_active":"2023-07-21T22:35:40.440153+0000","last_peered":"2023-07-21T22:35:40.440153+0000","last_clean":"2023-07-21T22:35:40.440153+0000","last_became_active":"2023-07-21T22:35:40.438212+0000","last_became_peered":"2023-07-21T22:35:40.438212+0000","last_unstale":"2023-07-21T22:35:40.440153+0000","last_undegraded":"2023-07-21T22:35:40.440153+0000","last_fullsized":"2023-07-21T22:35:40.440153+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:44:33.640689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.421211+0000","last_change":"2023-07-21T22:35:40.421211+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.421211+0000","last_undegraded":"2023-07-21T22:35:40.421211+0000","last_fullsized":"2023-07-21T22:35:40.421211+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.434865+0000","last_change":"2023-07-21T22:35:40.431308+0000","last_active":"2023-07-21T22:35:40.434865+0000","last_peered":"2023-07-21T22:35:40.434865+0000","last_clean":"2023-07-21T22:35:40.434865+0000","last_became_active":"2023-07-21T22:35:40.430971+0000","last_became_peered":"2023-07-21T22:35:40.430971+0000","last_unstale":"2023-07-21T22:35:40.434865+0000","last_undegraded":"2023-07-21T22:35:40.434865+0000","last_fullsized":"2023-07-21T22:35:40.434865+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:03:53.221395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.423889+0000","last_change":"2023-07-21T22:35:40.423889+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.423889+0000","last_undegraded":"2023-07-21T22:35:40.423889+0000","last_fullsized":"2023-07-21T22:35:40.423889+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.441877+0000","last_change":"2023-07-21T22:35:40.440037+0000","last_active":"2023-07-21T22:35:40.441877+0000","last_peered":"2023-07-21T22:35:40.441877+0000","last_clean":"2023-07-21T22:35:40.441877+0000","last_became_active":"2023-07-21T22:35:40.439762+0000","last_became_peered":"2023-07-21T22:35:40.439762+0000","last_unstale":"2023-07-21T22:35:40.441877+0000","last_undegraded":"2023-07-21T22:35:40.441877+0000","last_fullsized":"2023-07-21T22:35:40.441877+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:23:19.242316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.430522+0000","last_change":"2023-07-21T22:35:40.430522+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.430522+0000","last_undegraded":"2023-07-21T22:35:40.430522+0000","last_fullsized":"2023-07-21T22:35:40.430522+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.436063+0000","last_change":"2023-07-21T22:35:40.434129+0000","last_active":"2023-07-21T22:35:40.436063+0000","last_peered":"2023-07-21T22:35:40.436063+0000","last_clean":"2023-07-21T22:35:40.436063+0000","last_became_active":"2023-07-21T22:35:40.433862+0000","last_became_peered":"2023-07-21T22:35:40.433862+0000","last_unstale":"2023-07-21T22:35:40.436063+0000","last_undegraded":"2023-07-21T22:35:40.436063+0000","last_fullsized":"2023-07-21T22:35:40.436063+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:28:03.521963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.427652+0000","last_change":"2023-07-21T22:35:40.427652+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.427652+0000","last_undegraded":"2023-07-21T22:35:40.427652+0000","last_fullsized":"2023-07-21T22:35:40.427652+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.438468+0000","last_change":"2023-07-21T22:35:40.433064+0000","last_active":"2023-07-21T22:35:40.438468+0000","last_peered":"2023-07-21T22:35:40.438468+0000","last_clean":"2023-07-21T22:35:40.438468+0000","last_became_active":"2023-07-21T22:35:40.432727+0000","last_became_peered":"2023-07-21T22:35:40.432727+0000","last_unstale":"2023-07-21T22:35:40.438468+0000","last_undegraded":"2023-07-21T22:35:40.438468+0000","last_fullsized":"2023-07-21T22:35:40.438468+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:21:03.267520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"100'205","reported_seq":643,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.426835+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:35:40.426835+0000","last_peered":"2023-07-21T22:35:40.426835+0000","last_clean":"2023-07-21T22:35:40.426835+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:35:40.426835+0000","last_undegraded":"2023-07-21T22:35:40.426835+0000","last_fullsized":"2023-07-21T22:35:40.426835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:36:01.986411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.422451+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:35:40.422451+0000","last_peered":"2023-07-21T22:35:40.422451+0000","last_clean":"2023-07-21T22:35:40.422451+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:35:40.422451+0000","last_undegraded":"2023-07-21T22:35:40.422451+0000","last_fullsized":"2023-07-21T22:35:40.422451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:18:31.491085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424857+0000","last_change":"2023-07-21T22:35:40.424857+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424857+0000","last_undegraded":"2023-07-21T22:35:40.424857+0000","last_fullsized":"2023-07-21T22:35:40.424857+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.435040+0000","last_change":"2023-07-21T22:35:40.433828+0000","last_active":"2023-07-21T22:35:40.435040+0000","last_peered":"2023-07-21T22:35:40.435040+0000","last_clean":"2023-07-21T22:35:40.435040+0000","last_became_active":"2023-07-21T22:35:40.433537+0000","last_became_peered":"2023-07-21T22:35:40.433537+0000","last_unstale":"2023-07-21T22:35:40.435040+0000","last_undegraded":"2023-07-21T22:35:40.435040+0000","last_fullsized":"2023-07-21T22:35:40.435040+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:28:40.271547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.426718+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:35:40.426718+0000","last_peered":"2023-07-21T22:35:40.426718+0000","last_clean":"2023-07-21T22:35:40.426718+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:35:40.426718+0000","last_undegraded":"2023-07-21T22:35:40.426718+0000","last_fullsized":"2023-07-21T22:35:40.426718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:45.947440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.423880+0000","last_change":"2023-07-21T22:35:40.423880+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.423880+0000","last_undegraded":"2023-07-21T22:35:40.423880+0000","last_fullsized":"2023-07-21T22:35:40.423880+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440208+0000","last_change":"2023-07-21T22:35:40.435800+0000","last_active":"2023-07-21T22:35:40.440208+0000","last_peered":"2023-07-21T22:35:40.440208+0000","last_clean":"2023-07-21T22:35:40.440208+0000","last_became_active":"2023-07-21T22:35:40.435483+0000","last_became_peered":"2023-07-21T22:35:40.435483+0000","last_unstale":"2023-07-21T22:35:40.440208+0000","last_undegraded":"2023-07-21T22:35:40.440208+0000","last_fullsized":"2023-07-21T22:35:40.440208+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:03:30.720838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.413259+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:35:40.413259+0000","last_peered":"2023-07-21T22:35:40.413259+0000","last_clean":"2023-07-21T22:35:40.413259+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:35:40.413259+0000","last_undegraded":"2023-07-21T22:35:40.413259+0000","last_fullsized":"2023-07-21T22:35:40.413259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:02:00.190778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.430023+0000","last_change":"2023-07-21T22:35:40.430023+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.430023+0000","last_undegraded":"2023-07-21T22:35:40.430023+0000","last_fullsized":"2023-07-21T22:35:40.430023+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440425+0000","last_change":"2023-07-21T22:35:40.438789+0000","last_active":"2023-07-21T22:35:40.440425+0000","last_peered":"2023-07-21T22:35:40.440425+0000","last_clean":"2023-07-21T22:35:40.440425+0000","last_became_active":"2023-07-21T22:35:40.438114+0000","last_became_peered":"2023-07-21T22:35:40.438114+0000","last_unstale":"2023-07-21T22:35:40.440425+0000","last_undegraded":"2023-07-21T22:35:40.440425+0000","last_fullsized":"2023-07-21T22:35:40.440425+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:04:22.853070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.421978+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:35:40.421978+0000","last_peered":"2023-07-21T22:35:40.421978+0000","last_clean":"2023-07-21T22:35:40.421978+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:35:40.421978+0000","last_undegraded":"2023-07-21T22:35:40.421978+0000","last_fullsized":"2023-07-21T22:35:40.421978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:21:07.585851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424669+0000","last_change":"2023-07-21T22:35:40.424669+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424669+0000","last_undegraded":"2023-07-21T22:35:40.424669+0000","last_fullsized":"2023-07-21T22:35:40.424669+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.434924+0000","last_change":"2023-07-21T22:35:40.431423+0000","last_active":"2023-07-21T22:35:40.434924+0000","last_peered":"2023-07-21T22:35:40.434924+0000","last_clean":"2023-07-21T22:35:40.434924+0000","last_became_active":"2023-07-21T22:35:40.431123+0000","last_became_peered":"2023-07-21T22:35:40.431123+0000","last_unstale":"2023-07-21T22:35:40.434924+0000","last_undegraded":"2023-07-21T22:35:40.434924+0000","last_fullsized":"2023-07-21T22:35:40.434924+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:21:17.845810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.422041+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:35:40.422041+0000","last_peered":"2023-07-21T22:35:40.422041+0000","last_clean":"2023-07-21T22:35:40.422041+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:35:40.422041+0000","last_undegraded":"2023-07-21T22:35:40.422041+0000","last_fullsized":"2023-07-21T22:35:40.422041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:08:46.780739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.419952+0000","last_change":"2023-07-21T22:35:40.419952+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.419952+0000","last_undegraded":"2023-07-21T22:35:40.419952+0000","last_fullsized":"2023-07-21T22:35:40.419952+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.435195+0000","last_change":"2023-07-21T22:35:40.429195+0000","last_active":"2023-07-21T22:35:40.435195+0000","last_peered":"2023-07-21T22:35:40.435195+0000","last_clean":"2023-07-21T22:35:40.435195+0000","last_became_active":"2023-07-21T22:35:40.428906+0000","last_became_peered":"2023-07-21T22:35:40.428906+0000","last_unstale":"2023-07-21T22:35:40.435195+0000","last_undegraded":"2023-07-21T22:35:40.435195+0000","last_fullsized":"2023-07-21T22:35:40.435195+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:44.549024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.428271+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:35:40.428271+0000","last_peered":"2023-07-21T22:35:40.428271+0000","last_clean":"2023-07-21T22:35:40.428271+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:35:40.428271+0000","last_undegraded":"2023-07-21T22:35:40.428271+0000","last_fullsized":"2023-07-21T22:35:40.428271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:46:48.050930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.419934+0000","last_change":"2023-07-21T22:35:40.419934+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.419934+0000","last_undegraded":"2023-07-21T22:35:40.419934+0000","last_fullsized":"2023-07-21T22:35:40.419934+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440734+0000","last_change":"2023-07-21T22:35:40.436820+0000","last_active":"2023-07-21T22:35:40.440734+0000","last_peered":"2023-07-21T22:35:40.440734+0000","last_clean":"2023-07-21T22:35:40.440734+0000","last_became_active":"2023-07-21T22:35:40.436510+0000","last_became_peered":"2023-07-21T22:35:40.436510+0000","last_unstale":"2023-07-21T22:35:40.440734+0000","last_undegraded":"2023-07-21T22:35:40.440734+0000","last_fullsized":"2023-07-21T22:35:40.440734+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:15.357847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.419587+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:35:40.419587+0000","last_peered":"2023-07-21T22:35:40.419587+0000","last_clean":"2023-07-21T22:35:40.419587+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:35:40.419587+0000","last_undegraded":"2023-07-21T22:35:40.419587+0000","last_fullsized":"2023-07-21T22:35:40.419587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:31:49.740583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.431032+0000","last_change":"2023-07-21T22:35:40.431032+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.431032+0000","last_undegraded":"2023-07-21T22:35:40.431032+0000","last_fullsized":"2023-07-21T22:35:40.431032+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.434986+0000","last_change":"2023-07-21T22:35:40.423934+0000","last_active":"2023-07-21T22:35:40.434986+0000","last_peered":"2023-07-21T22:35:40.434986+0000","last_clean":"2023-07-21T22:35:40.434986+0000","last_became_active":"2023-07-21T22:35:40.423649+0000","last_became_peered":"2023-07-21T22:35:40.423649+0000","last_unstale":"2023-07-21T22:35:40.434986+0000","last_undegraded":"2023-07-21T22:35:40.434986+0000","last_fullsized":"2023-07-21T22:35:40.434986+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:22:52.903323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.426526+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:35:40.426526+0000","last_peered":"2023-07-21T22:35:40.426526+0000","last_clean":"2023-07-21T22:35:40.426526+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:35:40.426526+0000","last_undegraded":"2023-07-21T22:35:40.426526+0000","last_fullsized":"2023-07-21T22:35:40.426526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:48:53.359151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509645,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59180,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312660,"statfs":{"total":96636764160,"available":96576163840,"internally_reserved":0,"allocated":1937408,"data_stored":1260933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73299999999999998,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.35299999999999998,"15min":0.32600000000000001},"max":{"1min":1.1180000000000001,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.36099999999999999},"max":{"1min":0.90900000000000003,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.432,"15min":0.379},"max":{"1min":1.0509999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.85199999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72399999999999998,"15min":0.74299999999999999},"min":{"1min":0.51300000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.405},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72899999999999998,"15min":0.752},"min":{"1min":0.47999999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95699999999999996,"5min":1.409,"15min":1.409},"last":0.64500000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.504,"15min":0.42099999999999999},"max":{"1min":1.1539999999999999,"5min":1.46,"15min":1.46},"last":0.75},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.02,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.88}]},{"osd":4,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55400000000000005,"15min":0.55900000000000005},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.89900000000000002,"5min":0.90500000000000003,"15min":0.94999999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90400000000000003,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64500000000000002,"15min":0.61799999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.56499999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.052,"5min":1.506,"15min":1.506},"last":0.91900000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.048},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.434,"15min":0.42599999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.72699999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542351,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1343488,"data_stored":670565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.73599999999999999,"15min":0.76100000000000001},"min":{"1min":0.495,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.97599999999999998,"5min":1.016,"15min":1.016},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77700000000000002,"15min":0.79300000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.437},"max":{"1min":0.94699999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.56100000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.41999999999999998},"max":{"1min":0.90500000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.94599999999999995,"5min":0.99399999999999999,"15min":1.117},"last":0.60499999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.72999999999999998,"15min":0.75},"min":{"1min":0.499,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.96299999999999997,"5min":0.98099999999999998,"15min":1.0269999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.0149999999999999,"5min":1.097,"15min":1.097},"last":0.621}]},{"osd":3,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.76100000000000001},"min":{"1min":0.57899999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92800000000000005,"5min":1.048,"15min":1.048},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72499999999999998,"15min":0.74099999999999999},"min":{"1min":0.505,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88600000000000001,"5min":1.0049999999999999,"15min":1.054},"last":0.495}]},{"osd":4,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60299999999999998,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.374,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.441,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.048},"last":0.42999999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89600000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.91900000000000004,"5min":0.98799999999999999,"15min":1.054},"last":0.46800000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68500000000000005,"15min":0.67700000000000005},"min":{"1min":0.498,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":0.95699999999999996,"5min":1.079,"15min":1.079},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.70099999999999996,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96499999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.64800000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509644,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1343488,"data_stored":670565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.70699999999999996,"15min":0.71299999999999997},"min":{"1min":0.436,"5min":0.35699999999999998,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.70799999999999996,"15min":0.72199999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83999999999999997,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.75800000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66800000000000004,"15min":0.71099999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90600000000000003,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.71099999999999997,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77900000000000003,"5min":1.617,"15min":1.617},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.70999999999999996,"15min":0.73499999999999999},"min":{"1min":0.45100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.99399999999999999,"5min":1.0109999999999999,"15min":1.034},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.71399999999999997,"15min":0.747},"min":{"1min":0.498,"5min":0.377,"15min":0.377},"max":{"1min":0.86399999999999999,"5min":1.512,"15min":1.512},"last":0.84299999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.76100000000000001,"15min":0.78500000000000003},"min":{"1min":0.56299999999999994,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86199999999999999,"5min":1.472,"15min":1.472},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.59999999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.90800000000000003,"5min":1.556,"15min":1.556},"last":0.67700000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88900000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89200000000000002,"5min":1.012,"15min":1.038},"last":0.89800000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95499999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.622,"15min":0.60999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93799999999999994,"5min":1.02,"15min":1.02},"last":0.70699999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66100000000000003,"15min":0.65000000000000002},"min":{"1min":0.42399999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.91900000000000004,"5min":1.042,"15min":1.042},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.57899999999999996,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.88300000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509645,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1343488,"data_stored":670565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71999999999999997,"15min":0.74299999999999999},"min":{"1min":0.51200000000000001,"5min":0.438,"15min":0.40000000000000002},"max":{"1min":0.80900000000000005,"5min":0.99399999999999999,"15min":1.0429999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73299999999999998,"15min":0.74299999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.83599999999999997,"5min":0.96099999999999997,"15min":0.97599999999999998},"last":0.76600000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.39400000000000002},"max":{"1min":0.85499999999999998,"5min":1.002,"15min":1.0449999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.69399999999999995,"15min":0.69999999999999996},"min":{"1min":0.47299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.872,"5min":0.94299999999999995,"15min":1.016},"last":0.72899999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.51200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.95899999999999996,"5min":1.048,"15min":1.048},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.53000000000000003,"5min":0.41999999999999998,"15min":0.33000000000000002},"max":{"1min":1.006,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.85299999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72899999999999998,"15min":0.73699999999999999},"min":{"1min":0.51000000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94099999999999995,"5min":0.97999999999999998,"15min":1.026},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58399999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.78100000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.45100000000000001,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98899999999999999},"last":0.436}]},{"osd":6,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.38500000000000001},"max":{"1min":0.94699999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.57099999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.79400000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64400000000000002,"15min":0.65100000000000002},"min":{"1min":0.45500000000000002,"5min":0.39900000000000002,"15min":0.374},"max":{"1min":0.92100000000000004,"5min":1.0069999999999999,"15min":1.0429999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.135},"last":0.62}]}]},{"osd":3,"up_from":15,"seq":64424509644,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1331200,"data_stored":663893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.28599999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.55500000000000005,"5min":0.73099999999999998,"15min":0.76400000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.66300000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.371}]},{"osd":1,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.46899999999999997,"15min":0.47899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71799999999999997,"5min":0.754,"15min":0.83499999999999996},"last":0.312},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.54600000000000004,"15min":0.55500000000000005},"min":{"1min":0.30199999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.82599999999999996,"15min":0.90100000000000002},"last":0.29199999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54800000000000004,"15min":0.56000000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.997,"5min":0.997,"15min":1.1140000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.59099999999999997,"15min":0.59999999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69499999999999995,"5min":0.91800000000000004,"15min":0.99199999999999999},"last":0.39600000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0569999999999999,"5min":1.093,"15min":1.159},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.80200000000000005,"15min":0.82699999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0429999999999999,"5min":1.1459999999999999,"15min":1.3620000000000001},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.749,"15min":0.77600000000000002},"min":{"1min":0.501,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0029999999999999,"5min":1.0740000000000001,"15min":1.137},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.51300000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98199999999999998,"5min":1.048,"15min":1.2789999999999999},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.77400000000000002,"15min":0.79500000000000004},"min":{"1min":0.55700000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0289999999999999,"5min":1.056,"15min":1.3979999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.77500000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97099999999999997,"5min":1.1120000000000001,"15min":1.2450000000000001},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.79400000000000004,"15min":0.82499999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.024,"5min":1.087,"15min":1.335},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.81399999999999995,"15min":0.82999999999999996},"min":{"1min":0.57699999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.081,"5min":1.113,"15min":1.2130000000000001},"last":0.81399999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509646,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54492,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317348,"statfs":{"total":96636764160,"available":96580964352,"internally_reserved":0,"allocated":1331200,"data_stored":663893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45200000000000001,"15min":0.47099999999999997},"min":{"1min":0.27700000000000002,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.75,"5min":0.81200000000000006,"15min":0.94199999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.52400000000000002,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.84799999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.48799999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86699999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55800000000000005,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.012,"5min":1.085,"15min":1.085},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46999999999999997,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.30099999999999999,"15min":0.29699999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55000000000000004,"15min":0.56899999999999995},"min":{"1min":0.39300000000000002,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.77900000000000003,"15min":0.79600000000000004},"min":{"1min":0.49099999999999999,"5min":0.439,"15min":0.376},"max":{"1min":0.93500000000000005,"5min":1.2569999999999999,"15min":1.3420000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79200000000000004,"15min":0.80100000000000005},"min":{"1min":0.56000000000000005,"5min":0.501,"15min":0.432},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.58599999999999997,"5min":0.55800000000000005,"15min":0.496},"max":{"1min":0.93200000000000005,"5min":1.0600000000000001,"15min":1.1879999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80000000000000004,"15min":0.81100000000000005},"min":{"1min":0.54400000000000004,"5min":0.47299999999999998,"15min":0.46400000000000002},"max":{"1min":0.97599999999999998,"5min":1.171,"15min":1.3089999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.502,"5min":0.45500000000000002,"15min":0.40300000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.79700000000000004,"15min":0.81200000000000006},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.45600000000000002},"max":{"1min":0.88400000000000001,"5min":1.23,"15min":1.2649999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79900000000000004,"15min":0.82399999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.49099999999999999},"max":{"1min":0.90000000000000002,"5min":1.2,"15min":1.2909999999999999},"last":0.755},{"interface":"front","average":{"1min":0.75,"5min":0.79900000000000004,"15min":0.81599999999999995},"min":{"1min":0.57599999999999996,"5min":0.5,"15min":0.44700000000000001},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.65000000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509645,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1331200,"data_stored":663893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.28299999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53500000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.626,"5min":0.872,"15min":0.872},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.5,"15min":0.50700000000000001},"min":{"1min":0.33700000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63200000000000001,"5min":0.76100000000000001,"15min":0.81000000000000005},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.29099999999999998},"max":{"1min":0.78900000000000003,"5min":0.83599999999999997,"15min":0.88800000000000001},"last":0.42699999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.57599999999999996,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35799999999999998,"15min":0.33400000000000002},"max":{"1min":0.70799999999999996,"5min":0.84299999999999997,"15min":0.98899999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.505,"15min":0.51700000000000002},"min":{"1min":0.33100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.64200000000000002,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.748,"15min":0.77000000000000002},"min":{"1min":0.53100000000000003,"5min":0.432,"15min":0.432},"max":{"1min":0.91400000000000003,"5min":1.0860000000000001,"15min":1.234},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.57499999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.014,"5min":1.083,"15min":1.155},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75600000000000001,"15min":0.77800000000000002},"min":{"1min":0.53500000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92500000000000004,"5min":1.0609999999999999,"15min":1.1919999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78500000000000003,"15min":0.80000000000000004},"min":{"1min":0.55200000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.044,"5min":1.121,"15min":1.2849999999999999},"last":0.56899999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78600000000000003,"15min":0.81000000000000005},"min":{"1min":0.57199999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0229999999999999,"5min":1.0580000000000001,"15min":1.23},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76300000000000001,"15min":0.79000000000000004},"min":{"1min":0.50900000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0449999999999999,"5min":1.1020000000000001,"15min":1.3240000000000001},"last":0.61399999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78600000000000003,"15min":0.80900000000000005},"min":{"1min":0.58599999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.99299999999999999,"5min":1.103,"15min":1.3149999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79000000000000004,"15min":0.80800000000000005},"min":{"1min":0.55500000000000005,"5min":0.52600000000000002,"15min":0.45700000000000002},"max":{"1min":0.97499999999999998,"5min":1.115,"15min":1.3380000000000001},"last":0.64900000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509647,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37036,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334804,"statfs":{"total":96636764160,"available":96598839296,"internally_reserved":0,"allocated":1937408,"data_stored":1260933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.47399999999999998,"15min":0.47099999999999997},"min":{"1min":0.28399999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.64700000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.499,"15min":0.51300000000000001},"min":{"1min":0.374,"5min":0.247,"15min":0.247},"max":{"1min":0.63100000000000001,"5min":0.76200000000000001,"15min":0.79400000000000004},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71499999999999997,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51200000000000001,"15min":0.51700000000000002},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67000000000000004,"5min":0.871,"15min":0.871},"last":0.437}]},{"osd":3,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70899999999999996,"5min":0.84499999999999997,"15min":0.91300000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67700000000000005,"5min":1.038,"15min":1.038},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.754,"15min":0.77800000000000002},"min":{"1min":0.58099999999999996,"5min":0.46200000000000002,"15min":0.45200000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.321},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.78400000000000003,"15min":0.79800000000000004},"min":{"1min":0.55600000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.423},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76300000000000001,"15min":0.78100000000000003},"min":{"1min":0.55600000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.036,"5min":1.107,"15min":1.28},"last":0.627},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77600000000000002,"15min":0.80700000000000005},"min":{"1min":0.57699999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.24,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.67800000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76800000000000002,"15min":0.81200000000000006},"min":{"1min":0.53800000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.81699999999999995},"min":{"1min":0.60699999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0169999999999999,"5min":1.147,"15min":1.333},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78600000000000003,"15min":0.79800000000000004},"min":{"1min":0.54300000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.042,"5min":1.159,"15min":1.2310000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.79100000000000004,"15min":0.82899999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0609999999999999,"5min":1.1930000000000001,"15min":1.369},"last":0.70699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:35:46.388 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:35:46.444 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-07-21T22:35:46.394+0000 7ff0ae420640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:35:46.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.514+0000 7f1d91a0b640 1 Processor -- start 2023-07-21T22:35:46.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.514+0000 7f1d91a0b640 1 -- start start 2023-07-21T22:35:46.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d91a0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d8c15d0c0 0x7f1d8c06cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d91a0b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1d8c0ce390 0x7f1d8c0ad0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d91a0b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8c06d940 con 0x7f1d8c06d430 2023-07-21T22:35:46.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d91a0b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d8c06dc20 con 0x7f1d8c0ce390 2023-07-21T22:35:46.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d91a0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c06df00 con 0x7f1d8c15d0c0 2023-07-21T22:35:46.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d83fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1d8c06d430 0x7f1d8c0cdc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36954/0 (socket says 172.21.15.6:36954) 2023-07-21T22:35:46.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d83fff640 1 -- 172.21.15.6:0/722073571 learned_addr learned my addr 172.21.15.6:0/722073571 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:46.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8b7fe640 1 --2- 172.21.15.6:0/722073571 >> v2:172.21.15.161:3300/0 conn(0x7f1d8c0ce390 0x7f1d8c0ad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8affd640 1 --2- 172.21.15.6:0/722073571 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d8c15d0c0 0x7f1d8c06cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8a7fc640 1 -- 172.21.15.6:0/722073571 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414100305 0 0) 0x7f1d8c06d940 con 0x7f1d8c06d430 2023-07-21T22:35:46.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8a7fc640 1 -- 172.21.15.6:0/722073571 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d78003530 con 0x7f1d8c06d430 2023-07-21T22:35:46.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8a7fc640 1 -- 172.21.15.6:0/722073571 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3608988906 0 0) 0x7f1d78003530 con 0x7f1d8c06d430 2023-07-21T22:35:46.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8a7fc640 1 -- 172.21.15.6:0/722073571 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d8c15d0c0 msgr2=0x7f1d8c06cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:46.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8a7fc640 1 --2- 172.21.15.6:0/722073571 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d8c15d0c0 0x7f1d8c06cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8a7fc640 1 -- 172.21.15.6:0/722073571 >> v2:172.21.15.161:3300/0 conn(0x7f1d8c0ce390 msgr2=0x7f1d8c0ad0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:46.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8a7fc640 1 --2- 172.21.15.6:0/722073571 >> v2:172.21.15.161:3300/0 conn(0x7f1d8c0ce390 0x7f1d8c0ad0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8a7fc640 1 -- 172.21.15.6:0/722073571 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c06e1e0 con 0x7f1d8c06d430 2023-07-21T22:35:46.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8a7fc640 1 -- 172.21.15.6:0/722073571 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f1d74001680 con 0x7f1d8c06d430 2023-07-21T22:35:46.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8a7fc640 1 -- 172.21.15.6:0/722073571 >> v1:172.21.15.6:6789/0 conn(0x7f1d8c06d430 legacy=0x7f1d8c0cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8a7fc640 1 --2- 172.21.15.6:0/722073571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d78003980 0x7f1d78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8a7fc640 1 --2- 172.21.15.6:0/722073571 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d8c15d0c0 0x7f1d780047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8a7fc640 1 --2- 172.21.15.6:0/722073571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d78004d10 0x7f1d78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8a7fc640 1 -- 172.21.15.6:0/722073571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c06dc20 con 0x7f1d78004d10 2023-07-21T22:35:46.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8a7fc640 1 -- 172.21.15.6:0/722073571 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c06df00 con 0x7f1d78003980 2023-07-21T22:35:46.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8a7fc640 1 -- 172.21.15.6:0/722073571 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7800b990 con 0x7f1d8c15d0c0 2023-07-21T22:35:46.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8b7fe640 1 --2- 172.21.15.6:0/722073571 >> v2:172.21.15.161:3300/0 conn(0x7f1d8c0ce390 0x7f1d8c0ad0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:46.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8affd640 1 --2- 172.21.15.6:0/722073571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d78003980 0x7f1d78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8b7fe640 1 --2- 172.21.15.6:0/722073571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d78004d10 0x7f1d78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d83fff640 1 --2- 172.21.15.6:0/722073571 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d8c15d0c0 0x7f1d780047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8b7fe640 1 -- 172.21.15.6:0/722073571 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d8c15d0c0 msgr2=0x7f1d780047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:46.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8b7fe640 1 --2- 172.21.15.6:0/722073571 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d8c15d0c0 0x7f1d780047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8b7fe640 1 -- 172.21.15.6:0/722073571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d78003980 msgr2=0x7f1d78003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:46.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8b7fe640 1 --2- 172.21.15.6:0/722073571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d78003980 0x7f1d78003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.518+0000 7f1d8b7fe640 1 -- 172.21.15.6:0/722073571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d78003530 con 0x7f1d78004d10 2023-07-21T22:35:46.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.522+0000 7f1d8b7fe640 1 --2- 172.21.15.6:0/722073571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d78004d10 0x7f1d78005180 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400e350 tx=0x7f1d8401cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d41979245879093 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:46.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.522+0000 7f1d8a7fc640 1 -- 172.21.15.6:0/722073571 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d840a5e50 con 0x7f1d78004d10 2023-07-21T22:35:46.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.522+0000 7f1d8a7fc640 1 -- 172.21.15.6:0/722073571 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8400f040 con 0x7f1d78004d10 2023-07-21T22:35:46.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.522+0000 7f1d8a7fc640 1 -- 172.21.15.6:0/722073571 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d84003ba0 con 0x7f1d78004d10 2023-07-21T22:35:46.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.522+0000 7f1d91a0b640 1 -- 172.21.15.6:0/722073571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d78004d10 msgr2=0x7f1d78005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.522+0000 7f1d91a0b640 1 --2- 172.21.15.6:0/722073571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d78004d10 0x7f1d78005180 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400e350 tx=0x7f1d8401cde0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.522+0000 7f1d8b7fe640 1 -- 172.21.15.6:0/722073571 reap_dead start 2023-07-21T22:35:46.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.522+0000 7f1d91a0b640 1 -- 172.21.15.6:0/722073571 shutdown_connections 2023-07-21T22:35:46.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.522+0000 7f1d91a0b640 1 -- 172.21.15.6:0/722073571 >> 172.21.15.6:0/722073571 conn(0x7f1d8c0659d0 msgr2=0x7f1d8c099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:46.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.522+0000 7f1d91a0b640 1 -- 172.21.15.6:0/722073571 shutdown_connections 2023-07-21T22:35:46.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.522+0000 7f1d91a0b640 1 -- 172.21.15.6:0/722073571 wait complete. 2023-07-21T22:35:46.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d91a0b640 1 Processor -- start 2023-07-21T22:35:46.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d91a0b640 1 -- start start 2023-07-21T22:35:46.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d91a0b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d78004d10 0x7f1d8c14e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d91a0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d8c0b4ba0 0x7f1d8c0b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d91a0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d8c0c3bc0 0x7f1d8c0c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d91a0b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c14ed60 con 0x7f1d8c0c3bc0 2023-07-21T22:35:46.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d91a0b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c0c4570 con 0x7f1d78004d10 2023-07-21T22:35:46.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d91a0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c0b5530 con 0x7f1d8c0b4ba0 2023-07-21T22:35:46.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d8b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d8c0c3bc0 0x7f1d8c0c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d8b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d8c0c3bc0 0x7f1d8c0c4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48570/0 (socket says 172.21.15.6:48570) 2023-07-21T22:35:46.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d8b7fe640 1 -- 172.21.15.6:0/286529657 learned_addr learned my addr 172.21.15.6:0/286529657 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:46.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d8affd640 1 --2- 172.21.15.6:0/286529657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d78004d10 0x7f1d8c14e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d83fff640 1 --2- 172.21.15.6:0/286529657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d8c0b4ba0 0x7f1d8c0b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d8b7fe640 1 -- 172.21.15.6:0/286529657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d8c0b4ba0 msgr2=0x7f1d8c0b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d8b7fe640 1 --2- 172.21.15.6:0/286529657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d8c0b4ba0 0x7f1d8c0b4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d8b7fe640 1 -- 172.21.15.6:0/286529657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d78004d10 msgr2=0x7f1d8c14e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d8b7fe640 1 --2- 172.21.15.6:0/286529657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d78004d10 0x7f1d8c14e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d8b7fe640 1 -- 172.21.15.6:0/286529657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c153c90 con 0x7f1d8c0c3bc0 2023-07-21T22:35:46.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d8b7fe640 1 --2- 172.21.15.6:0/286529657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d8c0c3bc0 0x7f1d8c0c4030 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1d8401d680 tx=0x7f1d84009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:46.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d88ff9640 1 -- 172.21.15.6:0/286529657 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d840bd070 con 0x7f1d8c0c3bc0 2023-07-21T22:35:46.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d88ff9640 1 -- 172.21.15.6:0/286529657 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d840ade40 con 0x7f1d8c0c3bc0 2023-07-21T22:35:46.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d88ff9640 1 -- 172.21.15.6:0/286529657 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d84003ba0 con 0x7f1d8c0c3bc0 2023-07-21T22:35:46.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d91a0b640 1 -- 172.21.15.6:0/286529657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8c0c5f60 con 0x7f1d8c0c3bc0 2023-07-21T22:35:46.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.526+0000 7f1d91a0b640 1 -- 172.21.15.6:0/286529657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8c0c4a80 con 0x7f1d8c0c3bc0 2023-07-21T22:35:46.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.530+0000 7f1d91a0b640 1 -- 172.21.15.6:0/286529657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8c153e20 con 0x7f1d8c0c3bc0 2023-07-21T22:35:46.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.530+0000 7f1d88ff9640 1 -- 172.21.15.6:0/286529657 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1d84003d00 con 0x7f1d8c0c3bc0 2023-07-21T22:35:46.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.530+0000 7f1d88ff9640 1 --2- 172.21.15.6:0/286529657 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f1d6c0663d0 0x7f1d6c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.530+0000 7f1d88ff9640 1 -- 172.21.15.6:0/286529657 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f1d8411f0a0 con 0x7f1d8c0c3bc0 2023-07-21T22:35:46.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.530+0000 7f1d8affd640 1 --2- 172.21.15.6:0/286529657 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f1d6c0663d0 0x7f1d6c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.530+0000 7f1d8affd640 1 --2- 172.21.15.6:0/286529657 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f1d6c0663d0 0x7f1d6c068880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c009a80 tx=0x7f1d7c008040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:46.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.534+0000 7f1d88ff9640 1 -- 172.21.15.6:0/286529657 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1d840ec3d0 con 0x7f1d8c0c3bc0 2023-07-21T22:35:46.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.686+0000 7f1d91a0b640 1 -- 172.21.15.6:0/286529657 --> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d8c15d490 con 0x7f1d6c0663d0 2023-07-21T22:35:46.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.694+0000 7f1d88ff9640 1 -- 172.21.15.6:0/286529657 <== mgr.7255 v2:172.21.15.161:6832/3891612664 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305945 (secure 0 0 0) 0x7f1d7c014a90 con 0x7f1d6c0663d0 2023-07-21T22:35:46.749 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:46.750 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:35:46.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.698+0000 7f1d91a0b640 1 -- 172.21.15.6:0/286529657 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f1d6c0663d0 msgr2=0x7f1d6c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.698+0000 7f1d91a0b640 1 --2- 172.21.15.6:0/286529657 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f1d6c0663d0 0x7f1d6c068880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c009a80 tx=0x7f1d7c008040 comp rx=0 tx=0).stop 2023-07-21T22:35:46.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.698+0000 7f1d91a0b640 1 -- 172.21.15.6:0/286529657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d8c0c3bc0 msgr2=0x7f1d8c0c4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.698+0000 7f1d91a0b640 1 --2- 172.21.15.6:0/286529657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d8c0c3bc0 0x7f1d8c0c4030 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1d8401d680 tx=0x7f1d84009750 comp rx=0 tx=0).stop 2023-07-21T22:35:46.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.698+0000 7f1d91a0b640 1 -- 172.21.15.6:0/286529657 shutdown_connections 2023-07-21T22:35:46.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.698+0000 7f1d91a0b640 1 --2- 172.21.15.6:0/286529657 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f1d6c0663d0 0x7f1d6c068880 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.698+0000 7f1d91a0b640 1 --2- 172.21.15.6:0/286529657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d8c0c3bc0 0x7f1d8c0c4030 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.698+0000 7f1d91a0b640 1 --2- 172.21.15.6:0/286529657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d8c0b4ba0 0x7f1d8c0b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.698+0000 7f1d91a0b640 1 --2- 172.21.15.6:0/286529657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d78004d10 0x7f1d8c14e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.698+0000 7f1d91a0b640 1 -- 172.21.15.6:0/286529657 >> 172.21.15.6:0/286529657 conn(0x7f1d8c0659d0 msgr2=0x7f1d8c0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:46.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.698+0000 7f1d91a0b640 1 -- 172.21.15.6:0/286529657 shutdown_connections 2023-07-21T22:35:46.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.698+0000 7f1d91a0b640 1 -- 172.21.15.6:0/286529657 wait complete. 2023-07-21T22:35:46.770 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-21T22:35:45.025581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":312484,"kb_used_data":11620,"kb_used_omap":0,"kb_used_meta":300800,"kb_avail":754662236,"statfs":{"total":773094113280,"available":772774129664,"internally_reserved":0,"allocated":11898880,"data_stored":6525240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308019200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.615934"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.423025+0000","last_change":"2023-07-21T22:35:40.423025+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.423025+0000","last_undegraded":"2023-07-21T22:35:40.423025+0000","last_fullsized":"2023-07-21T22:35:40.423025+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420047+0000","last_change":"2023-07-21T22:35:40.420047+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420047+0000","last_undegraded":"2023-07-21T22:35:40.420047+0000","last_fullsized":"2023-07-21T22:35:40.420047+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.421225+0000","last_change":"2023-07-21T22:35:40.421225+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.421225+0000","last_undegraded":"2023-07-21T22:35:40.421225+0000","last_fullsized":"2023-07-21T22:35:40.421225+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.421779+0000","last_change":"2023-07-21T22:35:40.421779+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.421779+0000","last_undegraded":"2023-07-21T22:35:40.421779+0000","last_fullsized":"2023-07-21T22:35:40.421779+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.429598+0000","last_change":"2023-07-21T22:35:40.429598+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.429598+0000","last_undegraded":"2023-07-21T22:35:40.429598+0000","last_fullsized":"2023-07-21T22:35:40.429598+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.430526+0000","last_change":"2023-07-21T22:35:40.430526+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.430526+0000","last_undegraded":"2023-07-21T22:35:40.430526+0000","last_fullsized":"2023-07-21T22:35:40.430526+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424526+0000","last_change":"2023-07-21T22:35:40.424526+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424526+0000","last_undegraded":"2023-07-21T22:35:40.424526+0000","last_fullsized":"2023-07-21T22:35:40.424526+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420838+0000","last_change":"2023-07-21T22:35:40.420838+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420838+0000","last_undegraded":"2023-07-21T22:35:40.420838+0000","last_fullsized":"2023-07-21T22:35:40.420838+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424353+0000","last_change":"2023-07-21T22:35:40.424353+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424353+0000","last_undegraded":"2023-07-21T22:35:40.424353+0000","last_fullsized":"2023-07-21T22:35:40.424353+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.418763+0000","last_change":"2023-07-21T22:35:40.418763+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.418763+0000","last_undegraded":"2023-07-21T22:35:40.418763+0000","last_fullsized":"2023-07-21T22:35:40.418763+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.430089+0000","last_change":"2023-07-21T22:35:40.430089+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.430089+0000","last_undegraded":"2023-07-21T22:35:40.430089+0000","last_fullsized":"2023-07-21T22:35:40.430089+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.418675+0000","last_change":"2023-07-21T22:35:40.418675+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.418675+0000","last_undegraded":"2023-07-21T22:35:40.418675+0000","last_fullsized":"2023-07-21T22:35:40.418675+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420385+0000","last_change":"2023-07-21T22:35:40.420385+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420385+0000","last_undegraded":"2023-07-21T22:35:40.420385+0000","last_fullsized":"2023-07-21T22:35:40.420385+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.429283+0000","last_change":"2023-07-21T22:35:40.429283+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.429283+0000","last_undegraded":"2023-07-21T22:35:40.429283+0000","last_fullsized":"2023-07-21T22:35:40.429283+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.422505+0000","last_change":"2023-07-21T22:35:40.422505+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.422505+0000","last_undegraded":"2023-07-21T22:35:40.422505+0000","last_fullsized":"2023-07-21T22:35:40.422505+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.427423+0000","last_change":"2023-07-21T22:35:40.427423+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.427423+0000","last_undegraded":"2023-07-21T22:35:40.427423+0000","last_fullsized":"2023-07-21T22:35:40.427423+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.428251+0000","last_change":"2023-07-21T22:35:40.428251+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.428251+0000","last_undegraded":"2023-07-21T22:35:40.428251+0000","last_fullsized":"2023-07-21T22:35:40.428251+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.425699+0000","last_change":"2023-07-21T22:35:40.425699+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.425699+0000","last_undegraded":"2023-07-21T22:35:40.425699+0000","last_fullsized":"2023-07-21T22:35:40.425699+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424851+0000","last_change":"2023-07-21T22:35:40.424851+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424851+0000","last_undegraded":"2023-07-21T22:35:40.424851+0000","last_fullsized":"2023-07-21T22:35:40.424851+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.421317+0000","last_change":"2023-07-21T22:35:40.421317+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.421317+0000","last_undegraded":"2023-07-21T22:35:40.421317+0000","last_fullsized":"2023-07-21T22:35:40.421317+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.425277+0000","last_change":"2023-07-21T22:35:40.425277+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.425277+0000","last_undegraded":"2023-07-21T22:35:40.425277+0000","last_fullsized":"2023-07-21T22:35:40.425277+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.428797+0000","last_change":"2023-07-21T22:35:40.428797+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.428797+0000","last_undegraded":"2023-07-21T22:35:40.428797+0000","last_fullsized":"2023-07-21T22:35:40.428797+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424752+0000","last_change":"2023-07-21T22:35:40.424752+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424752+0000","last_undegraded":"2023-07-21T22:35:40.424752+0000","last_fullsized":"2023-07-21T22:35:40.424752+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420692+0000","last_change":"2023-07-21T22:35:40.420692+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420692+0000","last_undegraded":"2023-07-21T22:35:40.420692+0000","last_fullsized":"2023-07-21T22:35:40.420692+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420732+0000","last_change":"2023-07-21T22:35:40.420732+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420732+0000","last_undegraded":"2023-07-21T22:35:40.420732+0000","last_fullsized":"2023-07-21T22:35:40.420732+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.430470+0000","last_change":"2023-07-21T22:35:40.430470+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.430470+0000","last_undegraded":"2023-07-21T22:35:40.430470+0000","last_fullsized":"2023-07-21T22:35:40.430470+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.418305+0000","last_change":"2023-07-21T22:35:40.418305+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.418305+0000","last_undegraded":"2023-07-21T22:35:40.418305+0000","last_fullsized":"2023-07-21T22:35:40.418305+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420896+0000","last_change":"2023-07-21T22:35:40.420896+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420896+0000","last_undegraded":"2023-07-21T22:35:40.420896+0000","last_fullsized":"2023-07-21T22:35:40.420896+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.425095+0000","last_change":"2023-07-21T22:35:40.425095+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.425095+0000","last_undegraded":"2023-07-21T22:35:40.425095+0000","last_fullsized":"2023-07-21T22:35:40.425095+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.428282+0000","last_change":"2023-07-21T22:35:40.428282+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.428282+0000","last_undegraded":"2023-07-21T22:35:40.428282+0000","last_fullsized":"2023-07-21T22:35:40.428282+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.421437+0000","last_change":"2023-07-21T22:35:40.421437+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.421437+0000","last_undegraded":"2023-07-21T22:35:40.421437+0000","last_fullsized":"2023-07-21T22:35:40.421437+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.426901+0000","last_change":"2023-07-21T22:35:40.426901+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.426901+0000","last_undegraded":"2023-07-21T22:35:40.426901+0000","last_fullsized":"2023-07-21T22:35:40.426901+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.429666+0000","last_change":"2023-07-21T22:35:40.429666+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.429666+0000","last_undegraded":"2023-07-21T22:35:40.429666+0000","last_fullsized":"2023-07-21T22:35:40.429666+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440773+0000","last_change":"2023-07-21T22:35:40.437895+0000","last_active":"2023-07-21T22:35:40.440773+0000","last_peered":"2023-07-21T22:35:40.440773+0000","last_clean":"2023-07-21T22:35:40.440773+0000","last_became_active":"2023-07-21T22:35:40.436744+0000","last_became_peered":"2023-07-21T22:35:40.436744+0000","last_unstale":"2023-07-21T22:35:40.440773+0000","last_undegraded":"2023-07-21T22:35:40.440773+0000","last_fullsized":"2023-07-21T22:35:40.440773+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:04:30.695462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.427873+0000","last_change":"2023-07-21T22:35:40.427873+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.427873+0000","last_undegraded":"2023-07-21T22:35:40.427873+0000","last_fullsized":"2023-07-21T22:35:40.427873+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.439030+0000","last_change":"2023-07-21T22:35:40.436147+0000","last_active":"2023-07-21T22:35:40.439030+0000","last_peered":"2023-07-21T22:35:40.439030+0000","last_clean":"2023-07-21T22:35:40.439030+0000","last_became_active":"2023-07-21T22:35:40.435878+0000","last_became_peered":"2023-07-21T22:35:40.435878+0000","last_unstale":"2023-07-21T22:35:40.439030+0000","last_undegraded":"2023-07-21T22:35:40.439030+0000","last_fullsized":"2023-07-21T22:35:40.439030+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:10:23.638420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.427840+0000","last_change":"2023-07-21T22:35:40.427840+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.427840+0000","last_undegraded":"2023-07-21T22:35:40.427840+0000","last_fullsized":"2023-07-21T22:35:40.427840+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.441589+0000","last_change":"2023-07-21T22:35:40.440062+0000","last_active":"2023-07-21T22:35:40.441589+0000","last_peered":"2023-07-21T22:35:40.441589+0000","last_clean":"2023-07-21T22:35:40.441589+0000","last_became_active":"2023-07-21T22:35:40.439791+0000","last_became_peered":"2023-07-21T22:35:40.439791+0000","last_unstale":"2023-07-21T22:35:40.441589+0000","last_undegraded":"2023-07-21T22:35:40.441589+0000","last_fullsized":"2023-07-21T22:35:40.441589+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:12:02.163677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.427792+0000","last_change":"2023-07-21T22:35:40.427792+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.427792+0000","last_undegraded":"2023-07-21T22:35:40.427792+0000","last_fullsized":"2023-07-21T22:35:40.427792+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440795+0000","last_change":"2023-07-21T22:35:40.437899+0000","last_active":"2023-07-21T22:35:40.440795+0000","last_peered":"2023-07-21T22:35:40.440795+0000","last_clean":"2023-07-21T22:35:40.440795+0000","last_became_active":"2023-07-21T22:35:40.437604+0000","last_became_peered":"2023-07-21T22:35:40.437604+0000","last_unstale":"2023-07-21T22:35:40.440795+0000","last_undegraded":"2023-07-21T22:35:40.440795+0000","last_fullsized":"2023-07-21T22:35:40.440795+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:39:42.918696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.422116+0000","last_change":"2023-07-21T22:35:40.422116+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.422116+0000","last_undegraded":"2023-07-21T22:35:40.422116+0000","last_fullsized":"2023-07-21T22:35:40.422116+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.441407+0000","last_change":"2023-07-21T22:35:40.439578+0000","last_active":"2023-07-21T22:35:40.441407+0000","last_peered":"2023-07-21T22:35:40.441407+0000","last_clean":"2023-07-21T22:35:40.441407+0000","last_became_active":"2023-07-21T22:35:40.439264+0000","last_became_peered":"2023-07-21T22:35:40.439264+0000","last_unstale":"2023-07-21T22:35:40.441407+0000","last_undegraded":"2023-07-21T22:35:40.441407+0000","last_fullsized":"2023-07-21T22:35:40.441407+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:44:32.158083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.423601+0000","last_change":"2023-07-21T22:35:40.423601+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.423601+0000","last_undegraded":"2023-07-21T22:35:40.423601+0000","last_fullsized":"2023-07-21T22:35:40.423601+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.438717+0000","last_change":"2023-07-21T22:35:40.434147+0000","last_active":"2023-07-21T22:35:40.438717+0000","last_peered":"2023-07-21T22:35:40.438717+0000","last_clean":"2023-07-21T22:35:40.438717+0000","last_became_active":"2023-07-21T22:35:40.433804+0000","last_became_peered":"2023-07-21T22:35:40.433804+0000","last_unstale":"2023-07-21T22:35:40.438717+0000","last_undegraded":"2023-07-21T22:35:40.438717+0000","last_fullsized":"2023-07-21T22:35:40.438717+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:15:30.169233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.428001+0000","last_change":"2023-07-21T22:35:40.428001+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.428001+0000","last_undegraded":"2023-07-21T22:35:40.428001+0000","last_fullsized":"2023-07-21T22:35:40.428001+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.432160+0000","last_change":"2023-07-21T22:35:40.429279+0000","last_active":"2023-07-21T22:35:40.432160+0000","last_peered":"2023-07-21T22:35:40.432160+0000","last_clean":"2023-07-21T22:35:40.432160+0000","last_became_active":"2023-07-21T22:35:40.428980+0000","last_became_peered":"2023-07-21T22:35:40.428980+0000","last_unstale":"2023-07-21T22:35:40.432160+0000","last_undegraded":"2023-07-21T22:35:40.432160+0000","last_fullsized":"2023-07-21T22:35:40.432160+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:18:25.057533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.419933+0000","last_change":"2023-07-21T22:35:40.419933+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.419933+0000","last_undegraded":"2023-07-21T22:35:40.419933+0000","last_fullsized":"2023-07-21T22:35:40.419933+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.441067+0000","last_change":"2023-07-21T22:35:40.439163+0000","last_active":"2023-07-21T22:35:40.441067+0000","last_peered":"2023-07-21T22:35:40.441067+0000","last_clean":"2023-07-21T22:35:40.441067+0000","last_became_active":"2023-07-21T22:35:40.438863+0000","last_became_peered":"2023-07-21T22:35:40.438863+0000","last_unstale":"2023-07-21T22:35:40.441067+0000","last_undegraded":"2023-07-21T22:35:40.441067+0000","last_fullsized":"2023-07-21T22:35:40.441067+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:42:44.074458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.423511+0000","last_change":"2023-07-21T22:35:40.423511+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.423511+0000","last_undegraded":"2023-07-21T22:35:40.423511+0000","last_fullsized":"2023-07-21T22:35:40.423511+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.434812+0000","last_change":"2023-07-21T22:35:40.429995+0000","last_active":"2023-07-21T22:35:40.434812+0000","last_peered":"2023-07-21T22:35:40.434812+0000","last_clean":"2023-07-21T22:35:40.434812+0000","last_became_active":"2023-07-21T22:35:40.429725+0000","last_became_peered":"2023-07-21T22:35:40.429725+0000","last_unstale":"2023-07-21T22:35:40.434812+0000","last_undegraded":"2023-07-21T22:35:40.434812+0000","last_fullsized":"2023-07-21T22:35:40.434812+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:42:10.458404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.425900+0000","last_change":"2023-07-21T22:35:40.425900+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.425900+0000","last_undegraded":"2023-07-21T22:35:40.425900+0000","last_fullsized":"2023-07-21T22:35:40.425900+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.439075+0000","last_change":"2023-07-21T22:35:40.434725+0000","last_active":"2023-07-21T22:35:40.439075+0000","last_peered":"2023-07-21T22:35:40.439075+0000","last_clean":"2023-07-21T22:35:40.439075+0000","last_became_active":"2023-07-21T22:35:40.434401+0000","last_became_peered":"2023-07-21T22:35:40.434401+0000","last_unstale":"2023-07-21T22:35:40.439075+0000","last_undegraded":"2023-07-21T22:35:40.439075+0000","last_fullsized":"2023-07-21T22:35:40.439075+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:34:40.402810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420142+0000","last_change":"2023-07-21T22:35:40.420142+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420142+0000","last_undegraded":"2023-07-21T22:35:40.420142+0000","last_fullsized":"2023-07-21T22:35:40.420142+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.444169+0000","last_change":"2023-07-21T22:35:40.441811+0000","last_active":"2023-07-21T22:35:40.444169+0000","last_peered":"2023-07-21T22:35:40.444169+0000","last_clean":"2023-07-21T22:35:40.444169+0000","last_became_active":"2023-07-21T22:35:40.441488+0000","last_became_peered":"2023-07-21T22:35:40.441488+0000","last_unstale":"2023-07-21T22:35:40.444169+0000","last_undegraded":"2023-07-21T22:35:40.444169+0000","last_fullsized":"2023-07-21T22:35:40.444169+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:42:59.390932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.419867+0000","last_change":"2023-07-21T22:35:40.419867+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.419867+0000","last_undegraded":"2023-07-21T22:35:40.419867+0000","last_fullsized":"2023-07-21T22:35:40.419867+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.435766+0000","last_change":"2023-07-21T22:35:40.431340+0000","last_active":"2023-07-21T22:35:40.435766+0000","last_peered":"2023-07-21T22:35:40.435766+0000","last_clean":"2023-07-21T22:35:40.435766+0000","last_became_active":"2023-07-21T22:35:40.430803+0000","last_became_peered":"2023-07-21T22:35:40.430803+0000","last_unstale":"2023-07-21T22:35:40.435766+0000","last_undegraded":"2023-07-21T22:35:40.435766+0000","last_fullsized":"2023-07-21T22:35:40.435766+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:21:07.099124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.421665+0000","last_change":"2023-07-21T22:35:40.421665+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.421665+0000","last_undegraded":"2023-07-21T22:35:40.421665+0000","last_fullsized":"2023-07-21T22:35:40.421665+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440900+0000","last_change":"2023-07-21T22:35:40.438909+0000","last_active":"2023-07-21T22:35:40.440900+0000","last_peered":"2023-07-21T22:35:40.440900+0000","last_clean":"2023-07-21T22:35:40.440900+0000","last_became_active":"2023-07-21T22:35:40.438607+0000","last_became_peered":"2023-07-21T22:35:40.438607+0000","last_unstale":"2023-07-21T22:35:40.440900+0000","last_undegraded":"2023-07-21T22:35:40.440900+0000","last_fullsized":"2023-07-21T22:35:40.440900+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:36:16.312658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.423470+0000","last_change":"2023-07-21T22:35:40.423470+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.423470+0000","last_undegraded":"2023-07-21T22:35:40.423470+0000","last_fullsized":"2023-07-21T22:35:40.423470+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.439493+0000","last_change":"2023-07-21T22:35:40.435925+0000","last_active":"2023-07-21T22:35:40.439493+0000","last_peered":"2023-07-21T22:35:40.439493+0000","last_clean":"2023-07-21T22:35:40.439493+0000","last_became_active":"2023-07-21T22:35:40.435648+0000","last_became_peered":"2023-07-21T22:35:40.435648+0000","last_unstale":"2023-07-21T22:35:40.439493+0000","last_undegraded":"2023-07-21T22:35:40.439493+0000","last_fullsized":"2023-07-21T22:35:40.439493+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:49:32.823030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.418106+0000","last_change":"2023-07-21T22:35:40.418106+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.418106+0000","last_undegraded":"2023-07-21T22:35:40.418106+0000","last_fullsized":"2023-07-21T22:35:40.418106+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.438412+0000","last_change":"2023-07-21T22:35:40.433893+0000","last_active":"2023-07-21T22:35:40.438412+0000","last_peered":"2023-07-21T22:35:40.438412+0000","last_clean":"2023-07-21T22:35:40.438412+0000","last_became_active":"2023-07-21T22:35:40.433550+0000","last_became_peered":"2023-07-21T22:35:40.433550+0000","last_unstale":"2023-07-21T22:35:40.438412+0000","last_undegraded":"2023-07-21T22:35:40.438412+0000","last_fullsized":"2023-07-21T22:35:40.438412+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:51:25.969683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.418169+0000","last_change":"2023-07-21T22:35:40.418169+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.418169+0000","last_undegraded":"2023-07-21T22:35:40.418169+0000","last_fullsized":"2023-07-21T22:35:40.418169+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.439718+0000","last_change":"2023-07-21T22:35:40.435977+0000","last_active":"2023-07-21T22:35:40.439718+0000","last_peered":"2023-07-21T22:35:40.439718+0000","last_clean":"2023-07-21T22:35:40.439718+0000","last_became_active":"2023-07-21T22:35:40.435683+0000","last_became_peered":"2023-07-21T22:35:40.435683+0000","last_unstale":"2023-07-21T22:35:40.439718+0000","last_undegraded":"2023-07-21T22:35:40.439718+0000","last_fullsized":"2023-07-21T22:35:40.439718+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:44:28.111054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424484+0000","last_change":"2023-07-21T22:35:40.424484+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424484+0000","last_undegraded":"2023-07-21T22:35:40.424484+0000","last_fullsized":"2023-07-21T22:35:40.424484+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440853+0000","last_change":"2023-07-21T22:35:40.437173+0000","last_active":"2023-07-21T22:35:40.440853+0000","last_peered":"2023-07-21T22:35:40.440853+0000","last_clean":"2023-07-21T22:35:40.440853+0000","last_became_active":"2023-07-21T22:35:40.435532+0000","last_became_peered":"2023-07-21T22:35:40.435532+0000","last_unstale":"2023-07-21T22:35:40.440853+0000","last_undegraded":"2023-07-21T22:35:40.440853+0000","last_fullsized":"2023-07-21T22:35:40.440853+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:03.193160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.427422+0000","last_change":"2023-07-21T22:35:40.427422+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.427422+0000","last_undegraded":"2023-07-21T22:35:40.427422+0000","last_fullsized":"2023-07-21T22:35:40.427422+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.439013+0000","last_change":"2023-07-21T22:35:40.436051+0000","last_active":"2023-07-21T22:35:40.439013+0000","last_peered":"2023-07-21T22:35:40.439013+0000","last_clean":"2023-07-21T22:35:40.439013+0000","last_became_active":"2023-07-21T22:35:40.435765+0000","last_became_peered":"2023-07-21T22:35:40.435765+0000","last_unstale":"2023-07-21T22:35:40.439013+0000","last_undegraded":"2023-07-21T22:35:40.439013+0000","last_fullsized":"2023-07-21T22:35:40.439013+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:59:48.963572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.429872+0000","last_change":"2023-07-21T22:35:40.429872+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.429872+0000","last_undegraded":"2023-07-21T22:35:40.429872+0000","last_fullsized":"2023-07-21T22:35:40.429872+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440447+0000","last_change":"2023-07-21T22:35:40.439003+0000","last_active":"2023-07-21T22:35:40.440447+0000","last_peered":"2023-07-21T22:35:40.440447+0000","last_clean":"2023-07-21T22:35:40.440447+0000","last_became_active":"2023-07-21T22:35:40.438479+0000","last_became_peered":"2023-07-21T22:35:40.438479+0000","last_unstale":"2023-07-21T22:35:40.440447+0000","last_undegraded":"2023-07-21T22:35:40.440447+0000","last_fullsized":"2023-07-21T22:35:40.440447+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:02:26.383277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.420230+0000","last_change":"2023-07-21T22:35:40.420230+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.420230+0000","last_undegraded":"2023-07-21T22:35:40.420230+0000","last_fullsized":"2023-07-21T22:35:40.420230+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.443552+0000","last_change":"2023-07-21T22:35:40.440675+0000","last_active":"2023-07-21T22:35:40.443552+0000","last_peered":"2023-07-21T22:35:40.443552+0000","last_clean":"2023-07-21T22:35:40.443552+0000","last_became_active":"2023-07-21T22:35:40.440191+0000","last_became_peered":"2023-07-21T22:35:40.440191+0000","last_unstale":"2023-07-21T22:35:40.443552+0000","last_undegraded":"2023-07-21T22:35:40.443552+0000","last_fullsized":"2023-07-21T22:35:40.443552+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:52:58.701458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.418423+0000","last_change":"2023-07-21T22:35:40.418423+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.418423+0000","last_undegraded":"2023-07-21T22:35:40.418423+0000","last_fullsized":"2023-07-21T22:35:40.418423+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440153+0000","last_change":"2023-07-21T22:35:40.438483+0000","last_active":"2023-07-21T22:35:40.440153+0000","last_peered":"2023-07-21T22:35:40.440153+0000","last_clean":"2023-07-21T22:35:40.440153+0000","last_became_active":"2023-07-21T22:35:40.438212+0000","last_became_peered":"2023-07-21T22:35:40.438212+0000","last_unstale":"2023-07-21T22:35:40.440153+0000","last_undegraded":"2023-07-21T22:35:40.440153+0000","last_fullsized":"2023-07-21T22:35:40.440153+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:44:33.640689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.421211+0000","last_change":"2023-07-21T22:35:40.421211+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.421211+0000","last_undegraded":"2023-07-21T22:35:40.421211+0000","last_fullsized":"2023-07-21T22:35:40.421211+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.434865+0000","last_change":"2023-07-21T22:35:40.431308+0000","last_active":"2023-07-21T22:35:40.434865+0000","last_peered":"2023-07-21T22:35:40.434865+0000","last_clean":"2023-07-21T22:35:40.434865+0000","last_became_active":"2023-07-21T22:35:40.430971+0000","last_became_peered":"2023-07-21T22:35:40.430971+0000","last_unstale":"2023-07-21T22:35:40.434865+0000","last_undegraded":"2023-07-21T22:35:40.434865+0000","last_fullsized":"2023-07-21T22:35:40.434865+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:03:53.221395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.423889+0000","last_change":"2023-07-21T22:35:40.423889+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.423889+0000","last_undegraded":"2023-07-21T22:35:40.423889+0000","last_fullsized":"2023-07-21T22:35:40.423889+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.441877+0000","last_change":"2023-07-21T22:35:40.440037+0000","last_active":"2023-07-21T22:35:40.441877+0000","last_peered":"2023-07-21T22:35:40.441877+0000","last_clean":"2023-07-21T22:35:40.441877+0000","last_became_active":"2023-07-21T22:35:40.439762+0000","last_became_peered":"2023-07-21T22:35:40.439762+0000","last_unstale":"2023-07-21T22:35:40.441877+0000","last_undegraded":"2023-07-21T22:35:40.441877+0000","last_fullsized":"2023-07-21T22:35:40.441877+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:23:19.242316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.430522+0000","last_change":"2023-07-21T22:35:40.430522+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.430522+0000","last_undegraded":"2023-07-21T22:35:40.430522+0000","last_fullsized":"2023-07-21T22:35:40.430522+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.436063+0000","last_change":"2023-07-21T22:35:40.434129+0000","last_active":"2023-07-21T22:35:40.436063+0000","last_peered":"2023-07-21T22:35:40.436063+0000","last_clean":"2023-07-21T22:35:40.436063+0000","last_became_active":"2023-07-21T22:35:40.433862+0000","last_became_peered":"2023-07-21T22:35:40.433862+0000","last_unstale":"2023-07-21T22:35:40.436063+0000","last_undegraded":"2023-07-21T22:35:40.436063+0000","last_fullsized":"2023-07-21T22:35:40.436063+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:28:03.521963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.427652+0000","last_change":"2023-07-21T22:35:40.427652+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.427652+0000","last_undegraded":"2023-07-21T22:35:40.427652+0000","last_fullsized":"2023-07-21T22:35:40.427652+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.438468+0000","last_change":"2023-07-21T22:35:40.433064+0000","last_active":"2023-07-21T22:35:40.438468+0000","last_peered":"2023-07-21T22:35:40.438468+0000","last_clean":"2023-07-21T22:35:40.438468+0000","last_became_active":"2023-07-21T22:35:40.432727+0000","last_became_peered":"2023-07-21T22:35:40.432727+0000","last_unstale":"2023-07-21T22:35:40.438468+0000","last_undegraded":"2023-07-21T22:35:40.438468+0000","last_fullsized":"2023-07-21T22:35:40.438468+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:21:03.267520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"100'205","reported_seq":643,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.426835+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:35:40.426835+0000","last_peered":"2023-07-21T22:35:40.426835+0000","last_clean":"2023-07-21T22:35:40.426835+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:35:40.426835+0000","last_undegraded":"2023-07-21T22:35:40.426835+0000","last_fullsized":"2023-07-21T22:35:40.426835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:36:01.986411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.422451+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:35:40.422451+0000","last_peered":"2023-07-21T22:35:40.422451+0000","last_clean":"2023-07-21T22:35:40.422451+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:35:40.422451+0000","last_undegraded":"2023-07-21T22:35:40.422451+0000","last_fullsized":"2023-07-21T22:35:40.422451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:18:31.491085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424857+0000","last_change":"2023-07-21T22:35:40.424857+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424857+0000","last_undegraded":"2023-07-21T22:35:40.424857+0000","last_fullsized":"2023-07-21T22:35:40.424857+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.435040+0000","last_change":"2023-07-21T22:35:40.433828+0000","last_active":"2023-07-21T22:35:40.435040+0000","last_peered":"2023-07-21T22:35:40.435040+0000","last_clean":"2023-07-21T22:35:40.435040+0000","last_became_active":"2023-07-21T22:35:40.433537+0000","last_became_peered":"2023-07-21T22:35:40.433537+0000","last_unstale":"2023-07-21T22:35:40.435040+0000","last_undegraded":"2023-07-21T22:35:40.435040+0000","last_fullsized":"2023-07-21T22:35:40.435040+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:28:40.271547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.426718+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:35:40.426718+0000","last_peered":"2023-07-21T22:35:40.426718+0000","last_clean":"2023-07-21T22:35:40.426718+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:35:40.426718+0000","last_undegraded":"2023-07-21T22:35:40.426718+0000","last_fullsized":"2023-07-21T22:35:40.426718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:45.947440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.423880+0000","last_change":"2023-07-21T22:35:40.423880+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.423880+0000","last_undegraded":"2023-07-21T22:35:40.423880+0000","last_fullsized":"2023-07-21T22:35:40.423880+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440208+0000","last_change":"2023-07-21T22:35:40.435800+0000","last_active":"2023-07-21T22:35:40.440208+0000","last_peered":"2023-07-21T22:35:40.440208+0000","last_clean":"2023-07-21T22:35:40.440208+0000","last_became_active":"2023-07-21T22:35:40.435483+0000","last_became_peered":"2023-07-21T22:35:40.435483+0000","last_unstale":"2023-07-21T22:35:40.440208+0000","last_undegraded":"2023-07-21T22:35:40.440208+0000","last_fullsized":"2023-07-21T22:35:40.440208+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:03:30.720838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":171,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.413259+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:35:40.413259+0000","last_peered":"2023-07-21T22:35:40.413259+0000","last_clean":"2023-07-21T22:35:40.413259+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:35:40.413259+0000","last_undegraded":"2023-07-21T22:35:40.413259+0000","last_fullsized":"2023-07-21T22:35:40.413259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:02:00.190778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.430023+0000","last_change":"2023-07-21T22:35:40.430023+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.430023+0000","last_undegraded":"2023-07-21T22:35:40.430023+0000","last_fullsized":"2023-07-21T22:35:40.430023+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440425+0000","last_change":"2023-07-21T22:35:40.438789+0000","last_active":"2023-07-21T22:35:40.440425+0000","last_peered":"2023-07-21T22:35:40.440425+0000","last_clean":"2023-07-21T22:35:40.440425+0000","last_became_active":"2023-07-21T22:35:40.438114+0000","last_became_peered":"2023-07-21T22:35:40.438114+0000","last_unstale":"2023-07-21T22:35:40.440425+0000","last_undegraded":"2023-07-21T22:35:40.440425+0000","last_fullsized":"2023-07-21T22:35:40.440425+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:04:22.853070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":189,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.421978+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:35:40.421978+0000","last_peered":"2023-07-21T22:35:40.421978+0000","last_clean":"2023-07-21T22:35:40.421978+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:35:40.421978+0000","last_undegraded":"2023-07-21T22:35:40.421978+0000","last_fullsized":"2023-07-21T22:35:40.421978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:21:07.585851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.424669+0000","last_change":"2023-07-21T22:35:40.424669+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.424669+0000","last_undegraded":"2023-07-21T22:35:40.424669+0000","last_fullsized":"2023-07-21T22:35:40.424669+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.434924+0000","last_change":"2023-07-21T22:35:40.431423+0000","last_active":"2023-07-21T22:35:40.434924+0000","last_peered":"2023-07-21T22:35:40.434924+0000","last_clean":"2023-07-21T22:35:40.434924+0000","last_became_active":"2023-07-21T22:35:40.431123+0000","last_became_peered":"2023-07-21T22:35:40.431123+0000","last_unstale":"2023-07-21T22:35:40.434924+0000","last_undegraded":"2023-07-21T22:35:40.434924+0000","last_fullsized":"2023-07-21T22:35:40.434924+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:21:17.845810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.422041+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:35:40.422041+0000","last_peered":"2023-07-21T22:35:40.422041+0000","last_clean":"2023-07-21T22:35:40.422041+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:35:40.422041+0000","last_undegraded":"2023-07-21T22:35:40.422041+0000","last_fullsized":"2023-07-21T22:35:40.422041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:08:46.780739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.419952+0000","last_change":"2023-07-21T22:35:40.419952+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.419952+0000","last_undegraded":"2023-07-21T22:35:40.419952+0000","last_fullsized":"2023-07-21T22:35:40.419952+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.435195+0000","last_change":"2023-07-21T22:35:40.429195+0000","last_active":"2023-07-21T22:35:40.435195+0000","last_peered":"2023-07-21T22:35:40.435195+0000","last_clean":"2023-07-21T22:35:40.435195+0000","last_became_active":"2023-07-21T22:35:40.428906+0000","last_became_peered":"2023-07-21T22:35:40.428906+0000","last_unstale":"2023-07-21T22:35:40.435195+0000","last_undegraded":"2023-07-21T22:35:40.435195+0000","last_fullsized":"2023-07-21T22:35:40.435195+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:01:44.549024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":175,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.428271+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:35:40.428271+0000","last_peered":"2023-07-21T22:35:40.428271+0000","last_clean":"2023-07-21T22:35:40.428271+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:35:40.428271+0000","last_undegraded":"2023-07-21T22:35:40.428271+0000","last_fullsized":"2023-07-21T22:35:40.428271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:46:48.050930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.419934+0000","last_change":"2023-07-21T22:35:40.419934+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.419934+0000","last_undegraded":"2023-07-21T22:35:40.419934+0000","last_fullsized":"2023-07-21T22:35:40.419934+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.440734+0000","last_change":"2023-07-21T22:35:40.436820+0000","last_active":"2023-07-21T22:35:40.440734+0000","last_peered":"2023-07-21T22:35:40.440734+0000","last_clean":"2023-07-21T22:35:40.440734+0000","last_became_active":"2023-07-21T22:35:40.436510+0000","last_became_peered":"2023-07-21T22:35:40.436510+0000","last_unstale":"2023-07-21T22:35:40.440734+0000","last_undegraded":"2023-07-21T22:35:40.440734+0000","last_fullsized":"2023-07-21T22:35:40.440734+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:15.357847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":180,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.419587+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:35:40.419587+0000","last_peered":"2023-07-21T22:35:40.419587+0000","last_clean":"2023-07-21T22:35:40.419587+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:35:40.419587+0000","last_undegraded":"2023-07-21T22:35:40.419587+0000","last_fullsized":"2023-07-21T22:35:40.419587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:31:49.740583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":110,"state":"creating+peering","last_fresh":"2023-07-21T22:35:40.431032+0000","last_change":"2023-07-21T22:35:40.431032+0000","last_active":"2023-07-21T22:35:40.404500+0000","last_peered":"2023-07-21T22:35:40.404500+0000","last_clean":"2023-07-21T22:35:40.404500+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:35:40.431032+0000","last_undegraded":"2023-07-21T22:35:40.431032+0000","last_fullsized":"2023-07-21T22:35:40.431032+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.434986+0000","last_change":"2023-07-21T22:35:40.423934+0000","last_active":"2023-07-21T22:35:40.434986+0000","last_peered":"2023-07-21T22:35:40.434986+0000","last_clean":"2023-07-21T22:35:40.434986+0000","last_became_active":"2023-07-21T22:35:40.423649+0000","last_became_peered":"2023-07-21T22:35:40.423649+0000","last_unstale":"2023-07-21T22:35:40.434986+0000","last_undegraded":"2023-07-21T22:35:40.434986+0000","last_fullsized":"2023-07-21T22:35:40.434986+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:22:52.903323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":168,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-07-21T22:35:40.426526+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:35:40.426526+0000","last_peered":"2023-07-21T22:35:40.426526+0000","last_clean":"2023-07-21T22:35:40.426526+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:35:40.426526+0000","last_undegraded":"2023-07-21T22:35:40.426526+0000","last_fullsized":"2023-07-21T22:35:40.426526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:48:53.359151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509645,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59180,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312660,"statfs":{"total":96636764160,"available":96576163840,"internally_reserved":0,"allocated":1937408,"data_stored":1260933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73299999999999998,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.35299999999999998,"15min":0.32600000000000001},"max":{"1min":1.1180000000000001,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.36099999999999999},"max":{"1min":0.90900000000000003,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.432,"15min":0.379},"max":{"1min":1.0509999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.85199999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72399999999999998,"15min":0.74299999999999999},"min":{"1min":0.51300000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.405},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72899999999999998,"15min":0.752},"min":{"1min":0.47999999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95699999999999996,"5min":1.409,"15min":1.409},"last":0.64500000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.504,"15min":0.42099999999999999},"max":{"1min":1.1539999999999999,"5min":1.46,"15min":1.46},"last":0.75},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.02,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.88}]},{"osd":4,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55400000000000005,"15min":0.55900000000000005},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.89900000000000002,"5min":0.90500000000000003,"15min":0.94999999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90400000000000003,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.83099999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64500000000000002,"15min":0.61799999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.56499999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.052,"5min":1.506,"15min":1.506},"last":0.91900000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.048},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.434,"15min":0.42599999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.72699999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542351,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1343488,"data_stored":670565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.73599999999999999,"15min":0.76100000000000001},"min":{"1min":0.495,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.97599999999999998,"5min":1.016,"15min":1.016},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77700000000000002,"15min":0.79300000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.437},"max":{"1min":0.94699999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.56100000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.41999999999999998},"max":{"1min":0.90500000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.94599999999999995,"5min":0.99399999999999999,"15min":1.117},"last":0.60499999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.72999999999999998,"15min":0.75},"min":{"1min":0.499,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.96299999999999997,"5min":0.98099999999999998,"15min":1.0269999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.0149999999999999,"5min":1.097,"15min":1.097},"last":0.621}]},{"osd":3,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.76100000000000001},"min":{"1min":0.57899999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92800000000000005,"5min":1.048,"15min":1.048},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72499999999999998,"15min":0.74099999999999999},"min":{"1min":0.505,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88600000000000001,"5min":1.0049999999999999,"15min":1.054},"last":0.495}]},{"osd":4,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60299999999999998,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.374,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.441,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.048},"last":0.42999999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89600000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.91900000000000004,"5min":0.98799999999999999,"15min":1.054},"last":0.46800000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68500000000000005,"15min":0.67700000000000005},"min":{"1min":0.498,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":0.95699999999999996,"5min":1.079,"15min":1.079},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.70099999999999996,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96499999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.64800000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509644,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1343488,"data_stored":670565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.70699999999999996,"15min":0.71299999999999997},"min":{"1min":0.436,"5min":0.35699999999999998,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.70799999999999996,"15min":0.72199999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83999999999999997,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.75800000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66800000000000004,"15min":0.71099999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90600000000000003,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.71099999999999997,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77900000000000003,"5min":1.617,"15min":1.617},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.70999999999999996,"15min":0.73499999999999999},"min":{"1min":0.45100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.99399999999999999,"5min":1.0109999999999999,"15min":1.034},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.71399999999999997,"15min":0.747},"min":{"1min":0.498,"5min":0.377,"15min":0.377},"max":{"1min":0.86399999999999999,"5min":1.512,"15min":1.512},"last":0.84299999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.76100000000000001,"15min":0.78500000000000003},"min":{"1min":0.56299999999999994,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86199999999999999,"5min":1.472,"15min":1.472},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.59999999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.90800000000000003,"5min":1.556,"15min":1.556},"last":0.67700000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88900000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89200000000000002,"5min":1.012,"15min":1.038},"last":0.89800000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95499999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.622,"15min":0.60999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93799999999999994,"5min":1.02,"15min":1.02},"last":0.70699999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66100000000000003,"15min":0.65000000000000002},"min":{"1min":0.42399999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.91900000000000004,"5min":1.042,"15min":1.042},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.57899999999999996,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.88300000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509645,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1312,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1343488,"data_stored":670565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71999999999999997,"15min":0.74299999999999999},"min":{"1min":0.51200000000000001,"5min":0.438,"15min":0.40000000000000002},"max":{"1min":0.80900000000000005,"5min":0.99399999999999999,"15min":1.0429999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73299999999999998,"15min":0.74299999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.83599999999999997,"5min":0.96099999999999997,"15min":0.97599999999999998},"last":0.76600000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.39400000000000002},"max":{"1min":0.85499999999999998,"5min":1.002,"15min":1.0449999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.69399999999999995,"15min":0.69999999999999996},"min":{"1min":0.47299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.872,"5min":0.94299999999999995,"15min":1.016},"last":0.72899999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.51200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.95899999999999996,"5min":1.048,"15min":1.048},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.53000000000000003,"5min":0.41999999999999998,"15min":0.33000000000000002},"max":{"1min":1.006,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.85299999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72899999999999998,"15min":0.73699999999999999},"min":{"1min":0.51000000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94099999999999995,"5min":0.97999999999999998,"15min":1.026},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58399999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.78100000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.45100000000000001,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98899999999999999},"last":0.436}]},{"osd":6,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.38500000000000001},"max":{"1min":0.94699999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.57099999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.79400000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64400000000000002,"15min":0.65100000000000002},"min":{"1min":0.45500000000000002,"5min":0.39900000000000002,"15min":0.374},"max":{"1min":0.92100000000000004,"5min":1.0069999999999999,"15min":1.0429999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.135},"last":0.62}]}]},{"osd":3,"up_from":15,"seq":64424509644,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1331200,"data_stored":663893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.28599999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.55500000000000005,"5min":0.73099999999999998,"15min":0.76400000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.66300000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.371}]},{"osd":1,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.46899999999999997,"15min":0.47899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71799999999999997,"5min":0.754,"15min":0.83499999999999996},"last":0.312},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.54600000000000004,"15min":0.55500000000000005},"min":{"1min":0.30199999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.82599999999999996,"15min":0.90100000000000002},"last":0.29199999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54800000000000004,"15min":0.56000000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.997,"5min":0.997,"15min":1.1140000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.59099999999999997,"15min":0.59999999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69499999999999995,"5min":0.91800000000000004,"15min":0.99199999999999999},"last":0.39600000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0569999999999999,"5min":1.093,"15min":1.159},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.80200000000000005,"15min":0.82699999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0429999999999999,"5min":1.1459999999999999,"15min":1.3620000000000001},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.749,"15min":0.77600000000000002},"min":{"1min":0.501,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0029999999999999,"5min":1.0740000000000001,"15min":1.137},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.51300000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98199999999999998,"5min":1.048,"15min":1.2789999999999999},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.77400000000000002,"15min":0.79500000000000004},"min":{"1min":0.55700000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0289999999999999,"5min":1.056,"15min":1.3979999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.77500000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97099999999999997,"5min":1.1120000000000001,"15min":1.2450000000000001},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.79400000000000004,"15min":0.82499999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.024,"5min":1.087,"15min":1.335},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.81399999999999995,"15min":0.82999999999999996},"min":{"1min":0.57699999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.081,"5min":1.113,"15min":1.2130000000000001},"last":0.81399999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509646,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54492,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317348,"statfs":{"total":96636764160,"available":96580964352,"internally_reserved":0,"allocated":1331200,"data_stored":663893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45200000000000001,"15min":0.47099999999999997},"min":{"1min":0.27700000000000002,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.75,"5min":0.81200000000000006,"15min":0.94199999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.52400000000000002,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.84799999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.48799999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86699999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55800000000000005,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.012,"5min":1.085,"15min":1.085},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46999999999999997,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.30099999999999999,"15min":0.29699999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55000000000000004,"15min":0.56899999999999995},"min":{"1min":0.39300000000000002,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.77900000000000003,"15min":0.79600000000000004},"min":{"1min":0.49099999999999999,"5min":0.439,"15min":0.376},"max":{"1min":0.93500000000000005,"5min":1.2569999999999999,"15min":1.3420000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79200000000000004,"15min":0.80100000000000005},"min":{"1min":0.56000000000000005,"5min":0.501,"15min":0.432},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.58599999999999997,"5min":0.55800000000000005,"15min":0.496},"max":{"1min":0.93200000000000005,"5min":1.0600000000000001,"15min":1.1879999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80000000000000004,"15min":0.81100000000000005},"min":{"1min":0.54400000000000004,"5min":0.47299999999999998,"15min":0.46400000000000002},"max":{"1min":0.97599999999999998,"5min":1.171,"15min":1.3089999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.502,"5min":0.45500000000000002,"15min":0.40300000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.79700000000000004,"15min":0.81200000000000006},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.45600000000000002},"max":{"1min":0.88400000000000001,"5min":1.23,"15min":1.2649999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79900000000000004,"15min":0.82399999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.49099999999999999},"max":{"1min":0.90000000000000002,"5min":1.2,"15min":1.2909999999999999},"last":0.755},{"interface":"front","average":{"1min":0.75,"5min":0.79900000000000004,"15min":0.81599999999999995},"min":{"1min":0.57599999999999996,"5min":0.5,"15min":0.44700000000000001},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.65000000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509645,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1331200,"data_stored":663893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.28299999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53500000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.626,"5min":0.872,"15min":0.872},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.5,"15min":0.50700000000000001},"min":{"1min":0.33700000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63200000000000001,"5min":0.76100000000000001,"15min":0.81000000000000005},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.29099999999999998},"max":{"1min":0.78900000000000003,"5min":0.83599999999999997,"15min":0.88800000000000001},"last":0.42699999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.57599999999999996,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35799999999999998,"15min":0.33400000000000002},"max":{"1min":0.70799999999999996,"5min":0.84299999999999997,"15min":0.98899999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.505,"15min":0.51700000000000002},"min":{"1min":0.33100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.64200000000000002,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.748,"15min":0.77000000000000002},"min":{"1min":0.53100000000000003,"5min":0.432,"15min":0.432},"max":{"1min":0.91400000000000003,"5min":1.0860000000000001,"15min":1.234},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.57499999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.014,"5min":1.083,"15min":1.155},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75600000000000001,"15min":0.77800000000000002},"min":{"1min":0.53500000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92500000000000004,"5min":1.0609999999999999,"15min":1.1919999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78500000000000003,"15min":0.80000000000000004},"min":{"1min":0.55200000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.044,"5min":1.121,"15min":1.2849999999999999},"last":0.56899999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78600000000000003,"15min":0.81000000000000005},"min":{"1min":0.57199999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0229999999999999,"5min":1.0580000000000001,"15min":1.23},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76300000000000001,"15min":0.79000000000000004},"min":{"1min":0.50900000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0449999999999999,"5min":1.1020000000000001,"15min":1.3240000000000001},"last":0.61399999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78600000000000003,"15min":0.80900000000000005},"min":{"1min":0.58599999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.99299999999999999,"5min":1.103,"15min":1.3149999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79000000000000004,"15min":0.80800000000000005},"min":{"1min":0.55500000000000005,"5min":0.52600000000000002,"15min":0.45700000000000002},"max":{"1min":0.97499999999999998,"5min":1.115,"15min":1.3380000000000001},"last":0.64900000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509647,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37036,"kb_used_data":1892,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334804,"statfs":{"total":96636764160,"available":96598839296,"internally_reserved":0,"allocated":1937408,"data_stored":1260933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.47399999999999998,"15min":0.47099999999999997},"min":{"1min":0.28399999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.64700000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.499,"15min":0.51300000000000001},"min":{"1min":0.374,"5min":0.247,"15min":0.247},"max":{"1min":0.63100000000000001,"5min":0.76200000000000001,"15min":0.79400000000000004},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71499999999999997,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51200000000000001,"15min":0.51700000000000002},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67000000000000004,"5min":0.871,"15min":0.871},"last":0.437}]},{"osd":3,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70899999999999996,"5min":0.84499999999999997,"15min":0.91300000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67700000000000005,"5min":1.038,"15min":1.038},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.754,"15min":0.77800000000000002},"min":{"1min":0.58099999999999996,"5min":0.46200000000000002,"15min":0.45200000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.321},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.78400000000000003,"15min":0.79800000000000004},"min":{"1min":0.55600000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.423},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76300000000000001,"15min":0.78100000000000003},"min":{"1min":0.55600000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.036,"5min":1.107,"15min":1.28},"last":0.627},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77600000000000002,"15min":0.80700000000000005},"min":{"1min":0.57699999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.24,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.67800000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76800000000000002,"15min":0.81200000000000006},"min":{"1min":0.53800000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.81699999999999995},"min":{"1min":0.60699999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0169999999999999,"5min":1.147,"15min":1.333},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78600000000000003,"15min":0.79800000000000004},"min":{"1min":0.54300000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.042,"5min":1.159,"15min":1.2310000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.79100000000000004,"15min":0.82899999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0609999999999999,"5min":1.1930000000000001,"15min":1.369},"last":0.70699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:35:46.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3f is not active+clean 2023-07-21T22:35:46.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.423025+0000', 'last_change': '2023-07-21T22:35:40.423025+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.423025+0000', 'last_undegraded': '2023-07-21T22:35:40.423025+0000', 'last_fullsized': '2023-07-21T22:35:40.423025+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:35:46.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3e is not active+clean 2023-07-21T22:35:46.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.420047+0000', 'last_change': '2023-07-21T22:35:40.420047+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.420047+0000', 'last_undegraded': '2023-07-21T22:35:40.420047+0000', 'last_fullsized': '2023-07-21T22:35:40.420047+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:35:46.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3d is not active+clean 2023-07-21T22:35:46.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.421225+0000', 'last_change': '2023-07-21T22:35:40.421225+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.421225+0000', 'last_undegraded': '2023-07-21T22:35:40.421225+0000', 'last_fullsized': '2023-07-21T22:35:40.421225+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:35:46.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3c is not active+clean 2023-07-21T22:35:46.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.421779+0000', 'last_change': '2023-07-21T22:35:40.421779+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.421779+0000', 'last_undegraded': '2023-07-21T22:35:40.421779+0000', 'last_fullsized': '2023-07-21T22:35:40.421779+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:35:46.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3b is not active+clean 2023-07-21T22:35:46.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.429598+0000', 'last_change': '2023-07-21T22:35:40.429598+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.429598+0000', 'last_undegraded': '2023-07-21T22:35:40.429598+0000', 'last_fullsized': '2023-07-21T22:35:40.429598+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:35:46.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3a is not active+clean 2023-07-21T22:35:46.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.430526+0000', 'last_change': '2023-07-21T22:35:40.430526+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.430526+0000', 'last_undegraded': '2023-07-21T22:35:40.430526+0000', 'last_fullsized': '2023-07-21T22:35:40.430526+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:46.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.39 is not active+clean 2023-07-21T22:35:46.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.424526+0000', 'last_change': '2023-07-21T22:35:40.424526+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.424526+0000', 'last_undegraded': '2023-07-21T22:35:40.424526+0000', 'last_fullsized': '2023-07-21T22:35:40.424526+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:35:46.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.38 is not active+clean 2023-07-21T22:35:46.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.420838+0000', 'last_change': '2023-07-21T22:35:40.420838+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.420838+0000', 'last_undegraded': '2023-07-21T22:35:40.420838+0000', 'last_fullsized': '2023-07-21T22:35:40.420838+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:35:46.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.37 is not active+clean 2023-07-21T22:35:46.782 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.424353+0000', 'last_change': '2023-07-21T22:35:40.424353+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.424353+0000', 'last_undegraded': '2023-07-21T22:35:40.424353+0000', 'last_fullsized': '2023-07-21T22:35:40.424353+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:35:46.782 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.36 is not active+clean 2023-07-21T22:35:46.782 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.418763+0000', 'last_change': '2023-07-21T22:35:40.418763+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.418763+0000', 'last_undegraded': '2023-07-21T22:35:40.418763+0000', 'last_fullsized': '2023-07-21T22:35:40.418763+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:35:46.783 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.35 is not active+clean 2023-07-21T22:35:46.783 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.430089+0000', 'last_change': '2023-07-21T22:35:40.430089+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.430089+0000', 'last_undegraded': '2023-07-21T22:35:40.430089+0000', 'last_fullsized': '2023-07-21T22:35:40.430089+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:35:46.783 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.34 is not active+clean 2023-07-21T22:35:46.784 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.418675+0000', 'last_change': '2023-07-21T22:35:40.418675+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.418675+0000', 'last_undegraded': '2023-07-21T22:35:40.418675+0000', 'last_fullsized': '2023-07-21T22:35:40.418675+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:35:46.784 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.33 is not active+clean 2023-07-21T22:35:46.784 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.420385+0000', 'last_change': '2023-07-21T22:35:40.420385+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.420385+0000', 'last_undegraded': '2023-07-21T22:35:40.420385+0000', 'last_fullsized': '2023-07-21T22:35:40.420385+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:35:46.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.32 is not active+clean 2023-07-21T22:35:46.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.429283+0000', 'last_change': '2023-07-21T22:35:40.429283+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.429283+0000', 'last_undegraded': '2023-07-21T22:35:40.429283+0000', 'last_fullsized': '2023-07-21T22:35:40.429283+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:35:46.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.31 is not active+clean 2023-07-21T22:35:46.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.422505+0000', 'last_change': '2023-07-21T22:35:40.422505+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.422505+0000', 'last_undegraded': '2023-07-21T22:35:40.422505+0000', 'last_fullsized': '2023-07-21T22:35:40.422505+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:35:46.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.30 is not active+clean 2023-07-21T22:35:46.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.427423+0000', 'last_change': '2023-07-21T22:35:40.427423+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.427423+0000', 'last_undegraded': '2023-07-21T22:35:40.427423+0000', 'last_fullsized': '2023-07-21T22:35:40.427423+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:46.787 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2f is not active+clean 2023-07-21T22:35:46.787 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.428251+0000', 'last_change': '2023-07-21T22:35:40.428251+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.428251+0000', 'last_undegraded': '2023-07-21T22:35:40.428251+0000', 'last_fullsized': '2023-07-21T22:35:40.428251+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:46.787 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2e is not active+clean 2023-07-21T22:35:46.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.425699+0000', 'last_change': '2023-07-21T22:35:40.425699+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.425699+0000', 'last_undegraded': '2023-07-21T22:35:40.425699+0000', 'last_fullsized': '2023-07-21T22:35:40.425699+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:35:46.788 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2d is not active+clean 2023-07-21T22:35:46.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.424851+0000', 'last_change': '2023-07-21T22:35:40.424851+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.424851+0000', 'last_undegraded': '2023-07-21T22:35:40.424851+0000', 'last_fullsized': '2023-07-21T22:35:40.424851+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:35:46.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2c is not active+clean 2023-07-21T22:35:46.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.421317+0000', 'last_change': '2023-07-21T22:35:40.421317+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.421317+0000', 'last_undegraded': '2023-07-21T22:35:40.421317+0000', 'last_fullsized': '2023-07-21T22:35:40.421317+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:35:46.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2b is not active+clean 2023-07-21T22:35:46.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.425277+0000', 'last_change': '2023-07-21T22:35:40.425277+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.425277+0000', 'last_undegraded': '2023-07-21T22:35:40.425277+0000', 'last_fullsized': '2023-07-21T22:35:40.425277+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:35:46.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2a is not active+clean 2023-07-21T22:35:46.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.428797+0000', 'last_change': '2023-07-21T22:35:40.428797+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.428797+0000', 'last_undegraded': '2023-07-21T22:35:40.428797+0000', 'last_fullsized': '2023-07-21T22:35:40.428797+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:35:46.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.29 is not active+clean 2023-07-21T22:35:46.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.424752+0000', 'last_change': '2023-07-21T22:35:40.424752+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.424752+0000', 'last_undegraded': '2023-07-21T22:35:40.424752+0000', 'last_fullsized': '2023-07-21T22:35:40.424752+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:35:46.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.28 is not active+clean 2023-07-21T22:35:46.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.420692+0000', 'last_change': '2023-07-21T22:35:40.420692+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.420692+0000', 'last_undegraded': '2023-07-21T22:35:40.420692+0000', 'last_fullsized': '2023-07-21T22:35:40.420692+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:35:46.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.27 is not active+clean 2023-07-21T22:35:46.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.420732+0000', 'last_change': '2023-07-21T22:35:40.420732+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.420732+0000', 'last_undegraded': '2023-07-21T22:35:40.420732+0000', 'last_fullsized': '2023-07-21T22:35:40.420732+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:35:46.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.26 is not active+clean 2023-07-21T22:35:46.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.430470+0000', 'last_change': '2023-07-21T22:35:40.430470+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.430470+0000', 'last_undegraded': '2023-07-21T22:35:40.430470+0000', 'last_fullsized': '2023-07-21T22:35:40.430470+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:35:46.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.25 is not active+clean 2023-07-21T22:35:46.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.418305+0000', 'last_change': '2023-07-21T22:35:40.418305+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.418305+0000', 'last_undegraded': '2023-07-21T22:35:40.418305+0000', 'last_fullsized': '2023-07-21T22:35:40.418305+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:35:46.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.24 is not active+clean 2023-07-21T22:35:46.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.420896+0000', 'last_change': '2023-07-21T22:35:40.420896+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.420896+0000', 'last_undegraded': '2023-07-21T22:35:40.420896+0000', 'last_fullsized': '2023-07-21T22:35:40.420896+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:35:46.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.23 is not active+clean 2023-07-21T22:35:46.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.425095+0000', 'last_change': '2023-07-21T22:35:40.425095+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.425095+0000', 'last_undegraded': '2023-07-21T22:35:40.425095+0000', 'last_fullsized': '2023-07-21T22:35:40.425095+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:35:46.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.22 is not active+clean 2023-07-21T22:35:46.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.428282+0000', 'last_change': '2023-07-21T22:35:40.428282+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.428282+0000', 'last_undegraded': '2023-07-21T22:35:40.428282+0000', 'last_fullsized': '2023-07-21T22:35:40.428282+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:35:46.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.21 is not active+clean 2023-07-21T22:35:46.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.421437+0000', 'last_change': '2023-07-21T22:35:40.421437+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.421437+0000', 'last_undegraded': '2023-07-21T22:35:40.421437+0000', 'last_fullsized': '2023-07-21T22:35:40.421437+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:35:46.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.20 is not active+clean 2023-07-21T22:35:46.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.426901+0000', 'last_change': '2023-07-21T22:35:40.426901+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.426901+0000', 'last_undegraded': '2023-07-21T22:35:40.426901+0000', 'last_fullsized': '2023-07-21T22:35:40.426901+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:46.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1c is not active+clean 2023-07-21T22:35:46.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.429666+0000', 'last_change': '2023-07-21T22:35:40.429666+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.429666+0000', 'last_undegraded': '2023-07-21T22:35:40.429666+0000', 'last_fullsized': '2023-07-21T22:35:40.429666+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:46.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1d is not active+clean 2023-07-21T22:35:46.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.427873+0000', 'last_change': '2023-07-21T22:35:40.427873+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.427873+0000', 'last_undegraded': '2023-07-21T22:35:40.427873+0000', 'last_fullsized': '2023-07-21T22:35:40.427873+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:46.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2023-07-21T22:35:46.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.427840+0000', 'last_change': '2023-07-21T22:35:40.427840+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.427840+0000', 'last_undegraded': '2023-07-21T22:35:40.427840+0000', 'last_fullsized': '2023-07-21T22:35:40.427840+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:35:46.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2023-07-21T22:35:46.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.427792+0000', 'last_change': '2023-07-21T22:35:40.427792+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.427792+0000', 'last_undegraded': '2023-07-21T22:35:40.427792+0000', 'last_fullsized': '2023-07-21T22:35:40.427792+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:46.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2023-07-21T22:35:46.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.422116+0000', 'last_change': '2023-07-21T22:35:40.422116+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.422116+0000', 'last_undegraded': '2023-07-21T22:35:40.422116+0000', 'last_fullsized': '2023-07-21T22:35:40.422116+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:35:46.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2023-07-21T22:35:46.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.423601+0000', 'last_change': '2023-07-21T22:35:40.423601+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.423601+0000', 'last_undegraded': '2023-07-21T22:35:40.423601+0000', 'last_fullsized': '2023-07-21T22:35:40.423601+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:35:46.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1a is not active+clean 2023-07-21T22:35:46.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.428001+0000', 'last_change': '2023-07-21T22:35:40.428001+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.428001+0000', 'last_undegraded': '2023-07-21T22:35:40.428001+0000', 'last_fullsized': '2023-07-21T22:35:40.428001+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:46.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2023-07-21T22:35:46.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.419933+0000', 'last_change': '2023-07-21T22:35:40.419933+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.419933+0000', 'last_undegraded': '2023-07-21T22:35:40.419933+0000', 'last_fullsized': '2023-07-21T22:35:40.419933+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:35:46.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2023-07-21T22:35:46.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.423511+0000', 'last_change': '2023-07-21T22:35:40.423511+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.423511+0000', 'last_undegraded': '2023-07-21T22:35:40.423511+0000', 'last_fullsized': '2023-07-21T22:35:40.423511+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:35:46.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2023-07-21T22:35:46.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.425900+0000', 'last_change': '2023-07-21T22:35:40.425900+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.425900+0000', 'last_undegraded': '2023-07-21T22:35:40.425900+0000', 'last_fullsized': '2023-07-21T22:35:40.425900+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:35:46.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2023-07-21T22:35:46.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.420142+0000', 'last_change': '2023-07-21T22:35:40.420142+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.420142+0000', 'last_undegraded': '2023-07-21T22:35:40.420142+0000', 'last_fullsized': '2023-07-21T22:35:40.420142+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:35:46.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2023-07-21T22:35:46.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.419867+0000', 'last_change': '2023-07-21T22:35:40.419867+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.419867+0000', 'last_undegraded': '2023-07-21T22:35:40.419867+0000', 'last_fullsized': '2023-07-21T22:35:40.419867+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:35:46.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2023-07-21T22:35:46.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.421665+0000', 'last_change': '2023-07-21T22:35:40.421665+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.421665+0000', 'last_undegraded': '2023-07-21T22:35:40.421665+0000', 'last_fullsized': '2023-07-21T22:35:40.421665+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:35:46.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2023-07-21T22:35:46.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.423470+0000', 'last_change': '2023-07-21T22:35:40.423470+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.423470+0000', 'last_undegraded': '2023-07-21T22:35:40.423470+0000', 'last_fullsized': '2023-07-21T22:35:40.423470+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:35:46.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.12 is not active+clean 2023-07-21T22:35:46.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.418106+0000', 'last_change': '2023-07-21T22:35:40.418106+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.418106+0000', 'last_undegraded': '2023-07-21T22:35:40.418106+0000', 'last_fullsized': '2023-07-21T22:35:40.418106+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:35:46.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2023-07-21T22:35:46.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.418169+0000', 'last_change': '2023-07-21T22:35:40.418169+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.418169+0000', 'last_undegraded': '2023-07-21T22:35:40.418169+0000', 'last_fullsized': '2023-07-21T22:35:40.418169+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:35:46.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2023-07-21T22:35:46.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.424484+0000', 'last_change': '2023-07-21T22:35:40.424484+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.424484+0000', 'last_undegraded': '2023-07-21T22:35:40.424484+0000', 'last_fullsized': '2023-07-21T22:35:40.424484+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:35:46.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.5 is not active+clean 2023-07-21T22:35:46.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.427422+0000', 'last_change': '2023-07-21T22:35:40.427422+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.427422+0000', 'last_undegraded': '2023-07-21T22:35:40.427422+0000', 'last_fullsized': '2023-07-21T22:35:40.427422+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:46.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.6 is not active+clean 2023-07-21T22:35:46.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.429872+0000', 'last_change': '2023-07-21T22:35:40.429872+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.429872+0000', 'last_undegraded': '2023-07-21T22:35:40.429872+0000', 'last_fullsized': '2023-07-21T22:35:40.429872+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:46.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2023-07-21T22:35:46.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.420230+0000', 'last_change': '2023-07-21T22:35:40.420230+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.420230+0000', 'last_undegraded': '2023-07-21T22:35:40.420230+0000', 'last_fullsized': '2023-07-21T22:35:40.420230+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:35:46.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.0 is not active+clean 2023-07-21T22:35:46.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.418423+0000', 'last_change': '2023-07-21T22:35:40.418423+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.418423+0000', 'last_undegraded': '2023-07-21T22:35:40.418423+0000', 'last_fullsized': '2023-07-21T22:35:40.418423+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:35:46.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2023-07-21T22:35:46.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.421211+0000', 'last_change': '2023-07-21T22:35:40.421211+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.421211+0000', 'last_undegraded': '2023-07-21T22:35:40.421211+0000', 'last_fullsized': '2023-07-21T22:35:40.421211+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:35:46.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2023-07-21T22:35:46.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.423889+0000', 'last_change': '2023-07-21T22:35:40.423889+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.423889+0000', 'last_undegraded': '2023-07-21T22:35:40.423889+0000', 'last_fullsized': '2023-07-21T22:35:40.423889+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:35:46.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3 is not active+clean 2023-07-21T22:35:46.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.430522+0000', 'last_change': '2023-07-21T22:35:40.430522+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.430522+0000', 'last_undegraded': '2023-07-21T22:35:40.430522+0000', 'last_fullsized': '2023-07-21T22:35:40.430522+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:46.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2023-07-21T22:35:46.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.427652+0000', 'last_change': '2023-07-21T22:35:40.427652+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.427652+0000', 'last_undegraded': '2023-07-21T22:35:40.427652+0000', 'last_fullsized': '2023-07-21T22:35:40.427652+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:35:46.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.c is not active+clean 2023-07-21T22:35:46.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.424857+0000', 'last_change': '2023-07-21T22:35:40.424857+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.424857+0000', 'last_undegraded': '2023-07-21T22:35:40.424857+0000', 'last_fullsized': '2023-07-21T22:35:40.424857+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:46.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2023-07-21T22:35:46.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.423880+0000', 'last_change': '2023-07-21T22:35:40.423880+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.423880+0000', 'last_undegraded': '2023-07-21T22:35:40.423880+0000', 'last_fullsized': '2023-07-21T22:35:40.423880+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:35:46.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2023-07-21T22:35:46.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.430023+0000', 'last_change': '2023-07-21T22:35:40.430023+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.430023+0000', 'last_undegraded': '2023-07-21T22:35:40.430023+0000', 'last_fullsized': '2023-07-21T22:35:40.430023+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:35:46.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.8 is not active+clean 2023-07-21T22:35:46.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.424669+0000', 'last_change': '2023-07-21T22:35:40.424669+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.424669+0000', 'last_undegraded': '2023-07-21T22:35:40.424669+0000', 'last_fullsized': '2023-07-21T22:35:40.424669+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:46.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2023-07-21T22:35:46.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.419952+0000', 'last_change': '2023-07-21T22:35:40.419952+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.419952+0000', 'last_undegraded': '2023-07-21T22:35:40.419952+0000', 'last_fullsized': '2023-07-21T22:35:40.419952+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:35:46.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2023-07-21T22:35:46.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.419934+0000', 'last_change': '2023-07-21T22:35:40.419934+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.419934+0000', 'last_undegraded': '2023-07-21T22:35:40.419934+0000', 'last_fullsized': '2023-07-21T22:35:40.419934+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:35:46.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.b is not active+clean 2023-07-21T22:35:46.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 110, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:35:40.431032+0000', 'last_change': '2023-07-21T22:35:40.431032+0000', 'last_active': '2023-07-21T22:35:40.404500+0000', 'last_peered': '2023-07-21T22:35:40.404500+0000', 'last_clean': '2023-07-21T22:35:40.404500+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:35:40.431032+0000', 'last_undegraded': '2023-07-21T22:35:40.431032+0000', 'last_fullsized': '2023-07-21T22:35:40.431032+0000', 'mapping_epoch': 110, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 110, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'last_clean_scrub_stamp': '2023-07-21T22:35:40.404500+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:35:46.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-21T22:35:46.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.910+0000 7f66aaf40640 1 Processor -- start 2023-07-21T22:35:46.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.910+0000 7f66aaf40640 1 -- start start 2023-07-21T22:35:46.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.910+0000 7f66aaf40640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f66a40c9730 0x7f66a41638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.910+0000 7f66aaf40640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a40cc700 con 0x7f66a4158ce0 2023-07-21T22:35:46.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.910+0000 7f66aaf40640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a40b0ff0 con 0x7f66a40c8ad0 2023-07-21T22:35:46.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.910+0000 7f66aaf40640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66a4070c80 con 0x7f66a40c9730 2023-07-21T22:35:46.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.910+0000 7f66a8cdc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f66a4158ce0 0x7f66a4070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36970/0 (socket says 172.21.15.6:36970) 2023-07-21T22:35:46.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.910+0000 7f66a8cdc640 1 -- 172.21.15.6:0/1955254041 learned_addr learned my addr 172.21.15.6:0/1955254041 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:46.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.910+0000 7f66a94dd640 1 --2- 172.21.15.6:0/1955254041 >> v2:172.21.15.6:3300/0 conn(0x7f66a40c9730 0x7f66a41638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.910+0000 7f66a94dd640 1 -- 172.21.15.6:0/1955254041 >> v1:172.21.15.161:6789/0 conn(0x7f66a40c8ad0 legacy=0x7f66a40c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:46.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.910+0000 7f66a94dd640 1 -- 172.21.15.6:0/1955254041 >> v1:172.21.15.6:6789/0 conn(0x7f66a4158ce0 legacy=0x7f66a4070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.910+0000 7f66a94dd640 1 -- 172.21.15.6:0/1955254041 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a40cbdd0 con 0x7f66a40c9730 2023-07-21T22:35:46.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.910+0000 7f66a37fe640 1 -- 172.21.15.6:0/1955254041 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177578720 0 0) 0x7f66a40cc700 con 0x7f66a4158ce0 2023-07-21T22:35:46.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.914+0000 7f66a94dd640 1 --2- 172.21.15.6:0/1955254041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a40c9730 0x7f66a41638b0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f669c009d90 tx=0x7f669c01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2e3d0d429daa24 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:46.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.914+0000 7f66a37fe640 1 -- 172.21.15.6:0/1955254041 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c0a57d0 con 0x7f66a40c9730 2023-07-21T22:35:46.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.914+0000 7f66a37fe640 1 -- 172.21.15.6:0/1955254041 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669c0a5930 con 0x7f66a40c9730 2023-07-21T22:35:46.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.914+0000 7f66a37fe640 1 -- 172.21.15.6:0/1955254041 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c0a5cc0 con 0x7f66a40c9730 2023-07-21T22:35:46.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.914+0000 7f66aaf40640 1 -- 172.21.15.6:0/1955254041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a40c9730 msgr2=0x7f66a41638b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.914+0000 7f66aaf40640 1 --2- 172.21.15.6:0/1955254041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a40c9730 0x7f66a41638b0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f669c009d90 tx=0x7f669c01c800 comp rx=0 tx=0).stop 2023-07-21T22:35:46.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.914+0000 7f66aaf40640 1 -- 172.21.15.6:0/1955254041 shutdown_connections 2023-07-21T22:35:46.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.914+0000 7f66aaf40640 1 --2- 172.21.15.6:0/1955254041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a40c9730 0x7f66a41638b0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.914+0000 7f66aaf40640 1 -- 172.21.15.6:0/1955254041 >> 172.21.15.6:0/1955254041 conn(0x7f66a40afcf0 msgr2=0x7f66a40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:46.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.914+0000 7f66aaf40640 1 -- 172.21.15.6:0/1955254041 shutdown_connections 2023-07-21T22:35:46.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.914+0000 7f66aaf40640 1 -- 172.21.15.6:0/1955254041 wait complete. 2023-07-21T22:35:46.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.918+0000 7f66aaf40640 1 Processor -- start 2023-07-21T22:35:46.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.918+0000 7f66aaf40640 1 -- start start 2023-07-21T22:35:46.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.918+0000 7f66aaf40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66a40c8ad0 0x7f66a414d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.918+0000 7f66aaf40640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66a40c9730 0x7f66a40ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.918+0000 7f66aaf40640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a4158ce0 0x7f66a40cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.918+0000 7f66aaf40640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40adf40 con 0x7f66a4158ce0 2023-07-21T22:35:46.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.918+0000 7f66aaf40640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40ae220 con 0x7f66a40c9730 2023-07-21T22:35:46.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.918+0000 7f66aaf40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a40ae500 con 0x7f66a40c8ad0 2023-07-21T22:35:46.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.918+0000 7f66a94dd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a4158ce0 0x7f66a40cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.918+0000 7f66a94dd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a4158ce0 0x7f66a40cae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48592/0 (socket says 172.21.15.6:48592) 2023-07-21T22:35:46.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.918+0000 7f66a94dd640 1 -- 172.21.15.6:0/2912266458 learned_addr learned my addr 172.21.15.6:0/2912266458 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:46.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.918+0000 7f66a3fff640 1 --2- 172.21.15.6:0/2912266458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66a40c9730 0x7f66a40ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.918+0000 7f66a8cdc640 1 --2- 172.21.15.6:0/2912266458 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66a40c8ad0 0x7f66a414d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.918+0000 7f66a94dd640 1 -- 172.21.15.6:0/2912266458 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66a40c8ad0 msgr2=0x7f66a414d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.918+0000 7f66a94dd640 1 --2- 172.21.15.6:0/2912266458 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66a40c8ad0 0x7f66a414d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.918+0000 7f66a94dd640 1 -- 172.21.15.6:0/2912266458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66a40c9730 msgr2=0x7f66a40ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.918+0000 7f66a94dd640 1 --2- 172.21.15.6:0/2912266458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66a40c9730 0x7f66a40ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.918+0000 7f66a94dd640 1 -- 172.21.15.6:0/2912266458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c009a70 con 0x7f66a4158ce0 2023-07-21T22:35:46.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.918+0000 7f66a94dd640 1 --2- 172.21.15.6:0/2912266458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a4158ce0 0x7f66a40cae90 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f669c01a430 tx=0x7f669c0195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.918+0000 7f66a17fa640 1 -- 172.21.15.6:0/2912266458 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c0b9860 con 0x7f66a4158ce0 2023-07-21T22:35:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.922+0000 7f66aaf40640 1 -- 172.21.15.6:0/2912266458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a40ae7e0 con 0x7f66a4158ce0 2023-07-21T22:35:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.922+0000 7f66a17fa640 1 -- 172.21.15.6:0/2912266458 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669c0b99c0 con 0x7f66a4158ce0 2023-07-21T22:35:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.922+0000 7f66a17fa640 1 -- 172.21.15.6:0/2912266458 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c0b9d30 con 0x7f66a4158ce0 2023-07-21T22:35:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.922+0000 7f66aaf40640 1 -- 172.21.15.6:0/2912266458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a40b33c0 con 0x7f66a4158ce0 2023-07-21T22:35:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.922+0000 7f66aaf40640 1 -- 172.21.15.6:0/2912266458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a40ca1a0 con 0x7f66a4158ce0 2023-07-21T22:35:46.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.922+0000 7f66a17fa640 1 -- 172.21.15.6:0/2912266458 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f669c0ad440 con 0x7f66a4158ce0 2023-07-21T22:35:46.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.922+0000 7f66a17fa640 1 --2- 172.21.15.6:0/2912266458 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f66880663a0 0x7f6688068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.922+0000 7f66a17fa640 1 -- 172.21.15.6:0/2912266458 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f669c11f220 con 0x7f66a4158ce0 2023-07-21T22:35:46.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.922+0000 7f66a8cdc640 1 --2- 172.21.15.6:0/2912266458 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f66880663a0 0x7f6688068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.926+0000 7f66a8cdc640 1 --2- 172.21.15.6:0/2912266458 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f66880663a0 0x7f6688068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6698000f70 tx=0x7f6698007240 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:46.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:46.926+0000 7f66a17fa640 1 -- 172.21.15.6:0/2912266458 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f669c0ec4f0 con 0x7f66a4158ce0 2023-07-21T22:35:47.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.134+0000 7f66aaf40640 1 -- 172.21.15.6:0/2912266458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f66a40c3350 con 0x7f66a4158ce0 2023-07-21T22:35:47.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.138+0000 7f66a17fa640 1 -- 172.21.15.6:0/2912266458 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3232 (secure 0 0 0) 0x7f669c0efb10 con 0x7f66a4158ce0 2023-07-21T22:35:47.187 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:47.187 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1049,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":112,"num_osds":8,"num_up_osds":8,"osd_up_since":1689977909,"num_in_osds":8,"osd_in_since":1689977900,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":319983616,"bytes_avail":772774129664,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":47,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":7662}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-07-21T22:35:29.021707+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-21T22:35:47.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.138+0000 7f66aaf40640 1 -- 172.21.15.6:0/2912266458 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f66880663a0 msgr2=0x7f6688068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:47.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.138+0000 7f66aaf40640 1 --2- 172.21.15.6:0/2912266458 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f66880663a0 0x7f6688068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6698000f70 tx=0x7f6698007240 comp rx=0 tx=0).stop 2023-07-21T22:35:47.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.138+0000 7f66aaf40640 1 -- 172.21.15.6:0/2912266458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a4158ce0 msgr2=0x7f66a40cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:47.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.138+0000 7f66aaf40640 1 --2- 172.21.15.6:0/2912266458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a4158ce0 0x7f66a40cae90 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f669c01a430 tx=0x7f669c0195a0 comp rx=0 tx=0).stop 2023-07-21T22:35:47.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.138+0000 7f66aaf40640 1 -- 172.21.15.6:0/2912266458 shutdown_connections 2023-07-21T22:35:47.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.138+0000 7f66aaf40640 1 --2- 172.21.15.6:0/2912266458 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f66880663a0 0x7f6688068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:47.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.138+0000 7f66aaf40640 1 --2- 172.21.15.6:0/2912266458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a4158ce0 0x7f66a40cae90 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:47.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.138+0000 7f66aaf40640 1 --2- 172.21.15.6:0/2912266458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66a40c9730 0x7f66a40ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:47.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.138+0000 7f66aaf40640 1 --2- 172.21.15.6:0/2912266458 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66a40c8ad0 0x7f66a414d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:47.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.138+0000 7f66aaf40640 1 -- 172.21.15.6:0/2912266458 >> 172.21.15.6:0/2912266458 conn(0x7f66a40afcf0 msgr2=0x7f66a4070dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:47.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.138+0000 7f66aaf40640 1 -- 172.21.15.6:0/2912266458 shutdown_connections 2023-07-21T22:35:47.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.138+0000 7f66aaf40640 1 -- 172.21.15.6:0/2912266458 wait complete. 2023-07-21T22:35:47.208 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-21T22:35:47.209 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:35:47.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.302+0000 7f051ee0b640 1 Processor -- start 2023-07-21T22:35:47.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.302+0000 7f051ee0b640 1 -- start start 2023-07-21T22:35:47.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.302+0000 7f051ee0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05180d12f0 0x7f05180d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:47.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.302+0000 7f051ee0b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05180b4840 con 0x7f05180d1840 2023-07-21T22:35:47.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.302+0000 7f051ee0b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05180ccae0 con 0x7f05180b7990 2023-07-21T22:35:47.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.302+0000 7f051ee0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05180cd060 con 0x7f05180d12f0 2023-07-21T22:35:47.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.302+0000 7f051d3a8640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f05180d1840 0x7f05180d1d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36976/0 (socket says 172.21.15.6:36976) 2023-07-21T22:35:47.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.302+0000 7f051d3a8640 1 -- 172.21.15.6:0/1722376993 learned_addr learned my addr 172.21.15.6:0/1722376993 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:47.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.302+0000 7f050ffff640 1 --2- 172.21.15.6:0/1722376993 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05180d12f0 0x7f05180d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:47.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.302+0000 7f050f7fe640 1 -- 172.21.15.6:0/1722376993 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617232337 0 0) 0x7f05180b4840 con 0x7f05180d1840 2023-07-21T22:35:47.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.302+0000 7f050f7fe640 1 -- 172.21.15.6:0/1722376993 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0500003530 con 0x7f05180d1840 2023-07-21T22:35:47.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.302+0000 7f050f7fe640 1 -- 172.21.15.6:0/1722376993 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 688030721 0 0) 0x7f0500003530 con 0x7f05180d1840 2023-07-21T22:35:47.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.302+0000 7f050ffff640 1 -- 172.21.15.6:0/1722376993 >> v1:172.21.15.161:6789/0 conn(0x7f05180b7990 legacy=0x7f051815f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:47.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.302+0000 7f050ffff640 1 -- 172.21.15.6:0/1722376993 >> v1:172.21.15.6:6789/0 conn(0x7f05180d1840 legacy=0x7f05180d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:47.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.302+0000 7f050ffff640 1 -- 172.21.15.6:0/1722376993 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0518160310 con 0x7f05180d12f0 2023-07-21T22:35:47.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.306+0000 7f050ffff640 1 --2- 172.21.15.6:0/1722376993 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05180d12f0 0x7f05180d0c40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f05080097f0 tx=0x7f050801bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1311576fe2c1eb96 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:47.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.306+0000 7f050f7fe640 1 -- 172.21.15.6:0/1722376993 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0510001a00 con 0x7f05180d12f0 2023-07-21T22:35:47.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.306+0000 7f050f7fe640 1 -- 172.21.15.6:0/1722376993 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05080a6050 con 0x7f05180d12f0 2023-07-21T22:35:47.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.306+0000 7f050f7fe640 1 -- 172.21.15.6:0/1722376993 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05080aa620 con 0x7f05180d12f0 2023-07-21T22:35:47.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.306+0000 7f051ee0b640 1 -- 172.21.15.6:0/1722376993 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05180d12f0 msgr2=0x7f05180d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:47.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.306+0000 7f051ee0b640 1 --2- 172.21.15.6:0/1722376993 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05180d12f0 0x7f05180d0c40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f05080097f0 tx=0x7f050801bee0 comp rx=0 tx=0).stop 2023-07-21T22:35:47.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.306+0000 7f051ee0b640 1 -- 172.21.15.6:0/1722376993 shutdown_connections 2023-07-21T22:35:47.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.306+0000 7f051ee0b640 1 --2- 172.21.15.6:0/1722376993 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05180d12f0 0x7f05180d0c40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:47.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.306+0000 7f051ee0b640 1 -- 172.21.15.6:0/1722376993 >> 172.21.15.6:0/1722376993 conn(0x7f05180650b0 msgr2=0x7f05180654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:47.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.306+0000 7f051ee0b640 1 -- 172.21.15.6:0/1722376993 shutdown_connections 2023-07-21T22:35:47.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.306+0000 7f051ee0b640 1 -- 172.21.15.6:0/1722376993 wait complete. 2023-07-21T22:35:47.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.310+0000 7f051ee0b640 1 Processor -- start 2023-07-21T22:35:47.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.310+0000 7f051ee0b640 1 -- start start 2023-07-21T22:35:47.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.310+0000 7f051ee0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05180b7990 0x7f05180b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:47.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.310+0000 7f051ee0b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05180d12f0 0x7f051814d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:47.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.310+0000 7f051ee0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05180d1840 0x7f051814a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:47.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.310+0000 7f051ee0b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051814ab10 con 0x7f05180d1840 2023-07-21T22:35:47.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.310+0000 7f051ee0b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051814ebc0 con 0x7f05180d12f0 2023-07-21T22:35:47.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.310+0000 7f051ee0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05180b31c0 con 0x7f05180b7990 2023-07-21T22:35:47.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.310+0000 7f051d3a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05180d1840 0x7f051814a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:47.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.310+0000 7f051d3a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05180d1840 0x7f051814a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48606/0 (socket says 172.21.15.6:48606) 2023-07-21T22:35:47.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.310+0000 7f051d3a8640 1 -- 172.21.15.6:0/595614579 learned_addr learned my addr 172.21.15.6:0/595614579 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:47.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.310+0000 7f051cba7640 1 --2- 172.21.15.6:0/595614579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05180b7990 0x7f05180b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:47.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.310+0000 7f050ffff640 1 --2- 172.21.15.6:0/595614579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05180d12f0 0x7f051814d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:47.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.310+0000 7f051d3a8640 1 -- 172.21.15.6:0/595614579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05180b7990 msgr2=0x7f05180b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:47.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.310+0000 7f051d3a8640 1 --2- 172.21.15.6:0/595614579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05180b7990 0x7f05180b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:47.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.310+0000 7f051d3a8640 1 -- 172.21.15.6:0/595614579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05180d12f0 msgr2=0x7f051814d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:47.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.310+0000 7f051d3a8640 1 --2- 172.21.15.6:0/595614579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05180d12f0 0x7f051814d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:47.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.310+0000 7f051d3a8640 1 -- 172.21.15.6:0/595614579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0508009420 con 0x7f05180d1840 2023-07-21T22:35:47.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.310+0000 7f051d3a8640 1 --2- 172.21.15.6:0/595614579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05180d1840 0x7f051814a5d0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f051000ca70 tx=0x7f051000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:47.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.314+0000 7f050d7fa640 1 -- 172.21.15.6:0/595614579 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051000a6a0 con 0x7f05180d1840 2023-07-21T22:35:47.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.314+0000 7f050d7fa640 1 -- 172.21.15.6:0/595614579 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051000a800 con 0x7f05180d1840 2023-07-21T22:35:47.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.314+0000 7f051ee0b640 1 -- 172.21.15.6:0/595614579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f051814ee10 con 0x7f05180d1840 2023-07-21T22:35:47.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.314+0000 7f050d7fa640 1 -- 172.21.15.6:0/595614579 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051000ac30 con 0x7f05180d1840 2023-07-21T22:35:47.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.314+0000 7f051ee0b640 1 -- 172.21.15.6:0/595614579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f051814f3d0 con 0x7f05180d1840 2023-07-21T22:35:47.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.314+0000 7f051ee0b640 1 -- 172.21.15.6:0/595614579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f051814f5c0 con 0x7f05180d1840 2023-07-21T22:35:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.314+0000 7f050d7fa640 1 -- 172.21.15.6:0/595614579 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f05100070d0 con 0x7f05180d1840 2023-07-21T22:35:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.314+0000 7f050d7fa640 1 --2- 172.21.15.6:0/595614579 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f05040663a0 0x7f0504068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.314+0000 7f050d7fa640 1 -- 172.21.15.6:0/595614579 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f0510083510 con 0x7f05180d1840 2023-07-21T22:35:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.314+0000 7f051cba7640 1 --2- 172.21.15.6:0/595614579 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f05040663a0 0x7f0504068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.318+0000 7f051cba7640 1 --2- 172.21.15.6:0/595614579 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f05040663a0 0x7f0504068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f05180b36f0 tx=0x7f0514009040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:47.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.318+0000 7f050d7fa640 1 -- 172.21.15.6:0/595614579 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05100508f0 con 0x7f05180d1840 2023-07-21T22:35:47.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.470+0000 7f051ee0b640 1 -- 172.21.15.6:0/595614579 --> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f05180678d0 con 0x7f05040663a0 2023-07-21T22:35:47.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.478+0000 7f050d7fa640 1 -- 172.21.15.6:0/595614579 <== mgr.7255 v2:172.21.15.161:6832/3891612664 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311273 (secure 0 0 0) 0x7f05180678d0 con 0x7f05040663a0 2023-07-21T22:35:47.531 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:47.532 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:35:47.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.482+0000 7f051ee0b640 1 -- 172.21.15.6:0/595614579 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f05040663a0 msgr2=0x7f0504068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:47.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.482+0000 7f051ee0b640 1 --2- 172.21.15.6:0/595614579 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f05040663a0 0x7f0504068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f05180b36f0 tx=0x7f0514009040 comp rx=0 tx=0).stop 2023-07-21T22:35:47.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.482+0000 7f051ee0b640 1 -- 172.21.15.6:0/595614579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05180d1840 msgr2=0x7f051814a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:47.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.482+0000 7f051ee0b640 1 --2- 172.21.15.6:0/595614579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05180d1840 0x7f051814a5d0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f051000ca70 tx=0x7f051000cf30 comp rx=0 tx=0).stop 2023-07-21T22:35:47.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.482+0000 7f051ee0b640 1 -- 172.21.15.6:0/595614579 shutdown_connections 2023-07-21T22:35:47.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.482+0000 7f051ee0b640 1 --2- 172.21.15.6:0/595614579 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f05040663a0 0x7f0504068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:47.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.482+0000 7f051ee0b640 1 --2- 172.21.15.6:0/595614579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05180d1840 0x7f051814a5d0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:47.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.482+0000 7f051ee0b640 1 --2- 172.21.15.6:0/595614579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05180d12f0 0x7f051814d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:47.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.482+0000 7f051ee0b640 1 --2- 172.21.15.6:0/595614579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05180b7990 0x7f05180b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:47.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.482+0000 7f051ee0b640 1 -- 172.21.15.6:0/595614579 >> 172.21.15.6:0/595614579 conn(0x7f05180650b0 msgr2=0x7f05180b5120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:47.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.482+0000 7f051ee0b640 1 -- 172.21.15.6:0/595614579 shutdown_connections 2023-07-21T22:35:47.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:47.482+0000 7f051ee0b640 1 -- 172.21.15.6:0/595614579 wait complete. 2023-07-21T22:35:47.552 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-21T22:35:47.026016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":364,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":244,"ondisk_log_size":244,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":192,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":312776,"kb_used_data":11912,"kb_used_omap":0,"kb_used_meta":300800,"kb_avail":754661944,"statfs":{"total":773094113280,"available":772773830656,"internally_reserved":0,"allocated":12197888,"data_stored":6660932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308019200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.606716"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.465552+0000","last_change":"2023-07-21T22:35:41.466677+0000","last_active":"2023-07-21T22:35:42.465552+0000","last_peered":"2023-07-21T22:35:42.465552+0000","last_clean":"2023-07-21T22:35:42.465552+0000","last_became_active":"2023-07-21T22:35:41.466393+0000","last_became_peered":"2023-07-21T22:35:41.466393+0000","last_unstale":"2023-07-21T22:35:42.465552+0000","last_undegraded":"2023-07-21T22:35:42.465552+0000","last_fullsized":"2023-07-21T22:35:42.465552+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:45:59.155712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.472173+0000","last_change":"2023-07-21T22:35:41.463051+0000","last_active":"2023-07-21T22:35:42.472173+0000","last_peered":"2023-07-21T22:35:42.472173+0000","last_clean":"2023-07-21T22:35:42.472173+0000","last_became_active":"2023-07-21T22:35:41.462688+0000","last_became_peered":"2023-07-21T22:35:41.462688+0000","last_unstale":"2023-07-21T22:35:42.472173+0000","last_undegraded":"2023-07-21T22:35:42.472173+0000","last_fullsized":"2023-07-21T22:35:42.472173+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:30.649299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.465652+0000","last_change":"2023-07-21T22:35:41.463299+0000","last_active":"2023-07-21T22:35:42.465652+0000","last_peered":"2023-07-21T22:35:42.465652+0000","last_clean":"2023-07-21T22:35:42.465652+0000","last_became_active":"2023-07-21T22:35:41.463005+0000","last_became_peered":"2023-07-21T22:35:41.463005+0000","last_unstale":"2023-07-21T22:35:42.465652+0000","last_undegraded":"2023-07-21T22:35:42.465652+0000","last_fullsized":"2023-07-21T22:35:42.465652+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:06:03.106663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872886+0000","last_change":"2023-07-21T22:35:41.466791+0000","last_active":"2023-07-21T22:35:42.872886+0000","last_peered":"2023-07-21T22:35:42.872886+0000","last_clean":"2023-07-21T22:35:42.872886+0000","last_became_active":"2023-07-21T22:35:41.466126+0000","last_became_peered":"2023-07-21T22:35:41.466126+0000","last_unstale":"2023-07-21T22:35:42.872886+0000","last_undegraded":"2023-07-21T22:35:42.872886+0000","last_fullsized":"2023-07-21T22:35:42.872886+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:09:24.563717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954584+0000","last_change":"2023-07-21T22:35:41.465944+0000","last_active":"2023-07-21T22:35:42.954584+0000","last_peered":"2023-07-21T22:35:42.954584+0000","last_clean":"2023-07-21T22:35:42.954584+0000","last_became_active":"2023-07-21T22:35:41.465644+0000","last_became_peered":"2023-07-21T22:35:41.465644+0000","last_unstale":"2023-07-21T22:35:42.954584+0000","last_undegraded":"2023-07-21T22:35:42.954584+0000","last_fullsized":"2023-07-21T22:35:42.954584+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:27.726155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467549+0000","last_change":"2023-07-21T22:35:41.476760+0000","last_active":"2023-07-21T22:35:42.467549+0000","last_peered":"2023-07-21T22:35:42.467549+0000","last_clean":"2023-07-21T22:35:42.467549+0000","last_became_active":"2023-07-21T22:35:41.476482+0000","last_became_peered":"2023-07-21T22:35:41.476482+0000","last_unstale":"2023-07-21T22:35:42.467549+0000","last_undegraded":"2023-07-21T22:35:42.467549+0000","last_fullsized":"2023-07-21T22:35:42.467549+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:57:55.500168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953850+0000","last_change":"2023-07-21T22:35:41.463326+0000","last_active":"2023-07-21T22:35:42.953850+0000","last_peered":"2023-07-21T22:35:42.953850+0000","last_clean":"2023-07-21T22:35:42.953850+0000","last_became_active":"2023-07-21T22:35:41.462991+0000","last_became_peered":"2023-07-21T22:35:41.462991+0000","last_unstale":"2023-07-21T22:35:42.953850+0000","last_undegraded":"2023-07-21T22:35:42.953850+0000","last_fullsized":"2023-07-21T22:35:42.953850+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:55:29.220670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872594+0000","last_change":"2023-07-21T22:35:41.457594+0000","last_active":"2023-07-21T22:35:42.872594+0000","last_peered":"2023-07-21T22:35:42.872594+0000","last_clean":"2023-07-21T22:35:42.872594+0000","last_became_active":"2023-07-21T22:35:41.457103+0000","last_became_peered":"2023-07-21T22:35:41.457103+0000","last_unstale":"2023-07-21T22:35:42.872594+0000","last_undegraded":"2023-07-21T22:35:42.872594+0000","last_fullsized":"2023-07-21T22:35:42.872594+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:00:35.849238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.955087+0000","last_change":"2023-07-21T22:35:41.466440+0000","last_active":"2023-07-21T22:35:42.955087+0000","last_peered":"2023-07-21T22:35:42.955087+0000","last_clean":"2023-07-21T22:35:42.955087+0000","last_became_active":"2023-07-21T22:35:41.466114+0000","last_became_peered":"2023-07-21T22:35:41.466114+0000","last_unstale":"2023-07-21T22:35:42.955087+0000","last_undegraded":"2023-07-21T22:35:42.955087+0000","last_fullsized":"2023-07-21T22:35:42.955087+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:36:39.592689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.949364+0000","last_change":"2023-07-21T22:35:41.470569+0000","last_active":"2023-07-21T22:35:42.949364+0000","last_peered":"2023-07-21T22:35:42.949364+0000","last_clean":"2023-07-21T22:35:42.949364+0000","last_became_active":"2023-07-21T22:35:41.470301+0000","last_became_peered":"2023-07-21T22:35:41.470301+0000","last_unstale":"2023-07-21T22:35:42.949364+0000","last_undegraded":"2023-07-21T22:35:42.949364+0000","last_fullsized":"2023-07-21T22:35:42.949364+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:49:31.728512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.955002+0000","last_change":"2023-07-21T22:35:41.466758+0000","last_active":"2023-07-21T22:35:42.955002+0000","last_peered":"2023-07-21T22:35:42.955002+0000","last_clean":"2023-07-21T22:35:42.955002+0000","last_became_active":"2023-07-21T22:35:41.466494+0000","last_became_peered":"2023-07-21T22:35:41.466494+0000","last_unstale":"2023-07-21T22:35:42.955002+0000","last_undegraded":"2023-07-21T22:35:42.955002+0000","last_fullsized":"2023-07-21T22:35:42.955002+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:47:42.504007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.949189+0000","last_change":"2023-07-21T22:35:41.456368+0000","last_active":"2023-07-21T22:35:42.949189+0000","last_peered":"2023-07-21T22:35:42.949189+0000","last_clean":"2023-07-21T22:35:42.949189+0000","last_became_active":"2023-07-21T22:35:41.456086+0000","last_became_peered":"2023-07-21T22:35:41.456086+0000","last_unstale":"2023-07-21T22:35:42.949189+0000","last_undegraded":"2023-07-21T22:35:42.949189+0000","last_fullsized":"2023-07-21T22:35:42.949189+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:12:06.856071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872736+0000","last_change":"2023-07-21T22:35:41.464270+0000","last_active":"2023-07-21T22:35:42.872736+0000","last_peered":"2023-07-21T22:35:42.872736+0000","last_clean":"2023-07-21T22:35:42.872736+0000","last_became_active":"2023-07-21T22:35:41.463975+0000","last_became_peered":"2023-07-21T22:35:41.463975+0000","last_unstale":"2023-07-21T22:35:42.872736+0000","last_undegraded":"2023-07-21T22:35:42.872736+0000","last_fullsized":"2023-07-21T22:35:42.872736+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:22:12.669206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954326+0000","last_change":"2023-07-21T22:35:41.472511+0000","last_active":"2023-07-21T22:35:42.954326+0000","last_peered":"2023-07-21T22:35:42.954326+0000","last_clean":"2023-07-21T22:35:42.954326+0000","last_became_active":"2023-07-21T22:35:41.472197+0000","last_became_peered":"2023-07-21T22:35:41.472197+0000","last_unstale":"2023-07-21T22:35:42.954326+0000","last_undegraded":"2023-07-21T22:35:42.954326+0000","last_fullsized":"2023-07-21T22:35:42.954326+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:27:40.739453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872463+0000","last_change":"2023-07-21T22:35:41.459679+0000","last_active":"2023-07-21T22:35:42.872463+0000","last_peered":"2023-07-21T22:35:42.872463+0000","last_clean":"2023-07-21T22:35:42.872463+0000","last_became_active":"2023-07-21T22:35:41.459391+0000","last_became_peered":"2023-07-21T22:35:41.459391+0000","last_unstale":"2023-07-21T22:35:42.872463+0000","last_undegraded":"2023-07-21T22:35:42.872463+0000","last_fullsized":"2023-07-21T22:35:42.872463+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:47:23.365483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467357+0000","last_change":"2023-07-21T22:35:41.466239+0000","last_active":"2023-07-21T22:35:42.467357+0000","last_peered":"2023-07-21T22:35:42.467357+0000","last_clean":"2023-07-21T22:35:42.467357+0000","last_became_active":"2023-07-21T22:35:41.465937+0000","last_became_peered":"2023-07-21T22:35:41.465937+0000","last_unstale":"2023-07-21T22:35:42.467357+0000","last_undegraded":"2023-07-21T22:35:42.467357+0000","last_fullsized":"2023-07-21T22:35:42.467357+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:10:02.774571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467793+0000","last_change":"2023-07-21T22:35:41.466413+0000","last_active":"2023-07-21T22:35:42.467793+0000","last_peered":"2023-07-21T22:35:42.467793+0000","last_clean":"2023-07-21T22:35:42.467793+0000","last_became_active":"2023-07-21T22:35:41.466135+0000","last_became_peered":"2023-07-21T22:35:41.466135+0000","last_unstale":"2023-07-21T22:35:42.467793+0000","last_undegraded":"2023-07-21T22:35:42.467793+0000","last_fullsized":"2023-07-21T22:35:42.467793+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:21:04.275466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.465786+0000","last_change":"2023-07-21T22:35:41.462528+0000","last_active":"2023-07-21T22:35:42.465786+0000","last_peered":"2023-07-21T22:35:42.465786+0000","last_clean":"2023-07-21T22:35:42.465786+0000","last_became_active":"2023-07-21T22:35:41.462150+0000","last_became_peered":"2023-07-21T22:35:41.462150+0000","last_unstale":"2023-07-21T22:35:42.465786+0000","last_undegraded":"2023-07-21T22:35:42.465786+0000","last_fullsized":"2023-07-21T22:35:42.465786+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:22:02.513995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.955031+0000","last_change":"2023-07-21T22:35:41.476357+0000","last_active":"2023-07-21T22:35:42.955031+0000","last_peered":"2023-07-21T22:35:42.955031+0000","last_clean":"2023-07-21T22:35:42.955031+0000","last_became_active":"2023-07-21T22:35:41.476085+0000","last_became_peered":"2023-07-21T22:35:41.476085+0000","last_unstale":"2023-07-21T22:35:42.955031+0000","last_undegraded":"2023-07-21T22:35:42.955031+0000","last_fullsized":"2023-07-21T22:35:42.955031+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:19:57.755916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872924+0000","last_change":"2023-07-21T22:35:41.466615+0000","last_active":"2023-07-21T22:35:42.872924+0000","last_peered":"2023-07-21T22:35:42.872924+0000","last_clean":"2023-07-21T22:35:42.872924+0000","last_became_active":"2023-07-21T22:35:41.465762+0000","last_became_peered":"2023-07-21T22:35:41.465762+0000","last_unstale":"2023-07-21T22:35:42.872924+0000","last_undegraded":"2023-07-21T22:35:42.872924+0000","last_fullsized":"2023-07-21T22:35:42.872924+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:37:59.242334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954714+0000","last_change":"2023-07-21T22:35:41.461130+0000","last_active":"2023-07-21T22:35:42.954714+0000","last_peered":"2023-07-21T22:35:42.954714+0000","last_clean":"2023-07-21T22:35:42.954714+0000","last_became_active":"2023-07-21T22:35:41.460847+0000","last_became_peered":"2023-07-21T22:35:41.460847+0000","last_unstale":"2023-07-21T22:35:42.954714+0000","last_undegraded":"2023-07-21T22:35:42.954714+0000","last_fullsized":"2023-07-21T22:35:42.954714+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:37:04.091671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954364+0000","last_change":"2023-07-21T22:35:41.472837+0000","last_active":"2023-07-21T22:35:42.954364+0000","last_peered":"2023-07-21T22:35:42.954364+0000","last_clean":"2023-07-21T22:35:42.954364+0000","last_became_active":"2023-07-21T22:35:41.472337+0000","last_became_peered":"2023-07-21T22:35:41.472337+0000","last_unstale":"2023-07-21T22:35:42.954364+0000","last_undegraded":"2023-07-21T22:35:42.954364+0000","last_fullsized":"2023-07-21T22:35:42.954364+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:08:20.635175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953646+0000","last_change":"2023-07-21T22:35:41.476478+0000","last_active":"2023-07-21T22:35:42.953646+0000","last_peered":"2023-07-21T22:35:42.953646+0000","last_clean":"2023-07-21T22:35:42.953646+0000","last_became_active":"2023-07-21T22:35:41.476119+0000","last_became_peered":"2023-07-21T22:35:41.476119+0000","last_unstale":"2023-07-21T22:35:42.953646+0000","last_undegraded":"2023-07-21T22:35:42.953646+0000","last_fullsized":"2023-07-21T22:35:42.953646+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:53:03.772914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.465366+0000","last_change":"2023-07-21T22:35:41.463337+0000","last_active":"2023-07-21T22:35:42.465366+0000","last_peered":"2023-07-21T22:35:42.465366+0000","last_clean":"2023-07-21T22:35:42.465366+0000","last_became_active":"2023-07-21T22:35:41.463039+0000","last_became_peered":"2023-07-21T22:35:41.463039+0000","last_unstale":"2023-07-21T22:35:42.465366+0000","last_undegraded":"2023-07-21T22:35:42.465366+0000","last_fullsized":"2023-07-21T22:35:42.465366+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:05:06.262181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.472325+0000","last_change":"2023-07-21T22:35:41.461770+0000","last_active":"2023-07-21T22:35:42.472325+0000","last_peered":"2023-07-21T22:35:42.472325+0000","last_clean":"2023-07-21T22:35:42.472325+0000","last_became_active":"2023-07-21T22:35:41.461384+0000","last_became_peered":"2023-07-21T22:35:41.461384+0000","last_unstale":"2023-07-21T22:35:42.472325+0000","last_undegraded":"2023-07-21T22:35:42.472325+0000","last_fullsized":"2023-07-21T22:35:42.472325+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:18:12.178988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954940+0000","last_change":"2023-07-21T22:35:41.472750+0000","last_active":"2023-07-21T22:35:42.954940+0000","last_peered":"2023-07-21T22:35:42.954940+0000","last_clean":"2023-07-21T22:35:42.954940+0000","last_became_active":"2023-07-21T22:35:41.472406+0000","last_became_peered":"2023-07-21T22:35:41.472406+0000","last_unstale":"2023-07-21T22:35:42.954940+0000","last_undegraded":"2023-07-21T22:35:42.954940+0000","last_fullsized":"2023-07-21T22:35:42.954940+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:48.333557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.949236+0000","last_change":"2023-07-21T22:35:41.459186+0000","last_active":"2023-07-21T22:35:42.949236+0000","last_peered":"2023-07-21T22:35:42.949236+0000","last_clean":"2023-07-21T22:35:42.949236+0000","last_became_active":"2023-07-21T22:35:41.458281+0000","last_became_peered":"2023-07-21T22:35:41.458281+0000","last_unstale":"2023-07-21T22:35:42.949236+0000","last_undegraded":"2023-07-21T22:35:42.949236+0000","last_fullsized":"2023-07-21T22:35:42.949236+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:58:35.114645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.873018+0000","last_change":"2023-07-21T22:35:41.466437+0000","last_active":"2023-07-21T22:35:42.873018+0000","last_peered":"2023-07-21T22:35:42.873018+0000","last_clean":"2023-07-21T22:35:42.873018+0000","last_became_active":"2023-07-21T22:35:41.465398+0000","last_became_peered":"2023-07-21T22:35:41.465398+0000","last_unstale":"2023-07-21T22:35:42.873018+0000","last_undegraded":"2023-07-21T22:35:42.873018+0000","last_fullsized":"2023-07-21T22:35:42.873018+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:43:20.215798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954125+0000","last_change":"2023-07-21T22:35:41.452205+0000","last_active":"2023-07-21T22:35:42.954125+0000","last_peered":"2023-07-21T22:35:42.954125+0000","last_clean":"2023-07-21T22:35:42.954125+0000","last_became_active":"2023-07-21T22:35:41.451870+0000","last_became_peered":"2023-07-21T22:35:41.451870+0000","last_unstale":"2023-07-21T22:35:42.954125+0000","last_undegraded":"2023-07-21T22:35:42.954125+0000","last_fullsized":"2023-07-21T22:35:42.954125+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:12.666956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954490+0000","last_change":"2023-07-21T22:35:41.464387+0000","last_active":"2023-07-21T22:35:42.954490+0000","last_peered":"2023-07-21T22:35:42.954490+0000","last_clean":"2023-07-21T22:35:42.954490+0000","last_became_active":"2023-07-21T22:35:41.464083+0000","last_became_peered":"2023-07-21T22:35:41.464083+0000","last_unstale":"2023-07-21T22:35:42.954490+0000","last_undegraded":"2023-07-21T22:35:42.954490+0000","last_fullsized":"2023-07-21T22:35:42.954490+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:31:29.748120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.471906+0000","last_change":"2023-07-21T22:35:41.476238+0000","last_active":"2023-07-21T22:35:42.471906+0000","last_peered":"2023-07-21T22:35:42.471906+0000","last_clean":"2023-07-21T22:35:42.471906+0000","last_became_active":"2023-07-21T22:35:41.475942+0000","last_became_peered":"2023-07-21T22:35:41.475942+0000","last_unstale":"2023-07-21T22:35:42.471906+0000","last_undegraded":"2023-07-21T22:35:42.471906+0000","last_fullsized":"2023-07-21T22:35:42.471906+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:03:29.335794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467433+0000","last_change":"2023-07-21T22:35:41.463062+0000","last_active":"2023-07-21T22:35:42.467433+0000","last_peered":"2023-07-21T22:35:42.467433+0000","last_clean":"2023-07-21T22:35:42.467433+0000","last_became_active":"2023-07-21T22:35:41.462785+0000","last_became_peered":"2023-07-21T22:35:41.462785+0000","last_unstale":"2023-07-21T22:35:42.467433+0000","last_undegraded":"2023-07-21T22:35:42.467433+0000","last_fullsized":"2023-07-21T22:35:42.467433+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:36:32.358870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467544+0000","last_change":"2023-07-21T22:35:41.467473+0000","last_active":"2023-07-21T22:35:42.467544+0000","last_peered":"2023-07-21T22:35:42.467544+0000","last_clean":"2023-07-21T22:35:42.467544+0000","last_became_active":"2023-07-21T22:35:41.467099+0000","last_became_peered":"2023-07-21T22:35:41.467099+0000","last_unstale":"2023-07-21T22:35:42.467544+0000","last_undegraded":"2023-07-21T22:35:42.467544+0000","last_fullsized":"2023-07-21T22:35:42.467544+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:53:35.888493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"111'4","reported_seq":17,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953920+0000","last_change":"2023-07-21T22:35:40.437895+0000","last_active":"2023-07-21T22:35:42.953920+0000","last_peered":"2023-07-21T22:35:42.953920+0000","last_clean":"2023-07-21T22:35:42.953920+0000","last_became_active":"2023-07-21T22:35:40.436744+0000","last_became_peered":"2023-07-21T22:35:40.436744+0000","last_unstale":"2023-07-21T22:35:42.953920+0000","last_undegraded":"2023-07-21T22:35:42.953920+0000","last_fullsized":"2023-07-21T22:35:42.953920+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:41:18.590148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467695+0000","last_change":"2023-07-21T22:35:41.464734+0000","last_active":"2023-07-21T22:35:42.467695+0000","last_peered":"2023-07-21T22:35:42.467695+0000","last_clean":"2023-07-21T22:35:42.467695+0000","last_became_active":"2023-07-21T22:35:41.464453+0000","last_became_peered":"2023-07-21T22:35:41.464453+0000","last_unstale":"2023-07-21T22:35:42.467695+0000","last_undegraded":"2023-07-21T22:35:42.467695+0000","last_fullsized":"2023-07-21T22:35:42.467695+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:38.417785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"111'1","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.955080+0000","last_change":"2023-07-21T22:35:40.436147+0000","last_active":"2023-07-21T22:35:42.955080+0000","last_peered":"2023-07-21T22:35:42.955080+0000","last_clean":"2023-07-21T22:35:42.955080+0000","last_became_active":"2023-07-21T22:35:40.435878+0000","last_became_peered":"2023-07-21T22:35:40.435878+0000","last_unstale":"2023-07-21T22:35:42.955080+0000","last_undegraded":"2023-07-21T22:35:42.955080+0000","last_fullsized":"2023-07-21T22:35:42.955080+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:52:44.052569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954265+0000","last_change":"2023-07-21T22:35:41.469549+0000","last_active":"2023-07-21T22:35:42.954265+0000","last_peered":"2023-07-21T22:35:42.954265+0000","last_clean":"2023-07-21T22:35:42.954265+0000","last_became_active":"2023-07-21T22:35:41.469264+0000","last_became_peered":"2023-07-21T22:35:41.469264+0000","last_unstale":"2023-07-21T22:35:42.954265+0000","last_undegraded":"2023-07-21T22:35:42.954265+0000","last_fullsized":"2023-07-21T22:35:42.954265+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:31:51.987773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"111'2","reported_seq":15,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953248+0000","last_change":"2023-07-21T22:35:40.440062+0000","last_active":"2023-07-21T22:35:42.953248+0000","last_peered":"2023-07-21T22:35:42.953248+0000","last_clean":"2023-07-21T22:35:42.953248+0000","last_became_active":"2023-07-21T22:35:40.439791+0000","last_became_peered":"2023-07-21T22:35:40.439791+0000","last_unstale":"2023-07-21T22:35:42.953248+0000","last_undegraded":"2023-07-21T22:35:42.953248+0000","last_fullsized":"2023-07-21T22:35:42.953248+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:42:58.001245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467887+0000","last_change":"2023-07-21T22:35:41.467787+0000","last_active":"2023-07-21T22:35:42.467887+0000","last_peered":"2023-07-21T22:35:42.467887+0000","last_clean":"2023-07-21T22:35:42.467887+0000","last_became_active":"2023-07-21T22:35:41.466695+0000","last_became_peered":"2023-07-21T22:35:41.466695+0000","last_unstale":"2023-07-21T22:35:42.467887+0000","last_undegraded":"2023-07-21T22:35:42.467887+0000","last_fullsized":"2023-07-21T22:35:42.467887+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:51:26.977629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"111'2","reported_seq":15,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953805+0000","last_change":"2023-07-21T22:35:40.437899+0000","last_active":"2023-07-21T22:35:42.953805+0000","last_peered":"2023-07-21T22:35:42.953805+0000","last_clean":"2023-07-21T22:35:42.953805+0000","last_became_active":"2023-07-21T22:35:40.437604+0000","last_became_peered":"2023-07-21T22:35:40.437604+0000","last_unstale":"2023-07-21T22:35:42.953805+0000","last_undegraded":"2023-07-21T22:35:42.953805+0000","last_fullsized":"2023-07-21T22:35:42.953805+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:43.288673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872370+0000","last_change":"2023-07-21T22:35:41.465881+0000","last_active":"2023-07-21T22:35:42.872370+0000","last_peered":"2023-07-21T22:35:42.872370+0000","last_clean":"2023-07-21T22:35:42.872370+0000","last_became_active":"2023-07-21T22:35:41.465388+0000","last_became_peered":"2023-07-21T22:35:41.465388+0000","last_unstale":"2023-07-21T22:35:42.872370+0000","last_undegraded":"2023-07-21T22:35:42.872370+0000","last_fullsized":"2023-07-21T22:35:42.872370+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:48:58.606348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"111'1","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954854+0000","last_change":"2023-07-21T22:35:40.439578+0000","last_active":"2023-07-21T22:35:42.954854+0000","last_peered":"2023-07-21T22:35:42.954854+0000","last_clean":"2023-07-21T22:35:42.954854+0000","last_became_active":"2023-07-21T22:35:40.439264+0000","last_became_peered":"2023-07-21T22:35:40.439264+0000","last_unstale":"2023-07-21T22:35:42.954854+0000","last_undegraded":"2023-07-21T22:35:42.954854+0000","last_fullsized":"2023-07-21T22:35:42.954854+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:18:36.285247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953782+0000","last_change":"2023-07-21T22:35:41.471185+0000","last_active":"2023-07-21T22:35:42.953782+0000","last_peered":"2023-07-21T22:35:42.953782+0000","last_clean":"2023-07-21T22:35:42.953782+0000","last_became_active":"2023-07-21T22:35:41.470820+0000","last_became_peered":"2023-07-21T22:35:41.470820+0000","last_unstale":"2023-07-21T22:35:42.953782+0000","last_undegraded":"2023-07-21T22:35:42.953782+0000","last_fullsized":"2023-07-21T22:35:42.953782+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:10.909320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"111'1","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872734+0000","last_change":"2023-07-21T22:35:40.434147+0000","last_active":"2023-07-21T22:35:42.872734+0000","last_peered":"2023-07-21T22:35:42.872734+0000","last_clean":"2023-07-21T22:35:42.872734+0000","last_became_active":"2023-07-21T22:35:40.433804+0000","last_became_peered":"2023-07-21T22:35:40.433804+0000","last_unstale":"2023-07-21T22:35:42.872734+0000","last_undegraded":"2023-07-21T22:35:42.872734+0000","last_fullsized":"2023-07-21T22:35:42.872734+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:36:31.169299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467468+0000","last_change":"2023-07-21T22:35:41.476727+0000","last_active":"2023-07-21T22:35:42.467468+0000","last_peered":"2023-07-21T22:35:42.467468+0000","last_clean":"2023-07-21T22:35:42.467468+0000","last_became_active":"2023-07-21T22:35:41.476426+0000","last_became_peered":"2023-07-21T22:35:41.476426+0000","last_unstale":"2023-07-21T22:35:42.467468+0000","last_undegraded":"2023-07-21T22:35:42.467468+0000","last_fullsized":"2023-07-21T22:35:42.467468+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:46:28.615624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.465467+0000","last_change":"2023-07-21T22:35:40.429279+0000","last_active":"2023-07-21T22:35:42.465467+0000","last_peered":"2023-07-21T22:35:42.465467+0000","last_clean":"2023-07-21T22:35:42.465467+0000","last_became_active":"2023-07-21T22:35:40.428980+0000","last_became_peered":"2023-07-21T22:35:40.428980+0000","last_unstale":"2023-07-21T22:35:42.465467+0000","last_undegraded":"2023-07-21T22:35:42.465467+0000","last_fullsized":"2023-07-21T22:35:42.465467+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:31:15.627320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872898+0000","last_change":"2023-07-21T22:35:41.458213+0000","last_active":"2023-07-21T22:35:42.872898+0000","last_peered":"2023-07-21T22:35:42.872898+0000","last_clean":"2023-07-21T22:35:42.872898+0000","last_became_active":"2023-07-21T22:35:41.457863+0000","last_became_peered":"2023-07-21T22:35:41.457863+0000","last_unstale":"2023-07-21T22:35:42.872898+0000","last_undegraded":"2023-07-21T22:35:42.872898+0000","last_fullsized":"2023-07-21T22:35:42.872898+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:26:41.701135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953233+0000","last_change":"2023-07-21T22:35:40.439163+0000","last_active":"2023-07-21T22:35:42.953233+0000","last_peered":"2023-07-21T22:35:42.953233+0000","last_clean":"2023-07-21T22:35:42.953233+0000","last_became_active":"2023-07-21T22:35:40.438863+0000","last_became_peered":"2023-07-21T22:35:40.438863+0000","last_unstale":"2023-07-21T22:35:42.953233+0000","last_undegraded":"2023-07-21T22:35:42.953233+0000","last_fullsized":"2023-07-21T22:35:42.953233+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:46:26.052334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954744+0000","last_change":"2023-07-21T22:35:41.461770+0000","last_active":"2023-07-21T22:35:42.954744+0000","last_peered":"2023-07-21T22:35:42.954744+0000","last_clean":"2023-07-21T22:35:42.954744+0000","last_became_active":"2023-07-21T22:35:41.461460+0000","last_became_peered":"2023-07-21T22:35:41.461460+0000","last_unstale":"2023-07-21T22:35:42.954744+0000","last_undegraded":"2023-07-21T22:35:42.954744+0000","last_fullsized":"2023-07-21T22:35:42.954744+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:40:22.509629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.472439+0000","last_change":"2023-07-21T22:35:40.429995+0000","last_active":"2023-07-21T22:35:42.472439+0000","last_peered":"2023-07-21T22:35:42.472439+0000","last_clean":"2023-07-21T22:35:42.472439+0000","last_became_active":"2023-07-21T22:35:40.429725+0000","last_became_peered":"2023-07-21T22:35:40.429725+0000","last_unstale":"2023-07-21T22:35:42.472439+0000","last_undegraded":"2023-07-21T22:35:42.472439+0000","last_fullsized":"2023-07-21T22:35:42.472439+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:46:05.602626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953130+0000","last_change":"2023-07-21T22:35:41.467376+0000","last_active":"2023-07-21T22:35:42.953130+0000","last_peered":"2023-07-21T22:35:42.953130+0000","last_clean":"2023-07-21T22:35:42.953130+0000","last_became_active":"2023-07-21T22:35:41.467011+0000","last_became_peered":"2023-07-21T22:35:41.467011+0000","last_unstale":"2023-07-21T22:35:42.953130+0000","last_undegraded":"2023-07-21T22:35:42.953130+0000","last_fullsized":"2023-07-21T22:35:42.953130+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:48:08.549696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.465894+0000","last_change":"2023-07-21T22:35:40.434725+0000","last_active":"2023-07-21T22:35:42.465894+0000","last_peered":"2023-07-21T22:35:42.465894+0000","last_clean":"2023-07-21T22:35:42.465894+0000","last_became_active":"2023-07-21T22:35:40.434401+0000","last_became_peered":"2023-07-21T22:35:40.434401+0000","last_unstale":"2023-07-21T22:35:42.465894+0000","last_undegraded":"2023-07-21T22:35:42.465894+0000","last_fullsized":"2023-07-21T22:35:42.465894+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:38.136772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.465839+0000","last_change":"2023-07-21T22:35:41.467123+0000","last_active":"2023-07-21T22:35:42.465839+0000","last_peered":"2023-07-21T22:35:42.465839+0000","last_clean":"2023-07-21T22:35:42.465839+0000","last_became_active":"2023-07-21T22:35:41.466861+0000","last_became_peered":"2023-07-21T22:35:41.466861+0000","last_unstale":"2023-07-21T22:35:42.465839+0000","last_undegraded":"2023-07-21T22:35:42.465839+0000","last_fullsized":"2023-07-21T22:35:42.465839+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:02:09.395272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"111'3","reported_seq":16,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.955198+0000","last_change":"2023-07-21T22:35:40.441811+0000","last_active":"2023-07-21T22:35:42.955198+0000","last_peered":"2023-07-21T22:35:42.955198+0000","last_clean":"2023-07-21T22:35:42.955198+0000","last_became_active":"2023-07-21T22:35:40.441488+0000","last_became_peered":"2023-07-21T22:35:40.441488+0000","last_unstale":"2023-07-21T22:35:42.955198+0000","last_undegraded":"2023-07-21T22:35:42.955198+0000","last_fullsized":"2023-07-21T22:35:42.955198+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:26:11.026462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.873213+0000","last_change":"2023-07-21T22:35:41.460779+0000","last_active":"2023-07-21T22:35:42.873213+0000","last_peered":"2023-07-21T22:35:42.873213+0000","last_clean":"2023-07-21T22:35:42.873213+0000","last_became_active":"2023-07-21T22:35:41.460437+0000","last_became_peered":"2023-07-21T22:35:41.460437+0000","last_unstale":"2023-07-21T22:35:42.873213+0000","last_undegraded":"2023-07-21T22:35:42.873213+0000","last_fullsized":"2023-07-21T22:35:42.873213+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:51.797124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"111'6","reported_seq":19,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467694+0000","last_change":"2023-07-21T22:35:40.431340+0000","last_active":"2023-07-21T22:35:42.467694+0000","last_peered":"2023-07-21T22:35:42.467694+0000","last_clean":"2023-07-21T22:35:42.467694+0000","last_became_active":"2023-07-21T22:35:40.430803+0000","last_became_peered":"2023-07-21T22:35:40.430803+0000","last_unstale":"2023-07-21T22:35:42.467694+0000","last_undegraded":"2023-07-21T22:35:42.467694+0000","last_fullsized":"2023-07-21T22:35:42.467694+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:48:51.880288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872373+0000","last_change":"2023-07-21T22:35:41.465697+0000","last_active":"2023-07-21T22:35:42.872373+0000","last_peered":"2023-07-21T22:35:42.872373+0000","last_clean":"2023-07-21T22:35:42.872373+0000","last_became_active":"2023-07-21T22:35:41.465052+0000","last_became_peered":"2023-07-21T22:35:41.465052+0000","last_unstale":"2023-07-21T22:35:42.872373+0000","last_undegraded":"2023-07-21T22:35:42.872373+0000","last_fullsized":"2023-07-21T22:35:42.872373+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:20:50.784975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"111'2","reported_seq":15,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954187+0000","last_change":"2023-07-21T22:35:40.438909+0000","last_active":"2023-07-21T22:35:42.954187+0000","last_peered":"2023-07-21T22:35:42.954187+0000","last_clean":"2023-07-21T22:35:42.954187+0000","last_became_active":"2023-07-21T22:35:40.438607+0000","last_became_peered":"2023-07-21T22:35:40.438607+0000","last_unstale":"2023-07-21T22:35:42.954187+0000","last_undegraded":"2023-07-21T22:35:42.954187+0000","last_fullsized":"2023-07-21T22:35:42.954187+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:07:33.563104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954173+0000","last_change":"2023-07-21T22:35:41.462170+0000","last_active":"2023-07-21T22:35:42.954173+0000","last_peered":"2023-07-21T22:35:42.954173+0000","last_clean":"2023-07-21T22:35:42.954173+0000","last_became_active":"2023-07-21T22:35:41.461850+0000","last_became_peered":"2023-07-21T22:35:41.461850+0000","last_unstale":"2023-07-21T22:35:42.954173+0000","last_undegraded":"2023-07-21T22:35:42.954173+0000","last_fullsized":"2023-07-21T22:35:42.954173+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:27:23.662839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467610+0000","last_change":"2023-07-21T22:35:40.435925+0000","last_active":"2023-07-21T22:35:42.467610+0000","last_peered":"2023-07-21T22:35:42.467610+0000","last_clean":"2023-07-21T22:35:42.467610+0000","last_became_active":"2023-07-21T22:35:40.435648+0000","last_became_peered":"2023-07-21T22:35:40.435648+0000","last_unstale":"2023-07-21T22:35:42.467610+0000","last_undegraded":"2023-07-21T22:35:42.467610+0000","last_fullsized":"2023-07-21T22:35:42.467610+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:37:43.983362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.949076+0000","last_change":"2023-07-21T22:35:41.471593+0000","last_active":"2023-07-21T22:35:42.949076+0000","last_peered":"2023-07-21T22:35:42.949076+0000","last_clean":"2023-07-21T22:35:42.949076+0000","last_became_active":"2023-07-21T22:35:41.471273+0000","last_became_peered":"2023-07-21T22:35:41.471273+0000","last_unstale":"2023-07-21T22:35:42.949076+0000","last_undegraded":"2023-07-21T22:35:42.949076+0000","last_fullsized":"2023-07-21T22:35:42.949076+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:06:38.914530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872540+0000","last_change":"2023-07-21T22:35:40.433893+0000","last_active":"2023-07-21T22:35:42.872540+0000","last_peered":"2023-07-21T22:35:42.872540+0000","last_clean":"2023-07-21T22:35:42.872540+0000","last_became_active":"2023-07-21T22:35:40.433550+0000","last_became_peered":"2023-07-21T22:35:40.433550+0000","last_unstale":"2023-07-21T22:35:42.872540+0000","last_undegraded":"2023-07-21T22:35:42.872540+0000","last_fullsized":"2023-07-21T22:35:42.872540+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:56:40.396600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.949328+0000","last_change":"2023-07-21T22:35:41.460017+0000","last_active":"2023-07-21T22:35:42.949328+0000","last_peered":"2023-07-21T22:35:42.949328+0000","last_clean":"2023-07-21T22:35:42.949328+0000","last_became_active":"2023-07-21T22:35:41.459744+0000","last_became_peered":"2023-07-21T22:35:41.459744+0000","last_unstale":"2023-07-21T22:35:42.949328+0000","last_undegraded":"2023-07-21T22:35:42.949328+0000","last_fullsized":"2023-07-21T22:35:42.949328+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:15:50.014467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"111'8","reported_seq":21,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872549+0000","last_change":"2023-07-21T22:35:40.435977+0000","last_active":"2023-07-21T22:35:42.872549+0000","last_peered":"2023-07-21T22:35:42.872549+0000","last_clean":"2023-07-21T22:35:42.872549+0000","last_became_active":"2023-07-21T22:35:40.435683+0000","last_became_peered":"2023-07-21T22:35:40.435683+0000","last_unstale":"2023-07-21T22:35:42.872549+0000","last_undegraded":"2023-07-21T22:35:42.872549+0000","last_fullsized":"2023-07-21T22:35:42.872549+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:47.790294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953674+0000","last_change":"2023-07-21T22:35:41.459497+0000","last_active":"2023-07-21T22:35:42.953674+0000","last_peered":"2023-07-21T22:35:42.953674+0000","last_clean":"2023-07-21T22:35:42.953674+0000","last_became_active":"2023-07-21T22:35:41.459196+0000","last_became_peered":"2023-07-21T22:35:41.459196+0000","last_unstale":"2023-07-21T22:35:42.953674+0000","last_undegraded":"2023-07-21T22:35:42.953674+0000","last_fullsized":"2023-07-21T22:35:42.953674+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:59:50.902581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"111'2","reported_seq":15,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954503+0000","last_change":"2023-07-21T22:35:40.437173+0000","last_active":"2023-07-21T22:35:42.954503+0000","last_peered":"2023-07-21T22:35:42.954503+0000","last_clean":"2023-07-21T22:35:42.954503+0000","last_became_active":"2023-07-21T22:35:40.435532+0000","last_became_peered":"2023-07-21T22:35:40.435532+0000","last_unstale":"2023-07-21T22:35:42.954503+0000","last_undegraded":"2023-07-21T22:35:42.954503+0000","last_fullsized":"2023-07-21T22:35:42.954503+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:29:14.776433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467871+0000","last_change":"2023-07-21T22:35:41.468318+0000","last_active":"2023-07-21T22:35:42.467871+0000","last_peered":"2023-07-21T22:35:42.467871+0000","last_clean":"2023-07-21T22:35:42.467871+0000","last_became_active":"2023-07-21T22:35:41.468046+0000","last_became_peered":"2023-07-21T22:35:41.468046+0000","last_unstale":"2023-07-21T22:35:42.467871+0000","last_undegraded":"2023-07-21T22:35:42.467871+0000","last_fullsized":"2023-07-21T22:35:42.467871+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:25:49.928391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"112'1","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.955257+0000","last_change":"2023-07-21T22:35:40.436051+0000","last_active":"2023-07-21T22:35:42.955257+0000","last_peered":"2023-07-21T22:35:42.955257+0000","last_clean":"2023-07-21T22:35:42.955257+0000","last_became_active":"2023-07-21T22:35:40.435765+0000","last_became_peered":"2023-07-21T22:35:40.435765+0000","last_unstale":"2023-07-21T22:35:42.955257+0000","last_undegraded":"2023-07-21T22:35:42.955257+0000","last_fullsized":"2023-07-21T22:35:42.955257+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:51:46.802269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467990+0000","last_change":"2023-07-21T22:35:41.461568+0000","last_active":"2023-07-21T22:35:42.467990+0000","last_peered":"2023-07-21T22:35:42.467990+0000","last_clean":"2023-07-21T22:35:42.467990+0000","last_became_active":"2023-07-21T22:35:41.461271+0000","last_became_peered":"2023-07-21T22:35:41.461271+0000","last_unstale":"2023-07-21T22:35:42.467990+0000","last_undegraded":"2023-07-21T22:35:42.467990+0000","last_fullsized":"2023-07-21T22:35:42.467990+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:30:51.228495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.955312+0000","last_change":"2023-07-21T22:35:40.439003+0000","last_active":"2023-07-21T22:35:42.955312+0000","last_peered":"2023-07-21T22:35:42.955312+0000","last_clean":"2023-07-21T22:35:42.955312+0000","last_became_active":"2023-07-21T22:35:40.438479+0000","last_became_peered":"2023-07-21T22:35:40.438479+0000","last_unstale":"2023-07-21T22:35:42.955312+0000","last_undegraded":"2023-07-21T22:35:42.955312+0000","last_fullsized":"2023-07-21T22:35:42.955312+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:21:24.007639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.472319+0000","last_change":"2023-07-21T22:35:41.467558+0000","last_active":"2023-07-21T22:35:42.472319+0000","last_peered":"2023-07-21T22:35:42.472319+0000","last_clean":"2023-07-21T22:35:42.472319+0000","last_became_active":"2023-07-21T22:35:41.466758+0000","last_became_peered":"2023-07-21T22:35:41.466758+0000","last_unstale":"2023-07-21T22:35:42.472319+0000","last_undegraded":"2023-07-21T22:35:42.472319+0000","last_fullsized":"2023-07-21T22:35:42.472319+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:13:07.984344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953927+0000","last_change":"2023-07-21T22:35:40.440675+0000","last_active":"2023-07-21T22:35:42.953927+0000","last_peered":"2023-07-21T22:35:42.953927+0000","last_clean":"2023-07-21T22:35:42.953927+0000","last_became_active":"2023-07-21T22:35:40.440191+0000","last_became_peered":"2023-07-21T22:35:40.440191+0000","last_unstale":"2023-07-21T22:35:42.953927+0000","last_undegraded":"2023-07-21T22:35:42.953927+0000","last_fullsized":"2023-07-21T22:35:42.953927+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:54:36.993745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.948938+0000","last_change":"2023-07-21T22:35:41.463918+0000","last_active":"2023-07-21T22:35:42.948938+0000","last_peered":"2023-07-21T22:35:42.948938+0000","last_clean":"2023-07-21T22:35:42.948938+0000","last_became_active":"2023-07-21T22:35:41.463644+0000","last_became_peered":"2023-07-21T22:35:41.463644+0000","last_unstale":"2023-07-21T22:35:42.948938+0000","last_undegraded":"2023-07-21T22:35:42.948938+0000","last_fullsized":"2023-07-21T22:35:42.948938+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:34:23.425712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467852+0000","last_change":"2023-07-21T22:35:40.438483+0000","last_active":"2023-07-21T22:35:42.467852+0000","last_peered":"2023-07-21T22:35:42.467852+0000","last_clean":"2023-07-21T22:35:42.467852+0000","last_became_active":"2023-07-21T22:35:40.438212+0000","last_became_peered":"2023-07-21T22:35:40.438212+0000","last_unstale":"2023-07-21T22:35:42.467852+0000","last_undegraded":"2023-07-21T22:35:42.467852+0000","last_fullsized":"2023-07-21T22:35:42.467852+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:44:28.111054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.465253+0000","last_change":"2023-07-21T22:35:41.475016+0000","last_active":"2023-07-21T22:35:42.465253+0000","last_peered":"2023-07-21T22:35:42.465253+0000","last_clean":"2023-07-21T22:35:42.465253+0000","last_became_active":"2023-07-21T22:35:41.474647+0000","last_became_peered":"2023-07-21T22:35:41.474647+0000","last_unstale":"2023-07-21T22:35:42.465253+0000","last_undegraded":"2023-07-21T22:35:42.465253+0000","last_fullsized":"2023-07-21T22:35:42.465253+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:07:48.378981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.471839+0000","last_change":"2023-07-21T22:35:40.431308+0000","last_active":"2023-07-21T22:35:42.471839+0000","last_peered":"2023-07-21T22:35:42.471839+0000","last_clean":"2023-07-21T22:35:42.471839+0000","last_became_active":"2023-07-21T22:35:40.430971+0000","last_became_peered":"2023-07-21T22:35:40.430971+0000","last_unstale":"2023-07-21T22:35:42.471839+0000","last_undegraded":"2023-07-21T22:35:42.471839+0000","last_fullsized":"2023-07-21T22:35:42.471839+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:46:17.011000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953271+0000","last_change":"2023-07-21T22:35:41.476366+0000","last_active":"2023-07-21T22:35:42.953271+0000","last_peered":"2023-07-21T22:35:42.953271+0000","last_clean":"2023-07-21T22:35:42.953271+0000","last_became_active":"2023-07-21T22:35:41.476015+0000","last_became_peered":"2023-07-21T22:35:41.476015+0000","last_unstale":"2023-07-21T22:35:42.953271+0000","last_undegraded":"2023-07-21T22:35:42.953271+0000","last_fullsized":"2023-07-21T22:35:42.953271+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:48:19.858384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953895+0000","last_change":"2023-07-21T22:35:40.440037+0000","last_active":"2023-07-21T22:35:42.953895+0000","last_peered":"2023-07-21T22:35:42.953895+0000","last_clean":"2023-07-21T22:35:42.953895+0000","last_became_active":"2023-07-21T22:35:40.439762+0000","last_became_peered":"2023-07-21T22:35:40.439762+0000","last_unstale":"2023-07-21T22:35:42.953895+0000","last_undegraded":"2023-07-21T22:35:42.953895+0000","last_fullsized":"2023-07-21T22:35:42.953895+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:13:38.859402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467774+0000","last_change":"2023-07-21T22:35:41.468021+0000","last_active":"2023-07-21T22:35:42.467774+0000","last_peered":"2023-07-21T22:35:42.467774+0000","last_clean":"2023-07-21T22:35:42.467774+0000","last_became_active":"2023-07-21T22:35:41.467688+0000","last_became_peered":"2023-07-21T22:35:41.467688+0000","last_unstale":"2023-07-21T22:35:42.467774+0000","last_undegraded":"2023-07-21T22:35:42.467774+0000","last_fullsized":"2023-07-21T22:35:42.467774+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:15:31.177179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953356+0000","last_change":"2023-07-21T22:35:40.434129+0000","last_active":"2023-07-21T22:35:42.953356+0000","last_peered":"2023-07-21T22:35:42.953356+0000","last_clean":"2023-07-21T22:35:42.953356+0000","last_became_active":"2023-07-21T22:35:40.433862+0000","last_became_peered":"2023-07-21T22:35:40.433862+0000","last_unstale":"2023-07-21T22:35:42.953356+0000","last_undegraded":"2023-07-21T22:35:42.953356+0000","last_fullsized":"2023-07-21T22:35:42.953356+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:03:04.087315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954393+0000","last_change":"2023-07-21T22:35:41.458041+0000","last_active":"2023-07-21T22:35:42.954393+0000","last_peered":"2023-07-21T22:35:42.954393+0000","last_clean":"2023-07-21T22:35:42.954393+0000","last_became_active":"2023-07-21T22:35:41.457747+0000","last_became_peered":"2023-07-21T22:35:41.457747+0000","last_unstale":"2023-07-21T22:35:42.954393+0000","last_undegraded":"2023-07-21T22:35:42.954393+0000","last_fullsized":"2023-07-21T22:35:42.954393+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:35:25.895334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.873002+0000","last_change":"2023-07-21T22:35:40.433064+0000","last_active":"2023-07-21T22:35:42.873002+0000","last_peered":"2023-07-21T22:35:42.873002+0000","last_clean":"2023-07-21T22:35:42.873002+0000","last_became_active":"2023-07-21T22:35:40.432727+0000","last_became_peered":"2023-07-21T22:35:40.432727+0000","last_unstale":"2023-07-21T22:35:42.873002+0000","last_undegraded":"2023-07-21T22:35:42.873002+0000","last_fullsized":"2023-07-21T22:35:42.873002+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:04:34.379766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"100'205","reported_seq":647,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953647+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:35:42.953647+0000","last_peered":"2023-07-21T22:35:42.953647+0000","last_clean":"2023-07-21T22:35:42.953647+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:35:42.953647+0000","last_undegraded":"2023-07-21T22:35:42.953647+0000","last_fullsized":"2023-07-21T22:35:42.953647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:32:54.385030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":193,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.471971+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:35:42.471971+0000","last_peered":"2023-07-21T22:35:42.471971+0000","last_clean":"2023-07-21T22:35:42.471971+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:35:42.471971+0000","last_undegraded":"2023-07-21T22:35:42.471971+0000","last_fullsized":"2023-07-21T22:35:42.471971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:47:43.572728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467658+0000","last_change":"2023-07-21T22:35:41.467320+0000","last_active":"2023-07-21T22:35:42.467658+0000","last_peered":"2023-07-21T22:35:42.467658+0000","last_clean":"2023-07-21T22:35:42.467658+0000","last_became_active":"2023-07-21T22:35:41.467032+0000","last_became_peered":"2023-07-21T22:35:41.467032+0000","last_unstale":"2023-07-21T22:35:42.467658+0000","last_undegraded":"2023-07-21T22:35:42.467658+0000","last_fullsized":"2023-07-21T22:35:42.467658+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:43:23.202718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"111'1","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953784+0000","last_change":"2023-07-21T22:35:40.433828+0000","last_active":"2023-07-21T22:35:42.953784+0000","last_peered":"2023-07-21T22:35:42.953784+0000","last_clean":"2023-07-21T22:35:42.953784+0000","last_became_active":"2023-07-21T22:35:40.433537+0000","last_became_peered":"2023-07-21T22:35:40.433537+0000","last_unstale":"2023-07-21T22:35:42.953784+0000","last_undegraded":"2023-07-21T22:35:42.953784+0000","last_fullsized":"2023-07-21T22:35:42.953784+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:21:03.809811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":179,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953536+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:35:42.953536+0000","last_peered":"2023-07-21T22:35:42.953536+0000","last_clean":"2023-07-21T22:35:42.953536+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:35:42.953536+0000","last_undegraded":"2023-07-21T22:35:42.953536+0000","last_fullsized":"2023-07-21T22:35:42.953536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:30:00.828713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954112+0000","last_change":"2023-07-21T22:35:41.464825+0000","last_active":"2023-07-21T22:35:42.954112+0000","last_peered":"2023-07-21T22:35:42.954112+0000","last_clean":"2023-07-21T22:35:42.954112+0000","last_became_active":"2023-07-21T22:35:41.464551+0000","last_became_peered":"2023-07-21T22:35:41.464551+0000","last_unstale":"2023-07-21T22:35:42.954112+0000","last_undegraded":"2023-07-21T22:35:42.954112+0000","last_fullsized":"2023-07-21T22:35:42.954112+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:28:59.443855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"111'2","reported_seq":15,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954372+0000","last_change":"2023-07-21T22:35:40.435800+0000","last_active":"2023-07-21T22:35:42.954372+0000","last_peered":"2023-07-21T22:35:42.954372+0000","last_clean":"2023-07-21T22:35:42.954372+0000","last_became_active":"2023-07-21T22:35:40.435483+0000","last_became_peered":"2023-07-21T22:35:40.435483+0000","last_unstale":"2023-07-21T22:35:42.954372+0000","last_undegraded":"2023-07-21T22:35:42.954372+0000","last_fullsized":"2023-07-21T22:35:42.954372+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:58:22.453072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":175,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.948877+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:35:42.948877+0000","last_peered":"2023-07-21T22:35:42.948877+0000","last_clean":"2023-07-21T22:35:42.948877+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:35:42.948877+0000","last_undegraded":"2023-07-21T22:35:42.948877+0000","last_fullsized":"2023-07-21T22:35:42.948877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:02:03.450122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954995+0000","last_change":"2023-07-21T22:35:41.460459+0000","last_active":"2023-07-21T22:35:42.954995+0000","last_peered":"2023-07-21T22:35:42.954995+0000","last_clean":"2023-07-21T22:35:42.954995+0000","last_became_active":"2023-07-21T22:35:41.460162+0000","last_became_peered":"2023-07-21T22:35:41.460162+0000","last_unstale":"2023-07-21T22:35:42.954995+0000","last_undegraded":"2023-07-21T22:35:42.954995+0000","last_fullsized":"2023-07-21T22:35:42.954995+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:55:02.174512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"111'1","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.955259+0000","last_change":"2023-07-21T22:35:40.438789+0000","last_active":"2023-07-21T22:35:42.955259+0000","last_peered":"2023-07-21T22:35:42.955259+0000","last_clean":"2023-07-21T22:35:42.955259+0000","last_became_active":"2023-07-21T22:35:40.438114+0000","last_became_peered":"2023-07-21T22:35:40.438114+0000","last_unstale":"2023-07-21T22:35:42.955259+0000","last_undegraded":"2023-07-21T22:35:42.955259+0000","last_fullsized":"2023-07-21T22:35:42.955259+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:46:11.103993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":193,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.471913+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:35:42.471913+0000","last_peered":"2023-07-21T22:35:42.471913+0000","last_clean":"2023-07-21T22:35:42.471913+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:35:42.471913+0000","last_undegraded":"2023-07-21T22:35:42.471913+0000","last_fullsized":"2023-07-21T22:35:42.471913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:57:36.163782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467507+0000","last_change":"2023-07-21T22:35:41.477278+0000","last_active":"2023-07-21T22:35:42.467507+0000","last_peered":"2023-07-21T22:35:42.467507+0000","last_clean":"2023-07-21T22:35:42.467507+0000","last_became_active":"2023-07-21T22:35:41.476949+0000","last_became_peered":"2023-07-21T22:35:41.476949+0000","last_unstale":"2023-07-21T22:35:42.467507+0000","last_undegraded":"2023-07-21T22:35:42.467507+0000","last_fullsized":"2023-07-21T22:35:42.467507+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:22:00.627643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"111'2","reported_seq":15,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.472083+0000","last_change":"2023-07-21T22:35:40.431423+0000","last_active":"2023-07-21T22:35:42.472083+0000","last_peered":"2023-07-21T22:35:42.472083+0000","last_clean":"2023-07-21T22:35:42.472083+0000","last_became_active":"2023-07-21T22:35:40.431123+0000","last_became_peered":"2023-07-21T22:35:40.431123+0000","last_unstale":"2023-07-21T22:35:42.472083+0000","last_undegraded":"2023-07-21T22:35:42.472083+0000","last_fullsized":"2023-07-21T22:35:42.472083+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:32.721785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":185,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872223+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:35:42.872223+0000","last_peered":"2023-07-21T22:35:42.872223+0000","last_clean":"2023-07-21T22:35:42.872223+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:35:42.872223+0000","last_undegraded":"2023-07-21T22:35:42.872223+0000","last_fullsized":"2023-07-21T22:35:42.872223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:26:01.978253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.471715+0000","last_change":"2023-07-21T22:35:41.463513+0000","last_active":"2023-07-21T22:35:42.471715+0000","last_peered":"2023-07-21T22:35:42.471715+0000","last_clean":"2023-07-21T22:35:42.471715+0000","last_became_active":"2023-07-21T22:35:41.463182+0000","last_became_peered":"2023-07-21T22:35:41.463182+0000","last_unstale":"2023-07-21T22:35:42.471715+0000","last_undegraded":"2023-07-21T22:35:42.471715+0000","last_fullsized":"2023-07-21T22:35:42.471715+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:57:01.740803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.949184+0000","last_change":"2023-07-21T22:35:40.429195+0000","last_active":"2023-07-21T22:35:42.949184+0000","last_peered":"2023-07-21T22:35:42.949184+0000","last_clean":"2023-07-21T22:35:42.949184+0000","last_became_active":"2023-07-21T22:35:40.428906+0000","last_became_peered":"2023-07-21T22:35:40.428906+0000","last_unstale":"2023-07-21T22:35:42.949184+0000","last_undegraded":"2023-07-21T22:35:42.949184+0000","last_fullsized":"2023-07-21T22:35:42.949184+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:51:03.334920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":179,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.952963+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:35:42.952963+0000","last_peered":"2023-07-21T22:35:42.952963+0000","last_clean":"2023-07-21T22:35:42.952963+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:35:42.952963+0000","last_undegraded":"2023-07-21T22:35:42.952963+0000","last_fullsized":"2023-07-21T22:35:42.952963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:09:41.428435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.471742+0000","last_change":"2023-07-21T22:35:41.475332+0000","last_active":"2023-07-21T22:35:42.471742+0000","last_peered":"2023-07-21T22:35:42.471742+0000","last_clean":"2023-07-21T22:35:42.471742+0000","last_became_active":"2023-07-21T22:35:41.474718+0000","last_became_peered":"2023-07-21T22:35:41.474718+0000","last_unstale":"2023-07-21T22:35:42.471742+0000","last_undegraded":"2023-07-21T22:35:42.471742+0000","last_fullsized":"2023-07-21T22:35:42.471742+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:12:03.341016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.472043+0000","last_change":"2023-07-21T22:35:40.436820+0000","last_active":"2023-07-21T22:35:42.472043+0000","last_peered":"2023-07-21T22:35:42.472043+0000","last_clean":"2023-07-21T22:35:42.472043+0000","last_became_active":"2023-07-21T22:35:40.436510+0000","last_became_peered":"2023-07-21T22:35:40.436510+0000","last_unstale":"2023-07-21T22:35:42.472043+0000","last_undegraded":"2023-07-21T22:35:42.472043+0000","last_fullsized":"2023-07-21T22:35:42.472043+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:44:53.151577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.873181+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:35:42.873181+0000","last_peered":"2023-07-21T22:35:42.873181+0000","last_clean":"2023-07-21T22:35:42.873181+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:35:42.873181+0000","last_undegraded":"2023-07-21T22:35:42.873181+0000","last_fullsized":"2023-07-21T22:35:42.873181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:13:41.408029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467663+0000","last_change":"2023-07-21T22:35:41.467434+0000","last_active":"2023-07-21T22:35:42.467663+0000","last_peered":"2023-07-21T22:35:42.467663+0000","last_clean":"2023-07-21T22:35:42.467663+0000","last_became_active":"2023-07-21T22:35:41.467122+0000","last_became_peered":"2023-07-21T22:35:41.467122+0000","last_unstale":"2023-07-21T22:35:42.467663+0000","last_undegraded":"2023-07-21T22:35:42.467663+0000","last_fullsized":"2023-07-21T22:35:42.467663+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:39:58.644099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.949017+0000","last_change":"2023-07-21T22:35:40.423934+0000","last_active":"2023-07-21T22:35:42.949017+0000","last_peered":"2023-07-21T22:35:42.949017+0000","last_clean":"2023-07-21T22:35:42.949017+0000","last_became_active":"2023-07-21T22:35:40.423649+0000","last_became_peered":"2023-07-21T22:35:40.423649+0000","last_unstale":"2023-07-21T22:35:42.949017+0000","last_undegraded":"2023-07-21T22:35:42.949017+0000","last_fullsized":"2023-07-21T22:35:42.949017+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:30:29.402485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":172,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954037+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:35:42.954037+0000","last_peered":"2023-07-21T22:35:42.954037+0000","last_clean":"2023-07-21T22:35:42.954037+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:35:42.954037+0000","last_undegraded":"2023-07-21T22:35:42.954037+0000","last_fullsized":"2023-07-21T22:35:42.954037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:05:05.855481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509646,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59212,"kb_used_data":1924,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312628,"statfs":{"total":96636764160,"available":96576131072,"internally_reserved":0,"allocated":1970176,"data_stored":1274858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73299999999999998,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.35299999999999998,"15min":0.32600000000000001},"max":{"1min":1.1180000000000001,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.36099999999999999},"max":{"1min":0.90900000000000003,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.67400000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.432,"15min":0.379},"max":{"1min":1.0509999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72399999999999998,"15min":0.74299999999999999},"min":{"1min":0.51300000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.405},"last":0.63},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72899999999999998,"15min":0.752},"min":{"1min":0.47999999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95699999999999996,"5min":1.409,"15min":1.409},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.504,"15min":0.42099999999999999},"max":{"1min":1.1539999999999999,"5min":1.46,"15min":1.46},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.02,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.72899999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55400000000000005,"15min":0.55900000000000005},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.89900000000000002,"5min":0.90500000000000003,"15min":0.94999999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90400000000000003,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64500000000000002,"15min":0.61799999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.56499999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.052,"5min":1.506,"15min":1.506},"last":0.502}]},{"osd":6,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.048},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.434,"15min":0.42599999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.48399999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542352,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1388544,"data_stored":686602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.73599999999999999,"15min":0.76100000000000001},"min":{"1min":0.495,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.97599999999999998,"5min":1.016,"15min":1.016},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77700000000000002,"15min":0.79300000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.437},"max":{"1min":0.94699999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.91400000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.41999999999999998},"max":{"1min":0.90500000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":1.028},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.94599999999999995,"5min":0.99399999999999999,"15min":1.117},"last":0.79400000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.72999999999999998,"15min":0.75},"min":{"1min":0.499,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.96299999999999997,"5min":0.98099999999999998,"15min":1.0269999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.0149999999999999,"5min":1.097,"15min":1.097},"last":0.92500000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.76100000000000001},"min":{"1min":0.57899999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92800000000000005,"5min":1.048,"15min":1.048},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72499999999999998,"15min":0.74099999999999999},"min":{"1min":0.505,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88600000000000001,"5min":1.0049999999999999,"15min":1.054},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60299999999999998,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.374,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.441,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.048},"last":0.55100000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89600000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.497},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.91900000000000004,"5min":0.98799999999999999,"15min":1.054},"last":0.51700000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68500000000000005,"15min":0.67700000000000005},"min":{"1min":0.498,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":0.95699999999999996,"5min":1.079,"15min":1.079},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.70099999999999996,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96499999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.53700000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509645,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1368064,"data_stored":684434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.70699999999999996,"15min":0.71299999999999997},"min":{"1min":0.436,"5min":0.35699999999999998,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.70799999999999996,"15min":0.72199999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83999999999999997,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.66400000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66800000000000004,"15min":0.71099999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90600000000000003,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.71099999999999997,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77900000000000003,"5min":1.617,"15min":1.617},"last":0.48199999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.70999999999999996,"15min":0.73499999999999999},"min":{"1min":0.45100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.99399999999999999,"5min":1.0109999999999999,"15min":1.034},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.71399999999999997,"15min":0.747},"min":{"1min":0.498,"5min":0.377,"15min":0.377},"max":{"1min":0.86399999999999999,"5min":1.512,"15min":1.512},"last":0.68700000000000006}]},{"osd":3,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.76100000000000001,"15min":0.78500000000000003},"min":{"1min":0.56299999999999994,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86199999999999999,"5min":1.472,"15min":1.472},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.59999999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.90800000000000003,"5min":1.556,"15min":1.556},"last":0.80900000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88900000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89200000000000002,"5min":1.012,"15min":1.038},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95499999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.622,"15min":0.60999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93799999999999994,"5min":1.02,"15min":1.02},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66100000000000003,"15min":0.65000000000000002},"min":{"1min":0.42399999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.91900000000000004,"5min":1.042,"15min":1.042},"last":0.749},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.57899999999999996,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.84499999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509646,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1344,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1376256,"data_stored":684594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71999999999999997,"15min":0.74299999999999999},"min":{"1min":0.51200000000000001,"5min":0.438,"15min":0.40000000000000002},"max":{"1min":0.80900000000000005,"5min":0.99399999999999999,"15min":1.0429999999999999},"last":0.62},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73299999999999998,"15min":0.74299999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.83599999999999997,"5min":0.96099999999999997,"15min":0.97599999999999998},"last":0.56799999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.39400000000000002},"max":{"1min":0.85499999999999998,"5min":1.002,"15min":1.0449999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.69399999999999995,"15min":0.69999999999999996},"min":{"1min":0.47299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.872,"5min":0.94299999999999995,"15min":1.016},"last":0.44800000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.51200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.95899999999999996,"5min":1.048,"15min":1.048},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.53000000000000003,"5min":0.41999999999999998,"15min":0.33000000000000002},"max":{"1min":1.006,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.502}]},{"osd":3,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72899999999999998,"15min":0.73699999999999999},"min":{"1min":0.51000000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94099999999999995,"5min":0.97999999999999998,"15min":1.026},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58399999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.53000000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.45100000000000001,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98899999999999999},"last":0.71599999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.38500000000000001},"max":{"1min":0.94699999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.57099999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.73099999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64400000000000002,"15min":0.65100000000000002},"min":{"1min":0.45500000000000002,"5min":0.39900000000000002,"15min":0.374},"max":{"1min":0.92100000000000004,"5min":1.0069999999999999,"15min":1.0429999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.135},"last":0.76800000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509645,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1368064,"data_stored":684434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.28599999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.55500000000000005,"5min":0.73099999999999998,"15min":0.76400000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.66300000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.54300000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.46899999999999997,"15min":0.47899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71799999999999997,"5min":0.754,"15min":0.83499999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.54600000000000004,"15min":0.55500000000000005},"min":{"1min":0.30199999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.82599999999999996,"15min":0.90100000000000002},"last":0.498}]},{"osd":2,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54800000000000004,"15min":0.56000000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.997,"5min":0.997,"15min":1.1140000000000001},"last":0.749},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.59099999999999997,"15min":0.59999999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69499999999999995,"5min":0.91800000000000004,"15min":0.99199999999999999},"last":0.72199999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0569999999999999,"5min":1.093,"15min":1.159},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.80200000000000005,"15min":0.82699999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0429999999999999,"5min":1.1459999999999999,"15min":1.3620000000000001},"last":0.65700000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.749,"15min":0.77600000000000002},"min":{"1min":0.501,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0029999999999999,"5min":1.0740000000000001,"15min":1.137},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.51300000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98199999999999998,"5min":1.048,"15min":1.2789999999999999},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.77400000000000002,"15min":0.79500000000000004},"min":{"1min":0.55700000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0289999999999999,"5min":1.056,"15min":1.3979999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.77500000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97099999999999997,"5min":1.1120000000000001,"15min":1.2450000000000001},"last":0.78600000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.79400000000000004,"15min":0.82499999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.024,"5min":1.087,"15min":1.335},"last":0.879},{"interface":"front","average":{"1min":0.745,"5min":0.81399999999999995,"15min":0.82999999999999996},"min":{"1min":0.57699999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.081,"5min":1.113,"15min":1.2130000000000001},"last":0.80400000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509647,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54528,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317312,"statfs":{"total":96636764160,"available":96580927488,"internally_reserved":0,"allocated":1368064,"data_stored":684434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45200000000000001,"15min":0.47099999999999997},"min":{"1min":0.27700000000000002,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.75,"5min":0.81200000000000006,"15min":0.94199999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.52400000000000002,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.84799999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.48799999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86699999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55800000000000005,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.012,"5min":1.085,"15min":1.085},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46999999999999997,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.30099999999999999,"15min":0.29699999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55000000000000004,"15min":0.56899999999999995},"min":{"1min":0.39300000000000002,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.77900000000000003,"15min":0.79600000000000004},"min":{"1min":0.49099999999999999,"5min":0.439,"15min":0.376},"max":{"1min":0.93500000000000005,"5min":1.2569999999999999,"15min":1.3420000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79200000000000004,"15min":0.80100000000000005},"min":{"1min":0.56000000000000005,"5min":0.501,"15min":0.432},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.58599999999999997,"5min":0.55800000000000005,"15min":0.496},"max":{"1min":0.93200000000000005,"5min":1.0600000000000001,"15min":1.1879999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80000000000000004,"15min":0.81100000000000005},"min":{"1min":0.54400000000000004,"5min":0.47299999999999998,"15min":0.46400000000000002},"max":{"1min":0.97599999999999998,"5min":1.171,"15min":1.3089999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.502,"5min":0.45500000000000002,"15min":0.40300000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.79700000000000004,"15min":0.81200000000000006},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.45600000000000002},"max":{"1min":0.88400000000000001,"5min":1.23,"15min":1.2649999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79900000000000004,"15min":0.82399999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.49099999999999999},"max":{"1min":0.90000000000000002,"5min":1.2,"15min":1.2909999999999999},"last":0.755},{"interface":"front","average":{"1min":0.75,"5min":0.79900000000000004,"15min":0.81599999999999995},"min":{"1min":0.57599999999999996,"5min":0.5,"15min":0.44700000000000001},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.65000000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509646,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1372160,"data_stored":684504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.28299999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53500000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.626,"5min":0.872,"15min":0.872},"last":0.55800000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.5,"15min":0.50700000000000001},"min":{"1min":0.33700000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63200000000000001,"5min":0.76100000000000001,"15min":0.81000000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.29099999999999998},"max":{"1min":0.78900000000000003,"5min":0.83599999999999997,"15min":0.88800000000000001},"last":0.51500000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.57599999999999996,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35799999999999998,"15min":0.33400000000000002},"max":{"1min":0.70799999999999996,"5min":0.84299999999999997,"15min":0.98899999999999999},"last":0.624},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.505,"15min":0.51700000000000002},"min":{"1min":0.33100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.64200000000000002,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.54200000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.748,"15min":0.77000000000000002},"min":{"1min":0.53100000000000003,"5min":0.432,"15min":0.432},"max":{"1min":0.91400000000000003,"5min":1.0860000000000001,"15min":1.234},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.57499999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.014,"5min":1.083,"15min":1.155},"last":0.877}]},{"osd":5,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75600000000000001,"15min":0.77800000000000002},"min":{"1min":0.53500000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92500000000000004,"5min":1.0609999999999999,"15min":1.1919999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78500000000000003,"15min":0.80000000000000004},"min":{"1min":0.55200000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.044,"5min":1.121,"15min":1.2849999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78600000000000003,"15min":0.81000000000000005},"min":{"1min":0.57199999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0229999999999999,"5min":1.0580000000000001,"15min":1.23},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76300000000000001,"15min":0.79000000000000004},"min":{"1min":0.50900000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0449999999999999,"5min":1.1020000000000001,"15min":1.3240000000000001},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78600000000000003,"15min":0.80900000000000005},"min":{"1min":0.58599999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.99299999999999999,"5min":1.103,"15min":1.3149999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79000000000000004,"15min":0.80800000000000005},"min":{"1min":0.55500000000000005,"5min":0.52600000000000002,"15min":0.45700000000000002},"max":{"1min":0.97499999999999998,"5min":1.115,"15min":1.3380000000000001},"last":0.89800000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509648,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37084,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334756,"statfs":{"total":96636764160,"available":96598790144,"internally_reserved":0,"allocated":1986560,"data_stored":1277072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.47399999999999998,"15min":0.47099999999999997},"min":{"1min":0.28399999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.64700000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.499,"15min":0.51300000000000001},"min":{"1min":0.374,"5min":0.247,"15min":0.247},"max":{"1min":0.63100000000000001,"5min":0.76200000000000001,"15min":0.79400000000000004},"last":0.51400000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71499999999999997,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51200000000000001,"15min":0.51700000000000002},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67000000000000004,"5min":0.871,"15min":0.871},"last":0.48799999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70899999999999996,"5min":0.84499999999999997,"15min":0.91300000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67700000000000005,"5min":1.038,"15min":1.038},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.754,"15min":0.77800000000000002},"min":{"1min":0.58099999999999996,"5min":0.46200000000000002,"15min":0.45200000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.321},"last":1.016},{"interface":"front","average":{"1min":0.749,"5min":0.78400000000000003,"15min":0.79800000000000004},"min":{"1min":0.55600000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.423},"last":0.95299999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76300000000000001,"15min":0.78100000000000003},"min":{"1min":0.55600000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.036,"5min":1.107,"15min":1.28},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77600000000000002,"15min":0.80700000000000005},"min":{"1min":0.57699999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.24,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.0720000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76800000000000002,"15min":0.81200000000000006},"min":{"1min":0.53800000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.81699999999999995},"min":{"1min":0.60699999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0169999999999999,"5min":1.147,"15min":1.333},"last":0.98099999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78600000000000003,"15min":0.79800000000000004},"min":{"1min":0.54300000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.042,"5min":1.159,"15min":1.2310000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.79100000000000004,"15min":0.82899999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0609999999999999,"5min":1.1930000000000001,"15min":1.369},"last":1.05}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:35:50.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:35:50.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.666+0000 7fd5248bc640 1 Processor -- start 2023-07-21T22:35:50.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.666+0000 7fd5248bc640 1 -- start start 2023-07-21T22:35:50.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.666+0000 7fd5248bc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd520158680 0x7fd5200af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:50.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.666+0000 7fd5248bc640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd5200afdf0 0x7fd52006fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:50.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.666+0000 7fd5248bc640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd520158a50 con 0x7fd52006ffb0 2023-07-21T22:35:50.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.666+0000 7fd5248bc640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5201599b0 con 0x7fd5200afdf0 2023-07-21T22:35:50.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.666+0000 7fd5248bc640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52015d170 con 0x7fd520158680 2023-07-21T22:35:50.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.666+0000 7fd51effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd5200afdf0 0x7fd52006fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:50.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.666+0000 7fd51effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd5200afdf0 0x7fd52006fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34252/0 (socket says 172.21.15.6:34252) 2023-07-21T22:35:50.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.666+0000 7fd51effd640 1 -- 172.21.15.6:0/2431095198 learned_addr learned my addr 172.21.15.6:0/2431095198 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:50.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.666+0000 7fd51f7fe640 1 --2- 172.21.15.6:0/2431095198 >> v2:172.21.15.161:3300/0 conn(0x7fd520158680 0x7fd5200af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:50.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.666+0000 7fd51effd640 1 -- 172.21.15.6:0/2431095198 >> v2:172.21.15.161:3300/0 conn(0x7fd520158680 msgr2=0x7fd5200af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:50.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.666+0000 7fd51effd640 1 --2- 172.21.15.6:0/2431095198 >> v2:172.21.15.161:3300/0 conn(0x7fd520158680 0x7fd5200af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:50.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.666+0000 7fd51effd640 1 -- 172.21.15.6:0/2431095198 >> v1:172.21.15.6:6789/0 conn(0x7fd52006ffb0 legacy=0x7fd5200ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:50.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.666+0000 7fd51effd640 1 -- 172.21.15.6:0/2431095198 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd520158d30 con 0x7fd5200afdf0 2023-07-21T22:35:50.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.670+0000 7fd51effd640 1 --2- 172.21.15.6:0/2431095198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5200afdf0 0x7fd52006fa70 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fd5200cdd90 tx=0x7fd51401e710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5916c89669683ae server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:50.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.670+0000 7fd51e7fc640 1 -- 172.21.15.6:0/2431095198 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5140aa630 con 0x7fd5200afdf0 2023-07-21T22:35:50.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.670+0000 7fd51e7fc640 1 -- 172.21.15.6:0/2431095198 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5140aa790 con 0x7fd5200afdf0 2023-07-21T22:35:50.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.670+0000 7fd51e7fc640 1 -- 172.21.15.6:0/2431095198 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5140aab20 con 0x7fd5200afdf0 2023-07-21T22:35:50.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.670+0000 7fd5248bc640 1 -- 172.21.15.6:0/2431095198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5200afdf0 msgr2=0x7fd52006fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:50.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.670+0000 7fd5248bc640 1 --2- 172.21.15.6:0/2431095198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5200afdf0 0x7fd52006fa70 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fd5200cdd90 tx=0x7fd51401e710 comp rx=0 tx=0).stop 2023-07-21T22:35:50.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.670+0000 7fd5248bc640 1 -- 172.21.15.6:0/2431095198 shutdown_connections 2023-07-21T22:35:50.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.670+0000 7fd5248bc640 1 --2- 172.21.15.6:0/2431095198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5200afdf0 0x7fd52006fa70 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:50.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.670+0000 7fd5248bc640 1 --2- 172.21.15.6:0/2431095198 >> v2:172.21.15.161:3300/0 conn(0x7fd520158680 0x7fd5200af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:50.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.670+0000 7fd5248bc640 1 -- 172.21.15.6:0/2431095198 >> 172.21.15.6:0/2431095198 conn(0x7fd5200ca8b0 msgr2=0x7fd5200cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:50.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.670+0000 7fd5248bc640 1 -- 172.21.15.6:0/2431095198 shutdown_connections 2023-07-21T22:35:50.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.670+0000 7fd5248bc640 1 -- 172.21.15.6:0/2431095198 wait complete. 2023-07-21T22:35:50.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.670+0000 7fd5248bc640 1 Processor -- start 2023-07-21T22:35:50.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd5248bc640 1 -- start start 2023-07-21T22:35:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd5248bc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52006ffb0 0x7fd5200b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd5248bc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5200afdf0 0x7fd520155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd5248bc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd520158680 0x7fd5200c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd5248bc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd520156750 con 0x7fd52006ffb0 2023-07-21T22:35:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd5248bc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5200b2360 con 0x7fd5200afdf0 2023-07-21T22:35:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd5248bc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5200b20c0 con 0x7fd520158680 2023-07-21T22:35:50.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd51f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52006ffb0 0x7fd5200b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:50.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd51f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52006ffb0 0x7fd5200b1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34264/0 (socket says 172.21.15.6:34264) 2023-07-21T22:35:50.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd51f7fe640 1 -- 172.21.15.6:0/3946980819 learned_addr learned my addr 172.21.15.6:0/3946980819 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:50.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd51effd640 1 --2- 172.21.15.6:0/3946980819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5200afdf0 0x7fd520155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:50.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd51ffff640 1 --2- 172.21.15.6:0/3946980819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd520158680 0x7fd5200c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:50.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd51f7fe640 1 -- 172.21.15.6:0/3946980819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd520158680 msgr2=0x7fd5200c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:50.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd51f7fe640 1 --2- 172.21.15.6:0/3946980819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd520158680 0x7fd5200c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:50.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd51f7fe640 1 -- 172.21.15.6:0/3946980819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5200afdf0 msgr2=0x7fd520155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:50.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd51f7fe640 1 --2- 172.21.15.6:0/3946980819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5200afdf0 0x7fd520155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:50.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd51f7fe640 1 -- 172.21.15.6:0/3946980819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5140094d0 con 0x7fd52006ffb0 2023-07-21T22:35:50.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd51ffff640 1 --2- 172.21.15.6:0/3946980819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd520158680 0x7fd5200c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:50.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd51f7fe640 1 --2- 172.21.15.6:0/3946980819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52006ffb0 0x7fd5200b1b80 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fd51000d5f0 tx=0x7fd51000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:50.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd507fff640 1 -- 172.21.15.6:0/3946980819 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5100125f0 con 0x7fd52006ffb0 2023-07-21T22:35:50.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd507fff640 1 -- 172.21.15.6:0/3946980819 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd510012750 con 0x7fd52006ffb0 2023-07-21T22:35:50.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd507fff640 1 -- 172.21.15.6:0/3946980819 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510012ae0 con 0x7fd52006ffb0 2023-07-21T22:35:50.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd5248bc640 1 -- 172.21.15.6:0/3946980819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd520155db0 con 0x7fd52006ffb0 2023-07-21T22:35:50.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd5248bc640 1 -- 172.21.15.6:0/3946980819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd520156370 con 0x7fd52006ffb0 2023-07-21T22:35:50.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.674+0000 7fd5248bc640 1 -- 172.21.15.6:0/3946980819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5200678d0 con 0x7fd52006ffb0 2023-07-21T22:35:50.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.678+0000 7fd507fff640 1 -- 172.21.15.6:0/3946980819 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd510012c40 con 0x7fd52006ffb0 2023-07-21T22:35:50.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.678+0000 7fd507fff640 1 --2- 172.21.15.6:0/3946980819 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fd50c0663a0 0x7fd50c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:50.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.678+0000 7fd507fff640 1 -- 172.21.15.6:0/3946980819 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fd5100843b0 con 0x7fd52006ffb0 2023-07-21T22:35:50.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.678+0000 7fd51effd640 1 --2- 172.21.15.6:0/3946980819 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fd50c0663a0 0x7fd50c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:50.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.678+0000 7fd51effd640 1 --2- 172.21.15.6:0/3946980819 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fd50c0663a0 0x7fd50c068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd5140b1000 tx=0x7fd514008040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:50.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.682+0000 7fd507fff640 1 -- 172.21.15.6:0/3946980819 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd5100516e0 con 0x7fd52006ffb0 2023-07-21T22:35:50.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.834+0000 7fd5248bc640 1 -- 172.21.15.6:0/3946980819 --> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd5201595d0 con 0x7fd50c0663a0 2023-07-21T22:35:50.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.846+0000 7fd507fff640 1 -- 172.21.15.6:0/3946980819 <== mgr.7255 v2:172.21.15.161:6832/3891612664 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311273 (secure 0 0 0) 0x7fd5140aa610 con 0x7fd50c0663a0 2023-07-21T22:35:50.895 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:50.896 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:35:50.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.846+0000 7fd5248bc640 1 -- 172.21.15.6:0/3946980819 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fd50c0663a0 msgr2=0x7fd50c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:50.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.846+0000 7fd5248bc640 1 --2- 172.21.15.6:0/3946980819 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fd50c0663a0 0x7fd50c068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd5140b1000 tx=0x7fd514008040 comp rx=0 tx=0).stop 2023-07-21T22:35:50.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.846+0000 7fd5248bc640 1 -- 172.21.15.6:0/3946980819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52006ffb0 msgr2=0x7fd5200b1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:50.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.846+0000 7fd5248bc640 1 --2- 172.21.15.6:0/3946980819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52006ffb0 0x7fd5200b1b80 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fd51000d5f0 tx=0x7fd51000dab0 comp rx=0 tx=0).stop 2023-07-21T22:35:50.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.846+0000 7fd5248bc640 1 -- 172.21.15.6:0/3946980819 shutdown_connections 2023-07-21T22:35:50.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.846+0000 7fd5248bc640 1 --2- 172.21.15.6:0/3946980819 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fd50c0663a0 0x7fd50c068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:50.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.846+0000 7fd5248bc640 1 --2- 172.21.15.6:0/3946980819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd520158680 0x7fd5200c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:50.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.846+0000 7fd5248bc640 1 --2- 172.21.15.6:0/3946980819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5200afdf0 0x7fd520155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:50.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.846+0000 7fd5248bc640 1 --2- 172.21.15.6:0/3946980819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd52006ffb0 0x7fd5200b1b80 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:50.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.846+0000 7fd5248bc640 1 -- 172.21.15.6:0/3946980819 >> 172.21.15.6:0/3946980819 conn(0x7fd5200ca8b0 msgr2=0x7fd520159ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:50.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.846+0000 7fd5248bc640 1 -- 172.21.15.6:0/3946980819 shutdown_connections 2023-07-21T22:35:50.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:50.846+0000 7fd5248bc640 1 -- 172.21.15.6:0/3946980819 wait complete. 2023-07-21T22:35:50.916 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-21T22:35:49.026700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":364,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":244,"ondisk_log_size":244,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":192,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":312776,"kb_used_data":11912,"kb_used_omap":0,"kb_used_meta":300800,"kb_avail":754661944,"statfs":{"total":773094113280,"available":772773830656,"internally_reserved":0,"allocated":12197888,"data_stored":6660932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308019200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002095"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.465552+0000","last_change":"2023-07-21T22:35:41.466677+0000","last_active":"2023-07-21T22:35:42.465552+0000","last_peered":"2023-07-21T22:35:42.465552+0000","last_clean":"2023-07-21T22:35:42.465552+0000","last_became_active":"2023-07-21T22:35:41.466393+0000","last_became_peered":"2023-07-21T22:35:41.466393+0000","last_unstale":"2023-07-21T22:35:42.465552+0000","last_undegraded":"2023-07-21T22:35:42.465552+0000","last_fullsized":"2023-07-21T22:35:42.465552+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:45:59.155712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.472173+0000","last_change":"2023-07-21T22:35:41.463051+0000","last_active":"2023-07-21T22:35:42.472173+0000","last_peered":"2023-07-21T22:35:42.472173+0000","last_clean":"2023-07-21T22:35:42.472173+0000","last_became_active":"2023-07-21T22:35:41.462688+0000","last_became_peered":"2023-07-21T22:35:41.462688+0000","last_unstale":"2023-07-21T22:35:42.472173+0000","last_undegraded":"2023-07-21T22:35:42.472173+0000","last_fullsized":"2023-07-21T22:35:42.472173+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:30.649299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.465652+0000","last_change":"2023-07-21T22:35:41.463299+0000","last_active":"2023-07-21T22:35:42.465652+0000","last_peered":"2023-07-21T22:35:42.465652+0000","last_clean":"2023-07-21T22:35:42.465652+0000","last_became_active":"2023-07-21T22:35:41.463005+0000","last_became_peered":"2023-07-21T22:35:41.463005+0000","last_unstale":"2023-07-21T22:35:42.465652+0000","last_undegraded":"2023-07-21T22:35:42.465652+0000","last_fullsized":"2023-07-21T22:35:42.465652+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:06:03.106663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872886+0000","last_change":"2023-07-21T22:35:41.466791+0000","last_active":"2023-07-21T22:35:42.872886+0000","last_peered":"2023-07-21T22:35:42.872886+0000","last_clean":"2023-07-21T22:35:42.872886+0000","last_became_active":"2023-07-21T22:35:41.466126+0000","last_became_peered":"2023-07-21T22:35:41.466126+0000","last_unstale":"2023-07-21T22:35:42.872886+0000","last_undegraded":"2023-07-21T22:35:42.872886+0000","last_fullsized":"2023-07-21T22:35:42.872886+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:09:24.563717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954584+0000","last_change":"2023-07-21T22:35:41.465944+0000","last_active":"2023-07-21T22:35:42.954584+0000","last_peered":"2023-07-21T22:35:42.954584+0000","last_clean":"2023-07-21T22:35:42.954584+0000","last_became_active":"2023-07-21T22:35:41.465644+0000","last_became_peered":"2023-07-21T22:35:41.465644+0000","last_unstale":"2023-07-21T22:35:42.954584+0000","last_undegraded":"2023-07-21T22:35:42.954584+0000","last_fullsized":"2023-07-21T22:35:42.954584+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:27.726155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467549+0000","last_change":"2023-07-21T22:35:41.476760+0000","last_active":"2023-07-21T22:35:42.467549+0000","last_peered":"2023-07-21T22:35:42.467549+0000","last_clean":"2023-07-21T22:35:42.467549+0000","last_became_active":"2023-07-21T22:35:41.476482+0000","last_became_peered":"2023-07-21T22:35:41.476482+0000","last_unstale":"2023-07-21T22:35:42.467549+0000","last_undegraded":"2023-07-21T22:35:42.467549+0000","last_fullsized":"2023-07-21T22:35:42.467549+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:57:55.500168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953850+0000","last_change":"2023-07-21T22:35:41.463326+0000","last_active":"2023-07-21T22:35:42.953850+0000","last_peered":"2023-07-21T22:35:42.953850+0000","last_clean":"2023-07-21T22:35:42.953850+0000","last_became_active":"2023-07-21T22:35:41.462991+0000","last_became_peered":"2023-07-21T22:35:41.462991+0000","last_unstale":"2023-07-21T22:35:42.953850+0000","last_undegraded":"2023-07-21T22:35:42.953850+0000","last_fullsized":"2023-07-21T22:35:42.953850+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:55:29.220670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872594+0000","last_change":"2023-07-21T22:35:41.457594+0000","last_active":"2023-07-21T22:35:42.872594+0000","last_peered":"2023-07-21T22:35:42.872594+0000","last_clean":"2023-07-21T22:35:42.872594+0000","last_became_active":"2023-07-21T22:35:41.457103+0000","last_became_peered":"2023-07-21T22:35:41.457103+0000","last_unstale":"2023-07-21T22:35:42.872594+0000","last_undegraded":"2023-07-21T22:35:42.872594+0000","last_fullsized":"2023-07-21T22:35:42.872594+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:00:35.849238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.955087+0000","last_change":"2023-07-21T22:35:41.466440+0000","last_active":"2023-07-21T22:35:42.955087+0000","last_peered":"2023-07-21T22:35:42.955087+0000","last_clean":"2023-07-21T22:35:42.955087+0000","last_became_active":"2023-07-21T22:35:41.466114+0000","last_became_peered":"2023-07-21T22:35:41.466114+0000","last_unstale":"2023-07-21T22:35:42.955087+0000","last_undegraded":"2023-07-21T22:35:42.955087+0000","last_fullsized":"2023-07-21T22:35:42.955087+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:36:39.592689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.949364+0000","last_change":"2023-07-21T22:35:41.470569+0000","last_active":"2023-07-21T22:35:42.949364+0000","last_peered":"2023-07-21T22:35:42.949364+0000","last_clean":"2023-07-21T22:35:42.949364+0000","last_became_active":"2023-07-21T22:35:41.470301+0000","last_became_peered":"2023-07-21T22:35:41.470301+0000","last_unstale":"2023-07-21T22:35:42.949364+0000","last_undegraded":"2023-07-21T22:35:42.949364+0000","last_fullsized":"2023-07-21T22:35:42.949364+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:49:31.728512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.955002+0000","last_change":"2023-07-21T22:35:41.466758+0000","last_active":"2023-07-21T22:35:42.955002+0000","last_peered":"2023-07-21T22:35:42.955002+0000","last_clean":"2023-07-21T22:35:42.955002+0000","last_became_active":"2023-07-21T22:35:41.466494+0000","last_became_peered":"2023-07-21T22:35:41.466494+0000","last_unstale":"2023-07-21T22:35:42.955002+0000","last_undegraded":"2023-07-21T22:35:42.955002+0000","last_fullsized":"2023-07-21T22:35:42.955002+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:47:42.504007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.949189+0000","last_change":"2023-07-21T22:35:41.456368+0000","last_active":"2023-07-21T22:35:42.949189+0000","last_peered":"2023-07-21T22:35:42.949189+0000","last_clean":"2023-07-21T22:35:42.949189+0000","last_became_active":"2023-07-21T22:35:41.456086+0000","last_became_peered":"2023-07-21T22:35:41.456086+0000","last_unstale":"2023-07-21T22:35:42.949189+0000","last_undegraded":"2023-07-21T22:35:42.949189+0000","last_fullsized":"2023-07-21T22:35:42.949189+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:12:06.856071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872736+0000","last_change":"2023-07-21T22:35:41.464270+0000","last_active":"2023-07-21T22:35:42.872736+0000","last_peered":"2023-07-21T22:35:42.872736+0000","last_clean":"2023-07-21T22:35:42.872736+0000","last_became_active":"2023-07-21T22:35:41.463975+0000","last_became_peered":"2023-07-21T22:35:41.463975+0000","last_unstale":"2023-07-21T22:35:42.872736+0000","last_undegraded":"2023-07-21T22:35:42.872736+0000","last_fullsized":"2023-07-21T22:35:42.872736+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:22:12.669206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954326+0000","last_change":"2023-07-21T22:35:41.472511+0000","last_active":"2023-07-21T22:35:42.954326+0000","last_peered":"2023-07-21T22:35:42.954326+0000","last_clean":"2023-07-21T22:35:42.954326+0000","last_became_active":"2023-07-21T22:35:41.472197+0000","last_became_peered":"2023-07-21T22:35:41.472197+0000","last_unstale":"2023-07-21T22:35:42.954326+0000","last_undegraded":"2023-07-21T22:35:42.954326+0000","last_fullsized":"2023-07-21T22:35:42.954326+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:27:40.739453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872463+0000","last_change":"2023-07-21T22:35:41.459679+0000","last_active":"2023-07-21T22:35:42.872463+0000","last_peered":"2023-07-21T22:35:42.872463+0000","last_clean":"2023-07-21T22:35:42.872463+0000","last_became_active":"2023-07-21T22:35:41.459391+0000","last_became_peered":"2023-07-21T22:35:41.459391+0000","last_unstale":"2023-07-21T22:35:42.872463+0000","last_undegraded":"2023-07-21T22:35:42.872463+0000","last_fullsized":"2023-07-21T22:35:42.872463+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:47:23.365483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467357+0000","last_change":"2023-07-21T22:35:41.466239+0000","last_active":"2023-07-21T22:35:42.467357+0000","last_peered":"2023-07-21T22:35:42.467357+0000","last_clean":"2023-07-21T22:35:42.467357+0000","last_became_active":"2023-07-21T22:35:41.465937+0000","last_became_peered":"2023-07-21T22:35:41.465937+0000","last_unstale":"2023-07-21T22:35:42.467357+0000","last_undegraded":"2023-07-21T22:35:42.467357+0000","last_fullsized":"2023-07-21T22:35:42.467357+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:10:02.774571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467793+0000","last_change":"2023-07-21T22:35:41.466413+0000","last_active":"2023-07-21T22:35:42.467793+0000","last_peered":"2023-07-21T22:35:42.467793+0000","last_clean":"2023-07-21T22:35:42.467793+0000","last_became_active":"2023-07-21T22:35:41.466135+0000","last_became_peered":"2023-07-21T22:35:41.466135+0000","last_unstale":"2023-07-21T22:35:42.467793+0000","last_undegraded":"2023-07-21T22:35:42.467793+0000","last_fullsized":"2023-07-21T22:35:42.467793+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:21:04.275466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.465786+0000","last_change":"2023-07-21T22:35:41.462528+0000","last_active":"2023-07-21T22:35:42.465786+0000","last_peered":"2023-07-21T22:35:42.465786+0000","last_clean":"2023-07-21T22:35:42.465786+0000","last_became_active":"2023-07-21T22:35:41.462150+0000","last_became_peered":"2023-07-21T22:35:41.462150+0000","last_unstale":"2023-07-21T22:35:42.465786+0000","last_undegraded":"2023-07-21T22:35:42.465786+0000","last_fullsized":"2023-07-21T22:35:42.465786+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:22:02.513995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.955031+0000","last_change":"2023-07-21T22:35:41.476357+0000","last_active":"2023-07-21T22:35:42.955031+0000","last_peered":"2023-07-21T22:35:42.955031+0000","last_clean":"2023-07-21T22:35:42.955031+0000","last_became_active":"2023-07-21T22:35:41.476085+0000","last_became_peered":"2023-07-21T22:35:41.476085+0000","last_unstale":"2023-07-21T22:35:42.955031+0000","last_undegraded":"2023-07-21T22:35:42.955031+0000","last_fullsized":"2023-07-21T22:35:42.955031+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:19:57.755916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872924+0000","last_change":"2023-07-21T22:35:41.466615+0000","last_active":"2023-07-21T22:35:42.872924+0000","last_peered":"2023-07-21T22:35:42.872924+0000","last_clean":"2023-07-21T22:35:42.872924+0000","last_became_active":"2023-07-21T22:35:41.465762+0000","last_became_peered":"2023-07-21T22:35:41.465762+0000","last_unstale":"2023-07-21T22:35:42.872924+0000","last_undegraded":"2023-07-21T22:35:42.872924+0000","last_fullsized":"2023-07-21T22:35:42.872924+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:37:59.242334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954714+0000","last_change":"2023-07-21T22:35:41.461130+0000","last_active":"2023-07-21T22:35:42.954714+0000","last_peered":"2023-07-21T22:35:42.954714+0000","last_clean":"2023-07-21T22:35:42.954714+0000","last_became_active":"2023-07-21T22:35:41.460847+0000","last_became_peered":"2023-07-21T22:35:41.460847+0000","last_unstale":"2023-07-21T22:35:42.954714+0000","last_undegraded":"2023-07-21T22:35:42.954714+0000","last_fullsized":"2023-07-21T22:35:42.954714+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:37:04.091671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954364+0000","last_change":"2023-07-21T22:35:41.472837+0000","last_active":"2023-07-21T22:35:42.954364+0000","last_peered":"2023-07-21T22:35:42.954364+0000","last_clean":"2023-07-21T22:35:42.954364+0000","last_became_active":"2023-07-21T22:35:41.472337+0000","last_became_peered":"2023-07-21T22:35:41.472337+0000","last_unstale":"2023-07-21T22:35:42.954364+0000","last_undegraded":"2023-07-21T22:35:42.954364+0000","last_fullsized":"2023-07-21T22:35:42.954364+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:08:20.635175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953646+0000","last_change":"2023-07-21T22:35:41.476478+0000","last_active":"2023-07-21T22:35:42.953646+0000","last_peered":"2023-07-21T22:35:42.953646+0000","last_clean":"2023-07-21T22:35:42.953646+0000","last_became_active":"2023-07-21T22:35:41.476119+0000","last_became_peered":"2023-07-21T22:35:41.476119+0000","last_unstale":"2023-07-21T22:35:42.953646+0000","last_undegraded":"2023-07-21T22:35:42.953646+0000","last_fullsized":"2023-07-21T22:35:42.953646+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:53:03.772914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.465366+0000","last_change":"2023-07-21T22:35:41.463337+0000","last_active":"2023-07-21T22:35:42.465366+0000","last_peered":"2023-07-21T22:35:42.465366+0000","last_clean":"2023-07-21T22:35:42.465366+0000","last_became_active":"2023-07-21T22:35:41.463039+0000","last_became_peered":"2023-07-21T22:35:41.463039+0000","last_unstale":"2023-07-21T22:35:42.465366+0000","last_undegraded":"2023-07-21T22:35:42.465366+0000","last_fullsized":"2023-07-21T22:35:42.465366+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:05:06.262181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.472325+0000","last_change":"2023-07-21T22:35:41.461770+0000","last_active":"2023-07-21T22:35:42.472325+0000","last_peered":"2023-07-21T22:35:42.472325+0000","last_clean":"2023-07-21T22:35:42.472325+0000","last_became_active":"2023-07-21T22:35:41.461384+0000","last_became_peered":"2023-07-21T22:35:41.461384+0000","last_unstale":"2023-07-21T22:35:42.472325+0000","last_undegraded":"2023-07-21T22:35:42.472325+0000","last_fullsized":"2023-07-21T22:35:42.472325+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:18:12.178988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954940+0000","last_change":"2023-07-21T22:35:41.472750+0000","last_active":"2023-07-21T22:35:42.954940+0000","last_peered":"2023-07-21T22:35:42.954940+0000","last_clean":"2023-07-21T22:35:42.954940+0000","last_became_active":"2023-07-21T22:35:41.472406+0000","last_became_peered":"2023-07-21T22:35:41.472406+0000","last_unstale":"2023-07-21T22:35:42.954940+0000","last_undegraded":"2023-07-21T22:35:42.954940+0000","last_fullsized":"2023-07-21T22:35:42.954940+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:48.333557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.949236+0000","last_change":"2023-07-21T22:35:41.459186+0000","last_active":"2023-07-21T22:35:42.949236+0000","last_peered":"2023-07-21T22:35:42.949236+0000","last_clean":"2023-07-21T22:35:42.949236+0000","last_became_active":"2023-07-21T22:35:41.458281+0000","last_became_peered":"2023-07-21T22:35:41.458281+0000","last_unstale":"2023-07-21T22:35:42.949236+0000","last_undegraded":"2023-07-21T22:35:42.949236+0000","last_fullsized":"2023-07-21T22:35:42.949236+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:58:35.114645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.873018+0000","last_change":"2023-07-21T22:35:41.466437+0000","last_active":"2023-07-21T22:35:42.873018+0000","last_peered":"2023-07-21T22:35:42.873018+0000","last_clean":"2023-07-21T22:35:42.873018+0000","last_became_active":"2023-07-21T22:35:41.465398+0000","last_became_peered":"2023-07-21T22:35:41.465398+0000","last_unstale":"2023-07-21T22:35:42.873018+0000","last_undegraded":"2023-07-21T22:35:42.873018+0000","last_fullsized":"2023-07-21T22:35:42.873018+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:43:20.215798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954125+0000","last_change":"2023-07-21T22:35:41.452205+0000","last_active":"2023-07-21T22:35:42.954125+0000","last_peered":"2023-07-21T22:35:42.954125+0000","last_clean":"2023-07-21T22:35:42.954125+0000","last_became_active":"2023-07-21T22:35:41.451870+0000","last_became_peered":"2023-07-21T22:35:41.451870+0000","last_unstale":"2023-07-21T22:35:42.954125+0000","last_undegraded":"2023-07-21T22:35:42.954125+0000","last_fullsized":"2023-07-21T22:35:42.954125+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:12.666956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954490+0000","last_change":"2023-07-21T22:35:41.464387+0000","last_active":"2023-07-21T22:35:42.954490+0000","last_peered":"2023-07-21T22:35:42.954490+0000","last_clean":"2023-07-21T22:35:42.954490+0000","last_became_active":"2023-07-21T22:35:41.464083+0000","last_became_peered":"2023-07-21T22:35:41.464083+0000","last_unstale":"2023-07-21T22:35:42.954490+0000","last_undegraded":"2023-07-21T22:35:42.954490+0000","last_fullsized":"2023-07-21T22:35:42.954490+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:31:29.748120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.471906+0000","last_change":"2023-07-21T22:35:41.476238+0000","last_active":"2023-07-21T22:35:42.471906+0000","last_peered":"2023-07-21T22:35:42.471906+0000","last_clean":"2023-07-21T22:35:42.471906+0000","last_became_active":"2023-07-21T22:35:41.475942+0000","last_became_peered":"2023-07-21T22:35:41.475942+0000","last_unstale":"2023-07-21T22:35:42.471906+0000","last_undegraded":"2023-07-21T22:35:42.471906+0000","last_fullsized":"2023-07-21T22:35:42.471906+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:03:29.335794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467433+0000","last_change":"2023-07-21T22:35:41.463062+0000","last_active":"2023-07-21T22:35:42.467433+0000","last_peered":"2023-07-21T22:35:42.467433+0000","last_clean":"2023-07-21T22:35:42.467433+0000","last_became_active":"2023-07-21T22:35:41.462785+0000","last_became_peered":"2023-07-21T22:35:41.462785+0000","last_unstale":"2023-07-21T22:35:42.467433+0000","last_undegraded":"2023-07-21T22:35:42.467433+0000","last_fullsized":"2023-07-21T22:35:42.467433+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:36:32.358870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467544+0000","last_change":"2023-07-21T22:35:41.467473+0000","last_active":"2023-07-21T22:35:42.467544+0000","last_peered":"2023-07-21T22:35:42.467544+0000","last_clean":"2023-07-21T22:35:42.467544+0000","last_became_active":"2023-07-21T22:35:41.467099+0000","last_became_peered":"2023-07-21T22:35:41.467099+0000","last_unstale":"2023-07-21T22:35:42.467544+0000","last_undegraded":"2023-07-21T22:35:42.467544+0000","last_fullsized":"2023-07-21T22:35:42.467544+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:53:35.888493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"111'4","reported_seq":17,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953920+0000","last_change":"2023-07-21T22:35:40.437895+0000","last_active":"2023-07-21T22:35:42.953920+0000","last_peered":"2023-07-21T22:35:42.953920+0000","last_clean":"2023-07-21T22:35:42.953920+0000","last_became_active":"2023-07-21T22:35:40.436744+0000","last_became_peered":"2023-07-21T22:35:40.436744+0000","last_unstale":"2023-07-21T22:35:42.953920+0000","last_undegraded":"2023-07-21T22:35:42.953920+0000","last_fullsized":"2023-07-21T22:35:42.953920+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:41:18.590148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467695+0000","last_change":"2023-07-21T22:35:41.464734+0000","last_active":"2023-07-21T22:35:42.467695+0000","last_peered":"2023-07-21T22:35:42.467695+0000","last_clean":"2023-07-21T22:35:42.467695+0000","last_became_active":"2023-07-21T22:35:41.464453+0000","last_became_peered":"2023-07-21T22:35:41.464453+0000","last_unstale":"2023-07-21T22:35:42.467695+0000","last_undegraded":"2023-07-21T22:35:42.467695+0000","last_fullsized":"2023-07-21T22:35:42.467695+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:51:38.417785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"111'1","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.955080+0000","last_change":"2023-07-21T22:35:40.436147+0000","last_active":"2023-07-21T22:35:42.955080+0000","last_peered":"2023-07-21T22:35:42.955080+0000","last_clean":"2023-07-21T22:35:42.955080+0000","last_became_active":"2023-07-21T22:35:40.435878+0000","last_became_peered":"2023-07-21T22:35:40.435878+0000","last_unstale":"2023-07-21T22:35:42.955080+0000","last_undegraded":"2023-07-21T22:35:42.955080+0000","last_fullsized":"2023-07-21T22:35:42.955080+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:52:44.052569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954265+0000","last_change":"2023-07-21T22:35:41.469549+0000","last_active":"2023-07-21T22:35:42.954265+0000","last_peered":"2023-07-21T22:35:42.954265+0000","last_clean":"2023-07-21T22:35:42.954265+0000","last_became_active":"2023-07-21T22:35:41.469264+0000","last_became_peered":"2023-07-21T22:35:41.469264+0000","last_unstale":"2023-07-21T22:35:42.954265+0000","last_undegraded":"2023-07-21T22:35:42.954265+0000","last_fullsized":"2023-07-21T22:35:42.954265+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:31:51.987773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"111'2","reported_seq":15,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953248+0000","last_change":"2023-07-21T22:35:40.440062+0000","last_active":"2023-07-21T22:35:42.953248+0000","last_peered":"2023-07-21T22:35:42.953248+0000","last_clean":"2023-07-21T22:35:42.953248+0000","last_became_active":"2023-07-21T22:35:40.439791+0000","last_became_peered":"2023-07-21T22:35:40.439791+0000","last_unstale":"2023-07-21T22:35:42.953248+0000","last_undegraded":"2023-07-21T22:35:42.953248+0000","last_fullsized":"2023-07-21T22:35:42.953248+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:42:58.001245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467887+0000","last_change":"2023-07-21T22:35:41.467787+0000","last_active":"2023-07-21T22:35:42.467887+0000","last_peered":"2023-07-21T22:35:42.467887+0000","last_clean":"2023-07-21T22:35:42.467887+0000","last_became_active":"2023-07-21T22:35:41.466695+0000","last_became_peered":"2023-07-21T22:35:41.466695+0000","last_unstale":"2023-07-21T22:35:42.467887+0000","last_undegraded":"2023-07-21T22:35:42.467887+0000","last_fullsized":"2023-07-21T22:35:42.467887+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:51:26.977629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"111'2","reported_seq":15,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953805+0000","last_change":"2023-07-21T22:35:40.437899+0000","last_active":"2023-07-21T22:35:42.953805+0000","last_peered":"2023-07-21T22:35:42.953805+0000","last_clean":"2023-07-21T22:35:42.953805+0000","last_became_active":"2023-07-21T22:35:40.437604+0000","last_became_peered":"2023-07-21T22:35:40.437604+0000","last_unstale":"2023-07-21T22:35:42.953805+0000","last_undegraded":"2023-07-21T22:35:42.953805+0000","last_fullsized":"2023-07-21T22:35:42.953805+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:43.288673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872370+0000","last_change":"2023-07-21T22:35:41.465881+0000","last_active":"2023-07-21T22:35:42.872370+0000","last_peered":"2023-07-21T22:35:42.872370+0000","last_clean":"2023-07-21T22:35:42.872370+0000","last_became_active":"2023-07-21T22:35:41.465388+0000","last_became_peered":"2023-07-21T22:35:41.465388+0000","last_unstale":"2023-07-21T22:35:42.872370+0000","last_undegraded":"2023-07-21T22:35:42.872370+0000","last_fullsized":"2023-07-21T22:35:42.872370+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:48:58.606348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"111'1","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954854+0000","last_change":"2023-07-21T22:35:40.439578+0000","last_active":"2023-07-21T22:35:42.954854+0000","last_peered":"2023-07-21T22:35:42.954854+0000","last_clean":"2023-07-21T22:35:42.954854+0000","last_became_active":"2023-07-21T22:35:40.439264+0000","last_became_peered":"2023-07-21T22:35:40.439264+0000","last_unstale":"2023-07-21T22:35:42.954854+0000","last_undegraded":"2023-07-21T22:35:42.954854+0000","last_fullsized":"2023-07-21T22:35:42.954854+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:18:36.285247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953782+0000","last_change":"2023-07-21T22:35:41.471185+0000","last_active":"2023-07-21T22:35:42.953782+0000","last_peered":"2023-07-21T22:35:42.953782+0000","last_clean":"2023-07-21T22:35:42.953782+0000","last_became_active":"2023-07-21T22:35:41.470820+0000","last_became_peered":"2023-07-21T22:35:41.470820+0000","last_unstale":"2023-07-21T22:35:42.953782+0000","last_undegraded":"2023-07-21T22:35:42.953782+0000","last_fullsized":"2023-07-21T22:35:42.953782+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:10.909320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"111'1","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872734+0000","last_change":"2023-07-21T22:35:40.434147+0000","last_active":"2023-07-21T22:35:42.872734+0000","last_peered":"2023-07-21T22:35:42.872734+0000","last_clean":"2023-07-21T22:35:42.872734+0000","last_became_active":"2023-07-21T22:35:40.433804+0000","last_became_peered":"2023-07-21T22:35:40.433804+0000","last_unstale":"2023-07-21T22:35:42.872734+0000","last_undegraded":"2023-07-21T22:35:42.872734+0000","last_fullsized":"2023-07-21T22:35:42.872734+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:36:31.169299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467468+0000","last_change":"2023-07-21T22:35:41.476727+0000","last_active":"2023-07-21T22:35:42.467468+0000","last_peered":"2023-07-21T22:35:42.467468+0000","last_clean":"2023-07-21T22:35:42.467468+0000","last_became_active":"2023-07-21T22:35:41.476426+0000","last_became_peered":"2023-07-21T22:35:41.476426+0000","last_unstale":"2023-07-21T22:35:42.467468+0000","last_undegraded":"2023-07-21T22:35:42.467468+0000","last_fullsized":"2023-07-21T22:35:42.467468+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:46:28.615624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.465467+0000","last_change":"2023-07-21T22:35:40.429279+0000","last_active":"2023-07-21T22:35:42.465467+0000","last_peered":"2023-07-21T22:35:42.465467+0000","last_clean":"2023-07-21T22:35:42.465467+0000","last_became_active":"2023-07-21T22:35:40.428980+0000","last_became_peered":"2023-07-21T22:35:40.428980+0000","last_unstale":"2023-07-21T22:35:42.465467+0000","last_undegraded":"2023-07-21T22:35:42.465467+0000","last_fullsized":"2023-07-21T22:35:42.465467+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:31:15.627320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872898+0000","last_change":"2023-07-21T22:35:41.458213+0000","last_active":"2023-07-21T22:35:42.872898+0000","last_peered":"2023-07-21T22:35:42.872898+0000","last_clean":"2023-07-21T22:35:42.872898+0000","last_became_active":"2023-07-21T22:35:41.457863+0000","last_became_peered":"2023-07-21T22:35:41.457863+0000","last_unstale":"2023-07-21T22:35:42.872898+0000","last_undegraded":"2023-07-21T22:35:42.872898+0000","last_fullsized":"2023-07-21T22:35:42.872898+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:26:41.701135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953233+0000","last_change":"2023-07-21T22:35:40.439163+0000","last_active":"2023-07-21T22:35:42.953233+0000","last_peered":"2023-07-21T22:35:42.953233+0000","last_clean":"2023-07-21T22:35:42.953233+0000","last_became_active":"2023-07-21T22:35:40.438863+0000","last_became_peered":"2023-07-21T22:35:40.438863+0000","last_unstale":"2023-07-21T22:35:42.953233+0000","last_undegraded":"2023-07-21T22:35:42.953233+0000","last_fullsized":"2023-07-21T22:35:42.953233+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:46:26.052334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954744+0000","last_change":"2023-07-21T22:35:41.461770+0000","last_active":"2023-07-21T22:35:42.954744+0000","last_peered":"2023-07-21T22:35:42.954744+0000","last_clean":"2023-07-21T22:35:42.954744+0000","last_became_active":"2023-07-21T22:35:41.461460+0000","last_became_peered":"2023-07-21T22:35:41.461460+0000","last_unstale":"2023-07-21T22:35:42.954744+0000","last_undegraded":"2023-07-21T22:35:42.954744+0000","last_fullsized":"2023-07-21T22:35:42.954744+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:40:22.509629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.472439+0000","last_change":"2023-07-21T22:35:40.429995+0000","last_active":"2023-07-21T22:35:42.472439+0000","last_peered":"2023-07-21T22:35:42.472439+0000","last_clean":"2023-07-21T22:35:42.472439+0000","last_became_active":"2023-07-21T22:35:40.429725+0000","last_became_peered":"2023-07-21T22:35:40.429725+0000","last_unstale":"2023-07-21T22:35:42.472439+0000","last_undegraded":"2023-07-21T22:35:42.472439+0000","last_fullsized":"2023-07-21T22:35:42.472439+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:46:05.602626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953130+0000","last_change":"2023-07-21T22:35:41.467376+0000","last_active":"2023-07-21T22:35:42.953130+0000","last_peered":"2023-07-21T22:35:42.953130+0000","last_clean":"2023-07-21T22:35:42.953130+0000","last_became_active":"2023-07-21T22:35:41.467011+0000","last_became_peered":"2023-07-21T22:35:41.467011+0000","last_unstale":"2023-07-21T22:35:42.953130+0000","last_undegraded":"2023-07-21T22:35:42.953130+0000","last_fullsized":"2023-07-21T22:35:42.953130+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:48:08.549696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.465894+0000","last_change":"2023-07-21T22:35:40.434725+0000","last_active":"2023-07-21T22:35:42.465894+0000","last_peered":"2023-07-21T22:35:42.465894+0000","last_clean":"2023-07-21T22:35:42.465894+0000","last_became_active":"2023-07-21T22:35:40.434401+0000","last_became_peered":"2023-07-21T22:35:40.434401+0000","last_unstale":"2023-07-21T22:35:42.465894+0000","last_undegraded":"2023-07-21T22:35:42.465894+0000","last_fullsized":"2023-07-21T22:35:42.465894+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:38.136772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.465839+0000","last_change":"2023-07-21T22:35:41.467123+0000","last_active":"2023-07-21T22:35:42.465839+0000","last_peered":"2023-07-21T22:35:42.465839+0000","last_clean":"2023-07-21T22:35:42.465839+0000","last_became_active":"2023-07-21T22:35:41.466861+0000","last_became_peered":"2023-07-21T22:35:41.466861+0000","last_unstale":"2023-07-21T22:35:42.465839+0000","last_undegraded":"2023-07-21T22:35:42.465839+0000","last_fullsized":"2023-07-21T22:35:42.465839+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:02:09.395272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"111'3","reported_seq":16,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.955198+0000","last_change":"2023-07-21T22:35:40.441811+0000","last_active":"2023-07-21T22:35:42.955198+0000","last_peered":"2023-07-21T22:35:42.955198+0000","last_clean":"2023-07-21T22:35:42.955198+0000","last_became_active":"2023-07-21T22:35:40.441488+0000","last_became_peered":"2023-07-21T22:35:40.441488+0000","last_unstale":"2023-07-21T22:35:42.955198+0000","last_undegraded":"2023-07-21T22:35:42.955198+0000","last_fullsized":"2023-07-21T22:35:42.955198+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:26:11.026462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.873213+0000","last_change":"2023-07-21T22:35:41.460779+0000","last_active":"2023-07-21T22:35:42.873213+0000","last_peered":"2023-07-21T22:35:42.873213+0000","last_clean":"2023-07-21T22:35:42.873213+0000","last_became_active":"2023-07-21T22:35:41.460437+0000","last_became_peered":"2023-07-21T22:35:41.460437+0000","last_unstale":"2023-07-21T22:35:42.873213+0000","last_undegraded":"2023-07-21T22:35:42.873213+0000","last_fullsized":"2023-07-21T22:35:42.873213+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:51.797124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"111'6","reported_seq":19,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467694+0000","last_change":"2023-07-21T22:35:40.431340+0000","last_active":"2023-07-21T22:35:42.467694+0000","last_peered":"2023-07-21T22:35:42.467694+0000","last_clean":"2023-07-21T22:35:42.467694+0000","last_became_active":"2023-07-21T22:35:40.430803+0000","last_became_peered":"2023-07-21T22:35:40.430803+0000","last_unstale":"2023-07-21T22:35:42.467694+0000","last_undegraded":"2023-07-21T22:35:42.467694+0000","last_fullsized":"2023-07-21T22:35:42.467694+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:48:51.880288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872373+0000","last_change":"2023-07-21T22:35:41.465697+0000","last_active":"2023-07-21T22:35:42.872373+0000","last_peered":"2023-07-21T22:35:42.872373+0000","last_clean":"2023-07-21T22:35:42.872373+0000","last_became_active":"2023-07-21T22:35:41.465052+0000","last_became_peered":"2023-07-21T22:35:41.465052+0000","last_unstale":"2023-07-21T22:35:42.872373+0000","last_undegraded":"2023-07-21T22:35:42.872373+0000","last_fullsized":"2023-07-21T22:35:42.872373+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:20:50.784975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"111'2","reported_seq":15,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954187+0000","last_change":"2023-07-21T22:35:40.438909+0000","last_active":"2023-07-21T22:35:42.954187+0000","last_peered":"2023-07-21T22:35:42.954187+0000","last_clean":"2023-07-21T22:35:42.954187+0000","last_became_active":"2023-07-21T22:35:40.438607+0000","last_became_peered":"2023-07-21T22:35:40.438607+0000","last_unstale":"2023-07-21T22:35:42.954187+0000","last_undegraded":"2023-07-21T22:35:42.954187+0000","last_fullsized":"2023-07-21T22:35:42.954187+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:07:33.563104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954173+0000","last_change":"2023-07-21T22:35:41.462170+0000","last_active":"2023-07-21T22:35:42.954173+0000","last_peered":"2023-07-21T22:35:42.954173+0000","last_clean":"2023-07-21T22:35:42.954173+0000","last_became_active":"2023-07-21T22:35:41.461850+0000","last_became_peered":"2023-07-21T22:35:41.461850+0000","last_unstale":"2023-07-21T22:35:42.954173+0000","last_undegraded":"2023-07-21T22:35:42.954173+0000","last_fullsized":"2023-07-21T22:35:42.954173+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:27:23.662839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467610+0000","last_change":"2023-07-21T22:35:40.435925+0000","last_active":"2023-07-21T22:35:42.467610+0000","last_peered":"2023-07-21T22:35:42.467610+0000","last_clean":"2023-07-21T22:35:42.467610+0000","last_became_active":"2023-07-21T22:35:40.435648+0000","last_became_peered":"2023-07-21T22:35:40.435648+0000","last_unstale":"2023-07-21T22:35:42.467610+0000","last_undegraded":"2023-07-21T22:35:42.467610+0000","last_fullsized":"2023-07-21T22:35:42.467610+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:37:43.983362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.949076+0000","last_change":"2023-07-21T22:35:41.471593+0000","last_active":"2023-07-21T22:35:42.949076+0000","last_peered":"2023-07-21T22:35:42.949076+0000","last_clean":"2023-07-21T22:35:42.949076+0000","last_became_active":"2023-07-21T22:35:41.471273+0000","last_became_peered":"2023-07-21T22:35:41.471273+0000","last_unstale":"2023-07-21T22:35:42.949076+0000","last_undegraded":"2023-07-21T22:35:42.949076+0000","last_fullsized":"2023-07-21T22:35:42.949076+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:06:38.914530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872540+0000","last_change":"2023-07-21T22:35:40.433893+0000","last_active":"2023-07-21T22:35:42.872540+0000","last_peered":"2023-07-21T22:35:42.872540+0000","last_clean":"2023-07-21T22:35:42.872540+0000","last_became_active":"2023-07-21T22:35:40.433550+0000","last_became_peered":"2023-07-21T22:35:40.433550+0000","last_unstale":"2023-07-21T22:35:42.872540+0000","last_undegraded":"2023-07-21T22:35:42.872540+0000","last_fullsized":"2023-07-21T22:35:42.872540+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:56:40.396600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.949328+0000","last_change":"2023-07-21T22:35:41.460017+0000","last_active":"2023-07-21T22:35:42.949328+0000","last_peered":"2023-07-21T22:35:42.949328+0000","last_clean":"2023-07-21T22:35:42.949328+0000","last_became_active":"2023-07-21T22:35:41.459744+0000","last_became_peered":"2023-07-21T22:35:41.459744+0000","last_unstale":"2023-07-21T22:35:42.949328+0000","last_undegraded":"2023-07-21T22:35:42.949328+0000","last_fullsized":"2023-07-21T22:35:42.949328+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:15:50.014467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"111'8","reported_seq":21,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872549+0000","last_change":"2023-07-21T22:35:40.435977+0000","last_active":"2023-07-21T22:35:42.872549+0000","last_peered":"2023-07-21T22:35:42.872549+0000","last_clean":"2023-07-21T22:35:42.872549+0000","last_became_active":"2023-07-21T22:35:40.435683+0000","last_became_peered":"2023-07-21T22:35:40.435683+0000","last_unstale":"2023-07-21T22:35:42.872549+0000","last_undegraded":"2023-07-21T22:35:42.872549+0000","last_fullsized":"2023-07-21T22:35:42.872549+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:47.790294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953674+0000","last_change":"2023-07-21T22:35:41.459497+0000","last_active":"2023-07-21T22:35:42.953674+0000","last_peered":"2023-07-21T22:35:42.953674+0000","last_clean":"2023-07-21T22:35:42.953674+0000","last_became_active":"2023-07-21T22:35:41.459196+0000","last_became_peered":"2023-07-21T22:35:41.459196+0000","last_unstale":"2023-07-21T22:35:42.953674+0000","last_undegraded":"2023-07-21T22:35:42.953674+0000","last_fullsized":"2023-07-21T22:35:42.953674+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:59:50.902581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"111'2","reported_seq":15,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954503+0000","last_change":"2023-07-21T22:35:40.437173+0000","last_active":"2023-07-21T22:35:42.954503+0000","last_peered":"2023-07-21T22:35:42.954503+0000","last_clean":"2023-07-21T22:35:42.954503+0000","last_became_active":"2023-07-21T22:35:40.435532+0000","last_became_peered":"2023-07-21T22:35:40.435532+0000","last_unstale":"2023-07-21T22:35:42.954503+0000","last_undegraded":"2023-07-21T22:35:42.954503+0000","last_fullsized":"2023-07-21T22:35:42.954503+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:29:14.776433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467871+0000","last_change":"2023-07-21T22:35:41.468318+0000","last_active":"2023-07-21T22:35:42.467871+0000","last_peered":"2023-07-21T22:35:42.467871+0000","last_clean":"2023-07-21T22:35:42.467871+0000","last_became_active":"2023-07-21T22:35:41.468046+0000","last_became_peered":"2023-07-21T22:35:41.468046+0000","last_unstale":"2023-07-21T22:35:42.467871+0000","last_undegraded":"2023-07-21T22:35:42.467871+0000","last_fullsized":"2023-07-21T22:35:42.467871+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:25:49.928391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"112'1","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.955257+0000","last_change":"2023-07-21T22:35:40.436051+0000","last_active":"2023-07-21T22:35:42.955257+0000","last_peered":"2023-07-21T22:35:42.955257+0000","last_clean":"2023-07-21T22:35:42.955257+0000","last_became_active":"2023-07-21T22:35:40.435765+0000","last_became_peered":"2023-07-21T22:35:40.435765+0000","last_unstale":"2023-07-21T22:35:42.955257+0000","last_undegraded":"2023-07-21T22:35:42.955257+0000","last_fullsized":"2023-07-21T22:35:42.955257+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:51:46.802269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467990+0000","last_change":"2023-07-21T22:35:41.461568+0000","last_active":"2023-07-21T22:35:42.467990+0000","last_peered":"2023-07-21T22:35:42.467990+0000","last_clean":"2023-07-21T22:35:42.467990+0000","last_became_active":"2023-07-21T22:35:41.461271+0000","last_became_peered":"2023-07-21T22:35:41.461271+0000","last_unstale":"2023-07-21T22:35:42.467990+0000","last_undegraded":"2023-07-21T22:35:42.467990+0000","last_fullsized":"2023-07-21T22:35:42.467990+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:30:51.228495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.955312+0000","last_change":"2023-07-21T22:35:40.439003+0000","last_active":"2023-07-21T22:35:42.955312+0000","last_peered":"2023-07-21T22:35:42.955312+0000","last_clean":"2023-07-21T22:35:42.955312+0000","last_became_active":"2023-07-21T22:35:40.438479+0000","last_became_peered":"2023-07-21T22:35:40.438479+0000","last_unstale":"2023-07-21T22:35:42.955312+0000","last_undegraded":"2023-07-21T22:35:42.955312+0000","last_fullsized":"2023-07-21T22:35:42.955312+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:21:24.007639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.472319+0000","last_change":"2023-07-21T22:35:41.467558+0000","last_active":"2023-07-21T22:35:42.472319+0000","last_peered":"2023-07-21T22:35:42.472319+0000","last_clean":"2023-07-21T22:35:42.472319+0000","last_became_active":"2023-07-21T22:35:41.466758+0000","last_became_peered":"2023-07-21T22:35:41.466758+0000","last_unstale":"2023-07-21T22:35:42.472319+0000","last_undegraded":"2023-07-21T22:35:42.472319+0000","last_fullsized":"2023-07-21T22:35:42.472319+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:13:07.984344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953927+0000","last_change":"2023-07-21T22:35:40.440675+0000","last_active":"2023-07-21T22:35:42.953927+0000","last_peered":"2023-07-21T22:35:42.953927+0000","last_clean":"2023-07-21T22:35:42.953927+0000","last_became_active":"2023-07-21T22:35:40.440191+0000","last_became_peered":"2023-07-21T22:35:40.440191+0000","last_unstale":"2023-07-21T22:35:42.953927+0000","last_undegraded":"2023-07-21T22:35:42.953927+0000","last_fullsized":"2023-07-21T22:35:42.953927+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:54:36.993745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.948938+0000","last_change":"2023-07-21T22:35:41.463918+0000","last_active":"2023-07-21T22:35:42.948938+0000","last_peered":"2023-07-21T22:35:42.948938+0000","last_clean":"2023-07-21T22:35:42.948938+0000","last_became_active":"2023-07-21T22:35:41.463644+0000","last_became_peered":"2023-07-21T22:35:41.463644+0000","last_unstale":"2023-07-21T22:35:42.948938+0000","last_undegraded":"2023-07-21T22:35:42.948938+0000","last_fullsized":"2023-07-21T22:35:42.948938+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:34:23.425712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467852+0000","last_change":"2023-07-21T22:35:40.438483+0000","last_active":"2023-07-21T22:35:42.467852+0000","last_peered":"2023-07-21T22:35:42.467852+0000","last_clean":"2023-07-21T22:35:42.467852+0000","last_became_active":"2023-07-21T22:35:40.438212+0000","last_became_peered":"2023-07-21T22:35:40.438212+0000","last_unstale":"2023-07-21T22:35:42.467852+0000","last_undegraded":"2023-07-21T22:35:42.467852+0000","last_fullsized":"2023-07-21T22:35:42.467852+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:44:28.111054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.465253+0000","last_change":"2023-07-21T22:35:41.475016+0000","last_active":"2023-07-21T22:35:42.465253+0000","last_peered":"2023-07-21T22:35:42.465253+0000","last_clean":"2023-07-21T22:35:42.465253+0000","last_became_active":"2023-07-21T22:35:41.474647+0000","last_became_peered":"2023-07-21T22:35:41.474647+0000","last_unstale":"2023-07-21T22:35:42.465253+0000","last_undegraded":"2023-07-21T22:35:42.465253+0000","last_fullsized":"2023-07-21T22:35:42.465253+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:07:48.378981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.471839+0000","last_change":"2023-07-21T22:35:40.431308+0000","last_active":"2023-07-21T22:35:42.471839+0000","last_peered":"2023-07-21T22:35:42.471839+0000","last_clean":"2023-07-21T22:35:42.471839+0000","last_became_active":"2023-07-21T22:35:40.430971+0000","last_became_peered":"2023-07-21T22:35:40.430971+0000","last_unstale":"2023-07-21T22:35:42.471839+0000","last_undegraded":"2023-07-21T22:35:42.471839+0000","last_fullsized":"2023-07-21T22:35:42.471839+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:46:17.011000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953271+0000","last_change":"2023-07-21T22:35:41.476366+0000","last_active":"2023-07-21T22:35:42.953271+0000","last_peered":"2023-07-21T22:35:42.953271+0000","last_clean":"2023-07-21T22:35:42.953271+0000","last_became_active":"2023-07-21T22:35:41.476015+0000","last_became_peered":"2023-07-21T22:35:41.476015+0000","last_unstale":"2023-07-21T22:35:42.953271+0000","last_undegraded":"2023-07-21T22:35:42.953271+0000","last_fullsized":"2023-07-21T22:35:42.953271+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:48:19.858384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953895+0000","last_change":"2023-07-21T22:35:40.440037+0000","last_active":"2023-07-21T22:35:42.953895+0000","last_peered":"2023-07-21T22:35:42.953895+0000","last_clean":"2023-07-21T22:35:42.953895+0000","last_became_active":"2023-07-21T22:35:40.439762+0000","last_became_peered":"2023-07-21T22:35:40.439762+0000","last_unstale":"2023-07-21T22:35:42.953895+0000","last_undegraded":"2023-07-21T22:35:42.953895+0000","last_fullsized":"2023-07-21T22:35:42.953895+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:13:38.859402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467774+0000","last_change":"2023-07-21T22:35:41.468021+0000","last_active":"2023-07-21T22:35:42.467774+0000","last_peered":"2023-07-21T22:35:42.467774+0000","last_clean":"2023-07-21T22:35:42.467774+0000","last_became_active":"2023-07-21T22:35:41.467688+0000","last_became_peered":"2023-07-21T22:35:41.467688+0000","last_unstale":"2023-07-21T22:35:42.467774+0000","last_undegraded":"2023-07-21T22:35:42.467774+0000","last_fullsized":"2023-07-21T22:35:42.467774+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:15:31.177179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953356+0000","last_change":"2023-07-21T22:35:40.434129+0000","last_active":"2023-07-21T22:35:42.953356+0000","last_peered":"2023-07-21T22:35:42.953356+0000","last_clean":"2023-07-21T22:35:42.953356+0000","last_became_active":"2023-07-21T22:35:40.433862+0000","last_became_peered":"2023-07-21T22:35:40.433862+0000","last_unstale":"2023-07-21T22:35:42.953356+0000","last_undegraded":"2023-07-21T22:35:42.953356+0000","last_fullsized":"2023-07-21T22:35:42.953356+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:03:04.087315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954393+0000","last_change":"2023-07-21T22:35:41.458041+0000","last_active":"2023-07-21T22:35:42.954393+0000","last_peered":"2023-07-21T22:35:42.954393+0000","last_clean":"2023-07-21T22:35:42.954393+0000","last_became_active":"2023-07-21T22:35:41.457747+0000","last_became_peered":"2023-07-21T22:35:41.457747+0000","last_unstale":"2023-07-21T22:35:42.954393+0000","last_undegraded":"2023-07-21T22:35:42.954393+0000","last_fullsized":"2023-07-21T22:35:42.954393+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:35:25.895334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.873002+0000","last_change":"2023-07-21T22:35:40.433064+0000","last_active":"2023-07-21T22:35:42.873002+0000","last_peered":"2023-07-21T22:35:42.873002+0000","last_clean":"2023-07-21T22:35:42.873002+0000","last_became_active":"2023-07-21T22:35:40.432727+0000","last_became_peered":"2023-07-21T22:35:40.432727+0000","last_unstale":"2023-07-21T22:35:42.873002+0000","last_undegraded":"2023-07-21T22:35:42.873002+0000","last_fullsized":"2023-07-21T22:35:42.873002+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:04:34.379766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"100'205","reported_seq":647,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953647+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:35:42.953647+0000","last_peered":"2023-07-21T22:35:42.953647+0000","last_clean":"2023-07-21T22:35:42.953647+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:35:42.953647+0000","last_undegraded":"2023-07-21T22:35:42.953647+0000","last_fullsized":"2023-07-21T22:35:42.953647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:32:54.385030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":193,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.471971+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:35:42.471971+0000","last_peered":"2023-07-21T22:35:42.471971+0000","last_clean":"2023-07-21T22:35:42.471971+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:35:42.471971+0000","last_undegraded":"2023-07-21T22:35:42.471971+0000","last_fullsized":"2023-07-21T22:35:42.471971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:47:43.572728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467658+0000","last_change":"2023-07-21T22:35:41.467320+0000","last_active":"2023-07-21T22:35:42.467658+0000","last_peered":"2023-07-21T22:35:42.467658+0000","last_clean":"2023-07-21T22:35:42.467658+0000","last_became_active":"2023-07-21T22:35:41.467032+0000","last_became_peered":"2023-07-21T22:35:41.467032+0000","last_unstale":"2023-07-21T22:35:42.467658+0000","last_undegraded":"2023-07-21T22:35:42.467658+0000","last_fullsized":"2023-07-21T22:35:42.467658+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:43:23.202718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"111'1","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953784+0000","last_change":"2023-07-21T22:35:40.433828+0000","last_active":"2023-07-21T22:35:42.953784+0000","last_peered":"2023-07-21T22:35:42.953784+0000","last_clean":"2023-07-21T22:35:42.953784+0000","last_became_active":"2023-07-21T22:35:40.433537+0000","last_became_peered":"2023-07-21T22:35:40.433537+0000","last_unstale":"2023-07-21T22:35:42.953784+0000","last_undegraded":"2023-07-21T22:35:42.953784+0000","last_fullsized":"2023-07-21T22:35:42.953784+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:21:03.809811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":179,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.953536+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:35:42.953536+0000","last_peered":"2023-07-21T22:35:42.953536+0000","last_clean":"2023-07-21T22:35:42.953536+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:35:42.953536+0000","last_undegraded":"2023-07-21T22:35:42.953536+0000","last_fullsized":"2023-07-21T22:35:42.953536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:30:00.828713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954112+0000","last_change":"2023-07-21T22:35:41.464825+0000","last_active":"2023-07-21T22:35:42.954112+0000","last_peered":"2023-07-21T22:35:42.954112+0000","last_clean":"2023-07-21T22:35:42.954112+0000","last_became_active":"2023-07-21T22:35:41.464551+0000","last_became_peered":"2023-07-21T22:35:41.464551+0000","last_unstale":"2023-07-21T22:35:42.954112+0000","last_undegraded":"2023-07-21T22:35:42.954112+0000","last_fullsized":"2023-07-21T22:35:42.954112+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:28:59.443855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"111'2","reported_seq":15,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954372+0000","last_change":"2023-07-21T22:35:40.435800+0000","last_active":"2023-07-21T22:35:42.954372+0000","last_peered":"2023-07-21T22:35:42.954372+0000","last_clean":"2023-07-21T22:35:42.954372+0000","last_became_active":"2023-07-21T22:35:40.435483+0000","last_became_peered":"2023-07-21T22:35:40.435483+0000","last_unstale":"2023-07-21T22:35:42.954372+0000","last_undegraded":"2023-07-21T22:35:42.954372+0000","last_fullsized":"2023-07-21T22:35:42.954372+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:58:22.453072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":175,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.948877+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:35:42.948877+0000","last_peered":"2023-07-21T22:35:42.948877+0000","last_clean":"2023-07-21T22:35:42.948877+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:35:42.948877+0000","last_undegraded":"2023-07-21T22:35:42.948877+0000","last_fullsized":"2023-07-21T22:35:42.948877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:02:03.450122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954995+0000","last_change":"2023-07-21T22:35:41.460459+0000","last_active":"2023-07-21T22:35:42.954995+0000","last_peered":"2023-07-21T22:35:42.954995+0000","last_clean":"2023-07-21T22:35:42.954995+0000","last_became_active":"2023-07-21T22:35:41.460162+0000","last_became_peered":"2023-07-21T22:35:41.460162+0000","last_unstale":"2023-07-21T22:35:42.954995+0000","last_undegraded":"2023-07-21T22:35:42.954995+0000","last_fullsized":"2023-07-21T22:35:42.954995+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:55:02.174512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"111'1","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.955259+0000","last_change":"2023-07-21T22:35:40.438789+0000","last_active":"2023-07-21T22:35:42.955259+0000","last_peered":"2023-07-21T22:35:42.955259+0000","last_clean":"2023-07-21T22:35:42.955259+0000","last_became_active":"2023-07-21T22:35:40.438114+0000","last_became_peered":"2023-07-21T22:35:40.438114+0000","last_unstale":"2023-07-21T22:35:42.955259+0000","last_undegraded":"2023-07-21T22:35:42.955259+0000","last_fullsized":"2023-07-21T22:35:42.955259+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:46:11.103993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":193,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.471913+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:35:42.471913+0000","last_peered":"2023-07-21T22:35:42.471913+0000","last_clean":"2023-07-21T22:35:42.471913+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:35:42.471913+0000","last_undegraded":"2023-07-21T22:35:42.471913+0000","last_fullsized":"2023-07-21T22:35:42.471913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:57:36.163782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467507+0000","last_change":"2023-07-21T22:35:41.477278+0000","last_active":"2023-07-21T22:35:42.467507+0000","last_peered":"2023-07-21T22:35:42.467507+0000","last_clean":"2023-07-21T22:35:42.467507+0000","last_became_active":"2023-07-21T22:35:41.476949+0000","last_became_peered":"2023-07-21T22:35:41.476949+0000","last_unstale":"2023-07-21T22:35:42.467507+0000","last_undegraded":"2023-07-21T22:35:42.467507+0000","last_fullsized":"2023-07-21T22:35:42.467507+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:22:00.627643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"111'2","reported_seq":15,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.472083+0000","last_change":"2023-07-21T22:35:40.431423+0000","last_active":"2023-07-21T22:35:42.472083+0000","last_peered":"2023-07-21T22:35:42.472083+0000","last_clean":"2023-07-21T22:35:42.472083+0000","last_became_active":"2023-07-21T22:35:40.431123+0000","last_became_peered":"2023-07-21T22:35:40.431123+0000","last_unstale":"2023-07-21T22:35:42.472083+0000","last_undegraded":"2023-07-21T22:35:42.472083+0000","last_fullsized":"2023-07-21T22:35:42.472083+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:32.721785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":185,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.872223+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:35:42.872223+0000","last_peered":"2023-07-21T22:35:42.872223+0000","last_clean":"2023-07-21T22:35:42.872223+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:35:42.872223+0000","last_undegraded":"2023-07-21T22:35:42.872223+0000","last_fullsized":"2023-07-21T22:35:42.872223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:26:01.978253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.471715+0000","last_change":"2023-07-21T22:35:41.463513+0000","last_active":"2023-07-21T22:35:42.471715+0000","last_peered":"2023-07-21T22:35:42.471715+0000","last_clean":"2023-07-21T22:35:42.471715+0000","last_became_active":"2023-07-21T22:35:41.463182+0000","last_became_peered":"2023-07-21T22:35:41.463182+0000","last_unstale":"2023-07-21T22:35:42.471715+0000","last_undegraded":"2023-07-21T22:35:42.471715+0000","last_fullsized":"2023-07-21T22:35:42.471715+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:57:01.740803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.949184+0000","last_change":"2023-07-21T22:35:40.429195+0000","last_active":"2023-07-21T22:35:42.949184+0000","last_peered":"2023-07-21T22:35:42.949184+0000","last_clean":"2023-07-21T22:35:42.949184+0000","last_became_active":"2023-07-21T22:35:40.428906+0000","last_became_peered":"2023-07-21T22:35:40.428906+0000","last_unstale":"2023-07-21T22:35:42.949184+0000","last_undegraded":"2023-07-21T22:35:42.949184+0000","last_fullsized":"2023-07-21T22:35:42.949184+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:51:03.334920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":179,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.952963+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:35:42.952963+0000","last_peered":"2023-07-21T22:35:42.952963+0000","last_clean":"2023-07-21T22:35:42.952963+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:35:42.952963+0000","last_undegraded":"2023-07-21T22:35:42.952963+0000","last_fullsized":"2023-07-21T22:35:42.952963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:09:41.428435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.471742+0000","last_change":"2023-07-21T22:35:41.475332+0000","last_active":"2023-07-21T22:35:42.471742+0000","last_peered":"2023-07-21T22:35:42.471742+0000","last_clean":"2023-07-21T22:35:42.471742+0000","last_became_active":"2023-07-21T22:35:41.474718+0000","last_became_peered":"2023-07-21T22:35:41.474718+0000","last_unstale":"2023-07-21T22:35:42.471742+0000","last_undegraded":"2023-07-21T22:35:42.471742+0000","last_fullsized":"2023-07-21T22:35:42.471742+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:12:03.341016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.472043+0000","last_change":"2023-07-21T22:35:40.436820+0000","last_active":"2023-07-21T22:35:42.472043+0000","last_peered":"2023-07-21T22:35:42.472043+0000","last_clean":"2023-07-21T22:35:42.472043+0000","last_became_active":"2023-07-21T22:35:40.436510+0000","last_became_peered":"2023-07-21T22:35:40.436510+0000","last_unstale":"2023-07-21T22:35:42.472043+0000","last_undegraded":"2023-07-21T22:35:42.472043+0000","last_fullsized":"2023-07-21T22:35:42.472043+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:44:53.151577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":184,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.873181+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:35:42.873181+0000","last_peered":"2023-07-21T22:35:42.873181+0000","last_clean":"2023-07-21T22:35:42.873181+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:35:42.873181+0000","last_undegraded":"2023-07-21T22:35:42.873181+0000","last_fullsized":"2023-07-21T22:35:42.873181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:13:41.408029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.467663+0000","last_change":"2023-07-21T22:35:41.467434+0000","last_active":"2023-07-21T22:35:42.467663+0000","last_peered":"2023-07-21T22:35:42.467663+0000","last_clean":"2023-07-21T22:35:42.467663+0000","last_became_active":"2023-07-21T22:35:41.467122+0000","last_became_peered":"2023-07-21T22:35:41.467122+0000","last_unstale":"2023-07-21T22:35:42.467663+0000","last_undegraded":"2023-07-21T22:35:42.467663+0000","last_fullsized":"2023-07-21T22:35:42.467663+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:40.404500+0000","last_clean_scrub_stamp":"2023-07-21T22:35:40.404500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:39:58.644099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.949017+0000","last_change":"2023-07-21T22:35:40.423934+0000","last_active":"2023-07-21T22:35:42.949017+0000","last_peered":"2023-07-21T22:35:42.949017+0000","last_clean":"2023-07-21T22:35:42.949017+0000","last_became_active":"2023-07-21T22:35:40.423649+0000","last_became_peered":"2023-07-21T22:35:40.423649+0000","last_unstale":"2023-07-21T22:35:42.949017+0000","last_undegraded":"2023-07-21T22:35:42.949017+0000","last_fullsized":"2023-07-21T22:35:42.949017+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:35:39.396554+0000","last_clean_scrub_stamp":"2023-07-21T22:35:39.396554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:30:29.402485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":172,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-07-21T22:35:42.954037+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:35:42.954037+0000","last_peered":"2023-07-21T22:35:42.954037+0000","last_clean":"2023-07-21T22:35:42.954037+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:35:42.954037+0000","last_undegraded":"2023-07-21T22:35:42.954037+0000","last_fullsized":"2023-07-21T22:35:42.954037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:05:05.855481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509646,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59212,"kb_used_data":1924,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312628,"statfs":{"total":96636764160,"available":96576131072,"internally_reserved":0,"allocated":1970176,"data_stored":1274858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73299999999999998,"15min":0.73799999999999999},"min":{"1min":0.46500000000000002,"5min":0.35299999999999998,"15min":0.32600000000000001},"max":{"1min":1.1180000000000001,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.69699999999999995},"min":{"1min":0.42799999999999999,"5min":0.39500000000000002,"15min":0.36099999999999999},"max":{"1min":0.90900000000000003,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.67400000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.70599999999999996,"15min":0.73299999999999998},"min":{"1min":0.44900000000000001,"5min":0.432,"15min":0.379},"max":{"1min":1.0509999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.69599999999999995,"15min":0.71599999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.69599999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72399999999999998,"15min":0.74299999999999999},"min":{"1min":0.51300000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.405},"last":0.63},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72899999999999998,"15min":0.752},"min":{"1min":0.47999999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.95699999999999996,"5min":1.409,"15min":1.409},"last":0.68600000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75,"15min":0.76600000000000001},"min":{"1min":0.58499999999999996,"5min":0.504,"15min":0.42099999999999999},"max":{"1min":1.1539999999999999,"5min":1.46,"15min":1.46},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.02,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.72899999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55400000000000005,"15min":0.55900000000000005},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.36199999999999999},"max":{"1min":0.89900000000000002,"5min":0.90500000000000003,"15min":0.94999999999999996},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.41499999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90400000000000003,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64500000000000002,"15min":0.61799999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.56499999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.052,"5min":1.506,"15min":1.506},"last":0.502}]},{"osd":6,"last update":"Fri Jul 21 22:34:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.048},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.624,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.434,"15min":0.42599999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.48399999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542352,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1388544,"data_stored":686602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.73599999999999999,"15min":0.76100000000000001},"min":{"1min":0.495,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.97599999999999998,"5min":1.016,"15min":1.016},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77700000000000002,"15min":0.79300000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.437},"max":{"1min":0.94699999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.91400000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.41999999999999998},"max":{"1min":0.90500000000000003,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":1.028},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.94599999999999995,"5min":0.99399999999999999,"15min":1.117},"last":0.79400000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.72999999999999998,"15min":0.75},"min":{"1min":0.499,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.96299999999999997,"5min":0.98099999999999998,"15min":1.0269999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.78800000000000003,"15min":0.79300000000000004},"min":{"1min":0.55900000000000005,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.0149999999999999,"5min":1.097,"15min":1.097},"last":0.92500000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.73699999999999999,"15min":0.76100000000000001},"min":{"1min":0.57899999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.92800000000000005,"5min":1.048,"15min":1.048},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.72499999999999998,"15min":0.74099999999999999},"min":{"1min":0.505,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88600000000000001,"5min":1.0049999999999999,"15min":1.054},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.60299999999999998,"15min":0.59099999999999997},"min":{"1min":0.45900000000000002,"5min":0.374,"15min":0.36599999999999999},"max":{"1min":0.82299999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.441,"5min":0.41199999999999998,"15min":0.39700000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.048},"last":0.55100000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.61399999999999999,"15min":0.61499999999999999},"min":{"1min":0.38100000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89600000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.497},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.39400000000000002},"max":{"1min":0.91900000000000004,"5min":0.98799999999999999,"15min":1.054},"last":0.51700000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:35:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.68500000000000005,"15min":0.67700000000000005},"min":{"1min":0.498,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":0.95699999999999996,"5min":1.079,"15min":1.079},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.70099999999999996,"15min":0.69399999999999995},"min":{"1min":0.51200000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.96499999999999997,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.53700000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509645,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1368064,"data_stored":684434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.70699999999999996,"15min":0.71299999999999997},"min":{"1min":0.436,"5min":0.35699999999999998,"15min":0.32900000000000001},"max":{"1min":0.78700000000000003,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.70799999999999996,"15min":0.72199999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83999999999999997,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.66400000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.66800000000000004,"15min":0.71099999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90600000000000003,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.71099999999999997,"15min":0.73199999999999998},"min":{"1min":0.48999999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.77900000000000003,"5min":1.617,"15min":1.617},"last":0.48199999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.70999999999999996,"15min":0.73499999999999999},"min":{"1min":0.45100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.99399999999999999,"5min":1.0109999999999999,"15min":1.034},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.71399999999999997,"15min":0.747},"min":{"1min":0.498,"5min":0.377,"15min":0.377},"max":{"1min":0.86399999999999999,"5min":1.512,"15min":1.512},"last":0.68700000000000006}]},{"osd":3,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.76100000000000001,"15min":0.78500000000000003},"min":{"1min":0.56299999999999994,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86199999999999999,"5min":1.472,"15min":1.472},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.77600000000000002,"15min":0.79200000000000004},"min":{"1min":0.59999999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.90800000000000003,"5min":1.556,"15min":1.556},"last":0.80900000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88900000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.68999999999999995,"15min":0.68799999999999994},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89200000000000002,"5min":1.012,"15min":1.038},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.59099999999999997,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.95499999999999996,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.622,"15min":0.60999999999999999},"min":{"1min":0.40200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93799999999999994,"5min":1.02,"15min":1.02},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:35:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.66100000000000003,"15min":0.65000000000000002},"min":{"1min":0.42399999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.91900000000000004,"5min":1.042,"15min":1.042},"last":0.749},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73699999999999999,"15min":0.72699999999999998},"min":{"1min":0.57899999999999996,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.999,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.84499999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509646,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1344,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1376256,"data_stored":684594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.71999999999999997,"15min":0.74299999999999999},"min":{"1min":0.51200000000000001,"5min":0.438,"15min":0.40000000000000002},"max":{"1min":0.80900000000000005,"5min":0.99399999999999999,"15min":1.0429999999999999},"last":0.62},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73299999999999998,"15min":0.74299999999999999},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.83599999999999997,"5min":0.96099999999999997,"15min":0.97599999999999998},"last":0.56799999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.39400000000000002},"max":{"1min":0.85499999999999998,"5min":1.002,"15min":1.0449999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.69399999999999995,"15min":0.69999999999999996},"min":{"1min":0.47299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.872,"5min":0.94299999999999995,"15min":1.016},"last":0.44800000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.51200000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.95899999999999996,"5min":1.048,"15min":1.048},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.53000000000000003,"5min":0.41999999999999998,"15min":0.33000000000000002},"max":{"1min":1.006,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.502}]},{"osd":3,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72899999999999998,"15min":0.73699999999999999},"min":{"1min":0.51000000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94099999999999995,"5min":0.97999999999999998,"15min":1.026},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.58399999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.53000000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.58699999999999997,"15min":0.59099999999999997},"min":{"1min":0.45100000000000001,"5min":0.32800000000000001,"15min":0.32600000000000001},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98899999999999999},"last":0.71599999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64600000000000002,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.38500000000000001},"max":{"1min":0.94699999999999995,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.70899999999999996,"15min":0.72099999999999997},"min":{"1min":0.57099999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.73099999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:34:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64400000000000002,"15min":0.65100000000000002},"min":{"1min":0.45500000000000002,"5min":0.39900000000000002,"15min":0.374},"max":{"1min":0.92100000000000004,"5min":1.0069999999999999,"15min":1.0429999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.46400000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.135},"last":0.76800000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509645,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32384,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339456,"statfs":{"total":96636764160,"available":96603602944,"internally_reserved":0,"allocated":1368064,"data_stored":684434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.28599999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.55500000000000005,"5min":0.73099999999999998,"15min":0.76400000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.53300000000000003,"15min":0.54300000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.66300000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.54300000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.46899999999999997,"15min":0.47899999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.71799999999999997,"5min":0.754,"15min":0.83499999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.54600000000000004,"15min":0.55500000000000005},"min":{"1min":0.30199999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.82599999999999996,"15min":0.90100000000000002},"last":0.498}]},{"osd":2,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54800000000000004,"15min":0.56000000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.997,"5min":0.997,"15min":1.1140000000000001},"last":0.749},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.59099999999999997,"15min":0.59999999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.69499999999999995,"5min":0.91800000000000004,"15min":0.99199999999999999},"last":0.72199999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0569999999999999,"5min":1.093,"15min":1.159},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.80200000000000005,"15min":0.82699999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0429999999999999,"5min":1.1459999999999999,"15min":1.3620000000000001},"last":0.65700000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.749,"15min":0.77600000000000002},"min":{"1min":0.501,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0029999999999999,"5min":1.0740000000000001,"15min":1.137},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.51300000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98199999999999998,"5min":1.048,"15min":1.2789999999999999},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.77400000000000002,"15min":0.79500000000000004},"min":{"1min":0.55700000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0289999999999999,"5min":1.056,"15min":1.3979999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75900000000000001,"15min":0.77500000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97099999999999997,"5min":1.1120000000000001,"15min":1.2450000000000001},"last":0.78600000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:35:11 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.79400000000000004,"15min":0.82499999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.024,"5min":1.087,"15min":1.335},"last":0.879},{"interface":"front","average":{"1min":0.745,"5min":0.81399999999999995,"15min":0.82999999999999996},"min":{"1min":0.57699999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.081,"5min":1.113,"15min":1.2130000000000001},"last":0.80400000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509647,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54528,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317312,"statfs":{"total":96636764160,"available":96580927488,"internally_reserved":0,"allocated":1368064,"data_stored":684434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.45200000000000001,"15min":0.47099999999999997},"min":{"1min":0.27700000000000002,"5min":0.25600000000000001,"15min":0.23899999999999999},"max":{"1min":0.75,"5min":0.81200000000000006,"15min":0.94199999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.52400000000000002,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.84799999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.48799999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.36499999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.86699999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55800000000000005,"15min":0.58099999999999996},"min":{"1min":0.38900000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.012,"5min":1.085,"15min":1.085},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46999999999999997,"15min":0.47999999999999998},"min":{"1min":0.31,"5min":0.30099999999999999,"15min":0.29699999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55000000000000004,"15min":0.56899999999999995},"min":{"1min":0.39300000000000002,"5min":0.36699999999999999,"15min":0.34100000000000003},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.77900000000000003,"15min":0.79600000000000004},"min":{"1min":0.49099999999999999,"5min":0.439,"15min":0.376},"max":{"1min":0.93500000000000005,"5min":1.2569999999999999,"15min":1.3420000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79200000000000004,"15min":0.80100000000000005},"min":{"1min":0.56000000000000005,"5min":0.501,"15min":0.432},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.58599999999999997,"5min":0.55800000000000005,"15min":0.496},"max":{"1min":0.93200000000000005,"5min":1.0600000000000001,"15min":1.1879999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80000000000000004,"15min":0.81100000000000005},"min":{"1min":0.54400000000000004,"5min":0.47299999999999998,"15min":0.46400000000000002},"max":{"1min":0.97599999999999998,"5min":1.171,"15min":1.3089999999999999},"last":0.72199999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.78600000000000003,"15min":0.79600000000000004},"min":{"1min":0.502,"5min":0.45500000000000002,"15min":0.40300000000000002},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.79700000000000004,"15min":0.81200000000000006},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.45600000000000002},"max":{"1min":0.88400000000000001,"5min":1.23,"15min":1.2649999999999999},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.79900000000000004,"15min":0.82399999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.49099999999999999},"max":{"1min":0.90000000000000002,"5min":1.2,"15min":1.2909999999999999},"last":0.755},{"interface":"front","average":{"1min":0.75,"5min":0.79900000000000004,"15min":0.81599999999999995},"min":{"1min":0.57599999999999996,"5min":0.5,"15min":0.44700000000000001},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.65000000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509646,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1340,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1372160,"data_stored":684504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.47299999999999998,"15min":0.48099999999999998},"min":{"1min":0.28299999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.53500000000000003,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.55800000000000005,"15min":0.56799999999999995},"min":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.626,"5min":0.872,"15min":0.872},"last":0.55800000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.5,"15min":0.50700000000000001},"min":{"1min":0.33700000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.63200000000000001,"5min":0.76100000000000001,"15min":0.81000000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.29099999999999998},"max":{"1min":0.78900000000000003,"5min":0.83599999999999997,"15min":0.88800000000000001},"last":0.51500000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.57599999999999996,"15min":0.59699999999999998},"min":{"1min":0.378,"5min":0.35799999999999998,"15min":0.33400000000000002},"max":{"1min":0.70799999999999996,"5min":0.84299999999999997,"15min":0.98899999999999999},"last":0.624},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.505,"15min":0.51700000000000002},"min":{"1min":0.33100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.64200000000000002,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.54200000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.748,"15min":0.77000000000000002},"min":{"1min":0.53100000000000003,"5min":0.432,"15min":0.432},"max":{"1min":0.91400000000000003,"5min":1.0860000000000001,"15min":1.234},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.78100000000000003,"15min":0.79500000000000004},"min":{"1min":0.57499999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.014,"5min":1.083,"15min":1.155},"last":0.877}]},{"osd":5,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75600000000000001,"15min":0.77800000000000002},"min":{"1min":0.53500000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92500000000000004,"5min":1.0609999999999999,"15min":1.1919999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78500000000000003,"15min":0.80000000000000004},"min":{"1min":0.55200000000000005,"5min":0.376,"15min":0.376},"max":{"1min":1.044,"5min":1.121,"15min":1.2849999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78600000000000003,"15min":0.81000000000000005},"min":{"1min":0.57199999999999995,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0229999999999999,"5min":1.0580000000000001,"15min":1.23},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.76300000000000001,"15min":0.79000000000000004},"min":{"1min":0.50900000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0449999999999999,"5min":1.1020000000000001,"15min":1.3240000000000001},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:35:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78600000000000003,"15min":0.80900000000000005},"min":{"1min":0.58599999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.99299999999999999,"5min":1.103,"15min":1.3149999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79000000000000004,"15min":0.80800000000000005},"min":{"1min":0.55500000000000005,"5min":0.52600000000000002,"15min":0.45700000000000002},"max":{"1min":0.97499999999999998,"5min":1.115,"15min":1.3380000000000001},"last":0.89800000000000002}]}]},{"osd":0,"up_from":15,"seq":64424509648,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37084,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334756,"statfs":{"total":96636764160,"available":96598790144,"internally_reserved":0,"allocated":1986560,"data_stored":1277072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.47399999999999998,"15min":0.47099999999999997},"min":{"1min":0.28399999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.64700000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.499,"15min":0.51300000000000001},"min":{"1min":0.374,"5min":0.247,"15min":0.247},"max":{"1min":0.63100000000000001,"5min":0.76200000000000001,"15min":0.79400000000000004},"last":0.51400000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71499999999999997,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.51200000000000001,"15min":0.51700000000000002},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67000000000000004,"5min":0.871,"15min":0.871},"last":0.48799999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70899999999999996,"5min":0.84499999999999997,"15min":0.91300000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54600000000000004,"15min":0.55500000000000005},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.67700000000000005,"5min":1.038,"15min":1.038},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.754,"15min":0.77800000000000002},"min":{"1min":0.58099999999999996,"5min":0.46200000000000002,"15min":0.45200000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.321},"last":1.016},{"interface":"front","average":{"1min":0.749,"5min":0.78400000000000003,"15min":0.79800000000000004},"min":{"1min":0.55600000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.423},"last":0.95299999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76300000000000001,"15min":0.78100000000000003},"min":{"1min":0.55600000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.036,"5min":1.107,"15min":1.28},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77600000000000002,"15min":0.80700000000000005},"min":{"1min":0.57699999999999996,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.24,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.0720000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76800000000000002,"15min":0.81200000000000006},"min":{"1min":0.53800000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.79900000000000004,"15min":0.81699999999999995},"min":{"1min":0.60699999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0169999999999999,"5min":1.147,"15min":1.333},"last":0.98099999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:35:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78600000000000003,"15min":0.79800000000000004},"min":{"1min":0.54300000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.042,"5min":1.159,"15min":1.2310000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.79100000000000004,"15min":0.82899999999999996},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0609999999999999,"5min":1.1930000000000001,"15min":1.369},"last":1.05}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:35:50.923 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T22:35:50.923 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-21T22:35:51.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.058+0000 7f20c4711640 1 Processor -- start 2023-07-21T22:35:51.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.058+0000 7f20c4711640 1 -- start start 2023-07-21T22:35:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.058+0000 7f20c4711640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f20bc0cb360 0x7f20bc15df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.058+0000 7f20c4711640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f20bc0cd490 0x7f20bc0c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.058+0000 7f20c4711640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20bc0cc900 con 0x7f20bc0b38d0 2023-07-21T22:35:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.058+0000 7f20c4711640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20bc0ccbe0 con 0x7f20bc0cb360 2023-07-21T22:35:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.058+0000 7f20c4711640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20bc15d780 con 0x7f20bc0cd490 2023-07-21T22:35:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.058+0000 7f20c24ad640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f20bc0cb360 0x7f20bc15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.058+0000 7f20c24ad640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f20bc0cb360 0x7f20bc15df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34270/0 (socket says 172.21.15.6:34270) 2023-07-21T22:35:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.058+0000 7f20c24ad640 1 -- 172.21.15.6:0/2698216453 learned_addr learned my addr 172.21.15.6:0/2698216453 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.058+0000 7f20c2cae640 1 --2- 172.21.15.6:0/2698216453 >> v2:172.21.15.161:3300/0 conn(0x7f20bc0cd490 0x7f20bc0c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.062+0000 7f20c24ad640 1 -- 172.21.15.6:0/2698216453 >> v2:172.21.15.161:3300/0 conn(0x7f20bc0cd490 msgr2=0x7f20bc0c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.062+0000 7f20c24ad640 1 --2- 172.21.15.6:0/2698216453 >> v2:172.21.15.161:3300/0 conn(0x7f20bc0cd490 0x7f20bc0c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:51.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.062+0000 7f20c24ad640 1 -- 172.21.15.6:0/2698216453 >> v1:172.21.15.6:6789/0 conn(0x7f20bc0b38d0 legacy=0x7f20bc070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:51.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.062+0000 7f20c24ad640 1 -- 172.21.15.6:0/2698216453 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20bc15da60 con 0x7f20bc0cb360 2023-07-21T22:35:51.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.062+0000 7f20c14ab640 1 -- 172.21.15.6:0/2698216453 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273668576 0 0) 0x7f20bc0cc900 con 0x7f20bc0b38d0 2023-07-21T22:35:51.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.062+0000 7f20c24ad640 1 --2- 172.21.15.6:0/2698216453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20bc0cb360 0x7f20bc15df80 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0cc810 tx=0x7f20b801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742424c5914570f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.062+0000 7f20c14ab640 1 -- 172.21.15.6:0/2698216453 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b80ab600 con 0x7f20bc0cb360 2023-07-21T22:35:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.062+0000 7f20c14ab640 1 -- 172.21.15.6:0/2698216453 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b80a7050 con 0x7f20bc0cb360 2023-07-21T22:35:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.062+0000 7f20c14ab640 1 -- 172.21.15.6:0/2698216453 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b80ab980 con 0x7f20bc0cb360 2023-07-21T22:35:51.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c4711640 1 -- 172.21.15.6:0/2698216453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20bc0cb360 msgr2=0x7f20bc15df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:51.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c4711640 1 --2- 172.21.15.6:0/2698216453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20bc0cb360 0x7f20bc15df80 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0cc810 tx=0x7f20b801c3a0 comp rx=0 tx=0).stop 2023-07-21T22:35:51.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c4711640 1 -- 172.21.15.6:0/2698216453 shutdown_connections 2023-07-21T22:35:51.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c4711640 1 --2- 172.21.15.6:0/2698216453 >> v2:172.21.15.161:3300/0 conn(0x7f20bc0cd490 0x7f20bc0c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:51.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c4711640 1 --2- 172.21.15.6:0/2698216453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20bc0cb360 0x7f20bc15df80 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:51.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c4711640 1 -- 172.21.15.6:0/2698216453 >> 172.21.15.6:0/2698216453 conn(0x7f20bc0afac0 msgr2=0x7f20bc0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:51.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c4711640 1 -- 172.21.15.6:0/2698216453 shutdown_connections 2023-07-21T22:35:51.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c4711640 1 -- 172.21.15.6:0/2698216453 wait complete. 2023-07-21T22:35:51.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c4711640 1 Processor -- start 2023-07-21T22:35:51.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c4711640 1 -- start start 2023-07-21T22:35:51.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c4711640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20bc0b38d0 0x7f20bc15aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:51.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c4711640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20bc0cb360 0x7f20bc1466d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:51.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c4711640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20bc0cd490 0x7f20bc0c3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:51.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c4711640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc15b270 con 0x7f20bc0b38d0 2023-07-21T22:35:51.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c4711640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc15b550 con 0x7f20bc0cb360 2023-07-21T22:35:51.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c4711640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc15b830 con 0x7f20bc0cd490 2023-07-21T22:35:51.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c24ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20bc0b38d0 0x7f20bc15aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:51.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c24ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20bc0b38d0 0x7f20bc15aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34278/0 (socket says 172.21.15.6:34278) 2023-07-21T22:35:51.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c24ad640 1 -- 172.21.15.6:0/641203059 learned_addr learned my addr 172.21.15.6:0/641203059 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:51.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c24ad640 1 -- 172.21.15.6:0/641203059 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20bc0cd490 msgr2=0x7f20bc0c3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:51.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c24ad640 1 --2- 172.21.15.6:0/641203059 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20bc0cd490 0x7f20bc0c3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:51.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c24ad640 1 -- 172.21.15.6:0/641203059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20bc0cb360 msgr2=0x7f20bc1466d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:51.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c24ad640 1 --2- 172.21.15.6:0/641203059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20bc0cb360 0x7f20bc1466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:51.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c24ad640 1 -- 172.21.15.6:0/641203059 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b80094d0 con 0x7f20bc0b38d0 2023-07-21T22:35:51.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.066+0000 7f20c24ad640 1 --2- 172.21.15.6:0/641203059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20bc0b38d0 0x7f20bc15aa20 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f20b8018fb0 tx=0x7f20b8019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:51.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.070+0000 7f20b2ffd640 1 -- 172.21.15.6:0/641203059 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b80abea0 con 0x7f20bc0b38d0 2023-07-21T22:35:51.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.070+0000 7f20b2ffd640 1 -- 172.21.15.6:0/641203059 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b80b4420 con 0x7f20bc0b38d0 2023-07-21T22:35:51.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.070+0000 7f20b2ffd640 1 -- 172.21.15.6:0/641203059 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b80b47d0 con 0x7f20bc0b38d0 2023-07-21T22:35:51.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.070+0000 7f20c4711640 1 -- 172.21.15.6:0/641203059 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20bc15bb10 con 0x7f20bc0b38d0 2023-07-21T22:35:51.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.070+0000 7f20c4711640 1 -- 172.21.15.6:0/641203059 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20bc15af60 con 0x7f20bc0b38d0 2023-07-21T22:35:51.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.070+0000 7f20c4711640 1 -- 172.21.15.6:0/641203059 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20bc15c030 con 0x7f20bc0b38d0 2023-07-21T22:35:51.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.070+0000 7f20b2ffd640 1 -- 172.21.15.6:0/641203059 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f20b80b2070 con 0x7f20bc0b38d0 2023-07-21T22:35:51.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.070+0000 7f20b2ffd640 1 --2- 172.21.15.6:0/641203059 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f20a00663a0 0x7f20a0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:51.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.070+0000 7f20b2ffd640 1 -- 172.21.15.6:0/641203059 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f20b811d9a0 con 0x7f20bc0b38d0 2023-07-21T22:35:51.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.070+0000 7f20c1cac640 1 --2- 172.21.15.6:0/641203059 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f20a00663a0 0x7f20a0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:51.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.074+0000 7f20c1cac640 1 --2- 172.21.15.6:0/641203059 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f20a00663a0 0x7f20a0068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f20ac007fd0 tx=0x7f20ac007940 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:51.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.074+0000 7f20b2ffd640 1 -- 172.21.15.6:0/641203059 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f20bc15c030 con 0x7f20bc0b38d0 2023-07-21T22:35:51.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.286+0000 7f20c4711640 1 -- 172.21.15.6:0/641203059 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f20bc15c030 con 0x7f20bc0b38d0 2023-07-21T22:35:51.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.294+0000 7f20b2ffd640 1 -- 172.21.15.6:0/641203059 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7f20bc15c030 con 0x7f20bc0b38d0 2023-07-21T22:35:51.342 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-07-21T22:35:51.342 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA== 2023-07-21T22:35:51.342 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2023-07-21T22:35:51.342 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2023-07-21T22:35:51.343 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-21T22:35:51.343 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-07-21T22:35:51.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.294+0000 7f20c4711640 1 -- 172.21.15.6:0/641203059 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f20a00663a0 msgr2=0x7f20a0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:51.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.294+0000 7f20c4711640 1 --2- 172.21.15.6:0/641203059 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f20a00663a0 0x7f20a0068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f20ac007fd0 tx=0x7f20ac007940 comp rx=0 tx=0).stop 2023-07-21T22:35:51.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.294+0000 7f20c4711640 1 -- 172.21.15.6:0/641203059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20bc0b38d0 msgr2=0x7f20bc15aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:51.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.294+0000 7f20c4711640 1 --2- 172.21.15.6:0/641203059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20bc0b38d0 0x7f20bc15aa20 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f20b8018fb0 tx=0x7f20b8019140 comp rx=0 tx=0).stop 2023-07-21T22:35:51.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.294+0000 7f20c4711640 1 -- 172.21.15.6:0/641203059 shutdown_connections 2023-07-21T22:35:51.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.294+0000 7f20c4711640 1 --2- 172.21.15.6:0/641203059 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f20a00663a0 0x7f20a0068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:51.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.294+0000 7f20c4711640 1 --2- 172.21.15.6:0/641203059 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20bc0cd490 0x7f20bc0c3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:51.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.294+0000 7f20c4711640 1 --2- 172.21.15.6:0/641203059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20bc0cb360 0x7f20bc1466d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:51.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.294+0000 7f20c4711640 1 --2- 172.21.15.6:0/641203059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20bc0b38d0 0x7f20bc15aa20 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:51.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.294+0000 7f20c4711640 1 -- 172.21.15.6:0/641203059 >> 172.21.15.6:0/641203059 conn(0x7f20bc0afac0 msgr2=0x7f20bc0c9430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:51.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.294+0000 7f20c4711640 1 -- 172.21.15.6:0/641203059 shutdown_connections 2023-07-21T22:35:51.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.294+0000 7f20c4711640 1 -- 172.21.15.6:0/641203059 wait complete. 2023-07-21T22:35:51.363 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:35:51.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.458+0000 7fa8a4c6a640 1 Processor -- start 2023-07-21T22:35:51.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.458+0000 7fa8a4c6a640 1 -- start start 2023-07-21T22:35:51.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.458+0000 7fa8a4c6a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa8a00d22e0 0x7fa8a00d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:51.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.458+0000 7fa8a4c6a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a00b2140 con 0x7fa8a00d06b0 2023-07-21T22:35:51.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.458+0000 7fa8a4c6a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a00b2410 con 0x7fa8a0145430 2023-07-21T22:35:51.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.458+0000 7fa8a4c6a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a00d2cc0 con 0x7fa8a00d22e0 2023-07-21T22:35:51.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.458+0000 7fa89ed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa8a00d22e0 0x7fa8a00d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:51.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.458+0000 7fa89ed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa8a00d22e0 0x7fa8a00d2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34284/0 (socket says 172.21.15.6:34284) 2023-07-21T22:35:51.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.458+0000 7fa89ed9d640 1 -- 172.21.15.6:0/3365796663 learned_addr learned my addr 172.21.15.6:0/3365796663 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.458+0000 7fa89ed9d640 1 -- 172.21.15.6:0/3365796663 >> v1:172.21.15.161:6789/0 conn(0x7fa8a0145430 legacy=0x7fa8a00b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.458+0000 7fa89ed9d640 1 -- 172.21.15.6:0/3365796663 >> v1:172.21.15.6:6789/0 conn(0x7fa8a00d06b0 legacy=0x7fa8a00b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.458+0000 7fa89ed9d640 1 -- 172.21.15.6:0/3365796663 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a00b26f0 con 0x7fa8a00d22e0 2023-07-21T22:35:51.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.462+0000 7fa89ed9d640 1 --2- 172.21.15.6:0/3365796663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a00d22e0 0x7fa8a00d2780 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fa898009e50 tx=0x7fa89801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da1bb5c13a2475a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:51.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.462+0000 7fa89dd9b640 1 -- 172.21.15.6:0/3365796663 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8980a5860 con 0x7fa8a00d22e0 2023-07-21T22:35:51.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.462+0000 7fa89dd9b640 1 -- 172.21.15.6:0/3365796663 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8980a59c0 con 0x7fa8a00d22e0 2023-07-21T22:35:51.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.462+0000 7fa89dd9b640 1 -- 172.21.15.6:0/3365796663 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8980a5d50 con 0x7fa8a00d22e0 2023-07-21T22:35:51.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.462+0000 7fa8a4c6a640 1 -- 172.21.15.6:0/3365796663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a00d22e0 msgr2=0x7fa8a00d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:51.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.462+0000 7fa8a4c6a640 1 --2- 172.21.15.6:0/3365796663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a00d22e0 0x7fa8a00d2780 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fa898009e50 tx=0x7fa89801c9a0 comp rx=0 tx=0).stop 2023-07-21T22:35:51.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.462+0000 7fa8a4c6a640 1 -- 172.21.15.6:0/3365796663 shutdown_connections 2023-07-21T22:35:51.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.462+0000 7fa8a4c6a640 1 --2- 172.21.15.6:0/3365796663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a00d22e0 0x7fa8a00d2780 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:51.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.462+0000 7fa8a4c6a640 1 -- 172.21.15.6:0/3365796663 >> 172.21.15.6:0/3365796663 conn(0x7fa8a00659d0 msgr2=0x7fa8a009b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:51.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.462+0000 7fa8a4c6a640 1 -- 172.21.15.6:0/3365796663 shutdown_connections 2023-07-21T22:35:51.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.462+0000 7fa8a4c6a640 1 -- 172.21.15.6:0/3365796663 wait complete. 2023-07-21T22:35:51.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa8a4c6a640 1 Processor -- start 2023-07-21T22:35:51.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa8a4c6a640 1 -- start start 2023-07-21T22:35:51.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa8a4c6a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a00d06b0 0x7fa8a00b6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:51.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa8a4c6a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a00d22e0 0x7fa8a00c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:51.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa8a4c6a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8a00c8700 0x7fa8a00c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:51.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa8a4c6a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a0152740 con 0x7fa8a00d06b0 2023-07-21T22:35:51.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa8a4c6a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00c7120 con 0x7fa8a00c8700 2023-07-21T22:35:51.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa8a4c6a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00c7400 con 0x7fa8a00d22e0 2023-07-21T22:35:51.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa89e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a00d06b0 0x7fa8a00b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:51.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa89e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a00d06b0 0x7fa8a00b6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34296/0 (socket says 172.21.15.6:34296) 2023-07-21T22:35:51.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa89e59c640 1 -- 172.21.15.6:0/4175223811 learned_addr learned my addr 172.21.15.6:0/4175223811 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:51.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa89e59c640 1 -- 172.21.15.6:0/4175223811 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a00d22e0 msgr2=0x7fa8a00c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa89e59c640 1 --2- 172.21.15.6:0/4175223811 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a00d22e0 0x7fa8a00c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa89e59c640 1 -- 172.21.15.6:0/4175223811 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8a00c8700 msgr2=0x7fa8a00c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa89e59c640 1 --2- 172.21.15.6:0/4175223811 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8a00c8700 0x7fa8a00c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa89e59c640 1 -- 172.21.15.6:0/4175223811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa898009b30 con 0x7fa8a00d06b0 2023-07-21T22:35:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa89e59c640 1 --2- 172.21.15.6:0/4175223811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a00d06b0 0x7fa8a00b6620 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fa89000c3c0 tx=0x7fa89000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa896ffd640 1 -- 172.21.15.6:0/4175223811 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8900052d0 con 0x7fa8a00d06b0 2023-07-21T22:35:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa896ffd640 1 -- 172.21.15.6:0/4175223811 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa890005430 con 0x7fa8a00d06b0 2023-07-21T22:35:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa896ffd640 1 -- 172.21.15.6:0/4175223811 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890003840 con 0x7fa8a00d06b0 2023-07-21T22:35:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa8a4c6a640 1 -- 172.21.15.6:0/4175223811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a00c76e0 con 0x7fa8a00d06b0 2023-07-21T22:35:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.466+0000 7fa8a4c6a640 1 -- 172.21.15.6:0/4175223811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a00c7ca0 con 0x7fa8a00d06b0 2023-07-21T22:35:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.470+0000 7fa8a4c6a640 1 -- 172.21.15.6:0/4175223811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a00c7ec0 con 0x7fa8a00d06b0 2023-07-21T22:35:51.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.470+0000 7fa896ffd640 1 -- 172.21.15.6:0/4175223811 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa8900039a0 con 0x7fa8a00d06b0 2023-07-21T22:35:51.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.470+0000 7fa896ffd640 1 --2- 172.21.15.6:0/4175223811 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fa8800663a0 0x7fa880068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:51.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.470+0000 7fa896ffd640 1 -- 172.21.15.6:0/4175223811 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fa890083450 con 0x7fa8a00d06b0 2023-07-21T22:35:51.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.470+0000 7fa897fff640 1 --2- 172.21.15.6:0/4175223811 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fa8800663a0 0x7fa880068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:51.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.470+0000 7fa897fff640 1 --2- 172.21.15.6:0/4175223811 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fa8800663a0 0x7fa880068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0158f60 tx=0x7fa8880079c0 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:51.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.474+0000 7fa896ffd640 1 -- 172.21.15.6:0/4175223811 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa8900506f0 con 0x7fa8a00d06b0 2023-07-21T22:35:51.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.662+0000 7fa8a4c6a640 1 -- 172.21.15.6:0/4175223811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8a00678d0 con 0x7fa8a00d06b0 2023-07-21T22:35:51.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.662+0000 7fa896ffd640 1 -- 172.21.15.6:0/4175223811 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4667 (secure 0 0 0) 0x7fa890053d10 con 0x7fa8a00d06b0 2023-07-21T22:35:51.712 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:35:51.712 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6716,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/128364815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":128364815},{"type":"v1","addr":"172.21.15.161:6836","nonce":128364815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6719,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1447795142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1447795142},{"type":"v1","addr":"172.21.15.161:6837","nonce":1447795142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7653,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/921116259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":921116259},{"type":"v1","addr":"172.21.15.6:6833","nonce":921116259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:35:40.812228+0000","modified":"2023-07-21T22:35:44.851097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2789884551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2789884551},{"type":"v1","addr":"172.21.15.6:6835","nonce":2789884551}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-21T22:35:51.712 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 47 2023-07-21T22:35:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.662+0000 7fa8a4c6a640 1 -- 172.21.15.6:0/4175223811 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fa8800663a0 msgr2=0x7fa880068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.662+0000 7fa8a4c6a640 1 --2- 172.21.15.6:0/4175223811 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fa8800663a0 0x7fa880068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0158f60 tx=0x7fa8880079c0 comp rx=0 tx=0).stop 2023-07-21T22:35:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.662+0000 7fa8a4c6a640 1 -- 172.21.15.6:0/4175223811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a00d06b0 msgr2=0x7fa8a00b6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.662+0000 7fa8a4c6a640 1 --2- 172.21.15.6:0/4175223811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a00d06b0 0x7fa8a00b6620 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fa89000c3c0 tx=0x7fa89000c880 comp rx=0 tx=0).stop 2023-07-21T22:35:51.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.662+0000 7fa8a4c6a640 1 -- 172.21.15.6:0/4175223811 shutdown_connections 2023-07-21T22:35:51.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.662+0000 7fa8a4c6a640 1 --2- 172.21.15.6:0/4175223811 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fa8800663a0 0x7fa880068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:51.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.662+0000 7fa8a4c6a640 1 --2- 172.21.15.6:0/4175223811 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8a00c8700 0x7fa8a00c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:51.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.662+0000 7fa8a4c6a640 1 --2- 172.21.15.6:0/4175223811 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8a00d22e0 0x7fa8a00c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:51.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.662+0000 7fa8a4c6a640 1 --2- 172.21.15.6:0/4175223811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8a00d06b0 0x7fa8a00b6620 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:51.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.662+0000 7fa8a4c6a640 1 -- 172.21.15.6:0/4175223811 >> 172.21.15.6:0/4175223811 conn(0x7fa8a00659d0 msgr2=0x7fa8a00b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:51.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.662+0000 7fa8a4c6a640 1 -- 172.21.15.6:0/4175223811 shutdown_connections 2023-07-21T22:35:51.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:51.662+0000 7fa8a4c6a640 1 -- 172.21.15.6:0/4175223811 wait complete. 2023-07-21T22:35:52.134 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T22:35:40.812228+0000', 'modified': '2023-07-21T22:35:44.851097+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7662}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7662': {'gid': 7662, 'name': 'c', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/2789884551', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6834', 'nonce': 2789884551}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 2789884551}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T22:35:52.135 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T22:35:52.135 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-21T22:35:52.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.230+0000 7f4bf8fd3640 1 Processor -- start 2023-07-21T22:35:52.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.230+0000 7f4bf8fd3640 1 -- start start 2023-07-21T22:35:52.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.234+0000 7f4bf8fd3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4bf4069430 0x7f4bf4069830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.234+0000 7f4bf8fd3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf40c9c30 con 0x7f4bf4160450 2023-07-21T22:35:52.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.234+0000 7f4bf8fd3640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf415bfd0 con 0x7f4bf415bc00 2023-07-21T22:35:52.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.234+0000 7f4bf8fd3640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf40c96b0 con 0x7f4bf4069430 2023-07-21T22:35:52.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.234+0000 7f4bebfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4bf4160450 0x7f4bf406e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39894/0 (socket says 172.21.15.6:39894) 2023-07-21T22:35:52.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.234+0000 7f4bebfff640 1 -- 172.21.15.6:0/2324308249 learned_addr learned my addr 172.21.15.6:0/2324308249 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:52.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.234+0000 7f4bf2d9d640 1 --2- 172.21.15.6:0/2324308249 >> v2:172.21.15.161:3300/0 conn(0x7f4bf4069430 0x7f4bf4069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.234+0000 7f4bf1d9b640 1 -- 172.21.15.6:0/2324308249 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4015560297 0 0) 0x7f4bf40c9c30 con 0x7f4bf4160450 2023-07-21T22:35:52.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.234+0000 7f4bf1d9b640 1 -- 172.21.15.6:0/2324308249 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be0003530 con 0x7f4bf4160450 2023-07-21T22:35:52.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.234+0000 7f4bf1d9b640 1 -- 172.21.15.6:0/2324308249 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1876979272 0 0) 0x7f4be0003530 con 0x7f4bf4160450 2023-07-21T22:35:52.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.234+0000 7f4bf2d9d640 1 -- 172.21.15.6:0/2324308249 >> v1:172.21.15.161:6789/0 conn(0x7f4bf415bc00 legacy=0x7f4bf40ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:52.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.234+0000 7f4bf2d9d640 1 -- 172.21.15.6:0/2324308249 >> v1:172.21.15.6:6789/0 conn(0x7f4bf4160450 legacy=0x7f4bf406e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:52.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.234+0000 7f4bf2d9d640 1 -- 172.21.15.6:0/2324308249 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf4069d70 con 0x7f4bf4069430 2023-07-21T22:35:52.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.238+0000 7f4bf2d9d640 1 --2- 172.21.15.6:0/2324308249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bf4069430 0x7f4bf4069830 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009d90 tx=0x7f4bec01c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92063b8266435c8d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:52.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.238+0000 7f4bf1d9b640 1 -- 172.21.15.6:0/2324308249 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc001680 con 0x7f4bf4069430 2023-07-21T22:35:52.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.238+0000 7f4bf1d9b640 1 -- 172.21.15.6:0/2324308249 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec0a5680 con 0x7f4bf4069430 2023-07-21T22:35:52.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.238+0000 7f4bf1d9b640 1 -- 172.21.15.6:0/2324308249 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0a59f0 con 0x7f4bf4069430 2023-07-21T22:35:52.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.238+0000 7f4bf8fd3640 1 -- 172.21.15.6:0/2324308249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bf4069430 msgr2=0x7f4bf4069830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:52.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.238+0000 7f4bf8fd3640 1 --2- 172.21.15.6:0/2324308249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bf4069430 0x7f4bf4069830 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009d90 tx=0x7f4bec01c840 comp rx=0 tx=0).stop 2023-07-21T22:35:52.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.238+0000 7f4bf8fd3640 1 -- 172.21.15.6:0/2324308249 shutdown_connections 2023-07-21T22:35:52.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.238+0000 7f4bf8fd3640 1 --2- 172.21.15.6:0/2324308249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bf4069430 0x7f4bf4069830 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.238+0000 7f4bf8fd3640 1 -- 172.21.15.6:0/2324308249 >> 172.21.15.6:0/2324308249 conn(0x7f4bf40b1840 msgr2=0x7f4bf40cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:52.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.238+0000 7f4bf8fd3640 1 -- 172.21.15.6:0/2324308249 shutdown_connections 2023-07-21T22:35:52.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.238+0000 7f4bf8fd3640 1 -- 172.21.15.6:0/2324308249 wait complete. 2023-07-21T22:35:52.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.238+0000 7f4bf8fd3640 1 Processor -- start 2023-07-21T22:35:52.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.238+0000 7f4bf8fd3640 1 -- start start 2023-07-21T22:35:52.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4bf8fd3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf4069430 0x7f4bf415aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4bf8fd3640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4bf415bc00 0x7f4bf40b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4bf8fd3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bf4160450 0x7f4bf41523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4bf8fd3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf415b430 con 0x7f4bf4069430 2023-07-21T22:35:52.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4bf8fd3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf40b2870 con 0x7f4bf4160450 2023-07-21T22:35:52.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4bf8fd3640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf40c6130 con 0x7f4bf415bc00 2023-07-21T22:35:52.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4bf259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf4069430 0x7f4bf415aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4bf259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf4069430 0x7f4bf415aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34302/0 (socket says 172.21.15.6:34302) 2023-07-21T22:35:52.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4bf259c640 1 -- 172.21.15.6:0/145863735 learned_addr learned my addr 172.21.15.6:0/145863735 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:52.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4bf259c640 1 -- 172.21.15.6:0/145863735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4bf415bc00 msgr2=0x7f4bf40b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:52.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4bf259c640 1 --2- 172.21.15.6:0/145863735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4bf415bc00 0x7f4bf40b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4bf259c640 1 -- 172.21.15.6:0/145863735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bf4160450 msgr2=0x7f4bf41523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:52.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4bf259c640 1 --2- 172.21.15.6:0/145863735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bf4160450 0x7f4bf41523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4bf259c640 1 -- 172.21.15.6:0/145863735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec009a70 con 0x7f4bf4069430 2023-07-21T22:35:52.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4bf259c640 1 --2- 172.21.15.6:0/145863735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf4069430 0x7f4bf415aef0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f4be400c3c0 tx=0x7f4be400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:52.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4beaffd640 1 -- 172.21.15.6:0/145863735 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be40052d0 con 0x7f4bf4069430 2023-07-21T22:35:52.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4beaffd640 1 -- 172.21.15.6:0/145863735 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be4005430 con 0x7f4bf4069430 2023-07-21T22:35:52.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4bf8fd3640 1 -- 172.21.15.6:0/145863735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf40c6410 con 0x7f4bf4069430 2023-07-21T22:35:52.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4beaffd640 1 -- 172.21.15.6:0/145863735 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4003840 con 0x7f4bf4069430 2023-07-21T22:35:52.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4bf8fd3640 1 -- 172.21.15.6:0/145863735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf40c69d0 con 0x7f4bf4069430 2023-07-21T22:35:52.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.242+0000 7f4beaffd640 1 -- 172.21.15.6:0/145863735 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4be40039a0 con 0x7f4bf4069430 2023-07-21T22:35:52.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4beaffd640 1 --2- 172.21.15.6:0/145863735 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f4bd40663a0 0x7f4bd4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4beaffd640 1 -- 172.21.15.6:0/145863735 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f4be4083520 con 0x7f4bf4069430 2023-07-21T22:35:52.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bebfff640 1 --2- 172.21.15.6:0/145863735 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f4bd40663a0 0x7f4bd4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bfc31d000 1 Processor -- start 2023-07-21T22:35:52.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bfc31d000 1 -- start start 2023-07-21T22:35:52.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bebfff640 1 --2- 172.21.15.6:0/145863735 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f4bd40663a0 0x7f4bd4068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc000c10 tx=0x7f4bdc0011b0 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:52.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bfc31d000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55c833670f00 0x55c8336712d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bfc31d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 0x55c833627370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bfc31d000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c8336278b0 0x55c833627c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bfc31d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8334ee880 con 0x55c833671810 2023-07-21T22:35:52.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bfc31d000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c833428840 con 0x55c8336278b0 2023-07-21T22:35:52.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bfc31d000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c83347c2e0 con 0x55c833670f00 2023-07-21T22:35:52.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bebfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 0x55c833627370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bebfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 0x55c833627370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34306/0 (socket says 172.21.15.6:34306) 2023-07-21T22:35:52.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bebfff640 1 -- 172.21.15.6:0/15697271 learned_addr learned my addr 172.21.15.6:0/15697271 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:52.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bebfff640 1 -- 172.21.15.6:0/15697271 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55c833670f00 msgr2=0x55c8336712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bebfff640 1 --2- 172.21.15.6:0/15697271 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55c833670f00 0x55c8336712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bebfff640 1 -- 172.21.15.6:0/15697271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c8336278b0 msgr2=0x55c833627c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bf2d9d640 1 --2- 172.21.15.6:0/15697271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c8336278b0 0x55c833627c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bebfff640 1 --2- 172.21.15.6:0/15697271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c8336278b0 0x55c833627c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bebfff640 1 -- 172.21.15.6:0/15697271 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c833171890 con 0x55c833671810 2023-07-21T22:35:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bf2d9d640 1 --2- 172.21.15.6:0/15697271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c8336278b0 0x55c833627c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bebfff640 1 --2- 172.21.15.6:0/15697271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 0x55c833627370 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc0017b0 tx=0x7f4bdc00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92282dcc4f0f4414 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bd3fff640 1 -- 172.21.15.6:0/15697271 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc01b070 con 0x55c833671810 2023-07-21T22:35:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bd3fff640 1 -- 172.21.15.6:0/15697271 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc00c730 con 0x55c833671810 2023-07-21T22:35:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.246+0000 7f4bd3fff640 1 -- 172.21.15.6:0/15697271 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc00caa0 con 0x55c833671810 2023-07-21T22:35:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bfc31d000 1 -- 172.21.15.6:0/15697271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 msgr2=0x55c833627370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bfc31d000 1 --2- 172.21.15.6:0/15697271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 0x55c833627370 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc0017b0 tx=0x7f4bdc00f000 comp rx=0 tx=0).stop 2023-07-21T22:35:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bfc31d000 1 -- 172.21.15.6:0/15697271 shutdown_connections 2023-07-21T22:35:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bfc31d000 1 --2- 172.21.15.6:0/15697271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c8336278b0 0x55c833627c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bfc31d000 1 --2- 172.21.15.6:0/15697271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 0x55c833627370 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bfc31d000 1 --2- 172.21.15.6:0/15697271 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55c833670f00 0x55c8336712d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bfc31d000 1 -- 172.21.15.6:0/15697271 >> 172.21.15.6:0/15697271 conn(0x55c83362da10 msgr2=0x55c833625c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:52.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bfc31d000 1 -- 172.21.15.6:0/15697271 shutdown_connections 2023-07-21T22:35:52.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bfc31d000 1 -- 172.21.15.6:0/15697271 wait complete. 2023-07-21T22:35:52.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bfc31d000 1 -- start start 2023-07-21T22:35:52.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bfc31d000 1 Processor -- start 2023-07-21T22:35:52.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bfc31d000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c8336278b0 0x55c8336328e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bfc31d000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55c833670f00 0x55c833632e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bfc31d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 0x55c833633360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bfc31d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c833475380 con 0x55c833671810 2023-07-21T22:35:52.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bfc31d000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c833431ae0 con 0x55c8336278b0 2023-07-21T22:35:52.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bfc31d000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c833431780 con 0x55c833670f00 2023-07-21T22:35:52.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bfc31d000 10 client.0 _ll_register_callbacks cb 0x55c833613240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:35:52.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bf2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 0x55c833633360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bf2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 0x55c833633360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34312/0 (socket says 172.21.15.6:34312) 2023-07-21T22:35:52.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bf2d9d640 1 -- 172.21.15.6:0/702458 learned_addr learned my addr 172.21.15.6:0/702458 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:52.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bf259c640 1 --2- 172.21.15.6:0/702458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c8336278b0 0x55c8336328e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bebfff640 1 --2- 172.21.15.6:0/702458 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55c833670f00 0x55c833632e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bf2d9d640 1 -- 172.21.15.6:0/702458 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55c833670f00 msgr2=0x55c833632e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:52.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bf2d9d640 1 --2- 172.21.15.6:0/702458 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55c833670f00 0x55c833632e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bf2d9d640 1 -- 172.21.15.6:0/702458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c8336278b0 msgr2=0x55c8336328e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:52.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bf2d9d640 1 --2- 172.21.15.6:0/702458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c8336278b0 0x55c8336328e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bf2d9d640 1 -- 172.21.15.6:0/702458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bdc0058e0 con 0x55c833671810 2023-07-21T22:35:52.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bf2d9d640 1 --2- 172.21.15.6:0/702458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 0x55c833633360 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f4bec019450 tx=0x7f4bec0195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90abcb92bad72fc9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:52.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.250+0000 7f4bd17fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:35:52.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bd17fa640 1 -- 172.21.15.6:0/702458 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0a59f0 con 0x55c833671810 2023-07-21T22:35:52.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bd17fa640 1 -- 172.21.15.6:0/702458 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f4bec0a5b50 con 0x55c833671810 2023-07-21T22:35:52.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 1 -- 172.21.15.6:0/702458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c83343ca20 con 0x55c833671810 2023-07-21T22:35:52.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bd17fa640 1 -- 172.21.15.6:0/702458 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bec009450 con 0x55c833671810 2023-07-21T22:35:52.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 10 client.7833 fetch_fsmap learned FSMap version 47 2023-07-21T22:35:52.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 1 -- 172.21.15.6:0/702458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x55c833439d10 con 0x55c833671810 2023-07-21T22:35:52.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bd17fa640 1 -- 172.21.15.6:0/702458 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c83343ca20 con 0x55c833671810 2023-07-21T22:35:52.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bd17fa640 1 -- 172.21.15.6:0/702458 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f4bec0a5d10 con 0x55c833671810 2023-07-21T22:35:52.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 10 client.7833 fetch_fsmap finished waiting for FSMap version 47 2023-07-21T22:35:52.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 10 client.7833 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-21T22:35:52.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 20 client.7833 populate_metadata read hostname 'smithi006' 2023-07-21T22:35:52.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 1 --2- 172.21.15.6:0/702458 >> [v2:172.21.15.6:6834/2789884551,v1:172.21.15.6:6835/2789884551] conn(0x55c833633bd0 0x55c833682450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 4 client.7833 mds_command: new command op to 7662 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:35:52.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 1 -- 172.21.15.6:0/702458 --> [v2:172.21.15.6:6834/2789884551,v1:172.21.15.6:6835/2789884551] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c8334a3ec0 con 0x55c833633bd0 2023-07-21T22:35:52.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bf259c640 1 --2- 172.21.15.6:0/702458 >> [v2:172.21.15.6:6834/2789884551,v1:172.21.15.6:6835/2789884551] conn(0x55c833633bd0 0x55c833682450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bf259c640 1 --2- 172.21.15.6:0/702458 >> [v2:172.21.15.6:6834/2789884551,v1:172.21.15.6:6835/2789884551] conn(0x55c833633bd0 0x55c833682450 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1f2aee9ffac078b server_cookie=5677e2a7d7a4dbdb in_seq=0 out_seq=0 2023-07-21T22:35:52.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bd17fa640 10 client.7833 ms_handle_connect on v2:172.21.15.6:6834/2789884551 2023-07-21T22:35:52.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bd17fa640 1 -- 172.21.15.6:0/702458 <== mds.0 v2:172.21.15.6:6834/2789884551 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c8334a3ec0 con 0x55c833633bd0 2023-07-21T22:35:52.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bd17fa640 10 client.7833 handle_command_reply: tid=0 2023-07-21T22:35:52.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 1 client.7833 shutdown 2023-07-21T22:35:52.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 1 -- 172.21.15.6:0/702458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 msgr2=0x55c833633360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:52.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 1 --2- 172.21.15.6:0/702458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 0x55c833633360 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f4bec019450 tx=0x7f4bec0195e0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 1 -- 172.21.15.6:0/702458 shutdown_connections 2023-07-21T22:35:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 1 --2- 172.21.15.6:0/702458 >> [v2:172.21.15.6:6834/2789884551,v1:172.21.15.6:6835/2789884551] conn(0x55c833633bd0 0x55c833682450 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 1 --2- 172.21.15.6:0/702458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 0x55c833633360 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 1 --2- 172.21.15.6:0/702458 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55c833670f00 0x55c833632e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bd17fa640 0 client.7833 ms_handle_reset on v2:172.21.15.6:6834/2789884551 2023-07-21T22:35:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 1 --2- 172.21.15.6:0/702458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c8336278b0 0x55c8336328e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 1 -- 172.21.15.6:0/702458 >> 172.21.15.6:0/702458 conn(0x55c83362da10 msgr2=0x55c833626350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 1 -- 172.21.15.6:0/702458 shutdown_connections 2023-07-21T22:35:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 1 -- 172.21.15.6:0/702458 wait complete. 2023-07-21T22:35:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.254+0000 7f4bfc31d000 20 client.7833 trim_cache size 0 max 16384 2023-07-21T22:35:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.270+0000 7f4bfc31d000 1 Processor -- start 2023-07-21T22:35:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.270+0000 7f4bfc31d000 1 -- start start 2023-07-21T22:35:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.270+0000 7f4bfc31d000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55c8336278b0 0x55c8336707d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.270+0000 7f4bfc31d000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c833670f00 0x55c833683b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.270+0000 7f4bfc31d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 0x55c8336840b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.270+0000 7f4bfc31d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c83362aee0 con 0x55c833671810 2023-07-21T22:35:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.270+0000 7f4bfc31d000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c833132940 con 0x55c833670f00 2023-07-21T22:35:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.270+0000 7f4bfc31d000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c83362a880 con 0x55c8336278b0 2023-07-21T22:35:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.270+0000 7f4bf2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 0x55c8336840b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.270+0000 7f4bf2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 0x55c8336840b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34316/0 (socket says 172.21.15.6:34316) 2023-07-21T22:35:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.270+0000 7f4bf2d9d640 1 -- 172.21.15.6:0/3908360509 learned_addr learned my addr 172.21.15.6:0/3908360509 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.270+0000 7f4bf2d9d640 1 -- 172.21.15.6:0/3908360509 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55c8336278b0 msgr2=0x55c8336707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bf2d9d640 1 --2- 172.21.15.6:0/3908360509 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55c8336278b0 0x55c8336707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bf2d9d640 1 -- 172.21.15.6:0/3908360509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c833670f00 msgr2=0x55c833683b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bf2d9d640 1 --2- 172.21.15.6:0/3908360509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c833670f00 0x55c833683b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bf2d9d640 1 -- 172.21.15.6:0/3908360509 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c833629f80 con 0x55c833671810 2023-07-21T22:35:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bf2d9d640 1 --2- 172.21.15.6:0/3908360509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 0x55c8336840b0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f4bec01c880 tx=0x7f4bec0b5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec61d0846222c5d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4be8ff9640 1 -- 172.21.15.6:0/3908360509 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec003fb0 con 0x55c833671810 2023-07-21T22:35:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4be8ff9640 1 -- 172.21.15.6:0/3908360509 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec003d40 con 0x55c833671810 2023-07-21T22:35:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4be8ff9640 1 -- 172.21.15.6:0/3908360509 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec004200 con 0x55c833671810 2023-07-21T22:35:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bfc31d000 1 -- 172.21.15.6:0/3908360509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 msgr2=0x55c8336840b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bfc31d000 1 --2- 172.21.15.6:0/3908360509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 0x55c8336840b0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f4bec01c880 tx=0x7f4bec0b5000 comp rx=0 tx=0).stop 2023-07-21T22:35:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bfc31d000 1 -- 172.21.15.6:0/3908360509 shutdown_connections 2023-07-21T22:35:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bfc31d000 1 --2- 172.21.15.6:0/3908360509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833671810 0x55c8336840b0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bfc31d000 1 --2- 172.21.15.6:0/3908360509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c833670f00 0x55c833683b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bfc31d000 1 --2- 172.21.15.6:0/3908360509 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55c8336278b0 0x55c8336707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bfc31d000 1 -- 172.21.15.6:0/3908360509 >> 172.21.15.6:0/3908360509 conn(0x55c83362da10 msgr2=0x55c833682450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bfc31d000 1 -- 172.21.15.6:0/3908360509 shutdown_connections 2023-07-21T22:35:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bfc31d000 1 -- 172.21.15.6:0/3908360509 wait complete. 2023-07-21T22:35:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bfc31d000 1 -- start start 2023-07-21T22:35:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bfc31d000 1 Processor -- start 2023-07-21T22:35:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bfc31d000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55c8336278b0 0x55c8336cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bfc31d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833670f00 0x55c833682b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bfc31d000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c833671810 0x55c8336830a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bfc31d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8334b8580 con 0x55c833670f00 2023-07-21T22:35:52.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bfc31d000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c833472b90 con 0x55c833671810 2023-07-21T22:35:52.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bfc31d000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c83362bab0 con 0x55c8336278b0 2023-07-21T22:35:52.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bfc31d000 10 client.0 _ll_register_callbacks cb 0x55c8335f3430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:35:52.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bebfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833670f00 0x55c833682b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bebfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833670f00 0x55c833682b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34320/0 (socket says 172.21.15.6:34320) 2023-07-21T22:35:52.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bebfff640 1 -- 172.21.15.6:0/3366403769 learned_addr learned my addr 172.21.15.6:0/3366403769 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:52.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bf259c640 1 --2- 172.21.15.6:0/3366403769 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55c8336278b0 0x55c8336cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bf2d9d640 1 --2- 172.21.15.6:0/3366403769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c833671810 0x55c8336830a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bebfff640 1 -- 172.21.15.6:0/3366403769 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55c8336278b0 msgr2=0x55c8336cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:52.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bebfff640 1 --2- 172.21.15.6:0/3366403769 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55c8336278b0 0x55c8336cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bebfff640 1 -- 172.21.15.6:0/3366403769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c833671810 msgr2=0x55c8336830a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:52.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bebfff640 1 --2- 172.21.15.6:0/3366403769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c833671810 0x55c8336830a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bebfff640 1 -- 172.21.15.6:0/3366403769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c833439d10 con 0x55c833670f00 2023-07-21T22:35:52.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.274+0000 7f4bf2d9d640 1 --2- 172.21.15.6:0/3366403769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c833671810 0x55c8336830a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:52.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bebfff640 1 --2- 172.21.15.6:0/3366403769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833670f00 0x55c833682b60 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc005fd0 tx=0x7f4bdc000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a5da6fcebbeb4c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bd17fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:35:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bd17fa640 1 -- 172.21.15.6:0/3366403769 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc01b070 con 0x55c833670f00 2023-07-21T22:35:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 1 -- 172.21.15.6:0/3366403769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c833473cd0 con 0x55c833670f00 2023-07-21T22:35:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bd17fa640 1 -- 172.21.15.6:0/3366403769 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f4bdc012650 con 0x55c833670f00 2023-07-21T22:35:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bd17fa640 1 -- 172.21.15.6:0/3366403769 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bdc026070 con 0x55c833670f00 2023-07-21T22:35:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 10 client.7839 fetch_fsmap learned FSMap version 47 2023-07-21T22:35:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 1 -- 172.21.15.6:0/3366403769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x55c83341ffa0 con 0x55c833670f00 2023-07-21T22:35:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bd17fa640 1 -- 172.21.15.6:0/3366403769 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c833473cd0 con 0x55c833670f00 2023-07-21T22:35:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bd17fa640 1 -- 172.21.15.6:0/3366403769 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f4bdc012810 con 0x55c833670f00 2023-07-21T22:35:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 10 client.7839 fetch_fsmap finished waiting for FSMap version 47 2023-07-21T22:35:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 10 client.7839 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-21T22:35:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 20 client.7839 populate_metadata read hostname 'smithi006' 2023-07-21T22:35:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 1 --2- 172.21.15.6:0/3366403769 >> [v2:172.21.15.6:6834/2789884551,v1:172.21.15.6:6835/2789884551] conn(0x55c8336835e0 0x55c8336839b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 4 client.7839 mds_command: new command op to 7662 tid=0[{"prefix": "status"}] 2023-07-21T22:35:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 1 -- 172.21.15.6:0/3366403769 --> [v2:172.21.15.6:6834/2789884551,v1:172.21.15.6:6835/2789884551] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c83346e360 con 0x55c8336835e0 2023-07-21T22:35:52.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bf259c640 1 --2- 172.21.15.6:0/3366403769 >> [v2:172.21.15.6:6834/2789884551,v1:172.21.15.6:6835/2789884551] conn(0x55c8336835e0 0x55c8336839b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bf259c640 1 --2- 172.21.15.6:0/3366403769 >> [v2:172.21.15.6:6834/2789884551,v1:172.21.15.6:6835/2789884551] conn(0x55c8336835e0 0x55c8336839b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ba6cdf1f99b0e07 server_cookie=a244eb38ac4c9b78 in_seq=0 out_seq=0 2023-07-21T22:35:52.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bd17fa640 10 client.7839 ms_handle_connect on v2:172.21.15.6:6834/2789884551 2023-07-21T22:35:52.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bd17fa640 1 -- 172.21.15.6:0/3366403769 <== mds.0 v2:172.21.15.6:6834/2789884551 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55c83346e360 con 0x55c8336835e0 2023-07-21T22:35:52.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bd17fa640 10 client.7839 handle_command_reply: tid=0 2023-07-21T22:35:52.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 1 client.7839 shutdown 2023-07-21T22:35:52.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 1 -- 172.21.15.6:0/3366403769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833670f00 msgr2=0x55c833682b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:52.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 1 --2- 172.21.15.6:0/3366403769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833670f00 0x55c833682b60 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc005fd0 tx=0x7f4bdc000ee0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 1 -- 172.21.15.6:0/3366403769 shutdown_connections 2023-07-21T22:35:52.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 1 --2- 172.21.15.6:0/3366403769 >> [v2:172.21.15.6:6834/2789884551,v1:172.21.15.6:6835/2789884551] conn(0x55c8336835e0 0x55c8336839b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 1 --2- 172.21.15.6:0/3366403769 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55c833671810 0x55c8336830a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 1 --2- 172.21.15.6:0/3366403769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c833670f00 0x55c833682b60 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bd17fa640 0 client.7839 ms_handle_reset on v2:172.21.15.6:6834/2789884551 2023-07-21T22:35:52.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 1 --2- 172.21.15.6:0/3366403769 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55c8336278b0 0x55c8336cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 1 -- 172.21.15.6:0/3366403769 >> 172.21.15.6:0/3366403769 conn(0x55c83362da10 msgr2=0x55c83362d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:52.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 1 -- 172.21.15.6:0/3366403769 shutdown_connections 2023-07-21T22:35:52.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 1 -- 172.21.15.6:0/3366403769 wait complete. 2023-07-21T22:35:52.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bfc31d000 20 client.7839 trim_cache size 0 max 16384 2023-07-21T22:35:52.409 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:35:52.410 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "f3073df4-6cd1-4503-bd2e-d3e98fa18bdf", 2023-07-21T22:35:52.410 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-07-21T22:35:52.410 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 7662, 2023-07-21T22:35:52.410 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-07-21T22:35:52.410 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-07-21T22:35:52.410 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-07-21T22:35:52.410 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.828014748999999, 2023-07-21T22:35:52.410 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 47, 2023-07-21T22:35:52.411 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 112, 2023-07-21T22:35:52.411 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 112, 2023-07-21T22:35:52.411 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 16.778704264000002 2023-07-21T22:35:52.411 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:35:52.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bf8fd3640 1 -- 172.21.15.6:0/145863735 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f4bd40663a0 msgr2=0x7f4bd4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:52.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bf8fd3640 1 --2- 172.21.15.6:0/145863735 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f4bd40663a0 0x7f4bd4068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc000c10 tx=0x7f4bdc0011b0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bf8fd3640 1 -- 172.21.15.6:0/145863735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf4069430 msgr2=0x7f4bf415aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:52.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bf8fd3640 1 --2- 172.21.15.6:0/145863735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf4069430 0x7f4bf415aef0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f4be400c3c0 tx=0x7f4be400c880 comp rx=0 tx=0).stop 2023-07-21T22:35:52.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bf8fd3640 1 -- 172.21.15.6:0/145863735 shutdown_connections 2023-07-21T22:35:52.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bf8fd3640 1 --2- 172.21.15.6:0/145863735 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f4bd40663a0 0x7f4bd4068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bf8fd3640 1 --2- 172.21.15.6:0/145863735 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bf4160450 0x7f4bf41523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bf8fd3640 1 --2- 172.21.15.6:0/145863735 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4bf415bc00 0x7f4bf40b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bf8fd3640 1 --2- 172.21.15.6:0/145863735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf4069430 0x7f4bf415aef0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bf8fd3640 1 -- 172.21.15.6:0/145863735 >> 172.21.15.6:0/145863735 conn(0x7f4bf40b1840 msgr2=0x7f4bf414ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:52.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bf8fd3640 1 -- 172.21.15.6:0/145863735 shutdown_connections 2023-07-21T22:35:52.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.278+0000 7f4bf8fd3640 1 -- 172.21.15.6:0/145863735 wait complete. 2023-07-21T22:35:52.414 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:35:52.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.506+0000 7fcfd3174640 1 Processor -- start 2023-07-21T22:35:52.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.506+0000 7fcfd3174640 1 -- start start 2023-07-21T22:35:52.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfd3174640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcfcc15fdf0 0x7fcfcc0c9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfd3174640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfcc0cb080 con 0x7fcfcc15bdf0 2023-07-21T22:35:52.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfd3174640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfcc0cb2e0 con 0x7fcfcc15f970 2023-07-21T22:35:52.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfd3174640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfcc0cb5c0 con 0x7fcfcc15fdf0 2023-07-21T22:35:52.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfd0f10640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcfcc15bdf0 0x7fcfcc0ca970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39898/0 (socket says 172.21.15.6:39898) 2023-07-21T22:35:52.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfd0f10640 1 -- 172.21.15.6:0/1830389579 learned_addr learned my addr 172.21.15.6:0/1830389579 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:52.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfd1711640 1 --2- 172.21.15.6:0/1830389579 >> v2:172.21.15.161:3300/0 conn(0x7fcfcc15fdf0 0x7fcfcc0c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/1830389579 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385671586 0 0) 0x7fcfcc0cb080 con 0x7fcfcc15bdf0 2023-07-21T22:35:52.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/1830389579 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfbc003530 con 0x7fcfcc15bdf0 2023-07-21T22:35:52.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/1830389579 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1851931221 0 0) 0x7fcfbc003530 con 0x7fcfcc15bdf0 2023-07-21T22:35:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/1830389579 >> v2:172.21.15.161:3300/0 conn(0x7fcfcc15fdf0 msgr2=0x7fcfcc0c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfcb7fe640 1 --2- 172.21.15.6:0/1830389579 >> v2:172.21.15.161:3300/0 conn(0x7fcfcc15fdf0 0x7fcfcc0c9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/1830389579 >> v1:172.21.15.161:6789/0 conn(0x7fcfcc15f970 legacy=0x7fcfcc0c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/1830389579 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc0cb8a0 con 0x7fcfcc15bdf0 2023-07-21T22:35:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/1830389579 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fcfc0001680 con 0x7fcfcc15bdf0 2023-07-21T22:35:52.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/1830389579 >> v1:172.21.15.6:6789/0 conn(0x7fcfcc15bdf0 legacy=0x7fcfcc0ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfcb7fe640 1 --2- 172.21.15.6:0/1830389579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfbc003980 0x7fcfbc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfcb7fe640 1 --2- 172.21.15.6:0/1830389579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfbc0047d0 0x7fcfbc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfcb7fe640 1 --2- 172.21.15.6:0/1830389579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfbc005180 0x7fcfbc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/1830389579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc0cb5c0 con 0x7fcfbc003980 2023-07-21T22:35:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/1830389579 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc00c090 con 0x7fcfbc0047d0 2023-07-21T22:35:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/1830389579 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc00c250 con 0x7fcfbc005180 2023-07-21T22:35:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfd0f10640 1 --2- 172.21.15.6:0/1830389579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfbc003980 0x7fcfbc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfcbfff640 1 --2- 172.21.15.6:0/1830389579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfbc0047d0 0x7fcfbc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfd1711640 1 --2- 172.21.15.6:0/1830389579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfbc005180 0x7fcfbc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfd0f10640 1 -- 172.21.15.6:0/1830389579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfbc005180 msgr2=0x7fcfbc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfd0f10640 1 --2- 172.21.15.6:0/1830389579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfbc005180 0x7fcfbc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfd0f10640 1 -- 172.21.15.6:0/1830389579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfbc0047d0 msgr2=0x7fcfbc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfd0f10640 1 --2- 172.21.15.6:0/1830389579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfbc0047d0 0x7fcfbc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfd0f10640 1 -- 172.21.15.6:0/1830389579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc003530 con 0x7fcfbc003980 2023-07-21T22:35:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfcbfff640 1 --2- 172.21.15.6:0/1830389579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfbc0047d0 0x7fcfbc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:52.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.510+0000 7fcfd1711640 1 -- 172.21.15.6:0/1830389579 reap_dead start 2023-07-21T22:35:52.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.514+0000 7fcfd0f10640 1 --2- 172.21.15.6:0/1830389579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfbc003980 0x7fcfbc003d90 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000c240 tx=0x7fcfc001cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ea66367011d8ad server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:52.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.514+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/1830389579 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0005ae0 con 0x7fcfbc003980 2023-07-21T22:35:52.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.514+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/1830389579 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc0005c40 con 0x7fcfbc003980 2023-07-21T22:35:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.514+0000 7fcfcb7fe640 1 -- 172.21.15.6:0/1830389579 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc00a5ad0 con 0x7fcfbc003980 2023-07-21T22:35:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.514+0000 7fcfd3174640 1 -- 172.21.15.6:0/1830389579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfbc003980 msgr2=0x7fcfbc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.514+0000 7fcfd3174640 1 --2- 172.21.15.6:0/1830389579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfbc003980 0x7fcfbc003d90 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fcfc000c240 tx=0x7fcfc001cb90 comp rx=0 tx=0).stop 2023-07-21T22:35:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.514+0000 7fcfd3174640 1 -- 172.21.15.6:0/1830389579 shutdown_connections 2023-07-21T22:35:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.514+0000 7fcfd3174640 1 --2- 172.21.15.6:0/1830389579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfbc003980 0x7fcfbc003d90 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.514+0000 7fcfd3174640 1 -- 172.21.15.6:0/1830389579 >> 172.21.15.6:0/1830389579 conn(0x7fcfcc0afcf0 msgr2=0x7fcfcc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.514+0000 7fcfd3174640 1 -- 172.21.15.6:0/1830389579 shutdown_connections 2023-07-21T22:35:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.514+0000 7fcfd3174640 1 -- 172.21.15.6:0/1830389579 wait complete. 2023-07-21T22:35:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.514+0000 7fcfd3174640 1 Processor -- start 2023-07-21T22:35:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.514+0000 7fcfd3174640 1 -- start start 2023-07-21T22:35:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfd3174640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfbc003980 0x7fcfcc1f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfd3174640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfcc0adb60 0x7fcfcc0b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfd3174640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfcc158920 0x7fcfcc0c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfd3174640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc0aeba0 con 0x7fcfcc158920 2023-07-21T22:35:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfd3174640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc0ae300 con 0x7fcfcc0adb60 2023-07-21T22:35:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfd3174640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc0ae5e0 con 0x7fcfbc003980 2023-07-21T22:35:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfd1711640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfcc158920 0x7fcfcc0c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfd1711640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfcc158920 0x7fcfcc0c9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34338/0 (socket says 172.21.15.6:34338) 2023-07-21T22:35:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfd1711640 1 -- 172.21.15.6:0/105429190 learned_addr learned my addr 172.21.15.6:0/105429190 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfd0f10640 1 --2- 172.21.15.6:0/105429190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfbc003980 0x7fcfcc1f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfcbfff640 1 --2- 172.21.15.6:0/105429190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfcc0adb60 0x7fcfcc0b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfd1711640 1 -- 172.21.15.6:0/105429190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfbc003980 msgr2=0x7fcfcc1f4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfd1711640 1 --2- 172.21.15.6:0/105429190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfbc003980 0x7fcfcc1f4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfd1711640 1 -- 172.21.15.6:0/105429190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfcc0adb60 msgr2=0x7fcfcc0b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfd1711640 1 --2- 172.21.15.6:0/105429190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfcc0adb60 0x7fcfcc0b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfd1711640 1 -- 172.21.15.6:0/105429190 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc0ae8c0 con 0x7fcfcc158920 2023-07-21T22:35:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfd1711640 1 --2- 172.21.15.6:0/105429190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfcc158920 0x7fcfcc0c9300 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc0cc1f0 tx=0x7fcfc4007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfc97fa640 1 -- 172.21.15.6:0/105429190 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc400e070 con 0x7fcfcc158920 2023-07-21T22:35:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfc97fa640 1 -- 172.21.15.6:0/105429190 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc4003c70 con 0x7fcfcc158920 2023-07-21T22:35:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfc97fa640 1 -- 172.21.15.6:0/105429190 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4003e60 con 0x7fcfcc158920 2023-07-21T22:35:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfd3174640 1 -- 172.21.15.6:0/105429190 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfcc15de40 con 0x7fcfcc158920 2023-07-21T22:35:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfd3174640 1 -- 172.21.15.6:0/105429190 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfcc0b2440 con 0x7fcfcc158920 2023-07-21T22:35:52.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.518+0000 7fcfd3174640 1 -- 172.21.15.6:0/105429190 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfcc15e030 con 0x7fcfcc158920 2023-07-21T22:35:52.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.522+0000 7fcfc97fa640 1 -- 172.21.15.6:0/105429190 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcfc4004030 con 0x7fcfcc158920 2023-07-21T22:35:52.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.522+0000 7fcfc97fa640 1 --2- 172.21.15.6:0/105429190 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fcfb00663a0 0x7fcfb0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:52.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.522+0000 7fcfc97fa640 1 -- 172.21.15.6:0/105429190 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fcfc4083c90 con 0x7fcfcc158920 2023-07-21T22:35:52.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.522+0000 7fcfd0f10640 1 --2- 172.21.15.6:0/105429190 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fcfb00663a0 0x7fcfb0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:52.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.522+0000 7fcfd0f10640 1 --2- 172.21.15.6:0/105429190 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fcfb00663a0 0x7fcfb0068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00ab000 tx=0x7fcfc00b1040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:52.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.526+0000 7fcfc97fa640 1 -- 172.21.15.6:0/105429190 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcfc4051000 con 0x7fcfcc158920 2023-07-21T22:35:52.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.714+0000 7fcfd3174640 1 -- 172.21.15.6:0/105429190 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcfcc1601c0 con 0x7fcfcc158920 2023-07-21T22:35:52.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.714+0000 7fcfc97fa640 1 -- 172.21.15.6:0/105429190 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcfc4054620 con 0x7fcfcc158920 2023-07-21T22:35:52.764 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T22:35:52.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.714+0000 7fcfd3174640 1 -- 172.21.15.6:0/105429190 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fcfb00663a0 msgr2=0x7fcfb0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:52.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.714+0000 7fcfd3174640 1 --2- 172.21.15.6:0/105429190 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fcfb00663a0 0x7fcfb0068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00ab000 tx=0x7fcfc00b1040 comp rx=0 tx=0).stop 2023-07-21T22:35:52.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.714+0000 7fcfd3174640 1 -- 172.21.15.6:0/105429190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfcc158920 msgr2=0x7fcfcc0c9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:52.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.714+0000 7fcfd3174640 1 --2- 172.21.15.6:0/105429190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfcc158920 0x7fcfcc0c9300 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc0cc1f0 tx=0x7fcfc4007dd0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.714+0000 7fcfd3174640 1 -- 172.21.15.6:0/105429190 shutdown_connections 2023-07-21T22:35:52.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.714+0000 7fcfd3174640 1 --2- 172.21.15.6:0/105429190 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fcfb00663a0 0x7fcfb0068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.714+0000 7fcfd3174640 1 --2- 172.21.15.6:0/105429190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfcc158920 0x7fcfcc0c9300 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.714+0000 7fcfd3174640 1 --2- 172.21.15.6:0/105429190 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfcc0adb60 0x7fcfcc0b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.714+0000 7fcfd3174640 1 --2- 172.21.15.6:0/105429190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfbc003980 0x7fcfcc1f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:52.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.714+0000 7fcfd3174640 1 -- 172.21.15.6:0/105429190 >> 172.21.15.6:0/105429190 conn(0x7fcfcc0afcf0 msgr2=0x7fcfcc0ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:52.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.714+0000 7fcfd3174640 1 -- 172.21.15.6:0/105429190 shutdown_connections 2023-07-21T22:35:52.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:52.714+0000 7fcfd3174640 1 -- 172.21.15.6:0/105429190 wait complete. 2023-07-21T22:35:52.785 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-21T22:35:52.786 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:35:52.786 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-07-21T22:35:52.786 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T22:35:52.787 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T22:35:52.787 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-21T22:35:52.787 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-21T22:35:52.787 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:35:52.788 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:35:52.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:35:52.788 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-07-21T22:35:52.798 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:35:52.798 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:35:52.798 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:35:52.798 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:35:52.799 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-21T22:35:52.799 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:35:52.799 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:35:52.799 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:35:52.799 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-07-21T22:35:52.799 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:35:52.799 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:35:52.800 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-07-21T22:35:52.800 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:35:52.800 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:35:52.800 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-07-21T22:35:52.800 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:35:52.800 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41093sec preferred_lft 41093sec 2023-07-21T22:35:52.800 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-07-21T22:35:52.801 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:35:52.801 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:35:52.801 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:35:52.801 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-07-21T22:35:52.801 INFO:teuthology.orchestra.run.smithi006.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:35:52.801 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:42:2f:9a:3d:15 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:35:52.801 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:35:52.801 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:35:52.802 INFO:teuthology.orchestra.run.smithi006.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:35:52.802 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-21T22:35:52.802 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T22:35:52.802 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:35:52.802 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-21T22:35:52.802 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:35:52.803 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:35:52.803 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:35:52.803 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-21T22:35:52.804 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:35:52.804 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:35:52.804 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T22:35:52.804 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-21T22:35:52.804 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:35:52.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:35:52.805 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:35:52.866 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-07-21T22:35:52.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:35:52.868 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-07-21T22:35:52.920 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-07-21T22:35:52.920 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:35:52.920 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:35:52.920 INFO:teuthology.orchestra.run.smithi006.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:35:52.921 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:35:52.921 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:35:52.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:35:52.921 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T22:35:52.922 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T22:35:52.922 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:35:52.922 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:35:52.923 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:35:52.923 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T22:35:53.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:35:53.016 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T22:35:53.026 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-21T22:35:53.027 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T22:35:53.027 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:35:53.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:35:53.028 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-07-21T22:35:53.092 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:35:53.093 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T22:35:53.143 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:35:53.143 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:35:53.143 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:35:53.194 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-21T22:35:53.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:35:53.195 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:35:53.294 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:35:53.295 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:35:53.295 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:35:53.310 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:35:53.310 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:35:53.311 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:35:53.311 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:35:53.311 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:35:53.319 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:35:53.319 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:35:53.319 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:35:53.319 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:35:53.320 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:35:53.320 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-07-21T22:35:53.320 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-07-21T22:35:53.320 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f3073df4-6cd1-4503-bd2e-d3e98fa18bdf" will pass to kernel 2023-07-21T22:35:53.323 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T22:35:53.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:35:53.324 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:35:53.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:35:53.347 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:35:53.412 INFO:teuthology.orchestra.run.smithi006.stdout:client7848 2023-07-21T22:35:53.413 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:35:53.413 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:35:53.463 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-21T22:35:53.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.602+0000 7fc3b6e34640 1 Processor -- start 2023-07-21T22:35:53.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.602+0000 7fc3b6e34640 1 -- start start 2023-07-21T22:35:53.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.606+0000 7fc3b6e34640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc3b00ae1f0 0x7fc3b00b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.606+0000 7fc3b6e34640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3b006e160 0x7fc3b006bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.606+0000 7fc3b6e34640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b006a440 con 0x7fc3b006c260 2023-07-21T22:35:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.606+0000 7fc3b6e34640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b006c660 con 0x7fc3b006e160 2023-07-21T22:35:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.606+0000 7fc3b6e34640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b00b24f0 con 0x7fc3b00ae1f0 2023-07-21T22:35:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.606+0000 7fc3affff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3b006e160 0x7fc3b006bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.606+0000 7fc3affff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3b006e160 0x7fc3b006bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34350/0 (socket says 172.21.15.6:34350) 2023-07-21T22:35:53.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.606+0000 7fc3affff640 1 -- 172.21.15.6:0/4126970587 learned_addr learned my addr 172.21.15.6:0/4126970587 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:53.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.606+0000 7fc3b4bd0640 1 --2- 172.21.15.6:0/4126970587 >> v2:172.21.15.161:3300/0 conn(0x7fc3b00ae1f0 0x7fc3b00b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:53.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.606+0000 7fc3affff640 1 -- 172.21.15.6:0/4126970587 >> v2:172.21.15.161:3300/0 conn(0x7fc3b00ae1f0 msgr2=0x7fc3b00b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:53.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.606+0000 7fc3affff640 1 --2- 172.21.15.6:0/4126970587 >> v2:172.21.15.161:3300/0 conn(0x7fc3b00ae1f0 0x7fc3b00b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:53.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.606+0000 7fc3affff640 1 -- 172.21.15.6:0/4126970587 >> v1:172.21.15.161:6789/0 conn(0x7fc3b006c260 legacy=0x7fc3b015f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:53.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.606+0000 7fc3affff640 1 -- 172.21.15.6:0/4126970587 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b00b27d0 con 0x7fc3b006e160 2023-07-21T22:35:53.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.606+0000 7fc3b4bd0640 1 --2- 172.21.15.6:0/4126970587 >> v2:172.21.15.161:3300/0 conn(0x7fc3b00ae1f0 0x7fc3b00b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:53.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3affff640 1 --2- 172.21.15.6:0/4126970587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b006e160 0x7fc3b006bd20 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00cf340 tx=0x7fc39c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3853d6d12f54dd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:53.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3af7fe640 1 -- 172.21.15.6:0/4126970587 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c0ab5f0 con 0x7fc3b006e160 2023-07-21T22:35:53.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3af7fe640 1 -- 172.21.15.6:0/4126970587 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39c0ab750 con 0x7fc3b006e160 2023-07-21T22:35:53.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3af7fe640 1 -- 172.21.15.6:0/4126970587 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c0abae0 con 0x7fc3b006e160 2023-07-21T22:35:53.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b6e34640 1 -- 172.21.15.6:0/4126970587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b006e160 msgr2=0x7fc3b006bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:53.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b6e34640 1 --2- 172.21.15.6:0/4126970587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b006e160 0x7fc3b006bd20 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00cf340 tx=0x7fc39c01c4d0 comp rx=0 tx=0).stop 2023-07-21T22:35:53.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b6e34640 1 -- 172.21.15.6:0/4126970587 shutdown_connections 2023-07-21T22:35:53.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b6e34640 1 --2- 172.21.15.6:0/4126970587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b006e160 0x7fc3b006bd20 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:53.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b6e34640 1 --2- 172.21.15.6:0/4126970587 >> v2:172.21.15.161:3300/0 conn(0x7fc3b00ae1f0 0x7fc3b00b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:53.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b6e34640 1 -- 172.21.15.6:0/4126970587 >> 172.21.15.6:0/4126970587 conn(0x7fc3b00b1300 msgr2=0x7fc3b00ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:53.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b6e34640 1 -- 172.21.15.6:0/4126970587 shutdown_connections 2023-07-21T22:35:53.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b6e34640 1 -- 172.21.15.6:0/4126970587 wait complete. 2023-07-21T22:35:53.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b6e34640 1 Processor -- start 2023-07-21T22:35:53.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b6e34640 1 -- start start 2023-07-21T22:35:53.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b6e34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3b006c260 0x7fc3b013e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:53.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b6e34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b006e160 0x7fc3b015a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:53.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b6e34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3b00ae1f0 0x7fc3b00cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:53.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b6e34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b013d8c0 con 0x7fc3b006e160 2023-07-21T22:35:53.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b6e34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b013dba0 con 0x7fc3b00ae1f0 2023-07-21T22:35:53.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b6e34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b013de80 con 0x7fc3b006c260 2023-07-21T22:35:53.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3affff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b006e160 0x7fc3b015a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:53.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b4bd0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3b006c260 0x7fc3b013e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:53.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b53d1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3b00ae1f0 0x7fc3b00cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:53.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3affff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b006e160 0x7fc3b015a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34358/0 (socket says 172.21.15.6:34358) 2023-07-21T22:35:53.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3affff640 1 -- 172.21.15.6:0/1649056694 learned_addr learned my addr 172.21.15.6:0/1649056694 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:53.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3affff640 1 -- 172.21.15.6:0/1649056694 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3b006c260 msgr2=0x7fc3b013e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:53.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3affff640 1 --2- 172.21.15.6:0/1649056694 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3b006c260 0x7fc3b013e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:53.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3affff640 1 -- 172.21.15.6:0/1649056694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3b00ae1f0 msgr2=0x7fc3b00cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:53.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3affff640 1 --2- 172.21.15.6:0/1649056694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3b00ae1f0 0x7fc3b00cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:53.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3affff640 1 -- 172.21.15.6:0/1649056694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c0094d0 con 0x7fc3b006e160 2023-07-21T22:35:53.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3affff640 1 --2- 172.21.15.6:0/1649056694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b006e160 0x7fc3b015a8b0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fc39c0190e0 tx=0x7fc39c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:53.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3ad7fa640 1 -- 172.21.15.6:0/1649056694 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c0be5f0 con 0x7fc3b006e160 2023-07-21T22:35:53.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3ad7fa640 1 -- 172.21.15.6:0/1649056694 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39c0be750 con 0x7fc3b006e160 2023-07-21T22:35:53.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3ad7fa640 1 -- 172.21.15.6:0/1649056694 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39c0beb00 con 0x7fc3b006e160 2023-07-21T22:35:53.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b6e34640 1 -- 172.21.15.6:0/1649056694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b013e160 con 0x7fc3b006e160 2023-07-21T22:35:53.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b6e34640 1 -- 172.21.15.6:0/1649056694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b015adf0 con 0x7fc3b006e160 2023-07-21T22:35:53.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.610+0000 7fc3b6e34640 1 -- 172.21.15.6:0/1649056694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b00678d0 con 0x7fc3b006e160 2023-07-21T22:35:53.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.614+0000 7fc3ad7fa640 1 -- 172.21.15.6:0/1649056694 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc39c0b43f0 con 0x7fc3b006e160 2023-07-21T22:35:53.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.614+0000 7fc3ad7fa640 1 --2- 172.21.15.6:0/1649056694 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fc3940663a0 0x7fc394068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:53.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.614+0000 7fc3ad7fa640 1 -- 172.21.15.6:0/1649056694 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fc39c0a8050 con 0x7fc3b006e160 2023-07-21T22:35:53.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.614+0000 7fc3b4bd0640 1 --2- 172.21.15.6:0/1649056694 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fc3940663a0 0x7fc394068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:53.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.614+0000 7fc3b4bd0640 1 --2- 172.21.15.6:0/1649056694 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fc3940663a0 0x7fc394068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00cb130 tx=0x7fc3a4008040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:53.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.618+0000 7fc3ad7fa640 1 -- 172.21.15.6:0/1649056694 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc39c0ebf20 con 0x7fc3b006e160 2023-07-21T22:35:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.794+0000 7fc3b6e34640 1 -- 172.21.15.6:0/1649056694 --> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3b006e5c0 con 0x7fc3940663a0 2023-07-21T22:35:53.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.798+0000 7fc3ad7fa640 1 -- 172.21.15.6:0/1649056694 <== mgr.7255 v2:172.21.15.161:6832/3891612664 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc3a40108a0 con 0x7fc3940663a0 2023-07-21T22:35:53.846 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:35:53.847 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:35:53.847 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephfs" 2023-07-21T22:35:53.847 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:35:53.847 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:35:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.798+0000 7fc3b6e34640 1 -- 172.21.15.6:0/1649056694 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fc3940663a0 msgr2=0x7fc394068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:53.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.798+0000 7fc3b6e34640 1 --2- 172.21.15.6:0/1649056694 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fc3940663a0 0x7fc394068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00cb130 tx=0x7fc3a4008040 comp rx=0 tx=0).stop 2023-07-21T22:35:53.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.798+0000 7fc3b6e34640 1 -- 172.21.15.6:0/1649056694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b006e160 msgr2=0x7fc3b015a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:53.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.798+0000 7fc3b6e34640 1 --2- 172.21.15.6:0/1649056694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b006e160 0x7fc3b015a8b0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fc39c0190e0 tx=0x7fc39c01ad10 comp rx=0 tx=0).stop 2023-07-21T22:35:53.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.798+0000 7fc3b6e34640 1 -- 172.21.15.6:0/1649056694 shutdown_connections 2023-07-21T22:35:53.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.798+0000 7fc3b6e34640 1 --2- 172.21.15.6:0/1649056694 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fc3940663a0 0x7fc394068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:53.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.798+0000 7fc3b6e34640 1 --2- 172.21.15.6:0/1649056694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3b00ae1f0 0x7fc3b00cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:53.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.798+0000 7fc3b6e34640 1 --2- 172.21.15.6:0/1649056694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3b006e160 0x7fc3b015a8b0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:53.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.798+0000 7fc3b6e34640 1 --2- 172.21.15.6:0/1649056694 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3b006c260 0x7fc3b013e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:53.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.798+0000 7fc3b6e34640 1 -- 172.21.15.6:0/1649056694 >> 172.21.15.6:0/1649056694 conn(0x7fc3b00b1300 msgr2=0x7fc3b00afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:53.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.798+0000 7fc3b6e34640 1 -- 172.21.15.6:0/1649056694 shutdown_connections 2023-07-21T22:35:53.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.798+0000 7fc3b6e34640 1 -- 172.21.15.6:0/1649056694 wait complete. 2023-07-21T22:35:53.867 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-21T22:35:54.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.966+0000 7fc23e4ec640 1 Processor -- start 2023-07-21T22:35:54.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.966+0000 7fc23e4ec640 1 -- start start 2023-07-21T22:35:54.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23e4ec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2380ce620 0x7fc2380ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:54.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23e4ec640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc23806e700 0x7fc23806c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:54.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23e4ec640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2380c6140 con 0x7fc23815c050 2023-07-21T22:35:54.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23e4ec640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc23806c3f0 con 0x7fc23806e700 2023-07-21T22:35:54.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23e4ec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2380cef30 con 0x7fc2380ce620 2023-07-21T22:35:54.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc2377fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc23815c050 0x7fc23815f9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39900/0 (socket says 172.21.15.6:39900) 2023-07-21T22:35:54.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc2377fe640 1 -- 172.21.15.6:0/573959026 learned_addr learned my addr 172.21.15.6:0/573959026 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:35:54.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23ca89640 1 --2- 172.21.15.6:0/573959026 >> v2:172.21.15.161:3300/0 conn(0x7fc23806e700 0x7fc23806c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:54.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc237fff640 1 --2- 172.21.15.6:0/573959026 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2380ce620 0x7fc2380ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:54.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc236ffd640 1 -- 172.21.15.6:0/573959026 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4049229327 0 0) 0x7fc2380c6140 con 0x7fc23815c050 2023-07-21T22:35:54.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc236ffd640 1 -- 172.21.15.6:0/573959026 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc220003530 con 0x7fc23815c050 2023-07-21T22:35:54.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23ca89640 1 -- 172.21.15.6:0/573959026 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2380ce620 msgr2=0x7fc2380ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:54.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23ca89640 1 --2- 172.21.15.6:0/573959026 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2380ce620 0x7fc2380ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:54.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc236ffd640 1 -- 172.21.15.6:0/573959026 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1386281974 0 0) 0x7fc220003530 con 0x7fc23815c050 2023-07-21T22:35:54.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23ca89640 1 -- 172.21.15.6:0/573959026 >> v1:172.21.15.6:6789/0 conn(0x7fc23815c050 legacy=0x7fc23815f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:54.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23ca89640 1 -- 172.21.15.6:0/573959026 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23806dab0 con 0x7fc23806e700 2023-07-21T22:35:54.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23ca89640 1 --2- 172.21.15.6:0/573959026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc23806e700 0x7fc23806c840 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc230009d90 tx=0x7fc23001c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4835abe8d67cfb5f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:54.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc236ffd640 1 -- 172.21.15.6:0/573959026 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c001680 con 0x7fc23806e700 2023-07-21T22:35:54.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc236ffd640 1 -- 172.21.15.6:0/573959026 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2300a5550 con 0x7fc23806e700 2023-07-21T22:35:54.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc236ffd640 1 -- 172.21.15.6:0/573959026 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2300a58c0 con 0x7fc23806e700 2023-07-21T22:35:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23e4ec640 1 -- 172.21.15.6:0/573959026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc23806e700 msgr2=0x7fc23806c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23e4ec640 1 --2- 172.21.15.6:0/573959026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc23806e700 0x7fc23806c840 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc230009d90 tx=0x7fc23001c840 comp rx=0 tx=0).stop 2023-07-21T22:35:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23e4ec640 1 -- 172.21.15.6:0/573959026 shutdown_connections 2023-07-21T22:35:54.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23e4ec640 1 --2- 172.21.15.6:0/573959026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc23806e700 0x7fc23806c840 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23e4ec640 1 --2- 172.21.15.6:0/573959026 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2380ce620 0x7fc2380ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23e4ec640 1 -- 172.21.15.6:0/573959026 >> 172.21.15.6:0/573959026 conn(0x7fc2380cc9a0 msgr2=0x7fc2380cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23e4ec640 1 -- 172.21.15.6:0/573959026 shutdown_connections 2023-07-21T22:35:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23e4ec640 1 -- 172.21.15.6:0/573959026 wait complete. 2023-07-21T22:35:54.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23e4ec640 1 Processor -- start 2023-07-21T22:35:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.970+0000 7fc23e4ec640 1 -- start start 2023-07-21T22:35:54.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc23e4ec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc23806e700 0x7fc2380b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc23e4ec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2380ce620 0x7fc2380b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc23e4ec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc23815c050 0x7fc238157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc23e4ec640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc238157d70 con 0x7fc2380ce620 2023-07-21T22:35:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc23e4ec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc238158150 con 0x7fc23815c050 2023-07-21T22:35:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc23e4ec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc238158430 con 0x7fc23806e700 2023-07-21T22:35:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc2377fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2380ce620 0x7fc2380b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc2377fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2380ce620 0x7fc2380b3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34360/0 (socket says 172.21.15.6:34360) 2023-07-21T22:35:54.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc2377fe640 1 -- 172.21.15.6:0/930714312 learned_addr learned my addr 172.21.15.6:0/930714312 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc23ca89640 1 --2- 172.21.15.6:0/930714312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc23815c050 0x7fc238157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc237fff640 1 --2- 172.21.15.6:0/930714312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc23806e700 0x7fc2380b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc2377fe640 1 -- 172.21.15.6:0/930714312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc23806e700 msgr2=0x7fc2380b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc2377fe640 1 --2- 172.21.15.6:0/930714312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc23806e700 0x7fc2380b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc2377fe640 1 -- 172.21.15.6:0/930714312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc23815c050 msgr2=0x7fc238157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc2377fe640 1 --2- 172.21.15.6:0/930714312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc23815c050 0x7fc238157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:54.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc2377fe640 1 -- 172.21.15.6:0/930714312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc230009a70 con 0x7fc2380ce620 2023-07-21T22:35:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc2377fe640 1 --2- 172.21.15.6:0/930714312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2380ce620 0x7fc2380b3ad0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00c750 tx=0x7fc22c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc234ff9640 1 -- 172.21.15.6:0/930714312 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c005ae0 con 0x7fc2380ce620 2023-07-21T22:35:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc234ff9640 1 -- 172.21.15.6:0/930714312 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22c005c40 con 0x7fc2380ce620 2023-07-21T22:35:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc234ff9640 1 -- 172.21.15.6:0/930714312 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c007070 con 0x7fc2380ce620 2023-07-21T22:35:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc23e4ec640 1 -- 172.21.15.6:0/930714312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc238158710 con 0x7fc2380ce620 2023-07-21T22:35:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc23e4ec640 1 -- 172.21.15.6:0/930714312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc238158cd0 con 0x7fc2380ce620 2023-07-21T22:35:54.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc23e4ec640 1 -- 172.21.15.6:0/930714312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc238158ef0 con 0x7fc2380ce620 2023-07-21T22:35:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.974+0000 7fc234ff9640 1 -- 172.21.15.6:0/930714312 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc22c0071d0 con 0x7fc2380ce620 2023-07-21T22:35:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.978+0000 7fc234ff9640 1 --2- 172.21.15.6:0/930714312 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fc2240663a0 0x7fc224068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.978+0000 7fc234ff9640 1 -- 172.21.15.6:0/930714312 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fc22c083b60 con 0x7fc2380ce620 2023-07-21T22:35:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.978+0000 7fc237fff640 1 --2- 172.21.15.6:0/930714312 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fc2240663a0 0x7fc224068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:54.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.978+0000 7fc237fff640 1 --2- 172.21.15.6:0/930714312 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fc2240663a0 0x7fc224068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc2380b13a0 tx=0x7fc228009190 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:53.982+0000 7fc234ff9640 1 -- 172.21.15.6:0/930714312 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc22c050ed0 con 0x7fc2380ce620 2023-07-21T22:35:54.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:54.174+0000 7fc23e4ec640 1 -- 172.21.15.6:0/930714312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fc2380678d0 con 0x7fc2380ce620 2023-07-21T22:35:55.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.094+0000 7fc234ff9640 1 -- 172.21.15.6:0/930714312 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 41) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fc22c081ef0 con 0x7fc2380ce620 2023-07-21T22:35:55.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.102+0000 7fc234ff9640 1 -- 172.21.15.6:0/930714312 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v41) v1 ==== 92+0+0 (secure 0 0 0) 0x7fc22c07bf30 con 0x7fc2380ce620 2023-07-21T22:35:55.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.102+0000 7fc23e4ec640 1 -- 172.21.15.6:0/930714312 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fc2240663a0 msgr2=0x7fc224068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:55.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.102+0000 7fc23e4ec640 1 --2- 172.21.15.6:0/930714312 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fc2240663a0 0x7fc224068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc2380b13a0 tx=0x7fc228009190 comp rx=0 tx=0).stop 2023-07-21T22:35:55.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.102+0000 7fc23e4ec640 1 -- 172.21.15.6:0/930714312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2380ce620 msgr2=0x7fc2380b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:55.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.102+0000 7fc23e4ec640 1 --2- 172.21.15.6:0/930714312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2380ce620 0x7fc2380b3ad0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00c750 tx=0x7fc22c00cc10 comp rx=0 tx=0).stop 2023-07-21T22:35:55.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.102+0000 7fc23e4ec640 1 -- 172.21.15.6:0/930714312 shutdown_connections 2023-07-21T22:35:55.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.102+0000 7fc23e4ec640 1 --2- 172.21.15.6:0/930714312 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7fc2240663a0 0x7fc224068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.102+0000 7fc23e4ec640 1 --2- 172.21.15.6:0/930714312 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc23815c050 0x7fc238157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.102+0000 7fc23e4ec640 1 --2- 172.21.15.6:0/930714312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2380ce620 0x7fc2380b3ad0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.102+0000 7fc23e4ec640 1 --2- 172.21.15.6:0/930714312 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc23806e700 0x7fc2380b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.102+0000 7fc23e4ec640 1 -- 172.21.15.6:0/930714312 >> 172.21.15.6:0/930714312 conn(0x7fc2380cc9a0 msgr2=0x7fc2380c89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:55.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.102+0000 7fc23e4ec640 1 -- 172.21.15.6:0/930714312 shutdown_connections 2023-07-21T22:35:55.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.102+0000 7fc23e4ec640 1 -- 172.21.15.6:0/930714312 wait complete. 2023-07-21T22:35:55.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-21T22:35:55.322 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:55.278+0000 7fa1bbf3a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:35:55.341 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:55.294+0000 7f5465c4e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:35:55.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.294+0000 7f7909700640 1 Processor -- start 2023-07-21T22:35:55.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.298+0000 7f7909700640 1 -- start start 2023-07-21T22:35:55.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.298+0000 7f7909700640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f790415f320 0x7f79040d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:55.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.298+0000 7f7909700640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79040d0230 0x7f79040d2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:55.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.298+0000 7f7909700640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f79040b3690 0x7f79040b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:55.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.298+0000 7f7909700640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79040d0a60 con 0x7f790415f320 2023-07-21T22:35:55.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.298+0000 7f7909700640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79040af9d0 con 0x7f79040b3690 2023-07-21T22:35:55.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.298+0000 7f7909700640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79040b0230 con 0x7f79040d0230 2023-07-21T22:35:55.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.298+0000 7f7902ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f790415f320 0x7f79040d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:55.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.298+0000 7f7902ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f790415f320 0x7f79040d22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34368/0 (socket says 172.21.15.6:34368) 2023-07-21T22:35:55.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.298+0000 7f7902ffd640 1 -- 172.21.15.6:0/2037827676 learned_addr learned my addr 172.21.15.6:0/2037827676 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:55.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.298+0000 7f79037fe640 1 --2- 172.21.15.6:0/2037827676 >> v2:172.21.15.161:3300/0 conn(0x7f79040b3690 0x7f79040b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:55.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.298+0000 7f78fbfff640 1 --2- 172.21.15.6:0/2037827676 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79040d0230 0x7f79040d2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:55.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.298+0000 7f7902ffd640 1 -- 172.21.15.6:0/2037827676 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79040d0230 msgr2=0x7f79040d2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:55.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.298+0000 7f7902ffd640 1 --2- 172.21.15.6:0/2037827676 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79040d0230 0x7f79040d2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.298+0000 7f7902ffd640 1 -- 172.21.15.6:0/2037827676 >> v2:172.21.15.161:3300/0 conn(0x7f79040b3690 msgr2=0x7f79040b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:55.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.298+0000 7f7902ffd640 1 --2- 172.21.15.6:0/2037827676 >> v2:172.21.15.161:3300/0 conn(0x7f79040b3690 0x7f79040b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.298+0000 7f7902ffd640 1 -- 172.21.15.6:0/2037827676 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79040d0780 con 0x7f790415f320 2023-07-21T22:35:55.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.302+0000 7f7902ffd640 1 --2- 172.21.15.6:0/2037827676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f790415f320 0x7f79040d22c0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f7904069b10 tx=0x7f78f401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac6841eb3012ccd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:55.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.302+0000 7f79027fc640 1 -- 172.21.15.6:0/2037827676 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f40ab600 con 0x7f790415f320 2023-07-21T22:35:55.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.302+0000 7f79027fc640 1 -- 172.21.15.6:0/2037827676 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f40a7050 con 0x7f790415f320 2023-07-21T22:35:55.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.302+0000 7f79027fc640 1 -- 172.21.15.6:0/2037827676 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f40ab980 con 0x7f790415f320 2023-07-21T22:35:55.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.302+0000 7f7909700640 1 -- 172.21.15.6:0/2037827676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f790415f320 msgr2=0x7f79040d22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:55.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.302+0000 7f7909700640 1 --2- 172.21.15.6:0/2037827676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f790415f320 0x7f79040d22c0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f7904069b10 tx=0x7f78f401c240 comp rx=0 tx=0).stop 2023-07-21T22:35:55.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.302+0000 7f7909700640 1 -- 172.21.15.6:0/2037827676 shutdown_connections 2023-07-21T22:35:55.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.302+0000 7f7909700640 1 --2- 172.21.15.6:0/2037827676 >> v2:172.21.15.161:3300/0 conn(0x7f79040b3690 0x7f79040b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.302+0000 7f7909700640 1 --2- 172.21.15.6:0/2037827676 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79040d0230 0x7f79040d2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.302+0000 7f7909700640 1 --2- 172.21.15.6:0/2037827676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f790415f320 0x7f79040d22c0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.302+0000 7f7909700640 1 -- 172.21.15.6:0/2037827676 >> 172.21.15.6:0/2037827676 conn(0x7f79040659d0 msgr2=0x7f790409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:55.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.302+0000 7f7909700640 1 -- 172.21.15.6:0/2037827676 shutdown_connections 2023-07-21T22:35:55.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.302+0000 7f7909700640 1 -- 172.21.15.6:0/2037827676 wait complete. 2023-07-21T22:35:55.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f7909700640 1 Processor -- start 2023-07-21T22:35:55.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f7909700640 1 -- start start 2023-07-21T22:35:55.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f7909700640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79040b3690 0x7f7904156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:55.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f7909700640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79040d0230 0x7f790414db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:55.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f7909700640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f790415f320 0x7f790414fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:55.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f7909700640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790414e040 con 0x7f79040b3690 2023-07-21T22:35:55.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f7909700640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790414e730 con 0x7f790415f320 2023-07-21T22:35:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f7909700640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790414ea10 con 0x7f79040d0230 2023-07-21T22:35:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f7902ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79040b3690 0x7f7904156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f7902ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79040b3690 0x7f7904156cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34376/0 (socket says 172.21.15.6:34376) 2023-07-21T22:35:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f7902ffd640 1 -- 172.21.15.6:0/789964633 learned_addr learned my addr 172.21.15.6:0/789964633 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f78fbfff640 1 --2- 172.21.15.6:0/789964633 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79040d0230 0x7f790414db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:55.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f79037fe640 1 --2- 172.21.15.6:0/789964633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f790415f320 0x7f790414fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:55.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f7902ffd640 1 -- 172.21.15.6:0/789964633 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79040d0230 msgr2=0x7f790414db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:55.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f7902ffd640 1 --2- 172.21.15.6:0/789964633 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79040d0230 0x7f790414db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f7902ffd640 1 -- 172.21.15.6:0/789964633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f790415f320 msgr2=0x7f790414fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f7902ffd640 1 --2- 172.21.15.6:0/789964633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f790415f320 0x7f790414fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f7902ffd640 1 -- 172.21.15.6:0/789964633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f40094d0 con 0x7f79040b3690 2023-07-21T22:35:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f7902ffd640 1 --2- 172.21.15.6:0/789964633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79040b3690 0x7f7904156cb0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f78f4000c10 tx=0x7f78f4018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f78fb7fe640 1 -- 172.21.15.6:0/789964633 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f40b6440 con 0x7f79040b3690 2023-07-21T22:35:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f78fb7fe640 1 -- 172.21.15.6:0/789964633 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f40b65a0 con 0x7f79040b3690 2023-07-21T22:35:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f78fb7fe640 1 -- 172.21.15.6:0/789964633 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f40b6930 con 0x7f79040b3690 2023-07-21T22:35:55.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f7909700640 1 -- 172.21.15.6:0/789964633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790414ecf0 con 0x7f79040b3690 2023-07-21T22:35:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.306+0000 7f7909700640 1 -- 172.21.15.6:0/789964633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790414f2b0 con 0x7f79040b3690 2023-07-21T22:35:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.310+0000 7f7909700640 1 -- 172.21.15.6:0/789964633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79040678d0 con 0x7f79040b3690 2023-07-21T22:35:55.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.310+0000 7f78fb7fe640 1 -- 172.21.15.6:0/789964633 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 41) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f78f40b2040 con 0x7f79040b3690 2023-07-21T22:35:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.310+0000 7f78fb7fe640 1 --2- 172.21.15.6:0/789964633 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f78e40663f0 0x7f78e40688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.310+0000 7f78fb7fe640 1 -- 172.21.15.6:0/789964633 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f78f411d460 con 0x7f79040b3690 2023-07-21T22:35:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.310+0000 7f78fbfff640 1 -- 172.21.15.6:0/789964633 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f78e40663f0 msgr2=0x7f78e40688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3891612664 2023-07-21T22:35:55.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.310+0000 7f78fbfff640 1 --2- 172.21.15.6:0/789964633 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f78e40663f0 0x7f78e40688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:35:55.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.314+0000 7f78fb7fe640 1 -- 172.21.15.6:0/789964633 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f78f40ea7b0 con 0x7f79040b3690 2023-07-21T22:35:55.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.474+0000 7f7909700640 1 -- 172.21.15.6:0/789964633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f790414f4a0 con 0x7f79040b3690 2023-07-21T22:35:55.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.478+0000 7f78fb7fe640 1 -- 172.21.15.6:0/789964633 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f78f40eddd0 con 0x7f79040b3690 2023-07-21T22:35:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.482+0000 7f7909700640 1 -- 172.21.15.6:0/789964633 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f78e40663f0 msgr2=0x7f78e40688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:35:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.482+0000 7f7909700640 1 --2- 172.21.15.6:0/789964633 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f78e40663f0 0x7f78e40688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.482+0000 7f7909700640 1 -- 172.21.15.6:0/789964633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79040b3690 msgr2=0x7f7904156cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.482+0000 7f7909700640 1 --2- 172.21.15.6:0/789964633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79040b3690 0x7f7904156cb0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f78f4000c10 tx=0x7f78f4018fe0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.482+0000 7f7909700640 1 -- 172.21.15.6:0/789964633 shutdown_connections 2023-07-21T22:35:55.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.482+0000 7f7909700640 1 --2- 172.21.15.6:0/789964633 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f78e40663f0 0x7f78e40688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.482+0000 7f7909700640 1 --2- 172.21.15.6:0/789964633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f790415f320 0x7f790414fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.482+0000 7f7909700640 1 --2- 172.21.15.6:0/789964633 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79040d0230 0x7f790414db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.482+0000 7f7909700640 1 --2- 172.21.15.6:0/789964633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79040b3690 0x7f7904156cb0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.482+0000 7f7909700640 1 -- 172.21.15.6:0/789964633 >> 172.21.15.6:0/789964633 conn(0x7f79040659d0 msgr2=0x7f790406b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:55.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.482+0000 7f7909700640 1 -- 172.21.15.6:0/789964633 shutdown_connections 2023-07-21T22:35:55.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.482+0000 7f7909700640 1 -- 172.21.15.6:0/789964633 wait complete. 2023-07-21T22:35:55.554 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-21T22:35:55.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.658+0000 7f273232c640 1 Processor -- start 2023-07-21T22:35:55.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.658+0000 7f273232c640 1 -- start start 2023-07-21T22:35:55.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.658+0000 7f273232c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f272c15bde0 0x7f272c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:55.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.658+0000 7f273232c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f272c0d2300 0x7f272c0d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:55.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.658+0000 7f273232c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272c0b04c0 con 0x7f272c0d2fc0 2023-07-21T22:35:55.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.658+0000 7f273232c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272c15c1b0 con 0x7f272c15bde0 2023-07-21T22:35:55.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.658+0000 7f273232c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272c0b1060 con 0x7f272c0d2300 2023-07-21T22:35:55.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.658+0000 7f272bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f272c15bde0 0x7f272c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:55.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.658+0000 7f272bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f272c15bde0 0x7f272c0d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34388/0 (socket says 172.21.15.6:34388) 2023-07-21T22:35:55.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.658+0000 7f272bfff640 1 -- 172.21.15.6:0/669088953 learned_addr learned my addr 172.21.15.6:0/669088953 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:55.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.658+0000 7f27308c9640 1 --2- 172.21.15.6:0/669088953 >> v2:172.21.15.161:3300/0 conn(0x7f272c0d2300 0x7f272c0d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:55.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.658+0000 7f272bfff640 1 -- 172.21.15.6:0/669088953 >> v2:172.21.15.161:3300/0 conn(0x7f272c0d2300 msgr2=0x7f272c0d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:55.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.658+0000 7f272bfff640 1 --2- 172.21.15.6:0/669088953 >> v2:172.21.15.161:3300/0 conn(0x7f272c0d2300 0x7f272c0d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.658+0000 7f272bfff640 1 -- 172.21.15.6:0/669088953 >> v1:172.21.15.161:6789/0 conn(0x7f272c0d2fc0 legacy=0x7f272c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:55.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.658+0000 7f272bfff640 1 -- 172.21.15.6:0/669088953 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c0d2c80 con 0x7f272c15bde0 2023-07-21T22:35:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.662+0000 7f272bfff640 1 --2- 172.21.15.6:0/669088953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f272c15bde0 0x7f272c0d0270 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f272c08c820 tx=0x7f271c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c64dd57d26d68cf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.662+0000 7f272affd640 1 -- 172.21.15.6:0/669088953 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c0ab610 con 0x7f272c15bde0 2023-07-21T22:35:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.662+0000 7f272affd640 1 -- 172.21.15.6:0/669088953 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c0ab770 con 0x7f272c15bde0 2023-07-21T22:35:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.662+0000 7f272affd640 1 -- 172.21.15.6:0/669088953 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c0abb00 con 0x7f272c15bde0 2023-07-21T22:35:55.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.662+0000 7f273232c640 1 -- 172.21.15.6:0/669088953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f272c15bde0 msgr2=0x7f272c0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:55.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.662+0000 7f273232c640 1 --2- 172.21.15.6:0/669088953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f272c15bde0 0x7f272c0d0270 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f272c08c820 tx=0x7f271c01c500 comp rx=0 tx=0).stop 2023-07-21T22:35:55.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.662+0000 7f273232c640 1 -- 172.21.15.6:0/669088953 shutdown_connections 2023-07-21T22:35:55.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.662+0000 7f273232c640 1 --2- 172.21.15.6:0/669088953 >> v2:172.21.15.161:3300/0 conn(0x7f272c0d2300 0x7f272c0d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.662+0000 7f273232c640 1 --2- 172.21.15.6:0/669088953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f272c15bde0 0x7f272c0d0270 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.662+0000 7f273232c640 1 -- 172.21.15.6:0/669088953 >> 172.21.15.6:0/669088953 conn(0x7f272c0659d0 msgr2=0x7f272c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:55.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.662+0000 7f273232c640 1 -- 172.21.15.6:0/669088953 shutdown_connections 2023-07-21T22:35:55.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.662+0000 7f273232c640 1 -- 172.21.15.6:0/669088953 wait complete. 2023-07-21T22:35:55.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f273232c640 1 Processor -- start 2023-07-21T22:35:55.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f273232c640 1 -- start start 2023-07-21T22:35:55.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f273232c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f272c0d2300 0x7f272c1f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:55.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f273232c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f272c0d2fc0 0x7f272c0cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:55.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f273232c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f272c15bde0 0x7f272c1550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:55.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f273232c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0cbcc0 con 0x7f272c0d2fc0 2023-07-21T22:35:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f273232c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c1f8310 con 0x7f272c0d2300 2023-07-21T22:35:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f273232c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c15c490 con 0x7f272c15bde0 2023-07-21T22:35:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f272b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f272c0d2fc0 0x7f272c0cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f272bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f272c0d2300 0x7f272c1f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f272b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f272c0d2fc0 0x7f272c0cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34398/0 (socket says 172.21.15.6:34398) 2023-07-21T22:35:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f272b7fe640 1 -- 172.21.15.6:0/2331809169 learned_addr learned my addr 172.21.15.6:0/2331809169 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f27308c9640 1 --2- 172.21.15.6:0/2331809169 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f272c15bde0 0x7f272c1550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f272bfff640 1 -- 172.21.15.6:0/2331809169 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f272c15bde0 msgr2=0x7f272c1550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f272bfff640 1 --2- 172.21.15.6:0/2331809169 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f272c15bde0 0x7f272c1550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f272bfff640 1 -- 172.21.15.6:0/2331809169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f272c0d2fc0 msgr2=0x7f272c0cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f272bfff640 1 --2- 172.21.15.6:0/2331809169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f272c0d2fc0 0x7f272c0cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f272bfff640 1 -- 172.21.15.6:0/2331809169 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c009480 con 0x7f272c0d2300 2023-07-21T22:35:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f272b7fe640 1 --2- 172.21.15.6:0/2331809169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f272c0d2fc0 0x7f272c0cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f272bfff640 1 --2- 172.21.15.6:0/2331809169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f272c0d2300 0x7f272c1f7dd0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f272c0cfef0 tx=0x7f271c0192a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f2728ff9640 1 -- 172.21.15.6:0/2331809169 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c0bc070 con 0x7f272c0d2300 2023-07-21T22:35:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f2728ff9640 1 -- 172.21.15.6:0/2331809169 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c0ab5d0 con 0x7f272c0d2300 2023-07-21T22:35:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f2728ff9640 1 -- 172.21.15.6:0/2331809169 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c0abd10 con 0x7f272c0d2300 2023-07-21T22:35:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f273232c640 1 -- 172.21.15.6:0/2331809169 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272c15c770 con 0x7f272c0d2300 2023-07-21T22:35:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.666+0000 7f273232c640 1 -- 172.21.15.6:0/2331809169 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c15cd30 con 0x7f272c0d2300 2023-07-21T22:35:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.670+0000 7f273232c640 1 -- 172.21.15.6:0/2331809169 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272c0678d0 con 0x7f272c0d2300 2023-07-21T22:35:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.670+0000 7f2728ff9640 1 -- 172.21.15.6:0/2331809169 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 41) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f271c003620 con 0x7f272c0d2300 2023-07-21T22:35:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.670+0000 7f2728ff9640 1 --2- 172.21.15.6:0/2331809169 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f2718066420 0x7f27180688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.670+0000 7f2728ff9640 1 -- 172.21.15.6:0/2331809169 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f271c11df40 con 0x7f272c0d2300 2023-07-21T22:35:55.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.670+0000 7f272b7fe640 1 -- 172.21.15.6:0/2331809169 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f2718066420 msgr2=0x7f27180688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3891612664 2023-07-21T22:35:55.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.670+0000 7f272b7fe640 1 --2- 172.21.15.6:0/2331809169 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f2718066420 0x7f27180688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:35:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.678+0000 7f2728ff9640 1 -- 172.21.15.6:0/2331809169 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f271c0eb180 con 0x7f272c0d2300 2023-07-21T22:35:55.745 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:55.702+0000 7fa1bbf3a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:35:55.803 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:55.758+0000 7f5465c4e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:35:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.838+0000 7f273232c640 1 -- 172.21.15.6:0/2331809169 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f272c073040 con 0x7f272c0d2300 2023-07-21T22:35:55.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.846+0000 7f2728ff9640 1 -- 172.21.15.6:0/2331809169 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v36)=0 v36) v1 ==== 133+0+0 (secure 0 0 0) 0x7f271c0ee7a0 con 0x7f272c0d2300 2023-07-21T22:35:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.850+0000 7f273232c640 1 -- 172.21.15.6:0/2331809169 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f2718066420 msgr2=0x7f27180688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:35:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.850+0000 7f273232c640 1 --2- 172.21.15.6:0/2331809169 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f2718066420 0x7f27180688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.850+0000 7f273232c640 1 -- 172.21.15.6:0/2331809169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f272c0d2300 msgr2=0x7f272c1f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.850+0000 7f273232c640 1 --2- 172.21.15.6:0/2331809169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f272c0d2300 0x7f272c1f7dd0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f272c0cfef0 tx=0x7f271c0192a0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.850+0000 7f273232c640 1 -- 172.21.15.6:0/2331809169 shutdown_connections 2023-07-21T22:35:55.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.850+0000 7f273232c640 1 --2- 172.21.15.6:0/2331809169 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f2718066420 0x7f27180688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.850+0000 7f273232c640 1 --2- 172.21.15.6:0/2331809169 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f272c15bde0 0x7f272c1550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.850+0000 7f273232c640 1 --2- 172.21.15.6:0/2331809169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f272c0d2fc0 0x7f272c0cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.850+0000 7f273232c640 1 --2- 172.21.15.6:0/2331809169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f272c0d2300 0x7f272c1f7dd0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:55.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.850+0000 7f273232c640 1 -- 172.21.15.6:0/2331809169 >> 172.21.15.6:0/2331809169 conn(0x7f272c0659d0 msgr2=0x7f272c0cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:55.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.850+0000 7f273232c640 1 -- 172.21.15.6:0/2331809169 shutdown_connections 2023-07-21T22:35:55.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:55.850+0000 7f273232c640 1 -- 172.21.15.6:0/2331809169 wait complete. 2023-07-21T22:35:55.898 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:55.854+0000 7fa1bbf3a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:35:55.915 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /bad-path 1M 2023-07-21T22:35:55.965 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:55.918+0000 7f5465c4e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:35:56.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.022+0000 7f8dfb59e640 1 Processor -- start 2023-07-21T22:35:56.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.022+0000 7f8dfb59e640 1 -- start start 2023-07-21T22:35:56.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.022+0000 7f8dfb59e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8dfc0cebd0 0x7f8dfc0cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:56.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.022+0000 7f8dfb59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8dfc0b5010 0x7f8dfc0cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:56.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.022+0000 7f8dfb59e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dfc15bfa0 con 0x7f8dfc0cfd90 2023-07-21T22:35:56.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.022+0000 7f8dfb59e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dfc0ccdf0 con 0x7f8dfc0cebd0 2023-07-21T22:35:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.022+0000 7f8dfb59e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dfc0cd0d0 con 0x7f8dfc0b5010 2023-07-21T22:35:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.022+0000 7f8df3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8dfc0cebd0 0x7f8dfc0cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.022+0000 7f8df3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8dfc0cebd0 0x7f8dfc0cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34406/0 (socket says 172.21.15.6:34406) 2023-07-21T22:35:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.022+0000 7f8df3fff640 1 -- 172.21.15.6:0/3432511587 learned_addr learned my addr 172.21.15.6:0/3432511587 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.022+0000 7f8dfad9d640 1 --2- 172.21.15.6:0/3432511587 >> v2:172.21.15.161:3300/0 conn(0x7f8dfc0b5010 0x7f8dfc0cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.022+0000 7f8df3fff640 1 -- 172.21.15.6:0/3432511587 >> v2:172.21.15.161:3300/0 conn(0x7f8dfc0b5010 msgr2=0x7f8dfc0cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.022+0000 7f8df3fff640 1 --2- 172.21.15.6:0/3432511587 >> v2:172.21.15.161:3300/0 conn(0x7f8dfc0b5010 0x7f8dfc0cde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.022+0000 7f8df3fff640 1 -- 172.21.15.6:0/3432511587 >> v1:172.21.15.161:6789/0 conn(0x7f8dfc0cfd90 legacy=0x7f8dfc0d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.022+0000 7f8df3fff640 1 -- 172.21.15.6:0/3432511587 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc0cd3b0 con 0x7f8dfc0cebd0 2023-07-21T22:35:56.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.026+0000 7f8df3fff640 1 --2- 172.21.15.6:0/3432511587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0cebd0 0x7f8dfc0cc810 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc071ac0 tx=0x7f8de401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26769f85d1ec17d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:56.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.026+0000 7f8df9d9b640 1 -- 172.21.15.6:0/3432511587 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de40aa430 con 0x7f8dfc0cebd0 2023-07-21T22:35:56.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.026+0000 7f8df9d9b640 1 -- 172.21.15.6:0/3432511587 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de40aa590 con 0x7f8dfc0cebd0 2023-07-21T22:35:56.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.026+0000 7f8df9d9b640 1 -- 172.21.15.6:0/3432511587 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de40aa920 con 0x7f8dfc0cebd0 2023-07-21T22:35:56.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.026+0000 7f8dfb59e640 1 -- 172.21.15.6:0/3432511587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0cebd0 msgr2=0x7f8dfc0cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:56.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.026+0000 7f8dfb59e640 1 --2- 172.21.15.6:0/3432511587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0cebd0 0x7f8dfc0cc810 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc071ac0 tx=0x7f8de401c4d0 comp rx=0 tx=0).stop 2023-07-21T22:35:56.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.026+0000 7f8dfb59e640 1 -- 172.21.15.6:0/3432511587 shutdown_connections 2023-07-21T22:35:56.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.026+0000 7f8dfb59e640 1 --2- 172.21.15.6:0/3432511587 >> v2:172.21.15.161:3300/0 conn(0x7f8dfc0b5010 0x7f8dfc0cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:56.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.026+0000 7f8dfb59e640 1 --2- 172.21.15.6:0/3432511587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0cebd0 0x7f8dfc0cc810 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:56.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.026+0000 7f8dfb59e640 1 -- 172.21.15.6:0/3432511587 >> 172.21.15.6:0/3432511587 conn(0x7f8dfc09b490 msgr2=0x7f8dfc0d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:56.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.026+0000 7f8dfb59e640 1 -- 172.21.15.6:0/3432511587 shutdown_connections 2023-07-21T22:35:56.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.026+0000 7f8dfb59e640 1 -- 172.21.15.6:0/3432511587 wait complete. 2023-07-21T22:35:56.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8dfb59e640 1 Processor -- start 2023-07-21T22:35:56.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8dfb59e640 1 -- start start 2023-07-21T22:35:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8dfb59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0b5010 0x7f8dfc0af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8dfb59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8dfc0cebd0 0x7f8dfc0b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8dfb59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8dfc0cfd90 0x7f8dfc0c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8dfb59e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc0caa60 con 0x7f8dfc0b5010 2023-07-21T22:35:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8dfb59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc0ca430 con 0x7f8dfc0cebd0 2023-07-21T22:35:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8dfb59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc0b2490 con 0x7f8dfc0cfd90 2023-07-21T22:35:56.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8dfa59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0b5010 0x7f8dfc0af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:56.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8dfa59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0b5010 0x7f8dfc0af050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34418/0 (socket says 172.21.15.6:34418) 2023-07-21T22:35:56.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8df3fff640 1 --2- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8dfc0cebd0 0x7f8dfc0b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:56.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8dfa59c640 1 -- 172.21.15.6:0/2313412419 learned_addr learned my addr 172.21.15.6:0/2313412419 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:35:56.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8dfad9d640 1 --2- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8dfc0cfd90 0x7f8dfc0c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:56.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8dfa59c640 1 -- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8dfc0cfd90 msgr2=0x7f8dfc0c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:56.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8dfa59c640 1 --2- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8dfc0cfd90 0x7f8dfc0c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:56.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8dfa59c640 1 -- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8dfc0cebd0 msgr2=0x7f8dfc0b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:56.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8dfa59c640 1 --2- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8dfc0cebd0 0x7f8dfc0b1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:56.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8dfa59c640 1 -- 172.21.15.6:0/2313412419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de40094d0 con 0x7f8dfc0b5010 2023-07-21T22:35:56.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8df3fff640 1 --2- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8dfc0cebd0 0x7f8dfc0b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:56.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8dfa59c640 1 --2- 172.21.15.6:0/2313412419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0b5010 0x7f8dfc0af050 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00c400 tx=0x7f8dec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:56.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8df2ffd640 1 -- 172.21.15.6:0/2313412419 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec0052d0 con 0x7f8dfc0b5010 2023-07-21T22:35:56.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8df2ffd640 1 -- 172.21.15.6:0/2313412419 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dec005430 con 0x7f8dfc0b5010 2023-07-21T22:35:56.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8df2ffd640 1 -- 172.21.15.6:0/2313412419 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec003890 con 0x7f8dfc0b5010 2023-07-21T22:35:56.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8dfb59e640 1 -- 172.21.15.6:0/2313412419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dfc0b2770 con 0x7f8dfc0b5010 2023-07-21T22:35:56.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.030+0000 7f8dfb59e640 1 -- 172.21.15.6:0/2313412419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dfc15a410 con 0x7f8dfc0b5010 2023-07-21T22:35:56.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.034+0000 7f8dfb59e640 1 -- 172.21.15.6:0/2313412419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dfc0caba0 con 0x7f8dfc0b5010 2023-07-21T22:35:56.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.034+0000 7f8df2ffd640 1 -- 172.21.15.6:0/2313412419 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 41) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f8dec0039f0 con 0x7f8dfc0b5010 2023-07-21T22:35:56.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.034+0000 7f8df2ffd640 1 --2- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f8ddc0663f0 0x7f8ddc0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:56.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.034+0000 7f8df2ffd640 1 -- 172.21.15.6:0/2313412419 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f8dec0832e0 con 0x7f8dfc0b5010 2023-07-21T22:35:56.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.034+0000 7f8df3fff640 1 -- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f8ddc0663f0 msgr2=0x7f8ddc0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3891612664 2023-07-21T22:35:56.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.034+0000 7f8df3fff640 1 --2- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f8ddc0663f0 0x7f8ddc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:35:56.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.038+0000 7f8df2ffd640 1 -- 172.21.15.6:0/2313412419 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8dfc0caba0 con 0x7f8dfc0b5010 2023-07-21T22:35:56.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.218+0000 7f8dfb59e640 1 -- 172.21.15.6:0/2313412419 --> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8dfc0ce7e0 con 0x7f8ddc0663f0 2023-07-21T22:35:56.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.238+0000 7f8df3fff640 1 -- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f8ddc0663f0 msgr2=0x7f8ddc0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3891612664 2023-07-21T22:35:56.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.238+0000 7f8df3fff640 1 --2- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f8ddc0663f0 0x7f8ddc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:35:56.378 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:56.334+0000 7fa1bbf3a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:35:56.436 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:56.390+0000 7fa1bbf3a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:35:56.485 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:56.438+0000 7f5465c4e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:35:56.494 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:56.450+0000 7fa1bbf3a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:35:56.548 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:56.502+0000 7f5465c4e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:35:56.580 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:56.534+0000 7fa1bbf3a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:35:56.609 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:56.562+0000 7f5465c4e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:35:56.638 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:56.594+0000 7fa1bbf3a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:35:56.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.642+0000 7f8df3fff640 1 -- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f8ddc0663f0 msgr2=0x7f8ddc0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3891612664 2023-07-21T22:35:56.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:56.642+0000 7f8df3fff640 1 --2- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f8ddc0663f0 0x7f8ddc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-21T22:35:56.700 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:56.654+0000 7f5465c4e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:35:56.722 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:56.678+0000 7fa1bbf3a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:35:56.760 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:56.714+0000 7f5465c4e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:35:56.778 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:56.734+0000 7fa1bbf3a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:35:56.849 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:56.802+0000 7f5465c4e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:35:56.909 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:56.862+0000 7f5465c4e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:35:56.919 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:56.874+0000 7fa1bbf3a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:35:56.976 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:56.934+0000 7fa1bbf3a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:35:57.059 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:57.014+0000 7f5465c4e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:35:57.121 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:57.074+0000 7f5465c4e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:35:57.216 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:35:57.216 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:35:57.216 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:35:57.224 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:57.182+0000 7fa1bbf3a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:35:57.358 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:57.314+0000 7fa1bbf3a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:35:57.372 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:35:57.373 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:35:57.373 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:35:57.381 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:57.334+0000 7f5465c4e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:35:57.482 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:57.438+0000 7fa1bbf3a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:35:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:57.446+0000 7f8df3fff640 1 -- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f8ddc0663f0 msgr2=0x7f8ddc0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3891612664 2023-07-21T22:35:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:57.446+0000 7f8df3fff640 1 --2- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f8ddc0663f0 0x7f8ddc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-21T22:35:57.526 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:57.478+0000 7f5465c4e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:35:57.556 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:57.514+0000 7fa1bbf3a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:35:57.659 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:57.614+0000 7f5465c4e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:35:57.690 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:57.646+0000 7fa1bbf3a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:35:57.734 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:57.686+0000 7f5465c4e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:35:57.876 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:57.830+0000 7f5465c4e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:35:58.229 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:58.186+0000 7fa1bbf3a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:35:58.314 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:58.270+0000 7fa1bbf3a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:35:58.451 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:58.406+0000 7f5465c4e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:35:58.462 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:58.418+0000 7fa1bbf3a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:35:58.541 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:58.494+0000 7f5465c4e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:35:58.545 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:58.502+0000 7fa1bbf3a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:35:58.697 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:58.650+0000 7f5465c4e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:35:58.785 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:58.738+0000 7f5465c4e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:35:58.815 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:58.770+0000 7fa1bbf3a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:35:58.875 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:58.830+0000 7fa1bbf3a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:35:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:58.838+0000 7f8df2ffd640 1 -- 172.21.15.6:0/2313412419 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 42) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f8dec050a90 con 0x7f8dfc0b5010 2023-07-21T22:35:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:58.838+0000 7f8df2ffd640 1 -- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f8ddc0663f0 msgr2=0x7f8ddc0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:35:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:58.838+0000 7f8df2ffd640 1 --2- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:6832/3891612664,v1:172.21.15.161:6833/3891612664] conn(0x7f8ddc0663f0 0x7f8ddc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.017 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:58.974+0000 7fa13dfa1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:59.018 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:58.974+0000 7fa13dfa1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:59.018 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:58.974+0000 7fa13dfa1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:59.018 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:58.974+0000 7fa13dfa1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:59.018 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:58.974+0000 7fa13dfa1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:59.018 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:58.974+0000 7fa13af9b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:59.018 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:58.974+0000 7fa13af9b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:59.019 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:58.974+0000 7fa13af9b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:59.019 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:58.974+0000 7fa13af9b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:59.019 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:35:58.974+0000 7fa13af9b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:35:59.088 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:59.042+0000 7f5465c4e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:35:59.152 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:35:59.106+0000 7f5465c4e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:35:59.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:59.861+0000 7f8df2ffd640 1 -- 172.21.15.6:0/2313412419 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mgrmap(e 43) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f8dec072110 con 0x7f8dfc0b5010 2023-07-21T22:35:59.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:59.865+0000 7f8df2ffd640 1 --2- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f8ddc033920 0x7f8ddc033cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:59.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:59.865+0000 7f8df2ffd640 1 -- 172.21.15.6:0/2313412419 --> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ddc034230 con 0x7f8ddc033920 2023-07-21T22:35:59.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:59.869+0000 7f8df3fff640 1 --2- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f8ddc033920 0x7f8ddc033cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:59.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:59.873+0000 7f8df3fff640 1 --2- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f8ddc033920 0x7f8ddc033cf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8de40ae000 tx=0x7f8de40a7000 comp rx=0 tx=0).ready entity=mgr.7633 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:59.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:59.937+0000 7f8df2ffd640 1 -- 172.21.15.6:0/2313412419 <== mgr.7633 v2:172.21.15.161:6832/1474634903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f8ddc034230 con 0x7f8ddc033920 2023-07-21T22:35:59.984 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule set for path /bad-path 2023-07-21T22:35:59.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:59.941+0000 7f8dfb59e640 1 -- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f8ddc033920 msgr2=0x7f8ddc033cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:59.941+0000 7f8dfb59e640 1 --2- 172.21.15.6:0/2313412419 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f8ddc033920 0x7f8ddc033cf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8de40ae000 tx=0x7f8de40a7000 comp rx=0 tx=0).stop 2023-07-21T22:35:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:59.941+0000 7f8dfb59e640 1 -- 172.21.15.6:0/2313412419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0b5010 msgr2=0x7f8dfc0af050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:59.941+0000 7f8dfb59e640 1 --2- 172.21.15.6:0/2313412419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8dfc0b5010 0x7f8dfc0af050 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00c400 tx=0x7f8dec00c8c0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:59.941+0000 7f8dfad9d640 1 -- 172.21.15.6:0/2313412419 reap_dead start 2023-07-21T22:35:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:59.941+0000 7f8dfb59e640 1 -- 172.21.15.6:0/2313412419 shutdown_connections 2023-07-21T22:35:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:59.941+0000 7f8dfb59e640 1 -- 172.21.15.6:0/2313412419 >> 172.21.15.6:0/2313412419 conn(0x7f8dfc09b490 msgr2=0x7f8dfc0d08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:59.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:59.941+0000 7f8dfb59e640 1 -- 172.21.15.6:0/2313412419 shutdown_connections 2023-07-21T22:35:59.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:35:59.941+0000 7f8dfb59e640 1 -- 172.21.15.6:0/2313412419 wait complete. 2023-07-21T22:36:00.009 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /bad-path 2023-07-21T22:36:00.010 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-07-21T22:36:00.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.117+0000 7f751cb40640 1 Processor -- start 2023-07-21T22:36:00.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.117+0000 7f751cb40640 1 -- start start 2023-07-21T22:36:00.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.117+0000 7f751cb40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7518069430 0x7f7518069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:00.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.117+0000 7f751cb40640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7518070f30 0x7f75180ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:00.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.117+0000 7f751cb40640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7518159d70 con 0x7f75180af2b0 2023-07-21T22:36:00.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.117+0000 7f751cb40640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7518069d40 con 0x7f7518070f30 2023-07-21T22:36:00.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.117+0000 7f751cb40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75180c9c60 con 0x7f7518069430 2023-07-21T22:36:00.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.117+0000 7f7515d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7518070f30 0x7f75180ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:00.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.117+0000 7f7515d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7518070f30 0x7f75180ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47746/0 (socket says 172.21.15.6:47746) 2023-07-21T22:36:00.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.117+0000 7f7515d9b640 1 -- 172.21.15.6:0/3345460428 learned_addr learned my addr 172.21.15.6:0/3345460428 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:36:00.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.117+0000 7f7516d9d640 1 --1- 172.21.15.6:0/3345460428 >> v1:172.21.15.6:6789/0 conn(0x7f75180af2b0 0x7f751815a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49260/0 (socket says 172.21.15.6:49260) 2023-07-21T22:36:00.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.117+0000 7f751659c640 1 --2- 172.21.15.6:0/3345460428 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7518069430 0x7f7518069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:00.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.121+0000 7f7515d9b640 1 -- 172.21.15.6:0/3345460428 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7518069430 msgr2=0x7f7518069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:00.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.121+0000 7f7515d9b640 1 --2- 172.21.15.6:0/3345460428 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7518069430 0x7f7518069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:00.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.121+0000 7f7515d9b640 1 -- 172.21.15.6:0/3345460428 >> v1:172.21.15.6:6789/0 conn(0x7f75180af2b0 legacy=0x7f751815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:00.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.121+0000 7f7515d9b640 1 -- 172.21.15.6:0/3345460428 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75180c9f40 con 0x7f7518070f30 2023-07-21T22:36:00.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.121+0000 7f751559a640 1 -- 172.21.15.6:0/3345460428 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067972043 0 0) 0x7f75100014a0 con 0x7f75180af2b0 2023-07-21T22:36:00.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.121+0000 7f7515d9b640 1 --2- 172.21.15.6:0/3345460428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7518070f30 0x7f75180ad6f0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f750c009870 tx=0x7f750c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a2f3573ba4ee7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:00.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.121+0000 7f751559a640 1 -- 172.21.15.6:0/3345460428 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c0a9400 con 0x7f7518070f30 2023-07-21T22:36:00.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.121+0000 7f751559a640 1 -- 172.21.15.6:0/3345460428 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c0a9560 con 0x7f7518070f30 2023-07-21T22:36:00.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.121+0000 7f751559a640 1 -- 172.21.15.6:0/3345460428 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c0a98f0 con 0x7f7518070f30 2023-07-21T22:36:00.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.121+0000 7f751cb40640 1 -- 172.21.15.6:0/3345460428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7518070f30 msgr2=0x7f75180ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:00.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.121+0000 7f751cb40640 1 --2- 172.21.15.6:0/3345460428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7518070f30 0x7f75180ad6f0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f750c009870 tx=0x7f750c01c540 comp rx=0 tx=0).stop 2023-07-21T22:36:00.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.121+0000 7f751cb40640 1 -- 172.21.15.6:0/3345460428 shutdown_connections 2023-07-21T22:36:00.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.121+0000 7f751cb40640 1 --2- 172.21.15.6:0/3345460428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7518070f30 0x7f75180ad6f0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:00.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.121+0000 7f751cb40640 1 --2- 172.21.15.6:0/3345460428 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7518069430 0x7f7518069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:00.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.121+0000 7f751cb40640 1 -- 172.21.15.6:0/3345460428 >> 172.21.15.6:0/3345460428 conn(0x7f75180cde90 msgr2=0x7f75180ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:00.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f751cb40640 1 -- 172.21.15.6:0/3345460428 shutdown_connections 2023-07-21T22:36:00.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f751cb40640 1 -- 172.21.15.6:0/3345460428 wait complete. 2023-07-21T22:36:00.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f751cb40640 1 Processor -- start 2023-07-21T22:36:00.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f751cb40640 1 -- start start 2023-07-21T22:36:00.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f751cb40640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7518069430 0x7f75181f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:00.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f751cb40640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7518070f30 0x7f75181f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:00.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f751cb40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75180af2b0 0x7f75180b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:00.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f751cb40640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75180abfd0 con 0x7f7518069430 2023-07-21T22:36:00.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f751cb40640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7518154b60 con 0x7f7518070f30 2023-07-21T22:36:00.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f751cb40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75180ab9c0 con 0x7f75180af2b0 2023-07-21T22:36:00.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f751659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7518069430 0x7f75181f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:00.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f751659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7518069430 0x7f75181f43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47754/0 (socket says 172.21.15.6:47754) 2023-07-21T22:36:00.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f751659c640 1 -- 172.21.15.6:0/1121866710 learned_addr learned my addr 172.21.15.6:0/1121866710 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:36:00.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f7516d9d640 1 --2- 172.21.15.6:0/1121866710 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75180af2b0 0x7f75180b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:00.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f7515d9b640 1 --2- 172.21.15.6:0/1121866710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7518070f30 0x7f75181f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:00.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f751659c640 1 -- 172.21.15.6:0/1121866710 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75180af2b0 msgr2=0x7f75180b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:00.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f751659c640 1 --2- 172.21.15.6:0/1121866710 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75180af2b0 0x7f75180b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:00.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f751659c640 1 -- 172.21.15.6:0/1121866710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7518070f30 msgr2=0x7f75181f70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:00.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f751659c640 1 --2- 172.21.15.6:0/1121866710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7518070f30 0x7f75181f70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:00.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f751659c640 1 -- 172.21.15.6:0/1121866710 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c0094d0 con 0x7f7518069430 2023-07-21T22:36:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f7515d9b640 1 --2- 172.21.15.6:0/1121866710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7518070f30 0x7f75181f70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:36:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f751659c640 1 --2- 172.21.15.6:0/1121866710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7518069430 0x7f75181f43b0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f750800e870 tx=0x7f750800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.125+0000 7f7506ffd640 1 -- 172.21.15.6:0/1121866710 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508009510 con 0x7f7518069430 2023-07-21T22:36:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.129+0000 7f7506ffd640 1 -- 172.21.15.6:0/1121866710 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750800eec0 con 0x7f7518069430 2023-07-21T22:36:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.129+0000 7f7506ffd640 1 -- 172.21.15.6:0/1121866710 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750800cb40 con 0x7f7518069430 2023-07-21T22:36:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.129+0000 7f751cb40640 1 -- 172.21.15.6:0/1121866710 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7518154880 con 0x7f7518069430 2023-07-21T22:36:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.129+0000 7f751cb40640 1 -- 172.21.15.6:0/1121866710 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75181f7620 con 0x7f7518069430 2023-07-21T22:36:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.129+0000 7f751cb40640 1 -- 172.21.15.6:0/1121866710 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75180678d0 con 0x7f7518069430 2023-07-21T22:36:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.129+0000 7f7506ffd640 1 -- 172.21.15.6:0/1121866710 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 43) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f750800cca0 con 0x7f7518069430 2023-07-21T22:36:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.129+0000 7f7506ffd640 1 --2- 172.21.15.6:0/1121866710 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f74f8066120 0x7f74f80685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:00.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.129+0000 7f7506ffd640 1 -- 172.21.15.6:0/1121866710 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f7508083d20 con 0x7f7518069430 2023-07-21T22:36:00.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.129+0000 7f7515d9b640 1 --2- 172.21.15.6:0/1121866710 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f74f8066120 0x7f74f80685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:00.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.133+0000 7f7515d9b640 1 --2- 172.21.15.6:0/1121866710 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f74f8066120 0x7f74f80685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f750c0ae000 tx=0x7f750c008040 comp rx=0 tx=0).ready entity=mgr.7633 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:00.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.133+0000 7f7506ffd640 1 -- 172.21.15.6:0/1121866710 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7508051280 con 0x7f7518069430 2023-07-21T22:36:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.321+0000 7f751cb40640 1 -- 172.21.15.6:0/1121866710 --> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75180adc30 con 0x7f74f8066120 2023-07-21T22:36:00.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.329+0000 7f7506ffd640 1 -- 172.21.15.6:0/1121866710 <== mgr.7633 v2:172.21.15.161:6832/1474634903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+287 (secure 0 0 0) 0x7f750c0a98b0 con 0x7f74f8066120 2023-07-21T22:36:00.376 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:36:00.376 INFO:teuthology.orchestra.run.smithi006.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:35:59", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-07-21T22:36:00.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.329+0000 7f751cb40640 1 -- 172.21.15.6:0/1121866710 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f74f8066120 msgr2=0x7f74f80685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:00.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.329+0000 7f751cb40640 1 --2- 172.21.15.6:0/1121866710 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f74f8066120 0x7f74f80685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f750c0ae000 tx=0x7f750c008040 comp rx=0 tx=0).stop 2023-07-21T22:36:00.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.329+0000 7f751cb40640 1 -- 172.21.15.6:0/1121866710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7518069430 msgr2=0x7f75181f43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:00.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.329+0000 7f751cb40640 1 --2- 172.21.15.6:0/1121866710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7518069430 0x7f75181f43b0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f750800e870 tx=0x7f750800ec70 comp rx=0 tx=0).stop 2023-07-21T22:36:00.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.329+0000 7f751cb40640 1 -- 172.21.15.6:0/1121866710 shutdown_connections 2023-07-21T22:36:00.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.329+0000 7f751cb40640 1 --2- 172.21.15.6:0/1121866710 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f74f8066120 0x7f74f80685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:00.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.329+0000 7f751cb40640 1 --2- 172.21.15.6:0/1121866710 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75180af2b0 0x7f75180b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:00.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.329+0000 7f751cb40640 1 --2- 172.21.15.6:0/1121866710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7518070f30 0x7f75181f70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:00.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.329+0000 7f751cb40640 1 --2- 172.21.15.6:0/1121866710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7518069430 0x7f75181f43b0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:00.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.329+0000 7f751cb40640 1 -- 172.21.15.6:0/1121866710 >> 172.21.15.6:0/1121866710 conn(0x7f75180cde90 msgr2=0x7f751806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:00.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.329+0000 7f751cb40640 1 -- 172.21.15.6:0/1121866710 shutdown_connections 2023-07-21T22:36:00.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:36:00.329+0000 7f751cb40640 1 -- 172.21.15.6:0/1121866710 wait complete. 2023-07-21T22:36:00.397 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:35:59", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-07-21T22:36:00.993 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:36:00.950+0000 7fa12d780640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:36:00.994 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:36:00.950+0000 7fa12d780640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:36:00.994 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:36:00.950+0000 7fa12d780640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:36:00.994 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:36:00.950+0000 7fa12d780640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:36:00.995 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:36:00.950+0000 7fa12d780640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:36:13.612 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:36:13.616 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:36:43.694 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:36:43.698 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:37:00.398 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-07-21T22:37:00.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.505+0000 7fd9469c5640 1 Processor -- start 2023-07-21T22:37:00.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.505+0000 7fd9469c5640 1 -- start start 2023-07-21T22:37:00.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.505+0000 7fd9469c5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd940070f30 0x7fd9400ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:00.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.505+0000 7fd9469c5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd940159d70 con 0x7fd940069430 2023-07-21T22:37:00.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.505+0000 7fd9469c5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9400c9c60 con 0x7fd9400af2b0 2023-07-21T22:37:00.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.505+0000 7fd9469c5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9400c9f40 con 0x7fd940070f30 2023-07-21T22:37:00.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.505+0000 7fd93ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd940069430 0x7fd940069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52462/0 (socket says 172.21.15.6:52462) 2023-07-21T22:37:00.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93ffff640 1 -- 172.21.15.6:0/2085325341 learned_addr learned my addr 172.21.15.6:0/2085325341 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:00.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93f7fe640 1 --2- 172.21.15.6:0/2085325341 >> v2:172.21.15.161:3300/0 conn(0x7fd940070f30 0x7fd9400ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:00.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93effd640 1 -- 172.21.15.6:0/2085325341 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873191867 0 0) 0x7fd930001120 con 0x7fd940069430 2023-07-21T22:37:00.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93effd640 1 -- 172.21.15.6:0/2085325341 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd928003530 con 0x7fd940069430 2023-07-21T22:37:00.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93effd640 1 -- 172.21.15.6:0/2085325341 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1778368900 0 0) 0x7fd928003530 con 0x7fd940069430 2023-07-21T22:37:00.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93effd640 1 -- 172.21.15.6:0/2085325341 >> v2:172.21.15.161:3300/0 conn(0x7fd940070f30 msgr2=0x7fd9400ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:00.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93effd640 1 --2- 172.21.15.6:0/2085325341 >> v2:172.21.15.161:3300/0 conn(0x7fd940070f30 0x7fd9400ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:00.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93effd640 1 -- 172.21.15.6:0/2085325341 >> v1:172.21.15.161:6789/0 conn(0x7fd9400af2b0 legacy=0x7fd94015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:00.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93effd640 1 -- 172.21.15.6:0/2085325341 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9400ca220 con 0x7fd940069430 2023-07-21T22:37:00.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93effd640 1 -- 172.21.15.6:0/2085325341 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fd930001810 con 0x7fd940069430 2023-07-21T22:37:00.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93effd640 1 -- 172.21.15.6:0/2085325341 >> v1:172.21.15.6:6789/0 conn(0x7fd940069430 legacy=0x7fd940069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:00.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93effd640 1 --2- 172.21.15.6:0/2085325341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd928003980 0x7fd928003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:00.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93effd640 1 --2- 172.21.15.6:0/2085325341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9280047d0 0x7fd928004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:00.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93effd640 1 --2- 172.21.15.6:0/2085325341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd928005180 0x7fd92800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:00.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93effd640 1 -- 172.21.15.6:0/2085325341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9400c9f40 con 0x7fd9280047d0 2023-07-21T22:37:00.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93effd640 1 -- 172.21.15.6:0/2085325341 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92800c000 con 0x7fd928003980 2023-07-21T22:37:00.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93effd640 1 -- 172.21.15.6:0/2085325341 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd92800c1c0 con 0x7fd928005180 2023-07-21T22:37:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93f7fe640 1 --2- 172.21.15.6:0/2085325341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9280047d0 0x7fd928004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93ffff640 1 --2- 172.21.15.6:0/2085325341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd928003980 0x7fd928003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd944f62640 1 --2- 172.21.15.6:0/2085325341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd928005180 0x7fd92800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93f7fe640 1 -- 172.21.15.6:0/2085325341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd928005180 msgr2=0x7fd92800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93f7fe640 1 --2- 172.21.15.6:0/2085325341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd928005180 0x7fd92800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93f7fe640 1 -- 172.21.15.6:0/2085325341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd928003980 msgr2=0x7fd928003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93f7fe640 1 --2- 172.21.15.6:0/2085325341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd928003980 0x7fd928003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:00.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd93f7fe640 1 -- 172.21.15.6:0/2085325341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd928003530 con 0x7fd9280047d0 2023-07-21T22:37:00.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.509+0000 7fd944f62640 1 -- 172.21.15.6:0/2085325341 reap_dead start 2023-07-21T22:37:00.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.513+0000 7fd93f7fe640 1 --2- 172.21.15.6:0/2085325341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9280047d0 0x7fd928004c40 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fd934009ae0 tx=0x7fd93401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9acc5b675555ac server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:00.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.513+0000 7fd93effd640 1 -- 172.21.15.6:0/2085325341 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9340a5560 con 0x7fd9280047d0 2023-07-21T22:37:00.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.513+0000 7fd93effd640 1 -- 172.21.15.6:0/2085325341 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9340a56c0 con 0x7fd9280047d0 2023-07-21T22:37:00.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.513+0000 7fd93effd640 1 -- 172.21.15.6:0/2085325341 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9340a5a70 con 0x7fd9280047d0 2023-07-21T22:37:00.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.513+0000 7fd9469c5640 1 -- 172.21.15.6:0/2085325341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9280047d0 msgr2=0x7fd928004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:00.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.513+0000 7fd9469c5640 1 --2- 172.21.15.6:0/2085325341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9280047d0 0x7fd928004c40 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fd934009ae0 tx=0x7fd93401ca50 comp rx=0 tx=0).stop 2023-07-21T22:37:00.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.513+0000 7fd9469c5640 1 -- 172.21.15.6:0/2085325341 shutdown_connections 2023-07-21T22:37:00.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.513+0000 7fd9469c5640 1 --2- 172.21.15.6:0/2085325341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9280047d0 0x7fd928004c40 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:00.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.513+0000 7fd9469c5640 1 -- 172.21.15.6:0/2085325341 >> 172.21.15.6:0/2085325341 conn(0x7fd9400cde90 msgr2=0x7fd9400ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:00.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.513+0000 7fd9469c5640 1 -- 172.21.15.6:0/2085325341 shutdown_connections 2023-07-21T22:37:00.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.513+0000 7fd9469c5640 1 -- 172.21.15.6:0/2085325341 wait complete. 2023-07-21T22:37:00.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.513+0000 7fd9469c5640 1 Processor -- start 2023-07-21T22:37:00.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.513+0000 7fd9469c5640 1 -- start start 2023-07-21T22:37:00.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd9469c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9280047d0 0x7fd9401530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:00.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd9469c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd94014f750 0x7fd9400c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:00.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd9469c5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9400b2760 0x7fd9400b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:00.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd9469c5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9400b3120 con 0x7fd9280047d0 2023-07-21T22:37:00.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd9469c5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94014fcf0 con 0x7fd9400b2760 2023-07-21T22:37:00.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd9469c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94014ffd0 con 0x7fd94014f750 2023-07-21T22:37:00.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd93ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9280047d0 0x7fd9401530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:00.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd93ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9280047d0 0x7fd9401530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39056/0 (socket says 172.21.15.6:39056) 2023-07-21T22:37:00.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd93ffff640 1 -- 172.21.15.6:0/3461140875 learned_addr learned my addr 172.21.15.6:0/3461140875 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:00.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd944f62640 1 --2- 172.21.15.6:0/3461140875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9400b2760 0x7fd9400b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:00.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd93f7fe640 1 --2- 172.21.15.6:0/3461140875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd94014f750 0x7fd9400c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:00.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd93ffff640 1 -- 172.21.15.6:0/3461140875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd94014f750 msgr2=0x7fd9400c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:00.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd93ffff640 1 --2- 172.21.15.6:0/3461140875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd94014f750 0x7fd9400c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:00.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd93ffff640 1 -- 172.21.15.6:0/3461140875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9400b2760 msgr2=0x7fd9400b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:00.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd93ffff640 1 --2- 172.21.15.6:0/3461140875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9400b2760 0x7fd9400b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:00.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd93ffff640 1 -- 172.21.15.6:0/3461140875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9401502b0 con 0x7fd9280047d0 2023-07-21T22:37:00.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd944f62640 1 --2- 172.21.15.6:0/3461140875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9400b2760 0x7fd9400b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:00.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd93ffff640 1 --2- 172.21.15.6:0/3461140875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9280047d0 0x7fd9401530e0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fd930004880 tx=0x7fd930011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:00.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd93cff9640 1 -- 172.21.15.6:0/3461140875 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93000fb60 con 0x7fd9280047d0 2023-07-21T22:37:00.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd93cff9640 1 -- 172.21.15.6:0/3461140875 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93000fcc0 con 0x7fd9280047d0 2023-07-21T22:37:00.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd93cff9640 1 -- 172.21.15.6:0/3461140875 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd930015630 con 0x7fd9280047d0 2023-07-21T22:37:00.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd9469c5640 1 -- 172.21.15.6:0/3461140875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd940150590 con 0x7fd9280047d0 2023-07-21T22:37:00.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd9469c5640 1 -- 172.21.15.6:0/3461140875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd940153620 con 0x7fd9280047d0 2023-07-21T22:37:00.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd9469c5640 1 -- 172.21.15.6:0/3461140875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9400af710 con 0x7fd9280047d0 2023-07-21T22:37:00.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.517+0000 7fd93cff9640 1 -- 172.21.15.6:0/3461140875 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 45) v1 ==== 85891+0+0 (secure 0 0 0) 0x7fd930015790 con 0x7fd9280047d0 2023-07-21T22:37:00.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.521+0000 7fd93cff9640 1 --2- 172.21.15.6:0/3461140875 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fd92c066510 0x7fd92c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:00.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.521+0000 7fd93cff9640 1 -- 172.21.15.6:0/3461140875 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6566+0+0 (secure 0 0 0) 0x7fd9300874a0 con 0x7fd9280047d0 2023-07-21T22:37:00.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.521+0000 7fd93f7fe640 1 --2- 172.21.15.6:0/3461140875 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fd92c066510 0x7fd92c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:00.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.521+0000 7fd93f7fe640 1 --2- 172.21.15.6:0/3461140875 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fd92c066510 0x7fd92c0689c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd9340af000 tx=0x7fd9340046d0 comp rx=0 tx=0).ready entity=mgr.7633 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:00.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.525+0000 7fd93cff9640 1 -- 172.21.15.6:0/3461140875 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd9400af710 con 0x7fd9280047d0 2023-07-21T22:37:00.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.697+0000 7fd9469c5640 1 -- 172.21.15.6:0/3461140875 --> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9400ca500 con 0x7fd92c066510 2023-07-21T22:37:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.705+0000 7fd93cff9640 1 -- 172.21.15.6:0/3461140875 <== mgr.7633 v2:172.21.15.161:6832/1474634903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7fd9340a5830 con 0x7fd92c066510 2023-07-21T22:37:00.753 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:00.753 INFO:teuthology.orchestra.run.smithi006.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:35:59", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-07-21T22:37:00.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.709+0000 7fd9469c5640 1 -- 172.21.15.6:0/3461140875 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fd92c066510 msgr2=0x7fd92c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:00.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.709+0000 7fd9469c5640 1 --2- 172.21.15.6:0/3461140875 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fd92c066510 0x7fd92c0689c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd9340af000 tx=0x7fd9340046d0 comp rx=0 tx=0).stop 2023-07-21T22:37:00.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.709+0000 7fd9469c5640 1 -- 172.21.15.6:0/3461140875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9280047d0 msgr2=0x7fd9401530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:00.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.709+0000 7fd9469c5640 1 --2- 172.21.15.6:0/3461140875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9280047d0 0x7fd9401530e0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fd930004880 tx=0x7fd930011ca0 comp rx=0 tx=0).stop 2023-07-21T22:37:00.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.709+0000 7fd9469c5640 1 -- 172.21.15.6:0/3461140875 shutdown_connections 2023-07-21T22:37:00.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.709+0000 7fd9469c5640 1 --2- 172.21.15.6:0/3461140875 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fd92c066510 0x7fd92c0689c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:00.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.709+0000 7fd9469c5640 1 --2- 172.21.15.6:0/3461140875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9400b2760 0x7fd9400b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:00.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.709+0000 7fd9469c5640 1 --2- 172.21.15.6:0/3461140875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd94014f750 0x7fd9400c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:00.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.709+0000 7fd9469c5640 1 --2- 172.21.15.6:0/3461140875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd9280047d0 0x7fd9401530e0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:00.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.709+0000 7fd9469c5640 1 -- 172.21.15.6:0/3461140875 >> 172.21.15.6:0/3461140875 conn(0x7fd9400cde90 msgr2=0x7fd94006f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:00.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.709+0000 7fd9469c5640 1 -- 172.21.15.6:0/3461140875 shutdown_connections 2023-07-21T22:37:00.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.709+0000 7fd9469c5640 1 -- 172.21.15.6:0/3461140875 wait complete. 2023-07-21T22:37:00.774 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:35:59", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-07-21T22:37:00.774 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /bad-path 2023-07-21T22:37:00.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.877+0000 7f29c9f11640 1 Processor -- start 2023-07-21T22:37:00.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.877+0000 7f29c9f11640 1 -- start start 2023-07-21T22:37:00.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.877+0000 7f29c9f11640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29c415b9c0 0x7f29c40c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:00.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.877+0000 7f29c9f11640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f29c4069430 0x7f29c40cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:00.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.877+0000 7f29c9f11640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c40c37e0 con 0x7f29c4069880 2023-07-21T22:37:00.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.877+0000 7f29c9f11640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c40c3ac0 con 0x7f29c4069430 2023-07-21T22:37:00.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.877+0000 7f29c9f11640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40c3da0 con 0x7f29c415b9c0 2023-07-21T22:37:00.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.877+0000 7f29bbfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f29c4069430 0x7f29c40cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:00.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.877+0000 7f29c37fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29c415b9c0 0x7f29c40c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:00.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.877+0000 7f29c37fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29c415b9c0 0x7f29c40c3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:48234/0 (socket says 172.21.15.6:48234) 2023-07-21T22:37:00.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.877+0000 7f29bbfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f29c4069430 0x7f29c40cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:33182/0 (socket says 172.21.15.6:33182) 2023-07-21T22:37:00.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.877+0000 7f29c3fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f29c4069880 0x7f29c4159930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:48636/0 (socket says 172.21.15.6:48636) 2023-07-21T22:37:00.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.877+0000 7f29c37fe640 1 -- 172.21.15.6:0/108257717 learned_addr learned my addr 172.21.15.6:0/108257717 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:00.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.881+0000 7f29c37fe640 1 -- 172.21.15.6:0/108257717 >> v2:172.21.15.161:3300/0 conn(0x7f29c4069430 msgr2=0x7f29c40cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:00.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.881+0000 7f29c37fe640 1 --2- 172.21.15.6:0/108257717 >> v2:172.21.15.161:3300/0 conn(0x7f29c4069430 0x7f29c40cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:00.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.881+0000 7f29c37fe640 1 -- 172.21.15.6:0/108257717 >> v1:172.21.15.161:6789/0 conn(0x7f29c4069880 legacy=0x7f29c4159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:00.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.881+0000 7f29c2ffd640 1 -- 172.21.15.6:0/108257717 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646027830 0 0) 0x7f29c40c37e0 con 0x7f29c4069880 2023-07-21T22:37:00.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.881+0000 7f29c37fe640 1 -- 172.21.15.6:0/108257717 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c40c4080 con 0x7f29c415b9c0 2023-07-21T22:37:00.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.881+0000 7f29bbfff640 1 --2- 172.21.15.6:0/108257717 >> v2:172.21.15.161:3300/0 conn(0x7f29c4069430 0x7f29c40cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:00.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.881+0000 7f29c37fe640 1 --2- 172.21.15.6:0/108257717 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29c415b9c0 0x7f29c40c3150 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009870 tx=0x7f29b401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc236b32a21b35fb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:00.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.881+0000 7f29c2ffd640 1 -- 172.21.15.6:0/108257717 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b40ab600 con 0x7f29c415b9c0 2023-07-21T22:37:00.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.881+0000 7f29c2ffd640 1 -- 172.21.15.6:0/108257717 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b40a7050 con 0x7f29c415b9c0 2023-07-21T22:37:00.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.881+0000 7f29c2ffd640 1 -- 172.21.15.6:0/108257717 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b40ab980 con 0x7f29c415b9c0 2023-07-21T22:37:00.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c9f11640 1 -- 172.21.15.6:0/108257717 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29c415b9c0 msgr2=0x7f29c40c3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:00.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c9f11640 1 --2- 172.21.15.6:0/108257717 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29c415b9c0 0x7f29c40c3150 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009870 tx=0x7f29b401c4b0 comp rx=0 tx=0).stop 2023-07-21T22:37:00.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c9f11640 1 -- 172.21.15.6:0/108257717 shutdown_connections 2023-07-21T22:37:00.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c9f11640 1 --2- 172.21.15.6:0/108257717 >> v2:172.21.15.161:3300/0 conn(0x7f29c4069430 0x7f29c40cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:00.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c9f11640 1 --2- 172.21.15.6:0/108257717 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29c415b9c0 0x7f29c40c3150 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:00.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c9f11640 1 -- 172.21.15.6:0/108257717 >> 172.21.15.6:0/108257717 conn(0x7f29c40cde90 msgr2=0x7f29c40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:00.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c9f11640 1 -- 172.21.15.6:0/108257717 shutdown_connections 2023-07-21T22:37:00.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c9f11640 1 -- 172.21.15.6:0/108257717 wait complete. 2023-07-21T22:37:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c9f11640 1 Processor -- start 2023-07-21T22:37:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c9f11640 1 -- start start 2023-07-21T22:37:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c9f11640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29c4069430 0x7f29c41482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:00.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c9f11640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29c4069880 0x7f29c40b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:00.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c9f11640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29c415b9c0 0x7f29c40c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:00.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c9f11640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c4147400 con 0x7f29c4069430 2023-07-21T22:37:00.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c9f11640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c414a7f0 con 0x7f29c4069880 2023-07-21T22:37:00.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c9f11640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c4149360 con 0x7f29c415b9c0 2023-07-21T22:37:00.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29c4069430 0x7f29c41482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:00.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29c4069430 0x7f29c41482c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39066/0 (socket says 172.21.15.6:39066) 2023-07-21T22:37:00.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c37fe640 1 -- 172.21.15.6:0/2911680994 learned_addr learned my addr 172.21.15.6:0/2911680994 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:00.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c3fff640 1 --2- 172.21.15.6:0/2911680994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29c415b9c0 0x7f29c40c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:00.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29bbfff640 1 --2- 172.21.15.6:0/2911680994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29c4069880 0x7f29c40b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:00.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c37fe640 1 -- 172.21.15.6:0/2911680994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29c415b9c0 msgr2=0x7f29c40c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:00.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c37fe640 1 --2- 172.21.15.6:0/2911680994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29c415b9c0 0x7f29c40c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:00.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c37fe640 1 -- 172.21.15.6:0/2911680994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29c4069880 msgr2=0x7f29c40b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:00.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c37fe640 1 --2- 172.21.15.6:0/2911680994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29c4069880 0x7f29c40b2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:00.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.885+0000 7f29c37fe640 1 -- 172.21.15.6:0/2911680994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac009420 con 0x7f29c4069430 2023-07-21T22:37:00.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.889+0000 7f29c3fff640 1 --2- 172.21.15.6:0/2911680994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29c415b9c0 0x7f29c40c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:37:00.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.889+0000 7f29bbfff640 1 --2- 172.21.15.6:0/2911680994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29c4069880 0x7f29c40b2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:37:00.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.889+0000 7f29c37fe640 1 --2- 172.21.15.6:0/2911680994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29c4069430 0x7f29c41482c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f29b401ab60 tx=0x7f29b4019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:00.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.889+0000 7f29c0ff9640 1 -- 172.21.15.6:0/2911680994 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4004230 con 0x7f29c4069430 2023-07-21T22:37:00.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.889+0000 7f29c0ff9640 1 -- 172.21.15.6:0/2911680994 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b4004390 con 0x7f29c4069430 2023-07-21T22:37:00.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.889+0000 7f29c0ff9640 1 -- 172.21.15.6:0/2911680994 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4003820 con 0x7f29c4069430 2023-07-21T22:37:00.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.889+0000 7f29c9f11640 1 -- 172.21.15.6:0/2911680994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b40094d0 con 0x7f29c4069430 2023-07-21T22:37:00.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.889+0000 7f29c9f11640 1 -- 172.21.15.6:0/2911680994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c4148860 con 0x7f29c4069430 2023-07-21T22:37:00.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.889+0000 7f29c9f11640 1 -- 172.21.15.6:0/2911680994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c40714b0 con 0x7f29c4069430 2023-07-21T22:37:00.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.889+0000 7f29c0ff9640 1 -- 172.21.15.6:0/2911680994 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 45) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f29b4003980 con 0x7f29c4069430 2023-07-21T22:37:00.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.889+0000 7f29c0ff9640 1 --2- 172.21.15.6:0/2911680994 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f29a4066510 0x7f29a40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:00.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.889+0000 7f29c0ff9640 1 -- 172.21.15.6:0/2911680994 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6566+0+0 (secure 0 0 0) 0x7f29b411ed40 con 0x7f29c4069430 2023-07-21T22:37:00.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.889+0000 7f29bbfff640 1 --2- 172.21.15.6:0/2911680994 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f29a4066510 0x7f29a40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:00.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.893+0000 7f29bbfff640 1 --2- 172.21.15.6:0/2911680994 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f29a4066510 0x7f29a40689c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f29c4147a60 tx=0x7f29ac008040 comp rx=0 tx=0).ready entity=mgr.7633 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:00.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:00.893+0000 7f29c0ff9640 1 -- 172.21.15.6:0/2911680994 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f29b40ebca0 con 0x7f29c4069430 2023-07-21T22:37:01.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.069+0000 7f29c9f11640 1 -- 172.21.15.6:0/2911680994 --> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""]}) v1 -- 0x7f29c4069fb0 con 0x7f29a4066510 2023-07-21T22:37:01.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.137+0000 7f29c0ff9640 1 -- 172.21.15.6:0/2911680994 <== mgr.7633 v2:172.21.15.161:6832/1474634903 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+36 (secure 0 0 0) 0x7f29c4069fb0 con 0x7f29a4066510 2023-07-21T22:37:01.181 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule removed for path /bad-path 2023-07-21T22:37:01.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.137+0000 7f29c9f11640 1 -- 172.21.15.6:0/2911680994 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f29a4066510 msgr2=0x7f29a40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:01.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.137+0000 7f29c9f11640 1 --2- 172.21.15.6:0/2911680994 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f29a4066510 0x7f29a40689c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f29c4147a60 tx=0x7f29ac008040 comp rx=0 tx=0).stop 2023-07-21T22:37:01.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.137+0000 7f29c9f11640 1 -- 172.21.15.6:0/2911680994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29c4069430 msgr2=0x7f29c41482c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.137+0000 7f29c9f11640 1 --2- 172.21.15.6:0/2911680994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29c4069430 0x7f29c41482c0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f29b401ab60 tx=0x7f29b4019250 comp rx=0 tx=0).stop 2023-07-21T22:37:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.137+0000 7f29c9f11640 1 -- 172.21.15.6:0/2911680994 shutdown_connections 2023-07-21T22:37:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.137+0000 7f29c9f11640 1 --2- 172.21.15.6:0/2911680994 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f29a4066510 0x7f29a40689c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.137+0000 7f29c9f11640 1 --2- 172.21.15.6:0/2911680994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f29c415b9c0 0x7f29c40c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.137+0000 7f29c9f11640 1 --2- 172.21.15.6:0/2911680994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f29c4069880 0x7f29c40b2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.137+0000 7f29c9f11640 1 --2- 172.21.15.6:0/2911680994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29c4069430 0x7f29c41482c0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:01.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.137+0000 7f29c9f11640 1 -- 172.21.15.6:0/2911680994 >> 172.21.15.6:0/2911680994 conn(0x7f29c40cde90 msgr2=0x7f29c40701a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:01.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.137+0000 7f29c9f11640 1 -- 172.21.15.6:0/2911680994 shutdown_connections 2023-07-21T22:37:01.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.137+0000 7f29c9f11640 1 -- 172.21.15.6:0/2911680994 wait complete. 2023-07-21T22:37:01.203 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /bad-path 2023-07-21T22:37:01.204 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-21T22:37:01.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.305+0000 7fedb947b640 1 Processor -- start 2023-07-21T22:37:01.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.305+0000 7fedb947b640 1 -- start start 2023-07-21T22:37:01.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.305+0000 7fedb947b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fedb4157250 0x7fedb40cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:01.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.305+0000 7fedb947b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fedb406b6d0 0x7fedb40afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:01.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.305+0000 7fedb947b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb4071060 con 0x7fedb40af740 2023-07-21T22:37:01.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.305+0000 7fedb947b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb40b0100 con 0x7fedb406b6d0 2023-07-21T22:37:01.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.305+0000 7fedb947b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb40cbd40 con 0x7fedb4157250 2023-07-21T22:37:01.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.309+0000 7fedb37fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fedb406b6d0 0x7fedb40afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.309+0000 7fedb37fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fedb406b6d0 0x7fedb40afbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39082/0 (socket says 172.21.15.6:39082) 2023-07-21T22:37:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.309+0000 7fedb37fe640 1 -- 172.21.15.6:0/1382322740 learned_addr learned my addr 172.21.15.6:0/1382322740 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.309+0000 7fedb2ffd640 1 --2- 172.21.15.6:0/1382322740 >> v2:172.21.15.161:3300/0 conn(0x7fedb4157250 0x7fedb40cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.309+0000 7fedb37fe640 1 -- 172.21.15.6:0/1382322740 >> v2:172.21.15.161:3300/0 conn(0x7fedb4157250 msgr2=0x7fedb40cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.309+0000 7fedb37fe640 1 --2- 172.21.15.6:0/1382322740 >> v2:172.21.15.161:3300/0 conn(0x7fedb4157250 0x7fedb40cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.309+0000 7fedb37fe640 1 -- 172.21.15.6:0/1382322740 >> v1:172.21.15.161:6789/0 conn(0x7fedb40af740 legacy=0x7fedb406afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.309+0000 7fedb37fe640 1 -- 172.21.15.6:0/1382322740 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb40cc020 con 0x7fedb406b6d0 2023-07-21T22:37:01.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.309+0000 7fedb37fe640 1 --2- 172.21.15.6:0/1382322740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb406b6d0 0x7fedb40afbc0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fedb40ca6a0 tx=0x7fedac01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ce6372b290188f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:01.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.309+0000 7fedb27fc640 1 -- 172.21.15.6:0/1382322740 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac0a5800 con 0x7fedb406b6d0 2023-07-21T22:37:01.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.309+0000 7fedb27fc640 1 -- 172.21.15.6:0/1382322740 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac0a5960 con 0x7fedb406b6d0 2023-07-21T22:37:01.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.309+0000 7fedb27fc640 1 -- 172.21.15.6:0/1382322740 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac0a5cf0 con 0x7fedb406b6d0 2023-07-21T22:37:01.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedb947b640 1 -- 172.21.15.6:0/1382322740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb406b6d0 msgr2=0x7fedb40afbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:01.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedb947b640 1 --2- 172.21.15.6:0/1382322740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb406b6d0 0x7fedb40afbc0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fedb40ca6a0 tx=0x7fedac01c960 comp rx=0 tx=0).stop 2023-07-21T22:37:01.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedb947b640 1 -- 172.21.15.6:0/1382322740 shutdown_connections 2023-07-21T22:37:01.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedb947b640 1 --2- 172.21.15.6:0/1382322740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb406b6d0 0x7fedb40afbc0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:01.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedb947b640 1 --2- 172.21.15.6:0/1382322740 >> v2:172.21.15.161:3300/0 conn(0x7fedb4157250 0x7fedb40cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedb947b640 1 -- 172.21.15.6:0/1382322740 >> 172.21.15.6:0/1382322740 conn(0x7fedb406a070 msgr2=0x7fedb40ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedb947b640 1 -- 172.21.15.6:0/1382322740 shutdown_connections 2023-07-21T22:37:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedb947b640 1 -- 172.21.15.6:0/1382322740 wait complete. 2023-07-21T22:37:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedb947b640 1 Processor -- start 2023-07-21T22:37:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedb947b640 1 -- start start 2023-07-21T22:37:01.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedb947b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedb406b6d0 0x7fedb40b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:01.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedb947b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40af740 0x7fedb414b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:01.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedb947b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb4157250 0x7fedb415d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:01.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedb947b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb40b2be0 con 0x7fedb40af740 2023-07-21T22:37:01.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedb947b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb4153e40 con 0x7fedb406b6d0 2023-07-21T22:37:01.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedb947b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb40b2590 con 0x7fedb4157250 2023-07-21T22:37:01.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedabfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40af740 0x7fedb414b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:01.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedabfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40af740 0x7fedb414b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39098/0 (socket says 172.21.15.6:39098) 2023-07-21T22:37:01.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedabfff640 1 -- 172.21.15.6:0/98749664 learned_addr learned my addr 172.21.15.6:0/98749664 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:01.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedb2ffd640 1 --2- 172.21.15.6:0/98749664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedb406b6d0 0x7fedb40b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:01.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedb37fe640 1 --2- 172.21.15.6:0/98749664 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb4157250 0x7fedb415d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:01.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedabfff640 1 -- 172.21.15.6:0/98749664 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb4157250 msgr2=0x7fedb415d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:01.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedabfff640 1 --2- 172.21.15.6:0/98749664 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb4157250 0x7fedb415d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:01.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedabfff640 1 -- 172.21.15.6:0/98749664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedb406b6d0 msgr2=0x7fedb40b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:01.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedabfff640 1 --2- 172.21.15.6:0/98749664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedb406b6d0 0x7fedb40b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:01.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.313+0000 7fedabfff640 1 -- 172.21.15.6:0/98749664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac009b30 con 0x7fedb40af740 2023-07-21T22:37:01.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.317+0000 7fedabfff640 1 --2- 172.21.15.6:0/98749664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40af740 0x7fedb414b120 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00c450 tx=0x7fed9c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:01.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.317+0000 7fedab7fe640 1 -- 172.21.15.6:0/98749664 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c012830 con 0x7fedb40af740 2023-07-21T22:37:01.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.317+0000 7fedab7fe640 1 -- 172.21.15.6:0/98749664 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c0129b0 con 0x7fedb40af740 2023-07-21T22:37:01.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.317+0000 7fedab7fe640 1 -- 172.21.15.6:0/98749664 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c012d60 con 0x7fedb40af740 2023-07-21T22:37:01.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.317+0000 7fedb947b640 1 -- 172.21.15.6:0/98749664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb40b2870 con 0x7fedb40af740 2023-07-21T22:37:01.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.317+0000 7fedb947b640 1 -- 172.21.15.6:0/98749664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb414b830 con 0x7fedb40af740 2023-07-21T22:37:01.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.317+0000 7fedb947b640 1 -- 172.21.15.6:0/98749664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb40b23f0 con 0x7fedb40af740 2023-07-21T22:37:01.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.317+0000 7fedab7fe640 1 -- 172.21.15.6:0/98749664 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 45) v1 ==== 85891+0+0 (secure 0 0 0) 0x7fed9c01c460 con 0x7fedb40af740 2023-07-21T22:37:01.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.317+0000 7fedab7fe640 1 --2- 172.21.15.6:0/98749664 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fed94066510 0x7fed940689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:01.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.317+0000 7fedab7fe640 1 -- 172.21.15.6:0/98749664 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6566+0+0 (secure 0 0 0) 0x7fed9c084130 con 0x7fedb40af740 2023-07-21T22:37:01.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.317+0000 7fedb2ffd640 1 --2- 172.21.15.6:0/98749664 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fed94066510 0x7fed940689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:01.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.321+0000 7fedb2ffd640 1 --2- 172.21.15.6:0/98749664 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fed94066510 0x7fed940689c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fedb4159960 tx=0x7feda4008040 comp rx=0 tx=0).ready entity=mgr.7633 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:01.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.321+0000 7fedab7fe640 1 -- 172.21.15.6:0/98749664 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fedb40b23f0 con 0x7fedb40af740 2023-07-21T22:37:01.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.517+0000 7fedb947b640 1 -- 172.21.15.6:0/98749664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fedb40b23f0 con 0x7fedb40af740 2023-07-21T22:37:02.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.969+0000 7fedab7fe640 1 -- 172.21.15.6:0/98749664 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 46) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fed9c0514d0 con 0x7fedb40af740 2023-07-21T22:37:02.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.969+0000 7fedab7fe640 1 -- 172.21.15.6:0/98749664 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v46) v1 ==== 93+0+0 (secure 0 0 0) 0x7fed9c06e150 con 0x7fedb40af740 2023-07-21T22:37:02.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.973+0000 7fedb947b640 1 -- 172.21.15.6:0/98749664 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fed94066510 msgr2=0x7fed940689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:02.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.973+0000 7fedb947b640 1 --2- 172.21.15.6:0/98749664 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fed94066510 0x7fed940689c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fedb4159960 tx=0x7feda4008040 comp rx=0 tx=0).stop 2023-07-21T22:37:02.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.973+0000 7fedb947b640 1 -- 172.21.15.6:0/98749664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40af740 msgr2=0x7fedb414b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:02.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.973+0000 7fedb947b640 1 --2- 172.21.15.6:0/98749664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40af740 0x7fedb414b120 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fed9c00c450 tx=0x7fed9c00c910 comp rx=0 tx=0).stop 2023-07-21T22:37:02.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.973+0000 7fedb947b640 1 -- 172.21.15.6:0/98749664 shutdown_connections 2023-07-21T22:37:02.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.973+0000 7fedb947b640 1 --2- 172.21.15.6:0/98749664 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fed94066510 0x7fed940689c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.973+0000 7fedb947b640 1 --2- 172.21.15.6:0/98749664 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedb4157250 0x7fedb415d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.973+0000 7fedb947b640 1 --2- 172.21.15.6:0/98749664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb40af740 0x7fedb414b120 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.973+0000 7fedb947b640 1 --2- 172.21.15.6:0/98749664 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedb406b6d0 0x7fedb40b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.973+0000 7fedb947b640 1 -- 172.21.15.6:0/98749664 >> 172.21.15.6:0/98749664 conn(0x7fedb406a070 msgr2=0x7fedb406baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:02.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.973+0000 7fedb947b640 1 -- 172.21.15.6:0/98749664 shutdown_connections 2023-07-21T22:37:02.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:01.973+0000 7fedb947b640 1 -- 172.21.15.6:0/98749664 wait complete. 2023-07-21T22:37:02.040 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:37:02.041 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:37:02.104 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:37:02.166 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:37:02.167 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:37:02.167 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:37:02.176 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:37:02.177 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:37:02.194 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:02.149+0000 7f3479e46180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:37:02.195 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:02.153+0000 7ff927846180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:37:02.203 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:37:02.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.345+0000 7f230579f640 1 Processor -- start 2023-07-21T22:37:02.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.345+0000 7f230579f640 1 -- start start 2023-07-21T22:37:02.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.349+0000 7f230579f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230006b1e0 0x7f23000c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:02.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.349+0000 7f230579f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f23000c21f0 0x7f23000cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.349+0000 7f230579f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23000cac70 con 0x7f2300070b70 2023-07-21T22:37:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.349+0000 7f230579f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23000ca060 con 0x7f23000c21f0 2023-07-21T22:37:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.349+0000 7f230579f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23000ca340 con 0x7f230006b1e0 2023-07-21T22:37:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.349+0000 7f22feffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2300070b70 0x7f2300070f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52476/0 (socket says 172.21.15.6:52476) 2023-07-21T22:37:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.349+0000 7f22feffd640 1 -- 172.21.15.6:0/3191454011 learned_addr learned my addr 172.21.15.6:0/3191454011 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:02.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.349+0000 7f22f7fff640 1 --2- 172.21.15.6:0/3191454011 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230006b1e0 0x7f23000c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:02.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.349+0000 7f22ff7fe640 1 --2- 172.21.15.6:0/3191454011 >> v2:172.21.15.161:3300/0 conn(0x7f23000c21f0 0x7f23000cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:02.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.349+0000 7f22fe7fc640 1 -- 172.21.15.6:0/3191454011 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353947722 0 0) 0x7f23000cac70 con 0x7f2300070b70 2023-07-21T22:37:02.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.349+0000 7f22fe7fc640 1 -- 172.21.15.6:0/3191454011 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22ec003530 con 0x7f2300070b70 2023-07-21T22:37:02.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.349+0000 7f22ff7fe640 1 -- 172.21.15.6:0/3191454011 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230006b1e0 msgr2=0x7f23000c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:02.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.349+0000 7f22ff7fe640 1 --2- 172.21.15.6:0/3191454011 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230006b1e0 0x7f23000c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.349+0000 7f22ff7fe640 1 -- 172.21.15.6:0/3191454011 >> v1:172.21.15.6:6789/0 conn(0x7f2300070b70 legacy=0x7f2300070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:02.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.349+0000 7f22ff7fe640 1 -- 172.21.15.6:0/3191454011 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23000ca620 con 0x7f23000c21f0 2023-07-21T22:37:02.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.349+0000 7f22f7fff640 1 --2- 172.21.15.6:0/3191454011 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230006b1e0 0x7f23000c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:02.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.353+0000 7f22ff7fe640 1 --2- 172.21.15.6:0/3191454011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23000c21f0 0x7f23000cb100 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f22f8009d90 tx=0x7f22f801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34bc6210a4a383a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:02.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.353+0000 7f22fe7fc640 1 -- 172.21.15.6:0/3191454011 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f80a5970 con 0x7f23000c21f0 2023-07-21T22:37:02.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.353+0000 7f22fe7fc640 1 -- 172.21.15.6:0/3191454011 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f80a5ad0 con 0x7f23000c21f0 2023-07-21T22:37:02.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.353+0000 7f22fe7fc640 1 -- 172.21.15.6:0/3191454011 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f80a5e60 con 0x7f23000c21f0 2023-07-21T22:37:02.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.353+0000 7f230579f640 1 -- 172.21.15.6:0/3191454011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23000c21f0 msgr2=0x7f23000cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:02.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.353+0000 7f230579f640 1 --2- 172.21.15.6:0/3191454011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23000c21f0 0x7f23000cb100 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f22f8009d90 tx=0x7f22f801c890 comp rx=0 tx=0).stop 2023-07-21T22:37:02.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.353+0000 7f230579f640 1 -- 172.21.15.6:0/3191454011 shutdown_connections 2023-07-21T22:37:02.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.353+0000 7f230579f640 1 --2- 172.21.15.6:0/3191454011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23000c21f0 0x7f23000cb100 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.353+0000 7f230579f640 1 --2- 172.21.15.6:0/3191454011 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f230006b1e0 0x7f23000c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.353+0000 7f230579f640 1 -- 172.21.15.6:0/3191454011 >> 172.21.15.6:0/3191454011 conn(0x7f23000afcf0 msgr2=0x7f23000b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:02.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.353+0000 7f230579f640 1 -- 172.21.15.6:0/3191454011 shutdown_connections 2023-07-21T22:37:02.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.353+0000 7f230579f640 1 -- 172.21.15.6:0/3191454011 wait complete. 2023-07-21T22:37:02.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.353+0000 7f230579f640 1 Processor -- start 2023-07-21T22:37:02.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.353+0000 7f230579f640 1 -- start start 2023-07-21T22:37:02.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.353+0000 7f230579f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230006b1e0 0x7f2300148b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:02.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.353+0000 7f230579f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2300070b70 0x7f2300149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:02.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.353+0000 7f230579f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23000c21f0 0x7f23000b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:02.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.353+0000 7f230579f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230014cfe0 con 0x7f230006b1e0 2023-07-21T22:37:02.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.353+0000 7f230579f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230014d2a0 con 0x7f23000c21f0 2023-07-21T22:37:02.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.353+0000 7f230579f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230014d580 con 0x7f2300070b70 2023-07-21T22:37:02.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.357+0000 7f22feffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230006b1e0 0x7f2300148b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:02.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.357+0000 7f22feffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230006b1e0 0x7f2300148b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39120/0 (socket says 172.21.15.6:39120) 2023-07-21T22:37:02.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.357+0000 7f22feffd640 1 -- 172.21.15.6:0/3023674470 learned_addr learned my addr 172.21.15.6:0/3023674470 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:02.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.357+0000 7f22f7fff640 1 --2- 172.21.15.6:0/3023674470 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2300070b70 0x7f2300149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:02.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.357+0000 7f22ff7fe640 1 --2- 172.21.15.6:0/3023674470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23000c21f0 0x7f23000b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:02.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.357+0000 7f22feffd640 1 -- 172.21.15.6:0/3023674470 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2300070b70 msgr2=0x7f2300149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:02.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.357+0000 7f22feffd640 1 --2- 172.21.15.6:0/3023674470 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2300070b70 0x7f2300149f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.357+0000 7f22feffd640 1 -- 172.21.15.6:0/3023674470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23000c21f0 msgr2=0x7f23000b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:02.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.357+0000 7f22feffd640 1 --2- 172.21.15.6:0/3023674470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23000c21f0 0x7f23000b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.357+0000 7f22feffd640 1 -- 172.21.15.6:0/3023674470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e8009420 con 0x7f230006b1e0 2023-07-21T22:37:02.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.357+0000 7f22feffd640 1 --2- 172.21.15.6:0/3023674470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230006b1e0 0x7f2300148b70 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f22f000c4d0 tx=0x7f22f000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:02.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.357+0000 7f22f77fe640 1 -- 172.21.15.6:0/3023674470 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f0005cf0 con 0x7f230006b1e0 2023-07-21T22:37:02.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.357+0000 7f22f77fe640 1 -- 172.21.15.6:0/3023674470 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f0005e50 con 0x7f230006b1e0 2023-07-21T22:37:02.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.357+0000 7f230579f640 1 -- 172.21.15.6:0/3023674470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f8009a70 con 0x7f230006b1e0 2023-07-21T22:37:02.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.357+0000 7f22f77fe640 1 -- 172.21.15.6:0/3023674470 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f0007270 con 0x7f230006b1e0 2023-07-21T22:37:02.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.357+0000 7f230579f640 1 -- 172.21.15.6:0/3023674470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230014db40 con 0x7f230006b1e0 2023-07-21T22:37:02.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.357+0000 7f230579f640 1 -- 172.21.15.6:0/3023674470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23000b0a20 con 0x7f230006b1e0 2023-07-21T22:37:02.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.357+0000 7f22f77fe640 1 -- 172.21.15.6:0/3023674470 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 46) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f22f00073d0 con 0x7f230006b1e0 2023-07-21T22:37:02.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.361+0000 7f22f77fe640 1 --2- 172.21.15.6:0/3023674470 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f22e00664c0 0x7f22e0068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:02.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.361+0000 7f22f77fe640 1 -- 172.21.15.6:0/3023674470 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6566+0+0 (secure 0 0 0) 0x7f22f0083900 con 0x7f230006b1e0 2023-07-21T22:37:02.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.361+0000 7f22f7fff640 1 -- 172.21.15.6:0/3023674470 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f22e00664c0 msgr2=0x7f22e0068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1474634903 2023-07-21T22:37:02.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.361+0000 7f22f7fff640 1 --2- 172.21.15.6:0/3023674470 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f22e00664c0 0x7f22e0068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:37:02.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.369+0000 7f22f77fe640 1 -- 172.21.15.6:0/3023674470 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f22f0050840 con 0x7f230006b1e0 2023-07-21T22:37:02.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.525+0000 7f230579f640 1 -- 172.21.15.6:0/3023674470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23000678d0 con 0x7f230006b1e0 2023-07-21T22:37:02.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.529+0000 7f22f77fe640 1 -- 172.21.15.6:0/3023674470 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+19003 (secure 0 0 0) 0x7f22f0053e60 con 0x7f230006b1e0 2023-07-21T22:37:02.574 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:02.574 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":115,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:36:59.939624+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:35:38.932763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-21T22:35:39.805137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":1,"to":7}]},{"pgid":"14.a","mappings":[{"from":1,"to":7}]},{"pgid":"14.18","mappings":[{"from":1,"to":5}]},{"pgid":"14.31","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:6833/3891612664":"2023-07-22T22:35:58.832528+0000","172.21.15.161:6832/3891612664":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/2035498467":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/4102091229":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/1144695770":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/2493427911":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/3550191976":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/253243953":"2023-07-22T22:35:58.832528+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:37:02.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.529+0000 7f230579f640 1 -- 172.21.15.6:0/3023674470 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f22e00664c0 msgr2=0x7f22e0068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:37:02.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.529+0000 7f230579f640 1 --2- 172.21.15.6:0/3023674470 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f22e00664c0 0x7f22e0068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.529+0000 7f230579f640 1 -- 172.21.15.6:0/3023674470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230006b1e0 msgr2=0x7f2300148b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:02.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.529+0000 7f230579f640 1 --2- 172.21.15.6:0/3023674470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230006b1e0 0x7f2300148b70 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f22f000c4d0 tx=0x7f22f000c990 comp rx=0 tx=0).stop 2023-07-21T22:37:02.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.529+0000 7f230579f640 1 -- 172.21.15.6:0/3023674470 shutdown_connections 2023-07-21T22:37:02.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.529+0000 7f230579f640 1 --2- 172.21.15.6:0/3023674470 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f22e00664c0 0x7f22e0068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.529+0000 7f230579f640 1 --2- 172.21.15.6:0/3023674470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23000c21f0 0x7f23000b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.529+0000 7f230579f640 1 --2- 172.21.15.6:0/3023674470 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2300070b70 0x7f2300149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.529+0000 7f230579f640 1 --2- 172.21.15.6:0/3023674470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230006b1e0 0x7f2300148b70 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.529+0000 7f230579f640 1 -- 172.21.15.6:0/3023674470 >> 172.21.15.6:0/3023674470 conn(0x7f23000afcf0 msgr2=0x7f23000c2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:02.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.529+0000 7f230579f640 1 -- 172.21.15.6:0/3023674470 shutdown_connections 2023-07-21T22:37:02.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.529+0000 7f230579f640 1 -- 172.21.15.6:0/3023674470 wait complete. 2023-07-21T22:37:02.596 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:35:38.932763+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:35:39.805137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:37:02.597 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:37:02.607 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:02.565+0000 7ff927846180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:37:02.648 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:02.601+0000 7f3479e46180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:37:02.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.701+0000 7fee0f87b640 1 Processor -- start 2023-07-21T22:37:02.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.705+0000 7fee0f87b640 1 -- start start 2023-07-21T22:37:02.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.705+0000 7fee0f87b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fee0815bde0 0x7fee080d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:02.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.705+0000 7fee0f87b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fee080d2300 0x7fee080d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:02.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.705+0000 7fee0f87b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee080b04c0 con 0x7fee080d2fc0 2023-07-21T22:37:02.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.705+0000 7fee0f87b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0815c1b0 con 0x7fee0815bde0 2023-07-21T22:37:02.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.705+0000 7fee0f87b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee080b1060 con 0x7fee080d2300 2023-07-21T22:37:02.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.705+0000 7fee0d617640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fee0815bde0 0x7fee080d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:02.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.705+0000 7fee0ce16640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fee080d2fc0 0x7fee080b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52490/0 (socket says 172.21.15.6:52490) 2023-07-21T22:37:02.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.705+0000 7fee0ce16640 1 -- 172.21.15.6:0/4061156221 learned_addr learned my addr 172.21.15.6:0/4061156221 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:02.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.705+0000 7fee0de18640 1 --2- 172.21.15.6:0/4061156221 >> v2:172.21.15.161:3300/0 conn(0x7fee080d2300 0x7fee080d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:02.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.705+0000 7fedfffff640 1 -- 172.21.15.6:0/4061156221 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553317884 0 0) 0x7fee080b04c0 con 0x7fee080d2fc0 2023-07-21T22:37:02.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.705+0000 7fedfffff640 1 -- 172.21.15.6:0/4061156221 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedf4003530 con 0x7fee080d2fc0 2023-07-21T22:37:02.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.705+0000 7fee0d617640 1 -- 172.21.15.6:0/4061156221 >> v2:172.21.15.161:3300/0 conn(0x7fee080d2300 msgr2=0x7fee080d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:02.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.705+0000 7fee0d617640 1 --2- 172.21.15.6:0/4061156221 >> v2:172.21.15.161:3300/0 conn(0x7fee080d2300 0x7fee080d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.705+0000 7fee0d617640 1 -- 172.21.15.6:0/4061156221 >> v1:172.21.15.6:6789/0 conn(0x7fee080d2fc0 legacy=0x7fee080b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:02.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.705+0000 7fee0d617640 1 -- 172.21.15.6:0/4061156221 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee080d2c80 con 0x7fee0815bde0 2023-07-21T22:37:02.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.709+0000 7fee0d617640 1 --2- 172.21.15.6:0/4061156221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee0815bde0 0x7fee080d0270 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fee0808c820 tx=0x7fee0401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d72f09d5467585 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:02.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.709+0000 7fedfffff640 1 -- 172.21.15.6:0/4061156221 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04004230 con 0x7fee0815bde0 2023-07-21T22:37:02.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.709+0000 7fedfffff640 1 -- 172.21.15.6:0/4061156221 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee040a7050 con 0x7fee0815bde0 2023-07-21T22:37:02.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.709+0000 7fedfffff640 1 -- 172.21.15.6:0/4061156221 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04003620 con 0x7fee0815bde0 2023-07-21T22:37:02.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.709+0000 7fee0f87b640 1 -- 172.21.15.6:0/4061156221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee0815bde0 msgr2=0x7fee080d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:02.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.709+0000 7fee0f87b640 1 --2- 172.21.15.6:0/4061156221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee0815bde0 0x7fee080d0270 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fee0808c820 tx=0x7fee0401c440 comp rx=0 tx=0).stop 2023-07-21T22:37:02.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.709+0000 7fee0f87b640 1 -- 172.21.15.6:0/4061156221 shutdown_connections 2023-07-21T22:37:02.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.709+0000 7fee0f87b640 1 --2- 172.21.15.6:0/4061156221 >> v2:172.21.15.161:3300/0 conn(0x7fee080d2300 0x7fee080d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.709+0000 7fee0f87b640 1 --2- 172.21.15.6:0/4061156221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee0815bde0 0x7fee080d0270 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.709+0000 7fee0f87b640 1 -- 172.21.15.6:0/4061156221 >> 172.21.15.6:0/4061156221 conn(0x7fee080659d0 msgr2=0x7fee0809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:02.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.709+0000 7fee0f87b640 1 -- 172.21.15.6:0/4061156221 shutdown_connections 2023-07-21T22:37:02.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.709+0000 7fee0f87b640 1 -- 172.21.15.6:0/4061156221 wait complete. 2023-07-21T22:37:02.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0f87b640 1 Processor -- start 2023-07-21T22:37:02.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0f87b640 1 -- start start 2023-07-21T22:37:02.758 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:02.713+0000 7ff927846180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:37:02.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0f87b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee080d2300 0x7fee0815a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:02.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0f87b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee080d2fc0 0x7fee0815cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:02.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0f87b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee0815bde0 0x7fee08156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:02.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0f87b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee08158610 con 0x7fee080d2300 2023-07-21T22:37:02.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0f87b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee08145a50 con 0x7fee080d2fc0 2023-07-21T22:37:02.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0f87b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee08144e40 con 0x7fee0815bde0 2023-07-21T22:37:02.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0d617640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee080d2300 0x7fee0815a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:02.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0d617640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee080d2300 0x7fee0815a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39132/0 (socket says 172.21.15.6:39132) 2023-07-21T22:37:02.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0d617640 1 -- 172.21.15.6:0/3262003471 learned_addr learned my addr 172.21.15.6:0/3262003471 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:02.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0ce16640 1 --2- 172.21.15.6:0/3262003471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee080d2fc0 0x7fee0815cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:02.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0de18640 1 --2- 172.21.15.6:0/3262003471 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee0815bde0 0x7fee08156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:02.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0d617640 1 -- 172.21.15.6:0/3262003471 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee0815bde0 msgr2=0x7fee08156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:02.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0d617640 1 --2- 172.21.15.6:0/3262003471 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee0815bde0 0x7fee08156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0d617640 1 -- 172.21.15.6:0/3262003471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee080d2fc0 msgr2=0x7fee0815cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:02.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0d617640 1 --2- 172.21.15.6:0/3262003471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee080d2fc0 0x7fee0815cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0d617640 1 -- 172.21.15.6:0/3262003471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee040093b0 con 0x7fee080d2300 2023-07-21T22:37:02.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0d617640 1 --2- 172.21.15.6:0/3262003471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee080d2300 0x7fee0815a1d0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fee04019050 tx=0x7fee040191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:02.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fedfdffb640 1 -- 172.21.15.6:0/3262003471 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04005ba0 con 0x7fee080d2300 2023-07-21T22:37:02.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fedfdffb640 1 -- 172.21.15.6:0/3262003471 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee04005d00 con 0x7fee080d2300 2023-07-21T22:37:02.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fedfdffb640 1 -- 172.21.15.6:0/3262003471 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04003b10 con 0x7fee080d2300 2023-07-21T22:37:02.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0f87b640 1 -- 172.21.15.6:0/3262003471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee08145120 con 0x7fee080d2300 2023-07-21T22:37:02.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0f87b640 1 -- 172.21.15.6:0/3262003471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee081456e0 con 0x7fee080d2300 2023-07-21T22:37:02.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.713+0000 7fee0f87b640 1 -- 172.21.15.6:0/3262003471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee080678d0 con 0x7fee080d2300 2023-07-21T22:37:02.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.717+0000 7fedfdffb640 1 -- 172.21.15.6:0/3262003471 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 46) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fee040b2040 con 0x7fee080d2300 2023-07-21T22:37:02.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.717+0000 7fedfdffb640 1 --2- 172.21.15.6:0/3262003471 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fedec0664c0 0x7fedec068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:02.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.717+0000 7fedfdffb640 1 -- 172.21.15.6:0/3262003471 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6566+0+0 (secure 0 0 0) 0x7fee0411d310 con 0x7fee080d2300 2023-07-21T22:37:02.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.717+0000 7fee0ce16640 1 -- 172.21.15.6:0/3262003471 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fedec0664c0 msgr2=0x7fedec068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1474634903 2023-07-21T22:37:02.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.717+0000 7fee0ce16640 1 --2- 172.21.15.6:0/3262003471 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fedec0664c0 0x7fedec068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:37:02.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.721+0000 7fedfdffb640 1 -- 172.21.15.6:0/3262003471 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee040ea200 con 0x7fee080d2300 2023-07-21T22:37:02.812 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:02.765+0000 7f3479e46180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:37:02.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.881+0000 7fee0f87b640 1 -- 172.21.15.6:0/3262003471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee080c98c0 con 0x7fee080d2300 2023-07-21T22:37:02.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.881+0000 7fedfdffb640 1 -- 172.21.15.6:0/3262003471 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v115) v1 ==== 93+0+10 (secure 0 0 0) 0x7fee040b00a0 con 0x7fee080d2300 2023-07-21T22:37:02.928 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:37:02.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.885+0000 7fee0f87b640 1 -- 172.21.15.6:0/3262003471 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fedec0664c0 msgr2=0x7fedec068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:37:02.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.885+0000 7fee0f87b640 1 --2- 172.21.15.6:0/3262003471 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fedec0664c0 0x7fedec068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.885+0000 7fee0f87b640 1 -- 172.21.15.6:0/3262003471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee080d2300 msgr2=0x7fee0815a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:02.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.885+0000 7fee0f87b640 1 --2- 172.21.15.6:0/3262003471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee080d2300 0x7fee0815a1d0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fee04019050 tx=0x7fee040191e0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.885+0000 7fee0f87b640 1 -- 172.21.15.6:0/3262003471 shutdown_connections 2023-07-21T22:37:02.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.885+0000 7fee0f87b640 1 --2- 172.21.15.6:0/3262003471 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fedec0664c0 0x7fedec068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.885+0000 7fee0f87b640 1 --2- 172.21.15.6:0/3262003471 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee0815bde0 0x7fee08156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.885+0000 7fee0f87b640 1 --2- 172.21.15.6:0/3262003471 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee080d2fc0 0x7fee0815cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.885+0000 7fee0f87b640 1 --2- 172.21.15.6:0/3262003471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee080d2300 0x7fee0815a1d0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:02.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.885+0000 7fee0f87b640 1 -- 172.21.15.6:0/3262003471 >> 172.21.15.6:0/3262003471 conn(0x7fee080659d0 msgr2=0x7fee0815acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:02.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.885+0000 7fee0f87b640 1 -- 172.21.15.6:0/3262003471 shutdown_connections 2023-07-21T22:37:02.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:02.885+0000 7fee0f87b640 1 -- 172.21.15.6:0/3262003471 wait complete. 2023-07-21T22:37:02.950 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:37:03.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.053+0000 7f1dbc80b640 1 Processor -- start 2023-07-21T22:37:03.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.053+0000 7f1dbc80b640 1 -- start start 2023-07-21T22:37:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.053+0000 7f1dbc80b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db80d2300 0x7f1db80d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.053+0000 7f1dbc80b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db80b04c0 con 0x7f1db80d2fc0 2023-07-21T22:37:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.053+0000 7f1dbc80b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db80b1060 con 0x7f1db815bde0 2023-07-21T22:37:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.053+0000 7f1dbc80b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db815c1b0 con 0x7f1db80d2300 2023-07-21T22:37:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.053+0000 7f1db5d9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1db80d2fc0 0x7f1db80b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52500/0 (socket says 172.21.15.6:52500) 2023-07-21T22:37:03.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.053+0000 7f1db5d9b640 1 -- 172.21.15.6:0/469821444 learned_addr learned my addr 172.21.15.6:0/469821444 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.053+0000 7f1db6d9d640 1 --2- 172.21.15.6:0/469821444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db80d2300 0x7f1db80d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:03.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.053+0000 7f1db559a640 1 -- 172.21.15.6:0/469821444 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262037004 0 0) 0x7f1db80b04c0 con 0x7f1db80d2fc0 2023-07-21T22:37:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.053+0000 7f1db559a640 1 -- 172.21.15.6:0/469821444 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1da0003530 con 0x7f1db80d2fc0 2023-07-21T22:37:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.053+0000 7f1db559a640 1 -- 172.21.15.6:0/469821444 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99663181 0 0) 0x7f1db80b1060 con 0x7f1db815bde0 2023-07-21T22:37:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.053+0000 7f1db559a640 1 -- 172.21.15.6:0/469821444 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1db80b04c0 con 0x7f1db815bde0 2023-07-21T22:37:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.053+0000 7f1db6d9d640 1 -- 172.21.15.6:0/469821444 >> v1:172.21.15.161:6789/0 conn(0x7f1db815bde0 legacy=0x7f1db80d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.053+0000 7f1db6d9d640 1 -- 172.21.15.6:0/469821444 >> v1:172.21.15.6:6789/0 conn(0x7f1db80d2fc0 legacy=0x7f1db80b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:03.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.053+0000 7f1db6d9d640 1 -- 172.21.15.6:0/469821444 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db80d0aa0 con 0x7f1db80d2300 2023-07-21T22:37:03.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.057+0000 7f1db6d9d640 1 --2- 172.21.15.6:0/469821444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db80d2300 0x7f1db80d2780 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009dc0 tx=0x7f1db001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab1f438bf69ce730 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:03.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.057+0000 7f1db559a640 1 -- 172.21.15.6:0/469821444 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db00a5940 con 0x7f1db80d2300 2023-07-21T22:37:03.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.057+0000 7f1db559a640 1 -- 172.21.15.6:0/469821444 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db00a5aa0 con 0x7f1db80d2300 2023-07-21T22:37:03.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.057+0000 7f1db559a640 1 -- 172.21.15.6:0/469821444 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db00a5e30 con 0x7f1db80d2300 2023-07-21T22:37:03.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.061+0000 7f1dbc80b640 1 -- 172.21.15.6:0/469821444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db80d2300 msgr2=0x7f1db80d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:03.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.061+0000 7f1dbc80b640 1 --2- 172.21.15.6:0/469821444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db80d2300 0x7f1db80d2780 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009dc0 tx=0x7f1db001c970 comp rx=0 tx=0).stop 2023-07-21T22:37:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.061+0000 7f1dbc80b640 1 -- 172.21.15.6:0/469821444 shutdown_connections 2023-07-21T22:37:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.061+0000 7f1dbc80b640 1 --2- 172.21.15.6:0/469821444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db80d2300 0x7f1db80d2780 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.061+0000 7f1dbc80b640 1 -- 172.21.15.6:0/469821444 >> 172.21.15.6:0/469821444 conn(0x7f1db80659d0 msgr2=0x7f1db809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.061+0000 7f1dbc80b640 1 -- 172.21.15.6:0/469821444 shutdown_connections 2023-07-21T22:37:03.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.061+0000 7f1dbc80b640 1 -- 172.21.15.6:0/469821444 wait complete. 2023-07-21T22:37:03.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.061+0000 7f1dbc80b640 1 Processor -- start 2023-07-21T22:37:03.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.061+0000 7f1dbc80b640 1 -- start start 2023-07-21T22:37:03.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1dbc80b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1db80d2300 0x7f1db806b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:03.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1dbc80b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db80d2fc0 0x7f1db815ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:03.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1dbc80b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db815bde0 0x7f1db8152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:03.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1dbc80b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db80b1210 con 0x7f1db80d2fc0 2023-07-21T22:37:03.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1dbc80b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db815f3d0 con 0x7f1db80d2300 2023-07-21T22:37:03.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1dbc80b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db80b1460 con 0x7f1db815bde0 2023-07-21T22:37:03.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1db5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db80d2fc0 0x7f1db815ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:03.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1db5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db80d2fc0 0x7f1db815ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39140/0 (socket says 172.21.15.6:39140) 2023-07-21T22:37:03.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1db5d9b640 1 -- 172.21.15.6:0/121429726 learned_addr learned my addr 172.21.15.6:0/121429726 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:03.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1db6d9d640 1 --2- 172.21.15.6:0/121429726 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db815bde0 0x7f1db8152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:03.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1db659c640 1 --2- 172.21.15.6:0/121429726 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1db80d2300 0x7f1db806b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:03.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1db5d9b640 1 -- 172.21.15.6:0/121429726 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db815bde0 msgr2=0x7f1db8152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:03.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1db5d9b640 1 --2- 172.21.15.6:0/121429726 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db815bde0 0x7f1db8152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1db5d9b640 1 -- 172.21.15.6:0/121429726 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1db80d2300 msgr2=0x7f1db806b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:03.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1db5d9b640 1 --2- 172.21.15.6:0/121429726 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1db80d2300 0x7f1db806b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1db5d9b640 1 -- 172.21.15.6:0/121429726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db0009a70 con 0x7f1db80d2fc0 2023-07-21T22:37:03.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1db5d9b640 1 --2- 172.21.15.6:0/121429726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db80d2fc0 0x7f1db815ea10 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f1dac005890 tx=0x7f1dac00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:03.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1da6ffd640 1 -- 172.21.15.6:0/121429726 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac005cf0 con 0x7f1db80d2fc0 2023-07-21T22:37:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1da6ffd640 1 -- 172.21.15.6:0/121429726 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac005e50 con 0x7f1db80d2fc0 2023-07-21T22:37:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1da6ffd640 1 -- 172.21.15.6:0/121429726 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac0072d0 con 0x7f1db80d2fc0 2023-07-21T22:37:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1dbc80b640 1 -- 172.21.15.6:0/121429726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db80b1740 con 0x7f1db80d2fc0 2023-07-21T22:37:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1dbc80b640 1 -- 172.21.15.6:0/121429726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db806b740 con 0x7f1db80d2fc0 2023-07-21T22:37:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.065+0000 7f1dbc80b640 1 -- 172.21.15.6:0/121429726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db80678d0 con 0x7f1db80d2fc0 2023-07-21T22:37:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.069+0000 7f1da6ffd640 1 -- 172.21.15.6:0/121429726 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 46) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f1dac007430 con 0x7f1db80d2fc0 2023-07-21T22:37:03.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.069+0000 7f1da6ffd640 1 --2- 172.21.15.6:0/121429726 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f1d980664c0 0x7f1d98068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:03.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.069+0000 7f1da6ffd640 1 -- 172.21.15.6:0/121429726 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6566+0+0 (secure 0 0 0) 0x7f1dac083780 con 0x7f1db80d2fc0 2023-07-21T22:37:03.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.069+0000 7f1db659c640 1 -- 172.21.15.6:0/121429726 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f1d980664c0 msgr2=0x7f1d98068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1474634903 2023-07-21T22:37:03.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.069+0000 7f1db659c640 1 --2- 172.21.15.6:0/121429726 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f1d980664c0 0x7f1d98068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:37:03.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.073+0000 7f1da6ffd640 1 -- 172.21.15.6:0/121429726 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1dac0507e0 con 0x7f1db80d2fc0 2023-07-21T22:37:03.242 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:03.197+0000 7ff927846180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:37:03.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.229+0000 7f1dbc80b640 1 -- 172.21.15.6:0/121429726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1db80cf7c0 con 0x7f1db80d2fc0 2023-07-21T22:37:03.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.229+0000 7f1da6ffd640 1 -- 172.21.15.6:0/121429726 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v115) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1dac053e00 con 0x7f1db80d2fc0 2023-07-21T22:37:03.275 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:37:03.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.229+0000 7f1dbc80b640 1 -- 172.21.15.6:0/121429726 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f1d980664c0 msgr2=0x7f1d98068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:37:03.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.229+0000 7f1dbc80b640 1 --2- 172.21.15.6:0/121429726 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f1d980664c0 0x7f1d98068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.229+0000 7f1dbc80b640 1 -- 172.21.15.6:0/121429726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db80d2fc0 msgr2=0x7f1db815ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:03.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.229+0000 7f1dbc80b640 1 --2- 172.21.15.6:0/121429726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db80d2fc0 0x7f1db815ea10 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f1dac005890 tx=0x7f1dac00c8b0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.233+0000 7f1dbc80b640 1 -- 172.21.15.6:0/121429726 shutdown_connections 2023-07-21T22:37:03.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.233+0000 7f1dbc80b640 1 --2- 172.21.15.6:0/121429726 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f1d980664c0 0x7f1d98068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.233+0000 7f1dbc80b640 1 --2- 172.21.15.6:0/121429726 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db815bde0 0x7f1db8152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.233+0000 7f1dbc80b640 1 --2- 172.21.15.6:0/121429726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db80d2fc0 0x7f1db815ea10 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.233+0000 7f1dbc80b640 1 --2- 172.21.15.6:0/121429726 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1db80d2300 0x7f1db806b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.233+0000 7f1dbc80b640 1 -- 172.21.15.6:0/121429726 >> 172.21.15.6:0/121429726 conn(0x7f1db80659d0 msgr2=0x7f1db80af220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:03.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.233+0000 7f1dbc80b640 1 -- 172.21.15.6:0/121429726 shutdown_connections 2023-07-21T22:37:03.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.233+0000 7f1dbc80b640 1 -- 172.21.15.6:0/121429726 wait complete. 2023-07-21T22:37:03.298 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:37:03.300 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:03.257+0000 7ff927846180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:37:03.344 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:03.297+0000 7f3479e46180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:37:03.355 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:03.313+0000 7ff927846180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:37:03.407 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:03.361+0000 7f3479e46180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:37:03.439 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:03.397+0000 7ff927846180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:37:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.401+0000 7f1d71100640 1 Processor -- start 2023-07-21T22:37:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.401+0000 7f1d71100640 1 -- start start 2023-07-21T22:37:03.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.401+0000 7f1d71100640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d6c0d2fc0 0x7f1d6c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:03.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.401+0000 7f1d71100640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d6c0b04c0 con 0x7f1d6c15bde0 2023-07-21T22:37:03.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.401+0000 7f1d71100640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d6c0d0aa0 con 0x7f1d6c0d2300 2023-07-21T22:37:03.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.401+0000 7f1d71100640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d6c15c1b0 con 0x7f1d6c0d2fc0 2023-07-21T22:37:03.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.401+0000 7f1d63fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d6c0d2fc0 0x7f1d6c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:03.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.401+0000 7f1d63fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1d6c0d2fc0 0x7f1d6c0b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39154/0 (socket says 172.21.15.6:39154) 2023-07-21T22:37:03.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.401+0000 7f1d6ad9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1d6c15bde0 0x7f1d6c0d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52506/0 (socket says 172.21.15.6:52506) 2023-07-21T22:37:03.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.401+0000 7f1d63fff640 1 -- 172.21.15.6:0/3039216646 learned_addr learned my addr 172.21.15.6:0/3039216646 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:03.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.405+0000 7f1d63fff640 1 -- 172.21.15.6:0/3039216646 >> v1:172.21.15.161:6789/0 conn(0x7f1d6c0d2300 legacy=0x7f1d6c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:03.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.405+0000 7f1d63fff640 1 -- 172.21.15.6:0/3039216646 >> v1:172.21.15.6:6789/0 conn(0x7f1d6c15bde0 legacy=0x7f1d6c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:03.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.405+0000 7f1d63fff640 1 -- 172.21.15.6:0/3039216646 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c0afb90 con 0x7f1d6c0d2fc0 2023-07-21T22:37:03.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.405+0000 7f1d6a59c640 1 -- 172.21.15.6:0/3039216646 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947215138 0 0) 0x7f1d6c0b04c0 con 0x7f1d6c15bde0 2023-07-21T22:37:03.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.405+0000 7f1d63fff640 1 --2- 172.21.15.6:0/3039216646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d6c0d2fc0 0x7f1d6c0b0950 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f1d54009870 tx=0x7f1d5401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f049fc84d19ed60f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:03.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.405+0000 7f1d6a59c640 1 -- 172.21.15.6:0/3039216646 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d540a9400 con 0x7f1d6c0d2fc0 2023-07-21T22:37:03.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.405+0000 7f1d6a59c640 1 -- 172.21.15.6:0/3039216646 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d540a9560 con 0x7f1d6c0d2fc0 2023-07-21T22:37:03.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.405+0000 7f1d6a59c640 1 -- 172.21.15.6:0/3039216646 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d540a98f0 con 0x7f1d6c0d2fc0 2023-07-21T22:37:03.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d71100640 1 -- 172.21.15.6:0/3039216646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d6c0d2fc0 msgr2=0x7f1d6c0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:03.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d71100640 1 --2- 172.21.15.6:0/3039216646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d6c0d2fc0 0x7f1d6c0b0950 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f1d54009870 tx=0x7f1d5401c540 comp rx=0 tx=0).stop 2023-07-21T22:37:03.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d71100640 1 -- 172.21.15.6:0/3039216646 shutdown_connections 2023-07-21T22:37:03.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d71100640 1 --2- 172.21.15.6:0/3039216646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d6c0d2fc0 0x7f1d6c0b0950 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d71100640 1 -- 172.21.15.6:0/3039216646 >> 172.21.15.6:0/3039216646 conn(0x7f1d6c0659d0 msgr2=0x7f1d6c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:03.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d71100640 1 -- 172.21.15.6:0/3039216646 shutdown_connections 2023-07-21T22:37:03.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d71100640 1 -- 172.21.15.6:0/3039216646 wait complete. 2023-07-21T22:37:03.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d71100640 1 Processor -- start 2023-07-21T22:37:03.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d71100640 1 -- start start 2023-07-21T22:37:03.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d71100640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d6c0d2300 0x7f1d6c0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:03.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d71100640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d6c0d2fc0 0x7f1d6c15e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:03.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d71100640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d6c15bde0 0x7f1d6c15d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d71100640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c0c7d50 con 0x7f1d6c15bde0 2023-07-21T22:37:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d71100640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c0c8030 con 0x7f1d6c0d2fc0 2023-07-21T22:37:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d71100640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c0c8310 con 0x7f1d6c0d2300 2023-07-21T22:37:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d6b59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d6c15bde0 0x7f1d6c15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d6ad9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d6c0d2300 0x7f1d6c0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d6b59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d6c15bde0 0x7f1d6c15d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39164/0 (socket says 172.21.15.6:39164) 2023-07-21T22:37:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d6ad9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d6c0d2300 0x7f1d6c0cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:48342/0 (socket says 172.21.15.6:48342) 2023-07-21T22:37:03.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d6b59e640 1 -- 172.21.15.6:0/3767807898 learned_addr learned my addr 172.21.15.6:0/3767807898 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:03.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d63fff640 1 --2- 172.21.15.6:0/3767807898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d6c0d2fc0 0x7f1d6c15e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:03.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d6b59e640 1 -- 172.21.15.6:0/3767807898 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d6c0d2300 msgr2=0x7f1d6c0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:03.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d6b59e640 1 --2- 172.21.15.6:0/3767807898 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d6c0d2300 0x7f1d6c0cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d6b59e640 1 -- 172.21.15.6:0/3767807898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d6c0d2fc0 msgr2=0x7f1d6c15e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:03.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d6b59e640 1 --2- 172.21.15.6:0/3767807898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d6c0d2fc0 0x7f1d6c15e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.409+0000 7f1d6b59e640 1 -- 172.21.15.6:0/3767807898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d540094d0 con 0x7f1d6c15bde0 2023-07-21T22:37:03.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.413+0000 7f1d6b59e640 1 --2- 172.21.15.6:0/3767807898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d6c15bde0 0x7f1d6c15d370 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400c730 tx=0x7f1d6400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:03.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.413+0000 7f1d637fe640 1 -- 172.21.15.6:0/3767807898 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d64003b80 con 0x7f1d6c15bde0 2023-07-21T22:37:03.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.413+0000 7f1d637fe640 1 -- 172.21.15.6:0/3767807898 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d64003ce0 con 0x7f1d6c15bde0 2023-07-21T22:37:03.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.413+0000 7f1d637fe640 1 -- 172.21.15.6:0/3767807898 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6400aa30 con 0x7f1d6c15bde0 2023-07-21T22:37:03.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.413+0000 7f1d71100640 1 -- 172.21.15.6:0/3767807898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d6c0c85f0 con 0x7f1d6c15bde0 2023-07-21T22:37:03.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.413+0000 7f1d71100640 1 -- 172.21.15.6:0/3767807898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6c0c7950 con 0x7f1d6c15bde0 2023-07-21T22:37:03.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.413+0000 7f1d71100640 1 -- 172.21.15.6:0/3767807898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d6c0678d0 con 0x7f1d6c15bde0 2023-07-21T22:37:03.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.413+0000 7f1d637fe640 1 -- 172.21.15.6:0/3767807898 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 46) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f1d6400ab90 con 0x7f1d6c15bde0 2023-07-21T22:37:03.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.413+0000 7f1d637fe640 1 --2- 172.21.15.6:0/3767807898 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f1d4c0664c0 0x7f1d4c068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:03.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.413+0000 7f1d637fe640 1 -- 172.21.15.6:0/3767807898 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6566+0+0 (secure 0 0 0) 0x7f1d640840c0 con 0x7f1d6c15bde0 2023-07-21T22:37:03.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.413+0000 7f1d6ad9d640 1 -- 172.21.15.6:0/3767807898 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f1d4c0664c0 msgr2=0x7f1d4c068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1474634903 2023-07-21T22:37:03.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.413+0000 7f1d6ad9d640 1 --2- 172.21.15.6:0/3767807898 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f1d4c0664c0 0x7f1d4c068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:37:03.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.421+0000 7f1d637fe640 1 -- 172.21.15.6:0/3767807898 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1d64050ff0 con 0x7f1d6c15bde0 2023-07-21T22:37:03.473 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:03.429+0000 7f3479e46180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:37:03.498 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:03.457+0000 7ff927846180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:37:03.567 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:03.521+0000 7f3479e46180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:37:03.582 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:03.541+0000 7ff927846180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:37:03.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.581+0000 7f1d71100640 1 -- 172.21.15.6:0/3767807898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1d6c1525a0 con 0x7f1d6c15bde0 2023-07-21T22:37:03.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.581+0000 7f1d637fe640 1 -- 172.21.15.6:0/3767807898 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v115) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1d64054610 con 0x7f1d6c15bde0 2023-07-21T22:37:03.627 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:37:03.628 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:03.581+0000 7f3479e46180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:37:03.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.585+0000 7f1d71100640 1 -- 172.21.15.6:0/3767807898 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f1d4c0664c0 msgr2=0x7f1d4c068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:37:03.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.585+0000 7f1d71100640 1 --2- 172.21.15.6:0/3767807898 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f1d4c0664c0 0x7f1d4c068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.585+0000 7f1d71100640 1 -- 172.21.15.6:0/3767807898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d6c15bde0 msgr2=0x7f1d6c15d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:03.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.585+0000 7f1d71100640 1 --2- 172.21.15.6:0/3767807898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d6c15bde0 0x7f1d6c15d370 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400c730 tx=0x7f1d6400cbf0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.585+0000 7f1d71100640 1 -- 172.21.15.6:0/3767807898 shutdown_connections 2023-07-21T22:37:03.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.585+0000 7f1d71100640 1 --2- 172.21.15.6:0/3767807898 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f1d4c0664c0 0x7f1d4c068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.585+0000 7f1d71100640 1 --2- 172.21.15.6:0/3767807898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d6c15bde0 0x7f1d6c15d370 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.585+0000 7f1d71100640 1 --2- 172.21.15.6:0/3767807898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1d6c0d2fc0 0x7f1d6c15e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.585+0000 7f1d71100640 1 --2- 172.21.15.6:0/3767807898 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1d6c0d2300 0x7f1d6c0cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.585+0000 7f1d71100640 1 -- 172.21.15.6:0/3767807898 >> 172.21.15.6:0/3767807898 conn(0x7f1d6c0659d0 msgr2=0x7f1d6c0aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:03.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.585+0000 7f1d71100640 1 -- 172.21.15.6:0/3767807898 shutdown_connections 2023-07-21T22:37:03.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.585+0000 7f1d71100640 1 -- 172.21.15.6:0/3767807898 wait complete. 2023-07-21T22:37:03.638 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:03.597+0000 7ff927846180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:37:03.650 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:37:03.719 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:03.673+0000 7f3479e46180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:37:03.780 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:03.737+0000 7ff927846180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:37:03.780 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:03.733+0000 7f3479e46180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:37:03.837 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:03.793+0000 7ff927846180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:37:03.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.793+0000 7fad93fd2640 1 Processor -- start 2023-07-21T22:37:03.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.793+0000 7fad93fd2640 1 -- start start 2023-07-21T22:37:03.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.797+0000 7fad93fd2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fad8c0d2fc0 0x7fad8c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:03.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.797+0000 7fad93fd2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad8c0d2300 0x7fad8c0d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:03.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.797+0000 7fad93fd2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad8c0b04c0 con 0x7fad8c15bde0 2023-07-21T22:37:03.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.797+0000 7fad93fd2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8c15c1b0 con 0x7fad8c0d2fc0 2023-07-21T22:37:03.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.797+0000 7fad93fd2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c0d2cc0 con 0x7fad8c0d2300 2023-07-21T22:37:03.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.797+0000 7fad9256f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad8c0d2300 0x7fad8c0d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:03.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.797+0000 7fad9156d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fad8c0d2fc0 0x7fad8c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:03.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.797+0000 7fad9256f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad8c0d2300 0x7fad8c0d2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:48354/0 (socket says 172.21.15.6:48354) 2023-07-21T22:37:03.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.797+0000 7fad9256f640 1 -- 172.21.15.6:0/1512590537 learned_addr learned my addr 172.21.15.6:0/1512590537 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:03.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.797+0000 7fad9256f640 1 -- 172.21.15.6:0/1512590537 >> v2:172.21.15.161:3300/0 conn(0x7fad8c0d2fc0 msgr2=0x7fad8c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:03.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.797+0000 7fad9256f640 1 --2- 172.21.15.6:0/1512590537 >> v2:172.21.15.161:3300/0 conn(0x7fad8c0d2fc0 0x7fad8c0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.797+0000 7fad9256f640 1 -- 172.21.15.6:0/1512590537 >> v1:172.21.15.161:6789/0 conn(0x7fad8c15bde0 legacy=0x7fad8c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.797+0000 7fad9256f640 1 -- 172.21.15.6:0/1512590537 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c0d0aa0 con 0x7fad8c0d2300 2023-07-21T22:37:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.801+0000 7fad9256f640 1 --2- 172.21.15.6:0/1512590537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad8c0d2300 0x7fad8c0d2780 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fad84009e50 tx=0x7fad8401ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fec80c2d8412a521 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:03.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.801+0000 7fad90d6c640 1 -- 172.21.15.6:0/1512590537 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad840a58e0 con 0x7fad8c0d2300 2023-07-21T22:37:03.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.801+0000 7fad90d6c640 1 -- 172.21.15.6:0/1512590537 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad840a5a40 con 0x7fad8c0d2300 2023-07-21T22:37:03.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.801+0000 7fad90d6c640 1 -- 172.21.15.6:0/1512590537 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad840a5dd0 con 0x7fad8c0d2300 2023-07-21T22:37:03.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.801+0000 7fad93fd2640 1 -- 172.21.15.6:0/1512590537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad8c0d2300 msgr2=0x7fad8c0d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:03.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.801+0000 7fad93fd2640 1 --2- 172.21.15.6:0/1512590537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad8c0d2300 0x7fad8c0d2780 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fad84009e50 tx=0x7fad8401ca10 comp rx=0 tx=0).stop 2023-07-21T22:37:03.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.801+0000 7fad93fd2640 1 -- 172.21.15.6:0/1512590537 shutdown_connections 2023-07-21T22:37:03.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.801+0000 7fad93fd2640 1 --2- 172.21.15.6:0/1512590537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad8c0d2300 0x7fad8c0d2780 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.801+0000 7fad93fd2640 1 --2- 172.21.15.6:0/1512590537 >> v2:172.21.15.161:3300/0 conn(0x7fad8c0d2fc0 0x7fad8c0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.801+0000 7fad93fd2640 1 -- 172.21.15.6:0/1512590537 >> 172.21.15.6:0/1512590537 conn(0x7fad8c0659d0 msgr2=0x7fad8c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:03.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.801+0000 7fad93fd2640 1 -- 172.21.15.6:0/1512590537 shutdown_connections 2023-07-21T22:37:03.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.801+0000 7fad93fd2640 1 -- 172.21.15.6:0/1512590537 wait complete. 2023-07-21T22:37:03.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.801+0000 7fad93fd2640 1 Processor -- start 2023-07-21T22:37:03.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.801+0000 7fad93fd2640 1 -- start start 2023-07-21T22:37:03.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad93fd2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad8c0d2300 0x7fad8c15c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:03.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad93fd2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad8c0d2fc0 0x7fad8c14cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:03.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad93fd2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad8c15bde0 0x7fad8c14d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:03.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad93fd2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c15f210 con 0x7fad8c0d2300 2023-07-21T22:37:03.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad93fd2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c15ef30 con 0x7fad8c0d2fc0 2023-07-21T22:37:03.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad93fd2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c152b60 con 0x7fad8c15bde0 2023-07-21T22:37:03.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad91d6e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad8c0d2300 0x7fad8c15c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:03.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad91d6e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad8c0d2300 0x7fad8c15c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39172/0 (socket says 172.21.15.6:39172) 2023-07-21T22:37:03.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad91d6e640 1 -- 172.21.15.6:0/3018518396 learned_addr learned my addr 172.21.15.6:0/3018518396 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:03.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad9156d640 1 --2- 172.21.15.6:0/3018518396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad8c0d2fc0 0x7fad8c14cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:03.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad9256f640 1 --2- 172.21.15.6:0/3018518396 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad8c15bde0 0x7fad8c14d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:03.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad91d6e640 1 -- 172.21.15.6:0/3018518396 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad8c15bde0 msgr2=0x7fad8c14d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:03.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad91d6e640 1 --2- 172.21.15.6:0/3018518396 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad8c15bde0 0x7fad8c14d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad91d6e640 1 -- 172.21.15.6:0/3018518396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad8c0d2fc0 msgr2=0x7fad8c14cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:03.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad91d6e640 1 --2- 172.21.15.6:0/3018518396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad8c0d2fc0 0x7fad8c14cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:03.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad91d6e640 1 -- 172.21.15.6:0/3018518396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84009b30 con 0x7fad8c0d2300 2023-07-21T22:37:03.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad91d6e640 1 --2- 172.21.15.6:0/3018518396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad8c0d2300 0x7fad8c15c320 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fad8800c400 tx=0x7fad8800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:03.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad827fc640 1 -- 172.21.15.6:0/3018518396 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad880052d0 con 0x7fad8c0d2300 2023-07-21T22:37:03.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad827fc640 1 -- 172.21.15.6:0/3018518396 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad88005470 con 0x7fad8c0d2300 2023-07-21T22:37:03.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad827fc640 1 -- 172.21.15.6:0/3018518396 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88006a70 con 0x7fad8c0d2300 2023-07-21T22:37:03.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad93fd2640 1 -- 172.21.15.6:0/3018518396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8c152e40 con 0x7fad8c0d2300 2023-07-21T22:37:03.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad93fd2640 1 -- 172.21.15.6:0/3018518396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8c14d4b0 con 0x7fad8c0d2300 2023-07-21T22:37:03.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.805+0000 7fad93fd2640 1 -- 172.21.15.6:0/3018518396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad8c1529c0 con 0x7fad8c0d2300 2023-07-21T22:37:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.809+0000 7fad827fc640 1 -- 172.21.15.6:0/3018518396 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 46) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fad88006bd0 con 0x7fad8c0d2300 2023-07-21T22:37:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.809+0000 7fad827fc640 1 --2- 172.21.15.6:0/3018518396 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fad700664f0 0x7fad700689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.809+0000 7fad827fc640 1 -- 172.21.15.6:0/3018518396 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6566+0+0 (secure 0 0 0) 0x7fad88083690 con 0x7fad8c0d2300 2023-07-21T22:37:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.809+0000 7fad9156d640 1 -- 172.21.15.6:0/3018518396 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fad700664f0 msgr2=0x7fad700689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1474634903 2023-07-21T22:37:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.809+0000 7fad9156d640 1 --2- 172.21.15.6:0/3018518396 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fad700664f0 0x7fad700689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:37:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.813+0000 7fad827fc640 1 -- 172.21.15.6:0/3018518396 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fad8c1529c0 con 0x7fad8c0d2300 2023-07-21T22:37:03.935 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:03.889+0000 7f3479e46180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:37:03.997 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:03.953+0000 7f3479e46180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:37:04.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.969+0000 7fad93fd2640 1 -- 172.21.15.6:0/3018518396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fad8c1529c0 con 0x7fad8c0d2300 2023-07-21T22:37:04.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.973+0000 7fad827fc640 1 -- 172.21.15.6:0/3018518396 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v115) v1 ==== 100+0+11 (secure 0 0 0) 0x7fad8c1529c0 con 0x7fad8c0d2300 2023-07-21T22:37:04.017 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:37:04.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.973+0000 7fad93fd2640 1 -- 172.21.15.6:0/3018518396 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fad700664f0 msgr2=0x7fad700689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:37:04.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.973+0000 7fad93fd2640 1 --2- 172.21.15.6:0/3018518396 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fad700664f0 0x7fad700689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.973+0000 7fad93fd2640 1 -- 172.21.15.6:0/3018518396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad8c0d2300 msgr2=0x7fad8c15c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:04.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.973+0000 7fad93fd2640 1 --2- 172.21.15.6:0/3018518396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad8c0d2300 0x7fad8c15c320 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fad8800c400 tx=0x7fad8800c8c0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.973+0000 7fad93fd2640 1 -- 172.21.15.6:0/3018518396 shutdown_connections 2023-07-21T22:37:04.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.973+0000 7fad93fd2640 1 --2- 172.21.15.6:0/3018518396 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fad700664f0 0x7fad700689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.973+0000 7fad93fd2640 1 --2- 172.21.15.6:0/3018518396 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad8c15bde0 0x7fad8c14d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.973+0000 7fad93fd2640 1 --2- 172.21.15.6:0/3018518396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad8c0d2fc0 0x7fad8c14cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.973+0000 7fad93fd2640 1 --2- 172.21.15.6:0/3018518396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad8c0d2300 0x7fad8c15c320 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.973+0000 7fad93fd2640 1 -- 172.21.15.6:0/3018518396 >> 172.21.15.6:0/3018518396 conn(0x7fad8c0659d0 msgr2=0x7fad8c0ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:04.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.973+0000 7fad93fd2640 1 -- 172.21.15.6:0/3018518396 shutdown_connections 2023-07-21T22:37:04.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:03.973+0000 7fad93fd2640 1 -- 172.21.15.6:0/3018518396 wait complete. 2023-07-21T22:37:04.039 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:37:04.077 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:37:04.078 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:37:04.078 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:37:04.086 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:04.041+0000 7ff927846180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:37:04.219 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:04.177+0000 7ff927846180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:37:04.259 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:37:04.259 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:37:04.259 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:37:04.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.217+0000 7f204300b640 1 Processor -- start 2023-07-21T22:37:04.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.217+0000 7f204300b640 1 -- start start 2023-07-21T22:37:04.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.217+0000 7f204300b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f203c0d06b0 0x7f203c0b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:04.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.217+0000 7f204300b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f203c145430 0x7f203c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:04.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.217+0000 7f204300b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203c0b2410 con 0x7f203c0b1f70 2023-07-21T22:37:04.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.217+0000 7f204300b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f203c0b26f0 con 0x7f203c0d06b0 2023-07-21T22:37:04.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.217+0000 7f204300b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203c0b29d0 con 0x7f203c145430 2023-07-21T22:37:04.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.217+0000 7f2040da7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f203c0d06b0 0x7f203c0b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:04.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.217+0000 7f203bfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f203c145430 0x7f203c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:04.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.217+0000 7f203bfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f203c145430 0x7f203c0b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:48362/0 (socket says 172.21.15.6:48362) 2023-07-21T22:37:04.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.217+0000 7f203bfff640 1 -- 172.21.15.6:0/38998617 learned_addr learned my addr 172.21.15.6:0/38998617 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:04.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.217+0000 7f203bfff640 1 -- 172.21.15.6:0/38998617 >> v2:172.21.15.161:3300/0 conn(0x7f203c0d06b0 msgr2=0x7f203c0b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:04.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.217+0000 7f203bfff640 1 --2- 172.21.15.6:0/38998617 >> v2:172.21.15.161:3300/0 conn(0x7f203c0d06b0 0x7f203c0b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.217+0000 7f203bfff640 1 -- 172.21.15.6:0/38998617 >> v1:172.21.15.161:6789/0 conn(0x7f203c0b1f70 legacy=0x7f203c0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:04.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.217+0000 7f203bfff640 1 -- 172.21.15.6:0/38998617 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203c0b2cb0 con 0x7f203c145430 2023-07-21T22:37:04.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.221+0000 7f203bfff640 1 --2- 172.21.15.6:0/38998617 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f203c145430 0x7f203c0b34b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2028009870 tx=0x7f202801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=478790410c0245c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:04.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.221+0000 7f203b7fe640 1 -- 172.21.15.6:0/38998617 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20280a95f0 con 0x7f203c145430 2023-07-21T22:37:04.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.221+0000 7f203b7fe640 1 -- 172.21.15.6:0/38998617 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20280a9750 con 0x7f203c145430 2023-07-21T22:37:04.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.221+0000 7f203b7fe640 1 -- 172.21.15.6:0/38998617 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20280a9ae0 con 0x7f203c145430 2023-07-21T22:37:04.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.221+0000 7f204300b640 1 -- 172.21.15.6:0/38998617 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f203c145430 msgr2=0x7f203c0b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:04.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.221+0000 7f204300b640 1 --2- 172.21.15.6:0/38998617 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f203c145430 0x7f203c0b34b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2028009870 tx=0x7f202801c510 comp rx=0 tx=0).stop 2023-07-21T22:37:04.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.221+0000 7f204300b640 1 -- 172.21.15.6:0/38998617 shutdown_connections 2023-07-21T22:37:04.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.221+0000 7f204300b640 1 --2- 172.21.15.6:0/38998617 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f203c145430 0x7f203c0b34b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.221+0000 7f204300b640 1 --2- 172.21.15.6:0/38998617 >> v2:172.21.15.161:3300/0 conn(0x7f203c0d06b0 0x7f203c0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.221+0000 7f204300b640 1 -- 172.21.15.6:0/38998617 >> 172.21.15.6:0/38998617 conn(0x7f203c0659d0 msgr2=0x7f203c09b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:04.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.221+0000 7f204300b640 1 -- 172.21.15.6:0/38998617 shutdown_connections 2023-07-21T22:37:04.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.221+0000 7f204300b640 1 -- 172.21.15.6:0/38998617 wait complete. 2023-07-21T22:37:04.270 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f3479e46180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:37:04.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f204300b640 1 Processor -- start 2023-07-21T22:37:04.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f204300b640 1 -- start start 2023-07-21T22:37:04.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f204300b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f203c0b1f70 0x7f203c0cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:04.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f204300b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203c0d06b0 0x7f203c0cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:04.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f204300b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f203c0cf210 0x7f203c0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:04.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f204300b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c15d710 con 0x7f203c0d06b0 2023-07-21T22:37:04.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f204300b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203c15d9f0 con 0x7f203c0b1f70 2023-07-21T22:37:04.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f204300b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203c15dcd0 con 0x7f203c0cf210 2023-07-21T22:37:04.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f203bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203c0d06b0 0x7f203c0cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:04.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f203bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203c0d06b0 0x7f203c0cecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39182/0 (socket says 172.21.15.6:39182) 2023-07-21T22:37:04.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f203bfff640 1 -- 172.21.15.6:0/1686674660 learned_addr learned my addr 172.21.15.6:0/1686674660 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:04.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f2040da7640 1 --2- 172.21.15.6:0/1686674660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f203c0b1f70 0x7f203c0cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:04.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f20415a8640 1 --2- 172.21.15.6:0/1686674660 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f203c0cf210 0x7f203c0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:04.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f203bfff640 1 -- 172.21.15.6:0/1686674660 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f203c0cf210 msgr2=0x7f203c0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:04.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f203bfff640 1 --2- 172.21.15.6:0/1686674660 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f203c0cf210 0x7f203c0cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f203bfff640 1 -- 172.21.15.6:0/1686674660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f203c0b1f70 msgr2=0x7f203c0cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:04.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f203bfff640 1 --2- 172.21.15.6:0/1686674660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f203c0b1f70 0x7f203c0cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f203bfff640 1 -- 172.21.15.6:0/1686674660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20280094d0 con 0x7f203c0d06b0 2023-07-21T22:37:04.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f2040da7640 1 --2- 172.21.15.6:0/1686674660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f203c0b1f70 0x7f203c0cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:04.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.225+0000 7f203bfff640 1 --2- 172.21.15.6:0/1686674660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203c0d06b0 0x7f203c0cecd0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f20280ab040 tx=0x7f202801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:04.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.229+0000 7f20397fa640 1 -- 172.21.15.6:0/1686674660 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20280bc650 con 0x7f203c0d06b0 2023-07-21T22:37:04.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.229+0000 7f20397fa640 1 -- 172.21.15.6:0/1686674660 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20280bc7b0 con 0x7f203c0d06b0 2023-07-21T22:37:04.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.229+0000 7f20397fa640 1 -- 172.21.15.6:0/1686674660 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20280bcb60 con 0x7f203c0d06b0 2023-07-21T22:37:04.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.229+0000 7f204300b640 1 -- 172.21.15.6:0/1686674660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203c15dfb0 con 0x7f203c0d06b0 2023-07-21T22:37:04.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.229+0000 7f204300b640 1 -- 172.21.15.6:0/1686674660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203c15e7b0 con 0x7f203c0d06b0 2023-07-21T22:37:04.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.229+0000 7f204300b640 1 -- 172.21.15.6:0/1686674660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203c072e70 con 0x7f203c0d06b0 2023-07-21T22:37:04.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.229+0000 7f20397fa640 1 -- 172.21.15.6:0/1686674660 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 46) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f20280bccc0 con 0x7f203c0d06b0 2023-07-21T22:37:04.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.229+0000 7f20397fa640 1 --2- 172.21.15.6:0/1686674660 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f20200664c0 0x7f2020068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:04.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.229+0000 7f20397fa640 1 -- 172.21.15.6:0/1686674660 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6566+0+0 (secure 0 0 0) 0x7f202811ebe0 con 0x7f203c0d06b0 2023-07-21T22:37:04.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.229+0000 7f2040da7640 1 -- 172.21.15.6:0/1686674660 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f20200664c0 msgr2=0x7f2020068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1474634903 2023-07-21T22:37:04.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.229+0000 7f2040da7640 1 --2- 172.21.15.6:0/1686674660 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f20200664c0 0x7f2020068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:37:04.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.233+0000 7f20397fa640 1 -- 172.21.15.6:0/1686674660 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f20280ebad0 con 0x7f203c0d06b0 2023-07-21T22:37:04.345 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:04.301+0000 7ff927846180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:37:04.414 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:04.369+0000 7f3479e46180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:37:04.415 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:04.373+0000 7ff927846180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:37:04.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.405+0000 7f204300b640 1 -- 172.21.15.6:0/1686674660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f203c0678d0 con 0x7f203c0d06b0 2023-07-21T22:37:04.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.405+0000 7f20397fa640 1 -- 172.21.15.6:0/1686674660 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v115) v1 ==== 80+0+477 (secure 0 0 0) 0x7f20280ef0f0 con 0x7f203c0d06b0 2023-07-21T22:37:04.450 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6833/3891612664 2023-07-22T22:35:58.832528+0000 2023-07-21T22:37:04.450 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6832/3891612664 2023-07-22T22:35:58.832528+0000 2023-07-21T22:37:04.451 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/2035498467 2023-07-22T22:35:58.832528+0000 2023-07-21T22:37:04.451 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/4102091229 2023-07-22T22:35:58.832528+0000 2023-07-21T22:37:04.451 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/1144695770 2023-07-22T22:35:58.832528+0000 2023-07-21T22:37:04.451 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/2493427911 2023-07-22T22:35:58.832528+0000 2023-07-21T22:37:04.451 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/3550191976 2023-07-22T22:35:58.832528+0000 2023-07-21T22:37:04.451 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/253243953 2023-07-22T22:35:58.832528+0000 2023-07-21T22:37:04.452 INFO:teuthology.orchestra.run.smithi006.stderr:listed 8 entries 2023-07-21T22:37:04.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.405+0000 7f204300b640 1 -- 172.21.15.6:0/1686674660 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f20200664c0 msgr2=0x7f2020068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:37:04.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.405+0000 7f204300b640 1 --2- 172.21.15.6:0/1686674660 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f20200664c0 0x7f2020068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.405+0000 7f204300b640 1 -- 172.21.15.6:0/1686674660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203c0d06b0 msgr2=0x7f203c0cecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.405+0000 7f204300b640 1 --2- 172.21.15.6:0/1686674660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203c0d06b0 0x7f203c0cecd0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f20280ab040 tx=0x7f202801ad50 comp rx=0 tx=0).stop 2023-07-21T22:37:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.405+0000 7f204300b640 1 -- 172.21.15.6:0/1686674660 shutdown_connections 2023-07-21T22:37:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.405+0000 7f204300b640 1 --2- 172.21.15.6:0/1686674660 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f20200664c0 0x7f2020068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.405+0000 7f204300b640 1 --2- 172.21.15.6:0/1686674660 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f203c0cf210 0x7f203c0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.405+0000 7f204300b640 1 --2- 172.21.15.6:0/1686674660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203c0d06b0 0x7f203c0cecd0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.405+0000 7f204300b640 1 --2- 172.21.15.6:0/1686674660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f203c0b1f70 0x7f203c0cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.405+0000 7f204300b640 1 -- 172.21.15.6:0/1686674660 >> 172.21.15.6:0/1686674660 conn(0x7f203c0659d0 msgr2=0x7f203c15c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:04.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.405+0000 7f204300b640 1 -- 172.21.15.6:0/1686674660 shutdown_connections 2023-07-21T22:37:04.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.405+0000 7f204300b640 1 -- 172.21.15.6:0/1686674660 wait complete. 2023-07-21T22:37:04.472 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-21T22:37:04.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:04.473 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-21T22:37:04.537 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:37:04.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:04.539 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T22:37:04.548 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:04.505+0000 7ff927846180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:37:04.550 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:37:04.551 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:37:04.554 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:04.509+0000 7f3479e46180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:37:04.559 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:37:04.560 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:37:04.560 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:37:04.571 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:37:04.571 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:37:04.572 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:37:04.611 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:37:04.612 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:37:04.633 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:04.589+0000 7f3479e46180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:37:04.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.713+0000 7f72eeb82640 1 Processor -- start 2023-07-21T22:37:04.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.713+0000 7f72eeb82640 1 -- start start 2023-07-21T22:37:04.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.713+0000 7f72eeb82640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f72e8158ce0 0x7f72e8070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:04.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.713+0000 7f72eeb82640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72e80c8ad0 0x7f72e80c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:04.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.713+0000 7f72eeb82640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f72e80c9560 0x7f72e80cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:04.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.713+0000 7f72eeb82640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e80c99e0 con 0x7f72e8158ce0 2023-07-21T22:37:04.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.713+0000 7f72eeb82640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72e80cc700 con 0x7f72e80c9560 2023-07-21T22:37:04.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.713+0000 7f72eeb82640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e80b0ff0 con 0x7f72e80c8ad0 2023-07-21T22:37:04.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.713+0000 7f72ec91e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f72e8158ce0 0x7f72e8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:04.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.713+0000 7f72ec91e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f72e8158ce0 0x7f72e8070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39190/0 (socket says 172.21.15.6:39190) 2023-07-21T22:37:04.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.713+0000 7f72ec91e640 1 -- 172.21.15.6:0/1073202041 learned_addr learned my addr 172.21.15.6:0/1073202041 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:04.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.713+0000 7f72e7fff640 1 --2- 172.21.15.6:0/1073202041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72e80c8ad0 0x7f72e80c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:04.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.713+0000 7f72ed11f640 1 --2- 172.21.15.6:0/1073202041 >> v2:172.21.15.161:3300/0 conn(0x7f72e80c9560 0x7f72e80cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:04.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.713+0000 7f72ec91e640 1 -- 172.21.15.6:0/1073202041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72e80c8ad0 msgr2=0x7f72e80c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:04.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.713+0000 7f72ec91e640 1 --2- 172.21.15.6:0/1073202041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72e80c8ad0 0x7f72e80c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.713+0000 7f72ec91e640 1 -- 172.21.15.6:0/1073202041 >> v2:172.21.15.161:3300/0 conn(0x7f72e80c9560 msgr2=0x7f72e80cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:04.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.713+0000 7f72ec91e640 1 --2- 172.21.15.6:0/1073202041 >> v2:172.21.15.161:3300/0 conn(0x7f72e80c9560 0x7f72e80cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.713+0000 7f72ec91e640 1 -- 172.21.15.6:0/1073202041 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e8070c80 con 0x7f72e8158ce0 2023-07-21T22:37:04.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.717+0000 7f72ec91e640 1 --2- 172.21.15.6:0/1073202041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8158ce0 0x7f72e8070450 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f72e80c17e0 tx=0x7f72dc01e5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d852a15f5079f27d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:04.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.717+0000 7f72e77fe640 1 -- 172.21.15.6:0/1073202041 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72dc0a8040 con 0x7f72e8158ce0 2023-07-21T22:37:04.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.717+0000 7f72e77fe640 1 -- 172.21.15.6:0/1073202041 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72dc0ac600 con 0x7f72e8158ce0 2023-07-21T22:37:04.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.717+0000 7f72e77fe640 1 -- 172.21.15.6:0/1073202041 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72dc0ac990 con 0x7f72e8158ce0 2023-07-21T22:37:04.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.717+0000 7f72eeb82640 1 -- 172.21.15.6:0/1073202041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8158ce0 msgr2=0x7f72e8070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:04.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.717+0000 7f72eeb82640 1 --2- 172.21.15.6:0/1073202041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8158ce0 0x7f72e8070450 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f72e80c17e0 tx=0x7f72dc01e5c0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.717+0000 7f72eeb82640 1 -- 172.21.15.6:0/1073202041 shutdown_connections 2023-07-21T22:37:04.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.717+0000 7f72eeb82640 1 --2- 172.21.15.6:0/1073202041 >> v2:172.21.15.161:3300/0 conn(0x7f72e80c9560 0x7f72e80cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.717+0000 7f72eeb82640 1 --2- 172.21.15.6:0/1073202041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72e80c8ad0 0x7f72e80c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.717+0000 7f72eeb82640 1 --2- 172.21.15.6:0/1073202041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e8158ce0 0x7f72e8070450 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.717+0000 7f72eeb82640 1 -- 172.21.15.6:0/1073202041 >> 172.21.15.6:0/1073202041 conn(0x7f72e80afcf0 msgr2=0x7f72e80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:04.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.717+0000 7f72eeb82640 1 -- 172.21.15.6:0/1073202041 shutdown_connections 2023-07-21T22:37:04.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.717+0000 7f72eeb82640 1 -- 172.21.15.6:0/1073202041 wait complete. 2023-07-21T22:37:04.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.721+0000 7f72eeb82640 1 Processor -- start 2023-07-21T22:37:04.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.721+0000 7f72eeb82640 1 -- start start 2023-07-21T22:37:04.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72eeb82640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72e80c8ad0 0x7f72e8161cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:04.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72eeb82640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e80c9560 0x7f72e8154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:04.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72eeb82640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72e8158ce0 0x7f72e815ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:04.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72eeb82640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e815a8a0 con 0x7f72e80c9560 2023-07-21T22:37:04.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72eeb82640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e8159cd0 con 0x7f72e80c8ad0 2023-07-21T22:37:04.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72eeb82640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e8159f70 con 0x7f72e8158ce0 2023-07-21T22:37:04.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72e7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e80c9560 0x7f72e8154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:04.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72e7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e80c9560 0x7f72e8154780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39196/0 (socket says 172.21.15.6:39196) 2023-07-21T22:37:04.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72e7fff640 1 -- 172.21.15.6:0/841164523 learned_addr learned my addr 172.21.15.6:0/841164523 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:04.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72ed11f640 1 --2- 172.21.15.6:0/841164523 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72e8158ce0 0x7f72e815ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:04.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72ec91e640 1 --2- 172.21.15.6:0/841164523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72e80c8ad0 0x7f72e8161cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:04.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72e7fff640 1 -- 172.21.15.6:0/841164523 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72e8158ce0 msgr2=0x7f72e815ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:04.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72e7fff640 1 --2- 172.21.15.6:0/841164523 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72e8158ce0 0x7f72e815ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72e7fff640 1 -- 172.21.15.6:0/841164523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72e80c8ad0 msgr2=0x7f72e8161cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:04.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72e7fff640 1 --2- 172.21.15.6:0/841164523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72e80c8ad0 0x7f72e8161cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72e7fff640 1 -- 172.21.15.6:0/841164523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc0094d0 con 0x7f72e80c9560 2023-07-21T22:37:04.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72ec91e640 1 --2- 172.21.15.6:0/841164523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72e80c8ad0 0x7f72e8161cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:04.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72e7fff640 1 --2- 172.21.15.6:0/841164523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e80c9560 0x7f72e8154780 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f72d400e870 tx=0x7f72d400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:04.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72e57fa640 1 -- 172.21.15.6:0/841164523 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d4009510 con 0x7f72e80c9560 2023-07-21T22:37:04.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72e57fa640 1 -- 172.21.15.6:0/841164523 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d400eec0 con 0x7f72e80c9560 2023-07-21T22:37:04.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72eeb82640 1 -- 172.21.15.6:0/841164523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e815a250 con 0x7f72e80c9560 2023-07-21T22:37:04.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72e57fa640 1 -- 172.21.15.6:0/841164523 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d400cb40 con 0x7f72e80c9560 2023-07-21T22:37:04.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72eeb82640 1 -- 172.21.15.6:0/841164523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e814f8c0 con 0x7f72e80c9560 2023-07-21T22:37:04.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.725+0000 7f72eeb82640 1 -- 172.21.15.6:0/841164523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e80ca1a0 con 0x7f72e80c9560 2023-07-21T22:37:04.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.729+0000 7f72e57fa640 1 -- 172.21.15.6:0/841164523 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 46) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f72d400cca0 con 0x7f72e80c9560 2023-07-21T22:37:04.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.729+0000 7f72e57fa640 1 --2- 172.21.15.6:0/841164523 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f72cc0664f0 0x7f72cc0689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:04.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.729+0000 7f72e57fa640 1 -- 172.21.15.6:0/841164523 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6566+0+0 (secure 0 0 0) 0x7f72d4084420 con 0x7f72e80c9560 2023-07-21T22:37:04.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.729+0000 7f72ec91e640 1 -- 172.21.15.6:0/841164523 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f72cc0664f0 msgr2=0x7f72cc0689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1474634903 2023-07-21T22:37:04.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.729+0000 7f72ec91e640 1 --2- 172.21.15.6:0/841164523 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f72cc0664f0 0x7f72cc0689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:37:04.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.733+0000 7f72e57fa640 1 -- 172.21.15.6:0/841164523 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72d4051350 con 0x7f72e80c9560 2023-07-21T22:37:04.782 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:04.737+0000 7f3479e46180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:37:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.921+0000 7f72eeb82640 1 -- 172.21.15.6:0/841164523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72e8070950 con 0x7f72e80c9560 2023-07-21T22:37:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.921+0000 7f72e57fa640 1 -- 172.21.15.6:0/841164523 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4667 (secure 0 0 0) 0x7f72d4054970 con 0x7f72e80c9560 2023-07-21T22:37:04.967 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:04.967 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6716,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/128364815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":128364815},{"type":"v1","addr":"172.21.15.161:6836","nonce":128364815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6719,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1447795142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1447795142},{"type":"v1","addr":"172.21.15.161:6837","nonce":1447795142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7653,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/921116259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":921116259},{"type":"v1","addr":"172.21.15.6:6833","nonce":921116259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:35:40.812228+0000","modified":"2023-07-21T22:35:44.851097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2789884551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2789884551},{"type":"v1","addr":"172.21.15.6:6835","nonce":2789884551}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-21T22:37:04.967 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 47 2023-07-21T22:37:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.921+0000 7f72eeb82640 1 -- 172.21.15.6:0/841164523 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f72cc0664f0 msgr2=0x7f72cc0689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:37:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.921+0000 7f72eeb82640 1 --2- 172.21.15.6:0/841164523 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f72cc0664f0 0x7f72cc0689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.921+0000 7f72eeb82640 1 -- 172.21.15.6:0/841164523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e80c9560 msgr2=0x7f72e8154780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.921+0000 7f72eeb82640 1 --2- 172.21.15.6:0/841164523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e80c9560 0x7f72e8154780 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f72d400e870 tx=0x7f72d400ec70 comp rx=0 tx=0).stop 2023-07-21T22:37:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.921+0000 7f72eeb82640 1 -- 172.21.15.6:0/841164523 shutdown_connections 2023-07-21T22:37:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.921+0000 7f72eeb82640 1 --2- 172.21.15.6:0/841164523 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f72cc0664f0 0x7f72cc0689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.921+0000 7f72eeb82640 1 --2- 172.21.15.6:0/841164523 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f72e8158ce0 0x7f72e815ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.921+0000 7f72eeb82640 1 --2- 172.21.15.6:0/841164523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72e80c9560 0x7f72e8154780 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.921+0000 7f72eeb82640 1 --2- 172.21.15.6:0/841164523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f72e80c8ad0 0x7f72e8161cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.921+0000 7f72eeb82640 1 -- 172.21.15.6:0/841164523 >> 172.21.15.6:0/841164523 conn(0x7f72e80afcf0 msgr2=0x7f72e806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.921+0000 7f72eeb82640 1 -- 172.21.15.6:0/841164523 shutdown_connections 2023-07-21T22:37:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:04.921+0000 7f72eeb82640 1 -- 172.21.15.6:0/841164523 wait complete. 2023-07-21T22:37:04.988 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:37:05.086 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:05.045+0000 7ff927846180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:37:05.171 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:05.129+0000 7ff927846180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:37:05.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.129+0000 7f1a80774640 1 Processor -- start 2023-07-21T22:37:05.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.129+0000 7f1a80774640 1 -- start start 2023-07-21T22:37:05.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.129+0000 7f1a80774640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a780b7c70 0x7f1a780d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:05.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.129+0000 7f1a80774640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1a7815fd60 0x7f1a780d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:05.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.129+0000 7f1a80774640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a780ccaf0 con 0x7f1a780d1850 2023-07-21T22:37:05.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.129+0000 7f1a80774640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a780d1190 con 0x7f1a7815fd60 2023-07-21T22:37:05.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.129+0000 7f1a80774640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78160600 con 0x7f1a780b7c70 2023-07-21T22:37:05.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.133+0000 7f1a7e510640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a780b7c70 0x7f1a780d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:05.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.133+0000 7f1a7ed11640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1a7815fd60 0x7f1a780d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:05.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.133+0000 7f1a7ed11640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1a7815fd60 0x7f1a780d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:33336/0 (socket says 172.21.15.6:33336) 2023-07-21T22:37:05.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.133+0000 7f1a7ed11640 1 -- 172.21.15.6:0/1770007369 learned_addr learned my addr 172.21.15.6:0/1770007369 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:05.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.133+0000 7f1a7ed11640 1 -- 172.21.15.6:0/1770007369 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a780b7c70 msgr2=0x7f1a780d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:05.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.133+0000 7f1a7ed11640 1 --2- 172.21.15.6:0/1770007369 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a780b7c70 0x7f1a780d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.133+0000 7f1a7ed11640 1 -- 172.21.15.6:0/1770007369 >> v1:172.21.15.161:6789/0 conn(0x7f1a780d1850 legacy=0x7f1a7815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:05.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.133+0000 7f1a7ed11640 1 -- 172.21.15.6:0/1770007369 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a78160320 con 0x7f1a7815fd60 2023-07-21T22:37:05.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.133+0000 7f1a7e510640 1 --2- 172.21.15.6:0/1770007369 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a780b7c70 0x7f1a780d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:05.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.133+0000 7f1a7ed11640 1 --2- 172.21.15.6:0/1770007369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a7815fd60 0x7f1a780d1da0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009e80 tx=0x7f1a7001c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa64b265c8683dcf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:05.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.133+0000 7f1a7d50e640 1 -- 172.21.15.6:0/1770007369 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a700a58a0 con 0x7f1a7815fd60 2023-07-21T22:37:05.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.133+0000 7f1a7d50e640 1 -- 172.21.15.6:0/1770007369 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a700a5a00 con 0x7f1a7815fd60 2023-07-21T22:37:05.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.133+0000 7f1a7d50e640 1 -- 172.21.15.6:0/1770007369 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a700a5d90 con 0x7f1a7815fd60 2023-07-21T22:37:05.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a80774640 1 -- 172.21.15.6:0/1770007369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a7815fd60 msgr2=0x7f1a780d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:05.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a80774640 1 --2- 172.21.15.6:0/1770007369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a7815fd60 0x7f1a780d1da0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009e80 tx=0x7f1a7001c9c0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a80774640 1 -- 172.21.15.6:0/1770007369 shutdown_connections 2023-07-21T22:37:05.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a80774640 1 --2- 172.21.15.6:0/1770007369 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a7815fd60 0x7f1a780d1da0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a80774640 1 --2- 172.21.15.6:0/1770007369 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a780b7c70 0x7f1a780d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a80774640 1 -- 172.21.15.6:0/1770007369 >> 172.21.15.6:0/1770007369 conn(0x7f1a780650b0 msgr2=0x7f1a780654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:05.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a80774640 1 -- 172.21.15.6:0/1770007369 shutdown_connections 2023-07-21T22:37:05.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a80774640 1 -- 172.21.15.6:0/1770007369 wait complete. 2023-07-21T22:37:05.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a80774640 1 Processor -- start 2023-07-21T22:37:05.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a80774640 1 -- start start 2023-07-21T22:37:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a80774640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a780b7c70 0x7f1a780b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a80774640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a780d1850 0x7f1a7815e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a80774640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a7815fd60 0x7f1a7815eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a80774640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a780c93d0 con 0x7f1a7815fd60 2023-07-21T22:37:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a80774640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a780b53b0 con 0x7f1a780d1850 2023-07-21T22:37:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a80774640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a780b5690 con 0x7f1a780b7c70 2023-07-21T22:37:05.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a7ed11640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a7815fd60 0x7f1a7815eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:05.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a7e510640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a780b7c70 0x7f1a780b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a7dd0f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a780d1850 0x7f1a7815e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a7ed11640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a7815fd60 0x7f1a7815eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39204/0 (socket says 172.21.15.6:39204) 2023-07-21T22:37:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.137+0000 7f1a7ed11640 1 -- 172.21.15.6:0/3404239937 learned_addr learned my addr 172.21.15.6:0/3404239937 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.141+0000 7f1a7e510640 1 -- 172.21.15.6:0/3404239937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a780d1850 msgr2=0x7f1a7815e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.141+0000 7f1a7e510640 1 --2- 172.21.15.6:0/3404239937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a780d1850 0x7f1a7815e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.141+0000 7f1a7e510640 1 -- 172.21.15.6:0/3404239937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a7815fd60 msgr2=0x7f1a7815eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.141+0000 7f1a7e510640 1 --2- 172.21.15.6:0/3404239937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a7815fd60 0x7f1a7815eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.141+0000 7f1a7e510640 1 -- 172.21.15.6:0/3404239937 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a74009420 con 0x7f1a780b7c70 2023-07-21T22:37:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.141+0000 7f1a7ed11640 1 --2- 172.21.15.6:0/3404239937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a7815fd60 0x7f1a7815eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.141+0000 7f1a7e510640 1 --2- 172.21.15.6:0/3404239937 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a780b7c70 0x7f1a780b3010 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400e8e0 tx=0x7f1a7400eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.141+0000 7f1a6effd640 1 -- 172.21.15.6:0/3404239937 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400c8e0 con 0x7f1a780b7c70 2023-07-21T22:37:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.141+0000 7f1a6effd640 1 -- 172.21.15.6:0/3404239937 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7400ca40 con 0x7f1a780b7c70 2023-07-21T22:37:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.141+0000 7f1a6effd640 1 -- 172.21.15.6:0/3404239937 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400cdf0 con 0x7f1a780b7c70 2023-07-21T22:37:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.141+0000 7f1a80774640 1 -- 172.21.15.6:0/3404239937 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a70009b30 con 0x7f1a780b7c70 2023-07-21T22:37:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.141+0000 7f1a80774640 1 -- 172.21.15.6:0/3404239937 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a780b5c50 con 0x7f1a780b7c70 2023-07-21T22:37:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.141+0000 7f1a80774640 1 -- 172.21.15.6:0/3404239937 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a780678d0 con 0x7f1a780b7c70 2023-07-21T22:37:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.141+0000 7f1a6effd640 1 -- 172.21.15.6:0/3404239937 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 46) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f1a740059a0 con 0x7f1a780b7c70 2023-07-21T22:37:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.145+0000 7f1a6effd640 1 --2- 172.21.15.6:0/3404239937 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f1a5c0664f0 0x7f1a5c0689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.145+0000 7f1a6effd640 1 -- 172.21.15.6:0/3404239937 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6566+0+0 (secure 0 0 0) 0x7f1a74084bd0 con 0x7f1a780b7c70 2023-07-21T22:37:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.145+0000 7f1a7dd0f640 1 -- 172.21.15.6:0/3404239937 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f1a5c0664f0 msgr2=0x7f1a5c0689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1474634903 2023-07-21T22:37:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.145+0000 7f1a7dd0f640 1 --2- 172.21.15.6:0/3404239937 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f1a5c0664f0 0x7f1a5c0689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:37:05.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.153+0000 7f1a6effd640 1 -- 172.21.15.6:0/3404239937 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1a74051c50 con 0x7f1a780b7c70 2023-07-21T22:37:05.322 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:05.281+0000 7ff927846180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:37:05.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.309+0000 7f1a80774640 1 -- 172.21.15.6:0/3404239937 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a780d2ce0 con 0x7f1a780b7c70 2023-07-21T22:37:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.309+0000 7f1a6effd640 1 -- 172.21.15.6:0/3404239937 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+19003 (secure 0 0 0) 0x7f1a74021090 con 0x7f1a780b7c70 2023-07-21T22:37:05.357 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:05.357 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":115,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:36:59.939624+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:35:38.932763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-21T22:35:39.805137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":1,"to":7}]},{"pgid":"14.a","mappings":[{"from":1,"to":7}]},{"pgid":"14.18","mappings":[{"from":1,"to":5}]},{"pgid":"14.31","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:6833/3891612664":"2023-07-22T22:35:58.832528+0000","172.21.15.161:6832/3891612664":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/2035498467":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/4102091229":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/1144695770":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/2493427911":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/3550191976":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/253243953":"2023-07-22T22:35:58.832528+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:37:05.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.313+0000 7f1a80774640 1 -- 172.21.15.6:0/3404239937 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f1a5c0664f0 msgr2=0x7f1a5c0689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:37:05.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.313+0000 7f1a80774640 1 --2- 172.21.15.6:0/3404239937 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f1a5c0664f0 0x7f1a5c0689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.313+0000 7f1a80774640 1 -- 172.21.15.6:0/3404239937 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a780b7c70 msgr2=0x7f1a780b3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:05.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.313+0000 7f1a80774640 1 --2- 172.21.15.6:0/3404239937 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a780b7c70 0x7f1a780b3010 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400e8e0 tx=0x7f1a7400eda0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.313+0000 7f1a80774640 1 -- 172.21.15.6:0/3404239937 shutdown_connections 2023-07-21T22:37:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.313+0000 7f1a80774640 1 --2- 172.21.15.6:0/3404239937 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7f1a5c0664f0 0x7f1a5c0689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.313+0000 7f1a80774640 1 --2- 172.21.15.6:0/3404239937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a7815fd60 0x7f1a7815eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.313+0000 7f1a80774640 1 --2- 172.21.15.6:0/3404239937 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a780d1850 0x7f1a7815e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.313+0000 7f1a80774640 1 --2- 172.21.15.6:0/3404239937 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a780b7c70 0x7f1a780b3010 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.313+0000 7f1a80774640 1 -- 172.21.15.6:0/3404239937 >> 172.21.15.6:0/3404239937 conn(0x7f1a780650b0 msgr2=0x7f1a780cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:05.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.313+0000 7f1a80774640 1 -- 172.21.15.6:0/3404239937 shutdown_connections 2023-07-21T22:37:05.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.313+0000 7f1a80774640 1 -- 172.21.15.6:0/3404239937 wait complete. 2023-07-21T22:37:05.370 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:05.325+0000 7f3479e46180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:37:05.378 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:35:38.932763+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:35:39.805137+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:37:05.379 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:37:05.406 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:05.365+0000 7ff927846180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:37:05.461 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:05.417+0000 7f3479e46180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:37:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.481+0000 7fd59519f640 1 Processor -- start 2023-07-21T22:37:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.481+0000 7fd59519f640 1 -- start start 2023-07-21T22:37:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.481+0000 7fd59519f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd59015bde0 0x7fd5900d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.481+0000 7fd59519f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5900d2300 0x7fd5900d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.481+0000 7fd59519f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5900b04c0 con 0x7fd5900d2fc0 2023-07-21T22:37:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.481+0000 7fd59519f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59015c1b0 con 0x7fd59015bde0 2023-07-21T22:37:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.481+0000 7fd59519f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900d2cc0 con 0x7fd5900d2300 2023-07-21T22:37:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.481+0000 7fd58ed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd59015bde0 0x7fd5900d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.481+0000 7fd58ed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd59015bde0 0x7fd5900d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39208/0 (socket says 172.21.15.6:39208) 2023-07-21T22:37:05.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.481+0000 7fd58ed9d640 1 -- 172.21.15.6:0/1333625348 learned_addr learned my addr 172.21.15.6:0/1333625348 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:05.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.485+0000 7fd58f59e640 1 --2- 172.21.15.6:0/1333625348 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5900d2300 0x7fd5900d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:05.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.485+0000 7fd58ed9d640 1 -- 172.21.15.6:0/1333625348 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5900d2300 msgr2=0x7fd5900d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:05.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.485+0000 7fd58ed9d640 1 --2- 172.21.15.6:0/1333625348 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5900d2300 0x7fd5900d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.485+0000 7fd58ed9d640 1 -- 172.21.15.6:0/1333625348 >> v1:172.21.15.6:6789/0 conn(0x7fd5900d2fc0 legacy=0x7fd5900b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:05.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.485+0000 7fd58ed9d640 1 -- 172.21.15.6:0/1333625348 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5900b1060 con 0x7fd59015bde0 2023-07-21T22:37:05.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.485+0000 7fd58ed9d640 1 --2- 172.21.15.6:0/1333625348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd59015bde0 0x7fd5900d0270 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fd580006fd0 tx=0x7fd58001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34416b1c14b902fe server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:05.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.485+0000 7fd58e59c640 1 -- 172.21.15.6:0/1333625348 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5800a7070 con 0x7fd59015bde0 2023-07-21T22:37:05.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.485+0000 7fd58e59c640 1 -- 172.21.15.6:0/1333625348 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5800ab430 con 0x7fd59015bde0 2023-07-21T22:37:05.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.485+0000 7fd58e59c640 1 -- 172.21.15.6:0/1333625348 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5800ab7c0 con 0x7fd59015bde0 2023-07-21T22:37:05.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd59519f640 1 -- 172.21.15.6:0/1333625348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd59015bde0 msgr2=0x7fd5900d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:05.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd59519f640 1 --2- 172.21.15.6:0/1333625348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd59015bde0 0x7fd5900d0270 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fd580006fd0 tx=0x7fd58001c520 comp rx=0 tx=0).stop 2023-07-21T22:37:05.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd59519f640 1 -- 172.21.15.6:0/1333625348 shutdown_connections 2023-07-21T22:37:05.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd59519f640 1 --2- 172.21.15.6:0/1333625348 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5900d2300 0x7fd5900d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd59519f640 1 --2- 172.21.15.6:0/1333625348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd59015bde0 0x7fd5900d0270 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd59519f640 1 -- 172.21.15.6:0/1333625348 >> 172.21.15.6:0/1333625348 conn(0x7fd5900659d0 msgr2=0x7fd59009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:05.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd59519f640 1 -- 172.21.15.6:0/1333625348 shutdown_connections 2023-07-21T22:37:05.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd59519f640 1 -- 172.21.15.6:0/1333625348 wait complete. 2023-07-21T22:37:05.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd59519f640 1 Processor -- start 2023-07-21T22:37:05.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd59519f640 1 -- start start 2023-07-21T22:37:05.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd59519f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5900d2300 0x7fd59014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:05.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd59519f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5900d2fc0 0x7fd590153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:05.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd59519f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd59015bde0 0x7fd5900b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:05.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd59519f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900c8f40 con 0x7fd59015bde0 2023-07-21T22:37:05.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd59519f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5901540d0 con 0x7fd5900d2300 2023-07-21T22:37:05.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd59519f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd590153830 con 0x7fd5900d2fc0 2023-07-21T22:37:05.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd587fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5900d2fc0 0x7fd590153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:05.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd58ed9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5900d2300 0x7fd59014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:05.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd58f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd59015bde0 0x7fd5900b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:05.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd58ed9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5900d2300 0x7fd59014e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:33362/0 (socket says 172.21.15.6:33362) 2023-07-21T22:37:05.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.489+0000 7fd58ed9d640 1 -- 172.21.15.6:0/969255516 learned_addr learned my addr 172.21.15.6:0/969255516 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:05.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.493+0000 7fd58ed9d640 1 -- 172.21.15.6:0/969255516 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5900d2fc0 msgr2=0x7fd590153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:05.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.493+0000 7fd58ed9d640 1 --2- 172.21.15.6:0/969255516 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5900d2fc0 0x7fd590153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.493+0000 7fd58ed9d640 1 -- 172.21.15.6:0/969255516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd59015bde0 msgr2=0x7fd5900b7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:05.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.493+0000 7fd58ed9d640 1 --2- 172.21.15.6:0/969255516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd59015bde0 0x7fd5900b7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.493+0000 7fd58ed9d640 1 -- 172.21.15.6:0/969255516 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd580009480 con 0x7fd5900d2300 2023-07-21T22:37:05.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.493+0000 7fd58f59e640 1 --2- 172.21.15.6:0/969255516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd59015bde0 0x7fd5900b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:05.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.493+0000 7fd58ed9d640 1 --2- 172.21.15.6:0/969255516 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5900d2300 0x7fd59014e590 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd58001a150 tx=0x7fd5800192c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.493+0000 7fd5877fe640 1 -- 172.21.15.6:0/969255516 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580005ba0 con 0x7fd5900d2300 2023-07-21T22:37:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.493+0000 7fd5877fe640 1 -- 172.21.15.6:0/969255516 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd580005d00 con 0x7fd5900d2300 2023-07-21T22:37:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.493+0000 7fd5877fe640 1 -- 172.21.15.6:0/969255516 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580003b90 con 0x7fd5900d2300 2023-07-21T22:37:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.493+0000 7fd59519f640 1 -- 172.21.15.6:0/969255516 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd590153b10 con 0x7fd5900d2300 2023-07-21T22:37:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.493+0000 7fd59519f640 1 -- 172.21.15.6:0/969255516 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5900c6040 con 0x7fd5900d2300 2023-07-21T22:37:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.493+0000 7fd59519f640 1 -- 172.21.15.6:0/969255516 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5900c5ea0 con 0x7fd5900d2300 2023-07-21T22:37:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.493+0000 7fd5877fe640 1 -- 172.21.15.6:0/969255516 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 46) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fd580003cf0 con 0x7fd5900d2300 2023-07-21T22:37:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.493+0000 7fd5877fe640 1 --2- 172.21.15.6:0/969255516 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fd5700664c0 0x7fd570068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.493+0000 7fd5877fe640 1 -- 172.21.15.6:0/969255516 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6566+0+0 (secure 0 0 0) 0x7fd58011d4b0 con 0x7fd5900d2300 2023-07-21T22:37:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.493+0000 7fd587fff640 1 -- 172.21.15.6:0/969255516 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fd5700664c0 msgr2=0x7fd570068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1474634903 2023-07-21T22:37:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.497+0000 7fd587fff640 1 --2- 172.21.15.6:0/969255516 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fd5700664c0 0x7fd570068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:37:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.497+0000 7fd5877fe640 1 -- 172.21.15.6:0/969255516 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd5900c5ea0 con 0x7fd5900d2300 2023-07-21T22:37:05.622 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:05.577+0000 7f3479e46180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:37:05.674 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:05.629+0000 7ff927846180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:37:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.653+0000 7fd59519f640 1 -- 172.21.15.6:0/969255516 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5900c5ea0 con 0x7fd5900d2300 2023-07-21T22:37:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.653+0000 7fd5877fe640 1 -- 172.21.15.6:0/969255516 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v115) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd5900c5ea0 con 0x7fd5900d2300 2023-07-21T22:37:05.701 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:37:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.657+0000 7fd59519f640 1 -- 172.21.15.6:0/969255516 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fd5700664c0 msgr2=0x7fd570068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:37:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.657+0000 7fd59519f640 1 --2- 172.21.15.6:0/969255516 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fd5700664c0 0x7fd570068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.657+0000 7fd59519f640 1 -- 172.21.15.6:0/969255516 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5900d2300 msgr2=0x7fd59014e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.657+0000 7fd59519f640 1 --2- 172.21.15.6:0/969255516 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5900d2300 0x7fd59014e590 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd58001a150 tx=0x7fd5800192c0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.657+0000 7fd59519f640 1 -- 172.21.15.6:0/969255516 shutdown_connections 2023-07-21T22:37:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.657+0000 7fd59519f640 1 --2- 172.21.15.6:0/969255516 >> [v2:172.21.15.161:6832/1474634903,v1:172.21.15.161:6833/1474634903] conn(0x7fd5700664c0 0x7fd570068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.657+0000 7fd59519f640 1 --2- 172.21.15.6:0/969255516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd59015bde0 0x7fd5900b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.657+0000 7fd59519f640 1 --2- 172.21.15.6:0/969255516 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd5900d2fc0 0x7fd590153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.657+0000 7fd59519f640 1 --2- 172.21.15.6:0/969255516 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5900d2300 0x7fd59014e590 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.657+0000 7fd59519f640 1 -- 172.21.15.6:0/969255516 >> 172.21.15.6:0/969255516 conn(0x7fd5900659d0 msgr2=0x7fd5900cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.657+0000 7fd59519f640 1 -- 172.21.15.6:0/969255516 shutdown_connections 2023-07-21T22:37:05.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.657+0000 7fd59519f640 1 -- 172.21.15.6:0/969255516 wait complete. 2023-07-21T22:37:05.713 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:05.669+0000 7f3479e46180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:37:05.722 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:37:05.734 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:05.689+0000 7ff927846180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:37:05.819 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:05.777+0000 7ff8b24f0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:37:05.819 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:05.777+0000 7ff8b24f0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:37:05.820 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:05.777+0000 7ff8b24f0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:37:05.820 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:05.777+0000 7ff8b24f0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:37:05.820 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:05.777+0000 7ff8b24f0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:37:05.820 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:05.777+0000 7ff8af4ea640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:37:05.821 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:05.777+0000 7ff8af4ea640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:37:05.821 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:05.777+0000 7ff8af4ea640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:37:05.821 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:05.777+0000 7ff8af4ea640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:37:05.821 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:05.777+0000 7ff8af4ea640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:37:05.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.837+0000 7f0b02e93640 1 Processor -- start 2023-07-21T22:37:05.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.837+0000 7f0b02e93640 1 -- start start 2023-07-21T22:37:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.837+0000 7f0b02e93640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0afc15bde0 0x7f0afc0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.837+0000 7f0b02e93640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0afc0d2fc0 0x7f0afc0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.837+0000 7f0b02e93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0afc0d2300 0x7f0afc0d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.837+0000 7f0b02e93640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0afc15c1b0 con 0x7f0afc0d2fc0 2023-07-21T22:37:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.837+0000 7f0b02e93640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0afc0d2cc0 con 0x7f0afc15bde0 2023-07-21T22:37:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.837+0000 7f0b02e93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc0b04c0 con 0x7f0afc0d2300 2023-07-21T22:37:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.841+0000 7f0afbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0afc0d2fc0 0x7f0afc0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.841+0000 7f0afbfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0afc0d2fc0 0x7f0afc0b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39238/0 (socket says 172.21.15.6:39238) 2023-07-21T22:37:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.841+0000 7f0afbfff640 1 -- 172.21.15.6:0/2277972716 learned_addr learned my addr 172.21.15.6:0/2277972716 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.841+0000 7f0b01430640 1 --2- 172.21.15.6:0/2277972716 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0afc0d2300 0x7f0afc0d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.841+0000 7f0b00c2f640 1 --2- 172.21.15.6:0/2277972716 >> v2:172.21.15.161:3300/0 conn(0x7f0afc15bde0 0x7f0afc0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.841+0000 7f0afbfff640 1 -- 172.21.15.6:0/2277972716 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0afc0d2300 msgr2=0x7f0afc0d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.841+0000 7f0afbfff640 1 --2- 172.21.15.6:0/2277972716 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0afc0d2300 0x7f0afc0d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.841+0000 7f0afbfff640 1 -- 172.21.15.6:0/2277972716 >> v2:172.21.15.161:3300/0 conn(0x7f0afc15bde0 msgr2=0x7f0afc0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.841+0000 7f0afbfff640 1 --2- 172.21.15.6:0/2277972716 >> v2:172.21.15.161:3300/0 conn(0x7f0afc15bde0 0x7f0afc0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.841+0000 7f0afbfff640 1 -- 172.21.15.6:0/2277972716 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc0d0aa0 con 0x7f0afc0d2fc0 2023-07-21T22:37:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.841+0000 7f0b00c2f640 1 --2- 172.21.15.6:0/2277972716 >> v2:172.21.15.161:3300/0 conn(0x7f0afc15bde0 0x7f0afc0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.841+0000 7f0afbfff640 1 --2- 172.21.15.6:0/2277972716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0afc0d2fc0 0x7f0afc0b0950 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f0afc08b210 tx=0x7f0ae801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6016dbabf905ece1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.841+0000 7f0afb7fe640 1 -- 172.21.15.6:0/2277972716 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae80aa620 con 0x7f0afc0d2fc0 2023-07-21T22:37:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0afb7fe640 1 -- 172.21.15.6:0/2277972716 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae80aa780 con 0x7f0afc0d2fc0 2023-07-21T22:37:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0afb7fe640 1 -- 172.21.15.6:0/2277972716 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae80aab10 con 0x7f0afc0d2fc0 2023-07-21T22:37:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0b02e93640 1 -- 172.21.15.6:0/2277972716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0afc0d2fc0 msgr2=0x7f0afc0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0b02e93640 1 --2- 172.21.15.6:0/2277972716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0afc0d2fc0 0x7f0afc0b0950 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f0afc08b210 tx=0x7f0ae801c500 comp rx=0 tx=0).stop 2023-07-21T22:37:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0b02e93640 1 -- 172.21.15.6:0/2277972716 shutdown_connections 2023-07-21T22:37:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0b02e93640 1 --2- 172.21.15.6:0/2277972716 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0afc0d2300 0x7f0afc0d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0b02e93640 1 --2- 172.21.15.6:0/2277972716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0afc0d2fc0 0x7f0afc0b0950 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0b02e93640 1 --2- 172.21.15.6:0/2277972716 >> v2:172.21.15.161:3300/0 conn(0x7f0afc15bde0 0x7f0afc0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0b02e93640 1 -- 172.21.15.6:0/2277972716 >> 172.21.15.6:0/2277972716 conn(0x7f0afc0659d0 msgr2=0x7f0afc09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:05.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0b02e93640 1 -- 172.21.15.6:0/2277972716 shutdown_connections 2023-07-21T22:37:05.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0b02e93640 1 -- 172.21.15.6:0/2277972716 wait complete. 2023-07-21T22:37:05.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0b02e93640 1 Processor -- start 2023-07-21T22:37:05.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0b02e93640 1 -- start start 2023-07-21T22:37:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0b02e93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0afc0d2300 0x7f0afc1541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0b02e93640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0afc0d2fc0 0x7f0afc15e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0b02e93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0afc15bde0 0x7f0afc153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0b02e93640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc0b3350 con 0x7f0afc15bde0 2023-07-21T22:37:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0b02e93640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc0b3630 con 0x7f0afc0d2fc0 2023-07-21T22:37:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0b02e93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc0b3910 con 0x7f0afc0d2300 2023-07-21T22:37:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0b01430640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0afc15bde0 0x7f0afc153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0b01430640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0afc15bde0 0x7f0afc153a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39248/0 (socket says 172.21.15.6:39248) 2023-07-21T22:37:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0b01430640 1 -- 172.21.15.6:0/1483041671 learned_addr learned my addr 172.21.15.6:0/1483041671 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.845+0000 7f0afbfff640 1 --2- 172.21.15.6:0/1483041671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0afc0d2fc0 0x7f0afc15e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.849+0000 7f0b00c2f640 1 --2- 172.21.15.6:0/1483041671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0afc0d2300 0x7f0afc1541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:05.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.849+0000 7f0afbfff640 1 -- 172.21.15.6:0/1483041671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0afc0d2300 msgr2=0x7f0afc1541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:05.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.849+0000 7f0afbfff640 1 --2- 172.21.15.6:0/1483041671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0afc0d2300 0x7f0afc1541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.849+0000 7f0afbfff640 1 -- 172.21.15.6:0/1483041671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0afc15bde0 msgr2=0x7f0afc153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:05.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.849+0000 7f0afbfff640 1 --2- 172.21.15.6:0/1483041671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0afc15bde0 0x7f0afc153a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:05.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.849+0000 7f0afbfff640 1 -- 172.21.15.6:0/1483041671 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af00093b0 con 0x7f0afc0d2fc0 2023-07-21T22:37:05.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.849+0000 7f0afbfff640 1 --2- 172.21.15.6:0/1483041671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0afc0d2fc0 0x7f0afc15e980 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80ab000 tx=0x7f0ae801ad40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:05.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.849+0000 7f0af97fa640 1 -- 172.21.15.6:0/1483041671 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae80aadc0 con 0x7f0afc0d2fc0 2023-07-21T22:37:05.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.849+0000 7f0af97fa640 1 -- 172.21.15.6:0/1483041671 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae80bd3f0 con 0x7f0afc0d2fc0 2023-07-21T22:37:05.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.849+0000 7f0b02e93640 1 -- 172.21.15.6:0/1483041671 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae80094d0 con 0x7f0afc0d2fc0 2023-07-21T22:37:05.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.849+0000 7f0af97fa640 1 -- 172.21.15.6:0/1483041671 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae80bd7a0 con 0x7f0afc0d2fc0 2023-07-21T22:37:05.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.849+0000 7f0b02e93640 1 -- 172.21.15.6:0/1483041671 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0afc153f50 con 0x7f0afc0d2fc0 2023-07-21T22:37:05.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.849+0000 7f0b02e93640 1 -- 172.21.15.6:0/1483041671 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0afc0b3dc0 con 0x7f0afc0d2fc0 2023-07-21T22:37:05.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.849+0000 7f0af97fa640 1 -- 172.21.15.6:0/1483041671 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 47) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f0ae80b33f0 con 0x7f0afc0d2fc0 2023-07-21T22:37:05.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.853+0000 7f0af97fa640 1 -- 172.21.15.6:0/1483041671 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6996+0+0 (secure 0 0 0) 0x7f0ae811dff0 con 0x7f0afc0d2fc0 2023-07-21T22:37:05.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:05.857+0000 7f0af97fa640 1 -- 172.21.15.6:0/1483041671 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0afc0b3dc0 con 0x7f0afc0d2fc0 2023-07-21T22:37:06.023 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:05.977+0000 7f3479e46180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:37:06.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.013+0000 7f0b02e93640 1 -- 172.21.15.6:0/1483041671 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0afc0b3dc0 con 0x7f0afc0d2fc0 2023-07-21T22:37:06.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.017+0000 7f0af97fa640 1 -- 172.21.15.6:0/1483041671 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v116) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0afc0b3dc0 con 0x7f0afc0d2fc0 2023-07-21T22:37:06.061 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:37:06.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.017+0000 7f0b02e93640 1 -- 172.21.15.6:0/1483041671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0afc0d2fc0 msgr2=0x7f0afc15e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.017+0000 7f0b02e93640 1 --2- 172.21.15.6:0/1483041671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0afc0d2fc0 0x7f0afc15e980 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80ab000 tx=0x7f0ae801ad40 comp rx=0 tx=0).stop 2023-07-21T22:37:06.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.017+0000 7f0b02e93640 1 -- 172.21.15.6:0/1483041671 shutdown_connections 2023-07-21T22:37:06.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.017+0000 7f0b02e93640 1 --2- 172.21.15.6:0/1483041671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0afc15bde0 0x7f0afc153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.017+0000 7f0b02e93640 1 --2- 172.21.15.6:0/1483041671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0afc0d2fc0 0x7f0afc15e980 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.017+0000 7f0b02e93640 1 --2- 172.21.15.6:0/1483041671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0afc0d2300 0x7f0afc1541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.017+0000 7f0b02e93640 1 -- 172.21.15.6:0/1483041671 >> 172.21.15.6:0/1483041671 conn(0x7f0afc0659d0 msgr2=0x7f0afc0b46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:06.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.017+0000 7f0b02e93640 1 -- 172.21.15.6:0/1483041671 shutdown_connections 2023-07-21T22:37:06.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.017+0000 7f0b02e93640 1 -- 172.21.15.6:0/1483041671 wait complete. 2023-07-21T22:37:06.083 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:37:06.088 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:06.041+0000 7f3479e46180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:37:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.185+0000 7f44bea93640 1 Processor -- start 2023-07-21T22:37:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.185+0000 7f44bea93640 1 -- start start 2023-07-21T22:37:06.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.185+0000 7f44bea93640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f44b80aeb40 0x7f44b815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.185+0000 7f44bea93640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b81532b0 con 0x7f44b8159440 2023-07-21T22:37:06.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.185+0000 7f44bea93640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44b80ca6f0 con 0x7f44b80aef10 2023-07-21T22:37:06.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.185+0000 7f44bea93640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b81599d0 con 0x7f44b80aeb40 2023-07-21T22:37:06.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.185+0000 7f44bd030640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f44b8159440 0x7f44b80c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52518/0 (socket says 172.21.15.6:52518) 2023-07-21T22:37:06.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.185+0000 7f44bd030640 1 -- 172.21.15.6:0/3070997514 learned_addr learned my addr 172.21.15.6:0/3070997514 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.185+0000 7f44bc82f640 1 --2- 172.21.15.6:0/3070997514 >> v2:172.21.15.161:3300/0 conn(0x7f44b80aeb40 0x7f44b815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.185+0000 7f44b77fe640 1 -- 172.21.15.6:0/3070997514 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958280966 0 0) 0x7f44b81532b0 con 0x7f44b8159440 2023-07-21T22:37:06.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.185+0000 7f44b77fe640 1 -- 172.21.15.6:0/3070997514 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44a8005740 con 0x7f44b8159440 2023-07-21T22:37:06.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.185+0000 7f44b77fe640 1 -- 172.21.15.6:0/3070997514 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3971445295 0 0) 0x7f44b80ca6f0 con 0x7f44b80aef10 2023-07-21T22:37:06.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.185+0000 7f44b77fe640 1 -- 172.21.15.6:0/3070997514 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44b81532b0 con 0x7f44b80aef10 2023-07-21T22:37:06.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.185+0000 7f44bc82f640 1 -- 172.21.15.6:0/3070997514 >> v1:172.21.15.161:6789/0 conn(0x7f44b80aef10 legacy=0x7f44b8158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.185+0000 7f44bc82f640 1 -- 172.21.15.6:0/3070997514 >> v1:172.21.15.6:6789/0 conn(0x7f44b8159440 legacy=0x7f44b80c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.185+0000 7f44bc82f640 1 -- 172.21.15.6:0/3070997514 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b8159cb0 con 0x7f44b80aeb40 2023-07-21T22:37:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.189+0000 7f44bc82f640 1 --2- 172.21.15.6:0/3070997514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44b80aeb40 0x7f44b815cef0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0097c0 tx=0x7f44ac01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6d46d604d636c3f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.189+0000 7f44b77fe640 1 -- 172.21.15.6:0/3070997514 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0ac620 con 0x7f44b80aeb40 2023-07-21T22:37:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.189+0000 7f44b77fe640 1 -- 172.21.15.6:0/3070997514 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac0ac780 con 0x7f44b80aeb40 2023-07-21T22:37:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.189+0000 7f44b77fe640 1 -- 172.21.15.6:0/3070997514 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0acb10 con 0x7f44b80aeb40 2023-07-21T22:37:06.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.189+0000 7f44bea93640 1 -- 172.21.15.6:0/3070997514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44b80aeb40 msgr2=0x7f44b815cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.189+0000 7f44bea93640 1 --2- 172.21.15.6:0/3070997514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44b80aeb40 0x7f44b815cef0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0097c0 tx=0x7f44ac01c3c0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.189+0000 7f44bea93640 1 -- 172.21.15.6:0/3070997514 shutdown_connections 2023-07-21T22:37:06.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.189+0000 7f44bea93640 1 --2- 172.21.15.6:0/3070997514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44b80aeb40 0x7f44b815cef0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.189+0000 7f44bea93640 1 -- 172.21.15.6:0/3070997514 >> 172.21.15.6:0/3070997514 conn(0x7f44b80cde90 msgr2=0x7f44b80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.189+0000 7f44bea93640 1 -- 172.21.15.6:0/3070997514 shutdown_connections 2023-07-21T22:37:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.189+0000 7f44bea93640 1 -- 172.21.15.6:0/3070997514 wait complete. 2023-07-21T22:37:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bea93640 1 Processor -- start 2023-07-21T22:37:06.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bea93640 1 -- start start 2023-07-21T22:37:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bea93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44b80aeb40 0x7f44b814d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bea93640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44b80aef10 0x7f44b814d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bea93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b8159440 0x7f44b814eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bea93640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b8149940 con 0x7f44b8159440 2023-07-21T22:37:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bea93640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b8149c20 con 0x7f44b80aef10 2023-07-21T22:37:06.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bea93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b8149f00 con 0x7f44b80aeb40 2023-07-21T22:37:06.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bd030640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b8159440 0x7f44b814eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bd030640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b8159440 0x7f44b814eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39252/0 (socket says 172.21.15.6:39252) 2023-07-21T22:37:06.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bd030640 1 -- 172.21.15.6:0/3681769489 learned_addr learned my addr 172.21.15.6:0/3681769489 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:06.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bc82f640 1 --2- 172.21.15.6:0/3681769489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44b80aeb40 0x7f44b814d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44b7fff640 1 --2- 172.21.15.6:0/3681769489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44b80aef10 0x7f44b814d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bd030640 1 -- 172.21.15.6:0/3681769489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44b80aeb40 msgr2=0x7f44b814d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bd030640 1 --2- 172.21.15.6:0/3681769489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44b80aeb40 0x7f44b814d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bd030640 1 -- 172.21.15.6:0/3681769489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44b80aef10 msgr2=0x7f44b814d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bd030640 1 --2- 172.21.15.6:0/3681769489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44b80aef10 0x7f44b814d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bd030640 1 -- 172.21.15.6:0/3681769489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac009420 con 0x7f44b8159440 2023-07-21T22:37:06.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bc82f640 1 --2- 172.21.15.6:0/3681769489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44b80aeb40 0x7f44b814d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:06.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bd030640 1 --2- 172.21.15.6:0/3681769489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b8159440 0x7f44b814eb10 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f44b000caf0 tx=0x7f44b000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:06.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44b57fa640 1 -- 172.21.15.6:0/3681769489 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b000aca0 con 0x7f44b8159440 2023-07-21T22:37:06.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44b57fa640 1 -- 172.21.15.6:0/3681769489 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b000ae00 con 0x7f44b8159440 2023-07-21T22:37:06.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44b57fa640 1 -- 172.21.15.6:0/3681769489 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b0012620 con 0x7f44b8159440 2023-07-21T22:37:06.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bea93640 1 -- 172.21.15.6:0/3681769489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b814a1e0 con 0x7f44b8159440 2023-07-21T22:37:06.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.193+0000 7f44bea93640 1 -- 172.21.15.6:0/3681769489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b81494d0 con 0x7f44b8159440 2023-07-21T22:37:06.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.197+0000 7f44bea93640 1 -- 172.21.15.6:0/3681769489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b80678d0 con 0x7f44b8159440 2023-07-21T22:37:06.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.197+0000 7f44b57fa640 1 -- 172.21.15.6:0/3681769489 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 47) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f44b0007070 con 0x7f44b8159440 2023-07-21T22:37:06.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.197+0000 7f44b57fa640 1 -- 172.21.15.6:0/3681769489 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6996+0+0 (secure 0 0 0) 0x7f44b0083b50 con 0x7f44b8159440 2023-07-21T22:37:06.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.201+0000 7f44b57fa640 1 -- 172.21.15.6:0/3681769489 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44b0051070 con 0x7f44b8159440 2023-07-21T22:37:06.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.357+0000 7f44bea93640 1 -- 172.21.15.6:0/3681769489 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f44b814a690 con 0x7f44b8159440 2023-07-21T22:37:06.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.357+0000 7f44b57fa640 1 -- 172.21.15.6:0/3681769489 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7f44b0054690 con 0x7f44b8159440 2023-07-21T22:37:06.404 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:37:06.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.357+0000 7f44bea93640 1 -- 172.21.15.6:0/3681769489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b8159440 msgr2=0x7f44b814eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.357+0000 7f44bea93640 1 --2- 172.21.15.6:0/3681769489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b8159440 0x7f44b814eb10 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f44b000caf0 tx=0x7f44b000a060 comp rx=0 tx=0).stop 2023-07-21T22:37:06.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.361+0000 7f44bea93640 1 -- 172.21.15.6:0/3681769489 shutdown_connections 2023-07-21T22:37:06.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.361+0000 7f44bea93640 1 --2- 172.21.15.6:0/3681769489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44b8159440 0x7f44b814eb10 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.361+0000 7f44bea93640 1 --2- 172.21.15.6:0/3681769489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44b80aef10 0x7f44b814d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.361+0000 7f44bea93640 1 --2- 172.21.15.6:0/3681769489 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44b80aeb40 0x7f44b814d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.361+0000 7f44bea93640 1 -- 172.21.15.6:0/3681769489 >> 172.21.15.6:0/3681769489 conn(0x7f44b80cde90 msgr2=0x7f44b80ad8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:06.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.361+0000 7f44bea93640 1 -- 172.21.15.6:0/3681769489 shutdown_connections 2023-07-21T22:37:06.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.361+0000 7f44bea93640 1 -- 172.21.15.6:0/3681769489 wait complete. 2023-07-21T22:37:06.424 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:37:06.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.565+0000 7f8c8e140640 1 Processor -- start 2023-07-21T22:37:06.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.565+0000 7f8c8e140640 1 -- start start 2023-07-21T22:37:06.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.565+0000 7f8c8e140640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8c88159440 0x7f8c880c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.565+0000 7f8c8e140640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c881532b0 con 0x7f8c880aeb40 2023-07-21T22:37:06.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.565+0000 7f8c8e140640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c880ca6f0 con 0x7f8c8815cef0 2023-07-21T22:37:06.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.565+0000 7f8c8e140640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c8815d360 con 0x7f8c88159440 2023-07-21T22:37:06.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.565+0000 7f8c877fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8c880aeb40 0x7f8c880aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52528/0 (socket says 172.21.15.6:52528) 2023-07-21T22:37:06.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.565+0000 7f8c877fe640 1 -- 172.21.15.6:0/370924745 learned_addr learned my addr 172.21.15.6:0/370924745 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:06.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.565+0000 7f8c87fff640 1 --2- 172.21.15.6:0/370924745 >> v2:172.21.15.161:3300/0 conn(0x7f8c88159440 0x7f8c880c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.565+0000 7f8c867fc640 1 -- 172.21.15.6:0/370924745 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773109680 0 0) 0x7f8c881532b0 con 0x7f8c880aeb40 2023-07-21T22:37:06.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.565+0000 7f8c867fc640 1 -- 172.21.15.6:0/370924745 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c70003530 con 0x7f8c880aeb40 2023-07-21T22:37:06.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.565+0000 7f8c867fc640 1 -- 172.21.15.6:0/370924745 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655092101 0 0) 0x7f8c880ca6f0 con 0x7f8c8815cef0 2023-07-21T22:37:06.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c867fc640 1 -- 172.21.15.6:0/370924745 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c881532b0 con 0x7f8c8815cef0 2023-07-21T22:37:06.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c867fc640 1 -- 172.21.15.6:0/370924745 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3134624773 0 0) 0x7f8c70003530 con 0x7f8c880aeb40 2023-07-21T22:37:06.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c867fc640 1 -- 172.21.15.6:0/370924745 >> v2:172.21.15.161:3300/0 conn(0x7f8c88159440 msgr2=0x7f8c880c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:06.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c867fc640 1 --2- 172.21.15.6:0/370924745 >> v2:172.21.15.161:3300/0 conn(0x7f8c88159440 0x7f8c880c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c867fc640 1 -- 172.21.15.6:0/370924745 >> v1:172.21.15.161:6789/0 conn(0x7f8c8815cef0 legacy=0x7f8c88158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c867fc640 1 -- 172.21.15.6:0/370924745 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c881599d0 con 0x7f8c880aeb40 2023-07-21T22:37:06.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c867fc640 1 -- 172.21.15.6:0/370924745 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f8c78001680 con 0x7f8c880aeb40 2023-07-21T22:37:06.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c867fc640 1 -- 172.21.15.6:0/370924745 >> v1:172.21.15.6:6789/0 conn(0x7f8c880aeb40 legacy=0x7f8c880aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c867fc640 1 --2- 172.21.15.6:0/370924745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c70003b10 0x7f8c70003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c867fc640 1 --2- 172.21.15.6:0/370924745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c700047d0 0x7f8c70004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c867fc640 1 --2- 172.21.15.6:0/370924745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c70005180 0x7f8c7000ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c867fc640 1 -- 172.21.15.6:0/370924745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8815d360 con 0x7f8c70005180 2023-07-21T22:37:06.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c867fc640 1 -- 172.21.15.6:0/370924745 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c700104e0 con 0x7f8c70003b10 2023-07-21T22:37:06.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c867fc640 1 -- 172.21.15.6:0/370924745 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c70010620 con 0x7f8c700047d0 2023-07-21T22:37:06.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c87fff640 1 --2- 172.21.15.6:0/370924745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c70005180 0x7f8c7000ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c877fe640 1 --2- 172.21.15.6:0/370924745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c70003b10 0x7f8c70003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c86ffd640 1 --2- 172.21.15.6:0/370924745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c700047d0 0x7f8c70004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c87fff640 1 -- 172.21.15.6:0/370924745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c700047d0 msgr2=0x7f8c70004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:06.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c87fff640 1 --2- 172.21.15.6:0/370924745 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c700047d0 0x7f8c70004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c87fff640 1 -- 172.21.15.6:0/370924745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c70003b10 msgr2=0x7f8c70003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:06.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c87fff640 1 --2- 172.21.15.6:0/370924745 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c70003b10 0x7f8c70003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.569+0000 7f8c87fff640 1 -- 172.21.15.6:0/370924745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c70003530 con 0x7f8c70005180 2023-07-21T22:37:06.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.573+0000 7f8c87fff640 1 -- 172.21.15.6:0/370924745 reap_dead start 2023-07-21T22:37:06.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.573+0000 7f8c87fff640 1 --2- 172.21.15.6:0/370924745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c70005180 0x7f8c7000ffa0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009fc0 tx=0x7f8c8001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b1cf7d0e943d2b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:06.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.573+0000 7f8c867fc640 1 -- 172.21.15.6:0/370924745 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78007ea0 con 0x7f8c70005180 2023-07-21T22:37:06.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.573+0000 7f8c867fc640 1 -- 172.21.15.6:0/370924745 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8000f040 con 0x7f8c70005180 2023-07-21T22:37:06.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.573+0000 7f8c867fc640 1 -- 172.21.15.6:0/370924745 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c80003e20 con 0x7f8c70005180 2023-07-21T22:37:06.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.573+0000 7f8c8e140640 1 -- 172.21.15.6:0/370924745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c70005180 msgr2=0x7f8c7000ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.573+0000 7f8c8e140640 1 --2- 172.21.15.6:0/370924745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c70005180 0x7f8c7000ffa0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009fc0 tx=0x7f8c8001cca0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.573+0000 7f8c8e140640 1 -- 172.21.15.6:0/370924745 shutdown_connections 2023-07-21T22:37:06.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.573+0000 7f8c8e140640 1 --2- 172.21.15.6:0/370924745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c70005180 0x7f8c7000ffa0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.573+0000 7f8c8e140640 1 -- 172.21.15.6:0/370924745 >> 172.21.15.6:0/370924745 conn(0x7f8c880cde90 msgr2=0x7f8c880ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:06.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.573+0000 7f8c8e140640 1 -- 172.21.15.6:0/370924745 shutdown_connections 2023-07-21T22:37:06.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.573+0000 7f8c8e140640 1 -- 172.21.15.6:0/370924745 wait complete. 2023-07-21T22:37:06.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.573+0000 7f8c8e140640 1 Processor -- start 2023-07-21T22:37:06.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.573+0000 7f8c8e140640 1 -- start start 2023-07-21T22:37:06.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c8e140640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c70005180 0x7f8c88157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c8e140640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c880c9140 0x7f8c8814ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c8e140640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c8814e310 0x7f8c8814e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c8e140640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8815a6e0 con 0x7f8c880c9140 2023-07-21T22:37:06.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c8e140640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c88158420 con 0x7f8c70005180 2023-07-21T22:37:06.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c8e140640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c881588f0 con 0x7f8c8814e310 2023-07-21T22:37:06.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c86ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c880c9140 0x7f8c8814ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c86ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c880c9140 0x7f8c8814ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39270/0 (socket says 172.21.15.6:39270) 2023-07-21T22:37:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c86ffd640 1 -- 172.21.15.6:0/2185337651 learned_addr learned my addr 172.21.15.6:0/2185337651 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c877fe640 1 --2- 172.21.15.6:0/2185337651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c70005180 0x7f8c88157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c87fff640 1 --2- 172.21.15.6:0/2185337651 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c8814e310 0x7f8c8814e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c86ffd640 1 -- 172.21.15.6:0/2185337651 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c8814e310 msgr2=0x7f8c8814e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c86ffd640 1 --2- 172.21.15.6:0/2185337651 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c8814e310 0x7f8c8814e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c86ffd640 1 -- 172.21.15.6:0/2185337651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c70005180 msgr2=0x7f8c88157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c86ffd640 1 --2- 172.21.15.6:0/2185337651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c70005180 0x7f8c88157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c86ffd640 1 -- 172.21.15.6:0/2185337651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8815a060 con 0x7f8c880c9140 2023-07-21T22:37:06.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c86ffd640 1 --2- 172.21.15.6:0/2185337651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c880c9140 0x7f8c8814ddd0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00f7d0 tx=0x7f8c7c00fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:06.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c6ffff640 1 -- 172.21.15.6:0/2185337651 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c00fe80 con 0x7f8c880c9140 2023-07-21T22:37:06.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c6ffff640 1 -- 172.21.15.6:0/2185337651 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7c005320 con 0x7f8c880c9140 2023-07-21T22:37:06.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c6ffff640 1 -- 172.21.15.6:0/2185337651 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c007270 con 0x7f8c880c9140 2023-07-21T22:37:06.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c8e140640 1 -- 172.21.15.6:0/2185337651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c88158610 con 0x7f8c880c9140 2023-07-21T22:37:06.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c8e140640 1 -- 172.21.15.6:0/2185337651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c880c95b0 con 0x7f8c880c9140 2023-07-21T22:37:06.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c8e140640 1 -- 172.21.15.6:0/2185337651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c88159ec0 con 0x7f8c880c9140 2023-07-21T22:37:06.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.577+0000 7f8c6ffff640 1 -- 172.21.15.6:0/2185337651 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 47) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f8c7c0073d0 con 0x7f8c880c9140 2023-07-21T22:37:06.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.581+0000 7f8c6ffff640 1 -- 172.21.15.6:0/2185337651 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6996+0+0 (secure 0 0 0) 0x7f8c7c0831a0 con 0x7f8c880c9140 2023-07-21T22:37:06.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.585+0000 7f8c6ffff640 1 -- 172.21.15.6:0/2185337651 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8c88159ec0 con 0x7f8c880c9140 2023-07-21T22:37:06.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.705+0000 7f8c6ffff640 1 -- 172.21.15.6:0/2185337651 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 48) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f8c7c050130 con 0x7f8c880c9140 2023-07-21T22:37:06.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.705+0000 7f8c6ffff640 1 --2- 172.21.15.6:0/2185337651 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f8c7406c310 0x7f8c7406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.705+0000 7f8c877fe640 1 --2- 172.21.15.6:0/2185337651 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f8c7406c310 0x7f8c7406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.709+0000 7f8c877fe640 1 --2- 172.21.15.6:0/2185337651 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f8c7406c310 0x7f8c7406e6f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8c78001060 tx=0x7f8c78001e30 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:06.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.741+0000 7f8c8e140640 1 -- 172.21.15.6:0/2185337651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c88159ec0 con 0x7f8c880c9140 2023-07-21T22:37:06.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.741+0000 7f8c6ffff640 1 -- 172.21.15.6:0/2185337651 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c88159ec0 con 0x7f8c880c9140 2023-07-21T22:37:06.787 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:37:06.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.745+0000 7f8c8e140640 1 -- 172.21.15.6:0/2185337651 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f8c7406c310 msgr2=0x7f8c7406e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.745+0000 7f8c8e140640 1 --2- 172.21.15.6:0/2185337651 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f8c7406c310 0x7f8c7406e6f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8c78001060 tx=0x7f8c78001e30 comp rx=0 tx=0).stop 2023-07-21T22:37:06.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.745+0000 7f8c8e140640 1 -- 172.21.15.6:0/2185337651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c880c9140 msgr2=0x7f8c8814ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.745+0000 7f8c8e140640 1 --2- 172.21.15.6:0/2185337651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c880c9140 0x7f8c8814ddd0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c00f7d0 tx=0x7f8c7c00fc90 comp rx=0 tx=0).stop 2023-07-21T22:37:06.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.745+0000 7f8c8e140640 1 -- 172.21.15.6:0/2185337651 shutdown_connections 2023-07-21T22:37:06.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.745+0000 7f8c8e140640 1 --2- 172.21.15.6:0/2185337651 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f8c7406c310 0x7f8c7406e6f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.745+0000 7f8c8e140640 1 --2- 172.21.15.6:0/2185337651 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c8814e310 0x7f8c8814e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.745+0000 7f8c8e140640 1 --2- 172.21.15.6:0/2185337651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c880c9140 0x7f8c8814ddd0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.745+0000 7f8c8e140640 1 --2- 172.21.15.6:0/2185337651 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c70005180 0x7f8c88157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.745+0000 7f8c8e140640 1 -- 172.21.15.6:0/2185337651 >> 172.21.15.6:0/2185337651 conn(0x7f8c880cde90 msgr2=0x7f8c880ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:06.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.745+0000 7f8c8e140640 1 -- 172.21.15.6:0/2185337651 shutdown_connections 2023-07-21T22:37:06.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.745+0000 7f8c8e140640 1 -- 172.21.15.6:0/2185337651 wait complete. 2023-07-21T22:37:06.808 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:37:06.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.905+0000 7f4ed0f9d640 1 Processor -- start 2023-07-21T22:37:06.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.905+0000 7f4ed0f9d640 1 -- start start 2023-07-21T22:37:06.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.909+0000 7f4ed0f9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ecc158ce0 0x7f4ecc070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.909+0000 7f4ed0f9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4ecc0c9730 0x7f4ecc0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.909+0000 7f4ed0f9d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ecc0cc700 con 0x7f4ecc0c8ad0 2023-07-21T22:37:06.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.909+0000 7f4ed0f9d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ecc0b0ff0 con 0x7f4ecc0c9730 2023-07-21T22:37:06.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.909+0000 7f4ed0f9d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc070c80 con 0x7f4ecc158ce0 2023-07-21T22:37:06.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.909+0000 7f4ec9d9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4ecc0c8ad0 0x7f4ecc0c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52540/0 (socket says 172.21.15.6:52540) 2023-07-21T22:37:06.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.909+0000 7f4ec9d9b640 1 -- 172.21.15.6:0/3593701078 learned_addr learned my addr 172.21.15.6:0/3593701078 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:06.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.909+0000 7f4ecad9d640 1 --2- 172.21.15.6:0/3593701078 >> v2:172.21.15.6:3300/0 conn(0x7f4ecc0c9730 0x7f4ecc0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.909+0000 7f4eca59c640 1 --2- 172.21.15.6:0/3593701078 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ecc158ce0 0x7f4ecc070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.909+0000 7f4ecad9d640 1 -- 172.21.15.6:0/3593701078 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ecc158ce0 msgr2=0x7f4ecc070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:06.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.909+0000 7f4ecad9d640 1 --2- 172.21.15.6:0/3593701078 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ecc158ce0 0x7f4ecc070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.909+0000 7f4ecad9d640 1 -- 172.21.15.6:0/3593701078 >> v1:172.21.15.6:6789/0 conn(0x7f4ecc0c8ad0 legacy=0x7f4ecc0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.909+0000 7f4ecad9d640 1 -- 172.21.15.6:0/3593701078 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ecc0cbdd0 con 0x7f4ecc0c9730 2023-07-21T22:37:06.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.913+0000 7f4ecad9d640 1 --2- 172.21.15.6:0/3593701078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ecc0c9730 0x7f4ecc0ccb90 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009d90 tx=0x7f4ec401c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f919aef028c483 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:06.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.913+0000 7f4ec959a640 1 -- 172.21.15.6:0/3593701078 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec40a57d0 con 0x7f4ecc0c9730 2023-07-21T22:37:06.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.913+0000 7f4ec959a640 1 -- 172.21.15.6:0/3593701078 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec40a5930 con 0x7f4ecc0c9730 2023-07-21T22:37:06.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.913+0000 7f4ec959a640 1 -- 172.21.15.6:0/3593701078 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec40a5cc0 con 0x7f4ecc0c9730 2023-07-21T22:37:06.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.913+0000 7f4ed0f9d640 1 -- 172.21.15.6:0/3593701078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ecc0c9730 msgr2=0x7f4ecc0ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.913+0000 7f4ed0f9d640 1 --2- 172.21.15.6:0/3593701078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ecc0c9730 0x7f4ecc0ccb90 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4009d90 tx=0x7f4ec401c800 comp rx=0 tx=0).stop 2023-07-21T22:37:06.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.913+0000 7f4ed0f9d640 1 -- 172.21.15.6:0/3593701078 shutdown_connections 2023-07-21T22:37:06.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.913+0000 7f4ed0f9d640 1 --2- 172.21.15.6:0/3593701078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ecc0c9730 0x7f4ecc0ccb90 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.913+0000 7f4ed0f9d640 1 --2- 172.21.15.6:0/3593701078 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ecc158ce0 0x7f4ecc070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.913+0000 7f4ed0f9d640 1 -- 172.21.15.6:0/3593701078 >> 172.21.15.6:0/3593701078 conn(0x7f4ecc0afcf0 msgr2=0x7f4ecc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:06.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.913+0000 7f4ed0f9d640 1 -- 172.21.15.6:0/3593701078 shutdown_connections 2023-07-21T22:37:06.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.913+0000 7f4ed0f9d640 1 -- 172.21.15.6:0/3593701078 wait complete. 2023-07-21T22:37:06.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.913+0000 7f4ed0f9d640 1 Processor -- start 2023-07-21T22:37:06.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.913+0000 7f4ed0f9d640 1 -- start start 2023-07-21T22:37:06.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ed0f9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ecc0c8ad0 0x7f4ecc156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ed0f9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ecc0c9730 0x7f4ecc14ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ed0f9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ecc158ce0 0x7f4ecc0adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ed0f9d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc14bee0 con 0x7f4ecc0c9730 2023-07-21T22:37:06.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ed0f9d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc1570d0 con 0x7f4ecc158ce0 2023-07-21T22:37:06.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ed0f9d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ecc1573b0 con 0x7f4ecc0c8ad0 2023-07-21T22:37:06.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ec9d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ecc0c9730 0x7f4ecc14ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ec9d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ecc0c9730 0x7f4ecc14ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39282/0 (socket says 172.21.15.6:39282) 2023-07-21T22:37:06.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ec9d9b640 1 -- 172.21.15.6:0/2618583683 learned_addr learned my addr 172.21.15.6:0/2618583683 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:06.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ecad9d640 1 --2- 172.21.15.6:0/2618583683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ecc158ce0 0x7f4ecc0adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4eca59c640 1 --2- 172.21.15.6:0/2618583683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ecc0c8ad0 0x7f4ecc156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ec9d9b640 1 -- 172.21.15.6:0/2618583683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ecc0c8ad0 msgr2=0x7f4ecc156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ec9d9b640 1 --2- 172.21.15.6:0/2618583683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ecc0c8ad0 0x7f4ecc156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ec9d9b640 1 -- 172.21.15.6:0/2618583683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ecc158ce0 msgr2=0x7f4ecc0adbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ec9d9b640 1 --2- 172.21.15.6:0/2618583683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ecc158ce0 0x7f4ecc0adbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ec9d9b640 1 -- 172.21.15.6:0/2618583683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec4009a70 con 0x7f4ecc0c9730 2023-07-21T22:37:06.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ecad9d640 1 --2- 172.21.15.6:0/2618583683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ecc158ce0 0x7f4ecc0adbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:06.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ec9d9b640 1 --2- 172.21.15.6:0/2618583683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ecc0c9730 0x7f4ecc14ede0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000c500 tx=0x7f4ec000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ebaffd640 1 -- 172.21.15.6:0/2618583683 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec0005cf0 con 0x7f4ecc0c9730 2023-07-21T22:37:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ebaffd640 1 -- 172.21.15.6:0/2618583683 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec0005e50 con 0x7f4ecc0c9730 2023-07-21T22:37:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ebaffd640 1 -- 172.21.15.6:0/2618583683 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec00072f0 con 0x7f4ecc0c9730 2023-07-21T22:37:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ed0f9d640 1 -- 172.21.15.6:0/2618583683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ecc157690 con 0x7f4ecc0c9730 2023-07-21T22:37:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ed0f9d640 1 -- 172.21.15.6:0/2618583683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ecc157c50 con 0x7f4ecc0c9730 2023-07-21T22:37:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ed0f9d640 1 -- 172.21.15.6:0/2618583683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ecc0ca1a0 con 0x7f4ecc0c9730 2023-07-21T22:37:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.917+0000 7f4ebaffd640 1 -- 172.21.15.6:0/2618583683 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 48) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f4ec0007450 con 0x7f4ecc0c9730 2023-07-21T22:37:06.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.921+0000 7f4ebaffd640 1 --2- 172.21.15.6:0/2618583683 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f4eac0660d0 0x7f4eac068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.921+0000 7f4ebaffd640 1 -- 172.21.15.6:0/2618583683 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6996+0+0 (secure 0 0 0) 0x7f4ec00832c0 con 0x7f4ecc0c9730 2023-07-21T22:37:06.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.921+0000 7f4eca59c640 1 --2- 172.21.15.6:0/2618583683 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f4eac0660d0 0x7f4eac068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.921+0000 7f4eca59c640 1 --2- 172.21.15.6:0/2618583683 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f4eac0660d0 0x7f4eac068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009a50 tx=0x7f4ebc008040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:06.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:06.925+0000 7f4ebaffd640 1 -- 172.21.15.6:0/2618583683 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4ec00506b0 con 0x7f4ecc0c9730 2023-07-21T22:37:07.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.113+0000 7f4ed0f9d640 1 -- 172.21.15.6:0/2618583683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ecc0678d0 con 0x7f4ecc0c9730 2023-07-21T22:37:07.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.113+0000 7f4ebaffd640 1 -- 172.21.15.6:0/2618583683 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4667 (secure 0 0 0) 0x7f4ec0053cd0 con 0x7f4ecc0c9730 2023-07-21T22:37:07.160 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:07.160 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6716,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/128364815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":128364815},{"type":"v1","addr":"172.21.15.161:6836","nonce":128364815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6719,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1447795142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1447795142},{"type":"v1","addr":"172.21.15.161:6837","nonce":1447795142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7653,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/921116259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":921116259},{"type":"v1","addr":"172.21.15.6:6833","nonce":921116259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:35:40.812228+0000","modified":"2023-07-21T22:35:44.851097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2789884551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2789884551},{"type":"v1","addr":"172.21.15.6:6835","nonce":2789884551}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-21T22:37:07.160 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 47 2023-07-21T22:37:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.117+0000 7f4ed0f9d640 1 -- 172.21.15.6:0/2618583683 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f4eac0660d0 msgr2=0x7f4eac068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.117+0000 7f4ed0f9d640 1 --2- 172.21.15.6:0/2618583683 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f4eac0660d0 0x7f4eac068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc009a50 tx=0x7f4ebc008040 comp rx=0 tx=0).stop 2023-07-21T22:37:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.117+0000 7f4ed0f9d640 1 -- 172.21.15.6:0/2618583683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ecc0c9730 msgr2=0x7f4ecc14ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.117+0000 7f4ed0f9d640 1 --2- 172.21.15.6:0/2618583683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ecc0c9730 0x7f4ecc14ede0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000c500 tx=0x7f4ec000c9c0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.117+0000 7f4ed0f9d640 1 -- 172.21.15.6:0/2618583683 shutdown_connections 2023-07-21T22:37:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.117+0000 7f4ed0f9d640 1 --2- 172.21.15.6:0/2618583683 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f4eac0660d0 0x7f4eac068580 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.117+0000 7f4ed0f9d640 1 --2- 172.21.15.6:0/2618583683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ecc158ce0 0x7f4ecc0adbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.117+0000 7f4ed0f9d640 1 --2- 172.21.15.6:0/2618583683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ecc0c9730 0x7f4ecc14ede0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.117+0000 7f4ed0f9d640 1 --2- 172.21.15.6:0/2618583683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ecc0c8ad0 0x7f4ecc156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.117+0000 7f4ed0f9d640 1 -- 172.21.15.6:0/2618583683 >> 172.21.15.6:0/2618583683 conn(0x7f4ecc0afcf0 msgr2=0x7f4ecc152d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.117+0000 7f4ed0f9d640 1 -- 172.21.15.6:0/2618583683 shutdown_connections 2023-07-21T22:37:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.117+0000 7f4ed0f9d640 1 -- 172.21.15.6:0/2618583683 wait complete. 2023-07-21T22:37:07.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:37:07.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.277+0000 7f416f234640 1 Processor -- start 2023-07-21T22:37:07.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.277+0000 7f416f234640 1 -- start start 2023-07-21T22:37:07.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.281+0000 7f416f234640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41680c8ad0 0x7f41680c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:07.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.281+0000 7f416f234640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41680c9560 0x7f41680ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:07.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.281+0000 7f416f234640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41680cc700 con 0x7f4168158ce0 2023-07-21T22:37:07.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.281+0000 7f416f234640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41680c99e0 con 0x7f41680c9560 2023-07-21T22:37:07.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.281+0000 7f416f234640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41680b0ff0 con 0x7f41680c8ad0 2023-07-21T22:37:07.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.281+0000 7f416d7d1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41680c9560 0x7f41680ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:07.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.281+0000 7f416d7d1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f41680c9560 0x7f41680ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39292/0 (socket says 172.21.15.6:39292) 2023-07-21T22:37:07.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.281+0000 7f416d7d1640 1 -- 172.21.15.6:0/3189630235 learned_addr learned my addr 172.21.15.6:0/3189630235 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:07.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.281+0000 7f416d7d1640 1 -- 172.21.15.6:0/3189630235 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41680c8ad0 msgr2=0x7f41680c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:07.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.281+0000 7f4167fff640 1 --2- 172.21.15.6:0/3189630235 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41680c8ad0 0x7f41680c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:07.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.281+0000 7f416d7d1640 1 --2- 172.21.15.6:0/3189630235 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41680c8ad0 0x7f41680c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.281+0000 7f416d7d1640 1 -- 172.21.15.6:0/3189630235 >> v1:172.21.15.161:6789/0 conn(0x7f4168158ce0 legacy=0x7f4168070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:07.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.281+0000 7f416d7d1640 1 -- 172.21.15.6:0/3189630235 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4168070c80 con 0x7f41680c9560 2023-07-21T22:37:07.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.281+0000 7f4167fff640 1 --2- 172.21.15.6:0/3189630235 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41680c8ad0 0x7f41680c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:37:07.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.285+0000 7f416d7d1640 1 --2- 172.21.15.6:0/3189630235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41680c9560 0x7f41680ccb90 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f4160009e50 tx=0x7f416001ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627cc766521c82c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:07.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.285+0000 7f41677fe640 1 -- 172.21.15.6:0/3189630235 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41600a7830 con 0x7f41680c9560 2023-07-21T22:37:07.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.285+0000 7f41677fe640 1 -- 172.21.15.6:0/3189630235 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41600a7990 con 0x7f41680c9560 2023-07-21T22:37:07.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.285+0000 7f41677fe640 1 -- 172.21.15.6:0/3189630235 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41600a7d20 con 0x7f41680c9560 2023-07-21T22:37:07.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.285+0000 7f416f234640 1 -- 172.21.15.6:0/3189630235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41680c9560 msgr2=0x7f41680ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:07.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.285+0000 7f416f234640 1 --2- 172.21.15.6:0/3189630235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41680c9560 0x7f41680ccb90 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f4160009e50 tx=0x7f416001ea90 comp rx=0 tx=0).stop 2023-07-21T22:37:07.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.285+0000 7f416f234640 1 -- 172.21.15.6:0/3189630235 shutdown_connections 2023-07-21T22:37:07.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.285+0000 7f416f234640 1 --2- 172.21.15.6:0/3189630235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41680c9560 0x7f41680ccb90 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.285+0000 7f416f234640 1 --2- 172.21.15.6:0/3189630235 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41680c8ad0 0x7f41680c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.285+0000 7f416f234640 1 -- 172.21.15.6:0/3189630235 >> 172.21.15.6:0/3189630235 conn(0x7f41680afcf0 msgr2=0x7f41680b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:07.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.285+0000 7f416f234640 1 -- 172.21.15.6:0/3189630235 shutdown_connections 2023-07-21T22:37:07.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.285+0000 7f416f234640 1 -- 172.21.15.6:0/3189630235 wait complete. 2023-07-21T22:37:07.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.285+0000 7f416f234640 1 Processor -- start 2023-07-21T22:37:07.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.285+0000 7f416f234640 1 -- start start 2023-07-21T22:37:07.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f416f234640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41680c8ad0 0x7f4168151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:07.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f416f234640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41680c9560 0x7f4168150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:07.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f416f234640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4168158ce0 0x7f41680b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:07.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f416f234640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41680c4ac0 con 0x7f41680c9560 2023-07-21T22:37:07.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f416f234640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41680c47e0 con 0x7f4168158ce0 2023-07-21T22:37:07.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f416f234640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41680b3480 con 0x7f41680c8ad0 2023-07-21T22:37:07.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f4167fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41680c9560 0x7f4168150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:07.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f4167fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41680c9560 0x7f4168150b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39300/0 (socket says 172.21.15.6:39300) 2023-07-21T22:37:07.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f4167fff640 1 -- 172.21.15.6:0/4161624543 learned_addr learned my addr 172.21.15.6:0/4161624543 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:07.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f416cfd0640 1 --2- 172.21.15.6:0/4161624543 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41680c8ad0 0x7f4168151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:07.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f416d7d1640 1 --2- 172.21.15.6:0/4161624543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4168158ce0 0x7f41680b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:07.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f4167fff640 1 -- 172.21.15.6:0/4161624543 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41680c8ad0 msgr2=0x7f4168151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:07.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f4167fff640 1 --2- 172.21.15.6:0/4161624543 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41680c8ad0 0x7f4168151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f4167fff640 1 -- 172.21.15.6:0/4161624543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4168158ce0 msgr2=0x7f41680b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:07.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f4167fff640 1 --2- 172.21.15.6:0/4161624543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4168158ce0 0x7f41680b2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f4167fff640 1 -- 172.21.15.6:0/4161624543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4160009b30 con 0x7f41680c9560 2023-07-21T22:37:07.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f4167fff640 1 --2- 172.21.15.6:0/4161624543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41680c9560 0x7f4168150b60 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f415400c7c0 tx=0x7f415400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f41657fa640 1 -- 172.21.15.6:0/4161624543 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154007a30 con 0x7f41680c9560 2023-07-21T22:37:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f41657fa640 1 -- 172.21.15.6:0/4161624543 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4154007b90 con 0x7f41680c9560 2023-07-21T22:37:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f41657fa640 1 -- 172.21.15.6:0/4161624543 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415400ce70 con 0x7f41680c9560 2023-07-21T22:37:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f416f234640 1 -- 172.21.15.6:0/4161624543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41680b3760 con 0x7f41680c9560 2023-07-21T22:37:07.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f416f234640 1 -- 172.21.15.6:0/4161624543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41680b3f60 con 0x7f41680c9560 2023-07-21T22:37:07.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f416f234640 1 -- 172.21.15.6:0/4161624543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4168072d90 con 0x7f41680c9560 2023-07-21T22:37:07.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.289+0000 7f41657fa640 1 -- 172.21.15.6:0/4161624543 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 48) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f41540113f0 con 0x7f41680c9560 2023-07-21T22:37:07.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.293+0000 7f41657fa640 1 --2- 172.21.15.6:0/4161624543 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f414c0660d0 0x7f414c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:07.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.293+0000 7f41657fa640 1 -- 172.21.15.6:0/4161624543 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6996+0+0 (secure 0 0 0) 0x7f41540841e0 con 0x7f41680c9560 2023-07-21T22:37:07.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.293+0000 7f416cfd0640 1 --2- 172.21.15.6:0/4161624543 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f414c0660d0 0x7f414c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:07.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.293+0000 7f416cfd0640 1 --2- 172.21.15.6:0/4161624543 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f414c0660d0 0x7f414c068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f415c0098e0 tx=0x7f415c009060 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:07.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.297+0000 7f41657fa640 1 -- 172.21.15.6:0/4161624543 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f41540515d0 con 0x7f41680c9560 2023-07-21T22:37:07.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.449+0000 7f416f234640 1 -- 172.21.15.6:0/4161624543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41680ca1a0 con 0x7f41680c9560 2023-07-21T22:37:07.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.453+0000 7f41657fa640 1 -- 172.21.15.6:0/4161624543 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+19638 (secure 0 0 0) 0x7f4154054bf0 con 0x7f41680c9560 2023-07-21T22:37:07.497 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:07.498 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":116,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:37:05.693465+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:35:38.932763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-21T22:35:39.805137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":1,"to":7}]},{"pgid":"14.a","mappings":[{"from":1,"to":7}]},{"pgid":"14.18","mappings":[{"from":1,"to":5}]},{"pgid":"14.31","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/2049802965":"2023-07-22T22:37:05.693410+0000","172.21.15.161:0/1536867018":"2023-07-22T22:37:05.693410+0000","172.21.15.161:6833/1474634903":"2023-07-22T22:37:05.693410+0000","172.21.15.161:6832/1474634903":"2023-07-22T22:37:05.693410+0000","172.21.15.161:0/2406446162":"2023-07-22T22:37:05.693410+0000","172.21.15.161:0/3803331105":"2023-07-22T22:37:05.693410+0000","172.21.15.161:0/3642970140":"2023-07-22T22:37:05.693410+0000","172.21.15.161:0/3239365888":"2023-07-22T22:37:05.693410+0000","172.21.15.161:6833/3891612664":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/2615083836":"2023-07-22T22:37:05.693410+0000","172.21.15.161:6832/3891612664":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/2035498467":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/4102091229":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/1144695770":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/220067520":"2023-07-22T22:37:05.693410+0000","172.21.15.161:0/2493427911":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/3550191976":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/253243953":"2023-07-22T22:35:58.832528+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:37:07.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.453+0000 7f416f234640 1 -- 172.21.15.6:0/4161624543 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f414c0660d0 msgr2=0x7f414c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:07.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.453+0000 7f416f234640 1 --2- 172.21.15.6:0/4161624543 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f414c0660d0 0x7f414c068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f415c0098e0 tx=0x7f415c009060 comp rx=0 tx=0).stop 2023-07-21T22:37:07.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.453+0000 7f416f234640 1 -- 172.21.15.6:0/4161624543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41680c9560 msgr2=0x7f4168150b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.453+0000 7f416f234640 1 --2- 172.21.15.6:0/4161624543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41680c9560 0x7f4168150b60 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f415400c7c0 tx=0x7f415400cc80 comp rx=0 tx=0).stop 2023-07-21T22:37:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.453+0000 7f416f234640 1 -- 172.21.15.6:0/4161624543 shutdown_connections 2023-07-21T22:37:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.453+0000 7f416f234640 1 --2- 172.21.15.6:0/4161624543 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f414c0660d0 0x7f414c068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.453+0000 7f416f234640 1 --2- 172.21.15.6:0/4161624543 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4168158ce0 0x7f41680b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.453+0000 7f416f234640 1 --2- 172.21.15.6:0/4161624543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41680c9560 0x7f4168150b60 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.453+0000 7f416f234640 1 --2- 172.21.15.6:0/4161624543 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f41680c8ad0 0x7f4168151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.453+0000 7f416f234640 1 -- 172.21.15.6:0/4161624543 >> 172.21.15.6:0/4161624543 conn(0x7f41680afcf0 msgr2=0x7f4168070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:07.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.453+0000 7f416f234640 1 -- 172.21.15.6:0/4161624543 shutdown_connections 2023-07-21T22:37:07.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.453+0000 7f416f234640 1 -- 172.21.15.6:0/4161624543 wait complete. 2023-07-21T22:37:07.519 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-21T22:37:07.519 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:37:07.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.621+0000 7f58e88c9640 1 Processor -- start 2023-07-21T22:37:07.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.621+0000 7f58e88c9640 1 -- start start 2023-07-21T22:37:07.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.621+0000 7f58e88c9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f58e40d13f0 0x7f58e40cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:07.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.621+0000 7f58e88c9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e40d0f60 con 0x7f58e415f3f0 2023-07-21T22:37:07.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.621+0000 7f58e88c9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e40d0390 con 0x7f58e40b7d90 2023-07-21T22:37:07.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.621+0000 7f58e88c9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e40d0630 con 0x7f58e40d13f0 2023-07-21T22:37:07.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.621+0000 7f58e2d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f58e415f3f0 0x7f58e40b7680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38624/0 (socket says 172.21.15.6:38624) 2023-07-21T22:37:07.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.621+0000 7f58e2d9d640 1 -- 172.21.15.6:0/2344181955 learned_addr learned my addr 172.21.15.6:0/2344181955 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:07.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.621+0000 7f58e359e640 1 --2- 172.21.15.6:0/2344181955 >> v2:172.21.15.6:3300/0 conn(0x7f58e40d13f0 0x7f58e40cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:07.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.621+0000 7f58e359e640 1 -- 172.21.15.6:0/2344181955 >> v1:172.21.15.161:6789/0 conn(0x7f58e40b7d90 legacy=0x7f58e40cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:07.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.621+0000 7f58e359e640 1 -- 172.21.15.6:0/2344181955 >> v1:172.21.15.6:6789/0 conn(0x7f58e415f3f0 legacy=0x7f58e40b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:07.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.621+0000 7f58e1d9b640 1 -- 172.21.15.6:0/2344181955 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976161348 0 0) 0x7f58e40d0390 con 0x7f58e40b7d90 2023-07-21T22:37:07.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.621+0000 7f58e359e640 1 -- 172.21.15.6:0/2344181955 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e40d0910 con 0x7f58e40d13f0 2023-07-21T22:37:07.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.625+0000 7f58e359e640 1 --2- 172.21.15.6:0/2344181955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58e40d13f0 0x7f58e40cd0b0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009d90 tx=0x7f58dc01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c8079b7bb781f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:07.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.625+0000 7f58e1d9b640 1 -- 172.21.15.6:0/2344181955 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc0a5800 con 0x7f58e40d13f0 2023-07-21T22:37:07.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.625+0000 7f58e1d9b640 1 -- 172.21.15.6:0/2344181955 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58dc0a5960 con 0x7f58e40d13f0 2023-07-21T22:37:07.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.625+0000 7f58e1d9b640 1 -- 172.21.15.6:0/2344181955 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc0a5cf0 con 0x7f58e40d13f0 2023-07-21T22:37:07.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.625+0000 7f58e88c9640 1 -- 172.21.15.6:0/2344181955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58e40d13f0 msgr2=0x7f58e40cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:07.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.625+0000 7f58e88c9640 1 --2- 172.21.15.6:0/2344181955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58e40d13f0 0x7f58e40cd0b0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f58dc009d90 tx=0x7f58dc01c8c0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.625+0000 7f58e88c9640 1 -- 172.21.15.6:0/2344181955 shutdown_connections 2023-07-21T22:37:07.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.625+0000 7f58e88c9640 1 --2- 172.21.15.6:0/2344181955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58e40d13f0 0x7f58e40cd0b0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.625+0000 7f58e88c9640 1 -- 172.21.15.6:0/2344181955 >> 172.21.15.6:0/2344181955 conn(0x7f58e4069f50 msgr2=0x7f58e406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:07.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.625+0000 7f58e88c9640 1 -- 172.21.15.6:0/2344181955 shutdown_connections 2023-07-21T22:37:07.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.625+0000 7f58e88c9640 1 -- 172.21.15.6:0/2344181955 wait complete. 2023-07-21T22:37:07.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.625+0000 7f58e88c9640 1 Processor -- start 2023-07-21T22:37:07.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e88c9640 1 -- start start 2023-07-21T22:37:07.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e88c9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58e40b7d90 0x7f58e4153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:07.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e88c9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58e40d13f0 0x7f58e415d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:07.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e88c9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58e415f3f0 0x7f58e415d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:07.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e88c9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e415cbb0 con 0x7f58e40d13f0 2023-07-21T22:37:07.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e88c9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e40b1170 con 0x7f58e40b7d90 2023-07-21T22:37:07.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e88c9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e40b1450 con 0x7f58e415f3f0 2023-07-21T22:37:07.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58e40d13f0 0x7f58e415d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:07.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e2d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58e40b7d90 0x7f58e4153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:07.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58e40d13f0 0x7f58e415d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55894/0 (socket says 172.21.15.6:55894) 2023-07-21T22:37:07.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e259c640 1 -- 172.21.15.6:0/2367215530 learned_addr learned my addr 172.21.15.6:0/2367215530 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:07.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e359e640 1 --2- 172.21.15.6:0/2367215530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58e415f3f0 0x7f58e415d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:07.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e259c640 1 -- 172.21.15.6:0/2367215530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58e415f3f0 msgr2=0x7f58e415d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:07.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e259c640 1 --2- 172.21.15.6:0/2367215530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58e415f3f0 0x7f58e415d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e259c640 1 -- 172.21.15.6:0/2367215530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58e40b7d90 msgr2=0x7f58e4153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:07.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e259c640 1 --2- 172.21.15.6:0/2367215530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58e40b7d90 0x7f58e4153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e259c640 1 -- 172.21.15.6:0/2367215530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc009a70 con 0x7f58e40d13f0 2023-07-21T22:37:07.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e259c640 1 --2- 172.21.15.6:0/2367215530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58e40d13f0 0x7f58e415d250 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f58d800c520 tx=0x7f58d800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:07.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58cb7fe640 1 -- 172.21.15.6:0/2367215530 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d8003600 con 0x7f58e40d13f0 2023-07-21T22:37:07.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58cb7fe640 1 -- 172.21.15.6:0/2367215530 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d8003780 con 0x7f58e40d13f0 2023-07-21T22:37:07.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58cb7fe640 1 -- 172.21.15.6:0/2367215530 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d8003b30 con 0x7f58e40d13f0 2023-07-21T22:37:07.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e88c9640 1 -- 172.21.15.6:0/2367215530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e40b1730 con 0x7f58e40d13f0 2023-07-21T22:37:07.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e88c9640 1 -- 172.21.15.6:0/2367215530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e40cc7f0 con 0x7f58e40d13f0 2023-07-21T22:37:07.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.629+0000 7f58e88c9640 1 -- 172.21.15.6:0/2367215530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e40678d0 con 0x7f58e40d13f0 2023-07-21T22:37:07.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.633+0000 7f58cb7fe640 1 -- 172.21.15.6:0/2367215530 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 48) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f58d8003c90 con 0x7f58e40d13f0 2023-07-21T22:37:07.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.633+0000 7f58cb7fe640 1 --2- 172.21.15.6:0/2367215530 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f58d00660d0 0x7f58d0068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:07.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.633+0000 7f58cb7fe640 1 -- 172.21.15.6:0/2367215530 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6996+0+0 (secure 0 0 0) 0x7f58d80833f0 con 0x7f58e40d13f0 2023-07-21T22:37:07.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.633+0000 7f58e2d9d640 1 --2- 172.21.15.6:0/2367215530 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f58d00660d0 0x7f58d0068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:07.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.633+0000 7f58e2d9d640 1 --2- 172.21.15.6:0/2367215530 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f58d00660d0 0x7f58d0068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f58e40cc0b0 tx=0x7f58d4007e90 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:07.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.637+0000 7f58cb7fe640 1 -- 172.21.15.6:0/2367215530 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f58d8050760 con 0x7f58e40d13f0 2023-07-21T22:37:07.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.825+0000 7f58e88c9640 1 -- 172.21.15.6:0/2367215530 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58e415ed20 con 0x7f58e40d13f0 2023-07-21T22:37:07.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.825+0000 7f58cb7fe640 1 -- 172.21.15.6:0/2367215530 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4667 (secure 0 0 0) 0x7f58d8053d80 con 0x7f58e40d13f0 2023-07-21T22:37:07.870 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:07.871 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6716,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/128364815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":128364815},{"type":"v1","addr":"172.21.15.161:6836","nonce":128364815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6719,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1447795142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1447795142},{"type":"v1","addr":"172.21.15.161:6837","nonce":1447795142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7653,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/921116259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":921116259},{"type":"v1","addr":"172.21.15.6:6833","nonce":921116259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:35:40.812228+0000","modified":"2023-07-21T22:35:44.851097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2789884551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2789884551},{"type":"v1","addr":"172.21.15.6:6835","nonce":2789884551}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-21T22:37:07.871 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 47 2023-07-21T22:37:07.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.825+0000 7f58e88c9640 1 -- 172.21.15.6:0/2367215530 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f58d00660d0 msgr2=0x7f58d0068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:07.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.825+0000 7f58e88c9640 1 --2- 172.21.15.6:0/2367215530 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f58d00660d0 0x7f58d0068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f58e40cc0b0 tx=0x7f58d4007e90 comp rx=0 tx=0).stop 2023-07-21T22:37:07.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.825+0000 7f58e88c9640 1 -- 172.21.15.6:0/2367215530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58e40d13f0 msgr2=0x7f58e415d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:07.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.825+0000 7f58e88c9640 1 --2- 172.21.15.6:0/2367215530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58e40d13f0 0x7f58e415d250 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f58d800c520 tx=0x7f58d800c9e0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.825+0000 7f58e88c9640 1 -- 172.21.15.6:0/2367215530 shutdown_connections 2023-07-21T22:37:07.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.825+0000 7f58e88c9640 1 --2- 172.21.15.6:0/2367215530 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f58d00660d0 0x7f58d0068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.825+0000 7f58e88c9640 1 --2- 172.21.15.6:0/2367215530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58e415f3f0 0x7f58e415d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.825+0000 7f58e88c9640 1 --2- 172.21.15.6:0/2367215530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58e40d13f0 0x7f58e415d250 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.825+0000 7f58e88c9640 1 --2- 172.21.15.6:0/2367215530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58e40b7d90 0x7f58e4153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:07.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.825+0000 7f58e88c9640 1 -- 172.21.15.6:0/2367215530 >> 172.21.15.6:0/2367215530 conn(0x7f58e4069f50 msgr2=0x7f58e415aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:07.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.825+0000 7f58e88c9640 1 -- 172.21.15.6:0/2367215530 shutdown_connections 2023-07-21T22:37:07.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.825+0000 7f58e88c9640 1 -- 172.21.15.6:0/2367215530 wait complete. 2023-07-21T22:37:07.891 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:37:08.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.993+0000 7f3cf4382640 1 Processor -- start 2023-07-21T22:37:08.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.993+0000 7f3cf4382640 1 -- start start 2023-07-21T22:37:08.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.993+0000 7f3cf4382640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cec0c9730 0x7f3cec1638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:08.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.993+0000 7f3cf4382640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cec0cc700 con 0x7f3cec0c8ad0 2023-07-21T22:37:08.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.993+0000 7f3cf4382640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cec0b0ff0 con 0x7f3cec158ce0 2023-07-21T22:37:08.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.993+0000 7f3cf4382640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec070c80 con 0x7f3cec0c9730 2023-07-21T22:37:08.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.993+0000 7f3cf191d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3cec0c8ad0 0x7f3cec0c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38640/0 (socket says 172.21.15.6:38640) 2023-07-21T22:37:08.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.993+0000 7f3cf191d640 1 -- 172.21.15.6:0/590874764 learned_addr learned my addr 172.21.15.6:0/590874764 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:08.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.993+0000 7f3cf291f640 1 --2- 172.21.15.6:0/590874764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cec0c9730 0x7f3cec1638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:08.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.993+0000 7f3cf111c640 1 -- 172.21.15.6:0/590874764 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4194987524 0 0) 0x7f3cec0cc700 con 0x7f3cec0c8ad0 2023-07-21T22:37:08.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.993+0000 7f3cf111c640 1 -- 172.21.15.6:0/590874764 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cd8003530 con 0x7f3cec0c8ad0 2023-07-21T22:37:08.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.993+0000 7f3cf111c640 1 -- 172.21.15.6:0/590874764 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596752381 0 0) 0x7f3cec0b0ff0 con 0x7f3cec158ce0 2023-07-21T22:37:08.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.993+0000 7f3cf111c640 1 -- 172.21.15.6:0/590874764 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cec0cc700 con 0x7f3cec158ce0 2023-07-21T22:37:08.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.993+0000 7f3cf291f640 1 -- 172.21.15.6:0/590874764 >> v1:172.21.15.161:6789/0 conn(0x7f3cec158ce0 legacy=0x7f3cec070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:08.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.993+0000 7f3cf291f640 1 -- 172.21.15.6:0/590874764 >> v1:172.21.15.6:6789/0 conn(0x7f3cec0c8ad0 legacy=0x7f3cec0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:08.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.993+0000 7f3cf291f640 1 -- 172.21.15.6:0/590874764 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec0cbdd0 con 0x7f3cec0c9730 2023-07-21T22:37:08.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.997+0000 7f3cf291f640 1 --2- 172.21.15.6:0/590874764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cec0c9730 0x7f3cec1638b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009dc0 tx=0x7f3ce401c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1a284c002eb62e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:08.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.997+0000 7f3cf111c640 1 -- 172.21.15.6:0/590874764 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40a57f0 con 0x7f3cec0c9730 2023-07-21T22:37:08.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.997+0000 7f3cf111c640 1 -- 172.21.15.6:0/590874764 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce40a5950 con 0x7f3cec0c9730 2023-07-21T22:37:08.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.997+0000 7f3cf111c640 1 -- 172.21.15.6:0/590874764 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40a5cc0 con 0x7f3cec0c9730 2023-07-21T22:37:08.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.997+0000 7f3cf4382640 1 -- 172.21.15.6:0/590874764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cec0c9730 msgr2=0x7f3cec1638b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:08.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:07.997+0000 7f3cf4382640 1 --2- 172.21.15.6:0/590874764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cec0c9730 0x7f3cec1638b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009dc0 tx=0x7f3ce401c820 comp rx=0 tx=0).stop 2023-07-21T22:37:08.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf4382640 1 -- 172.21.15.6:0/590874764 shutdown_connections 2023-07-21T22:37:08.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf4382640 1 --2- 172.21.15.6:0/590874764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cec0c9730 0x7f3cec1638b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf4382640 1 -- 172.21.15.6:0/590874764 >> 172.21.15.6:0/590874764 conn(0x7f3cec0afcf0 msgr2=0x7f3cec0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:08.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf4382640 1 -- 172.21.15.6:0/590874764 shutdown_connections 2023-07-21T22:37:08.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf4382640 1 -- 172.21.15.6:0/590874764 wait complete. 2023-07-21T22:37:08.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf4382640 1 Processor -- start 2023-07-21T22:37:08.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf4382640 1 -- start start 2023-07-21T22:37:08.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf4382640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cec0c8ad0 0x7f3cec0c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:08.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf4382640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cec0c9730 0x7f3cec159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:08.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf4382640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cec158ce0 0x7f3cec159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:08.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf4382640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec0b4190 con 0x7f3cec0c9730 2023-07-21T22:37:08.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf4382640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec159d80 con 0x7f3cec0c8ad0 2023-07-21T22:37:08.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf4382640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec0c4190 con 0x7f3cec158ce0 2023-07-21T22:37:08.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf191d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cec0c9730 0x7f3cec159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:08.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf191d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cec0c9730 0x7f3cec159300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55904/0 (socket says 172.21.15.6:55904) 2023-07-21T22:37:08.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf191d640 1 -- 172.21.15.6:0/3497577245 learned_addr learned my addr 172.21.15.6:0/3497577245 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:08.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf211e640 1 --2- 172.21.15.6:0/3497577245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cec0c8ad0 0x7f3cec0c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:08.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf291f640 1 --2- 172.21.15.6:0/3497577245 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cec158ce0 0x7f3cec159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:08.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf191d640 1 -- 172.21.15.6:0/3497577245 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cec158ce0 msgr2=0x7f3cec159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:08.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf191d640 1 --2- 172.21.15.6:0/3497577245 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cec158ce0 0x7f3cec159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf191d640 1 -- 172.21.15.6:0/3497577245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cec0c8ad0 msgr2=0x7f3cec0c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:08.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf191d640 1 --2- 172.21.15.6:0/3497577245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cec0c8ad0 0x7f3cec0c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.001+0000 7f3cf191d640 1 -- 172.21.15.6:0/3497577245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce4009a70 con 0x7f3cec0c9730 2023-07-21T22:37:08.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.005+0000 7f3cf191d640 1 --2- 172.21.15.6:0/3497577245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cec0c9730 0x7f3cec159300 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00c500 tx=0x7f3cdc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:08.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.005+0000 7f3ce2ffd640 1 -- 172.21.15.6:0/3497577245 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc005cf0 con 0x7f3cec0c9730 2023-07-21T22:37:08.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.005+0000 7f3ce2ffd640 1 -- 172.21.15.6:0/3497577245 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc005e50 con 0x7f3cec0c9730 2023-07-21T22:37:08.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.005+0000 7f3ce2ffd640 1 -- 172.21.15.6:0/3497577245 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc007330 con 0x7f3cec0c9730 2023-07-21T22:37:08.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.005+0000 7f3cf4382640 1 -- 172.21.15.6:0/3497577245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cec0b2980 con 0x7f3cec0c9730 2023-07-21T22:37:08.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.005+0000 7f3cf4382640 1 -- 172.21.15.6:0/3497577245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cec0b26a0 con 0x7f3cec0c9730 2023-07-21T22:37:08.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.005+0000 7f3cf4382640 1 -- 172.21.15.6:0/3497577245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cec0cbb60 con 0x7f3cec0c9730 2023-07-21T22:37:08.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.005+0000 7f3ce2ffd640 1 -- 172.21.15.6:0/3497577245 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3cdc007490 con 0x7f3cec0c9730 2023-07-21T22:37:08.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.005+0000 7f3ce2ffd640 1 --2- 172.21.15.6:0/3497577245 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f3cd00663a0 0x7f3cd0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:08.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.005+0000 7f3ce2ffd640 1 -- 172.21.15.6:0/3497577245 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6996+0+0 (secure 0 0 0) 0x7f3cdc0838d0 con 0x7f3cec0c9730 2023-07-21T22:37:08.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.005+0000 7f3cf211e640 1 --2- 172.21.15.6:0/3497577245 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f3cd00663a0 0x7f3cd0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:08.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.009+0000 7f3cf211e640 1 --2- 172.21.15.6:0/3497577245 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f3cd00663a0 0x7f3cd0068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80015e0 tx=0x7f3ce8009040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:08.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.009+0000 7f3ce2ffd640 1 -- 172.21.15.6:0/3497577245 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3cdc050880 con 0x7f3cec0c9730 2023-07-21T22:37:08.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.205+0000 7f3cf4382640 1 -- 172.21.15.6:0/3497577245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3cec0678d0 con 0x7f3cec0c9730 2023-07-21T22:37:08.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.205+0000 7f3ce2ffd640 1 -- 172.21.15.6:0/3497577245 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4667 (secure 0 0 0) 0x7f3cdc053ea0 con 0x7f3cec0c9730 2023-07-21T22:37:08.252 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:08.253 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6716,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/128364815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":128364815},{"type":"v1","addr":"172.21.15.161:6836","nonce":128364815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6719,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1447795142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1447795142},{"type":"v1","addr":"172.21.15.161:6837","nonce":1447795142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7653,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/921116259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":921116259},{"type":"v1","addr":"172.21.15.6:6833","nonce":921116259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:35:40.812228+0000","modified":"2023-07-21T22:35:44.851097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7662},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7662":{"gid":7662,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2789884551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2789884551},{"type":"v1","addr":"172.21.15.6:6835","nonce":2789884551}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-21T22:37:08.253 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 47 2023-07-21T22:37:08.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.209+0000 7f3cf4382640 1 -- 172.21.15.6:0/3497577245 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f3cd00663a0 msgr2=0x7f3cd0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:08.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.209+0000 7f3cf4382640 1 --2- 172.21.15.6:0/3497577245 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f3cd00663a0 0x7f3cd0068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80015e0 tx=0x7f3ce8009040 comp rx=0 tx=0).stop 2023-07-21T22:37:08.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.209+0000 7f3cf4382640 1 -- 172.21.15.6:0/3497577245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cec0c9730 msgr2=0x7f3cec159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:08.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.209+0000 7f3cf4382640 1 --2- 172.21.15.6:0/3497577245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cec0c9730 0x7f3cec159300 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00c500 tx=0x7f3cdc00c9c0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.209+0000 7f3cf4382640 1 -- 172.21.15.6:0/3497577245 shutdown_connections 2023-07-21T22:37:08.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.209+0000 7f3cf4382640 1 --2- 172.21.15.6:0/3497577245 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f3cd00663a0 0x7f3cd0068850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.209+0000 7f3cf4382640 1 --2- 172.21.15.6:0/3497577245 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cec158ce0 0x7f3cec159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.209+0000 7f3cf4382640 1 --2- 172.21.15.6:0/3497577245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cec0c9730 0x7f3cec159300 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.209+0000 7f3cf4382640 1 --2- 172.21.15.6:0/3497577245 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cec0c8ad0 0x7f3cec0c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.209+0000 7f3cf4382640 1 -- 172.21.15.6:0/3497577245 >> 172.21.15.6:0/3497577245 conn(0x7f3cec0afcf0 msgr2=0x7f3cec0cea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:08.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.209+0000 7f3cf4382640 1 -- 172.21.15.6:0/3497577245 shutdown_connections 2023-07-21T22:37:08.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.209+0000 7f3cf4382640 1 -- 172.21.15.6:0/3497577245 wait complete. 2023-07-21T22:37:08.273 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:37:08.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.373+0000 7fa27fc93640 1 Processor -- start 2023-07-21T22:37:08.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.373+0000 7fa27fc93640 1 -- start start 2023-07-21T22:37:08.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.373+0000 7fa27fc93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa278158ce0 0x7fa278070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:08.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.373+0000 7fa27fc93640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa2780c9730 0x7fa2780ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:08.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.373+0000 7fa27fc93640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2780cc700 con 0x7fa2780c8ad0 2023-07-21T22:37:08.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.373+0000 7fa27fc93640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2780b0ff0 con 0x7fa2780c9730 2023-07-21T22:37:08.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.373+0000 7fa27fc93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa278070c80 con 0x7fa278158ce0 2023-07-21T22:37:08.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.373+0000 7fa27da2f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa278158ce0 0x7fa278070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:08.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.373+0000 7fa27da2f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa278158ce0 0x7fa278070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:59806/0 (socket says 172.21.15.6:59806) 2023-07-21T22:37:08.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.373+0000 7fa27da2f640 1 -- 172.21.15.6:0/856280 learned_addr learned my addr 172.21.15.6:0/856280 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:08.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.373+0000 7fa27d22e640 1 --1- 172.21.15.6:0/856280 >> v1:172.21.15.161:6789/0 conn(0x7fa2780c8ad0 0x7fa2780c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:55298/0 (socket says 172.21.15.6:55298) 2023-07-21T22:37:08.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.373+0000 7fa27e230640 1 --2- 172.21.15.6:0/856280 >> v2:172.21.15.161:3300/0 conn(0x7fa2780c9730 0x7fa2780ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:08.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.373+0000 7fa27da2f640 1 -- 172.21.15.6:0/856280 >> v2:172.21.15.161:3300/0 conn(0x7fa2780c9730 msgr2=0x7fa2780ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:08.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.373+0000 7fa27da2f640 1 --2- 172.21.15.6:0/856280 >> v2:172.21.15.161:3300/0 conn(0x7fa2780c9730 0x7fa2780ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.373+0000 7fa27da2f640 1 -- 172.21.15.6:0/856280 >> v1:172.21.15.161:6789/0 conn(0x7fa2780c8ad0 legacy=0x7fa2780c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:08.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.373+0000 7fa27da2f640 1 -- 172.21.15.6:0/856280 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2780cbdd0 con 0x7fa278158ce0 2023-07-21T22:37:08.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.377+0000 7fa27da2f640 1 --2- 172.21.15.6:0/856280 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa278158ce0 0x7fa278070450 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa274009870 tx=0x7fa27401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ecc4f8773c3c219 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:08.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.377+0000 7fa27ca2d640 1 -- 172.21.15.6:0/856280 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2740ab600 con 0x7fa278158ce0 2023-07-21T22:37:08.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.377+0000 7fa27ca2d640 1 -- 172.21.15.6:0/856280 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2740a7050 con 0x7fa278158ce0 2023-07-21T22:37:08.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.377+0000 7fa27ca2d640 1 -- 172.21.15.6:0/856280 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2740ab980 con 0x7fa278158ce0 2023-07-21T22:37:08.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.377+0000 7fa27fc93640 1 -- 172.21.15.6:0/856280 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa278158ce0 msgr2=0x7fa278070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:08.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.377+0000 7fa27fc93640 1 --2- 172.21.15.6:0/856280 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa278158ce0 0x7fa278070450 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa274009870 tx=0x7fa27401c3f0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.377+0000 7fa27fc93640 1 -- 172.21.15.6:0/856280 shutdown_connections 2023-07-21T22:37:08.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.377+0000 7fa27fc93640 1 --2- 172.21.15.6:0/856280 >> v2:172.21.15.161:3300/0 conn(0x7fa2780c9730 0x7fa2780ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.377+0000 7fa27fc93640 1 --2- 172.21.15.6:0/856280 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa278158ce0 0x7fa278070450 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.377+0000 7fa27fc93640 1 -- 172.21.15.6:0/856280 >> 172.21.15.6:0/856280 conn(0x7fa2780afcf0 msgr2=0x7fa2780b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:08.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.377+0000 7fa27fc93640 1 -- 172.21.15.6:0/856280 shutdown_connections 2023-07-21T22:37:08.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.377+0000 7fa27fc93640 1 -- 172.21.15.6:0/856280 wait complete. 2023-07-21T22:37:08.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27fc93640 1 Processor -- start 2023-07-21T22:37:08.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27fc93640 1 -- start start 2023-07-21T22:37:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27fc93640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2780c8ad0 0x7fa2780b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27fc93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2780c9730 0x7fa2781494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27fc93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa278158ce0 0x7fa278150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27fc93640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2780c5230 con 0x7fa2780c9730 2023-07-21T22:37:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27fc93640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2780c6090 con 0x7fa2780c8ad0 2023-07-21T22:37:08.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27fc93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2780c5480 con 0x7fa278158ce0 2023-07-21T22:37:08.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27d22e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2780c9730 0x7fa2781494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:08.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27d22e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2780c9730 0x7fa2781494d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55918/0 (socket says 172.21.15.6:55918) 2023-07-21T22:37:08.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27d22e640 1 -- 172.21.15.6:0/2034230850 learned_addr learned my addr 172.21.15.6:0/2034230850 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:08.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27da2f640 1 --2- 172.21.15.6:0/2034230850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2780c8ad0 0x7fa2780b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:08.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27e230640 1 --2- 172.21.15.6:0/2034230850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa278158ce0 0x7fa278150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:08.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27d22e640 1 -- 172.21.15.6:0/2034230850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa278158ce0 msgr2=0x7fa278150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:08.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27d22e640 1 --2- 172.21.15.6:0/2034230850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa278158ce0 0x7fa278150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27d22e640 1 -- 172.21.15.6:0/2034230850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2780c8ad0 msgr2=0x7fa2780b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:08.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27d22e640 1 --2- 172.21.15.6:0/2034230850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2780c8ad0 0x7fa2780b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27d22e640 1 -- 172.21.15.6:0/2034230850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2740094d0 con 0x7fa2780c9730 2023-07-21T22:37:08.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27d22e640 1 --2- 172.21.15.6:0/2034230850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2780c9730 0x7fa2781494d0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fa26800c450 tx=0x7fa26800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:08.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa26e7fc640 1 -- 172.21.15.6:0/2034230850 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa268007480 con 0x7fa2780c9730 2023-07-21T22:37:08.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa26e7fc640 1 -- 172.21.15.6:0/2034230850 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2680075e0 con 0x7fa2780c9730 2023-07-21T22:37:08.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa26e7fc640 1 -- 172.21.15.6:0/2034230850 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa268004a30 con 0x7fa2780c9730 2023-07-21T22:37:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27fc93640 1 -- 172.21.15.6:0/2034230850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2780c5760 con 0x7fa2780c9730 2023-07-21T22:37:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.381+0000 7fa27fc93640 1 -- 172.21.15.6:0/2034230850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2780c5d20 con 0x7fa2780c9730 2023-07-21T22:37:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.385+0000 7fa27fc93640 1 -- 172.21.15.6:0/2034230850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2780ca1a0 con 0x7fa2780c9730 2023-07-21T22:37:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.385+0000 7fa26e7fc640 1 -- 172.21.15.6:0/2034230850 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa268004b90 con 0x7fa2780c9730 2023-07-21T22:37:08.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.385+0000 7fa26e7fc640 1 --2- 172.21.15.6:0/2034230850 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fa25c0663a0 0x7fa25c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:08.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.385+0000 7fa26e7fc640 1 -- 172.21.15.6:0/2034230850 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6996+0+0 (secure 0 0 0) 0x7fa268083250 con 0x7fa2780c9730 2023-07-21T22:37:08.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.385+0000 7fa27da2f640 1 --2- 172.21.15.6:0/2034230850 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fa25c0663a0 0x7fa25c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.385+0000 7fa27da2f640 1 --2- 172.21.15.6:0/2034230850 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fa25c0663a0 0x7fa25c068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa2740ad000 tx=0x7fa2740a4f90 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:08.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.389+0000 7fa26e7fc640 1 -- 172.21.15.6:0/2034230850 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa268050240 con 0x7fa2780c9730 2023-07-21T22:37:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.549+0000 7fa27fc93640 1 -- 172.21.15.6:0/2034230850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2780678d0 con 0x7fa2780c9730 2023-07-21T22:37:08.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.549+0000 7fa26e7fc640 1 -- 172.21.15.6:0/2034230850 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+19638 (secure 0 0 0) 0x7fa268053860 con 0x7fa2780c9730 2023-07-21T22:37:08.596 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:08.597 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":116,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:37:05.693465+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:35:38.932763+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-21T22:35:39.805137+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2","mappings":[{"from":1,"to":7}]},{"pgid":"14.a","mappings":[{"from":1,"to":7}]},{"pgid":"14.18","mappings":[{"from":1,"to":5}]},{"pgid":"14.31","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/2049802965":"2023-07-22T22:37:05.693410+0000","172.21.15.161:0/1536867018":"2023-07-22T22:37:05.693410+0000","172.21.15.161:6833/1474634903":"2023-07-22T22:37:05.693410+0000","172.21.15.161:6832/1474634903":"2023-07-22T22:37:05.693410+0000","172.21.15.161:0/2406446162":"2023-07-22T22:37:05.693410+0000","172.21.15.161:0/3803331105":"2023-07-22T22:37:05.693410+0000","172.21.15.161:0/3642970140":"2023-07-22T22:37:05.693410+0000","172.21.15.161:0/3239365888":"2023-07-22T22:37:05.693410+0000","172.21.15.161:6833/3891612664":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/2615083836":"2023-07-22T22:37:05.693410+0000","172.21.15.161:6832/3891612664":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/2035498467":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/4102091229":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/1144695770":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/220067520":"2023-07-22T22:37:05.693410+0000","172.21.15.161:0/2493427911":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/3550191976":"2023-07-22T22:35:58.832528+0000","172.21.15.161:0/253243953":"2023-07-22T22:35:58.832528+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:37:08.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.553+0000 7fa27fc93640 1 -- 172.21.15.6:0/2034230850 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fa25c0663a0 msgr2=0x7fa25c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:08.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.553+0000 7fa27fc93640 1 --2- 172.21.15.6:0/2034230850 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fa25c0663a0 0x7fa25c068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa2740ad000 tx=0x7fa2740a4f90 comp rx=0 tx=0).stop 2023-07-21T22:37:08.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.553+0000 7fa27fc93640 1 -- 172.21.15.6:0/2034230850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2780c9730 msgr2=0x7fa2781494d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:08.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.553+0000 7fa27fc93640 1 --2- 172.21.15.6:0/2034230850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2780c9730 0x7fa2781494d0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fa26800c450 tx=0x7fa26800c910 comp rx=0 tx=0).stop 2023-07-21T22:37:08.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.553+0000 7fa27fc93640 1 -- 172.21.15.6:0/2034230850 shutdown_connections 2023-07-21T22:37:08.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.553+0000 7fa27fc93640 1 --2- 172.21.15.6:0/2034230850 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fa25c0663a0 0x7fa25c068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.553+0000 7fa27fc93640 1 --2- 172.21.15.6:0/2034230850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa278158ce0 0x7fa278150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.553+0000 7fa27fc93640 1 --2- 172.21.15.6:0/2034230850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2780c9730 0x7fa2781494d0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.553+0000 7fa27fc93640 1 --2- 172.21.15.6:0/2034230850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2780c8ad0 0x7fa2780b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.553+0000 7fa27fc93640 1 -- 172.21.15.6:0/2034230850 >> 172.21.15.6:0/2034230850 conn(0x7fa2780afcf0 msgr2=0x7fa278155b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.553+0000 7fa27fc93640 1 -- 172.21.15.6:0/2034230850 shutdown_connections 2023-07-21T22:37:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.553+0000 7fa27fc93640 1 -- 172.21.15.6:0/2034230850 wait complete. 2023-07-21T22:37:08.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-21T22:37:08.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.717+0000 7f8715f74640 1 Processor -- start 2023-07-21T22:37:08.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.717+0000 7f8715f74640 1 -- start start 2023-07-21T22:37:08.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.721+0000 7f8715f74640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f871015f500 0x7f871006cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:08.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.721+0000 7f8715f74640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f871006d430 0x7f871006a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:08.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.721+0000 7f8715f74640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f871006aa80 0x7f87100b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:08.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.721+0000 7f8715f74640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871006af20 con 0x7f871006d430 2023-07-21T22:37:08.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.721+0000 7f8715f74640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87100cdc80 con 0x7f871006aa80 2023-07-21T22:37:08.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.721+0000 7f8715f74640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871006e4c0 con 0x7f871015f500 2023-07-21T22:37:08.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.721+0000 7f870effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f871006d430 0x7f871006a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:08.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.721+0000 7f870effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f871006d430 0x7f871006a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55932/0 (socket says 172.21.15.6:55932) 2023-07-21T22:37:08.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.721+0000 7f870effd640 1 -- 172.21.15.6:0/110896294 learned_addr learned my addr 172.21.15.6:0/110896294 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:08.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.721+0000 7f870ffff640 1 --2- 172.21.15.6:0/110896294 >> v2:172.21.15.161:3300/0 conn(0x7f871006aa80 0x7f87100b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:08.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.721+0000 7f870f7fe640 1 --2- 172.21.15.6:0/110896294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f871015f500 0x7f871006cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:08.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.721+0000 7f870effd640 1 -- 172.21.15.6:0/110896294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f871015f500 msgr2=0x7f871006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:08.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.721+0000 7f870effd640 1 --2- 172.21.15.6:0/110896294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f871015f500 0x7f871006cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.721+0000 7f870effd640 1 -- 172.21.15.6:0/110896294 >> v2:172.21.15.161:3300/0 conn(0x7f871006aa80 msgr2=0x7f87100b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:08.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.721+0000 7f870effd640 1 --2- 172.21.15.6:0/110896294 >> v2:172.21.15.161:3300/0 conn(0x7f871006aa80 0x7f87100b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.721+0000 7f870effd640 1 -- 172.21.15.6:0/110896294 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871006d940 con 0x7f871006d430 2023-07-21T22:37:08.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.721+0000 7f870effd640 1 --2- 172.21.15.6:0/110896294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f871006d430 0x7f871006a540 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f87100713b0 tx=0x7f870401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2fa83a34dca3113 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:08.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f870e7fc640 1 -- 172.21.15.6:0/110896294 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87040ab600 con 0x7f871006d430 2023-07-21T22:37:08.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f870e7fc640 1 -- 172.21.15.6:0/110896294 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87040a7050 con 0x7f871006d430 2023-07-21T22:37:08.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f870e7fc640 1 -- 172.21.15.6:0/110896294 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87040ab980 con 0x7f871006d430 2023-07-21T22:37:08.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f8715f74640 1 -- 172.21.15.6:0/110896294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f871006d430 msgr2=0x7f871006a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:08.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f8715f74640 1 --2- 172.21.15.6:0/110896294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f871006d430 0x7f871006a540 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f87100713b0 tx=0x7f870401c240 comp rx=0 tx=0).stop 2023-07-21T22:37:08.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f8715f74640 1 -- 172.21.15.6:0/110896294 shutdown_connections 2023-07-21T22:37:08.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f8715f74640 1 --2- 172.21.15.6:0/110896294 >> v2:172.21.15.161:3300/0 conn(0x7f871006aa80 0x7f87100b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f8715f74640 1 --2- 172.21.15.6:0/110896294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f871006d430 0x7f871006a540 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f8715f74640 1 --2- 172.21.15.6:0/110896294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f871015f500 0x7f871006cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f8715f74640 1 -- 172.21.15.6:0/110896294 >> 172.21.15.6:0/110896294 conn(0x7f87100659d0 msgr2=0x7f8710099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f8715f74640 1 -- 172.21.15.6:0/110896294 shutdown_connections 2023-07-21T22:37:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f8715f74640 1 -- 172.21.15.6:0/110896294 wait complete. 2023-07-21T22:37:08.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f8715f74640 1 Processor -- start 2023-07-21T22:37:08.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f8715f74640 1 -- start start 2023-07-21T22:37:08.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f8715f74640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f871006aa80 0x7f87100cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:08.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f8715f74640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f871006d430 0x7f87101665e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:08.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f8715f74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f871015f500 0x7f87100cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:08.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f8715f74640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871015ae80 con 0x7f871015f500 2023-07-21T22:37:08.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f8715f74640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871015a950 con 0x7f871006aa80 2023-07-21T22:37:08.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f8715f74640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8710166b20 con 0x7f871006d430 2023-07-21T22:37:08.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f870ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f871015f500 0x7f87100cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:08.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f870ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f871015f500 0x7f87100cb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55946/0 (socket says 172.21.15.6:55946) 2023-07-21T22:37:08.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.725+0000 7f870ffff640 1 -- 172.21.15.6:0/3010883560 learned_addr learned my addr 172.21.15.6:0/3010883560 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:08.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.729+0000 7f870effd640 1 --2- 172.21.15.6:0/3010883560 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f871006d430 0x7f87101665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:08.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.729+0000 7f870f7fe640 1 --2- 172.21.15.6:0/3010883560 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f871006aa80 0x7f87100cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:08.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.729+0000 7f870ffff640 1 -- 172.21.15.6:0/3010883560 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f871006d430 msgr2=0x7f87101665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:08.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.729+0000 7f870ffff640 1 --2- 172.21.15.6:0/3010883560 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f871006d430 0x7f87101665e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.729+0000 7f870ffff640 1 -- 172.21.15.6:0/3010883560 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f871006aa80 msgr2=0x7f87100cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:08.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.729+0000 7f870ffff640 1 --2- 172.21.15.6:0/3010883560 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f871006aa80 0x7f87100cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.729+0000 7f870ffff640 1 -- 172.21.15.6:0/3010883560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87040094d0 con 0x7f871015f500 2023-07-21T22:37:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.729+0000 7f870ffff640 1 --2- 172.21.15.6:0/3010883560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f871015f500 0x7f87100cb0c0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f8708007e60 tx=0x7f870800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.729+0000 7f86f7fff640 1 -- 172.21.15.6:0/3010883560 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8708014620 con 0x7f871015f500 2023-07-21T22:37:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.729+0000 7f86f7fff640 1 -- 172.21.15.6:0/3010883560 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f870800ee90 con 0x7f871015f500 2023-07-21T22:37:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.729+0000 7f8715f74640 1 -- 172.21.15.6:0/3010883560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871015aba0 con 0x7f871015f500 2023-07-21T22:37:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.729+0000 7f86f7fff640 1 -- 172.21.15.6:0/3010883560 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87080149e0 con 0x7f871015f500 2023-07-21T22:37:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.729+0000 7f8715f74640 1 -- 172.21.15.6:0/3010883560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8710159f00 con 0x7f871015f500 2023-07-21T22:37:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.729+0000 7f8715f74640 1 -- 172.21.15.6:0/3010883560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8710159a80 con 0x7f871015f500 2023-07-21T22:37:08.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.729+0000 7f86f7fff640 1 -- 172.21.15.6:0/3010883560 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8708014b40 con 0x7f871015f500 2023-07-21T22:37:08.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.729+0000 7f86f7fff640 1 --2- 172.21.15.6:0/3010883560 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f86fc0663a0 0x7f86fc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:08.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.729+0000 7f86f7fff640 1 -- 172.21.15.6:0/3010883560 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6996+0+0 (secure 0 0 0) 0x7f8708084a90 con 0x7f871015f500 2023-07-21T22:37:08.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.733+0000 7f870f7fe640 1 --2- 172.21.15.6:0/3010883560 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f86fc0663a0 0x7f86fc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:08.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.733+0000 7f870f7fe640 1 --2- 172.21.15.6:0/3010883560 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f86fc0663a0 0x7f86fc068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f87100c6f10 tx=0x7f8700008040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:08.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.733+0000 7f86f7fff640 1 -- 172.21.15.6:0/3010883560 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8710159a80 con 0x7f871015f500 2023-07-21T22:37:08.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.925+0000 7f8715f74640 1 -- 172.21.15.6:0/3010883560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8710159a80 con 0x7f871015f500 2023-07-21T22:37:08.971 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-07-21T22:37:08.925+0000 7f195e836640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-21T22:37:08.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.933+0000 7f86f7fff640 1 -- 172.21.15.6:0/3010883560 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8710159a80 con 0x7f871015f500 2023-07-21T22:37:08.977 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-21T22:37:08.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.933+0000 7f8715f74640 1 -- 172.21.15.6:0/3010883560 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f86fc0663a0 msgr2=0x7f86fc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:08.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.933+0000 7f8715f74640 1 --2- 172.21.15.6:0/3010883560 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f86fc0663a0 0x7f86fc068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f87100c6f10 tx=0x7f8700008040 comp rx=0 tx=0).stop 2023-07-21T22:37:08.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.933+0000 7f8715f74640 1 -- 172.21.15.6:0/3010883560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f871015f500 msgr2=0x7f87100cb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:08.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.933+0000 7f8715f74640 1 --2- 172.21.15.6:0/3010883560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f871015f500 0x7f87100cb0c0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f8708007e60 tx=0x7f870800e4b0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.933+0000 7f8715f74640 1 -- 172.21.15.6:0/3010883560 shutdown_connections 2023-07-21T22:37:08.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.933+0000 7f8715f74640 1 --2- 172.21.15.6:0/3010883560 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f86fc0663a0 0x7f86fc068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.933+0000 7f8715f74640 1 --2- 172.21.15.6:0/3010883560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f871015f500 0x7f87100cb0c0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.933+0000 7f8715f74640 1 --2- 172.21.15.6:0/3010883560 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f871006d430 0x7f87101665e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.933+0000 7f8715f74640 1 --2- 172.21.15.6:0/3010883560 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f871006aa80 0x7f87100cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:08.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.933+0000 7f8715f74640 1 -- 172.21.15.6:0/3010883560 >> 172.21.15.6:0/3010883560 conn(0x7f87100659d0 msgr2=0x7f8710157cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:08.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.933+0000 7f8715f74640 1 -- 172.21.15.6:0/3010883560 shutdown_connections 2023-07-21T22:37:08.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:08.933+0000 7f8715f74640 1 -- 172.21.15.6:0/3010883560 wait complete. 2023-07-21T22:37:08.989 INFO:tasks.ceph.mds.c.smithi006.stderr: -7628> 2023-07-21T22:35:46.394+0000 7ff0ae420640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:37:09.000 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-21T22:37:09.043 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-21T22:37:09.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.105+0000 7fb264fc5640 1 Processor -- start 2023-07-21T22:37:09.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.105+0000 7fb264fc5640 1 -- start start 2023-07-21T22:37:09.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.105+0000 7fb264fc5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2600ce620 0x7fb2600ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:09.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.105+0000 7fb264fc5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb26006e700 0x7fb26006c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:09.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.105+0000 7fb264fc5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2600c6140 con 0x7fb26015c050 2023-07-21T22:37:09.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.105+0000 7fb264fc5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26006c3f0 con 0x7fb26006e700 2023-07-21T22:37:09.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.105+0000 7fb264fc5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600cef30 con 0x7fb2600ce620 2023-07-21T22:37:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.105+0000 7fb257fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb26015c050 0x7fb26015f9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38652/0 (socket says 172.21.15.6:38652) 2023-07-21T22:37:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.105+0000 7fb257fff640 1 -- 172.21.15.6:0/1804436184 learned_addr learned my addr 172.21.15.6:0/1804436184 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.105+0000 7fb25ed9d640 1 --2- 172.21.15.6:0/1804436184 >> v2:172.21.15.6:3300/0 conn(0x7fb26006e700 0x7fb26006c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.105+0000 7fb25e59c640 1 --2- 172.21.15.6:0/1804436184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2600ce620 0x7fb2600ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.105+0000 7fb25dd9b640 1 -- 172.21.15.6:0/1804436184 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026572427 0 0) 0x7fb2600c6140 con 0x7fb26015c050 2023-07-21T22:37:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.105+0000 7fb25ed9d640 1 -- 172.21.15.6:0/1804436184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2600ce620 msgr2=0x7fb2600ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.105+0000 7fb25ed9d640 1 --2- 172.21.15.6:0/1804436184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2600ce620 0x7fb2600ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:09.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.105+0000 7fb25ed9d640 1 -- 172.21.15.6:0/1804436184 >> v1:172.21.15.6:6789/0 conn(0x7fb26015c050 legacy=0x7fb26015f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:09.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.105+0000 7fb25ed9d640 1 -- 172.21.15.6:0/1804436184 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26006dab0 con 0x7fb26006e700 2023-07-21T22:37:09.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.109+0000 7fb25ed9d640 1 --2- 172.21.15.6:0/1804436184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26006e700 0x7fb26006c840 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fb258009d90 tx=0x7fb25801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a79ef666cc1fa1f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:09.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.109+0000 7fb25dd9b640 1 -- 172.21.15.6:0/1804436184 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2580a58f0 con 0x7fb26006e700 2023-07-21T22:37:09.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.109+0000 7fb25dd9b640 1 -- 172.21.15.6:0/1804436184 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2580a5a50 con 0x7fb26006e700 2023-07-21T22:37:09.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.109+0000 7fb25dd9b640 1 -- 172.21.15.6:0/1804436184 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2580a5de0 con 0x7fb26006e700 2023-07-21T22:37:09.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.109+0000 7fb264fc5640 1 -- 172.21.15.6:0/1804436184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26006e700 msgr2=0x7fb26006c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:09.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.109+0000 7fb264fc5640 1 --2- 172.21.15.6:0/1804436184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26006e700 0x7fb26006c840 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fb258009d90 tx=0x7fb25801c920 comp rx=0 tx=0).stop 2023-07-21T22:37:09.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.109+0000 7fb264fc5640 1 -- 172.21.15.6:0/1804436184 shutdown_connections 2023-07-21T22:37:09.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.109+0000 7fb264fc5640 1 --2- 172.21.15.6:0/1804436184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26006e700 0x7fb26006c840 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:09.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.109+0000 7fb264fc5640 1 --2- 172.21.15.6:0/1804436184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2600ce620 0x7fb2600ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:09.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.109+0000 7fb264fc5640 1 -- 172.21.15.6:0/1804436184 >> 172.21.15.6:0/1804436184 conn(0x7fb2600cc9a0 msgr2=0x7fb2600cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:09.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.109+0000 7fb264fc5640 1 -- 172.21.15.6:0/1804436184 shutdown_connections 2023-07-21T22:37:09.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.109+0000 7fb264fc5640 1 -- 172.21.15.6:0/1804436184 wait complete. 2023-07-21T22:37:09.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb264fc5640 1 Processor -- start 2023-07-21T22:37:09.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb264fc5640 1 -- start start 2023-07-21T22:37:09.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb264fc5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb26006e700 0x7fb260146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:09.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb264fc5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2600ce620 0x7fb26015c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:09.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb264fc5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26015c050 0x7fb2600c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:09.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb264fc5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600ae270 con 0x7fb26015c050 2023-07-21T22:37:09.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb264fc5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600c49c0 con 0x7fb26006e700 2023-07-21T22:37:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb264fc5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600ae4c0 con 0x7fb2600ce620 2023-07-21T22:37:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb25ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26015c050 0x7fb2600c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb25ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26015c050 0x7fb2600c4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55970/0 (socket says 172.21.15.6:55970) 2023-07-21T22:37:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb25ed9d640 1 -- 172.21.15.6:0/1655070361 learned_addr learned my addr 172.21.15.6:0/1655070361 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb25e59c640 1 --2- 172.21.15.6:0/1655070361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb26006e700 0x7fb260146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb257fff640 1 --2- 172.21.15.6:0/1655070361 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2600ce620 0x7fb26015c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:09.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb25ed9d640 1 -- 172.21.15.6:0/1655070361 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2600ce620 msgr2=0x7fb26015c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:09.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb25ed9d640 1 --2- 172.21.15.6:0/1655070361 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2600ce620 0x7fb26015c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:09.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb25ed9d640 1 -- 172.21.15.6:0/1655070361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb26006e700 msgr2=0x7fb260146620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:09.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb25ed9d640 1 --2- 172.21.15.6:0/1655070361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb26006e700 0x7fb260146620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:09.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb25ed9d640 1 -- 172.21.15.6:0/1655070361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb258009a70 con 0x7fb26015c050 2023-07-21T22:37:09.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb25ed9d640 1 --2- 172.21.15.6:0/1655070361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26015c050 0x7fb2600c4e50 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fb2580b0040 tx=0x7fb2580196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:09.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb256ffd640 1 -- 172.21.15.6:0/1655070361 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2580b9860 con 0x7fb26015c050 2023-07-21T22:37:09.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb256ffd640 1 -- 172.21.15.6:0/1655070361 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2580b99c0 con 0x7fb26015c050 2023-07-21T22:37:09.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb264fc5640 1 -- 172.21.15.6:0/1655070361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2600ae7a0 con 0x7fb26015c050 2023-07-21T22:37:09.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb256ffd640 1 -- 172.21.15.6:0/1655070361 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2580b9d50 con 0x7fb26015c050 2023-07-21T22:37:09.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.113+0000 7fb264fc5640 1 -- 172.21.15.6:0/1655070361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb260146b60 con 0x7fb26015c050 2023-07-21T22:37:09.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.117+0000 7fb264fc5640 1 -- 172.21.15.6:0/1655070361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2600c47f0 con 0x7fb26015c050 2023-07-21T22:37:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.117+0000 7fb256ffd640 1 -- 172.21.15.6:0/1655070361 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb2580ad440 con 0x7fb26015c050 2023-07-21T22:37:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.117+0000 7fb256ffd640 1 --2- 172.21.15.6:0/1655070361 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fb2400663a0 0x7fb240068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.117+0000 7fb256ffd640 1 -- 172.21.15.6:0/1655070361 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 7082+0+0 (secure 0 0 0) 0x7fb25811f530 con 0x7fb26015c050 2023-07-21T22:37:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.117+0000 7fb25e59c640 1 --2- 172.21.15.6:0/1655070361 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fb2400663a0 0x7fb240068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:09.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.117+0000 7fb25e59c640 1 --2- 172.21.15.6:0/1655070361 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fb2400663a0 0x7fb240068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb250009b60 tx=0x7fb250009190 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:09.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.121+0000 7fb256ffd640 1 -- 172.21.15.6:0/1655070361 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb2580ec540 con 0x7fb26015c050 2023-07-21T22:37:09.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.309+0000 7fb264fc5640 1 -- 172.21.15.6:0/1655070361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb2600678d0 con 0x7fb26015c050 2023-07-21T22:37:10.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.993+0000 7fb256ffd640 1 -- 172.21.15.6:0/1655070361 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb2580efb60 con 0x7fb26015c050 2023-07-21T22:37:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.993+0000 7fb264fc5640 1 -- 172.21.15.6:0/1655070361 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fb2400663a0 msgr2=0x7fb240068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.993+0000 7fb264fc5640 1 --2- 172.21.15.6:0/1655070361 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fb2400663a0 0x7fb240068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb250009b60 tx=0x7fb250009190 comp rx=0 tx=0).stop 2023-07-21T22:37:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.993+0000 7fb264fc5640 1 -- 172.21.15.6:0/1655070361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26015c050 msgr2=0x7fb2600c4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.993+0000 7fb264fc5640 1 --2- 172.21.15.6:0/1655070361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26015c050 0x7fb2600c4e50 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fb2580b0040 tx=0x7fb2580196c0 comp rx=0 tx=0).stop 2023-07-21T22:37:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.993+0000 7fb264fc5640 1 -- 172.21.15.6:0/1655070361 shutdown_connections 2023-07-21T22:37:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.993+0000 7fb264fc5640 1 --2- 172.21.15.6:0/1655070361 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fb2400663a0 0x7fb240068850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.993+0000 7fb264fc5640 1 --2- 172.21.15.6:0/1655070361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb26015c050 0x7fb2600c4e50 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.993+0000 7fb264fc5640 1 --2- 172.21.15.6:0/1655070361 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2600ce620 0x7fb26015c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.993+0000 7fb264fc5640 1 --2- 172.21.15.6:0/1655070361 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb26006e700 0x7fb260146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.993+0000 7fb264fc5640 1 -- 172.21.15.6:0/1655070361 >> 172.21.15.6:0/1655070361 conn(0x7fb2600cc9a0 msgr2=0x7fb26015f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.993+0000 7fb264fc5640 1 -- 172.21.15.6:0/1655070361 shutdown_connections 2023-07-21T22:37:10.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:09.993+0000 7fb264fc5640 1 -- 172.21.15.6:0/1655070361 wait complete. 2023-07-21T22:37:10.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-21T22:37:10.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.213+0000 7f7fdb20b640 1 Processor -- start 2023-07-21T22:37:10.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.213+0000 7f7fdb20b640 1 -- start start 2023-07-21T22:37:10.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.213+0000 7f7fdb20b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7fd4069430 0x7f7fd4069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:10.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.213+0000 7f7fdb20b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7fd4070f30 0x7f7fd40ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:10.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.213+0000 7f7fdb20b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7fd40af2b0 0x7f7fd415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.213+0000 7f7fdb20b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd4159d70 con 0x7f7fd40af2b0 2023-07-21T22:37:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.213+0000 7f7fdb20b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd4069d40 con 0x7f7fd4069430 2023-07-21T22:37:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.213+0000 7f7fdb20b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd40c9c60 con 0x7f7fd4070f30 2023-07-21T22:37:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.213+0000 7f7fd97a8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7fd40af2b0 0x7f7fd415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.213+0000 7f7fd97a8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7fd40af2b0 0x7f7fd415a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55978/0 (socket says 172.21.15.6:55978) 2023-07-21T22:37:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.213+0000 7f7fd97a8640 1 -- 172.21.15.6:0/2041090009 learned_addr learned my addr 172.21.15.6:0/2041090009 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.213+0000 7f7fd97a8640 1 -- 172.21.15.6:0/2041090009 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7fd4070f30 msgr2=0x7f7fd40ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:10.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.213+0000 7f7fd97a8640 1 --2- 172.21.15.6:0/2041090009 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7fd4070f30 0x7f7fd40ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:10.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.213+0000 7f7fd97a8640 1 -- 172.21.15.6:0/2041090009 >> v2:172.21.15.161:3300/0 conn(0x7f7fd4069430 msgr2=0x7f7fd4069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:10.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.213+0000 7f7fd97a8640 1 --2- 172.21.15.6:0/2041090009 >> v2:172.21.15.161:3300/0 conn(0x7f7fd4069430 0x7f7fd4069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.213+0000 7f7fd97a8640 1 -- 172.21.15.6:0/2041090009 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd40c9f40 con 0x7f7fd40af2b0 2023-07-21T22:37:10.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.217+0000 7f7fd97a8640 1 --2- 172.21.15.6:0/2041090009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fd40af2b0 0x7f7fd415a1f0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4071910 tx=0x7f7fcc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6649568e987fa1db server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:10.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.217+0000 7f7fd37fe640 1 -- 172.21.15.6:0/2041090009 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0a5850 con 0x7f7fd40af2b0 2023-07-21T22:37:10.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.217+0000 7f7fd37fe640 1 -- 172.21.15.6:0/2041090009 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fcc0a59b0 con 0x7f7fd40af2b0 2023-07-21T22:37:10.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.217+0000 7f7fd37fe640 1 -- 172.21.15.6:0/2041090009 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0a5d40 con 0x7f7fd40af2b0 2023-07-21T22:37:10.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.217+0000 7f7fdb20b640 1 -- 172.21.15.6:0/2041090009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fd40af2b0 msgr2=0x7f7fd415a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:10.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.217+0000 7f7fdb20b640 1 --2- 172.21.15.6:0/2041090009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fd40af2b0 0x7f7fd415a1f0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4071910 tx=0x7f7fcc01c9d0 comp rx=0 tx=0).stop 2023-07-21T22:37:10.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.217+0000 7f7fdb20b640 1 -- 172.21.15.6:0/2041090009 shutdown_connections 2023-07-21T22:37:10.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.217+0000 7f7fdb20b640 1 --2- 172.21.15.6:0/2041090009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fd40af2b0 0x7f7fd415a1f0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:10.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.217+0000 7f7fdb20b640 1 --2- 172.21.15.6:0/2041090009 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7fd4070f30 0x7f7fd40ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:10.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.217+0000 7f7fdb20b640 1 --2- 172.21.15.6:0/2041090009 >> v2:172.21.15.161:3300/0 conn(0x7f7fd4069430 0x7f7fd4069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:10.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.217+0000 7f7fdb20b640 1 -- 172.21.15.6:0/2041090009 >> 172.21.15.6:0/2041090009 conn(0x7f7fd40cde90 msgr2=0x7f7fd40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:10.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.217+0000 7f7fdb20b640 1 -- 172.21.15.6:0/2041090009 shutdown_connections 2023-07-21T22:37:10.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.217+0000 7f7fdb20b640 1 -- 172.21.15.6:0/2041090009 wait complete. 2023-07-21T22:37:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fdb20b640 1 Processor -- start 2023-07-21T22:37:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fdb20b640 1 -- start start 2023-07-21T22:37:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fdb20b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7fd4069430 0x7f7fd41f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:10.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fdb20b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fd4070f30 0x7f7fd4150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fdb20b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fd40af2b0 0x7f7fd40c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fdb20b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd41547a0 con 0x7f7fd4070f30 2023-07-21T22:37:10.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fdb20b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd41549f0 con 0x7f7fd40af2b0 2023-07-21T22:37:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fdb20b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd4154cd0 con 0x7f7fd4069430 2023-07-21T22:37:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fd3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fd4070f30 0x7f7fd4150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fd3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fd4070f30 0x7f7fd4150a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55992/0 (socket says 172.21.15.6:55992) 2023-07-21T22:37:10.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fd3fff640 1 -- 172.21.15.6:0/3463230352 learned_addr learned my addr 172.21.15.6:0/3463230352 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:10.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fd97a8640 1 --2- 172.21.15.6:0/3463230352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fd40af2b0 0x7f7fd40c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:10.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fd8fa7640 1 --2- 172.21.15.6:0/3463230352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7fd4069430 0x7f7fd41f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:10.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fd3fff640 1 -- 172.21.15.6:0/3463230352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7fd4069430 msgr2=0x7f7fd41f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:10.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fd3fff640 1 --2- 172.21.15.6:0/3463230352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7fd4069430 0x7f7fd41f4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:10.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fd3fff640 1 -- 172.21.15.6:0/3463230352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fd40af2b0 msgr2=0x7f7fd40c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:10.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fd3fff640 1 --2- 172.21.15.6:0/3463230352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fd40af2b0 0x7f7fd40c2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:10.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fd3fff640 1 -- 172.21.15.6:0/3463230352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fcc009b30 con 0x7f7fd4070f30 2023-07-21T22:37:10.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fd97a8640 1 --2- 172.21.15.6:0/3463230352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fd40af2b0 0x7f7fd40c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:10.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fd3fff640 1 --2- 172.21.15.6:0/3463230352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fd4070f30 0x7f7fd4150a60 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000b410 tx=0x7f7fc000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:10.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fd17fa640 1 -- 172.21.15.6:0/3463230352 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0011830 con 0x7f7fd4070f30 2023-07-21T22:37:10.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fd17fa640 1 -- 172.21.15.6:0/3463230352 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc0011990 con 0x7f7fd4070f30 2023-07-21T22:37:10.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fd17fa640 1 -- 172.21.15.6:0/3463230352 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0011d40 con 0x7f7fd4070f30 2023-07-21T22:37:10.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fdb20b640 1 -- 172.21.15.6:0/3463230352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd4154fb0 con 0x7f7fd4070f30 2023-07-21T22:37:10.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.221+0000 7f7fdb20b640 1 -- 172.21.15.6:0/3463230352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd4156770 con 0x7f7fd4070f30 2023-07-21T22:37:10.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.225+0000 7f7fdb20b640 1 -- 172.21.15.6:0/3463230352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd40678d0 con 0x7f7fd4070f30 2023-07-21T22:37:10.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.225+0000 7f7fd17fa640 1 -- 172.21.15.6:0/3463230352 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7fc001a400 con 0x7f7fd4070f30 2023-07-21T22:37:10.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.225+0000 7f7fd17fa640 1 --2- 172.21.15.6:0/3463230352 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f7fb80663a0 0x7f7fb8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:10.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.225+0000 7f7fd17fa640 1 -- 172.21.15.6:0/3463230352 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 7082+0+0 (secure 0 0 0) 0x7f7fc0084440 con 0x7f7fd4070f30 2023-07-21T22:37:10.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.225+0000 7f7fd8fa7640 1 --2- 172.21.15.6:0/3463230352 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f7fb80663a0 0x7f7fb8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:10.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.225+0000 7f7fd8fa7640 1 --2- 172.21.15.6:0/3463230352 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f7fb80663a0 0x7f7fb8068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8006fd0 tx=0x7f7fc8008040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:10.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.229+0000 7f7fd17fa640 1 -- 172.21.15.6:0/3463230352 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7fc00513a0 con 0x7f7fd4070f30 2023-07-21T22:37:10.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:10.385+0000 7f7fdb20b640 1 -- 172.21.15.6:0/3463230352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7fd4155460 con 0x7f7fd4070f30 2023-07-21T22:37:11.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.005+0000 7f7fd17fa640 1 -- 172.21.15.6:0/3463230352 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v118) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7fc00549c0 con 0x7f7fd4070f30 2023-07-21T22:37:11.053 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-07-21T22:37:11.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.009+0000 7f7fdb20b640 1 -- 172.21.15.6:0/3463230352 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f7fb80663a0 msgr2=0x7f7fb8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:11.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.009+0000 7f7fdb20b640 1 --2- 172.21.15.6:0/3463230352 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f7fb80663a0 0x7f7fb8068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8006fd0 tx=0x7f7fc8008040 comp rx=0 tx=0).stop 2023-07-21T22:37:11.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.009+0000 7f7fdb20b640 1 -- 172.21.15.6:0/3463230352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fd4070f30 msgr2=0x7f7fd4150a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:11.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.009+0000 7f7fdb20b640 1 --2- 172.21.15.6:0/3463230352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fd4070f30 0x7f7fd4150a60 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000b410 tx=0x7f7fc000b8d0 comp rx=0 tx=0).stop 2023-07-21T22:37:11.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.009+0000 7f7fdb20b640 1 -- 172.21.15.6:0/3463230352 shutdown_connections 2023-07-21T22:37:11.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.009+0000 7f7fdb20b640 1 --2- 172.21.15.6:0/3463230352 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f7fb80663a0 0x7f7fb8068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:11.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.009+0000 7f7fdb20b640 1 --2- 172.21.15.6:0/3463230352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7fd40af2b0 0x7f7fd40c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:11.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.009+0000 7f7fdb20b640 1 --2- 172.21.15.6:0/3463230352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fd4070f30 0x7f7fd4150a60 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:11.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.009+0000 7f7fdb20b640 1 --2- 172.21.15.6:0/3463230352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7fd4069430 0x7f7fd41f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:11.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.009+0000 7f7fdb20b640 1 -- 172.21.15.6:0/3463230352 >> 172.21.15.6:0/3463230352 conn(0x7f7fd40cde90 msgr2=0x7f7fd406b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:11.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.009+0000 7f7fdb20b640 1 -- 172.21.15.6:0/3463230352 shutdown_connections 2023-07-21T22:37:11.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.009+0000 7f7fdb20b640 1 -- 172.21.15.6:0/3463230352 wait complete. 2023-07-21T22:37:11.080 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-21T22:37:11.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.185+0000 7fd8ea1e9640 1 Processor -- start 2023-07-21T22:37:11.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.185+0000 7fd8ea1e9640 1 -- start start 2023-07-21T22:37:11.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.189+0000 7fd8ea1e9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8e4070f30 0x7fd8e40ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:11.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.189+0000 7fd8ea1e9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd8e40af2b0 0x7fd8e415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:11.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.189+0000 7fd8ea1e9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e4159d70 con 0x7fd8e4069430 2023-07-21T22:37:11.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.189+0000 7fd8ea1e9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e40c9c60 con 0x7fd8e4070f30 2023-07-21T22:37:11.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.189+0000 7fd8ea1e9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e40c9f40 con 0x7fd8e40af2b0 2023-07-21T22:37:11.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.189+0000 7fd8e2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8e4070f30 0x7fd8e40ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:11.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.189+0000 7fd8e2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8e4070f30 0x7fd8e40ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55994/0 (socket says 172.21.15.6:55994) 2023-07-21T22:37:11.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.189+0000 7fd8e2ffd640 1 -- 172.21.15.6:0/3904063194 learned_addr learned my addr 172.21.15.6:0/3904063194 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:11.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.189+0000 7fd8e3fff640 1 --2- 172.21.15.6:0/3904063194 >> v2:172.21.15.161:3300/0 conn(0x7fd8e40af2b0 0x7fd8e415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:11.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.189+0000 7fd8e2ffd640 1 -- 172.21.15.6:0/3904063194 >> v2:172.21.15.161:3300/0 conn(0x7fd8e40af2b0 msgr2=0x7fd8e415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:11.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.189+0000 7fd8e2ffd640 1 --2- 172.21.15.6:0/3904063194 >> v2:172.21.15.161:3300/0 conn(0x7fd8e40af2b0 0x7fd8e415a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:11.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.189+0000 7fd8e2ffd640 1 -- 172.21.15.6:0/3904063194 >> v1:172.21.15.161:6789/0 conn(0x7fd8e4069430 legacy=0x7fd8e4069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:11.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.189+0000 7fd8e2ffd640 1 -- 172.21.15.6:0/3904063194 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e40ca220 con 0x7fd8e4070f30 2023-07-21T22:37:11.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.193+0000 7fd8e2ffd640 1 --2- 172.21.15.6:0/3904063194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e4070f30 0x7fd8e40ad6f0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40cef70 tx=0x7fd8d801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c27ce9ba23d02a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:11.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.193+0000 7fd8e27fc640 1 -- 172.21.15.6:0/3904063194 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d80aa660 con 0x7fd8e4070f30 2023-07-21T22:37:11.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.193+0000 7fd8e27fc640 1 -- 172.21.15.6:0/3904063194 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d80aa7c0 con 0x7fd8e4070f30 2023-07-21T22:37:11.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.193+0000 7fd8e27fc640 1 -- 172.21.15.6:0/3904063194 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d80aab50 con 0x7fd8e4070f30 2023-07-21T22:37:11.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.193+0000 7fd8ea1e9640 1 -- 172.21.15.6:0/3904063194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e4070f30 msgr2=0x7fd8e40ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:11.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.193+0000 7fd8ea1e9640 1 --2- 172.21.15.6:0/3904063194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e4070f30 0x7fd8e40ad6f0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fd8e40cef70 tx=0x7fd8d801c500 comp rx=0 tx=0).stop 2023-07-21T22:37:11.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.193+0000 7fd8ea1e9640 1 -- 172.21.15.6:0/3904063194 shutdown_connections 2023-07-21T22:37:11.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.193+0000 7fd8ea1e9640 1 --2- 172.21.15.6:0/3904063194 >> v2:172.21.15.161:3300/0 conn(0x7fd8e40af2b0 0x7fd8e415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:11.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.193+0000 7fd8ea1e9640 1 --2- 172.21.15.6:0/3904063194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e4070f30 0x7fd8e40ad6f0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:11.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.193+0000 7fd8ea1e9640 1 -- 172.21.15.6:0/3904063194 >> 172.21.15.6:0/3904063194 conn(0x7fd8e40cde90 msgr2=0x7fd8e40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:11.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.193+0000 7fd8ea1e9640 1 -- 172.21.15.6:0/3904063194 shutdown_connections 2023-07-21T22:37:11.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.193+0000 7fd8ea1e9640 1 -- 172.21.15.6:0/3904063194 wait complete. 2023-07-21T22:37:11.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.193+0000 7fd8ea1e9640 1 Processor -- start 2023-07-21T22:37:11.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.193+0000 7fd8ea1e9640 1 -- start start 2023-07-21T22:37:11.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8ea1e9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8e4069430 0x7fd8e40c5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:11.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8ea1e9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e4070f30 0x7fd8e41514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:11.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8ea1e9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8e40af2b0 0x7fd8e40cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:11.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8ea1e9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e40c58c0 con 0x7fd8e4070f30 2023-07-21T22:37:11.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8ea1e9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e4154360 con 0x7fd8e40af2b0 2023-07-21T22:37:11.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8ea1e9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e4153750 con 0x7fd8e4069430 2023-07-21T22:37:11.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8e2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e4070f30 0x7fd8e41514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:11.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8e2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e4070f30 0x7fd8e41514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56004/0 (socket says 172.21.15.6:56004) 2023-07-21T22:37:11.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8e2ffd640 1 -- 172.21.15.6:0/3115252375 learned_addr learned my addr 172.21.15.6:0/3115252375 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:11.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8e3fff640 1 --2- 172.21.15.6:0/3115252375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8e40af2b0 0x7fd8e40cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:11.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8e37fe640 1 --2- 172.21.15.6:0/3115252375 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8e4069430 0x7fd8e40c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:11.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8e2ffd640 1 -- 172.21.15.6:0/3115252375 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8e4069430 msgr2=0x7fd8e40c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:11.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8e2ffd640 1 --2- 172.21.15.6:0/3115252375 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8e4069430 0x7fd8e40c5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:11.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8e2ffd640 1 -- 172.21.15.6:0/3115252375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8e40af2b0 msgr2=0x7fd8e40cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:11.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8e2ffd640 1 --2- 172.21.15.6:0/3115252375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8e40af2b0 0x7fd8e40cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:11.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8e2ffd640 1 -- 172.21.15.6:0/3115252375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d80094d0 con 0x7fd8e4070f30 2023-07-21T22:37:11.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8e37fe640 1 --2- 172.21.15.6:0/3115252375 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8e4069430 0x7fd8e40c5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:11.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8e2ffd640 1 --2- 172.21.15.6:0/3115252375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e4070f30 0x7fd8e41514a0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8019110 tx=0x7fd8d801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:11.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8cbfff640 1 -- 172.21.15.6:0/3115252375 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d80b3800 con 0x7fd8e4070f30 2023-07-21T22:37:11.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8cbfff640 1 -- 172.21.15.6:0/3115252375 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d80b3960 con 0x7fd8e4070f30 2023-07-21T22:37:11.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8cbfff640 1 -- 172.21.15.6:0/3115252375 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d80b3d10 con 0x7fd8e4070f30 2023-07-21T22:37:11.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8ea1e9640 1 -- 172.21.15.6:0/3115252375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e4153a30 con 0x7fd8e4070f30 2023-07-21T22:37:11.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8ea1e9640 1 -- 172.21.15.6:0/3115252375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e4153ff0 con 0x7fd8e4070f30 2023-07-21T22:37:11.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8ea1e9640 1 -- 172.21.15.6:0/3115252375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e40678d0 con 0x7fd8e4070f30 2023-07-21T22:37:11.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.197+0000 7fd8cbfff640 1 -- 172.21.15.6:0/3115252375 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd8d80b2380 con 0x7fd8e4070f30 2023-07-21T22:37:11.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.201+0000 7fd8cbfff640 1 --2- 172.21.15.6:0/3115252375 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fd8d00663a0 0x7fd8d0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:11.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.201+0000 7fd8cbfff640 1 -- 172.21.15.6:0/3115252375 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6644+0+0 (secure 0 0 0) 0x7fd8d80a6040 con 0x7fd8e4070f30 2023-07-21T22:37:11.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.201+0000 7fd8e37fe640 1 --2- 172.21.15.6:0/3115252375 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fd8d00663a0 0x7fd8d0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:11.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.201+0000 7fd8e37fe640 1 --2- 172.21.15.6:0/3115252375 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fd8d00663a0 0x7fd8d0068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4000f70 tx=0x7fd8d4009040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:11.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.205+0000 7fd8cbfff640 1 -- 172.21.15.6:0/3115252375 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd8d80eb9e0 con 0x7fd8e4070f30 2023-07-21T22:37:11.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:11.361+0000 7fd8ea1e9640 1 -- 172.21.15.6:0/3115252375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd8e40aeb80 con 0x7fd8e4070f30 2023-07-21T22:37:12.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.021+0000 7fd8cbfff640 1 -- 172.21.15.6:0/3115252375 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v119) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd8d80ef000 con 0x7fd8e4070f30 2023-07-21T22:37:12.069 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-07-21T22:37:12.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.025+0000 7fd8ea1e9640 1 -- 172.21.15.6:0/3115252375 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fd8d00663a0 msgr2=0x7fd8d0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:12.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.025+0000 7fd8ea1e9640 1 --2- 172.21.15.6:0/3115252375 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fd8d00663a0 0x7fd8d0068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4000f70 tx=0x7fd8d4009040 comp rx=0 tx=0).stop 2023-07-21T22:37:12.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.025+0000 7fd8ea1e9640 1 -- 172.21.15.6:0/3115252375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e4070f30 msgr2=0x7fd8e41514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:12.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.025+0000 7fd8ea1e9640 1 --2- 172.21.15.6:0/3115252375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e4070f30 0x7fd8e41514a0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8019110 tx=0x7fd8d801ad40 comp rx=0 tx=0).stop 2023-07-21T22:37:12.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.025+0000 7fd8ea1e9640 1 -- 172.21.15.6:0/3115252375 shutdown_connections 2023-07-21T22:37:12.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.029+0000 7fd8ea1e9640 1 --2- 172.21.15.6:0/3115252375 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fd8d00663a0 0x7fd8d0068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.029+0000 7fd8ea1e9640 1 --2- 172.21.15.6:0/3115252375 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8e40af2b0 0x7fd8e40cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.029+0000 7fd8ea1e9640 1 --2- 172.21.15.6:0/3115252375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e4070f30 0x7fd8e41514a0 secure :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8019110 tx=0x7fd8d801ad40 comp rx=0 tx=0).stop 2023-07-21T22:37:12.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.029+0000 7fd8ea1e9640 1 --2- 172.21.15.6:0/3115252375 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8e4069430 0x7fd8e40c5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.029+0000 7fd8ea1e9640 1 -- 172.21.15.6:0/3115252375 >> 172.21.15.6:0/3115252375 conn(0x7fd8e40cde90 msgr2=0x7fd8e4157890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:12.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.029+0000 7fd8ea1e9640 1 -- 172.21.15.6:0/3115252375 shutdown_connections 2023-07-21T22:37:12.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.029+0000 7fd8ea1e9640 1 -- 172.21.15.6:0/3115252375 wait complete. 2023-07-21T22:37:12.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-21T22:37:12.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.205+0000 7f2a3ae7a640 1 Processor -- start 2023-07-21T22:37:12.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.205+0000 7f2a3ae7a640 1 -- start start 2023-07-21T22:37:12.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.205+0000 7f2a3ae7a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a3415bd50 0x7f2a34069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:12.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.205+0000 7f2a3ae7a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2a3406fcf0 0x7f2a34070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:12.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.205+0000 7f2a3ae7a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a34069970 con 0x7f2a3406cc80 2023-07-21T22:37:12.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.205+0000 7f2a3ae7a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3415fa90 con 0x7f2a3406fcf0 2023-07-21T22:37:12.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.205+0000 7f2a3ae7a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3415fd70 con 0x7f2a3415bd50 2023-07-21T22:37:12.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.205+0000 7f2a38c16640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2a3406cc80 0x7f2a3406d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38664/0 (socket says 172.21.15.6:38664) 2023-07-21T22:37:12.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.205+0000 7f2a39417640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2a3406fcf0 0x7f2a34070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:12.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.205+0000 7f2a38c16640 1 -- 172.21.15.6:0/3634620322 learned_addr learned my addr 172.21.15.6:0/3634620322 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:12.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.205+0000 7f2a33fff640 1 --2- 172.21.15.6:0/3634620322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a3415bd50 0x7f2a34069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:12.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.205+0000 7f2a39417640 1 -- 172.21.15.6:0/3634620322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a3415bd50 msgr2=0x7f2a34069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:12.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.205+0000 7f2a39417640 1 --2- 172.21.15.6:0/3634620322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a3415bd50 0x7f2a34069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.205+0000 7f2a39417640 1 -- 172.21.15.6:0/3634620322 >> v1:172.21.15.6:6789/0 conn(0x7f2a3406cc80 legacy=0x7f2a3406d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:12.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.205+0000 7f2a337fe640 1 -- 172.21.15.6:0/3634620322 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665997280 0 0) 0x7f2a34069970 con 0x7f2a3406cc80 2023-07-21T22:37:12.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.205+0000 7f2a39417640 1 -- 172.21.15.6:0/3634620322 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a34160050 con 0x7f2a3406fcf0 2023-07-21T22:37:12.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.209+0000 7f2a39417640 1 --2- 172.21.15.6:0/3634620322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a3406fcf0 0x7f2a34070190 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009d90 tx=0x7f2a2c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c16a2c2b3d74105 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:12.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.209+0000 7f2a337fe640 1 -- 172.21.15.6:0/3634620322 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0a5a00 con 0x7f2a3406fcf0 2023-07-21T22:37:12.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.209+0000 7f2a337fe640 1 -- 172.21.15.6:0/3634620322 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c0a5b60 con 0x7f2a3406fcf0 2023-07-21T22:37:12.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.209+0000 7f2a337fe640 1 -- 172.21.15.6:0/3634620322 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0ad440 con 0x7f2a3406fcf0 2023-07-21T22:37:12.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.209+0000 7f2a3ae7a640 1 -- 172.21.15.6:0/3634620322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a3406fcf0 msgr2=0x7f2a34070190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:12.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.209+0000 7f2a3ae7a640 1 --2- 172.21.15.6:0/3634620322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a3406fcf0 0x7f2a34070190 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009d90 tx=0x7f2a2c01c920 comp rx=0 tx=0).stop 2023-07-21T22:37:12.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.209+0000 7f2a3ae7a640 1 -- 172.21.15.6:0/3634620322 shutdown_connections 2023-07-21T22:37:12.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.209+0000 7f2a3ae7a640 1 --2- 172.21.15.6:0/3634620322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a3406fcf0 0x7f2a34070190 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.209+0000 7f2a3ae7a640 1 --2- 172.21.15.6:0/3634620322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a3415bd50 0x7f2a34069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.209+0000 7f2a3ae7a640 1 -- 172.21.15.6:0/3634620322 >> 172.21.15.6:0/3634620322 conn(0x7f2a340b0490 msgr2=0x7f2a340b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:12.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.209+0000 7f2a3ae7a640 1 -- 172.21.15.6:0/3634620322 shutdown_connections 2023-07-21T22:37:12.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.209+0000 7f2a3ae7a640 1 -- 172.21.15.6:0/3634620322 wait complete. 2023-07-21T22:37:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a3ae7a640 1 Processor -- start 2023-07-21T22:37:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a3ae7a640 1 -- start start 2023-07-21T22:37:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a3ae7a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a3406cc80 0x7f2a3415b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a3ae7a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a3406fcf0 0x7f2a34154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a3ae7a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a3415bd50 0x7f2a3413e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a3ae7a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a34154cc0 con 0x7f2a3406cc80 2023-07-21T22:37:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a3ae7a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a341536e0 con 0x7f2a3415bd50 2023-07-21T22:37:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a3ae7a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a341539c0 con 0x7f2a3406fcf0 2023-07-21T22:37:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a38c16640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a3406cc80 0x7f2a3415b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a38c16640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a3406cc80 0x7f2a3415b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56022/0 (socket says 172.21.15.6:56022) 2023-07-21T22:37:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a38c16640 1 -- 172.21.15.6:0/1896122643 learned_addr learned my addr 172.21.15.6:0/1896122643 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a33fff640 1 --2- 172.21.15.6:0/1896122643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a3406fcf0 0x7f2a34154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a39417640 1 --2- 172.21.15.6:0/1896122643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a3415bd50 0x7f2a3413e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:12.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a38c16640 1 -- 172.21.15.6:0/1896122643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a3406fcf0 msgr2=0x7f2a34154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:12.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a38c16640 1 --2- 172.21.15.6:0/1896122643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a3406fcf0 0x7f2a34154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a38c16640 1 -- 172.21.15.6:0/1896122643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a3415bd50 msgr2=0x7f2a3413e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:12.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a38c16640 1 --2- 172.21.15.6:0/1896122643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a3415bd50 0x7f2a3413e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a38c16640 1 -- 172.21.15.6:0/1896122643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c009a70 con 0x7f2a3406cc80 2023-07-21T22:37:12.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a33fff640 1 --2- 172.21.15.6:0/1896122643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a3406fcf0 0x7f2a34154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:12.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a39417640 1 --2- 172.21.15.6:0/1896122643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a3415bd50 0x7f2a3413e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a38c16640 1 --2- 172.21.15.6:0/1896122643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a3406cc80 0x7f2a3415b5a0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f2a2800c480 tx=0x7f2a2800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a317fa640 1 -- 172.21.15.6:0/1896122643 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a280074e0 con 0x7f2a3406cc80 2023-07-21T22:37:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a317fa640 1 -- 172.21.15.6:0/1896122643 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a28007660 con 0x7f2a3406cc80 2023-07-21T22:37:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a317fa640 1 -- 172.21.15.6:0/1896122643 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a28004a30 con 0x7f2a3406cc80 2023-07-21T22:37:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a3ae7a640 1 -- 172.21.15.6:0/1896122643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a34153ca0 con 0x7f2a3406cc80 2023-07-21T22:37:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.213+0000 7f2a3ae7a640 1 -- 172.21.15.6:0/1896122643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a34154260 con 0x7f2a3406cc80 2023-07-21T22:37:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.217+0000 7f2a3ae7a640 1 -- 172.21.15.6:0/1896122643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a340678d0 con 0x7f2a3406cc80 2023-07-21T22:37:12.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.217+0000 7f2a317fa640 1 -- 172.21.15.6:0/1896122643 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2a28004b90 con 0x7f2a3406cc80 2023-07-21T22:37:12.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.217+0000 7f2a317fa640 1 --2- 172.21.15.6:0/1896122643 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f2a180663d0 0x7f2a18068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:12.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.217+0000 7f2a317fa640 1 -- 172.21.15.6:0/1896122643 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6114+0+0 (secure 0 0 0) 0x7f2a28083090 con 0x7f2a3406cc80 2023-07-21T22:37:12.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.217+0000 7f2a33fff640 1 --2- 172.21.15.6:0/1896122643 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f2a180663d0 0x7f2a18068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:12.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.217+0000 7f2a33fff640 1 --2- 172.21.15.6:0/1896122643 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f2a180663d0 0x7f2a18068880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2a34159080 tx=0x7f2a20008040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:12.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.221+0000 7f2a317fa640 1 -- 172.21.15.6:0/1896122643 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2a28053e40 con 0x7f2a3406cc80 2023-07-21T22:37:12.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.377+0000 7f2a3ae7a640 1 -- 172.21.15.6:0/1896122643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f2a340caf80 con 0x7f2a3406cc80 2023-07-21T22:37:12.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.381+0000 7f2a317fa640 1 -- 172.21.15.6:0/1896122643 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v37) v1 ==== 115+0+0 (secure 0 0 0) 0x7f2a280180b0 con 0x7f2a3406cc80 2023-07-21T22:37:12.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.385+0000 7f2a3ae7a640 1 -- 172.21.15.6:0/1896122643 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f2a180663d0 msgr2=0x7f2a18068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:12.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.385+0000 7f2a3ae7a640 1 --2- 172.21.15.6:0/1896122643 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f2a180663d0 0x7f2a18068880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2a34159080 tx=0x7f2a20008040 comp rx=0 tx=0).stop 2023-07-21T22:37:12.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.385+0000 7f2a3ae7a640 1 -- 172.21.15.6:0/1896122643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a3406cc80 msgr2=0x7f2a3415b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:12.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.385+0000 7f2a3ae7a640 1 --2- 172.21.15.6:0/1896122643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a3406cc80 0x7f2a3415b5a0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f2a2800c480 tx=0x7f2a2800c940 comp rx=0 tx=0).stop 2023-07-21T22:37:12.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.385+0000 7f2a3ae7a640 1 -- 172.21.15.6:0/1896122643 shutdown_connections 2023-07-21T22:37:12.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.385+0000 7f2a3ae7a640 1 --2- 172.21.15.6:0/1896122643 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f2a180663d0 0x7f2a18068880 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.385+0000 7f2a3ae7a640 1 --2- 172.21.15.6:0/1896122643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2a3415bd50 0x7f2a3413e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.385+0000 7f2a3ae7a640 1 --2- 172.21.15.6:0/1896122643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2a3406fcf0 0x7f2a34154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.385+0000 7f2a3ae7a640 1 --2- 172.21.15.6:0/1896122643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a3406cc80 0x7f2a3415b5a0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.385+0000 7f2a3ae7a640 1 -- 172.21.15.6:0/1896122643 >> 172.21.15.6:0/1896122643 conn(0x7f2a340b0490 msgr2=0x7f2a340b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:12.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.385+0000 7f2a3ae7a640 1 -- 172.21.15.6:0/1896122643 shutdown_connections 2023-07-21T22:37:12.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.385+0000 7f2a3ae7a640 1 -- 172.21.15.6:0/1896122643 wait complete. 2023-07-21T22:37:12.448 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-21T22:37:12.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.549+0000 7f2593f11640 1 Processor -- start 2023-07-21T22:37:12.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.549+0000 7f2593f11640 1 -- start start 2023-07-21T22:37:12.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.549+0000 7f2593f11640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f258c0d22e0 0x7f258c0d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:12.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.549+0000 7f2593f11640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258c0b2140 con 0x7f258c0d06b0 2023-07-21T22:37:12.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.549+0000 7f2593f11640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258c0b2410 con 0x7f258c145430 2023-07-21T22:37:12.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.549+0000 7f2593f11640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f258c0d2cc0 con 0x7f258c0d22e0 2023-07-21T22:37:12.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.549+0000 7f2591cad640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f258c0d06b0 0x7f258c0b1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38678/0 (socket says 172.21.15.6:38678) 2023-07-21T22:37:12.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.549+0000 7f2591cad640 1 -- 172.21.15.6:0/2490583386 learned_addr learned my addr 172.21.15.6:0/2490583386 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:12.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.549+0000 7f25924ae640 1 --2- 172.21.15.6:0/2490583386 >> v2:172.21.15.6:3300/0 conn(0x7f258c0d22e0 0x7f258c0d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:12.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.549+0000 7f2590cab640 1 -- 172.21.15.6:0/2490583386 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731880559 0 0) 0x7f258c0b2140 con 0x7f258c0d06b0 2023-07-21T22:37:12.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.549+0000 7f2590cab640 1 -- 172.21.15.6:0/2490583386 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2578003530 con 0x7f258c0d06b0 2023-07-21T22:37:12.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.549+0000 7f25924ae640 1 -- 172.21.15.6:0/2490583386 >> v1:172.21.15.161:6789/0 conn(0x7f258c145430 legacy=0x7f258c0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:12.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.549+0000 7f25924ae640 1 -- 172.21.15.6:0/2490583386 >> v1:172.21.15.6:6789/0 conn(0x7f258c0d06b0 legacy=0x7f258c0b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:12.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.549+0000 7f25924ae640 1 -- 172.21.15.6:0/2490583386 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258c0b26f0 con 0x7f258c0d22e0 2023-07-21T22:37:12.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.553+0000 7f25924ae640 1 --2- 172.21.15.6:0/2490583386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f258c0d22e0 0x7f258c0d2780 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f2584009d90 tx=0x7f258401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37237d191946b015 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:12.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.553+0000 7f2590cab640 1 -- 172.21.15.6:0/2490583386 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25840a59a0 con 0x7f258c0d22e0 2023-07-21T22:37:12.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.553+0000 7f2590cab640 1 -- 172.21.15.6:0/2490583386 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25840a5b00 con 0x7f258c0d22e0 2023-07-21T22:37:12.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.553+0000 7f2590cab640 1 -- 172.21.15.6:0/2490583386 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25840a5e90 con 0x7f258c0d22e0 2023-07-21T22:37:12.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.553+0000 7f2593f11640 1 -- 172.21.15.6:0/2490583386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f258c0d22e0 msgr2=0x7f258c0d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:12.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.553+0000 7f2593f11640 1 --2- 172.21.15.6:0/2490583386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f258c0d22e0 0x7f258c0d2780 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f2584009d90 tx=0x7f258401c8e0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.553+0000 7f2593f11640 1 -- 172.21.15.6:0/2490583386 shutdown_connections 2023-07-21T22:37:12.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.553+0000 7f2593f11640 1 --2- 172.21.15.6:0/2490583386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f258c0d22e0 0x7f258c0d2780 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.553+0000 7f2593f11640 1 -- 172.21.15.6:0/2490583386 >> 172.21.15.6:0/2490583386 conn(0x7f258c0659d0 msgr2=0x7f258c09b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:12.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.553+0000 7f2593f11640 1 -- 172.21.15.6:0/2490583386 shutdown_connections 2023-07-21T22:37:12.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.553+0000 7f2593f11640 1 -- 172.21.15.6:0/2490583386 wait complete. 2023-07-21T22:37:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f2593f11640 1 Processor -- start 2023-07-21T22:37:12.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f2593f11640 1 -- start start 2023-07-21T22:37:12.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f2593f11640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f258c0d06b0 0x7f258c0cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:12.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f2593f11640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f258c0d22e0 0x7f258c153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:12.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f2593f11640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f258c0b56b0 0x7f258c0b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:12.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f2593f11640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c0b6090 con 0x7f258c0d22e0 2023-07-21T22:37:12.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f2593f11640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c0ce520 con 0x7f258c0b56b0 2023-07-21T22:37:12.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f2593f11640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258c0ce800 con 0x7f258c0d06b0 2023-07-21T22:37:12.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f25914ac640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f258c0d22e0 0x7f258c153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:12.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f25914ac640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f258c0d22e0 0x7f258c153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56052/0 (socket says 172.21.15.6:56052) 2023-07-21T22:37:12.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f25914ac640 1 -- 172.21.15.6:0/1213995788 learned_addr learned my addr 172.21.15.6:0/1213995788 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:12.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f25924ae640 1 --2- 172.21.15.6:0/1213995788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f258c0b56b0 0x7f258c0b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:12.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f2591cad640 1 --2- 172.21.15.6:0/1213995788 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f258c0d06b0 0x7f258c0cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:12.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f25914ac640 1 -- 172.21.15.6:0/1213995788 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f258c0d06b0 msgr2=0x7f258c0cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:12.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f25914ac640 1 --2- 172.21.15.6:0/1213995788 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f258c0d06b0 0x7f258c0cf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f25914ac640 1 -- 172.21.15.6:0/1213995788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f258c0b56b0 msgr2=0x7f258c0b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:12.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f25914ac640 1 --2- 172.21.15.6:0/1213995788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f258c0b56b0 0x7f258c0b5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f25914ac640 1 -- 172.21.15.6:0/1213995788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2584009a70 con 0x7f258c0d22e0 2023-07-21T22:37:12.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f25914ac640 1 --2- 172.21.15.6:0/1213995788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f258c0d22e0 0x7f258c153820 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f257c00c450 tx=0x7f257c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:12.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f25827fc640 1 -- 172.21.15.6:0/1213995788 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c012830 con 0x7f258c0d22e0 2023-07-21T22:37:12.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f25827fc640 1 -- 172.21.15.6:0/1213995788 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257c0129b0 con 0x7f258c0d22e0 2023-07-21T22:37:12.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f25827fc640 1 -- 172.21.15.6:0/1213995788 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c012d60 con 0x7f258c0d22e0 2023-07-21T22:37:12.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f2593f11640 1 -- 172.21.15.6:0/1213995788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f258c0ceae0 con 0x7f258c0d22e0 2023-07-21T22:37:12.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.557+0000 7f2593f11640 1 -- 172.21.15.6:0/1213995788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f258c0cf0a0 con 0x7f258c0d22e0 2023-07-21T22:37:12.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.561+0000 7f2593f11640 1 -- 172.21.15.6:0/1213995788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f258c0cf2c0 con 0x7f258c0d22e0 2023-07-21T22:37:12.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.561+0000 7f25827fc640 1 -- 172.21.15.6:0/1213995788 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f257c01c460 con 0x7f258c0d22e0 2023-07-21T22:37:12.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.561+0000 7f25827fc640 1 --2- 172.21.15.6:0/1213995788 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f25700663d0 0x7f2570068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:12.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.561+0000 7f25827fc640 1 -- 172.21.15.6:0/1213995788 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6114+0+0 (secure 0 0 0) 0x7f257c083c80 con 0x7f258c0d22e0 2023-07-21T22:37:12.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.561+0000 7f2591cad640 1 --2- 172.21.15.6:0/1213995788 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f25700663d0 0x7f2570068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:12.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.561+0000 7f2591cad640 1 --2- 172.21.15.6:0/1213995788 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f25700663d0 0x7f2570068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f25880011f0 tx=0x7f2588007d40 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:12.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.565+0000 7f25827fc640 1 -- 172.21.15.6:0/1213995788 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f257c050fd0 con 0x7f258c0d22e0 2023-07-21T22:37:12.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.721+0000 7f2593f11640 1 -- 172.21.15.6:0/1213995788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f258c0678d0 con 0x7f258c0d22e0 2023-07-21T22:37:12.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.725+0000 7f25827fc640 1 -- 172.21.15.6:0/1213995788 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v38) v1 ==== 120+0+0 (secure 0 0 0) 0x7f257c0545f0 con 0x7f258c0d22e0 2023-07-21T22:37:12.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.725+0000 7f2593f11640 1 -- 172.21.15.6:0/1213995788 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f25700663d0 msgr2=0x7f2570068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:12.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.725+0000 7f2593f11640 1 --2- 172.21.15.6:0/1213995788 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f25700663d0 0x7f2570068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f25880011f0 tx=0x7f2588007d40 comp rx=0 tx=0).stop 2023-07-21T22:37:12.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.725+0000 7f2593f11640 1 -- 172.21.15.6:0/1213995788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f258c0d22e0 msgr2=0x7f258c153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:12.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.725+0000 7f2593f11640 1 --2- 172.21.15.6:0/1213995788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f258c0d22e0 0x7f258c153820 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f257c00c450 tx=0x7f257c00c910 comp rx=0 tx=0).stop 2023-07-21T22:37:12.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.725+0000 7f2593f11640 1 -- 172.21.15.6:0/1213995788 shutdown_connections 2023-07-21T22:37:12.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.725+0000 7f2593f11640 1 --2- 172.21.15.6:0/1213995788 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f25700663d0 0x7f2570068880 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.725+0000 7f2593f11640 1 --2- 172.21.15.6:0/1213995788 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f258c0b56b0 0x7f258c0b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.725+0000 7f2593f11640 1 --2- 172.21.15.6:0/1213995788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f258c0d22e0 0x7f258c153820 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.725+0000 7f2593f11640 1 --2- 172.21.15.6:0/1213995788 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f258c0d06b0 0x7f258c0cf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.725+0000 7f2593f11640 1 -- 172.21.15.6:0/1213995788 >> 172.21.15.6:0/1213995788 conn(0x7f258c0659d0 msgr2=0x7f258c06ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:12.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.729+0000 7f2593f11640 1 -- 172.21.15.6:0/1213995788 shutdown_connections 2023-07-21T22:37:12.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.729+0000 7f2593f11640 1 -- 172.21.15.6:0/1213995788 wait complete. 2023-07-21T22:37:12.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-21T22:37:12.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.893+0000 7f2755311640 1 Processor -- start 2023-07-21T22:37:12.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.893+0000 7f2755311640 1 -- start start 2023-07-21T22:37:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.893+0000 7f2755311640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f275006a540 0x7f27500cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.893+0000 7f2755311640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27501601f0 0x7f27500cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.893+0000 7f2755311640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f275006a910 0x7f27500d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.893+0000 7f2755311640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27500ccf50 con 0x7f275006a540 2023-07-21T22:37:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.893+0000 7f2755311640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27500cd1f0 con 0x7f275006a910 2023-07-21T22:37:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.893+0000 7f2755311640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27500cd4d0 con 0x7f27501601f0 2023-07-21T22:37:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.893+0000 7f274effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f275006a540 0x7f27500cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.893+0000 7f274effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f275006a540 0x7f27500cdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56054/0 (socket says 172.21.15.6:56054) 2023-07-21T22:37:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.893+0000 7f274effd640 1 -- 172.21.15.6:0/471015710 learned_addr learned my addr 172.21.15.6:0/471015710 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.893+0000 7f274f7fe640 1 --2- 172.21.15.6:0/471015710 >> v2:172.21.15.161:3300/0 conn(0x7f275006a910 0x7f27500d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.893+0000 7f27467fc640 1 --2- 172.21.15.6:0/471015710 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27501601f0 0x7f27500cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.893+0000 7f274effd640 1 -- 172.21.15.6:0/471015710 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27501601f0 msgr2=0x7f27500cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.893+0000 7f274effd640 1 --2- 172.21.15.6:0/471015710 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27501601f0 0x7f27500cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.893+0000 7f274effd640 1 -- 172.21.15.6:0/471015710 >> v2:172.21.15.161:3300/0 conn(0x7f275006a910 msgr2=0x7f27500d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.893+0000 7f274effd640 1 --2- 172.21.15.6:0/471015710 >> v2:172.21.15.161:3300/0 conn(0x7f275006a910 0x7f27500d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.893+0000 7f274effd640 1 -- 172.21.15.6:0/471015710 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27500cd7b0 con 0x7f275006a540 2023-07-21T22:37:12.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.897+0000 7f274effd640 1 --2- 172.21.15.6:0/471015710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f275006a540 0x7f27500cdcd0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f275006c680 tx=0x7f274001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a5881fca8482d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:12.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.897+0000 7f274e7fc640 1 -- 172.21.15.6:0/471015710 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27400a4ea0 con 0x7f275006a540 2023-07-21T22:37:12.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.897+0000 7f274e7fc640 1 -- 172.21.15.6:0/471015710 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27400a7050 con 0x7f275006a540 2023-07-21T22:37:12.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.897+0000 7f274e7fc640 1 -- 172.21.15.6:0/471015710 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27400ab820 con 0x7f275006a540 2023-07-21T22:37:12.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.897+0000 7f2755311640 1 -- 172.21.15.6:0/471015710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f275006a540 msgr2=0x7f27500cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:12.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.897+0000 7f2755311640 1 --2- 172.21.15.6:0/471015710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f275006a540 0x7f27500cdcd0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f275006c680 tx=0x7f274001c440 comp rx=0 tx=0).stop 2023-07-21T22:37:12.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.897+0000 7f2755311640 1 -- 172.21.15.6:0/471015710 shutdown_connections 2023-07-21T22:37:12.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.897+0000 7f2755311640 1 --2- 172.21.15.6:0/471015710 >> v2:172.21.15.161:3300/0 conn(0x7f275006a910 0x7f27500d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.897+0000 7f2755311640 1 --2- 172.21.15.6:0/471015710 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27501601f0 0x7f27500cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.897+0000 7f2755311640 1 --2- 172.21.15.6:0/471015710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f275006a540 0x7f27500cdcd0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.897+0000 7f2755311640 1 -- 172.21.15.6:0/471015710 >> 172.21.15.6:0/471015710 conn(0x7f2750099490 msgr2=0x7f2750089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:12.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.897+0000 7f2755311640 1 -- 172.21.15.6:0/471015710 shutdown_connections 2023-07-21T22:37:12.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.897+0000 7f2755311640 1 -- 172.21.15.6:0/471015710 wait complete. 2023-07-21T22:37:12.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f2755311640 1 Processor -- start 2023-07-21T22:37:12.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f2755311640 1 -- start start 2023-07-21T22:37:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f2755311640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f275006a540 0x7f2750158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f2755311640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f275006a910 0x7f27501596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f2755311640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27501601f0 0x7f2750159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f2755311640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27500c5250 con 0x7f275006a910 2023-07-21T22:37:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f2755311640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2750099e00 con 0x7f275006a540 2023-07-21T22:37:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f2755311640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2750158fc0 con 0x7f27501601f0 2023-07-21T22:37:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f27467fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f275006a910 0x7f27501596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f27467fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f275006a910 0x7f27501596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56064/0 (socket says 172.21.15.6:56064) 2023-07-21T22:37:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f27467fc640 1 -- 172.21.15.6:0/3297344588 learned_addr learned my addr 172.21.15.6:0/3297344588 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f274effd640 1 --2- 172.21.15.6:0/3297344588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f275006a540 0x7f2750158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f274f7fe640 1 --2- 172.21.15.6:0/3297344588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27501601f0 0x7f2750159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f27467fc640 1 -- 172.21.15.6:0/3297344588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27501601f0 msgr2=0x7f2750159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f27467fc640 1 --2- 172.21.15.6:0/3297344588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27501601f0 0x7f2750159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f27467fc640 1 -- 172.21.15.6:0/3297344588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f275006a540 msgr2=0x7f2750158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f27467fc640 1 --2- 172.21.15.6:0/3297344588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f275006a540 0x7f2750158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f27467fc640 1 -- 172.21.15.6:0/3297344588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2740009480 con 0x7f275006a910 2023-07-21T22:37:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f27467fc640 1 --2- 172.21.15.6:0/3297344588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f275006a910 0x7f27501596f0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f2738007e60 tx=0x7f273800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f2747fff640 1 -- 172.21.15.6:0/3297344588 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738014620 con 0x7f275006a910 2023-07-21T22:37:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f2747fff640 1 -- 172.21.15.6:0/3297344588 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273800ee90 con 0x7f275006a910 2023-07-21T22:37:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f2747fff640 1 -- 172.21.15.6:0/3297344588 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27380149e0 con 0x7f275006a910 2023-07-21T22:37:12.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f2755311640 1 -- 172.21.15.6:0/3297344588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27500c49b0 con 0x7f275006a910 2023-07-21T22:37:12.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.901+0000 7f2755311640 1 -- 172.21.15.6:0/3297344588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27500c4f70 con 0x7f275006a910 2023-07-21T22:37:12.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.905+0000 7f2755311640 1 -- 172.21.15.6:0/3297344588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27500678d0 con 0x7f275006a910 2023-07-21T22:37:12.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.905+0000 7f2747fff640 1 -- 172.21.15.6:0/3297344588 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2738014b40 con 0x7f275006a910 2023-07-21T22:37:12.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.905+0000 7f2747fff640 1 --2- 172.21.15.6:0/3297344588 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f27300663a0 0x7f2730068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:12.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.905+0000 7f2747fff640 1 -- 172.21.15.6:0/3297344588 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6114+0+0 (secure 0 0 0) 0x7f27380846a0 con 0x7f275006a910 2023-07-21T22:37:12.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.905+0000 7f274effd640 1 --2- 172.21.15.6:0/3297344588 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f27300663a0 0x7f2730068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.905+0000 7f274effd640 1 --2- 172.21.15.6:0/3297344588 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f27300663a0 0x7f2730068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f27400ad000 tx=0x7f27400a6000 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:12.909+0000 7f2747fff640 1 -- 172.21.15.6:0/3297344588 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2738051b10 con 0x7f275006a910 2023-07-21T22:37:13.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.065+0000 7f2755311640 1 -- 172.21.15.6:0/3297344588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f27500b0e90 con 0x7f275006a910 2023-07-21T22:37:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.069+0000 7f2747fff640 1 -- 172.21.15.6:0/3297344588 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2738055130 con 0x7f275006a910 2023-07-21T22:37:13.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.073+0000 7f2755311640 1 -- 172.21.15.6:0/3297344588 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f27300663a0 msgr2=0x7f2730068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:13.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.073+0000 7f2755311640 1 --2- 172.21.15.6:0/3297344588 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f27300663a0 0x7f2730068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f27400ad000 tx=0x7f27400a6000 comp rx=0 tx=0).stop 2023-07-21T22:37:13.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.073+0000 7f2755311640 1 -- 172.21.15.6:0/3297344588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f275006a910 msgr2=0x7f27501596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:13.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.073+0000 7f2755311640 1 --2- 172.21.15.6:0/3297344588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f275006a910 0x7f27501596f0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f2738007e60 tx=0x7f273800e4b0 comp rx=0 tx=0).stop 2023-07-21T22:37:13.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.073+0000 7f2755311640 1 -- 172.21.15.6:0/3297344588 shutdown_connections 2023-07-21T22:37:13.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.073+0000 7f2755311640 1 --2- 172.21.15.6:0/3297344588 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f27300663a0 0x7f2730068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:13.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.073+0000 7f2755311640 1 --2- 172.21.15.6:0/3297344588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f27501601f0 0x7f2750159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:13.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.073+0000 7f2755311640 1 --2- 172.21.15.6:0/3297344588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f275006a910 0x7f27501596f0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:13.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.073+0000 7f2755311640 1 --2- 172.21.15.6:0/3297344588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f275006a540 0x7f2750158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:13.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.073+0000 7f2755311640 1 -- 172.21.15.6:0/3297344588 >> 172.21.15.6:0/3297344588 conn(0x7f2750099490 msgr2=0x7f27500b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:13.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.073+0000 7f2755311640 1 -- 172.21.15.6:0/3297344588 shutdown_connections 2023-07-21T22:37:13.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.073+0000 7f2755311640 1 -- 172.21.15.6:0/3297344588 wait complete. 2023-07-21T22:37:13.137 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-07-21T22:37:13.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.237+0000 7f9ece893640 1 Processor -- start 2023-07-21T22:37:13.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.237+0000 7f9ece893640 1 -- start start 2023-07-21T22:37:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.237+0000 7f9ece893640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ec80d06b0 0x7f9ec80b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.237+0000 7f9ece893640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9ec80b1f70 0x7f9ec80d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.237+0000 7f9ece893640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec80b2410 con 0x7f9ec8145430 2023-07-21T22:37:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.237+0000 7f9ece893640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec80b26f0 con 0x7f9ec80b1f70 2023-07-21T22:37:13.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.237+0000 7f9ece893640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80b29d0 con 0x7f9ec80d06b0 2023-07-21T22:37:13.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.237+0000 7f9ec77fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9ec8145430 0x7f9ec80b34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38694/0 (socket says 172.21.15.6:38694) 2023-07-21T22:37:13.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.237+0000 7f9ec77fe640 1 -- 172.21.15.6:0/1324122919 learned_addr learned my addr 172.21.15.6:0/1324122919 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:13.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.237+0000 7f9ec7fff640 1 --2- 172.21.15.6:0/1324122919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ec80d06b0 0x7f9ec80b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:13.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.237+0000 7f9ecce30640 1 --2- 172.21.15.6:0/1324122919 >> v2:172.21.15.161:3300/0 conn(0x7f9ec80b1f70 0x7f9ec80d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:13.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.237+0000 7f9ec6ffd640 1 -- 172.21.15.6:0/1324122919 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463851205 0 0) 0x7f9ec80b2410 con 0x7f9ec8145430 2023-07-21T22:37:13.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.237+0000 7f9ec6ffd640 1 -- 172.21.15.6:0/1324122919 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eb0003530 con 0x7f9ec8145430 2023-07-21T22:37:13.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.237+0000 7f9ec7fff640 1 -- 172.21.15.6:0/1324122919 >> v2:172.21.15.161:3300/0 conn(0x7f9ec80b1f70 msgr2=0x7f9ec80d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:13.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.237+0000 7f9ec7fff640 1 --2- 172.21.15.6:0/1324122919 >> v2:172.21.15.161:3300/0 conn(0x7f9ec80b1f70 0x7f9ec80d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:13.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.237+0000 7f9ec7fff640 1 -- 172.21.15.6:0/1324122919 >> v1:172.21.15.6:6789/0 conn(0x7f9ec8145430 legacy=0x7f9ec80b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:13.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.237+0000 7f9ec7fff640 1 -- 172.21.15.6:0/1324122919 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec80b2cb0 con 0x7f9ec80d06b0 2023-07-21T22:37:13.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.237+0000 7f9ecce30640 1 --2- 172.21.15.6:0/1324122919 >> v2:172.21.15.161:3300/0 conn(0x7f9ec80b1f70 0x7f9ec80d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.241+0000 7f9ec7fff640 1 --2- 172.21.15.6:0/1324122919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ec80d06b0 0x7f9ec80b1a30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80097c0 tx=0x7f9eb801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15651e25eda88095 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.241+0000 7f9ec6ffd640 1 -- 172.21.15.6:0/1324122919 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb80ad660 con 0x7f9ec80d06b0 2023-07-21T22:37:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.241+0000 7f9ec6ffd640 1 -- 172.21.15.6:0/1324122919 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb80ad7c0 con 0x7f9ec80d06b0 2023-07-21T22:37:13.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.241+0000 7f9ec6ffd640 1 -- 172.21.15.6:0/1324122919 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb80adb50 con 0x7f9ec80d06b0 2023-07-21T22:37:13.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.241+0000 7f9ece893640 1 -- 172.21.15.6:0/1324122919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ec80d06b0 msgr2=0x7f9ec80b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:13.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.241+0000 7f9ece893640 1 --2- 172.21.15.6:0/1324122919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ec80d06b0 0x7f9ec80b1a30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80097c0 tx=0x7f9eb801c450 comp rx=0 tx=0).stop 2023-07-21T22:37:13.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.241+0000 7f9ece893640 1 -- 172.21.15.6:0/1324122919 shutdown_connections 2023-07-21T22:37:13.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.241+0000 7f9ece893640 1 --2- 172.21.15.6:0/1324122919 >> v2:172.21.15.161:3300/0 conn(0x7f9ec80b1f70 0x7f9ec80d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:13.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.241+0000 7f9ece893640 1 --2- 172.21.15.6:0/1324122919 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ec80d06b0 0x7f9ec80b1a30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:13.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.241+0000 7f9ece893640 1 -- 172.21.15.6:0/1324122919 >> 172.21.15.6:0/1324122919 conn(0x7f9ec80659d0 msgr2=0x7f9ec809b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:13.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.241+0000 7f9ece893640 1 -- 172.21.15.6:0/1324122919 shutdown_connections 2023-07-21T22:37:13.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.241+0000 7f9ece893640 1 -- 172.21.15.6:0/1324122919 wait complete. 2023-07-21T22:37:13.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ece893640 1 Processor -- start 2023-07-21T22:37:13.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ece893640 1 -- start start 2023-07-21T22:37:13.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ece893640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ec80b1f70 0x7f9ec80c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:13.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ece893640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec80d06b0 0x7f9ec815ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:13.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ece893640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ec80c5430 0x7f9ec80c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:13.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ece893640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec8154550 con 0x7f9ec80d06b0 2023-07-21T22:37:13.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ece893640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec8154fb0 con 0x7f9ec80b1f70 2023-07-21T22:37:13.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ece893640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec815e330 con 0x7f9ec80c5430 2023-07-21T22:37:13.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ec77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec80d06b0 0x7f9ec815ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:13.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ec77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec80d06b0 0x7f9ec815ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56080/0 (socket says 172.21.15.6:56080) 2023-07-21T22:37:13.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ec77fe640 1 -- 172.21.15.6:0/651097611 learned_addr learned my addr 172.21.15.6:0/651097611 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:13.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ec7fff640 1 --2- 172.21.15.6:0/651097611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ec80b1f70 0x7f9ec80c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:13.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ecce30640 1 --2- 172.21.15.6:0/651097611 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ec80c5430 0x7f9ec80c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:13.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ec77fe640 1 -- 172.21.15.6:0/651097611 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ec80c5430 msgr2=0x7f9ec80c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:13.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ec77fe640 1 --2- 172.21.15.6:0/651097611 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ec80c5430 0x7f9ec80c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:13.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ec77fe640 1 -- 172.21.15.6:0/651097611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ec80b1f70 msgr2=0x7f9ec80c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:13.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ec77fe640 1 --2- 172.21.15.6:0/651097611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ec80b1f70 0x7f9ec80c6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:13.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ec77fe640 1 -- 172.21.15.6:0/651097611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec0009a70 con 0x7f9ec80d06b0 2023-07-21T22:37:13.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ecce30640 1 --2- 172.21.15.6:0/651097611 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ec80c5430 0x7f9ec80c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:13.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ec77fe640 1 --2- 172.21.15.6:0/651097611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec80d06b0 0x7f9ec815ddf0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00c450 tx=0x7f9ebc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:13.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ec4ff9640 1 -- 172.21.15.6:0/651097611 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc005cf0 con 0x7f9ec80d06b0 2023-07-21T22:37:13.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ec4ff9640 1 -- 172.21.15.6:0/651097611 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc005e50 con 0x7f9ec80d06b0 2023-07-21T22:37:13.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ec4ff9640 1 -- 172.21.15.6:0/651097611 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc007290 con 0x7f9ec80d06b0 2023-07-21T22:37:13.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ece893640 1 -- 172.21.15.6:0/651097611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb8009420 con 0x7f9ec80d06b0 2023-07-21T22:37:13.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.245+0000 7f9ece893640 1 -- 172.21.15.6:0/651097611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec8154960 con 0x7f9ec80d06b0 2023-07-21T22:37:13.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.249+0000 7f9ece893640 1 -- 172.21.15.6:0/651097611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec8072e70 con 0x7f9ec80d06b0 2023-07-21T22:37:13.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.249+0000 7f9ec4ff9640 1 -- 172.21.15.6:0/651097611 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9ebc0073f0 con 0x7f9ec80d06b0 2023-07-21T22:37:13.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.249+0000 7f9ec4ff9640 1 --2- 172.21.15.6:0/651097611 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f9eb40663a0 0x7f9eb4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:13.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.249+0000 7f9ec4ff9640 1 -- 172.21.15.6:0/651097611 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6114+0+0 (secure 0 0 0) 0x7f9ebc083530 con 0x7f9ec80d06b0 2023-07-21T22:37:13.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.249+0000 7f9ec7fff640 1 --2- 172.21.15.6:0/651097611 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f9eb40663a0 0x7f9eb4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:13.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.249+0000 7f9ec7fff640 1 --2- 172.21.15.6:0/651097611 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f9eb40663a0 0x7f9eb4068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80af000 tx=0x7f9eb8008040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:13.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.253+0000 7f9ec4ff9640 1 -- 172.21.15.6:0/651097611 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ebc0507f0 con 0x7f9ec80d06b0 2023-07-21T22:37:13.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:13.473+0000 7f9ece893640 1 -- 172.21.15.6:0/651097611 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f9ec80678d0 con 0x7f9ec80d06b0 2023-07-21T22:37:13.761 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:37:13.765 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:37:14.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.021+0000 7f9ec4ff9640 1 -- 172.21.15.6:0/651097611 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v707) v1 ==== 183+0+0 (secure 0 0 0) 0x7f9ebc053e10 con 0x7f9ec80d06b0 2023-07-21T22:37:14.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.021+0000 7f9ece893640 1 -- 172.21.15.6:0/651097611 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f9eb40663a0 msgr2=0x7f9eb4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:14.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.021+0000 7f9ece893640 1 --2- 172.21.15.6:0/651097611 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f9eb40663a0 0x7f9eb4068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9eb80af000 tx=0x7f9eb8008040 comp rx=0 tx=0).stop 2023-07-21T22:37:14.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.021+0000 7f9ece893640 1 -- 172.21.15.6:0/651097611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec80d06b0 msgr2=0x7f9ec815ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:14.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.021+0000 7f9ece893640 1 --2- 172.21.15.6:0/651097611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec80d06b0 0x7f9ec815ddf0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00c450 tx=0x7f9ebc00c910 comp rx=0 tx=0).stop 2023-07-21T22:37:14.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.021+0000 7f9ece893640 1 -- 172.21.15.6:0/651097611 shutdown_connections 2023-07-21T22:37:14.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.021+0000 7f9ece893640 1 --2- 172.21.15.6:0/651097611 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f9eb40663a0 0x7f9eb4068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:14.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.021+0000 7f9ece893640 1 --2- 172.21.15.6:0/651097611 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ec80c5430 0x7f9ec80c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:14.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.021+0000 7f9ece893640 1 --2- 172.21.15.6:0/651097611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ec80d06b0 0x7f9ec815ddf0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:14.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.021+0000 7f9ece893640 1 --2- 172.21.15.6:0/651097611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ec80b1f70 0x7f9ec80c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:14.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.021+0000 7f9ece893640 1 -- 172.21.15.6:0/651097611 >> 172.21.15.6:0/651097611 conn(0x7f9ec80659d0 msgr2=0x7f9ec815c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:14.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.021+0000 7f9ece893640 1 -- 172.21.15.6:0/651097611 shutdown_connections 2023-07-21T22:37:14.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.021+0000 7f9ece893640 1 -- 172.21.15.6:0/651097611 wait complete. 2023-07-21T22:37:14.089 INFO:tasks.cephfs_test_runner:test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) ... ok 2023-07-21T22:37:14.089 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test existence of a scheduled snapshot 2023-07-21T22:37:14.090 INFO:tasks.cephfs_test_runner:test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-21T22:37:14.090 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-07-21T22:37:14.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.189+0000 7f846206d640 1 Processor -- start 2023-07-21T22:37:14.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.189+0000 7f846206d640 1 -- start start 2023-07-21T22:37:14.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.189+0000 7f846206d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f845c070b70 0x7f845c070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:14.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.189+0000 7f846206d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f845c0cb100 0x7f845c0cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:14.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.189+0000 7f846206d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845c0cac70 con 0x7f845c06b1e0 2023-07-21T22:37:14.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.189+0000 7f846206d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845c0cba60 con 0x7f845c0cb100 2023-07-21T22:37:14.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.189+0000 7f846206d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845c071480 con 0x7f845c070b70 2023-07-21T22:37:14.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.193+0000 7f845bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f845c0cb100 0x7f845c0cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:14.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.193+0000 7f845bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f845c0cb100 0x7f845c0cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56092/0 (socket says 172.21.15.6:56092) 2023-07-21T22:37:14.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.193+0000 7f845bfff640 1 -- 172.21.15.6:0/2967919605 learned_addr learned my addr 172.21.15.6:0/2967919605 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:14.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.193+0000 7f845b7fe640 1 --2- 172.21.15.6:0/2967919605 >> v2:172.21.15.161:3300/0 conn(0x7f845c070b70 0x7f845c070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:14.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.193+0000 7f845bfff640 1 -- 172.21.15.6:0/2967919605 >> v2:172.21.15.161:3300/0 conn(0x7f845c070b70 msgr2=0x7f845c070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:14.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.193+0000 7f845bfff640 1 --2- 172.21.15.6:0/2967919605 >> v2:172.21.15.161:3300/0 conn(0x7f845c070b70 0x7f845c070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:14.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.193+0000 7f845bfff640 1 -- 172.21.15.6:0/2967919605 >> v1:172.21.15.161:6789/0 conn(0x7f845c06b1e0 legacy=0x7f845c0c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:14.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.193+0000 7f845bfff640 1 -- 172.21.15.6:0/2967919605 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c0ca060 con 0x7f845c0cb100 2023-07-21T22:37:14.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.193+0000 7f845b7fe640 1 --2- 172.21.15.6:0/2967919605 >> v2:172.21.15.161:3300/0 conn(0x7f845c070b70 0x7f845c070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:14.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.193+0000 7f845bfff640 1 --2- 172.21.15.6:0/2967919605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845c0cb100 0x7f845c0cb520 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f845c06f1f0 tx=0x7f845401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5971ee93283e7fd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:14.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.193+0000 7f845a7fc640 1 -- 172.21.15.6:0/2967919605 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84540a5860 con 0x7f845c0cb100 2023-07-21T22:37:14.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.193+0000 7f845a7fc640 1 -- 172.21.15.6:0/2967919605 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84540a59c0 con 0x7f845c0cb100 2023-07-21T22:37:14.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.193+0000 7f845a7fc640 1 -- 172.21.15.6:0/2967919605 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84540a5d50 con 0x7f845c0cb100 2023-07-21T22:37:14.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f846206d640 1 -- 172.21.15.6:0/2967919605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845c0cb100 msgr2=0x7f845c0cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:14.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f846206d640 1 --2- 172.21.15.6:0/2967919605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845c0cb100 0x7f845c0cb520 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f845c06f1f0 tx=0x7f845401c9a0 comp rx=0 tx=0).stop 2023-07-21T22:37:14.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f846206d640 1 -- 172.21.15.6:0/2967919605 shutdown_connections 2023-07-21T22:37:14.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f846206d640 1 --2- 172.21.15.6:0/2967919605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845c0cb100 0x7f845c0cb520 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:14.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f846206d640 1 --2- 172.21.15.6:0/2967919605 >> v2:172.21.15.161:3300/0 conn(0x7f845c070b70 0x7f845c070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:14.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f846206d640 1 -- 172.21.15.6:0/2967919605 >> 172.21.15.6:0/2967919605 conn(0x7f845c0afcf0 msgr2=0x7f845c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:14.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f846206d640 1 -- 172.21.15.6:0/2967919605 shutdown_connections 2023-07-21T22:37:14.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f846206d640 1 -- 172.21.15.6:0/2967919605 wait complete. 2023-07-21T22:37:14.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f846206d640 1 Processor -- start 2023-07-21T22:37:14.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f846206d640 1 -- start start 2023-07-21T22:37:14.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f846206d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845c06b1e0 0x7f845c1488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:14.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f846206d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f845c070b70 0x7f845c151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:14.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f846206d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f845c0cb100 0x7f845c0cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:14.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f846206d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c157e30 con 0x7f845c06b1e0 2023-07-21T22:37:14.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f846206d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c148df0 con 0x7f845c0cb100 2023-07-21T22:37:14.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f846206d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845c163cb0 con 0x7f845c070b70 2023-07-21T22:37:14.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f845b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845c06b1e0 0x7f845c1488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:14.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f845b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845c06b1e0 0x7f845c1488b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56094/0 (socket says 172.21.15.6:56094) 2023-07-21T22:37:14.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f845b7fe640 1 -- 172.21.15.6:0/3927591967 learned_addr learned my addr 172.21.15.6:0/3927591967 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:14.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f845affd640 1 --2- 172.21.15.6:0/3927591967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f845c070b70 0x7f845c151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:14.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.197+0000 7f845bfff640 1 --2- 172.21.15.6:0/3927591967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f845c0cb100 0x7f845c0cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:14.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.201+0000 7f845b7fe640 1 -- 172.21.15.6:0/3927591967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f845c070b70 msgr2=0x7f845c151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.201+0000 7f845b7fe640 1 --2- 172.21.15.6:0/3927591967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f845c070b70 0x7f845c151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.201+0000 7f845b7fe640 1 -- 172.21.15.6:0/3927591967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f845c0cb100 msgr2=0x7f845c0cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.201+0000 7f845b7fe640 1 --2- 172.21.15.6:0/3927591967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f845c0cb100 0x7f845c0cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.201+0000 7f845b7fe640 1 -- 172.21.15.6:0/3927591967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8454009b30 con 0x7f845c06b1e0 2023-07-21T22:37:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.201+0000 7f845b7fe640 1 --2- 172.21.15.6:0/3927591967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845c06b1e0 0x7f845c1488b0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f844c00e840 tx=0x7f844c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.201+0000 7f8443fff640 1 -- 172.21.15.6:0/3927591967 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c00c8d0 con 0x7f845c06b1e0 2023-07-21T22:37:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.201+0000 7f8443fff640 1 -- 172.21.15.6:0/3927591967 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c00ca30 con 0x7f845c06b1e0 2023-07-21T22:37:14.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.201+0000 7f846206d640 1 -- 172.21.15.6:0/3927591967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845c163160 con 0x7f845c06b1e0 2023-07-21T22:37:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.201+0000 7f8443fff640 1 -- 172.21.15.6:0/3927591967 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c00cdc0 con 0x7f845c06b1e0 2023-07-21T22:37:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.201+0000 7f846206d640 1 -- 172.21.15.6:0/3927591967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845c157a50 con 0x7f845c06b1e0 2023-07-21T22:37:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.201+0000 7f846206d640 1 -- 172.21.15.6:0/3927591967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845c1580a0 con 0x7f845c06b1e0 2023-07-21T22:37:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.201+0000 7f8443fff640 1 -- 172.21.15.6:0/3927591967 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f844c013410 con 0x7f845c06b1e0 2023-07-21T22:37:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.201+0000 7f8443fff640 1 --2- 172.21.15.6:0/3927591967 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f84480663a0 0x7f8448068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.201+0000 7f8443fff640 1 -- 172.21.15.6:0/3927591967 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6114+0+0 (secure 0 0 0) 0x7f844c083d50 con 0x7f845c06b1e0 2023-07-21T22:37:14.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.205+0000 7f845affd640 1 --2- 172.21.15.6:0/3927591967 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f84480663a0 0x7f8448068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.205+0000 7f845affd640 1 --2- 172.21.15.6:0/3927591967 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f84480663a0 0x7f8448068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f845c0cdcf0 tx=0x7f8450009040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:14.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.205+0000 7f8443fff640 1 -- 172.21.15.6:0/3927591967 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f844c050f80 con 0x7f845c06b1e0 2023-07-21T22:37:14.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:14.421+0000 7f846206d640 1 -- 172.21.15.6:0/3927591967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f845c0678d0 con 0x7f845c06b1e0 2023-07-21T22:37:15.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.025+0000 7f8443fff640 1 -- 172.21.15.6:0/3927591967 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v708) v1 ==== 151+0+0 (secure 0 0 0) 0x7f844c009480 con 0x7f845c06b1e0 2023-07-21T22:37:15.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.025+0000 7f846206d640 1 -- 172.21.15.6:0/3927591967 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f84480663a0 msgr2=0x7f8448068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:15.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.025+0000 7f846206d640 1 --2- 172.21.15.6:0/3927591967 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f84480663a0 0x7f8448068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f845c0cdcf0 tx=0x7f8450009040 comp rx=0 tx=0).stop 2023-07-21T22:37:15.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.025+0000 7f846206d640 1 -- 172.21.15.6:0/3927591967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845c06b1e0 msgr2=0x7f845c1488b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:15.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.025+0000 7f846206d640 1 --2- 172.21.15.6:0/3927591967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845c06b1e0 0x7f845c1488b0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f844c00e840 tx=0x7f844c00ed00 comp rx=0 tx=0).stop 2023-07-21T22:37:15.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.025+0000 7f846206d640 1 -- 172.21.15.6:0/3927591967 shutdown_connections 2023-07-21T22:37:15.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.025+0000 7f846206d640 1 --2- 172.21.15.6:0/3927591967 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f84480663a0 0x7f8448068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.025+0000 7f846206d640 1 --2- 172.21.15.6:0/3927591967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f845c0cb100 0x7f845c0cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.025+0000 7f846206d640 1 --2- 172.21.15.6:0/3927591967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f845c070b70 0x7f845c151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.025+0000 7f846206d640 1 --2- 172.21.15.6:0/3927591967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f845c06b1e0 0x7f845c1488b0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.025+0000 7f846206d640 1 -- 172.21.15.6:0/3927591967 >> 172.21.15.6:0/3927591967 conn(0x7f845c0afcf0 msgr2=0x7f845c1556e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.025+0000 7f846206d640 1 -- 172.21.15.6:0/3927591967 shutdown_connections 2023-07-21T22:37:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.025+0000 7f846206d640 1 -- 172.21.15.6:0/3927591967 wait complete. 2023-07-21T22:37:15.093 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-21T22:37:15.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.197+0000 7f2bf6182640 1 Processor -- start 2023-07-21T22:37:15.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.197+0000 7f2bf6182640 1 -- start start 2023-07-21T22:37:15.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.197+0000 7f2bf6182640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2bf0069430 0x7f2bf00cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:15.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.197+0000 7f2bf6182640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2bf0160030 0x7f2bf0069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:15.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.197+0000 7f2bf6182640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf0069d40 con 0x7f2bf0070330 2023-07-21T22:37:15.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.197+0000 7f2bf6182640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf00cb7d0 con 0x7f2bf0069430 2023-07-21T22:37:15.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.197+0000 7f2bf6182640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf006c510 con 0x7f2bf0160030 2023-07-21T22:37:15.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.197+0000 7f2bef7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2bf0069430 0x7f2bf00cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:15.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.197+0000 7f2beffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2bf0070330 0x7f2bf0070750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38700/0 (socket says 172.21.15.6:38700) 2023-07-21T22:37:15.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.197+0000 7f2beffff640 1 -- 172.21.15.6:0/2695827495 learned_addr learned my addr 172.21.15.6:0/2695827495 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:15.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.197+0000 7f2beeffd640 1 --2- 172.21.15.6:0/2695827495 >> v2:172.21.15.161:3300/0 conn(0x7f2bf0160030 0x7f2bf0069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:15.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.201+0000 7f2bef7fe640 1 -- 172.21.15.6:0/2695827495 >> v2:172.21.15.161:3300/0 conn(0x7f2bf0160030 msgr2=0x7f2bf0069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:15.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.201+0000 7f2bef7fe640 1 --2- 172.21.15.6:0/2695827495 >> v2:172.21.15.161:3300/0 conn(0x7f2bf0160030 0x7f2bf0069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.201+0000 7f2bef7fe640 1 -- 172.21.15.6:0/2695827495 >> v1:172.21.15.6:6789/0 conn(0x7f2bf0070330 legacy=0x7f2bf0070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:15.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.201+0000 7f2bef7fe640 1 -- 172.21.15.6:0/2695827495 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf006c7f0 con 0x7f2bf0069430 2023-07-21T22:37:15.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.201+0000 7f2bee7fc640 1 -- 172.21.15.6:0/2695827495 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444879086 0 0) 0x7f2bf0069d40 con 0x7f2bf0070330 2023-07-21T22:37:15.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.201+0000 7f2bef7fe640 1 --2- 172.21.15.6:0/2695827495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0069430 0x7f2bf00cb0f0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0065f00 tx=0x7f2be001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5efe64a3a342d62 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:15.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.201+0000 7f2bee7fc640 1 -- 172.21.15.6:0/2695827495 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be00ac600 con 0x7f2bf0069430 2023-07-21T22:37:15.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.201+0000 7f2bee7fc640 1 -- 172.21.15.6:0/2695827495 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be00a8050 con 0x7f2bf0069430 2023-07-21T22:37:15.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.201+0000 7f2bee7fc640 1 -- 172.21.15.6:0/2695827495 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be00ac980 con 0x7f2bf0069430 2023-07-21T22:37:15.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.201+0000 7f2bf6182640 1 -- 172.21.15.6:0/2695827495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0069430 msgr2=0x7f2bf00cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:15.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.201+0000 7f2bf6182640 1 --2- 172.21.15.6:0/2695827495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0069430 0x7f2bf00cb0f0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0065f00 tx=0x7f2be001c3a0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.201+0000 7f2bf6182640 1 -- 172.21.15.6:0/2695827495 shutdown_connections 2023-07-21T22:37:15.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.201+0000 7f2bf6182640 1 --2- 172.21.15.6:0/2695827495 >> v2:172.21.15.161:3300/0 conn(0x7f2bf0160030 0x7f2bf0069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.201+0000 7f2bf6182640 1 --2- 172.21.15.6:0/2695827495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0069430 0x7f2bf00cb0f0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.201+0000 7f2bf6182640 1 -- 172.21.15.6:0/2695827495 >> 172.21.15.6:0/2695827495 conn(0x7f2bf00b1840 msgr2=0x7f2bf00cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:15.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.201+0000 7f2bf6182640 1 -- 172.21.15.6:0/2695827495 shutdown_connections 2023-07-21T22:37:15.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.201+0000 7f2bf6182640 1 -- 172.21.15.6:0/2695827495 wait complete. 2023-07-21T22:37:15.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bf6182640 1 Processor -- start 2023-07-21T22:37:15.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bf6182640 1 -- start start 2023-07-21T22:37:15.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bf6182640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0069430 0x7f2bf014df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:15.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bf6182640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2bf0070330 0x7f2bf015ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:15.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bf6182640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bf0160030 0x7f2bf014fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:15.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bf6182640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf0147da0 con 0x7f2bf0069430 2023-07-21T22:37:15.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bf6182640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf00c7cf0 con 0x7f2bf0160030 2023-07-21T22:37:15.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bf6182640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf014dd00 con 0x7f2bf0070330 2023-07-21T22:37:15.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bef7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0069430 0x7f2bf014df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:15.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bef7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0069430 0x7f2bf014df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56112/0 (socket says 172.21.15.6:56112) 2023-07-21T22:37:15.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bef7fe640 1 -- 172.21.15.6:0/3500496665 learned_addr learned my addr 172.21.15.6:0/3500496665 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:15.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bef7fe640 1 -- 172.21.15.6:0/3500496665 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2bf0070330 msgr2=0x7f2bf015ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:15.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bef7fe640 1 --2- 172.21.15.6:0/3500496665 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2bf0070330 0x7f2bf015ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bef7fe640 1 -- 172.21.15.6:0/3500496665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bf0160030 msgr2=0x7f2bf014fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:15.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bef7fe640 1 --2- 172.21.15.6:0/3500496665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bf0160030 0x7f2bf014fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bef7fe640 1 -- 172.21.15.6:0/3500496665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be0009420 con 0x7f2bf0069430 2023-07-21T22:37:15.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bef7fe640 1 --2- 172.21.15.6:0/3500496665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0069430 0x7f2bf014df10 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f2be0018fb0 tx=0x7f2be001abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:15.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bd7fff640 1 -- 172.21.15.6:0/3500496665 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be0006e20 con 0x7f2bf0069430 2023-07-21T22:37:15.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bd7fff640 1 -- 172.21.15.6:0/3500496665 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be0004030 con 0x7f2bf0069430 2023-07-21T22:37:15.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bd7fff640 1 -- 172.21.15.6:0/3500496665 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be00043a0 con 0x7f2bf0069430 2023-07-21T22:37:15.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.205+0000 7f2bf6182640 1 -- 172.21.15.6:0/3500496665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf01605b0 con 0x7f2bf0069430 2023-07-21T22:37:15.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.209+0000 7f2bf6182640 1 -- 172.21.15.6:0/3500496665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf015d140 con 0x7f2bf0069430 2023-07-21T22:37:15.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.209+0000 7f2bf6182640 1 -- 172.21.15.6:0/3500496665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf00678d0 con 0x7f2bf0069430 2023-07-21T22:37:15.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.209+0000 7f2bd7fff640 1 -- 172.21.15.6:0/3500496665 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2be00b3050 con 0x7f2bf0069430 2023-07-21T22:37:15.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.209+0000 7f2bd7fff640 1 --2- 172.21.15.6:0/3500496665 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f2bdc0663a0 0x7f2bdc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:15.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.209+0000 7f2bd7fff640 1 -- 172.21.15.6:0/3500496665 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6114+0+0 (secure 0 0 0) 0x7f2be011e1a0 con 0x7f2bf0069430 2023-07-21T22:37:15.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.209+0000 7f2beeffd640 1 --2- 172.21.15.6:0/3500496665 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f2bdc0663a0 0x7f2bdc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:15.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.213+0000 7f2beeffd640 1 --2- 172.21.15.6:0/3500496665 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f2bdc0663a0 0x7f2bdc068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2bf01f7870 tx=0x7f2be40095c0 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:15.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.213+0000 7f2bd7fff640 1 -- 172.21.15.6:0/3500496665 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2be00eb4d0 con 0x7f2bf0069430 2023-07-21T22:37:15.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.369+0000 7f2bf6182640 1 -- 172.21.15.6:0/3500496665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2bf006e920 con 0x7f2bf0069430 2023-07-21T22:37:15.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.373+0000 7f2bd7fff640 1 -- 172.21.15.6:0/3500496665 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2be00eeaf0 con 0x7f2bf0069430 2023-07-21T22:37:15.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.373+0000 7f2bf6182640 1 -- 172.21.15.6:0/3500496665 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f2bdc0663a0 msgr2=0x7f2bdc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:15.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.373+0000 7f2bf6182640 1 --2- 172.21.15.6:0/3500496665 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f2bdc0663a0 0x7f2bdc068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2bf01f7870 tx=0x7f2be40095c0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.373+0000 7f2bf6182640 1 -- 172.21.15.6:0/3500496665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0069430 msgr2=0x7f2bf014df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:15.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.373+0000 7f2bf6182640 1 --2- 172.21.15.6:0/3500496665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0069430 0x7f2bf014df10 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f2be0018fb0 tx=0x7f2be001abe0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.373+0000 7f2bf6182640 1 -- 172.21.15.6:0/3500496665 shutdown_connections 2023-07-21T22:37:15.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.373+0000 7f2bf6182640 1 --2- 172.21.15.6:0/3500496665 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f2bdc0663a0 0x7f2bdc068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.373+0000 7f2bf6182640 1 --2- 172.21.15.6:0/3500496665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bf0160030 0x7f2bf014fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.373+0000 7f2bf6182640 1 --2- 172.21.15.6:0/3500496665 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2bf0070330 0x7f2bf015ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.373+0000 7f2bf6182640 1 --2- 172.21.15.6:0/3500496665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bf0069430 0x7f2bf014df10 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.373+0000 7f2bf6182640 1 -- 172.21.15.6:0/3500496665 >> 172.21.15.6:0/3500496665 conn(0x7f2bf00b1840 msgr2=0x7f2bf00b4410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:15.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.377+0000 7f2bf6182640 1 -- 172.21.15.6:0/3500496665 shutdown_connections 2023-07-21T22:37:15.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.377+0000 7f2bf6182640 1 -- 172.21.15.6:0/3500496665 wait complete. 2023-07-21T22:37:15.440 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:37:15.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:37:15.499 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:37:15.565 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:37:15.565 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:37:15.565 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:37:15.574 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:37:15.575 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:37:15.575 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:37:15.585 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:37:15.585 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:37:15.586 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:37:15.625 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:37:15.625 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:37:15.626 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:37:15.638 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:37:15.638 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-21T22:37:15.638 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:37:15.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.765+0000 7fe04ac0b640 1 Processor -- start 2023-07-21T22:37:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.765+0000 7fe04ac0b640 1 -- start start 2023-07-21T22:37:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.765+0000 7fe04ac0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe044158ce0 0x7fe044070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe04ac0b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0440cc700 con 0x7fe0440c8ad0 2023-07-21T22:37:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe04ac0b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0440b0ff0 con 0x7fe0440c9730 2023-07-21T22:37:15.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe04ac0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe044070c80 con 0x7fe044158ce0 2023-07-21T22:37:15.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe043fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe0440c8ad0 0x7fe0440c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38702/0 (socket says 172.21.15.6:38702) 2023-07-21T22:37:15.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe043fff640 1 -- 172.21.15.6:0/1535042861 learned_addr learned my addr 172.21.15.6:0/1535042861 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:15.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe0489a7640 1 --2- 172.21.15.6:0/1535042861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe044158ce0 0x7fe044070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:15.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe0437fe640 1 -- 172.21.15.6:0/1535042861 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469530969 0 0) 0x7fe0440cc700 con 0x7fe0440c8ad0 2023-07-21T22:37:15.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe0437fe640 1 -- 172.21.15.6:0/1535042861 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe034003530 con 0x7fe0440c8ad0 2023-07-21T22:37:15.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe0437fe640 1 -- 172.21.15.6:0/1535042861 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3034099036 0 0) 0x7fe0440b0ff0 con 0x7fe0440c9730 2023-07-21T22:37:15.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe0437fe640 1 -- 172.21.15.6:0/1535042861 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0440cc700 con 0x7fe0440c9730 2023-07-21T22:37:15.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe0437fe640 1 -- 172.21.15.6:0/1535042861 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2662772105 0 0) 0x7fe034003530 con 0x7fe0440c8ad0 2023-07-21T22:37:15.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe0437fe640 1 -- 172.21.15.6:0/1535042861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe044158ce0 msgr2=0x7fe044070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:15.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe0437fe640 1 --2- 172.21.15.6:0/1535042861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe044158ce0 0x7fe044070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe0437fe640 1 -- 172.21.15.6:0/1535042861 >> v1:172.21.15.161:6789/0 conn(0x7fe0440c9730 legacy=0x7fe0440ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:15.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe0437fe640 1 -- 172.21.15.6:0/1535042861 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0440cbdd0 con 0x7fe0440c8ad0 2023-07-21T22:37:15.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe0437fe640 1 -- 172.21.15.6:0/1535042861 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fe030001680 con 0x7fe0440c8ad0 2023-07-21T22:37:15.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe0437fe640 1 -- 172.21.15.6:0/1535042861 >> v1:172.21.15.6:6789/0 conn(0x7fe0440c8ad0 legacy=0x7fe0440c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:15.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe0437fe640 1 --2- 172.21.15.6:0/1535042861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe034003b40 0x7fe034003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:15.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe0437fe640 1 --2- 172.21.15.6:0/1535042861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0340047d0 0x7fe034004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:15.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe0437fe640 1 --2- 172.21.15.6:0/1535042861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0340051d0 0x7fe03400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:15.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe0437fe640 1 -- 172.21.15.6:0/1535042861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe044070c80 con 0x7fe0340047d0 2023-07-21T22:37:15.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe0437fe640 1 -- 172.21.15.6:0/1535042861 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03400e2f0 con 0x7fe0340051d0 2023-07-21T22:37:15.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe0437fe640 1 -- 172.21.15.6:0/1535042861 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03400e4b0 con 0x7fe034003b40 2023-07-21T22:37:15.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe043fff640 1 --2- 172.21.15.6:0/1535042861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0340047d0 0x7fe034004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:15.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe0489a7640 1 --2- 172.21.15.6:0/1535042861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe034003b40 0x7fe034003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:15.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe0491a8640 1 --2- 172.21.15.6:0/1535042861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0340051d0 0x7fe03400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:15.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe043fff640 1 -- 172.21.15.6:0/1535042861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe034003b40 msgr2=0x7fe034003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:15.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe043fff640 1 --2- 172.21.15.6:0/1535042861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe034003b40 0x7fe034003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe043fff640 1 -- 172.21.15.6:0/1535042861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0340051d0 msgr2=0x7fe03400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:15.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe043fff640 1 --2- 172.21.15.6:0/1535042861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0340051d0 0x7fe03400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.769+0000 7fe043fff640 1 -- 172.21.15.6:0/1535042861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe034003530 con 0x7fe0340047d0 2023-07-21T22:37:15.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.773+0000 7fe043fff640 1 --2- 172.21.15.6:0/1535042861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0340047d0 0x7fe034004c40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fe030001ec0 tx=0x7fe03001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99fba0b345fab7e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:15.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.773+0000 7fe0437fe640 1 -- 172.21.15.6:0/1535042861 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe030005ae0 con 0x7fe0340047d0 2023-07-21T22:37:15.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.773+0000 7fe0437fe640 1 -- 172.21.15.6:0/1535042861 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe030005c40 con 0x7fe0340047d0 2023-07-21T22:37:15.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.773+0000 7fe0437fe640 1 -- 172.21.15.6:0/1535042861 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0300a59a0 con 0x7fe0340047d0 2023-07-21T22:37:15.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.773+0000 7fe04ac0b640 1 -- 172.21.15.6:0/1535042861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0340047d0 msgr2=0x7fe034004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:15.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.773+0000 7fe04ac0b640 1 --2- 172.21.15.6:0/1535042861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0340047d0 0x7fe034004c40 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fe030001ec0 tx=0x7fe03001ca90 comp rx=0 tx=0).stop 2023-07-21T22:37:15.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.773+0000 7fe0491a8640 1 -- 172.21.15.6:0/1535042861 reap_dead start 2023-07-21T22:37:15.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.773+0000 7fe04ac0b640 1 -- 172.21.15.6:0/1535042861 shutdown_connections 2023-07-21T22:37:15.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.773+0000 7fe04ac0b640 1 -- 172.21.15.6:0/1535042861 >> 172.21.15.6:0/1535042861 conn(0x7fe0440afcf0 msgr2=0x7fe0440b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:15.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.773+0000 7fe04ac0b640 1 -- 172.21.15.6:0/1535042861 shutdown_connections 2023-07-21T22:37:15.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.773+0000 7fe04ac0b640 1 -- 172.21.15.6:0/1535042861 wait complete. 2023-07-21T22:37:15.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.773+0000 7fe04ac0b640 1 Processor -- start 2023-07-21T22:37:15.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.773+0000 7fe04ac0b640 1 -- start start 2023-07-21T22:37:15.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe04ac0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0340047d0 0x7fe0440b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:15.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe04ac0b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe04414d250 0x7fe04414d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:15.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe04ac0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0441f4870 0x7fe0441f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:15.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe04ac0b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04414dc00 con 0x7fe0340047d0 2023-07-21T22:37:15.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe04ac0b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0440c3370 con 0x7fe04414d250 2023-07-21T22:37:15.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe04ac0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0440c3630 con 0x7fe0441f4870 2023-07-21T22:37:15.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe0489a7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0340047d0 0x7fe0440b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:15.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe0489a7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0340047d0 0x7fe0440b3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56130/0 (socket says 172.21.15.6:56130) 2023-07-21T22:37:15.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe0489a7640 1 -- 172.21.15.6:0/2271779922 learned_addr learned my addr 172.21.15.6:0/2271779922 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:15.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe043fff640 1 --2- 172.21.15.6:0/2271779922 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe04414d250 0x7fe04414d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:15.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe0491a8640 1 --2- 172.21.15.6:0/2271779922 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0441f4870 0x7fe0441f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:15.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe0489a7640 1 -- 172.21.15.6:0/2271779922 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0441f4870 msgr2=0x7fe0441f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:15.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe0489a7640 1 --2- 172.21.15.6:0/2271779922 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0441f4870 0x7fe0441f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe0489a7640 1 -- 172.21.15.6:0/2271779922 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe04414d250 msgr2=0x7fe04414d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:15.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe0489a7640 1 --2- 172.21.15.6:0/2271779922 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe04414d250 0x7fe04414d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:15.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe0489a7640 1 -- 172.21.15.6:0/2271779922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0440c3910 con 0x7fe0340047d0 2023-07-21T22:37:15.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe0489a7640 1 --2- 172.21.15.6:0/2271779922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0340047d0 0x7fe0440b3980 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fe038011890 tx=0x7fe038011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:15.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe0417fa640 1 -- 172.21.15.6:0/2271779922 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038004240 con 0x7fe0340047d0 2023-07-21T22:37:15.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe0417fa640 1 -- 172.21.15.6:0/2271779922 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0380043a0 con 0x7fe0340047d0 2023-07-21T22:37:15.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe04ac0b640 1 -- 172.21.15.6:0/2271779922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0440c3bf0 con 0x7fe0340047d0 2023-07-21T22:37:15.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe0417fa640 1 -- 172.21.15.6:0/2271779922 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038003860 con 0x7fe0340047d0 2023-07-21T22:37:15.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe04ac0b640 1 -- 172.21.15.6:0/2271779922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0440c43f0 con 0x7fe0340047d0 2023-07-21T22:37:15.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe04ac0b640 1 -- 172.21.15.6:0/2271779922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0440ca1a0 con 0x7fe0340047d0 2023-07-21T22:37:15.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.777+0000 7fe0417fa640 1 -- 172.21.15.6:0/2271779922 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe0380039c0 con 0x7fe0340047d0 2023-07-21T22:37:15.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.781+0000 7fe0417fa640 1 --2- 172.21.15.6:0/2271779922 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe0280663d0 0x7fe028068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:15.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.781+0000 7fe0417fa640 1 -- 172.21.15.6:0/2271779922 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6114+0+0 (secure 0 0 0) 0x7fe038083fc0 con 0x7fe0340047d0 2023-07-21T22:37:15.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.781+0000 7fe043fff640 1 --2- 172.21.15.6:0/2271779922 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe0280663d0 0x7fe028068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:15.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.781+0000 7fe043fff640 1 --2- 172.21.15.6:0/2271779922 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe0280663d0 0x7fe028068880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe0300ab000 tx=0x7fe0300a7070 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:15.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.785+0000 7fe0417fa640 1 -- 172.21.15.6:0/2271779922 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe038051300 con 0x7fe0340047d0 2023-07-21T22:37:16.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.973+0000 7fe04ac0b640 1 -- 172.21.15.6:0/2271779922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0440678d0 con 0x7fe0340047d0 2023-07-21T22:37:16.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.973+0000 7fe0417fa640 1 -- 172.21.15.6:0/2271779922 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+3523 (secure 0 0 0) 0x7fe038023090 con 0x7fe0340047d0 2023-07-21T22:37:16.018 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:16.018 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":49,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6716,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/128364815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":128364815},{"type":"v1","addr":"172.21.15.161:6836","nonce":128364815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":6719,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1447795142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1447795142},{"type":"v1","addr":"172.21.15.161:6837","nonce":1447795142}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7653,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6833/921116259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":921116259},{"type":"v1","addr":"172.21.15.6:6833","nonce":921116259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":8118,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2612049777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":2612049777},{"type":"v1","addr":"172.21.15.6:6835","nonce":2612049777}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[]} 2023-07-21T22:37:16.019 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 49 2023-07-21T22:37:16.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.973+0000 7fe04ac0b640 1 -- 172.21.15.6:0/2271779922 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe0280663d0 msgr2=0x7fe028068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:16.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.973+0000 7fe04ac0b640 1 --2- 172.21.15.6:0/2271779922 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe0280663d0 0x7fe028068880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe0300ab000 tx=0x7fe0300a7070 comp rx=0 tx=0).stop 2023-07-21T22:37:16.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.973+0000 7fe04ac0b640 1 -- 172.21.15.6:0/2271779922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0340047d0 msgr2=0x7fe0440b3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:16.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.973+0000 7fe04ac0b640 1 --2- 172.21.15.6:0/2271779922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0340047d0 0x7fe0440b3980 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fe038011890 tx=0x7fe038011980 comp rx=0 tx=0).stop 2023-07-21T22:37:16.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.973+0000 7fe04ac0b640 1 -- 172.21.15.6:0/2271779922 shutdown_connections 2023-07-21T22:37:16.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.973+0000 7fe04ac0b640 1 --2- 172.21.15.6:0/2271779922 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe0280663d0 0x7fe028068880 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:16.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.973+0000 7fe04ac0b640 1 --2- 172.21.15.6:0/2271779922 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe0441f4870 0x7fe0441f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:16.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.973+0000 7fe04ac0b640 1 --2- 172.21.15.6:0/2271779922 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe04414d250 0x7fe04414d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:16.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.973+0000 7fe04ac0b640 1 --2- 172.21.15.6:0/2271779922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0340047d0 0x7fe0440b3980 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:16.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.973+0000 7fe04ac0b640 1 -- 172.21.15.6:0/2271779922 >> 172.21.15.6:0/2271779922 conn(0x7fe0440afcf0 msgr2=0x7fe04406f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:16.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.973+0000 7fe04ac0b640 1 -- 172.21.15.6:0/2271779922 shutdown_connections 2023-07-21T22:37:16.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:15.973+0000 7fe04ac0b640 1 -- 172.21.15.6:0/2271779922 wait complete. 2023-07-21T22:37:16.039 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-21T22:37:16.040 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-21T22:37:16.040 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-21T22:37:16.040 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:37:16.041 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-21T22:37:16.041 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-21T22:37:16.041 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-21T22:37:16.041 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:37:16.042 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-21T22:37:16.042 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-21T22:37:16.042 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-21T22:37:16.042 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:37:16.042 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-21T22:37:16.043 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-21T22:37:16.043 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-21T22:37:16.043 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:37:16.054 INFO:tasks.ceph.mds.a:Stopped 2023-07-21T22:37:16.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-21T22:37:16.056 INFO:tasks.ceph.mds.c:Stopped 2023-07-21T22:37:16.056 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-21T22:37:16.058 INFO:tasks.ceph.mds.b:Stopped 2023-07-21T22:37:16.058 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-21T22:37:16.059 INFO:tasks.ceph.mds.d:Stopped 2023-07-21T22:37:16.059 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-21T22:37:16.103 INFO:tasks.ceph.mds.a:Started 2023-07-21T22:37:16.103 DEBUG:teuthology.parallel:result is None 2023-07-21T22:37:16.105 INFO:tasks.ceph.mds.b:Started 2023-07-21T22:37:16.105 DEBUG:teuthology.parallel:result is None 2023-07-21T22:37:16.106 INFO:tasks.ceph.mds.c:Started 2023-07-21T22:37:16.106 DEBUG:teuthology.parallel:result is None 2023-07-21T22:37:16.107 INFO:tasks.ceph.mds.d:Started 2023-07-21T22:37:16.107 DEBUG:teuthology.parallel:result is None 2023-07-21T22:37:16.108 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-21T22:37:16.192 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-07-21T22:37:16.193 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-21T22:37:16.200 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2023-07-21T22:37:16.201 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-07-21T22:37:16.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.213+0000 7ff00ea48640 1 Processor -- start 2023-07-21T22:37:16.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.213+0000 7ff00ea48640 1 -- start start 2023-07-21T22:37:16.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.213+0000 7ff00ea48640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff008160450 0x7ff00806e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:16.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.213+0000 7ff00ea48640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0080c9c30 con 0x7ff00815bc00 2023-07-21T22:37:16.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.213+0000 7ff00ea48640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff00815bfd0 con 0x7ff008069430 2023-07-21T22:37:16.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.213+0000 7ff00ea48640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0080c96b0 con 0x7ff008160450 2023-07-21T22:37:16.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.213+0000 7ff007fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff00815bc00 0x7ff0080ce8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:38708/0 (socket says 172.21.15.6:38708) 2023-07-21T22:37:16.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.213+0000 7ff0077fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff008160450 0x7ff00806e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:16.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.213+0000 7ff007fff640 1 -- 172.21.15.6:0/608012412 learned_addr learned my addr 172.21.15.6:0/608012412 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:16.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.213+0000 7ff0077fe640 1 -- 172.21.15.6:0/608012412 >> v1:172.21.15.161:6789/0 conn(0x7ff008069430 legacy=0x7ff008069830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:16.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.213+0000 7ff0077fe640 1 -- 172.21.15.6:0/608012412 >> v1:172.21.15.6:6789/0 conn(0x7ff00815bc00 legacy=0x7ff0080ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:16.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.213+0000 7ff0077fe640 1 -- 172.21.15.6:0/608012412 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0080cf910 con 0x7ff008160450 2023-07-21T22:37:16.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.217+0000 7ff0077fe640 1 --2- 172.21.15.6:0/608012412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff008160450 0x7ff00806e690 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7feffc0097c0 tx=0x7feffc01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3ff075f688073de server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:16.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.217+0000 7ff006ffd640 1 -- 172.21.15.6:0/608012412 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc0ab650 con 0x7ff008160450 2023-07-21T22:37:16.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.217+0000 7ff006ffd640 1 -- 172.21.15.6:0/608012412 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feffc0ab7b0 con 0x7ff008160450 2023-07-21T22:37:16.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.217+0000 7ff006ffd640 1 -- 172.21.15.6:0/608012412 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc0abb40 con 0x7ff008160450 2023-07-21T22:37:16.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.217+0000 7ff00ea48640 1 -- 172.21.15.6:0/608012412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff008160450 msgr2=0x7ff00806e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:16.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.217+0000 7ff00ea48640 1 --2- 172.21.15.6:0/608012412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff008160450 0x7ff00806e690 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7feffc0097c0 tx=0x7feffc01c450 comp rx=0 tx=0).stop 2023-07-21T22:37:16.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.217+0000 7ff00ea48640 1 -- 172.21.15.6:0/608012412 shutdown_connections 2023-07-21T22:37:16.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.217+0000 7ff00ea48640 1 --2- 172.21.15.6:0/608012412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff008160450 0x7ff00806e690 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:16.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.217+0000 7ff00ea48640 1 -- 172.21.15.6:0/608012412 >> 172.21.15.6:0/608012412 conn(0x7ff0080b1840 msgr2=0x7ff0080cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:16.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.217+0000 7ff00ea48640 1 -- 172.21.15.6:0/608012412 shutdown_connections 2023-07-21T22:37:16.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.217+0000 7ff00ea48640 1 -- 172.21.15.6:0/608012412 wait complete. 2023-07-21T22:37:16.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff00ea48640 1 Processor -- start 2023-07-21T22:37:16.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff00ea48640 1 -- start start 2023-07-21T22:37:16.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff00ea48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff008069430 0x7ff00815e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:16.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff00ea48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00815bc00 0x7ff00814f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:16.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff00ea48640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff008160450 0x7ff0080c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:16.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff00ea48640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0080c4d10 con 0x7ff00815bc00 2023-07-21T22:37:16.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff00ea48640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0080c57a0 con 0x7ff008160450 2023-07-21T22:37:16.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff00ea48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0080c46c0 con 0x7ff008069430 2023-07-21T22:37:16.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff0077fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00815bc00 0x7ff00814f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:16.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff0077fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00815bc00 0x7ff00814f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56186/0 (socket says 172.21.15.6:56186) 2023-07-21T22:37:16.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff0077fe640 1 -- 172.21.15.6:0/4153678672 learned_addr learned my addr 172.21.15.6:0/4153678672 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:16.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff00cfe5640 1 --2- 172.21.15.6:0/4153678672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff008160450 0x7ff0080c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:16.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff007fff640 1 --2- 172.21.15.6:0/4153678672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff008069430 0x7ff00815e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:16.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff0077fe640 1 -- 172.21.15.6:0/4153678672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff008069430 msgr2=0x7ff00815e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:16.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff0077fe640 1 --2- 172.21.15.6:0/4153678672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff008069430 0x7ff00815e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:16.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff0077fe640 1 -- 172.21.15.6:0/4153678672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff008160450 msgr2=0x7ff0080c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:16.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff0077fe640 1 --2- 172.21.15.6:0/4153678672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff008160450 0x7ff0080c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:16.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff0077fe640 1 -- 172.21.15.6:0/4153678672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc009420 con 0x7ff00815bc00 2023-07-21T22:37:16.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff00cfe5640 1 --2- 172.21.15.6:0/4153678672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff008160450 0x7ff0080c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:37:16.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff007fff640 1 --2- 172.21.15.6:0/4153678672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff008069430 0x7ff00815e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:37:16.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff0077fe640 1 --2- 172.21.15.6:0/4153678672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00815bc00 0x7ff00814f2e0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7feffc0ad040 tx=0x7feffc01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:16.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff004ff9640 1 -- 172.21.15.6:0/4153678672 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc0b5810 con 0x7ff00815bc00 2023-07-21T22:37:16.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff004ff9640 1 -- 172.21.15.6:0/4153678672 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feffc0b59b0 con 0x7ff00815bc00 2023-07-21T22:37:16.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff004ff9640 1 -- 172.21.15.6:0/4153678672 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc0b5d60 con 0x7ff00815bc00 2023-07-21T22:37:16.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.221+0000 7ff00ea48640 1 -- 172.21.15.6:0/4153678672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0080c49a0 con 0x7ff00815bc00 2023-07-21T22:37:16.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.225+0000 7ff00ea48640 1 -- 172.21.15.6:0/4153678672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff00814f9b0 con 0x7ff00815bc00 2023-07-21T22:37:16.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.225+0000 7ff00ea48640 1 -- 172.21.15.6:0/4153678672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0080c4b30 con 0x7ff00815bc00 2023-07-21T22:37:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.225+0000 7ff004ff9640 1 -- 172.21.15.6:0/4153678672 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7feffc0b4390 con 0x7ff00815bc00 2023-07-21T22:37:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.225+0000 7ff004ff9640 1 --2- 172.21.15.6:0/4153678672 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7feff40663a0 0x7feff4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:16.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.225+0000 7ff004ff9640 1 -- 172.21.15.6:0/4153678672 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6114+0+0 (secure 0 0 0) 0x7feffc11eb40 con 0x7ff00815bc00 2023-07-21T22:37:16.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.225+0000 7ff007fff640 1 --2- 172.21.15.6:0/4153678672 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7feff40663a0 0x7feff4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:16.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.225+0000 7ff007fff640 1 --2- 172.21.15.6:0/4153678672 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7feff40663a0 0x7feff4068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feff8005890 tx=0x7feff8009040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:16.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.229+0000 7ff004ff9640 1 -- 172.21.15.6:0/4153678672 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feffc0ebdd0 con 0x7ff00815bc00 2023-07-21T22:37:16.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:16.401+0000 7ff00ea48640 1 -- 172.21.15.6:0/4153678672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff0080678d0 con 0x7ff00815bc00 2023-07-21T22:37:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.405+0000 7ff004ff9640 1 -- 172.21.15.6:0/4153678672 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v124) v1 ==== 97+0+0 (secure 0 0 0) 0x7feffc0ef3f0 con 0x7ff00815bc00 2023-07-21T22:37:17.450 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-07-21T22:37:17.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.405+0000 7ff00ea48640 1 -- 172.21.15.6:0/4153678672 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7feff40663a0 msgr2=0x7feff4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:17.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.405+0000 7ff00ea48640 1 --2- 172.21.15.6:0/4153678672 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7feff40663a0 0x7feff4068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feff8005890 tx=0x7feff8009040 comp rx=0 tx=0).stop 2023-07-21T22:37:17.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.405+0000 7ff00ea48640 1 -- 172.21.15.6:0/4153678672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00815bc00 msgr2=0x7ff00814f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:17.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.405+0000 7ff00ea48640 1 --2- 172.21.15.6:0/4153678672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00815bc00 0x7ff00814f2e0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7feffc0ad040 tx=0x7feffc01ac90 comp rx=0 tx=0).stop 2023-07-21T22:37:17.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.405+0000 7ff00ea48640 1 -- 172.21.15.6:0/4153678672 shutdown_connections 2023-07-21T22:37:17.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.405+0000 7ff00ea48640 1 --2- 172.21.15.6:0/4153678672 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7feff40663a0 0x7feff4068850 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:17.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.405+0000 7ff00ea48640 1 --2- 172.21.15.6:0/4153678672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff008160450 0x7ff0080c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:17.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.405+0000 7ff00ea48640 1 --2- 172.21.15.6:0/4153678672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00815bc00 0x7ff00814f2e0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:17.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.405+0000 7ff00ea48640 1 --2- 172.21.15.6:0/4153678672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff008069430 0x7ff00815e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:17.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.405+0000 7ff00ea48640 1 -- 172.21.15.6:0/4153678672 >> 172.21.15.6:0/4153678672 conn(0x7ff0080b1840 msgr2=0x7ff0080cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:17.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.405+0000 7ff00ea48640 1 -- 172.21.15.6:0/4153678672 shutdown_connections 2023-07-21T22:37:17.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.405+0000 7ff00ea48640 1 -- 172.21.15.6:0/4153678672 wait complete. 2023-07-21T22:37:17.476 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-21T22:37:17.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.581+0000 7f55ab99f640 1 Processor -- start 2023-07-21T22:37:17.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.581+0000 7f55ab99f640 1 -- start start 2023-07-21T22:37:17.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.581+0000 7f55ab99f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f55a415f970 0x7f55a415fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:17.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.581+0000 7f55ab99f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f55a40c8e70 0x7f55a40c9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:17.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.581+0000 7f55ab99f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a4160330 con 0x7f55a415bdf0 2023-07-21T22:37:17.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.581+0000 7f55ab99f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a40cb080 con 0x7f55a415f970 2023-07-21T22:37:17.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.581+0000 7f55ab99f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a40cb2e0 con 0x7f55a40c8e70 2023-07-21T22:37:17.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.581+0000 7f55a8f3a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f55a415f970 0x7f55a415fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:17.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.581+0000 7f55a8f3a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f55a415f970 0x7f55a415fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46616/0 (socket says 172.21.15.6:46616) 2023-07-21T22:37:17.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.581+0000 7f55a8f3a640 1 -- 172.21.15.6:0/1099160896 learned_addr learned my addr 172.21.15.6:0/1099160896 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:17.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.581+0000 7f55a9f3c640 1 --2- 172.21.15.6:0/1099160896 >> v2:172.21.15.161:3300/0 conn(0x7f55a40c8e70 0x7f55a40c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:17.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.581+0000 7f55a8f3a640 1 -- 172.21.15.6:0/1099160896 >> v2:172.21.15.161:3300/0 conn(0x7f55a40c8e70 msgr2=0x7f55a40c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:17.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.581+0000 7f55a8f3a640 1 --2- 172.21.15.6:0/1099160896 >> v2:172.21.15.161:3300/0 conn(0x7f55a40c8e70 0x7f55a40c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:17.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.581+0000 7f55a8f3a640 1 -- 172.21.15.6:0/1099160896 >> v1:172.21.15.161:6789/0 conn(0x7f55a415bdf0 legacy=0x7f55a40ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:17.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.581+0000 7f55a8f3a640 1 -- 172.21.15.6:0/1099160896 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a40cb5c0 con 0x7f55a415f970 2023-07-21T22:37:17.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.581+0000 7f55a9f3c640 1 --2- 172.21.15.6:0/1099160896 >> v2:172.21.15.161:3300/0 conn(0x7f55a40c8e70 0x7f55a40c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:17.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.585+0000 7f55a8f3a640 1 --2- 172.21.15.6:0/1099160896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55a415f970 0x7f55a415fdf0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f55a40c51c0 tx=0x7f559401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b664478a09d58d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:17.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.585+0000 7f559bfff640 1 -- 172.21.15.6:0/1099160896 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55940ab640 con 0x7f55a415f970 2023-07-21T22:37:17.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.585+0000 7f559bfff640 1 -- 172.21.15.6:0/1099160896 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55940a7070 con 0x7f55a415f970 2023-07-21T22:37:17.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.585+0000 7f559bfff640 1 -- 172.21.15.6:0/1099160896 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55940ab9c0 con 0x7f55a415f970 2023-07-21T22:37:17.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.585+0000 7f55ab99f640 1 -- 172.21.15.6:0/1099160896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55a415f970 msgr2=0x7f55a415fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:17.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.585+0000 7f55ab99f640 1 --2- 172.21.15.6:0/1099160896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55a415f970 0x7f55a415fdf0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f55a40c51c0 tx=0x7f559401c440 comp rx=0 tx=0).stop 2023-07-21T22:37:17.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.585+0000 7f55ab99f640 1 -- 172.21.15.6:0/1099160896 shutdown_connections 2023-07-21T22:37:17.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.585+0000 7f55ab99f640 1 --2- 172.21.15.6:0/1099160896 >> v2:172.21.15.161:3300/0 conn(0x7f55a40c8e70 0x7f55a40c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:17.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.585+0000 7f55ab99f640 1 --2- 172.21.15.6:0/1099160896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55a415f970 0x7f55a415fdf0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:17.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.585+0000 7f55ab99f640 1 -- 172.21.15.6:0/1099160896 >> 172.21.15.6:0/1099160896 conn(0x7f55a40afcf0 msgr2=0x7f55a40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:17.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.585+0000 7f55ab99f640 1 -- 172.21.15.6:0/1099160896 shutdown_connections 2023-07-21T22:37:17.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.585+0000 7f55ab99f640 1 -- 172.21.15.6:0/1099160896 wait complete. 2023-07-21T22:37:17.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55ab99f640 1 Processor -- start 2023-07-21T22:37:17.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55ab99f640 1 -- start start 2023-07-21T22:37:17.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55ab99f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55a40c8e70 0x7f55a4155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:17.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55ab99f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55a415bdf0 0x7f55a40c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:17.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55ab99f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55a415f970 0x7f55a4153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:17.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55ab99f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a4159ea0 con 0x7f55a40c8e70 2023-07-21T22:37:17.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55ab99f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a40c5770 con 0x7f55a415f970 2023-07-21T22:37:17.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55ab99f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a40c7bf0 con 0x7f55a415bdf0 2023-07-21T22:37:17.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55a973b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55a40c8e70 0x7f55a4155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:17.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55a973b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55a40c8e70 0x7f55a4155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46630/0 (socket says 172.21.15.6:46630) 2023-07-21T22:37:17.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55a973b640 1 -- 172.21.15.6:0/977214076 learned_addr learned my addr 172.21.15.6:0/977214076 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:17.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55a9f3c640 1 --2- 172.21.15.6:0/977214076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55a415f970 0x7f55a4153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:17.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55a8f3a640 1 --2- 172.21.15.6:0/977214076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55a415bdf0 0x7f55a40c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:17.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55a973b640 1 -- 172.21.15.6:0/977214076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55a415bdf0 msgr2=0x7f55a40c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:17.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55a973b640 1 --2- 172.21.15.6:0/977214076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55a415bdf0 0x7f55a40c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:17.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55a973b640 1 -- 172.21.15.6:0/977214076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55a415f970 msgr2=0x7f55a4153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:17.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55a973b640 1 --2- 172.21.15.6:0/977214076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55a415f970 0x7f55a4153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:17.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55a973b640 1 -- 172.21.15.6:0/977214076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55940094d0 con 0x7f55a40c8e70 2023-07-21T22:37:17.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55a973b640 1 --2- 172.21.15.6:0/977214076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55a40c8e70 0x7f55a4155980 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f55a000c530 tx=0x7f55a000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:17.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f5599ffb640 1 -- 172.21.15.6:0/977214076 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a0005220 con 0x7f55a40c8e70 2023-07-21T22:37:17.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f5599ffb640 1 -- 172.21.15.6:0/977214076 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a0005380 con 0x7f55a40c8e70 2023-07-21T22:37:17.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f5599ffb640 1 -- 172.21.15.6:0/977214076 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a0007270 con 0x7f55a40c8e70 2023-07-21T22:37:17.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55ab99f640 1 -- 172.21.15.6:0/977214076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a40c7ed0 con 0x7f55a40c8e70 2023-07-21T22:37:17.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.589+0000 7f55ab99f640 1 -- 172.21.15.6:0/977214076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a40b1220 con 0x7f55a40c8e70 2023-07-21T22:37:17.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.593+0000 7f55ab99f640 1 -- 172.21.15.6:0/977214076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a40c8110 con 0x7f55a40c8e70 2023-07-21T22:37:17.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.593+0000 7f5599ffb640 1 -- 172.21.15.6:0/977214076 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f55a00073d0 con 0x7f55a40c8e70 2023-07-21T22:37:17.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.593+0000 7f5599ffb640 1 --2- 172.21.15.6:0/977214076 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f55880663a0 0x7f5588068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:17.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.593+0000 7f5599ffb640 1 -- 172.21.15.6:0/977214076 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5254+0+0 (secure 0 0 0) 0x7f55a0083280 con 0x7f55a40c8e70 2023-07-21T22:37:17.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.593+0000 7f55a8f3a640 1 --2- 172.21.15.6:0/977214076 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f55880663a0 0x7f5588068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:17.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.593+0000 7f55a8f3a640 1 --2- 172.21.15.6:0/977214076 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f55880663a0 0x7f5588068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f55940af000 tx=0x7f55940a7000 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:17.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.597+0000 7f5599ffb640 1 -- 172.21.15.6:0/977214076 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f55a0050900 con 0x7f55a40c8e70 2023-07-21T22:37:17.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.805+0000 7f55ab99f640 1 -- 172.21.15.6:0/977214076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f55a4160330 con 0x7f55a40c8e70 2023-07-21T22:37:17.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.805+0000 7f5599ffb640 1 -- 172.21.15.6:0/977214076 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f55a4160330 con 0x7f55a40c8e70 2023-07-21T22:37:17.852 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:17.853 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:37:17.853 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-07-21T22:37:17.853 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:17.853 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-07-21T22:37:17.853 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkHn5HNxAADk0AaSGwZfEj3SwNvEm8hw==", 2023-07-21T22:37:17.853 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:37:17.853 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:37:17.853 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:37:17.854 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:37:17.854 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:37:17.854 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:17.854 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:37:17.855 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:17.855 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-07-21T22:37:17.855 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkQFvXCBAANxf0/I2RQcHy4iYiydjkcg==", 2023-07-21T22:37:17.855 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:37:17.855 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:37:17.856 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:37:17.856 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:37:17.856 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:37:17.856 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:17.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:37:17.856 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:17.856 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-07-21T22:37:17.857 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkYtGXAxAAy+RDDBSvc1FeZq+eg23tRA==", 2023-07-21T22:37:17.857 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:37:17.857 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:37:17.857 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:37:17.857 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:37:17.857 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:37:17.857 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:17.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:37:17.858 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:17.858 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-07-21T22:37:17.858 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkH+Y1EBAAl+qTqd+gFrB9LtJWwD5dgA==", 2023-07-21T22:37:17.858 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:37:17.858 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:37:17.858 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:37:17.858 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:37:17.859 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:37:17.859 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:17.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:37:17.859 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:17.859 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-07-21T22:37:17.859 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAKBLtkPwZrLBAAQHZECi2zHST1MKYgGoa/Iw==", 2023-07-21T22:37:17.859 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:37:17.859 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:37:17.860 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:37:17.860 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:37:17.860 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:17.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:37:17.860 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:17.860 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-07-21T22:37:17.860 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQANBLtkvwgwNBAApurMm8c3pSlX2r16Gli/Ag==", 2023-07-21T22:37:17.861 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:37:17.861 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:37:17.861 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:37:17.861 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:37:17.861 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:17.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:37:17.861 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:17.861 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-07-21T22:37:17.862 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAQBLtkf2p1OxAAcKYw2RixFefYAwcfkGnOKQ==", 2023-07-21T22:37:17.862 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:37:17.862 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:37:17.862 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:37:17.862 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:37:17.862 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:17.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:37:17.863 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:17.863 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-07-21T22:37:17.863 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAUBLtkQUl6BhAAXXT1ZK1h9aZEcp6qIHsLiA==", 2023-07-21T22:37:17.863 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:37:17.863 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:37:17.863 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:37:17.863 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:37:17.863 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:17.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:37:17.864 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:17.864 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-07-21T22:37:17.864 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAaBLtkc1VfExAAPzDz2k/c0qVePG9h1saQCw==", 2023-07-21T22:37:17.864 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:37:17.864 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:37:17.865 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:37:17.865 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:37:17.865 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:17.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:37:17.865 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:17.865 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-07-21T22:37:17.866 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAdBLtkJ6fcGhAAglVSJIQS04WYBv4APhl57g==", 2023-07-21T22:37:17.866 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:37:17.866 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:37:17.866 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:37:17.866 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:37:17.866 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:17.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:37:17.866 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:17.867 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-07-21T22:37:17.867 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAgBLtkPINGIRAAWKs1RNQIdhZYlDAzDgUkNw==", 2023-07-21T22:37:17.867 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:37:17.867 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:37:17.867 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:37:17.867 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:37:17.867 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:17.867 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:37:17.868 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:17.868 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-07-21T22:37:17.868 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAjBLtk83MCKBAAZH2NhMBphVv4QkRzy+NDgg==", 2023-07-21T22:37:17.868 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:37:17.868 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:37:17.868 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:37:17.868 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:37:17.869 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:17.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:37:17.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:17.869 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-07-21T22:37:17.869 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA==", 2023-07-21T22:37:17.869 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:37:17.869 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:37:17.869 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-07-21T22:37:17.870 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-21T22:37:17.870 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:17.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:37:17.870 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:17.870 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-07-21T22:37:17.870 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkPVXTHhAAYmkzwAvqsfrowpAucTnlUQ==", 2023-07-21T22:37:17.870 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:37:17.871 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:37:17.871 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:37:17.871 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:37:17.871 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:37:17.871 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:17.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:37:17.871 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:17.872 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-07-21T22:37:17.872 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkd7wSGxAArvSYwe+k48vgRzb3fQAEAQ==", 2023-07-21T22:37:17.872 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:37:17.872 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:37:17.872 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:37:17.872 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:37:17.872 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:37:17.873 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:17.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:37:17.873 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:17.873 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-07-21T22:37:17.873 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkoZ4YJRAAX4yh0Q1pR4wY7yEV6kg9QA==", 2023-07-21T22:37:17.873 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:37:17.873 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:37:17.873 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:37:17.874 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:37:17.874 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:37:17.874 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:17.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:37:17.874 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:17.875 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-07-21T22:37:17.875 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtk0ILFGhAAQZ+8lGNFVdOtZYOuLlfkoQ==", 2023-07-21T22:37:17.875 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:37:17.875 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:37:17.875 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:37:17.876 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:37:17.876 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:37:17.876 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:17.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:37:17.876 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:17.876 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-07-21T22:37:17.876 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkdobtMhAAQbwi3cvsrW9P0t3d52oEKw==", 2023-07-21T22:37:17.877 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:37:17.877 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:37:17.877 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T22:37:17.877 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:37:17.877 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:17.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:37:17.877 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:17.877 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-07-21T22:37:17.878 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkHhzpLhAAZTx4Vrc0Htk88104SzuAxQ==", 2023-07-21T22:37:17.878 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:37:17.878 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:37:17.878 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T22:37:17.878 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:37:17.878 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:17.878 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:17.878 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-07-21T22:37:17.879 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:37:17.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.809+0000 7f55ab99f640 1 -- 172.21.15.6:0/977214076 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f55880663a0 msgr2=0x7f5588068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:17.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.809+0000 7f55ab99f640 1 --2- 172.21.15.6:0/977214076 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f55880663a0 0x7f5588068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f55940af000 tx=0x7f55940a7000 comp rx=0 tx=0).stop 2023-07-21T22:37:17.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.809+0000 7f55ab99f640 1 -- 172.21.15.6:0/977214076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55a40c8e70 msgr2=0x7f55a4155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:17.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.809+0000 7f55ab99f640 1 --2- 172.21.15.6:0/977214076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55a40c8e70 0x7f55a4155980 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f55a000c530 tx=0x7f55a000c9f0 comp rx=0 tx=0).stop 2023-07-21T22:37:17.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.809+0000 7f55ab99f640 1 -- 172.21.15.6:0/977214076 shutdown_connections 2023-07-21T22:37:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.809+0000 7f55ab99f640 1 --2- 172.21.15.6:0/977214076 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f55880663a0 0x7f5588068850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.809+0000 7f55ab99f640 1 --2- 172.21.15.6:0/977214076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55a415f970 0x7f55a4153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.809+0000 7f55ab99f640 1 --2- 172.21.15.6:0/977214076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55a415bdf0 0x7f55a40c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.809+0000 7f55ab99f640 1 --2- 172.21.15.6:0/977214076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55a40c8e70 0x7f55a4155980 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.809+0000 7f55ab99f640 1 -- 172.21.15.6:0/977214076 >> 172.21.15.6:0/977214076 conn(0x7f55a40afcf0 msgr2=0x7f55a40700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.809+0000 7f55ab99f640 1 -- 172.21.15.6:0/977214076 shutdown_connections 2023-07-21T22:37:17.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.809+0000 7f55ab99f640 1 -- 172.21.15.6:0/977214076 wait complete. 2023-07-21T22:37:17.882 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:37:18.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.981+0000 7fdd8a1db640 1 Processor -- start 2023-07-21T22:37:18.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.981+0000 7fdd8a1db640 1 -- start start 2023-07-21T22:37:18.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.981+0000 7fdd8a1db640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdd840c8ad0 0x7fdd840c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:18.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.981+0000 7fdd8a1db640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdd840c9560 0x7fdd840ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:18.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.981+0000 7fdd8a1db640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd840c99c0 con 0x7fdd84158ce0 2023-07-21T22:37:18.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.981+0000 7fdd8a1db640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd840cc700 con 0x7fdd840c9560 2023-07-21T22:37:18.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.981+0000 7fdd8a1db640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd840b0ff0 con 0x7fdd840c8ad0 2023-07-21T22:37:18.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.981+0000 7fdd83fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdd840c9560 0x7fdd840ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:18.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.981+0000 7fdd837fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdd84158ce0 0x7fdd84070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53046/0 (socket says 172.21.15.6:53046) 2023-07-21T22:37:18.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.981+0000 7fdd837fe640 1 -- 172.21.15.6:0/595762118 learned_addr learned my addr 172.21.15.6:0/595762118 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:18.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.981+0000 7fdd83fff640 1 -- 172.21.15.6:0/595762118 >> v2:172.21.15.161:3300/0 conn(0x7fdd840c8ad0 msgr2=0x7fdd840c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:18.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.981+0000 7fdd83fff640 1 --2- 172.21.15.6:0/595762118 >> v2:172.21.15.161:3300/0 conn(0x7fdd840c8ad0 0x7fdd840c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.981+0000 7fdd83fff640 1 -- 172.21.15.6:0/595762118 >> v1:172.21.15.6:6789/0 conn(0x7fdd84158ce0 legacy=0x7fdd84070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:18.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.981+0000 7fdd83fff640 1 -- 172.21.15.6:0/595762118 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd84070c80 con 0x7fdd840c9560 2023-07-21T22:37:18.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.981+0000 7fdd827fc640 1 -- 172.21.15.6:0/595762118 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129861594 0 0) 0x7fdd840c99c0 con 0x7fdd84158ce0 2023-07-21T22:37:18.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.985+0000 7fdd83fff640 1 --2- 172.21.15.6:0/595762118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd840c9560 0x7fdd840ccb90 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fdd840c1a30 tx=0x7fdd7c01c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2fb0e6cd511f67 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.985+0000 7fdd827fc640 1 -- 172.21.15.6:0/595762118 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c0a5880 con 0x7fdd840c9560 2023-07-21T22:37:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.985+0000 7fdd827fc640 1 -- 172.21.15.6:0/595762118 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c0a59e0 con 0x7fdd840c9560 2023-07-21T22:37:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.985+0000 7fdd827fc640 1 -- 172.21.15.6:0/595762118 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c0a5d70 con 0x7fdd840c9560 2023-07-21T22:37:18.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.985+0000 7fdd8a1db640 1 -- 172.21.15.6:0/595762118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd840c9560 msgr2=0x7fdd840ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:18.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.985+0000 7fdd8a1db640 1 --2- 172.21.15.6:0/595762118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd840c9560 0x7fdd840ccb90 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fdd840c1a30 tx=0x7fdd7c01c7c0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.985+0000 7fdd8a1db640 1 -- 172.21.15.6:0/595762118 shutdown_connections 2023-07-21T22:37:18.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.985+0000 7fdd8a1db640 1 --2- 172.21.15.6:0/595762118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd840c9560 0x7fdd840ccb90 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.985+0000 7fdd8a1db640 1 --2- 172.21.15.6:0/595762118 >> v2:172.21.15.161:3300/0 conn(0x7fdd840c8ad0 0x7fdd840c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.985+0000 7fdd8a1db640 1 -- 172.21.15.6:0/595762118 >> 172.21.15.6:0/595762118 conn(0x7fdd840afcf0 msgr2=0x7fdd840b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:18.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.985+0000 7fdd8a1db640 1 -- 172.21.15.6:0/595762118 shutdown_connections 2023-07-21T22:37:18.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.985+0000 7fdd8a1db640 1 -- 172.21.15.6:0/595762118 wait complete. 2023-07-21T22:37:18.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd8a1db640 1 Processor -- start 2023-07-21T22:37:18.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd8a1db640 1 -- start start 2023-07-21T22:37:18.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd8a1db640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd840c8ad0 0x7fdd840ae6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:18.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd8a1db640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd840c9560 0x7fdd84151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:18.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd8a1db640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd84158ce0 0x7fdd840ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:18.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd8a1db640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840aef40 con 0x7fdd84158ce0 2023-07-21T22:37:18.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd8a1db640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840af220 con 0x7fdd840c9560 2023-07-21T22:37:18.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd8a1db640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840af500 con 0x7fdd840c8ad0 2023-07-21T22:37:18.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd83fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd84158ce0 0x7fdd840ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:18.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd83fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd84158ce0 0x7fdd840ac1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46654/0 (socket says 172.21.15.6:46654) 2023-07-21T22:37:18.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd83fff640 1 -- 172.21.15.6:0/2840127671 learned_addr learned my addr 172.21.15.6:0/2840127671 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:18.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd82ffd640 1 --2- 172.21.15.6:0/2840127671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd840c9560 0x7fdd84151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:18.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd837fe640 1 --2- 172.21.15.6:0/2840127671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd840c8ad0 0x7fdd840ae6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:18.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd83fff640 1 -- 172.21.15.6:0/2840127671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd840c8ad0 msgr2=0x7fdd840ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:18.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd83fff640 1 --2- 172.21.15.6:0/2840127671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd840c8ad0 0x7fdd840ae6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd83fff640 1 -- 172.21.15.6:0/2840127671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd840c9560 msgr2=0x7fdd84151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:18.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd83fff640 1 --2- 172.21.15.6:0/2840127671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd840c9560 0x7fdd84151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd83fff640 1 -- 172.21.15.6:0/2840127671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7c009a70 con 0x7fdd84158ce0 2023-07-21T22:37:18.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd837fe640 1 --2- 172.21.15.6:0/2840127671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd840c8ad0 0x7fdd840ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:18.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd83fff640 1 --2- 172.21.15.6:0/2840127671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd84158ce0 0x7fdd840ac1e0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c0b0040 tx=0x7fdd7c019560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:18.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd6bfff640 1 -- 172.21.15.6:0/2840127671 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c0ad850 con 0x7fdd84158ce0 2023-07-21T22:37:18.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd6bfff640 1 -- 172.21.15.6:0/2840127671 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c0ad9b0 con 0x7fdd84158ce0 2023-07-21T22:37:18.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd6bfff640 1 -- 172.21.15.6:0/2840127671 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c0add60 con 0x7fdd84158ce0 2023-07-21T22:37:18.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd8a1db640 1 -- 172.21.15.6:0/2840127671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd840b28c0 con 0x7fdd84158ce0 2023-07-21T22:37:18.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.989+0000 7fdd8a1db640 1 -- 172.21.15.6:0/2840127671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd840b2590 con 0x7fdd84158ce0 2023-07-21T22:37:18.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.993+0000 7fdd8a1db640 1 -- 172.21.15.6:0/2840127671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd840ca1a0 con 0x7fdd84158ce0 2023-07-21T22:37:18.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.993+0000 7fdd6bfff640 1 -- 172.21.15.6:0/2840127671 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdd7c0b4050 con 0x7fdd84158ce0 2023-07-21T22:37:18.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.993+0000 7fdd6bfff640 1 --2- 172.21.15.6:0/2840127671 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fdd700663a0 0x7fdd70068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:18.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.993+0000 7fdd6bfff640 1 -- 172.21.15.6:0/2840127671 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5254+0+0 (secure 0 0 0) 0x7fdd7c11eda0 con 0x7fdd84158ce0 2023-07-21T22:37:18.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.993+0000 7fdd837fe640 1 --2- 172.21.15.6:0/2840127671 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fdd700663a0 0x7fdd70068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:18.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.993+0000 7fdd837fe640 1 --2- 172.21.15.6:0/2840127671 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fdd700663a0 0x7fdd70068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdd74000f70 tx=0x7fdd74007cd0 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:18.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:17.997+0000 7fdd6bfff640 1 -- 172.21.15.6:0/2840127671 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdd7c0ec550 con 0x7fdd84158ce0 2023-07-21T22:37:18.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.153+0000 7fdd8a1db640 1 -- 172.21.15.6:0/2840127671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd840b2ae0 con 0x7fdd84158ce0 2023-07-21T22:37:18.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.153+0000 7fdd6bfff640 1 -- 172.21.15.6:0/2840127671 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+14647 (secure 0 0 0) 0x7fdd7c0c7090 con 0x7fdd84158ce0 2023-07-21T22:37:18.200 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:18.200 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":124,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:37:17.401031+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:37:18.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.157+0000 7fdd8a1db640 1 -- 172.21.15.6:0/2840127671 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fdd700663a0 msgr2=0x7fdd70068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:18.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.157+0000 7fdd8a1db640 1 --2- 172.21.15.6:0/2840127671 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fdd700663a0 0x7fdd70068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdd74000f70 tx=0x7fdd74007cd0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.157+0000 7fdd8a1db640 1 -- 172.21.15.6:0/2840127671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd84158ce0 msgr2=0x7fdd840ac1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:18.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.157+0000 7fdd8a1db640 1 --2- 172.21.15.6:0/2840127671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd84158ce0 0x7fdd840ac1e0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c0b0040 tx=0x7fdd7c019560 comp rx=0 tx=0).stop 2023-07-21T22:37:18.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.157+0000 7fdd8a1db640 1 -- 172.21.15.6:0/2840127671 shutdown_connections 2023-07-21T22:37:18.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.157+0000 7fdd8a1db640 1 --2- 172.21.15.6:0/2840127671 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fdd700663a0 0x7fdd70068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.157+0000 7fdd8a1db640 1 --2- 172.21.15.6:0/2840127671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd84158ce0 0x7fdd840ac1e0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.157+0000 7fdd8a1db640 1 --2- 172.21.15.6:0/2840127671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd840c9560 0x7fdd84151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.157+0000 7fdd8a1db640 1 --2- 172.21.15.6:0/2840127671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd840c8ad0 0x7fdd840ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.157+0000 7fdd8a1db640 1 -- 172.21.15.6:0/2840127671 >> 172.21.15.6:0/2840127671 conn(0x7fdd840afcf0 msgr2=0x7fdd840ca610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:18.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.157+0000 7fdd8a1db640 1 -- 172.21.15.6:0/2840127671 shutdown_connections 2023-07-21T22:37:18.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.157+0000 7fdd8a1db640 1 -- 172.21.15.6:0/2840127671 wait complete. 2023-07-21T22:37:18.221 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:37:18.221 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:37:18.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.325+0000 7f14c1912640 1 Processor -- start 2023-07-21T22:37:18.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.325+0000 7f14c1912640 1 -- start start 2023-07-21T22:37:18.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.325+0000 7f14c1912640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f14bc0b1620 0x7f14bc0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:18.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.325+0000 7f14c1912640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14bc0cf430 con 0x7f14bc0cc960 2023-07-21T22:37:18.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.325+0000 7f14c1912640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14bc15fc70 con 0x7f14bc160750 2023-07-21T22:37:18.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.325+0000 7f14c1912640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14bc0cf710 con 0x7f14bc0b1620 2023-07-21T22:37:18.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.325+0000 7f14c0910640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f14bc0cc960 0x7f14bc0ccd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53056/0 (socket says 172.21.15.6:53056) 2023-07-21T22:37:18.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.325+0000 7f14c0910640 1 -- 172.21.15.6:0/1882461916 learned_addr learned my addr 172.21.15.6:0/1882461916 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:18.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.325+0000 7f14bbfff640 1 --2- 172.21.15.6:0/1882461916 >> v2:172.21.15.6:3300/0 conn(0x7f14bc0b1620 0x7f14bc0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:18.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.325+0000 7f14bbfff640 1 -- 172.21.15.6:0/1882461916 >> v1:172.21.15.161:6789/0 conn(0x7f14bc160750 legacy=0x7f14bc15c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:18.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.325+0000 7f14bbfff640 1 -- 172.21.15.6:0/1882461916 >> v1:172.21.15.6:6789/0 conn(0x7f14bc0cc960 legacy=0x7f14bc0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:18.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.325+0000 7f14bb7fe640 1 -- 172.21.15.6:0/1882461916 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119816599 0 0) 0x7f14bc0cf430 con 0x7f14bc0cc960 2023-07-21T22:37:18.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.325+0000 7f14bbfff640 1 -- 172.21.15.6:0/1882461916 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc15ff50 con 0x7f14bc0b1620 2023-07-21T22:37:18.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.329+0000 7f14bbfff640 1 --2- 172.21.15.6:0/1882461916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14bc0b1620 0x7f14bc0ce950 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f14a80097c0 tx=0x7f14a801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e775bac026b3d46 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:18.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.329+0000 7f14bb7fe640 1 -- 172.21.15.6:0/1882461916 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a80ab670 con 0x7f14bc0b1620 2023-07-21T22:37:18.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.329+0000 7f14bb7fe640 1 -- 172.21.15.6:0/1882461916 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a80ab7d0 con 0x7f14bc0b1620 2023-07-21T22:37:18.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.329+0000 7f14bb7fe640 1 -- 172.21.15.6:0/1882461916 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a80abb60 con 0x7f14bc0b1620 2023-07-21T22:37:18.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.329+0000 7f14c1912640 1 -- 172.21.15.6:0/1882461916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14bc0b1620 msgr2=0x7f14bc0ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.329+0000 7f14c1912640 1 --2- 172.21.15.6:0/1882461916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14bc0b1620 0x7f14bc0ce950 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f14a80097c0 tx=0x7f14a801c450 comp rx=0 tx=0).stop 2023-07-21T22:37:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.329+0000 7f14c1912640 1 -- 172.21.15.6:0/1882461916 shutdown_connections 2023-07-21T22:37:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.329+0000 7f14c1912640 1 --2- 172.21.15.6:0/1882461916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14bc0b1620 0x7f14bc0ce950 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.329+0000 7f14c1912640 1 -- 172.21.15.6:0/1882461916 >> 172.21.15.6:0/1882461916 conn(0x7f14bc069f50 msgr2=0x7f14bc06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.329+0000 7f14c1912640 1 -- 172.21.15.6:0/1882461916 shutdown_connections 2023-07-21T22:37:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.329+0000 7f14c1912640 1 -- 172.21.15.6:0/1882461916 wait complete. 2023-07-21T22:37:18.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c1912640 1 Processor -- start 2023-07-21T22:37:18.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c1912640 1 -- start start 2023-07-21T22:37:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c1912640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14bc0b1620 0x7f14bc158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c1912640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14bc0cc960 0x7f14bc0b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c1912640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14bc160750 0x7f14bc14c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c1912640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc15eae0 con 0x7f14bc160750 2023-07-21T22:37:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c1912640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc15f900 con 0x7f14bc0b1620 2023-07-21T22:37:18.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c1912640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0b1c90 con 0x7f14bc0cc960 2023-07-21T22:37:18.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c1111640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14bc160750 0x7f14bc14c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c1111640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14bc160750 0x7f14bc14c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46678/0 (socket says 172.21.15.6:46678) 2023-07-21T22:37:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c0910640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14bc0b1620 0x7f14bc158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c1111640 1 -- 172.21.15.6:0/4253274043 learned_addr learned my addr 172.21.15.6:0/4253274043 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14bbfff640 1 --2- 172.21.15.6:0/4253274043 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14bc0cc960 0x7f14bc0b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c1111640 1 -- 172.21.15.6:0/4253274043 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14bc0cc960 msgr2=0x7f14bc0b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c1111640 1 --2- 172.21.15.6:0/4253274043 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14bc0cc960 0x7f14bc0b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c1111640 1 -- 172.21.15.6:0/4253274043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14bc0b1620 msgr2=0x7f14bc158910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c1111640 1 --2- 172.21.15.6:0/4253274043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14bc0b1620 0x7f14bc158910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c1111640 1 -- 172.21.15.6:0/4253274043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a8009420 con 0x7f14bc160750 2023-07-21T22:37:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c1111640 1 --2- 172.21.15.6:0/4253274043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14bc160750 0x7f14bc14c1d0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f14b400c730 tx=0x7f14b400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14b97fa640 1 -- 172.21.15.6:0/4253274043 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b4003b80 con 0x7f14bc160750 2023-07-21T22:37:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14b97fa640 1 -- 172.21.15.6:0/4253274043 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b4003ce0 con 0x7f14bc160750 2023-07-21T22:37:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14b97fa640 1 -- 172.21.15.6:0/4253274043 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b400aa30 con 0x7f14bc160750 2023-07-21T22:37:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c1912640 1 -- 172.21.15.6:0/4253274043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14bc15ecf0 con 0x7f14bc160750 2023-07-21T22:37:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c1912640 1 -- 172.21.15.6:0/4253274043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14bc15f2b0 con 0x7f14bc160750 2023-07-21T22:37:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.333+0000 7f14c1912640 1 -- 172.21.15.6:0/4253274043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14bc04e020 con 0x7f14bc160750 2023-07-21T22:37:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.337+0000 7f14b97fa640 1 -- 172.21.15.6:0/4253274043 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f14b400ab90 con 0x7f14bc160750 2023-07-21T22:37:18.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.337+0000 7f14b97fa640 1 --2- 172.21.15.6:0/4253274043 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f14a00663a0 0x7f14a0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:18.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.337+0000 7f14b97fa640 1 -- 172.21.15.6:0/4253274043 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5254+0+0 (secure 0 0 0) 0x7f14b4083890 con 0x7f14bc160750 2023-07-21T22:37:18.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.337+0000 7f14c0910640 1 --2- 172.21.15.6:0/4253274043 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f14a00663a0 0x7f14a0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:18.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.337+0000 7f14c0910640 1 --2- 172.21.15.6:0/4253274043 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f14a00663a0 0x7f14a0068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f14b00011f0 tx=0x7f14b0001140 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.341+0000 7f14b97fa640 1 -- 172.21.15.6:0/4253274043 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14b4050f30 con 0x7f14bc160750 2023-07-21T22:37:18.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.497+0000 7f14c1912640 1 -- 172.21.15.6:0/4253274043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f14bc154930 con 0x7f14bc160750 2023-07-21T22:37:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.501+0000 7f14b97fa640 1 -- 172.21.15.6:0/4253274043 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v124) v1 ==== 93+0+10 (secure 0 0 0) 0x7f14b4054550 con 0x7f14bc160750 2023-07-21T22:37:18.545 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:37:18.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.501+0000 7f14c1912640 1 -- 172.21.15.6:0/4253274043 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f14a00663a0 msgr2=0x7f14a0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:18.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.501+0000 7f14c1912640 1 --2- 172.21.15.6:0/4253274043 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f14a00663a0 0x7f14a0068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f14b00011f0 tx=0x7f14b0001140 comp rx=0 tx=0).stop 2023-07-21T22:37:18.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.501+0000 7f14c1912640 1 -- 172.21.15.6:0/4253274043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14bc160750 msgr2=0x7f14bc14c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:18.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.501+0000 7f14c1912640 1 --2- 172.21.15.6:0/4253274043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14bc160750 0x7f14bc14c1d0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f14b400c730 tx=0x7f14b400cbf0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.501+0000 7f14c1912640 1 -- 172.21.15.6:0/4253274043 shutdown_connections 2023-07-21T22:37:18.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.501+0000 7f14c1912640 1 --2- 172.21.15.6:0/4253274043 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f14a00663a0 0x7f14a0068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.501+0000 7f14c1912640 1 --2- 172.21.15.6:0/4253274043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14bc160750 0x7f14bc14c1d0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.501+0000 7f14c1912640 1 --2- 172.21.15.6:0/4253274043 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14bc0cc960 0x7f14bc0b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.501+0000 7f14c1912640 1 --2- 172.21.15.6:0/4253274043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14bc0b1620 0x7f14bc158910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.501+0000 7f14c1912640 1 -- 172.21.15.6:0/4253274043 >> 172.21.15.6:0/4253274043 conn(0x7f14bc069f50 msgr2=0x7f14bc072420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.501+0000 7f14c1912640 1 -- 172.21.15.6:0/4253274043 shutdown_connections 2023-07-21T22:37:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.501+0000 7f14c1912640 1 -- 172.21.15.6:0/4253274043 wait complete. 2023-07-21T22:37:18.566 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:37:18.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.665+0000 7f57df9d2640 1 Processor -- start 2023-07-21T22:37:18.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.669+0000 7f57df9d2640 1 -- start start 2023-07-21T22:37:18.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.669+0000 7f57df9d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d815cef0 0x7f57d8158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:18.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.669+0000 7f57df9d2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f57d8159270 0x7f57d80c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:18.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.669+0000 7f57df9d2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d81532b0 con 0x7f57d80aeb40 2023-07-21T22:37:18.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.669+0000 7f57df9d2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d815d360 con 0x7f57d8159270 2023-07-21T22:37:18.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.669+0000 7f57df9d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d80ca6f0 con 0x7f57d815cef0 2023-07-21T22:37:18.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.669+0000 7f57ddf6f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f57d8159270 0x7f57d80c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:18.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.669+0000 7f57ddf6f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f57d8159270 0x7f57d80c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46690/0 (socket says 172.21.15.6:46690) 2023-07-21T22:37:18.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.669+0000 7f57ddf6f640 1 -- 172.21.15.6:0/2003619413 learned_addr learned my addr 172.21.15.6:0/2003619413 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:18.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.669+0000 7f57dcf6d640 1 --2- 172.21.15.6:0/2003619413 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d815cef0 0x7f57d8158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:18.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.669+0000 7f57ddf6f640 1 -- 172.21.15.6:0/2003619413 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d815cef0 msgr2=0x7f57d8158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:18.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.669+0000 7f57ddf6f640 1 --2- 172.21.15.6:0/2003619413 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d815cef0 0x7f57d8158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.669+0000 7f57ddf6f640 1 -- 172.21.15.6:0/2003619413 >> v1:172.21.15.161:6789/0 conn(0x7f57d80aeb40 legacy=0x7f57d80aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:18.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.669+0000 7f57ddf6f640 1 -- 172.21.15.6:0/2003619413 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d81599d0 con 0x7f57d8159270 2023-07-21T22:37:18.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.669+0000 7f57dcf6d640 1 --2- 172.21.15.6:0/2003619413 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d815cef0 0x7f57d8158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:37:18.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.673+0000 7f57ddf6f640 1 --2- 172.21.15.6:0/2003619413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57d8159270 0x7f57d80c88c0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009e50 tx=0x7f57d001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226d2f7dd2dd9963 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:18.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.673+0000 7f57cffff640 1 -- 172.21.15.6:0/2003619413 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d00a5820 con 0x7f57d8159270 2023-07-21T22:37:18.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.673+0000 7f57cffff640 1 -- 172.21.15.6:0/2003619413 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d00a5980 con 0x7f57d8159270 2023-07-21T22:37:18.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.673+0000 7f57cffff640 1 -- 172.21.15.6:0/2003619413 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d00a5d10 con 0x7f57d8159270 2023-07-21T22:37:18.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.673+0000 7f57df9d2640 1 -- 172.21.15.6:0/2003619413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57d8159270 msgr2=0x7f57d80c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:18.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.673+0000 7f57df9d2640 1 --2- 172.21.15.6:0/2003619413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57d8159270 0x7f57d80c88c0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009e50 tx=0x7f57d001c9a0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.673+0000 7f57df9d2640 1 -- 172.21.15.6:0/2003619413 shutdown_connections 2023-07-21T22:37:18.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.673+0000 7f57df9d2640 1 --2- 172.21.15.6:0/2003619413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57d8159270 0x7f57d80c88c0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.673+0000 7f57df9d2640 1 --2- 172.21.15.6:0/2003619413 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d815cef0 0x7f57d8158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.673+0000 7f57df9d2640 1 -- 172.21.15.6:0/2003619413 >> 172.21.15.6:0/2003619413 conn(0x7f57d80cde90 msgr2=0x7f57d80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:18.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.673+0000 7f57df9d2640 1 -- 172.21.15.6:0/2003619413 shutdown_connections 2023-07-21T22:37:18.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.673+0000 7f57df9d2640 1 -- 172.21.15.6:0/2003619413 wait complete. 2023-07-21T22:37:18.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.673+0000 7f57df9d2640 1 Processor -- start 2023-07-21T22:37:18.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.673+0000 7f57df9d2640 1 -- start start 2023-07-21T22:37:18.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57df9d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57d80aeb40 0x7f57d814daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:18.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57df9d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d8159270 0x7f57d80b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:18.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57df9d2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57d815cef0 0x7f57d8154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:18.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57df9d2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d80b3920 con 0x7f57d80aeb40 2023-07-21T22:37:18.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57df9d2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d80b3640 con 0x7f57d815cef0 2023-07-21T22:37:18.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57df9d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d80b0f60 con 0x7f57d8159270 2023-07-21T22:37:18.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57dd76e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57d80aeb40 0x7f57d814daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:18.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57dd76e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57d80aeb40 0x7f57d814daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46702/0 (socket says 172.21.15.6:46702) 2023-07-21T22:37:18.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57dd76e640 1 -- 172.21.15.6:0/3874983500 learned_addr learned my addr 172.21.15.6:0/3874983500 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:18.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57ddf6f640 1 --2- 172.21.15.6:0/3874983500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57d815cef0 0x7f57d8154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:18.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57dcf6d640 1 --2- 172.21.15.6:0/3874983500 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d8159270 0x7f57d80b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:18.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57dd76e640 1 -- 172.21.15.6:0/3874983500 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d8159270 msgr2=0x7f57d80b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:18.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57dd76e640 1 --2- 172.21.15.6:0/3874983500 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d8159270 0x7f57d80b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57dd76e640 1 -- 172.21.15.6:0/3874983500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57d815cef0 msgr2=0x7f57d8154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57dd76e640 1 --2- 172.21.15.6:0/3874983500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57d815cef0 0x7f57d8154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57dd76e640 1 -- 172.21.15.6:0/3874983500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d0009b30 con 0x7f57d80aeb40 2023-07-21T22:37:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57dd76e640 1 --2- 172.21.15.6:0/3874983500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57d80aeb40 0x7f57d814daa0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f57d400c450 tx=0x7f57d400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57cdffb640 1 -- 172.21.15.6:0/3874983500 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d4012830 con 0x7f57d80aeb40 2023-07-21T22:37:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57cdffb640 1 -- 172.21.15.6:0/3874983500 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d40129b0 con 0x7f57d80aeb40 2023-07-21T22:37:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57df9d2640 1 -- 172.21.15.6:0/3874983500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d80b1240 con 0x7f57d80aeb40 2023-07-21T22:37:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57cdffb640 1 -- 172.21.15.6:0/3874983500 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d4012d60 con 0x7f57d80aeb40 2023-07-21T22:37:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57df9d2640 1 -- 172.21.15.6:0/3874983500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d814dfe0 con 0x7f57d80aeb40 2023-07-21T22:37:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.677+0000 7f57df9d2640 1 -- 172.21.15.6:0/3874983500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d80b0dc0 con 0x7f57d80aeb40 2023-07-21T22:37:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.681+0000 7f57cdffb640 1 -- 172.21.15.6:0/3874983500 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f57d401c460 con 0x7f57d80aeb40 2023-07-21T22:37:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.681+0000 7f57cdffb640 1 --2- 172.21.15.6:0/3874983500 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f57bc0663a0 0x7f57bc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.681+0000 7f57cdffb640 1 -- 172.21.15.6:0/3874983500 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5254+0+0 (secure 0 0 0) 0x7f57d4083990 con 0x7f57d80aeb40 2023-07-21T22:37:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.681+0000 7f57dcf6d640 1 --2- 172.21.15.6:0/3874983500 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f57bc0663a0 0x7f57bc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.681+0000 7f57dcf6d640 1 --2- 172.21.15.6:0/3874983500 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f57bc0663a0 0x7f57bc068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f57d80cab60 tx=0x7f57c8008040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:18.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.685+0000 7f57cdffb640 1 -- 172.21.15.6:0/3874983500 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f57d80b0dc0 con 0x7f57d80aeb40 2023-07-21T22:37:18.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.837+0000 7f57df9d2640 1 -- 172.21.15.6:0/3874983500 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f57d80b1760 con 0x7f57d80aeb40 2023-07-21T22:37:18.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.841+0000 7f57cdffb640 1 -- 172.21.15.6:0/3874983500 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v124) v1 ==== 92+0+10 (secure 0 0 0) 0x7f57d80b1760 con 0x7f57d80aeb40 2023-07-21T22:37:18.885 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:37:18.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.841+0000 7f57df9d2640 1 -- 172.21.15.6:0/3874983500 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f57bc0663a0 msgr2=0x7f57bc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:18.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.841+0000 7f57df9d2640 1 --2- 172.21.15.6:0/3874983500 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f57bc0663a0 0x7f57bc068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f57d80cab60 tx=0x7f57c8008040 comp rx=0 tx=0).stop 2023-07-21T22:37:18.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.841+0000 7f57df9d2640 1 -- 172.21.15.6:0/3874983500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57d80aeb40 msgr2=0x7f57d814daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:18.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.841+0000 7f57df9d2640 1 --2- 172.21.15.6:0/3874983500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57d80aeb40 0x7f57d814daa0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f57d400c450 tx=0x7f57d400c910 comp rx=0 tx=0).stop 2023-07-21T22:37:18.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.841+0000 7f57df9d2640 1 -- 172.21.15.6:0/3874983500 shutdown_connections 2023-07-21T22:37:18.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.841+0000 7f57df9d2640 1 --2- 172.21.15.6:0/3874983500 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f57bc0663a0 0x7f57bc068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.841+0000 7f57df9d2640 1 --2- 172.21.15.6:0/3874983500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f57d815cef0 0x7f57d8154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.841+0000 7f57df9d2640 1 --2- 172.21.15.6:0/3874983500 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f57d8159270 0x7f57d80b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.841+0000 7f57df9d2640 1 --2- 172.21.15.6:0/3874983500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57d80aeb40 0x7f57d814daa0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:18.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.841+0000 7f57df9d2640 1 -- 172.21.15.6:0/3874983500 >> 172.21.15.6:0/3874983500 conn(0x7f57d80cde90 msgr2=0x7f57d80ccfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:18.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.841+0000 7f57df9d2640 1 -- 172.21.15.6:0/3874983500 shutdown_connections 2023-07-21T22:37:18.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:18.841+0000 7f57df9d2640 1 -- 172.21.15.6:0/3874983500 wait complete. 2023-07-21T22:37:18.906 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T22:37:19.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.005+0000 7f67195e9640 1 Processor -- start 2023-07-21T22:37:19.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.005+0000 7f67195e9640 1 -- start start 2023-07-21T22:37:19.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.005+0000 7f67195e9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6714158ce0 0x7f6714070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.005+0000 7f67195e9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67140c9730 0x7f67140ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.005+0000 7f67195e9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67140cc700 con 0x7f67140c8ad0 2023-07-21T22:37:19.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.005+0000 7f67195e9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67140b0ff0 con 0x7f67140c9730 2023-07-21T22:37:19.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.005+0000 7f67195e9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6714070c80 con 0x7f6714158ce0 2023-07-21T22:37:19.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.005+0000 7f67137fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67140c9730 0x7f67140ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.005+0000 7f67127fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f67140c8ad0 0x7f67140c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53066/0 (socket says 172.21.15.6:53066) 2023-07-21T22:37:19.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.005+0000 7f67127fc640 1 -- 172.21.15.6:0/2113653055 learned_addr learned my addr 172.21.15.6:0/2113653055 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:19.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.009+0000 7f6712ffd640 1 --2- 172.21.15.6:0/2113653055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6714158ce0 0x7f6714070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.009+0000 7f6711ffb640 1 -- 172.21.15.6:0/2113653055 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211216430 0 0) 0x7f67140cc700 con 0x7f67140c8ad0 2023-07-21T22:37:19.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.009+0000 7f6711ffb640 1 -- 172.21.15.6:0/2113653055 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66fc003530 con 0x7f67140c8ad0 2023-07-21T22:37:19.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.009+0000 7f67137fe640 1 -- 172.21.15.6:0/2113653055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6714158ce0 msgr2=0x7f6714070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:19.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.009+0000 7f67137fe640 1 --2- 172.21.15.6:0/2113653055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6714158ce0 0x7f6714070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.009+0000 7f67137fe640 1 -- 172.21.15.6:0/2113653055 >> v1:172.21.15.6:6789/0 conn(0x7f67140c8ad0 legacy=0x7f67140c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:19.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.009+0000 7f67137fe640 1 -- 172.21.15.6:0/2113653055 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67140cbdd0 con 0x7f67140c9730 2023-07-21T22:37:19.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.009+0000 7f67137fe640 1 --2- 172.21.15.6:0/2113653055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67140c9730 0x7f67140ccb90 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f670c009d90 tx=0x7f670c01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b668635ea508dd1c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:19.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.009+0000 7f6711ffb640 1 -- 172.21.15.6:0/2113653055 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c0a57d0 con 0x7f67140c9730 2023-07-21T22:37:19.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.009+0000 7f6711ffb640 1 -- 172.21.15.6:0/2113653055 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c0a5930 con 0x7f67140c9730 2023-07-21T22:37:19.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.009+0000 7f6711ffb640 1 -- 172.21.15.6:0/2113653055 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c0a5ca0 con 0x7f67140c9730 2023-07-21T22:37:19.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f67195e9640 1 -- 172.21.15.6:0/2113653055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67140c9730 msgr2=0x7f67140ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:19.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f67195e9640 1 --2- 172.21.15.6:0/2113653055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67140c9730 0x7f67140ccb90 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f670c009d90 tx=0x7f670c01c800 comp rx=0 tx=0).stop 2023-07-21T22:37:19.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f67195e9640 1 -- 172.21.15.6:0/2113653055 shutdown_connections 2023-07-21T22:37:19.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f67195e9640 1 --2- 172.21.15.6:0/2113653055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67140c9730 0x7f67140ccb90 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f67195e9640 1 --2- 172.21.15.6:0/2113653055 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6714158ce0 0x7f6714070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f67195e9640 1 -- 172.21.15.6:0/2113653055 >> 172.21.15.6:0/2113653055 conn(0x7f67140afcf0 msgr2=0x7f67140b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f67195e9640 1 -- 172.21.15.6:0/2113653055 shutdown_connections 2023-07-21T22:37:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f67195e9640 1 -- 172.21.15.6:0/2113653055 wait complete. 2023-07-21T22:37:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f67195e9640 1 Processor -- start 2023-07-21T22:37:19.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f67195e9640 1 -- start start 2023-07-21T22:37:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f67195e9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67140c8ad0 0x7f671414e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f67195e9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67140c9730 0x7f671414af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f67195e9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6714158ce0 0x7f67140c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f67195e9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67140c28b0 con 0x7f67140c8ad0 2023-07-21T22:37:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f67195e9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671414e9c0 con 0x7f67140c9730 2023-07-21T22:37:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f67195e9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671414b800 con 0x7f6714158ce0 2023-07-21T22:37:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f6712ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67140c8ad0 0x7f671414e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f6712ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67140c8ad0 0x7f671414e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46712/0 (socket says 172.21.15.6:46712) 2023-07-21T22:37:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f6712ffd640 1 -- 172.21.15.6:0/2310129905 learned_addr learned my addr 172.21.15.6:0/2310129905 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f67127fc640 1 --2- 172.21.15.6:0/2310129905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67140c9730 0x7f671414af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f67137fe640 1 --2- 172.21.15.6:0/2310129905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6714158ce0 0x7f67140c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f6712ffd640 1 -- 172.21.15.6:0/2310129905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6714158ce0 msgr2=0x7f67140c4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f6712ffd640 1 --2- 172.21.15.6:0/2310129905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6714158ce0 0x7f67140c4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f6712ffd640 1 -- 172.21.15.6:0/2310129905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67140c9730 msgr2=0x7f671414af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f6712ffd640 1 --2- 172.21.15.6:0/2310129905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67140c9730 0x7f671414af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f6712ffd640 1 -- 172.21.15.6:0/2310129905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c009a70 con 0x7f67140c8ad0 2023-07-21T22:37:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.013+0000 7f6712ffd640 1 --2- 172.21.15.6:0/2310129905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67140c8ad0 0x7f671414e480 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f670400e8a0 tx=0x7f670400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.017+0000 7f66fb7fe640 1 -- 172.21.15.6:0/2310129905 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6704009510 con 0x7f67140c8ad0 2023-07-21T22:37:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.017+0000 7f66fb7fe640 1 -- 172.21.15.6:0/2310129905 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670400c940 con 0x7f67140c8ad0 2023-07-21T22:37:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.017+0000 7f67195e9640 1 -- 172.21.15.6:0/2310129905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671414bae0 con 0x7f67140c8ad0 2023-07-21T22:37:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.017+0000 7f66fb7fe640 1 -- 172.21.15.6:0/2310129905 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670400ccb0 con 0x7f67140c8ad0 2023-07-21T22:37:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.017+0000 7f67195e9640 1 -- 172.21.15.6:0/2310129905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671414bdc0 con 0x7f67140c8ad0 2023-07-21T22:37:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.017+0000 7f67195e9640 1 -- 172.21.15.6:0/2310129905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67140ca1a0 con 0x7f67140c8ad0 2023-07-21T22:37:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.017+0000 7f66fb7fe640 1 -- 172.21.15.6:0/2310129905 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6704013470 con 0x7f67140c8ad0 2023-07-21T22:37:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.017+0000 7f66fb7fe640 1 --2- 172.21.15.6:0/2310129905 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f67000663a0 0x7f6700068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.017+0000 7f66fb7fe640 1 -- 172.21.15.6:0/2310129905 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5254+0+0 (secure 0 0 0) 0x7f6704083cc0 con 0x7f67140c8ad0 2023-07-21T22:37:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.017+0000 7f67127fc640 1 --2- 172.21.15.6:0/2310129905 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f67000663a0 0x7f6700068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.021+0000 7f67127fc640 1 --2- 172.21.15.6:0/2310129905 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f67000663a0 0x7f6700068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f67141511f0 tx=0x7f6708009040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:19.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.021+0000 7f66fb7fe640 1 -- 172.21.15.6:0/2310129905 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f670408a080 con 0x7f67140c8ad0 2023-07-21T22:37:19.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.181+0000 7f67195e9640 1 -- 172.21.15.6:0/2310129905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f67140678d0 con 0x7f67140c8ad0 2023-07-21T22:37:19.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.181+0000 7f66fb7fe640 1 -- 172.21.15.6:0/2310129905 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v124) v1 ==== 84+0+126 (secure 0 0 0) 0x7f6704017090 con 0x7f67140c8ad0 2023-07-21T22:37:19.226 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:19.226 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:37:19.226 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:19.226 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-07-21T22:37:19.226 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-07-21T22:37:19.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:37:19.227 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:19.227 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-07-21T22:37:19.227 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-07-21T22:37:19.227 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:19.227 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:37:19.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.181+0000 7f67195e9640 1 -- 172.21.15.6:0/2310129905 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f67000663a0 msgr2=0x7f6700068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:19.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.181+0000 7f67195e9640 1 --2- 172.21.15.6:0/2310129905 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f67000663a0 0x7f6700068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f67141511f0 tx=0x7f6708009040 comp rx=0 tx=0).stop 2023-07-21T22:37:19.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.181+0000 7f67195e9640 1 -- 172.21.15.6:0/2310129905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67140c8ad0 msgr2=0x7f671414e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:19.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.181+0000 7f67195e9640 1 --2- 172.21.15.6:0/2310129905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67140c8ad0 0x7f671414e480 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f670400e8a0 tx=0x7f670400eca0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.181+0000 7f67195e9640 1 -- 172.21.15.6:0/2310129905 shutdown_connections 2023-07-21T22:37:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.181+0000 7f67195e9640 1 --2- 172.21.15.6:0/2310129905 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f67000663a0 0x7f6700068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.181+0000 7f67195e9640 1 --2- 172.21.15.6:0/2310129905 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6714158ce0 0x7f67140c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.181+0000 7f67195e9640 1 --2- 172.21.15.6:0/2310129905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f67140c9730 0x7f671414af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.181+0000 7f67195e9640 1 --2- 172.21.15.6:0/2310129905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67140c8ad0 0x7f671414e480 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.181+0000 7f67195e9640 1 -- 172.21.15.6:0/2310129905 >> 172.21.15.6:0/2310129905 conn(0x7f67140afcf0 msgr2=0x7f6714070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.181+0000 7f67195e9640 1 -- 172.21.15.6:0/2310129905 shutdown_connections 2023-07-21T22:37:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.181+0000 7f67195e9640 1 -- 172.21.15.6:0/2310129905 wait complete. 2023-07-21T22:37:19.247 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-21T22:37:19.247 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-21T22:37:19.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.349+0000 7f8146234640 1 Processor -- start 2023-07-21T22:37:19.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.349+0000 7f8146234640 1 -- start start 2023-07-21T22:37:19.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.349+0000 7f8146234640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8140069430 0x7f8140069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.349+0000 7f8146234640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8140070f30 0x7f81400ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.349+0000 7f8146234640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8140159d70 con 0x7f81400af2b0 2023-07-21T22:37:19.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.349+0000 7f8146234640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8140069d40 con 0x7f8140070f30 2023-07-21T22:37:19.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.349+0000 7f8146234640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81400c9c60 con 0x7f8140069430 2023-07-21T22:37:19.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.349+0000 7f8137fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8140070f30 0x7f81400ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.349+0000 7f813ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f81400af2b0 0x7f814015a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53078/0 (socket says 172.21.15.6:53078) 2023-07-21T22:37:19.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.349+0000 7f813ffff640 1 -- 172.21.15.6:0/1827421443 learned_addr learned my addr 172.21.15.6:0/1827421443 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:19.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.349+0000 7f813f7fe640 1 --2- 172.21.15.6:0/1827421443 >> v2:172.21.15.161:3300/0 conn(0x7f8140069430 0x7f8140069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.349+0000 7f8137fff640 1 -- 172.21.15.6:0/1827421443 >> v2:172.21.15.161:3300/0 conn(0x7f8140069430 msgr2=0x7f8140069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:19.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.349+0000 7f8137fff640 1 --2- 172.21.15.6:0/1827421443 >> v2:172.21.15.161:3300/0 conn(0x7f8140069430 0x7f8140069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.349+0000 7f8137fff640 1 -- 172.21.15.6:0/1827421443 >> v1:172.21.15.6:6789/0 conn(0x7f81400af2b0 legacy=0x7f814015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:19.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.349+0000 7f8137fff640 1 -- 172.21.15.6:0/1827421443 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81400c9f40 con 0x7f8140070f30 2023-07-21T22:37:19.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.349+0000 7f813effd640 1 -- 172.21.15.6:0/1827421443 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926422961 0 0) 0x7f81380014a0 con 0x7f81400af2b0 2023-07-21T22:37:19.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.353+0000 7f8137fff640 1 --2- 172.21.15.6:0/1827421443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8140070f30 0x7f81400ad6f0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f8140071910 tx=0x7f812801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24db4494dbb846d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:19.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.353+0000 7f813effd640 1 -- 172.21.15.6:0/1827421443 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81280ab660 con 0x7f8140070f30 2023-07-21T22:37:19.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.353+0000 7f813effd640 1 -- 172.21.15.6:0/1827421443 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81280ab7c0 con 0x7f8140070f30 2023-07-21T22:37:19.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.353+0000 7f813effd640 1 -- 172.21.15.6:0/1827421443 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81280abb50 con 0x7f8140070f30 2023-07-21T22:37:19.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.353+0000 7f8146234640 1 -- 172.21.15.6:0/1827421443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8140070f30 msgr2=0x7f81400ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:19.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.353+0000 7f8146234640 1 --2- 172.21.15.6:0/1827421443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8140070f30 0x7f81400ad6f0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f8140071910 tx=0x7f812801c460 comp rx=0 tx=0).stop 2023-07-21T22:37:19.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.353+0000 7f8146234640 1 -- 172.21.15.6:0/1827421443 shutdown_connections 2023-07-21T22:37:19.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.353+0000 7f8146234640 1 --2- 172.21.15.6:0/1827421443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8140070f30 0x7f81400ad6f0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.353+0000 7f8146234640 1 --2- 172.21.15.6:0/1827421443 >> v2:172.21.15.161:3300/0 conn(0x7f8140069430 0x7f8140069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.353+0000 7f8146234640 1 -- 172.21.15.6:0/1827421443 >> 172.21.15.6:0/1827421443 conn(0x7f81400cde90 msgr2=0x7f81400ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:19.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.353+0000 7f8146234640 1 -- 172.21.15.6:0/1827421443 shutdown_connections 2023-07-21T22:37:19.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.353+0000 7f8146234640 1 -- 172.21.15.6:0/1827421443 wait complete. 2023-07-21T22:37:19.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f8146234640 1 Processor -- start 2023-07-21T22:37:19.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f8146234640 1 -- start start 2023-07-21T22:37:19.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f8146234640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8140069430 0x7f814014c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f8146234640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8140070f30 0x7f8140153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f8146234640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81400af2b0 0x7f81401537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f8146234640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81400c2dd0 con 0x7f8140070f30 2023-07-21T22:37:19.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f8146234640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81400c3040 con 0x7f81400af2b0 2023-07-21T22:37:19.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f8146234640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81400c3320 con 0x7f8140069430 2023-07-21T22:37:19.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f8137fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8140070f30 0x7f8140153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f8137fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8140070f30 0x7f8140153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46726/0 (socket says 172.21.15.6:46726) 2023-07-21T22:37:19.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f8137fff640 1 -- 172.21.15.6:0/1386529341 learned_addr learned my addr 172.21.15.6:0/1386529341 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:19.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f813f7fe640 1 --2- 172.21.15.6:0/1386529341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8140069430 0x7f814014c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f813ffff640 1 --2- 172.21.15.6:0/1386529341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81400af2b0 0x7f81401537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f8137fff640 1 -- 172.21.15.6:0/1386529341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8140069430 msgr2=0x7f814014c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f8137fff640 1 --2- 172.21.15.6:0/1386529341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8140069430 0x7f814014c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f8137fff640 1 -- 172.21.15.6:0/1386529341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81400af2b0 msgr2=0x7f81401537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f8137fff640 1 --2- 172.21.15.6:0/1386529341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81400af2b0 0x7f81401537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f8137fff640 1 -- 172.21.15.6:0/1386529341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8128009420 con 0x7f8140070f30 2023-07-21T22:37:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f813ffff640 1 --2- 172.21.15.6:0/1386529341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81400af2b0 0x7f81401537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f8137fff640 1 --2- 172.21.15.6:0/1386529341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8140070f30 0x7f8140153290 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f81280ad040 tx=0x7f812801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f813cff9640 1 -- 172.21.15.6:0/1386529341 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81280b5810 con 0x7f8140070f30 2023-07-21T22:37:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f813cff9640 1 -- 172.21.15.6:0/1386529341 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81280b5990 con 0x7f8140070f30 2023-07-21T22:37:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f813cff9640 1 -- 172.21.15.6:0/1386529341 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81280b5d40 con 0x7f8140070f30 2023-07-21T22:37:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.357+0000 7f8146234640 1 -- 172.21.15.6:0/1386529341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81400c3600 con 0x7f8140070f30 2023-07-21T22:37:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.361+0000 7f8146234640 1 -- 172.21.15.6:0/1386529341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81401550a0 con 0x7f8140070f30 2023-07-21T22:37:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.361+0000 7f8146234640 1 -- 172.21.15.6:0/1386529341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81400c3840 con 0x7f8140070f30 2023-07-21T22:37:19.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.361+0000 7f813cff9640 1 -- 172.21.15.6:0/1386529341 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f81280a9070 con 0x7f8140070f30 2023-07-21T22:37:19.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.361+0000 7f813cff9640 1 --2- 172.21.15.6:0/1386529341 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f81200663a0 0x7f8120068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.361+0000 7f813cff9640 1 -- 172.21.15.6:0/1386529341 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5254+0+0 (secure 0 0 0) 0x7f812811e540 con 0x7f8140070f30 2023-07-21T22:37:19.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.361+0000 7f813f7fe640 1 --2- 172.21.15.6:0/1386529341 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f81200663a0 0x7f8120068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.365+0000 7f813f7fe640 1 --2- 172.21.15.6:0/1386529341 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f81200663a0 0x7f8120068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f813000b930 tx=0x7f8130008040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:19.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.365+0000 7f813cff9640 1 -- 172.21.15.6:0/1386529341 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f81400c3840 con 0x7f8140070f30 2023-07-21T22:37:19.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:19.521+0000 7f8146234640 1 -- 172.21.15.6:0/1386529341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f81400c3840 con 0x7f8140070f30 2023-07-21T22:37:20.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.049+0000 7f813cff9640 1 -- 172.21.15.6:0/1386529341 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v125) v1 ==== 138+0+0 (secure 0 0 0) 0x7f81400c3840 con 0x7f8140070f30 2023-07-21T22:37:20.094 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-07-21T22:37:20.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.053+0000 7f8146234640 1 -- 172.21.15.6:0/1386529341 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f81200663a0 msgr2=0x7f8120068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:20.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.053+0000 7f8146234640 1 --2- 172.21.15.6:0/1386529341 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f81200663a0 0x7f8120068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f813000b930 tx=0x7f8130008040 comp rx=0 tx=0).stop 2023-07-21T22:37:20.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.053+0000 7f8146234640 1 -- 172.21.15.6:0/1386529341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8140070f30 msgr2=0x7f8140153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:20.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.053+0000 7f8146234640 1 --2- 172.21.15.6:0/1386529341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8140070f30 0x7f8140153290 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f81280ad040 tx=0x7f812801aca0 comp rx=0 tx=0).stop 2023-07-21T22:37:20.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.053+0000 7f8146234640 1 -- 172.21.15.6:0/1386529341 shutdown_connections 2023-07-21T22:37:20.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.053+0000 7f8146234640 1 --2- 172.21.15.6:0/1386529341 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f81200663a0 0x7f8120068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:20.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.053+0000 7f8146234640 1 --2- 172.21.15.6:0/1386529341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81400af2b0 0x7f81401537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:20.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.053+0000 7f8146234640 1 --2- 172.21.15.6:0/1386529341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8140070f30 0x7f8140153290 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:20.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.053+0000 7f8146234640 1 --2- 172.21.15.6:0/1386529341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8140069430 0x7f814014c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:20.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.053+0000 7f8146234640 1 -- 172.21.15.6:0/1386529341 >> 172.21.15.6:0/1386529341 conn(0x7f81400cde90 msgr2=0x7f814006c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:20.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.053+0000 7f8146234640 1 -- 172.21.15.6:0/1386529341 shutdown_connections 2023-07-21T22:37:20.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.057+0000 7f8146234640 1 -- 172.21.15.6:0/1386529341 wait complete. 2023-07-21T22:37:20.123 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T22:37:20.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.229+0000 7f145c66a640 1 Processor -- start 2023-07-21T22:37:20.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.229+0000 7f145c66a640 1 -- start start 2023-07-21T22:37:20.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.229+0000 7f145c66a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f14540cd670 0x7f14541637a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:20.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.233+0000 7f145c66a640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1454070c10 con 0x7f14540c8940 2023-07-21T22:37:20.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.233+0000 7f145c66a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14540c8e20 con 0x7f1454158a40 2023-07-21T22:37:20.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.233+0000 7f145c66a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14540711b0 con 0x7f14540cd670 2023-07-21T22:37:20.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.233+0000 7f145ac07640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f14540cd670 0x7f14541637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.233+0000 7f1459c05640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f14540c8940 0x7f14540ccf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53094/0 (socket says 172.21.15.6:53094) 2023-07-21T22:37:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.233+0000 7f1459c05640 1 -- 172.21.15.6:0/1606890906 learned_addr learned my addr 172.21.15.6:0/1606890906 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.233+0000 7f145ac07640 1 -- 172.21.15.6:0/1606890906 >> v1:172.21.15.161:6789/0 conn(0x7f1454158a40 legacy=0x7f14540cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.233+0000 7f145ac07640 1 -- 172.21.15.6:0/1606890906 >> v1:172.21.15.6:6789/0 conn(0x7f14540c8940 legacy=0x7f14540ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:20.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.233+0000 7f145ac07640 1 -- 172.21.15.6:0/1606890906 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14540c9100 con 0x7f14540cd670 2023-07-21T22:37:20.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.233+0000 7f145ac07640 1 --2- 172.21.15.6:0/1606890906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14540cd670 0x7f14541637a0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f144c009d90 tx=0x7f144c01ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f85b6ad6921c7664 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:20.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.233+0000 7f1459404640 1 -- 172.21.15.6:0/1606890906 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c0a7a30 con 0x7f14540cd670 2023-07-21T22:37:20.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.233+0000 7f1459404640 1 -- 172.21.15.6:0/1606890906 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144c0a7b90 con 0x7f14540cd670 2023-07-21T22:37:20.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.233+0000 7f1459404640 1 -- 172.21.15.6:0/1606890906 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144c0af440 con 0x7f14540cd670 2023-07-21T22:37:20.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.237+0000 7f145c66a640 1 -- 172.21.15.6:0/1606890906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14540cd670 msgr2=0x7f14541637a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.237+0000 7f145c66a640 1 --2- 172.21.15.6:0/1606890906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14540cd670 0x7f14541637a0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f144c009d90 tx=0x7f144c01ea60 comp rx=0 tx=0).stop 2023-07-21T22:37:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.237+0000 7f145c66a640 1 -- 172.21.15.6:0/1606890906 shutdown_connections 2023-07-21T22:37:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.237+0000 7f145c66a640 1 --2- 172.21.15.6:0/1606890906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14540cd670 0x7f14541637a0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.237+0000 7f145c66a640 1 -- 172.21.15.6:0/1606890906 >> 172.21.15.6:0/1606890906 conn(0x7f14540afac0 msgr2=0x7f14540afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.237+0000 7f145c66a640 1 -- 172.21.15.6:0/1606890906 shutdown_connections 2023-07-21T22:37:20.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.237+0000 7f145c66a640 1 -- 172.21.15.6:0/1606890906 wait complete. 2023-07-21T22:37:20.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.237+0000 7f145c66a640 1 Processor -- start 2023-07-21T22:37:20.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.237+0000 7f145c66a640 1 -- start start 2023-07-21T22:37:20.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.237+0000 7f145c66a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14540c8940 0x7f14540c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:20.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.237+0000 7f145c66a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14540cd670 0x7f1454156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:20.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.237+0000 7f145c66a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f145414ad30 0x7f1454156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:20.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.237+0000 7f145c66a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14540c5020 con 0x7f14540cd670 2023-07-21T22:37:20.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.237+0000 7f145c66a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14540c5e80 con 0x7f145414ad30 2023-07-21T22:37:20.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.237+0000 7f145c66a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14540c5270 con 0x7f14540c8940 2023-07-21T22:37:20.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.237+0000 7f1459c05640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14540cd670 0x7f1454156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:20.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.237+0000 7f1459c05640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14540cd670 0x7f1454156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46738/0 (socket says 172.21.15.6:46738) 2023-07-21T22:37:20.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.237+0000 7f1459c05640 1 -- 172.21.15.6:0/2538163199 learned_addr learned my addr 172.21.15.6:0/2538163199 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:20.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.237+0000 7f145ac07640 1 --2- 172.21.15.6:0/2538163199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f145414ad30 0x7f1454156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:20.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.237+0000 7f145a406640 1 --2- 172.21.15.6:0/2538163199 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14540c8940 0x7f14540c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:20.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.241+0000 7f1459c05640 1 -- 172.21.15.6:0/2538163199 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14540c8940 msgr2=0x7f14540c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:20.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.241+0000 7f1459c05640 1 --2- 172.21.15.6:0/2538163199 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14540c8940 0x7f14540c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:20.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.241+0000 7f1459c05640 1 -- 172.21.15.6:0/2538163199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f145414ad30 msgr2=0x7f1454156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:20.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.241+0000 7f1459c05640 1 --2- 172.21.15.6:0/2538163199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f145414ad30 0x7f1454156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:20.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.241+0000 7f1459c05640 1 -- 172.21.15.6:0/2538163199 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144c009a70 con 0x7f14540cd670 2023-07-21T22:37:20.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.241+0000 7f145a406640 1 --2- 172.21.15.6:0/2538163199 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14540c8940 0x7f14540c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:20.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.241+0000 7f1459c05640 1 --2- 172.21.15.6:0/2538163199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14540cd670 0x7f1454156a30 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f144400c500 tx=0x7f144400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:20.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.241+0000 7f144affd640 1 -- 172.21.15.6:0/2538163199 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444005cf0 con 0x7f14540cd670 2023-07-21T22:37:20.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.241+0000 7f144affd640 1 -- 172.21.15.6:0/2538163199 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1444005e50 con 0x7f14540cd670 2023-07-21T22:37:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.241+0000 7f145c66a640 1 -- 172.21.15.6:0/2538163199 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14540c5550 con 0x7f14540cd670 2023-07-21T22:37:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.241+0000 7f144affd640 1 -- 172.21.15.6:0/2538163199 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14440072f0 con 0x7f14540cd670 2023-07-21T22:37:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.241+0000 7f145c66a640 1 -- 172.21.15.6:0/2538163199 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14540c5b10 con 0x7f14540cd670 2023-07-21T22:37:20.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.241+0000 7f145c66a640 1 -- 172.21.15.6:0/2538163199 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14540ca370 con 0x7f14540cd670 2023-07-21T22:37:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.241+0000 7f144affd640 1 -- 172.21.15.6:0/2538163199 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1444007450 con 0x7f14540cd670 2023-07-21T22:37:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.241+0000 7f144affd640 1 --2- 172.21.15.6:0/2538163199 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f14380663a0 0x7f1438068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.245+0000 7f144affd640 1 -- 172.21.15.6:0/2538163199 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5624+0+0 (secure 0 0 0) 0x7f1444083630 con 0x7f14540cd670 2023-07-21T22:37:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.245+0000 7f145a406640 1 --2- 172.21.15.6:0/2538163199 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f14380663a0 0x7f1438068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:20.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.245+0000 7f145a406640 1 --2- 172.21.15.6:0/2538163199 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f14380663a0 0x7f1438068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f14500098b0 tx=0x7f1450008040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:20.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.245+0000 7f144affd640 1 -- 172.21.15.6:0/2538163199 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1444050c70 con 0x7f14540cd670 2023-07-21T22:37:20.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:20.405+0000 7f145c66a640 1 -- 172.21.15.6:0/2538163199 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f14540678d0 con 0x7f14540cd670 2023-07-21T22:37:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.053+0000 7f144affd640 1 -- 172.21.15.6:0/2538163199 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v126) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1444054290 con 0x7f14540cd670 2023-07-21T22:37:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-07-21T22:37:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.065+0000 7f145c66a640 1 -- 172.21.15.6:0/2538163199 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f14380663a0 msgr2=0x7f1438068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:21.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.065+0000 7f145c66a640 1 --2- 172.21.15.6:0/2538163199 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f14380663a0 0x7f1438068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f14500098b0 tx=0x7f1450008040 comp rx=0 tx=0).stop 2023-07-21T22:37:21.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.065+0000 7f145c66a640 1 -- 172.21.15.6:0/2538163199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14540cd670 msgr2=0x7f1454156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:21.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.069+0000 7f145c66a640 1 --2- 172.21.15.6:0/2538163199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14540cd670 0x7f1454156a30 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f144400c500 tx=0x7f144400c9c0 comp rx=0 tx=0).stop 2023-07-21T22:37:21.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.069+0000 7f145c66a640 1 -- 172.21.15.6:0/2538163199 shutdown_connections 2023-07-21T22:37:21.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.069+0000 7f145c66a640 1 --2- 172.21.15.6:0/2538163199 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f14380663a0 0x7f1438068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:21.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.069+0000 7f145c66a640 1 --2- 172.21.15.6:0/2538163199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f145414ad30 0x7f1454156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:21.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.069+0000 7f145c66a640 1 --2- 172.21.15.6:0/2538163199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14540cd670 0x7f1454156a30 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:21.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.069+0000 7f145c66a640 1 --2- 172.21.15.6:0/2538163199 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14540c8940 0x7f14540c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:21.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.069+0000 7f145c66a640 1 -- 172.21.15.6:0/2538163199 >> 172.21.15.6:0/2538163199 conn(0x7f14540afac0 msgr2=0x7f14540cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:21.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.069+0000 7f145c66a640 1 -- 172.21.15.6:0/2538163199 shutdown_connections 2023-07-21T22:37:21.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.069+0000 7f145c66a640 1 -- 172.21.15.6:0/2538163199 wait complete. 2023-07-21T22:37:21.143 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-21T22:37:21.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.249+0000 7f1990df6640 1 Processor -- start 2023-07-21T22:37:21.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.249+0000 7f1990df6640 1 -- start start 2023-07-21T22:37:21.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.249+0000 7f1990df6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f198c15bde0 0x7f198c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:21.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.249+0000 7f1990df6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198c0b04c0 con 0x7f198c0d2fc0 2023-07-21T22:37:21.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.249+0000 7f1990df6640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198c0b1060 con 0x7f198c0d2300 2023-07-21T22:37:21.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.249+0000 7f1990df6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f198c15c1b0 con 0x7f198c15bde0 2023-07-21T22:37:21.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.249+0000 7f198a59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f198c15bde0 0x7f198c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:21.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.249+0000 7f1989d9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f198c0d2fc0 0x7f198c0b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53100/0 (socket says 172.21.15.6:53100) 2023-07-21T22:37:21.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.249+0000 7f1989d9b640 1 -- 172.21.15.6:0/2745994097 learned_addr learned my addr 172.21.15.6:0/2745994097 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:21.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.249+0000 7f198959a640 1 -- 172.21.15.6:0/2745994097 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2420328745 0 0) 0x7f198c0b04c0 con 0x7f198c0d2fc0 2023-07-21T22:37:21.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.249+0000 7f198959a640 1 -- 172.21.15.6:0/2745994097 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1974003530 con 0x7f198c0d2fc0 2023-07-21T22:37:21.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.249+0000 7f198a59c640 1 -- 172.21.15.6:0/2745994097 >> v1:172.21.15.161:6789/0 conn(0x7f198c0d2300 legacy=0x7f198c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:21.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.249+0000 7f198959a640 1 -- 172.21.15.6:0/2745994097 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380703480 0 0) 0x7f198c0b1060 con 0x7f198c0d2300 2023-07-21T22:37:21.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.249+0000 7f198a59c640 1 -- 172.21.15.6:0/2745994097 >> v1:172.21.15.6:6789/0 conn(0x7f198c0d2fc0 legacy=0x7f198c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:21.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.249+0000 7f198a59c640 1 -- 172.21.15.6:0/2745994097 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c0d0aa0 con 0x7f198c15bde0 2023-07-21T22:37:21.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.253+0000 7f198a59c640 1 --2- 172.21.15.6:0/2745994097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c15bde0 0x7f198c0d0270 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f197c0097a0 tx=0x7f197c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f42e7dac5fe8536 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:21.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.253+0000 7f198959a640 1 -- 172.21.15.6:0/2745994097 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c0ab660 con 0x7f198c15bde0 2023-07-21T22:37:21.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.253+0000 7f198959a640 1 -- 172.21.15.6:0/2745994097 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c0ab7c0 con 0x7f198c15bde0 2023-07-21T22:37:21.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.253+0000 7f198959a640 1 -- 172.21.15.6:0/2745994097 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c0abb50 con 0x7f198c15bde0 2023-07-21T22:37:21.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.253+0000 7f1990df6640 1 -- 172.21.15.6:0/2745994097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c15bde0 msgr2=0x7f198c0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:21.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.253+0000 7f1990df6640 1 --2- 172.21.15.6:0/2745994097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c15bde0 0x7f198c0d0270 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f197c0097a0 tx=0x7f197c01c460 comp rx=0 tx=0).stop 2023-07-21T22:37:21.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.253+0000 7f1990df6640 1 -- 172.21.15.6:0/2745994097 shutdown_connections 2023-07-21T22:37:21.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.253+0000 7f1990df6640 1 --2- 172.21.15.6:0/2745994097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c15bde0 0x7f198c0d0270 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:21.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.253+0000 7f1990df6640 1 -- 172.21.15.6:0/2745994097 >> 172.21.15.6:0/2745994097 conn(0x7f198c0659d0 msgr2=0x7f198c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:21.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.253+0000 7f1990df6640 1 -- 172.21.15.6:0/2745994097 shutdown_connections 2023-07-21T22:37:21.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.253+0000 7f1990df6640 1 -- 172.21.15.6:0/2745994097 wait complete. 2023-07-21T22:37:21.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f1990df6640 1 Processor -- start 2023-07-21T22:37:21.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f1990df6640 1 -- start start 2023-07-21T22:37:21.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f1990df6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f198c0d2300 0x7f198c0b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:21.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f1990df6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c0d2fc0 0x7f198c0c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:21.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f1990df6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f198c15bde0 0x7f198c14f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:21.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f1990df6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c0c7b60 con 0x7f198c0d2fc0 2023-07-21T22:37:21.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f1990df6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c0c7e40 con 0x7f198c0d2300 2023-07-21T22:37:21.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f1990df6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198c0c8120 con 0x7f198c15bde0 2023-07-21T22:37:21.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f1989d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c0d2fc0 0x7f198c0c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:21.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f1989d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c0d2fc0 0x7f198c0c70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46766/0 (socket says 172.21.15.6:46766) 2023-07-21T22:37:21.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f1989d9b640 1 -- 172.21.15.6:0/2405411625 learned_addr learned my addr 172.21.15.6:0/2405411625 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:21.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f1989d9b640 1 -- 172.21.15.6:0/2405411625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f198c15bde0 msgr2=0x7f198c14f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:21.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f1989d9b640 1 --2- 172.21.15.6:0/2405411625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f198c15bde0 0x7f198c14f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:21.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f198a59c640 1 --2- 172.21.15.6:0/2405411625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f198c0d2300 0x7f198c0b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:21.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f1989d9b640 1 -- 172.21.15.6:0/2405411625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f198c0d2300 msgr2=0x7f198c0b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:21.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f1989d9b640 1 --2- 172.21.15.6:0/2405411625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f198c0d2300 0x7f198c0b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:21.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f1989d9b640 1 -- 172.21.15.6:0/2405411625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c0093b0 con 0x7f198c0d2fc0 2023-07-21T22:37:21.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f198a59c640 1 --2- 172.21.15.6:0/2405411625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f198c0d2300 0x7f198c0b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:37:21.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f1989d9b640 1 --2- 172.21.15.6:0/2405411625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c0d2fc0 0x7f198c0c70c0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f1980001ec0 tx=0x7f198000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:21.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f197affd640 1 -- 172.21.15.6:0/2405411625 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1980005d50 con 0x7f198c0d2fc0 2023-07-21T22:37:21.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f197affd640 1 -- 172.21.15.6:0/2405411625 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1980007070 con 0x7f198c0d2fc0 2023-07-21T22:37:21.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f197affd640 1 -- 172.21.15.6:0/2405411625 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1980007420 con 0x7f198c0d2fc0 2023-07-21T22:37:21.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f1990df6640 1 -- 172.21.15.6:0/2405411625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198c0c8400 con 0x7f198c0d2fc0 2023-07-21T22:37:21.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.257+0000 7f1990df6640 1 -- 172.21.15.6:0/2405411625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198c0b1a10 con 0x7f198c0d2fc0 2023-07-21T22:37:21.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.261+0000 7f1990df6640 1 -- 172.21.15.6:0/2405411625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198c0678d0 con 0x7f198c0d2fc0 2023-07-21T22:37:21.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.261+0000 7f197affd640 1 -- 172.21.15.6:0/2405411625 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1980007580 con 0x7f198c0d2fc0 2023-07-21T22:37:21.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.261+0000 7f197affd640 1 --2- 172.21.15.6:0/2405411625 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f196c0663a0 0x7f196c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:21.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.261+0000 7f197affd640 1 -- 172.21.15.6:0/2405411625 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6006+0+0 (secure 0 0 0) 0x7f1980083490 con 0x7f198c0d2fc0 2023-07-21T22:37:21.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.261+0000 7f198a59c640 1 --2- 172.21.15.6:0/2405411625 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f196c0663a0 0x7f196c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:21.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.265+0000 7f198a59c640 1 --2- 172.21.15.6:0/2405411625 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f196c0663a0 0x7f196c068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f197c0af000 tx=0x7f197c008040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:21.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.265+0000 7f197affd640 1 -- 172.21.15.6:0/2405411625 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1980050a10 con 0x7f198c0d2fc0 2023-07-21T22:37:21.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:21.457+0000 7f1990df6640 1 -- 172.21.15.6:0/2405411625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f198c0c88b0 con 0x7f198c0d2fc0 2023-07-21T22:37:22.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.105+0000 7f197affd640 1 -- 172.21.15.6:0/2405411625 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v51) v1 ==== 174+0+0 (secure 0 0 0) 0x7f1980054030 con 0x7f198c0d2fc0 2023-07-21T22:37:22.150 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 15 and data pool 16 2023-07-21T22:37:22.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.113+0000 7f1990df6640 1 -- 172.21.15.6:0/2405411625 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f196c0663a0 msgr2=0x7f196c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:22.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.113+0000 7f1990df6640 1 --2- 172.21.15.6:0/2405411625 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f196c0663a0 0x7f196c068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f197c0af000 tx=0x7f197c008040 comp rx=0 tx=0).stop 2023-07-21T22:37:22.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.113+0000 7f1990df6640 1 -- 172.21.15.6:0/2405411625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c0d2fc0 msgr2=0x7f198c0c70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:22.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.113+0000 7f1990df6640 1 --2- 172.21.15.6:0/2405411625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c0d2fc0 0x7f198c0c70c0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f1980001ec0 tx=0x7f198000c960 comp rx=0 tx=0).stop 2023-07-21T22:37:22.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.113+0000 7f1990df6640 1 -- 172.21.15.6:0/2405411625 shutdown_connections 2023-07-21T22:37:22.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.113+0000 7f1990df6640 1 --2- 172.21.15.6:0/2405411625 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f196c0663a0 0x7f196c068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.117+0000 7f1990df6640 1 --2- 172.21.15.6:0/2405411625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f198c15bde0 0x7f198c14f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.117+0000 7f1990df6640 1 --2- 172.21.15.6:0/2405411625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f198c0d2fc0 0x7f198c0c70c0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.117+0000 7f1990df6640 1 --2- 172.21.15.6:0/2405411625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f198c0d2300 0x7f198c0b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.117+0000 7f1990df6640 1 -- 172.21.15.6:0/2405411625 >> 172.21.15.6:0/2405411625 conn(0x7f198c0659d0 msgr2=0x7f198c159d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:22.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.117+0000 7f1990df6640 1 -- 172.21.15.6:0/2405411625 shutdown_connections 2023-07-21T22:37:22.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.117+0000 7f1990df6640 1 -- 172.21.15.6:0/2405411625 wait complete. 2023-07-21T22:37:22.183 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:37:22.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.281+0000 7fdfe4d37640 1 Processor -- start 2023-07-21T22:37:22.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.281+0000 7fdfe4d37640 1 -- start start 2023-07-21T22:37:22.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.285+0000 7fdfe4d37640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdfe00b7c70 0x7fdfe00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:22.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.285+0000 7fdfe4d37640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdfe00d1850 0x7fdfe015f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.285+0000 7fdfe4d37640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfe00ccaf0 con 0x7fdfe00d1300 2023-07-21T22:37:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.285+0000 7fdfe4d37640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfe00d1190 con 0x7fdfe00b7c70 2023-07-21T22:37:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.285+0000 7fdfe4d37640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe0160600 con 0x7fdfe00d1850 2023-07-21T22:37:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.285+0000 7fdfddd9b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdfe00d1850 0x7fdfe015f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.285+0000 7fdfde59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdfe00b7c70 0x7fdfe00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.285+0000 7fdfddd9b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdfe00d1850 0x7fdfe015f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:35374/0 (socket says 172.21.15.6:35374) 2023-07-21T22:37:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.285+0000 7fdfddd9b640 1 -- 172.21.15.6:0/999773723 learned_addr learned my addr 172.21.15.6:0/999773723 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:22.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.285+0000 7fdfded9d640 1 --1- 172.21.15.6:0/999773723 >> v1:172.21.15.161:6789/0 conn(0x7fdfe00d1300 0x7fdfe00d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:45120/0 (socket says 172.21.15.6:45120) 2023-07-21T22:37:22.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.285+0000 7fdfddd9b640 1 -- 172.21.15.6:0/999773723 >> v2:172.21.15.161:3300/0 conn(0x7fdfe00b7c70 msgr2=0x7fdfe00d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:22.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.285+0000 7fdfddd9b640 1 --2- 172.21.15.6:0/999773723 >> v2:172.21.15.161:3300/0 conn(0x7fdfe00b7c70 0x7fdfe00d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.285+0000 7fdfddd9b640 1 -- 172.21.15.6:0/999773723 >> v1:172.21.15.161:6789/0 conn(0x7fdfe00d1300 legacy=0x7fdfe00d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:22.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.285+0000 7fdfddd9b640 1 -- 172.21.15.6:0/999773723 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe0160320 con 0x7fdfe00d1850 2023-07-21T22:37:22.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.285+0000 7fdfde59c640 1 --2- 172.21.15.6:0/999773723 >> v2:172.21.15.161:3300/0 conn(0x7fdfe00b7c70 0x7fdfe00d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:22.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.289+0000 7fdfddd9b640 1 --2- 172.21.15.6:0/999773723 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdfe00d1850 0x7fdfe015f650 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009870 tx=0x7fdfd401c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6100924ed50a21ef server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:22.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.289+0000 7fdfdd59a640 1 -- 172.21.15.6:0/999773723 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40ab620 con 0x7fdfe00d1850 2023-07-21T22:37:22.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.289+0000 7fdfdd59a640 1 -- 172.21.15.6:0/999773723 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd40ab780 con 0x7fdfe00d1850 2023-07-21T22:37:22.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.289+0000 7fdfdd59a640 1 -- 172.21.15.6:0/999773723 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40abb10 con 0x7fdfe00d1850 2023-07-21T22:37:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.289+0000 7fdfe4d37640 1 -- 172.21.15.6:0/999773723 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdfe00d1850 msgr2=0x7fdfe015f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:22.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.289+0000 7fdfe4d37640 1 --2- 172.21.15.6:0/999773723 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdfe00d1850 0x7fdfe015f650 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009870 tx=0x7fdfd401c510 comp rx=0 tx=0).stop 2023-07-21T22:37:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.289+0000 7fdfe4d37640 1 -- 172.21.15.6:0/999773723 shutdown_connections 2023-07-21T22:37:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.289+0000 7fdfe4d37640 1 --2- 172.21.15.6:0/999773723 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdfe00d1850 0x7fdfe015f650 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.289+0000 7fdfe4d37640 1 --2- 172.21.15.6:0/999773723 >> v2:172.21.15.161:3300/0 conn(0x7fdfe00b7c70 0x7fdfe00d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.289+0000 7fdfe4d37640 1 -- 172.21.15.6:0/999773723 >> 172.21.15.6:0/999773723 conn(0x7fdfe00650b0 msgr2=0x7fdfe00654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.289+0000 7fdfe4d37640 1 -- 172.21.15.6:0/999773723 shutdown_connections 2023-07-21T22:37:22.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.289+0000 7fdfe4d37640 1 -- 172.21.15.6:0/999773723 wait complete. 2023-07-21T22:37:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfe4d37640 1 Processor -- start 2023-07-21T22:37:22.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfe4d37640 1 -- start start 2023-07-21T22:37:22.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfe4d37640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdfe00b7c70 0x7fdfe00cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:22.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfe4d37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe00d1300 0x7fdfe015b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:22.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfe4d37640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfe00d1850 0x7fdfe0153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:22.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfe4d37640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe015af80 con 0x7fdfe00d1300 2023-07-21T22:37:22.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfe4d37640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe00cbb20 con 0x7fdfe00d1850 2023-07-21T22:37:22.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfe4d37640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe00cbda0 con 0x7fdfe00b7c70 2023-07-21T22:37:22.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfddd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe00d1300 0x7fdfe015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:22.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfddd9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe00d1300 0x7fdfe015b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46776/0 (socket says 172.21.15.6:46776) 2023-07-21T22:37:22.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfddd9b640 1 -- 172.21.15.6:0/1766792642 learned_addr learned my addr 172.21.15.6:0/1766792642 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:22.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfde59c640 1 --2- 172.21.15.6:0/1766792642 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdfe00b7c70 0x7fdfe00cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:22.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfded9d640 1 --2- 172.21.15.6:0/1766792642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfe00d1850 0x7fdfe0153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:22.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfddd9b640 1 -- 172.21.15.6:0/1766792642 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdfe00b7c70 msgr2=0x7fdfe00cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:22.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfddd9b640 1 --2- 172.21.15.6:0/1766792642 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdfe00b7c70 0x7fdfe00cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfddd9b640 1 -- 172.21.15.6:0/1766792642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfe00d1850 msgr2=0x7fdfe0153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:22.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfddd9b640 1 --2- 172.21.15.6:0/1766792642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfe00d1850 0x7fdfe0153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfddd9b640 1 -- 172.21.15.6:0/1766792642 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd0009420 con 0x7fdfe00d1300 2023-07-21T22:37:22.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfddd9b640 1 --2- 172.21.15.6:0/1766792642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe00d1300 0x7fdfe015b410 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fdfd401abc0 tx=0x7fdfd40192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:22.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfceffd640 1 -- 172.21.15.6:0/1766792642 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40abe80 con 0x7fdfe00d1300 2023-07-21T22:37:22.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfceffd640 1 -- 172.21.15.6:0/1766792642 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd40bf410 con 0x7fdfe00d1300 2023-07-21T22:37:22.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfceffd640 1 -- 172.21.15.6:0/1766792642 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40bf7c0 con 0x7fdfe00d1300 2023-07-21T22:37:22.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfe4d37640 1 -- 172.21.15.6:0/1766792642 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd40094d0 con 0x7fdfe00d1300 2023-07-21T22:37:22.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfe4d37640 1 -- 172.21.15.6:0/1766792642 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe015a930 con 0x7fdfe00d1300 2023-07-21T22:37:22.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.293+0000 7fdfe4d37640 1 -- 172.21.15.6:0/1766792642 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe00678d0 con 0x7fdfe00d1300 2023-07-21T22:37:22.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.297+0000 7fdfceffd640 1 -- 172.21.15.6:0/1766792642 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdfd40b5400 con 0x7fdfe00d1300 2023-07-21T22:37:22.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.297+0000 7fdfceffd640 1 --2- 172.21.15.6:0/1766792642 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fdfc00663d0 0x7fdfc0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:22.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.297+0000 7fdfceffd640 1 -- 172.21.15.6:0/1766792642 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fdfd411df00 con 0x7fdfe00d1300 2023-07-21T22:37:22.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.297+0000 7fdfde59c640 1 --2- 172.21.15.6:0/1766792642 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fdfc00663d0 0x7fdfc0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:22.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.297+0000 7fdfde59c640 1 --2- 172.21.15.6:0/1766792642 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fdfc00663d0 0x7fdfc0068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0009c50 tx=0x7fdfd0009190 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:22.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.301+0000 7fdfceffd640 1 -- 172.21.15.6:0/1766792642 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdfd40eb140 con 0x7fdfe00d1300 2023-07-21T22:37:22.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.457+0000 7fdfe4d37640 1 -- 172.21.15.6:0/1766792642 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfe00c5bb0 con 0x7fdfe00d1300 2023-07-21T22:37:22.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.457+0000 7fdfceffd640 1 -- 172.21.15.6:0/1766792642 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+18304 (secure 0 0 0) 0x7fdfd40ee760 con 0x7fdfe00d1300 2023-07-21T22:37:22.503 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:22.503 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":127,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:37:21.459954+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:37:19.569960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-21T22:37:20.452035+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:37:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.461+0000 7fdfe4d37640 1 -- 172.21.15.6:0/1766792642 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fdfc00663d0 msgr2=0x7fdfc0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.461+0000 7fdfe4d37640 1 --2- 172.21.15.6:0/1766792642 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fdfc00663d0 0x7fdfc0068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0009c50 tx=0x7fdfd0009190 comp rx=0 tx=0).stop 2023-07-21T22:37:22.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.461+0000 7fdfe4d37640 1 -- 172.21.15.6:0/1766792642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe00d1300 msgr2=0x7fdfe015b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.461+0000 7fdfe4d37640 1 --2- 172.21.15.6:0/1766792642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe00d1300 0x7fdfe015b410 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fdfd401abc0 tx=0x7fdfd40192b0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.461+0000 7fdfe4d37640 1 -- 172.21.15.6:0/1766792642 shutdown_connections 2023-07-21T22:37:22.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.461+0000 7fdfe4d37640 1 --2- 172.21.15.6:0/1766792642 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fdfc00663d0 0x7fdfc0068880 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.461+0000 7fdfe4d37640 1 --2- 172.21.15.6:0/1766792642 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfe00d1850 0x7fdfe0153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.461+0000 7fdfe4d37640 1 --2- 172.21.15.6:0/1766792642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdfe00d1300 0x7fdfe015b410 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.461+0000 7fdfe4d37640 1 --2- 172.21.15.6:0/1766792642 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdfe00b7c70 0x7fdfe00cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.461+0000 7fdfe4d37640 1 -- 172.21.15.6:0/1766792642 >> 172.21.15.6:0/1766792642 conn(0x7fdfe00650b0 msgr2=0x7fdfe0065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:22.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.461+0000 7fdfe4d37640 1 -- 172.21.15.6:0/1766792642 shutdown_connections 2023-07-21T22:37:22.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.461+0000 7fdfe4d37640 1 -- 172.21.15.6:0/1766792642 wait complete. 2023-07-21T22:37:22.525 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:37:22.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.625+0000 7f88ef419640 1 Processor -- start 2023-07-21T22:37:22.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.625+0000 7f88ef419640 1 -- start start 2023-07-21T22:37:22.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.625+0000 7f88ef419640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f88e80c8ad0 0x7f88e80c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.625+0000 7f88ef419640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f88e80c9560 0x7f88e80ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.625+0000 7f88ef419640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e80c99c0 con 0x7f88e8158ce0 2023-07-21T22:37:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.625+0000 7f88ef419640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e80cc700 con 0x7f88e80c8ad0 2023-07-21T22:37:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.625+0000 7f88ef419640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e80b0ff0 con 0x7f88e80c9560 2023-07-21T22:37:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.625+0000 7f88ec9b4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f88e80c8ad0 0x7f88e80c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:22.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.625+0000 7f88ec9b4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f88e80c8ad0 0x7f88e80c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46786/0 (socket says 172.21.15.6:46786) 2023-07-21T22:37:22.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.625+0000 7f88ec9b4640 1 -- 172.21.15.6:0/2866314649 learned_addr learned my addr 172.21.15.6:0/2866314649 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:22.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.625+0000 7f88ed9b6640 1 --2- 172.21.15.6:0/2866314649 >> v2:172.21.15.161:3300/0 conn(0x7f88e80c9560 0x7f88e80ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:22.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.625+0000 7f88ec9b4640 1 -- 172.21.15.6:0/2866314649 >> v2:172.21.15.161:3300/0 conn(0x7f88e80c9560 msgr2=0x7f88e80ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:22.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.625+0000 7f88ec9b4640 1 --2- 172.21.15.6:0/2866314649 >> v2:172.21.15.161:3300/0 conn(0x7f88e80c9560 0x7f88e80ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.625+0000 7f88ec9b4640 1 -- 172.21.15.6:0/2866314649 >> v1:172.21.15.161:6789/0 conn(0x7f88e8158ce0 legacy=0x7f88e8070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:22.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.625+0000 7f88ec9b4640 1 -- 172.21.15.6:0/2866314649 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e8070c80 con 0x7f88e80c8ad0 2023-07-21T22:37:22.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.625+0000 7f88ed9b6640 1 --2- 172.21.15.6:0/2866314649 >> v2:172.21.15.161:3300/0 conn(0x7f88e80c9560 0x7f88e80ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:37:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.629+0000 7f88ec9b4640 1 --2- 172.21.15.6:0/2866314649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88e80c8ad0 0x7f88e80c9020 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f88e80b0d70 tx=0x7f88d801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457ee659068f6e9c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.629+0000 7f88dffff640 1 -- 172.21.15.6:0/2866314649 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d80ab600 con 0x7f88e80c8ad0 2023-07-21T22:37:22.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.629+0000 7f88dffff640 1 -- 172.21.15.6:0/2866314649 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d80a7050 con 0x7f88e80c8ad0 2023-07-21T22:37:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.629+0000 7f88dffff640 1 -- 172.21.15.6:0/2866314649 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d80ab980 con 0x7f88e80c8ad0 2023-07-21T22:37:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.629+0000 7f88ef419640 1 -- 172.21.15.6:0/2866314649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88e80c8ad0 msgr2=0x7f88e80c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:22.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.629+0000 7f88ef419640 1 --2- 172.21.15.6:0/2866314649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88e80c8ad0 0x7f88e80c9020 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f88e80b0d70 tx=0x7f88d801c370 comp rx=0 tx=0).stop 2023-07-21T22:37:22.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.629+0000 7f88ef419640 1 -- 172.21.15.6:0/2866314649 shutdown_connections 2023-07-21T22:37:22.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.629+0000 7f88ef419640 1 --2- 172.21.15.6:0/2866314649 >> v2:172.21.15.161:3300/0 conn(0x7f88e80c9560 0x7f88e80ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.629+0000 7f88ef419640 1 --2- 172.21.15.6:0/2866314649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88e80c8ad0 0x7f88e80c9020 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.629+0000 7f88ef419640 1 -- 172.21.15.6:0/2866314649 >> 172.21.15.6:0/2866314649 conn(0x7f88e80afcf0 msgr2=0x7f88e80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:22.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.629+0000 7f88ef419640 1 -- 172.21.15.6:0/2866314649 shutdown_connections 2023-07-21T22:37:22.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.629+0000 7f88ef419640 1 -- 172.21.15.6:0/2866314649 wait complete. 2023-07-21T22:37:22.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ef419640 1 Processor -- start 2023-07-21T22:37:22.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ef419640 1 -- start start 2023-07-21T22:37:22.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ef419640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88e80c8ad0 0x7f88e81434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:22.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ef419640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88e80c9560 0x7f88e80b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ef419640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88e8158ce0 0x7f88e81f5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ef419640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e80c5bd0 con 0x7f88e80c9560 2023-07-21T22:37:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ef419640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e8150db0 con 0x7f88e80c8ad0 2023-07-21T22:37:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ef419640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e80c7d90 con 0x7f88e8158ce0 2023-07-21T22:37:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ec9b4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88e80c9560 0x7f88e80b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:22.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ec9b4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88e80c9560 0x7f88e80b1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46788/0 (socket says 172.21.15.6:46788) 2023-07-21T22:37:22.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ec9b4640 1 -- 172.21.15.6:0/3950561588 learned_addr learned my addr 172.21.15.6:0/3950561588 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:22.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ed9b6640 1 --2- 172.21.15.6:0/3950561588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88e8158ce0 0x7f88e81f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:22.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ed1b5640 1 --2- 172.21.15.6:0/3950561588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88e80c8ad0 0x7f88e81434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:22.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ec9b4640 1 -- 172.21.15.6:0/3950561588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88e8158ce0 msgr2=0x7f88e81f5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:22.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ec9b4640 1 --2- 172.21.15.6:0/3950561588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88e8158ce0 0x7f88e81f5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ec9b4640 1 -- 172.21.15.6:0/3950561588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88e80c8ad0 msgr2=0x7f88e81434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:22.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ec9b4640 1 --2- 172.21.15.6:0/3950561588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88e80c8ad0 0x7f88e81434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ec9b4640 1 -- 172.21.15.6:0/3950561588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d80094d0 con 0x7f88e80c9560 2023-07-21T22:37:22.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ec9b4640 1 --2- 172.21.15.6:0/3950561588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88e80c9560 0x7f88e80b1390 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f88d80ae040 tx=0x7f88d8019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:22.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ddffb640 1 -- 172.21.15.6:0/3950561588 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d80b4640 con 0x7f88e80c9560 2023-07-21T22:37:22.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ddffb640 1 -- 172.21.15.6:0/3950561588 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d80b47c0 con 0x7f88e80c9560 2023-07-21T22:37:22.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ddffb640 1 -- 172.21.15.6:0/3950561588 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d80b4b70 con 0x7f88e80c9560 2023-07-21T22:37:22.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ef419640 1 -- 172.21.15.6:0/3950561588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e80c7fe0 con 0x7f88e80c9560 2023-07-21T22:37:22.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ef419640 1 -- 172.21.15.6:0/3950561588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e80c5510 con 0x7f88e80c9560 2023-07-21T22:37:22.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.633+0000 7f88ef419640 1 -- 172.21.15.6:0/3950561588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e80ca1a0 con 0x7f88e80c9560 2023-07-21T22:37:22.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.637+0000 7f88ddffb640 1 -- 172.21.15.6:0/3950561588 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f88d80b2070 con 0x7f88e80c9560 2023-07-21T22:37:22.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.637+0000 7f88ddffb640 1 --2- 172.21.15.6:0/3950561588 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f88cc0663a0 0x7f88cc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:22.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.637+0000 7f88ddffb640 1 -- 172.21.15.6:0/3950561588 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f88d811e0d0 con 0x7f88e80c9560 2023-07-21T22:37:22.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.637+0000 7f88ed1b5640 1 --2- 172.21.15.6:0/3950561588 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f88cc0663a0 0x7f88cc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:22.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.637+0000 7f88ed1b5640 1 --2- 172.21.15.6:0/3950561588 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f88cc0663a0 0x7f88cc068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f88e400b810 tx=0x7f88e4008040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:22.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.641+0000 7f88ddffb640 1 -- 172.21.15.6:0/3950561588 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f88d80eb2f0 con 0x7f88e80c9560 2023-07-21T22:37:22.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.797+0000 7f88ef419640 1 -- 172.21.15.6:0/3950561588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88e80678d0 con 0x7f88e80c9560 2023-07-21T22:37:22.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.801+0000 7f88ddffb640 1 -- 172.21.15.6:0/3950561588 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) v1 ==== 74+0+18304 (secure 0 0 0) 0x7f88d80ee910 con 0x7f88e80c9560 2023-07-21T22:37:22.846 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:22.846 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":127,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:37:21.459954+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:37:19.569960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-21T22:37:20.452035+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:37:22.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.801+0000 7f88ef419640 1 -- 172.21.15.6:0/3950561588 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f88cc0663a0 msgr2=0x7f88cc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:22.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.801+0000 7f88ef419640 1 --2- 172.21.15.6:0/3950561588 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f88cc0663a0 0x7f88cc068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f88e400b810 tx=0x7f88e4008040 comp rx=0 tx=0).stop 2023-07-21T22:37:22.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.801+0000 7f88ef419640 1 -- 172.21.15.6:0/3950561588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88e80c9560 msgr2=0x7f88e80b1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:22.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.801+0000 7f88ef419640 1 --2- 172.21.15.6:0/3950561588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88e80c9560 0x7f88e80b1390 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f88d80ae040 tx=0x7f88d8019110 comp rx=0 tx=0).stop 2023-07-21T22:37:22.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.801+0000 7f88ef419640 1 -- 172.21.15.6:0/3950561588 shutdown_connections 2023-07-21T22:37:22.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.801+0000 7f88ef419640 1 --2- 172.21.15.6:0/3950561588 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f88cc0663a0 0x7f88cc068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.801+0000 7f88ef419640 1 --2- 172.21.15.6:0/3950561588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88e8158ce0 0x7f88e81f5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.801+0000 7f88ef419640 1 --2- 172.21.15.6:0/3950561588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88e80c9560 0x7f88e80b1390 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.801+0000 7f88ef419640 1 --2- 172.21.15.6:0/3950561588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88e80c8ad0 0x7f88e81434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:22.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.801+0000 7f88ef419640 1 -- 172.21.15.6:0/3950561588 >> 172.21.15.6:0/3950561588 conn(0x7f88e80afcf0 msgr2=0x7f88e806b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:22.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.801+0000 7f88ef419640 1 -- 172.21.15.6:0/3950561588 shutdown_connections 2023-07-21T22:37:22.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.801+0000 7f88ef419640 1 -- 172.21.15.6:0/3950561588 wait complete. 2023-07-21T22:37:22.867 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-21T22:37:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.969+0000 7fee5ef9d640 1 Processor -- start 2023-07-21T22:37:23.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.969+0000 7fee5ef9d640 1 -- start start 2023-07-21T22:37:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.969+0000 7fee5ef9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fee58070f30 0x7fee580ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.969+0000 7fee5ef9d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee58159d70 con 0x7fee58069430 2023-07-21T22:37:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.969+0000 7fee5ef9d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee580c9c60 con 0x7fee580af2b0 2023-07-21T22:37:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.969+0000 7fee5ef9d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee580c9f40 con 0x7fee58070f30 2023-07-21T22:37:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee5cd39640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fee58069430 0x7fee58069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53106/0 (socket says 172.21.15.6:53106) 2023-07-21T22:37:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee5cd39640 1 -- 172.21.15.6:0/1066274509 learned_addr learned my addr 172.21.15.6:0/1066274509 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:23.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee57fff640 1 --2- 172.21.15.6:0/1066274509 >> v2:172.21.15.161:3300/0 conn(0x7fee58070f30 0x7fee580ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:23.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee577fe640 1 -- 172.21.15.6:0/1066274509 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849426696 0 0) 0x7fee4c001120 con 0x7fee58069430 2023-07-21T22:37:23.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee577fe640 1 -- 172.21.15.6:0/1066274509 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee48003530 con 0x7fee58069430 2023-07-21T22:37:23.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee577fe640 1 -- 172.21.15.6:0/1066274509 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332054642 0 0) 0x7fee580c9c60 con 0x7fee580af2b0 2023-07-21T22:37:23.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee577fe640 1 -- 172.21.15.6:0/1066274509 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee4c001120 con 0x7fee580af2b0 2023-07-21T22:37:23.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee577fe640 1 -- 172.21.15.6:0/1066274509 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1843287417 0 0) 0x7fee48003530 con 0x7fee58069430 2023-07-21T22:37:23.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee577fe640 1 -- 172.21.15.6:0/1066274509 >> v2:172.21.15.161:3300/0 conn(0x7fee58070f30 msgr2=0x7fee580ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:23.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee577fe640 1 --2- 172.21.15.6:0/1066274509 >> v2:172.21.15.161:3300/0 conn(0x7fee58070f30 0x7fee580ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:23.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee577fe640 1 -- 172.21.15.6:0/1066274509 >> v1:172.21.15.161:6789/0 conn(0x7fee580af2b0 legacy=0x7fee5815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:23.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee577fe640 1 -- 172.21.15.6:0/1066274509 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee580ca220 con 0x7fee58069430 2023-07-21T22:37:23.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee577fe640 1 -- 172.21.15.6:0/1066274509 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fee4c001810 con 0x7fee58069430 2023-07-21T22:37:23.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee577fe640 1 -- 172.21.15.6:0/1066274509 >> v1:172.21.15.6:6789/0 conn(0x7fee58069430 legacy=0x7fee58069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:23.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee577fe640 1 --2- 172.21.15.6:0/1066274509 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee48003b10 0x7fee48003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee577fe640 1 --2- 172.21.15.6:0/1066274509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee480047d0 0x7fee48004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee577fe640 1 --2- 172.21.15.6:0/1066274509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee48005180 0x7fee4800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee577fe640 1 -- 172.21.15.6:0/1066274509 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee580c9f40 con 0x7fee48005180 2023-07-21T22:37:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee577fe640 1 -- 172.21.15.6:0/1066274509 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4800bfe0 con 0x7fee480047d0 2023-07-21T22:37:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee577fe640 1 -- 172.21.15.6:0/1066274509 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4800c1a0 con 0x7fee48003b10 2023-07-21T22:37:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee5d53a640 1 --2- 172.21.15.6:0/1066274509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee48005180 0x7fee4800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:23.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee5cd39640 1 --2- 172.21.15.6:0/1066274509 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee48003b10 0x7fee48003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:23.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee57fff640 1 --2- 172.21.15.6:0/1066274509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee480047d0 0x7fee48004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:23.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee5d53a640 1 -- 172.21.15.6:0/1066274509 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee48003b10 msgr2=0x7fee48003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:23.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee5d53a640 1 --2- 172.21.15.6:0/1066274509 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee48003b10 0x7fee48003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:23.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee5d53a640 1 -- 172.21.15.6:0/1066274509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee480047d0 msgr2=0x7fee48004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:23.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee5d53a640 1 --2- 172.21.15.6:0/1066274509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee480047d0 0x7fee48004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:23.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee5d53a640 1 -- 172.21.15.6:0/1066274509 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee48003530 con 0x7fee48005180 2023-07-21T22:37:23.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.973+0000 7fee57fff640 1 --2- 172.21.15.6:0/1066274509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee480047d0 0x7fee48004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:23.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.977+0000 7fee5d53a640 1 -- 172.21.15.6:0/1066274509 reap_dead start 2023-07-21T22:37:23.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.977+0000 7fee5d53a640 1 --2- 172.21.15.6:0/1066274509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee48005180 0x7fee4800b990 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fee50001fd0 tx=0x7fee5001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bd21144e9c2a2d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:23.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.977+0000 7fee577fe640 1 -- 172.21.15.6:0/1066274509 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50003b80 con 0x7fee48005180 2023-07-21T22:37:23.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.977+0000 7fee577fe640 1 -- 172.21.15.6:0/1066274509 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee50003ce0 con 0x7fee48005180 2023-07-21T22:37:23.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.977+0000 7fee577fe640 1 -- 172.21.15.6:0/1066274509 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50005310 con 0x7fee48005180 2023-07-21T22:37:23.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.977+0000 7fee5ef9d640 1 -- 172.21.15.6:0/1066274509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee48005180 msgr2=0x7fee4800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:23.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.977+0000 7fee5ef9d640 1 --2- 172.21.15.6:0/1066274509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee48005180 0x7fee4800b990 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fee50001fd0 tx=0x7fee5001c8e0 comp rx=0 tx=0).stop 2023-07-21T22:37:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.977+0000 7fee5ef9d640 1 -- 172.21.15.6:0/1066274509 shutdown_connections 2023-07-21T22:37:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.977+0000 7fee5ef9d640 1 --2- 172.21.15.6:0/1066274509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee48005180 0x7fee4800b990 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.977+0000 7fee5ef9d640 1 -- 172.21.15.6:0/1066274509 >> 172.21.15.6:0/1066274509 conn(0x7fee580cde90 msgr2=0x7fee580ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.977+0000 7fee5ef9d640 1 -- 172.21.15.6:0/1066274509 shutdown_connections 2023-07-21T22:37:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.977+0000 7fee5ef9d640 1 -- 172.21.15.6:0/1066274509 wait complete. 2023-07-21T22:37:23.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.977+0000 7fee5ef9d640 1 Processor -- start 2023-07-21T22:37:23.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.977+0000 7fee5ef9d640 1 -- start start 2023-07-21T22:37:23.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee5ef9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee48005180 0x7fee580b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:23.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee5ef9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee581f1b50 0x7fee5814d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:23.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee5ef9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee5806b6b0 0x7fee5806bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:23.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee5ef9d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5806c060 con 0x7fee48005180 2023-07-21T22:37:23.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee5ef9d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee580b2d30 con 0x7fee581f1b50 2023-07-21T22:37:23.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee5ef9d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee580b3010 con 0x7fee5806b6b0 2023-07-21T22:37:23.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee5cd39640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee48005180 0x7fee580b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:23.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee5cd39640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee48005180 0x7fee580b26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46800/0 (socket says 172.21.15.6:46800) 2023-07-21T22:37:23.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee5cd39640 1 -- 172.21.15.6:0/2358853318 learned_addr learned my addr 172.21.15.6:0/2358853318 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:23.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee5cd39640 1 -- 172.21.15.6:0/2358853318 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee5806b6b0 msgr2=0x7fee5806bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:23.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee5cd39640 1 --2- 172.21.15.6:0/2358853318 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee5806b6b0 0x7fee5806bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:23.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee5cd39640 1 -- 172.21.15.6:0/2358853318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee581f1b50 msgr2=0x7fee5814d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:23.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee5cd39640 1 --2- 172.21.15.6:0/2358853318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee581f1b50 0x7fee5814d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:23.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee5cd39640 1 -- 172.21.15.6:0/2358853318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee580b32f0 con 0x7fee48005180 2023-07-21T22:37:23.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee5cd39640 1 --2- 172.21.15.6:0/2358853318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee48005180 0x7fee580b26b0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fee4c012510 tx=0x7fee4c0129d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:23.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee557fa640 1 -- 172.21.15.6:0/2358853318 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c014750 con 0x7fee48005180 2023-07-21T22:37:23.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee557fa640 1 -- 172.21.15.6:0/2358853318 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c0148b0 con 0x7fee48005180 2023-07-21T22:37:23.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee5ef9d640 1 -- 172.21.15.6:0/2358853318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee580b35d0 con 0x7fee48005180 2023-07-21T22:37:23.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee557fa640 1 -- 172.21.15.6:0/2358853318 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c014c40 con 0x7fee48005180 2023-07-21T22:37:23.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee5ef9d640 1 -- 172.21.15.6:0/2358853318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee580b3dd0 con 0x7fee48005180 2023-07-21T22:37:23.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee5ef9d640 1 -- 172.21.15.6:0/2358853318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee580b3af0 con 0x7fee48005180 2023-07-21T22:37:23.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.981+0000 7fee557fa640 1 -- 172.21.15.6:0/2358853318 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fee4c0153e0 con 0x7fee48005180 2023-07-21T22:37:23.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.985+0000 7fee557fa640 1 --2- 172.21.15.6:0/2358853318 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fee3c0663d0 0x7fee3c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:23.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.985+0000 7fee557fa640 1 -- 172.21.15.6:0/2358853318 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fee4c086870 con 0x7fee48005180 2023-07-21T22:37:23.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.985+0000 7fee57fff640 1 --2- 172.21.15.6:0/2358853318 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fee3c0663d0 0x7fee3c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:23.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.985+0000 7fee57fff640 1 --2- 172.21.15.6:0/2358853318 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fee3c0663d0 0x7fee3c068880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fee58151550 tx=0x7fee440112c0 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:23.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:22.989+0000 7fee557fa640 1 -- 172.21.15.6:0/2358853318 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee580b3af0 con 0x7fee48005180 2023-07-21T22:37:23.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:23.185+0000 7fee5ef9d640 1 -- 172.21.15.6:0/2358853318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fee58159d70 con 0x7fee48005180 2023-07-21T22:37:24.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.101+0000 7fee557fa640 1 -- 172.21.15.6:0/2358853318 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v53) v1 ==== 118+0+0 (secure 0 0 0) 0x7fee58159d70 con 0x7fee48005180 2023-07-21T22:37:24.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.105+0000 7fee5ef9d640 1 -- 172.21.15.6:0/2358853318 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fee3c0663d0 msgr2=0x7fee3c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:24.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.105+0000 7fee5ef9d640 1 --2- 172.21.15.6:0/2358853318 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fee3c0663d0 0x7fee3c068880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fee58151550 tx=0x7fee440112c0 comp rx=0 tx=0).stop 2023-07-21T22:37:24.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.105+0000 7fee5ef9d640 1 -- 172.21.15.6:0/2358853318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee48005180 msgr2=0x7fee580b26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:24.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.105+0000 7fee5ef9d640 1 --2- 172.21.15.6:0/2358853318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee48005180 0x7fee580b26b0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fee4c012510 tx=0x7fee4c0129d0 comp rx=0 tx=0).stop 2023-07-21T22:37:24.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.105+0000 7fee5ef9d640 1 -- 172.21.15.6:0/2358853318 shutdown_connections 2023-07-21T22:37:24.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.105+0000 7fee5ef9d640 1 --2- 172.21.15.6:0/2358853318 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fee3c0663d0 0x7fee3c068880 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:24.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.105+0000 7fee5ef9d640 1 --2- 172.21.15.6:0/2358853318 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee5806b6b0 0x7fee5806bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:24.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.105+0000 7fee5ef9d640 1 --2- 172.21.15.6:0/2358853318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee581f1b50 0x7fee5814d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:24.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.105+0000 7fee5ef9d640 1 --2- 172.21.15.6:0/2358853318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee48005180 0x7fee580b26b0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:24.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.105+0000 7fee5ef9d640 1 -- 172.21.15.6:0/2358853318 >> 172.21.15.6:0/2358853318 conn(0x7fee580cde90 msgr2=0x7fee5806cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:24.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.105+0000 7fee5ef9d640 1 -- 172.21.15.6:0/2358853318 shutdown_connections 2023-07-21T22:37:24.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.105+0000 7fee5ef9d640 1 -- 172.21.15.6:0/2358853318 wait complete. 2023-07-21T22:37:24.174 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-21T22:37:24.175 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-21T22:37:24.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.281+0000 7fa5b659f640 1 Processor -- start 2023-07-21T22:37:24.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.281+0000 7fa5b659f640 1 -- start start 2023-07-21T22:37:24.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.281+0000 7fa5b659f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b015bde0 0x7fa5b00d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:24.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.281+0000 7fa5b659f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa5b00d2fc0 0x7fa5b00b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:24.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.281+0000 7fa5b659f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b00b04c0 con 0x7fa5b00d2300 2023-07-21T22:37:24.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.281+0000 7fa5b659f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b015c1b0 con 0x7fa5b00d2fc0 2023-07-21T22:37:24.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.281+0000 7fa5b659f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b00d0aa0 con 0x7fa5b015bde0 2023-07-21T22:37:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.281+0000 7fa5affff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b015bde0 0x7fa5b00d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.281+0000 7fa5af7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa5b00d2fc0 0x7fa5b00b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.281+0000 7fa5affff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b015bde0 0x7fa5b00d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:35410/0 (socket says 172.21.15.6:35410) 2023-07-21T22:37:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.281+0000 7fa5affff640 1 -- 172.21.15.6:0/1991724007 learned_addr learned my addr 172.21.15.6:0/1991724007 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:24.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.281+0000 7fa5af7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa5b00d2fc0 0x7fa5b00b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:50804/0 (socket says 172.21.15.6:50804) 2023-07-21T22:37:24.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.285+0000 7fa5af7fe640 1 -- 172.21.15.6:0/1991724007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b015bde0 msgr2=0x7fa5b00d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:24.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.285+0000 7fa5af7fe640 1 --2- 172.21.15.6:0/1991724007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b015bde0 0x7fa5b00d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:24.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.285+0000 7fa5af7fe640 1 -- 172.21.15.6:0/1991724007 >> v1:172.21.15.161:6789/0 conn(0x7fa5b00d2300 legacy=0x7fa5b00cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:24.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.285+0000 7fa5af7fe640 1 -- 172.21.15.6:0/1991724007 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b00afb90 con 0x7fa5b00d2fc0 2023-07-21T22:37:24.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.285+0000 7fa5affff640 1 --2- 172.21.15.6:0/1991724007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b015bde0 0x7fa5b00d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:24.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.285+0000 7fa5af7fe640 1 --2- 172.21.15.6:0/1991724007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5b00d2fc0 0x7fa5b00b0950 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40097c0 tx=0x7fa5a401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=828be4c65283c4af server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:24.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.285+0000 7fa5aeffd640 1 -- 172.21.15.6:0/1991724007 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a40ab680 con 0x7fa5b00d2fc0 2023-07-21T22:37:24.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.285+0000 7fa5aeffd640 1 -- 172.21.15.6:0/1991724007 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a40ab7e0 con 0x7fa5b00d2fc0 2023-07-21T22:37:24.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.285+0000 7fa5aeffd640 1 -- 172.21.15.6:0/1991724007 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a40abb70 con 0x7fa5b00d2fc0 2023-07-21T22:37:24.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5b659f640 1 -- 172.21.15.6:0/1991724007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5b00d2fc0 msgr2=0x7fa5b00b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:24.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5b659f640 1 --2- 172.21.15.6:0/1991724007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5b00d2fc0 0x7fa5b00b0950 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40097c0 tx=0x7fa5a401c480 comp rx=0 tx=0).stop 2023-07-21T22:37:24.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5b659f640 1 -- 172.21.15.6:0/1991724007 shutdown_connections 2023-07-21T22:37:24.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5b659f640 1 --2- 172.21.15.6:0/1991724007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5b00d2fc0 0x7fa5b00b0950 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:24.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5b659f640 1 --2- 172.21.15.6:0/1991724007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b015bde0 0x7fa5b00d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:24.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5b659f640 1 -- 172.21.15.6:0/1991724007 >> 172.21.15.6:0/1991724007 conn(0x7fa5b00659d0 msgr2=0x7fa5b009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:24.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5b659f640 1 -- 172.21.15.6:0/1991724007 shutdown_connections 2023-07-21T22:37:24.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5b659f640 1 -- 172.21.15.6:0/1991724007 wait complete. 2023-07-21T22:37:24.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5b659f640 1 Processor -- start 2023-07-21T22:37:24.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5b659f640 1 -- start start 2023-07-21T22:37:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5b659f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b00d2300 0x7fa5b00c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5b659f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b00d2fc0 0x7fa5b015ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5b659f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5b015bde0 0x7fa5b0150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5b659f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b00c5ea0 con 0x7fa5b00d2300 2023-07-21T22:37:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5b659f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b015f190 con 0x7fa5b015bde0 2023-07-21T22:37:24.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5b659f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b00c87e0 con 0x7fa5b00d2fc0 2023-07-21T22:37:24.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5affff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b00d2300 0x7fa5b00c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:24.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5affff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b00d2300 0x7fa5b00c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46814/0 (socket says 172.21.15.6:46814) 2023-07-21T22:37:24.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5affff640 1 -- 172.21.15.6:0/1644976015 learned_addr learned my addr 172.21.15.6:0/1644976015 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:24.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5af7fe640 1 --2- 172.21.15.6:0/1644976015 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b00d2fc0 0x7fa5b015ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:24.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5b4b3c640 1 --2- 172.21.15.6:0/1644976015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5b015bde0 0x7fa5b0150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:24.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5affff640 1 -- 172.21.15.6:0/1644976015 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b00d2fc0 msgr2=0x7fa5b015ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:24.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5affff640 1 --2- 172.21.15.6:0/1644976015 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b00d2fc0 0x7fa5b015ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:24.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.289+0000 7fa5affff640 1 -- 172.21.15.6:0/1644976015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5b015bde0 msgr2=0x7fa5b0150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:24.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.293+0000 7fa5affff640 1 --2- 172.21.15.6:0/1644976015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5b015bde0 0x7fa5b0150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:24.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.293+0000 7fa5affff640 1 -- 172.21.15.6:0/1644976015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a0009480 con 0x7fa5b00d2300 2023-07-21T22:37:24.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.293+0000 7fa5affff640 1 --2- 172.21.15.6:0/1644976015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b00d2300 0x7fa5b00c8200 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000ebb0 tx=0x7fa5a000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:24.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.293+0000 7fa5acff9640 1 -- 172.21.15.6:0/1644976015 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a000eeb0 con 0x7fa5b00d2300 2023-07-21T22:37:24.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.293+0000 7fa5acff9640 1 -- 172.21.15.6:0/1644976015 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a000cc30 con 0x7fa5b00d2300 2023-07-21T22:37:24.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.293+0000 7fa5acff9640 1 -- 172.21.15.6:0/1644976015 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a00059a0 con 0x7fa5b00d2300 2023-07-21T22:37:24.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.293+0000 7fa5b659f640 1 -- 172.21.15.6:0/1644976015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a4009420 con 0x7fa5b00d2300 2023-07-21T22:37:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.293+0000 7fa5b659f640 1 -- 172.21.15.6:0/1644976015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b00c60f0 con 0x7fa5b00d2300 2023-07-21T22:37:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.293+0000 7fa5b659f640 1 -- 172.21.15.6:0/1644976015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b00c8d00 con 0x7fa5b00d2300 2023-07-21T22:37:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.293+0000 7fa5acff9640 1 -- 172.21.15.6:0/1644976015 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa5a0005b00 con 0x7fa5b00d2300 2023-07-21T22:37:24.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.293+0000 7fa5acff9640 1 --2- 172.21.15.6:0/1644976015 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fa59c0663d0 0x7fa59c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.293+0000 7fa5acff9640 1 -- 172.21.15.6:0/1644976015 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fa5a0084490 con 0x7fa5b00d2300 2023-07-21T22:37:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.297+0000 7fa5af7fe640 1 --2- 172.21.15.6:0/1644976015 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fa59c0663d0 0x7fa59c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:24.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.297+0000 7fa5af7fe640 1 --2- 172.21.15.6:0/1644976015 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fa59c0663d0 0x7fa59c068880 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40af000 tx=0x7fa5a40a7000 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:24.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.297+0000 7fa5acff9640 1 -- 172.21.15.6:0/1644976015 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa5a00517c0 con 0x7fa5b00d2300 2023-07-21T22:37:24.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:24.485+0000 7fa5b659f640 1 -- 172.21.15.6:0/1644976015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa5b00678d0 con 0x7fa5b00d2300 2023-07-21T22:37:25.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.105+0000 7fa5acff9640 1 -- 172.21.15.6:0/1644976015 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v54) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa5a0054de0 con 0x7fa5b00d2300 2023-07-21T22:37:25.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.105+0000 7fa5b659f640 1 -- 172.21.15.6:0/1644976015 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fa59c0663d0 msgr2=0x7fa59c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:25.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.109+0000 7fa5b659f640 1 --2- 172.21.15.6:0/1644976015 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fa59c0663d0 0x7fa59c068880 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40af000 tx=0x7fa5a40a7000 comp rx=0 tx=0).stop 2023-07-21T22:37:25.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.109+0000 7fa5b659f640 1 -- 172.21.15.6:0/1644976015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b00d2300 msgr2=0x7fa5b00c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:25.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.109+0000 7fa5b659f640 1 --2- 172.21.15.6:0/1644976015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b00d2300 0x7fa5b00c8200 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fa5a000ebb0 tx=0x7fa5a000c520 comp rx=0 tx=0).stop 2023-07-21T22:37:25.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.109+0000 7fa5b659f640 1 -- 172.21.15.6:0/1644976015 shutdown_connections 2023-07-21T22:37:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.109+0000 7fa5b659f640 1 --2- 172.21.15.6:0/1644976015 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fa59c0663d0 0x7fa59c068880 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.109+0000 7fa5b659f640 1 --2- 172.21.15.6:0/1644976015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5b015bde0 0x7fa5b0150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.109+0000 7fa5b659f640 1 --2- 172.21.15.6:0/1644976015 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b00d2fc0 0x7fa5b015ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.109+0000 7fa5b659f640 1 --2- 172.21.15.6:0/1644976015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b00d2300 0x7fa5b00c8200 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.109+0000 7fa5b659f640 1 -- 172.21.15.6:0/1644976015 >> 172.21.15.6:0/1644976015 conn(0x7fa5b00659d0 msgr2=0x7fa5b00b71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.109+0000 7fa5b659f640 1 -- 172.21.15.6:0/1644976015 shutdown_connections 2023-07-21T22:37:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.109+0000 7fa5b659f640 1 -- 172.21.15.6:0/1644976015 wait complete. 2023-07-21T22:37:25.176 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-21T22:37:25.176 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:37:25.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.277+0000 7fc7cac0b640 1 Processor -- start 2023-07-21T22:37:25.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.277+0000 7fc7cac0b640 1 -- start start 2023-07-21T22:37:25.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.281+0000 7fc7cac0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7c4158ce0 0x7fc7c4070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:25.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.281+0000 7fc7cac0b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc7c40c9730 0x7fc7c40ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:25.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.281+0000 7fc7cac0b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c40cc700 con 0x7fc7c40c8ad0 2023-07-21T22:37:25.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.281+0000 7fc7cac0b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c40b0ff0 con 0x7fc7c40c9730 2023-07-21T22:37:25.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.281+0000 7fc7cac0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c4070c80 con 0x7fc7c4158ce0 2023-07-21T22:37:25.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.281+0000 7fc7c3fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc7c40c8ad0 0x7fc7c40c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53122/0 (socket says 172.21.15.6:53122) 2023-07-21T22:37:25.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.281+0000 7fc7c3fff640 1 -- 172.21.15.6:0/2914886141 learned_addr learned my addr 172.21.15.6:0/2914886141 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:25.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.281+0000 7fc7c89a7640 1 --2- 172.21.15.6:0/2914886141 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7c4158ce0 0x7fc7c4070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:25.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.281+0000 7fc7c91a8640 1 --2- 172.21.15.6:0/2914886141 >> v2:172.21.15.161:3300/0 conn(0x7fc7c40c9730 0x7fc7c40ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:25.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.281+0000 7fc7c37fe640 1 -- 172.21.15.6:0/2914886141 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 149293220 0 0) 0x7fc7c40cc700 con 0x7fc7c40c8ad0 2023-07-21T22:37:25.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.281+0000 7fc7c37fe640 1 -- 172.21.15.6:0/2914886141 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b4003530 con 0x7fc7c40c8ad0 2023-07-21T22:37:25.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.281+0000 7fc7c91a8640 1 -- 172.21.15.6:0/2914886141 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7c4158ce0 msgr2=0x7fc7c4070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:25.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.281+0000 7fc7c91a8640 1 --2- 172.21.15.6:0/2914886141 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7c4158ce0 0x7fc7c4070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.281+0000 7fc7c91a8640 1 -- 172.21.15.6:0/2914886141 >> v1:172.21.15.6:6789/0 conn(0x7fc7c40c8ad0 legacy=0x7fc7c40c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:25.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.281+0000 7fc7c91a8640 1 -- 172.21.15.6:0/2914886141 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c40cbdd0 con 0x7fc7c40c9730 2023-07-21T22:37:25.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.285+0000 7fc7c91a8640 1 --2- 172.21.15.6:0/2914886141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c40c9730 0x7fc7c40ccb90 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009d90 tx=0x7fc7bc01c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64fe42034d49960 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:25.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.285+0000 7fc7c37fe640 1 -- 172.21.15.6:0/2914886141 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc0a57d0 con 0x7fc7c40c9730 2023-07-21T22:37:25.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.285+0000 7fc7c37fe640 1 -- 172.21.15.6:0/2914886141 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc0a5930 con 0x7fc7c40c9730 2023-07-21T22:37:25.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.285+0000 7fc7c37fe640 1 -- 172.21.15.6:0/2914886141 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc0a5cc0 con 0x7fc7c40c9730 2023-07-21T22:37:25.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.285+0000 7fc7cac0b640 1 -- 172.21.15.6:0/2914886141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c40c9730 msgr2=0x7fc7c40ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:25.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.285+0000 7fc7cac0b640 1 --2- 172.21.15.6:0/2914886141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c40c9730 0x7fc7c40ccb90 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009d90 tx=0x7fc7bc01c800 comp rx=0 tx=0).stop 2023-07-21T22:37:25.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.285+0000 7fc7cac0b640 1 -- 172.21.15.6:0/2914886141 shutdown_connections 2023-07-21T22:37:25.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.285+0000 7fc7cac0b640 1 --2- 172.21.15.6:0/2914886141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c40c9730 0x7fc7c40ccb90 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.285+0000 7fc7cac0b640 1 --2- 172.21.15.6:0/2914886141 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7c4158ce0 0x7fc7c4070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.285+0000 7fc7cac0b640 1 -- 172.21.15.6:0/2914886141 >> 172.21.15.6:0/2914886141 conn(0x7fc7c40afcf0 msgr2=0x7fc7c40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:25.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.285+0000 7fc7cac0b640 1 -- 172.21.15.6:0/2914886141 shutdown_connections 2023-07-21T22:37:25.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.285+0000 7fc7cac0b640 1 -- 172.21.15.6:0/2914886141 wait complete. 2023-07-21T22:37:25.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.285+0000 7fc7cac0b640 1 Processor -- start 2023-07-21T22:37:25.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.285+0000 7fc7cac0b640 1 -- start start 2023-07-21T22:37:25.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7cac0b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c40c8ad0 0x7fc7c414f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:25.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7cac0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7c40c9730 0x7fc7c4151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:25.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7cac0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7c4158ce0 0x7fc7c4146670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:25.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7cac0b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c4146e10 con 0x7fc7c40c9730 2023-07-21T22:37:25.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7cac0b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c40cae50 con 0x7fc7c40c8ad0 2023-07-21T22:37:25.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7cac0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c4151a40 con 0x7fc7c4158ce0 2023-07-21T22:37:25.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7c3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7c40c9730 0x7fc7c4151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:25.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7c3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7c40c9730 0x7fc7c4151500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46816/0 (socket says 172.21.15.6:46816) 2023-07-21T22:37:25.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7c3fff640 1 -- 172.21.15.6:0/3975312552 learned_addr learned my addr 172.21.15.6:0/3975312552 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:25.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7c91a8640 1 --2- 172.21.15.6:0/3975312552 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7c4158ce0 0x7fc7c4146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:25.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7c89a7640 1 --2- 172.21.15.6:0/3975312552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c40c8ad0 0x7fc7c414f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:25.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7c3fff640 1 -- 172.21.15.6:0/3975312552 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7c4158ce0 msgr2=0x7fc7c4146670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:25.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7c3fff640 1 --2- 172.21.15.6:0/3975312552 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7c4158ce0 0x7fc7c4146670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7c3fff640 1 -- 172.21.15.6:0/3975312552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c40c8ad0 msgr2=0x7fc7c414f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:25.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7c3fff640 1 --2- 172.21.15.6:0/3975312552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c40c8ad0 0x7fc7c414f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7c3fff640 1 -- 172.21.15.6:0/3975312552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc009a70 con 0x7fc7c40c9730 2023-07-21T22:37:25.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7c89a7640 1 --2- 172.21.15.6:0/3975312552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c40c8ad0 0x7fc7c414f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:37:25.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7c91a8640 1 --2- 172.21.15.6:0/3975312552 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7c4158ce0 0x7fc7c4146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:37:25.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7c3fff640 1 --2- 172.21.15.6:0/3975312552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7c40c9730 0x7fc7c4151500 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fc7b000c450 tx=0x7fc7b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:25.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7c17fa640 1 -- 172.21.15.6:0/3975312552 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0005cf0 con 0x7fc7c40c9730 2023-07-21T22:37:25.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7c17fa640 1 -- 172.21.15.6:0/3975312552 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b0005e50 con 0x7fc7c40c9730 2023-07-21T22:37:25.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7c17fa640 1 -- 172.21.15.6:0/3975312552 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b0007290 con 0x7fc7c40c9730 2023-07-21T22:37:25.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7cac0b640 1 -- 172.21.15.6:0/3975312552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c40ca820 con 0x7fc7c40c9730 2023-07-21T22:37:25.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7cac0b640 1 -- 172.21.15.6:0/3975312552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c4151fc0 con 0x7fc7c40c9730 2023-07-21T22:37:25.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7cac0b640 1 -- 172.21.15.6:0/3975312552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c40ca1a0 con 0x7fc7c40c9730 2023-07-21T22:37:25.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.289+0000 7fc7c17fa640 1 -- 172.21.15.6:0/3975312552 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc7b00073f0 con 0x7fc7c40c9730 2023-07-21T22:37:25.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.293+0000 7fc7c17fa640 1 --2- 172.21.15.6:0/3975312552 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fc7a80663a0 0x7fc7a8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:25.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.293+0000 7fc7c17fa640 1 -- 172.21.15.6:0/3975312552 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fc7b0083470 con 0x7fc7c40c9730 2023-07-21T22:37:25.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.293+0000 7fc7c89a7640 1 --2- 172.21.15.6:0/3975312552 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fc7a80663a0 0x7fc7a8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:25.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.293+0000 7fc7c89a7640 1 --2- 172.21.15.6:0/3975312552 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fc7a80663a0 0x7fc7a8068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009a40 tx=0x7fc7b8008040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:25.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.297+0000 7fc7c17fa640 1 -- 172.21.15.6:0/3975312552 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc7b0050790 con 0x7fc7c40c9730 2023-07-21T22:37:25.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.485+0000 7fc7cac0b640 1 -- 172.21.15.6:0/3975312552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7c40cafc0 con 0x7fc7c40c9730 2023-07-21T22:37:25.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.485+0000 7fc7c17fa640 1 -- 172.21.15.6:0/3975312552 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4673 (secure 0 0 0) 0x7fc7b0053db0 con 0x7fc7c40c9730 2023-07-21T22:37:25.530 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:25.531 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1099541342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1099541342},{"type":"v1","addr":"172.21.15.161:6837","nonce":1099541342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3942495258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3942495258},{"type":"v1","addr":"172.21.15.161:6836","nonce":3942495258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8211,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3306024838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3306024838},{"type":"v1","addr":"172.21.15.6:6834","nonce":3306024838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:37:21.460444+0000","modified":"2023-07-21T22:37:25.102431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8214":{"gid":8214,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2511188295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2511188295},{"type":"v1","addr":"172.21.15.6:6835","nonce":2511188295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-21T22:37:25.531 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 54 2023-07-21T22:37:25.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.485+0000 7fc7cac0b640 1 -- 172.21.15.6:0/3975312552 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fc7a80663a0 msgr2=0x7fc7a8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:25.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.485+0000 7fc7cac0b640 1 --2- 172.21.15.6:0/3975312552 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fc7a80663a0 0x7fc7a8068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009a40 tx=0x7fc7b8008040 comp rx=0 tx=0).stop 2023-07-21T22:37:25.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.485+0000 7fc7cac0b640 1 -- 172.21.15.6:0/3975312552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7c40c9730 msgr2=0x7fc7c4151500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:25.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.485+0000 7fc7cac0b640 1 --2- 172.21.15.6:0/3975312552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7c40c9730 0x7fc7c4151500 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fc7b000c450 tx=0x7fc7b000c910 comp rx=0 tx=0).stop 2023-07-21T22:37:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.485+0000 7fc7cac0b640 1 -- 172.21.15.6:0/3975312552 shutdown_connections 2023-07-21T22:37:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.485+0000 7fc7cac0b640 1 --2- 172.21.15.6:0/3975312552 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fc7a80663a0 0x7fc7a8068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.485+0000 7fc7cac0b640 1 --2- 172.21.15.6:0/3975312552 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc7c4158ce0 0x7fc7c4146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.485+0000 7fc7cac0b640 1 --2- 172.21.15.6:0/3975312552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7c40c9730 0x7fc7c4151500 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.485+0000 7fc7cac0b640 1 --2- 172.21.15.6:0/3975312552 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c40c8ad0 0x7fc7c414f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.485+0000 7fc7cac0b640 1 -- 172.21.15.6:0/3975312552 >> 172.21.15.6:0/3975312552 conn(0x7fc7c40afcf0 msgr2=0x7fc7c40c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:25.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.485+0000 7fc7cac0b640 1 -- 172.21.15.6:0/3975312552 shutdown_connections 2023-07-21T22:37:25.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.485+0000 7fc7cac0b640 1 -- 172.21.15.6:0/3975312552 wait complete. 2023-07-21T22:37:25.552 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:37:25.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.649+0000 7f4064d11640 1 Processor -- start 2023-07-21T22:37:25.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.649+0000 7f4064d11640 1 -- start start 2023-07-21T22:37:25.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.653+0000 7f4064d11640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f40600b7c70 0x7f40600d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:25.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.653+0000 7f4064d11640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40600d1850 0x7f406015f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:25.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.653+0000 7f4064d11640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40600d1300 0x7f406015fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:25.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.653+0000 7f4064d11640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40600d1190 con 0x7f40600d1850 2023-07-21T22:37:25.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.653+0000 7f4064d11640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4060160600 con 0x7f40600b7c70 2023-07-21T22:37:25.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.653+0000 7f4064d11640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40601600d0 con 0x7f40600d1300 2023-07-21T22:37:25.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.653+0000 7f4057fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40600d1850 0x7f406015f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:25.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.653+0000 7f4057fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40600d1850 0x7f406015f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46822/0 (socket says 172.21.15.6:46822) 2023-07-21T22:37:25.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.653+0000 7f4057fff640 1 -- 172.21.15.6:0/2953262564 learned_addr learned my addr 172.21.15.6:0/2953262564 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:25.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.653+0000 7f405ed9d640 1 --2- 172.21.15.6:0/2953262564 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40600d1300 0x7f406015fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:25.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.653+0000 7f405e59c640 1 --2- 172.21.15.6:0/2953262564 >> v2:172.21.15.161:3300/0 conn(0x7f40600b7c70 0x7f40600d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:25.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.653+0000 7f4057fff640 1 -- 172.21.15.6:0/2953262564 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40600d1300 msgr2=0x7f406015fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:25.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.653+0000 7f4057fff640 1 --2- 172.21.15.6:0/2953262564 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40600d1300 0x7f406015fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.653+0000 7f4057fff640 1 -- 172.21.15.6:0/2953262564 >> v2:172.21.15.161:3300/0 conn(0x7f40600b7c70 msgr2=0x7f40600d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:25.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.653+0000 7f4057fff640 1 --2- 172.21.15.6:0/2953262564 >> v2:172.21.15.161:3300/0 conn(0x7f40600b7c70 0x7f40600d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.653+0000 7f4057fff640 1 -- 172.21.15.6:0/2953262564 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40600ccaf0 con 0x7f40600d1850 2023-07-21T22:37:25.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.653+0000 7f405e59c640 1 --2- 172.21.15.6:0/2953262564 >> v2:172.21.15.161:3300/0 conn(0x7f40600b7c70 0x7f40600d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.657+0000 7f4057fff640 1 --2- 172.21.15.6:0/2953262564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40600d1850 0x7f406015f650 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f40600b40a0 tx=0x7f404801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e6ce87466a84f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.657+0000 7f405dd9b640 1 -- 172.21.15.6:0/2953262564 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40480ac600 con 0x7f40600d1850 2023-07-21T22:37:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.657+0000 7f405dd9b640 1 -- 172.21.15.6:0/2953262564 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40480a8050 con 0x7f40600d1850 2023-07-21T22:37:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.657+0000 7f405dd9b640 1 -- 172.21.15.6:0/2953262564 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40480ac980 con 0x7f40600d1850 2023-07-21T22:37:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.657+0000 7f4064d11640 1 -- 172.21.15.6:0/2953262564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40600d1850 msgr2=0x7f406015f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.657+0000 7f4064d11640 1 --2- 172.21.15.6:0/2953262564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40600d1850 0x7f406015f650 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f40600b40a0 tx=0x7f404801c4d0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.657+0000 7f4064d11640 1 -- 172.21.15.6:0/2953262564 shutdown_connections 2023-07-21T22:37:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.657+0000 7f4064d11640 1 --2- 172.21.15.6:0/2953262564 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40600d1300 0x7f406015fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.657+0000 7f4064d11640 1 --2- 172.21.15.6:0/2953262564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40600d1850 0x7f406015f650 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.657+0000 7f4064d11640 1 --2- 172.21.15.6:0/2953262564 >> v2:172.21.15.161:3300/0 conn(0x7f40600b7c70 0x7f40600d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.657+0000 7f4064d11640 1 -- 172.21.15.6:0/2953262564 >> 172.21.15.6:0/2953262564 conn(0x7f40600650b0 msgr2=0x7f40600654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.657+0000 7f4064d11640 1 -- 172.21.15.6:0/2953262564 shutdown_connections 2023-07-21T22:37:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.657+0000 7f4064d11640 1 -- 172.21.15.6:0/2953262564 wait complete. 2023-07-21T22:37:25.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.657+0000 7f4064d11640 1 Processor -- start 2023-07-21T22:37:25.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.657+0000 7f4064d11640 1 -- start start 2023-07-21T22:37:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f4064d11640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40600b7c70 0x7f406014c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f4064d11640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40600d1300 0x7f406015ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f4064d11640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40600d1850 0x7f40600cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f4064d11640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40600cc330 con 0x7f40600b7c70 2023-07-21T22:37:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f4064d11640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406015ba20 con 0x7f40600d1300 2023-07-21T22:37:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f4064d11640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406015e140 con 0x7f40600d1850 2023-07-21T22:37:25.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f405e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40600b7c70 0x7f406014c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:25.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f405e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40600b7c70 0x7f406014c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46828/0 (socket says 172.21.15.6:46828) 2023-07-21T22:37:25.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f405e59c640 1 -- 172.21.15.6:0/3573666206 learned_addr learned my addr 172.21.15.6:0/3573666206 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:25.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f4057fff640 1 --2- 172.21.15.6:0/3573666206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40600d1300 0x7f406015ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:25.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f405ed9d640 1 --2- 172.21.15.6:0/3573666206 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40600d1850 0x7f40600cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:25.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f405e59c640 1 -- 172.21.15.6:0/3573666206 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40600d1850 msgr2=0x7f40600cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:25.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f405e59c640 1 --2- 172.21.15.6:0/3573666206 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40600d1850 0x7f40600cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f405e59c640 1 -- 172.21.15.6:0/3573666206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40600d1300 msgr2=0x7f406015ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:25.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f405e59c640 1 --2- 172.21.15.6:0/3573666206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40600d1300 0x7f406015ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f405e59c640 1 -- 172.21.15.6:0/3573666206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40480094d0 con 0x7f40600b7c70 2023-07-21T22:37:25.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f405e59c640 1 --2- 172.21.15.6:0/3573666206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40600b7c70 0x7f406014c460 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f405000e810 tx=0x7f405000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:25.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f4056ffd640 1 -- 172.21.15.6:0/3573666206 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405000c8d0 con 0x7f40600b7c70 2023-07-21T22:37:25.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f4056ffd640 1 -- 172.21.15.6:0/3573666206 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405000ca30 con 0x7f40600b7c70 2023-07-21T22:37:25.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f4056ffd640 1 -- 172.21.15.6:0/3573666206 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405000cde0 con 0x7f40600b7c70 2023-07-21T22:37:25.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f4064d11640 1 -- 172.21.15.6:0/3573666206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406015e420 con 0x7f40600b7c70 2023-07-21T22:37:25.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f4064d11640 1 -- 172.21.15.6:0/3573666206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406015bd00 con 0x7f40600b7c70 2023-07-21T22:37:25.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f4064d11640 1 -- 172.21.15.6:0/3573666206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40600678d0 con 0x7f40600b7c70 2023-07-21T22:37:25.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.661+0000 7f4056ffd640 1 -- 172.21.15.6:0/3573666206 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4050013410 con 0x7f40600b7c70 2023-07-21T22:37:25.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.665+0000 7f4056ffd640 1 --2- 172.21.15.6:0/3573666206 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f40400663d0 0x7f4040068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:25.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.665+0000 7f4056ffd640 1 -- 172.21.15.6:0/3573666206 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f4050083db0 con 0x7f40600b7c70 2023-07-21T22:37:25.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.665+0000 7f4057fff640 1 --2- 172.21.15.6:0/3573666206 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f40400663d0 0x7f4040068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:25.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.665+0000 7f4057fff640 1 --2- 172.21.15.6:0/3573666206 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f40400663d0 0x7f4040068880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f40480ae000 tx=0x7f40480a7000 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:25.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.665+0000 7f4056ffd640 1 -- 172.21.15.6:0/3573666206 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4050088070 con 0x7f40600b7c70 2023-07-21T22:37:25.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.821+0000 7f4064d11640 1 -- 172.21.15.6:0/3573666206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40600b36f0 con 0x7f40600b7c70 2023-07-21T22:37:25.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.825+0000 7f4056ffd640 1 -- 172.21.15.6:0/3573666206 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+18291 (secure 0 0 0) 0x7f4050050ff0 con 0x7f40600b7c70 2023-07-21T22:37:25.870 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:25.870 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":128,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:37:23.075131+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:37:19.569960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-21T22:37:20.452035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:37:25.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.825+0000 7f4064d11640 1 -- 172.21.15.6:0/3573666206 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f40400663d0 msgr2=0x7f4040068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:25.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.825+0000 7f4064d11640 1 --2- 172.21.15.6:0/3573666206 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f40400663d0 0x7f4040068880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f40480ae000 tx=0x7f40480a7000 comp rx=0 tx=0).stop 2023-07-21T22:37:25.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.825+0000 7f4064d11640 1 -- 172.21.15.6:0/3573666206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40600b7c70 msgr2=0x7f406014c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:25.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.825+0000 7f4064d11640 1 --2- 172.21.15.6:0/3573666206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40600b7c70 0x7f406014c460 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f405000e810 tx=0x7f405000ecd0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.825+0000 7f4064d11640 1 -- 172.21.15.6:0/3573666206 shutdown_connections 2023-07-21T22:37:25.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.825+0000 7f4064d11640 1 --2- 172.21.15.6:0/3573666206 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f40400663d0 0x7f4040068880 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.825+0000 7f4064d11640 1 --2- 172.21.15.6:0/3573666206 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f40600d1850 0x7f40600cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.825+0000 7f4064d11640 1 --2- 172.21.15.6:0/3573666206 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f40600d1300 0x7f406015ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.825+0000 7f4064d11640 1 --2- 172.21.15.6:0/3573666206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40600b7c70 0x7f406014c460 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:25.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.825+0000 7f4064d11640 1 -- 172.21.15.6:0/3573666206 >> 172.21.15.6:0/3573666206 conn(0x7f40600650b0 msgr2=0x7f40600b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:25.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.825+0000 7f4064d11640 1 -- 172.21.15.6:0/3573666206 shutdown_connections 2023-07-21T22:37:25.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.825+0000 7f4064d11640 1 -- 172.21.15.6:0/3573666206 wait complete. 2023-07-21T22:37:25.891 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T22:37:25.892 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:37:26.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.989+0000 7fe877a26640 1 Processor -- start 2023-07-21T22:37:26.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.993+0000 7fe877a26640 1 -- start start 2023-07-21T22:37:26.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.993+0000 7fe877a26640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe870158ce0 0x7fe870070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:26.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.993+0000 7fe877a26640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe8700c9730 0x7fe8700ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:26.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.993+0000 7fe877a26640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8700cc700 con 0x7fe8700c8ad0 2023-07-21T22:37:26.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.993+0000 7fe877a26640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8700b0ff0 con 0x7fe8700c9730 2023-07-21T22:37:26.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.993+0000 7fe877a26640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe870070c80 con 0x7fe870158ce0 2023-07-21T22:37:26.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.993+0000 7fe874fc1640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe8700c8ad0 0x7fe8700c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53136/0 (socket says 172.21.15.6:53136) 2023-07-21T22:37:26.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.993+0000 7fe874fc1640 1 -- 172.21.15.6:0/4258152952 learned_addr learned my addr 172.21.15.6:0/4258152952 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:26.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.993+0000 7fe875fc3640 1 --2- 172.21.15.6:0/4258152952 >> v2:172.21.15.6:3300/0 conn(0x7fe8700c9730 0x7fe8700ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.993+0000 7fe8757c2640 1 --2- 172.21.15.6:0/4258152952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe870158ce0 0x7fe870070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.993+0000 7fe875fc3640 1 -- 172.21.15.6:0/4258152952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe870158ce0 msgr2=0x7fe870070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.993+0000 7fe875fc3640 1 --2- 172.21.15.6:0/4258152952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe870158ce0 0x7fe870070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.993+0000 7fe875fc3640 1 -- 172.21.15.6:0/4258152952 >> v1:172.21.15.6:6789/0 conn(0x7fe8700c8ad0 legacy=0x7fe8700c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.993+0000 7fe867fff640 1 -- 172.21.15.6:0/4258152952 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517828054 0 0) 0x7fe8700cc700 con 0x7fe8700c8ad0 2023-07-21T22:37:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.993+0000 7fe875fc3640 1 -- 172.21.15.6:0/4258152952 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8700cbdd0 con 0x7fe8700c9730 2023-07-21T22:37:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.993+0000 7fe8757c2640 1 --2- 172.21.15.6:0/4258152952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe870158ce0 0x7fe870070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:37:26.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.997+0000 7fe875fc3640 1 --2- 172.21.15.6:0/4258152952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8700c9730 0x7fe8700ccb90 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fe868009d90 tx=0x7fe86801c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a39e6bc35f88c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:26.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.997+0000 7fe867fff640 1 -- 172.21.15.6:0/4258152952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8680a58e0 con 0x7fe8700c9730 2023-07-21T22:37:26.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.997+0000 7fe867fff640 1 -- 172.21.15.6:0/4258152952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8680a5a40 con 0x7fe8700c9730 2023-07-21T22:37:26.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.997+0000 7fe867fff640 1 -- 172.21.15.6:0/4258152952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8680a5dd0 con 0x7fe8700c9730 2023-07-21T22:37:26.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.997+0000 7fe877a26640 1 -- 172.21.15.6:0/4258152952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8700c9730 msgr2=0x7fe8700ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:26.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.997+0000 7fe877a26640 1 --2- 172.21.15.6:0/4258152952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8700c9730 0x7fe8700ccb90 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fe868009d90 tx=0x7fe86801c800 comp rx=0 tx=0).stop 2023-07-21T22:37:26.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.997+0000 7fe877a26640 1 -- 172.21.15.6:0/4258152952 shutdown_connections 2023-07-21T22:37:26.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.997+0000 7fe877a26640 1 --2- 172.21.15.6:0/4258152952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8700c9730 0x7fe8700ccb90 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.997+0000 7fe877a26640 1 --2- 172.21.15.6:0/4258152952 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe870158ce0 0x7fe870070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.997+0000 7fe877a26640 1 -- 172.21.15.6:0/4258152952 >> 172.21.15.6:0/4258152952 conn(0x7fe8700afcf0 msgr2=0x7fe8700b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:26.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.997+0000 7fe877a26640 1 -- 172.21.15.6:0/4258152952 shutdown_connections 2023-07-21T22:37:26.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.997+0000 7fe877a26640 1 -- 172.21.15.6:0/4258152952 wait complete. 2023-07-21T22:37:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.997+0000 7fe877a26640 1 Processor -- start 2023-07-21T22:37:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:25.997+0000 7fe877a26640 1 -- start start 2023-07-21T22:37:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe877a26640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8700c8ad0 0x7fe870142280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe877a26640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8700c9730 0x7fe8700b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe877a26640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe870158ce0 0x7fe8700c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe877a26640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8700b3660 con 0x7fe870158ce0 2023-07-21T22:37:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe877a26640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8700b3940 con 0x7fe8700c8ad0 2023-07-21T22:37:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe877a26640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8700b3c20 con 0x7fe8700c9730 2023-07-21T22:37:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe875fc3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe870158ce0 0x7fe8700c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe875fc3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe870158ce0 0x7fe8700c7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46848/0 (socket says 172.21.15.6:46848) 2023-07-21T22:37:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe875fc3640 1 -- 172.21.15.6:0/1970556816 learned_addr learned my addr 172.21.15.6:0/1970556816 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe8757c2640 1 --2- 172.21.15.6:0/1970556816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8700c8ad0 0x7fe870142280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe874fc1640 1 --2- 172.21.15.6:0/1970556816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8700c9730 0x7fe8700b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe875fc3640 1 -- 172.21.15.6:0/1970556816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8700c9730 msgr2=0x7fe8700b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe875fc3640 1 --2- 172.21.15.6:0/1970556816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8700c9730 0x7fe8700b2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe875fc3640 1 -- 172.21.15.6:0/1970556816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8700c8ad0 msgr2=0x7fe870142280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe875fc3640 1 --2- 172.21.15.6:0/1970556816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8700c8ad0 0x7fe870142280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe875fc3640 1 -- 172.21.15.6:0/1970556816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe868009a70 con 0x7fe870158ce0 2023-07-21T22:37:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe8757c2640 1 --2- 172.21.15.6:0/1970556816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8700c8ad0 0x7fe870142280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe875fc3640 1 --2- 172.21.15.6:0/1970556816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe870158ce0 0x7fe8700c7ad0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fe8680b0040 tx=0x7fe8680195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:26.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe865ffb640 1 -- 172.21.15.6:0/1970556816 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8680ad950 con 0x7fe870158ce0 2023-07-21T22:37:26.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe865ffb640 1 -- 172.21.15.6:0/1970556816 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8680adab0 con 0x7fe870158ce0 2023-07-21T22:37:26.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe865ffb640 1 -- 172.21.15.6:0/1970556816 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8680ade60 con 0x7fe870158ce0 2023-07-21T22:37:26.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe877a26640 1 -- 172.21.15.6:0/1970556816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8700b3f00 con 0x7fe870158ce0 2023-07-21T22:37:26.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe877a26640 1 -- 172.21.15.6:0/1970556816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8700c8010 con 0x7fe870158ce0 2023-07-21T22:37:26.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.001+0000 7fe877a26640 1 -- 172.21.15.6:0/1970556816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8700ca1a0 con 0x7fe870158ce0 2023-07-21T22:37:26.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.005+0000 7fe865ffb640 1 -- 172.21.15.6:0/1970556816 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe8680b9450 con 0x7fe870158ce0 2023-07-21T22:37:26.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.005+0000 7fe865ffb640 1 --2- 172.21.15.6:0/1970556816 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe8540663a0 0x7fe854068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:26.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.005+0000 7fe865ffb640 1 -- 172.21.15.6:0/1970556816 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fe86811f460 con 0x7fe870158ce0 2023-07-21T22:37:26.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.005+0000 7fe8757c2640 1 --2- 172.21.15.6:0/1970556816 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe8540663a0 0x7fe854068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:26.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.005+0000 7fe8757c2640 1 --2- 172.21.15.6:0/1970556816 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe8540663a0 0x7fe854068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00a9b0 tx=0x7fe86c008040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.009+0000 7fe865ffb640 1 -- 172.21.15.6:0/1970556816 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe8680ec700 con 0x7fe870158ce0 2023-07-21T22:37:26.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.161+0000 7fe877a26640 1 -- 172.21.15.6:0/1970556816 --> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8701590b0 con 0x7fe8540663a0 2023-07-21T22:37:26.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.173+0000 7fe865ffb640 1 -- 172.21.15.6:0/1970556816 <== mgr.6905 v2:172.21.15.161:6832/1868466946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306310 (secure 0 0 0) 0x7fe86c00a1d0 con 0x7fe8540663a0 2023-07-21T22:37:26.222 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:26.223 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:37:26.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.177+0000 7fe877a26640 1 -- 172.21.15.6:0/1970556816 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe8540663a0 msgr2=0x7fe854068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.177+0000 7fe877a26640 1 --2- 172.21.15.6:0/1970556816 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe8540663a0 0x7fe854068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00a9b0 tx=0x7fe86c008040 comp rx=0 tx=0).stop 2023-07-21T22:37:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.177+0000 7fe877a26640 1 -- 172.21.15.6:0/1970556816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe870158ce0 msgr2=0x7fe8700c7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.177+0000 7fe877a26640 1 --2- 172.21.15.6:0/1970556816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe870158ce0 0x7fe8700c7ad0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fe8680b0040 tx=0x7fe8680195a0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.177+0000 7fe877a26640 1 -- 172.21.15.6:0/1970556816 shutdown_connections 2023-07-21T22:37:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.177+0000 7fe877a26640 1 --2- 172.21.15.6:0/1970556816 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe8540663a0 0x7fe854068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.177+0000 7fe877a26640 1 --2- 172.21.15.6:0/1970556816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe870158ce0 0x7fe8700c7ad0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.177+0000 7fe877a26640 1 --2- 172.21.15.6:0/1970556816 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe8700c9730 0x7fe8700b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.177+0000 7fe877a26640 1 --2- 172.21.15.6:0/1970556816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe8700c8ad0 0x7fe870142280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.177+0000 7fe877a26640 1 -- 172.21.15.6:0/1970556816 >> 172.21.15.6:0/1970556816 conn(0x7fe8700afcf0 msgr2=0x7fe8700adbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:26.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.177+0000 7fe877a26640 1 -- 172.21.15.6:0/1970556816 shutdown_connections 2023-07-21T22:37:26.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.177+0000 7fe877a26640 1 -- 172.21.15.6:0/1970556816 wait complete. 2023-07-21T22:37:26.242 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-21T22:37:25.726881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332108,"kb_used_data":13196,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754642612,"statfs":{"total":773094113280,"available":772754034688,"internally_reserved":0,"allocated":13512704,"data_stored":7378960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.674866"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058267+0000","last_change":"2023-07-21T22:37:21.058267+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058267+0000","last_undegraded":"2023-07-21T22:37:21.058267+0000","last_fullsized":"2023-07-21T22:37:21.058267+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.067653+0000","last_change":"2023-07-21T22:37:21.067653+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.067653+0000","last_undegraded":"2023-07-21T22:37:21.067653+0000","last_fullsized":"2023-07-21T22:37:21.067653+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.059237+0000","last_change":"2023-07-21T22:37:21.059237+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.059237+0000","last_undegraded":"2023-07-21T22:37:21.059237+0000","last_fullsized":"2023-07-21T22:37:21.059237+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.063706+0000","last_change":"2023-07-21T22:37:21.063706+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.063706+0000","last_undegraded":"2023-07-21T22:37:21.063706+0000","last_fullsized":"2023-07-21T22:37:21.063706+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.060500+0000","last_change":"2023-07-21T22:37:21.060500+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.060500+0000","last_undegraded":"2023-07-21T22:37:21.060500+0000","last_fullsized":"2023-07-21T22:37:21.060500+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.066890+0000","last_change":"2023-07-21T22:37:21.066890+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.066890+0000","last_undegraded":"2023-07-21T22:37:21.066890+0000","last_fullsized":"2023-07-21T22:37:21.066890+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.068882+0000","last_change":"2023-07-21T22:37:21.068882+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.068882+0000","last_undegraded":"2023-07-21T22:37:21.068882+0000","last_fullsized":"2023-07-21T22:37:21.068882+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.070714+0000","last_change":"2023-07-21T22:37:21.070714+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.070714+0000","last_undegraded":"2023-07-21T22:37:21.070714+0000","last_fullsized":"2023-07-21T22:37:21.070714+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.065404+0000","last_change":"2023-07-21T22:37:21.065404+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.065404+0000","last_undegraded":"2023-07-21T22:37:21.065404+0000","last_fullsized":"2023-07-21T22:37:21.065404+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058481+0000","last_change":"2023-07-21T22:37:21.058481+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058481+0000","last_undegraded":"2023-07-21T22:37:21.058481+0000","last_fullsized":"2023-07-21T22:37:21.058481+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.059138+0000","last_change":"2023-07-21T22:37:21.059138+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.059138+0000","last_undegraded":"2023-07-21T22:37:21.059138+0000","last_fullsized":"2023-07-21T22:37:21.059138+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.064623+0000","last_change":"2023-07-21T22:37:21.064623+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.064623+0000","last_undegraded":"2023-07-21T22:37:21.064623+0000","last_fullsized":"2023-07-21T22:37:21.064623+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.061613+0000","last_change":"2023-07-21T22:37:21.061613+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.061613+0000","last_undegraded":"2023-07-21T22:37:21.061613+0000","last_fullsized":"2023-07-21T22:37:21.061613+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.062767+0000","last_change":"2023-07-21T22:37:21.062767+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.062767+0000","last_undegraded":"2023-07-21T22:37:21.062767+0000","last_fullsized":"2023-07-21T22:37:21.062767+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.063983+0000","last_change":"2023-07-21T22:37:21.063983+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.063983+0000","last_undegraded":"2023-07-21T22:37:21.063983+0000","last_fullsized":"2023-07-21T22:37:21.063983+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.065141+0000","last_change":"2023-07-21T22:37:21.065141+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.065141+0000","last_undegraded":"2023-07-21T22:37:21.065141+0000","last_fullsized":"2023-07-21T22:37:21.065141+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057800+0000","last_change":"2023-07-21T22:37:21.057800+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057800+0000","last_undegraded":"2023-07-21T22:37:21.057800+0000","last_fullsized":"2023-07-21T22:37:21.057800+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.067143+0000","last_change":"2023-07-21T22:37:21.067143+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.067143+0000","last_undegraded":"2023-07-21T22:37:21.067143+0000","last_fullsized":"2023-07-21T22:37:21.067143+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058804+0000","last_change":"2023-07-21T22:37:21.058804+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058804+0000","last_undegraded":"2023-07-21T22:37:21.058804+0000","last_fullsized":"2023-07-21T22:37:21.058804+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.061352+0000","last_change":"2023-07-21T22:37:21.061352+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.061352+0000","last_undegraded":"2023-07-21T22:37:21.061352+0000","last_fullsized":"2023-07-21T22:37:21.061352+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.070641+0000","last_change":"2023-07-21T22:37:21.070641+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.070641+0000","last_undegraded":"2023-07-21T22:37:21.070641+0000","last_fullsized":"2023-07-21T22:37:21.070641+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.059082+0000","last_change":"2023-07-21T22:37:21.059082+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.059082+0000","last_undegraded":"2023-07-21T22:37:21.059082+0000","last_fullsized":"2023-07-21T22:37:21.059082+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057387+0000","last_change":"2023-07-21T22:37:21.057387+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057387+0000","last_undegraded":"2023-07-21T22:37:21.057387+0000","last_fullsized":"2023-07-21T22:37:21.057387+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058500+0000","last_change":"2023-07-21T22:37:21.058500+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058500+0000","last_undegraded":"2023-07-21T22:37:21.058500+0000","last_fullsized":"2023-07-21T22:37:21.058500+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.062184+0000","last_change":"2023-07-21T22:37:21.062184+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.062184+0000","last_undegraded":"2023-07-21T22:37:21.062184+0000","last_fullsized":"2023-07-21T22:37:21.062184+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.060749+0000","last_change":"2023-07-21T22:37:21.060749+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.060749+0000","last_undegraded":"2023-07-21T22:37:21.060749+0000","last_fullsized":"2023-07-21T22:37:21.060749+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057996+0000","last_change":"2023-07-21T22:37:21.057996+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057996+0000","last_undegraded":"2023-07-21T22:37:21.057996+0000","last_fullsized":"2023-07-21T22:37:21.057996+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.071838+0000","last_change":"2023-07-21T22:37:21.071838+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.071838+0000","last_undegraded":"2023-07-21T22:37:21.071838+0000","last_fullsized":"2023-07-21T22:37:21.071838+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.070119+0000","last_change":"2023-07-21T22:37:21.070119+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.070119+0000","last_undegraded":"2023-07-21T22:37:21.070119+0000","last_fullsized":"2023-07-21T22:37:21.070119+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.062274+0000","last_change":"2023-07-21T22:37:21.062274+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.062274+0000","last_undegraded":"2023-07-21T22:37:21.062274+0000","last_fullsized":"2023-07-21T22:37:21.062274+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.068434+0000","last_change":"2023-07-21T22:37:21.068434+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.068434+0000","last_undegraded":"2023-07-21T22:37:21.068434+0000","last_fullsized":"2023-07-21T22:37:21.068434+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.070220+0000","last_change":"2023-07-21T22:37:21.070220+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.070220+0000","last_undegraded":"2023-07-21T22:37:21.070220+0000","last_fullsized":"2023-07-21T22:37:21.070220+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057977+0000","last_change":"2023-07-21T22:37:21.057977+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057977+0000","last_undegraded":"2023-07-21T22:37:21.057977+0000","last_fullsized":"2023-07-21T22:37:21.057977+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.081540+0000","last_change":"2023-07-21T22:37:21.077330+0000","last_active":"2023-07-21T22:37:21.081540+0000","last_peered":"2023-07-21T22:37:21.081540+0000","last_clean":"2023-07-21T22:37:21.081540+0000","last_became_active":"2023-07-21T22:37:21.077027+0000","last_became_peered":"2023-07-21T22:37:21.077027+0000","last_unstale":"2023-07-21T22:37:21.081540+0000","last_undegraded":"2023-07-21T22:37:21.081540+0000","last_fullsized":"2023-07-21T22:37:21.081540+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:09:20.713834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.071547+0000","last_change":"2023-07-21T22:37:21.071547+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.071547+0000","last_undegraded":"2023-07-21T22:37:21.071547+0000","last_fullsized":"2023-07-21T22:37:21.071547+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082163+0000","last_change":"2023-07-21T22:37:21.078917+0000","last_active":"2023-07-21T22:37:21.082163+0000","last_peered":"2023-07-21T22:37:21.082163+0000","last_clean":"2023-07-21T22:37:21.082163+0000","last_became_active":"2023-07-21T22:37:21.078582+0000","last_became_peered":"2023-07-21T22:37:21.078582+0000","last_unstale":"2023-07-21T22:37:21.082163+0000","last_undegraded":"2023-07-21T22:37:21.082163+0000","last_fullsized":"2023-07-21T22:37:21.082163+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:44:59.850746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.061787+0000","last_change":"2023-07-21T22:37:21.061787+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.061787+0000","last_undegraded":"2023-07-21T22:37:21.061787+0000","last_fullsized":"2023-07-21T22:37:21.061787+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.077531+0000","last_change":"2023-07-21T22:37:21.071615+0000","last_active":"2023-07-21T22:37:21.077531+0000","last_peered":"2023-07-21T22:37:21.077531+0000","last_clean":"2023-07-21T22:37:21.077531+0000","last_became_active":"2023-07-21T22:37:21.071287+0000","last_became_peered":"2023-07-21T22:37:21.071287+0000","last_unstale":"2023-07-21T22:37:21.077531+0000","last_undegraded":"2023-07-21T22:37:21.077531+0000","last_fullsized":"2023-07-21T22:37:21.077531+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:16:18.946381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058462+0000","last_change":"2023-07-21T22:37:21.058462+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058462+0000","last_undegraded":"2023-07-21T22:37:21.058462+0000","last_fullsized":"2023-07-21T22:37:21.058462+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.067653+0000","last_change":"2023-07-21T22:37:21.063348+0000","last_active":"2023-07-21T22:37:21.067653+0000","last_peered":"2023-07-21T22:37:21.067653+0000","last_clean":"2023-07-21T22:37:21.067653+0000","last_became_active":"2023-07-21T22:37:21.062717+0000","last_became_peered":"2023-07-21T22:37:21.062717+0000","last_unstale":"2023-07-21T22:37:21.067653+0000","last_undegraded":"2023-07-21T22:37:21.067653+0000","last_fullsized":"2023-07-21T22:37:21.067653+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:52.156305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.060345+0000","last_change":"2023-07-21T22:37:21.060345+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.060345+0000","last_undegraded":"2023-07-21T22:37:21.060345+0000","last_fullsized":"2023-07-21T22:37:21.060345+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.080074+0000","last_change":"2023-07-21T22:37:21.078218+0000","last_active":"2023-07-21T22:37:21.080074+0000","last_peered":"2023-07-21T22:37:21.080074+0000","last_clean":"2023-07-21T22:37:21.080074+0000","last_became_active":"2023-07-21T22:37:21.077942+0000","last_became_peered":"2023-07-21T22:37:21.077942+0000","last_unstale":"2023-07-21T22:37:21.080074+0000","last_undegraded":"2023-07-21T22:37:21.080074+0000","last_fullsized":"2023-07-21T22:37:21.080074+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:44:27.641511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057756+0000","last_change":"2023-07-21T22:37:21.057756+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057756+0000","last_undegraded":"2023-07-21T22:37:21.057756+0000","last_fullsized":"2023-07-21T22:37:21.057756+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.074755+0000","last_change":"2023-07-21T22:37:21.072265+0000","last_active":"2023-07-21T22:37:21.074755+0000","last_peered":"2023-07-21T22:37:21.074755+0000","last_clean":"2023-07-21T22:37:21.074755+0000","last_became_active":"2023-07-21T22:37:21.071996+0000","last_became_peered":"2023-07-21T22:37:21.071996+0000","last_unstale":"2023-07-21T22:37:21.074755+0000","last_undegraded":"2023-07-21T22:37:21.074755+0000","last_fullsized":"2023-07-21T22:37:21.074755+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:12:15.936040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.065241+0000","last_change":"2023-07-21T22:37:21.065241+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.065241+0000","last_undegraded":"2023-07-21T22:37:21.065241+0000","last_fullsized":"2023-07-21T22:37:21.065241+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.078460+0000","last_change":"2023-07-21T22:37:21.070105+0000","last_active":"2023-07-21T22:37:21.078460+0000","last_peered":"2023-07-21T22:37:21.078460+0000","last_clean":"2023-07-21T22:37:21.078460+0000","last_became_active":"2023-07-21T22:37:21.069728+0000","last_became_peered":"2023-07-21T22:37:21.069728+0000","last_unstale":"2023-07-21T22:37:21.078460+0000","last_undegraded":"2023-07-21T22:37:21.078460+0000","last_fullsized":"2023-07-21T22:37:21.078460+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:05:08.970742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.060058+0000","last_change":"2023-07-21T22:37:21.060058+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.060058+0000","last_undegraded":"2023-07-21T22:37:21.060058+0000","last_fullsized":"2023-07-21T22:37:21.060058+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.072074+0000","last_change":"2023-07-21T22:37:21.068302+0000","last_active":"2023-07-21T22:37:21.072074+0000","last_peered":"2023-07-21T22:37:21.072074+0000","last_clean":"2023-07-21T22:37:21.072074+0000","last_became_active":"2023-07-21T22:37:21.068014+0000","last_became_peered":"2023-07-21T22:37:21.068014+0000","last_unstale":"2023-07-21T22:37:21.072074+0000","last_undegraded":"2023-07-21T22:37:21.072074+0000","last_fullsized":"2023-07-21T22:37:21.072074+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:49:08.508129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058492+0000","last_change":"2023-07-21T22:37:21.058492+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058492+0000","last_undegraded":"2023-07-21T22:37:21.058492+0000","last_fullsized":"2023-07-21T22:37:21.058492+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.078647+0000","last_change":"2023-07-21T22:37:21.072005+0000","last_active":"2023-07-21T22:37:21.078647+0000","last_peered":"2023-07-21T22:37:21.078647+0000","last_clean":"2023-07-21T22:37:21.078647+0000","last_became_active":"2023-07-21T22:37:21.071724+0000","last_became_peered":"2023-07-21T22:37:21.071724+0000","last_unstale":"2023-07-21T22:37:21.078647+0000","last_undegraded":"2023-07-21T22:37:21.078647+0000","last_fullsized":"2023-07-21T22:37:21.078647+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:26.355327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058561+0000","last_change":"2023-07-21T22:37:21.058561+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058561+0000","last_undegraded":"2023-07-21T22:37:21.058561+0000","last_fullsized":"2023-07-21T22:37:21.058561+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.074611+0000","last_change":"2023-07-21T22:37:21.071932+0000","last_active":"2023-07-21T22:37:21.074611+0000","last_peered":"2023-07-21T22:37:21.074611+0000","last_clean":"2023-07-21T22:37:21.074611+0000","last_became_active":"2023-07-21T22:37:21.071545+0000","last_became_peered":"2023-07-21T22:37:21.071545+0000","last_unstale":"2023-07-21T22:37:21.074611+0000","last_undegraded":"2023-07-21T22:37:21.074611+0000","last_fullsized":"2023-07-21T22:37:21.074611+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:57:21.999160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.071163+0000","last_change":"2023-07-21T22:37:21.071163+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.071163+0000","last_undegraded":"2023-07-21T22:37:21.071163+0000","last_fullsized":"2023-07-21T22:37:21.071163+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.076282+0000","last_change":"2023-07-21T22:37:21.074517+0000","last_active":"2023-07-21T22:37:21.076282+0000","last_peered":"2023-07-21T22:37:21.076282+0000","last_clean":"2023-07-21T22:37:21.076282+0000","last_became_active":"2023-07-21T22:37:21.074054+0000","last_became_peered":"2023-07-21T22:37:21.074054+0000","last_unstale":"2023-07-21T22:37:21.076282+0000","last_undegraded":"2023-07-21T22:37:21.076282+0000","last_fullsized":"2023-07-21T22:37:21.076282+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:34:22.370850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.059591+0000","last_change":"2023-07-21T22:37:21.059591+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.059591+0000","last_undegraded":"2023-07-21T22:37:21.059591+0000","last_fullsized":"2023-07-21T22:37:21.059591+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082570+0000","last_change":"2023-07-21T22:37:21.078493+0000","last_active":"2023-07-21T22:37:21.082570+0000","last_peered":"2023-07-21T22:37:21.082570+0000","last_clean":"2023-07-21T22:37:21.082570+0000","last_became_active":"2023-07-21T22:37:21.078199+0000","last_became_peered":"2023-07-21T22:37:21.078199+0000","last_unstale":"2023-07-21T22:37:21.082570+0000","last_undegraded":"2023-07-21T22:37:21.082570+0000","last_fullsized":"2023-07-21T22:37:21.082570+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:52:29.786420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058982+0000","last_change":"2023-07-21T22:37:21.058982+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058982+0000","last_undegraded":"2023-07-21T22:37:21.058982+0000","last_fullsized":"2023-07-21T22:37:21.058982+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.072498+0000","last_change":"2023-07-21T22:37:21.068918+0000","last_active":"2023-07-21T22:37:21.072498+0000","last_peered":"2023-07-21T22:37:21.072498+0000","last_clean":"2023-07-21T22:37:21.072498+0000","last_became_active":"2023-07-21T22:37:21.068632+0000","last_became_peered":"2023-07-21T22:37:21.068632+0000","last_unstale":"2023-07-21T22:37:21.072498+0000","last_undegraded":"2023-07-21T22:37:21.072498+0000","last_fullsized":"2023-07-21T22:37:21.072498+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:45:11.816606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.067540+0000","last_change":"2023-07-21T22:37:21.067540+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.067540+0000","last_undegraded":"2023-07-21T22:37:21.067540+0000","last_fullsized":"2023-07-21T22:37:21.067540+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.070286+0000","last_change":"2023-07-21T22:37:21.066648+0000","last_active":"2023-07-21T22:37:21.070286+0000","last_peered":"2023-07-21T22:37:21.070286+0000","last_clean":"2023-07-21T22:37:21.070286+0000","last_became_active":"2023-07-21T22:37:21.066313+0000","last_became_peered":"2023-07-21T22:37:21.066313+0000","last_unstale":"2023-07-21T22:37:21.070286+0000","last_undegraded":"2023-07-21T22:37:21.070286+0000","last_fullsized":"2023-07-21T22:37:21.070286+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:24:19.351613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.071271+0000","last_change":"2023-07-21T22:37:21.071271+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.071271+0000","last_undegraded":"2023-07-21T22:37:21.071271+0000","last_fullsized":"2023-07-21T22:37:21.071271+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.081885+0000","last_change":"2023-07-21T22:37:21.075668+0000","last_active":"2023-07-21T22:37:21.081885+0000","last_peered":"2023-07-21T22:37:21.081885+0000","last_clean":"2023-07-21T22:37:21.081885+0000","last_became_active":"2023-07-21T22:37:21.075393+0000","last_became_peered":"2023-07-21T22:37:21.075393+0000","last_unstale":"2023-07-21T22:37:21.081885+0000","last_undegraded":"2023-07-21T22:37:21.081885+0000","last_fullsized":"2023-07-21T22:37:21.081885+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:28:21.336083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057315+0000","last_change":"2023-07-21T22:37:21.057315+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057315+0000","last_undegraded":"2023-07-21T22:37:21.057315+0000","last_fullsized":"2023-07-21T22:37:21.057315+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.077525+0000","last_change":"2023-07-21T22:37:21.070598+0000","last_active":"2023-07-21T22:37:21.077525+0000","last_peered":"2023-07-21T22:37:21.077525+0000","last_clean":"2023-07-21T22:37:21.077525+0000","last_became_active":"2023-07-21T22:37:21.069746+0000","last_became_peered":"2023-07-21T22:37:21.069746+0000","last_unstale":"2023-07-21T22:37:21.077525+0000","last_undegraded":"2023-07-21T22:37:21.077525+0000","last_fullsized":"2023-07-21T22:37:21.077525+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:47:57.653894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058924+0000","last_change":"2023-07-21T22:37:21.058924+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058924+0000","last_undegraded":"2023-07-21T22:37:21.058924+0000","last_fullsized":"2023-07-21T22:37:21.058924+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082365+0000","last_change":"2023-07-21T22:37:21.079461+0000","last_active":"2023-07-21T22:37:21.082365+0000","last_peered":"2023-07-21T22:37:21.082365+0000","last_clean":"2023-07-21T22:37:21.082365+0000","last_became_active":"2023-07-21T22:37:21.079152+0000","last_became_peered":"2023-07-21T22:37:21.079152+0000","last_unstale":"2023-07-21T22:37:21.082365+0000","last_undegraded":"2023-07-21T22:37:21.082365+0000","last_fullsized":"2023-07-21T22:37:21.082365+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:13:42.164239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.061261+0000","last_change":"2023-07-21T22:37:21.061261+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.061261+0000","last_undegraded":"2023-07-21T22:37:21.061261+0000","last_fullsized":"2023-07-21T22:37:21.061261+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.073577+0000","last_change":"2023-07-21T22:37:21.066856+0000","last_active":"2023-07-21T22:37:21.073577+0000","last_peered":"2023-07-21T22:37:21.073577+0000","last_clean":"2023-07-21T22:37:21.073577+0000","last_became_active":"2023-07-21T22:37:21.066089+0000","last_became_peered":"2023-07-21T22:37:21.066089+0000","last_unstale":"2023-07-21T22:37:21.073577+0000","last_undegraded":"2023-07-21T22:37:21.073577+0000","last_fullsized":"2023-07-21T22:37:21.073577+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:15.352350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.062480+0000","last_change":"2023-07-21T22:37:21.062480+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.062480+0000","last_undegraded":"2023-07-21T22:37:21.062480+0000","last_fullsized":"2023-07-21T22:37:21.062480+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082518+0000","last_change":"2023-07-21T22:37:21.078173+0000","last_active":"2023-07-21T22:37:21.082518+0000","last_peered":"2023-07-21T22:37:21.082518+0000","last_clean":"2023-07-21T22:37:21.082518+0000","last_became_active":"2023-07-21T22:37:21.077879+0000","last_became_peered":"2023-07-21T22:37:21.077879+0000","last_unstale":"2023-07-21T22:37:21.082518+0000","last_undegraded":"2023-07-21T22:37:21.082518+0000","last_fullsized":"2023-07-21T22:37:21.082518+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:57:03.563418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.059646+0000","last_change":"2023-07-21T22:37:21.059646+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.059646+0000","last_undegraded":"2023-07-21T22:37:21.059646+0000","last_fullsized":"2023-07-21T22:37:21.059646+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.078749+0000","last_change":"2023-07-21T22:37:21.077940+0000","last_active":"2023-07-21T22:37:21.078749+0000","last_peered":"2023-07-21T22:37:21.078749+0000","last_clean":"2023-07-21T22:37:21.078749+0000","last_became_active":"2023-07-21T22:37:21.077593+0000","last_became_peered":"2023-07-21T22:37:21.077593+0000","last_unstale":"2023-07-21T22:37:21.078749+0000","last_undegraded":"2023-07-21T22:37:21.078749+0000","last_fullsized":"2023-07-21T22:37:21.078749+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:21:42.376326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.069756+0000","last_change":"2023-07-21T22:37:21.069756+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.069756+0000","last_undegraded":"2023-07-21T22:37:21.069756+0000","last_fullsized":"2023-07-21T22:37:21.069756+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.079004+0000","last_change":"2023-07-21T22:37:21.075547+0000","last_active":"2023-07-21T22:37:21.079004+0000","last_peered":"2023-07-21T22:37:21.079004+0000","last_clean":"2023-07-21T22:37:21.079004+0000","last_became_active":"2023-07-21T22:37:21.075261+0000","last_became_peered":"2023-07-21T22:37:21.075261+0000","last_unstale":"2023-07-21T22:37:21.079004+0000","last_undegraded":"2023-07-21T22:37:21.079004+0000","last_fullsized":"2023-07-21T22:37:21.079004+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:33.794471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.069735+0000","last_change":"2023-07-21T22:37:21.069735+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.069735+0000","last_undegraded":"2023-07-21T22:37:21.069735+0000","last_fullsized":"2023-07-21T22:37:21.069735+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.081837+0000","last_change":"2023-07-21T22:37:21.076789+0000","last_active":"2023-07-21T22:37:21.081837+0000","last_peered":"2023-07-21T22:37:21.081837+0000","last_clean":"2023-07-21T22:37:21.081837+0000","last_became_active":"2023-07-21T22:37:21.076497+0000","last_became_peered":"2023-07-21T22:37:21.076497+0000","last_unstale":"2023-07-21T22:37:21.081837+0000","last_undegraded":"2023-07-21T22:37:21.081837+0000","last_fullsized":"2023-07-21T22:37:21.081837+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:23:52.304154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.062405+0000","last_change":"2023-07-21T22:37:21.062405+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.062405+0000","last_undegraded":"2023-07-21T22:37:21.062405+0000","last_fullsized":"2023-07-21T22:37:21.062405+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.083436+0000","last_change":"2023-07-21T22:37:21.079413+0000","last_active":"2023-07-21T22:37:21.083436+0000","last_peered":"2023-07-21T22:37:21.083436+0000","last_clean":"2023-07-21T22:37:21.083436+0000","last_became_active":"2023-07-21T22:37:21.079087+0000","last_became_peered":"2023-07-21T22:37:21.079087+0000","last_unstale":"2023-07-21T22:37:21.083436+0000","last_undegraded":"2023-07-21T22:37:21.083436+0000","last_fullsized":"2023-07-21T22:37:21.083436+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:59:42.462195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058560+0000","last_change":"2023-07-21T22:37:21.058560+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058560+0000","last_undegraded":"2023-07-21T22:37:21.058560+0000","last_fullsized":"2023-07-21T22:37:21.058560+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.081845+0000","last_change":"2023-07-21T22:37:21.075785+0000","last_active":"2023-07-21T22:37:21.081845+0000","last_peered":"2023-07-21T22:37:21.081845+0000","last_clean":"2023-07-21T22:37:21.081845+0000","last_became_active":"2023-07-21T22:37:21.075437+0000","last_became_peered":"2023-07-21T22:37:21.075437+0000","last_unstale":"2023-07-21T22:37:21.081845+0000","last_undegraded":"2023-07-21T22:37:21.081845+0000","last_fullsized":"2023-07-21T22:37:21.081845+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:06:15.022660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057994+0000","last_change":"2023-07-21T22:37:21.057994+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057994+0000","last_undegraded":"2023-07-21T22:37:21.057994+0000","last_fullsized":"2023-07-21T22:37:21.057994+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082187+0000","last_change":"2023-07-21T22:37:21.079237+0000","last_active":"2023-07-21T22:37:21.082187+0000","last_peered":"2023-07-21T22:37:21.082187+0000","last_clean":"2023-07-21T22:37:21.082187+0000","last_became_active":"2023-07-21T22:37:21.078935+0000","last_became_peered":"2023-07-21T22:37:21.078935+0000","last_unstale":"2023-07-21T22:37:21.082187+0000","last_undegraded":"2023-07-21T22:37:21.082187+0000","last_fullsized":"2023-07-21T22:37:21.082187+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:24.190628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"116'227","reported_seq":748,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.065586+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:37:21.065586+0000","last_peered":"2023-07-21T22:37:21.065586+0000","last_clean":"2023-07-21T22:37:21.065586+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:37:21.065586+0000","last_undegraded":"2023-07-21T22:37:21.065586+0000","last_fullsized":"2023-07-21T22:37:21.065586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:51:00.701474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":219,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.061363+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:37:21.061363+0000","last_peered":"2023-07-21T22:37:21.061363+0000","last_clean":"2023-07-21T22:37:21.061363+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:37:21.061363+0000","last_undegraded":"2023-07-21T22:37:21.061363+0000","last_fullsized":"2023-07-21T22:37:21.061363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:35:00.619996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.064431+0000","last_change":"2023-07-21T22:37:21.064431+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.064431+0000","last_undegraded":"2023-07-21T22:37:21.064431+0000","last_fullsized":"2023-07-21T22:37:21.064431+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.077071+0000","last_change":"2023-07-21T22:37:21.075739+0000","last_active":"2023-07-21T22:37:21.077071+0000","last_peered":"2023-07-21T22:37:21.077071+0000","last_clean":"2023-07-21T22:37:21.077071+0000","last_became_active":"2023-07-21T22:37:21.075418+0000","last_became_peered":"2023-07-21T22:37:21.075418+0000","last_unstale":"2023-07-21T22:37:21.077071+0000","last_undegraded":"2023-07-21T22:37:21.077071+0000","last_fullsized":"2023-07-21T22:37:21.077071+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:31:34.885110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":202,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.065449+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:37:21.065449+0000","last_peered":"2023-07-21T22:37:21.065449+0000","last_clean":"2023-07-21T22:37:21.065449+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:37:21.065449+0000","last_undegraded":"2023-07-21T22:37:21.065449+0000","last_fullsized":"2023-07-21T22:37:21.065449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:33:54.469018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.060048+0000","last_change":"2023-07-21T22:37:21.060048+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.060048+0000","last_undegraded":"2023-07-21T22:37:21.060048+0000","last_fullsized":"2023-07-21T22:37:21.060048+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.080805+0000","last_change":"2023-07-21T22:37:21.079660+0000","last_active":"2023-07-21T22:37:21.080805+0000","last_peered":"2023-07-21T22:37:21.080805+0000","last_clean":"2023-07-21T22:37:21.080805+0000","last_became_active":"2023-07-21T22:37:21.079340+0000","last_became_peered":"2023-07-21T22:37:21.079340+0000","last_unstale":"2023-07-21T22:37:21.080805+0000","last_undegraded":"2023-07-21T22:37:21.080805+0000","last_fullsized":"2023-07-21T22:37:21.080805+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:18:13.008438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":200,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.067659+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:37:21.067659+0000","last_peered":"2023-07-21T22:37:21.067659+0000","last_clean":"2023-07-21T22:37:21.067659+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:37:21.067659+0000","last_undegraded":"2023-07-21T22:37:21.067659+0000","last_fullsized":"2023-07-21T22:37:21.067659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:38:48.649472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.069672+0000","last_change":"2023-07-21T22:37:21.069672+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.069672+0000","last_undegraded":"2023-07-21T22:37:21.069672+0000","last_fullsized":"2023-07-21T22:37:21.069672+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082683+0000","last_change":"2023-07-21T22:37:21.078854+0000","last_active":"2023-07-21T22:37:21.082683+0000","last_peered":"2023-07-21T22:37:21.082683+0000","last_clean":"2023-07-21T22:37:21.082683+0000","last_became_active":"2023-07-21T22:37:21.078575+0000","last_became_peered":"2023-07-21T22:37:21.078575+0000","last_unstale":"2023-07-21T22:37:21.082683+0000","last_undegraded":"2023-07-21T22:37:21.082683+0000","last_fullsized":"2023-07-21T22:37:21.082683+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:48:15.816878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":219,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.060250+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:37:21.060250+0000","last_peered":"2023-07-21T22:37:21.060250+0000","last_clean":"2023-07-21T22:37:21.060250+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:37:21.060250+0000","last_undegraded":"2023-07-21T22:37:21.060250+0000","last_fullsized":"2023-07-21T22:37:21.060250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:40:37.271851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.060963+0000","last_change":"2023-07-21T22:37:21.060963+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.060963+0000","last_undegraded":"2023-07-21T22:37:21.060963+0000","last_fullsized":"2023-07-21T22:37:21.060963+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082654+0000","last_change":"2023-07-21T22:37:21.078876+0000","last_active":"2023-07-21T22:37:21.082654+0000","last_peered":"2023-07-21T22:37:21.082654+0000","last_clean":"2023-07-21T22:37:21.082654+0000","last_became_active":"2023-07-21T22:37:21.078596+0000","last_became_peered":"2023-07-21T22:37:21.078596+0000","last_unstale":"2023-07-21T22:37:21.082654+0000","last_undegraded":"2023-07-21T22:37:21.082654+0000","last_fullsized":"2023-07-21T22:37:21.082654+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:45:12.152065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":211,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.053262+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:37:21.053262+0000","last_peered":"2023-07-21T22:37:21.053262+0000","last_clean":"2023-07-21T22:37:21.053262+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:37:21.053262+0000","last_undegraded":"2023-07-21T22:37:21.053262+0000","last_fullsized":"2023-07-21T22:37:21.053262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:24:28.113597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.069611+0000","last_change":"2023-07-21T22:37:21.069611+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.069611+0000","last_undegraded":"2023-07-21T22:37:21.069611+0000","last_fullsized":"2023-07-21T22:37:21.069611+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.081821+0000","last_change":"2023-07-21T22:37:21.075411+0000","last_active":"2023-07-21T22:37:21.081821+0000","last_peered":"2023-07-21T22:37:21.081821+0000","last_clean":"2023-07-21T22:37:21.081821+0000","last_became_active":"2023-07-21T22:37:21.075095+0000","last_became_peered":"2023-07-21T22:37:21.075095+0000","last_unstale":"2023-07-21T22:37:21.081821+0000","last_undegraded":"2023-07-21T22:37:21.081821+0000","last_fullsized":"2023-07-21T22:37:21.081821+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:39:38.877282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":201,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.064309+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:37:21.064309+0000","last_peered":"2023-07-21T22:37:21.064309+0000","last_clean":"2023-07-21T22:37:21.064309+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:37:21.064309+0000","last_undegraded":"2023-07-21T22:37:21.064309+0000","last_fullsized":"2023-07-21T22:37:21.064309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:32:33.263928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.061200+0000","last_change":"2023-07-21T22:37:21.061200+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.061200+0000","last_undegraded":"2023-07-21T22:37:21.061200+0000","last_fullsized":"2023-07-21T22:37:21.061200+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.081775+0000","last_change":"2023-07-21T22:37:21.075461+0000","last_active":"2023-07-21T22:37:21.081775+0000","last_peered":"2023-07-21T22:37:21.081775+0000","last_clean":"2023-07-21T22:37:21.081775+0000","last_became_active":"2023-07-21T22:37:21.075125+0000","last_became_peered":"2023-07-21T22:37:21.075125+0000","last_unstale":"2023-07-21T22:37:21.081775+0000","last_undegraded":"2023-07-21T22:37:21.081775+0000","last_fullsized":"2023-07-21T22:37:21.081775+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:11:04.198665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":211,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.052916+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:37:21.052916+0000","last_peered":"2023-07-21T22:37:21.052916+0000","last_clean":"2023-07-21T22:37:21.052916+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:37:21.052916+0000","last_undegraded":"2023-07-21T22:37:21.052916+0000","last_fullsized":"2023-07-21T22:37:21.052916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:43:51.528257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058355+0000","last_change":"2023-07-21T22:37:21.058355+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058355+0000","last_undegraded":"2023-07-21T22:37:21.058355+0000","last_fullsized":"2023-07-21T22:37:21.058355+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.079054+0000","last_change":"2023-07-21T22:37:21.073046+0000","last_active":"2023-07-21T22:37:21.079054+0000","last_peered":"2023-07-21T22:37:21.079054+0000","last_clean":"2023-07-21T22:37:21.079054+0000","last_became_active":"2023-07-21T22:37:21.072789+0000","last_became_peered":"2023-07-21T22:37:21.072789+0000","last_unstale":"2023-07-21T22:37:21.079054+0000","last_undegraded":"2023-07-21T22:37:21.079054+0000","last_fullsized":"2023-07-21T22:37:21.079054+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:38:11.812192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":197,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.072728+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:37:21.072728+0000","last_peered":"2023-07-21T22:37:21.072728+0000","last_clean":"2023-07-21T22:37:21.072728+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:37:21.072728+0000","last_undegraded":"2023-07-21T22:37:21.072728+0000","last_fullsized":"2023-07-21T22:37:21.072728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:23:55.856237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509664,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59368,"kb_used_data":2080,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312472,"statfs":{"total":96636764160,"available":96575971328,"internally_reserved":0,"allocated":2129920,"data_stored":1362644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.63,"5min":0.42599999999999999,"15min":0.35299999999999998},"max":{"1min":0.95199999999999996,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.625},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69599999999999995,"15min":0.69699999999999995},"min":{"1min":0.54500000000000004,"5min":0.40899999999999997,"15min":0.39500000000000002},"max":{"1min":0.82599999999999996,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.52600000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70899999999999996,"15min":0.72999999999999998},"min":{"1min":0.52700000000000002,"5min":0.44900000000000001,"15min":0.432},"max":{"1min":0.92400000000000004,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.69599999999999995,"15min":0.71499999999999997},"min":{"1min":0.497,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.873,"5min":1.093,"15min":1.093},"last":0.64500000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.501,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.877,"5min":1.1399999999999999,"15min":1.405},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.57399999999999995,"5min":0.47999999999999998,"15min":0.45800000000000002},"max":{"1min":0.88800000000000001,"5min":1.409,"15min":1.409},"last":0.68999999999999995}]},{"osd":3,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.75900000000000001,"15min":0.76500000000000001},"min":{"1min":0.55400000000000005,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95399999999999996,"5min":1.46,"15min":1.46},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.56599999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92900000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.70899999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.42699999999999999,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.66900000000000004,"5min":0.90000000000000002,"15min":0.94999999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.63,"15min":0.61699999999999999},"min":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82699999999999996,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64800000000000002,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.85199999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70099999999999996,"15min":0.68000000000000005},"min":{"1min":0.51100000000000001,"5min":0.42499999999999999,"15min":0.38300000000000001},"max":{"1min":0.90900000000000003,"5min":1.506,"15min":1.506},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.53600000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89000000000000001,"5min":1.0329999999999999,"15min":1.048},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.47399999999999998,"5min":0.442,"15min":0.42699999999999999},"max":{"1min":0.83599999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.56999999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542370,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1536000,"data_stored":772276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72999999999999998,"15min":0.76000000000000001},"min":{"1min":0.54200000000000004,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.95599999999999996,"5min":1.016,"15min":1.016},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77400000000000002,"15min":0.79100000000000004},"min":{"1min":0.58499999999999996,"5min":0.53200000000000003,"15min":0.437},"max":{"1min":0.93700000000000006,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.628}]},{"osd":1,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.57599999999999996,"5min":0.49099999999999999,"15min":0.45300000000000001},"max":{"1min":0.86399999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71399999999999997,"15min":0.73199999999999998},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.82799999999999996,"5min":0.99199999999999999,"15min":1.117},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72099999999999997,"15min":0.747},"min":{"1min":0.53000000000000003,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.91400000000000003,"5min":0.98099999999999998,"15min":0.997},"last":0.442},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.59299999999999997,"5min":0.53500000000000003,"15min":0.45500000000000002},"max":{"1min":0.99099999999999999,"5min":1.097,"15min":1.097},"last":0.69799999999999995}]},{"osd":3,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72999999999999998,"15min":0.754},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.45000000000000001},"max":{"1min":0.89400000000000002,"5min":1.048,"15min":1.048},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":0.73199999999999998},"min":{"1min":0.56399999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85799999999999998,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.59299999999999997},"min":{"1min":0.47199999999999998,"5min":0.374,"15min":0.36599999999999999},"max":{"1min":0.83699999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.623},"min":{"1min":0.42299999999999999,"5min":0.40500000000000003,"15min":0.39700000000000002},"max":{"1min":0.92800000000000005,"5min":0.98299999999999998,"15min":1.0209999999999999},"last":0.47399999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.61499999999999999},"min":{"1min":0.45900000000000002,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.89300000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.497,"5min":0.46000000000000002,"15min":0.435},"max":{"1min":0.95299999999999996,"5min":0.98299999999999998,"15min":1.054},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69999999999999996,"15min":0.67900000000000005},"min":{"1min":0.48199999999999998,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":0.996,"5min":1.079,"15min":1.079},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70299999999999996,"15min":0.69099999999999995},"min":{"1min":0.51900000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97199999999999998,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.61599999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509663,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50596,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321244,"statfs":{"total":96636764160,"available":96584953856,"internally_reserved":0,"allocated":1536000,"data_stored":772276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67800000000000005,"15min":0.71199999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35699999999999998},"max":{"1min":0.98799999999999999,"5min":1,"15min":1.8779999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70599999999999996,"15min":0.71799999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.95799999999999996,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.57499999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67300000000000004,"15min":0.70299999999999996},"min":{"1min":0.49199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90700000000000003,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.621},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68799999999999994,"15min":0.72499999999999998},"min":{"1min":0.441,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92500000000000004,"5min":0.94399999999999995,"15min":1.617},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.52600000000000002,"5min":0.45100000000000001,"15min":0.33600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71099999999999997,"15min":0.74199999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.377},"max":{"1min":0.94499999999999995,"5min":1.073,"15min":1.512},"last":0.71599999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.44800000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.472},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.754,"15min":0.78800000000000003},"min":{"1min":0.628,"5min":0.496,"15min":0.496},"max":{"1min":0.92200000000000004,"5min":1.022,"15min":1.556},"last":0.78500000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57299999999999995,"15min":0.56499999999999995},"min":{"1min":0.37,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.88900000000000001,"15min":0.96999999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71599999999999997,"15min":0.69499999999999995},"min":{"1min":0.53400000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.92400000000000004,"5min":1.012,"15min":1.038},"last":0.90900000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.47999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.76000000000000001,"5min":0.95499999999999996,"15min":1.0049999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63700000000000001,"15min":0.61499999999999999},"min":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.40000000000000002},"max":{"1min":0.84899999999999998,"5min":0.93799999999999994,"15min":1.02},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.69199999999999995,"15min":0.65400000000000003},"min":{"1min":0.51900000000000002,"5min":0.40999999999999998,"15min":0.374},"max":{"1min":0.97599999999999998,"5min":1.042,"15min":1.042},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.755,"15min":0.73199999999999998},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.96899999999999997,"5min":0.999,"15min":1.7390000000000001},"last":0.88300000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509664,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1536000,"data_stored":772276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.71799999999999997,"15min":0.74399999999999999},"min":{"1min":0.56499999999999995,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":0.98299999999999998,"5min":0.99399999999999999,"15min":1.0429999999999999},"last":0.501},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.59899999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.59699999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.51300000000000001,"5min":0.442,"15min":0.39400000000000002},"max":{"1min":0.97799999999999998,"5min":1.002,"15min":1.002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68200000000000005,"15min":0.70199999999999996},"min":{"1min":0.57999999999999996,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.877,"5min":0.93000000000000005,"15min":1.016},"last":0.44400000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73099999999999998,"15min":0.76000000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.371},"max":{"1min":1.0169999999999999,"5min":1.048,"15min":1.048},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.751,"15min":0.76700000000000002},"min":{"1min":0.61099999999999999,"5min":0.47699999999999998,"15min":0.33000000000000002},"max":{"1min":0.99199999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.57499999999999996,"5min":0.47199999999999998,"15min":0.40100000000000002},"max":{"1min":0.94599999999999995,"5min":0.97999999999999998,"15min":1.026},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76900000000000002,"15min":0.78300000000000003},"min":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.47999999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60299999999999998,"15min":0.58199999999999996},"min":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.629},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.38800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83999999999999997,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.38500000000000001},"max":{"1min":0.92800000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.53000000000000003,"5min":0.438,"15min":0.41599999999999998},"max":{"1min":0.95799999999999996,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65800000000000003,"15min":0.65200000000000002},"min":{"1min":0.497,"5min":0.45500000000000002,"15min":0.39200000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.0429999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.52200000000000002,"5min":0.46400000000000002,"15min":0.45300000000000001},"max":{"1min":0.874,"5min":1.101,"15min":1.135},"last":0.71699999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509663,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1512,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1548288,"data_stored":778948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47699999999999998,"15min":0.47899999999999998},"min":{"1min":0.30199999999999999,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.379},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.755,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46700000000000003,"15min":0.47999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72199999999999998,"5min":0.754,"15min":0.83499999999999996},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.29999999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82199999999999995,"5min":0.82599999999999996,"15min":0.90100000000000002},"last":0.52000000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81000000000000005,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.503},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.59999999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.99199999999999999},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.55400000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.052,"5min":1.093,"15min":1.1279999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.622,"5min":0.442,"15min":0.442},"max":{"1min":1.0580000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.84599999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76300000000000001,"15min":0.77400000000000002},"min":{"1min":0.53300000000000003,"5min":0.501,"15min":0.48999999999999999},"max":{"1min":1.002,"5min":1.0669999999999999,"15min":1.137},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77100000000000002,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.51300000000000001,"15min":0.42899999999999999},"max":{"1min":1.079,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.78800000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.63,"5min":0.51700000000000002,"15min":0.47399999999999998},"max":{"1min":1.0649999999999999,"5min":1.0680000000000001,"15min":1.169},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76700000000000002,"15min":0.77400000000000002},"min":{"1min":0.48199999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.03,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.754}]},{"osd":7,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.63900000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.083,"5min":1.087,"15min":1.099},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.82699999999999996,"15min":0.83199999999999996},"min":{"1min":0.67200000000000004,"5min":0.55200000000000005,"15min":0.48599999999999999},"max":{"1min":1.0980000000000001,"5min":1.623,"15min":1.623},"last":0.77400000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509665,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54704,"kb_used_data":1512,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317136,"statfs":{"total":96636764160,"available":96580747264,"internally_reserved":0,"allocated":1548288,"data_stored":778948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.438,"15min":0.46400000000000002},"min":{"1min":0.28999999999999998,"5min":0.27200000000000002,"15min":0.23899999999999999},"max":{"1min":0.68200000000000005,"5min":0.75,"15min":0.94199999999999995},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.54300000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.308},"max":{"1min":0.77400000000000002,"5min":0.88300000000000001,"15min":1.0409999999999999},"last":0.36899999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.748,"5min":0.86699999999999999,"15min":0.93999999999999995},"last":0.438},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.41999999999999998,"5min":0.38900000000000001,"15min":0.36099999999999999},"max":{"1min":0.85299999999999998,"5min":1.012,"15min":1.085},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72299999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.56499999999999995},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.81299999999999994,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.74399999999999999,"15min":0.78400000000000003},"min":{"1min":0.48399999999999999,"5min":0.46600000000000003,"15min":0.376},"max":{"1min":0.96699999999999997,"5min":1.2110000000000001,"15min":1.3420000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.78900000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.022,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.52300000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.73899999999999999,"15min":0.78000000000000003},"min":{"1min":0.55900000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.78100000000000003,"15min":0.80900000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.46400000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.3089999999999999},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.75900000000000001,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.499,"15min":0.40300000000000002},"max":{"1min":1.052,"5min":1.536,"15min":1.536},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.76400000000000001,"15min":0.80500000000000005},"min":{"1min":0.60999999999999999,"5min":0.54500000000000004,"15min":0.46200000000000002},"max":{"1min":1.1100000000000001,"5min":1.1339999999999999,"15min":1.2649999999999999},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77700000000000002,"15min":0.81699999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.107,"5min":1.143,"15min":1.214},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.80400000000000005},"min":{"1min":0.54300000000000004,"5min":0.50900000000000001,"15min":0.44700000000000001},"max":{"1min":1.0720000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.61799999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509664,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1536000,"data_stored":772276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.29299999999999998,"5min":0.28299999999999997,"15min":0.22900000000000001},"max":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.84599999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55000000000000004,"15min":0.56399999999999995},"min":{"1min":0.45300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.872},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.49099999999999999,"15min":0.50700000000000001},"min":{"1min":0.36799999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.81000000000000005},"last":0.44},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.41799999999999998,"5min":0.34599999999999997,"15min":0.29099999999999998},"max":{"1min":0.88,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.41799999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57599999999999996,"15min":0.59599999999999997},"min":{"1min":0.47199999999999998,"5min":0.378,"15min":0.33400000000000002},"max":{"1min":0.73399999999999999,"5min":0.81699999999999995,"15min":0.98899999999999999},"last":0.497},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.505,"15min":0.51600000000000001},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":0.70999999999999996,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.47599999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.75900000000000001,"15min":0.77500000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.432},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.625},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.79200000000000004,"15min":0.79800000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.498},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.74199999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.76500000000000001,"15min":0.78300000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.41899999999999998},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.79700000000000004,"15min":0.80000000000000004},"min":{"1min":0.65100000000000002,"5min":0.51500000000000001,"15min":0.376},"max":{"1min":1.276,"5min":1.276,"15min":1.2849999999999999},"last":0.75800000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.79300000000000004,"15min":0.81000000000000005},"min":{"1min":0.65500000000000003,"5min":0.53000000000000003,"15min":0.47899999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.23},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.77700000000000002,"15min":0.79000000000000004},"min":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.46500000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.3240000000000001},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.80000000000000004,"15min":0.81200000000000006},"min":{"1min":0.57899999999999996,"5min":0.53800000000000003,"15min":0.49199999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3149999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80000000000000004,"15min":0.80700000000000005},"min":{"1min":0.55600000000000005,"5min":0.55500000000000005,"15min":0.45700000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.3380000000000001},"last":0.58299999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509666,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37236,"kb_used_data":2092,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334604,"statfs":{"total":96636764160,"available":96598634496,"internally_reserved":0,"allocated":2142208,"data_stored":1369316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46999999999999997,"15min":0.46899999999999997},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.26600000000000001},"max":{"1min":0.70399999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.375},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.629}]},{"osd":2,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.42099999999999999,"5min":0.32400000000000001,"15min":0.29799999999999999},"max":{"1min":0.82599999999999996,"5min":0.871,"15min":1.3680000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.504,"5min":0.49299999999999999,"15min":0.51700000000000002},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.32600000000000001},"max":{"1min":0.68200000000000005,"5min":0.76700000000000002,"15min":0.871},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57299999999999995,"15min":0.58999999999999997},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.33700000000000002},"max":{"1min":0.745,"5min":1.038,"15min":1.038},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.79900000000000004,"15min":0.78400000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.45200000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.3009999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.80500000000000005,"15min":0.80200000000000005},"min":{"1min":0.54500000000000004,"5min":0.505,"15min":0.44600000000000001},"max":{"1min":1.278,"5min":1.278,"15min":1.423},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78200000000000003,"15min":0.77900000000000003},"min":{"1min":0.56799999999999995,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.0229999999999999,"5min":1.1020000000000001,"15min":1.2669999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81000000000000005,"15min":0.80800000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.39600000000000002},"max":{"1min":1.1950000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.48899999999999999},"max":{"1min":1.054,"5min":1.27,"15min":1.27},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.81100000000000005,"15min":0.81799999999999995},"min":{"1min":0.64300000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.333},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.60099999999999998,"5min":0.54300000000000004,"15min":0.53100000000000003},"max":{"1min":1.121,"5min":1.159,"15min":1.2310000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.80800000000000005,"15min":0.82799999999999996},"min":{"1min":0.55600000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.109,"5min":1.1930000000000001,"15min":1.369},"last":0.60699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:37:26.288 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:37:26.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.385+0000 7f8080711640 1 Processor -- start 2023-07-21T22:37:26.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.385+0000 7f8080711640 1 -- start start 2023-07-21T22:37:26.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.389+0000 7f8080711640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f807815bc00 0x7f80780ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:26.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.389+0000 7f8080711640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8078069430 0x7f8078069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:26.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.389+0000 7f8080711640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80780c9c30 con 0x7f8078160450 2023-07-21T22:37:26.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.389+0000 7f8080711640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80780c96b0 con 0x7f807815bc00 2023-07-21T22:37:26.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.389+0000 7f8080711640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8078069db0 con 0x7f8078069430 2023-07-21T22:37:26.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.389+0000 7f807e4ad640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f807815bc00 0x7f80780ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.389+0000 7f807e4ad640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f807815bc00 0x7f80780ce8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46850/0 (socket says 172.21.15.6:46850) 2023-07-21T22:37:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.389+0000 7f807e4ad640 1 -- 172.21.15.6:0/2233629442 learned_addr learned my addr 172.21.15.6:0/2233629442 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.389+0000 7f807ecae640 1 --2- 172.21.15.6:0/2233629442 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8078069430 0x7f8078069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.389+0000 7f807e4ad640 1 -- 172.21.15.6:0/2233629442 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8078069430 msgr2=0x7f8078069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:26.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.389+0000 7f807e4ad640 1 --2- 172.21.15.6:0/2233629442 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8078069430 0x7f8078069870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.389+0000 7f807e4ad640 1 -- 172.21.15.6:0/2233629442 >> v1:172.21.15.161:6789/0 conn(0x7f8078160450 legacy=0x7f807806e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:26.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.389+0000 7f807e4ad640 1 -- 172.21.15.6:0/2233629442 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807815bfd0 con 0x7f807815bc00 2023-07-21T22:37:26.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.393+0000 7f807e4ad640 1 --2- 172.21.15.6:0/2233629442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f807815bc00 0x7f80780ce8f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f8074009870 tx=0x7f807401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5859c6337b9817 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:26.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.393+0000 7f807d4ab640 1 -- 172.21.15.6:0/2233629442 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80740aa680 con 0x7f807815bc00 2023-07-21T22:37:26.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.393+0000 7f807d4ab640 1 -- 172.21.15.6:0/2233629442 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80740aa7e0 con 0x7f807815bc00 2023-07-21T22:37:26.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.393+0000 7f807d4ab640 1 -- 172.21.15.6:0/2233629442 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80740aab70 con 0x7f807815bc00 2023-07-21T22:37:26.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.393+0000 7f8080711640 1 -- 172.21.15.6:0/2233629442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f807815bc00 msgr2=0x7f80780ce8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:26.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.393+0000 7f8080711640 1 --2- 172.21.15.6:0/2233629442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f807815bc00 0x7f80780ce8f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f8074009870 tx=0x7f807401c520 comp rx=0 tx=0).stop 2023-07-21T22:37:26.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.393+0000 7f8080711640 1 -- 172.21.15.6:0/2233629442 shutdown_connections 2023-07-21T22:37:26.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.393+0000 7f8080711640 1 --2- 172.21.15.6:0/2233629442 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8078069430 0x7f8078069870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.393+0000 7f8080711640 1 --2- 172.21.15.6:0/2233629442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f807815bc00 0x7f80780ce8f0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.393+0000 7f8080711640 1 -- 172.21.15.6:0/2233629442 >> 172.21.15.6:0/2233629442 conn(0x7f80780b1840 msgr2=0x7f80780cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:26.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.393+0000 7f8080711640 1 -- 172.21.15.6:0/2233629442 shutdown_connections 2023-07-21T22:37:26.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.393+0000 7f8080711640 1 -- 172.21.15.6:0/2233629442 wait complete. 2023-07-21T22:37:26.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.393+0000 7f8080711640 1 Processor -- start 2023-07-21T22:37:26.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.393+0000 7f8080711640 1 -- start start 2023-07-21T22:37:26.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f8080711640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8078069430 0x7f80780b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:26.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f8080711640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f807815bc00 0x7f807814fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:26.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f8080711640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8078160450 0x7f8078150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:26.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f8080711640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80780b30a0 con 0x7f807815bc00 2023-07-21T22:37:26.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f8080711640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80780b4d60 con 0x7f8078160450 2023-07-21T22:37:26.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f8080711640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80780b2490 con 0x7f8078069430 2023-07-21T22:37:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f807dcac640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f807815bc00 0x7f807814fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f807dcac640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f807815bc00 0x7f807814fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46858/0 (socket says 172.21.15.6:46858) 2023-07-21T22:37:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f807dcac640 1 -- 172.21.15.6:0/4122967420 learned_addr learned my addr 172.21.15.6:0/4122967420 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f807e4ad640 1 --2- 172.21.15.6:0/4122967420 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8078069430 0x7f80780b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f807ecae640 1 --2- 172.21.15.6:0/4122967420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8078160450 0x7f8078150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f807dcac640 1 -- 172.21.15.6:0/4122967420 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8078069430 msgr2=0x7f80780b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f807dcac640 1 --2- 172.21.15.6:0/4122967420 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8078069430 0x7f80780b1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f807dcac640 1 -- 172.21.15.6:0/4122967420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8078160450 msgr2=0x7f8078150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f807dcac640 1 --2- 172.21.15.6:0/4122967420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8078160450 0x7f8078150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f807dcac640 1 -- 172.21.15.6:0/4122967420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80740094d0 con 0x7f807815bc00 2023-07-21T22:37:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f807e4ad640 1 --2- 172.21.15.6:0/4122967420 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8078069430 0x7f80780b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f807dcac640 1 --2- 172.21.15.6:0/4122967420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f807815bc00 0x7f807814fdf0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f806800c3c0 tx=0x7f806800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f806effd640 1 -- 172.21.15.6:0/4122967420 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80680052d0 con 0x7f807815bc00 2023-07-21T22:37:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f806effd640 1 -- 172.21.15.6:0/4122967420 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8068005430 con 0x7f807815bc00 2023-07-21T22:37:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f8080711640 1 -- 172.21.15.6:0/4122967420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80780b2770 con 0x7f807815bc00 2023-07-21T22:37:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f806effd640 1 -- 172.21.15.6:0/4122967420 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8068003840 con 0x7f807815bc00 2023-07-21T22:37:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f8080711640 1 -- 172.21.15.6:0/4122967420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80780b2d30 con 0x7f807815bc00 2023-07-21T22:37:26.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f8080711640 1 -- 172.21.15.6:0/4122967420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80780c2a80 con 0x7f807815bc00 2023-07-21T22:37:26.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.397+0000 7f806effd640 1 -- 172.21.15.6:0/4122967420 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f80680039a0 con 0x7f807815bc00 2023-07-21T22:37:26.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.401+0000 7f806effd640 1 --2- 172.21.15.6:0/4122967420 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f805c0663a0 0x7f805c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:26.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.401+0000 7f806effd640 1 -- 172.21.15.6:0/4122967420 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f80680833e0 con 0x7f807815bc00 2023-07-21T22:37:26.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.401+0000 7f807e4ad640 1 --2- 172.21.15.6:0/4122967420 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f805c0663a0 0x7f805c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:26.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.401+0000 7f807e4ad640 1 --2- 172.21.15.6:0/4122967420 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f805c0663a0 0x7f805c068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f80740ae000 tx=0x7f80740b5040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:26.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.405+0000 7f806effd640 1 -- 172.21.15.6:0/4122967420 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8068050730 con 0x7f807815bc00 2023-07-21T22:37:26.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.553+0000 7f8080711640 1 -- 172.21.15.6:0/4122967420 --> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80780c98c0 con 0x7f805c0663a0 2023-07-21T22:37:26.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.565+0000 7f806effd640 1 -- 172.21.15.6:0/4122967420 <== mgr.6905 v2:172.21.15.161:6832/1868466946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306310 (secure 0 0 0) 0x7f80740aa500 con 0x7f805c0663a0 2023-07-21T22:37:26.611 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:26.612 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:37:26.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.565+0000 7f8080711640 1 -- 172.21.15.6:0/4122967420 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f805c0663a0 msgr2=0x7f805c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:26.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.565+0000 7f8080711640 1 --2- 172.21.15.6:0/4122967420 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f805c0663a0 0x7f805c068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f80740ae000 tx=0x7f80740b5040 comp rx=0 tx=0).stop 2023-07-21T22:37:26.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.565+0000 7f8080711640 1 -- 172.21.15.6:0/4122967420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f807815bc00 msgr2=0x7f807814fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:26.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.565+0000 7f8080711640 1 --2- 172.21.15.6:0/4122967420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f807815bc00 0x7f807814fdf0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f806800c3c0 tx=0x7f806800c880 comp rx=0 tx=0).stop 2023-07-21T22:37:26.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.565+0000 7f8080711640 1 -- 172.21.15.6:0/4122967420 shutdown_connections 2023-07-21T22:37:26.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.565+0000 7f8080711640 1 --2- 172.21.15.6:0/4122967420 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f805c0663a0 0x7f805c068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.565+0000 7f8080711640 1 --2- 172.21.15.6:0/4122967420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8078160450 0x7f8078150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.565+0000 7f8080711640 1 --2- 172.21.15.6:0/4122967420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f807815bc00 0x7f807814fdf0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.565+0000 7f8080711640 1 --2- 172.21.15.6:0/4122967420 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8078069430 0x7f80780b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.565+0000 7f8080711640 1 -- 172.21.15.6:0/4122967420 >> 172.21.15.6:0/4122967420 conn(0x7f80780b1840 msgr2=0x7f80780ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:26.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.569+0000 7f8080711640 1 -- 172.21.15.6:0/4122967420 shutdown_connections 2023-07-21T22:37:26.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.569+0000 7f8080711640 1 -- 172.21.15.6:0/4122967420 wait complete. 2023-07-21T22:37:26.632 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-21T22:37:25.726881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332108,"kb_used_data":13196,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754642612,"statfs":{"total":773094113280,"available":772754034688,"internally_reserved":0,"allocated":13512704,"data_stored":7378960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.674866"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058267+0000","last_change":"2023-07-21T22:37:21.058267+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058267+0000","last_undegraded":"2023-07-21T22:37:21.058267+0000","last_fullsized":"2023-07-21T22:37:21.058267+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.067653+0000","last_change":"2023-07-21T22:37:21.067653+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.067653+0000","last_undegraded":"2023-07-21T22:37:21.067653+0000","last_fullsized":"2023-07-21T22:37:21.067653+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.059237+0000","last_change":"2023-07-21T22:37:21.059237+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.059237+0000","last_undegraded":"2023-07-21T22:37:21.059237+0000","last_fullsized":"2023-07-21T22:37:21.059237+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.063706+0000","last_change":"2023-07-21T22:37:21.063706+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.063706+0000","last_undegraded":"2023-07-21T22:37:21.063706+0000","last_fullsized":"2023-07-21T22:37:21.063706+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.060500+0000","last_change":"2023-07-21T22:37:21.060500+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.060500+0000","last_undegraded":"2023-07-21T22:37:21.060500+0000","last_fullsized":"2023-07-21T22:37:21.060500+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.066890+0000","last_change":"2023-07-21T22:37:21.066890+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.066890+0000","last_undegraded":"2023-07-21T22:37:21.066890+0000","last_fullsized":"2023-07-21T22:37:21.066890+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.068882+0000","last_change":"2023-07-21T22:37:21.068882+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.068882+0000","last_undegraded":"2023-07-21T22:37:21.068882+0000","last_fullsized":"2023-07-21T22:37:21.068882+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.070714+0000","last_change":"2023-07-21T22:37:21.070714+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.070714+0000","last_undegraded":"2023-07-21T22:37:21.070714+0000","last_fullsized":"2023-07-21T22:37:21.070714+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.065404+0000","last_change":"2023-07-21T22:37:21.065404+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.065404+0000","last_undegraded":"2023-07-21T22:37:21.065404+0000","last_fullsized":"2023-07-21T22:37:21.065404+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058481+0000","last_change":"2023-07-21T22:37:21.058481+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058481+0000","last_undegraded":"2023-07-21T22:37:21.058481+0000","last_fullsized":"2023-07-21T22:37:21.058481+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.059138+0000","last_change":"2023-07-21T22:37:21.059138+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.059138+0000","last_undegraded":"2023-07-21T22:37:21.059138+0000","last_fullsized":"2023-07-21T22:37:21.059138+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.064623+0000","last_change":"2023-07-21T22:37:21.064623+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.064623+0000","last_undegraded":"2023-07-21T22:37:21.064623+0000","last_fullsized":"2023-07-21T22:37:21.064623+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.061613+0000","last_change":"2023-07-21T22:37:21.061613+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.061613+0000","last_undegraded":"2023-07-21T22:37:21.061613+0000","last_fullsized":"2023-07-21T22:37:21.061613+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.062767+0000","last_change":"2023-07-21T22:37:21.062767+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.062767+0000","last_undegraded":"2023-07-21T22:37:21.062767+0000","last_fullsized":"2023-07-21T22:37:21.062767+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.063983+0000","last_change":"2023-07-21T22:37:21.063983+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.063983+0000","last_undegraded":"2023-07-21T22:37:21.063983+0000","last_fullsized":"2023-07-21T22:37:21.063983+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.065141+0000","last_change":"2023-07-21T22:37:21.065141+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.065141+0000","last_undegraded":"2023-07-21T22:37:21.065141+0000","last_fullsized":"2023-07-21T22:37:21.065141+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057800+0000","last_change":"2023-07-21T22:37:21.057800+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057800+0000","last_undegraded":"2023-07-21T22:37:21.057800+0000","last_fullsized":"2023-07-21T22:37:21.057800+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.067143+0000","last_change":"2023-07-21T22:37:21.067143+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.067143+0000","last_undegraded":"2023-07-21T22:37:21.067143+0000","last_fullsized":"2023-07-21T22:37:21.067143+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058804+0000","last_change":"2023-07-21T22:37:21.058804+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058804+0000","last_undegraded":"2023-07-21T22:37:21.058804+0000","last_fullsized":"2023-07-21T22:37:21.058804+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.061352+0000","last_change":"2023-07-21T22:37:21.061352+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.061352+0000","last_undegraded":"2023-07-21T22:37:21.061352+0000","last_fullsized":"2023-07-21T22:37:21.061352+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.070641+0000","last_change":"2023-07-21T22:37:21.070641+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.070641+0000","last_undegraded":"2023-07-21T22:37:21.070641+0000","last_fullsized":"2023-07-21T22:37:21.070641+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.059082+0000","last_change":"2023-07-21T22:37:21.059082+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.059082+0000","last_undegraded":"2023-07-21T22:37:21.059082+0000","last_fullsized":"2023-07-21T22:37:21.059082+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057387+0000","last_change":"2023-07-21T22:37:21.057387+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057387+0000","last_undegraded":"2023-07-21T22:37:21.057387+0000","last_fullsized":"2023-07-21T22:37:21.057387+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058500+0000","last_change":"2023-07-21T22:37:21.058500+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058500+0000","last_undegraded":"2023-07-21T22:37:21.058500+0000","last_fullsized":"2023-07-21T22:37:21.058500+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.062184+0000","last_change":"2023-07-21T22:37:21.062184+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.062184+0000","last_undegraded":"2023-07-21T22:37:21.062184+0000","last_fullsized":"2023-07-21T22:37:21.062184+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.060749+0000","last_change":"2023-07-21T22:37:21.060749+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.060749+0000","last_undegraded":"2023-07-21T22:37:21.060749+0000","last_fullsized":"2023-07-21T22:37:21.060749+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057996+0000","last_change":"2023-07-21T22:37:21.057996+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057996+0000","last_undegraded":"2023-07-21T22:37:21.057996+0000","last_fullsized":"2023-07-21T22:37:21.057996+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.071838+0000","last_change":"2023-07-21T22:37:21.071838+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.071838+0000","last_undegraded":"2023-07-21T22:37:21.071838+0000","last_fullsized":"2023-07-21T22:37:21.071838+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.070119+0000","last_change":"2023-07-21T22:37:21.070119+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.070119+0000","last_undegraded":"2023-07-21T22:37:21.070119+0000","last_fullsized":"2023-07-21T22:37:21.070119+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.062274+0000","last_change":"2023-07-21T22:37:21.062274+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.062274+0000","last_undegraded":"2023-07-21T22:37:21.062274+0000","last_fullsized":"2023-07-21T22:37:21.062274+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.068434+0000","last_change":"2023-07-21T22:37:21.068434+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.068434+0000","last_undegraded":"2023-07-21T22:37:21.068434+0000","last_fullsized":"2023-07-21T22:37:21.068434+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.070220+0000","last_change":"2023-07-21T22:37:21.070220+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.070220+0000","last_undegraded":"2023-07-21T22:37:21.070220+0000","last_fullsized":"2023-07-21T22:37:21.070220+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057977+0000","last_change":"2023-07-21T22:37:21.057977+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057977+0000","last_undegraded":"2023-07-21T22:37:21.057977+0000","last_fullsized":"2023-07-21T22:37:21.057977+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.081540+0000","last_change":"2023-07-21T22:37:21.077330+0000","last_active":"2023-07-21T22:37:21.081540+0000","last_peered":"2023-07-21T22:37:21.081540+0000","last_clean":"2023-07-21T22:37:21.081540+0000","last_became_active":"2023-07-21T22:37:21.077027+0000","last_became_peered":"2023-07-21T22:37:21.077027+0000","last_unstale":"2023-07-21T22:37:21.081540+0000","last_undegraded":"2023-07-21T22:37:21.081540+0000","last_fullsized":"2023-07-21T22:37:21.081540+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:09:20.713834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.071547+0000","last_change":"2023-07-21T22:37:21.071547+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.071547+0000","last_undegraded":"2023-07-21T22:37:21.071547+0000","last_fullsized":"2023-07-21T22:37:21.071547+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082163+0000","last_change":"2023-07-21T22:37:21.078917+0000","last_active":"2023-07-21T22:37:21.082163+0000","last_peered":"2023-07-21T22:37:21.082163+0000","last_clean":"2023-07-21T22:37:21.082163+0000","last_became_active":"2023-07-21T22:37:21.078582+0000","last_became_peered":"2023-07-21T22:37:21.078582+0000","last_unstale":"2023-07-21T22:37:21.082163+0000","last_undegraded":"2023-07-21T22:37:21.082163+0000","last_fullsized":"2023-07-21T22:37:21.082163+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:44:59.850746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.061787+0000","last_change":"2023-07-21T22:37:21.061787+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.061787+0000","last_undegraded":"2023-07-21T22:37:21.061787+0000","last_fullsized":"2023-07-21T22:37:21.061787+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.077531+0000","last_change":"2023-07-21T22:37:21.071615+0000","last_active":"2023-07-21T22:37:21.077531+0000","last_peered":"2023-07-21T22:37:21.077531+0000","last_clean":"2023-07-21T22:37:21.077531+0000","last_became_active":"2023-07-21T22:37:21.071287+0000","last_became_peered":"2023-07-21T22:37:21.071287+0000","last_unstale":"2023-07-21T22:37:21.077531+0000","last_undegraded":"2023-07-21T22:37:21.077531+0000","last_fullsized":"2023-07-21T22:37:21.077531+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:16:18.946381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058462+0000","last_change":"2023-07-21T22:37:21.058462+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058462+0000","last_undegraded":"2023-07-21T22:37:21.058462+0000","last_fullsized":"2023-07-21T22:37:21.058462+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.067653+0000","last_change":"2023-07-21T22:37:21.063348+0000","last_active":"2023-07-21T22:37:21.067653+0000","last_peered":"2023-07-21T22:37:21.067653+0000","last_clean":"2023-07-21T22:37:21.067653+0000","last_became_active":"2023-07-21T22:37:21.062717+0000","last_became_peered":"2023-07-21T22:37:21.062717+0000","last_unstale":"2023-07-21T22:37:21.067653+0000","last_undegraded":"2023-07-21T22:37:21.067653+0000","last_fullsized":"2023-07-21T22:37:21.067653+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:52.156305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.060345+0000","last_change":"2023-07-21T22:37:21.060345+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.060345+0000","last_undegraded":"2023-07-21T22:37:21.060345+0000","last_fullsized":"2023-07-21T22:37:21.060345+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.080074+0000","last_change":"2023-07-21T22:37:21.078218+0000","last_active":"2023-07-21T22:37:21.080074+0000","last_peered":"2023-07-21T22:37:21.080074+0000","last_clean":"2023-07-21T22:37:21.080074+0000","last_became_active":"2023-07-21T22:37:21.077942+0000","last_became_peered":"2023-07-21T22:37:21.077942+0000","last_unstale":"2023-07-21T22:37:21.080074+0000","last_undegraded":"2023-07-21T22:37:21.080074+0000","last_fullsized":"2023-07-21T22:37:21.080074+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:44:27.641511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057756+0000","last_change":"2023-07-21T22:37:21.057756+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057756+0000","last_undegraded":"2023-07-21T22:37:21.057756+0000","last_fullsized":"2023-07-21T22:37:21.057756+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.074755+0000","last_change":"2023-07-21T22:37:21.072265+0000","last_active":"2023-07-21T22:37:21.074755+0000","last_peered":"2023-07-21T22:37:21.074755+0000","last_clean":"2023-07-21T22:37:21.074755+0000","last_became_active":"2023-07-21T22:37:21.071996+0000","last_became_peered":"2023-07-21T22:37:21.071996+0000","last_unstale":"2023-07-21T22:37:21.074755+0000","last_undegraded":"2023-07-21T22:37:21.074755+0000","last_fullsized":"2023-07-21T22:37:21.074755+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:12:15.936040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.065241+0000","last_change":"2023-07-21T22:37:21.065241+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.065241+0000","last_undegraded":"2023-07-21T22:37:21.065241+0000","last_fullsized":"2023-07-21T22:37:21.065241+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.078460+0000","last_change":"2023-07-21T22:37:21.070105+0000","last_active":"2023-07-21T22:37:21.078460+0000","last_peered":"2023-07-21T22:37:21.078460+0000","last_clean":"2023-07-21T22:37:21.078460+0000","last_became_active":"2023-07-21T22:37:21.069728+0000","last_became_peered":"2023-07-21T22:37:21.069728+0000","last_unstale":"2023-07-21T22:37:21.078460+0000","last_undegraded":"2023-07-21T22:37:21.078460+0000","last_fullsized":"2023-07-21T22:37:21.078460+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:05:08.970742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.060058+0000","last_change":"2023-07-21T22:37:21.060058+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.060058+0000","last_undegraded":"2023-07-21T22:37:21.060058+0000","last_fullsized":"2023-07-21T22:37:21.060058+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.072074+0000","last_change":"2023-07-21T22:37:21.068302+0000","last_active":"2023-07-21T22:37:21.072074+0000","last_peered":"2023-07-21T22:37:21.072074+0000","last_clean":"2023-07-21T22:37:21.072074+0000","last_became_active":"2023-07-21T22:37:21.068014+0000","last_became_peered":"2023-07-21T22:37:21.068014+0000","last_unstale":"2023-07-21T22:37:21.072074+0000","last_undegraded":"2023-07-21T22:37:21.072074+0000","last_fullsized":"2023-07-21T22:37:21.072074+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:49:08.508129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058492+0000","last_change":"2023-07-21T22:37:21.058492+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058492+0000","last_undegraded":"2023-07-21T22:37:21.058492+0000","last_fullsized":"2023-07-21T22:37:21.058492+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.078647+0000","last_change":"2023-07-21T22:37:21.072005+0000","last_active":"2023-07-21T22:37:21.078647+0000","last_peered":"2023-07-21T22:37:21.078647+0000","last_clean":"2023-07-21T22:37:21.078647+0000","last_became_active":"2023-07-21T22:37:21.071724+0000","last_became_peered":"2023-07-21T22:37:21.071724+0000","last_unstale":"2023-07-21T22:37:21.078647+0000","last_undegraded":"2023-07-21T22:37:21.078647+0000","last_fullsized":"2023-07-21T22:37:21.078647+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:26.355327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058561+0000","last_change":"2023-07-21T22:37:21.058561+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058561+0000","last_undegraded":"2023-07-21T22:37:21.058561+0000","last_fullsized":"2023-07-21T22:37:21.058561+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.074611+0000","last_change":"2023-07-21T22:37:21.071932+0000","last_active":"2023-07-21T22:37:21.074611+0000","last_peered":"2023-07-21T22:37:21.074611+0000","last_clean":"2023-07-21T22:37:21.074611+0000","last_became_active":"2023-07-21T22:37:21.071545+0000","last_became_peered":"2023-07-21T22:37:21.071545+0000","last_unstale":"2023-07-21T22:37:21.074611+0000","last_undegraded":"2023-07-21T22:37:21.074611+0000","last_fullsized":"2023-07-21T22:37:21.074611+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:57:21.999160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.071163+0000","last_change":"2023-07-21T22:37:21.071163+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.071163+0000","last_undegraded":"2023-07-21T22:37:21.071163+0000","last_fullsized":"2023-07-21T22:37:21.071163+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.076282+0000","last_change":"2023-07-21T22:37:21.074517+0000","last_active":"2023-07-21T22:37:21.076282+0000","last_peered":"2023-07-21T22:37:21.076282+0000","last_clean":"2023-07-21T22:37:21.076282+0000","last_became_active":"2023-07-21T22:37:21.074054+0000","last_became_peered":"2023-07-21T22:37:21.074054+0000","last_unstale":"2023-07-21T22:37:21.076282+0000","last_undegraded":"2023-07-21T22:37:21.076282+0000","last_fullsized":"2023-07-21T22:37:21.076282+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:34:22.370850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.059591+0000","last_change":"2023-07-21T22:37:21.059591+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.059591+0000","last_undegraded":"2023-07-21T22:37:21.059591+0000","last_fullsized":"2023-07-21T22:37:21.059591+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082570+0000","last_change":"2023-07-21T22:37:21.078493+0000","last_active":"2023-07-21T22:37:21.082570+0000","last_peered":"2023-07-21T22:37:21.082570+0000","last_clean":"2023-07-21T22:37:21.082570+0000","last_became_active":"2023-07-21T22:37:21.078199+0000","last_became_peered":"2023-07-21T22:37:21.078199+0000","last_unstale":"2023-07-21T22:37:21.082570+0000","last_undegraded":"2023-07-21T22:37:21.082570+0000","last_fullsized":"2023-07-21T22:37:21.082570+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:52:29.786420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058982+0000","last_change":"2023-07-21T22:37:21.058982+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058982+0000","last_undegraded":"2023-07-21T22:37:21.058982+0000","last_fullsized":"2023-07-21T22:37:21.058982+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.072498+0000","last_change":"2023-07-21T22:37:21.068918+0000","last_active":"2023-07-21T22:37:21.072498+0000","last_peered":"2023-07-21T22:37:21.072498+0000","last_clean":"2023-07-21T22:37:21.072498+0000","last_became_active":"2023-07-21T22:37:21.068632+0000","last_became_peered":"2023-07-21T22:37:21.068632+0000","last_unstale":"2023-07-21T22:37:21.072498+0000","last_undegraded":"2023-07-21T22:37:21.072498+0000","last_fullsized":"2023-07-21T22:37:21.072498+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:45:11.816606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.067540+0000","last_change":"2023-07-21T22:37:21.067540+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.067540+0000","last_undegraded":"2023-07-21T22:37:21.067540+0000","last_fullsized":"2023-07-21T22:37:21.067540+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.070286+0000","last_change":"2023-07-21T22:37:21.066648+0000","last_active":"2023-07-21T22:37:21.070286+0000","last_peered":"2023-07-21T22:37:21.070286+0000","last_clean":"2023-07-21T22:37:21.070286+0000","last_became_active":"2023-07-21T22:37:21.066313+0000","last_became_peered":"2023-07-21T22:37:21.066313+0000","last_unstale":"2023-07-21T22:37:21.070286+0000","last_undegraded":"2023-07-21T22:37:21.070286+0000","last_fullsized":"2023-07-21T22:37:21.070286+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:24:19.351613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.071271+0000","last_change":"2023-07-21T22:37:21.071271+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.071271+0000","last_undegraded":"2023-07-21T22:37:21.071271+0000","last_fullsized":"2023-07-21T22:37:21.071271+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.081885+0000","last_change":"2023-07-21T22:37:21.075668+0000","last_active":"2023-07-21T22:37:21.081885+0000","last_peered":"2023-07-21T22:37:21.081885+0000","last_clean":"2023-07-21T22:37:21.081885+0000","last_became_active":"2023-07-21T22:37:21.075393+0000","last_became_peered":"2023-07-21T22:37:21.075393+0000","last_unstale":"2023-07-21T22:37:21.081885+0000","last_undegraded":"2023-07-21T22:37:21.081885+0000","last_fullsized":"2023-07-21T22:37:21.081885+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:28:21.336083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057315+0000","last_change":"2023-07-21T22:37:21.057315+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057315+0000","last_undegraded":"2023-07-21T22:37:21.057315+0000","last_fullsized":"2023-07-21T22:37:21.057315+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.077525+0000","last_change":"2023-07-21T22:37:21.070598+0000","last_active":"2023-07-21T22:37:21.077525+0000","last_peered":"2023-07-21T22:37:21.077525+0000","last_clean":"2023-07-21T22:37:21.077525+0000","last_became_active":"2023-07-21T22:37:21.069746+0000","last_became_peered":"2023-07-21T22:37:21.069746+0000","last_unstale":"2023-07-21T22:37:21.077525+0000","last_undegraded":"2023-07-21T22:37:21.077525+0000","last_fullsized":"2023-07-21T22:37:21.077525+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:47:57.653894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058924+0000","last_change":"2023-07-21T22:37:21.058924+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058924+0000","last_undegraded":"2023-07-21T22:37:21.058924+0000","last_fullsized":"2023-07-21T22:37:21.058924+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082365+0000","last_change":"2023-07-21T22:37:21.079461+0000","last_active":"2023-07-21T22:37:21.082365+0000","last_peered":"2023-07-21T22:37:21.082365+0000","last_clean":"2023-07-21T22:37:21.082365+0000","last_became_active":"2023-07-21T22:37:21.079152+0000","last_became_peered":"2023-07-21T22:37:21.079152+0000","last_unstale":"2023-07-21T22:37:21.082365+0000","last_undegraded":"2023-07-21T22:37:21.082365+0000","last_fullsized":"2023-07-21T22:37:21.082365+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:13:42.164239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.061261+0000","last_change":"2023-07-21T22:37:21.061261+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.061261+0000","last_undegraded":"2023-07-21T22:37:21.061261+0000","last_fullsized":"2023-07-21T22:37:21.061261+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.073577+0000","last_change":"2023-07-21T22:37:21.066856+0000","last_active":"2023-07-21T22:37:21.073577+0000","last_peered":"2023-07-21T22:37:21.073577+0000","last_clean":"2023-07-21T22:37:21.073577+0000","last_became_active":"2023-07-21T22:37:21.066089+0000","last_became_peered":"2023-07-21T22:37:21.066089+0000","last_unstale":"2023-07-21T22:37:21.073577+0000","last_undegraded":"2023-07-21T22:37:21.073577+0000","last_fullsized":"2023-07-21T22:37:21.073577+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:15.352350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.062480+0000","last_change":"2023-07-21T22:37:21.062480+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.062480+0000","last_undegraded":"2023-07-21T22:37:21.062480+0000","last_fullsized":"2023-07-21T22:37:21.062480+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082518+0000","last_change":"2023-07-21T22:37:21.078173+0000","last_active":"2023-07-21T22:37:21.082518+0000","last_peered":"2023-07-21T22:37:21.082518+0000","last_clean":"2023-07-21T22:37:21.082518+0000","last_became_active":"2023-07-21T22:37:21.077879+0000","last_became_peered":"2023-07-21T22:37:21.077879+0000","last_unstale":"2023-07-21T22:37:21.082518+0000","last_undegraded":"2023-07-21T22:37:21.082518+0000","last_fullsized":"2023-07-21T22:37:21.082518+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:57:03.563418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.059646+0000","last_change":"2023-07-21T22:37:21.059646+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.059646+0000","last_undegraded":"2023-07-21T22:37:21.059646+0000","last_fullsized":"2023-07-21T22:37:21.059646+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.078749+0000","last_change":"2023-07-21T22:37:21.077940+0000","last_active":"2023-07-21T22:37:21.078749+0000","last_peered":"2023-07-21T22:37:21.078749+0000","last_clean":"2023-07-21T22:37:21.078749+0000","last_became_active":"2023-07-21T22:37:21.077593+0000","last_became_peered":"2023-07-21T22:37:21.077593+0000","last_unstale":"2023-07-21T22:37:21.078749+0000","last_undegraded":"2023-07-21T22:37:21.078749+0000","last_fullsized":"2023-07-21T22:37:21.078749+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:21:42.376326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.069756+0000","last_change":"2023-07-21T22:37:21.069756+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.069756+0000","last_undegraded":"2023-07-21T22:37:21.069756+0000","last_fullsized":"2023-07-21T22:37:21.069756+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.079004+0000","last_change":"2023-07-21T22:37:21.075547+0000","last_active":"2023-07-21T22:37:21.079004+0000","last_peered":"2023-07-21T22:37:21.079004+0000","last_clean":"2023-07-21T22:37:21.079004+0000","last_became_active":"2023-07-21T22:37:21.075261+0000","last_became_peered":"2023-07-21T22:37:21.075261+0000","last_unstale":"2023-07-21T22:37:21.079004+0000","last_undegraded":"2023-07-21T22:37:21.079004+0000","last_fullsized":"2023-07-21T22:37:21.079004+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:33.794471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.069735+0000","last_change":"2023-07-21T22:37:21.069735+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.069735+0000","last_undegraded":"2023-07-21T22:37:21.069735+0000","last_fullsized":"2023-07-21T22:37:21.069735+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.081837+0000","last_change":"2023-07-21T22:37:21.076789+0000","last_active":"2023-07-21T22:37:21.081837+0000","last_peered":"2023-07-21T22:37:21.081837+0000","last_clean":"2023-07-21T22:37:21.081837+0000","last_became_active":"2023-07-21T22:37:21.076497+0000","last_became_peered":"2023-07-21T22:37:21.076497+0000","last_unstale":"2023-07-21T22:37:21.081837+0000","last_undegraded":"2023-07-21T22:37:21.081837+0000","last_fullsized":"2023-07-21T22:37:21.081837+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:23:52.304154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.062405+0000","last_change":"2023-07-21T22:37:21.062405+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.062405+0000","last_undegraded":"2023-07-21T22:37:21.062405+0000","last_fullsized":"2023-07-21T22:37:21.062405+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.083436+0000","last_change":"2023-07-21T22:37:21.079413+0000","last_active":"2023-07-21T22:37:21.083436+0000","last_peered":"2023-07-21T22:37:21.083436+0000","last_clean":"2023-07-21T22:37:21.083436+0000","last_became_active":"2023-07-21T22:37:21.079087+0000","last_became_peered":"2023-07-21T22:37:21.079087+0000","last_unstale":"2023-07-21T22:37:21.083436+0000","last_undegraded":"2023-07-21T22:37:21.083436+0000","last_fullsized":"2023-07-21T22:37:21.083436+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:59:42.462195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058560+0000","last_change":"2023-07-21T22:37:21.058560+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058560+0000","last_undegraded":"2023-07-21T22:37:21.058560+0000","last_fullsized":"2023-07-21T22:37:21.058560+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.081845+0000","last_change":"2023-07-21T22:37:21.075785+0000","last_active":"2023-07-21T22:37:21.081845+0000","last_peered":"2023-07-21T22:37:21.081845+0000","last_clean":"2023-07-21T22:37:21.081845+0000","last_became_active":"2023-07-21T22:37:21.075437+0000","last_became_peered":"2023-07-21T22:37:21.075437+0000","last_unstale":"2023-07-21T22:37:21.081845+0000","last_undegraded":"2023-07-21T22:37:21.081845+0000","last_fullsized":"2023-07-21T22:37:21.081845+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:06:15.022660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057994+0000","last_change":"2023-07-21T22:37:21.057994+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057994+0000","last_undegraded":"2023-07-21T22:37:21.057994+0000","last_fullsized":"2023-07-21T22:37:21.057994+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082187+0000","last_change":"2023-07-21T22:37:21.079237+0000","last_active":"2023-07-21T22:37:21.082187+0000","last_peered":"2023-07-21T22:37:21.082187+0000","last_clean":"2023-07-21T22:37:21.082187+0000","last_became_active":"2023-07-21T22:37:21.078935+0000","last_became_peered":"2023-07-21T22:37:21.078935+0000","last_unstale":"2023-07-21T22:37:21.082187+0000","last_undegraded":"2023-07-21T22:37:21.082187+0000","last_fullsized":"2023-07-21T22:37:21.082187+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:24.190628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"116'227","reported_seq":748,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.065586+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:37:21.065586+0000","last_peered":"2023-07-21T22:37:21.065586+0000","last_clean":"2023-07-21T22:37:21.065586+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:37:21.065586+0000","last_undegraded":"2023-07-21T22:37:21.065586+0000","last_fullsized":"2023-07-21T22:37:21.065586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:51:00.701474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":219,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.061363+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:37:21.061363+0000","last_peered":"2023-07-21T22:37:21.061363+0000","last_clean":"2023-07-21T22:37:21.061363+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:37:21.061363+0000","last_undegraded":"2023-07-21T22:37:21.061363+0000","last_fullsized":"2023-07-21T22:37:21.061363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:35:00.619996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.064431+0000","last_change":"2023-07-21T22:37:21.064431+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.064431+0000","last_undegraded":"2023-07-21T22:37:21.064431+0000","last_fullsized":"2023-07-21T22:37:21.064431+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.077071+0000","last_change":"2023-07-21T22:37:21.075739+0000","last_active":"2023-07-21T22:37:21.077071+0000","last_peered":"2023-07-21T22:37:21.077071+0000","last_clean":"2023-07-21T22:37:21.077071+0000","last_became_active":"2023-07-21T22:37:21.075418+0000","last_became_peered":"2023-07-21T22:37:21.075418+0000","last_unstale":"2023-07-21T22:37:21.077071+0000","last_undegraded":"2023-07-21T22:37:21.077071+0000","last_fullsized":"2023-07-21T22:37:21.077071+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:31:34.885110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":202,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.065449+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:37:21.065449+0000","last_peered":"2023-07-21T22:37:21.065449+0000","last_clean":"2023-07-21T22:37:21.065449+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:37:21.065449+0000","last_undegraded":"2023-07-21T22:37:21.065449+0000","last_fullsized":"2023-07-21T22:37:21.065449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:33:54.469018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.060048+0000","last_change":"2023-07-21T22:37:21.060048+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.060048+0000","last_undegraded":"2023-07-21T22:37:21.060048+0000","last_fullsized":"2023-07-21T22:37:21.060048+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.080805+0000","last_change":"2023-07-21T22:37:21.079660+0000","last_active":"2023-07-21T22:37:21.080805+0000","last_peered":"2023-07-21T22:37:21.080805+0000","last_clean":"2023-07-21T22:37:21.080805+0000","last_became_active":"2023-07-21T22:37:21.079340+0000","last_became_peered":"2023-07-21T22:37:21.079340+0000","last_unstale":"2023-07-21T22:37:21.080805+0000","last_undegraded":"2023-07-21T22:37:21.080805+0000","last_fullsized":"2023-07-21T22:37:21.080805+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:18:13.008438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":200,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.067659+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:37:21.067659+0000","last_peered":"2023-07-21T22:37:21.067659+0000","last_clean":"2023-07-21T22:37:21.067659+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:37:21.067659+0000","last_undegraded":"2023-07-21T22:37:21.067659+0000","last_fullsized":"2023-07-21T22:37:21.067659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:38:48.649472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.069672+0000","last_change":"2023-07-21T22:37:21.069672+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.069672+0000","last_undegraded":"2023-07-21T22:37:21.069672+0000","last_fullsized":"2023-07-21T22:37:21.069672+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082683+0000","last_change":"2023-07-21T22:37:21.078854+0000","last_active":"2023-07-21T22:37:21.082683+0000","last_peered":"2023-07-21T22:37:21.082683+0000","last_clean":"2023-07-21T22:37:21.082683+0000","last_became_active":"2023-07-21T22:37:21.078575+0000","last_became_peered":"2023-07-21T22:37:21.078575+0000","last_unstale":"2023-07-21T22:37:21.082683+0000","last_undegraded":"2023-07-21T22:37:21.082683+0000","last_fullsized":"2023-07-21T22:37:21.082683+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:48:15.816878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":219,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.060250+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:37:21.060250+0000","last_peered":"2023-07-21T22:37:21.060250+0000","last_clean":"2023-07-21T22:37:21.060250+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:37:21.060250+0000","last_undegraded":"2023-07-21T22:37:21.060250+0000","last_fullsized":"2023-07-21T22:37:21.060250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:40:37.271851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.060963+0000","last_change":"2023-07-21T22:37:21.060963+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.060963+0000","last_undegraded":"2023-07-21T22:37:21.060963+0000","last_fullsized":"2023-07-21T22:37:21.060963+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082654+0000","last_change":"2023-07-21T22:37:21.078876+0000","last_active":"2023-07-21T22:37:21.082654+0000","last_peered":"2023-07-21T22:37:21.082654+0000","last_clean":"2023-07-21T22:37:21.082654+0000","last_became_active":"2023-07-21T22:37:21.078596+0000","last_became_peered":"2023-07-21T22:37:21.078596+0000","last_unstale":"2023-07-21T22:37:21.082654+0000","last_undegraded":"2023-07-21T22:37:21.082654+0000","last_fullsized":"2023-07-21T22:37:21.082654+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:45:12.152065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":211,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.053262+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:37:21.053262+0000","last_peered":"2023-07-21T22:37:21.053262+0000","last_clean":"2023-07-21T22:37:21.053262+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:37:21.053262+0000","last_undegraded":"2023-07-21T22:37:21.053262+0000","last_fullsized":"2023-07-21T22:37:21.053262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:24:28.113597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.069611+0000","last_change":"2023-07-21T22:37:21.069611+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.069611+0000","last_undegraded":"2023-07-21T22:37:21.069611+0000","last_fullsized":"2023-07-21T22:37:21.069611+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.081821+0000","last_change":"2023-07-21T22:37:21.075411+0000","last_active":"2023-07-21T22:37:21.081821+0000","last_peered":"2023-07-21T22:37:21.081821+0000","last_clean":"2023-07-21T22:37:21.081821+0000","last_became_active":"2023-07-21T22:37:21.075095+0000","last_became_peered":"2023-07-21T22:37:21.075095+0000","last_unstale":"2023-07-21T22:37:21.081821+0000","last_undegraded":"2023-07-21T22:37:21.081821+0000","last_fullsized":"2023-07-21T22:37:21.081821+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:39:38.877282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":201,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.064309+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:37:21.064309+0000","last_peered":"2023-07-21T22:37:21.064309+0000","last_clean":"2023-07-21T22:37:21.064309+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:37:21.064309+0000","last_undegraded":"2023-07-21T22:37:21.064309+0000","last_fullsized":"2023-07-21T22:37:21.064309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:32:33.263928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.061200+0000","last_change":"2023-07-21T22:37:21.061200+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.061200+0000","last_undegraded":"2023-07-21T22:37:21.061200+0000","last_fullsized":"2023-07-21T22:37:21.061200+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.081775+0000","last_change":"2023-07-21T22:37:21.075461+0000","last_active":"2023-07-21T22:37:21.081775+0000","last_peered":"2023-07-21T22:37:21.081775+0000","last_clean":"2023-07-21T22:37:21.081775+0000","last_became_active":"2023-07-21T22:37:21.075125+0000","last_became_peered":"2023-07-21T22:37:21.075125+0000","last_unstale":"2023-07-21T22:37:21.081775+0000","last_undegraded":"2023-07-21T22:37:21.081775+0000","last_fullsized":"2023-07-21T22:37:21.081775+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:11:04.198665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":211,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.052916+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:37:21.052916+0000","last_peered":"2023-07-21T22:37:21.052916+0000","last_clean":"2023-07-21T22:37:21.052916+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:37:21.052916+0000","last_undegraded":"2023-07-21T22:37:21.052916+0000","last_fullsized":"2023-07-21T22:37:21.052916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:43:51.528257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058355+0000","last_change":"2023-07-21T22:37:21.058355+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058355+0000","last_undegraded":"2023-07-21T22:37:21.058355+0000","last_fullsized":"2023-07-21T22:37:21.058355+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.079054+0000","last_change":"2023-07-21T22:37:21.073046+0000","last_active":"2023-07-21T22:37:21.079054+0000","last_peered":"2023-07-21T22:37:21.079054+0000","last_clean":"2023-07-21T22:37:21.079054+0000","last_became_active":"2023-07-21T22:37:21.072789+0000","last_became_peered":"2023-07-21T22:37:21.072789+0000","last_unstale":"2023-07-21T22:37:21.079054+0000","last_undegraded":"2023-07-21T22:37:21.079054+0000","last_fullsized":"2023-07-21T22:37:21.079054+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:38:11.812192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":197,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.072728+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:37:21.072728+0000","last_peered":"2023-07-21T22:37:21.072728+0000","last_clean":"2023-07-21T22:37:21.072728+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:37:21.072728+0000","last_undegraded":"2023-07-21T22:37:21.072728+0000","last_fullsized":"2023-07-21T22:37:21.072728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:23:55.856237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509664,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59368,"kb_used_data":2080,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312472,"statfs":{"total":96636764160,"available":96575971328,"internally_reserved":0,"allocated":2129920,"data_stored":1362644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.63,"5min":0.42599999999999999,"15min":0.35299999999999998},"max":{"1min":0.95199999999999996,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.625},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69599999999999995,"15min":0.69699999999999995},"min":{"1min":0.54500000000000004,"5min":0.40899999999999997,"15min":0.39500000000000002},"max":{"1min":0.82599999999999996,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.52600000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70899999999999996,"15min":0.72999999999999998},"min":{"1min":0.52700000000000002,"5min":0.44900000000000001,"15min":0.432},"max":{"1min":0.92400000000000004,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.69599999999999995,"15min":0.71499999999999997},"min":{"1min":0.497,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.873,"5min":1.093,"15min":1.093},"last":0.64500000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.501,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.877,"5min":1.1399999999999999,"15min":1.405},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.57399999999999995,"5min":0.47999999999999998,"15min":0.45800000000000002},"max":{"1min":0.88800000000000001,"5min":1.409,"15min":1.409},"last":0.68999999999999995}]},{"osd":3,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.75900000000000001,"15min":0.76500000000000001},"min":{"1min":0.55400000000000005,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95399999999999996,"5min":1.46,"15min":1.46},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.56599999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92900000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.70899999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.42699999999999999,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.66900000000000004,"5min":0.90000000000000002,"15min":0.94999999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.63,"15min":0.61699999999999999},"min":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82699999999999996,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64800000000000002,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.85199999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70099999999999996,"15min":0.68000000000000005},"min":{"1min":0.51100000000000001,"5min":0.42499999999999999,"15min":0.38300000000000001},"max":{"1min":0.90900000000000003,"5min":1.506,"15min":1.506},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.53600000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89000000000000001,"5min":1.0329999999999999,"15min":1.048},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.47399999999999998,"5min":0.442,"15min":0.42699999999999999},"max":{"1min":0.83599999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.56999999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542370,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1536000,"data_stored":772276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72999999999999998,"15min":0.76000000000000001},"min":{"1min":0.54200000000000004,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.95599999999999996,"5min":1.016,"15min":1.016},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77400000000000002,"15min":0.79100000000000004},"min":{"1min":0.58499999999999996,"5min":0.53200000000000003,"15min":0.437},"max":{"1min":0.93700000000000006,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.628}]},{"osd":1,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.57599999999999996,"5min":0.49099999999999999,"15min":0.45300000000000001},"max":{"1min":0.86399999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71399999999999997,"15min":0.73199999999999998},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.82799999999999996,"5min":0.99199999999999999,"15min":1.117},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72099999999999997,"15min":0.747},"min":{"1min":0.53000000000000003,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.91400000000000003,"5min":0.98099999999999998,"15min":0.997},"last":0.442},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.59299999999999997,"5min":0.53500000000000003,"15min":0.45500000000000002},"max":{"1min":0.99099999999999999,"5min":1.097,"15min":1.097},"last":0.69799999999999995}]},{"osd":3,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72999999999999998,"15min":0.754},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.45000000000000001},"max":{"1min":0.89400000000000002,"5min":1.048,"15min":1.048},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":0.73199999999999998},"min":{"1min":0.56399999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85799999999999998,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.59299999999999997},"min":{"1min":0.47199999999999998,"5min":0.374,"15min":0.36599999999999999},"max":{"1min":0.83699999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.623},"min":{"1min":0.42299999999999999,"5min":0.40500000000000003,"15min":0.39700000000000002},"max":{"1min":0.92800000000000005,"5min":0.98299999999999998,"15min":1.0209999999999999},"last":0.47399999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.61499999999999999},"min":{"1min":0.45900000000000002,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.89300000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.497,"5min":0.46000000000000002,"15min":0.435},"max":{"1min":0.95299999999999996,"5min":0.98299999999999998,"15min":1.054},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69999999999999996,"15min":0.67900000000000005},"min":{"1min":0.48199999999999998,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":0.996,"5min":1.079,"15min":1.079},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70299999999999996,"15min":0.69099999999999995},"min":{"1min":0.51900000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97199999999999998,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.61599999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509663,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50596,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321244,"statfs":{"total":96636764160,"available":96584953856,"internally_reserved":0,"allocated":1536000,"data_stored":772276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67800000000000005,"15min":0.71199999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35699999999999998},"max":{"1min":0.98799999999999999,"5min":1,"15min":1.8779999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70599999999999996,"15min":0.71799999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.95799999999999996,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.57499999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67300000000000004,"15min":0.70299999999999996},"min":{"1min":0.49199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90700000000000003,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.621},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68799999999999994,"15min":0.72499999999999998},"min":{"1min":0.441,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92500000000000004,"5min":0.94399999999999995,"15min":1.617},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.52600000000000002,"5min":0.45100000000000001,"15min":0.33600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71099999999999997,"15min":0.74199999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.377},"max":{"1min":0.94499999999999995,"5min":1.073,"15min":1.512},"last":0.71599999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.44800000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.472},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.754,"15min":0.78800000000000003},"min":{"1min":0.628,"5min":0.496,"15min":0.496},"max":{"1min":0.92200000000000004,"5min":1.022,"15min":1.556},"last":0.78500000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57299999999999995,"15min":0.56499999999999995},"min":{"1min":0.37,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.88900000000000001,"15min":0.96999999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71599999999999997,"15min":0.69499999999999995},"min":{"1min":0.53400000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.92400000000000004,"5min":1.012,"15min":1.038},"last":0.90900000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.47999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.76000000000000001,"5min":0.95499999999999996,"15min":1.0049999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63700000000000001,"15min":0.61499999999999999},"min":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.40000000000000002},"max":{"1min":0.84899999999999998,"5min":0.93799999999999994,"15min":1.02},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.69199999999999995,"15min":0.65400000000000003},"min":{"1min":0.51900000000000002,"5min":0.40999999999999998,"15min":0.374},"max":{"1min":0.97599999999999998,"5min":1.042,"15min":1.042},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.755,"15min":0.73199999999999998},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.96899999999999997,"5min":0.999,"15min":1.7390000000000001},"last":0.88300000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509664,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1536000,"data_stored":772276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.71799999999999997,"15min":0.74399999999999999},"min":{"1min":0.56499999999999995,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":0.98299999999999998,"5min":0.99399999999999999,"15min":1.0429999999999999},"last":0.501},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.59899999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.59699999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.51300000000000001,"5min":0.442,"15min":0.39400000000000002},"max":{"1min":0.97799999999999998,"5min":1.002,"15min":1.002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68200000000000005,"15min":0.70199999999999996},"min":{"1min":0.57999999999999996,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.877,"5min":0.93000000000000005,"15min":1.016},"last":0.44400000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73099999999999998,"15min":0.76000000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.371},"max":{"1min":1.0169999999999999,"5min":1.048,"15min":1.048},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.751,"15min":0.76700000000000002},"min":{"1min":0.61099999999999999,"5min":0.47699999999999998,"15min":0.33000000000000002},"max":{"1min":0.99199999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.57499999999999996,"5min":0.47199999999999998,"15min":0.40100000000000002},"max":{"1min":0.94599999999999995,"5min":0.97999999999999998,"15min":1.026},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76900000000000002,"15min":0.78300000000000003},"min":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.47999999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60299999999999998,"15min":0.58199999999999996},"min":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.629},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.38800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83999999999999997,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.38500000000000001},"max":{"1min":0.92800000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.53000000000000003,"5min":0.438,"15min":0.41599999999999998},"max":{"1min":0.95799999999999996,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65800000000000003,"15min":0.65200000000000002},"min":{"1min":0.497,"5min":0.45500000000000002,"15min":0.39200000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.0429999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.52200000000000002,"5min":0.46400000000000002,"15min":0.45300000000000001},"max":{"1min":0.874,"5min":1.101,"15min":1.135},"last":0.71699999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509663,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1512,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1548288,"data_stored":778948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47699999999999998,"15min":0.47899999999999998},"min":{"1min":0.30199999999999999,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.379},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.755,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46700000000000003,"15min":0.47999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72199999999999998,"5min":0.754,"15min":0.83499999999999996},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.29999999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82199999999999995,"5min":0.82599999999999996,"15min":0.90100000000000002},"last":0.52000000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81000000000000005,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.503},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.59999999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.99199999999999999},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.55400000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.052,"5min":1.093,"15min":1.1279999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.622,"5min":0.442,"15min":0.442},"max":{"1min":1.0580000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.84599999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76300000000000001,"15min":0.77400000000000002},"min":{"1min":0.53300000000000003,"5min":0.501,"15min":0.48999999999999999},"max":{"1min":1.002,"5min":1.0669999999999999,"15min":1.137},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77100000000000002,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.51300000000000001,"15min":0.42899999999999999},"max":{"1min":1.079,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.78800000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.63,"5min":0.51700000000000002,"15min":0.47399999999999998},"max":{"1min":1.0649999999999999,"5min":1.0680000000000001,"15min":1.169},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76700000000000002,"15min":0.77400000000000002},"min":{"1min":0.48199999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.03,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.754}]},{"osd":7,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.63900000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.083,"5min":1.087,"15min":1.099},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.82699999999999996,"15min":0.83199999999999996},"min":{"1min":0.67200000000000004,"5min":0.55200000000000005,"15min":0.48599999999999999},"max":{"1min":1.0980000000000001,"5min":1.623,"15min":1.623},"last":0.77400000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509665,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54704,"kb_used_data":1512,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317136,"statfs":{"total":96636764160,"available":96580747264,"internally_reserved":0,"allocated":1548288,"data_stored":778948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.438,"15min":0.46400000000000002},"min":{"1min":0.28999999999999998,"5min":0.27200000000000002,"15min":0.23899999999999999},"max":{"1min":0.68200000000000005,"5min":0.75,"15min":0.94199999999999995},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.54300000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.308},"max":{"1min":0.77400000000000002,"5min":0.88300000000000001,"15min":1.0409999999999999},"last":0.36899999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.748,"5min":0.86699999999999999,"15min":0.93999999999999995},"last":0.438},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.41999999999999998,"5min":0.38900000000000001,"15min":0.36099999999999999},"max":{"1min":0.85299999999999998,"5min":1.012,"15min":1.085},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72299999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.56499999999999995},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.81299999999999994,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.74399999999999999,"15min":0.78400000000000003},"min":{"1min":0.48399999999999999,"5min":0.46600000000000003,"15min":0.376},"max":{"1min":0.96699999999999997,"5min":1.2110000000000001,"15min":1.3420000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.78900000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.022,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.52300000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.73899999999999999,"15min":0.78000000000000003},"min":{"1min":0.55900000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.78100000000000003,"15min":0.80900000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.46400000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.3089999999999999},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.75900000000000001,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.499,"15min":0.40300000000000002},"max":{"1min":1.052,"5min":1.536,"15min":1.536},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.76400000000000001,"15min":0.80500000000000005},"min":{"1min":0.60999999999999999,"5min":0.54500000000000004,"15min":0.46200000000000002},"max":{"1min":1.1100000000000001,"5min":1.1339999999999999,"15min":1.2649999999999999},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77700000000000002,"15min":0.81699999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.107,"5min":1.143,"15min":1.214},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.80400000000000005},"min":{"1min":0.54300000000000004,"5min":0.50900000000000001,"15min":0.44700000000000001},"max":{"1min":1.0720000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.61799999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509664,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1536000,"data_stored":772276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.29299999999999998,"5min":0.28299999999999997,"15min":0.22900000000000001},"max":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.84599999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55000000000000004,"15min":0.56399999999999995},"min":{"1min":0.45300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.872},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.49099999999999999,"15min":0.50700000000000001},"min":{"1min":0.36799999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.81000000000000005},"last":0.44},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.41799999999999998,"5min":0.34599999999999997,"15min":0.29099999999999998},"max":{"1min":0.88,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.41799999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57599999999999996,"15min":0.59599999999999997},"min":{"1min":0.47199999999999998,"5min":0.378,"15min":0.33400000000000002},"max":{"1min":0.73399999999999999,"5min":0.81699999999999995,"15min":0.98899999999999999},"last":0.497},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.505,"15min":0.51600000000000001},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":0.70999999999999996,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.47599999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.75900000000000001,"15min":0.77500000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.432},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.625},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.79200000000000004,"15min":0.79800000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.498},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.74199999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.76500000000000001,"15min":0.78300000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.41899999999999998},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.79700000000000004,"15min":0.80000000000000004},"min":{"1min":0.65100000000000002,"5min":0.51500000000000001,"15min":0.376},"max":{"1min":1.276,"5min":1.276,"15min":1.2849999999999999},"last":0.75800000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.79300000000000004,"15min":0.81000000000000005},"min":{"1min":0.65500000000000003,"5min":0.53000000000000003,"15min":0.47899999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.23},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.77700000000000002,"15min":0.79000000000000004},"min":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.46500000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.3240000000000001},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.80000000000000004,"15min":0.81200000000000006},"min":{"1min":0.57899999999999996,"5min":0.53800000000000003,"15min":0.49199999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3149999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80000000000000004,"15min":0.80700000000000005},"min":{"1min":0.55600000000000005,"5min":0.55500000000000005,"15min":0.45700000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.3380000000000001},"last":0.58299999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509666,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37236,"kb_used_data":2092,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334604,"statfs":{"total":96636764160,"available":96598634496,"internally_reserved":0,"allocated":2142208,"data_stored":1369316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46999999999999997,"15min":0.46899999999999997},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.26600000000000001},"max":{"1min":0.70399999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.375},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.629}]},{"osd":2,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.42099999999999999,"5min":0.32400000000000001,"15min":0.29799999999999999},"max":{"1min":0.82599999999999996,"5min":0.871,"15min":1.3680000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.504,"5min":0.49299999999999999,"15min":0.51700000000000002},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.32600000000000001},"max":{"1min":0.68200000000000005,"5min":0.76700000000000002,"15min":0.871},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57299999999999995,"15min":0.58999999999999997},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.33700000000000002},"max":{"1min":0.745,"5min":1.038,"15min":1.038},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.79900000000000004,"15min":0.78400000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.45200000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.3009999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.80500000000000005,"15min":0.80200000000000005},"min":{"1min":0.54500000000000004,"5min":0.505,"15min":0.44600000000000001},"max":{"1min":1.278,"5min":1.278,"15min":1.423},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78200000000000003,"15min":0.77900000000000003},"min":{"1min":0.56799999999999995,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.0229999999999999,"5min":1.1020000000000001,"15min":1.2669999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81000000000000005,"15min":0.80800000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.39600000000000002},"max":{"1min":1.1950000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.48899999999999999},"max":{"1min":1.054,"5min":1.27,"15min":1.27},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.81100000000000005,"15min":0.81799999999999995},"min":{"1min":0.64300000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.333},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.60099999999999998,"5min":0.54300000000000004,"15min":0.53100000000000003},"max":{"1min":1.121,"5min":1.159,"15min":1.2310000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.80800000000000005,"15min":0.82799999999999996},"min":{"1min":0.55600000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.109,"5min":1.1930000000000001,"15min":1.369},"last":0.60699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:37:26.639 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:37:26.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.773+0000 7fed6309c640 1 Processor -- start 2023-07-21T22:37:26.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.773+0000 7fed6309c640 1 -- start start 2023-07-21T22:37:26.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.773+0000 7fed6309c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fed5c158ce0 0x7fed5c070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:26.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.777+0000 7fed6309c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed5c0c9730 0x7fed5c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:26.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.777+0000 7fed6309c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5c0cc700 con 0x7fed5c0c8ad0 2023-07-21T22:37:26.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.777+0000 7fed6309c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5c0b0ff0 con 0x7fed5c0c9730 2023-07-21T22:37:26.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.777+0000 7fed6309c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5c070c80 con 0x7fed5c158ce0 2023-07-21T22:37:26.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.777+0000 7fed61639640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed5c0c9730 0x7fed5c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:26.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.777+0000 7fed5bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fed5c0c8ad0 0x7fed5c0c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53146/0 (socket says 172.21.15.6:53146) 2023-07-21T22:37:26.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.777+0000 7fed5bfff640 1 -- 172.21.15.6:0/385277013 learned_addr learned my addr 172.21.15.6:0/385277013 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:26.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.777+0000 7fed60e38640 1 --2- 172.21.15.6:0/385277013 >> v2:172.21.15.161:3300/0 conn(0x7fed5c158ce0 0x7fed5c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:26.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.777+0000 7fed61639640 1 -- 172.21.15.6:0/385277013 >> v2:172.21.15.161:3300/0 conn(0x7fed5c158ce0 msgr2=0x7fed5c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:26.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.777+0000 7fed61639640 1 --2- 172.21.15.6:0/385277013 >> v2:172.21.15.161:3300/0 conn(0x7fed5c158ce0 0x7fed5c070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.777+0000 7fed61639640 1 -- 172.21.15.6:0/385277013 >> v1:172.21.15.6:6789/0 conn(0x7fed5c0c8ad0 legacy=0x7fed5c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:26.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.777+0000 7fed61639640 1 -- 172.21.15.6:0/385277013 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c0cbdd0 con 0x7fed5c0c9730 2023-07-21T22:37:26.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.777+0000 7fed61639640 1 --2- 172.21.15.6:0/385277013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed5c0c9730 0x7fed5c0ccb90 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fed5c071be0 tx=0x7fed5401c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52420b5d12e93adb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:26.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.777+0000 7fed5b7fe640 1 -- 172.21.15.6:0/385277013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540a5790 con 0x7fed5c0c9730 2023-07-21T22:37:26.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.777+0000 7fed5b7fe640 1 -- 172.21.15.6:0/385277013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed540a58f0 con 0x7fed5c0c9730 2023-07-21T22:37:26.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.781+0000 7fed5b7fe640 1 -- 172.21.15.6:0/385277013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540a5c80 con 0x7fed5c0c9730 2023-07-21T22:37:26.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.781+0000 7fed6309c640 1 -- 172.21.15.6:0/385277013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed5c0c9730 msgr2=0x7fed5c0ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.781+0000 7fed6309c640 1 --2- 172.21.15.6:0/385277013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed5c0c9730 0x7fed5c0ccb90 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fed5c071be0 tx=0x7fed5401c7c0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.781+0000 7fed6309c640 1 -- 172.21.15.6:0/385277013 shutdown_connections 2023-07-21T22:37:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.781+0000 7fed6309c640 1 --2- 172.21.15.6:0/385277013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed5c0c9730 0x7fed5c0ccb90 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.781+0000 7fed6309c640 1 --2- 172.21.15.6:0/385277013 >> v2:172.21.15.161:3300/0 conn(0x7fed5c158ce0 0x7fed5c070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.781+0000 7fed6309c640 1 -- 172.21.15.6:0/385277013 >> 172.21.15.6:0/385277013 conn(0x7fed5c0afcf0 msgr2=0x7fed5c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.781+0000 7fed6309c640 1 -- 172.21.15.6:0/385277013 shutdown_connections 2023-07-21T22:37:26.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.781+0000 7fed6309c640 1 -- 172.21.15.6:0/385277013 wait complete. 2023-07-21T22:37:26.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.781+0000 7fed6309c640 1 Processor -- start 2023-07-21T22:37:26.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.781+0000 7fed6309c640 1 -- start start 2023-07-21T22:37:26.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.781+0000 7fed6309c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed5c0c8ad0 0x7fed5c149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:26.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.781+0000 7fed6309c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed5c0c9730 0x7fed5c06b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:26.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.781+0000 7fed6309c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed5c158ce0 0x7fed5c06b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:26.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.781+0000 7fed6309c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0c7e50 con 0x7fed5c158ce0 2023-07-21T22:37:26.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.781+0000 7fed6309c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0b40a0 con 0x7fed5c0c8ad0 2023-07-21T22:37:26.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.781+0000 7fed6309c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0c7240 con 0x7fed5c0c9730 2023-07-21T22:37:26.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.781+0000 7fed61639640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed5c158ce0 0x7fed5c06b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:26.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.781+0000 7fed61639640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed5c158ce0 0x7fed5c06b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46874/0 (socket says 172.21.15.6:46874) 2023-07-21T22:37:26.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.781+0000 7fed61639640 1 -- 172.21.15.6:0/2165894194 learned_addr learned my addr 172.21.15.6:0/2165894194 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:26.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.785+0000 7fed60e38640 1 --2- 172.21.15.6:0/2165894194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed5c0c8ad0 0x7fed5c149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:26.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.785+0000 7fed5bfff640 1 --2- 172.21.15.6:0/2165894194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed5c0c9730 0x7fed5c06b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:26.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.785+0000 7fed61639640 1 -- 172.21.15.6:0/2165894194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed5c0c9730 msgr2=0x7fed5c06b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:26.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.785+0000 7fed61639640 1 --2- 172.21.15.6:0/2165894194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed5c0c9730 0x7fed5c06b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.785+0000 7fed61639640 1 -- 172.21.15.6:0/2165894194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed5c0c8ad0 msgr2=0x7fed5c149bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:26.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.785+0000 7fed61639640 1 --2- 172.21.15.6:0/2165894194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed5c0c8ad0 0x7fed5c149bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:26.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.785+0000 7fed61639640 1 -- 172.21.15.6:0/2165894194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed54009a70 con 0x7fed5c158ce0 2023-07-21T22:37:26.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.785+0000 7fed5bfff640 1 --2- 172.21.15.6:0/2165894194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed5c0c9730 0x7fed5c06b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:37:26.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.785+0000 7fed61639640 1 --2- 172.21.15.6:0/2165894194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed5c158ce0 0x7fed5c06b720 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fed540b0040 tx=0x7fed54019560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:26.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.785+0000 7fed597fa640 1 -- 172.21.15.6:0/2165894194 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540b9860 con 0x7fed5c158ce0 2023-07-21T22:37:26.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.785+0000 7fed597fa640 1 -- 172.21.15.6:0/2165894194 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed540b99c0 con 0x7fed5c158ce0 2023-07-21T22:37:26.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.785+0000 7fed597fa640 1 -- 172.21.15.6:0/2165894194 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540b9d70 con 0x7fed5c158ce0 2023-07-21T22:37:26.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.785+0000 7fed6309c640 1 -- 172.21.15.6:0/2165894194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed5c0c7520 con 0x7fed5c158ce0 2023-07-21T22:37:26.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.785+0000 7fed6309c640 1 -- 172.21.15.6:0/2165894194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5c0c7ae0 con 0x7fed5c158ce0 2023-07-21T22:37:26.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.785+0000 7fed6309c640 1 -- 172.21.15.6:0/2165894194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed5c0ca1a0 con 0x7fed5c158ce0 2023-07-21T22:37:26.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.785+0000 7fed597fa640 1 -- 172.21.15.6:0/2165894194 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fed540ad440 con 0x7fed5c158ce0 2023-07-21T22:37:26.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.785+0000 7fed597fa640 1 --2- 172.21.15.6:0/2165894194 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fed400663a0 0x7fed40068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:26.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.785+0000 7fed597fa640 1 -- 172.21.15.6:0/2165894194 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fed5411f1c0 con 0x7fed5c158ce0 2023-07-21T22:37:26.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.789+0000 7fed60e38640 1 --2- 172.21.15.6:0/2165894194 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fed400663a0 0x7fed40068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:26.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.789+0000 7fed60e38640 1 --2- 172.21.15.6:0/2165894194 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fed400663a0 0x7fed40068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fed5000b930 tx=0x7fed50008040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.789+0000 7fed597fa640 1 -- 172.21.15.6:0/2165894194 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed540ec4f0 con 0x7fed5c158ce0 2023-07-21T22:37:26.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.945+0000 7fed6309c640 1 -- 172.21.15.6:0/2165894194 --> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed5c070990 con 0x7fed400663a0 2023-07-21T22:37:26.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.953+0000 7fed597fa640 1 -- 172.21.15.6:0/2165894194 <== mgr.6905 v2:172.21.15.161:6832/1868466946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306310 (secure 0 0 0) 0x7fed5000f860 con 0x7fed400663a0 2023-07-21T22:37:27.002 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:27.003 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:37:27.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.957+0000 7fed6309c640 1 -- 172.21.15.6:0/2165894194 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fed400663a0 msgr2=0x7fed40068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:27.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.957+0000 7fed6309c640 1 --2- 172.21.15.6:0/2165894194 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fed400663a0 0x7fed40068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fed5000b930 tx=0x7fed50008040 comp rx=0 tx=0).stop 2023-07-21T22:37:27.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.957+0000 7fed6309c640 1 -- 172.21.15.6:0/2165894194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed5c158ce0 msgr2=0x7fed5c06b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:27.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.957+0000 7fed6309c640 1 --2- 172.21.15.6:0/2165894194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed5c158ce0 0x7fed5c06b720 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fed540b0040 tx=0x7fed54019560 comp rx=0 tx=0).stop 2023-07-21T22:37:27.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.957+0000 7fed6309c640 1 -- 172.21.15.6:0/2165894194 shutdown_connections 2023-07-21T22:37:27.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.957+0000 7fed6309c640 1 --2- 172.21.15.6:0/2165894194 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fed400663a0 0x7fed40068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.957+0000 7fed6309c640 1 --2- 172.21.15.6:0/2165894194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed5c158ce0 0x7fed5c06b720 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.957+0000 7fed6309c640 1 --2- 172.21.15.6:0/2165894194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed5c0c9730 0x7fed5c06b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.957+0000 7fed6309c640 1 --2- 172.21.15.6:0/2165894194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed5c0c8ad0 0x7fed5c149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.957+0000 7fed6309c640 1 -- 172.21.15.6:0/2165894194 >> 172.21.15.6:0/2165894194 conn(0x7fed5c0afcf0 msgr2=0x7fed5c1509c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:27.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.957+0000 7fed6309c640 1 -- 172.21.15.6:0/2165894194 shutdown_connections 2023-07-21T22:37:27.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:26.957+0000 7fed6309c640 1 -- 172.21.15.6:0/2165894194 wait complete. 2023-07-21T22:37:27.023 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-21T22:37:25.726881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332108,"kb_used_data":13196,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754642612,"statfs":{"total":773094113280,"available":772754034688,"internally_reserved":0,"allocated":13512704,"data_stored":7378960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.674866"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058267+0000","last_change":"2023-07-21T22:37:21.058267+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058267+0000","last_undegraded":"2023-07-21T22:37:21.058267+0000","last_fullsized":"2023-07-21T22:37:21.058267+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.067653+0000","last_change":"2023-07-21T22:37:21.067653+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.067653+0000","last_undegraded":"2023-07-21T22:37:21.067653+0000","last_fullsized":"2023-07-21T22:37:21.067653+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.059237+0000","last_change":"2023-07-21T22:37:21.059237+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.059237+0000","last_undegraded":"2023-07-21T22:37:21.059237+0000","last_fullsized":"2023-07-21T22:37:21.059237+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.063706+0000","last_change":"2023-07-21T22:37:21.063706+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.063706+0000","last_undegraded":"2023-07-21T22:37:21.063706+0000","last_fullsized":"2023-07-21T22:37:21.063706+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.060500+0000","last_change":"2023-07-21T22:37:21.060500+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.060500+0000","last_undegraded":"2023-07-21T22:37:21.060500+0000","last_fullsized":"2023-07-21T22:37:21.060500+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.066890+0000","last_change":"2023-07-21T22:37:21.066890+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.066890+0000","last_undegraded":"2023-07-21T22:37:21.066890+0000","last_fullsized":"2023-07-21T22:37:21.066890+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.068882+0000","last_change":"2023-07-21T22:37:21.068882+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.068882+0000","last_undegraded":"2023-07-21T22:37:21.068882+0000","last_fullsized":"2023-07-21T22:37:21.068882+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.070714+0000","last_change":"2023-07-21T22:37:21.070714+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.070714+0000","last_undegraded":"2023-07-21T22:37:21.070714+0000","last_fullsized":"2023-07-21T22:37:21.070714+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.065404+0000","last_change":"2023-07-21T22:37:21.065404+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.065404+0000","last_undegraded":"2023-07-21T22:37:21.065404+0000","last_fullsized":"2023-07-21T22:37:21.065404+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058481+0000","last_change":"2023-07-21T22:37:21.058481+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058481+0000","last_undegraded":"2023-07-21T22:37:21.058481+0000","last_fullsized":"2023-07-21T22:37:21.058481+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.059138+0000","last_change":"2023-07-21T22:37:21.059138+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.059138+0000","last_undegraded":"2023-07-21T22:37:21.059138+0000","last_fullsized":"2023-07-21T22:37:21.059138+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.064623+0000","last_change":"2023-07-21T22:37:21.064623+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.064623+0000","last_undegraded":"2023-07-21T22:37:21.064623+0000","last_fullsized":"2023-07-21T22:37:21.064623+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.061613+0000","last_change":"2023-07-21T22:37:21.061613+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.061613+0000","last_undegraded":"2023-07-21T22:37:21.061613+0000","last_fullsized":"2023-07-21T22:37:21.061613+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.062767+0000","last_change":"2023-07-21T22:37:21.062767+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.062767+0000","last_undegraded":"2023-07-21T22:37:21.062767+0000","last_fullsized":"2023-07-21T22:37:21.062767+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.063983+0000","last_change":"2023-07-21T22:37:21.063983+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.063983+0000","last_undegraded":"2023-07-21T22:37:21.063983+0000","last_fullsized":"2023-07-21T22:37:21.063983+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.065141+0000","last_change":"2023-07-21T22:37:21.065141+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.065141+0000","last_undegraded":"2023-07-21T22:37:21.065141+0000","last_fullsized":"2023-07-21T22:37:21.065141+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057800+0000","last_change":"2023-07-21T22:37:21.057800+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057800+0000","last_undegraded":"2023-07-21T22:37:21.057800+0000","last_fullsized":"2023-07-21T22:37:21.057800+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.067143+0000","last_change":"2023-07-21T22:37:21.067143+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.067143+0000","last_undegraded":"2023-07-21T22:37:21.067143+0000","last_fullsized":"2023-07-21T22:37:21.067143+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058804+0000","last_change":"2023-07-21T22:37:21.058804+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058804+0000","last_undegraded":"2023-07-21T22:37:21.058804+0000","last_fullsized":"2023-07-21T22:37:21.058804+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.061352+0000","last_change":"2023-07-21T22:37:21.061352+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.061352+0000","last_undegraded":"2023-07-21T22:37:21.061352+0000","last_fullsized":"2023-07-21T22:37:21.061352+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.070641+0000","last_change":"2023-07-21T22:37:21.070641+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.070641+0000","last_undegraded":"2023-07-21T22:37:21.070641+0000","last_fullsized":"2023-07-21T22:37:21.070641+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.059082+0000","last_change":"2023-07-21T22:37:21.059082+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.059082+0000","last_undegraded":"2023-07-21T22:37:21.059082+0000","last_fullsized":"2023-07-21T22:37:21.059082+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057387+0000","last_change":"2023-07-21T22:37:21.057387+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057387+0000","last_undegraded":"2023-07-21T22:37:21.057387+0000","last_fullsized":"2023-07-21T22:37:21.057387+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058500+0000","last_change":"2023-07-21T22:37:21.058500+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058500+0000","last_undegraded":"2023-07-21T22:37:21.058500+0000","last_fullsized":"2023-07-21T22:37:21.058500+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.062184+0000","last_change":"2023-07-21T22:37:21.062184+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.062184+0000","last_undegraded":"2023-07-21T22:37:21.062184+0000","last_fullsized":"2023-07-21T22:37:21.062184+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.060749+0000","last_change":"2023-07-21T22:37:21.060749+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.060749+0000","last_undegraded":"2023-07-21T22:37:21.060749+0000","last_fullsized":"2023-07-21T22:37:21.060749+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057996+0000","last_change":"2023-07-21T22:37:21.057996+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057996+0000","last_undegraded":"2023-07-21T22:37:21.057996+0000","last_fullsized":"2023-07-21T22:37:21.057996+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.071838+0000","last_change":"2023-07-21T22:37:21.071838+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.071838+0000","last_undegraded":"2023-07-21T22:37:21.071838+0000","last_fullsized":"2023-07-21T22:37:21.071838+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.070119+0000","last_change":"2023-07-21T22:37:21.070119+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.070119+0000","last_undegraded":"2023-07-21T22:37:21.070119+0000","last_fullsized":"2023-07-21T22:37:21.070119+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.062274+0000","last_change":"2023-07-21T22:37:21.062274+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.062274+0000","last_undegraded":"2023-07-21T22:37:21.062274+0000","last_fullsized":"2023-07-21T22:37:21.062274+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.068434+0000","last_change":"2023-07-21T22:37:21.068434+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.068434+0000","last_undegraded":"2023-07-21T22:37:21.068434+0000","last_fullsized":"2023-07-21T22:37:21.068434+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.070220+0000","last_change":"2023-07-21T22:37:21.070220+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.070220+0000","last_undegraded":"2023-07-21T22:37:21.070220+0000","last_fullsized":"2023-07-21T22:37:21.070220+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057977+0000","last_change":"2023-07-21T22:37:21.057977+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057977+0000","last_undegraded":"2023-07-21T22:37:21.057977+0000","last_fullsized":"2023-07-21T22:37:21.057977+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.081540+0000","last_change":"2023-07-21T22:37:21.077330+0000","last_active":"2023-07-21T22:37:21.081540+0000","last_peered":"2023-07-21T22:37:21.081540+0000","last_clean":"2023-07-21T22:37:21.081540+0000","last_became_active":"2023-07-21T22:37:21.077027+0000","last_became_peered":"2023-07-21T22:37:21.077027+0000","last_unstale":"2023-07-21T22:37:21.081540+0000","last_undegraded":"2023-07-21T22:37:21.081540+0000","last_fullsized":"2023-07-21T22:37:21.081540+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:09:20.713834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.071547+0000","last_change":"2023-07-21T22:37:21.071547+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.071547+0000","last_undegraded":"2023-07-21T22:37:21.071547+0000","last_fullsized":"2023-07-21T22:37:21.071547+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082163+0000","last_change":"2023-07-21T22:37:21.078917+0000","last_active":"2023-07-21T22:37:21.082163+0000","last_peered":"2023-07-21T22:37:21.082163+0000","last_clean":"2023-07-21T22:37:21.082163+0000","last_became_active":"2023-07-21T22:37:21.078582+0000","last_became_peered":"2023-07-21T22:37:21.078582+0000","last_unstale":"2023-07-21T22:37:21.082163+0000","last_undegraded":"2023-07-21T22:37:21.082163+0000","last_fullsized":"2023-07-21T22:37:21.082163+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:44:59.850746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.061787+0000","last_change":"2023-07-21T22:37:21.061787+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.061787+0000","last_undegraded":"2023-07-21T22:37:21.061787+0000","last_fullsized":"2023-07-21T22:37:21.061787+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.077531+0000","last_change":"2023-07-21T22:37:21.071615+0000","last_active":"2023-07-21T22:37:21.077531+0000","last_peered":"2023-07-21T22:37:21.077531+0000","last_clean":"2023-07-21T22:37:21.077531+0000","last_became_active":"2023-07-21T22:37:21.071287+0000","last_became_peered":"2023-07-21T22:37:21.071287+0000","last_unstale":"2023-07-21T22:37:21.077531+0000","last_undegraded":"2023-07-21T22:37:21.077531+0000","last_fullsized":"2023-07-21T22:37:21.077531+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:16:18.946381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058462+0000","last_change":"2023-07-21T22:37:21.058462+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058462+0000","last_undegraded":"2023-07-21T22:37:21.058462+0000","last_fullsized":"2023-07-21T22:37:21.058462+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.067653+0000","last_change":"2023-07-21T22:37:21.063348+0000","last_active":"2023-07-21T22:37:21.067653+0000","last_peered":"2023-07-21T22:37:21.067653+0000","last_clean":"2023-07-21T22:37:21.067653+0000","last_became_active":"2023-07-21T22:37:21.062717+0000","last_became_peered":"2023-07-21T22:37:21.062717+0000","last_unstale":"2023-07-21T22:37:21.067653+0000","last_undegraded":"2023-07-21T22:37:21.067653+0000","last_fullsized":"2023-07-21T22:37:21.067653+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:52.156305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.060345+0000","last_change":"2023-07-21T22:37:21.060345+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.060345+0000","last_undegraded":"2023-07-21T22:37:21.060345+0000","last_fullsized":"2023-07-21T22:37:21.060345+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.080074+0000","last_change":"2023-07-21T22:37:21.078218+0000","last_active":"2023-07-21T22:37:21.080074+0000","last_peered":"2023-07-21T22:37:21.080074+0000","last_clean":"2023-07-21T22:37:21.080074+0000","last_became_active":"2023-07-21T22:37:21.077942+0000","last_became_peered":"2023-07-21T22:37:21.077942+0000","last_unstale":"2023-07-21T22:37:21.080074+0000","last_undegraded":"2023-07-21T22:37:21.080074+0000","last_fullsized":"2023-07-21T22:37:21.080074+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:44:27.641511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057756+0000","last_change":"2023-07-21T22:37:21.057756+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057756+0000","last_undegraded":"2023-07-21T22:37:21.057756+0000","last_fullsized":"2023-07-21T22:37:21.057756+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.074755+0000","last_change":"2023-07-21T22:37:21.072265+0000","last_active":"2023-07-21T22:37:21.074755+0000","last_peered":"2023-07-21T22:37:21.074755+0000","last_clean":"2023-07-21T22:37:21.074755+0000","last_became_active":"2023-07-21T22:37:21.071996+0000","last_became_peered":"2023-07-21T22:37:21.071996+0000","last_unstale":"2023-07-21T22:37:21.074755+0000","last_undegraded":"2023-07-21T22:37:21.074755+0000","last_fullsized":"2023-07-21T22:37:21.074755+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:12:15.936040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.065241+0000","last_change":"2023-07-21T22:37:21.065241+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.065241+0000","last_undegraded":"2023-07-21T22:37:21.065241+0000","last_fullsized":"2023-07-21T22:37:21.065241+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.078460+0000","last_change":"2023-07-21T22:37:21.070105+0000","last_active":"2023-07-21T22:37:21.078460+0000","last_peered":"2023-07-21T22:37:21.078460+0000","last_clean":"2023-07-21T22:37:21.078460+0000","last_became_active":"2023-07-21T22:37:21.069728+0000","last_became_peered":"2023-07-21T22:37:21.069728+0000","last_unstale":"2023-07-21T22:37:21.078460+0000","last_undegraded":"2023-07-21T22:37:21.078460+0000","last_fullsized":"2023-07-21T22:37:21.078460+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:05:08.970742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.060058+0000","last_change":"2023-07-21T22:37:21.060058+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.060058+0000","last_undegraded":"2023-07-21T22:37:21.060058+0000","last_fullsized":"2023-07-21T22:37:21.060058+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.072074+0000","last_change":"2023-07-21T22:37:21.068302+0000","last_active":"2023-07-21T22:37:21.072074+0000","last_peered":"2023-07-21T22:37:21.072074+0000","last_clean":"2023-07-21T22:37:21.072074+0000","last_became_active":"2023-07-21T22:37:21.068014+0000","last_became_peered":"2023-07-21T22:37:21.068014+0000","last_unstale":"2023-07-21T22:37:21.072074+0000","last_undegraded":"2023-07-21T22:37:21.072074+0000","last_fullsized":"2023-07-21T22:37:21.072074+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:49:08.508129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058492+0000","last_change":"2023-07-21T22:37:21.058492+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058492+0000","last_undegraded":"2023-07-21T22:37:21.058492+0000","last_fullsized":"2023-07-21T22:37:21.058492+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.078647+0000","last_change":"2023-07-21T22:37:21.072005+0000","last_active":"2023-07-21T22:37:21.078647+0000","last_peered":"2023-07-21T22:37:21.078647+0000","last_clean":"2023-07-21T22:37:21.078647+0000","last_became_active":"2023-07-21T22:37:21.071724+0000","last_became_peered":"2023-07-21T22:37:21.071724+0000","last_unstale":"2023-07-21T22:37:21.078647+0000","last_undegraded":"2023-07-21T22:37:21.078647+0000","last_fullsized":"2023-07-21T22:37:21.078647+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:26.355327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058561+0000","last_change":"2023-07-21T22:37:21.058561+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058561+0000","last_undegraded":"2023-07-21T22:37:21.058561+0000","last_fullsized":"2023-07-21T22:37:21.058561+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.074611+0000","last_change":"2023-07-21T22:37:21.071932+0000","last_active":"2023-07-21T22:37:21.074611+0000","last_peered":"2023-07-21T22:37:21.074611+0000","last_clean":"2023-07-21T22:37:21.074611+0000","last_became_active":"2023-07-21T22:37:21.071545+0000","last_became_peered":"2023-07-21T22:37:21.071545+0000","last_unstale":"2023-07-21T22:37:21.074611+0000","last_undegraded":"2023-07-21T22:37:21.074611+0000","last_fullsized":"2023-07-21T22:37:21.074611+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:57:21.999160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.071163+0000","last_change":"2023-07-21T22:37:21.071163+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.071163+0000","last_undegraded":"2023-07-21T22:37:21.071163+0000","last_fullsized":"2023-07-21T22:37:21.071163+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.076282+0000","last_change":"2023-07-21T22:37:21.074517+0000","last_active":"2023-07-21T22:37:21.076282+0000","last_peered":"2023-07-21T22:37:21.076282+0000","last_clean":"2023-07-21T22:37:21.076282+0000","last_became_active":"2023-07-21T22:37:21.074054+0000","last_became_peered":"2023-07-21T22:37:21.074054+0000","last_unstale":"2023-07-21T22:37:21.076282+0000","last_undegraded":"2023-07-21T22:37:21.076282+0000","last_fullsized":"2023-07-21T22:37:21.076282+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:34:22.370850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.059591+0000","last_change":"2023-07-21T22:37:21.059591+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.059591+0000","last_undegraded":"2023-07-21T22:37:21.059591+0000","last_fullsized":"2023-07-21T22:37:21.059591+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082570+0000","last_change":"2023-07-21T22:37:21.078493+0000","last_active":"2023-07-21T22:37:21.082570+0000","last_peered":"2023-07-21T22:37:21.082570+0000","last_clean":"2023-07-21T22:37:21.082570+0000","last_became_active":"2023-07-21T22:37:21.078199+0000","last_became_peered":"2023-07-21T22:37:21.078199+0000","last_unstale":"2023-07-21T22:37:21.082570+0000","last_undegraded":"2023-07-21T22:37:21.082570+0000","last_fullsized":"2023-07-21T22:37:21.082570+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:52:29.786420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058982+0000","last_change":"2023-07-21T22:37:21.058982+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058982+0000","last_undegraded":"2023-07-21T22:37:21.058982+0000","last_fullsized":"2023-07-21T22:37:21.058982+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.072498+0000","last_change":"2023-07-21T22:37:21.068918+0000","last_active":"2023-07-21T22:37:21.072498+0000","last_peered":"2023-07-21T22:37:21.072498+0000","last_clean":"2023-07-21T22:37:21.072498+0000","last_became_active":"2023-07-21T22:37:21.068632+0000","last_became_peered":"2023-07-21T22:37:21.068632+0000","last_unstale":"2023-07-21T22:37:21.072498+0000","last_undegraded":"2023-07-21T22:37:21.072498+0000","last_fullsized":"2023-07-21T22:37:21.072498+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:45:11.816606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.067540+0000","last_change":"2023-07-21T22:37:21.067540+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.067540+0000","last_undegraded":"2023-07-21T22:37:21.067540+0000","last_fullsized":"2023-07-21T22:37:21.067540+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.070286+0000","last_change":"2023-07-21T22:37:21.066648+0000","last_active":"2023-07-21T22:37:21.070286+0000","last_peered":"2023-07-21T22:37:21.070286+0000","last_clean":"2023-07-21T22:37:21.070286+0000","last_became_active":"2023-07-21T22:37:21.066313+0000","last_became_peered":"2023-07-21T22:37:21.066313+0000","last_unstale":"2023-07-21T22:37:21.070286+0000","last_undegraded":"2023-07-21T22:37:21.070286+0000","last_fullsized":"2023-07-21T22:37:21.070286+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:24:19.351613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.071271+0000","last_change":"2023-07-21T22:37:21.071271+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.071271+0000","last_undegraded":"2023-07-21T22:37:21.071271+0000","last_fullsized":"2023-07-21T22:37:21.071271+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.081885+0000","last_change":"2023-07-21T22:37:21.075668+0000","last_active":"2023-07-21T22:37:21.081885+0000","last_peered":"2023-07-21T22:37:21.081885+0000","last_clean":"2023-07-21T22:37:21.081885+0000","last_became_active":"2023-07-21T22:37:21.075393+0000","last_became_peered":"2023-07-21T22:37:21.075393+0000","last_unstale":"2023-07-21T22:37:21.081885+0000","last_undegraded":"2023-07-21T22:37:21.081885+0000","last_fullsized":"2023-07-21T22:37:21.081885+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:28:21.336083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057315+0000","last_change":"2023-07-21T22:37:21.057315+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057315+0000","last_undegraded":"2023-07-21T22:37:21.057315+0000","last_fullsized":"2023-07-21T22:37:21.057315+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.077525+0000","last_change":"2023-07-21T22:37:21.070598+0000","last_active":"2023-07-21T22:37:21.077525+0000","last_peered":"2023-07-21T22:37:21.077525+0000","last_clean":"2023-07-21T22:37:21.077525+0000","last_became_active":"2023-07-21T22:37:21.069746+0000","last_became_peered":"2023-07-21T22:37:21.069746+0000","last_unstale":"2023-07-21T22:37:21.077525+0000","last_undegraded":"2023-07-21T22:37:21.077525+0000","last_fullsized":"2023-07-21T22:37:21.077525+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:47:57.653894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058924+0000","last_change":"2023-07-21T22:37:21.058924+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058924+0000","last_undegraded":"2023-07-21T22:37:21.058924+0000","last_fullsized":"2023-07-21T22:37:21.058924+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082365+0000","last_change":"2023-07-21T22:37:21.079461+0000","last_active":"2023-07-21T22:37:21.082365+0000","last_peered":"2023-07-21T22:37:21.082365+0000","last_clean":"2023-07-21T22:37:21.082365+0000","last_became_active":"2023-07-21T22:37:21.079152+0000","last_became_peered":"2023-07-21T22:37:21.079152+0000","last_unstale":"2023-07-21T22:37:21.082365+0000","last_undegraded":"2023-07-21T22:37:21.082365+0000","last_fullsized":"2023-07-21T22:37:21.082365+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:13:42.164239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.061261+0000","last_change":"2023-07-21T22:37:21.061261+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.061261+0000","last_undegraded":"2023-07-21T22:37:21.061261+0000","last_fullsized":"2023-07-21T22:37:21.061261+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.073577+0000","last_change":"2023-07-21T22:37:21.066856+0000","last_active":"2023-07-21T22:37:21.073577+0000","last_peered":"2023-07-21T22:37:21.073577+0000","last_clean":"2023-07-21T22:37:21.073577+0000","last_became_active":"2023-07-21T22:37:21.066089+0000","last_became_peered":"2023-07-21T22:37:21.066089+0000","last_unstale":"2023-07-21T22:37:21.073577+0000","last_undegraded":"2023-07-21T22:37:21.073577+0000","last_fullsized":"2023-07-21T22:37:21.073577+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:15.352350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.062480+0000","last_change":"2023-07-21T22:37:21.062480+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.062480+0000","last_undegraded":"2023-07-21T22:37:21.062480+0000","last_fullsized":"2023-07-21T22:37:21.062480+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082518+0000","last_change":"2023-07-21T22:37:21.078173+0000","last_active":"2023-07-21T22:37:21.082518+0000","last_peered":"2023-07-21T22:37:21.082518+0000","last_clean":"2023-07-21T22:37:21.082518+0000","last_became_active":"2023-07-21T22:37:21.077879+0000","last_became_peered":"2023-07-21T22:37:21.077879+0000","last_unstale":"2023-07-21T22:37:21.082518+0000","last_undegraded":"2023-07-21T22:37:21.082518+0000","last_fullsized":"2023-07-21T22:37:21.082518+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:57:03.563418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.059646+0000","last_change":"2023-07-21T22:37:21.059646+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.059646+0000","last_undegraded":"2023-07-21T22:37:21.059646+0000","last_fullsized":"2023-07-21T22:37:21.059646+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.078749+0000","last_change":"2023-07-21T22:37:21.077940+0000","last_active":"2023-07-21T22:37:21.078749+0000","last_peered":"2023-07-21T22:37:21.078749+0000","last_clean":"2023-07-21T22:37:21.078749+0000","last_became_active":"2023-07-21T22:37:21.077593+0000","last_became_peered":"2023-07-21T22:37:21.077593+0000","last_unstale":"2023-07-21T22:37:21.078749+0000","last_undegraded":"2023-07-21T22:37:21.078749+0000","last_fullsized":"2023-07-21T22:37:21.078749+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:21:42.376326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.069756+0000","last_change":"2023-07-21T22:37:21.069756+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.069756+0000","last_undegraded":"2023-07-21T22:37:21.069756+0000","last_fullsized":"2023-07-21T22:37:21.069756+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.079004+0000","last_change":"2023-07-21T22:37:21.075547+0000","last_active":"2023-07-21T22:37:21.079004+0000","last_peered":"2023-07-21T22:37:21.079004+0000","last_clean":"2023-07-21T22:37:21.079004+0000","last_became_active":"2023-07-21T22:37:21.075261+0000","last_became_peered":"2023-07-21T22:37:21.075261+0000","last_unstale":"2023-07-21T22:37:21.079004+0000","last_undegraded":"2023-07-21T22:37:21.079004+0000","last_fullsized":"2023-07-21T22:37:21.079004+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:33.794471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.069735+0000","last_change":"2023-07-21T22:37:21.069735+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.069735+0000","last_undegraded":"2023-07-21T22:37:21.069735+0000","last_fullsized":"2023-07-21T22:37:21.069735+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.081837+0000","last_change":"2023-07-21T22:37:21.076789+0000","last_active":"2023-07-21T22:37:21.081837+0000","last_peered":"2023-07-21T22:37:21.081837+0000","last_clean":"2023-07-21T22:37:21.081837+0000","last_became_active":"2023-07-21T22:37:21.076497+0000","last_became_peered":"2023-07-21T22:37:21.076497+0000","last_unstale":"2023-07-21T22:37:21.081837+0000","last_undegraded":"2023-07-21T22:37:21.081837+0000","last_fullsized":"2023-07-21T22:37:21.081837+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:23:52.304154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.062405+0000","last_change":"2023-07-21T22:37:21.062405+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.062405+0000","last_undegraded":"2023-07-21T22:37:21.062405+0000","last_fullsized":"2023-07-21T22:37:21.062405+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.083436+0000","last_change":"2023-07-21T22:37:21.079413+0000","last_active":"2023-07-21T22:37:21.083436+0000","last_peered":"2023-07-21T22:37:21.083436+0000","last_clean":"2023-07-21T22:37:21.083436+0000","last_became_active":"2023-07-21T22:37:21.079087+0000","last_became_peered":"2023-07-21T22:37:21.079087+0000","last_unstale":"2023-07-21T22:37:21.083436+0000","last_undegraded":"2023-07-21T22:37:21.083436+0000","last_fullsized":"2023-07-21T22:37:21.083436+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:59:42.462195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058560+0000","last_change":"2023-07-21T22:37:21.058560+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058560+0000","last_undegraded":"2023-07-21T22:37:21.058560+0000","last_fullsized":"2023-07-21T22:37:21.058560+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.081845+0000","last_change":"2023-07-21T22:37:21.075785+0000","last_active":"2023-07-21T22:37:21.081845+0000","last_peered":"2023-07-21T22:37:21.081845+0000","last_clean":"2023-07-21T22:37:21.081845+0000","last_became_active":"2023-07-21T22:37:21.075437+0000","last_became_peered":"2023-07-21T22:37:21.075437+0000","last_unstale":"2023-07-21T22:37:21.081845+0000","last_undegraded":"2023-07-21T22:37:21.081845+0000","last_fullsized":"2023-07-21T22:37:21.081845+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:06:15.022660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.057994+0000","last_change":"2023-07-21T22:37:21.057994+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.057994+0000","last_undegraded":"2023-07-21T22:37:21.057994+0000","last_fullsized":"2023-07-21T22:37:21.057994+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082187+0000","last_change":"2023-07-21T22:37:21.079237+0000","last_active":"2023-07-21T22:37:21.082187+0000","last_peered":"2023-07-21T22:37:21.082187+0000","last_clean":"2023-07-21T22:37:21.082187+0000","last_became_active":"2023-07-21T22:37:21.078935+0000","last_became_peered":"2023-07-21T22:37:21.078935+0000","last_unstale":"2023-07-21T22:37:21.082187+0000","last_undegraded":"2023-07-21T22:37:21.082187+0000","last_fullsized":"2023-07-21T22:37:21.082187+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:24.190628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"116'227","reported_seq":748,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.065586+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:37:21.065586+0000","last_peered":"2023-07-21T22:37:21.065586+0000","last_clean":"2023-07-21T22:37:21.065586+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:37:21.065586+0000","last_undegraded":"2023-07-21T22:37:21.065586+0000","last_fullsized":"2023-07-21T22:37:21.065586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:51:00.701474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":219,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.061363+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:37:21.061363+0000","last_peered":"2023-07-21T22:37:21.061363+0000","last_clean":"2023-07-21T22:37:21.061363+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:37:21.061363+0000","last_undegraded":"2023-07-21T22:37:21.061363+0000","last_fullsized":"2023-07-21T22:37:21.061363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:35:00.619996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.064431+0000","last_change":"2023-07-21T22:37:21.064431+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.064431+0000","last_undegraded":"2023-07-21T22:37:21.064431+0000","last_fullsized":"2023-07-21T22:37:21.064431+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.077071+0000","last_change":"2023-07-21T22:37:21.075739+0000","last_active":"2023-07-21T22:37:21.077071+0000","last_peered":"2023-07-21T22:37:21.077071+0000","last_clean":"2023-07-21T22:37:21.077071+0000","last_became_active":"2023-07-21T22:37:21.075418+0000","last_became_peered":"2023-07-21T22:37:21.075418+0000","last_unstale":"2023-07-21T22:37:21.077071+0000","last_undegraded":"2023-07-21T22:37:21.077071+0000","last_fullsized":"2023-07-21T22:37:21.077071+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:31:34.885110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":202,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.065449+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:37:21.065449+0000","last_peered":"2023-07-21T22:37:21.065449+0000","last_clean":"2023-07-21T22:37:21.065449+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:37:21.065449+0000","last_undegraded":"2023-07-21T22:37:21.065449+0000","last_fullsized":"2023-07-21T22:37:21.065449+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:33:54.469018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.060048+0000","last_change":"2023-07-21T22:37:21.060048+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.060048+0000","last_undegraded":"2023-07-21T22:37:21.060048+0000","last_fullsized":"2023-07-21T22:37:21.060048+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.080805+0000","last_change":"2023-07-21T22:37:21.079660+0000","last_active":"2023-07-21T22:37:21.080805+0000","last_peered":"2023-07-21T22:37:21.080805+0000","last_clean":"2023-07-21T22:37:21.080805+0000","last_became_active":"2023-07-21T22:37:21.079340+0000","last_became_peered":"2023-07-21T22:37:21.079340+0000","last_unstale":"2023-07-21T22:37:21.080805+0000","last_undegraded":"2023-07-21T22:37:21.080805+0000","last_fullsized":"2023-07-21T22:37:21.080805+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:18:13.008438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":200,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.067659+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:37:21.067659+0000","last_peered":"2023-07-21T22:37:21.067659+0000","last_clean":"2023-07-21T22:37:21.067659+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:37:21.067659+0000","last_undegraded":"2023-07-21T22:37:21.067659+0000","last_fullsized":"2023-07-21T22:37:21.067659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:38:48.649472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.069672+0000","last_change":"2023-07-21T22:37:21.069672+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.069672+0000","last_undegraded":"2023-07-21T22:37:21.069672+0000","last_fullsized":"2023-07-21T22:37:21.069672+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082683+0000","last_change":"2023-07-21T22:37:21.078854+0000","last_active":"2023-07-21T22:37:21.082683+0000","last_peered":"2023-07-21T22:37:21.082683+0000","last_clean":"2023-07-21T22:37:21.082683+0000","last_became_active":"2023-07-21T22:37:21.078575+0000","last_became_peered":"2023-07-21T22:37:21.078575+0000","last_unstale":"2023-07-21T22:37:21.082683+0000","last_undegraded":"2023-07-21T22:37:21.082683+0000","last_fullsized":"2023-07-21T22:37:21.082683+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:48:15.816878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":219,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.060250+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:37:21.060250+0000","last_peered":"2023-07-21T22:37:21.060250+0000","last_clean":"2023-07-21T22:37:21.060250+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:37:21.060250+0000","last_undegraded":"2023-07-21T22:37:21.060250+0000","last_fullsized":"2023-07-21T22:37:21.060250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:40:37.271851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.060963+0000","last_change":"2023-07-21T22:37:21.060963+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.060963+0000","last_undegraded":"2023-07-21T22:37:21.060963+0000","last_fullsized":"2023-07-21T22:37:21.060963+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.082654+0000","last_change":"2023-07-21T22:37:21.078876+0000","last_active":"2023-07-21T22:37:21.082654+0000","last_peered":"2023-07-21T22:37:21.082654+0000","last_clean":"2023-07-21T22:37:21.082654+0000","last_became_active":"2023-07-21T22:37:21.078596+0000","last_became_peered":"2023-07-21T22:37:21.078596+0000","last_unstale":"2023-07-21T22:37:21.082654+0000","last_undegraded":"2023-07-21T22:37:21.082654+0000","last_fullsized":"2023-07-21T22:37:21.082654+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:45:12.152065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":211,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.053262+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:37:21.053262+0000","last_peered":"2023-07-21T22:37:21.053262+0000","last_clean":"2023-07-21T22:37:21.053262+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:37:21.053262+0000","last_undegraded":"2023-07-21T22:37:21.053262+0000","last_fullsized":"2023-07-21T22:37:21.053262+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:24:28.113597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.069611+0000","last_change":"2023-07-21T22:37:21.069611+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.069611+0000","last_undegraded":"2023-07-21T22:37:21.069611+0000","last_fullsized":"2023-07-21T22:37:21.069611+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.081821+0000","last_change":"2023-07-21T22:37:21.075411+0000","last_active":"2023-07-21T22:37:21.081821+0000","last_peered":"2023-07-21T22:37:21.081821+0000","last_clean":"2023-07-21T22:37:21.081821+0000","last_became_active":"2023-07-21T22:37:21.075095+0000","last_became_peered":"2023-07-21T22:37:21.075095+0000","last_unstale":"2023-07-21T22:37:21.081821+0000","last_undegraded":"2023-07-21T22:37:21.081821+0000","last_fullsized":"2023-07-21T22:37:21.081821+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:39:38.877282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":201,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.064309+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:37:21.064309+0000","last_peered":"2023-07-21T22:37:21.064309+0000","last_clean":"2023-07-21T22:37:21.064309+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:37:21.064309+0000","last_undegraded":"2023-07-21T22:37:21.064309+0000","last_fullsized":"2023-07-21T22:37:21.064309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:32:33.263928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.061200+0000","last_change":"2023-07-21T22:37:21.061200+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.061200+0000","last_undegraded":"2023-07-21T22:37:21.061200+0000","last_fullsized":"2023-07-21T22:37:21.061200+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.081775+0000","last_change":"2023-07-21T22:37:21.075461+0000","last_active":"2023-07-21T22:37:21.081775+0000","last_peered":"2023-07-21T22:37:21.081775+0000","last_clean":"2023-07-21T22:37:21.081775+0000","last_became_active":"2023-07-21T22:37:21.075125+0000","last_became_peered":"2023-07-21T22:37:21.075125+0000","last_unstale":"2023-07-21T22:37:21.081775+0000","last_undegraded":"2023-07-21T22:37:21.081775+0000","last_fullsized":"2023-07-21T22:37:21.081775+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:11:04.198665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":211,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.052916+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:37:21.052916+0000","last_peered":"2023-07-21T22:37:21.052916+0000","last_clean":"2023-07-21T22:37:21.052916+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:37:21.052916+0000","last_undegraded":"2023-07-21T22:37:21.052916+0000","last_fullsized":"2023-07-21T22:37:21.052916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:43:51.528257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2023-07-21T22:37:21.058355+0000","last_change":"2023-07-21T22:37:21.058355+0000","last_active":"2023-07-21T22:37:21.046551+0000","last_peered":"2023-07-21T22:37:21.046551+0000","last_clean":"2023-07-21T22:37:21.046551+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:37:21.058355+0000","last_undegraded":"2023-07-21T22:37:21.058355+0000","last_fullsized":"2023-07-21T22:37:21.058355+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.079054+0000","last_change":"2023-07-21T22:37:21.073046+0000","last_active":"2023-07-21T22:37:21.079054+0000","last_peered":"2023-07-21T22:37:21.079054+0000","last_clean":"2023-07-21T22:37:21.079054+0000","last_became_active":"2023-07-21T22:37:21.072789+0000","last_became_peered":"2023-07-21T22:37:21.072789+0000","last_unstale":"2023-07-21T22:37:21.079054+0000","last_undegraded":"2023-07-21T22:37:21.079054+0000","last_fullsized":"2023-07-21T22:37:21.079054+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:38:11.812192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":197,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-07-21T22:37:21.072728+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:37:21.072728+0000","last_peered":"2023-07-21T22:37:21.072728+0000","last_clean":"2023-07-21T22:37:21.072728+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:37:21.072728+0000","last_undegraded":"2023-07-21T22:37:21.072728+0000","last_fullsized":"2023-07-21T22:37:21.072728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:23:55.856237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509664,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59368,"kb_used_data":2080,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312472,"statfs":{"total":96636764160,"available":96575971328,"internally_reserved":0,"allocated":2129920,"data_stored":1362644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.63,"5min":0.42599999999999999,"15min":0.35299999999999998},"max":{"1min":0.95199999999999996,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.625},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69599999999999995,"15min":0.69699999999999995},"min":{"1min":0.54500000000000004,"5min":0.40899999999999997,"15min":0.39500000000000002},"max":{"1min":0.82599999999999996,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.52600000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70899999999999996,"15min":0.72999999999999998},"min":{"1min":0.52700000000000002,"5min":0.44900000000000001,"15min":0.432},"max":{"1min":0.92400000000000004,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.69599999999999995,"15min":0.71499999999999997},"min":{"1min":0.497,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.873,"5min":1.093,"15min":1.093},"last":0.64500000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.501,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.877,"5min":1.1399999999999999,"15min":1.405},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.57399999999999995,"5min":0.47999999999999998,"15min":0.45800000000000002},"max":{"1min":0.88800000000000001,"5min":1.409,"15min":1.409},"last":0.68999999999999995}]},{"osd":3,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.75900000000000001,"15min":0.76500000000000001},"min":{"1min":0.55400000000000005,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95399999999999996,"5min":1.46,"15min":1.46},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.56599999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92900000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.70899999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.42699999999999999,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.66900000000000004,"5min":0.90000000000000002,"15min":0.94999999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.63,"15min":0.61699999999999999},"min":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82699999999999996,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.58399999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64800000000000002,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.85199999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70099999999999996,"15min":0.68000000000000005},"min":{"1min":0.51100000000000001,"5min":0.42499999999999999,"15min":0.38300000000000001},"max":{"1min":0.90900000000000003,"5min":1.506,"15min":1.506},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.53600000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89000000000000001,"5min":1.0329999999999999,"15min":1.048},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.47399999999999998,"5min":0.442,"15min":0.42699999999999999},"max":{"1min":0.83599999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.56999999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542370,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1536000,"data_stored":772276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72999999999999998,"15min":0.76000000000000001},"min":{"1min":0.54200000000000004,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.95599999999999996,"5min":1.016,"15min":1.016},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77400000000000002,"15min":0.79100000000000004},"min":{"1min":0.58499999999999996,"5min":0.53200000000000003,"15min":0.437},"max":{"1min":0.93700000000000006,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.628}]},{"osd":1,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.57599999999999996,"5min":0.49099999999999999,"15min":0.45300000000000001},"max":{"1min":0.86399999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71399999999999997,"15min":0.73199999999999998},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.82799999999999996,"5min":0.99199999999999999,"15min":1.117},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72099999999999997,"15min":0.747},"min":{"1min":0.53000000000000003,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.91400000000000003,"5min":0.98099999999999998,"15min":0.997},"last":0.442},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.59299999999999997,"5min":0.53500000000000003,"15min":0.45500000000000002},"max":{"1min":0.99099999999999999,"5min":1.097,"15min":1.097},"last":0.69799999999999995}]},{"osd":3,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72999999999999998,"15min":0.754},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.45000000000000001},"max":{"1min":0.89400000000000002,"5min":1.048,"15min":1.048},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":0.73199999999999998},"min":{"1min":0.56399999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85799999999999998,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.59299999999999997},"min":{"1min":0.47199999999999998,"5min":0.374,"15min":0.36599999999999999},"max":{"1min":0.83699999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.623},"min":{"1min":0.42299999999999999,"5min":0.40500000000000003,"15min":0.39700000000000002},"max":{"1min":0.92800000000000005,"5min":0.98299999999999998,"15min":1.0209999999999999},"last":0.47399999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.61499999999999999},"min":{"1min":0.45900000000000002,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.89300000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.497,"5min":0.46000000000000002,"15min":0.435},"max":{"1min":0.95299999999999996,"5min":0.98299999999999998,"15min":1.054},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69999999999999996,"15min":0.67900000000000005},"min":{"1min":0.48199999999999998,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":0.996,"5min":1.079,"15min":1.079},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70299999999999996,"15min":0.69099999999999995},"min":{"1min":0.51900000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97199999999999998,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.61599999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509663,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50596,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321244,"statfs":{"total":96636764160,"available":96584953856,"internally_reserved":0,"allocated":1536000,"data_stored":772276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67800000000000005,"15min":0.71199999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35699999999999998},"max":{"1min":0.98799999999999999,"5min":1,"15min":1.8779999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70599999999999996,"15min":0.71799999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.95799999999999996,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.57499999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67300000000000004,"15min":0.70299999999999996},"min":{"1min":0.49199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90700000000000003,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.621},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68799999999999994,"15min":0.72499999999999998},"min":{"1min":0.441,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92500000000000004,"5min":0.94399999999999995,"15min":1.617},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.52600000000000002,"5min":0.45100000000000001,"15min":0.33600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71099999999999997,"15min":0.74199999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.377},"max":{"1min":0.94499999999999995,"5min":1.073,"15min":1.512},"last":0.71599999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.44800000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.472},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.754,"15min":0.78800000000000003},"min":{"1min":0.628,"5min":0.496,"15min":0.496},"max":{"1min":0.92200000000000004,"5min":1.022,"15min":1.556},"last":0.78500000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57299999999999995,"15min":0.56499999999999995},"min":{"1min":0.37,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.88900000000000001,"15min":0.96999999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71599999999999997,"15min":0.69499999999999995},"min":{"1min":0.53400000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.92400000000000004,"5min":1.012,"15min":1.038},"last":0.90900000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.47999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.76000000000000001,"5min":0.95499999999999996,"15min":1.0049999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63700000000000001,"15min":0.61499999999999999},"min":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.40000000000000002},"max":{"1min":0.84899999999999998,"5min":0.93799999999999994,"15min":1.02},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.69199999999999995,"15min":0.65400000000000003},"min":{"1min":0.51900000000000002,"5min":0.40999999999999998,"15min":0.374},"max":{"1min":0.97599999999999998,"5min":1.042,"15min":1.042},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.755,"15min":0.73199999999999998},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.96899999999999997,"5min":0.999,"15min":1.7390000000000001},"last":0.88300000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509664,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1536000,"data_stored":772276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.71799999999999997,"15min":0.74399999999999999},"min":{"1min":0.56499999999999995,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":0.98299999999999998,"5min":0.99399999999999999,"15min":1.0429999999999999},"last":0.501},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.59899999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.59699999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.51300000000000001,"5min":0.442,"15min":0.39400000000000002},"max":{"1min":0.97799999999999998,"5min":1.002,"15min":1.002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68200000000000005,"15min":0.70199999999999996},"min":{"1min":0.57999999999999996,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.877,"5min":0.93000000000000005,"15min":1.016},"last":0.44400000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73099999999999998,"15min":0.76000000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.371},"max":{"1min":1.0169999999999999,"5min":1.048,"15min":1.048},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.751,"15min":0.76700000000000002},"min":{"1min":0.61099999999999999,"5min":0.47699999999999998,"15min":0.33000000000000002},"max":{"1min":0.99199999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.57499999999999996,"5min":0.47199999999999998,"15min":0.40100000000000002},"max":{"1min":0.94599999999999995,"5min":0.97999999999999998,"15min":1.026},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76900000000000002,"15min":0.78300000000000003},"min":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.47999999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60299999999999998,"15min":0.58199999999999996},"min":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.629},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.38800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83999999999999997,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.38500000000000001},"max":{"1min":0.92800000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.53000000000000003,"5min":0.438,"15min":0.41599999999999998},"max":{"1min":0.95799999999999996,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65800000000000003,"15min":0.65200000000000002},"min":{"1min":0.497,"5min":0.45500000000000002,"15min":0.39200000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.0429999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.52200000000000002,"5min":0.46400000000000002,"15min":0.45300000000000001},"max":{"1min":0.874,"5min":1.101,"15min":1.135},"last":0.71699999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509663,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1512,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1548288,"data_stored":778948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47699999999999998,"15min":0.47899999999999998},"min":{"1min":0.30199999999999999,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.379},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.755,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45200000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46700000000000003,"15min":0.47999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72199999999999998,"5min":0.754,"15min":0.83499999999999996},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.29999999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82199999999999995,"5min":0.82599999999999996,"15min":0.90100000000000002},"last":0.52000000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81000000000000005,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.503},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.59999999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.99199999999999999},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.55400000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.052,"5min":1.093,"15min":1.1279999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.622,"5min":0.442,"15min":0.442},"max":{"1min":1.0580000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.84599999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76300000000000001,"15min":0.77400000000000002},"min":{"1min":0.53300000000000003,"5min":0.501,"15min":0.48999999999999999},"max":{"1min":1.002,"5min":1.0669999999999999,"15min":1.137},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77100000000000002,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.51300000000000001,"15min":0.42899999999999999},"max":{"1min":1.079,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.78800000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.63,"5min":0.51700000000000002,"15min":0.47399999999999998},"max":{"1min":1.0649999999999999,"5min":1.0680000000000001,"15min":1.169},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76700000000000002,"15min":0.77400000000000002},"min":{"1min":0.48199999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.03,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.754}]},{"osd":7,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.63900000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.083,"5min":1.087,"15min":1.099},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.82699999999999996,"15min":0.83199999999999996},"min":{"1min":0.67200000000000004,"5min":0.55200000000000005,"15min":0.48599999999999999},"max":{"1min":1.0980000000000001,"5min":1.623,"15min":1.623},"last":0.77400000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509665,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54704,"kb_used_data":1512,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317136,"statfs":{"total":96636764160,"available":96580747264,"internally_reserved":0,"allocated":1548288,"data_stored":778948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.438,"15min":0.46400000000000002},"min":{"1min":0.28999999999999998,"5min":0.27200000000000002,"15min":0.23899999999999999},"max":{"1min":0.68200000000000005,"5min":0.75,"15min":0.94199999999999995},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.54300000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.308},"max":{"1min":0.77400000000000002,"5min":0.88300000000000001,"15min":1.0409999999999999},"last":0.36899999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.748,"5min":0.86699999999999999,"15min":0.93999999999999995},"last":0.438},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.41999999999999998,"5min":0.38900000000000001,"15min":0.36099999999999999},"max":{"1min":0.85299999999999998,"5min":1.012,"15min":1.085},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72299999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.56499999999999995},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.81299999999999994,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.39300000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.74399999999999999,"15min":0.78400000000000003},"min":{"1min":0.48399999999999999,"5min":0.46600000000000003,"15min":0.376},"max":{"1min":0.96699999999999997,"5min":1.2110000000000001,"15min":1.3420000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.78900000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.022,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.52300000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.73899999999999999,"15min":0.78000000000000003},"min":{"1min":0.55900000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.78100000000000003,"15min":0.80900000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.46400000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.3089999999999999},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.75900000000000001,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.499,"15min":0.40300000000000002},"max":{"1min":1.052,"5min":1.536,"15min":1.536},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.76400000000000001,"15min":0.80500000000000005},"min":{"1min":0.60999999999999999,"5min":0.54500000000000004,"15min":0.46200000000000002},"max":{"1min":1.1100000000000001,"5min":1.1339999999999999,"15min":1.2649999999999999},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77700000000000002,"15min":0.81699999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.107,"5min":1.143,"15min":1.214},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.80400000000000005},"min":{"1min":0.54300000000000004,"5min":0.50900000000000001,"15min":0.44700000000000001},"max":{"1min":1.0720000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.61799999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509664,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1536000,"data_stored":772276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.29299999999999998,"5min":0.28299999999999997,"15min":0.22900000000000001},"max":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.84599999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55000000000000004,"15min":0.56399999999999995},"min":{"1min":0.45300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.872},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.49099999999999999,"15min":0.50700000000000001},"min":{"1min":0.36799999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.81000000000000005},"last":0.44},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.41799999999999998,"5min":0.34599999999999997,"15min":0.29099999999999998},"max":{"1min":0.88,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.41799999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57599999999999996,"15min":0.59599999999999997},"min":{"1min":0.47199999999999998,"5min":0.378,"15min":0.33400000000000002},"max":{"1min":0.73399999999999999,"5min":0.81699999999999995,"15min":0.98899999999999999},"last":0.497},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.505,"15min":0.51600000000000001},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":0.70999999999999996,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.47599999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.75900000000000001,"15min":0.77500000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.432},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.625},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.79200000000000004,"15min":0.79800000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.498},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.74199999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.76500000000000001,"15min":0.78300000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.41899999999999998},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.79700000000000004,"15min":0.80000000000000004},"min":{"1min":0.65100000000000002,"5min":0.51500000000000001,"15min":0.376},"max":{"1min":1.276,"5min":1.276,"15min":1.2849999999999999},"last":0.75800000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.79300000000000004,"15min":0.81000000000000005},"min":{"1min":0.65500000000000003,"5min":0.53000000000000003,"15min":0.47899999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.23},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.77700000000000002,"15min":0.79000000000000004},"min":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.46500000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.3240000000000001},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.80000000000000004,"15min":0.81200000000000006},"min":{"1min":0.57899999999999996,"5min":0.53800000000000003,"15min":0.49199999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3149999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80000000000000004,"15min":0.80700000000000005},"min":{"1min":0.55600000000000005,"5min":0.55500000000000005,"15min":0.45700000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.3380000000000001},"last":0.58299999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509666,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37236,"kb_used_data":2092,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334604,"statfs":{"total":96636764160,"available":96598634496,"internally_reserved":0,"allocated":2142208,"data_stored":1369316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46999999999999997,"15min":0.46899999999999997},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.26600000000000001},"max":{"1min":0.70399999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.375},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.629}]},{"osd":2,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.42099999999999999,"5min":0.32400000000000001,"15min":0.29799999999999999},"max":{"1min":0.82599999999999996,"5min":0.871,"15min":1.3680000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.504,"5min":0.49299999999999999,"15min":0.51700000000000002},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.32600000000000001},"max":{"1min":0.68200000000000005,"5min":0.76700000000000002,"15min":0.871},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57299999999999995,"15min":0.58999999999999997},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.33700000000000002},"max":{"1min":0.745,"5min":1.038,"15min":1.038},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.79900000000000004,"15min":0.78400000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.45200000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.3009999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.80500000000000005,"15min":0.80200000000000005},"min":{"1min":0.54500000000000004,"5min":0.505,"15min":0.44600000000000001},"max":{"1min":1.278,"5min":1.278,"15min":1.423},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78200000000000003,"15min":0.77900000000000003},"min":{"1min":0.56799999999999995,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.0229999999999999,"5min":1.1020000000000001,"15min":1.2669999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81000000000000005,"15min":0.80800000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.39600000000000002},"max":{"1min":1.1950000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.48899999999999999},"max":{"1min":1.054,"5min":1.27,"15min":1.27},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.81100000000000005,"15min":0.81799999999999995},"min":{"1min":0.64300000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.333},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.60099999999999998,"5min":0.54300000000000004,"15min":0.53100000000000003},"max":{"1min":1.121,"5min":1.159,"15min":1.2310000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.80800000000000005,"15min":0.82799999999999996},"min":{"1min":0.55600000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.109,"5min":1.1930000000000001,"15min":1.369},"last":0.60699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:37:27.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3f is not active+clean 2023-07-21T22:37:27.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.058267+0000', 'last_change': '2023-07-21T22:37:21.058267+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.058267+0000', 'last_undegraded': '2023-07-21T22:37:21.058267+0000', 'last_fullsized': '2023-07-21T22:37:21.058267+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:37:27.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3e is not active+clean 2023-07-21T22:37:27.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.067653+0000', 'last_change': '2023-07-21T22:37:21.067653+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.067653+0000', 'last_undegraded': '2023-07-21T22:37:21.067653+0000', 'last_fullsized': '2023-07-21T22:37:21.067653+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:37:27.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3d is not active+clean 2023-07-21T22:37:27.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.059237+0000', 'last_change': '2023-07-21T22:37:21.059237+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.059237+0000', 'last_undegraded': '2023-07-21T22:37:21.059237+0000', 'last_fullsized': '2023-07-21T22:37:21.059237+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:37:27.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3c is not active+clean 2023-07-21T22:37:27.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.063706+0000', 'last_change': '2023-07-21T22:37:21.063706+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.063706+0000', 'last_undegraded': '2023-07-21T22:37:21.063706+0000', 'last_fullsized': '2023-07-21T22:37:21.063706+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:37:27.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3b is not active+clean 2023-07-21T22:37:27.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.060500+0000', 'last_change': '2023-07-21T22:37:21.060500+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.060500+0000', 'last_undegraded': '2023-07-21T22:37:21.060500+0000', 'last_fullsized': '2023-07-21T22:37:21.060500+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:37:27.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3a is not active+clean 2023-07-21T22:37:27.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.066890+0000', 'last_change': '2023-07-21T22:37:21.066890+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.066890+0000', 'last_undegraded': '2023-07-21T22:37:21.066890+0000', 'last_fullsized': '2023-07-21T22:37:21.066890+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:37:27.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.39 is not active+clean 2023-07-21T22:37:27.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.068882+0000', 'last_change': '2023-07-21T22:37:21.068882+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.068882+0000', 'last_undegraded': '2023-07-21T22:37:21.068882+0000', 'last_fullsized': '2023-07-21T22:37:21.068882+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:37:27.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.38 is not active+clean 2023-07-21T22:37:27.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.070714+0000', 'last_change': '2023-07-21T22:37:21.070714+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.070714+0000', 'last_undegraded': '2023-07-21T22:37:21.070714+0000', 'last_fullsized': '2023-07-21T22:37:21.070714+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:37:27.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.37 is not active+clean 2023-07-21T22:37:27.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.065404+0000', 'last_change': '2023-07-21T22:37:21.065404+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.065404+0000', 'last_undegraded': '2023-07-21T22:37:21.065404+0000', 'last_fullsized': '2023-07-21T22:37:21.065404+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:37:27.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.36 is not active+clean 2023-07-21T22:37:27.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.058481+0000', 'last_change': '2023-07-21T22:37:21.058481+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.058481+0000', 'last_undegraded': '2023-07-21T22:37:21.058481+0000', 'last_fullsized': '2023-07-21T22:37:21.058481+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:37:27.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.35 is not active+clean 2023-07-21T22:37:27.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.059138+0000', 'last_change': '2023-07-21T22:37:21.059138+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.059138+0000', 'last_undegraded': '2023-07-21T22:37:21.059138+0000', 'last_fullsized': '2023-07-21T22:37:21.059138+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:37:27.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.34 is not active+clean 2023-07-21T22:37:27.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.064623+0000', 'last_change': '2023-07-21T22:37:21.064623+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.064623+0000', 'last_undegraded': '2023-07-21T22:37:21.064623+0000', 'last_fullsized': '2023-07-21T22:37:21.064623+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:37:27.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.33 is not active+clean 2023-07-21T22:37:27.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.061613+0000', 'last_change': '2023-07-21T22:37:21.061613+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.061613+0000', 'last_undegraded': '2023-07-21T22:37:21.061613+0000', 'last_fullsized': '2023-07-21T22:37:21.061613+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:37:27.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.32 is not active+clean 2023-07-21T22:37:27.040 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.062767+0000', 'last_change': '2023-07-21T22:37:21.062767+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.062767+0000', 'last_undegraded': '2023-07-21T22:37:21.062767+0000', 'last_fullsized': '2023-07-21T22:37:21.062767+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:37:27.040 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.31 is not active+clean 2023-07-21T22:37:27.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.063983+0000', 'last_change': '2023-07-21T22:37:21.063983+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.063983+0000', 'last_undegraded': '2023-07-21T22:37:21.063983+0000', 'last_fullsized': '2023-07-21T22:37:21.063983+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:37:27.041 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.30 is not active+clean 2023-07-21T22:37:27.042 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.065141+0000', 'last_change': '2023-07-21T22:37:21.065141+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.065141+0000', 'last_undegraded': '2023-07-21T22:37:21.065141+0000', 'last_fullsized': '2023-07-21T22:37:21.065141+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:37:27.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2f is not active+clean 2023-07-21T22:37:27.043 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.057800+0000', 'last_change': '2023-07-21T22:37:21.057800+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.057800+0000', 'last_undegraded': '2023-07-21T22:37:21.057800+0000', 'last_fullsized': '2023-07-21T22:37:21.057800+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:37:27.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2e is not active+clean 2023-07-21T22:37:27.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.067143+0000', 'last_change': '2023-07-21T22:37:21.067143+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.067143+0000', 'last_undegraded': '2023-07-21T22:37:21.067143+0000', 'last_fullsized': '2023-07-21T22:37:21.067143+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:37:27.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2d is not active+clean 2023-07-21T22:37:27.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.058804+0000', 'last_change': '2023-07-21T22:37:21.058804+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.058804+0000', 'last_undegraded': '2023-07-21T22:37:21.058804+0000', 'last_fullsized': '2023-07-21T22:37:21.058804+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:37:27.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2c is not active+clean 2023-07-21T22:37:27.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.061352+0000', 'last_change': '2023-07-21T22:37:21.061352+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.061352+0000', 'last_undegraded': '2023-07-21T22:37:21.061352+0000', 'last_fullsized': '2023-07-21T22:37:21.061352+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:37:27.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2b is not active+clean 2023-07-21T22:37:27.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.070641+0000', 'last_change': '2023-07-21T22:37:21.070641+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.070641+0000', 'last_undegraded': '2023-07-21T22:37:21.070641+0000', 'last_fullsized': '2023-07-21T22:37:21.070641+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:37:27.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2a is not active+clean 2023-07-21T22:37:27.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.059082+0000', 'last_change': '2023-07-21T22:37:21.059082+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.059082+0000', 'last_undegraded': '2023-07-21T22:37:21.059082+0000', 'last_fullsized': '2023-07-21T22:37:21.059082+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:37:27.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.29 is not active+clean 2023-07-21T22:37:27.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.057387+0000', 'last_change': '2023-07-21T22:37:21.057387+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.057387+0000', 'last_undegraded': '2023-07-21T22:37:21.057387+0000', 'last_fullsized': '2023-07-21T22:37:21.057387+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:37:27.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.28 is not active+clean 2023-07-21T22:37:27.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.058500+0000', 'last_change': '2023-07-21T22:37:21.058500+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.058500+0000', 'last_undegraded': '2023-07-21T22:37:21.058500+0000', 'last_fullsized': '2023-07-21T22:37:21.058500+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:37:27.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.27 is not active+clean 2023-07-21T22:37:27.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.062184+0000', 'last_change': '2023-07-21T22:37:21.062184+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.062184+0000', 'last_undegraded': '2023-07-21T22:37:21.062184+0000', 'last_fullsized': '2023-07-21T22:37:21.062184+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:37:27.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.26 is not active+clean 2023-07-21T22:37:27.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.060749+0000', 'last_change': '2023-07-21T22:37:21.060749+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.060749+0000', 'last_undegraded': '2023-07-21T22:37:21.060749+0000', 'last_fullsized': '2023-07-21T22:37:21.060749+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:37:27.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.25 is not active+clean 2023-07-21T22:37:27.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.057996+0000', 'last_change': '2023-07-21T22:37:21.057996+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.057996+0000', 'last_undegraded': '2023-07-21T22:37:21.057996+0000', 'last_fullsized': '2023-07-21T22:37:21.057996+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:37:27.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.24 is not active+clean 2023-07-21T22:37:27.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.071838+0000', 'last_change': '2023-07-21T22:37:21.071838+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.071838+0000', 'last_undegraded': '2023-07-21T22:37:21.071838+0000', 'last_fullsized': '2023-07-21T22:37:21.071838+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:37:27.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.23 is not active+clean 2023-07-21T22:37:27.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.070119+0000', 'last_change': '2023-07-21T22:37:21.070119+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.070119+0000', 'last_undegraded': '2023-07-21T22:37:21.070119+0000', 'last_fullsized': '2023-07-21T22:37:21.070119+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:37:27.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.22 is not active+clean 2023-07-21T22:37:27.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.062274+0000', 'last_change': '2023-07-21T22:37:21.062274+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.062274+0000', 'last_undegraded': '2023-07-21T22:37:21.062274+0000', 'last_fullsized': '2023-07-21T22:37:21.062274+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:37:27.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.21 is not active+clean 2023-07-21T22:37:27.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.068434+0000', 'last_change': '2023-07-21T22:37:21.068434+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.068434+0000', 'last_undegraded': '2023-07-21T22:37:21.068434+0000', 'last_fullsized': '2023-07-21T22:37:21.068434+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:37:27.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.20 is not active+clean 2023-07-21T22:37:27.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.070220+0000', 'last_change': '2023-07-21T22:37:21.070220+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.070220+0000', 'last_undegraded': '2023-07-21T22:37:21.070220+0000', 'last_fullsized': '2023-07-21T22:37:21.070220+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:37:27.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2023-07-21T22:37:27.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.057977+0000', 'last_change': '2023-07-21T22:37:21.057977+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.057977+0000', 'last_undegraded': '2023-07-21T22:37:21.057977+0000', 'last_fullsized': '2023-07-21T22:37:21.057977+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:37:27.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1 is not active+clean 2023-07-21T22:37:27.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.071547+0000', 'last_change': '2023-07-21T22:37:21.071547+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.071547+0000', 'last_undegraded': '2023-07-21T22:37:21.071547+0000', 'last_fullsized': '2023-07-21T22:37:21.071547+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:37:27.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2 is not active+clean 2023-07-21T22:37:27.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.061787+0000', 'last_change': '2023-07-21T22:37:21.061787+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.061787+0000', 'last_undegraded': '2023-07-21T22:37:21.061787+0000', 'last_fullsized': '2023-07-21T22:37:21.061787+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:37:27.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3 is not active+clean 2023-07-21T22:37:27.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.058462+0000', 'last_change': '2023-07-21T22:37:21.058462+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.058462+0000', 'last_undegraded': '2023-07-21T22:37:21.058462+0000', 'last_fullsized': '2023-07-21T22:37:21.058462+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:37:27.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.4 is not active+clean 2023-07-21T22:37:27.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.060345+0000', 'last_change': '2023-07-21T22:37:21.060345+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.060345+0000', 'last_undegraded': '2023-07-21T22:37:21.060345+0000', 'last_fullsized': '2023-07-21T22:37:21.060345+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:37:27.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2023-07-21T22:37:27.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.057756+0000', 'last_change': '2023-07-21T22:37:21.057756+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.057756+0000', 'last_undegraded': '2023-07-21T22:37:21.057756+0000', 'last_fullsized': '2023-07-21T22:37:21.057756+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:37:27.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.6 is not active+clean 2023-07-21T22:37:27.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.065241+0000', 'last_change': '2023-07-21T22:37:21.065241+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.065241+0000', 'last_undegraded': '2023-07-21T22:37:21.065241+0000', 'last_fullsized': '2023-07-21T22:37:21.065241+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:37:27.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.7 is not active+clean 2023-07-21T22:37:27.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.060058+0000', 'last_change': '2023-07-21T22:37:21.060058+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.060058+0000', 'last_undegraded': '2023-07-21T22:37:21.060058+0000', 'last_fullsized': '2023-07-21T22:37:21.060058+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:37:27.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2023-07-21T22:37:27.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.058492+0000', 'last_change': '2023-07-21T22:37:21.058492+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.058492+0000', 'last_undegraded': '2023-07-21T22:37:21.058492+0000', 'last_fullsized': '2023-07-21T22:37:21.058492+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:37:27.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.9 is not active+clean 2023-07-21T22:37:27.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.058561+0000', 'last_change': '2023-07-21T22:37:21.058561+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.058561+0000', 'last_undegraded': '2023-07-21T22:37:21.058561+0000', 'last_fullsized': '2023-07-21T22:37:21.058561+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:37:27.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.a is not active+clean 2023-07-21T22:37:27.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.071163+0000', 'last_change': '2023-07-21T22:37:21.071163+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.071163+0000', 'last_undegraded': '2023-07-21T22:37:21.071163+0000', 'last_fullsized': '2023-07-21T22:37:21.071163+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:37:27.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.b is not active+clean 2023-07-21T22:37:27.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.059591+0000', 'last_change': '2023-07-21T22:37:21.059591+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.059591+0000', 'last_undegraded': '2023-07-21T22:37:21.059591+0000', 'last_fullsized': '2023-07-21T22:37:21.059591+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:37:27.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.c is not active+clean 2023-07-21T22:37:27.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.058982+0000', 'last_change': '2023-07-21T22:37:21.058982+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.058982+0000', 'last_undegraded': '2023-07-21T22:37:21.058982+0000', 'last_fullsized': '2023-07-21T22:37:21.058982+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:37:27.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.d is not active+clean 2023-07-21T22:37:27.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.067540+0000', 'last_change': '2023-07-21T22:37:21.067540+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.067540+0000', 'last_undegraded': '2023-07-21T22:37:21.067540+0000', 'last_fullsized': '2023-07-21T22:37:21.067540+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:37:27.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.e is not active+clean 2023-07-21T22:37:27.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.071271+0000', 'last_change': '2023-07-21T22:37:21.071271+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.071271+0000', 'last_undegraded': '2023-07-21T22:37:21.071271+0000', 'last_fullsized': '2023-07-21T22:37:21.071271+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:37:27.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2023-07-21T22:37:27.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.057315+0000', 'last_change': '2023-07-21T22:37:21.057315+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.057315+0000', 'last_undegraded': '2023-07-21T22:37:21.057315+0000', 'last_fullsized': '2023-07-21T22:37:21.057315+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:37:27.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2023-07-21T22:37:27.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.058924+0000', 'last_change': '2023-07-21T22:37:21.058924+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.058924+0000', 'last_undegraded': '2023-07-21T22:37:21.058924+0000', 'last_fullsized': '2023-07-21T22:37:21.058924+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:37:27.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.19 is not active+clean 2023-07-21T22:37:27.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.061261+0000', 'last_change': '2023-07-21T22:37:21.061261+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.061261+0000', 'last_undegraded': '2023-07-21T22:37:21.061261+0000', 'last_fullsized': '2023-07-21T22:37:21.061261+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:37:27.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1a is not active+clean 2023-07-21T22:37:27.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.062480+0000', 'last_change': '2023-07-21T22:37:21.062480+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.062480+0000', 'last_undegraded': '2023-07-21T22:37:21.062480+0000', 'last_fullsized': '2023-07-21T22:37:21.062480+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:37:27.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1b is not active+clean 2023-07-21T22:37:27.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.059646+0000', 'last_change': '2023-07-21T22:37:21.059646+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.059646+0000', 'last_undegraded': '2023-07-21T22:37:21.059646+0000', 'last_fullsized': '2023-07-21T22:37:21.059646+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:37:27.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1c is not active+clean 2023-07-21T22:37:27.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.069756+0000', 'last_change': '2023-07-21T22:37:21.069756+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.069756+0000', 'last_undegraded': '2023-07-21T22:37:21.069756+0000', 'last_fullsized': '2023-07-21T22:37:21.069756+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:37:27.072 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1d is not active+clean 2023-07-21T22:37:27.072 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.069735+0000', 'last_change': '2023-07-21T22:37:21.069735+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.069735+0000', 'last_undegraded': '2023-07-21T22:37:21.069735+0000', 'last_fullsized': '2023-07-21T22:37:21.069735+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:37:27.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1e is not active+clean 2023-07-21T22:37:27.073 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.062405+0000', 'last_change': '2023-07-21T22:37:21.062405+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.062405+0000', 'last_undegraded': '2023-07-21T22:37:21.062405+0000', 'last_fullsized': '2023-07-21T22:37:21.062405+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:37:27.073 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1f is not active+clean 2023-07-21T22:37:27.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.058560+0000', 'last_change': '2023-07-21T22:37:21.058560+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.058560+0000', 'last_undegraded': '2023-07-21T22:37:21.058560+0000', 'last_fullsized': '2023-07-21T22:37:21.058560+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:37:27.074 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.11 is not active+clean 2023-07-21T22:37:27.074 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.057994+0000', 'last_change': '2023-07-21T22:37:21.057994+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.057994+0000', 'last_undegraded': '2023-07-21T22:37:21.057994+0000', 'last_fullsized': '2023-07-21T22:37:21.057994+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:37:27.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.12 is not active+clean 2023-07-21T22:37:27.075 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.064431+0000', 'last_change': '2023-07-21T22:37:21.064431+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.064431+0000', 'last_undegraded': '2023-07-21T22:37:21.064431+0000', 'last_fullsized': '2023-07-21T22:37:21.064431+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:37:27.075 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.13 is not active+clean 2023-07-21T22:37:27.076 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.060048+0000', 'last_change': '2023-07-21T22:37:21.060048+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.060048+0000', 'last_undegraded': '2023-07-21T22:37:21.060048+0000', 'last_fullsized': '2023-07-21T22:37:21.060048+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:37:27.076 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.10 is not active+clean 2023-07-21T22:37:27.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.069672+0000', 'last_change': '2023-07-21T22:37:21.069672+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.069672+0000', 'last_undegraded': '2023-07-21T22:37:21.069672+0000', 'last_fullsized': '2023-07-21T22:37:21.069672+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:37:27.077 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.16 is not active+clean 2023-07-21T22:37:27.077 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.060963+0000', 'last_change': '2023-07-21T22:37:21.060963+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.060963+0000', 'last_undegraded': '2023-07-21T22:37:21.060963+0000', 'last_fullsized': '2023-07-21T22:37:21.060963+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:37:27.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.17 is not active+clean 2023-07-21T22:37:27.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.069611+0000', 'last_change': '2023-07-21T22:37:21.069611+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.069611+0000', 'last_undegraded': '2023-07-21T22:37:21.069611+0000', 'last_fullsized': '2023-07-21T22:37:21.069611+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:37:27.078 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2023-07-21T22:37:27.078 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.061200+0000', 'last_change': '2023-07-21T22:37:21.061200+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.061200+0000', 'last_undegraded': '2023-07-21T22:37:21.061200+0000', 'last_fullsized': '2023-07-21T22:37:21.061200+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:37:27.079 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2023-07-21T22:37:27.079 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:37:21.058355+0000', 'last_change': '2023-07-21T22:37:21.058355+0000', 'last_active': '2023-07-21T22:37:21.046551+0000', 'last_peered': '2023-07-21T22:37:21.046551+0000', 'last_clean': '2023-07-21T22:37:21.046551+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:37:21.058355+0000', 'last_undegraded': '2023-07-21T22:37:21.058355+0000', 'last_fullsized': '2023-07-21T22:37:21.058355+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'last_clean_scrub_stamp': '2023-07-21T22:37:21.046551+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:37:27.080 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-21T22:37:27.081 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-07-21T22:37:27.037+0000 7f31c7005640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:37:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.177+0000 7f8bea2bd640 1 Processor -- start 2023-07-21T22:37:27.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.177+0000 7f8bea2bd640 1 -- start start 2023-07-21T22:37:27.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8bea2bd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8be4158ce0 0x7f8be4070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:27.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8bea2bd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8be40c8ad0 0x7f8be40c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:27.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8bea2bd640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be40cc700 con 0x7f8be40c9560 2023-07-21T22:37:27.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8bea2bd640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be40c99e0 con 0x7f8be40c8ad0 2023-07-21T22:37:27.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8bea2bd640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be40b0ff0 con 0x7f8be4158ce0 2023-07-21T22:37:27.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be885a640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8be40c9560 0x7f8be40cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53156/0 (socket says 172.21.15.6:53156) 2023-07-21T22:37:27.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be885a640 1 -- 172.21.15.6:0/302207465 learned_addr learned my addr 172.21.15.6:0/302207465 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:27.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be37fe640 1 --2- 172.21.15.6:0/302207465 >> v2:172.21.15.161:3300/0 conn(0x7f8be40c8ad0 0x7f8be40c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:27.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be3fff640 1 --2- 172.21.15.6:0/302207465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8be4158ce0 0x7f8be4070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:27.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be2ffd640 1 -- 172.21.15.6:0/302207465 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142298995 0 0) 0x7f8be40cc700 con 0x7f8be40c9560 2023-07-21T22:37:27.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be2ffd640 1 -- 172.21.15.6:0/302207465 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bcc003530 con 0x7f8be40c9560 2023-07-21T22:37:27.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be2ffd640 1 -- 172.21.15.6:0/302207465 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2702442774 0 0) 0x7f8bcc003530 con 0x7f8be40c9560 2023-07-21T22:37:27.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be2ffd640 1 -- 172.21.15.6:0/302207465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8be4158ce0 msgr2=0x7f8be4070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:27.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be2ffd640 1 --2- 172.21.15.6:0/302207465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8be4158ce0 0x7f8be4070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be2ffd640 1 -- 172.21.15.6:0/302207465 >> v2:172.21.15.161:3300/0 conn(0x7f8be40c8ad0 msgr2=0x7f8be40c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:27.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be2ffd640 1 --2- 172.21.15.6:0/302207465 >> v2:172.21.15.161:3300/0 conn(0x7f8be40c8ad0 0x7f8be40c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be2ffd640 1 -- 172.21.15.6:0/302207465 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be4070c80 con 0x7f8be40c9560 2023-07-21T22:37:27.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be2ffd640 1 -- 172.21.15.6:0/302207465 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f8bdc001a00 con 0x7f8be40c9560 2023-07-21T22:37:27.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be2ffd640 1 -- 172.21.15.6:0/302207465 >> v1:172.21.15.6:6789/0 conn(0x7f8be40c9560 legacy=0x7f8be40cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:27.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be2ffd640 1 --2- 172.21.15.6:0/302207465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8be4158ce0 0x7f8bcc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:27.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be2ffd640 1 --2- 172.21.15.6:0/302207465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bcc003f00 0x7f8bcc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:27.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be2ffd640 1 --2- 172.21.15.6:0/302207465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc004d10 0x7f8bcc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:27.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be2ffd640 1 -- 172.21.15.6:0/302207465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be40c99e0 con 0x7f8bcc004d10 2023-07-21T22:37:27.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be2ffd640 1 -- 172.21.15.6:0/302207465 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be40b0ff0 con 0x7f8bcc003f00 2023-07-21T22:37:27.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be2ffd640 1 -- 172.21.15.6:0/302207465 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc00ba70 con 0x7f8be4158ce0 2023-07-21T22:37:27.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be885a640 1 --2- 172.21.15.6:0/302207465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc004d10 0x7f8bcc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:27.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be37fe640 1 --2- 172.21.15.6:0/302207465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bcc003f00 0x7f8bcc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:27.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be3fff640 1 --2- 172.21.15.6:0/302207465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8be4158ce0 0x7f8bcc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:27.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be885a640 1 -- 172.21.15.6:0/302207465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8be4158ce0 msgr2=0x7f8bcc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:27.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be885a640 1 --2- 172.21.15.6:0/302207465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8be4158ce0 0x7f8bcc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be885a640 1 -- 172.21.15.6:0/302207465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bcc003f00 msgr2=0x7f8bcc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:27.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be885a640 1 --2- 172.21.15.6:0/302207465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bcc003f00 0x7f8bcc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be885a640 1 -- 172.21.15.6:0/302207465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc003530 con 0x7f8bcc004d10 2023-07-21T22:37:27.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.181+0000 7f8be37fe640 1 --2- 172.21.15.6:0/302207465 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8bcc003f00 0x7f8bcc0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:27.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.185+0000 7f8be885a640 1 --2- 172.21.15.6:0/302207465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc004d10 0x7f8bcc005180 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00a830 tx=0x7f8bdc01d310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8399f75354134986 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:27.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.185+0000 7f8be2ffd640 1 -- 172.21.15.6:0/302207465 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be40cba20 con 0x7f8bcc004d10 2023-07-21T22:37:27.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.185+0000 7f8be2ffd640 1 -- 172.21.15.6:0/302207465 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc0a8070 con 0x7f8bcc004d10 2023-07-21T22:37:27.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.185+0000 7f8be2ffd640 1 -- 172.21.15.6:0/302207465 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0ad8d0 con 0x7f8bcc004d10 2023-07-21T22:37:27.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.185+0000 7f8bea2bd640 1 -- 172.21.15.6:0/302207465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc004d10 msgr2=0x7f8bcc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:27.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.185+0000 7f8bea2bd640 1 --2- 172.21.15.6:0/302207465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc004d10 0x7f8bcc005180 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00a830 tx=0x7f8bdc01d310 comp rx=0 tx=0).stop 2023-07-21T22:37:27.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.185+0000 7f8be885a640 1 -- 172.21.15.6:0/302207465 reap_dead start 2023-07-21T22:37:27.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.185+0000 7f8bea2bd640 1 -- 172.21.15.6:0/302207465 shutdown_connections 2023-07-21T22:37:27.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.185+0000 7f8bea2bd640 1 -- 172.21.15.6:0/302207465 >> 172.21.15.6:0/302207465 conn(0x7f8be40afcf0 msgr2=0x7f8be40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:27.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.185+0000 7f8bea2bd640 1 -- 172.21.15.6:0/302207465 shutdown_connections 2023-07-21T22:37:27.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.185+0000 7f8bea2bd640 1 -- 172.21.15.6:0/302207465 wait complete. 2023-07-21T22:37:27.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.185+0000 7f8bea2bd640 1 Processor -- start 2023-07-21T22:37:27.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.185+0000 7f8bea2bd640 1 -- start start 2023-07-21T22:37:27.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8bea2bd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc004d10 0x7f8be41472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:27.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8bea2bd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8be40b2030 0x7f8be4153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:27.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8bea2bd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8be40c5230 0x7f8be40c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:27.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8bea2bd640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be4147800 con 0x7f8bcc004d10 2023-07-21T22:37:27.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8bea2bd640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be41f5080 con 0x7f8be40b2030 2023-07-21T22:37:27.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8bea2bd640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be40b3e20 con 0x7f8be40c5230 2023-07-21T22:37:27.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8be3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc004d10 0x7f8be41472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:27.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8be3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc004d10 0x7f8be41472c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46890/0 (socket says 172.21.15.6:46890) 2023-07-21T22:37:27.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8be3fff640 1 -- 172.21.15.6:0/3065398248 learned_addr learned my addr 172.21.15.6:0/3065398248 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:27.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8be37fe640 1 --2- 172.21.15.6:0/3065398248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8be40b2030 0x7f8be4153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:27.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8be885a640 1 --2- 172.21.15.6:0/3065398248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8be40c5230 0x7f8be40c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:27.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8be3fff640 1 -- 172.21.15.6:0/3065398248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8be40c5230 msgr2=0x7f8be40c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:27.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8be3fff640 1 --2- 172.21.15.6:0/3065398248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8be40c5230 0x7f8be40c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8be3fff640 1 -- 172.21.15.6:0/3065398248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8be40b2030 msgr2=0x7f8be4153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:27.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8be3fff640 1 --2- 172.21.15.6:0/3065398248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8be40b2030 0x7f8be4153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8be3fff640 1 -- 172.21.15.6:0/3065398248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be40c5be0 con 0x7f8bcc004d10 2023-07-21T22:37:27.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8be37fe640 1 --2- 172.21.15.6:0/3065398248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8be40b2030 0x7f8be4153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:27.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8be3fff640 1 --2- 172.21.15.6:0/3065398248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc004d10 0x7f8be41472c0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4011610 tx=0x7f8bd4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:27.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8be0ff9640 1 -- 172.21.15.6:0/3065398248 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd400f8f0 con 0x7f8bcc004d10 2023-07-21T22:37:27.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8be0ff9640 1 -- 172.21.15.6:0/3065398248 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd400fa50 con 0x7f8bcc004d10 2023-07-21T22:37:27.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8bea2bd640 1 -- 172.21.15.6:0/3065398248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be41f4470 con 0x7f8bcc004d10 2023-07-21T22:37:27.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8be0ff9640 1 -- 172.21.15.6:0/3065398248 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd400fdc0 con 0x7f8bcc004d10 2023-07-21T22:37:27.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8bea2bd640 1 -- 172.21.15.6:0/3065398248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be41f4a30 con 0x7f8bcc004d10 2023-07-21T22:37:27.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.189+0000 7f8bea2bd640 1 -- 172.21.15.6:0/3065398248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be40c7080 con 0x7f8bcc004d10 2023-07-21T22:37:27.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.193+0000 7f8be0ff9640 1 -- 172.21.15.6:0/3065398248 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8bd4015460 con 0x7f8bcc004d10 2023-07-21T22:37:27.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.193+0000 7f8be0ff9640 1 --2- 172.21.15.6:0/3065398248 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f8bd00663a0 0x7f8bd0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:27.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.193+0000 7f8be0ff9640 1 -- 172.21.15.6:0/3065398248 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f8bd4084840 con 0x7f8bcc004d10 2023-07-21T22:37:27.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.193+0000 7f8be37fe640 1 --2- 172.21.15.6:0/3065398248 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f8bd00663a0 0x7f8bd0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:27.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.193+0000 7f8be37fe640 1 --2- 172.21.15.6:0/3065398248 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f8bd00663a0 0x7f8bd0068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8be406be30 tx=0x7f8bd8008040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:27.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.197+0000 7f8be0ff9640 1 -- 172.21.15.6:0/3065398248 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8bd4051ae0 con 0x7f8bcc004d10 2023-07-21T22:37:27.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.409+0000 7f8bea2bd640 1 -- 172.21.15.6:0/3065398248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8be40cdb70 con 0x7f8bcc004d10 2023-07-21T22:37:27.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.409+0000 7f8be0ff9640 1 -- 172.21.15.6:0/3065398248 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3232 (secure 0 0 0) 0x7f8bd4055100 con 0x7f8bcc004d10 2023-07-21T22:37:27.456 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:27.457 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1149,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":128,"num_osds":8,"num_up_osds":8,"osd_up_since":1689977909,"num_in_osds":8,"osd_in_since":1689977900,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":340078592,"bytes_avail":772754034688,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":54,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8214}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2023-07-21T22:37:09.723391+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-21T22:37:27.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.413+0000 7f8bea2bd640 1 -- 172.21.15.6:0/3065398248 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f8bd00663a0 msgr2=0x7f8bd0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:27.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.413+0000 7f8bea2bd640 1 --2- 172.21.15.6:0/3065398248 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f8bd00663a0 0x7f8bd0068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8be406be30 tx=0x7f8bd8008040 comp rx=0 tx=0).stop 2023-07-21T22:37:27.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.413+0000 7f8bea2bd640 1 -- 172.21.15.6:0/3065398248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc004d10 msgr2=0x7f8be41472c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:27.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.413+0000 7f8bea2bd640 1 --2- 172.21.15.6:0/3065398248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc004d10 0x7f8be41472c0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4011610 tx=0x7f8bd4011ad0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.413+0000 7f8bea2bd640 1 -- 172.21.15.6:0/3065398248 shutdown_connections 2023-07-21T22:37:27.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.413+0000 7f8bea2bd640 1 --2- 172.21.15.6:0/3065398248 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f8bd00663a0 0x7f8bd0068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.413+0000 7f8bea2bd640 1 --2- 172.21.15.6:0/3065398248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8be40c5230 0x7f8be40c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.413+0000 7f8bea2bd640 1 --2- 172.21.15.6:0/3065398248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8be40b2030 0x7f8be4153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.413+0000 7f8bea2bd640 1 --2- 172.21.15.6:0/3065398248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bcc004d10 0x7f8be41472c0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.413+0000 7f8bea2bd640 1 -- 172.21.15.6:0/3065398248 >> 172.21.15.6:0/3065398248 conn(0x7f8be40afcf0 msgr2=0x7f8be41574a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:27.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.413+0000 7f8bea2bd640 1 -- 172.21.15.6:0/3065398248 shutdown_connections 2023-07-21T22:37:27.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.413+0000 7f8bea2bd640 1 -- 172.21.15.6:0/3065398248 wait complete. 2023-07-21T22:37:27.477 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-21T22:37:27.478 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:37:27.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.577+0000 7f835e71e640 1 Processor -- start 2023-07-21T22:37:27.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.577+0000 7f835e71e640 1 -- start start 2023-07-21T22:37:27.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.577+0000 7f835e71e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f835815bdf0 0x7f83580ca970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:27.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.577+0000 7f835e71e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f83580c8e70 0x7f83580c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:27.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.577+0000 7f835e71e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83580cb2e0 con 0x7f835815f970 2023-07-21T22:37:27.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.577+0000 7f835e71e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83580cb5c0 con 0x7f83580c8e70 2023-07-21T22:37:27.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.577+0000 7f835e71e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83580cb8a0 con 0x7f835815bdf0 2023-07-21T22:37:27.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.577+0000 7f8357fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f835815bdf0 0x7f83580ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:27.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.577+0000 7f835ccbb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f83580c8e70 0x7f83580c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:27.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.577+0000 7f83577fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f835815f970 0x7f835815fdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:38380/0 (socket says 172.21.15.6:38380) 2023-07-21T22:37:27.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.577+0000 7f83577fe640 1 -- 172.21.15.6:0/2667851353 learned_addr learned my addr 172.21.15.6:0/2667851353 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:27.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.577+0000 7f8357fff640 1 -- 172.21.15.6:0/2667851353 >> v2:172.21.15.161:3300/0 conn(0x7f83580c8e70 msgr2=0x7f83580c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:27.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.577+0000 7f8357fff640 1 --2- 172.21.15.6:0/2667851353 >> v2:172.21.15.161:3300/0 conn(0x7f83580c8e70 0x7f83580c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.577+0000 7f8357fff640 1 -- 172.21.15.6:0/2667851353 >> v1:172.21.15.161:6789/0 conn(0x7f835815f970 legacy=0x7f835815fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:27.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.577+0000 7f8357fff640 1 -- 172.21.15.6:0/2667851353 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83580c8950 con 0x7f835815bdf0 2023-07-21T22:37:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.581+0000 7f8357fff640 1 --2- 172.21.15.6:0/2667851353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f835815bdf0 0x7f83580ca970 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f83480097c0 tx=0x7f834801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cf6af00badc8910 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.581+0000 7f8356ffd640 1 -- 172.21.15.6:0/2667851353 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83480ab610 con 0x7f835815bdf0 2023-07-21T22:37:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.581+0000 7f8356ffd640 1 -- 172.21.15.6:0/2667851353 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83480ab770 con 0x7f835815bdf0 2023-07-21T22:37:27.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.581+0000 7f8356ffd640 1 -- 172.21.15.6:0/2667851353 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83480abb00 con 0x7f835815bdf0 2023-07-21T22:37:27.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.581+0000 7f835e71e640 1 -- 172.21.15.6:0/2667851353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f835815bdf0 msgr2=0x7f83580ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.581+0000 7f835e71e640 1 --2- 172.21.15.6:0/2667851353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f835815bdf0 0x7f83580ca970 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f83480097c0 tx=0x7f834801c3f0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.581+0000 7f835e71e640 1 -- 172.21.15.6:0/2667851353 shutdown_connections 2023-07-21T22:37:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.581+0000 7f835e71e640 1 --2- 172.21.15.6:0/2667851353 >> v2:172.21.15.161:3300/0 conn(0x7f83580c8e70 0x7f83580c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.581+0000 7f835e71e640 1 --2- 172.21.15.6:0/2667851353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f835815bdf0 0x7f83580ca970 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.581+0000 7f835e71e640 1 -- 172.21.15.6:0/2667851353 >> 172.21.15.6:0/2667851353 conn(0x7f83580afcf0 msgr2=0x7f83580b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.581+0000 7f835e71e640 1 -- 172.21.15.6:0/2667851353 shutdown_connections 2023-07-21T22:37:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.581+0000 7f835e71e640 1 -- 172.21.15.6:0/2667851353 wait complete. 2023-07-21T22:37:27.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f835e71e640 1 Processor -- start 2023-07-21T22:37:27.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f835e71e640 1 -- start start 2023-07-21T22:37:27.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f835e71e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83580c8e70 0x7f835814d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:27.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f835e71e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f835815bdf0 0x7f83580c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:27.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f835e71e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835815f970 0x7f8358159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:27.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f835e71e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83580c3b10 con 0x7f835815f970 2023-07-21T22:37:27.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f835e71e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83580c3170 con 0x7f835815bdf0 2023-07-21T22:37:27.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f835e71e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83580c3450 con 0x7f83580c8e70 2023-07-21T22:37:27.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f835ccbb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835815f970 0x7f8358159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:27.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f835ccbb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835815f970 0x7f8358159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50896/0 (socket says 172.21.15.6:50896) 2023-07-21T22:37:27.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f835ccbb640 1 -- 172.21.15.6:0/3523611968 learned_addr learned my addr 172.21.15.6:0/3523611968 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:27.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f83577fe640 1 --2- 172.21.15.6:0/3523611968 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f835815bdf0 0x7f83580c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:27.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f8357fff640 1 --2- 172.21.15.6:0/3523611968 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83580c8e70 0x7f835814d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:27.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f835ccbb640 1 -- 172.21.15.6:0/3523611968 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83580c8e70 msgr2=0x7f835814d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:27.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f835ccbb640 1 --2- 172.21.15.6:0/3523611968 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83580c8e70 0x7f835814d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f835ccbb640 1 -- 172.21.15.6:0/3523611968 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f835815bdf0 msgr2=0x7f83580c3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:27.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f835ccbb640 1 --2- 172.21.15.6:0/3523611968 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f835815bdf0 0x7f83580c3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f835ccbb640 1 -- 172.21.15.6:0/3523611968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8348009420 con 0x7f835815f970 2023-07-21T22:37:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f83577fe640 1 --2- 172.21.15.6:0/3523611968 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f835815bdf0 0x7f83580c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f835ccbb640 1 --2- 172.21.15.6:0/3523611968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835815f970 0x7f8358159db0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f835000efc0 tx=0x7f835000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f8354ff9640 1 -- 172.21.15.6:0/3523611968 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8350014480 con 0x7f835815f970 2023-07-21T22:37:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f8354ff9640 1 -- 172.21.15.6:0/3523611968 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835000f040 con 0x7f835815f970 2023-07-21T22:37:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f8354ff9640 1 -- 172.21.15.6:0/3523611968 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8350014820 con 0x7f835815f970 2023-07-21T22:37:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f835e71e640 1 -- 172.21.15.6:0/3523611968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83580c3730 con 0x7f835815f970 2023-07-21T22:37:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.585+0000 7f835e71e640 1 -- 172.21.15.6:0/3523611968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83580c2e20 con 0x7f835815f970 2023-07-21T22:37:27.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.589+0000 7f835e71e640 1 -- 172.21.15.6:0/3523611968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83580c3c50 con 0x7f835815f970 2023-07-21T22:37:27.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.589+0000 7f8354ff9640 1 -- 172.21.15.6:0/3523611968 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8350014980 con 0x7f835815f970 2023-07-21T22:37:27.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.589+0000 7f8354ff9640 1 --2- 172.21.15.6:0/3523611968 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f83440663a0 0x7f8344068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:27.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.589+0000 7f8354ff9640 1 -- 172.21.15.6:0/3523611968 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f8350084e70 con 0x7f835815f970 2023-07-21T22:37:27.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.589+0000 7f8357fff640 1 --2- 172.21.15.6:0/3523611968 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f83440663a0 0x7f8344068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:27.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.593+0000 7f8357fff640 1 --2- 172.21.15.6:0/3523611968 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f83440663a0 0x7f8344068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f83480af000 tx=0x7f83480a7000 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:27.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.593+0000 7f8354ff9640 1 -- 172.21.15.6:0/3523611968 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f83580c3c50 con 0x7f835815f970 2023-07-21T22:37:27.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.745+0000 7f835e71e640 1 -- 172.21.15.6:0/3523611968 --> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8358168d00 con 0x7f83440663a0 2023-07-21T22:37:27.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.757+0000 7f8354ff9640 1 -- 172.21.15.6:0/3523611968 <== mgr.6905 v2:172.21.15.161:6832/1868466946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311694 (secure 0 0 0) 0x7f83480ab8e0 con 0x7f83440663a0 2023-07-21T22:37:27.804 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:27.806 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:37:27.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.761+0000 7f835e71e640 1 -- 172.21.15.6:0/3523611968 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f83440663a0 msgr2=0x7f8344068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:27.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.761+0000 7f835e71e640 1 --2- 172.21.15.6:0/3523611968 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f83440663a0 0x7f8344068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f83480af000 tx=0x7f83480a7000 comp rx=0 tx=0).stop 2023-07-21T22:37:27.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.761+0000 7f835e71e640 1 -- 172.21.15.6:0/3523611968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835815f970 msgr2=0x7f8358159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:27.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.761+0000 7f835e71e640 1 --2- 172.21.15.6:0/3523611968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835815f970 0x7f8358159db0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f835000efc0 tx=0x7f835000c490 comp rx=0 tx=0).stop 2023-07-21T22:37:27.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.761+0000 7f835e71e640 1 -- 172.21.15.6:0/3523611968 shutdown_connections 2023-07-21T22:37:27.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.761+0000 7f835e71e640 1 --2- 172.21.15.6:0/3523611968 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f83440663a0 0x7f8344068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.761+0000 7f835e71e640 1 --2- 172.21.15.6:0/3523611968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f835815f970 0x7f8358159db0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.761+0000 7f835e71e640 1 --2- 172.21.15.6:0/3523611968 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f835815bdf0 0x7f83580c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.761+0000 7f835e71e640 1 --2- 172.21.15.6:0/3523611968 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f83580c8e70 0x7f835814d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:27.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.761+0000 7f835e71e640 1 -- 172.21.15.6:0/3523611968 >> 172.21.15.6:0/3523611968 conn(0x7f83580afcf0 msgr2=0x7f8358070220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:27.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.761+0000 7f835e71e640 1 -- 172.21.15.6:0/3523611968 shutdown_connections 2023-07-21T22:37:27.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:27.761+0000 7f835e71e640 1 -- 172.21.15.6:0/3523611968 wait complete. 2023-07-21T22:37:27.824 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-21T22:37:27.727241+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":404,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":266,"ondisk_log_size":266,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332424,"kb_used_data":13512,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754642296,"statfs":{"total":773094113280,"available":772753711104,"internally_reserved":0,"allocated":13836288,"data_stored":7527996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.670489"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894850+0000","last_change":"2023-07-21T22:37:22.107831+0000","last_active":"2023-07-21T22:37:23.894850+0000","last_peered":"2023-07-21T22:37:23.894850+0000","last_clean":"2023-07-21T22:37:23.894850+0000","last_became_active":"2023-07-21T22:37:22.107508+0000","last_became_peered":"2023-07-21T22:37:22.107508+0000","last_unstale":"2023-07-21T22:37:23.894850+0000","last_undegraded":"2023-07-21T22:37:23.894850+0000","last_fullsized":"2023-07-21T22:37:23.894850+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:19:33.942245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090696+0000","last_change":"2023-07-21T22:37:22.088568+0000","last_active":"2023-07-21T22:37:23.090696+0000","last_peered":"2023-07-21T22:37:23.090696+0000","last_clean":"2023-07-21T22:37:23.090696+0000","last_became_active":"2023-07-21T22:37:22.088275+0000","last_became_peered":"2023-07-21T22:37:22.088275+0000","last_unstale":"2023-07-21T22:37:23.090696+0000","last_undegraded":"2023-07-21T22:37:23.090696+0000","last_fullsized":"2023-07-21T22:37:23.090696+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:04:38.307558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895453+0000","last_change":"2023-07-21T22:37:22.100121+0000","last_active":"2023-07-21T22:37:23.895453+0000","last_peered":"2023-07-21T22:37:23.895453+0000","last_clean":"2023-07-21T22:37:23.895453+0000","last_became_active":"2023-07-21T22:37:22.099590+0000","last_became_peered":"2023-07-21T22:37:22.099590+0000","last_unstale":"2023-07-21T22:37:23.895453+0000","last_undegraded":"2023-07-21T22:37:23.895453+0000","last_fullsized":"2023-07-21T22:37:23.895453+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:06:31.514324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895966+0000","last_change":"2023-07-21T22:37:22.092845+0000","last_active":"2023-07-21T22:37:23.895966+0000","last_peered":"2023-07-21T22:37:23.895966+0000","last_clean":"2023-07-21T22:37:23.895966+0000","last_became_active":"2023-07-21T22:37:22.092571+0000","last_became_peered":"2023-07-21T22:37:22.092571+0000","last_unstale":"2023-07-21T22:37:23.895966+0000","last_undegraded":"2023-07-21T22:37:23.895966+0000","last_fullsized":"2023-07-21T22:37:23.895966+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:21:18.056170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085495+0000","last_change":"2023-07-21T22:37:22.113035+0000","last_active":"2023-07-21T22:37:23.085495+0000","last_peered":"2023-07-21T22:37:23.085495+0000","last_clean":"2023-07-21T22:37:23.085495+0000","last_became_active":"2023-07-21T22:37:22.112607+0000","last_became_peered":"2023-07-21T22:37:22.112607+0000","last_unstale":"2023-07-21T22:37:23.085495+0000","last_undegraded":"2023-07-21T22:37:23.085495+0000","last_fullsized":"2023-07-21T22:37:23.085495+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:44.770697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090101+0000","last_change":"2023-07-21T22:37:22.101752+0000","last_active":"2023-07-21T22:37:23.090101+0000","last_peered":"2023-07-21T22:37:23.090101+0000","last_clean":"2023-07-21T22:37:23.090101+0000","last_became_active":"2023-07-21T22:37:22.101490+0000","last_became_peered":"2023-07-21T22:37:22.101490+0000","last_unstale":"2023-07-21T22:37:23.090101+0000","last_undegraded":"2023-07-21T22:37:23.090101+0000","last_fullsized":"2023-07-21T22:37:23.090101+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:32:37.413308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.089770+0000","last_change":"2023-07-21T22:37:22.102470+0000","last_active":"2023-07-21T22:37:23.089770+0000","last_peered":"2023-07-21T22:37:23.089770+0000","last_clean":"2023-07-21T22:37:23.089770+0000","last_became_active":"2023-07-21T22:37:22.102178+0000","last_became_peered":"2023-07-21T22:37:22.102178+0000","last_unstale":"2023-07-21T22:37:23.089770+0000","last_undegraded":"2023-07-21T22:37:23.089770+0000","last_fullsized":"2023-07-21T22:37:23.089770+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:48:56.999112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.893896+0000","last_change":"2023-07-21T22:37:22.096429+0000","last_active":"2023-07-21T22:37:23.893896+0000","last_peered":"2023-07-21T22:37:23.893896+0000","last_clean":"2023-07-21T22:37:23.893896+0000","last_became_active":"2023-07-21T22:37:22.096137+0000","last_became_peered":"2023-07-21T22:37:22.096137+0000","last_unstale":"2023-07-21T22:37:23.893896+0000","last_undegraded":"2023-07-21T22:37:23.893896+0000","last_fullsized":"2023-07-21T22:37:23.893896+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:09.639526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090725+0000","last_change":"2023-07-21T22:37:22.090810+0000","last_active":"2023-07-21T22:37:23.090725+0000","last_peered":"2023-07-21T22:37:23.090725+0000","last_clean":"2023-07-21T22:37:23.090725+0000","last_became_active":"2023-07-21T22:37:22.090404+0000","last_became_peered":"2023-07-21T22:37:22.090404+0000","last_unstale":"2023-07-21T22:37:23.090725+0000","last_undegraded":"2023-07-21T22:37:23.090725+0000","last_fullsized":"2023-07-21T22:37:23.090725+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:55:06.160682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085606+0000","last_change":"2023-07-21T22:37:22.107484+0000","last_active":"2023-07-21T22:37:23.085606+0000","last_peered":"2023-07-21T22:37:23.085606+0000","last_clean":"2023-07-21T22:37:23.085606+0000","last_became_active":"2023-07-21T22:37:22.107137+0000","last_became_peered":"2023-07-21T22:37:22.107137+0000","last_unstale":"2023-07-21T22:37:23.085606+0000","last_undegraded":"2023-07-21T22:37:23.085606+0000","last_fullsized":"2023-07-21T22:37:23.085606+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:07:27.193624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090670+0000","last_change":"2023-07-21T22:37:22.104991+0000","last_active":"2023-07-21T22:37:23.090670+0000","last_peered":"2023-07-21T22:37:23.090670+0000","last_clean":"2023-07-21T22:37:23.090670+0000","last_became_active":"2023-07-21T22:37:22.104714+0000","last_became_peered":"2023-07-21T22:37:22.104714+0000","last_unstale":"2023-07-21T22:37:23.090670+0000","last_undegraded":"2023-07-21T22:37:23.090670+0000","last_fullsized":"2023-07-21T22:37:23.090670+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:58:07.137241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.898061+0000","last_change":"2023-07-21T22:37:22.099693+0000","last_active":"2023-07-21T22:37:23.898061+0000","last_peered":"2023-07-21T22:37:23.898061+0000","last_clean":"2023-07-21T22:37:23.898061+0000","last_became_active":"2023-07-21T22:37:22.099357+0000","last_became_peered":"2023-07-21T22:37:22.099357+0000","last_unstale":"2023-07-21T22:37:23.898061+0000","last_undegraded":"2023-07-21T22:37:23.898061+0000","last_fullsized":"2023-07-21T22:37:23.898061+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:13:51.549351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894560+0000","last_change":"2023-07-21T22:37:22.099882+0000","last_active":"2023-07-21T22:37:23.894560+0000","last_peered":"2023-07-21T22:37:23.894560+0000","last_clean":"2023-07-21T22:37:23.894560+0000","last_became_active":"2023-07-21T22:37:22.099607+0000","last_became_peered":"2023-07-21T22:37:22.099607+0000","last_unstale":"2023-07-21T22:37:23.894560+0000","last_undegraded":"2023-07-21T22:37:23.894560+0000","last_fullsized":"2023-07-21T22:37:23.894560+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:08:22.899930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897783+0000","last_change":"2023-07-21T22:37:22.094487+0000","last_active":"2023-07-21T22:37:23.897783+0000","last_peered":"2023-07-21T22:37:23.897783+0000","last_clean":"2023-07-21T22:37:23.897783+0000","last_became_active":"2023-07-21T22:37:22.094182+0000","last_became_peered":"2023-07-21T22:37:22.094182+0000","last_unstale":"2023-07-21T22:37:23.897783+0000","last_undegraded":"2023-07-21T22:37:23.897783+0000","last_fullsized":"2023-07-21T22:37:23.897783+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:44:49.192614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897793+0000","last_change":"2023-07-21T22:37:22.098326+0000","last_active":"2023-07-21T22:37:23.897793+0000","last_peered":"2023-07-21T22:37:23.897793+0000","last_clean":"2023-07-21T22:37:23.897793+0000","last_became_active":"2023-07-21T22:37:22.097862+0000","last_became_peered":"2023-07-21T22:37:22.097862+0000","last_unstale":"2023-07-21T22:37:23.897793+0000","last_undegraded":"2023-07-21T22:37:23.897793+0000","last_fullsized":"2023-07-21T22:37:23.897793+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:21.467017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897263+0000","last_change":"2023-07-21T22:37:22.095435+0000","last_active":"2023-07-21T22:37:23.897263+0000","last_peered":"2023-07-21T22:37:23.897263+0000","last_clean":"2023-07-21T22:37:23.897263+0000","last_became_active":"2023-07-21T22:37:22.095145+0000","last_became_peered":"2023-07-21T22:37:22.095145+0000","last_unstale":"2023-07-21T22:37:23.897263+0000","last_undegraded":"2023-07-21T22:37:23.897263+0000","last_fullsized":"2023-07-21T22:37:23.897263+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:41:57.225885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895013+0000","last_change":"2023-07-21T22:37:22.099722+0000","last_active":"2023-07-21T22:37:23.895013+0000","last_peered":"2023-07-21T22:37:23.895013+0000","last_clean":"2023-07-21T22:37:23.895013+0000","last_became_active":"2023-07-21T22:37:22.099430+0000","last_became_peered":"2023-07-21T22:37:22.099430+0000","last_unstale":"2023-07-21T22:37:23.895013+0000","last_undegraded":"2023-07-21T22:37:23.895013+0000","last_fullsized":"2023-07-21T22:37:23.895013+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:52:13.992344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090726+0000","last_change":"2023-07-21T22:37:22.104090+0000","last_active":"2023-07-21T22:37:23.090726+0000","last_peered":"2023-07-21T22:37:23.090726+0000","last_clean":"2023-07-21T22:37:23.090726+0000","last_became_active":"2023-07-21T22:37:22.103240+0000","last_became_peered":"2023-07-21T22:37:22.103240+0000","last_unstale":"2023-07-21T22:37:23.090726+0000","last_undegraded":"2023-07-21T22:37:23.090726+0000","last_fullsized":"2023-07-21T22:37:23.090726+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:14:43.360025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895585+0000","last_change":"2023-07-21T22:37:22.106737+0000","last_active":"2023-07-21T22:37:23.895585+0000","last_peered":"2023-07-21T22:37:23.895585+0000","last_clean":"2023-07-21T22:37:23.895585+0000","last_became_active":"2023-07-21T22:37:22.105690+0000","last_became_peered":"2023-07-21T22:37:22.105690+0000","last_unstale":"2023-07-21T22:37:23.895585+0000","last_undegraded":"2023-07-21T22:37:23.895585+0000","last_fullsized":"2023-07-21T22:37:23.895585+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:36:03.999643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.898285+0000","last_change":"2023-07-21T22:37:22.097988+0000","last_active":"2023-07-21T22:37:23.898285+0000","last_peered":"2023-07-21T22:37:23.898285+0000","last_clean":"2023-07-21T22:37:23.898285+0000","last_became_active":"2023-07-21T22:37:22.097686+0000","last_became_peered":"2023-07-21T22:37:22.097686+0000","last_unstale":"2023-07-21T22:37:23.898285+0000","last_undegraded":"2023-07-21T22:37:23.898285+0000","last_fullsized":"2023-07-21T22:37:23.898285+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:02:05.730511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895285+0000","last_change":"2023-07-21T22:37:22.102362+0000","last_active":"2023-07-21T22:37:23.895285+0000","last_peered":"2023-07-21T22:37:23.895285+0000","last_clean":"2023-07-21T22:37:23.895285+0000","last_became_active":"2023-07-21T22:37:22.102082+0000","last_became_peered":"2023-07-21T22:37:22.102082+0000","last_unstale":"2023-07-21T22:37:23.895285+0000","last_undegraded":"2023-07-21T22:37:23.895285+0000","last_fullsized":"2023-07-21T22:37:23.895285+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:56:12.403970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085653+0000","last_change":"2023-07-21T22:37:22.098703+0000","last_active":"2023-07-21T22:37:23.085653+0000","last_peered":"2023-07-21T22:37:23.085653+0000","last_clean":"2023-07-21T22:37:23.085653+0000","last_became_active":"2023-07-21T22:37:22.098286+0000","last_became_peered":"2023-07-21T22:37:22.098286+0000","last_unstale":"2023-07-21T22:37:23.085653+0000","last_undegraded":"2023-07-21T22:37:23.085653+0000","last_fullsized":"2023-07-21T22:37:23.085653+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:24:54.907029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894687+0000","last_change":"2023-07-21T22:37:22.104289+0000","last_active":"2023-07-21T22:37:23.894687+0000","last_peered":"2023-07-21T22:37:23.894687+0000","last_clean":"2023-07-21T22:37:23.894687+0000","last_became_active":"2023-07-21T22:37:22.103758+0000","last_became_peered":"2023-07-21T22:37:22.103758+0000","last_unstale":"2023-07-21T22:37:23.894687+0000","last_undegraded":"2023-07-21T22:37:23.894687+0000","last_fullsized":"2023-07-21T22:37:23.894687+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:54:51.112565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085426+0000","last_change":"2023-07-21T22:37:22.112796+0000","last_active":"2023-07-21T22:37:23.085426+0000","last_peered":"2023-07-21T22:37:23.085426+0000","last_clean":"2023-07-21T22:37:23.085426+0000","last_became_active":"2023-07-21T22:37:22.112412+0000","last_became_peered":"2023-07-21T22:37:22.112412+0000","last_unstale":"2023-07-21T22:37:23.085426+0000","last_undegraded":"2023-07-21T22:37:23.085426+0000","last_fullsized":"2023-07-21T22:37:23.085426+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:39:44.537855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.898326+0000","last_change":"2023-07-21T22:37:22.102479+0000","last_active":"2023-07-21T22:37:23.898326+0000","last_peered":"2023-07-21T22:37:23.898326+0000","last_clean":"2023-07-21T22:37:23.898326+0000","last_became_active":"2023-07-21T22:37:22.102193+0000","last_became_peered":"2023-07-21T22:37:22.102193+0000","last_unstale":"2023-07-21T22:37:23.898326+0000","last_undegraded":"2023-07-21T22:37:23.898326+0000","last_fullsized":"2023-07-21T22:37:23.898326+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:24:29.163797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.898214+0000","last_change":"2023-07-21T22:37:22.098593+0000","last_active":"2023-07-21T22:37:23.898214+0000","last_peered":"2023-07-21T22:37:23.898214+0000","last_clean":"2023-07-21T22:37:23.898214+0000","last_became_active":"2023-07-21T22:37:22.098310+0000","last_became_peered":"2023-07-21T22:37:22.098310+0000","last_unstale":"2023-07-21T22:37:23.898214+0000","last_undegraded":"2023-07-21T22:37:23.898214+0000","last_fullsized":"2023-07-21T22:37:23.898214+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:14.905799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090813+0000","last_change":"2023-07-21T22:37:22.101856+0000","last_active":"2023-07-21T22:37:23.090813+0000","last_peered":"2023-07-21T22:37:23.090813+0000","last_clean":"2023-07-21T22:37:23.090813+0000","last_became_active":"2023-07-21T22:37:22.101370+0000","last_became_peered":"2023-07-21T22:37:22.101370+0000","last_unstale":"2023-07-21T22:37:23.090813+0000","last_undegraded":"2023-07-21T22:37:23.090813+0000","last_fullsized":"2023-07-21T22:37:23.090813+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:47:58.300694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.089658+0000","last_change":"2023-07-21T22:37:22.098484+0000","last_active":"2023-07-21T22:37:23.089658+0000","last_peered":"2023-07-21T22:37:23.089658+0000","last_clean":"2023-07-21T22:37:23.089658+0000","last_became_active":"2023-07-21T22:37:22.098196+0000","last_became_peered":"2023-07-21T22:37:22.098196+0000","last_unstale":"2023-07-21T22:37:23.089658+0000","last_undegraded":"2023-07-21T22:37:23.089658+0000","last_fullsized":"2023-07-21T22:37:23.089658+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:42:57.880515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895428+0000","last_change":"2023-07-21T22:37:22.084542+0000","last_active":"2023-07-21T22:37:23.895428+0000","last_peered":"2023-07-21T22:37:23.895428+0000","last_clean":"2023-07-21T22:37:23.895428+0000","last_became_active":"2023-07-21T22:37:22.084264+0000","last_became_peered":"2023-07-21T22:37:22.084264+0000","last_unstale":"2023-07-21T22:37:23.895428+0000","last_undegraded":"2023-07-21T22:37:23.895428+0000","last_fullsized":"2023-07-21T22:37:23.895428+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:56:22.124534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897341+0000","last_change":"2023-07-21T22:37:22.102980+0000","last_active":"2023-07-21T22:37:23.897341+0000","last_peered":"2023-07-21T22:37:23.897341+0000","last_clean":"2023-07-21T22:37:23.897341+0000","last_became_active":"2023-07-21T22:37:22.102540+0000","last_became_peered":"2023-07-21T22:37:22.102540+0000","last_unstale":"2023-07-21T22:37:23.897341+0000","last_undegraded":"2023-07-21T22:37:23.897341+0000","last_fullsized":"2023-07-21T22:37:23.897341+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:20:59.270816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.089841+0000","last_change":"2023-07-21T22:37:22.097523+0000","last_active":"2023-07-21T22:37:23.089841+0000","last_peered":"2023-07-21T22:37:23.089841+0000","last_clean":"2023-07-21T22:37:23.089841+0000","last_became_active":"2023-07-21T22:37:22.097170+0000","last_became_peered":"2023-07-21T22:37:22.097170+0000","last_unstale":"2023-07-21T22:37:23.089841+0000","last_undegraded":"2023-07-21T22:37:23.089841+0000","last_fullsized":"2023-07-21T22:37:23.089841+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:50.889917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895132+0000","last_change":"2023-07-21T22:37:22.092194+0000","last_active":"2023-07-21T22:37:23.895132+0000","last_peered":"2023-07-21T22:37:23.895132+0000","last_clean":"2023-07-21T22:37:23.895132+0000","last_became_active":"2023-07-21T22:37:22.091618+0000","last_became_peered":"2023-07-21T22:37:22.091618+0000","last_unstale":"2023-07-21T22:37:23.895132+0000","last_undegraded":"2023-07-21T22:37:23.895132+0000","last_fullsized":"2023-07-21T22:37:23.895132+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:21:40.732882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894485+0000","last_change":"2023-07-21T22:37:22.104778+0000","last_active":"2023-07-21T22:37:23.894485+0000","last_peered":"2023-07-21T22:37:23.894485+0000","last_clean":"2023-07-21T22:37:23.894485+0000","last_became_active":"2023-07-21T22:37:22.104471+0000","last_became_peered":"2023-07-21T22:37:22.104471+0000","last_unstale":"2023-07-21T22:37:23.894485+0000","last_undegraded":"2023-07-21T22:37:23.894485+0000","last_fullsized":"2023-07-21T22:37:23.894485+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:25:48.345505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"127'4","reported_seq":17,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895770+0000","last_change":"2023-07-21T22:37:21.077330+0000","last_active":"2023-07-21T22:37:23.895770+0000","last_peered":"2023-07-21T22:37:23.895770+0000","last_clean":"2023-07-21T22:37:23.895770+0000","last_became_active":"2023-07-21T22:37:21.077027+0000","last_became_peered":"2023-07-21T22:37:21.077027+0000","last_unstale":"2023-07-21T22:37:23.895770+0000","last_undegraded":"2023-07-21T22:37:23.895770+0000","last_fullsized":"2023-07-21T22:37:23.895770+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:22:25.486881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.893904+0000","last_change":"2023-07-21T22:37:22.101145+0000","last_active":"2023-07-21T22:37:23.893904+0000","last_peered":"2023-07-21T22:37:23.893904+0000","last_clean":"2023-07-21T22:37:23.893904+0000","last_became_active":"2023-07-21T22:37:22.095785+0000","last_became_peered":"2023-07-21T22:37:22.095785+0000","last_unstale":"2023-07-21T22:37:23.893904+0000","last_undegraded":"2023-07-21T22:37:23.893904+0000","last_fullsized":"2023-07-21T22:37:23.893904+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:19:09.241414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"127'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894734+0000","last_change":"2023-07-21T22:37:21.078917+0000","last_active":"2023-07-21T22:37:23.894734+0000","last_peered":"2023-07-21T22:37:23.894734+0000","last_clean":"2023-07-21T22:37:23.894734+0000","last_became_active":"2023-07-21T22:37:21.078582+0000","last_became_peered":"2023-07-21T22:37:21.078582+0000","last_unstale":"2023-07-21T22:37:23.894734+0000","last_undegraded":"2023-07-21T22:37:23.894734+0000","last_fullsized":"2023-07-21T22:37:23.894734+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:58:52.170911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.898008+0000","last_change":"2023-07-21T22:37:22.102804+0000","last_active":"2023-07-21T22:37:23.898008+0000","last_peered":"2023-07-21T22:37:23.898008+0000","last_clean":"2023-07-21T22:37:23.898008+0000","last_became_active":"2023-07-21T22:37:22.102165+0000","last_became_peered":"2023-07-21T22:37:22.102165+0000","last_unstale":"2023-07-21T22:37:23.898008+0000","last_undegraded":"2023-07-21T22:37:23.898008+0000","last_fullsized":"2023-07-21T22:37:23.898008+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:07:04.731224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.898055+0000","last_change":"2023-07-21T22:37:21.071615+0000","last_active":"2023-07-21T22:37:23.898055+0000","last_peered":"2023-07-21T22:37:23.898055+0000","last_clean":"2023-07-21T22:37:23.898055+0000","last_became_active":"2023-07-21T22:37:21.071287+0000","last_became_peered":"2023-07-21T22:37:21.071287+0000","last_unstale":"2023-07-21T22:37:23.898055+0000","last_undegraded":"2023-07-21T22:37:23.898055+0000","last_fullsized":"2023-07-21T22:37:23.898055+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:25:41.786891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090008+0000","last_change":"2023-07-21T22:37:22.102928+0000","last_active":"2023-07-21T22:37:23.090008+0000","last_peered":"2023-07-21T22:37:23.090008+0000","last_clean":"2023-07-21T22:37:23.090008+0000","last_became_active":"2023-07-21T22:37:22.102556+0000","last_became_peered":"2023-07-21T22:37:22.102556+0000","last_unstale":"2023-07-21T22:37:23.090008+0000","last_undegraded":"2023-07-21T22:37:23.090008+0000","last_fullsized":"2023-07-21T22:37:23.090008+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:01:47.946114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085977+0000","last_change":"2023-07-21T22:37:21.063348+0000","last_active":"2023-07-21T22:37:23.085977+0000","last_peered":"2023-07-21T22:37:23.085977+0000","last_clean":"2023-07-21T22:37:23.085977+0000","last_became_active":"2023-07-21T22:37:21.062717+0000","last_became_peered":"2023-07-21T22:37:21.062717+0000","last_unstale":"2023-07-21T22:37:23.085977+0000","last_undegraded":"2023-07-21T22:37:23.085977+0000","last_fullsized":"2023-07-21T22:37:23.085977+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:43:30.392443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.896006+0000","last_change":"2023-07-21T22:37:22.098541+0000","last_active":"2023-07-21T22:37:23.896006+0000","last_peered":"2023-07-21T22:37:23.896006+0000","last_clean":"2023-07-21T22:37:23.896006+0000","last_became_active":"2023-07-21T22:37:22.097987+0000","last_became_peered":"2023-07-21T22:37:22.097987+0000","last_unstale":"2023-07-21T22:37:23.896006+0000","last_undegraded":"2023-07-21T22:37:23.896006+0000","last_fullsized":"2023-07-21T22:37:23.896006+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:55:54.548193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"127'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897633+0000","last_change":"2023-07-21T22:37:21.078218+0000","last_active":"2023-07-21T22:37:23.897633+0000","last_peered":"2023-07-21T22:37:23.897633+0000","last_clean":"2023-07-21T22:37:23.897633+0000","last_became_active":"2023-07-21T22:37:21.077942+0000","last_became_peered":"2023-07-21T22:37:21.077942+0000","last_unstale":"2023-07-21T22:37:23.897633+0000","last_undegraded":"2023-07-21T22:37:23.897633+0000","last_fullsized":"2023-07-21T22:37:23.897633+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:12:48.358296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895650+0000","last_change":"2023-07-21T22:37:22.104910+0000","last_active":"2023-07-21T22:37:23.895650+0000","last_peered":"2023-07-21T22:37:23.895650+0000","last_clean":"2023-07-21T22:37:23.895650+0000","last_became_active":"2023-07-21T22:37:22.104624+0000","last_became_peered":"2023-07-21T22:37:22.104624+0000","last_unstale":"2023-07-21T22:37:23.895650+0000","last_undegraded":"2023-07-21T22:37:23.895650+0000","last_fullsized":"2023-07-21T22:37:23.895650+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:11:24.701510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"127'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.089656+0000","last_change":"2023-07-21T22:37:21.072265+0000","last_active":"2023-07-21T22:37:23.089656+0000","last_peered":"2023-07-21T22:37:23.089656+0000","last_clean":"2023-07-21T22:37:23.089656+0000","last_became_active":"2023-07-21T22:37:21.071996+0000","last_became_peered":"2023-07-21T22:37:21.071996+0000","last_unstale":"2023-07-21T22:37:23.089656+0000","last_undegraded":"2023-07-21T22:37:23.089656+0000","last_fullsized":"2023-07-21T22:37:23.089656+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:18:26.267351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.091067+0000","last_change":"2023-07-21T22:37:22.104281+0000","last_active":"2023-07-21T22:37:23.091067+0000","last_peered":"2023-07-21T22:37:23.091067+0000","last_clean":"2023-07-21T22:37:23.091067+0000","last_became_active":"2023-07-21T22:37:22.103587+0000","last_became_peered":"2023-07-21T22:37:22.103587+0000","last_unstale":"2023-07-21T22:37:23.091067+0000","last_undegraded":"2023-07-21T22:37:23.091067+0000","last_fullsized":"2023-07-21T22:37:23.091067+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:27:57.000276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897288+0000","last_change":"2023-07-21T22:37:21.070105+0000","last_active":"2023-07-21T22:37:23.897288+0000","last_peered":"2023-07-21T22:37:23.897288+0000","last_clean":"2023-07-21T22:37:23.897288+0000","last_became_active":"2023-07-21T22:37:21.069728+0000","last_became_peered":"2023-07-21T22:37:21.069728+0000","last_unstale":"2023-07-21T22:37:23.897288+0000","last_undegraded":"2023-07-21T22:37:23.897288+0000","last_fullsized":"2023-07-21T22:37:23.897288+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:19:19.825592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895745+0000","last_change":"2023-07-21T22:37:22.101464+0000","last_active":"2023-07-21T22:37:23.895745+0000","last_peered":"2023-07-21T22:37:23.895745+0000","last_clean":"2023-07-21T22:37:23.895745+0000","last_became_active":"2023-07-21T22:37:22.101180+0000","last_became_peered":"2023-07-21T22:37:22.101180+0000","last_unstale":"2023-07-21T22:37:23.895745+0000","last_undegraded":"2023-07-21T22:37:23.895745+0000","last_fullsized":"2023-07-21T22:37:23.895745+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:38:09.434083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894233+0000","last_change":"2023-07-21T22:37:21.068302+0000","last_active":"2023-07-21T22:37:23.894233+0000","last_peered":"2023-07-21T22:37:23.894233+0000","last_clean":"2023-07-21T22:37:23.894233+0000","last_became_active":"2023-07-21T22:37:21.068014+0000","last_became_peered":"2023-07-21T22:37:21.068014+0000","last_unstale":"2023-07-21T22:37:23.894233+0000","last_undegraded":"2023-07-21T22:37:23.894233+0000","last_fullsized":"2023-07-21T22:37:23.894233+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:09:06.236261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894422+0000","last_change":"2023-07-21T22:37:22.104016+0000","last_active":"2023-07-21T22:37:23.894422+0000","last_peered":"2023-07-21T22:37:23.894422+0000","last_clean":"2023-07-21T22:37:23.894422+0000","last_became_active":"2023-07-21T22:37:22.103730+0000","last_became_peered":"2023-07-21T22:37:22.103730+0000","last_unstale":"2023-07-21T22:37:23.894422+0000","last_undegraded":"2023-07-21T22:37:23.894422+0000","last_fullsized":"2023-07-21T22:37:23.894422+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:16:42.895407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.898359+0000","last_change":"2023-07-21T22:37:21.072005+0000","last_active":"2023-07-21T22:37:23.898359+0000","last_peered":"2023-07-21T22:37:23.898359+0000","last_clean":"2023-07-21T22:37:23.898359+0000","last_became_active":"2023-07-21T22:37:21.071724+0000","last_became_peered":"2023-07-21T22:37:21.071724+0000","last_unstale":"2023-07-21T22:37:23.898359+0000","last_undegraded":"2023-07-21T22:37:23.898359+0000","last_fullsized":"2023-07-21T22:37:23.898359+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:43:02.829969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085480+0000","last_change":"2023-07-21T22:37:22.093848+0000","last_active":"2023-07-21T22:37:23.085480+0000","last_peered":"2023-07-21T22:37:23.085480+0000","last_clean":"2023-07-21T22:37:23.085480+0000","last_became_active":"2023-07-21T22:37:22.093563+0000","last_became_peered":"2023-07-21T22:37:22.093563+0000","last_unstale":"2023-07-21T22:37:23.085480+0000","last_undegraded":"2023-07-21T22:37:23.085480+0000","last_fullsized":"2023-07-21T22:37:23.085480+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:32:54.448580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894914+0000","last_change":"2023-07-21T22:37:21.071932+0000","last_active":"2023-07-21T22:37:23.894914+0000","last_peered":"2023-07-21T22:37:23.894914+0000","last_clean":"2023-07-21T22:37:23.894914+0000","last_became_active":"2023-07-21T22:37:21.071545+0000","last_became_peered":"2023-07-21T22:37:21.071545+0000","last_unstale":"2023-07-21T22:37:23.894914+0000","last_undegraded":"2023-07-21T22:37:23.894914+0000","last_fullsized":"2023-07-21T22:37:23.894914+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:30:20.966969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895039+0000","last_change":"2023-07-21T22:37:22.096402+0000","last_active":"2023-07-21T22:37:23.895039+0000","last_peered":"2023-07-21T22:37:23.895039+0000","last_clean":"2023-07-21T22:37:23.895039+0000","last_became_active":"2023-07-21T22:37:22.095411+0000","last_became_peered":"2023-07-21T22:37:22.095411+0000","last_unstale":"2023-07-21T22:37:23.895039+0000","last_undegraded":"2023-07-21T22:37:23.895039+0000","last_fullsized":"2023-07-21T22:37:23.895039+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:35:46.344835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"127'3","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897808+0000","last_change":"2023-07-21T22:37:21.074517+0000","last_active":"2023-07-21T22:37:23.897808+0000","last_peered":"2023-07-21T22:37:23.897808+0000","last_clean":"2023-07-21T22:37:23.897808+0000","last_became_active":"2023-07-21T22:37:21.074054+0000","last_became_peered":"2023-07-21T22:37:21.074054+0000","last_unstale":"2023-07-21T22:37:23.897808+0000","last_undegraded":"2023-07-21T22:37:23.897808+0000","last_fullsized":"2023-07-21T22:37:23.897808+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:50:33.770314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085871+0000","last_change":"2023-07-21T22:37:22.095006+0000","last_active":"2023-07-21T22:37:23.085871+0000","last_peered":"2023-07-21T22:37:23.085871+0000","last_clean":"2023-07-21T22:37:23.085871+0000","last_became_active":"2023-07-21T22:37:22.094707+0000","last_became_peered":"2023-07-21T22:37:22.094707+0000","last_unstale":"2023-07-21T22:37:23.085871+0000","last_undegraded":"2023-07-21T22:37:23.085871+0000","last_fullsized":"2023-07-21T22:37:23.085871+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:05:25.043084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"127'6","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090642+0000","last_change":"2023-07-21T22:37:21.078493+0000","last_active":"2023-07-21T22:37:23.090642+0000","last_peered":"2023-07-21T22:37:23.090642+0000","last_clean":"2023-07-21T22:37:23.090642+0000","last_became_active":"2023-07-21T22:37:21.078199+0000","last_became_peered":"2023-07-21T22:37:21.078199+0000","last_unstale":"2023-07-21T22:37:23.090642+0000","last_undegraded":"2023-07-21T22:37:23.090642+0000","last_fullsized":"2023-07-21T22:37:23.090642+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:54:58.828951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090361+0000","last_change":"2023-07-21T22:37:22.109910+0000","last_active":"2023-07-21T22:37:23.090361+0000","last_peered":"2023-07-21T22:37:23.090361+0000","last_clean":"2023-07-21T22:37:23.090361+0000","last_became_active":"2023-07-21T22:37:22.109641+0000","last_became_peered":"2023-07-21T22:37:22.109641+0000","last_unstale":"2023-07-21T22:37:23.090361+0000","last_undegraded":"2023-07-21T22:37:23.090361+0000","last_fullsized":"2023-07-21T22:37:23.090361+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:15:28.542594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085789+0000","last_change":"2023-07-21T22:37:21.068918+0000","last_active":"2023-07-21T22:37:23.085789+0000","last_peered":"2023-07-21T22:37:23.085789+0000","last_clean":"2023-07-21T22:37:23.085789+0000","last_became_active":"2023-07-21T22:37:21.068632+0000","last_became_peered":"2023-07-21T22:37:21.068632+0000","last_unstale":"2023-07-21T22:37:23.085789+0000","last_undegraded":"2023-07-21T22:37:23.085789+0000","last_fullsized":"2023-07-21T22:37:23.085789+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:59:08.055565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090519+0000","last_change":"2023-07-21T22:37:22.094829+0000","last_active":"2023-07-21T22:37:23.090519+0000","last_peered":"2023-07-21T22:37:23.090519+0000","last_clean":"2023-07-21T22:37:23.090519+0000","last_became_active":"2023-07-21T22:37:22.094548+0000","last_became_peered":"2023-07-21T22:37:22.094548+0000","last_unstale":"2023-07-21T22:37:23.090519+0000","last_undegraded":"2023-07-21T22:37:23.090519+0000","last_fullsized":"2023-07-21T22:37:23.090519+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:49:28.560586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895384+0000","last_change":"2023-07-21T22:37:21.066648+0000","last_active":"2023-07-21T22:37:23.895384+0000","last_peered":"2023-07-21T22:37:23.895384+0000","last_clean":"2023-07-21T22:37:23.895384+0000","last_became_active":"2023-07-21T22:37:21.066313+0000","last_became_peered":"2023-07-21T22:37:21.066313+0000","last_unstale":"2023-07-21T22:37:23.895384+0000","last_undegraded":"2023-07-21T22:37:23.895384+0000","last_fullsized":"2023-07-21T22:37:23.895384+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:03:38.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894600+0000","last_change":"2023-07-21T22:37:22.092130+0000","last_active":"2023-07-21T22:37:23.894600+0000","last_peered":"2023-07-21T22:37:23.894600+0000","last_clean":"2023-07-21T22:37:23.894600+0000","last_became_active":"2023-07-21T22:37:22.091844+0000","last_became_peered":"2023-07-21T22:37:22.091844+0000","last_unstale":"2023-07-21T22:37:23.894600+0000","last_undegraded":"2023-07-21T22:37:23.894600+0000","last_fullsized":"2023-07-21T22:37:23.894600+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:34:15.058316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894074+0000","last_change":"2023-07-21T22:37:21.075668+0000","last_active":"2023-07-21T22:37:23.894074+0000","last_peered":"2023-07-21T22:37:23.894074+0000","last_clean":"2023-07-21T22:37:23.894074+0000","last_became_active":"2023-07-21T22:37:21.075393+0000","last_became_peered":"2023-07-21T22:37:21.075393+0000","last_unstale":"2023-07-21T22:37:23.894074+0000","last_undegraded":"2023-07-21T22:37:23.894074+0000","last_fullsized":"2023-07-21T22:37:23.894074+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:39:04.737576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895185+0000","last_change":"2023-07-21T22:37:22.100819+0000","last_active":"2023-07-21T22:37:23.895185+0000","last_peered":"2023-07-21T22:37:23.895185+0000","last_clean":"2023-07-21T22:37:23.895185+0000","last_became_active":"2023-07-21T22:37:22.100543+0000","last_became_peered":"2023-07-21T22:37:22.100543+0000","last_unstale":"2023-07-21T22:37:23.895185+0000","last_undegraded":"2023-07-21T22:37:23.895185+0000","last_fullsized":"2023-07-21T22:37:23.895185+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:16:02.039951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"127'8","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897292+0000","last_change":"2023-07-21T22:37:21.070598+0000","last_active":"2023-07-21T22:37:23.897292+0000","last_peered":"2023-07-21T22:37:23.897292+0000","last_clean":"2023-07-21T22:37:23.897292+0000","last_became_active":"2023-07-21T22:37:21.069746+0000","last_became_peered":"2023-07-21T22:37:21.069746+0000","last_unstale":"2023-07-21T22:37:23.897292+0000","last_undegraded":"2023-07-21T22:37:23.897292+0000","last_fullsized":"2023-07-21T22:37:23.897292+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:28:56.048617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894313+0000","last_change":"2023-07-21T22:37:22.105316+0000","last_active":"2023-07-21T22:37:23.894313+0000","last_peered":"2023-07-21T22:37:23.894313+0000","last_clean":"2023-07-21T22:37:23.894313+0000","last_became_active":"2023-07-21T22:37:22.104988+0000","last_became_peered":"2023-07-21T22:37:22.104988+0000","last_unstale":"2023-07-21T22:37:23.894313+0000","last_undegraded":"2023-07-21T22:37:23.894313+0000","last_fullsized":"2023-07-21T22:37:23.894313+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:53:31.061722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085631+0000","last_change":"2023-07-21T22:37:21.079461+0000","last_active":"2023-07-21T22:37:23.085631+0000","last_peered":"2023-07-21T22:37:23.085631+0000","last_clean":"2023-07-21T22:37:23.085631+0000","last_became_active":"2023-07-21T22:37:21.079152+0000","last_became_peered":"2023-07-21T22:37:21.079152+0000","last_unstale":"2023-07-21T22:37:23.085631+0000","last_undegraded":"2023-07-21T22:37:23.085631+0000","last_fullsized":"2023-07-21T22:37:23.085631+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:04:21.277761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897231+0000","last_change":"2023-07-21T22:37:22.096058+0000","last_active":"2023-07-21T22:37:23.897231+0000","last_peered":"2023-07-21T22:37:23.897231+0000","last_clean":"2023-07-21T22:37:23.897231+0000","last_became_active":"2023-07-21T22:37:22.095746+0000","last_became_peered":"2023-07-21T22:37:22.095746+0000","last_unstale":"2023-07-21T22:37:23.897231+0000","last_undegraded":"2023-07-21T22:37:23.897231+0000","last_fullsized":"2023-07-21T22:37:23.897231+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:10.697508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"128'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895120+0000","last_change":"2023-07-21T22:37:21.066856+0000","last_active":"2023-07-21T22:37:23.895120+0000","last_peered":"2023-07-21T22:37:23.895120+0000","last_clean":"2023-07-21T22:37:23.895120+0000","last_became_active":"2023-07-21T22:37:21.066089+0000","last_became_peered":"2023-07-21T22:37:21.066089+0000","last_unstale":"2023-07-21T22:37:23.895120+0000","last_undegraded":"2023-07-21T22:37:23.895120+0000","last_fullsized":"2023-07-21T22:37:23.895120+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:50:33.765050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895376+0000","last_change":"2023-07-21T22:37:22.095449+0000","last_active":"2023-07-21T22:37:23.895376+0000","last_peered":"2023-07-21T22:37:23.895376+0000","last_clean":"2023-07-21T22:37:23.895376+0000","last_became_active":"2023-07-21T22:37:22.095111+0000","last_became_peered":"2023-07-21T22:37:22.095111+0000","last_unstale":"2023-07-21T22:37:23.895376+0000","last_undegraded":"2023-07-21T22:37:23.895376+0000","last_fullsized":"2023-07-21T22:37:23.895376+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:10:18.979950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090592+0000","last_change":"2023-07-21T22:37:21.078173+0000","last_active":"2023-07-21T22:37:23.090592+0000","last_peered":"2023-07-21T22:37:23.090592+0000","last_clean":"2023-07-21T22:37:23.090592+0000","last_became_active":"2023-07-21T22:37:21.077879+0000","last_became_peered":"2023-07-21T22:37:21.077879+0000","last_unstale":"2023-07-21T22:37:23.090592+0000","last_undegraded":"2023-07-21T22:37:23.090592+0000","last_fullsized":"2023-07-21T22:37:23.090592+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:44:40.573704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.089923+0000","last_change":"2023-07-21T22:37:22.102991+0000","last_active":"2023-07-21T22:37:23.089923+0000","last_peered":"2023-07-21T22:37:23.089923+0000","last_clean":"2023-07-21T22:37:23.089923+0000","last_became_active":"2023-07-21T22:37:22.102622+0000","last_became_peered":"2023-07-21T22:37:22.102622+0000","last_unstale":"2023-07-21T22:37:23.089923+0000","last_undegraded":"2023-07-21T22:37:23.089923+0000","last_fullsized":"2023-07-21T22:37:23.089923+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:58:02.622539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085940+0000","last_change":"2023-07-21T22:37:21.077940+0000","last_active":"2023-07-21T22:37:23.085940+0000","last_peered":"2023-07-21T22:37:23.085940+0000","last_clean":"2023-07-21T22:37:23.085940+0000","last_became_active":"2023-07-21T22:37:21.077593+0000","last_became_peered":"2023-07-21T22:37:21.077593+0000","last_unstale":"2023-07-21T22:37:23.085940+0000","last_undegraded":"2023-07-21T22:37:23.085940+0000","last_fullsized":"2023-07-21T22:37:23.085940+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:13:11.119495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894278+0000","last_change":"2023-07-21T22:37:22.096917+0000","last_active":"2023-07-21T22:37:23.894278+0000","last_peered":"2023-07-21T22:37:23.894278+0000","last_clean":"2023-07-21T22:37:23.894278+0000","last_became_active":"2023-07-21T22:37:22.096593+0000","last_became_peered":"2023-07-21T22:37:22.096593+0000","last_unstale":"2023-07-21T22:37:23.894278+0000","last_undegraded":"2023-07-21T22:37:23.894278+0000","last_fullsized":"2023-07-21T22:37:23.894278+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:34:09.895860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.898052+0000","last_change":"2023-07-21T22:37:21.075547+0000","last_active":"2023-07-21T22:37:23.898052+0000","last_peered":"2023-07-21T22:37:23.898052+0000","last_clean":"2023-07-21T22:37:23.898052+0000","last_became_active":"2023-07-21T22:37:21.075261+0000","last_became_peered":"2023-07-21T22:37:21.075261+0000","last_unstale":"2023-07-21T22:37:23.898052+0000","last_undegraded":"2023-07-21T22:37:23.898052+0000","last_fullsized":"2023-07-21T22:37:23.898052+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:53:52.562392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894437+0000","last_change":"2023-07-21T22:37:22.096293+0000","last_active":"2023-07-21T22:37:23.894437+0000","last_peered":"2023-07-21T22:37:23.894437+0000","last_clean":"2023-07-21T22:37:23.894437+0000","last_became_active":"2023-07-21T22:37:22.096001+0000","last_became_peered":"2023-07-21T22:37:22.096001+0000","last_unstale":"2023-07-21T22:37:23.894437+0000","last_undegraded":"2023-07-21T22:37:23.894437+0000","last_fullsized":"2023-07-21T22:37:23.894437+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:08:15.617249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894111+0000","last_change":"2023-07-21T22:37:21.076789+0000","last_active":"2023-07-21T22:37:23.894111+0000","last_peered":"2023-07-21T22:37:23.894111+0000","last_clean":"2023-07-21T22:37:23.894111+0000","last_became_active":"2023-07-21T22:37:21.076497+0000","last_became_peered":"2023-07-21T22:37:21.076497+0000","last_unstale":"2023-07-21T22:37:23.894111+0000","last_undegraded":"2023-07-21T22:37:23.894111+0000","last_fullsized":"2023-07-21T22:37:23.894111+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:48:03.217543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897717+0000","last_change":"2023-07-21T22:37:22.102450+0000","last_active":"2023-07-21T22:37:23.897717+0000","last_peered":"2023-07-21T22:37:23.897717+0000","last_clean":"2023-07-21T22:37:23.897717+0000","last_became_active":"2023-07-21T22:37:22.102161+0000","last_became_peered":"2023-07-21T22:37:22.102161+0000","last_unstale":"2023-07-21T22:37:23.897717+0000","last_undegraded":"2023-07-21T22:37:23.897717+0000","last_fullsized":"2023-07-21T22:37:23.897717+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:35:55.555978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.089961+0000","last_change":"2023-07-21T22:37:21.079413+0000","last_active":"2023-07-21T22:37:23.089961+0000","last_peered":"2023-07-21T22:37:23.089961+0000","last_clean":"2023-07-21T22:37:23.089961+0000","last_became_active":"2023-07-21T22:37:21.079087+0000","last_became_peered":"2023-07-21T22:37:21.079087+0000","last_unstale":"2023-07-21T22:37:23.089961+0000","last_undegraded":"2023-07-21T22:37:23.089961+0000","last_fullsized":"2023-07-21T22:37:23.089961+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:38:31.776033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090940+0000","last_change":"2023-07-21T22:37:22.097186+0000","last_active":"2023-07-21T22:37:23.090940+0000","last_peered":"2023-07-21T22:37:23.090940+0000","last_clean":"2023-07-21T22:37:23.090940+0000","last_became_active":"2023-07-21T22:37:22.096870+0000","last_became_peered":"2023-07-21T22:37:22.096870+0000","last_unstale":"2023-07-21T22:37:23.090940+0000","last_undegraded":"2023-07-21T22:37:23.090940+0000","last_fullsized":"2023-07-21T22:37:23.090940+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:29:45.521760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895420+0000","last_change":"2023-07-21T22:37:21.075785+0000","last_active":"2023-07-21T22:37:23.895420+0000","last_peered":"2023-07-21T22:37:23.895420+0000","last_clean":"2023-07-21T22:37:23.895420+0000","last_became_active":"2023-07-21T22:37:21.075437+0000","last_became_peered":"2023-07-21T22:37:21.075437+0000","last_unstale":"2023-07-21T22:37:23.895420+0000","last_undegraded":"2023-07-21T22:37:23.895420+0000","last_fullsized":"2023-07-21T22:37:23.895420+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:29:04.258564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.089657+0000","last_change":"2023-07-21T22:37:22.103922+0000","last_active":"2023-07-21T22:37:23.089657+0000","last_peered":"2023-07-21T22:37:23.089657+0000","last_clean":"2023-07-21T22:37:23.089657+0000","last_became_active":"2023-07-21T22:37:22.103622+0000","last_became_peered":"2023-07-21T22:37:22.103622+0000","last_unstale":"2023-07-21T22:37:23.089657+0000","last_undegraded":"2023-07-21T22:37:23.089657+0000","last_fullsized":"2023-07-21T22:37:23.089657+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:53:50.225297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894869+0000","last_change":"2023-07-21T22:37:21.079237+0000","last_active":"2023-07-21T22:37:23.894869+0000","last_peered":"2023-07-21T22:37:23.894869+0000","last_clean":"2023-07-21T22:37:23.894869+0000","last_became_active":"2023-07-21T22:37:21.078935+0000","last_became_peered":"2023-07-21T22:37:21.078935+0000","last_unstale":"2023-07-21T22:37:23.894869+0000","last_undegraded":"2023-07-21T22:37:23.894869+0000","last_fullsized":"2023-07-21T22:37:23.894869+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:01:48.375613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"116'227","reported_seq":752,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897498+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:37:23.897498+0000","last_peered":"2023-07-21T22:37:23.897498+0000","last_clean":"2023-07-21T22:37:23.897498+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:37:23.897498+0000","last_undegraded":"2023-07-21T22:37:23.897498+0000","last_fullsized":"2023-07-21T22:37:23.897498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:10:09.085810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090111+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:37:23.090111+0000","last_peered":"2023-07-21T22:37:23.090111+0000","last_clean":"2023-07-21T22:37:23.090111+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:37:23.090111+0000","last_undegraded":"2023-07-21T22:37:23.090111+0000","last_fullsized":"2023-07-21T22:37:23.090111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:16.716451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090122+0000","last_change":"2023-07-21T22:37:22.100051+0000","last_active":"2023-07-21T22:37:23.090122+0000","last_peered":"2023-07-21T22:37:23.090122+0000","last_clean":"2023-07-21T22:37:23.090122+0000","last_became_active":"2023-07-21T22:37:22.099760+0000","last_became_peered":"2023-07-21T22:37:22.099760+0000","last_unstale":"2023-07-21T22:37:23.090122+0000","last_undegraded":"2023-07-21T22:37:23.090122+0000","last_fullsized":"2023-07-21T22:37:23.090122+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:47:14.048064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"127'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897716+0000","last_change":"2023-07-21T22:37:21.075739+0000","last_active":"2023-07-21T22:37:23.897716+0000","last_peered":"2023-07-21T22:37:23.897716+0000","last_clean":"2023-07-21T22:37:23.897716+0000","last_became_active":"2023-07-21T22:37:21.075418+0000","last_became_peered":"2023-07-21T22:37:21.075418+0000","last_unstale":"2023-07-21T22:37:23.897716+0000","last_undegraded":"2023-07-21T22:37:23.897716+0000","last_fullsized":"2023-07-21T22:37:23.897716+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:25:50.222839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897331+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:37:23.897331+0000","last_peered":"2023-07-21T22:37:23.897331+0000","last_clean":"2023-07-21T22:37:23.897331+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:37:23.897331+0000","last_undegraded":"2023-07-21T22:37:23.897331+0000","last_fullsized":"2023-07-21T22:37:23.897331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:21.855598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085624+0000","last_change":"2023-07-21T22:37:22.096666+0000","last_active":"2023-07-21T22:37:23.085624+0000","last_peered":"2023-07-21T22:37:23.085624+0000","last_clean":"2023-07-21T22:37:23.085624+0000","last_became_active":"2023-07-21T22:37:22.094428+0000","last_became_peered":"2023-07-21T22:37:22.094428+0000","last_unstale":"2023-07-21T22:37:23.085624+0000","last_undegraded":"2023-07-21T22:37:23.085624+0000","last_fullsized":"2023-07-21T22:37:23.085624+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:17:40.482680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090230+0000","last_change":"2023-07-21T22:37:21.079660+0000","last_active":"2023-07-21T22:37:23.090230+0000","last_peered":"2023-07-21T22:37:23.090230+0000","last_clean":"2023-07-21T22:37:23.090230+0000","last_became_active":"2023-07-21T22:37:21.079340+0000","last_became_peered":"2023-07-21T22:37:21.079340+0000","last_unstale":"2023-07-21T22:37:23.090230+0000","last_undegraded":"2023-07-21T22:37:23.090230+0000","last_fullsized":"2023-07-21T22:37:23.090230+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:49:00.428677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895068+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:37:23.895068+0000","last_peered":"2023-07-21T22:37:23.895068+0000","last_clean":"2023-07-21T22:37:23.895068+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:37:23.895068+0000","last_undegraded":"2023-07-21T22:37:23.895068+0000","last_fullsized":"2023-07-21T22:37:23.895068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:31.034805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895257+0000","last_change":"2023-07-21T22:37:22.103174+0000","last_active":"2023-07-21T22:37:23.895257+0000","last_peered":"2023-07-21T22:37:23.895257+0000","last_clean":"2023-07-21T22:37:23.895257+0000","last_became_active":"2023-07-21T22:37:22.102794+0000","last_became_peered":"2023-07-21T22:37:22.102794+0000","last_unstale":"2023-07-21T22:37:23.895257+0000","last_undegraded":"2023-07-21T22:37:23.895257+0000","last_fullsized":"2023-07-21T22:37:23.895257+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:50:32.597539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"127'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.091003+0000","last_change":"2023-07-21T22:37:21.078854+0000","last_active":"2023-07-21T22:37:23.091003+0000","last_peered":"2023-07-21T22:37:23.091003+0000","last_clean":"2023-07-21T22:37:23.091003+0000","last_became_active":"2023-07-21T22:37:21.078575+0000","last_became_peered":"2023-07-21T22:37:21.078575+0000","last_unstale":"2023-07-21T22:37:23.091003+0000","last_undegraded":"2023-07-21T22:37:23.091003+0000","last_fullsized":"2023-07-21T22:37:23.091003+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:00:23.752947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.089768+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:37:23.089768+0000","last_peered":"2023-07-21T22:37:23.089768+0000","last_clean":"2023-07-21T22:37:23.089768+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:37:23.089768+0000","last_undegraded":"2023-07-21T22:37:23.089768+0000","last_fullsized":"2023-07-21T22:37:23.089768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:03:44.470488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894743+0000","last_change":"2023-07-21T22:37:22.095754+0000","last_active":"2023-07-21T22:37:23.894743+0000","last_peered":"2023-07-21T22:37:23.894743+0000","last_clean":"2023-07-21T22:37:23.894743+0000","last_became_active":"2023-07-21T22:37:22.095277+0000","last_became_peered":"2023-07-21T22:37:22.095277+0000","last_unstale":"2023-07-21T22:37:23.894743+0000","last_undegraded":"2023-07-21T22:37:23.894743+0000","last_fullsized":"2023-07-21T22:37:23.894743+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:28:16.432570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.089910+0000","last_change":"2023-07-21T22:37:21.078876+0000","last_active":"2023-07-21T22:37:23.089910+0000","last_peered":"2023-07-21T22:37:23.089910+0000","last_clean":"2023-07-21T22:37:23.089910+0000","last_became_active":"2023-07-21T22:37:21.078596+0000","last_became_peered":"2023-07-21T22:37:21.078596+0000","last_unstale":"2023-07-21T22:37:23.089910+0000","last_undegraded":"2023-07-21T22:37:23.089910+0000","last_fullsized":"2023-07-21T22:37:23.089910+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:53:38.824207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.086043+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:37:23.086043+0000","last_peered":"2023-07-21T22:37:23.086043+0000","last_clean":"2023-07-21T22:37:23.086043+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:37:23.086043+0000","last_undegraded":"2023-07-21T22:37:23.086043+0000","last_fullsized":"2023-07-21T22:37:23.086043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:33.030520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894122+0000","last_change":"2023-07-21T22:37:22.096709+0000","last_active":"2023-07-21T22:37:23.894122+0000","last_peered":"2023-07-21T22:37:23.894122+0000","last_clean":"2023-07-21T22:37:23.894122+0000","last_became_active":"2023-07-21T22:37:22.096087+0000","last_became_peered":"2023-07-21T22:37:22.096087+0000","last_unstale":"2023-07-21T22:37:23.894122+0000","last_undegraded":"2023-07-21T22:37:23.894122+0000","last_fullsized":"2023-07-21T22:37:23.894122+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:40:48.903412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895273+0000","last_change":"2023-07-21T22:37:21.075411+0000","last_active":"2023-07-21T22:37:23.895273+0000","last_peered":"2023-07-21T22:37:23.895273+0000","last_clean":"2023-07-21T22:37:23.895273+0000","last_became_active":"2023-07-21T22:37:21.075095+0000","last_became_peered":"2023-07-21T22:37:21.075095+0000","last_unstale":"2023-07-21T22:37:23.895273+0000","last_undegraded":"2023-07-21T22:37:23.895273+0000","last_fullsized":"2023-07-21T22:37:23.895273+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:12:52.089664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897867+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:37:23.897867+0000","last_peered":"2023-07-21T22:37:23.897867+0000","last_clean":"2023-07-21T22:37:23.897867+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:37:23.897867+0000","last_undegraded":"2023-07-21T22:37:23.897867+0000","last_fullsized":"2023-07-21T22:37:23.897867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:20:37.131269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894972+0000","last_change":"2023-07-21T22:37:22.106950+0000","last_active":"2023-07-21T22:37:23.894972+0000","last_peered":"2023-07-21T22:37:23.894972+0000","last_clean":"2023-07-21T22:37:23.894972+0000","last_became_active":"2023-07-21T22:37:22.106662+0000","last_became_peered":"2023-07-21T22:37:22.106662+0000","last_unstale":"2023-07-21T22:37:23.894972+0000","last_undegraded":"2023-07-21T22:37:23.894972+0000","last_fullsized":"2023-07-21T22:37:23.894972+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:11:41.213853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895643+0000","last_change":"2023-07-21T22:37:21.075461+0000","last_active":"2023-07-21T22:37:23.895643+0000","last_peered":"2023-07-21T22:37:23.895643+0000","last_clean":"2023-07-21T22:37:23.895643+0000","last_became_active":"2023-07-21T22:37:21.075125+0000","last_became_peered":"2023-07-21T22:37:21.075125+0000","last_unstale":"2023-07-21T22:37:23.895643+0000","last_undegraded":"2023-07-21T22:37:23.895643+0000","last_fullsized":"2023-07-21T22:37:23.895643+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:20:12.305387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085728+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:37:23.085728+0000","last_peered":"2023-07-21T22:37:23.085728+0000","last_clean":"2023-07-21T22:37:23.085728+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:37:23.085728+0000","last_undegraded":"2023-07-21T22:37:23.085728+0000","last_fullsized":"2023-07-21T22:37:23.085728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:29:14.065486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895566+0000","last_change":"2023-07-21T22:37:22.099935+0000","last_active":"2023-07-21T22:37:23.895566+0000","last_peered":"2023-07-21T22:37:23.895566+0000","last_clean":"2023-07-21T22:37:23.895566+0000","last_became_active":"2023-07-21T22:37:22.099214+0000","last_became_peered":"2023-07-21T22:37:22.099214+0000","last_unstale":"2023-07-21T22:37:23.895566+0000","last_undegraded":"2023-07-21T22:37:23.895566+0000","last_fullsized":"2023-07-21T22:37:23.895566+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:04:30.085035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.893896+0000","last_change":"2023-07-21T22:37:21.073046+0000","last_active":"2023-07-21T22:37:23.893896+0000","last_peered":"2023-07-21T22:37:23.893896+0000","last_clean":"2023-07-21T22:37:23.893896+0000","last_became_active":"2023-07-21T22:37:21.072789+0000","last_became_peered":"2023-07-21T22:37:21.072789+0000","last_unstale":"2023-07-21T22:37:23.893896+0000","last_undegraded":"2023-07-21T22:37:23.893896+0000","last_fullsized":"2023-07-21T22:37:23.893896+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:33:08.085011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":201,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.091156+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:37:23.091156+0000","last_peered":"2023-07-21T22:37:23.091156+0000","last_clean":"2023-07-21T22:37:23.091156+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:37:23.091156+0000","last_undegraded":"2023-07-21T22:37:23.091156+0000","last_fullsized":"2023-07-21T22:37:23.091156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:52:30.092132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509665,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59412,"kb_used_data":2124,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312428,"statfs":{"total":96636764160,"available":96575926272,"internally_reserved":0,"allocated":2174976,"data_stored":1383345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.63,"5min":0.42599999999999999,"15min":0.35299999999999998},"max":{"1min":0.95199999999999996,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69599999999999995,"15min":0.69699999999999995},"min":{"1min":0.54500000000000004,"5min":0.40899999999999997,"15min":0.39500000000000002},"max":{"1min":0.82599999999999996,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.71299999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70899999999999996,"15min":0.72999999999999998},"min":{"1min":0.52700000000000002,"5min":0.44900000000000001,"15min":0.432},"max":{"1min":0.92400000000000004,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.69599999999999995,"15min":0.71499999999999997},"min":{"1min":0.497,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.873,"5min":1.093,"15min":1.093},"last":0.67400000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.501,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.877,"5min":1.1399999999999999,"15min":1.405},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.57399999999999995,"5min":0.47999999999999998,"15min":0.45800000000000002},"max":{"1min":0.88800000000000001,"5min":1.409,"15min":1.409},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.75900000000000001,"15min":0.76500000000000001},"min":{"1min":0.55400000000000005,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95399999999999996,"5min":1.46,"15min":1.46},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.56599999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92900000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.77100000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.42699999999999999,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.66900000000000004,"5min":0.90000000000000002,"15min":0.94999999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.63,"15min":0.61699999999999999},"min":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82699999999999996,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64800000000000002,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.85199999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70099999999999996,"15min":0.68000000000000005},"min":{"1min":0.51100000000000001,"5min":0.42499999999999999,"15min":0.38300000000000001},"max":{"1min":0.90900000000000003,"5min":1.506,"15min":1.506},"last":0.58999999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.53600000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89000000000000001,"5min":1.0329999999999999,"15min":1.048},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.47399999999999998,"5min":0.442,"15min":0.42699999999999999},"max":{"1min":0.83599999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.64400000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542371,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1556,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1593344,"data_stored":794985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72999999999999998,"15min":0.76000000000000001},"min":{"1min":0.54200000000000004,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.95599999999999996,"5min":1.016,"15min":1.016},"last":0.871},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77400000000000002,"15min":0.79100000000000004},"min":{"1min":0.58499999999999996,"5min":0.53200000000000003,"15min":0.437},"max":{"1min":0.93700000000000006,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.96799999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.57599999999999996,"5min":0.49099999999999999,"15min":0.45300000000000001},"max":{"1min":0.86399999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71399999999999997,"15min":0.73199999999999998},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.82799999999999996,"5min":0.99199999999999999,"15min":1.117},"last":0.92600000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72099999999999997,"15min":0.747},"min":{"1min":0.53000000000000003,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.91400000000000003,"5min":0.98099999999999998,"15min":0.997},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.59299999999999997,"5min":0.53500000000000003,"15min":0.45500000000000002},"max":{"1min":0.99099999999999999,"5min":1.097,"15min":1.097},"last":0.94799999999999995}]},{"osd":3,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72999999999999998,"15min":0.754},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.45000000000000001},"max":{"1min":0.89400000000000002,"5min":1.048,"15min":1.048},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":0.73199999999999998},"min":{"1min":0.56399999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85799999999999998,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.98499999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.59299999999999997},"min":{"1min":0.47199999999999998,"5min":0.374,"15min":0.36599999999999999},"max":{"1min":0.83699999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.623},"min":{"1min":0.42299999999999999,"5min":0.40500000000000003,"15min":0.39700000000000002},"max":{"1min":0.92800000000000005,"5min":0.98299999999999998,"15min":1.0209999999999999},"last":0.58799999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.61499999999999999},"min":{"1min":0.45900000000000002,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.89300000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.497,"5min":0.46000000000000002,"15min":0.435},"max":{"1min":0.95299999999999996,"5min":0.98299999999999998,"15min":1.054},"last":0.623}]},{"osd":7,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69999999999999996,"15min":0.67900000000000005},"min":{"1min":0.48199999999999998,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":0.996,"5min":1.079,"15min":1.079},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70299999999999996,"15min":0.69099999999999995},"min":{"1min":0.51900000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97199999999999998,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.78600000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509664,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50632,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321208,"statfs":{"total":96636764160,"available":96584916992,"internally_reserved":0,"allocated":1572864,"data_stored":792817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67800000000000005,"15min":0.71199999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35699999999999998},"max":{"1min":0.98799999999999999,"5min":1,"15min":1.8779999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70599999999999996,"15min":0.71799999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.95799999999999996,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.57499999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67300000000000004,"15min":0.70299999999999996},"min":{"1min":0.49199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90700000000000003,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68799999999999994,"15min":0.72499999999999998},"min":{"1min":0.441,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92500000000000004,"5min":0.94399999999999995,"15min":1.617},"last":0.66100000000000003}]},{"osd":2,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.52600000000000002,"5min":0.45100000000000001,"15min":0.33600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71099999999999997,"15min":0.74199999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.377},"max":{"1min":0.94499999999999995,"5min":1.073,"15min":1.512},"last":0.76200000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.44800000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.472},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.754,"15min":0.78800000000000003},"min":{"1min":0.628,"5min":0.496,"15min":0.496},"max":{"1min":0.92200000000000004,"5min":1.022,"15min":1.556},"last":0.82499999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57299999999999995,"15min":0.56499999999999995},"min":{"1min":0.37,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.88900000000000001,"15min":0.96999999999999997},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71599999999999997,"15min":0.69499999999999995},"min":{"1min":0.53400000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.92400000000000004,"5min":1.012,"15min":1.038},"last":0.83999999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.47999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.76000000000000001,"5min":0.95499999999999996,"15min":1.0049999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63700000000000001,"15min":0.61499999999999999},"min":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.40000000000000002},"max":{"1min":0.84899999999999998,"5min":0.93799999999999994,"15min":1.02},"last":0.73699999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.69199999999999995,"15min":0.65400000000000003},"min":{"1min":0.51900000000000002,"5min":0.40999999999999998,"15min":0.374},"max":{"1min":0.97599999999999998,"5min":1.042,"15min":1.042},"last":0.88},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.755,"15min":0.73199999999999998},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.96899999999999997,"5min":0.999,"15min":1.7390000000000001},"last":0.86499999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509665,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1544,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1581056,"data_stored":792909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.71799999999999997,"15min":0.74399999999999999},"min":{"1min":0.56499999999999995,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":0.98299999999999998,"5min":0.99399999999999999,"15min":1.0429999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.59899999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.64200000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.51300000000000001,"5min":0.442,"15min":0.39400000000000002},"max":{"1min":0.97799999999999998,"5min":1.002,"15min":1.002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68200000000000005,"15min":0.70199999999999996},"min":{"1min":0.57999999999999996,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.877,"5min":0.93000000000000005,"15min":1.016},"last":0.69799999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73099999999999998,"15min":0.76000000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.371},"max":{"1min":1.0169999999999999,"5min":1.048,"15min":1.048},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.751,"15min":0.76700000000000002},"min":{"1min":0.61099999999999999,"5min":0.47699999999999998,"15min":0.33000000000000002},"max":{"1min":0.99199999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.57499999999999996,"5min":0.47199999999999998,"15min":0.40100000000000002},"max":{"1min":0.94599999999999995,"5min":0.97999999999999998,"15min":1.026},"last":0.498},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76900000000000002,"15min":0.78300000000000003},"min":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.47999999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.625}]},{"osd":5,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60299999999999998,"15min":0.58199999999999996},"min":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.38800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83999999999999997,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.58399999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.38500000000000001},"max":{"1min":0.92800000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.75},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.53000000000000003,"5min":0.438,"15min":0.41599999999999998},"max":{"1min":0.95799999999999996,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65800000000000003,"15min":0.65200000000000002},"min":{"1min":0.497,"5min":0.45500000000000002,"15min":0.39200000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.0429999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.52200000000000002,"5min":0.46400000000000002,"15min":0.45300000000000001},"max":{"1min":0.874,"5min":1.101,"15min":1.135},"last":0.71399999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509664,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1576960,"data_stored":793399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47699999999999998,"15min":0.47899999999999998},"min":{"1min":0.30199999999999999,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.755,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.52800000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46700000000000003,"15min":0.47999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72199999999999998,"5min":0.754,"15min":0.83499999999999996},"last":0.373},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.29999999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82199999999999995,"5min":0.82599999999999996,"15min":0.90100000000000002},"last":0.498}]},{"osd":2,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81000000000000005,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.59999999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.99199999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.55400000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.052,"5min":1.093,"15min":1.1279999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.622,"5min":0.442,"15min":0.442},"max":{"1min":1.0580000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.81100000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76300000000000001,"15min":0.77400000000000002},"min":{"1min":0.53300000000000003,"5min":0.501,"15min":0.48999999999999999},"max":{"1min":1.002,"5min":1.0669999999999999,"15min":1.137},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77100000000000002,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.51300000000000001,"15min":0.42899999999999999},"max":{"1min":1.079,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.63,"5min":0.51700000000000002,"15min":0.47399999999999998},"max":{"1min":1.0649999999999999,"5min":1.0680000000000001,"15min":1.169},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76700000000000002,"15min":0.77400000000000002},"min":{"1min":0.48199999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.03,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.88200000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.63900000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.083,"5min":1.087,"15min":1.099},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.82699999999999996,"15min":0.83199999999999996},"min":{"1min":0.67200000000000004,"5min":0.55200000000000005,"15min":0.48599999999999999},"max":{"1min":1.0980000000000001,"5min":1.623,"15min":1.623},"last":0.85199999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509666,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54732,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317108,"statfs":{"total":96636764160,"available":96580718592,"internally_reserved":0,"allocated":1576960,"data_stored":792851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.438,"15min":0.46400000000000002},"min":{"1min":0.28999999999999998,"5min":0.27200000000000002,"15min":0.23899999999999999},"max":{"1min":0.68200000000000005,"5min":0.75,"15min":0.94199999999999995},"last":0.498},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.54300000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.308},"max":{"1min":0.77400000000000002,"5min":0.88300000000000001,"15min":1.0409999999999999},"last":0.47899999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.748,"5min":0.86699999999999999,"15min":0.93999999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.41999999999999998,"5min":0.38900000000000001,"15min":0.36099999999999999},"max":{"1min":0.85299999999999998,"5min":1.012,"15min":1.085},"last":0.443}]},{"osd":3,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72299999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.56499999999999995},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.81299999999999994,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.56100000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.74399999999999999,"15min":0.78400000000000003},"min":{"1min":0.48399999999999999,"5min":0.46600000000000003,"15min":0.376},"max":{"1min":0.96699999999999997,"5min":1.2110000000000001,"15min":1.3420000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.78900000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.022,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.77300000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.73899999999999999,"15min":0.78000000000000003},"min":{"1min":0.55900000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.78100000000000003,"15min":0.80900000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.46400000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.3089999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.75900000000000001,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.499,"15min":0.40300000000000002},"max":{"1min":1.052,"5min":1.536,"15min":1.536},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.76400000000000001,"15min":0.80500000000000005},"min":{"1min":0.60999999999999999,"5min":0.54500000000000004,"15min":0.46200000000000002},"max":{"1min":1.1100000000000001,"5min":1.1339999999999999,"15min":1.2649999999999999},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77700000000000002,"15min":0.81699999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.107,"5min":1.143,"15min":1.214},"last":0.752},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.80400000000000005},"min":{"1min":0.54300000000000004,"5min":0.50900000000000001,"15min":0.44700000000000001},"max":{"1min":1.0720000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.60299999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509665,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1576960,"data_stored":792851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.29299999999999998,"5min":0.28299999999999997,"15min":0.22900000000000001},"max":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.84599999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55000000000000004,"15min":0.56399999999999995},"min":{"1min":0.45300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.872},"last":0.41799999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.49099999999999999,"15min":0.50700000000000001},"min":{"1min":0.36799999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.81000000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.41799999999999998,"5min":0.34599999999999997,"15min":0.29099999999999998},"max":{"1min":0.88,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57599999999999996,"15min":0.59599999999999997},"min":{"1min":0.47199999999999998,"5min":0.378,"15min":0.33400000000000002},"max":{"1min":0.73399999999999999,"5min":0.81699999999999995,"15min":0.98899999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.505,"15min":0.51600000000000001},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":0.70999999999999996,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.33800000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.75900000000000001,"15min":0.77500000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.432},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.79200000000000004,"15min":0.79800000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.498},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.76500000000000001,"15min":0.78300000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.41899999999999998},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.79700000000000004,"15min":0.80000000000000004},"min":{"1min":0.65100000000000002,"5min":0.51500000000000001,"15min":0.376},"max":{"1min":1.276,"5min":1.276,"15min":1.2849999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.79300000000000004,"15min":0.81000000000000005},"min":{"1min":0.65500000000000003,"5min":0.53000000000000003,"15min":0.47899999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.23},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.77700000000000002,"15min":0.79000000000000004},"min":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.46500000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.3240000000000001},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.80000000000000004,"15min":0.81200000000000006},"min":{"1min":0.57899999999999996,"5min":0.53800000000000003,"15min":0.49199999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3149999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80000000000000004,"15min":0.80700000000000005},"min":{"1min":0.55600000000000005,"5min":0.55500000000000005,"15min":0.45700000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.3380000000000001},"last":0.90800000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509667,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37276,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334564,"statfs":{"total":96636764160,"available":96598593536,"internally_reserved":0,"allocated":2183168,"data_stored":1384839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46999999999999997,"15min":0.46899999999999997},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.26600000000000001},"max":{"1min":0.70399999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.40100000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.42099999999999999,"5min":0.32400000000000001,"15min":0.29799999999999999},"max":{"1min":0.82599999999999996,"5min":0.871,"15min":1.3680000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.49299999999999999,"15min":0.51700000000000002},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.32600000000000001},"max":{"1min":0.68200000000000005,"5min":0.76700000000000002,"15min":0.871},"last":0.49099999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57299999999999995,"15min":0.58999999999999997},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.505},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.33700000000000002},"max":{"1min":0.745,"5min":1.038,"15min":1.038},"last":0.44400000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.79900000000000004,"15min":0.78400000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.45200000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.3009999999999999},"last":1.341},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.80500000000000005,"15min":0.80200000000000005},"min":{"1min":0.54500000000000004,"5min":0.505,"15min":0.44600000000000001},"max":{"1min":1.278,"5min":1.278,"15min":1.423},"last":1.206}]},{"osd":5,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78200000000000003,"15min":0.77900000000000003},"min":{"1min":0.56799999999999995,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.0229999999999999,"5min":1.1020000000000001,"15min":1.2669999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81000000000000005,"15min":0.80800000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.39600000000000002},"max":{"1min":1.1950000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.85799999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.48899999999999999},"max":{"1min":1.054,"5min":1.27,"15min":1.27},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.81100000000000005,"15min":0.81799999999999995},"min":{"1min":0.64300000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.333},"last":1.363}]},{"osd":7,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.60099999999999998,"5min":0.54300000000000004,"15min":0.53100000000000003},"max":{"1min":1.121,"5min":1.159,"15min":1.2310000000000001},"last":1.254},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.80800000000000005,"15min":0.82799999999999996},"min":{"1min":0.55600000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.109,"5min":1.1930000000000001,"15min":1.369},"last":0.88600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:37:30.832 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:37:30.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.941+0000 7fcdacc6d640 1 Processor -- start 2023-07-21T22:37:30.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.941+0000 7fcdacc6d640 1 -- start start 2023-07-21T22:37:30.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.941+0000 7fcdacc6d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcda806b1e0 0x7fcda80c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:30.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.941+0000 7fcdacc6d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda80c21f0 0x7fcda80cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:30.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.941+0000 7fcdacc6d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda80cac70 con 0x7fcda8070b70 2023-07-21T22:37:30.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.941+0000 7fcdacc6d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda80ca060 con 0x7fcda806b1e0 2023-07-21T22:37:30.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.941+0000 7fcdacc6d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda80ca340 con 0x7fcda80c21f0 2023-07-21T22:37:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.945+0000 7fcd9ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcda806b1e0 0x7fcda80c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.945+0000 7fcda6d9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda80c21f0 0x7fcda80cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.945+0000 7fcda659c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fcda8070b70 0x7fcda8070f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:38382/0 (socket says 172.21.15.6:38382) 2023-07-21T22:37:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.945+0000 7fcda659c640 1 -- 172.21.15.6:0/184538922 learned_addr learned my addr 172.21.15.6:0/184538922 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.945+0000 7fcd9ffff640 1 --2- 172.21.15.6:0/184538922 >> v2:172.21.15.161:3300/0 conn(0x7fcda806b1e0 0x7fcda80c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:50228/0 (socket says 172.21.15.6:50228) 2023-07-21T22:37:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.945+0000 7fcda5d9b640 1 -- 172.21.15.6:0/184538922 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513393788 0 0) 0x7fcda80cac70 con 0x7fcda8070b70 2023-07-21T22:37:30.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.945+0000 7fcda5d9b640 1 -- 172.21.15.6:0/184538922 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd94003530 con 0x7fcda8070b70 2023-07-21T22:37:30.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.945+0000 7fcda6d9d640 1 -- 172.21.15.6:0/184538922 >> v2:172.21.15.161:3300/0 conn(0x7fcda806b1e0 msgr2=0x7fcda80c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:30.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.945+0000 7fcda6d9d640 1 --2- 172.21.15.6:0/184538922 >> v2:172.21.15.161:3300/0 conn(0x7fcda806b1e0 0x7fcda80c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:30.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.945+0000 7fcda6d9d640 1 -- 172.21.15.6:0/184538922 >> v1:172.21.15.161:6789/0 conn(0x7fcda8070b70 legacy=0x7fcda8070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:30.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.945+0000 7fcda6d9d640 1 -- 172.21.15.6:0/184538922 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda80ca620 con 0x7fcda80c21f0 2023-07-21T22:37:30.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.945+0000 7fcd9ffff640 1 --2- 172.21.15.6:0/184538922 >> v2:172.21.15.161:3300/0 conn(0x7fcda806b1e0 0x7fcda80c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.945+0000 7fcda6d9d640 1 --2- 172.21.15.6:0/184538922 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda80c21f0 0x7fcda80cb100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009d90 tx=0x7fcda001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e08aace75e93e83b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.945+0000 7fcda5d9b640 1 -- 172.21.15.6:0/184538922 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda00a5a00 con 0x7fcda80c21f0 2023-07-21T22:37:30.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.945+0000 7fcda5d9b640 1 -- 172.21.15.6:0/184538922 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda00a5b60 con 0x7fcda80c21f0 2023-07-21T22:37:30.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.945+0000 7fcda5d9b640 1 -- 172.21.15.6:0/184538922 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda00ad440 con 0x7fcda80c21f0 2023-07-21T22:37:30.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.949+0000 7fcdacc6d640 1 -- 172.21.15.6:0/184538922 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda80c21f0 msgr2=0x7fcda80cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:30.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.949+0000 7fcdacc6d640 1 --2- 172.21.15.6:0/184538922 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda80c21f0 0x7fcda80cb100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009d90 tx=0x7fcda001c920 comp rx=0 tx=0).stop 2023-07-21T22:37:30.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.949+0000 7fcdacc6d640 1 -- 172.21.15.6:0/184538922 shutdown_connections 2023-07-21T22:37:30.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.949+0000 7fcdacc6d640 1 --2- 172.21.15.6:0/184538922 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda80c21f0 0x7fcda80cb100 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:30.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.949+0000 7fcdacc6d640 1 --2- 172.21.15.6:0/184538922 >> v2:172.21.15.161:3300/0 conn(0x7fcda806b1e0 0x7fcda80c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:30.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.949+0000 7fcdacc6d640 1 -- 172.21.15.6:0/184538922 >> 172.21.15.6:0/184538922 conn(0x7fcda80afcf0 msgr2=0x7fcda80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:30.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.949+0000 7fcdacc6d640 1 -- 172.21.15.6:0/184538922 shutdown_connections 2023-07-21T22:37:30.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.949+0000 7fcdacc6d640 1 -- 172.21.15.6:0/184538922 wait complete. 2023-07-21T22:37:30.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.949+0000 7fcdacc6d640 1 Processor -- start 2023-07-21T22:37:30.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.949+0000 7fcdacc6d640 1 -- start start 2023-07-21T22:37:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.949+0000 7fcdacc6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda806b1e0 0x7fcda80c0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.949+0000 7fcdacc6d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda8070b70 0x7fcda80b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:30.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.949+0000 7fcdacc6d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcda80c21f0 0x7fcda8156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.949+0000 7fcdacc6d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda80c1510 con 0x7fcda806b1e0 2023-07-21T22:37:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.949+0000 7fcdacc6d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda80b1f40 con 0x7fcda80c21f0 2023-07-21T22:37:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.949+0000 7fcdacc6d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda80b32f0 con 0x7fcda8070b70 2023-07-21T22:37:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.949+0000 7fcda659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda806b1e0 0x7fcda80c0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.949+0000 7fcda659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda806b1e0 0x7fcda80c0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50912/0 (socket says 172.21.15.6:50912) 2023-07-21T22:37:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.949+0000 7fcda659c640 1 -- 172.21.15.6:0/2371087087 learned_addr learned my addr 172.21.15.6:0/2371087087 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:30.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.949+0000 7fcd9ffff640 1 --2- 172.21.15.6:0/2371087087 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda8070b70 0x7fcda80b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.953+0000 7fcda6d9d640 1 --2- 172.21.15.6:0/2371087087 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcda80c21f0 0x7fcda8156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.953+0000 7fcda659c640 1 -- 172.21.15.6:0/2371087087 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda8070b70 msgr2=0x7fcda80b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.953+0000 7fcda659c640 1 --2- 172.21.15.6:0/2371087087 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda8070b70 0x7fcda80b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.953+0000 7fcda659c640 1 -- 172.21.15.6:0/2371087087 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcda80c21f0 msgr2=0x7fcda8156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.953+0000 7fcda659c640 1 --2- 172.21.15.6:0/2371087087 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcda80c21f0 0x7fcda8156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.953+0000 7fcda659c640 1 -- 172.21.15.6:0/2371087087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd90009420 con 0x7fcda806b1e0 2023-07-21T22:37:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.953+0000 7fcda659c640 1 --2- 172.21.15.6:0/2371087087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda806b1e0 0x7fcda80c0fd0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800c4d0 tx=0x7fcd9800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.953+0000 7fcd9effd640 1 -- 172.21.15.6:0/2371087087 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd98005cf0 con 0x7fcda806b1e0 2023-07-21T22:37:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.953+0000 7fcd9effd640 1 -- 172.21.15.6:0/2371087087 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd98005e50 con 0x7fcda806b1e0 2023-07-21T22:37:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.953+0000 7fcd9effd640 1 -- 172.21.15.6:0/2371087087 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd98007270 con 0x7fcda806b1e0 2023-07-21T22:37:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.953+0000 7fcdacc6d640 1 -- 172.21.15.6:0/2371087087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda0009a70 con 0x7fcda806b1e0 2023-07-21T22:37:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.953+0000 7fcdacc6d640 1 -- 172.21.15.6:0/2371087087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda80b29c0 con 0x7fcda806b1e0 2023-07-21T22:37:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.953+0000 7fcdacc6d640 1 -- 172.21.15.6:0/2371087087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda80678d0 con 0x7fcda806b1e0 2023-07-21T22:37:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.953+0000 7fcd9effd640 1 -- 172.21.15.6:0/2371087087 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcd980073d0 con 0x7fcda806b1e0 2023-07-21T22:37:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.953+0000 7fcd9effd640 1 --2- 172.21.15.6:0/2371087087 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fcd880663d0 0x7fcd88068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.953+0000 7fcd9effd640 1 -- 172.21.15.6:0/2371087087 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fcd980833e0 con 0x7fcda806b1e0 2023-07-21T22:37:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.957+0000 7fcd9ffff640 1 --2- 172.21.15.6:0/2371087087 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fcd880663d0 0x7fcd88068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.957+0000 7fcd9ffff640 1 --2- 172.21.15.6:0/2371087087 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fcd880663d0 0x7fcd88068880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcda8153ed0 tx=0x7fcd90009190 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:31.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:30.957+0000 7fcd9effd640 1 -- 172.21.15.6:0/2371087087 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcd980507c0 con 0x7fcda806b1e0 2023-07-21T22:37:31.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.113+0000 7fcdacc6d640 1 -- 172.21.15.6:0/2371087087 --> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcda80c9cf0 con 0x7fcd880663d0 2023-07-21T22:37:31.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.121+0000 7fcd9effd640 1 -- 172.21.15.6:0/2371087087 <== mgr.6905 v2:172.21.15.161:6832/1868466946 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311694 (secure 0 0 0) 0x7fcd90009940 con 0x7fcd880663d0 2023-07-21T22:37:31.171 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:31.172 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:37:31.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.125+0000 7fcdacc6d640 1 -- 172.21.15.6:0/2371087087 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fcd880663d0 msgr2=0x7fcd88068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:31.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.125+0000 7fcdacc6d640 1 --2- 172.21.15.6:0/2371087087 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fcd880663d0 0x7fcd88068880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcda8153ed0 tx=0x7fcd90009190 comp rx=0 tx=0).stop 2023-07-21T22:37:31.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.125+0000 7fcdacc6d640 1 -- 172.21.15.6:0/2371087087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda806b1e0 msgr2=0x7fcda80c0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:31.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.125+0000 7fcdacc6d640 1 --2- 172.21.15.6:0/2371087087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda806b1e0 0x7fcda80c0fd0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800c4d0 tx=0x7fcd9800c990 comp rx=0 tx=0).stop 2023-07-21T22:37:31.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.125+0000 7fcdacc6d640 1 -- 172.21.15.6:0/2371087087 shutdown_connections 2023-07-21T22:37:31.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.125+0000 7fcdacc6d640 1 --2- 172.21.15.6:0/2371087087 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fcd880663d0 0x7fcd88068880 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.125+0000 7fcdacc6d640 1 --2- 172.21.15.6:0/2371087087 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcda80c21f0 0x7fcda8156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.125+0000 7fcdacc6d640 1 --2- 172.21.15.6:0/2371087087 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcda8070b70 0x7fcda80b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.125+0000 7fcdacc6d640 1 --2- 172.21.15.6:0/2371087087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda806b1e0 0x7fcda80c0fd0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.125+0000 7fcdacc6d640 1 -- 172.21.15.6:0/2371087087 >> 172.21.15.6:0/2371087087 conn(0x7fcda80afcf0 msgr2=0x7fcda80cd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.129+0000 7fcdacc6d640 1 -- 172.21.15.6:0/2371087087 shutdown_connections 2023-07-21T22:37:31.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.129+0000 7fcdacc6d640 1 -- 172.21.15.6:0/2371087087 wait complete. 2023-07-21T22:37:31.192 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-21T22:37:29.727901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":404,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":266,"ondisk_log_size":266,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332424,"kb_used_data":13512,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754642296,"statfs":{"total":773094113280,"available":772753711104,"internally_reserved":0,"allocated":13836288,"data_stored":7527996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002149"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894850+0000","last_change":"2023-07-21T22:37:22.107831+0000","last_active":"2023-07-21T22:37:23.894850+0000","last_peered":"2023-07-21T22:37:23.894850+0000","last_clean":"2023-07-21T22:37:23.894850+0000","last_became_active":"2023-07-21T22:37:22.107508+0000","last_became_peered":"2023-07-21T22:37:22.107508+0000","last_unstale":"2023-07-21T22:37:23.894850+0000","last_undegraded":"2023-07-21T22:37:23.894850+0000","last_fullsized":"2023-07-21T22:37:23.894850+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:19:33.942245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090696+0000","last_change":"2023-07-21T22:37:22.088568+0000","last_active":"2023-07-21T22:37:23.090696+0000","last_peered":"2023-07-21T22:37:23.090696+0000","last_clean":"2023-07-21T22:37:23.090696+0000","last_became_active":"2023-07-21T22:37:22.088275+0000","last_became_peered":"2023-07-21T22:37:22.088275+0000","last_unstale":"2023-07-21T22:37:23.090696+0000","last_undegraded":"2023-07-21T22:37:23.090696+0000","last_fullsized":"2023-07-21T22:37:23.090696+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:04:38.307558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895453+0000","last_change":"2023-07-21T22:37:22.100121+0000","last_active":"2023-07-21T22:37:23.895453+0000","last_peered":"2023-07-21T22:37:23.895453+0000","last_clean":"2023-07-21T22:37:23.895453+0000","last_became_active":"2023-07-21T22:37:22.099590+0000","last_became_peered":"2023-07-21T22:37:22.099590+0000","last_unstale":"2023-07-21T22:37:23.895453+0000","last_undegraded":"2023-07-21T22:37:23.895453+0000","last_fullsized":"2023-07-21T22:37:23.895453+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:06:31.514324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895966+0000","last_change":"2023-07-21T22:37:22.092845+0000","last_active":"2023-07-21T22:37:23.895966+0000","last_peered":"2023-07-21T22:37:23.895966+0000","last_clean":"2023-07-21T22:37:23.895966+0000","last_became_active":"2023-07-21T22:37:22.092571+0000","last_became_peered":"2023-07-21T22:37:22.092571+0000","last_unstale":"2023-07-21T22:37:23.895966+0000","last_undegraded":"2023-07-21T22:37:23.895966+0000","last_fullsized":"2023-07-21T22:37:23.895966+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:21:18.056170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085495+0000","last_change":"2023-07-21T22:37:22.113035+0000","last_active":"2023-07-21T22:37:23.085495+0000","last_peered":"2023-07-21T22:37:23.085495+0000","last_clean":"2023-07-21T22:37:23.085495+0000","last_became_active":"2023-07-21T22:37:22.112607+0000","last_became_peered":"2023-07-21T22:37:22.112607+0000","last_unstale":"2023-07-21T22:37:23.085495+0000","last_undegraded":"2023-07-21T22:37:23.085495+0000","last_fullsized":"2023-07-21T22:37:23.085495+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:44.770697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090101+0000","last_change":"2023-07-21T22:37:22.101752+0000","last_active":"2023-07-21T22:37:23.090101+0000","last_peered":"2023-07-21T22:37:23.090101+0000","last_clean":"2023-07-21T22:37:23.090101+0000","last_became_active":"2023-07-21T22:37:22.101490+0000","last_became_peered":"2023-07-21T22:37:22.101490+0000","last_unstale":"2023-07-21T22:37:23.090101+0000","last_undegraded":"2023-07-21T22:37:23.090101+0000","last_fullsized":"2023-07-21T22:37:23.090101+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:32:37.413308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.089770+0000","last_change":"2023-07-21T22:37:22.102470+0000","last_active":"2023-07-21T22:37:23.089770+0000","last_peered":"2023-07-21T22:37:23.089770+0000","last_clean":"2023-07-21T22:37:23.089770+0000","last_became_active":"2023-07-21T22:37:22.102178+0000","last_became_peered":"2023-07-21T22:37:22.102178+0000","last_unstale":"2023-07-21T22:37:23.089770+0000","last_undegraded":"2023-07-21T22:37:23.089770+0000","last_fullsized":"2023-07-21T22:37:23.089770+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:48:56.999112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.893896+0000","last_change":"2023-07-21T22:37:22.096429+0000","last_active":"2023-07-21T22:37:23.893896+0000","last_peered":"2023-07-21T22:37:23.893896+0000","last_clean":"2023-07-21T22:37:23.893896+0000","last_became_active":"2023-07-21T22:37:22.096137+0000","last_became_peered":"2023-07-21T22:37:22.096137+0000","last_unstale":"2023-07-21T22:37:23.893896+0000","last_undegraded":"2023-07-21T22:37:23.893896+0000","last_fullsized":"2023-07-21T22:37:23.893896+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:09.639526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090725+0000","last_change":"2023-07-21T22:37:22.090810+0000","last_active":"2023-07-21T22:37:23.090725+0000","last_peered":"2023-07-21T22:37:23.090725+0000","last_clean":"2023-07-21T22:37:23.090725+0000","last_became_active":"2023-07-21T22:37:22.090404+0000","last_became_peered":"2023-07-21T22:37:22.090404+0000","last_unstale":"2023-07-21T22:37:23.090725+0000","last_undegraded":"2023-07-21T22:37:23.090725+0000","last_fullsized":"2023-07-21T22:37:23.090725+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:55:06.160682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085606+0000","last_change":"2023-07-21T22:37:22.107484+0000","last_active":"2023-07-21T22:37:23.085606+0000","last_peered":"2023-07-21T22:37:23.085606+0000","last_clean":"2023-07-21T22:37:23.085606+0000","last_became_active":"2023-07-21T22:37:22.107137+0000","last_became_peered":"2023-07-21T22:37:22.107137+0000","last_unstale":"2023-07-21T22:37:23.085606+0000","last_undegraded":"2023-07-21T22:37:23.085606+0000","last_fullsized":"2023-07-21T22:37:23.085606+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:07:27.193624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090670+0000","last_change":"2023-07-21T22:37:22.104991+0000","last_active":"2023-07-21T22:37:23.090670+0000","last_peered":"2023-07-21T22:37:23.090670+0000","last_clean":"2023-07-21T22:37:23.090670+0000","last_became_active":"2023-07-21T22:37:22.104714+0000","last_became_peered":"2023-07-21T22:37:22.104714+0000","last_unstale":"2023-07-21T22:37:23.090670+0000","last_undegraded":"2023-07-21T22:37:23.090670+0000","last_fullsized":"2023-07-21T22:37:23.090670+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:58:07.137241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.898061+0000","last_change":"2023-07-21T22:37:22.099693+0000","last_active":"2023-07-21T22:37:23.898061+0000","last_peered":"2023-07-21T22:37:23.898061+0000","last_clean":"2023-07-21T22:37:23.898061+0000","last_became_active":"2023-07-21T22:37:22.099357+0000","last_became_peered":"2023-07-21T22:37:22.099357+0000","last_unstale":"2023-07-21T22:37:23.898061+0000","last_undegraded":"2023-07-21T22:37:23.898061+0000","last_fullsized":"2023-07-21T22:37:23.898061+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:13:51.549351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894560+0000","last_change":"2023-07-21T22:37:22.099882+0000","last_active":"2023-07-21T22:37:23.894560+0000","last_peered":"2023-07-21T22:37:23.894560+0000","last_clean":"2023-07-21T22:37:23.894560+0000","last_became_active":"2023-07-21T22:37:22.099607+0000","last_became_peered":"2023-07-21T22:37:22.099607+0000","last_unstale":"2023-07-21T22:37:23.894560+0000","last_undegraded":"2023-07-21T22:37:23.894560+0000","last_fullsized":"2023-07-21T22:37:23.894560+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:08:22.899930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897783+0000","last_change":"2023-07-21T22:37:22.094487+0000","last_active":"2023-07-21T22:37:23.897783+0000","last_peered":"2023-07-21T22:37:23.897783+0000","last_clean":"2023-07-21T22:37:23.897783+0000","last_became_active":"2023-07-21T22:37:22.094182+0000","last_became_peered":"2023-07-21T22:37:22.094182+0000","last_unstale":"2023-07-21T22:37:23.897783+0000","last_undegraded":"2023-07-21T22:37:23.897783+0000","last_fullsized":"2023-07-21T22:37:23.897783+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:44:49.192614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897793+0000","last_change":"2023-07-21T22:37:22.098326+0000","last_active":"2023-07-21T22:37:23.897793+0000","last_peered":"2023-07-21T22:37:23.897793+0000","last_clean":"2023-07-21T22:37:23.897793+0000","last_became_active":"2023-07-21T22:37:22.097862+0000","last_became_peered":"2023-07-21T22:37:22.097862+0000","last_unstale":"2023-07-21T22:37:23.897793+0000","last_undegraded":"2023-07-21T22:37:23.897793+0000","last_fullsized":"2023-07-21T22:37:23.897793+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:21.467017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897263+0000","last_change":"2023-07-21T22:37:22.095435+0000","last_active":"2023-07-21T22:37:23.897263+0000","last_peered":"2023-07-21T22:37:23.897263+0000","last_clean":"2023-07-21T22:37:23.897263+0000","last_became_active":"2023-07-21T22:37:22.095145+0000","last_became_peered":"2023-07-21T22:37:22.095145+0000","last_unstale":"2023-07-21T22:37:23.897263+0000","last_undegraded":"2023-07-21T22:37:23.897263+0000","last_fullsized":"2023-07-21T22:37:23.897263+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:41:57.225885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895013+0000","last_change":"2023-07-21T22:37:22.099722+0000","last_active":"2023-07-21T22:37:23.895013+0000","last_peered":"2023-07-21T22:37:23.895013+0000","last_clean":"2023-07-21T22:37:23.895013+0000","last_became_active":"2023-07-21T22:37:22.099430+0000","last_became_peered":"2023-07-21T22:37:22.099430+0000","last_unstale":"2023-07-21T22:37:23.895013+0000","last_undegraded":"2023-07-21T22:37:23.895013+0000","last_fullsized":"2023-07-21T22:37:23.895013+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:52:13.992344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090726+0000","last_change":"2023-07-21T22:37:22.104090+0000","last_active":"2023-07-21T22:37:23.090726+0000","last_peered":"2023-07-21T22:37:23.090726+0000","last_clean":"2023-07-21T22:37:23.090726+0000","last_became_active":"2023-07-21T22:37:22.103240+0000","last_became_peered":"2023-07-21T22:37:22.103240+0000","last_unstale":"2023-07-21T22:37:23.090726+0000","last_undegraded":"2023-07-21T22:37:23.090726+0000","last_fullsized":"2023-07-21T22:37:23.090726+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:14:43.360025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895585+0000","last_change":"2023-07-21T22:37:22.106737+0000","last_active":"2023-07-21T22:37:23.895585+0000","last_peered":"2023-07-21T22:37:23.895585+0000","last_clean":"2023-07-21T22:37:23.895585+0000","last_became_active":"2023-07-21T22:37:22.105690+0000","last_became_peered":"2023-07-21T22:37:22.105690+0000","last_unstale":"2023-07-21T22:37:23.895585+0000","last_undegraded":"2023-07-21T22:37:23.895585+0000","last_fullsized":"2023-07-21T22:37:23.895585+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:36:03.999643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.898285+0000","last_change":"2023-07-21T22:37:22.097988+0000","last_active":"2023-07-21T22:37:23.898285+0000","last_peered":"2023-07-21T22:37:23.898285+0000","last_clean":"2023-07-21T22:37:23.898285+0000","last_became_active":"2023-07-21T22:37:22.097686+0000","last_became_peered":"2023-07-21T22:37:22.097686+0000","last_unstale":"2023-07-21T22:37:23.898285+0000","last_undegraded":"2023-07-21T22:37:23.898285+0000","last_fullsized":"2023-07-21T22:37:23.898285+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:02:05.730511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895285+0000","last_change":"2023-07-21T22:37:22.102362+0000","last_active":"2023-07-21T22:37:23.895285+0000","last_peered":"2023-07-21T22:37:23.895285+0000","last_clean":"2023-07-21T22:37:23.895285+0000","last_became_active":"2023-07-21T22:37:22.102082+0000","last_became_peered":"2023-07-21T22:37:22.102082+0000","last_unstale":"2023-07-21T22:37:23.895285+0000","last_undegraded":"2023-07-21T22:37:23.895285+0000","last_fullsized":"2023-07-21T22:37:23.895285+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:56:12.403970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085653+0000","last_change":"2023-07-21T22:37:22.098703+0000","last_active":"2023-07-21T22:37:23.085653+0000","last_peered":"2023-07-21T22:37:23.085653+0000","last_clean":"2023-07-21T22:37:23.085653+0000","last_became_active":"2023-07-21T22:37:22.098286+0000","last_became_peered":"2023-07-21T22:37:22.098286+0000","last_unstale":"2023-07-21T22:37:23.085653+0000","last_undegraded":"2023-07-21T22:37:23.085653+0000","last_fullsized":"2023-07-21T22:37:23.085653+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:24:54.907029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894687+0000","last_change":"2023-07-21T22:37:22.104289+0000","last_active":"2023-07-21T22:37:23.894687+0000","last_peered":"2023-07-21T22:37:23.894687+0000","last_clean":"2023-07-21T22:37:23.894687+0000","last_became_active":"2023-07-21T22:37:22.103758+0000","last_became_peered":"2023-07-21T22:37:22.103758+0000","last_unstale":"2023-07-21T22:37:23.894687+0000","last_undegraded":"2023-07-21T22:37:23.894687+0000","last_fullsized":"2023-07-21T22:37:23.894687+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:54:51.112565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085426+0000","last_change":"2023-07-21T22:37:22.112796+0000","last_active":"2023-07-21T22:37:23.085426+0000","last_peered":"2023-07-21T22:37:23.085426+0000","last_clean":"2023-07-21T22:37:23.085426+0000","last_became_active":"2023-07-21T22:37:22.112412+0000","last_became_peered":"2023-07-21T22:37:22.112412+0000","last_unstale":"2023-07-21T22:37:23.085426+0000","last_undegraded":"2023-07-21T22:37:23.085426+0000","last_fullsized":"2023-07-21T22:37:23.085426+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:39:44.537855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.898326+0000","last_change":"2023-07-21T22:37:22.102479+0000","last_active":"2023-07-21T22:37:23.898326+0000","last_peered":"2023-07-21T22:37:23.898326+0000","last_clean":"2023-07-21T22:37:23.898326+0000","last_became_active":"2023-07-21T22:37:22.102193+0000","last_became_peered":"2023-07-21T22:37:22.102193+0000","last_unstale":"2023-07-21T22:37:23.898326+0000","last_undegraded":"2023-07-21T22:37:23.898326+0000","last_fullsized":"2023-07-21T22:37:23.898326+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:24:29.163797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.898214+0000","last_change":"2023-07-21T22:37:22.098593+0000","last_active":"2023-07-21T22:37:23.898214+0000","last_peered":"2023-07-21T22:37:23.898214+0000","last_clean":"2023-07-21T22:37:23.898214+0000","last_became_active":"2023-07-21T22:37:22.098310+0000","last_became_peered":"2023-07-21T22:37:22.098310+0000","last_unstale":"2023-07-21T22:37:23.898214+0000","last_undegraded":"2023-07-21T22:37:23.898214+0000","last_fullsized":"2023-07-21T22:37:23.898214+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:14.905799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090813+0000","last_change":"2023-07-21T22:37:22.101856+0000","last_active":"2023-07-21T22:37:23.090813+0000","last_peered":"2023-07-21T22:37:23.090813+0000","last_clean":"2023-07-21T22:37:23.090813+0000","last_became_active":"2023-07-21T22:37:22.101370+0000","last_became_peered":"2023-07-21T22:37:22.101370+0000","last_unstale":"2023-07-21T22:37:23.090813+0000","last_undegraded":"2023-07-21T22:37:23.090813+0000","last_fullsized":"2023-07-21T22:37:23.090813+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:47:58.300694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.089658+0000","last_change":"2023-07-21T22:37:22.098484+0000","last_active":"2023-07-21T22:37:23.089658+0000","last_peered":"2023-07-21T22:37:23.089658+0000","last_clean":"2023-07-21T22:37:23.089658+0000","last_became_active":"2023-07-21T22:37:22.098196+0000","last_became_peered":"2023-07-21T22:37:22.098196+0000","last_unstale":"2023-07-21T22:37:23.089658+0000","last_undegraded":"2023-07-21T22:37:23.089658+0000","last_fullsized":"2023-07-21T22:37:23.089658+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:42:57.880515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895428+0000","last_change":"2023-07-21T22:37:22.084542+0000","last_active":"2023-07-21T22:37:23.895428+0000","last_peered":"2023-07-21T22:37:23.895428+0000","last_clean":"2023-07-21T22:37:23.895428+0000","last_became_active":"2023-07-21T22:37:22.084264+0000","last_became_peered":"2023-07-21T22:37:22.084264+0000","last_unstale":"2023-07-21T22:37:23.895428+0000","last_undegraded":"2023-07-21T22:37:23.895428+0000","last_fullsized":"2023-07-21T22:37:23.895428+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:56:22.124534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897341+0000","last_change":"2023-07-21T22:37:22.102980+0000","last_active":"2023-07-21T22:37:23.897341+0000","last_peered":"2023-07-21T22:37:23.897341+0000","last_clean":"2023-07-21T22:37:23.897341+0000","last_became_active":"2023-07-21T22:37:22.102540+0000","last_became_peered":"2023-07-21T22:37:22.102540+0000","last_unstale":"2023-07-21T22:37:23.897341+0000","last_undegraded":"2023-07-21T22:37:23.897341+0000","last_fullsized":"2023-07-21T22:37:23.897341+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:20:59.270816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.089841+0000","last_change":"2023-07-21T22:37:22.097523+0000","last_active":"2023-07-21T22:37:23.089841+0000","last_peered":"2023-07-21T22:37:23.089841+0000","last_clean":"2023-07-21T22:37:23.089841+0000","last_became_active":"2023-07-21T22:37:22.097170+0000","last_became_peered":"2023-07-21T22:37:22.097170+0000","last_unstale":"2023-07-21T22:37:23.089841+0000","last_undegraded":"2023-07-21T22:37:23.089841+0000","last_fullsized":"2023-07-21T22:37:23.089841+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:50.889917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895132+0000","last_change":"2023-07-21T22:37:22.092194+0000","last_active":"2023-07-21T22:37:23.895132+0000","last_peered":"2023-07-21T22:37:23.895132+0000","last_clean":"2023-07-21T22:37:23.895132+0000","last_became_active":"2023-07-21T22:37:22.091618+0000","last_became_peered":"2023-07-21T22:37:22.091618+0000","last_unstale":"2023-07-21T22:37:23.895132+0000","last_undegraded":"2023-07-21T22:37:23.895132+0000","last_fullsized":"2023-07-21T22:37:23.895132+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:21:40.732882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894485+0000","last_change":"2023-07-21T22:37:22.104778+0000","last_active":"2023-07-21T22:37:23.894485+0000","last_peered":"2023-07-21T22:37:23.894485+0000","last_clean":"2023-07-21T22:37:23.894485+0000","last_became_active":"2023-07-21T22:37:22.104471+0000","last_became_peered":"2023-07-21T22:37:22.104471+0000","last_unstale":"2023-07-21T22:37:23.894485+0000","last_undegraded":"2023-07-21T22:37:23.894485+0000","last_fullsized":"2023-07-21T22:37:23.894485+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:25:48.345505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"127'4","reported_seq":17,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895770+0000","last_change":"2023-07-21T22:37:21.077330+0000","last_active":"2023-07-21T22:37:23.895770+0000","last_peered":"2023-07-21T22:37:23.895770+0000","last_clean":"2023-07-21T22:37:23.895770+0000","last_became_active":"2023-07-21T22:37:21.077027+0000","last_became_peered":"2023-07-21T22:37:21.077027+0000","last_unstale":"2023-07-21T22:37:23.895770+0000","last_undegraded":"2023-07-21T22:37:23.895770+0000","last_fullsized":"2023-07-21T22:37:23.895770+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:22:25.486881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.893904+0000","last_change":"2023-07-21T22:37:22.101145+0000","last_active":"2023-07-21T22:37:23.893904+0000","last_peered":"2023-07-21T22:37:23.893904+0000","last_clean":"2023-07-21T22:37:23.893904+0000","last_became_active":"2023-07-21T22:37:22.095785+0000","last_became_peered":"2023-07-21T22:37:22.095785+0000","last_unstale":"2023-07-21T22:37:23.893904+0000","last_undegraded":"2023-07-21T22:37:23.893904+0000","last_fullsized":"2023-07-21T22:37:23.893904+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:19:09.241414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"127'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894734+0000","last_change":"2023-07-21T22:37:21.078917+0000","last_active":"2023-07-21T22:37:23.894734+0000","last_peered":"2023-07-21T22:37:23.894734+0000","last_clean":"2023-07-21T22:37:23.894734+0000","last_became_active":"2023-07-21T22:37:21.078582+0000","last_became_peered":"2023-07-21T22:37:21.078582+0000","last_unstale":"2023-07-21T22:37:23.894734+0000","last_undegraded":"2023-07-21T22:37:23.894734+0000","last_fullsized":"2023-07-21T22:37:23.894734+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:58:52.170911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.898008+0000","last_change":"2023-07-21T22:37:22.102804+0000","last_active":"2023-07-21T22:37:23.898008+0000","last_peered":"2023-07-21T22:37:23.898008+0000","last_clean":"2023-07-21T22:37:23.898008+0000","last_became_active":"2023-07-21T22:37:22.102165+0000","last_became_peered":"2023-07-21T22:37:22.102165+0000","last_unstale":"2023-07-21T22:37:23.898008+0000","last_undegraded":"2023-07-21T22:37:23.898008+0000","last_fullsized":"2023-07-21T22:37:23.898008+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:07:04.731224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.898055+0000","last_change":"2023-07-21T22:37:21.071615+0000","last_active":"2023-07-21T22:37:23.898055+0000","last_peered":"2023-07-21T22:37:23.898055+0000","last_clean":"2023-07-21T22:37:23.898055+0000","last_became_active":"2023-07-21T22:37:21.071287+0000","last_became_peered":"2023-07-21T22:37:21.071287+0000","last_unstale":"2023-07-21T22:37:23.898055+0000","last_undegraded":"2023-07-21T22:37:23.898055+0000","last_fullsized":"2023-07-21T22:37:23.898055+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:25:41.786891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090008+0000","last_change":"2023-07-21T22:37:22.102928+0000","last_active":"2023-07-21T22:37:23.090008+0000","last_peered":"2023-07-21T22:37:23.090008+0000","last_clean":"2023-07-21T22:37:23.090008+0000","last_became_active":"2023-07-21T22:37:22.102556+0000","last_became_peered":"2023-07-21T22:37:22.102556+0000","last_unstale":"2023-07-21T22:37:23.090008+0000","last_undegraded":"2023-07-21T22:37:23.090008+0000","last_fullsized":"2023-07-21T22:37:23.090008+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:01:47.946114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085977+0000","last_change":"2023-07-21T22:37:21.063348+0000","last_active":"2023-07-21T22:37:23.085977+0000","last_peered":"2023-07-21T22:37:23.085977+0000","last_clean":"2023-07-21T22:37:23.085977+0000","last_became_active":"2023-07-21T22:37:21.062717+0000","last_became_peered":"2023-07-21T22:37:21.062717+0000","last_unstale":"2023-07-21T22:37:23.085977+0000","last_undegraded":"2023-07-21T22:37:23.085977+0000","last_fullsized":"2023-07-21T22:37:23.085977+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:43:30.392443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.896006+0000","last_change":"2023-07-21T22:37:22.098541+0000","last_active":"2023-07-21T22:37:23.896006+0000","last_peered":"2023-07-21T22:37:23.896006+0000","last_clean":"2023-07-21T22:37:23.896006+0000","last_became_active":"2023-07-21T22:37:22.097987+0000","last_became_peered":"2023-07-21T22:37:22.097987+0000","last_unstale":"2023-07-21T22:37:23.896006+0000","last_undegraded":"2023-07-21T22:37:23.896006+0000","last_fullsized":"2023-07-21T22:37:23.896006+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:55:54.548193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"127'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897633+0000","last_change":"2023-07-21T22:37:21.078218+0000","last_active":"2023-07-21T22:37:23.897633+0000","last_peered":"2023-07-21T22:37:23.897633+0000","last_clean":"2023-07-21T22:37:23.897633+0000","last_became_active":"2023-07-21T22:37:21.077942+0000","last_became_peered":"2023-07-21T22:37:21.077942+0000","last_unstale":"2023-07-21T22:37:23.897633+0000","last_undegraded":"2023-07-21T22:37:23.897633+0000","last_fullsized":"2023-07-21T22:37:23.897633+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:12:48.358296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895650+0000","last_change":"2023-07-21T22:37:22.104910+0000","last_active":"2023-07-21T22:37:23.895650+0000","last_peered":"2023-07-21T22:37:23.895650+0000","last_clean":"2023-07-21T22:37:23.895650+0000","last_became_active":"2023-07-21T22:37:22.104624+0000","last_became_peered":"2023-07-21T22:37:22.104624+0000","last_unstale":"2023-07-21T22:37:23.895650+0000","last_undegraded":"2023-07-21T22:37:23.895650+0000","last_fullsized":"2023-07-21T22:37:23.895650+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:11:24.701510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"127'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.089656+0000","last_change":"2023-07-21T22:37:21.072265+0000","last_active":"2023-07-21T22:37:23.089656+0000","last_peered":"2023-07-21T22:37:23.089656+0000","last_clean":"2023-07-21T22:37:23.089656+0000","last_became_active":"2023-07-21T22:37:21.071996+0000","last_became_peered":"2023-07-21T22:37:21.071996+0000","last_unstale":"2023-07-21T22:37:23.089656+0000","last_undegraded":"2023-07-21T22:37:23.089656+0000","last_fullsized":"2023-07-21T22:37:23.089656+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:18:26.267351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.091067+0000","last_change":"2023-07-21T22:37:22.104281+0000","last_active":"2023-07-21T22:37:23.091067+0000","last_peered":"2023-07-21T22:37:23.091067+0000","last_clean":"2023-07-21T22:37:23.091067+0000","last_became_active":"2023-07-21T22:37:22.103587+0000","last_became_peered":"2023-07-21T22:37:22.103587+0000","last_unstale":"2023-07-21T22:37:23.091067+0000","last_undegraded":"2023-07-21T22:37:23.091067+0000","last_fullsized":"2023-07-21T22:37:23.091067+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:27:57.000276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897288+0000","last_change":"2023-07-21T22:37:21.070105+0000","last_active":"2023-07-21T22:37:23.897288+0000","last_peered":"2023-07-21T22:37:23.897288+0000","last_clean":"2023-07-21T22:37:23.897288+0000","last_became_active":"2023-07-21T22:37:21.069728+0000","last_became_peered":"2023-07-21T22:37:21.069728+0000","last_unstale":"2023-07-21T22:37:23.897288+0000","last_undegraded":"2023-07-21T22:37:23.897288+0000","last_fullsized":"2023-07-21T22:37:23.897288+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:19:19.825592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895745+0000","last_change":"2023-07-21T22:37:22.101464+0000","last_active":"2023-07-21T22:37:23.895745+0000","last_peered":"2023-07-21T22:37:23.895745+0000","last_clean":"2023-07-21T22:37:23.895745+0000","last_became_active":"2023-07-21T22:37:22.101180+0000","last_became_peered":"2023-07-21T22:37:22.101180+0000","last_unstale":"2023-07-21T22:37:23.895745+0000","last_undegraded":"2023-07-21T22:37:23.895745+0000","last_fullsized":"2023-07-21T22:37:23.895745+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:38:09.434083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894233+0000","last_change":"2023-07-21T22:37:21.068302+0000","last_active":"2023-07-21T22:37:23.894233+0000","last_peered":"2023-07-21T22:37:23.894233+0000","last_clean":"2023-07-21T22:37:23.894233+0000","last_became_active":"2023-07-21T22:37:21.068014+0000","last_became_peered":"2023-07-21T22:37:21.068014+0000","last_unstale":"2023-07-21T22:37:23.894233+0000","last_undegraded":"2023-07-21T22:37:23.894233+0000","last_fullsized":"2023-07-21T22:37:23.894233+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:09:06.236261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894422+0000","last_change":"2023-07-21T22:37:22.104016+0000","last_active":"2023-07-21T22:37:23.894422+0000","last_peered":"2023-07-21T22:37:23.894422+0000","last_clean":"2023-07-21T22:37:23.894422+0000","last_became_active":"2023-07-21T22:37:22.103730+0000","last_became_peered":"2023-07-21T22:37:22.103730+0000","last_unstale":"2023-07-21T22:37:23.894422+0000","last_undegraded":"2023-07-21T22:37:23.894422+0000","last_fullsized":"2023-07-21T22:37:23.894422+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:16:42.895407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.898359+0000","last_change":"2023-07-21T22:37:21.072005+0000","last_active":"2023-07-21T22:37:23.898359+0000","last_peered":"2023-07-21T22:37:23.898359+0000","last_clean":"2023-07-21T22:37:23.898359+0000","last_became_active":"2023-07-21T22:37:21.071724+0000","last_became_peered":"2023-07-21T22:37:21.071724+0000","last_unstale":"2023-07-21T22:37:23.898359+0000","last_undegraded":"2023-07-21T22:37:23.898359+0000","last_fullsized":"2023-07-21T22:37:23.898359+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:43:02.829969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085480+0000","last_change":"2023-07-21T22:37:22.093848+0000","last_active":"2023-07-21T22:37:23.085480+0000","last_peered":"2023-07-21T22:37:23.085480+0000","last_clean":"2023-07-21T22:37:23.085480+0000","last_became_active":"2023-07-21T22:37:22.093563+0000","last_became_peered":"2023-07-21T22:37:22.093563+0000","last_unstale":"2023-07-21T22:37:23.085480+0000","last_undegraded":"2023-07-21T22:37:23.085480+0000","last_fullsized":"2023-07-21T22:37:23.085480+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:32:54.448580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894914+0000","last_change":"2023-07-21T22:37:21.071932+0000","last_active":"2023-07-21T22:37:23.894914+0000","last_peered":"2023-07-21T22:37:23.894914+0000","last_clean":"2023-07-21T22:37:23.894914+0000","last_became_active":"2023-07-21T22:37:21.071545+0000","last_became_peered":"2023-07-21T22:37:21.071545+0000","last_unstale":"2023-07-21T22:37:23.894914+0000","last_undegraded":"2023-07-21T22:37:23.894914+0000","last_fullsized":"2023-07-21T22:37:23.894914+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:30:20.966969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895039+0000","last_change":"2023-07-21T22:37:22.096402+0000","last_active":"2023-07-21T22:37:23.895039+0000","last_peered":"2023-07-21T22:37:23.895039+0000","last_clean":"2023-07-21T22:37:23.895039+0000","last_became_active":"2023-07-21T22:37:22.095411+0000","last_became_peered":"2023-07-21T22:37:22.095411+0000","last_unstale":"2023-07-21T22:37:23.895039+0000","last_undegraded":"2023-07-21T22:37:23.895039+0000","last_fullsized":"2023-07-21T22:37:23.895039+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:35:46.344835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"127'3","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897808+0000","last_change":"2023-07-21T22:37:21.074517+0000","last_active":"2023-07-21T22:37:23.897808+0000","last_peered":"2023-07-21T22:37:23.897808+0000","last_clean":"2023-07-21T22:37:23.897808+0000","last_became_active":"2023-07-21T22:37:21.074054+0000","last_became_peered":"2023-07-21T22:37:21.074054+0000","last_unstale":"2023-07-21T22:37:23.897808+0000","last_undegraded":"2023-07-21T22:37:23.897808+0000","last_fullsized":"2023-07-21T22:37:23.897808+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:50:33.770314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085871+0000","last_change":"2023-07-21T22:37:22.095006+0000","last_active":"2023-07-21T22:37:23.085871+0000","last_peered":"2023-07-21T22:37:23.085871+0000","last_clean":"2023-07-21T22:37:23.085871+0000","last_became_active":"2023-07-21T22:37:22.094707+0000","last_became_peered":"2023-07-21T22:37:22.094707+0000","last_unstale":"2023-07-21T22:37:23.085871+0000","last_undegraded":"2023-07-21T22:37:23.085871+0000","last_fullsized":"2023-07-21T22:37:23.085871+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:05:25.043084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"127'6","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090642+0000","last_change":"2023-07-21T22:37:21.078493+0000","last_active":"2023-07-21T22:37:23.090642+0000","last_peered":"2023-07-21T22:37:23.090642+0000","last_clean":"2023-07-21T22:37:23.090642+0000","last_became_active":"2023-07-21T22:37:21.078199+0000","last_became_peered":"2023-07-21T22:37:21.078199+0000","last_unstale":"2023-07-21T22:37:23.090642+0000","last_undegraded":"2023-07-21T22:37:23.090642+0000","last_fullsized":"2023-07-21T22:37:23.090642+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:54:58.828951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090361+0000","last_change":"2023-07-21T22:37:22.109910+0000","last_active":"2023-07-21T22:37:23.090361+0000","last_peered":"2023-07-21T22:37:23.090361+0000","last_clean":"2023-07-21T22:37:23.090361+0000","last_became_active":"2023-07-21T22:37:22.109641+0000","last_became_peered":"2023-07-21T22:37:22.109641+0000","last_unstale":"2023-07-21T22:37:23.090361+0000","last_undegraded":"2023-07-21T22:37:23.090361+0000","last_fullsized":"2023-07-21T22:37:23.090361+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:15:28.542594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085789+0000","last_change":"2023-07-21T22:37:21.068918+0000","last_active":"2023-07-21T22:37:23.085789+0000","last_peered":"2023-07-21T22:37:23.085789+0000","last_clean":"2023-07-21T22:37:23.085789+0000","last_became_active":"2023-07-21T22:37:21.068632+0000","last_became_peered":"2023-07-21T22:37:21.068632+0000","last_unstale":"2023-07-21T22:37:23.085789+0000","last_undegraded":"2023-07-21T22:37:23.085789+0000","last_fullsized":"2023-07-21T22:37:23.085789+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:59:08.055565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090519+0000","last_change":"2023-07-21T22:37:22.094829+0000","last_active":"2023-07-21T22:37:23.090519+0000","last_peered":"2023-07-21T22:37:23.090519+0000","last_clean":"2023-07-21T22:37:23.090519+0000","last_became_active":"2023-07-21T22:37:22.094548+0000","last_became_peered":"2023-07-21T22:37:22.094548+0000","last_unstale":"2023-07-21T22:37:23.090519+0000","last_undegraded":"2023-07-21T22:37:23.090519+0000","last_fullsized":"2023-07-21T22:37:23.090519+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:49:28.560586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895384+0000","last_change":"2023-07-21T22:37:21.066648+0000","last_active":"2023-07-21T22:37:23.895384+0000","last_peered":"2023-07-21T22:37:23.895384+0000","last_clean":"2023-07-21T22:37:23.895384+0000","last_became_active":"2023-07-21T22:37:21.066313+0000","last_became_peered":"2023-07-21T22:37:21.066313+0000","last_unstale":"2023-07-21T22:37:23.895384+0000","last_undegraded":"2023-07-21T22:37:23.895384+0000","last_fullsized":"2023-07-21T22:37:23.895384+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:03:38.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894600+0000","last_change":"2023-07-21T22:37:22.092130+0000","last_active":"2023-07-21T22:37:23.894600+0000","last_peered":"2023-07-21T22:37:23.894600+0000","last_clean":"2023-07-21T22:37:23.894600+0000","last_became_active":"2023-07-21T22:37:22.091844+0000","last_became_peered":"2023-07-21T22:37:22.091844+0000","last_unstale":"2023-07-21T22:37:23.894600+0000","last_undegraded":"2023-07-21T22:37:23.894600+0000","last_fullsized":"2023-07-21T22:37:23.894600+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:34:15.058316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894074+0000","last_change":"2023-07-21T22:37:21.075668+0000","last_active":"2023-07-21T22:37:23.894074+0000","last_peered":"2023-07-21T22:37:23.894074+0000","last_clean":"2023-07-21T22:37:23.894074+0000","last_became_active":"2023-07-21T22:37:21.075393+0000","last_became_peered":"2023-07-21T22:37:21.075393+0000","last_unstale":"2023-07-21T22:37:23.894074+0000","last_undegraded":"2023-07-21T22:37:23.894074+0000","last_fullsized":"2023-07-21T22:37:23.894074+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:39:04.737576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895185+0000","last_change":"2023-07-21T22:37:22.100819+0000","last_active":"2023-07-21T22:37:23.895185+0000","last_peered":"2023-07-21T22:37:23.895185+0000","last_clean":"2023-07-21T22:37:23.895185+0000","last_became_active":"2023-07-21T22:37:22.100543+0000","last_became_peered":"2023-07-21T22:37:22.100543+0000","last_unstale":"2023-07-21T22:37:23.895185+0000","last_undegraded":"2023-07-21T22:37:23.895185+0000","last_fullsized":"2023-07-21T22:37:23.895185+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:16:02.039951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"127'8","reported_seq":21,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897292+0000","last_change":"2023-07-21T22:37:21.070598+0000","last_active":"2023-07-21T22:37:23.897292+0000","last_peered":"2023-07-21T22:37:23.897292+0000","last_clean":"2023-07-21T22:37:23.897292+0000","last_became_active":"2023-07-21T22:37:21.069746+0000","last_became_peered":"2023-07-21T22:37:21.069746+0000","last_unstale":"2023-07-21T22:37:23.897292+0000","last_undegraded":"2023-07-21T22:37:23.897292+0000","last_fullsized":"2023-07-21T22:37:23.897292+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:28:56.048617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894313+0000","last_change":"2023-07-21T22:37:22.105316+0000","last_active":"2023-07-21T22:37:23.894313+0000","last_peered":"2023-07-21T22:37:23.894313+0000","last_clean":"2023-07-21T22:37:23.894313+0000","last_became_active":"2023-07-21T22:37:22.104988+0000","last_became_peered":"2023-07-21T22:37:22.104988+0000","last_unstale":"2023-07-21T22:37:23.894313+0000","last_undegraded":"2023-07-21T22:37:23.894313+0000","last_fullsized":"2023-07-21T22:37:23.894313+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:53:31.061722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085631+0000","last_change":"2023-07-21T22:37:21.079461+0000","last_active":"2023-07-21T22:37:23.085631+0000","last_peered":"2023-07-21T22:37:23.085631+0000","last_clean":"2023-07-21T22:37:23.085631+0000","last_became_active":"2023-07-21T22:37:21.079152+0000","last_became_peered":"2023-07-21T22:37:21.079152+0000","last_unstale":"2023-07-21T22:37:23.085631+0000","last_undegraded":"2023-07-21T22:37:23.085631+0000","last_fullsized":"2023-07-21T22:37:23.085631+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:04:21.277761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897231+0000","last_change":"2023-07-21T22:37:22.096058+0000","last_active":"2023-07-21T22:37:23.897231+0000","last_peered":"2023-07-21T22:37:23.897231+0000","last_clean":"2023-07-21T22:37:23.897231+0000","last_became_active":"2023-07-21T22:37:22.095746+0000","last_became_peered":"2023-07-21T22:37:22.095746+0000","last_unstale":"2023-07-21T22:37:23.897231+0000","last_undegraded":"2023-07-21T22:37:23.897231+0000","last_fullsized":"2023-07-21T22:37:23.897231+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:10.697508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"128'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895120+0000","last_change":"2023-07-21T22:37:21.066856+0000","last_active":"2023-07-21T22:37:23.895120+0000","last_peered":"2023-07-21T22:37:23.895120+0000","last_clean":"2023-07-21T22:37:23.895120+0000","last_became_active":"2023-07-21T22:37:21.066089+0000","last_became_peered":"2023-07-21T22:37:21.066089+0000","last_unstale":"2023-07-21T22:37:23.895120+0000","last_undegraded":"2023-07-21T22:37:23.895120+0000","last_fullsized":"2023-07-21T22:37:23.895120+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:50:33.765050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895376+0000","last_change":"2023-07-21T22:37:22.095449+0000","last_active":"2023-07-21T22:37:23.895376+0000","last_peered":"2023-07-21T22:37:23.895376+0000","last_clean":"2023-07-21T22:37:23.895376+0000","last_became_active":"2023-07-21T22:37:22.095111+0000","last_became_peered":"2023-07-21T22:37:22.095111+0000","last_unstale":"2023-07-21T22:37:23.895376+0000","last_undegraded":"2023-07-21T22:37:23.895376+0000","last_fullsized":"2023-07-21T22:37:23.895376+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:10:18.979950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090592+0000","last_change":"2023-07-21T22:37:21.078173+0000","last_active":"2023-07-21T22:37:23.090592+0000","last_peered":"2023-07-21T22:37:23.090592+0000","last_clean":"2023-07-21T22:37:23.090592+0000","last_became_active":"2023-07-21T22:37:21.077879+0000","last_became_peered":"2023-07-21T22:37:21.077879+0000","last_unstale":"2023-07-21T22:37:23.090592+0000","last_undegraded":"2023-07-21T22:37:23.090592+0000","last_fullsized":"2023-07-21T22:37:23.090592+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:44:40.573704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.089923+0000","last_change":"2023-07-21T22:37:22.102991+0000","last_active":"2023-07-21T22:37:23.089923+0000","last_peered":"2023-07-21T22:37:23.089923+0000","last_clean":"2023-07-21T22:37:23.089923+0000","last_became_active":"2023-07-21T22:37:22.102622+0000","last_became_peered":"2023-07-21T22:37:22.102622+0000","last_unstale":"2023-07-21T22:37:23.089923+0000","last_undegraded":"2023-07-21T22:37:23.089923+0000","last_fullsized":"2023-07-21T22:37:23.089923+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:58:02.622539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085940+0000","last_change":"2023-07-21T22:37:21.077940+0000","last_active":"2023-07-21T22:37:23.085940+0000","last_peered":"2023-07-21T22:37:23.085940+0000","last_clean":"2023-07-21T22:37:23.085940+0000","last_became_active":"2023-07-21T22:37:21.077593+0000","last_became_peered":"2023-07-21T22:37:21.077593+0000","last_unstale":"2023-07-21T22:37:23.085940+0000","last_undegraded":"2023-07-21T22:37:23.085940+0000","last_fullsized":"2023-07-21T22:37:23.085940+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:13:11.119495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894278+0000","last_change":"2023-07-21T22:37:22.096917+0000","last_active":"2023-07-21T22:37:23.894278+0000","last_peered":"2023-07-21T22:37:23.894278+0000","last_clean":"2023-07-21T22:37:23.894278+0000","last_became_active":"2023-07-21T22:37:22.096593+0000","last_became_peered":"2023-07-21T22:37:22.096593+0000","last_unstale":"2023-07-21T22:37:23.894278+0000","last_undegraded":"2023-07-21T22:37:23.894278+0000","last_fullsized":"2023-07-21T22:37:23.894278+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:34:09.895860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.898052+0000","last_change":"2023-07-21T22:37:21.075547+0000","last_active":"2023-07-21T22:37:23.898052+0000","last_peered":"2023-07-21T22:37:23.898052+0000","last_clean":"2023-07-21T22:37:23.898052+0000","last_became_active":"2023-07-21T22:37:21.075261+0000","last_became_peered":"2023-07-21T22:37:21.075261+0000","last_unstale":"2023-07-21T22:37:23.898052+0000","last_undegraded":"2023-07-21T22:37:23.898052+0000","last_fullsized":"2023-07-21T22:37:23.898052+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:53:52.562392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894437+0000","last_change":"2023-07-21T22:37:22.096293+0000","last_active":"2023-07-21T22:37:23.894437+0000","last_peered":"2023-07-21T22:37:23.894437+0000","last_clean":"2023-07-21T22:37:23.894437+0000","last_became_active":"2023-07-21T22:37:22.096001+0000","last_became_peered":"2023-07-21T22:37:22.096001+0000","last_unstale":"2023-07-21T22:37:23.894437+0000","last_undegraded":"2023-07-21T22:37:23.894437+0000","last_fullsized":"2023-07-21T22:37:23.894437+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:08:15.617249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894111+0000","last_change":"2023-07-21T22:37:21.076789+0000","last_active":"2023-07-21T22:37:23.894111+0000","last_peered":"2023-07-21T22:37:23.894111+0000","last_clean":"2023-07-21T22:37:23.894111+0000","last_became_active":"2023-07-21T22:37:21.076497+0000","last_became_peered":"2023-07-21T22:37:21.076497+0000","last_unstale":"2023-07-21T22:37:23.894111+0000","last_undegraded":"2023-07-21T22:37:23.894111+0000","last_fullsized":"2023-07-21T22:37:23.894111+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:48:03.217543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897717+0000","last_change":"2023-07-21T22:37:22.102450+0000","last_active":"2023-07-21T22:37:23.897717+0000","last_peered":"2023-07-21T22:37:23.897717+0000","last_clean":"2023-07-21T22:37:23.897717+0000","last_became_active":"2023-07-21T22:37:22.102161+0000","last_became_peered":"2023-07-21T22:37:22.102161+0000","last_unstale":"2023-07-21T22:37:23.897717+0000","last_undegraded":"2023-07-21T22:37:23.897717+0000","last_fullsized":"2023-07-21T22:37:23.897717+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:35:55.555978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.089961+0000","last_change":"2023-07-21T22:37:21.079413+0000","last_active":"2023-07-21T22:37:23.089961+0000","last_peered":"2023-07-21T22:37:23.089961+0000","last_clean":"2023-07-21T22:37:23.089961+0000","last_became_active":"2023-07-21T22:37:21.079087+0000","last_became_peered":"2023-07-21T22:37:21.079087+0000","last_unstale":"2023-07-21T22:37:23.089961+0000","last_undegraded":"2023-07-21T22:37:23.089961+0000","last_fullsized":"2023-07-21T22:37:23.089961+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:38:31.776033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090940+0000","last_change":"2023-07-21T22:37:22.097186+0000","last_active":"2023-07-21T22:37:23.090940+0000","last_peered":"2023-07-21T22:37:23.090940+0000","last_clean":"2023-07-21T22:37:23.090940+0000","last_became_active":"2023-07-21T22:37:22.096870+0000","last_became_peered":"2023-07-21T22:37:22.096870+0000","last_unstale":"2023-07-21T22:37:23.090940+0000","last_undegraded":"2023-07-21T22:37:23.090940+0000","last_fullsized":"2023-07-21T22:37:23.090940+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:29:45.521760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895420+0000","last_change":"2023-07-21T22:37:21.075785+0000","last_active":"2023-07-21T22:37:23.895420+0000","last_peered":"2023-07-21T22:37:23.895420+0000","last_clean":"2023-07-21T22:37:23.895420+0000","last_became_active":"2023-07-21T22:37:21.075437+0000","last_became_peered":"2023-07-21T22:37:21.075437+0000","last_unstale":"2023-07-21T22:37:23.895420+0000","last_undegraded":"2023-07-21T22:37:23.895420+0000","last_fullsized":"2023-07-21T22:37:23.895420+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:29:04.258564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.089657+0000","last_change":"2023-07-21T22:37:22.103922+0000","last_active":"2023-07-21T22:37:23.089657+0000","last_peered":"2023-07-21T22:37:23.089657+0000","last_clean":"2023-07-21T22:37:23.089657+0000","last_became_active":"2023-07-21T22:37:22.103622+0000","last_became_peered":"2023-07-21T22:37:22.103622+0000","last_unstale":"2023-07-21T22:37:23.089657+0000","last_undegraded":"2023-07-21T22:37:23.089657+0000","last_fullsized":"2023-07-21T22:37:23.089657+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:53:50.225297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894869+0000","last_change":"2023-07-21T22:37:21.079237+0000","last_active":"2023-07-21T22:37:23.894869+0000","last_peered":"2023-07-21T22:37:23.894869+0000","last_clean":"2023-07-21T22:37:23.894869+0000","last_became_active":"2023-07-21T22:37:21.078935+0000","last_became_peered":"2023-07-21T22:37:21.078935+0000","last_unstale":"2023-07-21T22:37:23.894869+0000","last_undegraded":"2023-07-21T22:37:23.894869+0000","last_fullsized":"2023-07-21T22:37:23.894869+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:01:48.375613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"116'227","reported_seq":752,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897498+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:37:23.897498+0000","last_peered":"2023-07-21T22:37:23.897498+0000","last_clean":"2023-07-21T22:37:23.897498+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:37:23.897498+0000","last_undegraded":"2023-07-21T22:37:23.897498+0000","last_fullsized":"2023-07-21T22:37:23.897498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:10:09.085810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090111+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:37:23.090111+0000","last_peered":"2023-07-21T22:37:23.090111+0000","last_clean":"2023-07-21T22:37:23.090111+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:37:23.090111+0000","last_undegraded":"2023-07-21T22:37:23.090111+0000","last_fullsized":"2023-07-21T22:37:23.090111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:29:16.716451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090122+0000","last_change":"2023-07-21T22:37:22.100051+0000","last_active":"2023-07-21T22:37:23.090122+0000","last_peered":"2023-07-21T22:37:23.090122+0000","last_clean":"2023-07-21T22:37:23.090122+0000","last_became_active":"2023-07-21T22:37:22.099760+0000","last_became_peered":"2023-07-21T22:37:22.099760+0000","last_unstale":"2023-07-21T22:37:23.090122+0000","last_undegraded":"2023-07-21T22:37:23.090122+0000","last_fullsized":"2023-07-21T22:37:23.090122+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:47:14.048064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"127'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897716+0000","last_change":"2023-07-21T22:37:21.075739+0000","last_active":"2023-07-21T22:37:23.897716+0000","last_peered":"2023-07-21T22:37:23.897716+0000","last_clean":"2023-07-21T22:37:23.897716+0000","last_became_active":"2023-07-21T22:37:21.075418+0000","last_became_peered":"2023-07-21T22:37:21.075418+0000","last_unstale":"2023-07-21T22:37:23.897716+0000","last_undegraded":"2023-07-21T22:37:23.897716+0000","last_fullsized":"2023-07-21T22:37:23.897716+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:25:50.222839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":206,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897331+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:37:23.897331+0000","last_peered":"2023-07-21T22:37:23.897331+0000","last_clean":"2023-07-21T22:37:23.897331+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:37:23.897331+0000","last_undegraded":"2023-07-21T22:37:23.897331+0000","last_fullsized":"2023-07-21T22:37:23.897331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:21.855598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085624+0000","last_change":"2023-07-21T22:37:22.096666+0000","last_active":"2023-07-21T22:37:23.085624+0000","last_peered":"2023-07-21T22:37:23.085624+0000","last_clean":"2023-07-21T22:37:23.085624+0000","last_became_active":"2023-07-21T22:37:22.094428+0000","last_became_peered":"2023-07-21T22:37:22.094428+0000","last_unstale":"2023-07-21T22:37:23.085624+0000","last_undegraded":"2023-07-21T22:37:23.085624+0000","last_fullsized":"2023-07-21T22:37:23.085624+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:17:40.482680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.090230+0000","last_change":"2023-07-21T22:37:21.079660+0000","last_active":"2023-07-21T22:37:23.090230+0000","last_peered":"2023-07-21T22:37:23.090230+0000","last_clean":"2023-07-21T22:37:23.090230+0000","last_became_active":"2023-07-21T22:37:21.079340+0000","last_became_peered":"2023-07-21T22:37:21.079340+0000","last_unstale":"2023-07-21T22:37:23.090230+0000","last_undegraded":"2023-07-21T22:37:23.090230+0000","last_fullsized":"2023-07-21T22:37:23.090230+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:49:00.428677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":204,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895068+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:37:23.895068+0000","last_peered":"2023-07-21T22:37:23.895068+0000","last_clean":"2023-07-21T22:37:23.895068+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:37:23.895068+0000","last_undegraded":"2023-07-21T22:37:23.895068+0000","last_fullsized":"2023-07-21T22:37:23.895068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:31.034805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895257+0000","last_change":"2023-07-21T22:37:22.103174+0000","last_active":"2023-07-21T22:37:23.895257+0000","last_peered":"2023-07-21T22:37:23.895257+0000","last_clean":"2023-07-21T22:37:23.895257+0000","last_became_active":"2023-07-21T22:37:22.102794+0000","last_became_peered":"2023-07-21T22:37:22.102794+0000","last_unstale":"2023-07-21T22:37:23.895257+0000","last_undegraded":"2023-07-21T22:37:23.895257+0000","last_fullsized":"2023-07-21T22:37:23.895257+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:50:32.597539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"127'1","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.091003+0000","last_change":"2023-07-21T22:37:21.078854+0000","last_active":"2023-07-21T22:37:23.091003+0000","last_peered":"2023-07-21T22:37:23.091003+0000","last_clean":"2023-07-21T22:37:23.091003+0000","last_became_active":"2023-07-21T22:37:21.078575+0000","last_became_peered":"2023-07-21T22:37:21.078575+0000","last_unstale":"2023-07-21T22:37:23.091003+0000","last_undegraded":"2023-07-21T22:37:23.091003+0000","last_fullsized":"2023-07-21T22:37:23.091003+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:00:23.752947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":224,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.089768+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:37:23.089768+0000","last_peered":"2023-07-21T22:37:23.089768+0000","last_clean":"2023-07-21T22:37:23.089768+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:37:23.089768+0000","last_undegraded":"2023-07-21T22:37:23.089768+0000","last_fullsized":"2023-07-21T22:37:23.089768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:03:44.470488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894743+0000","last_change":"2023-07-21T22:37:22.095754+0000","last_active":"2023-07-21T22:37:23.894743+0000","last_peered":"2023-07-21T22:37:23.894743+0000","last_clean":"2023-07-21T22:37:23.894743+0000","last_became_active":"2023-07-21T22:37:22.095277+0000","last_became_peered":"2023-07-21T22:37:22.095277+0000","last_unstale":"2023-07-21T22:37:23.894743+0000","last_undegraded":"2023-07-21T22:37:23.894743+0000","last_fullsized":"2023-07-21T22:37:23.894743+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:28:16.432570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.089910+0000","last_change":"2023-07-21T22:37:21.078876+0000","last_active":"2023-07-21T22:37:23.089910+0000","last_peered":"2023-07-21T22:37:23.089910+0000","last_clean":"2023-07-21T22:37:23.089910+0000","last_became_active":"2023-07-21T22:37:21.078596+0000","last_became_peered":"2023-07-21T22:37:21.078596+0000","last_unstale":"2023-07-21T22:37:23.089910+0000","last_undegraded":"2023-07-21T22:37:23.089910+0000","last_fullsized":"2023-07-21T22:37:23.089910+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:53:38.824207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.086043+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:37:23.086043+0000","last_peered":"2023-07-21T22:37:23.086043+0000","last_clean":"2023-07-21T22:37:23.086043+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:37:23.086043+0000","last_undegraded":"2023-07-21T22:37:23.086043+0000","last_fullsized":"2023-07-21T22:37:23.086043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:33.030520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894122+0000","last_change":"2023-07-21T22:37:22.096709+0000","last_active":"2023-07-21T22:37:23.894122+0000","last_peered":"2023-07-21T22:37:23.894122+0000","last_clean":"2023-07-21T22:37:23.894122+0000","last_became_active":"2023-07-21T22:37:22.096087+0000","last_became_peered":"2023-07-21T22:37:22.096087+0000","last_unstale":"2023-07-21T22:37:23.894122+0000","last_undegraded":"2023-07-21T22:37:23.894122+0000","last_fullsized":"2023-07-21T22:37:23.894122+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:40:48.903412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895273+0000","last_change":"2023-07-21T22:37:21.075411+0000","last_active":"2023-07-21T22:37:23.895273+0000","last_peered":"2023-07-21T22:37:23.895273+0000","last_clean":"2023-07-21T22:37:23.895273+0000","last_became_active":"2023-07-21T22:37:21.075095+0000","last_became_peered":"2023-07-21T22:37:21.075095+0000","last_unstale":"2023-07-21T22:37:23.895273+0000","last_undegraded":"2023-07-21T22:37:23.895273+0000","last_fullsized":"2023-07-21T22:37:23.895273+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:12:52.089664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.897867+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:37:23.897867+0000","last_peered":"2023-07-21T22:37:23.897867+0000","last_clean":"2023-07-21T22:37:23.897867+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:37:23.897867+0000","last_undegraded":"2023-07-21T22:37:23.897867+0000","last_fullsized":"2023-07-21T22:37:23.897867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:20:37.131269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.894972+0000","last_change":"2023-07-21T22:37:22.106950+0000","last_active":"2023-07-21T22:37:23.894972+0000","last_peered":"2023-07-21T22:37:23.894972+0000","last_clean":"2023-07-21T22:37:23.894972+0000","last_became_active":"2023-07-21T22:37:22.106662+0000","last_became_peered":"2023-07-21T22:37:22.106662+0000","last_unstale":"2023-07-21T22:37:23.894972+0000","last_undegraded":"2023-07-21T22:37:23.894972+0000","last_fullsized":"2023-07-21T22:37:23.894972+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:11:41.213853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"127'2","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895643+0000","last_change":"2023-07-21T22:37:21.075461+0000","last_active":"2023-07-21T22:37:23.895643+0000","last_peered":"2023-07-21T22:37:23.895643+0000","last_clean":"2023-07-21T22:37:23.895643+0000","last_became_active":"2023-07-21T22:37:21.075125+0000","last_became_peered":"2023-07-21T22:37:21.075125+0000","last_unstale":"2023-07-21T22:37:23.895643+0000","last_undegraded":"2023-07-21T22:37:23.895643+0000","last_fullsized":"2023-07-21T22:37:23.895643+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:20:12.305387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":215,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.085728+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:37:23.085728+0000","last_peered":"2023-07-21T22:37:23.085728+0000","last_clean":"2023-07-21T22:37:23.085728+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:37:23.085728+0000","last_undegraded":"2023-07-21T22:37:23.085728+0000","last_fullsized":"2023-07-21T22:37:23.085728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:29:14.065486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.895566+0000","last_change":"2023-07-21T22:37:22.099935+0000","last_active":"2023-07-21T22:37:23.895566+0000","last_peered":"2023-07-21T22:37:23.895566+0000","last_clean":"2023-07-21T22:37:23.895566+0000","last_became_active":"2023-07-21T22:37:22.099214+0000","last_became_peered":"2023-07-21T22:37:22.099214+0000","last_unstale":"2023-07-21T22:37:23.895566+0000","last_undegraded":"2023-07-21T22:37:23.895566+0000","last_fullsized":"2023-07-21T22:37:23.895566+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:21.046551+0000","last_clean_scrub_stamp":"2023-07-21T22:37:21.046551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:04:30.085035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.893896+0000","last_change":"2023-07-21T22:37:21.073046+0000","last_active":"2023-07-21T22:37:23.893896+0000","last_peered":"2023-07-21T22:37:23.893896+0000","last_clean":"2023-07-21T22:37:23.893896+0000","last_became_active":"2023-07-21T22:37:21.072789+0000","last_became_peered":"2023-07-21T22:37:21.072789+0000","last_unstale":"2023-07-21T22:37:23.893896+0000","last_undegraded":"2023-07-21T22:37:23.893896+0000","last_fullsized":"2023-07-21T22:37:23.893896+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:37:20.039448+0000","last_clean_scrub_stamp":"2023-07-21T22:37:20.039448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:33:08.085011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":201,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-07-21T22:37:23.091156+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:37:23.091156+0000","last_peered":"2023-07-21T22:37:23.091156+0000","last_clean":"2023-07-21T22:37:23.091156+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:37:23.091156+0000","last_undegraded":"2023-07-21T22:37:23.091156+0000","last_fullsized":"2023-07-21T22:37:23.091156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:52:30.092132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509665,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59412,"kb_used_data":2124,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312428,"statfs":{"total":96636764160,"available":96575926272,"internally_reserved":0,"allocated":2174976,"data_stored":1383345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.63,"5min":0.42599999999999999,"15min":0.35299999999999998},"max":{"1min":0.95199999999999996,"5min":3.5059999999999998,"15min":3.5059999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69599999999999995,"15min":0.69699999999999995},"min":{"1min":0.54500000000000004,"5min":0.40899999999999997,"15min":0.39500000000000002},"max":{"1min":0.82599999999999996,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":0.71299999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70899999999999996,"15min":0.72999999999999998},"min":{"1min":0.52700000000000002,"5min":0.44900000000000001,"15min":0.432},"max":{"1min":0.92400000000000004,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.69599999999999995,"15min":0.71499999999999997},"min":{"1min":0.497,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.873,"5min":1.093,"15min":1.093},"last":0.67400000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.501,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.877,"5min":1.1399999999999999,"15min":1.405},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.57399999999999995,"5min":0.47999999999999998,"15min":0.45800000000000002},"max":{"1min":0.88800000000000001,"5min":1.409,"15min":1.409},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.75900000000000001,"15min":0.76500000000000001},"min":{"1min":0.55400000000000005,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95399999999999996,"5min":1.46,"15min":1.46},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.56599999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92900000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.77100000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55200000000000005,"15min":0.56100000000000005},"min":{"1min":0.42699999999999999,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.66900000000000004,"5min":0.90000000000000002,"15min":0.94999999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.63,"15min":0.61699999999999999},"min":{"1min":0.39800000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82699999999999996,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.64800000000000002,"15min":0.624},"min":{"1min":0.46000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.85199999999999998,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70099999999999996,"15min":0.68000000000000005},"min":{"1min":0.51100000000000001,"5min":0.42499999999999999,"15min":0.38300000000000001},"max":{"1min":0.90900000000000003,"5min":1.506,"15min":1.506},"last":0.58999999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:37:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68799999999999994,"15min":0.67900000000000005},"min":{"1min":0.53600000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89000000000000001,"5min":1.0329999999999999,"15min":1.048},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.47399999999999998,"5min":0.442,"15min":0.42699999999999999},"max":{"1min":0.83599999999999997,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.64400000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542371,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1556,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1593344,"data_stored":794985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72999999999999998,"15min":0.76000000000000001},"min":{"1min":0.54200000000000004,"5min":0.40899999999999997,"15min":0.36599999999999999},"max":{"1min":0.95599999999999996,"5min":1.016,"15min":1.016},"last":0.871},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.77400000000000002,"15min":0.79100000000000004},"min":{"1min":0.58499999999999996,"5min":0.53200000000000003,"15min":0.437},"max":{"1min":0.93700000000000006,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.96799999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71899999999999997,"15min":0.73299999999999998},"min":{"1min":0.57599999999999996,"5min":0.49099999999999999,"15min":0.45300000000000001},"max":{"1min":0.86399999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71399999999999997,"15min":0.73199999999999998},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.82799999999999996,"5min":0.99199999999999999,"15min":1.117},"last":0.92600000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72099999999999997,"15min":0.747},"min":{"1min":0.53000000000000003,"5min":0.435,"15min":0.42799999999999999},"max":{"1min":0.91400000000000003,"5min":0.98099999999999998,"15min":0.997},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.78900000000000003},"min":{"1min":0.59299999999999997,"5min":0.53500000000000003,"15min":0.45500000000000002},"max":{"1min":0.99099999999999999,"5min":1.097,"15min":1.097},"last":0.94799999999999995}]},{"osd":3,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.72999999999999998,"15min":0.754},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.45000000000000001},"max":{"1min":0.89400000000000002,"5min":1.048,"15min":1.048},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70999999999999996,"15min":0.73199999999999998},"min":{"1min":0.56399999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.85799999999999998,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.98499999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.59299999999999997},"min":{"1min":0.47199999999999998,"5min":0.374,"15min":0.36599999999999999},"max":{"1min":0.83699999999999997,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.623},"min":{"1min":0.42299999999999999,"5min":0.40500000000000003,"15min":0.39700000000000002},"max":{"1min":0.92800000000000005,"5min":0.98299999999999998,"15min":1.0209999999999999},"last":0.58799999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.61499999999999999},"min":{"1min":0.45900000000000002,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":0.89300000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.497,"5min":0.46000000000000002,"15min":0.435},"max":{"1min":0.95299999999999996,"5min":0.98299999999999998,"15min":1.054},"last":0.623}]},{"osd":7,"last update":"Fri Jul 21 22:37:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69999999999999996,"15min":0.67900000000000005},"min":{"1min":0.48199999999999998,"5min":0.47399999999999998,"15min":0.443},"max":{"1min":0.996,"5min":1.079,"15min":1.079},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70299999999999996,"15min":0.69099999999999995},"min":{"1min":0.51900000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97199999999999998,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.78600000000000003}]}]},{"osd":5,"up_from":15,"seq":64424509664,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50632,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321208,"statfs":{"total":96636764160,"available":96584916992,"internally_reserved":0,"allocated":1572864,"data_stored":792817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67800000000000005,"15min":0.71199999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.35699999999999998},"max":{"1min":0.98799999999999999,"5min":1,"15min":1.8779999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70599999999999996,"15min":0.71799999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.95799999999999996,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.57499999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67300000000000004,"15min":0.70299999999999996},"min":{"1min":0.49199999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90700000000000003,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68799999999999994,"15min":0.72499999999999998},"min":{"1min":0.441,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92500000000000004,"5min":0.94399999999999995,"15min":1.617},"last":0.66100000000000003}]},{"osd":2,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.70599999999999996,"15min":0.72899999999999998},"min":{"1min":0.52600000000000002,"5min":0.45100000000000001,"15min":0.33600000000000002},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.71099999999999997,"15min":0.74199999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.377},"max":{"1min":0.94499999999999995,"5min":1.073,"15min":1.512},"last":0.76200000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.44800000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.472},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.754,"15min":0.78800000000000003},"min":{"1min":0.628,"5min":0.496,"15min":0.496},"max":{"1min":0.92200000000000004,"5min":1.022,"15min":1.556},"last":0.82499999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57299999999999995,"15min":0.56499999999999995},"min":{"1min":0.37,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76900000000000002,"5min":0.88900000000000001,"15min":0.96999999999999997},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71599999999999997,"15min":0.69499999999999995},"min":{"1min":0.53400000000000003,"5min":0.433,"15min":0.433},"max":{"1min":0.92400000000000004,"5min":1.012,"15min":1.038},"last":0.83999999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.59099999999999997},"min":{"1min":0.47999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.76000000000000001,"5min":0.95499999999999996,"15min":1.0049999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.63700000000000001,"15min":0.61499999999999999},"min":{"1min":0.42599999999999999,"5min":0.40200000000000002,"15min":0.40000000000000002},"max":{"1min":0.84899999999999998,"5min":0.93799999999999994,"15min":1.02},"last":0.73699999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:37:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.69199999999999995,"15min":0.65400000000000003},"min":{"1min":0.51900000000000002,"5min":0.40999999999999998,"15min":0.374},"max":{"1min":0.97599999999999998,"5min":1.042,"15min":1.042},"last":0.88},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.755,"15min":0.73199999999999998},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.96899999999999997,"5min":0.999,"15min":1.7390000000000001},"last":0.86499999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509665,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1544,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1581056,"data_stored":792909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.71799999999999997,"15min":0.74399999999999999},"min":{"1min":0.56499999999999995,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":0.98299999999999998,"5min":0.99399999999999999,"15min":1.0429999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.59899999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.64200000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.51300000000000001,"5min":0.442,"15min":0.39400000000000002},"max":{"1min":0.97799999999999998,"5min":1.002,"15min":1.002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68200000000000005,"15min":0.70199999999999996},"min":{"1min":0.57999999999999996,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.877,"5min":0.93000000000000005,"15min":1.016},"last":0.69799999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73099999999999998,"15min":0.76000000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.371},"max":{"1min":1.0169999999999999,"5min":1.048,"15min":1.048},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.751,"15min":0.76700000000000002},"min":{"1min":0.61099999999999999,"5min":0.47699999999999998,"15min":0.33000000000000002},"max":{"1min":0.99199999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.71199999999999997,"15min":0.73299999999999998},"min":{"1min":0.57499999999999996,"5min":0.47199999999999998,"15min":0.40100000000000002},"max":{"1min":0.94599999999999995,"5min":0.97999999999999998,"15min":1.026},"last":0.498},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76900000000000002,"15min":0.78300000000000003},"min":{"1min":0.53400000000000003,"5min":0.53000000000000003,"15min":0.47999999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.625}]},{"osd":5,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60299999999999998,"15min":0.58199999999999996},"min":{"1min":0.45100000000000001,"5min":0.42999999999999999,"15min":0.34399999999999997},"max":{"1min":0.85299999999999998,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60199999999999998,"15min":0.59199999999999997},"min":{"1min":0.46500000000000002,"5min":0.38800000000000001,"15min":0.32800000000000001},"max":{"1min":0.83999999999999997,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.58399999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64900000000000002,"15min":0.64700000000000002},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.38500000000000001},"max":{"1min":0.92800000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.75},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.72799999999999998,"15min":0.72299999999999998},"min":{"1min":0.53000000000000003,"5min":0.438,"15min":0.41599999999999998},"max":{"1min":0.95799999999999996,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:36:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65800000000000003,"15min":0.65200000000000002},"min":{"1min":0.497,"5min":0.45500000000000002,"15min":0.39200000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.0429999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.52200000000000002,"5min":0.46400000000000002,"15min":0.45300000000000001},"max":{"1min":0.874,"5min":1.101,"15min":1.135},"last":0.71399999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509664,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1576960,"data_stored":793399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47699999999999998,"15min":0.47899999999999998},"min":{"1min":0.30199999999999999,"5min":0.28599999999999998,"15min":0.27000000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.755,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.52800000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.46700000000000003,"15min":0.47999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72199999999999998,"5min":0.754,"15min":0.83499999999999996},"last":0.373},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.29999999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82199999999999995,"5min":0.82599999999999996,"15min":0.90100000000000002},"last":0.498}]},{"osd":2,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.81000000000000005,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57999999999999996,"15min":0.59999999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.99199999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.55400000000000005,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.052,"5min":1.093,"15min":1.1279999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.622,"5min":0.442,"15min":0.442},"max":{"1min":1.0580000000000001,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.81100000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.76300000000000001,"15min":0.77400000000000002},"min":{"1min":0.53300000000000003,"5min":0.501,"15min":0.48999999999999999},"max":{"1min":1.002,"5min":1.0669999999999999,"15min":1.137},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.77100000000000002,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.51300000000000001,"15min":0.42899999999999999},"max":{"1min":1.079,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.63,"5min":0.51700000000000002,"15min":0.47399999999999998},"max":{"1min":1.0649999999999999,"5min":1.0680000000000001,"15min":1.169},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.76700000000000002,"15min":0.77400000000000002},"min":{"1min":0.48199999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.03,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.88200000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:37:14 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.63900000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.083,"5min":1.087,"15min":1.099},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.82699999999999996,"15min":0.83199999999999996},"min":{"1min":0.67200000000000004,"5min":0.55200000000000005,"15min":0.48599999999999999},"max":{"1min":1.0980000000000001,"5min":1.623,"15min":1.623},"last":0.85199999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509666,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54732,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317108,"statfs":{"total":96636764160,"available":96580718592,"internally_reserved":0,"allocated":1576960,"data_stored":792851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.438,"15min":0.46400000000000002},"min":{"1min":0.28999999999999998,"5min":0.27200000000000002,"15min":0.23899999999999999},"max":{"1min":0.68200000000000005,"5min":0.75,"15min":0.94199999999999995},"last":0.498},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.54300000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.308},"max":{"1min":0.77400000000000002,"5min":0.88300000000000001,"15min":1.0409999999999999},"last":0.47899999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54200000000000004,"15min":0.54600000000000004},"min":{"1min":0.44900000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.748,"5min":0.86699999999999999,"15min":0.93999999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.41999999999999998,"5min":0.38900000000000001,"15min":0.36099999999999999},"max":{"1min":0.85299999999999998,"5min":1.012,"15min":1.085},"last":0.443}]},{"osd":3,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.72299999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54000000000000004,"15min":0.56499999999999995},"min":{"1min":0.39400000000000002,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.81299999999999994,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.56100000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.74399999999999999,"15min":0.78400000000000003},"min":{"1min":0.48399999999999999,"5min":0.46600000000000003,"15min":0.376},"max":{"1min":0.96699999999999997,"5min":1.2110000000000001,"15min":1.3420000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.748,"15min":0.78900000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.022,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.77300000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.73899999999999999,"15min":0.78000000000000003},"min":{"1min":0.55900000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.78100000000000003,"15min":0.80900000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.46400000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.3089999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.75900000000000001,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.499,"15min":0.40300000000000002},"max":{"1min":1.052,"5min":1.536,"15min":1.536},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.76400000000000001,"15min":0.80500000000000005},"min":{"1min":0.60999999999999999,"5min":0.54500000000000004,"15min":0.46200000000000002},"max":{"1min":1.1100000000000001,"5min":1.1339999999999999,"15min":1.2649999999999999},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:37:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.77700000000000002,"15min":0.81699999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.107,"5min":1.143,"15min":1.214},"last":0.752},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.80400000000000005},"min":{"1min":0.54300000000000004,"5min":0.50900000000000001,"15min":0.44700000000000001},"max":{"1min":1.0720000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.60299999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509665,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1576960,"data_stored":792851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.47299999999999998,"15min":0.47899999999999998},"min":{"1min":0.29299999999999998,"5min":0.28299999999999997,"15min":0.22900000000000001},"max":{"1min":0.73699999999999999,"5min":0.78700000000000003,"15min":0.84599999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.55000000000000004,"15min":0.56399999999999995},"min":{"1min":0.45300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.872},"last":0.41799999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.49099999999999999,"15min":0.50700000000000001},"min":{"1min":0.36799999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.81000000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.41799999999999998,"5min":0.34599999999999997,"15min":0.29099999999999998},"max":{"1min":0.88,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57599999999999996,"15min":0.59599999999999997},"min":{"1min":0.47199999999999998,"5min":0.378,"15min":0.33400000000000002},"max":{"1min":0.73399999999999999,"5min":0.81699999999999995,"15min":0.98899999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.505,"15min":0.51600000000000001},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":0.70999999999999996,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.33800000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.75900000000000001,"15min":0.77500000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.432},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.79200000000000004,"15min":0.79800000000000004},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.498},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.76500000000000001,"15min":0.78300000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.41899999999999998},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.79700000000000004,"15min":0.80000000000000004},"min":{"1min":0.65100000000000002,"5min":0.51500000000000001,"15min":0.376},"max":{"1min":1.276,"5min":1.276,"15min":1.2849999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.79300000000000004,"15min":0.81000000000000005},"min":{"1min":0.65500000000000003,"5min":0.53000000000000003,"15min":0.47899999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.23},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.77700000000000002,"15min":0.79000000000000004},"min":{"1min":0.52000000000000002,"5min":0.50900000000000001,"15min":0.46500000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.3240000000000001},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.80000000000000004,"15min":0.81200000000000006},"min":{"1min":0.57899999999999996,"5min":0.53800000000000003,"15min":0.49199999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3149999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.80000000000000004,"15min":0.80700000000000005},"min":{"1min":0.55600000000000005,"5min":0.55500000000000005,"15min":0.45700000000000002},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.3380000000000001},"last":0.90800000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509667,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37276,"kb_used_data":2132,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334564,"statfs":{"total":96636764160,"available":96598593536,"internally_reserved":0,"allocated":2183168,"data_stored":1384839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46999999999999997,"15min":0.46899999999999997},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.26600000000000001},"max":{"1min":0.70399999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.40100000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.42099999999999999,"5min":0.32400000000000001,"15min":0.29799999999999999},"max":{"1min":0.82599999999999996,"5min":0.871,"15min":1.3680000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.49299999999999999,"15min":0.51700000000000002},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.32600000000000001},"max":{"1min":0.68200000000000005,"5min":0.76700000000000002,"15min":0.871},"last":0.49099999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57299999999999995,"15min":0.58999999999999997},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.505},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.33700000000000002},"max":{"1min":0.745,"5min":1.038,"15min":1.038},"last":0.44400000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.79900000000000004,"15min":0.78400000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.45200000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.3009999999999999},"last":1.341},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.80500000000000005,"15min":0.80200000000000005},"min":{"1min":0.54500000000000004,"5min":0.505,"15min":0.44600000000000001},"max":{"1min":1.278,"5min":1.278,"15min":1.423},"last":1.206}]},{"osd":5,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78200000000000003,"15min":0.77900000000000003},"min":{"1min":0.56799999999999995,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.0229999999999999,"5min":1.1020000000000001,"15min":1.2669999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81000000000000005,"15min":0.80800000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.39600000000000002},"max":{"1min":1.1950000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.85799999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.48899999999999999},"max":{"1min":1.054,"5min":1.27,"15min":1.27},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.81100000000000005,"15min":0.81799999999999995},"min":{"1min":0.64300000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.333},"last":1.363}]},{"osd":7,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.60099999999999998,"5min":0.54300000000000004,"15min":0.53100000000000003},"max":{"1min":1.121,"5min":1.159,"15min":1.2310000000000001},"last":1.254},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.80800000000000005,"15min":0.82799999999999996},"min":{"1min":0.55600000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.109,"5min":1.1930000000000001,"15min":1.369},"last":0.88600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:37:31.199 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T22:37:31.199 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-21T22:37:31.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.341+0000 7fcdb63c5640 1 Processor -- start 2023-07-21T22:37:31.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.341+0000 7fcdb63c5640 1 -- start start 2023-07-21T22:37:31.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.341+0000 7fcdb63c5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcdb006a100 0x7fcdb006fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:31.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.341+0000 7fcdb63c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdb006ff80 0x7fcdb006cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:31.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.341+0000 7fcdb63c5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb006d8e0 con 0x7fcdb006d480 2023-07-21T22:37:31.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.341+0000 7fcdb63c5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb00703d0 con 0x7fcdb006a100 2023-07-21T22:37:31.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.341+0000 7fcdb63c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb015f6a0 con 0x7fcdb006ff80 2023-07-21T22:37:31.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.341+0000 7fcdb4962640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcdb006d480 0x7fcdb006ba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36046/0 (socket says 172.21.15.6:36046) 2023-07-21T22:37:31.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.341+0000 7fcdb4962640 1 -- 172.21.15.6:0/2772339696 learned_addr learned my addr 172.21.15.6:0/2772339696 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:31.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.341+0000 7fcdaffff640 1 --2- 172.21.15.6:0/2772339696 >> v2:172.21.15.161:3300/0 conn(0x7fcdb006a100 0x7fcdb006fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:31.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.341+0000 7fcdaf7fe640 1 --2- 172.21.15.6:0/2772339696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdb006ff80 0x7fcdb006cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:31.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdaeffd640 1 -- 172.21.15.6:0/2772339696 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973707811 0 0) 0x7fcdb006d8e0 con 0x7fcdb006d480 2023-07-21T22:37:31.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdaeffd640 1 -- 172.21.15.6:0/2772339696 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd98003530 con 0x7fcdb006d480 2023-07-21T22:37:31.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdaeffd640 1 -- 172.21.15.6:0/2772339696 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1224839678 0 0) 0x7fcd98003530 con 0x7fcdb006d480 2023-07-21T22:37:31.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdaeffd640 1 -- 172.21.15.6:0/2772339696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdb006ff80 msgr2=0x7fcdb006cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:31.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdaeffd640 1 --2- 172.21.15.6:0/2772339696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdb006ff80 0x7fcdb006cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdaeffd640 1 -- 172.21.15.6:0/2772339696 >> v2:172.21.15.161:3300/0 conn(0x7fcdb006a100 msgr2=0x7fcdb006fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:31.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdaeffd640 1 --2- 172.21.15.6:0/2772339696 >> v2:172.21.15.161:3300/0 conn(0x7fcdb006a100 0x7fcdb006fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdaeffd640 1 -- 172.21.15.6:0/2772339696 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb0160220 con 0x7fcdb006d480 2023-07-21T22:37:31.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdaeffd640 1 -- 172.21.15.6:0/2772339696 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fcda8001a00 con 0x7fcdb006d480 2023-07-21T22:37:31.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdaeffd640 1 -- 172.21.15.6:0/2772339696 >> v1:172.21.15.6:6789/0 conn(0x7fcdb006d480 legacy=0x7fcdb006ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:31.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdaeffd640 1 --2- 172.21.15.6:0/2772339696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd98003980 0x7fcd98003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:31.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdaeffd640 1 --2- 172.21.15.6:0/2772339696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd980043b0 0x7fcd98004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:31.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdaeffd640 1 --2- 172.21.15.6:0/2772339696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd98004f30 0x7fcd9800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:31.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdaeffd640 1 -- 172.21.15.6:0/2772339696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00703d0 con 0x7fcd98004f30 2023-07-21T22:37:31.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdaeffd640 1 -- 172.21.15.6:0/2772339696 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb015f6a0 con 0x7fcd98003980 2023-07-21T22:37:31.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdaeffd640 1 -- 172.21.15.6:0/2772339696 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9800bed0 con 0x7fcd980043b0 2023-07-21T22:37:31.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdaffff640 1 --2- 172.21.15.6:0/2772339696 >> v2:172.21.15.161:3300/0 conn(0x7fcdb006a100 0x7fcdb006fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:31.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdb4962640 1 --2- 172.21.15.6:0/2772339696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd98004f30 0x7fcd9800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:31.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdaf7fe640 1 --2- 172.21.15.6:0/2772339696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd980043b0 0x7fcd98004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:31.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdaffff640 1 --2- 172.21.15.6:0/2772339696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd98003980 0x7fcd98003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:31.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdb4962640 1 -- 172.21.15.6:0/2772339696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd980043b0 msgr2=0x7fcd98004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:31.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdb4962640 1 --2- 172.21.15.6:0/2772339696 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd980043b0 0x7fcd98004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdb4962640 1 -- 172.21.15.6:0/2772339696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd98003980 msgr2=0x7fcd98003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:31.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdb4962640 1 --2- 172.21.15.6:0/2772339696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd98003980 0x7fcd98003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdb4962640 1 -- 172.21.15.6:0/2772339696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd98003530 con 0x7fcd98004f30 2023-07-21T22:37:31.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.345+0000 7fcdaffff640 1 --2- 172.21.15.6:0/2772339696 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd98003980 0x7fcd98003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:31.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.349+0000 7fcdb4962640 1 --2- 172.21.15.6:0/2772339696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd98004f30 0x7fcd9800b990 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fcda800a860 tx=0x7fcda801fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc2baf4d3f5cc0d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:31.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.349+0000 7fcdaeffd640 1 -- 172.21.15.6:0/2772339696 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda80aa6f0 con 0x7fcd98004f30 2023-07-21T22:37:31.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.349+0000 7fcdaeffd640 1 -- 172.21.15.6:0/2772339696 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda80aa850 con 0x7fcd98004f30 2023-07-21T22:37:31.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.349+0000 7fcdaeffd640 1 -- 172.21.15.6:0/2772339696 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda80aac20 con 0x7fcd98004f30 2023-07-21T22:37:31.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.349+0000 7fcdb63c5640 1 -- 172.21.15.6:0/2772339696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd98004f30 msgr2=0x7fcd9800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:31.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.349+0000 7fcdb63c5640 1 --2- 172.21.15.6:0/2772339696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd98004f30 0x7fcd9800b990 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fcda800a860 tx=0x7fcda801fac0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.349+0000 7fcdb4962640 1 -- 172.21.15.6:0/2772339696 reap_dead start 2023-07-21T22:37:31.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.349+0000 7fcdb63c5640 1 -- 172.21.15.6:0/2772339696 shutdown_connections 2023-07-21T22:37:31.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.349+0000 7fcdb63c5640 1 -- 172.21.15.6:0/2772339696 >> 172.21.15.6:0/2772339696 conn(0x7fcdb00b0490 msgr2=0x7fcdb00b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:31.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.349+0000 7fcdb63c5640 1 -- 172.21.15.6:0/2772339696 shutdown_connections 2023-07-21T22:37:31.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.349+0000 7fcdb63c5640 1 -- 172.21.15.6:0/2772339696 wait complete. 2023-07-21T22:37:31.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.349+0000 7fcdb63c5640 1 Processor -- start 2023-07-21T22:37:31.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.349+0000 7fcdb63c5640 1 -- start start 2023-07-21T22:37:31.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.349+0000 7fcdb63c5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd98004f30 0x7fcdb00ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:31.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.349+0000 7fcdb63c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdb00c7b10 0x7fcdb00c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:31.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdb63c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdb015db60 0x7fcdb015dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:31.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdb63c5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb015e510 con 0x7fcdb00c7b10 2023-07-21T22:37:31.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdb63c5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00c8590 con 0x7fcd98004f30 2023-07-21T22:37:31.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdb63c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00c8870 con 0x7fcdb015db60 2023-07-21T22:37:31.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdaf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdb00c7b10 0x7fcdb00c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:31.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdaf7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdb00c7b10 0x7fcdb00c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50924/0 (socket says 172.21.15.6:50924) 2023-07-21T22:37:31.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdaf7fe640 1 -- 172.21.15.6:0/1399484946 learned_addr learned my addr 172.21.15.6:0/1399484946 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:31.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdb4962640 1 --2- 172.21.15.6:0/1399484946 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdb015db60 0x7fcdb015dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:31.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdaffff640 1 --2- 172.21.15.6:0/1399484946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd98004f30 0x7fcdb00ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:31.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdaf7fe640 1 -- 172.21.15.6:0/1399484946 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdb015db60 msgr2=0x7fcdb015dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:31.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdaf7fe640 1 --2- 172.21.15.6:0/1399484946 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdb015db60 0x7fcdb015dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdaf7fe640 1 -- 172.21.15.6:0/1399484946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd98004f30 msgr2=0x7fcdb00ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:31.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdaf7fe640 1 --2- 172.21.15.6:0/1399484946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd98004f30 0x7fcdb00ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdaf7fe640 1 -- 172.21.15.6:0/1399484946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb00c8b50 con 0x7fcdb00c7b10 2023-07-21T22:37:31.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdaf7fe640 1 --2- 172.21.15.6:0/1399484946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdb00c7b10 0x7fcdb00c7f60 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fcda4011890 tx=0x7fcda4011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:31.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdacff9640 1 -- 172.21.15.6:0/1399484946 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4004240 con 0x7fcdb00c7b10 2023-07-21T22:37:31.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdacff9640 1 -- 172.21.15.6:0/1399484946 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda40043a0 con 0x7fcdb00c7b10 2023-07-21T22:37:31.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdacff9640 1 -- 172.21.15.6:0/1399484946 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4003860 con 0x7fcdb00c7b10 2023-07-21T22:37:31.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdb63c5640 1 -- 172.21.15.6:0/1399484946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb00c8e30 con 0x7fcdb00c7b10 2023-07-21T22:37:31.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdb63c5640 1 -- 172.21.15.6:0/1399484946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb015d200 con 0x7fcdb00c7b10 2023-07-21T22:37:31.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdb63c5640 1 -- 172.21.15.6:0/1399484946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb00678d0 con 0x7fcdb00c7b10 2023-07-21T22:37:31.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.353+0000 7fcdacff9640 1 -- 172.21.15.6:0/1399484946 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcda40039c0 con 0x7fcdb00c7b10 2023-07-21T22:37:31.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.357+0000 7fcdacff9640 1 --2- 172.21.15.6:0/1399484946 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fcd9c0663d0 0x7fcd9c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:31.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.357+0000 7fcdacff9640 1 -- 172.21.15.6:0/1399484946 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fcda40840b0 con 0x7fcdb00c7b10 2023-07-21T22:37:31.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.357+0000 7fcdaffff640 1 --2- 172.21.15.6:0/1399484946 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fcd9c0663d0 0x7fcd9c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:31.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.357+0000 7fcdaffff640 1 --2- 172.21.15.6:0/1399484946 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fcd9c0663d0 0x7fcd9c068880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcda0006f90 tx=0x7fcda0008040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:31.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.361+0000 7fcdacff9640 1 -- 172.21.15.6:0/1399484946 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcda4051370 con 0x7fcdb00c7b10 2023-07-21T22:37:31.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.569+0000 7fcdb63c5640 1 -- 172.21.15.6:0/1399484946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fcdb015b1e0 con 0x7fcdb00c7b10 2023-07-21T22:37:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.573+0000 7fcdacff9640 1 -- 172.21.15.6:0/1399484946 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7fcda40230e0 con 0x7fcdb00c7b10 2023-07-21T22:37:31.620 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-07-21T22:37:31.620 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA== 2023-07-21T22:37:31.620 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2023-07-21T22:37:31.620 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2023-07-21T22:37:31.620 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-21T22:37:31.621 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-07-21T22:37:31.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.577+0000 7fcdb63c5640 1 -- 172.21.15.6:0/1399484946 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fcd9c0663d0 msgr2=0x7fcd9c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:31.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.577+0000 7fcdb63c5640 1 --2- 172.21.15.6:0/1399484946 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fcd9c0663d0 0x7fcd9c068880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcda0006f90 tx=0x7fcda0008040 comp rx=0 tx=0).stop 2023-07-21T22:37:31.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.577+0000 7fcdb63c5640 1 -- 172.21.15.6:0/1399484946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdb00c7b10 msgr2=0x7fcdb00c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:31.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.577+0000 7fcdb63c5640 1 --2- 172.21.15.6:0/1399484946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdb00c7b10 0x7fcdb00c7f60 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fcda4011890 tx=0x7fcda4011980 comp rx=0 tx=0).stop 2023-07-21T22:37:31.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.577+0000 7fcdb63c5640 1 -- 172.21.15.6:0/1399484946 shutdown_connections 2023-07-21T22:37:31.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.577+0000 7fcdb63c5640 1 --2- 172.21.15.6:0/1399484946 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fcd9c0663d0 0x7fcd9c068880 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.577+0000 7fcdb63c5640 1 --2- 172.21.15.6:0/1399484946 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcdb015db60 0x7fcdb015dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.577+0000 7fcdb63c5640 1 --2- 172.21.15.6:0/1399484946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdb00c7b10 0x7fcdb00c7f60 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.577+0000 7fcdb63c5640 1 --2- 172.21.15.6:0/1399484946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd98004f30 0x7fcdb00ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.577+0000 7fcdb63c5640 1 -- 172.21.15.6:0/1399484946 >> 172.21.15.6:0/1399484946 conn(0x7fcdb00b0490 msgr2=0x7fcdb01e54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.577+0000 7fcdb63c5640 1 -- 172.21.15.6:0/1399484946 shutdown_connections 2023-07-21T22:37:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.577+0000 7fcdb63c5640 1 -- 172.21.15.6:0/1399484946 wait complete. 2023-07-21T22:37:31.641 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:37:31.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.741+0000 7f468292c640 1 Processor -- start 2023-07-21T22:37:31.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.741+0000 7f468292c640 1 -- start start 2023-07-21T22:37:31.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.745+0000 7f468292c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f467c06a540 0x7f467c06a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:31.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.745+0000 7f468292c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467c0cdc80 con 0x7f467c0ce0f0 2023-07-21T22:37:31.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.745+0000 7f468292c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467c06e4c0 con 0x7f467c15f500 2023-07-21T22:37:31.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.745+0000 7f468292c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467c06af00 con 0x7f467c06a540 2023-07-21T22:37:31.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.745+0000 7f467b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f467c06a540 0x7f467c06a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:31.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.745+0000 7f4680ec9640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f467c0ce0f0 0x7f467c0ce550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36058/0 (socket says 172.21.15.6:36058) 2023-07-21T22:37:31.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.745+0000 7f4680ec9640 1 -- 172.21.15.6:0/3150386209 learned_addr learned my addr 172.21.15.6:0/3150386209 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:31.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.745+0000 7f467affd640 1 -- 172.21.15.6:0/3150386209 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036046405 0 0) 0x7f467c0cdc80 con 0x7f467c0ce0f0 2023-07-21T22:37:31.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.745+0000 7f467affd640 1 -- 172.21.15.6:0/3150386209 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4664003530 con 0x7f467c0ce0f0 2023-07-21T22:37:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.745+0000 7f467b7fe640 1 -- 172.21.15.6:0/3150386209 >> v1:172.21.15.161:6789/0 conn(0x7f467c15f500 legacy=0x7f467c06cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.745+0000 7f467b7fe640 1 -- 172.21.15.6:0/3150386209 >> v1:172.21.15.6:6789/0 conn(0x7f467c0ce0f0 legacy=0x7f467c0ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.745+0000 7f467b7fe640 1 -- 172.21.15.6:0/3150386209 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c06d940 con 0x7f467c06a540 2023-07-21T22:37:31.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f467b7fe640 1 --2- 172.21.15.6:0/3150386209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f467c06a540 0x7f467c06a9c0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f46700097c0 tx=0x7f467001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55682a98fde9f96e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:31.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f467affd640 1 -- 172.21.15.6:0/3150386209 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46700ab600 con 0x7f467c06a540 2023-07-21T22:37:31.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f467affd640 1 -- 172.21.15.6:0/3150386209 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46700a7050 con 0x7f467c06a540 2023-07-21T22:37:31.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f467affd640 1 -- 172.21.15.6:0/3150386209 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46700ab980 con 0x7f467c06a540 2023-07-21T22:37:31.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f468292c640 1 -- 172.21.15.6:0/3150386209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f467c06a540 msgr2=0x7f467c06a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:31.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f468292c640 1 --2- 172.21.15.6:0/3150386209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f467c06a540 0x7f467c06a9c0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f46700097c0 tx=0x7f467001c480 comp rx=0 tx=0).stop 2023-07-21T22:37:31.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f468292c640 1 -- 172.21.15.6:0/3150386209 shutdown_connections 2023-07-21T22:37:31.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f468292c640 1 --2- 172.21.15.6:0/3150386209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f467c06a540 0x7f467c06a9c0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f468292c640 1 -- 172.21.15.6:0/3150386209 >> 172.21.15.6:0/3150386209 conn(0x7f467c0659d0 msgr2=0x7f467c099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:31.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f468292c640 1 -- 172.21.15.6:0/3150386209 shutdown_connections 2023-07-21T22:37:31.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f468292c640 1 -- 172.21.15.6:0/3150386209 wait complete. 2023-07-21T22:37:31.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f468292c640 1 Processor -- start 2023-07-21T22:37:31.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f468292c640 1 -- start start 2023-07-21T22:37:31.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f468292c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f467c06a540 0x7f467c158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:31.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f468292c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f467c0ce0f0 0x7f467c14cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:31.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f468292c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f467c15f500 0x7f467c14d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:31.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f468292c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0c8af0 con 0x7f467c06a540 2023-07-21T22:37:31.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f468292c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0c7e70 con 0x7f467c0ce0f0 2023-07-21T22:37:31.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f468292c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0c8150 con 0x7f467c15f500 2023-07-21T22:37:31.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f467bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f467c06a540 0x7f467c158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:31.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f467bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f467c06a540 0x7f467c158f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50934/0 (socket says 172.21.15.6:50934) 2023-07-21T22:37:31.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.749+0000 7f467bfff640 1 -- 172.21.15.6:0/3055805719 learned_addr learned my addr 172.21.15.6:0/3055805719 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:31.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.753+0000 7f467bfff640 1 -- 172.21.15.6:0/3055805719 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f467c15f500 msgr2=0x7f467c14d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:31.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.753+0000 7f467bfff640 1 --2- 172.21.15.6:0/3055805719 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f467c15f500 0x7f467c14d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.753+0000 7f467bfff640 1 -- 172.21.15.6:0/3055805719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f467c0ce0f0 msgr2=0x7f467c14cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:31.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.753+0000 7f467bfff640 1 --2- 172.21.15.6:0/3055805719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f467c0ce0f0 0x7f467c14cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.753+0000 7f467bfff640 1 -- 172.21.15.6:0/3055805719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4670009420 con 0x7f467c06a540 2023-07-21T22:37:31.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.753+0000 7f467bfff640 1 --2- 172.21.15.6:0/3055805719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f467c06a540 0x7f467c158f90 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f466c00c400 tx=0x7f466c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:31.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.753+0000 7f4678ff9640 1 -- 172.21.15.6:0/3055805719 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c0052d0 con 0x7f467c06a540 2023-07-21T22:37:31.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.753+0000 7f4678ff9640 1 -- 172.21.15.6:0/3055805719 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466c005430 con 0x7f467c06a540 2023-07-21T22:37:31.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.753+0000 7f4678ff9640 1 -- 172.21.15.6:0/3055805719 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c003890 con 0x7f467c06a540 2023-07-21T22:37:31.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.753+0000 7f468292c640 1 -- 172.21.15.6:0/3055805719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467c0c8430 con 0x7f467c06a540 2023-07-21T22:37:31.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.753+0000 7f468292c640 1 -- 172.21.15.6:0/3055805719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467c1594d0 con 0x7f467c06a540 2023-07-21T22:37:31.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.753+0000 7f468292c640 1 -- 172.21.15.6:0/3055805719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467c1596c0 con 0x7f467c06a540 2023-07-21T22:37:31.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.753+0000 7f4678ff9640 1 -- 172.21.15.6:0/3055805719 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f466c0039f0 con 0x7f467c06a540 2023-07-21T22:37:31.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.753+0000 7f4678ff9640 1 --2- 172.21.15.6:0/3055805719 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f46680663a0 0x7f4668068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:31.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.753+0000 7f4678ff9640 1 -- 172.21.15.6:0/3055805719 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f466c083590 con 0x7f467c06a540 2023-07-21T22:37:31.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.757+0000 7f467b7fe640 1 --2- 172.21.15.6:0/3055805719 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f46680663a0 0x7f4668068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:31.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.757+0000 7f467b7fe640 1 --2- 172.21.15.6:0/3055805719 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f46680663a0 0x7f4668068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f46700ad000 tx=0x7f4670004740 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:31.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.757+0000 7f4678ff9640 1 -- 172.21.15.6:0/3055805719 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f467c1596c0 con 0x7f467c06a540 2023-07-21T22:37:31.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.945+0000 7f468292c640 1 -- 172.21.15.6:0/3055805719 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f467c1596c0 con 0x7f467c06a540 2023-07-21T22:37:31.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.945+0000 7f4678ff9640 1 -- 172.21.15.6:0/3055805719 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f467c1596c0 con 0x7f467c06a540 2023-07-21T22:37:31.992 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:31.992 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1099541342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1099541342},{"type":"v1","addr":"172.21.15.161:6837","nonce":1099541342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3942495258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3942495258},{"type":"v1","addr":"172.21.15.161:6836","nonce":3942495258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8211,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3306024838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3306024838},{"type":"v1","addr":"172.21.15.6:6834","nonce":3306024838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:37:21.460444+0000","modified":"2023-07-21T22:37:25.102431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8214":{"gid":8214,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2511188295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2511188295},{"type":"v1","addr":"172.21.15.6:6835","nonce":2511188295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-21T22:37:31.992 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 54 2023-07-21T22:37:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.949+0000 7f468292c640 1 -- 172.21.15.6:0/3055805719 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f46680663a0 msgr2=0x7f4668068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:31.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.949+0000 7f468292c640 1 --2- 172.21.15.6:0/3055805719 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f46680663a0 0x7f4668068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f46700ad000 tx=0x7f4670004740 comp rx=0 tx=0).stop 2023-07-21T22:37:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.949+0000 7f468292c640 1 -- 172.21.15.6:0/3055805719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f467c06a540 msgr2=0x7f467c158f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.949+0000 7f468292c640 1 --2- 172.21.15.6:0/3055805719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f467c06a540 0x7f467c158f90 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f466c00c400 tx=0x7f466c00c8c0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.949+0000 7f468292c640 1 -- 172.21.15.6:0/3055805719 shutdown_connections 2023-07-21T22:37:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.949+0000 7f468292c640 1 --2- 172.21.15.6:0/3055805719 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f46680663a0 0x7f4668068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.949+0000 7f468292c640 1 --2- 172.21.15.6:0/3055805719 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f467c15f500 0x7f467c14d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.949+0000 7f468292c640 1 --2- 172.21.15.6:0/3055805719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f467c0ce0f0 0x7f467c14cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.949+0000 7f468292c640 1 --2- 172.21.15.6:0/3055805719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f467c06a540 0x7f467c158f90 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:31.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.949+0000 7f468292c640 1 -- 172.21.15.6:0/3055805719 >> 172.21.15.6:0/3055805719 conn(0x7f467c0659d0 msgr2=0x7f467c06cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:31.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.949+0000 7f468292c640 1 -- 172.21.15.6:0/3055805719 shutdown_connections 2023-07-21T22:37:31.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:31.949+0000 7f468292c640 1 -- 172.21.15.6:0/3055805719 wait complete. 2023-07-21T22:37:32.415 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T22:37:21.460444+0000', 'modified': '2023-07-21T22:37:25.102431+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8214}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8214': {'gid': 8214, 'name': 'c', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/2511188295', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 2511188295}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 2511188295}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T22:37:32.416 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T22:37:32.416 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-21T22:37:32.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.521+0000 7f3299bd2640 1 Processor -- start 2023-07-21T22:37:32.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.521+0000 7f3299bd2640 1 -- start start 2023-07-21T22:37:32.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.521+0000 7f3299bd2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3294159850 0x7f329415db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.521+0000 7f3299bd2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329415a660 con 0x7f32940cd7e0 2023-07-21T22:37:32.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.521+0000 7f3299bd2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329415a940 con 0x7f32940af8b0 2023-07-21T22:37:32.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.521+0000 7f3299bd2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329415ac20 con 0x7f3294159850 2023-07-21T22:37:32.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.521+0000 7f3293fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f32940cd7e0 0x7f3294159c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36072/0 (socket says 172.21.15.6:36072) 2023-07-21T22:37:32.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.521+0000 7f3293fff640 1 -- 172.21.15.6:0/3635555283 learned_addr learned my addr 172.21.15.6:0/3635555283 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:32.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.521+0000 7f3298bd0640 1 --2- 172.21.15.6:0/3635555283 >> v2:172.21.15.6:3300/0 conn(0x7f3294159850 0x7f329415db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.521+0000 7f32937fe640 1 -- 172.21.15.6:0/3635555283 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561958075 0 0) 0x7f329415a660 con 0x7f32940cd7e0 2023-07-21T22:37:32.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.521+0000 7f32937fe640 1 -- 172.21.15.6:0/3635555283 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3284003530 con 0x7f32940cd7e0 2023-07-21T22:37:32.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.521+0000 7f3298bd0640 1 -- 172.21.15.6:0/3635555283 >> v1:172.21.15.161:6789/0 conn(0x7f32940af8b0 legacy=0x7f329406c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.521+0000 7f3298bd0640 1 -- 172.21.15.6:0/3635555283 >> v1:172.21.15.6:6789/0 conn(0x7f32940cd7e0 legacy=0x7f3294159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.521+0000 7f3298bd0640 1 -- 172.21.15.6:0/3635555283 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329415d380 con 0x7f3294159850 2023-07-21T22:37:32.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.525+0000 7f3298bd0640 1 --2- 172.21.15.6:0/3635555283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3294159850 0x7f329415db80 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f32880097c0 tx=0x7f328801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494bc66cf672744a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:32.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.525+0000 7f32937fe640 1 -- 172.21.15.6:0/3635555283 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32880ab670 con 0x7f3294159850 2023-07-21T22:37:32.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.525+0000 7f32937fe640 1 -- 172.21.15.6:0/3635555283 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32880ab7d0 con 0x7f3294159850 2023-07-21T22:37:32.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.525+0000 7f32937fe640 1 -- 172.21.15.6:0/3635555283 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32880abb60 con 0x7f3294159850 2023-07-21T22:37:32.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.525+0000 7f3299bd2640 1 -- 172.21.15.6:0/3635555283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3294159850 msgr2=0x7f329415db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.525+0000 7f3299bd2640 1 --2- 172.21.15.6:0/3635555283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3294159850 0x7f329415db80 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f32880097c0 tx=0x7f328801c450 comp rx=0 tx=0).stop 2023-07-21T22:37:32.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.525+0000 7f3299bd2640 1 -- 172.21.15.6:0/3635555283 shutdown_connections 2023-07-21T22:37:32.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.525+0000 7f3299bd2640 1 --2- 172.21.15.6:0/3635555283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3294159850 0x7f329415db80 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.525+0000 7f3299bd2640 1 -- 172.21.15.6:0/3635555283 >> 172.21.15.6:0/3635555283 conn(0x7f32940ca8b0 msgr2=0x7f32940cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:32.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.525+0000 7f3299bd2640 1 -- 172.21.15.6:0/3635555283 shutdown_connections 2023-07-21T22:37:32.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.525+0000 7f3299bd2640 1 -- 172.21.15.6:0/3635555283 wait complete. 2023-07-21T22:37:32.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3299bd2640 1 Processor -- start 2023-07-21T22:37:32.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3299bd2640 1 -- start start 2023-07-21T22:37:32.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3299bd2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32940af8b0 0x7f32940c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3299bd2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32940cd7e0 0x7f329414db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3299bd2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3294159850 0x7f3294152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3299bd2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3294153c80 con 0x7f32940cd7e0 2023-07-21T22:37:32.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3299bd2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329414e060 con 0x7f32940af8b0 2023-07-21T22:37:32.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3299bd2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32940ca140 con 0x7f3294159850 2023-07-21T22:37:32.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3293fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32940cd7e0 0x7f329414db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3293fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32940cd7e0 0x7f329414db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50954/0 (socket says 172.21.15.6:50954) 2023-07-21T22:37:32.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3293fff640 1 -- 172.21.15.6:0/830053197 learned_addr learned my addr 172.21.15.6:0/830053197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:32.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3298bd0640 1 --2- 172.21.15.6:0/830053197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32940af8b0 0x7f32940c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f32993d1640 1 --2- 172.21.15.6:0/830053197 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3294159850 0x7f3294152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3293fff640 1 -- 172.21.15.6:0/830053197 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3294159850 msgr2=0x7f3294152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3293fff640 1 --2- 172.21.15.6:0/830053197 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3294159850 0x7f3294152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3293fff640 1 -- 172.21.15.6:0/830053197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32940af8b0 msgr2=0x7f32940c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3293fff640 1 --2- 172.21.15.6:0/830053197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32940af8b0 0x7f32940c9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3293fff640 1 -- 172.21.15.6:0/830053197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3288009420 con 0x7f32940cd7e0 2023-07-21T22:37:32.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3298bd0640 1 --2- 172.21.15.6:0/830053197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32940af8b0 0x7f32940c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:32.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3293fff640 1 --2- 172.21.15.6:0/830053197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32940cd7e0 0x7f329414db20 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f328000c4d0 tx=0x7f328000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:32.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f32917fa640 1 -- 172.21.15.6:0/830053197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3280005cf0 con 0x7f32940cd7e0 2023-07-21T22:37:32.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f32917fa640 1 -- 172.21.15.6:0/830053197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3280005e50 con 0x7f32940cd7e0 2023-07-21T22:37:32.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f32917fa640 1 -- 172.21.15.6:0/830053197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3280007270 con 0x7f32940cd7e0 2023-07-21T22:37:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3299bd2640 1 -- 172.21.15.6:0/830053197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3294153eb0 con 0x7f32940cd7e0 2023-07-21T22:37:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.529+0000 7f3299bd2640 1 -- 172.21.15.6:0/830053197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3294154150 con 0x7f32940cd7e0 2023-07-21T22:37:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.533+0000 7f32917fa640 1 -- 172.21.15.6:0/830053197 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f32800073d0 con 0x7f32940cd7e0 2023-07-21T22:37:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.533+0000 7f32917fa640 1 --2- 172.21.15.6:0/830053197 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f32780663a0 0x7f3278068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.533+0000 7f32917fa640 1 -- 172.21.15.6:0/830053197 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f32800834c0 con 0x7f32940cd7e0 2023-07-21T22:37:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.533+0000 7f3298bd0640 1 --2- 172.21.15.6:0/830053197 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f32780663a0 0x7f3278068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.533+0000 7f329e196000 1 Processor -- start 2023-07-21T22:37:32.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f329e196000 1 -- start start 2023-07-21T22:37:32.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f3298bd0640 1 --2- 172.21.15.6:0/830053197 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f32780663a0 0x7f3278068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f32880af000 tx=0x7f32880a7000 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:32.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f329e196000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce84972f00 0x55ce849732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f329e196000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84973810 0x55ce84929370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f329e196000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce849298b0 0x55ce84929c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f329e196000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce847f0880 con 0x55ce84973810 2023-07-21T22:37:32.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f329e196000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce8472a840 con 0x55ce849298b0 2023-07-21T22:37:32.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f329e196000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce8477e2e0 con 0x55ce84972f00 2023-07-21T22:37:32.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f3293fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84973810 0x55ce84929370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f3293fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84973810 0x55ce84929370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50964/0 (socket says 172.21.15.6:50964) 2023-07-21T22:37:32.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f3293fff640 1 -- 172.21.15.6:0/641805258 learned_addr learned my addr 172.21.15.6:0/641805258 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:32.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f3298bd0640 1 --2- 172.21.15.6:0/641805258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce84972f00 0x55ce849732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f32993d1640 1 --2- 172.21.15.6:0/641805258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce849298b0 0x55ce84929c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f3293fff640 1 -- 172.21.15.6:0/641805258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce84972f00 msgr2=0x55ce849732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:32.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f3293fff640 1 --2- 172.21.15.6:0/641805258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce84972f00 0x55ce849732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f3293fff640 1 -- 172.21.15.6:0/641805258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce849298b0 msgr2=0x55ce84929c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:32.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f3293fff640 1 --2- 172.21.15.6:0/641805258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce849298b0 0x55ce84929c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f3293fff640 1 -- 172.21.15.6:0/641805258 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce84473890 con 0x55ce84973810 2023-07-21T22:37:32.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f3293fff640 1 --2- 172.21.15.6:0/641805258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84973810 0x55ce84929370 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f328005c240 tx=0x7f328005c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29145ce5cb6cf846 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:32.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f327e7fc640 1 -- 172.21.15.6:0/641805258 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800817b0 con 0x55ce84973810 2023-07-21T22:37:32.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f327e7fc640 1 -- 172.21.15.6:0/641805258 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3280081910 con 0x55ce84973810 2023-07-21T22:37:32.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f327e7fc640 1 -- 172.21.15.6:0/641805258 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800830d0 con 0x55ce84973810 2023-07-21T22:37:32.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f329e196000 1 -- 172.21.15.6:0/641805258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84973810 msgr2=0x55ce84929370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f329e196000 1 --2- 172.21.15.6:0/641805258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84973810 0x55ce84929370 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f328005c240 tx=0x7f328005c8b0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f329e196000 1 -- 172.21.15.6:0/641805258 shutdown_connections 2023-07-21T22:37:32.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f329e196000 1 --2- 172.21.15.6:0/641805258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce849298b0 0x55ce84929c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f329e196000 1 --2- 172.21.15.6:0/641805258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84973810 0x55ce84929370 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f329e196000 1 --2- 172.21.15.6:0/641805258 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce84972f00 0x55ce849732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f329e196000 1 -- 172.21.15.6:0/641805258 >> 172.21.15.6:0/641805258 conn(0x55ce8492fa10 msgr2=0x55ce84927c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:32.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f329e196000 1 -- 172.21.15.6:0/641805258 shutdown_connections 2023-07-21T22:37:32.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f329e196000 1 -- 172.21.15.6:0/641805258 wait complete. 2023-07-21T22:37:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f329e196000 1 -- start start 2023-07-21T22:37:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.537+0000 7f329e196000 1 Processor -- start 2023-07-21T22:37:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f329e196000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce849298b0 0x55ce84979e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f329e196000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84972f00 0x55ce8497a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f329e196000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce84973810 0x55ce849344f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f329e196000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce84777380 con 0x55ce84972f00 2023-07-21T22:37:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f329e196000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce84733ae0 con 0x55ce84973810 2023-07-21T22:37:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f329e196000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce84733780 con 0x55ce849298b0 2023-07-21T22:37:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f329e196000 10 client.0 _ll_register_callbacks cb 0x55ce84915240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:37:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f3293fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84972f00 0x55ce8497a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f3293fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84972f00 0x55ce8497a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50966/0 (socket says 172.21.15.6:50966) 2023-07-21T22:37:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f3293fff640 1 -- 172.21.15.6:0/4251007915 learned_addr learned my addr 172.21.15.6:0/4251007915 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f32993d1640 1 --2- 172.21.15.6:0/4251007915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce84973810 0x55ce849344f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f3298bd0640 1 --2- 172.21.15.6:0/4251007915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce849298b0 0x55ce84979e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f3293fff640 1 -- 172.21.15.6:0/4251007915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce849298b0 msgr2=0x55ce84979e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f3293fff640 1 --2- 172.21.15.6:0/4251007915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce849298b0 0x55ce84979e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f3293fff640 1 -- 172.21.15.6:0/4251007915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce84973810 msgr2=0x55ce849344f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f3293fff640 1 --2- 172.21.15.6:0/4251007915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce84973810 0x55ce849344f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f3293fff640 1 -- 172.21.15.6:0/4251007915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3294154150 con 0x55ce84972f00 2023-07-21T22:37:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f3293fff640 1 --2- 172.21.15.6:0/4251007915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84972f00 0x55ce8497a390 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f3280014040 tx=0x7f3280007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6a8490eea0e2b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f32737fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:37:32.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f32737fe640 1 -- 172.21.15.6:0/4251007915 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328005c2e0 con 0x55ce84972f00 2023-07-21T22:37:32.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f32737fe640 1 -- 172.21.15.6:0/4251007915 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f3280059e80 con 0x55ce84972f00 2023-07-21T22:37:32.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f329e196000 1 -- 172.21.15.6:0/4251007915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce8473ea20 con 0x55ce84972f00 2023-07-21T22:37:32.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f32737fe640 1 -- 172.21.15.6:0/4251007915 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f328005c440 con 0x55ce84972f00 2023-07-21T22:37:32.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f329e196000 10 client.8391 fetch_fsmap learned FSMap version 54 2023-07-21T22:37:32.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f329e196000 1 -- 172.21.15.6:0/4251007915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x55ce8473bd10 con 0x55ce84972f00 2023-07-21T22:37:32.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f32737fe640 1 -- 172.21.15.6:0/4251007915 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328006f030 con 0x55ce84972f00 2023-07-21T22:37:32.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f32737fe640 1 -- 172.21.15.6:0/4251007915 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 54) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3280081290 con 0x55ce84972f00 2023-07-21T22:37:32.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f329e196000 10 client.8391 fetch_fsmap finished waiting for FSMap version 54 2023-07-21T22:37:32.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f329e196000 10 client.8391 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-21T22:37:32.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f329e196000 20 client.8391 populate_metadata read hostname 'smithi006' 2023-07-21T22:37:32.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f329e196000 1 --2- 172.21.15.6:0/4251007915 >> [v2:172.21.15.6:6833/2511188295,v1:172.21.15.6:6835/2511188295] conn(0x55ce84934f00 0x55ce849352d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f329e196000 4 client.8391 mds_command: new command op to 8214 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:37:32.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f329e196000 1 -- 172.21.15.6:0/4251007915 --> [v2:172.21.15.6:6833/2511188295,v1:172.21.15.6:6835/2511188295] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ce847a5ec0 con 0x55ce84934f00 2023-07-21T22:37:32.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f3298bd0640 1 --2- 172.21.15.6:0/4251007915 >> [v2:172.21.15.6:6833/2511188295,v1:172.21.15.6:6835/2511188295] conn(0x55ce84934f00 0x55ce849352d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f3298bd0640 1 --2- 172.21.15.6:0/4251007915 >> [v2:172.21.15.6:6833/2511188295,v1:172.21.15.6:6835/2511188295] conn(0x55ce84934f00 0x55ce849352d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af6a7a45b15ba9b6 server_cookie=2d0cab7a0169b0c6 in_seq=0 out_seq=0 2023-07-21T22:37:32.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.541+0000 7f32737fe640 10 client.8391 ms_handle_connect on v2:172.21.15.6:6833/2511188295 2023-07-21T22:37:32.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.545+0000 7f32737fe640 1 -- 172.21.15.6:0/4251007915 <== mds.0 v2:172.21.15.6:6833/2511188295 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ce847a5ec0 con 0x55ce84934f00 2023-07-21T22:37:32.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.545+0000 7f32737fe640 10 client.8391 handle_command_reply: tid=0 2023-07-21T22:37:32.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.545+0000 7f329e196000 1 client.8391 shutdown 2023-07-21T22:37:32.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.545+0000 7f329e196000 1 -- 172.21.15.6:0/4251007915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84972f00 msgr2=0x55ce8497a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.545+0000 7f329e196000 1 --2- 172.21.15.6:0/4251007915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84972f00 0x55ce8497a390 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f3280014040 tx=0x7f3280007f50 comp rx=0 tx=0).stop 2023-07-21T22:37:32.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.545+0000 7f329e196000 1 -- 172.21.15.6:0/4251007915 shutdown_connections 2023-07-21T22:37:32.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.545+0000 7f329e196000 1 --2- 172.21.15.6:0/4251007915 >> [v2:172.21.15.6:6833/2511188295,v1:172.21.15.6:6835/2511188295] conn(0x55ce84934f00 0x55ce849352d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.545+0000 7f329e196000 1 --2- 172.21.15.6:0/4251007915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce84973810 0x55ce849344f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.545+0000 7f329e196000 1 --2- 172.21.15.6:0/4251007915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84972f00 0x55ce8497a390 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.545+0000 7f32737fe640 0 client.8391 ms_handle_reset on v2:172.21.15.6:6833/2511188295 2023-07-21T22:37:32.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.545+0000 7f329e196000 1 --2- 172.21.15.6:0/4251007915 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce849298b0 0x55ce84979e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.545+0000 7f329e196000 1 -- 172.21.15.6:0/4251007915 >> 172.21.15.6:0/4251007915 conn(0x55ce8492fa10 msgr2=0x55ce84928350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:32.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.545+0000 7f329e196000 1 -- 172.21.15.6:0/4251007915 shutdown_connections 2023-07-21T22:37:32.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.545+0000 7f329e196000 1 -- 172.21.15.6:0/4251007915 wait complete. 2023-07-21T22:37:32.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.545+0000 7f329e196000 20 client.8391 trim_cache size 0 max 16384 2023-07-21T22:37:32.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f329e196000 1 Processor -- start 2023-07-21T22:37:32.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f329e196000 1 -- start start 2023-07-21T22:37:32.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f329e196000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce849298b0 0x55ce849cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f329e196000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84972f00 0x55ce849ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f329e196000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce84973810 0x55ce849cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f329e196000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce84434940 con 0x55ce84972f00 2023-07-21T22:37:32.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f329e196000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce84774b90 con 0x55ce84973810 2023-07-21T22:37:32.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f329e196000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce84774780 con 0x55ce849298b0 2023-07-21T22:37:32.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f3293fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84972f00 0x55ce849ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f3293fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84972f00 0x55ce849ccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50970/0 (socket says 172.21.15.6:50970) 2023-07-21T22:37:32.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f3298bd0640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce849298b0 0x55ce849cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f3293fff640 1 -- 172.21.15.6:0/2100183534 learned_addr learned my addr 172.21.15.6:0/2100183534 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:32.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f32993d1640 1 --2- 172.21.15.6:0/2100183534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce84973810 0x55ce849cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f3293fff640 1 -- 172.21.15.6:0/2100183534 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce849298b0 msgr2=0x55ce849cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:32.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f3293fff640 1 --2- 172.21.15.6:0/2100183534 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce849298b0 0x55ce849cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f3293fff640 1 -- 172.21.15.6:0/2100183534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce84973810 msgr2=0x55ce849cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:32.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f3293fff640 1 --2- 172.21.15.6:0/2100183534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce84973810 0x55ce849cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f3293fff640 1 -- 172.21.15.6:0/2100183534 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce84721fa0 con 0x55ce84972f00 2023-07-21T22:37:32.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f3293fff640 1 --2- 172.21.15.6:0/2100183534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84972f00 0x55ce849ccbf0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f3280054460 tx=0x7f328007d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab853d8142ff876a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:32.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f327effd640 1 -- 172.21.15.6:0/2100183534 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800526d0 con 0x55ce84972f00 2023-07-21T22:37:32.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f327effd640 1 -- 172.21.15.6:0/2100183534 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328006f070 con 0x55ce84972f00 2023-07-21T22:37:32.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f327effd640 1 -- 172.21.15.6:0/2100183534 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3280050810 con 0x55ce84972f00 2023-07-21T22:37:32.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f329e196000 1 -- 172.21.15.6:0/2100183534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84972f00 msgr2=0x55ce849ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f329e196000 1 --2- 172.21.15.6:0/2100183534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84972f00 0x55ce849ccbf0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f3280054460 tx=0x7f328007d040 comp rx=0 tx=0).stop 2023-07-21T22:37:32.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f329e196000 1 -- 172.21.15.6:0/2100183534 shutdown_connections 2023-07-21T22:37:32.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f329e196000 1 --2- 172.21.15.6:0/2100183534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce84973810 0x55ce849cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f329e196000 1 --2- 172.21.15.6:0/2100183534 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce84972f00 0x55ce849ccbf0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f329e196000 1 --2- 172.21.15.6:0/2100183534 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce849298b0 0x55ce849cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f329e196000 1 -- 172.21.15.6:0/2100183534 >> 172.21.15.6:0/2100183534 conn(0x55ce8492fa10 msgr2=0x55ce8492ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:32.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f329e196000 1 -- 172.21.15.6:0/2100183534 shutdown_connections 2023-07-21T22:37:32.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f329e196000 1 -- 172.21.15.6:0/2100183534 wait complete. 2023-07-21T22:37:32.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.561+0000 7f329e196000 1 -- start start 2023-07-21T22:37:32.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f329e196000 1 Processor -- start 2023-07-21T22:37:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f329e196000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce849298b0 0x55ce84977350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f329e196000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce84972f00 0x55ce84977890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f329e196000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce84973810 0x55ce84977dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f329e196000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce84771680 con 0x55ce849298b0 2023-07-21T22:37:32.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f329e196000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce84746320 con 0x55ce84973810 2023-07-21T22:37:32.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f329e196000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ce84779ee0 con 0x55ce84972f00 2023-07-21T22:37:32.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f329e196000 10 client.0 _ll_register_callbacks cb 0x55ce848f5430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:37:32.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f3298bd0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce849298b0 0x55ce84977350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f3298bd0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce849298b0 0x55ce84977350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50974/0 (socket says 172.21.15.6:50974) 2023-07-21T22:37:32.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f3298bd0640 1 -- 172.21.15.6:0/441404898 learned_addr learned my addr 172.21.15.6:0/441404898 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:32.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f3293fff640 1 --2- 172.21.15.6:0/441404898 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce84972f00 0x55ce84977890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f32993d1640 1 --2- 172.21.15.6:0/441404898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce84973810 0x55ce84977dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f3298bd0640 1 -- 172.21.15.6:0/441404898 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce84972f00 msgr2=0x55ce84977890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:32.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f3298bd0640 1 --2- 172.21.15.6:0/441404898 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce84972f00 0x55ce84977890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f3298bd0640 1 -- 172.21.15.6:0/441404898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce84973810 msgr2=0x55ce84977dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:32.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f3298bd0640 1 --2- 172.21.15.6:0/441404898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce84973810 0x55ce84977dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f3298bd0640 1 -- 172.21.15.6:0/441404898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce8473bd10 con 0x55ce849298b0 2023-07-21T22:37:32.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f3293fff640 1 --2- 172.21.15.6:0/441404898 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce84972f00 0x55ce84977890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f32993d1640 1 --2- 172.21.15.6:0/441404898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce84973810 0x55ce84977dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f3298bd0640 1 --2- 172.21.15.6:0/441404898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce849298b0 0x55ce84977350 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f3288019060 tx=0x7f328801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a24e87831bbc37 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f32737fe640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:37:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f32737fe640 1 -- 172.21.15.6:0/441404898 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32880cfb60 con 0x55ce849298b0 2023-07-21T22:37:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f32737fe640 1 -- 172.21.15.6:0/441404898 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f32880cfcc0 con 0x55ce849298b0 2023-07-21T22:37:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f329e196000 1 -- 172.21.15.6:0/441404898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce84775cd0 con 0x55ce849298b0 2023-07-21T22:37:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f32737fe640 1 -- 172.21.15.6:0/441404898 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32880cfe80 con 0x55ce849298b0 2023-07-21T22:37:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f329e196000 10 client.8397 fetch_fsmap learned FSMap version 54 2023-07-21T22:37:32.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f329e196000 1 -- 172.21.15.6:0/441404898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x55ce84473cc0 con 0x55ce849298b0 2023-07-21T22:37:32.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f32737fe640 1 -- 172.21.15.6:0/441404898 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ce84775cd0 con 0x55ce849298b0 2023-07-21T22:37:32.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f32737fe640 1 -- 172.21.15.6:0/441404898 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 54) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f32880cf050 con 0x55ce849298b0 2023-07-21T22:37:32.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f329e196000 10 client.8397 fetch_fsmap finished waiting for FSMap version 54 2023-07-21T22:37:32.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f329e196000 10 client.8397 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-21T22:37:32.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f329e196000 20 client.8397 populate_metadata read hostname 'smithi006' 2023-07-21T22:37:32.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f329e196000 1 --2- 172.21.15.6:0/441404898 >> [v2:172.21.15.6:6833/2511188295,v1:172.21.15.6:6835/2511188295] conn(0x55ce84978310 0x55ce849786e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f329e196000 4 client.8397 mds_command: new command op to 8214 tid=0[{"prefix": "status"}] 2023-07-21T22:37:32.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f329e196000 1 -- 172.21.15.6:0/441404898 --> [v2:172.21.15.6:6833/2511188295,v1:172.21.15.6:6835/2511188295] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ce84770360 con 0x55ce84978310 2023-07-21T22:37:32.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f3293fff640 1 --2- 172.21.15.6:0/441404898 >> [v2:172.21.15.6:6833/2511188295,v1:172.21.15.6:6835/2511188295] conn(0x55ce84978310 0x55ce849786e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f3293fff640 1 --2- 172.21.15.6:0/441404898 >> [v2:172.21.15.6:6833/2511188295,v1:172.21.15.6:6835/2511188295] conn(0x55ce84978310 0x55ce849786e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e79b81ef8686d0e server_cookie=49eb24cfb1d024e6 in_seq=0 out_seq=0 2023-07-21T22:37:32.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f32737fe640 10 client.8397 ms_handle_connect on v2:172.21.15.6:6833/2511188295 2023-07-21T22:37:32.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f32737fe640 1 -- 172.21.15.6:0/441404898 <== mds.0 v2:172.21.15.6:6833/2511188295 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55ce84770360 con 0x55ce84978310 2023-07-21T22:37:32.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f32737fe640 10 client.8397 handle_command_reply: tid=0 2023-07-21T22:37:32.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.565+0000 7f329e196000 1 client.8397 shutdown 2023-07-21T22:37:32.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f329e196000 1 -- 172.21.15.6:0/441404898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce849298b0 msgr2=0x55ce84977350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f329e196000 1 --2- 172.21.15.6:0/441404898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce849298b0 0x55ce84977350 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f3288019060 tx=0x7f328801ac90 comp rx=0 tx=0).stop 2023-07-21T22:37:32.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f329e196000 1 -- 172.21.15.6:0/441404898 shutdown_connections 2023-07-21T22:37:32.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f329e196000 1 --2- 172.21.15.6:0/441404898 >> [v2:172.21.15.6:6833/2511188295,v1:172.21.15.6:6835/2511188295] conn(0x55ce84978310 0x55ce849786e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f329e196000 1 --2- 172.21.15.6:0/441404898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ce84973810 0x55ce84977dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f329e196000 1 --2- 172.21.15.6:0/441404898 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55ce84972f00 0x55ce84977890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f329e196000 1 --2- 172.21.15.6:0/441404898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce849298b0 0x55ce84977350 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f329e196000 1 -- 172.21.15.6:0/441404898 >> 172.21.15.6:0/441404898 conn(0x55ce8492fa10 msgr2=0x55ce849714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:32.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f32737fe640 0 client.8397 ms_handle_reset on v2:172.21.15.6:6833/2511188295 2023-07-21T22:37:32.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f329e196000 1 -- 172.21.15.6:0/441404898 shutdown_connections 2023-07-21T22:37:32.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f329e196000 1 -- 172.21.15.6:0/441404898 wait complete. 2023-07-21T22:37:32.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f329e196000 20 client.8397 trim_cache size 0 max 16384 2023-07-21T22:37:32.622 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:37:32.622 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "f3073df4-6cd1-4503-bd2e-d3e98fa18bdf", 2023-07-21T22:37:32.622 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-07-21T22:37:32.622 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 8214, 2023-07-21T22:37:32.623 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-07-21T22:37:32.623 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-07-21T22:37:32.623 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-07-21T22:37:32.623 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.477816108000001, 2023-07-21T22:37:32.623 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 54, 2023-07-21T22:37:32.623 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 128, 2023-07-21T22:37:32.623 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 128, 2023-07-21T22:37:32.623 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 16.414460997999999 2023-07-21T22:37:32.624 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:37:32.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f3299bd2640 1 -- 172.21.15.6:0/830053197 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f32780663a0 msgr2=0x7f3278068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f3299bd2640 1 --2- 172.21.15.6:0/830053197 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f32780663a0 0x7f3278068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f32880af000 tx=0x7f32880a7000 comp rx=0 tx=0).stop 2023-07-21T22:37:32.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f3299bd2640 1 -- 172.21.15.6:0/830053197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32940cd7e0 msgr2=0x7f329414db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f3299bd2640 1 --2- 172.21.15.6:0/830053197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32940cd7e0 0x7f329414db20 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f328000c4d0 tx=0x7f328000c990 comp rx=0 tx=0).stop 2023-07-21T22:37:32.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f3299bd2640 1 -- 172.21.15.6:0/830053197 shutdown_connections 2023-07-21T22:37:32.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f3299bd2640 1 --2- 172.21.15.6:0/830053197 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f32780663a0 0x7f3278068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f3299bd2640 1 --2- 172.21.15.6:0/830053197 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3294159850 0x7f3294152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f3299bd2640 1 --2- 172.21.15.6:0/830053197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32940cd7e0 0x7f329414db20 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f3299bd2640 1 --2- 172.21.15.6:0/830053197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32940af8b0 0x7f32940c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f3299bd2640 1 -- 172.21.15.6:0/830053197 >> 172.21.15.6:0/830053197 conn(0x7f32940ca8b0 msgr2=0x7f3294157bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:32.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f3299bd2640 1 -- 172.21.15.6:0/830053197 shutdown_connections 2023-07-21T22:37:32.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.569+0000 7f3299bd2640 1 -- 172.21.15.6:0/830053197 wait complete. 2023-07-21T22:37:32.634 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:37:32.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.733+0000 7f827b4ec640 1 Processor -- start 2023-07-21T22:37:32.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.733+0000 7f827b4ec640 1 -- start start 2023-07-21T22:37:32.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.737+0000 7f827b4ec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f827406b1e0 0x7f82740c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.737+0000 7f827b4ec640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f82740c21f0 0x7f82740cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.737+0000 7f827b4ec640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82740cac70 con 0x7f8274070b70 2023-07-21T22:37:32.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.737+0000 7f827b4ec640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82740ca060 con 0x7f82740c21f0 2023-07-21T22:37:32.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.737+0000 7f827b4ec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82740ca340 con 0x7f827406b1e0 2023-07-21T22:37:32.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.737+0000 7f8279288640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8274070b70 0x7f8274070f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36086/0 (socket says 172.21.15.6:36086) 2023-07-21T22:37:32.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.737+0000 7f8279288640 1 -- 172.21.15.6:0/2298016069 learned_addr learned my addr 172.21.15.6:0/2298016069 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:32.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.737+0000 7f8279a89640 1 --2- 172.21.15.6:0/2298016069 >> v2:172.21.15.6:3300/0 conn(0x7f82740c21f0 0x7f82740cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.737+0000 7f8278a87640 1 --2- 172.21.15.6:0/2298016069 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f827406b1e0 0x7f82740c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.737+0000 7f8279a89640 1 -- 172.21.15.6:0/2298016069 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f827406b1e0 msgr2=0x7f82740c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:32.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.737+0000 7f8279a89640 1 --2- 172.21.15.6:0/2298016069 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f827406b1e0 0x7f82740c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.737+0000 7f8279a89640 1 -- 172.21.15.6:0/2298016069 >> v1:172.21.15.6:6789/0 conn(0x7f8274070b70 legacy=0x7f8274070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.737+0000 7f826bfff640 1 -- 172.21.15.6:0/2298016069 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641202568 0 0) 0x7f82740cac70 con 0x7f8274070b70 2023-07-21T22:37:32.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.737+0000 7f8279a89640 1 -- 172.21.15.6:0/2298016069 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82740ca620 con 0x7f82740c21f0 2023-07-21T22:37:32.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.737+0000 7f8279a89640 1 --2- 172.21.15.6:0/2298016069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82740c21f0 0x7f82740cb100 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f826c009d90 tx=0x7f826c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23da756b273e674 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:32.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.737+0000 7f826bfff640 1 -- 172.21.15.6:0/2298016069 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c0a5970 con 0x7f82740c21f0 2023-07-21T22:37:32.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.737+0000 7f826bfff640 1 -- 172.21.15.6:0/2298016069 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c0a5ad0 con 0x7f82740c21f0 2023-07-21T22:37:32.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.737+0000 7f826bfff640 1 -- 172.21.15.6:0/2298016069 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c0a5e60 con 0x7f82740c21f0 2023-07-21T22:37:32.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.741+0000 7f827b4ec640 1 -- 172.21.15.6:0/2298016069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82740c21f0 msgr2=0x7f82740cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.741+0000 7f827b4ec640 1 --2- 172.21.15.6:0/2298016069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82740c21f0 0x7f82740cb100 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f826c009d90 tx=0x7f826c01c890 comp rx=0 tx=0).stop 2023-07-21T22:37:32.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.741+0000 7f827b4ec640 1 -- 172.21.15.6:0/2298016069 shutdown_connections 2023-07-21T22:37:32.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.741+0000 7f827b4ec640 1 --2- 172.21.15.6:0/2298016069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82740c21f0 0x7f82740cb100 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.741+0000 7f827b4ec640 1 --2- 172.21.15.6:0/2298016069 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f827406b1e0 0x7f82740c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.741+0000 7f827b4ec640 1 -- 172.21.15.6:0/2298016069 >> 172.21.15.6:0/2298016069 conn(0x7f82740afcf0 msgr2=0x7f82740b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:32.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.741+0000 7f827b4ec640 1 -- 172.21.15.6:0/2298016069 shutdown_connections 2023-07-21T22:37:32.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.741+0000 7f827b4ec640 1 -- 172.21.15.6:0/2298016069 wait complete. 2023-07-21T22:37:32.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.741+0000 7f827b4ec640 1 Processor -- start 2023-07-21T22:37:32.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.741+0000 7f827b4ec640 1 -- start start 2023-07-21T22:37:32.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.741+0000 7f827b4ec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f827406b1e0 0x7f8274151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.741+0000 7f827b4ec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8274070b70 0x7f82740aa070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.741+0000 7f827b4ec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82740c21f0 0x7f8274155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.741+0000 7f827b4ec640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82740ab3a0 con 0x7f827406b1e0 2023-07-21T22:37:32.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.741+0000 7f827b4ec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8274152460 con 0x7f8274070b70 2023-07-21T22:37:32.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.741+0000 7f827b4ec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82740ab640 con 0x7f82740c21f0 2023-07-21T22:37:32.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.741+0000 7f8279288640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f827406b1e0 0x7f8274151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.741+0000 7f8279288640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f827406b1e0 0x7f8274151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50980/0 (socket says 172.21.15.6:50980) 2023-07-21T22:37:32.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.741+0000 7f8279288640 1 -- 172.21.15.6:0/2011916126 learned_addr learned my addr 172.21.15.6:0/2011916126 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:32.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.745+0000 7f8279a89640 1 --2- 172.21.15.6:0/2011916126 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82740c21f0 0x7f8274155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.745+0000 7f8279288640 1 -- 172.21.15.6:0/2011916126 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82740c21f0 msgr2=0x7f8274155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.745+0000 7f8278a87640 1 --2- 172.21.15.6:0/2011916126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8274070b70 0x7f82740aa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.745+0000 7f8279288640 1 --2- 172.21.15.6:0/2011916126 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82740c21f0 0x7f8274155c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.745+0000 7f8279288640 1 -- 172.21.15.6:0/2011916126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8274070b70 msgr2=0x7f82740aa070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.745+0000 7f8279288640 1 --2- 172.21.15.6:0/2011916126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8274070b70 0x7f82740aa070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.745+0000 7f8279288640 1 -- 172.21.15.6:0/2011916126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c009a70 con 0x7f827406b1e0 2023-07-21T22:37:32.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.745+0000 7f8279a89640 1 --2- 172.21.15.6:0/2011916126 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82740c21f0 0x7f8274155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:37:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.745+0000 7f8278a87640 1 --2- 172.21.15.6:0/2011916126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8274070b70 0x7f82740aa070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:37:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.745+0000 7f8279288640 1 --2- 172.21.15.6:0/2011916126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f827406b1e0 0x7f8274151f20 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f82700011f0 tx=0x7f827000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.745+0000 7f8269ffb640 1 -- 172.21.15.6:0/2011916126 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82700074e0 con 0x7f827406b1e0 2023-07-21T22:37:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.745+0000 7f8269ffb640 1 -- 172.21.15.6:0/2011916126 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8270007640 con 0x7f827406b1e0 2023-07-21T22:37:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.745+0000 7f8269ffb640 1 -- 172.21.15.6:0/2011916126 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270004a10 con 0x7f827406b1e0 2023-07-21T22:37:32.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.745+0000 7f827b4ec640 1 -- 172.21.15.6:0/2011916126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82740ab920 con 0x7f827406b1e0 2023-07-21T22:37:32.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.745+0000 7f827b4ec640 1 -- 172.21.15.6:0/2011916126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82740abee0 con 0x7f827406b1e0 2023-07-21T22:37:32.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.745+0000 7f827b4ec640 1 -- 172.21.15.6:0/2011916126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82740ac100 con 0x7f827406b1e0 2023-07-21T22:37:32.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.745+0000 7f8269ffb640 1 -- 172.21.15.6:0/2011916126 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8270004b70 con 0x7f827406b1e0 2023-07-21T22:37:32.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.749+0000 7f8269ffb640 1 --2- 172.21.15.6:0/2011916126 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f82580663a0 0x7f8258068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.749+0000 7f8269ffb640 1 -- 172.21.15.6:0/2011916126 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f82700831c0 con 0x7f827406b1e0 2023-07-21T22:37:32.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.749+0000 7f8278a87640 1 --2- 172.21.15.6:0/2011916126 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f82580663a0 0x7f8258068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.749+0000 7f8278a87640 1 --2- 172.21.15.6:0/2011916126 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f82580663a0 0x7f8258068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8274164060 tx=0x7f8264008040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:32.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.753+0000 7f8269ffb640 1 -- 172.21.15.6:0/2011916126 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f82700504f0 con 0x7f827406b1e0 2023-07-21T22:37:32.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.941+0000 7f827b4ec640 1 -- 172.21.15.6:0/2011916126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f82740c9cc0 con 0x7f827406b1e0 2023-07-21T22:37:32.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.941+0000 7f8269ffb640 1 -- 172.21.15.6:0/2011916126 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8270018070 con 0x7f827406b1e0 2023-07-21T22:37:32.988 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T22:37:32.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.945+0000 7f827b4ec640 1 -- 172.21.15.6:0/2011916126 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f82580663a0 msgr2=0x7f8258068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.945+0000 7f827b4ec640 1 --2- 172.21.15.6:0/2011916126 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f82580663a0 0x7f8258068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8274164060 tx=0x7f8264008040 comp rx=0 tx=0).stop 2023-07-21T22:37:32.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.945+0000 7f827b4ec640 1 -- 172.21.15.6:0/2011916126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f827406b1e0 msgr2=0x7f8274151f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.945+0000 7f827b4ec640 1 --2- 172.21.15.6:0/2011916126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f827406b1e0 0x7f8274151f20 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f82700011f0 tx=0x7f827000c9b0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.945+0000 7f827b4ec640 1 -- 172.21.15.6:0/2011916126 shutdown_connections 2023-07-21T22:37:32.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.945+0000 7f827b4ec640 1 --2- 172.21.15.6:0/2011916126 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f82580663a0 0x7f8258068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.945+0000 7f827b4ec640 1 --2- 172.21.15.6:0/2011916126 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82740c21f0 0x7f8274155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.945+0000 7f827b4ec640 1 --2- 172.21.15.6:0/2011916126 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8274070b70 0x7f82740aa070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.945+0000 7f827b4ec640 1 --2- 172.21.15.6:0/2011916126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f827406b1e0 0x7f8274151f20 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.945+0000 7f827b4ec640 1 -- 172.21.15.6:0/2011916126 >> 172.21.15.6:0/2011916126 conn(0x7f82740afcf0 msgr2=0x7f82740c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:32.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.945+0000 7f827b4ec640 1 -- 172.21.15.6:0/2011916126 shutdown_connections 2023-07-21T22:37:32.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:32.945+0000 7f827b4ec640 1 -- 172.21.15.6:0/2011916126 wait complete. 2023-07-21T22:37:33.009 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-21T22:37:33.009 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:37:33.010 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-07-21T22:37:33.011 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T22:37:33.011 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T22:37:33.012 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-21T22:37:33.013 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-21T22:37:33.013 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:37:33.014 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:37:33.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:33.015 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-07-21T22:37:33.026 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:37:33.026 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:37:33.026 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:37:33.026 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:37:33.027 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-21T22:37:33.027 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:37:33.027 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:37:33.027 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:37:33.027 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-07-21T22:37:33.027 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:37:33.027 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:37:33.027 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-07-21T22:37:33.028 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:37:33.028 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:37:33.028 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-07-21T22:37:33.028 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:37:33.028 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 40992sec preferred_lft 40992sec 2023-07-21T22:37:33.029 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-07-21T22:37:33.029 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:37:33.029 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:37:33.029 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:37:33.029 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-07-21T22:37:33.029 INFO:teuthology.orchestra.run.smithi006.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:37:33.029 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:42:2f:9a:3d:15 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:37:33.029 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:37:33.030 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:37:33.030 INFO:teuthology.orchestra.run.smithi006.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:37:33.030 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-21T22:37:33.030 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T22:37:33.030 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:37:33.030 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-21T22:37:33.031 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:37:33.031 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:37:33.031 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:37:33.031 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-21T22:37:33.031 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:37:33.031 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:37:33.031 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T22:37:33.031 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-21T22:37:33.032 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:37:33.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:33.033 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:37:33.100 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-07-21T22:37:33.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:33.102 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-07-21T22:37:33.158 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-07-21T22:37:33.159 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:37:33.159 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:37:33.159 INFO:teuthology.orchestra.run.smithi006.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:37:33.159 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:37:33.159 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:37:33.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:33.160 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T22:37:33.161 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T22:37:33.161 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:37:33.161 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:37:33.162 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:37:33.162 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T22:37:33.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:33.255 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T22:37:33.264 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-21T22:37:33.264 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T22:37:33.265 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:37:33.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:33.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-07-21T22:37:33.334 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:37:33.334 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T22:37:33.389 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:37:33.389 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:37:33.390 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:37:33.440 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-21T22:37:33.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:33.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:37:33.536 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:37:33.537 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:37:33.537 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:37:33.552 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:37:33.553 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:37:33.553 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:37:33.553 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:37:33.553 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:37:33.562 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:37:33.562 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:37:33.562 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:37:33.562 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:37:33.563 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:37:33.563 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-07-21T22:37:33.563 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-07-21T22:37:33.563 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f3073df4-6cd1-4503-bd2e-d3e98fa18bdf" will pass to kernel 2023-07-21T22:37:33.566 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T22:37:33.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:33.566 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:37:33.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:33.589 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:37:33.651 INFO:teuthology.orchestra.run.smithi006.stdout:client7205 2023-07-21T22:37:33.652 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:37:33.652 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:37:33.700 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-21T22:37:33.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.841+0000 7ff0afe96640 1 Processor -- start 2023-07-21T22:37:33.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.841+0000 7ff0afe96640 1 -- start start 2023-07-21T22:37:33.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.845+0000 7ff0afe96640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0a8160330 0x7ff0a80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:33.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.845+0000 7ff0afe96640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff0a80c8940 0x7ff0a80ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:33.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.845+0000 7ff0afe96640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a80c17d0 con 0x7ff0a80c0f80 2023-07-21T22:37:33.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.845+0000 7ff0afe96640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a80c14f0 con 0x7ff0a80c8940 2023-07-21T22:37:33.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.845+0000 7ff0afe96640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a80cac10 con 0x7ff0a8160330 2023-07-21T22:37:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.845+0000 7ff0adc32640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0a8160330 0x7ff0a80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.845+0000 7ff0ad431640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff0a80c8940 0x7ff0a80ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.845+0000 7ff0adc32640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0a8160330 0x7ff0a80cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:44628/0 (socket says 172.21.15.6:44628) 2023-07-21T22:37:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.845+0000 7ff0adc32640 1 -- 172.21.15.6:0/3637807742 learned_addr learned my addr 172.21.15.6:0/3637807742 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:33.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.845+0000 7ff0adc32640 1 -- 172.21.15.6:0/3637807742 >> v2:172.21.15.161:3300/0 conn(0x7ff0a80c8940 msgr2=0x7ff0a80ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:33.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.845+0000 7ff0adc32640 1 --2- 172.21.15.6:0/3637807742 >> v2:172.21.15.161:3300/0 conn(0x7ff0a80c8940 0x7ff0a80ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:33.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.845+0000 7ff0adc32640 1 -- 172.21.15.6:0/3637807742 >> v1:172.21.15.161:6789/0 conn(0x7ff0a80c0f80 legacy=0x7ff0a80cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:33.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.845+0000 7ff0adc32640 1 -- 172.21.15.6:0/3637807742 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a80caef0 con 0x7ff0a8160330 2023-07-21T22:37:33.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.845+0000 7ff0ad431640 1 --2- 172.21.15.6:0/3637807742 >> v2:172.21.15.161:3300/0 conn(0x7ff0a80c8940 0x7ff0a80ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:33.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.849+0000 7ff0adc32640 1 --2- 172.21.15.6:0/3637807742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0a8160330 0x7ff0a80cb6f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4009870 tx=0x7ff0a401ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13101a3c4014e032 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:33.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.849+0000 7ff0acc30640 1 -- 172.21.15.6:0/3637807742 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a40a8a30 con 0x7ff0a8160330 2023-07-21T22:37:33.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.849+0000 7ff0acc30640 1 -- 172.21.15.6:0/3637807742 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a40a8b90 con 0x7ff0a8160330 2023-07-21T22:37:33.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.849+0000 7ff0acc30640 1 -- 172.21.15.6:0/3637807742 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a40b0440 con 0x7ff0a8160330 2023-07-21T22:37:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.849+0000 7ff0afe96640 1 -- 172.21.15.6:0/3637807742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0a8160330 msgr2=0x7ff0a80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.849+0000 7ff0afe96640 1 --2- 172.21.15.6:0/3637807742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0a8160330 0x7ff0a80cb6f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4009870 tx=0x7ff0a401ed30 comp rx=0 tx=0).stop 2023-07-21T22:37:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.849+0000 7ff0afe96640 1 -- 172.21.15.6:0/3637807742 shutdown_connections 2023-07-21T22:37:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.849+0000 7ff0afe96640 1 --2- 172.21.15.6:0/3637807742 >> v2:172.21.15.161:3300/0 conn(0x7ff0a80c8940 0x7ff0a80ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.849+0000 7ff0afe96640 1 --2- 172.21.15.6:0/3637807742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0a8160330 0x7ff0a80cb6f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.849+0000 7ff0afe96640 1 -- 172.21.15.6:0/3637807742 >> 172.21.15.6:0/3637807742 conn(0x7ff0a80afcf0 msgr2=0x7ff0a80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.849+0000 7ff0afe96640 1 -- 172.21.15.6:0/3637807742 shutdown_connections 2023-07-21T22:37:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.849+0000 7ff0afe96640 1 -- 172.21.15.6:0/3637807742 wait complete. 2023-07-21T22:37:33.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0afe96640 1 Processor -- start 2023-07-21T22:37:33.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0afe96640 1 -- start start 2023-07-21T22:37:33.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0afe96640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0a80c0f80 0x7ff0a81562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:33.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0afe96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a80c8940 0x7ff0a81f9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:33.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0afe96640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0a8160330 0x7ff0a8070210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:33.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0afe96640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a81567f0 con 0x7ff0a80c8940 2023-07-21T22:37:33.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0afe96640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a81fa290 con 0x7ff0a8160330 2023-07-21T22:37:33.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0afe96640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a81fa570 con 0x7ff0a80c0f80 2023-07-21T22:37:33.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0ad431640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a80c8940 0x7ff0a81f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:33.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0ad431640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a80c8940 0x7ff0a81f9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50992/0 (socket says 172.21.15.6:50992) 2023-07-21T22:37:33.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0ad431640 1 -- 172.21.15.6:0/4054043594 learned_addr learned my addr 172.21.15.6:0/4054043594 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:33.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0adc32640 1 --2- 172.21.15.6:0/4054043594 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0a80c0f80 0x7ff0a81562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:33.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0ae433640 1 --2- 172.21.15.6:0/4054043594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0a8160330 0x7ff0a8070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:33.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0ad431640 1 -- 172.21.15.6:0/4054043594 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0a80c0f80 msgr2=0x7ff0a81562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:33.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0ad431640 1 --2- 172.21.15.6:0/4054043594 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0a80c0f80 0x7ff0a81562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:33.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0ad431640 1 -- 172.21.15.6:0/4054043594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0a8160330 msgr2=0x7ff0a8070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:33.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0ad431640 1 --2- 172.21.15.6:0/4054043594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0a8160330 0x7ff0a8070210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:33.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0ad431640 1 -- 172.21.15.6:0/4054043594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff098009420 con 0x7ff0a80c8940 2023-07-21T22:37:33.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0ad431640 1 --2- 172.21.15.6:0/4054043594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a80c8940 0x7ff0a81f9840 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7ff09800ebe0 tx=0x7ff09800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:33.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff09e7fc640 1 -- 172.21.15.6:0/4054043594 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09800eee0 con 0x7ff0a80c8940 2023-07-21T22:37:33.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff09e7fc640 1 -- 172.21.15.6:0/4054043594 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09800cc30 con 0x7ff0a80c8940 2023-07-21T22:37:33.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff09e7fc640 1 -- 172.21.15.6:0/4054043594 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff098013470 con 0x7ff0a80c8940 2023-07-21T22:37:33.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0afe96640 1 -- 172.21.15.6:0/4054043594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a40094d0 con 0x7ff0a80c8940 2023-07-21T22:37:33.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0afe96640 1 -- 172.21.15.6:0/4054043594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a815b510 con 0x7ff0a80c8940 2023-07-21T22:37:33.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.853+0000 7ff0afe96640 1 -- 172.21.15.6:0/4054043594 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a815b6d0 con 0x7ff0a80c8940 2023-07-21T22:37:33.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.857+0000 7ff09e7fc640 1 -- 172.21.15.6:0/4054043594 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff0980135d0 con 0x7ff0a80c8940 2023-07-21T22:37:33.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.857+0000 7ff09e7fc640 1 --2- 172.21.15.6:0/4054043594 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7ff08c0663a0 0x7ff08c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:33.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.857+0000 7ff09e7fc640 1 -- 172.21.15.6:0/4054043594 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6106+0+0 (secure 0 0 0) 0x7ff0980841f0 con 0x7ff0a80c8940 2023-07-21T22:37:33.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.857+0000 7ff0adc32640 1 --2- 172.21.15.6:0/4054043594 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7ff08c0663a0 0x7ff08c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:33.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.857+0000 7ff0adc32640 1 --2- 172.21.15.6:0/4054043594 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7ff08c0663a0 0x7ff08c068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff0a40b2000 tx=0x7ff0a40aa070 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:33.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:33.861+0000 7ff09e7fc640 1 -- 172.21.15.6:0/4054043594 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff098054f20 con 0x7ff0a80c8940 2023-07-21T22:37:34.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.036+0000 7ff0afe96640 1 -- 172.21.15.6:0/4054043594 --> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0a8160700 con 0x7ff08c0663a0 2023-07-21T22:37:34.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.040+0000 7ff09e7fc640 1 -- 172.21.15.6:0/4054043594 <== mgr.6905 v2:172.21.15.161:6832/1868466946 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff0a40bc450 con 0x7ff08c0663a0 2023-07-21T22:37:34.085 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:37:34.085 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:37:34.085 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephfs" 2023-07-21T22:37:34.085 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:37:34.086 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:37:34.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.040+0000 7ff0afe96640 1 -- 172.21.15.6:0/4054043594 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7ff08c0663a0 msgr2=0x7ff08c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:34.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.040+0000 7ff0afe96640 1 --2- 172.21.15.6:0/4054043594 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7ff08c0663a0 0x7ff08c068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff0a40b2000 tx=0x7ff0a40aa070 comp rx=0 tx=0).stop 2023-07-21T22:37:34.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.040+0000 7ff0afe96640 1 -- 172.21.15.6:0/4054043594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a80c8940 msgr2=0x7ff0a81f9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:34.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.040+0000 7ff0afe96640 1 --2- 172.21.15.6:0/4054043594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a80c8940 0x7ff0a81f9840 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7ff09800ebe0 tx=0x7ff09800c520 comp rx=0 tx=0).stop 2023-07-21T22:37:34.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.040+0000 7ff0afe96640 1 -- 172.21.15.6:0/4054043594 shutdown_connections 2023-07-21T22:37:34.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.040+0000 7ff0afe96640 1 --2- 172.21.15.6:0/4054043594 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7ff08c0663a0 0x7ff08c068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:34.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.040+0000 7ff0afe96640 1 --2- 172.21.15.6:0/4054043594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0a8160330 0x7ff0a8070210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:34.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.040+0000 7ff0afe96640 1 --2- 172.21.15.6:0/4054043594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0a80c8940 0x7ff0a81f9840 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:34.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.040+0000 7ff0afe96640 1 --2- 172.21.15.6:0/4054043594 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff0a80c0f80 0x7ff0a81562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:34.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.040+0000 7ff0afe96640 1 -- 172.21.15.6:0/4054043594 >> 172.21.15.6:0/4054043594 conn(0x7ff0a80afcf0 msgr2=0x7ff0a80adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:34.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.040+0000 7ff0afe96640 1 -- 172.21.15.6:0/4054043594 shutdown_connections 2023-07-21T22:37:34.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.040+0000 7ff0afe96640 1 -- 172.21.15.6:0/4054043594 wait complete. 2023-07-21T22:37:34.106 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-21T22:37:34.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.204+0000 7fbc4a49c640 1 Processor -- start 2023-07-21T22:37:34.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.204+0000 7fbc4a49c640 1 -- start start 2023-07-21T22:37:34.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc4a49c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbc4415bd50 0x7fbc44069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:34.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc4a49c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc44069970 con 0x7fbc4406cc80 2023-07-21T22:37:34.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc4a49c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc4415fa90 con 0x7fbc4406fcf0 2023-07-21T22:37:34.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc4a49c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4415fd70 con 0x7fbc4415bd50 2023-07-21T22:37:34.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc43fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbc4406cc80 0x7fbc4406d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36098/0 (socket says 172.21.15.6:36098) 2023-07-21T22:37:34.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc43fff640 1 -- 172.21.15.6:0/1780048997 learned_addr learned my addr 172.21.15.6:0/1780048997 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:34.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc437fe640 1 --2- 172.21.15.6:0/1780048997 >> v2:172.21.15.161:3300/0 conn(0x7fbc4415bd50 0x7fbc44069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:34.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc42ffd640 1 -- 172.21.15.6:0/1780048997 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667023573 0 0) 0x7fbc44069970 con 0x7fbc4406cc80 2023-07-21T22:37:34.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc42ffd640 1 -- 172.21.15.6:0/1780048997 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc2c003530 con 0x7fbc4406cc80 2023-07-21T22:37:34.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc42ffd640 1 -- 172.21.15.6:0/1780048997 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3382757836 0 0) 0x7fbc2c003530 con 0x7fbc4406cc80 2023-07-21T22:37:34.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc42ffd640 1 -- 172.21.15.6:0/1780048997 >> v2:172.21.15.161:3300/0 conn(0x7fbc4415bd50 msgr2=0x7fbc44069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:34.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc42ffd640 1 --2- 172.21.15.6:0/1780048997 >> v2:172.21.15.161:3300/0 conn(0x7fbc4415bd50 0x7fbc44069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:34.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc42ffd640 1 -- 172.21.15.6:0/1780048997 >> v1:172.21.15.161:6789/0 conn(0x7fbc4406fcf0 legacy=0x7fbc4415c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:34.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc42ffd640 1 -- 172.21.15.6:0/1780048997 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc44160050 con 0x7fbc4406cc80 2023-07-21T22:37:34.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc42ffd640 1 -- 172.21.15.6:0/1780048997 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fbc34001680 con 0x7fbc4406cc80 2023-07-21T22:37:34.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc42ffd640 1 -- 172.21.15.6:0/1780048997 >> v1:172.21.15.6:6789/0 conn(0x7fbc4406cc80 legacy=0x7fbc4406d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:34.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc42ffd640 1 --2- 172.21.15.6:0/1780048997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc2c003980 0x7fbc2c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:34.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc42ffd640 1 --2- 172.21.15.6:0/1780048997 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc2c0047d0 0x7fbc2c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:34.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc42ffd640 1 --2- 172.21.15.6:0/1780048997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc2c005180 0x7fbc2c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:34.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc42ffd640 1 -- 172.21.15.6:0/1780048997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4415fd70 con 0x7fbc2c005180 2023-07-21T22:37:34.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc42ffd640 1 -- 172.21.15.6:0/1780048997 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c00c000 con 0x7fbc2c003980 2023-07-21T22:37:34.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc42ffd640 1 -- 172.21.15.6:0/1780048997 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c00c1c0 con 0x7fbc2c0047d0 2023-07-21T22:37:34.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc43fff640 1 --2- 172.21.15.6:0/1780048997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc2c003980 0x7fbc2c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:34.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc48a39640 1 --2- 172.21.15.6:0/1780048997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc2c005180 0x7fbc2c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:34.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc437fe640 1 --2- 172.21.15.6:0/1780048997 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc2c0047d0 0x7fbc2c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:34.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc48a39640 1 -- 172.21.15.6:0/1780048997 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc2c0047d0 msgr2=0x7fbc2c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:34.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc48a39640 1 --2- 172.21.15.6:0/1780048997 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc2c0047d0 0x7fbc2c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc48a39640 1 -- 172.21.15.6:0/1780048997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc2c003980 msgr2=0x7fbc2c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc48a39640 1 --2- 172.21.15.6:0/1780048997 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc2c003980 0x7fbc2c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.208+0000 7fbc48a39640 1 -- 172.21.15.6:0/1780048997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c003530 con 0x7fbc2c005180 2023-07-21T22:37:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.212+0000 7fbc48a39640 1 -- 172.21.15.6:0/1780048997 reap_dead start 2023-07-21T22:37:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.212+0000 7fbc48a39640 1 --2- 172.21.15.6:0/1780048997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc2c005180 0x7fbc2c00b990 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c001e70 tx=0x7fbc3c01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db54ea055a4fe78f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.212+0000 7fbc42ffd640 1 -- 172.21.15.6:0/1780048997 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c003b80 con 0x7fbc2c005180 2023-07-21T22:37:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.212+0000 7fbc42ffd640 1 -- 172.21.15.6:0/1780048997 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3c003d20 con 0x7fbc2c005180 2023-07-21T22:37:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.212+0000 7fbc42ffd640 1 -- 172.21.15.6:0/1780048997 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c005260 con 0x7fbc2c005180 2023-07-21T22:37:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.212+0000 7fbc4a49c640 1 -- 172.21.15.6:0/1780048997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc2c005180 msgr2=0x7fbc2c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.212+0000 7fbc4a49c640 1 --2- 172.21.15.6:0/1780048997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc2c005180 0x7fbc2c00b990 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c001e70 tx=0x7fbc3c01c760 comp rx=0 tx=0).stop 2023-07-21T22:37:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.212+0000 7fbc4a49c640 1 -- 172.21.15.6:0/1780048997 shutdown_connections 2023-07-21T22:37:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.212+0000 7fbc4a49c640 1 --2- 172.21.15.6:0/1780048997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc2c005180 0x7fbc2c00b990 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.212+0000 7fbc4a49c640 1 -- 172.21.15.6:0/1780048997 >> 172.21.15.6:0/1780048997 conn(0x7fbc440b0490 msgr2=0x7fbc440b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.212+0000 7fbc4a49c640 1 -- 172.21.15.6:0/1780048997 shutdown_connections 2023-07-21T22:37:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.212+0000 7fbc4a49c640 1 -- 172.21.15.6:0/1780048997 wait complete. 2023-07-21T22:37:34.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc4a49c640 1 Processor -- start 2023-07-21T22:37:34.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc4a49c640 1 -- start start 2023-07-21T22:37:34.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc4a49c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc2c005180 0x7fbc441f1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:34.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc4a49c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc440af180 0x7fbc440c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:34.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc4a49c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc440b3320 0x7fbc440c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:34.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc4a49c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc440a8200 con 0x7fbc440af180 2023-07-21T22:37:34.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc4a49c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc440c9320 con 0x7fbc2c005180 2023-07-21T22:37:34.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc4a49c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc440c8ff0 con 0x7fbc440b3320 2023-07-21T22:37:34.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc437fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc440af180 0x7fbc440c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:34.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc437fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc440af180 0x7fbc440c7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51010/0 (socket says 172.21.15.6:51010) 2023-07-21T22:37:34.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc437fe640 1 -- 172.21.15.6:0/4277123831 learned_addr learned my addr 172.21.15.6:0/4277123831 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc43fff640 1 --2- 172.21.15.6:0/4277123831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc2c005180 0x7fbc441f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc48a39640 1 --2- 172.21.15.6:0/4277123831 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc440b3320 0x7fbc440c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc437fe640 1 -- 172.21.15.6:0/4277123831 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc440b3320 msgr2=0x7fbc440c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc437fe640 1 --2- 172.21.15.6:0/4277123831 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc440b3320 0x7fbc440c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc437fe640 1 -- 172.21.15.6:0/4277123831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc2c005180 msgr2=0x7fbc441f1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc437fe640 1 --2- 172.21.15.6:0/4277123831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc2c005180 0x7fbc441f1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc437fe640 1 -- 172.21.15.6:0/4277123831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc441f1d10 con 0x7fbc440af180 2023-07-21T22:37:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc43fff640 1 --2- 172.21.15.6:0/4277123831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc2c005180 0x7fbc441f1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc48a39640 1 --2- 172.21.15.6:0/4277123831 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc440b3320 0x7fbc440c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc437fe640 1 --2- 172.21.15.6:0/4277123831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc440af180 0x7fbc440c7b10 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fbc38011990 tx=0x7fbc38011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc40ff9640 1 -- 172.21.15.6:0/4277123831 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc38004240 con 0x7fbc440af180 2023-07-21T22:37:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc40ff9640 1 -- 172.21.15.6:0/4277123831 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc380043a0 con 0x7fbc440af180 2023-07-21T22:37:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc4a49c640 1 -- 172.21.15.6:0/4277123831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc441f1ff0 con 0x7fbc440af180 2023-07-21T22:37:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc40ff9640 1 -- 172.21.15.6:0/4277123831 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3800fa80 con 0x7fbc440af180 2023-07-21T22:37:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc4a49c640 1 -- 172.21.15.6:0/4277123831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc441f1940 con 0x7fbc440af180 2023-07-21T22:37:34.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.216+0000 7fbc4a49c640 1 -- 172.21.15.6:0/4277123831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc440678d0 con 0x7fbc440af180 2023-07-21T22:37:34.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.220+0000 7fbc40ff9640 1 -- 172.21.15.6:0/4277123831 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbc3800fbe0 con 0x7fbc440af180 2023-07-21T22:37:34.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.220+0000 7fbc40ff9640 1 --2- 172.21.15.6:0/4277123831 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fbc300663d0 0x7fbc30068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:34.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.220+0000 7fbc40ff9640 1 -- 172.21.15.6:0/4277123831 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fbc38084570 con 0x7fbc440af180 2023-07-21T22:37:34.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.220+0000 7fbc43fff640 1 --2- 172.21.15.6:0/4277123831 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fbc300663d0 0x7fbc30068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:34.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.220+0000 7fbc43fff640 1 --2- 172.21.15.6:0/4277123831 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fbc300663d0 0x7fbc30068880 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbc34001060 tx=0x7fbc34009040 comp rx=0 tx=0).ready entity=mgr.6905 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:34.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.224+0000 7fbc40ff9640 1 -- 172.21.15.6:0/4277123831 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbc38051810 con 0x7fbc440af180 2023-07-21T22:37:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.416+0000 7fbc4a49c640 1 -- 172.21.15.6:0/4277123831 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fbc440c9460 con 0x7fbc440af180 2023-07-21T22:37:34.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.888+0000 7fbc40ff9640 1 -- 172.21.15.6:0/4277123831 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 50) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fbc38051be0 con 0x7fbc440af180 2023-07-21T22:37:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.892+0000 7fbc40ff9640 1 -- 172.21.15.6:0/4277123831 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v50) v1 ==== 92+0+0 (secure 0 0 0) 0x7fbc38041120 con 0x7fbc440af180 2023-07-21T22:37:34.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.892+0000 7fbc4a49c640 1 -- 172.21.15.6:0/4277123831 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fbc300663d0 msgr2=0x7fbc30068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:34.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.892+0000 7fbc4a49c640 1 --2- 172.21.15.6:0/4277123831 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fbc300663d0 0x7fbc30068880 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbc34001060 tx=0x7fbc34009040 comp rx=0 tx=0).stop 2023-07-21T22:37:34.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.892+0000 7fbc4a49c640 1 -- 172.21.15.6:0/4277123831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc440af180 msgr2=0x7fbc440c7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:34.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.892+0000 7fbc4a49c640 1 --2- 172.21.15.6:0/4277123831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc440af180 0x7fbc440c7b10 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fbc38011990 tx=0x7fbc38011e50 comp rx=0 tx=0).stop 2023-07-21T22:37:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.892+0000 7fbc4a49c640 1 -- 172.21.15.6:0/4277123831 shutdown_connections 2023-07-21T22:37:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.892+0000 7fbc4a49c640 1 --2- 172.21.15.6:0/4277123831 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fbc300663d0 0x7fbc30068880 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.892+0000 7fbc4a49c640 1 --2- 172.21.15.6:0/4277123831 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc440b3320 0x7fbc440c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.892+0000 7fbc4a49c640 1 --2- 172.21.15.6:0/4277123831 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc440af180 0x7fbc440c7b10 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.892+0000 7fbc4a49c640 1 --2- 172.21.15.6:0/4277123831 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc2c005180 0x7fbc441f1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.892+0000 7fbc4a49c640 1 -- 172.21.15.6:0/4277123831 >> 172.21.15.6:0/4277123831 conn(0x7fbc440b0490 msgr2=0x7fbc4406d050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:34.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.892+0000 7fbc4a49c640 1 -- 172.21.15.6:0/4277123831 shutdown_connections 2023-07-21T22:37:34.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:34.892+0000 7fbc4a49c640 1 -- 172.21.15.6:0/4277123831 wait complete. 2023-07-21T22:37:34.971 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-21T22:37:35.112 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:35.068+0000 7f388c84a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:37:35.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.080+0000 7fd0e1b67640 1 Processor -- start 2023-07-21T22:37:35.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.084+0000 7fd0e1b67640 1 -- start start 2023-07-21T22:37:35.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.084+0000 7fd0e1b67640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd0dc15bde0 0x7fd0dc0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:35.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.084+0000 7fd0e1b67640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd0dc0d2fc0 0x7fd0dc0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:35.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.084+0000 7fd0e1b67640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0dc0b04c0 con 0x7fd0dc0d2300 2023-07-21T22:37:35.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.084+0000 7fd0e1b67640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0dc15c1b0 con 0x7fd0dc15bde0 2023-07-21T22:37:35.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.084+0000 7fd0e1b67640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0dc0d0aa0 con 0x7fd0dc0d2fc0 2023-07-21T22:37:35.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.084+0000 7fd0db7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd0dc15bde0 0x7fd0dc0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:35.131 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:35.084+0000 7f7127377180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:37:35.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.084+0000 7fd0db7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd0dc15bde0 0x7fd0dc0d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51034/0 (socket says 172.21.15.6:51034) 2023-07-21T22:37:35.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.084+0000 7fd0db7fe640 1 -- 172.21.15.6:0/2721519978 learned_addr learned my addr 172.21.15.6:0/2721519978 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:35.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.084+0000 7fd0daffd640 1 --2- 172.21.15.6:0/2721519978 >> v2:172.21.15.161:3300/0 conn(0x7fd0dc0d2fc0 0x7fd0dc0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:35.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.084+0000 7fd0db7fe640 1 -- 172.21.15.6:0/2721519978 >> v2:172.21.15.161:3300/0 conn(0x7fd0dc0d2fc0 msgr2=0x7fd0dc0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:35.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.084+0000 7fd0db7fe640 1 --2- 172.21.15.6:0/2721519978 >> v2:172.21.15.161:3300/0 conn(0x7fd0dc0d2fc0 0x7fd0dc0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.084+0000 7fd0db7fe640 1 -- 172.21.15.6:0/2721519978 >> v1:172.21.15.161:6789/0 conn(0x7fd0dc0d2300 legacy=0x7fd0dc0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:35.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.084+0000 7fd0db7fe640 1 -- 172.21.15.6:0/2721519978 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc0afb90 con 0x7fd0dc15bde0 2023-07-21T22:37:35.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.084+0000 7fd0da7fc640 1 -- 172.21.15.6:0/2721519978 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112334968 0 0) 0x7fd0dc0b04c0 con 0x7fd0dc0d2300 2023-07-21T22:37:35.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.088+0000 7fd0db7fe640 1 --2- 172.21.15.6:0/2721519978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0dc15bde0 0x7fd0dc0d0270 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc08c600 tx=0x7fd0cc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec735d96e2411753 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:35.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.088+0000 7fd0da7fc640 1 -- 172.21.15.6:0/2721519978 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc0aa660 con 0x7fd0dc15bde0 2023-07-21T22:37:35.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.088+0000 7fd0da7fc640 1 -- 172.21.15.6:0/2721519978 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0cc0aa7c0 con 0x7fd0dc15bde0 2023-07-21T22:37:35.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.088+0000 7fd0da7fc640 1 -- 172.21.15.6:0/2721519978 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc0aab50 con 0x7fd0dc15bde0 2023-07-21T22:37:35.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.088+0000 7fd0e1b67640 1 -- 172.21.15.6:0/2721519978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0dc15bde0 msgr2=0x7fd0dc0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:35.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.088+0000 7fd0e1b67640 1 --2- 172.21.15.6:0/2721519978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0dc15bde0 0x7fd0dc0d0270 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc08c600 tx=0x7fd0cc01c500 comp rx=0 tx=0).stop 2023-07-21T22:37:35.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.088+0000 7fd0e1b67640 1 -- 172.21.15.6:0/2721519978 shutdown_connections 2023-07-21T22:37:35.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.088+0000 7fd0e1b67640 1 --2- 172.21.15.6:0/2721519978 >> v2:172.21.15.161:3300/0 conn(0x7fd0dc0d2fc0 0x7fd0dc0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.088+0000 7fd0e1b67640 1 --2- 172.21.15.6:0/2721519978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0dc15bde0 0x7fd0dc0d0270 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.088+0000 7fd0e1b67640 1 -- 172.21.15.6:0/2721519978 >> 172.21.15.6:0/2721519978 conn(0x7fd0dc0659d0 msgr2=0x7fd0dc09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:35.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.088+0000 7fd0e1b67640 1 -- 172.21.15.6:0/2721519978 shutdown_connections 2023-07-21T22:37:35.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.088+0000 7fd0e1b67640 1 -- 172.21.15.6:0/2721519978 wait complete. 2023-07-21T22:37:35.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.088+0000 7fd0e1b67640 1 Processor -- start 2023-07-21T22:37:35.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0e1b67640 1 -- start start 2023-07-21T22:37:35.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0e1b67640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0dc0d2300 0x7fd0dc0cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:35.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0e1b67640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0dc0d2fc0 0x7fd0dc15c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:35.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0e1b67640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0dc15bde0 0x7fd0dc1513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:35.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0e1b67640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc152250 con 0x7fd0dc15bde0 2023-07-21T22:37:35.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0e1b67640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc15e7c0 con 0x7fd0dc0d2300 2023-07-21T22:37:35.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0e1b67640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc15eaa0 con 0x7fd0dc0d2fc0 2023-07-21T22:37:35.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0dbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0dc15bde0 0x7fd0dc1513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:35.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0db7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0dc0d2300 0x7fd0dc0cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:35.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0dbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0dc15bde0 0x7fd0dc1513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51040/0 (socket says 172.21.15.6:51040) 2023-07-21T22:37:35.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0dbfff640 1 -- 172.21.15.6:0/3800285579 learned_addr learned my addr 172.21.15.6:0/3800285579 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:35.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0daffd640 1 --2- 172.21.15.6:0/3800285579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0dc0d2fc0 0x7fd0dc15c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:35.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0dbfff640 1 -- 172.21.15.6:0/3800285579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0dc0d2fc0 msgr2=0x7fd0dc15c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:35.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0dbfff640 1 --2- 172.21.15.6:0/3800285579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0dc0d2fc0 0x7fd0dc15c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0dbfff640 1 -- 172.21.15.6:0/3800285579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0dc0d2300 msgr2=0x7fd0dc0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:35.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0dbfff640 1 --2- 172.21.15.6:0/3800285579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0dc0d2300 0x7fd0dc0cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0dbfff640 1 -- 172.21.15.6:0/3800285579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0cc009480 con 0x7fd0dc15bde0 2023-07-21T22:37:35.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0dbfff640 1 --2- 172.21.15.6:0/3800285579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0dc15bde0 0x7fd0dc1513f0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4001570 tx=0x7fd0d400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:35.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0c3fff640 1 -- 172.21.15.6:0/3800285579 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4003db0 con 0x7fd0dc15bde0 2023-07-21T22:37:35.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0c3fff640 1 -- 172.21.15.6:0/3800285579 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d4005070 con 0x7fd0dc15bde0 2023-07-21T22:37:35.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0e1b67640 1 -- 172.21.15.6:0/3800285579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0dc15ed80 con 0x7fd0dc15bde0 2023-07-21T22:37:35.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0c3fff640 1 -- 172.21.15.6:0/3800285579 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4005420 con 0x7fd0dc15bde0 2023-07-21T22:37:35.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0e1b67640 1 -- 172.21.15.6:0/3800285579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0dc0cdc80 con 0x7fd0dc15bde0 2023-07-21T22:37:35.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.092+0000 7fd0e1b67640 1 -- 172.21.15.6:0/3800285579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0dc1523c0 con 0x7fd0dc15bde0 2023-07-21T22:37:35.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.096+0000 7fd0c3fff640 1 -- 172.21.15.6:0/3800285579 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 50) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fd0d4005580 con 0x7fd0dc15bde0 2023-07-21T22:37:35.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.096+0000 7fd0c3fff640 1 --2- 172.21.15.6:0/3800285579 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fd0c80663f0 0x7fd0c80688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.096+0000 7fd0c3fff640 1 -- 172.21.15.6:0/3800285579 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fd0d4083790 con 0x7fd0dc15bde0 2023-07-21T22:37:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.096+0000 7fd0db7fe640 1 -- 172.21.15.6:0/3800285579 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fd0c80663f0 msgr2=0x7fd0c80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1868466946 2023-07-21T22:37:35.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.096+0000 7fd0db7fe640 1 --2- 172.21.15.6:0/3800285579 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fd0c80663f0 0x7fd0c80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:37:35.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.100+0000 7fd0c3fff640 1 -- 172.21.15.6:0/3800285579 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd0d4050b80 con 0x7fd0dc15bde0 2023-07-21T22:37:35.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.264+0000 7fd0e1b67640 1 -- 172.21.15.6:0/3800285579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fd0dc0678d0 con 0x7fd0dc15bde0 2023-07-21T22:37:35.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.268+0000 7fd0c3fff640 1 -- 172.21.15.6:0/3800285579 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v41)=0 v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd0d40541a0 con 0x7fd0dc15bde0 2023-07-21T22:37:35.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.268+0000 7fd0e1b67640 1 -- 172.21.15.6:0/3800285579 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fd0c80663f0 msgr2=0x7fd0c80688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:37:35.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.268+0000 7fd0e1b67640 1 --2- 172.21.15.6:0/3800285579 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fd0c80663f0 0x7fd0c80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.268+0000 7fd0e1b67640 1 -- 172.21.15.6:0/3800285579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0dc15bde0 msgr2=0x7fd0dc1513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:35.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.268+0000 7fd0e1b67640 1 --2- 172.21.15.6:0/3800285579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0dc15bde0 0x7fd0dc1513f0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4001570 tx=0x7fd0d400cd20 comp rx=0 tx=0).stop 2023-07-21T22:37:35.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.268+0000 7fd0e1b67640 1 -- 172.21.15.6:0/3800285579 shutdown_connections 2023-07-21T22:37:35.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.268+0000 7fd0e1b67640 1 --2- 172.21.15.6:0/3800285579 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fd0c80663f0 0x7fd0c80688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.268+0000 7fd0e1b67640 1 --2- 172.21.15.6:0/3800285579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0dc15bde0 0x7fd0dc1513f0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.268+0000 7fd0e1b67640 1 --2- 172.21.15.6:0/3800285579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd0dc0d2fc0 0x7fd0dc15c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.268+0000 7fd0e1b67640 1 --2- 172.21.15.6:0/3800285579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0dc0d2300 0x7fd0dc0cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.268+0000 7fd0e1b67640 1 -- 172.21.15.6:0/3800285579 >> 172.21.15.6:0/3800285579 conn(0x7fd0dc0659d0 msgr2=0x7fd0dc0aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.272+0000 7fd0e1b67640 1 -- 172.21.15.6:0/3800285579 shutdown_connections 2023-07-21T22:37:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.272+0000 7fd0e1b67640 1 -- 172.21.15.6:0/3800285579 wait complete. 2023-07-21T22:37:35.336 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-21T22:37:35.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.440+0000 7f3763c26640 1 Processor -- start 2023-07-21T22:37:35.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.440+0000 7f3763c26640 1 -- start start 2023-07-21T22:37:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.440+0000 7f3763c26640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f375c0d2fc0 0x7f375c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.440+0000 7f3763c26640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375c0b04c0 con 0x7f375c0d2300 2023-07-21T22:37:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.440+0000 7f3763c26640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375c0d0aa0 con 0x7f375c15bde0 2023-07-21T22:37:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.440+0000 7f3763c26640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c15c1b0 con 0x7f375c0d2fc0 2023-07-21T22:37:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.440+0000 7f37621c3640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f375c0d2300 0x7f375c0cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36104/0 (socket says 172.21.15.6:36104) 2023-07-21T22:37:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.440+0000 7f37621c3640 1 -- 172.21.15.6:0/3599539381 learned_addr learned my addr 172.21.15.6:0/3599539381 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:35.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.440+0000 7f37611c1640 1 --2- 172.21.15.6:0/3599539381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f375c0d2fc0 0x7f375c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.440+0000 7f37609c0640 1 -- 172.21.15.6:0/3599539381 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391418217 0 0) 0x7f375c0b04c0 con 0x7f375c0d2300 2023-07-21T22:37:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.440+0000 7f37609c0640 1 -- 172.21.15.6:0/3599539381 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3748003530 con 0x7f375c0d2300 2023-07-21T22:37:35.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.440+0000 7f37609c0640 1 -- 172.21.15.6:0/3599539381 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187308246 0 0) 0x7f375c0d0aa0 con 0x7f375c15bde0 2023-07-21T22:37:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.440+0000 7f37609c0640 1 -- 172.21.15.6:0/3599539381 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f375c0b04c0 con 0x7f375c15bde0 2023-07-21T22:37:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.440+0000 7f37611c1640 1 -- 172.21.15.6:0/3599539381 >> v1:172.21.15.161:6789/0 conn(0x7f375c15bde0 legacy=0x7f375c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.440+0000 7f37611c1640 1 -- 172.21.15.6:0/3599539381 >> v1:172.21.15.6:6789/0 conn(0x7f375c0d2300 legacy=0x7f375c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.440+0000 7f37611c1640 1 -- 172.21.15.6:0/3599539381 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c0afb90 con 0x7f375c0d2fc0 2023-07-21T22:37:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.444+0000 7f37611c1640 1 --2- 172.21.15.6:0/3599539381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f375c0d2fc0 0x7f375c0b0950 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f374c0097f0 tx=0x7f374c01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33725c58e450f4cc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.444+0000 7f37609c0640 1 -- 172.21.15.6:0/3599539381 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c0aa620 con 0x7f375c0d2fc0 2023-07-21T22:37:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.444+0000 7f37609c0640 1 -- 172.21.15.6:0/3599539381 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c0aa780 con 0x7f375c0d2fc0 2023-07-21T22:37:35.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.444+0000 7f37609c0640 1 -- 172.21.15.6:0/3599539381 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c0aaaf0 con 0x7f375c0d2fc0 2023-07-21T22:37:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.444+0000 7f3763c26640 1 -- 172.21.15.6:0/3599539381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f375c0d2fc0 msgr2=0x7f375c0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.444+0000 7f3763c26640 1 --2- 172.21.15.6:0/3599539381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f375c0d2fc0 0x7f375c0b0950 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f374c0097f0 tx=0x7f374c01c4c0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.444+0000 7f3763c26640 1 -- 172.21.15.6:0/3599539381 shutdown_connections 2023-07-21T22:37:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.444+0000 7f3763c26640 1 --2- 172.21.15.6:0/3599539381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f375c0d2fc0 0x7f375c0b0950 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.444+0000 7f3763c26640 1 -- 172.21.15.6:0/3599539381 >> 172.21.15.6:0/3599539381 conn(0x7f375c0659d0 msgr2=0x7f375c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:35.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.444+0000 7f3763c26640 1 -- 172.21.15.6:0/3599539381 shutdown_connections 2023-07-21T22:37:35.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.444+0000 7f3763c26640 1 -- 172.21.15.6:0/3599539381 wait complete. 2023-07-21T22:37:35.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.448+0000 7f3763c26640 1 Processor -- start 2023-07-21T22:37:35.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.448+0000 7f3763c26640 1 -- start start 2023-07-21T22:37:35.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.448+0000 7f3763c26640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f375c0d2300 0x7f375c0cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:35.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.448+0000 7f3763c26640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f375c0d2fc0 0x7f375c06afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:35.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.448+0000 7f3763c26640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f375c15bde0 0x7f375c06b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:35.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.448+0000 7f3763c26640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c0c6a90 con 0x7f375c0d2300 2023-07-21T22:37:35.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.448+0000 7f3763c26640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c0c5ea0 con 0x7f375c0d2fc0 2023-07-21T22:37:35.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.448+0000 7f3763c26640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c0cc590 con 0x7f375c15bde0 2023-07-21T22:37:35.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.452+0000 7f37619c2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f375c0d2300 0x7f375c0cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:35.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.452+0000 7f37619c2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f375c0d2300 0x7f375c0cc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51042/0 (socket says 172.21.15.6:51042) 2023-07-21T22:37:35.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.452+0000 7f37619c2640 1 -- 172.21.15.6:0/1805197709 learned_addr learned my addr 172.21.15.6:0/1805197709 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:35.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.452+0000 7f37621c3640 1 --2- 172.21.15.6:0/1805197709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f375c15bde0 0x7f375c06b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:35.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.452+0000 7f37611c1640 1 --2- 172.21.15.6:0/1805197709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f375c0d2fc0 0x7f375c06afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:35.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.452+0000 7f37619c2640 1 -- 172.21.15.6:0/1805197709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f375c15bde0 msgr2=0x7f375c06b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:35.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.452+0000 7f37619c2640 1 --2- 172.21.15.6:0/1805197709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f375c15bde0 0x7f375c06b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.452+0000 7f37619c2640 1 -- 172.21.15.6:0/1805197709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f375c0d2fc0 msgr2=0x7f375c06afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:35.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.452+0000 7f37619c2640 1 --2- 172.21.15.6:0/1805197709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f375c0d2fc0 0x7f375c06afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.452+0000 7f37619c2640 1 -- 172.21.15.6:0/1805197709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c009420 con 0x7f375c0d2300 2023-07-21T22:37:35.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.452+0000 7f37619c2640 1 --2- 172.21.15.6:0/1805197709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f375c0d2300 0x7f375c0cc050 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f375800c430 tx=0x7f375800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:35.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.452+0000 7f37527fc640 1 -- 172.21.15.6:0/1805197709 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37580052d0 con 0x7f375c0d2300 2023-07-21T22:37:35.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.452+0000 7f37527fc640 1 -- 172.21.15.6:0/1805197709 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3758005430 con 0x7f375c0d2300 2023-07-21T22:37:35.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.452+0000 7f3763c26640 1 -- 172.21.15.6:0/1805197709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375c0c60f0 con 0x7f375c0d2300 2023-07-21T22:37:35.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.452+0000 7f37527fc640 1 -- 172.21.15.6:0/1805197709 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758003890 con 0x7f375c0d2300 2023-07-21T22:37:35.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.452+0000 7f3763c26640 1 -- 172.21.15.6:0/1805197709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375c0c66b0 con 0x7f375c0d2300 2023-07-21T22:37:35.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.452+0000 7f3763c26640 1 -- 172.21.15.6:0/1805197709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375c0c6bd0 con 0x7f375c0d2300 2023-07-21T22:37:35.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.456+0000 7f37527fc640 1 -- 172.21.15.6:0/1805197709 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 50) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f37580039f0 con 0x7f375c0d2300 2023-07-21T22:37:35.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.456+0000 7f37527fc640 1 --2- 172.21.15.6:0/1805197709 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f3740066420 0x7f37400688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.456+0000 7f37527fc640 1 -- 172.21.15.6:0/1805197709 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6106+0+0 (secure 0 0 0) 0x7f3758083510 con 0x7f375c0d2300 2023-07-21T22:37:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.456+0000 7f37611c1640 1 -- 172.21.15.6:0/1805197709 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f3740066420 msgr2=0x7f37400688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1868466946 2023-07-21T22:37:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.456+0000 7f37611c1640 1 --2- 172.21.15.6:0/1805197709 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f3740066420 0x7f37400688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:37:35.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.460+0000 7f37527fc640 1 -- 172.21.15.6:0/1805197709 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f375c0c6bd0 con 0x7f375c0d2300 2023-07-21T22:37:35.529 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:35.484+0000 7f388c84a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:37:35.584 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:35.536+0000 7f7127377180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:37:35.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.620+0000 7f3763c26640 1 -- 172.21.15.6:0/1805197709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f375c0c6bd0 con 0x7f375c0d2300 2023-07-21T22:37:35.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.624+0000 7f37527fc640 1 -- 172.21.15.6:0/1805197709 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v42)=0 v42) v1 ==== 133+0+0 (secure 0 0 0) 0x7f375c0c6bd0 con 0x7f375c0d2300 2023-07-21T22:37:35.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.628+0000 7f3763c26640 1 -- 172.21.15.6:0/1805197709 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f3740066420 msgr2=0x7f37400688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:37:35.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.628+0000 7f3763c26640 1 --2- 172.21.15.6:0/1805197709 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f3740066420 0x7f37400688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.628+0000 7f3763c26640 1 -- 172.21.15.6:0/1805197709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f375c0d2300 msgr2=0x7f375c0cc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.628+0000 7f3763c26640 1 --2- 172.21.15.6:0/1805197709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f375c0d2300 0x7f375c0cc050 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f375800c430 tx=0x7f375800c8f0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.628+0000 7f3763c26640 1 -- 172.21.15.6:0/1805197709 shutdown_connections 2023-07-21T22:37:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.628+0000 7f3763c26640 1 --2- 172.21.15.6:0/1805197709 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7f3740066420 0x7f37400688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.628+0000 7f3763c26640 1 --2- 172.21.15.6:0/1805197709 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f375c15bde0 0x7f375c06b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.628+0000 7f3763c26640 1 --2- 172.21.15.6:0/1805197709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f375c0d2fc0 0x7f375c06afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.628+0000 7f3763c26640 1 --2- 172.21.15.6:0/1805197709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f375c0d2300 0x7f375c0cc050 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.628+0000 7f3763c26640 1 -- 172.21.15.6:0/1805197709 >> 172.21.15.6:0/1805197709 conn(0x7f375c0659d0 msgr2=0x7f375c0b51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.628+0000 7f3763c26640 1 -- 172.21.15.6:0/1805197709 shutdown_connections 2023-07-21T22:37:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.628+0000 7f3763c26640 1 -- 172.21.15.6:0/1805197709 wait complete. 2023-07-21T22:37:35.680 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:35.636+0000 7f388c84a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:37:35.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:35.693 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-21T22:37:35.708 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-07-21T22:37:35.746 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:35.700+0000 7f7127377180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:37:35.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.848+0000 7fe43c337640 1 Processor -- start 2023-07-21T22:37:35.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.848+0000 7fe43c337640 1 -- start start 2023-07-21T22:37:35.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.852+0000 7fe43c337640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe4340d2fc0 0x7fe4340b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:35.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.852+0000 7fe43c337640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4340b04c0 con 0x7fe43415bde0 2023-07-21T22:37:35.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.852+0000 7fe43c337640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4340d0aa0 con 0x7fe4340d2300 2023-07-21T22:37:35.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.852+0000 7fe43c337640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe43415c1b0 con 0x7fe4340d2fc0 2023-07-21T22:37:35.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.852+0000 7fe43a0d3640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe43415bde0 0x7fe4340d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:36118/0 (socket says 172.21.15.6:36118) 2023-07-21T22:37:35.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.852+0000 7fe43a0d3640 1 -- 172.21.15.6:0/3862954603 learned_addr learned my addr 172.21.15.6:0/3862954603 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:37:35.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.852+0000 7fe4398d2640 1 --2- 172.21.15.6:0/3862954603 >> v2:172.21.15.161:3300/0 conn(0x7fe4340d2fc0 0x7fe4340b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:35.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.852+0000 7fe4390d1640 1 -- 172.21.15.6:0/3862954603 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608651352 0 0) 0x7fe4340b04c0 con 0x7fe43415bde0 2023-07-21T22:37:35.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.852+0000 7fe4390d1640 1 -- 172.21.15.6:0/3862954603 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe420003530 con 0x7fe43415bde0 2023-07-21T22:37:35.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.852+0000 7fe4390d1640 1 -- 172.21.15.6:0/3862954603 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097528680 0 0) 0x7fe4340d0aa0 con 0x7fe4340d2300 2023-07-21T22:37:35.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.852+0000 7fe4390d1640 1 -- 172.21.15.6:0/3862954603 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4340b04c0 con 0x7fe4340d2300 2023-07-21T22:37:35.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.852+0000 7fe4390d1640 1 -- 172.21.15.6:0/3862954603 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1165845996 0 0) 0x7fe420003530 con 0x7fe43415bde0 2023-07-21T22:37:35.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.852+0000 7fe4398d2640 1 -- 172.21.15.6:0/3862954603 >> v1:172.21.15.161:6789/0 conn(0x7fe4340d2300 legacy=0x7fe4340cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:35.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.852+0000 7fe4398d2640 1 -- 172.21.15.6:0/3862954603 >> v1:172.21.15.6:6789/0 conn(0x7fe43415bde0 legacy=0x7fe4340d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:35.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.852+0000 7fe4398d2640 1 -- 172.21.15.6:0/3862954603 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4340afb90 con 0x7fe4340d2fc0 2023-07-21T22:37:35.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.856+0000 7fe4398d2640 1 --2- 172.21.15.6:0/3862954603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4340d2fc0 0x7fe4340b0950 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe4240097c0 tx=0x7fe42401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8384bdbe7179655e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:35.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.856+0000 7fe4390d1640 1 -- 172.21.15.6:0/3862954603 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe430001800 con 0x7fe4340d2fc0 2023-07-21T22:37:35.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.856+0000 7fe4390d1640 1 -- 172.21.15.6:0/3862954603 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4240a7050 con 0x7fe4340d2fc0 2023-07-21T22:37:35.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.856+0000 7fe4390d1640 1 -- 172.21.15.6:0/3862954603 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4240ab620 con 0x7fe4340d2fc0 2023-07-21T22:37:35.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.856+0000 7fe43c337640 1 -- 172.21.15.6:0/3862954603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4340d2fc0 msgr2=0x7fe4340b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.856+0000 7fe43c337640 1 --2- 172.21.15.6:0/3862954603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4340d2fc0 0x7fe4340b0950 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe4240097c0 tx=0x7fe42401c3a0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.856+0000 7fe43c337640 1 -- 172.21.15.6:0/3862954603 shutdown_connections 2023-07-21T22:37:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.856+0000 7fe43c337640 1 --2- 172.21.15.6:0/3862954603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4340d2fc0 0x7fe4340b0950 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.856+0000 7fe43c337640 1 -- 172.21.15.6:0/3862954603 >> 172.21.15.6:0/3862954603 conn(0x7fe4340659d0 msgr2=0x7fe43409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.856+0000 7fe43c337640 1 -- 172.21.15.6:0/3862954603 shutdown_connections 2023-07-21T22:37:35.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.856+0000 7fe43c337640 1 -- 172.21.15.6:0/3862954603 wait complete. 2023-07-21T22:37:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.860+0000 7fe43c337640 1 Processor -- start 2023-07-21T22:37:35.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.860+0000 7fe43c337640 1 -- start start 2023-07-21T22:37:35.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.860+0000 7fe43c337640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4340d2300 0x7fe4340b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:35.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.860+0000 7fe43c337640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4340d2fc0 0x7fe4341514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:35.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.860+0000 7fe43c337640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe43415bde0 0x7fe43414f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:35.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.860+0000 7fe43c337640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43415b450 con 0x7fe4340d2fc0 2023-07-21T22:37:35.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.860+0000 7fe43c337640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43415c450 con 0x7fe4340d2300 2023-07-21T22:37:35.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.860+0000 7fe43c337640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43415c730 con 0x7fe43415bde0 2023-07-21T22:37:35.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.860+0000 7fe4398d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4340d2fc0 0x7fe4341514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:35.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.860+0000 7fe4398d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4340d2fc0 0x7fe4341514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51044/0 (socket says 172.21.15.6:51044) 2023-07-21T22:37:35.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.860+0000 7fe4398d2640 1 -- 172.21.15.6:0/290692865 learned_addr learned my addr 172.21.15.6:0/290692865 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:35.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.860+0000 7fe43a0d3640 1 --2- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4340d2300 0x7fe4340b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:35.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.860+0000 7fe43a8d4640 1 --2- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe43415bde0 0x7fe43414f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:35.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.860+0000 7fe4398d2640 1 -- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe43415bde0 msgr2=0x7fe43414f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:35.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.860+0000 7fe4398d2640 1 --2- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe43415bde0 0x7fe43414f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.860+0000 7fe4398d2640 1 -- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4340d2300 msgr2=0x7fe4340b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:35.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.860+0000 7fe4398d2640 1 --2- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4340d2300 0x7fe4340b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.860+0000 7fe4398d2640 1 -- 172.21.15.6:0/290692865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe424009420 con 0x7fe4340d2fc0 2023-07-21T22:37:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.860+0000 7fe4398d2640 1 --2- 172.21.15.6:0/290692865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4340d2fc0 0x7fe4341514c0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fe4240ae040 tx=0x7fe424019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.860+0000 7fe42affd640 1 -- 172.21.15.6:0/290692865 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4240b4410 con 0x7fe4340d2fc0 2023-07-21T22:37:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.864+0000 7fe42affd640 1 -- 172.21.15.6:0/290692865 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4240b4570 con 0x7fe4340d2fc0 2023-07-21T22:37:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.864+0000 7fe42affd640 1 -- 172.21.15.6:0/290692865 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4240b4920 con 0x7fe4340d2fc0 2023-07-21T22:37:35.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.864+0000 7fe43c337640 1 -- 172.21.15.6:0/290692865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43415ca10 con 0x7fe4340d2fc0 2023-07-21T22:37:35.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.864+0000 7fe43c337640 1 -- 172.21.15.6:0/290692865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe434150670 con 0x7fe4340d2fc0 2023-07-21T22:37:35.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.864+0000 7fe43c337640 1 -- 172.21.15.6:0/290692865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4340678d0 con 0x7fe4340d2fc0 2023-07-21T22:37:35.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.864+0000 7fe42affd640 1 -- 172.21.15.6:0/290692865 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 50) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fe4240b2040 con 0x7fe4340d2fc0 2023-07-21T22:37:35.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.864+0000 7fe42affd640 1 --2- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe4180663f0 0x7fe4180688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:35.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.864+0000 7fe42affd640 1 -- 172.21.15.6:0/290692865 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6106+0+0 (secure 0 0 0) 0x7fe42411db90 con 0x7fe4340d2fc0 2023-07-21T22:37:35.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.864+0000 7fe43a0d3640 1 -- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe4180663f0 msgr2=0x7fe4180688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1868466946 2023-07-21T22:37:35.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.864+0000 7fe43a0d3640 1 --2- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe4180663f0 0x7fe4180688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:37:35.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:35.868+0000 7fe42affd640 1 -- 172.21.15.6:0/290692865 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe4240eae60 con 0x7fe4340d2fc0 2023-07-21T22:37:36.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:36.044+0000 7fe43c337640 1 -- 172.21.15.6:0/290692865 --> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4340b0de0 con 0x7fe4180663f0 2023-07-21T22:37:36.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:36.068+0000 7fe43a0d3640 1 -- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe4180663f0 msgr2=0x7fe4180688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1868466946 2023-07-21T22:37:36.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:36.068+0000 7fe43a0d3640 1 --2- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe4180663f0 0x7fe4180688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:37:36.160 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:36.116+0000 7f388c84a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:37:36.220 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:36.176+0000 7f388c84a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:37:36.261 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:36.216+0000 7f7127377180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:37:36.276 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:36.232+0000 7f388c84a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:37:36.323 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:36.276+0000 7f7127377180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:37:36.361 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:36.316+0000 7f388c84a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:37:36.382 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:36.336+0000 7f7127377180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:37:36.419 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:36.376+0000 7f388c84a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:37:36.474 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:36.428+0000 7f7127377180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:37:36.502 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:36.460+0000 7f388c84a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:37:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:36.472+0000 7fe43a0d3640 1 -- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe4180663f0 msgr2=0x7fe4180688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1868466946 2023-07-21T22:37:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:36.472+0000 7fe43a0d3640 1 --2- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe4180663f0 0x7fe4180688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-21T22:37:36.533 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:36.488+0000 7f7127377180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:37:36.558 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:36.516+0000 7f388c84a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:37:36.623 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:36.576+0000 7f7127377180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:37:36.685 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:36.640+0000 7f7127377180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:37:36.699 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:36.656+0000 7f388c84a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:37:36.757 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:36.712+0000 7f388c84a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:37:36.835 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:36.788+0000 7f7127377180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:37:36.896 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:36.848+0000 7f7127377180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:37:36.997 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:37:36.997 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:37:36.998 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:37:37.005 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:36.964+0000 7f388c84a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:37:37.141 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:37.096+0000 7f388c84a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:37:37.151 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:37:37.151 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:37:37.152 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:37:37.161 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:37.116+0000 7f7127377180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:37:37.269 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:37.224+0000 7f388c84a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:37:37.302 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:37.256+0000 7f7127377180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:37:37.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:37.276+0000 7fe43a0d3640 1 -- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe4180663f0 msgr2=0x7fe4180688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1868466946 2023-07-21T22:37:37.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:37.276+0000 7fe43a0d3640 1 --2- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe4180663f0 0x7fe4180688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-21T22:37:37.336 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:37.292+0000 7f388c84a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:37:37.434 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:37.388+0000 7f7127377180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:37:37.470 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:37.428+0000 7f388c84a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:37:37.508 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:37.460+0000 7f7127377180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:37:37.649 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:37.604+0000 7f7127377180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:37:38.005 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:37.960+0000 7f388c84a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:37:38.090 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:38.048+0000 7f388c84a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:37:38.222 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:38.176+0000 7f7127377180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:37:38.241 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:38.196+0000 7f388c84a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:37:38.311 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:38.264+0000 7f7127377180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:37:38.324 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:38.280+0000 7f388c84a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:37:38.467 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:38.420+0000 7f7127377180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:37:38.555 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:38.508+0000 7f7127377180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:37:38.592 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:38.548+0000 7f388c84a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:37:38.652 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:38.608+0000 7f388c84a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:37:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:38.620+0000 7fe42affd640 1 -- 172.21.15.6:0/290692865 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 51) v1 ==== 85386+0+0 (secure 0 0 0) 0x7fe4240eb230 con 0x7fe4340d2fc0 2023-07-21T22:37:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:38.620+0000 7fe42affd640 1 -- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe4180663f0 msgr2=0x7fe4180688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:37:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:38.620+0000 7fe42affd640 1 --2- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:6832/1868466946,v1:172.21.15.161:6833/1868466946] conn(0x7fe4180663f0 0x7fe4180688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:38.794 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:38.752+0000 7f380acd7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:37:38.794 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:38.752+0000 7f380acd7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:37:38.794 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:38.752+0000 7f380acd7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:37:38.794 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:38.752+0000 7f380acd7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:37:38.795 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:38.752+0000 7f380acd7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:37:38.795 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:38.752+0000 7f380dcdd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:37:38.795 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:38.752+0000 7f380dcdd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:37:38.795 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:38.752+0000 7f380dcdd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:37:38.795 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:38.752+0000 7f380dcdd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:37:38.795 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:37:38.752+0000 7f380dcdd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:37:38.862 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:38.816+0000 7f7127377180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:37:38.926 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:37:38.880+0000 7f7127377180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:37:39.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.624+0000 7fe42affd640 1 -- 172.21.15.6:0/290692865 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mgrmap(e 52) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fe4241060c0 con 0x7fe4340d2fc0 2023-07-21T22:37:39.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.624+0000 7fe42affd640 1 --2- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7fe418033e90 0x7fe418070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:39.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.624+0000 7fe42affd640 1 -- 172.21.15.6:0/290692865 --> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4340b0de0 con 0x7fe418033e90 2023-07-21T22:37:39.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.624+0000 7fe43a0d3640 1 --2- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7fe418033e90 0x7fe418070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:39.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.632+0000 7fe43a0d3640 1 --2- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7fe418033e90 0x7fe418070950 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe430001010 tx=0x7fe430000f80 comp rx=0 tx=0).ready entity=mgr.8128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:39.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.696+0000 7fe42affd640 1 -- 172.21.15.6:0/290692865 <== mgr.8128 v2:172.21.15.161:6832/1243154965 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe4340b0de0 con 0x7fe418033e90 2023-07-21T22:37:39.743 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule set for path snap_test_dir1 2023-07-21T22:37:39.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.700+0000 7fe43c337640 1 -- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7fe418033e90 msgr2=0x7fe418070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:39.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.700+0000 7fe43c337640 1 --2- 172.21.15.6:0/290692865 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7fe418033e90 0x7fe418070950 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe430001010 tx=0x7fe430000f80 comp rx=0 tx=0).stop 2023-07-21T22:37:39.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.700+0000 7fe43c337640 1 -- 172.21.15.6:0/290692865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4340d2fc0 msgr2=0x7fe4341514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:39.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.700+0000 7fe43c337640 1 --2- 172.21.15.6:0/290692865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4340d2fc0 0x7fe4341514c0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fe4240ae040 tx=0x7fe424019140 comp rx=0 tx=0).stop 2023-07-21T22:37:39.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.700+0000 7fe43a8d4640 1 -- 172.21.15.6:0/290692865 reap_dead start 2023-07-21T22:37:39.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.700+0000 7fe43c337640 1 -- 172.21.15.6:0/290692865 shutdown_connections 2023-07-21T22:37:39.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.700+0000 7fe43c337640 1 -- 172.21.15.6:0/290692865 >> 172.21.15.6:0/290692865 conn(0x7fe4340659d0 msgr2=0x7fe4340cf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:39.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.700+0000 7fe43c337640 1 -- 172.21.15.6:0/290692865 shutdown_connections 2023-07-21T22:37:39.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.700+0000 7fe43c337640 1 -- 172.21.15.6:0/290692865 wait complete. 2023-07-21T22:37:39.767 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-21T22:37:39.767 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-21-22_38_00 in ~21s... 2023-07-21T22:37:39.767 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-07-21T22:37:39.768 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-07-21T22:37:39.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.872+0000 7f0b7b19f640 1 Processor -- start 2023-07-21T22:37:39.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.872+0000 7f0b7b19f640 1 -- start start 2023-07-21T22:37:39.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.876+0000 7f0b7b19f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0b740d2fc0 0x7f0b740b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:39.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.876+0000 7f0b7b19f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b740d2300 0x7f0b740d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:39.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.876+0000 7f0b7b19f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b740b04c0 con 0x7f0b7415bde0 2023-07-21T22:37:39.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.876+0000 7f0b7b19f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b7415c1b0 con 0x7f0b740d2300 2023-07-21T22:37:39.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.876+0000 7f0b7b19f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b740d2c80 con 0x7f0b740d2fc0 2023-07-21T22:37:39.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.876+0000 7f0b7973c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b740d2300 0x7f0b740d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:39.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.876+0000 7f0b7973c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0b740d2300 0x7f0b740d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48604/0 (socket says 172.21.15.6:48604) 2023-07-21T22:37:39.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.876+0000 7f0b7973c640 1 -- 172.21.15.6:0/3850015139 learned_addr learned my addr 172.21.15.6:0/3850015139 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:39.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.876+0000 7f0b73fff640 1 --2- 172.21.15.6:0/3850015139 >> v2:172.21.15.161:3300/0 conn(0x7f0b740d2fc0 0x7f0b740b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:39.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.876+0000 7f0b7973c640 1 -- 172.21.15.6:0/3850015139 >> v2:172.21.15.161:3300/0 conn(0x7f0b740d2fc0 msgr2=0x7f0b740b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:39.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.876+0000 7f0b7973c640 1 --2- 172.21.15.6:0/3850015139 >> v2:172.21.15.161:3300/0 conn(0x7f0b740d2fc0 0x7f0b740b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:39.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.876+0000 7f0b7973c640 1 -- 172.21.15.6:0/3850015139 >> v1:172.21.15.6:6789/0 conn(0x7f0b7415bde0 legacy=0x7f0b740d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:39.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.876+0000 7f0b7973c640 1 -- 172.21.15.6:0/3850015139 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b740d0aa0 con 0x7f0b740d2300 2023-07-21T22:37:39.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.876+0000 7f0b737fe640 1 -- 172.21.15.6:0/3850015139 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503457063 0 0) 0x7f0b740b04c0 con 0x7f0b7415bde0 2023-07-21T22:37:39.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.880+0000 7f0b7973c640 1 --2- 172.21.15.6:0/3850015139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b740d2300 0x7f0b740d2740 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f0b7408c600 tx=0x7f0b6c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5a494311983c1d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:39.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.880+0000 7f0b737fe640 1 -- 172.21.15.6:0/3850015139 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c0a5890 con 0x7f0b740d2300 2023-07-21T22:37:39.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.880+0000 7f0b737fe640 1 -- 172.21.15.6:0/3850015139 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c0a59f0 con 0x7f0b740d2300 2023-07-21T22:37:39.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.880+0000 7f0b737fe640 1 -- 172.21.15.6:0/3850015139 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c0a5d80 con 0x7f0b740d2300 2023-07-21T22:37:39.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.880+0000 7f0b7b19f640 1 -- 172.21.15.6:0/3850015139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b740d2300 msgr2=0x7f0b740d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:39.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.880+0000 7f0b7b19f640 1 --2- 172.21.15.6:0/3850015139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b740d2300 0x7f0b740d2740 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f0b7408c600 tx=0x7f0b6c01c9d0 comp rx=0 tx=0).stop 2023-07-21T22:37:39.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.880+0000 7f0b7b19f640 1 -- 172.21.15.6:0/3850015139 shutdown_connections 2023-07-21T22:37:39.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.880+0000 7f0b7b19f640 1 --2- 172.21.15.6:0/3850015139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b740d2300 0x7f0b740d2740 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:39.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.880+0000 7f0b7b19f640 1 --2- 172.21.15.6:0/3850015139 >> v2:172.21.15.161:3300/0 conn(0x7f0b740d2fc0 0x7f0b740b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:39.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.880+0000 7f0b7b19f640 1 -- 172.21.15.6:0/3850015139 >> 172.21.15.6:0/3850015139 conn(0x7f0b740659d0 msgr2=0x7f0b7409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:39.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.880+0000 7f0b7b19f640 1 -- 172.21.15.6:0/3850015139 shutdown_connections 2023-07-21T22:37:39.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.880+0000 7f0b7b19f640 1 -- 172.21.15.6:0/3850015139 wait complete. 2023-07-21T22:37:39.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.880+0000 7f0b7b19f640 1 Processor -- start 2023-07-21T22:37:39.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.880+0000 7f0b7b19f640 1 -- start start 2023-07-21T22:37:39.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b7b19f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b740d2300 0x7f0b741544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:39.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b7b19f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b740d2fc0 0x7f0b7414e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:39.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b7b19f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b7415bde0 0x7f0b740b6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:39.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b7b19f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b740cc1b0 con 0x7f0b740d2fc0 2023-07-21T22:37:39.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b7b19f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b740c9ee0 con 0x7f0b740d2300 2023-07-21T22:37:39.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b7b19f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b740cb2b0 con 0x7f0b7415bde0 2023-07-21T22:37:39.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b73fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b740d2fc0 0x7f0b7414e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:39.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b73fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b740d2fc0 0x7f0b7414e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48610/0 (socket says 172.21.15.6:48610) 2023-07-21T22:37:39.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b73fff640 1 -- 172.21.15.6:0/1306851444 learned_addr learned my addr 172.21.15.6:0/1306851444 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:37:39.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b78f3b640 1 --2- 172.21.15.6:0/1306851444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b740d2300 0x7f0b741544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:39.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b7973c640 1 --2- 172.21.15.6:0/1306851444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b7415bde0 0x7f0b740b6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:39.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b73fff640 1 -- 172.21.15.6:0/1306851444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b7415bde0 msgr2=0x7f0b740b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:39.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b73fff640 1 --2- 172.21.15.6:0/1306851444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b7415bde0 0x7f0b740b6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:39.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b73fff640 1 -- 172.21.15.6:0/1306851444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b740d2300 msgr2=0x7f0b741544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:39.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b73fff640 1 --2- 172.21.15.6:0/1306851444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b740d2300 0x7f0b741544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:39.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b73fff640 1 -- 172.21.15.6:0/1306851444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c009b30 con 0x7f0b740d2fc0 2023-07-21T22:37:39.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b73fff640 1 --2- 172.21.15.6:0/1306851444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b740d2fc0 0x7f0b7414e590 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000e900 tx=0x7f0b6000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:39.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b717fa640 1 -- 172.21.15.6:0/1306851444 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b60009690 con 0x7f0b740d2fc0 2023-07-21T22:37:39.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b717fa640 1 -- 172.21.15.6:0/1306851444 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6000ca00 con 0x7f0b740d2fc0 2023-07-21T22:37:39.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b717fa640 1 -- 172.21.15.6:0/1306851444 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6000cdb0 con 0x7f0b740d2fc0 2023-07-21T22:37:39.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b7b19f640 1 -- 172.21.15.6:0/1306851444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b740cb530 con 0x7f0b740d2fc0 2023-07-21T22:37:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b7b19f640 1 -- 172.21.15.6:0/1306851444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b740cbaf0 con 0x7f0b740d2fc0 2023-07-21T22:37:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b7b19f640 1 -- 172.21.15.6:0/1306851444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b740678d0 con 0x7f0b740d2fc0 2023-07-21T22:37:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.884+0000 7f0b717fa640 1 -- 172.21.15.6:0/1306851444 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 52) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f0b60013470 con 0x7f0b740d2fc0 2023-07-21T22:37:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.888+0000 7f0b717fa640 1 --2- 172.21.15.6:0/1306851444 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f0b58066120 0x7f0b580685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.888+0000 7f0b717fa640 1 -- 172.21.15.6:0/1306851444 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f0b60083e30 con 0x7f0b740d2fc0 2023-07-21T22:37:39.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.888+0000 7f0b78f3b640 1 --2- 172.21.15.6:0/1306851444 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f0b58066120 0x7f0b580685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:39.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.888+0000 7f0b78f3b640 1 --2- 172.21.15.6:0/1306851444 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f0b58066120 0x7f0b580685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0b7415b400 tx=0x7f0b68009040 comp rx=0 tx=0).ready entity=mgr.8128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:39.892+0000 7f0b717fa640 1 -- 172.21.15.6:0/1306851444 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b60051390 con 0x7f0b740d2fc0 2023-07-21T22:37:40.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:40.068+0000 7f0b7b19f640 1 -- 172.21.15.6:0/1306851444 --> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b740b0150 con 0x7f0b58066120 2023-07-21T22:37:40.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:40.076+0000 7f0b717fa640 1 -- 172.21.15.6:0/1306851444 <== mgr.8128 v2:172.21.15.161:6832/1243154965 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7f0b68001cf0 con 0x7f0b58066120 2023-07-21T22:37:40.121 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:37:40.121 INFO:teuthology.orchestra.run.smithi006.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-07-21T22:37:40.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:40.076+0000 7f0b7b19f640 1 -- 172.21.15.6:0/1306851444 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f0b58066120 msgr2=0x7f0b580685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:40.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:40.076+0000 7f0b7b19f640 1 --2- 172.21.15.6:0/1306851444 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f0b58066120 0x7f0b580685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0b7415b400 tx=0x7f0b68009040 comp rx=0 tx=0).stop 2023-07-21T22:37:40.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:40.076+0000 7f0b7b19f640 1 -- 172.21.15.6:0/1306851444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b740d2fc0 msgr2=0x7f0b7414e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:40.076+0000 7f0b7b19f640 1 --2- 172.21.15.6:0/1306851444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b740d2fc0 0x7f0b7414e590 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000e900 tx=0x7f0b6000edc0 comp rx=0 tx=0).stop 2023-07-21T22:37:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:40.076+0000 7f0b7b19f640 1 -- 172.21.15.6:0/1306851444 shutdown_connections 2023-07-21T22:37:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:40.076+0000 7f0b7b19f640 1 --2- 172.21.15.6:0/1306851444 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f0b58066120 0x7f0b580685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:40.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:40.076+0000 7f0b7b19f640 1 --2- 172.21.15.6:0/1306851444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b7415bde0 0x7f0b740b6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:40.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:40.076+0000 7f0b7b19f640 1 --2- 172.21.15.6:0/1306851444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b740d2fc0 0x7f0b7414e590 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:40.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:40.076+0000 7f0b7b19f640 1 --2- 172.21.15.6:0/1306851444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b740d2300 0x7f0b741544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:40.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:40.076+0000 7f0b7b19f640 1 -- 172.21.15.6:0/1306851444 >> 172.21.15.6:0/1306851444 conn(0x7f0b740659d0 msgr2=0x7f0b7415a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:40.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:40.076+0000 7f0b7b19f640 1 -- 172.21.15.6:0/1306851444 shutdown_connections 2023-07-21T22:37:40.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:37:40.076+0000 7f0b7b19f640 1 -- 172.21.15.6:0/1306851444 wait complete. 2023-07-21T22:37:40.142 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-07-21T22:37:40.143 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{}]} 2023-07-21T22:37:40.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:40.144 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:37:40.156 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:37:40.157 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:37:40.158 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:37:41.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:41.159 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:37:41.171 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:37:41.171 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:37:41.171 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:37:42.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:42.172 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:37:42.184 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:37:42.185 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:37:42.185 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:37:43.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:43.187 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:37:43.199 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:37:43.199 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:37:43.199 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:37:43.840 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:37:43.844 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:37:44.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:44.200 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:37:44.213 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:37:44.213 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:37:44.213 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:37:45.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:45.215 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:37:45.227 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:37:45.227 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:37:45.228 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:37:46.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:46.229 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:37:46.241 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:37:46.242 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:37:46.242 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:37:47.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:47.243 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:37:47.256 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:37:47.256 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:37:47.256 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:37:48.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:48.258 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:37:48.270 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:37:48.270 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:37:48.270 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:37:49.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:49.272 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:37:49.284 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:37:49.285 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:37:49.285 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:37:50.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:50.287 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:37:50.299 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:37:50.300 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:37:50.300 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:37:51.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:51.302 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:37:51.314 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:37:51.314 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:37:51.315 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:37:52.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:52.316 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:37:52.328 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:37:52.329 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:37:52.329 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:37:53.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:53.330 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:37:53.342 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:37:53.343 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:37:53.343 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:37:54.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:54.344 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:37:54.356 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:37:54.357 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:37:54.357 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:37:55.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:55.359 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:37:55.371 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:37:55.371 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:37:55.371 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:37:56.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:56.373 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:37:56.385 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:37:56.386 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:37:56.386 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:37:57.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:57.387 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:37:57.399 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:37:57.400 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:37:57.400 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:37:58.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:58.401 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:37:58.413 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:37:58.414 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:37:58.415 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:37:59.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:37:59.416 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:37:59.429 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:37:59.430 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:37:59.430 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:38:00.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:38:00.432 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:38:00.443 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:38:00.443 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:38:00.444 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:38:00.756 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:00.712+0000 7f37fd4bc640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:00.756 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:00.712+0000 7f37fd4bc640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:00.756 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:00.712+0000 7f37fd4bc640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:00.756 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:00.712+0000 7f37fd4bc640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:00.757 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:00.712+0000 7f37fd4bc640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:01.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:38:01.445 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:38:01.457 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_38_00_UTC 2023-07-21T22:38:01.459 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_38_00_UTC'} 2023-07-21T22:38:01.459 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-21-22_38_00_UTC'} 2023-07-21T22:38:01.460 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:38:01.460 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-07-21-22_38_00_UTC'] 2023-07-21T22:38:01.461 DEBUG:tasks.cephfs.test_snap_schedules:exec=1689979059.7675574, now = 1689979081.461199, timo = 21 2023-07-21T22:38:02.462 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-21T22:38:02.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.576+0000 7f2be25fa640 1 Processor -- start 2023-07-21T22:38:02.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.576+0000 7f2be25fa640 1 -- start start 2023-07-21T22:38:02.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.576+0000 7f2be25fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2bdc15bde0 0x7f2bdc0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:02.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.576+0000 7f2be25fa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2bdc0d2fc0 0x7f2bdc0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:02.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.576+0000 7f2be25fa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bdc0b04c0 con 0x7f2bdc0d2300 2023-07-21T22:38:02.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.576+0000 7f2be25fa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bdc15c1b0 con 0x7f2bdc0d2fc0 2023-07-21T22:38:02.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.576+0000 7f2be25fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0d0aa0 con 0x7f2bdc15bde0 2023-07-21T22:38:02.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.576+0000 7f2be0b97640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2bdc0d2300 0x7f2bdc0cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51150/0 (socket says 172.21.15.6:51150) 2023-07-21T22:38:02.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.576+0000 7f2be0b97640 1 -- 172.21.15.6:0/1524328986 learned_addr learned my addr 172.21.15.6:0/1524328986 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:02.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.576+0000 7f2bdb7fe640 1 --2- 172.21.15.6:0/1524328986 >> v2:172.21.15.161:3300/0 conn(0x7f2bdc0d2fc0 0x7f2bdc0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:02.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.576+0000 7f2bdbfff640 1 --2- 172.21.15.6:0/1524328986 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2bdc15bde0 0x7f2bdc0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:02.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.580+0000 7f2bdaffd640 1 -- 172.21.15.6:0/1524328986 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964265508 0 0) 0x7f2bdc0b04c0 con 0x7f2bdc0d2300 2023-07-21T22:38:02.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.580+0000 7f2bdaffd640 1 -- 172.21.15.6:0/1524328986 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bc4003530 con 0x7f2bdc0d2300 2023-07-21T22:38:02.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.580+0000 7f2bdb7fe640 1 -- 172.21.15.6:0/1524328986 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2bdc15bde0 msgr2=0x7f2bdc0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:02.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.580+0000 7f2bdb7fe640 1 --2- 172.21.15.6:0/1524328986 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2bdc15bde0 0x7f2bdc0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:02.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.580+0000 7f2bdb7fe640 1 -- 172.21.15.6:0/1524328986 >> v1:172.21.15.6:6789/0 conn(0x7f2bdc0d2300 legacy=0x7f2bdc0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:02.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.580+0000 7f2bdaffd640 1 -- 172.21.15.6:0/1524328986 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2585455156 0 0) 0x7f2bc4003530 con 0x7f2bdc0d2300 2023-07-21T22:38:02.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.580+0000 7f2bdb7fe640 1 -- 172.21.15.6:0/1524328986 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bdc0afb90 con 0x7f2bdc0d2fc0 2023-07-21T22:38:02.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.580+0000 7f2bdb7fe640 1 --2- 172.21.15.6:0/1524328986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bdc0d2fc0 0x7f2bdc0b0950 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00097c0 tx=0x7f2bd001c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5bf6e4b7ec94bf1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:02.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.580+0000 7f2bdaffd640 1 -- 172.21.15.6:0/1524328986 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4001a00 con 0x7f2bdc0d2fc0 2023-07-21T22:38:02.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.580+0000 7f2bdaffd640 1 -- 172.21.15.6:0/1524328986 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd00a7050 con 0x7f2bdc0d2fc0 2023-07-21T22:38:02.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.580+0000 7f2bdaffd640 1 -- 172.21.15.6:0/1524328986 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd00ab620 con 0x7f2bdc0d2fc0 2023-07-21T22:38:02.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2be25fa640 1 -- 172.21.15.6:0/1524328986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bdc0d2fc0 msgr2=0x7f2bdc0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:02.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2be25fa640 1 --2- 172.21.15.6:0/1524328986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bdc0d2fc0 0x7f2bdc0b0950 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00097c0 tx=0x7f2bd001c3a0 comp rx=0 tx=0).stop 2023-07-21T22:38:02.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2be25fa640 1 -- 172.21.15.6:0/1524328986 shutdown_connections 2023-07-21T22:38:02.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2be25fa640 1 --2- 172.21.15.6:0/1524328986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bdc0d2fc0 0x7f2bdc0b0950 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:02.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2be25fa640 1 --2- 172.21.15.6:0/1524328986 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2bdc15bde0 0x7f2bdc0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:02.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2be25fa640 1 -- 172.21.15.6:0/1524328986 >> 172.21.15.6:0/1524328986 conn(0x7f2bdc0659d0 msgr2=0x7f2bdc09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:02.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2be25fa640 1 -- 172.21.15.6:0/1524328986 shutdown_connections 2023-07-21T22:38:02.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2be25fa640 1 -- 172.21.15.6:0/1524328986 wait complete. 2023-07-21T22:38:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2be25fa640 1 Processor -- start 2023-07-21T22:38:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2be25fa640 1 -- start start 2023-07-21T22:38:02.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2be25fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bdc0d2300 0x7f2bdc147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:02.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2be25fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bdc0d2fc0 0x7f2bdc15c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:02.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2be25fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2bdc15bde0 0x7f2bdc15df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:02.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2be25fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0c62e0 con 0x7f2bdc0d2300 2023-07-21T22:38:02.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2be25fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc0c65c0 con 0x7f2bdc0d2fc0 2023-07-21T22:38:02.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2be25fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc1528a0 con 0x7f2bdc15bde0 2023-07-21T22:38:02.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2bdbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bdc0d2300 0x7f2bdc147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:02.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2bdbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bdc0d2300 0x7f2bdc147590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35156/0 (socket says 172.21.15.6:35156) 2023-07-21T22:38:02.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2bdbfff640 1 -- 172.21.15.6:0/1531110099 learned_addr learned my addr 172.21.15.6:0/1531110099 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2be0b97640 1 --2- 172.21.15.6:0/1531110099 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2bdc15bde0 0x7f2bdc15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2bdb7fe640 1 --2- 172.21.15.6:0/1531110099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bdc0d2fc0 0x7f2bdc15c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2bdbfff640 1 -- 172.21.15.6:0/1531110099 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2bdc15bde0 msgr2=0x7f2bdc15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2bdbfff640 1 --2- 172.21.15.6:0/1531110099 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2bdc15bde0 0x7f2bdc15df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2bdbfff640 1 -- 172.21.15.6:0/1531110099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bdc0d2fc0 msgr2=0x7f2bdc15c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2bdbfff640 1 --2- 172.21.15.6:0/1531110099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bdc0d2fc0 0x7f2bdc15c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2bdbfff640 1 -- 172.21.15.6:0/1531110099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd0009420 con 0x7f2bdc0d2300 2023-07-21T22:38:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.584+0000 7f2bdb7fe640 1 --2- 172.21.15.6:0/1531110099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bdc0d2fc0 0x7f2bdc15c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.588+0000 7f2bdbfff640 1 --2- 172.21.15.6:0/1531110099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bdc0d2300 0x7f2bdc147590 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00e9b0 tx=0x7f2bcc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.588+0000 7f2bd8ff9640 1 -- 172.21.15.6:0/1531110099 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc009670 con 0x7f2bdc0d2300 2023-07-21T22:38:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.588+0000 7f2bd8ff9640 1 -- 172.21.15.6:0/1531110099 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc00c9a0 con 0x7f2bdc0d2300 2023-07-21T22:38:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.588+0000 7f2bd8ff9640 1 -- 172.21.15.6:0/1531110099 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc00cd10 con 0x7f2bdc0d2300 2023-07-21T22:38:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.588+0000 7f2be25fa640 1 -- 172.21.15.6:0/1531110099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bdc15ee10 con 0x7f2bdc0d2300 2023-07-21T22:38:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.588+0000 7f2be25fa640 1 -- 172.21.15.6:0/1531110099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bdc15f3d0 con 0x7f2bdc0d2300 2023-07-21T22:38:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.588+0000 7f2be25fa640 1 -- 172.21.15.6:0/1531110099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bdc0678d0 con 0x7f2bdc0d2300 2023-07-21T22:38:02.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.588+0000 7f2bd8ff9640 1 -- 172.21.15.6:0/1531110099 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 53) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f2bcc013470 con 0x7f2bdc0d2300 2023-07-21T22:38:02.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.588+0000 7f2bd8ff9640 1 --2- 172.21.15.6:0/1531110099 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f2bc8066480 0x7f2bc8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:02.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.588+0000 7f2bd8ff9640 1 -- 172.21.15.6:0/1531110099 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f2bcc084940 con 0x7f2bdc0d2300 2023-07-21T22:38:02.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.588+0000 7f2bdb7fe640 1 --2- 172.21.15.6:0/1531110099 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f2bc8066480 0x7f2bc8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:02.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.592+0000 7f2bdb7fe640 1 --2- 172.21.15.6:0/1531110099 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f2bc8066480 0x7f2bc8068930 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00ad000 tx=0x7f2bd0008040 comp rx=0 tx=0).ready entity=mgr.8128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.592+0000 7f2bd8ff9640 1 -- 172.21.15.6:0/1531110099 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2bcc051910 con 0x7f2bdc0d2300 2023-07-21T22:38:02.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.768+0000 7f2be25fa640 1 -- 172.21.15.6:0/1531110099 --> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bdc0d2bb0 con 0x7f2bc8066480 2023-07-21T22:38:02.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.836+0000 7f2bd8ff9640 1 -- 172.21.15.6:0/1531110099 <== mgr.8128 v2:172.21.15.161:6832/1243154965 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f2bd00ab5a0 con 0x7f2bc8066480 2023-07-21T22:38:02.882 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule removed for path snap_test_dir1 2023-07-21T22:38:02.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.836+0000 7f2be25fa640 1 -- 172.21.15.6:0/1531110099 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f2bc8066480 msgr2=0x7f2bc8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:02.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.836+0000 7f2be25fa640 1 --2- 172.21.15.6:0/1531110099 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f2bc8066480 0x7f2bc8068930 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00ad000 tx=0x7f2bd0008040 comp rx=0 tx=0).stop 2023-07-21T22:38:02.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.836+0000 7f2be25fa640 1 -- 172.21.15.6:0/1531110099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bdc0d2300 msgr2=0x7f2bdc147590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:02.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.836+0000 7f2be25fa640 1 --2- 172.21.15.6:0/1531110099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bdc0d2300 0x7f2bdc147590 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00e9b0 tx=0x7f2bcc00ee70 comp rx=0 tx=0).stop 2023-07-21T22:38:02.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.840+0000 7f2be25fa640 1 -- 172.21.15.6:0/1531110099 shutdown_connections 2023-07-21T22:38:02.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.840+0000 7f2be25fa640 1 --2- 172.21.15.6:0/1531110099 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f2bc8066480 0x7f2bc8068930 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:02.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.840+0000 7f2be25fa640 1 --2- 172.21.15.6:0/1531110099 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2bdc15bde0 0x7f2bdc15df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:02.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.840+0000 7f2be25fa640 1 --2- 172.21.15.6:0/1531110099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bdc0d2fc0 0x7f2bdc15c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:02.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.840+0000 7f2be25fa640 1 --2- 172.21.15.6:0/1531110099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bdc0d2300 0x7f2bdc147590 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:02.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.840+0000 7f2be25fa640 1 -- 172.21.15.6:0/1531110099 >> 172.21.15.6:0/1531110099 conn(0x7f2bdc0659d0 msgr2=0x7f2bdc06afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:02.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.840+0000 7f2be25fa640 1 -- 172.21.15.6:0/1531110099 shutdown_connections 2023-07-21T22:38:02.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:02.840+0000 7f2be25fa640 1 -- 172.21.15.6:0/1531110099 wait complete. 2023-07-21T22:38:02.903 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-21T22:38:02.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:38:02.904 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:38:02.913 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_38_00_UTC 2023-07-21T22:38:02.914 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-21-22_38_00_UTC 2023-07-21T22:38:02.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:38:02.915 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-21-22_38_00_UTC) 2023-07-21T22:38:02.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:38:02.971 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-21T22:38:03.023 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-21T22:38:03.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.168+0000 7f61d81fa640 1 Processor -- start 2023-07-21T22:38:03.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.168+0000 7f61d81fa640 1 -- start start 2023-07-21T22:38:03.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.168+0000 7f61d81fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61d0164340 0x7f61d00cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:03.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.168+0000 7f61d81fa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f61d006cf80 0x7f61d00c0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:03.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.168+0000 7f61d81fa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d006d420 con 0x7f61d01600b0 2023-07-21T22:38:03.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.168+0000 7f61d81fa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d00c89f0 con 0x7f61d006cf80 2023-07-21T22:38:03.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.168+0000 7f61d81fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00cbe50 con 0x7f61d0164340 2023-07-21T22:38:03.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.168+0000 7f61d6797640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f61d006cf80 0x7f61d00c0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:03.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.168+0000 7f61d6797640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f61d006cf80 0x7f61d00c0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35164/0 (socket says 172.21.15.6:35164) 2023-07-21T22:38:03.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.168+0000 7f61d6797640 1 -- 172.21.15.6:0/1200492227 learned_addr learned my addr 172.21.15.6:0/1200492227 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:03.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.168+0000 7f61d5f96640 1 --1- 172.21.15.6:0/1200492227 >> v1:172.21.15.6:6789/0 conn(0x7f61d01600b0 0x7f61d0163c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51158/0 (socket says 172.21.15.6:51158) 2023-07-21T22:38:03.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.168+0000 7f61d5795640 1 --2- 172.21.15.6:0/1200492227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61d0164340 0x7f61d00cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:03.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.172+0000 7f61d6797640 1 -- 172.21.15.6:0/1200492227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61d0164340 msgr2=0x7f61d00cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:03.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.172+0000 7f61d6797640 1 --2- 172.21.15.6:0/1200492227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61d0164340 0x7f61d00cd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:03.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.172+0000 7f61d6797640 1 -- 172.21.15.6:0/1200492227 >> v1:172.21.15.6:6789/0 conn(0x7f61d01600b0 legacy=0x7f61d0163c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:03.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.172+0000 7f61d6797640 1 -- 172.21.15.6:0/1200492227 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d00cc9d0 con 0x7f61d006cf80 2023-07-21T22:38:03.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.172+0000 7f61d5795640 1 --2- 172.21.15.6:0/1200492227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61d0164340 0x7f61d00cd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:03.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.172+0000 7f61d4f94640 1 -- 172.21.15.6:0/1200492227 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234858009 0 0) 0x7f61cc001120 con 0x7f61d01600b0 2023-07-21T22:38:03.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.172+0000 7f61d6797640 1 --2- 172.21.15.6:0/1200492227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61d006cf80 0x7f61d00c0b50 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009e50 tx=0x7f61c801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa15e03d7c3fa80 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:03.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.172+0000 7f61d4f94640 1 -- 172.21.15.6:0/1200492227 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c80a55e0 con 0x7f61d006cf80 2023-07-21T22:38:03.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.172+0000 7f61d4f94640 1 -- 172.21.15.6:0/1200492227 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c80a5740 con 0x7f61d006cf80 2023-07-21T22:38:03.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.172+0000 7f61d4f94640 1 -- 172.21.15.6:0/1200492227 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c80a5ad0 con 0x7f61d006cf80 2023-07-21T22:38:03.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.172+0000 7f61d81fa640 1 -- 172.21.15.6:0/1200492227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61d006cf80 msgr2=0x7f61d00c0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:03.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.172+0000 7f61d81fa640 1 --2- 172.21.15.6:0/1200492227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61d006cf80 0x7f61d00c0b50 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009e50 tx=0x7f61c801c830 comp rx=0 tx=0).stop 2023-07-21T22:38:03.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.172+0000 7f61d81fa640 1 -- 172.21.15.6:0/1200492227 shutdown_connections 2023-07-21T22:38:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.172+0000 7f61d81fa640 1 --2- 172.21.15.6:0/1200492227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61d006cf80 0x7f61d00c0b50 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.172+0000 7f61d81fa640 1 --2- 172.21.15.6:0/1200492227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61d0164340 0x7f61d00cd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.172+0000 7f61d81fa640 1 -- 172.21.15.6:0/1200492227 >> 172.21.15.6:0/1200492227 conn(0x7f61d00afac0 msgr2=0x7f61d00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:03.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d81fa640 1 -- 172.21.15.6:0/1200492227 shutdown_connections 2023-07-21T22:38:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d81fa640 1 -- 172.21.15.6:0/1200492227 wait complete. 2023-07-21T22:38:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d81fa640 1 Processor -- start 2023-07-21T22:38:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d81fa640 1 -- start start 2023-07-21T22:38:03.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d81fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61d006cf80 0x7f61d00c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d81fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61d01600b0 0x7f61d00c5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d81fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61d0164340 0x7f61d0154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:03.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d81fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00b3090 con 0x7f61d0164340 2023-07-21T22:38:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d81fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00b2480 con 0x7f61d006cf80 2023-07-21T22:38:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d81fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00b2760 con 0x7f61d01600b0 2023-07-21T22:38:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d6797640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61d0164340 0x7f61d0154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:03.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d6797640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61d0164340 0x7f61d0154ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35174/0 (socket says 172.21.15.6:35174) 2023-07-21T22:38:03.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d6797640 1 -- 172.21.15.6:0/2117204926 learned_addr learned my addr 172.21.15.6:0/2117204926 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:03.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d5f96640 1 --2- 172.21.15.6:0/2117204926 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61d006cf80 0x7f61d00c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:03.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d5795640 1 --2- 172.21.15.6:0/2117204926 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61d01600b0 0x7f61d00c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:03.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d6797640 1 -- 172.21.15.6:0/2117204926 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61d01600b0 msgr2=0x7f61d00c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:03.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d6797640 1 --2- 172.21.15.6:0/2117204926 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61d01600b0 0x7f61d00c5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:03.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d6797640 1 -- 172.21.15.6:0/2117204926 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61d006cf80 msgr2=0x7f61d00c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:03.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d6797640 1 --2- 172.21.15.6:0/2117204926 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61d006cf80 0x7f61d00c2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:03.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d6797640 1 -- 172.21.15.6:0/2117204926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c8009b30 con 0x7f61d0164340 2023-07-21T22:38:03.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d5795640 1 --2- 172.21.15.6:0/2117204926 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61d01600b0 0x7f61d00c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:03.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d5f96640 1 --2- 172.21.15.6:0/2117204926 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61d006cf80 0x7f61d00c2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:03.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61d6797640 1 --2- 172.21.15.6:0/2117204926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61d0164340 0x7f61d0154ce0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f61c801a460 tx=0x7f61c80195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:03.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.176+0000 7f61c67fc640 1 -- 172.21.15.6:0/2117204926 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c80b8670 con 0x7f61d0164340 2023-07-21T22:38:03.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.180+0000 7f61c67fc640 1 -- 172.21.15.6:0/2117204926 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c80b87d0 con 0x7f61d0164340 2023-07-21T22:38:03.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.180+0000 7f61c67fc640 1 -- 172.21.15.6:0/2117204926 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c80b8b80 con 0x7f61d0164340 2023-07-21T22:38:03.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.180+0000 7f61d81fa640 1 -- 172.21.15.6:0/2117204926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d00b2a40 con 0x7f61d0164340 2023-07-21T22:38:03.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.180+0000 7f61d81fa640 1 -- 172.21.15.6:0/2117204926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d00c31c0 con 0x7f61d0164340 2023-07-21T22:38:03.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.180+0000 7f61d81fa640 1 -- 172.21.15.6:0/2117204926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d00c3350 con 0x7f61d0164340 2023-07-21T22:38:03.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.180+0000 7f61c67fc640 1 -- 172.21.15.6:0/2117204926 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 54) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f61c80b8ce0 con 0x7f61d0164340 2023-07-21T22:38:03.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.180+0000 7f61c67fc640 1 --2- 172.21.15.6:0/2117204926 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f61b4066510 0x7f61b40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:03.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.180+0000 7f61c67fc640 1 -- 172.21.15.6:0/2117204926 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f61c811f7e0 con 0x7f61d0164340 2023-07-21T22:38:03.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.180+0000 7f61d5f96640 1 --2- 172.21.15.6:0/2117204926 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f61b4066510 0x7f61b40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:03.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.180+0000 7f61d5f96640 1 --2- 172.21.15.6:0/2117204926 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f61b4066510 0x7f61b40689c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f61cc007fd0 tx=0x7f61cc009040 comp rx=0 tx=0).ready entity=mgr.8128 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:03.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.184+0000 7f61c67fc640 1 -- 172.21.15.6:0/2117204926 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f61c80ec810 con 0x7f61d0164340 2023-07-21T22:38:03.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.380+0000 7f61d81fa640 1 -- 172.21.15.6:0/2117204926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f61d00713a0 con 0x7f61d0164340 2023-07-21T22:38:03.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.948+0000 7f61c67fc640 1 -- 172.21.15.6:0/2117204926 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 55) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f61c80ecbe0 con 0x7f61d0164340 2023-07-21T22:38:03.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.952+0000 7f61c67fc640 1 -- 172.21.15.6:0/2117204926 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v55) v1 ==== 93+0+0 (secure 0 0 0) 0x7f61c80ec810 con 0x7f61d0164340 2023-07-21T22:38:04.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.952+0000 7f61d81fa640 1 -- 172.21.15.6:0/2117204926 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f61b4066510 msgr2=0x7f61b40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:04.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.952+0000 7f61d81fa640 1 --2- 172.21.15.6:0/2117204926 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f61b4066510 0x7f61b40689c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f61cc007fd0 tx=0x7f61cc009040 comp rx=0 tx=0).stop 2023-07-21T22:38:04.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.952+0000 7f61d81fa640 1 -- 172.21.15.6:0/2117204926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61d0164340 msgr2=0x7f61d0154ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:04.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.952+0000 7f61d81fa640 1 --2- 172.21.15.6:0/2117204926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61d0164340 0x7f61d0154ce0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f61c801a460 tx=0x7f61c80195d0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.952+0000 7f61d81fa640 1 -- 172.21.15.6:0/2117204926 shutdown_connections 2023-07-21T22:38:04.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.952+0000 7f61d81fa640 1 --2- 172.21.15.6:0/2117204926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61d0164340 0x7f61d0154ce0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.952+0000 7f61d81fa640 1 --2- 172.21.15.6:0/2117204926 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f61b4066510 0x7f61b40689c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.952+0000 7f61d81fa640 1 --2- 172.21.15.6:0/2117204926 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61d01600b0 0x7f61d00c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.952+0000 7f61d81fa640 1 --2- 172.21.15.6:0/2117204926 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61d006cf80 0x7f61d00c2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.952+0000 7f61d81fa640 1 -- 172.21.15.6:0/2117204926 >> 172.21.15.6:0/2117204926 conn(0x7f61d00afac0 msgr2=0x7f61d015b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:04.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.952+0000 7f61d81fa640 1 -- 172.21.15.6:0/2117204926 shutdown_connections 2023-07-21T22:38:04.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:03.956+0000 7f61d81fa640 1 -- 172.21.15.6:0/2117204926 wait complete. 2023-07-21T22:38:04.023 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:38:04.024 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:38:04.087 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:38:04.144 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:38:04.144 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:38:04.145 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:38:04.155 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:38:04.155 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:38:04.179 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:04.136+0000 7f39bf246180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:38:04.182 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:04.136+0000 7f1bd4455180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:38:04.192 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:38:04.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.340+0000 7ff422137640 1 Processor -- start 2023-07-21T22:38:04.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.340+0000 7ff422137640 1 -- start start 2023-07-21T22:38:04.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.340+0000 7ff422137640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff41c0b7c70 0x7ff41c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:04.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.340+0000 7ff422137640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff41c0d1850 0x7ff41c15f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:04.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.340+0000 7ff422137640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff41c0d1300 0x7ff41c15fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:04.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.340+0000 7ff422137640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41c0d1190 con 0x7ff41c0d1850 2023-07-21T22:38:04.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.340+0000 7ff422137640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41c160600 con 0x7ff41c0d1300 2023-07-21T22:38:04.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.340+0000 7ff422137640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c1600d0 con 0x7ff41c0b7c70 2023-07-21T22:38:04.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.340+0000 7ff41affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff41c0d1850 0x7ff41c15f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:04.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.340+0000 7ff41affd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff41c0d1850 0x7ff41c15f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35194/0 (socket says 172.21.15.6:35194) 2023-07-21T22:38:04.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.340+0000 7ff41affd640 1 -- 172.21.15.6:0/3320867945 learned_addr learned my addr 172.21.15.6:0/3320867945 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:04.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.340+0000 7ff41bfff640 1 --2- 172.21.15.6:0/3320867945 >> v2:172.21.15.161:3300/0 conn(0x7ff41c0d1300 0x7ff41c15fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:04.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.340+0000 7ff41b7fe640 1 --2- 172.21.15.6:0/3320867945 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff41c0b7c70 0x7ff41c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:04.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.340+0000 7ff41affd640 1 -- 172.21.15.6:0/3320867945 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff41c0b7c70 msgr2=0x7ff41c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:04.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.340+0000 7ff41affd640 1 --2- 172.21.15.6:0/3320867945 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff41c0b7c70 0x7ff41c0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.340+0000 7ff41affd640 1 -- 172.21.15.6:0/3320867945 >> v2:172.21.15.161:3300/0 conn(0x7ff41c0d1300 msgr2=0x7ff41c15fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:04.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.340+0000 7ff41affd640 1 --2- 172.21.15.6:0/3320867945 >> v2:172.21.15.161:3300/0 conn(0x7ff41c0d1300 0x7ff41c15fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.340+0000 7ff41affd640 1 -- 172.21.15.6:0/3320867945 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c0ccaf0 con 0x7ff41c0d1850 2023-07-21T22:38:04.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.344+0000 7ff41affd640 1 --2- 172.21.15.6:0/3320867945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff41c0d1850 0x7ff41c15f650 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7ff41c069e40 tx=0x7ff41001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d5da6b32973436 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:04.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.344+0000 7ff41a7fc640 1 -- 172.21.15.6:0/3320867945 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4100ac600 con 0x7ff41c0d1850 2023-07-21T22:38:04.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.344+0000 7ff41a7fc640 1 -- 172.21.15.6:0/3320867945 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4100a8050 con 0x7ff41c0d1850 2023-07-21T22:38:04.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.344+0000 7ff41a7fc640 1 -- 172.21.15.6:0/3320867945 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4100ac980 con 0x7ff41c0d1850 2023-07-21T22:38:04.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.344+0000 7ff422137640 1 -- 172.21.15.6:0/3320867945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff41c0d1850 msgr2=0x7ff41c15f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:04.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.344+0000 7ff422137640 1 --2- 172.21.15.6:0/3320867945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff41c0d1850 0x7ff41c15f650 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7ff41c069e40 tx=0x7ff41001c4d0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.344+0000 7ff422137640 1 -- 172.21.15.6:0/3320867945 shutdown_connections 2023-07-21T22:38:04.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.344+0000 7ff422137640 1 --2- 172.21.15.6:0/3320867945 >> v2:172.21.15.161:3300/0 conn(0x7ff41c0d1300 0x7ff41c15fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.344+0000 7ff422137640 1 --2- 172.21.15.6:0/3320867945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff41c0d1850 0x7ff41c15f650 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.344+0000 7ff422137640 1 --2- 172.21.15.6:0/3320867945 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff41c0b7c70 0x7ff41c0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.344+0000 7ff422137640 1 -- 172.21.15.6:0/3320867945 >> 172.21.15.6:0/3320867945 conn(0x7ff41c0650b0 msgr2=0x7ff41c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:04.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.344+0000 7ff422137640 1 -- 172.21.15.6:0/3320867945 shutdown_connections 2023-07-21T22:38:04.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.344+0000 7ff422137640 1 -- 172.21.15.6:0/3320867945 wait complete. 2023-07-21T22:38:04.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff422137640 1 Processor -- start 2023-07-21T22:38:04.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff422137640 1 -- start start 2023-07-21T22:38:04.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff422137640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff41c0b7c70 0x7ff41c155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:04.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff422137640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff41c0d1300 0x7ff41c154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:04.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff422137640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff41c0d1850 0x7ff41c15c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff422137640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c0ca7f0 con 0x7ff41c0b7c70 2023-07-21T22:38:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff422137640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c0caa90 con 0x7ff41c0d1850 2023-07-21T22:38:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff422137640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41c0cad70 con 0x7ff41c0d1300 2023-07-21T22:38:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff41b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff41c0b7c70 0x7ff41c155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff41b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff41c0b7c70 0x7ff41c155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35198/0 (socket says 172.21.15.6:35198) 2023-07-21T22:38:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff41b7fe640 1 -- 172.21.15.6:0/3133603264 learned_addr learned my addr 172.21.15.6:0/3133603264 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff41affd640 1 --2- 172.21.15.6:0/3133603264 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff41c0d1300 0x7ff41c154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:04.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff41bfff640 1 --2- 172.21.15.6:0/3133603264 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff41c0d1850 0x7ff41c15c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:04.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff41affd640 1 -- 172.21.15.6:0/3133603264 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff41c0d1850 msgr2=0x7ff41c15c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:04.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff41affd640 1 --2- 172.21.15.6:0/3133603264 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff41c0d1850 0x7ff41c15c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff41affd640 1 -- 172.21.15.6:0/3133603264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff41c0b7c70 msgr2=0x7ff41c155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:04.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff41affd640 1 --2- 172.21.15.6:0/3133603264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff41c0b7c70 0x7ff41c155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff41affd640 1 -- 172.21.15.6:0/3133603264 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4100094d0 con 0x7ff41c0d1300 2023-07-21T22:38:04.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff41affd640 1 --2- 172.21.15.6:0/3133603264 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff41c0d1300 0x7ff41c154b30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff4100ac000 tx=0x7ff41001ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:04.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff403fff640 1 -- 172.21.15.6:0/3133603264 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4100b7450 con 0x7ff41c0d1300 2023-07-21T22:38:04.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff403fff640 1 -- 172.21.15.6:0/3133603264 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4100b75d0 con 0x7ff41c0d1300 2023-07-21T22:38:04.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff403fff640 1 -- 172.21.15.6:0/3133603264 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4100b7980 con 0x7ff41c0d1300 2023-07-21T22:38:04.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff422137640 1 -- 172.21.15.6:0/3133603264 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41c0cb050 con 0x7ff41c0d1300 2023-07-21T22:38:04.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.348+0000 7ff422137640 1 -- 172.21.15.6:0/3133603264 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41c0cb610 con 0x7ff41c0d1300 2023-07-21T22:38:04.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.352+0000 7ff422137640 1 -- 172.21.15.6:0/3133603264 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41c0cb800 con 0x7ff41c0d1300 2023-07-21T22:38:04.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.352+0000 7ff403fff640 1 -- 172.21.15.6:0/3133603264 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 55) v1 ==== 85874+0+0 (secure 0 0 0) 0x7ff4100b3070 con 0x7ff41c0d1300 2023-07-21T22:38:04.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.352+0000 7ff403fff640 1 --2- 172.21.15.6:0/3133603264 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7ff4080664c0 0x7ff408068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:04.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.352+0000 7ff403fff640 1 -- 172.21.15.6:0/3133603264 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6450+0+0 (secure 0 0 0) 0x7ff41011e650 con 0x7ff41c0d1300 2023-07-21T22:38:04.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.352+0000 7ff41b7fe640 1 -- 172.21.15.6:0/3133603264 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7ff4080664c0 msgr2=0x7ff408068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1243154965 2023-07-21T22:38:04.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.352+0000 7ff41b7fe640 1 --2- 172.21.15.6:0/3133603264 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7ff4080664c0 0x7ff408068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:04.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.356+0000 7ff403fff640 1 -- 172.21.15.6:0/3133603264 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff4100eb640 con 0x7ff41c0d1300 2023-07-21T22:38:04.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.516+0000 7ff422137640 1 -- 172.21.15.6:0/3133603264 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff41c0678d0 con 0x7ff41c0d1300 2023-07-21T22:38:04.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.516+0000 7ff403fff640 1 -- 172.21.15.6:0/3133603264 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+18800 (secure 0 0 0) 0x7ff4100eec60 con 0x7ff41c0d1300 2023-07-21T22:38:04.562 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:04.562 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":129,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:37:38.611669+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:37:19.569960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-21T22:37:20.452035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/2022618322":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/2545996454":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/1765632394":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/3061870707":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/3531274071":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/3831746843":"2023-07-22T22:37:38.611638+0000","172.21.15.161:6833/1868466946":"2023-07-22T22:37:38.611638+0000","172.21.15.161:6832/1868466946":"2023-07-22T22:37:38.611638+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:38:04.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.516+0000 7ff422137640 1 -- 172.21.15.6:0/3133603264 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7ff4080664c0 msgr2=0x7ff408068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:04.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.516+0000 7ff422137640 1 --2- 172.21.15.6:0/3133603264 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7ff4080664c0 0x7ff408068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.516+0000 7ff422137640 1 -- 172.21.15.6:0/3133603264 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff41c0d1300 msgr2=0x7ff41c154b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:04.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.516+0000 7ff422137640 1 --2- 172.21.15.6:0/3133603264 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff41c0d1300 0x7ff41c154b30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff4100ac000 tx=0x7ff41001ad10 comp rx=0 tx=0).stop 2023-07-21T22:38:04.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.516+0000 7ff422137640 1 -- 172.21.15.6:0/3133603264 shutdown_connections 2023-07-21T22:38:04.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.516+0000 7ff422137640 1 --2- 172.21.15.6:0/3133603264 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff41c0d1850 0x7ff41c15c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.516+0000 7ff422137640 1 --2- 172.21.15.6:0/3133603264 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7ff4080664c0 0x7ff408068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.516+0000 7ff422137640 1 --2- 172.21.15.6:0/3133603264 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff41c0d1300 0x7ff41c154b30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.516+0000 7ff422137640 1 --2- 172.21.15.6:0/3133603264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff41c0b7c70 0x7ff41c155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.516+0000 7ff422137640 1 -- 172.21.15.6:0/3133603264 >> 172.21.15.6:0/3133603264 conn(0x7ff41c0650b0 msgr2=0x7ff41c165dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:04.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.516+0000 7ff422137640 1 -- 172.21.15.6:0/3133603264 shutdown_connections 2023-07-21T22:38:04.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.516+0000 7ff422137640 1 -- 172.21.15.6:0/3133603264 wait complete. 2023-07-21T22:38:04.584 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:37:19.569960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '127', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:37:20.452035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:38:04.585 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:38:04.594 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:04.552+0000 7f39bf246180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:38:04.635 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:04.588+0000 7f1bd4455180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:38:04.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.692+0000 7fccd7e48640 1 Processor -- start 2023-07-21T22:38:04.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.692+0000 7fccd7e48640 1 -- start start 2023-07-21T22:38:04.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.692+0000 7fccd7e48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fccd00d2fc0 0x7fccd00b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:04.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.692+0000 7fccd7e48640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd00b04c0 con 0x7fccd015bde0 2023-07-21T22:38:04.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.692+0000 7fccd7e48640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd00d0aa0 con 0x7fccd00d2300 2023-07-21T22:38:04.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.692+0000 7fccd7e48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd015c1b0 con 0x7fccd00d2fc0 2023-07-21T22:38:04.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.692+0000 7fccd5be4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fccd015bde0 0x7fccd00d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51162/0 (socket says 172.21.15.6:51162) 2023-07-21T22:38:04.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.692+0000 7fccd5be4640 1 -- 172.21.15.6:0/2354709505 learned_addr learned my addr 172.21.15.6:0/2354709505 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:04.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.692+0000 7fccd53e3640 1 --2- 172.21.15.6:0/2354709505 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fccd00d2fc0 0x7fccd00b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:04.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.692+0000 7fccd4be2640 1 -- 172.21.15.6:0/2354709505 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448366619 0 0) 0x7fccd00b04c0 con 0x7fccd015bde0 2023-07-21T22:38:04.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.692+0000 7fccd4be2640 1 -- 172.21.15.6:0/2354709505 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccbc003530 con 0x7fccd015bde0 2023-07-21T22:38:04.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.692+0000 7fccd4be2640 1 -- 172.21.15.6:0/2354709505 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176032419 0 0) 0x7fccd00d0aa0 con 0x7fccd00d2300 2023-07-21T22:38:04.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.692+0000 7fccd4be2640 1 -- 172.21.15.6:0/2354709505 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccd00b04c0 con 0x7fccd00d2300 2023-07-21T22:38:04.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.692+0000 7fccd53e3640 1 -- 172.21.15.6:0/2354709505 >> v1:172.21.15.161:6789/0 conn(0x7fccd00d2300 legacy=0x7fccd00cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:04.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.692+0000 7fccd53e3640 1 -- 172.21.15.6:0/2354709505 >> v1:172.21.15.6:6789/0 conn(0x7fccd015bde0 legacy=0x7fccd00d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:04.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.692+0000 7fccd53e3640 1 -- 172.21.15.6:0/2354709505 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd00afb90 con 0x7fccd00d2fc0 2023-07-21T22:38:04.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.696+0000 7fccd53e3640 1 --2- 172.21.15.6:0/2354709505 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fccd00d2fc0 0x7fccd00b0950 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fccc00097f0 tx=0x7fccc001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b59fcb73455b3b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:04.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.696+0000 7fccd4be2640 1 -- 172.21.15.6:0/2354709505 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc00aa620 con 0x7fccd00d2fc0 2023-07-21T22:38:04.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.696+0000 7fccd4be2640 1 -- 172.21.15.6:0/2354709505 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc00aa780 con 0x7fccd00d2fc0 2023-07-21T22:38:04.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.696+0000 7fccd4be2640 1 -- 172.21.15.6:0/2354709505 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc00aab10 con 0x7fccd00d2fc0 2023-07-21T22:38:04.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.696+0000 7fccd7e48640 1 -- 172.21.15.6:0/2354709505 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fccd00d2fc0 msgr2=0x7fccd00b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:04.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.696+0000 7fccd7e48640 1 --2- 172.21.15.6:0/2354709505 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fccd00d2fc0 0x7fccd00b0950 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fccc00097f0 tx=0x7fccc001c4c0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.696+0000 7fccd7e48640 1 -- 172.21.15.6:0/2354709505 shutdown_connections 2023-07-21T22:38:04.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.696+0000 7fccd7e48640 1 --2- 172.21.15.6:0/2354709505 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fccd00d2fc0 0x7fccd00b0950 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.696+0000 7fccd7e48640 1 -- 172.21.15.6:0/2354709505 >> 172.21.15.6:0/2354709505 conn(0x7fccd00659d0 msgr2=0x7fccd009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:04.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.696+0000 7fccd7e48640 1 -- 172.21.15.6:0/2354709505 shutdown_connections 2023-07-21T22:38:04.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.696+0000 7fccd7e48640 1 -- 172.21.15.6:0/2354709505 wait complete. 2023-07-21T22:38:04.745 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:04.700+0000 7f39bf246180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:38:04.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd7e48640 1 Processor -- start 2023-07-21T22:38:04.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd7e48640 1 -- start start 2023-07-21T22:38:04.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd7e48640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd00d2300 0x7fccd015dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:04.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd7e48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00d2fc0 0x7fccd00ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:04.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd7e48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fccd015bde0 0x7fccd015c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:04.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd7e48640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd015d910 con 0x7fccd00d2fc0 2023-07-21T22:38:04.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd7e48640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd015cd00 con 0x7fccd00d2300 2023-07-21T22:38:04.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd7e48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd015cfe0 con 0x7fccd015bde0 2023-07-21T22:38:04.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd53e3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00d2fc0 0x7fccd00ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:04.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd53e3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00d2fc0 0x7fccd00ce280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35200/0 (socket says 172.21.15.6:35200) 2023-07-21T22:38:04.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd53e3640 1 -- 172.21.15.6:0/1385511323 learned_addr learned my addr 172.21.15.6:0/1385511323 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:04.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd5be4640 1 --2- 172.21.15.6:0/1385511323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd00d2300 0x7fccd015dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:04.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd63e5640 1 --2- 172.21.15.6:0/1385511323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fccd015bde0 0x7fccd015c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:04.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd5be4640 1 -- 172.21.15.6:0/1385511323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fccd015bde0 msgr2=0x7fccd015c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:04.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd5be4640 1 --2- 172.21.15.6:0/1385511323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fccd015bde0 0x7fccd015c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd5be4640 1 -- 172.21.15.6:0/1385511323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00d2fc0 msgr2=0x7fccd00ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:04.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd5be4640 1 --2- 172.21.15.6:0/1385511323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00d2fc0 0x7fccd00ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd5be4640 1 -- 172.21.15.6:0/1385511323 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc0009420 con 0x7fccd00d2300 2023-07-21T22:38:04.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd53e3640 1 --2- 172.21.15.6:0/1385511323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00d2fc0 0x7fccd00ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:04.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd63e5640 1 --2- 172.21.15.6:0/1385511323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fccd015bde0 0x7fccd015c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:04.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.700+0000 7fccd5be4640 1 --2- 172.21.15.6:0/1385511323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd00d2300 0x7fccd015dda0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcccc004990 tx=0x7fcccc00c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:04.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.704+0000 7fccc67fc640 1 -- 172.21.15.6:0/1385511323 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc005cf0 con 0x7fccd00d2300 2023-07-21T22:38:04.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.704+0000 7fccc67fc640 1 -- 172.21.15.6:0/1385511323 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcccc005e50 con 0x7fccd00d2300 2023-07-21T22:38:04.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.704+0000 7fccc67fc640 1 -- 172.21.15.6:0/1385511323 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc0072d0 con 0x7fccd00d2300 2023-07-21T22:38:04.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.704+0000 7fccd7e48640 1 -- 172.21.15.6:0/1385511323 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd015d2c0 con 0x7fccd00d2300 2023-07-21T22:38:04.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.704+0000 7fccd7e48640 1 -- 172.21.15.6:0/1385511323 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd015e2e0 con 0x7fccd00d2300 2023-07-21T22:38:04.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.704+0000 7fccd7e48640 1 -- 172.21.15.6:0/1385511323 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd00678d0 con 0x7fccd00d2300 2023-07-21T22:38:04.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.704+0000 7fccc67fc640 1 -- 172.21.15.6:0/1385511323 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 55) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fcccc007430 con 0x7fccd00d2300 2023-07-21T22:38:04.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.704+0000 7fccc67fc640 1 --2- 172.21.15.6:0/1385511323 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7fccb40664c0 0x7fccb4068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:04.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.704+0000 7fccc67fc640 1 -- 172.21.15.6:0/1385511323 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6450+0+0 (secure 0 0 0) 0x7fcccc0838b0 con 0x7fccd00d2300 2023-07-21T22:38:04.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.704+0000 7fccd53e3640 1 -- 172.21.15.6:0/1385511323 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7fccb40664c0 msgr2=0x7fccb4068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1243154965 2023-07-21T22:38:04.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.704+0000 7fccd53e3640 1 --2- 172.21.15.6:0/1385511323 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7fccb40664c0 0x7fccb4068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:04.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.708+0000 7fccc67fc640 1 -- 172.21.15.6:0/1385511323 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcccc050850 con 0x7fccd00d2300 2023-07-21T22:38:04.798 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:04.752+0000 7f1bd4455180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:38:04.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.864+0000 7fccd7e48640 1 -- 172.21.15.6:0/1385511323 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fccd00d0680 con 0x7fccd00d2300 2023-07-21T22:38:04.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.868+0000 7fccc67fc640 1 -- 172.21.15.6:0/1385511323 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v129) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcccc017020 con 0x7fccd00d2300 2023-07-21T22:38:04.912 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:38:04.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.868+0000 7fccd7e48640 1 -- 172.21.15.6:0/1385511323 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7fccb40664c0 msgr2=0x7fccb4068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:04.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.868+0000 7fccd7e48640 1 --2- 172.21.15.6:0/1385511323 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7fccb40664c0 0x7fccb4068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.868+0000 7fccd7e48640 1 -- 172.21.15.6:0/1385511323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd00d2300 msgr2=0x7fccd015dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:04.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.868+0000 7fccd7e48640 1 --2- 172.21.15.6:0/1385511323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd00d2300 0x7fccd015dda0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fcccc004990 tx=0x7fcccc00c960 comp rx=0 tx=0).stop 2023-07-21T22:38:04.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.868+0000 7fccd7e48640 1 -- 172.21.15.6:0/1385511323 shutdown_connections 2023-07-21T22:38:04.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.868+0000 7fccd7e48640 1 --2- 172.21.15.6:0/1385511323 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7fccb40664c0 0x7fccb4068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.868+0000 7fccd7e48640 1 --2- 172.21.15.6:0/1385511323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fccd015bde0 0x7fccd015c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.868+0000 7fccd7e48640 1 --2- 172.21.15.6:0/1385511323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00d2fc0 0x7fccd00ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.868+0000 7fccd7e48640 1 --2- 172.21.15.6:0/1385511323 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd00d2300 0x7fccd015dda0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:04.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.868+0000 7fccd7e48640 1 -- 172.21.15.6:0/1385511323 >> 172.21.15.6:0/1385511323 conn(0x7fccd00659d0 msgr2=0x7fccd006b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:04.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.868+0000 7fccd7e48640 1 -- 172.21.15.6:0/1385511323 shutdown_connections 2023-07-21T22:38:04.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:04.868+0000 7fccd7e48640 1 -- 172.21.15.6:0/1385511323 wait complete. 2023-07-21T22:38:04.935 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:38:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.036+0000 7f3cc199d640 1 Processor -- start 2023-07-21T22:38:05.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.036+0000 7f3cc199d640 1 -- start start 2023-07-21T22:38:05.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.040+0000 7f3cc199d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cbc070f30 0x7f3cbc0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:05.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.040+0000 7f3cc199d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3cbc0af2b0 0x7f3cbc15a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:05.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.040+0000 7f3cc199d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cbc159d70 con 0x7f3cbc069430 2023-07-21T22:38:05.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.040+0000 7f3cc199d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cbc0c9c60 con 0x7f3cbc0af2b0 2023-07-21T22:38:05.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.040+0000 7f3cc199d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc0c9f40 con 0x7f3cbc070f30 2023-07-21T22:38:05.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.040+0000 7f3cbaffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3cbc069430 0x7f3cbc069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51172/0 (socket says 172.21.15.6:51172) 2023-07-21T22:38:05.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.040+0000 7f3cbaffd640 1 -- 172.21.15.6:0/1386326202 learned_addr learned my addr 172.21.15.6:0/1386326202 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:05.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.040+0000 7f3cbb7fe640 1 --2- 172.21.15.6:0/1386326202 >> v2:172.21.15.6:3300/0 conn(0x7f3cbc0af2b0 0x7f3cbc15a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:05.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.040+0000 7f3cba7fc640 1 --2- 172.21.15.6:0/1386326202 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cbc070f30 0x7f3cbc0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:05.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.040+0000 7f3cb9ffb640 1 -- 172.21.15.6:0/1386326202 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167190487 0 0) 0x7f3cac001120 con 0x7f3cbc069430 2023-07-21T22:38:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.040+0000 7f3cb9ffb640 1 -- 172.21.15.6:0/1386326202 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ca4003530 con 0x7f3cbc069430 2023-07-21T22:38:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.040+0000 7f3cbb7fe640 1 -- 172.21.15.6:0/1386326202 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cbc070f30 msgr2=0x7f3cbc0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.040+0000 7f3cbb7fe640 1 --2- 172.21.15.6:0/1386326202 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cbc070f30 0x7f3cbc0ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.040+0000 7f3cbb7fe640 1 -- 172.21.15.6:0/1386326202 >> v1:172.21.15.6:6789/0 conn(0x7f3cbc069430 legacy=0x7f3cbc069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.040+0000 7f3cbb7fe640 1 -- 172.21.15.6:0/1386326202 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc0ca220 con 0x7f3cbc0af2b0 2023-07-21T22:38:05.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.040+0000 7f3cba7fc640 1 --2- 172.21.15.6:0/1386326202 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cbc070f30 0x7f3cbc0ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.044+0000 7f3cbb7fe640 1 --2- 172.21.15.6:0/1386326202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc0af2b0 0x7f3cbc15a1f0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4009d90 tx=0x7f3cb401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d446bed79042803 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.044+0000 7f3cb9ffb640 1 -- 172.21.15.6:0/1386326202 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb40a5920 con 0x7f3cbc0af2b0 2023-07-21T22:38:05.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.044+0000 7f3cb9ffb640 1 -- 172.21.15.6:0/1386326202 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb40a5a80 con 0x7f3cbc0af2b0 2023-07-21T22:38:05.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.044+0000 7f3cb9ffb640 1 -- 172.21.15.6:0/1386326202 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb40a5df0 con 0x7f3cbc0af2b0 2023-07-21T22:38:05.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.044+0000 7f3cc199d640 1 -- 172.21.15.6:0/1386326202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc0af2b0 msgr2=0x7f3cbc15a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:05.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.044+0000 7f3cc199d640 1 --2- 172.21.15.6:0/1386326202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc0af2b0 0x7f3cbc15a1f0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4009d90 tx=0x7f3cb401c950 comp rx=0 tx=0).stop 2023-07-21T22:38:05.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.044+0000 7f3cc199d640 1 -- 172.21.15.6:0/1386326202 shutdown_connections 2023-07-21T22:38:05.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.044+0000 7f3cc199d640 1 --2- 172.21.15.6:0/1386326202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc0af2b0 0x7f3cbc15a1f0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.044+0000 7f3cc199d640 1 --2- 172.21.15.6:0/1386326202 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cbc070f30 0x7f3cbc0ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.044+0000 7f3cc199d640 1 -- 172.21.15.6:0/1386326202 >> 172.21.15.6:0/1386326202 conn(0x7f3cbc0cde90 msgr2=0x7f3cbc0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:05.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.044+0000 7f3cc199d640 1 -- 172.21.15.6:0/1386326202 shutdown_connections 2023-07-21T22:38:05.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.044+0000 7f3cc199d640 1 -- 172.21.15.6:0/1386326202 wait complete. 2023-07-21T22:38:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cc199d640 1 Processor -- start 2023-07-21T22:38:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cc199d640 1 -- start start 2023-07-21T22:38:05.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cc199d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cbc069430 0x7f3cbc158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cc199d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc070f30 0x7f3cbc151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cc199d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cbc0af2b0 0x7f3cbc0c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cc199d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc0c4dc0 con 0x7f3cbc070f30 2023-07-21T22:38:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cc199d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc0cb590 con 0x7f3cbc0af2b0 2023-07-21T22:38:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cc199d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc0c4b20 con 0x7f3cbc069430 2023-07-21T22:38:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cba7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc070f30 0x7f3cbc151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cba7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc070f30 0x7f3cbc151620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35210/0 (socket says 172.21.15.6:35210) 2023-07-21T22:38:05.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cba7fc640 1 -- 172.21.15.6:0/2090733171 learned_addr learned my addr 172.21.15.6:0/2090733171 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:05.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cbaffd640 1 --2- 172.21.15.6:0/2090733171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cbc069430 0x7f3cbc158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:05.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cbb7fe640 1 --2- 172.21.15.6:0/2090733171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cbc0af2b0 0x7f3cbc0c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:05.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cba7fc640 1 -- 172.21.15.6:0/2090733171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cbc069430 msgr2=0x7f3cbc158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:05.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cba7fc640 1 --2- 172.21.15.6:0/2090733171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cbc069430 0x7f3cbc158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cba7fc640 1 -- 172.21.15.6:0/2090733171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cbc0af2b0 msgr2=0x7f3cbc0c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:05.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cba7fc640 1 --2- 172.21.15.6:0/2090733171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cbc0af2b0 0x7f3cbc0c45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cba7fc640 1 -- 172.21.15.6:0/2090733171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb0009420 con 0x7f3cbc070f30 2023-07-21T22:38:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cba7fc640 1 --2- 172.21.15.6:0/2090733171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc070f30 0x7f3cbc151620 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000ebe0 tx=0x7f3cb000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3ca3fff640 1 -- 172.21.15.6:0/2090733171 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb000eee0 con 0x7f3cbc070f30 2023-07-21T22:38:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3ca3fff640 1 -- 172.21.15.6:0/2090733171 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb000cc30 con 0x7f3cbc070f30 2023-07-21T22:38:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cc199d640 1 -- 172.21.15.6:0/2090733171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb4009a70 con 0x7f3cbc070f30 2023-07-21T22:38:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3ca3fff640 1 -- 172.21.15.6:0/2090733171 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0013470 con 0x7f3cbc070f30 2023-07-21T22:38:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.048+0000 7f3cc199d640 1 -- 172.21.15.6:0/2090733171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cbc0cbb10 con 0x7f3cbc070f30 2023-07-21T22:38:05.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.052+0000 7f3cc199d640 1 -- 172.21.15.6:0/2090733171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cbc0cc160 con 0x7f3cbc070f30 2023-07-21T22:38:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.052+0000 7f3ca3fff640 1 -- 172.21.15.6:0/2090733171 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 55) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f3cb00135d0 con 0x7f3cbc070f30 2023-07-21T22:38:05.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.052+0000 7f3ca3fff640 1 --2- 172.21.15.6:0/2090733171 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f3ca80664c0 0x7f3ca8068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:05.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.052+0000 7f3ca3fff640 1 -- 172.21.15.6:0/2090733171 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f3cb0084590 con 0x7f3cbc070f30 2023-07-21T22:38:05.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.052+0000 7f3cbaffd640 1 -- 172.21.15.6:0/2090733171 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f3ca80664c0 msgr2=0x7f3ca8068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1243154965 2023-07-21T22:38:05.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.052+0000 7f3cbaffd640 1 --2- 172.21.15.6:0/2090733171 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f3ca80664c0 0x7f3ca8068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:05.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.056+0000 7f3ca3fff640 1 -- 172.21.15.6:0/2090733171 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3cb0051530 con 0x7f3cbc070f30 2023-07-21T22:38:05.228 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:05.184+0000 7f39bf246180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:38:05.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.216+0000 7f3cc199d640 1 -- 172.21.15.6:0/2090733171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3cbc0678d0 con 0x7f3cbc070f30 2023-07-21T22:38:05.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.216+0000 7f3ca3fff640 1 -- 172.21.15.6:0/2090733171 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v129) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3cb0054b50 con 0x7f3cbc070f30 2023-07-21T22:38:05.261 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:38:05.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.216+0000 7f3cc199d640 1 -- 172.21.15.6:0/2090733171 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f3ca80664c0 msgr2=0x7f3ca8068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:05.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.216+0000 7f3cc199d640 1 --2- 172.21.15.6:0/2090733171 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f3ca80664c0 0x7f3ca8068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.216+0000 7f3cc199d640 1 -- 172.21.15.6:0/2090733171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc070f30 msgr2=0x7f3cbc151620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:05.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.216+0000 7f3cc199d640 1 --2- 172.21.15.6:0/2090733171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc070f30 0x7f3cbc151620 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000ebe0 tx=0x7f3cb000c520 comp rx=0 tx=0).stop 2023-07-21T22:38:05.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.216+0000 7f3cc199d640 1 -- 172.21.15.6:0/2090733171 shutdown_connections 2023-07-21T22:38:05.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.216+0000 7f3cc199d640 1 --2- 172.21.15.6:0/2090733171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cbc0af2b0 0x7f3cbc0c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.216+0000 7f3cc199d640 1 --2- 172.21.15.6:0/2090733171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc070f30 0x7f3cbc151620 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.216+0000 7f3cc199d640 1 --2- 172.21.15.6:0/2090733171 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f3ca80664c0 0x7f3ca8068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.216+0000 7f3cc199d640 1 --2- 172.21.15.6:0/2090733171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cbc069430 0x7f3cbc158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.216+0000 7f3cc199d640 1 -- 172.21.15.6:0/2090733171 >> 172.21.15.6:0/2090733171 conn(0x7f3cbc0cde90 msgr2=0x7f3cbc0ad430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:05.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.216+0000 7f3cc199d640 1 -- 172.21.15.6:0/2090733171 shutdown_connections 2023-07-21T22:38:05.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.216+0000 7f3cc199d640 1 -- 172.21.15.6:0/2090733171 wait complete. 2023-07-21T22:38:05.284 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:38:05.286 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:05.244+0000 7f39bf246180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:38:05.326 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:05.280+0000 7f1bd4455180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:38:05.342 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:05.300+0000 7f39bf246180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:38:05.390 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:05.344+0000 7f1bd4455180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:38:05.427 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:05.384+0000 7f39bf246180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:38:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.388+0000 7fb128896640 1 Processor -- start 2023-07-21T22:38:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.388+0000 7fb128896640 1 -- start start 2023-07-21T22:38:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.388+0000 7fb128896640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb12415bde0 0x7fb1240d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.388+0000 7fb128896640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb1240d2fc0 0x7fb1240b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.388+0000 7fb128896640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1240b04c0 con 0x7fb1240d2300 2023-07-21T22:38:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.388+0000 7fb128896640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12415c1b0 con 0x7fb12415bde0 2023-07-21T22:38:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.388+0000 7fb128896640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1240d0aa0 con 0x7fb1240d2fc0 2023-07-21T22:38:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.388+0000 7fb12259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb12415bde0 0x7fb1240d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.388+0000 7fb12259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb12415bde0 0x7fb1240d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35224/0 (socket says 172.21.15.6:35224) 2023-07-21T22:38:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.388+0000 7fb12259c640 1 -- 172.21.15.6:0/1447251694 learned_addr learned my addr 172.21.15.6:0/1447251694 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.388+0000 7fb11bfff640 1 --2- 172.21.15.6:0/1447251694 >> v2:172.21.15.161:3300/0 conn(0x7fb1240d2fc0 0x7fb1240b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.388+0000 7fb12259c640 1 -- 172.21.15.6:0/1447251694 >> v2:172.21.15.161:3300/0 conn(0x7fb1240d2fc0 msgr2=0x7fb1240b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.388+0000 7fb12259c640 1 --2- 172.21.15.6:0/1447251694 >> v2:172.21.15.161:3300/0 conn(0x7fb1240d2fc0 0x7fb1240b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.388+0000 7fb12259c640 1 -- 172.21.15.6:0/1447251694 >> v1:172.21.15.161:6789/0 conn(0x7fb1240d2300 legacy=0x7fb1240cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.388+0000 7fb12259c640 1 -- 172.21.15.6:0/1447251694 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1240afb90 con 0x7fb12415bde0 2023-07-21T22:38:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.392+0000 7fb12259c640 1 --2- 172.21.15.6:0/1447251694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb12415bde0 0x7fb1240d0270 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fb12408c600 tx=0x7fb11401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0c76d69c6bd494 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:05.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.392+0000 7fb121d9b640 1 -- 172.21.15.6:0/1447251694 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1140aa660 con 0x7fb12415bde0 2023-07-21T22:38:05.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.392+0000 7fb121d9b640 1 -- 172.21.15.6:0/1447251694 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1140aa7c0 con 0x7fb12415bde0 2023-07-21T22:38:05.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.392+0000 7fb121d9b640 1 -- 172.21.15.6:0/1447251694 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1140aab50 con 0x7fb12415bde0 2023-07-21T22:38:05.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.392+0000 7fb128896640 1 -- 172.21.15.6:0/1447251694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb12415bde0 msgr2=0x7fb1240d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:05.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.392+0000 7fb128896640 1 --2- 172.21.15.6:0/1447251694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb12415bde0 0x7fb1240d0270 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fb12408c600 tx=0x7fb11401c500 comp rx=0 tx=0).stop 2023-07-21T22:38:05.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.392+0000 7fb128896640 1 -- 172.21.15.6:0/1447251694 shutdown_connections 2023-07-21T22:38:05.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.392+0000 7fb128896640 1 --2- 172.21.15.6:0/1447251694 >> v2:172.21.15.161:3300/0 conn(0x7fb1240d2fc0 0x7fb1240b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.392+0000 7fb128896640 1 --2- 172.21.15.6:0/1447251694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb12415bde0 0x7fb1240d0270 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.392+0000 7fb128896640 1 -- 172.21.15.6:0/1447251694 >> 172.21.15.6:0/1447251694 conn(0x7fb1240659d0 msgr2=0x7fb12409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:05.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.392+0000 7fb128896640 1 -- 172.21.15.6:0/1447251694 shutdown_connections 2023-07-21T22:38:05.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.392+0000 7fb128896640 1 -- 172.21.15.6:0/1447251694 wait complete. 2023-07-21T22:38:05.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb128896640 1 Processor -- start 2023-07-21T22:38:05.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb128896640 1 -- start start 2023-07-21T22:38:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb128896640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1240d2300 0x7fb12414a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb128896640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1240d2fc0 0x7fb1240c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb128896640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb12415bde0 0x7fb124154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:05.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb128896640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb124153de0 con 0x7fb1240d2300 2023-07-21T22:38:05.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb128896640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1241531d0 con 0x7fb12415bde0 2023-07-21T22:38:05.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb128896640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1241534b0 con 0x7fb1240d2fc0 2023-07-21T22:38:05.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb12259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1240d2300 0x7fb12414a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:05.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb12259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1240d2300 0x7fb12414a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35228/0 (socket says 172.21.15.6:35228) 2023-07-21T22:38:05.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb12259c640 1 -- 172.21.15.6:0/2213984770 learned_addr learned my addr 172.21.15.6:0/2213984770 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:05.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb11bfff640 1 --2- 172.21.15.6:0/2213984770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1240d2fc0 0x7fb1240c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:05.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb122d9d640 1 --2- 172.21.15.6:0/2213984770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb12415bde0 0x7fb124154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:05.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb12259c640 1 -- 172.21.15.6:0/2213984770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1240d2fc0 msgr2=0x7fb1240c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:05.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb12259c640 1 --2- 172.21.15.6:0/2213984770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1240d2fc0 0x7fb1240c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb12259c640 1 -- 172.21.15.6:0/2213984770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb12415bde0 msgr2=0x7fb124154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:05.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb12259c640 1 --2- 172.21.15.6:0/2213984770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb12415bde0 0x7fb124154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb12259c640 1 -- 172.21.15.6:0/2213984770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb114009480 con 0x7fb1240d2300 2023-07-21T22:38:05.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb12259c640 1 --2- 172.21.15.6:0/2213984770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1240d2300 0x7fb12414a9a0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fb11401a130 tx=0x7fb1140192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:05.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb11affd640 1 -- 172.21.15.6:0/2213984770 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1140aad40 con 0x7fb1240d2300 2023-07-21T22:38:05.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb11affd640 1 -- 172.21.15.6:0/2213984770 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1140aa620 con 0x7fb1240d2300 2023-07-21T22:38:05.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb11affd640 1 -- 172.21.15.6:0/2213984770 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1140aaea0 con 0x7fb1240d2300 2023-07-21T22:38:05.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.396+0000 7fb128896640 1 -- 172.21.15.6:0/2213984770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb124153790 con 0x7fb1240d2300 2023-07-21T22:38:05.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.400+0000 7fb128896640 1 -- 172.21.15.6:0/2213984770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb12414aee0 con 0x7fb1240d2300 2023-07-21T22:38:05.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.400+0000 7fb128896640 1 -- 172.21.15.6:0/2213984770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1240678d0 con 0x7fb1240d2300 2023-07-21T22:38:05.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.400+0000 7fb11affd640 1 -- 172.21.15.6:0/2213984770 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 55) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fb114003620 con 0x7fb1240d2300 2023-07-21T22:38:05.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.400+0000 7fb11affd640 1 --2- 172.21.15.6:0/2213984770 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7fb1040664c0 0x7fb104068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:05.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.400+0000 7fb11affd640 1 -- 172.21.15.6:0/2213984770 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6450+0+0 (secure 0 0 0) 0x7fb1140a6040 con 0x7fb1240d2300 2023-07-21T22:38:05.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.400+0000 7fb11bfff640 1 -- 172.21.15.6:0/2213984770 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7fb1040664c0 msgr2=0x7fb104068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1243154965 2023-07-21T22:38:05.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.400+0000 7fb11bfff640 1 --2- 172.21.15.6:0/2213984770 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7fb1040664c0 0x7fb104068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:05.455 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:05.408+0000 7f1bd4455180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:38:05.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.408+0000 7fb11affd640 1 -- 172.21.15.6:0/2213984770 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb1140ec000 con 0x7fb1240d2300 2023-07-21T22:38:05.486 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:05.444+0000 7f39bf246180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:38:05.549 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:05.504+0000 7f1bd4455180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:38:05.570 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:05.528+0000 7f39bf246180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:38:05.609 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:05.564+0000 7f1bd4455180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:38:05.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.568+0000 7fb128896640 1 -- 172.21.15.6:0/2213984770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb124152480 con 0x7fb1240d2300 2023-07-21T22:38:05.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.568+0000 7fb11affd640 1 -- 172.21.15.6:0/2213984770 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v129) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb1140ef620 con 0x7fb1240d2300 2023-07-21T22:38:05.615 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:38:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.572+0000 7fb128896640 1 -- 172.21.15.6:0/2213984770 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7fb1040664c0 msgr2=0x7fb104068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.572+0000 7fb128896640 1 --2- 172.21.15.6:0/2213984770 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7fb1040664c0 0x7fb104068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.572+0000 7fb128896640 1 -- 172.21.15.6:0/2213984770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1240d2300 msgr2=0x7fb12414a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.572+0000 7fb128896640 1 --2- 172.21.15.6:0/2213984770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1240d2300 0x7fb12414a9a0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fb11401a130 tx=0x7fb1140192a0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.572+0000 7fb128896640 1 -- 172.21.15.6:0/2213984770 shutdown_connections 2023-07-21T22:38:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.572+0000 7fb128896640 1 --2- 172.21.15.6:0/2213984770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb12415bde0 0x7fb124154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.572+0000 7fb128896640 1 --2- 172.21.15.6:0/2213984770 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7fb1040664c0 0x7fb104068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.572+0000 7fb128896640 1 --2- 172.21.15.6:0/2213984770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb1240d2fc0 0x7fb1240c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.572+0000 7fb128896640 1 --2- 172.21.15.6:0/2213984770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1240d2300 0x7fb12414a9a0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.572+0000 7fb128896640 1 -- 172.21.15.6:0/2213984770 >> 172.21.15.6:0/2213984770 conn(0x7fb1240659d0 msgr2=0x7fb124155510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:05.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.572+0000 7fb128896640 1 -- 172.21.15.6:0/2213984770 shutdown_connections 2023-07-21T22:38:05.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.572+0000 7fb128896640 1 -- 172.21.15.6:0/2213984770 wait complete. 2023-07-21T22:38:05.626 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:05.584+0000 7f39bf246180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:38:05.637 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:38:05.700 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:05.656+0000 7f1bd4455180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:38:05.761 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:05.716+0000 7f1bd4455180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:38:05.768 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:05.724+0000 7f39bf246180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:38:05.825 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:05.784+0000 7f39bf246180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:38:05.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.784+0000 7f7ba7a93640 1 Processor -- start 2023-07-21T22:38:05.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.784+0000 7f7ba7a93640 1 -- start start 2023-07-21T22:38:05.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.788+0000 7f7ba7a93640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7ba015a940 0x7f7ba00c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:05.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.788+0000 7f7ba7a93640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba00c37e0 con 0x7f7ba015b9c0 2023-07-21T22:38:05.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.788+0000 7f7ba7a93640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba00c3ac0 con 0x7f7ba00cba60 2023-07-21T22:38:05.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.788+0000 7f7ba7a93640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba0069b40 con 0x7f7ba015a940 2023-07-21T22:38:05.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.788+0000 7f7ba582f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7ba015b9c0 0x7f7ba0069430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51174/0 (socket says 172.21.15.6:51174) 2023-07-21T22:38:05.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.788+0000 7f7ba582f640 1 -- 172.21.15.6:0/1015252602 learned_addr learned my addr 172.21.15.6:0/1015252602 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:05.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.788+0000 7f7ba502e640 1 --2- 172.21.15.6:0/1015252602 >> v2:172.21.15.161:3300/0 conn(0x7f7ba015a940 0x7f7ba00c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:05.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.788+0000 7f7ba482d640 1 -- 172.21.15.6:0/1015252602 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996843918 0 0) 0x7f7ba00c37e0 con 0x7f7ba015b9c0 2023-07-21T22:38:05.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.788+0000 7f7ba482d640 1 -- 172.21.15.6:0/1015252602 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b8c005740 con 0x7f7ba015b9c0 2023-07-21T22:38:05.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.788+0000 7f7ba502e640 1 -- 172.21.15.6:0/1015252602 >> v1:172.21.15.161:6789/0 conn(0x7f7ba00cba60 legacy=0x7f7ba0162d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:05.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.788+0000 7f7ba502e640 1 -- 172.21.15.6:0/1015252602 >> v1:172.21.15.6:6789/0 conn(0x7f7ba015b9c0 legacy=0x7f7ba0069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:05.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.788+0000 7f7ba502e640 1 -- 172.21.15.6:0/1015252602 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba00c3da0 con 0x7f7ba015a940 2023-07-21T22:38:05.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.792+0000 7f7ba502e640 1 --2- 172.21.15.6:0/1015252602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ba015a940 0x7f7ba00c3150 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7b900097c0 tx=0x7f7b9001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aedad8768809f64d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:05.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.792+0000 7f7ba482d640 1 -- 172.21.15.6:0/1015252602 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b900a4ea0 con 0x7f7ba015a940 2023-07-21T22:38:05.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.792+0000 7f7ba482d640 1 -- 172.21.15.6:0/1015252602 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b900ac440 con 0x7f7ba015a940 2023-07-21T22:38:05.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.792+0000 7f7ba482d640 1 -- 172.21.15.6:0/1015252602 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b900ac7b0 con 0x7f7ba015a940 2023-07-21T22:38:05.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.792+0000 7f7ba7a93640 1 -- 172.21.15.6:0/1015252602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ba015a940 msgr2=0x7f7ba00c3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:05.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.792+0000 7f7ba7a93640 1 --2- 172.21.15.6:0/1015252602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ba015a940 0x7f7ba00c3150 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7b900097c0 tx=0x7f7b9001c3f0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.792+0000 7f7ba7a93640 1 -- 172.21.15.6:0/1015252602 shutdown_connections 2023-07-21T22:38:05.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.792+0000 7f7ba7a93640 1 --2- 172.21.15.6:0/1015252602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ba015a940 0x7f7ba00c3150 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.792+0000 7f7ba7a93640 1 -- 172.21.15.6:0/1015252602 >> 172.21.15.6:0/1015252602 conn(0x7f7ba00cde90 msgr2=0x7f7ba00ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:05.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.792+0000 7f7ba7a93640 1 -- 172.21.15.6:0/1015252602 shutdown_connections 2023-07-21T22:38:05.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.792+0000 7f7ba7a93640 1 -- 172.21.15.6:0/1015252602 wait complete. 2023-07-21T22:38:05.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.792+0000 7f7ba7a93640 1 Processor -- start 2023-07-21T22:38:05.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.792+0000 7f7ba7a93640 1 -- start start 2023-07-21T22:38:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7ba7a93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba00cba60 0x7f7ba00b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7ba7a93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ba015a940 0x7f7ba01522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7ba7a93640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ba015b9c0 0x7f7ba0153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7ba7a93640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba00c82f0 con 0x7f7ba00cba60 2023-07-21T22:38:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7ba7a93640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba00c65d0 con 0x7f7ba015b9c0 2023-07-21T22:38:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7ba7a93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba00c68b0 con 0x7f7ba015a940 2023-07-21T22:38:05.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7ba582f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba00cba60 0x7f7ba00b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:05.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7ba582f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba00cba60 0x7f7ba00b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35238/0 (socket says 172.21.15.6:35238) 2023-07-21T22:38:05.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7ba582f640 1 -- 172.21.15.6:0/4246696320 learned_addr learned my addr 172.21.15.6:0/4246696320 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:05.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7ba502e640 1 --2- 172.21.15.6:0/4246696320 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ba015a940 0x7f7ba01522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:05.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7ba6030640 1 --2- 172.21.15.6:0/4246696320 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ba015b9c0 0x7f7ba0153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:05.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7ba582f640 1 -- 172.21.15.6:0/4246696320 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ba015a940 msgr2=0x7f7ba01522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:05.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7ba582f640 1 --2- 172.21.15.6:0/4246696320 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ba015a940 0x7f7ba01522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7ba582f640 1 -- 172.21.15.6:0/4246696320 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ba015b9c0 msgr2=0x7f7ba0153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:05.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7ba582f640 1 --2- 172.21.15.6:0/4246696320 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ba015b9c0 0x7f7ba0153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:05.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7ba582f640 1 -- 172.21.15.6:0/4246696320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b90009420 con 0x7f7ba00cba60 2023-07-21T22:38:05.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7ba582f640 1 --2- 172.21.15.6:0/4246696320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba00cba60 0x7f7ba00b3690 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c00c420 tx=0x7f7b9c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:05.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7b967fc640 1 -- 172.21.15.6:0/4246696320 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c005cf0 con 0x7f7ba00cba60 2023-07-21T22:38:05.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7b967fc640 1 -- 172.21.15.6:0/4246696320 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9c005e50 con 0x7f7ba00cba60 2023-07-21T22:38:05.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7b967fc640 1 -- 172.21.15.6:0/4246696320 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c0072d0 con 0x7f7ba00cba60 2023-07-21T22:38:05.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7ba7a93640 1 -- 172.21.15.6:0/4246696320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba00c6b90 con 0x7f7ba00cba60 2023-07-21T22:38:05.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7ba7a93640 1 -- 172.21.15.6:0/4246696320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba00c7150 con 0x7f7ba00cba60 2023-07-21T22:38:05.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.796+0000 7f7ba7a93640 1 -- 172.21.15.6:0/4246696320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba00714b0 con 0x7f7ba00cba60 2023-07-21T22:38:05.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.800+0000 7f7b967fc640 1 -- 172.21.15.6:0/4246696320 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 55) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f7b9c007430 con 0x7f7ba00cba60 2023-07-21T22:38:05.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.800+0000 7f7b967fc640 1 --2- 172.21.15.6:0/4246696320 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f7b840664c0 0x7f7b84068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:05.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.800+0000 7f7b967fc640 1 -- 172.21.15.6:0/4246696320 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f7b9c083770 con 0x7f7ba00cba60 2023-07-21T22:38:05.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.800+0000 7f7ba502e640 1 -- 172.21.15.6:0/4246696320 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f7b840664c0 msgr2=0x7f7b84068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1243154965 2023-07-21T22:38:05.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.800+0000 7f7ba502e640 1 --2- 172.21.15.6:0/4246696320 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f7b840664c0 0x7f7b84068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:05.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.804+0000 7f7b967fc640 1 -- 172.21.15.6:0/4246696320 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7b9c050840 con 0x7f7ba00cba60 2023-07-21T22:38:05.916 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:05.872+0000 7f1bd4455180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:38:05.978 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:05.932+0000 7f1bd4455180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:38:06.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.960+0000 7f7ba7a93640 1 -- 172.21.15.6:0/4246696320 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7ba00c7340 con 0x7f7ba00cba60 2023-07-21T22:38:06.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.960+0000 7f7b967fc640 1 -- 172.21.15.6:0/4246696320 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v129) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7b9c053e60 con 0x7f7ba00cba60 2023-07-21T22:38:06.008 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:38:06.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.964+0000 7f7ba7a93640 1 -- 172.21.15.6:0/4246696320 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f7b840664c0 msgr2=0x7f7b84068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:06.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.964+0000 7f7ba7a93640 1 --2- 172.21.15.6:0/4246696320 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f7b840664c0 0x7f7b84068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.964+0000 7f7ba7a93640 1 -- 172.21.15.6:0/4246696320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba00cba60 msgr2=0x7f7ba00b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:06.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.964+0000 7f7ba7a93640 1 --2- 172.21.15.6:0/4246696320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba00cba60 0x7f7ba00b3690 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c00c420 tx=0x7f7b9c00c8e0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.964+0000 7f7ba7a93640 1 -- 172.21.15.6:0/4246696320 shutdown_connections 2023-07-21T22:38:06.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.964+0000 7f7ba7a93640 1 --2- 172.21.15.6:0/4246696320 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ba015b9c0 0x7f7ba0153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.964+0000 7f7ba7a93640 1 --2- 172.21.15.6:0/4246696320 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f7b840664c0 0x7f7b84068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.964+0000 7f7ba7a93640 1 --2- 172.21.15.6:0/4246696320 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ba015a940 0x7f7ba01522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.964+0000 7f7ba7a93640 1 --2- 172.21.15.6:0/4246696320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ba00cba60 0x7f7ba00b3690 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.964+0000 7f7ba7a93640 1 -- 172.21.15.6:0/4246696320 >> 172.21.15.6:0/4246696320 conn(0x7f7ba00cde90 msgr2=0x7f7ba006f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:06.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.964+0000 7f7ba7a93640 1 -- 172.21.15.6:0/4246696320 shutdown_connections 2023-07-21T22:38:06.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:05.964+0000 7f7ba7a93640 1 -- 172.21.15.6:0/4246696320 wait complete. 2023-07-21T22:38:06.029 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:38:06.066 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:38:06.066 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:38:06.067 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:38:06.074 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:06.032+0000 7f39bf246180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:38:06.208 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:06.164+0000 7f39bf246180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:38:06.246 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:38:06.246 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:38:06.247 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:38:06.255 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:06.208+0000 7f1bd4455180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:38:06.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.212+0000 7f305bef9640 1 Processor -- start 2023-07-21T22:38:06.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.212+0000 7f305bef9640 1 -- start start 2023-07-21T22:38:06.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.212+0000 7f305bef9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f30540b7c70 0x7f30540d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:06.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.212+0000 7f305bef9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f305415fd60 0x7f30540d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:06.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.212+0000 7f305bef9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30540ccaf0 con 0x7f30540d1850 2023-07-21T22:38:06.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.212+0000 7f305bef9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30540d1190 con 0x7f30540b7c70 2023-07-21T22:38:06.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.212+0000 7f305bef9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3054160600 con 0x7f305415fd60 2023-07-21T22:38:06.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.212+0000 7f3059c95640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f30540b7c70 0x7f30540d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:06.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.212+0000 7f305a496640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f305415fd60 0x7f30540d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.212+0000 7f3059c95640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f30540b7c70 0x7f30540d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:48918/0 (socket says 172.21.15.6:48918) 2023-07-21T22:38:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.212+0000 7f3059c95640 1 -- 172.21.15.6:0/3517395690 learned_addr learned my addr 172.21.15.6:0/3517395690 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.212+0000 7f305a496640 1 -- 172.21.15.6:0/3517395690 >> v2:172.21.15.161:3300/0 conn(0x7f30540b7c70 msgr2=0x7f30540d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.212+0000 7f305a496640 1 --2- 172.21.15.6:0/3517395690 >> v2:172.21.15.161:3300/0 conn(0x7f30540b7c70 0x7f30540d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.212+0000 7f305a496640 1 -- 172.21.15.6:0/3517395690 >> v1:172.21.15.161:6789/0 conn(0x7f30540d1850 legacy=0x7f305415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.212+0000 7f305a496640 1 -- 172.21.15.6:0/3517395690 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3054160320 con 0x7f305415fd60 2023-07-21T22:38:06.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.212+0000 7f3059c95640 1 --2- 172.21.15.6:0/3517395690 >> v2:172.21.15.161:3300/0 conn(0x7f30540b7c70 0x7f30540d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:06.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.216+0000 7f305a496640 1 --2- 172.21.15.6:0/3517395690 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f305415fd60 0x7f30540d1da0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f304c009d90 tx=0x7f304c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=301a293d4aab18eb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:06.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.220+0000 7f3058c93640 1 -- 172.21.15.6:0/3517395690 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0a5a00 con 0x7f305415fd60 2023-07-21T22:38:06.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.220+0000 7f3058c93640 1 -- 172.21.15.6:0/3517395690 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c0a5b60 con 0x7f305415fd60 2023-07-21T22:38:06.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.220+0000 7f3058c93640 1 -- 172.21.15.6:0/3517395690 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0ad440 con 0x7f305415fd60 2023-07-21T22:38:06.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.220+0000 7f305bef9640 1 -- 172.21.15.6:0/3517395690 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f305415fd60 msgr2=0x7f30540d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:06.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.220+0000 7f305bef9640 1 --2- 172.21.15.6:0/3517395690 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f305415fd60 0x7f30540d1da0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f304c009d90 tx=0x7f304c01c920 comp rx=0 tx=0).stop 2023-07-21T22:38:06.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.220+0000 7f305bef9640 1 -- 172.21.15.6:0/3517395690 shutdown_connections 2023-07-21T22:38:06.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.220+0000 7f305bef9640 1 --2- 172.21.15.6:0/3517395690 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f305415fd60 0x7f30540d1da0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.220+0000 7f305bef9640 1 --2- 172.21.15.6:0/3517395690 >> v2:172.21.15.161:3300/0 conn(0x7f30540b7c70 0x7f30540d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.220+0000 7f305bef9640 1 -- 172.21.15.6:0/3517395690 >> 172.21.15.6:0/3517395690 conn(0x7f30540650b0 msgr2=0x7f30540654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:06.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.220+0000 7f305bef9640 1 -- 172.21.15.6:0/3517395690 shutdown_connections 2023-07-21T22:38:06.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.220+0000 7f305bef9640 1 -- 172.21.15.6:0/3517395690 wait complete. 2023-07-21T22:38:06.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.220+0000 7f305bef9640 1 Processor -- start 2023-07-21T22:38:06.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.220+0000 7f305bef9640 1 -- start start 2023-07-21T22:38:06.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f305bef9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30540b7c70 0x7f30541529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:06.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f305bef9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30540d1850 0x7f30540b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:06.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f305bef9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f305415fd60 0x7f30540cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:06.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f305bef9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30540b6470 con 0x7f305415fd60 2023-07-21T22:38:06.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f305bef9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30540ce960 con 0x7f30540d1850 2023-07-21T22:38:06.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f305bef9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3054153600 con 0x7f30540b7c70 2023-07-21T22:38:06.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f3059c95640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30540b7c70 0x7f30541529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:06.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f305a496640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f305415fd60 0x7f30540cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:06.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f3059c95640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30540b7c70 0x7f30541529b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:56326/0 (socket says 172.21.15.6:56326) 2023-07-21T22:38:06.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f3059c95640 1 -- 172.21.15.6:0/683356517 learned_addr learned my addr 172.21.15.6:0/683356517 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:06.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f3059494640 1 --2- 172.21.15.6:0/683356517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30540d1850 0x7f30540b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:06.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f3059c95640 1 -- 172.21.15.6:0/683356517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30540d1850 msgr2=0x7f30540b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:06.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f3059c95640 1 --2- 172.21.15.6:0/683356517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30540d1850 0x7f30540b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f3059c95640 1 -- 172.21.15.6:0/683356517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f305415fd60 msgr2=0x7f30540cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:06.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f3059c95640 1 --2- 172.21.15.6:0/683356517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f305415fd60 0x7f30540cedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f3059c95640 1 -- 172.21.15.6:0/683356517 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30500094d0 con 0x7f30540b7c70 2023-07-21T22:38:06.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f3059c95640 1 --2- 172.21.15.6:0/683356517 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30540b7c70 0x7f30541529b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f305000e930 tx=0x7f305000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:06.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f304a7fc640 1 -- 172.21.15.6:0/683356517 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305000ca00 con 0x7f30540b7c70 2023-07-21T22:38:06.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f304a7fc640 1 -- 172.21.15.6:0/683356517 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305000cb60 con 0x7f30540b7c70 2023-07-21T22:38:06.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f304a7fc640 1 -- 172.21.15.6:0/683356517 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050013470 con 0x7f30540b7c70 2023-07-21T22:38:06.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f305bef9640 1 -- 172.21.15.6:0/683356517 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304c009a70 con 0x7f30540b7c70 2023-07-21T22:38:06.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f305bef9640 1 -- 172.21.15.6:0/683356517 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3054153040 con 0x7f30540b7c70 2023-07-21T22:38:06.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f305bef9640 1 -- 172.21.15.6:0/683356517 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30540678d0 con 0x7f30540b7c70 2023-07-21T22:38:06.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.224+0000 7f304a7fc640 1 -- 172.21.15.6:0/683356517 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 55) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f30500135d0 con 0x7f30540b7c70 2023-07-21T22:38:06.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.228+0000 7f304a7fc640 1 --2- 172.21.15.6:0/683356517 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f30380664c0 0x7f3038068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:06.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.228+0000 7f304a7fc640 1 -- 172.21.15.6:0/683356517 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f3050084470 con 0x7f30540b7c70 2023-07-21T22:38:06.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.228+0000 7f3059494640 1 -- 172.21.15.6:0/683356517 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f30380664c0 msgr2=0x7f3038068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1243154965 2023-07-21T22:38:06.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.228+0000 7f3059494640 1 --2- 172.21.15.6:0/683356517 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f30380664c0 0x7f3038068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:06.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.236+0000 7f304a7fc640 1 -- 172.21.15.6:0/683356517 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f30500514a0 con 0x7f30540b7c70 2023-07-21T22:38:06.338 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:06.296+0000 7f39bf246180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:38:06.401 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:06.356+0000 7f1bd4455180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:38:06.409 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:06.364+0000 7f39bf246180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:38:06.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.404+0000 7f305bef9640 1 -- 172.21.15.6:0/683356517 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f30540b6610 con 0x7f30540b7c70 2023-07-21T22:38:06.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.404+0000 7f304a7fc640 1 -- 172.21.15.6:0/683356517 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v129) v1 ==== 80+0+478 (secure 0 0 0) 0x7f3050054ac0 con 0x7f30540b7c70 2023-07-21T22:38:06.449 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/2022618322 2023-07-22T22:37:38.611638+0000 2023-07-21T22:38:06.449 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/2545996454 2023-07-22T22:37:38.611638+0000 2023-07-21T22:38:06.450 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/1765632394 2023-07-22T22:37:38.611638+0000 2023-07-21T22:38:06.450 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/3061870707 2023-07-22T22:37:38.611638+0000 2023-07-21T22:38:06.450 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/3531274071 2023-07-22T22:37:38.611638+0000 2023-07-21T22:38:06.450 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/3831746843 2023-07-22T22:37:38.611638+0000 2023-07-21T22:38:06.450 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6833/1868466946 2023-07-22T22:37:38.611638+0000 2023-07-21T22:38:06.450 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6832/1868466946 2023-07-22T22:37:38.611638+0000 2023-07-21T22:38:06.451 INFO:teuthology.orchestra.run.smithi006.stderr:listed 8 entries 2023-07-21T22:38:06.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.404+0000 7f305bef9640 1 -- 172.21.15.6:0/683356517 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f30380664c0 msgr2=0x7f3038068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:06.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.404+0000 7f305bef9640 1 --2- 172.21.15.6:0/683356517 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f30380664c0 0x7f3038068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.404+0000 7f305bef9640 1 -- 172.21.15.6:0/683356517 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30540b7c70 msgr2=0x7f30541529b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:06.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.404+0000 7f305bef9640 1 --2- 172.21.15.6:0/683356517 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30540b7c70 0x7f30541529b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f305000e930 tx=0x7f305000edf0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.404+0000 7f305bef9640 1 -- 172.21.15.6:0/683356517 shutdown_connections 2023-07-21T22:38:06.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.404+0000 7f305bef9640 1 --2- 172.21.15.6:0/683356517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f305415fd60 0x7f30540cedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.404+0000 7f305bef9640 1 --2- 172.21.15.6:0/683356517 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30540d1850 0x7f30540b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.404+0000 7f305bef9640 1 --2- 172.21.15.6:0/683356517 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f30380664c0 0x7f3038068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.404+0000 7f305bef9640 1 --2- 172.21.15.6:0/683356517 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30540b7c70 0x7f30541529b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.404+0000 7f305bef9640 1 -- 172.21.15.6:0/683356517 >> 172.21.15.6:0/683356517 conn(0x7f30540650b0 msgr2=0x7f30540cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:06.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.404+0000 7f305bef9640 1 -- 172.21.15.6:0/683356517 shutdown_connections 2023-07-21T22:38:06.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.404+0000 7f305bef9640 1 -- 172.21.15.6:0/683356517 wait complete. 2023-07-21T22:38:06.471 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-21T22:38:06.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:38:06.471 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-21T22:38:06.528 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:38:06.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:38:06.529 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T22:38:06.539 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:06.492+0000 7f1bd4455180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:38:06.540 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:38:06.540 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:38:06.544 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:06.500+0000 7f39bf246180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:38:06.549 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:38:06.549 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:38:06.550 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:38:06.593 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:38:06.594 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:38:06.594 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:38:06.603 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:38:06.603 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:38:06.616 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:06.572+0000 7f1bd4455180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:38:06.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.716+0000 7f791ae48640 1 Processor -- start 2023-07-21T22:38:06.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.716+0000 7f791ae48640 1 -- start start 2023-07-21T22:38:06.764 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:06.720+0000 7f1bd4455180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:38:06.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.720+0000 7f791ae48640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f79140b7c70 0x7f79140d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:06.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.720+0000 7f791ae48640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f79140d1850 0x7f791415f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:06.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.720+0000 7f791ae48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79140d1300 0x7f791415fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:06.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.720+0000 7f791ae48640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79140d1190 con 0x7f79140d1850 2023-07-21T22:38:06.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.720+0000 7f791ae48640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7914160600 con 0x7f79140b7c70 2023-07-21T22:38:06.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.720+0000 7f791ae48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79141600d0 con 0x7f79140d1300 2023-07-21T22:38:06.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.720+0000 7f7913fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f79140d1850 0x7f791415f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:06.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.720+0000 7f7913fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f79140d1850 0x7f791415f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35260/0 (socket says 172.21.15.6:35260) 2023-07-21T22:38:06.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.720+0000 7f7913fff640 1 -- 172.21.15.6:0/3127825635 learned_addr learned my addr 172.21.15.6:0/3127825635 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:06.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.720+0000 7f7918be4640 1 --2- 172.21.15.6:0/3127825635 >> v2:172.21.15.161:3300/0 conn(0x7f79140b7c70 0x7f79140d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:06.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.720+0000 7f79193e5640 1 --2- 172.21.15.6:0/3127825635 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79140d1300 0x7f791415fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:06.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.720+0000 7f7913fff640 1 -- 172.21.15.6:0/3127825635 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79140d1300 msgr2=0x7f791415fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:06.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.720+0000 7f7913fff640 1 --2- 172.21.15.6:0/3127825635 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79140d1300 0x7f791415fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.720+0000 7f7913fff640 1 -- 172.21.15.6:0/3127825635 >> v2:172.21.15.161:3300/0 conn(0x7f79140b7c70 msgr2=0x7f79140d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:06.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.720+0000 7f7913fff640 1 --2- 172.21.15.6:0/3127825635 >> v2:172.21.15.161:3300/0 conn(0x7f79140b7c70 0x7f79140d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.720+0000 7f7913fff640 1 -- 172.21.15.6:0/3127825635 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79140ccaf0 con 0x7f79140d1850 2023-07-21T22:38:06.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.724+0000 7f7913fff640 1 --2- 172.21.15.6:0/3127825635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79140d1850 0x7f791415f650 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f79140b40a0 tx=0x7f790001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60886faeb8983f34 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:06.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.724+0000 7f79137fe640 1 -- 172.21.15.6:0/3127825635 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79000ac600 con 0x7f79140d1850 2023-07-21T22:38:06.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.724+0000 7f79137fe640 1 -- 172.21.15.6:0/3127825635 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79000a8050 con 0x7f79140d1850 2023-07-21T22:38:06.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.724+0000 7f79137fe640 1 -- 172.21.15.6:0/3127825635 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79000ac980 con 0x7f79140d1850 2023-07-21T22:38:06.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.724+0000 7f791ae48640 1 -- 172.21.15.6:0/3127825635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79140d1850 msgr2=0x7f791415f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:06.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.724+0000 7f791ae48640 1 --2- 172.21.15.6:0/3127825635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79140d1850 0x7f791415f650 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f79140b40a0 tx=0x7f790001c4d0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.724+0000 7f791ae48640 1 -- 172.21.15.6:0/3127825635 shutdown_connections 2023-07-21T22:38:06.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.724+0000 7f791ae48640 1 --2- 172.21.15.6:0/3127825635 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79140d1300 0x7f791415fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.724+0000 7f791ae48640 1 --2- 172.21.15.6:0/3127825635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79140d1850 0x7f791415f650 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.724+0000 7f791ae48640 1 --2- 172.21.15.6:0/3127825635 >> v2:172.21.15.161:3300/0 conn(0x7f79140b7c70 0x7f79140d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.724+0000 7f791ae48640 1 -- 172.21.15.6:0/3127825635 >> 172.21.15.6:0/3127825635 conn(0x7f79140650b0 msgr2=0x7f79140654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:06.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.724+0000 7f791ae48640 1 -- 172.21.15.6:0/3127825635 shutdown_connections 2023-07-21T22:38:06.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.724+0000 7f791ae48640 1 -- 172.21.15.6:0/3127825635 wait complete. 2023-07-21T22:38:06.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.724+0000 7f791ae48640 1 Processor -- start 2023-07-21T22:38:06.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.724+0000 7f791ae48640 1 -- start start 2023-07-21T22:38:06.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f791ae48640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79140b7c70 0x7f79141f6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:06.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f791ae48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79140d1300 0x7f791415e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:06.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f791ae48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79140d1850 0x7f79140c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:06.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f791ae48640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79140c6640 con 0x7f79140d1300 2023-07-21T22:38:06.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f791ae48640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79140c5e30 con 0x7f79140b7c70 2023-07-21T22:38:06.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f791ae48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79140c80b0 con 0x7f79140d1850 2023-07-21T22:38:06.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f7913fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79140d1300 0x7f791415e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:06.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f79193e5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79140d1850 0x7f79140c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:06.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f7913fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79140d1300 0x7f791415e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35270/0 (socket says 172.21.15.6:35270) 2023-07-21T22:38:06.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f7913fff640 1 -- 172.21.15.6:0/1729742978 learned_addr learned my addr 172.21.15.6:0/1729742978 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:06.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f7918be4640 1 --2- 172.21.15.6:0/1729742978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79140b7c70 0x7f79141f6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:06.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f7913fff640 1 -- 172.21.15.6:0/1729742978 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79140d1850 msgr2=0x7f79140c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f7913fff640 1 --2- 172.21.15.6:0/1729742978 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79140d1850 0x7f79140c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f7913fff640 1 -- 172.21.15.6:0/1729742978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79140b7c70 msgr2=0x7f79141f6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f7913fff640 1 --2- 172.21.15.6:0/1729742978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79140b7c70 0x7f79141f6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f7913fff640 1 -- 172.21.15.6:0/1729742978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79000094d0 con 0x7f79140d1300 2023-07-21T22:38:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f7913fff640 1 --2- 172.21.15.6:0/1729742978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79140d1300 0x7f791415e900 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f790001ab80 tx=0x7f7900019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f79117fa640 1 -- 172.21.15.6:0/1729742978 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79000b5460 con 0x7f79140d1300 2023-07-21T22:38:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f79117fa640 1 -- 172.21.15.6:0/1729742978 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79000b55c0 con 0x7f79140d1300 2023-07-21T22:38:06.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f791ae48640 1 -- 172.21.15.6:0/1729742978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79140c6080 con 0x7f79140d1300 2023-07-21T22:38:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f79117fa640 1 -- 172.21.15.6:0/1729742978 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79000b5970 con 0x7f79140d1300 2023-07-21T22:38:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f791ae48640 1 -- 172.21.15.6:0/1729742978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79140c7d40 con 0x7f79140d1300 2023-07-21T22:38:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.728+0000 7f791ae48640 1 -- 172.21.15.6:0/1729742978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79140c8220 con 0x7f79140d1300 2023-07-21T22:38:06.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.732+0000 7f79117fa640 1 -- 172.21.15.6:0/1729742978 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 55) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f79000b3070 con 0x7f79140d1300 2023-07-21T22:38:06.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.732+0000 7f79117fa640 1 --2- 172.21.15.6:0/1729742978 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f78f80664f0 0x7f78f80689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:06.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.732+0000 7f79117fa640 1 -- 172.21.15.6:0/1729742978 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f790011dc80 con 0x7f79140d1300 2023-07-21T22:38:06.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.732+0000 7f7918be4640 1 -- 172.21.15.6:0/1729742978 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f78f80664f0 msgr2=0x7f78f80689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1243154965 2023-07-21T22:38:06.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.732+0000 7f7918be4640 1 --2- 172.21.15.6:0/1729742978 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f78f80664f0 0x7f78f80689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:06.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.736+0000 7f79117fa640 1 -- 172.21.15.6:0/1729742978 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f79000eac60 con 0x7f79140d1300 2023-07-21T22:38:06.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.924+0000 7f791ae48640 1 -- 172.21.15.6:0/1729742978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79140678d0 con 0x7f79140d1300 2023-07-21T22:38:06.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.924+0000 7f79117fa640 1 -- 172.21.15.6:0/1729742978 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f79000ee280 con 0x7f79140d1300 2023-07-21T22:38:06.969 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:06.970 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1099541342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1099541342},{"type":"v1","addr":"172.21.15.161:6837","nonce":1099541342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3942495258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3942495258},{"type":"v1","addr":"172.21.15.161:6836","nonce":3942495258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8211,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3306024838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3306024838},{"type":"v1","addr":"172.21.15.6:6834","nonce":3306024838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:37:21.460444+0000","modified":"2023-07-21T22:37:25.102431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8214":{"gid":8214,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2511188295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2511188295},{"type":"v1","addr":"172.21.15.6:6835","nonce":2511188295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-21T22:38:06.970 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 54 2023-07-21T22:38:06.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.924+0000 7f791ae48640 1 -- 172.21.15.6:0/1729742978 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f78f80664f0 msgr2=0x7f78f80689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:06.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.924+0000 7f791ae48640 1 --2- 172.21.15.6:0/1729742978 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f78f80664f0 0x7f78f80689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.924+0000 7f791ae48640 1 -- 172.21.15.6:0/1729742978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79140d1300 msgr2=0x7f791415e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:06.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.924+0000 7f791ae48640 1 --2- 172.21.15.6:0/1729742978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79140d1300 0x7f791415e900 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f790001ab80 tx=0x7f7900019270 comp rx=0 tx=0).stop 2023-07-21T22:38:06.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.924+0000 7f791ae48640 1 -- 172.21.15.6:0/1729742978 shutdown_connections 2023-07-21T22:38:06.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.924+0000 7f791ae48640 1 --2- 172.21.15.6:0/1729742978 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f78f80664f0 0x7f78f80689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.924+0000 7f791ae48640 1 --2- 172.21.15.6:0/1729742978 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f79140d1850 0x7f79140c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.924+0000 7f791ae48640 1 --2- 172.21.15.6:0/1729742978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79140d1300 0x7f791415e900 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.924+0000 7f791ae48640 1 --2- 172.21.15.6:0/1729742978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79140b7c70 0x7f79141f6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:06.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.924+0000 7f791ae48640 1 -- 172.21.15.6:0/1729742978 >> 172.21.15.6:0/1729742978 conn(0x7f79140650b0 msgr2=0x7f79140cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:06.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.924+0000 7f791ae48640 1 -- 172.21.15.6:0/1729742978 shutdown_connections 2023-07-21T22:38:06.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:06.924+0000 7f791ae48640 1 -- 172.21.15.6:0/1729742978 wait complete. 2023-07-21T22:38:06.991 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:38:07.085 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:07.040+0000 7f39bf246180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:38:07.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.092+0000 7f94cf4d8640 1 Processor -- start 2023-07-21T22:38:07.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.092+0000 7f94cf4d8640 1 -- start start 2023-07-21T22:38:07.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.096+0000 7f94cf4d8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94c80b7c70 0x7f94c80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:07.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.096+0000 7f94cf4d8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c80ccaf0 con 0x7f94c815fd60 2023-07-21T22:38:07.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.096+0000 7f94cf4d8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c8160320 con 0x7f94c80d1850 2023-07-21T22:38:07.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.096+0000 7f94cf4d8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c80d1190 con 0x7f94c80b7c70 2023-07-21T22:38:07.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.096+0000 7f94cda75640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f94c815fd60 0x7f94c80d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:51188/0 (socket says 172.21.15.6:51188) 2023-07-21T22:38:07.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.096+0000 7f94cda75640 1 -- 172.21.15.6:0/4015223406 learned_addr learned my addr 172.21.15.6:0/4015223406 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:07.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.096+0000 7f94cd274640 1 --2- 172.21.15.6:0/4015223406 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94c80b7c70 0x7f94c80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:07.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.096+0000 7f94bffff640 1 -- 172.21.15.6:0/4015223406 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188199618 0 0) 0x7f94c80ccaf0 con 0x7f94c815fd60 2023-07-21T22:38:07.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.096+0000 7f94bffff640 1 -- 172.21.15.6:0/4015223406 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94b4003530 con 0x7f94c815fd60 2023-07-21T22:38:07.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.096+0000 7f94bffff640 1 -- 172.21.15.6:0/4015223406 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970551642 0 0) 0x7f94c8160320 con 0x7f94c80d1850 2023-07-21T22:38:07.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.096+0000 7f94bffff640 1 -- 172.21.15.6:0/4015223406 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c80ccaf0 con 0x7f94c80d1850 2023-07-21T22:38:07.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.096+0000 7f94cd274640 1 -- 172.21.15.6:0/4015223406 >> v1:172.21.15.161:6789/0 conn(0x7f94c80d1850 legacy=0x7f94c815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:07.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.096+0000 7f94cd274640 1 -- 172.21.15.6:0/4015223406 >> v1:172.21.15.6:6789/0 conn(0x7f94c815fd60 legacy=0x7f94c80d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:07.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.096+0000 7f94cd274640 1 -- 172.21.15.6:0/4015223406 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c80ccd90 con 0x7f94c80b7c70 2023-07-21T22:38:07.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.100+0000 7f94cd274640 1 --2- 172.21.15.6:0/4015223406 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94c80b7c70 0x7f94c80d0c50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f94c40097f0 tx=0x7f94c401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3aed12c7592443e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:07.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.100+0000 7f94bffff640 1 -- 172.21.15.6:0/4015223406 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c40ac630 con 0x7f94c80b7c70 2023-07-21T22:38:07.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.100+0000 7f94bffff640 1 -- 172.21.15.6:0/4015223406 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c40ac790 con 0x7f94c80b7c70 2023-07-21T22:38:07.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.100+0000 7f94bffff640 1 -- 172.21.15.6:0/4015223406 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c40acb20 con 0x7f94c80b7c70 2023-07-21T22:38:07.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.100+0000 7f94cf4d8640 1 -- 172.21.15.6:0/4015223406 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94c80b7c70 msgr2=0x7f94c80d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:07.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.100+0000 7f94cf4d8640 1 --2- 172.21.15.6:0/4015223406 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94c80b7c70 0x7f94c80d0c50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f94c40097f0 tx=0x7f94c401c4c0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.100+0000 7f94cf4d8640 1 -- 172.21.15.6:0/4015223406 shutdown_connections 2023-07-21T22:38:07.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.100+0000 7f94cf4d8640 1 --2- 172.21.15.6:0/4015223406 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94c80b7c70 0x7f94c80d0c50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.100+0000 7f94cf4d8640 1 -- 172.21.15.6:0/4015223406 >> 172.21.15.6:0/4015223406 conn(0x7f94c80650b0 msgr2=0x7f94c80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.100+0000 7f94cf4d8640 1 -- 172.21.15.6:0/4015223406 shutdown_connections 2023-07-21T22:38:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.100+0000 7f94cf4d8640 1 -- 172.21.15.6:0/4015223406 wait complete. 2023-07-21T22:38:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.100+0000 7f94cf4d8640 1 Processor -- start 2023-07-21T22:38:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cf4d8640 1 -- start start 2023-07-21T22:38:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cf4d8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c80b7c70 0x7f94c814d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cf4d8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94c80d1850 0x7f94c815cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cf4d8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c815fd60 0x7f94c8153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cf4d8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c8154890 con 0x7f94c80b7c70 2023-07-21T22:38:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cf4d8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c814dea0 con 0x7f94c815fd60 2023-07-21T22:38:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cf4d8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c815b4b0 con 0x7f94c80d1850 2023-07-21T22:38:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cd274640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c80b7c70 0x7f94c814d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cd274640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c80b7c70 0x7f94c814d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35280/0 (socket says 172.21.15.6:35280) 2023-07-21T22:38:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cd274640 1 -- 172.21.15.6:0/2236795093 learned_addr learned my addr 172.21.15.6:0/2236795093 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cca73640 1 --2- 172.21.15.6:0/2236795093 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94c80d1850 0x7f94c815cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cda75640 1 --2- 172.21.15.6:0/2236795093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c815fd60 0x7f94c8153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:07.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cd274640 1 -- 172.21.15.6:0/2236795093 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94c80d1850 msgr2=0x7f94c815cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:07.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cd274640 1 --2- 172.21.15.6:0/2236795093 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94c80d1850 0x7f94c815cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cd274640 1 -- 172.21.15.6:0/2236795093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c815fd60 msgr2=0x7f94c8153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:07.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cd274640 1 --2- 172.21.15.6:0/2236795093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c815fd60 0x7f94c8153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cd274640 1 -- 172.21.15.6:0/2236795093 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c4009420 con 0x7f94c80b7c70 2023-07-21T22:38:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cd274640 1 --2- 172.21.15.6:0/2236795093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c80b7c70 0x7f94c814d960 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f94c40190d0 tx=0x7f94c401ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94bdffb640 1 -- 172.21.15.6:0/2236795093 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c40b8650 con 0x7f94c80b7c70 2023-07-21T22:38:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94bdffb640 1 -- 172.21.15.6:0/2236795093 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c40b87b0 con 0x7f94c80b7c70 2023-07-21T22:38:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94bdffb640 1 -- 172.21.15.6:0/2236795093 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c40b8b60 con 0x7f94c80b7c70 2023-07-21T22:38:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cf4d8640 1 -- 172.21.15.6:0/2236795093 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c815d260 con 0x7f94c80b7c70 2023-07-21T22:38:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cf4d8640 1 -- 172.21.15.6:0/2236795093 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c815c240 con 0x7f94c80b7c70 2023-07-21T22:38:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.104+0000 7f94cf4d8640 1 -- 172.21.15.6:0/2236795093 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c80678d0 con 0x7f94c80b7c70 2023-07-21T22:38:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.108+0000 7f94bdffb640 1 -- 172.21.15.6:0/2236795093 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 55) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f94c40c1410 con 0x7f94c80b7c70 2023-07-21T22:38:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.108+0000 7f94bdffb640 1 --2- 172.21.15.6:0/2236795093 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f94ac0664f0 0x7f94ac0689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.108+0000 7f94bdffb640 1 -- 172.21.15.6:0/2236795093 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f94c411e7e0 con 0x7f94c80b7c70 2023-07-21T22:38:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.108+0000 7f94cca73640 1 -- 172.21.15.6:0/2236795093 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f94ac0664f0 msgr2=0x7f94ac0689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1243154965 2023-07-21T22:38:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.108+0000 7f94cca73640 1 --2- 172.21.15.6:0/2236795093 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f94ac0664f0 0x7f94ac0689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.112+0000 7f94bdffb640 1 -- 172.21.15.6:0/2236795093 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f94c40eb700 con 0x7f94c80b7c70 2023-07-21T22:38:07.170 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:07.128+0000 7f39bf246180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:38:07.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.268+0000 7f94cf4d8640 1 -- 172.21.15.6:0/2236795093 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94c81549d0 con 0x7f94c80b7c70 2023-07-21T22:38:07.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.272+0000 7f94bdffb640 1 -- 172.21.15.6:0/2236795093 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+18800 (secure 0 0 0) 0x7f94c81549d0 con 0x7f94c80b7c70 2023-07-21T22:38:07.317 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:07.317 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":129,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:37:38.611669+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:37:19.569960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-21T22:37:20.452035+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/2022618322":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/2545996454":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/1765632394":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/3061870707":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/3531274071":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/3831746843":"2023-07-22T22:37:38.611638+0000","172.21.15.161:6833/1868466946":"2023-07-22T22:37:38.611638+0000","172.21.15.161:6832/1868466946":"2023-07-22T22:37:38.611638+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:38:07.317 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:07.272+0000 7f39bf246180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:38:07.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.272+0000 7f94cf4d8640 1 -- 172.21.15.6:0/2236795093 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f94ac0664f0 msgr2=0x7f94ac0689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:07.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.272+0000 7f94cf4d8640 1 --2- 172.21.15.6:0/2236795093 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f94ac0664f0 0x7f94ac0689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.272+0000 7f94cf4d8640 1 -- 172.21.15.6:0/2236795093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c80b7c70 msgr2=0x7f94c814d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:07.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.272+0000 7f94cf4d8640 1 --2- 172.21.15.6:0/2236795093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c80b7c70 0x7f94c814d960 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f94c40190d0 tx=0x7f94c401ad00 comp rx=0 tx=0).stop 2023-07-21T22:38:07.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.272+0000 7f94cf4d8640 1 -- 172.21.15.6:0/2236795093 shutdown_connections 2023-07-21T22:38:07.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.272+0000 7f94cf4d8640 1 --2- 172.21.15.6:0/2236795093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94c815fd60 0x7f94c8153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.272+0000 7f94cf4d8640 1 --2- 172.21.15.6:0/2236795093 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f94ac0664f0 0x7f94ac0689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.272+0000 7f94cf4d8640 1 --2- 172.21.15.6:0/2236795093 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94c80d1850 0x7f94c815cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.272+0000 7f94cf4d8640 1 --2- 172.21.15.6:0/2236795093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94c80b7c70 0x7f94c814d960 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.272+0000 7f94cf4d8640 1 -- 172.21.15.6:0/2236795093 >> 172.21.15.6:0/2236795093 conn(0x7f94c80650b0 msgr2=0x7f94c815f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:07.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.272+0000 7f94cf4d8640 1 -- 172.21.15.6:0/2236795093 shutdown_connections 2023-07-21T22:38:07.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.272+0000 7f94cf4d8640 1 -- 172.21.15.6:0/2236795093 wait complete. 2023-07-21T22:38:07.338 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:37:19.569960+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '127', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:37:20.452035+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:38:07.339 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:38:07.347 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:07.300+0000 7f1bd4455180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:38:07.399 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:07.356+0000 7f39bf246180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:38:07.439 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:07.392+0000 7f1bd4455180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:38:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.440+0000 7f6ae8c7b640 1 Processor -- start 2023-07-21T22:38:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.440+0000 7f6ae8c7b640 1 -- start start 2023-07-21T22:38:07.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.444+0000 7f6ae8c7b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ae415bde0 0x7f6ae40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:07.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.444+0000 7f6ae8c7b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ae40d2300 0x7f6ae40d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:07.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.444+0000 7f6ae8c7b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae40b04c0 con 0x7f6ae40d2fc0 2023-07-21T22:38:07.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.444+0000 7f6ae8c7b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae415c1b0 con 0x7f6ae415bde0 2023-07-21T22:38:07.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.444+0000 7f6ae8c7b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae40d2cc0 con 0x7f6ae40d2300 2023-07-21T22:38:07.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.444+0000 7f6ae259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ae415bde0 0x7f6ae40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:07.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.444+0000 7f6adbfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6ae40d2fc0 0x7f6ae40b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41944/0 (socket says 172.21.15.6:41944) 2023-07-21T22:38:07.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.444+0000 7f6adbfff640 1 -- 172.21.15.6:0/3640136636 learned_addr learned my addr 172.21.15.6:0/3640136636 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:07.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.444+0000 7f6ae2d9d640 1 --2- 172.21.15.6:0/3640136636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ae40d2300 0x7f6ae40d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:07.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.444+0000 7f6ae259c640 1 -- 172.21.15.6:0/3640136636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ae40d2300 msgr2=0x7f6ae40d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:07.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.444+0000 7f6ae259c640 1 --2- 172.21.15.6:0/3640136636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ae40d2300 0x7f6ae40d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.444+0000 7f6ae259c640 1 -- 172.21.15.6:0/3640136636 >> v1:172.21.15.6:6789/0 conn(0x7f6ae40d2fc0 legacy=0x7f6ae40b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:07.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.444+0000 7f6ae259c640 1 -- 172.21.15.6:0/3640136636 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae40b1060 con 0x7f6ae415bde0 2023-07-21T22:38:07.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.448+0000 7f6ae259c640 1 --2- 172.21.15.6:0/3640136636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae415bde0 0x7f6ae40d0270 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40097a0 tx=0x7f6ad401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd25a27b8f35670 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:07.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.448+0000 7f6ae1d9b640 1 -- 172.21.15.6:0/3640136636 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40ab600 con 0x7f6ae415bde0 2023-07-21T22:38:07.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.448+0000 7f6ae1d9b640 1 -- 172.21.15.6:0/3640136636 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad40a7050 con 0x7f6ae415bde0 2023-07-21T22:38:07.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.448+0000 7f6ae1d9b640 1 -- 172.21.15.6:0/3640136636 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40ab980 con 0x7f6ae415bde0 2023-07-21T22:38:07.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.448+0000 7f6ae8c7b640 1 -- 172.21.15.6:0/3640136636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae415bde0 msgr2=0x7f6ae40d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:07.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.448+0000 7f6ae8c7b640 1 --2- 172.21.15.6:0/3640136636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae415bde0 0x7f6ae40d0270 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40097a0 tx=0x7f6ad401c460 comp rx=0 tx=0).stop 2023-07-21T22:38:07.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.448+0000 7f6ae8c7b640 1 -- 172.21.15.6:0/3640136636 shutdown_connections 2023-07-21T22:38:07.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.448+0000 7f6ae8c7b640 1 --2- 172.21.15.6:0/3640136636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ae40d2300 0x7f6ae40d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.448+0000 7f6ae8c7b640 1 --2- 172.21.15.6:0/3640136636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae415bde0 0x7f6ae40d0270 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.448+0000 7f6ae8c7b640 1 -- 172.21.15.6:0/3640136636 >> 172.21.15.6:0/3640136636 conn(0x7f6ae40659d0 msgr2=0x7f6ae409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:07.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.448+0000 7f6ae8c7b640 1 -- 172.21.15.6:0/3640136636 shutdown_connections 2023-07-21T22:38:07.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.448+0000 7f6ae8c7b640 1 -- 172.21.15.6:0/3640136636 wait complete. 2023-07-21T22:38:07.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.448+0000 7f6ae8c7b640 1 Processor -- start 2023-07-21T22:38:07.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.448+0000 7f6ae8c7b640 1 -- start start 2023-07-21T22:38:07.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6ae8c7b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae40d2300 0x7f6ae40c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:07.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6ae8c7b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ae40d2fc0 0x7f6ae40c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:07.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6ae8c7b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ae415bde0 0x7f6ae415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:07.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6ae8c7b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae4153790 con 0x7f6ae40d2300 2023-07-21T22:38:07.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6ae8c7b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae40b5a40 con 0x7f6ae40d2fc0 2023-07-21T22:38:07.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6ae8c7b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae40b51a0 con 0x7f6ae415bde0 2023-07-21T22:38:07.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6ae259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae40d2300 0x7f6ae40c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:07.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6ae259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae40d2300 0x7f6ae40c8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51256/0 (socket says 172.21.15.6:51256) 2023-07-21T22:38:07.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6ae259c640 1 -- 172.21.15.6:0/1082562409 learned_addr learned my addr 172.21.15.6:0/1082562409 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:07.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6adbfff640 1 --2- 172.21.15.6:0/1082562409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ae40d2fc0 0x7f6ae40c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:07.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6ae2d9d640 1 --2- 172.21.15.6:0/1082562409 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ae415bde0 0x7f6ae415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:07.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6ae259c640 1 -- 172.21.15.6:0/1082562409 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ae415bde0 msgr2=0x7f6ae415eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:07.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6ae259c640 1 --2- 172.21.15.6:0/1082562409 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ae415bde0 0x7f6ae415eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6ae259c640 1 -- 172.21.15.6:0/1082562409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ae40d2fc0 msgr2=0x7f6ae40c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6ae259c640 1 --2- 172.21.15.6:0/1082562409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ae40d2fc0 0x7f6ae40c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6ae259c640 1 -- 172.21.15.6:0/1082562409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad40093b0 con 0x7f6ae40d2300 2023-07-21T22:38:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6ae259c640 1 --2- 172.21.15.6:0/1082562409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae40d2300 0x7f6ae40c8ae0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40ae040 tx=0x7f6ad401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6adaffd640 1 -- 172.21.15.6:0/1082562409 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40b7650 con 0x7f6ae40d2300 2023-07-21T22:38:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6adaffd640 1 -- 172.21.15.6:0/1082562409 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad40b77b0 con 0x7f6ae40d2300 2023-07-21T22:38:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6adaffd640 1 -- 172.21.15.6:0/1082562409 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40b7b60 con 0x7f6ae40d2300 2023-07-21T22:38:07.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6ae8c7b640 1 -- 172.21.15.6:0/1082562409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae40b5480 con 0x7f6ae40d2300 2023-07-21T22:38:07.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6ae8c7b640 1 -- 172.21.15.6:0/1082562409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae40c63e0 con 0x7f6ae40d2300 2023-07-21T22:38:07.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.452+0000 7f6ae8c7b640 1 -- 172.21.15.6:0/1082562409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae4153560 con 0x7f6ae40d2300 2023-07-21T22:38:07.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.456+0000 7f6adaffd640 1 -- 172.21.15.6:0/1082562409 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 55) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f6ad40b7cc0 con 0x7f6ae40d2300 2023-07-21T22:38:07.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.456+0000 7f6adaffd640 1 --2- 172.21.15.6:0/1082562409 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f6ac40664c0 0x7f6ac4068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:07.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.456+0000 7f6adaffd640 1 -- 172.21.15.6:0/1082562409 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6450+0+0 (secure 0 0 0) 0x7f6ad411ea30 con 0x7f6ae40d2300 2023-07-21T22:38:07.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.456+0000 7f6adbfff640 1 -- 172.21.15.6:0/1082562409 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f6ac40664c0 msgr2=0x7f6ac4068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/1243154965 2023-07-21T22:38:07.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.456+0000 7f6adbfff640 1 --2- 172.21.15.6:0/1082562409 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f6ac40664c0 0x7f6ac4068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:07.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.464+0000 7f6adaffd640 1 -- 172.21.15.6:0/1082562409 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ae4153560 con 0x7f6ae40d2300 2023-07-21T22:38:07.602 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:07.556+0000 7f1bd4455180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:38:07.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.620+0000 7f6ae8c7b640 1 -- 172.21.15.6:0/1082562409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ae4153560 con 0x7f6ae40d2300 2023-07-21T22:38:07.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.620+0000 7f6adaffd640 1 -- 172.21.15.6:0/1082562409 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v129) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6ae4153560 con 0x7f6ae40d2300 2023-07-21T22:38:07.667 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:38:07.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.624+0000 7f6ae8c7b640 1 -- 172.21.15.6:0/1082562409 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f6ac40664c0 msgr2=0x7f6ac4068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:07.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.624+0000 7f6ae8c7b640 1 --2- 172.21.15.6:0/1082562409 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f6ac40664c0 0x7f6ac4068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.624+0000 7f6ae8c7b640 1 -- 172.21.15.6:0/1082562409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae40d2300 msgr2=0x7f6ae40c8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:07.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.624+0000 7f6ae8c7b640 1 --2- 172.21.15.6:0/1082562409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae40d2300 0x7f6ae40c8ae0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40ae040 tx=0x7f6ad401aca0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.624+0000 7f6ae8c7b640 1 -- 172.21.15.6:0/1082562409 shutdown_connections 2023-07-21T22:38:07.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.624+0000 7f6ae8c7b640 1 --2- 172.21.15.6:0/1082562409 >> [v2:172.21.15.161:6832/1243154965,v1:172.21.15.161:6833/1243154965] conn(0x7f6ac40664c0 0x7f6ac4068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.624+0000 7f6ae8c7b640 1 --2- 172.21.15.6:0/1082562409 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ae415bde0 0x7f6ae415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.624+0000 7f6ae8c7b640 1 --2- 172.21.15.6:0/1082562409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ae40d2fc0 0x7f6ae40c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.624+0000 7f6ae8c7b640 1 --2- 172.21.15.6:0/1082562409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ae40d2300 0x7f6ae40c8ae0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.624+0000 7f6ae8c7b640 1 -- 172.21.15.6:0/1082562409 >> 172.21.15.6:0/1082562409 conn(0x7f6ae40659d0 msgr2=0x7f6ae406b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:07.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.624+0000 7f6ae8c7b640 1 -- 172.21.15.6:0/1082562409 shutdown_connections 2023-07-21T22:38:07.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.624+0000 7f6ae8c7b640 1 -- 172.21.15.6:0/1082562409 wait complete. 2023-07-21T22:38:07.671 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:07.628+0000 7f39bf246180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:38:07.689 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:38:07.693 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:07.648+0000 7f1bd4455180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:38:07.728 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:07.684+0000 7f39bf246180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:38:07.814 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:07.772+0000 7f394a876640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:07.814 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:07.772+0000 7f394a876640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:07.814 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:07.772+0000 7f394a876640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:07.815 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:07.772+0000 7f394a876640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:07.815 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:07.772+0000 7f394a876640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:07.815 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:07.772+0000 7f394586c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:07.815 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:07.772+0000 7f394586c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:07.816 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:07.772+0000 7f394586c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:07.816 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:07.772+0000 7f394586c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:07.816 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:07.772+0000 7f394586c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:07.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.808+0000 7fd34106d640 1 Processor -- start 2023-07-21T22:38:07.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.808+0000 7fd34106d640 1 -- start start 2023-07-21T22:38:07.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.808+0000 7fd34106d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd33c15bde0 0x7fd33c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:07.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.808+0000 7fd34106d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33c0b04c0 con 0x7fd33c0d2fc0 2023-07-21T22:38:07.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.808+0000 7fd34106d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33c0b1060 con 0x7fd33c0d2300 2023-07-21T22:38:07.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.808+0000 7fd34106d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33c15c1b0 con 0x7fd33c15bde0 2023-07-21T22:38:07.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.808+0000 7fd33ad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd33c15bde0 0x7fd33c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:07.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.808+0000 7fd33ad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd33c15bde0 0x7fd33c0d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51260/0 (socket says 172.21.15.6:51260) 2023-07-21T22:38:07.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.808+0000 7fd33ad9d640 1 -- 172.21.15.6:0/3326752706 learned_addr learned my addr 172.21.15.6:0/3326752706 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:07.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.808+0000 7fd33a59c640 1 --1- 172.21.15.6:0/3326752706 >> v1:172.21.15.6:6789/0 conn(0x7fd33c0d2fc0 0x7fd33c0b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41946/0 (socket says 172.21.15.6:41946) 2023-07-21T22:38:07.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.808+0000 7fd33ad9d640 1 -- 172.21.15.6:0/3326752706 >> v1:172.21.15.161:6789/0 conn(0x7fd33c0d2300 legacy=0x7fd33c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:07.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.808+0000 7fd33ad9d640 1 -- 172.21.15.6:0/3326752706 >> v1:172.21.15.6:6789/0 conn(0x7fd33c0d2fc0 legacy=0x7fd33c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:07.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.808+0000 7fd33ad9d640 1 -- 172.21.15.6:0/3326752706 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c0d0aa0 con 0x7fd33c15bde0 2023-07-21T22:38:07.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.812+0000 7fd33ad9d640 1 --2- 172.21.15.6:0/3326752706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd33c15bde0 0x7fd33c0d0270 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fd32c006fd0 tx=0x7fd32c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8089ffe1c600362 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:07.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.812+0000 7fd339d9b640 1 -- 172.21.15.6:0/3326752706 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c0aa640 con 0x7fd33c15bde0 2023-07-21T22:38:07.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.812+0000 7fd339d9b640 1 -- 172.21.15.6:0/3326752706 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32c0aa7a0 con 0x7fd33c15bde0 2023-07-21T22:38:07.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.812+0000 7fd339d9b640 1 -- 172.21.15.6:0/3326752706 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c0aab30 con 0x7fd33c15bde0 2023-07-21T22:38:07.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.812+0000 7fd34106d640 1 -- 172.21.15.6:0/3326752706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd33c15bde0 msgr2=0x7fd33c0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:07.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.812+0000 7fd34106d640 1 --2- 172.21.15.6:0/3326752706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd33c15bde0 0x7fd33c0d0270 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fd32c006fd0 tx=0x7fd32c01c4e0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.812+0000 7fd34106d640 1 -- 172.21.15.6:0/3326752706 shutdown_connections 2023-07-21T22:38:07.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.812+0000 7fd34106d640 1 --2- 172.21.15.6:0/3326752706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd33c15bde0 0x7fd33c0d0270 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.812+0000 7fd34106d640 1 -- 172.21.15.6:0/3326752706 >> 172.21.15.6:0/3326752706 conn(0x7fd33c0659d0 msgr2=0x7fd33c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:07.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.812+0000 7fd34106d640 1 -- 172.21.15.6:0/3326752706 shutdown_connections 2023-07-21T22:38:07.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.812+0000 7fd34106d640 1 -- 172.21.15.6:0/3326752706 wait complete. 2023-07-21T22:38:07.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.812+0000 7fd34106d640 1 Processor -- start 2023-07-21T22:38:07.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd34106d640 1 -- start start 2023-07-21T22:38:07.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd34106d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd33c0d2300 0x7fd33c0b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:07.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd34106d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd33c0d2fc0 0x7fd33c150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:07.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd34106d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd33c15bde0 0x7fd33c151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:07.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd34106d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c1512e0 con 0x7fd33c15bde0 2023-07-21T22:38:07.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd34106d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0b30d0 con 0x7fd33c0d2300 2023-07-21T22:38:07.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd34106d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0b33b0 con 0x7fd33c0d2fc0 2023-07-21T22:38:07.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd33b59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd33c15bde0 0x7fd33c151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:07.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd33b59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd33c15bde0 0x7fd33c151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51276/0 (socket says 172.21.15.6:51276) 2023-07-21T22:38:07.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd33b59e640 1 -- 172.21.15.6:0/553851846 learned_addr learned my addr 172.21.15.6:0/553851846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:07.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd33ad9d640 1 --2- 172.21.15.6:0/553851846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd33c0d2300 0x7fd33c0b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:07.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd33a59c640 1 --2- 172.21.15.6:0/553851846 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd33c0d2fc0 0x7fd33c150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:07.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd33b59e640 1 -- 172.21.15.6:0/553851846 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd33c0d2fc0 msgr2=0x7fd33c150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:07.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd33b59e640 1 --2- 172.21.15.6:0/553851846 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd33c0d2fc0 0x7fd33c150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd33b59e640 1 -- 172.21.15.6:0/553851846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd33c0d2300 msgr2=0x7fd33c0b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:07.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd33b59e640 1 --2- 172.21.15.6:0/553851846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd33c0d2300 0x7fd33c0b2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:07.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd33b59e640 1 -- 172.21.15.6:0/553851846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c009480 con 0x7fd33c15bde0 2023-07-21T22:38:07.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd33ad9d640 1 --2- 172.21.15.6:0/553851846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd33c0d2300 0x7fd33c0b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:07.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd33b59e640 1 --2- 172.21.15.6:0/553851846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd33c15bde0 0x7fd33c151690 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fd33400c780 tx=0x7fd33400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:07.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd3237fe640 1 -- 172.21.15.6:0/553851846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334004b70 con 0x7fd33c15bde0 2023-07-21T22:38:07.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd3237fe640 1 -- 172.21.15.6:0/553851846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33400ce90 con 0x7fd33c15bde0 2023-07-21T22:38:07.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd34106d640 1 -- 172.21.15.6:0/553851846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33c0b3690 con 0x7fd33c15bde0 2023-07-21T22:38:07.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd3237fe640 1 -- 172.21.15.6:0/553851846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33400a850 con 0x7fd33c15bde0 2023-07-21T22:38:07.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd34106d640 1 -- 172.21.15.6:0/553851846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33c0b3c50 con 0x7fd33c15bde0 2023-07-21T22:38:07.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.816+0000 7fd34106d640 1 -- 172.21.15.6:0/553851846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33c0678d0 con 0x7fd33c15bde0 2023-07-21T22:38:07.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.820+0000 7fd3237fe640 1 -- 172.21.15.6:0/553851846 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 56) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fd33400a9b0 con 0x7fd33c15bde0 2023-07-21T22:38:07.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.820+0000 7fd3237fe640 1 -- 172.21.15.6:0/553851846 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6880+0+0 (secure 0 0 0) 0x7fd334083d30 con 0x7fd33c15bde0 2023-07-21T22:38:07.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.824+0000 7fd3237fe640 1 -- 172.21.15.6:0/553851846 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd334051030 con 0x7fd33c15bde0 2023-07-21T22:38:08.010 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:07.964+0000 7f1bd4455180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:38:08.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.996+0000 7fd34106d640 1 -- 172.21.15.6:0/553851846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd33c0cceb0 con 0x7fd33c15bde0 2023-07-21T22:38:08.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.996+0000 7fd3237fe640 1 -- 172.21.15.6:0/553851846 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v130) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd334083030 con 0x7fd33c15bde0 2023-07-21T22:38:08.041 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:38:08.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.996+0000 7fd34106d640 1 -- 172.21.15.6:0/553851846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd33c15bde0 msgr2=0x7fd33c151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:08.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.996+0000 7fd34106d640 1 --2- 172.21.15.6:0/553851846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd33c15bde0 0x7fd33c151690 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fd33400c780 tx=0x7fd33400cc40 comp rx=0 tx=0).stop 2023-07-21T22:38:08.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.996+0000 7fd34106d640 1 -- 172.21.15.6:0/553851846 shutdown_connections 2023-07-21T22:38:08.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.996+0000 7fd34106d640 1 --2- 172.21.15.6:0/553851846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd33c15bde0 0x7fd33c151690 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.996+0000 7fd34106d640 1 --2- 172.21.15.6:0/553851846 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd33c0d2fc0 0x7fd33c150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.996+0000 7fd34106d640 1 --2- 172.21.15.6:0/553851846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd33c0d2300 0x7fd33c0b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.996+0000 7fd34106d640 1 -- 172.21.15.6:0/553851846 >> 172.21.15.6:0/553851846 conn(0x7fd33c0659d0 msgr2=0x7fd33c0cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:08.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.996+0000 7fd34106d640 1 -- 172.21.15.6:0/553851846 shutdown_connections 2023-07-21T22:38:08.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:07.996+0000 7fd34106d640 1 -- 172.21.15.6:0/553851846 wait complete. 2023-07-21T22:38:08.062 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:38:08.075 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:08.028+0000 7f1bd4455180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:38:08.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.164+0000 7fbdc3d03640 1 Processor -- start 2023-07-21T22:38:08.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.164+0000 7fbdc3d03640 1 -- start start 2023-07-21T22:38:08.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.164+0000 7fbdc3d03640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbdbc06a540 0x7fbdbc06a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:08.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.164+0000 7fbdc3d03640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdbc0cf710 0x7fbdbc0cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:08.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.164+0000 7fbdc3d03640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdbc0cb7a0 con 0x7fbdbc0cf2e0 2023-07-21T22:38:08.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.164+0000 7fbdc3d03640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdbc0d0920 con 0x7fbdbc06a540 2023-07-21T22:38:08.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.164+0000 7fbdc3d03640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc15bfd0 con 0x7fbdbc0cf710 2023-07-21T22:38:08.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.164+0000 7fbdc1a9f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbdbc06a540 0x7fbdbc06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:08.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.164+0000 7fbdc129e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbdbc0cf2e0 0x7fbdbc0cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41958/0 (socket says 172.21.15.6:41958) 2023-07-21T22:38:08.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.164+0000 7fbdc129e640 1 -- 172.21.15.6:0/485513022 learned_addr learned my addr 172.21.15.6:0/485513022 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:08.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.164+0000 7fbdc22a0640 1 --2- 172.21.15.6:0/485513022 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdbc0cf710 0x7fbdbc0cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:08.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.164+0000 7fbdc1a9f640 1 -- 172.21.15.6:0/485513022 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdbc0cf710 msgr2=0x7fbdbc0cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:08.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.164+0000 7fbdc1a9f640 1 --2- 172.21.15.6:0/485513022 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdbc0cf710 0x7fbdbc0cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.164+0000 7fbdc1a9f640 1 -- 172.21.15.6:0/485513022 >> v1:172.21.15.6:6789/0 conn(0x7fbdbc0cf2e0 legacy=0x7fbdbc0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:08.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.164+0000 7fbdc1a9f640 1 -- 172.21.15.6:0/485513022 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc06ae50 con 0x7fbdbc06a540 2023-07-21T22:38:08.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.164+0000 7fbdc0a9d640 1 -- 172.21.15.6:0/485513022 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133690064 0 0) 0x7fbdbc0cb7a0 con 0x7fbdbc0cf2e0 2023-07-21T22:38:08.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.168+0000 7fbdc1a9f640 1 --2- 172.21.15.6:0/485513022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdbc06a540 0x7fbdbc06a910 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80097c0 tx=0x7fbdb801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8fac0a9293f79 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:08.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.168+0000 7fbdc0a9d640 1 -- 172.21.15.6:0/485513022 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb80ad660 con 0x7fbdbc06a540 2023-07-21T22:38:08.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.168+0000 7fbdc0a9d640 1 -- 172.21.15.6:0/485513022 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb80ad7c0 con 0x7fbdbc06a540 2023-07-21T22:38:08.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.168+0000 7fbdc0a9d640 1 -- 172.21.15.6:0/485513022 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb80adb50 con 0x7fbdbc06a540 2023-07-21T22:38:08.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.168+0000 7fbdc3d03640 1 -- 172.21.15.6:0/485513022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdbc06a540 msgr2=0x7fbdbc06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:08.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.168+0000 7fbdc3d03640 1 --2- 172.21.15.6:0/485513022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdbc06a540 0x7fbdbc06a910 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80097c0 tx=0x7fbdb801c450 comp rx=0 tx=0).stop 2023-07-21T22:38:08.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.168+0000 7fbdc3d03640 1 -- 172.21.15.6:0/485513022 shutdown_connections 2023-07-21T22:38:08.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.168+0000 7fbdc3d03640 1 --2- 172.21.15.6:0/485513022 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdbc0cf710 0x7fbdbc0cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.168+0000 7fbdc3d03640 1 --2- 172.21.15.6:0/485513022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdbc06a540 0x7fbdbc06a910 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.168+0000 7fbdc3d03640 1 -- 172.21.15.6:0/485513022 >> 172.21.15.6:0/485513022 conn(0x7fbdbc099490 msgr2=0x7fbdbc089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:08.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.168+0000 7fbdc3d03640 1 -- 172.21.15.6:0/485513022 shutdown_connections 2023-07-21T22:38:08.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.168+0000 7fbdc3d03640 1 -- 172.21.15.6:0/485513022 wait complete. 2023-07-21T22:38:08.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc3d03640 1 Processor -- start 2023-07-21T22:38:08.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc3d03640 1 -- start start 2023-07-21T22:38:08.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc3d03640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdbc06a540 0x7fbdbc15a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:08.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc3d03640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdbc0cf2e0 0x7fbdbc0b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:08.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc3d03640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdbc0cf710 0x7fbdbc14aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:08.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc3d03640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc15bcf0 con 0x7fbdbc06a540 2023-07-21T22:38:08.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc3d03640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc15b070 con 0x7fbdbc0cf2e0 2023-07-21T22:38:08.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc3d03640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc15b350 con 0x7fbdbc0cf710 2023-07-21T22:38:08.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc1a9f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdbc06a540 0x7fbdbc15a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:08.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc1a9f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdbc06a540 0x7fbdbc15a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51284/0 (socket says 172.21.15.6:51284) 2023-07-21T22:38:08.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc1a9f640 1 -- 172.21.15.6:0/2428592192 learned_addr learned my addr 172.21.15.6:0/2428592192 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:08.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc22a0640 1 --2- 172.21.15.6:0/2428592192 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdbc0cf710 0x7fbdbc14aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:08.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc129e640 1 --2- 172.21.15.6:0/2428592192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdbc0cf2e0 0x7fbdbc0b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:08.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc1a9f640 1 -- 172.21.15.6:0/2428592192 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdbc0cf710 msgr2=0x7fbdbc14aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:08.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc1a9f640 1 --2- 172.21.15.6:0/2428592192 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdbc0cf710 0x7fbdbc14aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc1a9f640 1 -- 172.21.15.6:0/2428592192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdbc0cf2e0 msgr2=0x7fbdbc0b06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:08.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc1a9f640 1 --2- 172.21.15.6:0/2428592192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdbc0cf2e0 0x7fbdbc0b06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc1a9f640 1 -- 172.21.15.6:0/2428592192 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb8009420 con 0x7fbdbc06a540 2023-07-21T22:38:08.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc129e640 1 --2- 172.21.15.6:0/2428592192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdbc0cf2e0 0x7fbdbc0b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:08.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc1a9f640 1 --2- 172.21.15.6:0/2428592192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdbc06a540 0x7fbdbc15a700 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80b0040 tx=0x7fbdb801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:08.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdb27fc640 1 -- 172.21.15.6:0/2428592192 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb80b9650 con 0x7fbdbc06a540 2023-07-21T22:38:08.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdb27fc640 1 -- 172.21.15.6:0/2428592192 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb80b97f0 con 0x7fbdbc06a540 2023-07-21T22:38:08.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdb27fc640 1 -- 172.21.15.6:0/2428592192 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb80b9ba0 con 0x7fbdbc06a540 2023-07-21T22:38:08.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc3d03640 1 -- 172.21.15.6:0/2428592192 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdbc15b630 con 0x7fbdbc06a540 2023-07-21T22:38:08.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.172+0000 7fbdc3d03640 1 -- 172.21.15.6:0/2428592192 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdbc15ac40 con 0x7fbdbc06a540 2023-07-21T22:38:08.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.176+0000 7fbdc3d03640 1 -- 172.21.15.6:0/2428592192 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdbc137b70 con 0x7fbdbc06a540 2023-07-21T22:38:08.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.176+0000 7fbdb27fc640 1 -- 172.21.15.6:0/2428592192 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 56) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fbdb80b9d00 con 0x7fbdbc06a540 2023-07-21T22:38:08.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.176+0000 7fbdb27fc640 1 -- 172.21.15.6:0/2428592192 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6880+0+0 (secure 0 0 0) 0x7fbdb811e610 con 0x7fbdbc06a540 2023-07-21T22:38:08.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.180+0000 7fbdb27fc640 1 -- 172.21.15.6:0/2428592192 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbdbc137b70 con 0x7fbdbc06a540 2023-07-21T22:38:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.332+0000 7fbdc3d03640 1 -- 172.21.15.6:0/2428592192 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbdbc137b70 con 0x7fbdbc06a540 2023-07-21T22:38:08.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.336+0000 7fbdb27fc640 1 -- 172.21.15.6:0/2428592192 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v130) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbdbc137b70 con 0x7fbdbc06a540 2023-07-21T22:38:08.380 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:38:08.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.336+0000 7fbdc3d03640 1 -- 172.21.15.6:0/2428592192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdbc06a540 msgr2=0x7fbdbc15a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:08.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.336+0000 7fbdc3d03640 1 --2- 172.21.15.6:0/2428592192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdbc06a540 0x7fbdbc15a700 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80b0040 tx=0x7fbdb801ac90 comp rx=0 tx=0).stop 2023-07-21T22:38:08.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.336+0000 7fbdc3d03640 1 -- 172.21.15.6:0/2428592192 shutdown_connections 2023-07-21T22:38:08.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.336+0000 7fbdc3d03640 1 --2- 172.21.15.6:0/2428592192 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdbc0cf710 0x7fbdbc14aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.336+0000 7fbdc3d03640 1 --2- 172.21.15.6:0/2428592192 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdbc0cf2e0 0x7fbdbc0b06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.336+0000 7fbdc3d03640 1 --2- 172.21.15.6:0/2428592192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdbc06a540 0x7fbdbc15a700 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.336+0000 7fbdc3d03640 1 -- 172.21.15.6:0/2428592192 >> 172.21.15.6:0/2428592192 conn(0x7fbdbc099490 msgr2=0x7fbdbc0afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.336+0000 7fbdc3d03640 1 -- 172.21.15.6:0/2428592192 shutdown_connections 2023-07-21T22:38:08.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.336+0000 7fbdc3d03640 1 -- 172.21.15.6:0/2428592192 wait complete. 2023-07-21T22:38:08.401 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:38:08.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.544+0000 7f0b16140640 1 Processor -- start 2023-07-21T22:38:08.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.544+0000 7f0b16140640 1 -- start start 2023-07-21T22:38:08.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.544+0000 7f0b16140640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0b10070f30 0x7f0b100ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:08.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.544+0000 7f0b16140640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b100af2b0 0x7f0b1015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:08.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.544+0000 7f0b16140640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b10159d70 con 0x7f0b10069430 2023-07-21T22:38:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.544+0000 7f0b16140640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b100c9c60 con 0x7f0b10070f30 2023-07-21T22:38:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.544+0000 7f0b16140640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100c9f40 con 0x7f0b100af2b0 2023-07-21T22:38:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.544+0000 7f0b0f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0b10069430 0x7f0b10069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41972/0 (socket says 172.21.15.6:41972) 2023-07-21T22:38:08.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.544+0000 7f0b0f7fe640 1 -- 172.21.15.6:0/3994996507 learned_addr learned my addr 172.21.15.6:0/3994996507 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.544+0000 7f0b0ffff640 1 --2- 172.21.15.6:0/3994996507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b100af2b0 0x7f0b1015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.544+0000 7f0b0effd640 1 --2- 172.21.15.6:0/3994996507 >> v2:172.21.15.161:3300/0 conn(0x7f0b10070f30 0x7f0b100ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.548+0000 7f0b0e7fc640 1 -- 172.21.15.6:0/3994996507 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84885620 0 0) 0x7f0b00001120 con 0x7f0b10069430 2023-07-21T22:38:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.548+0000 7f0b0e7fc640 1 -- 172.21.15.6:0/3994996507 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0af8003530 con 0x7f0b10069430 2023-07-21T22:38:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.548+0000 7f0b0ffff640 1 -- 172.21.15.6:0/3994996507 >> v2:172.21.15.161:3300/0 conn(0x7f0b10070f30 msgr2=0x7f0b100ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.548+0000 7f0b0ffff640 1 --2- 172.21.15.6:0/3994996507 >> v2:172.21.15.161:3300/0 conn(0x7f0b10070f30 0x7f0b100ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.548+0000 7f0b0ffff640 1 -- 172.21.15.6:0/3994996507 >> v1:172.21.15.6:6789/0 conn(0x7f0b10069430 legacy=0x7f0b10069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.548+0000 7f0b0ffff640 1 -- 172.21.15.6:0/3994996507 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b100ca220 con 0x7f0b100af2b0 2023-07-21T22:38:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.548+0000 7f0b0ffff640 1 --2- 172.21.15.6:0/3994996507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b100af2b0 0x7f0b1015a1f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009d90 tx=0x7f0b0801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bcb80fc6bd645b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:08.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.548+0000 7f0b0e7fc640 1 -- 172.21.15.6:0/3994996507 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b080a5920 con 0x7f0b100af2b0 2023-07-21T22:38:08.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.548+0000 7f0b0e7fc640 1 -- 172.21.15.6:0/3994996507 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b080a5a80 con 0x7f0b100af2b0 2023-07-21T22:38:08.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.548+0000 7f0b0e7fc640 1 -- 172.21.15.6:0/3994996507 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b080a5e10 con 0x7f0b100af2b0 2023-07-21T22:38:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.552+0000 7f0b16140640 1 -- 172.21.15.6:0/3994996507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b100af2b0 msgr2=0x7f0b1015a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.552+0000 7f0b16140640 1 --2- 172.21.15.6:0/3994996507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b100af2b0 0x7f0b1015a1f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0b08009d90 tx=0x7f0b0801c950 comp rx=0 tx=0).stop 2023-07-21T22:38:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.552+0000 7f0b16140640 1 -- 172.21.15.6:0/3994996507 shutdown_connections 2023-07-21T22:38:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.552+0000 7f0b16140640 1 --2- 172.21.15.6:0/3994996507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b100af2b0 0x7f0b1015a1f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.552+0000 7f0b16140640 1 --2- 172.21.15.6:0/3994996507 >> v2:172.21.15.161:3300/0 conn(0x7f0b10070f30 0x7f0b100ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.552+0000 7f0b16140640 1 -- 172.21.15.6:0/3994996507 >> 172.21.15.6:0/3994996507 conn(0x7f0b100cde90 msgr2=0x7f0b100ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:08.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.552+0000 7f0b16140640 1 -- 172.21.15.6:0/3994996507 shutdown_connections 2023-07-21T22:38:08.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.552+0000 7f0b16140640 1 -- 172.21.15.6:0/3994996507 wait complete. 2023-07-21T22:38:08.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.552+0000 7f0b16140640 1 Processor -- start 2023-07-21T22:38:08.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.552+0000 7f0b16140640 1 -- start start 2023-07-21T22:38:08.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.552+0000 7f0b16140640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b10069430 0x7f0b100b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:08.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.552+0000 7f0b16140640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b10070f30 0x7f0b1014f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:08.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.552+0000 7f0b16140640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b100af2b0 0x7f0b10152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.552+0000 7f0b16140640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100c3d70 con 0x7f0b10070f30 2023-07-21T22:38:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.552+0000 7f0b16140640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100c3160 con 0x7f0b10069430 2023-07-21T22:38:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.552+0000 7f0b16140640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100c3440 con 0x7f0b100af2b0 2023-07-21T22:38:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.552+0000 7f0b0effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b10070f30 0x7f0b1014f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.552+0000 7f0b0effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b10070f30 0x7f0b1014f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51286/0 (socket says 172.21.15.6:51286) 2023-07-21T22:38:08.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.552+0000 7f0b0effd640 1 -- 172.21.15.6:0/1610789180 learned_addr learned my addr 172.21.15.6:0/1610789180 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:08.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.556+0000 7f0b0ffff640 1 --2- 172.21.15.6:0/1610789180 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b100af2b0 0x7f0b10152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.556+0000 7f0b0effd640 1 -- 172.21.15.6:0/1610789180 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b100af2b0 msgr2=0x7f0b10152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.556+0000 7f0b0f7fe640 1 --2- 172.21.15.6:0/1610789180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b10069430 0x7f0b100b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.556+0000 7f0b0effd640 1 --2- 172.21.15.6:0/1610789180 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b100af2b0 0x7f0b10152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.556+0000 7f0b0effd640 1 -- 172.21.15.6:0/1610789180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b10069430 msgr2=0x7f0b100b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.556+0000 7f0b0effd640 1 --2- 172.21.15.6:0/1610789180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b10069430 0x7f0b100b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.556+0000 7f0b0effd640 1 -- 172.21.15.6:0/1610789180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b08009a70 con 0x7f0b10070f30 2023-07-21T22:38:08.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.556+0000 7f0b0ffff640 1 --2- 172.21.15.6:0/1610789180 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b100af2b0 0x7f0b10152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:08.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.556+0000 7f0b0f7fe640 1 --2- 172.21.15.6:0/1610789180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b10069430 0x7f0b100b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:08.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.556+0000 7f0b0effd640 1 --2- 172.21.15.6:0/1610789180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b10070f30 0x7f0b1014f090 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400e930 tx=0x7f0b0400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:08.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.556+0000 7f0af7fff640 1 -- 172.21.15.6:0/1610789180 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b04009690 con 0x7f0b10070f30 2023-07-21T22:38:08.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.556+0000 7f0af7fff640 1 -- 172.21.15.6:0/1610789180 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0400ca00 con 0x7f0b10070f30 2023-07-21T22:38:08.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.556+0000 7f0af7fff640 1 -- 172.21.15.6:0/1610789180 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0400cd70 con 0x7f0b10070f30 2023-07-21T22:38:08.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.556+0000 7f0b16140640 1 -- 172.21.15.6:0/1610789180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b100c3720 con 0x7f0b10070f30 2023-07-21T22:38:08.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.556+0000 7f0b16140640 1 -- 172.21.15.6:0/1610789180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b100c2e50 con 0x7f0b10070f30 2023-07-21T22:38:08.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.556+0000 7f0b16140640 1 -- 172.21.15.6:0/1610789180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b100c3ee0 con 0x7f0b10070f30 2023-07-21T22:38:08.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.556+0000 7f0af7fff640 1 -- 172.21.15.6:0/1610789180 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 56) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f0b04013470 con 0x7f0b10070f30 2023-07-21T22:38:08.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.556+0000 7f0af7fff640 1 -- 172.21.15.6:0/1610789180 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6880+0+0 (secure 0 0 0) 0x7f0b04083d40 con 0x7f0b10070f30 2023-07-21T22:38:08.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.560+0000 7f0af7fff640 1 -- 172.21.15.6:0/1610789180 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b04087030 con 0x7f0b10070f30 2023-07-21T22:38:08.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.708+0000 7f0af7fff640 1 -- 172.21.15.6:0/1610789180 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 57) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f0b04050e50 con 0x7f0b10070f30 2023-07-21T22:38:08.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.708+0000 7f0af7fff640 1 --2- 172.21.15.6:0/1610789180 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0afc06c170 0x7f0afc06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:08.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.708+0000 7f0b0f7fe640 1 --2- 172.21.15.6:0/1610789180 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0afc06c170 0x7f0afc06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:08.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.708+0000 7f0b0f7fe640 1 --2- 172.21.15.6:0/1610789180 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0afc06c170 0x7f0afc06e550 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0b00007fd0 tx=0x7f0b00009040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:08.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.728+0000 7f0b16140640 1 -- 172.21.15.6:0/1610789180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b100678d0 con 0x7f0b10070f30 2023-07-21T22:38:08.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.728+0000 7f0af7fff640 1 -- 172.21.15.6:0/1610789180 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v131) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b0406e2f0 con 0x7f0b10070f30 2023-07-21T22:38:08.773 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:38:08.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.728+0000 7f0b16140640 1 -- 172.21.15.6:0/1610789180 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0afc06c170 msgr2=0x7f0afc06e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:08.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.728+0000 7f0b16140640 1 --2- 172.21.15.6:0/1610789180 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0afc06c170 0x7f0afc06e550 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0b00007fd0 tx=0x7f0b00009040 comp rx=0 tx=0).stop 2023-07-21T22:38:08.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.728+0000 7f0b16140640 1 -- 172.21.15.6:0/1610789180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b10070f30 msgr2=0x7f0b1014f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.728+0000 7f0b16140640 1 --2- 172.21.15.6:0/1610789180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b10070f30 0x7f0b1014f090 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400e930 tx=0x7f0b0400edf0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.728+0000 7f0b16140640 1 -- 172.21.15.6:0/1610789180 shutdown_connections 2023-07-21T22:38:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.728+0000 7f0b16140640 1 --2- 172.21.15.6:0/1610789180 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0afc06c170 0x7f0afc06e550 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.728+0000 7f0b16140640 1 --2- 172.21.15.6:0/1610789180 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0b100af2b0 0x7f0b10152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.728+0000 7f0b16140640 1 --2- 172.21.15.6:0/1610789180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b10070f30 0x7f0b1014f090 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.728+0000 7f0b16140640 1 --2- 172.21.15.6:0/1610789180 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b10069430 0x7f0b100b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.728+0000 7f0b16140640 1 -- 172.21.15.6:0/1610789180 >> 172.21.15.6:0/1610789180 conn(0x7f0b100cde90 msgr2=0x7f0b100ae230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:08.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.728+0000 7f0b16140640 1 -- 172.21.15.6:0/1610789180 shutdown_connections 2023-07-21T22:38:08.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.728+0000 7f0b16140640 1 -- 172.21.15.6:0/1610789180 wait complete. 2023-07-21T22:38:08.794 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:38:08.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.892+0000 7f11ff6f9640 1 Processor -- start 2023-07-21T22:38:08.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.892+0000 7f11ff6f9640 1 -- start start 2023-07-21T22:38:08.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.892+0000 7f11ff6f9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f11f80d06b0 0x7f11f80b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:08.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.892+0000 7f11ff6f9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f80b2410 con 0x7f11f80b1f70 2023-07-21T22:38:08.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.892+0000 7f11ff6f9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f80b26f0 con 0x7f11f8145430 2023-07-21T22:38:08.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.892+0000 7f11ff6f9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f80b29d0 con 0x7f11f80d06b0 2023-07-21T22:38:08.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11fdc96640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f11f80b1f70 0x7f11f80d22e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41986/0 (socket says 172.21.15.6:41986) 2023-07-21T22:38:08.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11fdc96640 1 -- 172.21.15.6:0/1749879458 learned_addr learned my addr 172.21.15.6:0/1749879458 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11fd495640 1 --2- 172.21.15.6:0/1749879458 >> v2:172.21.15.161:3300/0 conn(0x7f11f80d06b0 0x7f11f80b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11effff640 1 -- 172.21.15.6:0/1749879458 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517745935 0 0) 0x7f11f80b2410 con 0x7f11f80b1f70 2023-07-21T22:38:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11effff640 1 -- 172.21.15.6:0/1749879458 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11e4003530 con 0x7f11f80b1f70 2023-07-21T22:38:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11effff640 1 -- 172.21.15.6:0/1749879458 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 563592257 0 0) 0x7f11e4003530 con 0x7f11f80b1f70 2023-07-21T22:38:08.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11effff640 1 -- 172.21.15.6:0/1749879458 >> v2:172.21.15.161:3300/0 conn(0x7f11f80d06b0 msgr2=0x7f11f80b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11effff640 1 --2- 172.21.15.6:0/1749879458 >> v2:172.21.15.161:3300/0 conn(0x7f11f80d06b0 0x7f11f80b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11effff640 1 -- 172.21.15.6:0/1749879458 >> v1:172.21.15.161:6789/0 conn(0x7f11f8145430 legacy=0x7f11f80b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11effff640 1 -- 172.21.15.6:0/1749879458 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f80b2cb0 con 0x7f11f80b1f70 2023-07-21T22:38:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11effff640 1 -- 172.21.15.6:0/1749879458 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f11f0001a00 con 0x7f11f80b1f70 2023-07-21T22:38:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11effff640 1 -- 172.21.15.6:0/1749879458 >> v1:172.21.15.6:6789/0 conn(0x7f11f80b1f70 legacy=0x7f11f80d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11effff640 1 --2- 172.21.15.6:0/1749879458 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11e4003980 0x7f11e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:08.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11effff640 1 --2- 172.21.15.6:0/1749879458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11e40047d0 0x7f11e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:08.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11effff640 1 --2- 172.21.15.6:0/1749879458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11e4005180 0x7f11e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:08.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11effff640 1 -- 172.21.15.6:0/1749879458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f80b29d0 con 0x7f11e4005180 2023-07-21T22:38:08.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11effff640 1 -- 172.21.15.6:0/1749879458 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e400c000 con 0x7f11e40047d0 2023-07-21T22:38:08.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11effff640 1 -- 172.21.15.6:0/1749879458 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e400c1c0 con 0x7f11e4003980 2023-07-21T22:38:08.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11fdc96640 1 --2- 172.21.15.6:0/1749879458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11e4005180 0x7f11e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:08.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11fcc94640 1 --2- 172.21.15.6:0/1749879458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11e40047d0 0x7f11e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:08.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11fd495640 1 --2- 172.21.15.6:0/1749879458 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11e4003980 0x7f11e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:08.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11fdc96640 1 -- 172.21.15.6:0/1749879458 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11e4003980 msgr2=0x7f11e4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:08.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11fdc96640 1 --2- 172.21.15.6:0/1749879458 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11e4003980 0x7f11e4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11fdc96640 1 -- 172.21.15.6:0/1749879458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11e40047d0 msgr2=0x7f11e4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:08.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11fdc96640 1 --2- 172.21.15.6:0/1749879458 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11e40047d0 0x7f11e4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.896+0000 7f11fdc96640 1 -- 172.21.15.6:0/1749879458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e4003530 con 0x7f11e4005180 2023-07-21T22:38:08.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.900+0000 7f11fdc96640 1 -- 172.21.15.6:0/1749879458 reap_dead start 2023-07-21T22:38:08.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.900+0000 7f11fdc96640 1 --2- 172.21.15.6:0/1749879458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11e4005180 0x7f11e400b990 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f11f000a800 tx=0x7f11f001d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b412f18fbf2284e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:08.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.900+0000 7f11effff640 1 -- 172.21.15.6:0/1749879458 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f00072d0 con 0x7f11e4005180 2023-07-21T22:38:08.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.900+0000 7f11effff640 1 -- 172.21.15.6:0/1749879458 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f00a8070 con 0x7f11e4005180 2023-07-21T22:38:08.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.900+0000 7f11effff640 1 -- 172.21.15.6:0/1749879458 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f0007690 con 0x7f11e4005180 2023-07-21T22:38:08.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.900+0000 7f11ff6f9640 1 -- 172.21.15.6:0/1749879458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11e4005180 msgr2=0x7f11e400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:08.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.900+0000 7f11ff6f9640 1 --2- 172.21.15.6:0/1749879458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11e4005180 0x7f11e400b990 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f11f000a800 tx=0x7f11f001d300 comp rx=0 tx=0).stop 2023-07-21T22:38:08.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.900+0000 7f11ff6f9640 1 -- 172.21.15.6:0/1749879458 shutdown_connections 2023-07-21T22:38:08.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.900+0000 7f11ff6f9640 1 --2- 172.21.15.6:0/1749879458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11e4005180 0x7f11e400b990 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.900+0000 7f11ff6f9640 1 -- 172.21.15.6:0/1749879458 >> 172.21.15.6:0/1749879458 conn(0x7f11f80659d0 msgr2=0x7f11f809b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:08.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.900+0000 7f11ff6f9640 1 -- 172.21.15.6:0/1749879458 shutdown_connections 2023-07-21T22:38:08.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.900+0000 7f11ff6f9640 1 -- 172.21.15.6:0/1749879458 wait complete. 2023-07-21T22:38:08.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.900+0000 7f11ff6f9640 1 Processor -- start 2023-07-21T22:38:08.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.900+0000 7f11ff6f9640 1 -- start start 2023-07-21T22:38:08.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11ff6f9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11e4005180 0x7f11f8159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:08.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11ff6f9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11f80c6890 0x7f11f80c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:08.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11ff6f9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11f80c9a40 0x7f11f80c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:08.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11ff6f9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f8159d90 con 0x7f11f80c6890 2023-07-21T22:38:08.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11ff6f9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f80b6f70 con 0x7f11e4005180 2023-07-21T22:38:08.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11ff6f9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f80c7400 con 0x7f11f80c9a40 2023-07-21T22:38:08.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11fcc94640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11f80c6890 0x7f11f80c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:08.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11fcc94640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11f80c6890 0x7f11f80c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51298/0 (socket says 172.21.15.6:51298) 2023-07-21T22:38:08.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11fcc94640 1 -- 172.21.15.6:0/184867428 learned_addr learned my addr 172.21.15.6:0/184867428 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:08.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11fd495640 1 --2- 172.21.15.6:0/184867428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11e4005180 0x7f11f8159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:08.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11fdc96640 1 --2- 172.21.15.6:0/184867428 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11f80c9a40 0x7f11f80c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:08.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11fcc94640 1 -- 172.21.15.6:0/184867428 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11f80c9a40 msgr2=0x7f11f80c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:08.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11fcc94640 1 --2- 172.21.15.6:0/184867428 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11f80c9a40 0x7f11f80c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11fcc94640 1 -- 172.21.15.6:0/184867428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11e4005180 msgr2=0x7f11f8159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:08.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11fcc94640 1 --2- 172.21.15.6:0/184867428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11e4005180 0x7f11f8159850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:08.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11fcc94640 1 -- 172.21.15.6:0/184867428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f80c76e0 con 0x7f11f80c6890 2023-07-21T22:38:08.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11fcc94640 1 --2- 172.21.15.6:0/184867428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11f80c6890 0x7f11f80c6d00 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f11e800e4b0 tx=0x7f11e800e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:08.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11edffb640 1 -- 172.21.15.6:0/184867428 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e80052e0 con 0x7f11f80c6890 2023-07-21T22:38:08.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11edffb640 1 -- 172.21.15.6:0/184867428 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e8005440 con 0x7f11f80c6890 2023-07-21T22:38:08.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11edffb640 1 -- 172.21.15.6:0/184867428 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8003840 con 0x7f11f80c6890 2023-07-21T22:38:08.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11ff6f9640 1 -- 172.21.15.6:0/184867428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f80c79c0 con 0x7f11f80c6890 2023-07-21T22:38:08.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11ff6f9640 1 -- 172.21.15.6:0/184867428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f80c7f80 con 0x7f11f80c6890 2023-07-21T22:38:08.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.904+0000 7f11ff6f9640 1 -- 172.21.15.6:0/184867428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f80678d0 con 0x7f11f80c6890 2023-07-21T22:38:08.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.908+0000 7f11edffb640 1 -- 172.21.15.6:0/184867428 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 57) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f11e80039a0 con 0x7f11f80c6890 2023-07-21T22:38:08.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.908+0000 7f11edffb640 1 --2- 172.21.15.6:0/184867428 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f11dc0660d0 0x7f11dc068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:08.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.908+0000 7f11edffb640 1 -- 172.21.15.6:0/184867428 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6936+0+0 (secure 0 0 0) 0x7f11e8083940 con 0x7f11f80c6890 2023-07-21T22:38:08.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.908+0000 7f11fd495640 1 --2- 172.21.15.6:0/184867428 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f11dc0660d0 0x7f11dc068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:08.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.908+0000 7f11fd495640 1 --2- 172.21.15.6:0/184867428 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f11dc0660d0 0x7f11dc068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f11f4009a60 tx=0x7f11f4008040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:08.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:08.912+0000 7f11edffb640 1 -- 172.21.15.6:0/184867428 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f11e8050d70 con 0x7f11f80c6890 2023-07-21T22:38:09.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.112+0000 7f11ff6f9640 1 -- 172.21.15.6:0/184867428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11f80d2e80 con 0x7f11f80c6890 2023-07-21T22:38:09.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.112+0000 7f11edffb640 1 -- 172.21.15.6:0/184867428 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f11e8054390 con 0x7f11f80c6890 2023-07-21T22:38:09.158 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:09.158 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1099541342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1099541342},{"type":"v1","addr":"172.21.15.161:6837","nonce":1099541342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3942495258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3942495258},{"type":"v1","addr":"172.21.15.161:6836","nonce":3942495258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8211,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3306024838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3306024838},{"type":"v1","addr":"172.21.15.6:6834","nonce":3306024838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:37:21.460444+0000","modified":"2023-07-21T22:37:25.102431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8214":{"gid":8214,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2511188295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2511188295},{"type":"v1","addr":"172.21.15.6:6835","nonce":2511188295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-21T22:38:09.159 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 54 2023-07-21T22:38:09.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.116+0000 7f11ff6f9640 1 -- 172.21.15.6:0/184867428 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f11dc0660d0 msgr2=0x7f11dc068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:09.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.116+0000 7f11ff6f9640 1 --2- 172.21.15.6:0/184867428 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f11dc0660d0 0x7f11dc068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f11f4009a60 tx=0x7f11f4008040 comp rx=0 tx=0).stop 2023-07-21T22:38:09.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.116+0000 7f11ff6f9640 1 -- 172.21.15.6:0/184867428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11f80c6890 msgr2=0x7f11f80c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:09.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.116+0000 7f11ff6f9640 1 --2- 172.21.15.6:0/184867428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11f80c6890 0x7f11f80c6d00 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f11e800e4b0 tx=0x7f11e800e970 comp rx=0 tx=0).stop 2023-07-21T22:38:09.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.116+0000 7f11ff6f9640 1 -- 172.21.15.6:0/184867428 shutdown_connections 2023-07-21T22:38:09.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.116+0000 7f11ff6f9640 1 --2- 172.21.15.6:0/184867428 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f11dc0660d0 0x7f11dc068580 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.116+0000 7f11ff6f9640 1 --2- 172.21.15.6:0/184867428 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11f80c9a40 0x7f11f80c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.116+0000 7f11ff6f9640 1 --2- 172.21.15.6:0/184867428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11f80c6890 0x7f11f80c6d00 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.116+0000 7f11ff6f9640 1 --2- 172.21.15.6:0/184867428 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11e4005180 0x7f11f8159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.116+0000 7f11ff6f9640 1 -- 172.21.15.6:0/184867428 >> 172.21.15.6:0/184867428 conn(0x7f11f80659d0 msgr2=0x7f11f80af150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:09.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.116+0000 7f11ff6f9640 1 -- 172.21.15.6:0/184867428 shutdown_connections 2023-07-21T22:38:09.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.116+0000 7f11ff6f9640 1 -- 172.21.15.6:0/184867428 wait complete. 2023-07-21T22:38:09.180 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:38:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.280+0000 7f05c046d640 1 Processor -- start 2023-07-21T22:38:09.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.280+0000 7f05c046d640 1 -- start start 2023-07-21T22:38:09.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.280+0000 7f05c046d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05b80b7c70 0x7f05b80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.280+0000 7f05c046d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f05b815fd60 0x7f05b80d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.280+0000 7f05c046d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b80ccaf0 con 0x7f05b80d1850 2023-07-21T22:38:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.280+0000 7f05c046d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b80d1190 con 0x7f05b815fd60 2023-07-21T22:38:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.280+0000 7f05c046d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b8160600 con 0x7f05b80b7c70 2023-07-21T22:38:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.280+0000 7f05bea0a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f05b815fd60 0x7f05b80d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.280+0000 7f05bea0a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f05b815fd60 0x7f05b80d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51314/0 (socket says 172.21.15.6:51314) 2023-07-21T22:38:09.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.280+0000 7f05bea0a640 1 -- 172.21.15.6:0/4063143490 learned_addr learned my addr 172.21.15.6:0/4063143490 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:09.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.280+0000 7f05be209640 1 --2- 172.21.15.6:0/4063143490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05b80b7c70 0x7f05b80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:09.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.280+0000 7f05bea0a640 1 -- 172.21.15.6:0/4063143490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05b80b7c70 msgr2=0x7f05b80d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:09.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.280+0000 7f05bea0a640 1 --2- 172.21.15.6:0/4063143490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05b80b7c70 0x7f05b80d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.280+0000 7f05bea0a640 1 -- 172.21.15.6:0/4063143490 >> v1:172.21.15.161:6789/0 conn(0x7f05b80d1850 legacy=0x7f05b815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:09.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.280+0000 7f05bea0a640 1 -- 172.21.15.6:0/4063143490 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b8160320 con 0x7f05b815fd60 2023-07-21T22:38:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.284+0000 7f05bea0a640 1 --2- 172.21.15.6:0/4063143490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b815fd60 0x7f05b80d1da0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009e80 tx=0x7f05b001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e18981dc91bb46 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.284+0000 7f05bd207640 1 -- 172.21.15.6:0/4063143490 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b00a58a0 con 0x7f05b815fd60 2023-07-21T22:38:09.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.284+0000 7f05bd207640 1 -- 172.21.15.6:0/4063143490 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b00a5a00 con 0x7f05b815fd60 2023-07-21T22:38:09.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.284+0000 7f05bd207640 1 -- 172.21.15.6:0/4063143490 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b00a5d90 con 0x7f05b815fd60 2023-07-21T22:38:09.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.284+0000 7f05c046d640 1 -- 172.21.15.6:0/4063143490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b815fd60 msgr2=0x7f05b80d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:09.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.284+0000 7f05c046d640 1 --2- 172.21.15.6:0/4063143490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b815fd60 0x7f05b80d1da0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009e80 tx=0x7f05b001c9c0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.284+0000 7f05c046d640 1 -- 172.21.15.6:0/4063143490 shutdown_connections 2023-07-21T22:38:09.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.284+0000 7f05c046d640 1 --2- 172.21.15.6:0/4063143490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b815fd60 0x7f05b80d1da0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.284+0000 7f05c046d640 1 --2- 172.21.15.6:0/4063143490 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05b80b7c70 0x7f05b80d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.284+0000 7f05c046d640 1 -- 172.21.15.6:0/4063143490 >> 172.21.15.6:0/4063143490 conn(0x7f05b80650b0 msgr2=0x7f05b80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:09.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.284+0000 7f05c046d640 1 -- 172.21.15.6:0/4063143490 shutdown_connections 2023-07-21T22:38:09.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.284+0000 7f05c046d640 1 -- 172.21.15.6:0/4063143490 wait complete. 2023-07-21T22:38:09.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05c046d640 1 Processor -- start 2023-07-21T22:38:09.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05c046d640 1 -- start start 2023-07-21T22:38:09.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05c046d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05b80b7c70 0x7f05b814c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:09.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05c046d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b80d1850 0x7f05b8156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05c046d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05b815fd60 0x7f05b8156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05c046d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b80b52a0 con 0x7f05b80d1850 2023-07-21T22:38:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05c046d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b815efd0 con 0x7f05b815fd60 2023-07-21T22:38:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05c046d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b815c0f0 con 0x7f05b80b7c70 2023-07-21T22:38:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05bda08640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b80d1850 0x7f05b8156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:09.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05bda08640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b80d1850 0x7f05b8156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51318/0 (socket says 172.21.15.6:51318) 2023-07-21T22:38:09.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05bda08640 1 -- 172.21.15.6:0/2808108162 learned_addr learned my addr 172.21.15.6:0/2808108162 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:09.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05be209640 1 --2- 172.21.15.6:0/2808108162 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05b80b7c70 0x7f05b814c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:09.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05bea0a640 1 --2- 172.21.15.6:0/2808108162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05b815fd60 0x7f05b8156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:09.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05bda08640 1 -- 172.21.15.6:0/2808108162 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05b80b7c70 msgr2=0x7f05b814c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:09.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05bda08640 1 --2- 172.21.15.6:0/2808108162 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05b80b7c70 0x7f05b814c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05bda08640 1 -- 172.21.15.6:0/2808108162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05b815fd60 msgr2=0x7f05b8156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:09.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05bda08640 1 --2- 172.21.15.6:0/2808108162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05b815fd60 0x7f05b8156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05bda08640 1 -- 172.21.15.6:0/2808108162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b0009b30 con 0x7f05b80d1850 2023-07-21T22:38:09.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05bda08640 1 --2- 172.21.15.6:0/2808108162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b80d1850 0x7f05b8156810 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f05a800c3c0 tx=0x7f05a800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:09.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05aeffd640 1 -- 172.21.15.6:0/2808108162 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a80052d0 con 0x7f05b80d1850 2023-07-21T22:38:09.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05aeffd640 1 -- 172.21.15.6:0/2808108162 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a8005430 con 0x7f05b80d1850 2023-07-21T22:38:09.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05aeffd640 1 -- 172.21.15.6:0/2808108162 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a8003840 con 0x7f05b80d1850 2023-07-21T22:38:09.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05c046d640 1 -- 172.21.15.6:0/2808108162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b815c340 con 0x7f05b80d1850 2023-07-21T22:38:09.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05c046d640 1 -- 172.21.15.6:0/2808108162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b815c900 con 0x7f05b80d1850 2023-07-21T22:38:09.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.288+0000 7f05c046d640 1 -- 172.21.15.6:0/2808108162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b80678d0 con 0x7f05b80d1850 2023-07-21T22:38:09.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.292+0000 7f05aeffd640 1 -- 172.21.15.6:0/2808108162 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 57) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f05a80039a0 con 0x7f05b80d1850 2023-07-21T22:38:09.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.292+0000 7f05aeffd640 1 --2- 172.21.15.6:0/2808108162 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f059c0660d0 0x7f059c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:09.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.292+0000 7f05aeffd640 1 -- 172.21.15.6:0/2808108162 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6936+0+0 (secure 0 0 0) 0x7f05a8083150 con 0x7f05b80d1850 2023-07-21T22:38:09.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.292+0000 7f05be209640 1 --2- 172.21.15.6:0/2808108162 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f059c0660d0 0x7f059c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:09.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.292+0000 7f05be209640 1 --2- 172.21.15.6:0/2808108162 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f059c0660d0 0x7f059c068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f05b8154ea0 tx=0x7f05b4008040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:09.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.296+0000 7f05aeffd640 1 -- 172.21.15.6:0/2808108162 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05a8050650 con 0x7f05b80d1850 2023-07-21T22:38:09.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.452+0000 7f05c046d640 1 -- 172.21.15.6:0/2808108162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05b80d2ce0 con 0x7f05b80d1850 2023-07-21T22:38:09.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.452+0000 7f05aeffd640 1 -- 172.21.15.6:0/2808108162 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+19547 (secure 0 0 0) 0x7f05a8053c70 con 0x7f05b80d1850 2023-07-21T22:38:09.497 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:09.498 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":131,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:38:08.693170+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:37:19.569960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-21T22:37:20.452035+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":131,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/1116211863":"2023-07-22T22:38:07.689018+0000","172.21.15.161:0/1438025095":"2023-07-22T22:38:07.689018+0000","172.21.15.161:0/4044156621":"2023-07-22T22:38:07.689018+0000","172.21.15.161:0/3002130727":"2023-07-22T22:38:07.689018+0000","172.21.15.161:0/4167735587":"2023-07-22T22:38:07.689018+0000","172.21.15.161:6833/1243154965":"2023-07-22T22:38:07.689018+0000","172.21.15.161:6832/1243154965":"2023-07-22T22:38:07.689018+0000","172.21.15.161:0/2022618322":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/2545996454":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/1765632394":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/3061870707":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/3531274071":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/3723143099":"2023-07-22T22:38:07.689018+0000","172.21.15.161:0/3831746843":"2023-07-22T22:37:38.611638+0000","172.21.15.161:6833/1868466946":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/714898619":"2023-07-22T22:38:07.689018+0000","172.21.15.161:0/2130602813":"2023-07-22T22:38:07.689018+0000","172.21.15.161:6832/1868466946":"2023-07-22T22:37:38.611638+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:38:09.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.452+0000 7f05c046d640 1 -- 172.21.15.6:0/2808108162 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f059c0660d0 msgr2=0x7f059c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:09.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.452+0000 7f05c046d640 1 --2- 172.21.15.6:0/2808108162 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f059c0660d0 0x7f059c068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f05b8154ea0 tx=0x7f05b4008040 comp rx=0 tx=0).stop 2023-07-21T22:38:09.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.452+0000 7f05c046d640 1 -- 172.21.15.6:0/2808108162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b80d1850 msgr2=0x7f05b8156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:09.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.452+0000 7f05c046d640 1 --2- 172.21.15.6:0/2808108162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b80d1850 0x7f05b8156810 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f05a800c3c0 tx=0x7f05a800c880 comp rx=0 tx=0).stop 2023-07-21T22:38:09.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.452+0000 7f05c046d640 1 -- 172.21.15.6:0/2808108162 shutdown_connections 2023-07-21T22:38:09.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.452+0000 7f05c046d640 1 --2- 172.21.15.6:0/2808108162 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f059c0660d0 0x7f059c068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.452+0000 7f05c046d640 1 --2- 172.21.15.6:0/2808108162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05b815fd60 0x7f05b8156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.452+0000 7f05c046d640 1 --2- 172.21.15.6:0/2808108162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05b80d1850 0x7f05b8156810 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.452+0000 7f05c046d640 1 --2- 172.21.15.6:0/2808108162 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05b80b7c70 0x7f05b814c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.452+0000 7f05c046d640 1 -- 172.21.15.6:0/2808108162 >> 172.21.15.6:0/2808108162 conn(0x7f05b80650b0 msgr2=0x7f05b80cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:09.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.452+0000 7f05c046d640 1 -- 172.21.15.6:0/2808108162 shutdown_connections 2023-07-21T22:38:09.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.452+0000 7f05c046d640 1 -- 172.21.15.6:0/2808108162 wait complete. 2023-07-21T22:38:09.518 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-21T22:38:09.519 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:38:09.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.616+0000 7f252eae6640 1 Processor -- start 2023-07-21T22:38:09.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.616+0000 7f252eae6640 1 -- start start 2023-07-21T22:38:09.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.620+0000 7f252eae6640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f25280cb780 0x7f25280cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:09.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.620+0000 7f252eae6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f252806b8f0 0x7f25280cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:09.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.620+0000 7f252eae6640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252806f900 con 0x7f252815b7c0 2023-07-21T22:38:09.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.620+0000 7f252eae6640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25280cdce0 con 0x7f25280cb780 2023-07-21T22:38:09.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.620+0000 7f252eae6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25280ca830 con 0x7f252806b8f0 2023-07-21T22:38:09.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.620+0000 7f252d083640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f252806b8f0 0x7f25280cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:09.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.620+0000 7f2527fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f25280cb780 0x7f25280cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:09.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.620+0000 7f252d083640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f252806b8f0 0x7f25280cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:53538/0 (socket says 172.21.15.6:53538) 2023-07-21T22:38:09.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.620+0000 7f252d083640 1 -- 172.21.15.6:0/2076121084 learned_addr learned my addr 172.21.15.6:0/2076121084 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:09.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.620+0000 7f2527fff640 1 -- 172.21.15.6:0/2076121084 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f252806b8f0 msgr2=0x7f25280cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:09.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.620+0000 7f2527fff640 1 --2- 172.21.15.6:0/2076121084 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f252806b8f0 0x7f25280cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.620+0000 7f2527fff640 1 -- 172.21.15.6:0/2076121084 >> v1:172.21.15.161:6789/0 conn(0x7f252815b7c0 legacy=0x7f252806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:09.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.620+0000 7f2527fff640 1 -- 172.21.15.6:0/2076121084 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252815bb90 con 0x7f25280cb780 2023-07-21T22:38:09.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.624+0000 7f2527fff640 1 --2- 172.21.15.6:0/2076121084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25280cb780 0x7f25280cbd30 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f25140097c0 tx=0x7f251401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8c73365d8e82db server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:09.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.624+0000 7f25277fe640 1 -- 172.21.15.6:0/2076121084 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25140ab600 con 0x7f25280cb780 2023-07-21T22:38:09.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.624+0000 7f25277fe640 1 -- 172.21.15.6:0/2076121084 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25140a7050 con 0x7f25280cb780 2023-07-21T22:38:09.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.624+0000 7f25277fe640 1 -- 172.21.15.6:0/2076121084 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25140ab980 con 0x7f25280cb780 2023-07-21T22:38:09.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.624+0000 7f252eae6640 1 -- 172.21.15.6:0/2076121084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25280cb780 msgr2=0x7f25280cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:09.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.624+0000 7f252eae6640 1 --2- 172.21.15.6:0/2076121084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25280cb780 0x7f25280cbd30 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f25140097c0 tx=0x7f251401c450 comp rx=0 tx=0).stop 2023-07-21T22:38:09.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.624+0000 7f252eae6640 1 -- 172.21.15.6:0/2076121084 shutdown_connections 2023-07-21T22:38:09.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.624+0000 7f252eae6640 1 --2- 172.21.15.6:0/2076121084 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f252806b8f0 0x7f25280cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.624+0000 7f252eae6640 1 --2- 172.21.15.6:0/2076121084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25280cb780 0x7f25280cbd30 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.624+0000 7f252eae6640 1 -- 172.21.15.6:0/2076121084 >> 172.21.15.6:0/2076121084 conn(0x7f25280afcf0 msgr2=0x7f25280b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:09.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.624+0000 7f252eae6640 1 -- 172.21.15.6:0/2076121084 shutdown_connections 2023-07-21T22:38:09.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.624+0000 7f252eae6640 1 -- 172.21.15.6:0/2076121084 wait complete. 2023-07-21T22:38:09.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.624+0000 7f252eae6640 1 Processor -- start 2023-07-21T22:38:09.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.624+0000 7f252eae6640 1 -- start start 2023-07-21T22:38:09.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.624+0000 7f252eae6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f252806b8f0 0x7f25281526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:09.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f252eae6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f252815b7c0 0x7f2528157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:09.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f252eae6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25281596e0 0x7f25280b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:09.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f252eae6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2528152be0 con 0x7f252806b8f0 2023-07-21T22:38:09.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f252eae6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2528165240 con 0x7f25281596e0 2023-07-21T22:38:09.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f252eae6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2528158220 con 0x7f252815b7c0 2023-07-21T22:38:09.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f252c882640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f252806b8f0 0x7f25281526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:09.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f252c882640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f252806b8f0 0x7f25281526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51324/0 (socket says 172.21.15.6:51324) 2023-07-21T22:38:09.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f252c882640 1 -- 172.21.15.6:0/172896054 learned_addr learned my addr 172.21.15.6:0/172896054 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:09.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f2527fff640 1 --2- 172.21.15.6:0/172896054 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f252815b7c0 0x7f2528157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:09.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f252d083640 1 --2- 172.21.15.6:0/172896054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25281596e0 0x7f25280b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f252c882640 1 -- 172.21.15.6:0/172896054 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f252815b7c0 msgr2=0x7f2528157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f252c882640 1 --2- 172.21.15.6:0/172896054 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f252815b7c0 0x7f2528157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f252c882640 1 -- 172.21.15.6:0/172896054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25281596e0 msgr2=0x7f25280b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f252c882640 1 --2- 172.21.15.6:0/172896054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25281596e0 0x7f25280b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f252c882640 1 -- 172.21.15.6:0/172896054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2514009420 con 0x7f252806b8f0 2023-07-21T22:38:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f252c882640 1 --2- 172.21.15.6:0/172896054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f252806b8f0 0x7f25281526a0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f251c00c3c0 tx=0x7f251c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f25257fa640 1 -- 172.21.15.6:0/172896054 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c0052d0 con 0x7f252806b8f0 2023-07-21T22:38:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f25257fa640 1 -- 172.21.15.6:0/172896054 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251c005430 con 0x7f252806b8f0 2023-07-21T22:38:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f252eae6640 1 -- 172.21.15.6:0/172896054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25281584e0 con 0x7f252806b8f0 2023-07-21T22:38:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f25257fa640 1 -- 172.21.15.6:0/172896054 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c003840 con 0x7f252806b8f0 2023-07-21T22:38:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f252eae6640 1 -- 172.21.15.6:0/172896054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2528158aa0 con 0x7f252806b8f0 2023-07-21T22:38:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f252eae6640 1 -- 172.21.15.6:0/172896054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25280678d0 con 0x7f252806b8f0 2023-07-21T22:38:09.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.628+0000 7f25257fa640 1 -- 172.21.15.6:0/172896054 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 57) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f251c0039a0 con 0x7f252806b8f0 2023-07-21T22:38:09.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.632+0000 7f25257fa640 1 --2- 172.21.15.6:0/172896054 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f250c0660d0 0x7f250c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:09.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.632+0000 7f25257fa640 1 -- 172.21.15.6:0/172896054 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6936+0+0 (secure 0 0 0) 0x7f251c083150 con 0x7f252806b8f0 2023-07-21T22:38:09.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.632+0000 7f2527fff640 1 --2- 172.21.15.6:0/172896054 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f250c0660d0 0x7f250c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:09.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.632+0000 7f2527fff640 1 --2- 172.21.15.6:0/172896054 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f250c0660d0 0x7f250c068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f25140ad000 tx=0x7f2514008040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:09.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.636+0000 7f25257fa640 1 -- 172.21.15.6:0/172896054 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f251c050650 con 0x7f252806b8f0 2023-07-21T22:38:09.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.820+0000 7f252eae6640 1 -- 172.21.15.6:0/172896054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f252806c380 con 0x7f252806b8f0 2023-07-21T22:38:09.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.820+0000 7f25257fa640 1 -- 172.21.15.6:0/172896054 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f251c053c70 con 0x7f252806b8f0 2023-07-21T22:38:09.868 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:09.868 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1099541342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1099541342},{"type":"v1","addr":"172.21.15.161:6837","nonce":1099541342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3942495258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3942495258},{"type":"v1","addr":"172.21.15.161:6836","nonce":3942495258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8211,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3306024838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3306024838},{"type":"v1","addr":"172.21.15.6:6834","nonce":3306024838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:37:21.460444+0000","modified":"2023-07-21T22:37:25.102431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8214":{"gid":8214,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2511188295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2511188295},{"type":"v1","addr":"172.21.15.6:6835","nonce":2511188295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-21T22:38:09.868 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 54 2023-07-21T22:38:09.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.824+0000 7f252eae6640 1 -- 172.21.15.6:0/172896054 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f250c0660d0 msgr2=0x7f250c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:09.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.824+0000 7f252eae6640 1 --2- 172.21.15.6:0/172896054 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f250c0660d0 0x7f250c068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f25140ad000 tx=0x7f2514008040 comp rx=0 tx=0).stop 2023-07-21T22:38:09.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.824+0000 7f252eae6640 1 -- 172.21.15.6:0/172896054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f252806b8f0 msgr2=0x7f25281526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:09.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.824+0000 7f252eae6640 1 --2- 172.21.15.6:0/172896054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f252806b8f0 0x7f25281526a0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f251c00c3c0 tx=0x7f251c00c880 comp rx=0 tx=0).stop 2023-07-21T22:38:09.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.824+0000 7f252eae6640 1 -- 172.21.15.6:0/172896054 shutdown_connections 2023-07-21T22:38:09.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.824+0000 7f252eae6640 1 --2- 172.21.15.6:0/172896054 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f250c0660d0 0x7f250c068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.824+0000 7f252eae6640 1 --2- 172.21.15.6:0/172896054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f25281596e0 0x7f25280b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.824+0000 7f252eae6640 1 --2- 172.21.15.6:0/172896054 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f252815b7c0 0x7f2528157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.824+0000 7f252eae6640 1 --2- 172.21.15.6:0/172896054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f252806b8f0 0x7f25281526a0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:09.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.824+0000 7f252eae6640 1 -- 172.21.15.6:0/172896054 >> 172.21.15.6:0/172896054 conn(0x7f25280afcf0 msgr2=0x7f252815a100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:09.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.824+0000 7f252eae6640 1 -- 172.21.15.6:0/172896054 shutdown_connections 2023-07-21T22:38:09.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.824+0000 7f252eae6640 1 -- 172.21.15.6:0/172896054 wait complete. 2023-07-21T22:38:09.888 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:38:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.988+0000 7fe10c4cb640 1 Processor -- start 2023-07-21T22:38:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.988+0000 7fe10c4cb640 1 -- start start 2023-07-21T22:38:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.988+0000 7fe10c4cb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe104158ce0 0x7fe104070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.988+0000 7fe10c4cb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe1040c8ad0 0x7fe1040c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.988+0000 7fe10c4cb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe1040c9560 0x7fe1040cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.988+0000 7fe10c4cb640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1040c99e0 con 0x7fe1040c9560 2023-07-21T22:38:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.988+0000 7fe10c4cb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1040cc700 con 0x7fe1040c8ad0 2023-07-21T22:38:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.988+0000 7fe10c4cb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040b0ff0 con 0x7fe104158ce0 2023-07-21T22:38:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.988+0000 7fe10aa68640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe1040c9560 0x7fe1040cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:10.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.988+0000 7fe10aa68640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe1040c9560 0x7fe1040cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51328/0 (socket says 172.21.15.6:51328) 2023-07-21T22:38:10.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.988+0000 7fe10a267640 1 --2- 172.21.15.6:0/3997664190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe104158ce0 0x7fe104070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:10.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.988+0000 7fe10aa68640 1 -- 172.21.15.6:0/3997664190 learned_addr learned my addr 172.21.15.6:0/3997664190 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:10.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.988+0000 7fe109a66640 1 --2- 172.21.15.6:0/3997664190 >> v2:172.21.15.161:3300/0 conn(0x7fe1040c8ad0 0x7fe1040c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:10.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.988+0000 7fe10aa68640 1 -- 172.21.15.6:0/3997664190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe104158ce0 msgr2=0x7fe104070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:10.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.988+0000 7fe10aa68640 1 --2- 172.21.15.6:0/3997664190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe104158ce0 0x7fe104070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.988+0000 7fe10aa68640 1 -- 172.21.15.6:0/3997664190 >> v2:172.21.15.161:3300/0 conn(0x7fe1040c8ad0 msgr2=0x7fe1040c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:10.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.988+0000 7fe10aa68640 1 --2- 172.21.15.6:0/3997664190 >> v2:172.21.15.161:3300/0 conn(0x7fe1040c8ad0 0x7fe1040c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.988+0000 7fe10aa68640 1 -- 172.21.15.6:0/3997664190 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe104070c80 con 0x7fe1040c9560 2023-07-21T22:38:10.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.992+0000 7fe10aa68640 1 --2- 172.21.15.6:0/3997664190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1040c9560 0x7fe1040cab00 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fe10406a6d0 tx=0x7fe0fc01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39b4eb6c42ed943 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:10.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.992+0000 7fe109265640 1 -- 172.21.15.6:0/3997664190 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc0a5610 con 0x7fe1040c9560 2023-07-21T22:38:10.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.992+0000 7fe109265640 1 -- 172.21.15.6:0/3997664190 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc0a5770 con 0x7fe1040c9560 2023-07-21T22:38:10.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.992+0000 7fe109265640 1 -- 172.21.15.6:0/3997664190 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc0a5b00 con 0x7fe1040c9560 2023-07-21T22:38:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.992+0000 7fe10c4cb640 1 -- 172.21.15.6:0/3997664190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1040c9560 msgr2=0x7fe1040cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.992+0000 7fe10c4cb640 1 --2- 172.21.15.6:0/3997664190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1040c9560 0x7fe1040cab00 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fe10406a6d0 tx=0x7fe0fc01c880 comp rx=0 tx=0).stop 2023-07-21T22:38:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.992+0000 7fe10c4cb640 1 -- 172.21.15.6:0/3997664190 shutdown_connections 2023-07-21T22:38:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.992+0000 7fe10c4cb640 1 --2- 172.21.15.6:0/3997664190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1040c9560 0x7fe1040cab00 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.992+0000 7fe10c4cb640 1 --2- 172.21.15.6:0/3997664190 >> v2:172.21.15.161:3300/0 conn(0x7fe1040c8ad0 0x7fe1040c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.992+0000 7fe10c4cb640 1 --2- 172.21.15.6:0/3997664190 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe104158ce0 0x7fe104070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.992+0000 7fe10c4cb640 1 -- 172.21.15.6:0/3997664190 >> 172.21.15.6:0/3997664190 conn(0x7fe1040afcf0 msgr2=0x7fe1040b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.992+0000 7fe10c4cb640 1 -- 172.21.15.6:0/3997664190 shutdown_connections 2023-07-21T22:38:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.992+0000 7fe10c4cb640 1 -- 172.21.15.6:0/3997664190 wait complete. 2023-07-21T22:38:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe10c4cb640 1 Processor -- start 2023-07-21T22:38:10.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe10c4cb640 1 -- start start 2023-07-21T22:38:10.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe10c4cb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1040c8ad0 0x7fe104157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:10.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe10c4cb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1040c9560 0x7fe1040b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:10.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe10c4cb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe104158ce0 0x7fe1040b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:10.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe10c4cb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10414eea0 con 0x7fe1040c8ad0 2023-07-21T22:38:10.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe10c4cb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1041582c0 con 0x7fe104158ce0 2023-07-21T22:38:10.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe10c4cb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe104147640 con 0x7fe1040c9560 2023-07-21T22:38:10.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe10a267640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1040c8ad0 0x7fe104157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:10.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe10a267640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1040c8ad0 0x7fe104157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51336/0 (socket says 172.21.15.6:51336) 2023-07-21T22:38:10.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe10a267640 1 -- 172.21.15.6:0/478483794 learned_addr learned my addr 172.21.15.6:0/478483794 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:10.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe109a66640 1 --2- 172.21.15.6:0/478483794 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1040c9560 0x7fe1040b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:10.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe10aa68640 1 --2- 172.21.15.6:0/478483794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe104158ce0 0x7fe1040b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:10.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe10a267640 1 -- 172.21.15.6:0/478483794 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1040c9560 msgr2=0x7fe1040b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:10.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe10a267640 1 --2- 172.21.15.6:0/478483794 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1040c9560 0x7fe1040b1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe10a267640 1 -- 172.21.15.6:0/478483794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe104158ce0 msgr2=0x7fe1040b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe10a267640 1 --2- 172.21.15.6:0/478483794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe104158ce0 0x7fe1040b2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe10a267640 1 -- 172.21.15.6:0/478483794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc009b30 con 0x7fe1040c8ad0 2023-07-21T22:38:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe10aa68640 1 --2- 172.21.15.6:0/478483794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe104158ce0 0x7fe1040b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe109a66640 1 --2- 172.21.15.6:0/478483794 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1040c9560 0x7fe1040b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:10.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe10a267640 1 --2- 172.21.15.6:0/478483794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1040c8ad0 0x7fe104157d80 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fe10000e870 tx=0x7fe10000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:10.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe0faffd640 1 -- 172.21.15.6:0/478483794 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe100009510 con 0x7fe1040c8ad0 2023-07-21T22:38:10.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe0faffd640 1 -- 172.21.15.6:0/478483794 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10000eec0 con 0x7fe1040c8ad0 2023-07-21T22:38:10.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe0faffd640 1 -- 172.21.15.6:0/478483794 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10000cb40 con 0x7fe1040c8ad0 2023-07-21T22:38:10.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:09.996+0000 7fe10c4cb640 1 -- 172.21.15.6:0/478483794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe10414e8e0 con 0x7fe1040c8ad0 2023-07-21T22:38:10.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.000+0000 7fe10c4cb640 1 -- 172.21.15.6:0/478483794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe104146e40 con 0x7fe1040c8ad0 2023-07-21T22:38:10.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.000+0000 7fe10c4cb640 1 -- 172.21.15.6:0/478483794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1040ca1a0 con 0x7fe1040c8ad0 2023-07-21T22:38:10.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.000+0000 7fe0faffd640 1 -- 172.21.15.6:0/478483794 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe10000cca0 con 0x7fe1040c8ad0 2023-07-21T22:38:10.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.000+0000 7fe0faffd640 1 --2- 172.21.15.6:0/478483794 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fe0e80663d0 0x7fe0e8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:10.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.000+0000 7fe0faffd640 1 -- 172.21.15.6:0/478483794 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6936+0+0 (secure 0 0 0) 0x7fe1000842a0 con 0x7fe1040c8ad0 2023-07-21T22:38:10.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.000+0000 7fe109a66640 1 --2- 172.21.15.6:0/478483794 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fe0e80663d0 0x7fe0e8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:10.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.000+0000 7fe109a66640 1 --2- 172.21.15.6:0/478483794 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fe0e80663d0 0x7fe0e8068880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe104071080 tx=0x7fe0f400d040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:10.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.004+0000 7fe0faffd640 1 -- 172.21.15.6:0/478483794 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe100051290 con 0x7fe1040c8ad0 2023-07-21T22:38:10.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.196+0000 7fe10c4cb640 1 -- 172.21.15.6:0/478483794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1040678d0 con 0x7fe1040c8ad0 2023-07-21T22:38:10.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.196+0000 7fe0faffd640 1 -- 172.21.15.6:0/478483794 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4673 (secure 0 0 0) 0x7fe1000548b0 con 0x7fe1040c8ad0 2023-07-21T22:38:10.242 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:10.243 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":54,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1099541342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1099541342},{"type":"v1","addr":"172.21.15.161:6837","nonce":1099541342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3942495258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3942495258},{"type":"v1","addr":"172.21.15.161:6836","nonce":3942495258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8211,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3306024838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3306024838},{"type":"v1","addr":"172.21.15.6:6834","nonce":3306024838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:37:21.460444+0000","modified":"2023-07-21T22:37:25.102431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8214},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8214":{"gid":8214,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2511188295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2511188295},{"type":"v1","addr":"172.21.15.6:6835","nonce":2511188295}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-21T22:38:10.243 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 54 2023-07-21T22:38:10.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.200+0000 7fe10c4cb640 1 -- 172.21.15.6:0/478483794 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fe0e80663d0 msgr2=0x7fe0e8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:10.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.200+0000 7fe10c4cb640 1 --2- 172.21.15.6:0/478483794 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fe0e80663d0 0x7fe0e8068880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe104071080 tx=0x7fe0f400d040 comp rx=0 tx=0).stop 2023-07-21T22:38:10.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.200+0000 7fe10c4cb640 1 -- 172.21.15.6:0/478483794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1040c8ad0 msgr2=0x7fe104157d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:10.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.200+0000 7fe10c4cb640 1 --2- 172.21.15.6:0/478483794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1040c8ad0 0x7fe104157d80 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fe10000e870 tx=0x7fe10000ec70 comp rx=0 tx=0).stop 2023-07-21T22:38:10.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.200+0000 7fe10c4cb640 1 -- 172.21.15.6:0/478483794 shutdown_connections 2023-07-21T22:38:10.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.200+0000 7fe10c4cb640 1 --2- 172.21.15.6:0/478483794 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fe0e80663d0 0x7fe0e8068880 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.200+0000 7fe10c4cb640 1 --2- 172.21.15.6:0/478483794 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe104158ce0 0x7fe1040b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.200+0000 7fe10c4cb640 1 --2- 172.21.15.6:0/478483794 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1040c9560 0x7fe1040b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.200+0000 7fe10c4cb640 1 --2- 172.21.15.6:0/478483794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1040c8ad0 0x7fe104157d80 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.200+0000 7fe10c4cb640 1 -- 172.21.15.6:0/478483794 >> 172.21.15.6:0/478483794 conn(0x7fe1040afcf0 msgr2=0x7fe10406b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:10.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.200+0000 7fe10c4cb640 1 -- 172.21.15.6:0/478483794 shutdown_connections 2023-07-21T22:38:10.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.200+0000 7fe10c4cb640 1 -- 172.21.15.6:0/478483794 wait complete. 2023-07-21T22:38:10.263 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:38:10.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.360+0000 7f905a974640 1 Processor -- start 2023-07-21T22:38:10.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.360+0000 7f905a974640 1 -- start start 2023-07-21T22:38:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.364+0000 7f905a974640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9054070b70 0x7f9054070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.364+0000 7f905a974640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f905406b1e0 0x7f90540c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.364+0000 7f905a974640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90540cac70 con 0x7f90540c21f0 2023-07-21T22:38:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.364+0000 7f905a974640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9054071480 con 0x7f905406b1e0 2023-07-21T22:38:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.364+0000 7f905a974640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90540ca060 con 0x7f9054070b70 2023-07-21T22:38:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.364+0000 7f90537fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f905406b1e0 0x7f90540c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.364+0000 7f90537fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f905406b1e0 0x7f90540c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51348/0 (socket says 172.21.15.6:51348) 2023-07-21T22:38:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.364+0000 7f90537fe640 1 -- 172.21.15.6:0/3915962087 learned_addr learned my addr 172.21.15.6:0/3915962087 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.364+0000 7f9053fff640 1 --2- 172.21.15.6:0/3915962087 >> v2:172.21.15.161:3300/0 conn(0x7f9054070b70 0x7f9054070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.364+0000 7f90537fe640 1 -- 172.21.15.6:0/3915962087 >> v2:172.21.15.161:3300/0 conn(0x7f9054070b70 msgr2=0x7f9054070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.364+0000 7f90537fe640 1 --2- 172.21.15.6:0/3915962087 >> v2:172.21.15.161:3300/0 conn(0x7f9054070b70 0x7f9054070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.364+0000 7f90537fe640 1 -- 172.21.15.6:0/3915962087 >> v1:172.21.15.161:6789/0 conn(0x7f90540c21f0 legacy=0x7f90540cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.364+0000 7f90537fe640 1 -- 172.21.15.6:0/3915962087 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90540ca340 con 0x7f905406b1e0 2023-07-21T22:38:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.364+0000 7f9053fff640 1 --2- 172.21.15.6:0/3915962087 >> v2:172.21.15.161:3300/0 conn(0x7f9054070b70 0x7f9054070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.364+0000 7f90537fe640 1 --2- 172.21.15.6:0/3915962087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f905406b1e0 0x7f90540c1cb0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f905406f1f0 tx=0x7f904801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99abef68e7385886 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.368+0000 7f9052ffd640 1 -- 172.21.15.6:0/3915962087 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90480aa5f0 con 0x7f905406b1e0 2023-07-21T22:38:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.368+0000 7f9052ffd640 1 -- 172.21.15.6:0/3915962087 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90480aa750 con 0x7f905406b1e0 2023-07-21T22:38:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.368+0000 7f9052ffd640 1 -- 172.21.15.6:0/3915962087 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90480aaae0 con 0x7f905406b1e0 2023-07-21T22:38:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.368+0000 7f905a974640 1 -- 172.21.15.6:0/3915962087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f905406b1e0 msgr2=0x7f90540c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.368+0000 7f905a974640 1 --2- 172.21.15.6:0/3915962087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f905406b1e0 0x7f90540c1cb0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f905406f1f0 tx=0x7f904801c490 comp rx=0 tx=0).stop 2023-07-21T22:38:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.368+0000 7f905a974640 1 -- 172.21.15.6:0/3915962087 shutdown_connections 2023-07-21T22:38:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.368+0000 7f905a974640 1 --2- 172.21.15.6:0/3915962087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f905406b1e0 0x7f90540c1cb0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.368+0000 7f905a974640 1 --2- 172.21.15.6:0/3915962087 >> v2:172.21.15.161:3300/0 conn(0x7f9054070b70 0x7f9054070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.368+0000 7f905a974640 1 -- 172.21.15.6:0/3915962087 >> 172.21.15.6:0/3915962087 conn(0x7f90540afcf0 msgr2=0x7f90540b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:10.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.368+0000 7f905a974640 1 -- 172.21.15.6:0/3915962087 shutdown_connections 2023-07-21T22:38:10.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.368+0000 7f905a974640 1 -- 172.21.15.6:0/3915962087 wait complete. 2023-07-21T22:38:10.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.368+0000 7f905a974640 1 Processor -- start 2023-07-21T22:38:10.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.368+0000 7f905a974640 1 -- start start 2023-07-21T22:38:10.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.368+0000 7f905a974640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f905406b1e0 0x7f905414daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:10.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.368+0000 7f905a974640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9054070b70 0x7f90540b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:10.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.368+0000 7f905a974640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90540c21f0 0x7f90541584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:10.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.368+0000 7f905a974640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905414dfe0 con 0x7f905406b1e0 2023-07-21T22:38:10.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.368+0000 7f905a974640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90540c6370 con 0x7f9054070b70 2023-07-21T22:38:10.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.368+0000 7f905a974640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90540c6650 con 0x7f90540c21f0 2023-07-21T22:38:10.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.372+0000 7f9053fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f905406b1e0 0x7f905414daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:10.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.372+0000 7f9053fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f905406b1e0 0x7f905414daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51364/0 (socket says 172.21.15.6:51364) 2023-07-21T22:38:10.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.372+0000 7f9053fff640 1 -- 172.21.15.6:0/824431591 learned_addr learned my addr 172.21.15.6:0/824431591 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:10.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.372+0000 7f9053fff640 1 -- 172.21.15.6:0/824431591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90540c21f0 msgr2=0x7f90541584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:10.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.372+0000 7f9053fff640 1 --2- 172.21.15.6:0/824431591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90540c21f0 0x7f90541584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.372+0000 7f9053fff640 1 -- 172.21.15.6:0/824431591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9054070b70 msgr2=0x7f90540b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:10.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.372+0000 7f9053fff640 1 --2- 172.21.15.6:0/824431591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9054070b70 0x7f90540b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.372+0000 7f9053fff640 1 -- 172.21.15.6:0/824431591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90480094d0 con 0x7f905406b1e0 2023-07-21T22:38:10.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.372+0000 7f9053fff640 1 --2- 172.21.15.6:0/824431591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f905406b1e0 0x7f905414daa0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f904400c7c0 tx=0x7f904400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:10.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.372+0000 7f9050ff9640 1 -- 172.21.15.6:0/824431591 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9044007a30 con 0x7f905406b1e0 2023-07-21T22:38:10.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.372+0000 7f9050ff9640 1 -- 172.21.15.6:0/824431591 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9044007b90 con 0x7f905406b1e0 2023-07-21T22:38:10.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.372+0000 7f9050ff9640 1 -- 172.21.15.6:0/824431591 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904400ce70 con 0x7f905406b1e0 2023-07-21T22:38:10.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.372+0000 7f905a974640 1 -- 172.21.15.6:0/824431591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90540c6930 con 0x7f905406b1e0 2023-07-21T22:38:10.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.372+0000 7f905a974640 1 -- 172.21.15.6:0/824431591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f905414e8d0 con 0x7f905406b1e0 2023-07-21T22:38:10.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.372+0000 7f905a974640 1 -- 172.21.15.6:0/824431591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90540678d0 con 0x7f905406b1e0 2023-07-21T22:38:10.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.372+0000 7f9050ff9640 1 -- 172.21.15.6:0/824431591 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f90440113f0 con 0x7f905406b1e0 2023-07-21T22:38:10.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.372+0000 7f9050ff9640 1 --2- 172.21.15.6:0/824431591 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f90400663a0 0x7f9040068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:10.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.372+0000 7f9050ff9640 1 -- 172.21.15.6:0/824431591 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6936+0+0 (secure 0 0 0) 0x7f9044084840 con 0x7f905406b1e0 2023-07-21T22:38:10.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.376+0000 7f90537fe640 1 --2- 172.21.15.6:0/824431591 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f90400663a0 0x7f9040068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:10.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.376+0000 7f90537fe640 1 --2- 172.21.15.6:0/824431591 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f90400663a0 0x7f9040068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f90480ae000 tx=0x7f9048008040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:10.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.376+0000 7f9050ff9640 1 -- 172.21.15.6:0/824431591 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9044051690 con 0x7f905406b1e0 2023-07-21T22:38:10.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.532+0000 7f905a974640 1 -- 172.21.15.6:0/824431591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90540c6de0 con 0x7f905406b1e0 2023-07-21T22:38:10.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.536+0000 7f9050ff9640 1 -- 172.21.15.6:0/824431591 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+19547 (secure 0 0 0) 0x7f9044054cb0 con 0x7f905406b1e0 2023-07-21T22:38:10.581 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:10.581 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":131,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:38:08.693170+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:37:19.569960+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-21T22:37:20.452035+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"131","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":131,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/1116211863":"2023-07-22T22:38:07.689018+0000","172.21.15.161:0/1438025095":"2023-07-22T22:38:07.689018+0000","172.21.15.161:0/4044156621":"2023-07-22T22:38:07.689018+0000","172.21.15.161:0/3002130727":"2023-07-22T22:38:07.689018+0000","172.21.15.161:0/4167735587":"2023-07-22T22:38:07.689018+0000","172.21.15.161:6833/1243154965":"2023-07-22T22:38:07.689018+0000","172.21.15.161:6832/1243154965":"2023-07-22T22:38:07.689018+0000","172.21.15.161:0/2022618322":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/2545996454":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/1765632394":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/3061870707":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/3531274071":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/3723143099":"2023-07-22T22:38:07.689018+0000","172.21.15.161:0/3831746843":"2023-07-22T22:37:38.611638+0000","172.21.15.161:6833/1868466946":"2023-07-22T22:37:38.611638+0000","172.21.15.161:0/714898619":"2023-07-22T22:38:07.689018+0000","172.21.15.161:0/2130602813":"2023-07-22T22:38:07.689018+0000","172.21.15.161:6832/1868466946":"2023-07-22T22:37:38.611638+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:38:10.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.536+0000 7f905a974640 1 -- 172.21.15.6:0/824431591 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f90400663a0 msgr2=0x7f9040068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:10.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.536+0000 7f905a974640 1 --2- 172.21.15.6:0/824431591 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f90400663a0 0x7f9040068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f90480ae000 tx=0x7f9048008040 comp rx=0 tx=0).stop 2023-07-21T22:38:10.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.536+0000 7f905a974640 1 -- 172.21.15.6:0/824431591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f905406b1e0 msgr2=0x7f905414daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:10.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.536+0000 7f905a974640 1 --2- 172.21.15.6:0/824431591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f905406b1e0 0x7f905414daa0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f904400c7c0 tx=0x7f904400cc80 comp rx=0 tx=0).stop 2023-07-21T22:38:10.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.536+0000 7f905a974640 1 -- 172.21.15.6:0/824431591 shutdown_connections 2023-07-21T22:38:10.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.536+0000 7f905a974640 1 --2- 172.21.15.6:0/824431591 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f90400663a0 0x7f9040068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.536+0000 7f905a974640 1 --2- 172.21.15.6:0/824431591 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f90540c21f0 0x7f90541584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.536+0000 7f905a974640 1 --2- 172.21.15.6:0/824431591 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9054070b70 0x7f90540b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.536+0000 7f905a974640 1 --2- 172.21.15.6:0/824431591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f905406b1e0 0x7f905414daa0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.536+0000 7f905a974640 1 -- 172.21.15.6:0/824431591 >> 172.21.15.6:0/824431591 conn(0x7f90540afcf0 msgr2=0x7f90540cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:10.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.536+0000 7f905a974640 1 -- 172.21.15.6:0/824431591 shutdown_connections 2023-07-21T22:38:10.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.536+0000 7f905a974640 1 -- 172.21.15.6:0/824431591 wait complete. 2023-07-21T22:38:10.602 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-21T22:38:10.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.700+0000 7f0f5f27b640 1 Processor -- start 2023-07-21T22:38:10.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.700+0000 7f0f5f27b640 1 -- start start 2023-07-21T22:38:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.704+0000 7f0f5f27b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0f58070b70 0x7f0f58070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.704+0000 7f0f5f27b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0f580cb100 0x7f0f580cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.704+0000 7f0f5f27b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f580cac70 con 0x7f0f5806b1e0 2023-07-21T22:38:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.704+0000 7f0f5f27b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f580cba60 con 0x7f0f58070b70 2023-07-21T22:38:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.704+0000 7f0f5f27b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f58071480 con 0x7f0f580cb100 2023-07-21T22:38:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.704+0000 7f0f5d017640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0f58070b70 0x7f0f58070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.704+0000 7f0f5d017640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0f58070b70 0x7f0f58070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51378/0 (socket says 172.21.15.6:51378) 2023-07-21T22:38:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.704+0000 7f0f5d017640 1 -- 172.21.15.6:0/4138099073 learned_addr learned my addr 172.21.15.6:0/4138099073 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:10.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.704+0000 7f0f5d017640 1 -- 172.21.15.6:0/4138099073 >> v2:172.21.15.161:3300/0 conn(0x7f0f580cb100 msgr2=0x7f0f580cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:10.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.704+0000 7f0f5d017640 1 --2- 172.21.15.6:0/4138099073 >> v2:172.21.15.161:3300/0 conn(0x7f0f580cb100 0x7f0f580cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.704+0000 7f0f5d017640 1 -- 172.21.15.6:0/4138099073 >> v1:172.21.15.161:6789/0 conn(0x7f0f5806b1e0 legacy=0x7f0f580c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:10.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.704+0000 7f0f5d017640 1 -- 172.21.15.6:0/4138099073 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f580ca060 con 0x7f0f58070b70 2023-07-21T22:38:10.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.708+0000 7f0f5d017640 1 --2- 172.21.15.6:0/4138099073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f58070b70 0x7f0f58070f40 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f0f580c19c0 tx=0x7f0f5401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fba154a04b24a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:10.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.708+0000 7f0f4ffff640 1 -- 172.21.15.6:0/4138099073 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f540aa5f0 con 0x7f0f58070b70 2023-07-21T22:38:10.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.708+0000 7f0f4ffff640 1 -- 172.21.15.6:0/4138099073 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f540aa750 con 0x7f0f58070b70 2023-07-21T22:38:10.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.708+0000 7f0f4ffff640 1 -- 172.21.15.6:0/4138099073 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f540aaae0 con 0x7f0f58070b70 2023-07-21T22:38:10.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.708+0000 7f0f5f27b640 1 -- 172.21.15.6:0/4138099073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f58070b70 msgr2=0x7f0f58070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:10.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.708+0000 7f0f5f27b640 1 --2- 172.21.15.6:0/4138099073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f58070b70 0x7f0f58070f40 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f0f580c19c0 tx=0x7f0f5401c490 comp rx=0 tx=0).stop 2023-07-21T22:38:10.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.708+0000 7f0f5f27b640 1 -- 172.21.15.6:0/4138099073 shutdown_connections 2023-07-21T22:38:10.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.708+0000 7f0f5f27b640 1 --2- 172.21.15.6:0/4138099073 >> v2:172.21.15.161:3300/0 conn(0x7f0f580cb100 0x7f0f580cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.708+0000 7f0f5f27b640 1 --2- 172.21.15.6:0/4138099073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f58070b70 0x7f0f58070f40 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.708+0000 7f0f5f27b640 1 -- 172.21.15.6:0/4138099073 >> 172.21.15.6:0/4138099073 conn(0x7f0f580afcf0 msgr2=0x7f0f580b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:10.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.708+0000 7f0f5f27b640 1 -- 172.21.15.6:0/4138099073 shutdown_connections 2023-07-21T22:38:10.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.708+0000 7f0f5f27b640 1 -- 172.21.15.6:0/4138099073 wait complete. 2023-07-21T22:38:10.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5f27b640 1 Processor -- start 2023-07-21T22:38:10.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5f27b640 1 -- start start 2023-07-21T22:38:10.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5f27b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f5806b1e0 0x7f0f5814f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:10.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5f27b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f58070b70 0x7f0f580cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:10.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5f27b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f580cb100 0x7f0f580cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:10.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5f27b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f580cc5a0 con 0x7f0f58070b70 2023-07-21T22:38:10.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5f27b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f580cc880 con 0x7f0f580cb100 2023-07-21T22:38:10.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5f27b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f580ccb60 con 0x7f0f5806b1e0 2023-07-21T22:38:10.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5c816640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f58070b70 0x7f0f580cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:10.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5c816640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f58070b70 0x7f0f580cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51390/0 (socket says 172.21.15.6:51390) 2023-07-21T22:38:10.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5c816640 1 -- 172.21.15.6:0/610509727 learned_addr learned my addr 172.21.15.6:0/610509727 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:10.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5d017640 1 --2- 172.21.15.6:0/610509727 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f5806b1e0 0x7f0f5814f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:10.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5d818640 1 --2- 172.21.15.6:0/610509727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f580cb100 0x7f0f580cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:10.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5c816640 1 -- 172.21.15.6:0/610509727 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f5806b1e0 msgr2=0x7f0f5814f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:10.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5c816640 1 --2- 172.21.15.6:0/610509727 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f5806b1e0 0x7f0f5814f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5c816640 1 -- 172.21.15.6:0/610509727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f580cb100 msgr2=0x7f0f580cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:10.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5c816640 1 --2- 172.21.15.6:0/610509727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f580cb100 0x7f0f580cd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5c816640 1 -- 172.21.15.6:0/610509727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f540094d0 con 0x7f0f58070b70 2023-07-21T22:38:10.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5c816640 1 --2- 172.21.15.6:0/610509727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f58070b70 0x7f0f580cbd30 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f0f4800c450 tx=0x7f0f4800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:10.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f4dffb640 1 -- 172.21.15.6:0/610509727 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48012830 con 0x7f0f58070b70 2023-07-21T22:38:10.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f4dffb640 1 -- 172.21.15.6:0/610509727 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f480129b0 con 0x7f0f58070b70 2023-07-21T22:38:10.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f4dffb640 1 -- 172.21.15.6:0/610509727 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48012d60 con 0x7f0f58070b70 2023-07-21T22:38:10.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5f27b640 1 -- 172.21.15.6:0/610509727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f580cce40 con 0x7f0f58070b70 2023-07-21T22:38:10.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.712+0000 7f0f5f27b640 1 -- 172.21.15.6:0/610509727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f580cc270 con 0x7f0f58070b70 2023-07-21T22:38:10.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.716+0000 7f0f5f27b640 1 -- 172.21.15.6:0/610509727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f580cd360 con 0x7f0f58070b70 2023-07-21T22:38:10.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.716+0000 7f0f4dffb640 1 -- 172.21.15.6:0/610509727 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0f4801c460 con 0x7f0f58070b70 2023-07-21T22:38:10.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.716+0000 7f0f4dffb640 1 --2- 172.21.15.6:0/610509727 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0f3c0663a0 0x7f0f3c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:10.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.716+0000 7f0f4dffb640 1 -- 172.21.15.6:0/610509727 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6936+0+0 (secure 0 0 0) 0x7f0f48083fc0 con 0x7f0f58070b70 2023-07-21T22:38:10.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.716+0000 7f0f5d017640 1 --2- 172.21.15.6:0/610509727 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0f3c0663a0 0x7f0f3c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:10.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.716+0000 7f0f5d017640 1 --2- 172.21.15.6:0/610509727 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0f3c0663a0 0x7f0f3c068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0f540ae000 tx=0x7f0f540b5040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:10.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.720+0000 7f0f4dffb640 1 -- 172.21.15.6:0/610509727 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0f580cd360 con 0x7f0f58070b70 2023-07-21T22:38:10.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.908+0000 7f0f5f27b640 1 -- 172.21.15.6:0/610509727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0f580cd360 con 0x7f0f58070b70 2023-07-21T22:38:10.956 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-07-21T22:38:10.912+0000 7f195e836640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-21T22:38:10.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.916+0000 7f0f4dffb640 1 -- 172.21.15.6:0/610509727 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v55) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0f580cd360 con 0x7f0f58070b70 2023-07-21T22:38:10.963 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-21T22:38:10.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.920+0000 7f0f5f27b640 1 -- 172.21.15.6:0/610509727 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0f3c0663a0 msgr2=0x7f0f3c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:10.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.920+0000 7f0f5f27b640 1 --2- 172.21.15.6:0/610509727 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0f3c0663a0 0x7f0f3c068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0f540ae000 tx=0x7f0f540b5040 comp rx=0 tx=0).stop 2023-07-21T22:38:10.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.920+0000 7f0f5f27b640 1 -- 172.21.15.6:0/610509727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f58070b70 msgr2=0x7f0f580cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:10.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.920+0000 7f0f5f27b640 1 --2- 172.21.15.6:0/610509727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f58070b70 0x7f0f580cbd30 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f0f4800c450 tx=0x7f0f4800c910 comp rx=0 tx=0).stop 2023-07-21T22:38:10.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.920+0000 7f0f5f27b640 1 -- 172.21.15.6:0/610509727 shutdown_connections 2023-07-21T22:38:10.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.920+0000 7f0f5f27b640 1 --2- 172.21.15.6:0/610509727 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0f3c0663a0 0x7f0f3c068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.920+0000 7f0f5f27b640 1 --2- 172.21.15.6:0/610509727 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f580cb100 0x7f0f580cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.920+0000 7f0f5f27b640 1 --2- 172.21.15.6:0/610509727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f58070b70 0x7f0f580cbd30 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.920+0000 7f0f5f27b640 1 --2- 172.21.15.6:0/610509727 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f5806b1e0 0x7f0f5814f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:10.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.920+0000 7f0f5f27b640 1 -- 172.21.15.6:0/610509727 >> 172.21.15.6:0/610509727 conn(0x7f0f580afcf0 msgr2=0x7f0f580ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:10.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.920+0000 7f0f5f27b640 1 -- 172.21.15.6:0/610509727 shutdown_connections 2023-07-21T22:38:10.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:10.920+0000 7f0f5f27b640 1 -- 172.21.15.6:0/610509727 wait complete. 2023-07-21T22:38:10.974 INFO:tasks.ceph.mds.c.smithi006.stderr: -7294> 2023-07-21T22:37:27.037+0000 7f31c7005640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:38:10.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-21T22:38:11.028 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-21T22:38:11.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.088+0000 7f8379fd2640 1 Processor -- start 2023-07-21T22:38:11.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.088+0000 7f8379fd2640 1 -- start start 2023-07-21T22:38:11.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.088+0000 7f8379fd2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f837406a540 0x7f83740cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:11.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.088+0000 7f8379fd2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f837406a910 0x7f83740d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:11.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.088+0000 7f8379fd2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83740cd1f0 con 0x7f83741601f0 2023-07-21T22:38:11.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.088+0000 7f8379fd2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83740cd4d0 con 0x7f837406a540 2023-07-21T22:38:11.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.088+0000 7f8379fd2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83740cd7b0 con 0x7f837406a910 2023-07-21T22:38:11.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.088+0000 7f8373fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f837406a910 0x7f83740d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:11.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.088+0000 7f83737fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f837406a540 0x7f83740cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:11.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.088+0000 7f8373fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f837406a910 0x7f83740d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:53602/0 (socket says 172.21.15.6:53602) 2023-07-21T22:38:11.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.088+0000 7f8373fff640 1 -- 172.21.15.6:0/836884658 learned_addr learned my addr 172.21.15.6:0/836884658 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:11.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.092+0000 7f8373fff640 1 -- 172.21.15.6:0/836884658 >> v2:172.21.15.161:3300/0 conn(0x7f837406a540 msgr2=0x7f83740cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:11.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.092+0000 7f8373fff640 1 --2- 172.21.15.6:0/836884658 >> v2:172.21.15.161:3300/0 conn(0x7f837406a540 0x7f83740cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:11.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.092+0000 7f8373fff640 1 -- 172.21.15.6:0/836884658 >> v1:172.21.15.161:6789/0 conn(0x7f83741601f0 legacy=0x7f83740cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:11.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.092+0000 7f83727fc640 1 -- 172.21.15.6:0/836884658 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859225344 0 0) 0x7f83740cd1f0 con 0x7f83741601f0 2023-07-21T22:38:11.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.092+0000 7f8373fff640 1 -- 172.21.15.6:0/836884658 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83740cfe40 con 0x7f837406a910 2023-07-21T22:38:11.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.092+0000 7f8373fff640 1 --2- 172.21.15.6:0/836884658 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f837406a910 0x7f83740d0360 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f836c009e80 tx=0x7f836c01c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b4aea1a99759595 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:11.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.092+0000 7f83727fc640 1 -- 172.21.15.6:0/836884658 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c0a5670 con 0x7f837406a910 2023-07-21T22:38:11.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.092+0000 7f83727fc640 1 -- 172.21.15.6:0/836884658 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c0a57d0 con 0x7f837406a910 2023-07-21T22:38:11.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.092+0000 7f83727fc640 1 -- 172.21.15.6:0/836884658 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c0a5b60 con 0x7f837406a910 2023-07-21T22:38:11.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f8379fd2640 1 -- 172.21.15.6:0/836884658 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f837406a910 msgr2=0x7f83740d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:11.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f8379fd2640 1 --2- 172.21.15.6:0/836884658 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f837406a910 0x7f83740d0360 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f836c009e80 tx=0x7f836c01c8d0 comp rx=0 tx=0).stop 2023-07-21T22:38:11.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f8379fd2640 1 -- 172.21.15.6:0/836884658 shutdown_connections 2023-07-21T22:38:11.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f8379fd2640 1 --2- 172.21.15.6:0/836884658 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f837406a910 0x7f83740d0360 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:11.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f8379fd2640 1 --2- 172.21.15.6:0/836884658 >> v2:172.21.15.161:3300/0 conn(0x7f837406a540 0x7f83740cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:11.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f8379fd2640 1 -- 172.21.15.6:0/836884658 >> 172.21.15.6:0/836884658 conn(0x7f8374099490 msgr2=0x7f8374089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:11.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f8379fd2640 1 -- 172.21.15.6:0/836884658 shutdown_connections 2023-07-21T22:38:11.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f8379fd2640 1 -- 172.21.15.6:0/836884658 wait complete. 2023-07-21T22:38:11.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f8379fd2640 1 Processor -- start 2023-07-21T22:38:11.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f8379fd2640 1 -- start start 2023-07-21T22:38:11.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f8379fd2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f837406a540 0x7f837414dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:11.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f8379fd2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f837406a910 0x7f83740ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:11.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f8379fd2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83741601f0 0x7f8374147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:11.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f8379fd2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837414efc0 con 0x7f837406a910 2023-07-21T22:38:11.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f8379fd2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83740aee00 con 0x7f83741601f0 2023-07-21T22:38:11.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f8379fd2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8374147dd0 con 0x7f837406a540 2023-07-21T22:38:11.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f8372ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f837406a910 0x7f83740ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:11.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f8372ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f837406a910 0x7f83740ae8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51414/0 (socket says 172.21.15.6:51414) 2023-07-21T22:38:11.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f8372ffd640 1 -- 172.21.15.6:0/1820469770 learned_addr learned my addr 172.21.15.6:0/1820469770 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:11.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f83737fe640 1 --2- 172.21.15.6:0/1820469770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f837406a540 0x7f837414dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:11.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.096+0000 7f8373fff640 1 --2- 172.21.15.6:0/1820469770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83741601f0 0x7f8374147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:11.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.100+0000 7f8372ffd640 1 -- 172.21.15.6:0/1820469770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f837406a540 msgr2=0x7f837414dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:11.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.100+0000 7f8372ffd640 1 --2- 172.21.15.6:0/1820469770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f837406a540 0x7f837414dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:11.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.100+0000 7f8372ffd640 1 -- 172.21.15.6:0/1820469770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83741601f0 msgr2=0x7f8374147890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:11.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.100+0000 7f8372ffd640 1 --2- 172.21.15.6:0/1820469770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83741601f0 0x7f8374147890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:11.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.100+0000 7f8372ffd640 1 -- 172.21.15.6:0/1820469770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c009b30 con 0x7f837406a910 2023-07-21T22:38:11.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.100+0000 7f8372ffd640 1 --2- 172.21.15.6:0/1820469770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f837406a910 0x7f83740ae8c0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f836800c3f0 tx=0x7f836800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:11.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.100+0000 7f835bfff640 1 -- 172.21.15.6:0/1820469770 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83680054e0 con 0x7f837406a910 2023-07-21T22:38:11.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.100+0000 7f835bfff640 1 -- 172.21.15.6:0/1820469770 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8368003600 con 0x7f837406a910 2023-07-21T22:38:11.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.100+0000 7f835bfff640 1 -- 172.21.15.6:0/1820469770 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368003990 con 0x7f837406a910 2023-07-21T22:38:11.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.100+0000 7f8379fd2640 1 -- 172.21.15.6:0/1820469770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837414e3b0 con 0x7f837406a910 2023-07-21T22:38:11.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.100+0000 7f8379fd2640 1 -- 172.21.15.6:0/1820469770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837414e970 con 0x7f837406a910 2023-07-21T22:38:11.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.100+0000 7f8379fd2640 1 -- 172.21.15.6:0/1820469770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837414f130 con 0x7f837406a910 2023-07-21T22:38:11.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.100+0000 7f835bfff640 1 -- 172.21.15.6:0/1820469770 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8368003af0 con 0x7f837406a910 2023-07-21T22:38:11.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.100+0000 7f835bfff640 1 --2- 172.21.15.6:0/1820469770 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f83600663a0 0x7f8360068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:11.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.100+0000 7f835bfff640 1 -- 172.21.15.6:0/1820469770 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6994+0+0 (secure 0 0 0) 0x7f8368083850 con 0x7f837406a910 2023-07-21T22:38:11.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.104+0000 7f83737fe640 1 --2- 172.21.15.6:0/1820469770 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f83600663a0 0x7f8360068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:11.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.104+0000 7f83737fe640 1 --2- 172.21.15.6:0/1820469770 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f83600663a0 0x7f8360068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8364009aa0 tx=0x7f8364006f90 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:11.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.104+0000 7f835bfff640 1 -- 172.21.15.6:0/1820469770 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8368050820 con 0x7f837406a910 2023-07-21T22:38:11.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.296+0000 7f8379fd2640 1 -- 172.21.15.6:0/1820469770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f83740678d0 con 0x7f837406a910 2023-07-21T22:38:12.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.980+0000 7f835bfff640 1 -- 172.21.15.6:0/1820469770 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v56) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8368053e40 con 0x7f837406a910 2023-07-21T22:38:12.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.980+0000 7f8379fd2640 1 -- 172.21.15.6:0/1820469770 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f83600663a0 msgr2=0x7f8360068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:12.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.980+0000 7f8379fd2640 1 --2- 172.21.15.6:0/1820469770 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f83600663a0 0x7f8360068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f8364009aa0 tx=0x7f8364006f90 comp rx=0 tx=0).stop 2023-07-21T22:38:12.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.980+0000 7f8379fd2640 1 -- 172.21.15.6:0/1820469770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f837406a910 msgr2=0x7f83740ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:12.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.980+0000 7f8379fd2640 1 --2- 172.21.15.6:0/1820469770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f837406a910 0x7f83740ae8c0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f836800c3f0 tx=0x7f836800c8b0 comp rx=0 tx=0).stop 2023-07-21T22:38:12.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.980+0000 7f8379fd2640 1 -- 172.21.15.6:0/1820469770 shutdown_connections 2023-07-21T22:38:12.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.980+0000 7f8379fd2640 1 --2- 172.21.15.6:0/1820469770 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f83600663a0 0x7f8360068850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:12.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.980+0000 7f8379fd2640 1 --2- 172.21.15.6:0/1820469770 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83741601f0 0x7f8374147890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:12.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.980+0000 7f8379fd2640 1 --2- 172.21.15.6:0/1820469770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f837406a910 0x7f83740ae8c0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:12.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.980+0000 7f8379fd2640 1 --2- 172.21.15.6:0/1820469770 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f837406a540 0x7f837414dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:12.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.980+0000 7f8379fd2640 1 -- 172.21.15.6:0/1820469770 >> 172.21.15.6:0/1820469770 conn(0x7f8374099490 msgr2=0x7f837406dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:12.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.984+0000 7f8379fd2640 1 -- 172.21.15.6:0/1820469770 shutdown_connections 2023-07-21T22:38:12.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:11.984+0000 7f8379fd2640 1 -- 172.21.15.6:0/1820469770 wait complete. 2023-07-21T22:38:12.052 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-21T22:38:12.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.204+0000 7feb68c96640 1 Processor -- start 2023-07-21T22:38:12.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.204+0000 7feb68c96640 1 -- start start 2023-07-21T22:38:12.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.204+0000 7feb68c96640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feb640aeb40 0x7feb6415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:12.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.204+0000 7feb68c96640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb641532b0 con 0x7feb640aef10 2023-07-21T22:38:12.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.204+0000 7feb68c96640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb640ca6f0 con 0x7feb64159440 2023-07-21T22:38:12.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.204+0000 7feb68c96640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb641599d0 con 0x7feb640aeb40 2023-07-21T22:38:12.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.204+0000 7feb6259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feb640aeb40 0x7feb6415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:12.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.204+0000 7feb6259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feb640aeb40 0x7feb6415cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51430/0 (socket says 172.21.15.6:51430) 2023-07-21T22:38:12.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.204+0000 7feb6259c640 1 -- 172.21.15.6:0/3529406375 learned_addr learned my addr 172.21.15.6:0/3529406375 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:12.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.208+0000 7feb6259c640 1 -- 172.21.15.6:0/3529406375 >> v1:172.21.15.161:6789/0 conn(0x7feb64159440 legacy=0x7feb640c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:12.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.208+0000 7feb6259c640 1 -- 172.21.15.6:0/3529406375 >> v1:172.21.15.6:6789/0 conn(0x7feb640aef10 legacy=0x7feb64158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:12.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.208+0000 7feb6259c640 1 -- 172.21.15.6:0/3529406375 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb64159cb0 con 0x7feb640aeb40 2023-07-21T22:38:12.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.208+0000 7feb61d9b640 1 -- 172.21.15.6:0/3529406375 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893929279 0 0) 0x7feb641532b0 con 0x7feb640aef10 2023-07-21T22:38:12.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.208+0000 7feb6259c640 1 --2- 172.21.15.6:0/3529406375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb640aeb40 0x7feb6415cef0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7feb54009870 tx=0x7feb5401e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3879eabab685501 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:12.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.212+0000 7feb61d9b640 1 -- 172.21.15.6:0/3529406375 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb540a8660 con 0x7feb640aeb40 2023-07-21T22:38:12.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.212+0000 7feb61d9b640 1 -- 172.21.15.6:0/3529406375 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb540a87c0 con 0x7feb640aeb40 2023-07-21T22:38:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.212+0000 7feb61d9b640 1 -- 172.21.15.6:0/3529406375 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb540a8b50 con 0x7feb640aeb40 2023-07-21T22:38:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.212+0000 7feb68c96640 1 -- 172.21.15.6:0/3529406375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb640aeb40 msgr2=0x7feb6415cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:12.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.212+0000 7feb68c96640 1 --2- 172.21.15.6:0/3529406375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb640aeb40 0x7feb6415cef0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7feb54009870 tx=0x7feb5401e690 comp rx=0 tx=0).stop 2023-07-21T22:38:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.212+0000 7feb68c96640 1 -- 172.21.15.6:0/3529406375 shutdown_connections 2023-07-21T22:38:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.212+0000 7feb68c96640 1 --2- 172.21.15.6:0/3529406375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb640aeb40 0x7feb6415cef0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:12.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.212+0000 7feb68c96640 1 -- 172.21.15.6:0/3529406375 >> 172.21.15.6:0/3529406375 conn(0x7feb640cde90 msgr2=0x7feb640ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.212+0000 7feb68c96640 1 -- 172.21.15.6:0/3529406375 shutdown_connections 2023-07-21T22:38:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.212+0000 7feb68c96640 1 -- 172.21.15.6:0/3529406375 wait complete. 2023-07-21T22:38:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.212+0000 7feb68c96640 1 Processor -- start 2023-07-21T22:38:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.212+0000 7feb68c96640 1 -- start start 2023-07-21T22:38:12.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.212+0000 7feb68c96640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb640aeb40 0x7feb6415afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:12.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.212+0000 7feb68c96640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb640aef10 0x7feb641569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:12.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.212+0000 7feb68c96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb64159440 0x7feb64156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:12.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.212+0000 7feb68c96640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6414cc50 con 0x7feb64159440 2023-07-21T22:38:12.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.212+0000 7feb68c96640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6406f060 con 0x7feb640aeb40 2023-07-21T22:38:12.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.212+0000 7feb68c96640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6414cea0 con 0x7feb640aef10 2023-07-21T22:38:12.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.216+0000 7feb62d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb64159440 0x7feb64156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:12.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.216+0000 7feb62d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb64159440 0x7feb64156ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51436/0 (socket says 172.21.15.6:51436) 2023-07-21T22:38:12.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.216+0000 7feb62d9d640 1 -- 172.21.15.6:0/1744401630 learned_addr learned my addr 172.21.15.6:0/1744401630 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:12.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.216+0000 7feb6259c640 1 --2- 172.21.15.6:0/1744401630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb640aeb40 0x7feb6415afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:12.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.216+0000 7feb5bfff640 1 --2- 172.21.15.6:0/1744401630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb640aef10 0x7feb641569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:12.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.216+0000 7feb62d9d640 1 -- 172.21.15.6:0/1744401630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb640aef10 msgr2=0x7feb641569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:12.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.216+0000 7feb62d9d640 1 --2- 172.21.15.6:0/1744401630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb640aef10 0x7feb641569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:12.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.216+0000 7feb62d9d640 1 -- 172.21.15.6:0/1744401630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb640aeb40 msgr2=0x7feb6415afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:12.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.216+0000 7feb62d9d640 1 --2- 172.21.15.6:0/1744401630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb640aeb40 0x7feb6415afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:12.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.216+0000 7feb62d9d640 1 -- 172.21.15.6:0/1744401630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb540094d0 con 0x7feb64159440 2023-07-21T22:38:12.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.216+0000 7feb62d9d640 1 --2- 172.21.15.6:0/1744401630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb64159440 0x7feb64156ee0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7feb5c00c760 tx=0x7feb5c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:12.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.216+0000 7feb5affd640 1 -- 172.21.15.6:0/1744401630 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c003b80 con 0x7feb64159440 2023-07-21T22:38:12.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.216+0000 7feb5affd640 1 -- 172.21.15.6:0/1744401630 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5c003ce0 con 0x7feb64159440 2023-07-21T22:38:12.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.216+0000 7feb5affd640 1 -- 172.21.15.6:0/1744401630 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c00aa30 con 0x7feb64159440 2023-07-21T22:38:12.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.216+0000 7feb68c96640 1 -- 172.21.15.6:0/1744401630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb64070d60 con 0x7feb64159440 2023-07-21T22:38:12.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.216+0000 7feb68c96640 1 -- 172.21.15.6:0/1744401630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb6414d180 con 0x7feb64159440 2023-07-21T22:38:12.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.216+0000 7feb68c96640 1 -- 172.21.15.6:0/1744401630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb64070bc0 con 0x7feb64159440 2023-07-21T22:38:12.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.216+0000 7feb5affd640 1 -- 172.21.15.6:0/1744401630 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7feb5c00ab90 con 0x7feb64159440 2023-07-21T22:38:12.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.220+0000 7feb5affd640 1 --2- 172.21.15.6:0/1744401630 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7feb440663d0 0x7feb44068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:12.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.220+0000 7feb5affd640 1 -- 172.21.15.6:0/1744401630 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6994+0+0 (secure 0 0 0) 0x7feb5c083e50 con 0x7feb64159440 2023-07-21T22:38:12.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.220+0000 7feb6259c640 1 --2- 172.21.15.6:0/1744401630 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7feb440663d0 0x7feb44068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:12.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.220+0000 7feb6259c640 1 --2- 172.21.15.6:0/1744401630 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7feb440663d0 0x7feb44068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7feb540b1000 tx=0x7feb540a9000 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:12.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.224+0000 7feb5affd640 1 -- 172.21.15.6:0/1744401630 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feb64070bc0 con 0x7feb64159440 2023-07-21T22:38:12.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.376+0000 7feb68c96640 1 -- 172.21.15.6:0/1744401630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7feb64070bc0 con 0x7feb64159440 2023-07-21T22:38:13.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.984+0000 7feb5affd640 1 -- 172.21.15.6:0/1744401630 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v133) v1 ==== 181+0+0 (secure 0 0 0) 0x7feb64070bc0 con 0x7feb64159440 2023-07-21T22:38:13.030 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-07-21T22:38:13.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.988+0000 7feb68c96640 1 -- 172.21.15.6:0/1744401630 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7feb440663d0 msgr2=0x7feb44068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:13.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.988+0000 7feb68c96640 1 --2- 172.21.15.6:0/1744401630 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7feb440663d0 0x7feb44068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7feb540b1000 tx=0x7feb540a9000 comp rx=0 tx=0).stop 2023-07-21T22:38:13.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.988+0000 7feb68c96640 1 -- 172.21.15.6:0/1744401630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb64159440 msgr2=0x7feb64156ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:13.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.988+0000 7feb68c96640 1 --2- 172.21.15.6:0/1744401630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb64159440 0x7feb64156ee0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7feb5c00c760 tx=0x7feb5c00cc20 comp rx=0 tx=0).stop 2023-07-21T22:38:13.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.988+0000 7feb68c96640 1 -- 172.21.15.6:0/1744401630 shutdown_connections 2023-07-21T22:38:13.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.988+0000 7feb68c96640 1 --2- 172.21.15.6:0/1744401630 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7feb440663d0 0x7feb44068880 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.988+0000 7feb68c96640 1 --2- 172.21.15.6:0/1744401630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb64159440 0x7feb64156ee0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.988+0000 7feb68c96640 1 --2- 172.21.15.6:0/1744401630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb640aef10 0x7feb641569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.988+0000 7feb68c96640 1 --2- 172.21.15.6:0/1744401630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb640aeb40 0x7feb6415afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.988+0000 7feb68c96640 1 -- 172.21.15.6:0/1744401630 >> 172.21.15.6:0/1744401630 conn(0x7feb640cde90 msgr2=0x7feb64072420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:13.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.988+0000 7feb68c96640 1 -- 172.21.15.6:0/1744401630 shutdown_connections 2023-07-21T22:38:13.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:12.988+0000 7feb68c96640 1 -- 172.21.15.6:0/1744401630 wait complete. 2023-07-21T22:38:13.058 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-21T22:38:13.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.164+0000 7fe433382640 1 Processor -- start 2023-07-21T22:38:13.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.164+0000 7fe433382640 1 -- start start 2023-07-21T22:38:13.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.168+0000 7fe433382640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe42c15bde0 0x7fe42c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.168+0000 7fe433382640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe42c0d2fc0 0x7fe42c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.168+0000 7fe433382640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe42c0d2300 0x7fe42c0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.168+0000 7fe433382640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe42c0d2ce0 con 0x7fe42c0d2300 2023-07-21T22:38:13.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.168+0000 7fe433382640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe42c15c1b0 con 0x7fe42c15bde0 2023-07-21T22:38:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.168+0000 7fe433382640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0b04c0 con 0x7fe42c0d2fc0 2023-07-21T22:38:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.168+0000 7fe43111e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe42c15bde0 0x7fe42c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.168+0000 7fe43111e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe42c15bde0 0x7fe42c0d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:55966/0 (socket says 172.21.15.6:55966) 2023-07-21T22:38:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.168+0000 7fe43111e640 1 -- 172.21.15.6:0/2357760388 learned_addr learned my addr 172.21.15.6:0/2357760388 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.168+0000 7fe43191f640 1 --2- 172.21.15.6:0/2357760388 >> v2:172.21.15.6:3300/0 conn(0x7fe42c0d2300 0x7fe42c0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.168+0000 7fe43091d640 1 --2- 172.21.15.6:0/2357760388 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe42c0d2fc0 0x7fe42c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.168+0000 7fe43111e640 1 -- 172.21.15.6:0/2357760388 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe42c0d2fc0 msgr2=0x7fe42c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:13.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.168+0000 7fe43111e640 1 --2- 172.21.15.6:0/2357760388 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe42c0d2fc0 0x7fe42c0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.168+0000 7fe43111e640 1 -- 172.21.15.6:0/2357760388 >> v2:172.21.15.6:3300/0 conn(0x7fe42c0d2300 msgr2=0x7fe42c0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:13.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.168+0000 7fe43111e640 1 --2- 172.21.15.6:0/2357760388 >> v2:172.21.15.6:3300/0 conn(0x7fe42c0d2300 0x7fe42c0d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.168+0000 7fe43111e640 1 -- 172.21.15.6:0/2357760388 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c0d0aa0 con 0x7fe42c15bde0 2023-07-21T22:38:13.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.172+0000 7fe43111e640 1 --2- 172.21.15.6:0/2357760388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe42c15bde0 0x7fe42c0d0270 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe42c08b210 tx=0x7fe42801c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=748f4a45046e86c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:13.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.172+0000 7fe423fff640 1 -- 172.21.15.6:0/2357760388 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4280aa620 con 0x7fe42c15bde0 2023-07-21T22:38:13.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.172+0000 7fe423fff640 1 -- 172.21.15.6:0/2357760388 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4280aa780 con 0x7fe42c15bde0 2023-07-21T22:38:13.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.172+0000 7fe423fff640 1 -- 172.21.15.6:0/2357760388 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4280aab10 con 0x7fe42c15bde0 2023-07-21T22:38:13.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.176+0000 7fe433382640 1 -- 172.21.15.6:0/2357760388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe42c15bde0 msgr2=0x7fe42c0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:13.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.176+0000 7fe433382640 1 --2- 172.21.15.6:0/2357760388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe42c15bde0 0x7fe42c0d0270 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe42c08b210 tx=0x7fe42801c500 comp rx=0 tx=0).stop 2023-07-21T22:38:13.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.176+0000 7fe433382640 1 -- 172.21.15.6:0/2357760388 shutdown_connections 2023-07-21T22:38:13.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.176+0000 7fe433382640 1 --2- 172.21.15.6:0/2357760388 >> v2:172.21.15.6:3300/0 conn(0x7fe42c0d2300 0x7fe42c0d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.176+0000 7fe433382640 1 --2- 172.21.15.6:0/2357760388 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe42c0d2fc0 0x7fe42c0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.176+0000 7fe433382640 1 --2- 172.21.15.6:0/2357760388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe42c15bde0 0x7fe42c0d0270 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.176+0000 7fe433382640 1 -- 172.21.15.6:0/2357760388 >> 172.21.15.6:0/2357760388 conn(0x7fe42c0659d0 msgr2=0x7fe42c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:13.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.176+0000 7fe433382640 1 -- 172.21.15.6:0/2357760388 shutdown_connections 2023-07-21T22:38:13.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.176+0000 7fe433382640 1 -- 172.21.15.6:0/2357760388 wait complete. 2023-07-21T22:38:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.176+0000 7fe433382640 1 Processor -- start 2023-07-21T22:38:13.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.176+0000 7fe433382640 1 -- start start 2023-07-21T22:38:13.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.176+0000 7fe433382640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe42c0d2300 0x7fe42c14d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.176+0000 7fe433382640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe42c0d2fc0 0x7fe42c0c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.176+0000 7fe433382640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe42c15bde0 0x7fe42c0b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.176+0000 7fe433382640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c150ad0 con 0x7fe42c0d2300 2023-07-21T22:38:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.176+0000 7fe433382640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c150130 con 0x7fe42c15bde0 2023-07-21T22:38:13.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.176+0000 7fe433382640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c150410 con 0x7fe42c0d2fc0 2023-07-21T22:38:13.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.176+0000 7fe43111e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe42c0d2300 0x7fe42c14d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.180+0000 7fe43111e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe42c0d2300 0x7fe42c14d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51446/0 (socket says 172.21.15.6:51446) 2023-07-21T22:38:13.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.180+0000 7fe43111e640 1 -- 172.21.15.6:0/262456672 learned_addr learned my addr 172.21.15.6:0/262456672 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:13.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.180+0000 7fe43091d640 1 --2- 172.21.15.6:0/262456672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe42c0d2fc0 0x7fe42c0c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.180+0000 7fe43191f640 1 --2- 172.21.15.6:0/262456672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe42c15bde0 0x7fe42c0b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.180+0000 7fe43111e640 1 -- 172.21.15.6:0/262456672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe42c0d2fc0 msgr2=0x7fe42c0c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:13.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.180+0000 7fe43111e640 1 --2- 172.21.15.6:0/262456672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe42c0d2fc0 0x7fe42c0c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.180+0000 7fe43111e640 1 -- 172.21.15.6:0/262456672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe42c15bde0 msgr2=0x7fe42c0b7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.180+0000 7fe43111e640 1 --2- 172.21.15.6:0/262456672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe42c15bde0 0x7fe42c0b7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.180+0000 7fe43111e640 1 -- 172.21.15.6:0/262456672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe428009480 con 0x7fe42c0d2300 2023-07-21T22:38:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.180+0000 7fe43111e640 1 --2- 172.21.15.6:0/262456672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe42c0d2300 0x7fe42c14d5c0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fe42801abb0 tx=0x7fe4280192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.180+0000 7fe421ffb640 1 -- 172.21.15.6:0/262456672 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428004510 con 0x7fe42c0d2300 2023-07-21T22:38:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.180+0000 7fe421ffb640 1 -- 172.21.15.6:0/262456672 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4280059a0 con 0x7fe42c0d2300 2023-07-21T22:38:13.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.180+0000 7fe421ffb640 1 -- 172.21.15.6:0/262456672 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428005d50 con 0x7fe42c0d2300 2023-07-21T22:38:13.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.180+0000 7fe433382640 1 -- 172.21.15.6:0/262456672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42c1506f0 con 0x7fe42c0d2300 2023-07-21T22:38:13.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.180+0000 7fe433382640 1 -- 172.21.15.6:0/262456672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42c149b00 con 0x7fe42c0d2300 2023-07-21T22:38:13.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.180+0000 7fe433382640 1 -- 172.21.15.6:0/262456672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42c150c10 con 0x7fe42c0d2300 2023-07-21T22:38:13.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.180+0000 7fe421ffb640 1 -- 172.21.15.6:0/262456672 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe4280aa8f0 con 0x7fe42c0d2300 2023-07-21T22:38:13.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.180+0000 7fe421ffb640 1 --2- 172.21.15.6:0/262456672 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fe4100663a0 0x7fe410068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.184+0000 7fe421ffb640 1 -- 172.21.15.6:0/262456672 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6556+0+0 (secure 0 0 0) 0x7fe42811e6b0 con 0x7fe42c0d2300 2023-07-21T22:38:13.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.184+0000 7fe43091d640 1 --2- 172.21.15.6:0/262456672 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fe4100663a0 0x7fe410068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.184+0000 7fe43091d640 1 --2- 172.21.15.6:0/262456672 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fe4100663a0 0x7fe410068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe42c1521a0 tx=0x7fe41c008040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:13.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.188+0000 7fe421ffb640 1 -- 172.21.15.6:0/262456672 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe42c150c10 con 0x7fe42c0d2300 2023-07-21T22:38:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.344+0000 7fe433382640 1 -- 172.21.15.6:0/262456672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe42c0678d0 con 0x7fe42c0d2300 2023-07-21T22:38:13.904 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:38:13.908 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:38:14.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.992+0000 7fe421ffb640 1 -- 172.21.15.6:0/262456672 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v134) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe4280eb7b0 con 0x7fe42c0d2300 2023-07-21T22:38:14.038 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-07-21T22:38:14.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.996+0000 7fe433382640 1 -- 172.21.15.6:0/262456672 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fe4100663a0 msgr2=0x7fe410068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:14.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.996+0000 7fe433382640 1 --2- 172.21.15.6:0/262456672 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fe4100663a0 0x7fe410068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe42c1521a0 tx=0x7fe41c008040 comp rx=0 tx=0).stop 2023-07-21T22:38:14.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.996+0000 7fe433382640 1 -- 172.21.15.6:0/262456672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe42c0d2300 msgr2=0x7fe42c14d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:14.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.996+0000 7fe433382640 1 --2- 172.21.15.6:0/262456672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe42c0d2300 0x7fe42c14d5c0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fe42801abb0 tx=0x7fe4280192a0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.996+0000 7fe433382640 1 -- 172.21.15.6:0/262456672 shutdown_connections 2023-07-21T22:38:14.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.996+0000 7fe433382640 1 --2- 172.21.15.6:0/262456672 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fe4100663a0 0x7fe410068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.996+0000 7fe433382640 1 --2- 172.21.15.6:0/262456672 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe42c15bde0 0x7fe42c0b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.996+0000 7fe433382640 1 --2- 172.21.15.6:0/262456672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe42c0d2fc0 0x7fe42c0c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.996+0000 7fe433382640 1 --2- 172.21.15.6:0/262456672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe42c0d2300 0x7fe42c14d5c0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.996+0000 7fe433382640 1 -- 172.21.15.6:0/262456672 >> 172.21.15.6:0/262456672 conn(0x7fe42c0659d0 msgr2=0x7fe42c0cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:14.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.996+0000 7fe433382640 1 -- 172.21.15.6:0/262456672 shutdown_connections 2023-07-21T22:38:14.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:13.996+0000 7fe433382640 1 -- 172.21.15.6:0/262456672 wait complete. 2023-07-21T22:38:14.066 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-21T22:38:14.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.168+0000 7f836020b640 1 Processor -- start 2023-07-21T22:38:14.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.168+0000 7f836020b640 1 -- start start 2023-07-21T22:38:14.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.172+0000 7f836020b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83580ccff0 0x7f835815e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:14.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.172+0000 7f836020b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83580cbe50 con 0x7f8358159a70 2023-07-21T22:38:14.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.172+0000 7f836020b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83580cd410 con 0x7f8358071030 2023-07-21T22:38:14.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.172+0000 7f836020b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f835815e5a0 con 0x7f83580ccff0 2023-07-21T22:38:14.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.172+0000 7f835e7a8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83580ccff0 0x7f835815e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:14.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.172+0000 7f835dfa7640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8358159a70 0x7f8358070920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42006/0 (socket says 172.21.15.6:42006) 2023-07-21T22:38:14.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.172+0000 7f835dfa7640 1 -- 172.21.15.6:0/192695414 learned_addr learned my addr 172.21.15.6:0/192695414 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:14.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.172+0000 7f835e7a8640 1 -- 172.21.15.6:0/192695414 >> v1:172.21.15.161:6789/0 conn(0x7f8358071030 legacy=0x7f83580c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:14.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.172+0000 7f835e7a8640 1 -- 172.21.15.6:0/192695414 >> v1:172.21.15.6:6789/0 conn(0x7f8358159a70 legacy=0x7f8358070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:14.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.172+0000 7f835cfa5640 1 -- 172.21.15.6:0/192695414 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198942542 0 0) 0x7f83580cbe50 con 0x7f8358159a70 2023-07-21T22:38:14.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.172+0000 7f835e7a8640 1 -- 172.21.15.6:0/192695414 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83580cd660 con 0x7f83580ccff0 2023-07-21T22:38:14.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.172+0000 7f835e7a8640 1 --2- 172.21.15.6:0/192695414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83580ccff0 0x7f835815e060 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f8350009d90 tx=0x7f835001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a5526690f51f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:14.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.172+0000 7f835cfa5640 1 -- 172.21.15.6:0/192695414 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83500a5970 con 0x7f83580ccff0 2023-07-21T22:38:14.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.172+0000 7f835cfa5640 1 -- 172.21.15.6:0/192695414 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83500a5ad0 con 0x7f83580ccff0 2023-07-21T22:38:14.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.172+0000 7f835cfa5640 1 -- 172.21.15.6:0/192695414 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83500a5e60 con 0x7f83580ccff0 2023-07-21T22:38:14.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.176+0000 7f836020b640 1 -- 172.21.15.6:0/192695414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83580ccff0 msgr2=0x7f835815e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:14.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.176+0000 7f836020b640 1 --2- 172.21.15.6:0/192695414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83580ccff0 0x7f835815e060 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f8350009d90 tx=0x7f835001c890 comp rx=0 tx=0).stop 2023-07-21T22:38:14.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.176+0000 7f836020b640 1 -- 172.21.15.6:0/192695414 shutdown_connections 2023-07-21T22:38:14.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.176+0000 7f836020b640 1 --2- 172.21.15.6:0/192695414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83580ccff0 0x7f835815e060 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.176+0000 7f836020b640 1 -- 172.21.15.6:0/192695414 >> 172.21.15.6:0/192695414 conn(0x7f83580afac0 msgr2=0x7f83580afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:14.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.176+0000 7f836020b640 1 -- 172.21.15.6:0/192695414 shutdown_connections 2023-07-21T22:38:14.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.176+0000 7f836020b640 1 -- 172.21.15.6:0/192695414 wait complete. 2023-07-21T22:38:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.176+0000 7f836020b640 1 Processor -- start 2023-07-21T22:38:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.176+0000 7f836020b640 1 -- start start 2023-07-21T22:38:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.176+0000 7f836020b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8358071030 0x7f83580b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.176+0000 7f836020b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83580ccff0 0x7f8358150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.176+0000 7f836020b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8358159a70 0x7f8358150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.176+0000 7f836020b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8358152bc0 con 0x7f8358159a70 2023-07-21T22:38:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.176+0000 7f836020b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8358150c90 con 0x7f83580ccff0 2023-07-21T22:38:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.176+0000 7f836020b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83581529e0 con 0x7f8358071030 2023-07-21T22:38:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.176+0000 7f835e7a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8358159a70 0x7f8358150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.176+0000 7f835e7a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8358159a70 0x7f8358150750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51456/0 (socket says 172.21.15.6:51456) 2023-07-21T22:38:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.176+0000 7f835e7a8640 1 -- 172.21.15.6:0/3490455486 learned_addr learned my addr 172.21.15.6:0/3490455486 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.176+0000 7f835dfa7640 1 --2- 172.21.15.6:0/3490455486 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8358071030 0x7f83580b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.176+0000 7f835d7a6640 1 --2- 172.21.15.6:0/3490455486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83580ccff0 0x7f8358150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:14.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.180+0000 7f835e7a8640 1 -- 172.21.15.6:0/3490455486 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8358071030 msgr2=0x7f83580b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:14.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.180+0000 7f835e7a8640 1 --2- 172.21.15.6:0/3490455486 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8358071030 0x7f83580b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.180+0000 7f835e7a8640 1 -- 172.21.15.6:0/3490455486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83580ccff0 msgr2=0x7f8358150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:14.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.180+0000 7f835e7a8640 1 --2- 172.21.15.6:0/3490455486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83580ccff0 0x7f8358150210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.180+0000 7f835e7a8640 1 -- 172.21.15.6:0/3490455486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8350009a70 con 0x7f8358159a70 2023-07-21T22:38:14.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.180+0000 7f835e7a8640 1 --2- 172.21.15.6:0/3490455486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8358159a70 0x7f8358150750 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f8350009d90 tx=0x7f8350019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:14.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.180+0000 7f834e7fc640 1 -- 172.21.15.6:0/3490455486 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83500adea0 con 0x7f8358159a70 2023-07-21T22:38:14.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.180+0000 7f834e7fc640 1 -- 172.21.15.6:0/3490455486 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83500039a0 con 0x7f8358159a70 2023-07-21T22:38:14.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.180+0000 7f836020b640 1 -- 172.21.15.6:0/3490455486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83580b1e40 con 0x7f8358159a70 2023-07-21T22:38:14.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.180+0000 7f834e7fc640 1 -- 172.21.15.6:0/3490455486 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8350003d10 con 0x7f8358159a70 2023-07-21T22:38:14.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.180+0000 7f836020b640 1 -- 172.21.15.6:0/3490455486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83580b2400 con 0x7f8358159a70 2023-07-21T22:38:14.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.180+0000 7f836020b640 1 -- 172.21.15.6:0/3490455486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8358152d00 con 0x7f8358159a70 2023-07-21T22:38:14.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.180+0000 7f834e7fc640 1 -- 172.21.15.6:0/3490455486 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8350004030 con 0x7f8358159a70 2023-07-21T22:38:14.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.180+0000 7f834e7fc640 1 --2- 172.21.15.6:0/3490455486 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f833c0663a0 0x7f833c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:14.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.180+0000 7f834e7fc640 1 -- 172.21.15.6:0/3490455486 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6142+0+0 (secure 0 0 0) 0x7f835011f3f0 con 0x7f8358159a70 2023-07-21T22:38:14.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.184+0000 7f835dfa7640 1 --2- 172.21.15.6:0/3490455486 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f833c0663a0 0x7f833c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:14.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.184+0000 7f835dfa7640 1 --2- 172.21.15.6:0/3490455486 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f833c0663a0 0x7f833c068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8354000f70 tx=0x7f8354007240 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:14.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.184+0000 7f834e7fc640 1 -- 172.21.15.6:0/3490455486 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f83500ec750 con 0x7f8358159a70 2023-07-21T22:38:14.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.340+0000 7f836020b640 1 -- 172.21.15.6:0/3490455486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f8358151980 con 0x7f8358159a70 2023-07-21T22:38:14.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.348+0000 7f834e7fc640 1 -- 172.21.15.6:0/3490455486 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v43) v1 ==== 115+0+0 (secure 0 0 0) 0x7f83500c50b0 con 0x7f8358159a70 2023-07-21T22:38:14.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.348+0000 7f836020b640 1 -- 172.21.15.6:0/3490455486 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f833c0663a0 msgr2=0x7f833c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:14.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.348+0000 7f836020b640 1 --2- 172.21.15.6:0/3490455486 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f833c0663a0 0x7f833c068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8354000f70 tx=0x7f8354007240 comp rx=0 tx=0).stop 2023-07-21T22:38:14.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.348+0000 7f836020b640 1 -- 172.21.15.6:0/3490455486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8358159a70 msgr2=0x7f8358150750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:14.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.348+0000 7f836020b640 1 --2- 172.21.15.6:0/3490455486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8358159a70 0x7f8358150750 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f8350009d90 tx=0x7f8350019630 comp rx=0 tx=0).stop 2023-07-21T22:38:14.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.348+0000 7f836020b640 1 -- 172.21.15.6:0/3490455486 shutdown_connections 2023-07-21T22:38:14.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.348+0000 7f836020b640 1 --2- 172.21.15.6:0/3490455486 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f833c0663a0 0x7f833c068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.348+0000 7f836020b640 1 --2- 172.21.15.6:0/3490455486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8358159a70 0x7f8358150750 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.348+0000 7f836020b640 1 --2- 172.21.15.6:0/3490455486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83580ccff0 0x7f8358150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.348+0000 7f836020b640 1 --2- 172.21.15.6:0/3490455486 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8358071030 0x7f83580b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.348+0000 7f836020b640 1 -- 172.21.15.6:0/3490455486 >> 172.21.15.6:0/3490455486 conn(0x7f83580afac0 msgr2=0x7f83580afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:14.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.348+0000 7f836020b640 1 -- 172.21.15.6:0/3490455486 shutdown_connections 2023-07-21T22:38:14.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.348+0000 7f836020b640 1 -- 172.21.15.6:0/3490455486 wait complete. 2023-07-21T22:38:14.413 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-21T22:38:14.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff28839d640 1 Processor -- start 2023-07-21T22:38:14.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff28839d640 1 -- start start 2023-07-21T22:38:14.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff28839d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff280159a70 0x7ff2800ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:14.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff28839d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2800cbe50 con 0x7ff28015e060 2023-07-21T22:38:14.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff28839d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2800cd660 con 0x7ff280071030 2023-07-21T22:38:14.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff28839d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2800cc0a0 con 0x7ff280159a70 2023-07-21T22:38:14.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff285938640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff28015e060 0x7ff280070920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42022/0 (socket says 172.21.15.6:42022) 2023-07-21T22:38:14.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff285938640 1 -- 172.21.15.6:0/1913188990 learned_addr learned my addr 172.21.15.6:0/1913188990 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:14.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff286139640 1 --2- 172.21.15.6:0/1913188990 >> v2:172.21.15.161:3300/0 conn(0x7ff280159a70 0x7ff2800ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:14.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff285137640 1 -- 172.21.15.6:0/1913188990 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185751084 0 0) 0x7ff2800cbe50 con 0x7ff28015e060 2023-07-21T22:38:14.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff285137640 1 -- 172.21.15.6:0/1913188990 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff26c003530 con 0x7ff28015e060 2023-07-21T22:38:14.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff285137640 1 -- 172.21.15.6:0/1913188990 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4287453702 0 0) 0x7ff26c003530 con 0x7ff28015e060 2023-07-21T22:38:14.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff285137640 1 -- 172.21.15.6:0/1913188990 >> v2:172.21.15.161:3300/0 conn(0x7ff280159a70 msgr2=0x7ff2800ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:14.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff285137640 1 --2- 172.21.15.6:0/1913188990 >> v2:172.21.15.161:3300/0 conn(0x7ff280159a70 0x7ff2800ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff285137640 1 -- 172.21.15.6:0/1913188990 >> v1:172.21.15.161:6789/0 conn(0x7ff280071030 legacy=0x7ff2800c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:14.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff285137640 1 -- 172.21.15.6:0/1913188990 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2800cc380 con 0x7ff28015e060 2023-07-21T22:38:14.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff285137640 1 -- 172.21.15.6:0/1913188990 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7ff270001680 con 0x7ff28015e060 2023-07-21T22:38:14.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff285137640 1 -- 172.21.15.6:0/1913188990 >> v1:172.21.15.6:6789/0 conn(0x7ff28015e060 legacy=0x7ff280070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:14.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff285137640 1 --2- 172.21.15.6:0/1913188990 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff26c003980 0x7ff26c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff285137640 1 --2- 172.21.15.6:0/1913188990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff26c0047d0 0x7ff26c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff285137640 1 --2- 172.21.15.6:0/1913188990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff26c0052a0 0x7ff26c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff285137640 1 -- 172.21.15.6:0/1913188990 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2800cc0a0 con 0x7ff26c0052a0 2023-07-21T22:38:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff285137640 1 -- 172.21.15.6:0/1913188990 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c00c1d0 con 0x7ff26c0047d0 2023-07-21T22:38:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff285137640 1 -- 172.21.15.6:0/1913188990 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c00c390 con 0x7ff26c003980 2023-07-21T22:38:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff28693a640 1 --2- 172.21.15.6:0/1913188990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff26c0052a0 0x7ff26c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff285938640 1 --2- 172.21.15.6:0/1913188990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff26c0047d0 0x7ff26c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff286139640 1 --2- 172.21.15.6:0/1913188990 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff26c003980 0x7ff26c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:14.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff28693a640 1 -- 172.21.15.6:0/1913188990 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff26c003980 msgr2=0x7ff26c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:14.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff28693a640 1 --2- 172.21.15.6:0/1913188990 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff26c003980 0x7ff26c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff28693a640 1 -- 172.21.15.6:0/1913188990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff26c0047d0 msgr2=0x7ff26c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:14.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff28693a640 1 --2- 172.21.15.6:0/1913188990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff26c0047d0 0x7ff26c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.528+0000 7ff28693a640 1 -- 172.21.15.6:0/1913188990 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c003530 con 0x7ff26c0052a0 2023-07-21T22:38:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.532+0000 7ff28693a640 1 -- 172.21.15.6:0/1913188990 reap_dead start 2023-07-21T22:38:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.532+0000 7ff28693a640 1 --2- 172.21.15.6:0/1913188990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff26c0052a0 0x7ff26c00b990 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7ff278001e70 tx=0x7ff27801c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71adccdccc144d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.532+0000 7ff285137640 1 -- 172.21.15.6:0/1913188990 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278003b80 con 0x7ff26c0052a0 2023-07-21T22:38:14.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.532+0000 7ff285137640 1 -- 172.21.15.6:0/1913188990 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff278003d20 con 0x7ff26c0052a0 2023-07-21T22:38:14.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.532+0000 7ff285137640 1 -- 172.21.15.6:0/1913188990 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278005260 con 0x7ff26c0052a0 2023-07-21T22:38:14.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.532+0000 7ff28839d640 1 -- 172.21.15.6:0/1913188990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff26c0052a0 msgr2=0x7ff26c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:14.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.532+0000 7ff28839d640 1 --2- 172.21.15.6:0/1913188990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff26c0052a0 0x7ff26c00b990 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7ff278001e70 tx=0x7ff27801c730 comp rx=0 tx=0).stop 2023-07-21T22:38:14.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.532+0000 7ff28839d640 1 -- 172.21.15.6:0/1913188990 shutdown_connections 2023-07-21T22:38:14.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.532+0000 7ff28839d640 1 --2- 172.21.15.6:0/1913188990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff26c0052a0 0x7ff26c00b990 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.532+0000 7ff28839d640 1 -- 172.21.15.6:0/1913188990 >> 172.21.15.6:0/1913188990 conn(0x7ff2800afac0 msgr2=0x7ff2800afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:14.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.532+0000 7ff28839d640 1 -- 172.21.15.6:0/1913188990 shutdown_connections 2023-07-21T22:38:14.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.532+0000 7ff28839d640 1 -- 172.21.15.6:0/1913188990 wait complete. 2023-07-21T22:38:14.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff28839d640 1 Processor -- start 2023-07-21T22:38:14.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff28839d640 1 -- start start 2023-07-21T22:38:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff28839d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff26c0052a0 0x7ff28006b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff28839d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff280148ac0 0x7ff2800b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff28839d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff280148ff0 0x7ff280147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff28839d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28014f4c0 con 0x7ff280148ff0 2023-07-21T22:38:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff28839d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28014ebb0 con 0x7ff280148ac0 2023-07-21T22:38:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff28839d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2800c11b0 con 0x7ff26c0052a0 2023-07-21T22:38:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff28693a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff280148ff0 0x7ff280147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff28693a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff280148ff0 0x7ff280147ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51482/0 (socket says 172.21.15.6:51482) 2023-07-21T22:38:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff28693a640 1 -- 172.21.15.6:0/2976564840 learned_addr learned my addr 172.21.15.6:0/2976564840 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff285938640 1 --2- 172.21.15.6:0/2976564840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff280148ac0 0x7ff2800b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff286139640 1 --2- 172.21.15.6:0/2976564840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff26c0052a0 0x7ff28006b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff28693a640 1 -- 172.21.15.6:0/2976564840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff26c0052a0 msgr2=0x7ff28006b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff28693a640 1 --2- 172.21.15.6:0/2976564840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff26c0052a0 0x7ff28006b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff28693a640 1 -- 172.21.15.6:0/2976564840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff280148ac0 msgr2=0x7ff2800b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff28693a640 1 --2- 172.21.15.6:0/2976564840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff280148ac0 0x7ff2800b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff28693a640 1 -- 172.21.15.6:0/2976564840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2800c1490 con 0x7ff280148ff0 2023-07-21T22:38:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff28693a640 1 --2- 172.21.15.6:0/2976564840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff280148ff0 0x7ff280147ef0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7ff27801c560 tx=0x7ff26c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff276ffd640 1 -- 172.21.15.6:0/2976564840 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780ac070 con 0x7ff280148ff0 2023-07-21T22:38:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff276ffd640 1 -- 172.21.15.6:0/2976564840 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff278007dc0 con 0x7ff280148ff0 2023-07-21T22:38:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff276ffd640 1 -- 172.21.15.6:0/2976564840 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278001260 con 0x7ff280148ff0 2023-07-21T22:38:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff28839d640 1 -- 172.21.15.6:0/2976564840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28014ee00 con 0x7ff280148ff0 2023-07-21T22:38:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.536+0000 7ff28839d640 1 -- 172.21.15.6:0/2976564840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2800b2410 con 0x7ff280148ff0 2023-07-21T22:38:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.540+0000 7ff28839d640 1 -- 172.21.15.6:0/2976564840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2800678d0 con 0x7ff280148ff0 2023-07-21T22:38:14.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.540+0000 7ff276ffd640 1 -- 172.21.15.6:0/2976564840 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff278003980 con 0x7ff280148ff0 2023-07-21T22:38:14.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.540+0000 7ff276ffd640 1 --2- 172.21.15.6:0/2976564840 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7ff2640663d0 0x7ff264068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:14.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.540+0000 7ff276ffd640 1 -- 172.21.15.6:0/2976564840 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6142+0+0 (secure 0 0 0) 0x7ff27811c4d0 con 0x7ff280148ff0 2023-07-21T22:38:14.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.540+0000 7ff286139640 1 --2- 172.21.15.6:0/2976564840 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7ff2640663d0 0x7ff264068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:14.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.540+0000 7ff286139640 1 --2- 172.21.15.6:0/2976564840 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7ff2640663d0 0x7ff264068880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff28015d380 tx=0x7ff27c009190 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:14.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.544+0000 7ff276ffd640 1 -- 172.21.15.6:0/2976564840 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff2780e9830 con 0x7ff280148ff0 2023-07-21T22:38:14.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.700+0000 7ff28839d640 1 -- 172.21.15.6:0/2976564840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7ff2800ced70 con 0x7ff280148ff0 2023-07-21T22:38:14.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.708+0000 7ff276ffd640 1 -- 172.21.15.6:0/2976564840 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v44) v1 ==== 120+0+0 (secure 0 0 0) 0x7ff2780ece50 con 0x7ff280148ff0 2023-07-21T22:38:14.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.708+0000 7ff28839d640 1 -- 172.21.15.6:0/2976564840 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7ff2640663d0 msgr2=0x7ff264068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:14.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.708+0000 7ff28839d640 1 --2- 172.21.15.6:0/2976564840 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7ff2640663d0 0x7ff264068880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff28015d380 tx=0x7ff27c009190 comp rx=0 tx=0).stop 2023-07-21T22:38:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.708+0000 7ff28839d640 1 -- 172.21.15.6:0/2976564840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff280148ff0 msgr2=0x7ff280147ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.708+0000 7ff28839d640 1 --2- 172.21.15.6:0/2976564840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff280148ff0 0x7ff280147ef0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7ff27801c560 tx=0x7ff26c005800 comp rx=0 tx=0).stop 2023-07-21T22:38:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.708+0000 7ff28839d640 1 -- 172.21.15.6:0/2976564840 shutdown_connections 2023-07-21T22:38:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.708+0000 7ff28839d640 1 --2- 172.21.15.6:0/2976564840 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7ff2640663d0 0x7ff264068880 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.708+0000 7ff28839d640 1 --2- 172.21.15.6:0/2976564840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff280148ff0 0x7ff280147ef0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.708+0000 7ff28839d640 1 --2- 172.21.15.6:0/2976564840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff280148ac0 0x7ff2800b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.708+0000 7ff28839d640 1 --2- 172.21.15.6:0/2976564840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff26c0052a0 0x7ff28006b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.708+0000 7ff28839d640 1 -- 172.21.15.6:0/2976564840 >> 172.21.15.6:0/2976564840 conn(0x7ff2800afac0 msgr2=0x7ff280070920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:14.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.708+0000 7ff28839d640 1 -- 172.21.15.6:0/2976564840 shutdown_connections 2023-07-21T22:38:14.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.708+0000 7ff28839d640 1 -- 172.21.15.6:0/2976564840 wait complete. 2023-07-21T22:38:14.773 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-21T22:38:14.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.876+0000 7f6495fa9640 1 Processor -- start 2023-07-21T22:38:14.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.876+0000 7f6495fa9640 1 -- start start 2023-07-21T22:38:14.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.876+0000 7f6495fa9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f64900cc960 0x7f64900ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:14.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.876+0000 7f6495fa9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64900b1620 0x7f64900ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:14.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.876+0000 7f6495fa9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64900cd270 con 0x7f6490160750 2023-07-21T22:38:14.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.876+0000 7f6495fa9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64900cf710 con 0x7f64900cc960 2023-07-21T22:38:14.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.876+0000 7f6495fa9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64900cf430 con 0x7f64900b1620 2023-07-21T22:38:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.876+0000 7f6494fa7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f64900cc960 0x7f64900ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.876+0000 7f6494fa7640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f64900cc960 0x7f64900ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51498/0 (socket says 172.21.15.6:51498) 2023-07-21T22:38:14.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.876+0000 7f6494fa7640 1 -- 172.21.15.6:0/3793867749 learned_addr learned my addr 172.21.15.6:0/3793867749 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:14.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.876+0000 7f648ffff640 1 --2- 172.21.15.6:0/3793867749 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64900b1620 0x7f64900ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:14.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.876+0000 7f6494fa7640 1 -- 172.21.15.6:0/3793867749 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64900b1620 msgr2=0x7f64900ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:14.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.876+0000 7f6494fa7640 1 --2- 172.21.15.6:0/3793867749 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64900b1620 0x7f64900ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.876+0000 7f6494fa7640 1 -- 172.21.15.6:0/3793867749 >> v1:172.21.15.6:6789/0 conn(0x7f6490160750 legacy=0x7f64900b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:14.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.876+0000 7f6494fa7640 1 -- 172.21.15.6:0/3793867749 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649015fc70 con 0x7f64900cc960 2023-07-21T22:38:14.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.876+0000 7f648f7fe640 1 -- 172.21.15.6:0/3793867749 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429105297 0 0) 0x7f64900cd270 con 0x7f6490160750 2023-07-21T22:38:14.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.880+0000 7f6494fa7640 1 --2- 172.21.15.6:0/3793867749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900cc960 0x7f64900ccd30 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f6484009870 tx=0x7f648401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54dc8c28637a9ada server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:14.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.880+0000 7f648f7fe640 1 -- 172.21.15.6:0/3793867749 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64840aa670 con 0x7f64900cc960 2023-07-21T22:38:14.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.880+0000 7f648f7fe640 1 -- 172.21.15.6:0/3793867749 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64840aa7d0 con 0x7f64900cc960 2023-07-21T22:38:14.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.880+0000 7f648f7fe640 1 -- 172.21.15.6:0/3793867749 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64840aab60 con 0x7f64900cc960 2023-07-21T22:38:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.880+0000 7f6495fa9640 1 -- 172.21.15.6:0/3793867749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900cc960 msgr2=0x7f64900ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.880+0000 7f6495fa9640 1 --2- 172.21.15.6:0/3793867749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900cc960 0x7f64900ccd30 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f6484009870 tx=0x7f648401c510 comp rx=0 tx=0).stop 2023-07-21T22:38:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.880+0000 7f6495fa9640 1 -- 172.21.15.6:0/3793867749 shutdown_connections 2023-07-21T22:38:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.880+0000 7f6495fa9640 1 --2- 172.21.15.6:0/3793867749 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64900b1620 0x7f64900ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.880+0000 7f6495fa9640 1 --2- 172.21.15.6:0/3793867749 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900cc960 0x7f64900ccd30 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.880+0000 7f6495fa9640 1 -- 172.21.15.6:0/3793867749 >> 172.21.15.6:0/3793867749 conn(0x7f6490069f50 msgr2=0x7f649006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.880+0000 7f6495fa9640 1 -- 172.21.15.6:0/3793867749 shutdown_connections 2023-07-21T22:38:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.880+0000 7f6495fa9640 1 -- 172.21.15.6:0/3793867749 wait complete. 2023-07-21T22:38:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.880+0000 7f6495fa9640 1 Processor -- start 2023-07-21T22:38:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f6495fa9640 1 -- start start 2023-07-21T22:38:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f6495fa9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900b1620 0x7f649014ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f6495fa9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64900cc960 0x7f6490159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f6495fa9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6490160750 0x7f649015a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f6495fa9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64901559b0 con 0x7f64900b1620 2023-07-21T22:38:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f6495fa9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64900b1e00 con 0x7f6490160750 2023-07-21T22:38:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f6495fa9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649014ef70 con 0x7f64900cc960 2023-07-21T22:38:14.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f6494fa7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900b1620 0x7f649014ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:14.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f6494fa7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900b1620 0x7f649014ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51500/0 (socket says 172.21.15.6:51500) 2023-07-21T22:38:14.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f6494fa7640 1 -- 172.21.15.6:0/3825154969 learned_addr learned my addr 172.21.15.6:0/3825154969 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f648ffff640 1 --2- 172.21.15.6:0/3825154969 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64900cc960 0x7f6490159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f6494fa7640 1 -- 172.21.15.6:0/3825154969 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64900cc960 msgr2=0x7f6490159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f64957a8640 1 --2- 172.21.15.6:0/3825154969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6490160750 0x7f649015a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f6494fa7640 1 --2- 172.21.15.6:0/3825154969 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64900cc960 0x7f6490159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f6494fa7640 1 -- 172.21.15.6:0/3825154969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6490160750 msgr2=0x7f649015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f6494fa7640 1 --2- 172.21.15.6:0/3825154969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6490160750 0x7f649015a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f6494fa7640 1 -- 172.21.15.6:0/3825154969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64840094d0 con 0x7f64900b1620 2023-07-21T22:38:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f64957a8640 1 --2- 172.21.15.6:0/3825154969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6490160750 0x7f649015a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f6494fa7640 1 --2- 172.21.15.6:0/3825154969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900b1620 0x7f649014ea30 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f648401a140 tx=0x7f648401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f648d7fa640 1 -- 172.21.15.6:0/3825154969 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64840aae10 con 0x7f64900b1620 2023-07-21T22:38:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f648d7fa640 1 -- 172.21.15.6:0/3825154969 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64840b7070 con 0x7f64900b1620 2023-07-21T22:38:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f6495fa9640 1 -- 172.21.15.6:0/3825154969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f649014fb80 con 0x7f64900b1620 2023-07-21T22:38:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f648d7fa640 1 -- 172.21.15.6:0/3825154969 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6484004220 con 0x7f64900b1620 2023-07-21T22:38:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f6495fa9640 1 -- 172.21.15.6:0/3825154969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6490150140 con 0x7f64900b1620 2023-07-21T22:38:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.884+0000 7f6495fa9640 1 -- 172.21.15.6:0/3825154969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f649004e020 con 0x7f64900b1620 2023-07-21T22:38:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.888+0000 7f648d7fa640 1 -- 172.21.15.6:0/3825154969 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6484004380 con 0x7f64900b1620 2023-07-21T22:38:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.888+0000 7f648d7fa640 1 --2- 172.21.15.6:0/3825154969 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f64740663a0 0x7f6474068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.888+0000 7f648d7fa640 1 -- 172.21.15.6:0/3825154969 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6142+0+0 (secure 0 0 0) 0x7f648411e200 con 0x7f64900b1620 2023-07-21T22:38:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.888+0000 7f648ffff640 1 --2- 172.21.15.6:0/3825154969 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f64740663a0 0x7f6474068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.888+0000 7f648ffff640 1 --2- 172.21.15.6:0/3825154969 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f64740663a0 0x7f6474068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6490156dc0 tx=0x7f647c008040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:14.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:14.892+0000 7f648d7fa640 1 -- 172.21.15.6:0/3825154969 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f64840eb480 con 0x7f64900b1620 2023-07-21T22:38:15.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.048+0000 7f6495fa9640 1 -- 172.21.15.6:0/3825154969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6490072a90 con 0x7f64900b1620 2023-07-21T22:38:15.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.056+0000 7f648d7fa640 1 -- 172.21.15.6:0/3825154969 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v45) v1 ==== 104+0+0 (secure 0 0 0) 0x7f64840eeaa0 con 0x7f64900b1620 2023-07-21T22:38:15.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.056+0000 7f6495fa9640 1 -- 172.21.15.6:0/3825154969 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f64740663a0 msgr2=0x7f6474068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:15.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.056+0000 7f6495fa9640 1 --2- 172.21.15.6:0/3825154969 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f64740663a0 0x7f6474068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6490156dc0 tx=0x7f647c008040 comp rx=0 tx=0).stop 2023-07-21T22:38:15.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.056+0000 7f6495fa9640 1 -- 172.21.15.6:0/3825154969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900b1620 msgr2=0x7f649014ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:15.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.056+0000 7f6495fa9640 1 --2- 172.21.15.6:0/3825154969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900b1620 0x7f649014ea30 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f648401a140 tx=0x7f648401ad50 comp rx=0 tx=0).stop 2023-07-21T22:38:15.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.056+0000 7f6495fa9640 1 -- 172.21.15.6:0/3825154969 shutdown_connections 2023-07-21T22:38:15.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.056+0000 7f6495fa9640 1 --2- 172.21.15.6:0/3825154969 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f64740663a0 0x7f6474068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.056+0000 7f6495fa9640 1 --2- 172.21.15.6:0/3825154969 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6490160750 0x7f649015a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.056+0000 7f6495fa9640 1 --2- 172.21.15.6:0/3825154969 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f64900cc960 0x7f6490159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.056+0000 7f6495fa9640 1 --2- 172.21.15.6:0/3825154969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900b1620 0x7f649014ea30 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.056+0000 7f6495fa9640 1 -- 172.21.15.6:0/3825154969 >> 172.21.15.6:0/3825154969 conn(0x7f6490069f50 msgr2=0x7f649015e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.056+0000 7f6495fa9640 1 -- 172.21.15.6:0/3825154969 shutdown_connections 2023-07-21T22:38:15.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.056+0000 7f6495fa9640 1 -- 172.21.15.6:0/3825154969 wait complete. 2023-07-21T22:38:15.121 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-07-21T22:38:15.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.220+0000 7fa08b4ca640 1 Processor -- start 2023-07-21T22:38:15.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.220+0000 7fa08b4ca640 1 -- start start 2023-07-21T22:38:15.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.220+0000 7fa08b4ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa08415f500 0x7fa08406cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:15.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.220+0000 7fa08b4ca640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa08406d430 0x7fa08406a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:15.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.220+0000 7fa08b4ca640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0840cdc80 con 0x7fa08406aa80 2023-07-21T22:38:15.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.220+0000 7fa08b4ca640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08406af20 con 0x7fa08406d430 2023-07-21T22:38:15.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.220+0000 7fa08b4ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08406e4c0 con 0x7fa08415f500 2023-07-21T22:38:15.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.220+0000 7fa089266640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa08415f500 0x7fa08406cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:15.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.220+0000 7fa088a65640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa08406d430 0x7fa08406a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:15.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.220+0000 7fa089266640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa08415f500 0x7fa08406cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:53702/0 (socket says 172.21.15.6:53702) 2023-07-21T22:38:15.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.220+0000 7fa089266640 1 -- 172.21.15.6:0/1553342488 learned_addr learned my addr 172.21.15.6:0/1553342488 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:15.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.220+0000 7fa088a65640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa08406d430 0x7fa08406a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:56048/0 (socket says 172.21.15.6:56048) 2023-07-21T22:38:15.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.220+0000 7fa089a67640 1 --1- 172.21.15.6:0/1553342488 >> v1:172.21.15.161:6789/0 conn(0x7fa08406aa80 0x7fa0840b1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:52684/0 (socket says 172.21.15.6:52684) 2023-07-21T22:38:15.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.220+0000 7fa089266640 1 -- 172.21.15.6:0/1553342488 >> v2:172.21.15.161:3300/0 conn(0x7fa08406d430 msgr2=0x7fa08406a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:15.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.220+0000 7fa089266640 1 --2- 172.21.15.6:0/1553342488 >> v2:172.21.15.161:3300/0 conn(0x7fa08406d430 0x7fa08406a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:15.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.220+0000 7fa089266640 1 -- 172.21.15.6:0/1553342488 >> v1:172.21.15.161:6789/0 conn(0x7fa08406aa80 legacy=0x7fa0840b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:15.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.220+0000 7fa089266640 1 -- 172.21.15.6:0/1553342488 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08406d940 con 0x7fa08415f500 2023-07-21T22:38:15.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.220+0000 7fa088a65640 1 --2- 172.21.15.6:0/1553342488 >> v2:172.21.15.161:3300/0 conn(0x7fa08406d430 0x7fa08406a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:15.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.224+0000 7fa089266640 1 --2- 172.21.15.6:0/1553342488 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa08415f500 0x7fa08406cef0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa080006fd0 tx=0x7fa08001c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=399942f513917833 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:15.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.224+0000 7fa07bfff640 1 -- 172.21.15.6:0/1553342488 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0800ab610 con 0x7fa08415f500 2023-07-21T22:38:15.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.224+0000 7fa07bfff640 1 -- 172.21.15.6:0/1553342488 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0800ab770 con 0x7fa08415f500 2023-07-21T22:38:15.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.224+0000 7fa07bfff640 1 -- 172.21.15.6:0/1553342488 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0800abb00 con 0x7fa08415f500 2023-07-21T22:38:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.224+0000 7fa08b4ca640 1 -- 172.21.15.6:0/1553342488 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa08415f500 msgr2=0x7fa08406cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.224+0000 7fa08b4ca640 1 --2- 172.21.15.6:0/1553342488 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa08415f500 0x7fa08406cef0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa080006fd0 tx=0x7fa08001c520 comp rx=0 tx=0).stop 2023-07-21T22:38:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.224+0000 7fa08b4ca640 1 -- 172.21.15.6:0/1553342488 shutdown_connections 2023-07-21T22:38:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.224+0000 7fa08b4ca640 1 --2- 172.21.15.6:0/1553342488 >> v2:172.21.15.161:3300/0 conn(0x7fa08406d430 0x7fa08406a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:15.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.224+0000 7fa08b4ca640 1 --2- 172.21.15.6:0/1553342488 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa08415f500 0x7fa08406cef0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:15.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.224+0000 7fa08b4ca640 1 -- 172.21.15.6:0/1553342488 >> 172.21.15.6:0/1553342488 conn(0x7fa0840659d0 msgr2=0x7fa084099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:15.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.224+0000 7fa08b4ca640 1 -- 172.21.15.6:0/1553342488 shutdown_connections 2023-07-21T22:38:15.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.224+0000 7fa08b4ca640 1 -- 172.21.15.6:0/1553342488 wait complete. 2023-07-21T22:38:15.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa08b4ca640 1 Processor -- start 2023-07-21T22:38:15.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa08b4ca640 1 -- start start 2023-07-21T22:38:15.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa08b4ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa08406aa80 0x7fa08415e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:15.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa08b4ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa08406d430 0x7fa0840c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa08b4ca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa08415f500 0x7fa084154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa08b4ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0840c9320 con 0x7fa08406d430 2023-07-21T22:38:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa08b4ca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0841554e0 con 0x7fa08415f500 2023-07-21T22:38:15.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa08b4ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08415cc70 con 0x7fa08406aa80 2023-07-21T22:38:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa088a65640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa08406d430 0x7fa0840c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:15.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa088a65640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa08406d430 0x7fa0840c8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51504/0 (socket says 172.21.15.6:51504) 2023-07-21T22:38:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa088a65640 1 -- 172.21.15.6:0/3941142048 learned_addr learned my addr 172.21.15.6:0/3941142048 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa089266640 1 --2- 172.21.15.6:0/3941142048 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa08406aa80 0x7fa08415e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa089a67640 1 --2- 172.21.15.6:0/3941142048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa08415f500 0x7fa084154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa088a65640 1 -- 172.21.15.6:0/3941142048 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa08406aa80 msgr2=0x7fa08415e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa088a65640 1 --2- 172.21.15.6:0/3941142048 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa08406aa80 0x7fa08415e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa088a65640 1 -- 172.21.15.6:0/3941142048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa08415f500 msgr2=0x7fa084154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:15.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa088a65640 1 --2- 172.21.15.6:0/3941142048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa08415f500 0x7fa084154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa088a65640 1 -- 172.21.15.6:0/3941142048 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa074009420 con 0x7fa08406d430 2023-07-21T22:38:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa088a65640 1 --2- 172.21.15.6:0/3941142048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa08406d430 0x7fa0840c8de0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fa07400ebe0 tx=0x7fa07400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa079ffb640 1 -- 172.21.15.6:0/3941142048 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07400eee0 con 0x7fa08406d430 2023-07-21T22:38:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa079ffb640 1 -- 172.21.15.6:0/3941142048 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07400cc30 con 0x7fa08406d430 2023-07-21T22:38:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa079ffb640 1 -- 172.21.15.6:0/3941142048 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa074013470 con 0x7fa08406d430 2023-07-21T22:38:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa08b4ca640 1 -- 172.21.15.6:0/3941142048 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa080009480 con 0x7fa08406d430 2023-07-21T22:38:15.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.228+0000 7fa08b4ca640 1 -- 172.21.15.6:0/3941142048 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0840c97e0 con 0x7fa08406d430 2023-07-21T22:38:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.232+0000 7fa08b4ca640 1 -- 172.21.15.6:0/3941142048 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0840c9a00 con 0x7fa08406d430 2023-07-21T22:38:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.232+0000 7fa079ffb640 1 -- 172.21.15.6:0/3941142048 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa0740135d0 con 0x7fa08406d430 2023-07-21T22:38:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.232+0000 7fa079ffb640 1 --2- 172.21.15.6:0/3941142048 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fa0680663d0 0x7fa068068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:15.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.232+0000 7fa079ffb640 1 -- 172.21.15.6:0/3941142048 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6142+0+0 (secure 0 0 0) 0x7fa074084110 con 0x7fa08406d430 2023-07-21T22:38:15.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.232+0000 7fa089266640 1 --2- 172.21.15.6:0/3941142048 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fa0680663d0 0x7fa068068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:15.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.232+0000 7fa089266640 1 --2- 172.21.15.6:0/3941142048 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fa0680663d0 0x7fa068068880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa0800af000 tx=0x7fa0800a7000 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:15.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.236+0000 7fa079ffb640 1 -- 172.21.15.6:0/3941142048 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa074051440 con 0x7fa08406d430 2023-07-21T22:38:15.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.448+0000 7fa08b4ca640 1 -- 172.21.15.6:0/3941142048 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7fa08406c2f0 con 0x7fa08406d430 2023-07-21T22:38:16.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.996+0000 7fa079ffb640 1 -- 172.21.15.6:0/3941142048 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v754) v1 ==== 148+0+0 (secure 0 0 0) 0x7fa074054a60 con 0x7fa08406d430 2023-07-21T22:38:16.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.996+0000 7fa08b4ca640 1 -- 172.21.15.6:0/3941142048 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fa0680663d0 msgr2=0x7fa068068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:16.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.996+0000 7fa08b4ca640 1 --2- 172.21.15.6:0/3941142048 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fa0680663d0 0x7fa068068880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa0800af000 tx=0x7fa0800a7000 comp rx=0 tx=0).stop 2023-07-21T22:38:16.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.996+0000 7fa08b4ca640 1 -- 172.21.15.6:0/3941142048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa08406d430 msgr2=0x7fa0840c8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:16.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.996+0000 7fa08b4ca640 1 --2- 172.21.15.6:0/3941142048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa08406d430 0x7fa0840c8de0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fa07400ebe0 tx=0x7fa07400c520 comp rx=0 tx=0).stop 2023-07-21T22:38:16.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.996+0000 7fa08b4ca640 1 -- 172.21.15.6:0/3941142048 shutdown_connections 2023-07-21T22:38:16.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.996+0000 7fa08b4ca640 1 --2- 172.21.15.6:0/3941142048 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fa0680663d0 0x7fa068068880 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:16.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.996+0000 7fa08b4ca640 1 --2- 172.21.15.6:0/3941142048 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa08415f500 0x7fa084154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:16.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.996+0000 7fa08b4ca640 1 --2- 172.21.15.6:0/3941142048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa08406d430 0x7fa0840c8de0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:16.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.996+0000 7fa08b4ca640 1 --2- 172.21.15.6:0/3941142048 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa08406aa80 0x7fa08415e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:16.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.996+0000 7fa08b4ca640 1 -- 172.21.15.6:0/3941142048 >> 172.21.15.6:0/3941142048 conn(0x7fa0840659d0 msgr2=0x7fa0840cf560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:16.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.996+0000 7fa08b4ca640 1 -- 172.21.15.6:0/3941142048 shutdown_connections 2023-07-21T22:38:16.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:15.996+0000 7fa08b4ca640 1 -- 172.21.15.6:0/3941142048 wait complete. 2023-07-21T22:38:16.065 INFO:tasks.cephfs_test_runner:Test existence of a scheduled snapshot ... ok 2023-07-21T22:38:16.066 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules post removal of a schedule 2023-07-21T22:38:16.066 INFO:tasks.cephfs_test_runner:test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-21T22:38:16.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-07-21T22:38:16.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.168+0000 7f8be9493640 1 Processor -- start 2023-07-21T22:38:16.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.168+0000 7f8be9493640 1 -- start start 2023-07-21T22:38:16.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.172+0000 7f8be9493640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8be40c8ad0 0x7f8be40c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:16.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.172+0000 7f8be9493640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8be40c9560 0x7f8be40ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:16.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.172+0000 7f8be9493640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be40c99c0 con 0x7f8be4158ce0 2023-07-21T22:38:16.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.172+0000 7f8be9493640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be40cc700 con 0x7f8be40c8ad0 2023-07-21T22:38:16.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.172+0000 7f8be9493640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be40b0ff0 con 0x7f8be40c9560 2023-07-21T22:38:16.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.172+0000 7f8be2ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8be4158ce0 0x7f8be4070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:42034/0 (socket says 172.21.15.6:42034) 2023-07-21T22:38:16.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.172+0000 7f8be2ffd640 1 -- 172.21.15.6:0/4144747855 learned_addr learned my addr 172.21.15.6:0/4144747855 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:16.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.172+0000 7f8bdbfff640 1 --2- 172.21.15.6:0/4144747855 >> v2:172.21.15.6:3300/0 conn(0x7f8be40c8ad0 0x7f8be40c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:16.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.172+0000 7f8be37fe640 1 --2- 172.21.15.6:0/4144747855 >> v2:172.21.15.161:3300/0 conn(0x7f8be40c9560 0x7f8be40ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:16.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.172+0000 7f8be27fc640 1 -- 172.21.15.6:0/4144747855 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232477464 0 0) 0x7f8be40c99c0 con 0x7f8be4158ce0 2023-07-21T22:38:16.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.172+0000 7f8bdbfff640 1 -- 172.21.15.6:0/4144747855 >> v2:172.21.15.161:3300/0 conn(0x7f8be40c9560 msgr2=0x7f8be40ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:16.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.172+0000 7f8bdbfff640 1 --2- 172.21.15.6:0/4144747855 >> v2:172.21.15.161:3300/0 conn(0x7f8be40c9560 0x7f8be40ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:16.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.172+0000 7f8bdbfff640 1 -- 172.21.15.6:0/4144747855 >> v1:172.21.15.6:6789/0 conn(0x7f8be4158ce0 legacy=0x7f8be4070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:16.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.172+0000 7f8bdbfff640 1 -- 172.21.15.6:0/4144747855 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be4070c80 con 0x7f8be40c8ad0 2023-07-21T22:38:16.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.176+0000 7f8bdbfff640 1 --2- 172.21.15.6:0/4144747855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be40c8ad0 0x7f8be40c9020 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f8be40b0d70 tx=0x7f8bcc01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5ceadbb30d9a1d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:16.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.176+0000 7f8be27fc640 1 -- 172.21.15.6:0/4144747855 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc0ac640 con 0x7f8be40c8ad0 2023-07-21T22:38:16.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.176+0000 7f8be27fc640 1 -- 172.21.15.6:0/4144747855 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bcc0ac7a0 con 0x7f8be40c8ad0 2023-07-21T22:38:16.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.176+0000 7f8be27fc640 1 -- 172.21.15.6:0/4144747855 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc0acb30 con 0x7f8be40c8ad0 2023-07-21T22:38:16.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.176+0000 7f8be9493640 1 -- 172.21.15.6:0/4144747855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be40c8ad0 msgr2=0x7f8be40c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:16.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.176+0000 7f8be9493640 1 --2- 172.21.15.6:0/4144747855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be40c8ad0 0x7f8be40c9020 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f8be40b0d70 tx=0x7f8bcc01c310 comp rx=0 tx=0).stop 2023-07-21T22:38:16.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.176+0000 7f8be9493640 1 -- 172.21.15.6:0/4144747855 shutdown_connections 2023-07-21T22:38:16.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.176+0000 7f8be9493640 1 --2- 172.21.15.6:0/4144747855 >> v2:172.21.15.161:3300/0 conn(0x7f8be40c9560 0x7f8be40ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:16.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.176+0000 7f8be9493640 1 --2- 172.21.15.6:0/4144747855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be40c8ad0 0x7f8be40c9020 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:16.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.176+0000 7f8be9493640 1 -- 172.21.15.6:0/4144747855 >> 172.21.15.6:0/4144747855 conn(0x7f8be40afcf0 msgr2=0x7f8be40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:16.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.176+0000 7f8be9493640 1 -- 172.21.15.6:0/4144747855 shutdown_connections 2023-07-21T22:38:16.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.176+0000 7f8be9493640 1 -- 172.21.15.6:0/4144747855 wait complete. 2023-07-21T22:38:16.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.176+0000 7f8be9493640 1 Processor -- start 2023-07-21T22:38:16.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.176+0000 7f8be9493640 1 -- start start 2023-07-21T22:38:16.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8be9493640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8be40c8ad0 0x7f8be4151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:16.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8be9493640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8be40c9560 0x7f8be414d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:16.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8be9493640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be4158ce0 0x7f8be40ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:16.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8be9493640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be415bde0 con 0x7f8be4158ce0 2023-07-21T22:38:16.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8be9493640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be4152500 con 0x7f8be40c8ad0 2023-07-21T22:38:16.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8be9493640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be414eab0 con 0x7f8be40c9560 2023-07-21T22:38:16.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8be37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be4158ce0 0x7f8be40ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:16.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8be37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be4158ce0 0x7f8be40ade50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51522/0 (socket says 172.21.15.6:51522) 2023-07-21T22:38:16.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8be37fe640 1 -- 172.21.15.6:0/798920988 learned_addr learned my addr 172.21.15.6:0/798920988 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:16.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8bdbfff640 1 --2- 172.21.15.6:0/798920988 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8be40c9560 0x7f8be414d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:16.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8be2ffd640 1 --2- 172.21.15.6:0/798920988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8be40c8ad0 0x7f8be4151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:16.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8be37fe640 1 -- 172.21.15.6:0/798920988 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8be40c9560 msgr2=0x7f8be414d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:16.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8be37fe640 1 --2- 172.21.15.6:0/798920988 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8be40c9560 0x7f8be414d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:16.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8be37fe640 1 -- 172.21.15.6:0/798920988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8be40c8ad0 msgr2=0x7f8be4151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:16.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8be37fe640 1 --2- 172.21.15.6:0/798920988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8be40c8ad0 0x7f8be4151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:16.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8be37fe640 1 -- 172.21.15.6:0/798920988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc009420 con 0x7f8be4158ce0 2023-07-21T22:38:16.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8be37fe640 1 --2- 172.21.15.6:0/798920988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be4158ce0 0x7f8be40ade50 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00efc0 tx=0x7f8bdc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:16.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8bdb7fe640 1 -- 172.21.15.6:0/798920988 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc014480 con 0x7f8be4158ce0 2023-07-21T22:38:16.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8bdb7fe640 1 -- 172.21.15.6:0/798920988 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc00f040 con 0x7f8be4158ce0 2023-07-21T22:38:16.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8be9493640 1 -- 172.21.15.6:0/798920988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be415b020 con 0x7f8be4158ce0 2023-07-21T22:38:16.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8bdb7fe640 1 -- 172.21.15.6:0/798920988 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc014820 con 0x7f8be4158ce0 2023-07-21T22:38:16.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8be9493640 1 -- 172.21.15.6:0/798920988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be415b5e0 con 0x7f8be4158ce0 2023-07-21T22:38:16.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8be9493640 1 -- 172.21.15.6:0/798920988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be40ca1a0 con 0x7f8be4158ce0 2023-07-21T22:38:16.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.180+0000 7f8bdb7fe640 1 -- 172.21.15.6:0/798920988 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8bdc014980 con 0x7f8be4158ce0 2023-07-21T22:38:16.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.184+0000 7f8bdb7fe640 1 --2- 172.21.15.6:0/798920988 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f8bc40663a0 0x7f8bc4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:16.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.184+0000 7f8bdb7fe640 1 -- 172.21.15.6:0/798920988 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6142+0+0 (secure 0 0 0) 0x7f8bdc084ac0 con 0x7f8be4158ce0 2023-07-21T22:38:16.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.184+0000 7f8be2ffd640 1 --2- 172.21.15.6:0/798920988 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f8bc40663a0 0x7f8bc4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:16.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.184+0000 7f8be2ffd640 1 --2- 172.21.15.6:0/798920988 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f8bc40663a0 0x7f8bc4068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4000f70 tx=0x7f8bd4007df0 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:16.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.188+0000 7f8bdb7fe640 1 -- 172.21.15.6:0/798920988 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8bdc051ce0 con 0x7f8be4158ce0 2023-07-21T22:38:16.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.396+0000 7f8be9493640 1 -- 172.21.15.6:0/798920988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f8be40678d0 con 0x7f8be4158ce0 2023-07-21T22:38:17.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:16.996+0000 7f8bdb7fe640 1 -- 172.21.15.6:0/798920988 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v755) v1 ==== 177+0+0 (secure 0 0 0) 0x7f8bdc055300 con 0x7f8be4158ce0 2023-07-21T22:38:17.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.000+0000 7f8be9493640 1 -- 172.21.15.6:0/798920988 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f8bc40663a0 msgr2=0x7f8bc4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:17.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.000+0000 7f8be9493640 1 --2- 172.21.15.6:0/798920988 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f8bc40663a0 0x7f8bc4068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4000f70 tx=0x7f8bd4007df0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.000+0000 7f8be9493640 1 -- 172.21.15.6:0/798920988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be4158ce0 msgr2=0x7f8be40ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:17.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.000+0000 7f8be9493640 1 --2- 172.21.15.6:0/798920988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be4158ce0 0x7f8be40ade50 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00efc0 tx=0x7f8bdc00c490 comp rx=0 tx=0).stop 2023-07-21T22:38:17.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.000+0000 7f8be9493640 1 -- 172.21.15.6:0/798920988 shutdown_connections 2023-07-21T22:38:17.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.000+0000 7f8be9493640 1 --2- 172.21.15.6:0/798920988 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f8bc40663a0 0x7f8bc4068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.000+0000 7f8be9493640 1 --2- 172.21.15.6:0/798920988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8be4158ce0 0x7f8be40ade50 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.000+0000 7f8be9493640 1 --2- 172.21.15.6:0/798920988 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8be40c9560 0x7f8be414d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.000+0000 7f8be9493640 1 --2- 172.21.15.6:0/798920988 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8be40c8ad0 0x7f8be4151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.000+0000 7f8be9493640 1 -- 172.21.15.6:0/798920988 >> 172.21.15.6:0/798920988 conn(0x7f8be40afcf0 msgr2=0x7f8be4152780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:17.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.000+0000 7f8be9493640 1 -- 172.21.15.6:0/798920988 shutdown_connections 2023-07-21T22:38:17.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.000+0000 7f8be9493640 1 -- 172.21.15.6:0/798920988 wait complete. 2023-07-21T22:38:17.068 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-21T22:38:17.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.176+0000 7fe63fc7b640 1 Processor -- start 2023-07-21T22:38:17.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.176+0000 7fe63fc7b640 1 -- start start 2023-07-21T22:38:17.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.176+0000 7fe63fc7b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe6380c3ac0 0x7fe6380c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:17.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.176+0000 7fe63fc7b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe6380af2b0 0x7fe6380ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:17.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.176+0000 7fe63fc7b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6380cd120 0x7fe6380cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:17.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.176+0000 7fe63fc7b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6380ca540 con 0x7fe6380af2b0 2023-07-21T22:38:17.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.176+0000 7fe63fc7b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6380695b0 con 0x7fe6380c3ac0 2023-07-21T22:38:17.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.176+0000 7fe63fc7b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe638069890 con 0x7fe6380cd120 2023-07-21T22:38:17.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.176+0000 7fe63d216640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe6380af2b0 0x7fe6380ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:17.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.176+0000 7fe63d216640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe6380af2b0 0x7fe6380ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51530/0 (socket says 172.21.15.6:51530) 2023-07-21T22:38:17.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.176+0000 7fe63d216640 1 -- 172.21.15.6:0/1592487418 learned_addr learned my addr 172.21.15.6:0/1592487418 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:17.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.176+0000 7fe63da17640 1 --2- 172.21.15.6:0/1592487418 >> v2:172.21.15.161:3300/0 conn(0x7fe6380c3ac0 0x7fe6380c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.176+0000 7fe63e218640 1 --2- 172.21.15.6:0/1592487418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6380cd120 0x7fe6380cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.176+0000 7fe63d216640 1 -- 172.21.15.6:0/1592487418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6380cd120 msgr2=0x7fe6380cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.176+0000 7fe63d216640 1 --2- 172.21.15.6:0/1592487418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6380cd120 0x7fe6380cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.176+0000 7fe63d216640 1 -- 172.21.15.6:0/1592487418 >> v2:172.21.15.161:3300/0 conn(0x7fe6380c3ac0 msgr2=0x7fe6380c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.176+0000 7fe63d216640 1 --2- 172.21.15.6:0/1592487418 >> v2:172.21.15.161:3300/0 conn(0x7fe6380c3ac0 0x7fe6380c2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.176+0000 7fe63d216640 1 -- 172.21.15.6:0/1592487418 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe638069b70 con 0x7fe6380af2b0 2023-07-21T22:38:17.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.176+0000 7fe63e218640 1 --2- 172.21.15.6:0/1592487418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6380cd120 0x7fe6380cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:17.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.180+0000 7fe63d216640 1 --2- 172.21.15.6:0/1592487418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6380af2b0 0x7fe6380ca000 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fe6380cef90 tx=0x7fe62801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b18ba1edca0bdb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:17.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.180+0000 7fe63ca15640 1 -- 172.21.15.6:0/1592487418 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6280ab610 con 0x7fe6380af2b0 2023-07-21T22:38:17.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.180+0000 7fe63ca15640 1 -- 172.21.15.6:0/1592487418 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6280ab770 con 0x7fe6380af2b0 2023-07-21T22:38:17.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.180+0000 7fe63ca15640 1 -- 172.21.15.6:0/1592487418 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6280abb00 con 0x7fe6380af2b0 2023-07-21T22:38:17.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.180+0000 7fe63fc7b640 1 -- 172.21.15.6:0/1592487418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6380af2b0 msgr2=0x7fe6380ca000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:17.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.180+0000 7fe63fc7b640 1 --2- 172.21.15.6:0/1592487418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6380af2b0 0x7fe6380ca000 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fe6380cef90 tx=0x7fe62801c500 comp rx=0 tx=0).stop 2023-07-21T22:38:17.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.180+0000 7fe63fc7b640 1 -- 172.21.15.6:0/1592487418 shutdown_connections 2023-07-21T22:38:17.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.180+0000 7fe63fc7b640 1 --2- 172.21.15.6:0/1592487418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6380cd120 0x7fe6380cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.180+0000 7fe63fc7b640 1 --2- 172.21.15.6:0/1592487418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6380af2b0 0x7fe6380ca000 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.180+0000 7fe63fc7b640 1 --2- 172.21.15.6:0/1592487418 >> v2:172.21.15.161:3300/0 conn(0x7fe6380c3ac0 0x7fe6380c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.180+0000 7fe63fc7b640 1 -- 172.21.15.6:0/1592487418 >> 172.21.15.6:0/1592487418 conn(0x7fe6380cde90 msgr2=0x7fe6380ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:17.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.180+0000 7fe63fc7b640 1 -- 172.21.15.6:0/1592487418 shutdown_connections 2023-07-21T22:38:17.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.180+0000 7fe63fc7b640 1 -- 172.21.15.6:0/1592487418 wait complete. 2023-07-21T22:38:17.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63fc7b640 1 Processor -- start 2023-07-21T22:38:17.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63fc7b640 1 -- start start 2023-07-21T22:38:17.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63fc7b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6380af2b0 0x7fe6380b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:17.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63fc7b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6380c3ac0 0x7fe63813cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:17.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63fc7b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6380cd120 0x7fe6380b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:17.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63fc7b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63814f520 con 0x7fe6380af2b0 2023-07-21T22:38:17.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63fc7b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6380b32d0 con 0x7fe6380c3ac0 2023-07-21T22:38:17.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63fc7b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63814e910 con 0x7fe6380cd120 2023-07-21T22:38:17.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63da17640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6380af2b0 0x7fe6380b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:17.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63da17640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6380af2b0 0x7fe6380b36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51546/0 (socket says 172.21.15.6:51546) 2023-07-21T22:38:17.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63da17640 1 -- 172.21.15.6:0/505403250 learned_addr learned my addr 172.21.15.6:0/505403250 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:17.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63d216640 1 --2- 172.21.15.6:0/505403250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6380c3ac0 0x7fe63813cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:17.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63e218640 1 --2- 172.21.15.6:0/505403250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6380cd120 0x7fe6380b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:17.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63da17640 1 -- 172.21.15.6:0/505403250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6380cd120 msgr2=0x7fe6380b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:17.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63da17640 1 --2- 172.21.15.6:0/505403250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6380cd120 0x7fe6380b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63da17640 1 -- 172.21.15.6:0/505403250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6380c3ac0 msgr2=0x7fe63813cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:17.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63da17640 1 --2- 172.21.15.6:0/505403250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6380c3ac0 0x7fe63813cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63da17640 1 -- 172.21.15.6:0/505403250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6280094d0 con 0x7fe6380af2b0 2023-07-21T22:38:17.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63e218640 1 --2- 172.21.15.6:0/505403250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6380cd120 0x7fe6380b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:17.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63da17640 1 --2- 172.21.15.6:0/505403250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6380af2b0 0x7fe6380b36e0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fe63400d800 tx=0x7fe63400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:17.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe62e7fc640 1 -- 172.21.15.6:0/505403250 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6340096a0 con 0x7fe6380af2b0 2023-07-21T22:38:17.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe62e7fc640 1 -- 172.21.15.6:0/505403250 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe634009800 con 0x7fe6380af2b0 2023-07-21T22:38:17.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe62e7fc640 1 -- 172.21.15.6:0/505403250 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634009b70 con 0x7fe6380af2b0 2023-07-21T22:38:17.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63fc7b640 1 -- 172.21.15.6:0/505403250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63814ebf0 con 0x7fe6380af2b0 2023-07-21T22:38:17.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63fc7b640 1 -- 172.21.15.6:0/505403250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63814f1b0 con 0x7fe6380af2b0 2023-07-21T22:38:17.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.184+0000 7fe63fc7b640 1 -- 172.21.15.6:0/505403250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6380678d0 con 0x7fe6380af2b0 2023-07-21T22:38:17.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.188+0000 7fe62e7fc640 1 -- 172.21.15.6:0/505403250 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe634009cd0 con 0x7fe6380af2b0 2023-07-21T22:38:17.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.188+0000 7fe62e7fc640 1 --2- 172.21.15.6:0/505403250 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fe61c0663d0 0x7fe61c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:17.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.188+0000 7fe62e7fc640 1 -- 172.21.15.6:0/505403250 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6142+0+0 (secure 0 0 0) 0x7fe634084620 con 0x7fe6380af2b0 2023-07-21T22:38:17.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.188+0000 7fe63d216640 1 --2- 172.21.15.6:0/505403250 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fe61c0663d0 0x7fe61c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:17.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.188+0000 7fe63d216640 1 --2- 172.21.15.6:0/505403250 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fe61c0663d0 0x7fe61c068880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe6280af000 tx=0x7fe6280b6040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:17.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.192+0000 7fe62e7fc640 1 -- 172.21.15.6:0/505403250 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe6340518b0 con 0x7fe6380af2b0 2023-07-21T22:38:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.344+0000 7fe63fc7b640 1 -- 172.21.15.6:0/505403250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe6380aeb80 con 0x7fe6380af2b0 2023-07-21T22:38:17.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.352+0000 7fe62e7fc640 1 -- 172.21.15.6:0/505403250 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe634054ed0 con 0x7fe6380af2b0 2023-07-21T22:38:17.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.352+0000 7fe63fc7b640 1 -- 172.21.15.6:0/505403250 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fe61c0663d0 msgr2=0x7fe61c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.352+0000 7fe63fc7b640 1 --2- 172.21.15.6:0/505403250 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fe61c0663d0 0x7fe61c068880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe6280af000 tx=0x7fe6280b6040 comp rx=0 tx=0).stop 2023-07-21T22:38:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.352+0000 7fe63fc7b640 1 -- 172.21.15.6:0/505403250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6380af2b0 msgr2=0x7fe6380b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.352+0000 7fe63fc7b640 1 --2- 172.21.15.6:0/505403250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6380af2b0 0x7fe6380b36e0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fe63400d800 tx=0x7fe63400dcc0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.352+0000 7fe63fc7b640 1 -- 172.21.15.6:0/505403250 shutdown_connections 2023-07-21T22:38:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.352+0000 7fe63fc7b640 1 --2- 172.21.15.6:0/505403250 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fe61c0663d0 0x7fe61c068880 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.352+0000 7fe63fc7b640 1 --2- 172.21.15.6:0/505403250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6380cd120 0x7fe6380b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.352+0000 7fe63fc7b640 1 --2- 172.21.15.6:0/505403250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6380c3ac0 0x7fe63813cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.352+0000 7fe63fc7b640 1 --2- 172.21.15.6:0/505403250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6380af2b0 0x7fe6380b36e0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.352+0000 7fe63fc7b640 1 -- 172.21.15.6:0/505403250 >> 172.21.15.6:0/505403250 conn(0x7fe6380cde90 msgr2=0x7fe63806f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.352+0000 7fe63fc7b640 1 -- 172.21.15.6:0/505403250 shutdown_connections 2023-07-21T22:38:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.352+0000 7fe63fc7b640 1 -- 172.21.15.6:0/505403250 wait complete. 2023-07-21T22:38:17.418 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:38:17.418 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:38:17.486 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:38:17.556 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:38:17.556 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:38:17.556 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:38:17.565 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:38:17.566 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:38:17.566 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:38:17.576 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:38:17.576 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:38:17.576 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:38:17.615 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:38:17.616 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:38:17.616 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:38:17.625 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:38:17.626 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-21T22:38:17.626 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:38:17.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.756+0000 7fc937aca640 1 Processor -- start 2023-07-21T22:38:17.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.756+0000 7fc937aca640 1 -- start start 2023-07-21T22:38:17.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.760+0000 7fc937aca640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc930158ce0 0x7fc930070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:17.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.760+0000 7fc937aca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc9300c8ad0 0x7fc9300c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:17.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.760+0000 7fc937aca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9300c9560 0x7fc9300cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:17.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.760+0000 7fc937aca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9300c99e0 con 0x7fc9300c8ad0 2023-07-21T22:38:17.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.760+0000 7fc937aca640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9300cc700 con 0x7fc930158ce0 2023-07-21T22:38:17.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.760+0000 7fc937aca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9300b0ff0 con 0x7fc9300c9560 2023-07-21T22:38:17.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.760+0000 7fc935065640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc9300c8ad0 0x7fc9300c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:17.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.760+0000 7fc935065640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc9300c8ad0 0x7fc9300c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51594/0 (socket says 172.21.15.6:51594) 2023-07-21T22:38:17.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.760+0000 7fc935065640 1 -- 172.21.15.6:0/3443769500 learned_addr learned my addr 172.21.15.6:0/3443769500 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:17.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.760+0000 7fc935065640 1 -- 172.21.15.6:0/3443769500 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9300c9560 msgr2=0x7fc9300cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:17.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.760+0000 7fc935065640 1 --2- 172.21.15.6:0/3443769500 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9300c9560 0x7fc9300cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.760+0000 7fc935065640 1 -- 172.21.15.6:0/3443769500 >> v2:172.21.15.161:3300/0 conn(0x7fc930158ce0 msgr2=0x7fc930070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:17.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.760+0000 7fc935065640 1 --2- 172.21.15.6:0/3443769500 >> v2:172.21.15.161:3300/0 conn(0x7fc930158ce0 0x7fc930070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.760+0000 7fc935065640 1 -- 172.21.15.6:0/3443769500 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc930070c80 con 0x7fc9300c8ad0 2023-07-21T22:38:17.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.764+0000 7fc935065640 1 --2- 172.21.15.6:0/3443769500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300c8ad0 0x7fc9300c9020 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fc930071be0 tx=0x7fc92001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6eee98e82cb3c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:17.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.764+0000 7fc934864640 1 -- 172.21.15.6:0/3443769500 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9200ab600 con 0x7fc9300c8ad0 2023-07-21T22:38:17.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.764+0000 7fc934864640 1 -- 172.21.15.6:0/3443769500 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9200a7050 con 0x7fc9300c8ad0 2023-07-21T22:38:17.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.764+0000 7fc934864640 1 -- 172.21.15.6:0/3443769500 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9200ab980 con 0x7fc9300c8ad0 2023-07-21T22:38:17.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.764+0000 7fc937aca640 1 -- 172.21.15.6:0/3443769500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300c8ad0 msgr2=0x7fc9300c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:17.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.764+0000 7fc937aca640 1 --2- 172.21.15.6:0/3443769500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300c8ad0 0x7fc9300c9020 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7fc930071be0 tx=0x7fc92001c3b0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.764+0000 7fc937aca640 1 -- 172.21.15.6:0/3443769500 shutdown_connections 2023-07-21T22:38:17.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.764+0000 7fc937aca640 1 --2- 172.21.15.6:0/3443769500 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9300c9560 0x7fc9300cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.764+0000 7fc937aca640 1 --2- 172.21.15.6:0/3443769500 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300c8ad0 0x7fc9300c9020 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.764+0000 7fc937aca640 1 --2- 172.21.15.6:0/3443769500 >> v2:172.21.15.161:3300/0 conn(0x7fc930158ce0 0x7fc930070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.764+0000 7fc937aca640 1 -- 172.21.15.6:0/3443769500 >> 172.21.15.6:0/3443769500 conn(0x7fc9300afcf0 msgr2=0x7fc9300b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.764+0000 7fc937aca640 1 -- 172.21.15.6:0/3443769500 shutdown_connections 2023-07-21T22:38:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.764+0000 7fc937aca640 1 -- 172.21.15.6:0/3443769500 wait complete. 2023-07-21T22:38:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.764+0000 7fc937aca640 1 Processor -- start 2023-07-21T22:38:17.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.764+0000 7fc937aca640 1 -- start start 2023-07-21T22:38:17.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc937aca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300c8ad0 0x7fc9300c2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:17.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc937aca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9300c9560 0x7fc9300c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:17.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc937aca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc930158ce0 0x7fc930157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:17.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc937aca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9300c3dc0 con 0x7fc9300c8ad0 2023-07-21T22:38:17.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc937aca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9300c4be0 con 0x7fc930158ce0 2023-07-21T22:38:17.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc937aca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9300c4060 con 0x7fc9300c9560 2023-07-21T22:38:17.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc935866640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300c8ad0 0x7fc9300c2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:17.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc935866640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300c8ad0 0x7fc9300c2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51606/0 (socket says 172.21.15.6:51606) 2023-07-21T22:38:17.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc936067640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc930158ce0 0x7fc930157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:17.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc935065640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9300c9560 0x7fc9300c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:17.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc935866640 1 -- 172.21.15.6:0/598822917 learned_addr learned my addr 172.21.15.6:0/598822917 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:17.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc935866640 1 -- 172.21.15.6:0/598822917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9300c9560 msgr2=0x7fc9300c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:17.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc935866640 1 --2- 172.21.15.6:0/598822917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9300c9560 0x7fc9300c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc935866640 1 -- 172.21.15.6:0/598822917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc930158ce0 msgr2=0x7fc930157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:17.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc935866640 1 --2- 172.21.15.6:0/598822917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc930158ce0 0x7fc930157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:17.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc935866640 1 -- 172.21.15.6:0/598822917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9200094d0 con 0x7fc9300c8ad0 2023-07-21T22:38:17.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc935866640 1 --2- 172.21.15.6:0/598822917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300c8ad0 0x7fc9300c2b60 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00b550 tx=0x7fc92c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:17.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc9267fc640 1 -- 172.21.15.6:0/598822917 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c010870 con 0x7fc9300c8ad0 2023-07-21T22:38:17.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc9267fc640 1 -- 172.21.15.6:0/598822917 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c0109f0 con 0x7fc9300c8ad0 2023-07-21T22:38:17.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc9267fc640 1 -- 172.21.15.6:0/598822917 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c010da0 con 0x7fc9300c8ad0 2023-07-21T22:38:17.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc937aca640 1 -- 172.21.15.6:0/598822917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9300c4340 con 0x7fc9300c8ad0 2023-07-21T22:38:17.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc937aca640 1 -- 172.21.15.6:0/598822917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9300c4900 con 0x7fc9300c8ad0 2023-07-21T22:38:17.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc937aca640 1 -- 172.21.15.6:0/598822917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9300ca1a0 con 0x7fc9300c8ad0 2023-07-21T22:38:17.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.768+0000 7fc9267fc640 1 -- 172.21.15.6:0/598822917 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc92c00f3c0 con 0x7fc9300c8ad0 2023-07-21T22:38:17.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.772+0000 7fc9267fc640 1 --2- 172.21.15.6:0/598822917 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fc9140663a0 0x7fc914068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:17.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.772+0000 7fc9267fc640 1 -- 172.21.15.6:0/598822917 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6142+0+0 (secure 0 0 0) 0x7fc92c083e30 con 0x7fc9300c8ad0 2023-07-21T22:38:17.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.772+0000 7fc935065640 1 --2- 172.21.15.6:0/598822917 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fc9140663a0 0x7fc914068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:17.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.772+0000 7fc935065640 1 --2- 172.21.15.6:0/598822917 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fc9140663a0 0x7fc914068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc9200ad000 tx=0x7fc920008040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:17.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.776+0000 7fc9267fc640 1 -- 172.21.15.6:0/598822917 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc92c0511f0 con 0x7fc9300c8ad0 2023-07-21T22:38:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.964+0000 7fc937aca640 1 -- 172.21.15.6:0/598822917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9301593d0 con 0x7fc9300c8ad0 2023-07-21T22:38:18.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.968+0000 7fc9267fc640 1 -- 172.21.15.6:0/598822917 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fc92c01ede0 con 0x7fc9300c8ad0 2023-07-21T22:38:18.012 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:18.012 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":56,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7103,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1099541342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1099541342},{"type":"v1","addr":"172.21.15.161:6837","nonce":1099541342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":7960,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3942495258","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3942495258},{"type":"v1","addr":"172.21.15.161:6836","nonce":3942495258}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8211,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/3306024838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3306024838},{"type":"v1","addr":"172.21.15.6:6834","nonce":3306024838}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":8374,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/4068055509","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":4068055509},{"type":"v1","addr":"172.21.15.6:6835","nonce":4068055509}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":56}],"filesystems":[]} 2023-07-21T22:38:18.013 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 56 2023-07-21T22:38:18.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.968+0000 7fc937aca640 1 -- 172.21.15.6:0/598822917 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fc9140663a0 msgr2=0x7fc914068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:18.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.968+0000 7fc937aca640 1 --2- 172.21.15.6:0/598822917 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fc9140663a0 0x7fc914068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc9200ad000 tx=0x7fc920008040 comp rx=0 tx=0).stop 2023-07-21T22:38:18.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.968+0000 7fc937aca640 1 -- 172.21.15.6:0/598822917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300c8ad0 msgr2=0x7fc9300c2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:18.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.968+0000 7fc937aca640 1 --2- 172.21.15.6:0/598822917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300c8ad0 0x7fc9300c2b60 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00b550 tx=0x7fc92c00ba10 comp rx=0 tx=0).stop 2023-07-21T22:38:18.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.968+0000 7fc937aca640 1 -- 172.21.15.6:0/598822917 shutdown_connections 2023-07-21T22:38:18.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.968+0000 7fc937aca640 1 --2- 172.21.15.6:0/598822917 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fc9140663a0 0x7fc914068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:18.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.968+0000 7fc937aca640 1 --2- 172.21.15.6:0/598822917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc930158ce0 0x7fc930157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:18.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.968+0000 7fc937aca640 1 --2- 172.21.15.6:0/598822917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc9300c9560 0x7fc9300c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:18.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.968+0000 7fc937aca640 1 --2- 172.21.15.6:0/598822917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9300c8ad0 0x7fc9300c2b60 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:18.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.968+0000 7fc937aca640 1 -- 172.21.15.6:0/598822917 >> 172.21.15.6:0/598822917 conn(0x7fc9300afcf0 msgr2=0x7fc9300ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:18.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.968+0000 7fc937aca640 1 -- 172.21.15.6:0/598822917 shutdown_connections 2023-07-21T22:38:18.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:17.968+0000 7fc937aca640 1 -- 172.21.15.6:0/598822917 wait complete. 2023-07-21T22:38:18.034 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-21T22:38:18.034 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-21T22:38:18.035 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-21T22:38:18.035 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:38:18.035 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-21T22:38:18.035 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-21T22:38:18.036 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-21T22:38:18.036 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:38:18.036 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-21T22:38:18.036 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-21T22:38:18.036 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-21T22:38:18.037 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:38:18.037 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-21T22:38:18.037 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-21T22:38:18.037 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-21T22:38:18.037 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:38:18.047 INFO:tasks.ceph.mds.a:Stopped 2023-07-21T22:38:18.048 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-21T22:38:18.048 INFO:tasks.ceph.mds.c:Stopped 2023-07-21T22:38:18.049 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-21T22:38:18.051 INFO:tasks.ceph.mds.d:Stopped 2023-07-21T22:38:18.052 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-21T22:38:18.053 INFO:tasks.ceph.mds.b:Stopped 2023-07-21T22:38:18.053 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-21T22:38:18.098 INFO:tasks.ceph.mds.a:Started 2023-07-21T22:38:18.099 DEBUG:teuthology.parallel:result is None 2023-07-21T22:38:18.099 INFO:tasks.ceph.mds.d:Started 2023-07-21T22:38:18.100 DEBUG:teuthology.parallel:result is None 2023-07-21T22:38:18.101 INFO:tasks.ceph.mds.c:Started 2023-07-21T22:38:18.101 DEBUG:teuthology.parallel:result is None 2023-07-21T22:38:18.102 INFO:tasks.ceph.mds.b:Started 2023-07-21T22:38:18.103 DEBUG:teuthology.parallel:result is None 2023-07-21T22:38:18.103 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-21T22:38:18.187 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-07-21T22:38:18.188 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2023-07-21T22:38:18.189 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-07-21T22:38:18.189 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-21T22:38:18.190 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-07-21T22:38:18.144+0000 7f0ffc402640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-07-21T22:38:18.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.204+0000 7fecfa712640 1 Processor -- start 2023-07-21T22:38:18.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.204+0000 7fecfa712640 1 -- start start 2023-07-21T22:38:18.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.208+0000 7fecfa712640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fecf40d13f0 0x7fecf40cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:18.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.208+0000 7fecfa712640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf40d0f60 con 0x7fecf40b7d90 2023-07-21T22:38:18.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.208+0000 7fecfa712640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf40d0390 con 0x7fecf415f3f0 2023-07-21T22:38:18.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.208+0000 7fecfa712640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf40d0630 con 0x7fecf40d13f0 2023-07-21T22:38:18.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.208+0000 7fecf9f11640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fecf40d13f0 0x7fecf40cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:18.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.208+0000 7fecf9f11640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fecf40d13f0 0x7fecf40cd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51626/0 (socket says 172.21.15.6:51626) 2023-07-21T22:38:18.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.208+0000 7fecf9f11640 1 -- 172.21.15.6:0/1316297851 learned_addr learned my addr 172.21.15.6:0/1316297851 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:18.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.208+0000 7fecf8f0f640 1 --1- 172.21.15.6:0/1316297851 >> v1:172.21.15.6:6789/0 conn(0x7fecf40b7d90 0x7fecf40cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47582/0 (socket says 172.21.15.6:47582) 2023-07-21T22:38:18.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.208+0000 7fecf9f11640 1 -- 172.21.15.6:0/1316297851 >> v1:172.21.15.161:6789/0 conn(0x7fecf415f3f0 legacy=0x7fecf40b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:18.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.208+0000 7fecf9f11640 1 -- 172.21.15.6:0/1316297851 >> v1:172.21.15.6:6789/0 conn(0x7fecf40b7d90 legacy=0x7fecf40cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:18.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.208+0000 7fecf9f11640 1 -- 172.21.15.6:0/1316297851 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf40d0910 con 0x7fecf40d13f0 2023-07-21T22:38:18.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.208+0000 7fecebfff640 1 -- 172.21.15.6:0/1316297851 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737559631 0 0) 0x7fecf40d0f60 con 0x7fecf40b7d90 2023-07-21T22:38:18.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.212+0000 7fecf9f11640 1 --2- 172.21.15.6:0/1316297851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf40d13f0 0x7fecf40cd0b0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fecec009e50 tx=0x7fecec01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d227d48da14b4175 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:18.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.212+0000 7fecebfff640 1 -- 172.21.15.6:0/1316297851 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec0a56c0 con 0x7fecf40d13f0 2023-07-21T22:38:18.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.212+0000 7fecebfff640 1 -- 172.21.15.6:0/1316297851 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec0a5820 con 0x7fecf40d13f0 2023-07-21T22:38:18.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.212+0000 7fecebfff640 1 -- 172.21.15.6:0/1316297851 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec0a5bb0 con 0x7fecf40d13f0 2023-07-21T22:38:18.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.212+0000 7fecfa712640 1 -- 172.21.15.6:0/1316297851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf40d13f0 msgr2=0x7fecf40cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:18.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.212+0000 7fecfa712640 1 --2- 172.21.15.6:0/1316297851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf40d13f0 0x7fecf40cd0b0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fecec009e50 tx=0x7fecec01c980 comp rx=0 tx=0).stop 2023-07-21T22:38:18.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.212+0000 7fecfa712640 1 -- 172.21.15.6:0/1316297851 shutdown_connections 2023-07-21T22:38:18.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.212+0000 7fecfa712640 1 --2- 172.21.15.6:0/1316297851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf40d13f0 0x7fecf40cd0b0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:18.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.212+0000 7fecfa712640 1 -- 172.21.15.6:0/1316297851 >> 172.21.15.6:0/1316297851 conn(0x7fecf4069f50 msgr2=0x7fecf406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:18.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.212+0000 7fecfa712640 1 -- 172.21.15.6:0/1316297851 shutdown_connections 2023-07-21T22:38:18.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.212+0000 7fecfa712640 1 -- 172.21.15.6:0/1316297851 wait complete. 2023-07-21T22:38:18.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.212+0000 7fecfa712640 1 Processor -- start 2023-07-21T22:38:18.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.212+0000 7fecfa712640 1 -- start start 2023-07-21T22:38:18.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fecfa712640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecf40b7d90 0x7fecf4153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:18.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fecfa712640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf40d13f0 0x7fecf40cb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:18.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fecfa712640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecf415f3f0 0x7fecf41532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:18.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fecfa712640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf40cbb80 con 0x7fecf40d13f0 2023-07-21T22:38:18.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fecfa712640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf40cb8a0 con 0x7fecf40b7d90 2023-07-21T22:38:18.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fecfa712640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf40b1ba0 con 0x7fecf415f3f0 2023-07-21T22:38:18.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fecf8f0f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf40d13f0 0x7fecf40cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:18.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fecf8f0f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf40d13f0 0x7fecf40cb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51642/0 (socket says 172.21.15.6:51642) 2023-07-21T22:38:18.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fecf8f0f640 1 -- 172.21.15.6:0/1497518928 learned_addr learned my addr 172.21.15.6:0/1497518928 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:18.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fecf9710640 1 --2- 172.21.15.6:0/1497518928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecf40b7d90 0x7fecf4153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:18.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fecf9f11640 1 --2- 172.21.15.6:0/1497518928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecf415f3f0 0x7fecf41532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:18.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fecf8f0f640 1 -- 172.21.15.6:0/1497518928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecf415f3f0 msgr2=0x7fecf41532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:18.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fecf8f0f640 1 --2- 172.21.15.6:0/1497518928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecf415f3f0 0x7fecf41532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:18.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fecf8f0f640 1 -- 172.21.15.6:0/1497518928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecf40b7d90 msgr2=0x7fecf4153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:18.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fecf8f0f640 1 --2- 172.21.15.6:0/1497518928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecf40b7d90 0x7fecf4153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:18.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fecf8f0f640 1 -- 172.21.15.6:0/1497518928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec009b30 con 0x7fecf40d13f0 2023-07-21T22:38:18.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fecf8f0f640 1 --2- 172.21.15.6:0/1497518928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf40d13f0 0x7fecf40cb050 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fece400c480 tx=0x7fece400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:18.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fece9ffb640 1 -- 172.21.15.6:0/1497518928 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece40074e0 con 0x7fecf40d13f0 2023-07-21T22:38:18.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fece9ffb640 1 -- 172.21.15.6:0/1497518928 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece4007640 con 0x7fecf40d13f0 2023-07-21T22:38:18.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fece9ffb640 1 -- 172.21.15.6:0/1497518928 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece4004a10 con 0x7fecf40d13f0 2023-07-21T22:38:18.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fecfa712640 1 -- 172.21.15.6:0/1497518928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf40b1e80 con 0x7fecf40d13f0 2023-07-21T22:38:18.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fecfa712640 1 -- 172.21.15.6:0/1497518928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf40cb590 con 0x7fecf40d13f0 2023-07-21T22:38:18.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fecfa712640 1 -- 172.21.15.6:0/1497518928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf40b1a00 con 0x7fecf40d13f0 2023-07-21T22:38:18.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.216+0000 7fece9ffb640 1 -- 172.21.15.6:0/1497518928 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fece4004b70 con 0x7fecf40d13f0 2023-07-21T22:38:18.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.220+0000 7fece9ffb640 1 --2- 172.21.15.6:0/1497518928 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fecd80663a0 0x7fecd8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:18.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.220+0000 7fece9ffb640 1 -- 172.21.15.6:0/1497518928 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6142+0+0 (secure 0 0 0) 0x7fece4083100 con 0x7fecf40d13f0 2023-07-21T22:38:18.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.220+0000 7fecf9710640 1 --2- 172.21.15.6:0/1497518928 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fecd80663a0 0x7fecd8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:18.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.220+0000 7fecf9710640 1 --2- 172.21.15.6:0/1497518928 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fecd80663a0 0x7fecd8068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fecf40b3e10 tx=0x7fecf0009040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:18.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.224+0000 7fece9ffb640 1 -- 172.21.15.6:0/1497518928 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fecf40b1a00 con 0x7fecf40d13f0 2023-07-21T22:38:18.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:18.392+0000 7fecfa712640 1 -- 172.21.15.6:0/1497518928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fecf40b1a00 con 0x7fecf40d13f0 2023-07-21T22:38:19.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.372+0000 7fece9ffb640 1 -- 172.21.15.6:0/1497518928 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v139) v1 ==== 97+0+0 (secure 0 0 0) 0x7fecf40b1a00 con 0x7fecf40d13f0 2023-07-21T22:38:19.417 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-07-21T22:38:19.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.372+0000 7fecfa712640 1 -- 172.21.15.6:0/1497518928 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fecd80663a0 msgr2=0x7fecd8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:19.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.372+0000 7fecfa712640 1 --2- 172.21.15.6:0/1497518928 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fecd80663a0 0x7fecd8068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fecf40b3e10 tx=0x7fecf0009040 comp rx=0 tx=0).stop 2023-07-21T22:38:19.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.372+0000 7fecfa712640 1 -- 172.21.15.6:0/1497518928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf40d13f0 msgr2=0x7fecf40cb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:19.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.372+0000 7fecfa712640 1 --2- 172.21.15.6:0/1497518928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf40d13f0 0x7fecf40cb050 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fece400c480 tx=0x7fece400c940 comp rx=0 tx=0).stop 2023-07-21T22:38:19.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.372+0000 7fecfa712640 1 -- 172.21.15.6:0/1497518928 shutdown_connections 2023-07-21T22:38:19.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.372+0000 7fecfa712640 1 --2- 172.21.15.6:0/1497518928 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fecd80663a0 0x7fecd8068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:19.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.372+0000 7fecfa712640 1 --2- 172.21.15.6:0/1497518928 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecf415f3f0 0x7fecf41532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:19.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.372+0000 7fecfa712640 1 --2- 172.21.15.6:0/1497518928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecf40d13f0 0x7fecf40cb050 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.372+0000 7fecfa712640 1 --2- 172.21.15.6:0/1497518928 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecf40b7d90 0x7fecf4153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.372+0000 7fecfa712640 1 -- 172.21.15.6:0/1497518928 >> 172.21.15.6:0/1497518928 conn(0x7fecf4069f50 msgr2=0x7fecf40ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.372+0000 7fecfa712640 1 -- 172.21.15.6:0/1497518928 shutdown_connections 2023-07-21T22:38:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.376+0000 7fecfa712640 1 -- 172.21.15.6:0/1497518928 wait complete. 2023-07-21T22:38:19.443 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-21T22:38:19.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.548+0000 7fd425d98640 1 Processor -- start 2023-07-21T22:38:19.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.548+0000 7fd425d98640 1 -- start start 2023-07-21T22:38:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.548+0000 7fd425d98640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd42015f3f0 0x7fd4200b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.548+0000 7fd425d98640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4200b7bc0 0x7fd4200cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.548+0000 7fd425d98640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4200d0f60 con 0x7fd4200d13f0 2023-07-21T22:38:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.548+0000 7fd425d98640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4200b7ff0 con 0x7fd4200b7bc0 2023-07-21T22:38:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.548+0000 7fd425d98640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4200d0390 con 0x7fd42015f3f0 2023-07-21T22:38:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.548+0000 7fd425597640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd4200b7bc0 0x7fd4200cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.548+0000 7fd41ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd4200d13f0 0x7fd4200cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47584/0 (socket says 172.21.15.6:47584) 2023-07-21T22:38:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.548+0000 7fd41ffff640 1 -- 172.21.15.6:0/1779607259 learned_addr learned my addr 172.21.15.6:0/1779607259 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.548+0000 7fd424d96640 1 --2- 172.21.15.6:0/1779607259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd42015f3f0 0x7fd4200b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.548+0000 7fd425597640 1 -- 172.21.15.6:0/1779607259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd42015f3f0 msgr2=0x7fd4200b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:19.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.548+0000 7fd425597640 1 --2- 172.21.15.6:0/1779607259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd42015f3f0 0x7fd4200b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:19.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.548+0000 7fd425597640 1 -- 172.21.15.6:0/1779607259 >> v1:172.21.15.6:6789/0 conn(0x7fd4200d13f0 legacy=0x7fd4200cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:19.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.548+0000 7fd425597640 1 -- 172.21.15.6:0/1779607259 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4200d0630 con 0x7fd4200b7bc0 2023-07-21T22:38:19.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.548+0000 7fd41f7fe640 1 -- 172.21.15.6:0/1779607259 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2264770984 0 0) 0x7fd4200d0f60 con 0x7fd4200d13f0 2023-07-21T22:38:19.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.552+0000 7fd425597640 1 --2- 172.21.15.6:0/1779607259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4200b7bc0 0x7fd4200cd0b0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fd418009d90 tx=0x7fd41801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dafa8e8f8366e74 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:19.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.552+0000 7fd41f7fe640 1 -- 172.21.15.6:0/1779607259 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4180a5870 con 0x7fd4200b7bc0 2023-07-21T22:38:19.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.552+0000 7fd41f7fe640 1 -- 172.21.15.6:0/1779607259 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4180a59d0 con 0x7fd4200b7bc0 2023-07-21T22:38:19.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.552+0000 7fd41f7fe640 1 -- 172.21.15.6:0/1779607259 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4180a5d60 con 0x7fd4200b7bc0 2023-07-21T22:38:19.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.552+0000 7fd425d98640 1 -- 172.21.15.6:0/1779607259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4200b7bc0 msgr2=0x7fd4200cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:19.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.552+0000 7fd425d98640 1 --2- 172.21.15.6:0/1779607259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4200b7bc0 0x7fd4200cd0b0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fd418009d90 tx=0x7fd41801c8c0 comp rx=0 tx=0).stop 2023-07-21T22:38:19.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.552+0000 7fd425d98640 1 -- 172.21.15.6:0/1779607259 shutdown_connections 2023-07-21T22:38:19.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.552+0000 7fd425d98640 1 --2- 172.21.15.6:0/1779607259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4200b7bc0 0x7fd4200cd0b0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:19.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.552+0000 7fd425d98640 1 --2- 172.21.15.6:0/1779607259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd42015f3f0 0x7fd4200b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:19.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.552+0000 7fd425d98640 1 -- 172.21.15.6:0/1779607259 >> 172.21.15.6:0/1779607259 conn(0x7fd420069f50 msgr2=0x7fd42006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:19.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.552+0000 7fd425d98640 1 -- 172.21.15.6:0/1779607259 shutdown_connections 2023-07-21T22:38:19.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.552+0000 7fd425d98640 1 -- 172.21.15.6:0/1779607259 wait complete. 2023-07-21T22:38:19.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd425d98640 1 Processor -- start 2023-07-21T22:38:19.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd425d98640 1 -- start start 2023-07-21T22:38:19.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd425d98640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4200b7bc0 0x7fd420152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:19.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd425d98640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4200d13f0 0x7fd420154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:19.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd425d98640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd42015f3f0 0x7fd420150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:19.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd425d98640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4201564c0 con 0x7fd42015f3f0 2023-07-21T22:38:19.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd425d98640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4201550b0 con 0x7fd4200b7bc0 2023-07-21T22:38:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd425d98640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd420156760 con 0x7fd4200d13f0 2023-07-21T22:38:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd425597640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd42015f3f0 0x7fd420150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd425597640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd42015f3f0 0x7fd420150970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51652/0 (socket says 172.21.15.6:51652) 2023-07-21T22:38:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd425597640 1 -- 172.21.15.6:0/3209297837 learned_addr learned my addr 172.21.15.6:0/3209297837 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd41ffff640 1 --2- 172.21.15.6:0/3209297837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4200d13f0 0x7fd420154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd424d96640 1 --2- 172.21.15.6:0/3209297837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4200b7bc0 0x7fd420152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:19.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd425597640 1 -- 172.21.15.6:0/3209297837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4200d13f0 msgr2=0x7fd420154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:19.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd425597640 1 --2- 172.21.15.6:0/3209297837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4200d13f0 0x7fd420154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:19.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd425597640 1 -- 172.21.15.6:0/3209297837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4200b7bc0 msgr2=0x7fd420152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:19.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd425597640 1 --2- 172.21.15.6:0/3209297837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4200b7bc0 0x7fd420152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:19.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd425597640 1 -- 172.21.15.6:0/3209297837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd418009a70 con 0x7fd42015f3f0 2023-07-21T22:38:19.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd41ffff640 1 --2- 172.21.15.6:0/3209297837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4200d13f0 0x7fd420154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:19.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd424d96640 1 --2- 172.21.15.6:0/3209297837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4200b7bc0 0x7fd420152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:19.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd425597640 1 --2- 172.21.15.6:0/3209297837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd42015f3f0 0x7fd420150970 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fd4180b0040 tx=0x7fd418019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:19.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd41d7fa640 1 -- 172.21.15.6:0/3209297837 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4180b9860 con 0x7fd42015f3f0 2023-07-21T22:38:19.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd41d7fa640 1 -- 172.21.15.6:0/3209297837 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4180b99c0 con 0x7fd42015f3f0 2023-07-21T22:38:19.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd41d7fa640 1 -- 172.21.15.6:0/3209297837 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4180b9d70 con 0x7fd42015f3f0 2023-07-21T22:38:19.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd425d98640 1 -- 172.21.15.6:0/3209297837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd420156a40 con 0x7fd42015f3f0 2023-07-21T22:38:19.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd425d98640 1 -- 172.21.15.6:0/3209297837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd420153480 con 0x7fd42015f3f0 2023-07-21T22:38:19.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.556+0000 7fd425d98640 1 -- 172.21.15.6:0/3209297837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4200678d0 con 0x7fd42015f3f0 2023-07-21T22:38:19.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.560+0000 7fd41d7fa640 1 -- 172.21.15.6:0/3209297837 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd4180ad440 con 0x7fd42015f3f0 2023-07-21T22:38:19.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.560+0000 7fd41d7fa640 1 --2- 172.21.15.6:0/3209297837 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fd4040663a0 0x7fd404068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:19.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.560+0000 7fd41d7fa640 1 -- 172.21.15.6:0/3209297837 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5282+0+0 (secure 0 0 0) 0x7fd41811ef90 con 0x7fd42015f3f0 2023-07-21T22:38:19.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.560+0000 7fd424d96640 1 --2- 172.21.15.6:0/3209297837 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fd4040663a0 0x7fd404068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:19.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.560+0000 7fd424d96640 1 --2- 172.21.15.6:0/3209297837 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fd4040663a0 0x7fd404068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd41400b9f0 tx=0x7fd414008040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:19.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.564+0000 7fd41d7fa640 1 -- 172.21.15.6:0/3209297837 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd4180ec5f0 con 0x7fd42015f3f0 2023-07-21T22:38:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.772+0000 7fd425d98640 1 -- 172.21.15.6:0/3209297837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd4201568a0 con 0x7fd42015f3f0 2023-07-21T22:38:19.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.772+0000 7fd41d7fa640 1 -- 172.21.15.6:0/3209297837 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd4201568a0 con 0x7fd42015f3f0 2023-07-21T22:38:19.817 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:19.817 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:38:19.817 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-07-21T22:38:19.817 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:19.817 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-07-21T22:38:19.818 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkHn5HNxAADk0AaSGwZfEj3SwNvEm8hw==", 2023-07-21T22:38:19.818 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:19.818 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:38:19.818 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:38:19.818 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:38:19.818 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:19.818 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:19.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:19.819 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:19.819 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-07-21T22:38:19.819 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkQFvXCBAANxf0/I2RQcHy4iYiydjkcg==", 2023-07-21T22:38:19.819 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:19.819 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:38:19.819 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:38:19.819 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:38:19.820 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:19.820 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:19.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:19.820 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:19.820 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-07-21T22:38:19.820 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkYtGXAxAAy+RDDBSvc1FeZq+eg23tRA==", 2023-07-21T22:38:19.820 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:19.821 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:38:19.821 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:38:19.821 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:38:19.821 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:19.821 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:19.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:19.821 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:19.821 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-07-21T22:38:19.822 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkH+Y1EBAAl+qTqd+gFrB9LtJWwD5dgA==", 2023-07-21T22:38:19.822 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:19.822 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:38:19.822 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:38:19.822 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:38:19.822 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:19.822 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:19.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:19.823 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:19.823 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-07-21T22:38:19.823 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAKBLtkPwZrLBAAQHZECi2zHST1MKYgGoa/Iw==", 2023-07-21T22:38:19.823 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:19.823 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:38:19.823 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:38:19.823 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:19.823 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:19.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:19.824 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:19.824 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-07-21T22:38:19.824 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQANBLtkvwgwNBAApurMm8c3pSlX2r16Gli/Ag==", 2023-07-21T22:38:19.824 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:19.824 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:38:19.824 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:38:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-07-21T22:38:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAQBLtkf2p1OxAAcKYw2RixFefYAwcfkGnOKQ==", 2023-07-21T22:38:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:19.825 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:38:19.826 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:38:19.826 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:19.826 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:19.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:19.826 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:19.826 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-07-21T22:38:19.826 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAUBLtkQUl6BhAAXXT1ZK1h9aZEcp6qIHsLiA==", 2023-07-21T22:38:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:38:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:38:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:19.827 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-07-21T22:38:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAaBLtkc1VfExAAPzDz2k/c0qVePG9h1saQCw==", 2023-07-21T22:38:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:38:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:38:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:19.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:19.829 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:19.829 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-07-21T22:38:19.829 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAdBLtkJ6fcGhAAglVSJIQS04WYBv4APhl57g==", 2023-07-21T22:38:19.829 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:19.829 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:38:19.829 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:38:19.829 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-07-21T22:38:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAgBLtkPINGIRAAWKs1RNQIdhZYlDAzDgUkNw==", 2023-07-21T22:38:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:19.830 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:38:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:38:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-07-21T22:38:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAjBLtk83MCKBAAZH2NhMBphVv4QkRzy+NDgg==", 2023-07-21T22:38:19.831 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:38:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:38:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-07-21T22:38:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA==", 2023-07-21T22:38:19.833 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:19.833 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:38:19.833 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-07-21T22:38:19.833 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-21T22:38:19.833 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:19.833 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:19.833 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-07-21T22:38:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkPVXTHhAAYmkzwAvqsfrowpAucTnlUQ==", 2023-07-21T22:38:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:38:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:38:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:38:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:38:19.834 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:19.835 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:19.835 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:19.835 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-07-21T22:38:19.835 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkd7wSGxAArvSYwe+k48vgRzb3fQAEAQ==", 2023-07-21T22:38:19.835 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:19.835 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:38:19.835 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:38:19.836 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:38:19.836 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:38:19.836 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:19.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:19.836 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:19.836 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-07-21T22:38:19.836 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkoZ4YJRAAX4yh0Q1pR4wY7yEV6kg9QA==", 2023-07-21T22:38:19.836 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:19.837 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:38:19.837 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:38:19.837 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:38:19.837 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:38:19.837 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:19.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:19.837 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:19.838 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-07-21T22:38:19.838 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtk0ILFGhAAQZ+8lGNFVdOtZYOuLlfkoQ==", 2023-07-21T22:38:19.838 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:19.838 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:38:19.838 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:38:19.838 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:38:19.838 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:19.838 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:19.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:19.839 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:19.839 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-07-21T22:38:19.839 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkdobtMhAAQbwi3cvsrW9P0t3d52oEKw==", 2023-07-21T22:38:19.839 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:19.839 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:38:19.839 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T22:38:19.839 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:19.840 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:19.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:19.840 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:19.840 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-07-21T22:38:19.840 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkHhzpLhAAZTx4Vrc0Htk88104SzuAxQ==", 2023-07-21T22:38:19.840 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:19.840 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:38:19.840 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T22:38:19.841 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:19.841 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:19.841 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:19.841 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-07-21T22:38:19.841 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:38:19.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.772+0000 7fd425d98640 1 -- 172.21.15.6:0/3209297837 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fd4040663a0 msgr2=0x7fd404068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:19.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.772+0000 7fd425d98640 1 --2- 172.21.15.6:0/3209297837 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fd4040663a0 0x7fd404068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd41400b9f0 tx=0x7fd414008040 comp rx=0 tx=0).stop 2023-07-21T22:38:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.772+0000 7fd425d98640 1 -- 172.21.15.6:0/3209297837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd42015f3f0 msgr2=0x7fd420150970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.772+0000 7fd425d98640 1 --2- 172.21.15.6:0/3209297837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd42015f3f0 0x7fd420150970 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fd4180b0040 tx=0x7fd418019660 comp rx=0 tx=0).stop 2023-07-21T22:38:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.772+0000 7fd425d98640 1 -- 172.21.15.6:0/3209297837 shutdown_connections 2023-07-21T22:38:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.772+0000 7fd425d98640 1 --2- 172.21.15.6:0/3209297837 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fd4040663a0 0x7fd404068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.772+0000 7fd425d98640 1 --2- 172.21.15.6:0/3209297837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd42015f3f0 0x7fd420150970 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.772+0000 7fd425d98640 1 --2- 172.21.15.6:0/3209297837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4200d13f0 0x7fd420154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:19.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.772+0000 7fd425d98640 1 --2- 172.21.15.6:0/3209297837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4200b7bc0 0x7fd420152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:19.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.772+0000 7fd425d98640 1 -- 172.21.15.6:0/3209297837 >> 172.21.15.6:0/3209297837 conn(0x7fd420069f50 msgr2=0x7fd4200cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:19.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.772+0000 7fd425d98640 1 -- 172.21.15.6:0/3209297837 shutdown_connections 2023-07-21T22:38:19.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.772+0000 7fd425d98640 1 -- 172.21.15.6:0/3209297837 wait complete. 2023-07-21T22:38:19.844 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:38:19.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.944+0000 7f28e7940640 1 Processor -- start 2023-07-21T22:38:19.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.944+0000 7f28e7940640 1 -- start start 2023-07-21T22:38:19.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.944+0000 7f28e7940640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f28e015bc00 0x7f28e00ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:19.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.944+0000 7f28e7940640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28e0069430 0x7f28e0069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:19.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.944+0000 7f28e7940640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e00c9c30 con 0x7f28e0160450 2023-07-21T22:38:19.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.944+0000 7f28e7940640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e00c96b0 con 0x7f28e015bc00 2023-07-21T22:38:19.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.944+0000 7f28e7940640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e0069db0 con 0x7f28e0069430 2023-07-21T22:38:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.944+0000 7f28e5edd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28e0069430 0x7f28e0069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.944+0000 7f28e56dc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f28e015bc00 0x7f28e00ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:19.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.944+0000 7f28e5edd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28e0069430 0x7f28e0069870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:51128/0 (socket says 172.21.15.6:51128) 2023-07-21T22:38:19.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.944+0000 7f28e56dc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f28e015bc00 0x7f28e00ce8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:41162/0 (socket says 172.21.15.6:41162) 2023-07-21T22:38:19.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.944+0000 7f28e5edd640 1 -- 172.21.15.6:0/2685656546 learned_addr learned my addr 172.21.15.6:0/2685656546 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:19.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.944+0000 7f28e5edd640 1 -- 172.21.15.6:0/2685656546 >> v2:172.21.15.161:3300/0 conn(0x7f28e015bc00 msgr2=0x7f28e00ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:19.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.944+0000 7f28e5edd640 1 --2- 172.21.15.6:0/2685656546 >> v2:172.21.15.161:3300/0 conn(0x7f28e015bc00 0x7f28e00ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:19.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.944+0000 7f28e5edd640 1 -- 172.21.15.6:0/2685656546 >> v1:172.21.15.161:6789/0 conn(0x7f28e0160450 legacy=0x7f28e006e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:19.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.944+0000 7f28e5edd640 1 -- 172.21.15.6:0/2685656546 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e015bfd0 con 0x7f28e0069430 2023-07-21T22:38:19.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.944+0000 7f28d7fff640 1 -- 172.21.15.6:0/2685656546 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65117380 0 0) 0x7f28e00c9c30 con 0x7f28e0160450 2023-07-21T22:38:19.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.944+0000 7f28e56dc640 1 --2- 172.21.15.6:0/2685656546 >> v2:172.21.15.161:3300/0 conn(0x7f28e015bc00 0x7f28e00ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:19.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.948+0000 7f28e5edd640 1 --2- 172.21.15.6:0/2685656546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28e0069430 0x7f28e0069870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f28d8009e50 tx=0x7f28d801c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=788a36c991feb6a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:19.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.948+0000 7f28d7fff640 1 -- 172.21.15.6:0/2685656546 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d80a58b0 con 0x7f28e0069430 2023-07-21T22:38:19.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.948+0000 7f28d7fff640 1 -- 172.21.15.6:0/2685656546 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d80a5a10 con 0x7f28e0069430 2023-07-21T22:38:19.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.948+0000 7f28d7fff640 1 -- 172.21.15.6:0/2685656546 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d80a5da0 con 0x7f28e0069430 2023-07-21T22:38:19.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.948+0000 7f28e7940640 1 -- 172.21.15.6:0/2685656546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28e0069430 msgr2=0x7f28e0069870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:19.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.948+0000 7f28e7940640 1 --2- 172.21.15.6:0/2685656546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28e0069430 0x7f28e0069870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f28d8009e50 tx=0x7f28d801c9f0 comp rx=0 tx=0).stop 2023-07-21T22:38:19.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.948+0000 7f28e7940640 1 -- 172.21.15.6:0/2685656546 shutdown_connections 2023-07-21T22:38:19.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.948+0000 7f28e7940640 1 --2- 172.21.15.6:0/2685656546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28e0069430 0x7f28e0069870 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:19.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.948+0000 7f28e7940640 1 --2- 172.21.15.6:0/2685656546 >> v2:172.21.15.161:3300/0 conn(0x7f28e015bc00 0x7f28e00ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:19.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.948+0000 7f28e7940640 1 -- 172.21.15.6:0/2685656546 >> 172.21.15.6:0/2685656546 conn(0x7f28e00b1840 msgr2=0x7f28e00cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:19.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.948+0000 7f28e7940640 1 -- 172.21.15.6:0/2685656546 shutdown_connections 2023-07-21T22:38:19.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.948+0000 7f28e7940640 1 -- 172.21.15.6:0/2685656546 wait complete. 2023-07-21T22:38:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28e7940640 1 Processor -- start 2023-07-21T22:38:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28e7940640 1 -- start start 2023-07-21T22:38:19.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28e7940640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28e0069430 0x7f28e006e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:19.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28e7940640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28e015bc00 0x7f28e00c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:20.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28e7940640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28e0160450 0x7f28e00c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:20.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28e7940640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e01f4000 con 0x7f28e015bc00 2023-07-21T22:38:20.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28e7940640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e0158430 con 0x7f28e0069430 2023-07-21T22:38:20.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28e7940640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e00c6c70 con 0x7f28e0160450 2023-07-21T22:38:20.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28e4edb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28e015bc00 0x7f28e00c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:20.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28e4edb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28e015bc00 0x7f28e00c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51654/0 (socket says 172.21.15.6:51654) 2023-07-21T22:38:20.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28e4edb640 1 -- 172.21.15.6:0/3652198597 learned_addr learned my addr 172.21.15.6:0/3652198597 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:20.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28e56dc640 1 --2- 172.21.15.6:0/3652198597 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28e0069430 0x7f28e006e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:20.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28e5edd640 1 --2- 172.21.15.6:0/3652198597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28e0160450 0x7f28e00c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:20.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28e4edb640 1 -- 172.21.15.6:0/3652198597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28e0160450 msgr2=0x7f28e00c7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:20.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28e4edb640 1 --2- 172.21.15.6:0/3652198597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28e0160450 0x7f28e00c7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28e4edb640 1 -- 172.21.15.6:0/3652198597 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28e0069430 msgr2=0x7f28e006e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:20.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28e4edb640 1 --2- 172.21.15.6:0/3652198597 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28e0069430 0x7f28e006e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28e4edb640 1 -- 172.21.15.6:0/3652198597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc009420 con 0x7f28e015bc00 2023-07-21T22:38:20.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28e4edb640 1 --2- 172.21.15.6:0/3652198597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28e015bc00 0x7f28e00c6300 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f28d0001ec0 tx=0x7f28d000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:20.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28d5ffb640 1 -- 172.21.15.6:0/3652198597 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d00054e0 con 0x7f28e015bc00 2023-07-21T22:38:20.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28d5ffb640 1 -- 172.21.15.6:0/3652198597 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d0003600 con 0x7f28e015bc00 2023-07-21T22:38:20.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28d5ffb640 1 -- 172.21.15.6:0/3652198597 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d00039b0 con 0x7f28e015bc00 2023-07-21T22:38:20.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.952+0000 7f28e7940640 1 -- 172.21.15.6:0/3652198597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d8009b30 con 0x7f28e015bc00 2023-07-21T22:38:20.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.956+0000 7f28e7940640 1 -- 172.21.15.6:0/3652198597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e00c6f10 con 0x7f28e015bc00 2023-07-21T22:38:20.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.956+0000 7f28e7940640 1 -- 172.21.15.6:0/3652198597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e00678d0 con 0x7f28e015bc00 2023-07-21T22:38:20.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.956+0000 7f28d5ffb640 1 -- 172.21.15.6:0/3652198597 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f28d0003b10 con 0x7f28e015bc00 2023-07-21T22:38:20.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.956+0000 7f28d5ffb640 1 --2- 172.21.15.6:0/3652198597 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f28c40663a0 0x7f28c4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:20.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.956+0000 7f28d5ffb640 1 -- 172.21.15.6:0/3652198597 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f28d0083230 con 0x7f28e015bc00 2023-07-21T22:38:20.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.956+0000 7f28e56dc640 1 --2- 172.21.15.6:0/3652198597 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f28c40663a0 0x7f28c4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:20.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.960+0000 7f28e56dc640 1 --2- 172.21.15.6:0/3652198597 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f28c40663a0 0x7f28c4068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009c80 tx=0x7f28dc008040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:20.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:19.960+0000 7f28d5ffb640 1 -- 172.21.15.6:0/3652198597 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f28d0050800 con 0x7f28e015bc00 2023-07-21T22:38:20.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.120+0000 7f28e7940640 1 -- 172.21.15.6:0/3652198597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28e015f490 con 0x7f28e015bc00 2023-07-21T22:38:20.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.120+0000 7f28d5ffb640 1 -- 172.21.15.6:0/3652198597 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+14692 (secure 0 0 0) 0x7f28d0053e20 con 0x7f28e015bc00 2023-07-21T22:38:20.167 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:20.167 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":139,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:38:19.369114+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:38:20.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.124+0000 7f28e7940640 1 -- 172.21.15.6:0/3652198597 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f28c40663a0 msgr2=0x7f28c4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:20.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.124+0000 7f28e7940640 1 --2- 172.21.15.6:0/3652198597 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f28c40663a0 0x7f28c4068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009c80 tx=0x7f28dc008040 comp rx=0 tx=0).stop 2023-07-21T22:38:20.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.124+0000 7f28e7940640 1 -- 172.21.15.6:0/3652198597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28e015bc00 msgr2=0x7f28e00c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:20.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.124+0000 7f28e7940640 1 --2- 172.21.15.6:0/3652198597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28e015bc00 0x7f28e00c6300 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f28d0001ec0 tx=0x7f28d000c8e0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.124+0000 7f28e7940640 1 -- 172.21.15.6:0/3652198597 shutdown_connections 2023-07-21T22:38:20.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.124+0000 7f28e7940640 1 --2- 172.21.15.6:0/3652198597 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f28c40663a0 0x7f28c4068850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.124+0000 7f28e7940640 1 --2- 172.21.15.6:0/3652198597 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28e0160450 0x7f28e00c7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.124+0000 7f28e7940640 1 --2- 172.21.15.6:0/3652198597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28e015bc00 0x7f28e00c6300 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.124+0000 7f28e7940640 1 --2- 172.21.15.6:0/3652198597 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28e0069430 0x7f28e006e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.124+0000 7f28e7940640 1 -- 172.21.15.6:0/3652198597 >> 172.21.15.6:0/3652198597 conn(0x7f28e00b1840 msgr2=0x7f28e00cd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:20.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.124+0000 7f28e7940640 1 -- 172.21.15.6:0/3652198597 shutdown_connections 2023-07-21T22:38:20.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.124+0000 7f28e7940640 1 -- 172.21.15.6:0/3652198597 wait complete. 2023-07-21T22:38:20.188 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:38:20.189 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:38:20.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.292+0000 7fdccfa0b640 1 Processor -- start 2023-07-21T22:38:20.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.292+0000 7fdccfa0b640 1 -- start start 2023-07-21T22:38:20.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.292+0000 7fdccfa0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdcc8069430 0x7fdcc8069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:20.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.292+0000 7fdccfa0b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdcc8070f30 0x7fdcc80ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:20.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.292+0000 7fdccfa0b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc8159d70 con 0x7fdcc80af2b0 2023-07-21T22:38:20.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.292+0000 7fdccfa0b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc8069d40 con 0x7fdcc8070f30 2023-07-21T22:38:20.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.292+0000 7fdccfa0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc80c9c60 con 0x7fdcc8069430 2023-07-21T22:38:20.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.292+0000 7fdcccfa6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdcc8070f30 0x7fdcc80ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:20.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.292+0000 7fdcccfa6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdcc8070f30 0x7fdcc80ad6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51668/0 (socket says 172.21.15.6:51668) 2023-07-21T22:38:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.292+0000 7fdcccfa6640 1 -- 172.21.15.6:0/2952204839 learned_addr learned my addr 172.21.15.6:0/2952204839 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.292+0000 7fdccd7a7640 1 --2- 172.21.15.6:0/2952204839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdcc8069430 0x7fdcc8069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.292+0000 7fdcccfa6640 1 -- 172.21.15.6:0/2952204839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdcc8069430 msgr2=0x7fdcc8069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.292+0000 7fdcccfa6640 1 --2- 172.21.15.6:0/2952204839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdcc8069430 0x7fdcc8069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.292+0000 7fdcccfa6640 1 -- 172.21.15.6:0/2952204839 >> v1:172.21.15.161:6789/0 conn(0x7fdcc80af2b0 legacy=0x7fdcc815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.292+0000 7fdcccfa6640 1 -- 172.21.15.6:0/2952204839 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc80c9f40 con 0x7fdcc8070f30 2023-07-21T22:38:20.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.296+0000 7fdcccfa6640 1 --2- 172.21.15.6:0/2952204839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc8070f30 0x7fdcc80ad6f0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8009870 tx=0x7fdcb801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dbe440855d15a4d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:20.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.296+0000 7fdcbffff640 1 -- 172.21.15.6:0/2952204839 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb80a9400 con 0x7fdcc8070f30 2023-07-21T22:38:20.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.296+0000 7fdcbffff640 1 -- 172.21.15.6:0/2952204839 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb80a9560 con 0x7fdcc8070f30 2023-07-21T22:38:20.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.296+0000 7fdcbffff640 1 -- 172.21.15.6:0/2952204839 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb80a98f0 con 0x7fdcc8070f30 2023-07-21T22:38:20.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.296+0000 7fdccfa0b640 1 -- 172.21.15.6:0/2952204839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc8070f30 msgr2=0x7fdcc80ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:20.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.296+0000 7fdccfa0b640 1 --2- 172.21.15.6:0/2952204839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc8070f30 0x7fdcc80ad6f0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8009870 tx=0x7fdcb801c540 comp rx=0 tx=0).stop 2023-07-21T22:38:20.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.296+0000 7fdccfa0b640 1 -- 172.21.15.6:0/2952204839 shutdown_connections 2023-07-21T22:38:20.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.296+0000 7fdccfa0b640 1 --2- 172.21.15.6:0/2952204839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc8070f30 0x7fdcc80ad6f0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.296+0000 7fdccfa0b640 1 --2- 172.21.15.6:0/2952204839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdcc8069430 0x7fdcc8069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.296+0000 7fdccfa0b640 1 -- 172.21.15.6:0/2952204839 >> 172.21.15.6:0/2952204839 conn(0x7fdcc80cde90 msgr2=0x7fdcc80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:20.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.296+0000 7fdccfa0b640 1 -- 172.21.15.6:0/2952204839 shutdown_connections 2023-07-21T22:38:20.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.296+0000 7fdccfa0b640 1 -- 172.21.15.6:0/2952204839 wait complete. 2023-07-21T22:38:20.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.296+0000 7fdccfa0b640 1 Processor -- start 2023-07-21T22:38:20.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.296+0000 7fdccfa0b640 1 -- start start 2023-07-21T22:38:20.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdccfa0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc8069430 0x7fdcc80c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdccfa0b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcc8070f30 0x7fdcc8151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdccfa0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdcc80af2b0 0x7fdcc806f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdccfa0b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc80c42e0 con 0x7fdcc8069430 2023-07-21T22:38:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdccfa0b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc80c45c0 con 0x7fdcc8070f30 2023-07-21T22:38:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdccfa0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc81532b0 con 0x7fdcc80af2b0 2023-07-21T22:38:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdccd7a7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc8069430 0x7fdcc80c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdccd7a7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc8069430 0x7fdcc80c3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51684/0 (socket says 172.21.15.6:51684) 2023-07-21T22:38:20.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdccd7a7640 1 -- 172.21.15.6:0/3153893357 learned_addr learned my addr 172.21.15.6:0/3153893357 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:20.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdcccfa6640 1 --2- 172.21.15.6:0/3153893357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcc8070f30 0x7fdcc8151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:20.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdccdfa8640 1 --2- 172.21.15.6:0/3153893357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdcc80af2b0 0x7fdcc806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:20.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdccd7a7640 1 -- 172.21.15.6:0/3153893357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdcc80af2b0 msgr2=0x7fdcc806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:20.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdccd7a7640 1 --2- 172.21.15.6:0/3153893357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdcc80af2b0 0x7fdcc806f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdccd7a7640 1 -- 172.21.15.6:0/3153893357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcc8070f30 msgr2=0x7fdcc8151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:20.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdccd7a7640 1 --2- 172.21.15.6:0/3153893357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcc8070f30 0x7fdcc8151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdccd7a7640 1 -- 172.21.15.6:0/3153893357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb80094d0 con 0x7fdcc8069430 2023-07-21T22:38:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdcccfa6640 1 --2- 172.21.15.6:0/3153893357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcc8070f30 0x7fdcc8151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdccd7a7640 1 --2- 172.21.15.6:0/3153893357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc8069430 0x7fdcc80c3c10 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400d5f0 tx=0x7fdcc400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdcbdffb640 1 -- 172.21.15.6:0/3153893357 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc40125f0 con 0x7fdcc8069430 2023-07-21T22:38:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdcbdffb640 1 -- 172.21.15.6:0/3153893357 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc4012750 con 0x7fdcc8069430 2023-07-21T22:38:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdcbdffb640 1 -- 172.21.15.6:0/3153893357 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4012ae0 con 0x7fdcc8069430 2023-07-21T22:38:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdccfa0b640 1 -- 172.21.15.6:0/3153893357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc8153590 con 0x7fdcc8069430 2023-07-21T22:38:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdccfa0b640 1 -- 172.21.15.6:0/3153893357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc80c7660 con 0x7fdcc8069430 2023-07-21T22:38:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.300+0000 7fdccfa0b640 1 -- 172.21.15.6:0/3153893357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc80678d0 con 0x7fdcc8069430 2023-07-21T22:38:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.304+0000 7fdcbdffb640 1 -- 172.21.15.6:0/3153893357 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdcc4012c40 con 0x7fdcc8069430 2023-07-21T22:38:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.304+0000 7fdcbdffb640 1 --2- 172.21.15.6:0/3153893357 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fdcac0663a0 0x7fdcac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.304+0000 7fdcbdffb640 1 -- 172.21.15.6:0/3153893357 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5282+0+0 (secure 0 0 0) 0x7fdcc4084080 con 0x7fdcc8069430 2023-07-21T22:38:20.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.304+0000 7fdcccfa6640 1 --2- 172.21.15.6:0/3153893357 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fdcac0663a0 0x7fdcac068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:20.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.304+0000 7fdcccfa6640 1 --2- 172.21.15.6:0/3153893357 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fdcac0663a0 0x7fdcac068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdcb80ae000 tx=0x7fdcb80b3040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.308+0000 7fdcbdffb640 1 -- 172.21.15.6:0/3153893357 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdcc40516f0 con 0x7fdcc8069430 2023-07-21T22:38:20.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.464+0000 7fdccfa0b640 1 -- 172.21.15.6:0/3153893357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdcc815a400 con 0x7fdcc8069430 2023-07-21T22:38:20.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.464+0000 7fdcbdffb640 1 -- 172.21.15.6:0/3153893357 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v139) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdcc4054d10 con 0x7fdcc8069430 2023-07-21T22:38:20.510 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:38:20.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.468+0000 7fdccfa0b640 1 -- 172.21.15.6:0/3153893357 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fdcac0663a0 msgr2=0x7fdcac068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:20.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.468+0000 7fdccfa0b640 1 --2- 172.21.15.6:0/3153893357 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fdcac0663a0 0x7fdcac068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdcb80ae000 tx=0x7fdcb80b3040 comp rx=0 tx=0).stop 2023-07-21T22:38:20.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.468+0000 7fdccfa0b640 1 -- 172.21.15.6:0/3153893357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc8069430 msgr2=0x7fdcc80c3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:20.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.468+0000 7fdccfa0b640 1 --2- 172.21.15.6:0/3153893357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc8069430 0x7fdcc80c3c10 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400d5f0 tx=0x7fdcc400dab0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.468+0000 7fdccfa0b640 1 -- 172.21.15.6:0/3153893357 shutdown_connections 2023-07-21T22:38:20.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.468+0000 7fdccfa0b640 1 --2- 172.21.15.6:0/3153893357 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fdcac0663a0 0x7fdcac068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.468+0000 7fdccfa0b640 1 --2- 172.21.15.6:0/3153893357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdcc80af2b0 0x7fdcc806f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.468+0000 7fdccfa0b640 1 --2- 172.21.15.6:0/3153893357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcc8070f30 0x7fdcc8151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.468+0000 7fdccfa0b640 1 --2- 172.21.15.6:0/3153893357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc8069430 0x7fdcc80c3c10 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.468+0000 7fdccfa0b640 1 -- 172.21.15.6:0/3153893357 >> 172.21.15.6:0/3153893357 conn(0x7fdcc80cde90 msgr2=0x7fdcc8157cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:20.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.468+0000 7fdccfa0b640 1 -- 172.21.15.6:0/3153893357 shutdown_connections 2023-07-21T22:38:20.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.468+0000 7fdccfa0b640 1 -- 172.21.15.6:0/3153893357 wait complete. 2023-07-21T22:38:20.531 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:38:20.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.632+0000 7fbf35c0b640 1 Processor -- start 2023-07-21T22:38:20.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.632+0000 7fbf35c0b640 1 -- start start 2023-07-21T22:38:20.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf35c0b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbf3015f690 0x7fbf300b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:20.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf35c0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf3006a440 0x7fbf3006c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:20.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf35c0b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf3006c040 con 0x7fbf301453a0 2023-07-21T22:38:20.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf35c0b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf30160170 con 0x7fbf3015f690 2023-07-21T22:38:20.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf35c0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30160600 con 0x7fbf3006a440 2023-07-21T22:38:20.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2effd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbf301453a0 0x7fbf3015fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47588/0 (socket says 172.21.15.6:47588) 2023-07-21T22:38:20.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2effd640 1 -- 172.21.15.6:0/2203333859 learned_addr learned my addr 172.21.15.6:0/2203333859 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:20.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2ffff640 1 --2- 172.21.15.6:0/2203333859 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf3006a440 0x7fbf3006c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:20.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2f7fe640 1 --2- 172.21.15.6:0/2203333859 >> v2:172.21.15.161:3300/0 conn(0x7fbf3015f690 0x7fbf300b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:20.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2e7fc640 1 -- 172.21.15.6:0/2203333859 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901764220 0 0) 0x7fbf3006c040 con 0x7fbf301453a0 2023-07-21T22:38:20.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2e7fc640 1 -- 172.21.15.6:0/2203333859 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf18003530 con 0x7fbf301453a0 2023-07-21T22:38:20.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2e7fc640 1 -- 172.21.15.6:0/2203333859 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2398445264 0 0) 0x7fbf18003530 con 0x7fbf301453a0 2023-07-21T22:38:20.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2e7fc640 1 -- 172.21.15.6:0/2203333859 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf3006a440 msgr2=0x7fbf3006c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:20.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2e7fc640 1 --2- 172.21.15.6:0/2203333859 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf3006a440 0x7fbf3006c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2e7fc640 1 -- 172.21.15.6:0/2203333859 >> v2:172.21.15.161:3300/0 conn(0x7fbf3015f690 msgr2=0x7fbf300b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:20.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2e7fc640 1 --2- 172.21.15.6:0/2203333859 >> v2:172.21.15.161:3300/0 conn(0x7fbf3015f690 0x7fbf300b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2e7fc640 1 -- 172.21.15.6:0/2203333859 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf30160360 con 0x7fbf301453a0 2023-07-21T22:38:20.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2e7fc640 1 -- 172.21.15.6:0/2203333859 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fbf24001680 con 0x7fbf301453a0 2023-07-21T22:38:20.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2e7fc640 1 -- 172.21.15.6:0/2203333859 >> v1:172.21.15.6:6789/0 conn(0x7fbf301453a0 legacy=0x7fbf3015fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:20.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2e7fc640 1 --2- 172.21.15.6:0/2203333859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf18003980 0x7fbf18003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:20.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2e7fc640 1 --2- 172.21.15.6:0/2203333859 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf3006a440 0x7fbf180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:20.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2e7fc640 1 --2- 172.21.15.6:0/2203333859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf18004d10 0x7fbf18005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:20.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2e7fc640 1 -- 172.21.15.6:0/2203333859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30160600 con 0x7fbf18003980 2023-07-21T22:38:20.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2e7fc640 1 -- 172.21.15.6:0/2203333859 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1800b9c0 con 0x7fbf18004d10 2023-07-21T22:38:20.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2e7fc640 1 -- 172.21.15.6:0/2203333859 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1800bb80 con 0x7fbf3006a440 2023-07-21T22:38:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2f7fe640 1 --2- 172.21.15.6:0/2203333859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf18003980 0x7fbf18003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2effd640 1 --2- 172.21.15.6:0/2203333859 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf3006a440 0x7fbf180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2ffff640 1 --2- 172.21.15.6:0/2203333859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf18004d10 0x7fbf18005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2f7fe640 1 -- 172.21.15.6:0/2203333859 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf3006a440 msgr2=0x7fbf180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2f7fe640 1 --2- 172.21.15.6:0/2203333859 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf3006a440 0x7fbf180047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2f7fe640 1 -- 172.21.15.6:0/2203333859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf18004d10 msgr2=0x7fbf18005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2f7fe640 1 --2- 172.21.15.6:0/2203333859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf18004d10 0x7fbf18005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2f7fe640 1 -- 172.21.15.6:0/2203333859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf18003530 con 0x7fbf18003980 2023-07-21T22:38:20.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2ffff640 1 --2- 172.21.15.6:0/2203333859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf18004d10 0x7fbf18005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:20.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.636+0000 7fbf2effd640 1 --2- 172.21.15.6:0/2203333859 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf3006a440 0x7fbf180047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:20.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.640+0000 7fbf2f7fe640 1 --2- 172.21.15.6:0/2203333859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf18003980 0x7fbf18003d90 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009ae0 tx=0x7fbf2001ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c87c9fa3ba5f12 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:20.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.640+0000 7fbf2e7fc640 1 -- 172.21.15.6:0/2203333859 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf200a5540 con 0x7fbf18003980 2023-07-21T22:38:20.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.640+0000 7fbf2e7fc640 1 -- 172.21.15.6:0/2203333859 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf200a56a0 con 0x7fbf18003980 2023-07-21T22:38:20.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.640+0000 7fbf2e7fc640 1 -- 172.21.15.6:0/2203333859 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf200a5a50 con 0x7fbf18003980 2023-07-21T22:38:20.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.640+0000 7fbf35c0b640 1 -- 172.21.15.6:0/2203333859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf18003980 msgr2=0x7fbf18003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:20.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.640+0000 7fbf35c0b640 1 --2- 172.21.15.6:0/2203333859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf18003980 0x7fbf18003d90 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fbf20009ae0 tx=0x7fbf2001ca60 comp rx=0 tx=0).stop 2023-07-21T22:38:20.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.640+0000 7fbf2ffff640 1 -- 172.21.15.6:0/2203333859 reap_dead start 2023-07-21T22:38:20.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.640+0000 7fbf35c0b640 1 -- 172.21.15.6:0/2203333859 shutdown_connections 2023-07-21T22:38:20.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.640+0000 7fbf35c0b640 1 -- 172.21.15.6:0/2203333859 >> 172.21.15.6:0/2203333859 conn(0x7fbf300b1210 msgr2=0x7fbf300ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:20.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.640+0000 7fbf35c0b640 1 -- 172.21.15.6:0/2203333859 shutdown_connections 2023-07-21T22:38:20.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.640+0000 7fbf35c0b640 1 -- 172.21.15.6:0/2203333859 wait complete. 2023-07-21T22:38:20.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.640+0000 7fbf35c0b640 1 Processor -- start 2023-07-21T22:38:20.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf35c0b640 1 -- start start 2023-07-21T22:38:20.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf35c0b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf18003980 0x7fbf3013cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:20.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf35c0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf3013d310 0x7fbf3013d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:20.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf35c0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf3015c380 0x7fbf3015c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:20.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf35c0b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30140910 con 0x7fbf3013d310 2023-07-21T22:38:20.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf35c0b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30140bf0 con 0x7fbf18003980 2023-07-21T22:38:20.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf35c0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30140ed0 con 0x7fbf3015c380 2023-07-21T22:38:20.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf2effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf3013d310 0x7fbf3013d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:20.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf2effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf3013d310 0x7fbf3013d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51692/0 (socket says 172.21.15.6:51692) 2023-07-21T22:38:20.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf2effd640 1 -- 172.21.15.6:0/1834909685 learned_addr learned my addr 172.21.15.6:0/1834909685 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:20.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf2f7fe640 1 --2- 172.21.15.6:0/1834909685 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf18003980 0x7fbf3013cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:20.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf2ffff640 1 --2- 172.21.15.6:0/1834909685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf3015c380 0x7fbf3015c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:20.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf2effd640 1 -- 172.21.15.6:0/1834909685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf3015c380 msgr2=0x7fbf3015c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:20.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf2effd640 1 --2- 172.21.15.6:0/1834909685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf3015c380 0x7fbf3015c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf2effd640 1 -- 172.21.15.6:0/1834909685 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf18003980 msgr2=0x7fbf3013cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:20.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf2effd640 1 --2- 172.21.15.6:0/1834909685 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf18003980 0x7fbf3013cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf2effd640 1 -- 172.21.15.6:0/1834909685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf301411b0 con 0x7fbf3013d310 2023-07-21T22:38:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf2effd640 1 --2- 172.21.15.6:0/1834909685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf3013d310 0x7fbf3013d780 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fbf24000fc0 tx=0x7fbf2400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf17fff640 1 -- 172.21.15.6:0/1834909685 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2400c630 con 0x7fbf3013d310 2023-07-21T22:38:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf17fff640 1 -- 172.21.15.6:0/1834909685 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2400c790 con 0x7fbf3013d310 2023-07-21T22:38:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf17fff640 1 -- 172.21.15.6:0/1834909685 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2400cb20 con 0x7fbf3013d310 2023-07-21T22:38:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf35c0b640 1 -- 172.21.15.6:0/1834909685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf30141490 con 0x7fbf3013d310 2023-07-21T22:38:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf35c0b640 1 -- 172.21.15.6:0/1834909685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf3013dfc0 con 0x7fbf3013d310 2023-07-21T22:38:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.644+0000 7fbf35c0b640 1 -- 172.21.15.6:0/1834909685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf300678d0 con 0x7fbf3013d310 2023-07-21T22:38:20.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.648+0000 7fbf17fff640 1 -- 172.21.15.6:0/1834909685 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbf2401d460 con 0x7fbf3013d310 2023-07-21T22:38:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.648+0000 7fbf17fff640 1 --2- 172.21.15.6:0/1834909685 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fbf1c0663a0 0x7fbf1c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.648+0000 7fbf17fff640 1 -- 172.21.15.6:0/1834909685 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5282+0+0 (secure 0 0 0) 0x7fbf24083ba0 con 0x7fbf3013d310 2023-07-21T22:38:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.648+0000 7fbf2f7fe640 1 --2- 172.21.15.6:0/1834909685 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fbf1c0663a0 0x7fbf1c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.648+0000 7fbf2f7fe640 1 --2- 172.21.15.6:0/1834909685 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fbf1c0663a0 0x7fbf1c068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbf200af000 tx=0x7fbf200046d0 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:20.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.652+0000 7fbf17fff640 1 -- 172.21.15.6:0/1834909685 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbf240512b0 con 0x7fbf3013d310 2023-07-21T22:38:20.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.808+0000 7fbf35c0b640 1 -- 172.21.15.6:0/1834909685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbf300aba90 con 0x7fbf3013d310 2023-07-21T22:38:20.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.808+0000 7fbf17fff640 1 -- 172.21.15.6:0/1834909685 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v139) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbf240548d0 con 0x7fbf3013d310 2023-07-21T22:38:20.852 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:38:20.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.808+0000 7fbf35c0b640 1 -- 172.21.15.6:0/1834909685 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fbf1c0663a0 msgr2=0x7fbf1c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:20.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.808+0000 7fbf35c0b640 1 --2- 172.21.15.6:0/1834909685 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fbf1c0663a0 0x7fbf1c068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbf200af000 tx=0x7fbf200046d0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.808+0000 7fbf35c0b640 1 -- 172.21.15.6:0/1834909685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf3013d310 msgr2=0x7fbf3013d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:20.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.808+0000 7fbf35c0b640 1 --2- 172.21.15.6:0/1834909685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf3013d310 0x7fbf3013d780 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fbf24000fc0 tx=0x7fbf2400eb90 comp rx=0 tx=0).stop 2023-07-21T22:38:20.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.808+0000 7fbf35c0b640 1 -- 172.21.15.6:0/1834909685 shutdown_connections 2023-07-21T22:38:20.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.808+0000 7fbf35c0b640 1 --2- 172.21.15.6:0/1834909685 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fbf1c0663a0 0x7fbf1c068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.808+0000 7fbf35c0b640 1 --2- 172.21.15.6:0/1834909685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbf3015c380 0x7fbf3015c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.808+0000 7fbf35c0b640 1 --2- 172.21.15.6:0/1834909685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf3013d310 0x7fbf3013d780 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.808+0000 7fbf35c0b640 1 --2- 172.21.15.6:0/1834909685 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf18003980 0x7fbf3013cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:20.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.808+0000 7fbf35c0b640 1 -- 172.21.15.6:0/1834909685 >> 172.21.15.6:0/1834909685 conn(0x7fbf300b1210 msgr2=0x7fbf301423d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:20.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.808+0000 7fbf35c0b640 1 -- 172.21.15.6:0/1834909685 shutdown_connections 2023-07-21T22:38:20.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.808+0000 7fbf35c0b640 1 -- 172.21.15.6:0/1834909685 wait complete. 2023-07-21T22:38:20.873 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T22:38:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.972+0000 7f45d3d40640 1 Processor -- start 2023-07-21T22:38:21.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.972+0000 7f45d3d40640 1 -- start start 2023-07-21T22:38:21.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.972+0000 7f45d3d40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45cc0ae1f0 0x7f45cc0b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:21.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.972+0000 7f45d3d40640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45cc06c430 0x7f45cc069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:21.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.972+0000 7f45d3d40640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45cc0b24f0 con 0x7f45cc06e160 2023-07-21T22:38:21.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.972+0000 7f45d3d40640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45cc0b27d0 con 0x7f45cc06c430 2023-07-21T22:38:21.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.972+0000 7f45d3d40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc0b2ab0 con 0x7f45cc0ae1f0 2023-07-21T22:38:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.972+0000 7f45d22dd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45cc06c430 0x7f45cc069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.972+0000 7f45d22dd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45cc06c430 0x7f45cc069430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51698/0 (socket says 172.21.15.6:51698) 2023-07-21T22:38:21.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.972+0000 7f45d22dd640 1 -- 172.21.15.6:0/2834693757 learned_addr learned my addr 172.21.15.6:0/2834693757 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.972+0000 7f45d1adc640 1 --2- 172.21.15.6:0/2834693757 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45cc0ae1f0 0x7f45cc0b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.976+0000 7f45d22dd640 1 -- 172.21.15.6:0/2834693757 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45cc0ae1f0 msgr2=0x7f45cc0b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.976+0000 7f45d22dd640 1 --2- 172.21.15.6:0/2834693757 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45cc0ae1f0 0x7f45cc0b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.976+0000 7f45d22dd640 1 -- 172.21.15.6:0/2834693757 >> v1:172.21.15.161:6789/0 conn(0x7f45cc06e160 legacy=0x7f45cc06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.976+0000 7f45d22dd640 1 -- 172.21.15.6:0/2834693757 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45cc0b2d90 con 0x7f45cc06c430 2023-07-21T22:38:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.976+0000 7f45d1adc640 1 --2- 172.21.15.6:0/2834693757 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45cc0ae1f0 0x7f45cc0b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:21.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.976+0000 7f45d0ada640 1 -- 172.21.15.6:0/2834693757 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392396181 0 0) 0x7f45cc0b24f0 con 0x7f45cc06e160 2023-07-21T22:38:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.976+0000 7f45d22dd640 1 --2- 172.21.15.6:0/2834693757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45cc06c430 0x7f45cc069430 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009e50 tx=0x7f45c401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d5733ba1ab781d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:21.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.976+0000 7f45d0ada640 1 -- 172.21.15.6:0/2834693757 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c40a58d0 con 0x7f45cc06c430 2023-07-21T22:38:21.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.976+0000 7f45d0ada640 1 -- 172.21.15.6:0/2834693757 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c40a5a30 con 0x7f45cc06c430 2023-07-21T22:38:21.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.976+0000 7f45d0ada640 1 -- 172.21.15.6:0/2834693757 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c40a5dc0 con 0x7f45cc06c430 2023-07-21T22:38:21.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.976+0000 7f45d3d40640 1 -- 172.21.15.6:0/2834693757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45cc06c430 msgr2=0x7f45cc069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:21.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.976+0000 7f45d3d40640 1 --2- 172.21.15.6:0/2834693757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45cc06c430 0x7f45cc069430 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f45c4009e50 tx=0x7f45c401c9e0 comp rx=0 tx=0).stop 2023-07-21T22:38:21.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.976+0000 7f45d3d40640 1 -- 172.21.15.6:0/2834693757 shutdown_connections 2023-07-21T22:38:21.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.976+0000 7f45d3d40640 1 --2- 172.21.15.6:0/2834693757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45cc06c430 0x7f45cc069430 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:21.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.976+0000 7f45d3d40640 1 --2- 172.21.15.6:0/2834693757 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45cc0ae1f0 0x7f45cc0b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:21.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.976+0000 7f45d3d40640 1 -- 172.21.15.6:0/2834693757 >> 172.21.15.6:0/2834693757 conn(0x7f45cc0b1300 msgr2=0x7f45cc0ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:21.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.976+0000 7f45d3d40640 1 -- 172.21.15.6:0/2834693757 shutdown_connections 2023-07-21T22:38:21.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.976+0000 7f45d3d40640 1 -- 172.21.15.6:0/2834693757 wait complete. 2023-07-21T22:38:21.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d3d40640 1 Processor -- start 2023-07-21T22:38:21.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d3d40640 1 -- start start 2023-07-21T22:38:21.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d3d40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45cc06c430 0x7f45cc15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d3d40640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45cc06e160 0x7f45cc140290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d3d40640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45cc0ae1f0 0x7f45cc0cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d3d40640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc140d90 con 0x7f45cc06e160 2023-07-21T22:38:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d3d40640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc141070 con 0x7f45cc0ae1f0 2023-07-21T22:38:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d3d40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45cc141350 con 0x7f45cc06c430 2023-07-21T22:38:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d12db640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45cc06e160 0x7f45cc140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d12db640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45cc06e160 0x7f45cc140290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51702/0 (socket says 172.21.15.6:51702) 2023-07-21T22:38:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d12db640 1 -- 172.21.15.6:0/1633974041 learned_addr learned my addr 172.21.15.6:0/1633974041 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d1adc640 1 --2- 172.21.15.6:0/1633974041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45cc06c430 0x7f45cc15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d22dd640 1 --2- 172.21.15.6:0/1633974041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45cc0ae1f0 0x7f45cc0cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d12db640 1 -- 172.21.15.6:0/1633974041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45cc06c430 msgr2=0x7f45cc15ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d12db640 1 --2- 172.21.15.6:0/1633974041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45cc06c430 0x7f45cc15ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d12db640 1 -- 172.21.15.6:0/1633974041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45cc0ae1f0 msgr2=0x7f45cc0cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d12db640 1 --2- 172.21.15.6:0/1633974041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45cc0ae1f0 0x7f45cc0cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d12db640 1 -- 172.21.15.6:0/1633974041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c8009420 con 0x7f45cc06e160 2023-07-21T22:38:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d12db640 1 --2- 172.21.15.6:0/1633974041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45cc06e160 0x7f45cc140290 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00c4d0 tx=0x7f45bc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:21.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45c27fc640 1 -- 172.21.15.6:0/1633974041 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc005480 con 0x7f45cc06e160 2023-07-21T22:38:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45c27fc640 1 -- 172.21.15.6:0/1633974041 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc003600 con 0x7f45cc06e160 2023-07-21T22:38:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45c27fc640 1 -- 172.21.15.6:0/1633974041 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc0039b0 con 0x7f45cc06e160 2023-07-21T22:38:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d3d40640 1 -- 172.21.15.6:0/1633974041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c4009b30 con 0x7f45cc06e160 2023-07-21T22:38:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.980+0000 7f45d3d40640 1 -- 172.21.15.6:0/1633974041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45cc0b3710 con 0x7f45cc06e160 2023-07-21T22:38:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.984+0000 7f45d3d40640 1 -- 172.21.15.6:0/1633974041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45cc0678d0 con 0x7f45cc06e160 2023-07-21T22:38:21.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.984+0000 7f45c27fc640 1 -- 172.21.15.6:0/1633974041 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f45bc003b10 con 0x7f45cc06e160 2023-07-21T22:38:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.984+0000 7f45c27fc640 1 --2- 172.21.15.6:0/1633974041 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f45b00663a0 0x7f45b0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.984+0000 7f45c27fc640 1 -- 172.21.15.6:0/1633974041 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f45bc083210 con 0x7f45cc06e160 2023-07-21T22:38:21.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.984+0000 7f45d1adc640 1 --2- 172.21.15.6:0/1633974041 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f45b00663a0 0x7f45b0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:21.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.988+0000 7f45d1adc640 1 --2- 172.21.15.6:0/1633974041 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f45b00663a0 0x7f45b0068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f45c8009be0 tx=0x7f45c8008040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:21.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:20.988+0000 7f45c27fc640 1 -- 172.21.15.6:0/1633974041 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f45bc054330 con 0x7f45cc06e160 2023-07-21T22:38:21.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.152+0000 7f45d3d40640 1 -- 172.21.15.6:0/1633974041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f45cc066810 con 0x7f45cc06e160 2023-07-21T22:38:21.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.152+0000 7f45c27fc640 1 -- 172.21.15.6:0/1633974041 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v139) v1 ==== 84+0+126 (secure 0 0 0) 0x7f45bc017090 con 0x7f45cc06e160 2023-07-21T22:38:21.199 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:21.199 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:38:21.199 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:21.199 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-07-21T22:38:21.199 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-07-21T22:38:21.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:21.200 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:21.200 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-07-21T22:38:21.200 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-07-21T22:38:21.200 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:21.200 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:38:21.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.156+0000 7f45d3d40640 1 -- 172.21.15.6:0/1633974041 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f45b00663a0 msgr2=0x7f45b0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:21.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.156+0000 7f45d3d40640 1 --2- 172.21.15.6:0/1633974041 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f45b00663a0 0x7f45b0068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f45c8009be0 tx=0x7f45c8008040 comp rx=0 tx=0).stop 2023-07-21T22:38:21.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.156+0000 7f45d3d40640 1 -- 172.21.15.6:0/1633974041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45cc06e160 msgr2=0x7f45cc140290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:21.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.156+0000 7f45d3d40640 1 --2- 172.21.15.6:0/1633974041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45cc06e160 0x7f45cc140290 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f45bc00c4d0 tx=0x7f45bc00c990 comp rx=0 tx=0).stop 2023-07-21T22:38:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.156+0000 7f45d3d40640 1 -- 172.21.15.6:0/1633974041 shutdown_connections 2023-07-21T22:38:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.156+0000 7f45d3d40640 1 --2- 172.21.15.6:0/1633974041 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f45b00663a0 0x7f45b0068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.156+0000 7f45d3d40640 1 --2- 172.21.15.6:0/1633974041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45cc0ae1f0 0x7f45cc0cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.156+0000 7f45d3d40640 1 --2- 172.21.15.6:0/1633974041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45cc06e160 0x7f45cc140290 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.156+0000 7f45d3d40640 1 --2- 172.21.15.6:0/1633974041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45cc06c430 0x7f45cc15ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.156+0000 7f45d3d40640 1 -- 172.21.15.6:0/1633974041 >> 172.21.15.6:0/1633974041 conn(0x7f45cc0b1300 msgr2=0x7f45cc0acde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.156+0000 7f45d3d40640 1 -- 172.21.15.6:0/1633974041 shutdown_connections 2023-07-21T22:38:21.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.156+0000 7f45d3d40640 1 -- 172.21.15.6:0/1633974041 wait complete. 2023-07-21T22:38:21.219 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-21T22:38:21.220 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-21T22:38:21.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.324+0000 7f08c56ca640 1 Processor -- start 2023-07-21T22:38:21.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.324+0000 7f08c56ca640 1 -- start start 2023-07-21T22:38:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.324+0000 7f08c56ca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f08c0159780 0x7f08c00c9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:21.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.324+0000 7f08c56ca640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f08c00aff10 0x7f08c00c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.324+0000 7f08c56ca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c00ca400 con 0x7f08c00c9ea0 2023-07-21T22:38:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.324+0000 7f08c56ca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c0070380 con 0x7f08c0159780 2023-07-21T22:38:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.324+0000 7f08c56ca640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c0070660 con 0x7f08c00aff10 2023-07-21T22:38:21.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.324+0000 7f08bffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f08c0159780 0x7f08c00c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.324+0000 7f08bffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f08c0159780 0x7f08c00c9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51716/0 (socket says 172.21.15.6:51716) 2023-07-21T22:38:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.324+0000 7f08bffff640 1 -- 172.21.15.6:0/2852358328 learned_addr learned my addr 172.21.15.6:0/2852358328 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.324+0000 7f08bf7fe640 1 --1- 172.21.15.6:0/2852358328 >> v1:172.21.15.6:6789/0 conn(0x7f08c00c9ea0 0x7f08c00af800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47596/0 (socket says 172.21.15.6:47596) 2023-07-21T22:38:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.324+0000 7f08c4ec9640 1 --2- 172.21.15.6:0/2852358328 >> v2:172.21.15.161:3300/0 conn(0x7f08c00aff10 0x7f08c00c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:21.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.324+0000 7f08bffff640 1 -- 172.21.15.6:0/2852358328 >> v2:172.21.15.161:3300/0 conn(0x7f08c00aff10 msgr2=0x7f08c00c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:21.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.324+0000 7f08bffff640 1 --2- 172.21.15.6:0/2852358328 >> v2:172.21.15.161:3300/0 conn(0x7f08c00aff10 0x7f08c00c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:21.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.324+0000 7f08bffff640 1 -- 172.21.15.6:0/2852358328 >> v1:172.21.15.6:6789/0 conn(0x7f08c00c9ea0 legacy=0x7f08c00af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:21.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.324+0000 7f08bffff640 1 -- 172.21.15.6:0/2852358328 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c0070940 con 0x7f08c0159780 2023-07-21T22:38:21.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.324+0000 7f08beffd640 1 -- 172.21.15.6:0/2852358328 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022882047 0 0) 0x7f08c00ca400 con 0x7f08c00c9ea0 2023-07-21T22:38:21.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.328+0000 7f08bffff640 1 --2- 172.21.15.6:0/2852358328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08c0159780 0x7f08c00c9960 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f08c00cb450 tx=0x7f08b001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8021f46b69e5b6e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:21.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.328+0000 7f08beffd640 1 -- 172.21.15.6:0/2852358328 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b00aa650 con 0x7f08c0159780 2023-07-21T22:38:21.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.328+0000 7f08beffd640 1 -- 172.21.15.6:0/2852358328 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b00aa7b0 con 0x7f08c0159780 2023-07-21T22:38:21.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.328+0000 7f08beffd640 1 -- 172.21.15.6:0/2852358328 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b00aab40 con 0x7f08c0159780 2023-07-21T22:38:21.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.328+0000 7f08c56ca640 1 -- 172.21.15.6:0/2852358328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08c0159780 msgr2=0x7f08c00c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:21.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.328+0000 7f08c56ca640 1 --2- 172.21.15.6:0/2852358328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08c0159780 0x7f08c00c9960 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f08c00cb450 tx=0x7f08b001c4d0 comp rx=0 tx=0).stop 2023-07-21T22:38:21.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.328+0000 7f08c56ca640 1 -- 172.21.15.6:0/2852358328 shutdown_connections 2023-07-21T22:38:21.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.328+0000 7f08c56ca640 1 --2- 172.21.15.6:0/2852358328 >> v2:172.21.15.161:3300/0 conn(0x7f08c00aff10 0x7f08c00c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:21.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.328+0000 7f08c56ca640 1 --2- 172.21.15.6:0/2852358328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08c0159780 0x7f08c00c9960 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:21.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.328+0000 7f08c56ca640 1 -- 172.21.15.6:0/2852358328 >> 172.21.15.6:0/2852358328 conn(0x7f08c00ca800 msgr2=0x7f08c00cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:21.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.328+0000 7f08c56ca640 1 -- 172.21.15.6:0/2852358328 shutdown_connections 2023-07-21T22:38:21.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.328+0000 7f08c56ca640 1 -- 172.21.15.6:0/2852358328 wait complete. 2023-07-21T22:38:21.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.328+0000 7f08c56ca640 1 Processor -- start 2023-07-21T22:38:21.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.328+0000 7f08c56ca640 1 -- start start 2023-07-21T22:38:21.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08c56ca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08c00aff10 0x7f08c00ce830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:21.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08c56ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08c00c9ea0 0x7f08c00c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:21.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08c56ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08c0159780 0x7f08c013f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:21.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08c56ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c0141370 con 0x7f08c0159780 2023-07-21T22:38:21.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08c56ca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c00a7810 con 0x7f08c00aff10 2023-07-21T22:38:21.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08c56ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c00a7530 con 0x7f08c00c9ea0 2023-07-21T22:38:21.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08c4ec9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08c0159780 0x7f08c013f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:21.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08c4ec9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08c0159780 0x7f08c013f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51720/0 (socket says 172.21.15.6:51720) 2023-07-21T22:38:21.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08c4ec9640 1 -- 172.21.15.6:0/2431955924 learned_addr learned my addr 172.21.15.6:0/2431955924 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:21.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08bffff640 1 --2- 172.21.15.6:0/2431955924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08c00aff10 0x7f08c00ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:21.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08bf7fe640 1 --2- 172.21.15.6:0/2431955924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08c00c9ea0 0x7f08c00c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:21.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08c4ec9640 1 -- 172.21.15.6:0/2431955924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08c00c9ea0 msgr2=0x7f08c00c3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08c4ec9640 1 --2- 172.21.15.6:0/2431955924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08c00c9ea0 0x7f08c00c3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08c4ec9640 1 -- 172.21.15.6:0/2431955924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08c00aff10 msgr2=0x7f08c00ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08c4ec9640 1 --2- 172.21.15.6:0/2431955924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08c00aff10 0x7f08c00ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08c4ec9640 1 -- 172.21.15.6:0/2431955924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b00094d0 con 0x7f08c0159780 2023-07-21T22:38:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08c4ec9640 1 --2- 172.21.15.6:0/2431955924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08c0159780 0x7f08c013f950 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f08b8007e60 tx=0x7f08b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08bcff9640 1 -- 172.21.15.6:0/2431955924 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8014420 con 0x7f08c0159780 2023-07-21T22:38:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08bcff9640 1 -- 172.21.15.6:0/2431955924 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b80145a0 con 0x7f08c0159780 2023-07-21T22:38:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08bcff9640 1 -- 172.21.15.6:0/2431955924 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8014950 con 0x7f08c0159780 2023-07-21T22:38:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08c56ca640 1 -- 172.21.15.6:0/2431955924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c00712c0 con 0x7f08c0159780 2023-07-21T22:38:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08c56ca640 1 -- 172.21.15.6:0/2431955924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c00c8560 con 0x7f08c0159780 2023-07-21T22:38:21.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.332+0000 7f08c56ca640 1 -- 172.21.15.6:0/2431955924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c0141520 con 0x7f08c0159780 2023-07-21T22:38:21.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.336+0000 7f08bcff9640 1 -- 172.21.15.6:0/2431955924 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f08b8014ab0 con 0x7f08c0159780 2023-07-21T22:38:21.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.336+0000 7f08bcff9640 1 --2- 172.21.15.6:0/2431955924 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f08ac0663a0 0x7f08ac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:21.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.336+0000 7f08bcff9640 1 -- 172.21.15.6:0/2431955924 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f08b8084430 con 0x7f08c0159780 2023-07-21T22:38:21.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.336+0000 7f08bffff640 1 --2- 172.21.15.6:0/2431955924 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f08ac0663a0 0x7f08ac068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:21.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.336+0000 7f08bffff640 1 --2- 172.21.15.6:0/2431955924 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f08ac0663a0 0x7f08ac068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f08b00ae000 tx=0x7f08b00b5040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:21.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.340+0000 7f08bcff9640 1 -- 172.21.15.6:0/2431955924 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f08c0141520 con 0x7f08c0159780 2023-07-21T22:38:21.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:21.496+0000 7f08c56ca640 1 -- 172.21.15.6:0/2431955924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f08c004e020 con 0x7f08c0159780 2023-07-21T22:38:22.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.044+0000 7f08bcff9640 1 -- 172.21.15.6:0/2431955924 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v140) v1 ==== 138+0+0 (secure 0 0 0) 0x7f08b8055540 con 0x7f08c0159780 2023-07-21T22:38:22.088 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-07-21T22:38:22.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.044+0000 7f08c56ca640 1 -- 172.21.15.6:0/2431955924 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f08ac0663a0 msgr2=0x7f08ac068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:22.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.044+0000 7f08c56ca640 1 --2- 172.21.15.6:0/2431955924 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f08ac0663a0 0x7f08ac068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f08b00ae000 tx=0x7f08b00b5040 comp rx=0 tx=0).stop 2023-07-21T22:38:22.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.044+0000 7f08c56ca640 1 -- 172.21.15.6:0/2431955924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08c0159780 msgr2=0x7f08c013f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:22.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.044+0000 7f08c56ca640 1 --2- 172.21.15.6:0/2431955924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08c0159780 0x7f08c013f950 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f08b8007e60 tx=0x7f08b800e4b0 comp rx=0 tx=0).stop 2023-07-21T22:38:22.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.048+0000 7f08c56ca640 1 -- 172.21.15.6:0/2431955924 shutdown_connections 2023-07-21T22:38:22.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.048+0000 7f08c56ca640 1 --2- 172.21.15.6:0/2431955924 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f08ac0663a0 0x7f08ac068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:22.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.048+0000 7f08c56ca640 1 --2- 172.21.15.6:0/2431955924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08c0159780 0x7f08c013f950 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:22.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.048+0000 7f08c56ca640 1 --2- 172.21.15.6:0/2431955924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f08c00c9ea0 0x7f08c00c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:22.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.048+0000 7f08c56ca640 1 --2- 172.21.15.6:0/2431955924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f08c00aff10 0x7f08c00ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:22.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.048+0000 7f08c56ca640 1 -- 172.21.15.6:0/2431955924 >> 172.21.15.6:0/2431955924 conn(0x7f08c00ca800 msgr2=0x7f08c00cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:22.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.048+0000 7f08c56ca640 1 -- 172.21.15.6:0/2431955924 shutdown_connections 2023-07-21T22:38:22.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.048+0000 7f08c56ca640 1 -- 172.21.15.6:0/2431955924 wait complete. 2023-07-21T22:38:22.116 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T22:38:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.224+0000 7fafe9196640 1 Processor -- start 2023-07-21T22:38:22.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.224+0000 7fafe9196640 1 -- start start 2023-07-21T22:38:22.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.224+0000 7fafe9196640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fafe40cb360 0x7fafe415df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:22.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.224+0000 7fafe9196640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fafe40b38d0 0x7fafe4070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.224+0000 7fafe9196640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe40cc900 con 0x7fafe40cd490 2023-07-21T22:38:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.224+0000 7fafe9196640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe40ccbe0 con 0x7fafe40cb360 2023-07-21T22:38:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.224+0000 7fafe9196640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe415d780 con 0x7fafe40b38d0 2023-07-21T22:38:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.224+0000 7fafe2d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fafe40cb360 0x7fafe415df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.224+0000 7fafe2d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fafe40cb360 0x7fafe415df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51724/0 (socket says 172.21.15.6:51724) 2023-07-21T22:38:22.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.224+0000 7fafe2d9d640 1 -- 172.21.15.6:0/3902593014 learned_addr learned my addr 172.21.15.6:0/3902593014 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.224+0000 7fafdbfff640 1 --2- 172.21.15.6:0/3902593014 >> v2:172.21.15.161:3300/0 conn(0x7fafe40b38d0 0x7fafe4070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.224+0000 7fafe2d9d640 1 -- 172.21.15.6:0/3902593014 >> v2:172.21.15.161:3300/0 conn(0x7fafe40b38d0 msgr2=0x7fafe4070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:22.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.224+0000 7fafe2d9d640 1 --2- 172.21.15.6:0/3902593014 >> v2:172.21.15.161:3300/0 conn(0x7fafe40b38d0 0x7fafe4070920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.224+0000 7fafe2d9d640 1 -- 172.21.15.6:0/3902593014 >> v1:172.21.15.161:6789/0 conn(0x7fafe40cd490 legacy=0x7fafe40c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:22.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.224+0000 7fafe2d9d640 1 -- 172.21.15.6:0/3902593014 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe415da60 con 0x7fafe40cb360 2023-07-21T22:38:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.228+0000 7fafe2d9d640 1 --2- 172.21.15.6:0/3902593014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafe40cb360 0x7fafe415df80 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fafe40cefd0 tx=0x7fafd401ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1a13d637b4543c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.228+0000 7fafe259c640 1 -- 172.21.15.6:0/3902593014 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd40ab600 con 0x7fafe40cb360 2023-07-21T22:38:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.228+0000 7fafe259c640 1 -- 172.21.15.6:0/3902593014 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd40ab760 con 0x7fafe40cb360 2023-07-21T22:38:22.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.228+0000 7fafe259c640 1 -- 172.21.15.6:0/3902593014 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd40abaf0 con 0x7fafe40cb360 2023-07-21T22:38:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.228+0000 7fafe9196640 1 -- 172.21.15.6:0/3902593014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafe40cb360 msgr2=0x7fafe415df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.228+0000 7fafe9196640 1 --2- 172.21.15.6:0/3902593014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafe40cb360 0x7fafe415df80 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fafe40cefd0 tx=0x7fafd401ce00 comp rx=0 tx=0).stop 2023-07-21T22:38:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.228+0000 7fafe9196640 1 -- 172.21.15.6:0/3902593014 shutdown_connections 2023-07-21T22:38:22.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.228+0000 7fafe9196640 1 --2- 172.21.15.6:0/3902593014 >> v2:172.21.15.161:3300/0 conn(0x7fafe40b38d0 0x7fafe4070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:22.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.228+0000 7fafe9196640 1 --2- 172.21.15.6:0/3902593014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafe40cb360 0x7fafe415df80 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:22.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.228+0000 7fafe9196640 1 -- 172.21.15.6:0/3902593014 >> 172.21.15.6:0/3902593014 conn(0x7fafe40afac0 msgr2=0x7fafe40afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:22.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.228+0000 7fafe9196640 1 -- 172.21.15.6:0/3902593014 shutdown_connections 2023-07-21T22:38:22.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.228+0000 7fafe9196640 1 -- 172.21.15.6:0/3902593014 wait complete. 2023-07-21T22:38:22.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe9196640 1 Processor -- start 2023-07-21T22:38:22.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe9196640 1 -- start start 2023-07-21T22:38:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe9196640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafe40b38d0 0x7fafe4156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:22.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe9196640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafe40cb360 0x7fafe406cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe9196640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafe40cd490 0x7fafe414c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe9196640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe406cd00 con 0x7fafe40b38d0 2023-07-21T22:38:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe9196640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe406d420 con 0x7fafe40cd490 2023-07-21T22:38:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe9196640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe4158950 con 0x7fafe40cb360 2023-07-21T22:38:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafe40b38d0 0x7fafe4156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:22.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe2d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafe40b38d0 0x7fafe4156f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51726/0 (socket says 172.21.15.6:51726) 2023-07-21T22:38:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe2d9d640 1 -- 172.21.15.6:0/1015201110 learned_addr learned my addr 172.21.15.6:0/1015201110 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafdbfff640 1 --2- 172.21.15.6:0/1015201110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafe40cb360 0x7fafe406cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe2d9d640 1 -- 172.21.15.6:0/1015201110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafe40cb360 msgr2=0x7fafe406cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe2d9d640 1 --2- 172.21.15.6:0/1015201110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafe40cb360 0x7fafe406cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe2d9d640 1 -- 172.21.15.6:0/1015201110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafe40cd490 msgr2=0x7fafe414c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe359e640 1 --2- 172.21.15.6:0/1015201110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafe40cd490 0x7fafe414c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:22.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe2d9d640 1 --2- 172.21.15.6:0/1015201110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafe40cd490 0x7fafe414c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:22.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe2d9d640 1 -- 172.21.15.6:0/1015201110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd40094d0 con 0x7fafe40b38d0 2023-07-21T22:38:22.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafdbfff640 1 --2- 172.21.15.6:0/1015201110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafe40cb360 0x7fafe406cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:22.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe359e640 1 --2- 172.21.15.6:0/1015201110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafe40cd490 0x7fafe414c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:22.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe2d9d640 1 --2- 172.21.15.6:0/1015201110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafe40b38d0 0x7fafe4156f00 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fafd4018fb0 tx=0x7fafd401abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafdb7fe640 1 -- 172.21.15.6:0/1015201110 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd40b4800 con 0x7fafe40b38d0 2023-07-21T22:38:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafdb7fe640 1 -- 172.21.15.6:0/1015201110 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd40b4980 con 0x7fafe40b38d0 2023-07-21T22:38:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafdb7fe640 1 -- 172.21.15.6:0/1015201110 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd40b4d30 con 0x7fafe40b38d0 2023-07-21T22:38:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe9196640 1 -- 172.21.15.6:0/1015201110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe4158c30 con 0x7fafe40b38d0 2023-07-21T22:38:22.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.232+0000 7fafe9196640 1 -- 172.21.15.6:0/1015201110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe41f8070 con 0x7fafe40b38d0 2023-07-21T22:38:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.236+0000 7fafe9196640 1 -- 172.21.15.6:0/1015201110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe40678d0 con 0x7fafe40b38d0 2023-07-21T22:38:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.236+0000 7fafdb7fe640 1 -- 172.21.15.6:0/1015201110 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fafd40c7440 con 0x7fafe40b38d0 2023-07-21T22:38:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.236+0000 7fafdb7fe640 1 --2- 172.21.15.6:0/1015201110 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fafc40663d0 0x7fafc4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.236+0000 7fafdb7fe640 1 -- 172.21.15.6:0/1015201110 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5652+0+0 (secure 0 0 0) 0x7fafd411e830 con 0x7fafe40b38d0 2023-07-21T22:38:22.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.236+0000 7fafdbfff640 1 --2- 172.21.15.6:0/1015201110 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fafc40663d0 0x7fafc4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:22.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.236+0000 7fafdbfff640 1 --2- 172.21.15.6:0/1015201110 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fafc40663d0 0x7fafc4068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fafe4151490 tx=0x7fafcc008040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:22.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.240+0000 7fafdb7fe640 1 -- 172.21.15.6:0/1015201110 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fafd40ebb80 con 0x7fafe40b38d0 2023-07-21T22:38:22.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:22.396+0000 7fafe9196640 1 -- 172.21.15.6:0/1015201110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fafe40cd270 con 0x7fafe40b38d0 2023-07-21T22:38:23.092 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-07-21T22:38:23.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.048+0000 7fafdb7fe640 1 -- 172.21.15.6:0/1015201110 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v141) v1 ==== 170+0+0 (secure 0 0 0) 0x7fafd40ef1a0 con 0x7fafe40b38d0 2023-07-21T22:38:23.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.052+0000 7fafe9196640 1 -- 172.21.15.6:0/1015201110 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fafc40663d0 msgr2=0x7fafc4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:23.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.052+0000 7fafe9196640 1 --2- 172.21.15.6:0/1015201110 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fafc40663d0 0x7fafc4068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fafe4151490 tx=0x7fafcc008040 comp rx=0 tx=0).stop 2023-07-21T22:38:23.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.052+0000 7fafe9196640 1 -- 172.21.15.6:0/1015201110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafe40b38d0 msgr2=0x7fafe4156f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:23.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.052+0000 7fafe9196640 1 --2- 172.21.15.6:0/1015201110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafe40b38d0 0x7fafe4156f00 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fafd4018fb0 tx=0x7fafd401abe0 comp rx=0 tx=0).stop 2023-07-21T22:38:23.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.052+0000 7fafe9196640 1 -- 172.21.15.6:0/1015201110 shutdown_connections 2023-07-21T22:38:23.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.052+0000 7fafe9196640 1 --2- 172.21.15.6:0/1015201110 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fafc40663d0 0x7fafc4068880 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:23.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.052+0000 7fafe9196640 1 --2- 172.21.15.6:0/1015201110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafe40cd490 0x7fafe414c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:23.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.052+0000 7fafe9196640 1 --2- 172.21.15.6:0/1015201110 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fafe40cb360 0x7fafe406cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:23.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.052+0000 7fafe9196640 1 --2- 172.21.15.6:0/1015201110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafe40b38d0 0x7fafe4156f00 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:23.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.052+0000 7fafe9196640 1 -- 172.21.15.6:0/1015201110 >> 172.21.15.6:0/1015201110 conn(0x7fafe40afac0 msgr2=0x7fafe415cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:23.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.056+0000 7fafe9196640 1 -- 172.21.15.6:0/1015201110 shutdown_connections 2023-07-21T22:38:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.056+0000 7fafe9196640 1 -- 172.21.15.6:0/1015201110 wait complete. 2023-07-21T22:38:23.134 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-21T22:38:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.236+0000 7f80bc693640 1 Processor -- start 2023-07-21T22:38:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.236+0000 7f80bc693640 1 -- start start 2023-07-21T22:38:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.236+0000 7f80bc693640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80b40d2fc0 0x7f80b40b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.236+0000 7f80bc693640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b40b04c0 con 0x7f80b40d2300 2023-07-21T22:38:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.236+0000 7f80bc693640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b40d0aa0 con 0x7f80b415bde0 2023-07-21T22:38:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.236+0000 7f80bc693640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b415c1b0 con 0x7f80b40d2fc0 2023-07-21T22:38:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.236+0000 7f80bac30640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f80b40d2300 0x7f80b40cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47610/0 (socket says 172.21.15.6:47610) 2023-07-21T22:38:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.236+0000 7f80bac30640 1 -- 172.21.15.6:0/3173558294 learned_addr learned my addr 172.21.15.6:0/3173558294 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.236+0000 7f80b9c2e640 1 --2- 172.21.15.6:0/3173558294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80b40d2fc0 0x7f80b40b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.236+0000 7f80b942d640 1 -- 172.21.15.6:0/3173558294 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527738956 0 0) 0x7f80b40b04c0 con 0x7f80b40d2300 2023-07-21T22:38:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.236+0000 7f80b942d640 1 -- 172.21.15.6:0/3173558294 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80a0003530 con 0x7f80b40d2300 2023-07-21T22:38:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.236+0000 7f80b942d640 1 -- 172.21.15.6:0/3173558294 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3385496620 0 0) 0x7f80b40d0aa0 con 0x7f80b415bde0 2023-07-21T22:38:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.236+0000 7f80b942d640 1 -- 172.21.15.6:0/3173558294 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80b40b04c0 con 0x7f80b415bde0 2023-07-21T22:38:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.236+0000 7f80b9c2e640 1 -- 172.21.15.6:0/3173558294 >> v1:172.21.15.161:6789/0 conn(0x7f80b415bde0 legacy=0x7f80b40d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:23.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.236+0000 7f80b9c2e640 1 -- 172.21.15.6:0/3173558294 >> v1:172.21.15.6:6789/0 conn(0x7f80b40d2300 legacy=0x7f80b40cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:23.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.236+0000 7f80b9c2e640 1 -- 172.21.15.6:0/3173558294 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b40afb90 con 0x7f80b40d2fc0 2023-07-21T22:38:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.240+0000 7f80b9c2e640 1 --2- 172.21.15.6:0/3173558294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80b40d2fc0 0x7f80b40b0950 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f80a40097f0 tx=0x7f80a401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a15e42ffe18acf11 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.240+0000 7f80b942d640 1 -- 172.21.15.6:0/3173558294 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a40aa620 con 0x7f80b40d2fc0 2023-07-21T22:38:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.240+0000 7f80b942d640 1 -- 172.21.15.6:0/3173558294 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a40aa780 con 0x7f80b40d2fc0 2023-07-21T22:38:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.240+0000 7f80b942d640 1 -- 172.21.15.6:0/3173558294 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a40aaaf0 con 0x7f80b40d2fc0 2023-07-21T22:38:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.240+0000 7f80bc693640 1 -- 172.21.15.6:0/3173558294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80b40d2fc0 msgr2=0x7f80b40b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.240+0000 7f80bc693640 1 --2- 172.21.15.6:0/3173558294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80b40d2fc0 0x7f80b40b0950 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f80a40097f0 tx=0x7f80a401c4c0 comp rx=0 tx=0).stop 2023-07-21T22:38:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bc693640 1 -- 172.21.15.6:0/3173558294 shutdown_connections 2023-07-21T22:38:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bc693640 1 --2- 172.21.15.6:0/3173558294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80b40d2fc0 0x7f80b40b0950 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bc693640 1 -- 172.21.15.6:0/3173558294 >> 172.21.15.6:0/3173558294 conn(0x7f80b40659d0 msgr2=0x7f80b409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bc693640 1 -- 172.21.15.6:0/3173558294 shutdown_connections 2023-07-21T22:38:23.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bc693640 1 -- 172.21.15.6:0/3173558294 wait complete. 2023-07-21T22:38:23.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bc693640 1 Processor -- start 2023-07-21T22:38:23.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bc693640 1 -- start start 2023-07-21T22:38:23.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bc693640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80b40d2300 0x7f80b414fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:23.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bc693640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80b40d2fc0 0x7f80b40b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:23.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bc693640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80b415bde0 0x7f80b415e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:23.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bc693640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b40c6b50 con 0x7f80b415bde0 2023-07-21T22:38:23.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bc693640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b40c5f40 con 0x7f80b40d2fc0 2023-07-21T22:38:23.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bc693640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b40c6220 con 0x7f80b40d2300 2023-07-21T22:38:23.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bac30640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80b415bde0 0x7f80b415e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:23.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bac30640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80b415bde0 0x7f80b415e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51742/0 (socket says 172.21.15.6:51742) 2023-07-21T22:38:23.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bac30640 1 -- 172.21.15.6:0/472808685 learned_addr learned my addr 172.21.15.6:0/472808685 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:23.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80ba42f640 1 --2- 172.21.15.6:0/472808685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80b40d2300 0x7f80b414fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:23.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bac30640 1 -- 172.21.15.6:0/472808685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80b40d2300 msgr2=0x7f80b414fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:23.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80b9c2e640 1 --2- 172.21.15.6:0/472808685 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80b40d2fc0 0x7f80b40b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:23.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bac30640 1 --2- 172.21.15.6:0/472808685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80b40d2300 0x7f80b414fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:23.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bac30640 1 -- 172.21.15.6:0/472808685 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80b40d2fc0 msgr2=0x7f80b40b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:23.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bac30640 1 --2- 172.21.15.6:0/472808685 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80b40d2fc0 0x7f80b40b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:23.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bac30640 1 -- 172.21.15.6:0/472808685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a4009420 con 0x7f80b415bde0 2023-07-21T22:38:23.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80ba42f640 1 --2- 172.21.15.6:0/472808685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80b40d2300 0x7f80b414fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:23.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80b9c2e640 1 --2- 172.21.15.6:0/472808685 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80b40d2fc0 0x7f80b40b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:23.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80bac30640 1 --2- 172.21.15.6:0/472808685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80b415bde0 0x7f80b415e0b0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00cb10 tx=0x7f80ac00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:23.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.244+0000 7f80aaffd640 1 -- 172.21.15.6:0/472808685 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac00ac70 con 0x7f80b415bde0 2023-07-21T22:38:23.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.248+0000 7f80aaffd640 1 -- 172.21.15.6:0/472808685 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac00add0 con 0x7f80b415bde0 2023-07-21T22:38:23.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.248+0000 7f80bc693640 1 -- 172.21.15.6:0/472808685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b40c6500 con 0x7f80b415bde0 2023-07-21T22:38:23.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.248+0000 7f80aaffd640 1 -- 172.21.15.6:0/472808685 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac012600 con 0x7f80b415bde0 2023-07-21T22:38:23.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.248+0000 7f80bc693640 1 -- 172.21.15.6:0/472808685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b414ffc0 con 0x7f80b415bde0 2023-07-21T22:38:23.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.248+0000 7f80bc693640 1 -- 172.21.15.6:0/472808685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b40c6cc0 con 0x7f80b415bde0 2023-07-21T22:38:23.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.248+0000 7f80aaffd640 1 -- 172.21.15.6:0/472808685 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f80ac007070 con 0x7f80b415bde0 2023-07-21T22:38:23.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.248+0000 7f80aaffd640 1 --2- 172.21.15.6:0/472808685 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f80980663a0 0x7f8098068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:23.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.248+0000 7f80aaffd640 1 -- 172.21.15.6:0/472808685 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f80ac084220 con 0x7f80b415bde0 2023-07-21T22:38:23.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.248+0000 7f80ba42f640 1 --2- 172.21.15.6:0/472808685 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f80980663a0 0x7f8098068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:23.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.252+0000 7f80ba42f640 1 --2- 172.21.15.6:0/472808685 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f80980663a0 0x7f8098068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f80b0000fc0 tx=0x7f80b0009040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:23.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.252+0000 7f80aaffd640 1 -- 172.21.15.6:0/472808685 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f80ac051630 con 0x7f80b415bde0 2023-07-21T22:38:23.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:23.440+0000 7f80bc693640 1 -- 172.21.15.6:0/472808685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f80b40678d0 con 0x7f80b415bde0 2023-07-21T22:38:24.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.092+0000 7f80aaffd640 1 -- 172.21.15.6:0/472808685 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v58) v1 ==== 174+0+0 (secure 0 0 0) 0x7f80ac054c50 con 0x7f80b415bde0 2023-07-21T22:38:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 17 and data pool 18 2023-07-21T22:38:24.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.096+0000 7f80bc693640 1 -- 172.21.15.6:0/472808685 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f80980663a0 msgr2=0x7f8098068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:24.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.096+0000 7f80bc693640 1 --2- 172.21.15.6:0/472808685 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f80980663a0 0x7f8098068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f80b0000fc0 tx=0x7f80b0009040 comp rx=0 tx=0).stop 2023-07-21T22:38:24.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.096+0000 7f80bc693640 1 -- 172.21.15.6:0/472808685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80b415bde0 msgr2=0x7f80b415e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:24.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.096+0000 7f80bc693640 1 --2- 172.21.15.6:0/472808685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80b415bde0 0x7f80b415e0b0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00cb10 tx=0x7f80ac00a060 comp rx=0 tx=0).stop 2023-07-21T22:38:24.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.096+0000 7f80bc693640 1 -- 172.21.15.6:0/472808685 shutdown_connections 2023-07-21T22:38:24.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.096+0000 7f80bc693640 1 --2- 172.21.15.6:0/472808685 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f80980663a0 0x7f8098068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.096+0000 7f80bc693640 1 --2- 172.21.15.6:0/472808685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80b415bde0 0x7f80b415e0b0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.096+0000 7f80bc693640 1 --2- 172.21.15.6:0/472808685 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f80b40d2fc0 0x7f80b40b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.096+0000 7f80bc693640 1 --2- 172.21.15.6:0/472808685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f80b40d2300 0x7f80b414fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.096+0000 7f80bc693640 1 -- 172.21.15.6:0/472808685 >> 172.21.15.6:0/472808685 conn(0x7f80b40659d0 msgr2=0x7f80b40aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:24.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.096+0000 7f80bc693640 1 -- 172.21.15.6:0/472808685 shutdown_connections 2023-07-21T22:38:24.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.096+0000 7f80bc693640 1 -- 172.21.15.6:0/472808685 wait complete. 2023-07-21T22:38:24.170 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:38:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.268+0000 7fed0247b640 1 Processor -- start 2023-07-21T22:38:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.268+0000 7fed0247b640 1 -- start start 2023-07-21T22:38:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.272+0000 7fed0247b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fecfc0c8ad0 0x7fecfc0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.272+0000 7fed0247b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecfc0c9560 0x7fecfc0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.272+0000 7fed0247b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecfc0cc700 con 0x7fecfc158ce0 2023-07-21T22:38:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.272+0000 7fed0247b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecfc0c99e0 con 0x7fecfc0c8ad0 2023-07-21T22:38:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.272+0000 7fed0247b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0b0ff0 con 0x7fecfc0c9560 2023-07-21T22:38:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.272+0000 7fecfbfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fecfc158ce0 0x7fecfc070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47618/0 (socket says 172.21.15.6:47618) 2023-07-21T22:38:24.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.272+0000 7fecfbfff640 1 -- 172.21.15.6:0/366843916 learned_addr learned my addr 172.21.15.6:0/366843916 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:24.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.272+0000 7fecfb7fe640 1 --2- 172.21.15.6:0/366843916 >> v2:172.21.15.6:3300/0 conn(0x7fecfc0c8ad0 0x7fecfc0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:24.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.272+0000 7fecfaffd640 1 -- 172.21.15.6:0/366843916 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138154580 0 0) 0x7fecfc0cc700 con 0x7fecfc158ce0 2023-07-21T22:38:24.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.272+0000 7fecfb7fe640 1 -- 172.21.15.6:0/366843916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecfc0c9560 msgr2=0x7fecfc0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:24.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.272+0000 7fed00a18640 1 --2- 172.21.15.6:0/366843916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecfc0c9560 0x7fecfc0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:24.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.272+0000 7fecfb7fe640 1 --2- 172.21.15.6:0/366843916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecfc0c9560 0x7fecfc0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.272+0000 7fecfb7fe640 1 -- 172.21.15.6:0/366843916 >> v1:172.21.15.6:6789/0 conn(0x7fecfc158ce0 legacy=0x7fecfc070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:24.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.272+0000 7fecfb7fe640 1 -- 172.21.15.6:0/366843916 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc070c80 con 0x7fecfc0c8ad0 2023-07-21T22:38:24.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.272+0000 7fed00a18640 1 --2- 172.21.15.6:0/366843916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecfc0c9560 0x7fecfc0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:24.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.276+0000 7fecfb7fe640 1 --2- 172.21.15.6:0/366843916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecfc0c8ad0 0x7fecfc0c9020 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fecf00097c0 tx=0x7fecf001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ea755b6fd67654 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:24.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.276+0000 7fecfaffd640 1 -- 172.21.15.6:0/366843916 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf00ab600 con 0x7fecfc0c8ad0 2023-07-21T22:38:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.276+0000 7fecfaffd640 1 -- 172.21.15.6:0/366843916 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf00a7050 con 0x7fecfc0c8ad0 2023-07-21T22:38:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.276+0000 7fecfaffd640 1 -- 172.21.15.6:0/366843916 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf00ab980 con 0x7fecfc0c8ad0 2023-07-21T22:38:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.276+0000 7fed0247b640 1 -- 172.21.15.6:0/366843916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecfc0c8ad0 msgr2=0x7fecfc0c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.276+0000 7fed0247b640 1 --2- 172.21.15.6:0/366843916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecfc0c8ad0 0x7fecfc0c9020 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fecf00097c0 tx=0x7fecf001c330 comp rx=0 tx=0).stop 2023-07-21T22:38:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.276+0000 7fed0247b640 1 -- 172.21.15.6:0/366843916 shutdown_connections 2023-07-21T22:38:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.276+0000 7fed0247b640 1 --2- 172.21.15.6:0/366843916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecfc0c9560 0x7fecfc0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.276+0000 7fed0247b640 1 --2- 172.21.15.6:0/366843916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecfc0c8ad0 0x7fecfc0c9020 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.276+0000 7fed0247b640 1 -- 172.21.15.6:0/366843916 >> 172.21.15.6:0/366843916 conn(0x7fecfc0afcf0 msgr2=0x7fecfc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:24.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.276+0000 7fed0247b640 1 -- 172.21.15.6:0/366843916 shutdown_connections 2023-07-21T22:38:24.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.276+0000 7fed0247b640 1 -- 172.21.15.6:0/366843916 wait complete. 2023-07-21T22:38:24.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.276+0000 7fed0247b640 1 Processor -- start 2023-07-21T22:38:24.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.276+0000 7fed0247b640 1 -- start start 2023-07-21T22:38:24.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.276+0000 7fed0247b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecfc0c8ad0 0x7fecfc14d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:24.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fed0247b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecfc0c9560 0x7fecfc149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:24.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fed0247b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecfc158ce0 0x7fecfc14a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:24.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fed0247b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc14a9f0 con 0x7fecfc0c9560 2023-07-21T22:38:24.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fed0247b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc06b650 con 0x7fecfc158ce0 2023-07-21T22:38:24.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fed0247b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc06b930 con 0x7fecfc0c8ad0 2023-07-21T22:38:24.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fecfb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecfc0c9560 0x7fecfc149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:24.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fecfb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecfc0c9560 0x7fecfc149f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51752/0 (socket says 172.21.15.6:51752) 2023-07-21T22:38:24.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fecfb7fe640 1 -- 172.21.15.6:0/1168273646 learned_addr learned my addr 172.21.15.6:0/1168273646 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:24.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fed00a18640 1 --2- 172.21.15.6:0/1168273646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecfc158ce0 0x7fecfc14a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:24.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fecfb7fe640 1 -- 172.21.15.6:0/1168273646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecfc0c8ad0 msgr2=0x7fecfc14d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:24.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fecfbfff640 1 --2- 172.21.15.6:0/1168273646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecfc0c8ad0 0x7fecfc14d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:24.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fecfb7fe640 1 --2- 172.21.15.6:0/1168273646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecfc0c8ad0 0x7fecfc14d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fecfb7fe640 1 -- 172.21.15.6:0/1168273646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecfc158ce0 msgr2=0x7fecfc14a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:24.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fecfb7fe640 1 --2- 172.21.15.6:0/1168273646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecfc158ce0 0x7fecfc14a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fecfb7fe640 1 -- 172.21.15.6:0/1168273646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf0009420 con 0x7fecfc0c9560 2023-07-21T22:38:24.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fed00a18640 1 --2- 172.21.15.6:0/1168273646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecfc158ce0 0x7fecfc14a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:24.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fecfbfff640 1 --2- 172.21.15.6:0/1168273646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecfc0c8ad0 0x7fecfc14d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:24.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fecfb7fe640 1 --2- 172.21.15.6:0/1168273646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecfc0c9560 0x7fecfc149f70 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fecf00ae040 tx=0x7fecf00190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:24.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fecf8ff9640 1 -- 172.21.15.6:0/1168273646 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf00b4610 con 0x7fecfc0c9560 2023-07-21T22:38:24.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fecf8ff9640 1 -- 172.21.15.6:0/1168273646 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf00abe90 con 0x7fecfc0c9560 2023-07-21T22:38:24.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fecf8ff9640 1 -- 172.21.15.6:0/1168273646 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf00b49d0 con 0x7fecfc0c9560 2023-07-21T22:38:24.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fed0247b640 1 -- 172.21.15.6:0/1168273646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecfc06bc10 con 0x7fecfc0c9560 2023-07-21T22:38:24.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fed0247b640 1 -- 172.21.15.6:0/1168273646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecfc0c6770 con 0x7fecfc0c9560 2023-07-21T22:38:24.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fed0247b640 1 -- 172.21.15.6:0/1168273646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecfc0ca1a0 con 0x7fecfc0c9560 2023-07-21T22:38:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.280+0000 7fecf8ff9640 1 -- 172.21.15.6:0/1168273646 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fecf00b2040 con 0x7fecfc0c9560 2023-07-21T22:38:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.284+0000 7fecf8ff9640 1 --2- 172.21.15.6:0/1168273646 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fece80663a0 0x7fece8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.284+0000 7fecf8ff9640 1 -- 172.21.15.6:0/1168273646 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fecf011e2d0 con 0x7fecfc0c9560 2023-07-21T22:38:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.284+0000 7fecfbfff640 1 --2- 172.21.15.6:0/1168273646 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fece80663a0 0x7fece8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:24.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.284+0000 7fecfbfff640 1 --2- 172.21.15.6:0/1168273646 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fece80663a0 0x7fece8068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fecec007fd0 tx=0x7fecec009040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:24.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.288+0000 7fecf8ff9640 1 -- 172.21.15.6:0/1168273646 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fecf00eb440 con 0x7fecfc0c9560 2023-07-21T22:38:24.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.444+0000 7fed0247b640 1 -- 172.21.15.6:0/1168273646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecfc0678d0 con 0x7fecfc0c9560 2023-07-21T22:38:24.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.444+0000 7fecf8ff9640 1 -- 172.21.15.6:0/1168273646 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+18417 (secure 0 0 0) 0x7fecf00eea60 con 0x7fecfc0c9560 2023-07-21T22:38:24.491 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:24.492 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":142,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:38:23.444301+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:38:21.546383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-21T22:38:22.445128+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:38:24.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.448+0000 7fed0247b640 1 -- 172.21.15.6:0/1168273646 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fece80663a0 msgr2=0x7fece8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:24.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.448+0000 7fed0247b640 1 --2- 172.21.15.6:0/1168273646 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fece80663a0 0x7fece8068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fecec007fd0 tx=0x7fecec009040 comp rx=0 tx=0).stop 2023-07-21T22:38:24.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.448+0000 7fed0247b640 1 -- 172.21.15.6:0/1168273646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecfc0c9560 msgr2=0x7fecfc149f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:24.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.448+0000 7fed0247b640 1 --2- 172.21.15.6:0/1168273646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecfc0c9560 0x7fecfc149f70 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fecf00ae040 tx=0x7fecf00190d0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.448+0000 7fed0247b640 1 -- 172.21.15.6:0/1168273646 shutdown_connections 2023-07-21T22:38:24.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.448+0000 7fed0247b640 1 --2- 172.21.15.6:0/1168273646 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fece80663a0 0x7fece8068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.448+0000 7fed0247b640 1 --2- 172.21.15.6:0/1168273646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecfc158ce0 0x7fecfc14a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.448+0000 7fed0247b640 1 --2- 172.21.15.6:0/1168273646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecfc0c9560 0x7fecfc149f70 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.448+0000 7fed0247b640 1 --2- 172.21.15.6:0/1168273646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecfc0c8ad0 0x7fecfc14d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.448+0000 7fed0247b640 1 -- 172.21.15.6:0/1168273646 >> 172.21.15.6:0/1168273646 conn(0x7fecfc0afcf0 msgr2=0x7fecfc151870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:24.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.448+0000 7fed0247b640 1 -- 172.21.15.6:0/1168273646 shutdown_connections 2023-07-21T22:38:24.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.448+0000 7fed0247b640 1 -- 172.21.15.6:0/1168273646 wait complete. 2023-07-21T22:38:24.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:38:24.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.612+0000 7efe8cc48640 1 Processor -- start 2023-07-21T22:38:24.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.612+0000 7efe8cc48640 1 -- start start 2023-07-21T22:38:24.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.612+0000 7efe8cc48640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe880ae1f0 0x7efe880b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:24.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.612+0000 7efe8cc48640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efe8806c430 0x7efe88069430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:24.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.612+0000 7efe8cc48640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe880b24f0 con 0x7efe8806e160 2023-07-21T22:38:24.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.612+0000 7efe8cc48640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe880b27d0 con 0x7efe880ae1f0 2023-07-21T22:38:24.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.612+0000 7efe8cc48640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe880b2ab0 con 0x7efe8806c430 2023-07-21T22:38:24.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.612+0000 7efe8659c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe880ae1f0 0x7efe880b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:24.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.612+0000 7efe8659c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efe880ae1f0 0x7efe880b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51760/0 (socket says 172.21.15.6:51760) 2023-07-21T22:38:24.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.612+0000 7efe8659c640 1 -- 172.21.15.6:0/3926396511 learned_addr learned my addr 172.21.15.6:0/3926396511 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:24.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.612+0000 7efe7ffff640 1 --1- 172.21.15.6:0/3926396511 >> v1:172.21.15.6:6789/0 conn(0x7efe8806e160 0x7efe8806bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47628/0 (socket says 172.21.15.6:47628) 2023-07-21T22:38:24.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.612+0000 7efe86d9d640 1 --2- 172.21.15.6:0/3926396511 >> v2:172.21.15.161:3300/0 conn(0x7efe8806c430 0x7efe88069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:24.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.612+0000 7efe8659c640 1 -- 172.21.15.6:0/3926396511 >> v2:172.21.15.161:3300/0 conn(0x7efe8806c430 msgr2=0x7efe88069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:24.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.612+0000 7efe8659c640 1 --2- 172.21.15.6:0/3926396511 >> v2:172.21.15.161:3300/0 conn(0x7efe8806c430 0x7efe88069430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.612+0000 7efe8659c640 1 -- 172.21.15.6:0/3926396511 >> v1:172.21.15.6:6789/0 conn(0x7efe8806e160 legacy=0x7efe8806bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:24.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.612+0000 7efe8659c640 1 -- 172.21.15.6:0/3926396511 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe880b2d90 con 0x7efe880ae1f0 2023-07-21T22:38:24.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.612+0000 7efe85d9b640 1 -- 172.21.15.6:0/3926396511 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589778015 0 0) 0x7efe880b24f0 con 0x7efe8806e160 2023-07-21T22:38:24.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.616+0000 7efe8659c640 1 --2- 172.21.15.6:0/3926396511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe880ae1f0 0x7efe880b1e60 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7efe880658f0 tx=0x7efe7801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c5694e17f50f49 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:24.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.616+0000 7efe85d9b640 1 -- 172.21.15.6:0/3926396511 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe780aa650 con 0x7efe880ae1f0 2023-07-21T22:38:24.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.616+0000 7efe85d9b640 1 -- 172.21.15.6:0/3926396511 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe780aa7b0 con 0x7efe880ae1f0 2023-07-21T22:38:24.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.616+0000 7efe85d9b640 1 -- 172.21.15.6:0/3926396511 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe780aab40 con 0x7efe880ae1f0 2023-07-21T22:38:24.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.616+0000 7efe8cc48640 1 -- 172.21.15.6:0/3926396511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe880ae1f0 msgr2=0x7efe880b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:24.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.616+0000 7efe8cc48640 1 --2- 172.21.15.6:0/3926396511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe880ae1f0 0x7efe880b1e60 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7efe880658f0 tx=0x7efe7801c4d0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.616+0000 7efe8cc48640 1 -- 172.21.15.6:0/3926396511 shutdown_connections 2023-07-21T22:38:24.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.616+0000 7efe8cc48640 1 --2- 172.21.15.6:0/3926396511 >> v2:172.21.15.161:3300/0 conn(0x7efe8806c430 0x7efe88069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.616+0000 7efe8cc48640 1 --2- 172.21.15.6:0/3926396511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe880ae1f0 0x7efe880b1e60 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.616+0000 7efe8cc48640 1 -- 172.21.15.6:0/3926396511 >> 172.21.15.6:0/3926396511 conn(0x7efe880b1300 msgr2=0x7efe880ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:24.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.616+0000 7efe8cc48640 1 -- 172.21.15.6:0/3926396511 shutdown_connections 2023-07-21T22:38:24.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.616+0000 7efe8cc48640 1 -- 172.21.15.6:0/3926396511 wait complete. 2023-07-21T22:38:24.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe8cc48640 1 Processor -- start 2023-07-21T22:38:24.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe8cc48640 1 -- start start 2023-07-21T22:38:24.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe8cc48640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe8806c430 0x7efe8813e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:24.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe8cc48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe8806e160 0x7efe880aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:24.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe8cc48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe880ae1f0 0x7efe880af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:24.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe8cc48640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe880cb9e0 con 0x7efe8806e160 2023-07-21T22:38:24.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe8cc48640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe880afb60 con 0x7efe8806c430 2023-07-21T22:38:24.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe8cc48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe880afe40 con 0x7efe880ae1f0 2023-07-21T22:38:24.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe7ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe8806e160 0x7efe880aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe7ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe8806e160 0x7efe880aeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51772/0 (socket says 172.21.15.6:51772) 2023-07-21T22:38:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe7ffff640 1 -- 172.21.15.6:0/913817630 learned_addr learned my addr 172.21.15.6:0/913817630 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe86d9d640 1 --2- 172.21.15.6:0/913817630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe880ae1f0 0x7efe880af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe8659c640 1 --2- 172.21.15.6:0/913817630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe8806c430 0x7efe8813e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe7ffff640 1 -- 172.21.15.6:0/913817630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe880ae1f0 msgr2=0x7efe880af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe7ffff640 1 --2- 172.21.15.6:0/913817630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe880ae1f0 0x7efe880af530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe7ffff640 1 -- 172.21.15.6:0/913817630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe8806c430 msgr2=0x7efe8813e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:24.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe7ffff640 1 --2- 172.21.15.6:0/913817630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe8806c430 0x7efe8813e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe7ffff640 1 -- 172.21.15.6:0/913817630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe780094d0 con 0x7efe8806e160 2023-07-21T22:38:24.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe8659c640 1 --2- 172.21.15.6:0/913817630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe8806c430 0x7efe8813e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:24.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe7ffff640 1 --2- 172.21.15.6:0/913817630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe8806e160 0x7efe880aeff0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7efe700011f0 tx=0x7efe7000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:24.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe7effd640 1 -- 172.21.15.6:0/913817630 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe700074e0 con 0x7efe8806e160 2023-07-21T22:38:24.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe7effd640 1 -- 172.21.15.6:0/913817630 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe70007640 con 0x7efe8806e160 2023-07-21T22:38:24.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe7effd640 1 -- 172.21.15.6:0/913817630 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70004a10 con 0x7efe8806e160 2023-07-21T22:38:24.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe8cc48640 1 -- 172.21.15.6:0/913817630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe880b3710 con 0x7efe8806e160 2023-07-21T22:38:24.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.620+0000 7efe8cc48640 1 -- 172.21.15.6:0/913817630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe880cb670 con 0x7efe8806e160 2023-07-21T22:38:24.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.624+0000 7efe8cc48640 1 -- 172.21.15.6:0/913817630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe880cbb50 con 0x7efe8806e160 2023-07-21T22:38:24.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.624+0000 7efe7effd640 1 -- 172.21.15.6:0/913817630 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efe70004b70 con 0x7efe8806e160 2023-07-21T22:38:24.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.624+0000 7efe7effd640 1 --2- 172.21.15.6:0/913817630 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7efe680663a0 0x7efe68068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.624+0000 7efe7effd640 1 -- 172.21.15.6:0/913817630 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6134+0+0 (secure 0 0 0) 0x7efe70083110 con 0x7efe8806e160 2023-07-21T22:38:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.624+0000 7efe8659c640 1 --2- 172.21.15.6:0/913817630 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7efe680663a0 0x7efe68068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:24.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.628+0000 7efe8659c640 1 --2- 172.21.15.6:0/913817630 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7efe680663a0 0x7efe68068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efe780ae000 tx=0x7efe780a7000 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:24.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.628+0000 7efe7effd640 1 -- 172.21.15.6:0/913817630 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efe700504d0 con 0x7efe8806e160 2023-07-21T22:38:24.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.788+0000 7efe8cc48640 1 -- 172.21.15.6:0/913817630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe880678d0 con 0x7efe8806e160 2023-07-21T22:38:24.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.792+0000 7efe7effd640 1 -- 172.21.15.6:0/913817630 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) v1 ==== 74+0+18417 (secure 0 0 0) 0x7efe70018090 con 0x7efe8806e160 2023-07-21T22:38:24.836 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:24.836 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":142,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:38:23.444301+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:38:21.546383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-21T22:38:22.445128+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:38:24.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.792+0000 7efe8cc48640 1 -- 172.21.15.6:0/913817630 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7efe680663a0 msgr2=0x7efe68068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:24.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.792+0000 7efe8cc48640 1 --2- 172.21.15.6:0/913817630 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7efe680663a0 0x7efe68068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efe780ae000 tx=0x7efe780a7000 comp rx=0 tx=0).stop 2023-07-21T22:38:24.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.792+0000 7efe8cc48640 1 -- 172.21.15.6:0/913817630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe8806e160 msgr2=0x7efe880aeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:24.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.792+0000 7efe8cc48640 1 --2- 172.21.15.6:0/913817630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe8806e160 0x7efe880aeff0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7efe700011f0 tx=0x7efe7000c9b0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.792+0000 7efe8cc48640 1 -- 172.21.15.6:0/913817630 shutdown_connections 2023-07-21T22:38:24.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.792+0000 7efe8cc48640 1 --2- 172.21.15.6:0/913817630 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7efe680663a0 0x7efe68068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.792+0000 7efe8cc48640 1 --2- 172.21.15.6:0/913817630 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efe880ae1f0 0x7efe880af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.792+0000 7efe8cc48640 1 --2- 172.21.15.6:0/913817630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe8806e160 0x7efe880aeff0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.792+0000 7efe8cc48640 1 --2- 172.21.15.6:0/913817630 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efe8806c430 0x7efe8813e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:24.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.792+0000 7efe8cc48640 1 -- 172.21.15.6:0/913817630 >> 172.21.15.6:0/913817630 conn(0x7efe880b1300 msgr2=0x7efe880ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:24.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.792+0000 7efe8cc48640 1 -- 172.21.15.6:0/913817630 shutdown_connections 2023-07-21T22:38:24.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.792+0000 7efe8cc48640 1 -- 172.21.15.6:0/913817630 wait complete. 2023-07-21T22:38:24.857 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-21T22:38:25.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.956+0000 7f8d605ad640 1 Processor -- start 2023-07-21T22:38:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.956+0000 7f8d605ad640 1 -- start start 2023-07-21T22:38:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.960+0000 7f8d605ad640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8d580aeb40 0x7f8d5815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.960+0000 7f8d605ad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d58159440 0x7f8d580c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.960+0000 7f8d605ad640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d581532b0 con 0x7f8d580aef10 2023-07-21T22:38:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.960+0000 7f8d605ad640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d580ca6f0 con 0x7f8d580aeb40 2023-07-21T22:38:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.960+0000 7f8d605ad640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d581599d0 con 0x7f8d58159440 2023-07-21T22:38:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.960+0000 7f8d5eb4a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d58159440 0x7f8d580c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.960+0000 7f8d5e349640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8d580aeb40 0x7f8d5815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.960+0000 7f8d5e349640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8d580aeb40 0x7f8d5815cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:41300/0 (socket says 172.21.15.6:41300) 2023-07-21T22:38:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.960+0000 7f8d5e349640 1 -- 172.21.15.6:0/2868368978 learned_addr learned my addr 172.21.15.6:0/2868368978 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.960+0000 7f8d5e349640 1 -- 172.21.15.6:0/2868368978 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d58159440 msgr2=0x7f8d580c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.960+0000 7f8d5e349640 1 --2- 172.21.15.6:0/2868368978 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d58159440 0x7f8d580c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.960+0000 7f8d5e349640 1 -- 172.21.15.6:0/2868368978 >> v1:172.21.15.161:6789/0 conn(0x7f8d580aef10 legacy=0x7f8d58158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.960+0000 7f8d5e349640 1 -- 172.21.15.6:0/2868368978 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d58159cb0 con 0x7f8d580aeb40 2023-07-21T22:38:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.960+0000 7f8d5d347640 1 -- 172.21.15.6:0/2868368978 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563444113 0 0) 0x7f8d581532b0 con 0x7f8d580aef10 2023-07-21T22:38:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.964+0000 7f8d5e349640 1 --2- 172.21.15.6:0/2868368978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d580aeb40 0x7f8d5815cef0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009870 tx=0x7f8d5401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31349db925ebf83f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.964+0000 7f8d5d347640 1 -- 172.21.15.6:0/2868368978 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d540ab680 con 0x7f8d580aeb40 2023-07-21T22:38:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.964+0000 7f8d5d347640 1 -- 172.21.15.6:0/2868368978 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d540ab7e0 con 0x7f8d580aeb40 2023-07-21T22:38:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.964+0000 7f8d5d347640 1 -- 172.21.15.6:0/2868368978 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d540abb70 con 0x7f8d580aeb40 2023-07-21T22:38:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.964+0000 7f8d605ad640 1 -- 172.21.15.6:0/2868368978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d580aeb40 msgr2=0x7f8d5815cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.964+0000 7f8d605ad640 1 --2- 172.21.15.6:0/2868368978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d580aeb40 0x7f8d5815cef0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009870 tx=0x7f8d5401c480 comp rx=0 tx=0).stop 2023-07-21T22:38:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.964+0000 7f8d605ad640 1 -- 172.21.15.6:0/2868368978 shutdown_connections 2023-07-21T22:38:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.964+0000 7f8d605ad640 1 --2- 172.21.15.6:0/2868368978 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d58159440 0x7f8d580c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:25.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.964+0000 7f8d605ad640 1 --2- 172.21.15.6:0/2868368978 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d580aeb40 0x7f8d5815cef0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:25.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.964+0000 7f8d605ad640 1 -- 172.21.15.6:0/2868368978 >> 172.21.15.6:0/2868368978 conn(0x7f8d580cde90 msgr2=0x7f8d580ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:25.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.964+0000 7f8d605ad640 1 -- 172.21.15.6:0/2868368978 shutdown_connections 2023-07-21T22:38:25.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.964+0000 7f8d605ad640 1 -- 172.21.15.6:0/2868368978 wait complete. 2023-07-21T22:38:25.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d605ad640 1 Processor -- start 2023-07-21T22:38:25.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d605ad640 1 -- start start 2023-07-21T22:38:25.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d605ad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d580aeb40 0x7f8d58147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:25.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d605ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d580aef10 0x7f8d5815ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:25.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d605ad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d58159440 0x7f8d5814c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:25.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d605ad640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5815b260 con 0x7f8d580aef10 2023-07-21T22:38:25.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d605ad640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5814c590 con 0x7f8d580aeb40 2023-07-21T22:38:25.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d605ad640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d58070580 con 0x7f8d58159440 2023-07-21T22:38:25.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d5db48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d580aef10 0x7f8d5815ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:25.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d5db48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d580aef10 0x7f8d5815ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51774/0 (socket says 172.21.15.6:51774) 2023-07-21T22:38:25.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d5db48640 1 -- 172.21.15.6:0/466978188 learned_addr learned my addr 172.21.15.6:0/466978188 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:25.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d5e349640 1 --2- 172.21.15.6:0/466978188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d580aeb40 0x7f8d58147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:25.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d5eb4a640 1 --2- 172.21.15.6:0/466978188 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d58159440 0x7f8d5814c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:25.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d5db48640 1 -- 172.21.15.6:0/466978188 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d58159440 msgr2=0x7f8d5814c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:25.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d5db48640 1 --2- 172.21.15.6:0/466978188 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d58159440 0x7f8d5814c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:25.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d5db48640 1 -- 172.21.15.6:0/466978188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d580aeb40 msgr2=0x7f8d58147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:25.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d5db48640 1 --2- 172.21.15.6:0/466978188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d580aeb40 0x7f8d58147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:25.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d5db48640 1 -- 172.21.15.6:0/466978188 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d540094d0 con 0x7f8d580aef10 2023-07-21T22:38:25.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d5db48640 1 --2- 172.21.15.6:0/466978188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d580aef10 0x7f8d5815ab80 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800c4d0 tx=0x7f8d4800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:25.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d4effd640 1 -- 172.21.15.6:0/466978188 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d48005480 con 0x7f8d580aef10 2023-07-21T22:38:25.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d4effd640 1 -- 172.21.15.6:0/466978188 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d48003600 con 0x7f8d580aef10 2023-07-21T22:38:25.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d4effd640 1 -- 172.21.15.6:0/466978188 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d480039b0 con 0x7f8d580aef10 2023-07-21T22:38:25.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d605ad640 1 -- 172.21.15.6:0/466978188 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d5814a320 con 0x7f8d580aef10 2023-07-21T22:38:25.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d605ad640 1 -- 172.21.15.6:0/466978188 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d58070b00 con 0x7f8d580aef10 2023-07-21T22:38:25.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.968+0000 7f8d605ad640 1 -- 172.21.15.6:0/466978188 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d580678d0 con 0x7f8d580aef10 2023-07-21T22:38:25.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.972+0000 7f8d4effd640 1 -- 172.21.15.6:0/466978188 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8d48003b10 con 0x7f8d580aef10 2023-07-21T22:38:25.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.972+0000 7f8d4effd640 1 --2- 172.21.15.6:0/466978188 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f8d3c0663a0 0x7f8d3c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:25.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.972+0000 7f8d4effd640 1 -- 172.21.15.6:0/466978188 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f8d48083460 con 0x7f8d580aef10 2023-07-21T22:38:25.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.972+0000 7f8d5e349640 1 --2- 172.21.15.6:0/466978188 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f8d3c0663a0 0x7f8d3c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:25.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.972+0000 7f8d5e349640 1 --2- 172.21.15.6:0/466978188 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f8d3c0663a0 0x7f8d3c068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8d540af000 tx=0x7f8d540b6040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:25.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:24.976+0000 7f8d4effd640 1 -- 172.21.15.6:0/466978188 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8d480508e0 con 0x7f8d580aef10 2023-07-21T22:38:25.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:25.172+0000 7f8d605ad640 1 -- 172.21.15.6:0/466978188 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8d580c4060 con 0x7f8d580aef10 2023-07-21T22:38:26.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.100+0000 7f8d4effd640 1 -- 172.21.15.6:0/466978188 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v61) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8d48053f00 con 0x7f8d580aef10 2023-07-21T22:38:26.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.104+0000 7f8d605ad640 1 -- 172.21.15.6:0/466978188 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f8d3c0663a0 msgr2=0x7f8d3c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:26.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.104+0000 7f8d605ad640 1 --2- 172.21.15.6:0/466978188 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f8d3c0663a0 0x7f8d3c068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8d540af000 tx=0x7f8d540b6040 comp rx=0 tx=0).stop 2023-07-21T22:38:26.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.104+0000 7f8d605ad640 1 -- 172.21.15.6:0/466978188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d580aef10 msgr2=0x7f8d5815ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:26.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.104+0000 7f8d605ad640 1 --2- 172.21.15.6:0/466978188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d580aef10 0x7f8d5815ab80 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800c4d0 tx=0x7f8d4800c990 comp rx=0 tx=0).stop 2023-07-21T22:38:26.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.104+0000 7f8d605ad640 1 -- 172.21.15.6:0/466978188 shutdown_connections 2023-07-21T22:38:26.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.104+0000 7f8d605ad640 1 --2- 172.21.15.6:0/466978188 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f8d3c0663a0 0x7f8d3c068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.104+0000 7f8d605ad640 1 --2- 172.21.15.6:0/466978188 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d58159440 0x7f8d5814c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.104+0000 7f8d605ad640 1 --2- 172.21.15.6:0/466978188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d580aef10 0x7f8d5815ab80 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.104+0000 7f8d605ad640 1 --2- 172.21.15.6:0/466978188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d580aeb40 0x7f8d58147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.104+0000 7f8d605ad640 1 -- 172.21.15.6:0/466978188 >> 172.21.15.6:0/466978188 conn(0x7f8d580cde90 msgr2=0x7f8d580ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:26.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.104+0000 7f8d605ad640 1 -- 172.21.15.6:0/466978188 shutdown_connections 2023-07-21T22:38:26.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.104+0000 7f8d605ad640 1 -- 172.21.15.6:0/466978188 wait complete. 2023-07-21T22:38:26.171 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-21T22:38:26.171 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-21T22:38:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.276+0000 7fc250b59640 1 Processor -- start 2023-07-21T22:38:26.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.276+0000 7fc250b59640 1 -- start start 2023-07-21T22:38:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc250b59640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc24c1590a0 0x7fc24c0c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc250b59640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24c0c37e0 con 0x7fc24c0cba60 2023-07-21T22:38:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc250b59640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24c0c3ac0 con 0x7fc24c15b9c0 2023-07-21T22:38:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc250b59640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24c0c3da0 con 0x7fc24c1590a0 2023-07-21T22:38:26.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc24a59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc24c0cba60 0x7fc24c0cbe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47632/0 (socket says 172.21.15.6:47632) 2023-07-21T22:38:26.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc24a59c640 1 -- 172.21.15.6:0/113585175 learned_addr learned my addr 172.21.15.6:0/113585175 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:26.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc243fff640 1 --2- 172.21.15.6:0/113585175 >> v2:172.21.15.161:3300/0 conn(0x7fc24c1590a0 0x7fc24c0c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc249d9b640 1 -- 172.21.15.6:0/113585175 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3030181471 0 0) 0x7fc24c0c37e0 con 0x7fc24c0cba60 2023-07-21T22:38:26.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc249d9b640 1 -- 172.21.15.6:0/113585175 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc238003530 con 0x7fc24c0cba60 2023-07-21T22:38:26.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc249d9b640 1 -- 172.21.15.6:0/113585175 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3476196319 0 0) 0x7fc238003530 con 0x7fc24c0cba60 2023-07-21T22:38:26.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc249d9b640 1 -- 172.21.15.6:0/113585175 >> v2:172.21.15.161:3300/0 conn(0x7fc24c1590a0 msgr2=0x7fc24c0c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:26.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc249d9b640 1 --2- 172.21.15.6:0/113585175 >> v2:172.21.15.161:3300/0 conn(0x7fc24c1590a0 0x7fc24c0c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc249d9b640 1 -- 172.21.15.6:0/113585175 >> v1:172.21.15.161:6789/0 conn(0x7fc24c15b9c0 legacy=0x7fc24c159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:26.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc249d9b640 1 -- 172.21.15.6:0/113585175 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24c0c4080 con 0x7fc24c0cba60 2023-07-21T22:38:26.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc249d9b640 1 -- 172.21.15.6:0/113585175 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fc23c001680 con 0x7fc24c0cba60 2023-07-21T22:38:26.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc249d9b640 1 -- 172.21.15.6:0/113585175 >> v1:172.21.15.6:6789/0 conn(0x7fc24c0cba60 legacy=0x7fc24c0cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:26.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc249d9b640 1 --2- 172.21.15.6:0/113585175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc238003980 0x7fc238003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc249d9b640 1 --2- 172.21.15.6:0/113585175 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2380047d0 0x7fc238004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc249d9b640 1 --2- 172.21.15.6:0/113585175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc238005180 0x7fc23800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc249d9b640 1 -- 172.21.15.6:0/113585175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c0c3da0 con 0x7fc238005180 2023-07-21T22:38:26.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc249d9b640 1 -- 172.21.15.6:0/113585175 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23800e2a0 con 0x7fc238003980 2023-07-21T22:38:26.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc249d9b640 1 -- 172.21.15.6:0/113585175 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23800e460 con 0x7fc2380047d0 2023-07-21T22:38:26.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc24ad9d640 1 --2- 172.21.15.6:0/113585175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc238005180 0x7fc23800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc24a59c640 1 --2- 172.21.15.6:0/113585175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc238003980 0x7fc238003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc243fff640 1 --2- 172.21.15.6:0/113585175 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2380047d0 0x7fc238004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc24ad9d640 1 -- 172.21.15.6:0/113585175 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2380047d0 msgr2=0x7fc238004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:26.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc24ad9d640 1 --2- 172.21.15.6:0/113585175 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc2380047d0 0x7fc238004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc24ad9d640 1 -- 172.21.15.6:0/113585175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc238003980 msgr2=0x7fc238003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:26.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc24ad9d640 1 --2- 172.21.15.6:0/113585175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc238003980 0x7fc238003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.280+0000 7fc24ad9d640 1 -- 172.21.15.6:0/113585175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc238003530 con 0x7fc238005180 2023-07-21T22:38:26.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.284+0000 7fc24ad9d640 1 -- 172.21.15.6:0/113585175 reap_dead start 2023-07-21T22:38:26.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.284+0000 7fc24ad9d640 1 --2- 172.21.15.6:0/113585175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc238005180 0x7fc23800dba0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fc244001e70 tx=0x7fc24401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a663420ae39ba56 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:26.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.284+0000 7fc249d9b640 1 -- 172.21.15.6:0/113585175 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc244003b80 con 0x7fc238005180 2023-07-21T22:38:26.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.284+0000 7fc249d9b640 1 -- 172.21.15.6:0/113585175 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc244003d00 con 0x7fc238005180 2023-07-21T22:38:26.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.284+0000 7fc249d9b640 1 -- 172.21.15.6:0/113585175 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc244005310 con 0x7fc238005180 2023-07-21T22:38:26.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.284+0000 7fc250b59640 1 -- 172.21.15.6:0/113585175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc238005180 msgr2=0x7fc23800dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:26.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.284+0000 7fc250b59640 1 --2- 172.21.15.6:0/113585175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc238005180 0x7fc23800dba0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fc244001e70 tx=0x7fc24401c760 comp rx=0 tx=0).stop 2023-07-21T22:38:26.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.284+0000 7fc250b59640 1 -- 172.21.15.6:0/113585175 shutdown_connections 2023-07-21T22:38:26.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.284+0000 7fc250b59640 1 --2- 172.21.15.6:0/113585175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc238005180 0x7fc23800dba0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.284+0000 7fc250b59640 1 -- 172.21.15.6:0/113585175 >> 172.21.15.6:0/113585175 conn(0x7fc24c0cde90 msgr2=0x7fc24c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:26.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.284+0000 7fc250b59640 1 -- 172.21.15.6:0/113585175 shutdown_connections 2023-07-21T22:38:26.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.284+0000 7fc250b59640 1 -- 172.21.15.6:0/113585175 wait complete. 2023-07-21T22:38:26.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc250b59640 1 Processor -- start 2023-07-21T22:38:26.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc250b59640 1 -- start start 2023-07-21T22:38:26.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc250b59640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc238005180 0x7fc24c14cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc250b59640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc24c0b3990 0x7fc24c14e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc250b59640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc24c14ebc0 0x7fc24c0c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc250b59640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c13a760 con 0x7fc238005180 2023-07-21T22:38:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc250b59640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c14d100 con 0x7fc24c0b3990 2023-07-21T22:38:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc250b59640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24c0caf20 con 0x7fc24c14ebc0 2023-07-21T22:38:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc24a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc238005180 0x7fc24c14cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc24a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc238005180 0x7fc24c14cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51796/0 (socket says 172.21.15.6:51796) 2023-07-21T22:38:26.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc24a59c640 1 -- 172.21.15.6:0/2665550319 learned_addr learned my addr 172.21.15.6:0/2665550319 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc243fff640 1 --2- 172.21.15.6:0/2665550319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc24c0b3990 0x7fc24c14e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc24ad9d640 1 --2- 172.21.15.6:0/2665550319 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc24c14ebc0 0x7fc24c0c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc24a59c640 1 -- 172.21.15.6:0/2665550319 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc24c14ebc0 msgr2=0x7fc24c0c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc24a59c640 1 --2- 172.21.15.6:0/2665550319 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc24c14ebc0 0x7fc24c0c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc24a59c640 1 -- 172.21.15.6:0/2665550319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc24c0b3990 msgr2=0x7fc24c14e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc24a59c640 1 --2- 172.21.15.6:0/2665550319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc24c0b3990 0x7fc24c14e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc24a59c640 1 -- 172.21.15.6:0/2665550319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24c0ca960 con 0x7fc238005180 2023-07-21T22:38:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc243fff640 1 --2- 172.21.15.6:0/2665550319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc24c0b3990 0x7fc24c14e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc24a59c640 1 --2- 172.21.15.6:0/2665550319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc238005180 0x7fc24c14cbc0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fc23c012490 tx=0x7fc23c012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc242ffd640 1 -- 172.21.15.6:0/2665550319 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c014810 con 0x7fc238005180 2023-07-21T22:38:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc242ffd640 1 -- 172.21.15.6:0/2665550319 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23c014970 con 0x7fc238005180 2023-07-21T22:38:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc242ffd640 1 -- 172.21.15.6:0/2665550319 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c014ce0 con 0x7fc238005180 2023-07-21T22:38:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc250b59640 1 -- 172.21.15.6:0/2665550319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24c0cac40 con 0x7fc238005180 2023-07-21T22:38:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc250b59640 1 -- 172.21.15.6:0/2665550319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24c14f030 con 0x7fc238005180 2023-07-21T22:38:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.288+0000 7fc250b59640 1 -- 172.21.15.6:0/2665550319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc24c0714b0 con 0x7fc238005180 2023-07-21T22:38:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.292+0000 7fc242ffd640 1 -- 172.21.15.6:0/2665550319 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc23c0153e0 con 0x7fc238005180 2023-07-21T22:38:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.292+0000 7fc242ffd640 1 --2- 172.21.15.6:0/2665550319 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fc22c0663d0 0x7fc22c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.292+0000 7fc242ffd640 1 -- 172.21.15.6:0/2665550319 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fc23c0868c0 con 0x7fc238005180 2023-07-21T22:38:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.292+0000 7fc243fff640 1 --2- 172.21.15.6:0/2665550319 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fc22c0663d0 0x7fc22c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.292+0000 7fc243fff640 1 --2- 172.21.15.6:0/2665550319 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fc22c0663d0 0x7fc22c068880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc24c1578d0 tx=0x7fc234008040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:26.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.296+0000 7fc242ffd640 1 -- 172.21.15.6:0/2665550319 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc23c0575f0 con 0x7fc238005180 2023-07-21T22:38:26.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:26.484+0000 7fc250b59640 1 -- 172.21.15.6:0/2665550319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc24c0678d0 con 0x7fc238005180 2023-07-21T22:38:27.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.100+0000 7fc242ffd640 1 -- 172.21.15.6:0/2665550319 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v62) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc23c01c070 con 0x7fc238005180 2023-07-21T22:38:27.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.104+0000 7fc250b59640 1 -- 172.21.15.6:0/2665550319 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fc22c0663d0 msgr2=0x7fc22c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:27.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.104+0000 7fc250b59640 1 --2- 172.21.15.6:0/2665550319 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fc22c0663d0 0x7fc22c068880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc24c1578d0 tx=0x7fc234008040 comp rx=0 tx=0).stop 2023-07-21T22:38:27.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.104+0000 7fc250b59640 1 -- 172.21.15.6:0/2665550319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc238005180 msgr2=0x7fc24c14cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:27.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.104+0000 7fc250b59640 1 --2- 172.21.15.6:0/2665550319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc238005180 0x7fc24c14cbc0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fc23c012490 tx=0x7fc23c012950 comp rx=0 tx=0).stop 2023-07-21T22:38:27.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.104+0000 7fc250b59640 1 -- 172.21.15.6:0/2665550319 shutdown_connections 2023-07-21T22:38:27.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.104+0000 7fc250b59640 1 --2- 172.21.15.6:0/2665550319 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fc22c0663d0 0x7fc22c068880 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:27.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.104+0000 7fc250b59640 1 --2- 172.21.15.6:0/2665550319 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc24c14ebc0 0x7fc24c0c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:27.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.104+0000 7fc250b59640 1 --2- 172.21.15.6:0/2665550319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc24c0b3990 0x7fc24c14e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:27.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.104+0000 7fc250b59640 1 --2- 172.21.15.6:0/2665550319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc238005180 0x7fc24c14cbc0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:27.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.104+0000 7fc250b59640 1 -- 172.21.15.6:0/2665550319 >> 172.21.15.6:0/2665550319 conn(0x7fc24c0cde90 msgr2=0x7fc24c153a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:27.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.104+0000 7fc250b59640 1 -- 172.21.15.6:0/2665550319 shutdown_connections 2023-07-21T22:38:27.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.104+0000 7fc250b59640 1 -- 172.21.15.6:0/2665550319 wait complete. 2023-07-21T22:38:27.170 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-21T22:38:27.171 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:38:27.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.272+0000 7f448dc34640 1 Processor -- start 2023-07-21T22:38:27.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.272+0000 7f448dc34640 1 -- start start 2023-07-21T22:38:27.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.272+0000 7f448dc34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44880d1850 0x7f44880d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:27.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.272+0000 7f448dc34640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44880ccaf0 con 0x7f448815fd60 2023-07-21T22:38:27.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.272+0000 7f448dc34640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4488160320 con 0x7f44880b7c70 2023-07-21T22:38:27.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.272+0000 7f448dc34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44880d1190 con 0x7f44880d1850 2023-07-21T22:38:27.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.272+0000 7f447ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f448815fd60 0x7f44880d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:47646/0 (socket says 172.21.15.6:47646) 2023-07-21T22:38:27.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.272+0000 7f447ffff640 1 -- 172.21.15.6:0/1903580259 learned_addr learned my addr 172.21.15.6:0/1903580259 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.272+0000 7f4487fff640 1 --2- 172.21.15.6:0/1903580259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44880d1850 0x7f44880d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.272+0000 7f4486ffd640 1 -- 172.21.15.6:0/1903580259 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108072744 0 0) 0x7f44880ccaf0 con 0x7f448815fd60 2023-07-21T22:38:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.272+0000 7f4486ffd640 1 -- 172.21.15.6:0/1903580259 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4474003530 con 0x7f448815fd60 2023-07-21T22:38:27.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.272+0000 7f4486ffd640 1 -- 172.21.15.6:0/1903580259 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359547851 0 0) 0x7f4488160320 con 0x7f44880b7c70 2023-07-21T22:38:27.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.272+0000 7f4486ffd640 1 -- 172.21.15.6:0/1903580259 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44880ccaf0 con 0x7f44880b7c70 2023-07-21T22:38:27.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.272+0000 7f4487fff640 1 -- 172.21.15.6:0/1903580259 >> v1:172.21.15.161:6789/0 conn(0x7f44880b7c70 legacy=0x7f448815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:27.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.272+0000 7f4487fff640 1 -- 172.21.15.6:0/1903580259 >> v1:172.21.15.6:6789/0 conn(0x7f448815fd60 legacy=0x7f44880d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:27.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.272+0000 7f4487fff640 1 -- 172.21.15.6:0/1903580259 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44880ccd90 con 0x7f44880d1850 2023-07-21T22:38:27.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.276+0000 7f4487fff640 1 --2- 172.21.15.6:0/1903580259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44880d1850 0x7f44880d0c50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4480009dc0 tx=0x7f448001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e92d61b5a04543d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:27.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.276+0000 7f4486ffd640 1 -- 172.21.15.6:0/1903580259 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800a5940 con 0x7f44880d1850 2023-07-21T22:38:27.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.276+0000 7f4486ffd640 1 -- 172.21.15.6:0/1903580259 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44800a5aa0 con 0x7f44880d1850 2023-07-21T22:38:27.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.276+0000 7f4486ffd640 1 -- 172.21.15.6:0/1903580259 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800a5e30 con 0x7f44880d1850 2023-07-21T22:38:27.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.276+0000 7f448dc34640 1 -- 172.21.15.6:0/1903580259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44880d1850 msgr2=0x7f44880d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:27.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.276+0000 7f448dc34640 1 --2- 172.21.15.6:0/1903580259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44880d1850 0x7f44880d0c50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4480009dc0 tx=0x7f448001c970 comp rx=0 tx=0).stop 2023-07-21T22:38:27.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.276+0000 7f448dc34640 1 -- 172.21.15.6:0/1903580259 shutdown_connections 2023-07-21T22:38:27.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.276+0000 7f448dc34640 1 --2- 172.21.15.6:0/1903580259 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44880d1850 0x7f44880d0c50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:27.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.276+0000 7f448dc34640 1 -- 172.21.15.6:0/1903580259 >> 172.21.15.6:0/1903580259 conn(0x7f44880650b0 msgr2=0x7f44880654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:27.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.276+0000 7f448dc34640 1 -- 172.21.15.6:0/1903580259 shutdown_connections 2023-07-21T22:38:27.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.276+0000 7f448dc34640 1 -- 172.21.15.6:0/1903580259 wait complete. 2023-07-21T22:38:27.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f448dc34640 1 Processor -- start 2023-07-21T22:38:27.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f448dc34640 1 -- start start 2023-07-21T22:38:27.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f448dc34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44880b7c70 0x7f44880ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:27.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f448dc34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44880d1850 0x7f4488151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:27.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f448dc34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f448815fd60 0x7f44881530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:27.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f448dc34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448814a140 con 0x7f44880d1850 2023-07-21T22:38:27.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f448dc34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44880b5260 con 0x7f448815fd60 2023-07-21T22:38:27.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f448dc34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448814b8a0 con 0x7f44880b7c70 2023-07-21T22:38:27.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f447ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44880d1850 0x7f4488151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:27.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f447ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44880d1850 0x7f4488151480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51808/0 (socket says 172.21.15.6:51808) 2023-07-21T22:38:27.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f447ffff640 1 -- 172.21.15.6:0/3466341965 learned_addr learned my addr 172.21.15.6:0/3466341965 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:27.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f44877fe640 1 --2- 172.21.15.6:0/3466341965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44880b7c70 0x7f44880ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:27.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f4487fff640 1 --2- 172.21.15.6:0/3466341965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f448815fd60 0x7f44881530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:27.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f447ffff640 1 -- 172.21.15.6:0/3466341965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44880b7c70 msgr2=0x7f44880ceaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:27.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f447ffff640 1 --2- 172.21.15.6:0/3466341965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44880b7c70 0x7f44880ceaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:27.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f447ffff640 1 -- 172.21.15.6:0/3466341965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f448815fd60 msgr2=0x7f44881530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:27.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f447ffff640 1 --2- 172.21.15.6:0/3466341965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f448815fd60 0x7f44881530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:27.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f447ffff640 1 -- 172.21.15.6:0/3466341965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4480009a70 con 0x7f44880d1850 2023-07-21T22:38:27.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f4487fff640 1 --2- 172.21.15.6:0/3466341965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f448815fd60 0x7f44881530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:27.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f447ffff640 1 --2- 172.21.15.6:0/3466341965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44880d1850 0x7f4488151480 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f447000c4d0 tx=0x7f447000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:27.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f4484ff9640 1 -- 172.21.15.6:0/3466341965 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4470005cf0 con 0x7f44880d1850 2023-07-21T22:38:27.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f4484ff9640 1 -- 172.21.15.6:0/3466341965 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4470005e50 con 0x7f44880d1850 2023-07-21T22:38:27.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f4484ff9640 1 -- 172.21.15.6:0/3466341965 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44700072b0 con 0x7f44880d1850 2023-07-21T22:38:27.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.280+0000 7f448dc34640 1 -- 172.21.15.6:0/3466341965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448814bb80 con 0x7f44880d1850 2023-07-21T22:38:27.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.284+0000 7f448dc34640 1 -- 172.21.15.6:0/3466341965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44881535e0 con 0x7f44880d1850 2023-07-21T22:38:27.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.284+0000 7f448dc34640 1 -- 172.21.15.6:0/3466341965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44880678d0 con 0x7f44880d1850 2023-07-21T22:38:27.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.284+0000 7f4484ff9640 1 -- 172.21.15.6:0/3466341965 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4470007410 con 0x7f44880d1850 2023-07-21T22:38:27.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.284+0000 7f4484ff9640 1 --2- 172.21.15.6:0/3466341965 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f44680663d0 0x7f4468068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:27.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.284+0000 7f4484ff9640 1 -- 172.21.15.6:0/3466341965 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f44700833a0 con 0x7f44880d1850 2023-07-21T22:38:27.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.284+0000 7f44877fe640 1 --2- 172.21.15.6:0/3466341965 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f44680663d0 0x7f4468068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:27.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.288+0000 7f44877fe640 1 --2- 172.21.15.6:0/3466341965 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f44680663d0 0x7f4468068880 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f44780011f0 tx=0x7f4478009040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:27.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.288+0000 7f4484ff9640 1 -- 172.21.15.6:0/3466341965 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44700507a0 con 0x7f44880d1850 2023-07-21T22:38:27.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.480+0000 7f448dc34640 1 -- 172.21.15.6:0/3466341965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f448814c030 con 0x7f44880d1850 2023-07-21T22:38:27.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.480+0000 7f4484ff9640 1 -- 172.21.15.6:0/3466341965 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4664 (secure 0 0 0) 0x7f4470053dc0 con 0x7f44880d1850 2023-07-21T22:38:27.527 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:27.527 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1816246921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1816246921},{"type":"v1","addr":"172.21.15.6:6834","nonce":1816246921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7490,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/543588806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":543588806},{"type":"v1","addr":"172.21.15.6:6835","nonce":543588806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3250690150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3250690150},{"type":"v1","addr":"172.21.15.161:6836","nonce":3250690150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:38:23.444629+0000","modified":"2023-07-21T22:38:27.099144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8455":{"gid":8455,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/29499426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":29499426},{"type":"v1","addr":"172.21.15.161:6837","nonce":29499426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-21T22:38:27.528 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 62 2023-07-21T22:38:27.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.484+0000 7f448dc34640 1 -- 172.21.15.6:0/3466341965 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f44680663d0 msgr2=0x7f4468068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:27.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.484+0000 7f448dc34640 1 --2- 172.21.15.6:0/3466341965 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f44680663d0 0x7f4468068880 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f44780011f0 tx=0x7f4478009040 comp rx=0 tx=0).stop 2023-07-21T22:38:27.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.484+0000 7f448dc34640 1 -- 172.21.15.6:0/3466341965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44880d1850 msgr2=0x7f4488151480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:27.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.484+0000 7f448dc34640 1 --2- 172.21.15.6:0/3466341965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44880d1850 0x7f4488151480 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f447000c4d0 tx=0x7f447000c990 comp rx=0 tx=0).stop 2023-07-21T22:38:27.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.484+0000 7f448dc34640 1 -- 172.21.15.6:0/3466341965 shutdown_connections 2023-07-21T22:38:27.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.484+0000 7f448dc34640 1 --2- 172.21.15.6:0/3466341965 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f44680663d0 0x7f4468068880 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:27.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.484+0000 7f448dc34640 1 --2- 172.21.15.6:0/3466341965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f448815fd60 0x7f44881530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:27.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.484+0000 7f448dc34640 1 --2- 172.21.15.6:0/3466341965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44880d1850 0x7f4488151480 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:27.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.484+0000 7f448dc34640 1 --2- 172.21.15.6:0/3466341965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44880b7c70 0x7f44880ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:27.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.484+0000 7f448dc34640 1 -- 172.21.15.6:0/3466341965 >> 172.21.15.6:0/3466341965 conn(0x7f44880650b0 msgr2=0x7f44880b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:27.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.484+0000 7f448dc34640 1 -- 172.21.15.6:0/3466341965 shutdown_connections 2023-07-21T22:38:27.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.484+0000 7f448dc34640 1 -- 172.21.15.6:0/3466341965 wait complete. 2023-07-21T22:38:27.548 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:38:27.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.648+0000 7fdf5f419640 1 Processor -- start 2023-07-21T22:38:27.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.648+0000 7fdf5f419640 1 -- start start 2023-07-21T22:38:27.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.648+0000 7fdf5f419640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdf580d06b0 0x7fdf580b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:27.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.648+0000 7fdf5f419640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf58145430 0x7fdf580b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:27.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.648+0000 7fdf5f419640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf580b2410 con 0x7fdf580b1f70 2023-07-21T22:38:27.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.648+0000 7fdf5f419640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf580b26f0 con 0x7fdf580d06b0 2023-07-21T22:38:27.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.648+0000 7fdf5f419640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf580b29d0 con 0x7fdf58145430 2023-07-21T22:38:27.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.648+0000 7fdf5d1b5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdf580d06b0 0x7fdf580b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:27.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.648+0000 7fdf5c9b4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf58145430 0x7fdf580b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:27.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.648+0000 7fdf5d9b6640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fdf580b1f70 0x7fdf580d22e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:43098/0 (socket says 172.21.15.6:43098) 2023-07-21T22:38:27.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.648+0000 7fdf5d9b6640 1 -- 172.21.15.6:0/2987635462 learned_addr learned my addr 172.21.15.6:0/2987635462 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:27.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.648+0000 7fdf4ffff640 1 -- 172.21.15.6:0/2987635462 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3852900634 0 0) 0x7fdf580b2410 con 0x7fdf580b1f70 2023-07-21T22:38:27.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.648+0000 7fdf4ffff640 1 -- 172.21.15.6:0/2987635462 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf44003530 con 0x7fdf580b1f70 2023-07-21T22:38:27.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.648+0000 7fdf5d1b5640 1 -- 172.21.15.6:0/2987635462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf58145430 msgr2=0x7fdf580b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:27.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.648+0000 7fdf5d1b5640 1 --2- 172.21.15.6:0/2987635462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf58145430 0x7fdf580b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:27.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.648+0000 7fdf5d1b5640 1 -- 172.21.15.6:0/2987635462 >> v1:172.21.15.161:6789/0 conn(0x7fdf580b1f70 legacy=0x7fdf580d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:27.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.648+0000 7fdf5d1b5640 1 -- 172.21.15.6:0/2987635462 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf580b2cb0 con 0x7fdf580d06b0 2023-07-21T22:38:27.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.648+0000 7fdf5c9b4640 1 --2- 172.21.15.6:0/2987635462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf58145430 0x7fdf580b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:27.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.652+0000 7fdf5d1b5640 1 --2- 172.21.15.6:0/2987635462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf580d06b0 0x7fdf580b1a30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fdf540097c0 tx=0x7fdf5401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e05e7abfb4233223 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:27.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.652+0000 7fdf4ffff640 1 -- 172.21.15.6:0/2987635462 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf540ab670 con 0x7fdf580d06b0 2023-07-21T22:38:27.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.652+0000 7fdf4ffff640 1 -- 172.21.15.6:0/2987635462 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf540ab7d0 con 0x7fdf580d06b0 2023-07-21T22:38:27.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.652+0000 7fdf4ffff640 1 -- 172.21.15.6:0/2987635462 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf540abb60 con 0x7fdf580d06b0 2023-07-21T22:38:27.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.652+0000 7fdf5f419640 1 -- 172.21.15.6:0/2987635462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf580d06b0 msgr2=0x7fdf580b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:27.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.652+0000 7fdf5f419640 1 --2- 172.21.15.6:0/2987635462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf580d06b0 0x7fdf580b1a30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fdf540097c0 tx=0x7fdf5401c450 comp rx=0 tx=0).stop 2023-07-21T22:38:27.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.652+0000 7fdf5f419640 1 -- 172.21.15.6:0/2987635462 shutdown_connections 2023-07-21T22:38:27.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.652+0000 7fdf5f419640 1 --2- 172.21.15.6:0/2987635462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf58145430 0x7fdf580b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:27.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.652+0000 7fdf5f419640 1 --2- 172.21.15.6:0/2987635462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf580d06b0 0x7fdf580b1a30 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:27.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.652+0000 7fdf5f419640 1 -- 172.21.15.6:0/2987635462 >> 172.21.15.6:0/2987635462 conn(0x7fdf580659d0 msgr2=0x7fdf5809b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:27.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.652+0000 7fdf5f419640 1 -- 172.21.15.6:0/2987635462 shutdown_connections 2023-07-21T22:38:27.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.652+0000 7fdf5f419640 1 -- 172.21.15.6:0/2987635462 wait complete. 2023-07-21T22:38:27.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5f419640 1 Processor -- start 2023-07-21T22:38:27.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5f419640 1 -- start start 2023-07-21T22:38:27.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5f419640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf580b1f70 0x7fdf58153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:27.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5f419640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf580d06b0 0x7fdf581535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:27.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5f419640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf5815bb60 0x7fdf580b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:27.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5f419640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf581552a0 con 0x7fdf580d06b0 2023-07-21T22:38:27.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5f419640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf58154380 con 0x7fdf580b1f70 2023-07-21T22:38:27.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5f419640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf58154620 con 0x7fdf5815bb60 2023-07-21T22:38:27.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5c9b4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf580d06b0 0x7fdf581535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:27.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5c9b4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf580d06b0 0x7fdf581535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45448/0 (socket says 172.21.15.6:45448) 2023-07-21T22:38:27.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5c9b4640 1 -- 172.21.15.6:0/665212554 learned_addr learned my addr 172.21.15.6:0/665212554 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:27.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5d9b6640 1 --2- 172.21.15.6:0/665212554 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf5815bb60 0x7fdf580b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:27.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5d1b5640 1 --2- 172.21.15.6:0/665212554 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf580b1f70 0x7fdf58153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:27.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5c9b4640 1 -- 172.21.15.6:0/665212554 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf5815bb60 msgr2=0x7fdf580b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:27.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5c9b4640 1 --2- 172.21.15.6:0/665212554 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf5815bb60 0x7fdf580b3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:27.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5c9b4640 1 -- 172.21.15.6:0/665212554 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf580b1f70 msgr2=0x7fdf58153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:27.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5c9b4640 1 --2- 172.21.15.6:0/665212554 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf580b1f70 0x7fdf58153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:27.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5c9b4640 1 -- 172.21.15.6:0/665212554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf48009420 con 0x7fdf580d06b0 2023-07-21T22:38:27.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5c9b4640 1 --2- 172.21.15.6:0/665212554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf580d06b0 0x7fdf581535c0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800ebe0 tx=0x7fdf4800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:27.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf4dffb640 1 -- 172.21.15.6:0/665212554 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4800eee0 con 0x7fdf580d06b0 2023-07-21T22:38:27.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf4dffb640 1 -- 172.21.15.6:0/665212554 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4800cc30 con 0x7fdf580d06b0 2023-07-21T22:38:27.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5f419640 1 -- 172.21.15.6:0/665212554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf54009420 con 0x7fdf580d06b0 2023-07-21T22:38:27.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf4dffb640 1 -- 172.21.15.6:0/665212554 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf48013470 con 0x7fdf580d06b0 2023-07-21T22:38:27.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.656+0000 7fdf5f419640 1 -- 172.21.15.6:0/665212554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf58154be0 con 0x7fdf580d06b0 2023-07-21T22:38:27.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.660+0000 7fdf5f419640 1 -- 172.21.15.6:0/665212554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf58072e70 con 0x7fdf580d06b0 2023-07-21T22:38:27.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.660+0000 7fdf4dffb640 1 -- 172.21.15.6:0/665212554 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdf480135d0 con 0x7fdf580d06b0 2023-07-21T22:38:27.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.660+0000 7fdf4dffb640 1 --2- 172.21.15.6:0/665212554 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fdf3c0663a0 0x7fdf3c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:27.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.660+0000 7fdf4dffb640 1 -- 172.21.15.6:0/665212554 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fdf48084100 con 0x7fdf580d06b0 2023-07-21T22:38:27.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.660+0000 7fdf5d1b5640 1 --2- 172.21.15.6:0/665212554 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fdf3c0663a0 0x7fdf3c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:27.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.660+0000 7fdf5d1b5640 1 --2- 172.21.15.6:0/665212554 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fdf3c0663a0 0x7fdf3c068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdf540af000 tx=0x7fdf540a7000 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:27.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.664+0000 7fdf4dffb640 1 -- 172.21.15.6:0/665212554 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdf480514c0 con 0x7fdf580d06b0 2023-07-21T22:38:27.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.824+0000 7fdf5f419640 1 -- 172.21.15.6:0/665212554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf580678d0 con 0x7fdf580d06b0 2023-07-21T22:38:27.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.824+0000 7fdf4dffb640 1 -- 172.21.15.6:0/665212554 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+18404 (secure 0 0 0) 0x7fdf48054ae0 con 0x7fdf580d06b0 2023-07-21T22:38:27.869 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:27.869 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":143,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:38:25.068037+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:38:21.546383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-21T22:38:22.445128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:38:27.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.824+0000 7fdf5f419640 1 -- 172.21.15.6:0/665212554 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fdf3c0663a0 msgr2=0x7fdf3c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:27.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.824+0000 7fdf5f419640 1 --2- 172.21.15.6:0/665212554 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fdf3c0663a0 0x7fdf3c068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdf540af000 tx=0x7fdf540a7000 comp rx=0 tx=0).stop 2023-07-21T22:38:27.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.824+0000 7fdf5f419640 1 -- 172.21.15.6:0/665212554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf580d06b0 msgr2=0x7fdf581535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:27.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.824+0000 7fdf5f419640 1 --2- 172.21.15.6:0/665212554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf580d06b0 0x7fdf581535c0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800ebe0 tx=0x7fdf4800c520 comp rx=0 tx=0).stop 2023-07-21T22:38:27.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.824+0000 7fdf5f419640 1 -- 172.21.15.6:0/665212554 shutdown_connections 2023-07-21T22:38:27.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.824+0000 7fdf5f419640 1 --2- 172.21.15.6:0/665212554 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fdf3c0663a0 0x7fdf3c068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:27.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.824+0000 7fdf5f419640 1 --2- 172.21.15.6:0/665212554 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf5815bb60 0x7fdf580b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:27.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.824+0000 7fdf5f419640 1 --2- 172.21.15.6:0/665212554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf580d06b0 0x7fdf581535c0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:27.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.824+0000 7fdf5f419640 1 --2- 172.21.15.6:0/665212554 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf580b1f70 0x7fdf58153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.824+0000 7fdf5f419640 1 -- 172.21.15.6:0/665212554 >> 172.21.15.6:0/665212554 conn(0x7fdf580659d0 msgr2=0x7fdf580afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.824+0000 7fdf5f419640 1 -- 172.21.15.6:0/665212554 shutdown_connections 2023-07-21T22:38:27.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.824+0000 7fdf5f419640 1 -- 172.21.15.6:0/665212554 wait complete. 2023-07-21T22:38:27.891 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T22:38:27.891 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:38:28.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.992+0000 7efee872c640 1 Processor -- start 2023-07-21T22:38:28.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.992+0000 7efee872c640 1 -- start start 2023-07-21T22:38:28.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.992+0000 7efee872c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efee00b7c70 0x7efee00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:28.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.992+0000 7efee872c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee00ccaf0 con 0x7efee015fd60 2023-07-21T22:38:28.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.992+0000 7efee872c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee0160320 con 0x7efee00d1850 2023-07-21T22:38:28.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.992+0000 7efee872c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee00d1190 con 0x7efee00b7c70 2023-07-21T22:38:28.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.992+0000 7efee64c8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efee00b7c70 0x7efee00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:28.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.992+0000 7efee6cc9640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efee015fd60 0x7efee00d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52568/0 (socket says 172.21.15.6:52568) 2023-07-21T22:38:28.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.992+0000 7efee6cc9640 1 -- 172.21.15.6:0/4010176098 learned_addr learned my addr 172.21.15.6:0/4010176098 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:28.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.992+0000 7efee64c8640 1 -- 172.21.15.6:0/4010176098 >> v1:172.21.15.161:6789/0 conn(0x7efee00d1850 legacy=0x7efee015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:28.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.992+0000 7efee64c8640 1 -- 172.21.15.6:0/4010176098 >> v1:172.21.15.6:6789/0 conn(0x7efee015fd60 legacy=0x7efee00d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:28.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.992+0000 7efee64c8640 1 -- 172.21.15.6:0/4010176098 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee00ccd90 con 0x7efee00b7c70 2023-07-21T22:38:28.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.992+0000 7efee54c6640 1 -- 172.21.15.6:0/4010176098 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177926946 0 0) 0x7efee00ccaf0 con 0x7efee015fd60 2023-07-21T22:38:28.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.996+0000 7efee64c8640 1 --2- 172.21.15.6:0/4010176098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efee00b7c70 0x7efee00d0c50 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7efedc0097c0 tx=0x7efedc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c3310da489d01d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:28.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.996+0000 7efee54c6640 1 -- 172.21.15.6:0/4010176098 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc004230 con 0x7efee00b7c70 2023-07-21T22:38:28.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.996+0000 7efee54c6640 1 -- 172.21.15.6:0/4010176098 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efedc0a7050 con 0x7efee00b7c70 2023-07-21T22:38:28.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.996+0000 7efee54c6640 1 -- 172.21.15.6:0/4010176098 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc003620 con 0x7efee00b7c70 2023-07-21T22:38:28.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.996+0000 7efee872c640 1 -- 172.21.15.6:0/4010176098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efee00b7c70 msgr2=0x7efee00d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:28.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.996+0000 7efee872c640 1 --2- 172.21.15.6:0/4010176098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efee00b7c70 0x7efee00d0c50 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7efedc0097c0 tx=0x7efedc01c440 comp rx=0 tx=0).stop 2023-07-21T22:38:28.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.996+0000 7efee872c640 1 -- 172.21.15.6:0/4010176098 shutdown_connections 2023-07-21T22:38:28.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.996+0000 7efee872c640 1 --2- 172.21.15.6:0/4010176098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efee00b7c70 0x7efee00d0c50 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.996+0000 7efee872c640 1 -- 172.21.15.6:0/4010176098 >> 172.21.15.6:0/4010176098 conn(0x7efee00650b0 msgr2=0x7efee00654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:28.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.996+0000 7efee872c640 1 -- 172.21.15.6:0/4010176098 shutdown_connections 2023-07-21T22:38:28.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.996+0000 7efee872c640 1 -- 172.21.15.6:0/4010176098 wait complete. 2023-07-21T22:38:28.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:27.996+0000 7efee872c640 1 Processor -- start 2023-07-21T22:38:28.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee872c640 1 -- start start 2023-07-21T22:38:28.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee872c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efee00b7c70 0x7efee014db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:28.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee872c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee00d1850 0x7efee0153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:28.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee872c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efee015fd60 0x7efee01565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:28.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee872c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee00c95e0 con 0x7efee015fd60 2023-07-21T22:38:28.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee872c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee015c1d0 con 0x7efee00d1850 2023-07-21T22:38:28.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee872c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee015c4b0 con 0x7efee00b7c70 2023-07-21T22:38:28.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee6cc9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efee015fd60 0x7efee01565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:28.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee6cc9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efee015fd60 0x7efee01565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45458/0 (socket says 172.21.15.6:45458) 2023-07-21T22:38:28.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee6cc9640 1 -- 172.21.15.6:0/1070361666 learned_addr learned my addr 172.21.15.6:0/1070361666 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:28.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee5cc7640 1 --2- 172.21.15.6:0/1070361666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee00d1850 0x7efee0153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:28.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee64c8640 1 --2- 172.21.15.6:0/1070361666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efee00b7c70 0x7efee014db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:28.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee6cc9640 1 -- 172.21.15.6:0/1070361666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efee00b7c70 msgr2=0x7efee014db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:28.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee6cc9640 1 --2- 172.21.15.6:0/1070361666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efee00b7c70 0x7efee014db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee6cc9640 1 -- 172.21.15.6:0/1070361666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee00d1850 msgr2=0x7efee0153600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:28.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee6cc9640 1 --2- 172.21.15.6:0/1070361666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee00d1850 0x7efee0153600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee6cc9640 1 -- 172.21.15.6:0/1070361666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efedc009420 con 0x7efee015fd60 2023-07-21T22:38:28.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee5cc7640 1 --2- 172.21.15.6:0/1070361666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee00d1850 0x7efee0153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:28.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee6cc9640 1 --2- 172.21.15.6:0/1070361666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efee015fd60 0x7efee01565a0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7efed8001570 tx=0x7efed800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:28.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efed6ffd640 1 -- 172.21.15.6:0/1070361666 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed800a640 con 0x7efee015fd60 2023-07-21T22:38:28.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efed6ffd640 1 -- 172.21.15.6:0/1070361666 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed800a7c0 con 0x7efee015fd60 2023-07-21T22:38:28.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efed6ffd640 1 -- 172.21.15.6:0/1070361666 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed800ab70 con 0x7efee015fd60 2023-07-21T22:38:28.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee872c640 1 -- 172.21.15.6:0/1070361666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee015c790 con 0x7efee015fd60 2023-07-21T22:38:28.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee872c640 1 -- 172.21.15.6:0/1070361666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee015cd50 con 0x7efee015fd60 2023-07-21T22:38:28.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.000+0000 7efee872c640 1 -- 172.21.15.6:0/1070361666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee015cf70 con 0x7efee015fd60 2023-07-21T22:38:28.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.004+0000 7efed6ffd640 1 -- 172.21.15.6:0/1070361666 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efed800acd0 con 0x7efee015fd60 2023-07-21T22:38:28.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.004+0000 7efed6ffd640 1 --2- 172.21.15.6:0/1070361666 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7efec40663a0 0x7efec4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:28.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.004+0000 7efed6ffd640 1 -- 172.21.15.6:0/1070361666 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6134+0+0 (secure 0 0 0) 0x7efed80835d0 con 0x7efee015fd60 2023-07-21T22:38:28.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.004+0000 7efee64c8640 1 --2- 172.21.15.6:0/1070361666 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7efec40663a0 0x7efec4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:28.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.004+0000 7efee64c8640 1 --2- 172.21.15.6:0/1070361666 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7efec40663a0 0x7efec4068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efedc0ad000 tx=0x7efedc008040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:28.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.008+0000 7efed6ffd640 1 -- 172.21.15.6:0/1070361666 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efed80507c0 con 0x7efee015fd60 2023-07-21T22:38:28.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.160+0000 7efee872c640 1 -- 172.21.15.6:0/1070361666 --> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efee00678d0 con 0x7efec40663a0 2023-07-21T22:38:28.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.172+0000 7efed6ffd640 1 -- 172.21.15.6:0/1070361666 <== mgr.7307 v2:172.21.15.161:6832/3436422767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306205 (secure 0 0 0) 0x7efee00678d0 con 0x7efec40663a0 2023-07-21T22:38:28.220 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:28.221 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:38:28.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.176+0000 7efee872c640 1 -- 172.21.15.6:0/1070361666 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7efec40663a0 msgr2=0x7efec4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:28.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.176+0000 7efee872c640 1 --2- 172.21.15.6:0/1070361666 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7efec40663a0 0x7efec4068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efedc0ad000 tx=0x7efedc008040 comp rx=0 tx=0).stop 2023-07-21T22:38:28.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.176+0000 7efee872c640 1 -- 172.21.15.6:0/1070361666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efee015fd60 msgr2=0x7efee01565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:28.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.176+0000 7efee872c640 1 --2- 172.21.15.6:0/1070361666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efee015fd60 0x7efee01565a0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7efed8001570 tx=0x7efed800cca0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.176+0000 7efee872c640 1 -- 172.21.15.6:0/1070361666 shutdown_connections 2023-07-21T22:38:28.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.176+0000 7efee872c640 1 --2- 172.21.15.6:0/1070361666 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7efec40663a0 0x7efec4068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.176+0000 7efee872c640 1 --2- 172.21.15.6:0/1070361666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efee015fd60 0x7efee01565a0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.176+0000 7efee872c640 1 --2- 172.21.15.6:0/1070361666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee00d1850 0x7efee0153600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.176+0000 7efee872c640 1 --2- 172.21.15.6:0/1070361666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efee00b7c70 0x7efee014db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.176+0000 7efee872c640 1 -- 172.21.15.6:0/1070361666 >> 172.21.15.6:0/1070361666 conn(0x7efee00650b0 msgr2=0x7efee00b7020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:28.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.176+0000 7efee872c640 1 -- 172.21.15.6:0/1070361666 shutdown_connections 2023-07-21T22:38:28.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.176+0000 7efee872c640 1 -- 172.21.15.6:0/1070361666 wait complete. 2023-07-21T22:38:28.240 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-21T22:38:27.720112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":337732,"kb_used_data":14724,"kb_used_omap":0,"kb_used_meta":322944,"kb_avail":754636988,"statfs":{"total":773094113280,"available":772748275712,"internally_reserved":0,"allocated":15077376,"data_stored":8205548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":330694656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.669685"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058704+0000","last_change":"2023-07-21T22:38:23.058704+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058704+0000","last_undegraded":"2023-07-21T22:38:23.058704+0000","last_fullsized":"2023-07-21T22:38:23.058704+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.060174+0000","last_change":"2023-07-21T22:38:23.060174+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.060174+0000","last_undegraded":"2023-07-21T22:38:23.060174+0000","last_fullsized":"2023-07-21T22:38:23.060174+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.060115+0000","last_change":"2023-07-21T22:38:23.060115+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.060115+0000","last_undegraded":"2023-07-21T22:38:23.060115+0000","last_fullsized":"2023-07-21T22:38:23.060115+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.064006+0000","last_change":"2023-07-21T22:38:23.064006+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.064006+0000","last_undegraded":"2023-07-21T22:38:23.064006+0000","last_fullsized":"2023-07-21T22:38:23.064006+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058516+0000","last_change":"2023-07-21T22:38:23.058516+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058516+0000","last_undegraded":"2023-07-21T22:38:23.058516+0000","last_fullsized":"2023-07-21T22:38:23.058516+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058277+0000","last_change":"2023-07-21T22:38:23.058277+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058277+0000","last_undegraded":"2023-07-21T22:38:23.058277+0000","last_fullsized":"2023-07-21T22:38:23.058277+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058518+0000","last_change":"2023-07-21T22:38:23.058518+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058518+0000","last_undegraded":"2023-07-21T22:38:23.058518+0000","last_fullsized":"2023-07-21T22:38:23.058518+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.059899+0000","last_change":"2023-07-21T22:38:23.059899+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.059899+0000","last_undegraded":"2023-07-21T22:38:23.059899+0000","last_fullsized":"2023-07-21T22:38:23.059899+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.064880+0000","last_change":"2023-07-21T22:38:23.064880+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.064880+0000","last_undegraded":"2023-07-21T22:38:23.064880+0000","last_fullsized":"2023-07-21T22:38:23.064880+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054804+0000","last_change":"2023-07-21T22:38:23.054804+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054804+0000","last_undegraded":"2023-07-21T22:38:23.054804+0000","last_fullsized":"2023-07-21T22:38:23.054804+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056794+0000","last_change":"2023-07-21T22:38:23.056794+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056794+0000","last_undegraded":"2023-07-21T22:38:23.056794+0000","last_fullsized":"2023-07-21T22:38:23.056794+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.059734+0000","last_change":"2023-07-21T22:38:23.059734+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.059734+0000","last_undegraded":"2023-07-21T22:38:23.059734+0000","last_fullsized":"2023-07-21T22:38:23.059734+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.055336+0000","last_change":"2023-07-21T22:38:23.055336+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.055336+0000","last_undegraded":"2023-07-21T22:38:23.055336+0000","last_fullsized":"2023-07-21T22:38:23.055336+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.059023+0000","last_change":"2023-07-21T22:38:23.059023+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.059023+0000","last_undegraded":"2023-07-21T22:38:23.059023+0000","last_fullsized":"2023-07-21T22:38:23.059023+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.057190+0000","last_change":"2023-07-21T22:38:23.057190+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.057190+0000","last_undegraded":"2023-07-21T22:38:23.057190+0000","last_fullsized":"2023-07-21T22:38:23.057190+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.060985+0000","last_change":"2023-07-21T22:38:23.060985+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.060985+0000","last_undegraded":"2023-07-21T22:38:23.060985+0000","last_fullsized":"2023-07-21T22:38:23.060985+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054305+0000","last_change":"2023-07-21T22:38:23.054305+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054305+0000","last_undegraded":"2023-07-21T22:38:23.054305+0000","last_fullsized":"2023-07-21T22:38:23.054305+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056444+0000","last_change":"2023-07-21T22:38:23.056444+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056444+0000","last_undegraded":"2023-07-21T22:38:23.056444+0000","last_fullsized":"2023-07-21T22:38:23.056444+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.065397+0000","last_change":"2023-07-21T22:38:23.065397+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.065397+0000","last_undegraded":"2023-07-21T22:38:23.065397+0000","last_fullsized":"2023-07-21T22:38:23.065397+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054217+0000","last_change":"2023-07-21T22:38:23.054217+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054217+0000","last_undegraded":"2023-07-21T22:38:23.054217+0000","last_fullsized":"2023-07-21T22:38:23.054217+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.064516+0000","last_change":"2023-07-21T22:38:23.064516+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.064516+0000","last_undegraded":"2023-07-21T22:38:23.064516+0000","last_fullsized":"2023-07-21T22:38:23.064516+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058638+0000","last_change":"2023-07-21T22:38:23.058638+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058638+0000","last_undegraded":"2023-07-21T22:38:23.058638+0000","last_fullsized":"2023-07-21T22:38:23.058638+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.065753+0000","last_change":"2023-07-21T22:38:23.065753+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.065753+0000","last_undegraded":"2023-07-21T22:38:23.065753+0000","last_fullsized":"2023-07-21T22:38:23.065753+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056721+0000","last_change":"2023-07-21T22:38:23.056721+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056721+0000","last_undegraded":"2023-07-21T22:38:23.056721+0000","last_fullsized":"2023-07-21T22:38:23.056721+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.059483+0000","last_change":"2023-07-21T22:38:23.059483+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.059483+0000","last_undegraded":"2023-07-21T22:38:23.059483+0000","last_fullsized":"2023-07-21T22:38:23.059483+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054539+0000","last_change":"2023-07-21T22:38:23.054539+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054539+0000","last_undegraded":"2023-07-21T22:38:23.054539+0000","last_fullsized":"2023-07-21T22:38:23.054539+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.063166+0000","last_change":"2023-07-21T22:38:23.063166+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.063166+0000","last_undegraded":"2023-07-21T22:38:23.063166+0000","last_fullsized":"2023-07-21T22:38:23.063166+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.059287+0000","last_change":"2023-07-21T22:38:23.059287+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.059287+0000","last_undegraded":"2023-07-21T22:38:23.059287+0000","last_fullsized":"2023-07-21T22:38:23.059287+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054429+0000","last_change":"2023-07-21T22:38:23.054429+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054429+0000","last_undegraded":"2023-07-21T22:38:23.054429+0000","last_fullsized":"2023-07-21T22:38:23.054429+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.057369+0000","last_change":"2023-07-21T22:38:23.057369+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.057369+0000","last_undegraded":"2023-07-21T22:38:23.057369+0000","last_fullsized":"2023-07-21T22:38:23.057369+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056551+0000","last_change":"2023-07-21T22:38:23.056551+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056551+0000","last_undegraded":"2023-07-21T22:38:23.056551+0000","last_fullsized":"2023-07-21T22:38:23.056551+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056100+0000","last_change":"2023-07-21T22:38:23.056100+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056100+0000","last_undegraded":"2023-07-21T22:38:23.056100+0000","last_fullsized":"2023-07-21T22:38:23.056100+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054362+0000","last_change":"2023-07-21T22:38:23.054362+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054362+0000","last_undegraded":"2023-07-21T22:38:23.054362+0000","last_fullsized":"2023-07-21T22:38:23.054362+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.075979+0000","last_change":"2023-07-21T22:38:23.071766+0000","last_active":"2023-07-21T22:38:23.075979+0000","last_peered":"2023-07-21T22:38:23.075979+0000","last_clean":"2023-07-21T22:38:23.075979+0000","last_became_active":"2023-07-21T22:38:23.071479+0000","last_became_peered":"2023-07-21T22:38:23.071479+0000","last_unstale":"2023-07-21T22:38:23.075979+0000","last_undegraded":"2023-07-21T22:38:23.075979+0000","last_fullsized":"2023-07-21T22:38:23.075979+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:31:02.781796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058884+0000","last_change":"2023-07-21T22:38:23.058884+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058884+0000","last_undegraded":"2023-07-21T22:38:23.058884+0000","last_fullsized":"2023-07-21T22:38:23.058884+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.063953+0000","last_change":"2023-07-21T22:38:23.061581+0000","last_active":"2023-07-21T22:38:23.063953+0000","last_peered":"2023-07-21T22:38:23.063953+0000","last_clean":"2023-07-21T22:38:23.063953+0000","last_became_active":"2023-07-21T22:38:23.061317+0000","last_became_peered":"2023-07-21T22:38:23.061317+0000","last_unstale":"2023-07-21T22:38:23.063953+0000","last_undegraded":"2023-07-21T22:38:23.063953+0000","last_fullsized":"2023-07-21T22:38:23.063953+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:25:32.838226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.057681+0000","last_change":"2023-07-21T22:38:23.057681+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.057681+0000","last_undegraded":"2023-07-21T22:38:23.057681+0000","last_fullsized":"2023-07-21T22:38:23.057681+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.083881+0000","last_change":"2023-07-21T22:38:23.076553+0000","last_active":"2023-07-21T22:38:23.083881+0000","last_peered":"2023-07-21T22:38:23.083881+0000","last_clean":"2023-07-21T22:38:23.083881+0000","last_became_active":"2023-07-21T22:38:23.076250+0000","last_became_peered":"2023-07-21T22:38:23.076250+0000","last_unstale":"2023-07-21T22:38:23.083881+0000","last_undegraded":"2023-07-21T22:38:23.083881+0000","last_fullsized":"2023-07-21T22:38:23.083881+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:32:38.947160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.064400+0000","last_change":"2023-07-21T22:38:23.064400+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.064400+0000","last_undegraded":"2023-07-21T22:38:23.064400+0000","last_fullsized":"2023-07-21T22:38:23.064400+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.063335+0000","last_change":"2023-07-21T22:38:23.061237+0000","last_active":"2023-07-21T22:38:23.063335+0000","last_peered":"2023-07-21T22:38:23.063335+0000","last_clean":"2023-07-21T22:38:23.063335+0000","last_became_active":"2023-07-21T22:38:23.060950+0000","last_became_peered":"2023-07-21T22:38:23.060950+0000","last_unstale":"2023-07-21T22:38:23.063335+0000","last_undegraded":"2023-07-21T22:38:23.063335+0000","last_fullsized":"2023-07-21T22:38:23.063335+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:22:35.983664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.052966+0000","last_change":"2023-07-21T22:38:23.052966+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.052966+0000","last_undegraded":"2023-07-21T22:38:23.052966+0000","last_fullsized":"2023-07-21T22:38:23.052966+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.071069+0000","last_change":"2023-07-21T22:38:23.067155+0000","last_active":"2023-07-21T22:38:23.071069+0000","last_peered":"2023-07-21T22:38:23.071069+0000","last_clean":"2023-07-21T22:38:23.071069+0000","last_became_active":"2023-07-21T22:38:23.066836+0000","last_became_peered":"2023-07-21T22:38:23.066836+0000","last_unstale":"2023-07-21T22:38:23.071069+0000","last_undegraded":"2023-07-21T22:38:23.071069+0000","last_fullsized":"2023-07-21T22:38:23.071069+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:07:37.597596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056682+0000","last_change":"2023-07-21T22:38:23.056682+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056682+0000","last_undegraded":"2023-07-21T22:38:23.056682+0000","last_fullsized":"2023-07-21T22:38:23.056682+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.074401+0000","last_change":"2023-07-21T22:38:23.071033+0000","last_active":"2023-07-21T22:38:23.074401+0000","last_peered":"2023-07-21T22:38:23.074401+0000","last_clean":"2023-07-21T22:38:23.074401+0000","last_became_active":"2023-07-21T22:38:23.070744+0000","last_became_peered":"2023-07-21T22:38:23.070744+0000","last_unstale":"2023-07-21T22:38:23.074401+0000","last_undegraded":"2023-07-21T22:38:23.074401+0000","last_fullsized":"2023-07-21T22:38:23.074401+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:26:48.570149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056861+0000","last_change":"2023-07-21T22:38:23.056861+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056861+0000","last_undegraded":"2023-07-21T22:38:23.056861+0000","last_fullsized":"2023-07-21T22:38:23.056861+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.072250+0000","last_change":"2023-07-21T22:38:23.069579+0000","last_active":"2023-07-21T22:38:23.072250+0000","last_peered":"2023-07-21T22:38:23.072250+0000","last_clean":"2023-07-21T22:38:23.072250+0000","last_became_active":"2023-07-21T22:38:23.069255+0000","last_became_peered":"2023-07-21T22:38:23.069255+0000","last_unstale":"2023-07-21T22:38:23.072250+0000","last_undegraded":"2023-07-21T22:38:23.072250+0000","last_fullsized":"2023-07-21T22:38:23.072250+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:34:06.885474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054770+0000","last_change":"2023-07-21T22:38:23.054770+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054770+0000","last_undegraded":"2023-07-21T22:38:23.054770+0000","last_fullsized":"2023-07-21T22:38:23.054770+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.075743+0000","last_change":"2023-07-21T22:38:23.072024+0000","last_active":"2023-07-21T22:38:23.075743+0000","last_peered":"2023-07-21T22:38:23.075743+0000","last_clean":"2023-07-21T22:38:23.075743+0000","last_became_active":"2023-07-21T22:38:23.071738+0000","last_became_peered":"2023-07-21T22:38:23.071738+0000","last_unstale":"2023-07-21T22:38:23.075743+0000","last_undegraded":"2023-07-21T22:38:23.075743+0000","last_fullsized":"2023-07-21T22:38:23.075743+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:26:55.203317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.057169+0000","last_change":"2023-07-21T22:38:23.057169+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.057169+0000","last_undegraded":"2023-07-21T22:38:23.057169+0000","last_fullsized":"2023-07-21T22:38:23.057169+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.073719+0000","last_change":"2023-07-21T22:38:23.071033+0000","last_active":"2023-07-21T22:38:23.073719+0000","last_peered":"2023-07-21T22:38:23.073719+0000","last_clean":"2023-07-21T22:38:23.073719+0000","last_became_active":"2023-07-21T22:38:23.070685+0000","last_became_peered":"2023-07-21T22:38:23.070685+0000","last_unstale":"2023-07-21T22:38:23.073719+0000","last_undegraded":"2023-07-21T22:38:23.073719+0000","last_fullsized":"2023-07-21T22:38:23.073719+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:03.509609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056192+0000","last_change":"2023-07-21T22:38:23.056192+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056192+0000","last_undegraded":"2023-07-21T22:38:23.056192+0000","last_fullsized":"2023-07-21T22:38:23.056192+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.067689+0000","last_change":"2023-07-21T22:38:23.066606+0000","last_active":"2023-07-21T22:38:23.067689+0000","last_peered":"2023-07-21T22:38:23.067689+0000","last_clean":"2023-07-21T22:38:23.067689+0000","last_became_active":"2023-07-21T22:38:23.066288+0000","last_became_peered":"2023-07-21T22:38:23.066288+0000","last_unstale":"2023-07-21T22:38:23.067689+0000","last_undegraded":"2023-07-21T22:38:23.067689+0000","last_fullsized":"2023-07-21T22:38:23.067689+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:23:08.070998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.062315+0000","last_change":"2023-07-21T22:38:23.062315+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.062315+0000","last_undegraded":"2023-07-21T22:38:23.062315+0000","last_fullsized":"2023-07-21T22:38:23.062315+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.084392+0000","last_change":"2023-07-21T22:38:23.080670+0000","last_active":"2023-07-21T22:38:23.084392+0000","last_peered":"2023-07-21T22:38:23.084392+0000","last_clean":"2023-07-21T22:38:23.084392+0000","last_became_active":"2023-07-21T22:38:23.080326+0000","last_became_peered":"2023-07-21T22:38:23.080326+0000","last_unstale":"2023-07-21T22:38:23.084392+0000","last_undegraded":"2023-07-21T22:38:23.084392+0000","last_fullsized":"2023-07-21T22:38:23.084392+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:16:09.844811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056718+0000","last_change":"2023-07-21T22:38:23.056718+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056718+0000","last_undegraded":"2023-07-21T22:38:23.056718+0000","last_fullsized":"2023-07-21T22:38:23.056718+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.083942+0000","last_change":"2023-07-21T22:38:23.078636+0000","last_active":"2023-07-21T22:38:23.083942+0000","last_peered":"2023-07-21T22:38:23.083942+0000","last_clean":"2023-07-21T22:38:23.083942+0000","last_became_active":"2023-07-21T22:38:23.078443+0000","last_became_peered":"2023-07-21T22:38:23.078443+0000","last_unstale":"2023-07-21T22:38:23.083942+0000","last_undegraded":"2023-07-21T22:38:23.083942+0000","last_fullsized":"2023-07-21T22:38:23.083942+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:51:49.106671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.060531+0000","last_change":"2023-07-21T22:38:23.060531+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.060531+0000","last_undegraded":"2023-07-21T22:38:23.060531+0000","last_fullsized":"2023-07-21T22:38:23.060531+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.074292+0000","last_change":"2023-07-21T22:38:23.069898+0000","last_active":"2023-07-21T22:38:23.074292+0000","last_peered":"2023-07-21T22:38:23.074292+0000","last_clean":"2023-07-21T22:38:23.074292+0000","last_became_active":"2023-07-21T22:38:23.069638+0000","last_became_peered":"2023-07-21T22:38:23.069638+0000","last_unstale":"2023-07-21T22:38:23.074292+0000","last_undegraded":"2023-07-21T22:38:23.074292+0000","last_fullsized":"2023-07-21T22:38:23.074292+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:25:57.031023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.055886+0000","last_change":"2023-07-21T22:38:23.055886+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.055886+0000","last_undegraded":"2023-07-21T22:38:23.055886+0000","last_fullsized":"2023-07-21T22:38:23.055886+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.083856+0000","last_change":"2023-07-21T22:38:23.076677+0000","last_active":"2023-07-21T22:38:23.083856+0000","last_peered":"2023-07-21T22:38:23.083856+0000","last_clean":"2023-07-21T22:38:23.083856+0000","last_became_active":"2023-07-21T22:38:23.076377+0000","last_became_peered":"2023-07-21T22:38:23.076377+0000","last_unstale":"2023-07-21T22:38:23.083856+0000","last_undegraded":"2023-07-21T22:38:23.083856+0000","last_fullsized":"2023-07-21T22:38:23.083856+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:00:08.144958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056425+0000","last_change":"2023-07-21T22:38:23.056425+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056425+0000","last_undegraded":"2023-07-21T22:38:23.056425+0000","last_fullsized":"2023-07-21T22:38:23.056425+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.069157+0000","last_change":"2023-07-21T22:38:23.066154+0000","last_active":"2023-07-21T22:38:23.069157+0000","last_peered":"2023-07-21T22:38:23.069157+0000","last_clean":"2023-07-21T22:38:23.069157+0000","last_became_active":"2023-07-21T22:38:23.065865+0000","last_became_peered":"2023-07-21T22:38:23.065865+0000","last_unstale":"2023-07-21T22:38:23.069157+0000","last_undegraded":"2023-07-21T22:38:23.069157+0000","last_fullsized":"2023-07-21T22:38:23.069157+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:24:53.841626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056203+0000","last_change":"2023-07-21T22:38:23.056203+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056203+0000","last_undegraded":"2023-07-21T22:38:23.056203+0000","last_fullsized":"2023-07-21T22:38:23.056203+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.080104+0000","last_change":"2023-07-21T22:38:23.074540+0000","last_active":"2023-07-21T22:38:23.080104+0000","last_peered":"2023-07-21T22:38:23.080104+0000","last_clean":"2023-07-21T22:38:23.080104+0000","last_became_active":"2023-07-21T22:38:23.074297+0000","last_became_peered":"2023-07-21T22:38:23.074297+0000","last_unstale":"2023-07-21T22:38:23.080104+0000","last_undegraded":"2023-07-21T22:38:23.080104+0000","last_fullsized":"2023-07-21T22:38:23.080104+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:28:11.072255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058870+0000","last_change":"2023-07-21T22:38:23.058870+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058870+0000","last_undegraded":"2023-07-21T22:38:23.058870+0000","last_fullsized":"2023-07-21T22:38:23.058870+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.072289+0000","last_change":"2023-07-21T22:38:23.067648+0000","last_active":"2023-07-21T22:38:23.072289+0000","last_peered":"2023-07-21T22:38:23.072289+0000","last_clean":"2023-07-21T22:38:23.072289+0000","last_became_active":"2023-07-21T22:38:23.067340+0000","last_became_peered":"2023-07-21T22:38:23.067340+0000","last_unstale":"2023-07-21T22:38:23.072289+0000","last_undegraded":"2023-07-21T22:38:23.072289+0000","last_fullsized":"2023-07-21T22:38:23.072289+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:23:58.668883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.052301+0000","last_change":"2023-07-21T22:38:23.052301+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.052301+0000","last_undegraded":"2023-07-21T22:38:23.052301+0000","last_fullsized":"2023-07-21T22:38:23.052301+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.083742+0000","last_change":"2023-07-21T22:38:23.076843+0000","last_active":"2023-07-21T22:38:23.083742+0000","last_peered":"2023-07-21T22:38:23.083742+0000","last_clean":"2023-07-21T22:38:23.083742+0000","last_became_active":"2023-07-21T22:38:23.076531+0000","last_became_peered":"2023-07-21T22:38:23.076531+0000","last_unstale":"2023-07-21T22:38:23.083742+0000","last_undegraded":"2023-07-21T22:38:23.083742+0000","last_fullsized":"2023-07-21T22:38:23.083742+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:46:36.793506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.062536+0000","last_change":"2023-07-21T22:38:23.062536+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.062536+0000","last_undegraded":"2023-07-21T22:38:23.062536+0000","last_fullsized":"2023-07-21T22:38:23.062536+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.083832+0000","last_change":"2023-07-21T22:38:23.077345+0000","last_active":"2023-07-21T22:38:23.083832+0000","last_peered":"2023-07-21T22:38:23.083832+0000","last_clean":"2023-07-21T22:38:23.083832+0000","last_became_active":"2023-07-21T22:38:23.076977+0000","last_became_peered":"2023-07-21T22:38:23.076977+0000","last_unstale":"2023-07-21T22:38:23.083832+0000","last_undegraded":"2023-07-21T22:38:23.083832+0000","last_fullsized":"2023-07-21T22:38:23.083832+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:18:48.303353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.053644+0000","last_change":"2023-07-21T22:38:23.053644+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.053644+0000","last_undegraded":"2023-07-21T22:38:23.053644+0000","last_fullsized":"2023-07-21T22:38:23.053644+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.075732+0000","last_change":"2023-07-21T22:38:23.072030+0000","last_active":"2023-07-21T22:38:23.075732+0000","last_peered":"2023-07-21T22:38:23.075732+0000","last_clean":"2023-07-21T22:38:23.075732+0000","last_became_active":"2023-07-21T22:38:23.071779+0000","last_became_peered":"2023-07-21T22:38:23.071779+0000","last_unstale":"2023-07-21T22:38:23.075732+0000","last_undegraded":"2023-07-21T22:38:23.075732+0000","last_fullsized":"2023-07-21T22:38:23.075732+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:53:20.230381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058197+0000","last_change":"2023-07-21T22:38:23.058197+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058197+0000","last_undegraded":"2023-07-21T22:38:23.058197+0000","last_fullsized":"2023-07-21T22:38:23.058197+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.066553+0000","last_change":"2023-07-21T22:38:23.064167+0000","last_active":"2023-07-21T22:38:23.066553+0000","last_peered":"2023-07-21T22:38:23.066553+0000","last_clean":"2023-07-21T22:38:23.066553+0000","last_became_active":"2023-07-21T22:38:23.063832+0000","last_became_peered":"2023-07-21T22:38:23.063832+0000","last_unstale":"2023-07-21T22:38:23.066553+0000","last_undegraded":"2023-07-21T22:38:23.066553+0000","last_fullsized":"2023-07-21T22:38:23.066553+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:22:01.415836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.053443+0000","last_change":"2023-07-21T22:38:23.053443+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.053443+0000","last_undegraded":"2023-07-21T22:38:23.053443+0000","last_fullsized":"2023-07-21T22:38:23.053443+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.070149+0000","last_change":"2023-07-21T22:38:23.069081+0000","last_active":"2023-07-21T22:38:23.070149+0000","last_peered":"2023-07-21T22:38:23.070149+0000","last_clean":"2023-07-21T22:38:23.070149+0000","last_became_active":"2023-07-21T22:38:23.068690+0000","last_became_peered":"2023-07-21T22:38:23.068690+0000","last_unstale":"2023-07-21T22:38:23.070149+0000","last_undegraded":"2023-07-21T22:38:23.070149+0000","last_fullsized":"2023-07-21T22:38:23.070149+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:33:23.832514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.065544+0000","last_change":"2023-07-21T22:38:23.065544+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.065544+0000","last_undegraded":"2023-07-21T22:38:23.065544+0000","last_fullsized":"2023-07-21T22:38:23.065544+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.075782+0000","last_change":"2023-07-21T22:38:23.072049+0000","last_active":"2023-07-21T22:38:23.075782+0000","last_peered":"2023-07-21T22:38:23.075782+0000","last_clean":"2023-07-21T22:38:23.075782+0000","last_became_active":"2023-07-21T22:38:23.071697+0000","last_became_peered":"2023-07-21T22:38:23.071697+0000","last_unstale":"2023-07-21T22:38:23.075782+0000","last_undegraded":"2023-07-21T22:38:23.075782+0000","last_fullsized":"2023-07-21T22:38:23.075782+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:50:06.058541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.052292+0000","last_change":"2023-07-21T22:38:23.052292+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.052292+0000","last_undegraded":"2023-07-21T22:38:23.052292+0000","last_fullsized":"2023-07-21T22:38:23.052292+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.083930+0000","last_change":"2023-07-21T22:38:23.076939+0000","last_active":"2023-07-21T22:38:23.083930+0000","last_peered":"2023-07-21T22:38:23.083930+0000","last_clean":"2023-07-21T22:38:23.083930+0000","last_became_active":"2023-07-21T22:38:23.076616+0000","last_became_peered":"2023-07-21T22:38:23.076616+0000","last_unstale":"2023-07-21T22:38:23.083930+0000","last_undegraded":"2023-07-21T22:38:23.083930+0000","last_fullsized":"2023-07-21T22:38:23.083930+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:25.345042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.063974+0000","last_change":"2023-07-21T22:38:23.063974+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.063974+0000","last_undegraded":"2023-07-21T22:38:23.063974+0000","last_fullsized":"2023-07-21T22:38:23.063974+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.070815+0000","last_change":"2023-07-21T22:38:23.068532+0000","last_active":"2023-07-21T22:38:23.070815+0000","last_peered":"2023-07-21T22:38:23.070815+0000","last_clean":"2023-07-21T22:38:23.070815+0000","last_became_active":"2023-07-21T22:38:23.068250+0000","last_became_peered":"2023-07-21T22:38:23.068250+0000","last_unstale":"2023-07-21T22:38:23.070815+0000","last_undegraded":"2023-07-21T22:38:23.070815+0000","last_fullsized":"2023-07-21T22:38:23.070815+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:20:08.667299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"130'249","reported_seq":850,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.069273+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:38:23.069273+0000","last_peered":"2023-07-21T22:38:23.069273+0000","last_clean":"2023-07-21T22:38:23.069273+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:38:23.069273+0000","last_undegraded":"2023-07-21T22:38:23.069273+0000","last_fullsized":"2023-07-21T22:38:23.069273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:30:42.824483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":248,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.061108+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:38:23.061108+0000","last_peered":"2023-07-21T22:38:23.061108+0000","last_clean":"2023-07-21T22:38:23.061108+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:38:23.061108+0000","last_undegraded":"2023-07-21T22:38:23.061108+0000","last_fullsized":"2023-07-21T22:38:23.061108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:06:29.154549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.062847+0000","last_change":"2023-07-21T22:38:23.062847+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.062847+0000","last_undegraded":"2023-07-21T22:38:23.062847+0000","last_fullsized":"2023-07-21T22:38:23.062847+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.066848+0000","last_change":"2023-07-21T22:38:23.063181+0000","last_active":"2023-07-21T22:38:23.066848+0000","last_peered":"2023-07-21T22:38:23.066848+0000","last_clean":"2023-07-21T22:38:23.066848+0000","last_became_active":"2023-07-21T22:38:23.062917+0000","last_became_peered":"2023-07-21T22:38:23.062917+0000","last_unstale":"2023-07-21T22:38:23.066848+0000","last_undegraded":"2023-07-21T22:38:23.066848+0000","last_fullsized":"2023-07-21T22:38:23.066848+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:36:46.103640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":226,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.069151+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:38:23.069151+0000","last_peered":"2023-07-21T22:38:23.069151+0000","last_clean":"2023-07-21T22:38:23.069151+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:38:23.069151+0000","last_undegraded":"2023-07-21T22:38:23.069151+0000","last_fullsized":"2023-07-21T22:38:23.069151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:28.789417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.052705+0000","last_change":"2023-07-21T22:38:23.052705+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.052705+0000","last_undegraded":"2023-07-21T22:38:23.052705+0000","last_fullsized":"2023-07-21T22:38:23.052705+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.070821+0000","last_change":"2023-07-21T22:38:23.069398+0000","last_active":"2023-07-21T22:38:23.070821+0000","last_peered":"2023-07-21T22:38:23.070821+0000","last_clean":"2023-07-21T22:38:23.070821+0000","last_became_active":"2023-07-21T22:38:23.069091+0000","last_became_peered":"2023-07-21T22:38:23.069091+0000","last_unstale":"2023-07-21T22:38:23.070821+0000","last_undegraded":"2023-07-21T22:38:23.070821+0000","last_fullsized":"2023-07-21T22:38:23.070821+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:38:33.051764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":224,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.051927+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:38:23.051927+0000","last_peered":"2023-07-21T22:38:23.051927+0000","last_clean":"2023-07-21T22:38:23.051927+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:38:23.051927+0000","last_undegraded":"2023-07-21T22:38:23.051927+0000","last_fullsized":"2023-07-21T22:38:23.051927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:19.912597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054021+0000","last_change":"2023-07-21T22:38:23.054021+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054021+0000","last_undegraded":"2023-07-21T22:38:23.054021+0000","last_fullsized":"2023-07-21T22:38:23.054021+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.066791+0000","last_change":"2023-07-21T22:38:23.062898+0000","last_active":"2023-07-21T22:38:23.066791+0000","last_peered":"2023-07-21T22:38:23.066791+0000","last_clean":"2023-07-21T22:38:23.066791+0000","last_became_active":"2023-07-21T22:38:23.062603+0000","last_became_peered":"2023-07-21T22:38:23.062603+0000","last_unstale":"2023-07-21T22:38:23.066791+0000","last_undegraded":"2023-07-21T22:38:23.066791+0000","last_fullsized":"2023-07-21T22:38:23.066791+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:31:59.541471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":248,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.059920+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:38:23.059920+0000","last_peered":"2023-07-21T22:38:23.059920+0000","last_clean":"2023-07-21T22:38:23.059920+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:38:23.059920+0000","last_undegraded":"2023-07-21T22:38:23.059920+0000","last_fullsized":"2023-07-21T22:38:23.059920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:07:21.311463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.062904+0000","last_change":"2023-07-21T22:38:23.062904+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.062904+0000","last_undegraded":"2023-07-21T22:38:23.062904+0000","last_fullsized":"2023-07-21T22:38:23.062904+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.079842+0000","last_change":"2023-07-21T22:38:23.073676+0000","last_active":"2023-07-21T22:38:23.079842+0000","last_peered":"2023-07-21T22:38:23.079842+0000","last_clean":"2023-07-21T22:38:23.079842+0000","last_became_active":"2023-07-21T22:38:23.073401+0000","last_became_peered":"2023-07-21T22:38:23.073401+0000","last_unstale":"2023-07-21T22:38:23.079842+0000","last_undegraded":"2023-07-21T22:38:23.079842+0000","last_fullsized":"2023-07-21T22:38:23.079842+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:38:39.057650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":240,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.049280+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:38:23.049280+0000","last_peered":"2023-07-21T22:38:23.049280+0000","last_clean":"2023-07-21T22:38:23.049280+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:38:23.049280+0000","last_undegraded":"2023-07-21T22:38:23.049280+0000","last_fullsized":"2023-07-21T22:38:23.049280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:47:57.599145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.057612+0000","last_change":"2023-07-21T22:38:23.057612+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.057612+0000","last_undegraded":"2023-07-21T22:38:23.057612+0000","last_fullsized":"2023-07-21T22:38:23.057612+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.070595+0000","last_change":"2023-07-21T22:38:23.064930+0000","last_active":"2023-07-21T22:38:23.070595+0000","last_peered":"2023-07-21T22:38:23.070595+0000","last_clean":"2023-07-21T22:38:23.070595+0000","last_became_active":"2023-07-21T22:38:23.064654+0000","last_became_peered":"2023-07-21T22:38:23.064654+0000","last_unstale":"2023-07-21T22:38:23.070595+0000","last_undegraded":"2023-07-21T22:38:23.070595+0000","last_fullsized":"2023-07-21T22:38:23.070595+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:31.160555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":226,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.071595+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:38:23.071595+0000","last_peered":"2023-07-21T22:38:23.071595+0000","last_clean":"2023-07-21T22:38:23.071595+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:38:23.071595+0000","last_undegraded":"2023-07-21T22:38:23.071595+0000","last_fullsized":"2023-07-21T22:38:23.071595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:42:04.153664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.055927+0000","last_change":"2023-07-21T22:38:23.055927+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.055927+0000","last_undegraded":"2023-07-21T22:38:23.055927+0000","last_fullsized":"2023-07-21T22:38:23.055927+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.079939+0000","last_change":"2023-07-21T22:38:23.073379+0000","last_active":"2023-07-21T22:38:23.079939+0000","last_peered":"2023-07-21T22:38:23.079939+0000","last_clean":"2023-07-21T22:38:23.079939+0000","last_became_active":"2023-07-21T22:38:23.073091+0000","last_became_peered":"2023-07-21T22:38:23.073091+0000","last_unstale":"2023-07-21T22:38:23.079939+0000","last_undegraded":"2023-07-21T22:38:23.079939+0000","last_fullsized":"2023-07-21T22:38:23.079939+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:57:18.041817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":240,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.049276+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:38:23.049276+0000","last_peered":"2023-07-21T22:38:23.049276+0000","last_clean":"2023-07-21T22:38:23.049276+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:38:23.049276+0000","last_undegraded":"2023-07-21T22:38:23.049276+0000","last_fullsized":"2023-07-21T22:38:23.049276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:14:30.325976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.057255+0000","last_change":"2023-07-21T22:38:23.057255+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.057255+0000","last_undegraded":"2023-07-21T22:38:23.057255+0000","last_fullsized":"2023-07-21T22:38:23.057255+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.066909+0000","last_change":"2023-07-21T22:38:23.061980+0000","last_active":"2023-07-21T22:38:23.066909+0000","last_peered":"2023-07-21T22:38:23.066909+0000","last_clean":"2023-07-21T22:38:23.066909+0000","last_became_active":"2023-07-21T22:38:23.061558+0000","last_became_peered":"2023-07-21T22:38:23.061558+0000","last_unstale":"2023-07-21T22:38:23.066909+0000","last_undegraded":"2023-07-21T22:38:23.066909+0000","last_fullsized":"2023-07-21T22:38:23.066909+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:51:44.530129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":222,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.063664+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:38:23.063664+0000","last_peered":"2023-07-21T22:38:23.063664+0000","last_clean":"2023-07-21T22:38:23.063664+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:38:23.063664+0000","last_undegraded":"2023-07-21T22:38:23.063664+0000","last_fullsized":"2023-07-21T22:38:23.063664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:56:58.160508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509675,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59568,"kb_used_data":2280,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312272,"statfs":{"total":96636764160,"available":96575766528,"internally_reserved":0,"allocated":2334720,"data_stored":1470982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69099999999999995,"15min":0.73199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35299999999999998},"max":{"1min":0.876,"5min":1.1180000000000001,"15min":3.5059999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66400000000000003,"15min":0.69399999999999995},"min":{"1min":0.46200000000000002,"5min":0.40899999999999997,"15min":0.39500000000000002},"max":{"1min":0.94199999999999995,"5min":0.94399999999999995,"15min":3.2709999999999999},"last":0.628}]},{"osd":1,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.70599999999999996,"15min":0.72799999999999998},"min":{"1min":0.49199999999999999,"5min":0.44900000000000001,"15min":0.432},"max":{"1min":0.98599999999999999,"5min":1.0680000000000001,"15min":1.5429999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.71299999999999997},"min":{"1min":0.44800000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96499999999999997,"5min":1.093,"15min":1.093},"last":0.61599999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70899999999999996,"15min":0.73599999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":1.1399999999999999,"15min":1.405},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73199999999999998,"15min":0.746},"min":{"1min":0.55100000000000005,"5min":0.47999999999999998,"15min":0.45800000000000002},"max":{"1min":0.92800000000000005,"5min":1.083,"15min":1.409},"last":0.70199999999999996}]},{"osd":3,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75900000000000001,"15min":0.76500000000000001},"min":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0209999999999999,"5min":1.1539999999999999,"15min":1.46},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.48599999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94899999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.55900000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55700000000000005,"15min":0.56200000000000006},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.67500000000000004,"5min":0.90000000000000002,"15min":0.94999999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82299999999999995,"5min":0.97399999999999998,"15min":1.7949999999999999},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.89700000000000002,"5min":0.98799999999999999,"15min":2.2120000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70199999999999996,"15min":0.68100000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.38300000000000001},"max":{"1min":0.95199999999999996,"5min":1.052,"15min":1.506},"last":0.65000000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.68100000000000005},"min":{"1min":0.53700000000000003,"5min":0.44900000000000001,"15min":0.41999999999999998},"max":{"1min":0.93500000000000005,"5min":1.0329999999999999,"15min":1.048},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.42699999999999999},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.57399999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542381,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36844,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334996,"statfs":{"total":96636764160,"available":96599035904,"internally_reserved":0,"allocated":1740800,"data_stored":880614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.755},"min":{"1min":0.47099999999999997,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.94399999999999995,"5min":1.016,"15min":1.016},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.437},"max":{"1min":0.96799999999999997,"5min":1.0289999999999999,"15min":1.1180000000000001},"last":0.74099999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.70099999999999996,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.49099999999999999,"15min":0.45300000000000001},"max":{"1min":0.872,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.501},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.45800000000000002,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.93300000000000005,"5min":0.99199999999999999,"15min":1.117},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71099999999999997,"15min":0.74199999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.42799999999999999},"max":{"1min":0.89600000000000002,"5min":0.98099999999999998,"15min":0.997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.78700000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.45500000000000002},"max":{"1min":0.98199999999999998,"5min":1.0149999999999999,"15min":1.097},"last":0.59199999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71999999999999997,"15min":0.748},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":1.048,"15min":1.048},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70499999999999996,"15min":0.72899999999999998},"min":{"1min":0.52300000000000002,"5min":0.49399999999999999,"15min":0.46899999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0049999999999999},"last":0.56799999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.93400000000000005,"15min":1.0229999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.39700000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.879}]},{"osd":5,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.054},"last":0.45000000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70299999999999996,"15min":0.68100000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.443},"max":{"1min":1.024,"5min":1.024,"15min":1.079},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.621}]}]},{"osd":5,"up_from":15,"seq":64424509674,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50784,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321056,"statfs":{"total":96636764160,"available":96584761344,"internally_reserved":0,"allocated":1728512,"data_stored":873914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.70999999999999996},"min":{"1min":0.48099999999999998,"5min":0.38500000000000001,"15min":0.35699999999999998},"max":{"1min":0.96499999999999997,"5min":1,"15min":1.8779999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.97999999999999998,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.68600000000000005,"15min":0.70299999999999996},"min":{"1min":0.505,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.95899999999999996,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69099999999999995,"15min":0.72099999999999997},"min":{"1min":0.42699999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.617},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71099999999999997,"15min":0.72699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.33600000000000002},"max":{"1min":1.008,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.42199999999999999,"15min":0.377},"max":{"1min":0.89300000000000002,"5min":1.073,"15min":1.512},"last":0.65700000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76900000000000002,"15min":0.77800000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":1.0009999999999999,"15min":1.472},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76000000000000001,"15min":0.78700000000000003},"min":{"1min":0.60099999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.997,"5min":1.022,"15min":1.556},"last":0.69299999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.372,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83699999999999997,"5min":0.88900000000000001,"15min":0.96999999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72399999999999998,"15min":0.69599999999999995},"min":{"1min":0.58899999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.92300000000000004,"5min":0.92400000000000004,"15min":1.038},"last":0.79100000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":0.95499999999999996,"15min":1.0049999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.40200000000000002,"15min":0.40000000000000002},"max":{"1min":0.76600000000000001,"5min":0.93799999999999994,"15min":1.02},"last":0.71099999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70099999999999996,"15min":0.65700000000000003},"min":{"1min":0.46200000000000002,"5min":0.40999999999999998,"15min":0.374},"max":{"1min":0.96699999999999997,"5min":1.042,"15min":1.042},"last":0.751},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":0.73099999999999998},"min":{"1min":0.59799999999999998,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.88300000000000001,"5min":0.999,"15min":1.7390000000000001},"last":0.73299999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509675,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1728512,"data_stored":873914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.70399999999999996,"15min":0.73599999999999999},"min":{"1min":0.46800000000000003,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.71399999999999997,"15min":0.73699999999999999},"min":{"1min":0.47999999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98499999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.52900000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.70199999999999996},"min":{"1min":0.46999999999999997,"5min":0.442,"15min":0.39400000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67600000000000005,"15min":0.69999999999999996},"min":{"1min":0.44400000000000001,"5min":0.43099999999999999,"15min":0.36899999999999999},"max":{"1min":0.90400000000000003,"5min":0.93000000000000005,"15min":1.016},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72799999999999998,"15min":0.755},"min":{"1min":0.55800000000000005,"5min":0.49099999999999999,"15min":0.371},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73799999999999999,"15min":0.76400000000000001},"min":{"1min":0.52400000000000002,"5min":0.47699999999999998,"15min":0.33000000000000002},"max":{"1min":1.018,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.40100000000000002},"max":{"1min":0.91000000000000003,"5min":0.97999999999999998,"15min":1.026},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75900000000000001,"15min":0.77900000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47999999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.66500000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60799999999999998,"15min":0.58499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34399999999999997},"max":{"1min":0.96199999999999997,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.60399999999999998,"15min":0.59499999999999997},"min":{"1min":0.44400000000000001,"5min":0.38800000000000001,"15min":0.32800000000000001},"max":{"1min":0.93600000000000005,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.70799999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.753},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.41599999999999998},"max":{"1min":1.0089999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.65200000000000002},"min":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.39200000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.0429999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.61699999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509674,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32748,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339092,"statfs":{"total":96636764160,"available":96603230208,"internally_reserved":0,"allocated":1740800,"data_stored":880614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46899999999999997,"15min":0.47499999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":0.77800000000000002,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.35899999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46200000000000002,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60299999999999998,"5min":0.754,"15min":0.83499999999999996},"last":0.316},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.41999999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71899999999999997,"5min":0.82599999999999996,"15min":0.90100000000000002},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67600000000000005,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.59599999999999997},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.99199999999999999},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.755,"15min":0.77000000000000002},"min":{"1min":0.57599999999999996,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91200000000000003,"5min":1.093,"15min":1.1279999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.81399999999999995},"min":{"1min":0.54500000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.93200000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.76900000000000002},"min":{"1min":0.54900000000000004,"5min":0.501,"15min":0.48999999999999999},"max":{"1min":0.97799999999999998,"5min":1.0669999999999999,"15min":1.137},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.51300000000000001,"15min":0.42899999999999999},"max":{"1min":0.86399999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76900000000000002,"15min":0.79000000000000004},"min":{"1min":0.51900000000000002,"5min":0.51700000000000002,"15min":0.47399999999999998},"max":{"1min":0.91700000000000004,"5min":1.0680000000000001,"15min":1.169},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91300000000000003,"5min":1.107,"15min":1.1120000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79200000000000004,"15min":0.81299999999999994},"min":{"1min":0.621,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94299999999999995,"5min":1.083,"15min":1.099},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80900000000000005,"15min":0.82799999999999996},"min":{"1min":0.61299999999999999,"5min":0.55200000000000005,"15min":0.48599999999999999},"max":{"1min":0.92200000000000004,"5min":1.623,"15min":1.623},"last":0.78100000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509676,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54892,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316948,"statfs":{"total":96636764160,"available":96580554752,"internally_reserved":0,"allocated":1740800,"data_stored":880614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.46400000000000002},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.23899999999999999},"max":{"1min":0.624,"5min":0.75,"15min":0.94199999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50600000000000001,"15min":0.54100000000000004},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.308},"max":{"1min":0.64200000000000002,"5min":0.88300000000000001,"15min":1.0409999999999999},"last":0.53600000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.40699999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72599999999999998,"5min":0.86699999999999999,"15min":0.93999999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.012,"15min":1.085},"last":0.45300000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46300000000000002,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.623,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.56399999999999995},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.85299999999999998,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.46600000000000003,"15min":0.376},"max":{"1min":1.016,"5min":1.1579999999999999,"15min":1.3420000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73599999999999999,"15min":0.78500000000000003},"min":{"1min":0.48899999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.996,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.64900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0780000000000001,"5min":1.214,"15min":1.214},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77700000000000002,"15min":0.80600000000000005},"min":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.46400000000000002},"max":{"1min":1.012,"5min":1.2689999999999999,"15min":1.3089999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.746,"15min":0.78300000000000003},"min":{"1min":0.52800000000000002,"5min":0.499,"15min":0.40300000000000002},"max":{"1min":0.94399999999999995,"5min":1.536,"15min":1.536},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.46200000000000002},"max":{"1min":1.0289999999999999,"5min":1.1339999999999999,"15min":1.2649999999999999},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77500000000000002,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.008,"5min":1.143,"15min":1.214},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.751,"15min":0.79700000000000004},"min":{"1min":0.58899999999999997,"5min":0.50900000000000001,"15min":0.44700000000000001},"max":{"1min":0.91200000000000003,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.73799999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509675,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32748,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339092,"statfs":{"total":96636764160,"available":96603230208,"internally_reserved":0,"allocated":1740800,"data_stored":880614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.47499999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.22900000000000001},"max":{"1min":0.60399999999999998,"5min":0.78700000000000003,"15min":0.84599999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54100000000000004,"15min":0.55900000000000005},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.35099999999999998},"max":{"1min":0.80900000000000005,"5min":0.82499999999999996,"15min":0.872},"last":0.441}]},{"osd":2,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48999999999999999,"15min":0.502},"min":{"1min":0.36199999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"max":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":0.81000000000000005},"last":0.317},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.29099999999999998},"max":{"1min":0.71899999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.42299999999999999,"5min":0.378,"15min":0.33400000000000002},"max":{"1min":0.76100000000000001,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":0.77600000000000002,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.34699999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.432},"max":{"1min":1.115,"5min":1.294,"15min":1.294},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77800000000000002,"15min":0.79000000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.498},"max":{"1min":1.1220000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.95399999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.753,"15min":0.77200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.41899999999999998},"max":{"1min":1.0980000000000001,"5min":1.242,"15min":1.242},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.55700000000000005,"5min":0.51500000000000001,"15min":0.376},"max":{"1min":1.1639999999999999,"5min":1.276,"15min":1.2849999999999999},"last":0.93700000000000006}]},{"osd":6,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77700000000000002,"15min":0.80000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.47899999999999998},"max":{"1min":1.0800000000000001,"5min":1.208,"15min":1.23},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.78100000000000003},"min":{"1min":0.56100000000000005,"5min":0.50900000000000001,"15min":0.46500000000000002},"max":{"1min":1.0109999999999999,"5min":1.244,"15min":1.3240000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78500000000000003,"15min":0.80400000000000005},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.49199999999999999},"max":{"1min":1.089,"5min":1.3120000000000001,"15min":1.3149999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.45700000000000002},"max":{"1min":1.0289999999999999,"5min":1.1819999999999999,"15min":1.3380000000000001},"last":0.79000000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509677,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37412,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334428,"statfs":{"total":96636764160,"available":96598454272,"internally_reserved":0,"allocated":2322432,"data_stored":1464282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46999999999999997,"15min":0.46899999999999997},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.26600000000000001},"max":{"1min":0.70399999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.499}]},{"osd":2,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.42099999999999999,"5min":0.32400000000000001,"15min":0.29799999999999999},"max":{"1min":0.82599999999999996,"5min":0.871,"15min":1.3680000000000001},"last":0.442},{"interface":"front","average":{"1min":0.504,"5min":0.49299999999999999,"15min":0.51700000000000002},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.32600000000000001},"max":{"1min":0.68200000000000005,"5min":0.76700000000000002,"15min":0.871},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57299999999999995,"15min":0.58999999999999997},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.33700000000000002},"max":{"1min":0.745,"5min":1.038,"15min":1.038},"last":0.46200000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.79900000000000004,"15min":0.78400000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.45200000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.3009999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.80500000000000005,"15min":0.80200000000000005},"min":{"1min":0.54500000000000004,"5min":0.505,"15min":0.44600000000000001},"max":{"1min":1.278,"5min":1.278,"15min":1.423},"last":0.627}]},{"osd":5,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78200000000000003,"15min":0.77900000000000003},"min":{"1min":0.56799999999999995,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.0229999999999999,"5min":1.1020000000000001,"15min":1.2669999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81000000000000005,"15min":0.80800000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.39600000000000002},"max":{"1min":1.1950000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.72799999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.48899999999999999},"max":{"1min":1.054,"5min":1.27,"15min":1.27},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.81100000000000005,"15min":0.81799999999999995},"min":{"1min":0.64300000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.333},"last":0.75800000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.60099999999999998,"5min":0.54300000000000004,"15min":0.53100000000000003},"max":{"1min":1.121,"5min":1.159,"15min":1.2310000000000001},"last":0.746},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.80800000000000005,"15min":0.82799999999999996},"min":{"1min":0.55600000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.109,"5min":1.1930000000000001,"15min":1.369},"last":0.68600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:38:28.248 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:38:28.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.384+0000 7fed60ee6640 1 Processor -- start 2023-07-21T22:38:28.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.384+0000 7fed60ee6640 1 -- start start 2023-07-21T22:38:28.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.384+0000 7fed60ee6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed5c158ce0 0x7fed5c070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:28.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed60ee6640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fed5c0c8ad0 0x7fed5c0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:28.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed60ee6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5c0cc700 con 0x7fed5c0c9560 2023-07-21T22:38:28.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed60ee6640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5c0c99e0 con 0x7fed5c0c8ad0 2023-07-21T22:38:28.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed60ee6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0b0ff0 con 0x7fed5c158ce0 2023-07-21T22:38:28.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed5ad9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fed5c0c9560 0x7fed5c0cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52578/0 (socket says 172.21.15.6:52578) 2023-07-21T22:38:28.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed5ad9d640 1 -- 172.21.15.6:0/922001881 learned_addr learned my addr 172.21.15.6:0/922001881 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:28.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed53fff640 1 --2- 172.21.15.6:0/922001881 >> v2:172.21.15.161:3300/0 conn(0x7fed5c0c8ad0 0x7fed5c0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:28.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed5a59c640 1 --2- 172.21.15.6:0/922001881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed5c158ce0 0x7fed5c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:28.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed59d9b640 1 -- 172.21.15.6:0/922001881 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491412190 0 0) 0x7fed5c0cc700 con 0x7fed5c0c9560 2023-07-21T22:38:28.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed59d9b640 1 -- 172.21.15.6:0/922001881 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed48005740 con 0x7fed5c0c9560 2023-07-21T22:38:28.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed59d9b640 1 -- 172.21.15.6:0/922001881 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3767134843 0 0) 0x7fed48005740 con 0x7fed5c0c9560 2023-07-21T22:38:28.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed59d9b640 1 -- 172.21.15.6:0/922001881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed5c158ce0 msgr2=0x7fed5c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:28.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed59d9b640 1 --2- 172.21.15.6:0/922001881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed5c158ce0 0x7fed5c070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed59d9b640 1 -- 172.21.15.6:0/922001881 >> v2:172.21.15.161:3300/0 conn(0x7fed5c0c8ad0 msgr2=0x7fed5c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:28.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed59d9b640 1 --2- 172.21.15.6:0/922001881 >> v2:172.21.15.161:3300/0 conn(0x7fed5c0c8ad0 0x7fed5c0c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed59d9b640 1 -- 172.21.15.6:0/922001881 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c070c80 con 0x7fed5c0c9560 2023-07-21T22:38:28.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed59d9b640 1 -- 172.21.15.6:0/922001881 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fed54001a00 con 0x7fed5c0c9560 2023-07-21T22:38:28.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed59d9b640 1 -- 172.21.15.6:0/922001881 >> v1:172.21.15.6:6789/0 conn(0x7fed5c0c9560 legacy=0x7fed5c0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:28.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed59d9b640 1 --2- 172.21.15.6:0/922001881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed48005b90 0x7fed48005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:28.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed59d9b640 1 --2- 172.21.15.6:0/922001881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed480069e0 0x7fed48006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:28.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed59d9b640 1 --2- 172.21.15.6:0/922001881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed5c158ce0 0x7fed48007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:28.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed59d9b640 1 -- 172.21.15.6:0/922001881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0c99e0 con 0x7fed480069e0 2023-07-21T22:38:28.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed59d9b640 1 -- 172.21.15.6:0/922001881 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0b0ff0 con 0x7fed48005b90 2023-07-21T22:38:28.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed59d9b640 1 -- 172.21.15.6:0/922001881 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4800dc20 con 0x7fed5c158ce0 2023-07-21T22:38:28.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed53fff640 1 --2- 172.21.15.6:0/922001881 >> v2:172.21.15.161:3300/0 conn(0x7fed5c0c8ad0 0x7fed5c0c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:28.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed53fff640 1 --2- 172.21.15.6:0/922001881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed480069e0 0x7fed48006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:28.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed5a59c640 1 --2- 172.21.15.6:0/922001881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed48005b90 0x7fed48005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:28.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed5ad9d640 1 --2- 172.21.15.6:0/922001881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed5c158ce0 0x7fed48007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:28.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed53fff640 1 -- 172.21.15.6:0/922001881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed5c158ce0 msgr2=0x7fed48007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:28.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed53fff640 1 --2- 172.21.15.6:0/922001881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed5c158ce0 0x7fed48007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed53fff640 1 -- 172.21.15.6:0/922001881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed48005b90 msgr2=0x7fed48005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:28.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed53fff640 1 --2- 172.21.15.6:0/922001881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed48005b90 0x7fed48005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.388+0000 7fed53fff640 1 -- 172.21.15.6:0/922001881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed48005740 con 0x7fed480069e0 2023-07-21T22:38:28.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.392+0000 7fed53fff640 1 --2- 172.21.15.6:0/922001881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed480069e0 0x7fed48006e50 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fed44009c90 tx=0x7fed4401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1a735e08b1d505 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:28.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.392+0000 7fed59d9b640 1 -- 172.21.15.6:0/922001881 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0cba20 con 0x7fed480069e0 2023-07-21T22:38:28.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.392+0000 7fed59d9b640 1 -- 172.21.15.6:0/922001881 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed44004020 con 0x7fed480069e0 2023-07-21T22:38:28.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.392+0000 7fed59d9b640 1 -- 172.21.15.6:0/922001881 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed440043d0 con 0x7fed480069e0 2023-07-21T22:38:28.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.392+0000 7fed60ee6640 1 -- 172.21.15.6:0/922001881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed480069e0 msgr2=0x7fed48006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:28.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.392+0000 7fed60ee6640 1 --2- 172.21.15.6:0/922001881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed480069e0 0x7fed48006e50 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fed44009c90 tx=0x7fed4401cc20 comp rx=0 tx=0).stop 2023-07-21T22:38:28.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.392+0000 7fed5ad9d640 1 -- 172.21.15.6:0/922001881 reap_dead start 2023-07-21T22:38:28.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.392+0000 7fed60ee6640 1 -- 172.21.15.6:0/922001881 shutdown_connections 2023-07-21T22:38:28.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.392+0000 7fed60ee6640 1 -- 172.21.15.6:0/922001881 >> 172.21.15.6:0/922001881 conn(0x7fed5c0afcf0 msgr2=0x7fed5c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:28.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.392+0000 7fed60ee6640 1 -- 172.21.15.6:0/922001881 shutdown_connections 2023-07-21T22:38:28.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.392+0000 7fed60ee6640 1 -- 172.21.15.6:0/922001881 wait complete. 2023-07-21T22:38:28.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.392+0000 7fed60ee6640 1 Processor -- start 2023-07-21T22:38:28.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.392+0000 7fed60ee6640 1 -- start start 2023-07-21T22:38:28.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed60ee6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed480069e0 0x7fed5c14df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:28.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed60ee6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed5c0c6ad0 0x7fed5c0c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:28.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed60ee6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed5c0c6f40 0x7fed5c0c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:28.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed60ee6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0c5230 con 0x7fed480069e0 2023-07-21T22:38:28.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed60ee6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0c5510 con 0x7fed5c0c6ad0 2023-07-21T22:38:28.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed60ee6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0b2630 con 0x7fed5c0c6f40 2023-07-21T22:38:28.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed5a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed480069e0 0x7fed5c14df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:28.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed5a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed480069e0 0x7fed5c14df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45470/0 (socket says 172.21.15.6:45470) 2023-07-21T22:38:28.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed5a59c640 1 -- 172.21.15.6:0/466600450 learned_addr learned my addr 172.21.15.6:0/466600450 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:28.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed53fff640 1 --2- 172.21.15.6:0/466600450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed5c0c6ad0 0x7fed5c0c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:28.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed5ad9d640 1 --2- 172.21.15.6:0/466600450 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed5c0c6f40 0x7fed5c0c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:28.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed5a59c640 1 -- 172.21.15.6:0/466600450 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed5c0c6f40 msgr2=0x7fed5c0c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:28.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed5a59c640 1 --2- 172.21.15.6:0/466600450 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed5c0c6f40 0x7fed5c0c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed5a59c640 1 -- 172.21.15.6:0/466600450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed5c0c6ad0 msgr2=0x7fed5c0c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:28.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed5a59c640 1 --2- 172.21.15.6:0/466600450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed5c0c6ad0 0x7fed5c0c59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed5a59c640 1 -- 172.21.15.6:0/466600450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c0b2910 con 0x7fed480069e0 2023-07-21T22:38:28.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed53fff640 1 --2- 172.21.15.6:0/466600450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed5c0c6ad0 0x7fed5c0c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:28.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed5a59c640 1 --2- 172.21.15.6:0/466600450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed480069e0 0x7fed5c14df70 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0119d0 tx=0x7fed4c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:28.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed52ffd640 1 -- 172.21.15.6:0/466600450 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c00fb50 con 0x7fed480069e0 2023-07-21T22:38:28.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed52ffd640 1 -- 172.21.15.6:0/466600450 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4c00fcb0 con 0x7fed480069e0 2023-07-21T22:38:28.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed52ffd640 1 -- 172.21.15.6:0/466600450 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c014440 con 0x7fed480069e0 2023-07-21T22:38:28.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed60ee6640 1 -- 172.21.15.6:0/466600450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed5c0b2bf0 con 0x7fed480069e0 2023-07-21T22:38:28.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed60ee6640 1 -- 172.21.15.6:0/466600450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5c0c5ee0 con 0x7fed480069e0 2023-07-21T22:38:28.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed60ee6640 1 -- 172.21.15.6:0/466600450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed5c0ca1a0 con 0x7fed480069e0 2023-07-21T22:38:28.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.396+0000 7fed52ffd640 1 -- 172.21.15.6:0/466600450 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fed4c0145a0 con 0x7fed480069e0 2023-07-21T22:38:28.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.400+0000 7fed52ffd640 1 --2- 172.21.15.6:0/466600450 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fed3c0663d0 0x7fed3c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:28.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.400+0000 7fed52ffd640 1 -- 172.21.15.6:0/466600450 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fed4c084770 con 0x7fed480069e0 2023-07-21T22:38:28.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.400+0000 7fed53fff640 1 --2- 172.21.15.6:0/466600450 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fed3c0663d0 0x7fed3c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:28.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.400+0000 7fed53fff640 1 --2- 172.21.15.6:0/466600450 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fed3c0663d0 0x7fed3c068880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed440ae000 tx=0x7fed440046d0 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:28.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.404+0000 7fed52ffd640 1 -- 172.21.15.6:0/466600450 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed4c051ab0 con 0x7fed480069e0 2023-07-21T22:38:28.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.556+0000 7fed60ee6640 1 -- 172.21.15.6:0/466600450 --> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed5c0b2420 con 0x7fed3c0663d0 2023-07-21T22:38:28.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.564+0000 7fed52ffd640 1 -- 172.21.15.6:0/466600450 <== mgr.7307 v2:172.21.15.161:6832/3436422767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306205 (secure 0 0 0) 0x7fed5c0b2420 con 0x7fed3c0663d0 2023-07-21T22:38:28.612 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:28.613 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:38:28.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.568+0000 7fed60ee6640 1 -- 172.21.15.6:0/466600450 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fed3c0663d0 msgr2=0x7fed3c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:28.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.568+0000 7fed60ee6640 1 --2- 172.21.15.6:0/466600450 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fed3c0663d0 0x7fed3c068880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed440ae000 tx=0x7fed440046d0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.568+0000 7fed60ee6640 1 -- 172.21.15.6:0/466600450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed480069e0 msgr2=0x7fed5c14df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:28.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.568+0000 7fed60ee6640 1 --2- 172.21.15.6:0/466600450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed480069e0 0x7fed5c14df70 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0119d0 tx=0x7fed4c011e90 comp rx=0 tx=0).stop 2023-07-21T22:38:28.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.568+0000 7fed60ee6640 1 -- 172.21.15.6:0/466600450 shutdown_connections 2023-07-21T22:38:28.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.568+0000 7fed60ee6640 1 --2- 172.21.15.6:0/466600450 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fed3c0663d0 0x7fed3c068880 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.568+0000 7fed60ee6640 1 --2- 172.21.15.6:0/466600450 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed5c0c6f40 0x7fed5c0c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.568+0000 7fed60ee6640 1 --2- 172.21.15.6:0/466600450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed5c0c6ad0 0x7fed5c0c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.568+0000 7fed60ee6640 1 --2- 172.21.15.6:0/466600450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed480069e0 0x7fed5c14df70 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.568+0000 7fed60ee6640 1 -- 172.21.15.6:0/466600450 >> 172.21.15.6:0/466600450 conn(0x7fed5c0afcf0 msgr2=0x7fed5c14ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:28.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.568+0000 7fed60ee6640 1 -- 172.21.15.6:0/466600450 shutdown_connections 2023-07-21T22:38:28.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.568+0000 7fed60ee6640 1 -- 172.21.15.6:0/466600450 wait complete. 2023-07-21T22:38:28.633 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-21T22:38:27.720112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":337732,"kb_used_data":14724,"kb_used_omap":0,"kb_used_meta":322944,"kb_avail":754636988,"statfs":{"total":773094113280,"available":772748275712,"internally_reserved":0,"allocated":15077376,"data_stored":8205548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":330694656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.669685"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058704+0000","last_change":"2023-07-21T22:38:23.058704+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058704+0000","last_undegraded":"2023-07-21T22:38:23.058704+0000","last_fullsized":"2023-07-21T22:38:23.058704+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.060174+0000","last_change":"2023-07-21T22:38:23.060174+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.060174+0000","last_undegraded":"2023-07-21T22:38:23.060174+0000","last_fullsized":"2023-07-21T22:38:23.060174+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.060115+0000","last_change":"2023-07-21T22:38:23.060115+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.060115+0000","last_undegraded":"2023-07-21T22:38:23.060115+0000","last_fullsized":"2023-07-21T22:38:23.060115+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.064006+0000","last_change":"2023-07-21T22:38:23.064006+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.064006+0000","last_undegraded":"2023-07-21T22:38:23.064006+0000","last_fullsized":"2023-07-21T22:38:23.064006+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058516+0000","last_change":"2023-07-21T22:38:23.058516+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058516+0000","last_undegraded":"2023-07-21T22:38:23.058516+0000","last_fullsized":"2023-07-21T22:38:23.058516+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058277+0000","last_change":"2023-07-21T22:38:23.058277+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058277+0000","last_undegraded":"2023-07-21T22:38:23.058277+0000","last_fullsized":"2023-07-21T22:38:23.058277+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058518+0000","last_change":"2023-07-21T22:38:23.058518+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058518+0000","last_undegraded":"2023-07-21T22:38:23.058518+0000","last_fullsized":"2023-07-21T22:38:23.058518+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.059899+0000","last_change":"2023-07-21T22:38:23.059899+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.059899+0000","last_undegraded":"2023-07-21T22:38:23.059899+0000","last_fullsized":"2023-07-21T22:38:23.059899+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.064880+0000","last_change":"2023-07-21T22:38:23.064880+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.064880+0000","last_undegraded":"2023-07-21T22:38:23.064880+0000","last_fullsized":"2023-07-21T22:38:23.064880+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054804+0000","last_change":"2023-07-21T22:38:23.054804+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054804+0000","last_undegraded":"2023-07-21T22:38:23.054804+0000","last_fullsized":"2023-07-21T22:38:23.054804+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056794+0000","last_change":"2023-07-21T22:38:23.056794+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056794+0000","last_undegraded":"2023-07-21T22:38:23.056794+0000","last_fullsized":"2023-07-21T22:38:23.056794+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.059734+0000","last_change":"2023-07-21T22:38:23.059734+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.059734+0000","last_undegraded":"2023-07-21T22:38:23.059734+0000","last_fullsized":"2023-07-21T22:38:23.059734+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.055336+0000","last_change":"2023-07-21T22:38:23.055336+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.055336+0000","last_undegraded":"2023-07-21T22:38:23.055336+0000","last_fullsized":"2023-07-21T22:38:23.055336+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.059023+0000","last_change":"2023-07-21T22:38:23.059023+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.059023+0000","last_undegraded":"2023-07-21T22:38:23.059023+0000","last_fullsized":"2023-07-21T22:38:23.059023+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.057190+0000","last_change":"2023-07-21T22:38:23.057190+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.057190+0000","last_undegraded":"2023-07-21T22:38:23.057190+0000","last_fullsized":"2023-07-21T22:38:23.057190+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.060985+0000","last_change":"2023-07-21T22:38:23.060985+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.060985+0000","last_undegraded":"2023-07-21T22:38:23.060985+0000","last_fullsized":"2023-07-21T22:38:23.060985+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054305+0000","last_change":"2023-07-21T22:38:23.054305+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054305+0000","last_undegraded":"2023-07-21T22:38:23.054305+0000","last_fullsized":"2023-07-21T22:38:23.054305+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056444+0000","last_change":"2023-07-21T22:38:23.056444+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056444+0000","last_undegraded":"2023-07-21T22:38:23.056444+0000","last_fullsized":"2023-07-21T22:38:23.056444+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.065397+0000","last_change":"2023-07-21T22:38:23.065397+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.065397+0000","last_undegraded":"2023-07-21T22:38:23.065397+0000","last_fullsized":"2023-07-21T22:38:23.065397+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054217+0000","last_change":"2023-07-21T22:38:23.054217+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054217+0000","last_undegraded":"2023-07-21T22:38:23.054217+0000","last_fullsized":"2023-07-21T22:38:23.054217+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.064516+0000","last_change":"2023-07-21T22:38:23.064516+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.064516+0000","last_undegraded":"2023-07-21T22:38:23.064516+0000","last_fullsized":"2023-07-21T22:38:23.064516+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058638+0000","last_change":"2023-07-21T22:38:23.058638+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058638+0000","last_undegraded":"2023-07-21T22:38:23.058638+0000","last_fullsized":"2023-07-21T22:38:23.058638+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.065753+0000","last_change":"2023-07-21T22:38:23.065753+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.065753+0000","last_undegraded":"2023-07-21T22:38:23.065753+0000","last_fullsized":"2023-07-21T22:38:23.065753+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056721+0000","last_change":"2023-07-21T22:38:23.056721+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056721+0000","last_undegraded":"2023-07-21T22:38:23.056721+0000","last_fullsized":"2023-07-21T22:38:23.056721+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.059483+0000","last_change":"2023-07-21T22:38:23.059483+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.059483+0000","last_undegraded":"2023-07-21T22:38:23.059483+0000","last_fullsized":"2023-07-21T22:38:23.059483+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054539+0000","last_change":"2023-07-21T22:38:23.054539+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054539+0000","last_undegraded":"2023-07-21T22:38:23.054539+0000","last_fullsized":"2023-07-21T22:38:23.054539+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.063166+0000","last_change":"2023-07-21T22:38:23.063166+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.063166+0000","last_undegraded":"2023-07-21T22:38:23.063166+0000","last_fullsized":"2023-07-21T22:38:23.063166+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.059287+0000","last_change":"2023-07-21T22:38:23.059287+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.059287+0000","last_undegraded":"2023-07-21T22:38:23.059287+0000","last_fullsized":"2023-07-21T22:38:23.059287+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054429+0000","last_change":"2023-07-21T22:38:23.054429+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054429+0000","last_undegraded":"2023-07-21T22:38:23.054429+0000","last_fullsized":"2023-07-21T22:38:23.054429+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.057369+0000","last_change":"2023-07-21T22:38:23.057369+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.057369+0000","last_undegraded":"2023-07-21T22:38:23.057369+0000","last_fullsized":"2023-07-21T22:38:23.057369+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056551+0000","last_change":"2023-07-21T22:38:23.056551+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056551+0000","last_undegraded":"2023-07-21T22:38:23.056551+0000","last_fullsized":"2023-07-21T22:38:23.056551+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056100+0000","last_change":"2023-07-21T22:38:23.056100+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056100+0000","last_undegraded":"2023-07-21T22:38:23.056100+0000","last_fullsized":"2023-07-21T22:38:23.056100+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054362+0000","last_change":"2023-07-21T22:38:23.054362+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054362+0000","last_undegraded":"2023-07-21T22:38:23.054362+0000","last_fullsized":"2023-07-21T22:38:23.054362+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.075979+0000","last_change":"2023-07-21T22:38:23.071766+0000","last_active":"2023-07-21T22:38:23.075979+0000","last_peered":"2023-07-21T22:38:23.075979+0000","last_clean":"2023-07-21T22:38:23.075979+0000","last_became_active":"2023-07-21T22:38:23.071479+0000","last_became_peered":"2023-07-21T22:38:23.071479+0000","last_unstale":"2023-07-21T22:38:23.075979+0000","last_undegraded":"2023-07-21T22:38:23.075979+0000","last_fullsized":"2023-07-21T22:38:23.075979+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:31:02.781796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058884+0000","last_change":"2023-07-21T22:38:23.058884+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058884+0000","last_undegraded":"2023-07-21T22:38:23.058884+0000","last_fullsized":"2023-07-21T22:38:23.058884+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.063953+0000","last_change":"2023-07-21T22:38:23.061581+0000","last_active":"2023-07-21T22:38:23.063953+0000","last_peered":"2023-07-21T22:38:23.063953+0000","last_clean":"2023-07-21T22:38:23.063953+0000","last_became_active":"2023-07-21T22:38:23.061317+0000","last_became_peered":"2023-07-21T22:38:23.061317+0000","last_unstale":"2023-07-21T22:38:23.063953+0000","last_undegraded":"2023-07-21T22:38:23.063953+0000","last_fullsized":"2023-07-21T22:38:23.063953+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:25:32.838226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.057681+0000","last_change":"2023-07-21T22:38:23.057681+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.057681+0000","last_undegraded":"2023-07-21T22:38:23.057681+0000","last_fullsized":"2023-07-21T22:38:23.057681+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.083881+0000","last_change":"2023-07-21T22:38:23.076553+0000","last_active":"2023-07-21T22:38:23.083881+0000","last_peered":"2023-07-21T22:38:23.083881+0000","last_clean":"2023-07-21T22:38:23.083881+0000","last_became_active":"2023-07-21T22:38:23.076250+0000","last_became_peered":"2023-07-21T22:38:23.076250+0000","last_unstale":"2023-07-21T22:38:23.083881+0000","last_undegraded":"2023-07-21T22:38:23.083881+0000","last_fullsized":"2023-07-21T22:38:23.083881+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:32:38.947160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.064400+0000","last_change":"2023-07-21T22:38:23.064400+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.064400+0000","last_undegraded":"2023-07-21T22:38:23.064400+0000","last_fullsized":"2023-07-21T22:38:23.064400+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.063335+0000","last_change":"2023-07-21T22:38:23.061237+0000","last_active":"2023-07-21T22:38:23.063335+0000","last_peered":"2023-07-21T22:38:23.063335+0000","last_clean":"2023-07-21T22:38:23.063335+0000","last_became_active":"2023-07-21T22:38:23.060950+0000","last_became_peered":"2023-07-21T22:38:23.060950+0000","last_unstale":"2023-07-21T22:38:23.063335+0000","last_undegraded":"2023-07-21T22:38:23.063335+0000","last_fullsized":"2023-07-21T22:38:23.063335+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:22:35.983664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.052966+0000","last_change":"2023-07-21T22:38:23.052966+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.052966+0000","last_undegraded":"2023-07-21T22:38:23.052966+0000","last_fullsized":"2023-07-21T22:38:23.052966+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.071069+0000","last_change":"2023-07-21T22:38:23.067155+0000","last_active":"2023-07-21T22:38:23.071069+0000","last_peered":"2023-07-21T22:38:23.071069+0000","last_clean":"2023-07-21T22:38:23.071069+0000","last_became_active":"2023-07-21T22:38:23.066836+0000","last_became_peered":"2023-07-21T22:38:23.066836+0000","last_unstale":"2023-07-21T22:38:23.071069+0000","last_undegraded":"2023-07-21T22:38:23.071069+0000","last_fullsized":"2023-07-21T22:38:23.071069+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:07:37.597596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056682+0000","last_change":"2023-07-21T22:38:23.056682+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056682+0000","last_undegraded":"2023-07-21T22:38:23.056682+0000","last_fullsized":"2023-07-21T22:38:23.056682+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.074401+0000","last_change":"2023-07-21T22:38:23.071033+0000","last_active":"2023-07-21T22:38:23.074401+0000","last_peered":"2023-07-21T22:38:23.074401+0000","last_clean":"2023-07-21T22:38:23.074401+0000","last_became_active":"2023-07-21T22:38:23.070744+0000","last_became_peered":"2023-07-21T22:38:23.070744+0000","last_unstale":"2023-07-21T22:38:23.074401+0000","last_undegraded":"2023-07-21T22:38:23.074401+0000","last_fullsized":"2023-07-21T22:38:23.074401+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:26:48.570149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056861+0000","last_change":"2023-07-21T22:38:23.056861+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056861+0000","last_undegraded":"2023-07-21T22:38:23.056861+0000","last_fullsized":"2023-07-21T22:38:23.056861+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.072250+0000","last_change":"2023-07-21T22:38:23.069579+0000","last_active":"2023-07-21T22:38:23.072250+0000","last_peered":"2023-07-21T22:38:23.072250+0000","last_clean":"2023-07-21T22:38:23.072250+0000","last_became_active":"2023-07-21T22:38:23.069255+0000","last_became_peered":"2023-07-21T22:38:23.069255+0000","last_unstale":"2023-07-21T22:38:23.072250+0000","last_undegraded":"2023-07-21T22:38:23.072250+0000","last_fullsized":"2023-07-21T22:38:23.072250+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:34:06.885474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054770+0000","last_change":"2023-07-21T22:38:23.054770+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054770+0000","last_undegraded":"2023-07-21T22:38:23.054770+0000","last_fullsized":"2023-07-21T22:38:23.054770+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.075743+0000","last_change":"2023-07-21T22:38:23.072024+0000","last_active":"2023-07-21T22:38:23.075743+0000","last_peered":"2023-07-21T22:38:23.075743+0000","last_clean":"2023-07-21T22:38:23.075743+0000","last_became_active":"2023-07-21T22:38:23.071738+0000","last_became_peered":"2023-07-21T22:38:23.071738+0000","last_unstale":"2023-07-21T22:38:23.075743+0000","last_undegraded":"2023-07-21T22:38:23.075743+0000","last_fullsized":"2023-07-21T22:38:23.075743+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:26:55.203317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.057169+0000","last_change":"2023-07-21T22:38:23.057169+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.057169+0000","last_undegraded":"2023-07-21T22:38:23.057169+0000","last_fullsized":"2023-07-21T22:38:23.057169+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.073719+0000","last_change":"2023-07-21T22:38:23.071033+0000","last_active":"2023-07-21T22:38:23.073719+0000","last_peered":"2023-07-21T22:38:23.073719+0000","last_clean":"2023-07-21T22:38:23.073719+0000","last_became_active":"2023-07-21T22:38:23.070685+0000","last_became_peered":"2023-07-21T22:38:23.070685+0000","last_unstale":"2023-07-21T22:38:23.073719+0000","last_undegraded":"2023-07-21T22:38:23.073719+0000","last_fullsized":"2023-07-21T22:38:23.073719+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:03.509609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056192+0000","last_change":"2023-07-21T22:38:23.056192+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056192+0000","last_undegraded":"2023-07-21T22:38:23.056192+0000","last_fullsized":"2023-07-21T22:38:23.056192+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.067689+0000","last_change":"2023-07-21T22:38:23.066606+0000","last_active":"2023-07-21T22:38:23.067689+0000","last_peered":"2023-07-21T22:38:23.067689+0000","last_clean":"2023-07-21T22:38:23.067689+0000","last_became_active":"2023-07-21T22:38:23.066288+0000","last_became_peered":"2023-07-21T22:38:23.066288+0000","last_unstale":"2023-07-21T22:38:23.067689+0000","last_undegraded":"2023-07-21T22:38:23.067689+0000","last_fullsized":"2023-07-21T22:38:23.067689+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:23:08.070998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.062315+0000","last_change":"2023-07-21T22:38:23.062315+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.062315+0000","last_undegraded":"2023-07-21T22:38:23.062315+0000","last_fullsized":"2023-07-21T22:38:23.062315+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.084392+0000","last_change":"2023-07-21T22:38:23.080670+0000","last_active":"2023-07-21T22:38:23.084392+0000","last_peered":"2023-07-21T22:38:23.084392+0000","last_clean":"2023-07-21T22:38:23.084392+0000","last_became_active":"2023-07-21T22:38:23.080326+0000","last_became_peered":"2023-07-21T22:38:23.080326+0000","last_unstale":"2023-07-21T22:38:23.084392+0000","last_undegraded":"2023-07-21T22:38:23.084392+0000","last_fullsized":"2023-07-21T22:38:23.084392+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:16:09.844811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056718+0000","last_change":"2023-07-21T22:38:23.056718+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056718+0000","last_undegraded":"2023-07-21T22:38:23.056718+0000","last_fullsized":"2023-07-21T22:38:23.056718+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.083942+0000","last_change":"2023-07-21T22:38:23.078636+0000","last_active":"2023-07-21T22:38:23.083942+0000","last_peered":"2023-07-21T22:38:23.083942+0000","last_clean":"2023-07-21T22:38:23.083942+0000","last_became_active":"2023-07-21T22:38:23.078443+0000","last_became_peered":"2023-07-21T22:38:23.078443+0000","last_unstale":"2023-07-21T22:38:23.083942+0000","last_undegraded":"2023-07-21T22:38:23.083942+0000","last_fullsized":"2023-07-21T22:38:23.083942+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:51:49.106671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.060531+0000","last_change":"2023-07-21T22:38:23.060531+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.060531+0000","last_undegraded":"2023-07-21T22:38:23.060531+0000","last_fullsized":"2023-07-21T22:38:23.060531+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.074292+0000","last_change":"2023-07-21T22:38:23.069898+0000","last_active":"2023-07-21T22:38:23.074292+0000","last_peered":"2023-07-21T22:38:23.074292+0000","last_clean":"2023-07-21T22:38:23.074292+0000","last_became_active":"2023-07-21T22:38:23.069638+0000","last_became_peered":"2023-07-21T22:38:23.069638+0000","last_unstale":"2023-07-21T22:38:23.074292+0000","last_undegraded":"2023-07-21T22:38:23.074292+0000","last_fullsized":"2023-07-21T22:38:23.074292+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:25:57.031023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.055886+0000","last_change":"2023-07-21T22:38:23.055886+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.055886+0000","last_undegraded":"2023-07-21T22:38:23.055886+0000","last_fullsized":"2023-07-21T22:38:23.055886+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.083856+0000","last_change":"2023-07-21T22:38:23.076677+0000","last_active":"2023-07-21T22:38:23.083856+0000","last_peered":"2023-07-21T22:38:23.083856+0000","last_clean":"2023-07-21T22:38:23.083856+0000","last_became_active":"2023-07-21T22:38:23.076377+0000","last_became_peered":"2023-07-21T22:38:23.076377+0000","last_unstale":"2023-07-21T22:38:23.083856+0000","last_undegraded":"2023-07-21T22:38:23.083856+0000","last_fullsized":"2023-07-21T22:38:23.083856+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:00:08.144958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056425+0000","last_change":"2023-07-21T22:38:23.056425+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056425+0000","last_undegraded":"2023-07-21T22:38:23.056425+0000","last_fullsized":"2023-07-21T22:38:23.056425+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.069157+0000","last_change":"2023-07-21T22:38:23.066154+0000","last_active":"2023-07-21T22:38:23.069157+0000","last_peered":"2023-07-21T22:38:23.069157+0000","last_clean":"2023-07-21T22:38:23.069157+0000","last_became_active":"2023-07-21T22:38:23.065865+0000","last_became_peered":"2023-07-21T22:38:23.065865+0000","last_unstale":"2023-07-21T22:38:23.069157+0000","last_undegraded":"2023-07-21T22:38:23.069157+0000","last_fullsized":"2023-07-21T22:38:23.069157+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:24:53.841626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056203+0000","last_change":"2023-07-21T22:38:23.056203+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056203+0000","last_undegraded":"2023-07-21T22:38:23.056203+0000","last_fullsized":"2023-07-21T22:38:23.056203+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.080104+0000","last_change":"2023-07-21T22:38:23.074540+0000","last_active":"2023-07-21T22:38:23.080104+0000","last_peered":"2023-07-21T22:38:23.080104+0000","last_clean":"2023-07-21T22:38:23.080104+0000","last_became_active":"2023-07-21T22:38:23.074297+0000","last_became_peered":"2023-07-21T22:38:23.074297+0000","last_unstale":"2023-07-21T22:38:23.080104+0000","last_undegraded":"2023-07-21T22:38:23.080104+0000","last_fullsized":"2023-07-21T22:38:23.080104+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:28:11.072255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058870+0000","last_change":"2023-07-21T22:38:23.058870+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058870+0000","last_undegraded":"2023-07-21T22:38:23.058870+0000","last_fullsized":"2023-07-21T22:38:23.058870+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.072289+0000","last_change":"2023-07-21T22:38:23.067648+0000","last_active":"2023-07-21T22:38:23.072289+0000","last_peered":"2023-07-21T22:38:23.072289+0000","last_clean":"2023-07-21T22:38:23.072289+0000","last_became_active":"2023-07-21T22:38:23.067340+0000","last_became_peered":"2023-07-21T22:38:23.067340+0000","last_unstale":"2023-07-21T22:38:23.072289+0000","last_undegraded":"2023-07-21T22:38:23.072289+0000","last_fullsized":"2023-07-21T22:38:23.072289+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:23:58.668883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.052301+0000","last_change":"2023-07-21T22:38:23.052301+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.052301+0000","last_undegraded":"2023-07-21T22:38:23.052301+0000","last_fullsized":"2023-07-21T22:38:23.052301+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.083742+0000","last_change":"2023-07-21T22:38:23.076843+0000","last_active":"2023-07-21T22:38:23.083742+0000","last_peered":"2023-07-21T22:38:23.083742+0000","last_clean":"2023-07-21T22:38:23.083742+0000","last_became_active":"2023-07-21T22:38:23.076531+0000","last_became_peered":"2023-07-21T22:38:23.076531+0000","last_unstale":"2023-07-21T22:38:23.083742+0000","last_undegraded":"2023-07-21T22:38:23.083742+0000","last_fullsized":"2023-07-21T22:38:23.083742+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:46:36.793506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.062536+0000","last_change":"2023-07-21T22:38:23.062536+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.062536+0000","last_undegraded":"2023-07-21T22:38:23.062536+0000","last_fullsized":"2023-07-21T22:38:23.062536+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.083832+0000","last_change":"2023-07-21T22:38:23.077345+0000","last_active":"2023-07-21T22:38:23.083832+0000","last_peered":"2023-07-21T22:38:23.083832+0000","last_clean":"2023-07-21T22:38:23.083832+0000","last_became_active":"2023-07-21T22:38:23.076977+0000","last_became_peered":"2023-07-21T22:38:23.076977+0000","last_unstale":"2023-07-21T22:38:23.083832+0000","last_undegraded":"2023-07-21T22:38:23.083832+0000","last_fullsized":"2023-07-21T22:38:23.083832+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:18:48.303353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.053644+0000","last_change":"2023-07-21T22:38:23.053644+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.053644+0000","last_undegraded":"2023-07-21T22:38:23.053644+0000","last_fullsized":"2023-07-21T22:38:23.053644+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.075732+0000","last_change":"2023-07-21T22:38:23.072030+0000","last_active":"2023-07-21T22:38:23.075732+0000","last_peered":"2023-07-21T22:38:23.075732+0000","last_clean":"2023-07-21T22:38:23.075732+0000","last_became_active":"2023-07-21T22:38:23.071779+0000","last_became_peered":"2023-07-21T22:38:23.071779+0000","last_unstale":"2023-07-21T22:38:23.075732+0000","last_undegraded":"2023-07-21T22:38:23.075732+0000","last_fullsized":"2023-07-21T22:38:23.075732+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:53:20.230381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058197+0000","last_change":"2023-07-21T22:38:23.058197+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058197+0000","last_undegraded":"2023-07-21T22:38:23.058197+0000","last_fullsized":"2023-07-21T22:38:23.058197+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.066553+0000","last_change":"2023-07-21T22:38:23.064167+0000","last_active":"2023-07-21T22:38:23.066553+0000","last_peered":"2023-07-21T22:38:23.066553+0000","last_clean":"2023-07-21T22:38:23.066553+0000","last_became_active":"2023-07-21T22:38:23.063832+0000","last_became_peered":"2023-07-21T22:38:23.063832+0000","last_unstale":"2023-07-21T22:38:23.066553+0000","last_undegraded":"2023-07-21T22:38:23.066553+0000","last_fullsized":"2023-07-21T22:38:23.066553+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:22:01.415836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.053443+0000","last_change":"2023-07-21T22:38:23.053443+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.053443+0000","last_undegraded":"2023-07-21T22:38:23.053443+0000","last_fullsized":"2023-07-21T22:38:23.053443+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.070149+0000","last_change":"2023-07-21T22:38:23.069081+0000","last_active":"2023-07-21T22:38:23.070149+0000","last_peered":"2023-07-21T22:38:23.070149+0000","last_clean":"2023-07-21T22:38:23.070149+0000","last_became_active":"2023-07-21T22:38:23.068690+0000","last_became_peered":"2023-07-21T22:38:23.068690+0000","last_unstale":"2023-07-21T22:38:23.070149+0000","last_undegraded":"2023-07-21T22:38:23.070149+0000","last_fullsized":"2023-07-21T22:38:23.070149+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:33:23.832514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.065544+0000","last_change":"2023-07-21T22:38:23.065544+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.065544+0000","last_undegraded":"2023-07-21T22:38:23.065544+0000","last_fullsized":"2023-07-21T22:38:23.065544+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.075782+0000","last_change":"2023-07-21T22:38:23.072049+0000","last_active":"2023-07-21T22:38:23.075782+0000","last_peered":"2023-07-21T22:38:23.075782+0000","last_clean":"2023-07-21T22:38:23.075782+0000","last_became_active":"2023-07-21T22:38:23.071697+0000","last_became_peered":"2023-07-21T22:38:23.071697+0000","last_unstale":"2023-07-21T22:38:23.075782+0000","last_undegraded":"2023-07-21T22:38:23.075782+0000","last_fullsized":"2023-07-21T22:38:23.075782+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:50:06.058541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.052292+0000","last_change":"2023-07-21T22:38:23.052292+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.052292+0000","last_undegraded":"2023-07-21T22:38:23.052292+0000","last_fullsized":"2023-07-21T22:38:23.052292+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.083930+0000","last_change":"2023-07-21T22:38:23.076939+0000","last_active":"2023-07-21T22:38:23.083930+0000","last_peered":"2023-07-21T22:38:23.083930+0000","last_clean":"2023-07-21T22:38:23.083930+0000","last_became_active":"2023-07-21T22:38:23.076616+0000","last_became_peered":"2023-07-21T22:38:23.076616+0000","last_unstale":"2023-07-21T22:38:23.083930+0000","last_undegraded":"2023-07-21T22:38:23.083930+0000","last_fullsized":"2023-07-21T22:38:23.083930+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:25.345042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.063974+0000","last_change":"2023-07-21T22:38:23.063974+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.063974+0000","last_undegraded":"2023-07-21T22:38:23.063974+0000","last_fullsized":"2023-07-21T22:38:23.063974+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.070815+0000","last_change":"2023-07-21T22:38:23.068532+0000","last_active":"2023-07-21T22:38:23.070815+0000","last_peered":"2023-07-21T22:38:23.070815+0000","last_clean":"2023-07-21T22:38:23.070815+0000","last_became_active":"2023-07-21T22:38:23.068250+0000","last_became_peered":"2023-07-21T22:38:23.068250+0000","last_unstale":"2023-07-21T22:38:23.070815+0000","last_undegraded":"2023-07-21T22:38:23.070815+0000","last_fullsized":"2023-07-21T22:38:23.070815+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:20:08.667299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"130'249","reported_seq":850,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.069273+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:38:23.069273+0000","last_peered":"2023-07-21T22:38:23.069273+0000","last_clean":"2023-07-21T22:38:23.069273+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:38:23.069273+0000","last_undegraded":"2023-07-21T22:38:23.069273+0000","last_fullsized":"2023-07-21T22:38:23.069273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:30:42.824483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":248,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.061108+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:38:23.061108+0000","last_peered":"2023-07-21T22:38:23.061108+0000","last_clean":"2023-07-21T22:38:23.061108+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:38:23.061108+0000","last_undegraded":"2023-07-21T22:38:23.061108+0000","last_fullsized":"2023-07-21T22:38:23.061108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:06:29.154549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.062847+0000","last_change":"2023-07-21T22:38:23.062847+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.062847+0000","last_undegraded":"2023-07-21T22:38:23.062847+0000","last_fullsized":"2023-07-21T22:38:23.062847+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.066848+0000","last_change":"2023-07-21T22:38:23.063181+0000","last_active":"2023-07-21T22:38:23.066848+0000","last_peered":"2023-07-21T22:38:23.066848+0000","last_clean":"2023-07-21T22:38:23.066848+0000","last_became_active":"2023-07-21T22:38:23.062917+0000","last_became_peered":"2023-07-21T22:38:23.062917+0000","last_unstale":"2023-07-21T22:38:23.066848+0000","last_undegraded":"2023-07-21T22:38:23.066848+0000","last_fullsized":"2023-07-21T22:38:23.066848+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:36:46.103640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":226,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.069151+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:38:23.069151+0000","last_peered":"2023-07-21T22:38:23.069151+0000","last_clean":"2023-07-21T22:38:23.069151+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:38:23.069151+0000","last_undegraded":"2023-07-21T22:38:23.069151+0000","last_fullsized":"2023-07-21T22:38:23.069151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:28.789417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.052705+0000","last_change":"2023-07-21T22:38:23.052705+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.052705+0000","last_undegraded":"2023-07-21T22:38:23.052705+0000","last_fullsized":"2023-07-21T22:38:23.052705+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.070821+0000","last_change":"2023-07-21T22:38:23.069398+0000","last_active":"2023-07-21T22:38:23.070821+0000","last_peered":"2023-07-21T22:38:23.070821+0000","last_clean":"2023-07-21T22:38:23.070821+0000","last_became_active":"2023-07-21T22:38:23.069091+0000","last_became_peered":"2023-07-21T22:38:23.069091+0000","last_unstale":"2023-07-21T22:38:23.070821+0000","last_undegraded":"2023-07-21T22:38:23.070821+0000","last_fullsized":"2023-07-21T22:38:23.070821+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:38:33.051764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":224,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.051927+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:38:23.051927+0000","last_peered":"2023-07-21T22:38:23.051927+0000","last_clean":"2023-07-21T22:38:23.051927+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:38:23.051927+0000","last_undegraded":"2023-07-21T22:38:23.051927+0000","last_fullsized":"2023-07-21T22:38:23.051927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:19.912597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054021+0000","last_change":"2023-07-21T22:38:23.054021+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054021+0000","last_undegraded":"2023-07-21T22:38:23.054021+0000","last_fullsized":"2023-07-21T22:38:23.054021+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.066791+0000","last_change":"2023-07-21T22:38:23.062898+0000","last_active":"2023-07-21T22:38:23.066791+0000","last_peered":"2023-07-21T22:38:23.066791+0000","last_clean":"2023-07-21T22:38:23.066791+0000","last_became_active":"2023-07-21T22:38:23.062603+0000","last_became_peered":"2023-07-21T22:38:23.062603+0000","last_unstale":"2023-07-21T22:38:23.066791+0000","last_undegraded":"2023-07-21T22:38:23.066791+0000","last_fullsized":"2023-07-21T22:38:23.066791+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:31:59.541471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":248,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.059920+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:38:23.059920+0000","last_peered":"2023-07-21T22:38:23.059920+0000","last_clean":"2023-07-21T22:38:23.059920+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:38:23.059920+0000","last_undegraded":"2023-07-21T22:38:23.059920+0000","last_fullsized":"2023-07-21T22:38:23.059920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:07:21.311463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.062904+0000","last_change":"2023-07-21T22:38:23.062904+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.062904+0000","last_undegraded":"2023-07-21T22:38:23.062904+0000","last_fullsized":"2023-07-21T22:38:23.062904+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.079842+0000","last_change":"2023-07-21T22:38:23.073676+0000","last_active":"2023-07-21T22:38:23.079842+0000","last_peered":"2023-07-21T22:38:23.079842+0000","last_clean":"2023-07-21T22:38:23.079842+0000","last_became_active":"2023-07-21T22:38:23.073401+0000","last_became_peered":"2023-07-21T22:38:23.073401+0000","last_unstale":"2023-07-21T22:38:23.079842+0000","last_undegraded":"2023-07-21T22:38:23.079842+0000","last_fullsized":"2023-07-21T22:38:23.079842+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:38:39.057650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":240,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.049280+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:38:23.049280+0000","last_peered":"2023-07-21T22:38:23.049280+0000","last_clean":"2023-07-21T22:38:23.049280+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:38:23.049280+0000","last_undegraded":"2023-07-21T22:38:23.049280+0000","last_fullsized":"2023-07-21T22:38:23.049280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:47:57.599145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.057612+0000","last_change":"2023-07-21T22:38:23.057612+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.057612+0000","last_undegraded":"2023-07-21T22:38:23.057612+0000","last_fullsized":"2023-07-21T22:38:23.057612+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.070595+0000","last_change":"2023-07-21T22:38:23.064930+0000","last_active":"2023-07-21T22:38:23.070595+0000","last_peered":"2023-07-21T22:38:23.070595+0000","last_clean":"2023-07-21T22:38:23.070595+0000","last_became_active":"2023-07-21T22:38:23.064654+0000","last_became_peered":"2023-07-21T22:38:23.064654+0000","last_unstale":"2023-07-21T22:38:23.070595+0000","last_undegraded":"2023-07-21T22:38:23.070595+0000","last_fullsized":"2023-07-21T22:38:23.070595+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:31.160555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":226,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.071595+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:38:23.071595+0000","last_peered":"2023-07-21T22:38:23.071595+0000","last_clean":"2023-07-21T22:38:23.071595+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:38:23.071595+0000","last_undegraded":"2023-07-21T22:38:23.071595+0000","last_fullsized":"2023-07-21T22:38:23.071595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:42:04.153664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.055927+0000","last_change":"2023-07-21T22:38:23.055927+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.055927+0000","last_undegraded":"2023-07-21T22:38:23.055927+0000","last_fullsized":"2023-07-21T22:38:23.055927+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.079939+0000","last_change":"2023-07-21T22:38:23.073379+0000","last_active":"2023-07-21T22:38:23.079939+0000","last_peered":"2023-07-21T22:38:23.079939+0000","last_clean":"2023-07-21T22:38:23.079939+0000","last_became_active":"2023-07-21T22:38:23.073091+0000","last_became_peered":"2023-07-21T22:38:23.073091+0000","last_unstale":"2023-07-21T22:38:23.079939+0000","last_undegraded":"2023-07-21T22:38:23.079939+0000","last_fullsized":"2023-07-21T22:38:23.079939+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:57:18.041817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":240,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.049276+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:38:23.049276+0000","last_peered":"2023-07-21T22:38:23.049276+0000","last_clean":"2023-07-21T22:38:23.049276+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:38:23.049276+0000","last_undegraded":"2023-07-21T22:38:23.049276+0000","last_fullsized":"2023-07-21T22:38:23.049276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:14:30.325976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.057255+0000","last_change":"2023-07-21T22:38:23.057255+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.057255+0000","last_undegraded":"2023-07-21T22:38:23.057255+0000","last_fullsized":"2023-07-21T22:38:23.057255+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.066909+0000","last_change":"2023-07-21T22:38:23.061980+0000","last_active":"2023-07-21T22:38:23.066909+0000","last_peered":"2023-07-21T22:38:23.066909+0000","last_clean":"2023-07-21T22:38:23.066909+0000","last_became_active":"2023-07-21T22:38:23.061558+0000","last_became_peered":"2023-07-21T22:38:23.061558+0000","last_unstale":"2023-07-21T22:38:23.066909+0000","last_undegraded":"2023-07-21T22:38:23.066909+0000","last_fullsized":"2023-07-21T22:38:23.066909+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:51:44.530129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":222,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.063664+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:38:23.063664+0000","last_peered":"2023-07-21T22:38:23.063664+0000","last_clean":"2023-07-21T22:38:23.063664+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:38:23.063664+0000","last_undegraded":"2023-07-21T22:38:23.063664+0000","last_fullsized":"2023-07-21T22:38:23.063664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:56:58.160508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509675,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59568,"kb_used_data":2280,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312272,"statfs":{"total":96636764160,"available":96575766528,"internally_reserved":0,"allocated":2334720,"data_stored":1470982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69099999999999995,"15min":0.73199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35299999999999998},"max":{"1min":0.876,"5min":1.1180000000000001,"15min":3.5059999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66400000000000003,"15min":0.69399999999999995},"min":{"1min":0.46200000000000002,"5min":0.40899999999999997,"15min":0.39500000000000002},"max":{"1min":0.94199999999999995,"5min":0.94399999999999995,"15min":3.2709999999999999},"last":0.628}]},{"osd":1,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.70599999999999996,"15min":0.72799999999999998},"min":{"1min":0.49199999999999999,"5min":0.44900000000000001,"15min":0.432},"max":{"1min":0.98599999999999999,"5min":1.0680000000000001,"15min":1.5429999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.71299999999999997},"min":{"1min":0.44800000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96499999999999997,"5min":1.093,"15min":1.093},"last":0.61599999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70899999999999996,"15min":0.73599999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":1.1399999999999999,"15min":1.405},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73199999999999998,"15min":0.746},"min":{"1min":0.55100000000000005,"5min":0.47999999999999998,"15min":0.45800000000000002},"max":{"1min":0.92800000000000005,"5min":1.083,"15min":1.409},"last":0.70199999999999996}]},{"osd":3,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75900000000000001,"15min":0.76500000000000001},"min":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0209999999999999,"5min":1.1539999999999999,"15min":1.46},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.48599999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94899999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.55900000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55700000000000005,"15min":0.56200000000000006},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.67500000000000004,"5min":0.90000000000000002,"15min":0.94999999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82299999999999995,"5min":0.97399999999999998,"15min":1.7949999999999999},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.89700000000000002,"5min":0.98799999999999999,"15min":2.2120000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70199999999999996,"15min":0.68100000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.38300000000000001},"max":{"1min":0.95199999999999996,"5min":1.052,"15min":1.506},"last":0.65000000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.68100000000000005},"min":{"1min":0.53700000000000003,"5min":0.44900000000000001,"15min":0.41999999999999998},"max":{"1min":0.93500000000000005,"5min":1.0329999999999999,"15min":1.048},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.42699999999999999},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.57399999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542381,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36844,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334996,"statfs":{"total":96636764160,"available":96599035904,"internally_reserved":0,"allocated":1740800,"data_stored":880614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.755},"min":{"1min":0.47099999999999997,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.94399999999999995,"5min":1.016,"15min":1.016},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.437},"max":{"1min":0.96799999999999997,"5min":1.0289999999999999,"15min":1.1180000000000001},"last":0.74099999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.70099999999999996,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.49099999999999999,"15min":0.45300000000000001},"max":{"1min":0.872,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.501},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.45800000000000002,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.93300000000000005,"5min":0.99199999999999999,"15min":1.117},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71099999999999997,"15min":0.74199999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.42799999999999999},"max":{"1min":0.89600000000000002,"5min":0.98099999999999998,"15min":0.997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.78700000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.45500000000000002},"max":{"1min":0.98199999999999998,"5min":1.0149999999999999,"15min":1.097},"last":0.59199999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71999999999999997,"15min":0.748},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":1.048,"15min":1.048},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70499999999999996,"15min":0.72899999999999998},"min":{"1min":0.52300000000000002,"5min":0.49399999999999999,"15min":0.46899999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0049999999999999},"last":0.56799999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.93400000000000005,"15min":1.0229999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.39700000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.879}]},{"osd":5,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.054},"last":0.45000000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70299999999999996,"15min":0.68100000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.443},"max":{"1min":1.024,"5min":1.024,"15min":1.079},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.621}]}]},{"osd":5,"up_from":15,"seq":64424509674,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50784,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321056,"statfs":{"total":96636764160,"available":96584761344,"internally_reserved":0,"allocated":1728512,"data_stored":873914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.70999999999999996},"min":{"1min":0.48099999999999998,"5min":0.38500000000000001,"15min":0.35699999999999998},"max":{"1min":0.96499999999999997,"5min":1,"15min":1.8779999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.97999999999999998,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.68600000000000005,"15min":0.70299999999999996},"min":{"1min":0.505,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.95899999999999996,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69099999999999995,"15min":0.72099999999999997},"min":{"1min":0.42699999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.617},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71099999999999997,"15min":0.72699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.33600000000000002},"max":{"1min":1.008,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.42199999999999999,"15min":0.377},"max":{"1min":0.89300000000000002,"5min":1.073,"15min":1.512},"last":0.65700000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76900000000000002,"15min":0.77800000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":1.0009999999999999,"15min":1.472},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76000000000000001,"15min":0.78700000000000003},"min":{"1min":0.60099999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.997,"5min":1.022,"15min":1.556},"last":0.69299999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.372,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83699999999999997,"5min":0.88900000000000001,"15min":0.96999999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72399999999999998,"15min":0.69599999999999995},"min":{"1min":0.58899999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.92300000000000004,"5min":0.92400000000000004,"15min":1.038},"last":0.79100000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":0.95499999999999996,"15min":1.0049999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.40200000000000002,"15min":0.40000000000000002},"max":{"1min":0.76600000000000001,"5min":0.93799999999999994,"15min":1.02},"last":0.71099999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70099999999999996,"15min":0.65700000000000003},"min":{"1min":0.46200000000000002,"5min":0.40999999999999998,"15min":0.374},"max":{"1min":0.96699999999999997,"5min":1.042,"15min":1.042},"last":0.751},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":0.73099999999999998},"min":{"1min":0.59799999999999998,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.88300000000000001,"5min":0.999,"15min":1.7390000000000001},"last":0.73299999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509675,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1728512,"data_stored":873914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.70399999999999996,"15min":0.73599999999999999},"min":{"1min":0.46800000000000003,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.71399999999999997,"15min":0.73699999999999999},"min":{"1min":0.47999999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98499999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.52900000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.70199999999999996},"min":{"1min":0.46999999999999997,"5min":0.442,"15min":0.39400000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67600000000000005,"15min":0.69999999999999996},"min":{"1min":0.44400000000000001,"5min":0.43099999999999999,"15min":0.36899999999999999},"max":{"1min":0.90400000000000003,"5min":0.93000000000000005,"15min":1.016},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72799999999999998,"15min":0.755},"min":{"1min":0.55800000000000005,"5min":0.49099999999999999,"15min":0.371},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73799999999999999,"15min":0.76400000000000001},"min":{"1min":0.52400000000000002,"5min":0.47699999999999998,"15min":0.33000000000000002},"max":{"1min":1.018,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.40100000000000002},"max":{"1min":0.91000000000000003,"5min":0.97999999999999998,"15min":1.026},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75900000000000001,"15min":0.77900000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47999999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.66500000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60799999999999998,"15min":0.58499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34399999999999997},"max":{"1min":0.96199999999999997,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.60399999999999998,"15min":0.59499999999999997},"min":{"1min":0.44400000000000001,"5min":0.38800000000000001,"15min":0.32800000000000001},"max":{"1min":0.93600000000000005,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.70799999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.753},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.41599999999999998},"max":{"1min":1.0089999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.65200000000000002},"min":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.39200000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.0429999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.61699999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509674,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32748,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339092,"statfs":{"total":96636764160,"available":96603230208,"internally_reserved":0,"allocated":1740800,"data_stored":880614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46899999999999997,"15min":0.47499999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":0.77800000000000002,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.35899999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46200000000000002,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60299999999999998,"5min":0.754,"15min":0.83499999999999996},"last":0.316},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.41999999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71899999999999997,"5min":0.82599999999999996,"15min":0.90100000000000002},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67600000000000005,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.59599999999999997},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.99199999999999999},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.755,"15min":0.77000000000000002},"min":{"1min":0.57599999999999996,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91200000000000003,"5min":1.093,"15min":1.1279999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.81399999999999995},"min":{"1min":0.54500000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.93200000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.76900000000000002},"min":{"1min":0.54900000000000004,"5min":0.501,"15min":0.48999999999999999},"max":{"1min":0.97799999999999998,"5min":1.0669999999999999,"15min":1.137},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.51300000000000001,"15min":0.42899999999999999},"max":{"1min":0.86399999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76900000000000002,"15min":0.79000000000000004},"min":{"1min":0.51900000000000002,"5min":0.51700000000000002,"15min":0.47399999999999998},"max":{"1min":0.91700000000000004,"5min":1.0680000000000001,"15min":1.169},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91300000000000003,"5min":1.107,"15min":1.1120000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79200000000000004,"15min":0.81299999999999994},"min":{"1min":0.621,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94299999999999995,"5min":1.083,"15min":1.099},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80900000000000005,"15min":0.82799999999999996},"min":{"1min":0.61299999999999999,"5min":0.55200000000000005,"15min":0.48599999999999999},"max":{"1min":0.92200000000000004,"5min":1.623,"15min":1.623},"last":0.78100000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509676,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54892,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316948,"statfs":{"total":96636764160,"available":96580554752,"internally_reserved":0,"allocated":1740800,"data_stored":880614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.46400000000000002},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.23899999999999999},"max":{"1min":0.624,"5min":0.75,"15min":0.94199999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50600000000000001,"15min":0.54100000000000004},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.308},"max":{"1min":0.64200000000000002,"5min":0.88300000000000001,"15min":1.0409999999999999},"last":0.53600000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.40699999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72599999999999998,"5min":0.86699999999999999,"15min":0.93999999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.012,"15min":1.085},"last":0.45300000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46300000000000002,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.623,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.56399999999999995},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.85299999999999998,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.46600000000000003,"15min":0.376},"max":{"1min":1.016,"5min":1.1579999999999999,"15min":1.3420000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73599999999999999,"15min":0.78500000000000003},"min":{"1min":0.48899999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.996,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.64900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0780000000000001,"5min":1.214,"15min":1.214},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77700000000000002,"15min":0.80600000000000005},"min":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.46400000000000002},"max":{"1min":1.012,"5min":1.2689999999999999,"15min":1.3089999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.746,"15min":0.78300000000000003},"min":{"1min":0.52800000000000002,"5min":0.499,"15min":0.40300000000000002},"max":{"1min":0.94399999999999995,"5min":1.536,"15min":1.536},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.46200000000000002},"max":{"1min":1.0289999999999999,"5min":1.1339999999999999,"15min":1.2649999999999999},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77500000000000002,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.008,"5min":1.143,"15min":1.214},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.751,"15min":0.79700000000000004},"min":{"1min":0.58899999999999997,"5min":0.50900000000000001,"15min":0.44700000000000001},"max":{"1min":0.91200000000000003,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.73799999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509675,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32748,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339092,"statfs":{"total":96636764160,"available":96603230208,"internally_reserved":0,"allocated":1740800,"data_stored":880614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.47499999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.22900000000000001},"max":{"1min":0.60399999999999998,"5min":0.78700000000000003,"15min":0.84599999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54100000000000004,"15min":0.55900000000000005},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.35099999999999998},"max":{"1min":0.80900000000000005,"5min":0.82499999999999996,"15min":0.872},"last":0.441}]},{"osd":2,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48999999999999999,"15min":0.502},"min":{"1min":0.36199999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"max":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":0.81000000000000005},"last":0.317},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.29099999999999998},"max":{"1min":0.71899999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.42299999999999999,"5min":0.378,"15min":0.33400000000000002},"max":{"1min":0.76100000000000001,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":0.77600000000000002,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.34699999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.432},"max":{"1min":1.115,"5min":1.294,"15min":1.294},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77800000000000002,"15min":0.79000000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.498},"max":{"1min":1.1220000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.95399999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.753,"15min":0.77200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.41899999999999998},"max":{"1min":1.0980000000000001,"5min":1.242,"15min":1.242},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.55700000000000005,"5min":0.51500000000000001,"15min":0.376},"max":{"1min":1.1639999999999999,"5min":1.276,"15min":1.2849999999999999},"last":0.93700000000000006}]},{"osd":6,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77700000000000002,"15min":0.80000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.47899999999999998},"max":{"1min":1.0800000000000001,"5min":1.208,"15min":1.23},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.78100000000000003},"min":{"1min":0.56100000000000005,"5min":0.50900000000000001,"15min":0.46500000000000002},"max":{"1min":1.0109999999999999,"5min":1.244,"15min":1.3240000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78500000000000003,"15min":0.80400000000000005},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.49199999999999999},"max":{"1min":1.089,"5min":1.3120000000000001,"15min":1.3149999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.45700000000000002},"max":{"1min":1.0289999999999999,"5min":1.1819999999999999,"15min":1.3380000000000001},"last":0.79000000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509677,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37412,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334428,"statfs":{"total":96636764160,"available":96598454272,"internally_reserved":0,"allocated":2322432,"data_stored":1464282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46999999999999997,"15min":0.46899999999999997},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.26600000000000001},"max":{"1min":0.70399999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.499}]},{"osd":2,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.42099999999999999,"5min":0.32400000000000001,"15min":0.29799999999999999},"max":{"1min":0.82599999999999996,"5min":0.871,"15min":1.3680000000000001},"last":0.442},{"interface":"front","average":{"1min":0.504,"5min":0.49299999999999999,"15min":0.51700000000000002},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.32600000000000001},"max":{"1min":0.68200000000000005,"5min":0.76700000000000002,"15min":0.871},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57299999999999995,"15min":0.58999999999999997},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.33700000000000002},"max":{"1min":0.745,"5min":1.038,"15min":1.038},"last":0.46200000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.79900000000000004,"15min":0.78400000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.45200000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.3009999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.80500000000000005,"15min":0.80200000000000005},"min":{"1min":0.54500000000000004,"5min":0.505,"15min":0.44600000000000001},"max":{"1min":1.278,"5min":1.278,"15min":1.423},"last":0.627}]},{"osd":5,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78200000000000003,"15min":0.77900000000000003},"min":{"1min":0.56799999999999995,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.0229999999999999,"5min":1.1020000000000001,"15min":1.2669999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81000000000000005,"15min":0.80800000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.39600000000000002},"max":{"1min":1.1950000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.72799999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.48899999999999999},"max":{"1min":1.054,"5min":1.27,"15min":1.27},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.81100000000000005,"15min":0.81799999999999995},"min":{"1min":0.64300000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.333},"last":0.75800000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.60099999999999998,"5min":0.54300000000000004,"15min":0.53100000000000003},"max":{"1min":1.121,"5min":1.159,"15min":1.2310000000000001},"last":0.746},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.80800000000000005,"15min":0.82799999999999996},"min":{"1min":0.55600000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.109,"5min":1.1930000000000001,"15min":1.369},"last":0.68600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:38:28.639 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:38:28.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.772+0000 7f92d1ed8640 1 Processor -- start 2023-07-21T22:38:28.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.772+0000 7f92d1ed8640 1 -- start start 2023-07-21T22:38:28.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.772+0000 7f92d1ed8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92cc160330 0x7f92cc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:28.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.772+0000 7f92d1ed8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f92cc0c8940 0x7f92cc0ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:28.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.772+0000 7f92d1ed8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92cc0c17d0 con 0x7f92cc0c0f80 2023-07-21T22:38:28.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.776+0000 7f92d1ed8640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92cc0c14f0 con 0x7f92cc0c8940 2023-07-21T22:38:28.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.776+0000 7f92d1ed8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc0cac10 con 0x7f92cc160330 2023-07-21T22:38:28.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.776+0000 7f92cb7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92cc160330 0x7f92cc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:28.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.776+0000 7f92caffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f92cc0c8940 0x7f92cc0ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:28.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.776+0000 7f92cbfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f92cc0c0f80 0x7f92cc0cd490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:43112/0 (socket says 172.21.15.6:43112) 2023-07-21T22:38:28.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.776+0000 7f92cbfff640 1 -- 172.21.15.6:0/4002382381 learned_addr learned my addr 172.21.15.6:0/4002382381 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:28.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.776+0000 7f92cb7fe640 1 -- 172.21.15.6:0/4002382381 >> v2:172.21.15.161:3300/0 conn(0x7f92cc0c8940 msgr2=0x7f92cc0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:28.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.776+0000 7f92cb7fe640 1 --2- 172.21.15.6:0/4002382381 >> v2:172.21.15.161:3300/0 conn(0x7f92cc0c8940 0x7f92cc0ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.776+0000 7f92cb7fe640 1 -- 172.21.15.6:0/4002382381 >> v1:172.21.15.161:6789/0 conn(0x7f92cc0c0f80 legacy=0x7f92cc0cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:28.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.776+0000 7f92cb7fe640 1 -- 172.21.15.6:0/4002382381 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92cc0caef0 con 0x7f92cc160330 2023-07-21T22:38:28.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.776+0000 7f92caffd640 1 --2- 172.21.15.6:0/4002382381 >> v2:172.21.15.161:3300/0 conn(0x7f92cc0c8940 0x7f92cc0ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:28.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.780+0000 7f92cb7fe640 1 --2- 172.21.15.6:0/4002382381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92cc160330 0x7f92cc0cb6f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0097c0 tx=0x7f92bc01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e57853bb67a4a291 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:28.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.780+0000 7f92ca7fc640 1 -- 172.21.15.6:0/4002382381 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0ab600 con 0x7f92cc160330 2023-07-21T22:38:28.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.780+0000 7f92ca7fc640 1 -- 172.21.15.6:0/4002382381 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92bc0a7050 con 0x7f92cc160330 2023-07-21T22:38:28.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.780+0000 7f92ca7fc640 1 -- 172.21.15.6:0/4002382381 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0ab980 con 0x7f92cc160330 2023-07-21T22:38:28.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.780+0000 7f92d1ed8640 1 -- 172.21.15.6:0/4002382381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92cc160330 msgr2=0x7f92cc0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:28.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.780+0000 7f92d1ed8640 1 --2- 172.21.15.6:0/4002382381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92cc160330 0x7f92cc0cb6f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0097c0 tx=0x7f92bc01c3a0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.780+0000 7f92d1ed8640 1 -- 172.21.15.6:0/4002382381 shutdown_connections 2023-07-21T22:38:28.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.780+0000 7f92d1ed8640 1 --2- 172.21.15.6:0/4002382381 >> v2:172.21.15.161:3300/0 conn(0x7f92cc0c8940 0x7f92cc0ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.780+0000 7f92d1ed8640 1 --2- 172.21.15.6:0/4002382381 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92cc160330 0x7f92cc0cb6f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.780+0000 7f92d1ed8640 1 -- 172.21.15.6:0/4002382381 >> 172.21.15.6:0/4002382381 conn(0x7f92cc0afcf0 msgr2=0x7f92cc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:28.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.780+0000 7f92d1ed8640 1 -- 172.21.15.6:0/4002382381 shutdown_connections 2023-07-21T22:38:28.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.780+0000 7f92d1ed8640 1 -- 172.21.15.6:0/4002382381 wait complete. 2023-07-21T22:38:28.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.780+0000 7f92d1ed8640 1 Processor -- start 2023-07-21T22:38:28.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.780+0000 7f92d1ed8640 1 -- start start 2023-07-21T22:38:28.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92d1ed8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92cc0c0f80 0x7f92cc1526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:28.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92d1ed8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92cc0c8940 0x7f92cc161bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:28.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92d1ed8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92cc160330 0x7f92cc0c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:28.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92d1ed8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc0b1c20 con 0x7f92cc0c8940 2023-07-21T22:38:28.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92d1ed8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc0b18f0 con 0x7f92cc160330 2023-07-21T22:38:28.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92d1ed8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc152be0 con 0x7f92cc0c0f80 2023-07-21T22:38:28.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92caffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92cc0c8940 0x7f92cc161bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:28.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92caffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92cc0c8940 0x7f92cc161bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45480/0 (socket says 172.21.15.6:45480) 2023-07-21T22:38:28.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92caffd640 1 -- 172.21.15.6:0/1070277208 learned_addr learned my addr 172.21.15.6:0/1070277208 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:28.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92caffd640 1 -- 172.21.15.6:0/1070277208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92cc0c0f80 msgr2=0x7f92cc1526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:28.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92cb7fe640 1 --2- 172.21.15.6:0/1070277208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92cc0c0f80 0x7f92cc1526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:28.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92cbfff640 1 --2- 172.21.15.6:0/1070277208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92cc160330 0x7f92cc0c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:28.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92caffd640 1 --2- 172.21.15.6:0/1070277208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92cc0c0f80 0x7f92cc1526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92caffd640 1 -- 172.21.15.6:0/1070277208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92cc160330 msgr2=0x7f92cc0c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:28.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92caffd640 1 --2- 172.21.15.6:0/1070277208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92cc160330 0x7f92cc0c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:28.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92caffd640 1 -- 172.21.15.6:0/1070277208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c0009420 con 0x7f92cc0c8940 2023-07-21T22:38:28.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92cb7fe640 1 --2- 172.21.15.6:0/1070277208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92cc0c0f80 0x7f92cc1526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:28.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92cbfff640 1 --2- 172.21.15.6:0/1070277208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92cc160330 0x7f92cc0c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:28.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92caffd640 1 --2- 172.21.15.6:0/1070277208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92cc0c8940 0x7f92cc161bc0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f92c000ebe0 tx=0x7f92c000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:28.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92b3fff640 1 -- 172.21.15.6:0/1070277208 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c000eee0 con 0x7f92cc0c8940 2023-07-21T22:38:28.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92b3fff640 1 -- 172.21.15.6:0/1070277208 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c000cc30 con 0x7f92cc0c8940 2023-07-21T22:38:28.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92b3fff640 1 -- 172.21.15.6:0/1070277208 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c0013470 con 0x7f92cc0c8940 2023-07-21T22:38:28.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92d1ed8640 1 -- 172.21.15.6:0/1070277208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92bc009420 con 0x7f92cc0c8940 2023-07-21T22:38:28.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92d1ed8640 1 -- 172.21.15.6:0/1070277208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92cc1628d0 con 0x7f92cc0c8940 2023-07-21T22:38:28.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92d1ed8640 1 -- 172.21.15.6:0/1070277208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92cc0b1dd0 con 0x7f92cc0c8940 2023-07-21T22:38:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.784+0000 7f92b3fff640 1 -- 172.21.15.6:0/1070277208 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f92c00135d0 con 0x7f92cc0c8940 2023-07-21T22:38:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.788+0000 7f92b3fff640 1 --2- 172.21.15.6:0/1070277208 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f92b80663a0 0x7f92b8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.788+0000 7f92b3fff640 1 -- 172.21.15.6:0/1070277208 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f92c00841d0 con 0x7f92cc0c8940 2023-07-21T22:38:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.788+0000 7f92cb7fe640 1 --2- 172.21.15.6:0/1070277208 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f92b80663a0 0x7f92b8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:28.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.788+0000 7f92cb7fe640 1 --2- 172.21.15.6:0/1070277208 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f92b80663a0 0x7f92b8068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0ad000 tx=0x7f92bc0a4f90 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:28.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.792+0000 7f92b3fff640 1 -- 172.21.15.6:0/1070277208 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f92cc0b1dd0 con 0x7f92cc0c8940 2023-07-21T22:38:28.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.940+0000 7f92d1ed8640 1 -- 172.21.15.6:0/1070277208 --> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f92cc160700 con 0x7f92b80663a0 2023-07-21T22:38:28.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.948+0000 7f92b3fff640 1 -- 172.21.15.6:0/1070277208 <== mgr.7307 v2:172.21.15.161:6832/3436422767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306205 (secure 0 0 0) 0x7f92bc0bb090 con 0x7f92b80663a0 2023-07-21T22:38:28.998 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:28.999 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:38:29.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.952+0000 7f92d1ed8640 1 -- 172.21.15.6:0/1070277208 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f92b80663a0 msgr2=0x7f92b8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:29.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.952+0000 7f92d1ed8640 1 --2- 172.21.15.6:0/1070277208 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f92b80663a0 0x7f92b8068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0ad000 tx=0x7f92bc0a4f90 comp rx=0 tx=0).stop 2023-07-21T22:38:29.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.952+0000 7f92d1ed8640 1 -- 172.21.15.6:0/1070277208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92cc0c8940 msgr2=0x7f92cc161bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:29.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.952+0000 7f92d1ed8640 1 --2- 172.21.15.6:0/1070277208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92cc0c8940 0x7f92cc161bc0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f92c000ebe0 tx=0x7f92c000c520 comp rx=0 tx=0).stop 2023-07-21T22:38:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.952+0000 7f92d1ed8640 1 -- 172.21.15.6:0/1070277208 shutdown_connections 2023-07-21T22:38:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.952+0000 7f92d1ed8640 1 --2- 172.21.15.6:0/1070277208 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f92b80663a0 0x7f92b8068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.952+0000 7f92d1ed8640 1 --2- 172.21.15.6:0/1070277208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92cc160330 0x7f92cc0c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.952+0000 7f92d1ed8640 1 --2- 172.21.15.6:0/1070277208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92cc0c8940 0x7f92cc161bc0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.952+0000 7f92d1ed8640 1 --2- 172.21.15.6:0/1070277208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92cc0c0f80 0x7f92cc1526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.952+0000 7f92d1ed8640 1 -- 172.21.15.6:0/1070277208 >> 172.21.15.6:0/1070277208 conn(0x7f92cc0afcf0 msgr2=0x7f92cc0adc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.952+0000 7f92d1ed8640 1 -- 172.21.15.6:0/1070277208 shutdown_connections 2023-07-21T22:38:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:28.952+0000 7f92d1ed8640 1 -- 172.21.15.6:0/1070277208 wait complete. 2023-07-21T22:38:29.018 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-21T22:38:27.720112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":337732,"kb_used_data":14724,"kb_used_omap":0,"kb_used_meta":322944,"kb_avail":754636988,"statfs":{"total":773094113280,"available":772748275712,"internally_reserved":0,"allocated":15077376,"data_stored":8205548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":330694656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.669685"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058704+0000","last_change":"2023-07-21T22:38:23.058704+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058704+0000","last_undegraded":"2023-07-21T22:38:23.058704+0000","last_fullsized":"2023-07-21T22:38:23.058704+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.060174+0000","last_change":"2023-07-21T22:38:23.060174+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.060174+0000","last_undegraded":"2023-07-21T22:38:23.060174+0000","last_fullsized":"2023-07-21T22:38:23.060174+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.060115+0000","last_change":"2023-07-21T22:38:23.060115+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.060115+0000","last_undegraded":"2023-07-21T22:38:23.060115+0000","last_fullsized":"2023-07-21T22:38:23.060115+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.064006+0000","last_change":"2023-07-21T22:38:23.064006+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.064006+0000","last_undegraded":"2023-07-21T22:38:23.064006+0000","last_fullsized":"2023-07-21T22:38:23.064006+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058516+0000","last_change":"2023-07-21T22:38:23.058516+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058516+0000","last_undegraded":"2023-07-21T22:38:23.058516+0000","last_fullsized":"2023-07-21T22:38:23.058516+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058277+0000","last_change":"2023-07-21T22:38:23.058277+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058277+0000","last_undegraded":"2023-07-21T22:38:23.058277+0000","last_fullsized":"2023-07-21T22:38:23.058277+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058518+0000","last_change":"2023-07-21T22:38:23.058518+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058518+0000","last_undegraded":"2023-07-21T22:38:23.058518+0000","last_fullsized":"2023-07-21T22:38:23.058518+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.059899+0000","last_change":"2023-07-21T22:38:23.059899+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.059899+0000","last_undegraded":"2023-07-21T22:38:23.059899+0000","last_fullsized":"2023-07-21T22:38:23.059899+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.064880+0000","last_change":"2023-07-21T22:38:23.064880+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.064880+0000","last_undegraded":"2023-07-21T22:38:23.064880+0000","last_fullsized":"2023-07-21T22:38:23.064880+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054804+0000","last_change":"2023-07-21T22:38:23.054804+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054804+0000","last_undegraded":"2023-07-21T22:38:23.054804+0000","last_fullsized":"2023-07-21T22:38:23.054804+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056794+0000","last_change":"2023-07-21T22:38:23.056794+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056794+0000","last_undegraded":"2023-07-21T22:38:23.056794+0000","last_fullsized":"2023-07-21T22:38:23.056794+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.059734+0000","last_change":"2023-07-21T22:38:23.059734+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.059734+0000","last_undegraded":"2023-07-21T22:38:23.059734+0000","last_fullsized":"2023-07-21T22:38:23.059734+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.055336+0000","last_change":"2023-07-21T22:38:23.055336+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.055336+0000","last_undegraded":"2023-07-21T22:38:23.055336+0000","last_fullsized":"2023-07-21T22:38:23.055336+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.059023+0000","last_change":"2023-07-21T22:38:23.059023+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.059023+0000","last_undegraded":"2023-07-21T22:38:23.059023+0000","last_fullsized":"2023-07-21T22:38:23.059023+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.057190+0000","last_change":"2023-07-21T22:38:23.057190+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.057190+0000","last_undegraded":"2023-07-21T22:38:23.057190+0000","last_fullsized":"2023-07-21T22:38:23.057190+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.060985+0000","last_change":"2023-07-21T22:38:23.060985+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.060985+0000","last_undegraded":"2023-07-21T22:38:23.060985+0000","last_fullsized":"2023-07-21T22:38:23.060985+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054305+0000","last_change":"2023-07-21T22:38:23.054305+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054305+0000","last_undegraded":"2023-07-21T22:38:23.054305+0000","last_fullsized":"2023-07-21T22:38:23.054305+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056444+0000","last_change":"2023-07-21T22:38:23.056444+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056444+0000","last_undegraded":"2023-07-21T22:38:23.056444+0000","last_fullsized":"2023-07-21T22:38:23.056444+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.065397+0000","last_change":"2023-07-21T22:38:23.065397+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.065397+0000","last_undegraded":"2023-07-21T22:38:23.065397+0000","last_fullsized":"2023-07-21T22:38:23.065397+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054217+0000","last_change":"2023-07-21T22:38:23.054217+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054217+0000","last_undegraded":"2023-07-21T22:38:23.054217+0000","last_fullsized":"2023-07-21T22:38:23.054217+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.064516+0000","last_change":"2023-07-21T22:38:23.064516+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.064516+0000","last_undegraded":"2023-07-21T22:38:23.064516+0000","last_fullsized":"2023-07-21T22:38:23.064516+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058638+0000","last_change":"2023-07-21T22:38:23.058638+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058638+0000","last_undegraded":"2023-07-21T22:38:23.058638+0000","last_fullsized":"2023-07-21T22:38:23.058638+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.065753+0000","last_change":"2023-07-21T22:38:23.065753+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.065753+0000","last_undegraded":"2023-07-21T22:38:23.065753+0000","last_fullsized":"2023-07-21T22:38:23.065753+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056721+0000","last_change":"2023-07-21T22:38:23.056721+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056721+0000","last_undegraded":"2023-07-21T22:38:23.056721+0000","last_fullsized":"2023-07-21T22:38:23.056721+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.059483+0000","last_change":"2023-07-21T22:38:23.059483+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.059483+0000","last_undegraded":"2023-07-21T22:38:23.059483+0000","last_fullsized":"2023-07-21T22:38:23.059483+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054539+0000","last_change":"2023-07-21T22:38:23.054539+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054539+0000","last_undegraded":"2023-07-21T22:38:23.054539+0000","last_fullsized":"2023-07-21T22:38:23.054539+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.063166+0000","last_change":"2023-07-21T22:38:23.063166+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.063166+0000","last_undegraded":"2023-07-21T22:38:23.063166+0000","last_fullsized":"2023-07-21T22:38:23.063166+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.059287+0000","last_change":"2023-07-21T22:38:23.059287+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.059287+0000","last_undegraded":"2023-07-21T22:38:23.059287+0000","last_fullsized":"2023-07-21T22:38:23.059287+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054429+0000","last_change":"2023-07-21T22:38:23.054429+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054429+0000","last_undegraded":"2023-07-21T22:38:23.054429+0000","last_fullsized":"2023-07-21T22:38:23.054429+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.057369+0000","last_change":"2023-07-21T22:38:23.057369+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.057369+0000","last_undegraded":"2023-07-21T22:38:23.057369+0000","last_fullsized":"2023-07-21T22:38:23.057369+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056551+0000","last_change":"2023-07-21T22:38:23.056551+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056551+0000","last_undegraded":"2023-07-21T22:38:23.056551+0000","last_fullsized":"2023-07-21T22:38:23.056551+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056100+0000","last_change":"2023-07-21T22:38:23.056100+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056100+0000","last_undegraded":"2023-07-21T22:38:23.056100+0000","last_fullsized":"2023-07-21T22:38:23.056100+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054362+0000","last_change":"2023-07-21T22:38:23.054362+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054362+0000","last_undegraded":"2023-07-21T22:38:23.054362+0000","last_fullsized":"2023-07-21T22:38:23.054362+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.075979+0000","last_change":"2023-07-21T22:38:23.071766+0000","last_active":"2023-07-21T22:38:23.075979+0000","last_peered":"2023-07-21T22:38:23.075979+0000","last_clean":"2023-07-21T22:38:23.075979+0000","last_became_active":"2023-07-21T22:38:23.071479+0000","last_became_peered":"2023-07-21T22:38:23.071479+0000","last_unstale":"2023-07-21T22:38:23.075979+0000","last_undegraded":"2023-07-21T22:38:23.075979+0000","last_fullsized":"2023-07-21T22:38:23.075979+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:31:02.781796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058884+0000","last_change":"2023-07-21T22:38:23.058884+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058884+0000","last_undegraded":"2023-07-21T22:38:23.058884+0000","last_fullsized":"2023-07-21T22:38:23.058884+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.063953+0000","last_change":"2023-07-21T22:38:23.061581+0000","last_active":"2023-07-21T22:38:23.063953+0000","last_peered":"2023-07-21T22:38:23.063953+0000","last_clean":"2023-07-21T22:38:23.063953+0000","last_became_active":"2023-07-21T22:38:23.061317+0000","last_became_peered":"2023-07-21T22:38:23.061317+0000","last_unstale":"2023-07-21T22:38:23.063953+0000","last_undegraded":"2023-07-21T22:38:23.063953+0000","last_fullsized":"2023-07-21T22:38:23.063953+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:25:32.838226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.057681+0000","last_change":"2023-07-21T22:38:23.057681+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.057681+0000","last_undegraded":"2023-07-21T22:38:23.057681+0000","last_fullsized":"2023-07-21T22:38:23.057681+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.083881+0000","last_change":"2023-07-21T22:38:23.076553+0000","last_active":"2023-07-21T22:38:23.083881+0000","last_peered":"2023-07-21T22:38:23.083881+0000","last_clean":"2023-07-21T22:38:23.083881+0000","last_became_active":"2023-07-21T22:38:23.076250+0000","last_became_peered":"2023-07-21T22:38:23.076250+0000","last_unstale":"2023-07-21T22:38:23.083881+0000","last_undegraded":"2023-07-21T22:38:23.083881+0000","last_fullsized":"2023-07-21T22:38:23.083881+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:32:38.947160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.064400+0000","last_change":"2023-07-21T22:38:23.064400+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.064400+0000","last_undegraded":"2023-07-21T22:38:23.064400+0000","last_fullsized":"2023-07-21T22:38:23.064400+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.063335+0000","last_change":"2023-07-21T22:38:23.061237+0000","last_active":"2023-07-21T22:38:23.063335+0000","last_peered":"2023-07-21T22:38:23.063335+0000","last_clean":"2023-07-21T22:38:23.063335+0000","last_became_active":"2023-07-21T22:38:23.060950+0000","last_became_peered":"2023-07-21T22:38:23.060950+0000","last_unstale":"2023-07-21T22:38:23.063335+0000","last_undegraded":"2023-07-21T22:38:23.063335+0000","last_fullsized":"2023-07-21T22:38:23.063335+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:22:35.983664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.052966+0000","last_change":"2023-07-21T22:38:23.052966+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.052966+0000","last_undegraded":"2023-07-21T22:38:23.052966+0000","last_fullsized":"2023-07-21T22:38:23.052966+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.071069+0000","last_change":"2023-07-21T22:38:23.067155+0000","last_active":"2023-07-21T22:38:23.071069+0000","last_peered":"2023-07-21T22:38:23.071069+0000","last_clean":"2023-07-21T22:38:23.071069+0000","last_became_active":"2023-07-21T22:38:23.066836+0000","last_became_peered":"2023-07-21T22:38:23.066836+0000","last_unstale":"2023-07-21T22:38:23.071069+0000","last_undegraded":"2023-07-21T22:38:23.071069+0000","last_fullsized":"2023-07-21T22:38:23.071069+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:07:37.597596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056682+0000","last_change":"2023-07-21T22:38:23.056682+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056682+0000","last_undegraded":"2023-07-21T22:38:23.056682+0000","last_fullsized":"2023-07-21T22:38:23.056682+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.074401+0000","last_change":"2023-07-21T22:38:23.071033+0000","last_active":"2023-07-21T22:38:23.074401+0000","last_peered":"2023-07-21T22:38:23.074401+0000","last_clean":"2023-07-21T22:38:23.074401+0000","last_became_active":"2023-07-21T22:38:23.070744+0000","last_became_peered":"2023-07-21T22:38:23.070744+0000","last_unstale":"2023-07-21T22:38:23.074401+0000","last_undegraded":"2023-07-21T22:38:23.074401+0000","last_fullsized":"2023-07-21T22:38:23.074401+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:26:48.570149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056861+0000","last_change":"2023-07-21T22:38:23.056861+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056861+0000","last_undegraded":"2023-07-21T22:38:23.056861+0000","last_fullsized":"2023-07-21T22:38:23.056861+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.072250+0000","last_change":"2023-07-21T22:38:23.069579+0000","last_active":"2023-07-21T22:38:23.072250+0000","last_peered":"2023-07-21T22:38:23.072250+0000","last_clean":"2023-07-21T22:38:23.072250+0000","last_became_active":"2023-07-21T22:38:23.069255+0000","last_became_peered":"2023-07-21T22:38:23.069255+0000","last_unstale":"2023-07-21T22:38:23.072250+0000","last_undegraded":"2023-07-21T22:38:23.072250+0000","last_fullsized":"2023-07-21T22:38:23.072250+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:34:06.885474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054770+0000","last_change":"2023-07-21T22:38:23.054770+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054770+0000","last_undegraded":"2023-07-21T22:38:23.054770+0000","last_fullsized":"2023-07-21T22:38:23.054770+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.075743+0000","last_change":"2023-07-21T22:38:23.072024+0000","last_active":"2023-07-21T22:38:23.075743+0000","last_peered":"2023-07-21T22:38:23.075743+0000","last_clean":"2023-07-21T22:38:23.075743+0000","last_became_active":"2023-07-21T22:38:23.071738+0000","last_became_peered":"2023-07-21T22:38:23.071738+0000","last_unstale":"2023-07-21T22:38:23.075743+0000","last_undegraded":"2023-07-21T22:38:23.075743+0000","last_fullsized":"2023-07-21T22:38:23.075743+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:26:55.203317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.057169+0000","last_change":"2023-07-21T22:38:23.057169+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.057169+0000","last_undegraded":"2023-07-21T22:38:23.057169+0000","last_fullsized":"2023-07-21T22:38:23.057169+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.073719+0000","last_change":"2023-07-21T22:38:23.071033+0000","last_active":"2023-07-21T22:38:23.073719+0000","last_peered":"2023-07-21T22:38:23.073719+0000","last_clean":"2023-07-21T22:38:23.073719+0000","last_became_active":"2023-07-21T22:38:23.070685+0000","last_became_peered":"2023-07-21T22:38:23.070685+0000","last_unstale":"2023-07-21T22:38:23.073719+0000","last_undegraded":"2023-07-21T22:38:23.073719+0000","last_fullsized":"2023-07-21T22:38:23.073719+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:03.509609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056192+0000","last_change":"2023-07-21T22:38:23.056192+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056192+0000","last_undegraded":"2023-07-21T22:38:23.056192+0000","last_fullsized":"2023-07-21T22:38:23.056192+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.067689+0000","last_change":"2023-07-21T22:38:23.066606+0000","last_active":"2023-07-21T22:38:23.067689+0000","last_peered":"2023-07-21T22:38:23.067689+0000","last_clean":"2023-07-21T22:38:23.067689+0000","last_became_active":"2023-07-21T22:38:23.066288+0000","last_became_peered":"2023-07-21T22:38:23.066288+0000","last_unstale":"2023-07-21T22:38:23.067689+0000","last_undegraded":"2023-07-21T22:38:23.067689+0000","last_fullsized":"2023-07-21T22:38:23.067689+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:23:08.070998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.062315+0000","last_change":"2023-07-21T22:38:23.062315+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.062315+0000","last_undegraded":"2023-07-21T22:38:23.062315+0000","last_fullsized":"2023-07-21T22:38:23.062315+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.084392+0000","last_change":"2023-07-21T22:38:23.080670+0000","last_active":"2023-07-21T22:38:23.084392+0000","last_peered":"2023-07-21T22:38:23.084392+0000","last_clean":"2023-07-21T22:38:23.084392+0000","last_became_active":"2023-07-21T22:38:23.080326+0000","last_became_peered":"2023-07-21T22:38:23.080326+0000","last_unstale":"2023-07-21T22:38:23.084392+0000","last_undegraded":"2023-07-21T22:38:23.084392+0000","last_fullsized":"2023-07-21T22:38:23.084392+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:16:09.844811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056718+0000","last_change":"2023-07-21T22:38:23.056718+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056718+0000","last_undegraded":"2023-07-21T22:38:23.056718+0000","last_fullsized":"2023-07-21T22:38:23.056718+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.083942+0000","last_change":"2023-07-21T22:38:23.078636+0000","last_active":"2023-07-21T22:38:23.083942+0000","last_peered":"2023-07-21T22:38:23.083942+0000","last_clean":"2023-07-21T22:38:23.083942+0000","last_became_active":"2023-07-21T22:38:23.078443+0000","last_became_peered":"2023-07-21T22:38:23.078443+0000","last_unstale":"2023-07-21T22:38:23.083942+0000","last_undegraded":"2023-07-21T22:38:23.083942+0000","last_fullsized":"2023-07-21T22:38:23.083942+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:51:49.106671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.060531+0000","last_change":"2023-07-21T22:38:23.060531+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.060531+0000","last_undegraded":"2023-07-21T22:38:23.060531+0000","last_fullsized":"2023-07-21T22:38:23.060531+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.074292+0000","last_change":"2023-07-21T22:38:23.069898+0000","last_active":"2023-07-21T22:38:23.074292+0000","last_peered":"2023-07-21T22:38:23.074292+0000","last_clean":"2023-07-21T22:38:23.074292+0000","last_became_active":"2023-07-21T22:38:23.069638+0000","last_became_peered":"2023-07-21T22:38:23.069638+0000","last_unstale":"2023-07-21T22:38:23.074292+0000","last_undegraded":"2023-07-21T22:38:23.074292+0000","last_fullsized":"2023-07-21T22:38:23.074292+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:25:57.031023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.055886+0000","last_change":"2023-07-21T22:38:23.055886+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.055886+0000","last_undegraded":"2023-07-21T22:38:23.055886+0000","last_fullsized":"2023-07-21T22:38:23.055886+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.083856+0000","last_change":"2023-07-21T22:38:23.076677+0000","last_active":"2023-07-21T22:38:23.083856+0000","last_peered":"2023-07-21T22:38:23.083856+0000","last_clean":"2023-07-21T22:38:23.083856+0000","last_became_active":"2023-07-21T22:38:23.076377+0000","last_became_peered":"2023-07-21T22:38:23.076377+0000","last_unstale":"2023-07-21T22:38:23.083856+0000","last_undegraded":"2023-07-21T22:38:23.083856+0000","last_fullsized":"2023-07-21T22:38:23.083856+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:00:08.144958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056425+0000","last_change":"2023-07-21T22:38:23.056425+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056425+0000","last_undegraded":"2023-07-21T22:38:23.056425+0000","last_fullsized":"2023-07-21T22:38:23.056425+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.069157+0000","last_change":"2023-07-21T22:38:23.066154+0000","last_active":"2023-07-21T22:38:23.069157+0000","last_peered":"2023-07-21T22:38:23.069157+0000","last_clean":"2023-07-21T22:38:23.069157+0000","last_became_active":"2023-07-21T22:38:23.065865+0000","last_became_peered":"2023-07-21T22:38:23.065865+0000","last_unstale":"2023-07-21T22:38:23.069157+0000","last_undegraded":"2023-07-21T22:38:23.069157+0000","last_fullsized":"2023-07-21T22:38:23.069157+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:24:53.841626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.056203+0000","last_change":"2023-07-21T22:38:23.056203+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.056203+0000","last_undegraded":"2023-07-21T22:38:23.056203+0000","last_fullsized":"2023-07-21T22:38:23.056203+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.080104+0000","last_change":"2023-07-21T22:38:23.074540+0000","last_active":"2023-07-21T22:38:23.080104+0000","last_peered":"2023-07-21T22:38:23.080104+0000","last_clean":"2023-07-21T22:38:23.080104+0000","last_became_active":"2023-07-21T22:38:23.074297+0000","last_became_peered":"2023-07-21T22:38:23.074297+0000","last_unstale":"2023-07-21T22:38:23.080104+0000","last_undegraded":"2023-07-21T22:38:23.080104+0000","last_fullsized":"2023-07-21T22:38:23.080104+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:28:11.072255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058870+0000","last_change":"2023-07-21T22:38:23.058870+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058870+0000","last_undegraded":"2023-07-21T22:38:23.058870+0000","last_fullsized":"2023-07-21T22:38:23.058870+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.072289+0000","last_change":"2023-07-21T22:38:23.067648+0000","last_active":"2023-07-21T22:38:23.072289+0000","last_peered":"2023-07-21T22:38:23.072289+0000","last_clean":"2023-07-21T22:38:23.072289+0000","last_became_active":"2023-07-21T22:38:23.067340+0000","last_became_peered":"2023-07-21T22:38:23.067340+0000","last_unstale":"2023-07-21T22:38:23.072289+0000","last_undegraded":"2023-07-21T22:38:23.072289+0000","last_fullsized":"2023-07-21T22:38:23.072289+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:23:58.668883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.052301+0000","last_change":"2023-07-21T22:38:23.052301+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.052301+0000","last_undegraded":"2023-07-21T22:38:23.052301+0000","last_fullsized":"2023-07-21T22:38:23.052301+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.083742+0000","last_change":"2023-07-21T22:38:23.076843+0000","last_active":"2023-07-21T22:38:23.083742+0000","last_peered":"2023-07-21T22:38:23.083742+0000","last_clean":"2023-07-21T22:38:23.083742+0000","last_became_active":"2023-07-21T22:38:23.076531+0000","last_became_peered":"2023-07-21T22:38:23.076531+0000","last_unstale":"2023-07-21T22:38:23.083742+0000","last_undegraded":"2023-07-21T22:38:23.083742+0000","last_fullsized":"2023-07-21T22:38:23.083742+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:46:36.793506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.062536+0000","last_change":"2023-07-21T22:38:23.062536+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.062536+0000","last_undegraded":"2023-07-21T22:38:23.062536+0000","last_fullsized":"2023-07-21T22:38:23.062536+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.083832+0000","last_change":"2023-07-21T22:38:23.077345+0000","last_active":"2023-07-21T22:38:23.083832+0000","last_peered":"2023-07-21T22:38:23.083832+0000","last_clean":"2023-07-21T22:38:23.083832+0000","last_became_active":"2023-07-21T22:38:23.076977+0000","last_became_peered":"2023-07-21T22:38:23.076977+0000","last_unstale":"2023-07-21T22:38:23.083832+0000","last_undegraded":"2023-07-21T22:38:23.083832+0000","last_fullsized":"2023-07-21T22:38:23.083832+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:18:48.303353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.053644+0000","last_change":"2023-07-21T22:38:23.053644+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.053644+0000","last_undegraded":"2023-07-21T22:38:23.053644+0000","last_fullsized":"2023-07-21T22:38:23.053644+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.075732+0000","last_change":"2023-07-21T22:38:23.072030+0000","last_active":"2023-07-21T22:38:23.075732+0000","last_peered":"2023-07-21T22:38:23.075732+0000","last_clean":"2023-07-21T22:38:23.075732+0000","last_became_active":"2023-07-21T22:38:23.071779+0000","last_became_peered":"2023-07-21T22:38:23.071779+0000","last_unstale":"2023-07-21T22:38:23.075732+0000","last_undegraded":"2023-07-21T22:38:23.075732+0000","last_fullsized":"2023-07-21T22:38:23.075732+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:53:20.230381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.058197+0000","last_change":"2023-07-21T22:38:23.058197+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.058197+0000","last_undegraded":"2023-07-21T22:38:23.058197+0000","last_fullsized":"2023-07-21T22:38:23.058197+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.066553+0000","last_change":"2023-07-21T22:38:23.064167+0000","last_active":"2023-07-21T22:38:23.066553+0000","last_peered":"2023-07-21T22:38:23.066553+0000","last_clean":"2023-07-21T22:38:23.066553+0000","last_became_active":"2023-07-21T22:38:23.063832+0000","last_became_peered":"2023-07-21T22:38:23.063832+0000","last_unstale":"2023-07-21T22:38:23.066553+0000","last_undegraded":"2023-07-21T22:38:23.066553+0000","last_fullsized":"2023-07-21T22:38:23.066553+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:22:01.415836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.053443+0000","last_change":"2023-07-21T22:38:23.053443+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.053443+0000","last_undegraded":"2023-07-21T22:38:23.053443+0000","last_fullsized":"2023-07-21T22:38:23.053443+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.070149+0000","last_change":"2023-07-21T22:38:23.069081+0000","last_active":"2023-07-21T22:38:23.070149+0000","last_peered":"2023-07-21T22:38:23.070149+0000","last_clean":"2023-07-21T22:38:23.070149+0000","last_became_active":"2023-07-21T22:38:23.068690+0000","last_became_peered":"2023-07-21T22:38:23.068690+0000","last_unstale":"2023-07-21T22:38:23.070149+0000","last_undegraded":"2023-07-21T22:38:23.070149+0000","last_fullsized":"2023-07-21T22:38:23.070149+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:33:23.832514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.065544+0000","last_change":"2023-07-21T22:38:23.065544+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.065544+0000","last_undegraded":"2023-07-21T22:38:23.065544+0000","last_fullsized":"2023-07-21T22:38:23.065544+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.075782+0000","last_change":"2023-07-21T22:38:23.072049+0000","last_active":"2023-07-21T22:38:23.075782+0000","last_peered":"2023-07-21T22:38:23.075782+0000","last_clean":"2023-07-21T22:38:23.075782+0000","last_became_active":"2023-07-21T22:38:23.071697+0000","last_became_peered":"2023-07-21T22:38:23.071697+0000","last_unstale":"2023-07-21T22:38:23.075782+0000","last_undegraded":"2023-07-21T22:38:23.075782+0000","last_fullsized":"2023-07-21T22:38:23.075782+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:50:06.058541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.052292+0000","last_change":"2023-07-21T22:38:23.052292+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.052292+0000","last_undegraded":"2023-07-21T22:38:23.052292+0000","last_fullsized":"2023-07-21T22:38:23.052292+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.083930+0000","last_change":"2023-07-21T22:38:23.076939+0000","last_active":"2023-07-21T22:38:23.083930+0000","last_peered":"2023-07-21T22:38:23.083930+0000","last_clean":"2023-07-21T22:38:23.083930+0000","last_became_active":"2023-07-21T22:38:23.076616+0000","last_became_peered":"2023-07-21T22:38:23.076616+0000","last_unstale":"2023-07-21T22:38:23.083930+0000","last_undegraded":"2023-07-21T22:38:23.083930+0000","last_fullsized":"2023-07-21T22:38:23.083930+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:25.345042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.063974+0000","last_change":"2023-07-21T22:38:23.063974+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.063974+0000","last_undegraded":"2023-07-21T22:38:23.063974+0000","last_fullsized":"2023-07-21T22:38:23.063974+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.070815+0000","last_change":"2023-07-21T22:38:23.068532+0000","last_active":"2023-07-21T22:38:23.070815+0000","last_peered":"2023-07-21T22:38:23.070815+0000","last_clean":"2023-07-21T22:38:23.070815+0000","last_became_active":"2023-07-21T22:38:23.068250+0000","last_became_peered":"2023-07-21T22:38:23.068250+0000","last_unstale":"2023-07-21T22:38:23.070815+0000","last_undegraded":"2023-07-21T22:38:23.070815+0000","last_fullsized":"2023-07-21T22:38:23.070815+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:20:08.667299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"130'249","reported_seq":850,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.069273+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:38:23.069273+0000","last_peered":"2023-07-21T22:38:23.069273+0000","last_clean":"2023-07-21T22:38:23.069273+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:38:23.069273+0000","last_undegraded":"2023-07-21T22:38:23.069273+0000","last_fullsized":"2023-07-21T22:38:23.069273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:30:42.824483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":248,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.061108+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:38:23.061108+0000","last_peered":"2023-07-21T22:38:23.061108+0000","last_clean":"2023-07-21T22:38:23.061108+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:38:23.061108+0000","last_undegraded":"2023-07-21T22:38:23.061108+0000","last_fullsized":"2023-07-21T22:38:23.061108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:06:29.154549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.062847+0000","last_change":"2023-07-21T22:38:23.062847+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.062847+0000","last_undegraded":"2023-07-21T22:38:23.062847+0000","last_fullsized":"2023-07-21T22:38:23.062847+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.066848+0000","last_change":"2023-07-21T22:38:23.063181+0000","last_active":"2023-07-21T22:38:23.066848+0000","last_peered":"2023-07-21T22:38:23.066848+0000","last_clean":"2023-07-21T22:38:23.066848+0000","last_became_active":"2023-07-21T22:38:23.062917+0000","last_became_peered":"2023-07-21T22:38:23.062917+0000","last_unstale":"2023-07-21T22:38:23.066848+0000","last_undegraded":"2023-07-21T22:38:23.066848+0000","last_fullsized":"2023-07-21T22:38:23.066848+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:36:46.103640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":226,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.069151+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:38:23.069151+0000","last_peered":"2023-07-21T22:38:23.069151+0000","last_clean":"2023-07-21T22:38:23.069151+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:38:23.069151+0000","last_undegraded":"2023-07-21T22:38:23.069151+0000","last_fullsized":"2023-07-21T22:38:23.069151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:28.789417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.052705+0000","last_change":"2023-07-21T22:38:23.052705+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.052705+0000","last_undegraded":"2023-07-21T22:38:23.052705+0000","last_fullsized":"2023-07-21T22:38:23.052705+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.070821+0000","last_change":"2023-07-21T22:38:23.069398+0000","last_active":"2023-07-21T22:38:23.070821+0000","last_peered":"2023-07-21T22:38:23.070821+0000","last_clean":"2023-07-21T22:38:23.070821+0000","last_became_active":"2023-07-21T22:38:23.069091+0000","last_became_peered":"2023-07-21T22:38:23.069091+0000","last_unstale":"2023-07-21T22:38:23.070821+0000","last_undegraded":"2023-07-21T22:38:23.070821+0000","last_fullsized":"2023-07-21T22:38:23.070821+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:38:33.051764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":224,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.051927+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:38:23.051927+0000","last_peered":"2023-07-21T22:38:23.051927+0000","last_clean":"2023-07-21T22:38:23.051927+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:38:23.051927+0000","last_undegraded":"2023-07-21T22:38:23.051927+0000","last_fullsized":"2023-07-21T22:38:23.051927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:19.912597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.054021+0000","last_change":"2023-07-21T22:38:23.054021+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.054021+0000","last_undegraded":"2023-07-21T22:38:23.054021+0000","last_fullsized":"2023-07-21T22:38:23.054021+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.066791+0000","last_change":"2023-07-21T22:38:23.062898+0000","last_active":"2023-07-21T22:38:23.066791+0000","last_peered":"2023-07-21T22:38:23.066791+0000","last_clean":"2023-07-21T22:38:23.066791+0000","last_became_active":"2023-07-21T22:38:23.062603+0000","last_became_peered":"2023-07-21T22:38:23.062603+0000","last_unstale":"2023-07-21T22:38:23.066791+0000","last_undegraded":"2023-07-21T22:38:23.066791+0000","last_fullsized":"2023-07-21T22:38:23.066791+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:31:59.541471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":248,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.059920+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:38:23.059920+0000","last_peered":"2023-07-21T22:38:23.059920+0000","last_clean":"2023-07-21T22:38:23.059920+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:38:23.059920+0000","last_undegraded":"2023-07-21T22:38:23.059920+0000","last_fullsized":"2023-07-21T22:38:23.059920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:07:21.311463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.062904+0000","last_change":"2023-07-21T22:38:23.062904+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.062904+0000","last_undegraded":"2023-07-21T22:38:23.062904+0000","last_fullsized":"2023-07-21T22:38:23.062904+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.079842+0000","last_change":"2023-07-21T22:38:23.073676+0000","last_active":"2023-07-21T22:38:23.079842+0000","last_peered":"2023-07-21T22:38:23.079842+0000","last_clean":"2023-07-21T22:38:23.079842+0000","last_became_active":"2023-07-21T22:38:23.073401+0000","last_became_peered":"2023-07-21T22:38:23.073401+0000","last_unstale":"2023-07-21T22:38:23.079842+0000","last_undegraded":"2023-07-21T22:38:23.079842+0000","last_fullsized":"2023-07-21T22:38:23.079842+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:38:39.057650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":240,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.049280+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:38:23.049280+0000","last_peered":"2023-07-21T22:38:23.049280+0000","last_clean":"2023-07-21T22:38:23.049280+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:38:23.049280+0000","last_undegraded":"2023-07-21T22:38:23.049280+0000","last_fullsized":"2023-07-21T22:38:23.049280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:47:57.599145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.057612+0000","last_change":"2023-07-21T22:38:23.057612+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.057612+0000","last_undegraded":"2023-07-21T22:38:23.057612+0000","last_fullsized":"2023-07-21T22:38:23.057612+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.070595+0000","last_change":"2023-07-21T22:38:23.064930+0000","last_active":"2023-07-21T22:38:23.070595+0000","last_peered":"2023-07-21T22:38:23.070595+0000","last_clean":"2023-07-21T22:38:23.070595+0000","last_became_active":"2023-07-21T22:38:23.064654+0000","last_became_peered":"2023-07-21T22:38:23.064654+0000","last_unstale":"2023-07-21T22:38:23.070595+0000","last_undegraded":"2023-07-21T22:38:23.070595+0000","last_fullsized":"2023-07-21T22:38:23.070595+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:31.160555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":226,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.071595+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:38:23.071595+0000","last_peered":"2023-07-21T22:38:23.071595+0000","last_clean":"2023-07-21T22:38:23.071595+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:38:23.071595+0000","last_undegraded":"2023-07-21T22:38:23.071595+0000","last_fullsized":"2023-07-21T22:38:23.071595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:42:04.153664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.055927+0000","last_change":"2023-07-21T22:38:23.055927+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.055927+0000","last_undegraded":"2023-07-21T22:38:23.055927+0000","last_fullsized":"2023-07-21T22:38:23.055927+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.079939+0000","last_change":"2023-07-21T22:38:23.073379+0000","last_active":"2023-07-21T22:38:23.079939+0000","last_peered":"2023-07-21T22:38:23.079939+0000","last_clean":"2023-07-21T22:38:23.079939+0000","last_became_active":"2023-07-21T22:38:23.073091+0000","last_became_peered":"2023-07-21T22:38:23.073091+0000","last_unstale":"2023-07-21T22:38:23.079939+0000","last_undegraded":"2023-07-21T22:38:23.079939+0000","last_fullsized":"2023-07-21T22:38:23.079939+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:57:18.041817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":240,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.049276+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:38:23.049276+0000","last_peered":"2023-07-21T22:38:23.049276+0000","last_clean":"2023-07-21T22:38:23.049276+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:38:23.049276+0000","last_undegraded":"2023-07-21T22:38:23.049276+0000","last_fullsized":"2023-07-21T22:38:23.049276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:14:30.325976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":141,"state":"creating+peering","last_fresh":"2023-07-21T22:38:23.057255+0000","last_change":"2023-07-21T22:38:23.057255+0000","last_active":"2023-07-21T22:38:23.043425+0000","last_peered":"2023-07-21T22:38:23.043425+0000","last_clean":"2023-07-21T22:38:23.043425+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:38:23.057255+0000","last_undegraded":"2023-07-21T22:38:23.057255+0000","last_fullsized":"2023-07-21T22:38:23.057255+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.066909+0000","last_change":"2023-07-21T22:38:23.061980+0000","last_active":"2023-07-21T22:38:23.066909+0000","last_peered":"2023-07-21T22:38:23.066909+0000","last_clean":"2023-07-21T22:38:23.066909+0000","last_became_active":"2023-07-21T22:38:23.061558+0000","last_became_peered":"2023-07-21T22:38:23.061558+0000","last_unstale":"2023-07-21T22:38:23.066909+0000","last_undegraded":"2023-07-21T22:38:23.066909+0000","last_fullsized":"2023-07-21T22:38:23.066909+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:51:44.530129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":222,"reported_epoch":141,"state":"active+clean","last_fresh":"2023-07-21T22:38:23.063664+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:38:23.063664+0000","last_peered":"2023-07-21T22:38:23.063664+0000","last_clean":"2023-07-21T22:38:23.063664+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:38:23.063664+0000","last_undegraded":"2023-07-21T22:38:23.063664+0000","last_fullsized":"2023-07-21T22:38:23.063664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:56:58.160508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509675,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59568,"kb_used_data":2280,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312272,"statfs":{"total":96636764160,"available":96575766528,"internally_reserved":0,"allocated":2334720,"data_stored":1470982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69099999999999995,"15min":0.73199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35299999999999998},"max":{"1min":0.876,"5min":1.1180000000000001,"15min":3.5059999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66400000000000003,"15min":0.69399999999999995},"min":{"1min":0.46200000000000002,"5min":0.40899999999999997,"15min":0.39500000000000002},"max":{"1min":0.94199999999999995,"5min":0.94399999999999995,"15min":3.2709999999999999},"last":0.628}]},{"osd":1,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.70599999999999996,"15min":0.72799999999999998},"min":{"1min":0.49199999999999999,"5min":0.44900000000000001,"15min":0.432},"max":{"1min":0.98599999999999999,"5min":1.0680000000000001,"15min":1.5429999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.71299999999999997},"min":{"1min":0.44800000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96499999999999997,"5min":1.093,"15min":1.093},"last":0.61599999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70899999999999996,"15min":0.73599999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":1.1399999999999999,"15min":1.405},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73199999999999998,"15min":0.746},"min":{"1min":0.55100000000000005,"5min":0.47999999999999998,"15min":0.45800000000000002},"max":{"1min":0.92800000000000005,"5min":1.083,"15min":1.409},"last":0.70199999999999996}]},{"osd":3,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75900000000000001,"15min":0.76500000000000001},"min":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0209999999999999,"5min":1.1539999999999999,"15min":1.46},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.48599999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94899999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.55900000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55700000000000005,"15min":0.56200000000000006},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.67500000000000004,"5min":0.90000000000000002,"15min":0.94999999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82299999999999995,"5min":0.97399999999999998,"15min":1.7949999999999999},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.89700000000000002,"5min":0.98799999999999999,"15min":2.2120000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70199999999999996,"15min":0.68100000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.38300000000000001},"max":{"1min":0.95199999999999996,"5min":1.052,"15min":1.506},"last":0.65000000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.68100000000000005},"min":{"1min":0.53700000000000003,"5min":0.44900000000000001,"15min":0.41999999999999998},"max":{"1min":0.93500000000000005,"5min":1.0329999999999999,"15min":1.048},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.42699999999999999},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.57399999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542381,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36844,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334996,"statfs":{"total":96636764160,"available":96599035904,"internally_reserved":0,"allocated":1740800,"data_stored":880614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.755},"min":{"1min":0.47099999999999997,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.94399999999999995,"5min":1.016,"15min":1.016},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.437},"max":{"1min":0.96799999999999997,"5min":1.0289999999999999,"15min":1.1180000000000001},"last":0.74099999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.70099999999999996,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.49099999999999999,"15min":0.45300000000000001},"max":{"1min":0.872,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.501},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.45800000000000002,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.93300000000000005,"5min":0.99199999999999999,"15min":1.117},"last":0.67900000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71099999999999997,"15min":0.74199999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.42799999999999999},"max":{"1min":0.89600000000000002,"5min":0.98099999999999998,"15min":0.997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.78700000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.45500000000000002},"max":{"1min":0.98199999999999998,"5min":1.0149999999999999,"15min":1.097},"last":0.59199999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71999999999999997,"15min":0.748},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":1.048,"15min":1.048},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70499999999999996,"15min":0.72899999999999998},"min":{"1min":0.52300000000000002,"5min":0.49399999999999999,"15min":0.46899999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0049999999999999},"last":0.56799999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.93400000000000005,"15min":1.0229999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.39700000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.879}]},{"osd":5,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.054},"last":0.45000000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70299999999999996,"15min":0.68100000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.443},"max":{"1min":1.024,"5min":1.024,"15min":1.079},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.621}]}]},{"osd":5,"up_from":15,"seq":64424509674,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50784,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321056,"statfs":{"total":96636764160,"available":96584761344,"internally_reserved":0,"allocated":1728512,"data_stored":873914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.70999999999999996},"min":{"1min":0.48099999999999998,"5min":0.38500000000000001,"15min":0.35699999999999998},"max":{"1min":0.96499999999999997,"5min":1,"15min":1.8779999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.97999999999999998,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.53700000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.68600000000000005,"15min":0.70299999999999996},"min":{"1min":0.505,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.95899999999999996,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69099999999999995,"15min":0.72099999999999997},"min":{"1min":0.42699999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.617},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71099999999999997,"15min":0.72699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.33600000000000002},"max":{"1min":1.008,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.42199999999999999,"15min":0.377},"max":{"1min":0.89300000000000002,"5min":1.073,"15min":1.512},"last":0.65700000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76900000000000002,"15min":0.77800000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":1.0009999999999999,"15min":1.472},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76000000000000001,"15min":0.78700000000000003},"min":{"1min":0.60099999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.997,"5min":1.022,"15min":1.556},"last":0.69299999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.372,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83699999999999997,"5min":0.88900000000000001,"15min":0.96999999999999997},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72399999999999998,"15min":0.69599999999999995},"min":{"1min":0.58899999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.92300000000000004,"5min":0.92400000000000004,"15min":1.038},"last":0.79100000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":0.95499999999999996,"15min":1.0049999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.40200000000000002,"15min":0.40000000000000002},"max":{"1min":0.76600000000000001,"5min":0.93799999999999994,"15min":1.02},"last":0.71099999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70099999999999996,"15min":0.65700000000000003},"min":{"1min":0.46200000000000002,"5min":0.40999999999999998,"15min":0.374},"max":{"1min":0.96699999999999997,"5min":1.042,"15min":1.042},"last":0.751},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":0.73099999999999998},"min":{"1min":0.59799999999999998,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.88300000000000001,"5min":0.999,"15min":1.7390000000000001},"last":0.73299999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509675,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1728512,"data_stored":873914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.70399999999999996,"15min":0.73599999999999999},"min":{"1min":0.46800000000000003,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.71399999999999997,"15min":0.73699999999999999},"min":{"1min":0.47999999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98499999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.52900000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.70199999999999996},"min":{"1min":0.46999999999999997,"5min":0.442,"15min":0.39400000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67600000000000005,"15min":0.69999999999999996},"min":{"1min":0.44400000000000001,"5min":0.43099999999999999,"15min":0.36899999999999999},"max":{"1min":0.90400000000000003,"5min":0.93000000000000005,"15min":1.016},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72799999999999998,"15min":0.755},"min":{"1min":0.55800000000000005,"5min":0.49099999999999999,"15min":0.371},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73799999999999999,"15min":0.76400000000000001},"min":{"1min":0.52400000000000002,"5min":0.47699999999999998,"15min":0.33000000000000002},"max":{"1min":1.018,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.40100000000000002},"max":{"1min":0.91000000000000003,"5min":0.97999999999999998,"15min":1.026},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75900000000000001,"15min":0.77900000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47999999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.66500000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60799999999999998,"15min":0.58499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34399999999999997},"max":{"1min":0.96199999999999997,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.60399999999999998,"15min":0.59499999999999997},"min":{"1min":0.44400000000000001,"5min":0.38800000000000001,"15min":0.32800000000000001},"max":{"1min":0.93600000000000005,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.70799999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.753},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.41599999999999998},"max":{"1min":1.0089999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.65200000000000002},"min":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.39200000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.0429999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.61699999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509674,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32748,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339092,"statfs":{"total":96636764160,"available":96603230208,"internally_reserved":0,"allocated":1740800,"data_stored":880614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46899999999999997,"15min":0.47499999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":0.77800000000000002,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.35899999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46200000000000002,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60299999999999998,"5min":0.754,"15min":0.83499999999999996},"last":0.316},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.41999999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71899999999999997,"5min":0.82599999999999996,"15min":0.90100000000000002},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67600000000000005,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.59599999999999997},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.99199999999999999},"last":0.48399999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.755,"15min":0.77000000000000002},"min":{"1min":0.57599999999999996,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91200000000000003,"5min":1.093,"15min":1.1279999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.81399999999999995},"min":{"1min":0.54500000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.93200000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.76900000000000002},"min":{"1min":0.54900000000000004,"5min":0.501,"15min":0.48999999999999999},"max":{"1min":0.97799999999999998,"5min":1.0669999999999999,"15min":1.137},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.51300000000000001,"15min":0.42899999999999999},"max":{"1min":0.86399999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76900000000000002,"15min":0.79000000000000004},"min":{"1min":0.51900000000000002,"5min":0.51700000000000002,"15min":0.47399999999999998},"max":{"1min":0.91700000000000004,"5min":1.0680000000000001,"15min":1.169},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91300000000000003,"5min":1.107,"15min":1.1120000000000001},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79200000000000004,"15min":0.81299999999999994},"min":{"1min":0.621,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94299999999999995,"5min":1.083,"15min":1.099},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80900000000000005,"15min":0.82799999999999996},"min":{"1min":0.61299999999999999,"5min":0.55200000000000005,"15min":0.48599999999999999},"max":{"1min":0.92200000000000004,"5min":1.623,"15min":1.623},"last":0.78100000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509676,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54892,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316948,"statfs":{"total":96636764160,"available":96580554752,"internally_reserved":0,"allocated":1740800,"data_stored":880614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.46400000000000002},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.23899999999999999},"max":{"1min":0.624,"5min":0.75,"15min":0.94199999999999995},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50600000000000001,"15min":0.54100000000000004},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.308},"max":{"1min":0.64200000000000002,"5min":0.88300000000000001,"15min":1.0409999999999999},"last":0.53600000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.40699999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72599999999999998,"5min":0.86699999999999999,"15min":0.93999999999999995},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.012,"15min":1.085},"last":0.45300000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46300000000000002,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.623,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.56399999999999995},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.85299999999999998,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.46600000000000003,"15min":0.376},"max":{"1min":1.016,"5min":1.1579999999999999,"15min":1.3420000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73599999999999999,"15min":0.78500000000000003},"min":{"1min":0.48899999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.996,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.64900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0780000000000001,"5min":1.214,"15min":1.214},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77700000000000002,"15min":0.80600000000000005},"min":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.46400000000000002},"max":{"1min":1.012,"5min":1.2689999999999999,"15min":1.3089999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.746,"15min":0.78300000000000003},"min":{"1min":0.52800000000000002,"5min":0.499,"15min":0.40300000000000002},"max":{"1min":0.94399999999999995,"5min":1.536,"15min":1.536},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.46200000000000002},"max":{"1min":1.0289999999999999,"5min":1.1339999999999999,"15min":1.2649999999999999},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77500000000000002,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.008,"5min":1.143,"15min":1.214},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.751,"15min":0.79700000000000004},"min":{"1min":0.58899999999999997,"5min":0.50900000000000001,"15min":0.44700000000000001},"max":{"1min":0.91200000000000003,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.73799999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509675,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32748,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339092,"statfs":{"total":96636764160,"available":96603230208,"internally_reserved":0,"allocated":1740800,"data_stored":880614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.47499999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.22900000000000001},"max":{"1min":0.60399999999999998,"5min":0.78700000000000003,"15min":0.84599999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54100000000000004,"15min":0.55900000000000005},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.35099999999999998},"max":{"1min":0.80900000000000005,"5min":0.82499999999999996,"15min":0.872},"last":0.441}]},{"osd":2,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48999999999999999,"15min":0.502},"min":{"1min":0.36199999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"max":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":0.81000000000000005},"last":0.317},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.29099999999999998},"max":{"1min":0.71899999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.42299999999999999,"5min":0.378,"15min":0.33400000000000002},"max":{"1min":0.76100000000000001,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":0.77600000000000002,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.34699999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.432},"max":{"1min":1.115,"5min":1.294,"15min":1.294},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77800000000000002,"15min":0.79000000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.498},"max":{"1min":1.1220000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.95399999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.753,"15min":0.77200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.41899999999999998},"max":{"1min":1.0980000000000001,"5min":1.242,"15min":1.242},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.55700000000000005,"5min":0.51500000000000001,"15min":0.376},"max":{"1min":1.1639999999999999,"5min":1.276,"15min":1.2849999999999999},"last":0.93700000000000006}]},{"osd":6,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77700000000000002,"15min":0.80000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.47899999999999998},"max":{"1min":1.0800000000000001,"5min":1.208,"15min":1.23},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.78100000000000003},"min":{"1min":0.56100000000000005,"5min":0.50900000000000001,"15min":0.46500000000000002},"max":{"1min":1.0109999999999999,"5min":1.244,"15min":1.3240000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78500000000000003,"15min":0.80400000000000005},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.49199999999999999},"max":{"1min":1.089,"5min":1.3120000000000001,"15min":1.3149999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.45700000000000002},"max":{"1min":1.0289999999999999,"5min":1.1819999999999999,"15min":1.3380000000000001},"last":0.79000000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509677,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37412,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334428,"statfs":{"total":96636764160,"available":96598454272,"internally_reserved":0,"allocated":2322432,"data_stored":1464282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46999999999999997,"15min":0.46899999999999997},"min":{"1min":0.29799999999999999,"5min":0.28399999999999997,"15min":0.26600000000000001},"max":{"1min":0.70399999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.499}]},{"osd":2,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53500000000000003,"15min":0.53400000000000003},"min":{"1min":0.42099999999999999,"5min":0.32400000000000001,"15min":0.29799999999999999},"max":{"1min":0.82599999999999996,"5min":0.871,"15min":1.3680000000000001},"last":0.442},{"interface":"front","average":{"1min":0.504,"5min":0.49299999999999999,"15min":0.51700000000000002},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.32600000000000001},"max":{"1min":0.68200000000000005,"5min":0.76700000000000002,"15min":0.871},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57299999999999995,"15min":0.58999999999999997},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81599999999999995,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.373,"5min":0.36599999999999999,"15min":0.33700000000000002},"max":{"1min":0.745,"5min":1.038,"15min":1.038},"last":0.46200000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.79900000000000004,"15min":0.78400000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.45200000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.3009999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.80500000000000005,"15min":0.80200000000000005},"min":{"1min":0.54500000000000004,"5min":0.505,"15min":0.44600000000000001},"max":{"1min":1.278,"5min":1.278,"15min":1.423},"last":0.627}]},{"osd":5,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.78200000000000003,"15min":0.77900000000000003},"min":{"1min":0.56799999999999995,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.0229999999999999,"5min":1.1020000000000001,"15min":1.2669999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.81000000000000005,"15min":0.80800000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.39600000000000002},"max":{"1min":1.1950000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.72799999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80200000000000005,"15min":0.81000000000000005},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.48899999999999999},"max":{"1min":1.054,"5min":1.27,"15min":1.27},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.81100000000000005,"15min":0.81799999999999995},"min":{"1min":0.64300000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.333},"last":0.75800000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.80400000000000005,"15min":0.79800000000000004},"min":{"1min":0.60099999999999998,"5min":0.54300000000000004,"15min":0.53100000000000003},"max":{"1min":1.121,"5min":1.159,"15min":1.2310000000000001},"last":0.746},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.80800000000000005,"15min":0.82799999999999996},"min":{"1min":0.55600000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.109,"5min":1.1930000000000001,"15min":1.369},"last":0.68600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:38:29.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3f is not active+clean 2023-07-21T22:38:29.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.058704+0000', 'last_change': '2023-07-21T22:38:23.058704+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.058704+0000', 'last_undegraded': '2023-07-21T22:38:23.058704+0000', 'last_fullsized': '2023-07-21T22:38:23.058704+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:38:29.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3e is not active+clean 2023-07-21T22:38:29.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.060174+0000', 'last_change': '2023-07-21T22:38:23.060174+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.060174+0000', 'last_undegraded': '2023-07-21T22:38:23.060174+0000', 'last_fullsized': '2023-07-21T22:38:23.060174+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:38:29.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3d is not active+clean 2023-07-21T22:38:29.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.060115+0000', 'last_change': '2023-07-21T22:38:23.060115+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.060115+0000', 'last_undegraded': '2023-07-21T22:38:23.060115+0000', 'last_fullsized': '2023-07-21T22:38:23.060115+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:38:29.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3c is not active+clean 2023-07-21T22:38:29.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.064006+0000', 'last_change': '2023-07-21T22:38:23.064006+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.064006+0000', 'last_undegraded': '2023-07-21T22:38:23.064006+0000', 'last_fullsized': '2023-07-21T22:38:23.064006+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:38:29.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3b is not active+clean 2023-07-21T22:38:29.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.058516+0000', 'last_change': '2023-07-21T22:38:23.058516+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.058516+0000', 'last_undegraded': '2023-07-21T22:38:23.058516+0000', 'last_fullsized': '2023-07-21T22:38:23.058516+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:38:29.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3a is not active+clean 2023-07-21T22:38:29.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.058277+0000', 'last_change': '2023-07-21T22:38:23.058277+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.058277+0000', 'last_undegraded': '2023-07-21T22:38:23.058277+0000', 'last_fullsized': '2023-07-21T22:38:23.058277+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:38:29.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.39 is not active+clean 2023-07-21T22:38:29.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.058518+0000', 'last_change': '2023-07-21T22:38:23.058518+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.058518+0000', 'last_undegraded': '2023-07-21T22:38:23.058518+0000', 'last_fullsized': '2023-07-21T22:38:23.058518+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:38:29.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.38 is not active+clean 2023-07-21T22:38:29.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.059899+0000', 'last_change': '2023-07-21T22:38:23.059899+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.059899+0000', 'last_undegraded': '2023-07-21T22:38:23.059899+0000', 'last_fullsized': '2023-07-21T22:38:23.059899+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:38:29.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.37 is not active+clean 2023-07-21T22:38:29.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.064880+0000', 'last_change': '2023-07-21T22:38:23.064880+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.064880+0000', 'last_undegraded': '2023-07-21T22:38:23.064880+0000', 'last_fullsized': '2023-07-21T22:38:23.064880+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:38:29.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.36 is not active+clean 2023-07-21T22:38:29.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.054804+0000', 'last_change': '2023-07-21T22:38:23.054804+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.054804+0000', 'last_undegraded': '2023-07-21T22:38:23.054804+0000', 'last_fullsized': '2023-07-21T22:38:23.054804+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:38:29.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.35 is not active+clean 2023-07-21T22:38:29.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.056794+0000', 'last_change': '2023-07-21T22:38:23.056794+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.056794+0000', 'last_undegraded': '2023-07-21T22:38:23.056794+0000', 'last_fullsized': '2023-07-21T22:38:23.056794+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:38:29.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.34 is not active+clean 2023-07-21T22:38:29.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.059734+0000', 'last_change': '2023-07-21T22:38:23.059734+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.059734+0000', 'last_undegraded': '2023-07-21T22:38:23.059734+0000', 'last_fullsized': '2023-07-21T22:38:23.059734+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:38:29.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.33 is not active+clean 2023-07-21T22:38:29.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.055336+0000', 'last_change': '2023-07-21T22:38:23.055336+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.055336+0000', 'last_undegraded': '2023-07-21T22:38:23.055336+0000', 'last_fullsized': '2023-07-21T22:38:23.055336+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:38:29.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.32 is not active+clean 2023-07-21T22:38:29.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.059023+0000', 'last_change': '2023-07-21T22:38:23.059023+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.059023+0000', 'last_undegraded': '2023-07-21T22:38:23.059023+0000', 'last_fullsized': '2023-07-21T22:38:23.059023+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:38:29.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.31 is not active+clean 2023-07-21T22:38:29.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.057190+0000', 'last_change': '2023-07-21T22:38:23.057190+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.057190+0000', 'last_undegraded': '2023-07-21T22:38:23.057190+0000', 'last_fullsized': '2023-07-21T22:38:23.057190+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:38:29.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.30 is not active+clean 2023-07-21T22:38:29.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.060985+0000', 'last_change': '2023-07-21T22:38:23.060985+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.060985+0000', 'last_undegraded': '2023-07-21T22:38:23.060985+0000', 'last_fullsized': '2023-07-21T22:38:23.060985+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:38:29.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2f is not active+clean 2023-07-21T22:38:29.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.054305+0000', 'last_change': '2023-07-21T22:38:23.054305+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.054305+0000', 'last_undegraded': '2023-07-21T22:38:23.054305+0000', 'last_fullsized': '2023-07-21T22:38:23.054305+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:38:29.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2e is not active+clean 2023-07-21T22:38:29.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.056444+0000', 'last_change': '2023-07-21T22:38:23.056444+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.056444+0000', 'last_undegraded': '2023-07-21T22:38:23.056444+0000', 'last_fullsized': '2023-07-21T22:38:23.056444+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:38:29.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2d is not active+clean 2023-07-21T22:38:29.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.065397+0000', 'last_change': '2023-07-21T22:38:23.065397+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.065397+0000', 'last_undegraded': '2023-07-21T22:38:23.065397+0000', 'last_fullsized': '2023-07-21T22:38:23.065397+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:38:29.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2c is not active+clean 2023-07-21T22:38:29.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.054217+0000', 'last_change': '2023-07-21T22:38:23.054217+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.054217+0000', 'last_undegraded': '2023-07-21T22:38:23.054217+0000', 'last_fullsized': '2023-07-21T22:38:23.054217+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:38:29.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2b is not active+clean 2023-07-21T22:38:29.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.064516+0000', 'last_change': '2023-07-21T22:38:23.064516+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.064516+0000', 'last_undegraded': '2023-07-21T22:38:23.064516+0000', 'last_fullsized': '2023-07-21T22:38:23.064516+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:38:29.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2a is not active+clean 2023-07-21T22:38:29.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.058638+0000', 'last_change': '2023-07-21T22:38:23.058638+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.058638+0000', 'last_undegraded': '2023-07-21T22:38:23.058638+0000', 'last_fullsized': '2023-07-21T22:38:23.058638+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:38:29.040 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.29 is not active+clean 2023-07-21T22:38:29.040 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.065753+0000', 'last_change': '2023-07-21T22:38:23.065753+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.065753+0000', 'last_undegraded': '2023-07-21T22:38:23.065753+0000', 'last_fullsized': '2023-07-21T22:38:23.065753+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:38:29.040 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.28 is not active+clean 2023-07-21T22:38:29.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.056721+0000', 'last_change': '2023-07-21T22:38:23.056721+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.056721+0000', 'last_undegraded': '2023-07-21T22:38:23.056721+0000', 'last_fullsized': '2023-07-21T22:38:23.056721+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:38:29.041 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.27 is not active+clean 2023-07-21T22:38:29.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.059483+0000', 'last_change': '2023-07-21T22:38:23.059483+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.059483+0000', 'last_undegraded': '2023-07-21T22:38:23.059483+0000', 'last_fullsized': '2023-07-21T22:38:23.059483+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:38:29.042 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.26 is not active+clean 2023-07-21T22:38:29.042 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.054539+0000', 'last_change': '2023-07-21T22:38:23.054539+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.054539+0000', 'last_undegraded': '2023-07-21T22:38:23.054539+0000', 'last_fullsized': '2023-07-21T22:38:23.054539+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:38:29.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.25 is not active+clean 2023-07-21T22:38:29.043 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.063166+0000', 'last_change': '2023-07-21T22:38:23.063166+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.063166+0000', 'last_undegraded': '2023-07-21T22:38:23.063166+0000', 'last_fullsized': '2023-07-21T22:38:23.063166+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:38:29.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.24 is not active+clean 2023-07-21T22:38:29.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.059287+0000', 'last_change': '2023-07-21T22:38:23.059287+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.059287+0000', 'last_undegraded': '2023-07-21T22:38:23.059287+0000', 'last_fullsized': '2023-07-21T22:38:23.059287+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:38:29.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.23 is not active+clean 2023-07-21T22:38:29.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.054429+0000', 'last_change': '2023-07-21T22:38:23.054429+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.054429+0000', 'last_undegraded': '2023-07-21T22:38:23.054429+0000', 'last_fullsized': '2023-07-21T22:38:23.054429+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:38:29.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.22 is not active+clean 2023-07-21T22:38:29.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.057369+0000', 'last_change': '2023-07-21T22:38:23.057369+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.057369+0000', 'last_undegraded': '2023-07-21T22:38:23.057369+0000', 'last_fullsized': '2023-07-21T22:38:23.057369+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:38:29.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.21 is not active+clean 2023-07-21T22:38:29.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.056551+0000', 'last_change': '2023-07-21T22:38:23.056551+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.056551+0000', 'last_undegraded': '2023-07-21T22:38:23.056551+0000', 'last_fullsized': '2023-07-21T22:38:23.056551+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:38:29.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.20 is not active+clean 2023-07-21T22:38:29.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.056100+0000', 'last_change': '2023-07-21T22:38:23.056100+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.056100+0000', 'last_undegraded': '2023-07-21T22:38:23.056100+0000', 'last_fullsized': '2023-07-21T22:38:23.056100+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:38:29.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1c is not active+clean 2023-07-21T22:38:29.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.054362+0000', 'last_change': '2023-07-21T22:38:23.054362+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.054362+0000', 'last_undegraded': '2023-07-21T22:38:23.054362+0000', 'last_fullsized': '2023-07-21T22:38:23.054362+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:38:29.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1d is not active+clean 2023-07-21T22:38:29.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.058884+0000', 'last_change': '2023-07-21T22:38:23.058884+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.058884+0000', 'last_undegraded': '2023-07-21T22:38:23.058884+0000', 'last_fullsized': '2023-07-21T22:38:23.058884+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:38:29.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1e is not active+clean 2023-07-21T22:38:29.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.057681+0000', 'last_change': '2023-07-21T22:38:23.057681+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.057681+0000', 'last_undegraded': '2023-07-21T22:38:23.057681+0000', 'last_fullsized': '2023-07-21T22:38:23.057681+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:38:29.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1f is not active+clean 2023-07-21T22:38:29.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.064400+0000', 'last_change': '2023-07-21T22:38:23.064400+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.064400+0000', 'last_undegraded': '2023-07-21T22:38:23.064400+0000', 'last_fullsized': '2023-07-21T22:38:23.064400+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:38:29.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.18 is not active+clean 2023-07-21T22:38:29.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.052966+0000', 'last_change': '2023-07-21T22:38:23.052966+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.052966+0000', 'last_undegraded': '2023-07-21T22:38:23.052966+0000', 'last_fullsized': '2023-07-21T22:38:23.052966+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:38:29.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.19 is not active+clean 2023-07-21T22:38:29.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.056682+0000', 'last_change': '2023-07-21T22:38:23.056682+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.056682+0000', 'last_undegraded': '2023-07-21T22:38:23.056682+0000', 'last_fullsized': '2023-07-21T22:38:23.056682+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:38:29.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1a is not active+clean 2023-07-21T22:38:29.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.056861+0000', 'last_change': '2023-07-21T22:38:23.056861+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.056861+0000', 'last_undegraded': '2023-07-21T22:38:23.056861+0000', 'last_fullsized': '2023-07-21T22:38:23.056861+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:38:29.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1b is not active+clean 2023-07-21T22:38:29.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.054770+0000', 'last_change': '2023-07-21T22:38:23.054770+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.054770+0000', 'last_undegraded': '2023-07-21T22:38:23.054770+0000', 'last_fullsized': '2023-07-21T22:38:23.054770+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:38:29.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.c is not active+clean 2023-07-21T22:38:29.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.057169+0000', 'last_change': '2023-07-21T22:38:23.057169+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.057169+0000', 'last_undegraded': '2023-07-21T22:38:23.057169+0000', 'last_fullsized': '2023-07-21T22:38:23.057169+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:38:29.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.d is not active+clean 2023-07-21T22:38:29.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.056192+0000', 'last_change': '2023-07-21T22:38:23.056192+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.056192+0000', 'last_undegraded': '2023-07-21T22:38:23.056192+0000', 'last_fullsized': '2023-07-21T22:38:23.056192+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:38:29.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.e is not active+clean 2023-07-21T22:38:29.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.062315+0000', 'last_change': '2023-07-21T22:38:23.062315+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.062315+0000', 'last_undegraded': '2023-07-21T22:38:23.062315+0000', 'last_fullsized': '2023-07-21T22:38:23.062315+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:38:29.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.f is not active+clean 2023-07-21T22:38:29.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.056718+0000', 'last_change': '2023-07-21T22:38:23.056718+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.056718+0000', 'last_undegraded': '2023-07-21T22:38:23.056718+0000', 'last_fullsized': '2023-07-21T22:38:23.056718+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:38:29.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.8 is not active+clean 2023-07-21T22:38:29.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.060531+0000', 'last_change': '2023-07-21T22:38:23.060531+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.060531+0000', 'last_undegraded': '2023-07-21T22:38:23.060531+0000', 'last_fullsized': '2023-07-21T22:38:23.060531+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:38:29.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.9 is not active+clean 2023-07-21T22:38:29.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.055886+0000', 'last_change': '2023-07-21T22:38:23.055886+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.055886+0000', 'last_undegraded': '2023-07-21T22:38:23.055886+0000', 'last_fullsized': '2023-07-21T22:38:23.055886+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:38:29.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.a is not active+clean 2023-07-21T22:38:29.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.056425+0000', 'last_change': '2023-07-21T22:38:23.056425+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.056425+0000', 'last_undegraded': '2023-07-21T22:38:23.056425+0000', 'last_fullsized': '2023-07-21T22:38:23.056425+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:38:29.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.b is not active+clean 2023-07-21T22:38:29.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.056203+0000', 'last_change': '2023-07-21T22:38:23.056203+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.056203+0000', 'last_undegraded': '2023-07-21T22:38:23.056203+0000', 'last_fullsized': '2023-07-21T22:38:23.056203+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:38:29.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.4 is not active+clean 2023-07-21T22:38:29.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.058870+0000', 'last_change': '2023-07-21T22:38:23.058870+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.058870+0000', 'last_undegraded': '2023-07-21T22:38:23.058870+0000', 'last_fullsized': '2023-07-21T22:38:23.058870+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:38:29.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.5 is not active+clean 2023-07-21T22:38:29.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.052301+0000', 'last_change': '2023-07-21T22:38:23.052301+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.052301+0000', 'last_undegraded': '2023-07-21T22:38:23.052301+0000', 'last_fullsized': '2023-07-21T22:38:23.052301+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:38:29.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.6 is not active+clean 2023-07-21T22:38:29.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.062536+0000', 'last_change': '2023-07-21T22:38:23.062536+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.062536+0000', 'last_undegraded': '2023-07-21T22:38:23.062536+0000', 'last_fullsized': '2023-07-21T22:38:23.062536+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:38:29.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.7 is not active+clean 2023-07-21T22:38:29.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.053644+0000', 'last_change': '2023-07-21T22:38:23.053644+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.053644+0000', 'last_undegraded': '2023-07-21T22:38:23.053644+0000', 'last_fullsized': '2023-07-21T22:38:23.053644+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:38:29.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.0 is not active+clean 2023-07-21T22:38:29.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.058197+0000', 'last_change': '2023-07-21T22:38:23.058197+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.058197+0000', 'last_undegraded': '2023-07-21T22:38:23.058197+0000', 'last_fullsized': '2023-07-21T22:38:23.058197+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:38:29.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1 is not active+clean 2023-07-21T22:38:29.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.053443+0000', 'last_change': '2023-07-21T22:38:23.053443+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.053443+0000', 'last_undegraded': '2023-07-21T22:38:23.053443+0000', 'last_fullsized': '2023-07-21T22:38:23.053443+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:38:29.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2 is not active+clean 2023-07-21T22:38:29.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.065544+0000', 'last_change': '2023-07-21T22:38:23.065544+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.065544+0000', 'last_undegraded': '2023-07-21T22:38:23.065544+0000', 'last_fullsized': '2023-07-21T22:38:23.065544+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:38:29.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3 is not active+clean 2023-07-21T22:38:29.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.052292+0000', 'last_change': '2023-07-21T22:38:23.052292+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.052292+0000', 'last_undegraded': '2023-07-21T22:38:23.052292+0000', 'last_fullsized': '2023-07-21T22:38:23.052292+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:38:29.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.13 is not active+clean 2023-07-21T22:38:29.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.063974+0000', 'last_change': '2023-07-21T22:38:23.063974+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.063974+0000', 'last_undegraded': '2023-07-21T22:38:23.063974+0000', 'last_fullsized': '2023-07-21T22:38:23.063974+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:38:29.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.10 is not active+clean 2023-07-21T22:38:29.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.062847+0000', 'last_change': '2023-07-21T22:38:23.062847+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.062847+0000', 'last_undegraded': '2023-07-21T22:38:23.062847+0000', 'last_fullsized': '2023-07-21T22:38:23.062847+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:38:29.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.11 is not active+clean 2023-07-21T22:38:29.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.052705+0000', 'last_change': '2023-07-21T22:38:23.052705+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.052705+0000', 'last_undegraded': '2023-07-21T22:38:23.052705+0000', 'last_fullsized': '2023-07-21T22:38:23.052705+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:38:29.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.12 is not active+clean 2023-07-21T22:38:29.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.054021+0000', 'last_change': '2023-07-21T22:38:23.054021+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.054021+0000', 'last_undegraded': '2023-07-21T22:38:23.054021+0000', 'last_fullsized': '2023-07-21T22:38:23.054021+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:38:29.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.14 is not active+clean 2023-07-21T22:38:29.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.062904+0000', 'last_change': '2023-07-21T22:38:23.062904+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.062904+0000', 'last_undegraded': '2023-07-21T22:38:23.062904+0000', 'last_fullsized': '2023-07-21T22:38:23.062904+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:38:29.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.15 is not active+clean 2023-07-21T22:38:29.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.057612+0000', 'last_change': '2023-07-21T22:38:23.057612+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.057612+0000', 'last_undegraded': '2023-07-21T22:38:23.057612+0000', 'last_fullsized': '2023-07-21T22:38:23.057612+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:38:29.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.16 is not active+clean 2023-07-21T22:38:29.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.055927+0000', 'last_change': '2023-07-21T22:38:23.055927+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.055927+0000', 'last_undegraded': '2023-07-21T22:38:23.055927+0000', 'last_fullsized': '2023-07-21T22:38:23.055927+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:38:29.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.17 is not active+clean 2023-07-21T22:38:29.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 141, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:38:23.057255+0000', 'last_change': '2023-07-21T22:38:23.057255+0000', 'last_active': '2023-07-21T22:38:23.043425+0000', 'last_peered': '2023-07-21T22:38:23.043425+0000', 'last_clean': '2023-07-21T22:38:23.043425+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:38:23.057255+0000', 'last_undegraded': '2023-07-21T22:38:23.057255+0000', 'last_fullsized': '2023-07-21T22:38:23.057255+0000', 'mapping_epoch': 141, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 141, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'last_clean_scrub_stamp': '2023-07-21T22:38:23.043425+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:38:29.068 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-21T22:38:29.084 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-07-21T22:38:29.039+0000 7fbab33df640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:38:29.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77fe80b640 1 Processor -- start 2023-07-21T22:38:29.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77fe80b640 1 -- start start 2023-07-21T22:38:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77fe80b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f77f815fd60 0x7f77f80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77fe80b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f80ccaf0 con 0x7f77f80b7c70 2023-07-21T22:38:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77fe80b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f8160320 con 0x7f77f80d1850 2023-07-21T22:38:29.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77fe80b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f80d1190 con 0x7f77f815fd60 2023-07-21T22:38:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f7fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f77f80b7c70 0x7f77f815f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52586/0 (socket says 172.21.15.6:52586) 2023-07-21T22:38:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f7fff640 1 -- 172.21.15.6:0/2390310692 learned_addr learned my addr 172.21.15.6:0/2390310692 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:29.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f6ffd640 1 -- 172.21.15.6:0/2390310692 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514316543 0 0) 0x7f77f80ccaf0 con 0x7f77f80b7c70 2023-07-21T22:38:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f77fe640 1 --2- 172.21.15.6:0/2390310692 >> v2:172.21.15.161:3300/0 conn(0x7f77f815fd60 0x7f77f80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f6ffd640 1 -- 172.21.15.6:0/2390310692 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77e0003530 con 0x7f77f80b7c70 2023-07-21T22:38:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f6ffd640 1 -- 172.21.15.6:0/2390310692 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 160555109 0 0) 0x7f77e0003530 con 0x7f77f80b7c70 2023-07-21T22:38:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f6ffd640 1 -- 172.21.15.6:0/2390310692 >> v2:172.21.15.161:3300/0 conn(0x7f77f815fd60 msgr2=0x7f77f80d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f6ffd640 1 --2- 172.21.15.6:0/2390310692 >> v2:172.21.15.161:3300/0 conn(0x7f77f815fd60 0x7f77f80d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f6ffd640 1 -- 172.21.15.6:0/2390310692 >> v1:172.21.15.161:6789/0 conn(0x7f77f80d1850 legacy=0x7f77f80d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:29.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f6ffd640 1 -- 172.21.15.6:0/2390310692 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f80ccd90 con 0x7f77f80b7c70 2023-07-21T22:38:29.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f6ffd640 1 -- 172.21.15.6:0/2390310692 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f77e8001680 con 0x7f77f80b7c70 2023-07-21T22:38:29.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f6ffd640 1 -- 172.21.15.6:0/2390310692 >> v1:172.21.15.6:6789/0 conn(0x7f77f80b7c70 legacy=0x7f77f815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:29.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f6ffd640 1 --2- 172.21.15.6:0/2390310692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77e0003980 0x7f77e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:29.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f6ffd640 1 --2- 172.21.15.6:0/2390310692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e00047d0 0x7f77e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:29.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f6ffd640 1 --2- 172.21.15.6:0/2390310692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77e0005180 0x7f77e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:29.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f6ffd640 1 -- 172.21.15.6:0/2390310692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e000bfd0 con 0x7f77e0005180 2023-07-21T22:38:29.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f6ffd640 1 -- 172.21.15.6:0/2390310692 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e000c140 con 0x7f77e0003980 2023-07-21T22:38:29.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f6ffd640 1 -- 172.21.15.6:0/2390310692 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e000c300 con 0x7f77e00047d0 2023-07-21T22:38:29.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f7fff640 1 --2- 172.21.15.6:0/2390310692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77e0003980 0x7f77e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:29.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77fcda8640 1 --2- 172.21.15.6:0/2390310692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77e0005180 0x7f77e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:29.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f77fe640 1 --2- 172.21.15.6:0/2390310692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e00047d0 0x7f77e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:29.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77fcda8640 1 -- 172.21.15.6:0/2390310692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e00047d0 msgr2=0x7f77e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:29.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77fcda8640 1 --2- 172.21.15.6:0/2390310692 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e00047d0 0x7f77e0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77fcda8640 1 -- 172.21.15.6:0/2390310692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77e0003980 msgr2=0x7f77e0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:29.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77fcda8640 1 --2- 172.21.15.6:0/2390310692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77e0003980 0x7f77e0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77fcda8640 1 -- 172.21.15.6:0/2390310692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e0003530 con 0x7f77e0005180 2023-07-21T22:38:29.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.168+0000 7f77f7fff640 1 --2- 172.21.15.6:0/2390310692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77e0003980 0x7f77e0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.172+0000 7f77fcda8640 1 -- 172.21.15.6:0/2390310692 reap_dead start 2023-07-21T22:38:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.172+0000 7f77fcda8640 1 --2- 172.21.15.6:0/2390310692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77e0005180 0x7f77e000b990 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f77f0001e70 tx=0x7f77f001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28aaf392bc0f0cdc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.172+0000 7f77f6ffd640 1 -- 172.21.15.6:0/2390310692 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0003b80 con 0x7f77e0005180 2023-07-21T22:38:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.172+0000 7f77f6ffd640 1 -- 172.21.15.6:0/2390310692 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f0003d20 con 0x7f77e0005180 2023-07-21T22:38:29.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.172+0000 7f77f6ffd640 1 -- 172.21.15.6:0/2390310692 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f0005260 con 0x7f77e0005180 2023-07-21T22:38:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.172+0000 7f77fe80b640 1 -- 172.21.15.6:0/2390310692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77e0005180 msgr2=0x7f77e000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.172+0000 7f77fe80b640 1 --2- 172.21.15.6:0/2390310692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77e0005180 0x7f77e000b990 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f77f0001e70 tx=0x7f77f001c760 comp rx=0 tx=0).stop 2023-07-21T22:38:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.172+0000 7f77fe80b640 1 -- 172.21.15.6:0/2390310692 shutdown_connections 2023-07-21T22:38:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.172+0000 7f77fe80b640 1 --2- 172.21.15.6:0/2390310692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77e0005180 0x7f77e000b990 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.172+0000 7f77fe80b640 1 -- 172.21.15.6:0/2390310692 >> 172.21.15.6:0/2390310692 conn(0x7f77f80650b0 msgr2=0x7f77f80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.172+0000 7f77fe80b640 1 -- 172.21.15.6:0/2390310692 shutdown_connections 2023-07-21T22:38:29.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.172+0000 7f77fe80b640 1 -- 172.21.15.6:0/2390310692 wait complete. 2023-07-21T22:38:29.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77fe80b640 1 Processor -- start 2023-07-21T22:38:29.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77fe80b640 1 -- start start 2023-07-21T22:38:29.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77fe80b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e0005180 0x7f77f81596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:29.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77fe80b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77f8159e70 0x7f77f815b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:29.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77fe80b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77f80c7e40 0x7f77f80c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:29.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77fe80b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f80c8820 con 0x7f77f8159e70 2023-07-21T22:38:29.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77fe80b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f8159c10 con 0x7f77f80c7e40 2023-07-21T22:38:29.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77fe80b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f815e310 con 0x7f77e0005180 2023-07-21T22:38:29.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77f77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77f8159e70 0x7f77f815b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:29.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77f77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77f8159e70 0x7f77f815b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45502/0 (socket says 172.21.15.6:45502) 2023-07-21T22:38:29.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77f77fe640 1 -- 172.21.15.6:0/1019773791 learned_addr learned my addr 172.21.15.6:0/1019773791 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:29.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77f7fff640 1 --2- 172.21.15.6:0/1019773791 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e0005180 0x7f77f81596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:29.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77fcda8640 1 --2- 172.21.15.6:0/1019773791 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77f80c7e40 0x7f77f80c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:29.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77f77fe640 1 -- 172.21.15.6:0/1019773791 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e0005180 msgr2=0x7f77f81596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:29.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77f77fe640 1 --2- 172.21.15.6:0/1019773791 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e0005180 0x7f77f81596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77f77fe640 1 -- 172.21.15.6:0/1019773791 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77f80c7e40 msgr2=0x7f77f80c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:29.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77f77fe640 1 --2- 172.21.15.6:0/1019773791 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77f80c7e40 0x7f77f80c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77f77fe640 1 -- 172.21.15.6:0/1019773791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f815e5f0 con 0x7f77f8159e70 2023-07-21T22:38:29.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77f77fe640 1 --2- 172.21.15.6:0/1019773791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77f8159e70 0x7f77f815b470 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f77ec011990 tx=0x7f77ec011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:29.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77f4ff9640 1 -- 172.21.15.6:0/1019773791 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec00fad0 con 0x7f77f8159e70 2023-07-21T22:38:29.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77f4ff9640 1 -- 172.21.15.6:0/1019773791 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ec00fc30 con 0x7f77f8159e70 2023-07-21T22:38:29.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77f4ff9640 1 -- 172.21.15.6:0/1019773791 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec014440 con 0x7f77f8159e70 2023-07-21T22:38:29.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.176+0000 7f77fe80b640 1 -- 172.21.15.6:0/1019773791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f815e8d0 con 0x7f77f8159e70 2023-07-21T22:38:29.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.180+0000 7f77fe80b640 1 -- 172.21.15.6:0/1019773791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f815df50 con 0x7f77f8159e70 2023-07-21T22:38:29.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.180+0000 7f77fe80b640 1 -- 172.21.15.6:0/1019773791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f80678d0 con 0x7f77f8159e70 2023-07-21T22:38:29.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.180+0000 7f77f4ff9640 1 -- 172.21.15.6:0/1019773791 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f77ec0145a0 con 0x7f77f8159e70 2023-07-21T22:38:29.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.180+0000 7f77f4ff9640 1 --2- 172.21.15.6:0/1019773791 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f77e40663d0 0x7f77e4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:29.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.180+0000 7f77f4ff9640 1 -- 172.21.15.6:0/1019773791 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f77ec084650 con 0x7f77f8159e70 2023-07-21T22:38:29.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.180+0000 7f77f7fff640 1 --2- 172.21.15.6:0/1019773791 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f77e40663d0 0x7f77e4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:29.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.180+0000 7f77f7fff640 1 --2- 172.21.15.6:0/1019773791 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f77e40663d0 0x7f77e4068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f77e8001620 tx=0x7f77e8001c40 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:29.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.184+0000 7f77f4ff9640 1 -- 172.21.15.6:0/1019773791 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f77ec051980 con 0x7f77f8159e70 2023-07-21T22:38:29.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.392+0000 7f77fe80b640 1 -- 172.21.15.6:0/1019773791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f77f80b7050 con 0x7f77f8159e70 2023-07-21T22:38:29.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.396+0000 7f77f4ff9640 1 -- 172.21.15.6:0/1019773791 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3232 (secure 0 0 0) 0x7f77ec054fa0 con 0x7f77f8159e70 2023-07-21T22:38:29.440 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:29.440 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1211,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1689977909,"num_in_osds":8,"osd_in_since":1689977900,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":345837568,"bytes_avail":772748275712,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":62,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"b","status":"up:active","gid":8455}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2023-07-21T22:38:11.716285+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-21T22:38:29.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.396+0000 7f77fe80b640 1 -- 172.21.15.6:0/1019773791 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f77e40663d0 msgr2=0x7f77e4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:29.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.396+0000 7f77fe80b640 1 --2- 172.21.15.6:0/1019773791 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f77e40663d0 0x7f77e4068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f77e8001620 tx=0x7f77e8001c40 comp rx=0 tx=0).stop 2023-07-21T22:38:29.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.396+0000 7f77fe80b640 1 -- 172.21.15.6:0/1019773791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77f8159e70 msgr2=0x7f77f815b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:29.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.396+0000 7f77fe80b640 1 --2- 172.21.15.6:0/1019773791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77f8159e70 0x7f77f815b470 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f77ec011990 tx=0x7f77ec011e50 comp rx=0 tx=0).stop 2023-07-21T22:38:29.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.396+0000 7f77fe80b640 1 -- 172.21.15.6:0/1019773791 shutdown_connections 2023-07-21T22:38:29.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.396+0000 7f77fe80b640 1 --2- 172.21.15.6:0/1019773791 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f77e40663d0 0x7f77e4068880 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.396+0000 7f77fe80b640 1 --2- 172.21.15.6:0/1019773791 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77f80c7e40 0x7f77f80c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.396+0000 7f77fe80b640 1 --2- 172.21.15.6:0/1019773791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77f8159e70 0x7f77f815b470 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.396+0000 7f77fe80b640 1 --2- 172.21.15.6:0/1019773791 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77e0005180 0x7f77f81596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.396+0000 7f77fe80b640 1 -- 172.21.15.6:0/1019773791 >> 172.21.15.6:0/1019773791 conn(0x7f77f80650b0 msgr2=0x7f77f8072420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:29.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.396+0000 7f77fe80b640 1 -- 172.21.15.6:0/1019773791 shutdown_connections 2023-07-21T22:38:29.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.396+0000 7f77fe80b640 1 -- 172.21.15.6:0/1019773791 wait complete. 2023-07-21T22:38:29.461 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-21T22:38:29.461 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:38:29.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.560+0000 7f23a7e6d640 1 Processor -- start 2023-07-21T22:38:29.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.560+0000 7f23a7e6d640 1 -- start start 2023-07-21T22:38:29.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.560+0000 7f23a7e6d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23a006a9c0 0x7f23a00ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:29.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.560+0000 7f23a7e6d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a00cdc80 con 0x7f23a006a540 2023-07-21T22:38:29.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.560+0000 7f23a7e6d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a006e4c0 con 0x7f23a015f500 2023-07-21T22:38:29.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.560+0000 7f23a7e6d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a006ae40 con 0x7f23a006a9c0 2023-07-21T22:38:29.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.560+0000 7f23a5408640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f23a006a540 0x7f23a00ce0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52592/0 (socket says 172.21.15.6:52592) 2023-07-21T22:38:29.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.560+0000 7f23a5408640 1 -- 172.21.15.6:0/1602547365 learned_addr learned my addr 172.21.15.6:0/1602547365 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.560+0000 7f23a640a640 1 --2- 172.21.15.6:0/1602547365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23a006a9c0 0x7f23a00ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.560+0000 7f23a4c07640 1 -- 172.21.15.6:0/1602547365 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142395196 0 0) 0x7f23a00cdc80 con 0x7f23a006a540 2023-07-21T22:38:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.560+0000 7f23a4c07640 1 -- 172.21.15.6:0/1602547365 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f238c003530 con 0x7f23a006a540 2023-07-21T22:38:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.560+0000 7f23a4c07640 1 -- 172.21.15.6:0/1602547365 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838526309 0 0) 0x7f23a006e4c0 con 0x7f23a015f500 2023-07-21T22:38:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.560+0000 7f23a4c07640 1 -- 172.21.15.6:0/1602547365 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23a00cdc80 con 0x7f23a015f500 2023-07-21T22:38:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.560+0000 7f23a640a640 1 -- 172.21.15.6:0/1602547365 >> v1:172.21.15.161:6789/0 conn(0x7f23a015f500 legacy=0x7f23a006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:29.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.560+0000 7f23a640a640 1 -- 172.21.15.6:0/1602547365 >> v1:172.21.15.6:6789/0 conn(0x7f23a006a540 legacy=0x7f23a00ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:29.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.560+0000 7f23a640a640 1 -- 172.21.15.6:0/1602547365 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a006d940 con 0x7f23a006a9c0 2023-07-21T22:38:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.564+0000 7f23a640a640 1 --2- 172.21.15.6:0/1602547365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23a006a9c0 0x7f23a00ce800 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2398009dc0 tx=0x7f239801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1572eb2001bec43 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.564+0000 7f23a4c07640 1 -- 172.21.15.6:0/1602547365 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23980a5920 con 0x7f23a006a9c0 2023-07-21T22:38:29.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.564+0000 7f23a4c07640 1 -- 172.21.15.6:0/1602547365 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23980a5a80 con 0x7f23a006a9c0 2023-07-21T22:38:29.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.564+0000 7f23a4c07640 1 -- 172.21.15.6:0/1602547365 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23980a5df0 con 0x7f23a006a9c0 2023-07-21T22:38:29.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.564+0000 7f23a7e6d640 1 -- 172.21.15.6:0/1602547365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23a006a9c0 msgr2=0x7f23a00ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:29.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.564+0000 7f23a7e6d640 1 --2- 172.21.15.6:0/1602547365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23a006a9c0 0x7f23a00ce800 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2398009dc0 tx=0x7f239801c970 comp rx=0 tx=0).stop 2023-07-21T22:38:29.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.564+0000 7f23a7e6d640 1 -- 172.21.15.6:0/1602547365 shutdown_connections 2023-07-21T22:38:29.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.564+0000 7f23a7e6d640 1 --2- 172.21.15.6:0/1602547365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23a006a9c0 0x7f23a00ce800 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.564+0000 7f23a7e6d640 1 -- 172.21.15.6:0/1602547365 >> 172.21.15.6:0/1602547365 conn(0x7f23a00659d0 msgr2=0x7f23a0099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:29.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.564+0000 7f23a7e6d640 1 -- 172.21.15.6:0/1602547365 shutdown_connections 2023-07-21T22:38:29.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.564+0000 7f23a7e6d640 1 -- 172.21.15.6:0/1602547365 wait complete. 2023-07-21T22:38:29.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a7e6d640 1 Processor -- start 2023-07-21T22:38:29.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a7e6d640 1 -- start start 2023-07-21T22:38:29.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a7e6d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23a006a540 0x7f23a00aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:29.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a7e6d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23a006a9c0 0x7f23a0150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:29.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a7e6d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23a015f500 0x7f23a01555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:29.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a7e6d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a00b4ba0 con 0x7f23a006a9c0 2023-07-21T22:38:29.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a7e6d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a00b4e80 con 0x7f23a015f500 2023-07-21T22:38:29.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a7e6d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a00b5160 con 0x7f23a006a540 2023-07-21T22:38:29.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a5408640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23a006a9c0 0x7f23a0150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:29.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a5408640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23a006a9c0 0x7f23a0150410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45514/0 (socket says 172.21.15.6:45514) 2023-07-21T22:38:29.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a5408640 1 -- 172.21.15.6:0/3714173227 learned_addr learned my addr 172.21.15.6:0/3714173227 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:29.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a5c09640 1 --2- 172.21.15.6:0/3714173227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23a006a540 0x7f23a00aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:29.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a640a640 1 --2- 172.21.15.6:0/3714173227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23a015f500 0x7f23a01555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:29.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a5408640 1 -- 172.21.15.6:0/3714173227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23a006a540 msgr2=0x7f23a00aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:29.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a5408640 1 --2- 172.21.15.6:0/3714173227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23a006a540 0x7f23a00aeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a5408640 1 -- 172.21.15.6:0/3714173227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23a015f500 msgr2=0x7f23a01555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:29.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a5408640 1 --2- 172.21.15.6:0/3714173227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23a015f500 0x7f23a01555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a5408640 1 -- 172.21.15.6:0/3714173227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2398009a70 con 0x7f23a006a9c0 2023-07-21T22:38:29.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a5c09640 1 --2- 172.21.15.6:0/3714173227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23a006a540 0x7f23a00aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:29.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a640a640 1 --2- 172.21.15.6:0/3714173227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23a015f500 0x7f23a01555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:29.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a5408640 1 --2- 172.21.15.6:0/3714173227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23a006a9c0 0x7f23a0150410 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f239000c4f0 tx=0x7f239000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:29.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23967fc640 1 -- 172.21.15.6:0/3714173227 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390005cf0 con 0x7f23a006a9c0 2023-07-21T22:38:29.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23967fc640 1 -- 172.21.15.6:0/3714173227 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2390005e50 con 0x7f23a006a9c0 2023-07-21T22:38:29.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a7e6d640 1 -- 172.21.15.6:0/3714173227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a00b5440 con 0x7f23a006a9c0 2023-07-21T22:38:29.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23967fc640 1 -- 172.21.15.6:0/3714173227 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2390007270 con 0x7f23a006a9c0 2023-07-21T22:38:29.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.568+0000 7f23a7e6d640 1 -- 172.21.15.6:0/3714173227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a0150b40 con 0x7f23a006a9c0 2023-07-21T22:38:29.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.572+0000 7f23a7e6d640 1 -- 172.21.15.6:0/3714173227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a00678d0 con 0x7f23a006a9c0 2023-07-21T22:38:29.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.572+0000 7f23967fc640 1 -- 172.21.15.6:0/3714173227 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f23900073d0 con 0x7f23a006a9c0 2023-07-21T22:38:29.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.572+0000 7f23967fc640 1 --2- 172.21.15.6:0/3714173227 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f23840663a0 0x7f2384068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:29.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.572+0000 7f23967fc640 1 -- 172.21.15.6:0/3714173227 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f2390083440 con 0x7f23a006a9c0 2023-07-21T22:38:29.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.572+0000 7f23a5c09640 1 --2- 172.21.15.6:0/3714173227 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f23840663a0 0x7f2384068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:29.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.572+0000 7f23a5c09640 1 --2- 172.21.15.6:0/3714173227 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f23840663a0 0x7f2384068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f239c000fc0 tx=0x7f239c009040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:29.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.576+0000 7f23967fc640 1 -- 172.21.15.6:0/3714173227 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2390050770 con 0x7f23a006a9c0 2023-07-21T22:38:29.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.728+0000 7f23a7e6d640 1 -- 172.21.15.6:0/3714173227 --> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23a00b4ff0 con 0x7f23840663a0 2023-07-21T22:38:29.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.736+0000 7f23967fc640 1 -- 172.21.15.6:0/3714173227 <== mgr.7307 v2:172.21.15.161:6832/3436422767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311661 (secure 0 0 0) 0x7f23a00b4ff0 con 0x7f23840663a0 2023-07-21T22:38:29.784 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:29.786 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:38:29.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.740+0000 7f23a7e6d640 1 -- 172.21.15.6:0/3714173227 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f23840663a0 msgr2=0x7f2384068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:29.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.740+0000 7f23a7e6d640 1 --2- 172.21.15.6:0/3714173227 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f23840663a0 0x7f2384068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f239c000fc0 tx=0x7f239c009040 comp rx=0 tx=0).stop 2023-07-21T22:38:29.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.740+0000 7f23a7e6d640 1 -- 172.21.15.6:0/3714173227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23a006a9c0 msgr2=0x7f23a0150410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:29.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.740+0000 7f23a7e6d640 1 --2- 172.21.15.6:0/3714173227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23a006a9c0 0x7f23a0150410 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f239000c4f0 tx=0x7f239000c9b0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.740+0000 7f23a7e6d640 1 -- 172.21.15.6:0/3714173227 shutdown_connections 2023-07-21T22:38:29.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.740+0000 7f23a7e6d640 1 --2- 172.21.15.6:0/3714173227 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f23840663a0 0x7f2384068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.740+0000 7f23a7e6d640 1 --2- 172.21.15.6:0/3714173227 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23a015f500 0x7f23a01555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.740+0000 7f23a7e6d640 1 --2- 172.21.15.6:0/3714173227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23a006a9c0 0x7f23a0150410 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.740+0000 7f23a7e6d640 1 --2- 172.21.15.6:0/3714173227 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23a006a540 0x7f23a00aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:29.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.740+0000 7f23a7e6d640 1 -- 172.21.15.6:0/3714173227 >> 172.21.15.6:0/3714173227 conn(0x7f23a00659d0 msgr2=0x7f23a015e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:29.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.740+0000 7f23a7e6d640 1 -- 172.21.15.6:0/3714173227 shutdown_connections 2023-07-21T22:38:29.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:29.740+0000 7f23a7e6d640 1 -- 172.21.15.6:0/3714173227 wait complete. 2023-07-21T22:38:29.805 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-21T22:38:29.720584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":444,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":288,"ondisk_log_size":288,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":338024,"kb_used_data":15016,"kb_used_omap":0,"kb_used_meta":322944,"kb_avail":754636696,"statfs":{"total":773094113280,"available":772747976704,"internally_reserved":0,"allocated":15376384,"data_stored":8341772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":330694656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.667151"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079644+0000","last_change":"2023-07-21T22:38:24.096350+0000","last_active":"2023-07-21T22:38:25.079644+0000","last_peered":"2023-07-21T22:38:25.079644+0000","last_clean":"2023-07-21T22:38:25.079644+0000","last_became_active":"2023-07-21T22:38:24.096072+0000","last_became_peered":"2023-07-21T22:38:24.096072+0000","last_unstale":"2023-07-21T22:38:25.079644+0000","last_undegraded":"2023-07-21T22:38:25.079644+0000","last_fullsized":"2023-07-21T22:38:25.079644+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:44:05.919088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073391+0000","last_change":"2023-07-21T22:38:24.084689+0000","last_active":"2023-07-21T22:38:25.073391+0000","last_peered":"2023-07-21T22:38:25.073391+0000","last_clean":"2023-07-21T22:38:25.073391+0000","last_became_active":"2023-07-21T22:38:24.082810+0000","last_became_peered":"2023-07-21T22:38:24.082810+0000","last_unstale":"2023-07-21T22:38:25.073391+0000","last_undegraded":"2023-07-21T22:38:25.073391+0000","last_fullsized":"2023-07-21T22:38:25.073391+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:06:59.940295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073553+0000","last_change":"2023-07-21T22:38:24.088354+0000","last_active":"2023-07-21T22:38:25.073553+0000","last_peered":"2023-07-21T22:38:25.073553+0000","last_clean":"2023-07-21T22:38:25.073553+0000","last_became_active":"2023-07-21T22:38:24.088066+0000","last_became_peered":"2023-07-21T22:38:24.088066+0000","last_unstale":"2023-07-21T22:38:25.073553+0000","last_undegraded":"2023-07-21T22:38:25.073553+0000","last_fullsized":"2023-07-21T22:38:25.073553+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:00:37.444848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080296+0000","last_change":"2023-07-21T22:38:24.094649+0000","last_active":"2023-07-21T22:38:25.080296+0000","last_peered":"2023-07-21T22:38:25.080296+0000","last_clean":"2023-07-21T22:38:25.080296+0000","last_became_active":"2023-07-21T22:38:24.093864+0000","last_became_peered":"2023-07-21T22:38:24.093864+0000","last_unstale":"2023-07-21T22:38:25.080296+0000","last_undegraded":"2023-07-21T22:38:25.080296+0000","last_fullsized":"2023-07-21T22:38:25.080296+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:19:45.271552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079355+0000","last_change":"2023-07-21T22:38:24.103284+0000","last_active":"2023-07-21T22:38:25.079355+0000","last_peered":"2023-07-21T22:38:25.079355+0000","last_clean":"2023-07-21T22:38:25.079355+0000","last_became_active":"2023-07-21T22:38:24.102962+0000","last_became_peered":"2023-07-21T22:38:24.102962+0000","last_unstale":"2023-07-21T22:38:25.079355+0000","last_undegraded":"2023-07-21T22:38:25.079355+0000","last_fullsized":"2023-07-21T22:38:25.079355+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:45:02.252698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.783767+0000","last_change":"2023-07-21T22:38:24.091508+0000","last_active":"2023-07-21T22:38:25.783767+0000","last_peered":"2023-07-21T22:38:25.783767+0000","last_clean":"2023-07-21T22:38:25.783767+0000","last_became_active":"2023-07-21T22:38:24.091215+0000","last_became_peered":"2023-07-21T22:38:24.091215+0000","last_unstale":"2023-07-21T22:38:25.783767+0000","last_undegraded":"2023-07-21T22:38:25.783767+0000","last_fullsized":"2023-07-21T22:38:25.783767+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:00:51.383736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.783987+0000","last_change":"2023-07-21T22:38:24.099935+0000","last_active":"2023-07-21T22:38:25.783987+0000","last_peered":"2023-07-21T22:38:25.783987+0000","last_clean":"2023-07-21T22:38:25.783987+0000","last_became_active":"2023-07-21T22:38:24.099652+0000","last_became_peered":"2023-07-21T22:38:24.099652+0000","last_unstale":"2023-07-21T22:38:25.783987+0000","last_undegraded":"2023-07-21T22:38:25.783987+0000","last_fullsized":"2023-07-21T22:38:25.783987+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:10:36.870471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073003+0000","last_change":"2023-07-21T22:38:24.088305+0000","last_active":"2023-07-21T22:38:25.073003+0000","last_peered":"2023-07-21T22:38:25.073003+0000","last_clean":"2023-07-21T22:38:25.073003+0000","last_became_active":"2023-07-21T22:38:24.087755+0000","last_became_peered":"2023-07-21T22:38:24.087755+0000","last_unstale":"2023-07-21T22:38:25.073003+0000","last_undegraded":"2023-07-21T22:38:25.073003+0000","last_fullsized":"2023-07-21T22:38:25.073003+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:32:21.804074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080780+0000","last_change":"2023-07-21T22:38:24.098033+0000","last_active":"2023-07-21T22:38:25.080780+0000","last_peered":"2023-07-21T22:38:25.080780+0000","last_clean":"2023-07-21T22:38:25.080780+0000","last_became_active":"2023-07-21T22:38:24.097753+0000","last_became_peered":"2023-07-21T22:38:24.097753+0000","last_unstale":"2023-07-21T22:38:25.080780+0000","last_undegraded":"2023-07-21T22:38:25.080780+0000","last_fullsized":"2023-07-21T22:38:25.080780+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:45:05.966828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784547+0000","last_change":"2023-07-21T22:38:24.093863+0000","last_active":"2023-07-21T22:38:25.784547+0000","last_peered":"2023-07-21T22:38:25.784547+0000","last_clean":"2023-07-21T22:38:25.784547+0000","last_became_active":"2023-07-21T22:38:24.093467+0000","last_became_peered":"2023-07-21T22:38:24.093467+0000","last_unstale":"2023-07-21T22:38:25.784547+0000","last_undegraded":"2023-07-21T22:38:25.784547+0000","last_fullsized":"2023-07-21T22:38:25.784547+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:58:53.544658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080090+0000","last_change":"2023-07-21T22:38:24.105913+0000","last_active":"2023-07-21T22:38:25.080090+0000","last_peered":"2023-07-21T22:38:25.080090+0000","last_clean":"2023-07-21T22:38:25.080090+0000","last_became_active":"2023-07-21T22:38:24.105642+0000","last_became_peered":"2023-07-21T22:38:24.105642+0000","last_unstale":"2023-07-21T22:38:25.080090+0000","last_undegraded":"2023-07-21T22:38:25.080090+0000","last_fullsized":"2023-07-21T22:38:25.080090+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:10:49.261747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785375+0000","last_change":"2023-07-21T22:38:24.094545+0000","last_active":"2023-07-21T22:38:25.785375+0000","last_peered":"2023-07-21T22:38:25.785375+0000","last_clean":"2023-07-21T22:38:25.785375+0000","last_became_active":"2023-07-21T22:38:24.094167+0000","last_became_peered":"2023-07-21T22:38:24.094167+0000","last_unstale":"2023-07-21T22:38:25.785375+0000","last_undegraded":"2023-07-21T22:38:25.785375+0000","last_fullsized":"2023-07-21T22:38:25.785375+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:09:49.797201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784920+0000","last_change":"2023-07-21T22:38:24.089366+0000","last_active":"2023-07-21T22:38:25.784920+0000","last_peered":"2023-07-21T22:38:25.784920+0000","last_clean":"2023-07-21T22:38:25.784920+0000","last_became_active":"2023-07-21T22:38:24.089037+0000","last_became_peered":"2023-07-21T22:38:24.089037+0000","last_unstale":"2023-07-21T22:38:25.784920+0000","last_undegraded":"2023-07-21T22:38:25.784920+0000","last_fullsized":"2023-07-21T22:38:25.784920+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:14:05.326581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073593+0000","last_change":"2023-07-21T22:38:24.089862+0000","last_active":"2023-07-21T22:38:25.073593+0000","last_peered":"2023-07-21T22:38:25.073593+0000","last_clean":"2023-07-21T22:38:25.073593+0000","last_became_active":"2023-07-21T22:38:24.089305+0000","last_became_peered":"2023-07-21T22:38:24.089305+0000","last_unstale":"2023-07-21T22:38:25.073593+0000","last_undegraded":"2023-07-21T22:38:25.073593+0000","last_fullsized":"2023-07-21T22:38:25.073593+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:57:17.921295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079678+0000","last_change":"2023-07-21T22:38:24.105772+0000","last_active":"2023-07-21T22:38:25.079678+0000","last_peered":"2023-07-21T22:38:25.079678+0000","last_clean":"2023-07-21T22:38:25.079678+0000","last_became_active":"2023-07-21T22:38:24.105477+0000","last_became_peered":"2023-07-21T22:38:24.105477+0000","last_unstale":"2023-07-21T22:38:25.079678+0000","last_undegraded":"2023-07-21T22:38:25.079678+0000","last_fullsized":"2023-07-21T22:38:25.079678+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:22:57.428549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.783850+0000","last_change":"2023-07-21T22:38:24.090736+0000","last_active":"2023-07-21T22:38:25.783850+0000","last_peered":"2023-07-21T22:38:25.783850+0000","last_clean":"2023-07-21T22:38:25.783850+0000","last_became_active":"2023-07-21T22:38:24.090456+0000","last_became_peered":"2023-07-21T22:38:24.090456+0000","last_unstale":"2023-07-21T22:38:25.783850+0000","last_undegraded":"2023-07-21T22:38:25.783850+0000","last_fullsized":"2023-07-21T22:38:25.783850+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:09:59.319285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785339+0000","last_change":"2023-07-21T22:38:24.091010+0000","last_active":"2023-07-21T22:38:25.785339+0000","last_peered":"2023-07-21T22:38:25.785339+0000","last_clean":"2023-07-21T22:38:25.785339+0000","last_became_active":"2023-07-21T22:38:24.090660+0000","last_became_peered":"2023-07-21T22:38:24.090660+0000","last_unstale":"2023-07-21T22:38:25.785339+0000","last_undegraded":"2023-07-21T22:38:25.785339+0000","last_fullsized":"2023-07-21T22:38:25.785339+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:22:37.120539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073427+0000","last_change":"2023-07-21T22:38:24.082310+0000","last_active":"2023-07-21T22:38:25.073427+0000","last_peered":"2023-07-21T22:38:25.073427+0000","last_clean":"2023-07-21T22:38:25.073427+0000","last_became_active":"2023-07-21T22:38:24.082015+0000","last_became_peered":"2023-07-21T22:38:24.082015+0000","last_unstale":"2023-07-21T22:38:25.073427+0000","last_undegraded":"2023-07-21T22:38:25.073427+0000","last_fullsized":"2023-07-21T22:38:25.073427+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:50:15.223031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788018+0000","last_change":"2023-07-21T22:38:24.093822+0000","last_active":"2023-07-21T22:38:25.788018+0000","last_peered":"2023-07-21T22:38:25.788018+0000","last_clean":"2023-07-21T22:38:25.788018+0000","last_became_active":"2023-07-21T22:38:24.093524+0000","last_became_peered":"2023-07-21T22:38:24.093524+0000","last_unstale":"2023-07-21T22:38:25.788018+0000","last_undegraded":"2023-07-21T22:38:25.788018+0000","last_fullsized":"2023-07-21T22:38:25.788018+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:41:54.129514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.783790+0000","last_change":"2023-07-21T22:38:24.096844+0000","last_active":"2023-07-21T22:38:25.783790+0000","last_peered":"2023-07-21T22:38:25.783790+0000","last_clean":"2023-07-21T22:38:25.783790+0000","last_became_active":"2023-07-21T22:38:24.096494+0000","last_became_peered":"2023-07-21T22:38:24.096494+0000","last_unstale":"2023-07-21T22:38:25.783790+0000","last_undegraded":"2023-07-21T22:38:25.783790+0000","last_fullsized":"2023-07-21T22:38:25.783790+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:44:13.900174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080412+0000","last_change":"2023-07-21T22:38:24.095885+0000","last_active":"2023-07-21T22:38:25.080412+0000","last_peered":"2023-07-21T22:38:25.080412+0000","last_clean":"2023-07-21T22:38:25.080412+0000","last_became_active":"2023-07-21T22:38:24.095585+0000","last_became_peered":"2023-07-21T22:38:24.095585+0000","last_unstale":"2023-07-21T22:38:25.080412+0000","last_undegraded":"2023-07-21T22:38:25.080412+0000","last_fullsized":"2023-07-21T22:38:25.080412+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:15:40.694148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079919+0000","last_change":"2023-07-21T22:38:24.101925+0000","last_active":"2023-07-21T22:38:25.079919+0000","last_peered":"2023-07-21T22:38:25.079919+0000","last_clean":"2023-07-21T22:38:25.079919+0000","last_became_active":"2023-07-21T22:38:24.100737+0000","last_became_peered":"2023-07-21T22:38:24.100737+0000","last_unstale":"2023-07-21T22:38:25.079919+0000","last_undegraded":"2023-07-21T22:38:25.079919+0000","last_fullsized":"2023-07-21T22:38:25.079919+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:24:47.062349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079566+0000","last_change":"2023-07-21T22:38:24.098134+0000","last_active":"2023-07-21T22:38:25.079566+0000","last_peered":"2023-07-21T22:38:25.079566+0000","last_clean":"2023-07-21T22:38:25.079566+0000","last_became_active":"2023-07-21T22:38:24.097821+0000","last_became_peered":"2023-07-21T22:38:24.097821+0000","last_unstale":"2023-07-21T22:38:25.079566+0000","last_undegraded":"2023-07-21T22:38:25.079566+0000","last_fullsized":"2023-07-21T22:38:25.079566+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:36:48.023274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.787467+0000","last_change":"2023-07-21T22:38:24.099713+0000","last_active":"2023-07-21T22:38:25.787467+0000","last_peered":"2023-07-21T22:38:25.787467+0000","last_clean":"2023-07-21T22:38:25.787467+0000","last_became_active":"2023-07-21T22:38:24.099433+0000","last_became_peered":"2023-07-21T22:38:24.099433+0000","last_unstale":"2023-07-21T22:38:25.787467+0000","last_undegraded":"2023-07-21T22:38:25.787467+0000","last_fullsized":"2023-07-21T22:38:25.787467+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:29:36.424186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788534+0000","last_change":"2023-07-21T22:38:24.105911+0000","last_active":"2023-07-21T22:38:25.788534+0000","last_peered":"2023-07-21T22:38:25.788534+0000","last_clean":"2023-07-21T22:38:25.788534+0000","last_became_active":"2023-07-21T22:38:24.105270+0000","last_became_peered":"2023-07-21T22:38:24.105270+0000","last_unstale":"2023-07-21T22:38:25.788534+0000","last_undegraded":"2023-07-21T22:38:25.788534+0000","last_fullsized":"2023-07-21T22:38:25.788534+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:50:30.121903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784235+0000","last_change":"2023-07-21T22:38:24.079532+0000","last_active":"2023-07-21T22:38:25.784235+0000","last_peered":"2023-07-21T22:38:25.784235+0000","last_clean":"2023-07-21T22:38:25.784235+0000","last_became_active":"2023-07-21T22:38:24.079247+0000","last_became_peered":"2023-07-21T22:38:24.079247+0000","last_unstale":"2023-07-21T22:38:25.784235+0000","last_undegraded":"2023-07-21T22:38:25.784235+0000","last_fullsized":"2023-07-21T22:38:25.784235+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:56:47.427890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788384+0000","last_change":"2023-07-21T22:38:24.093844+0000","last_active":"2023-07-21T22:38:25.788384+0000","last_peered":"2023-07-21T22:38:25.788384+0000","last_clean":"2023-07-21T22:38:25.788384+0000","last_became_active":"2023-07-21T22:38:24.093518+0000","last_became_peered":"2023-07-21T22:38:24.093518+0000","last_unstale":"2023-07-21T22:38:25.788384+0000","last_undegraded":"2023-07-21T22:38:25.788384+0000","last_fullsized":"2023-07-21T22:38:25.788384+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:31:41.282905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784430+0000","last_change":"2023-07-21T22:38:24.095141+0000","last_active":"2023-07-21T22:38:25.784430+0000","last_peered":"2023-07-21T22:38:25.784430+0000","last_clean":"2023-07-21T22:38:25.784430+0000","last_became_active":"2023-07-21T22:38:24.094847+0000","last_became_peered":"2023-07-21T22:38:24.094847+0000","last_unstale":"2023-07-21T22:38:25.784430+0000","last_undegraded":"2023-07-21T22:38:25.784430+0000","last_fullsized":"2023-07-21T22:38:25.784430+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:47:44.613426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784585+0000","last_change":"2023-07-21T22:38:24.078266+0000","last_active":"2023-07-21T22:38:25.784585+0000","last_peered":"2023-07-21T22:38:25.784585+0000","last_clean":"2023-07-21T22:38:25.784585+0000","last_became_active":"2023-07-21T22:38:24.077952+0000","last_became_peered":"2023-07-21T22:38:24.077952+0000","last_unstale":"2023-07-21T22:38:25.784585+0000","last_undegraded":"2023-07-21T22:38:25.784585+0000","last_fullsized":"2023-07-21T22:38:25.784585+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:45:14.726844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073636+0000","last_change":"2023-07-21T22:38:24.095973+0000","last_active":"2023-07-21T22:38:25.073636+0000","last_peered":"2023-07-21T22:38:25.073636+0000","last_clean":"2023-07-21T22:38:25.073636+0000","last_became_active":"2023-07-21T22:38:24.095711+0000","last_became_peered":"2023-07-21T22:38:24.095711+0000","last_unstale":"2023-07-21T22:38:25.073636+0000","last_undegraded":"2023-07-21T22:38:25.073636+0000","last_fullsized":"2023-07-21T22:38:25.073636+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:19:05.311752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.787604+0000","last_change":"2023-07-21T22:38:24.101366+0000","last_active":"2023-07-21T22:38:25.787604+0000","last_peered":"2023-07-21T22:38:25.787604+0000","last_clean":"2023-07-21T22:38:25.787604+0000","last_became_active":"2023-07-21T22:38:24.100793+0000","last_became_peered":"2023-07-21T22:38:24.100793+0000","last_unstale":"2023-07-21T22:38:25.787604+0000","last_undegraded":"2023-07-21T22:38:25.787604+0000","last_fullsized":"2023-07-21T22:38:25.787604+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:36:09.625577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.787467+0000","last_change":"2023-07-21T22:38:24.105147+0000","last_active":"2023-07-21T22:38:25.787467+0000","last_peered":"2023-07-21T22:38:25.787467+0000","last_clean":"2023-07-21T22:38:25.787467+0000","last_became_active":"2023-07-21T22:38:24.104856+0000","last_became_peered":"2023-07-21T22:38:24.104856+0000","last_unstale":"2023-07-21T22:38:25.787467+0000","last_undegraded":"2023-07-21T22:38:25.787467+0000","last_fullsized":"2023-07-21T22:38:25.787467+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:21:04.720457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785178+0000","last_change":"2023-07-21T22:38:24.095035+0000","last_active":"2023-07-21T22:38:25.785178+0000","last_peered":"2023-07-21T22:38:25.785178+0000","last_clean":"2023-07-21T22:38:25.785178+0000","last_became_active":"2023-07-21T22:38:24.094748+0000","last_became_peered":"2023-07-21T22:38:24.094748+0000","last_unstale":"2023-07-21T22:38:25.785178+0000","last_undegraded":"2023-07-21T22:38:25.785178+0000","last_fullsized":"2023-07-21T22:38:25.785178+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:06.886930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"142'4","reported_seq":17,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788160+0000","last_change":"2023-07-21T22:38:23.071766+0000","last_active":"2023-07-21T22:38:25.788160+0000","last_peered":"2023-07-21T22:38:25.788160+0000","last_clean":"2023-07-21T22:38:25.788160+0000","last_became_active":"2023-07-21T22:38:23.071479+0000","last_became_peered":"2023-07-21T22:38:23.071479+0000","last_unstale":"2023-07-21T22:38:25.788160+0000","last_undegraded":"2023-07-21T22:38:25.788160+0000","last_fullsized":"2023-07-21T22:38:25.788160+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:00:36.438322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785004+0000","last_change":"2023-07-21T22:38:24.090603+0000","last_active":"2023-07-21T22:38:25.785004+0000","last_peered":"2023-07-21T22:38:25.785004+0000","last_clean":"2023-07-21T22:38:25.785004+0000","last_became_active":"2023-07-21T22:38:24.090316+0000","last_became_peered":"2023-07-21T22:38:24.090316+0000","last_unstale":"2023-07-21T22:38:25.785004+0000","last_undegraded":"2023-07-21T22:38:25.785004+0000","last_fullsized":"2023-07-21T22:38:25.785004+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:09:00.941490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"142'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784717+0000","last_change":"2023-07-21T22:38:23.061581+0000","last_active":"2023-07-21T22:38:25.784717+0000","last_peered":"2023-07-21T22:38:25.784717+0000","last_clean":"2023-07-21T22:38:25.784717+0000","last_became_active":"2023-07-21T22:38:23.061317+0000","last_became_peered":"2023-07-21T22:38:23.061317+0000","last_unstale":"2023-07-21T22:38:25.784717+0000","last_undegraded":"2023-07-21T22:38:25.784717+0000","last_fullsized":"2023-07-21T22:38:25.784717+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:27:32.965649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788163+0000","last_change":"2023-07-21T22:38:24.104599+0000","last_active":"2023-07-21T22:38:25.788163+0000","last_peered":"2023-07-21T22:38:25.788163+0000","last_clean":"2023-07-21T22:38:25.788163+0000","last_became_active":"2023-07-21T22:38:24.104266+0000","last_became_peered":"2023-07-21T22:38:24.104266+0000","last_unstale":"2023-07-21T22:38:25.788163+0000","last_undegraded":"2023-07-21T22:38:25.788163+0000","last_fullsized":"2023-07-21T22:38:25.788163+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:04:17.202257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080545+0000","last_change":"2023-07-21T22:38:23.076553+0000","last_active":"2023-07-21T22:38:25.080545+0000","last_peered":"2023-07-21T22:38:25.080545+0000","last_clean":"2023-07-21T22:38:25.080545+0000","last_became_active":"2023-07-21T22:38:23.076250+0000","last_became_peered":"2023-07-21T22:38:23.076250+0000","last_unstale":"2023-07-21T22:38:25.080545+0000","last_undegraded":"2023-07-21T22:38:25.080545+0000","last_fullsized":"2023-07-21T22:38:25.080545+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:28.390501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080872+0000","last_change":"2023-07-21T22:38:24.096824+0000","last_active":"2023-07-21T22:38:25.080872+0000","last_peered":"2023-07-21T22:38:25.080872+0000","last_clean":"2023-07-21T22:38:25.080872+0000","last_became_active":"2023-07-21T22:38:24.096034+0000","last_became_peered":"2023-07-21T22:38:24.096034+0000","last_unstale":"2023-07-21T22:38:25.080872+0000","last_undegraded":"2023-07-21T22:38:25.080872+0000","last_fullsized":"2023-07-21T22:38:25.080872+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:58:00.070644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785216+0000","last_change":"2023-07-21T22:38:23.061237+0000","last_active":"2023-07-21T22:38:25.785216+0000","last_peered":"2023-07-21T22:38:25.785216+0000","last_clean":"2023-07-21T22:38:25.785216+0000","last_became_active":"2023-07-21T22:38:23.060950+0000","last_became_peered":"2023-07-21T22:38:23.060950+0000","last_unstale":"2023-07-21T22:38:25.785216+0000","last_undegraded":"2023-07-21T22:38:25.785216+0000","last_fullsized":"2023-07-21T22:38:25.785216+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:40:31.177602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784558+0000","last_change":"2023-07-21T22:38:24.084884+0000","last_active":"2023-07-21T22:38:25.784558+0000","last_peered":"2023-07-21T22:38:25.784558+0000","last_clean":"2023-07-21T22:38:25.784558+0000","last_became_active":"2023-07-21T22:38:24.084580+0000","last_became_peered":"2023-07-21T22:38:24.084580+0000","last_unstale":"2023-07-21T22:38:25.784558+0000","last_undegraded":"2023-07-21T22:38:25.784558+0000","last_fullsized":"2023-07-21T22:38:25.784558+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:48:35.087230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"142'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079611+0000","last_change":"2023-07-21T22:38:23.067155+0000","last_active":"2023-07-21T22:38:25.079611+0000","last_peered":"2023-07-21T22:38:25.079611+0000","last_clean":"2023-07-21T22:38:25.079611+0000","last_became_active":"2023-07-21T22:38:23.066836+0000","last_became_peered":"2023-07-21T22:38:23.066836+0000","last_unstale":"2023-07-21T22:38:25.079611+0000","last_undegraded":"2023-07-21T22:38:25.079611+0000","last_fullsized":"2023-07-21T22:38:25.079611+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:49:45.502056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079826+0000","last_change":"2023-07-21T22:38:24.103010+0000","last_active":"2023-07-21T22:38:25.079826+0000","last_peered":"2023-07-21T22:38:25.079826+0000","last_clean":"2023-07-21T22:38:25.079826+0000","last_became_active":"2023-07-21T22:38:24.102728+0000","last_became_peered":"2023-07-21T22:38:24.102728+0000","last_unstale":"2023-07-21T22:38:25.079826+0000","last_undegraded":"2023-07-21T22:38:25.079826+0000","last_fullsized":"2023-07-21T22:38:25.079826+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:38:59.426111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"142'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.783915+0000","last_change":"2023-07-21T22:38:23.071033+0000","last_active":"2023-07-21T22:38:25.783915+0000","last_peered":"2023-07-21T22:38:25.783915+0000","last_clean":"2023-07-21T22:38:25.783915+0000","last_became_active":"2023-07-21T22:38:23.070744+0000","last_became_peered":"2023-07-21T22:38:23.070744+0000","last_unstale":"2023-07-21T22:38:25.783915+0000","last_undegraded":"2023-07-21T22:38:25.783915+0000","last_fullsized":"2023-07-21T22:38:25.783915+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:19.183245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073680+0000","last_change":"2023-07-21T22:38:24.079664+0000","last_active":"2023-07-21T22:38:25.073680+0000","last_peered":"2023-07-21T22:38:25.073680+0000","last_clean":"2023-07-21T22:38:25.073680+0000","last_became_active":"2023-07-21T22:38:24.079364+0000","last_became_peered":"2023-07-21T22:38:24.079364+0000","last_unstale":"2023-07-21T22:38:25.073680+0000","last_undegraded":"2023-07-21T22:38:25.073680+0000","last_fullsized":"2023-07-21T22:38:25.073680+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:31:41.282905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.787677+0000","last_change":"2023-07-21T22:38:23.069579+0000","last_active":"2023-07-21T22:38:25.787677+0000","last_peered":"2023-07-21T22:38:25.787677+0000","last_clean":"2023-07-21T22:38:25.787677+0000","last_became_active":"2023-07-21T22:38:23.069255+0000","last_became_peered":"2023-07-21T22:38:23.069255+0000","last_unstale":"2023-07-21T22:38:25.787677+0000","last_undegraded":"2023-07-21T22:38:25.787677+0000","last_fullsized":"2023-07-21T22:38:25.787677+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:38:26.373969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785102+0000","last_change":"2023-07-21T22:38:24.079410+0000","last_active":"2023-07-21T22:38:25.785102+0000","last_peered":"2023-07-21T22:38:25.785102+0000","last_clean":"2023-07-21T22:38:25.785102+0000","last_became_active":"2023-07-21T22:38:24.079092+0000","last_became_peered":"2023-07-21T22:38:24.079092+0000","last_unstale":"2023-07-21T22:38:25.785102+0000","last_undegraded":"2023-07-21T22:38:25.785102+0000","last_fullsized":"2023-07-21T22:38:25.785102+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:11:11.841831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784171+0000","last_change":"2023-07-21T22:38:23.072024+0000","last_active":"2023-07-21T22:38:25.784171+0000","last_peered":"2023-07-21T22:38:25.784171+0000","last_clean":"2023-07-21T22:38:25.784171+0000","last_became_active":"2023-07-21T22:38:23.071738+0000","last_became_peered":"2023-07-21T22:38:23.071738+0000","last_unstale":"2023-07-21T22:38:25.784171+0000","last_undegraded":"2023-07-21T22:38:25.784171+0000","last_fullsized":"2023-07-21T22:38:25.784171+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:56:12.495929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788714+0000","last_change":"2023-07-21T22:38:24.106040+0000","last_active":"2023-07-21T22:38:25.788714+0000","last_peered":"2023-07-21T22:38:25.788714+0000","last_clean":"2023-07-21T22:38:25.788714+0000","last_became_active":"2023-07-21T22:38:24.101398+0000","last_became_peered":"2023-07-21T22:38:24.101398+0000","last_unstale":"2023-07-21T22:38:25.788714+0000","last_undegraded":"2023-07-21T22:38:25.788714+0000","last_fullsized":"2023-07-21T22:38:25.788714+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:23:05.843340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"142'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785459+0000","last_change":"2023-07-21T22:38:23.071033+0000","last_active":"2023-07-21T22:38:25.785459+0000","last_peered":"2023-07-21T22:38:25.785459+0000","last_clean":"2023-07-21T22:38:25.785459+0000","last_became_active":"2023-07-21T22:38:23.070685+0000","last_became_peered":"2023-07-21T22:38:23.070685+0000","last_unstale":"2023-07-21T22:38:25.785459+0000","last_undegraded":"2023-07-21T22:38:25.785459+0000","last_fullsized":"2023-07-21T22:38:25.785459+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:27:41.978908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080194+0000","last_change":"2023-07-21T22:38:24.099849+0000","last_active":"2023-07-21T22:38:25.080194+0000","last_peered":"2023-07-21T22:38:25.080194+0000","last_clean":"2023-07-21T22:38:25.080194+0000","last_became_active":"2023-07-21T22:38:24.099580+0000","last_became_peered":"2023-07-21T22:38:24.099580+0000","last_unstale":"2023-07-21T22:38:25.080194+0000","last_undegraded":"2023-07-21T22:38:25.080194+0000","last_fullsized":"2023-07-21T22:38:25.080194+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:16:48.290025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784453+0000","last_change":"2023-07-21T22:38:23.066606+0000","last_active":"2023-07-21T22:38:25.784453+0000","last_peered":"2023-07-21T22:38:25.784453+0000","last_clean":"2023-07-21T22:38:25.784453+0000","last_became_active":"2023-07-21T22:38:23.066288+0000","last_became_peered":"2023-07-21T22:38:23.066288+0000","last_unstale":"2023-07-21T22:38:25.784453+0000","last_undegraded":"2023-07-21T22:38:25.784453+0000","last_fullsized":"2023-07-21T22:38:25.784453+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:33:35.474710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784829+0000","last_change":"2023-07-21T22:38:24.097879+0000","last_active":"2023-07-21T22:38:25.784829+0000","last_peered":"2023-07-21T22:38:25.784829+0000","last_clean":"2023-07-21T22:38:25.784829+0000","last_became_active":"2023-07-21T22:38:24.097586+0000","last_became_peered":"2023-07-21T22:38:24.097586+0000","last_unstale":"2023-07-21T22:38:25.784829+0000","last_undegraded":"2023-07-21T22:38:25.784829+0000","last_fullsized":"2023-07-21T22:38:25.784829+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:36:52.938955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"142'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080602+0000","last_change":"2023-07-21T22:38:23.080670+0000","last_active":"2023-07-21T22:38:25.080602+0000","last_peered":"2023-07-21T22:38:25.080602+0000","last_clean":"2023-07-21T22:38:25.080602+0000","last_became_active":"2023-07-21T22:38:23.080326+0000","last_became_peered":"2023-07-21T22:38:23.080326+0000","last_unstale":"2023-07-21T22:38:25.080602+0000","last_undegraded":"2023-07-21T22:38:25.080602+0000","last_fullsized":"2023-07-21T22:38:25.080602+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:10.175545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788700+0000","last_change":"2023-07-21T22:38:24.106128+0000","last_active":"2023-07-21T22:38:25.788700+0000","last_peered":"2023-07-21T22:38:25.788700+0000","last_clean":"2023-07-21T22:38:25.788700+0000","last_became_active":"2023-07-21T22:38:24.105617+0000","last_became_peered":"2023-07-21T22:38:24.105617+0000","last_unstale":"2023-07-21T22:38:25.788700+0000","last_undegraded":"2023-07-21T22:38:25.788700+0000","last_fullsized":"2023-07-21T22:38:25.788700+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:00:45.730116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080277+0000","last_change":"2023-07-21T22:38:23.078636+0000","last_active":"2023-07-21T22:38:25.080277+0000","last_peered":"2023-07-21T22:38:25.080277+0000","last_clean":"2023-07-21T22:38:25.080277+0000","last_became_active":"2023-07-21T22:38:23.078443+0000","last_became_peered":"2023-07-21T22:38:23.078443+0000","last_unstale":"2023-07-21T22:38:25.080277+0000","last_undegraded":"2023-07-21T22:38:25.080277+0000","last_fullsized":"2023-07-21T22:38:25.080277+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:26:11.453377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784023+0000","last_change":"2023-07-21T22:38:24.097937+0000","last_active":"2023-07-21T22:38:25.784023+0000","last_peered":"2023-07-21T22:38:25.784023+0000","last_clean":"2023-07-21T22:38:25.784023+0000","last_became_active":"2023-07-21T22:38:24.097670+0000","last_became_peered":"2023-07-21T22:38:24.097670+0000","last_unstale":"2023-07-21T22:38:25.784023+0000","last_undegraded":"2023-07-21T22:38:25.784023+0000","last_fullsized":"2023-07-21T22:38:25.784023+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:01:51.959640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.783973+0000","last_change":"2023-07-21T22:38:23.069898+0000","last_active":"2023-07-21T22:38:25.783973+0000","last_peered":"2023-07-21T22:38:25.783973+0000","last_clean":"2023-07-21T22:38:25.783973+0000","last_became_active":"2023-07-21T22:38:23.069638+0000","last_became_peered":"2023-07-21T22:38:23.069638+0000","last_unstale":"2023-07-21T22:38:25.783973+0000","last_undegraded":"2023-07-21T22:38:25.783973+0000","last_fullsized":"2023-07-21T22:38:25.783973+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:47:26.418838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073008+0000","last_change":"2023-07-21T22:38:24.086531+0000","last_active":"2023-07-21T22:38:25.073008+0000","last_peered":"2023-07-21T22:38:25.073008+0000","last_clean":"2023-07-21T22:38:25.073008+0000","last_became_active":"2023-07-21T22:38:24.086229+0000","last_became_peered":"2023-07-21T22:38:24.086229+0000","last_unstale":"2023-07-21T22:38:25.073008+0000","last_undegraded":"2023-07-21T22:38:25.073008+0000","last_fullsized":"2023-07-21T22:38:25.073008+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:45:36.634653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080003+0000","last_change":"2023-07-21T22:38:23.076677+0000","last_active":"2023-07-21T22:38:25.080003+0000","last_peered":"2023-07-21T22:38:25.080003+0000","last_clean":"2023-07-21T22:38:25.080003+0000","last_became_active":"2023-07-21T22:38:23.076377+0000","last_became_peered":"2023-07-21T22:38:23.076377+0000","last_unstale":"2023-07-21T22:38:25.080003+0000","last_undegraded":"2023-07-21T22:38:25.080003+0000","last_fullsized":"2023-07-21T22:38:25.080003+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:56:17.368210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073756+0000","last_change":"2023-07-21T22:38:24.090100+0000","last_active":"2023-07-21T22:38:25.073756+0000","last_peered":"2023-07-21T22:38:25.073756+0000","last_clean":"2023-07-21T22:38:25.073756+0000","last_became_active":"2023-07-21T22:38:24.089622+0000","last_became_peered":"2023-07-21T22:38:24.089622+0000","last_unstale":"2023-07-21T22:38:25.073756+0000","last_undegraded":"2023-07-21T22:38:25.073756+0000","last_fullsized":"2023-07-21T22:38:25.073756+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:04:13.230479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073369+0000","last_change":"2023-07-21T22:38:23.066154+0000","last_active":"2023-07-21T22:38:25.073369+0000","last_peered":"2023-07-21T22:38:25.073369+0000","last_clean":"2023-07-21T22:38:25.073369+0000","last_became_active":"2023-07-21T22:38:23.065865+0000","last_became_peered":"2023-07-21T22:38:23.065865+0000","last_unstale":"2023-07-21T22:38:25.073369+0000","last_undegraded":"2023-07-21T22:38:25.073369+0000","last_fullsized":"2023-07-21T22:38:25.073369+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:50:03.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788316+0000","last_change":"2023-07-21T22:38:24.090424+0000","last_active":"2023-07-21T22:38:25.788316+0000","last_peered":"2023-07-21T22:38:25.788316+0000","last_clean":"2023-07-21T22:38:25.788316+0000","last_became_active":"2023-07-21T22:38:24.090102+0000","last_became_peered":"2023-07-21T22:38:24.090102+0000","last_unstale":"2023-07-21T22:38:25.788316+0000","last_undegraded":"2023-07-21T22:38:25.788316+0000","last_fullsized":"2023-07-21T22:38:25.788316+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:01:46.067288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079199+0000","last_change":"2023-07-21T22:38:23.074540+0000","last_active":"2023-07-21T22:38:25.079199+0000","last_peered":"2023-07-21T22:38:25.079199+0000","last_clean":"2023-07-21T22:38:25.079199+0000","last_became_active":"2023-07-21T22:38:23.074297+0000","last_became_peered":"2023-07-21T22:38:23.074297+0000","last_unstale":"2023-07-21T22:38:25.079199+0000","last_undegraded":"2023-07-21T22:38:25.079199+0000","last_fullsized":"2023-07-21T22:38:25.079199+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:18:58.765889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784573+0000","last_change":"2023-07-21T22:38:24.092977+0000","last_active":"2023-07-21T22:38:25.784573+0000","last_peered":"2023-07-21T22:38:25.784573+0000","last_clean":"2023-07-21T22:38:25.784573+0000","last_became_active":"2023-07-21T22:38:24.091605+0000","last_became_peered":"2023-07-21T22:38:24.091605+0000","last_unstale":"2023-07-21T22:38:25.784573+0000","last_undegraded":"2023-07-21T22:38:25.784573+0000","last_fullsized":"2023-07-21T22:38:25.784573+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:05:16.686353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784477+0000","last_change":"2023-07-21T22:38:23.067648+0000","last_active":"2023-07-21T22:38:25.784477+0000","last_peered":"2023-07-21T22:38:25.784477+0000","last_clean":"2023-07-21T22:38:25.784477+0000","last_became_active":"2023-07-21T22:38:23.067340+0000","last_became_peered":"2023-07-21T22:38:23.067340+0000","last_unstale":"2023-07-21T22:38:25.784477+0000","last_undegraded":"2023-07-21T22:38:25.784477+0000","last_fullsized":"2023-07-21T22:38:25.784477+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:43:47.490054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785048+0000","last_change":"2023-07-21T22:38:24.086899+0000","last_active":"2023-07-21T22:38:25.785048+0000","last_peered":"2023-07-21T22:38:25.785048+0000","last_clean":"2023-07-21T22:38:25.785048+0000","last_became_active":"2023-07-21T22:38:24.086687+0000","last_became_peered":"2023-07-21T22:38:24.086687+0000","last_unstale":"2023-07-21T22:38:25.785048+0000","last_undegraded":"2023-07-21T22:38:25.785048+0000","last_fullsized":"2023-07-21T22:38:25.785048+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:10:02.578722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"143'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788000+0000","last_change":"2023-07-21T22:38:23.076843+0000","last_active":"2023-07-21T22:38:25.788000+0000","last_peered":"2023-07-21T22:38:25.788000+0000","last_clean":"2023-07-21T22:38:25.788000+0000","last_became_active":"2023-07-21T22:38:23.076531+0000","last_became_peered":"2023-07-21T22:38:23.076531+0000","last_unstale":"2023-07-21T22:38:25.788000+0000","last_undegraded":"2023-07-21T22:38:25.788000+0000","last_fullsized":"2023-07-21T22:38:25.788000+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:06:58.933769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080779+0000","last_change":"2023-07-21T22:38:24.101889+0000","last_active":"2023-07-21T22:38:25.080779+0000","last_peered":"2023-07-21T22:38:25.080779+0000","last_clean":"2023-07-21T22:38:25.080779+0000","last_became_active":"2023-07-21T22:38:24.101592+0000","last_became_peered":"2023-07-21T22:38:24.101592+0000","last_unstale":"2023-07-21T22:38:25.080779+0000","last_undegraded":"2023-07-21T22:38:25.080779+0000","last_fullsized":"2023-07-21T22:38:25.080779+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:54:00.953682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788525+0000","last_change":"2023-07-21T22:38:23.077345+0000","last_active":"2023-07-21T22:38:25.788525+0000","last_peered":"2023-07-21T22:38:25.788525+0000","last_clean":"2023-07-21T22:38:25.788525+0000","last_became_active":"2023-07-21T22:38:23.076977+0000","last_became_peered":"2023-07-21T22:38:23.076977+0000","last_unstale":"2023-07-21T22:38:25.788525+0000","last_undegraded":"2023-07-21T22:38:25.788525+0000","last_fullsized":"2023-07-21T22:38:25.788525+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:21:15.032316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784338+0000","last_change":"2023-07-21T22:38:24.096862+0000","last_active":"2023-07-21T22:38:25.784338+0000","last_peered":"2023-07-21T22:38:25.784338+0000","last_clean":"2023-07-21T22:38:25.784338+0000","last_became_active":"2023-07-21T22:38:24.096571+0000","last_became_peered":"2023-07-21T22:38:24.096571+0000","last_unstale":"2023-07-21T22:38:25.784338+0000","last_undegraded":"2023-07-21T22:38:25.784338+0000","last_fullsized":"2023-07-21T22:38:25.784338+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:11:32.354921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784701+0000","last_change":"2023-07-21T22:38:23.072030+0000","last_active":"2023-07-21T22:38:25.784701+0000","last_peered":"2023-07-21T22:38:25.784701+0000","last_clean":"2023-07-21T22:38:25.784701+0000","last_became_active":"2023-07-21T22:38:23.071779+0000","last_became_peered":"2023-07-21T22:38:23.071779+0000","last_unstale":"2023-07-21T22:38:25.784701+0000","last_undegraded":"2023-07-21T22:38:25.784701+0000","last_fullsized":"2023-07-21T22:38:25.784701+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:24:58.097681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784078+0000","last_change":"2023-07-21T22:38:24.098006+0000","last_active":"2023-07-21T22:38:25.784078+0000","last_peered":"2023-07-21T22:38:25.784078+0000","last_clean":"2023-07-21T22:38:25.784078+0000","last_became_active":"2023-07-21T22:38:24.097717+0000","last_became_peered":"2023-07-21T22:38:24.097717+0000","last_unstale":"2023-07-21T22:38:25.784078+0000","last_undegraded":"2023-07-21T22:38:25.784078+0000","last_fullsized":"2023-07-21T22:38:25.784078+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:59:11.447007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079740+0000","last_change":"2023-07-21T22:38:23.064167+0000","last_active":"2023-07-21T22:38:25.079740+0000","last_peered":"2023-07-21T22:38:25.079740+0000","last_clean":"2023-07-21T22:38:25.079740+0000","last_became_active":"2023-07-21T22:38:23.063832+0000","last_became_peered":"2023-07-21T22:38:23.063832+0000","last_unstale":"2023-07-21T22:38:25.079740+0000","last_undegraded":"2023-07-21T22:38:25.079740+0000","last_fullsized":"2023-07-21T22:38:25.079740+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:20.088571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073146+0000","last_change":"2023-07-21T22:38:24.083269+0000","last_active":"2023-07-21T22:38:25.073146+0000","last_peered":"2023-07-21T22:38:25.073146+0000","last_clean":"2023-07-21T22:38:25.073146+0000","last_became_active":"2023-07-21T22:38:24.081731+0000","last_became_peered":"2023-07-21T22:38:24.081731+0000","last_unstale":"2023-07-21T22:38:25.073146+0000","last_undegraded":"2023-07-21T22:38:25.073146+0000","last_fullsized":"2023-07-21T22:38:25.073146+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:08:17.577766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079999+0000","last_change":"2023-07-21T22:38:23.069081+0000","last_active":"2023-07-21T22:38:25.079999+0000","last_peered":"2023-07-21T22:38:25.079999+0000","last_clean":"2023-07-21T22:38:25.079999+0000","last_became_active":"2023-07-21T22:38:23.068690+0000","last_became_peered":"2023-07-21T22:38:23.068690+0000","last_unstale":"2023-07-21T22:38:25.079999+0000","last_undegraded":"2023-07-21T22:38:25.079999+0000","last_fullsized":"2023-07-21T22:38:25.079999+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:23:12.707344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079346+0000","last_change":"2023-07-21T22:38:24.095531+0000","last_active":"2023-07-21T22:38:25.079346+0000","last_peered":"2023-07-21T22:38:25.079346+0000","last_clean":"2023-07-21T22:38:25.079346+0000","last_became_active":"2023-07-21T22:38:24.095237+0000","last_became_peered":"2023-07-21T22:38:24.095237+0000","last_unstale":"2023-07-21T22:38:25.079346+0000","last_undegraded":"2023-07-21T22:38:25.079346+0000","last_fullsized":"2023-07-21T22:38:25.079346+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:10:09.441603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784231+0000","last_change":"2023-07-21T22:38:23.072049+0000","last_active":"2023-07-21T22:38:25.784231+0000","last_peered":"2023-07-21T22:38:25.784231+0000","last_clean":"2023-07-21T22:38:25.784231+0000","last_became_active":"2023-07-21T22:38:23.071697+0000","last_became_peered":"2023-07-21T22:38:23.071697+0000","last_unstale":"2023-07-21T22:38:25.784231+0000","last_undegraded":"2023-07-21T22:38:25.784231+0000","last_fullsized":"2023-07-21T22:38:25.784231+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:50:17.486364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785223+0000","last_change":"2023-07-21T22:38:24.087878+0000","last_active":"2023-07-21T22:38:25.785223+0000","last_peered":"2023-07-21T22:38:25.785223+0000","last_clean":"2023-07-21T22:38:25.785223+0000","last_became_active":"2023-07-21T22:38:24.087596+0000","last_became_peered":"2023-07-21T22:38:24.087596+0000","last_unstale":"2023-07-21T22:38:25.785223+0000","last_undegraded":"2023-07-21T22:38:25.785223+0000","last_fullsized":"2023-07-21T22:38:25.785223+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:55.647829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079211+0000","last_change":"2023-07-21T22:38:23.076939+0000","last_active":"2023-07-21T22:38:25.079211+0000","last_peered":"2023-07-21T22:38:25.079211+0000","last_clean":"2023-07-21T22:38:25.079211+0000","last_became_active":"2023-07-21T22:38:23.076616+0000","last_became_peered":"2023-07-21T22:38:23.076616+0000","last_unstale":"2023-07-21T22:38:25.079211+0000","last_undegraded":"2023-07-21T22:38:25.079211+0000","last_fullsized":"2023-07-21T22:38:25.079211+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:24:35.294680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080226+0000","last_change":"2023-07-21T22:38:24.093594+0000","last_active":"2023-07-21T22:38:25.080226+0000","last_peered":"2023-07-21T22:38:25.080226+0000","last_clean":"2023-07-21T22:38:25.080226+0000","last_became_active":"2023-07-21T22:38:24.093278+0000","last_became_peered":"2023-07-21T22:38:24.093278+0000","last_unstale":"2023-07-21T22:38:25.080226+0000","last_undegraded":"2023-07-21T22:38:25.080226+0000","last_fullsized":"2023-07-21T22:38:25.080226+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:14:35.831166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"142'8","reported_seq":21,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073086+0000","last_change":"2023-07-21T22:38:23.068532+0000","last_active":"2023-07-21T22:38:25.073086+0000","last_peered":"2023-07-21T22:38:25.073086+0000","last_clean":"2023-07-21T22:38:25.073086+0000","last_became_active":"2023-07-21T22:38:23.068250+0000","last_became_peered":"2023-07-21T22:38:23.068250+0000","last_unstale":"2023-07-21T22:38:25.073086+0000","last_undegraded":"2023-07-21T22:38:25.073086+0000","last_fullsized":"2023-07-21T22:38:25.073086+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:26:02.389222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"130'249","reported_seq":854,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079594+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:38:25.079594+0000","last_peered":"2023-07-21T22:38:25.079594+0000","last_clean":"2023-07-21T22:38:25.079594+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:38:25.079594+0000","last_undegraded":"2023-07-21T22:38:25.079594+0000","last_fullsized":"2023-07-21T22:38:25.079594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:12:03.608673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":252,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788450+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:38:25.788450+0000","last_peered":"2023-07-21T22:38:25.788450+0000","last_clean":"2023-07-21T22:38:25.788450+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:38:25.788450+0000","last_undegraded":"2023-07-21T22:38:25.788450+0000","last_fullsized":"2023-07-21T22:38:25.788450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:22:48.485641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788017+0000","last_change":"2023-07-21T22:38:24.090205+0000","last_active":"2023-07-21T22:38:25.788017+0000","last_peered":"2023-07-21T22:38:25.788017+0000","last_clean":"2023-07-21T22:38:25.788017+0000","last_became_active":"2023-07-21T22:38:24.089783+0000","last_became_peered":"2023-07-21T22:38:24.089783+0000","last_unstale":"2023-07-21T22:38:25.788017+0000","last_undegraded":"2023-07-21T22:38:25.788017+0000","last_fullsized":"2023-07-21T22:38:25.788017+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:50:15.223031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073268+0000","last_change":"2023-07-21T22:38:23.063181+0000","last_active":"2023-07-21T22:38:25.073268+0000","last_peered":"2023-07-21T22:38:25.073268+0000","last_clean":"2023-07-21T22:38:25.073268+0000","last_became_active":"2023-07-21T22:38:23.062917+0000","last_became_peered":"2023-07-21T22:38:23.062917+0000","last_unstale":"2023-07-21T22:38:25.073268+0000","last_undegraded":"2023-07-21T22:38:25.073268+0000","last_fullsized":"2023-07-21T22:38:25.073268+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:08:34.867008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":230,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079369+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:38:25.079369+0000","last_peered":"2023-07-21T22:38:25.079369+0000","last_clean":"2023-07-21T22:38:25.079369+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:38:25.079369+0000","last_undegraded":"2023-07-21T22:38:25.079369+0000","last_fullsized":"2023-07-21T22:38:25.079369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:23:05.518387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785026+0000","last_change":"2023-07-21T22:38:24.081637+0000","last_active":"2023-07-21T22:38:25.785026+0000","last_peered":"2023-07-21T22:38:25.785026+0000","last_clean":"2023-07-21T22:38:25.785026+0000","last_became_active":"2023-07-21T22:38:24.081283+0000","last_became_peered":"2023-07-21T22:38:24.081283+0000","last_unstale":"2023-07-21T22:38:25.785026+0000","last_undegraded":"2023-07-21T22:38:25.785026+0000","last_fullsized":"2023-07-21T22:38:25.785026+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:15:21.856379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073756+0000","last_change":"2023-07-21T22:38:23.069398+0000","last_active":"2023-07-21T22:38:25.073756+0000","last_peered":"2023-07-21T22:38:25.073756+0000","last_clean":"2023-07-21T22:38:25.073756+0000","last_became_active":"2023-07-21T22:38:23.069091+0000","last_became_peered":"2023-07-21T22:38:23.069091+0000","last_unstale":"2023-07-21T22:38:25.073756+0000","last_undegraded":"2023-07-21T22:38:25.073756+0000","last_fullsized":"2023-07-21T22:38:25.073756+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:21:15.032316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":228,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.783828+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:38:25.783828+0000","last_peered":"2023-07-21T22:38:25.783828+0000","last_clean":"2023-07-21T22:38:25.783828+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:38:25.783828+0000","last_undegraded":"2023-07-21T22:38:25.783828+0000","last_fullsized":"2023-07-21T22:38:25.783828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:35:36.553194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.783987+0000","last_change":"2023-07-21T22:38:24.092881+0000","last_active":"2023-07-21T22:38:25.783987+0000","last_peered":"2023-07-21T22:38:25.783987+0000","last_clean":"2023-07-21T22:38:25.783987+0000","last_became_active":"2023-07-21T22:38:24.092589+0000","last_became_peered":"2023-07-21T22:38:24.092589+0000","last_unstale":"2023-07-21T22:38:25.783987+0000","last_undegraded":"2023-07-21T22:38:25.783987+0000","last_fullsized":"2023-07-21T22:38:25.783987+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:54:14.632380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073173+0000","last_change":"2023-07-21T22:38:23.062898+0000","last_active":"2023-07-21T22:38:25.073173+0000","last_peered":"2023-07-21T22:38:25.073173+0000","last_clean":"2023-07-21T22:38:25.073173+0000","last_became_active":"2023-07-21T22:38:23.062603+0000","last_became_peered":"2023-07-21T22:38:23.062603+0000","last_unstale":"2023-07-21T22:38:25.073173+0000","last_undegraded":"2023-07-21T22:38:25.073173+0000","last_fullsized":"2023-07-21T22:38:25.073173+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:41:58.825031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":252,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788064+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:38:25.788064+0000","last_peered":"2023-07-21T22:38:25.788064+0000","last_clean":"2023-07-21T22:38:25.788064+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:38:25.788064+0000","last_undegraded":"2023-07-21T22:38:25.788064+0000","last_fullsized":"2023-07-21T22:38:25.788064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:46:15.432136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788214+0000","last_change":"2023-07-21T22:38:24.095582+0000","last_active":"2023-07-21T22:38:25.788214+0000","last_peered":"2023-07-21T22:38:25.788214+0000","last_clean":"2023-07-21T22:38:25.788214+0000","last_became_active":"2023-07-21T22:38:24.095318+0000","last_became_peered":"2023-07-21T22:38:24.095318+0000","last_unstale":"2023-07-21T22:38:25.788214+0000","last_undegraded":"2023-07-21T22:38:25.788214+0000","last_fullsized":"2023-07-21T22:38:25.788214+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:57:17.921295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788303+0000","last_change":"2023-07-21T22:38:23.073676+0000","last_active":"2023-07-21T22:38:25.788303+0000","last_peered":"2023-07-21T22:38:25.788303+0000","last_clean":"2023-07-21T22:38:25.788303+0000","last_became_active":"2023-07-21T22:38:23.073401+0000","last_became_peered":"2023-07-21T22:38:23.073401+0000","last_unstale":"2023-07-21T22:38:25.788303+0000","last_undegraded":"2023-07-21T22:38:25.788303+0000","last_fullsized":"2023-07-21T22:38:25.788303+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:19:04.305226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":244,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785284+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:38:25.785284+0000","last_peered":"2023-07-21T22:38:25.785284+0000","last_clean":"2023-07-21T22:38:25.785284+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:38:25.785284+0000","last_undegraded":"2023-07-21T22:38:25.785284+0000","last_fullsized":"2023-07-21T22:38:25.785284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:00:35.047119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788408+0000","last_change":"2023-07-21T22:38:24.098711+0000","last_active":"2023-07-21T22:38:25.788408+0000","last_peered":"2023-07-21T22:38:25.788408+0000","last_clean":"2023-07-21T22:38:25.788408+0000","last_became_active":"2023-07-21T22:38:24.098396+0000","last_became_peered":"2023-07-21T22:38:24.098396+0000","last_unstale":"2023-07-21T22:38:25.788408+0000","last_undegraded":"2023-07-21T22:38:25.788408+0000","last_fullsized":"2023-07-21T22:38:25.788408+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:21:26.325894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788181+0000","last_change":"2023-07-21T22:38:23.064930+0000","last_active":"2023-07-21T22:38:25.788181+0000","last_peered":"2023-07-21T22:38:25.788181+0000","last_clean":"2023-07-21T22:38:25.788181+0000","last_became_active":"2023-07-21T22:38:23.064654+0000","last_became_peered":"2023-07-21T22:38:23.064654+0000","last_unstale":"2023-07-21T22:38:25.788181+0000","last_undegraded":"2023-07-21T22:38:25.788181+0000","last_fullsized":"2023-07-21T22:38:25.788181+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:23:37.260793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":230,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080704+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:38:25.080704+0000","last_peered":"2023-07-21T22:38:25.080704+0000","last_clean":"2023-07-21T22:38:25.080704+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:38:25.080704+0000","last_undegraded":"2023-07-21T22:38:25.080704+0000","last_fullsized":"2023-07-21T22:38:25.080704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:05:33.127342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073529+0000","last_change":"2023-07-21T22:38:24.088196+0000","last_active":"2023-07-21T22:38:25.073529+0000","last_peered":"2023-07-21T22:38:25.073529+0000","last_clean":"2023-07-21T22:38:25.073529+0000","last_became_active":"2023-07-21T22:38:24.087917+0000","last_became_peered":"2023-07-21T22:38:24.087917+0000","last_unstale":"2023-07-21T22:38:25.073529+0000","last_undegraded":"2023-07-21T22:38:25.073529+0000","last_fullsized":"2023-07-21T22:38:25.073529+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:41:54.129514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"142'3","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788567+0000","last_change":"2023-07-21T22:38:23.073379+0000","last_active":"2023-07-21T22:38:25.788567+0000","last_peered":"2023-07-21T22:38:25.788567+0000","last_clean":"2023-07-21T22:38:25.788567+0000","last_became_active":"2023-07-21T22:38:23.073091+0000","last_became_peered":"2023-07-21T22:38:23.073091+0000","last_unstale":"2023-07-21T22:38:25.788567+0000","last_undegraded":"2023-07-21T22:38:25.788567+0000","last_fullsized":"2023-07-21T22:38:25.788567+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:09:17.217068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":244,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784850+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:38:25.784850+0000","last_peered":"2023-07-21T22:38:25.784850+0000","last_clean":"2023-07-21T22:38:25.784850+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:38:25.784850+0000","last_undegraded":"2023-07-21T22:38:25.784850+0000","last_fullsized":"2023-07-21T22:38:25.784850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:03:28.104938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788613+0000","last_change":"2023-07-21T22:38:24.092283+0000","last_active":"2023-07-21T22:38:25.788613+0000","last_peered":"2023-07-21T22:38:25.788613+0000","last_clean":"2023-07-21T22:38:25.788613+0000","last_became_active":"2023-07-21T22:38:24.091994+0000","last_became_peered":"2023-07-21T22:38:24.091994+0000","last_unstale":"2023-07-21T22:38:25.788613+0000","last_undegraded":"2023-07-21T22:38:25.788613+0000","last_fullsized":"2023-07-21T22:38:25.788613+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:19:52.933181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"142'6","reported_seq":19,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073387+0000","last_change":"2023-07-21T22:38:23.061980+0000","last_active":"2023-07-21T22:38:25.073387+0000","last_peered":"2023-07-21T22:38:25.073387+0000","last_clean":"2023-07-21T22:38:25.073387+0000","last_became_active":"2023-07-21T22:38:23.061558+0000","last_became_peered":"2023-07-21T22:38:23.061558+0000","last_unstale":"2023-07-21T22:38:25.073387+0000","last_undegraded":"2023-07-21T22:38:25.073387+0000","last_fullsized":"2023-07-21T22:38:25.073387+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:55:21.318261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":226,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788422+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:38:25.788422+0000","last_peered":"2023-07-21T22:38:25.788422+0000","last_clean":"2023-07-21T22:38:25.788422+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:38:25.788422+0000","last_undegraded":"2023-07-21T22:38:25.788422+0000","last_fullsized":"2023-07-21T22:38:25.788422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:44:27.443903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509676,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59608,"kb_used_data":2320,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312232,"statfs":{"total":96636764160,"available":96575725568,"internally_reserved":0,"allocated":2375680,"data_stored":1485683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69099999999999995,"15min":0.73199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35299999999999998},"max":{"1min":0.876,"5min":1.1180000000000001,"15min":3.5059999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66400000000000003,"15min":0.69399999999999995},"min":{"1min":0.46200000000000002,"5min":0.40899999999999997,"15min":0.39500000000000002},"max":{"1min":0.94199999999999995,"5min":0.94399999999999995,"15min":3.2709999999999999},"last":0.47899999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.70599999999999996,"15min":0.72799999999999998},"min":{"1min":0.49199999999999999,"5min":0.44900000000000001,"15min":0.432},"max":{"1min":0.98599999999999999,"5min":1.0680000000000001,"15min":1.5429999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.71299999999999997},"min":{"1min":0.44800000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96499999999999997,"5min":1.093,"15min":1.093},"last":0.72599999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70899999999999996,"15min":0.73599999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":1.1399999999999999,"15min":1.405},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73199999999999998,"15min":0.746},"min":{"1min":0.55100000000000005,"5min":0.47999999999999998,"15min":0.45800000000000002},"max":{"1min":0.92800000000000005,"5min":1.083,"15min":1.409},"last":0.68300000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75900000000000001,"15min":0.76500000000000001},"min":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0209999999999999,"5min":1.1539999999999999,"15min":1.46},"last":0.62},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.48599999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94899999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.69399999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55700000000000005,"15min":0.56200000000000006},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.67500000000000004,"5min":0.90000000000000002,"15min":0.94999999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82299999999999995,"5min":0.97399999999999998,"15min":1.7949999999999999},"last":0.57199999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.89700000000000002,"5min":0.98799999999999999,"15min":2.2120000000000002},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70199999999999996,"15min":0.68100000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.38300000000000001},"max":{"1min":0.95199999999999996,"5min":1.052,"15min":1.506},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.68100000000000005},"min":{"1min":0.53700000000000003,"5min":0.44900000000000001,"15min":0.41999999999999998},"max":{"1min":0.93500000000000005,"5min":1.0329999999999999,"15min":1.048},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.42699999999999999},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.53400000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542382,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36872,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334968,"statfs":{"total":96636764160,"available":96599007232,"internally_reserved":0,"allocated":1769472,"data_stored":895121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.755},"min":{"1min":0.47099999999999997,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.94399999999999995,"5min":1.016,"15min":1.016},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.437},"max":{"1min":0.96799999999999997,"5min":1.0289999999999999,"15min":1.1180000000000001},"last":0.59099999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.70099999999999996,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.49099999999999999,"15min":0.45300000000000001},"max":{"1min":0.872,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.45800000000000002,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.93300000000000005,"5min":0.99199999999999999,"15min":1.117},"last":0.71899999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71099999999999997,"15min":0.74199999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.42799999999999999},"max":{"1min":0.89600000000000002,"5min":0.98099999999999998,"15min":0.997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.78700000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.45500000000000002},"max":{"1min":0.98199999999999998,"5min":1.0149999999999999,"15min":1.097},"last":0.66800000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71999999999999997,"15min":0.748},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":1.048,"15min":1.048},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70499999999999996,"15min":0.72899999999999998},"min":{"1min":0.52300000000000002,"5min":0.49399999999999999,"15min":0.46899999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0049999999999999},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.93400000000000005,"15min":1.0229999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.39700000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.628}]},{"osd":5,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.749},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.054},"last":0.73499999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70299999999999996,"15min":0.68100000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.443},"max":{"1min":1.024,"5min":1.024,"15min":1.079},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.68700000000000006}]}]},{"osd":5,"up_from":15,"seq":64424509675,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50828,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321012,"statfs":{"total":96636764160,"available":96584716288,"internally_reserved":0,"allocated":1773568,"data_stored":894699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.70999999999999996},"min":{"1min":0.48099999999999998,"5min":0.38500000000000001,"15min":0.35699999999999998},"max":{"1min":0.96499999999999997,"5min":1,"15min":1.8779999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.97999999999999998,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.85299999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.68600000000000005,"15min":0.70299999999999996},"min":{"1min":0.505,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.95899999999999996,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69099999999999995,"15min":0.72099999999999997},"min":{"1min":0.42699999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.617},"last":0.752}]},{"osd":2,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71099999999999997,"15min":0.72699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.33600000000000002},"max":{"1min":1.008,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.42199999999999999,"15min":0.377},"max":{"1min":0.89300000000000002,"5min":1.073,"15min":1.512},"last":0.78500000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76900000000000002,"15min":0.77800000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":1.0009999999999999,"15min":1.472},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76000000000000001,"15min":0.78700000000000003},"min":{"1min":0.60099999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.997,"5min":1.022,"15min":1.556},"last":0.83399999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.372,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83699999999999997,"5min":0.88900000000000001,"15min":0.96999999999999997},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72399999999999998,"15min":0.69599999999999995},"min":{"1min":0.58899999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.92300000000000004,"5min":0.92400000000000004,"15min":1.038},"last":0.90000000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":0.95499999999999996,"15min":1.0049999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.40200000000000002,"15min":0.40000000000000002},"max":{"1min":0.76600000000000001,"5min":0.93799999999999994,"15min":1.02},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70099999999999996,"15min":0.65700000000000003},"min":{"1min":0.46200000000000002,"5min":0.40999999999999998,"15min":0.374},"max":{"1min":0.96699999999999997,"5min":1.042,"15min":1.042},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":0.73099999999999998},"min":{"1min":0.59799999999999998,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.88300000000000001,"5min":0.999,"15min":1.7390000000000001},"last":0.88}]}]},{"osd":4,"up_from":15,"seq":64424509676,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32784,"kb_used_data":1736,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339056,"statfs":{"total":96636764160,"available":96603193344,"internally_reserved":0,"allocated":1777664,"data_stored":896103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.70399999999999996,"15min":0.73599999999999999},"min":{"1min":0.46800000000000003,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.71399999999999997,"15min":0.73699999999999999},"min":{"1min":0.47999999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98499999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.52900000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.70199999999999996},"min":{"1min":0.46999999999999997,"5min":0.442,"15min":0.39400000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67600000000000005,"15min":0.69999999999999996},"min":{"1min":0.44400000000000001,"5min":0.43099999999999999,"15min":0.36899999999999999},"max":{"1min":0.90400000000000003,"5min":0.93000000000000005,"15min":1.016},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72799999999999998,"15min":0.755},"min":{"1min":0.55800000000000005,"5min":0.49099999999999999,"15min":0.371},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73799999999999999,"15min":0.76400000000000001},"min":{"1min":0.52400000000000002,"5min":0.47699999999999998,"15min":0.33000000000000002},"max":{"1min":1.018,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.40100000000000002},"max":{"1min":0.91000000000000003,"5min":0.97999999999999998,"15min":1.026},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75900000000000001,"15min":0.77900000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47999999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.66500000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60799999999999998,"15min":0.58499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34399999999999997},"max":{"1min":0.96199999999999997,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.60399999999999998,"15min":0.59499999999999997},"min":{"1min":0.44400000000000001,"5min":0.38800000000000001,"15min":0.32800000000000001},"max":{"1min":0.93600000000000005,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.70799999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.753},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.41599999999999998},"max":{"1min":1.0089999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.65200000000000002},"min":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.39200000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.0429999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.61699999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509675,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1740,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1781760,"data_stored":896137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46899999999999997,"15min":0.47499999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":0.77800000000000002,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.43099999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46200000000000002,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60299999999999998,"5min":0.754,"15min":0.83499999999999996},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.41999999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71899999999999997,"5min":0.82599999999999996,"15min":0.90100000000000002},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67600000000000005,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.59599999999999997},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.99199999999999999},"last":0.498}]},{"osd":4,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.755,"15min":0.77000000000000002},"min":{"1min":0.57599999999999996,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91200000000000003,"5min":1.093,"15min":1.1279999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.81399999999999995},"min":{"1min":0.54500000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.93200000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.89200000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.76900000000000002},"min":{"1min":0.54900000000000004,"5min":0.501,"15min":0.48999999999999999},"max":{"1min":0.97799999999999998,"5min":1.0669999999999999,"15min":1.137},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.51300000000000001,"15min":0.42899999999999999},"max":{"1min":0.86399999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76900000000000002,"15min":0.79000000000000004},"min":{"1min":0.51900000000000002,"5min":0.51700000000000002,"15min":0.47399999999999998},"max":{"1min":0.91700000000000004,"5min":1.0680000000000001,"15min":1.169},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91300000000000003,"5min":1.107,"15min":1.1120000000000001},"last":0.79700000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79200000000000004,"15min":0.81299999999999994},"min":{"1min":0.621,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94299999999999995,"5min":1.083,"15min":1.099},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80900000000000005,"15min":0.82799999999999996},"min":{"1min":0.61299999999999999,"5min":0.55200000000000005,"15min":0.48599999999999999},"max":{"1min":0.92200000000000004,"5min":1.623,"15min":1.623},"last":0.86599999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509677,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54916,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316924,"statfs":{"total":96636764160,"available":96580530176,"internally_reserved":0,"allocated":1765376,"data_stored":894539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.46400000000000002},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.23899999999999999},"max":{"1min":0.624,"5min":0.75,"15min":0.94199999999999995},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50600000000000001,"15min":0.54100000000000004},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.308},"max":{"1min":0.64200000000000002,"5min":0.88300000000000001,"15min":1.0409999999999999},"last":0.45900000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.40699999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72599999999999998,"5min":0.86699999999999999,"15min":0.93999999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.012,"15min":1.085},"last":0.505}]},{"osd":3,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46300000000000002,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.623,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.56399999999999995},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.85299999999999998,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.48599999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.46600000000000003,"15min":0.376},"max":{"1min":1.016,"5min":1.1579999999999999,"15min":1.3420000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73599999999999999,"15min":0.78500000000000003},"min":{"1min":0.48899999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.996,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.86099999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0780000000000001,"5min":1.214,"15min":1.214},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77700000000000002,"15min":0.80600000000000005},"min":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.46400000000000002},"max":{"1min":1.012,"5min":1.2689999999999999,"15min":1.3089999999999999},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.746,"15min":0.78300000000000003},"min":{"1min":0.52800000000000002,"5min":0.499,"15min":0.40300000000000002},"max":{"1min":0.94399999999999995,"5min":1.536,"15min":1.536},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.46200000000000002},"max":{"1min":1.0289999999999999,"5min":1.1339999999999999,"15min":1.2649999999999999},"last":0.84399999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77500000000000002,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.008,"5min":1.143,"15min":1.214},"last":0.879},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.751,"15min":0.79700000000000004},"min":{"1min":0.58899999999999997,"5min":0.50900000000000001,"15min":0.44700000000000001},"max":{"1min":0.91200000000000003,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.73599999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509676,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32776,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1769472,"data_stored":894561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.47499999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.22900000000000001},"max":{"1min":0.60399999999999998,"5min":0.78700000000000003,"15min":0.84599999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54100000000000004,"15min":0.55900000000000005},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.35099999999999998},"max":{"1min":0.80900000000000005,"5min":0.82499999999999996,"15min":0.872},"last":0.441}]},{"osd":2,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48999999999999999,"15min":0.502},"min":{"1min":0.36199999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"max":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":0.81000000000000005},"last":0.317},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.29099999999999998},"max":{"1min":0.71899999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.42299999999999999,"5min":0.378,"15min":0.33400000000000002},"max":{"1min":0.76100000000000001,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":0.77600000000000002,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.34699999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.432},"max":{"1min":1.115,"5min":1.294,"15min":1.294},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77800000000000002,"15min":0.79000000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.498},"max":{"1min":1.1220000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.95399999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.753,"15min":0.77200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.41899999999999998},"max":{"1min":1.0980000000000001,"5min":1.242,"15min":1.242},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.55700000000000005,"5min":0.51500000000000001,"15min":0.376},"max":{"1min":1.1639999999999999,"5min":1.276,"15min":1.2849999999999999},"last":0.93700000000000006}]},{"osd":6,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77700000000000002,"15min":0.80000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.47899999999999998},"max":{"1min":1.0800000000000001,"5min":1.208,"15min":1.23},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.78100000000000003},"min":{"1min":0.56100000000000005,"5min":0.50900000000000001,"15min":0.46500000000000002},"max":{"1min":1.0109999999999999,"5min":1.244,"15min":1.3240000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78500000000000003,"15min":0.80400000000000005},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.49199999999999999},"max":{"1min":1.089,"5min":1.3120000000000001,"15min":1.3149999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.45700000000000002},"max":{"1min":1.0289999999999999,"5min":1.1819999999999999,"15min":1.3380000000000001},"last":0.79000000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509678,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37452,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334388,"statfs":{"total":96636764160,"available":96598413312,"internally_reserved":0,"allocated":2363392,"data_stored":1484929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.33200000000000002,"5min":0.28399999999999997,"15min":0.26600000000000001},"max":{"1min":0.66300000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.375},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50900000000000001,"15min":0.51600000000000001},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.70599999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58599999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.41599999999999998,"5min":0.32400000000000001,"15min":0.29799999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.3680000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.49099999999999999,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.871},"last":0.42899999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.432,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81899999999999995,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.33700000000000002},"max":{"1min":0.83599999999999997,"5min":0.88600000000000001,"15min":1.038},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.81000000000000005,"15min":0.78400000000000003},"min":{"1min":0.56899999999999995,"5min":0.499,"15min":0.45200000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.80500000000000005,"15min":0.80000000000000004},"min":{"1min":0.57899999999999996,"5min":0.505,"15min":0.44600000000000001},"max":{"1min":1.206,"5min":1.278,"15min":1.423},"last":0.80800000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.59599999999999997,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.0089999999999999,"5min":1.0960000000000001,"15min":1.2669999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80500000000000005,"15min":0.80300000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.39600000000000002},"max":{"1min":1.119,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.61299999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.48899999999999999},"max":{"1min":1.2210000000000001,"5min":1.27,"15min":1.27},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.65500000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80700000000000005,"15min":0.79500000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.53100000000000003},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80200000000000005,"15min":0.82199999999999995},"min":{"1min":0.58999999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1479999999999999,"5min":1.1930000000000001,"15min":1.296},"last":0.75700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:38:32.813 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:38:32.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.924+0000 7f04ad737640 1 Processor -- start 2023-07-21T22:38:32.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.924+0000 7f04ad737640 1 -- start start 2023-07-21T22:38:32.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.924+0000 7f04ad737640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f04a815fd60 0x7f04a80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:32.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.924+0000 7f04ad737640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a80ccaf0 con 0x7f04a80d1850 2023-07-21T22:38:32.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.924+0000 7f04ad737640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a8160320 con 0x7f04a80b7c70 2023-07-21T22:38:32.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.924+0000 7f04ad737640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a80d1190 con 0x7f04a815fd60 2023-07-21T22:38:32.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.924+0000 7f04a77fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f04a80d1850 0x7f04a80d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52604/0 (socket says 172.21.15.6:52604) 2023-07-21T22:38:32.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.924+0000 7f04a77fe640 1 -- 172.21.15.6:0/3143469930 learned_addr learned my addr 172.21.15.6:0/3143469930 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:32.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.924+0000 7f049e7fc640 1 --2- 172.21.15.6:0/3143469930 >> v2:172.21.15.161:3300/0 conn(0x7f04a815fd60 0x7f04a80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:32.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.924+0000 7f04a67fc640 1 -- 172.21.15.6:0/3143469930 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794130063 0 0) 0x7f04a80ccaf0 con 0x7f04a80d1850 2023-07-21T22:38:32.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.924+0000 7f04a67fc640 1 -- 172.21.15.6:0/3143469930 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0494003530 con 0x7f04a80d1850 2023-07-21T22:38:32.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.924+0000 7f04a67fc640 1 -- 172.21.15.6:0/3143469930 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 490037439 0 0) 0x7f04a8160320 con 0x7f04a80b7c70 2023-07-21T22:38:32.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.924+0000 7f04a67fc640 1 -- 172.21.15.6:0/3143469930 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04a80ccaf0 con 0x7f04a80b7c70 2023-07-21T22:38:32.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.924+0000 7f049e7fc640 1 -- 172.21.15.6:0/3143469930 >> v1:172.21.15.161:6789/0 conn(0x7f04a80b7c70 legacy=0x7f04a815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:32.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.924+0000 7f049e7fc640 1 -- 172.21.15.6:0/3143469930 >> v1:172.21.15.6:6789/0 conn(0x7f04a80d1850 legacy=0x7f04a80d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:32.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.924+0000 7f049e7fc640 1 -- 172.21.15.6:0/3143469930 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a80ccd90 con 0x7f04a815fd60 2023-07-21T22:38:32.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.928+0000 7f049e7fc640 1 --2- 172.21.15.6:0/3143469930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04a815fd60 0x7f04a80d0c50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f04980097c0 tx=0x7f049801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a207d10ad653cf6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:32.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.928+0000 7f04a67fc640 1 -- 172.21.15.6:0/3143469930 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04980a8050 con 0x7f04a815fd60 2023-07-21T22:38:32.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.928+0000 7f04a67fc640 1 -- 172.21.15.6:0/3143469930 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04980ac5f0 con 0x7f04a815fd60 2023-07-21T22:38:32.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.928+0000 7f04a67fc640 1 -- 172.21.15.6:0/3143469930 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04980ac980 con 0x7f04a815fd60 2023-07-21T22:38:32.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.928+0000 7f04ad737640 1 -- 172.21.15.6:0/3143469930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04a815fd60 msgr2=0x7f04a80d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:32.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.928+0000 7f04ad737640 1 --2- 172.21.15.6:0/3143469930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04a815fd60 0x7f04a80d0c50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f04980097c0 tx=0x7f049801c480 comp rx=0 tx=0).stop 2023-07-21T22:38:32.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.928+0000 7f04ad737640 1 -- 172.21.15.6:0/3143469930 shutdown_connections 2023-07-21T22:38:32.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.928+0000 7f04ad737640 1 --2- 172.21.15.6:0/3143469930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04a815fd60 0x7f04a80d0c50 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:32.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.928+0000 7f04ad737640 1 -- 172.21.15.6:0/3143469930 >> 172.21.15.6:0/3143469930 conn(0x7f04a80650b0 msgr2=0x7f04a80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:32.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.928+0000 7f04ad737640 1 -- 172.21.15.6:0/3143469930 shutdown_connections 2023-07-21T22:38:32.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.928+0000 7f04ad737640 1 -- 172.21.15.6:0/3143469930 wait complete. 2023-07-21T22:38:32.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f04ad737640 1 Processor -- start 2023-07-21T22:38:32.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f04ad737640 1 -- start start 2023-07-21T22:38:32.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f04ad737640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04a80b7c70 0x7f04a8148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:32.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f04ad737640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04a80d1850 0x7f04a80c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:32.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f04ad737640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04a815fd60 0x7f04a80c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:32.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f04ad737640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a814a080 con 0x7f04a815fd60 2023-07-21T22:38:32.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f04ad737640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a8149210 con 0x7f04a80d1850 2023-07-21T22:38:32.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f04ad737640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a8149470 con 0x7f04a80b7c70 2023-07-21T22:38:32.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f04a77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04a815fd60 0x7f04a80c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f04a77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04a815fd60 0x7f04a80c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45518/0 (socket says 172.21.15.6:45518) 2023-07-21T22:38:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f04a77fe640 1 -- 172.21.15.6:0/3628332624 learned_addr learned my addr 172.21.15.6:0/3628332624 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f049e7fc640 1 --2- 172.21.15.6:0/3628332624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04a80d1850 0x7f04a80c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f04a6ffd640 1 --2- 172.21.15.6:0/3628332624 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04a80b7c70 0x7f04a8148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f04a77fe640 1 -- 172.21.15.6:0/3628332624 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04a80b7c70 msgr2=0x7f04a8148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f04a77fe640 1 --2- 172.21.15.6:0/3628332624 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04a80b7c70 0x7f04a8148cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:32.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f04a77fe640 1 -- 172.21.15.6:0/3628332624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04a80d1850 msgr2=0x7f04a80c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:32.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f04a77fe640 1 --2- 172.21.15.6:0/3628332624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04a80d1850 0x7f04a80c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:32.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f04a77fe640 1 -- 172.21.15.6:0/3628332624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0498009420 con 0x7f04a815fd60 2023-07-21T22:38:32.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f04a77fe640 1 --2- 172.21.15.6:0/3628332624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04a815fd60 0x7f04a80c53a0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f04a000caa0 tx=0x7f04a000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:32.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f049ffff640 1 -- 172.21.15.6:0/3628332624 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a000ac00 con 0x7f04a815fd60 2023-07-21T22:38:32.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f049ffff640 1 -- 172.21.15.6:0/3628332624 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a000ad80 con 0x7f04a815fd60 2023-07-21T22:38:32.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f049ffff640 1 -- 172.21.15.6:0/3628332624 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0012640 con 0x7f04a815fd60 2023-07-21T22:38:32.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.932+0000 7f04ad737640 1 -- 172.21.15.6:0/3628332624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a8149750 con 0x7f04a815fd60 2023-07-21T22:38:32.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.936+0000 7f04ad737640 1 -- 172.21.15.6:0/3628332624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a8149d10 con 0x7f04a815fd60 2023-07-21T22:38:32.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.936+0000 7f04ad737640 1 -- 172.21.15.6:0/3628332624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a80678d0 con 0x7f04a815fd60 2023-07-21T22:38:32.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.936+0000 7f049ffff640 1 -- 172.21.15.6:0/3628332624 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f04a0007070 con 0x7f04a815fd60 2023-07-21T22:38:32.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.936+0000 7f049ffff640 1 --2- 172.21.15.6:0/3628332624 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f04880663a0 0x7f0488068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:32.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.936+0000 7f049ffff640 1 -- 172.21.15.6:0/3628332624 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f04a0083dd0 con 0x7f04a815fd60 2023-07-21T22:38:32.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.936+0000 7f04a6ffd640 1 --2- 172.21.15.6:0/3628332624 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f04880663a0 0x7f0488068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:32.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.940+0000 7f04a6ffd640 1 --2- 172.21.15.6:0/3628332624 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f04880663a0 0x7f0488068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f04900011f0 tx=0x7f0490009040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:32.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:32.940+0000 7f049ffff640 1 -- 172.21.15.6:0/3628332624 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f04a00511a0 con 0x7f04a815fd60 2023-07-21T22:38:33.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.092+0000 7f04ad737640 1 -- 172.21.15.6:0/3628332624 --> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04a80b4280 con 0x7f04880663a0 2023-07-21T22:38:33.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.100+0000 7f049ffff640 1 -- 172.21.15.6:0/3628332624 <== mgr.7307 v2:172.21.15.161:6832/3436422767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311661 (secure 0 0 0) 0x7f04a80b4280 con 0x7f04880663a0 2023-07-21T22:38:33.149 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:33.151 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:38:33.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.104+0000 7f04ad737640 1 -- 172.21.15.6:0/3628332624 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f04880663a0 msgr2=0x7f0488068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:33.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.104+0000 7f04ad737640 1 --2- 172.21.15.6:0/3628332624 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f04880663a0 0x7f0488068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f04900011f0 tx=0x7f0490009040 comp rx=0 tx=0).stop 2023-07-21T22:38:33.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.104+0000 7f04ad737640 1 -- 172.21.15.6:0/3628332624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04a815fd60 msgr2=0x7f04a80c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:33.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.104+0000 7f04ad737640 1 --2- 172.21.15.6:0/3628332624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04a815fd60 0x7f04a80c53a0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f04a000caa0 tx=0x7f04a000cf60 comp rx=0 tx=0).stop 2023-07-21T22:38:33.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.104+0000 7f04ad737640 1 -- 172.21.15.6:0/3628332624 shutdown_connections 2023-07-21T22:38:33.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.104+0000 7f04ad737640 1 --2- 172.21.15.6:0/3628332624 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f04880663a0 0x7f0488068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.104+0000 7f04ad737640 1 --2- 172.21.15.6:0/3628332624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04a815fd60 0x7f04a80c53a0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.104+0000 7f04ad737640 1 --2- 172.21.15.6:0/3628332624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04a80d1850 0x7f04a80c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.104+0000 7f04ad737640 1 --2- 172.21.15.6:0/3628332624 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04a80b7c70 0x7f04a8148cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.104+0000 7f04ad737640 1 -- 172.21.15.6:0/3628332624 >> 172.21.15.6:0/3628332624 conn(0x7f04a80650b0 msgr2=0x7f04a8157050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:33.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.104+0000 7f04ad737640 1 -- 172.21.15.6:0/3628332624 shutdown_connections 2023-07-21T22:38:33.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.104+0000 7f04ad737640 1 -- 172.21.15.6:0/3628332624 wait complete. 2023-07-21T22:38:33.170 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-21T22:38:31.721373+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":444,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":288,"ondisk_log_size":288,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":338024,"kb_used_data":15016,"kb_used_omap":0,"kb_used_meta":322944,"kb_avail":754636696,"statfs":{"total":773094113280,"available":772747976704,"internally_reserved":0,"allocated":15376384,"data_stored":8341772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":330694656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002349"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079644+0000","last_change":"2023-07-21T22:38:24.096350+0000","last_active":"2023-07-21T22:38:25.079644+0000","last_peered":"2023-07-21T22:38:25.079644+0000","last_clean":"2023-07-21T22:38:25.079644+0000","last_became_active":"2023-07-21T22:38:24.096072+0000","last_became_peered":"2023-07-21T22:38:24.096072+0000","last_unstale":"2023-07-21T22:38:25.079644+0000","last_undegraded":"2023-07-21T22:38:25.079644+0000","last_fullsized":"2023-07-21T22:38:25.079644+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:44:05.919088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073391+0000","last_change":"2023-07-21T22:38:24.084689+0000","last_active":"2023-07-21T22:38:25.073391+0000","last_peered":"2023-07-21T22:38:25.073391+0000","last_clean":"2023-07-21T22:38:25.073391+0000","last_became_active":"2023-07-21T22:38:24.082810+0000","last_became_peered":"2023-07-21T22:38:24.082810+0000","last_unstale":"2023-07-21T22:38:25.073391+0000","last_undegraded":"2023-07-21T22:38:25.073391+0000","last_fullsized":"2023-07-21T22:38:25.073391+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:06:59.940295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073553+0000","last_change":"2023-07-21T22:38:24.088354+0000","last_active":"2023-07-21T22:38:25.073553+0000","last_peered":"2023-07-21T22:38:25.073553+0000","last_clean":"2023-07-21T22:38:25.073553+0000","last_became_active":"2023-07-21T22:38:24.088066+0000","last_became_peered":"2023-07-21T22:38:24.088066+0000","last_unstale":"2023-07-21T22:38:25.073553+0000","last_undegraded":"2023-07-21T22:38:25.073553+0000","last_fullsized":"2023-07-21T22:38:25.073553+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:00:37.444848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080296+0000","last_change":"2023-07-21T22:38:24.094649+0000","last_active":"2023-07-21T22:38:25.080296+0000","last_peered":"2023-07-21T22:38:25.080296+0000","last_clean":"2023-07-21T22:38:25.080296+0000","last_became_active":"2023-07-21T22:38:24.093864+0000","last_became_peered":"2023-07-21T22:38:24.093864+0000","last_unstale":"2023-07-21T22:38:25.080296+0000","last_undegraded":"2023-07-21T22:38:25.080296+0000","last_fullsized":"2023-07-21T22:38:25.080296+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:19:45.271552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079355+0000","last_change":"2023-07-21T22:38:24.103284+0000","last_active":"2023-07-21T22:38:25.079355+0000","last_peered":"2023-07-21T22:38:25.079355+0000","last_clean":"2023-07-21T22:38:25.079355+0000","last_became_active":"2023-07-21T22:38:24.102962+0000","last_became_peered":"2023-07-21T22:38:24.102962+0000","last_unstale":"2023-07-21T22:38:25.079355+0000","last_undegraded":"2023-07-21T22:38:25.079355+0000","last_fullsized":"2023-07-21T22:38:25.079355+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:45:02.252698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.783767+0000","last_change":"2023-07-21T22:38:24.091508+0000","last_active":"2023-07-21T22:38:25.783767+0000","last_peered":"2023-07-21T22:38:25.783767+0000","last_clean":"2023-07-21T22:38:25.783767+0000","last_became_active":"2023-07-21T22:38:24.091215+0000","last_became_peered":"2023-07-21T22:38:24.091215+0000","last_unstale":"2023-07-21T22:38:25.783767+0000","last_undegraded":"2023-07-21T22:38:25.783767+0000","last_fullsized":"2023-07-21T22:38:25.783767+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:00:51.383736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.783987+0000","last_change":"2023-07-21T22:38:24.099935+0000","last_active":"2023-07-21T22:38:25.783987+0000","last_peered":"2023-07-21T22:38:25.783987+0000","last_clean":"2023-07-21T22:38:25.783987+0000","last_became_active":"2023-07-21T22:38:24.099652+0000","last_became_peered":"2023-07-21T22:38:24.099652+0000","last_unstale":"2023-07-21T22:38:25.783987+0000","last_undegraded":"2023-07-21T22:38:25.783987+0000","last_fullsized":"2023-07-21T22:38:25.783987+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:10:36.870471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073003+0000","last_change":"2023-07-21T22:38:24.088305+0000","last_active":"2023-07-21T22:38:25.073003+0000","last_peered":"2023-07-21T22:38:25.073003+0000","last_clean":"2023-07-21T22:38:25.073003+0000","last_became_active":"2023-07-21T22:38:24.087755+0000","last_became_peered":"2023-07-21T22:38:24.087755+0000","last_unstale":"2023-07-21T22:38:25.073003+0000","last_undegraded":"2023-07-21T22:38:25.073003+0000","last_fullsized":"2023-07-21T22:38:25.073003+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:32:21.804074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080780+0000","last_change":"2023-07-21T22:38:24.098033+0000","last_active":"2023-07-21T22:38:25.080780+0000","last_peered":"2023-07-21T22:38:25.080780+0000","last_clean":"2023-07-21T22:38:25.080780+0000","last_became_active":"2023-07-21T22:38:24.097753+0000","last_became_peered":"2023-07-21T22:38:24.097753+0000","last_unstale":"2023-07-21T22:38:25.080780+0000","last_undegraded":"2023-07-21T22:38:25.080780+0000","last_fullsized":"2023-07-21T22:38:25.080780+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:45:05.966828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784547+0000","last_change":"2023-07-21T22:38:24.093863+0000","last_active":"2023-07-21T22:38:25.784547+0000","last_peered":"2023-07-21T22:38:25.784547+0000","last_clean":"2023-07-21T22:38:25.784547+0000","last_became_active":"2023-07-21T22:38:24.093467+0000","last_became_peered":"2023-07-21T22:38:24.093467+0000","last_unstale":"2023-07-21T22:38:25.784547+0000","last_undegraded":"2023-07-21T22:38:25.784547+0000","last_fullsized":"2023-07-21T22:38:25.784547+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:58:53.544658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080090+0000","last_change":"2023-07-21T22:38:24.105913+0000","last_active":"2023-07-21T22:38:25.080090+0000","last_peered":"2023-07-21T22:38:25.080090+0000","last_clean":"2023-07-21T22:38:25.080090+0000","last_became_active":"2023-07-21T22:38:24.105642+0000","last_became_peered":"2023-07-21T22:38:24.105642+0000","last_unstale":"2023-07-21T22:38:25.080090+0000","last_undegraded":"2023-07-21T22:38:25.080090+0000","last_fullsized":"2023-07-21T22:38:25.080090+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:10:49.261747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785375+0000","last_change":"2023-07-21T22:38:24.094545+0000","last_active":"2023-07-21T22:38:25.785375+0000","last_peered":"2023-07-21T22:38:25.785375+0000","last_clean":"2023-07-21T22:38:25.785375+0000","last_became_active":"2023-07-21T22:38:24.094167+0000","last_became_peered":"2023-07-21T22:38:24.094167+0000","last_unstale":"2023-07-21T22:38:25.785375+0000","last_undegraded":"2023-07-21T22:38:25.785375+0000","last_fullsized":"2023-07-21T22:38:25.785375+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:09:49.797201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784920+0000","last_change":"2023-07-21T22:38:24.089366+0000","last_active":"2023-07-21T22:38:25.784920+0000","last_peered":"2023-07-21T22:38:25.784920+0000","last_clean":"2023-07-21T22:38:25.784920+0000","last_became_active":"2023-07-21T22:38:24.089037+0000","last_became_peered":"2023-07-21T22:38:24.089037+0000","last_unstale":"2023-07-21T22:38:25.784920+0000","last_undegraded":"2023-07-21T22:38:25.784920+0000","last_fullsized":"2023-07-21T22:38:25.784920+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:14:05.326581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073593+0000","last_change":"2023-07-21T22:38:24.089862+0000","last_active":"2023-07-21T22:38:25.073593+0000","last_peered":"2023-07-21T22:38:25.073593+0000","last_clean":"2023-07-21T22:38:25.073593+0000","last_became_active":"2023-07-21T22:38:24.089305+0000","last_became_peered":"2023-07-21T22:38:24.089305+0000","last_unstale":"2023-07-21T22:38:25.073593+0000","last_undegraded":"2023-07-21T22:38:25.073593+0000","last_fullsized":"2023-07-21T22:38:25.073593+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:57:17.921295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079678+0000","last_change":"2023-07-21T22:38:24.105772+0000","last_active":"2023-07-21T22:38:25.079678+0000","last_peered":"2023-07-21T22:38:25.079678+0000","last_clean":"2023-07-21T22:38:25.079678+0000","last_became_active":"2023-07-21T22:38:24.105477+0000","last_became_peered":"2023-07-21T22:38:24.105477+0000","last_unstale":"2023-07-21T22:38:25.079678+0000","last_undegraded":"2023-07-21T22:38:25.079678+0000","last_fullsized":"2023-07-21T22:38:25.079678+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:22:57.428549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.783850+0000","last_change":"2023-07-21T22:38:24.090736+0000","last_active":"2023-07-21T22:38:25.783850+0000","last_peered":"2023-07-21T22:38:25.783850+0000","last_clean":"2023-07-21T22:38:25.783850+0000","last_became_active":"2023-07-21T22:38:24.090456+0000","last_became_peered":"2023-07-21T22:38:24.090456+0000","last_unstale":"2023-07-21T22:38:25.783850+0000","last_undegraded":"2023-07-21T22:38:25.783850+0000","last_fullsized":"2023-07-21T22:38:25.783850+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:09:59.319285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785339+0000","last_change":"2023-07-21T22:38:24.091010+0000","last_active":"2023-07-21T22:38:25.785339+0000","last_peered":"2023-07-21T22:38:25.785339+0000","last_clean":"2023-07-21T22:38:25.785339+0000","last_became_active":"2023-07-21T22:38:24.090660+0000","last_became_peered":"2023-07-21T22:38:24.090660+0000","last_unstale":"2023-07-21T22:38:25.785339+0000","last_undegraded":"2023-07-21T22:38:25.785339+0000","last_fullsized":"2023-07-21T22:38:25.785339+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:22:37.120539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073427+0000","last_change":"2023-07-21T22:38:24.082310+0000","last_active":"2023-07-21T22:38:25.073427+0000","last_peered":"2023-07-21T22:38:25.073427+0000","last_clean":"2023-07-21T22:38:25.073427+0000","last_became_active":"2023-07-21T22:38:24.082015+0000","last_became_peered":"2023-07-21T22:38:24.082015+0000","last_unstale":"2023-07-21T22:38:25.073427+0000","last_undegraded":"2023-07-21T22:38:25.073427+0000","last_fullsized":"2023-07-21T22:38:25.073427+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:50:15.223031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788018+0000","last_change":"2023-07-21T22:38:24.093822+0000","last_active":"2023-07-21T22:38:25.788018+0000","last_peered":"2023-07-21T22:38:25.788018+0000","last_clean":"2023-07-21T22:38:25.788018+0000","last_became_active":"2023-07-21T22:38:24.093524+0000","last_became_peered":"2023-07-21T22:38:24.093524+0000","last_unstale":"2023-07-21T22:38:25.788018+0000","last_undegraded":"2023-07-21T22:38:25.788018+0000","last_fullsized":"2023-07-21T22:38:25.788018+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:41:54.129514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.783790+0000","last_change":"2023-07-21T22:38:24.096844+0000","last_active":"2023-07-21T22:38:25.783790+0000","last_peered":"2023-07-21T22:38:25.783790+0000","last_clean":"2023-07-21T22:38:25.783790+0000","last_became_active":"2023-07-21T22:38:24.096494+0000","last_became_peered":"2023-07-21T22:38:24.096494+0000","last_unstale":"2023-07-21T22:38:25.783790+0000","last_undegraded":"2023-07-21T22:38:25.783790+0000","last_fullsized":"2023-07-21T22:38:25.783790+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:44:13.900174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080412+0000","last_change":"2023-07-21T22:38:24.095885+0000","last_active":"2023-07-21T22:38:25.080412+0000","last_peered":"2023-07-21T22:38:25.080412+0000","last_clean":"2023-07-21T22:38:25.080412+0000","last_became_active":"2023-07-21T22:38:24.095585+0000","last_became_peered":"2023-07-21T22:38:24.095585+0000","last_unstale":"2023-07-21T22:38:25.080412+0000","last_undegraded":"2023-07-21T22:38:25.080412+0000","last_fullsized":"2023-07-21T22:38:25.080412+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:15:40.694148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079919+0000","last_change":"2023-07-21T22:38:24.101925+0000","last_active":"2023-07-21T22:38:25.079919+0000","last_peered":"2023-07-21T22:38:25.079919+0000","last_clean":"2023-07-21T22:38:25.079919+0000","last_became_active":"2023-07-21T22:38:24.100737+0000","last_became_peered":"2023-07-21T22:38:24.100737+0000","last_unstale":"2023-07-21T22:38:25.079919+0000","last_undegraded":"2023-07-21T22:38:25.079919+0000","last_fullsized":"2023-07-21T22:38:25.079919+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:24:47.062349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079566+0000","last_change":"2023-07-21T22:38:24.098134+0000","last_active":"2023-07-21T22:38:25.079566+0000","last_peered":"2023-07-21T22:38:25.079566+0000","last_clean":"2023-07-21T22:38:25.079566+0000","last_became_active":"2023-07-21T22:38:24.097821+0000","last_became_peered":"2023-07-21T22:38:24.097821+0000","last_unstale":"2023-07-21T22:38:25.079566+0000","last_undegraded":"2023-07-21T22:38:25.079566+0000","last_fullsized":"2023-07-21T22:38:25.079566+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:36:48.023274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.787467+0000","last_change":"2023-07-21T22:38:24.099713+0000","last_active":"2023-07-21T22:38:25.787467+0000","last_peered":"2023-07-21T22:38:25.787467+0000","last_clean":"2023-07-21T22:38:25.787467+0000","last_became_active":"2023-07-21T22:38:24.099433+0000","last_became_peered":"2023-07-21T22:38:24.099433+0000","last_unstale":"2023-07-21T22:38:25.787467+0000","last_undegraded":"2023-07-21T22:38:25.787467+0000","last_fullsized":"2023-07-21T22:38:25.787467+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:29:36.424186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788534+0000","last_change":"2023-07-21T22:38:24.105911+0000","last_active":"2023-07-21T22:38:25.788534+0000","last_peered":"2023-07-21T22:38:25.788534+0000","last_clean":"2023-07-21T22:38:25.788534+0000","last_became_active":"2023-07-21T22:38:24.105270+0000","last_became_peered":"2023-07-21T22:38:24.105270+0000","last_unstale":"2023-07-21T22:38:25.788534+0000","last_undegraded":"2023-07-21T22:38:25.788534+0000","last_fullsized":"2023-07-21T22:38:25.788534+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:50:30.121903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784235+0000","last_change":"2023-07-21T22:38:24.079532+0000","last_active":"2023-07-21T22:38:25.784235+0000","last_peered":"2023-07-21T22:38:25.784235+0000","last_clean":"2023-07-21T22:38:25.784235+0000","last_became_active":"2023-07-21T22:38:24.079247+0000","last_became_peered":"2023-07-21T22:38:24.079247+0000","last_unstale":"2023-07-21T22:38:25.784235+0000","last_undegraded":"2023-07-21T22:38:25.784235+0000","last_fullsized":"2023-07-21T22:38:25.784235+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:56:47.427890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788384+0000","last_change":"2023-07-21T22:38:24.093844+0000","last_active":"2023-07-21T22:38:25.788384+0000","last_peered":"2023-07-21T22:38:25.788384+0000","last_clean":"2023-07-21T22:38:25.788384+0000","last_became_active":"2023-07-21T22:38:24.093518+0000","last_became_peered":"2023-07-21T22:38:24.093518+0000","last_unstale":"2023-07-21T22:38:25.788384+0000","last_undegraded":"2023-07-21T22:38:25.788384+0000","last_fullsized":"2023-07-21T22:38:25.788384+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:31:41.282905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784430+0000","last_change":"2023-07-21T22:38:24.095141+0000","last_active":"2023-07-21T22:38:25.784430+0000","last_peered":"2023-07-21T22:38:25.784430+0000","last_clean":"2023-07-21T22:38:25.784430+0000","last_became_active":"2023-07-21T22:38:24.094847+0000","last_became_peered":"2023-07-21T22:38:24.094847+0000","last_unstale":"2023-07-21T22:38:25.784430+0000","last_undegraded":"2023-07-21T22:38:25.784430+0000","last_fullsized":"2023-07-21T22:38:25.784430+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:47:44.613426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784585+0000","last_change":"2023-07-21T22:38:24.078266+0000","last_active":"2023-07-21T22:38:25.784585+0000","last_peered":"2023-07-21T22:38:25.784585+0000","last_clean":"2023-07-21T22:38:25.784585+0000","last_became_active":"2023-07-21T22:38:24.077952+0000","last_became_peered":"2023-07-21T22:38:24.077952+0000","last_unstale":"2023-07-21T22:38:25.784585+0000","last_undegraded":"2023-07-21T22:38:25.784585+0000","last_fullsized":"2023-07-21T22:38:25.784585+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:45:14.726844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073636+0000","last_change":"2023-07-21T22:38:24.095973+0000","last_active":"2023-07-21T22:38:25.073636+0000","last_peered":"2023-07-21T22:38:25.073636+0000","last_clean":"2023-07-21T22:38:25.073636+0000","last_became_active":"2023-07-21T22:38:24.095711+0000","last_became_peered":"2023-07-21T22:38:24.095711+0000","last_unstale":"2023-07-21T22:38:25.073636+0000","last_undegraded":"2023-07-21T22:38:25.073636+0000","last_fullsized":"2023-07-21T22:38:25.073636+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:19:05.311752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.787604+0000","last_change":"2023-07-21T22:38:24.101366+0000","last_active":"2023-07-21T22:38:25.787604+0000","last_peered":"2023-07-21T22:38:25.787604+0000","last_clean":"2023-07-21T22:38:25.787604+0000","last_became_active":"2023-07-21T22:38:24.100793+0000","last_became_peered":"2023-07-21T22:38:24.100793+0000","last_unstale":"2023-07-21T22:38:25.787604+0000","last_undegraded":"2023-07-21T22:38:25.787604+0000","last_fullsized":"2023-07-21T22:38:25.787604+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:36:09.625577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.787467+0000","last_change":"2023-07-21T22:38:24.105147+0000","last_active":"2023-07-21T22:38:25.787467+0000","last_peered":"2023-07-21T22:38:25.787467+0000","last_clean":"2023-07-21T22:38:25.787467+0000","last_became_active":"2023-07-21T22:38:24.104856+0000","last_became_peered":"2023-07-21T22:38:24.104856+0000","last_unstale":"2023-07-21T22:38:25.787467+0000","last_undegraded":"2023-07-21T22:38:25.787467+0000","last_fullsized":"2023-07-21T22:38:25.787467+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:21:04.720457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785178+0000","last_change":"2023-07-21T22:38:24.095035+0000","last_active":"2023-07-21T22:38:25.785178+0000","last_peered":"2023-07-21T22:38:25.785178+0000","last_clean":"2023-07-21T22:38:25.785178+0000","last_became_active":"2023-07-21T22:38:24.094748+0000","last_became_peered":"2023-07-21T22:38:24.094748+0000","last_unstale":"2023-07-21T22:38:25.785178+0000","last_undegraded":"2023-07-21T22:38:25.785178+0000","last_fullsized":"2023-07-21T22:38:25.785178+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:06.886930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"142'4","reported_seq":17,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788160+0000","last_change":"2023-07-21T22:38:23.071766+0000","last_active":"2023-07-21T22:38:25.788160+0000","last_peered":"2023-07-21T22:38:25.788160+0000","last_clean":"2023-07-21T22:38:25.788160+0000","last_became_active":"2023-07-21T22:38:23.071479+0000","last_became_peered":"2023-07-21T22:38:23.071479+0000","last_unstale":"2023-07-21T22:38:25.788160+0000","last_undegraded":"2023-07-21T22:38:25.788160+0000","last_fullsized":"2023-07-21T22:38:25.788160+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:00:36.438322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785004+0000","last_change":"2023-07-21T22:38:24.090603+0000","last_active":"2023-07-21T22:38:25.785004+0000","last_peered":"2023-07-21T22:38:25.785004+0000","last_clean":"2023-07-21T22:38:25.785004+0000","last_became_active":"2023-07-21T22:38:24.090316+0000","last_became_peered":"2023-07-21T22:38:24.090316+0000","last_unstale":"2023-07-21T22:38:25.785004+0000","last_undegraded":"2023-07-21T22:38:25.785004+0000","last_fullsized":"2023-07-21T22:38:25.785004+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:09:00.941490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"142'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784717+0000","last_change":"2023-07-21T22:38:23.061581+0000","last_active":"2023-07-21T22:38:25.784717+0000","last_peered":"2023-07-21T22:38:25.784717+0000","last_clean":"2023-07-21T22:38:25.784717+0000","last_became_active":"2023-07-21T22:38:23.061317+0000","last_became_peered":"2023-07-21T22:38:23.061317+0000","last_unstale":"2023-07-21T22:38:25.784717+0000","last_undegraded":"2023-07-21T22:38:25.784717+0000","last_fullsized":"2023-07-21T22:38:25.784717+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:27:32.965649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788163+0000","last_change":"2023-07-21T22:38:24.104599+0000","last_active":"2023-07-21T22:38:25.788163+0000","last_peered":"2023-07-21T22:38:25.788163+0000","last_clean":"2023-07-21T22:38:25.788163+0000","last_became_active":"2023-07-21T22:38:24.104266+0000","last_became_peered":"2023-07-21T22:38:24.104266+0000","last_unstale":"2023-07-21T22:38:25.788163+0000","last_undegraded":"2023-07-21T22:38:25.788163+0000","last_fullsized":"2023-07-21T22:38:25.788163+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:04:17.202257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080545+0000","last_change":"2023-07-21T22:38:23.076553+0000","last_active":"2023-07-21T22:38:25.080545+0000","last_peered":"2023-07-21T22:38:25.080545+0000","last_clean":"2023-07-21T22:38:25.080545+0000","last_became_active":"2023-07-21T22:38:23.076250+0000","last_became_peered":"2023-07-21T22:38:23.076250+0000","last_unstale":"2023-07-21T22:38:25.080545+0000","last_undegraded":"2023-07-21T22:38:25.080545+0000","last_fullsized":"2023-07-21T22:38:25.080545+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:27:28.390501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080872+0000","last_change":"2023-07-21T22:38:24.096824+0000","last_active":"2023-07-21T22:38:25.080872+0000","last_peered":"2023-07-21T22:38:25.080872+0000","last_clean":"2023-07-21T22:38:25.080872+0000","last_became_active":"2023-07-21T22:38:24.096034+0000","last_became_peered":"2023-07-21T22:38:24.096034+0000","last_unstale":"2023-07-21T22:38:25.080872+0000","last_undegraded":"2023-07-21T22:38:25.080872+0000","last_fullsized":"2023-07-21T22:38:25.080872+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:58:00.070644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785216+0000","last_change":"2023-07-21T22:38:23.061237+0000","last_active":"2023-07-21T22:38:25.785216+0000","last_peered":"2023-07-21T22:38:25.785216+0000","last_clean":"2023-07-21T22:38:25.785216+0000","last_became_active":"2023-07-21T22:38:23.060950+0000","last_became_peered":"2023-07-21T22:38:23.060950+0000","last_unstale":"2023-07-21T22:38:25.785216+0000","last_undegraded":"2023-07-21T22:38:25.785216+0000","last_fullsized":"2023-07-21T22:38:25.785216+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:40:31.177602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784558+0000","last_change":"2023-07-21T22:38:24.084884+0000","last_active":"2023-07-21T22:38:25.784558+0000","last_peered":"2023-07-21T22:38:25.784558+0000","last_clean":"2023-07-21T22:38:25.784558+0000","last_became_active":"2023-07-21T22:38:24.084580+0000","last_became_peered":"2023-07-21T22:38:24.084580+0000","last_unstale":"2023-07-21T22:38:25.784558+0000","last_undegraded":"2023-07-21T22:38:25.784558+0000","last_fullsized":"2023-07-21T22:38:25.784558+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:48:35.087230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"142'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079611+0000","last_change":"2023-07-21T22:38:23.067155+0000","last_active":"2023-07-21T22:38:25.079611+0000","last_peered":"2023-07-21T22:38:25.079611+0000","last_clean":"2023-07-21T22:38:25.079611+0000","last_became_active":"2023-07-21T22:38:23.066836+0000","last_became_peered":"2023-07-21T22:38:23.066836+0000","last_unstale":"2023-07-21T22:38:25.079611+0000","last_undegraded":"2023-07-21T22:38:25.079611+0000","last_fullsized":"2023-07-21T22:38:25.079611+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:49:45.502056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079826+0000","last_change":"2023-07-21T22:38:24.103010+0000","last_active":"2023-07-21T22:38:25.079826+0000","last_peered":"2023-07-21T22:38:25.079826+0000","last_clean":"2023-07-21T22:38:25.079826+0000","last_became_active":"2023-07-21T22:38:24.102728+0000","last_became_peered":"2023-07-21T22:38:24.102728+0000","last_unstale":"2023-07-21T22:38:25.079826+0000","last_undegraded":"2023-07-21T22:38:25.079826+0000","last_fullsized":"2023-07-21T22:38:25.079826+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:38:59.426111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"142'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.783915+0000","last_change":"2023-07-21T22:38:23.071033+0000","last_active":"2023-07-21T22:38:25.783915+0000","last_peered":"2023-07-21T22:38:25.783915+0000","last_clean":"2023-07-21T22:38:25.783915+0000","last_became_active":"2023-07-21T22:38:23.070744+0000","last_became_peered":"2023-07-21T22:38:23.070744+0000","last_unstale":"2023-07-21T22:38:25.783915+0000","last_undegraded":"2023-07-21T22:38:25.783915+0000","last_fullsized":"2023-07-21T22:38:25.783915+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:19.183245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073680+0000","last_change":"2023-07-21T22:38:24.079664+0000","last_active":"2023-07-21T22:38:25.073680+0000","last_peered":"2023-07-21T22:38:25.073680+0000","last_clean":"2023-07-21T22:38:25.073680+0000","last_became_active":"2023-07-21T22:38:24.079364+0000","last_became_peered":"2023-07-21T22:38:24.079364+0000","last_unstale":"2023-07-21T22:38:25.073680+0000","last_undegraded":"2023-07-21T22:38:25.073680+0000","last_fullsized":"2023-07-21T22:38:25.073680+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:31:41.282905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.787677+0000","last_change":"2023-07-21T22:38:23.069579+0000","last_active":"2023-07-21T22:38:25.787677+0000","last_peered":"2023-07-21T22:38:25.787677+0000","last_clean":"2023-07-21T22:38:25.787677+0000","last_became_active":"2023-07-21T22:38:23.069255+0000","last_became_peered":"2023-07-21T22:38:23.069255+0000","last_unstale":"2023-07-21T22:38:25.787677+0000","last_undegraded":"2023-07-21T22:38:25.787677+0000","last_fullsized":"2023-07-21T22:38:25.787677+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:38:26.373969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785102+0000","last_change":"2023-07-21T22:38:24.079410+0000","last_active":"2023-07-21T22:38:25.785102+0000","last_peered":"2023-07-21T22:38:25.785102+0000","last_clean":"2023-07-21T22:38:25.785102+0000","last_became_active":"2023-07-21T22:38:24.079092+0000","last_became_peered":"2023-07-21T22:38:24.079092+0000","last_unstale":"2023-07-21T22:38:25.785102+0000","last_undegraded":"2023-07-21T22:38:25.785102+0000","last_fullsized":"2023-07-21T22:38:25.785102+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:11:11.841831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784171+0000","last_change":"2023-07-21T22:38:23.072024+0000","last_active":"2023-07-21T22:38:25.784171+0000","last_peered":"2023-07-21T22:38:25.784171+0000","last_clean":"2023-07-21T22:38:25.784171+0000","last_became_active":"2023-07-21T22:38:23.071738+0000","last_became_peered":"2023-07-21T22:38:23.071738+0000","last_unstale":"2023-07-21T22:38:25.784171+0000","last_undegraded":"2023-07-21T22:38:25.784171+0000","last_fullsized":"2023-07-21T22:38:25.784171+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:56:12.495929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788714+0000","last_change":"2023-07-21T22:38:24.106040+0000","last_active":"2023-07-21T22:38:25.788714+0000","last_peered":"2023-07-21T22:38:25.788714+0000","last_clean":"2023-07-21T22:38:25.788714+0000","last_became_active":"2023-07-21T22:38:24.101398+0000","last_became_peered":"2023-07-21T22:38:24.101398+0000","last_unstale":"2023-07-21T22:38:25.788714+0000","last_undegraded":"2023-07-21T22:38:25.788714+0000","last_fullsized":"2023-07-21T22:38:25.788714+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:23:05.843340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"142'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785459+0000","last_change":"2023-07-21T22:38:23.071033+0000","last_active":"2023-07-21T22:38:25.785459+0000","last_peered":"2023-07-21T22:38:25.785459+0000","last_clean":"2023-07-21T22:38:25.785459+0000","last_became_active":"2023-07-21T22:38:23.070685+0000","last_became_peered":"2023-07-21T22:38:23.070685+0000","last_unstale":"2023-07-21T22:38:25.785459+0000","last_undegraded":"2023-07-21T22:38:25.785459+0000","last_fullsized":"2023-07-21T22:38:25.785459+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:27:41.978908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080194+0000","last_change":"2023-07-21T22:38:24.099849+0000","last_active":"2023-07-21T22:38:25.080194+0000","last_peered":"2023-07-21T22:38:25.080194+0000","last_clean":"2023-07-21T22:38:25.080194+0000","last_became_active":"2023-07-21T22:38:24.099580+0000","last_became_peered":"2023-07-21T22:38:24.099580+0000","last_unstale":"2023-07-21T22:38:25.080194+0000","last_undegraded":"2023-07-21T22:38:25.080194+0000","last_fullsized":"2023-07-21T22:38:25.080194+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:16:48.290025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784453+0000","last_change":"2023-07-21T22:38:23.066606+0000","last_active":"2023-07-21T22:38:25.784453+0000","last_peered":"2023-07-21T22:38:25.784453+0000","last_clean":"2023-07-21T22:38:25.784453+0000","last_became_active":"2023-07-21T22:38:23.066288+0000","last_became_peered":"2023-07-21T22:38:23.066288+0000","last_unstale":"2023-07-21T22:38:25.784453+0000","last_undegraded":"2023-07-21T22:38:25.784453+0000","last_fullsized":"2023-07-21T22:38:25.784453+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:33:35.474710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784829+0000","last_change":"2023-07-21T22:38:24.097879+0000","last_active":"2023-07-21T22:38:25.784829+0000","last_peered":"2023-07-21T22:38:25.784829+0000","last_clean":"2023-07-21T22:38:25.784829+0000","last_became_active":"2023-07-21T22:38:24.097586+0000","last_became_peered":"2023-07-21T22:38:24.097586+0000","last_unstale":"2023-07-21T22:38:25.784829+0000","last_undegraded":"2023-07-21T22:38:25.784829+0000","last_fullsized":"2023-07-21T22:38:25.784829+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:36:52.938955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"142'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080602+0000","last_change":"2023-07-21T22:38:23.080670+0000","last_active":"2023-07-21T22:38:25.080602+0000","last_peered":"2023-07-21T22:38:25.080602+0000","last_clean":"2023-07-21T22:38:25.080602+0000","last_became_active":"2023-07-21T22:38:23.080326+0000","last_became_peered":"2023-07-21T22:38:23.080326+0000","last_unstale":"2023-07-21T22:38:25.080602+0000","last_undegraded":"2023-07-21T22:38:25.080602+0000","last_fullsized":"2023-07-21T22:38:25.080602+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:55:10.175545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788700+0000","last_change":"2023-07-21T22:38:24.106128+0000","last_active":"2023-07-21T22:38:25.788700+0000","last_peered":"2023-07-21T22:38:25.788700+0000","last_clean":"2023-07-21T22:38:25.788700+0000","last_became_active":"2023-07-21T22:38:24.105617+0000","last_became_peered":"2023-07-21T22:38:24.105617+0000","last_unstale":"2023-07-21T22:38:25.788700+0000","last_undegraded":"2023-07-21T22:38:25.788700+0000","last_fullsized":"2023-07-21T22:38:25.788700+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:00:45.730116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080277+0000","last_change":"2023-07-21T22:38:23.078636+0000","last_active":"2023-07-21T22:38:25.080277+0000","last_peered":"2023-07-21T22:38:25.080277+0000","last_clean":"2023-07-21T22:38:25.080277+0000","last_became_active":"2023-07-21T22:38:23.078443+0000","last_became_peered":"2023-07-21T22:38:23.078443+0000","last_unstale":"2023-07-21T22:38:25.080277+0000","last_undegraded":"2023-07-21T22:38:25.080277+0000","last_fullsized":"2023-07-21T22:38:25.080277+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:26:11.453377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784023+0000","last_change":"2023-07-21T22:38:24.097937+0000","last_active":"2023-07-21T22:38:25.784023+0000","last_peered":"2023-07-21T22:38:25.784023+0000","last_clean":"2023-07-21T22:38:25.784023+0000","last_became_active":"2023-07-21T22:38:24.097670+0000","last_became_peered":"2023-07-21T22:38:24.097670+0000","last_unstale":"2023-07-21T22:38:25.784023+0000","last_undegraded":"2023-07-21T22:38:25.784023+0000","last_fullsized":"2023-07-21T22:38:25.784023+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:01:51.959640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.783973+0000","last_change":"2023-07-21T22:38:23.069898+0000","last_active":"2023-07-21T22:38:25.783973+0000","last_peered":"2023-07-21T22:38:25.783973+0000","last_clean":"2023-07-21T22:38:25.783973+0000","last_became_active":"2023-07-21T22:38:23.069638+0000","last_became_peered":"2023-07-21T22:38:23.069638+0000","last_unstale":"2023-07-21T22:38:25.783973+0000","last_undegraded":"2023-07-21T22:38:25.783973+0000","last_fullsized":"2023-07-21T22:38:25.783973+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:47:26.418838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073008+0000","last_change":"2023-07-21T22:38:24.086531+0000","last_active":"2023-07-21T22:38:25.073008+0000","last_peered":"2023-07-21T22:38:25.073008+0000","last_clean":"2023-07-21T22:38:25.073008+0000","last_became_active":"2023-07-21T22:38:24.086229+0000","last_became_peered":"2023-07-21T22:38:24.086229+0000","last_unstale":"2023-07-21T22:38:25.073008+0000","last_undegraded":"2023-07-21T22:38:25.073008+0000","last_fullsized":"2023-07-21T22:38:25.073008+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:45:36.634653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080003+0000","last_change":"2023-07-21T22:38:23.076677+0000","last_active":"2023-07-21T22:38:25.080003+0000","last_peered":"2023-07-21T22:38:25.080003+0000","last_clean":"2023-07-21T22:38:25.080003+0000","last_became_active":"2023-07-21T22:38:23.076377+0000","last_became_peered":"2023-07-21T22:38:23.076377+0000","last_unstale":"2023-07-21T22:38:25.080003+0000","last_undegraded":"2023-07-21T22:38:25.080003+0000","last_fullsized":"2023-07-21T22:38:25.080003+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:56:17.368210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073756+0000","last_change":"2023-07-21T22:38:24.090100+0000","last_active":"2023-07-21T22:38:25.073756+0000","last_peered":"2023-07-21T22:38:25.073756+0000","last_clean":"2023-07-21T22:38:25.073756+0000","last_became_active":"2023-07-21T22:38:24.089622+0000","last_became_peered":"2023-07-21T22:38:24.089622+0000","last_unstale":"2023-07-21T22:38:25.073756+0000","last_undegraded":"2023-07-21T22:38:25.073756+0000","last_fullsized":"2023-07-21T22:38:25.073756+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:04:13.230479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073369+0000","last_change":"2023-07-21T22:38:23.066154+0000","last_active":"2023-07-21T22:38:25.073369+0000","last_peered":"2023-07-21T22:38:25.073369+0000","last_clean":"2023-07-21T22:38:25.073369+0000","last_became_active":"2023-07-21T22:38:23.065865+0000","last_became_peered":"2023-07-21T22:38:23.065865+0000","last_unstale":"2023-07-21T22:38:25.073369+0000","last_undegraded":"2023-07-21T22:38:25.073369+0000","last_fullsized":"2023-07-21T22:38:25.073369+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:50:03.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788316+0000","last_change":"2023-07-21T22:38:24.090424+0000","last_active":"2023-07-21T22:38:25.788316+0000","last_peered":"2023-07-21T22:38:25.788316+0000","last_clean":"2023-07-21T22:38:25.788316+0000","last_became_active":"2023-07-21T22:38:24.090102+0000","last_became_peered":"2023-07-21T22:38:24.090102+0000","last_unstale":"2023-07-21T22:38:25.788316+0000","last_undegraded":"2023-07-21T22:38:25.788316+0000","last_fullsized":"2023-07-21T22:38:25.788316+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:01:46.067288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079199+0000","last_change":"2023-07-21T22:38:23.074540+0000","last_active":"2023-07-21T22:38:25.079199+0000","last_peered":"2023-07-21T22:38:25.079199+0000","last_clean":"2023-07-21T22:38:25.079199+0000","last_became_active":"2023-07-21T22:38:23.074297+0000","last_became_peered":"2023-07-21T22:38:23.074297+0000","last_unstale":"2023-07-21T22:38:25.079199+0000","last_undegraded":"2023-07-21T22:38:25.079199+0000","last_fullsized":"2023-07-21T22:38:25.079199+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:18:58.765889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784573+0000","last_change":"2023-07-21T22:38:24.092977+0000","last_active":"2023-07-21T22:38:25.784573+0000","last_peered":"2023-07-21T22:38:25.784573+0000","last_clean":"2023-07-21T22:38:25.784573+0000","last_became_active":"2023-07-21T22:38:24.091605+0000","last_became_peered":"2023-07-21T22:38:24.091605+0000","last_unstale":"2023-07-21T22:38:25.784573+0000","last_undegraded":"2023-07-21T22:38:25.784573+0000","last_fullsized":"2023-07-21T22:38:25.784573+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:05:16.686353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784477+0000","last_change":"2023-07-21T22:38:23.067648+0000","last_active":"2023-07-21T22:38:25.784477+0000","last_peered":"2023-07-21T22:38:25.784477+0000","last_clean":"2023-07-21T22:38:25.784477+0000","last_became_active":"2023-07-21T22:38:23.067340+0000","last_became_peered":"2023-07-21T22:38:23.067340+0000","last_unstale":"2023-07-21T22:38:25.784477+0000","last_undegraded":"2023-07-21T22:38:25.784477+0000","last_fullsized":"2023-07-21T22:38:25.784477+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:43:47.490054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785048+0000","last_change":"2023-07-21T22:38:24.086899+0000","last_active":"2023-07-21T22:38:25.785048+0000","last_peered":"2023-07-21T22:38:25.785048+0000","last_clean":"2023-07-21T22:38:25.785048+0000","last_became_active":"2023-07-21T22:38:24.086687+0000","last_became_peered":"2023-07-21T22:38:24.086687+0000","last_unstale":"2023-07-21T22:38:25.785048+0000","last_undegraded":"2023-07-21T22:38:25.785048+0000","last_fullsized":"2023-07-21T22:38:25.785048+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:10:02.578722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"143'1","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788000+0000","last_change":"2023-07-21T22:38:23.076843+0000","last_active":"2023-07-21T22:38:25.788000+0000","last_peered":"2023-07-21T22:38:25.788000+0000","last_clean":"2023-07-21T22:38:25.788000+0000","last_became_active":"2023-07-21T22:38:23.076531+0000","last_became_peered":"2023-07-21T22:38:23.076531+0000","last_unstale":"2023-07-21T22:38:25.788000+0000","last_undegraded":"2023-07-21T22:38:25.788000+0000","last_fullsized":"2023-07-21T22:38:25.788000+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:06:58.933769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080779+0000","last_change":"2023-07-21T22:38:24.101889+0000","last_active":"2023-07-21T22:38:25.080779+0000","last_peered":"2023-07-21T22:38:25.080779+0000","last_clean":"2023-07-21T22:38:25.080779+0000","last_became_active":"2023-07-21T22:38:24.101592+0000","last_became_peered":"2023-07-21T22:38:24.101592+0000","last_unstale":"2023-07-21T22:38:25.080779+0000","last_undegraded":"2023-07-21T22:38:25.080779+0000","last_fullsized":"2023-07-21T22:38:25.080779+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:54:00.953682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788525+0000","last_change":"2023-07-21T22:38:23.077345+0000","last_active":"2023-07-21T22:38:25.788525+0000","last_peered":"2023-07-21T22:38:25.788525+0000","last_clean":"2023-07-21T22:38:25.788525+0000","last_became_active":"2023-07-21T22:38:23.076977+0000","last_became_peered":"2023-07-21T22:38:23.076977+0000","last_unstale":"2023-07-21T22:38:25.788525+0000","last_undegraded":"2023-07-21T22:38:25.788525+0000","last_fullsized":"2023-07-21T22:38:25.788525+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:21:15.032316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784338+0000","last_change":"2023-07-21T22:38:24.096862+0000","last_active":"2023-07-21T22:38:25.784338+0000","last_peered":"2023-07-21T22:38:25.784338+0000","last_clean":"2023-07-21T22:38:25.784338+0000","last_became_active":"2023-07-21T22:38:24.096571+0000","last_became_peered":"2023-07-21T22:38:24.096571+0000","last_unstale":"2023-07-21T22:38:25.784338+0000","last_undegraded":"2023-07-21T22:38:25.784338+0000","last_fullsized":"2023-07-21T22:38:25.784338+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:11:32.354921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784701+0000","last_change":"2023-07-21T22:38:23.072030+0000","last_active":"2023-07-21T22:38:25.784701+0000","last_peered":"2023-07-21T22:38:25.784701+0000","last_clean":"2023-07-21T22:38:25.784701+0000","last_became_active":"2023-07-21T22:38:23.071779+0000","last_became_peered":"2023-07-21T22:38:23.071779+0000","last_unstale":"2023-07-21T22:38:25.784701+0000","last_undegraded":"2023-07-21T22:38:25.784701+0000","last_fullsized":"2023-07-21T22:38:25.784701+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:24:58.097681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784078+0000","last_change":"2023-07-21T22:38:24.098006+0000","last_active":"2023-07-21T22:38:25.784078+0000","last_peered":"2023-07-21T22:38:25.784078+0000","last_clean":"2023-07-21T22:38:25.784078+0000","last_became_active":"2023-07-21T22:38:24.097717+0000","last_became_peered":"2023-07-21T22:38:24.097717+0000","last_unstale":"2023-07-21T22:38:25.784078+0000","last_undegraded":"2023-07-21T22:38:25.784078+0000","last_fullsized":"2023-07-21T22:38:25.784078+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:59:11.447007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079740+0000","last_change":"2023-07-21T22:38:23.064167+0000","last_active":"2023-07-21T22:38:25.079740+0000","last_peered":"2023-07-21T22:38:25.079740+0000","last_clean":"2023-07-21T22:38:25.079740+0000","last_became_active":"2023-07-21T22:38:23.063832+0000","last_became_peered":"2023-07-21T22:38:23.063832+0000","last_unstale":"2023-07-21T22:38:25.079740+0000","last_undegraded":"2023-07-21T22:38:25.079740+0000","last_fullsized":"2023-07-21T22:38:25.079740+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:20.088571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073146+0000","last_change":"2023-07-21T22:38:24.083269+0000","last_active":"2023-07-21T22:38:25.073146+0000","last_peered":"2023-07-21T22:38:25.073146+0000","last_clean":"2023-07-21T22:38:25.073146+0000","last_became_active":"2023-07-21T22:38:24.081731+0000","last_became_peered":"2023-07-21T22:38:24.081731+0000","last_unstale":"2023-07-21T22:38:25.073146+0000","last_undegraded":"2023-07-21T22:38:25.073146+0000","last_fullsized":"2023-07-21T22:38:25.073146+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:08:17.577766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079999+0000","last_change":"2023-07-21T22:38:23.069081+0000","last_active":"2023-07-21T22:38:25.079999+0000","last_peered":"2023-07-21T22:38:25.079999+0000","last_clean":"2023-07-21T22:38:25.079999+0000","last_became_active":"2023-07-21T22:38:23.068690+0000","last_became_peered":"2023-07-21T22:38:23.068690+0000","last_unstale":"2023-07-21T22:38:25.079999+0000","last_undegraded":"2023-07-21T22:38:25.079999+0000","last_fullsized":"2023-07-21T22:38:25.079999+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:23:12.707344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079346+0000","last_change":"2023-07-21T22:38:24.095531+0000","last_active":"2023-07-21T22:38:25.079346+0000","last_peered":"2023-07-21T22:38:25.079346+0000","last_clean":"2023-07-21T22:38:25.079346+0000","last_became_active":"2023-07-21T22:38:24.095237+0000","last_became_peered":"2023-07-21T22:38:24.095237+0000","last_unstale":"2023-07-21T22:38:25.079346+0000","last_undegraded":"2023-07-21T22:38:25.079346+0000","last_fullsized":"2023-07-21T22:38:25.079346+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:10:09.441603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784231+0000","last_change":"2023-07-21T22:38:23.072049+0000","last_active":"2023-07-21T22:38:25.784231+0000","last_peered":"2023-07-21T22:38:25.784231+0000","last_clean":"2023-07-21T22:38:25.784231+0000","last_became_active":"2023-07-21T22:38:23.071697+0000","last_became_peered":"2023-07-21T22:38:23.071697+0000","last_unstale":"2023-07-21T22:38:25.784231+0000","last_undegraded":"2023-07-21T22:38:25.784231+0000","last_fullsized":"2023-07-21T22:38:25.784231+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:50:17.486364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785223+0000","last_change":"2023-07-21T22:38:24.087878+0000","last_active":"2023-07-21T22:38:25.785223+0000","last_peered":"2023-07-21T22:38:25.785223+0000","last_clean":"2023-07-21T22:38:25.785223+0000","last_became_active":"2023-07-21T22:38:24.087596+0000","last_became_peered":"2023-07-21T22:38:24.087596+0000","last_unstale":"2023-07-21T22:38:25.785223+0000","last_undegraded":"2023-07-21T22:38:25.785223+0000","last_fullsized":"2023-07-21T22:38:25.785223+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:05:55.647829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079211+0000","last_change":"2023-07-21T22:38:23.076939+0000","last_active":"2023-07-21T22:38:25.079211+0000","last_peered":"2023-07-21T22:38:25.079211+0000","last_clean":"2023-07-21T22:38:25.079211+0000","last_became_active":"2023-07-21T22:38:23.076616+0000","last_became_peered":"2023-07-21T22:38:23.076616+0000","last_unstale":"2023-07-21T22:38:25.079211+0000","last_undegraded":"2023-07-21T22:38:25.079211+0000","last_fullsized":"2023-07-21T22:38:25.079211+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:24:35.294680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080226+0000","last_change":"2023-07-21T22:38:24.093594+0000","last_active":"2023-07-21T22:38:25.080226+0000","last_peered":"2023-07-21T22:38:25.080226+0000","last_clean":"2023-07-21T22:38:25.080226+0000","last_became_active":"2023-07-21T22:38:24.093278+0000","last_became_peered":"2023-07-21T22:38:24.093278+0000","last_unstale":"2023-07-21T22:38:25.080226+0000","last_undegraded":"2023-07-21T22:38:25.080226+0000","last_fullsized":"2023-07-21T22:38:25.080226+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:14:35.831166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"142'8","reported_seq":21,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073086+0000","last_change":"2023-07-21T22:38:23.068532+0000","last_active":"2023-07-21T22:38:25.073086+0000","last_peered":"2023-07-21T22:38:25.073086+0000","last_clean":"2023-07-21T22:38:25.073086+0000","last_became_active":"2023-07-21T22:38:23.068250+0000","last_became_peered":"2023-07-21T22:38:23.068250+0000","last_unstale":"2023-07-21T22:38:25.073086+0000","last_undegraded":"2023-07-21T22:38:25.073086+0000","last_fullsized":"2023-07-21T22:38:25.073086+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:26:02.389222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"130'249","reported_seq":854,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079594+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:38:25.079594+0000","last_peered":"2023-07-21T22:38:25.079594+0000","last_clean":"2023-07-21T22:38:25.079594+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:38:25.079594+0000","last_undegraded":"2023-07-21T22:38:25.079594+0000","last_fullsized":"2023-07-21T22:38:25.079594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:12:03.608673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":252,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788450+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:38:25.788450+0000","last_peered":"2023-07-21T22:38:25.788450+0000","last_clean":"2023-07-21T22:38:25.788450+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:38:25.788450+0000","last_undegraded":"2023-07-21T22:38:25.788450+0000","last_fullsized":"2023-07-21T22:38:25.788450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:22:48.485641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788017+0000","last_change":"2023-07-21T22:38:24.090205+0000","last_active":"2023-07-21T22:38:25.788017+0000","last_peered":"2023-07-21T22:38:25.788017+0000","last_clean":"2023-07-21T22:38:25.788017+0000","last_became_active":"2023-07-21T22:38:24.089783+0000","last_became_peered":"2023-07-21T22:38:24.089783+0000","last_unstale":"2023-07-21T22:38:25.788017+0000","last_undegraded":"2023-07-21T22:38:25.788017+0000","last_fullsized":"2023-07-21T22:38:25.788017+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:50:15.223031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"142'2","reported_seq":15,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073268+0000","last_change":"2023-07-21T22:38:23.063181+0000","last_active":"2023-07-21T22:38:25.073268+0000","last_peered":"2023-07-21T22:38:25.073268+0000","last_clean":"2023-07-21T22:38:25.073268+0000","last_became_active":"2023-07-21T22:38:23.062917+0000","last_became_peered":"2023-07-21T22:38:23.062917+0000","last_unstale":"2023-07-21T22:38:25.073268+0000","last_undegraded":"2023-07-21T22:38:25.073268+0000","last_fullsized":"2023-07-21T22:38:25.073268+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:08:34.867008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":230,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.079369+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:38:25.079369+0000","last_peered":"2023-07-21T22:38:25.079369+0000","last_clean":"2023-07-21T22:38:25.079369+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:38:25.079369+0000","last_undegraded":"2023-07-21T22:38:25.079369+0000","last_fullsized":"2023-07-21T22:38:25.079369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:23:05.518387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785026+0000","last_change":"2023-07-21T22:38:24.081637+0000","last_active":"2023-07-21T22:38:25.785026+0000","last_peered":"2023-07-21T22:38:25.785026+0000","last_clean":"2023-07-21T22:38:25.785026+0000","last_became_active":"2023-07-21T22:38:24.081283+0000","last_became_peered":"2023-07-21T22:38:24.081283+0000","last_unstale":"2023-07-21T22:38:25.785026+0000","last_undegraded":"2023-07-21T22:38:25.785026+0000","last_fullsized":"2023-07-21T22:38:25.785026+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:15:21.856379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073756+0000","last_change":"2023-07-21T22:38:23.069398+0000","last_active":"2023-07-21T22:38:25.073756+0000","last_peered":"2023-07-21T22:38:25.073756+0000","last_clean":"2023-07-21T22:38:25.073756+0000","last_became_active":"2023-07-21T22:38:23.069091+0000","last_became_peered":"2023-07-21T22:38:23.069091+0000","last_unstale":"2023-07-21T22:38:25.073756+0000","last_undegraded":"2023-07-21T22:38:25.073756+0000","last_fullsized":"2023-07-21T22:38:25.073756+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:21:15.032316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":228,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.783828+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:38:25.783828+0000","last_peered":"2023-07-21T22:38:25.783828+0000","last_clean":"2023-07-21T22:38:25.783828+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:38:25.783828+0000","last_undegraded":"2023-07-21T22:38:25.783828+0000","last_fullsized":"2023-07-21T22:38:25.783828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:35:36.553194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.783987+0000","last_change":"2023-07-21T22:38:24.092881+0000","last_active":"2023-07-21T22:38:25.783987+0000","last_peered":"2023-07-21T22:38:25.783987+0000","last_clean":"2023-07-21T22:38:25.783987+0000","last_became_active":"2023-07-21T22:38:24.092589+0000","last_became_peered":"2023-07-21T22:38:24.092589+0000","last_unstale":"2023-07-21T22:38:25.783987+0000","last_undegraded":"2023-07-21T22:38:25.783987+0000","last_fullsized":"2023-07-21T22:38:25.783987+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:54:14.632380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073173+0000","last_change":"2023-07-21T22:38:23.062898+0000","last_active":"2023-07-21T22:38:25.073173+0000","last_peered":"2023-07-21T22:38:25.073173+0000","last_clean":"2023-07-21T22:38:25.073173+0000","last_became_active":"2023-07-21T22:38:23.062603+0000","last_became_peered":"2023-07-21T22:38:23.062603+0000","last_unstale":"2023-07-21T22:38:25.073173+0000","last_undegraded":"2023-07-21T22:38:25.073173+0000","last_fullsized":"2023-07-21T22:38:25.073173+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:41:58.825031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":252,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788064+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:38:25.788064+0000","last_peered":"2023-07-21T22:38:25.788064+0000","last_clean":"2023-07-21T22:38:25.788064+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:38:25.788064+0000","last_undegraded":"2023-07-21T22:38:25.788064+0000","last_fullsized":"2023-07-21T22:38:25.788064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:46:15.432136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788214+0000","last_change":"2023-07-21T22:38:24.095582+0000","last_active":"2023-07-21T22:38:25.788214+0000","last_peered":"2023-07-21T22:38:25.788214+0000","last_clean":"2023-07-21T22:38:25.788214+0000","last_became_active":"2023-07-21T22:38:24.095318+0000","last_became_peered":"2023-07-21T22:38:24.095318+0000","last_unstale":"2023-07-21T22:38:25.788214+0000","last_undegraded":"2023-07-21T22:38:25.788214+0000","last_fullsized":"2023-07-21T22:38:25.788214+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:57:17.921295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788303+0000","last_change":"2023-07-21T22:38:23.073676+0000","last_active":"2023-07-21T22:38:25.788303+0000","last_peered":"2023-07-21T22:38:25.788303+0000","last_clean":"2023-07-21T22:38:25.788303+0000","last_became_active":"2023-07-21T22:38:23.073401+0000","last_became_peered":"2023-07-21T22:38:23.073401+0000","last_unstale":"2023-07-21T22:38:25.788303+0000","last_undegraded":"2023-07-21T22:38:25.788303+0000","last_fullsized":"2023-07-21T22:38:25.788303+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:19:04.305226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":244,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.785284+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:38:25.785284+0000","last_peered":"2023-07-21T22:38:25.785284+0000","last_clean":"2023-07-21T22:38:25.785284+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:38:25.785284+0000","last_undegraded":"2023-07-21T22:38:25.785284+0000","last_fullsized":"2023-07-21T22:38:25.785284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:00:35.047119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788408+0000","last_change":"2023-07-21T22:38:24.098711+0000","last_active":"2023-07-21T22:38:25.788408+0000","last_peered":"2023-07-21T22:38:25.788408+0000","last_clean":"2023-07-21T22:38:25.788408+0000","last_became_active":"2023-07-21T22:38:24.098396+0000","last_became_peered":"2023-07-21T22:38:24.098396+0000","last_unstale":"2023-07-21T22:38:25.788408+0000","last_undegraded":"2023-07-21T22:38:25.788408+0000","last_fullsized":"2023-07-21T22:38:25.788408+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:21:26.325894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788181+0000","last_change":"2023-07-21T22:38:23.064930+0000","last_active":"2023-07-21T22:38:25.788181+0000","last_peered":"2023-07-21T22:38:25.788181+0000","last_clean":"2023-07-21T22:38:25.788181+0000","last_became_active":"2023-07-21T22:38:23.064654+0000","last_became_peered":"2023-07-21T22:38:23.064654+0000","last_unstale":"2023-07-21T22:38:25.788181+0000","last_undegraded":"2023-07-21T22:38:25.788181+0000","last_fullsized":"2023-07-21T22:38:25.788181+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:23:37.260793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":230,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.080704+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:38:25.080704+0000","last_peered":"2023-07-21T22:38:25.080704+0000","last_clean":"2023-07-21T22:38:25.080704+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:38:25.080704+0000","last_undegraded":"2023-07-21T22:38:25.080704+0000","last_fullsized":"2023-07-21T22:38:25.080704+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:05:33.127342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073529+0000","last_change":"2023-07-21T22:38:24.088196+0000","last_active":"2023-07-21T22:38:25.073529+0000","last_peered":"2023-07-21T22:38:25.073529+0000","last_clean":"2023-07-21T22:38:25.073529+0000","last_became_active":"2023-07-21T22:38:24.087917+0000","last_became_peered":"2023-07-21T22:38:24.087917+0000","last_unstale":"2023-07-21T22:38:25.073529+0000","last_undegraded":"2023-07-21T22:38:25.073529+0000","last_fullsized":"2023-07-21T22:38:25.073529+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:41:54.129514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"142'3","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788567+0000","last_change":"2023-07-21T22:38:23.073379+0000","last_active":"2023-07-21T22:38:25.788567+0000","last_peered":"2023-07-21T22:38:25.788567+0000","last_clean":"2023-07-21T22:38:25.788567+0000","last_became_active":"2023-07-21T22:38:23.073091+0000","last_became_peered":"2023-07-21T22:38:23.073091+0000","last_unstale":"2023-07-21T22:38:25.788567+0000","last_undegraded":"2023-07-21T22:38:25.788567+0000","last_fullsized":"2023-07-21T22:38:25.788567+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:09:17.217068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":244,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.784850+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:38:25.784850+0000","last_peered":"2023-07-21T22:38:25.784850+0000","last_clean":"2023-07-21T22:38:25.784850+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:38:25.784850+0000","last_undegraded":"2023-07-21T22:38:25.784850+0000","last_fullsized":"2023-07-21T22:38:25.784850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:03:28.104938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788613+0000","last_change":"2023-07-21T22:38:24.092283+0000","last_active":"2023-07-21T22:38:25.788613+0000","last_peered":"2023-07-21T22:38:25.788613+0000","last_clean":"2023-07-21T22:38:25.788613+0000","last_became_active":"2023-07-21T22:38:24.091994+0000","last_became_peered":"2023-07-21T22:38:24.091994+0000","last_unstale":"2023-07-21T22:38:25.788613+0000","last_undegraded":"2023-07-21T22:38:25.788613+0000","last_fullsized":"2023-07-21T22:38:25.788613+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:23.043425+0000","last_clean_scrub_stamp":"2023-07-21T22:38:23.043425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:19:52.933181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"142'6","reported_seq":19,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.073387+0000","last_change":"2023-07-21T22:38:23.061980+0000","last_active":"2023-07-21T22:38:25.073387+0000","last_peered":"2023-07-21T22:38:25.073387+0000","last_clean":"2023-07-21T22:38:25.073387+0000","last_became_active":"2023-07-21T22:38:23.061558+0000","last_became_peered":"2023-07-21T22:38:23.061558+0000","last_unstale":"2023-07-21T22:38:25.073387+0000","last_undegraded":"2023-07-21T22:38:25.073387+0000","last_fullsized":"2023-07-21T22:38:25.073387+0000","mapping_epoch":140,"log_start":"0'0","ondisk_log_start":"0'0","created":140,"last_epoch_clean":141,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:38:22.036899+0000","last_clean_scrub_stamp":"2023-07-21T22:38:22.036899+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:55:21.318261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":226,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-07-21T22:38:25.788422+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:38:25.788422+0000","last_peered":"2023-07-21T22:38:25.788422+0000","last_clean":"2023-07-21T22:38:25.788422+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:38:25.788422+0000","last_undegraded":"2023-07-21T22:38:25.788422+0000","last_fullsized":"2023-07-21T22:38:25.788422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:44:27.443903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509676,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59608,"kb_used_data":2320,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312232,"statfs":{"total":96636764160,"available":96575725568,"internally_reserved":0,"allocated":2375680,"data_stored":1485683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69099999999999995,"15min":0.73199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35299999999999998},"max":{"1min":0.876,"5min":1.1180000000000001,"15min":3.5059999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66400000000000003,"15min":0.69399999999999995},"min":{"1min":0.46200000000000002,"5min":0.40899999999999997,"15min":0.39500000000000002},"max":{"1min":0.94199999999999995,"5min":0.94399999999999995,"15min":3.2709999999999999},"last":0.47899999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.70599999999999996,"15min":0.72799999999999998},"min":{"1min":0.49199999999999999,"5min":0.44900000000000001,"15min":0.432},"max":{"1min":0.98599999999999999,"5min":1.0680000000000001,"15min":1.5429999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.71299999999999997},"min":{"1min":0.44800000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96499999999999997,"5min":1.093,"15min":1.093},"last":0.72599999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70899999999999996,"15min":0.73599999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":1.1399999999999999,"15min":1.405},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73199999999999998,"15min":0.746},"min":{"1min":0.55100000000000005,"5min":0.47999999999999998,"15min":0.45800000000000002},"max":{"1min":0.92800000000000005,"5min":1.083,"15min":1.409},"last":0.68300000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75900000000000001,"15min":0.76500000000000001},"min":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0209999999999999,"5min":1.1539999999999999,"15min":1.46},"last":0.62},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.48599999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94899999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.69399999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55700000000000005,"15min":0.56200000000000006},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.67500000000000004,"5min":0.90000000000000002,"15min":0.94999999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82299999999999995,"5min":0.97399999999999998,"15min":1.7949999999999999},"last":0.57199999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.89700000000000002,"5min":0.98799999999999999,"15min":2.2120000000000002},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70199999999999996,"15min":0.68100000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.38300000000000001},"max":{"1min":0.95199999999999996,"5min":1.052,"15min":1.506},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.68100000000000005},"min":{"1min":0.53700000000000003,"5min":0.44900000000000001,"15min":0.41999999999999998},"max":{"1min":0.93500000000000005,"5min":1.0329999999999999,"15min":1.048},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.42699999999999999},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.53400000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542382,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36872,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334968,"statfs":{"total":96636764160,"available":96599007232,"internally_reserved":0,"allocated":1769472,"data_stored":895121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.755},"min":{"1min":0.47099999999999997,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.94399999999999995,"5min":1.016,"15min":1.016},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.437},"max":{"1min":0.96799999999999997,"5min":1.0289999999999999,"15min":1.1180000000000001},"last":0.59099999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.70099999999999996,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.49099999999999999,"15min":0.45300000000000001},"max":{"1min":0.872,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.45800000000000002,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.93300000000000005,"5min":0.99199999999999999,"15min":1.117},"last":0.71899999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71099999999999997,"15min":0.74199999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.42799999999999999},"max":{"1min":0.89600000000000002,"5min":0.98099999999999998,"15min":0.997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.78700000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.45500000000000002},"max":{"1min":0.98199999999999998,"5min":1.0149999999999999,"15min":1.097},"last":0.66800000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71999999999999997,"15min":0.748},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":1.048,"15min":1.048},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70499999999999996,"15min":0.72899999999999998},"min":{"1min":0.52300000000000002,"5min":0.49399999999999999,"15min":0.46899999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0049999999999999},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.93400000000000005,"15min":1.0229999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.39700000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.628}]},{"osd":5,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.749},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.054},"last":0.73499999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70299999999999996,"15min":0.68100000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.443},"max":{"1min":1.024,"5min":1.024,"15min":1.079},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.68700000000000006}]}]},{"osd":5,"up_from":15,"seq":64424509675,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50828,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321012,"statfs":{"total":96636764160,"available":96584716288,"internally_reserved":0,"allocated":1773568,"data_stored":894699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.70999999999999996},"min":{"1min":0.48099999999999998,"5min":0.38500000000000001,"15min":0.35699999999999998},"max":{"1min":0.96499999999999997,"5min":1,"15min":1.8779999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.97999999999999998,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.85299999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.68600000000000005,"15min":0.70299999999999996},"min":{"1min":0.505,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.95899999999999996,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69099999999999995,"15min":0.72099999999999997},"min":{"1min":0.42699999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.617},"last":0.752}]},{"osd":2,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71099999999999997,"15min":0.72699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.33600000000000002},"max":{"1min":1.008,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.42199999999999999,"15min":0.377},"max":{"1min":0.89300000000000002,"5min":1.073,"15min":1.512},"last":0.78500000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76900000000000002,"15min":0.77800000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":1.0009999999999999,"15min":1.472},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76000000000000001,"15min":0.78700000000000003},"min":{"1min":0.60099999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.997,"5min":1.022,"15min":1.556},"last":0.83399999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.372,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83699999999999997,"5min":0.88900000000000001,"15min":0.96999999999999997},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72399999999999998,"15min":0.69599999999999995},"min":{"1min":0.58899999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.92300000000000004,"5min":0.92400000000000004,"15min":1.038},"last":0.90000000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":0.95499999999999996,"15min":1.0049999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.40200000000000002,"15min":0.40000000000000002},"max":{"1min":0.76600000000000001,"5min":0.93799999999999994,"15min":1.02},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70099999999999996,"15min":0.65700000000000003},"min":{"1min":0.46200000000000002,"5min":0.40999999999999998,"15min":0.374},"max":{"1min":0.96699999999999997,"5min":1.042,"15min":1.042},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":0.73099999999999998},"min":{"1min":0.59799999999999998,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.88300000000000001,"5min":0.999,"15min":1.7390000000000001},"last":0.88}]}]},{"osd":4,"up_from":15,"seq":64424509676,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32784,"kb_used_data":1736,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339056,"statfs":{"total":96636764160,"available":96603193344,"internally_reserved":0,"allocated":1777664,"data_stored":896103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.70399999999999996,"15min":0.73599999999999999},"min":{"1min":0.46800000000000003,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.71399999999999997,"15min":0.73699999999999999},"min":{"1min":0.47999999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98499999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.52900000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.68799999999999994,"15min":0.70199999999999996},"min":{"1min":0.46999999999999997,"5min":0.442,"15min":0.39400000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67600000000000005,"15min":0.69999999999999996},"min":{"1min":0.44400000000000001,"5min":0.43099999999999999,"15min":0.36899999999999999},"max":{"1min":0.90400000000000003,"5min":0.93000000000000005,"15min":1.016},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72799999999999998,"15min":0.755},"min":{"1min":0.55800000000000005,"5min":0.49099999999999999,"15min":0.371},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.73799999999999999,"15min":0.76400000000000001},"min":{"1min":0.52400000000000002,"5min":0.47699999999999998,"15min":0.33000000000000002},"max":{"1min":1.018,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.40100000000000002},"max":{"1min":0.91000000000000003,"5min":0.97999999999999998,"15min":1.026},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.75900000000000001,"15min":0.77900000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47999999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.66500000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60799999999999998,"15min":0.58499999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34399999999999997},"max":{"1min":0.96199999999999997,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.60399999999999998,"15min":0.59499999999999997},"min":{"1min":0.44400000000000001,"5min":0.38800000000000001,"15min":0.32800000000000001},"max":{"1min":0.93600000000000005,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.70799999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.753},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.41599999999999998},"max":{"1min":1.0089999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:37:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66100000000000003,"15min":0.65200000000000002},"min":{"1min":0.47599999999999998,"5min":0.45500000000000002,"15min":0.39200000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.0429999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.61699999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509675,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1740,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1781760,"data_stored":896137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46899999999999997,"15min":0.47499999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":0.77800000000000002,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.43099999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46200000000000002,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60299999999999998,"5min":0.754,"15min":0.83499999999999996},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.41999999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71899999999999997,"5min":0.82599999999999996,"15min":0.90100000000000002},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67600000000000005,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.59599999999999997},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.99199999999999999},"last":0.498}]},{"osd":4,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.755,"15min":0.77000000000000002},"min":{"1min":0.57599999999999996,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91200000000000003,"5min":1.093,"15min":1.1279999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.81399999999999995},"min":{"1min":0.54500000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.93200000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.89200000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.76900000000000002},"min":{"1min":0.54900000000000004,"5min":0.501,"15min":0.48999999999999999},"max":{"1min":0.97799999999999998,"5min":1.0669999999999999,"15min":1.137},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.51300000000000001,"15min":0.42899999999999999},"max":{"1min":0.86399999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76900000000000002,"15min":0.79000000000000004},"min":{"1min":0.51900000000000002,"5min":0.51700000000000002,"15min":0.47399999999999998},"max":{"1min":0.91700000000000004,"5min":1.0680000000000001,"15min":1.169},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91300000000000003,"5min":1.107,"15min":1.1120000000000001},"last":0.79700000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79200000000000004,"15min":0.81299999999999994},"min":{"1min":0.621,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94299999999999995,"5min":1.083,"15min":1.099},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80900000000000005,"15min":0.82799999999999996},"min":{"1min":0.61299999999999999,"5min":0.55200000000000005,"15min":0.48599999999999999},"max":{"1min":0.92200000000000004,"5min":1.623,"15min":1.623},"last":0.86599999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509677,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54916,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316924,"statfs":{"total":96636764160,"available":96580530176,"internally_reserved":0,"allocated":1765376,"data_stored":894539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.46400000000000002},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.23899999999999999},"max":{"1min":0.624,"5min":0.75,"15min":0.94199999999999995},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50600000000000001,"15min":0.54100000000000004},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.308},"max":{"1min":0.64200000000000002,"5min":0.88300000000000001,"15min":1.0409999999999999},"last":0.45900000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.40699999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72599999999999998,"5min":0.86699999999999999,"15min":0.93999999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.012,"15min":1.085},"last":0.505}]},{"osd":3,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46300000000000002,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.623,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.56399999999999995},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.85299999999999998,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.48599999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.46600000000000003,"15min":0.376},"max":{"1min":1.016,"5min":1.1579999999999999,"15min":1.3420000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73599999999999999,"15min":0.78500000000000003},"min":{"1min":0.48899999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.996,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.86099999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0780000000000001,"5min":1.214,"15min":1.214},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77700000000000002,"15min":0.80600000000000005},"min":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.46400000000000002},"max":{"1min":1.012,"5min":1.2689999999999999,"15min":1.3089999999999999},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.746,"15min":0.78300000000000003},"min":{"1min":0.52800000000000002,"5min":0.499,"15min":0.40300000000000002},"max":{"1min":0.94399999999999995,"5min":1.536,"15min":1.536},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.46200000000000002},"max":{"1min":1.0289999999999999,"5min":1.1339999999999999,"15min":1.2649999999999999},"last":0.84399999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77500000000000002,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.008,"5min":1.143,"15min":1.214},"last":0.879},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.751,"15min":0.79700000000000004},"min":{"1min":0.58899999999999997,"5min":0.50900000000000001,"15min":0.44700000000000001},"max":{"1min":0.91200000000000003,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.73599999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509676,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32776,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1769472,"data_stored":894561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.47499999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.22900000000000001},"max":{"1min":0.60399999999999998,"5min":0.78700000000000003,"15min":0.84599999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54100000000000004,"15min":0.55900000000000005},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.35099999999999998},"max":{"1min":0.80900000000000005,"5min":0.82499999999999996,"15min":0.872},"last":0.441}]},{"osd":2,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48999999999999999,"15min":0.502},"min":{"1min":0.36199999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"max":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":0.81000000000000005},"last":0.317},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.29099999999999998},"max":{"1min":0.71899999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.38800000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.42299999999999999,"5min":0.378,"15min":0.33400000000000002},"max":{"1min":0.76100000000000001,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":0.77600000000000002,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.34699999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.432},"max":{"1min":1.115,"5min":1.294,"15min":1.294},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77800000000000002,"15min":0.79000000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.498},"max":{"1min":1.1220000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.95399999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.753,"15min":0.77200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.41899999999999998},"max":{"1min":1.0980000000000001,"5min":1.242,"15min":1.242},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.55700000000000005,"5min":0.51500000000000001,"15min":0.376},"max":{"1min":1.1639999999999999,"5min":1.276,"15min":1.2849999999999999},"last":0.93700000000000006}]},{"osd":6,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77700000000000002,"15min":0.80000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.47899999999999998},"max":{"1min":1.0800000000000001,"5min":1.208,"15min":1.23},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.78100000000000003},"min":{"1min":0.56100000000000005,"5min":0.50900000000000001,"15min":0.46500000000000002},"max":{"1min":1.0109999999999999,"5min":1.244,"15min":1.3240000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78500000000000003,"15min":0.80400000000000005},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.49199999999999999},"max":{"1min":1.089,"5min":1.3120000000000001,"15min":1.3149999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.45700000000000002},"max":{"1min":1.0289999999999999,"5min":1.1819999999999999,"15min":1.3380000000000001},"last":0.79000000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509678,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37452,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334388,"statfs":{"total":96636764160,"available":96598413312,"internally_reserved":0,"allocated":2363392,"data_stored":1484929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.33200000000000002,"5min":0.28399999999999997,"15min":0.26600000000000001},"max":{"1min":0.66300000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.375},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50900000000000001,"15min":0.51600000000000001},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.70599999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58599999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.41599999999999998,"5min":0.32400000000000001,"15min":0.29799999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.3680000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.49099999999999999,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.871},"last":0.42899999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.432,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81899999999999995,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.33700000000000002},"max":{"1min":0.83599999999999997,"5min":0.88600000000000001,"15min":1.038},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.81000000000000005,"15min":0.78400000000000003},"min":{"1min":0.56899999999999995,"5min":0.499,"15min":0.45200000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.80500000000000005,"15min":0.80000000000000004},"min":{"1min":0.57899999999999996,"5min":0.505,"15min":0.44600000000000001},"max":{"1min":1.206,"5min":1.278,"15min":1.423},"last":0.80800000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.59599999999999997,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.0089999999999999,"5min":1.0960000000000001,"15min":1.2669999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80500000000000005,"15min":0.80300000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.39600000000000002},"max":{"1min":1.119,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.61299999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.48899999999999999},"max":{"1min":1.2210000000000001,"5min":1.27,"15min":1.27},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.65500000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80700000000000005,"15min":0.79500000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.53100000000000003},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80200000000000005,"15min":0.82199999999999995},"min":{"1min":0.58999999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1479999999999999,"5min":1.1930000000000001,"15min":1.296},"last":0.75700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:38:33.177 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T22:38:33.177 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-21T22:38:33.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.316+0000 7f4bcb4ec640 1 Processor -- start 2023-07-21T22:38:33.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.316+0000 7f4bcb4ec640 1 -- start start 2023-07-21T22:38:33.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.316+0000 7f4bcb4ec640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4bc4164340 0x7f4bc40cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:33.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.316+0000 7f4bcb4ec640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc4070b30 con 0x7f4bc406c240 2023-07-21T22:38:33.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.316+0000 7f4bcb4ec640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc406b4c0 con 0x7f4bc415fc20 2023-07-21T22:38:33.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.316+0000 7f4bcb4ec640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc406b760 con 0x7f4bc4164340 2023-07-21T22:38:33.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.316+0000 7f4bc9a89640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4bc4164340 0x7f4bc40cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:33.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.316+0000 7f4bc9a89640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4bc4164340 0x7f4bc40cd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45522/0 (socket says 172.21.15.6:45522) 2023-07-21T22:38:33.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.316+0000 7f4bc9a89640 1 -- 172.21.15.6:0/470812888 learned_addr learned my addr 172.21.15.6:0/470812888 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:33.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.320+0000 7f4bc9a89640 1 -- 172.21.15.6:0/470812888 >> v1:172.21.15.161:6789/0 conn(0x7f4bc415fc20 legacy=0x7f4bc415fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:33.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.320+0000 7f4bc9a89640 1 -- 172.21.15.6:0/470812888 >> v1:172.21.15.6:6789/0 conn(0x7f4bc406c240 legacy=0x7f4bc4163c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:33.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.320+0000 7f4bc9a89640 1 -- 172.21.15.6:0/470812888 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc406ba40 con 0x7f4bc4164340 2023-07-21T22:38:33.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.320+0000 7f4bbbfff640 1 -- 172.21.15.6:0/470812888 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4159974547 0 0) 0x7f4bc4070b30 con 0x7f4bc406c240 2023-07-21T22:38:33.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.320+0000 7f4bc9a89640 1 --2- 172.21.15.6:0/470812888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bc4164340 0x7f4bc40cd670 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009e50 tx=0x7f4bbc01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e6eba7e15ae1db server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:33.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.320+0000 7f4bbbfff640 1 -- 172.21.15.6:0/470812888 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc0a57b0 con 0x7f4bc4164340 2023-07-21T22:38:33.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.320+0000 7f4bbbfff640 1 -- 172.21.15.6:0/470812888 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bbc0a5910 con 0x7f4bc4164340 2023-07-21T22:38:33.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.320+0000 7f4bbbfff640 1 -- 172.21.15.6:0/470812888 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc0a5ca0 con 0x7f4bc4164340 2023-07-21T22:38:33.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.320+0000 7f4bcb4ec640 1 -- 172.21.15.6:0/470812888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bc4164340 msgr2=0x7f4bc40cd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:33.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.320+0000 7f4bcb4ec640 1 --2- 172.21.15.6:0/470812888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bc4164340 0x7f4bc40cd670 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009e50 tx=0x7f4bbc01ca10 comp rx=0 tx=0).stop 2023-07-21T22:38:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.320+0000 7f4bcb4ec640 1 -- 172.21.15.6:0/470812888 shutdown_connections 2023-07-21T22:38:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.320+0000 7f4bcb4ec640 1 --2- 172.21.15.6:0/470812888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bc4164340 0x7f4bc40cd670 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.320+0000 7f4bcb4ec640 1 -- 172.21.15.6:0/470812888 >> 172.21.15.6:0/470812888 conn(0x7f4bc40afac0 msgr2=0x7f4bc40afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bcb4ec640 1 -- 172.21.15.6:0/470812888 shutdown_connections 2023-07-21T22:38:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bcb4ec640 1 -- 172.21.15.6:0/470812888 wait complete. 2023-07-21T22:38:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bcb4ec640 1 Processor -- start 2023-07-21T22:38:33.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bcb4ec640 1 -- start start 2023-07-21T22:38:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bcb4ec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bc406c240 0x7f4bc40c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bcb4ec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bc415fc20 0x7f4bc4157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bcb4ec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4bc4164340 0x7f4bc4161040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bcb4ec640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc40c4990 con 0x7f4bc406c240 2023-07-21T22:38:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bcb4ec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc40c74d0 con 0x7f4bc415fc20 2023-07-21T22:38:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bcb4ec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc40b0dc0 con 0x7f4bc4164340 2023-07-21T22:38:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bc9288640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bc406c240 0x7f4bc40c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bc9288640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bc406c240 0x7f4bc40c4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45524/0 (socket says 172.21.15.6:45524) 2023-07-21T22:38:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bc9288640 1 -- 172.21.15.6:0/279959274 learned_addr learned my addr 172.21.15.6:0/279959274 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bc8a87640 1 --2- 172.21.15.6:0/279959274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bc415fc20 0x7f4bc4157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bc9a89640 1 --2- 172.21.15.6:0/279959274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4bc4164340 0x7f4bc4161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:33.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bc9288640 1 -- 172.21.15.6:0/279959274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4bc4164340 msgr2=0x7f4bc4161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bc9288640 1 --2- 172.21.15.6:0/279959274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4bc4164340 0x7f4bc4161040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bc9288640 1 -- 172.21.15.6:0/279959274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bc415fc20 msgr2=0x7f4bc4157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bc9288640 1 --2- 172.21.15.6:0/279959274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bc415fc20 0x7f4bc4157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bc9288640 1 -- 172.21.15.6:0/279959274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc009b30 con 0x7f4bc406c240 2023-07-21T22:38:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bc9a89640 1 --2- 172.21.15.6:0/279959274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4bc4164340 0x7f4bc4161040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bc9288640 1 --2- 172.21.15.6:0/279959274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bc406c240 0x7f4bc40c4450 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f4bc000c500 tx=0x7f4bc000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bb9ffb640 1 -- 172.21.15.6:0/279959274 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0005220 con 0x7f4bc406c240 2023-07-21T22:38:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bb9ffb640 1 -- 172.21.15.6:0/279959274 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc0005380 con 0x7f4bc406c240 2023-07-21T22:38:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bb9ffb640 1 -- 172.21.15.6:0/279959274 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc0007270 con 0x7f4bc406c240 2023-07-21T22:38:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.324+0000 7f4bcb4ec640 1 -- 172.21.15.6:0/279959274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc40b10a0 con 0x7f4bc406c240 2023-07-21T22:38:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.328+0000 7f4bcb4ec640 1 -- 172.21.15.6:0/279959274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc40b1660 con 0x7f4bc406c240 2023-07-21T22:38:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.328+0000 7f4bcb4ec640 1 -- 172.21.15.6:0/279959274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc40b1880 con 0x7f4bc406c240 2023-07-21T22:38:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.328+0000 7f4bb9ffb640 1 -- 172.21.15.6:0/279959274 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4bc00073d0 con 0x7f4bc406c240 2023-07-21T22:38:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.328+0000 7f4bb9ffb640 1 --2- 172.21.15.6:0/279959274 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f4ba80663d0 0x7f4ba8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.328+0000 7f4bb9ffb640 1 -- 172.21.15.6:0/279959274 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f4bc0083790 con 0x7f4bc406c240 2023-07-21T22:38:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.328+0000 7f4bc8a87640 1 --2- 172.21.15.6:0/279959274 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f4ba80663d0 0x7f4ba8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.332+0000 7f4bc8a87640 1 --2- 172.21.15.6:0/279959274 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f4ba80663d0 0x7f4ba8068880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4bc415bd10 tx=0x7f4bb4009040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:33.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.332+0000 7f4bb9ffb640 1 -- 172.21.15.6:0/279959274 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4bc0050a20 con 0x7f4bc406c240 2023-07-21T22:38:33.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.540+0000 7f4bcb4ec640 1 -- 172.21.15.6:0/279959274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4bc40678d0 con 0x7f4bc406c240 2023-07-21T22:38:33.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.544+0000 7f4bb9ffb640 1 -- 172.21.15.6:0/279959274 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+147 (secure 0 0 0) 0x7f4bc0054040 con 0x7f4bc406c240 2023-07-21T22:38:33.590 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-07-21T22:38:33.590 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA== 2023-07-21T22:38:33.591 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2023-07-21T22:38:33.591 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2023-07-21T22:38:33.591 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-21T22:38:33.591 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-07-21T22:38:33.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.548+0000 7f4bcb4ec640 1 -- 172.21.15.6:0/279959274 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f4ba80663d0 msgr2=0x7f4ba8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:33.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.548+0000 7f4bcb4ec640 1 --2- 172.21.15.6:0/279959274 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f4ba80663d0 0x7f4ba8068880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4bc415bd10 tx=0x7f4bb4009040 comp rx=0 tx=0).stop 2023-07-21T22:38:33.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.548+0000 7f4bcb4ec640 1 -- 172.21.15.6:0/279959274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bc406c240 msgr2=0x7f4bc40c4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:33.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.548+0000 7f4bcb4ec640 1 --2- 172.21.15.6:0/279959274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bc406c240 0x7f4bc40c4450 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f4bc000c500 tx=0x7f4bc000c9c0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.548+0000 7f4bcb4ec640 1 -- 172.21.15.6:0/279959274 shutdown_connections 2023-07-21T22:38:33.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.548+0000 7f4bcb4ec640 1 --2- 172.21.15.6:0/279959274 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f4ba80663d0 0x7f4ba8068880 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.548+0000 7f4bcb4ec640 1 --2- 172.21.15.6:0/279959274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4bc4164340 0x7f4bc4161040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.548+0000 7f4bcb4ec640 1 --2- 172.21.15.6:0/279959274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4bc415fc20 0x7f4bc4157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.548+0000 7f4bcb4ec640 1 --2- 172.21.15.6:0/279959274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bc406c240 0x7f4bc40c4450 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.548+0000 7f4bcb4ec640 1 -- 172.21.15.6:0/279959274 >> 172.21.15.6:0/279959274 conn(0x7f4bc40afac0 msgr2=0x7f4bc406f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:33.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.548+0000 7f4bcb4ec640 1 -- 172.21.15.6:0/279959274 shutdown_connections 2023-07-21T22:38:33.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.548+0000 7f4bcb4ec640 1 -- 172.21.15.6:0/279959274 wait complete. 2023-07-21T22:38:33.611 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:38:33.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.708+0000 7f77913fa640 1 Processor -- start 2023-07-21T22:38:33.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.712+0000 7f77913fa640 1 -- start start 2023-07-21T22:38:33.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.712+0000 7f77913fa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f778c15f500 0x7f778c06cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:33.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.712+0000 7f77913fa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f778c06ac50 0x7f778c0ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:33.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.712+0000 7f77913fa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f778c0cdc80 con 0x7f778c06d430 2023-07-21T22:38:33.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.712+0000 7f77913fa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f778c06e4c0 con 0x7f778c06ac50 2023-07-21T22:38:33.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.712+0000 7f77913fa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f778c06d940 con 0x7f778c15f500 2023-07-21T22:38:33.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.712+0000 7f778b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f778c06ac50 0x7f778c0ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:33.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.712+0000 7f778b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f778c06ac50 0x7f778c0ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45536/0 (socket says 172.21.15.6:45536) 2023-07-21T22:38:33.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.712+0000 7f778b7fe640 1 -- 172.21.15.6:0/1226247116 learned_addr learned my addr 172.21.15.6:0/1226247116 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:33.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.712+0000 7f778affd640 1 --2- 172.21.15.6:0/1226247116 >> v2:172.21.15.161:3300/0 conn(0x7f778c15f500 0x7f778c06cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:33.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.712+0000 7f778b7fe640 1 -- 172.21.15.6:0/1226247116 >> v2:172.21.15.161:3300/0 conn(0x7f778c15f500 msgr2=0x7f778c06cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:33.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.712+0000 7f778b7fe640 1 --2- 172.21.15.6:0/1226247116 >> v2:172.21.15.161:3300/0 conn(0x7f778c15f500 0x7f778c06cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.712+0000 7f778b7fe640 1 -- 172.21.15.6:0/1226247116 >> v1:172.21.15.161:6789/0 conn(0x7f778c06d430 legacy=0x7f778c06a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:33.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.712+0000 7f778b7fe640 1 -- 172.21.15.6:0/1226247116 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778c06dc20 con 0x7f778c06ac50 2023-07-21T22:38:33.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.716+0000 7f778b7fe640 1 --2- 172.21.15.6:0/1226247116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f778c06ac50 0x7f778c0ce0f0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f778c0b2c40 tx=0x7f778401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9fbac134bd12839 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.716+0000 7f778a7fc640 1 -- 172.21.15.6:0/1226247116 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77840a5780 con 0x7f778c06ac50 2023-07-21T22:38:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.716+0000 7f778a7fc640 1 -- 172.21.15.6:0/1226247116 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77840a58e0 con 0x7f778c06ac50 2023-07-21T22:38:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.716+0000 7f778a7fc640 1 -- 172.21.15.6:0/1226247116 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77840a5c70 con 0x7f778c06ac50 2023-07-21T22:38:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.716+0000 7f77913fa640 1 -- 172.21.15.6:0/1226247116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f778c06ac50 msgr2=0x7f778c0ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.716+0000 7f77913fa640 1 --2- 172.21.15.6:0/1226247116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f778c06ac50 0x7f778c0ce0f0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f778c0b2c40 tx=0x7f778401c9d0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.716+0000 7f77913fa640 1 -- 172.21.15.6:0/1226247116 shutdown_connections 2023-07-21T22:38:33.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.716+0000 7f77913fa640 1 --2- 172.21.15.6:0/1226247116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f778c06ac50 0x7f778c0ce0f0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.716+0000 7f77913fa640 1 --2- 172.21.15.6:0/1226247116 >> v2:172.21.15.161:3300/0 conn(0x7f778c15f500 0x7f778c06cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.716+0000 7f77913fa640 1 -- 172.21.15.6:0/1226247116 >> 172.21.15.6:0/1226247116 conn(0x7f778c0659d0 msgr2=0x7f778c099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:33.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.716+0000 7f77913fa640 1 -- 172.21.15.6:0/1226247116 shutdown_connections 2023-07-21T22:38:33.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.716+0000 7f77913fa640 1 -- 172.21.15.6:0/1226247116 wait complete. 2023-07-21T22:38:33.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f77913fa640 1 Processor -- start 2023-07-21T22:38:33.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f77913fa640 1 -- start start 2023-07-21T22:38:33.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f77913fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f778c06ac50 0x7f778c15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:33.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f77913fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f778c06d430 0x7f778c1523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:33.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f77913fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f778c15f500 0x7f778c0ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:33.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f77913fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c15d3b0 con 0x7f778c06d430 2023-07-21T22:38:33.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f77913fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c15c730 con 0x7f778c06ac50 2023-07-21T22:38:33.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f77913fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778c15ca10 con 0x7f778c15f500 2023-07-21T22:38:33.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f7783fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f778c06d430 0x7f778c1523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:33.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f7783fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f778c06d430 0x7f778c1523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45546/0 (socket says 172.21.15.6:45546) 2023-07-21T22:38:33.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f7783fff640 1 -- 172.21.15.6:0/1379282271 learned_addr learned my addr 172.21.15.6:0/1379282271 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:33.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f778affd640 1 --2- 172.21.15.6:0/1379282271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f778c06ac50 0x7f778c15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:33.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f778b7fe640 1 --2- 172.21.15.6:0/1379282271 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f778c15f500 0x7f778c0ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:33.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f7783fff640 1 -- 172.21.15.6:0/1379282271 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f778c15f500 msgr2=0x7f778c0ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:33.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f7783fff640 1 --2- 172.21.15.6:0/1379282271 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f778c15f500 0x7f778c0ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f7783fff640 1 -- 172.21.15.6:0/1379282271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f778c06ac50 msgr2=0x7f778c15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:33.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f7783fff640 1 --2- 172.21.15.6:0/1379282271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f778c06ac50 0x7f778c15d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f7783fff640 1 -- 172.21.15.6:0/1379282271 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7784009b30 con 0x7f778c06d430 2023-07-21T22:38:33.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f778b7fe640 1 --2- 172.21.15.6:0/1379282271 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f778c15f500 0x7f778c0ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:33.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f7783fff640 1 --2- 172.21.15.6:0/1379282271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f778c06d430 0x7f778c1523b0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f777400c4d0 tx=0x7f777400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:33.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f77837fe640 1 -- 172.21.15.6:0/1379282271 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77740052d0 con 0x7f778c06d430 2023-07-21T22:38:33.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f77837fe640 1 -- 172.21.15.6:0/1379282271 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7774005430 con 0x7f778c06d430 2023-07-21T22:38:33.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f77837fe640 1 -- 172.21.15.6:0/1379282271 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774012830 con 0x7f778c06d430 2023-07-21T22:38:33.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f77913fa640 1 -- 172.21.15.6:0/1379282271 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f778c15ccf0 con 0x7f778c06d430 2023-07-21T22:38:33.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f77913fa640 1 -- 172.21.15.6:0/1379282271 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778c152b10 con 0x7f778c06d430 2023-07-21T22:38:33.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.720+0000 7f77913fa640 1 -- 172.21.15.6:0/1379282271 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778c15d4f0 con 0x7f778c06d430 2023-07-21T22:38:33.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.724+0000 7f77837fe640 1 -- 172.21.15.6:0/1379282271 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7774012990 con 0x7f778c06d430 2023-07-21T22:38:33.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.724+0000 7f77837fe640 1 --2- 172.21.15.6:0/1379282271 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f776c0663a0 0x7f776c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:33.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.724+0000 7f77837fe640 1 -- 172.21.15.6:0/1379282271 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f7774083980 con 0x7f778c06d430 2023-07-21T22:38:33.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.724+0000 7f778affd640 1 --2- 172.21.15.6:0/1379282271 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f776c0663a0 0x7f776c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:33.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.724+0000 7f778affd640 1 --2- 172.21.15.6:0/1379282271 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f776c0663a0 0x7f776c068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f777c009aa0 tx=0x7f777c006f90 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:33.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.728+0000 7f77837fe640 1 -- 172.21.15.6:0/1379282271 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f778c15d4f0 con 0x7f778c06d430 2023-07-21T22:38:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.916+0000 7f77913fa640 1 -- 172.21.15.6:0/1379282271 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f778c15d4f0 con 0x7f778c06d430 2023-07-21T22:38:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.916+0000 7f77837fe640 1 -- 172.21.15.6:0/1379282271 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4664 (secure 0 0 0) 0x7f778c15d4f0 con 0x7f778c06d430 2023-07-21T22:38:33.964 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:33.964 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1816246921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1816246921},{"type":"v1","addr":"172.21.15.6:6834","nonce":1816246921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7490,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/543588806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":543588806},{"type":"v1","addr":"172.21.15.6:6835","nonce":543588806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3250690150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3250690150},{"type":"v1","addr":"172.21.15.161:6836","nonce":3250690150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:38:23.444629+0000","modified":"2023-07-21T22:38:27.099144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8455":{"gid":8455,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/29499426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":29499426},{"type":"v1","addr":"172.21.15.161:6837","nonce":29499426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-21T22:38:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 62 2023-07-21T22:38:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.920+0000 7f77913fa640 1 -- 172.21.15.6:0/1379282271 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f776c0663a0 msgr2=0x7f776c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.920+0000 7f77913fa640 1 --2- 172.21.15.6:0/1379282271 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f776c0663a0 0x7f776c068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f777c009aa0 tx=0x7f777c006f90 comp rx=0 tx=0).stop 2023-07-21T22:38:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.920+0000 7f77913fa640 1 -- 172.21.15.6:0/1379282271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f778c06d430 msgr2=0x7f778c1523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.920+0000 7f77913fa640 1 --2- 172.21.15.6:0/1379282271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f778c06d430 0x7f778c1523b0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f777400c4d0 tx=0x7f777400c990 comp rx=0 tx=0).stop 2023-07-21T22:38:33.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.920+0000 7f77913fa640 1 -- 172.21.15.6:0/1379282271 shutdown_connections 2023-07-21T22:38:33.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.920+0000 7f77913fa640 1 --2- 172.21.15.6:0/1379282271 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f776c0663a0 0x7f776c068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.920+0000 7f77913fa640 1 --2- 172.21.15.6:0/1379282271 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f778c15f500 0x7f778c0ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.920+0000 7f77913fa640 1 --2- 172.21.15.6:0/1379282271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f778c06d430 0x7f778c1523b0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.920+0000 7f77913fa640 1 --2- 172.21.15.6:0/1379282271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f778c06ac50 0x7f778c15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.920+0000 7f77913fa640 1 -- 172.21.15.6:0/1379282271 >> 172.21.15.6:0/1379282271 conn(0x7f778c0659d0 msgr2=0x7f778c0cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.920+0000 7f77913fa640 1 -- 172.21.15.6:0/1379282271 shutdown_connections 2023-07-21T22:38:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:33.920+0000 7f77913fa640 1 -- 172.21.15.6:0/1379282271 wait complete. 2023-07-21T22:38:34.386 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T22:38:23.444629+0000', 'modified': '2023-07-21T22:38:27.099144+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8455}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8455': {'gid': 8455, 'name': 'b', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.161:6837/29499426', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6835', 'nonce': 29499426}, {'type': 'v1', 'addr': '172.21.15.161:6837', 'nonce': 29499426}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T22:38:34.386 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T22:38:34.387 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-21T22:38:34.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.492+0000 7f34fd631640 1 Processor -- start 2023-07-21T22:38:34.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.492+0000 7f34fd631640 1 -- start start 2023-07-21T22:38:34.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.492+0000 7f34fd631640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f34f80b7d90 0x7f34f80cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.492+0000 7f34fd631640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f80d0f60 con 0x7f34f815f3f0 2023-07-21T22:38:34.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.492+0000 7f34fd631640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f80d0390 con 0x7f34f80d13f0 2023-07-21T22:38:34.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.492+0000 7f34fd631640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f80d0630 con 0x7f34f80b7d90 2023-07-21T22:38:34.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.492+0000 7f34f7fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f34f815f3f0 0x7f34f80b7680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52628/0 (socket says 172.21.15.6:52628) 2023-07-21T22:38:34.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.492+0000 7f34f7fff640 1 -- 172.21.15.6:0/3007313816 learned_addr learned my addr 172.21.15.6:0/3007313816 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:34.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.492+0000 7f34f77fe640 1 --2- 172.21.15.6:0/3007313816 >> v2:172.21.15.6:3300/0 conn(0x7f34f80b7d90 0x7f34f80cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.492+0000 7f34f6ffd640 1 -- 172.21.15.6:0/3007313816 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581751137 0 0) 0x7f34f80d0f60 con 0x7f34f815f3f0 2023-07-21T22:38:34.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.492+0000 7f34f6ffd640 1 -- 172.21.15.6:0/3007313816 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34e0003530 con 0x7f34f815f3f0 2023-07-21T22:38:34.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.492+0000 7f34f77fe640 1 -- 172.21.15.6:0/3007313816 >> v1:172.21.15.161:6789/0 conn(0x7f34f80d13f0 legacy=0x7f34f80ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:34.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.492+0000 7f34f77fe640 1 -- 172.21.15.6:0/3007313816 >> v1:172.21.15.6:6789/0 conn(0x7f34f815f3f0 legacy=0x7f34f80b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:34.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.492+0000 7f34f77fe640 1 -- 172.21.15.6:0/3007313816 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f80d0910 con 0x7f34f80b7d90 2023-07-21T22:38:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.496+0000 7f34f77fe640 1 --2- 172.21.15.6:0/3007313816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f80b7d90 0x7f34f80cc9a0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0097c0 tx=0x7f34ec01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcac5a42bc0635af server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:34.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.496+0000 7f34f6ffd640 1 -- 172.21.15.6:0/3007313816 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec0ab600 con 0x7f34f80b7d90 2023-07-21T22:38:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.496+0000 7f34f6ffd640 1 -- 172.21.15.6:0/3007313816 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec0a7050 con 0x7f34f80b7d90 2023-07-21T22:38:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.496+0000 7f34f6ffd640 1 -- 172.21.15.6:0/3007313816 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec0ab980 con 0x7f34f80b7d90 2023-07-21T22:38:34.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.496+0000 7f34fd631640 1 -- 172.21.15.6:0/3007313816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f80b7d90 msgr2=0x7f34f80cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:34.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.496+0000 7f34fd631640 1 --2- 172.21.15.6:0/3007313816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f80b7d90 0x7f34f80cc9a0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0097c0 tx=0x7f34ec01c3f0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.496+0000 7f34fd631640 1 -- 172.21.15.6:0/3007313816 shutdown_connections 2023-07-21T22:38:34.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.496+0000 7f34fd631640 1 --2- 172.21.15.6:0/3007313816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f80b7d90 0x7f34f80cc9a0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.496+0000 7f34fd631640 1 -- 172.21.15.6:0/3007313816 >> 172.21.15.6:0/3007313816 conn(0x7f34f8069f50 msgr2=0x7f34f806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:34.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.496+0000 7f34fd631640 1 -- 172.21.15.6:0/3007313816 shutdown_connections 2023-07-21T22:38:34.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.496+0000 7f34fd631640 1 -- 172.21.15.6:0/3007313816 wait complete. 2023-07-21T22:38:34.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34fd631640 1 Processor -- start 2023-07-21T22:38:34.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34fd631640 1 -- start start 2023-07-21T22:38:34.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34fd631640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f80b7d90 0x7f34f8155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34fd631640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34f80d13f0 0x7f34f80b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34fd631640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34f815f3f0 0x7f34f80b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34fd631640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f815b670 con 0x7f34f80b7d90 2023-07-21T22:38:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34fd631640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f815c680 con 0x7f34f815f3f0 2023-07-21T22:38:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34fd631640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f815b8c0 con 0x7f34f80d13f0 2023-07-21T22:38:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34f7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f80b7d90 0x7f34f8155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34f7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f80b7d90 0x7f34f8155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45554/0 (socket says 172.21.15.6:45554) 2023-07-21T22:38:34.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34f7fff640 1 -- 172.21.15.6:0/3368534963 learned_addr learned my addr 172.21.15.6:0/3368534963 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:34.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34f77fe640 1 --2- 172.21.15.6:0/3368534963 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34f80d13f0 0x7f34f80b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34fce30640 1 --2- 172.21.15.6:0/3368534963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34f815f3f0 0x7f34f80b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34f7fff640 1 -- 172.21.15.6:0/3368534963 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34f80d13f0 msgr2=0x7f34f80b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34f7fff640 1 --2- 172.21.15.6:0/3368534963 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34f80d13f0 0x7f34f80b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34f7fff640 1 -- 172.21.15.6:0/3368534963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34f815f3f0 msgr2=0x7f34f80b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34f7fff640 1 --2- 172.21.15.6:0/3368534963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34f815f3f0 0x7f34f80b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34f7fff640 1 -- 172.21.15.6:0/3368534963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec009420 con 0x7f34f80b7d90 2023-07-21T22:38:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34fce30640 1 --2- 172.21.15.6:0/3368534963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34f815f3f0 0x7f34f80b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34f7fff640 1 --2- 172.21.15.6:0/3368534963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f80b7d90 0x7f34f8155ff0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f34e800c420 tx=0x7f34e800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34f4ff9640 1 -- 172.21.15.6:0/3368534963 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e8005cf0 con 0x7f34f80b7d90 2023-07-21T22:38:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34f4ff9640 1 -- 172.21.15.6:0/3368534963 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e8005e50 con 0x7f34f80b7d90 2023-07-21T22:38:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34fd631640 1 -- 172.21.15.6:0/3368534963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f815bba0 con 0x7f34f80b7d90 2023-07-21T22:38:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34f4ff9640 1 -- 172.21.15.6:0/3368534963 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e80072d0 con 0x7f34f80b7d90 2023-07-21T22:38:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.500+0000 7f34fd631640 1 -- 172.21.15.6:0/3368534963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f815c160 con 0x7f34f80b7d90 2023-07-21T22:38:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.504+0000 7f34f4ff9640 1 -- 172.21.15.6:0/3368534963 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f34e8007430 con 0x7f34f80b7d90 2023-07-21T22:38:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.504+0000 7f34f4ff9640 1 --2- 172.21.15.6:0/3368534963 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f34e40663a0 0x7f34e4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.504+0000 7f34f4ff9640 1 -- 172.21.15.6:0/3368534963 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f34e80834d0 con 0x7f34f80b7d90 2023-07-21T22:38:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.504+0000 7f34f77fe640 1 --2- 172.21.15.6:0/3368534963 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f34e40663a0 0x7f34e4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.504+0000 7f3501bf2000 1 Processor -- start 2023-07-21T22:38:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.504+0000 7f3501bf2000 1 -- start start 2023-07-21T22:38:34.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f34f77fe640 1 --2- 172.21.15.6:0/3368534963 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f34e40663a0 0x7f34e4068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0ad000 tx=0x7f34ec0a6000 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f3501bf2000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955a1f00 0x5633955a22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f3501bf2000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5633955a2810 0x563395558370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f3501bf2000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 0x563395558c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f3501bf2000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56339541f880 con 0x5633955588b0 2023-07-21T22:38:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f3501bf2000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563395359840 con 0x5633955a2810 2023-07-21T22:38:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f3501bf2000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x5633953ad2e0 con 0x5633955a1f00 2023-07-21T22:38:34.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f34fce30640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 0x563395558c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f34fce30640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 0x563395558c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45558/0 (socket says 172.21.15.6:45558) 2023-07-21T22:38:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f34fce30640 1 -- 172.21.15.6:0/611604601 learned_addr learned my addr 172.21.15.6:0/611604601 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f34f77fe640 1 --2- 172.21.15.6:0/611604601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5633955a2810 0x563395558370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f34f7fff640 1 --2- 172.21.15.6:0/611604601 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955a1f00 0x5633955a22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f34fce30640 1 -- 172.21.15.6:0/611604601 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955a1f00 msgr2=0x5633955a22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f34fce30640 1 --2- 172.21.15.6:0/611604601 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955a1f00 0x5633955a22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f34fce30640 1 -- 172.21.15.6:0/611604601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5633955a2810 msgr2=0x563395558370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:34.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f34fce30640 1 --2- 172.21.15.6:0/611604601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5633955a2810 0x563395558370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f34fce30640 1 -- 172.21.15.6:0/611604601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5633950a2890 con 0x5633955588b0 2023-07-21T22:38:34.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f34fce30640 1 --2- 172.21.15.6:0/611604601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 0x563395558c80 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f34f0001d20 tx=0x7f34f00021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e0df5add4f997d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:34.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f34ddffb640 1 -- 172.21.15.6:0/611604601 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f0003b90 con 0x5633955588b0 2023-07-21T22:38:34.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f34ddffb640 1 -- 172.21.15.6:0/611604601 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f0003cf0 con 0x5633955588b0 2023-07-21T22:38:34.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f34ddffb640 1 -- 172.21.15.6:0/611604601 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f000eb20 con 0x5633955588b0 2023-07-21T22:38:34.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f3501bf2000 1 -- 172.21.15.6:0/611604601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 msgr2=0x563395558c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:34.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f3501bf2000 1 --2- 172.21.15.6:0/611604601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 0x563395558c80 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f34f0001d20 tx=0x7f34f00021e0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f3501bf2000 1 -- 172.21.15.6:0/611604601 shutdown_connections 2023-07-21T22:38:34.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f3501bf2000 1 --2- 172.21.15.6:0/611604601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 0x563395558c80 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f3501bf2000 1 --2- 172.21.15.6:0/611604601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5633955a2810 0x563395558370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f3501bf2000 1 --2- 172.21.15.6:0/611604601 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955a1f00 0x5633955a22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f3501bf2000 1 -- 172.21.15.6:0/611604601 >> 172.21.15.6:0/611604601 conn(0x56339555ea10 msgr2=0x563395556c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:34.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f3501bf2000 1 -- 172.21.15.6:0/611604601 shutdown_connections 2023-07-21T22:38:34.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f3501bf2000 1 -- 172.21.15.6:0/611604601 wait complete. 2023-07-21T22:38:34.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f3501bf2000 1 -- start start 2023-07-21T22:38:34.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.508+0000 7f3501bf2000 1 Processor -- start 2023-07-21T22:38:34.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f3501bf2000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955588b0 0x5633955638e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f3501bf2000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955a1f00 0x563395563e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f3501bf2000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5633955a2810 0x563395564360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f3501bf2000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633953a6380 con 0x5633955a1f00 2023-07-21T22:38:34.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f3501bf2000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563395362ae0 con 0x5633955a2810 2023-07-21T22:38:34.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f3501bf2000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x563395362780 con 0x5633955588b0 2023-07-21T22:38:34.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f3501bf2000 10 client.0 _ll_register_callbacks cb 0x563395544240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:38:34.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34f77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955a1f00 0x563395563e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34f7fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955588b0 0x5633955638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34f7fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955588b0 0x5633955638e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:42786/0 (socket says 172.21.15.6:42786) 2023-07-21T22:38:34.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34f77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955a1f00 0x563395563e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45574/0 (socket says 172.21.15.6:45574) 2023-07-21T22:38:34.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34f7fff640 1 -- 172.21.15.6:0/34564254 learned_addr learned my addr 172.21.15.6:0/34564254 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:34.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34fce30640 1 --2- 172.21.15.6:0/34564254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5633955a2810 0x563395564360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34f7fff640 1 -- 172.21.15.6:0/34564254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5633955a2810 msgr2=0x563395564360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:34.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34f7fff640 1 --2- 172.21.15.6:0/34564254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5633955a2810 0x563395564360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34f7fff640 1 -- 172.21.15.6:0/34564254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955a1f00 msgr2=0x563395563e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:34.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34f7fff640 1 --2- 172.21.15.6:0/34564254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955a1f00 0x563395563e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34f7fff640 1 -- 172.21.15.6:0/34564254 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f000f040 con 0x5633955588b0 2023-07-21T22:38:34.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34f77fe640 1 --2- 172.21.15.6:0/34564254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955a1f00 0x563395563e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:34.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34f7fff640 1 --2- 172.21.15.6:0/34564254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955588b0 0x5633955638e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f34e8054450 tx=0x7f34e8052860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c877d8a0c6821e03 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:34.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.161:3301/0 2023-07-21T22:38:34.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34d6ffd640 1 -- 172.21.15.6:0/34564254 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e805a270 con 0x5633955588b0 2023-07-21T22:38:34.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f3501bf2000 1 -- 172.21.15.6:0/34564254 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56339536da20 con 0x5633955588b0 2023-07-21T22:38:34.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34d6ffd640 1 -- 172.21.15.6:0/34564254 <== mon.2 v2:172.21.15.161:3301/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f34e805c2d0 con 0x5633955588b0 2023-07-21T22:38:34.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34d6ffd640 1 -- 172.21.15.6:0/34564254 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34e805c4b0 con 0x5633955588b0 2023-07-21T22:38:34.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f3501bf2000 10 client.7589 fetch_fsmap learned FSMap version 62 2023-07-21T22:38:34.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f3501bf2000 1 -- 172.21.15.6:0/34564254 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x56339536ad10 con 0x5633955588b0 2023-07-21T22:38:34.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34d6ffd640 1 -- 172.21.15.6:0/34564254 <== mon.2 v2:172.21.15.161:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e806f030 con 0x5633955588b0 2023-07-21T22:38:34.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34d6ffd640 1 -- 172.21.15.6:0/34564254 <== mon.2 v2:172.21.15.161:3301/0 5 ==== fsmap(e 62) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f34e8081260 con 0x5633955588b0 2023-07-21T22:38:34.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f3501bf2000 10 client.7589 fetch_fsmap finished waiting for FSMap version 62 2023-07-21T22:38:34.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f3501bf2000 10 client.7589 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-21T22:38:34.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f3501bf2000 20 client.7589 populate_metadata read hostname 'smithi006' 2023-07-21T22:38:34.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f3501bf2000 1 --2- 172.21.15.6:0/34564254 >> [v2:172.21.15.161:6835/29499426,v1:172.21.15.161:6837/29499426] conn(0x563395564c00 0x5633955b3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f3501bf2000 4 client.7589 mds_command: new command op to 8455 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:38:34.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f3501bf2000 1 -- 172.21.15.6:0/34564254 --> [v2:172.21.15.161:6835/29499426,v1:172.21.15.161:6837/29499426] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5633953d4ec0 con 0x563395564c00 2023-07-21T22:38:34.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34f77fe640 1 --2- 172.21.15.6:0/34564254 >> [v2:172.21.15.161:6835/29499426,v1:172.21.15.161:6837/29499426] conn(0x563395564c00 0x5633955b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34f77fe640 1 --2- 172.21.15.6:0/34564254 >> [v2:172.21.15.161:6835/29499426,v1:172.21.15.161:6837/29499426] conn(0x563395564c00 0x5633955b3450 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f2449a0d22b6f9b server_cookie=a6afc864225dd113 in_seq=0 out_seq=0 2023-07-21T22:38:34.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.512+0000 7f34d6ffd640 10 client.7589 ms_handle_connect on v2:172.21.15.161:6835/29499426 2023-07-21T22:38:34.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.516+0000 7f34d6ffd640 1 -- 172.21.15.6:0/34564254 <== mds.0 v2:172.21.15.161:6835/29499426 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5633953d4ec0 con 0x563395564c00 2023-07-21T22:38:34.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.516+0000 7f34d6ffd640 10 client.7589 handle_command_reply: tid=0 2023-07-21T22:38:34.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.516+0000 7f3501bf2000 1 client.7589 shutdown 2023-07-21T22:38:34.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.516+0000 7f3501bf2000 1 -- 172.21.15.6:0/34564254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955588b0 msgr2=0x5633955638e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:34.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.516+0000 7f3501bf2000 1 --2- 172.21.15.6:0/34564254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955588b0 0x5633955638e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f34e8054450 tx=0x7f34e8052860 comp rx=0 tx=0).stop 2023-07-21T22:38:34.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.516+0000 7f3501bf2000 1 -- 172.21.15.6:0/34564254 shutdown_connections 2023-07-21T22:38:34.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.516+0000 7f3501bf2000 1 --2- 172.21.15.6:0/34564254 >> [v2:172.21.15.161:6835/29499426,v1:172.21.15.161:6837/29499426] conn(0x563395564c00 0x5633955b3450 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.516+0000 7f3501bf2000 1 --2- 172.21.15.6:0/34564254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5633955a2810 0x563395564360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.516+0000 7f3501bf2000 1 --2- 172.21.15.6:0/34564254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955a1f00 0x563395563e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.516+0000 7f3501bf2000 1 --2- 172.21.15.6:0/34564254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955588b0 0x5633955638e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.516+0000 7f34d6ffd640 0 client.7589 ms_handle_reset on v2:172.21.15.161:6835/29499426 2023-07-21T22:38:34.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.516+0000 7f3501bf2000 1 -- 172.21.15.6:0/34564254 >> 172.21.15.6:0/34564254 conn(0x56339555ea10 msgr2=0x563395557350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:34.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.516+0000 7f3501bf2000 1 -- 172.21.15.6:0/34564254 shutdown_connections 2023-07-21T22:38:34.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.516+0000 7f3501bf2000 1 -- 172.21.15.6:0/34564254 wait complete. 2023-07-21T22:38:34.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.516+0000 7f3501bf2000 20 client.7589 trim_cache size 0 max 16384 2023-07-21T22:38:34.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f3501bf2000 1 Processor -- start 2023-07-21T22:38:34.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f3501bf2000 1 -- start start 2023-07-21T22:38:34.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f3501bf2000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 0x5633955a1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f3501bf2000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5633955a1f00 0x5633955b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f3501bf2000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955a2810 0x5633955b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f3501bf2000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56339555bee0 con 0x5633955588b0 2023-07-21T22:38:34.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f3501bf2000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x563395063940 con 0x5633955a1f00 2023-07-21T22:38:34.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f3501bf2000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x5633953a3b90 con 0x5633955a2810 2023-07-21T22:38:34.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f34f7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 0x5633955a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f34f7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 0x5633955a1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45576/0 (socket says 172.21.15.6:45576) 2023-07-21T22:38:34.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f34f7fff640 1 -- 172.21.15.6:0/3702364352 learned_addr learned my addr 172.21.15.6:0/3702364352 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:34.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f34f77fe640 1 --2- 172.21.15.6:0/3702364352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5633955a1f00 0x5633955b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f34fce30640 1 --2- 172.21.15.6:0/3702364352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955a2810 0x5633955b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f34f7fff640 1 -- 172.21.15.6:0/3702364352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955a2810 msgr2=0x5633955b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:34.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f34f7fff640 1 --2- 172.21.15.6:0/3702364352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955a2810 0x5633955b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f34f7fff640 1 -- 172.21.15.6:0/3702364352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5633955a1f00 msgr2=0x5633955b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:34.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f34f7fff640 1 --2- 172.21.15.6:0/3702364352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5633955a1f00 0x5633955b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f34f7fff640 1 -- 172.21.15.6:0/3702364352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56339555af80 con 0x5633955588b0 2023-07-21T22:38:34.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f34f7fff640 1 --2- 172.21.15.6:0/3702364352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 0x5633955a1800 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f34e80078f0 tx=0x7f34e801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e423f172584699 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:34.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f34de7fc640 1 -- 172.21.15.6:0/3702364352 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e800e040 con 0x5633955588b0 2023-07-21T22:38:34.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f34de7fc640 1 -- 172.21.15.6:0/3702364352 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e806f070 con 0x5633955588b0 2023-07-21T22:38:34.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f34de7fc640 1 -- 172.21.15.6:0/3702364352 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e805c2d0 con 0x5633955588b0 2023-07-21T22:38:34.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f3501bf2000 1 -- 172.21.15.6:0/3702364352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 msgr2=0x5633955a1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:34.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f3501bf2000 1 --2- 172.21.15.6:0/3702364352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 0x5633955a1800 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f34e80078f0 tx=0x7f34e801e000 comp rx=0 tx=0).stop 2023-07-21T22:38:34.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f3501bf2000 1 -- 172.21.15.6:0/3702364352 shutdown_connections 2023-07-21T22:38:34.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f3501bf2000 1 --2- 172.21.15.6:0/3702364352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955a2810 0x5633955b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f3501bf2000 1 --2- 172.21.15.6:0/3702364352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5633955a1f00 0x5633955b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f3501bf2000 1 --2- 172.21.15.6:0/3702364352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 0x5633955a1800 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f3501bf2000 1 -- 172.21.15.6:0/3702364352 >> 172.21.15.6:0/3702364352 conn(0x56339555ea10 msgr2=0x5633955b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:34.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f3501bf2000 1 -- 172.21.15.6:0/3702364352 shutdown_connections 2023-07-21T22:38:34.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f3501bf2000 1 -- 172.21.15.6:0/3702364352 wait complete. 2023-07-21T22:38:34.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.532+0000 7f3501bf2000 1 -- start start 2023-07-21T22:38:34.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f3501bf2000 1 Processor -- start 2023-07-21T22:38:34.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f3501bf2000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 0x5633955b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f3501bf2000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5633955a1f00 0x5633955b4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f3501bf2000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955a2810 0x5633955b4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f3501bf2000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5633953a8ee0 con 0x5633955588b0 2023-07-21T22:38:34.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f3501bf2000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x56339536d630 con 0x5633955a1f00 2023-07-21T22:38:34.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f3501bf2000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x563395375320 con 0x5633955a2810 2023-07-21T22:38:34.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f3501bf2000 10 client.0 _ll_register_callbacks cb 0x563395524430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:38:34.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34f7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 0x5633955b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34f7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 0x5633955b3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45580/0 (socket says 172.21.15.6:45580) 2023-07-21T22:38:34.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34f7fff640 1 -- 172.21.15.6:0/3741529803 learned_addr learned my addr 172.21.15.6:0/3741529803 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:34.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34f77fe640 1 --2- 172.21.15.6:0/3741529803 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5633955a1f00 0x5633955b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34fce30640 1 --2- 172.21.15.6:0/3741529803 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955a2810 0x5633955b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34f7fff640 1 -- 172.21.15.6:0/3741529803 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955a2810 msgr2=0x5633955b4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:34.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34f7fff640 1 --2- 172.21.15.6:0/3741529803 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955a2810 0x5633955b4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34f7fff640 1 -- 172.21.15.6:0/3741529803 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5633955a1f00 msgr2=0x5633955b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:34.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34f7fff640 1 --2- 172.21.15.6:0/3741529803 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5633955a1f00 0x5633955b4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34f7fff640 1 -- 172.21.15.6:0/3741529803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56339536ad10 con 0x5633955588b0 2023-07-21T22:38:34.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34fce30640 1 --2- 172.21.15.6:0/3741529803 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955a2810 0x5633955b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:34.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34f7fff640 1 --2- 172.21.15.6:0/3741529803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 0x5633955b3c10 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f34e8054450 tx=0x7f34e801e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29dc173fb984e517 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:34.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:38:34.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34d6ffd640 1 -- 172.21.15.6:0/3741529803 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e800e040 con 0x5633955588b0 2023-07-21T22:38:34.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34d6ffd640 1 -- 172.21.15.6:0/3741529803 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f34e8081260 con 0x5633955588b0 2023-07-21T22:38:34.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f3501bf2000 1 -- 172.21.15.6:0/3741529803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5633953a4cd0 con 0x5633955588b0 2023-07-21T22:38:34.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34d6ffd640 1 -- 172.21.15.6:0/3741529803 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34e8081420 con 0x5633955588b0 2023-07-21T22:38:34.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f3501bf2000 10 client.8937 fetch_fsmap learned FSMap version 62 2023-07-21T22:38:34.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f3501bf2000 1 -- 172.21.15.6:0/3741529803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x563395350fa0 con 0x5633955588b0 2023-07-21T22:38:34.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34d6ffd640 1 -- 172.21.15.6:0/3741529803 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5633953a4cd0 con 0x5633955588b0 2023-07-21T22:38:34.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34d6ffd640 1 -- 172.21.15.6:0/3741529803 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 62) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f34e80502b0 con 0x5633955588b0 2023-07-21T22:38:34.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f3501bf2000 10 client.8937 fetch_fsmap finished waiting for FSMap version 62 2023-07-21T22:38:34.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f3501bf2000 10 client.8937 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-21T22:38:34.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f3501bf2000 20 client.8937 populate_metadata read hostname 'smithi006' 2023-07-21T22:38:34.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f3501bf2000 1 --2- 172.21.15.6:0/3741529803 >> [v2:172.21.15.161:6835/29499426,v1:172.21.15.161:6837/29499426] conn(0x5633955b4bd0 0x5633955b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f3501bf2000 4 client.8937 mds_command: new command op to 8455 tid=0[{"prefix": "status"}] 2023-07-21T22:38:34.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f3501bf2000 1 -- 172.21.15.6:0/3741529803 --> [v2:172.21.15.161:6835/29499426,v1:172.21.15.161:6837/29499426] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56339539f360 con 0x5633955b4bd0 2023-07-21T22:38:34.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34f77fe640 1 --2- 172.21.15.6:0/3741529803 >> [v2:172.21.15.161:6835/29499426,v1:172.21.15.161:6837/29499426] conn(0x5633955b4bd0 0x5633955b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34d6ffd640 10 client.8937 ms_handle_connect on v2:172.21.15.161:6835/29499426 2023-07-21T22:38:34.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34f77fe640 1 --2- 172.21.15.6:0/3741529803 >> [v2:172.21.15.161:6835/29499426,v1:172.21.15.161:6837/29499426] conn(0x5633955b4bd0 0x5633955b4fa0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9bf14ab78d287cb server_cookie=a5f1c6d930a73d22 in_seq=0 out_seq=0 2023-07-21T22:38:34.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34d6ffd640 1 -- 172.21.15.6:0/3741529803 <== mds.0 v2:172.21.15.161:6835/29499426 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x56339539f360 con 0x5633955b4bd0 2023-07-21T22:38:34.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f34d6ffd640 10 client.8937 handle_command_reply: tid=0 2023-07-21T22:38:34.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.536+0000 7f3501bf2000 1 client.8937 shutdown 2023-07-21T22:38:34.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f3501bf2000 1 -- 172.21.15.6:0/3741529803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 msgr2=0x5633955b3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:34.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f3501bf2000 1 --2- 172.21.15.6:0/3741529803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 0x5633955b3c10 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f34e8054450 tx=0x7f34e801e070 comp rx=0 tx=0).stop 2023-07-21T22:38:34.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f3501bf2000 1 -- 172.21.15.6:0/3741529803 shutdown_connections 2023-07-21T22:38:34.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f3501bf2000 1 --2- 172.21.15.6:0/3741529803 >> [v2:172.21.15.161:6835/29499426,v1:172.21.15.161:6837/29499426] conn(0x5633955b4bd0 0x5633955b4fa0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f3501bf2000 1 --2- 172.21.15.6:0/3741529803 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5633955a2810 0x5633955b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f3501bf2000 1 --2- 172.21.15.6:0/3741529803 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5633955a1f00 0x5633955b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f34d6ffd640 0 client.8937 ms_handle_reset on v2:172.21.15.161:6835/29499426 2023-07-21T22:38:34.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f3501bf2000 1 --2- 172.21.15.6:0/3741529803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5633955588b0 0x5633955b3c10 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f3501bf2000 1 -- 172.21.15.6:0/3741529803 >> 172.21.15.6:0/3741529803 conn(0x56339555ea10 msgr2=0x56339555e020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:34.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f3501bf2000 1 -- 172.21.15.6:0/3741529803 shutdown_connections 2023-07-21T22:38:34.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f3501bf2000 1 -- 172.21.15.6:0/3741529803 wait complete. 2023-07-21T22:38:34.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f3501bf2000 20 client.8937 trim_cache size 0 max 16384 2023-07-21T22:38:34.594 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:38:34.594 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "f3073df4-6cd1-4503-bd2e-d3e98fa18bdf", 2023-07-21T22:38:34.595 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-07-21T22:38:34.595 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 8455, 2023-07-21T22:38:34.595 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-07-21T22:38:34.595 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-07-21T22:38:34.596 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-07-21T22:38:34.596 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.446958886999999, 2023-07-21T22:38:34.596 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 62, 2023-07-21T22:38:34.596 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 143, 2023-07-21T22:38:34.596 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 143, 2023-07-21T22:38:34.597 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 16.392501785 2023-07-21T22:38:34.597 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:38:34.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f34fd631640 1 -- 172.21.15.6:0/3368534963 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f34e40663a0 msgr2=0x7f34e4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:34.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f34fd631640 1 --2- 172.21.15.6:0/3368534963 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f34e40663a0 0x7f34e4068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0ad000 tx=0x7f34ec0a6000 comp rx=0 tx=0).stop 2023-07-21T22:38:34.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f34fd631640 1 -- 172.21.15.6:0/3368534963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f80b7d90 msgr2=0x7f34f8155ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f34fd631640 1 --2- 172.21.15.6:0/3368534963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f80b7d90 0x7f34f8155ff0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f34e800c420 tx=0x7f34e800c8e0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f34fd631640 1 -- 172.21.15.6:0/3368534963 shutdown_connections 2023-07-21T22:38:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f34fd631640 1 --2- 172.21.15.6:0/3368534963 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f34e40663a0 0x7f34e4068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f34fd631640 1 --2- 172.21.15.6:0/3368534963 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34f815f3f0 0x7f34f80b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f34fd631640 1 --2- 172.21.15.6:0/3368534963 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34f80d13f0 0x7f34f80b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f34fd631640 1 --2- 172.21.15.6:0/3368534963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f80b7d90 0x7f34f8155ff0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f34fd631640 1 -- 172.21.15.6:0/3368534963 >> 172.21.15.6:0/3368534963 conn(0x7f34f8069f50 msgr2=0x7f34f80cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:34.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f34fd631640 1 -- 172.21.15.6:0/3368534963 shutdown_connections 2023-07-21T22:38:34.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.540+0000 7f34fd631640 1 -- 172.21.15.6:0/3368534963 wait complete. 2023-07-21T22:38:34.604 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:38:34.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.704+0000 7fb6f2382640 1 Processor -- start 2023-07-21T22:38:34.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.704+0000 7fb6f2382640 1 -- start start 2023-07-21T22:38:34.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.704+0000 7fb6f2382640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6ec0c8ad0 0x7fb6ec0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.704+0000 7fb6f2382640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ec0cc700 con 0x7fb6ec158ce0 2023-07-21T22:38:34.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.704+0000 7fb6f2382640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ec0b0ff0 con 0x7fb6ec0c9560 2023-07-21T22:38:34.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.704+0000 7fb6f2382640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec0c99e0 con 0x7fb6ec0c8ad0 2023-07-21T22:38:34.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.704+0000 7fb6ebfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb6ec158ce0 0x7fb6ec070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:52640/0 (socket says 172.21.15.6:52640) 2023-07-21T22:38:34.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.704+0000 7fb6ebfff640 1 -- 172.21.15.6:0/2485586680 learned_addr learned my addr 172.21.15.6:0/2485586680 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:34.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.704+0000 7fb6eb7fe640 1 --2- 172.21.15.6:0/2485586680 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6ec0c8ad0 0x7fb6ec0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.704+0000 7fb6eaffd640 1 -- 172.21.15.6:0/2485586680 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496447733 0 0) 0x7fb6ec0cc700 con 0x7fb6ec158ce0 2023-07-21T22:38:34.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.704+0000 7fb6eaffd640 1 -- 172.21.15.6:0/2485586680 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6d4003530 con 0x7fb6ec158ce0 2023-07-21T22:38:34.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.704+0000 7fb6eaffd640 1 -- 172.21.15.6:0/2485586680 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2815182772 0 0) 0x7fb6d4003530 con 0x7fb6ec158ce0 2023-07-21T22:38:34.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.704+0000 7fb6eb7fe640 1 -- 172.21.15.6:0/2485586680 >> v1:172.21.15.161:6789/0 conn(0x7fb6ec0c9560 legacy=0x7fb6ec0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:34.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.704+0000 7fb6eb7fe640 1 -- 172.21.15.6:0/2485586680 >> v1:172.21.15.6:6789/0 conn(0x7fb6ec158ce0 legacy=0x7fb6ec070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:34.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.704+0000 7fb6eb7fe640 1 -- 172.21.15.6:0/2485586680 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ec070c80 con 0x7fb6ec0c8ad0 2023-07-21T22:38:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.708+0000 7fb6eb7fe640 1 --2- 172.21.15.6:0/2485586680 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6ec0c8ad0 0x7fb6ec0c9020 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00097f0 tx=0x7fb6e001c290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbcfd190e25338e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.708+0000 7fb6eaffd640 1 -- 172.21.15.6:0/2485586680 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e00a4ea0 con 0x7fb6ec0c8ad0 2023-07-21T22:38:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.708+0000 7fb6eaffd640 1 -- 172.21.15.6:0/2485586680 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e00a7050 con 0x7fb6ec0c8ad0 2023-07-21T22:38:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.708+0000 7fb6eaffd640 1 -- 172.21.15.6:0/2485586680 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc001680 con 0x7fb6ec0c8ad0 2023-07-21T22:38:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.708+0000 7fb6f2382640 1 -- 172.21.15.6:0/2485586680 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6ec0c8ad0 msgr2=0x7fb6ec0c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.708+0000 7fb6f2382640 1 --2- 172.21.15.6:0/2485586680 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6ec0c8ad0 0x7fb6ec0c9020 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00097f0 tx=0x7fb6e001c290 comp rx=0 tx=0).stop 2023-07-21T22:38:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.708+0000 7fb6f2382640 1 -- 172.21.15.6:0/2485586680 shutdown_connections 2023-07-21T22:38:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.708+0000 7fb6f2382640 1 --2- 172.21.15.6:0/2485586680 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6ec0c8ad0 0x7fb6ec0c9020 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.708+0000 7fb6f2382640 1 -- 172.21.15.6:0/2485586680 >> 172.21.15.6:0/2485586680 conn(0x7fb6ec0afcf0 msgr2=0x7fb6ec0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.708+0000 7fb6f2382640 1 -- 172.21.15.6:0/2485586680 shutdown_connections 2023-07-21T22:38:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.708+0000 7fb6f2382640 1 -- 172.21.15.6:0/2485586680 wait complete. 2023-07-21T22:38:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6f2382640 1 Processor -- start 2023-07-21T22:38:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6f2382640 1 -- start start 2023-07-21T22:38:34.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6f2382640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6ec0c8ad0 0x7fb6ec0b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6f2382640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6ec0c9560 0x7fb6ec157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6f2382640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ec158ce0 0x7fb6ec158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6f2382640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec146e30 con 0x7fb6ec158ce0 2023-07-21T22:38:34.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6f2382640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec147e30 con 0x7fb6ec0c8ad0 2023-07-21T22:38:34.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6f2382640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec0b1210 con 0x7fb6ec0c9560 2023-07-21T22:38:34.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6f091f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ec158ce0 0x7fb6ec158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6f091f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ec158ce0 0x7fb6ec158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45590/0 (socket says 172.21.15.6:45590) 2023-07-21T22:38:34.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6f091f640 1 -- 172.21.15.6:0/1398980419 learned_addr learned my addr 172.21.15.6:0/1398980419 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6eb7fe640 1 --2- 172.21.15.6:0/1398980419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6ec0c9560 0x7fb6ec157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6ebfff640 1 --2- 172.21.15.6:0/1398980419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6ec0c8ad0 0x7fb6ec0b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6f091f640 1 -- 172.21.15.6:0/1398980419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6ec0c9560 msgr2=0x7fb6ec157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6f091f640 1 --2- 172.21.15.6:0/1398980419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6ec0c9560 0x7fb6ec157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6f091f640 1 -- 172.21.15.6:0/1398980419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6ec0c8ad0 msgr2=0x7fb6ec0b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6f091f640 1 --2- 172.21.15.6:0/1398980419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6ec0c8ad0 0x7fb6ec0b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6f091f640 1 -- 172.21.15.6:0/1398980419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e0009420 con 0x7fb6ec158ce0 2023-07-21T22:38:34.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6f091f640 1 --2- 172.21.15.6:0/1398980419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ec158ce0 0x7fb6ec158190 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fb6e400c770 tx=0x7fb6e400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6e8ff9640 1 -- 172.21.15.6:0/1398980419 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4003b80 con 0x7fb6ec158ce0 2023-07-21T22:38:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6e8ff9640 1 -- 172.21.15.6:0/1398980419 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e4003ce0 con 0x7fb6ec158ce0 2023-07-21T22:38:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6e8ff9640 1 -- 172.21.15.6:0/1398980419 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e400aa90 con 0x7fb6ec158ce0 2023-07-21T22:38:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6f2382640 1 -- 172.21.15.6:0/1398980419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ec15c020 con 0x7fb6ec158ce0 2023-07-21T22:38:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.712+0000 7fb6f2382640 1 -- 172.21.15.6:0/1398980419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ec147500 con 0x7fb6ec158ce0 2023-07-21T22:38:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.716+0000 7fb6f2382640 1 -- 172.21.15.6:0/1398980419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ec0ca1a0 con 0x7fb6ec158ce0 2023-07-21T22:38:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.716+0000 7fb6e8ff9640 1 -- 172.21.15.6:0/1398980419 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb6e400abf0 con 0x7fb6ec158ce0 2023-07-21T22:38:34.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.716+0000 7fb6e8ff9640 1 --2- 172.21.15.6:0/1398980419 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fb6d80663a0 0x7fb6d8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:34.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.716+0000 7fb6e8ff9640 1 -- 172.21.15.6:0/1398980419 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fb6e4083e00 con 0x7fb6ec158ce0 2023-07-21T22:38:34.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.716+0000 7fb6ebfff640 1 --2- 172.21.15.6:0/1398980419 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fb6d80663a0 0x7fb6d8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:34.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.716+0000 7fb6ebfff640 1 --2- 172.21.15.6:0/1398980419 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fb6d80663a0 0x7fb6d8068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc005890 tx=0x7fb6dc009040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:34.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.720+0000 7fb6e8ff9640 1 -- 172.21.15.6:0/1398980419 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb6e4051080 con 0x7fb6ec158ce0 2023-07-21T22:38:34.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.908+0000 7fb6f2382640 1 -- 172.21.15.6:0/1398980419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb6ec0678d0 con 0x7fb6ec158ce0 2023-07-21T22:38:34.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.908+0000 7fb6e8ff9640 1 -- 172.21.15.6:0/1398980419 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb6e40546a0 con 0x7fb6ec158ce0 2023-07-21T22:38:34.954 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T22:38:34.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.912+0000 7fb6f2382640 1 -- 172.21.15.6:0/1398980419 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fb6d80663a0 msgr2=0x7fb6d8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:34.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.912+0000 7fb6f2382640 1 --2- 172.21.15.6:0/1398980419 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fb6d80663a0 0x7fb6d8068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc005890 tx=0x7fb6dc009040 comp rx=0 tx=0).stop 2023-07-21T22:38:34.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.912+0000 7fb6f2382640 1 -- 172.21.15.6:0/1398980419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ec158ce0 msgr2=0x7fb6ec158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:34.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.912+0000 7fb6f2382640 1 --2- 172.21.15.6:0/1398980419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ec158ce0 0x7fb6ec158190 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fb6e400c770 tx=0x7fb6e400cc30 comp rx=0 tx=0).stop 2023-07-21T22:38:34.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.912+0000 7fb6f2382640 1 -- 172.21.15.6:0/1398980419 shutdown_connections 2023-07-21T22:38:34.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.912+0000 7fb6f2382640 1 --2- 172.21.15.6:0/1398980419 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fb6d80663a0 0x7fb6d8068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.912+0000 7fb6f2382640 1 --2- 172.21.15.6:0/1398980419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ec158ce0 0x7fb6ec158190 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.912+0000 7fb6f2382640 1 --2- 172.21.15.6:0/1398980419 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6ec0c9560 0x7fb6ec157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.912+0000 7fb6f2382640 1 --2- 172.21.15.6:0/1398980419 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6ec0c8ad0 0x7fb6ec0b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:34.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.912+0000 7fb6f2382640 1 -- 172.21.15.6:0/1398980419 >> 172.21.15.6:0/1398980419 conn(0x7fb6ec0afcf0 msgr2=0x7fb6ec0ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:34.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.912+0000 7fb6f2382640 1 -- 172.21.15.6:0/1398980419 shutdown_connections 2023-07-21T22:38:34.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:34.912+0000 7fb6f2382640 1 -- 172.21.15.6:0/1398980419 wait complete. 2023-07-21T22:38:34.975 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-21T22:38:34.976 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:38:34.977 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-07-21T22:38:34.977 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T22:38:34.978 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T22:38:34.978 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-21T22:38:34.978 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-21T22:38:34.979 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:38:34.979 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:38:34.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:38:34.980 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-07-21T22:38:34.990 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:38:34.990 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:38:34.990 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:38:34.990 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:38:34.991 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-21T22:38:34.991 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:38:34.991 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:38:34.991 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:38:34.991 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-07-21T22:38:34.991 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:38:34.991 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:38:34.992 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-07-21T22:38:34.992 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:38:34.992 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:38:34.992 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-07-21T22:38:34.992 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:38:34.993 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 40930sec preferred_lft 40930sec 2023-07-21T22:38:34.993 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-07-21T22:38:34.993 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:38:34.993 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:38:34.993 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:38:34.993 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-07-21T22:38:34.993 INFO:teuthology.orchestra.run.smithi006.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:38:34.994 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:42:2f:9a:3d:15 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:38:34.994 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:38:34.994 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:38:34.994 INFO:teuthology.orchestra.run.smithi006.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:38:34.994 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-21T22:38:34.994 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T22:38:34.994 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:38:34.995 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-21T22:38:34.995 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:38:34.995 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:38:34.995 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:38:34.995 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-21T22:38:34.995 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:38:34.995 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:38:34.995 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T22:38:34.996 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-21T22:38:34.996 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:38:34.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:38:34.997 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:38:35.059 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-07-21T22:38:35.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:38:35.061 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-07-21T22:38:35.113 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-07-21T22:38:35.114 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:38:35.114 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:38:35.114 INFO:teuthology.orchestra.run.smithi006.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:38:35.115 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:38:35.115 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:38:35.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:38:35.116 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T22:38:35.117 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T22:38:35.117 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:38:35.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:38:35.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:38:35.119 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T22:38:35.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:38:35.213 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T22:38:35.222 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-21T22:38:35.223 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T22:38:35.223 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:38:35.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:38:35.224 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-07-21T22:38:35.293 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:38:35.293 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T22:38:35.343 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:38:35.344 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:38:35.344 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:38:35.395 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-21T22:38:35.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:38:35.396 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:38:35.491 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:38:35.491 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:38:35.491 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:38:35.506 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:38:35.507 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:38:35.507 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:38:35.507 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:38:35.507 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:38:35.517 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:38:35.517 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:38:35.518 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:38:35.518 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:38:35.518 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:38:35.518 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-07-21T22:38:35.518 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-07-21T22:38:35.518 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f3073df4-6cd1-4503-bd2e-d3e98fa18bdf" will pass to kernel 2023-07-21T22:38:35.522 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T22:38:35.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:38:35.523 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:38:35.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:38:35.545 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:38:35.612 INFO:teuthology.orchestra.run.smithi006.stdout:client8946 2023-07-21T22:38:35.612 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:38:35.613 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:38:35.667 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-21T22:38:35.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.816+0000 7fa3fe626640 1 Processor -- start 2023-07-21T22:38:35.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.816+0000 7fa3fe626640 1 -- start start 2023-07-21T22:38:35.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.816+0000 7fa3fe626640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa3f815f500 0x7fa3f806cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:35.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.816+0000 7fa3fe626640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3f806d430 0x7fa3f806a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:35.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.816+0000 7fa3fe626640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa3f806aa80 0x7fa3f80b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:35.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.816+0000 7fa3fe626640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f806af20 con 0x7fa3f815f500 2023-07-21T22:38:35.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.816+0000 7fa3fe626640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f80cdc80 con 0x7fa3f806aa80 2023-07-21T22:38:35.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.816+0000 7fa3fe626640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f806e4c0 con 0x7fa3f806d430 2023-07-21T22:38:35.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.816+0000 7fa3f7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa3f815f500 0x7fa3f806cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:35.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.816+0000 7fa3f7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa3f815f500 0x7fa3f806cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45596/0 (socket says 172.21.15.6:45596) 2023-07-21T22:38:35.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.816+0000 7fa3f7fff640 1 -- 172.21.15.6:0/1130490130 learned_addr learned my addr 172.21.15.6:0/1130490130 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:35.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.816+0000 7fa3f77fe640 1 --2- 172.21.15.6:0/1130490130 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3f806d430 0x7fa3f806a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:35.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.816+0000 7fa3fcbc3640 1 --2- 172.21.15.6:0/1130490130 >> v2:172.21.15.161:3300/0 conn(0x7fa3f806aa80 0x7fa3f80b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:35.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.816+0000 7fa3f7fff640 1 -- 172.21.15.6:0/1130490130 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3f806d430 msgr2=0x7fa3f806a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.816+0000 7fa3f7fff640 1 --2- 172.21.15.6:0/1130490130 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3f806d430 0x7fa3f806a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.816+0000 7fa3f7fff640 1 -- 172.21.15.6:0/1130490130 >> v2:172.21.15.161:3300/0 conn(0x7fa3f806aa80 msgr2=0x7fa3f80b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.816+0000 7fa3f7fff640 1 --2- 172.21.15.6:0/1130490130 >> v2:172.21.15.161:3300/0 conn(0x7fa3f806aa80 0x7fa3f80b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:35.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.816+0000 7fa3f7fff640 1 -- 172.21.15.6:0/1130490130 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f806d940 con 0x7fa3f815f500 2023-07-21T22:38:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.820+0000 7fa3f7fff640 1 --2- 172.21.15.6:0/1130490130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f815f500 0x7fa3f806cef0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80713b0 tx=0x7fa3e801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9296c695073607fa server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.820+0000 7fa3f6ffd640 1 -- 172.21.15.6:0/1130490130 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e80ab600 con 0x7fa3f815f500 2023-07-21T22:38:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.820+0000 7fa3f6ffd640 1 -- 172.21.15.6:0/1130490130 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e80a7050 con 0x7fa3f815f500 2023-07-21T22:38:35.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.820+0000 7fa3f6ffd640 1 -- 172.21.15.6:0/1130490130 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e80ab980 con 0x7fa3f815f500 2023-07-21T22:38:35.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.820+0000 7fa3fe626640 1 -- 172.21.15.6:0/1130490130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f815f500 msgr2=0x7fa3f806cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:35.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.820+0000 7fa3fe626640 1 --2- 172.21.15.6:0/1130490130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f815f500 0x7fa3f806cef0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80713b0 tx=0x7fa3e801c240 comp rx=0 tx=0).stop 2023-07-21T22:38:35.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.820+0000 7fa3fe626640 1 -- 172.21.15.6:0/1130490130 shutdown_connections 2023-07-21T22:38:35.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.820+0000 7fa3fe626640 1 --2- 172.21.15.6:0/1130490130 >> v2:172.21.15.161:3300/0 conn(0x7fa3f806aa80 0x7fa3f80b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:35.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.820+0000 7fa3fe626640 1 --2- 172.21.15.6:0/1130490130 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3f806d430 0x7fa3f806a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:35.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.820+0000 7fa3fe626640 1 --2- 172.21.15.6:0/1130490130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f815f500 0x7fa3f806cef0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:35.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.820+0000 7fa3fe626640 1 -- 172.21.15.6:0/1130490130 >> 172.21.15.6:0/1130490130 conn(0x7fa3f80659d0 msgr2=0x7fa3f8099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:35.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.820+0000 7fa3fe626640 1 -- 172.21.15.6:0/1130490130 shutdown_connections 2023-07-21T22:38:35.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.820+0000 7fa3fe626640 1 -- 172.21.15.6:0/1130490130 wait complete. 2023-07-21T22:38:35.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3fe626640 1 Processor -- start 2023-07-21T22:38:35.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3fe626640 1 -- start start 2023-07-21T22:38:35.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3fe626640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3f806aa80 0x7fa3f814df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:35.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3fe626640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f806d430 0x7fa3f815e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:35.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3fe626640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3f815f500 0x7fa3f815a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:35.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3fe626640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f814e470 con 0x7fa3f806d430 2023-07-21T22:38:35.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3fe626640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f80ca6e0 con 0x7fa3f806aa80 2023-07-21T22:38:35.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3fe626640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f814e940 con 0x7fa3f815f500 2023-07-21T22:38:35.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3f77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f806d430 0x7fa3f815e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:35.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3f77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f806d430 0x7fa3f815e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45608/0 (socket says 172.21.15.6:45608) 2023-07-21T22:38:35.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3f77fe640 1 -- 172.21.15.6:0/612506622 learned_addr learned my addr 172.21.15.6:0/612506622 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:35.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3f7fff640 1 --2- 172.21.15.6:0/612506622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3f806aa80 0x7fa3f814df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:35.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3fcbc3640 1 --2- 172.21.15.6:0/612506622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3f815f500 0x7fa3f815a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:35.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3f77fe640 1 -- 172.21.15.6:0/612506622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3f815f500 msgr2=0x7fa3f815a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:35.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3f77fe640 1 --2- 172.21.15.6:0/612506622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3f815f500 0x7fa3f815a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:35.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3f77fe640 1 -- 172.21.15.6:0/612506622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3f806aa80 msgr2=0x7fa3f814df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:35.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3f77fe640 1 --2- 172.21.15.6:0/612506622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3f806aa80 0x7fa3f814df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:35.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3f77fe640 1 -- 172.21.15.6:0/612506622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e8009480 con 0x7fa3f806d430 2023-07-21T22:38:35.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3fcbc3640 1 --2- 172.21.15.6:0/612506622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3f815f500 0x7fa3f815a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:35.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3f77fe640 1 --2- 172.21.15.6:0/612506622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f806d430 0x7fa3f815e310 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec00d800 tx=0x7fa3ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:35.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3f4ff9640 1 -- 172.21.15.6:0/612506622 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec00b6c0 con 0x7fa3f806d430 2023-07-21T22:38:35.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3f4ff9640 1 -- 172.21.15.6:0/612506622 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3ec00b820 con 0x7fa3f806d430 2023-07-21T22:38:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3fe626640 1 -- 172.21.15.6:0/612506622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f80caf80 con 0x7fa3f806d430 2023-07-21T22:38:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3f4ff9640 1 -- 172.21.15.6:0/612506622 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3ec00bb90 con 0x7fa3f806d430 2023-07-21T22:38:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3fe626640 1 -- 172.21.15.6:0/612506622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f80cd3a0 con 0x7fa3f806d430 2023-07-21T22:38:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.824+0000 7fa3fe626640 1 -- 172.21.15.6:0/612506622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f80678d0 con 0x7fa3f806d430 2023-07-21T22:38:35.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.828+0000 7fa3f4ff9640 1 -- 172.21.15.6:0/612506622 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa3ec00bcf0 con 0x7fa3f806d430 2023-07-21T22:38:35.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.828+0000 7fa3f4ff9640 1 --2- 172.21.15.6:0/612506622 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fa3e40663a0 0x7fa3e4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:35.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.828+0000 7fa3f4ff9640 1 -- 172.21.15.6:0/612506622 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fa3ec0843e0 con 0x7fa3f806d430 2023-07-21T22:38:35.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.828+0000 7fa3f7fff640 1 --2- 172.21.15.6:0/612506622 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fa3e40663a0 0x7fa3e4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:35.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.828+0000 7fa3f7fff640 1 --2- 172.21.15.6:0/612506622 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fa3e40663a0 0x7fa3e4068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80ad000 tx=0x7fa3e80a6000 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:35.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:35.832+0000 7fa3f4ff9640 1 -- 172.21.15.6:0/612506622 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa3ec055180 con 0x7fa3f806d430 2023-07-21T22:38:36.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.004+0000 7fa3fe626640 1 -- 172.21.15.6:0/612506622 --> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3f806e1e0 con 0x7fa3e40663a0 2023-07-21T22:38:36.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.008+0000 7fa3f4ff9640 1 -- 172.21.15.6:0/612506622 <== mgr.7307 v2:172.21.15.161:6832/3436422767 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fa3e80042a0 con 0x7fa3e40663a0 2023-07-21T22:38:36.053 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:38:36.053 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:36.053 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephfs" 2023-07-21T22:38:36.053 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:36.053 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:38:36.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.008+0000 7fa3fe626640 1 -- 172.21.15.6:0/612506622 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fa3e40663a0 msgr2=0x7fa3e4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:36.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.008+0000 7fa3fe626640 1 --2- 172.21.15.6:0/612506622 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fa3e40663a0 0x7fa3e4068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80ad000 tx=0x7fa3e80a6000 comp rx=0 tx=0).stop 2023-07-21T22:38:36.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.008+0000 7fa3fe626640 1 -- 172.21.15.6:0/612506622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f806d430 msgr2=0x7fa3f815e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:36.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.008+0000 7fa3fe626640 1 --2- 172.21.15.6:0/612506622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f806d430 0x7fa3f815e310 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec00d800 tx=0x7fa3ec00dcc0 comp rx=0 tx=0).stop 2023-07-21T22:38:36.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.008+0000 7fa3fe626640 1 -- 172.21.15.6:0/612506622 shutdown_connections 2023-07-21T22:38:36.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.008+0000 7fa3fe626640 1 --2- 172.21.15.6:0/612506622 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7fa3e40663a0 0x7fa3e4068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:36.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.008+0000 7fa3fe626640 1 --2- 172.21.15.6:0/612506622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3f815f500 0x7fa3f815a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:36.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.008+0000 7fa3fe626640 1 --2- 172.21.15.6:0/612506622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3f806d430 0x7fa3f815e310 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:36.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.008+0000 7fa3fe626640 1 --2- 172.21.15.6:0/612506622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3f806aa80 0x7fa3f814df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:36.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.008+0000 7fa3fe626640 1 -- 172.21.15.6:0/612506622 >> 172.21.15.6:0/612506622 conn(0x7fa3f80659d0 msgr2=0x7fa3f8157ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:36.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.008+0000 7fa3fe626640 1 -- 172.21.15.6:0/612506622 shutdown_connections 2023-07-21T22:38:36.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.008+0000 7fa3fe626640 1 -- 172.21.15.6:0/612506622 wait complete. 2023-07-21T22:38:36.074 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-21T22:38:36.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.176+0000 7f138a0f9640 1 Processor -- start 2023-07-21T22:38:36.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.176+0000 7f138a0f9640 1 -- start start 2023-07-21T22:38:36.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.176+0000 7f138a0f9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f138406a540 0x7f13840cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:36.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.176+0000 7f138a0f9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f13841601f0 0x7f13840cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:36.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.176+0000 7f138a0f9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f138406a910 0x7f13840d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:36.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.176+0000 7f138a0f9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13840ccf50 con 0x7f13841601f0 2023-07-21T22:38:36.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.176+0000 7f138a0f9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13840cd1f0 con 0x7f138406a910 2023-07-21T22:38:36.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.176+0000 7f138a0f9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13840cd4d0 con 0x7f138406a540 2023-07-21T22:38:36.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.176+0000 7f1382ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f13841601f0 0x7f13840cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:36.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.176+0000 7f1382ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f13841601f0 0x7f13840cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45620/0 (socket says 172.21.15.6:45620) 2023-07-21T22:38:36.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.176+0000 7f1382ffd640 1 -- 172.21.15.6:0/3016176342 learned_addr learned my addr 172.21.15.6:0/3016176342 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:36.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.176+0000 7f1383fff640 1 --2- 172.21.15.6:0/3016176342 >> v2:172.21.15.161:3300/0 conn(0x7f138406a910 0x7f13840d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:36.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.176+0000 7f13837fe640 1 --2- 172.21.15.6:0/3016176342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f138406a540 0x7f13840cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:36.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.176+0000 7f1382ffd640 1 -- 172.21.15.6:0/3016176342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f138406a540 msgr2=0x7f13840cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:36.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.176+0000 7f1382ffd640 1 --2- 172.21.15.6:0/3016176342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f138406a540 0x7f13840cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:36.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.176+0000 7f1382ffd640 1 -- 172.21.15.6:0/3016176342 >> v2:172.21.15.161:3300/0 conn(0x7f138406a910 msgr2=0x7f13840d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:36.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.176+0000 7f1382ffd640 1 --2- 172.21.15.6:0/3016176342 >> v2:172.21.15.161:3300/0 conn(0x7f138406a910 0x7f13840d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:36.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.176+0000 7f1382ffd640 1 -- 172.21.15.6:0/3016176342 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13840cd7b0 con 0x7f13841601f0 2023-07-21T22:38:36.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.176+0000 7f13837fe640 1 --2- 172.21.15.6:0/3016176342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f138406a540 0x7f13840cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:36.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.176+0000 7f1383fff640 1 --2- 172.21.15.6:0/3016176342 >> v2:172.21.15.161:3300/0 conn(0x7f138406a910 0x7f13840d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:36.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.180+0000 7f1382ffd640 1 --2- 172.21.15.6:0/3016176342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13841601f0 0x7f13840cca10 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f138406c680 tx=0x7f137801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea879bd9aff71c13 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:36.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.180+0000 7f13827fc640 1 -- 172.21.15.6:0/3016176342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13780ab600 con 0x7f13841601f0 2023-07-21T22:38:36.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.180+0000 7f13827fc640 1 -- 172.21.15.6:0/3016176342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13780a7050 con 0x7f13841601f0 2023-07-21T22:38:36.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.180+0000 7f13827fc640 1 -- 172.21.15.6:0/3016176342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13780ab980 con 0x7f13841601f0 2023-07-21T22:38:36.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.180+0000 7f138a0f9640 1 -- 172.21.15.6:0/3016176342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13841601f0 msgr2=0x7f13840cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:36.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.180+0000 7f138a0f9640 1 --2- 172.21.15.6:0/3016176342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13841601f0 0x7f13840cca10 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f138406c680 tx=0x7f137801c440 comp rx=0 tx=0).stop 2023-07-21T22:38:36.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.180+0000 7f138a0f9640 1 -- 172.21.15.6:0/3016176342 shutdown_connections 2023-07-21T22:38:36.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.180+0000 7f138a0f9640 1 --2- 172.21.15.6:0/3016176342 >> v2:172.21.15.161:3300/0 conn(0x7f138406a910 0x7f13840d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:36.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.180+0000 7f138a0f9640 1 --2- 172.21.15.6:0/3016176342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13841601f0 0x7f13840cca10 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:36.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.180+0000 7f138a0f9640 1 --2- 172.21.15.6:0/3016176342 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f138406a540 0x7f13840cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:36.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.180+0000 7f138a0f9640 1 -- 172.21.15.6:0/3016176342 >> 172.21.15.6:0/3016176342 conn(0x7f1384099490 msgr2=0x7f1384089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:36.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.180+0000 7f138a0f9640 1 -- 172.21.15.6:0/3016176342 shutdown_connections 2023-07-21T22:38:36.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.180+0000 7f138a0f9640 1 -- 172.21.15.6:0/3016176342 wait complete. 2023-07-21T22:38:36.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f138a0f9640 1 Processor -- start 2023-07-21T22:38:36.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f138a0f9640 1 -- start start 2023-07-21T22:38:36.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f138a0f9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f138406a540 0x7f138415dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:36.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f138a0f9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f138406a910 0x7f13840c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:36.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f138a0f9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13841601f0 0x7f138415c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:36.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f138a0f9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138415cab0 con 0x7f13841601f0 2023-07-21T22:38:36.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f138a0f9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138415cce0 con 0x7f138406a540 2023-07-21T22:38:36.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f138a0f9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138415cfc0 con 0x7f138406a910 2023-07-21T22:38:36.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f1383fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13841601f0 0x7f138415c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:36.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f1383fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13841601f0 0x7f138415c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45622/0 (socket says 172.21.15.6:45622) 2023-07-21T22:38:36.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f1383fff640 1 -- 172.21.15.6:0/820957636 learned_addr learned my addr 172.21.15.6:0/820957636 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:36.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f13837fe640 1 --2- 172.21.15.6:0/820957636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f138406a540 0x7f138415dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:36.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f1382ffd640 1 --2- 172.21.15.6:0/820957636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f138406a910 0x7f13840c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:36.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f1383fff640 1 -- 172.21.15.6:0/820957636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f138406a910 msgr2=0x7f13840c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:36.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f1383fff640 1 --2- 172.21.15.6:0/820957636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f138406a910 0x7f13840c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:36.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f1383fff640 1 -- 172.21.15.6:0/820957636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f138406a540 msgr2=0x7f138415dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:36.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f1383fff640 1 --2- 172.21.15.6:0/820957636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f138406a540 0x7f138415dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:36.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f1383fff640 1 -- 172.21.15.6:0/820957636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13780094d0 con 0x7f13841601f0 2023-07-21T22:38:36.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f1383fff640 1 --2- 172.21.15.6:0/820957636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13841601f0 0x7f138415c570 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f137c00cef0 tx=0x7f137c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:36.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f136bfff640 1 -- 172.21.15.6:0/820957636 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c00d840 con 0x7f13841601f0 2023-07-21T22:38:36.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f136bfff640 1 -- 172.21.15.6:0/820957636 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c00d9c0 con 0x7f13841601f0 2023-07-21T22:38:36.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f136bfff640 1 -- 172.21.15.6:0/820957636 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137c00dd70 con 0x7f13841601f0 2023-07-21T22:38:36.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f138a0f9640 1 -- 172.21.15.6:0/820957636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138415d2a0 con 0x7f13841601f0 2023-07-21T22:38:36.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.184+0000 7f138a0f9640 1 -- 172.21.15.6:0/820957636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138415d860 con 0x7f13841601f0 2023-07-21T22:38:36.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.188+0000 7f138a0f9640 1 -- 172.21.15.6:0/820957636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138415da50 con 0x7f13841601f0 2023-07-21T22:38:36.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.188+0000 7f136bfff640 1 -- 172.21.15.6:0/820957636 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f137c01e3b0 con 0x7f13841601f0 2023-07-21T22:38:36.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.188+0000 7f136bfff640 1 --2- 172.21.15.6:0/820957636 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f13700663a0 0x7f1370068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:36.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.188+0000 7f136bfff640 1 -- 172.21.15.6:0/820957636 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f137c0849f0 con 0x7f13841601f0 2023-07-21T22:38:36.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.188+0000 7f13837fe640 1 --2- 172.21.15.6:0/820957636 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f13700663a0 0x7f1370068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:36.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.188+0000 7f13837fe640 1 --2- 172.21.15.6:0/820957636 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f13700663a0 0x7f1370068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1374006ac0 tx=0x7f1374008040 comp rx=0 tx=0).ready entity=mgr.7307 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:36.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.192+0000 7f136bfff640 1 -- 172.21.15.6:0/820957636 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f137c051d50 con 0x7f13841601f0 2023-07-21T22:38:36.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.384+0000 7f138a0f9640 1 -- 172.21.15.6:0/820957636 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f13840678d0 con 0x7f13841601f0 2023-07-21T22:38:36.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.924+0000 7f136bfff640 1 -- 172.21.15.6:0/820957636 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 59) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f137c086d50 con 0x7f13841601f0 2023-07-21T22:38:36.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.924+0000 7f136bfff640 1 -- 172.21.15.6:0/820957636 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v59) v1 ==== 92+0+0 (secure 0 0 0) 0x7f137c074950 con 0x7f13841601f0 2023-07-21T22:38:36.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.928+0000 7f138a0f9640 1 -- 172.21.15.6:0/820957636 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f13700663a0 msgr2=0x7f1370068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:36.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.928+0000 7f138a0f9640 1 --2- 172.21.15.6:0/820957636 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f13700663a0 0x7f1370068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1374006ac0 tx=0x7f1374008040 comp rx=0 tx=0).stop 2023-07-21T22:38:36.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.928+0000 7f138a0f9640 1 -- 172.21.15.6:0/820957636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13841601f0 msgr2=0x7f138415c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:36.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.928+0000 7f138a0f9640 1 --2- 172.21.15.6:0/820957636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13841601f0 0x7f138415c570 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f137c00cef0 tx=0x7f137c00a710 comp rx=0 tx=0).stop 2023-07-21T22:38:36.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.928+0000 7f138a0f9640 1 -- 172.21.15.6:0/820957636 shutdown_connections 2023-07-21T22:38:36.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.928+0000 7f138a0f9640 1 --2- 172.21.15.6:0/820957636 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f13700663a0 0x7f1370068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:36.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.928+0000 7f138a0f9640 1 --2- 172.21.15.6:0/820957636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13841601f0 0x7f138415c570 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:36.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.928+0000 7f138a0f9640 1 --2- 172.21.15.6:0/820957636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f138406a910 0x7f13840c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:36.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.928+0000 7f138a0f9640 1 --2- 172.21.15.6:0/820957636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f138406a540 0x7f138415dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:36.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.928+0000 7f138a0f9640 1 -- 172.21.15.6:0/820957636 >> 172.21.15.6:0/820957636 conn(0x7f1384099490 msgr2=0x7f13840cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:36.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.928+0000 7f138a0f9640 1 -- 172.21.15.6:0/820957636 shutdown_connections 2023-07-21T22:38:36.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:36.928+0000 7f138a0f9640 1 -- 172.21.15.6:0/820957636 wait complete. 2023-07-21T22:38:36.996 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-21T22:38:37.148 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:37.103+0000 7f91a8846180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:38:37.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.104+0000 7f49e732c640 1 Processor -- start 2023-07-21T22:38:37.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.104+0000 7f49e732c640 1 -- start start 2023-07-21T22:38:37.150 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:37.104+0000 7f21c8813180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:38:37.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.104+0000 7f49e732c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49e015bde0 0x7f49e00d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:37.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.104+0000 7f49e732c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e00d2300 0x7f49e00d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:37.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.104+0000 7f49e732c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e00b04c0 con 0x7f49e00d2fc0 2023-07-21T22:38:37.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.104+0000 7f49e732c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e015c1b0 con 0x7f49e015bde0 2023-07-21T22:38:37.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.104+0000 7f49e732c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e00d2cc0 con 0x7f49e00d2300 2023-07-21T22:38:37.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.104+0000 7f49e50c8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49e015bde0 0x7f49e00d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:37.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.104+0000 7f49e50c8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49e015bde0 0x7f49e00d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45638/0 (socket says 172.21.15.6:45638) 2023-07-21T22:38:37.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.104+0000 7f49e50c8640 1 -- 172.21.15.6:0/3002883685 learned_addr learned my addr 172.21.15.6:0/3002883685 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:37.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.104+0000 7f49e58c9640 1 --2- 172.21.15.6:0/3002883685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e00d2300 0x7f49e00d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:37.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.108+0000 7f49e50c8640 1 -- 172.21.15.6:0/3002883685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e00d2300 msgr2=0x7f49e00d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:37.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.108+0000 7f49e50c8640 1 --2- 172.21.15.6:0/3002883685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e00d2300 0x7f49e00d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.108+0000 7f49e50c8640 1 -- 172.21.15.6:0/3002883685 >> v1:172.21.15.161:6789/0 conn(0x7f49e00d2fc0 legacy=0x7f49e00b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:37.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.108+0000 7f49e50c8640 1 -- 172.21.15.6:0/3002883685 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e00b1060 con 0x7f49e015bde0 2023-07-21T22:38:37.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.108+0000 7f49e50c8640 1 --2- 172.21.15.6:0/3002883685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e015bde0 0x7f49e00d0270 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f49dc006fd0 tx=0x7f49dc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2839a0f72069ed server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:37.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.108+0000 7f49d7fff640 1 -- 172.21.15.6:0/3002883685 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0a7070 con 0x7f49e015bde0 2023-07-21T22:38:37.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.108+0000 7f49d7fff640 1 -- 172.21.15.6:0/3002883685 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc0ab430 con 0x7f49e015bde0 2023-07-21T22:38:37.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.108+0000 7f49d7fff640 1 -- 172.21.15.6:0/3002883685 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc0ab7c0 con 0x7f49e015bde0 2023-07-21T22:38:37.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.108+0000 7f49e732c640 1 -- 172.21.15.6:0/3002883685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e015bde0 msgr2=0x7f49e00d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:37.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.108+0000 7f49e732c640 1 --2- 172.21.15.6:0/3002883685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e015bde0 0x7f49e00d0270 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f49dc006fd0 tx=0x7f49dc01c520 comp rx=0 tx=0).stop 2023-07-21T22:38:37.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e732c640 1 -- 172.21.15.6:0/3002883685 shutdown_connections 2023-07-21T22:38:37.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e732c640 1 --2- 172.21.15.6:0/3002883685 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e00d2300 0x7f49e00d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e732c640 1 --2- 172.21.15.6:0/3002883685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e015bde0 0x7f49e00d0270 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e732c640 1 -- 172.21.15.6:0/3002883685 >> 172.21.15.6:0/3002883685 conn(0x7f49e00659d0 msgr2=0x7f49e009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:37.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e732c640 1 -- 172.21.15.6:0/3002883685 shutdown_connections 2023-07-21T22:38:37.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e732c640 1 -- 172.21.15.6:0/3002883685 wait complete. 2023-07-21T22:38:37.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e732c640 1 Processor -- start 2023-07-21T22:38:37.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e732c640 1 -- start start 2023-07-21T22:38:37.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e732c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49e00d2300 0x7f49e014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e732c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e00d2fc0 0x7f49e0153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e732c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e015bde0 0x7f49e00b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e732c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e00c8f40 con 0x7f49e00d2fc0 2023-07-21T22:38:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e732c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e01540d0 con 0x7f49e00d2300 2023-07-21T22:38:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e732c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e0153830 con 0x7f49e015bde0 2023-07-21T22:38:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e48c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e00d2fc0 0x7f49e0153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e58c9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e015bde0 0x7f49e00b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e48c7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e00d2fc0 0x7f49e0153130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45650/0 (socket says 172.21.15.6:45650) 2023-07-21T22:38:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e48c7640 1 -- 172.21.15.6:0/491663184 learned_addr learned my addr 172.21.15.6:0/491663184 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:37.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e50c8640 1 --2- 172.21.15.6:0/491663184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49e00d2300 0x7f49e014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e58c9640 1 -- 172.21.15.6:0/491663184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49e00d2300 msgr2=0x7f49e014e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e58c9640 1 --2- 172.21.15.6:0/491663184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49e00d2300 0x7f49e014e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e58c9640 1 -- 172.21.15.6:0/491663184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e00d2fc0 msgr2=0x7f49e0153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:37.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e58c9640 1 --2- 172.21.15.6:0/491663184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e00d2fc0 0x7f49e0153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.112+0000 7f49e58c9640 1 -- 172.21.15.6:0/491663184 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc009480 con 0x7f49e015bde0 2023-07-21T22:38:37.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.116+0000 7f49e58c9640 1 --2- 172.21.15.6:0/491663184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e015bde0 0x7f49e00b7ab0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f49d800eba0 tx=0x7f49d800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:37.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.116+0000 7f49d5ffb640 1 -- 172.21.15.6:0/491663184 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d800cd20 con 0x7f49e015bde0 2023-07-21T22:38:37.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.116+0000 7f49d5ffb640 1 -- 172.21.15.6:0/491663184 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d800f040 con 0x7f49e015bde0 2023-07-21T22:38:37.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.116+0000 7f49d5ffb640 1 -- 172.21.15.6:0/491663184 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d80146c0 con 0x7f49e015bde0 2023-07-21T22:38:37.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.116+0000 7f49e732c640 1 -- 172.21.15.6:0/491663184 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e0153b10 con 0x7f49e015bde0 2023-07-21T22:38:37.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.116+0000 7f49e732c640 1 -- 172.21.15.6:0/491663184 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e00c6040 con 0x7f49e015bde0 2023-07-21T22:38:37.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.116+0000 7f49e732c640 1 -- 172.21.15.6:0/491663184 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e00c5ea0 con 0x7f49e015bde0 2023-07-21T22:38:37.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.116+0000 7f49d5ffb640 1 -- 172.21.15.6:0/491663184 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 59) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f49d8014820 con 0x7f49e015bde0 2023-07-21T22:38:37.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.120+0000 7f49d5ffb640 1 --2- 172.21.15.6:0/491663184 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f49c40663f0 0x7f49c40688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:37.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.120+0000 7f49d5ffb640 1 -- 172.21.15.6:0/491663184 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f49d8084ce0 con 0x7f49e015bde0 2023-07-21T22:38:37.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.120+0000 7f49e50c8640 1 -- 172.21.15.6:0/491663184 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f49c40663f0 msgr2=0x7f49c40688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3436422767 2023-07-21T22:38:37.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.120+0000 7f49e50c8640 1 --2- 172.21.15.6:0/491663184 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f49c40663f0 0x7f49c40688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:37.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.124+0000 7f49d5ffb640 1 -- 172.21.15.6:0/491663184 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f49e00c5ea0 con 0x7f49e015bde0 2023-07-21T22:38:37.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.280+0000 7f49e732c640 1 -- 172.21.15.6:0/491663184 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f49e00c5ea0 con 0x7f49e015bde0 2023-07-21T22:38:37.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.288+0000 7f49d5ffb640 1 -- 172.21.15.6:0/491663184 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v47)=0 v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7f49e00c5ea0 con 0x7f49e015bde0 2023-07-21T22:38:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.292+0000 7f49e732c640 1 -- 172.21.15.6:0/491663184 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f49c40663f0 msgr2=0x7f49c40688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.292+0000 7f49e732c640 1 --2- 172.21.15.6:0/491663184 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f49c40663f0 0x7f49c40688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.292+0000 7f49e732c640 1 -- 172.21.15.6:0/491663184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e015bde0 msgr2=0x7f49e00b7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.292+0000 7f49e732c640 1 --2- 172.21.15.6:0/491663184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e015bde0 0x7f49e00b7ab0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f49d800eba0 tx=0x7f49d800c490 comp rx=0 tx=0).stop 2023-07-21T22:38:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.292+0000 7f49e732c640 1 -- 172.21.15.6:0/491663184 shutdown_connections 2023-07-21T22:38:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.292+0000 7f49e732c640 1 --2- 172.21.15.6:0/491663184 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f49c40663f0 0x7f49c40688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.292+0000 7f49e732c640 1 --2- 172.21.15.6:0/491663184 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49e015bde0 0x7f49e00b7ab0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.292+0000 7f49e732c640 1 --2- 172.21.15.6:0/491663184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49e00d2fc0 0x7f49e0153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.292+0000 7f49e732c640 1 --2- 172.21.15.6:0/491663184 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49e00d2300 0x7f49e014e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.292+0000 7f49e732c640 1 -- 172.21.15.6:0/491663184 >> 172.21.15.6:0/491663184 conn(0x7f49e00659d0 msgr2=0x7f49e00cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:37.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.292+0000 7f49e732c640 1 -- 172.21.15.6:0/491663184 shutdown_connections 2023-07-21T22:38:37.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.292+0000 7f49e732c640 1 -- 172.21.15.6:0/491663184 wait complete. 2023-07-21T22:38:37.357 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-21T22:38:37.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.460+0000 7f77aaa9c640 1 Processor -- start 2023-07-21T22:38:37.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.460+0000 7f77aaa9c640 1 -- start start 2023-07-21T22:38:37.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.460+0000 7f77aaa9c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77a415bde0 0x7f77a40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:37.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.460+0000 7f77aaa9c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f77a40d2300 0x7f77a40d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:37.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.460+0000 7f77aaa9c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a40b04c0 con 0x7f77a40d2fc0 2023-07-21T22:38:37.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.460+0000 7f77aaa9c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a40d2ce0 con 0x7f77a40d2300 2023-07-21T22:38:37.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.460+0000 7f77aaa9c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a415c1b0 con 0x7f77a415bde0 2023-07-21T22:38:37.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.460+0000 7f77a3fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f77a40d2fc0 0x7f77a40b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46600/0 (socket says 172.21.15.6:46600) 2023-07-21T22:38:37.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.460+0000 7f77a3fff640 1 -- 172.21.15.6:0/1573783672 learned_addr learned my addr 172.21.15.6:0/1573783672 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:37.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.460+0000 7f77a8838640 1 --2- 172.21.15.6:0/1573783672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77a415bde0 0x7f77a40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:37.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.460+0000 7f77a9039640 1 --2- 172.21.15.6:0/1573783672 >> v2:172.21.15.161:3300/0 conn(0x7f77a40d2300 0x7f77a40d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:37.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.464+0000 7f77a37fe640 1 -- 172.21.15.6:0/1573783672 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4032925757 0 0) 0x7f77a40b04c0 con 0x7f77a40d2fc0 2023-07-21T22:38:37.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.464+0000 7f77a37fe640 1 -- 172.21.15.6:0/1573783672 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7794003530 con 0x7f77a40d2fc0 2023-07-21T22:38:37.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.464+0000 7f77a8838640 1 -- 172.21.15.6:0/1573783672 >> v2:172.21.15.161:3300/0 conn(0x7f77a40d2300 msgr2=0x7f77a40d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:37.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.464+0000 7f77a8838640 1 --2- 172.21.15.6:0/1573783672 >> v2:172.21.15.161:3300/0 conn(0x7f77a40d2300 0x7f77a40d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.464+0000 7f77a8838640 1 -- 172.21.15.6:0/1573783672 >> v1:172.21.15.6:6789/0 conn(0x7f77a40d2fc0 legacy=0x7f77a40b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:37.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.464+0000 7f77a8838640 1 -- 172.21.15.6:0/1573783672 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a40b1060 con 0x7f77a415bde0 2023-07-21T22:38:37.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.464+0000 7f77a8838640 1 --2- 172.21.15.6:0/1573783672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77a415bde0 0x7f77a40d0270 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f77980097a0 tx=0x7f779801c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c7d70e9cd0b750d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:37.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.464+0000 7f77a37fe640 1 -- 172.21.15.6:0/1573783672 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77980ab600 con 0x7f77a415bde0 2023-07-21T22:38:37.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.464+0000 7f77a37fe640 1 -- 172.21.15.6:0/1573783672 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77980a7050 con 0x7f77a415bde0 2023-07-21T22:38:37.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.464+0000 7f77a37fe640 1 -- 172.21.15.6:0/1573783672 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77980ab980 con 0x7f77a415bde0 2023-07-21T22:38:37.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77aaa9c640 1 -- 172.21.15.6:0/1573783672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77a415bde0 msgr2=0x7f77a40d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:37.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77aaa9c640 1 --2- 172.21.15.6:0/1573783672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77a415bde0 0x7f77a40d0270 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f77980097a0 tx=0x7f779801c460 comp rx=0 tx=0).stop 2023-07-21T22:38:37.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77aaa9c640 1 -- 172.21.15.6:0/1573783672 shutdown_connections 2023-07-21T22:38:37.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77aaa9c640 1 --2- 172.21.15.6:0/1573783672 >> v2:172.21.15.161:3300/0 conn(0x7f77a40d2300 0x7f77a40d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77aaa9c640 1 --2- 172.21.15.6:0/1573783672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77a415bde0 0x7f77a40d0270 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77aaa9c640 1 -- 172.21.15.6:0/1573783672 >> 172.21.15.6:0/1573783672 conn(0x7f77a40659d0 msgr2=0x7f77a409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:37.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77aaa9c640 1 -- 172.21.15.6:0/1573783672 shutdown_connections 2023-07-21T22:38:37.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77aaa9c640 1 -- 172.21.15.6:0/1573783672 wait complete. 2023-07-21T22:38:37.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77aaa9c640 1 Processor -- start 2023-07-21T22:38:37.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77aaa9c640 1 -- start start 2023-07-21T22:38:37.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77aaa9c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77a40d2300 0x7f77a41594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77aaa9c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77a40d2fc0 0x7f77a4159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77aaa9c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77a415bde0 0x7f77a41510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77aaa9c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a40ca0a0 con 0x7f77a415bde0 2023-07-21T22:38:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77aaa9c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a40cc400 con 0x7f77a40d2fc0 2023-07-21T22:38:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77aaa9c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a40cbbf0 con 0x7f77a40d2300 2023-07-21T22:38:37.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77a9039640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77a415bde0 0x7f77a41510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:37.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77a9039640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77a415bde0 0x7f77a41510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58630/0 (socket says 172.21.15.6:58630) 2023-07-21T22:38:37.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77a9039640 1 -- 172.21.15.6:0/2700686687 learned_addr learned my addr 172.21.15.6:0/2700686687 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:37.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77a8838640 1 --2- 172.21.15.6:0/2700686687 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77a40d2300 0x7f77a41594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:37.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77a3fff640 1 --2- 172.21.15.6:0/2700686687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77a40d2fc0 0x7f77a4159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:37.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77a9039640 1 -- 172.21.15.6:0/2700686687 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77a40d2300 msgr2=0x7f77a41594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:37.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77a9039640 1 --2- 172.21.15.6:0/2700686687 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77a40d2300 0x7f77a41594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77a9039640 1 -- 172.21.15.6:0/2700686687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77a40d2fc0 msgr2=0x7f77a4159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:37.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77a9039640 1 --2- 172.21.15.6:0/2700686687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77a40d2fc0 0x7f77a4159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.468+0000 7f77a9039640 1 -- 172.21.15.6:0/2700686687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77980093b0 con 0x7f77a415bde0 2023-07-21T22:38:37.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.472+0000 7f77a9039640 1 --2- 172.21.15.6:0/2700686687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77a415bde0 0x7f77a41510c0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f779c00efc0 tx=0x7f779c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:37.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.472+0000 7f77a17fa640 1 -- 172.21.15.6:0/2700686687 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c009ba0 con 0x7f77a415bde0 2023-07-21T22:38:37.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.472+0000 7f77a17fa640 1 -- 172.21.15.6:0/2700686687 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779c00f040 con 0x7f77a415bde0 2023-07-21T22:38:37.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.472+0000 7f77a17fa640 1 -- 172.21.15.6:0/2700686687 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c0146c0 con 0x7f77a415bde0 2023-07-21T22:38:37.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.472+0000 7f77aaa9c640 1 -- 172.21.15.6:0/2700686687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a40cbe40 con 0x7f77a415bde0 2023-07-21T22:38:37.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.472+0000 7f77aaa9c640 1 -- 172.21.15.6:0/2700686687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a40ca290 con 0x7f77a415bde0 2023-07-21T22:38:37.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.472+0000 7f77aaa9c640 1 -- 172.21.15.6:0/2700686687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a40678d0 con 0x7f77a415bde0 2023-07-21T22:38:37.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.472+0000 7f77a17fa640 1 -- 172.21.15.6:0/2700686687 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 59) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f779c014820 con 0x7f77a415bde0 2023-07-21T22:38:37.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.476+0000 7f77a17fa640 1 --2- 172.21.15.6:0/2700686687 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f77880663f0 0x7f77880688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:37.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.476+0000 7f77a17fa640 1 -- 172.21.15.6:0/2700686687 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f779c0849f0 con 0x7f77a415bde0 2023-07-21T22:38:37.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.476+0000 7f77a8838640 1 -- 172.21.15.6:0/2700686687 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f77880663f0 msgr2=0x7f77880688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3436422767 2023-07-21T22:38:37.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.476+0000 7f77a8838640 1 --2- 172.21.15.6:0/2700686687 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f77880663f0 0x7f77880688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:37.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.480+0000 7f77a17fa640 1 -- 172.21.15.6:0/2700686687 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f779c051cb0 con 0x7f77a415bde0 2023-07-21T22:38:37.565 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:37.519+0000 7f91a8846180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:38:37.600 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:37.556+0000 7f21c8813180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:38:37.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.640+0000 7f77aaa9c640 1 -- 172.21.15.6:0/2700686687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f77a40d27a0 con 0x7f77a415bde0 2023-07-21T22:38:37.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.644+0000 7f77a17fa640 1 -- 172.21.15.6:0/2700686687 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v48)=0 v48) v1 ==== 133+0+0 (secure 0 0 0) 0x7f779c0552d0 con 0x7f77a415bde0 2023-07-21T22:38:37.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.644+0000 7f77aaa9c640 1 -- 172.21.15.6:0/2700686687 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f77880663f0 msgr2=0x7f77880688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:37.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.644+0000 7f77aaa9c640 1 --2- 172.21.15.6:0/2700686687 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f77880663f0 0x7f77880688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.644+0000 7f77aaa9c640 1 -- 172.21.15.6:0/2700686687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77a415bde0 msgr2=0x7f77a41510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:37.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.644+0000 7f77aaa9c640 1 --2- 172.21.15.6:0/2700686687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77a415bde0 0x7f77a41510c0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f779c00efc0 tx=0x7f779c00c490 comp rx=0 tx=0).stop 2023-07-21T22:38:37.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.644+0000 7f77aaa9c640 1 -- 172.21.15.6:0/2700686687 shutdown_connections 2023-07-21T22:38:37.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.644+0000 7f77aaa9c640 1 --2- 172.21.15.6:0/2700686687 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f77880663f0 0x7f77880688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.644+0000 7f77aaa9c640 1 --2- 172.21.15.6:0/2700686687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77a415bde0 0x7f77a41510c0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.644+0000 7f77aaa9c640 1 --2- 172.21.15.6:0/2700686687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77a40d2fc0 0x7f77a4159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.644+0000 7f77aaa9c640 1 --2- 172.21.15.6:0/2700686687 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77a40d2300 0x7f77a41594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.644+0000 7f77aaa9c640 1 -- 172.21.15.6:0/2700686687 >> 172.21.15.6:0/2700686687 conn(0x7f77a40659d0 msgr2=0x7f77a40ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:37.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.644+0000 7f77aaa9c640 1 -- 172.21.15.6:0/2700686687 shutdown_connections 2023-07-21T22:38:37.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.644+0000 7f77aaa9c640 1 -- 172.21.15.6:0/2700686687 wait complete. 2023-07-21T22:38:37.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:38:37.711 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-21T22:38:37.715 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:37.671+0000 7f91a8846180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:38:37.728 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1h 2023-07-21T22:38:37.761 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:37.716+0000 7f21c8813180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:38:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.868+0000 7f062d367640 1 Processor -- start 2023-07-21T22:38:37.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.868+0000 7f062d367640 1 -- start start 2023-07-21T22:38:37.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.868+0000 7f062d367640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0628159440 0x7f06280c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:37.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.868+0000 7f062d367640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06281532b0 con 0x7f06280aeb40 2023-07-21T22:38:37.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.868+0000 7f062d367640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06280ca6f0 con 0x7f062815cef0 2023-07-21T22:38:37.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.868+0000 7f062d367640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f062815d360 con 0x7f0628159440 2023-07-21T22:38:37.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.868+0000 7f0626ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f06280aeb40 0x7f06280aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46612/0 (socket says 172.21.15.6:46612) 2023-07-21T22:38:37.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.868+0000 7f0626ffd640 1 -- 172.21.15.6:0/3151722873 learned_addr learned my addr 172.21.15.6:0/3151722873 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:37.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.868+0000 7f06277fe640 1 --2- 172.21.15.6:0/3151722873 >> v2:172.21.15.6:3300/0 conn(0x7f0628159440 0x7f06280c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:37.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.868+0000 7f06267fc640 1 -- 172.21.15.6:0/3151722873 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159003453 0 0) 0x7f06281532b0 con 0x7f06280aeb40 2023-07-21T22:38:37.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.868+0000 7f06267fc640 1 -- 172.21.15.6:0/3151722873 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0614005740 con 0x7f06280aeb40 2023-07-21T22:38:37.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.868+0000 7f06277fe640 1 -- 172.21.15.6:0/3151722873 >> v1:172.21.15.161:6789/0 conn(0x7f062815cef0 legacy=0x7f0628158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:37.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.868+0000 7f06267fc640 1 -- 172.21.15.6:0/3151722873 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492118294 0 0) 0x7f06280ca6f0 con 0x7f062815cef0 2023-07-21T22:38:37.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.868+0000 7f06277fe640 1 -- 172.21.15.6:0/3151722873 >> v1:172.21.15.6:6789/0 conn(0x7f06280aeb40 legacy=0x7f06280aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:37.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.868+0000 7f06277fe640 1 -- 172.21.15.6:0/3151722873 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06281599d0 con 0x7f0628159440 2023-07-21T22:38:37.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.872+0000 7f06277fe640 1 --2- 172.21.15.6:0/3151722873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0628159440 0x7f06280c88c0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f0620009d90 tx=0x7f062001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e90457969430bb0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:37.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.872+0000 7f06267fc640 1 -- 172.21.15.6:0/3151722873 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06200a59e0 con 0x7f0628159440 2023-07-21T22:38:37.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.872+0000 7f06267fc640 1 -- 172.21.15.6:0/3151722873 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06200a5b40 con 0x7f0628159440 2023-07-21T22:38:37.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.872+0000 7f06267fc640 1 -- 172.21.15.6:0/3151722873 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06200ad440 con 0x7f0628159440 2023-07-21T22:38:37.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.872+0000 7f062d367640 1 -- 172.21.15.6:0/3151722873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0628159440 msgr2=0x7f06280c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:37.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.872+0000 7f062d367640 1 --2- 172.21.15.6:0/3151722873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0628159440 0x7f06280c88c0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f0620009d90 tx=0x7f062001c920 comp rx=0 tx=0).stop 2023-07-21T22:38:37.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.872+0000 7f062d367640 1 -- 172.21.15.6:0/3151722873 shutdown_connections 2023-07-21T22:38:37.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.872+0000 7f062d367640 1 --2- 172.21.15.6:0/3151722873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0628159440 0x7f06280c88c0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.872+0000 7f062d367640 1 -- 172.21.15.6:0/3151722873 >> 172.21.15.6:0/3151722873 conn(0x7f06280cde90 msgr2=0x7f06280ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:37.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.872+0000 7f062d367640 1 -- 172.21.15.6:0/3151722873 shutdown_connections 2023-07-21T22:38:37.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.872+0000 7f062d367640 1 -- 172.21.15.6:0/3151722873 wait complete. 2023-07-21T22:38:37.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f062d367640 1 Processor -- start 2023-07-21T22:38:37.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f062d367640 1 -- start start 2023-07-21T22:38:37.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f062d367640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06280aeb40 0x7f062814c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:37.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f062d367640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0628159440 0x7f06280700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:37.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f062d367640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f062815cef0 0x7f06280c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:37.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f062d367640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06280705f0 con 0x7f0628159440 2023-07-21T22:38:37.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f062d367640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0628070890 con 0x7f062815cef0 2023-07-21T22:38:37.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f062d367640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0628070b70 con 0x7f06280aeb40 2023-07-21T22:38:37.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f061ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0628159440 0x7f06280700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:37.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f061ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0628159440 0x7f06280700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58646/0 (socket says 172.21.15.6:58646) 2023-07-21T22:38:37.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f061ffff640 1 -- 172.21.15.6:0/1456452924 learned_addr learned my addr 172.21.15.6:0/1456452924 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:37.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f06277fe640 1 --2- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f062815cef0 0x7f06280c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:37.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f0626ffd640 1 --2- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06280aeb40 0x7f062814c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:37.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f061ffff640 1 -- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06280aeb40 msgr2=0x7f062814c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:37.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f061ffff640 1 --2- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f06280aeb40 0x7f062814c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f061ffff640 1 -- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f062815cef0 msgr2=0x7f06280c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:37.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f061ffff640 1 --2- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f062815cef0 0x7f06280c3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:37.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f061ffff640 1 -- 172.21.15.6:0/1456452924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0620009a70 con 0x7f0628159440 2023-07-21T22:38:37.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f061ffff640 1 --2- 172.21.15.6:0/1456452924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0628159440 0x7f06280700b0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f061000c410 tx=0x7f061000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:37.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f061f7fe640 1 -- 172.21.15.6:0/1456452924 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06100054e0 con 0x7f0628159440 2023-07-21T22:38:37.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f061f7fe640 1 -- 172.21.15.6:0/1456452924 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0610003600 con 0x7f0628159440 2023-07-21T22:38:37.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f061f7fe640 1 -- 172.21.15.6:0/1456452924 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06100039b0 con 0x7f0628159440 2023-07-21T22:38:37.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f062d367640 1 -- 172.21.15.6:0/1456452924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0628070e50 con 0x7f0628159440 2023-07-21T22:38:37.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.876+0000 7f062d367640 1 -- 172.21.15.6:0/1456452924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062806bfd0 con 0x7f0628159440 2023-07-21T22:38:37.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.880+0000 7f062d367640 1 -- 172.21.15.6:0/1456452924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062806c210 con 0x7f0628159440 2023-07-21T22:38:37.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.880+0000 7f061f7fe640 1 -- 172.21.15.6:0/1456452924 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 59) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f0610003b10 con 0x7f0628159440 2023-07-21T22:38:37.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.880+0000 7f061f7fe640 1 --2- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0608066420 0x7f06080688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:37.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.880+0000 7f061f7fe640 1 -- 172.21.15.6:0/1456452924 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f0610083530 con 0x7f0628159440 2023-07-21T22:38:37.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.884+0000 7f0626ffd640 1 -- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0608066420 msgr2=0x7f06080688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3436422767 2023-07-21T22:38:37.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.884+0000 7f0626ffd640 1 --2- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0608066420 0x7f06080688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:37.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:37.888+0000 7f061f7fe640 1 -- 172.21.15.6:0/1456452924 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f062806c210 con 0x7f0628159440 2023-07-21T22:38:38.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:38.064+0000 7f062d367640 1 -- 172.21.15.6:0/1456452924 --> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f062815c9d0 con 0x7f0608066420 2023-07-21T22:38:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:38.088+0000 7f0626ffd640 1 -- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0608066420 msgr2=0x7f06080688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3436422767 2023-07-21T22:38:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:38.088+0000 7f0626ffd640 1 --2- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0608066420 0x7f06080688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:38:38.198 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:38.155+0000 7f91a8846180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:38:38.257 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:38.215+0000 7f91a8846180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:38:38.276 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:38.232+0000 7f21c8813180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:38:38.312 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:38.267+0000 7f91a8846180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:38:38.337 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:38.292+0000 7f21c8813180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:38:38.396 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:38.352+0000 7f21c8813180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:38:38.397 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:38.355+0000 7f91a8846180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:38:38.455 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:38.411+0000 7f91a8846180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:38:38.488 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:38.444+0000 7f21c8813180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:38:38.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:38.492+0000 7f0626ffd640 1 -- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0608066420 msgr2=0x7f06080688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3436422767 2023-07-21T22:38:38.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:38.492+0000 7f0626ffd640 1 --2- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0608066420 0x7f06080688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-21T22:38:38.539 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:38.495+0000 7f91a8846180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:38:38.548 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:38.504+0000 7f21c8813180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:38:38.596 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:38.551+0000 7f91a8846180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:38:38.637 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:38.592+0000 7f21c8813180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:38:38.696 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:38.652+0000 7f21c8813180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:38:38.735 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:38.691+0000 7f91a8846180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:38:38.794 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:38.751+0000 7f91a8846180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:38:38.846 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:38.800+0000 7f21c8813180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:38:38.907 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:38.860+0000 7f21c8813180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:38:39.033 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:38:39.034 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:38:39.034 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:38:39.042 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:38.999+0000 7f91a8846180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:38:39.160 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:38:39.160 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:38:39.160 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:38:39.174 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:39.124+0000 7f21c8813180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:38:39.179 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:39.135+0000 7f91a8846180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:38:39.304 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:39.259+0000 7f91a8846180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:38:39.308 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:39.264+0000 7f21c8813180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:38:39.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:39.296+0000 7f0626ffd640 1 -- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0608066420 msgr2=0x7f06080688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3436422767 2023-07-21T22:38:39.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:39.296+0000 7f0626ffd640 1 --2- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0608066420 0x7f06080688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-21T22:38:39.374 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:39.331+0000 7f91a8846180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:38:39.440 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:39.396+0000 7f21c8813180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:38:39.507 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:39.463+0000 7f91a8846180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:38:39.515 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:39.468+0000 7f21c8813180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:38:39.656 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:39.612+0000 7f21c8813180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:38:40.042 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:39.999+0000 7f91a8846180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:38:40.126 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:40.083+0000 7f91a8846180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:38:40.225 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:40.180+0000 7f21c8813180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:38:40.276 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:40.231+0000 7f91a8846180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:38:40.313 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:40.268+0000 7f21c8813180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:38:40.359 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:40.315+0000 7f91a8846180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:38:40.468 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:40.424+0000 7f21c8813180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:38:40.556 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:40.512+0000 7f21c8813180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:38:40.625 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:40.583+0000 7f91a8846180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:38:40.685 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:40.639+0000 7f91a8846180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:38:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:40.652+0000 7f061f7fe640 1 -- 172.21.15.6:0/1456452924 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 60) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f0610050c30 con 0x7f0628159440 2023-07-21T22:38:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:40.652+0000 7f061f7fe640 1 -- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0608066420 msgr2=0x7f06080688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:40.652+0000 7f061f7fe640 1 --2- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:6832/3436422767,v1:172.21.15.161:6833/3436422767] conn(0x7f0608066420 0x7f06080688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:40.818 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:40.775+0000 7f9126ca2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:40.819 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:40.775+0000 7f9126ca2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:40.819 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:40.775+0000 7f9126ca2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:40.819 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:40.775+0000 7f9126ca2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:40.819 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:40.775+0000 7f9126ca2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:40.820 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:40.775+0000 7f9129ca8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:40.820 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:40.775+0000 7f9129ca8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:40.820 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:40.775+0000 7f9129ca8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:40.820 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:40.775+0000 7f9129ca8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:40.820 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:40.775+0000 7f9129ca8640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:40.856 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:40.812+0000 7f21c8813180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:38:40.919 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:40.872+0000 7f21c8813180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:38:41.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.656+0000 7f061f7fe640 1 -- 172.21.15.6:0/1456452924 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mgrmap(e 61) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f0610081800 con 0x7f0628159440 2023-07-21T22:38:41.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.656+0000 7f061f7fe640 1 --2- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f0608033e90 0x7f06080709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:41.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.656+0000 7f061f7fe640 1 -- 172.21.15.6:0/1456452924 --> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f0608034260 con 0x7f0608033e90 2023-07-21T22:38:41.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.656+0000 7f0626ffd640 1 --2- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f0608033e90 0x7f06080709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:41.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.664+0000 7f0626ffd640 1 --2- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f0608033e90 0x7f06080709e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0618007fd0 tx=0x7f0618000bd0 comp rx=0 tx=0).ready entity=mgr.8641 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:41.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.728+0000 7f061f7fe640 1 -- 172.21.15.6:0/1456452924 <== mgr.8641 v2:172.21.15.161:6832/3543285241 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0608034260 con 0x7f0608033e90 2023-07-21T22:38:41.773 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule set for path snap_test_dir1 2023-07-21T22:38:41.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.728+0000 7f062d367640 1 -- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f0608033e90 msgr2=0x7f06080709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:41.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.728+0000 7f062d367640 1 --2- 172.21.15.6:0/1456452924 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f0608033e90 0x7f06080709e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0618007fd0 tx=0x7f0618000bd0 comp rx=0 tx=0).stop 2023-07-21T22:38:41.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.728+0000 7f062d367640 1 -- 172.21.15.6:0/1456452924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0628159440 msgr2=0x7f06280700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:41.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.728+0000 7f062d367640 1 --2- 172.21.15.6:0/1456452924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0628159440 0x7f06280700b0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f061000c410 tx=0x7f061000c8d0 comp rx=0 tx=0).stop 2023-07-21T22:38:41.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.728+0000 7f06277fe640 1 -- 172.21.15.6:0/1456452924 reap_dead start 2023-07-21T22:38:41.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.728+0000 7f062d367640 1 -- 172.21.15.6:0/1456452924 shutdown_connections 2023-07-21T22:38:41.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.728+0000 7f062d367640 1 -- 172.21.15.6:0/1456452924 >> 172.21.15.6:0/1456452924 conn(0x7f06280cde90 msgr2=0x7f062815b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:41.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.728+0000 7f062d367640 1 -- 172.21.15.6:0/1456452924 shutdown_connections 2023-07-21T22:38:41.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.728+0000 7f062d367640 1 -- 172.21.15.6:0/1456452924 wait complete. 2023-07-21T22:38:41.797 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-21T22:38:41.797 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-21T22:38:41.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.900+0000 7fdccd1e9640 1 Processor -- start 2023-07-21T22:38:41.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.900+0000 7fdccd1e9640 1 -- start start 2023-07-21T22:38:41.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.904+0000 7fdccd1e9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdcc8159440 0x7fdcc80c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:41.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.904+0000 7fdccd1e9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc81532b0 con 0x7fdcc815cef0 2023-07-21T22:38:41.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.904+0000 7fdccd1e9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc80ca6f0 con 0x7fdcc80aeb40 2023-07-21T22:38:41.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.904+0000 7fdccd1e9640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc815d360 con 0x7fdcc8159440 2023-07-21T22:38:41.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.904+0000 7fdcc759e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdcc8159440 0x7fdcc80c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:41.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.904+0000 7fdcc759e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdcc8159440 0x7fdcc80c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58648/0 (socket says 172.21.15.6:58648) 2023-07-21T22:38:41.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.904+0000 7fdcc759e640 1 -- 172.21.15.6:0/1217763741 learned_addr learned my addr 172.21.15.6:0/1217763741 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:41.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.904+0000 7fdcc659c640 1 --1- 172.21.15.6:0/1217763741 >> v1:172.21.15.6:6789/0 conn(0x7fdcc815cef0 0x7fdcc8158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46624/0 (socket says 172.21.15.6:46624) 2023-07-21T22:38:41.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.904+0000 7fdcc759e640 1 -- 172.21.15.6:0/1217763741 >> v1:172.21.15.161:6789/0 conn(0x7fdcc80aeb40 legacy=0x7fdcc80aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:41.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.904+0000 7fdcc759e640 1 -- 172.21.15.6:0/1217763741 >> v1:172.21.15.6:6789/0 conn(0x7fdcc815cef0 legacy=0x7fdcc8158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:41.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.904+0000 7fdcc759e640 1 -- 172.21.15.6:0/1217763741 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc81599d0 con 0x7fdcc8159440 2023-07-21T22:38:41.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.904+0000 7fdcc5d9b640 1 -- 172.21.15.6:0/1217763741 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810794974 0 0) 0x7fdcc81532b0 con 0x7fdcc815cef0 2023-07-21T22:38:41.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.908+0000 7fdcc759e640 1 --2- 172.21.15.6:0/1217763741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc8159440 0x7fdcc80c88c0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000d150 tx=0x7fdcc001ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cdb23997a92434f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:41.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.908+0000 7fdcc5d9b640 1 -- 172.21.15.6:0/1217763741 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc000b2d0 con 0x7fdcc8159440 2023-07-21T22:38:41.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.908+0000 7fdcc5d9b640 1 -- 172.21.15.6:0/1217763741 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc000b430 con 0x7fdcc8159440 2023-07-21T22:38:41.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.908+0000 7fdcc5d9b640 1 -- 172.21.15.6:0/1217763741 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc00a7cd0 con 0x7fdcc8159440 2023-07-21T22:38:41.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.908+0000 7fdccd1e9640 1 -- 172.21.15.6:0/1217763741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc8159440 msgr2=0x7fdcc80c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:41.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.908+0000 7fdccd1e9640 1 --2- 172.21.15.6:0/1217763741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc8159440 0x7fdcc80c88c0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fdcc000d150 tx=0x7fdcc001ebe0 comp rx=0 tx=0).stop 2023-07-21T22:38:41.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.908+0000 7fdccd1e9640 1 -- 172.21.15.6:0/1217763741 shutdown_connections 2023-07-21T22:38:41.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.908+0000 7fdccd1e9640 1 --2- 172.21.15.6:0/1217763741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc8159440 0x7fdcc80c88c0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:41.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.908+0000 7fdccd1e9640 1 -- 172.21.15.6:0/1217763741 >> 172.21.15.6:0/1217763741 conn(0x7fdcc80cde90 msgr2=0x7fdcc80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:41.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.908+0000 7fdccd1e9640 1 -- 172.21.15.6:0/1217763741 shutdown_connections 2023-07-21T22:38:41.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.908+0000 7fdccd1e9640 1 -- 172.21.15.6:0/1217763741 wait complete. 2023-07-21T22:38:41.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.908+0000 7fdccd1e9640 1 Processor -- start 2023-07-21T22:38:41.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.908+0000 7fdccd1e9640 1 -- start start 2023-07-21T22:38:41.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdccd1e9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc80aeb40 0x7fdcc81584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:41.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdccd1e9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcc8159440 0x7fdcc806fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdccd1e9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdcc815cef0 0x7fdcc81f7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdccd1e9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc806ffb0 con 0x7fdcc80aeb40 2023-07-21T22:38:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdccd1e9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc8070250 con 0x7fdcc8159440 2023-07-21T22:38:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdccd1e9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc8070530 con 0x7fdcc815cef0 2023-07-21T22:38:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdcc6d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc80aeb40 0x7fdcc81584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdcc6d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc80aeb40 0x7fdcc81584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58660/0 (socket says 172.21.15.6:58660) 2023-07-21T22:38:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdcc6d9d640 1 -- 172.21.15.6:0/2405458016 learned_addr learned my addr 172.21.15.6:0/2405458016 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:41.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdcc659c640 1 --2- 172.21.15.6:0/2405458016 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcc8159440 0x7fdcc806fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:41.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdcc759e640 1 --2- 172.21.15.6:0/2405458016 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdcc815cef0 0x7fdcc81f7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:41.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdcc6d9d640 1 -- 172.21.15.6:0/2405458016 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdcc815cef0 msgr2=0x7fdcc81f7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:41.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdcc6d9d640 1 --2- 172.21.15.6:0/2405458016 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdcc815cef0 0x7fdcc81f7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:41.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdcc6d9d640 1 -- 172.21.15.6:0/2405458016 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcc8159440 msgr2=0x7fdcc806fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:41.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdcc6d9d640 1 --2- 172.21.15.6:0/2405458016 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcc8159440 0x7fdcc806fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdcc6d9d640 1 -- 172.21.15.6:0/2405458016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc000bd40 con 0x7fdcc80aeb40 2023-07-21T22:38:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdcc659c640 1 --2- 172.21.15.6:0/2405458016 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcc8159440 0x7fdcc806fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdcc6d9d640 1 --2- 172.21.15.6:0/2405458016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc80aeb40 0x7fdcc81584b0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800c500 tx=0x7fdcb800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdcaf7fe640 1 -- 172.21.15.6:0/2405458016 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8005220 con 0x7fdcc80aeb40 2023-07-21T22:38:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdcaf7fe640 1 -- 172.21.15.6:0/2405458016 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb8005380 con 0x7fdcc80aeb40 2023-07-21T22:38:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdcaf7fe640 1 -- 172.21.15.6:0/2405458016 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8007270 con 0x7fdcc80aeb40 2023-07-21T22:38:41.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdccd1e9640 1 -- 172.21.15.6:0/2405458016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc8070810 con 0x7fdcc80aeb40 2023-07-21T22:38:41.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdccd1e9640 1 -- 172.21.15.6:0/2405458016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc81540a0 con 0x7fdcc80aeb40 2023-07-21T22:38:41.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.912+0000 7fdccd1e9640 1 -- 172.21.15.6:0/2405458016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc80678d0 con 0x7fdcc80aeb40 2023-07-21T22:38:41.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.916+0000 7fdcaf7fe640 1 -- 172.21.15.6:0/2405458016 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 61) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fdcb80073d0 con 0x7fdcc80aeb40 2023-07-21T22:38:41.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.916+0000 7fdcaf7fe640 1 --2- 172.21.15.6:0/2405458016 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fdcb4066150 0x7fdcb4068600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:41.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.916+0000 7fdcaf7fe640 1 -- 172.21.15.6:0/2405458016 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fdcb8083370 con 0x7fdcc80aeb40 2023-07-21T22:38:41.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.916+0000 7fdcc659c640 1 --2- 172.21.15.6:0/2405458016 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fdcb4066150 0x7fdcb4068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:41.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.916+0000 7fdcc659c640 1 --2- 172.21.15.6:0/2405458016 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fdcb4066150 0x7fdcb4068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc007bc0 tx=0x7fdcbc007b10 comp rx=0 tx=0).ready entity=mgr.8641 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:41.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:41.920+0000 7fdcaf7fe640 1 -- 172.21.15.6:0/2405458016 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdcb8050980 con 0x7fdcc80aeb40 2023-07-21T22:38:42.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.092+0000 7fdccd1e9640 1 -- 172.21.15.6:0/2405458016 --> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcc815c9d0 con 0x7fdcb4066150 2023-07-21T22:38:42.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.152+0000 7fdcaf7fe640 1 -- 172.21.15.6:0/2405458016 <== mgr.8641 v2:172.21.15.161:6832/3543285241 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fdcbc004b50 con 0x7fdcb4066150 2023-07-21T22:38:42.199 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule removed for path snap_test_dir1 2023-07-21T22:38:42.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.156+0000 7fdccd1e9640 1 -- 172.21.15.6:0/2405458016 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fdcb4066150 msgr2=0x7fdcb4068600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:42.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.156+0000 7fdccd1e9640 1 --2- 172.21.15.6:0/2405458016 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fdcb4066150 0x7fdcb4068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc007bc0 tx=0x7fdcbc007b10 comp rx=0 tx=0).stop 2023-07-21T22:38:42.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.156+0000 7fdccd1e9640 1 -- 172.21.15.6:0/2405458016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc80aeb40 msgr2=0x7fdcc81584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:42.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.156+0000 7fdccd1e9640 1 --2- 172.21.15.6:0/2405458016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc80aeb40 0x7fdcc81584b0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800c500 tx=0x7fdcb800c9c0 comp rx=0 tx=0).stop 2023-07-21T22:38:42.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.156+0000 7fdccd1e9640 1 -- 172.21.15.6:0/2405458016 shutdown_connections 2023-07-21T22:38:42.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.156+0000 7fdccd1e9640 1 --2- 172.21.15.6:0/2405458016 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fdcb4066150 0x7fdcb4068600 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:42.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.156+0000 7fdccd1e9640 1 --2- 172.21.15.6:0/2405458016 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdcc815cef0 0x7fdcc81f7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:42.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.156+0000 7fdccd1e9640 1 --2- 172.21.15.6:0/2405458016 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcc8159440 0x7fdcc806fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:42.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.156+0000 7fdccd1e9640 1 --2- 172.21.15.6:0/2405458016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcc80aeb40 0x7fdcc81584b0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:42.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.156+0000 7fdccd1e9640 1 -- 172.21.15.6:0/2405458016 >> 172.21.15.6:0/2405458016 conn(0x7fdcc80cde90 msgr2=0x7fdcc8152780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:42.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.156+0000 7fdccd1e9640 1 -- 172.21.15.6:0/2405458016 shutdown_connections 2023-07-21T22:38:42.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.156+0000 7fdccd1e9640 1 -- 172.21.15.6:0/2405458016 wait complete. 2023-07-21T22:38:42.220 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-21T22:38:42.221 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-07-21T22:38:42.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.324+0000 7fdcb349c640 1 Processor -- start 2023-07-21T22:38:42.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.324+0000 7fdcb349c640 1 -- start start 2023-07-21T22:38:42.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.324+0000 7fdcb349c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdcac069430 0x7fdcac0cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:42.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.324+0000 7fdcb349c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdcac06d2d0 0x7fdcac06d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:42.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.324+0000 7fdcb349c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcac0cb7d0 con 0x7fdcac160030 2023-07-21T22:38:42.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.324+0000 7fdcb349c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcac06c510 con 0x7fdcac069430 2023-07-21T22:38:42.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.324+0000 7fdcb349c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcac06c7f0 con 0x7fdcac06d2d0 2023-07-21T22:38:42.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.324+0000 7fdcb1238640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdcac069430 0x7fdcac0cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:42.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.324+0000 7fdcb1238640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdcac069430 0x7fdcac0cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58666/0 (socket says 172.21.15.6:58666) 2023-07-21T22:38:42.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.324+0000 7fdcb1238640 1 -- 172.21.15.6:0/3155389960 learned_addr learned my addr 172.21.15.6:0/3155389960 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:42.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.324+0000 7fdcb1a39640 1 --2- 172.21.15.6:0/3155389960 >> v2:172.21.15.161:3300/0 conn(0x7fdcac06d2d0 0x7fdcac06d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:42.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.324+0000 7fdcb1238640 1 -- 172.21.15.6:0/3155389960 >> v2:172.21.15.161:3300/0 conn(0x7fdcac06d2d0 msgr2=0x7fdcac06d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:42.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.324+0000 7fdcb1238640 1 --2- 172.21.15.6:0/3155389960 >> v2:172.21.15.161:3300/0 conn(0x7fdcac06d2d0 0x7fdcac06d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:42.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.324+0000 7fdcb1238640 1 -- 172.21.15.6:0/3155389960 >> v1:172.21.15.161:6789/0 conn(0x7fdcac160030 legacy=0x7fdcac069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:42.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.324+0000 7fdcb1238640 1 -- 172.21.15.6:0/3155389960 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac06cad0 con 0x7fdcac069430 2023-07-21T22:38:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.328+0000 7fdcb1238640 1 --2- 172.21.15.6:0/3155389960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcac069430 0x7fdcac0cb0f0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0b0b40 tx=0x7fdca801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27eb788d08c1ac01 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:42.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.328+0000 7fdca3fff640 1 -- 172.21.15.6:0/3155389960 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca80ad660 con 0x7fdcac069430 2023-07-21T22:38:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.328+0000 7fdca3fff640 1 -- 172.21.15.6:0/3155389960 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca80ad7c0 con 0x7fdcac069430 2023-07-21T22:38:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.328+0000 7fdca3fff640 1 -- 172.21.15.6:0/3155389960 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca80adb50 con 0x7fdcac069430 2023-07-21T22:38:42.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.328+0000 7fdcb349c640 1 -- 172.21.15.6:0/3155389960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcac069430 msgr2=0x7fdcac0cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.328+0000 7fdcb349c640 1 --2- 172.21.15.6:0/3155389960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcac069430 0x7fdcac0cb0f0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fdcac0b0b40 tx=0x7fdca801c440 comp rx=0 tx=0).stop 2023-07-21T22:38:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.328+0000 7fdcb349c640 1 -- 172.21.15.6:0/3155389960 shutdown_connections 2023-07-21T22:38:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.328+0000 7fdcb349c640 1 --2- 172.21.15.6:0/3155389960 >> v2:172.21.15.161:3300/0 conn(0x7fdcac06d2d0 0x7fdcac06d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.328+0000 7fdcb349c640 1 --2- 172.21.15.6:0/3155389960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcac069430 0x7fdcac0cb0f0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.328+0000 7fdcb349c640 1 -- 172.21.15.6:0/3155389960 >> 172.21.15.6:0/3155389960 conn(0x7fdcac0b1840 msgr2=0x7fdcac0cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.328+0000 7fdcb349c640 1 -- 172.21.15.6:0/3155389960 shutdown_connections 2023-07-21T22:38:42.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.328+0000 7fdcb349c640 1 -- 172.21.15.6:0/3155389960 wait complete. 2023-07-21T22:38:42.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb349c640 1 Processor -- start 2023-07-21T22:38:42.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb349c640 1 -- start start 2023-07-21T22:38:42.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb349c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcac069430 0x7fdcac0b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:42.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb349c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcac06d2d0 0x7fdcac0b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:42.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb349c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdcac160030 0x7fdcac1481a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:42.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb349c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac0b36d0 con 0x7fdcac06d2d0 2023-07-21T22:38:42.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb349c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac0b4320 con 0x7fdcac069430 2023-07-21T22:38:42.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb349c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac0b2b50 con 0x7fdcac160030 2023-07-21T22:38:42.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb0a37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcac06d2d0 0x7fdcac0b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:42.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb1238640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcac069430 0x7fdcac0b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:42.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb0a37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcac06d2d0 0x7fdcac0b3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58680/0 (socket says 172.21.15.6:58680) 2023-07-21T22:38:42.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb0a37640 1 -- 172.21.15.6:0/139832254 learned_addr learned my addr 172.21.15.6:0/139832254 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:42.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb1a39640 1 --2- 172.21.15.6:0/139832254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdcac160030 0x7fdcac1481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:42.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb0a37640 1 -- 172.21.15.6:0/139832254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdcac160030 msgr2=0x7fdcac1481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb0a37640 1 --2- 172.21.15.6:0/139832254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdcac160030 0x7fdcac1481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb0a37640 1 -- 172.21.15.6:0/139832254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcac069430 msgr2=0x7fdcac0b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb0a37640 1 --2- 172.21.15.6:0/139832254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcac069430 0x7fdcac0b2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb0a37640 1 -- 172.21.15.6:0/139832254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca80094d0 con 0x7fdcac06d2d0 2023-07-21T22:38:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb1238640 1 --2- 172.21.15.6:0/139832254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdcac069430 0x7fdcac0b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb0a37640 1 --2- 172.21.15.6:0/139832254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcac06d2d0 0x7fdcac0b3de0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00c500 tx=0x7fdc9c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdca1ffb640 1 -- 172.21.15.6:0/139832254 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c005220 con 0x7fdcac06d2d0 2023-07-21T22:38:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdca1ffb640 1 -- 172.21.15.6:0/139832254 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c005380 con 0x7fdcac06d2d0 2023-07-21T22:38:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdca1ffb640 1 -- 172.21.15.6:0/139832254 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c007270 con 0x7fdcac06d2d0 2023-07-21T22:38:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb349c640 1 -- 172.21.15.6:0/139832254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcac0b2e30 con 0x7fdcac06d2d0 2023-07-21T22:38:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.332+0000 7fdcb349c640 1 -- 172.21.15.6:0/139832254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcac0b33f0 con 0x7fdcac06d2d0 2023-07-21T22:38:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.336+0000 7fdcb349c640 1 -- 172.21.15.6:0/139832254 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcac148b00 con 0x7fdcac06d2d0 2023-07-21T22:38:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.336+0000 7fdca1ffb640 1 -- 172.21.15.6:0/139832254 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 61) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fdc9c0073d0 con 0x7fdcac06d2d0 2023-07-21T22:38:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.336+0000 7fdca1ffb640 1 --2- 172.21.15.6:0/139832254 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fdc90066120 0x7fdc900685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.336+0000 7fdca1ffb640 1 -- 172.21.15.6:0/139832254 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fdc9c083450 con 0x7fdcac06d2d0 2023-07-21T22:38:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.336+0000 7fdcb1238640 1 --2- 172.21.15.6:0/139832254 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fdc90066120 0x7fdc900685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.336+0000 7fdcb1238640 1 --2- 172.21.15.6:0/139832254 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fdc90066120 0x7fdc900685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdca80af000 tx=0x7fdca8008040 comp rx=0 tx=0).ready entity=mgr.8641 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:42.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.340+0000 7fdca1ffb640 1 -- 172.21.15.6:0/139832254 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdcac148b00 con 0x7fdcac06d2d0 2023-07-21T22:38:42.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.512+0000 7fdcb349c640 1 -- 172.21.15.6:0/139832254 --> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fdcac06e040 con 0x7fdc90066120 2023-07-21T22:38:42.564 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:42.519+0000 7f9130cb6640 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-07-21T22:38:42.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.520+0000 7fdca1ffb640 1 -- 172.21.15.6:0/139832254 <== mgr.8641 v2:172.21.15.161:6832/3543285241 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fdca80ad460 con 0x7fdc90066120 2023-07-21T22:38:42.565 INFO:teuthology.orchestra.run.smithi006.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-07-21T22:38:42.573 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-07-21T22:38:42.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:38:42.574 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-21T22:38:42.585 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-21T22:38:42.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.728+0000 7fcb8d0cb640 1 Processor -- start 2023-07-21T22:38:42.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.728+0000 7fcb8d0cb640 1 -- start start 2023-07-21T22:38:42.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.728+0000 7fcb8d0cb640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcb88159a70 0x7fcb880ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:42.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.732+0000 7fcb8d0cb640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb880cbe50 con 0x7fcb88071030 2023-07-21T22:38:42.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.732+0000 7fcb8d0cb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb880cd660 con 0x7fcb8815e060 2023-07-21T22:38:42.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.732+0000 7fcb8d0cb640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb880cc0a0 con 0x7fcb88159a70 2023-07-21T22:38:42.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.732+0000 7fcb86d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcb88159a70 0x7fcb880ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:42.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.732+0000 7fcb86d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcb88159a70 0x7fcb880ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58682/0 (socket says 172.21.15.6:58682) 2023-07-21T22:38:42.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.732+0000 7fcb86d9d640 1 -- 172.21.15.6:0/743132381 learned_addr learned my addr 172.21.15.6:0/743132381 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:42.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.732+0000 7fcb8759e640 1 --1- 172.21.15.6:0/743132381 >> v1:172.21.15.6:6789/0 conn(0x7fcb88071030 0x7fcb880c9da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46636/0 (socket says 172.21.15.6:46636) 2023-07-21T22:38:42.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.732+0000 7fcb86d9d640 1 -- 172.21.15.6:0/743132381 >> v1:172.21.15.161:6789/0 conn(0x7fcb8815e060 legacy=0x7fcb88070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:42.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.732+0000 7fcb86d9d640 1 -- 172.21.15.6:0/743132381 >> v1:172.21.15.6:6789/0 conn(0x7fcb88071030 legacy=0x7fcb880c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:42.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.732+0000 7fcb86d9d640 1 -- 172.21.15.6:0/743132381 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb880cc380 con 0x7fcb88159a70 2023-07-21T22:38:42.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.732+0000 7fcb8659c640 1 -- 172.21.15.6:0/743132381 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439398854 0 0) 0x7fcb880cbe50 con 0x7fcb88071030 2023-07-21T22:38:42.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.732+0000 7fcb86d9d640 1 --2- 172.21.15.6:0/743132381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb88159a70 0x7fcb880ccff0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fcb78009870 tx=0x7fcb7801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1db921a25707fe server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.732+0000 7fcb8659c640 1 -- 172.21.15.6:0/743132381 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb780ac630 con 0x7fcb88159a70 2023-07-21T22:38:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.732+0000 7fcb8659c640 1 -- 172.21.15.6:0/743132381 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb780ac790 con 0x7fcb88159a70 2023-07-21T22:38:42.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.732+0000 7fcb8659c640 1 -- 172.21.15.6:0/743132381 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb780acb20 con 0x7fcb88159a70 2023-07-21T22:38:42.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.736+0000 7fcb8d0cb640 1 -- 172.21.15.6:0/743132381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb88159a70 msgr2=0x7fcb880ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:42.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.736+0000 7fcb8d0cb640 1 --2- 172.21.15.6:0/743132381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb88159a70 0x7fcb880ccff0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fcb78009870 tx=0x7fcb7801c3b0 comp rx=0 tx=0).stop 2023-07-21T22:38:42.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.736+0000 7fcb8d0cb640 1 -- 172.21.15.6:0/743132381 shutdown_connections 2023-07-21T22:38:42.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.736+0000 7fcb8d0cb640 1 --2- 172.21.15.6:0/743132381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb88159a70 0x7fcb880ccff0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:42.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.736+0000 7fcb8d0cb640 1 -- 172.21.15.6:0/743132381 >> 172.21.15.6:0/743132381 conn(0x7fcb880afac0 msgr2=0x7fcb880afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:42.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.736+0000 7fcb8d0cb640 1 -- 172.21.15.6:0/743132381 shutdown_connections 2023-07-21T22:38:42.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.736+0000 7fcb8d0cb640 1 -- 172.21.15.6:0/743132381 wait complete. 2023-07-21T22:38:42.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.736+0000 7fcb8d0cb640 1 Processor -- start 2023-07-21T22:38:42.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.736+0000 7fcb8d0cb640 1 -- start start 2023-07-21T22:38:42.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.736+0000 7fcb8d0cb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb88071030 0x7fcb8814d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:42.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.736+0000 7fcb8d0cb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb88159a70 0x7fcb8814b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:42.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.736+0000 7fcb8d0cb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb8815e060 0x7fcb8814ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:42.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.736+0000 7fcb8d0cb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8814bc60 con 0x7fcb88071030 2023-07-21T22:38:42.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.736+0000 7fcb8d0cb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8806be30 con 0x7fcb88159a70 2023-07-21T22:38:42.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.736+0000 7fcb8d0cb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8814bf00 con 0x7fcb8815e060 2023-07-21T22:38:42.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.736+0000 7fcb86d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb88071030 0x7fcb8814d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:42.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.736+0000 7fcb86d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb88071030 0x7fcb8814d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58690/0 (socket says 172.21.15.6:58690) 2023-07-21T22:38:42.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.736+0000 7fcb86d9d640 1 -- 172.21.15.6:0/1337912319 learned_addr learned my addr 172.21.15.6:0/1337912319 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:42.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.736+0000 7fcb7ffff640 1 --2- 172.21.15.6:0/1337912319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb88159a70 0x7fcb8814b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:42.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.736+0000 7fcb8759e640 1 --2- 172.21.15.6:0/1337912319 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb8815e060 0x7fcb8814ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:42.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.740+0000 7fcb86d9d640 1 -- 172.21.15.6:0/1337912319 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb8815e060 msgr2=0x7fcb8814ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:42.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.740+0000 7fcb86d9d640 1 --2- 172.21.15.6:0/1337912319 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb8815e060 0x7fcb8814ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:42.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.740+0000 7fcb86d9d640 1 -- 172.21.15.6:0/1337912319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb88159a70 msgr2=0x7fcb8814b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:42.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.740+0000 7fcb86d9d640 1 --2- 172.21.15.6:0/1337912319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb88159a70 0x7fcb8814b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:42.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.740+0000 7fcb86d9d640 1 -- 172.21.15.6:0/1337912319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb780094d0 con 0x7fcb88071030 2023-07-21T22:38:42.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.740+0000 7fcb86d9d640 1 --2- 172.21.15.6:0/1337912319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb88071030 0x7fcb8814d520 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fcb780af040 tx=0x7fcb7801abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:42.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.740+0000 7fcb7f7fe640 1 -- 172.21.15.6:0/1337912319 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb780b7830 con 0x7fcb88071030 2023-07-21T22:38:42.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.740+0000 7fcb7f7fe640 1 -- 172.21.15.6:0/1337912319 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb780b79b0 con 0x7fcb88071030 2023-07-21T22:38:42.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.740+0000 7fcb7f7fe640 1 -- 172.21.15.6:0/1337912319 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb780b7d60 con 0x7fcb88071030 2023-07-21T22:38:42.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.740+0000 7fcb8d0cb640 1 -- 172.21.15.6:0/1337912319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8806c0f0 con 0x7fcb88071030 2023-07-21T22:38:42.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.740+0000 7fcb8d0cb640 1 -- 172.21.15.6:0/1337912319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8806c6b0 con 0x7fcb88071030 2023-07-21T22:38:42.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.740+0000 7fcb8d0cb640 1 -- 172.21.15.6:0/1337912319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb880678d0 con 0x7fcb88071030 2023-07-21T22:38:42.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.740+0000 7fcb7f7fe640 1 -- 172.21.15.6:0/1337912319 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 62) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fcb780b3040 con 0x7fcb88071030 2023-07-21T22:38:42.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.740+0000 7fcb7f7fe640 1 --2- 172.21.15.6:0/1337912319 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fcb680664b0 0x7fcb68068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:42.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.740+0000 7fcb7f7fe640 1 -- 172.21.15.6:0/1337912319 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fcb7811e8d0 con 0x7fcb88071030 2023-07-21T22:38:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.740+0000 7fcb7ffff640 1 --2- 172.21.15.6:0/1337912319 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fcb680664b0 0x7fcb68068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.744+0000 7fcb7ffff640 1 --2- 172.21.15.6:0/1337912319 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fcb680664b0 0x7fcb68068960 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcb880b19c0 tx=0x7fcb70009060 comp rx=0 tx=0).ready entity=mgr.8641 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:42.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.744+0000 7fcb7f7fe640 1 -- 172.21.15.6:0/1337912319 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcb780eba10 con 0x7fcb88071030 2023-07-21T22:38:42.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:42.936+0000 7fcb8d0cb640 1 -- 172.21.15.6:0/1337912319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fcb8814dff0 con 0x7fcb88071030 2023-07-21T22:38:43.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:43.908+0000 7fcb7f7fe640 1 -- 172.21.15.6:0/1337912319 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 63) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fcb780ebde0 con 0x7fcb88071030 2023-07-21T22:38:43.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:43.908+0000 7fcb7f7fe640 1 -- 172.21.15.6:0/1337912319 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v63) v1 ==== 93+0+0 (secure 0 0 0) 0x7fcb78104980 con 0x7fcb88071030 2023-07-21T22:38:43.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:43.912+0000 7fcb8d0cb640 1 -- 172.21.15.6:0/1337912319 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fcb680664b0 msgr2=0x7fcb68068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:43.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:43.912+0000 7fcb8d0cb640 1 --2- 172.21.15.6:0/1337912319 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fcb680664b0 0x7fcb68068960 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcb880b19c0 tx=0x7fcb70009060 comp rx=0 tx=0).stop 2023-07-21T22:38:43.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:43.912+0000 7fcb8d0cb640 1 -- 172.21.15.6:0/1337912319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb88071030 msgr2=0x7fcb8814d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:43.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:43.912+0000 7fcb8d0cb640 1 --2- 172.21.15.6:0/1337912319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb88071030 0x7fcb8814d520 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fcb780af040 tx=0x7fcb7801abf0 comp rx=0 tx=0).stop 2023-07-21T22:38:43.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:43.912+0000 7fcb8d0cb640 1 -- 172.21.15.6:0/1337912319 shutdown_connections 2023-07-21T22:38:43.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:43.912+0000 7fcb8d0cb640 1 --2- 172.21.15.6:0/1337912319 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fcb680664b0 0x7fcb68068960 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:43.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:43.912+0000 7fcb8d0cb640 1 --2- 172.21.15.6:0/1337912319 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcb8815e060 0x7fcb8814ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:43.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:43.912+0000 7fcb8d0cb640 1 --2- 172.21.15.6:0/1337912319 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb88159a70 0x7fcb8814b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:43.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:43.912+0000 7fcb8d0cb640 1 --2- 172.21.15.6:0/1337912319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb88071030 0x7fcb8814d520 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:43.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:43.912+0000 7fcb8d0cb640 1 -- 172.21.15.6:0/1337912319 >> 172.21.15.6:0/1337912319 conn(0x7fcb880afac0 msgr2=0x7fcb880b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:43.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:43.912+0000 7fcb8d0cb640 1 -- 172.21.15.6:0/1337912319 shutdown_connections 2023-07-21T22:38:43.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:43.912+0000 7fcb8d0cb640 1 -- 172.21.15.6:0/1337912319 wait complete. 2023-07-21T22:38:43.966 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:38:43.972 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:38:43.980 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:38:43.980 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:38:44.126 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:38:44.130 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:44.084+0000 7f97dc63a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:38:44.131 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:44.087+0000 7fa3bdd7e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:38:44.199 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:38:44.200 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:38:44.200 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:38:44.211 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:38:44.211 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:38:44.264 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:38:44.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.404+0000 7f126e505640 1 Processor -- start 2023-07-21T22:38:44.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.408+0000 7f126e505640 1 -- start start 2023-07-21T22:38:44.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.408+0000 7f126e505640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f126806e770 0x7f12680abd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.408+0000 7f126e505640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1268069b40 0x7f12680cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.408+0000 7f126e505640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126806eb40 con 0x7f12680ce650 2023-07-21T22:38:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.408+0000 7f126e505640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12680c9950 con 0x7f1268069b40 2023-07-21T22:38:44.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.408+0000 7f126e505640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126815f900 con 0x7f126806e770 2023-07-21T22:38:44.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.408+0000 7f126dd04640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1268069b40 0x7f12680cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:44.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.408+0000 7f126d503640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f126806e770 0x7f12680abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:44.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.408+0000 7f126dd04640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1268069b40 0x7f12680cce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58726/0 (socket says 172.21.15.6:58726) 2023-07-21T22:38:44.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.408+0000 7f126dd04640 1 -- 172.21.15.6:0/3378988470 learned_addr learned my addr 172.21.15.6:0/3378988470 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:44.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.408+0000 7f126d503640 1 -- 172.21.15.6:0/3378988470 >> v2:172.21.15.6:3300/0 conn(0x7f1268069b40 msgr2=0x7f12680cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:44.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.408+0000 7f126d503640 1 --2- 172.21.15.6:0/3378988470 >> v2:172.21.15.6:3300/0 conn(0x7f1268069b40 0x7f12680cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:44.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.408+0000 7f126d503640 1 -- 172.21.15.6:0/3378988470 >> v1:172.21.15.161:6789/0 conn(0x7f12680ce650 legacy=0x7f1268069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:44.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.408+0000 7f126d503640 1 -- 172.21.15.6:0/3378988470 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126815fbe0 con 0x7f126806e770 2023-07-21T22:38:44.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.412+0000 7f126d503640 1 --2- 172.21.15.6:0/3378988470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f126806e770 0x7f12680abd60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f12680b1b40 tx=0x7f126401c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f6511fd0b6cb01b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.412+0000 7f125ffff640 1 -- 172.21.15.6:0/3378988470 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12640a7070 con 0x7f126806e770 2023-07-21T22:38:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.412+0000 7f125ffff640 1 -- 172.21.15.6:0/3378988470 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12640ab430 con 0x7f126806e770 2023-07-21T22:38:44.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.412+0000 7f125ffff640 1 -- 172.21.15.6:0/3378988470 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12640ab7c0 con 0x7f126806e770 2023-07-21T22:38:44.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.412+0000 7f126e505640 1 -- 172.21.15.6:0/3378988470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f126806e770 msgr2=0x7f12680abd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:44.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.412+0000 7f126e505640 1 --2- 172.21.15.6:0/3378988470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f126806e770 0x7f12680abd60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f12680b1b40 tx=0x7f126401c430 comp rx=0 tx=0).stop 2023-07-21T22:38:44.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.412+0000 7f126e505640 1 -- 172.21.15.6:0/3378988470 shutdown_connections 2023-07-21T22:38:44.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.412+0000 7f126e505640 1 --2- 172.21.15.6:0/3378988470 >> v2:172.21.15.6:3300/0 conn(0x7f1268069b40 0x7f12680cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:44.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.412+0000 7f126e505640 1 --2- 172.21.15.6:0/3378988470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f126806e770 0x7f12680abd60 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:44.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.412+0000 7f126e505640 1 -- 172.21.15.6:0/3378988470 >> 172.21.15.6:0/3378988470 conn(0x7f126806a540 msgr2=0x7f126806a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:44.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.412+0000 7f126e505640 1 -- 172.21.15.6:0/3378988470 shutdown_connections 2023-07-21T22:38:44.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.412+0000 7f126e505640 1 -- 172.21.15.6:0/3378988470 wait complete. 2023-07-21T22:38:44.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126e505640 1 Processor -- start 2023-07-21T22:38:44.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126e505640 1 -- start start 2023-07-21T22:38:44.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126e505640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1268069b40 0x7f126806d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:44.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126e505640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f126806e770 0x7f12680b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:44.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126e505640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12680ce650 0x7f12680b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:44.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126e505640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12681573e0 con 0x7f126806e770 2023-07-21T22:38:44.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126e505640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12680c8580 con 0x7f1268069b40 2023-07-21T22:38:44.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126e505640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12680c8860 con 0x7f12680ce650 2023-07-21T22:38:44.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126cd02640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f126806e770 0x7f12680b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:44.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126cd02640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f126806e770 0x7f12680b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58728/0 (socket says 172.21.15.6:58728) 2023-07-21T22:38:44.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126cd02640 1 -- 172.21.15.6:0/3045054233 learned_addr learned my addr 172.21.15.6:0/3045054233 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:44.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126d503640 1 --2- 172.21.15.6:0/3045054233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1268069b40 0x7f126806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:44.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126dd04640 1 --2- 172.21.15.6:0/3045054233 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12680ce650 0x7f12680b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:44.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126d503640 1 -- 172.21.15.6:0/3045054233 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12680ce650 msgr2=0x7f12680b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:44.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126d503640 1 --2- 172.21.15.6:0/3045054233 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12680ce650 0x7f12680b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:44.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126d503640 1 -- 172.21.15.6:0/3045054233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f126806e770 msgr2=0x7f12680b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:44.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126d503640 1 --2- 172.21.15.6:0/3045054233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f126806e770 0x7f12680b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:44.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126d503640 1 -- 172.21.15.6:0/3045054233 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1264009420 con 0x7f1268069b40 2023-07-21T22:38:44.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126cd02640 1 --2- 172.21.15.6:0/3045054233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f126806e770 0x7f12680b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:44.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126d503640 1 --2- 172.21.15.6:0/3045054233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1268069b40 0x7f126806d810 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f12640ac000 tx=0x7f126401ac70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:44.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f125dffb640 1 -- 172.21.15.6:0/3045054233 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12640bf610 con 0x7f1268069b40 2023-07-21T22:38:44.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f125dffb640 1 -- 172.21.15.6:0/3045054233 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12640bf790 con 0x7f1268069b40 2023-07-21T22:38:44.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f125dffb640 1 -- 172.21.15.6:0/3045054233 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12640bfb40 con 0x7f1268069b40 2023-07-21T22:38:44.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126e505640 1 -- 172.21.15.6:0/3045054233 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12680b3160 con 0x7f1268069b40 2023-07-21T22:38:44.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.416+0000 7f126e505640 1 -- 172.21.15.6:0/3045054233 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12680b2e10 con 0x7f1268069b40 2023-07-21T22:38:44.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.420+0000 7f126e505640 1 -- 172.21.15.6:0/3045054233 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12680678d0 con 0x7f1268069b40 2023-07-21T22:38:44.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.420+0000 7f125dffb640 1 -- 172.21.15.6:0/3045054233 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 63) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f12640b5400 con 0x7f1268069b40 2023-07-21T22:38:44.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.420+0000 7f125dffb640 1 --2- 172.21.15.6:0/3045054233 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f124c066430 0x7f124c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:44.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.420+0000 7f125dffb640 1 -- 172.21.15.6:0/3045054233 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f126411e670 con 0x7f1268069b40 2023-07-21T22:38:44.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.420+0000 7f126cd02640 1 -- 172.21.15.6:0/3045054233 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f124c066430 msgr2=0x7f124c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3543285241 2023-07-21T22:38:44.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.420+0000 7f126cd02640 1 --2- 172.21.15.6:0/3045054233 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f124c066430 0x7f124c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:44.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.424+0000 7f125dffb640 1 -- 172.21.15.6:0/3045054233 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f12640eb720 con 0x7f1268069b40 2023-07-21T22:38:44.548 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:44.507+0000 7fa3bdd7e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:38:44.573 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:44.528+0000 7f97dc63a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:38:44.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.584+0000 7f126e505640 1 -- 172.21.15.6:0/3045054233 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12680b3610 con 0x7f1268069b40 2023-07-21T22:38:44.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.584+0000 7f125dffb640 1 -- 172.21.15.6:0/3045054233 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+18911 (secure 0 0 0) 0x7f12640abe60 con 0x7f1268069b40 2023-07-21T22:38:44.631 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:44.631 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":144,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:38:40.645814+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:38:21.546383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-21T22:38:22.445128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/611533009":"2023-07-22T22:38:40.645781+0000","172.21.15.161:6833/3436422767":"2023-07-22T22:38:40.645781+0000","172.21.15.161:0/3113062624":"2023-07-22T22:38:40.645781+0000","172.21.15.161:6832/3436422767":"2023-07-22T22:38:40.645781+0000","172.21.15.161:0/2051512394":"2023-07-22T22:38:40.645781+0000","172.21.15.161:0/747215894":"2023-07-22T22:38:40.645781+0000","172.21.15.161:0/3161426051":"2023-07-22T22:38:40.645781+0000","172.21.15.161:0/3783651589":"2023-07-22T22:38:40.645781+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:38:44.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.588+0000 7f126e505640 1 -- 172.21.15.6:0/3045054233 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f124c066430 msgr2=0x7f124c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:44.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.588+0000 7f126e505640 1 --2- 172.21.15.6:0/3045054233 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f124c066430 0x7f124c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:44.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.588+0000 7f126e505640 1 -- 172.21.15.6:0/3045054233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1268069b40 msgr2=0x7f126806d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:44.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.588+0000 7f126e505640 1 --2- 172.21.15.6:0/3045054233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1268069b40 0x7f126806d810 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f12640ac000 tx=0x7f126401ac70 comp rx=0 tx=0).stop 2023-07-21T22:38:44.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.588+0000 7f126e505640 1 -- 172.21.15.6:0/3045054233 shutdown_connections 2023-07-21T22:38:44.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.588+0000 7f126e505640 1 --2- 172.21.15.6:0/3045054233 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f124c066430 0x7f124c0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:44.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.588+0000 7f126e505640 1 --2- 172.21.15.6:0/3045054233 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f12680ce650 0x7f12680b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:44.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.588+0000 7f126e505640 1 --2- 172.21.15.6:0/3045054233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f126806e770 0x7f12680b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:44.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.588+0000 7f126e505640 1 --2- 172.21.15.6:0/3045054233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1268069b40 0x7f126806d810 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:44.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.588+0000 7f126e505640 1 -- 172.21.15.6:0/3045054233 >> 172.21.15.6:0/3045054233 conn(0x7f126806a540 msgr2=0x7f126815b120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:44.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.588+0000 7f126e505640 1 -- 172.21.15.6:0/3045054233 shutdown_connections 2023-07-21T22:38:44.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.588+0000 7f126e505640 1 -- 172.21.15.6:0/3045054233 wait complete. 2023-07-21T22:38:44.653 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:38:21.546383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:38:22.445128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:38:44.654 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:38:44.699 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:44.659+0000 7fa3bdd7e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:38:44.736 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:44.692+0000 7f97dc63a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:38:44.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.756+0000 7f4c0e567640 1 Processor -- start 2023-07-21T22:38:44.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.756+0000 7f4c0e567640 1 -- start start 2023-07-21T22:38:44.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.756+0000 7f4c0e567640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4c080d2fc0 0x7f4c080b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:44.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.760+0000 7f4c0e567640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c080b04c0 con 0x7f4c0815bde0 2023-07-21T22:38:44.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.760+0000 7f4c0e567640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c080d0aa0 con 0x7f4c080d2300 2023-07-21T22:38:44.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.760+0000 7f4c0e567640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0815c1b0 con 0x7f4c080d2fc0 2023-07-21T22:38:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.760+0000 7f4c07fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4c0815bde0 0x7f4c080d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46656/0 (socket says 172.21.15.6:46656) 2023-07-21T22:38:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.760+0000 7f4c07fff640 1 -- 172.21.15.6:0/2976850295 learned_addr learned my addr 172.21.15.6:0/2976850295 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.760+0000 7f4c077fe640 1 --2- 172.21.15.6:0/2976850295 >> v2:172.21.15.161:3300/0 conn(0x7f4c080d2fc0 0x7f4c080b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.760+0000 7f4c06ffd640 1 -- 172.21.15.6:0/2976850295 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815079064 0 0) 0x7f4c080b04c0 con 0x7f4c0815bde0 2023-07-21T22:38:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.760+0000 7f4c06ffd640 1 -- 172.21.15.6:0/2976850295 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bf0003530 con 0x7f4c0815bde0 2023-07-21T22:38:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.760+0000 7f4c077fe640 1 -- 172.21.15.6:0/2976850295 >> v1:172.21.15.161:6789/0 conn(0x7f4c080d2300 legacy=0x7f4c080cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.760+0000 7f4c077fe640 1 -- 172.21.15.6:0/2976850295 >> v1:172.21.15.6:6789/0 conn(0x7f4c0815bde0 legacy=0x7f4c080d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.760+0000 7f4c077fe640 1 -- 172.21.15.6:0/2976850295 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c080afb90 con 0x7f4c080d2fc0 2023-07-21T22:38:44.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.760+0000 7f4c077fe640 1 --2- 172.21.15.6:0/2976850295 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c080d2fc0 0x7f4c080b0950 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0097c0 tx=0x7f4bfc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97a5e207b89fd569 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:44.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.764+0000 7f4c06ffd640 1 -- 172.21.15.6:0/2976850295 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc0ab680 con 0x7f4c080d2fc0 2023-07-21T22:38:44.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.764+0000 7f4c06ffd640 1 -- 172.21.15.6:0/2976850295 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc0ab7e0 con 0x7f4c080d2fc0 2023-07-21T22:38:44.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.764+0000 7f4c06ffd640 1 -- 172.21.15.6:0/2976850295 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc0abb50 con 0x7f4c080d2fc0 2023-07-21T22:38:44.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.764+0000 7f4c0e567640 1 -- 172.21.15.6:0/2976850295 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c080d2fc0 msgr2=0x7f4c080b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:44.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.764+0000 7f4c0e567640 1 --2- 172.21.15.6:0/2976850295 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c080d2fc0 0x7f4c080b0950 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0097c0 tx=0x7f4bfc01c480 comp rx=0 tx=0).stop 2023-07-21T22:38:44.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.764+0000 7f4c0e567640 1 -- 172.21.15.6:0/2976850295 shutdown_connections 2023-07-21T22:38:44.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.764+0000 7f4c0e567640 1 --2- 172.21.15.6:0/2976850295 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c080d2fc0 0x7f4c080b0950 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:44.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.764+0000 7f4c0e567640 1 -- 172.21.15.6:0/2976850295 >> 172.21.15.6:0/2976850295 conn(0x7f4c080659d0 msgr2=0x7f4c0809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:44.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.764+0000 7f4c0e567640 1 -- 172.21.15.6:0/2976850295 shutdown_connections 2023-07-21T22:38:44.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.764+0000 7f4c0e567640 1 -- 172.21.15.6:0/2976850295 wait complete. 2023-07-21T22:38:44.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.764+0000 7f4c0e567640 1 Processor -- start 2023-07-21T22:38:44.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.764+0000 7f4c0e567640 1 -- start start 2023-07-21T22:38:44.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.764+0000 7f4c0e567640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c080d2300 0x7f4c080b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:44.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.764+0000 7f4c0e567640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4c080d2fc0 0x7f4c08150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:44.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.764+0000 7f4c0e567640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c0815bde0 0x7f4c08150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:44.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.764+0000 7f4c0e567640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c080c9620 con 0x7f4c080d2300 2023-07-21T22:38:44.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.764+0000 7f4c0e567640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0815d0e0 con 0x7f4c0815bde0 2023-07-21T22:38:44.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.764+0000 7f4c0e567640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c080c6040 con 0x7f4c080d2fc0 2023-07-21T22:38:44.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.764+0000 7f4c07fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c080d2300 0x7f4c080b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:44.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.768+0000 7f4c07fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c080d2300 0x7f4c080b6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58734/0 (socket says 172.21.15.6:58734) 2023-07-21T22:38:44.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.768+0000 7f4c07fff640 1 -- 172.21.15.6:0/2175484142 learned_addr learned my addr 172.21.15.6:0/2175484142 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:44.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.768+0000 7f4c0cb04640 1 --2- 172.21.15.6:0/2175484142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c0815bde0 0x7f4c08150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:44.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.768+0000 7f4c077fe640 1 --2- 172.21.15.6:0/2175484142 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4c080d2fc0 0x7f4c08150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:44.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.768+0000 7f4c07fff640 1 -- 172.21.15.6:0/2175484142 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4c080d2fc0 msgr2=0x7f4c08150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:44.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.768+0000 7f4c07fff640 1 --2- 172.21.15.6:0/2175484142 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4c080d2fc0 0x7f4c08150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:44.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.768+0000 7f4c07fff640 1 -- 172.21.15.6:0/2175484142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c0815bde0 msgr2=0x7f4c08150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:44.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.768+0000 7f4c07fff640 1 --2- 172.21.15.6:0/2175484142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c0815bde0 0x7f4c08150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:44.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.768+0000 7f4c07fff640 1 -- 172.21.15.6:0/2175484142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bfc009420 con 0x7f4c080d2300 2023-07-21T22:38:44.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.768+0000 7f4c07fff640 1 --2- 172.21.15.6:0/2175484142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c080d2300 0x7f4c080b6450 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8001270 tx=0x7f4bf800cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:44.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.768+0000 7f4c04ff9640 1 -- 172.21.15.6:0/2175484142 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8007270 con 0x7f4c080d2300 2023-07-21T22:38:44.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.768+0000 7f4c04ff9640 1 -- 172.21.15.6:0/2175484142 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf80073d0 con 0x7f4c080d2300 2023-07-21T22:38:44.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.768+0000 7f4c04ff9640 1 -- 172.21.15.6:0/2175484142 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf800ce50 con 0x7f4c080d2300 2023-07-21T22:38:44.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.768+0000 7f4c0e567640 1 -- 172.21.15.6:0/2175484142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c080c6320 con 0x7f4c080d2300 2023-07-21T22:38:44.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.768+0000 7f4c0e567640 1 -- 172.21.15.6:0/2175484142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c080b6990 con 0x7f4c080d2300 2023-07-21T22:38:44.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.768+0000 7f4c0e567640 1 -- 172.21.15.6:0/2175484142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c080c5ea0 con 0x7f4c080d2300 2023-07-21T22:38:44.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.768+0000 7f4c04ff9640 1 -- 172.21.15.6:0/2175484142 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 63) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f4bf80057b0 con 0x7f4c080d2300 2023-07-21T22:38:44.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.772+0000 7f4c04ff9640 1 --2- 172.21.15.6:0/2175484142 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f4bf4066430 0x7f4bf40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:44.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.772+0000 7f4c04ff9640 1 -- 172.21.15.6:0/2175484142 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f4bf8083760 con 0x7f4c080d2300 2023-07-21T22:38:44.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.772+0000 7f4c077fe640 1 -- 172.21.15.6:0/2175484142 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f4bf4066430 msgr2=0x7f4bf40688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3543285241 2023-07-21T22:38:44.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.772+0000 7f4c077fe640 1 --2- 172.21.15.6:0/2175484142 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f4bf4066430 0x7f4bf40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:44.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.776+0000 7f4c04ff9640 1 -- 172.21.15.6:0/2175484142 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4c080c5ea0 con 0x7f4c080d2300 2023-07-21T22:38:44.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.932+0000 7f4c0e567640 1 -- 172.21.15.6:0/2175484142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4c080c5ea0 con 0x7f4c080d2300 2023-07-21T22:38:44.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.932+0000 7f4c04ff9640 1 -- 172.21.15.6:0/2175484142 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v144) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4bf8017020 con 0x7f4c080d2300 2023-07-21T22:38:44.977 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:38:44.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.932+0000 7f4c0e567640 1 -- 172.21.15.6:0/2175484142 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f4bf4066430 msgr2=0x7f4bf40688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:44.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.932+0000 7f4c0e567640 1 --2- 172.21.15.6:0/2175484142 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f4bf4066430 0x7f4bf40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:44.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.932+0000 7f4c0e567640 1 -- 172.21.15.6:0/2175484142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c080d2300 msgr2=0x7f4c080b6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:44.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.932+0000 7f4c0e567640 1 --2- 172.21.15.6:0/2175484142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c080d2300 0x7f4c080b6450 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8001270 tx=0x7f4bf800cb10 comp rx=0 tx=0).stop 2023-07-21T22:38:44.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.932+0000 7f4c0e567640 1 -- 172.21.15.6:0/2175484142 shutdown_connections 2023-07-21T22:38:44.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.932+0000 7f4c0e567640 1 --2- 172.21.15.6:0/2175484142 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f4bf4066430 0x7f4bf40688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:44.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.932+0000 7f4c0e567640 1 --2- 172.21.15.6:0/2175484142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c0815bde0 0x7f4c08150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:44.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.932+0000 7f4c0e567640 1 --2- 172.21.15.6:0/2175484142 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4c080d2fc0 0x7f4c08150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:44.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.932+0000 7f4c0e567640 1 --2- 172.21.15.6:0/2175484142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c080d2300 0x7f4c080b6450 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:44.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.932+0000 7f4c0e567640 1 -- 172.21.15.6:0/2175484142 >> 172.21.15.6:0/2175484142 conn(0x7f4c080659d0 msgr2=0x7f4c08151920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:44.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.932+0000 7f4c0e567640 1 -- 172.21.15.6:0/2175484142 shutdown_connections 2023-07-21T22:38:44.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:44.932+0000 7f4c0e567640 1 -- 172.21.15.6:0/2175484142 wait complete. 2023-07-21T22:38:44.999 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:38:45.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.104+0000 7fbb94f2c640 1 Processor -- start 2023-07-21T22:38:45.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.104+0000 7fbb94f2c640 1 -- start start 2023-07-21T22:38:45.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.104+0000 7fbb94f2c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbb9015bde0 0x7fbb900d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:45.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.104+0000 7fbb94f2c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb900b04c0 con 0x7fbb900d2fc0 2023-07-21T22:38:45.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.104+0000 7fbb94f2c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb900b1060 con 0x7fbb900d2300 2023-07-21T22:38:45.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.104+0000 7fbb94f2c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb9015c1b0 con 0x7fbb9015bde0 2023-07-21T22:38:45.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.104+0000 7fbb87fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbb900d2fc0 0x7fbb900b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46672/0 (socket says 172.21.15.6:46672) 2023-07-21T22:38:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.104+0000 7fbb87fff640 1 -- 172.21.15.6:0/3744072689 learned_addr learned my addr 172.21.15.6:0/3744072689 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.104+0000 7fbb8e59c640 1 --2- 172.21.15.6:0/3744072689 >> v2:172.21.15.161:3300/0 conn(0x7fbb9015bde0 0x7fbb900d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.104+0000 7fbb8dd9b640 1 -- 172.21.15.6:0/3744072689 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4162828725 0 0) 0x7fbb900b04c0 con 0x7fbb900d2fc0 2023-07-21T22:38:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.104+0000 7fbb8dd9b640 1 -- 172.21.15.6:0/3744072689 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb7c003530 con 0x7fbb900d2fc0 2023-07-21T22:38:45.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.104+0000 7fbb8e59c640 1 -- 172.21.15.6:0/3744072689 >> v1:172.21.15.161:6789/0 conn(0x7fbb900d2300 legacy=0x7fbb900cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:45.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.104+0000 7fbb8e59c640 1 -- 172.21.15.6:0/3744072689 >> v1:172.21.15.6:6789/0 conn(0x7fbb900d2fc0 legacy=0x7fbb900b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:45.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.104+0000 7fbb8e59c640 1 -- 172.21.15.6:0/3744072689 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb900d0aa0 con 0x7fbb9015bde0 2023-07-21T22:38:45.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.108+0000 7fbb8e59c640 1 --2- 172.21.15.6:0/3744072689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb9015bde0 0x7fbb900d0270 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fbb800097a0 tx=0x7fbb8001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f7184938daa2bd1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:45.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.108+0000 7fbb8dd9b640 1 -- 172.21.15.6:0/3744072689 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb800ab660 con 0x7fbb9015bde0 2023-07-21T22:38:45.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.108+0000 7fbb8dd9b640 1 -- 172.21.15.6:0/3744072689 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb800ab7c0 con 0x7fbb9015bde0 2023-07-21T22:38:45.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.108+0000 7fbb8dd9b640 1 -- 172.21.15.6:0/3744072689 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb800abb50 con 0x7fbb9015bde0 2023-07-21T22:38:45.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.108+0000 7fbb94f2c640 1 -- 172.21.15.6:0/3744072689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb9015bde0 msgr2=0x7fbb900d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:45.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.108+0000 7fbb94f2c640 1 --2- 172.21.15.6:0/3744072689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb9015bde0 0x7fbb900d0270 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fbb800097a0 tx=0x7fbb8001c460 comp rx=0 tx=0).stop 2023-07-21T22:38:45.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.108+0000 7fbb94f2c640 1 -- 172.21.15.6:0/3744072689 shutdown_connections 2023-07-21T22:38:45.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.108+0000 7fbb94f2c640 1 --2- 172.21.15.6:0/3744072689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb9015bde0 0x7fbb900d0270 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.108+0000 7fbb94f2c640 1 -- 172.21.15.6:0/3744072689 >> 172.21.15.6:0/3744072689 conn(0x7fbb900659d0 msgr2=0x7fbb9009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:45.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.108+0000 7fbb94f2c640 1 -- 172.21.15.6:0/3744072689 shutdown_connections 2023-07-21T22:38:45.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.108+0000 7fbb94f2c640 1 -- 172.21.15.6:0/3744072689 wait complete. 2023-07-21T22:38:45.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb94f2c640 1 Processor -- start 2023-07-21T22:38:45.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb94f2c640 1 -- start start 2023-07-21T22:38:45.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb94f2c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb900d2300 0x7fbb90150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:45.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb94f2c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb900d2fc0 0x7fbb900c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:45.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb94f2c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb9015bde0 0x7fbb900cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:45.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb94f2c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb900c9440 con 0x7fbb900d2300 2023-07-21T22:38:45.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb94f2c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9006bfb0 con 0x7fbb900d2fc0 2023-07-21T22:38:45.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb94f2c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb900c7480 con 0x7fbb9015bde0 2023-07-21T22:38:45.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb8e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb900d2300 0x7fbb90150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:45.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb87fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb900d2fc0 0x7fbb900c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:45.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb8e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb900d2300 0x7fbb90150770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58744/0 (socket says 172.21.15.6:58744) 2023-07-21T22:38:45.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb8e59c640 1 -- 172.21.15.6:0/2586068921 learned_addr learned my addr 172.21.15.6:0/2586068921 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:45.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb8ed9d640 1 --2- 172.21.15.6:0/2586068921 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb9015bde0 0x7fbb900cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:45.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb8e59c640 1 -- 172.21.15.6:0/2586068921 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb9015bde0 msgr2=0x7fbb900cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:45.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb8e59c640 1 --2- 172.21.15.6:0/2586068921 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb9015bde0 0x7fbb900cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb8e59c640 1 -- 172.21.15.6:0/2586068921 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb900d2fc0 msgr2=0x7fbb900c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:45.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb8e59c640 1 --2- 172.21.15.6:0/2586068921 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb900d2fc0 0x7fbb900c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb8e59c640 1 -- 172.21.15.6:0/2586068921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb800093b0 con 0x7fbb900d2300 2023-07-21T22:38:45.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb8e59c640 1 --2- 172.21.15.6:0/2586068921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb900d2300 0x7fbb90150770 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fbb80019070 tx=0x7fbb8001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:45.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb86ffd640 1 -- 172.21.15.6:0/2586068921 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb800bf610 con 0x7fbb900d2300 2023-07-21T22:38:45.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb86ffd640 1 -- 172.21.15.6:0/2586068921 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb800bf770 con 0x7fbb900d2300 2023-07-21T22:38:45.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb86ffd640 1 -- 172.21.15.6:0/2586068921 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb800bfb20 con 0x7fbb900d2300 2023-07-21T22:38:45.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.112+0000 7fbb94f2c640 1 -- 172.21.15.6:0/2586068921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9006bcd0 con 0x7fbb900d2300 2023-07-21T22:38:45.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.116+0000 7fbb94f2c640 1 -- 172.21.15.6:0/2586068921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb900c7110 con 0x7fbb900d2300 2023-07-21T22:38:45.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.116+0000 7fbb94f2c640 1 -- 172.21.15.6:0/2586068921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb900678d0 con 0x7fbb900d2300 2023-07-21T22:38:45.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.116+0000 7fbb86ffd640 1 -- 172.21.15.6:0/2586068921 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 63) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fbb800a9070 con 0x7fbb900d2300 2023-07-21T22:38:45.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.116+0000 7fbb86ffd640 1 --2- 172.21.15.6:0/2586068921 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fbb70066430 0x7fbb700688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:45.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.116+0000 7fbb86ffd640 1 -- 172.21.15.6:0/2586068921 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fbb8011e8c0 con 0x7fbb900d2300 2023-07-21T22:38:45.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.116+0000 7fbb87fff640 1 -- 172.21.15.6:0/2586068921 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fbb70066430 msgr2=0x7fbb700688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3543285241 2023-07-21T22:38:45.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.116+0000 7fbb87fff640 1 --2- 172.21.15.6:0/2586068921 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fbb70066430 0x7fbb700688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:45.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.124+0000 7fbb86ffd640 1 -- 172.21.15.6:0/2586068921 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb800eba80 con 0x7fbb900d2300 2023-07-21T22:38:45.182 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:45.143+0000 7fa3bdd7e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:38:45.241 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:45.203+0000 7fa3bdd7e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:38:45.261 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:45.216+0000 7f97dc63a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:38:45.296 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:45.255+0000 7fa3bdd7e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:38:45.323 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:45.280+0000 7f97dc63a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:38:45.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.280+0000 7fbb94f2c640 1 -- 172.21.15.6:0/2586068921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbb900b0ba0 con 0x7fbb900d2300 2023-07-21T22:38:45.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.280+0000 7fbb86ffd640 1 -- 172.21.15.6:0/2586068921 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v144) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbb800ef0a0 con 0x7fbb900d2300 2023-07-21T22:38:45.327 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:38:45.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.284+0000 7fbb94f2c640 1 -- 172.21.15.6:0/2586068921 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fbb70066430 msgr2=0x7fbb700688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:45.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.284+0000 7fbb94f2c640 1 --2- 172.21.15.6:0/2586068921 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fbb70066430 0x7fbb700688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.284+0000 7fbb94f2c640 1 -- 172.21.15.6:0/2586068921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb900d2300 msgr2=0x7fbb90150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:45.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.284+0000 7fbb94f2c640 1 --2- 172.21.15.6:0/2586068921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb900d2300 0x7fbb90150770 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fbb80019070 tx=0x7fbb8001aca0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.284+0000 7fbb94f2c640 1 -- 172.21.15.6:0/2586068921 shutdown_connections 2023-07-21T22:38:45.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.284+0000 7fbb94f2c640 1 --2- 172.21.15.6:0/2586068921 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fbb70066430 0x7fbb700688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.284+0000 7fbb94f2c640 1 --2- 172.21.15.6:0/2586068921 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb9015bde0 0x7fbb900cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.284+0000 7fbb94f2c640 1 --2- 172.21.15.6:0/2586068921 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb900d2fc0 0x7fbb900c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.284+0000 7fbb94f2c640 1 --2- 172.21.15.6:0/2586068921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb900d2300 0x7fbb90150770 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.284+0000 7fbb94f2c640 1 -- 172.21.15.6:0/2586068921 >> 172.21.15.6:0/2586068921 conn(0x7fbb900659d0 msgr2=0x7fbb90153d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:45.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.284+0000 7fbb94f2c640 1 -- 172.21.15.6:0/2586068921 shutdown_connections 2023-07-21T22:38:45.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.284+0000 7fbb94f2c640 1 -- 172.21.15.6:0/2586068921 wait complete. 2023-07-21T22:38:45.349 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:38:45.382 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:45.343+0000 7fa3bdd7e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:38:45.384 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:45.340+0000 7f97dc63a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:38:45.440 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:45.399+0000 7fa3bdd7e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:38:45.479 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:45.432+0000 7f97dc63a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:38:45.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.456+0000 7f6a98137640 1 Processor -- start 2023-07-21T22:38:45.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.456+0000 7f6a98137640 1 -- start start 2023-07-21T22:38:45.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.456+0000 7f6a98137640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6a9015bde0 0x7f6a900d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:45.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.456+0000 7f6a98137640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6a900d2300 0x7f6a900d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:45.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.456+0000 7f6a98137640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a900b04c0 con 0x7f6a900d2fc0 2023-07-21T22:38:45.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.456+0000 7f6a98137640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9015c1b0 con 0x7f6a900d2300 2023-07-21T22:38:45.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.456+0000 7f6a98137640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a900b1060 con 0x7f6a9015bde0 2023-07-21T22:38:45.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.456+0000 7f6a966d4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6a900d2300 0x7f6a900d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:45.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.456+0000 7f6a966d4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6a900d2300 0x7f6a900d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58754/0 (socket says 172.21.15.6:58754) 2023-07-21T22:38:45.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.456+0000 7f6a966d4640 1 -- 172.21.15.6:0/1321707349 learned_addr learned my addr 172.21.15.6:0/1321707349 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:45.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.456+0000 7f6a95ed3640 1 --2- 172.21.15.6:0/1321707349 >> v2:172.21.15.161:3300/0 conn(0x7f6a9015bde0 0x7f6a900d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:45.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.456+0000 7f6a966d4640 1 -- 172.21.15.6:0/1321707349 >> v2:172.21.15.161:3300/0 conn(0x7f6a9015bde0 msgr2=0x7f6a900d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:45.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.456+0000 7f6a966d4640 1 --2- 172.21.15.6:0/1321707349 >> v2:172.21.15.161:3300/0 conn(0x7f6a9015bde0 0x7f6a900d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.456+0000 7f6a966d4640 1 -- 172.21.15.6:0/1321707349 >> v1:172.21.15.6:6789/0 conn(0x7f6a900d2fc0 legacy=0x7f6a900b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:45.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.456+0000 7f6a966d4640 1 -- 172.21.15.6:0/1321707349 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a900d2c80 con 0x7f6a900d2300 2023-07-21T22:38:45.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.456+0000 7f6a94ed1640 1 -- 172.21.15.6:0/1321707349 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205032422 0 0) 0x7f6a900b04c0 con 0x7f6a900d2fc0 2023-07-21T22:38:45.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.460+0000 7f6a966d4640 1 --2- 172.21.15.6:0/1321707349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a900d2300 0x7f6a900d2740 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f6a9008b210 tx=0x7f6a8801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df6e3b61fe4a70e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:45.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.460+0000 7f6a94ed1640 1 -- 172.21.15.6:0/1321707349 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a880a57a0 con 0x7f6a900d2300 2023-07-21T22:38:45.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.460+0000 7f6a94ed1640 1 -- 172.21.15.6:0/1321707349 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a880a5900 con 0x7f6a900d2300 2023-07-21T22:38:45.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.460+0000 7f6a94ed1640 1 -- 172.21.15.6:0/1321707349 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a880a5c90 con 0x7f6a900d2300 2023-07-21T22:38:45.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.460+0000 7f6a98137640 1 -- 172.21.15.6:0/1321707349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a900d2300 msgr2=0x7f6a900d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:45.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.460+0000 7f6a98137640 1 --2- 172.21.15.6:0/1321707349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a900d2300 0x7f6a900d2740 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f6a9008b210 tx=0x7f6a8801c9d0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.460+0000 7f6a98137640 1 -- 172.21.15.6:0/1321707349 shutdown_connections 2023-07-21T22:38:45.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.460+0000 7f6a98137640 1 --2- 172.21.15.6:0/1321707349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a900d2300 0x7f6a900d2740 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.460+0000 7f6a98137640 1 --2- 172.21.15.6:0/1321707349 >> v2:172.21.15.161:3300/0 conn(0x7f6a9015bde0 0x7f6a900d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.460+0000 7f6a98137640 1 -- 172.21.15.6:0/1321707349 >> 172.21.15.6:0/1321707349 conn(0x7f6a900659d0 msgr2=0x7f6a9009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:45.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.460+0000 7f6a98137640 1 -- 172.21.15.6:0/1321707349 shutdown_connections 2023-07-21T22:38:45.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.460+0000 7f6a98137640 1 -- 172.21.15.6:0/1321707349 wait complete. 2023-07-21T22:38:45.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a98137640 1 Processor -- start 2023-07-21T22:38:45.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a98137640 1 -- start start 2023-07-21T22:38:45.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a98137640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a900d2300 0x7f6a90142340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:45.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a98137640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a900d2fc0 0x7f6a9015c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:45.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a98137640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a9015bde0 0x7f6a90159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:45.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a98137640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a90142880 con 0x7f6a900d2300 2023-07-21T22:38:45.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a98137640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9015e1c0 con 0x7f6a900d2fc0 2023-07-21T22:38:45.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a98137640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9015e460 con 0x7f6a9015bde0 2023-07-21T22:38:45.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a95ed3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a900d2300 0x7f6a90142340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:45.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a95ed3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a900d2300 0x7f6a90142340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58766/0 (socket says 172.21.15.6:58766) 2023-07-21T22:38:45.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a95ed3640 1 -- 172.21.15.6:0/1712593257 learned_addr learned my addr 172.21.15.6:0/1712593257 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:45.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a966d4640 1 --2- 172.21.15.6:0/1712593257 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a9015bde0 0x7f6a90159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:45.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a956d2640 1 --2- 172.21.15.6:0/1712593257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a900d2fc0 0x7f6a9015c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:45.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a95ed3640 1 -- 172.21.15.6:0/1712593257 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a9015bde0 msgr2=0x7f6a90159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:45.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a95ed3640 1 --2- 172.21.15.6:0/1712593257 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a9015bde0 0x7f6a90159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a95ed3640 1 -- 172.21.15.6:0/1712593257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a900d2fc0 msgr2=0x7f6a9015c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:45.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a95ed3640 1 --2- 172.21.15.6:0/1712593257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a900d2fc0 0x7f6a9015c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a95ed3640 1 -- 172.21.15.6:0/1712593257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a88009b30 con 0x7f6a900d2300 2023-07-21T22:38:45.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a95ed3640 1 --2- 172.21.15.6:0/1712593257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a900d2300 0x7f6a90142340 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00e870 tx=0x7f6a8c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:45.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a867fc640 1 -- 172.21.15.6:0/1712593257 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c0095d0 con 0x7f6a900d2300 2023-07-21T22:38:45.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a867fc640 1 -- 172.21.15.6:0/1712593257 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c00c940 con 0x7f6a900d2300 2023-07-21T22:38:45.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a98137640 1 -- 172.21.15.6:0/1712593257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9015e740 con 0x7f6a900d2300 2023-07-21T22:38:45.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a867fc640 1 -- 172.21.15.6:0/1712593257 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c00ccb0 con 0x7f6a900d2300 2023-07-21T22:38:45.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.464+0000 7f6a98137640 1 -- 172.21.15.6:0/1712593257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9015ed00 con 0x7f6a900d2300 2023-07-21T22:38:45.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.468+0000 7f6a98137640 1 -- 172.21.15.6:0/1712593257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a900678d0 con 0x7f6a900d2300 2023-07-21T22:38:45.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.468+0000 7f6a867fc640 1 -- 172.21.15.6:0/1712593257 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 63) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f6a8c013470 con 0x7f6a900d2300 2023-07-21T22:38:45.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.468+0000 7f6a867fc640 1 --2- 172.21.15.6:0/1712593257 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f6a74066430 0x7f6a740688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:45.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.468+0000 7f6a867fc640 1 -- 172.21.15.6:0/1712593257 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f6a8c0846d0 con 0x7f6a900d2300 2023-07-21T22:38:45.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.468+0000 7f6a956d2640 1 -- 172.21.15.6:0/1712593257 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f6a74066430 msgr2=0x7f6a740688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3543285241 2023-07-21T22:38:45.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.468+0000 7f6a956d2640 1 --2- 172.21.15.6:0/1712593257 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f6a74066430 0x7f6a740688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:45.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.476+0000 7f6a867fc640 1 -- 172.21.15.6:0/1712593257 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6a8c0518b0 con 0x7f6a900d2300 2023-07-21T22:38:45.525 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:45.487+0000 7fa3bdd7e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:38:45.544 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:45.500+0000 7f97dc63a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:38:45.581 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:45.543+0000 7fa3bdd7e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:38:45.634 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:45.588+0000 7f97dc63a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:38:45.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.632+0000 7f6a98137640 1 -- 172.21.15.6:0/1712593257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6a900b6030 con 0x7f6a900d2300 2023-07-21T22:38:45.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.632+0000 7f6a867fc640 1 -- 172.21.15.6:0/1712593257 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v144) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6a8c054ed0 con 0x7f6a900d2300 2023-07-21T22:38:45.677 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:38:45.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.632+0000 7f6a98137640 1 -- 172.21.15.6:0/1712593257 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f6a74066430 msgr2=0x7f6a740688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:45.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.632+0000 7f6a98137640 1 --2- 172.21.15.6:0/1712593257 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f6a74066430 0x7f6a740688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.632+0000 7f6a98137640 1 -- 172.21.15.6:0/1712593257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a900d2300 msgr2=0x7f6a90142340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:45.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.632+0000 7f6a98137640 1 --2- 172.21.15.6:0/1712593257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a900d2300 0x7f6a90142340 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00e870 tx=0x7f6a8c00ed30 comp rx=0 tx=0).stop 2023-07-21T22:38:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.632+0000 7f6a98137640 1 -- 172.21.15.6:0/1712593257 shutdown_connections 2023-07-21T22:38:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.632+0000 7f6a98137640 1 --2- 172.21.15.6:0/1712593257 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f6a74066430 0x7f6a740688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.632+0000 7f6a98137640 1 --2- 172.21.15.6:0/1712593257 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a9015bde0 0x7f6a90159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.632+0000 7f6a98137640 1 --2- 172.21.15.6:0/1712593257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a900d2fc0 0x7f6a9015c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.632+0000 7f6a98137640 1 --2- 172.21.15.6:0/1712593257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a900d2300 0x7f6a90142340 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.632+0000 7f6a98137640 1 -- 172.21.15.6:0/1712593257 >> 172.21.15.6:0/1712593257 conn(0x7f6a900659d0 msgr2=0x7f6a900b51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.636+0000 7f6a98137640 1 -- 172.21.15.6:0/1712593257 shutdown_connections 2023-07-21T22:38:45.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.636+0000 7f6a98137640 1 -- 172.21.15.6:0/1712593257 wait complete. 2023-07-21T22:38:45.695 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:45.648+0000 7f97dc63a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:38:45.699 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:38:45.724 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:45.683+0000 7fa3bdd7e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:38:45.782 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:45.743+0000 7fa3bdd7e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:38:45.847 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:45.804+0000 7f97dc63a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:38:45.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.840+0000 7f5e7ed40640 1 Processor -- start 2023-07-21T22:38:45.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.840+0000 7f5e7ed40640 1 -- start start 2023-07-21T22:38:45.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.844+0000 7f5e7ed40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e7815bde0 0x7f5e780d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:45.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.844+0000 7f5e7ed40640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5e780d2300 0x7f5e780d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:45.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.844+0000 7f5e7ed40640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e780b04c0 con 0x7f5e780d2fc0 2023-07-21T22:38:45.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.844+0000 7f5e7ed40640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e780d2ce0 con 0x7f5e780d2300 2023-07-21T22:38:45.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.844+0000 7f5e7ed40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7815c1b0 con 0x7f5e7815bde0 2023-07-21T22:38:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.844+0000 7f5e7d2dd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5e780d2300 0x7f5e780d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.844+0000 7f5e7cadc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e7815bde0 0x7f5e780d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.844+0000 7f5e77fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f5e780d2fc0 0x7f5e780b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:41998/0 (socket says 172.21.15.6:41998) 2023-07-21T22:38:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.844+0000 7f5e7d2dd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5e780d2300 0x7f5e780d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:48252/0 (socket says 172.21.15.6:48252) 2023-07-21T22:38:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.844+0000 7f5e77fff640 1 -- 172.21.15.6:0/2434483979 learned_addr learned my addr 172.21.15.6:0/2434483979 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.844+0000 7f5e7cadc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e7815bde0 0x7f5e780d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:35072/0 (socket says 172.21.15.6:35072) 2023-07-21T22:38:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.844+0000 7f5e7d2dd640 1 -- 172.21.15.6:0/2434483979 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e7815bde0 msgr2=0x7f5e780d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.844+0000 7f5e7d2dd640 1 --2- 172.21.15.6:0/2434483979 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e7815bde0 0x7f5e780d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.844+0000 7f5e7d2dd640 1 -- 172.21.15.6:0/2434483979 >> v1:172.21.15.161:6789/0 conn(0x7f5e780d2fc0 legacy=0x7f5e780b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.844+0000 7f5e7d2dd640 1 -- 172.21.15.6:0/2434483979 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e780b1060 con 0x7f5e780d2300 2023-07-21T22:38:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.844+0000 7f5e777fe640 1 -- 172.21.15.6:0/2434483979 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952619008 0 0) 0x7f5e780b04c0 con 0x7f5e780d2fc0 2023-07-21T22:38:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.844+0000 7f5e7cadc640 1 --2- 172.21.15.6:0/2434483979 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e7815bde0 0x7f5e780d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:45.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.848+0000 7f5e7d2dd640 1 --2- 172.21.15.6:0/2434483979 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e780d2300 0x7f5e780d27a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009d90 tx=0x7f5e7001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ea94ebd803c1c61 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:45.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.848+0000 7f5e777fe640 1 -- 172.21.15.6:0/2434483979 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e700a5920 con 0x7f5e780d2300 2023-07-21T22:38:45.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.848+0000 7f5e777fe640 1 -- 172.21.15.6:0/2434483979 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e700a5a80 con 0x7f5e780d2300 2023-07-21T22:38:45.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.848+0000 7f5e777fe640 1 -- 172.21.15.6:0/2434483979 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e700a5e10 con 0x7f5e780d2300 2023-07-21T22:38:45.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.848+0000 7f5e7ed40640 1 -- 172.21.15.6:0/2434483979 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e780d2300 msgr2=0x7f5e780d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:45.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.848+0000 7f5e7ed40640 1 --2- 172.21.15.6:0/2434483979 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e780d2300 0x7f5e780d27a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009d90 tx=0x7f5e7001c950 comp rx=0 tx=0).stop 2023-07-21T22:38:45.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.848+0000 7f5e7ed40640 1 -- 172.21.15.6:0/2434483979 shutdown_connections 2023-07-21T22:38:45.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.848+0000 7f5e7ed40640 1 --2- 172.21.15.6:0/2434483979 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e780d2300 0x7f5e780d27a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.848+0000 7f5e7ed40640 1 --2- 172.21.15.6:0/2434483979 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e7815bde0 0x7f5e780d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.848+0000 7f5e7ed40640 1 -- 172.21.15.6:0/2434483979 >> 172.21.15.6:0/2434483979 conn(0x7f5e780659d0 msgr2=0x7f5e7809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:45.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.848+0000 7f5e7ed40640 1 -- 172.21.15.6:0/2434483979 shutdown_connections 2023-07-21T22:38:45.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.848+0000 7f5e7ed40640 1 -- 172.21.15.6:0/2434483979 wait complete. 2023-07-21T22:38:45.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.848+0000 7f5e7ed40640 1 Processor -- start 2023-07-21T22:38:45.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.848+0000 7f5e7ed40640 1 -- start start 2023-07-21T22:38:45.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e7ed40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e780d2300 0x7f5e781f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:45.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e7ed40640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e780d2fc0 0x7f5e780b7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:45.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e7ed40640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e7815bde0 0x7f5e780b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:45.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e7ed40640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7806b2d0 con 0x7f5e780d2fc0 2023-07-21T22:38:45.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e7ed40640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e78152450 con 0x7f5e7815bde0 2023-07-21T22:38:45.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e7ed40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e781f4fe0 con 0x7f5e780d2300 2023-07-21T22:38:45.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e77fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e780d2fc0 0x7f5e780b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:45.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e77fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e780d2fc0 0x7f5e780b7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58768/0 (socket says 172.21.15.6:58768) 2023-07-21T22:38:45.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e7cadc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e780d2300 0x7f5e781f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:45.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e77fff640 1 -- 172.21.15.6:0/3811543575 learned_addr learned my addr 172.21.15.6:0/3811543575 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:45.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e7d2dd640 1 --2- 172.21.15.6:0/3811543575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e7815bde0 0x7f5e780b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:45.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e77fff640 1 -- 172.21.15.6:0/3811543575 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e780d2300 msgr2=0x7f5e781f4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:45.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e77fff640 1 --2- 172.21.15.6:0/3811543575 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e780d2300 0x7f5e781f4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e77fff640 1 -- 172.21.15.6:0/3811543575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e7815bde0 msgr2=0x7f5e780b68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:45.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e77fff640 1 --2- 172.21.15.6:0/3811543575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e7815bde0 0x7f5e780b68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:45.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e77fff640 1 -- 172.21.15.6:0/3811543575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c0093b0 con 0x7f5e780d2fc0 2023-07-21T22:38:45.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e7cadc640 1 --2- 172.21.15.6:0/3811543575 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e780d2300 0x7f5e781f4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:45.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e77fff640 1 --2- 172.21.15.6:0/3811543575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e780d2fc0 0x7f5e780b7520 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400c4a0 tx=0x7f5e6400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:45.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e757fa640 1 -- 172.21.15.6:0/3811543575 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e640074e0 con 0x7f5e780d2fc0 2023-07-21T22:38:45.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e757fa640 1 -- 172.21.15.6:0/3811543575 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e64007640 con 0x7f5e780d2fc0 2023-07-21T22:38:45.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e757fa640 1 -- 172.21.15.6:0/3811543575 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64004a30 con 0x7f5e780d2fc0 2023-07-21T22:38:45.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e7ed40640 1 -- 172.21.15.6:0/3811543575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e70009a70 con 0x7f5e780d2fc0 2023-07-21T22:38:45.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e7ed40640 1 -- 172.21.15.6:0/3811543575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e781f7b00 con 0x7f5e780d2fc0 2023-07-21T22:38:45.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.852+0000 7f5e7ed40640 1 -- 172.21.15.6:0/3811543575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e780cfc80 con 0x7f5e780d2fc0 2023-07-21T22:38:45.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.856+0000 7f5e757fa640 1 -- 172.21.15.6:0/3811543575 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 63) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f5e64004b90 con 0x7f5e780d2fc0 2023-07-21T22:38:45.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.856+0000 7f5e757fa640 1 --2- 172.21.15.6:0/3811543575 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f5e5c066430 0x7f5e5c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:45.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.856+0000 7f5e757fa640 1 -- 172.21.15.6:0/3811543575 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f5e640832c0 con 0x7f5e780d2fc0 2023-07-21T22:38:45.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.856+0000 7f5e7cadc640 1 -- 172.21.15.6:0/3811543575 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f5e5c066430 msgr2=0x7f5e5c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3543285241 2023-07-21T22:38:45.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.856+0000 7f5e7cadc640 1 --2- 172.21.15.6:0/3811543575 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f5e5c066430 0x7f5e5c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:45.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:45.864+0000 7f5e757fa640 1 -- 172.21.15.6:0/3811543575 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5e640503f0 con 0x7f5e780d2fc0 2023-07-21T22:38:45.915 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:45.868+0000 7f97dc63a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:38:46.023 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:38:46.024 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:38:46.024 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:38:46.032 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:45.991+0000 7fa3bdd7e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:38:46.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.032+0000 7f5e7ed40640 1 -- 172.21.15.6:0/3811543575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5e7815b930 con 0x7f5e780d2fc0 2023-07-21T22:38:46.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.032+0000 7f5e757fa640 1 -- 172.21.15.6:0/3811543575 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v144) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5e64053a10 con 0x7f5e780d2fc0 2023-07-21T22:38:46.081 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:38:46.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.040+0000 7f5e7ed40640 1 -- 172.21.15.6:0/3811543575 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f5e5c066430 msgr2=0x7f5e5c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:46.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.040+0000 7f5e7ed40640 1 --2- 172.21.15.6:0/3811543575 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f5e5c066430 0x7f5e5c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.040+0000 7f5e7ed40640 1 -- 172.21.15.6:0/3811543575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e780d2fc0 msgr2=0x7f5e780b7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:46.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.040+0000 7f5e7ed40640 1 --2- 172.21.15.6:0/3811543575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e780d2fc0 0x7f5e780b7520 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400c4a0 tx=0x7f5e6400c960 comp rx=0 tx=0).stop 2023-07-21T22:38:46.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.040+0000 7f5e7ed40640 1 -- 172.21.15.6:0/3811543575 shutdown_connections 2023-07-21T22:38:46.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.040+0000 7f5e7ed40640 1 --2- 172.21.15.6:0/3811543575 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f5e5c066430 0x7f5e5c0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.040+0000 7f5e7ed40640 1 --2- 172.21.15.6:0/3811543575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e7815bde0 0x7f5e780b68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.040+0000 7f5e7ed40640 1 --2- 172.21.15.6:0/3811543575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5e780d2fc0 0x7f5e780b7520 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.040+0000 7f5e7ed40640 1 --2- 172.21.15.6:0/3811543575 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5e780d2300 0x7f5e781f4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.040+0000 7f5e7ed40640 1 -- 172.21.15.6:0/3811543575 >> 172.21.15.6:0/3811543575 conn(0x7f5e780659d0 msgr2=0x7f5e780cdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:46.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.044+0000 7f5e7ed40640 1 -- 172.21.15.6:0/3811543575 shutdown_connections 2023-07-21T22:38:46.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.044+0000 7f5e7ed40640 1 -- 172.21.15.6:0/3811543575 wait complete. 2023-07-21T22:38:46.123 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:38:46.166 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:46.127+0000 7fa3bdd7e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:38:46.173 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:38:46.173 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:38:46.173 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:38:46.182 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:46.136+0000 7f97dc63a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:38:46.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.232+0000 7f5ec37fa640 1 Processor -- start 2023-07-21T22:38:46.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.232+0000 7f5ec37fa640 1 -- start start 2023-07-21T22:38:46.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.232+0000 7f5ec37fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ebc15fd60 0x7f5ebc0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:46.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.232+0000 7f5ec37fa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ebc0ccaf0 con 0x7f5ebc0b7c70 2023-07-21T22:38:46.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.232+0000 7f5ec37fa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ebc160320 con 0x7f5ebc0d1850 2023-07-21T22:38:46.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.232+0000 7f5ec37fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc0d1190 con 0x7f5ebc15fd60 2023-07-21T22:38:46.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.232+0000 7f5ec1596640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5ebc0b7c70 0x7f5ebc15f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:46702/0 (socket says 172.21.15.6:46702) 2023-07-21T22:38:46.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.232+0000 7f5ec1596640 1 -- 172.21.15.6:0/1868615861 learned_addr learned my addr 172.21.15.6:0/1868615861 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:46.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.232+0000 7f5ec0d95640 1 --2- 172.21.15.6:0/1868615861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ebc15fd60 0x7f5ebc0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:46.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.236+0000 7f5eb3fff640 1 -- 172.21.15.6:0/1868615861 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 254345632 0 0) 0x7f5ebc0ccaf0 con 0x7f5ebc0b7c70 2023-07-21T22:38:46.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.236+0000 7f5eb3fff640 1 -- 172.21.15.6:0/1868615861 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ea8003530 con 0x7f5ebc0b7c70 2023-07-21T22:38:46.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.236+0000 7f5eb3fff640 1 -- 172.21.15.6:0/1868615861 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507869176 0 0) 0x7f5ebc160320 con 0x7f5ebc0d1850 2023-07-21T22:38:46.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.236+0000 7f5eb3fff640 1 -- 172.21.15.6:0/1868615861 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ebc0ccaf0 con 0x7f5ebc0d1850 2023-07-21T22:38:46.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.236+0000 7f5ec0d95640 1 -- 172.21.15.6:0/1868615861 >> v1:172.21.15.161:6789/0 conn(0x7f5ebc0d1850 legacy=0x7f5ebc0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:46.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.236+0000 7f5ec0d95640 1 -- 172.21.15.6:0/1868615861 >> v1:172.21.15.6:6789/0 conn(0x7f5ebc0b7c70 legacy=0x7f5ebc15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:46.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.236+0000 7f5ec0d95640 1 -- 172.21.15.6:0/1868615861 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc0ccd90 con 0x7f5ebc15fd60 2023-07-21T22:38:46.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.236+0000 7f5ec0d95640 1 --2- 172.21.15.6:0/1868615861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ebc15fd60 0x7f5ebc0d0c50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0097f0 tx=0x7f5eac01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9c9e62c6529104f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:46.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.236+0000 7f5eb3fff640 1 -- 172.21.15.6:0/1868615861 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac0ac630 con 0x7f5ebc15fd60 2023-07-21T22:38:46.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.236+0000 7f5eb3fff640 1 -- 172.21.15.6:0/1868615861 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eac0ac790 con 0x7f5ebc15fd60 2023-07-21T22:38:46.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.236+0000 7f5eb3fff640 1 -- 172.21.15.6:0/1868615861 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac0acb20 con 0x7f5ebc15fd60 2023-07-21T22:38:46.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec37fa640 1 -- 172.21.15.6:0/1868615861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ebc15fd60 msgr2=0x7f5ebc0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:46.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec37fa640 1 --2- 172.21.15.6:0/1868615861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ebc15fd60 0x7f5ebc0d0c50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5eac0097f0 tx=0x7f5eac01c4c0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec37fa640 1 -- 172.21.15.6:0/1868615861 shutdown_connections 2023-07-21T22:38:46.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec37fa640 1 --2- 172.21.15.6:0/1868615861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ebc15fd60 0x7f5ebc0d0c50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec37fa640 1 -- 172.21.15.6:0/1868615861 >> 172.21.15.6:0/1868615861 conn(0x7f5ebc0650b0 msgr2=0x7f5ebc0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:46.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec37fa640 1 -- 172.21.15.6:0/1868615861 shutdown_connections 2023-07-21T22:38:46.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec37fa640 1 -- 172.21.15.6:0/1868615861 wait complete. 2023-07-21T22:38:46.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec37fa640 1 Processor -- start 2023-07-21T22:38:46.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec37fa640 1 -- start start 2023-07-21T22:38:46.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec37fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ebc0b7c70 0x7f5ebc156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:46.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec37fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ebc0d1850 0x7f5ebc154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:46.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec37fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ebc15fd60 0x7f5ebc154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec37fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc0cb8a0 con 0x7f5ebc0b7c70 2023-07-21T22:38:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec37fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc156c90 con 0x7f5ebc0d1850 2023-07-21T22:38:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec37fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc0cb000 con 0x7f5ebc15fd60 2023-07-21T22:38:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec1596640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ebc0b7c70 0x7f5ebc156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec1596640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ebc0b7c70 0x7f5ebc156750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58774/0 (socket says 172.21.15.6:58774) 2023-07-21T22:38:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec1596640 1 -- 172.21.15.6:0/378005427 learned_addr learned my addr 172.21.15.6:0/378005427 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:46.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec0d95640 1 --2- 172.21.15.6:0/378005427 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ebc0d1850 0x7f5ebc154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:46.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec1d97640 1 --2- 172.21.15.6:0/378005427 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ebc15fd60 0x7f5ebc154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec1596640 1 -- 172.21.15.6:0/378005427 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ebc15fd60 msgr2=0x7f5ebc154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec1596640 1 --2- 172.21.15.6:0/378005427 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ebc15fd60 0x7f5ebc154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec1596640 1 -- 172.21.15.6:0/378005427 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ebc0d1850 msgr2=0x7f5ebc154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec1596640 1 --2- 172.21.15.6:0/378005427 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ebc0d1850 0x7f5ebc154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec1596640 1 -- 172.21.15.6:0/378005427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac009420 con 0x7f5ebc0b7c70 2023-07-21T22:38:46.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.240+0000 7f5ec1596640 1 --2- 172.21.15.6:0/378005427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ebc0b7c70 0x7f5ebc156750 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800c420 tx=0x7f5eb800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:46.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.244+0000 7f5eb1ffb640 1 -- 172.21.15.6:0/378005427 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8005cf0 con 0x7f5ebc0b7c70 2023-07-21T22:38:46.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.244+0000 7f5eb1ffb640 1 -- 172.21.15.6:0/378005427 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb8005e50 con 0x7f5ebc0b7c70 2023-07-21T22:38:46.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.244+0000 7f5eb1ffb640 1 -- 172.21.15.6:0/378005427 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8007310 con 0x7f5ebc0b7c70 2023-07-21T22:38:46.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.244+0000 7f5ec37fa640 1 -- 172.21.15.6:0/378005427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ebc0cb2e0 con 0x7f5ebc0b7c70 2023-07-21T22:38:46.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.244+0000 7f5ec37fa640 1 -- 172.21.15.6:0/378005427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ebc15c1d0 con 0x7f5ebc0b7c70 2023-07-21T22:38:46.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.244+0000 7f5ec37fa640 1 -- 172.21.15.6:0/378005427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ebc0678d0 con 0x7f5ebc0b7c70 2023-07-21T22:38:46.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.244+0000 7f5eb1ffb640 1 -- 172.21.15.6:0/378005427 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 63) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f5eb8007470 con 0x7f5ebc0b7c70 2023-07-21T22:38:46.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.244+0000 7f5eb1ffb640 1 --2- 172.21.15.6:0/378005427 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f5ea0066460 0x7f5ea0068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:46.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.244+0000 7f5eb1ffb640 1 -- 172.21.15.6:0/378005427 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f5eb8083740 con 0x7f5ebc0b7c70 2023-07-21T22:38:46.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.244+0000 7f5ec0d95640 1 -- 172.21.15.6:0/378005427 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f5ea0066460 msgr2=0x7f5ea0068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3543285241 2023-07-21T22:38:46.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.244+0000 7f5ec0d95640 1 --2- 172.21.15.6:0/378005427 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f5ea0066460 0x7f5ea0068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:46.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.248+0000 7f5eb1ffb640 1 -- 172.21.15.6:0/378005427 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5eb8050860 con 0x7f5ebc0b7c70 2023-07-21T22:38:46.294 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:46.255+0000 7fa3bdd7e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:38:46.327 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:46.284+0000 7f97dc63a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:38:46.366 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:46.327+0000 7fa3bdd7e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:38:46.461 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:46.416+0000 7f97dc63a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:38:46.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.420+0000 7f5ec37fa640 1 -- 172.21.15.6:0/378005427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5ebc0c5bb0 con 0x7f5ebc0b7c70 2023-07-21T22:38:46.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.420+0000 7f5eb1ffb640 1 -- 172.21.15.6:0/378005427 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v144) v1 ==== 80+0+476 (secure 0 0 0) 0x7f5eb8053e80 con 0x7f5ebc0b7c70 2023-07-21T22:38:46.464 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/611533009 2023-07-22T22:38:40.645781+0000 2023-07-21T22:38:46.464 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6833/3436422767 2023-07-22T22:38:40.645781+0000 2023-07-21T22:38:46.464 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/3113062624 2023-07-22T22:38:40.645781+0000 2023-07-21T22:38:46.464 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6832/3436422767 2023-07-22T22:38:40.645781+0000 2023-07-21T22:38:46.465 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/2051512394 2023-07-22T22:38:40.645781+0000 2023-07-21T22:38:46.465 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/747215894 2023-07-22T22:38:40.645781+0000 2023-07-21T22:38:46.465 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/3161426051 2023-07-22T22:38:40.645781+0000 2023-07-21T22:38:46.465 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/3783651589 2023-07-22T22:38:40.645781+0000 2023-07-21T22:38:46.466 INFO:teuthology.orchestra.run.smithi006.stderr:listed 8 entries 2023-07-21T22:38:46.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.420+0000 7f5ec37fa640 1 -- 172.21.15.6:0/378005427 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f5ea0066460 msgr2=0x7f5ea0068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:46.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.420+0000 7f5ec37fa640 1 --2- 172.21.15.6:0/378005427 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f5ea0066460 0x7f5ea0068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.420+0000 7f5ec37fa640 1 -- 172.21.15.6:0/378005427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ebc0b7c70 msgr2=0x7f5ebc156750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:46.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.420+0000 7f5ec37fa640 1 --2- 172.21.15.6:0/378005427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ebc0b7c70 0x7f5ebc156750 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800c420 tx=0x7f5eb800c8e0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.420+0000 7f5ec37fa640 1 -- 172.21.15.6:0/378005427 shutdown_connections 2023-07-21T22:38:46.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.420+0000 7f5ec37fa640 1 --2- 172.21.15.6:0/378005427 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7f5ea0066460 0x7f5ea0068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.420+0000 7f5ec37fa640 1 --2- 172.21.15.6:0/378005427 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5ebc15fd60 0x7f5ebc154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.420+0000 7f5ec37fa640 1 --2- 172.21.15.6:0/378005427 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5ebc0d1850 0x7f5ebc154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.420+0000 7f5ec37fa640 1 --2- 172.21.15.6:0/378005427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ebc0b7c70 0x7f5ebc156750 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.420+0000 7f5ec37fa640 1 -- 172.21.15.6:0/378005427 >> 172.21.15.6:0/378005427 conn(0x7f5ebc0650b0 msgr2=0x7f5ebc0b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:46.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.420+0000 7f5ec37fa640 1 -- 172.21.15.6:0/378005427 shutdown_connections 2023-07-21T22:38:46.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.420+0000 7f5ec37fa640 1 -- 172.21.15.6:0/378005427 wait complete. 2023-07-21T22:38:46.485 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-21T22:38:46.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:38:46.486 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-21T22:38:46.500 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:46.459+0000 7fa3bdd7e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:38:46.541 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:46.496+0000 7f97dc63a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:38:46.567 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:38:46.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:38:46.568 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T22:38:46.579 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:38:46.580 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:38:46.590 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:38:46.590 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:38:46.591 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:38:46.633 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:38:46.633 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:38:46.633 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:38:46.644 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:38:46.644 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:38:46.689 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:46.644+0000 7f97dc63a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:38:46.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.776+0000 7fa9a489c640 1 Processor -- start 2023-07-21T22:38:46.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.776+0000 7fa9a489c640 1 -- start start 2023-07-21T22:38:46.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.776+0000 7fa9a489c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa9a00b7c70 0x7fa9a00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:46.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.776+0000 7fa9a489c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9a00d1850 0x7fa9a015f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:46.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.776+0000 7fa9a489c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a00ccaf0 con 0x7fa9a00d1300 2023-07-21T22:38:46.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.780+0000 7fa9a489c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a00d1190 con 0x7fa9a00d1850 2023-07-21T22:38:46.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.780+0000 7fa9a489c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a0160600 con 0x7fa9a00b7c70 2023-07-21T22:38:46.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.780+0000 7fa997fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9a00d1850 0x7fa9a015f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.780+0000 7fa997fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9a00d1850 0x7fa9a015f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58778/0 (socket says 172.21.15.6:58778) 2023-07-21T22:38:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.780+0000 7fa997fff640 1 -- 172.21.15.6:0/2662429034 learned_addr learned my addr 172.21.15.6:0/2662429034 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.780+0000 7fa99e59c640 1 --2- 172.21.15.6:0/2662429034 >> v2:172.21.15.161:3300/0 conn(0x7fa9a00b7c70 0x7fa9a00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.780+0000 7fa997fff640 1 -- 172.21.15.6:0/2662429034 >> v2:172.21.15.161:3300/0 conn(0x7fa9a00b7c70 msgr2=0x7fa9a00d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.780+0000 7fa997fff640 1 --2- 172.21.15.6:0/2662429034 >> v2:172.21.15.161:3300/0 conn(0x7fa9a00b7c70 0x7fa9a00d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.780+0000 7fa997fff640 1 -- 172.21.15.6:0/2662429034 >> v1:172.21.15.161:6789/0 conn(0x7fa9a00d1300 legacy=0x7fa9a00d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:46.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.780+0000 7fa997fff640 1 -- 172.21.15.6:0/2662429034 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a0160320 con 0x7fa9a00d1850 2023-07-21T22:38:46.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.780+0000 7fa997fff640 1 --2- 172.21.15.6:0/2662429034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a00d1850 0x7fa9a015f650 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00b40a0 tx=0x7fa98801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7971f10ae94a12ff server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:46.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.780+0000 7fa99dd9b640 1 -- 172.21.15.6:0/2662429034 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9880ac640 con 0x7fa9a00d1850 2023-07-21T22:38:46.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.780+0000 7fa99dd9b640 1 -- 172.21.15.6:0/2662429034 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9880ac7a0 con 0x7fa9a00d1850 2023-07-21T22:38:46.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.780+0000 7fa99dd9b640 1 -- 172.21.15.6:0/2662429034 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9880acb30 con 0x7fa9a00d1850 2023-07-21T22:38:46.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.784+0000 7fa9a489c640 1 -- 172.21.15.6:0/2662429034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a00d1850 msgr2=0x7fa9a015f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:46.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.784+0000 7fa9a489c640 1 --2- 172.21.15.6:0/2662429034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a00d1850 0x7fa9a015f650 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00b40a0 tx=0x7fa98801c4d0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.784+0000 7fa9a489c640 1 -- 172.21.15.6:0/2662429034 shutdown_connections 2023-07-21T22:38:46.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.784+0000 7fa9a489c640 1 --2- 172.21.15.6:0/2662429034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a00d1850 0x7fa9a015f650 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.784+0000 7fa9a489c640 1 --2- 172.21.15.6:0/2662429034 >> v2:172.21.15.161:3300/0 conn(0x7fa9a00b7c70 0x7fa9a00d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.784+0000 7fa9a489c640 1 -- 172.21.15.6:0/2662429034 >> 172.21.15.6:0/2662429034 conn(0x7fa9a00650b0 msgr2=0x7fa9a00654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:46.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.784+0000 7fa9a489c640 1 -- 172.21.15.6:0/2662429034 shutdown_connections 2023-07-21T22:38:46.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.784+0000 7fa9a489c640 1 -- 172.21.15.6:0/2662429034 wait complete. 2023-07-21T22:38:46.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.784+0000 7fa9a489c640 1 Processor -- start 2023-07-21T22:38:46.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.784+0000 7fa9a489c640 1 -- start start 2023-07-21T22:38:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa9a489c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9a00b7c70 0x7fa9a00c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa9a489c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9a00d1300 0x7fa9a0156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa9a489c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a00d1850 0x7fa9a014c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa9a489c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a014ce90 con 0x7fa9a00d1850 2023-07-21T22:38:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa9a489c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a01557d0 con 0x7fa9a00d1300 2023-07-21T22:38:46.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa9a489c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00b6200 con 0x7fa9a00b7c70 2023-07-21T22:38:46.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa99ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a00d1850 0x7fa9a014c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:46.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa99ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a00d1850 0x7fa9a014c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58788/0 (socket says 172.21.15.6:58788) 2023-07-21T22:38:46.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa99ed9d640 1 -- 172.21.15.6:0/2173550881 learned_addr learned my addr 172.21.15.6:0/2173550881 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:46.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa997fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9a00d1300 0x7fa9a0156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:46.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa99e59c640 1 --2- 172.21.15.6:0/2173550881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9a00b7c70 0x7fa9a00c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:46.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa99ed9d640 1 -- 172.21.15.6:0/2173550881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9a00b7c70 msgr2=0x7fa9a00c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:46.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa99ed9d640 1 --2- 172.21.15.6:0/2173550881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9a00b7c70 0x7fa9a00c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa99ed9d640 1 -- 172.21.15.6:0/2173550881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9a00d1300 msgr2=0x7fa9a0156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa99ed9d640 1 --2- 172.21.15.6:0/2173550881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9a00d1300 0x7fa9a0156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa99ed9d640 1 -- 172.21.15.6:0/2173550881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9880094d0 con 0x7fa9a00d1850 2023-07-21T22:38:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa99ed9d640 1 --2- 172.21.15.6:0/2173550881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a00d1850 0x7fa9a014c950 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fa99800c730 tx=0x7fa99800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa996ffd640 1 -- 172.21.15.6:0/2173550881 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa998003b80 con 0x7fa9a00d1850 2023-07-21T22:38:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa996ffd640 1 -- 172.21.15.6:0/2173550881 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa998003ce0 con 0x7fa9a00d1850 2023-07-21T22:38:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa9a489c640 1 -- 172.21.15.6:0/2173550881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a0155ab0 con 0x7fa9a00d1850 2023-07-21T22:38:46.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa996ffd640 1 -- 172.21.15.6:0/2173550881 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa99800aa30 con 0x7fa9a00d1850 2023-07-21T22:38:46.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa9a489c640 1 -- 172.21.15.6:0/2173550881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a0156070 con 0x7fa9a00d1850 2023-07-21T22:38:46.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.788+0000 7fa9a489c640 1 -- 172.21.15.6:0/2173550881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a00678d0 con 0x7fa9a00d1850 2023-07-21T22:38:46.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.792+0000 7fa996ffd640 1 -- 172.21.15.6:0/2173550881 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 63) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fa99800ab90 con 0x7fa9a00d1850 2023-07-21T22:38:46.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.792+0000 7fa996ffd640 1 --2- 172.21.15.6:0/2173550881 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fa980066460 0x7fa980068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:46.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.792+0000 7fa996ffd640 1 -- 172.21.15.6:0/2173550881 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fa998083e10 con 0x7fa9a00d1850 2023-07-21T22:38:46.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.792+0000 7fa99e59c640 1 -- 172.21.15.6:0/2173550881 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fa980066460 msgr2=0x7fa980068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3543285241 2023-07-21T22:38:46.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.792+0000 7fa99e59c640 1 --2- 172.21.15.6:0/2173550881 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fa980066460 0x7fa980068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:46.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.796+0000 7fa996ffd640 1 -- 172.21.15.6:0/2173550881 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa998087030 con 0x7fa9a00d1850 2023-07-21T22:38:47.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.984+0000 7fa9a489c640 1 -- 172.21.15.6:0/2173550881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9a0072a60 con 0x7fa9a00d1850 2023-07-21T22:38:47.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.988+0000 7fa996ffd640 1 -- 172.21.15.6:0/2173550881 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4664 (secure 0 0 0) 0x7fa998050f10 con 0x7fa9a00d1850 2023-07-21T22:38:47.031 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:47.032 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1816246921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1816246921},{"type":"v1","addr":"172.21.15.6:6834","nonce":1816246921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7490,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/543588806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":543588806},{"type":"v1","addr":"172.21.15.6:6835","nonce":543588806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3250690150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3250690150},{"type":"v1","addr":"172.21.15.161:6836","nonce":3250690150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:38:23.444629+0000","modified":"2023-07-21T22:38:27.099144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8455":{"gid":8455,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/29499426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":29499426},{"type":"v1","addr":"172.21.15.161:6837","nonce":29499426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-21T22:38:47.032 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 62 2023-07-21T22:38:47.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.988+0000 7fa9a489c640 1 -- 172.21.15.6:0/2173550881 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fa980066460 msgr2=0x7fa980068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:47.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.988+0000 7fa9a489c640 1 --2- 172.21.15.6:0/2173550881 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fa980066460 0x7fa980068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.988+0000 7fa9a489c640 1 -- 172.21.15.6:0/2173550881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a00d1850 msgr2=0x7fa9a014c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.988+0000 7fa9a489c640 1 --2- 172.21.15.6:0/2173550881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a00d1850 0x7fa9a014c950 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fa99800c730 tx=0x7fa99800cbf0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.988+0000 7fa9a489c640 1 -- 172.21.15.6:0/2173550881 shutdown_connections 2023-07-21T22:38:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.988+0000 7fa9a489c640 1 --2- 172.21.15.6:0/2173550881 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fa980066460 0x7fa980068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.988+0000 7fa9a489c640 1 --2- 172.21.15.6:0/2173550881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9a00d1850 0x7fa9a014c950 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.988+0000 7fa9a489c640 1 --2- 172.21.15.6:0/2173550881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9a00d1300 0x7fa9a0156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.988+0000 7fa9a489c640 1 --2- 172.21.15.6:0/2173550881 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9a00b7c70 0x7fa9a00c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.988+0000 7fa9a489c640 1 -- 172.21.15.6:0/2173550881 >> 172.21.15.6:0/2173550881 conn(0x7fa9a00650b0 msgr2=0x7fa9a00ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:47.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.988+0000 7fa9a489c640 1 -- 172.21.15.6:0/2173550881 shutdown_connections 2023-07-21T22:38:47.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:46.988+0000 7fa9a489c640 1 -- 172.21.15.6:0/2173550881 wait complete. 2023-07-21T22:38:47.047 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:47.007+0000 7fa3bdd7e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:38:47.053 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:38:47.135 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:47.095+0000 7fa3bdd7e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:38:47.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.196+0000 7fd65c337640 1 Processor -- start 2023-07-21T22:38:47.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.196+0000 7fd65c337640 1 -- start start 2023-07-21T22:38:47.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.200+0000 7fd65c337640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd654158ce0 0x7fd654070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:47.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.200+0000 7fd65c337640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6540c9730 0x7fd6540ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:47.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.200+0000 7fd65c337640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6540cc700 con 0x7fd6540c8ad0 2023-07-21T22:38:47.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.200+0000 7fd65c337640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6540b0ff0 con 0x7fd6540c9730 2023-07-21T22:38:47.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.200+0000 7fd65c337640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd654070c80 con 0x7fd654158ce0 2023-07-21T22:38:47.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.200+0000 7fd65a8d4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6540c9730 0x7fd6540ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.200+0000 7fd65a8d4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6540c9730 0x7fd6540ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58802/0 (socket says 172.21.15.6:58802) 2023-07-21T22:38:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.200+0000 7fd65a8d4640 1 -- 172.21.15.6:0/2438150577 learned_addr learned my addr 172.21.15.6:0/2438150577 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.200+0000 7fd65a0d3640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd654158ce0 0x7fd654070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.200+0000 7fd65a8d4640 1 -- 172.21.15.6:0/2438150577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd654158ce0 msgr2=0x7fd654070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.200+0000 7fd65a8d4640 1 --2- 172.21.15.6:0/2438150577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd654158ce0 0x7fd654070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.200+0000 7fd65a8d4640 1 -- 172.21.15.6:0/2438150577 >> v1:172.21.15.6:6789/0 conn(0x7fd6540c8ad0 legacy=0x7fd6540c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.200+0000 7fd65a8d4640 1 -- 172.21.15.6:0/2438150577 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6540cbdd0 con 0x7fd6540c9730 2023-07-21T22:38:47.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.204+0000 7fd65a8d4640 1 --2- 172.21.15.6:0/2438150577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6540c9730 0x7fd6540ccb90 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009e50 tx=0x7fd64c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc39b943328569c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.204+0000 7fd6590d1640 1 -- 172.21.15.6:0/2438150577 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c0a5690 con 0x7fd6540c9730 2023-07-21T22:38:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.204+0000 7fd6590d1640 1 -- 172.21.15.6:0/2438150577 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64c0a57f0 con 0x7fd6540c9730 2023-07-21T22:38:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.204+0000 7fd6590d1640 1 -- 172.21.15.6:0/2438150577 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c0a5b80 con 0x7fd6540c9730 2023-07-21T22:38:47.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.204+0000 7fd65c337640 1 -- 172.21.15.6:0/2438150577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6540c9730 msgr2=0x7fd6540ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:47.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.204+0000 7fd65c337640 1 --2- 172.21.15.6:0/2438150577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6540c9730 0x7fd6540ccb90 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009e50 tx=0x7fd64c01c8c0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.204+0000 7fd65c337640 1 -- 172.21.15.6:0/2438150577 shutdown_connections 2023-07-21T22:38:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.204+0000 7fd65c337640 1 --2- 172.21.15.6:0/2438150577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6540c9730 0x7fd6540ccb90 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.204+0000 7fd65c337640 1 --2- 172.21.15.6:0/2438150577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd654158ce0 0x7fd654070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.204+0000 7fd65c337640 1 -- 172.21.15.6:0/2438150577 >> 172.21.15.6:0/2438150577 conn(0x7fd6540afcf0 msgr2=0x7fd6540b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.204+0000 7fd65c337640 1 -- 172.21.15.6:0/2438150577 shutdown_connections 2023-07-21T22:38:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.204+0000 7fd65c337640 1 -- 172.21.15.6:0/2438150577 wait complete. 2023-07-21T22:38:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.204+0000 7fd65c337640 1 Processor -- start 2023-07-21T22:38:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.204+0000 7fd65c337640 1 -- start start 2023-07-21T22:38:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd65c337640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6540c8ad0 0x7fd6540b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd65c337640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6540c9730 0x7fd6541f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd65c337640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd654158ce0 0x7fd6540ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd65c337640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6540c83f0 con 0x7fd6540c9730 2023-07-21T22:38:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd65c337640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6540ac640 con 0x7fd6540c8ad0 2023-07-21T22:38:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd65c337640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6541f42e0 con 0x7fd654158ce0 2023-07-21T22:38:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd65a8d4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd654158ce0 0x7fd6540ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd6598d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6540c9730 0x7fd6541f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd65a8d4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd654158ce0 0x7fd6540ca610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:35130/0 (socket says 172.21.15.6:35130) 2023-07-21T22:38:47.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd65a8d4640 1 -- 172.21.15.6:0/1801267615 learned_addr learned my addr 172.21.15.6:0/1801267615 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:47.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd65a0d3640 1 --2- 172.21.15.6:0/1801267615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6540c8ad0 0x7fd6540b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:47.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd65a8d4640 1 -- 172.21.15.6:0/1801267615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6540c8ad0 msgr2=0x7fd6540b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:47.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd65a8d4640 1 --2- 172.21.15.6:0/1801267615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6540c8ad0 0x7fd6540b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd65a8d4640 1 -- 172.21.15.6:0/1801267615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6540c9730 msgr2=0x7fd6541f3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:47.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd65a8d4640 1 --2- 172.21.15.6:0/1801267615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6540c9730 0x7fd6541f3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd65a8d4640 1 -- 172.21.15.6:0/1801267615 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64c009b30 con 0x7fd654158ce0 2023-07-21T22:38:47.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd65a8d4640 1 --2- 172.21.15.6:0/1801267615 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd654158ce0 0x7fd6540ca610 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009e50 tx=0x7fd64c019660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:47.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd64affd640 1 -- 172.21.15.6:0/1801267615 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c0b8670 con 0x7fd654158ce0 2023-07-21T22:38:47.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd64affd640 1 -- 172.21.15.6:0/1801267615 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64c0b87d0 con 0x7fd654158ce0 2023-07-21T22:38:47.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd65c337640 1 -- 172.21.15.6:0/1801267615 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6540b3fb0 con 0x7fd654158ce0 2023-07-21T22:38:47.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd64affd640 1 -- 172.21.15.6:0/1801267615 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c0b8b80 con 0x7fd654158ce0 2023-07-21T22:38:47.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd65c337640 1 -- 172.21.15.6:0/1801267615 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6540c7910 con 0x7fd654158ce0 2023-07-21T22:38:47.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.208+0000 7fd65c337640 1 -- 172.21.15.6:0/1801267615 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6540ca1a0 con 0x7fd654158ce0 2023-07-21T22:38:47.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.212+0000 7fd64affd640 1 -- 172.21.15.6:0/1801267615 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 63) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fd64c0b8ce0 con 0x7fd654158ce0 2023-07-21T22:38:47.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.212+0000 7fd64affd640 1 --2- 172.21.15.6:0/1801267615 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fd638066430 0x7fd6380688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:47.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.212+0000 7fd64affd640 1 -- 172.21.15.6:0/1801267615 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fd64c11f5d0 con 0x7fd654158ce0 2023-07-21T22:38:47.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.212+0000 7fd65a0d3640 1 -- 172.21.15.6:0/1801267615 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fd638066430 msgr2=0x7fd6380688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3543285241 2023-07-21T22:38:47.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.212+0000 7fd65a0d3640 1 --2- 172.21.15.6:0/1801267615 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fd638066430 0x7fd6380688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:47.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.216+0000 7fd64affd640 1 -- 172.21.15.6:0/1801267615 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd64c0ec640 con 0x7fd654158ce0 2023-07-21T22:38:47.277 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:47.232+0000 7f97dc63a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:38:47.283 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:47.243+0000 7fa3bdd7e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:38:47.367 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:47.320+0000 7f97dc63a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:38:47.367 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:47.327+0000 7fa3bdd7e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:38:47.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.372+0000 7fd65c337640 1 -- 172.21.15.6:0/1801267615 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6540b22b0 con 0x7fd654158ce0 2023-07-21T22:38:47.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.376+0000 7fd64affd640 1 -- 172.21.15.6:0/1801267615 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+18911 (secure 0 0 0) 0x7fd64c009510 con 0x7fd654158ce0 2023-07-21T22:38:47.420 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:47.420 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":144,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:38:40.645814+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:38:21.546383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-21T22:38:22.445128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/611533009":"2023-07-22T22:38:40.645781+0000","172.21.15.161:6833/3436422767":"2023-07-22T22:38:40.645781+0000","172.21.15.161:0/3113062624":"2023-07-22T22:38:40.645781+0000","172.21.15.161:6832/3436422767":"2023-07-22T22:38:40.645781+0000","172.21.15.161:0/2051512394":"2023-07-22T22:38:40.645781+0000","172.21.15.161:0/747215894":"2023-07-22T22:38:40.645781+0000","172.21.15.161:0/3161426051":"2023-07-22T22:38:40.645781+0000","172.21.15.161:0/3783651589":"2023-07-22T22:38:40.645781+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:38:47.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.376+0000 7fd65c337640 1 -- 172.21.15.6:0/1801267615 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fd638066430 msgr2=0x7fd6380688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:47.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.376+0000 7fd65c337640 1 --2- 172.21.15.6:0/1801267615 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fd638066430 0x7fd6380688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.376+0000 7fd65c337640 1 -- 172.21.15.6:0/1801267615 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd654158ce0 msgr2=0x7fd6540ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:47.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.376+0000 7fd65c337640 1 --2- 172.21.15.6:0/1801267615 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd654158ce0 0x7fd6540ca610 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009e50 tx=0x7fd64c019660 comp rx=0 tx=0).stop 2023-07-21T22:38:47.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.376+0000 7fd65c337640 1 -- 172.21.15.6:0/1801267615 shutdown_connections 2023-07-21T22:38:47.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.376+0000 7fd65c337640 1 --2- 172.21.15.6:0/1801267615 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7fd638066430 0x7fd6380688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.376+0000 7fd65c337640 1 --2- 172.21.15.6:0/1801267615 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd654158ce0 0x7fd6540ca610 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.376+0000 7fd65c337640 1 --2- 172.21.15.6:0/1801267615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6540c9730 0x7fd6541f3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.376+0000 7fd65c337640 1 --2- 172.21.15.6:0/1801267615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6540c8ad0 0x7fd6540b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.376+0000 7fd65c337640 1 -- 172.21.15.6:0/1801267615 >> 172.21.15.6:0/1801267615 conn(0x7fd6540afcf0 msgr2=0x7fd654151a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:47.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.376+0000 7fd65c337640 1 -- 172.21.15.6:0/1801267615 shutdown_connections 2023-07-21T22:38:47.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.376+0000 7fd65c337640 1 -- 172.21.15.6:0/1801267615 wait complete. 2023-07-21T22:38:47.441 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:38:21.546383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:38:22.445128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:38:47.442 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:38:47.527 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:47.480+0000 7f97dc63a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:38:47.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.548+0000 7feb96bfa640 1 Processor -- start 2023-07-21T22:38:47.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.548+0000 7feb96bfa640 1 -- start start 2023-07-21T22:38:47.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.548+0000 7feb96bfa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feb900d2fc0 0x7feb900b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:47.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.548+0000 7feb96bfa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb900d2300 0x7feb900d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:47.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.548+0000 7feb96bfa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb900b04c0 con 0x7feb9015bde0 2023-07-21T22:38:47.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.548+0000 7feb96bfa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9015c1b0 con 0x7feb900d2fc0 2023-07-21T22:38:47.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.548+0000 7feb96bfa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb900d2cc0 con 0x7feb900d2300 2023-07-21T22:38:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.548+0000 7feb8ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feb900d2fc0 0x7feb900b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.548+0000 7feb95197640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb900d2300 0x7feb900d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.548+0000 7feb95197640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb900d2300 0x7feb900d2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:34962/0 (socket says 172.21.15.6:34962) 2023-07-21T22:38:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.548+0000 7feb95197640 1 -- 172.21.15.6:0/3020084984 learned_addr learned my addr 172.21.15.6:0/3020084984 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.548+0000 7feb95197640 1 -- 172.21.15.6:0/3020084984 >> v2:172.21.15.161:3300/0 conn(0x7feb900d2fc0 msgr2=0x7feb900b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.548+0000 7feb95197640 1 --2- 172.21.15.6:0/3020084984 >> v2:172.21.15.161:3300/0 conn(0x7feb900d2fc0 0x7feb900b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.548+0000 7feb95197640 1 -- 172.21.15.6:0/3020084984 >> v1:172.21.15.161:6789/0 conn(0x7feb9015bde0 legacy=0x7feb900d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.548+0000 7feb95197640 1 -- 172.21.15.6:0/3020084984 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb900d0aa0 con 0x7feb900d2300 2023-07-21T22:38:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.552+0000 7feb95197640 1 --2- 172.21.15.6:0/3020084984 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb900d2300 0x7feb900d2780 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7feb88009e50 tx=0x7feb8801ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78d0140ce66a36ed server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.552+0000 7feb8f7fe640 1 -- 172.21.15.6:0/3020084984 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880a58e0 con 0x7feb900d2300 2023-07-21T22:38:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.552+0000 7feb8f7fe640 1 -- 172.21.15.6:0/3020084984 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb880a5a40 con 0x7feb900d2300 2023-07-21T22:38:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.552+0000 7feb8f7fe640 1 -- 172.21.15.6:0/3020084984 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880a5dd0 con 0x7feb900d2300 2023-07-21T22:38:47.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.552+0000 7feb96bfa640 1 -- 172.21.15.6:0/3020084984 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb900d2300 msgr2=0x7feb900d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:47.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.552+0000 7feb96bfa640 1 --2- 172.21.15.6:0/3020084984 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb900d2300 0x7feb900d2780 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7feb88009e50 tx=0x7feb8801ca10 comp rx=0 tx=0).stop 2023-07-21T22:38:47.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.552+0000 7feb96bfa640 1 -- 172.21.15.6:0/3020084984 shutdown_connections 2023-07-21T22:38:47.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.552+0000 7feb96bfa640 1 --2- 172.21.15.6:0/3020084984 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb900d2300 0x7feb900d2780 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.552+0000 7feb96bfa640 1 --2- 172.21.15.6:0/3020084984 >> v2:172.21.15.161:3300/0 conn(0x7feb900d2fc0 0x7feb900b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.552+0000 7feb96bfa640 1 -- 172.21.15.6:0/3020084984 >> 172.21.15.6:0/3020084984 conn(0x7feb900659d0 msgr2=0x7feb9009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:47.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.552+0000 7feb96bfa640 1 -- 172.21.15.6:0/3020084984 shutdown_connections 2023-07-21T22:38:47.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.552+0000 7feb96bfa640 1 -- 172.21.15.6:0/3020084984 wait complete. 2023-07-21T22:38:47.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb96bfa640 1 Processor -- start 2023-07-21T22:38:47.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb96bfa640 1 -- start start 2023-07-21T22:38:47.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb96bfa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb900d2300 0x7feb900b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:47.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb96bfa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb900d2fc0 0x7feb90154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:47.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb96bfa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb9015bde0 0x7feb9014ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:47.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb96bfa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb900c5780 con 0x7feb900d2300 2023-07-21T22:38:47.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb96bfa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9014b070 con 0x7feb900d2fc0 2023-07-21T22:38:47.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb96bfa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb900c51c0 con 0x7feb9015bde0 2023-07-21T22:38:47.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb94996640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb900d2300 0x7feb900b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:47.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb94996640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb900d2300 0x7feb900b1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43668/0 (socket says 172.21.15.6:43668) 2023-07-21T22:38:47.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb94996640 1 -- 172.21.15.6:0/744874454 learned_addr learned my addr 172.21.15.6:0/744874454 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:47.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb8ffff640 1 --2- 172.21.15.6:0/744874454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb900d2fc0 0x7feb90154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:47.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb95197640 1 --2- 172.21.15.6:0/744874454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb9015bde0 0x7feb9014ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:47.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb94996640 1 -- 172.21.15.6:0/744874454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb9015bde0 msgr2=0x7feb9014ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:47.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb94996640 1 --2- 172.21.15.6:0/744874454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb9015bde0 0x7feb9014ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb94996640 1 -- 172.21.15.6:0/744874454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb900d2fc0 msgr2=0x7feb90154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:47.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb94996640 1 --2- 172.21.15.6:0/744874454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb900d2fc0 0x7feb90154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb94996640 1 -- 172.21.15.6:0/744874454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb88009b30 con 0x7feb900d2300 2023-07-21T22:38:47.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb94996640 1 --2- 172.21.15.6:0/744874454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb900d2300 0x7feb900b1220 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7feb8400c430 tx=0x7feb8400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:47.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb8d7fa640 1 -- 172.21.15.6:0/744874454 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb840052d0 con 0x7feb900d2300 2023-07-21T22:38:47.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb8d7fa640 1 -- 172.21.15.6:0/744874454 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb84005470 con 0x7feb900d2300 2023-07-21T22:38:47.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb8d7fa640 1 -- 172.21.15.6:0/744874454 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb84006a70 con 0x7feb900d2300 2023-07-21T22:38:47.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb96bfa640 1 -- 172.21.15.6:0/744874454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb900c54a0 con 0x7feb900d2300 2023-07-21T22:38:47.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb96bfa640 1 -- 172.21.15.6:0/744874454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb900b39f0 con 0x7feb900d2300 2023-07-21T22:38:47.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.556+0000 7feb96bfa640 1 -- 172.21.15.6:0/744874454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb900678d0 con 0x7feb900d2300 2023-07-21T22:38:47.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.560+0000 7feb8d7fa640 1 -- 172.21.15.6:0/744874454 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 63) v1 ==== 85817+0+0 (secure 0 0 0) 0x7feb84006bd0 con 0x7feb900d2300 2023-07-21T22:38:47.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.560+0000 7feb8d7fa640 1 --2- 172.21.15.6:0/744874454 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7feb74066430 0x7feb740688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:47.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.560+0000 7feb8d7fa640 1 -- 172.21.15.6:0/744874454 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6478+0+0 (secure 0 0 0) 0x7feb84083520 con 0x7feb900d2300 2023-07-21T22:38:47.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.560+0000 7feb8ffff640 1 -- 172.21.15.6:0/744874454 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7feb74066430 msgr2=0x7feb740688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/3543285241 2023-07-21T22:38:47.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.560+0000 7feb8ffff640 1 --2- 172.21.15.6:0/744874454 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7feb74066430 0x7feb740688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:38:47.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.564+0000 7feb8d7fa640 1 -- 172.21.15.6:0/744874454 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feb840506d0 con 0x7feb900d2300 2023-07-21T22:38:47.620 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:47.576+0000 7f97dc63a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:38:47.640 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:47.599+0000 7fa3bdd7e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:38:47.701 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:47.663+0000 7fa3bdd7e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:38:47.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.668+0000 7feb8d7fa640 1 -- 172.21.15.6:0/744874454 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 64) v1 ==== 85369+0+0 (secure 0 0 0) 0x7feb84050aa0 con 0x7feb900d2300 2023-07-21T22:38:47.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.668+0000 7feb8d7fa640 1 -- 172.21.15.6:0/744874454 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7feb74066430 msgr2=0x7feb740688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:38:47.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.668+0000 7feb8d7fa640 1 --2- 172.21.15.6:0/744874454 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7feb74066430 0x7feb740688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.736+0000 7feb96bfa640 1 -- 172.21.15.6:0/744874454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb900b5340 con 0x7feb900d2300 2023-07-21T22:38:47.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.736+0000 7feb8d7fa640 1 -- 172.21.15.6:0/744874454 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v145) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb8406dec0 con 0x7feb900d2300 2023-07-21T22:38:47.780 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:38:47.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.736+0000 7feb96bfa640 1 -- 172.21.15.6:0/744874454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb900d2300 msgr2=0x7feb900b1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:47.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.736+0000 7feb96bfa640 1 --2- 172.21.15.6:0/744874454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb900d2300 0x7feb900b1220 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7feb8400c430 tx=0x7feb8400c8f0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.736+0000 7feb96bfa640 1 -- 172.21.15.6:0/744874454 shutdown_connections 2023-07-21T22:38:47.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.736+0000 7feb96bfa640 1 --2- 172.21.15.6:0/744874454 >> [v2:172.21.15.161:6832/3543285241,v1:172.21.15.161:6833/3543285241] conn(0x7feb74066430 0x7feb740688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.736+0000 7feb96bfa640 1 --2- 172.21.15.6:0/744874454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feb9015bde0 0x7feb9014ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.736+0000 7feb96bfa640 1 --2- 172.21.15.6:0/744874454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feb900d2fc0 0x7feb90154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.736+0000 7feb96bfa640 1 --2- 172.21.15.6:0/744874454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb900d2300 0x7feb900b1220 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.736+0000 7feb96bfa640 1 -- 172.21.15.6:0/744874454 >> 172.21.15.6:0/744874454 conn(0x7feb900659d0 msgr2=0x7feb9015ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:47.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.736+0000 7feb96bfa640 1 -- 172.21.15.6:0/744874454 shutdown_connections 2023-07-21T22:38:47.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.736+0000 7feb96bfa640 1 -- 172.21.15.6:0/744874454 wait complete. 2023-07-21T22:38:47.784 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:47.743+0000 7fa3457f6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:47.784 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:47.743+0000 7fa3457f6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:47.785 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:47.743+0000 7fa3457f6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:47.785 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:47.743+0000 7fa3457f6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:47.785 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:47.743+0000 7fa3457f6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:47.787 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:47.747+0000 7fa348ffd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:47.787 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:47.747+0000 7fa348ffd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:47.787 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:47.747+0000 7fa348ffd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:47.788 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:47.747+0000 7fa348ffd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:47.788 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:38:47.747+0000 7fa348ffd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:38:47.803 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:38:47.924 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:47.880+0000 7f97dc63a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:38:47.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.908+0000 7f6713693640 1 Processor -- start 2023-07-21T22:38:47.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.908+0000 7f6713693640 1 -- start start 2023-07-21T22:38:47.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.908+0000 7f6713693640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f670c0d2300 0x7f670c0d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:47.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.908+0000 7f6713693640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670c0b04c0 con 0x7f670c15bde0 2023-07-21T22:38:47.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.908+0000 7f6713693640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670c0b1060 con 0x7f670c0d2fc0 2023-07-21T22:38:47.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.908+0000 7f6713693640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670c15c1b0 con 0x7f670c0d2300 2023-07-21T22:38:47.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.908+0000 7f671142f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f670c15bde0 0x7f670c0d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41396/0 (socket says 172.21.15.6:41396) 2023-07-21T22:38:47.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.908+0000 7f671142f640 1 -- 172.21.15.6:0/4145187303 learned_addr learned my addr 172.21.15.6:0/4145187303 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:47.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.908+0000 7f6711c30640 1 --2- 172.21.15.6:0/4145187303 >> v2:172.21.15.161:3300/0 conn(0x7f670c0d2300 0x7f670c0d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:47.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.908+0000 7f6711c30640 1 -- 172.21.15.6:0/4145187303 >> v1:172.21.15.161:6789/0 conn(0x7f670c0d2fc0 legacy=0x7f670c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:47.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.908+0000 7f6711c30640 1 -- 172.21.15.6:0/4145187303 >> v1:172.21.15.6:6789/0 conn(0x7f670c15bde0 legacy=0x7f670c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:47.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.908+0000 7f6711c30640 1 -- 172.21.15.6:0/4145187303 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c0d2c80 con 0x7f670c0d2300 2023-07-21T22:38:47.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.916+0000 7f6711c30640 1 --2- 172.21.15.6:0/4145187303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f670c0d2300 0x7f670c0d2740 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6704009d90 tx=0x7f670401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48bf514eee025b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:47.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.916+0000 7f6703fff640 1 -- 172.21.15.6:0/4145187303 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67040a5920 con 0x7f670c0d2300 2023-07-21T22:38:47.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.916+0000 7f6703fff640 1 -- 172.21.15.6:0/4145187303 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67040a5a80 con 0x7f670c0d2300 2023-07-21T22:38:47.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.916+0000 7f6703fff640 1 -- 172.21.15.6:0/4145187303 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67040a5e10 con 0x7f670c0d2300 2023-07-21T22:38:47.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.916+0000 7f6713693640 1 -- 172.21.15.6:0/4145187303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f670c0d2300 msgr2=0x7f670c0d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:47.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.916+0000 7f6713693640 1 --2- 172.21.15.6:0/4145187303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f670c0d2300 0x7f670c0d2740 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6704009d90 tx=0x7f670401c950 comp rx=0 tx=0).stop 2023-07-21T22:38:47.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.916+0000 7f6713693640 1 -- 172.21.15.6:0/4145187303 shutdown_connections 2023-07-21T22:38:47.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.916+0000 7f6713693640 1 --2- 172.21.15.6:0/4145187303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f670c0d2300 0x7f670c0d2740 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.916+0000 7f6713693640 1 -- 172.21.15.6:0/4145187303 >> 172.21.15.6:0/4145187303 conn(0x7f670c0659d0 msgr2=0x7f670c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:47.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.916+0000 7f6713693640 1 -- 172.21.15.6:0/4145187303 shutdown_connections 2023-07-21T22:38:47.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.916+0000 7f6713693640 1 -- 172.21.15.6:0/4145187303 wait complete. 2023-07-21T22:38:47.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.916+0000 7f6713693640 1 Processor -- start 2023-07-21T22:38:47.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.916+0000 7f6713693640 1 -- start start 2023-07-21T22:38:47.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f6713693640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f670c0d2300 0x7f670c0c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:47.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f6713693640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f670c0d2fc0 0x7f670c0b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:47.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f6713693640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f670c15bde0 0x7f670c0b6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:47.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f6713693640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670c0c6e40 con 0x7f670c0d2300 2023-07-21T22:38:47.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f6713693640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670c0c9f10 con 0x7f670c0d2fc0 2023-07-21T22:38:47.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f6713693640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670c0c9be0 con 0x7f670c15bde0 2023-07-21T22:38:47.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f671142f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f670c0d2300 0x7f670c0c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:47.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f671142f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f670c0d2300 0x7f670c0c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43680/0 (socket says 172.21.15.6:43680) 2023-07-21T22:38:47.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f671142f640 1 -- 172.21.15.6:0/2857049352 learned_addr learned my addr 172.21.15.6:0/2857049352 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:47.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f6711c30640 1 --2- 172.21.15.6:0/2857049352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f670c15bde0 0x7f670c0b6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:47.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f6710c2e640 1 --2- 172.21.15.6:0/2857049352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f670c0d2fc0 0x7f670c0b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:47.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f671142f640 1 -- 172.21.15.6:0/2857049352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f670c15bde0 msgr2=0x7f670c0b6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:47.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f671142f640 1 --2- 172.21.15.6:0/2857049352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f670c15bde0 0x7f670c0b6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f671142f640 1 -- 172.21.15.6:0/2857049352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f670c0d2fc0 msgr2=0x7f670c0b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:47.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f671142f640 1 --2- 172.21.15.6:0/2857049352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f670c0d2fc0 0x7f670c0b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:47.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f671142f640 1 -- 172.21.15.6:0/2857049352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6704009a70 con 0x7f670c0d2300 2023-07-21T22:38:47.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f671142f640 1 --2- 172.21.15.6:0/2857049352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f670c0d2300 0x7f670c0c5ea0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f6708007fd0 tx=0x7f670800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:47.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f6701ffb640 1 -- 172.21.15.6:0/2857049352 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67080074e0 con 0x7f670c0d2300 2023-07-21T22:38:47.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f6701ffb640 1 -- 172.21.15.6:0/2857049352 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6708007640 con 0x7f670c0d2300 2023-07-21T22:38:47.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f6701ffb640 1 -- 172.21.15.6:0/2857049352 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67080059b0 con 0x7f670c0d2300 2023-07-21T22:38:47.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f6713693640 1 -- 172.21.15.6:0/2857049352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f670c0c65a0 con 0x7f670c0d2300 2023-07-21T22:38:47.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f6713693640 1 -- 172.21.15.6:0/2857049352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f670c0c6b60 con 0x7f670c0d2300 2023-07-21T22:38:47.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.920+0000 7f6713693640 1 -- 172.21.15.6:0/2857049352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f670c0678d0 con 0x7f670c0d2300 2023-07-21T22:38:47.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.924+0000 7f6701ffb640 1 -- 172.21.15.6:0/2857049352 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 64) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f6708005b10 con 0x7f670c0d2300 2023-07-21T22:38:47.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.924+0000 7f6701ffb640 1 -- 172.21.15.6:0/2857049352 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6865+0+0 (secure 0 0 0) 0x7f67080830a0 con 0x7f670c0d2300 2023-07-21T22:38:47.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:47.928+0000 7f6701ffb640 1 -- 172.21.15.6:0/2857049352 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6708050570 con 0x7f670c0d2300 2023-07-21T22:38:47.993 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:38:47.948+0000 7f97dc63a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:38:48.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.088+0000 7f6713693640 1 -- 172.21.15.6:0/2857049352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f670c0b0af0 con 0x7f670c0d2300 2023-07-21T22:38:48.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.088+0000 7f6701ffb640 1 -- 172.21.15.6:0/2857049352 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v145) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6708017070 con 0x7f670c0d2300 2023-07-21T22:38:48.133 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:38:48.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.088+0000 7f6713693640 1 -- 172.21.15.6:0/2857049352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f670c0d2300 msgr2=0x7f670c0c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:48.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.088+0000 7f6713693640 1 --2- 172.21.15.6:0/2857049352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f670c0d2300 0x7f670c0c5ea0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f6708007fd0 tx=0x7f670800c890 comp rx=0 tx=0).stop 2023-07-21T22:38:48.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.088+0000 7f6713693640 1 -- 172.21.15.6:0/2857049352 shutdown_connections 2023-07-21T22:38:48.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.088+0000 7f6713693640 1 --2- 172.21.15.6:0/2857049352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f670c15bde0 0x7f670c0b6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.088+0000 7f6713693640 1 --2- 172.21.15.6:0/2857049352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f670c0d2fc0 0x7f670c0b6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.088+0000 7f6713693640 1 --2- 172.21.15.6:0/2857049352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f670c0d2300 0x7f670c0c5ea0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.088+0000 7f6713693640 1 -- 172.21.15.6:0/2857049352 >> 172.21.15.6:0/2857049352 conn(0x7f670c0659d0 msgr2=0x7f670c06afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:48.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.092+0000 7f6713693640 1 -- 172.21.15.6:0/2857049352 shutdown_connections 2023-07-21T22:38:48.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.092+0000 7f6713693640 1 -- 172.21.15.6:0/2857049352 wait complete. 2023-07-21T22:38:48.155 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:38:48.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.256+0000 7f0d1169c640 1 Processor -- start 2023-07-21T22:38:48.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.256+0000 7f0d1169c640 1 -- start start 2023-07-21T22:38:48.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.260+0000 7f0d1169c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0d0c15cef0 0x7f0d0c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:48.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.260+0000 7f0d1169c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d0c159270 0x7f0d0c0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.260+0000 7f0d1169c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0c1532b0 con 0x7f0d0c0aeb40 2023-07-21T22:38:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.260+0000 7f0d1169c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0c15d360 con 0x7f0d0c15cef0 2023-07-21T22:38:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.260+0000 7f0d1169c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c0ca6f0 con 0x7f0d0c159270 2023-07-21T22:38:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.260+0000 7f0d0affd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0d0c0aeb40 0x7f0d0c0aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41404/0 (socket says 172.21.15.6:41404) 2023-07-21T22:38:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.260+0000 7f0d0affd640 1 -- 172.21.15.6:0/2284951064 learned_addr learned my addr 172.21.15.6:0/2284951064 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:48.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.260+0000 7f0d03fff640 1 --2- 172.21.15.6:0/2284951064 >> v2:172.21.15.6:3300/0 conn(0x7f0d0c15cef0 0x7f0d0c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:48.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.260+0000 7f0d0b7fe640 1 --2- 172.21.15.6:0/2284951064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d0c159270 0x7f0d0c0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:48.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.260+0000 7f0d0a7fc640 1 -- 172.21.15.6:0/2284951064 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 12273202 0 0) 0x7f0d0c1532b0 con 0x7f0d0c0aeb40 2023-07-21T22:38:48.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.260+0000 7f0d0a7fc640 1 -- 172.21.15.6:0/2284951064 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cf8005740 con 0x7f0d0c0aeb40 2023-07-21T22:38:48.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.260+0000 7f0d03fff640 1 -- 172.21.15.6:0/2284951064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d0c159270 msgr2=0x7f0d0c0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:48.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.260+0000 7f0d03fff640 1 --2- 172.21.15.6:0/2284951064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d0c159270 0x7f0d0c0c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.260+0000 7f0d03fff640 1 -- 172.21.15.6:0/2284951064 >> v1:172.21.15.6:6789/0 conn(0x7f0d0c0aeb40 legacy=0x7f0d0c0aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:48.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.260+0000 7f0d03fff640 1 -- 172.21.15.6:0/2284951064 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c1599d0 con 0x7f0d0c15cef0 2023-07-21T22:38:48.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.260+0000 7f0d03fff640 1 --2- 172.21.15.6:0/2284951064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d0c15cef0 0x7f0d0c158d30 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f0cf40097c0 tx=0x7f0cf401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9df52a821dd3c1f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:48.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d0a7fc640 1 -- 172.21.15.6:0/2284951064 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf40ab650 con 0x7f0d0c15cef0 2023-07-21T22:38:48.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d0a7fc640 1 -- 172.21.15.6:0/2284951064 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf40ab7b0 con 0x7f0d0c15cef0 2023-07-21T22:38:48.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d0a7fc640 1 -- 172.21.15.6:0/2284951064 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf40abb40 con 0x7f0d0c15cef0 2023-07-21T22:38:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d1169c640 1 -- 172.21.15.6:0/2284951064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d0c15cef0 msgr2=0x7f0d0c158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d1169c640 1 --2- 172.21.15.6:0/2284951064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d0c15cef0 0x7f0d0c158d30 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f0cf40097c0 tx=0x7f0cf401c450 comp rx=0 tx=0).stop 2023-07-21T22:38:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d1169c640 1 -- 172.21.15.6:0/2284951064 shutdown_connections 2023-07-21T22:38:48.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d1169c640 1 --2- 172.21.15.6:0/2284951064 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d0c159270 0x7f0d0c0c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d1169c640 1 --2- 172.21.15.6:0/2284951064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d0c15cef0 0x7f0d0c158d30 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d1169c640 1 -- 172.21.15.6:0/2284951064 >> 172.21.15.6:0/2284951064 conn(0x7f0d0c0cde90 msgr2=0x7f0d0c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:48.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d1169c640 1 -- 172.21.15.6:0/2284951064 shutdown_connections 2023-07-21T22:38:48.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d1169c640 1 -- 172.21.15.6:0/2284951064 wait complete. 2023-07-21T22:38:48.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d1169c640 1 Processor -- start 2023-07-21T22:38:48.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d1169c640 1 -- start start 2023-07-21T22:38:48.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d1169c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d0c0aeb40 0x7f0d0c0b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:48.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d1169c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d0c159270 0x7f0d0c14e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:48.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d1169c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d0c15cef0 0x7f0d0c0b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:48.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d1169c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c14ee60 con 0x7f0d0c0aeb40 2023-07-21T22:38:48.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d1169c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c06f6a0 con 0x7f0d0c15cef0 2023-07-21T22:38:48.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d1169c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0c06f980 con 0x7f0d0c159270 2023-07-21T22:38:48.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d0affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d0c0aeb40 0x7f0d0c0b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:48.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d0affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d0c0aeb40 0x7f0d0c0b3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43692/0 (socket says 172.21.15.6:43692) 2023-07-21T22:38:48.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.264+0000 7f0d0affd640 1 -- 172.21.15.6:0/3440151648 learned_addr learned my addr 172.21.15.6:0/3440151648 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:48.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.268+0000 7f0d0b7fe640 1 --2- 172.21.15.6:0/3440151648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d0c15cef0 0x7f0d0c0b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:48.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.268+0000 7f0d03fff640 1 --2- 172.21.15.6:0/3440151648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d0c159270 0x7f0d0c14e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:48.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.268+0000 7f0d0affd640 1 -- 172.21.15.6:0/3440151648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d0c159270 msgr2=0x7f0d0c14e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:48.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.268+0000 7f0d0affd640 1 --2- 172.21.15.6:0/3440151648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d0c159270 0x7f0d0c14e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.268+0000 7f0d0affd640 1 -- 172.21.15.6:0/3440151648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d0c15cef0 msgr2=0x7f0d0c0b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:48.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.268+0000 7f0d0affd640 1 --2- 172.21.15.6:0/3440151648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d0c15cef0 0x7f0d0c0b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.268+0000 7f0d0affd640 1 -- 172.21.15.6:0/3440151648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf4009420 con 0x7f0d0c0aeb40 2023-07-21T22:38:48.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.268+0000 7f0d0b7fe640 1 --2- 172.21.15.6:0/3440151648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d0c15cef0 0x7f0d0c0b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:48.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.268+0000 7f0d0affd640 1 --2- 172.21.15.6:0/3440151648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d0c0aeb40 0x7f0d0c0b3980 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00c4d0 tx=0x7f0cfc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:48.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.268+0000 7f0d037fe640 1 -- 172.21.15.6:0/3440151648 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc005cf0 con 0x7f0d0c0aeb40 2023-07-21T22:38:48.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.268+0000 7f0d037fe640 1 -- 172.21.15.6:0/3440151648 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cfc005e50 con 0x7f0d0c0aeb40 2023-07-21T22:38:48.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.268+0000 7f0d1169c640 1 -- 172.21.15.6:0/3440151648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d0c06fc60 con 0x7f0d0c0aeb40 2023-07-21T22:38:48.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.268+0000 7f0d037fe640 1 -- 172.21.15.6:0/3440151648 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc007270 con 0x7f0d0c0aeb40 2023-07-21T22:38:48.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.268+0000 7f0d1169c640 1 -- 172.21.15.6:0/3440151648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0c0b2230 con 0x7f0d0c0aeb40 2023-07-21T22:38:48.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.268+0000 7f0d1169c640 1 -- 172.21.15.6:0/3440151648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0c070180 con 0x7f0d0c0aeb40 2023-07-21T22:38:48.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.268+0000 7f0d037fe640 1 -- 172.21.15.6:0/3440151648 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 64) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f0cfc0073d0 con 0x7f0d0c0aeb40 2023-07-21T22:38:48.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.272+0000 7f0d037fe640 1 -- 172.21.15.6:0/3440151648 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6865+0+0 (secure 0 0 0) 0x7f0cfc083170 con 0x7f0d0c0aeb40 2023-07-21T22:38:48.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.272+0000 7f0d037fe640 1 -- 172.21.15.6:0/3440151648 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0d0c070180 con 0x7f0d0c0aeb40 2023-07-21T22:38:48.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.432+0000 7f0d1169c640 1 -- 172.21.15.6:0/3440151648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0d0c070180 con 0x7f0d0c0aeb40 2023-07-21T22:38:48.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.432+0000 7f0d037fe640 1 -- 172.21.15.6:0/3440151648 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v145) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0d0c070180 con 0x7f0d0c0aeb40 2023-07-21T22:38:48.476 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:38:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.432+0000 7f0d1169c640 1 -- 172.21.15.6:0/3440151648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d0c0aeb40 msgr2=0x7f0d0c0b3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.432+0000 7f0d1169c640 1 --2- 172.21.15.6:0/3440151648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d0c0aeb40 0x7f0d0c0b3980 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00c4d0 tx=0x7f0cfc00c990 comp rx=0 tx=0).stop 2023-07-21T22:38:48.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.432+0000 7f0d1169c640 1 -- 172.21.15.6:0/3440151648 shutdown_connections 2023-07-21T22:38:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.432+0000 7f0d1169c640 1 --2- 172.21.15.6:0/3440151648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d0c15cef0 0x7f0d0c0b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.432+0000 7f0d1169c640 1 --2- 172.21.15.6:0/3440151648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0d0c159270 0x7f0d0c14e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.432+0000 7f0d1169c640 1 --2- 172.21.15.6:0/3440151648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d0c0aeb40 0x7f0d0c0b3980 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.432+0000 7f0d1169c640 1 -- 172.21.15.6:0/3440151648 >> 172.21.15.6:0/3440151648 conn(0x7f0d0c0cde90 msgr2=0x7f0d0c0cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:48.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.432+0000 7f0d1169c640 1 -- 172.21.15.6:0/3440151648 shutdown_connections 2023-07-21T22:38:48.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.432+0000 7f0d1169c640 1 -- 172.21.15.6:0/3440151648 wait complete. 2023-07-21T22:38:48.497 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:38:48.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.600+0000 7f99c2196640 1 Processor -- start 2023-07-21T22:38:48.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.600+0000 7f99c2196640 1 -- start start 2023-07-21T22:38:48.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.600+0000 7f99c2196640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f99bc0cf2e0 0x7f99bc0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:48.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.600+0000 7f99c2196640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f99bc0ca790 0x7f99bc0cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:48.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.600+0000 7f99c2196640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0d0920 con 0x7f99bc06a540 2023-07-21T22:38:48.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.600+0000 7f99c2196640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc15bfd0 con 0x7f99bc0ca790 2023-07-21T22:38:48.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.600+0000 7f99c2196640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc0cfd10 con 0x7f99bc0cf2e0 2023-07-21T22:38:48.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.604+0000 7f99bb7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f99bc06a540 0x7f99bc06a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41420/0 (socket says 172.21.15.6:41420) 2023-07-21T22:38:48.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.604+0000 7f99bb7fe640 1 -- 172.21.15.6:0/2827514705 learned_addr learned my addr 172.21.15.6:0/2827514705 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:48.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.604+0000 7f99bbfff640 1 --2- 172.21.15.6:0/2827514705 >> v2:172.21.15.6:3300/0 conn(0x7f99bc0ca790 0x7f99bc0cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:48.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.604+0000 7f99baffd640 1 --2- 172.21.15.6:0/2827514705 >> v2:172.21.15.161:3300/0 conn(0x7f99bc0cf2e0 0x7f99bc0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:48.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.604+0000 7f99ba7fc640 1 -- 172.21.15.6:0/2827514705 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637318993 0 0) 0x7f99bc0d0920 con 0x7f99bc06a540 2023-07-21T22:38:48.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.604+0000 7f99ba7fc640 1 -- 172.21.15.6:0/2827514705 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99a4003530 con 0x7f99bc06a540 2023-07-21T22:38:48.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.604+0000 7f99bbfff640 1 -- 172.21.15.6:0/2827514705 >> v2:172.21.15.161:3300/0 conn(0x7f99bc0cf2e0 msgr2=0x7f99bc0cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:48.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.604+0000 7f99bbfff640 1 --2- 172.21.15.6:0/2827514705 >> v2:172.21.15.161:3300/0 conn(0x7f99bc0cf2e0 0x7f99bc0cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.604+0000 7f99bbfff640 1 -- 172.21.15.6:0/2827514705 >> v1:172.21.15.6:6789/0 conn(0x7f99bc06a540 legacy=0x7f99bc06a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:48.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.604+0000 7f99bbfff640 1 -- 172.21.15.6:0/2827514705 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0cfff0 con 0x7f99bc0ca790 2023-07-21T22:38:48.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.604+0000 7f99bbfff640 1 --2- 172.21.15.6:0/2827514705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99bc0ca790 0x7f99bc0cac30 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009d90 tx=0x7f99b401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0368996b82f8120 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:48.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.604+0000 7f99ba7fc640 1 -- 172.21.15.6:0/2827514705 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40a59a0 con 0x7f99bc0ca790 2023-07-21T22:38:48.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.604+0000 7f99ba7fc640 1 -- 172.21.15.6:0/2827514705 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b40a5b00 con 0x7f99bc0ca790 2023-07-21T22:38:48.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.604+0000 7f99ba7fc640 1 -- 172.21.15.6:0/2827514705 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40a5e70 con 0x7f99bc0ca790 2023-07-21T22:38:48.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99c2196640 1 -- 172.21.15.6:0/2827514705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99bc0ca790 msgr2=0x7f99bc0cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:48.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99c2196640 1 --2- 172.21.15.6:0/2827514705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99bc0ca790 0x7f99bc0cac30 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009d90 tx=0x7f99b401c8e0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99c2196640 1 -- 172.21.15.6:0/2827514705 shutdown_connections 2023-07-21T22:38:48.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99c2196640 1 --2- 172.21.15.6:0/2827514705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99bc0ca790 0x7f99bc0cac30 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99c2196640 1 --2- 172.21.15.6:0/2827514705 >> v2:172.21.15.161:3300/0 conn(0x7f99bc0cf2e0 0x7f99bc0cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99c2196640 1 -- 172.21.15.6:0/2827514705 >> 172.21.15.6:0/2827514705 conn(0x7f99bc099490 msgr2=0x7f99bc089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:48.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99c2196640 1 -- 172.21.15.6:0/2827514705 shutdown_connections 2023-07-21T22:38:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99c2196640 1 -- 172.21.15.6:0/2827514705 wait complete. 2023-07-21T22:38:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99c2196640 1 Processor -- start 2023-07-21T22:38:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99c2196640 1 -- start start 2023-07-21T22:38:48.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99c2196640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99bc06a540 0x7f99bc14f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:48.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99c2196640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99bc0ca790 0x7f99bc152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:48.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99c2196640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99bc0cf2e0 0x7f99bc0b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:48.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99c2196640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc152260 con 0x7f99bc06a540 2023-07-21T22:38:48.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99c2196640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0add40 con 0x7f99bc0cf2e0 2023-07-21T22:38:48.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99c2196640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0ae020 con 0x7f99bc0ca790 2023-07-21T22:38:48.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99bb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99bc06a540 0x7f99bc14f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:48.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99bb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99bc06a540 0x7f99bc14f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43704/0 (socket says 172.21.15.6:43704) 2023-07-21T22:38:48.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99bb7fe640 1 -- 172.21.15.6:0/796846976 learned_addr learned my addr 172.21.15.6:0/796846976 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:48.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99baffd640 1 --2- 172.21.15.6:0/796846976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99bc0ca790 0x7f99bc152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:48.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99bbfff640 1 --2- 172.21.15.6:0/796846976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99bc0cf2e0 0x7f99bc0b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:48.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99bb7fe640 1 -- 172.21.15.6:0/796846976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99bc0ca790 msgr2=0x7f99bc152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:48.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99bb7fe640 1 --2- 172.21.15.6:0/796846976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99bc0ca790 0x7f99bc152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99bb7fe640 1 -- 172.21.15.6:0/796846976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99bc0cf2e0 msgr2=0x7f99bc0b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:48.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99bb7fe640 1 --2- 172.21.15.6:0/796846976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99bc0cf2e0 0x7f99bc0b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.608+0000 7f99bb7fe640 1 -- 172.21.15.6:0/796846976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b4009a70 con 0x7f99bc06a540 2023-07-21T22:38:48.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.612+0000 7f99bb7fe640 1 --2- 172.21.15.6:0/796846976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99bc06a540 0x7f99bc14f0e0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00c420 tx=0x7f99ac00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:48.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.612+0000 7f99a3fff640 1 -- 172.21.15.6:0/796846976 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac005cf0 con 0x7f99bc06a540 2023-07-21T22:38:48.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.612+0000 7f99a3fff640 1 -- 172.21.15.6:0/796846976 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac005e50 con 0x7f99bc06a540 2023-07-21T22:38:48.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.612+0000 7f99a3fff640 1 -- 172.21.15.6:0/796846976 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0072d0 con 0x7f99bc06a540 2023-07-21T22:38:48.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.612+0000 7f99c2196640 1 -- 172.21.15.6:0/796846976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc1524b0 con 0x7f99bc06a540 2023-07-21T22:38:48.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.612+0000 7f99c2196640 1 -- 172.21.15.6:0/796846976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc0b1370 con 0x7f99bc06a540 2023-07-21T22:38:48.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.612+0000 7f99c2196640 1 -- 172.21.15.6:0/796846976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99bc0678d0 con 0x7f99bc06a540 2023-07-21T22:38:48.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.612+0000 7f99a3fff640 1 -- 172.21.15.6:0/796846976 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 64) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f99ac007430 con 0x7f99bc06a540 2023-07-21T22:38:48.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.612+0000 7f99a3fff640 1 -- 172.21.15.6:0/796846976 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6865+0+0 (secure 0 0 0) 0x7f99ac0830b0 con 0x7f99bc06a540 2023-07-21T22:38:48.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.616+0000 7f99a3fff640 1 -- 172.21.15.6:0/796846976 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99ac050610 con 0x7f99bc06a540 2023-07-21T22:38:48.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.672+0000 7f99a3fff640 1 -- 172.21.15.6:0/796846976 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 65) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f99ac0500c0 con 0x7f99bc06a540 2023-07-21T22:38:48.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.672+0000 7f99a3fff640 1 --2- 172.21.15.6:0/796846976 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f99a806c180 0x7f99a806e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:48.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.672+0000 7f99baffd640 1 --2- 172.21.15.6:0/796846976 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f99a806c180 0x7f99a806e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:48.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.672+0000 7f99baffd640 1 --2- 172.21.15.6:0/796846976 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f99a806c180 0x7f99a806e560 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f99bc1f7a90 tx=0x7f99b0009190 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:48.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.776+0000 7f99c2196640 1 -- 172.21.15.6:0/796846976 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99bc152960 con 0x7f99bc06a540 2023-07-21T22:38:48.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.776+0000 7f99a3fff640 1 -- 172.21.15.6:0/796846976 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v145) v1 ==== 100+0+11 (secure 0 0 0) 0x7f99ac0704a0 con 0x7f99bc06a540 2023-07-21T22:38:48.821 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:38:48.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.776+0000 7f99c2196640 1 -- 172.21.15.6:0/796846976 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f99a806c180 msgr2=0x7f99a806e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:48.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.776+0000 7f99c2196640 1 --2- 172.21.15.6:0/796846976 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f99a806c180 0x7f99a806e560 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f99bc1f7a90 tx=0x7f99b0009190 comp rx=0 tx=0).stop 2023-07-21T22:38:48.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.776+0000 7f99c2196640 1 -- 172.21.15.6:0/796846976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99bc06a540 msgr2=0x7f99bc14f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:48.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.776+0000 7f99c2196640 1 --2- 172.21.15.6:0/796846976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99bc06a540 0x7f99bc14f0e0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00c420 tx=0x7f99ac00c8e0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.776+0000 7f99c2196640 1 -- 172.21.15.6:0/796846976 shutdown_connections 2023-07-21T22:38:48.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.776+0000 7f99c2196640 1 --2- 172.21.15.6:0/796846976 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f99a806c180 0x7f99a806e560 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.776+0000 7f99c2196640 1 --2- 172.21.15.6:0/796846976 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99bc0cf2e0 0x7f99bc0b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.776+0000 7f99c2196640 1 --2- 172.21.15.6:0/796846976 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99bc0ca790 0x7f99bc152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.776+0000 7f99c2196640 1 --2- 172.21.15.6:0/796846976 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99bc06a540 0x7f99bc14f0e0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.776+0000 7f99c2196640 1 -- 172.21.15.6:0/796846976 >> 172.21.15.6:0/796846976 conn(0x7f99bc099490 msgr2=0x7f99bc06a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:48.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.776+0000 7f99c2196640 1 -- 172.21.15.6:0/796846976 shutdown_connections 2023-07-21T22:38:48.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.776+0000 7f99c2196640 1 -- 172.21.15.6:0/796846976 wait complete. 2023-07-21T22:38:48.842 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:38:48.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.944+0000 7f031fa48640 1 Processor -- start 2023-07-21T22:38:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.944+0000 7f031fa48640 1 -- start start 2023-07-21T22:38:48.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.944+0000 7f031fa48640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0318158ce0 0x7f0318070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:48.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.944+0000 7f031fa48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03180c9730 0x7f03180ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:48.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.944+0000 7f031fa48640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03180cc700 con 0x7f03180c8ad0 2023-07-21T22:38:48.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.944+0000 7f031fa48640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03180b0ff0 con 0x7f0318158ce0 2023-07-21T22:38:48.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.944+0000 7f031fa48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0318070c80 con 0x7f03180c9730 2023-07-21T22:38:48.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.944+0000 7f031d7e4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0318158ce0 0x7f0318070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:48.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.944+0000 7f031dfe5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03180c9730 0x7f03180ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:48.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.944+0000 7f031d7e4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0318158ce0 0x7f0318070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:43920/0 (socket says 172.21.15.6:43920) 2023-07-21T22:38:48.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.944+0000 7f031d7e4640 1 -- 172.21.15.6:0/889597530 learned_addr learned my addr 172.21.15.6:0/889597530 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.944+0000 7f031d7e4640 1 -- 172.21.15.6:0/889597530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03180c9730 msgr2=0x7f03180ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.944+0000 7f031d7e4640 1 --2- 172.21.15.6:0/889597530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03180c9730 0x7f03180ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.944+0000 7f031d7e4640 1 -- 172.21.15.6:0/889597530 >> v1:172.21.15.161:6789/0 conn(0x7f03180c8ad0 legacy=0x7f03180c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.944+0000 7f031d7e4640 1 -- 172.21.15.6:0/889597530 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03180cbdd0 con 0x7f0318158ce0 2023-07-21T22:38:48.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.948+0000 7f031d7e4640 1 --2- 172.21.15.6:0/889597530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0318158ce0 0x7f0318070450 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f031400bb10 tx=0x7f031401eac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c367efa6abc38af server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:48.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.948+0000 7f030ffff640 1 -- 172.21.15.6:0/889597530 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03140a7aa0 con 0x7f0318158ce0 2023-07-21T22:38:48.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.948+0000 7f030ffff640 1 -- 172.21.15.6:0/889597530 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03140a7c00 con 0x7f0318158ce0 2023-07-21T22:38:48.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.948+0000 7f030ffff640 1 -- 172.21.15.6:0/889597530 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03140af440 con 0x7f0318158ce0 2023-07-21T22:38:48.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.948+0000 7f031fa48640 1 -- 172.21.15.6:0/889597530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0318158ce0 msgr2=0x7f0318070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:48.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.948+0000 7f031fa48640 1 --2- 172.21.15.6:0/889597530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0318158ce0 0x7f0318070450 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f031400bb10 tx=0x7f031401eac0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.948+0000 7f031fa48640 1 -- 172.21.15.6:0/889597530 shutdown_connections 2023-07-21T22:38:48.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.948+0000 7f031fa48640 1 --2- 172.21.15.6:0/889597530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03180c9730 0x7f03180ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.948+0000 7f031fa48640 1 --2- 172.21.15.6:0/889597530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0318158ce0 0x7f0318070450 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:48.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.948+0000 7f031fa48640 1 -- 172.21.15.6:0/889597530 >> 172.21.15.6:0/889597530 conn(0x7f03180afcf0 msgr2=0x7f03180b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:48.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.948+0000 7f031fa48640 1 -- 172.21.15.6:0/889597530 shutdown_connections 2023-07-21T22:38:48.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.948+0000 7f031fa48640 1 -- 172.21.15.6:0/889597530 wait complete. 2023-07-21T22:38:48.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.952+0000 7f031fa48640 1 Processor -- start 2023-07-21T22:38:48.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.952+0000 7f031fa48640 1 -- start start 2023-07-21T22:38:49.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.952+0000 7f031fa48640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03180c8ad0 0x7f03180c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:49.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.952+0000 7f031fa48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03180c9730 0x7f031815a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:49.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.952+0000 7f031fa48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0318158ce0 0x7f031814ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:49.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.952+0000 7f031fa48640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031815b560 con 0x7f0318158ce0 2023-07-21T22:38:49.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.952+0000 7f031fa48640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031815a950 con 0x7f03180c8ad0 2023-07-21T22:38:49.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.952+0000 7f031fa48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031815ac30 con 0x7f03180c9730 2023-07-21T22:38:49.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.952+0000 7f031d7e4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03180c8ad0 0x7f03180c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:49.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.952+0000 7f031dfe5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0318158ce0 0x7f031814ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:49.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.952+0000 7f031d7e4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03180c8ad0 0x7f03180c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:43930/0 (socket says 172.21.15.6:43930) 2023-07-21T22:38:49.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.952+0000 7f031d7e4640 1 -- 172.21.15.6:0/1650008536 learned_addr learned my addr 172.21.15.6:0/1650008536 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:49.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.952+0000 7f031cfe3640 1 --2- 172.21.15.6:0/1650008536 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03180c9730 0x7f031815a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:49.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.952+0000 7f031d7e4640 1 -- 172.21.15.6:0/1650008536 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03180c9730 msgr2=0x7f031815a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:49.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.952+0000 7f031d7e4640 1 --2- 172.21.15.6:0/1650008536 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03180c9730 0x7f031815a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.952+0000 7f031d7e4640 1 -- 172.21.15.6:0/1650008536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0318158ce0 msgr2=0x7f031814ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:49.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.952+0000 7f031d7e4640 1 --2- 172.21.15.6:0/1650008536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0318158ce0 0x7f031814ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.952+0000 7f031d7e4640 1 -- 172.21.15.6:0/1650008536 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031400b770 con 0x7f03180c8ad0 2023-07-21T22:38:49.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.952+0000 7f031d7e4640 1 --2- 172.21.15.6:0/1650008536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03180c8ad0 0x7f03180c4440 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f031400b2c0 tx=0x7f031401d300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:49.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.956+0000 7f030dffb640 1 -- 172.21.15.6:0/1650008536 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03140afe30 con 0x7f03180c8ad0 2023-07-21T22:38:49.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.956+0000 7f030dffb640 1 -- 172.21.15.6:0/1650008536 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03140ba480 con 0x7f03180c8ad0 2023-07-21T22:38:49.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.956+0000 7f030dffb640 1 -- 172.21.15.6:0/1650008536 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03140ba830 con 0x7f03180c8ad0 2023-07-21T22:38:49.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.956+0000 7f031fa48640 1 -- 172.21.15.6:0/1650008536 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f031815af10 con 0x7f03180c8ad0 2023-07-21T22:38:49.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.956+0000 7f031fa48640 1 -- 172.21.15.6:0/1650008536 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f031814b1b0 con 0x7f03180c8ad0 2023-07-21T22:38:49.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.956+0000 7f031fa48640 1 -- 172.21.15.6:0/1650008536 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03180ca1a0 con 0x7f03180c8ad0 2023-07-21T22:38:49.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.956+0000 7f030dffb640 1 -- 172.21.15.6:0/1650008536 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 65) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f03140ba990 con 0x7f03180c8ad0 2023-07-21T22:38:49.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.956+0000 7f030dffb640 1 --2- 172.21.15.6:0/1650008536 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f02fc0660d0 0x7f02fc068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:49.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.956+0000 7f030dffb640 1 -- 172.21.15.6:0/1650008536 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6865+0+0 (secure 0 0 0) 0x7f031411f1a0 con 0x7f03180c8ad0 2023-07-21T22:38:49.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.956+0000 7f031cfe3640 1 --2- 172.21.15.6:0/1650008536 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f02fc0660d0 0x7f02fc068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:49.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.960+0000 7f031cfe3640 1 --2- 172.21.15.6:0/1650008536 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f02fc0660d0 0x7f02fc068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f03181f7850 tx=0x7f0308009040 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:49.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:48.960+0000 7f030dffb640 1 -- 172.21.15.6:0/1650008536 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f03140ec610 con 0x7f03180c8ad0 2023-07-21T22:38:49.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.152+0000 7f031fa48640 1 -- 172.21.15.6:0/1650008536 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03180678d0 con 0x7f03180c8ad0 2023-07-21T22:38:49.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.152+0000 7f030dffb640 1 -- 172.21.15.6:0/1650008536 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4664 (secure 0 0 0) 0x7f03140b4090 con 0x7f03180c8ad0 2023-07-21T22:38:49.197 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:49.197 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1816246921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1816246921},{"type":"v1","addr":"172.21.15.6:6834","nonce":1816246921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7490,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/543588806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":543588806},{"type":"v1","addr":"172.21.15.6:6835","nonce":543588806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3250690150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3250690150},{"type":"v1","addr":"172.21.15.161:6836","nonce":3250690150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:38:23.444629+0000","modified":"2023-07-21T22:38:27.099144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8455":{"gid":8455,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/29499426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":29499426},{"type":"v1","addr":"172.21.15.161:6837","nonce":29499426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-21T22:38:49.198 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 62 2023-07-21T22:38:49.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.156+0000 7f031fa48640 1 -- 172.21.15.6:0/1650008536 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f02fc0660d0 msgr2=0x7f02fc068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:49.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.156+0000 7f031fa48640 1 --2- 172.21.15.6:0/1650008536 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f02fc0660d0 0x7f02fc068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f03181f7850 tx=0x7f0308009040 comp rx=0 tx=0).stop 2023-07-21T22:38:49.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.156+0000 7f031fa48640 1 -- 172.21.15.6:0/1650008536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03180c8ad0 msgr2=0x7f03180c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:49.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.156+0000 7f031fa48640 1 --2- 172.21.15.6:0/1650008536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03180c8ad0 0x7f03180c4440 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f031400b2c0 tx=0x7f031401d300 comp rx=0 tx=0).stop 2023-07-21T22:38:49.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.156+0000 7f031fa48640 1 -- 172.21.15.6:0/1650008536 shutdown_connections 2023-07-21T22:38:49.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.156+0000 7f031fa48640 1 --2- 172.21.15.6:0/1650008536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0318158ce0 0x7f031814ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.156+0000 7f031fa48640 1 --2- 172.21.15.6:0/1650008536 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f03180c9730 0x7f031815a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.156+0000 7f031fa48640 1 --2- 172.21.15.6:0/1650008536 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f02fc0660d0 0x7f02fc068580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.156+0000 7f031fa48640 1 --2- 172.21.15.6:0/1650008536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03180c8ad0 0x7f03180c4440 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.156+0000 7f031fa48640 1 -- 172.21.15.6:0/1650008536 >> 172.21.15.6:0/1650008536 conn(0x7f03180afcf0 msgr2=0x7f03180b1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:49.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.156+0000 7f031fa48640 1 -- 172.21.15.6:0/1650008536 shutdown_connections 2023-07-21T22:38:49.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.156+0000 7f031fa48640 1 -- 172.21.15.6:0/1650008536 wait complete. 2023-07-21T22:38:49.219 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:38:49.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.316+0000 7fa88405c640 1 Processor -- start 2023-07-21T22:38:49.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.316+0000 7fa88405c640 1 -- start start 2023-07-21T22:38:49.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.320+0000 7fa88405c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa87c0d1850 0x7fa87c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:49.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.320+0000 7fa88405c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87c0ccaf0 con 0x7fa87c15fd60 2023-07-21T22:38:49.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.320+0000 7fa88405c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87c160320 con 0x7fa87c0b7c70 2023-07-21T22:38:49.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.320+0000 7fa88405c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87c0d1190 con 0x7fa87c0d1850 2023-07-21T22:38:49.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.320+0000 7fa8825f9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa87c0d1850 0x7fa87c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:49.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.320+0000 7fa8825f9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa87c0d1850 0x7fa87c0d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43718/0 (socket says 172.21.15.6:43718) 2023-07-21T22:38:49.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.320+0000 7fa8825f9640 1 -- 172.21.15.6:0/161803767 learned_addr learned my addr 172.21.15.6:0/161803767 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:49.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.320+0000 7fa8825f9640 1 -- 172.21.15.6:0/161803767 >> v1:172.21.15.161:6789/0 conn(0x7fa87c0b7c70 legacy=0x7fa87c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:49.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.320+0000 7fa8825f9640 1 -- 172.21.15.6:0/161803767 >> v1:172.21.15.6:6789/0 conn(0x7fa87c15fd60 legacy=0x7fa87c0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:49.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.320+0000 7fa8825f9640 1 -- 172.21.15.6:0/161803767 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c0ccd90 con 0x7fa87c0d1850 2023-07-21T22:38:49.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.324+0000 7fa8825f9640 1 --2- 172.21.15.6:0/161803767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa87c0d1850 0x7fa87c0d0c50 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fa874009e50 tx=0x7fa87401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=812ed062cc2cf406 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:49.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.324+0000 7fa880df6640 1 -- 172.21.15.6:0/161803767 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8740a57f0 con 0x7fa87c0d1850 2023-07-21T22:38:49.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.324+0000 7fa880df6640 1 -- 172.21.15.6:0/161803767 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8740a5950 con 0x7fa87c0d1850 2023-07-21T22:38:49.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.324+0000 7fa880df6640 1 -- 172.21.15.6:0/161803767 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8740a5ce0 con 0x7fa87c0d1850 2023-07-21T22:38:49.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.324+0000 7fa88405c640 1 -- 172.21.15.6:0/161803767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa87c0d1850 msgr2=0x7fa87c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:49.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.324+0000 7fa88405c640 1 --2- 172.21.15.6:0/161803767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa87c0d1850 0x7fa87c0d0c50 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fa874009e50 tx=0x7fa87401ca10 comp rx=0 tx=0).stop 2023-07-21T22:38:49.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.324+0000 7fa88405c640 1 -- 172.21.15.6:0/161803767 shutdown_connections 2023-07-21T22:38:49.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.324+0000 7fa88405c640 1 --2- 172.21.15.6:0/161803767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa87c0d1850 0x7fa87c0d0c50 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.324+0000 7fa88405c640 1 -- 172.21.15.6:0/161803767 >> 172.21.15.6:0/161803767 conn(0x7fa87c0650b0 msgr2=0x7fa87c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:49.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.324+0000 7fa88405c640 1 -- 172.21.15.6:0/161803767 shutdown_connections 2023-07-21T22:38:49.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.324+0000 7fa88405c640 1 -- 172.21.15.6:0/161803767 wait complete. 2023-07-21T22:38:49.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.324+0000 7fa88405c640 1 Processor -- start 2023-07-21T22:38:49.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.324+0000 7fa88405c640 1 -- start start 2023-07-21T22:38:49.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa88405c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa87c0b7c70 0x7fa87c1558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:49.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa88405c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa87c0d1850 0x7fa87c14cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:49.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa88405c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa87c15fd60 0x7fa87c0c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:49.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa88405c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c155df0 con 0x7fa87c0b7c70 2023-07-21T22:38:49.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa88405c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c14f240 con 0x7fa87c15fd60 2023-07-21T22:38:49.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa88405c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c14d110 con 0x7fa87c0d1850 2023-07-21T22:38:49.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa881df8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa87c0b7c70 0x7fa87c1558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:49.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa881df8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa87c0b7c70 0x7fa87c1558b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43726/0 (socket says 172.21.15.6:43726) 2023-07-21T22:38:49.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa881df8640 1 -- 172.21.15.6:0/4215023261 learned_addr learned my addr 172.21.15.6:0/4215023261 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:49.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa8815f7640 1 --2- 172.21.15.6:0/4215023261 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa87c0d1850 0x7fa87c14cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:49.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa8825f9640 1 --2- 172.21.15.6:0/4215023261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa87c15fd60 0x7fa87c0c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:49.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa881df8640 1 -- 172.21.15.6:0/4215023261 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa87c0d1850 msgr2=0x7fa87c14cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:49.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa881df8640 1 --2- 172.21.15.6:0/4215023261 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa87c0d1850 0x7fa87c14cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa881df8640 1 -- 172.21.15.6:0/4215023261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa87c15fd60 msgr2=0x7fa87c0c6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:49.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa881df8640 1 --2- 172.21.15.6:0/4215023261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa87c15fd60 0x7fa87c0c6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa881df8640 1 -- 172.21.15.6:0/4215023261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa874009b30 con 0x7fa87c0b7c70 2023-07-21T22:38:49.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa881df8640 1 --2- 172.21.15.6:0/4215023261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa87c0b7c70 0x7fa87c1558b0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fa87800c3c0 tx=0x7fa87800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:49.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa8727fc640 1 -- 172.21.15.6:0/4215023261 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780052d0 con 0x7fa87c0b7c70 2023-07-21T22:38:49.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa8727fc640 1 -- 172.21.15.6:0/4215023261 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa878005430 con 0x7fa87c0b7c70 2023-07-21T22:38:49.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa8727fc640 1 -- 172.21.15.6:0/4215023261 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa878003840 con 0x7fa87c0b7c70 2023-07-21T22:38:49.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa88405c640 1 -- 172.21.15.6:0/4215023261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87c14e630 con 0x7fa87c0b7c70 2023-07-21T22:38:49.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa88405c640 1 -- 172.21.15.6:0/4215023261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87c14ebf0 con 0x7fa87c0b7c70 2023-07-21T22:38:49.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa88405c640 1 -- 172.21.15.6:0/4215023261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87c0b3c20 con 0x7fa87c0b7c70 2023-07-21T22:38:49.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.328+0000 7fa8727fc640 1 -- 172.21.15.6:0/4215023261 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 65) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fa8780039a0 con 0x7fa87c0b7c70 2023-07-21T22:38:49.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.332+0000 7fa8727fc640 1 --2- 172.21.15.6:0/4215023261 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fa8600660d0 0x7fa860068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:49.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.332+0000 7fa8727fc640 1 -- 172.21.15.6:0/4215023261 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6865+0+0 (secure 0 0 0) 0x7fa8780831c0 con 0x7fa87c0b7c70 2023-07-21T22:38:49.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.332+0000 7fa8815f7640 1 --2- 172.21.15.6:0/4215023261 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fa8600660d0 0x7fa860068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:49.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.332+0000 7fa8815f7640 1 --2- 172.21.15.6:0/4215023261 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fa8600660d0 0x7fa860068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa87c151610 tx=0x7fa86c009040 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:49.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.336+0000 7fa8727fc640 1 -- 172.21.15.6:0/4215023261 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa878050630 con 0x7fa87c0b7c70 2023-07-21T22:38:49.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.492+0000 7fa88405c640 1 -- 172.21.15.6:0/4215023261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa87c0678d0 con 0x7fa87c0b7c70 2023-07-21T22:38:49.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.492+0000 7fa8727fc640 1 -- 172.21.15.6:0/4215023261 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+19484 (secure 0 0 0) 0x7fa878053c50 con 0x7fa87c0b7c70 2023-07-21T22:38:49.537 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:49.537 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":145,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:38:47.662227+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:38:21.546383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-21T22:38:22.445128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:6833/3543285241":"2023-07-22T22:38:47.662173+0000","172.21.15.161:0/2044622308":"2023-07-22T22:38:47.662173+0000","172.21.15.161:0/1527327696":"2023-07-22T22:38:47.662173+0000","172.21.15.161:0/2947691815":"2023-07-22T22:38:47.662173+0000","172.21.15.161:0/2306363155":"2023-07-22T22:38:47.662173+0000","172.21.15.161:0/611533009":"2023-07-22T22:38:40.645781+0000","172.21.15.161:6833/3436422767":"2023-07-22T22:38:40.645781+0000","172.21.15.161:6832/3543285241":"2023-07-22T22:38:47.662173+0000","172.21.15.161:0/1711122631":"2023-07-22T22:38:47.662173+0000","172.21.15.161:0/3113062624":"2023-07-22T22:38:40.645781+0000","172.21.15.161:6832/3436422767":"2023-07-22T22:38:40.645781+0000","172.21.15.161:0/3716131790":"2023-07-22T22:38:47.662173+0000","172.21.15.161:0/2051512394":"2023-07-22T22:38:40.645781+0000","172.21.15.161:0/3807620529":"2023-07-22T22:38:47.662173+0000","172.21.15.161:0/747215894":"2023-07-22T22:38:40.645781+0000","172.21.15.161:0/3161426051":"2023-07-22T22:38:40.645781+0000","172.21.15.161:0/3783651589":"2023-07-22T22:38:40.645781+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:38:49.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.492+0000 7fa88405c640 1 -- 172.21.15.6:0/4215023261 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fa8600660d0 msgr2=0x7fa860068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:49.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.492+0000 7fa88405c640 1 --2- 172.21.15.6:0/4215023261 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fa8600660d0 0x7fa860068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa87c151610 tx=0x7fa86c009040 comp rx=0 tx=0).stop 2023-07-21T22:38:49.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.492+0000 7fa88405c640 1 -- 172.21.15.6:0/4215023261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa87c0b7c70 msgr2=0x7fa87c1558b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:49.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.492+0000 7fa88405c640 1 --2- 172.21.15.6:0/4215023261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa87c0b7c70 0x7fa87c1558b0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fa87800c3c0 tx=0x7fa87800c880 comp rx=0 tx=0).stop 2023-07-21T22:38:49.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.492+0000 7fa88405c640 1 -- 172.21.15.6:0/4215023261 shutdown_connections 2023-07-21T22:38:49.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.492+0000 7fa88405c640 1 --2- 172.21.15.6:0/4215023261 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fa8600660d0 0x7fa860068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.492+0000 7fa88405c640 1 --2- 172.21.15.6:0/4215023261 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa87c15fd60 0x7fa87c0c6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.492+0000 7fa88405c640 1 --2- 172.21.15.6:0/4215023261 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa87c0d1850 0x7fa87c14cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.492+0000 7fa88405c640 1 --2- 172.21.15.6:0/4215023261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa87c0b7c70 0x7fa87c1558b0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.492+0000 7fa88405c640 1 -- 172.21.15.6:0/4215023261 >> 172.21.15.6:0/4215023261 conn(0x7fa87c0650b0 msgr2=0x7fa87c0cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:49.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.492+0000 7fa88405c640 1 -- 172.21.15.6:0/4215023261 shutdown_connections 2023-07-21T22:38:49.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.492+0000 7fa88405c640 1 -- 172.21.15.6:0/4215023261 wait complete. 2023-07-21T22:38:49.558 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-21T22:38:49.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:38:49.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.656+0000 7fc91d093640 1 Processor -- start 2023-07-21T22:38:49.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.656+0000 7fc91d093640 1 -- start start 2023-07-21T22:38:49.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.660+0000 7fc91d093640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc91815f500 0x7fc91806cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:49.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.660+0000 7fc91d093640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc91806d430 0x7fc91806a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:49.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.660+0000 7fc91d093640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9180cdc80 con 0x7fc91806aa80 2023-07-21T22:38:49.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.660+0000 7fc91d093640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91806af00 con 0x7fc91806d430 2023-07-21T22:38:49.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.660+0000 7fc91d093640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91806e4c0 con 0x7fc91815f500 2023-07-21T22:38:49.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.660+0000 7fc90ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc91806d430 0x7fc91806a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:49.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.660+0000 7fc90ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc91806d430 0x7fc91806a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43732/0 (socket says 172.21.15.6:43732) 2023-07-21T22:38:49.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.660+0000 7fc90ffff640 1 -- 172.21.15.6:0/2680729060 learned_addr learned my addr 172.21.15.6:0/2680729060 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:49.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.660+0000 7fc916d9d640 1 --2- 172.21.15.6:0/2680729060 >> v2:172.21.15.161:3300/0 conn(0x7fc91815f500 0x7fc91806cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:49.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.660+0000 7fc90ffff640 1 -- 172.21.15.6:0/2680729060 >> v2:172.21.15.161:3300/0 conn(0x7fc91815f500 msgr2=0x7fc91806cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:49.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.660+0000 7fc90ffff640 1 --2- 172.21.15.6:0/2680729060 >> v2:172.21.15.161:3300/0 conn(0x7fc91815f500 0x7fc91806cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.660+0000 7fc90ffff640 1 -- 172.21.15.6:0/2680729060 >> v1:172.21.15.161:6789/0 conn(0x7fc91806aa80 legacy=0x7fc9180b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:49.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.660+0000 7fc90ffff640 1 -- 172.21.15.6:0/2680729060 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91806d940 con 0x7fc91806d430 2023-07-21T22:38:49.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.664+0000 7fc90ffff640 1 --2- 172.21.15.6:0/2680729060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc91806d430 0x7fc91806a540 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fc9180b2c40 tx=0x7fc90001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bab2dc1d7e7472d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:49.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.664+0000 7fc91659c640 1 -- 172.21.15.6:0/2680729060 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9000ab5f0 con 0x7fc91806d430 2023-07-21T22:38:49.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.664+0000 7fc91659c640 1 -- 172.21.15.6:0/2680729060 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9000ab750 con 0x7fc91806d430 2023-07-21T22:38:49.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.664+0000 7fc91659c640 1 -- 172.21.15.6:0/2680729060 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9000abae0 con 0x7fc91806d430 2023-07-21T22:38:49.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.664+0000 7fc91d093640 1 -- 172.21.15.6:0/2680729060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc91806d430 msgr2=0x7fc91806a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:49.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.664+0000 7fc91d093640 1 --2- 172.21.15.6:0/2680729060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc91806d430 0x7fc91806a540 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fc9180b2c40 tx=0x7fc90001c500 comp rx=0 tx=0).stop 2023-07-21T22:38:49.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.664+0000 7fc91d093640 1 -- 172.21.15.6:0/2680729060 shutdown_connections 2023-07-21T22:38:49.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.664+0000 7fc91d093640 1 --2- 172.21.15.6:0/2680729060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc91806d430 0x7fc91806a540 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.664+0000 7fc91d093640 1 --2- 172.21.15.6:0/2680729060 >> v2:172.21.15.161:3300/0 conn(0x7fc91815f500 0x7fc91806cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.664+0000 7fc91d093640 1 -- 172.21.15.6:0/2680729060 >> 172.21.15.6:0/2680729060 conn(0x7fc9180659d0 msgr2=0x7fc918099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:49.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.664+0000 7fc91d093640 1 -- 172.21.15.6:0/2680729060 shutdown_connections 2023-07-21T22:38:49.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.664+0000 7fc91d093640 1 -- 172.21.15.6:0/2680729060 wait complete. 2023-07-21T22:38:49.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.664+0000 7fc91d093640 1 Processor -- start 2023-07-21T22:38:49.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.664+0000 7fc91d093640 1 -- start start 2023-07-21T22:38:49.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc91d093640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc91806aa80 0x7fc91814c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:49.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc91d093640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc91806d430 0x7fc91814b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:49.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc91d093640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc91815f500 0x7fc918156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:49.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc91d093640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180b14c0 con 0x7fc91815f500 2023-07-21T22:38:49.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc91d093640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc918150e70 con 0x7fc91806d430 2023-07-21T22:38:49.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc91d093640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9180b0940 con 0x7fc91806aa80 2023-07-21T22:38:49.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc91759e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc91815f500 0x7fc918156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:49.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc91759e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc91815f500 0x7fc918156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43734/0 (socket says 172.21.15.6:43734) 2023-07-21T22:38:49.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc91759e640 1 -- 172.21.15.6:0/3409512367 learned_addr learned my addr 172.21.15.6:0/3409512367 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:49.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc90ffff640 1 --2- 172.21.15.6:0/3409512367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc91806d430 0x7fc91814b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:49.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc916d9d640 1 --2- 172.21.15.6:0/3409512367 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc91806aa80 0x7fc91814c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:49.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc91759e640 1 -- 172.21.15.6:0/3409512367 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc91806aa80 msgr2=0x7fc91814c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:49.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc91759e640 1 --2- 172.21.15.6:0/3409512367 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc91806aa80 0x7fc91814c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc91759e640 1 -- 172.21.15.6:0/3409512367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc91806d430 msgr2=0x7fc91814b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:49.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc91759e640 1 --2- 172.21.15.6:0/3409512367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc91806d430 0x7fc91814b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc91759e640 1 -- 172.21.15.6:0/3409512367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9000094d0 con 0x7fc91815f500 2023-07-21T22:38:49.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc91759e640 1 --2- 172.21.15.6:0/3409512367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc91815f500 0x7fc918156dd0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fc91000c770 tx=0x7fc91000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:49.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc90f7fe640 1 -- 172.21.15.6:0/3409512367 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc910003b80 con 0x7fc91815f500 2023-07-21T22:38:49.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc91d093640 1 -- 172.21.15.6:0/3409512367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9180b0b90 con 0x7fc91815f500 2023-07-21T22:38:49.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc90f7fe640 1 -- 172.21.15.6:0/3409512367 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc910003ce0 con 0x7fc91815f500 2023-07-21T22:38:49.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc90f7fe640 1 -- 172.21.15.6:0/3409512367 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91000aa90 con 0x7fc91815f500 2023-07-21T22:38:49.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc91d093640 1 -- 172.21.15.6:0/3409512367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9180b1150 con 0x7fc91815f500 2023-07-21T22:38:49.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc91d093640 1 -- 172.21.15.6:0/3409512367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc918150fe0 con 0x7fc91815f500 2023-07-21T22:38:49.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.668+0000 7fc90f7fe640 1 -- 172.21.15.6:0/3409512367 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 65) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fc91000abf0 con 0x7fc91815f500 2023-07-21T22:38:49.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.672+0000 7fc90f7fe640 1 --2- 172.21.15.6:0/3409512367 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fc8f8066100 0x7fc8f80685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:49.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.672+0000 7fc90f7fe640 1 -- 172.21.15.6:0/3409512367 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6865+0+0 (secure 0 0 0) 0x7fc910083ad0 con 0x7fc91815f500 2023-07-21T22:38:49.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.672+0000 7fc916d9d640 1 --2- 172.21.15.6:0/3409512367 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fc8f8066100 0x7fc8f80685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:49.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.672+0000 7fc916d9d640 1 --2- 172.21.15.6:0/3409512367 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fc8f8066100 0x7fc8f80685b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc908006fd0 tx=0x7fc908008040 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:49.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.676+0000 7fc90f7fe640 1 -- 172.21.15.6:0/3409512367 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc918150fe0 con 0x7fc91815f500 2023-07-21T22:38:49.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.872+0000 7fc91d093640 1 -- 172.21.15.6:0/3409512367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc918150fe0 con 0x7fc91815f500 2023-07-21T22:38:49.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.872+0000 7fc90f7fe640 1 -- 172.21.15.6:0/3409512367 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4664 (secure 0 0 0) 0x7fc918150fe0 con 0x7fc91815f500 2023-07-21T22:38:49.916 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:49.917 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1816246921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1816246921},{"type":"v1","addr":"172.21.15.6:6834","nonce":1816246921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7490,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/543588806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":543588806},{"type":"v1","addr":"172.21.15.6:6835","nonce":543588806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3250690150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3250690150},{"type":"v1","addr":"172.21.15.161:6836","nonce":3250690150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:38:23.444629+0000","modified":"2023-07-21T22:38:27.099144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8455":{"gid":8455,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/29499426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":29499426},{"type":"v1","addr":"172.21.15.161:6837","nonce":29499426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-21T22:38:49.917 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 62 2023-07-21T22:38:49.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.872+0000 7fc91d093640 1 -- 172.21.15.6:0/3409512367 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fc8f8066100 msgr2=0x7fc8f80685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:49.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.872+0000 7fc91d093640 1 --2- 172.21.15.6:0/3409512367 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fc8f8066100 0x7fc8f80685b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc908006fd0 tx=0x7fc908008040 comp rx=0 tx=0).stop 2023-07-21T22:38:49.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.872+0000 7fc91d093640 1 -- 172.21.15.6:0/3409512367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc91815f500 msgr2=0x7fc918156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:49.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.872+0000 7fc91d093640 1 --2- 172.21.15.6:0/3409512367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc91815f500 0x7fc918156dd0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fc91000c770 tx=0x7fc91000cc30 comp rx=0 tx=0).stop 2023-07-21T22:38:49.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.872+0000 7fc91d093640 1 -- 172.21.15.6:0/3409512367 shutdown_connections 2023-07-21T22:38:49.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.872+0000 7fc91d093640 1 --2- 172.21.15.6:0/3409512367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc91815f500 0x7fc918156dd0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.872+0000 7fc91d093640 1 --2- 172.21.15.6:0/3409512367 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fc8f8066100 0x7fc8f80685b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.872+0000 7fc91d093640 1 --2- 172.21.15.6:0/3409512367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc91806d430 0x7fc91814b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.872+0000 7fc91d093640 1 --2- 172.21.15.6:0/3409512367 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc91806aa80 0x7fc91814c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:49.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.872+0000 7fc91d093640 1 -- 172.21.15.6:0/3409512367 >> 172.21.15.6:0/3409512367 conn(0x7fc9180659d0 msgr2=0x7fc9180ae290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:49.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.872+0000 7fc91d093640 1 -- 172.21.15.6:0/3409512367 shutdown_connections 2023-07-21T22:38:49.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:49.872+0000 7fc91d093640 1 -- 172.21.15.6:0/3409512367 wait complete. 2023-07-21T22:38:49.937 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:38:50.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.040+0000 7f1868d03640 1 Processor -- start 2023-07-21T22:38:50.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.040+0000 7f1868d03640 1 -- start start 2023-07-21T22:38:50.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.040+0000 7f1868d03640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f186406a540 0x7f186406a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:50.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.040+0000 7f1868d03640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f18640cdcd0 0x7f18640cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:50.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.040+0000 7f1868d03640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18640cc980 0x7f18640cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:50.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.040+0000 7f1868d03640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18640cef10 con 0x7f186406a540 2023-07-21T22:38:50.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.040+0000 7f1868d03640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186406ae50 con 0x7f18640cdcd0 2023-07-21T22:38:50.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.040+0000 7f1868d03640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18640cfaf0 con 0x7f18640cc980 2023-07-21T22:38:50.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.040+0000 7f186259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f186406a540 0x7f186406a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:50.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.040+0000 7f186259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f186406a540 0x7f186406a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43736/0 (socket says 172.21.15.6:43736) 2023-07-21T22:38:50.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.040+0000 7f186259c640 1 -- 172.21.15.6:0/3372323438 learned_addr learned my addr 172.21.15.6:0/3372323438 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:50.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.040+0000 7f1862d9d640 1 --2- 172.21.15.6:0/3372323438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18640cc980 0x7f18640cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:50.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.040+0000 7f185bfff640 1 --2- 172.21.15.6:0/3372323438 >> v2:172.21.15.161:3300/0 conn(0x7f18640cdcd0 0x7f18640cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:50.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.040+0000 7f186259c640 1 -- 172.21.15.6:0/3372323438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18640cc980 msgr2=0x7f18640cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:50.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.040+0000 7f186259c640 1 --2- 172.21.15.6:0/3372323438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18640cc980 0x7f18640cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.040+0000 7f186259c640 1 -- 172.21.15.6:0/3372323438 >> v2:172.21.15.161:3300/0 conn(0x7f18640cdcd0 msgr2=0x7f18640cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:50.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.040+0000 7f186259c640 1 --2- 172.21.15.6:0/3372323438 >> v2:172.21.15.161:3300/0 conn(0x7f18640cdcd0 0x7f18640cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.040+0000 7f186259c640 1 -- 172.21.15.6:0/3372323438 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18640cfdd0 con 0x7f186406a540 2023-07-21T22:38:50.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.044+0000 7f186259c640 1 --2- 172.21.15.6:0/3372323438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f186406a540 0x7f186406a910 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f18640cdbf0 tx=0x7f185401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ad19662209e8fd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:50.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.044+0000 7f1861d9b640 1 -- 172.21.15.6:0/3372323438 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18540a89b0 con 0x7f186406a540 2023-07-21T22:38:50.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.044+0000 7f1861d9b640 1 -- 172.21.15.6:0/3372323438 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18540a8b10 con 0x7f186406a540 2023-07-21T22:38:50.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.044+0000 7f1861d9b640 1 -- 172.21.15.6:0/3372323438 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18540a8ea0 con 0x7f186406a540 2023-07-21T22:38:50.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.044+0000 7f1868d03640 1 -- 172.21.15.6:0/3372323438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f186406a540 msgr2=0x7f186406a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:50.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.044+0000 7f1868d03640 1 --2- 172.21.15.6:0/3372323438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f186406a540 0x7f186406a910 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f18640cdbf0 tx=0x7f185401ecf0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.044+0000 7f1868d03640 1 -- 172.21.15.6:0/3372323438 shutdown_connections 2023-07-21T22:38:50.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.044+0000 7f1868d03640 1 --2- 172.21.15.6:0/3372323438 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18640cc980 0x7f18640cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.044+0000 7f1868d03640 1 --2- 172.21.15.6:0/3372323438 >> v2:172.21.15.161:3300/0 conn(0x7f18640cdcd0 0x7f18640cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.044+0000 7f1868d03640 1 --2- 172.21.15.6:0/3372323438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f186406a540 0x7f186406a910 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.044+0000 7f1868d03640 1 -- 172.21.15.6:0/3372323438 >> 172.21.15.6:0/3372323438 conn(0x7f1864099490 msgr2=0x7f1864089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:50.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.044+0000 7f1868d03640 1 -- 172.21.15.6:0/3372323438 shutdown_connections 2023-07-21T22:38:50.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.044+0000 7f1868d03640 1 -- 172.21.15.6:0/3372323438 wait complete. 2023-07-21T22:38:50.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f1868d03640 1 Processor -- start 2023-07-21T22:38:50.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f1868d03640 1 -- start start 2023-07-21T22:38:50.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f1868d03640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f186406a540 0x7f18641487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:50.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f1868d03640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18640cc980 0x7f18640afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:50.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f1868d03640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18640cdcd0 0x7f18640b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:50.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f1868d03640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1864148ce0 con 0x7f18640cc980 2023-07-21T22:38:50.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f1868d03640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186414aab0 con 0x7f18640cdcd0 2023-07-21T22:38:50.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f1868d03640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1864149ea0 con 0x7f186406a540 2023-07-21T22:38:50.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f185bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18640cc980 0x7f18640afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:50.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f185bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18640cc980 0x7f18640afc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43744/0 (socket says 172.21.15.6:43744) 2023-07-21T22:38:50.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f185bfff640 1 -- 172.21.15.6:0/1918628194 learned_addr learned my addr 172.21.15.6:0/1918628194 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:50.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f1862d9d640 1 --2- 172.21.15.6:0/1918628194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18640cdcd0 0x7f18640b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:50.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f186259c640 1 --2- 172.21.15.6:0/1918628194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f186406a540 0x7f18641487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:50.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f185bfff640 1 -- 172.21.15.6:0/1918628194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f186406a540 msgr2=0x7f18641487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:50.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f185bfff640 1 --2- 172.21.15.6:0/1918628194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f186406a540 0x7f18641487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f185bfff640 1 -- 172.21.15.6:0/1918628194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18640cdcd0 msgr2=0x7f18640b0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f185bfff640 1 --2- 172.21.15.6:0/1918628194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18640cdcd0 0x7f18640b0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f185bfff640 1 -- 172.21.15.6:0/1918628194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1854009480 con 0x7f18640cc980 2023-07-21T22:38:50.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f185bfff640 1 --2- 172.21.15.6:0/1918628194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18640cc980 0x7f18640afc00 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f184c00e930 tx=0x7f184c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f185affd640 1 -- 172.21.15.6:0/1918628194 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c009690 con 0x7f18640cc980 2023-07-21T22:38:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f185affd640 1 -- 172.21.15.6:0/1918628194 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184c00ca00 con 0x7f18640cc980 2023-07-21T22:38:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f185affd640 1 -- 172.21.15.6:0/1918628194 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c00cd70 con 0x7f18640cc980 2023-07-21T22:38:50.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f1868d03640 1 -- 172.21.15.6:0/1918628194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186414a180 con 0x7f18640cc980 2023-07-21T22:38:50.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.048+0000 7f1868d03640 1 -- 172.21.15.6:0/1918628194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186414a740 con 0x7f18640cc980 2023-07-21T22:38:50.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.052+0000 7f1868d03640 1 -- 172.21.15.6:0/1918628194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186414ac60 con 0x7f18640cc980 2023-07-21T22:38:50.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.052+0000 7f185affd640 1 -- 172.21.15.6:0/1918628194 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f184c013470 con 0x7f18640cc980 2023-07-21T22:38:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.052+0000 7f185affd640 1 --2- 172.21.15.6:0/1918628194 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f18440663a0 0x7f1844068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.052+0000 7f185affd640 1 -- 172.21.15.6:0/1918628194 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6865+0+0 (secure 0 0 0) 0x7f184c0843a0 con 0x7f18640cc980 2023-07-21T22:38:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.052+0000 7f186259c640 1 --2- 172.21.15.6:0/1918628194 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f18440663a0 0x7f1844068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.052+0000 7f186259c640 1 --2- 172.21.15.6:0/1918628194 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f18440663a0 0x7f1844068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f18540b2000 tx=0x7f18540aa070 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.056+0000 7f185affd640 1 -- 172.21.15.6:0/1918628194 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f186414ac60 con 0x7f18640cc980 2023-07-21T22:38:50.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.244+0000 7f1868d03640 1 -- 172.21.15.6:0/1918628194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f186414ac20 con 0x7f18640cc980 2023-07-21T22:38:50.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.244+0000 7f185affd640 1 -- 172.21.15.6:0/1918628194 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4664 (secure 0 0 0) 0x7f184c0514b0 con 0x7f18640cc980 2023-07-21T22:38:50.290 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:50.290 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1816246921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1816246921},{"type":"v1","addr":"172.21.15.6:6834","nonce":1816246921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7490,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/543588806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":543588806},{"type":"v1","addr":"172.21.15.6:6835","nonce":543588806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3250690150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3250690150},{"type":"v1","addr":"172.21.15.161:6836","nonce":3250690150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:38:23.444629+0000","modified":"2023-07-21T22:38:27.099144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8455":{"gid":8455,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6837/29499426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":29499426},{"type":"v1","addr":"172.21.15.161:6837","nonce":29499426}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-21T22:38:50.290 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 62 2023-07-21T22:38:50.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.244+0000 7f1868d03640 1 -- 172.21.15.6:0/1918628194 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f18440663a0 msgr2=0x7f1844068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:50.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.244+0000 7f1868d03640 1 --2- 172.21.15.6:0/1918628194 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f18440663a0 0x7f1844068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f18540b2000 tx=0x7f18540aa070 comp rx=0 tx=0).stop 2023-07-21T22:38:50.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.244+0000 7f1868d03640 1 -- 172.21.15.6:0/1918628194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18640cc980 msgr2=0x7f18640afc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:50.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.244+0000 7f1868d03640 1 --2- 172.21.15.6:0/1918628194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18640cc980 0x7f18640afc00 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f184c00e930 tx=0x7f184c00edf0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.248+0000 7f1868d03640 1 -- 172.21.15.6:0/1918628194 shutdown_connections 2023-07-21T22:38:50.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.248+0000 7f1868d03640 1 --2- 172.21.15.6:0/1918628194 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f18440663a0 0x7f1844068850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.248+0000 7f1868d03640 1 --2- 172.21.15.6:0/1918628194 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18640cdcd0 0x7f18640b0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.248+0000 7f1868d03640 1 --2- 172.21.15.6:0/1918628194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18640cc980 0x7f18640afc00 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.248+0000 7f1868d03640 1 --2- 172.21.15.6:0/1918628194 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f186406a540 0x7f18641487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.248+0000 7f1868d03640 1 -- 172.21.15.6:0/1918628194 >> 172.21.15.6:0/1918628194 conn(0x7f1864099490 msgr2=0x7f18640cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:50.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.248+0000 7f1868d03640 1 -- 172.21.15.6:0/1918628194 shutdown_connections 2023-07-21T22:38:50.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.248+0000 7f1868d03640 1 -- 172.21.15.6:0/1918628194 wait complete. 2023-07-21T22:38:50.310 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:38:50.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.408+0000 7faa92782640 1 Processor -- start 2023-07-21T22:38:50.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.408+0000 7faa92782640 1 -- start start 2023-07-21T22:38:50.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.408+0000 7faa92782640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa8c158ce0 0x7faa8c070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:50.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.408+0000 7faa92782640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faa8c0c8ad0 0x7faa8c0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:50.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.408+0000 7faa92782640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8c0cc700 con 0x7faa8c0c9560 2023-07-21T22:38:50.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.408+0000 7faa92782640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8c0c99e0 con 0x7faa8c0c8ad0 2023-07-21T22:38:50.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.408+0000 7faa92782640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c0b0ff0 con 0x7faa8c158ce0 2023-07-21T22:38:50.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.408+0000 7faa8b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faa8c0c8ad0 0x7faa8c0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:50.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.412+0000 7faa8b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faa8c0c8ad0 0x7faa8c0c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43754/0 (socket says 172.21.15.6:43754) 2023-07-21T22:38:50.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.412+0000 7faa8b7fe640 1 -- 172.21.15.6:0/4109464219 learned_addr learned my addr 172.21.15.6:0/4109464219 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:50.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.412+0000 7faa8bfff640 1 --2- 172.21.15.6:0/4109464219 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa8c158ce0 0x7faa8c070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:50.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.412+0000 7faa8b7fe640 1 -- 172.21.15.6:0/4109464219 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa8c158ce0 msgr2=0x7faa8c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:50.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.412+0000 7faa8b7fe640 1 --2- 172.21.15.6:0/4109464219 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa8c158ce0 0x7faa8c070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.412+0000 7faa8b7fe640 1 -- 172.21.15.6:0/4109464219 >> v1:172.21.15.161:6789/0 conn(0x7faa8c0c9560 legacy=0x7faa8c0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:50.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.412+0000 7faa8b7fe640 1 -- 172.21.15.6:0/4109464219 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8c070c80 con 0x7faa8c0c8ad0 2023-07-21T22:38:50.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.412+0000 7faa8b7fe640 1 --2- 172.21.15.6:0/4109464219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c0c8ad0 0x7faa8c0c9020 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7faa80009870 tx=0x7faa8001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16de5c066585c46 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:50.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.412+0000 7faa8affd640 1 -- 172.21.15.6:0/4109464219 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8c0cba20 con 0x7faa8c0c8ad0 2023-07-21T22:38:50.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.412+0000 7faa8affd640 1 -- 172.21.15.6:0/4109464219 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa800ab5f0 con 0x7faa8c0c8ad0 2023-07-21T22:38:50.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.412+0000 7faa8affd640 1 -- 172.21.15.6:0/4109464219 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa800ab980 con 0x7faa8c0c8ad0 2023-07-21T22:38:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa92782640 1 -- 172.21.15.6:0/4109464219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c0c8ad0 msgr2=0x7faa8c0c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa92782640 1 --2- 172.21.15.6:0/4109464219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c0c8ad0 0x7faa8c0c9020 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7faa80009870 tx=0x7faa8001c3f0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa92782640 1 -- 172.21.15.6:0/4109464219 shutdown_connections 2023-07-21T22:38:50.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa92782640 1 --2- 172.21.15.6:0/4109464219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c0c8ad0 0x7faa8c0c9020 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa92782640 1 --2- 172.21.15.6:0/4109464219 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa8c158ce0 0x7faa8c070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa92782640 1 -- 172.21.15.6:0/4109464219 >> 172.21.15.6:0/4109464219 conn(0x7faa8c0afcf0 msgr2=0x7faa8c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:50.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa92782640 1 -- 172.21.15.6:0/4109464219 shutdown_connections 2023-07-21T22:38:50.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa92782640 1 -- 172.21.15.6:0/4109464219 wait complete. 2023-07-21T22:38:50.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa92782640 1 Processor -- start 2023-07-21T22:38:50.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa92782640 1 -- start start 2023-07-21T22:38:50.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa92782640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa8c0c8ad0 0x7faa8c1f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:50.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa92782640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c0c9560 0x7faa8c0ac7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:50.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa92782640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa8c158ce0 0x7faa8c0c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:50.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa92782640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c0ac3b0 con 0x7faa8c0c9560 2023-07-21T22:38:50.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa92782640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c0aba30 con 0x7faa8c0c8ad0 2023-07-21T22:38:50.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa92782640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c1573f0 con 0x7faa8c158ce0 2023-07-21T22:38:50.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa8bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa8c0c8ad0 0x7faa8c1f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:50.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa8b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c0c9560 0x7faa8c0ac7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:50.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa8bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa8c0c8ad0 0x7faa8c1f6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:43990/0 (socket says 172.21.15.6:43990) 2023-07-21T22:38:50.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa8bfff640 1 -- 172.21.15.6:0/2055610720 learned_addr learned my addr 172.21.15.6:0/2055610720 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:50.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa90d1f640 1 --2- 172.21.15.6:0/2055610720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa8c158ce0 0x7faa8c0c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:50.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa8b7fe640 1 -- 172.21.15.6:0/2055610720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa8c158ce0 msgr2=0x7faa8c0c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:50.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa8b7fe640 1 --2- 172.21.15.6:0/2055610720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa8c158ce0 0x7faa8c0c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa8b7fe640 1 -- 172.21.15.6:0/2055610720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa8c0c8ad0 msgr2=0x7faa8c1f6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:50.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa8b7fe640 1 --2- 172.21.15.6:0/2055610720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa8c0c8ad0 0x7faa8c1f6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.416+0000 7faa8b7fe640 1 -- 172.21.15.6:0/2055610720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa800094d0 con 0x7faa8c0c9560 2023-07-21T22:38:50.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.420+0000 7faa8b7fe640 1 --2- 172.21.15.6:0/2055610720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c0c9560 0x7faa8c0ac7d0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7faa800ac000 tx=0x7faa8001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:50.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.420+0000 7faa88ff9640 1 -- 172.21.15.6:0/2055610720 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa800b4600 con 0x7faa8c0c9560 2023-07-21T22:38:50.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.420+0000 7faa88ff9640 1 -- 172.21.15.6:0/2055610720 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa800b4760 con 0x7faa8c0c9560 2023-07-21T22:38:50.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.420+0000 7faa92782640 1 -- 172.21.15.6:0/2055610720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8c0abcf0 con 0x7faa8c0c9560 2023-07-21T22:38:50.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.420+0000 7faa88ff9640 1 -- 172.21.15.6:0/2055610720 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa800b4b10 con 0x7faa8c0c9560 2023-07-21T22:38:50.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.420+0000 7faa92782640 1 -- 172.21.15.6:0/2055610720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c1f7280 con 0x7faa8c0c9560 2023-07-21T22:38:50.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.420+0000 7faa92782640 1 -- 172.21.15.6:0/2055610720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa8c0ca1a0 con 0x7faa8c0c9560 2023-07-21T22:38:50.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.420+0000 7faa88ff9640 1 -- 172.21.15.6:0/2055610720 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7faa800b4c70 con 0x7faa8c0c9560 2023-07-21T22:38:50.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.420+0000 7faa88ff9640 1 --2- 172.21.15.6:0/2055610720 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7faa780663a0 0x7faa78068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:50.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.420+0000 7faa88ff9640 1 -- 172.21.15.6:0/2055610720 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6865+0+0 (secure 0 0 0) 0x7faa800a8050 con 0x7faa8c0c9560 2023-07-21T22:38:50.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.420+0000 7faa8bfff640 1 --2- 172.21.15.6:0/2055610720 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7faa780663a0 0x7faa78068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:50.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.424+0000 7faa8bfff640 1 --2- 172.21.15.6:0/2055610720 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7faa780663a0 0x7faa78068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faa8c1583a0 tx=0x7faa7c009190 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:50.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.424+0000 7faa88ff9640 1 -- 172.21.15.6:0/2055610720 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faa800eba90 con 0x7faa8c0c9560 2023-07-21T22:38:50.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.584+0000 7faa92782640 1 -- 172.21.15.6:0/2055610720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa8c0ac4f0 con 0x7faa8c0c9560 2023-07-21T22:38:50.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.584+0000 7faa88ff9640 1 -- 172.21.15.6:0/2055610720 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+19484 (secure 0 0 0) 0x7faa8c0ac4f0 con 0x7faa8c0c9560 2023-07-21T22:38:50.630 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:50.630 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":145,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:38:47.662227+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:38:21.546383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"142","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-21T22:38:22.445128+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:6833/3543285241":"2023-07-22T22:38:47.662173+0000","172.21.15.161:0/2044622308":"2023-07-22T22:38:47.662173+0000","172.21.15.161:0/1527327696":"2023-07-22T22:38:47.662173+0000","172.21.15.161:0/2947691815":"2023-07-22T22:38:47.662173+0000","172.21.15.161:0/2306363155":"2023-07-22T22:38:47.662173+0000","172.21.15.161:0/611533009":"2023-07-22T22:38:40.645781+0000","172.21.15.161:6833/3436422767":"2023-07-22T22:38:40.645781+0000","172.21.15.161:6832/3543285241":"2023-07-22T22:38:47.662173+0000","172.21.15.161:0/1711122631":"2023-07-22T22:38:47.662173+0000","172.21.15.161:0/3113062624":"2023-07-22T22:38:40.645781+0000","172.21.15.161:6832/3436422767":"2023-07-22T22:38:40.645781+0000","172.21.15.161:0/3716131790":"2023-07-22T22:38:47.662173+0000","172.21.15.161:0/2051512394":"2023-07-22T22:38:40.645781+0000","172.21.15.161:0/3807620529":"2023-07-22T22:38:47.662173+0000","172.21.15.161:0/747215894":"2023-07-22T22:38:40.645781+0000","172.21.15.161:0/3161426051":"2023-07-22T22:38:40.645781+0000","172.21.15.161:0/3783651589":"2023-07-22T22:38:40.645781+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:38:50.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.588+0000 7faa92782640 1 -- 172.21.15.6:0/2055610720 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7faa780663a0 msgr2=0x7faa78068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:50.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.588+0000 7faa92782640 1 --2- 172.21.15.6:0/2055610720 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7faa780663a0 0x7faa78068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faa8c1583a0 tx=0x7faa7c009190 comp rx=0 tx=0).stop 2023-07-21T22:38:50.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.588+0000 7faa92782640 1 -- 172.21.15.6:0/2055610720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c0c9560 msgr2=0x7faa8c0ac7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:50.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.588+0000 7faa92782640 1 --2- 172.21.15.6:0/2055610720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c0c9560 0x7faa8c0ac7d0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7faa800ac000 tx=0x7faa8001ac30 comp rx=0 tx=0).stop 2023-07-21T22:38:50.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.588+0000 7faa92782640 1 -- 172.21.15.6:0/2055610720 shutdown_connections 2023-07-21T22:38:50.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.588+0000 7faa92782640 1 --2- 172.21.15.6:0/2055610720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa8c158ce0 0x7faa8c0c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.588+0000 7faa92782640 1 --2- 172.21.15.6:0/2055610720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c0c9560 0x7faa8c0ac7d0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.588+0000 7faa92782640 1 --2- 172.21.15.6:0/2055610720 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7faa780663a0 0x7faa78068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.588+0000 7faa92782640 1 --2- 172.21.15.6:0/2055610720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa8c0c8ad0 0x7faa8c1f6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.588+0000 7faa92782640 1 -- 172.21.15.6:0/2055610720 >> 172.21.15.6:0/2055610720 conn(0x7faa8c0afcf0 msgr2=0x7faa8c0af1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:50.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.588+0000 7faa92782640 1 -- 172.21.15.6:0/2055610720 shutdown_connections 2023-07-21T22:38:50.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.588+0000 7faa92782640 1 -- 172.21.15.6:0/2055610720 wait complete. 2023-07-21T22:38:50.651 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-21T22:38:50.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.752+0000 7f0208511640 1 Processor -- start 2023-07-21T22:38:50.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.752+0000 7f0208511640 1 -- start start 2023-07-21T22:38:50.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.752+0000 7f0208511640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f02000d06b0 0x7f02000b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:50.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.752+0000 7f0208511640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0200145430 0x7f02000b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:50.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.752+0000 7f0208511640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02000b1f70 0x7f02000d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:50.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.752+0000 7f0208511640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02000b2410 con 0x7f02000d06b0 2023-07-21T22:38:50.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.752+0000 7f0208511640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02000b26f0 con 0x7f0200145430 2023-07-21T22:38:50.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.752+0000 7f0208511640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02000b29d0 con 0x7f02000b1f70 2023-07-21T22:38:50.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.752+0000 7f02062ad640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f02000d06b0 0x7f02000b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:50.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.752+0000 7f02062ad640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f02000d06b0 0x7f02000b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43776/0 (socket says 172.21.15.6:43776) 2023-07-21T22:38:50.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.752+0000 7f02062ad640 1 -- 172.21.15.6:0/166898404 learned_addr learned my addr 172.21.15.6:0/166898404 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:50.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.752+0000 7f0206aae640 1 --2- 172.21.15.6:0/166898404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02000b1f70 0x7f02000d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:50.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.752+0000 7f0205aac640 1 --2- 172.21.15.6:0/166898404 >> v2:172.21.15.161:3300/0 conn(0x7f0200145430 0x7f02000b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:50.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.752+0000 7f02062ad640 1 -- 172.21.15.6:0/166898404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02000b1f70 msgr2=0x7f02000d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:50.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.752+0000 7f02062ad640 1 --2- 172.21.15.6:0/166898404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02000b1f70 0x7f02000d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.752+0000 7f02062ad640 1 -- 172.21.15.6:0/166898404 >> v2:172.21.15.161:3300/0 conn(0x7f0200145430 msgr2=0x7f02000b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:50.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.752+0000 7f02062ad640 1 --2- 172.21.15.6:0/166898404 >> v2:172.21.15.161:3300/0 conn(0x7f0200145430 0x7f02000b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.752+0000 7f02062ad640 1 -- 172.21.15.6:0/166898404 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02000b2cb0 con 0x7f02000d06b0 2023-07-21T22:38:50.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.752+0000 7f0206aae640 1 --2- 172.21.15.6:0/166898404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02000b1f70 0x7f02000d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:50.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.752+0000 7f0205aac640 1 --2- 172.21.15.6:0/166898404 >> v2:172.21.15.161:3300/0 conn(0x7f0200145430 0x7f02000b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:50.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.756+0000 7f02062ad640 1 --2- 172.21.15.6:0/166898404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02000d06b0 0x7f02000b1a30 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f020008b230 tx=0x7f01fc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b539b84d6c01b5fc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:50.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.756+0000 7f02052ab640 1 -- 172.21.15.6:0/166898404 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0aa610 con 0x7f02000d06b0 2023-07-21T22:38:50.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.756+0000 7f02052ab640 1 -- 172.21.15.6:0/166898404 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc0a6040 con 0x7f02000d06b0 2023-07-21T22:38:50.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.756+0000 7f02052ab640 1 -- 172.21.15.6:0/166898404 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0aa990 con 0x7f02000d06b0 2023-07-21T22:38:50.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.756+0000 7f0208511640 1 -- 172.21.15.6:0/166898404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02000d06b0 msgr2=0x7f02000b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:50.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.756+0000 7f0208511640 1 --2- 172.21.15.6:0/166898404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02000d06b0 0x7f02000b1a30 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f020008b230 tx=0x7f01fc01c4d0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.756+0000 7f0208511640 1 -- 172.21.15.6:0/166898404 shutdown_connections 2023-07-21T22:38:50.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.756+0000 7f0208511640 1 --2- 172.21.15.6:0/166898404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02000b1f70 0x7f02000d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.756+0000 7f0208511640 1 --2- 172.21.15.6:0/166898404 >> v2:172.21.15.161:3300/0 conn(0x7f0200145430 0x7f02000b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.756+0000 7f0208511640 1 --2- 172.21.15.6:0/166898404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02000d06b0 0x7f02000b1a30 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.756+0000 7f0208511640 1 -- 172.21.15.6:0/166898404 >> 172.21.15.6:0/166898404 conn(0x7f02000659d0 msgr2=0x7f020009b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:50.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.756+0000 7f0208511640 1 -- 172.21.15.6:0/166898404 shutdown_connections 2023-07-21T22:38:50.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.756+0000 7f0208511640 1 -- 172.21.15.6:0/166898404 wait complete. 2023-07-21T22:38:50.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0208511640 1 Processor -- start 2023-07-21T22:38:50.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0208511640 1 -- start start 2023-07-21T22:38:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0208511640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02000b1f70 0x7f020015c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0208511640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02000d06b0 0x7f02000c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0208511640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02000b79e0 0x7f02001570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0208511640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02000c3c00 con 0x7f02000d06b0 2023-07-21T22:38:50.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0208511640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02000c3fc0 con 0x7f02000b1f70 2023-07-21T22:38:50.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0208511640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02000ca5c0 con 0x7f02000b79e0 2023-07-21T22:38:50.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0205aac640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02000d06b0 0x7f02000c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:50.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0205aac640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02000d06b0 0x7f02000c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43784/0 (socket says 172.21.15.6:43784) 2023-07-21T22:38:50.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0205aac640 1 -- 172.21.15.6:0/3853927610 learned_addr learned my addr 172.21.15.6:0/3853927610 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:50.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f02062ad640 1 --2- 172.21.15.6:0/3853927610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02000b1f70 0x7f020015c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:50.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0205aac640 1 -- 172.21.15.6:0/3853927610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02000b79e0 msgr2=0x7f02001570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:50.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0206aae640 1 --2- 172.21.15.6:0/3853927610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02000b79e0 0x7f02001570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:50.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0205aac640 1 --2- 172.21.15.6:0/3853927610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02000b79e0 0x7f02001570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0205aac640 1 -- 172.21.15.6:0/3853927610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02000b1f70 msgr2=0x7f020015c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:50.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0205aac640 1 --2- 172.21.15.6:0/3853927610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02000b1f70 0x7f020015c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:50.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0205aac640 1 -- 172.21.15.6:0/3853927610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc0094d0 con 0x7f02000d06b0 2023-07-21T22:38:50.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f02062ad640 1 --2- 172.21.15.6:0/3853927610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02000b1f70 0x7f020015c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:50.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0206aae640 1 --2- 172.21.15.6:0/3853927610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02000b79e0 0x7f02001570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:50.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0205aac640 1 --2- 172.21.15.6:0/3853927610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02000d06b0 0x7f02000c9420 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f01f000c7f0 tx=0x7f01f000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:50.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f01f6ffd640 1 -- 172.21.15.6:0/3853927610 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f000cea0 con 0x7f02000d06b0 2023-07-21T22:38:50.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f01f6ffd640 1 -- 172.21.15.6:0/3853927610 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f0007a30 con 0x7f02000d06b0 2023-07-21T22:38:50.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f01f6ffd640 1 -- 172.21.15.6:0/3853927610 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f0007de0 con 0x7f02000d06b0 2023-07-21T22:38:50.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0208511640 1 -- 172.21.15.6:0/3853927610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02000c9d20 con 0x7f02000d06b0 2023-07-21T22:38:50.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.760+0000 7f0208511640 1 -- 172.21.15.6:0/3853927610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02000ca2e0 con 0x7f02000d06b0 2023-07-21T22:38:50.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.764+0000 7f0208511640 1 -- 172.21.15.6:0/3853927610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0200072e70 con 0x7f02000d06b0 2023-07-21T22:38:50.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.764+0000 7f01f6ffd640 1 -- 172.21.15.6:0/3853927610 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f01f00113f0 con 0x7f02000d06b0 2023-07-21T22:38:50.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.764+0000 7f01f6ffd640 1 --2- 172.21.15.6:0/3853927610 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f01e40663d0 0x7f01e4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:50.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.764+0000 7f01f6ffd640 1 -- 172.21.15.6:0/3853927610 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6865+0+0 (secure 0 0 0) 0x7f01f0084490 con 0x7f02000d06b0 2023-07-21T22:38:50.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.764+0000 7f02062ad640 1 --2- 172.21.15.6:0/3853927610 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f01e40663d0 0x7f01e4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:50.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.764+0000 7f02062ad640 1 --2- 172.21.15.6:0/3853927610 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f01e40663d0 0x7f01e4068880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0ae000 tx=0x7f01fc008040 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:50.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.768+0000 7f01f6ffd640 1 -- 172.21.15.6:0/3853927610 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f01f0051320 con 0x7f02000d06b0 2023-07-21T22:38:51.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.956+0000 7f0208511640 1 -- 172.21.15.6:0/3853927610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f02000678d0 con 0x7f02000d06b0 2023-07-21T22:38:51.002 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-07-21T22:38:50.956+0000 7f195e836640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-21T22:38:51.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.960+0000 7f01f6ffd640 1 -- 172.21.15.6:0/3853927610 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) v1 ==== 161+0+0 (secure 0 0 0) 0x7f01f0054940 con 0x7f02000d06b0 2023-07-21T22:38:51.007 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-21T22:38:51.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.964+0000 7f0208511640 1 -- 172.21.15.6:0/3853927610 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f01e40663d0 msgr2=0x7f01e4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:51.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.964+0000 7f0208511640 1 --2- 172.21.15.6:0/3853927610 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f01e40663d0 0x7f01e4068880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f01fc0ae000 tx=0x7f01fc008040 comp rx=0 tx=0).stop 2023-07-21T22:38:51.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.964+0000 7f0208511640 1 -- 172.21.15.6:0/3853927610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02000d06b0 msgr2=0x7f02000c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:51.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.964+0000 7f0208511640 1 --2- 172.21.15.6:0/3853927610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02000d06b0 0x7f02000c9420 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f01f000c7f0 tx=0x7f01f000ccb0 comp rx=0 tx=0).stop 2023-07-21T22:38:51.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.964+0000 7f0208511640 1 -- 172.21.15.6:0/3853927610 shutdown_connections 2023-07-21T22:38:51.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.964+0000 7f0208511640 1 --2- 172.21.15.6:0/3853927610 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02000b79e0 0x7f02001570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:51.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.964+0000 7f0208511640 1 --2- 172.21.15.6:0/3853927610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02000d06b0 0x7f02000c9420 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:51.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.964+0000 7f0208511640 1 --2- 172.21.15.6:0/3853927610 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f01e40663d0 0x7f01e4068880 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:51.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.964+0000 7f0208511640 1 --2- 172.21.15.6:0/3853927610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02000b1f70 0x7f020015c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:51.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.964+0000 7f0208511640 1 -- 172.21.15.6:0/3853927610 >> 172.21.15.6:0/3853927610 conn(0x7f02000659d0 msgr2=0x7f020006ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:51.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.964+0000 7f0208511640 1 -- 172.21.15.6:0/3853927610 shutdown_connections 2023-07-21T22:38:51.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:50.964+0000 7f0208511640 1 -- 172.21.15.6:0/3853927610 wait complete. 2023-07-21T22:38:51.017 INFO:tasks.ceph.mds.b.smithi161.stderr: -4045> 2023-07-21T22:38:29.039+0000 7fbab33df640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:38:51.028 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-21T22:38:51.068 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-07-21T22:38:51.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.128+0000 7f76447d2640 1 Processor -- start 2023-07-21T22:38:51.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.128+0000 7f76447d2640 1 -- start start 2023-07-21T22:38:51.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.132+0000 7f76447d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f763c06a540 0x7f763c0cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:51.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.132+0000 7f76447d2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f763c1601f0 0x7f763c0cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:51.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.132+0000 7f76447d2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f763c0ccf50 con 0x7f763c06a910 2023-07-21T22:38:51.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.132+0000 7f76447d2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763c0cd1f0 con 0x7f763c1601f0 2023-07-21T22:38:51.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.132+0000 7f76447d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0cd4d0 con 0x7f763c06a540 2023-07-21T22:38:51.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.132+0000 7f7642d6f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f763c06a910 0x7f763c0d0360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41432/0 (socket says 172.21.15.6:41432) 2023-07-21T22:38:51.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.132+0000 7f7642d6f640 1 -- 172.21.15.6:0/3783321243 learned_addr learned my addr 172.21.15.6:0/3783321243 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:51.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.132+0000 7f7641d6d640 1 --2- 172.21.15.6:0/3783321243 >> v2:172.21.15.161:3300/0 conn(0x7f763c1601f0 0x7f763c0cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:51.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.132+0000 7f764256e640 1 --2- 172.21.15.6:0/3783321243 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f763c06a540 0x7f763c0cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:51.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.132+0000 7f764156c640 1 -- 172.21.15.6:0/3783321243 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 960146102 0 0) 0x7f763c0ccf50 con 0x7f763c06a910 2023-07-21T22:38:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.132+0000 7f764156c640 1 -- 172.21.15.6:0/3783321243 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7628003530 con 0x7f763c06a910 2023-07-21T22:38:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.132+0000 7f7641d6d640 1 -- 172.21.15.6:0/3783321243 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f763c06a540 msgr2=0x7f763c0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.132+0000 7f7641d6d640 1 --2- 172.21.15.6:0/3783321243 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f763c06a540 0x7f763c0cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.132+0000 7f7641d6d640 1 -- 172.21.15.6:0/3783321243 >> v1:172.21.15.6:6789/0 conn(0x7f763c06a910 legacy=0x7f763c0d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.132+0000 7f7641d6d640 1 -- 172.21.15.6:0/3783321243 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c0cd7b0 con 0x7f763c1601f0 2023-07-21T22:38:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.132+0000 7f764256e640 1 --2- 172.21.15.6:0/3783321243 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f763c06a540 0x7f763c0cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:51.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.136+0000 7f7641d6d640 1 --2- 172.21.15.6:0/3783321243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f763c1601f0 0x7f763c0cca10 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f762c0097c0 tx=0x7f762c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e24ce683c433a6c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:51.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.136+0000 7f764156c640 1 -- 172.21.15.6:0/3783321243 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c0ac640 con 0x7f763c1601f0 2023-07-21T22:38:51.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.136+0000 7f764156c640 1 -- 172.21.15.6:0/3783321243 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c0ac7a0 con 0x7f763c1601f0 2023-07-21T22:38:51.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.136+0000 7f764156c640 1 -- 172.21.15.6:0/3783321243 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c0acb30 con 0x7f763c1601f0 2023-07-21T22:38:51.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.136+0000 7f76447d2640 1 -- 172.21.15.6:0/3783321243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f763c1601f0 msgr2=0x7f763c0cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:51.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.136+0000 7f76447d2640 1 --2- 172.21.15.6:0/3783321243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f763c1601f0 0x7f763c0cca10 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f762c0097c0 tx=0x7f762c01c3c0 comp rx=0 tx=0).stop 2023-07-21T22:38:51.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.136+0000 7f76447d2640 1 -- 172.21.15.6:0/3783321243 shutdown_connections 2023-07-21T22:38:51.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.136+0000 7f76447d2640 1 --2- 172.21.15.6:0/3783321243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f763c1601f0 0x7f763c0cca10 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:51.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.136+0000 7f76447d2640 1 --2- 172.21.15.6:0/3783321243 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f763c06a540 0x7f763c0cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:51.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.136+0000 7f76447d2640 1 -- 172.21.15.6:0/3783321243 >> 172.21.15.6:0/3783321243 conn(0x7f763c099490 msgr2=0x7f763c089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:51.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.136+0000 7f76447d2640 1 -- 172.21.15.6:0/3783321243 shutdown_connections 2023-07-21T22:38:51.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.136+0000 7f76447d2640 1 -- 172.21.15.6:0/3783321243 wait complete. 2023-07-21T22:38:51.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.136+0000 7f76447d2640 1 Processor -- start 2023-07-21T22:38:51.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.136+0000 7f76447d2640 1 -- start start 2023-07-21T22:38:51.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f76447d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f763c06a540 0x7f763c0ae510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:51.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f76447d2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f763c06a910 0x7f763c0aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:51.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f76447d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f763c1601f0 0x7f763c0b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:51.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f76447d2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0adfe0 con 0x7f763c1601f0 2023-07-21T22:38:51.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f76447d2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0b4a90 con 0x7f763c06a910 2023-07-21T22:38:51.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f76447d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0b4d70 con 0x7f763c06a540 2023-07-21T22:38:51.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f7642d6f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f763c1601f0 0x7f763c0b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:51.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f7642d6f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f763c1601f0 0x7f763c0b01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43788/0 (socket says 172.21.15.6:43788) 2023-07-21T22:38:51.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f7642d6f640 1 -- 172.21.15.6:0/3210684218 learned_addr learned my addr 172.21.15.6:0/3210684218 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:51.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f764256e640 1 --2- 172.21.15.6:0/3210684218 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f763c06a540 0x7f763c0ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:51.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f7641d6d640 1 --2- 172.21.15.6:0/3210684218 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f763c06a910 0x7f763c0aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f7642d6f640 1 -- 172.21.15.6:0/3210684218 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f763c06a540 msgr2=0x7f763c0ae510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f7642d6f640 1 --2- 172.21.15.6:0/3210684218 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f763c06a540 0x7f763c0ae510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f7642d6f640 1 -- 172.21.15.6:0/3210684218 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f763c06a910 msgr2=0x7f763c0aea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f7642d6f640 1 --2- 172.21.15.6:0/3210684218 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f763c06a910 0x7f763c0aea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f7642d6f640 1 -- 172.21.15.6:0/3210684218 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76380093b0 con 0x7f763c1601f0 2023-07-21T22:38:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f764256e640 1 --2- 172.21.15.6:0/3210684218 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f763c06a540 0x7f763c0ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f7642d6f640 1 --2- 172.21.15.6:0/3210684218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f763c1601f0 0x7f763c0b01e0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f763400caa0 tx=0x7f763400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f7632ffd640 1 -- 172.21.15.6:0/3210684218 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763400ac00 con 0x7f763c1601f0 2023-07-21T22:38:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f7632ffd640 1 -- 172.21.15.6:0/3210684218 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763400ad60 con 0x7f763c1601f0 2023-07-21T22:38:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f76447d2640 1 -- 172.21.15.6:0/3210684218 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762c009420 con 0x7f763c1601f0 2023-07-21T22:38:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f7632ffd640 1 -- 172.21.15.6:0/3210684218 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7634012620 con 0x7f763c1601f0 2023-07-21T22:38:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f76447d2640 1 -- 172.21.15.6:0/3210684218 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763c0b5330 con 0x7f763c1601f0 2023-07-21T22:38:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f76447d2640 1 -- 172.21.15.6:0/3210684218 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763c0678d0 con 0x7f763c1601f0 2023-07-21T22:38:51.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.140+0000 7f7632ffd640 1 -- 172.21.15.6:0/3210684218 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7634007070 con 0x7f763c1601f0 2023-07-21T22:38:51.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.144+0000 7f7632ffd640 1 --2- 172.21.15.6:0/3210684218 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f76200663a0 0x7f7620068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:51.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.144+0000 7f7632ffd640 1 -- 172.21.15.6:0/3210684218 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6951+0+0 (secure 0 0 0) 0x7f7634084200 con 0x7f763c1601f0 2023-07-21T22:38:51.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.144+0000 7f764256e640 1 --2- 172.21.15.6:0/3210684218 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f76200663a0 0x7f7620068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:51.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.144+0000 7f764256e640 1 --2- 172.21.15.6:0/3210684218 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f76200663a0 0x7f7620068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7638009fd0 tx=0x7f7638006f90 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:51.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.148+0000 7f7632ffd640 1 -- 172.21.15.6:0/3210684218 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7634051200 con 0x7f763c1601f0 2023-07-21T22:38:51.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.332+0000 7f76447d2640 1 -- 172.21.15.6:0/3210684218 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f763c0cfb00 con 0x7f763c1601f0 2023-07-21T22:38:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.968+0000 7f7632ffd640 1 -- 172.21.15.6:0/3210684218 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7634054820 con 0x7f763c1601f0 2023-07-21T22:38:52.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.972+0000 7f76447d2640 1 -- 172.21.15.6:0/3210684218 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f76200663a0 msgr2=0x7f7620068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:52.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.972+0000 7f76447d2640 1 --2- 172.21.15.6:0/3210684218 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f76200663a0 0x7f7620068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7638009fd0 tx=0x7f7638006f90 comp rx=0 tx=0).stop 2023-07-21T22:38:52.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.972+0000 7f76447d2640 1 -- 172.21.15.6:0/3210684218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f763c1601f0 msgr2=0x7f763c0b01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:52.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.972+0000 7f76447d2640 1 --2- 172.21.15.6:0/3210684218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f763c1601f0 0x7f763c0b01e0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f763400caa0 tx=0x7f763400cf60 comp rx=0 tx=0).stop 2023-07-21T22:38:52.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.972+0000 7f76447d2640 1 -- 172.21.15.6:0/3210684218 shutdown_connections 2023-07-21T22:38:52.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.972+0000 7f76447d2640 1 --2- 172.21.15.6:0/3210684218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f763c1601f0 0x7f763c0b01e0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.972+0000 7f76447d2640 1 --2- 172.21.15.6:0/3210684218 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f76200663a0 0x7f7620068850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.972+0000 7f76447d2640 1 --2- 172.21.15.6:0/3210684218 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f763c06a910 0x7f763c0aea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.972+0000 7f76447d2640 1 --2- 172.21.15.6:0/3210684218 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f763c06a540 0x7f763c0ae510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.972+0000 7f76447d2640 1 -- 172.21.15.6:0/3210684218 >> 172.21.15.6:0/3210684218 conn(0x7f763c099490 msgr2=0x7f763c0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:52.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.972+0000 7f76447d2640 1 -- 172.21.15.6:0/3210684218 shutdown_connections 2023-07-21T22:38:52.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:51.972+0000 7f76447d2640 1 -- 172.21.15.6:0/3210684218 wait complete. 2023-07-21T22:38:52.039 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-21T22:38:52.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.148+0000 7f2e63d9f640 1 Processor -- start 2023-07-21T22:38:52.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.148+0000 7f2e63d9f640 1 -- start start 2023-07-21T22:38:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.148+0000 7f2e63d9f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2e5c0cba60 0x7f2e5c0c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.148+0000 7f2e63d9f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e5c15b9c0 0x7f2e5c0cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.148+0000 7f2e63d9f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5c0cc370 con 0x7f2e5c158090 2023-07-21T22:38:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.148+0000 7f2e63d9f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5c0c37e0 con 0x7f2e5c0cba60 2023-07-21T22:38:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.148+0000 7f2e63d9f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c0c3ac0 con 0x7f2e5c15b9c0 2023-07-21T22:38:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.148+0000 7f2e61b3b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2e5c0cba60 0x7f2e5c0c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.148+0000 7f2e61b3b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2e5c0cba60 0x7f2e5c0c3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43802/0 (socket says 172.21.15.6:43802) 2023-07-21T22:38:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.148+0000 7f2e61b3b640 1 -- 172.21.15.6:0/3969209355 learned_addr learned my addr 172.21.15.6:0/3969209355 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.148+0000 7f2e6233c640 1 --1- 172.21.15.6:0/3969209355 >> v1:172.21.15.6:6789/0 conn(0x7f2e5c158090 0x7f2e5c158510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41438/0 (socket says 172.21.15.6:41438) 2023-07-21T22:38:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.148+0000 7f2e6133a640 1 --2- 172.21.15.6:0/3969209355 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e5c15b9c0 0x7f2e5c0cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.148+0000 7f2e61b3b640 1 -- 172.21.15.6:0/3969209355 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e5c15b9c0 msgr2=0x7f2e5c0cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.148+0000 7f2e61b3b640 1 --2- 172.21.15.6:0/3969209355 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e5c15b9c0 0x7f2e5c0cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.148+0000 7f2e61b3b640 1 -- 172.21.15.6:0/3969209355 >> v1:172.21.15.6:6789/0 conn(0x7f2e5c158090 legacy=0x7f2e5c158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.148+0000 7f2e61b3b640 1 -- 172.21.15.6:0/3969209355 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c0c3da0 con 0x7f2e5c0cba60 2023-07-21T22:38:52.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.152+0000 7f2e61b3b640 1 --2- 172.21.15.6:0/3969209355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c0cba60 0x7f2e5c0c3150 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f2e58006fd0 tx=0x7f2e5801e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7404cdc87eb2d4b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:52.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.152+0000 7f2e60b39640 1 -- 172.21.15.6:0/3969209355 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e58004230 con 0x7f2e5c0cba60 2023-07-21T22:38:52.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.152+0000 7f2e60b39640 1 -- 172.21.15.6:0/3969209355 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e580ab070 con 0x7f2e5c0cba60 2023-07-21T22:38:52.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.152+0000 7f2e60b39640 1 -- 172.21.15.6:0/3969209355 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e580a76f0 con 0x7f2e5c0cba60 2023-07-21T22:38:52.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.152+0000 7f2e63d9f640 1 -- 172.21.15.6:0/3969209355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c0cba60 msgr2=0x7f2e5c0c3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.152+0000 7f2e63d9f640 1 --2- 172.21.15.6:0/3969209355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c0cba60 0x7f2e5c0c3150 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f2e58006fd0 tx=0x7f2e5801e880 comp rx=0 tx=0).stop 2023-07-21T22:38:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.152+0000 7f2e63d9f640 1 -- 172.21.15.6:0/3969209355 shutdown_connections 2023-07-21T22:38:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.152+0000 7f2e63d9f640 1 --2- 172.21.15.6:0/3969209355 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e5c15b9c0 0x7f2e5c0cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.152+0000 7f2e63d9f640 1 --2- 172.21.15.6:0/3969209355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c0cba60 0x7f2e5c0c3150 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.152+0000 7f2e63d9f640 1 -- 172.21.15.6:0/3969209355 >> 172.21.15.6:0/3969209355 conn(0x7f2e5c0cde90 msgr2=0x7f2e5c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.152+0000 7f2e63d9f640 1 -- 172.21.15.6:0/3969209355 shutdown_connections 2023-07-21T22:38:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.152+0000 7f2e63d9f640 1 -- 172.21.15.6:0/3969209355 wait complete. 2023-07-21T22:38:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e63d9f640 1 Processor -- start 2023-07-21T22:38:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e63d9f640 1 -- start start 2023-07-21T22:38:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e63d9f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e5c0cba60 0x7f2e5c06c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e63d9f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e5c158090 0x7f2e5c06c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e63d9f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c15b9c0 0x7f2e5c1f4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e63d9f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c1f7e00 con 0x7f2e5c15b9c0 2023-07-21T22:38:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e63d9f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c1f80a0 con 0x7f2e5c158090 2023-07-21T22:38:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e63d9f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c1f8380 con 0x7f2e5c0cba60 2023-07-21T22:38:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e6233c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c15b9c0 0x7f2e5c1f4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e6233c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c15b9c0 0x7f2e5c1f4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43812/0 (socket says 172.21.15.6:43812) 2023-07-21T22:38:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e6233c640 1 -- 172.21.15.6:0/536038253 learned_addr learned my addr 172.21.15.6:0/536038253 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e61b3b640 1 --2- 172.21.15.6:0/536038253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e5c0cba60 0x7f2e5c06c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e6133a640 1 --2- 172.21.15.6:0/536038253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e5c158090 0x7f2e5c06c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:52.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e6233c640 1 -- 172.21.15.6:0/536038253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e5c0cba60 msgr2=0x7f2e5c06c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e6233c640 1 --2- 172.21.15.6:0/536038253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e5c0cba60 0x7f2e5c06c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e6233c640 1 -- 172.21.15.6:0/536038253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e5c158090 msgr2=0x7f2e5c06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e6233c640 1 --2- 172.21.15.6:0/536038253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e5c158090 0x7f2e5c06c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e6233c640 1 -- 172.21.15.6:0/536038253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5800b780 con 0x7f2e5c15b9c0 2023-07-21T22:38:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e6133a640 1 --2- 172.21.15.6:0/536038253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e5c158090 0x7f2e5c06c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e6233c640 1 --2- 172.21.15.6:0/536038253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c15b9c0 0x7f2e5c1f4bb0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400c7a0 tx=0x7f2e5400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e527fc640 1 -- 172.21.15.6:0/536038253 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5400a640 con 0x7f2e5c15b9c0 2023-07-21T22:38:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e527fc640 1 -- 172.21.15.6:0/536038253 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5400a7a0 con 0x7f2e5c15b9c0 2023-07-21T22:38:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e527fc640 1 -- 172.21.15.6:0/536038253 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5400ab10 con 0x7f2e5c15b9c0 2023-07-21T22:38:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e63d9f640 1 -- 172.21.15.6:0/536038253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5c1f8660 con 0x7f2e5c15b9c0 2023-07-21T22:38:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e63d9f640 1 -- 172.21.15.6:0/536038253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5c0b0dc0 con 0x7f2e5c15b9c0 2023-07-21T22:38:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.156+0000 7f2e63d9f640 1 -- 172.21.15.6:0/536038253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5c0714b0 con 0x7f2e5c15b9c0 2023-07-21T22:38:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.160+0000 7f2e527fc640 1 -- 172.21.15.6:0/536038253 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2e5400ac70 con 0x7f2e5c15b9c0 2023-07-21T22:38:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.160+0000 7f2e527fc640 1 --2- 172.21.15.6:0/536038253 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f2e400663a0 0x7f2e40068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.160+0000 7f2e527fc640 1 -- 172.21.15.6:0/536038253 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6951+0+0 (secure 0 0 0) 0x7f2e54083a60 con 0x7f2e5c15b9c0 2023-07-21T22:38:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.160+0000 7f2e61b3b640 1 --2- 172.21.15.6:0/536038253 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f2e400663a0 0x7f2e40068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.160+0000 7f2e61b3b640 1 --2- 172.21.15.6:0/536038253 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f2e400663a0 0x7f2e40068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2e580b1000 tx=0x7f2e580a9070 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.164+0000 7f2e527fc640 1 -- 172.21.15.6:0/536038253 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2e54050a60 con 0x7f2e5c15b9c0 2023-07-21T22:38:52.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.316+0000 7f2e63d9f640 1 -- 172.21.15.6:0/536038253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2e5c0b1010 con 0x7f2e5c15b9c0 2023-07-21T22:38:53.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.976+0000 7f2e527fc640 1 -- 172.21.15.6:0/536038253 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v147) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2e54054080 con 0x7f2e5c15b9c0 2023-07-21T22:38:53.019 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-07-21T22:38:53.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.976+0000 7f2e63d9f640 1 -- 172.21.15.6:0/536038253 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f2e400663a0 msgr2=0x7f2e40068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:53.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.976+0000 7f2e63d9f640 1 --2- 172.21.15.6:0/536038253 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f2e400663a0 0x7f2e40068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2e580b1000 tx=0x7f2e580a9070 comp rx=0 tx=0).stop 2023-07-21T22:38:53.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.976+0000 7f2e63d9f640 1 -- 172.21.15.6:0/536038253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c15b9c0 msgr2=0x7f2e5c1f4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:53.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.976+0000 7f2e63d9f640 1 --2- 172.21.15.6:0/536038253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c15b9c0 0x7f2e5c1f4bb0 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f2e5400c7a0 tx=0x7f2e5400cc60 comp rx=0 tx=0).stop 2023-07-21T22:38:53.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.976+0000 7f2e63d9f640 1 -- 172.21.15.6:0/536038253 shutdown_connections 2023-07-21T22:38:53.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.976+0000 7f2e63d9f640 1 --2- 172.21.15.6:0/536038253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e5c15b9c0 0x7f2e5c1f4bb0 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.976+0000 7f2e63d9f640 1 --2- 172.21.15.6:0/536038253 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f2e400663a0 0x7f2e40068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.976+0000 7f2e63d9f640 1 --2- 172.21.15.6:0/536038253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e5c158090 0x7f2e5c06c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.976+0000 7f2e63d9f640 1 --2- 172.21.15.6:0/536038253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e5c0cba60 0x7f2e5c06c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.976+0000 7f2e63d9f640 1 -- 172.21.15.6:0/536038253 >> 172.21.15.6:0/536038253 conn(0x7f2e5c0cde90 msgr2=0x7f2e5c150390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:53.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.976+0000 7f2e63d9f640 1 -- 172.21.15.6:0/536038253 shutdown_connections 2023-07-21T22:38:53.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:52.976+0000 7f2e63d9f640 1 -- 172.21.15.6:0/536038253 wait complete. 2023-07-21T22:38:53.046 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-21T22:38:53.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.156+0000 7fb009648640 1 Processor -- start 2023-07-21T22:38:53.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.156+0000 7fb009648640 1 -- start start 2023-07-21T22:38:53.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.156+0000 7fb009648640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb00406c0c0 0x7fb0040cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:53.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.156+0000 7fb009648640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb00406b150 0x7fb00406b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:53.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.156+0000 7fb009648640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb004159160 con 0x7fb004158d90 2023-07-21T22:38:53.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.156+0000 7fb009648640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00406bb10 con 0x7fb00406c0c0 2023-07-21T22:38:53.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.156+0000 7fb009648640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0040ce830 con 0x7fb00406b150 2023-07-21T22:38:53.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.156+0000 7fb0037fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb00406b150 0x7fb00406b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:53.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.156+0000 7fb0027fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb00406c0c0 0x7fb0040cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:53.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.156+0000 7fb0037fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb00406b150 0x7fb00406b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:35124/0 (socket says 172.21.15.6:35124) 2023-07-21T22:38:53.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.156+0000 7fb0037fe640 1 -- 172.21.15.6:0/2791987798 learned_addr learned my addr 172.21.15.6:0/2791987798 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:53.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.156+0000 7fb0027fc640 1 -- 172.21.15.6:0/2791987798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb00406b150 msgr2=0x7fb00406b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:53.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.156+0000 7fb0027fc640 1 --2- 172.21.15.6:0/2791987798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb00406b150 0x7fb00406b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.156+0000 7fb0027fc640 1 -- 172.21.15.6:0/2791987798 >> v1:172.21.15.161:6789/0 conn(0x7fb004158d90 legacy=0x7fb0040cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:53.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.156+0000 7fb0027fc640 1 -- 172.21.15.6:0/2791987798 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0040ceb10 con 0x7fb00406c0c0 2023-07-21T22:38:53.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.156+0000 7fb001ffb640 1 -- 172.21.15.6:0/2791987798 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176634038 0 0) 0x7fb004159160 con 0x7fb004158d90 2023-07-21T22:38:53.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.156+0000 7fb0037fe640 1 --2- 172.21.15.6:0/2791987798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb00406b150 0x7fb00406b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:53.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.160+0000 7fb0027fc640 1 --2- 172.21.15.6:0/2791987798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb00406c0c0 0x7fb0040cbce0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7faff80097c0 tx=0x7faff801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2aa880f68eb419cf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:53.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.160+0000 7fb001ffb640 1 -- 172.21.15.6:0/2791987798 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff80ab5f0 con 0x7fb00406c0c0 2023-07-21T22:38:53.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.160+0000 7fb001ffb640 1 -- 172.21.15.6:0/2791987798 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff80ab750 con 0x7fb00406c0c0 2023-07-21T22:38:53.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.160+0000 7fb001ffb640 1 -- 172.21.15.6:0/2791987798 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff80abae0 con 0x7fb00406c0c0 2023-07-21T22:38:53.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.160+0000 7fb009648640 1 -- 172.21.15.6:0/2791987798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb00406c0c0 msgr2=0x7fb0040cbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:53.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.160+0000 7fb009648640 1 --2- 172.21.15.6:0/2791987798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb00406c0c0 0x7fb0040cbce0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7faff80097c0 tx=0x7faff801c3f0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.160+0000 7fb009648640 1 -- 172.21.15.6:0/2791987798 shutdown_connections 2023-07-21T22:38:53.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.160+0000 7fb009648640 1 --2- 172.21.15.6:0/2791987798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb00406b150 0x7fb00406b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.160+0000 7fb009648640 1 --2- 172.21.15.6:0/2791987798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb00406c0c0 0x7fb0040cbce0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.160+0000 7fb009648640 1 -- 172.21.15.6:0/2791987798 >> 172.21.15.6:0/2791987798 conn(0x7fb0040cb4f0 msgr2=0x7fb0040cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:53.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.160+0000 7fb009648640 1 -- 172.21.15.6:0/2791987798 shutdown_connections 2023-07-21T22:38:53.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.160+0000 7fb009648640 1 -- 172.21.15.6:0/2791987798 wait complete. 2023-07-21T22:38:53.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb009648640 1 Processor -- start 2023-07-21T22:38:53.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb009648640 1 -- start start 2023-07-21T22:38:53.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb009648640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb00406b150 0x7fb0040ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:53.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb009648640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00406c0c0 0x7fb0040c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:53.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb009648640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb004158d90 0x7fb0040c5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:53.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb009648640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb004156390 con 0x7fb00406c0c0 2023-07-21T22:38:53.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb009648640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00414e040 con 0x7fb00406b150 2023-07-21T22:38:53.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb009648640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb004156bf0 con 0x7fb004158d90 2023-07-21T22:38:53.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb0027fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00406c0c0 0x7fb0040c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:53.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb0027fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00406c0c0 0x7fb0040c50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43818/0 (socket says 172.21.15.6:43818) 2023-07-21T22:38:53.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb0027fc640 1 -- 172.21.15.6:0/2874002098 learned_addr learned my addr 172.21.15.6:0/2874002098 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:53.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb0037fe640 1 --2- 172.21.15.6:0/2874002098 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb004158d90 0x7fb0040c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:53.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb002ffd640 1 --2- 172.21.15.6:0/2874002098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb00406b150 0x7fb0040ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:53.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb0027fc640 1 -- 172.21.15.6:0/2874002098 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb004158d90 msgr2=0x7fb0040c5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:53.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb0027fc640 1 --2- 172.21.15.6:0/2874002098 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb004158d90 0x7fb0040c5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb0027fc640 1 -- 172.21.15.6:0/2874002098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb00406b150 msgr2=0x7fb0040ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:53.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb0027fc640 1 --2- 172.21.15.6:0/2874002098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb00406b150 0x7fb0040ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb0027fc640 1 -- 172.21.15.6:0/2874002098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc009b30 con 0x7fb00406c0c0 2023-07-21T22:38:53.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb0037fe640 1 --2- 172.21.15.6:0/2874002098 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb004158d90 0x7fb0040c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:53.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb002ffd640 1 --2- 172.21.15.6:0/2874002098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb00406b150 0x7fb0040ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:53.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb0027fc640 1 --2- 172.21.15.6:0/2874002098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00406c0c0 0x7fb0040c50e0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7faff80ad040 tx=0x7faff801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:53.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fafeb7fe640 1 -- 172.21.15.6:0/2874002098 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff80bf610 con 0x7fb00406c0c0 2023-07-21T22:38:53.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fafeb7fe640 1 -- 172.21.15.6:0/2874002098 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff80bf770 con 0x7fb00406c0c0 2023-07-21T22:38:53.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fafeb7fe640 1 -- 172.21.15.6:0/2874002098 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff80bfb00 con 0x7fb00406c0c0 2023-07-21T22:38:53.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb009648640 1 -- 172.21.15.6:0/2874002098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff8009420 con 0x7fb00406c0c0 2023-07-21T22:38:53.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb009648640 1 -- 172.21.15.6:0/2874002098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0040c7b30 con 0x7fb00406c0c0 2023-07-21T22:38:53.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.164+0000 7fb009648640 1 -- 172.21.15.6:0/2874002098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb004156d80 con 0x7fb00406c0c0 2023-07-21T22:38:53.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.168+0000 7fafeb7fe640 1 -- 172.21.15.6:0/2874002098 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7faff80bfc60 con 0x7fb00406c0c0 2023-07-21T22:38:53.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.168+0000 7fafeb7fe640 1 --2- 172.21.15.6:0/2874002098 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7faff00663a0 0x7faff0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:53.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.168+0000 7fafeb7fe640 1 -- 172.21.15.6:0/2874002098 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6513+0+0 (secure 0 0 0) 0x7faff80a8050 con 0x7fb00406c0c0 2023-07-21T22:38:53.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.168+0000 7fb002ffd640 1 --2- 172.21.15.6:0/2874002098 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7faff00663a0 0x7faff0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:53.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.168+0000 7fb002ffd640 1 --2- 172.21.15.6:0/2874002098 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7faff00663a0 0x7faff0068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faff4000f70 tx=0x7faff4009040 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:53.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.172+0000 7fafeb7fe640 1 -- 172.21.15.6:0/2874002098 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faff80eb8f0 con 0x7fb00406c0c0 2023-07-21T22:38:53.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.328+0000 7fb009648640 1 -- 172.21.15.6:0/2874002098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb00404e020 con 0x7fb00406c0c0 2023-07-21T22:38:54.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.984+0000 7fafeb7fe640 1 -- 172.21.15.6:0/2874002098 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v148) v1 ==== 169+0+0 (secure 0 0 0) 0x7faff80eef10 con 0x7fb00406c0c0 2023-07-21T22:38:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-07-21T22:38:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.992+0000 7fb009648640 1 -- 172.21.15.6:0/2874002098 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7faff00663a0 msgr2=0x7faff0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.992+0000 7fb009648640 1 --2- 172.21.15.6:0/2874002098 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7faff00663a0 0x7faff0068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faff4000f70 tx=0x7faff4009040 comp rx=0 tx=0).stop 2023-07-21T22:38:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.992+0000 7fb009648640 1 -- 172.21.15.6:0/2874002098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00406c0c0 msgr2=0x7fb0040c50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.992+0000 7fb009648640 1 --2- 172.21.15.6:0/2874002098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00406c0c0 0x7fb0040c50e0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7faff80ad040 tx=0x7faff801ac30 comp rx=0 tx=0).stop 2023-07-21T22:38:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.992+0000 7fb009648640 1 -- 172.21.15.6:0/2874002098 shutdown_connections 2023-07-21T22:38:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.992+0000 7fb009648640 1 --2- 172.21.15.6:0/2874002098 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb004158d90 0x7fb0040c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.992+0000 7fb009648640 1 --2- 172.21.15.6:0/2874002098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb00406c0c0 0x7fb0040c50e0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.992+0000 7fb009648640 1 --2- 172.21.15.6:0/2874002098 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7faff00663a0 0x7faff0068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.992+0000 7fb009648640 1 --2- 172.21.15.6:0/2874002098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb00406b150 0x7fb0040ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.992+0000 7fb009648640 1 -- 172.21.15.6:0/2874002098 >> 172.21.15.6:0/2874002098 conn(0x7fb0040cb4f0 msgr2=0x7fb0040cc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.992+0000 7fb009648640 1 -- 172.21.15.6:0/2874002098 shutdown_connections 2023-07-21T22:38:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:53.992+0000 7fb009648640 1 -- 172.21.15.6:0/2874002098 wait complete. 2023-07-21T22:38:54.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-21T22:38:54.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.168+0000 7fb192574640 1 Processor -- start 2023-07-21T22:38:54.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.168+0000 7fb192574640 1 -- start start 2023-07-21T22:38:54.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.168+0000 7fb192574640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb18c0cd670 0x7fb18c0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:54.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.168+0000 7fb192574640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb18c158df0 0x7fb18c159290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:54.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.168+0000 7fb192574640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18c0b08d0 con 0x7fb18c156560 2023-07-21T22:38:54.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.168+0000 7fb192574640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18c1597d0 con 0x7fb18c0cd670 2023-07-21T22:38:54.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.168+0000 7fb192574640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18c159cb0 con 0x7fb18c158df0 2023-07-21T22:38:54.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.168+0000 7fb18b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb18c0cd670 0x7fb18c0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:54.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.168+0000 7fb18b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb18c0cd670 0x7fb18c0cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43834/0 (socket says 172.21.15.6:43834) 2023-07-21T22:38:54.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.168+0000 7fb18b7fe640 1 -- 172.21.15.6:0/4172936698 learned_addr learned my addr 172.21.15.6:0/4172936698 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:54.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.168+0000 7fb190b11640 1 --2- 172.21.15.6:0/4172936698 >> v2:172.21.15.161:3300/0 conn(0x7fb18c158df0 0x7fb18c159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:54.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.168+0000 7fb18b7fe640 1 -- 172.21.15.6:0/4172936698 >> v2:172.21.15.161:3300/0 conn(0x7fb18c158df0 msgr2=0x7fb18c159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:54.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.168+0000 7fb18b7fe640 1 --2- 172.21.15.6:0/4172936698 >> v2:172.21.15.161:3300/0 conn(0x7fb18c158df0 0x7fb18c159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.168+0000 7fb18b7fe640 1 -- 172.21.15.6:0/4172936698 >> v1:172.21.15.6:6789/0 conn(0x7fb18c156560 legacy=0x7fb18c0ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:54.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.168+0000 7fb18b7fe640 1 -- 172.21.15.6:0/4172936698 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18c1599d0 con 0x7fb18c0cd670 2023-07-21T22:38:54.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.172+0000 7fb190b11640 1 --2- 172.21.15.6:0/4172936698 >> v2:172.21.15.161:3300/0 conn(0x7fb18c158df0 0x7fb18c159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:54.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.172+0000 7fb18b7fe640 1 --2- 172.21.15.6:0/4172936698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb18c0cd670 0x7fb18c0cb3e0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0c86e0 tx=0x7fb18001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86df959ce632ec46 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:54.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.172+0000 7fb18affd640 1 -- 172.21.15.6:0/4172936698 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1800aa650 con 0x7fb18c0cd670 2023-07-21T22:38:54.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.172+0000 7fb18affd640 1 -- 172.21.15.6:0/4172936698 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1800aa7b0 con 0x7fb18c0cd670 2023-07-21T22:38:54.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.172+0000 7fb18affd640 1 -- 172.21.15.6:0/4172936698 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1800aab40 con 0x7fb18c0cd670 2023-07-21T22:38:54.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.172+0000 7fb192574640 1 -- 172.21.15.6:0/4172936698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb18c0cd670 msgr2=0x7fb18c0cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:54.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.172+0000 7fb192574640 1 --2- 172.21.15.6:0/4172936698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb18c0cd670 0x7fb18c0cb3e0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0c86e0 tx=0x7fb18001c4d0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.172+0000 7fb192574640 1 -- 172.21.15.6:0/4172936698 shutdown_connections 2023-07-21T22:38:54.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.172+0000 7fb192574640 1 --2- 172.21.15.6:0/4172936698 >> v2:172.21.15.161:3300/0 conn(0x7fb18c158df0 0x7fb18c159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.172+0000 7fb192574640 1 --2- 172.21.15.6:0/4172936698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb18c0cd670 0x7fb18c0cb3e0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.172+0000 7fb192574640 1 -- 172.21.15.6:0/4172936698 >> 172.21.15.6:0/4172936698 conn(0x7fb18c0afac0 msgr2=0x7fb18c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:54.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.172+0000 7fb192574640 1 -- 172.21.15.6:0/4172936698 shutdown_connections 2023-07-21T22:38:54.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.172+0000 7fb192574640 1 -- 172.21.15.6:0/4172936698 wait complete. 2023-07-21T22:38:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb192574640 1 Processor -- start 2023-07-21T22:38:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb192574640 1 -- start start 2023-07-21T22:38:54.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb192574640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb18c0cd670 0x7fb18c1f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb192574640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb18c156560 0x7fb18c070a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb192574640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb18c158df0 0x7fb18c1f5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb192574640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c157d60 con 0x7fb18c0cd670 2023-07-21T22:38:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb192574640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c0b30d0 con 0x7fb18c156560 2023-07-21T22:38:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb192574640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c0b2550 con 0x7fb18c158df0 2023-07-21T22:38:54.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb18bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb18c0cd670 0x7fb18c1f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:54.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb18bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb18c0cd670 0x7fb18c1f5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43840/0 (socket says 172.21.15.6:43840) 2023-07-21T22:38:54.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb18bfff640 1 -- 172.21.15.6:0/4133803172 learned_addr learned my addr 172.21.15.6:0/4133803172 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb18b7fe640 1 --2- 172.21.15.6:0/4133803172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb18c156560 0x7fb18c070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb190b11640 1 --2- 172.21.15.6:0/4133803172 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb18c158df0 0x7fb18c1f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb18bfff640 1 -- 172.21.15.6:0/4133803172 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb18c158df0 msgr2=0x7fb18c1f5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb18bfff640 1 --2- 172.21.15.6:0/4133803172 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb18c158df0 0x7fb18c1f5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb18bfff640 1 -- 172.21.15.6:0/4133803172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb18c156560 msgr2=0x7fb18c070a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:54.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb18bfff640 1 --2- 172.21.15.6:0/4133803172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb18c156560 0x7fb18c070a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb18bfff640 1 -- 172.21.15.6:0/4133803172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1800094d0 con 0x7fb18c0cd670 2023-07-21T22:38:54.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb18b7fe640 1 --2- 172.21.15.6:0/4133803172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb18c156560 0x7fb18c070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:54.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb18bfff640 1 --2- 172.21.15.6:0/4133803172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb18c0cd670 0x7fb18c1f5a10 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fb17c00c500 tx=0x7fb17c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:54.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.176+0000 7fb188ff9640 1 -- 172.21.15.6:0/4133803172 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c005220 con 0x7fb18c0cd670 2023-07-21T22:38:54.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.180+0000 7fb188ff9640 1 -- 172.21.15.6:0/4133803172 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17c005380 con 0x7fb18c0cd670 2023-07-21T22:38:54.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.180+0000 7fb188ff9640 1 -- 172.21.15.6:0/4133803172 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c007270 con 0x7fb18c0cd670 2023-07-21T22:38:54.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.180+0000 7fb192574640 1 -- 172.21.15.6:0/4133803172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18c0b2830 con 0x7fb18c0cd670 2023-07-21T22:38:54.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.180+0000 7fb192574640 1 -- 172.21.15.6:0/4133803172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18c0b2df0 con 0x7fb18c0cd670 2023-07-21T22:38:54.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.180+0000 7fb192574640 1 -- 172.21.15.6:0/4133803172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18c0678d0 con 0x7fb18c0cd670 2023-07-21T22:38:54.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.180+0000 7fb188ff9640 1 -- 172.21.15.6:0/4133803172 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb17c0073d0 con 0x7fb18c0cd670 2023-07-21T22:38:54.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.180+0000 7fb188ff9640 1 --2- 172.21.15.6:0/4133803172 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fb1780663d0 0x7fb178068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:54.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.180+0000 7fb188ff9640 1 -- 172.21.15.6:0/4133803172 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6099+0+0 (secure 0 0 0) 0x7fb17c083830 con 0x7fb18c0cd670 2023-07-21T22:38:54.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.180+0000 7fb18b7fe640 1 --2- 172.21.15.6:0/4133803172 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fb1780663d0 0x7fb178068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:54.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.184+0000 7fb18b7fe640 1 --2- 172.21.15.6:0/4133803172 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fb1780663d0 0x7fb178068880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb1800ae000 tx=0x7fb1800a7000 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:54.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.184+0000 7fb188ff9640 1 -- 172.21.15.6:0/4133803172 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb17c050ae0 con 0x7fb18c0cd670 2023-07-21T22:38:54.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.344+0000 7fb192574640 1 -- 172.21.15.6:0/4133803172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fb18c163550 con 0x7fb18c0cd670 2023-07-21T22:38:54.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.348+0000 7fb188ff9640 1 -- 172.21.15.6:0/4133803172 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v49) v1 ==== 115+0+0 (secure 0 0 0) 0x7fb17c054100 con 0x7fb18c0cd670 2023-07-21T22:38:54.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.348+0000 7fb192574640 1 -- 172.21.15.6:0/4133803172 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fb1780663d0 msgr2=0x7fb178068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:54.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.348+0000 7fb192574640 1 --2- 172.21.15.6:0/4133803172 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fb1780663d0 0x7fb178068880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb1800ae000 tx=0x7fb1800a7000 comp rx=0 tx=0).stop 2023-07-21T22:38:54.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.348+0000 7fb192574640 1 -- 172.21.15.6:0/4133803172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb18c0cd670 msgr2=0x7fb18c1f5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:54.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.348+0000 7fb192574640 1 --2- 172.21.15.6:0/4133803172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb18c0cd670 0x7fb18c1f5a10 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fb17c00c500 tx=0x7fb17c00c9c0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.348+0000 7fb192574640 1 -- 172.21.15.6:0/4133803172 shutdown_connections 2023-07-21T22:38:54.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.348+0000 7fb192574640 1 --2- 172.21.15.6:0/4133803172 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb18c158df0 0x7fb18c1f5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.348+0000 7fb192574640 1 --2- 172.21.15.6:0/4133803172 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fb1780663d0 0x7fb178068880 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.348+0000 7fb192574640 1 --2- 172.21.15.6:0/4133803172 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb18c156560 0x7fb18c070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.348+0000 7fb192574640 1 --2- 172.21.15.6:0/4133803172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb18c0cd670 0x7fb18c1f5a10 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.348+0000 7fb192574640 1 -- 172.21.15.6:0/4133803172 >> 172.21.15.6:0/4133803172 conn(0x7fb18c0afac0 msgr2=0x7fb18c0ab8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:54.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.352+0000 7fb192574640 1 -- 172.21.15.6:0/4133803172 shutdown_connections 2023-07-21T22:38:54.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.352+0000 7fb192574640 1 -- 172.21.15.6:0/4133803172 wait complete. 2023-07-21T22:38:54.414 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-21T22:38:54.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.524+0000 7f578086d640 1 Processor -- start 2023-07-21T22:38:54.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.524+0000 7f578086d640 1 -- start start 2023-07-21T22:38:54.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.528+0000 7f578086d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f577c071030 0x7f577c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:54.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.528+0000 7f578086d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f577c15e060 0x7f577c0c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:54.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.528+0000 7f578086d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f577c0cbe50 con 0x7f577c159a70 2023-07-21T22:38:54.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.528+0000 7f578086d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577c0cd660 con 0x7f577c15e060 2023-07-21T22:38:54.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.528+0000 7f578086d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577c0cc0a0 con 0x7f577c071030 2023-07-21T22:38:54.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.528+0000 7f577ad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f577c15e060 0x7f577c0c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.528+0000 7f577ad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f577c15e060 0x7f577c0c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43850/0 (socket says 172.21.15.6:43850) 2023-07-21T22:38:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.528+0000 7f577ad9d640 1 -- 172.21.15.6:0/313650745 learned_addr learned my addr 172.21.15.6:0/313650745 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:54.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.528+0000 7f5773fff640 1 --2- 172.21.15.6:0/313650745 >> v2:172.21.15.161:3300/0 conn(0x7f577c071030 0x7f577c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:54.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.528+0000 7f577ad9d640 1 -- 172.21.15.6:0/313650745 >> v2:172.21.15.161:3300/0 conn(0x7f577c071030 msgr2=0x7f577c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:54.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.528+0000 7f577ad9d640 1 --2- 172.21.15.6:0/313650745 >> v2:172.21.15.161:3300/0 conn(0x7f577c071030 0x7f577c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.528+0000 7f577ad9d640 1 -- 172.21.15.6:0/313650745 >> v1:172.21.15.6:6789/0 conn(0x7f577c159a70 legacy=0x7f577c070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:54.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.528+0000 7f577ad9d640 1 -- 172.21.15.6:0/313650745 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c0cc380 con 0x7f577c15e060 2023-07-21T22:38:54.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.532+0000 7f577ad9d640 1 --2- 172.21.15.6:0/313650745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f577c15e060 0x7f577c0c9da0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f577c06d6c0 tx=0x7f577401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848cbdd955d73f3b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:54.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.532+0000 7f5779d9b640 1 -- 172.21.15.6:0/313650745 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57740a5760 con 0x7f577c15e060 2023-07-21T22:38:54.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.532+0000 7f5779d9b640 1 -- 172.21.15.6:0/313650745 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57740a58c0 con 0x7f577c15e060 2023-07-21T22:38:54.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.532+0000 7f5779d9b640 1 -- 172.21.15.6:0/313650745 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57740a5c50 con 0x7f577c15e060 2023-07-21T22:38:54.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.532+0000 7f578086d640 1 -- 172.21.15.6:0/313650745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f577c15e060 msgr2=0x7f577c0c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:54.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.532+0000 7f578086d640 1 --2- 172.21.15.6:0/313650745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f577c15e060 0x7f577c0c9da0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f577c06d6c0 tx=0x7f577401c880 comp rx=0 tx=0).stop 2023-07-21T22:38:54.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.532+0000 7f578086d640 1 -- 172.21.15.6:0/313650745 shutdown_connections 2023-07-21T22:38:54.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.532+0000 7f578086d640 1 --2- 172.21.15.6:0/313650745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f577c15e060 0x7f577c0c9da0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.532+0000 7f578086d640 1 --2- 172.21.15.6:0/313650745 >> v2:172.21.15.161:3300/0 conn(0x7f577c071030 0x7f577c0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.532+0000 7f578086d640 1 -- 172.21.15.6:0/313650745 >> 172.21.15.6:0/313650745 conn(0x7f577c0afac0 msgr2=0x7f577c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:54.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.532+0000 7f578086d640 1 -- 172.21.15.6:0/313650745 shutdown_connections 2023-07-21T22:38:54.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.532+0000 7f578086d640 1 -- 172.21.15.6:0/313650745 wait complete. 2023-07-21T22:38:54.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.532+0000 7f578086d640 1 Processor -- start 2023-07-21T22:38:54.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.532+0000 7f578086d640 1 -- start start 2023-07-21T22:38:54.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.532+0000 7f578086d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f577c071030 0x7f577c0af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:54.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.532+0000 7f578086d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f577c159a70 0x7f577c153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:54.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f578086d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f577c15e060 0x7f577c1537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:54.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f578086d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c150e50 con 0x7f577c159a70 2023-07-21T22:38:54.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f578086d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c150b70 con 0x7f577c15e060 2023-07-21T22:38:54.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f578086d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577c0b0e60 con 0x7f577c071030 2023-07-21T22:38:54.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f5773fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f577c159a70 0x7f577c153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:54.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f5773fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f577c159a70 0x7f577c153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43852/0 (socket says 172.21.15.6:43852) 2023-07-21T22:38:54.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f5773fff640 1 -- 172.21.15.6:0/3075173632 learned_addr learned my addr 172.21.15.6:0/3075173632 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:54.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f577a59c640 1 --2- 172.21.15.6:0/3075173632 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f577c071030 0x7f577c0af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:54.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f577ad9d640 1 --2- 172.21.15.6:0/3075173632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f577c15e060 0x7f577c1537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:54.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f5773fff640 1 -- 172.21.15.6:0/3075173632 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f577c071030 msgr2=0x7f577c0af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:54.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f5773fff640 1 --2- 172.21.15.6:0/3075173632 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f577c071030 0x7f577c0af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f5773fff640 1 -- 172.21.15.6:0/3075173632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f577c15e060 msgr2=0x7f577c1537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:54.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f5773fff640 1 --2- 172.21.15.6:0/3075173632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f577c15e060 0x7f577c1537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f5773fff640 1 -- 172.21.15.6:0/3075173632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5774009b30 con 0x7f577c159a70 2023-07-21T22:38:54.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f5773fff640 1 --2- 172.21.15.6:0/3075173632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f577c159a70 0x7f577c153290 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f576400d5f0 tx=0x7f576400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:54.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f5772ffd640 1 -- 172.21.15.6:0/3075173632 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57640125f0 con 0x7f577c159a70 2023-07-21T22:38:54.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f5772ffd640 1 -- 172.21.15.6:0/3075173632 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5764012750 con 0x7f577c159a70 2023-07-21T22:38:54.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f5772ffd640 1 -- 172.21.15.6:0/3075173632 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5764012ae0 con 0x7f577c159a70 2023-07-21T22:38:54.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f578086d640 1 -- 172.21.15.6:0/3075173632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577c0b1140 con 0x7f577c159a70 2023-07-21T22:38:54.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f578086d640 1 -- 172.21.15.6:0/3075173632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577c14e910 con 0x7f577c159a70 2023-07-21T22:38:54.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f578086d640 1 -- 172.21.15.6:0/3075173632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577c0678d0 con 0x7f577c159a70 2023-07-21T22:38:54.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f5772ffd640 1 -- 172.21.15.6:0/3075173632 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5764012c40 con 0x7f577c159a70 2023-07-21T22:38:54.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.536+0000 7f5772ffd640 1 --2- 172.21.15.6:0/3075173632 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f575c0663d0 0x7f575c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:54.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.540+0000 7f5772ffd640 1 -- 172.21.15.6:0/3075173632 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f5764084270 con 0x7f577c159a70 2023-07-21T22:38:54.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.540+0000 7f577a59c640 1 --2- 172.21.15.6:0/3075173632 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f575c0663d0 0x7f575c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:54.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.540+0000 7f577a59c640 1 --2- 172.21.15.6:0/3075173632 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f575c0663d0 0x7f575c068880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f576c007fd0 tx=0x7f576c009040 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:54.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.540+0000 7f5772ffd640 1 -- 172.21.15.6:0/3075173632 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5764051650 con 0x7f577c159a70 2023-07-21T22:38:54.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.696+0000 7f578086d640 1 -- 172.21.15.6:0/3075173632 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f577c0cd7a0 con 0x7f577c159a70 2023-07-21T22:38:54.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.700+0000 7f5772ffd640 1 -- 172.21.15.6:0/3075173632 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v50) v1 ==== 120+0+0 (secure 0 0 0) 0x7f5764007380 con 0x7f577c159a70 2023-07-21T22:38:54.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.704+0000 7f578086d640 1 -- 172.21.15.6:0/3075173632 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f575c0663d0 msgr2=0x7f575c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:54.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.704+0000 7f578086d640 1 --2- 172.21.15.6:0/3075173632 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f575c0663d0 0x7f575c068880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f576c007fd0 tx=0x7f576c009040 comp rx=0 tx=0).stop 2023-07-21T22:38:54.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.704+0000 7f578086d640 1 -- 172.21.15.6:0/3075173632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f577c159a70 msgr2=0x7f577c153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:54.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.704+0000 7f578086d640 1 --2- 172.21.15.6:0/3075173632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f577c159a70 0x7f577c153290 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f576400d5f0 tx=0x7f576400dab0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.704+0000 7f578086d640 1 -- 172.21.15.6:0/3075173632 shutdown_connections 2023-07-21T22:38:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.704+0000 7f578086d640 1 --2- 172.21.15.6:0/3075173632 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f575c0663d0 0x7f575c068880 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.704+0000 7f578086d640 1 --2- 172.21.15.6:0/3075173632 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f577c15e060 0x7f577c1537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.704+0000 7f578086d640 1 --2- 172.21.15.6:0/3075173632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f577c159a70 0x7f577c153290 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.704+0000 7f578086d640 1 --2- 172.21.15.6:0/3075173632 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f577c071030 0x7f577c0af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.704+0000 7f578086d640 1 -- 172.21.15.6:0/3075173632 >> 172.21.15.6:0/3075173632 conn(0x7f577c0afac0 msgr2=0x7f577c06cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.704+0000 7f578086d640 1 -- 172.21.15.6:0/3075173632 shutdown_connections 2023-07-21T22:38:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.704+0000 7f578086d640 1 -- 172.21.15.6:0/3075173632 wait complete. 2023-07-21T22:38:54.767 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-21T22:38:54.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.868+0000 7f824ed37640 1 Processor -- start 2023-07-21T22:38:54.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.868+0000 7f824ed37640 1 -- start start 2023-07-21T22:38:54.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.872+0000 7f824ed37640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f824806a540 0x7f82480cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:54.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.872+0000 7f824ed37640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f824806a910 0x7f82480d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:54.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.872+0000 7f824ed37640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82480cd1f0 con 0x7f82481601f0 2023-07-21T22:38:54.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.872+0000 7f824ed37640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82480cd4d0 con 0x7f824806a910 2023-07-21T22:38:54.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.872+0000 7f824ed37640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82480cd7b0 con 0x7f824806a540 2023-07-21T22:38:54.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.872+0000 7f824d2d4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f824806a910 0x7f82480d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:54.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.872+0000 7f824d2d4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f824806a910 0x7f82480d0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43854/0 (socket says 172.21.15.6:43854) 2023-07-21T22:38:54.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.872+0000 7f824d2d4640 1 -- 172.21.15.6:0/2017588676 learned_addr learned my addr 172.21.15.6:0/2017588676 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:54.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.872+0000 7f824cad3640 1 --2- 172.21.15.6:0/2017588676 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f824806a540 0x7f82480cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:54.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.872+0000 7f824d2d4640 1 -- 172.21.15.6:0/2017588676 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f824806a540 msgr2=0x7f82480cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.872+0000 7f824d2d4640 1 --2- 172.21.15.6:0/2017588676 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f824806a540 0x7f82480cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.872+0000 7f824d2d4640 1 -- 172.21.15.6:0/2017588676 >> v1:172.21.15.161:6789/0 conn(0x7f82481601f0 legacy=0x7f82480cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.872+0000 7f824d2d4640 1 -- 172.21.15.6:0/2017588676 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82480cfe40 con 0x7f824806a910 2023-07-21T22:38:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.872+0000 7f824cad3640 1 --2- 172.21.15.6:0/2017588676 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f824806a540 0x7f82480cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.872+0000 7f824d2d4640 1 --2- 172.21.15.6:0/2017588676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f824806a910 0x7f82480d0360 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f8240009e50 tx=0x7f824001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e580c975be551a03 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f82477fe640 1 -- 172.21.15.6:0/2017588676 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82400a5720 con 0x7f824806a910 2023-07-21T22:38:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f82477fe640 1 -- 172.21.15.6:0/2017588676 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82400a5880 con 0x7f824806a910 2023-07-21T22:38:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f82477fe640 1 -- 172.21.15.6:0/2017588676 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82400a5c10 con 0x7f824806a910 2023-07-21T22:38:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f824ed37640 1 -- 172.21.15.6:0/2017588676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f824806a910 msgr2=0x7f82480d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f824ed37640 1 --2- 172.21.15.6:0/2017588676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f824806a910 0x7f82480d0360 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f8240009e50 tx=0x7f824001c980 comp rx=0 tx=0).stop 2023-07-21T22:38:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f824ed37640 1 -- 172.21.15.6:0/2017588676 shutdown_connections 2023-07-21T22:38:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f824ed37640 1 --2- 172.21.15.6:0/2017588676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f824806a910 0x7f82480d0360 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f824ed37640 1 --2- 172.21.15.6:0/2017588676 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f824806a540 0x7f82480cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f824ed37640 1 -- 172.21.15.6:0/2017588676 >> 172.21.15.6:0/2017588676 conn(0x7f8248099490 msgr2=0x7f8248089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f824ed37640 1 -- 172.21.15.6:0/2017588676 shutdown_connections 2023-07-21T22:38:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f824ed37640 1 -- 172.21.15.6:0/2017588676 wait complete. 2023-07-21T22:38:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f824ed37640 1 Processor -- start 2023-07-21T22:38:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f824ed37640 1 -- start start 2023-07-21T22:38:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f824ed37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f824806a540 0x7f8248145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f824ed37640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f824806a910 0x7f824815d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f824ed37640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82481601f0 0x7f824815f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f824ed37640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824815e780 con 0x7f824806a540 2023-07-21T22:38:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f824ed37640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8248145bb0 con 0x7f824806a910 2023-07-21T22:38:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f824ed37640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824815db70 con 0x7f82481601f0 2023-07-21T22:38:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f824cad3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f824806a540 0x7f8248145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f824cad3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f824806a540 0x7f8248145670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43868/0 (socket says 172.21.15.6:43868) 2023-07-21T22:38:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.876+0000 7f824cad3640 1 -- 172.21.15.6:0/2260008725 learned_addr learned my addr 172.21.15.6:0/2260008725 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.880+0000 7f8247fff640 1 --2- 172.21.15.6:0/2260008725 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f824806a910 0x7f824815d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:54.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.880+0000 7f824d2d4640 1 --2- 172.21.15.6:0/2260008725 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82481601f0 0x7f824815f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:54.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.880+0000 7f824cad3640 1 -- 172.21.15.6:0/2260008725 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82481601f0 msgr2=0x7f824815f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:54.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.880+0000 7f824cad3640 1 --2- 172.21.15.6:0/2260008725 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82481601f0 0x7f824815f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.880+0000 7f824cad3640 1 -- 172.21.15.6:0/2260008725 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f824806a910 msgr2=0x7f824815d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:54.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.880+0000 7f824cad3640 1 --2- 172.21.15.6:0/2260008725 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f824806a910 0x7f824815d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:54.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.880+0000 7f824cad3640 1 -- 172.21.15.6:0/2260008725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8240009b30 con 0x7f824806a540 2023-07-21T22:38:54.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.880+0000 7f824cad3640 1 --2- 172.21.15.6:0/2260008725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f824806a540 0x7f8248145670 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f823c00d7d0 tx=0x7f823c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:54.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.880+0000 7f82457fa640 1 -- 172.21.15.6:0/2260008725 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c0059a0 con 0x7f824806a540 2023-07-21T22:38:54.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.880+0000 7f82457fa640 1 -- 172.21.15.6:0/2260008725 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823c005b00 con 0x7f824806a540 2023-07-21T22:38:54.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.880+0000 7f824ed37640 1 -- 172.21.15.6:0/2260008725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f824815de50 con 0x7f824806a540 2023-07-21T22:38:54.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.880+0000 7f82457fa640 1 -- 172.21.15.6:0/2260008725 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c005e90 con 0x7f824806a540 2023-07-21T22:38:54.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.880+0000 7f824ed37640 1 -- 172.21.15.6:0/2260008725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824815e410 con 0x7f824806a540 2023-07-21T22:38:54.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.880+0000 7f824ed37640 1 -- 172.21.15.6:0/2260008725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82480678d0 con 0x7f824806a540 2023-07-21T22:38:54.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.880+0000 7f82457fa640 1 -- 172.21.15.6:0/2260008725 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f823c004030 con 0x7f824806a540 2023-07-21T22:38:54.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.884+0000 7f82457fa640 1 --2- 172.21.15.6:0/2260008725 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f822c0663a0 0x7f822c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:54.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.884+0000 7f82457fa640 1 -- 172.21.15.6:0/2260008725 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f823c083e80 con 0x7f824806a540 2023-07-21T22:38:54.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.884+0000 7f8247fff640 1 --2- 172.21.15.6:0/2260008725 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f822c0663a0 0x7f822c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:54.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.884+0000 7f8247fff640 1 --2- 172.21.15.6:0/2260008725 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f822c0663a0 0x7f822c068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f824806fd60 tx=0x7f8234009040 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:54.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:54.884+0000 7f82457fa640 1 -- 172.21.15.6:0/2260008725 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f823c054c40 con 0x7f824806a540 2023-07-21T22:38:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.040+0000 7f824ed37640 1 -- 172.21.15.6:0/2260008725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f82480999b0 con 0x7f824806a540 2023-07-21T22:38:55.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.044+0000 7f82457fa640 1 -- 172.21.15.6:0/2260008725 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7f823c0547d0 con 0x7f824806a540 2023-07-21T22:38:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.048+0000 7f824ed37640 1 -- 172.21.15.6:0/2260008725 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f822c0663a0 msgr2=0x7f822c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.048+0000 7f824ed37640 1 --2- 172.21.15.6:0/2260008725 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f822c0663a0 0x7f822c068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f824806fd60 tx=0x7f8234009040 comp rx=0 tx=0).stop 2023-07-21T22:38:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.048+0000 7f824ed37640 1 -- 172.21.15.6:0/2260008725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f824806a540 msgr2=0x7f8248145670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.048+0000 7f824ed37640 1 --2- 172.21.15.6:0/2260008725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f824806a540 0x7f8248145670 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f823c00d7d0 tx=0x7f823c00dc90 comp rx=0 tx=0).stop 2023-07-21T22:38:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.048+0000 7f824ed37640 1 -- 172.21.15.6:0/2260008725 shutdown_connections 2023-07-21T22:38:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.048+0000 7f824ed37640 1 --2- 172.21.15.6:0/2260008725 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82481601f0 0x7f824815f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.048+0000 7f824ed37640 1 --2- 172.21.15.6:0/2260008725 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f822c0663a0 0x7f822c068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.048+0000 7f824ed37640 1 --2- 172.21.15.6:0/2260008725 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f824806a910 0x7f824815d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.048+0000 7f824ed37640 1 --2- 172.21.15.6:0/2260008725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f824806a540 0x7f8248145670 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.048+0000 7f824ed37640 1 -- 172.21.15.6:0/2260008725 >> 172.21.15.6:0/2260008725 conn(0x7f8248099490 msgr2=0x7f82480aed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.048+0000 7f824ed37640 1 -- 172.21.15.6:0/2260008725 shutdown_connections 2023-07-21T22:38:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.048+0000 7f824ed37640 1 -- 172.21.15.6:0/2260008725 wait complete. 2023-07-21T22:38:55.112 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-07-21T22:38:55.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.212+0000 7f9655574640 1 Processor -- start 2023-07-21T22:38:55.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.212+0000 7f9655574640 1 -- start start 2023-07-21T22:38:55.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.212+0000 7f9655574640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f965006b1e0 0x7f96500c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:55.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.212+0000 7f9655574640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f96500c21f0 0x7f96500cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:55.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.212+0000 7f9655574640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96500cac70 con 0x7f9650070b70 2023-07-21T22:38:55.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.212+0000 7f9655574640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96500ca060 con 0x7f96500c21f0 2023-07-21T22:38:55.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.212+0000 7f9655574640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96500ca340 con 0x7f965006b1e0 2023-07-21T22:38:55.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.212+0000 7f964f7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f96500c21f0 0x7f96500cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:55.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.212+0000 7f9647fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f965006b1e0 0x7f96500c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:55.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.212+0000 7f964f7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f96500c21f0 0x7f96500cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:44098/0 (socket says 172.21.15.6:44098) 2023-07-21T22:38:55.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.212+0000 7f964effd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f9650070b70 0x7f9650070f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:53800/0 (socket says 172.21.15.6:53800) 2023-07-21T22:38:55.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.212+0000 7f964f7fe640 1 -- 172.21.15.6:0/639348370 learned_addr learned my addr 172.21.15.6:0/639348370 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:55.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.216+0000 7f964f7fe640 1 -- 172.21.15.6:0/639348370 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f965006b1e0 msgr2=0x7f96500c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:55.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.216+0000 7f964f7fe640 1 --2- 172.21.15.6:0/639348370 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f965006b1e0 0x7f96500c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:55.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.216+0000 7f964f7fe640 1 -- 172.21.15.6:0/639348370 >> v1:172.21.15.161:6789/0 conn(0x7f9650070b70 legacy=0x7f9650070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:55.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.216+0000 7f964f7fe640 1 -- 172.21.15.6:0/639348370 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96500ca620 con 0x7f96500c21f0 2023-07-21T22:38:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.216+0000 7f964f7fe640 1 --2- 172.21.15.6:0/639348370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96500c21f0 0x7f96500cb100 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9648009e50 tx=0x7f964801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17557c527d5480ef server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.216+0000 7f964e7fc640 1 -- 172.21.15.6:0/639348370 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96480a5830 con 0x7f96500c21f0 2023-07-21T22:38:55.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.216+0000 7f964e7fc640 1 -- 172.21.15.6:0/639348370 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96480a5990 con 0x7f96500c21f0 2023-07-21T22:38:55.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.216+0000 7f964e7fc640 1 -- 172.21.15.6:0/639348370 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96480a5d20 con 0x7f96500c21f0 2023-07-21T22:38:55.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.216+0000 7f9655574640 1 -- 172.21.15.6:0/639348370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96500c21f0 msgr2=0x7f96500cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:55.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.216+0000 7f9655574640 1 --2- 172.21.15.6:0/639348370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96500c21f0 0x7f96500cb100 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f9648009e50 tx=0x7f964801c950 comp rx=0 tx=0).stop 2023-07-21T22:38:55.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f9655574640 1 -- 172.21.15.6:0/639348370 shutdown_connections 2023-07-21T22:38:55.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f9655574640 1 --2- 172.21.15.6:0/639348370 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96500c21f0 0x7f96500cb100 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:55.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f9655574640 1 --2- 172.21.15.6:0/639348370 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f965006b1e0 0x7f96500c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:55.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f9655574640 1 -- 172.21.15.6:0/639348370 >> 172.21.15.6:0/639348370 conn(0x7f96500afcf0 msgr2=0x7f96500b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:55.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f9655574640 1 -- 172.21.15.6:0/639348370 shutdown_connections 2023-07-21T22:38:55.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f9655574640 1 -- 172.21.15.6:0/639348370 wait complete. 2023-07-21T22:38:55.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f9655574640 1 Processor -- start 2023-07-21T22:38:55.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f9655574640 1 -- start start 2023-07-21T22:38:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f9655574640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f965006b1e0 0x7f9650155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f9655574640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9650070b70 0x7f9650155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f9655574640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96500c21f0 0x7f965014a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f9655574640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96500b1c20 con 0x7f96500c21f0 2023-07-21T22:38:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f9655574640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965014b050 con 0x7f9650070b70 2023-07-21T22:38:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f9655574640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965014b330 con 0x7f965006b1e0 2023-07-21T22:38:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f964f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96500c21f0 0x7f965014a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f964f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96500c21f0 0x7f965014a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43876/0 (socket says 172.21.15.6:43876) 2023-07-21T22:38:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f964f7fe640 1 -- 172.21.15.6:0/1138692050 learned_addr learned my addr 172.21.15.6:0/1138692050 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f964effd640 1 --2- 172.21.15.6:0/1138692050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f965006b1e0 0x7f9650155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f9647fff640 1 --2- 172.21.15.6:0/1138692050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9650070b70 0x7f9650155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f964f7fe640 1 -- 172.21.15.6:0/1138692050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f965006b1e0 msgr2=0x7f9650155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f964f7fe640 1 --2- 172.21.15.6:0/1138692050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f965006b1e0 0x7f9650155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f964f7fe640 1 -- 172.21.15.6:0/1138692050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9650070b70 msgr2=0x7f9650155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f964f7fe640 1 --2- 172.21.15.6:0/1138692050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9650070b70 0x7f9650155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f964f7fe640 1 -- 172.21.15.6:0/1138692050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9648009b30 con 0x7f96500c21f0 2023-07-21T22:38:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.220+0000 7f964f7fe640 1 --2- 172.21.15.6:0/1138692050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96500c21f0 0x7f965014a370 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f964801a580 tx=0x7f96480196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.224+0000 7f96477fe640 1 -- 172.21.15.6:0/1138692050 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96480b8670 con 0x7f96500c21f0 2023-07-21T22:38:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.224+0000 7f96477fe640 1 -- 172.21.15.6:0/1138692050 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96480b87d0 con 0x7f96500c21f0 2023-07-21T22:38:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.224+0000 7f9655574640 1 -- 172.21.15.6:0/1138692050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965014b610 con 0x7f96500c21f0 2023-07-21T22:38:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.224+0000 7f96477fe640 1 -- 172.21.15.6:0/1138692050 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96480b8b40 con 0x7f96500c21f0 2023-07-21T22:38:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.224+0000 7f9655574640 1 -- 172.21.15.6:0/1138692050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96500c28d0 con 0x7f96500c21f0 2023-07-21T22:38:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.224+0000 7f9655574640 1 -- 172.21.15.6:0/1138692050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96500c2ac0 con 0x7f96500c21f0 2023-07-21T22:38:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.224+0000 7f96477fe640 1 -- 172.21.15.6:0/1138692050 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f96480b8ca0 con 0x7f96500c21f0 2023-07-21T22:38:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.224+0000 7f96477fe640 1 --2- 172.21.15.6:0/1138692050 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f96300663d0 0x7f9630068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.224+0000 7f96477fe640 1 -- 172.21.15.6:0/1138692050 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f964811f310 con 0x7f96500c21f0 2023-07-21T22:38:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.224+0000 7f964effd640 1 --2- 172.21.15.6:0/1138692050 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f96300663d0 0x7f9630068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.228+0000 7f964effd640 1 --2- 172.21.15.6:0/1138692050 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f96300663d0 0x7f9630068880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9640000f70 tx=0x7f9640007e50 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.228+0000 7f96477fe640 1 -- 172.21.15.6:0/1138692050 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f96480ec660 con 0x7f96500c21f0 2023-07-21T22:38:55.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.436+0000 7f9655574640 1 -- 172.21.15.6:0/1138692050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f96500678d0 con 0x7f96500c21f0 2023-07-21T22:38:56.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.984+0000 7f96477fe640 1 -- 172.21.15.6:0/1138692050 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v790) v1 ==== 174+0+0 (secure 0 0 0) 0x7f96480efc80 con 0x7f96500c21f0 2023-07-21T22:38:56.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.988+0000 7f9655574640 1 -- 172.21.15.6:0/1138692050 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f96300663d0 msgr2=0x7f9630068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:56.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.988+0000 7f9655574640 1 --2- 172.21.15.6:0/1138692050 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f96300663d0 0x7f9630068880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9640000f70 tx=0x7f9640007e50 comp rx=0 tx=0).stop 2023-07-21T22:38:56.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.988+0000 7f9655574640 1 -- 172.21.15.6:0/1138692050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96500c21f0 msgr2=0x7f965014a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:56.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.988+0000 7f9655574640 1 --2- 172.21.15.6:0/1138692050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96500c21f0 0x7f965014a370 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f964801a580 tx=0x7f96480196f0 comp rx=0 tx=0).stop 2023-07-21T22:38:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.988+0000 7f9655574640 1 -- 172.21.15.6:0/1138692050 shutdown_connections 2023-07-21T22:38:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.988+0000 7f9655574640 1 --2- 172.21.15.6:0/1138692050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96500c21f0 0x7f965014a370 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.988+0000 7f9655574640 1 --2- 172.21.15.6:0/1138692050 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f96300663d0 0x7f9630068880 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.988+0000 7f9655574640 1 --2- 172.21.15.6:0/1138692050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9650070b70 0x7f9650155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.988+0000 7f9655574640 1 --2- 172.21.15.6:0/1138692050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f965006b1e0 0x7f9650155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.988+0000 7f9655574640 1 -- 172.21.15.6:0/1138692050 >> 172.21.15.6:0/1138692050 conn(0x7f96500afcf0 msgr2=0x7f96500b34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.988+0000 7f9655574640 1 -- 172.21.15.6:0/1138692050 shutdown_connections 2023-07-21T22:38:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:55.988+0000 7f9655574640 1 -- 172.21.15.6:0/1138692050 wait complete. 2023-07-21T22:38:56.056 INFO:tasks.cephfs_test_runner:Test listing snap schedules post removal of a schedule ... ok 2023-07-21T22:38:56.056 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that snap schedule is resumed after mgr restart 2023-07-21T22:38:56.057 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-21T22:38:56.057 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-07-21T22:38:56.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.160+0000 7f7290e34640 1 Processor -- start 2023-07-21T22:38:56.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.160+0000 7f7290e34640 1 -- start start 2023-07-21T22:38:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.164+0000 7f7290e34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f728c06a540 0x7f728c06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:56.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.164+0000 7f7290e34640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f728c0ce0f0 0x7f728c0ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:56.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.164+0000 7f7290e34640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f728c0cdc80 con 0x7f728c15f500 2023-07-21T22:38:56.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.164+0000 7f7290e34640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728c06aed0 con 0x7f728c0ce0f0 2023-07-21T22:38:56.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.164+0000 7f7290e34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728c06e4c0 con 0x7f728c06a540 2023-07-21T22:38:56.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.164+0000 7f728a59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f728c15f500 0x7f728c06cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41458/0 (socket says 172.21.15.6:41458) 2023-07-21T22:38:56.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.164+0000 7f728a59c640 1 -- 172.21.15.6:0/1649928526 learned_addr learned my addr 172.21.15.6:0/1649928526 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:56.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.164+0000 7f728ad9d640 1 --2- 172.21.15.6:0/1649928526 >> v2:172.21.15.6:3300/0 conn(0x7f728c0ce0f0 0x7f728c0ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:56.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.164+0000 7f7289d9b640 1 --2- 172.21.15.6:0/1649928526 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f728c06a540 0x7f728c06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:56.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.164+0000 7f728ad9d640 1 -- 172.21.15.6:0/1649928526 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f728c06a540 msgr2=0x7f728c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:56.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.164+0000 7f728ad9d640 1 --2- 172.21.15.6:0/1649928526 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f728c06a540 0x7f728c06a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:56.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.164+0000 7f728ad9d640 1 -- 172.21.15.6:0/1649928526 >> v1:172.21.15.6:6789/0 conn(0x7f728c15f500 legacy=0x7f728c06cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:56.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.164+0000 7f728ad9d640 1 -- 172.21.15.6:0/1649928526 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c06d940 con 0x7f728c0ce0f0 2023-07-21T22:38:56.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.164+0000 7f7289d9b640 1 --2- 172.21.15.6:0/1649928526 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f728c06a540 0x7f728c06a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:56.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.168+0000 7f728ad9d640 1 --2- 172.21.15.6:0/1649928526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f728c0ce0f0 0x7f728c0ce570 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f7284009d90 tx=0x7f728401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae61a2e15e9539bf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:56.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.168+0000 7f728959a640 1 -- 172.21.15.6:0/1649928526 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72840a5900 con 0x7f728c0ce0f0 2023-07-21T22:38:56.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.168+0000 7f728959a640 1 -- 172.21.15.6:0/1649928526 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72840a5a60 con 0x7f728c0ce0f0 2023-07-21T22:38:56.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.168+0000 7f728959a640 1 -- 172.21.15.6:0/1649928526 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72840a5df0 con 0x7f728c0ce0f0 2023-07-21T22:38:56.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.168+0000 7f7290e34640 1 -- 172.21.15.6:0/1649928526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f728c0ce0f0 msgr2=0x7f728c0ce570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:56.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.168+0000 7f7290e34640 1 --2- 172.21.15.6:0/1649928526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f728c0ce0f0 0x7f728c0ce570 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f7284009d90 tx=0x7f728401c950 comp rx=0 tx=0).stop 2023-07-21T22:38:56.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.168+0000 7f7290e34640 1 -- 172.21.15.6:0/1649928526 shutdown_connections 2023-07-21T22:38:56.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.168+0000 7f7290e34640 1 --2- 172.21.15.6:0/1649928526 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f728c0ce0f0 0x7f728c0ce570 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:56.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.168+0000 7f7290e34640 1 --2- 172.21.15.6:0/1649928526 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f728c06a540 0x7f728c06a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:56.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.168+0000 7f7290e34640 1 -- 172.21.15.6:0/1649928526 >> 172.21.15.6:0/1649928526 conn(0x7f728c0659d0 msgr2=0x7f728c099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:56.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.168+0000 7f7290e34640 1 -- 172.21.15.6:0/1649928526 shutdown_connections 2023-07-21T22:38:56.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.168+0000 7f7290e34640 1 -- 172.21.15.6:0/1649928526 wait complete. 2023-07-21T22:38:56.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.168+0000 7f7290e34640 1 Processor -- start 2023-07-21T22:38:56.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.168+0000 7f7290e34640 1 -- start start 2023-07-21T22:38:56.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f7290e34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f728c06a540 0x7f728c1576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:56.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f7290e34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f728c0ce0f0 0x7f728c1556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:56.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f7290e34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f728c15f500 0x7f728c0c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:56.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f7290e34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c15ca00 con 0x7f728c06a540 2023-07-21T22:38:56.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f7290e34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c15cce0 con 0x7f728c0ce0f0 2023-07-21T22:38:56.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f7290e34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728c15cfc0 con 0x7f728c15f500 2023-07-21T22:38:56.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f728a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f728c06a540 0x7f728c1576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:56.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f728a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f728c06a540 0x7f728c1576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43886/0 (socket says 172.21.15.6:43886) 2023-07-21T22:38:56.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f728a59c640 1 -- 172.21.15.6:0/3281245484 learned_addr learned my addr 172.21.15.6:0/3281245484 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:56.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f7289d9b640 1 --2- 172.21.15.6:0/3281245484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f728c0ce0f0 0x7f728c1556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:56.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f728a59c640 1 -- 172.21.15.6:0/3281245484 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f728c15f500 msgr2=0x7f728c0c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:56.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f728a59c640 1 --2- 172.21.15.6:0/3281245484 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f728c15f500 0x7f728c0c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:56.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f728a59c640 1 -- 172.21.15.6:0/3281245484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f728c0ce0f0 msgr2=0x7f728c1556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:56.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f728a59c640 1 --2- 172.21.15.6:0/3281245484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f728c0ce0f0 0x7f728c1556d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:56.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f728a59c640 1 -- 172.21.15.6:0/3281245484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7284009a70 con 0x7f728c06a540 2023-07-21T22:38:56.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f728a59c640 1 --2- 172.21.15.6:0/3281245484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f728c06a540 0x7f728c1576b0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f727c00c4d0 tx=0x7f727c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:56.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f727affd640 1 -- 172.21.15.6:0/3281245484 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c007480 con 0x7f728c06a540 2023-07-21T22:38:56.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f727affd640 1 -- 172.21.15.6:0/3281245484 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727c0075e0 con 0x7f728c06a540 2023-07-21T22:38:56.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f7290e34640 1 -- 172.21.15.6:0/3281245484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f728c15d2a0 con 0x7f728c06a540 2023-07-21T22:38:56.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f727affd640 1 -- 172.21.15.6:0/3281245484 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727c0059b0 con 0x7f728c06a540 2023-07-21T22:38:56.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f7290e34640 1 -- 172.21.15.6:0/3281245484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f728c155c10 con 0x7f728c06a540 2023-07-21T22:38:56.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.172+0000 7f7290e34640 1 -- 172.21.15.6:0/3281245484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f728c15d7c0 con 0x7f728c06a540 2023-07-21T22:38:56.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.176+0000 7f727affd640 1 -- 172.21.15.6:0/3281245484 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f727c005b10 con 0x7f728c06a540 2023-07-21T22:38:56.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.176+0000 7f727affd640 1 --2- 172.21.15.6:0/3281245484 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f726c0663a0 0x7f726c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:56.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.176+0000 7f727affd640 1 -- 172.21.15.6:0/3281245484 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f727c083390 con 0x7f728c06a540 2023-07-21T22:38:56.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.176+0000 7f7289d9b640 1 --2- 172.21.15.6:0/3281245484 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f726c0663a0 0x7f726c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:56.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.176+0000 7f7289d9b640 1 --2- 172.21.15.6:0/3281245484 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f726c0663a0 0x7f726c068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f728c0caa70 tx=0x7f7280008040 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:56.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.180+0000 7f727affd640 1 -- 172.21.15.6:0/3281245484 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f728c15d7c0 con 0x7f728c06a540 2023-07-21T22:38:56.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.384+0000 7f7290e34640 1 -- 172.21.15.6:0/3281245484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f728c15d7c0 con 0x7f728c06a540 2023-07-21T22:38:57.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.988+0000 7f727affd640 1 -- 172.21.15.6:0/3281245484 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v791) v1 ==== 168+0+0 (secure 0 0 0) 0x7f728c15d7c0 con 0x7f728c06a540 2023-07-21T22:38:57.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.988+0000 7f7290e34640 1 -- 172.21.15.6:0/3281245484 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f726c0663a0 msgr2=0x7f726c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:57.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.988+0000 7f7290e34640 1 --2- 172.21.15.6:0/3281245484 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f726c0663a0 0x7f726c068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f728c0caa70 tx=0x7f7280008040 comp rx=0 tx=0).stop 2023-07-21T22:38:57.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.988+0000 7f7290e34640 1 -- 172.21.15.6:0/3281245484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f728c06a540 msgr2=0x7f728c1576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:57.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.988+0000 7f7290e34640 1 --2- 172.21.15.6:0/3281245484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f728c06a540 0x7f728c1576b0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f727c00c4d0 tx=0x7f727c00c990 comp rx=0 tx=0).stop 2023-07-21T22:38:57.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.988+0000 7f7290e34640 1 -- 172.21.15.6:0/3281245484 shutdown_connections 2023-07-21T22:38:57.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.988+0000 7f7290e34640 1 --2- 172.21.15.6:0/3281245484 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f728c15f500 0x7f728c0c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.988+0000 7f7290e34640 1 --2- 172.21.15.6:0/3281245484 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f726c0663a0 0x7f726c068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.988+0000 7f7290e34640 1 --2- 172.21.15.6:0/3281245484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f728c0ce0f0 0x7f728c1556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.988+0000 7f7290e34640 1 --2- 172.21.15.6:0/3281245484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f728c06a540 0x7f728c1576b0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.988+0000 7f7290e34640 1 -- 172.21.15.6:0/3281245484 >> 172.21.15.6:0/3281245484 conn(0x7f728c0659d0 msgr2=0x7f728c0b2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:57.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.988+0000 7f7290e34640 1 -- 172.21.15.6:0/3281245484 shutdown_connections 2023-07-21T22:38:57.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:56.992+0000 7f7290e34640 1 -- 172.21.15.6:0/3281245484 wait complete. 2023-07-21T22:38:57.057 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-21T22:38:57.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f55303640 1 Processor -- start 2023-07-21T22:38:57.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f55303640 1 -- start start 2023-07-21T22:38:57.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f55303640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f5015cef0 0x7f7f50158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:57.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f55303640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f501532b0 con 0x7f7f500aeb40 2023-07-21T22:38:57.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f55303640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f500ca6f0 con 0x7f7f50159270 2023-07-21T22:38:57.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f55303640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5015d360 con 0x7f7f5015cef0 2023-07-21T22:38:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4effd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7f500aeb40 0x7f7f500aef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41460/0 (socket says 172.21.15.6:41460) 2023-07-21T22:38:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4effd640 1 -- 172.21.15.6:0/591037372 learned_addr learned my addr 172.21.15.6:0/591037372 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f47fff640 1 --2- 172.21.15.6:0/591037372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f5015cef0 0x7f7f50158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4e7fc640 1 -- 172.21.15.6:0/591037372 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254241327 0 0) 0x7f7f501532b0 con 0x7f7f500aeb40 2023-07-21T22:38:57.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4e7fc640 1 -- 172.21.15.6:0/591037372 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f3c005740 con 0x7f7f500aeb40 2023-07-21T22:38:57.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4e7fc640 1 -- 172.21.15.6:0/591037372 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122031149 0 0) 0x7f7f500ca6f0 con 0x7f7f50159270 2023-07-21T22:38:57.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4e7fc640 1 -- 172.21.15.6:0/591037372 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f501532b0 con 0x7f7f50159270 2023-07-21T22:38:57.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4e7fc640 1 -- 172.21.15.6:0/591037372 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1777386432 0 0) 0x7f7f3c005740 con 0x7f7f500aeb40 2023-07-21T22:38:57.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4e7fc640 1 -- 172.21.15.6:0/591037372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f5015cef0 msgr2=0x7f7f50158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:57.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4e7fc640 1 --2- 172.21.15.6:0/591037372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f5015cef0 0x7f7f50158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4e7fc640 1 -- 172.21.15.6:0/591037372 >> v1:172.21.15.161:6789/0 conn(0x7f7f50159270 legacy=0x7f7f500c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:57.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4e7fc640 1 -- 172.21.15.6:0/591037372 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f501599d0 con 0x7f7f500aeb40 2023-07-21T22:38:57.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4e7fc640 1 -- 172.21.15.6:0/591037372 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f7f40001680 con 0x7f7f500aeb40 2023-07-21T22:38:57.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4e7fc640 1 -- 172.21.15.6:0/591037372 >> v1:172.21.15.6:6789/0 conn(0x7f7f500aeb40 legacy=0x7f7f500aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:57.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4e7fc640 1 --2- 172.21.15.6:0/591037372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f5015cef0 0x7f7f3c005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:57.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4e7fc640 1 --2- 172.21.15.6:0/591037372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f3c0062b0 0x7f7f3c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:57.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4e7fc640 1 --2- 172.21.15.6:0/591037372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f3c006f20 0x7f7f3c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:57.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4e7fc640 1 -- 172.21.15.6:0/591037372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5015d360 con 0x7f7f3c0062b0 2023-07-21T22:38:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4e7fc640 1 -- 172.21.15.6:0/591037372 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c00dc50 con 0x7f7f3c006f20 2023-07-21T22:38:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4e7fc640 1 -- 172.21.15.6:0/591037372 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c00de10 con 0x7f7f5015cef0 2023-07-21T22:38:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f47fff640 1 --2- 172.21.15.6:0/591037372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f3c0062b0 0x7f7f3c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4effd640 1 --2- 172.21.15.6:0/591037372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f5015cef0 0x7f7f3c005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f4f7fe640 1 --2- 172.21.15.6:0/591037372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f3c006f20 0x7f7f3c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f47fff640 1 -- 172.21.15.6:0/591037372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f5015cef0 msgr2=0x7f7f3c005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:57.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f47fff640 1 --2- 172.21.15.6:0/591037372 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f5015cef0 0x7f7f3c005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f47fff640 1 -- 172.21.15.6:0/591037372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f3c006f20 msgr2=0x7f7f3c007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:57.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.164+0000 7f7f47fff640 1 --2- 172.21.15.6:0/591037372 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f3c006f20 0x7f7f3c007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.168+0000 7f7f47fff640 1 -- 172.21.15.6:0/591037372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c005740 con 0x7f7f3c0062b0 2023-07-21T22:38:57.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.168+0000 7f7f47fff640 1 --2- 172.21.15.6:0/591037372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f3c0062b0 0x7f7f3c0069e0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f7f38009ab0 tx=0x7f7f3801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72324795bd2c30be server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:57.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.168+0000 7f7f4e7fc640 1 -- 172.21.15.6:0/591037372 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f380a5620 con 0x7f7f3c0062b0 2023-07-21T22:38:57.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.168+0000 7f7f4e7fc640 1 -- 172.21.15.6:0/591037372 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f380a5780 con 0x7f7f3c0062b0 2023-07-21T22:38:57.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.168+0000 7f7f4e7fc640 1 -- 172.21.15.6:0/591037372 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f380a5b30 con 0x7f7f3c0062b0 2023-07-21T22:38:57.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.168+0000 7f7f55303640 1 -- 172.21.15.6:0/591037372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f3c0062b0 msgr2=0x7f7f3c0069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:57.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.168+0000 7f7f55303640 1 --2- 172.21.15.6:0/591037372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f3c0062b0 0x7f7f3c0069e0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f7f38009ab0 tx=0x7f7f3801ca30 comp rx=0 tx=0).stop 2023-07-21T22:38:57.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.168+0000 7f7f4f7fe640 1 -- 172.21.15.6:0/591037372 reap_dead start 2023-07-21T22:38:57.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.168+0000 7f7f55303640 1 -- 172.21.15.6:0/591037372 shutdown_connections 2023-07-21T22:38:57.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.168+0000 7f7f55303640 1 -- 172.21.15.6:0/591037372 >> 172.21.15.6:0/591037372 conn(0x7f7f500cde90 msgr2=0x7f7f500ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:57.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.168+0000 7f7f55303640 1 -- 172.21.15.6:0/591037372 shutdown_connections 2023-07-21T22:38:57.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.168+0000 7f7f55303640 1 -- 172.21.15.6:0/591037372 wait complete. 2023-07-21T22:38:57.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f55303640 1 Processor -- start 2023-07-21T22:38:57.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f55303640 1 -- start start 2023-07-21T22:38:57.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f55303640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f3c0062b0 0x7f7f501520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:57.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f55303640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f5006f060 0x7f7f500706a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:57.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f55303640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f50070be0 0x7f7f5015b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:57.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f55303640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5014c260 con 0x7f7f5006f060 2023-07-21T22:38:57.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f55303640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5014d9a0 con 0x7f7f3c0062b0 2023-07-21T22:38:57.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f55303640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5014dc80 con 0x7f7f50070be0 2023-07-21T22:38:57.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f47fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f5006f060 0x7f7f500706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:57.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f47fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f5006f060 0x7f7f500706a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43904/0 (socket says 172.21.15.6:43904) 2023-07-21T22:38:57.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f47fff640 1 -- 172.21.15.6:0/2981040311 learned_addr learned my addr 172.21.15.6:0/2981040311 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:57.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f4effd640 1 --2- 172.21.15.6:0/2981040311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f3c0062b0 0x7f7f501520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:57.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f4f7fe640 1 --2- 172.21.15.6:0/2981040311 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f50070be0 0x7f7f5015b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:57.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f47fff640 1 -- 172.21.15.6:0/2981040311 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f50070be0 msgr2=0x7f7f5015b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:57.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f47fff640 1 --2- 172.21.15.6:0/2981040311 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f50070be0 0x7f7f5015b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f47fff640 1 -- 172.21.15.6:0/2981040311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f3c0062b0 msgr2=0x7f7f501520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:57.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f47fff640 1 --2- 172.21.15.6:0/2981040311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f3c0062b0 0x7f7f501520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f47fff640 1 -- 172.21.15.6:0/2981040311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5014df60 con 0x7f7f5006f060 2023-07-21T22:38:57.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f4f7fe640 1 --2- 172.21.15.6:0/2981040311 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f50070be0 0x7f7f5015b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:57.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f47fff640 1 --2- 172.21.15.6:0/2981040311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f5006f060 0x7f7f500706a0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f7f38009ab0 tx=0x7f7f3c007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:57.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f477fe640 1 -- 172.21.15.6:0/2981040311 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f38004220 con 0x7f7f5006f060 2023-07-21T22:38:57.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f477fe640 1 -- 172.21.15.6:0/2981040311 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f38004380 con 0x7f7f5006f060 2023-07-21T22:38:57.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f477fe640 1 -- 172.21.15.6:0/2981040311 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f380ad850 con 0x7f7f5006f060 2023-07-21T22:38:57.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.172+0000 7f7f55303640 1 -- 172.21.15.6:0/2981040311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5014c260 con 0x7f7f5006f060 2023-07-21T22:38:57.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.176+0000 7f7f55303640 1 -- 172.21.15.6:0/2981040311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5014d630 con 0x7f7f5006f060 2023-07-21T22:38:57.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.176+0000 7f7f55303640 1 -- 172.21.15.6:0/2981040311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5014e480 con 0x7f7f5006f060 2023-07-21T22:38:57.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.176+0000 7f7f477fe640 1 -- 172.21.15.6:0/2981040311 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7f380b4040 con 0x7f7f5006f060 2023-07-21T22:38:57.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.176+0000 7f7f477fe640 1 --2- 172.21.15.6:0/2981040311 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f7f300663a0 0x7f7f30068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:57.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.176+0000 7f7f477fe640 1 -- 172.21.15.6:0/2981040311 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f7f3811e3e0 con 0x7f7f5006f060 2023-07-21T22:38:57.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.176+0000 7f7f4effd640 1 --2- 172.21.15.6:0/2981040311 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f7f300663a0 0x7f7f30068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:57.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.176+0000 7f7f4effd640 1 --2- 172.21.15.6:0/2981040311 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f7f300663a0 0x7f7f30068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7f40001c50 tx=0x7f7f40001e30 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:57.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.180+0000 7f7f477fe640 1 -- 172.21.15.6:0/2981040311 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f380eb7c0 con 0x7f7f5006f060 2023-07-21T22:38:57.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.340+0000 7f7f55303640 1 -- 172.21.15.6:0/2981040311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7f5014ddc0 con 0x7f7f5006f060 2023-07-21T22:38:57.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.344+0000 7f7f477fe640 1 -- 172.21.15.6:0/2981040311 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v52)=0 v52) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7f5014ddc0 con 0x7f7f5006f060 2023-07-21T22:38:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.344+0000 7f7f55303640 1 -- 172.21.15.6:0/2981040311 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f7f300663a0 msgr2=0x7f7f30068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.344+0000 7f7f55303640 1 --2- 172.21.15.6:0/2981040311 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f7f300663a0 0x7f7f30068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7f40001c50 tx=0x7f7f40001e30 comp rx=0 tx=0).stop 2023-07-21T22:38:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.344+0000 7f7f55303640 1 -- 172.21.15.6:0/2981040311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f5006f060 msgr2=0x7f7f500706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.344+0000 7f7f55303640 1 --2- 172.21.15.6:0/2981040311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f5006f060 0x7f7f500706a0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f7f38009ab0 tx=0x7f7f3c007a10 comp rx=0 tx=0).stop 2023-07-21T22:38:57.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.348+0000 7f7f55303640 1 -- 172.21.15.6:0/2981040311 shutdown_connections 2023-07-21T22:38:57.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.348+0000 7f7f55303640 1 --2- 172.21.15.6:0/2981040311 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f50070be0 0x7f7f5015b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.348+0000 7f7f55303640 1 --2- 172.21.15.6:0/2981040311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f5006f060 0x7f7f500706a0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.348+0000 7f7f55303640 1 --2- 172.21.15.6:0/2981040311 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f7f300663a0 0x7f7f30068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.348+0000 7f7f55303640 1 --2- 172.21.15.6:0/2981040311 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f3c0062b0 0x7f7f501520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.348+0000 7f7f55303640 1 -- 172.21.15.6:0/2981040311 >> 172.21.15.6:0/2981040311 conn(0x7f7f500cde90 msgr2=0x7f7f50152860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:57.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.348+0000 7f7f55303640 1 -- 172.21.15.6:0/2981040311 shutdown_connections 2023-07-21T22:38:57.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.348+0000 7f7f55303640 1 -- 172.21.15.6:0/2981040311 wait complete. 2023-07-21T22:38:57.410 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:38:57.411 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:38:57.453 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:38:57.519 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:38:57.520 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:38:57.520 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:38:57.529 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:38:57.530 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:38:57.530 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:38:57.539 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:38:57.540 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:38:57.540 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:38:57.579 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:38:57.579 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:38:57.580 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:38:57.589 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:38:57.590 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-21T22:38:57.591 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:38:57.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.720+0000 7f43f34e6640 1 Processor -- start 2023-07-21T22:38:57.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.720+0000 7f43f34e6640 1 -- start start 2023-07-21T22:38:57.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.724+0000 7f43f34e6640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f43ec160330 0x7f43ec0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:57.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.724+0000 7f43f34e6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43ec0c0f80 0x7f43ec0cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:57.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.724+0000 7f43f34e6640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ec0c17d0 con 0x7f43ec0c8940 2023-07-21T22:38:57.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.724+0000 7f43f34e6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ec0c14f0 con 0x7f43ec0c0f80 2023-07-21T22:38:57.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.724+0000 7f43f34e6640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ec0cac10 con 0x7f43ec160330 2023-07-21T22:38:57.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.724+0000 7f43f1a83640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43ec0c0f80 0x7f43ec0cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:57.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.724+0000 7f43f1a83640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43ec0c0f80 0x7f43ec0cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36846/0 (socket says 172.21.15.6:36846) 2023-07-21T22:38:57.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.724+0000 7f43f1a83640 1 -- 172.21.15.6:0/151428937 learned_addr learned my addr 172.21.15.6:0/151428937 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:57.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.724+0000 7f43f1282640 1 --2- 172.21.15.6:0/151428937 >> v2:172.21.15.161:3300/0 conn(0x7f43ec160330 0x7f43ec0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:57.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.724+0000 7f43f1a83640 1 -- 172.21.15.6:0/151428937 >> v2:172.21.15.161:3300/0 conn(0x7f43ec160330 msgr2=0x7f43ec0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:57.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.724+0000 7f43f1a83640 1 --2- 172.21.15.6:0/151428937 >> v2:172.21.15.161:3300/0 conn(0x7f43ec160330 0x7f43ec0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.724+0000 7f43f1a83640 1 -- 172.21.15.6:0/151428937 >> v1:172.21.15.161:6789/0 conn(0x7f43ec0c8940 legacy=0x7f43ec0ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:57.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.724+0000 7f43f1a83640 1 -- 172.21.15.6:0/151428937 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec0caef0 con 0x7f43ec0c0f80 2023-07-21T22:38:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.728+0000 7f43f1a83640 1 --2- 172.21.15.6:0/151428937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43ec0c0f80 0x7f43ec0cd660 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f43ec066260 tx=0x7f43e401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf8d8f3ecf5fe10 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:57.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.728+0000 7f43e3fff640 1 -- 172.21.15.6:0/151428937 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e40af400 con 0x7f43ec0c0f80 2023-07-21T22:38:57.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.728+0000 7f43e3fff640 1 -- 172.21.15.6:0/151428937 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e40ab050 con 0x7f43ec0c0f80 2023-07-21T22:38:57.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.728+0000 7f43e3fff640 1 -- 172.21.15.6:0/151428937 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e40af780 con 0x7f43ec0c0f80 2023-07-21T22:38:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.728+0000 7f43f34e6640 1 -- 172.21.15.6:0/151428937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43ec0c0f80 msgr2=0x7f43ec0cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.728+0000 7f43f34e6640 1 --2- 172.21.15.6:0/151428937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43ec0c0f80 0x7f43ec0cd660 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f43ec066260 tx=0x7f43e401f1c0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.728+0000 7f43f34e6640 1 -- 172.21.15.6:0/151428937 shutdown_connections 2023-07-21T22:38:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.728+0000 7f43f34e6640 1 --2- 172.21.15.6:0/151428937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43ec0c0f80 0x7f43ec0cd660 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.728+0000 7f43f34e6640 1 --2- 172.21.15.6:0/151428937 >> v2:172.21.15.161:3300/0 conn(0x7f43ec160330 0x7f43ec0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.728+0000 7f43f34e6640 1 -- 172.21.15.6:0/151428937 >> 172.21.15.6:0/151428937 conn(0x7f43ec0afcf0 msgr2=0x7f43ec0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:57.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.728+0000 7f43f34e6640 1 -- 172.21.15.6:0/151428937 shutdown_connections 2023-07-21T22:38:57.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.728+0000 7f43f34e6640 1 -- 172.21.15.6:0/151428937 wait complete. 2023-07-21T22:38:57.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.728+0000 7f43f34e6640 1 Processor -- start 2023-07-21T22:38:57.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.728+0000 7f43f34e6640 1 -- start start 2023-07-21T22:38:57.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f34e6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43ec0c0f80 0x7f43ec156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:57.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f34e6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43ec0c8940 0x7f43ec160880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:57.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f34e6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43ec160330 0x7f43ec0ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:57.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f34e6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec0c5990 con 0x7f43ec0c8940 2023-07-21T22:38:57.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f34e6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec15baf0 con 0x7f43ec0c0f80 2023-07-21T22:38:57.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f34e6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec0c53d0 con 0x7f43ec160330 2023-07-21T22:38:57.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f0a81640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43ec0c8940 0x7f43ec160880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:57.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f0a81640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43ec0c8940 0x7f43ec160880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36854/0 (socket says 172.21.15.6:36854) 2023-07-21T22:38:57.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f0a81640 1 -- 172.21.15.6:0/2648165153 learned_addr learned my addr 172.21.15.6:0/2648165153 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f1a83640 1 --2- 172.21.15.6:0/2648165153 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43ec160330 0x7f43ec0ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f1282640 1 --2- 172.21.15.6:0/2648165153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43ec0c0f80 0x7f43ec156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f0a81640 1 -- 172.21.15.6:0/2648165153 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43ec160330 msgr2=0x7f43ec0ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f0a81640 1 --2- 172.21.15.6:0/2648165153 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43ec160330 0x7f43ec0ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f0a81640 1 -- 172.21.15.6:0/2648165153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43ec0c0f80 msgr2=0x7f43ec156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f0a81640 1 --2- 172.21.15.6:0/2648165153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43ec0c0f80 0x7f43ec156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f0a81640 1 -- 172.21.15.6:0/2648165153 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e4009b30 con 0x7f43ec0c8940 2023-07-21T22:38:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f1282640 1 --2- 172.21.15.6:0/2648165153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43ec0c0f80 0x7f43ec156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:38:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f0a81640 1 --2- 172.21.15.6:0/2648165153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43ec0c8940 0x7f43ec160880 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00c530 tx=0x7f43dc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43e1ffb640 1 -- 172.21.15.6:0/2648165153 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc005220 con 0x7f43ec0c8940 2023-07-21T22:38:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43e1ffb640 1 -- 172.21.15.6:0/2648165153 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc005380 con 0x7f43ec0c8940 2023-07-21T22:38:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43e1ffb640 1 -- 172.21.15.6:0/2648165153 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc007270 con 0x7f43ec0c8940 2023-07-21T22:38:57.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f34e6640 1 -- 172.21.15.6:0/2648165153 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ec0c56b0 con 0x7f43ec0c8940 2023-07-21T22:38:57.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f34e6640 1 -- 172.21.15.6:0/2648165153 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ec0cc9e0 con 0x7f43ec0c8940 2023-07-21T22:38:57.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.732+0000 7f43f34e6640 1 -- 172.21.15.6:0/2648165153 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ec0678d0 con 0x7f43ec0c8940 2023-07-21T22:38:57.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.736+0000 7f43e1ffb640 1 -- 172.21.15.6:0/2648165153 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f43dc0073d0 con 0x7f43ec0c8940 2023-07-21T22:38:57.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.736+0000 7f43e1ffb640 1 --2- 172.21.15.6:0/2648165153 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f43d00663a0 0x7f43d0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:57.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.736+0000 7f43e1ffb640 1 -- 172.21.15.6:0/2648165153 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f43dc0837b0 con 0x7f43ec0c8940 2023-07-21T22:38:57.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.736+0000 7f43f1282640 1 --2- 172.21.15.6:0/2648165153 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f43d00663a0 0x7f43d0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:57.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.736+0000 7f43f1282640 1 --2- 172.21.15.6:0/2648165153 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f43d00663a0 0x7f43d0068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009ae0 tx=0x7f43e8008040 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:57.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.740+0000 7f43e1ffb640 1 -- 172.21.15.6:0/2648165153 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f43dc050ae0 con 0x7f43ec0c8940 2023-07-21T22:38:57.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.932+0000 7f43f34e6640 1 -- 172.21.15.6:0/2648165153 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43ec066810 con 0x7f43ec0c8940 2023-07-21T22:38:57.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.932+0000 7f43e1ffb640 1 -- 172.21.15.6:0/2648165153 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f43dc054100 con 0x7f43ec0c8940 2023-07-21T22:38:57.977 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:57.977 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":64,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/1816246921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":1816246921},{"type":"v1","addr":"172.21.15.6:6834","nonce":1816246921}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":7490,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/543588806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":543588806},{"type":"v1","addr":"172.21.15.6:6835","nonce":543588806}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8452,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/3250690150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":3250690150},{"type":"v1","addr":"172.21.15.161:6836","nonce":3250690150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":8893,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/262498054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":262498054},{"type":"v1","addr":"172.21.15.161:6837","nonce":262498054}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[]} 2023-07-21T22:38:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 64 2023-07-21T22:38:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.932+0000 7f43f34e6640 1 -- 172.21.15.6:0/2648165153 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f43d00663a0 msgr2=0x7f43d0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.936+0000 7f43f34e6640 1 --2- 172.21.15.6:0/2648165153 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f43d00663a0 0x7f43d0068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f43e8009ae0 tx=0x7f43e8008040 comp rx=0 tx=0).stop 2023-07-21T22:38:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.936+0000 7f43f34e6640 1 -- 172.21.15.6:0/2648165153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43ec0c8940 msgr2=0x7f43ec160880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:57.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.936+0000 7f43f34e6640 1 --2- 172.21.15.6:0/2648165153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43ec0c8940 0x7f43ec160880 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f43dc00c530 tx=0x7f43dc00c9f0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.936+0000 7f43f34e6640 1 -- 172.21.15.6:0/2648165153 shutdown_connections 2023-07-21T22:38:57.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.936+0000 7f43f34e6640 1 --2- 172.21.15.6:0/2648165153 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43ec160330 0x7f43ec0ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.936+0000 7f43f34e6640 1 --2- 172.21.15.6:0/2648165153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43ec0c8940 0x7f43ec160880 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.936+0000 7f43f34e6640 1 --2- 172.21.15.6:0/2648165153 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f43d00663a0 0x7f43d0068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.936+0000 7f43f34e6640 1 --2- 172.21.15.6:0/2648165153 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43ec0c0f80 0x7f43ec156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:57.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.936+0000 7f43f34e6640 1 -- 172.21.15.6:0/2648165153 >> 172.21.15.6:0/2648165153 conn(0x7f43ec0afcf0 msgr2=0x7f43ec0700a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:57.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.936+0000 7f43f34e6640 1 -- 172.21.15.6:0/2648165153 shutdown_connections 2023-07-21T22:38:57.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:57.936+0000 7f43f34e6640 1 -- 172.21.15.6:0/2648165153 wait complete. 2023-07-21T22:38:57.998 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-21T22:38:57.998 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-21T22:38:57.999 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-21T22:38:57.999 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:38:57.999 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-21T22:38:57.999 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-21T22:38:58.000 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-21T22:38:58.000 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:38:58.000 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-21T22:38:58.000 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-21T22:38:58.001 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-21T22:38:58.001 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:38:58.001 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-21T22:38:58.001 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-21T22:38:58.001 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-21T22:38:58.002 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:38:58.013 INFO:tasks.ceph.mds.a:Stopped 2023-07-21T22:38:58.014 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-21T22:38:58.015 INFO:tasks.ceph.mds.c:Stopped 2023-07-21T22:38:58.016 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-21T22:38:58.017 INFO:tasks.ceph.mds.b:Stopped 2023-07-21T22:38:58.018 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-21T22:38:58.019 INFO:tasks.ceph.mds.d:Stopped 2023-07-21T22:38:58.019 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-21T22:38:58.062 INFO:tasks.ceph.mds.a:Started 2023-07-21T22:38:58.062 DEBUG:teuthology.parallel:result is None 2023-07-21T22:38:58.063 INFO:tasks.ceph.mds.b:Started 2023-07-21T22:38:58.064 DEBUG:teuthology.parallel:result is None 2023-07-21T22:38:58.064 INFO:tasks.ceph.mds.c:Started 2023-07-21T22:38:58.065 DEBUG:teuthology.parallel:result is None 2023-07-21T22:38:58.065 INFO:tasks.ceph.mds.d:Started 2023-07-21T22:38:58.066 DEBUG:teuthology.parallel:result is None 2023-07-21T22:38:58.066 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-21T22:38:58.152 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-07-21T22:38:58.154 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-21T22:38:58.158 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-07-21T22:38:58.158 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2023-07-21T22:38:58.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.172+0000 7f557ba48640 1 Processor -- start 2023-07-21T22:38:58.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.172+0000 7f557ba48640 1 -- start start 2023-07-21T22:38:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.172+0000 7f557ba48640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f55740b7990 0x7f55740d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.172+0000 7f557ba48640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55740b4840 con 0x7f55740d12f0 2023-07-21T22:38:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.172+0000 7f557ba48640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55740ccae0 con 0x7f55740d1840 2023-07-21T22:38:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.172+0000 7f557ba48640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55740cd060 con 0x7f55740b7990 2023-07-21T22:38:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.172+0000 7f55797e4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f55740b7990 0x7f55740d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.172+0000 7f55797e4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f55740b7990 0x7f55740d0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36898/0 (socket says 172.21.15.6:36898) 2023-07-21T22:38:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.172+0000 7f55797e4640 1 -- 172.21.15.6:0/448773487 learned_addr learned my addr 172.21.15.6:0/448773487 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.172+0000 7f5578fe3640 1 --1- 172.21.15.6:0/448773487 >> v1:172.21.15.6:6789/0 conn(0x7f55740d12f0 0x7f557415f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33094/0 (socket says 172.21.15.6:33094) 2023-07-21T22:38:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.172+0000 7f55797e4640 1 -- 172.21.15.6:0/448773487 >> v1:172.21.15.161:6789/0 conn(0x7f55740d1840 legacy=0x7f55740d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.172+0000 7f55797e4640 1 -- 172.21.15.6:0/448773487 >> v1:172.21.15.6:6789/0 conn(0x7f55740d12f0 legacy=0x7f557415f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.172+0000 7f55797e4640 1 -- 172.21.15.6:0/448773487 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5574160310 con 0x7f55740b7990 2023-07-21T22:38:58.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.176+0000 7f55797e4640 1 --2- 172.21.15.6:0/448773487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55740b7990 0x7f55740d0c40 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f5570009870 tx=0x7f557001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8561b8898fb0089b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:58.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.176+0000 7f556bfff640 1 -- 172.21.15.6:0/448773487 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700ab600 con 0x7f55740b7990 2023-07-21T22:38:58.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.176+0000 7f556bfff640 1 -- 172.21.15.6:0/448773487 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55700a7050 con 0x7f55740b7990 2023-07-21T22:38:58.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.176+0000 7f556bfff640 1 -- 172.21.15.6:0/448773487 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700ab980 con 0x7f55740b7990 2023-07-21T22:38:58.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.176+0000 7f557ba48640 1 -- 172.21.15.6:0/448773487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55740b7990 msgr2=0x7f55740d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:58.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.176+0000 7f557ba48640 1 --2- 172.21.15.6:0/448773487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55740b7990 0x7f55740d0c40 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f5570009870 tx=0x7f557001c470 comp rx=0 tx=0).stop 2023-07-21T22:38:58.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.176+0000 7f557ba48640 1 -- 172.21.15.6:0/448773487 shutdown_connections 2023-07-21T22:38:58.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.176+0000 7f557ba48640 1 --2- 172.21.15.6:0/448773487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55740b7990 0x7f55740d0c40 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:58.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.176+0000 7f557ba48640 1 -- 172.21.15.6:0/448773487 >> 172.21.15.6:0/448773487 conn(0x7f55740650b0 msgr2=0x7f55740654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:58.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.176+0000 7f557ba48640 1 -- 172.21.15.6:0/448773487 shutdown_connections 2023-07-21T22:38:58.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.176+0000 7f557ba48640 1 -- 172.21.15.6:0/448773487 wait complete. 2023-07-21T22:38:58.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f557ba48640 1 Processor -- start 2023-07-21T22:38:58.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f557ba48640 1 -- start start 2023-07-21T22:38:58.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f557ba48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55740b7990 0x7f5574155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:58.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f557ba48640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55740d12f0 0x7f55741f84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:58.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f557ba48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55740d1840 0x7f55740ca440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f557ba48640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55741f8a30 con 0x7f55740b7990 2023-07-21T22:38:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f557ba48640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55740c7c40 con 0x7f55740d12f0 2023-07-21T22:38:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f557ba48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55740c93c0 con 0x7f55740d1840 2023-07-21T22:38:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f55797e4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55740b7990 0x7f5574155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f55797e4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55740b7990 0x7f5574155130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36902/0 (socket says 172.21.15.6:36902) 2023-07-21T22:38:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f55797e4640 1 -- 172.21.15.6:0/986117943 learned_addr learned my addr 172.21.15.6:0/986117943 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:58.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f5579fe5640 1 --2- 172.21.15.6:0/986117943 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55740d1840 0x7f55740ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:58.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f5578fe3640 1 --2- 172.21.15.6:0/986117943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55740d12f0 0x7f55741f84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:58.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f55797e4640 1 -- 172.21.15.6:0/986117943 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55740d1840 msgr2=0x7f55740ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:58.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f55797e4640 1 --2- 172.21.15.6:0/986117943 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55740d1840 0x7f55740ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:58.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f55797e4640 1 -- 172.21.15.6:0/986117943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55740d12f0 msgr2=0x7f55741f84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f55797e4640 1 --2- 172.21.15.6:0/986117943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55740d12f0 0x7f55741f84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f55797e4640 1 -- 172.21.15.6:0/986117943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55700094d0 con 0x7f55740b7990 2023-07-21T22:38:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f55797e4640 1 --2- 172.21.15.6:0/986117943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55740b7990 0x7f5574155130 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f5570019080 tx=0x7f557001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f5569ffb640 1 -- 172.21.15.6:0/986117943 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700b6620 con 0x7f55740b7990 2023-07-21T22:38:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f5569ffb640 1 -- 172.21.15.6:0/986117943 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55700b67a0 con 0x7f55740b7990 2023-07-21T22:38:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f557ba48640 1 -- 172.21.15.6:0/986117943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55740c9680 con 0x7f55740b7990 2023-07-21T22:38:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f5569ffb640 1 -- 172.21.15.6:0/986117943 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700b6b50 con 0x7f55740b7990 2023-07-21T22:38:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.180+0000 7f557ba48640 1 -- 172.21.15.6:0/986117943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55740c9c40 con 0x7f55740b7990 2023-07-21T22:38:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.184+0000 7f557ba48640 1 -- 172.21.15.6:0/986117943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55740678d0 con 0x7f55740b7990 2023-07-21T22:38:58.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.184+0000 7f5569ffb640 1 -- 172.21.15.6:0/986117943 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f55700b2040 con 0x7f55740b7990 2023-07-21T22:38:58.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.184+0000 7f5569ffb640 1 --2- 172.21.15.6:0/986117943 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f55580663a0 0x7f5558068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:58.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.184+0000 7f5569ffb640 1 -- 172.21.15.6:0/986117943 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f557011e590 con 0x7f55740b7990 2023-07-21T22:38:58.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.184+0000 7f5578fe3640 1 --2- 172.21.15.6:0/986117943 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f55580663a0 0x7f5558068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:58.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.188+0000 7f5578fe3640 1 --2- 172.21.15.6:0/986117943 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f55580663a0 0x7f5558068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f557415fbe0 tx=0x7f5564007cb0 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:58.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.188+0000 7f5569ffb640 1 -- 172.21.15.6:0/986117943 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f55700eb720 con 0x7f55740b7990 2023-07-21T22:38:58.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:58.368+0000 7f557ba48640 1 -- 172.21.15.6:0/986117943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f55740b3ad0 con 0x7f55740b7990 2023-07-21T22:38:59.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.380+0000 7f5569ffb640 1 -- 172.21.15.6:0/986117943 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v153) v1 ==== 97+0+0 (secure 0 0 0) 0x7f55700eed40 con 0x7f55740b7990 2023-07-21T22:38:59.424 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-07-21T22:38:59.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.384+0000 7f557ba48640 1 -- 172.21.15.6:0/986117943 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f55580663a0 msgr2=0x7f5558068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:59.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.384+0000 7f557ba48640 1 --2- 172.21.15.6:0/986117943 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f55580663a0 0x7f5558068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f557415fbe0 tx=0x7f5564007cb0 comp rx=0 tx=0).stop 2023-07-21T22:38:59.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.384+0000 7f557ba48640 1 -- 172.21.15.6:0/986117943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55740b7990 msgr2=0x7f5574155130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:59.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.384+0000 7f557ba48640 1 --2- 172.21.15.6:0/986117943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55740b7990 0x7f5574155130 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f5570019080 tx=0x7f557001acb0 comp rx=0 tx=0).stop 2023-07-21T22:38:59.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.384+0000 7f557ba48640 1 -- 172.21.15.6:0/986117943 shutdown_connections 2023-07-21T22:38:59.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.384+0000 7f557ba48640 1 --2- 172.21.15.6:0/986117943 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f55740d1840 0x7f55740ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:59.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.384+0000 7f557ba48640 1 --2- 172.21.15.6:0/986117943 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f55580663a0 0x7f5558068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:59.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.384+0000 7f557ba48640 1 --2- 172.21.15.6:0/986117943 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55740d12f0 0x7f55741f84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:59.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.384+0000 7f557ba48640 1 --2- 172.21.15.6:0/986117943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55740b7990 0x7f5574155130 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:59.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.384+0000 7f557ba48640 1 -- 172.21.15.6:0/986117943 >> 172.21.15.6:0/986117943 conn(0x7f55740650b0 msgr2=0x7f55740b5200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:59.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.384+0000 7f557ba48640 1 -- 172.21.15.6:0/986117943 shutdown_connections 2023-07-21T22:38:59.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.384+0000 7f557ba48640 1 -- 172.21.15.6:0/986117943 wait complete. 2023-07-21T22:38:59.451 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-21T22:38:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf2e974640 1 Processor -- start 2023-07-21T22:38:59.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf2e974640 1 -- start start 2023-07-21T22:38:59.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf2e974640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf2815fd60 0x7fdf280d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:59.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf2e974640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdf280d1850 0x7fdf280d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:59.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf2e974640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf280ccaf0 con 0x7fdf280b7c70 2023-07-21T22:38:59.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf2e974640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf280d1190 con 0x7fdf280d1850 2023-07-21T22:38:59.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf2e974640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf28160600 con 0x7fdf2815fd60 2023-07-21T22:38:59.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf27fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdf280b7c70 0x7fdf2815f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33100/0 (socket says 172.21.15.6:33100) 2023-07-21T22:38:59.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf27fff640 1 -- 172.21.15.6:0/3121698339 learned_addr learned my addr 172.21.15.6:0/3121698339 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:38:59.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf26ffd640 1 -- 172.21.15.6:0/3121698339 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472100908 0 0) 0x7fdf280ccaf0 con 0x7fdf280b7c70 2023-07-21T22:38:59.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf26ffd640 1 -- 172.21.15.6:0/3121698339 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf10003530 con 0x7fdf280b7c70 2023-07-21T22:38:59.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf277fe640 1 --2- 172.21.15.6:0/3121698339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf2815fd60 0x7fdf280d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:59.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf2cf11640 1 --2- 172.21.15.6:0/3121698339 >> v2:172.21.15.161:3300/0 conn(0x7fdf280d1850 0x7fdf280d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:59.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf26ffd640 1 -- 172.21.15.6:0/3121698339 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3673567174 0 0) 0x7fdf10003530 con 0x7fdf280b7c70 2023-07-21T22:38:59.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf26ffd640 1 -- 172.21.15.6:0/3121698339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf2815fd60 msgr2=0x7fdf280d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:59.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf26ffd640 1 --2- 172.21.15.6:0/3121698339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf2815fd60 0x7fdf280d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:59.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf26ffd640 1 -- 172.21.15.6:0/3121698339 >> v2:172.21.15.161:3300/0 conn(0x7fdf280d1850 msgr2=0x7fdf280d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:59.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf26ffd640 1 --2- 172.21.15.6:0/3121698339 >> v2:172.21.15.161:3300/0 conn(0x7fdf280d1850 0x7fdf280d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:59.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf26ffd640 1 -- 172.21.15.6:0/3121698339 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf28160320 con 0x7fdf280b7c70 2023-07-21T22:38:59.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf26ffd640 1 -- 172.21.15.6:0/3121698339 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fdf18001680 con 0x7fdf280b7c70 2023-07-21T22:38:59.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf26ffd640 1 -- 172.21.15.6:0/3121698339 >> v1:172.21.15.6:6789/0 conn(0x7fdf280b7c70 legacy=0x7fdf2815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf26ffd640 1 --2- 172.21.15.6:0/3121698339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf2815fd60 0x7fdf100039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf26ffd640 1 --2- 172.21.15.6:0/3121698339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf10003f30 0x7fdf100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf26ffd640 1 --2- 172.21.15.6:0/3121698339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf10004d10 0x7fdf10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf26ffd640 1 -- 172.21.15.6:0/3121698339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf28160600 con 0x7fdf10004d10 2023-07-21T22:38:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf26ffd640 1 -- 172.21.15.6:0/3121698339 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1000b990 con 0x7fdf10003f30 2023-07-21T22:38:59.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf26ffd640 1 -- 172.21.15.6:0/3121698339 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1000bad0 con 0x7fdf2815fd60 2023-07-21T22:38:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf2cf11640 1 --2- 172.21.15.6:0/3121698339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf10004d10 0x7fdf10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf27fff640 1 --2- 172.21.15.6:0/3121698339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf2815fd60 0x7fdf100039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf277fe640 1 --2- 172.21.15.6:0/3121698339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf10003f30 0x7fdf100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf2cf11640 1 -- 172.21.15.6:0/3121698339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf2815fd60 msgr2=0x7fdf100039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf2cf11640 1 --2- 172.21.15.6:0/3121698339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf2815fd60 0x7fdf100039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf2cf11640 1 -- 172.21.15.6:0/3121698339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf10003f30 msgr2=0x7fdf100047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:59.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf2cf11640 1 --2- 172.21.15.6:0/3121698339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf10003f30 0x7fdf100047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:59.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf2cf11640 1 -- 172.21.15.6:0/3121698339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf10003530 con 0x7fdf10004d10 2023-07-21T22:38:59.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.556+0000 7fdf277fe640 1 --2- 172.21.15.6:0/3121698339 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf10003f30 0x7fdf100047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:59.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.560+0000 7fdf2cf11640 1 --2- 172.21.15.6:0/3121698339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf10004d10 0x7fdf10005180 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fdf20009fc0 tx=0x7fdf2001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a342cfea61b78c4b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:59.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.560+0000 7fdf26ffd640 1 -- 172.21.15.6:0/3121698339 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf200a5cb0 con 0x7fdf10004d10 2023-07-21T22:38:59.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.560+0000 7fdf26ffd640 1 -- 172.21.15.6:0/3121698339 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2000f040 con 0x7fdf10004d10 2023-07-21T22:38:59.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.560+0000 7fdf26ffd640 1 -- 172.21.15.6:0/3121698339 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf200ad680 con 0x7fdf10004d10 2023-07-21T22:38:59.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.560+0000 7fdf2e974640 1 -- 172.21.15.6:0/3121698339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf10004d10 msgr2=0x7fdf10005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:59.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.560+0000 7fdf2e974640 1 --2- 172.21.15.6:0/3121698339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf10004d10 0x7fdf10005180 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fdf20009fc0 tx=0x7fdf2001cca0 comp rx=0 tx=0).stop 2023-07-21T22:38:59.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.560+0000 7fdf2cf11640 1 -- 172.21.15.6:0/3121698339 reap_dead start 2023-07-21T22:38:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.560+0000 7fdf2e974640 1 -- 172.21.15.6:0/3121698339 shutdown_connections 2023-07-21T22:38:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.560+0000 7fdf2e974640 1 -- 172.21.15.6:0/3121698339 >> 172.21.15.6:0/3121698339 conn(0x7fdf280650b0 msgr2=0x7fdf280654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.560+0000 7fdf2e974640 1 -- 172.21.15.6:0/3121698339 shutdown_connections 2023-07-21T22:38:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.560+0000 7fdf2e974640 1 -- 172.21.15.6:0/3121698339 wait complete. 2023-07-21T22:38:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf2e974640 1 Processor -- start 2023-07-21T22:38:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf2e974640 1 -- start start 2023-07-21T22:38:59.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf2e974640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf10004d10 0x7fdf280b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:59.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf2e974640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf280b22a0 0x7fdf281e5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:59.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf2e974640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf281e59d0 0x7fdf281e5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:59.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf2e974640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf280b2710 con 0x7fdf281e59d0 2023-07-21T22:38:59.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf2e974640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf281f1680 con 0x7fdf10004d10 2023-07-21T22:38:59.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf2e974640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2814f0b0 con 0x7fdf280b22a0 2023-07-21T22:38:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf2cf11640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf281e59d0 0x7fdf281e5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf2cf11640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf281e59d0 0x7fdf281e5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36920/0 (socket says 172.21.15.6:36920) 2023-07-21T22:38:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf2cf11640 1 -- 172.21.15.6:0/2032717408 learned_addr learned my addr 172.21.15.6:0/2032717408 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:38:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf27fff640 1 --2- 172.21.15.6:0/2032717408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf10004d10 0x7fdf280b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf277fe640 1 --2- 172.21.15.6:0/2032717408 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf280b22a0 0x7fdf281e5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf2cf11640 1 -- 172.21.15.6:0/2032717408 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf280b22a0 msgr2=0x7fdf281e5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf2cf11640 1 --2- 172.21.15.6:0/2032717408 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf280b22a0 0x7fdf281e5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf2cf11640 1 -- 172.21.15.6:0/2032717408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf10004d10 msgr2=0x7fdf280b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf2cf11640 1 --2- 172.21.15.6:0/2032717408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf10004d10 0x7fdf280b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf2cf11640 1 -- 172.21.15.6:0/2032717408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf281f0d50 con 0x7fdf281e59d0 2023-07-21T22:38:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf277fe640 1 --2- 172.21.15.6:0/2032717408 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf280b22a0 0x7fdf281e5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:59.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf2cf11640 1 --2- 172.21.15.6:0/2032717408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf281e59d0 0x7fdf281e5e40 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fdf20002240 tx=0x7fdf20009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:59.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf24ff9640 1 -- 172.21.15.6:0/2032717408 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf200039a0 con 0x7fdf281e59d0 2023-07-21T22:38:59.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf24ff9640 1 -- 172.21.15.6:0/2032717408 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf20003b00 con 0x7fdf281e59d0 2023-07-21T22:38:59.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf2e974640 1 -- 172.21.15.6:0/2032717408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf281f1030 con 0x7fdf281e59d0 2023-07-21T22:38:59.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.564+0000 7fdf24ff9640 1 -- 172.21.15.6:0/2032717408 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20003e70 con 0x7fdf281e59d0 2023-07-21T22:38:59.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.568+0000 7fdf2e974640 1 -- 172.21.15.6:0/2032717408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf281f1b10 con 0x7fdf281e59d0 2023-07-21T22:38:59.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.568+0000 7fdf2e974640 1 -- 172.21.15.6:0/2032717408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf280678d0 con 0x7fdf281e59d0 2023-07-21T22:38:59.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.568+0000 7fdf24ff9640 1 -- 172.21.15.6:0/2032717408 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdf200b4040 con 0x7fdf281e59d0 2023-07-21T22:38:59.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.568+0000 7fdf24ff9640 1 --2- 172.21.15.6:0/2032717408 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fdf140663d0 0x7fdf14068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:59.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.568+0000 7fdf24ff9640 1 -- 172.21.15.6:0/2032717408 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5282+0+0 (secure 0 0 0) 0x7fdf2011db90 con 0x7fdf281e59d0 2023-07-21T22:38:59.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.568+0000 7fdf27fff640 1 --2- 172.21.15.6:0/2032717408 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fdf140663d0 0x7fdf14068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:59.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.572+0000 7fdf27fff640 1 --2- 172.21.15.6:0/2032717408 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fdf140663d0 0x7fdf14068880 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdf180017b0 tx=0x7fdf18001440 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:59.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.572+0000 7fdf24ff9640 1 -- 172.21.15.6:0/2032717408 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdf200eb180 con 0x7fdf281e59d0 2023-07-21T22:38:59.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.784+0000 7fdf2e974640 1 -- 172.21.15.6:0/2032717408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdf281f17c0 con 0x7fdf281e59d0 2023-07-21T22:38:59.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.784+0000 7fdf24ff9640 1 -- 172.21.15.6:0/2032717408 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fdf200b2090 con 0x7fdf281e59d0 2023-07-21T22:38:59.828 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:38:59.828 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:38:59.828 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-07-21T22:38:59.829 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:59.829 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-07-21T22:38:59.829 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkHn5HNxAADk0AaSGwZfEj3SwNvEm8hw==", 2023-07-21T22:38:59.829 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:59.829 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:38:59.829 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:38:59.829 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:38:59.830 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:59.830 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:59.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:59.830 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:59.830 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-07-21T22:38:59.830 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkQFvXCBAANxf0/I2RQcHy4iYiydjkcg==", 2023-07-21T22:38:59.830 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:59.831 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:38:59.831 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:38:59.831 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:38:59.831 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:59.831 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:59.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:59.831 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:59.832 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-07-21T22:38:59.832 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkYtGXAxAAy+RDDBSvc1FeZq+eg23tRA==", 2023-07-21T22:38:59.832 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:59.832 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:38:59.832 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:38:59.832 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:38:59.832 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:59.833 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:59.833 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:59.833 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:59.833 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-07-21T22:38:59.833 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkH+Y1EBAAl+qTqd+gFrB9LtJWwD5dgA==", 2023-07-21T22:38:59.833 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:59.833 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:38:59.834 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:38:59.834 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:38:59.834 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:59.834 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:59.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:59.834 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:59.834 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-07-21T22:38:59.834 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAKBLtkPwZrLBAAQHZECi2zHST1MKYgGoa/Iw==", 2023-07-21T22:38:59.835 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:59.835 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:38:59.835 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:38:59.835 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:59.835 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:59.835 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:59.835 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:59.836 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-07-21T22:38:59.836 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQANBLtkvwgwNBAApurMm8c3pSlX2r16Gli/Ag==", 2023-07-21T22:38:59.836 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:59.836 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:38:59.836 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:38:59.836 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:59.836 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:59.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:59.837 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:59.837 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-07-21T22:38:59.837 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAQBLtkf2p1OxAAcKYw2RixFefYAwcfkGnOKQ==", 2023-07-21T22:38:59.837 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:59.837 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:38:59.837 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:38:59.837 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:59.837 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:59.838 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:59.838 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:59.838 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-07-21T22:38:59.838 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAUBLtkQUl6BhAAXXT1ZK1h9aZEcp6qIHsLiA==", 2023-07-21T22:38:59.838 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:59.838 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:38:59.838 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:38:59.839 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:59.839 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:59.839 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:59.839 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:59.839 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-07-21T22:38:59.839 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAaBLtkc1VfExAAPzDz2k/c0qVePG9h1saQCw==", 2023-07-21T22:38:59.839 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:59.839 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:38:59.840 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:38:59.840 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:59.840 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:59.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:59.840 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:59.840 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-07-21T22:38:59.840 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAdBLtkJ6fcGhAAglVSJIQS04WYBv4APhl57g==", 2023-07-21T22:38:59.840 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:59.841 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:38:59.841 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:38:59.841 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:59.841 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:59.841 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:59.841 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:59.841 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-07-21T22:38:59.842 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAgBLtkPINGIRAAWKs1RNQIdhZYlDAzDgUkNw==", 2023-07-21T22:38:59.842 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:59.842 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:38:59.842 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:38:59.842 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:59.842 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:59.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:59.843 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:59.843 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-07-21T22:38:59.843 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAjBLtk83MCKBAAZH2NhMBphVv4QkRzy+NDgg==", 2023-07-21T22:38:59.843 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:59.843 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:38:59.843 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:38:59.843 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:59.844 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:59.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:59.844 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:59.844 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-07-21T22:38:59.844 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA==", 2023-07-21T22:38:59.844 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:59.844 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:38:59.844 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-07-21T22:38:59.845 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-21T22:38:59.845 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:59.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:59.845 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:59.845 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-07-21T22:38:59.845 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkPVXTHhAAYmkzwAvqsfrowpAucTnlUQ==", 2023-07-21T22:38:59.845 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:59.845 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:38:59.846 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:38:59.846 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:38:59.846 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:38:59.846 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:59.846 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:59.846 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:59.846 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-07-21T22:38:59.847 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkd7wSGxAArvSYwe+k48vgRzb3fQAEAQ==", 2023-07-21T22:38:59.847 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:59.847 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:38:59.847 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:38:59.847 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:38:59.847 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:38:59.847 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:59.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:59.848 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:59.848 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-07-21T22:38:59.848 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkoZ4YJRAAX4yh0Q1pR4wY7yEV6kg9QA==", 2023-07-21T22:38:59.848 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:59.848 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:38:59.848 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:38:59.848 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:38:59.848 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:38:59.849 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:59.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:59.849 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:59.849 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-07-21T22:38:59.849 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtk0ILFGhAAQZ+8lGNFVdOtZYOuLlfkoQ==", 2023-07-21T22:38:59.849 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:59.849 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:38:59.850 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:38:59.850 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:38:59.850 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:59.850 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:59.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:59.850 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:59.850 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-07-21T22:38:59.850 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkdobtMhAAQbwi3cvsrW9P0t3d52oEKw==", 2023-07-21T22:38:59.851 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:59.851 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:38:59.851 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T22:38:59.851 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:59.851 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:59.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:38:59.851 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:38:59.851 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-07-21T22:38:59.852 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkHhzpLhAAZTx4Vrc0Htk88104SzuAxQ==", 2023-07-21T22:38:59.852 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:38:59.852 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:38:59.852 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T22:38:59.852 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:38:59.852 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:59.852 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:38:59.853 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-07-21T22:38:59.853 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:38:59.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.784+0000 7fdf2e974640 1 -- 172.21.15.6:0/2032717408 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fdf140663d0 msgr2=0x7fdf14068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:59.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.784+0000 7fdf2e974640 1 --2- 172.21.15.6:0/2032717408 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fdf140663d0 0x7fdf14068880 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdf180017b0 tx=0x7fdf18001440 comp rx=0 tx=0).stop 2023-07-21T22:38:59.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.784+0000 7fdf2e974640 1 -- 172.21.15.6:0/2032717408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf281e59d0 msgr2=0x7fdf281e5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:59.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.784+0000 7fdf2e974640 1 --2- 172.21.15.6:0/2032717408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf281e59d0 0x7fdf281e5e40 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fdf20002240 tx=0x7fdf20009750 comp rx=0 tx=0).stop 2023-07-21T22:38:59.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.784+0000 7fdf2e974640 1 -- 172.21.15.6:0/2032717408 shutdown_connections 2023-07-21T22:38:59.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.784+0000 7fdf2e974640 1 --2- 172.21.15.6:0/2032717408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf281e59d0 0x7fdf281e5e40 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:59.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.784+0000 7fdf2e974640 1 --2- 172.21.15.6:0/2032717408 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdf280b22a0 0x7fdf281e5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:59.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.784+0000 7fdf2e974640 1 --2- 172.21.15.6:0/2032717408 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fdf140663d0 0x7fdf14068880 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:59.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.784+0000 7fdf2e974640 1 --2- 172.21.15.6:0/2032717408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdf10004d10 0x7fdf280b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:59.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.784+0000 7fdf2e974640 1 -- 172.21.15.6:0/2032717408 >> 172.21.15.6:0/2032717408 conn(0x7fdf280650b0 msgr2=0x7fdf280cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.784+0000 7fdf2e974640 1 -- 172.21.15.6:0/2032717408 shutdown_connections 2023-07-21T22:38:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.784+0000 7fdf2e974640 1 -- 172.21.15.6:0/2032717408 wait complete. 2023-07-21T22:38:59.856 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:39:00.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59b679d640 1 Processor -- start 2023-07-21T22:39:00.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59b679d640 1 -- start start 2023-07-21T22:39:00.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59b679d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f59b00c8ad0 0x7f59b00c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59b679d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59b00c9560 0x7f59b00ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59b679d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b00cc700 con 0x7f59b0158ce0 2023-07-21T22:39:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59b679d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b00c99e0 con 0x7f59b00c8ad0 2023-07-21T22:39:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59b679d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00b0ff0 con 0x7f59b00c9560 2023-07-21T22:39:00.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59affff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f59b0158ce0 0x7f59b0070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33110/0 (socket says 172.21.15.6:33110) 2023-07-21T22:39:00.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59affff640 1 -- 172.21.15.6:0/1375237256 learned_addr learned my addr 172.21.15.6:0/1375237256 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:39:00.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59aeffd640 1 -- 172.21.15.6:0/1375237256 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193695940 0 0) 0x7f59b00cc700 con 0x7f59b0158ce0 2023-07-21T22:39:00.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59aeffd640 1 -- 172.21.15.6:0/1375237256 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5998003530 con 0x7f59b0158ce0 2023-07-21T22:39:00.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59b4d3a640 1 --2- 172.21.15.6:0/1375237256 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59b00c9560 0x7f59b00ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59af7fe640 1 --2- 172.21.15.6:0/1375237256 >> v2:172.21.15.161:3300/0 conn(0x7f59b00c8ad0 0x7f59b00c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59aeffd640 1 -- 172.21.15.6:0/1375237256 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3260429298 0 0) 0x7f5998003530 con 0x7f59b0158ce0 2023-07-21T22:39:00.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59aeffd640 1 -- 172.21.15.6:0/1375237256 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59b00c9560 msgr2=0x7f59b00ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:00.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59aeffd640 1 --2- 172.21.15.6:0/1375237256 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59b00c9560 0x7f59b00ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59aeffd640 1 -- 172.21.15.6:0/1375237256 >> v2:172.21.15.161:3300/0 conn(0x7f59b00c8ad0 msgr2=0x7f59b00c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:00.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59aeffd640 1 --2- 172.21.15.6:0/1375237256 >> v2:172.21.15.161:3300/0 conn(0x7f59b00c8ad0 0x7f59b00c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59aeffd640 1 -- 172.21.15.6:0/1375237256 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b0070c80 con 0x7f59b0158ce0 2023-07-21T22:39:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59aeffd640 1 -- 172.21.15.6:0/1375237256 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f59a0001680 con 0x7f59b0158ce0 2023-07-21T22:39:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59aeffd640 1 -- 172.21.15.6:0/1375237256 >> v1:172.21.15.6:6789/0 conn(0x7f59b0158ce0 legacy=0x7f59b0070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59aeffd640 1 --2- 172.21.15.6:0/1375237256 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59b00c9560 0x7f5998003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59aeffd640 1 --2- 172.21.15.6:0/1375237256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5998003fb0 0x7f59980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59aeffd640 1 --2- 172.21.15.6:0/1375237256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5998004d10 0x7f5998005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59aeffd640 1 -- 172.21.15.6:0/1375237256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00c99e0 con 0x7f5998003fb0 2023-07-21T22:39:00.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59aeffd640 1 -- 172.21.15.6:0/1375237256 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00b0ff0 con 0x7f5998004d10 2023-07-21T22:39:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59aeffd640 1 -- 172.21.15.6:0/1375237256 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599800bbd0 con 0x7f59b00c9560 2023-07-21T22:39:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.956+0000 7f59af7fe640 1 --2- 172.21.15.6:0/1375237256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5998003fb0 0x7f59980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.960+0000 7f59affff640 1 --2- 172.21.15.6:0/1375237256 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59b00c9560 0x7f5998003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.960+0000 7f59b4d3a640 1 --2- 172.21.15.6:0/1375237256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5998004d10 0x7f5998005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.960+0000 7f59af7fe640 1 -- 172.21.15.6:0/1375237256 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59b00c9560 msgr2=0x7f5998003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.960+0000 7f59af7fe640 1 --2- 172.21.15.6:0/1375237256 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59b00c9560 0x7f5998003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.960+0000 7f59af7fe640 1 -- 172.21.15.6:0/1375237256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5998004d10 msgr2=0x7f5998005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:00.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.960+0000 7f59af7fe640 1 --2- 172.21.15.6:0/1375237256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5998004d10 0x7f5998005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.960+0000 7f59af7fe640 1 -- 172.21.15.6:0/1375237256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5998003530 con 0x7f5998003fb0 2023-07-21T22:39:00.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.960+0000 7f59affff640 1 --2- 172.21.15.6:0/1375237256 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59b00c9560 0x7f5998003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.960+0000 7f59af7fe640 1 --2- 172.21.15.6:0/1375237256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5998003fb0 0x7f59980047d0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f59a400ba30 tx=0x7f59a401c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec5af46edd85d84 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.960+0000 7f59aeffd640 1 -- 172.21.15.6:0/1375237256 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a40af600 con 0x7f5998003fb0 2023-07-21T22:39:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.960+0000 7f59aeffd640 1 -- 172.21.15.6:0/1375237256 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a40a9070 con 0x7f5998003fb0 2023-07-21T22:39:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.960+0000 7f59aeffd640 1 -- 172.21.15.6:0/1375237256 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a40af9a0 con 0x7f5998003fb0 2023-07-21T22:39:00.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.960+0000 7f59b679d640 1 -- 172.21.15.6:0/1375237256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5998003fb0 msgr2=0x7f59980047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.960+0000 7f59b679d640 1 --2- 172.21.15.6:0/1375237256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5998003fb0 0x7f59980047d0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f59a400ba30 tx=0x7f59a401c690 comp rx=0 tx=0).stop 2023-07-21T22:39:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.960+0000 7f59b4d3a640 1 -- 172.21.15.6:0/1375237256 reap_dead start 2023-07-21T22:39:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59b679d640 1 -- 172.21.15.6:0/1375237256 shutdown_connections 2023-07-21T22:39:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59b679d640 1 -- 172.21.15.6:0/1375237256 >> 172.21.15.6:0/1375237256 conn(0x7f59b00afcf0 msgr2=0x7f59b00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59b679d640 1 -- 172.21.15.6:0/1375237256 shutdown_connections 2023-07-21T22:39:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59b679d640 1 -- 172.21.15.6:0/1375237256 wait complete. 2023-07-21T22:39:00.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59b679d640 1 Processor -- start 2023-07-21T22:39:00.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59b679d640 1 -- start start 2023-07-21T22:39:00.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59b679d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5998003fb0 0x7f59b00c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59b679d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b00c79d0 0x7f59b006ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59b679d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59b00c7e40 0x7f59b0070460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59b679d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00c5a00 con 0x7f59b00c79d0 2023-07-21T22:39:00.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59b679d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b01f8080 con 0x7f59b00c7e40 2023-07-21T22:39:00.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59b679d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00c53b0 con 0x7f5998003fb0 2023-07-21T22:39:00.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59af7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b00c79d0 0x7f59b006ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59af7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b00c79d0 0x7f59b006ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36940/0 (socket says 172.21.15.6:36940) 2023-07-21T22:39:00.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59af7fe640 1 -- 172.21.15.6:0/721595067 learned_addr learned my addr 172.21.15.6:0/721595067 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:00.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59affff640 1 --2- 172.21.15.6:0/721595067 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5998003fb0 0x7f59b00c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59b4d3a640 1 --2- 172.21.15.6:0/721595067 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59b00c7e40 0x7f59b0070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59af7fe640 1 -- 172.21.15.6:0/721595067 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5998003fb0 msgr2=0x7f59b00c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:00.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59af7fe640 1 --2- 172.21.15.6:0/721595067 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5998003fb0 0x7f59b00c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59af7fe640 1 -- 172.21.15.6:0/721595067 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59b00c7e40 msgr2=0x7f59b0070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:00.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59af7fe640 1 --2- 172.21.15.6:0/721595067 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59b00c7e40 0x7f59b0070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.964+0000 7f59af7fe640 1 -- 172.21.15.6:0/721595067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b00c5690 con 0x7f59b00c79d0 2023-07-21T22:39:00.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.968+0000 7f59af7fe640 1 --2- 172.21.15.6:0/721595067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b00c79d0 0x7f59b006ff20 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f59a40b1040 tx=0x7f5998005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:00.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.968+0000 7f59acff9640 1 -- 172.21.15.6:0/721595067 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a40afbf0 con 0x7f59b00c79d0 2023-07-21T22:39:00.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.968+0000 7f59acff9640 1 -- 172.21.15.6:0/721595067 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a40a6040 con 0x7f59b00c79d0 2023-07-21T22:39:00.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.968+0000 7f59acff9640 1 -- 172.21.15.6:0/721595067 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a4004020 con 0x7f59b00c79d0 2023-07-21T22:39:00.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.968+0000 7f59b679d640 1 -- 172.21.15.6:0/721595067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b01f7350 con 0x7f59b00c79d0 2023-07-21T22:39:00.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.968+0000 7f59b679d640 1 -- 172.21.15.6:0/721595067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b01f7800 con 0x7f59b00c79d0 2023-07-21T22:39:00.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.968+0000 7f59b679d640 1 -- 172.21.15.6:0/721595067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b00ca1a0 con 0x7f59b00c79d0 2023-07-21T22:39:00.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.968+0000 7f59acff9640 1 -- 172.21.15.6:0/721595067 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f59a4004180 con 0x7f59b00c79d0 2023-07-21T22:39:00.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.968+0000 7f59acff9640 1 --2- 172.21.15.6:0/721595067 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f599c0663d0 0x7f599c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.968+0000 7f59acff9640 1 -- 172.21.15.6:0/721595067 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f59a411db40 con 0x7f59b00c79d0 2023-07-21T22:39:00.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.968+0000 7f59affff640 1 --2- 172.21.15.6:0/721595067 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f599c0663d0 0x7f599c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.972+0000 7f59affff640 1 --2- 172.21.15.6:0/721595067 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f599c0663d0 0x7f599c068880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f59a0001040 tx=0x7f59a0009040 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:00.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:38:59.972+0000 7f59acff9640 1 -- 172.21.15.6:0/721595067 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f59a40eb110 con 0x7f59b00c79d0 2023-07-21T22:39:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.132+0000 7f59b679d640 1 -- 172.21.15.6:0/721595067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59b00c5210 con 0x7f59b00c79d0 2023-07-21T22:39:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.132+0000 7f59acff9640 1 -- 172.21.15.6:0/721595067 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+14692 (secure 0 0 0) 0x7f59b00c5210 con 0x7f59b00c79d0 2023-07-21T22:39:00.178 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:39:00.178 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":153,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:38:59.376581+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:39:00.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.136+0000 7f59b679d640 1 -- 172.21.15.6:0/721595067 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f599c0663d0 msgr2=0x7f599c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:00.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.136+0000 7f59b679d640 1 --2- 172.21.15.6:0/721595067 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f599c0663d0 0x7f599c068880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f59a0001040 tx=0x7f59a0009040 comp rx=0 tx=0).stop 2023-07-21T22:39:00.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.136+0000 7f59b679d640 1 -- 172.21.15.6:0/721595067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b00c79d0 msgr2=0x7f59b006ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:00.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.136+0000 7f59b679d640 1 --2- 172.21.15.6:0/721595067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b00c79d0 0x7f59b006ff20 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f59a40b1040 tx=0x7f5998005800 comp rx=0 tx=0).stop 2023-07-21T22:39:00.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.136+0000 7f59b679d640 1 -- 172.21.15.6:0/721595067 shutdown_connections 2023-07-21T22:39:00.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.136+0000 7f59b679d640 1 --2- 172.21.15.6:0/721595067 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f599c0663d0 0x7f599c068880 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.136+0000 7f59b679d640 1 --2- 172.21.15.6:0/721595067 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59b00c7e40 0x7f59b0070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.136+0000 7f59b679d640 1 --2- 172.21.15.6:0/721595067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b00c79d0 0x7f59b006ff20 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.136+0000 7f59b679d640 1 --2- 172.21.15.6:0/721595067 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5998003fb0 0x7f59b00c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.136+0000 7f59b679d640 1 -- 172.21.15.6:0/721595067 >> 172.21.15.6:0/721595067 conn(0x7f59b00afcf0 msgr2=0x7f59b00ca540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:00.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.136+0000 7f59b679d640 1 -- 172.21.15.6:0/721595067 shutdown_connections 2023-07-21T22:39:00.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.136+0000 7f59b679d640 1 -- 172.21.15.6:0/721595067 wait complete. 2023-07-21T22:39:00.200 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:39:00.201 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:39:00.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.304+0000 7f2fd5234640 1 Processor -- start 2023-07-21T22:39:00.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.304+0000 7f2fd5234640 1 -- start start 2023-07-21T22:39:00.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.304+0000 7f2fd5234640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2fd006db00 0x7f2fd00ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.304+0000 7f2fd5234640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2fd00b0760 0x7f2fd00ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.304+0000 7f2fd5234640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd00cab20 con 0x7f2fd015beb0 2023-07-21T22:39:00.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.304+0000 7f2fd5234640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd00cb4b0 con 0x7f2fd00b0760 2023-07-21T22:39:00.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.304+0000 7f2fd5234640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd00cb6a0 con 0x7f2fd006db00 2023-07-21T22:39:00.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.304+0000 7f2fced9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2fd015beb0 0x7f2fd00cada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33120/0 (socket says 172.21.15.6:33120) 2023-07-21T22:39:00.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.304+0000 7f2fced9d640 1 -- 172.21.15.6:0/718226744 learned_addr learned my addr 172.21.15.6:0/718226744 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:39:00.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.304+0000 7f2fcf59e640 1 --2- 172.21.15.6:0/718226744 >> v2:172.21.15.6:3300/0 conn(0x7f2fd00b0760 0x7f2fd00ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.304+0000 7f2fce59c640 1 --2- 172.21.15.6:0/718226744 >> v2:172.21.15.161:3300/0 conn(0x7f2fd006db00 0x7f2fd00ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.304+0000 7f2fcdd9b640 1 -- 172.21.15.6:0/718226744 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154288836 0 0) 0x7f2fd00cab20 con 0x7f2fd015beb0 2023-07-21T22:39:00.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.304+0000 7f2fcdd9b640 1 -- 172.21.15.6:0/718226744 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fb8003530 con 0x7f2fd015beb0 2023-07-21T22:39:00.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.304+0000 7f2fcf59e640 1 -- 172.21.15.6:0/718226744 >> v2:172.21.15.161:3300/0 conn(0x7f2fd006db00 msgr2=0x7f2fd00ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:00.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.304+0000 7f2fcf59e640 1 --2- 172.21.15.6:0/718226744 >> v2:172.21.15.161:3300/0 conn(0x7f2fd006db00 0x7f2fd00ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.304+0000 7f2fcf59e640 1 -- 172.21.15.6:0/718226744 >> v1:172.21.15.6:6789/0 conn(0x7f2fd015beb0 legacy=0x7f2fd00cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:00.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.304+0000 7f2fcf59e640 1 -- 172.21.15.6:0/718226744 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd006d020 con 0x7f2fd00b0760 2023-07-21T22:39:00.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.308+0000 7f2fcf59e640 1 --2- 172.21.15.6:0/718226744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd00b0760 0x7f2fd00ca5e0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f2fd006efe0 tx=0x7f2fc801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd4a5c1e44c8f28 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:00.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.308+0000 7f2fcdd9b640 1 -- 172.21.15.6:0/718226744 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc80a5910 con 0x7f2fd00b0760 2023-07-21T22:39:00.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.308+0000 7f2fcdd9b640 1 -- 172.21.15.6:0/718226744 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc80a5a70 con 0x7f2fd00b0760 2023-07-21T22:39:00.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.308+0000 7f2fcdd9b640 1 -- 172.21.15.6:0/718226744 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc80a5e00 con 0x7f2fd00b0760 2023-07-21T22:39:00.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.308+0000 7f2fd5234640 1 -- 172.21.15.6:0/718226744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd00b0760 msgr2=0x7f2fd00ca5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:00.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.308+0000 7f2fd5234640 1 --2- 172.21.15.6:0/718226744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd00b0760 0x7f2fd00ca5e0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f2fd006efe0 tx=0x7f2fc801c850 comp rx=0 tx=0).stop 2023-07-21T22:39:00.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.308+0000 7f2fd5234640 1 -- 172.21.15.6:0/718226744 shutdown_connections 2023-07-21T22:39:00.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.308+0000 7f2fd5234640 1 --2- 172.21.15.6:0/718226744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd00b0760 0x7f2fd00ca5e0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.308+0000 7f2fd5234640 1 --2- 172.21.15.6:0/718226744 >> v2:172.21.15.161:3300/0 conn(0x7f2fd006db00 0x7f2fd00ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.308+0000 7f2fd5234640 1 -- 172.21.15.6:0/718226744 >> 172.21.15.6:0/718226744 conn(0x7f2fd006c2f0 msgr2=0x7f2fd00aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:00.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.308+0000 7f2fd5234640 1 -- 172.21.15.6:0/718226744 shutdown_connections 2023-07-21T22:39:00.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.308+0000 7f2fd5234640 1 -- 172.21.15.6:0/718226744 wait complete. 2023-07-21T22:39:00.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fd5234640 1 Processor -- start 2023-07-21T22:39:00.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fd5234640 1 -- start start 2023-07-21T22:39:00.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fd5234640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd006db00 0x7f2fd014d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fd5234640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fd00b0760 0x7f2fd00c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fd5234640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fd015beb0 0x7f2fd00b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fd5234640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd00c6da0 con 0x7f2fd006db00 2023-07-21T22:39:00.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fd5234640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd00c4e30 con 0x7f2fd00b0760 2023-07-21T22:39:00.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fd5234640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd00c6190 con 0x7f2fd015beb0 2023-07-21T22:39:00.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fced9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd006db00 0x7f2fd014d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fced9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd006db00 0x7f2fd014d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36968/0 (socket says 172.21.15.6:36968) 2023-07-21T22:39:00.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fced9d640 1 -- 172.21.15.6:0/4011145878 learned_addr learned my addr 172.21.15.6:0/4011145878 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:00.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fce59c640 1 --2- 172.21.15.6:0/4011145878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fd00b0760 0x7f2fd00c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fced9d640 1 -- 172.21.15.6:0/4011145878 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fd015beb0 msgr2=0x7f2fd00b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:00.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fcf59e640 1 --2- 172.21.15.6:0/4011145878 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fd015beb0 0x7f2fd00b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fced9d640 1 --2- 172.21.15.6:0/4011145878 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fd015beb0 0x7f2fd00b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fced9d640 1 -- 172.21.15.6:0/4011145878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fd00b0760 msgr2=0x7f2fd00c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:00.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fced9d640 1 --2- 172.21.15.6:0/4011145878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fd00b0760 0x7f2fd00c7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fced9d640 1 -- 172.21.15.6:0/4011145878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc8009a70 con 0x7f2fd006db00 2023-07-21T22:39:00.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fce59c640 1 --2- 172.21.15.6:0/4011145878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fd00b0760 0x7f2fd00c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:39:00.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fcf59e640 1 --2- 172.21.15.6:0/4011145878 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fd015beb0 0x7f2fd00b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:39:00.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fced9d640 1 --2- 172.21.15.6:0/4011145878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd006db00 0x7f2fd014d5d0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000c420 tx=0x7f2fc000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:00.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fb77fe640 1 -- 172.21.15.6:0/4011145878 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0005cf0 con 0x7f2fd006db00 2023-07-21T22:39:00.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fb77fe640 1 -- 172.21.15.6:0/4011145878 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc0005e50 con 0x7f2fd006db00 2023-07-21T22:39:00.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fb77fe640 1 -- 172.21.15.6:0/4011145878 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc00072d0 con 0x7f2fd006db00 2023-07-21T22:39:00.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fd5234640 1 -- 172.21.15.6:0/4011145878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd00c6470 con 0x7f2fd006db00 2023-07-21T22:39:00.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fd5234640 1 -- 172.21.15.6:0/4011145878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd00c6a30 con 0x7f2fd006db00 2023-07-21T22:39:00.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.312+0000 7f2fd5234640 1 -- 172.21.15.6:0/4011145878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd00678d0 con 0x7f2fd006db00 2023-07-21T22:39:00.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.316+0000 7f2fb77fe640 1 -- 172.21.15.6:0/4011145878 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2fc0007430 con 0x7f2fd006db00 2023-07-21T22:39:00.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.316+0000 7f2fb77fe640 1 --2- 172.21.15.6:0/4011145878 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f2fbc0663a0 0x7f2fbc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.316+0000 7f2fb77fe640 1 -- 172.21.15.6:0/4011145878 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f2fc00830b0 con 0x7f2fd006db00 2023-07-21T22:39:00.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.316+0000 7f2fce59c640 1 --2- 172.21.15.6:0/4011145878 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f2fbc0663a0 0x7f2fbc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.316+0000 7f2fce59c640 1 --2- 172.21.15.6:0/4011145878 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f2fbc0663a0 0x7f2fbc068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2fd01f7230 tx=0x7f2fc4008040 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:00.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.320+0000 7f2fb77fe640 1 -- 172.21.15.6:0/4011145878 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2fc0054250 con 0x7f2fd006db00 2023-07-21T22:39:00.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.476+0000 7f2fd5234640 1 -- 172.21.15.6:0/4011145878 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2fd00cbb20 con 0x7f2fd006db00 2023-07-21T22:39:00.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.476+0000 7f2fb77fe640 1 -- 172.21.15.6:0/4011145878 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v153) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2fc0053de0 con 0x7f2fd006db00 2023-07-21T22:39:00.521 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:39:00.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.476+0000 7f2fd5234640 1 -- 172.21.15.6:0/4011145878 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f2fbc0663a0 msgr2=0x7f2fbc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:00.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.476+0000 7f2fd5234640 1 --2- 172.21.15.6:0/4011145878 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f2fbc0663a0 0x7f2fbc068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2fd01f7230 tx=0x7f2fc4008040 comp rx=0 tx=0).stop 2023-07-21T22:39:00.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.476+0000 7f2fd5234640 1 -- 172.21.15.6:0/4011145878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd006db00 msgr2=0x7f2fd014d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:00.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.476+0000 7f2fd5234640 1 --2- 172.21.15.6:0/4011145878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd006db00 0x7f2fd014d5d0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000c420 tx=0x7f2fc000c8e0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.476+0000 7f2fd5234640 1 -- 172.21.15.6:0/4011145878 shutdown_connections 2023-07-21T22:39:00.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.476+0000 7f2fd5234640 1 --2- 172.21.15.6:0/4011145878 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2fd015beb0 0x7f2fd00b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.476+0000 7f2fd5234640 1 --2- 172.21.15.6:0/4011145878 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f2fbc0663a0 0x7f2fbc068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.476+0000 7f2fd5234640 1 --2- 172.21.15.6:0/4011145878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fd00b0760 0x7f2fd00c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.476+0000 7f2fd5234640 1 --2- 172.21.15.6:0/4011145878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd006db00 0x7f2fd014d5d0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.476+0000 7f2fd5234640 1 -- 172.21.15.6:0/4011145878 >> 172.21.15.6:0/4011145878 conn(0x7f2fd006c2f0 msgr2=0x7f2fd006f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:00.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.476+0000 7f2fd5234640 1 -- 172.21.15.6:0/4011145878 shutdown_connections 2023-07-21T22:39:00.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.476+0000 7f2fd5234640 1 -- 172.21.15.6:0/4011145878 wait complete. 2023-07-21T22:39:00.542 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:39:00.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.644+0000 7f3fa3a5c640 1 Processor -- start 2023-07-21T22:39:00.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.644+0000 7f3fa3a5c640 1 -- start start 2023-07-21T22:39:00.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.644+0000 7f3fa3a5c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3f9c0cdd10 0x7f3f9c0ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.644+0000 7f3fa3a5c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f9c0d0820 0x7f3f9c0accf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.644+0000 7f3fa3a5c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9c0b0450 con 0x7f3f9c0b1770 2023-07-21T22:39:00.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.644+0000 7f3fa3a5c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9c0ce620 con 0x7f3f9c0cdd10 2023-07-21T22:39:00.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.644+0000 7f3fa3a5c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0b06d0 con 0x7f3f9c0d0820 2023-07-21T22:39:00.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.644+0000 7f3fa17f8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3f9c0cdd10 0x7f3f9c0ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.644+0000 7f3fa17f8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3f9c0cdd10 0x7f3f9c0ce0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36974/0 (socket says 172.21.15.6:36974) 2023-07-21T22:39:00.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.644+0000 7f3fa17f8640 1 -- 172.21.15.6:0/1520241323 learned_addr learned my addr 172.21.15.6:0/1520241323 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:00.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.644+0000 7f3fa0ff7640 1 --1- 172.21.15.6:0/1520241323 >> v1:172.21.15.6:6789/0 conn(0x7f3f9c0b1770 0x7f3f9c0d0110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33132/0 (socket says 172.21.15.6:33132) 2023-07-21T22:39:00.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.644+0000 7f3fa1ff9640 1 --2- 172.21.15.6:0/1520241323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f9c0d0820 0x7f3f9c0accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.644+0000 7f3fa17f8640 1 -- 172.21.15.6:0/1520241323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f9c0d0820 msgr2=0x7f3f9c0accf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:00.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.644+0000 7f3fa17f8640 1 --2- 172.21.15.6:0/1520241323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f9c0d0820 0x7f3f9c0accf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.644+0000 7f3fa17f8640 1 -- 172.21.15.6:0/1520241323 >> v1:172.21.15.6:6789/0 conn(0x7f3f9c0b1770 legacy=0x7f3f9c0d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:00.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.644+0000 7f3f93fff640 1 -- 172.21.15.6:0/1520241323 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759769634 0 0) 0x7f3f9c0b0450 con 0x7f3f9c0b1770 2023-07-21T22:39:00.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.644+0000 7f3fa17f8640 1 -- 172.21.15.6:0/1520241323 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c0b09b0 con 0x7f3f9c0cdd10 2023-07-21T22:39:00.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.648+0000 7f3fa17f8640 1 --2- 172.21.15.6:0/1520241323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f9c0cdd10 0x7f3f9c0ce0e0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f3f98009870 tx=0x7f3f9801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71cada09b272181 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:00.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.648+0000 7f3f93fff640 1 -- 172.21.15.6:0/1520241323 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f980aa670 con 0x7f3f9c0cdd10 2023-07-21T22:39:00.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.648+0000 7f3f93fff640 1 -- 172.21.15.6:0/1520241323 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f980aa7d0 con 0x7f3f9c0cdd10 2023-07-21T22:39:00.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.648+0000 7f3f93fff640 1 -- 172.21.15.6:0/1520241323 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f980aab60 con 0x7f3f9c0cdd10 2023-07-21T22:39:00.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.648+0000 7f3fa3a5c640 1 -- 172.21.15.6:0/1520241323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f9c0cdd10 msgr2=0x7f3f9c0ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.648+0000 7f3fa3a5c640 1 --2- 172.21.15.6:0/1520241323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f9c0cdd10 0x7f3f9c0ce0e0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f3f98009870 tx=0x7f3f9801c510 comp rx=0 tx=0).stop 2023-07-21T22:39:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.648+0000 7f3fa3a5c640 1 -- 172.21.15.6:0/1520241323 shutdown_connections 2023-07-21T22:39:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.648+0000 7f3fa3a5c640 1 --2- 172.21.15.6:0/1520241323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f9c0d0820 0x7f3f9c0accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.648+0000 7f3fa3a5c640 1 --2- 172.21.15.6:0/1520241323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f9c0cdd10 0x7f3f9c0ce0e0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.648+0000 7f3fa3a5c640 1 -- 172.21.15.6:0/1520241323 >> 172.21.15.6:0/1520241323 conn(0x7f3f9c099490 msgr2=0x7f3f9c089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.648+0000 7f3fa3a5c640 1 -- 172.21.15.6:0/1520241323 shutdown_connections 2023-07-21T22:39:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.648+0000 7f3fa3a5c640 1 -- 172.21.15.6:0/1520241323 wait complete. 2023-07-21T22:39:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa3a5c640 1 Processor -- start 2023-07-21T22:39:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa3a5c640 1 -- start start 2023-07-21T22:39:00.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa3a5c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f9c0b1770 0x7f3f9c147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa3a5c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f9c0cdd10 0x7f3f9c158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa3a5c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f9c0d0820 0x7f3f9c158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa3a5c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c1477c0 con 0x7f3f9c0b1770 2023-07-21T22:39:00.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa3a5c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c06b740 con 0x7f3f9c0d0820 2023-07-21T22:39:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa3a5c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c06ba20 con 0x7f3f9c0cdd10 2023-07-21T22:39:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa17f8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f9c0b1770 0x7f3f9c147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa17f8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f9c0b1770 0x7f3f9c147280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36990/0 (socket says 172.21.15.6:36990) 2023-07-21T22:39:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa17f8640 1 -- 172.21.15.6:0/2838466578 learned_addr learned my addr 172.21.15.6:0/2838466578 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa1ff9640 1 --2- 172.21.15.6:0/2838466578 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f9c0d0820 0x7f3f9c158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa0ff7640 1 --2- 172.21.15.6:0/2838466578 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f9c0cdd10 0x7f3f9c158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa17f8640 1 -- 172.21.15.6:0/2838466578 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f9c0cdd10 msgr2=0x7f3f9c158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:00.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa17f8640 1 --2- 172.21.15.6:0/2838466578 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f9c0cdd10 0x7f3f9c158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa17f8640 1 -- 172.21.15.6:0/2838466578 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f9c0d0820 msgr2=0x7f3f9c158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:00.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa17f8640 1 --2- 172.21.15.6:0/2838466578 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f9c0d0820 0x7f3f9c158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa17f8640 1 -- 172.21.15.6:0/2838466578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f980094d0 con 0x7f3f9c0b1770 2023-07-21T22:39:00.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa1ff9640 1 --2- 172.21.15.6:0/2838466578 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f9c0d0820 0x7f3f9c158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:00.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa17f8640 1 --2- 172.21.15.6:0/2838466578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f9c0b1770 0x7f3f9c147280 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f3f980ac040 tx=0x7f3f9801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:00.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3f91ffb640 1 -- 172.21.15.6:0/2838466578 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f980aad50 con 0x7f3f9c0b1770 2023-07-21T22:39:00.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3f91ffb640 1 -- 172.21.15.6:0/2838466578 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f980b7070 con 0x7f3f9c0b1770 2023-07-21T22:39:00.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa3a5c640 1 -- 172.21.15.6:0/2838466578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9c06bd00 con 0x7f3f9c0b1770 2023-07-21T22:39:00.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3f91ffb640 1 -- 172.21.15.6:0/2838466578 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f98004220 con 0x7f3f9c0b1770 2023-07-21T22:39:00.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.652+0000 7f3fa3a5c640 1 -- 172.21.15.6:0/2838466578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9c06c2c0 con 0x7f3f9c0b1770 2023-07-21T22:39:00.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.656+0000 7f3fa3a5c640 1 -- 172.21.15.6:0/2838466578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9c0678d0 con 0x7f3f9c0b1770 2023-07-21T22:39:00.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.656+0000 7f3f91ffb640 1 -- 172.21.15.6:0/2838466578 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3f98004380 con 0x7f3f9c0b1770 2023-07-21T22:39:00.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.656+0000 7f3f91ffb640 1 --2- 172.21.15.6:0/2838466578 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f3f800663a0 0x7f3f80068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:00.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.656+0000 7f3f91ffb640 1 -- 172.21.15.6:0/2838466578 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f3f9811e280 con 0x7f3f9c0b1770 2023-07-21T22:39:00.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.656+0000 7f3fa0ff7640 1 --2- 172.21.15.6:0/2838466578 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f3f800663a0 0x7f3f80068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:00.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.656+0000 7f3fa0ff7640 1 --2- 172.21.15.6:0/2838466578 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f3f800663a0 0x7f3f80068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c06dd20 tx=0x7f3f8c007b60 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:00.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.660+0000 7f3f91ffb640 1 -- 172.21.15.6:0/2838466578 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3f980eb7c0 con 0x7f3f9c0b1770 2023-07-21T22:39:00.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.812+0000 7f3fa3a5c640 1 -- 172.21.15.6:0/2838466578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3f9c0ce2f0 con 0x7f3f9c0b1770 2023-07-21T22:39:00.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.816+0000 7f3f91ffb640 1 -- 172.21.15.6:0/2838466578 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v153) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3f980b90a0 con 0x7f3f9c0b1770 2023-07-21T22:39:00.860 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:39:00.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.816+0000 7f3fa3a5c640 1 -- 172.21.15.6:0/2838466578 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f3f800663a0 msgr2=0x7f3f80068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:00.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.816+0000 7f3fa3a5c640 1 --2- 172.21.15.6:0/2838466578 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f3f800663a0 0x7f3f80068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c06dd20 tx=0x7f3f8c007b60 comp rx=0 tx=0).stop 2023-07-21T22:39:00.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.816+0000 7f3fa3a5c640 1 -- 172.21.15.6:0/2838466578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f9c0b1770 msgr2=0x7f3f9c147280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:00.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.816+0000 7f3fa3a5c640 1 --2- 172.21.15.6:0/2838466578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f9c0b1770 0x7f3f9c147280 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f3f980ac040 tx=0x7f3f9801ad50 comp rx=0 tx=0).stop 2023-07-21T22:39:00.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.816+0000 7f3fa3a5c640 1 -- 172.21.15.6:0/2838466578 shutdown_connections 2023-07-21T22:39:00.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.816+0000 7f3fa3a5c640 1 --2- 172.21.15.6:0/2838466578 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f3f800663a0 0x7f3f80068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.816+0000 7f3fa3a5c640 1 --2- 172.21.15.6:0/2838466578 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f9c0d0820 0x7f3f9c158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.816+0000 7f3fa3a5c640 1 --2- 172.21.15.6:0/2838466578 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f9c0cdd10 0x7f3f9c158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.816+0000 7f3fa3a5c640 1 --2- 172.21.15.6:0/2838466578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f9c0b1770 0x7f3f9c147280 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:00.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.816+0000 7f3fa3a5c640 1 -- 172.21.15.6:0/2838466578 >> 172.21.15.6:0/2838466578 conn(0x7f3f9c099490 msgr2=0x7f3f9c0ae5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:00.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.816+0000 7f3fa3a5c640 1 -- 172.21.15.6:0/2838466578 shutdown_connections 2023-07-21T22:39:00.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.816+0000 7f3fa3a5c640 1 -- 172.21.15.6:0/2838466578 wait complete. 2023-07-21T22:39:00.880 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T22:39:01.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.980+0000 7f1b20fe9640 1 Processor -- start 2023-07-21T22:39:01.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.980+0000 7f1b20fe9640 1 -- start start 2023-07-21T22:39:01.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.980+0000 7f1b20fe9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1b1c15fd60 0x7f1b1c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:01.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.980+0000 7f1b20fe9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b1c0d1850 0x7f1b1c0d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:01.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.980+0000 7f1b20fe9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1c0ccaf0 con 0x7f1b1c0b7c70 2023-07-21T22:39:01.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.980+0000 7f1b20fe9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b1c0d1190 con 0x7f1b1c15fd60 2023-07-21T22:39:01.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.980+0000 7f1b20fe9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c160600 con 0x7f1b1c0d1850 2023-07-21T22:39:01.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.980+0000 7f1b13fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1b1c15fd60 0x7f1b1c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:01.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.980+0000 7f1b1ad9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b1c0d1850 0x7f1b1c0d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:01.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.980+0000 7f1b1ad9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b1c0d1850 0x7f1b1c0d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:40034/0 (socket says 172.21.15.6:40034) 2023-07-21T22:39:01.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.980+0000 7f1b13fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1b1c15fd60 0x7f1b1c0d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:49988/0 (socket says 172.21.15.6:49988) 2023-07-21T22:39:01.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.980+0000 7f1b1ad9d640 1 -- 172.21.15.6:0/173319954 learned_addr learned my addr 172.21.15.6:0/173319954 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:01.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.980+0000 7f1b13fff640 1 -- 172.21.15.6:0/173319954 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b1c0d1850 msgr2=0x7f1b1c0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:01.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.980+0000 7f1b13fff640 1 --2- 172.21.15.6:0/173319954 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b1c0d1850 0x7f1b1c0d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:01.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.980+0000 7f1b13fff640 1 -- 172.21.15.6:0/173319954 >> v1:172.21.15.161:6789/0 conn(0x7f1b1c0b7c70 legacy=0x7f1b1c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:01.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.980+0000 7f1b13fff640 1 -- 172.21.15.6:0/173319954 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1c160320 con 0x7f1b1c15fd60 2023-07-21T22:39:01.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.980+0000 7f1b1ad9d640 1 --2- 172.21.15.6:0/173319954 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b1c0d1850 0x7f1b1c0d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:39:01.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.980+0000 7f1b19d9b640 1 -- 172.21.15.6:0/173319954 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513103577 0 0) 0x7f1b1c0ccaf0 con 0x7f1b1c0b7c70 2023-07-21T22:39:01.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.984+0000 7f1b13fff640 1 --2- 172.21.15.6:0/173319954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b1c15fd60 0x7f1b1c0d0c50 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1b040097c0 tx=0x7f1b0401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afea9f82e974e681 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:01.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.984+0000 7f1b19d9b640 1 -- 172.21.15.6:0/173319954 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b040ab670 con 0x7f1b1c15fd60 2023-07-21T22:39:01.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.984+0000 7f1b19d9b640 1 -- 172.21.15.6:0/173319954 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b040ab7d0 con 0x7f1b1c15fd60 2023-07-21T22:39:01.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.984+0000 7f1b19d9b640 1 -- 172.21.15.6:0/173319954 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b040abb60 con 0x7f1b1c15fd60 2023-07-21T22:39:01.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.984+0000 7f1b20fe9640 1 -- 172.21.15.6:0/173319954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b1c15fd60 msgr2=0x7f1b1c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:01.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.984+0000 7f1b20fe9640 1 --2- 172.21.15.6:0/173319954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b1c15fd60 0x7f1b1c0d0c50 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1b040097c0 tx=0x7f1b0401c450 comp rx=0 tx=0).stop 2023-07-21T22:39:01.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.984+0000 7f1b20fe9640 1 -- 172.21.15.6:0/173319954 shutdown_connections 2023-07-21T22:39:01.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.984+0000 7f1b20fe9640 1 --2- 172.21.15.6:0/173319954 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b1c0d1850 0x7f1b1c0d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:01.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.984+0000 7f1b20fe9640 1 --2- 172.21.15.6:0/173319954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b1c15fd60 0x7f1b1c0d0c50 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:01.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.984+0000 7f1b20fe9640 1 -- 172.21.15.6:0/173319954 >> 172.21.15.6:0/173319954 conn(0x7f1b1c0650b0 msgr2=0x7f1b1c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:01.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.984+0000 7f1b20fe9640 1 -- 172.21.15.6:0/173319954 shutdown_connections 2023-07-21T22:39:01.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.984+0000 7f1b20fe9640 1 -- 172.21.15.6:0/173319954 wait complete. 2023-07-21T22:39:01.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b20fe9640 1 Processor -- start 2023-07-21T22:39:01.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b20fe9640 1 -- start start 2023-07-21T22:39:01.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b20fe9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b1c0b7c70 0x7f1b1c152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:01.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b20fe9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1c0d1850 0x7f1b1c1f9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:01.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b20fe9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b1c15fd60 0x7f1b1c0ce550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:01.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b20fe9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c152650 con 0x7f1b1c0d1850 2023-07-21T22:39:01.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b20fe9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c1f98b0 con 0x7f1b1c0b7c70 2023-07-21T22:39:01.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b20fe9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c0b5f10 con 0x7f1b1c15fd60 2023-07-21T22:39:01.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b13fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1c0d1850 0x7f1b1c1f9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:01.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b13fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1c0d1850 0x7f1b1c1f9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36996/0 (socket says 172.21.15.6:36996) 2023-07-21T22:39:01.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b13fff640 1 -- 172.21.15.6:0/2376241827 learned_addr learned my addr 172.21.15.6:0/2376241827 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:01.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b1a59c640 1 --2- 172.21.15.6:0/2376241827 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b1c0b7c70 0x7f1b1c152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:01.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b1ad9d640 1 --2- 172.21.15.6:0/2376241827 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b1c15fd60 0x7f1b1c0ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:01.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b13fff640 1 -- 172.21.15.6:0/2376241827 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b1c15fd60 msgr2=0x7f1b1c0ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:01.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b13fff640 1 --2- 172.21.15.6:0/2376241827 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b1c15fd60 0x7f1b1c0ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:01.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b13fff640 1 -- 172.21.15.6:0/2376241827 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b1c0b7c70 msgr2=0x7f1b1c152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:01.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b13fff640 1 --2- 172.21.15.6:0/2376241827 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b1c0b7c70 0x7f1b1c152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:01.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b13fff640 1 -- 172.21.15.6:0/2376241827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b14009b30 con 0x7f1b1c0d1850 2023-07-21T22:39:01.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b13fff640 1 --2- 172.21.15.6:0/2376241827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1c0d1850 0x7f1b1c1f9370 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f1b0401ab00 tx=0x7f1b040191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:01.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b12ffd640 1 -- 172.21.15.6:0/2376241827 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b040abe90 con 0x7f1b1c0d1850 2023-07-21T22:39:01.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b12ffd640 1 -- 172.21.15.6:0/2376241827 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b040bf450 con 0x7f1b1c0d1850 2023-07-21T22:39:01.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b12ffd640 1 -- 172.21.15.6:0/2376241827 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b040bf820 con 0x7f1b1c0d1850 2023-07-21T22:39:01.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b20fe9640 1 -- 172.21.15.6:0/2376241827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b04009420 con 0x7f1b1c0d1850 2023-07-21T22:39:01.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.988+0000 7f1b20fe9640 1 -- 172.21.15.6:0/2376241827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1c159d80 con 0x7f1b1c0d1850 2023-07-21T22:39:01.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.992+0000 7f1b20fe9640 1 -- 172.21.15.6:0/2376241827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1c0c9240 con 0x7f1b1c0d1850 2023-07-21T22:39:01.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.992+0000 7f1b12ffd640 1 -- 172.21.15.6:0/2376241827 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1b040c93f0 con 0x7f1b1c0d1850 2023-07-21T22:39:01.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.992+0000 7f1b12ffd640 1 --2- 172.21.15.6:0/2376241827 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f1afc0663a0 0x7f1afc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:01.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.992+0000 7f1b12ffd640 1 -- 172.21.15.6:0/2376241827 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f1b0411e670 con 0x7f1b1c0d1850 2023-07-21T22:39:01.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.992+0000 7f1b1a59c640 1 --2- 172.21.15.6:0/2376241827 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f1afc0663a0 0x7f1afc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:01.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.992+0000 7f1b1a59c640 1 --2- 172.21.15.6:0/2376241827 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f1afc0663a0 0x7f1afc068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c007fd0 tx=0x7f1b0c009040 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:00.996+0000 7f1b12ffd640 1 -- 172.21.15.6:0/2376241827 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1b040ebc70 con 0x7f1b1c0d1850 2023-07-21T22:39:01.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.156+0000 7f1b20fe9640 1 -- 172.21.15.6:0/2376241827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1b1c0678d0 con 0x7f1b1c0d1850 2023-07-21T22:39:01.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.156+0000 7f1b12ffd640 1 -- 172.21.15.6:0/2376241827 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v153) v1 ==== 84+0+126 (secure 0 0 0) 0x7f1b040c4090 con 0x7f1b1c0d1850 2023-07-21T22:39:01.201 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:39:01.201 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:39:01.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:39:01.201 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-07-21T22:39:01.202 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-07-21T22:39:01.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:39:01.202 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:39:01.202 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-07-21T22:39:01.202 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-07-21T22:39:01.202 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:39:01.202 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:39:01.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.156+0000 7f1b20fe9640 1 -- 172.21.15.6:0/2376241827 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f1afc0663a0 msgr2=0x7f1afc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:01.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.156+0000 7f1b20fe9640 1 --2- 172.21.15.6:0/2376241827 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f1afc0663a0 0x7f1afc068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c007fd0 tx=0x7f1b0c009040 comp rx=0 tx=0).stop 2023-07-21T22:39:01.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.156+0000 7f1b20fe9640 1 -- 172.21.15.6:0/2376241827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1c0d1850 msgr2=0x7f1b1c1f9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:01.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.156+0000 7f1b20fe9640 1 --2- 172.21.15.6:0/2376241827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1c0d1850 0x7f1b1c1f9370 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f1b0401ab00 tx=0x7f1b040191f0 comp rx=0 tx=0).stop 2023-07-21T22:39:01.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.156+0000 7f1b20fe9640 1 -- 172.21.15.6:0/2376241827 shutdown_connections 2023-07-21T22:39:01.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.156+0000 7f1b20fe9640 1 --2- 172.21.15.6:0/2376241827 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b1c15fd60 0x7f1b1c0ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:01.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.156+0000 7f1b20fe9640 1 --2- 172.21.15.6:0/2376241827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b1c0d1850 0x7f1b1c1f9370 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:01.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.156+0000 7f1b20fe9640 1 --2- 172.21.15.6:0/2376241827 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f1afc0663a0 0x7f1afc068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:01.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.156+0000 7f1b20fe9640 1 --2- 172.21.15.6:0/2376241827 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b1c0b7c70 0x7f1b1c152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:01.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.156+0000 7f1b20fe9640 1 -- 172.21.15.6:0/2376241827 >> 172.21.15.6:0/2376241827 conn(0x7f1b1c0650b0 msgr2=0x7f1b1c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:01.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.156+0000 7f1b20fe9640 1 -- 172.21.15.6:0/2376241827 shutdown_connections 2023-07-21T22:39:01.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.156+0000 7f1b20fe9640 1 -- 172.21.15.6:0/2376241827 wait complete. 2023-07-21T22:39:01.222 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-21T22:39:01.222 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-21T22:39:01.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.324+0000 7f3f6aba9640 1 Processor -- start 2023-07-21T22:39:01.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.324+0000 7f3f6aba9640 1 -- start start 2023-07-21T22:39:01.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.324+0000 7f3f6aba9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3f640b4390 0x7f3f640b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:01.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.324+0000 7f3f6aba9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f640d0000 con 0x7f3f6415ee20 2023-07-21T22:39:01.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.324+0000 7f3f6aba9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f640cf510 con 0x7f3f640b5050 2023-07-21T22:39:01.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.324+0000 7f3f6aba9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f640ce0c0 con 0x7f3f640b4390 2023-07-21T22:39:01.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.328+0000 7f3f69ba7640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3f6415ee20 0x7f3f640d0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33142/0 (socket says 172.21.15.6:33142) 2023-07-21T22:39:01.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.328+0000 7f3f69ba7640 1 -- 172.21.15.6:0/826297066 learned_addr learned my addr 172.21.15.6:0/826297066 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:39:01.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.328+0000 7f3f6a3a8640 1 --2- 172.21.15.6:0/826297066 >> v2:172.21.15.161:3300/0 conn(0x7f3f640b4390 0x7f3f640b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:01.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.328+0000 7f3f68ba5640 1 -- 172.21.15.6:0/826297066 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394685469 0 0) 0x7f3f640d0000 con 0x7f3f6415ee20 2023-07-21T22:39:01.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.328+0000 7f3f68ba5640 1 -- 172.21.15.6:0/826297066 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f50003530 con 0x7f3f6415ee20 2023-07-21T22:39:01.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.328+0000 7f3f6a3a8640 1 -- 172.21.15.6:0/826297066 >> v1:172.21.15.161:6789/0 conn(0x7f3f640b5050 legacy=0x7f3f640b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:01.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.328+0000 7f3f6a3a8640 1 -- 172.21.15.6:0/826297066 >> v1:172.21.15.6:6789/0 conn(0x7f3f6415ee20 legacy=0x7f3f640d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:01.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.328+0000 7f3f6a3a8640 1 -- 172.21.15.6:0/826297066 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f640d0270 con 0x7f3f640b4390 2023-07-21T22:39:01.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.328+0000 7f3f6a3a8640 1 --2- 172.21.15.6:0/826297066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f640b4390 0x7f3f640b54c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c009d90 tx=0x7f3f5c01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33b4fed590b9a28d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:01.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f68ba5640 1 -- 172.21.15.6:0/826297066 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c0a5870 con 0x7f3f640b4390 2023-07-21T22:39:01.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f68ba5640 1 -- 172.21.15.6:0/826297066 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c0a59d0 con 0x7f3f640b4390 2023-07-21T22:39:01.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f68ba5640 1 -- 172.21.15.6:0/826297066 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c0a5d60 con 0x7f3f640b4390 2023-07-21T22:39:01.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f6aba9640 1 -- 172.21.15.6:0/826297066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f640b4390 msgr2=0x7f3f640b54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:01.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f6aba9640 1 --2- 172.21.15.6:0/826297066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f640b4390 0x7f3f640b54c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c009d90 tx=0x7f3f5c01c8c0 comp rx=0 tx=0).stop 2023-07-21T22:39:01.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f6aba9640 1 -- 172.21.15.6:0/826297066 shutdown_connections 2023-07-21T22:39:01.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f6aba9640 1 --2- 172.21.15.6:0/826297066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f640b4390 0x7f3f640b54c0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:01.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f6aba9640 1 -- 172.21.15.6:0/826297066 >> 172.21.15.6:0/826297066 conn(0x7f3f64069e00 msgr2=0x7f3f6406a200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:01.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f6aba9640 1 -- 172.21.15.6:0/826297066 shutdown_connections 2023-07-21T22:39:01.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f6aba9640 1 -- 172.21.15.6:0/826297066 wait complete. 2023-07-21T22:39:01.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f6aba9640 1 Processor -- start 2023-07-21T22:39:01.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f6aba9640 1 -- start start 2023-07-21T22:39:01.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f6aba9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f640b4390 0x7f3f64141610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:01.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f6aba9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f640b5050 0x7f3f640b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:01.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f6aba9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f6415ee20 0x7f3f6415db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:01.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f6aba9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f640ca250 con 0x7f3f6415ee20 2023-07-21T22:39:01.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f6aba9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f640c96d0 con 0x7f3f640b4390 2023-07-21T22:39:01.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f6aba9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f640c99b0 con 0x7f3f640b5050 2023-07-21T22:39:01.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f6a3a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f6415ee20 0x7f3f6415db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:01.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f6a3a8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f6415ee20 0x7f3f6415db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37002/0 (socket says 172.21.15.6:37002) 2023-07-21T22:39:01.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f6a3a8640 1 -- 172.21.15.6:0/2636438658 learned_addr learned my addr 172.21.15.6:0/2636438658 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:01.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f69ba7640 1 --2- 172.21.15.6:0/2636438658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f640b4390 0x7f3f64141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:01.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.332+0000 7f3f693a6640 1 --2- 172.21.15.6:0/2636438658 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f640b5050 0x7f3f640b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:01.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.336+0000 7f3f6a3a8640 1 -- 172.21.15.6:0/2636438658 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f640b5050 msgr2=0x7f3f640b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:01.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.336+0000 7f3f6a3a8640 1 --2- 172.21.15.6:0/2636438658 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f640b5050 0x7f3f640b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:01.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.336+0000 7f3f6a3a8640 1 -- 172.21.15.6:0/2636438658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f640b4390 msgr2=0x7f3f64141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:01.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.336+0000 7f3f6a3a8640 1 --2- 172.21.15.6:0/2636438658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f640b4390 0x7f3f64141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:01.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.336+0000 7f3f6a3a8640 1 -- 172.21.15.6:0/2636438658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c009a70 con 0x7f3f6415ee20 2023-07-21T22:39:01.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.336+0000 7f3f6a3a8640 1 --2- 172.21.15.6:0/2636438658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f6415ee20 0x7f3f6415db10 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0b0040 tx=0x7f3f5c019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:01.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.336+0000 7f3f5a7fc640 1 -- 172.21.15.6:0/2636438658 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c0b9650 con 0x7f3f6415ee20 2023-07-21T22:39:01.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.336+0000 7f3f5a7fc640 1 -- 172.21.15.6:0/2636438658 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c0b97b0 con 0x7f3f6415ee20 2023-07-21T22:39:01.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.336+0000 7f3f6aba9640 1 -- 172.21.15.6:0/2636438658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f640c9c90 con 0x7f3f6415ee20 2023-07-21T22:39:01.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.336+0000 7f3f5a7fc640 1 -- 172.21.15.6:0/2636438658 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c0b9b40 con 0x7f3f6415ee20 2023-07-21T22:39:01.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.336+0000 7f3f6aba9640 1 -- 172.21.15.6:0/2636438658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f640b40c0 con 0x7f3f6415ee20 2023-07-21T22:39:01.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.336+0000 7f3f6aba9640 1 -- 172.21.15.6:0/2636438658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f6404e020 con 0x7f3f6415ee20 2023-07-21T22:39:01.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.336+0000 7f3f5a7fc640 1 -- 172.21.15.6:0/2636438658 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3f5c0b9ca0 con 0x7f3f6415ee20 2023-07-21T22:39:01.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.340+0000 7f3f5a7fc640 1 --2- 172.21.15.6:0/2636438658 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f3f480663a0 0x7f3f48068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:01.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.340+0000 7f3f5a7fc640 1 -- 172.21.15.6:0/2636438658 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f3f5c11ed70 con 0x7f3f6415ee20 2023-07-21T22:39:01.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.340+0000 7f3f69ba7640 1 --2- 172.21.15.6:0/2636438658 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f3f480663a0 0x7f3f48068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:01.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.340+0000 7f3f69ba7640 1 --2- 172.21.15.6:0/2636438658 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f3f480663a0 0x7f3f48068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3f600011f0 tx=0x7f3f60007d40 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:01.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.344+0000 7f3f5a7fc640 1 -- 172.21.15.6:0/2636438658 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3f5c0ec3f0 con 0x7f3f6415ee20 2023-07-21T22:39:01.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:01.500+0000 7f3f6aba9640 1 -- 172.21.15.6:0/2636438658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3f640b3960 con 0x7f3f6415ee20 2023-07-21T22:39:02.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.012+0000 7f3f5a7fc640 1 -- 172.21.15.6:0/2636438658 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v154) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3f5c0bd0b0 con 0x7f3f6415ee20 2023-07-21T22:39:02.057 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-07-21T22:39:02.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.016+0000 7f3f6aba9640 1 -- 172.21.15.6:0/2636438658 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f3f480663a0 msgr2=0x7f3f48068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:02.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.016+0000 7f3f6aba9640 1 --2- 172.21.15.6:0/2636438658 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f3f480663a0 0x7f3f48068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3f600011f0 tx=0x7f3f60007d40 comp rx=0 tx=0).stop 2023-07-21T22:39:02.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.016+0000 7f3f6aba9640 1 -- 172.21.15.6:0/2636438658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f6415ee20 msgr2=0x7f3f6415db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.016+0000 7f3f6aba9640 1 --2- 172.21.15.6:0/2636438658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f6415ee20 0x7f3f6415db10 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0b0040 tx=0x7f3f5c019660 comp rx=0 tx=0).stop 2023-07-21T22:39:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.016+0000 7f3f6aba9640 1 -- 172.21.15.6:0/2636438658 shutdown_connections 2023-07-21T22:39:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.016+0000 7f3f6aba9640 1 --2- 172.21.15.6:0/2636438658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f6415ee20 0x7f3f6415db10 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.016+0000 7f3f6aba9640 1 --2- 172.21.15.6:0/2636438658 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f640b5050 0x7f3f640b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:02.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.016+0000 7f3f6aba9640 1 --2- 172.21.15.6:0/2636438658 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f3f480663a0 0x7f3f48068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.016+0000 7f3f6aba9640 1 --2- 172.21.15.6:0/2636438658 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f640b4390 0x7f3f64141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.016+0000 7f3f6aba9640 1 -- 172.21.15.6:0/2636438658 >> 172.21.15.6:0/2636438658 conn(0x7f3f64069e00 msgr2=0x7f3f640b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.016+0000 7f3f6aba9640 1 -- 172.21.15.6:0/2636438658 shutdown_connections 2023-07-21T22:39:02.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.016+0000 7f3f6aba9640 1 -- 172.21.15.6:0/2636438658 wait complete. 2023-07-21T22:39:02.084 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T22:39:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.192+0000 7facb2a48640 1 Processor -- start 2023-07-21T22:39:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.192+0000 7facb2a48640 1 -- start start 2023-07-21T22:39:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.192+0000 7facb2a48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7facac06cff0 0x7facac0c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.192+0000 7facb2a48640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facac0c8eb0 con 0x7facac0c85a0 2023-07-21T22:39:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.192+0000 7facb2a48640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facac156130 con 0x7facac0cc000 2023-07-21T22:39:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.192+0000 7facb2a48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facac158a10 con 0x7facac06cff0 2023-07-21T22:39:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.192+0000 7facabfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7facac0c85a0 0x7facac15c750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33150/0 (socket says 172.21.15.6:33150) 2023-07-21T22:39:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.192+0000 7facabfff640 1 -- 172.21.15.6:0/1861024864 learned_addr learned my addr 172.21.15.6:0/1861024864 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:39:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.192+0000 7facab7fe640 1 --2- 172.21.15.6:0/1861024864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7facac06cff0 0x7facac0c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.192+0000 7facaaffd640 1 -- 172.21.15.6:0/1861024864 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261520357 0 0) 0x7facac0c8eb0 con 0x7facac0c85a0 2023-07-21T22:39:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.192+0000 7facaaffd640 1 -- 172.21.15.6:0/1861024864 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac94003530 con 0x7facac0c85a0 2023-07-21T22:39:02.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.192+0000 7facaaffd640 1 -- 172.21.15.6:0/1861024864 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1276018412 0 0) 0x7facac156130 con 0x7facac0cc000 2023-07-21T22:39:02.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.192+0000 7facab7fe640 1 -- 172.21.15.6:0/1861024864 >> v1:172.21.15.161:6789/0 conn(0x7facac0cc000 legacy=0x7facac0cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:02.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.192+0000 7facab7fe640 1 -- 172.21.15.6:0/1861024864 >> v1:172.21.15.6:6789/0 conn(0x7facac0c85a0 legacy=0x7facac15c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:02.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.192+0000 7facab7fe640 1 -- 172.21.15.6:0/1861024864 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac158cf0 con 0x7facac06cff0 2023-07-21T22:39:02.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.196+0000 7facab7fe640 1 --2- 172.21.15.6:0/1861024864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7facac06cff0 0x7facac0c8970 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7faca00097f0 tx=0x7faca001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99785f27f57f6287 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:02.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.196+0000 7facaaffd640 1 -- 172.21.15.6:0/1861024864 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca00ac410 con 0x7facac06cff0 2023-07-21T22:39:02.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.196+0000 7facaaffd640 1 -- 172.21.15.6:0/1861024864 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca00ac570 con 0x7facac06cff0 2023-07-21T22:39:02.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.196+0000 7facaaffd640 1 -- 172.21.15.6:0/1861024864 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca00ac900 con 0x7facac06cff0 2023-07-21T22:39:02.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.196+0000 7facb2a48640 1 -- 172.21.15.6:0/1861024864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7facac06cff0 msgr2=0x7facac0c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.196+0000 7facb2a48640 1 --2- 172.21.15.6:0/1861024864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7facac06cff0 0x7facac0c8970 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7faca00097f0 tx=0x7faca001c430 comp rx=0 tx=0).stop 2023-07-21T22:39:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.196+0000 7facb2a48640 1 -- 172.21.15.6:0/1861024864 shutdown_connections 2023-07-21T22:39:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.196+0000 7facb2a48640 1 --2- 172.21.15.6:0/1861024864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7facac06cff0 0x7facac0c8970 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.196+0000 7facb2a48640 1 -- 172.21.15.6:0/1861024864 >> 172.21.15.6:0/1861024864 conn(0x7facac0afac0 msgr2=0x7facac0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.196+0000 7facb2a48640 1 -- 172.21.15.6:0/1861024864 shutdown_connections 2023-07-21T22:39:02.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.196+0000 7facb2a48640 1 -- 172.21.15.6:0/1861024864 wait complete. 2023-07-21T22:39:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.200+0000 7facb2a48640 1 Processor -- start 2023-07-21T22:39:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.200+0000 7facb2a48640 1 -- start start 2023-07-21T22:39:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.200+0000 7facb2a48640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7facac06cff0 0x7facac15aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.200+0000 7facb2a48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facac0c85a0 0x7facac070d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.200+0000 7facb2a48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7facac0cc000 0x7facac0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.200+0000 7facb2a48640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac0b0dc0 con 0x7facac0c85a0 2023-07-21T22:39:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.200+0000 7facb2a48640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac15b1c0 con 0x7facac06cff0 2023-07-21T22:39:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.200+0000 7facb2a48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facac15b4a0 con 0x7facac0cc000 2023-07-21T22:39:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.200+0000 7facab7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facac0c85a0 0x7facac070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.200+0000 7facab7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facac0c85a0 0x7facac070d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37018/0 (socket says 172.21.15.6:37018) 2023-07-21T22:39:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.200+0000 7facab7fe640 1 -- 172.21.15.6:0/3096791608 learned_addr learned my addr 172.21.15.6:0/3096791608 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:02.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.200+0000 7facabfff640 1 --2- 172.21.15.6:0/3096791608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7facac06cff0 0x7facac15aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.200+0000 7facb0fe5640 1 --2- 172.21.15.6:0/3096791608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7facac0cc000 0x7facac0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.200+0000 7facab7fe640 1 -- 172.21.15.6:0/3096791608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7facac0cc000 msgr2=0x7facac0ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.200+0000 7facab7fe640 1 --2- 172.21.15.6:0/3096791608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7facac0cc000 0x7facac0ce030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.200+0000 7facab7fe640 1 -- 172.21.15.6:0/3096791608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7facac06cff0 msgr2=0x7facac15aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.200+0000 7facab7fe640 1 --2- 172.21.15.6:0/3096791608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7facac06cff0 0x7facac15aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:02.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.200+0000 7facab7fe640 1 -- 172.21.15.6:0/3096791608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca0009420 con 0x7facac0c85a0 2023-07-21T22:39:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.200+0000 7facabfff640 1 --2- 172.21.15.6:0/3096791608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7facac06cff0 0x7facac15aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.200+0000 7facab7fe640 1 --2- 172.21.15.6:0/3096791608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facac0c85a0 0x7facac070d50 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7faca00097f0 tx=0x7faca00191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.204+0000 7faca8ff9640 1 -- 172.21.15.6:0/3096791608 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0006e20 con 0x7facac0c85a0 2023-07-21T22:39:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.204+0000 7faca8ff9640 1 -- 172.21.15.6:0/3096791608 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca00ace50 con 0x7facac0c85a0 2023-07-21T22:39:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.204+0000 7facb2a48640 1 -- 172.21.15.6:0/3096791608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facac15b780 con 0x7facac0c85a0 2023-07-21T22:39:02.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.204+0000 7faca8ff9640 1 -- 172.21.15.6:0/3096791608 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0004260 con 0x7facac0c85a0 2023-07-21T22:39:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.204+0000 7facb2a48640 1 -- 172.21.15.6:0/3096791608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facac15bd40 con 0x7facac0c85a0 2023-07-21T22:39:02.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.204+0000 7facb2a48640 1 -- 172.21.15.6:0/3096791608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facac0678d0 con 0x7facac0c85a0 2023-07-21T22:39:02.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.204+0000 7faca8ff9640 1 -- 172.21.15.6:0/3096791608 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7faca00b3040 con 0x7facac0c85a0 2023-07-21T22:39:02.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.204+0000 7faca8ff9640 1 --2- 172.21.15.6:0/3096791608 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fac980663a0 0x7fac98068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:02.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.204+0000 7faca8ff9640 1 -- 172.21.15.6:0/3096791608 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5652+0+0 (secure 0 0 0) 0x7faca011e0e0 con 0x7facac0c85a0 2023-07-21T22:39:02.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.204+0000 7facabfff640 1 --2- 172.21.15.6:0/3096791608 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fac980663a0 0x7fac98068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:02.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.208+0000 7facabfff640 1 --2- 172.21.15.6:0/3096791608 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fac980663a0 0x7fac98068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fac9c005890 tx=0x7fac9c009040 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:02.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.208+0000 7faca8ff9640 1 -- 172.21.15.6:0/3096791608 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faca00eb4b0 con 0x7facac0c85a0 2023-07-21T22:39:02.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:02.364+0000 7facb2a48640 1 -- 172.21.15.6:0/3096791608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7facac0cb7b0 con 0x7facac0c85a0 2023-07-21T22:39:03.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.020+0000 7faca8ff9640 1 -- 172.21.15.6:0/3096791608 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v155) v1 ==== 170+0+0 (secure 0 0 0) 0x7faca00eead0 con 0x7facac0c85a0 2023-07-21T22:39:03.067 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-07-21T22:39:03.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.036+0000 7facb2a48640 1 -- 172.21.15.6:0/3096791608 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fac980663a0 msgr2=0x7fac98068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:03.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.036+0000 7facb2a48640 1 --2- 172.21.15.6:0/3096791608 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fac980663a0 0x7fac98068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fac9c005890 tx=0x7fac9c009040 comp rx=0 tx=0).stop 2023-07-21T22:39:03.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.036+0000 7facb2a48640 1 -- 172.21.15.6:0/3096791608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facac0c85a0 msgr2=0x7facac070d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:03.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.036+0000 7facb2a48640 1 --2- 172.21.15.6:0/3096791608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facac0c85a0 0x7facac070d50 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7faca00097f0 tx=0x7faca00191d0 comp rx=0 tx=0).stop 2023-07-21T22:39:03.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.036+0000 7facb2a48640 1 -- 172.21.15.6:0/3096791608 shutdown_connections 2023-07-21T22:39:03.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.036+0000 7facb2a48640 1 --2- 172.21.15.6:0/3096791608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7facac0cc000 0x7facac0ce030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:03.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.036+0000 7facb2a48640 1 --2- 172.21.15.6:0/3096791608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facac0c85a0 0x7facac070d50 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:03.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.036+0000 7facb2a48640 1 --2- 172.21.15.6:0/3096791608 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fac980663a0 0x7fac98068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:03.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.036+0000 7facb2a48640 1 --2- 172.21.15.6:0/3096791608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7facac06cff0 0x7facac15aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:03.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.036+0000 7facb2a48640 1 -- 172.21.15.6:0/3096791608 >> 172.21.15.6:0/3096791608 conn(0x7facac0afac0 msgr2=0x7facac154be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:03.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.036+0000 7facb2a48640 1 -- 172.21.15.6:0/3096791608 shutdown_connections 2023-07-21T22:39:03.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.036+0000 7facb2a48640 1 -- 172.21.15.6:0/3096791608 wait complete. 2023-07-21T22:39:03.111 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-21T22:39:03.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.216+0000 7fde26396640 1 Processor -- start 2023-07-21T22:39:03.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.216+0000 7fde26396640 1 -- start start 2023-07-21T22:39:03.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.216+0000 7fde26396640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fde200af2b0 0x7fde2015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:03.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.216+0000 7fde26396640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde20159d70 con 0x7fde20069430 2023-07-21T22:39:03.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.216+0000 7fde26396640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde200c9c60 con 0x7fde20070f30 2023-07-21T22:39:03.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.216+0000 7fde26396640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde200c9f40 con 0x7fde200af2b0 2023-07-21T22:39:03.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.216+0000 7fde24933640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fde200af2b0 0x7fde2015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:03.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.216+0000 7fde24933640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fde200af2b0 0x7fde2015a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37024/0 (socket says 172.21.15.6:37024) 2023-07-21T22:39:03.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.216+0000 7fde24933640 1 -- 172.21.15.6:0/1015481740 learned_addr learned my addr 172.21.15.6:0/1015481740 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:03.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.216+0000 7fde24933640 1 -- 172.21.15.6:0/1015481740 >> v1:172.21.15.161:6789/0 conn(0x7fde20070f30 legacy=0x7fde200ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:03.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.216+0000 7fde24933640 1 -- 172.21.15.6:0/1015481740 >> v1:172.21.15.6:6789/0 conn(0x7fde20069430 legacy=0x7fde20069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:03.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.216+0000 7fde24933640 1 -- 172.21.15.6:0/1015481740 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde200ca220 con 0x7fde200af2b0 2023-07-21T22:39:03.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.216+0000 7fde1effd640 1 -- 172.21.15.6:0/1015481740 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3366622479 0 0) 0x7fde10001120 con 0x7fde20069430 2023-07-21T22:39:03.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.220+0000 7fde24933640 1 --2- 172.21.15.6:0/1015481740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde200af2b0 0x7fde2015a1f0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fde18009e50 tx=0x7fde1801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5030f4983d9fa5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:03.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.220+0000 7fde1effd640 1 -- 172.21.15.6:0/1015481740 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde180a58b0 con 0x7fde200af2b0 2023-07-21T22:39:03.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.220+0000 7fde1effd640 1 -- 172.21.15.6:0/1015481740 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde180a5a10 con 0x7fde200af2b0 2023-07-21T22:39:03.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.220+0000 7fde1effd640 1 -- 172.21.15.6:0/1015481740 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde180a5da0 con 0x7fde200af2b0 2023-07-21T22:39:03.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.220+0000 7fde26396640 1 -- 172.21.15.6:0/1015481740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde200af2b0 msgr2=0x7fde2015a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:03.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.220+0000 7fde26396640 1 --2- 172.21.15.6:0/1015481740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde200af2b0 0x7fde2015a1f0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fde18009e50 tx=0x7fde1801c9d0 comp rx=0 tx=0).stop 2023-07-21T22:39:03.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.220+0000 7fde26396640 1 -- 172.21.15.6:0/1015481740 shutdown_connections 2023-07-21T22:39:03.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.220+0000 7fde26396640 1 --2- 172.21.15.6:0/1015481740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde200af2b0 0x7fde2015a1f0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:03.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.220+0000 7fde26396640 1 -- 172.21.15.6:0/1015481740 >> 172.21.15.6:0/1015481740 conn(0x7fde200cde90 msgr2=0x7fde200ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:03.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.220+0000 7fde26396640 1 -- 172.21.15.6:0/1015481740 shutdown_connections 2023-07-21T22:39:03.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.220+0000 7fde26396640 1 -- 172.21.15.6:0/1015481740 wait complete. 2023-07-21T22:39:03.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde26396640 1 Processor -- start 2023-07-21T22:39:03.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde26396640 1 -- start start 2023-07-21T22:39:03.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde26396640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde20069430 0x7fde200ad350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:03.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde26396640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde20070f30 0x7fde200c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:03.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde26396640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde200af2b0 0x7fde200c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:03.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde26396640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde200ac480 con 0x7fde20069430 2023-07-21T22:39:03.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde26396640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde200ab890 con 0x7fde20070f30 2023-07-21T22:39:03.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde26396640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde200abb50 con 0x7fde200af2b0 2023-07-21T22:39:03.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde1ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde20069430 0x7fde200ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:03.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde1ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde20069430 0x7fde200ad350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37032/0 (socket says 172.21.15.6:37032) 2023-07-21T22:39:03.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde1ffff640 1 -- 172.21.15.6:0/1770948845 learned_addr learned my addr 172.21.15.6:0/1770948845 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:03.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde1f7fe640 1 --2- 172.21.15.6:0/1770948845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde20070f30 0x7fde200c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:03.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde24933640 1 --2- 172.21.15.6:0/1770948845 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde200af2b0 0x7fde200c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:03.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde1ffff640 1 -- 172.21.15.6:0/1770948845 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde200af2b0 msgr2=0x7fde200c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:03.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde1ffff640 1 --2- 172.21.15.6:0/1770948845 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde200af2b0 0x7fde200c2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:03.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde1ffff640 1 -- 172.21.15.6:0/1770948845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde20070f30 msgr2=0x7fde200c4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:03.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde1ffff640 1 --2- 172.21.15.6:0/1770948845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde20070f30 0x7fde200c4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:03.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde1ffff640 1 -- 172.21.15.6:0/1770948845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde18009b30 con 0x7fde20069430 2023-07-21T22:39:03.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde24933640 1 --2- 172.21.15.6:0/1770948845 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde200af2b0 0x7fde200c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:03.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde1ffff640 1 --2- 172.21.15.6:0/1770948845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde20069430 0x7fde200ad350 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fde10001ec0 tx=0x7fde1000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:03.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde1cff9640 1 -- 172.21.15.6:0/1770948845 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde100054e0 con 0x7fde20069430 2023-07-21T22:39:03.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde1cff9640 1 -- 172.21.15.6:0/1770948845 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde10003600 con 0x7fde20069430 2023-07-21T22:39:03.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde26396640 1 -- 172.21.15.6:0/1770948845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde200abe30 con 0x7fde20069430 2023-07-21T22:39:03.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde1cff9640 1 -- 172.21.15.6:0/1770948845 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde100039b0 con 0x7fde20069430 2023-07-21T22:39:03.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.224+0000 7fde26396640 1 -- 172.21.15.6:0/1770948845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde200ad890 con 0x7fde20069430 2023-07-21T22:39:03.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.228+0000 7fde26396640 1 -- 172.21.15.6:0/1770948845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde200678d0 con 0x7fde20069430 2023-07-21T22:39:03.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.228+0000 7fde1cff9640 1 -- 172.21.15.6:0/1770948845 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fde10003b10 con 0x7fde20069430 2023-07-21T22:39:03.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.228+0000 7fde1cff9640 1 --2- 172.21.15.6:0/1770948845 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fde0c0663a0 0x7fde0c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:03.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.228+0000 7fde1cff9640 1 -- 172.21.15.6:0/1770948845 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6034+0+0 (secure 0 0 0) 0x7fde10083640 con 0x7fde20069430 2023-07-21T22:39:03.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.228+0000 7fde1f7fe640 1 --2- 172.21.15.6:0/1770948845 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fde0c0663a0 0x7fde0c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:03.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.232+0000 7fde1f7fe640 1 --2- 172.21.15.6:0/1770948845 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fde0c0663a0 0x7fde0c068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fde200c8540 tx=0x7fde14009060 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:03.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.232+0000 7fde1cff9640 1 -- 172.21.15.6:0/1770948845 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fde10050ae0 con 0x7fde20069430 2023-07-21T22:39:03.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:03.420+0000 7fde26396640 1 -- 172.21.15.6:0/1770948845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fde20159d70 con 0x7fde20069430 2023-07-21T22:39:04.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.028+0000 7fde1cff9640 1 -- 172.21.15.6:0/1770948845 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v66) v1 ==== 174+0+0 (secure 0 0 0) 0x7fde20159d70 con 0x7fde20069430 2023-07-21T22:39:04.072 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 19 and data pool 20 2023-07-21T22:39:04.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.044+0000 7fde26396640 1 -- 172.21.15.6:0/1770948845 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fde0c0663a0 msgr2=0x7fde0c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:04.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.044+0000 7fde26396640 1 --2- 172.21.15.6:0/1770948845 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fde0c0663a0 0x7fde0c068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fde200c8540 tx=0x7fde14009060 comp rx=0 tx=0).stop 2023-07-21T22:39:04.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.044+0000 7fde26396640 1 -- 172.21.15.6:0/1770948845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde20069430 msgr2=0x7fde200ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:04.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.044+0000 7fde26396640 1 --2- 172.21.15.6:0/1770948845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde20069430 0x7fde200ad350 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fde10001ec0 tx=0x7fde1000c8e0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.044+0000 7fde26396640 1 -- 172.21.15.6:0/1770948845 shutdown_connections 2023-07-21T22:39:04.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.044+0000 7fde26396640 1 --2- 172.21.15.6:0/1770948845 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde200af2b0 0x7fde200c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.044+0000 7fde26396640 1 --2- 172.21.15.6:0/1770948845 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fde0c0663a0 0x7fde0c068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.044+0000 7fde26396640 1 --2- 172.21.15.6:0/1770948845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde20070f30 0x7fde200c4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.044+0000 7fde26396640 1 --2- 172.21.15.6:0/1770948845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde20069430 0x7fde200ad350 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.044+0000 7fde26396640 1 -- 172.21.15.6:0/1770948845 >> 172.21.15.6:0/1770948845 conn(0x7fde200cde90 msgr2=0x7fde2006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:04.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.048+0000 7fde26396640 1 -- 172.21.15.6:0/1770948845 shutdown_connections 2023-07-21T22:39:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.048+0000 7fde26396640 1 -- 172.21.15.6:0/1770948845 wait complete. 2023-07-21T22:39:04.124 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:39:04.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.224+0000 7f17bc9f6640 1 Processor -- start 2023-07-21T22:39:04.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.224+0000 7f17bc9f6640 1 -- start start 2023-07-21T22:39:04.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.228+0000 7f17bc9f6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f17b8160330 0x7f17b80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:04.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.228+0000 7f17bc9f6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17b80c0f80 0x7f17b80cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:04.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.228+0000 7f17bc9f6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b80c17d0 con 0x7f17b80c8940 2023-07-21T22:39:04.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.228+0000 7f17bc9f6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b80c14f0 con 0x7f17b8160330 2023-07-21T22:39:04.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.228+0000 7f17bc9f6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80cac10 con 0x7f17b80c0f80 2023-07-21T22:39:04.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.228+0000 7f17b659c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f17b8160330 0x7f17b80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:04.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.228+0000 7f17affff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f17b80c8940 0x7f17b80ccf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33178/0 (socket says 172.21.15.6:33178) 2023-07-21T22:39:04.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.228+0000 7f17b659c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f17b8160330 0x7f17b80cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37042/0 (socket says 172.21.15.6:37042) 2023-07-21T22:39:04.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.228+0000 7f17affff640 1 -- 172.21.15.6:0/4063575410 learned_addr learned my addr 172.21.15.6:0/4063575410 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:39:04.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.228+0000 7f17b6d9d640 1 --2- 172.21.15.6:0/4063575410 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17b80c0f80 0x7f17b80cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:04.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.228+0000 7f17b659c640 1 -- 172.21.15.6:0/4063575410 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17b80c0f80 msgr2=0x7f17b80cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:04.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.228+0000 7f17b659c640 1 --2- 172.21.15.6:0/4063575410 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17b80c0f80 0x7f17b80cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.228+0000 7f17b659c640 1 -- 172.21.15.6:0/4063575410 >> v1:172.21.15.6:6789/0 conn(0x7f17b80c8940 legacy=0x7f17b80ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:04.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.228+0000 7f17b659c640 1 -- 172.21.15.6:0/4063575410 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b80caef0 con 0x7f17b8160330 2023-07-21T22:39:04.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.232+0000 7f17b659c640 1 --2- 172.21.15.6:0/4063575410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17b8160330 0x7f17b80cb6f0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f17a80097c0 tx=0x7f17a801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d322ae4bc740535 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:04.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.232+0000 7f17b5d9b640 1 -- 172.21.15.6:0/4063575410 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a80a8970 con 0x7f17b8160330 2023-07-21T22:39:04.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.232+0000 7f17b5d9b640 1 -- 172.21.15.6:0/4063575410 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a80a8ad0 con 0x7f17b8160330 2023-07-21T22:39:04.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.232+0000 7f17b5d9b640 1 -- 172.21.15.6:0/4063575410 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a80a8e60 con 0x7f17b8160330 2023-07-21T22:39:04.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.232+0000 7f17bc9f6640 1 -- 172.21.15.6:0/4063575410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17b8160330 msgr2=0x7f17b80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:04.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.232+0000 7f17bc9f6640 1 --2- 172.21.15.6:0/4063575410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17b8160330 0x7f17b80cb6f0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f17a80097c0 tx=0x7f17a801ec70 comp rx=0 tx=0).stop 2023-07-21T22:39:04.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.232+0000 7f17bc9f6640 1 -- 172.21.15.6:0/4063575410 shutdown_connections 2023-07-21T22:39:04.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.232+0000 7f17bc9f6640 1 --2- 172.21.15.6:0/4063575410 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17b80c0f80 0x7f17b80cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.232+0000 7f17bc9f6640 1 --2- 172.21.15.6:0/4063575410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17b8160330 0x7f17b80cb6f0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.232+0000 7f17bc9f6640 1 -- 172.21.15.6:0/4063575410 >> 172.21.15.6:0/4063575410 conn(0x7f17b80afcf0 msgr2=0x7f17b80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:04.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.232+0000 7f17bc9f6640 1 -- 172.21.15.6:0/4063575410 shutdown_connections 2023-07-21T22:39:04.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.232+0000 7f17bc9f6640 1 -- 172.21.15.6:0/4063575410 wait complete. 2023-07-21T22:39:04.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.232+0000 7f17bc9f6640 1 Processor -- start 2023-07-21T22:39:04.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.232+0000 7f17bc9f6640 1 -- start start 2023-07-21T22:39:04.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17bc9f6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17b80c0f80 0x7f17b80c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:04.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17bc9f6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b80c8940 0x7f17b80c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:04.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17bc9f6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17b8160330 0x7f17b81f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:04.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17bc9f6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b81f64a0 con 0x7f17b8160330 2023-07-21T22:39:04.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17bc9f6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80c30f0 con 0x7f17b80c8940 2023-07-21T22:39:04.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17bc9f6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80c3390 con 0x7f17b80c0f80 2023-07-21T22:39:04.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17b6d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17b8160330 0x7f17b81f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:04.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17b6d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17b8160330 0x7f17b81f5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37052/0 (socket says 172.21.15.6:37052) 2023-07-21T22:39:04.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17affff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b80c8940 0x7f17b80c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:04.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17b6d9d640 1 -- 172.21.15.6:0/4014936257 learned_addr learned my addr 172.21.15.6:0/4014936257 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:04.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17b659c640 1 --2- 172.21.15.6:0/4014936257 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17b80c0f80 0x7f17b80c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:04.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17b6d9d640 1 -- 172.21.15.6:0/4014936257 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17b80c0f80 msgr2=0x7f17b80c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:04.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17b6d9d640 1 --2- 172.21.15.6:0/4014936257 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17b80c0f80 0x7f17b80c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17b6d9d640 1 -- 172.21.15.6:0/4014936257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b80c8940 msgr2=0x7f17b80c6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:04.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17b6d9d640 1 --2- 172.21.15.6:0/4014936257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b80c8940 0x7f17b80c6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17b6d9d640 1 -- 172.21.15.6:0/4014936257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a8009420 con 0x7f17b8160330 2023-07-21T22:39:04.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17b6d9d640 1 --2- 172.21.15.6:0/4014936257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17b8160330 0x7f17b81f5f60 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f17b0007e40 tx=0x7f17b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:04.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17aeffd640 1 -- 172.21.15.6:0/4014936257 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b0014620 con 0x7f17b8160330 2023-07-21T22:39:04.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17aeffd640 1 -- 172.21.15.6:0/4014936257 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b000ee90 con 0x7f17b8160330 2023-07-21T22:39:04.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17bc9f6640 1 -- 172.21.15.6:0/4014936257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b80c3670 con 0x7f17b8160330 2023-07-21T22:39:04.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17aeffd640 1 -- 172.21.15.6:0/4014936257 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b00149e0 con 0x7f17b8160330 2023-07-21T22:39:04.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17bc9f6640 1 -- 172.21.15.6:0/4014936257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b815cf90 con 0x7f17b8160330 2023-07-21T22:39:04.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.236+0000 7f17bc9f6640 1 -- 172.21.15.6:0/4014936257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b80678d0 con 0x7f17b8160330 2023-07-21T22:39:04.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.240+0000 7f17aeffd640 1 -- 172.21.15.6:0/4014936257 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f17b0014b40 con 0x7f17b8160330 2023-07-21T22:39:04.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.240+0000 7f17aeffd640 1 --2- 172.21.15.6:0/4014936257 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f17980663a0 0x7f1798068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:04.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.240+0000 7f17aeffd640 1 -- 172.21.15.6:0/4014936257 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f17b0084860 con 0x7f17b8160330 2023-07-21T22:39:04.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.240+0000 7f17b659c640 1 --2- 172.21.15.6:0/4014936257 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f17980663a0 0x7f1798068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:04.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.240+0000 7f17b659c640 1 --2- 172.21.15.6:0/4014936257 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f17980663a0 0x7f1798068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f17a80b2000 tx=0x7f17a8008040 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:04.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.244+0000 7f17aeffd640 1 -- 172.21.15.6:0/4014936257 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f17b0051b00 con 0x7f17b8160330 2023-07-21T22:39:04.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.400+0000 7f17bc9f6640 1 -- 172.21.15.6:0/4014936257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17b80c3b20 con 0x7f17b8160330 2023-07-21T22:39:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.400+0000 7f17aeffd640 1 -- 172.21.15.6:0/4014936257 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+18365 (secure 0 0 0) 0x7f17b0055120 con 0x7f17b8160330 2023-07-21T22:39:04.445 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:39:04.445 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":156,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:39:03.423960+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:39:01.548583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-21T22:39:02.416927+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:39:04.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.400+0000 7f17bc9f6640 1 -- 172.21.15.6:0/4014936257 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f17980663a0 msgr2=0x7f1798068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:04.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.400+0000 7f17bc9f6640 1 --2- 172.21.15.6:0/4014936257 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f17980663a0 0x7f1798068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f17a80b2000 tx=0x7f17a8008040 comp rx=0 tx=0).stop 2023-07-21T22:39:04.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.400+0000 7f17bc9f6640 1 -- 172.21.15.6:0/4014936257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17b8160330 msgr2=0x7f17b81f5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:04.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.400+0000 7f17bc9f6640 1 --2- 172.21.15.6:0/4014936257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17b8160330 0x7f17b81f5f60 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f17b0007e40 tx=0x7f17b000e4b0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.400+0000 7f17bc9f6640 1 -- 172.21.15.6:0/4014936257 shutdown_connections 2023-07-21T22:39:04.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.400+0000 7f17bc9f6640 1 --2- 172.21.15.6:0/4014936257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17b8160330 0x7f17b81f5f60 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.400+0000 7f17bc9f6640 1 --2- 172.21.15.6:0/4014936257 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f17980663a0 0x7f1798068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.400+0000 7f17bc9f6640 1 --2- 172.21.15.6:0/4014936257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b80c8940 0x7f17b80c6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.400+0000 7f17bc9f6640 1 --2- 172.21.15.6:0/4014936257 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17b80c0f80 0x7f17b80c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.400+0000 7f17bc9f6640 1 -- 172.21.15.6:0/4014936257 >> 172.21.15.6:0/4014936257 conn(0x7f17b80afcf0 msgr2=0x7f17b80ade50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:04.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.404+0000 7f17bc9f6640 1 -- 172.21.15.6:0/4014936257 shutdown_connections 2023-07-21T22:39:04.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.404+0000 7f17bc9f6640 1 -- 172.21.15.6:0/4014936257 wait complete. 2023-07-21T22:39:04.466 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:39:04.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.564+0000 7fe67f634640 1 Processor -- start 2023-07-21T22:39:04.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.568+0000 7fe67f634640 1 -- start start 2023-07-21T22:39:04.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.568+0000 7fe67f634640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe678158ce0 0x7fe678070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:04.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.568+0000 7fe67f634640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6780cc700 con 0x7fe6780c9730 2023-07-21T22:39:04.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.568+0000 7fe67f634640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6780b0ff0 con 0x7fe6780c8ad0 2023-07-21T22:39:04.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.568+0000 7fe67f634640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe678070c80 con 0x7fe678158ce0 2023-07-21T22:39:04.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.568+0000 7fe67d3d0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe678158ce0 0x7fe678070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:04.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.568+0000 7fe67dbd1640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe6780c9730 0x7fe6780ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33194/0 (socket says 172.21.15.6:33194) 2023-07-21T22:39:04.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.568+0000 7fe67dbd1640 1 -- 172.21.15.6:0/2583072900 learned_addr learned my addr 172.21.15.6:0/2583072900 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:39:04.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.568+0000 7fe67d3d0640 1 -- 172.21.15.6:0/2583072900 >> v1:172.21.15.161:6789/0 conn(0x7fe6780c8ad0 legacy=0x7fe6780c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:04.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.568+0000 7fe67d3d0640 1 -- 172.21.15.6:0/2583072900 >> v1:172.21.15.6:6789/0 conn(0x7fe6780c9730 legacy=0x7fe6780ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:04.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.568+0000 7fe66ffff640 1 -- 172.21.15.6:0/2583072900 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506881135 0 0) 0x7fe6780cc700 con 0x7fe6780c9730 2023-07-21T22:39:04.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.568+0000 7fe67d3d0640 1 -- 172.21.15.6:0/2583072900 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6780cbdd0 con 0x7fe678158ce0 2023-07-21T22:39:04.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.572+0000 7fe67d3d0640 1 --2- 172.21.15.6:0/2583072900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe678158ce0 0x7fe678070450 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fe6740097c0 tx=0x7fe67401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0f34a04456780d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.572+0000 7fe66ffff640 1 -- 172.21.15.6:0/2583072900 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6740ab600 con 0x7fe678158ce0 2023-07-21T22:39:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.572+0000 7fe66ffff640 1 -- 172.21.15.6:0/2583072900 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6740a7050 con 0x7fe678158ce0 2023-07-21T22:39:04.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.572+0000 7fe66ffff640 1 -- 172.21.15.6:0/2583072900 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6740ab980 con 0x7fe678158ce0 2023-07-21T22:39:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.572+0000 7fe67f634640 1 -- 172.21.15.6:0/2583072900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe678158ce0 msgr2=0x7fe678070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.572+0000 7fe67f634640 1 --2- 172.21.15.6:0/2583072900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe678158ce0 0x7fe678070450 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fe6740097c0 tx=0x7fe67401c330 comp rx=0 tx=0).stop 2023-07-21T22:39:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.572+0000 7fe67f634640 1 -- 172.21.15.6:0/2583072900 shutdown_connections 2023-07-21T22:39:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.572+0000 7fe67f634640 1 --2- 172.21.15.6:0/2583072900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe678158ce0 0x7fe678070450 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.572+0000 7fe67f634640 1 -- 172.21.15.6:0/2583072900 >> 172.21.15.6:0/2583072900 conn(0x7fe6780afcf0 msgr2=0x7fe6780b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:04.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.572+0000 7fe67f634640 1 -- 172.21.15.6:0/2583072900 shutdown_connections 2023-07-21T22:39:04.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.572+0000 7fe67f634640 1 -- 172.21.15.6:0/2583072900 wait complete. 2023-07-21T22:39:04.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.572+0000 7fe67f634640 1 Processor -- start 2023-07-21T22:39:04.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.572+0000 7fe67f634640 1 -- start start 2023-07-21T22:39:04.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67f634640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6780c8ad0 0x7fe6780c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:04.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67f634640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6780c9730 0x7fe678151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:04.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67f634640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe678158ce0 0x7fe67814f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:04.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67f634640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe678151fd0 con 0x7fe678158ce0 2023-07-21T22:39:04.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67f634640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6780c3eb0 con 0x7fe6780c8ad0 2023-07-21T22:39:04.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67f634640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6780c4190 con 0x7fe6780c9730 2023-07-21T22:39:04.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67dbd1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe678158ce0 0x7fe67814f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:04.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67dbd1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe678158ce0 0x7fe67814f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37068/0 (socket says 172.21.15.6:37068) 2023-07-21T22:39:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67dbd1640 1 -- 172.21.15.6:0/3490438159 learned_addr learned my addr 172.21.15.6:0/3490438159 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67d3d0640 1 --2- 172.21.15.6:0/3490438159 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6780c8ad0 0x7fe6780c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67cbcf640 1 --2- 172.21.15.6:0/3490438159 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6780c9730 0x7fe678151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67dbd1640 1 -- 172.21.15.6:0/3490438159 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6780c9730 msgr2=0x7fe678151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67dbd1640 1 --2- 172.21.15.6:0/3490438159 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6780c9730 0x7fe678151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67dbd1640 1 -- 172.21.15.6:0/3490438159 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6780c8ad0 msgr2=0x7fe6780c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:04.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67dbd1640 1 --2- 172.21.15.6:0/3490438159 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6780c8ad0 0x7fe6780c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67dbd1640 1 -- 172.21.15.6:0/3490438159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe674009420 con 0x7fe678158ce0 2023-07-21T22:39:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67cbcf640 1 --2- 172.21.15.6:0/3490438159 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6780c9730 0x7fe678151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67dbd1640 1 --2- 172.21.15.6:0/3490438159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe678158ce0 0x7fe67814f930 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fe67000c780 tx=0x7fe67000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:04.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe66dffb640 1 -- 172.21.15.6:0/3490438159 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67000ce90 con 0x7fe678158ce0 2023-07-21T22:39:04.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe66dffb640 1 -- 172.21.15.6:0/3490438159 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67000a640 con 0x7fe678158ce0 2023-07-21T22:39:04.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe66dffb640 1 -- 172.21.15.6:0/3490438159 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67000aa70 con 0x7fe678158ce0 2023-07-21T22:39:04.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67f634640 1 -- 172.21.15.6:0/3490438159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6780c6700 con 0x7fe678158ce0 2023-07-21T22:39:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67f634640 1 -- 172.21.15.6:0/3490438159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6781570d0 con 0x7fe678158ce0 2023-07-21T22:39:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe67f634640 1 -- 172.21.15.6:0/3490438159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6780678d0 con 0x7fe678158ce0 2023-07-21T22:39:04.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.576+0000 7fe66dffb640 1 -- 172.21.15.6:0/3490438159 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe67000abd0 con 0x7fe678158ce0 2023-07-21T22:39:04.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.580+0000 7fe66dffb640 1 --2- 172.21.15.6:0/3490438159 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe65c0663a0 0x7fe65c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:04.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.580+0000 7fe66dffb640 1 -- 172.21.15.6:0/3490438159 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fe670083330 con 0x7fe678158ce0 2023-07-21T22:39:04.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.580+0000 7fe67d3d0640 1 --2- 172.21.15.6:0/3490438159 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe65c0663a0 0x7fe65c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:04.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.580+0000 7fe67d3d0640 1 --2- 172.21.15.6:0/3490438159 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe65c0663a0 0x7fe65c068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe6740ad000 tx=0x7fe6740a6000 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:04.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.584+0000 7fe66dffb640 1 -- 172.21.15.6:0/3490438159 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe670050790 con 0x7fe678158ce0 2023-07-21T22:39:04.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.740+0000 7fe67f634640 1 -- 172.21.15.6:0/3490438159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6780ca120 con 0x7fe678158ce0 2023-07-21T22:39:04.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.740+0000 7fe66dffb640 1 -- 172.21.15.6:0/3490438159 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+18365 (secure 0 0 0) 0x7fe670053db0 con 0x7fe678158ce0 2023-07-21T22:39:04.786 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:39:04.787 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":156,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:39:03.423960+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:39:01.548583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-21T22:39:02.416927+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:39:04.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.744+0000 7fe67f634640 1 -- 172.21.15.6:0/3490438159 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe65c0663a0 msgr2=0x7fe65c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:04.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.744+0000 7fe67f634640 1 --2- 172.21.15.6:0/3490438159 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe65c0663a0 0x7fe65c068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe6740ad000 tx=0x7fe6740a6000 comp rx=0 tx=0).stop 2023-07-21T22:39:04.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.744+0000 7fe67f634640 1 -- 172.21.15.6:0/3490438159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe678158ce0 msgr2=0x7fe67814f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:04.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.744+0000 7fe67f634640 1 --2- 172.21.15.6:0/3490438159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe678158ce0 0x7fe67814f930 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fe67000c780 tx=0x7fe67000cc40 comp rx=0 tx=0).stop 2023-07-21T22:39:04.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.744+0000 7fe67f634640 1 -- 172.21.15.6:0/3490438159 shutdown_connections 2023-07-21T22:39:04.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.744+0000 7fe67f634640 1 --2- 172.21.15.6:0/3490438159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe678158ce0 0x7fe67814f930 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.744+0000 7fe67f634640 1 --2- 172.21.15.6:0/3490438159 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe6780c9730 0x7fe678151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.744+0000 7fe67f634640 1 --2- 172.21.15.6:0/3490438159 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe65c0663a0 0x7fe65c068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.744+0000 7fe67f634640 1 --2- 172.21.15.6:0/3490438159 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6780c8ad0 0x7fe6780c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.744+0000 7fe67f634640 1 -- 172.21.15.6:0/3490438159 >> 172.21.15.6:0/3490438159 conn(0x7fe6780afcf0 msgr2=0x7fe67806f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:04.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.744+0000 7fe67f634640 1 -- 172.21.15.6:0/3490438159 shutdown_connections 2023-07-21T22:39:04.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.744+0000 7fe67f634640 1 -- 172.21.15.6:0/3490438159 wait complete. 2023-07-21T22:39:04.808 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-21T22:39:04.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.912+0000 7f78c2a34640 1 Processor -- start 2023-07-21T22:39:04.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.912+0000 7f78c2a34640 1 -- start start 2023-07-21T22:39:04.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.912+0000 7f78c2a34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78bc0aeb40 0x7f78bc15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:04.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.912+0000 7f78c2a34640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f78bc159440 0x7f78bc0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:04.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.912+0000 7f78c2a34640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc1532b0 con 0x7f78bc0aef10 2023-07-21T22:39:04.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.912+0000 7f78c2a34640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78bc0ca6f0 con 0x7f78bc159440 2023-07-21T22:39:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.912+0000 7f78c2a34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc1599d0 con 0x7f78bc0aeb40 2023-07-21T22:39:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.912+0000 7f78bb7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f78bc0aef10 0x7f78bc158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33204/0 (socket says 172.21.15.6:33204) 2023-07-21T22:39:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.912+0000 7f78bb7fe640 1 -- 172.21.15.6:0/1689467798 learned_addr learned my addr 172.21.15.6:0/1689467798 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:39:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.912+0000 7f78c0fd1640 1 --2- 172.21.15.6:0/1689467798 >> v2:172.21.15.6:3300/0 conn(0x7f78bc159440 0x7f78bc0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.912+0000 7f78bbfff640 1 --2- 172.21.15.6:0/1689467798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78bc0aeb40 0x7f78bc15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.912+0000 7f78baffd640 1 -- 172.21.15.6:0/1689467798 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2175471905 0 0) 0x7f78bc1532b0 con 0x7f78bc0aef10 2023-07-21T22:39:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.912+0000 7f78baffd640 1 -- 172.21.15.6:0/1689467798 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78a4003530 con 0x7f78bc0aef10 2023-07-21T22:39:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.912+0000 7f78c0fd1640 1 -- 172.21.15.6:0/1689467798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78bc0aeb40 msgr2=0x7f78bc15cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.912+0000 7f78c0fd1640 1 --2- 172.21.15.6:0/1689467798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78bc0aeb40 0x7f78bc15cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.912+0000 7f78c0fd1640 1 -- 172.21.15.6:0/1689467798 >> v1:172.21.15.6:6789/0 conn(0x7f78bc0aef10 legacy=0x7f78bc158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.912+0000 7f78c0fd1640 1 -- 172.21.15.6:0/1689467798 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc159cb0 con 0x7f78bc159440 2023-07-21T22:39:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.916+0000 7f78c0fd1640 1 --2- 172.21.15.6:0/1689467798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc159440 0x7f78bc0c88c0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009d90 tx=0x7f78b401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dabb81f32dd20c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.916+0000 7f78baffd640 1 -- 172.21.15.6:0/1689467798 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b40a5950 con 0x7f78bc159440 2023-07-21T22:39:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.916+0000 7f78baffd640 1 -- 172.21.15.6:0/1689467798 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b40a5ab0 con 0x7f78bc159440 2023-07-21T22:39:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.916+0000 7f78baffd640 1 -- 172.21.15.6:0/1689467798 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b40a5e40 con 0x7f78bc159440 2023-07-21T22:39:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.916+0000 7f78c2a34640 1 -- 172.21.15.6:0/1689467798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc159440 msgr2=0x7f78bc0c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.916+0000 7f78c2a34640 1 --2- 172.21.15.6:0/1689467798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc159440 0x7f78bc0c88c0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f78b4009d90 tx=0x7f78b401c890 comp rx=0 tx=0).stop 2023-07-21T22:39:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.916+0000 7f78c2a34640 1 -- 172.21.15.6:0/1689467798 shutdown_connections 2023-07-21T22:39:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.916+0000 7f78c2a34640 1 --2- 172.21.15.6:0/1689467798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc159440 0x7f78bc0c88c0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.916+0000 7f78c2a34640 1 --2- 172.21.15.6:0/1689467798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78bc0aeb40 0x7f78bc15cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.916+0000 7f78c2a34640 1 -- 172.21.15.6:0/1689467798 >> 172.21.15.6:0/1689467798 conn(0x7f78bc0cde90 msgr2=0x7f78bc0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.916+0000 7f78c2a34640 1 -- 172.21.15.6:0/1689467798 shutdown_connections 2023-07-21T22:39:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.916+0000 7f78c2a34640 1 -- 172.21.15.6:0/1689467798 wait complete. 2023-07-21T22:39:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78c2a34640 1 Processor -- start 2023-07-21T22:39:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78c2a34640 1 -- start start 2023-07-21T22:39:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78c2a34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78bc0aeb40 0x7f78bc0acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78c2a34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc0aef10 0x7f78bc14e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78c2a34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78bc159440 0x7f78bc15b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78c2a34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc14edc0 con 0x7f78bc0aef10 2023-07-21T22:39:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78c2a34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc0c39a0 con 0x7f78bc159440 2023-07-21T22:39:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78c2a34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc0ad4d0 con 0x7f78bc0aeb40 2023-07-21T22:39:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78bb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc0aef10 0x7f78bc14e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78bb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc0aef10 0x7f78bc14e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37090/0 (socket says 172.21.15.6:37090) 2023-07-21T22:39:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78bb7fe640 1 -- 172.21.15.6:0/2293290707 learned_addr learned my addr 172.21.15.6:0/2293290707 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78c0fd1640 1 --2- 172.21.15.6:0/2293290707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78bc159440 0x7f78bc15b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78bbfff640 1 --2- 172.21.15.6:0/2293290707 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78bc0aeb40 0x7f78bc0acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:04.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78bb7fe640 1 -- 172.21.15.6:0/2293290707 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78bc0aeb40 msgr2=0x7f78bc0acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78bb7fe640 1 --2- 172.21.15.6:0/2293290707 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78bc0aeb40 0x7f78bc0acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78bb7fe640 1 -- 172.21.15.6:0/2293290707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78bc159440 msgr2=0x7f78bc15b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78bb7fe640 1 --2- 172.21.15.6:0/2293290707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78bc159440 0x7f78bc15b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78bb7fe640 1 -- 172.21.15.6:0/2293290707 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b4009a70 con 0x7f78bc0aef10 2023-07-21T22:39:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78bb7fe640 1 --2- 172.21.15.6:0/2293290707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc0aef10 0x7f78bc14e880 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f78b000c4d0 tx=0x7f78b000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78b8ff9640 1 -- 172.21.15.6:0/2293290707 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0005cf0 con 0x7f78bc0aef10 2023-07-21T22:39:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78b8ff9640 1 -- 172.21.15.6:0/2293290707 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b0005e50 con 0x7f78bc0aef10 2023-07-21T22:39:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78b8ff9640 1 -- 172.21.15.6:0/2293290707 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0007270 con 0x7f78bc0aef10 2023-07-21T22:39:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78c2a34640 1 -- 172.21.15.6:0/2293290707 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc0aba30 con 0x7f78bc0aef10 2023-07-21T22:39:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.920+0000 7f78c2a34640 1 -- 172.21.15.6:0/2293290707 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc0abff0 con 0x7f78bc0aef10 2023-07-21T22:39:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.924+0000 7f78c2a34640 1 -- 172.21.15.6:0/2293290707 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc0678d0 con 0x7f78bc0aef10 2023-07-21T22:39:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.924+0000 7f78b8ff9640 1 -- 172.21.15.6:0/2293290707 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f78b00073d0 con 0x7f78bc0aef10 2023-07-21T22:39:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.924+0000 7f78b8ff9640 1 --2- 172.21.15.6:0/2293290707 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f78a80663a0 0x7f78a8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.924+0000 7f78b8ff9640 1 -- 172.21.15.6:0/2293290707 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f78b0083310 con 0x7f78bc0aef10 2023-07-21T22:39:04.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.924+0000 7f78bbfff640 1 --2- 172.21.15.6:0/2293290707 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f78a80663a0 0x7f78a8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:04.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.924+0000 7f78bbfff640 1 --2- 172.21.15.6:0/2293290707 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f78a80663a0 0x7f78a8068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0b3bf0 tx=0x7f78ac009190 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:04.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:04.928+0000 7f78b8ff9640 1 -- 172.21.15.6:0/2293290707 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f78b00506e0 con 0x7f78bc0aef10 2023-07-21T22:39:05.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:05.120+0000 7f78c2a34640 1 -- 172.21.15.6:0/2293290707 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f78bc0c2ee0 con 0x7f78bc0aef10 2023-07-21T22:39:06.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.056+0000 7f78b8ff9640 1 -- 172.21.15.6:0/2293290707 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v69) v1 ==== 118+0+0 (secure 0 0 0) 0x7f78b0053d00 con 0x7f78bc0aef10 2023-07-21T22:39:06.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.060+0000 7f78c2a34640 1 -- 172.21.15.6:0/2293290707 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f78a80663a0 msgr2=0x7f78a8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:06.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.060+0000 7f78c2a34640 1 --2- 172.21.15.6:0/2293290707 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f78a80663a0 0x7f78a8068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0b3bf0 tx=0x7f78ac009190 comp rx=0 tx=0).stop 2023-07-21T22:39:06.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.060+0000 7f78c2a34640 1 -- 172.21.15.6:0/2293290707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc0aef10 msgr2=0x7f78bc14e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:06.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.060+0000 7f78c2a34640 1 --2- 172.21.15.6:0/2293290707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc0aef10 0x7f78bc14e880 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f78b000c4d0 tx=0x7f78b000c990 comp rx=0 tx=0).stop 2023-07-21T22:39:06.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.060+0000 7f78c2a34640 1 -- 172.21.15.6:0/2293290707 shutdown_connections 2023-07-21T22:39:06.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.060+0000 7f78c2a34640 1 --2- 172.21.15.6:0/2293290707 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f78a80663a0 0x7f78a8068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.060+0000 7f78c2a34640 1 --2- 172.21.15.6:0/2293290707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78bc159440 0x7f78bc15b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.060+0000 7f78c2a34640 1 --2- 172.21.15.6:0/2293290707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f78bc0aef10 0x7f78bc14e880 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.060+0000 7f78c2a34640 1 --2- 172.21.15.6:0/2293290707 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78bc0aeb40 0x7f78bc0acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.060+0000 7f78c2a34640 1 -- 172.21.15.6:0/2293290707 >> 172.21.15.6:0/2293290707 conn(0x7f78bc0cde90 msgr2=0x7f78bc0ae150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:06.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.060+0000 7f78c2a34640 1 -- 172.21.15.6:0/2293290707 shutdown_connections 2023-07-21T22:39:06.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.060+0000 7f78c2a34640 1 -- 172.21.15.6:0/2293290707 wait complete. 2023-07-21T22:39:06.126 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-21T22:39:06.127 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-21T22:39:06.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.232+0000 7f3f74f82640 1 Processor -- start 2023-07-21T22:39:06.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.232+0000 7f3f74f82640 1 -- start start 2023-07-21T22:39:06.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.236+0000 7f3f74f82640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3f700aeb40 0x7f3f7015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.236+0000 7f3f74f82640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f701532b0 con 0x7f3f70159440 2023-07-21T22:39:06.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.236+0000 7f3f74f82640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f700ca6f0 con 0x7f3f700aef10 2023-07-21T22:39:06.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.236+0000 7f3f74f82640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f701599d0 con 0x7f3f700aeb40 2023-07-21T22:39:06.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.236+0000 7f3f6e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3f700aeb40 0x7f3f7015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.236+0000 7f3f6e59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3f700aeb40 0x7f3f7015cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37104/0 (socket says 172.21.15.6:37104) 2023-07-21T22:39:06.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.236+0000 7f3f6e59c640 1 -- 172.21.15.6:0/614647062 learned_addr learned my addr 172.21.15.6:0/614647062 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:06.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.236+0000 7f3f6e59c640 1 -- 172.21.15.6:0/614647062 >> v1:172.21.15.161:6789/0 conn(0x7f3f700aef10 legacy=0x7f3f70158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:06.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.236+0000 7f3f6e59c640 1 -- 172.21.15.6:0/614647062 >> v1:172.21.15.6:6789/0 conn(0x7f3f70159440 legacy=0x7f3f700c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:06.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.236+0000 7f3f6e59c640 1 -- 172.21.15.6:0/614647062 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f70159cb0 con 0x7f3f700aeb40 2023-07-21T22:39:06.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.236+0000 7f3f6e59c640 1 --2- 172.21.15.6:0/614647062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f700aeb40 0x7f3f7015cef0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f3f6000bb10 tx=0x7f3f6001eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e79aa4c118f52c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:06.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.236+0000 7f3f6dd9b640 1 -- 172.21.15.6:0/614647062 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f600a7c20 con 0x7f3f700aeb40 2023-07-21T22:39:06.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f6dd9b640 1 -- 172.21.15.6:0/614647062 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f600a7d80 con 0x7f3f700aeb40 2023-07-21T22:39:06.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f6dd9b640 1 -- 172.21.15.6:0/614647062 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f600af660 con 0x7f3f700aeb40 2023-07-21T22:39:06.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f74f82640 1 -- 172.21.15.6:0/614647062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f700aeb40 msgr2=0x7f3f7015cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:06.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f74f82640 1 --2- 172.21.15.6:0/614647062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f700aeb40 0x7f3f7015cef0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f3f6000bb10 tx=0x7f3f6001eb50 comp rx=0 tx=0).stop 2023-07-21T22:39:06.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f74f82640 1 -- 172.21.15.6:0/614647062 shutdown_connections 2023-07-21T22:39:06.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f74f82640 1 --2- 172.21.15.6:0/614647062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f700aeb40 0x7f3f7015cef0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f74f82640 1 -- 172.21.15.6:0/614647062 >> 172.21.15.6:0/614647062 conn(0x7f3f700cde90 msgr2=0x7f3f700ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:06.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f74f82640 1 -- 172.21.15.6:0/614647062 shutdown_connections 2023-07-21T22:39:06.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f74f82640 1 -- 172.21.15.6:0/614647062 wait complete. 2023-07-21T22:39:06.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f74f82640 1 Processor -- start 2023-07-21T22:39:06.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f74f82640 1 -- start start 2023-07-21T22:39:06.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f74f82640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f700aeb40 0x7f3f70153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f74f82640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f700aef10 0x7f3f70137440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f74f82640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f70159440 0x7f3f70137980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f74f82640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f700b1a70 con 0x7f3f70159440 2023-07-21T22:39:06.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f74f82640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f700b0e60 con 0x7f3f700aeb40 2023-07-21T22:39:06.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f74f82640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f700b1140 con 0x7f3f700aef10 2023-07-21T22:39:06.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f6ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f70159440 0x7f3f70137980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f6ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f70159440 0x7f3f70137980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37114/0 (socket says 172.21.15.6:37114) 2023-07-21T22:39:06.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f6ed9d640 1 -- 172.21.15.6:0/1734157308 learned_addr learned my addr 172.21.15.6:0/1734157308 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:06.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f6e59c640 1 --2- 172.21.15.6:0/1734157308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f700aeb40 0x7f3f70153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.240+0000 7f3f67fff640 1 --2- 172.21.15.6:0/1734157308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f700aef10 0x7f3f70137440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.244+0000 7f3f6ed9d640 1 -- 172.21.15.6:0/1734157308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f700aef10 msgr2=0x7f3f70137440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:06.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.244+0000 7f3f6ed9d640 1 --2- 172.21.15.6:0/1734157308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f700aef10 0x7f3f70137440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.244+0000 7f3f6ed9d640 1 -- 172.21.15.6:0/1734157308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f700aeb40 msgr2=0x7f3f70153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:06.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.244+0000 7f3f6ed9d640 1 --2- 172.21.15.6:0/1734157308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f700aeb40 0x7f3f70153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.244+0000 7f3f6ed9d640 1 -- 172.21.15.6:0/1734157308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6000b770 con 0x7f3f70159440 2023-07-21T22:39:06.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.244+0000 7f3f6ed9d640 1 --2- 172.21.15.6:0/1734157308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f70159440 0x7f3f70137980 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800c730 tx=0x7f3f6800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:06.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.244+0000 7f3f66ffd640 1 -- 172.21.15.6:0/1734157308 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68003b80 con 0x7f3f70159440 2023-07-21T22:39:06.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.244+0000 7f3f66ffd640 1 -- 172.21.15.6:0/1734157308 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f68003ce0 con 0x7f3f70159440 2023-07-21T22:39:06.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.244+0000 7f3f74f82640 1 -- 172.21.15.6:0/1734157308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f700b1420 con 0x7f3f70159440 2023-07-21T22:39:06.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.244+0000 7f3f66ffd640 1 -- 172.21.15.6:0/1734157308 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6800aa30 con 0x7f3f70159440 2023-07-21T22:39:06.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.244+0000 7f3f74f82640 1 -- 172.21.15.6:0/1734157308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7014c420 con 0x7f3f70159440 2023-07-21T22:39:06.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.244+0000 7f3f74f82640 1 -- 172.21.15.6:0/1734157308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f700b1c20 con 0x7f3f70159440 2023-07-21T22:39:06.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.244+0000 7f3f66ffd640 1 -- 172.21.15.6:0/1734157308 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3f6800ab90 con 0x7f3f70159440 2023-07-21T22:39:06.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.248+0000 7f3f66ffd640 1 --2- 172.21.15.6:0/1734157308 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f3f500663a0 0x7f3f50068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.248+0000 7f3f66ffd640 1 -- 172.21.15.6:0/1734157308 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f3f68083b20 con 0x7f3f70159440 2023-07-21T22:39:06.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.248+0000 7f3f6e59c640 1 --2- 172.21.15.6:0/1734157308 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f3f500663a0 0x7f3f50068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.248+0000 7f3f6e59c640 1 --2- 172.21.15.6:0/1734157308 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f3f500663a0 0x7f3f50068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3f600b1000 tx=0x7f3f600a9070 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:06.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.252+0000 7f3f66ffd640 1 -- 172.21.15.6:0/1734157308 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3f700b1c20 con 0x7f3f70159440 2023-07-21T22:39:06.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:06.440+0000 7f3f74f82640 1 -- 172.21.15.6:0/1734157308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3f700678d0 con 0x7f3f70159440 2023-07-21T22:39:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.060+0000 7f3f66ffd640 1 -- 172.21.15.6:0/1734157308 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v70) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3f68050ef0 con 0x7f3f70159440 2023-07-21T22:39:07.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.060+0000 7f3f74f82640 1 -- 172.21.15.6:0/1734157308 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f3f500663a0 msgr2=0x7f3f50068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:07.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.060+0000 7f3f74f82640 1 --2- 172.21.15.6:0/1734157308 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f3f500663a0 0x7f3f50068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3f600b1000 tx=0x7f3f600a9070 comp rx=0 tx=0).stop 2023-07-21T22:39:07.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.060+0000 7f3f74f82640 1 -- 172.21.15.6:0/1734157308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f70159440 msgr2=0x7f3f70137980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:07.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.060+0000 7f3f74f82640 1 --2- 172.21.15.6:0/1734157308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f70159440 0x7f3f70137980 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800c730 tx=0x7f3f6800cbf0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.060+0000 7f3f74f82640 1 -- 172.21.15.6:0/1734157308 shutdown_connections 2023-07-21T22:39:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.060+0000 7f3f74f82640 1 --2- 172.21.15.6:0/1734157308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f70159440 0x7f3f70137980 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.060+0000 7f3f74f82640 1 --2- 172.21.15.6:0/1734157308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f700aef10 0x7f3f70137440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.060+0000 7f3f74f82640 1 --2- 172.21.15.6:0/1734157308 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f3f500663a0 0x7f3f50068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.060+0000 7f3f74f82640 1 --2- 172.21.15.6:0/1734157308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f700aeb40 0x7f3f70153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.060+0000 7f3f74f82640 1 -- 172.21.15.6:0/1734157308 >> 172.21.15.6:0/1734157308 conn(0x7f3f700cde90 msgr2=0x7f3f700cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.060+0000 7f3f74f82640 1 -- 172.21.15.6:0/1734157308 shutdown_connections 2023-07-21T22:39:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.060+0000 7f3f74f82640 1 -- 172.21.15.6:0/1734157308 wait complete. 2023-07-21T22:39:07.129 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-21T22:39:07.130 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:39:07.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.232+0000 7f137e367640 1 Processor -- start 2023-07-21T22:39:07.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.232+0000 7f137e367640 1 -- start start 2023-07-21T22:39:07.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.236+0000 7f137e367640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f13780c8ad0 0x7f13780c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:07.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.236+0000 7f137e367640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13780c99c0 con 0x7f13780c9560 2023-07-21T22:39:07.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.236+0000 7f137e367640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13780cc700 con 0x7f1378158ce0 2023-07-21T22:39:07.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.236+0000 7f137e367640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13780b0ff0 con 0x7f13780c8ad0 2023-07-21T22:39:07.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.236+0000 7f13777fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f13780c8ad0 0x7f13780c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:07.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.236+0000 7f13777fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f13780c8ad0 0x7f13780c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37122/0 (socket says 172.21.15.6:37122) 2023-07-21T22:39:07.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.236+0000 7f137c904640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f13780c9560 0x7f13780ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33218/0 (socket says 172.21.15.6:33218) 2023-07-21T22:39:07.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.236+0000 7f13777fe640 1 -- 172.21.15.6:0/4141540845 learned_addr learned my addr 172.21.15.6:0/4141540845 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:07.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.236+0000 7f13777fe640 1 -- 172.21.15.6:0/4141540845 >> v1:172.21.15.161:6789/0 conn(0x7f1378158ce0 legacy=0x7f1378070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:07.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.236+0000 7f13777fe640 1 -- 172.21.15.6:0/4141540845 >> v1:172.21.15.6:6789/0 conn(0x7f13780c9560 legacy=0x7f13780ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:07.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.236+0000 7f13777fe640 1 -- 172.21.15.6:0/4141540845 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1378070c80 con 0x7f13780c8ad0 2023-07-21T22:39:07.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.236+0000 7f1376ffd640 1 -- 172.21.15.6:0/4141540845 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757696922 0 0) 0x7f13780c99c0 con 0x7f13780c9560 2023-07-21T22:39:07.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.240+0000 7f13777fe640 1 --2- 172.21.15.6:0/4141540845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13780c8ad0 0x7f13780c9020 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f136c009870 tx=0x7f136c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8c970831ee677d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:07.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.240+0000 7f1376ffd640 1 -- 172.21.15.6:0/4141540845 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c0ab5f0 con 0x7f13780c8ad0 2023-07-21T22:39:07.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.240+0000 7f1376ffd640 1 -- 172.21.15.6:0/4141540845 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136c0ab750 con 0x7f13780c8ad0 2023-07-21T22:39:07.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.240+0000 7f1376ffd640 1 -- 172.21.15.6:0/4141540845 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c0abae0 con 0x7f13780c8ad0 2023-07-21T22:39:07.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.240+0000 7f137e367640 1 -- 172.21.15.6:0/4141540845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13780c8ad0 msgr2=0x7f13780c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:07.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.240+0000 7f137e367640 1 --2- 172.21.15.6:0/4141540845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13780c8ad0 0x7f13780c9020 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f136c009870 tx=0x7f136c01c3f0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.240+0000 7f137e367640 1 -- 172.21.15.6:0/4141540845 shutdown_connections 2023-07-21T22:39:07.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.240+0000 7f137e367640 1 --2- 172.21.15.6:0/4141540845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13780c8ad0 0x7f13780c9020 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.240+0000 7f137e367640 1 -- 172.21.15.6:0/4141540845 >> 172.21.15.6:0/4141540845 conn(0x7f13780afcf0 msgr2=0x7f13780b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:07.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.240+0000 7f137e367640 1 -- 172.21.15.6:0/4141540845 shutdown_connections 2023-07-21T22:39:07.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.240+0000 7f137e367640 1 -- 172.21.15.6:0/4141540845 wait complete. 2023-07-21T22:39:07.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.240+0000 7f137e367640 1 Processor -- start 2023-07-21T22:39:07.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.240+0000 7f137e367640 1 -- start start 2023-07-21T22:39:07.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f137e367640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13780c8ad0 0x7f13781452b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:07.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f137e367640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13780c9560 0x7f13781457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:07.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f137e367640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1378158ce0 0x7f1378144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:07.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f137e367640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13780ab8a0 con 0x7f1378158ce0 2023-07-21T22:39:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f137e367640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13780abb80 con 0x7f13780c8ad0 2023-07-21T22:39:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f137e367640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13780abe60 con 0x7f13780c9560 2023-07-21T22:39:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f137c904640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1378158ce0 0x7f1378144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f137c904640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1378158ce0 0x7f1378144050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37136/0 (socket says 172.21.15.6:37136) 2023-07-21T22:39:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f137c904640 1 -- 172.21.15.6:0/2654365668 learned_addr learned my addr 172.21.15.6:0/2654365668 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f1377fff640 1 --2- 172.21.15.6:0/2654365668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13780c8ad0 0x7f13781452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:07.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f13777fe640 1 --2- 172.21.15.6:0/2654365668 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13780c9560 0x7f13781457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:07.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f137c904640 1 -- 172.21.15.6:0/2654365668 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13780c9560 msgr2=0x7f13781457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:07.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f137c904640 1 --2- 172.21.15.6:0/2654365668 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13780c9560 0x7f13781457f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f137c904640 1 -- 172.21.15.6:0/2654365668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13780c8ad0 msgr2=0x7f13781452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:07.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f137c904640 1 --2- 172.21.15.6:0/2654365668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13780c8ad0 0x7f13781452b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f137c904640 1 -- 172.21.15.6:0/2654365668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c0094d0 con 0x7f1378158ce0 2023-07-21T22:39:07.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f1377fff640 1 --2- 172.21.15.6:0/2654365668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13780c8ad0 0x7f13781452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:07.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f137c904640 1 --2- 172.21.15.6:0/2654365668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1378158ce0 0x7f1378144050 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f137000c700 tx=0x7f137000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:07.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f1374ff9640 1 -- 172.21.15.6:0/2654365668 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137000ce10 con 0x7f1378158ce0 2023-07-21T22:39:07.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f1374ff9640 1 -- 172.21.15.6:0/2654365668 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137000a640 con 0x7f1378158ce0 2023-07-21T22:39:07.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f137e367640 1 -- 172.21.15.6:0/2654365668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13780ac140 con 0x7f1378158ce0 2023-07-21T22:39:07.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f1374ff9640 1 -- 172.21.15.6:0/2654365668 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137000aa70 con 0x7f1378158ce0 2023-07-21T22:39:07.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f137e367640 1 -- 172.21.15.6:0/2654365668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1378070fa0 con 0x7f1378158ce0 2023-07-21T22:39:07.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f137e367640 1 -- 172.21.15.6:0/2654365668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13780ca1a0 con 0x7f1378158ce0 2023-07-21T22:39:07.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.244+0000 7f1374ff9640 1 -- 172.21.15.6:0/2654365668 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f137000abd0 con 0x7f1378158ce0 2023-07-21T22:39:07.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.248+0000 7f1374ff9640 1 --2- 172.21.15.6:0/2654365668 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f13640663a0 0x7f1364068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:07.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.248+0000 7f1374ff9640 1 -- 172.21.15.6:0/2654365668 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f1370083490 con 0x7f1378158ce0 2023-07-21T22:39:07.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.248+0000 7f1377fff640 1 --2- 172.21.15.6:0/2654365668 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f13640663a0 0x7f1364068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:07.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.248+0000 7f1377fff640 1 --2- 172.21.15.6:0/2654365668 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f13640663a0 0x7f1364068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f13781f8040 tx=0x7f1368009040 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:07.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.252+0000 7f1374ff9640 1 -- 172.21.15.6:0/2654365668 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1370050710 con 0x7f1378158ce0 2023-07-21T22:39:07.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.440+0000 7f137e367640 1 -- 172.21.15.6:0/2654365668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1378071190 con 0x7f1378158ce0 2023-07-21T22:39:07.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.440+0000 7f1374ff9640 1 -- 172.21.15.6:0/2654365668 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4670 (secure 0 0 0) 0x7f1370053d30 con 0x7f1378158ce0 2023-07-21T22:39:07.485 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:39:07.485 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/2365019581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2365019581},{"type":"v1","addr":"172.21.15.161:6836","nonce":2365019581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8968,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/798924835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":798924835},{"type":"v1","addr":"172.21.15.161:6837","nonce":798924835}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2487387353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2487387353},{"type":"v1","addr":"172.21.15.6:6834","nonce":2487387353}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:39:03.424297+0000","modified":"2023-07-21T22:39:07.057160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9309":{"gid":9309,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2700138945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2700138945},{"type":"v1","addr":"172.21.15.6:6835","nonce":2700138945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-21T22:39:07.485 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 70 2023-07-21T22:39:07.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.440+0000 7f137e367640 1 -- 172.21.15.6:0/2654365668 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f13640663a0 msgr2=0x7f1364068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:07.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.440+0000 7f137e367640 1 --2- 172.21.15.6:0/2654365668 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f13640663a0 0x7f1364068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f13781f8040 tx=0x7f1368009040 comp rx=0 tx=0).stop 2023-07-21T22:39:07.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.440+0000 7f137e367640 1 -- 172.21.15.6:0/2654365668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1378158ce0 msgr2=0x7f1378144050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:07.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.440+0000 7f137e367640 1 --2- 172.21.15.6:0/2654365668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1378158ce0 0x7f1378144050 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f137000c700 tx=0x7f137000cbc0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.440+0000 7f137e367640 1 -- 172.21.15.6:0/2654365668 shutdown_connections 2023-07-21T22:39:07.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.440+0000 7f137e367640 1 --2- 172.21.15.6:0/2654365668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1378158ce0 0x7f1378144050 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.440+0000 7f137e367640 1 --2- 172.21.15.6:0/2654365668 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f13780c9560 0x7f13781457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.440+0000 7f137e367640 1 --2- 172.21.15.6:0/2654365668 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f13640663a0 0x7f1364068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.440+0000 7f137e367640 1 --2- 172.21.15.6:0/2654365668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13780c8ad0 0x7f13781452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.440+0000 7f137e367640 1 -- 172.21.15.6:0/2654365668 >> 172.21.15.6:0/2654365668 conn(0x7f13780afcf0 msgr2=0x7f13780ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.444+0000 7f137e367640 1 -- 172.21.15.6:0/2654365668 shutdown_connections 2023-07-21T22:39:07.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.444+0000 7f137e367640 1 -- 172.21.15.6:0/2654365668 wait complete. 2023-07-21T22:39:07.506 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:39:07.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.604+0000 7f32d149c640 1 Processor -- start 2023-07-21T22:39:07.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.608+0000 7f32d149c640 1 -- start start 2023-07-21T22:39:07.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.608+0000 7f32d149c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f32cc06a540 0x7f32cc06a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:07.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.608+0000 7f32d149c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f32cc0cdcd0 0x7f32cc0cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:07.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.608+0000 7f32d149c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32cc06ae50 con 0x7f32cc0cc980 2023-07-21T22:39:07.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.608+0000 7f32d149c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32cc0cef10 con 0x7f32cc0cdcd0 2023-07-21T22:39:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.608+0000 7f32d149c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32cc0cfaf0 con 0x7f32cc06a540 2023-07-21T22:39:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.608+0000 7f32c3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f32cc0cdcd0 0x7f32cc0cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.608+0000 7f32c3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f32cc0cdcd0 0x7f32cc0cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54380/0 (socket says 172.21.15.6:54380) 2023-07-21T22:39:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.608+0000 7f32c3fff640 1 -- 172.21.15.6:0/3601482815 learned_addr learned my addr 172.21.15.6:0/3601482815 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:07.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.608+0000 7f32c3fff640 1 -- 172.21.15.6:0/3601482815 >> v2:172.21.15.161:3300/0 conn(0x7f32cc06a540 msgr2=0x7f32cc06a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:07.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.608+0000 7f32c3fff640 1 --2- 172.21.15.6:0/3601482815 >> v2:172.21.15.161:3300/0 conn(0x7f32cc06a540 0x7f32cc06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.608+0000 7f32c3fff640 1 -- 172.21.15.6:0/3601482815 >> v1:172.21.15.161:6789/0 conn(0x7f32cc0cc980 legacy=0x7f32cc0ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:07.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.608+0000 7f32c3fff640 1 -- 172.21.15.6:0/3601482815 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32cc0cfdd0 con 0x7f32cc0cdcd0 2023-07-21T22:39:07.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.612+0000 7f32c3fff640 1 --2- 172.21.15.6:0/3601482815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32cc0cdcd0 0x7f32cc0cf2a0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f32cc070f20 tx=0x7f32b401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33884a16a34fa629 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:07.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.612+0000 7f32ca7fc640 1 -- 172.21.15.6:0/3601482815 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b40a89b0 con 0x7f32cc0cdcd0 2023-07-21T22:39:07.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.612+0000 7f32ca7fc640 1 -- 172.21.15.6:0/3601482815 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b40a8b10 con 0x7f32cc0cdcd0 2023-07-21T22:39:07.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.612+0000 7f32ca7fc640 1 -- 172.21.15.6:0/3601482815 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b40a8ea0 con 0x7f32cc0cdcd0 2023-07-21T22:39:07.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.612+0000 7f32d149c640 1 -- 172.21.15.6:0/3601482815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32cc0cdcd0 msgr2=0x7f32cc0cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:07.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.612+0000 7f32d149c640 1 --2- 172.21.15.6:0/3601482815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32cc0cdcd0 0x7f32cc0cf2a0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f32cc070f20 tx=0x7f32b401ecb0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.612+0000 7f32d149c640 1 -- 172.21.15.6:0/3601482815 shutdown_connections 2023-07-21T22:39:07.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.612+0000 7f32d149c640 1 --2- 172.21.15.6:0/3601482815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32cc0cdcd0 0x7f32cc0cf2a0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.612+0000 7f32d149c640 1 --2- 172.21.15.6:0/3601482815 >> v2:172.21.15.161:3300/0 conn(0x7f32cc06a540 0x7f32cc06a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.612+0000 7f32d149c640 1 -- 172.21.15.6:0/3601482815 >> 172.21.15.6:0/3601482815 conn(0x7f32cc099490 msgr2=0x7f32cc089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:07.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.612+0000 7f32d149c640 1 -- 172.21.15.6:0/3601482815 shutdown_connections 2023-07-21T22:39:07.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.612+0000 7f32d149c640 1 -- 172.21.15.6:0/3601482815 wait complete. 2023-07-21T22:39:07.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.612+0000 7f32d149c640 1 Processor -- start 2023-07-21T22:39:07.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.612+0000 7f32d149c640 1 -- start start 2023-07-21T22:39:07.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32d149c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32cc06a540 0x7f32cc15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:07.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32d149c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32cc0cc980 0x7f32cc149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:07.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32d149c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32cc0cdcd0 0x7f32cc148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:07.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32d149c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc158fb0 con 0x7f32cc06a540 2023-07-21T22:39:07.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32d149c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc15c5b0 con 0x7f32cc0cdcd0 2023-07-21T22:39:07.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32d149c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc15ed00 con 0x7f32cc0cc980 2023-07-21T22:39:07.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32caffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32cc06a540 0x7f32cc15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:07.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32caffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32cc06a540 0x7f32cc15bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54388/0 (socket says 172.21.15.6:54388) 2023-07-21T22:39:07.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32caffd640 1 -- 172.21.15.6:0/3738095538 learned_addr learned my addr 172.21.15.6:0/3738095538 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:07.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32c3fff640 1 --2- 172.21.15.6:0/3738095538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32cc0cc980 0x7f32cc149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:07.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32cb7fe640 1 --2- 172.21.15.6:0/3738095538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32cc0cdcd0 0x7f32cc148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:07.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32caffd640 1 -- 172.21.15.6:0/3738095538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32cc0cc980 msgr2=0x7f32cc149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:07.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32caffd640 1 --2- 172.21.15.6:0/3738095538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32cc0cc980 0x7f32cc149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32caffd640 1 -- 172.21.15.6:0/3738095538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32cc0cdcd0 msgr2=0x7f32cc148c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:07.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32caffd640 1 --2- 172.21.15.6:0/3738095538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32cc0cdcd0 0x7f32cc148c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32caffd640 1 -- 172.21.15.6:0/3738095538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b40094d0 con 0x7f32cc06a540 2023-07-21T22:39:07.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32cb7fe640 1 --2- 172.21.15.6:0/3738095538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32cc0cdcd0 0x7f32cc148c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:07.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32caffd640 1 --2- 172.21.15.6:0/3738095538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32cc06a540 0x7f32cc15bfd0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00b410 tx=0x7f32bc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:07.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32c37fe640 1 -- 172.21.15.6:0/3738095538 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc005980 con 0x7f32cc06a540 2023-07-21T22:39:07.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32c37fe640 1 -- 172.21.15.6:0/3738095538 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32bc005b00 con 0x7f32cc06a540 2023-07-21T22:39:07.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32c37fe640 1 -- 172.21.15.6:0/3738095538 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc006020 con 0x7f32cc06a540 2023-07-21T22:39:07.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32d149c640 1 -- 172.21.15.6:0/3738095538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32cc15efa0 con 0x7f32cc06a540 2023-07-21T22:39:07.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32d149c640 1 -- 172.21.15.6:0/3738095538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32cc149bb0 con 0x7f32cc06a540 2023-07-21T22:39:07.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.616+0000 7f32d149c640 1 -- 172.21.15.6:0/3738095538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32cc0b4c70 con 0x7f32cc06a540 2023-07-21T22:39:07.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.620+0000 7f32c37fe640 1 -- 172.21.15.6:0/3738095538 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f32bc006180 con 0x7f32cc06a540 2023-07-21T22:39:07.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.620+0000 7f32c37fe640 1 --2- 172.21.15.6:0/3738095538 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f32ac0663d0 0x7f32ac068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:07.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.620+0000 7f32c37fe640 1 -- 172.21.15.6:0/3738095538 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f32bc083cb0 con 0x7f32cc06a540 2023-07-21T22:39:07.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.620+0000 7f32c3fff640 1 --2- 172.21.15.6:0/3738095538 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f32ac0663d0 0x7f32ac068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:07.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.620+0000 7f32c3fff640 1 --2- 172.21.15.6:0/3738095538 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f32ac0663d0 0x7f32ac068880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f32b40b2000 tx=0x7f32b40aa070 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:07.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.624+0000 7f32c37fe640 1 -- 172.21.15.6:0/3738095538 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f32cc0b4c70 con 0x7f32cc06a540 2023-07-21T22:39:07.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.780+0000 7f32d149c640 1 -- 172.21.15.6:0/3738095538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32cc0b4c70 con 0x7f32cc06a540 2023-07-21T22:39:07.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.780+0000 7f32c37fe640 1 -- 172.21.15.6:0/3738095538 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+18352 (secure 0 0 0) 0x7f32cc0b4c70 con 0x7f32cc06a540 2023-07-21T22:39:07.826 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:39:07.827 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":157,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:39:05.024557+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:39:01.548583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-21T22:39:02.416927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:39:07.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.784+0000 7f32d149c640 1 -- 172.21.15.6:0/3738095538 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f32ac0663d0 msgr2=0x7f32ac068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:07.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.784+0000 7f32d149c640 1 --2- 172.21.15.6:0/3738095538 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f32ac0663d0 0x7f32ac068880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f32b40b2000 tx=0x7f32b40aa070 comp rx=0 tx=0).stop 2023-07-21T22:39:07.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.784+0000 7f32d149c640 1 -- 172.21.15.6:0/3738095538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32cc06a540 msgr2=0x7f32cc15bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:07.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.784+0000 7f32d149c640 1 --2- 172.21.15.6:0/3738095538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32cc06a540 0x7f32cc15bfd0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00b410 tx=0x7f32bc00b8d0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.784+0000 7f32d149c640 1 -- 172.21.15.6:0/3738095538 shutdown_connections 2023-07-21T22:39:07.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.784+0000 7f32d149c640 1 --2- 172.21.15.6:0/3738095538 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f32ac0663d0 0x7f32ac068880 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.784+0000 7f32d149c640 1 --2- 172.21.15.6:0/3738095538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f32cc0cdcd0 0x7f32cc148c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.784+0000 7f32d149c640 1 --2- 172.21.15.6:0/3738095538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f32cc0cc980 0x7f32cc149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.784+0000 7f32d149c640 1 --2- 172.21.15.6:0/3738095538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32cc06a540 0x7f32cc15bfd0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.784+0000 7f32d149c640 1 -- 172.21.15.6:0/3738095538 >> 172.21.15.6:0/3738095538 conn(0x7f32cc099490 msgr2=0x7f32cc0cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:07.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.784+0000 7f32d149c640 1 -- 172.21.15.6:0/3738095538 shutdown_connections 2023-07-21T22:39:07.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.784+0000 7f32d149c640 1 -- 172.21.15.6:0/3738095538 wait complete. 2023-07-21T22:39:07.847 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T22:39:07.848 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:39:07.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.948+0000 7fe2163d2640 1 Processor -- start 2023-07-21T22:39:07.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.948+0000 7fe2163d2640 1 -- start start 2023-07-21T22:39:07.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.952+0000 7fe2163d2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe21015bc00 0x7fe2100ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:07.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.952+0000 7fe2163d2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe210160450 0x7fe21006e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:07.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.952+0000 7fe2163d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe210069430 0x7fe210069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:07.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.952+0000 7fe2163d2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2100c96b0 con 0x7fe210160450 2023-07-21T22:39:07.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.952+0000 7fe2163d2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2100c9c30 con 0x7fe21015bc00 2023-07-21T22:39:07.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.952+0000 7fe2163d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe210069db0 con 0x7fe210069430 2023-07-21T22:39:07.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.952+0000 7fe207fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe210160450 0x7fe21006e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:07.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.952+0000 7fe207fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe210160450 0x7fe21006e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54390/0 (socket says 172.21.15.6:54390) 2023-07-21T22:39:07.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.952+0000 7fe207fff640 1 -- 172.21.15.6:0/2123324370 learned_addr learned my addr 172.21.15.6:0/2123324370 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:07.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.952+0000 7fe20ffff640 1 --2- 172.21.15.6:0/2123324370 >> v2:172.21.15.161:3300/0 conn(0x7fe21015bc00 0x7fe2100ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:07.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.952+0000 7fe21496f640 1 --2- 172.21.15.6:0/2123324370 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe210069430 0x7fe210069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:07.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.952+0000 7fe207fff640 1 -- 172.21.15.6:0/2123324370 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe210069430 msgr2=0x7fe210069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:07.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.952+0000 7fe207fff640 1 --2- 172.21.15.6:0/2123324370 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe210069430 0x7fe210069870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.952+0000 7fe207fff640 1 -- 172.21.15.6:0/2123324370 >> v2:172.21.15.161:3300/0 conn(0x7fe21015bc00 msgr2=0x7fe2100ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:07.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.952+0000 7fe207fff640 1 --2- 172.21.15.6:0/2123324370 >> v2:172.21.15.161:3300/0 conn(0x7fe21015bc00 0x7fe2100ce8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:07.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.952+0000 7fe207fff640 1 -- 172.21.15.6:0/2123324370 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21015bfd0 con 0x7fe210160450 2023-07-21T22:39:07.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.952+0000 7fe207fff640 1 --2- 172.21.15.6:0/2123324370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe210160450 0x7fe21006e690 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fe210071ca0 tx=0x7fe1f801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc009f13e9a8903 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:07.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe20f7fe640 1 -- 172.21.15.6:0/2123324370 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f80a6040 con 0x7fe210160450 2023-07-21T22:39:07.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe20f7fe640 1 -- 172.21.15.6:0/2123324370 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f80aa600 con 0x7fe210160450 2023-07-21T22:39:08.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe20f7fe640 1 -- 172.21.15.6:0/2123324370 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f80aa990 con 0x7fe210160450 2023-07-21T22:39:08.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe2163d2640 1 -- 172.21.15.6:0/2123324370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe210160450 msgr2=0x7fe21006e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:08.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe2163d2640 1 --2- 172.21.15.6:0/2123324370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe210160450 0x7fe21006e690 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fe210071ca0 tx=0x7fe1f801c4e0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe2163d2640 1 -- 172.21.15.6:0/2123324370 shutdown_connections 2023-07-21T22:39:08.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe2163d2640 1 --2- 172.21.15.6:0/2123324370 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe210069430 0x7fe210069870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe2163d2640 1 --2- 172.21.15.6:0/2123324370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe210160450 0x7fe21006e690 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe2163d2640 1 --2- 172.21.15.6:0/2123324370 >> v2:172.21.15.161:3300/0 conn(0x7fe21015bc00 0x7fe2100ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe2163d2640 1 -- 172.21.15.6:0/2123324370 >> 172.21.15.6:0/2123324370 conn(0x7fe2100b1840 msgr2=0x7fe2100cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:08.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe2163d2640 1 -- 172.21.15.6:0/2123324370 shutdown_connections 2023-07-21T22:39:08.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe2163d2640 1 -- 172.21.15.6:0/2123324370 wait complete. 2023-07-21T22:39:08.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe2163d2640 1 Processor -- start 2023-07-21T22:39:08.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe2163d2640 1 -- start start 2023-07-21T22:39:08.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe2163d2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe210069430 0x7fe2100c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:08.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe2163d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe21015bc00 0x7fe2100c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:08.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe2163d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe210160450 0x7fe21015e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:08.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe2163d2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2101f8710 con 0x7fe210160450 2023-07-21T22:39:08.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe2163d2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2101f7b00 con 0x7fe210069430 2023-07-21T22:39:08.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe2163d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2101f7de0 con 0x7fe21015bc00 2023-07-21T22:39:08.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.956+0000 7fe21496f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe210160450 0x7fe21015e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:08.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.960+0000 7fe21496f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe210160450 0x7fe21015e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54402/0 (socket says 172.21.15.6:54402) 2023-07-21T22:39:08.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.960+0000 7fe21496f640 1 -- 172.21.15.6:0/1437311171 learned_addr learned my addr 172.21.15.6:0/1437311171 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:08.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.960+0000 7fe20ffff640 1 --2- 172.21.15.6:0/1437311171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe210069430 0x7fe2100c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:08.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.960+0000 7fe207fff640 1 --2- 172.21.15.6:0/1437311171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe21015bc00 0x7fe2100c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:08.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.960+0000 7fe21496f640 1 -- 172.21.15.6:0/1437311171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe21015bc00 msgr2=0x7fe2100c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:08.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.960+0000 7fe21496f640 1 --2- 172.21.15.6:0/1437311171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe21015bc00 0x7fe2100c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.960+0000 7fe21496f640 1 -- 172.21.15.6:0/1437311171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe210069430 msgr2=0x7fe2100c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:08.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.960+0000 7fe21496f640 1 --2- 172.21.15.6:0/1437311171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe210069430 0x7fe2100c34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.960+0000 7fe21496f640 1 -- 172.21.15.6:0/1437311171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f80094d0 con 0x7fe210160450 2023-07-21T22:39:08.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.960+0000 7fe207fff640 1 --2- 172.21.15.6:0/1437311171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe21015bc00 0x7fe2100c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:08.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.960+0000 7fe21496f640 1 --2- 172.21.15.6:0/1437311171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe210160450 0x7fe21015e290 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fe20800efc0 tx=0x7fe20800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:08.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.960+0000 7fe20d7fa640 1 -- 172.21.15.6:0/1437311171 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe208014480 con 0x7fe210160450 2023-07-21T22:39:08.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.960+0000 7fe20d7fa640 1 -- 172.21.15.6:0/1437311171 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20800f040 con 0x7fe210160450 2023-07-21T22:39:08.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.960+0000 7fe20d7fa640 1 -- 172.21.15.6:0/1437311171 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe208014820 con 0x7fe210160450 2023-07-21T22:39:08.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.960+0000 7fe2163d2640 1 -- 172.21.15.6:0/1437311171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2101f80c0 con 0x7fe210160450 2023-07-21T22:39:08.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.960+0000 7fe2163d2640 1 -- 172.21.15.6:0/1437311171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2100c3a20 con 0x7fe210160450 2023-07-21T22:39:08.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.960+0000 7fe2163d2640 1 -- 172.21.15.6:0/1437311171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2100b1f20 con 0x7fe210160450 2023-07-21T22:39:08.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.960+0000 7fe20d7fa640 1 -- 172.21.15.6:0/1437311171 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe208014980 con 0x7fe210160450 2023-07-21T22:39:08.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.964+0000 7fe20d7fa640 1 --2- 172.21.15.6:0/1437311171 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe1f00663a0 0x7fe1f0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:08.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.964+0000 7fe20d7fa640 1 -- 172.21.15.6:0/1437311171 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fe208084ad0 con 0x7fe210160450 2023-07-21T22:39:08.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.964+0000 7fe20ffff640 1 --2- 172.21.15.6:0/1437311171 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe1f00663a0 0x7fe1f0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:08.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.964+0000 7fe20ffff640 1 --2- 172.21.15.6:0/1437311171 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe1f00663a0 0x7fe1f0068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe200009ae0 tx=0x7fe200009190 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:08.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:07.968+0000 7fe20d7fa640 1 -- 172.21.15.6:0/1437311171 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe2100b1f20 con 0x7fe210160450 2023-07-21T22:39:08.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.120+0000 7fe2163d2640 1 -- 172.21.15.6:0/1437311171 --> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2100c98c0 con 0x7fe1f00663a0 2023-07-21T22:39:08.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.132+0000 7fe20d7fa640 1 -- 172.21.15.6:0/1437311171 <== mgr.7694 v2:172.21.15.161:6832/2692111396 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306370 (secure 0 0 0) 0x7fe200011a00 con 0x7fe1f00663a0 2023-07-21T22:39:08.178 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:39:08.180 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:39:08.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.136+0000 7fe2163d2640 1 -- 172.21.15.6:0/1437311171 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe1f00663a0 msgr2=0x7fe1f0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:08.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.136+0000 7fe2163d2640 1 --2- 172.21.15.6:0/1437311171 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe1f00663a0 0x7fe1f0068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe200009ae0 tx=0x7fe200009190 comp rx=0 tx=0).stop 2023-07-21T22:39:08.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.136+0000 7fe2163d2640 1 -- 172.21.15.6:0/1437311171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe210160450 msgr2=0x7fe21015e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:08.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.136+0000 7fe2163d2640 1 --2- 172.21.15.6:0/1437311171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe210160450 0x7fe21015e290 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fe20800efc0 tx=0x7fe20800c490 comp rx=0 tx=0).stop 2023-07-21T22:39:08.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.136+0000 7fe2163d2640 1 -- 172.21.15.6:0/1437311171 shutdown_connections 2023-07-21T22:39:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.136+0000 7fe2163d2640 1 --2- 172.21.15.6:0/1437311171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe210160450 0x7fe21015e290 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.136+0000 7fe2163d2640 1 --2- 172.21.15.6:0/1437311171 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe21015bc00 0x7fe2100c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.136+0000 7fe2163d2640 1 --2- 172.21.15.6:0/1437311171 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe1f00663a0 0x7fe1f0068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.136+0000 7fe2163d2640 1 --2- 172.21.15.6:0/1437311171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe210069430 0x7fe2100c34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.136+0000 7fe2163d2640 1 -- 172.21.15.6:0/1437311171 >> 172.21.15.6:0/1437311171 conn(0x7fe2100b1840 msgr2=0x7fe2101545e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.136+0000 7fe2163d2640 1 -- 172.21.15.6:0/1437311171 shutdown_connections 2023-07-21T22:39:08.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.136+0000 7fe2163d2640 1 -- 172.21.15.6:0/1437311171 wait complete. 2023-07-21T22:39:08.199 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-21T22:39:07.694302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":339152,"kb_used_data":16144,"kb_used_omap":0,"kb_used_meta":322944,"kb_avail":754635568,"statfs":{"total":773094113280,"available":772746821632,"internally_reserved":0,"allocated":16531456,"data_stored":8962608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":330694656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.675750"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.031755+0000","last_change":"2023-07-21T22:39:03.031755+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.031755+0000","last_undegraded":"2023-07-21T22:39:03.031755+0000","last_fullsized":"2023-07-21T22:39:03.031755+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035392+0000","last_change":"2023-07-21T22:39:03.035392+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035392+0000","last_undegraded":"2023-07-21T22:39:03.035392+0000","last_fullsized":"2023-07-21T22:39:03.035392+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.037166+0000","last_change":"2023-07-21T22:39:03.037166+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.037166+0000","last_undegraded":"2023-07-21T22:39:03.037166+0000","last_fullsized":"2023-07-21T22:39:03.037166+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033602+0000","last_change":"2023-07-21T22:39:03.033602+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033602+0000","last_undegraded":"2023-07-21T22:39:03.033602+0000","last_fullsized":"2023-07-21T22:39:03.033602+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.029514+0000","last_change":"2023-07-21T22:39:03.029514+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.029514+0000","last_undegraded":"2023-07-21T22:39:03.029514+0000","last_fullsized":"2023-07-21T22:39:03.029514+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.027710+0000","last_change":"2023-07-21T22:39:03.027710+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.027710+0000","last_undegraded":"2023-07-21T22:39:03.027710+0000","last_fullsized":"2023-07-21T22:39:03.027710+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.045495+0000","last_change":"2023-07-21T22:39:03.045495+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.045495+0000","last_undegraded":"2023-07-21T22:39:03.045495+0000","last_fullsized":"2023-07-21T22:39:03.045495+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032274+0000","last_change":"2023-07-21T22:39:03.032274+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032274+0000","last_undegraded":"2023-07-21T22:39:03.032274+0000","last_fullsized":"2023-07-21T22:39:03.032274+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.028120+0000","last_change":"2023-07-21T22:39:03.028120+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.028120+0000","last_undegraded":"2023-07-21T22:39:03.028120+0000","last_fullsized":"2023-07-21T22:39:03.028120+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032516+0000","last_change":"2023-07-21T22:39:03.032516+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032516+0000","last_undegraded":"2023-07-21T22:39:03.032516+0000","last_fullsized":"2023-07-21T22:39:03.032516+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033779+0000","last_change":"2023-07-21T22:39:03.033779+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033779+0000","last_undegraded":"2023-07-21T22:39:03.033779+0000","last_fullsized":"2023-07-21T22:39:03.033779+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.030463+0000","last_change":"2023-07-21T22:39:03.030463+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.030463+0000","last_undegraded":"2023-07-21T22:39:03.030463+0000","last_fullsized":"2023-07-21T22:39:03.030463+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.028563+0000","last_change":"2023-07-21T22:39:03.028563+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.028563+0000","last_undegraded":"2023-07-21T22:39:03.028563+0000","last_fullsized":"2023-07-21T22:39:03.028563+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032620+0000","last_change":"2023-07-21T22:39:03.032620+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032620+0000","last_undegraded":"2023-07-21T22:39:03.032620+0000","last_fullsized":"2023-07-21T22:39:03.032620+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.034073+0000","last_change":"2023-07-21T22:39:03.034073+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.034073+0000","last_undegraded":"2023-07-21T22:39:03.034073+0000","last_fullsized":"2023-07-21T22:39:03.034073+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.030541+0000","last_change":"2023-07-21T22:39:03.030541+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.030541+0000","last_undegraded":"2023-07-21T22:39:03.030541+0000","last_fullsized":"2023-07-21T22:39:03.030541+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.027650+0000","last_change":"2023-07-21T22:39:03.027650+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.027650+0000","last_undegraded":"2023-07-21T22:39:03.027650+0000","last_fullsized":"2023-07-21T22:39:03.027650+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.031440+0000","last_change":"2023-07-21T22:39:03.031440+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.031440+0000","last_undegraded":"2023-07-21T22:39:03.031440+0000","last_fullsized":"2023-07-21T22:39:03.031440+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.038813+0000","last_change":"2023-07-21T22:39:03.038813+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.038813+0000","last_undegraded":"2023-07-21T22:39:03.038813+0000","last_fullsized":"2023-07-21T22:39:03.038813+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032698+0000","last_change":"2023-07-21T22:39:03.032698+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032698+0000","last_undegraded":"2023-07-21T22:39:03.032698+0000","last_fullsized":"2023-07-21T22:39:03.032698+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033863+0000","last_change":"2023-07-21T22:39:03.033863+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033863+0000","last_undegraded":"2023-07-21T22:39:03.033863+0000","last_fullsized":"2023-07-21T22:39:03.033863+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033051+0000","last_change":"2023-07-21T22:39:03.033051+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033051+0000","last_undegraded":"2023-07-21T22:39:03.033051+0000","last_fullsized":"2023-07-21T22:39:03.033051+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.034683+0000","last_change":"2023-07-21T22:39:03.034683+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.034683+0000","last_undegraded":"2023-07-21T22:39:03.034683+0000","last_fullsized":"2023-07-21T22:39:03.034683+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.030099+0000","last_change":"2023-07-21T22:39:03.030099+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.030099+0000","last_undegraded":"2023-07-21T22:39:03.030099+0000","last_fullsized":"2023-07-21T22:39:03.030099+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.037595+0000","last_change":"2023-07-21T22:39:03.037595+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.037595+0000","last_undegraded":"2023-07-21T22:39:03.037595+0000","last_fullsized":"2023-07-21T22:39:03.037595+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.036711+0000","last_change":"2023-07-21T22:39:03.036711+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.036711+0000","last_undegraded":"2023-07-21T22:39:03.036711+0000","last_fullsized":"2023-07-21T22:39:03.036711+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.038301+0000","last_change":"2023-07-21T22:39:03.038301+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.038301+0000","last_undegraded":"2023-07-21T22:39:03.038301+0000","last_fullsized":"2023-07-21T22:39:03.038301+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032779+0000","last_change":"2023-07-21T22:39:03.032779+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032779+0000","last_undegraded":"2023-07-21T22:39:03.032779+0000","last_fullsized":"2023-07-21T22:39:03.032779+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.036335+0000","last_change":"2023-07-21T22:39:03.036335+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.036335+0000","last_undegraded":"2023-07-21T22:39:03.036335+0000","last_fullsized":"2023-07-21T22:39:03.036335+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035927+0000","last_change":"2023-07-21T22:39:03.035927+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035927+0000","last_undegraded":"2023-07-21T22:39:03.035927+0000","last_fullsized":"2023-07-21T22:39:03.035927+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.031055+0000","last_change":"2023-07-21T22:39:03.031055+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.031055+0000","last_undegraded":"2023-07-21T22:39:03.031055+0000","last_fullsized":"2023-07-21T22:39:03.031055+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032720+0000","last_change":"2023-07-21T22:39:03.032720+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032720+0000","last_undegraded":"2023-07-21T22:39:03.032720+0000","last_fullsized":"2023-07-21T22:39:03.032720+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.031801+0000","last_change":"2023-07-21T22:39:03.031801+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.031801+0000","last_undegraded":"2023-07-21T22:39:03.031801+0000","last_fullsized":"2023-07-21T22:39:03.031801+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.051284+0000","last_change":"2023-07-21T22:39:03.045196+0000","last_active":"2023-07-21T22:39:03.051284+0000","last_peered":"2023-07-21T22:39:03.051284+0000","last_clean":"2023-07-21T22:39:03.051284+0000","last_became_active":"2023-07-21T22:39:03.044911+0000","last_became_peered":"2023-07-21T22:39:03.044911+0000","last_unstale":"2023-07-21T22:39:03.051284+0000","last_undegraded":"2023-07-21T22:39:03.051284+0000","last_fullsized":"2023-07-21T22:39:03.051284+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:59:50.408032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033616+0000","last_change":"2023-07-21T22:39:03.033616+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033616+0000","last_undegraded":"2023-07-21T22:39:03.033616+0000","last_fullsized":"2023-07-21T22:39:03.033616+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.049521+0000","last_change":"2023-07-21T22:39:03.043899+0000","last_active":"2023-07-21T22:39:03.049521+0000","last_peered":"2023-07-21T22:39:03.049521+0000","last_clean":"2023-07-21T22:39:03.049521+0000","last_became_active":"2023-07-21T22:39:03.043604+0000","last_became_peered":"2023-07-21T22:39:03.043604+0000","last_unstale":"2023-07-21T22:39:03.049521+0000","last_undegraded":"2023-07-21T22:39:03.049521+0000","last_fullsized":"2023-07-21T22:39:03.049521+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:26:49.888654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.034520+0000","last_change":"2023-07-21T22:39:03.034520+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.034520+0000","last_undegraded":"2023-07-21T22:39:03.034520+0000","last_fullsized":"2023-07-21T22:39:03.034520+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.052224+0000","last_change":"2023-07-21T22:39:03.047859+0000","last_active":"2023-07-21T22:39:03.052224+0000","last_peered":"2023-07-21T22:39:03.052224+0000","last_clean":"2023-07-21T22:39:03.052224+0000","last_became_active":"2023-07-21T22:39:03.047591+0000","last_became_peered":"2023-07-21T22:39:03.047591+0000","last_unstale":"2023-07-21T22:39:03.052224+0000","last_undegraded":"2023-07-21T22:39:03.052224+0000","last_fullsized":"2023-07-21T22:39:03.052224+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:30:13.086821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.028874+0000","last_change":"2023-07-21T22:39:03.028874+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.028874+0000","last_undegraded":"2023-07-21T22:39:03.028874+0000","last_fullsized":"2023-07-21T22:39:03.028874+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.054382+0000","last_change":"2023-07-21T22:39:03.052051+0000","last_active":"2023-07-21T22:39:03.054382+0000","last_peered":"2023-07-21T22:39:03.054382+0000","last_clean":"2023-07-21T22:39:03.054382+0000","last_became_active":"2023-07-21T22:39:03.051732+0000","last_became_peered":"2023-07-21T22:39:03.051732+0000","last_unstale":"2023-07-21T22:39:03.054382+0000","last_undegraded":"2023-07-21T22:39:03.054382+0000","last_fullsized":"2023-07-21T22:39:03.054382+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:52:56.209992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.031271+0000","last_change":"2023-07-21T22:39:03.031271+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.031271+0000","last_undegraded":"2023-07-21T22:39:03.031271+0000","last_fullsized":"2023-07-21T22:39:03.031271+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.051290+0000","last_change":"2023-07-21T22:39:03.047928+0000","last_active":"2023-07-21T22:39:03.051290+0000","last_peered":"2023-07-21T22:39:03.051290+0000","last_clean":"2023-07-21T22:39:03.051290+0000","last_became_active":"2023-07-21T22:39:03.047629+0000","last_became_peered":"2023-07-21T22:39:03.047629+0000","last_unstale":"2023-07-21T22:39:03.051290+0000","last_undegraded":"2023-07-21T22:39:03.051290+0000","last_fullsized":"2023-07-21T22:39:03.051290+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:19:36.446560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.031605+0000","last_change":"2023-07-21T22:39:03.031605+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.031605+0000","last_undegraded":"2023-07-21T22:39:03.031605+0000","last_fullsized":"2023-07-21T22:39:03.031605+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.040059+0000","last_change":"2023-07-21T22:39:03.035738+0000","last_active":"2023-07-21T22:39:03.040059+0000","last_peered":"2023-07-21T22:39:03.040059+0000","last_clean":"2023-07-21T22:39:03.040059+0000","last_became_active":"2023-07-21T22:39:03.035421+0000","last_became_peered":"2023-07-21T22:39:03.035421+0000","last_unstale":"2023-07-21T22:39:03.040059+0000","last_undegraded":"2023-07-21T22:39:03.040059+0000","last_fullsized":"2023-07-21T22:39:03.040059+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:03:22.351326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.030986+0000","last_change":"2023-07-21T22:39:03.030986+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.030986+0000","last_undegraded":"2023-07-21T22:39:03.030986+0000","last_fullsized":"2023-07-21T22:39:03.030986+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.039585+0000","last_change":"2023-07-21T22:39:03.036395+0000","last_active":"2023-07-21T22:39:03.039585+0000","last_peered":"2023-07-21T22:39:03.039585+0000","last_clean":"2023-07-21T22:39:03.039585+0000","last_became_active":"2023-07-21T22:39:03.036126+0000","last_became_peered":"2023-07-21T22:39:03.036126+0000","last_unstale":"2023-07-21T22:39:03.039585+0000","last_undegraded":"2023-07-21T22:39:03.039585+0000","last_fullsized":"2023-07-21T22:39:03.039585+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:48:39.173771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.039311+0000","last_change":"2023-07-21T22:39:03.039311+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.039311+0000","last_undegraded":"2023-07-21T22:39:03.039311+0000","last_fullsized":"2023-07-21T22:39:03.039311+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.046896+0000","last_change":"2023-07-21T22:39:03.043496+0000","last_active":"2023-07-21T22:39:03.046896+0000","last_peered":"2023-07-21T22:39:03.046896+0000","last_clean":"2023-07-21T22:39:03.046896+0000","last_became_active":"2023-07-21T22:39:03.043150+0000","last_became_peered":"2023-07-21T22:39:03.043150+0000","last_unstale":"2023-07-21T22:39:03.046896+0000","last_undegraded":"2023-07-21T22:39:03.046896+0000","last_fullsized":"2023-07-21T22:39:03.046896+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:48:06.386390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.041058+0000","last_change":"2023-07-21T22:39:03.041058+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.041058+0000","last_undegraded":"2023-07-21T22:39:03.041058+0000","last_fullsized":"2023-07-21T22:39:03.041058+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.050228+0000","last_change":"2023-07-21T22:39:03.048717+0000","last_active":"2023-07-21T22:39:03.050228+0000","last_peered":"2023-07-21T22:39:03.050228+0000","last_clean":"2023-07-21T22:39:03.050228+0000","last_became_active":"2023-07-21T22:39:03.048384+0000","last_became_peered":"2023-07-21T22:39:03.048384+0000","last_unstale":"2023-07-21T22:39:03.050228+0000","last_undegraded":"2023-07-21T22:39:03.050228+0000","last_fullsized":"2023-07-21T22:39:03.050228+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:40:09.732090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.039376+0000","last_change":"2023-07-21T22:39:03.039376+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.039376+0000","last_undegraded":"2023-07-21T22:39:03.039376+0000","last_fullsized":"2023-07-21T22:39:03.039376+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.051097+0000","last_change":"2023-07-21T22:39:03.045117+0000","last_active":"2023-07-21T22:39:03.051097+0000","last_peered":"2023-07-21T22:39:03.051097+0000","last_clean":"2023-07-21T22:39:03.051097+0000","last_became_active":"2023-07-21T22:39:03.044806+0000","last_became_peered":"2023-07-21T22:39:03.044806+0000","last_unstale":"2023-07-21T22:39:03.051097+0000","last_undegraded":"2023-07-21T22:39:03.051097+0000","last_fullsized":"2023-07-21T22:39:03.051097+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:11:15.831496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.040150+0000","last_change":"2023-07-21T22:39:03.040150+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.040150+0000","last_undegraded":"2023-07-21T22:39:03.040150+0000","last_fullsized":"2023-07-21T22:39:03.040150+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.041874+0000","last_change":"2023-07-21T22:39:03.039227+0000","last_active":"2023-07-21T22:39:03.041874+0000","last_peered":"2023-07-21T22:39:03.041874+0000","last_clean":"2023-07-21T22:39:03.041874+0000","last_became_active":"2023-07-21T22:39:03.038928+0000","last_became_peered":"2023-07-21T22:39:03.038928+0000","last_unstale":"2023-07-21T22:39:03.041874+0000","last_undegraded":"2023-07-21T22:39:03.041874+0000","last_fullsized":"2023-07-21T22:39:03.041874+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:48:20.047417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033719+0000","last_change":"2023-07-21T22:39:03.033719+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033719+0000","last_undegraded":"2023-07-21T22:39:03.033719+0000","last_fullsized":"2023-07-21T22:39:03.033719+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.049373+0000","last_change":"2023-07-21T22:39:03.040678+0000","last_active":"2023-07-21T22:39:03.049373+0000","last_peered":"2023-07-21T22:39:03.049373+0000","last_clean":"2023-07-21T22:39:03.049373+0000","last_became_active":"2023-07-21T22:39:03.040326+0000","last_became_peered":"2023-07-21T22:39:03.040326+0000","last_unstale":"2023-07-21T22:39:03.049373+0000","last_undegraded":"2023-07-21T22:39:03.049373+0000","last_fullsized":"2023-07-21T22:39:03.049373+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:25:50.691637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032262+0000","last_change":"2023-07-21T22:39:03.032262+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032262+0000","last_undegraded":"2023-07-21T22:39:03.032262+0000","last_fullsized":"2023-07-21T22:39:03.032262+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.045930+0000","last_change":"2023-07-21T22:39:03.044385+0000","last_active":"2023-07-21T22:39:03.045930+0000","last_peered":"2023-07-21T22:39:03.045930+0000","last_clean":"2023-07-21T22:39:03.045930+0000","last_became_active":"2023-07-21T22:39:03.044051+0000","last_became_peered":"2023-07-21T22:39:03.044051+0000","last_unstale":"2023-07-21T22:39:03.045930+0000","last_undegraded":"2023-07-21T22:39:03.045930+0000","last_fullsized":"2023-07-21T22:39:03.045930+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:40:22.537231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.030951+0000","last_change":"2023-07-21T22:39:03.030951+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.030951+0000","last_undegraded":"2023-07-21T22:39:03.030951+0000","last_fullsized":"2023-07-21T22:39:03.030951+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.045614+0000","last_change":"2023-07-21T22:39:03.043464+0000","last_active":"2023-07-21T22:39:03.045614+0000","last_peered":"2023-07-21T22:39:03.045614+0000","last_clean":"2023-07-21T22:39:03.045614+0000","last_became_active":"2023-07-21T22:39:03.043147+0000","last_became_peered":"2023-07-21T22:39:03.043147+0000","last_unstale":"2023-07-21T22:39:03.045614+0000","last_undegraded":"2023-07-21T22:39:03.045614+0000","last_fullsized":"2023-07-21T22:39:03.045614+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:56.767831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.030440+0000","last_change":"2023-07-21T22:39:03.030440+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.030440+0000","last_undegraded":"2023-07-21T22:39:03.030440+0000","last_fullsized":"2023-07-21T22:39:03.030440+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.056237+0000","last_change":"2023-07-21T22:39:03.053112+0000","last_active":"2023-07-21T22:39:03.056237+0000","last_peered":"2023-07-21T22:39:03.056237+0000","last_clean":"2023-07-21T22:39:03.056237+0000","last_became_active":"2023-07-21T22:39:03.052821+0000","last_became_peered":"2023-07-21T22:39:03.052821+0000","last_unstale":"2023-07-21T22:39:03.056237+0000","last_undegraded":"2023-07-21T22:39:03.056237+0000","last_fullsized":"2023-07-21T22:39:03.056237+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:10.156412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035197+0000","last_change":"2023-07-21T22:39:03.035197+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035197+0000","last_undegraded":"2023-07-21T22:39:03.035197+0000","last_fullsized":"2023-07-21T22:39:03.035197+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.046432+0000","last_change":"2023-07-21T22:39:03.042529+0000","last_active":"2023-07-21T22:39:03.046432+0000","last_peered":"2023-07-21T22:39:03.046432+0000","last_clean":"2023-07-21T22:39:03.046432+0000","last_became_active":"2023-07-21T22:39:03.042254+0000","last_became_peered":"2023-07-21T22:39:03.042254+0000","last_unstale":"2023-07-21T22:39:03.046432+0000","last_undegraded":"2023-07-21T22:39:03.046432+0000","last_fullsized":"2023-07-21T22:39:03.046432+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:52.040683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.029169+0000","last_change":"2023-07-21T22:39:03.029169+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.029169+0000","last_undegraded":"2023-07-21T22:39:03.029169+0000","last_fullsized":"2023-07-21T22:39:03.029169+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.048201+0000","last_change":"2023-07-21T22:39:03.045034+0000","last_active":"2023-07-21T22:39:03.048201+0000","last_peered":"2023-07-21T22:39:03.048201+0000","last_clean":"2023-07-21T22:39:03.048201+0000","last_became_active":"2023-07-21T22:39:03.044569+0000","last_became_peered":"2023-07-21T22:39:03.044569+0000","last_unstale":"2023-07-21T22:39:03.048201+0000","last_undegraded":"2023-07-21T22:39:03.048201+0000","last_fullsized":"2023-07-21T22:39:03.048201+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:24:01.085248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035264+0000","last_change":"2023-07-21T22:39:03.035264+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035264+0000","last_undegraded":"2023-07-21T22:39:03.035264+0000","last_fullsized":"2023-07-21T22:39:03.035264+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.045813+0000","last_change":"2023-07-21T22:39:03.043363+0000","last_active":"2023-07-21T22:39:03.045813+0000","last_peered":"2023-07-21T22:39:03.045813+0000","last_clean":"2023-07-21T22:39:03.045813+0000","last_became_active":"2023-07-21T22:39:03.043036+0000","last_became_peered":"2023-07-21T22:39:03.043036+0000","last_unstale":"2023-07-21T22:39:03.045813+0000","last_undegraded":"2023-07-21T22:39:03.045813+0000","last_fullsized":"2023-07-21T22:39:03.045813+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:38:21.996057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.045397+0000","last_change":"2023-07-21T22:39:03.045397+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.045397+0000","last_undegraded":"2023-07-21T22:39:03.045397+0000","last_fullsized":"2023-07-21T22:39:03.045397+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.045916+0000","last_change":"2023-07-21T22:39:03.044365+0000","last_active":"2023-07-21T22:39:03.045916+0000","last_peered":"2023-07-21T22:39:03.045916+0000","last_clean":"2023-07-21T22:39:03.045916+0000","last_became_active":"2023-07-21T22:39:03.044104+0000","last_became_peered":"2023-07-21T22:39:03.044104+0000","last_unstale":"2023-07-21T22:39:03.045916+0000","last_undegraded":"2023-07-21T22:39:03.045916+0000","last_fullsized":"2023-07-21T22:39:03.045916+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:55:34.402372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033267+0000","last_change":"2023-07-21T22:39:03.033267+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033267+0000","last_undegraded":"2023-07-21T22:39:03.033267+0000","last_fullsized":"2023-07-21T22:39:03.033267+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.047438+0000","last_change":"2023-07-21T22:39:03.044807+0000","last_active":"2023-07-21T22:39:03.047438+0000","last_peered":"2023-07-21T22:39:03.047438+0000","last_clean":"2023-07-21T22:39:03.047438+0000","last_became_active":"2023-07-21T22:39:03.044482+0000","last_became_peered":"2023-07-21T22:39:03.044482+0000","last_unstale":"2023-07-21T22:39:03.047438+0000","last_undegraded":"2023-07-21T22:39:03.047438+0000","last_fullsized":"2023-07-21T22:39:03.047438+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:31:44.130740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.027521+0000","last_change":"2023-07-21T22:39:03.027521+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.027521+0000","last_undegraded":"2023-07-21T22:39:03.027521+0000","last_fullsized":"2023-07-21T22:39:03.027521+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.045761+0000","last_change":"2023-07-21T22:39:03.043971+0000","last_active":"2023-07-21T22:39:03.045761+0000","last_peered":"2023-07-21T22:39:03.045761+0000","last_clean":"2023-07-21T22:39:03.045761+0000","last_became_active":"2023-07-21T22:39:03.043698+0000","last_became_peered":"2023-07-21T22:39:03.043698+0000","last_unstale":"2023-07-21T22:39:03.045761+0000","last_undegraded":"2023-07-21T22:39:03.045761+0000","last_fullsized":"2023-07-21T22:39:03.045761+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:33:33.644414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.029054+0000","last_change":"2023-07-21T22:39:03.029054+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.029054+0000","last_undegraded":"2023-07-21T22:39:03.029054+0000","last_fullsized":"2023-07-21T22:39:03.029054+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.056204+0000","last_change":"2023-07-21T22:39:03.052780+0000","last_active":"2023-07-21T22:39:03.056204+0000","last_peered":"2023-07-21T22:39:03.056204+0000","last_clean":"2023-07-21T22:39:03.056204+0000","last_became_active":"2023-07-21T22:39:03.052324+0000","last_became_peered":"2023-07-21T22:39:03.052324+0000","last_unstale":"2023-07-21T22:39:03.056204+0000","last_undegraded":"2023-07-21T22:39:03.056204+0000","last_fullsized":"2023-07-21T22:39:03.056204+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:42:19.254396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.027536+0000","last_change":"2023-07-21T22:39:03.027536+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.027536+0000","last_undegraded":"2023-07-21T22:39:03.027536+0000","last_fullsized":"2023-07-21T22:39:03.027536+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.051018+0000","last_change":"2023-07-21T22:39:03.049975+0000","last_active":"2023-07-21T22:39:03.051018+0000","last_peered":"2023-07-21T22:39:03.051018+0000","last_clean":"2023-07-21T22:39:03.051018+0000","last_became_active":"2023-07-21T22:39:03.049641+0000","last_became_peered":"2023-07-21T22:39:03.049641+0000","last_unstale":"2023-07-21T22:39:03.051018+0000","last_undegraded":"2023-07-21T22:39:03.051018+0000","last_fullsized":"2023-07-21T22:39:03.051018+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:47:53.393380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.038663+0000","last_change":"2023-07-21T22:39:03.038663+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.038663+0000","last_undegraded":"2023-07-21T22:39:03.038663+0000","last_fullsized":"2023-07-21T22:39:03.038663+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.047406+0000","last_change":"2023-07-21T22:39:03.039410+0000","last_active":"2023-07-21T22:39:03.047406+0000","last_peered":"2023-07-21T22:39:03.047406+0000","last_clean":"2023-07-21T22:39:03.047406+0000","last_became_active":"2023-07-21T22:39:03.039134+0000","last_became_peered":"2023-07-21T22:39:03.039134+0000","last_unstale":"2023-07-21T22:39:03.047406+0000","last_undegraded":"2023-07-21T22:39:03.047406+0000","last_fullsized":"2023-07-21T22:39:03.047406+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:04:32.243820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035845+0000","last_change":"2023-07-21T22:39:03.035845+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035845+0000","last_undegraded":"2023-07-21T22:39:03.035845+0000","last_fullsized":"2023-07-21T22:39:03.035845+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.056252+0000","last_change":"2023-07-21T22:39:03.053328+0000","last_active":"2023-07-21T22:39:03.056252+0000","last_peered":"2023-07-21T22:39:03.056252+0000","last_clean":"2023-07-21T22:39:03.056252+0000","last_became_active":"2023-07-21T22:39:03.052955+0000","last_became_peered":"2023-07-21T22:39:03.052955+0000","last_unstale":"2023-07-21T22:39:03.056252+0000","last_undegraded":"2023-07-21T22:39:03.056252+0000","last_fullsized":"2023-07-21T22:39:03.056252+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:36:43.080644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"145'271","reported_seq":949,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.038366+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:39:03.038366+0000","last_peered":"2023-07-21T22:39:03.038366+0000","last_clean":"2023-07-21T22:39:03.038366+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:39:03.038366+0000","last_undegraded":"2023-07-21T22:39:03.038366+0000","last_fullsized":"2023-07-21T22:39:03.038366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:19:57.210171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":276,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.034179+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:39:03.034179+0000","last_peered":"2023-07-21T22:39:03.034179+0000","last_clean":"2023-07-21T22:39:03.034179+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:39:03.034179+0000","last_undegraded":"2023-07-21T22:39:03.034179+0000","last_fullsized":"2023-07-21T22:39:03.034179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:32:45.245980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.043333+0000","last_change":"2023-07-21T22:39:03.043333+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.043333+0000","last_undegraded":"2023-07-21T22:39:03.043333+0000","last_fullsized":"2023-07-21T22:39:03.043333+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.051247+0000","last_change":"2023-07-21T22:39:03.045628+0000","last_active":"2023-07-21T22:39:03.051247+0000","last_peered":"2023-07-21T22:39:03.051247+0000","last_clean":"2023-07-21T22:39:03.051247+0000","last_became_active":"2023-07-21T22:39:03.044601+0000","last_became_peered":"2023-07-21T22:39:03.044601+0000","last_unstale":"2023-07-21T22:39:03.051247+0000","last_undegraded":"2023-07-21T22:39:03.051247+0000","last_fullsized":"2023-07-21T22:39:03.051247+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:02:30.920665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":247,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.038231+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:39:03.038231+0000","last_peered":"2023-07-21T22:39:03.038231+0000","last_clean":"2023-07-21T22:39:03.038231+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:39:03.038231+0000","last_undegraded":"2023-07-21T22:39:03.038231+0000","last_fullsized":"2023-07-21T22:39:03.038231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:51:43.481525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033051+0000","last_change":"2023-07-21T22:39:03.033051+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033051+0000","last_undegraded":"2023-07-21T22:39:03.033051+0000","last_fullsized":"2023-07-21T22:39:03.033051+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.048052+0000","last_change":"2023-07-21T22:39:03.046544+0000","last_active":"2023-07-21T22:39:03.048052+0000","last_peered":"2023-07-21T22:39:03.048052+0000","last_clean":"2023-07-21T22:39:03.048052+0000","last_became_active":"2023-07-21T22:39:03.046251+0000","last_became_peered":"2023-07-21T22:39:03.046251+0000","last_unstale":"2023-07-21T22:39:03.048052+0000","last_undegraded":"2023-07-21T22:39:03.048052+0000","last_fullsized":"2023-07-21T22:39:03.048052+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:25:00.614842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":248,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.034354+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:39:03.034354+0000","last_peered":"2023-07-21T22:39:03.034354+0000","last_clean":"2023-07-21T22:39:03.034354+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:39:03.034354+0000","last_undegraded":"2023-07-21T22:39:03.034354+0000","last_fullsized":"2023-07-21T22:39:03.034354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:26.401604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032057+0000","last_change":"2023-07-21T22:39:03.032057+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032057+0000","last_undegraded":"2023-07-21T22:39:03.032057+0000","last_fullsized":"2023-07-21T22:39:03.032057+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.047977+0000","last_change":"2023-07-21T22:39:03.044488+0000","last_active":"2023-07-21T22:39:03.047977+0000","last_peered":"2023-07-21T22:39:03.047977+0000","last_clean":"2023-07-21T22:39:03.047977+0000","last_became_active":"2023-07-21T22:39:03.044193+0000","last_became_peered":"2023-07-21T22:39:03.044193+0000","last_unstale":"2023-07-21T22:39:03.047977+0000","last_undegraded":"2023-07-21T22:39:03.047977+0000","last_fullsized":"2023-07-21T22:39:03.047977+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:06:43.937701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":276,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.034839+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:39:03.034839+0000","last_peered":"2023-07-21T22:39:03.034839+0000","last_clean":"2023-07-21T22:39:03.034839+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:39:03.034839+0000","last_undegraded":"2023-07-21T22:39:03.034839+0000","last_fullsized":"2023-07-21T22:39:03.034839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:55:25.947163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035385+0000","last_change":"2023-07-21T22:39:03.035385+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035385+0000","last_undegraded":"2023-07-21T22:39:03.035385+0000","last_fullsized":"2023-07-21T22:39:03.035385+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.052388+0000","last_change":"2023-07-21T22:39:03.050012+0000","last_active":"2023-07-21T22:39:03.052388+0000","last_peered":"2023-07-21T22:39:03.052388+0000","last_clean":"2023-07-21T22:39:03.052388+0000","last_became_active":"2023-07-21T22:39:03.049736+0000","last_became_peered":"2023-07-21T22:39:03.049736+0000","last_unstale":"2023-07-21T22:39:03.052388+0000","last_undegraded":"2023-07-21T22:39:03.052388+0000","last_fullsized":"2023-07-21T22:39:03.052388+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:19.696421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":260,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.025080+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:39:03.025080+0000","last_peered":"2023-07-21T22:39:03.025080+0000","last_clean":"2023-07-21T22:39:03.025080+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:39:03.025080+0000","last_undegraded":"2023-07-21T22:39:03.025080+0000","last_fullsized":"2023-07-21T22:39:03.025080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:48:23.151070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035875+0000","last_change":"2023-07-21T22:39:03.035875+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035875+0000","last_undegraded":"2023-07-21T22:39:03.035875+0000","last_fullsized":"2023-07-21T22:39:03.035875+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.056302+0000","last_change":"2023-07-21T22:39:03.053828+0000","last_active":"2023-07-21T22:39:03.056302+0000","last_peered":"2023-07-21T22:39:03.056302+0000","last_clean":"2023-07-21T22:39:03.056302+0000","last_became_active":"2023-07-21T22:39:03.053526+0000","last_became_peered":"2023-07-21T22:39:03.053526+0000","last_unstale":"2023-07-21T22:39:03.056302+0000","last_undegraded":"2023-07-21T22:39:03.056302+0000","last_fullsized":"2023-07-21T22:39:03.056302+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:01:46.815106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":246,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.039659+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:39:03.039659+0000","last_peered":"2023-07-21T22:39:03.039659+0000","last_clean":"2023-07-21T22:39:03.039659+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:39:03.039659+0000","last_undegraded":"2023-07-21T22:39:03.039659+0000","last_fullsized":"2023-07-21T22:39:03.039659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:04:04.247394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.029967+0000","last_change":"2023-07-21T22:39:03.029967+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.029967+0000","last_undegraded":"2023-07-21T22:39:03.029967+0000","last_fullsized":"2023-07-21T22:39:03.029967+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.046346+0000","last_change":"2023-07-21T22:39:03.042778+0000","last_active":"2023-07-21T22:39:03.046346+0000","last_peered":"2023-07-21T22:39:03.046346+0000","last_clean":"2023-07-21T22:39:03.046346+0000","last_became_active":"2023-07-21T22:39:03.042441+0000","last_became_peered":"2023-07-21T22:39:03.042441+0000","last_unstale":"2023-07-21T22:39:03.046346+0000","last_undegraded":"2023-07-21T22:39:03.046346+0000","last_fullsized":"2023-07-21T22:39:03.046346+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:01:29.405460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":260,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.024412+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:39:03.024412+0000","last_peered":"2023-07-21T22:39:03.024412+0000","last_clean":"2023-07-21T22:39:03.024412+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:39:03.024412+0000","last_undegraded":"2023-07-21T22:39:03.024412+0000","last_fullsized":"2023-07-21T22:39:03.024412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:51:30.283493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.029529+0000","last_change":"2023-07-21T22:39:03.029529+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.029529+0000","last_undegraded":"2023-07-21T22:39:03.029529+0000","last_fullsized":"2023-07-21T22:39:03.029529+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.048225+0000","last_change":"2023-07-21T22:39:03.045134+0000","last_active":"2023-07-21T22:39:03.048225+0000","last_peered":"2023-07-21T22:39:03.048225+0000","last_clean":"2023-07-21T22:39:03.048225+0000","last_became_active":"2023-07-21T22:39:03.044863+0000","last_became_peered":"2023-07-21T22:39:03.044863+0000","last_unstale":"2023-07-21T22:39:03.048225+0000","last_undegraded":"2023-07-21T22:39:03.048225+0000","last_fullsized":"2023-07-21T22:39:03.048225+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:04:09.984484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":242,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.044313+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:39:03.044313+0000","last_peered":"2023-07-21T22:39:03.044313+0000","last_clean":"2023-07-21T22:39:03.044313+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:39:03.044313+0000","last_undegraded":"2023-07-21T22:39:03.044313+0000","last_fullsized":"2023-07-21T22:39:03.044313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:36:27.715879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509682,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59744,"kb_used_data":2456,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312096,"statfs":{"total":96636764160,"available":96575586304,"internally_reserved":0,"allocated":2514944,"data_stored":1564775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69099999999999995,"15min":0.73199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35299999999999998},"max":{"1min":0.876,"5min":1.1180000000000001,"15min":3.5059999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66400000000000003,"15min":0.69399999999999995},"min":{"1min":0.46200000000000002,"5min":0.40899999999999997,"15min":0.39500000000000002},"max":{"1min":0.94199999999999995,"5min":0.94399999999999995,"15min":3.2709999999999999},"last":0.626}]},{"osd":1,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.70599999999999996,"15min":0.72799999999999998},"min":{"1min":0.49199999999999999,"5min":0.44900000000000001,"15min":0.432},"max":{"1min":0.98599999999999999,"5min":1.0680000000000001,"15min":1.5429999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.71299999999999997},"min":{"1min":0.44800000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96499999999999997,"5min":1.093,"15min":1.093},"last":0.71599999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70899999999999996,"15min":0.73599999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":1.1399999999999999,"15min":1.405},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73199999999999998,"15min":0.746},"min":{"1min":0.55100000000000005,"5min":0.47999999999999998,"15min":0.45800000000000002},"max":{"1min":0.92800000000000005,"5min":1.083,"15min":1.409},"last":0.66100000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75900000000000001,"15min":0.76500000000000001},"min":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0209999999999999,"5min":1.1539999999999999,"15min":1.46},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.48599999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94899999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.67700000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55700000000000005,"15min":0.56200000000000006},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.67500000000000004,"5min":0.90000000000000002,"15min":0.94999999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82299999999999995,"5min":0.97399999999999998,"15min":1.7949999999999999},"last":0.501}]},{"osd":5,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.89700000000000002,"5min":0.98799999999999999,"15min":2.2120000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70199999999999996,"15min":0.68100000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.38300000000000001},"max":{"1min":0.95199999999999996,"5min":1.052,"15min":1.506},"last":0.69499999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.68100000000000005},"min":{"1min":0.53700000000000003,"5min":0.44900000000000001,"15min":0.41999999999999998},"max":{"1min":0.93500000000000005,"5min":1.0329999999999999,"15min":1.048},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.42699999999999999},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.58399999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542388,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37008,"kb_used_data":1864,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334832,"statfs":{"total":96636764160,"available":96598867968,"internally_reserved":0,"allocated":1908736,"data_stored":967715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.755},"min":{"1min":0.47099999999999997,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.94399999999999995,"5min":1.016,"15min":1.016},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.437},"max":{"1min":0.96799999999999997,"5min":1.0289999999999999,"15min":1.1180000000000001},"last":0.90200000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.70099999999999996,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.49099999999999999,"15min":0.45300000000000001},"max":{"1min":0.872,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.45800000000000002,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.93300000000000005,"5min":0.99199999999999999,"15min":1.117},"last":0.82899999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71099999999999997,"15min":0.74199999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.42799999999999999},"max":{"1min":0.89600000000000002,"5min":0.98099999999999998,"15min":0.997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.78700000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.45500000000000002},"max":{"1min":0.98199999999999998,"5min":1.0149999999999999,"15min":1.097},"last":0.88700000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71999999999999997,"15min":0.748},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":1.048,"15min":1.048},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70499999999999996,"15min":0.72899999999999998},"min":{"1min":0.52300000000000002,"5min":0.49399999999999999,"15min":0.46899999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0049999999999999},"last":0.76300000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.93400000000000005,"15min":1.0229999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.39700000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.95599999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.054},"last":0.92200000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70299999999999996,"15min":0.68100000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.443},"max":{"1min":1.024,"5min":1.024,"15min":1.079},"last":0.995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.86899999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509681,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50960,"kb_used_data":1864,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320880,"statfs":{"total":96636764160,"available":96584581120,"internally_reserved":0,"allocated":1908736,"data_stored":967715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.70999999999999996},"min":{"1min":0.48099999999999998,"5min":0.38500000000000001,"15min":0.35699999999999998},"max":{"1min":0.96499999999999997,"5min":1,"15min":1.8779999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.97999999999999998,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.68600000000000005,"15min":0.70299999999999996},"min":{"1min":0.505,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.95899999999999996,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69099999999999995,"15min":0.72099999999999997},"min":{"1min":0.42699999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.617},"last":0.68400000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71099999999999997,"15min":0.72699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.33600000000000002},"max":{"1min":1.008,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.42199999999999999,"15min":0.377},"max":{"1min":0.89300000000000002,"5min":1.073,"15min":1.512},"last":0.73399999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76900000000000002,"15min":0.77800000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":1.0009999999999999,"15min":1.472},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76000000000000001,"15min":0.78700000000000003},"min":{"1min":0.60099999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.997,"5min":1.022,"15min":1.556},"last":0.66000000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.372,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83699999999999997,"5min":0.88900000000000001,"15min":0.96999999999999997},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72399999999999998,"15min":0.69599999999999995},"min":{"1min":0.58899999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.92300000000000004,"5min":0.92400000000000004,"15min":1.038},"last":0.754}]},{"osd":6,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":0.95499999999999996,"15min":1.0049999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.40200000000000002,"15min":0.40000000000000002},"max":{"1min":0.76600000000000001,"5min":0.93799999999999994,"15min":1.02},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70099999999999996,"15min":0.65700000000000003},"min":{"1min":0.46200000000000002,"5min":0.40999999999999998,"15min":0.374},"max":{"1min":0.96699999999999997,"5min":1.042,"15min":1.042},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":0.73099999999999998},"min":{"1min":0.59799999999999998,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.88300000000000001,"5min":0.999,"15min":1.7390000000000001},"last":0.78300000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509682,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1876,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1921024,"data_stored":974407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68300000000000005,"15min":0.72999999999999998},"min":{"1min":0.48599999999999999,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":0.93600000000000005,"5min":1.077,"15min":1.077},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68899999999999995,"15min":0.72999999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89800000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.66900000000000004,"15min":0.69699999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92200000000000004,"5min":1.044,"15min":1.044},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65600000000000003,"15min":0.69499999999999995},"min":{"1min":0.53100000000000003,"5min":0.43099999999999999,"15min":0.36899999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.96399999999999997},"last":0.754}]},{"osd":2,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.70499999999999996,"15min":0.746},"min":{"1min":0.441,"5min":0.441,"15min":0.371},"max":{"1min":0.88500000000000001,"5min":1.052,"15min":1.052},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71499999999999997,"15min":0.75700000000000001},"min":{"1min":0.501,"5min":0.47699999999999998,"15min":0.33000000000000002},"max":{"1min":0.89300000000000002,"5min":1.018,"15min":1.0660000000000001},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68000000000000005,"15min":0.72199999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.40100000000000002},"max":{"1min":0.90000000000000002,"5min":0.94599999999999995,"15min":1.0169999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.77500000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47999999999999998},"max":{"1min":0.94899999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.86199999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61099999999999999,"15min":0.58399999999999996},"min":{"1min":0.44400000000000001,"5min":0.35799999999999998,"15min":0.34399999999999997},"max":{"1min":0.86399999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.42799999999999999,"5min":0.42699999999999999,"15min":0.32800000000000001},"max":{"1min":0.82299999999999995,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.439,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.90900000000000003,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72299999999999998,"15min":0.71599999999999997},"min":{"1min":0.48499999999999999,"5min":0.443,"15min":0.41599999999999998},"max":{"1min":0.96299999999999997,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.39200000000000002},"max":{"1min":0.93999999999999995,"5min":1.028,"15min":1.028},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.47199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97099999999999997,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.89700000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509681,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1876,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1921024,"data_stored":974407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46899999999999997,"15min":0.47499999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":0.77800000000000002,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.45100000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46200000000000002,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60299999999999998,"5min":0.754,"15min":0.83499999999999996},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.41999999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71899999999999997,"5min":0.82599999999999996,"15min":0.90100000000000002},"last":0.41999999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67600000000000005,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.374},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.59599999999999997},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.99199999999999999},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.755,"15min":0.77000000000000002},"min":{"1min":0.57599999999999996,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91200000000000003,"5min":1.093,"15min":1.1279999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.81399999999999995},"min":{"1min":0.54500000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.93200000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.84399999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.76900000000000002},"min":{"1min":0.54900000000000004,"5min":0.501,"15min":0.48999999999999999},"max":{"1min":0.97799999999999998,"5min":1.0669999999999999,"15min":1.137},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.51300000000000001,"15min":0.42899999999999999},"max":{"1min":0.86399999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.82699999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76900000000000002,"15min":0.79000000000000004},"min":{"1min":0.51900000000000002,"5min":0.51700000000000002,"15min":0.47399999999999998},"max":{"1min":0.91700000000000004,"5min":1.0680000000000001,"15min":1.169},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91300000000000003,"5min":1.107,"15min":1.1120000000000001},"last":0.88200000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79200000000000004,"15min":0.81299999999999994},"min":{"1min":0.621,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94299999999999995,"5min":1.083,"15min":1.099},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80900000000000005,"15min":0.82799999999999996},"min":{"1min":0.61299999999999999,"5min":0.55200000000000005,"15min":0.48599999999999999},"max":{"1min":0.92200000000000004,"5min":1.623,"15min":1.623},"last":0.90100000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509683,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55068,"kb_used_data":1876,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316772,"statfs":{"total":96636764160,"available":96580374528,"internally_reserved":0,"allocated":1921024,"data_stored":974407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.46400000000000002},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.23899999999999999},"max":{"1min":0.624,"5min":0.75,"15min":0.94199999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50600000000000001,"15min":0.54100000000000004},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.308},"max":{"1min":0.64200000000000002,"5min":0.88300000000000001,"15min":1.0409999999999999},"last":0.44700000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.40699999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72599999999999998,"5min":0.86699999999999999,"15min":0.93999999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.012,"15min":1.085},"last":0.52700000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46300000000000002,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.623,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.56399999999999995},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.85299999999999998,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.46600000000000003,"15min":0.376},"max":{"1min":1.016,"5min":1.1579999999999999,"15min":1.3420000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73599999999999999,"15min":0.78500000000000003},"min":{"1min":0.48899999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.996,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0780000000000001,"5min":1.214,"15min":1.214},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77700000000000002,"15min":0.80600000000000005},"min":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.46400000000000002},"max":{"1min":1.012,"5min":1.2689999999999999,"15min":1.3089999999999999},"last":0.73799999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.746,"15min":0.78300000000000003},"min":{"1min":0.52800000000000002,"5min":0.499,"15min":0.40300000000000002},"max":{"1min":0.94399999999999995,"5min":1.536,"15min":1.536},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.46200000000000002},"max":{"1min":1.0289999999999999,"5min":1.1339999999999999,"15min":1.2649999999999999},"last":0.79200000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77500000000000002,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.008,"5min":1.143,"15min":1.214},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.751,"15min":0.79700000000000004},"min":{"1min":0.58899999999999997,"5min":0.50900000000000001,"15min":0.44700000000000001},"max":{"1min":0.91200000000000003,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.72599999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509682,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1876,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1921024,"data_stored":974407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.47499999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.22900000000000001},"max":{"1min":0.60399999999999998,"5min":0.78700000000000003,"15min":0.84599999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54100000000000004,"15min":0.55900000000000005},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.35099999999999998},"max":{"1min":0.80900000000000005,"5min":0.82499999999999996,"15min":0.872},"last":0.57599999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48999999999999999,"15min":0.502},"min":{"1min":0.36199999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"max":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":0.81000000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.29099999999999998},"max":{"1min":0.71899999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.42299999999999999,"5min":0.378,"15min":0.33400000000000002},"max":{"1min":0.76100000000000001,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":0.77600000000000002,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.371}]},{"osd":4,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.432},"max":{"1min":1.115,"5min":1.294,"15min":1.294},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77800000000000002,"15min":0.79000000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.498},"max":{"1min":1.1220000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.753,"15min":0.77200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.41899999999999998},"max":{"1min":1.0980000000000001,"5min":1.242,"15min":1.242},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.55700000000000005,"5min":0.51500000000000001,"15min":0.376},"max":{"1min":1.1639999999999999,"5min":1.276,"15min":1.2849999999999999},"last":0.77300000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77700000000000002,"15min":0.80000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.47899999999999998},"max":{"1min":1.0800000000000001,"5min":1.208,"15min":1.23},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.78100000000000003},"min":{"1min":0.56100000000000005,"5min":0.50900000000000001,"15min":0.46500000000000002},"max":{"1min":1.0109999999999999,"5min":1.244,"15min":1.3240000000000001},"last":0.66500000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78500000000000003,"15min":0.80400000000000005},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.49199999999999999},"max":{"1min":1.089,"5min":1.3120000000000001,"15min":1.3149999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.45700000000000002},"max":{"1min":1.0289999999999999,"5min":1.1819999999999999,"15min":1.3380000000000001},"last":0.86399999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509684,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37600,"kb_used_data":2456,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334240,"statfs":{"total":96636764160,"available":96598261760,"internally_reserved":0,"allocated":2514944,"data_stored":1564775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.33200000000000002,"5min":0.28399999999999997,"15min":0.26600000000000001},"max":{"1min":0.66300000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.495},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50900000000000001,"15min":0.51600000000000001},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.70599999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.36599999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.41599999999999998,"5min":0.32400000000000001,"15min":0.29799999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.3680000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.49099999999999999,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.871},"last":0.438}]},{"osd":3,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.432,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81899999999999995,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.33700000000000002},"max":{"1min":0.83599999999999997,"5min":0.88600000000000001,"15min":1.038},"last":0.60499999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.81000000000000005,"15min":0.78400000000000003},"min":{"1min":0.56899999999999995,"5min":0.499,"15min":0.45200000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.80500000000000005,"15min":0.80000000000000004},"min":{"1min":0.57899999999999996,"5min":0.505,"15min":0.44600000000000001},"max":{"1min":1.206,"5min":1.278,"15min":1.423},"last":0.79400000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.59599999999999997,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.0089999999999999,"5min":1.0960000000000001,"15min":1.2669999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80500000000000005,"15min":0.80300000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.39600000000000002},"max":{"1min":1.119,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.48899999999999999},"max":{"1min":1.2210000000000001,"5min":1.27,"15min":1.27},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.65500000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.90500000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80700000000000005,"15min":0.79500000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.53100000000000003},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80200000000000005,"15min":0.82199999999999995},"min":{"1min":0.58999999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1479999999999999,"5min":1.1930000000000001,"15min":1.296},"last":0.97699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:39:08.206 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:39:08.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c46697640 1 Processor -- start 2023-07-21T22:39:08.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c46697640 1 -- start start 2023-07-21T22:39:08.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c46697640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c400b42c0 0x7f8c4006a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c46697640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8c400cee90 0x7f8c400d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:08.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c46697640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c400cf310 con 0x7f8c400b7a10 2023-07-21T22:39:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c46697640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c400cff30 con 0x7f8c400cee90 2023-07-21T22:39:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c46697640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c400ccee0 con 0x7f8c400b42c0 2023-07-21T22:39:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c45695640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8c400b7a10 0x7f8c400b3bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37300/0 (socket says 172.21.15.6:37300) 2023-07-21T22:39:08.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c45695640 1 -- 172.21.15.6:0/1716469805 learned_addr learned my addr 172.21.15.6:0/1716469805 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:39:08.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c44e94640 1 --2- 172.21.15.6:0/1716469805 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c400b42c0 0x7f8c4006a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:08.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c37fff640 1 -- 172.21.15.6:0/1716469805 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571033252 0 0) 0x7f8c400cf310 con 0x7f8c400b7a10 2023-07-21T22:39:08.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c37fff640 1 -- 172.21.15.6:0/1716469805 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c2c003530 con 0x7f8c400b7a10 2023-07-21T22:39:08.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c45e96640 1 --2- 172.21.15.6:0/1716469805 >> v2:172.21.15.161:3300/0 conn(0x7f8c400cee90 0x7f8c400d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:08.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c37fff640 1 -- 172.21.15.6:0/1716469805 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1325752319 0 0) 0x7f8c2c003530 con 0x7f8c400b7a10 2023-07-21T22:39:08.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c37fff640 1 -- 172.21.15.6:0/1716469805 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c400b42c0 msgr2=0x7f8c4006a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:08.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c37fff640 1 --2- 172.21.15.6:0/1716469805 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c400b42c0 0x7f8c4006a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c37fff640 1 -- 172.21.15.6:0/1716469805 >> v2:172.21.15.161:3300/0 conn(0x7f8c400cee90 msgr2=0x7f8c400d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:08.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c37fff640 1 --2- 172.21.15.6:0/1716469805 >> v2:172.21.15.161:3300/0 conn(0x7f8c400cee90 0x7f8c400d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c37fff640 1 -- 172.21.15.6:0/1716469805 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c400cc920 con 0x7f8c400b7a10 2023-07-21T22:39:08.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c37fff640 1 -- 172.21.15.6:0/1716469805 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f8c3c001680 con 0x7f8c400b7a10 2023-07-21T22:39:08.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c37fff640 1 -- 172.21.15.6:0/1716469805 >> v1:172.21.15.6:6789/0 conn(0x7f8c400b7a10 legacy=0x7f8c400b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:08.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c37fff640 1 --2- 172.21.15.6:0/1716469805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c2c003980 0x7f8c2c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:08.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c37fff640 1 --2- 172.21.15.6:0/1716469805 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c400b42c0 0x7f8c2c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:08.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c37fff640 1 --2- 172.21.15.6:0/1716469805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c2c004d10 0x7f8c2c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:08.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c37fff640 1 -- 172.21.15.6:0/1716469805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c400ccee0 con 0x7f8c2c003980 2023-07-21T22:39:08.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c37fff640 1 -- 172.21.15.6:0/1716469805 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c00b990 con 0x7f8c2c004d10 2023-07-21T22:39:08.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c37fff640 1 -- 172.21.15.6:0/1716469805 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c00bad0 con 0x7f8c400b42c0 2023-07-21T22:39:08.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c45695640 1 --2- 172.21.15.6:0/1716469805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c2c003980 0x7f8c2c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:08.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c44e94640 1 --2- 172.21.15.6:0/1716469805 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c400b42c0 0x7f8c2c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:08.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c45e96640 1 --2- 172.21.15.6:0/1716469805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c2c004d10 0x7f8c2c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:08.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c45695640 1 -- 172.21.15.6:0/1716469805 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c400b42c0 msgr2=0x7f8c2c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:08.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c45695640 1 --2- 172.21.15.6:0/1716469805 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c400b42c0 0x7f8c2c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c45695640 1 -- 172.21.15.6:0/1716469805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c2c004d10 msgr2=0x7f8c2c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:08.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c45695640 1 --2- 172.21.15.6:0/1716469805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c2c004d10 0x7f8c2c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c45695640 1 -- 172.21.15.6:0/1716469805 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c003530 con 0x7f8c2c003980 2023-07-21T22:39:08.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c44e94640 1 --2- 172.21.15.6:0/1716469805 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c400b42c0 0x7f8c2c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:08.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.344+0000 7f8c45e96640 1 --2- 172.21.15.6:0/1716469805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c2c004d10 0x7f8c2c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:08.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.348+0000 7f8c45695640 1 --2- 172.21.15.6:0/1716469805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c2c003980 0x7f8c2c003d90 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c00c240 tx=0x7f8c3c01cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e277613d8d484eb6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:08.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.348+0000 7f8c37fff640 1 -- 172.21.15.6:0/1716469805 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c0058e0 con 0x7f8c2c003980 2023-07-21T22:39:08.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.348+0000 7f8c37fff640 1 -- 172.21.15.6:0/1716469805 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3c005a40 con 0x7f8c2c003980 2023-07-21T22:39:08.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.348+0000 7f8c37fff640 1 -- 172.21.15.6:0/1716469805 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c005e10 con 0x7f8c2c003980 2023-07-21T22:39:08.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.348+0000 7f8c46697640 1 -- 172.21.15.6:0/1716469805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c2c003980 msgr2=0x7f8c2c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:08.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.348+0000 7f8c46697640 1 --2- 172.21.15.6:0/1716469805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c2c003980 0x7f8c2c003d90 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c00c240 tx=0x7f8c3c01cbd0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.348+0000 7f8c45e96640 1 -- 172.21.15.6:0/1716469805 reap_dead start 2023-07-21T22:39:08.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.348+0000 7f8c46697640 1 -- 172.21.15.6:0/1716469805 shutdown_connections 2023-07-21T22:39:08.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.348+0000 7f8c46697640 1 -- 172.21.15.6:0/1716469805 >> 172.21.15.6:0/1716469805 conn(0x7f8c40069ea0 msgr2=0x7f8c4006a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:08.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.348+0000 7f8c46697640 1 -- 172.21.15.6:0/1716469805 shutdown_connections 2023-07-21T22:39:08.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.348+0000 7f8c46697640 1 -- 172.21.15.6:0/1716469805 wait complete. 2023-07-21T22:39:08.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c46697640 1 Processor -- start 2023-07-21T22:39:08.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c46697640 1 -- start start 2023-07-21T22:39:08.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c46697640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c2c003980 0x7f8c401588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:08.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c46697640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c4015eb60 0x7f8c401f7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:08.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c46697640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c401f76d0 0x7f8c401f7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:08.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c46697640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c40158df0 con 0x7f8c4015eb60 2023-07-21T22:39:08.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c46697640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c40159280 con 0x7f8c401f76d0 2023-07-21T22:39:08.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c46697640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c400c83e0 con 0x7f8c2c003980 2023-07-21T22:39:08.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c44e94640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c4015eb60 0x7f8c401f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:08.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c44e94640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c4015eb60 0x7f8c401f7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54432/0 (socket says 172.21.15.6:54432) 2023-07-21T22:39:08.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c44e94640 1 -- 172.21.15.6:0/1146456082 learned_addr learned my addr 172.21.15.6:0/1146456082 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:08.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c45695640 1 --2- 172.21.15.6:0/1146456082 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c2c003980 0x7f8c401588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:08.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c45e96640 1 --2- 172.21.15.6:0/1146456082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c401f76d0 0x7f8c401f7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:08.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c44e94640 1 -- 172.21.15.6:0/1146456082 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c2c003980 msgr2=0x7f8c401588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:08.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c44e94640 1 --2- 172.21.15.6:0/1146456082 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c2c003980 0x7f8c401588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c44e94640 1 -- 172.21.15.6:0/1146456082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c401f76d0 msgr2=0x7f8c401f7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:08.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c44e94640 1 --2- 172.21.15.6:0/1146456082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c401f76d0 0x7f8c401f7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c44e94640 1 -- 172.21.15.6:0/1146456082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c400c86c0 con 0x7f8c4015eb60 2023-07-21T22:39:08.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c45e96640 1 --2- 172.21.15.6:0/1146456082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c401f76d0 0x7f8c401f7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:08.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c44e94640 1 --2- 172.21.15.6:0/1146456082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c4015eb60 0x7f8c401f7190 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f8c300115d0 tx=0x7f8c30011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:08.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c35ffb640 1 -- 172.21.15.6:0/1146456082 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c30004220 con 0x7f8c4015eb60 2023-07-21T22:39:08.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c35ffb640 1 -- 172.21.15.6:0/1146456082 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c30004380 con 0x7f8c4015eb60 2023-07-21T22:39:08.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c35ffb640 1 -- 172.21.15.6:0/1146456082 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000f8f0 con 0x7f8c4015eb60 2023-07-21T22:39:08.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c46697640 1 -- 172.21.15.6:0/1146456082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c400c89a0 con 0x7f8c4015eb60 2023-07-21T22:39:08.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.352+0000 7f8c46697640 1 -- 172.21.15.6:0/1146456082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4015c2c0 con 0x7f8c4015eb60 2023-07-21T22:39:08.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.356+0000 7f8c46697640 1 -- 172.21.15.6:0/1146456082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c400678d0 con 0x7f8c4015eb60 2023-07-21T22:39:08.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.356+0000 7f8c35ffb640 1 -- 172.21.15.6:0/1146456082 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8c3000fa50 con 0x7f8c4015eb60 2023-07-21T22:39:08.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.356+0000 7f8c35ffb640 1 --2- 172.21.15.6:0/1146456082 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f8c240663a0 0x7f8c24068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:08.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.356+0000 7f8c35ffb640 1 -- 172.21.15.6:0/1146456082 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f8c30084390 con 0x7f8c4015eb60 2023-07-21T22:39:08.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.356+0000 7f8c45695640 1 --2- 172.21.15.6:0/1146456082 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f8c240663a0 0x7f8c24068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:08.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.356+0000 7f8c45695640 1 --2- 172.21.15.6:0/1146456082 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f8c240663a0 0x7f8c24068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0aa000 tx=0x7f8c3c001a80 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:08.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.360+0000 7f8c35ffb640 1 -- 172.21.15.6:0/1146456082 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8c30051750 con 0x7f8c4015eb60 2023-07-21T22:39:08.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.512+0000 7f8c46697640 1 -- 172.21.15.6:0/1146456082 --> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8c4006a4f0 con 0x7f8c240663a0 2023-07-21T22:39:08.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.520+0000 7f8c35ffb640 1 -- 172.21.15.6:0/1146456082 <== mgr.7694 v2:172.21.15.161:6832/2692111396 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306370 (secure 0 0 0) 0x7f8c4006a4f0 con 0x7f8c240663a0 2023-07-21T22:39:08.567 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:39:08.569 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:39:08.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.524+0000 7f8c46697640 1 -- 172.21.15.6:0/1146456082 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f8c240663a0 msgr2=0x7f8c24068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:08.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.524+0000 7f8c46697640 1 --2- 172.21.15.6:0/1146456082 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f8c240663a0 0x7f8c24068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0aa000 tx=0x7f8c3c001a80 comp rx=0 tx=0).stop 2023-07-21T22:39:08.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.524+0000 7f8c46697640 1 -- 172.21.15.6:0/1146456082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c4015eb60 msgr2=0x7f8c401f7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:08.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.524+0000 7f8c46697640 1 --2- 172.21.15.6:0/1146456082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c4015eb60 0x7f8c401f7190 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f8c300115d0 tx=0x7f8c30011a90 comp rx=0 tx=0).stop 2023-07-21T22:39:08.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.524+0000 7f8c46697640 1 -- 172.21.15.6:0/1146456082 shutdown_connections 2023-07-21T22:39:08.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.524+0000 7f8c46697640 1 --2- 172.21.15.6:0/1146456082 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f8c240663a0 0x7f8c24068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.524+0000 7f8c46697640 1 --2- 172.21.15.6:0/1146456082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c401f76d0 0x7f8c401f7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.524+0000 7f8c46697640 1 --2- 172.21.15.6:0/1146456082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c4015eb60 0x7f8c401f7190 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.524+0000 7f8c46697640 1 --2- 172.21.15.6:0/1146456082 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c2c003980 0x7f8c401588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.524+0000 7f8c46697640 1 -- 172.21.15.6:0/1146456082 >> 172.21.15.6:0/1146456082 conn(0x7f8c40069ea0 msgr2=0x7f8c400b6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:08.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.524+0000 7f8c46697640 1 -- 172.21.15.6:0/1146456082 shutdown_connections 2023-07-21T22:39:08.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.524+0000 7f8c46697640 1 -- 172.21.15.6:0/1146456082 wait complete. 2023-07-21T22:39:08.588 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-21T22:39:07.694302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":339152,"kb_used_data":16144,"kb_used_omap":0,"kb_used_meta":322944,"kb_avail":754635568,"statfs":{"total":773094113280,"available":772746821632,"internally_reserved":0,"allocated":16531456,"data_stored":8962608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":330694656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.675750"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.031755+0000","last_change":"2023-07-21T22:39:03.031755+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.031755+0000","last_undegraded":"2023-07-21T22:39:03.031755+0000","last_fullsized":"2023-07-21T22:39:03.031755+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035392+0000","last_change":"2023-07-21T22:39:03.035392+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035392+0000","last_undegraded":"2023-07-21T22:39:03.035392+0000","last_fullsized":"2023-07-21T22:39:03.035392+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.037166+0000","last_change":"2023-07-21T22:39:03.037166+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.037166+0000","last_undegraded":"2023-07-21T22:39:03.037166+0000","last_fullsized":"2023-07-21T22:39:03.037166+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033602+0000","last_change":"2023-07-21T22:39:03.033602+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033602+0000","last_undegraded":"2023-07-21T22:39:03.033602+0000","last_fullsized":"2023-07-21T22:39:03.033602+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.029514+0000","last_change":"2023-07-21T22:39:03.029514+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.029514+0000","last_undegraded":"2023-07-21T22:39:03.029514+0000","last_fullsized":"2023-07-21T22:39:03.029514+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.027710+0000","last_change":"2023-07-21T22:39:03.027710+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.027710+0000","last_undegraded":"2023-07-21T22:39:03.027710+0000","last_fullsized":"2023-07-21T22:39:03.027710+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.045495+0000","last_change":"2023-07-21T22:39:03.045495+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.045495+0000","last_undegraded":"2023-07-21T22:39:03.045495+0000","last_fullsized":"2023-07-21T22:39:03.045495+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032274+0000","last_change":"2023-07-21T22:39:03.032274+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032274+0000","last_undegraded":"2023-07-21T22:39:03.032274+0000","last_fullsized":"2023-07-21T22:39:03.032274+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.028120+0000","last_change":"2023-07-21T22:39:03.028120+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.028120+0000","last_undegraded":"2023-07-21T22:39:03.028120+0000","last_fullsized":"2023-07-21T22:39:03.028120+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032516+0000","last_change":"2023-07-21T22:39:03.032516+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032516+0000","last_undegraded":"2023-07-21T22:39:03.032516+0000","last_fullsized":"2023-07-21T22:39:03.032516+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033779+0000","last_change":"2023-07-21T22:39:03.033779+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033779+0000","last_undegraded":"2023-07-21T22:39:03.033779+0000","last_fullsized":"2023-07-21T22:39:03.033779+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.030463+0000","last_change":"2023-07-21T22:39:03.030463+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.030463+0000","last_undegraded":"2023-07-21T22:39:03.030463+0000","last_fullsized":"2023-07-21T22:39:03.030463+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.028563+0000","last_change":"2023-07-21T22:39:03.028563+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.028563+0000","last_undegraded":"2023-07-21T22:39:03.028563+0000","last_fullsized":"2023-07-21T22:39:03.028563+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032620+0000","last_change":"2023-07-21T22:39:03.032620+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032620+0000","last_undegraded":"2023-07-21T22:39:03.032620+0000","last_fullsized":"2023-07-21T22:39:03.032620+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.034073+0000","last_change":"2023-07-21T22:39:03.034073+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.034073+0000","last_undegraded":"2023-07-21T22:39:03.034073+0000","last_fullsized":"2023-07-21T22:39:03.034073+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.030541+0000","last_change":"2023-07-21T22:39:03.030541+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.030541+0000","last_undegraded":"2023-07-21T22:39:03.030541+0000","last_fullsized":"2023-07-21T22:39:03.030541+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.027650+0000","last_change":"2023-07-21T22:39:03.027650+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.027650+0000","last_undegraded":"2023-07-21T22:39:03.027650+0000","last_fullsized":"2023-07-21T22:39:03.027650+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.031440+0000","last_change":"2023-07-21T22:39:03.031440+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.031440+0000","last_undegraded":"2023-07-21T22:39:03.031440+0000","last_fullsized":"2023-07-21T22:39:03.031440+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.038813+0000","last_change":"2023-07-21T22:39:03.038813+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.038813+0000","last_undegraded":"2023-07-21T22:39:03.038813+0000","last_fullsized":"2023-07-21T22:39:03.038813+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032698+0000","last_change":"2023-07-21T22:39:03.032698+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032698+0000","last_undegraded":"2023-07-21T22:39:03.032698+0000","last_fullsized":"2023-07-21T22:39:03.032698+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033863+0000","last_change":"2023-07-21T22:39:03.033863+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033863+0000","last_undegraded":"2023-07-21T22:39:03.033863+0000","last_fullsized":"2023-07-21T22:39:03.033863+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033051+0000","last_change":"2023-07-21T22:39:03.033051+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033051+0000","last_undegraded":"2023-07-21T22:39:03.033051+0000","last_fullsized":"2023-07-21T22:39:03.033051+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.034683+0000","last_change":"2023-07-21T22:39:03.034683+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.034683+0000","last_undegraded":"2023-07-21T22:39:03.034683+0000","last_fullsized":"2023-07-21T22:39:03.034683+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.030099+0000","last_change":"2023-07-21T22:39:03.030099+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.030099+0000","last_undegraded":"2023-07-21T22:39:03.030099+0000","last_fullsized":"2023-07-21T22:39:03.030099+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.037595+0000","last_change":"2023-07-21T22:39:03.037595+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.037595+0000","last_undegraded":"2023-07-21T22:39:03.037595+0000","last_fullsized":"2023-07-21T22:39:03.037595+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.036711+0000","last_change":"2023-07-21T22:39:03.036711+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.036711+0000","last_undegraded":"2023-07-21T22:39:03.036711+0000","last_fullsized":"2023-07-21T22:39:03.036711+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.038301+0000","last_change":"2023-07-21T22:39:03.038301+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.038301+0000","last_undegraded":"2023-07-21T22:39:03.038301+0000","last_fullsized":"2023-07-21T22:39:03.038301+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032779+0000","last_change":"2023-07-21T22:39:03.032779+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032779+0000","last_undegraded":"2023-07-21T22:39:03.032779+0000","last_fullsized":"2023-07-21T22:39:03.032779+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.036335+0000","last_change":"2023-07-21T22:39:03.036335+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.036335+0000","last_undegraded":"2023-07-21T22:39:03.036335+0000","last_fullsized":"2023-07-21T22:39:03.036335+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035927+0000","last_change":"2023-07-21T22:39:03.035927+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035927+0000","last_undegraded":"2023-07-21T22:39:03.035927+0000","last_fullsized":"2023-07-21T22:39:03.035927+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.031055+0000","last_change":"2023-07-21T22:39:03.031055+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.031055+0000","last_undegraded":"2023-07-21T22:39:03.031055+0000","last_fullsized":"2023-07-21T22:39:03.031055+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032720+0000","last_change":"2023-07-21T22:39:03.032720+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032720+0000","last_undegraded":"2023-07-21T22:39:03.032720+0000","last_fullsized":"2023-07-21T22:39:03.032720+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.031801+0000","last_change":"2023-07-21T22:39:03.031801+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.031801+0000","last_undegraded":"2023-07-21T22:39:03.031801+0000","last_fullsized":"2023-07-21T22:39:03.031801+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.051284+0000","last_change":"2023-07-21T22:39:03.045196+0000","last_active":"2023-07-21T22:39:03.051284+0000","last_peered":"2023-07-21T22:39:03.051284+0000","last_clean":"2023-07-21T22:39:03.051284+0000","last_became_active":"2023-07-21T22:39:03.044911+0000","last_became_peered":"2023-07-21T22:39:03.044911+0000","last_unstale":"2023-07-21T22:39:03.051284+0000","last_undegraded":"2023-07-21T22:39:03.051284+0000","last_fullsized":"2023-07-21T22:39:03.051284+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:59:50.408032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033616+0000","last_change":"2023-07-21T22:39:03.033616+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033616+0000","last_undegraded":"2023-07-21T22:39:03.033616+0000","last_fullsized":"2023-07-21T22:39:03.033616+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.049521+0000","last_change":"2023-07-21T22:39:03.043899+0000","last_active":"2023-07-21T22:39:03.049521+0000","last_peered":"2023-07-21T22:39:03.049521+0000","last_clean":"2023-07-21T22:39:03.049521+0000","last_became_active":"2023-07-21T22:39:03.043604+0000","last_became_peered":"2023-07-21T22:39:03.043604+0000","last_unstale":"2023-07-21T22:39:03.049521+0000","last_undegraded":"2023-07-21T22:39:03.049521+0000","last_fullsized":"2023-07-21T22:39:03.049521+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:26:49.888654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.034520+0000","last_change":"2023-07-21T22:39:03.034520+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.034520+0000","last_undegraded":"2023-07-21T22:39:03.034520+0000","last_fullsized":"2023-07-21T22:39:03.034520+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.052224+0000","last_change":"2023-07-21T22:39:03.047859+0000","last_active":"2023-07-21T22:39:03.052224+0000","last_peered":"2023-07-21T22:39:03.052224+0000","last_clean":"2023-07-21T22:39:03.052224+0000","last_became_active":"2023-07-21T22:39:03.047591+0000","last_became_peered":"2023-07-21T22:39:03.047591+0000","last_unstale":"2023-07-21T22:39:03.052224+0000","last_undegraded":"2023-07-21T22:39:03.052224+0000","last_fullsized":"2023-07-21T22:39:03.052224+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:30:13.086821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.028874+0000","last_change":"2023-07-21T22:39:03.028874+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.028874+0000","last_undegraded":"2023-07-21T22:39:03.028874+0000","last_fullsized":"2023-07-21T22:39:03.028874+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.054382+0000","last_change":"2023-07-21T22:39:03.052051+0000","last_active":"2023-07-21T22:39:03.054382+0000","last_peered":"2023-07-21T22:39:03.054382+0000","last_clean":"2023-07-21T22:39:03.054382+0000","last_became_active":"2023-07-21T22:39:03.051732+0000","last_became_peered":"2023-07-21T22:39:03.051732+0000","last_unstale":"2023-07-21T22:39:03.054382+0000","last_undegraded":"2023-07-21T22:39:03.054382+0000","last_fullsized":"2023-07-21T22:39:03.054382+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:52:56.209992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.031271+0000","last_change":"2023-07-21T22:39:03.031271+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.031271+0000","last_undegraded":"2023-07-21T22:39:03.031271+0000","last_fullsized":"2023-07-21T22:39:03.031271+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.051290+0000","last_change":"2023-07-21T22:39:03.047928+0000","last_active":"2023-07-21T22:39:03.051290+0000","last_peered":"2023-07-21T22:39:03.051290+0000","last_clean":"2023-07-21T22:39:03.051290+0000","last_became_active":"2023-07-21T22:39:03.047629+0000","last_became_peered":"2023-07-21T22:39:03.047629+0000","last_unstale":"2023-07-21T22:39:03.051290+0000","last_undegraded":"2023-07-21T22:39:03.051290+0000","last_fullsized":"2023-07-21T22:39:03.051290+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:19:36.446560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.031605+0000","last_change":"2023-07-21T22:39:03.031605+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.031605+0000","last_undegraded":"2023-07-21T22:39:03.031605+0000","last_fullsized":"2023-07-21T22:39:03.031605+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.040059+0000","last_change":"2023-07-21T22:39:03.035738+0000","last_active":"2023-07-21T22:39:03.040059+0000","last_peered":"2023-07-21T22:39:03.040059+0000","last_clean":"2023-07-21T22:39:03.040059+0000","last_became_active":"2023-07-21T22:39:03.035421+0000","last_became_peered":"2023-07-21T22:39:03.035421+0000","last_unstale":"2023-07-21T22:39:03.040059+0000","last_undegraded":"2023-07-21T22:39:03.040059+0000","last_fullsized":"2023-07-21T22:39:03.040059+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:03:22.351326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.030986+0000","last_change":"2023-07-21T22:39:03.030986+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.030986+0000","last_undegraded":"2023-07-21T22:39:03.030986+0000","last_fullsized":"2023-07-21T22:39:03.030986+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.039585+0000","last_change":"2023-07-21T22:39:03.036395+0000","last_active":"2023-07-21T22:39:03.039585+0000","last_peered":"2023-07-21T22:39:03.039585+0000","last_clean":"2023-07-21T22:39:03.039585+0000","last_became_active":"2023-07-21T22:39:03.036126+0000","last_became_peered":"2023-07-21T22:39:03.036126+0000","last_unstale":"2023-07-21T22:39:03.039585+0000","last_undegraded":"2023-07-21T22:39:03.039585+0000","last_fullsized":"2023-07-21T22:39:03.039585+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:48:39.173771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.039311+0000","last_change":"2023-07-21T22:39:03.039311+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.039311+0000","last_undegraded":"2023-07-21T22:39:03.039311+0000","last_fullsized":"2023-07-21T22:39:03.039311+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.046896+0000","last_change":"2023-07-21T22:39:03.043496+0000","last_active":"2023-07-21T22:39:03.046896+0000","last_peered":"2023-07-21T22:39:03.046896+0000","last_clean":"2023-07-21T22:39:03.046896+0000","last_became_active":"2023-07-21T22:39:03.043150+0000","last_became_peered":"2023-07-21T22:39:03.043150+0000","last_unstale":"2023-07-21T22:39:03.046896+0000","last_undegraded":"2023-07-21T22:39:03.046896+0000","last_fullsized":"2023-07-21T22:39:03.046896+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:48:06.386390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.041058+0000","last_change":"2023-07-21T22:39:03.041058+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.041058+0000","last_undegraded":"2023-07-21T22:39:03.041058+0000","last_fullsized":"2023-07-21T22:39:03.041058+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.050228+0000","last_change":"2023-07-21T22:39:03.048717+0000","last_active":"2023-07-21T22:39:03.050228+0000","last_peered":"2023-07-21T22:39:03.050228+0000","last_clean":"2023-07-21T22:39:03.050228+0000","last_became_active":"2023-07-21T22:39:03.048384+0000","last_became_peered":"2023-07-21T22:39:03.048384+0000","last_unstale":"2023-07-21T22:39:03.050228+0000","last_undegraded":"2023-07-21T22:39:03.050228+0000","last_fullsized":"2023-07-21T22:39:03.050228+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:40:09.732090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.039376+0000","last_change":"2023-07-21T22:39:03.039376+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.039376+0000","last_undegraded":"2023-07-21T22:39:03.039376+0000","last_fullsized":"2023-07-21T22:39:03.039376+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.051097+0000","last_change":"2023-07-21T22:39:03.045117+0000","last_active":"2023-07-21T22:39:03.051097+0000","last_peered":"2023-07-21T22:39:03.051097+0000","last_clean":"2023-07-21T22:39:03.051097+0000","last_became_active":"2023-07-21T22:39:03.044806+0000","last_became_peered":"2023-07-21T22:39:03.044806+0000","last_unstale":"2023-07-21T22:39:03.051097+0000","last_undegraded":"2023-07-21T22:39:03.051097+0000","last_fullsized":"2023-07-21T22:39:03.051097+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:11:15.831496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.040150+0000","last_change":"2023-07-21T22:39:03.040150+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.040150+0000","last_undegraded":"2023-07-21T22:39:03.040150+0000","last_fullsized":"2023-07-21T22:39:03.040150+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.041874+0000","last_change":"2023-07-21T22:39:03.039227+0000","last_active":"2023-07-21T22:39:03.041874+0000","last_peered":"2023-07-21T22:39:03.041874+0000","last_clean":"2023-07-21T22:39:03.041874+0000","last_became_active":"2023-07-21T22:39:03.038928+0000","last_became_peered":"2023-07-21T22:39:03.038928+0000","last_unstale":"2023-07-21T22:39:03.041874+0000","last_undegraded":"2023-07-21T22:39:03.041874+0000","last_fullsized":"2023-07-21T22:39:03.041874+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:48:20.047417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033719+0000","last_change":"2023-07-21T22:39:03.033719+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033719+0000","last_undegraded":"2023-07-21T22:39:03.033719+0000","last_fullsized":"2023-07-21T22:39:03.033719+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.049373+0000","last_change":"2023-07-21T22:39:03.040678+0000","last_active":"2023-07-21T22:39:03.049373+0000","last_peered":"2023-07-21T22:39:03.049373+0000","last_clean":"2023-07-21T22:39:03.049373+0000","last_became_active":"2023-07-21T22:39:03.040326+0000","last_became_peered":"2023-07-21T22:39:03.040326+0000","last_unstale":"2023-07-21T22:39:03.049373+0000","last_undegraded":"2023-07-21T22:39:03.049373+0000","last_fullsized":"2023-07-21T22:39:03.049373+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:25:50.691637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032262+0000","last_change":"2023-07-21T22:39:03.032262+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032262+0000","last_undegraded":"2023-07-21T22:39:03.032262+0000","last_fullsized":"2023-07-21T22:39:03.032262+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.045930+0000","last_change":"2023-07-21T22:39:03.044385+0000","last_active":"2023-07-21T22:39:03.045930+0000","last_peered":"2023-07-21T22:39:03.045930+0000","last_clean":"2023-07-21T22:39:03.045930+0000","last_became_active":"2023-07-21T22:39:03.044051+0000","last_became_peered":"2023-07-21T22:39:03.044051+0000","last_unstale":"2023-07-21T22:39:03.045930+0000","last_undegraded":"2023-07-21T22:39:03.045930+0000","last_fullsized":"2023-07-21T22:39:03.045930+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:40:22.537231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.030951+0000","last_change":"2023-07-21T22:39:03.030951+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.030951+0000","last_undegraded":"2023-07-21T22:39:03.030951+0000","last_fullsized":"2023-07-21T22:39:03.030951+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.045614+0000","last_change":"2023-07-21T22:39:03.043464+0000","last_active":"2023-07-21T22:39:03.045614+0000","last_peered":"2023-07-21T22:39:03.045614+0000","last_clean":"2023-07-21T22:39:03.045614+0000","last_became_active":"2023-07-21T22:39:03.043147+0000","last_became_peered":"2023-07-21T22:39:03.043147+0000","last_unstale":"2023-07-21T22:39:03.045614+0000","last_undegraded":"2023-07-21T22:39:03.045614+0000","last_fullsized":"2023-07-21T22:39:03.045614+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:56.767831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.030440+0000","last_change":"2023-07-21T22:39:03.030440+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.030440+0000","last_undegraded":"2023-07-21T22:39:03.030440+0000","last_fullsized":"2023-07-21T22:39:03.030440+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.056237+0000","last_change":"2023-07-21T22:39:03.053112+0000","last_active":"2023-07-21T22:39:03.056237+0000","last_peered":"2023-07-21T22:39:03.056237+0000","last_clean":"2023-07-21T22:39:03.056237+0000","last_became_active":"2023-07-21T22:39:03.052821+0000","last_became_peered":"2023-07-21T22:39:03.052821+0000","last_unstale":"2023-07-21T22:39:03.056237+0000","last_undegraded":"2023-07-21T22:39:03.056237+0000","last_fullsized":"2023-07-21T22:39:03.056237+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:10.156412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035197+0000","last_change":"2023-07-21T22:39:03.035197+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035197+0000","last_undegraded":"2023-07-21T22:39:03.035197+0000","last_fullsized":"2023-07-21T22:39:03.035197+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.046432+0000","last_change":"2023-07-21T22:39:03.042529+0000","last_active":"2023-07-21T22:39:03.046432+0000","last_peered":"2023-07-21T22:39:03.046432+0000","last_clean":"2023-07-21T22:39:03.046432+0000","last_became_active":"2023-07-21T22:39:03.042254+0000","last_became_peered":"2023-07-21T22:39:03.042254+0000","last_unstale":"2023-07-21T22:39:03.046432+0000","last_undegraded":"2023-07-21T22:39:03.046432+0000","last_fullsized":"2023-07-21T22:39:03.046432+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:52.040683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.029169+0000","last_change":"2023-07-21T22:39:03.029169+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.029169+0000","last_undegraded":"2023-07-21T22:39:03.029169+0000","last_fullsized":"2023-07-21T22:39:03.029169+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.048201+0000","last_change":"2023-07-21T22:39:03.045034+0000","last_active":"2023-07-21T22:39:03.048201+0000","last_peered":"2023-07-21T22:39:03.048201+0000","last_clean":"2023-07-21T22:39:03.048201+0000","last_became_active":"2023-07-21T22:39:03.044569+0000","last_became_peered":"2023-07-21T22:39:03.044569+0000","last_unstale":"2023-07-21T22:39:03.048201+0000","last_undegraded":"2023-07-21T22:39:03.048201+0000","last_fullsized":"2023-07-21T22:39:03.048201+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:24:01.085248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035264+0000","last_change":"2023-07-21T22:39:03.035264+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035264+0000","last_undegraded":"2023-07-21T22:39:03.035264+0000","last_fullsized":"2023-07-21T22:39:03.035264+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.045813+0000","last_change":"2023-07-21T22:39:03.043363+0000","last_active":"2023-07-21T22:39:03.045813+0000","last_peered":"2023-07-21T22:39:03.045813+0000","last_clean":"2023-07-21T22:39:03.045813+0000","last_became_active":"2023-07-21T22:39:03.043036+0000","last_became_peered":"2023-07-21T22:39:03.043036+0000","last_unstale":"2023-07-21T22:39:03.045813+0000","last_undegraded":"2023-07-21T22:39:03.045813+0000","last_fullsized":"2023-07-21T22:39:03.045813+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:38:21.996057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.045397+0000","last_change":"2023-07-21T22:39:03.045397+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.045397+0000","last_undegraded":"2023-07-21T22:39:03.045397+0000","last_fullsized":"2023-07-21T22:39:03.045397+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.045916+0000","last_change":"2023-07-21T22:39:03.044365+0000","last_active":"2023-07-21T22:39:03.045916+0000","last_peered":"2023-07-21T22:39:03.045916+0000","last_clean":"2023-07-21T22:39:03.045916+0000","last_became_active":"2023-07-21T22:39:03.044104+0000","last_became_peered":"2023-07-21T22:39:03.044104+0000","last_unstale":"2023-07-21T22:39:03.045916+0000","last_undegraded":"2023-07-21T22:39:03.045916+0000","last_fullsized":"2023-07-21T22:39:03.045916+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:55:34.402372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033267+0000","last_change":"2023-07-21T22:39:03.033267+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033267+0000","last_undegraded":"2023-07-21T22:39:03.033267+0000","last_fullsized":"2023-07-21T22:39:03.033267+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.047438+0000","last_change":"2023-07-21T22:39:03.044807+0000","last_active":"2023-07-21T22:39:03.047438+0000","last_peered":"2023-07-21T22:39:03.047438+0000","last_clean":"2023-07-21T22:39:03.047438+0000","last_became_active":"2023-07-21T22:39:03.044482+0000","last_became_peered":"2023-07-21T22:39:03.044482+0000","last_unstale":"2023-07-21T22:39:03.047438+0000","last_undegraded":"2023-07-21T22:39:03.047438+0000","last_fullsized":"2023-07-21T22:39:03.047438+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:31:44.130740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.027521+0000","last_change":"2023-07-21T22:39:03.027521+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.027521+0000","last_undegraded":"2023-07-21T22:39:03.027521+0000","last_fullsized":"2023-07-21T22:39:03.027521+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.045761+0000","last_change":"2023-07-21T22:39:03.043971+0000","last_active":"2023-07-21T22:39:03.045761+0000","last_peered":"2023-07-21T22:39:03.045761+0000","last_clean":"2023-07-21T22:39:03.045761+0000","last_became_active":"2023-07-21T22:39:03.043698+0000","last_became_peered":"2023-07-21T22:39:03.043698+0000","last_unstale":"2023-07-21T22:39:03.045761+0000","last_undegraded":"2023-07-21T22:39:03.045761+0000","last_fullsized":"2023-07-21T22:39:03.045761+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:33:33.644414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.029054+0000","last_change":"2023-07-21T22:39:03.029054+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.029054+0000","last_undegraded":"2023-07-21T22:39:03.029054+0000","last_fullsized":"2023-07-21T22:39:03.029054+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.056204+0000","last_change":"2023-07-21T22:39:03.052780+0000","last_active":"2023-07-21T22:39:03.056204+0000","last_peered":"2023-07-21T22:39:03.056204+0000","last_clean":"2023-07-21T22:39:03.056204+0000","last_became_active":"2023-07-21T22:39:03.052324+0000","last_became_peered":"2023-07-21T22:39:03.052324+0000","last_unstale":"2023-07-21T22:39:03.056204+0000","last_undegraded":"2023-07-21T22:39:03.056204+0000","last_fullsized":"2023-07-21T22:39:03.056204+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:42:19.254396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.027536+0000","last_change":"2023-07-21T22:39:03.027536+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.027536+0000","last_undegraded":"2023-07-21T22:39:03.027536+0000","last_fullsized":"2023-07-21T22:39:03.027536+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.051018+0000","last_change":"2023-07-21T22:39:03.049975+0000","last_active":"2023-07-21T22:39:03.051018+0000","last_peered":"2023-07-21T22:39:03.051018+0000","last_clean":"2023-07-21T22:39:03.051018+0000","last_became_active":"2023-07-21T22:39:03.049641+0000","last_became_peered":"2023-07-21T22:39:03.049641+0000","last_unstale":"2023-07-21T22:39:03.051018+0000","last_undegraded":"2023-07-21T22:39:03.051018+0000","last_fullsized":"2023-07-21T22:39:03.051018+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:47:53.393380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.038663+0000","last_change":"2023-07-21T22:39:03.038663+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.038663+0000","last_undegraded":"2023-07-21T22:39:03.038663+0000","last_fullsized":"2023-07-21T22:39:03.038663+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.047406+0000","last_change":"2023-07-21T22:39:03.039410+0000","last_active":"2023-07-21T22:39:03.047406+0000","last_peered":"2023-07-21T22:39:03.047406+0000","last_clean":"2023-07-21T22:39:03.047406+0000","last_became_active":"2023-07-21T22:39:03.039134+0000","last_became_peered":"2023-07-21T22:39:03.039134+0000","last_unstale":"2023-07-21T22:39:03.047406+0000","last_undegraded":"2023-07-21T22:39:03.047406+0000","last_fullsized":"2023-07-21T22:39:03.047406+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:04:32.243820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035845+0000","last_change":"2023-07-21T22:39:03.035845+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035845+0000","last_undegraded":"2023-07-21T22:39:03.035845+0000","last_fullsized":"2023-07-21T22:39:03.035845+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.056252+0000","last_change":"2023-07-21T22:39:03.053328+0000","last_active":"2023-07-21T22:39:03.056252+0000","last_peered":"2023-07-21T22:39:03.056252+0000","last_clean":"2023-07-21T22:39:03.056252+0000","last_became_active":"2023-07-21T22:39:03.052955+0000","last_became_peered":"2023-07-21T22:39:03.052955+0000","last_unstale":"2023-07-21T22:39:03.056252+0000","last_undegraded":"2023-07-21T22:39:03.056252+0000","last_fullsized":"2023-07-21T22:39:03.056252+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:36:43.080644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"145'271","reported_seq":949,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.038366+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:39:03.038366+0000","last_peered":"2023-07-21T22:39:03.038366+0000","last_clean":"2023-07-21T22:39:03.038366+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:39:03.038366+0000","last_undegraded":"2023-07-21T22:39:03.038366+0000","last_fullsized":"2023-07-21T22:39:03.038366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:19:57.210171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":276,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.034179+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:39:03.034179+0000","last_peered":"2023-07-21T22:39:03.034179+0000","last_clean":"2023-07-21T22:39:03.034179+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:39:03.034179+0000","last_undegraded":"2023-07-21T22:39:03.034179+0000","last_fullsized":"2023-07-21T22:39:03.034179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:32:45.245980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.043333+0000","last_change":"2023-07-21T22:39:03.043333+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.043333+0000","last_undegraded":"2023-07-21T22:39:03.043333+0000","last_fullsized":"2023-07-21T22:39:03.043333+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.051247+0000","last_change":"2023-07-21T22:39:03.045628+0000","last_active":"2023-07-21T22:39:03.051247+0000","last_peered":"2023-07-21T22:39:03.051247+0000","last_clean":"2023-07-21T22:39:03.051247+0000","last_became_active":"2023-07-21T22:39:03.044601+0000","last_became_peered":"2023-07-21T22:39:03.044601+0000","last_unstale":"2023-07-21T22:39:03.051247+0000","last_undegraded":"2023-07-21T22:39:03.051247+0000","last_fullsized":"2023-07-21T22:39:03.051247+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:02:30.920665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":247,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.038231+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:39:03.038231+0000","last_peered":"2023-07-21T22:39:03.038231+0000","last_clean":"2023-07-21T22:39:03.038231+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:39:03.038231+0000","last_undegraded":"2023-07-21T22:39:03.038231+0000","last_fullsized":"2023-07-21T22:39:03.038231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:51:43.481525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033051+0000","last_change":"2023-07-21T22:39:03.033051+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033051+0000","last_undegraded":"2023-07-21T22:39:03.033051+0000","last_fullsized":"2023-07-21T22:39:03.033051+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.048052+0000","last_change":"2023-07-21T22:39:03.046544+0000","last_active":"2023-07-21T22:39:03.048052+0000","last_peered":"2023-07-21T22:39:03.048052+0000","last_clean":"2023-07-21T22:39:03.048052+0000","last_became_active":"2023-07-21T22:39:03.046251+0000","last_became_peered":"2023-07-21T22:39:03.046251+0000","last_unstale":"2023-07-21T22:39:03.048052+0000","last_undegraded":"2023-07-21T22:39:03.048052+0000","last_fullsized":"2023-07-21T22:39:03.048052+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:25:00.614842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":248,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.034354+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:39:03.034354+0000","last_peered":"2023-07-21T22:39:03.034354+0000","last_clean":"2023-07-21T22:39:03.034354+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:39:03.034354+0000","last_undegraded":"2023-07-21T22:39:03.034354+0000","last_fullsized":"2023-07-21T22:39:03.034354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:26.401604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032057+0000","last_change":"2023-07-21T22:39:03.032057+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032057+0000","last_undegraded":"2023-07-21T22:39:03.032057+0000","last_fullsized":"2023-07-21T22:39:03.032057+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.047977+0000","last_change":"2023-07-21T22:39:03.044488+0000","last_active":"2023-07-21T22:39:03.047977+0000","last_peered":"2023-07-21T22:39:03.047977+0000","last_clean":"2023-07-21T22:39:03.047977+0000","last_became_active":"2023-07-21T22:39:03.044193+0000","last_became_peered":"2023-07-21T22:39:03.044193+0000","last_unstale":"2023-07-21T22:39:03.047977+0000","last_undegraded":"2023-07-21T22:39:03.047977+0000","last_fullsized":"2023-07-21T22:39:03.047977+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:06:43.937701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":276,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.034839+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:39:03.034839+0000","last_peered":"2023-07-21T22:39:03.034839+0000","last_clean":"2023-07-21T22:39:03.034839+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:39:03.034839+0000","last_undegraded":"2023-07-21T22:39:03.034839+0000","last_fullsized":"2023-07-21T22:39:03.034839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:55:25.947163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035385+0000","last_change":"2023-07-21T22:39:03.035385+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035385+0000","last_undegraded":"2023-07-21T22:39:03.035385+0000","last_fullsized":"2023-07-21T22:39:03.035385+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.052388+0000","last_change":"2023-07-21T22:39:03.050012+0000","last_active":"2023-07-21T22:39:03.052388+0000","last_peered":"2023-07-21T22:39:03.052388+0000","last_clean":"2023-07-21T22:39:03.052388+0000","last_became_active":"2023-07-21T22:39:03.049736+0000","last_became_peered":"2023-07-21T22:39:03.049736+0000","last_unstale":"2023-07-21T22:39:03.052388+0000","last_undegraded":"2023-07-21T22:39:03.052388+0000","last_fullsized":"2023-07-21T22:39:03.052388+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:19.696421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":260,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.025080+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:39:03.025080+0000","last_peered":"2023-07-21T22:39:03.025080+0000","last_clean":"2023-07-21T22:39:03.025080+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:39:03.025080+0000","last_undegraded":"2023-07-21T22:39:03.025080+0000","last_fullsized":"2023-07-21T22:39:03.025080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:48:23.151070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035875+0000","last_change":"2023-07-21T22:39:03.035875+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035875+0000","last_undegraded":"2023-07-21T22:39:03.035875+0000","last_fullsized":"2023-07-21T22:39:03.035875+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.056302+0000","last_change":"2023-07-21T22:39:03.053828+0000","last_active":"2023-07-21T22:39:03.056302+0000","last_peered":"2023-07-21T22:39:03.056302+0000","last_clean":"2023-07-21T22:39:03.056302+0000","last_became_active":"2023-07-21T22:39:03.053526+0000","last_became_peered":"2023-07-21T22:39:03.053526+0000","last_unstale":"2023-07-21T22:39:03.056302+0000","last_undegraded":"2023-07-21T22:39:03.056302+0000","last_fullsized":"2023-07-21T22:39:03.056302+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:01:46.815106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":246,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.039659+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:39:03.039659+0000","last_peered":"2023-07-21T22:39:03.039659+0000","last_clean":"2023-07-21T22:39:03.039659+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:39:03.039659+0000","last_undegraded":"2023-07-21T22:39:03.039659+0000","last_fullsized":"2023-07-21T22:39:03.039659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:04:04.247394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.029967+0000","last_change":"2023-07-21T22:39:03.029967+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.029967+0000","last_undegraded":"2023-07-21T22:39:03.029967+0000","last_fullsized":"2023-07-21T22:39:03.029967+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.046346+0000","last_change":"2023-07-21T22:39:03.042778+0000","last_active":"2023-07-21T22:39:03.046346+0000","last_peered":"2023-07-21T22:39:03.046346+0000","last_clean":"2023-07-21T22:39:03.046346+0000","last_became_active":"2023-07-21T22:39:03.042441+0000","last_became_peered":"2023-07-21T22:39:03.042441+0000","last_unstale":"2023-07-21T22:39:03.046346+0000","last_undegraded":"2023-07-21T22:39:03.046346+0000","last_fullsized":"2023-07-21T22:39:03.046346+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:01:29.405460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":260,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.024412+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:39:03.024412+0000","last_peered":"2023-07-21T22:39:03.024412+0000","last_clean":"2023-07-21T22:39:03.024412+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:39:03.024412+0000","last_undegraded":"2023-07-21T22:39:03.024412+0000","last_fullsized":"2023-07-21T22:39:03.024412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:51:30.283493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.029529+0000","last_change":"2023-07-21T22:39:03.029529+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.029529+0000","last_undegraded":"2023-07-21T22:39:03.029529+0000","last_fullsized":"2023-07-21T22:39:03.029529+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.048225+0000","last_change":"2023-07-21T22:39:03.045134+0000","last_active":"2023-07-21T22:39:03.048225+0000","last_peered":"2023-07-21T22:39:03.048225+0000","last_clean":"2023-07-21T22:39:03.048225+0000","last_became_active":"2023-07-21T22:39:03.044863+0000","last_became_peered":"2023-07-21T22:39:03.044863+0000","last_unstale":"2023-07-21T22:39:03.048225+0000","last_undegraded":"2023-07-21T22:39:03.048225+0000","last_fullsized":"2023-07-21T22:39:03.048225+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:04:09.984484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":242,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.044313+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:39:03.044313+0000","last_peered":"2023-07-21T22:39:03.044313+0000","last_clean":"2023-07-21T22:39:03.044313+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:39:03.044313+0000","last_undegraded":"2023-07-21T22:39:03.044313+0000","last_fullsized":"2023-07-21T22:39:03.044313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:36:27.715879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509682,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59744,"kb_used_data":2456,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312096,"statfs":{"total":96636764160,"available":96575586304,"internally_reserved":0,"allocated":2514944,"data_stored":1564775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69099999999999995,"15min":0.73199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35299999999999998},"max":{"1min":0.876,"5min":1.1180000000000001,"15min":3.5059999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66400000000000003,"15min":0.69399999999999995},"min":{"1min":0.46200000000000002,"5min":0.40899999999999997,"15min":0.39500000000000002},"max":{"1min":0.94199999999999995,"5min":0.94399999999999995,"15min":3.2709999999999999},"last":0.626}]},{"osd":1,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.70599999999999996,"15min":0.72799999999999998},"min":{"1min":0.49199999999999999,"5min":0.44900000000000001,"15min":0.432},"max":{"1min":0.98599999999999999,"5min":1.0680000000000001,"15min":1.5429999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.71299999999999997},"min":{"1min":0.44800000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96499999999999997,"5min":1.093,"15min":1.093},"last":0.71599999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70899999999999996,"15min":0.73599999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":1.1399999999999999,"15min":1.405},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73199999999999998,"15min":0.746},"min":{"1min":0.55100000000000005,"5min":0.47999999999999998,"15min":0.45800000000000002},"max":{"1min":0.92800000000000005,"5min":1.083,"15min":1.409},"last":0.66100000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75900000000000001,"15min":0.76500000000000001},"min":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0209999999999999,"5min":1.1539999999999999,"15min":1.46},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.48599999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94899999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.67700000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55700000000000005,"15min":0.56200000000000006},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.67500000000000004,"5min":0.90000000000000002,"15min":0.94999999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82299999999999995,"5min":0.97399999999999998,"15min":1.7949999999999999},"last":0.501}]},{"osd":5,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.89700000000000002,"5min":0.98799999999999999,"15min":2.2120000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70199999999999996,"15min":0.68100000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.38300000000000001},"max":{"1min":0.95199999999999996,"5min":1.052,"15min":1.506},"last":0.69499999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.68100000000000005},"min":{"1min":0.53700000000000003,"5min":0.44900000000000001,"15min":0.41999999999999998},"max":{"1min":0.93500000000000005,"5min":1.0329999999999999,"15min":1.048},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.42699999999999999},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.58399999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542388,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37008,"kb_used_data":1864,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334832,"statfs":{"total":96636764160,"available":96598867968,"internally_reserved":0,"allocated":1908736,"data_stored":967715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.755},"min":{"1min":0.47099999999999997,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.94399999999999995,"5min":1.016,"15min":1.016},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.437},"max":{"1min":0.96799999999999997,"5min":1.0289999999999999,"15min":1.1180000000000001},"last":0.90200000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.70099999999999996,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.49099999999999999,"15min":0.45300000000000001},"max":{"1min":0.872,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.45800000000000002,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.93300000000000005,"5min":0.99199999999999999,"15min":1.117},"last":0.82899999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71099999999999997,"15min":0.74199999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.42799999999999999},"max":{"1min":0.89600000000000002,"5min":0.98099999999999998,"15min":0.997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.78700000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.45500000000000002},"max":{"1min":0.98199999999999998,"5min":1.0149999999999999,"15min":1.097},"last":0.88700000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71999999999999997,"15min":0.748},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":1.048,"15min":1.048},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70499999999999996,"15min":0.72899999999999998},"min":{"1min":0.52300000000000002,"5min":0.49399999999999999,"15min":0.46899999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0049999999999999},"last":0.76300000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.93400000000000005,"15min":1.0229999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.39700000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.95599999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.054},"last":0.92200000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70299999999999996,"15min":0.68100000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.443},"max":{"1min":1.024,"5min":1.024,"15min":1.079},"last":0.995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.86899999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509681,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50960,"kb_used_data":1864,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320880,"statfs":{"total":96636764160,"available":96584581120,"internally_reserved":0,"allocated":1908736,"data_stored":967715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.70999999999999996},"min":{"1min":0.48099999999999998,"5min":0.38500000000000001,"15min":0.35699999999999998},"max":{"1min":0.96499999999999997,"5min":1,"15min":1.8779999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.97999999999999998,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.68600000000000005,"15min":0.70299999999999996},"min":{"1min":0.505,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.95899999999999996,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69099999999999995,"15min":0.72099999999999997},"min":{"1min":0.42699999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.617},"last":0.68400000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71099999999999997,"15min":0.72699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.33600000000000002},"max":{"1min":1.008,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.42199999999999999,"15min":0.377},"max":{"1min":0.89300000000000002,"5min":1.073,"15min":1.512},"last":0.73399999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76900000000000002,"15min":0.77800000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":1.0009999999999999,"15min":1.472},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76000000000000001,"15min":0.78700000000000003},"min":{"1min":0.60099999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.997,"5min":1.022,"15min":1.556},"last":0.66000000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.372,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83699999999999997,"5min":0.88900000000000001,"15min":0.96999999999999997},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72399999999999998,"15min":0.69599999999999995},"min":{"1min":0.58899999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.92300000000000004,"5min":0.92400000000000004,"15min":1.038},"last":0.754}]},{"osd":6,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":0.95499999999999996,"15min":1.0049999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.40200000000000002,"15min":0.40000000000000002},"max":{"1min":0.76600000000000001,"5min":0.93799999999999994,"15min":1.02},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70099999999999996,"15min":0.65700000000000003},"min":{"1min":0.46200000000000002,"5min":0.40999999999999998,"15min":0.374},"max":{"1min":0.96699999999999997,"5min":1.042,"15min":1.042},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":0.73099999999999998},"min":{"1min":0.59799999999999998,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.88300000000000001,"5min":0.999,"15min":1.7390000000000001},"last":0.78300000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509682,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1876,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1921024,"data_stored":974407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68300000000000005,"15min":0.72999999999999998},"min":{"1min":0.48599999999999999,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":0.93600000000000005,"5min":1.077,"15min":1.077},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68899999999999995,"15min":0.72999999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89800000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.66900000000000004,"15min":0.69699999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92200000000000004,"5min":1.044,"15min":1.044},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65600000000000003,"15min":0.69499999999999995},"min":{"1min":0.53100000000000003,"5min":0.43099999999999999,"15min":0.36899999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.96399999999999997},"last":0.754}]},{"osd":2,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.70499999999999996,"15min":0.746},"min":{"1min":0.441,"5min":0.441,"15min":0.371},"max":{"1min":0.88500000000000001,"5min":1.052,"15min":1.052},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71499999999999997,"15min":0.75700000000000001},"min":{"1min":0.501,"5min":0.47699999999999998,"15min":0.33000000000000002},"max":{"1min":0.89300000000000002,"5min":1.018,"15min":1.0660000000000001},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68000000000000005,"15min":0.72199999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.40100000000000002},"max":{"1min":0.90000000000000002,"5min":0.94599999999999995,"15min":1.0169999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.77500000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47999999999999998},"max":{"1min":0.94899999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.86199999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61099999999999999,"15min":0.58399999999999996},"min":{"1min":0.44400000000000001,"5min":0.35799999999999998,"15min":0.34399999999999997},"max":{"1min":0.86399999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.42799999999999999,"5min":0.42699999999999999,"15min":0.32800000000000001},"max":{"1min":0.82299999999999995,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.439,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.90900000000000003,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72299999999999998,"15min":0.71599999999999997},"min":{"1min":0.48499999999999999,"5min":0.443,"15min":0.41599999999999998},"max":{"1min":0.96299999999999997,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.39200000000000002},"max":{"1min":0.93999999999999995,"5min":1.028,"15min":1.028},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.47199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97099999999999997,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.89700000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509681,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1876,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1921024,"data_stored":974407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46899999999999997,"15min":0.47499999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":0.77800000000000002,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.45100000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46200000000000002,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60299999999999998,"5min":0.754,"15min":0.83499999999999996},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.41999999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71899999999999997,"5min":0.82599999999999996,"15min":0.90100000000000002},"last":0.41999999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67600000000000005,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.374},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.59599999999999997},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.99199999999999999},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.755,"15min":0.77000000000000002},"min":{"1min":0.57599999999999996,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91200000000000003,"5min":1.093,"15min":1.1279999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.81399999999999995},"min":{"1min":0.54500000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.93200000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.84399999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.76900000000000002},"min":{"1min":0.54900000000000004,"5min":0.501,"15min":0.48999999999999999},"max":{"1min":0.97799999999999998,"5min":1.0669999999999999,"15min":1.137},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.51300000000000001,"15min":0.42899999999999999},"max":{"1min":0.86399999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.82699999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76900000000000002,"15min":0.79000000000000004},"min":{"1min":0.51900000000000002,"5min":0.51700000000000002,"15min":0.47399999999999998},"max":{"1min":0.91700000000000004,"5min":1.0680000000000001,"15min":1.169},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91300000000000003,"5min":1.107,"15min":1.1120000000000001},"last":0.88200000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79200000000000004,"15min":0.81299999999999994},"min":{"1min":0.621,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94299999999999995,"5min":1.083,"15min":1.099},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80900000000000005,"15min":0.82799999999999996},"min":{"1min":0.61299999999999999,"5min":0.55200000000000005,"15min":0.48599999999999999},"max":{"1min":0.92200000000000004,"5min":1.623,"15min":1.623},"last":0.90100000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509683,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55068,"kb_used_data":1876,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316772,"statfs":{"total":96636764160,"available":96580374528,"internally_reserved":0,"allocated":1921024,"data_stored":974407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.46400000000000002},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.23899999999999999},"max":{"1min":0.624,"5min":0.75,"15min":0.94199999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50600000000000001,"15min":0.54100000000000004},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.308},"max":{"1min":0.64200000000000002,"5min":0.88300000000000001,"15min":1.0409999999999999},"last":0.44700000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.40699999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72599999999999998,"5min":0.86699999999999999,"15min":0.93999999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.012,"15min":1.085},"last":0.52700000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46300000000000002,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.623,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.56399999999999995},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.85299999999999998,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.46600000000000003,"15min":0.376},"max":{"1min":1.016,"5min":1.1579999999999999,"15min":1.3420000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73599999999999999,"15min":0.78500000000000003},"min":{"1min":0.48899999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.996,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0780000000000001,"5min":1.214,"15min":1.214},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77700000000000002,"15min":0.80600000000000005},"min":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.46400000000000002},"max":{"1min":1.012,"5min":1.2689999999999999,"15min":1.3089999999999999},"last":0.73799999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.746,"15min":0.78300000000000003},"min":{"1min":0.52800000000000002,"5min":0.499,"15min":0.40300000000000002},"max":{"1min":0.94399999999999995,"5min":1.536,"15min":1.536},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.46200000000000002},"max":{"1min":1.0289999999999999,"5min":1.1339999999999999,"15min":1.2649999999999999},"last":0.79200000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77500000000000002,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.008,"5min":1.143,"15min":1.214},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.751,"15min":0.79700000000000004},"min":{"1min":0.58899999999999997,"5min":0.50900000000000001,"15min":0.44700000000000001},"max":{"1min":0.91200000000000003,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.72599999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509682,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1876,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1921024,"data_stored":974407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.47499999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.22900000000000001},"max":{"1min":0.60399999999999998,"5min":0.78700000000000003,"15min":0.84599999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54100000000000004,"15min":0.55900000000000005},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.35099999999999998},"max":{"1min":0.80900000000000005,"5min":0.82499999999999996,"15min":0.872},"last":0.57599999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48999999999999999,"15min":0.502},"min":{"1min":0.36199999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"max":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":0.81000000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.29099999999999998},"max":{"1min":0.71899999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.42299999999999999,"5min":0.378,"15min":0.33400000000000002},"max":{"1min":0.76100000000000001,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":0.77600000000000002,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.371}]},{"osd":4,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.432},"max":{"1min":1.115,"5min":1.294,"15min":1.294},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77800000000000002,"15min":0.79000000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.498},"max":{"1min":1.1220000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.753,"15min":0.77200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.41899999999999998},"max":{"1min":1.0980000000000001,"5min":1.242,"15min":1.242},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.55700000000000005,"5min":0.51500000000000001,"15min":0.376},"max":{"1min":1.1639999999999999,"5min":1.276,"15min":1.2849999999999999},"last":0.77300000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77700000000000002,"15min":0.80000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.47899999999999998},"max":{"1min":1.0800000000000001,"5min":1.208,"15min":1.23},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.78100000000000003},"min":{"1min":0.56100000000000005,"5min":0.50900000000000001,"15min":0.46500000000000002},"max":{"1min":1.0109999999999999,"5min":1.244,"15min":1.3240000000000001},"last":0.66500000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78500000000000003,"15min":0.80400000000000005},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.49199999999999999},"max":{"1min":1.089,"5min":1.3120000000000001,"15min":1.3149999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.45700000000000002},"max":{"1min":1.0289999999999999,"5min":1.1819999999999999,"15min":1.3380000000000001},"last":0.86399999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509684,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37600,"kb_used_data":2456,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334240,"statfs":{"total":96636764160,"available":96598261760,"internally_reserved":0,"allocated":2514944,"data_stored":1564775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.33200000000000002,"5min":0.28399999999999997,"15min":0.26600000000000001},"max":{"1min":0.66300000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.495},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50900000000000001,"15min":0.51600000000000001},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.70599999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.36599999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.41599999999999998,"5min":0.32400000000000001,"15min":0.29799999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.3680000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.49099999999999999,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.871},"last":0.438}]},{"osd":3,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.432,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81899999999999995,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.33700000000000002},"max":{"1min":0.83599999999999997,"5min":0.88600000000000001,"15min":1.038},"last":0.60499999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.81000000000000005,"15min":0.78400000000000003},"min":{"1min":0.56899999999999995,"5min":0.499,"15min":0.45200000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.80500000000000005,"15min":0.80000000000000004},"min":{"1min":0.57899999999999996,"5min":0.505,"15min":0.44600000000000001},"max":{"1min":1.206,"5min":1.278,"15min":1.423},"last":0.79400000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.59599999999999997,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.0089999999999999,"5min":1.0960000000000001,"15min":1.2669999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80500000000000005,"15min":0.80300000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.39600000000000002},"max":{"1min":1.119,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.48899999999999999},"max":{"1min":1.2210000000000001,"5min":1.27,"15min":1.27},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.65500000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.90500000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80700000000000005,"15min":0.79500000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.53100000000000003},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80200000000000005,"15min":0.82199999999999995},"min":{"1min":0.58999999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1479999999999999,"5min":1.1930000000000001,"15min":1.296},"last":0.97699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:39:08.596 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:39:08.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.732+0000 7f4b868ca640 1 Processor -- start 2023-07-21T22:39:08.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.732+0000 7f4b868ca640 1 -- start start 2023-07-21T22:39:08.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.736+0000 7f4b868ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b8015f500 0x7f4b8006cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:08.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.736+0000 7f4b868ca640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4b8006ac50 0x7f4b800ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:08.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.736+0000 7f4b868ca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b800cdc80 con 0x7f4b8006d430 2023-07-21T22:39:08.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.736+0000 7f4b868ca640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b8006e4c0 con 0x7f4b8006ac50 2023-07-21T22:39:08.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.736+0000 7f4b868ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8006d940 con 0x7f4b8015f500 2023-07-21T22:39:08.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.736+0000 7f4b7f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4b8006d430 0x7f4b8006a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37308/0 (socket says 172.21.15.6:37308) 2023-07-21T22:39:08.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.736+0000 7f4b7f7fe640 1 -- 172.21.15.6:0/1837688654 learned_addr learned my addr 172.21.15.6:0/1837688654 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:39:08.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.736+0000 7f4b7ffff640 1 --2- 172.21.15.6:0/1837688654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b8015f500 0x7f4b8006cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:08.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.736+0000 7f4b84e67640 1 --2- 172.21.15.6:0/1837688654 >> v2:172.21.15.161:3300/0 conn(0x7f4b8006ac50 0x7f4b800ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:08.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.736+0000 7f4b7effd640 1 -- 172.21.15.6:0/1837688654 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 784259946 0 0) 0x7f4b800cdc80 con 0x7f4b8006d430 2023-07-21T22:39:08.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.736+0000 7f4b7effd640 1 -- 172.21.15.6:0/1837688654 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b68003530 con 0x7f4b8006d430 2023-07-21T22:39:08.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.736+0000 7f4b84e67640 1 -- 172.21.15.6:0/1837688654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b8015f500 msgr2=0x7f4b8006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:08.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.736+0000 7f4b84e67640 1 --2- 172.21.15.6:0/1837688654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b8015f500 0x7f4b8006cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.736+0000 7f4b84e67640 1 -- 172.21.15.6:0/1837688654 >> v1:172.21.15.6:6789/0 conn(0x7f4b8006d430 legacy=0x7f4b8006a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:08.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.736+0000 7f4b84e67640 1 -- 172.21.15.6:0/1837688654 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8006dc20 con 0x7f4b8006ac50 2023-07-21T22:39:08.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.740+0000 7f4b84e67640 1 --2- 172.21.15.6:0/1837688654 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b8006ac50 0x7f4b800ce0f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4b78009d90 tx=0x7f4b7801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e270ac971ce6e30e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:08.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.740+0000 7f4b7effd640 1 -- 172.21.15.6:0/1837688654 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b780a5900 con 0x7f4b8006ac50 2023-07-21T22:39:08.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.740+0000 7f4b7effd640 1 -- 172.21.15.6:0/1837688654 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b780a5a60 con 0x7f4b8006ac50 2023-07-21T22:39:08.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.740+0000 7f4b7effd640 1 -- 172.21.15.6:0/1837688654 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b780a5df0 con 0x7f4b8006ac50 2023-07-21T22:39:08.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.740+0000 7f4b868ca640 1 -- 172.21.15.6:0/1837688654 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b8006ac50 msgr2=0x7f4b800ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:08.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.740+0000 7f4b868ca640 1 --2- 172.21.15.6:0/1837688654 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b8006ac50 0x7f4b800ce0f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f4b78009d90 tx=0x7f4b7801c950 comp rx=0 tx=0).stop 2023-07-21T22:39:08.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.740+0000 7f4b868ca640 1 -- 172.21.15.6:0/1837688654 shutdown_connections 2023-07-21T22:39:08.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.740+0000 7f4b868ca640 1 --2- 172.21.15.6:0/1837688654 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b8006ac50 0x7f4b800ce0f0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.740+0000 7f4b868ca640 1 --2- 172.21.15.6:0/1837688654 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b8015f500 0x7f4b8006cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.740+0000 7f4b868ca640 1 -- 172.21.15.6:0/1837688654 >> 172.21.15.6:0/1837688654 conn(0x7f4b800659d0 msgr2=0x7f4b80099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:08.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.740+0000 7f4b868ca640 1 -- 172.21.15.6:0/1837688654 shutdown_connections 2023-07-21T22:39:08.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.740+0000 7f4b868ca640 1 -- 172.21.15.6:0/1837688654 wait complete. 2023-07-21T22:39:08.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.740+0000 7f4b868ca640 1 Processor -- start 2023-07-21T22:39:08.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.740+0000 7f4b868ca640 1 -- start start 2023-07-21T22:39:08.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b868ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b8006ac50 0x7f4b801453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:08.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b868ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b8006d430 0x7f4b800b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:08.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b868ca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b8015f500 0x7f4b800b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b868ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800c3f40 con 0x7f4b8006ac50 2023-07-21T22:39:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b868ca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800c5f50 con 0x7f4b8015f500 2023-07-21T22:39:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b868ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800c6230 con 0x7f4b8006d430 2023-07-21T22:39:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b7ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b8006ac50 0x7f4b801453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:08.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b7ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b8006ac50 0x7f4b801453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54434/0 (socket says 172.21.15.6:54434) 2023-07-21T22:39:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b7ffff640 1 -- 172.21.15.6:0/452237898 learned_addr learned my addr 172.21.15.6:0/452237898 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b7ffff640 1 -- 172.21.15.6:0/452237898 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b8006d430 msgr2=0x7f4b800b2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b7ffff640 1 --2- 172.21.15.6:0/452237898 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b8006d430 0x7f4b800b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b7ffff640 1 -- 172.21.15.6:0/452237898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b8015f500 msgr2=0x7f4b800b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b7ffff640 1 --2- 172.21.15.6:0/452237898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b8015f500 0x7f4b800b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b7ffff640 1 -- 172.21.15.6:0/452237898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b78009a70 con 0x7f4b8006ac50 2023-07-21T22:39:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b7ffff640 1 --2- 172.21.15.6:0/452237898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b8006ac50 0x7f4b801453f0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000e870 tx=0x7f4b7000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b7cff9640 1 -- 172.21.15.6:0/452237898 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7000c8c0 con 0x7f4b8006ac50 2023-07-21T22:39:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b7cff9640 1 -- 172.21.15.6:0/452237898 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7000ca20 con 0x7f4b8006ac50 2023-07-21T22:39:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b7cff9640 1 -- 172.21.15.6:0/452237898 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7000cd90 con 0x7f4b8006ac50 2023-07-21T22:39:08.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b868ca640 1 -- 172.21.15.6:0/452237898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b800c6510 con 0x7f4b8006ac50 2023-07-21T22:39:08.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b868ca640 1 -- 172.21.15.6:0/452237898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b80145930 con 0x7f4b8006ac50 2023-07-21T22:39:08.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b868ca640 1 -- 172.21.15.6:0/452237898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b800ad740 con 0x7f4b8006ac50 2023-07-21T22:39:08.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.744+0000 7f4b7cff9640 1 -- 172.21.15.6:0/452237898 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4b70013470 con 0x7f4b8006ac50 2023-07-21T22:39:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.748+0000 7f4b7cff9640 1 --2- 172.21.15.6:0/452237898 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f4b6c0663a0 0x7f4b6c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.748+0000 7f4b7cff9640 1 -- 172.21.15.6:0/452237898 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f4b70084400 con 0x7f4b8006ac50 2023-07-21T22:39:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.748+0000 7f4b7f7fe640 1 --2- 172.21.15.6:0/452237898 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f4b6c0663a0 0x7f4b6c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.748+0000 7f4b7f7fe640 1 --2- 172.21.15.6:0/452237898 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f4b6c0663a0 0x7f4b6c068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4b74007fd0 tx=0x7f4b74007900 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:08.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.752+0000 7f4b7cff9640 1 -- 172.21.15.6:0/452237898 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4b700517e0 con 0x7f4b8006ac50 2023-07-21T22:39:08.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.900+0000 7f4b868ca640 1 -- 172.21.15.6:0/452237898 --> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b800cee40 con 0x7f4b6c0663a0 2023-07-21T22:39:08.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.912+0000 7f4b7cff9640 1 -- 172.21.15.6:0/452237898 <== mgr.7694 v2:172.21.15.161:6832/2692111396 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306370 (secure 0 0 0) 0x7f4b740058a0 con 0x7f4b6c0663a0 2023-07-21T22:39:08.958 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:39:08.959 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:39:08.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.912+0000 7f4b868ca640 1 -- 172.21.15.6:0/452237898 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f4b6c0663a0 msgr2=0x7f4b6c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:08.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.912+0000 7f4b868ca640 1 --2- 172.21.15.6:0/452237898 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f4b6c0663a0 0x7f4b6c068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4b74007fd0 tx=0x7f4b74007900 comp rx=0 tx=0).stop 2023-07-21T22:39:08.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.912+0000 7f4b868ca640 1 -- 172.21.15.6:0/452237898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b8006ac50 msgr2=0x7f4b801453f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:08.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.912+0000 7f4b868ca640 1 --2- 172.21.15.6:0/452237898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b8006ac50 0x7f4b801453f0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000e870 tx=0x7f4b7000ed30 comp rx=0 tx=0).stop 2023-07-21T22:39:08.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.912+0000 7f4b868ca640 1 -- 172.21.15.6:0/452237898 shutdown_connections 2023-07-21T22:39:08.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.912+0000 7f4b868ca640 1 --2- 172.21.15.6:0/452237898 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f4b6c0663a0 0x7f4b6c068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.912+0000 7f4b868ca640 1 --2- 172.21.15.6:0/452237898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b8015f500 0x7f4b800b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.912+0000 7f4b868ca640 1 --2- 172.21.15.6:0/452237898 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b8006d430 0x7f4b800b2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.912+0000 7f4b868ca640 1 --2- 172.21.15.6:0/452237898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b8006ac50 0x7f4b801453f0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:08.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.912+0000 7f4b868ca640 1 -- 172.21.15.6:0/452237898 >> 172.21.15.6:0/452237898 conn(0x7f4b800659d0 msgr2=0x7f4b8015b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:08.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.916+0000 7f4b868ca640 1 -- 172.21.15.6:0/452237898 shutdown_connections 2023-07-21T22:39:08.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:08.916+0000 7f4b868ca640 1 -- 172.21.15.6:0/452237898 wait complete. 2023-07-21T22:39:08.978 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-21T22:39:07.694302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":339152,"kb_used_data":16144,"kb_used_omap":0,"kb_used_meta":322944,"kb_avail":754635568,"statfs":{"total":773094113280,"available":772746821632,"internally_reserved":0,"allocated":16531456,"data_stored":8962608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":330694656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.675750"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.031755+0000","last_change":"2023-07-21T22:39:03.031755+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.031755+0000","last_undegraded":"2023-07-21T22:39:03.031755+0000","last_fullsized":"2023-07-21T22:39:03.031755+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035392+0000","last_change":"2023-07-21T22:39:03.035392+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035392+0000","last_undegraded":"2023-07-21T22:39:03.035392+0000","last_fullsized":"2023-07-21T22:39:03.035392+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.037166+0000","last_change":"2023-07-21T22:39:03.037166+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.037166+0000","last_undegraded":"2023-07-21T22:39:03.037166+0000","last_fullsized":"2023-07-21T22:39:03.037166+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033602+0000","last_change":"2023-07-21T22:39:03.033602+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033602+0000","last_undegraded":"2023-07-21T22:39:03.033602+0000","last_fullsized":"2023-07-21T22:39:03.033602+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.029514+0000","last_change":"2023-07-21T22:39:03.029514+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.029514+0000","last_undegraded":"2023-07-21T22:39:03.029514+0000","last_fullsized":"2023-07-21T22:39:03.029514+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.027710+0000","last_change":"2023-07-21T22:39:03.027710+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.027710+0000","last_undegraded":"2023-07-21T22:39:03.027710+0000","last_fullsized":"2023-07-21T22:39:03.027710+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.045495+0000","last_change":"2023-07-21T22:39:03.045495+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.045495+0000","last_undegraded":"2023-07-21T22:39:03.045495+0000","last_fullsized":"2023-07-21T22:39:03.045495+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032274+0000","last_change":"2023-07-21T22:39:03.032274+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032274+0000","last_undegraded":"2023-07-21T22:39:03.032274+0000","last_fullsized":"2023-07-21T22:39:03.032274+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.028120+0000","last_change":"2023-07-21T22:39:03.028120+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.028120+0000","last_undegraded":"2023-07-21T22:39:03.028120+0000","last_fullsized":"2023-07-21T22:39:03.028120+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032516+0000","last_change":"2023-07-21T22:39:03.032516+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032516+0000","last_undegraded":"2023-07-21T22:39:03.032516+0000","last_fullsized":"2023-07-21T22:39:03.032516+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033779+0000","last_change":"2023-07-21T22:39:03.033779+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033779+0000","last_undegraded":"2023-07-21T22:39:03.033779+0000","last_fullsized":"2023-07-21T22:39:03.033779+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.030463+0000","last_change":"2023-07-21T22:39:03.030463+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.030463+0000","last_undegraded":"2023-07-21T22:39:03.030463+0000","last_fullsized":"2023-07-21T22:39:03.030463+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.028563+0000","last_change":"2023-07-21T22:39:03.028563+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.028563+0000","last_undegraded":"2023-07-21T22:39:03.028563+0000","last_fullsized":"2023-07-21T22:39:03.028563+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032620+0000","last_change":"2023-07-21T22:39:03.032620+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032620+0000","last_undegraded":"2023-07-21T22:39:03.032620+0000","last_fullsized":"2023-07-21T22:39:03.032620+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.034073+0000","last_change":"2023-07-21T22:39:03.034073+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.034073+0000","last_undegraded":"2023-07-21T22:39:03.034073+0000","last_fullsized":"2023-07-21T22:39:03.034073+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.030541+0000","last_change":"2023-07-21T22:39:03.030541+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.030541+0000","last_undegraded":"2023-07-21T22:39:03.030541+0000","last_fullsized":"2023-07-21T22:39:03.030541+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.027650+0000","last_change":"2023-07-21T22:39:03.027650+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.027650+0000","last_undegraded":"2023-07-21T22:39:03.027650+0000","last_fullsized":"2023-07-21T22:39:03.027650+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.031440+0000","last_change":"2023-07-21T22:39:03.031440+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.031440+0000","last_undegraded":"2023-07-21T22:39:03.031440+0000","last_fullsized":"2023-07-21T22:39:03.031440+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.038813+0000","last_change":"2023-07-21T22:39:03.038813+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.038813+0000","last_undegraded":"2023-07-21T22:39:03.038813+0000","last_fullsized":"2023-07-21T22:39:03.038813+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032698+0000","last_change":"2023-07-21T22:39:03.032698+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032698+0000","last_undegraded":"2023-07-21T22:39:03.032698+0000","last_fullsized":"2023-07-21T22:39:03.032698+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033863+0000","last_change":"2023-07-21T22:39:03.033863+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033863+0000","last_undegraded":"2023-07-21T22:39:03.033863+0000","last_fullsized":"2023-07-21T22:39:03.033863+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033051+0000","last_change":"2023-07-21T22:39:03.033051+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033051+0000","last_undegraded":"2023-07-21T22:39:03.033051+0000","last_fullsized":"2023-07-21T22:39:03.033051+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.034683+0000","last_change":"2023-07-21T22:39:03.034683+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.034683+0000","last_undegraded":"2023-07-21T22:39:03.034683+0000","last_fullsized":"2023-07-21T22:39:03.034683+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.030099+0000","last_change":"2023-07-21T22:39:03.030099+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.030099+0000","last_undegraded":"2023-07-21T22:39:03.030099+0000","last_fullsized":"2023-07-21T22:39:03.030099+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.037595+0000","last_change":"2023-07-21T22:39:03.037595+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.037595+0000","last_undegraded":"2023-07-21T22:39:03.037595+0000","last_fullsized":"2023-07-21T22:39:03.037595+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.036711+0000","last_change":"2023-07-21T22:39:03.036711+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.036711+0000","last_undegraded":"2023-07-21T22:39:03.036711+0000","last_fullsized":"2023-07-21T22:39:03.036711+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.038301+0000","last_change":"2023-07-21T22:39:03.038301+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.038301+0000","last_undegraded":"2023-07-21T22:39:03.038301+0000","last_fullsized":"2023-07-21T22:39:03.038301+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032779+0000","last_change":"2023-07-21T22:39:03.032779+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032779+0000","last_undegraded":"2023-07-21T22:39:03.032779+0000","last_fullsized":"2023-07-21T22:39:03.032779+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.036335+0000","last_change":"2023-07-21T22:39:03.036335+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.036335+0000","last_undegraded":"2023-07-21T22:39:03.036335+0000","last_fullsized":"2023-07-21T22:39:03.036335+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035927+0000","last_change":"2023-07-21T22:39:03.035927+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035927+0000","last_undegraded":"2023-07-21T22:39:03.035927+0000","last_fullsized":"2023-07-21T22:39:03.035927+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.031055+0000","last_change":"2023-07-21T22:39:03.031055+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.031055+0000","last_undegraded":"2023-07-21T22:39:03.031055+0000","last_fullsized":"2023-07-21T22:39:03.031055+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032720+0000","last_change":"2023-07-21T22:39:03.032720+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032720+0000","last_undegraded":"2023-07-21T22:39:03.032720+0000","last_fullsized":"2023-07-21T22:39:03.032720+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.031801+0000","last_change":"2023-07-21T22:39:03.031801+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.031801+0000","last_undegraded":"2023-07-21T22:39:03.031801+0000","last_fullsized":"2023-07-21T22:39:03.031801+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.051284+0000","last_change":"2023-07-21T22:39:03.045196+0000","last_active":"2023-07-21T22:39:03.051284+0000","last_peered":"2023-07-21T22:39:03.051284+0000","last_clean":"2023-07-21T22:39:03.051284+0000","last_became_active":"2023-07-21T22:39:03.044911+0000","last_became_peered":"2023-07-21T22:39:03.044911+0000","last_unstale":"2023-07-21T22:39:03.051284+0000","last_undegraded":"2023-07-21T22:39:03.051284+0000","last_fullsized":"2023-07-21T22:39:03.051284+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:59:50.408032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033616+0000","last_change":"2023-07-21T22:39:03.033616+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033616+0000","last_undegraded":"2023-07-21T22:39:03.033616+0000","last_fullsized":"2023-07-21T22:39:03.033616+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.049521+0000","last_change":"2023-07-21T22:39:03.043899+0000","last_active":"2023-07-21T22:39:03.049521+0000","last_peered":"2023-07-21T22:39:03.049521+0000","last_clean":"2023-07-21T22:39:03.049521+0000","last_became_active":"2023-07-21T22:39:03.043604+0000","last_became_peered":"2023-07-21T22:39:03.043604+0000","last_unstale":"2023-07-21T22:39:03.049521+0000","last_undegraded":"2023-07-21T22:39:03.049521+0000","last_fullsized":"2023-07-21T22:39:03.049521+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:26:49.888654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.034520+0000","last_change":"2023-07-21T22:39:03.034520+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.034520+0000","last_undegraded":"2023-07-21T22:39:03.034520+0000","last_fullsized":"2023-07-21T22:39:03.034520+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.052224+0000","last_change":"2023-07-21T22:39:03.047859+0000","last_active":"2023-07-21T22:39:03.052224+0000","last_peered":"2023-07-21T22:39:03.052224+0000","last_clean":"2023-07-21T22:39:03.052224+0000","last_became_active":"2023-07-21T22:39:03.047591+0000","last_became_peered":"2023-07-21T22:39:03.047591+0000","last_unstale":"2023-07-21T22:39:03.052224+0000","last_undegraded":"2023-07-21T22:39:03.052224+0000","last_fullsized":"2023-07-21T22:39:03.052224+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:30:13.086821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.028874+0000","last_change":"2023-07-21T22:39:03.028874+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.028874+0000","last_undegraded":"2023-07-21T22:39:03.028874+0000","last_fullsized":"2023-07-21T22:39:03.028874+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.054382+0000","last_change":"2023-07-21T22:39:03.052051+0000","last_active":"2023-07-21T22:39:03.054382+0000","last_peered":"2023-07-21T22:39:03.054382+0000","last_clean":"2023-07-21T22:39:03.054382+0000","last_became_active":"2023-07-21T22:39:03.051732+0000","last_became_peered":"2023-07-21T22:39:03.051732+0000","last_unstale":"2023-07-21T22:39:03.054382+0000","last_undegraded":"2023-07-21T22:39:03.054382+0000","last_fullsized":"2023-07-21T22:39:03.054382+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:52:56.209992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.031271+0000","last_change":"2023-07-21T22:39:03.031271+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.031271+0000","last_undegraded":"2023-07-21T22:39:03.031271+0000","last_fullsized":"2023-07-21T22:39:03.031271+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.051290+0000","last_change":"2023-07-21T22:39:03.047928+0000","last_active":"2023-07-21T22:39:03.051290+0000","last_peered":"2023-07-21T22:39:03.051290+0000","last_clean":"2023-07-21T22:39:03.051290+0000","last_became_active":"2023-07-21T22:39:03.047629+0000","last_became_peered":"2023-07-21T22:39:03.047629+0000","last_unstale":"2023-07-21T22:39:03.051290+0000","last_undegraded":"2023-07-21T22:39:03.051290+0000","last_fullsized":"2023-07-21T22:39:03.051290+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:19:36.446560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.031605+0000","last_change":"2023-07-21T22:39:03.031605+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.031605+0000","last_undegraded":"2023-07-21T22:39:03.031605+0000","last_fullsized":"2023-07-21T22:39:03.031605+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.040059+0000","last_change":"2023-07-21T22:39:03.035738+0000","last_active":"2023-07-21T22:39:03.040059+0000","last_peered":"2023-07-21T22:39:03.040059+0000","last_clean":"2023-07-21T22:39:03.040059+0000","last_became_active":"2023-07-21T22:39:03.035421+0000","last_became_peered":"2023-07-21T22:39:03.035421+0000","last_unstale":"2023-07-21T22:39:03.040059+0000","last_undegraded":"2023-07-21T22:39:03.040059+0000","last_fullsized":"2023-07-21T22:39:03.040059+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:03:22.351326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.030986+0000","last_change":"2023-07-21T22:39:03.030986+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.030986+0000","last_undegraded":"2023-07-21T22:39:03.030986+0000","last_fullsized":"2023-07-21T22:39:03.030986+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.039585+0000","last_change":"2023-07-21T22:39:03.036395+0000","last_active":"2023-07-21T22:39:03.039585+0000","last_peered":"2023-07-21T22:39:03.039585+0000","last_clean":"2023-07-21T22:39:03.039585+0000","last_became_active":"2023-07-21T22:39:03.036126+0000","last_became_peered":"2023-07-21T22:39:03.036126+0000","last_unstale":"2023-07-21T22:39:03.039585+0000","last_undegraded":"2023-07-21T22:39:03.039585+0000","last_fullsized":"2023-07-21T22:39:03.039585+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:48:39.173771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.039311+0000","last_change":"2023-07-21T22:39:03.039311+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.039311+0000","last_undegraded":"2023-07-21T22:39:03.039311+0000","last_fullsized":"2023-07-21T22:39:03.039311+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.046896+0000","last_change":"2023-07-21T22:39:03.043496+0000","last_active":"2023-07-21T22:39:03.046896+0000","last_peered":"2023-07-21T22:39:03.046896+0000","last_clean":"2023-07-21T22:39:03.046896+0000","last_became_active":"2023-07-21T22:39:03.043150+0000","last_became_peered":"2023-07-21T22:39:03.043150+0000","last_unstale":"2023-07-21T22:39:03.046896+0000","last_undegraded":"2023-07-21T22:39:03.046896+0000","last_fullsized":"2023-07-21T22:39:03.046896+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:48:06.386390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.041058+0000","last_change":"2023-07-21T22:39:03.041058+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.041058+0000","last_undegraded":"2023-07-21T22:39:03.041058+0000","last_fullsized":"2023-07-21T22:39:03.041058+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.050228+0000","last_change":"2023-07-21T22:39:03.048717+0000","last_active":"2023-07-21T22:39:03.050228+0000","last_peered":"2023-07-21T22:39:03.050228+0000","last_clean":"2023-07-21T22:39:03.050228+0000","last_became_active":"2023-07-21T22:39:03.048384+0000","last_became_peered":"2023-07-21T22:39:03.048384+0000","last_unstale":"2023-07-21T22:39:03.050228+0000","last_undegraded":"2023-07-21T22:39:03.050228+0000","last_fullsized":"2023-07-21T22:39:03.050228+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:40:09.732090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.039376+0000","last_change":"2023-07-21T22:39:03.039376+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.039376+0000","last_undegraded":"2023-07-21T22:39:03.039376+0000","last_fullsized":"2023-07-21T22:39:03.039376+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.051097+0000","last_change":"2023-07-21T22:39:03.045117+0000","last_active":"2023-07-21T22:39:03.051097+0000","last_peered":"2023-07-21T22:39:03.051097+0000","last_clean":"2023-07-21T22:39:03.051097+0000","last_became_active":"2023-07-21T22:39:03.044806+0000","last_became_peered":"2023-07-21T22:39:03.044806+0000","last_unstale":"2023-07-21T22:39:03.051097+0000","last_undegraded":"2023-07-21T22:39:03.051097+0000","last_fullsized":"2023-07-21T22:39:03.051097+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:11:15.831496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.040150+0000","last_change":"2023-07-21T22:39:03.040150+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.040150+0000","last_undegraded":"2023-07-21T22:39:03.040150+0000","last_fullsized":"2023-07-21T22:39:03.040150+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.041874+0000","last_change":"2023-07-21T22:39:03.039227+0000","last_active":"2023-07-21T22:39:03.041874+0000","last_peered":"2023-07-21T22:39:03.041874+0000","last_clean":"2023-07-21T22:39:03.041874+0000","last_became_active":"2023-07-21T22:39:03.038928+0000","last_became_peered":"2023-07-21T22:39:03.038928+0000","last_unstale":"2023-07-21T22:39:03.041874+0000","last_undegraded":"2023-07-21T22:39:03.041874+0000","last_fullsized":"2023-07-21T22:39:03.041874+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:48:20.047417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033719+0000","last_change":"2023-07-21T22:39:03.033719+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033719+0000","last_undegraded":"2023-07-21T22:39:03.033719+0000","last_fullsized":"2023-07-21T22:39:03.033719+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.049373+0000","last_change":"2023-07-21T22:39:03.040678+0000","last_active":"2023-07-21T22:39:03.049373+0000","last_peered":"2023-07-21T22:39:03.049373+0000","last_clean":"2023-07-21T22:39:03.049373+0000","last_became_active":"2023-07-21T22:39:03.040326+0000","last_became_peered":"2023-07-21T22:39:03.040326+0000","last_unstale":"2023-07-21T22:39:03.049373+0000","last_undegraded":"2023-07-21T22:39:03.049373+0000","last_fullsized":"2023-07-21T22:39:03.049373+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:25:50.691637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032262+0000","last_change":"2023-07-21T22:39:03.032262+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032262+0000","last_undegraded":"2023-07-21T22:39:03.032262+0000","last_fullsized":"2023-07-21T22:39:03.032262+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.045930+0000","last_change":"2023-07-21T22:39:03.044385+0000","last_active":"2023-07-21T22:39:03.045930+0000","last_peered":"2023-07-21T22:39:03.045930+0000","last_clean":"2023-07-21T22:39:03.045930+0000","last_became_active":"2023-07-21T22:39:03.044051+0000","last_became_peered":"2023-07-21T22:39:03.044051+0000","last_unstale":"2023-07-21T22:39:03.045930+0000","last_undegraded":"2023-07-21T22:39:03.045930+0000","last_fullsized":"2023-07-21T22:39:03.045930+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:40:22.537231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.030951+0000","last_change":"2023-07-21T22:39:03.030951+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.030951+0000","last_undegraded":"2023-07-21T22:39:03.030951+0000","last_fullsized":"2023-07-21T22:39:03.030951+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.045614+0000","last_change":"2023-07-21T22:39:03.043464+0000","last_active":"2023-07-21T22:39:03.045614+0000","last_peered":"2023-07-21T22:39:03.045614+0000","last_clean":"2023-07-21T22:39:03.045614+0000","last_became_active":"2023-07-21T22:39:03.043147+0000","last_became_peered":"2023-07-21T22:39:03.043147+0000","last_unstale":"2023-07-21T22:39:03.045614+0000","last_undegraded":"2023-07-21T22:39:03.045614+0000","last_fullsized":"2023-07-21T22:39:03.045614+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:36:56.767831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.030440+0000","last_change":"2023-07-21T22:39:03.030440+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.030440+0000","last_undegraded":"2023-07-21T22:39:03.030440+0000","last_fullsized":"2023-07-21T22:39:03.030440+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.056237+0000","last_change":"2023-07-21T22:39:03.053112+0000","last_active":"2023-07-21T22:39:03.056237+0000","last_peered":"2023-07-21T22:39:03.056237+0000","last_clean":"2023-07-21T22:39:03.056237+0000","last_became_active":"2023-07-21T22:39:03.052821+0000","last_became_peered":"2023-07-21T22:39:03.052821+0000","last_unstale":"2023-07-21T22:39:03.056237+0000","last_undegraded":"2023-07-21T22:39:03.056237+0000","last_fullsized":"2023-07-21T22:39:03.056237+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:10.156412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035197+0000","last_change":"2023-07-21T22:39:03.035197+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035197+0000","last_undegraded":"2023-07-21T22:39:03.035197+0000","last_fullsized":"2023-07-21T22:39:03.035197+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.046432+0000","last_change":"2023-07-21T22:39:03.042529+0000","last_active":"2023-07-21T22:39:03.046432+0000","last_peered":"2023-07-21T22:39:03.046432+0000","last_clean":"2023-07-21T22:39:03.046432+0000","last_became_active":"2023-07-21T22:39:03.042254+0000","last_became_peered":"2023-07-21T22:39:03.042254+0000","last_unstale":"2023-07-21T22:39:03.046432+0000","last_undegraded":"2023-07-21T22:39:03.046432+0000","last_fullsized":"2023-07-21T22:39:03.046432+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:52.040683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.029169+0000","last_change":"2023-07-21T22:39:03.029169+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.029169+0000","last_undegraded":"2023-07-21T22:39:03.029169+0000","last_fullsized":"2023-07-21T22:39:03.029169+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.048201+0000","last_change":"2023-07-21T22:39:03.045034+0000","last_active":"2023-07-21T22:39:03.048201+0000","last_peered":"2023-07-21T22:39:03.048201+0000","last_clean":"2023-07-21T22:39:03.048201+0000","last_became_active":"2023-07-21T22:39:03.044569+0000","last_became_peered":"2023-07-21T22:39:03.044569+0000","last_unstale":"2023-07-21T22:39:03.048201+0000","last_undegraded":"2023-07-21T22:39:03.048201+0000","last_fullsized":"2023-07-21T22:39:03.048201+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:24:01.085248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035264+0000","last_change":"2023-07-21T22:39:03.035264+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035264+0000","last_undegraded":"2023-07-21T22:39:03.035264+0000","last_fullsized":"2023-07-21T22:39:03.035264+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.045813+0000","last_change":"2023-07-21T22:39:03.043363+0000","last_active":"2023-07-21T22:39:03.045813+0000","last_peered":"2023-07-21T22:39:03.045813+0000","last_clean":"2023-07-21T22:39:03.045813+0000","last_became_active":"2023-07-21T22:39:03.043036+0000","last_became_peered":"2023-07-21T22:39:03.043036+0000","last_unstale":"2023-07-21T22:39:03.045813+0000","last_undegraded":"2023-07-21T22:39:03.045813+0000","last_fullsized":"2023-07-21T22:39:03.045813+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:38:21.996057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.045397+0000","last_change":"2023-07-21T22:39:03.045397+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.045397+0000","last_undegraded":"2023-07-21T22:39:03.045397+0000","last_fullsized":"2023-07-21T22:39:03.045397+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.045916+0000","last_change":"2023-07-21T22:39:03.044365+0000","last_active":"2023-07-21T22:39:03.045916+0000","last_peered":"2023-07-21T22:39:03.045916+0000","last_clean":"2023-07-21T22:39:03.045916+0000","last_became_active":"2023-07-21T22:39:03.044104+0000","last_became_peered":"2023-07-21T22:39:03.044104+0000","last_unstale":"2023-07-21T22:39:03.045916+0000","last_undegraded":"2023-07-21T22:39:03.045916+0000","last_fullsized":"2023-07-21T22:39:03.045916+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:55:34.402372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033267+0000","last_change":"2023-07-21T22:39:03.033267+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033267+0000","last_undegraded":"2023-07-21T22:39:03.033267+0000","last_fullsized":"2023-07-21T22:39:03.033267+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.047438+0000","last_change":"2023-07-21T22:39:03.044807+0000","last_active":"2023-07-21T22:39:03.047438+0000","last_peered":"2023-07-21T22:39:03.047438+0000","last_clean":"2023-07-21T22:39:03.047438+0000","last_became_active":"2023-07-21T22:39:03.044482+0000","last_became_peered":"2023-07-21T22:39:03.044482+0000","last_unstale":"2023-07-21T22:39:03.047438+0000","last_undegraded":"2023-07-21T22:39:03.047438+0000","last_fullsized":"2023-07-21T22:39:03.047438+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:31:44.130740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.027521+0000","last_change":"2023-07-21T22:39:03.027521+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.027521+0000","last_undegraded":"2023-07-21T22:39:03.027521+0000","last_fullsized":"2023-07-21T22:39:03.027521+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.045761+0000","last_change":"2023-07-21T22:39:03.043971+0000","last_active":"2023-07-21T22:39:03.045761+0000","last_peered":"2023-07-21T22:39:03.045761+0000","last_clean":"2023-07-21T22:39:03.045761+0000","last_became_active":"2023-07-21T22:39:03.043698+0000","last_became_peered":"2023-07-21T22:39:03.043698+0000","last_unstale":"2023-07-21T22:39:03.045761+0000","last_undegraded":"2023-07-21T22:39:03.045761+0000","last_fullsized":"2023-07-21T22:39:03.045761+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:33:33.644414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.029054+0000","last_change":"2023-07-21T22:39:03.029054+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.029054+0000","last_undegraded":"2023-07-21T22:39:03.029054+0000","last_fullsized":"2023-07-21T22:39:03.029054+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.056204+0000","last_change":"2023-07-21T22:39:03.052780+0000","last_active":"2023-07-21T22:39:03.056204+0000","last_peered":"2023-07-21T22:39:03.056204+0000","last_clean":"2023-07-21T22:39:03.056204+0000","last_became_active":"2023-07-21T22:39:03.052324+0000","last_became_peered":"2023-07-21T22:39:03.052324+0000","last_unstale":"2023-07-21T22:39:03.056204+0000","last_undegraded":"2023-07-21T22:39:03.056204+0000","last_fullsized":"2023-07-21T22:39:03.056204+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:42:19.254396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.027536+0000","last_change":"2023-07-21T22:39:03.027536+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.027536+0000","last_undegraded":"2023-07-21T22:39:03.027536+0000","last_fullsized":"2023-07-21T22:39:03.027536+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.051018+0000","last_change":"2023-07-21T22:39:03.049975+0000","last_active":"2023-07-21T22:39:03.051018+0000","last_peered":"2023-07-21T22:39:03.051018+0000","last_clean":"2023-07-21T22:39:03.051018+0000","last_became_active":"2023-07-21T22:39:03.049641+0000","last_became_peered":"2023-07-21T22:39:03.049641+0000","last_unstale":"2023-07-21T22:39:03.051018+0000","last_undegraded":"2023-07-21T22:39:03.051018+0000","last_fullsized":"2023-07-21T22:39:03.051018+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:47:53.393380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.038663+0000","last_change":"2023-07-21T22:39:03.038663+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.038663+0000","last_undegraded":"2023-07-21T22:39:03.038663+0000","last_fullsized":"2023-07-21T22:39:03.038663+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.047406+0000","last_change":"2023-07-21T22:39:03.039410+0000","last_active":"2023-07-21T22:39:03.047406+0000","last_peered":"2023-07-21T22:39:03.047406+0000","last_clean":"2023-07-21T22:39:03.047406+0000","last_became_active":"2023-07-21T22:39:03.039134+0000","last_became_peered":"2023-07-21T22:39:03.039134+0000","last_unstale":"2023-07-21T22:39:03.047406+0000","last_undegraded":"2023-07-21T22:39:03.047406+0000","last_fullsized":"2023-07-21T22:39:03.047406+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:04:32.243820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035845+0000","last_change":"2023-07-21T22:39:03.035845+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035845+0000","last_undegraded":"2023-07-21T22:39:03.035845+0000","last_fullsized":"2023-07-21T22:39:03.035845+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.056252+0000","last_change":"2023-07-21T22:39:03.053328+0000","last_active":"2023-07-21T22:39:03.056252+0000","last_peered":"2023-07-21T22:39:03.056252+0000","last_clean":"2023-07-21T22:39:03.056252+0000","last_became_active":"2023-07-21T22:39:03.052955+0000","last_became_peered":"2023-07-21T22:39:03.052955+0000","last_unstale":"2023-07-21T22:39:03.056252+0000","last_undegraded":"2023-07-21T22:39:03.056252+0000","last_fullsized":"2023-07-21T22:39:03.056252+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:36:43.080644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"145'271","reported_seq":949,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.038366+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:39:03.038366+0000","last_peered":"2023-07-21T22:39:03.038366+0000","last_clean":"2023-07-21T22:39:03.038366+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:39:03.038366+0000","last_undegraded":"2023-07-21T22:39:03.038366+0000","last_fullsized":"2023-07-21T22:39:03.038366+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:19:57.210171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":276,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.034179+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:39:03.034179+0000","last_peered":"2023-07-21T22:39:03.034179+0000","last_clean":"2023-07-21T22:39:03.034179+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:39:03.034179+0000","last_undegraded":"2023-07-21T22:39:03.034179+0000","last_fullsized":"2023-07-21T22:39:03.034179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:32:45.245980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.043333+0000","last_change":"2023-07-21T22:39:03.043333+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.043333+0000","last_undegraded":"2023-07-21T22:39:03.043333+0000","last_fullsized":"2023-07-21T22:39:03.043333+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.051247+0000","last_change":"2023-07-21T22:39:03.045628+0000","last_active":"2023-07-21T22:39:03.051247+0000","last_peered":"2023-07-21T22:39:03.051247+0000","last_clean":"2023-07-21T22:39:03.051247+0000","last_became_active":"2023-07-21T22:39:03.044601+0000","last_became_peered":"2023-07-21T22:39:03.044601+0000","last_unstale":"2023-07-21T22:39:03.051247+0000","last_undegraded":"2023-07-21T22:39:03.051247+0000","last_fullsized":"2023-07-21T22:39:03.051247+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:02:30.920665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":247,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.038231+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:39:03.038231+0000","last_peered":"2023-07-21T22:39:03.038231+0000","last_clean":"2023-07-21T22:39:03.038231+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:39:03.038231+0000","last_undegraded":"2023-07-21T22:39:03.038231+0000","last_fullsized":"2023-07-21T22:39:03.038231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:51:43.481525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.033051+0000","last_change":"2023-07-21T22:39:03.033051+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.033051+0000","last_undegraded":"2023-07-21T22:39:03.033051+0000","last_fullsized":"2023-07-21T22:39:03.033051+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.048052+0000","last_change":"2023-07-21T22:39:03.046544+0000","last_active":"2023-07-21T22:39:03.048052+0000","last_peered":"2023-07-21T22:39:03.048052+0000","last_clean":"2023-07-21T22:39:03.048052+0000","last_became_active":"2023-07-21T22:39:03.046251+0000","last_became_peered":"2023-07-21T22:39:03.046251+0000","last_unstale":"2023-07-21T22:39:03.048052+0000","last_undegraded":"2023-07-21T22:39:03.048052+0000","last_fullsized":"2023-07-21T22:39:03.048052+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:25:00.614842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":248,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.034354+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:39:03.034354+0000","last_peered":"2023-07-21T22:39:03.034354+0000","last_clean":"2023-07-21T22:39:03.034354+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:39:03.034354+0000","last_undegraded":"2023-07-21T22:39:03.034354+0000","last_fullsized":"2023-07-21T22:39:03.034354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:26.401604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.032057+0000","last_change":"2023-07-21T22:39:03.032057+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.032057+0000","last_undegraded":"2023-07-21T22:39:03.032057+0000","last_fullsized":"2023-07-21T22:39:03.032057+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.047977+0000","last_change":"2023-07-21T22:39:03.044488+0000","last_active":"2023-07-21T22:39:03.047977+0000","last_peered":"2023-07-21T22:39:03.047977+0000","last_clean":"2023-07-21T22:39:03.047977+0000","last_became_active":"2023-07-21T22:39:03.044193+0000","last_became_peered":"2023-07-21T22:39:03.044193+0000","last_unstale":"2023-07-21T22:39:03.047977+0000","last_undegraded":"2023-07-21T22:39:03.047977+0000","last_fullsized":"2023-07-21T22:39:03.047977+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:06:43.937701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":276,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.034839+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:39:03.034839+0000","last_peered":"2023-07-21T22:39:03.034839+0000","last_clean":"2023-07-21T22:39:03.034839+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:39:03.034839+0000","last_undegraded":"2023-07-21T22:39:03.034839+0000","last_fullsized":"2023-07-21T22:39:03.034839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:55:25.947163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035385+0000","last_change":"2023-07-21T22:39:03.035385+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035385+0000","last_undegraded":"2023-07-21T22:39:03.035385+0000","last_fullsized":"2023-07-21T22:39:03.035385+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.052388+0000","last_change":"2023-07-21T22:39:03.050012+0000","last_active":"2023-07-21T22:39:03.052388+0000","last_peered":"2023-07-21T22:39:03.052388+0000","last_clean":"2023-07-21T22:39:03.052388+0000","last_became_active":"2023-07-21T22:39:03.049736+0000","last_became_peered":"2023-07-21T22:39:03.049736+0000","last_unstale":"2023-07-21T22:39:03.052388+0000","last_undegraded":"2023-07-21T22:39:03.052388+0000","last_fullsized":"2023-07-21T22:39:03.052388+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:32:19.696421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":260,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.025080+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:39:03.025080+0000","last_peered":"2023-07-21T22:39:03.025080+0000","last_clean":"2023-07-21T22:39:03.025080+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:39:03.025080+0000","last_undegraded":"2023-07-21T22:39:03.025080+0000","last_fullsized":"2023-07-21T22:39:03.025080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:48:23.151070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.035875+0000","last_change":"2023-07-21T22:39:03.035875+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.035875+0000","last_undegraded":"2023-07-21T22:39:03.035875+0000","last_fullsized":"2023-07-21T22:39:03.035875+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.056302+0000","last_change":"2023-07-21T22:39:03.053828+0000","last_active":"2023-07-21T22:39:03.056302+0000","last_peered":"2023-07-21T22:39:03.056302+0000","last_clean":"2023-07-21T22:39:03.056302+0000","last_became_active":"2023-07-21T22:39:03.053526+0000","last_became_peered":"2023-07-21T22:39:03.053526+0000","last_unstale":"2023-07-21T22:39:03.056302+0000","last_undegraded":"2023-07-21T22:39:03.056302+0000","last_fullsized":"2023-07-21T22:39:03.056302+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:01:46.815106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":246,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.039659+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:39:03.039659+0000","last_peered":"2023-07-21T22:39:03.039659+0000","last_clean":"2023-07-21T22:39:03.039659+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:39:03.039659+0000","last_undegraded":"2023-07-21T22:39:03.039659+0000","last_fullsized":"2023-07-21T22:39:03.039659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:04:04.247394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.029967+0000","last_change":"2023-07-21T22:39:03.029967+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.029967+0000","last_undegraded":"2023-07-21T22:39:03.029967+0000","last_fullsized":"2023-07-21T22:39:03.029967+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.046346+0000","last_change":"2023-07-21T22:39:03.042778+0000","last_active":"2023-07-21T22:39:03.046346+0000","last_peered":"2023-07-21T22:39:03.046346+0000","last_clean":"2023-07-21T22:39:03.046346+0000","last_became_active":"2023-07-21T22:39:03.042441+0000","last_became_peered":"2023-07-21T22:39:03.042441+0000","last_unstale":"2023-07-21T22:39:03.046346+0000","last_undegraded":"2023-07-21T22:39:03.046346+0000","last_fullsized":"2023-07-21T22:39:03.046346+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:01:29.405460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":260,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.024412+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:39:03.024412+0000","last_peered":"2023-07-21T22:39:03.024412+0000","last_clean":"2023-07-21T22:39:03.024412+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:39:03.024412+0000","last_undegraded":"2023-07-21T22:39:03.024412+0000","last_fullsized":"2023-07-21T22:39:03.024412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:51:30.283493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":155,"state":"creating+peering","last_fresh":"2023-07-21T22:39:03.029529+0000","last_change":"2023-07-21T22:39:03.029529+0000","last_active":"2023-07-21T22:39:03.013057+0000","last_peered":"2023-07-21T22:39:03.013057+0000","last_clean":"2023-07-21T22:39:03.013057+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:39:03.029529+0000","last_undegraded":"2023-07-21T22:39:03.029529+0000","last_fullsized":"2023-07-21T22:39:03.029529+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.048225+0000","last_change":"2023-07-21T22:39:03.045134+0000","last_active":"2023-07-21T22:39:03.048225+0000","last_peered":"2023-07-21T22:39:03.048225+0000","last_clean":"2023-07-21T22:39:03.048225+0000","last_became_active":"2023-07-21T22:39:03.044863+0000","last_became_peered":"2023-07-21T22:39:03.044863+0000","last_unstale":"2023-07-21T22:39:03.048225+0000","last_undegraded":"2023-07-21T22:39:03.048225+0000","last_fullsized":"2023-07-21T22:39:03.048225+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:04:09.984484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":242,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-07-21T22:39:03.044313+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:39:03.044313+0000","last_peered":"2023-07-21T22:39:03.044313+0000","last_clean":"2023-07-21T22:39:03.044313+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:39:03.044313+0000","last_undegraded":"2023-07-21T22:39:03.044313+0000","last_fullsized":"2023-07-21T22:39:03.044313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:36:27.715879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509682,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59744,"kb_used_data":2456,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312096,"statfs":{"total":96636764160,"available":96575586304,"internally_reserved":0,"allocated":2514944,"data_stored":1564775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.69099999999999995,"15min":0.73199999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.35299999999999998},"max":{"1min":0.876,"5min":1.1180000000000001,"15min":3.5059999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66400000000000003,"15min":0.69399999999999995},"min":{"1min":0.46200000000000002,"5min":0.40899999999999997,"15min":0.39500000000000002},"max":{"1min":0.94199999999999995,"5min":0.94399999999999995,"15min":3.2709999999999999},"last":0.626}]},{"osd":1,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.70599999999999996,"15min":0.72799999999999998},"min":{"1min":0.49199999999999999,"5min":0.44900000000000001,"15min":0.432},"max":{"1min":0.98599999999999999,"5min":1.0680000000000001,"15min":1.5429999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.71299999999999997},"min":{"1min":0.44800000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96499999999999997,"5min":1.093,"15min":1.093},"last":0.71599999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70899999999999996,"15min":0.73599999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":1.1399999999999999,"15min":1.405},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73199999999999998,"15min":0.746},"min":{"1min":0.55100000000000005,"5min":0.47999999999999998,"15min":0.45800000000000002},"max":{"1min":0.92800000000000005,"5min":1.083,"15min":1.409},"last":0.66100000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75900000000000001,"15min":0.76500000000000001},"min":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0209999999999999,"5min":1.1539999999999999,"15min":1.46},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.48599999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94899999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.67700000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55700000000000005,"15min":0.56200000000000006},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.36199999999999999},"max":{"1min":0.67500000000000004,"5min":0.90000000000000002,"15min":0.94999999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.40899999999999997,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82299999999999995,"5min":0.97399999999999998,"15min":1.7949999999999999},"last":0.501}]},{"osd":5,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.626},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.89700000000000002,"5min":0.98799999999999999,"15min":2.2120000000000002},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70199999999999996,"15min":0.68100000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.38300000000000001},"max":{"1min":0.95199999999999996,"5min":1.052,"15min":1.506},"last":0.69499999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69499999999999995,"15min":0.68100000000000005},"min":{"1min":0.53700000000000003,"5min":0.44900000000000001,"15min":0.41999999999999998},"max":{"1min":0.93500000000000005,"5min":1.0329999999999999,"15min":1.048},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.42699999999999999},"max":{"1min":0.91300000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.58399999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542388,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37008,"kb_used_data":1864,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334832,"statfs":{"total":96636764160,"available":96598867968,"internally_reserved":0,"allocated":1908736,"data_stored":967715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.755},"min":{"1min":0.47099999999999997,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.94399999999999995,"5min":1.016,"15min":1.016},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.437},"max":{"1min":0.96799999999999997,"5min":1.0289999999999999,"15min":1.1180000000000001},"last":0.90200000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.70099999999999996,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.49099999999999999,"15min":0.45300000000000001},"max":{"1min":0.872,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.45800000000000002,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.93300000000000005,"5min":0.99199999999999999,"15min":1.117},"last":0.82899999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71099999999999997,"15min":0.74199999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.42799999999999999},"max":{"1min":0.89600000000000002,"5min":0.98099999999999998,"15min":0.997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.78700000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.45500000000000002},"max":{"1min":0.98199999999999998,"5min":1.0149999999999999,"15min":1.097},"last":0.88700000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71999999999999997,"15min":0.748},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":1.048,"15min":1.048},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70499999999999996,"15min":0.72899999999999998},"min":{"1min":0.52300000000000002,"5min":0.49399999999999999,"15min":0.46899999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0049999999999999},"last":0.76300000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.93400000000000005,"15min":1.0229999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.39700000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.95599999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.054},"last":0.92200000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70299999999999996,"15min":0.68100000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.443},"max":{"1min":1.024,"5min":1.024,"15min":1.079},"last":0.995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.86899999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509681,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50960,"kb_used_data":1864,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320880,"statfs":{"total":96636764160,"available":96584581120,"internally_reserved":0,"allocated":1908736,"data_stored":967715,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.70999999999999996},"min":{"1min":0.48099999999999998,"5min":0.38500000000000001,"15min":0.35699999999999998},"max":{"1min":0.96499999999999997,"5min":1,"15min":1.8779999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.97999999999999998,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.68600000000000005,"15min":0.70299999999999996},"min":{"1min":0.505,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.95899999999999996,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69099999999999995,"15min":0.72099999999999997},"min":{"1min":0.42699999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.617},"last":0.68400000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71099999999999997,"15min":0.72699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.33600000000000002},"max":{"1min":1.008,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.42199999999999999,"15min":0.377},"max":{"1min":0.89300000000000002,"5min":1.073,"15min":1.512},"last":0.73399999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76900000000000002,"15min":0.77800000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":1.0009999999999999,"15min":1.472},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76000000000000001,"15min":0.78700000000000003},"min":{"1min":0.60099999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.997,"5min":1.022,"15min":1.556},"last":0.66000000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.372,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83699999999999997,"5min":0.88900000000000001,"15min":0.96999999999999997},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72399999999999998,"15min":0.69599999999999995},"min":{"1min":0.58899999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.92300000000000004,"5min":0.92400000000000004,"15min":1.038},"last":0.754}]},{"osd":6,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":0.95499999999999996,"15min":1.0049999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.40200000000000002,"15min":0.40000000000000002},"max":{"1min":0.76600000000000001,"5min":0.93799999999999994,"15min":1.02},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70099999999999996,"15min":0.65700000000000003},"min":{"1min":0.46200000000000002,"5min":0.40999999999999998,"15min":0.374},"max":{"1min":0.96699999999999997,"5min":1.042,"15min":1.042},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":0.73099999999999998},"min":{"1min":0.59799999999999998,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.88300000000000001,"5min":0.999,"15min":1.7390000000000001},"last":0.78300000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509682,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1876,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1921024,"data_stored":974407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68300000000000005,"15min":0.72999999999999998},"min":{"1min":0.48599999999999999,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":0.93600000000000005,"5min":1.077,"15min":1.077},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68899999999999995,"15min":0.72999999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89800000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.66900000000000004,"15min":0.69699999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92200000000000004,"5min":1.044,"15min":1.044},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65600000000000003,"15min":0.69499999999999995},"min":{"1min":0.53100000000000003,"5min":0.43099999999999999,"15min":0.36899999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.96399999999999997},"last":0.754}]},{"osd":2,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.70499999999999996,"15min":0.746},"min":{"1min":0.441,"5min":0.441,"15min":0.371},"max":{"1min":0.88500000000000001,"5min":1.052,"15min":1.052},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71499999999999997,"15min":0.75700000000000001},"min":{"1min":0.501,"5min":0.47699999999999998,"15min":0.33000000000000002},"max":{"1min":0.89300000000000002,"5min":1.018,"15min":1.0660000000000001},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68000000000000005,"15min":0.72199999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.40100000000000002},"max":{"1min":0.90000000000000002,"5min":0.94599999999999995,"15min":1.0169999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.77500000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47999999999999998},"max":{"1min":0.94899999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.86199999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61099999999999999,"15min":0.58399999999999996},"min":{"1min":0.44400000000000001,"5min":0.35799999999999998,"15min":0.34399999999999997},"max":{"1min":0.86399999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.42799999999999999,"5min":0.42699999999999999,"15min":0.32800000000000001},"max":{"1min":0.82299999999999995,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.73399999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.439,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.90900000000000003,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72299999999999998,"15min":0.71599999999999997},"min":{"1min":0.48499999999999999,"5min":0.443,"15min":0.41599999999999998},"max":{"1min":0.96299999999999997,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.39200000000000002},"max":{"1min":0.93999999999999995,"5min":1.028,"15min":1.028},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.47199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97099999999999997,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.89700000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509681,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1876,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1921024,"data_stored":974407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46899999999999997,"15min":0.47499999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":0.77800000000000002,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.45100000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46200000000000002,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60299999999999998,"5min":0.754,"15min":0.83499999999999996},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.41999999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71899999999999997,"5min":0.82599999999999996,"15min":0.90100000000000002},"last":0.41999999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67600000000000005,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.374},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.59599999999999997},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.99199999999999999},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.755,"15min":0.77000000000000002},"min":{"1min":0.57599999999999996,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91200000000000003,"5min":1.093,"15min":1.1279999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.81399999999999995},"min":{"1min":0.54500000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.93200000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.84399999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.76900000000000002},"min":{"1min":0.54900000000000004,"5min":0.501,"15min":0.48999999999999999},"max":{"1min":0.97799999999999998,"5min":1.0669999999999999,"15min":1.137},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.51300000000000001,"15min":0.42899999999999999},"max":{"1min":0.86399999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.82699999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76900000000000002,"15min":0.79000000000000004},"min":{"1min":0.51900000000000002,"5min":0.51700000000000002,"15min":0.47399999999999998},"max":{"1min":0.91700000000000004,"5min":1.0680000000000001,"15min":1.169},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91300000000000003,"5min":1.107,"15min":1.1120000000000001},"last":0.88200000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79200000000000004,"15min":0.81299999999999994},"min":{"1min":0.621,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94299999999999995,"5min":1.083,"15min":1.099},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80900000000000005,"15min":0.82799999999999996},"min":{"1min":0.61299999999999999,"5min":0.55200000000000005,"15min":0.48599999999999999},"max":{"1min":0.92200000000000004,"5min":1.623,"15min":1.623},"last":0.90100000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509683,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55068,"kb_used_data":1876,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316772,"statfs":{"total":96636764160,"available":96580374528,"internally_reserved":0,"allocated":1921024,"data_stored":974407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.46400000000000002},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.23899999999999999},"max":{"1min":0.624,"5min":0.75,"15min":0.94199999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50600000000000001,"15min":0.54100000000000004},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.308},"max":{"1min":0.64200000000000002,"5min":0.88300000000000001,"15min":1.0409999999999999},"last":0.44700000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.40699999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72599999999999998,"5min":0.86699999999999999,"15min":0.93999999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.012,"15min":1.085},"last":0.52700000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46300000000000002,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.623,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.56399999999999995},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.85299999999999998,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.46600000000000003,"15min":0.376},"max":{"1min":1.016,"5min":1.1579999999999999,"15min":1.3420000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73599999999999999,"15min":0.78500000000000003},"min":{"1min":0.48899999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.996,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0780000000000001,"5min":1.214,"15min":1.214},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77700000000000002,"15min":0.80600000000000005},"min":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.46400000000000002},"max":{"1min":1.012,"5min":1.2689999999999999,"15min":1.3089999999999999},"last":0.73799999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.746,"15min":0.78300000000000003},"min":{"1min":0.52800000000000002,"5min":0.499,"15min":0.40300000000000002},"max":{"1min":0.94399999999999995,"5min":1.536,"15min":1.536},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.46200000000000002},"max":{"1min":1.0289999999999999,"5min":1.1339999999999999,"15min":1.2649999999999999},"last":0.79200000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77500000000000002,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.008,"5min":1.143,"15min":1.214},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.751,"15min":0.79700000000000004},"min":{"1min":0.58899999999999997,"5min":0.50900000000000001,"15min":0.44700000000000001},"max":{"1min":0.91200000000000003,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.72599999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509682,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1876,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1921024,"data_stored":974407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.47499999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.22900000000000001},"max":{"1min":0.60399999999999998,"5min":0.78700000000000003,"15min":0.84599999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54100000000000004,"15min":0.55900000000000005},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.35099999999999998},"max":{"1min":0.80900000000000005,"5min":0.82499999999999996,"15min":0.872},"last":0.57599999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48999999999999999,"15min":0.502},"min":{"1min":0.36199999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"max":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":0.81000000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.29099999999999998},"max":{"1min":0.71899999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.42299999999999999,"5min":0.378,"15min":0.33400000000000002},"max":{"1min":0.76100000000000001,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":0.77600000000000002,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.371}]},{"osd":4,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.432},"max":{"1min":1.115,"5min":1.294,"15min":1.294},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77800000000000002,"15min":0.79000000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.498},"max":{"1min":1.1220000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.753,"15min":0.77200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.41899999999999998},"max":{"1min":1.0980000000000001,"5min":1.242,"15min":1.242},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.55700000000000005,"5min":0.51500000000000001,"15min":0.376},"max":{"1min":1.1639999999999999,"5min":1.276,"15min":1.2849999999999999},"last":0.77300000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77700000000000002,"15min":0.80000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.47899999999999998},"max":{"1min":1.0800000000000001,"5min":1.208,"15min":1.23},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.78100000000000003},"min":{"1min":0.56100000000000005,"5min":0.50900000000000001,"15min":0.46500000000000002},"max":{"1min":1.0109999999999999,"5min":1.244,"15min":1.3240000000000001},"last":0.66500000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78500000000000003,"15min":0.80400000000000005},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.49199999999999999},"max":{"1min":1.089,"5min":1.3120000000000001,"15min":1.3149999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.45700000000000002},"max":{"1min":1.0289999999999999,"5min":1.1819999999999999,"15min":1.3380000000000001},"last":0.86399999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509684,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37600,"kb_used_data":2456,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334240,"statfs":{"total":96636764160,"available":96598261760,"internally_reserved":0,"allocated":2514944,"data_stored":1564775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.33200000000000002,"5min":0.28399999999999997,"15min":0.26600000000000001},"max":{"1min":0.66300000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.495},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50900000000000001,"15min":0.51600000000000001},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.70599999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.36599999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.41599999999999998,"5min":0.32400000000000001,"15min":0.29799999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.3680000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.49099999999999999,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.871},"last":0.438}]},{"osd":3,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.432,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81899999999999995,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.33700000000000002},"max":{"1min":0.83599999999999997,"5min":0.88600000000000001,"15min":1.038},"last":0.60499999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.81000000000000005,"15min":0.78400000000000003},"min":{"1min":0.56899999999999995,"5min":0.499,"15min":0.45200000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.80500000000000005,"15min":0.80000000000000004},"min":{"1min":0.57899999999999996,"5min":0.505,"15min":0.44600000000000001},"max":{"1min":1.206,"5min":1.278,"15min":1.423},"last":0.79400000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.59599999999999997,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.0089999999999999,"5min":1.0960000000000001,"15min":1.2669999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80500000000000005,"15min":0.80300000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.39600000000000002},"max":{"1min":1.119,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.48899999999999999},"max":{"1min":1.2210000000000001,"5min":1.27,"15min":1.27},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.65500000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.90500000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80700000000000005,"15min":0.79500000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.53100000000000003},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80200000000000005,"15min":0.82199999999999995},"min":{"1min":0.58999999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1479999999999999,"5min":1.1930000000000001,"15min":1.296},"last":0.97699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:39:08.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3f is not active+clean 2023-07-21T22:39:08.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.031755+0000', 'last_change': '2023-07-21T22:39:03.031755+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.031755+0000', 'last_undegraded': '2023-07-21T22:39:03.031755+0000', 'last_fullsized': '2023-07-21T22:39:03.031755+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:39:08.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3e is not active+clean 2023-07-21T22:39:08.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.035392+0000', 'last_change': '2023-07-21T22:39:03.035392+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.035392+0000', 'last_undegraded': '2023-07-21T22:39:03.035392+0000', 'last_fullsized': '2023-07-21T22:39:03.035392+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:39:08.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3d is not active+clean 2023-07-21T22:39:08.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.037166+0000', 'last_change': '2023-07-21T22:39:03.037166+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.037166+0000', 'last_undegraded': '2023-07-21T22:39:03.037166+0000', 'last_fullsized': '2023-07-21T22:39:03.037166+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:39:08.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3c is not active+clean 2023-07-21T22:39:08.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.033602+0000', 'last_change': '2023-07-21T22:39:03.033602+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.033602+0000', 'last_undegraded': '2023-07-21T22:39:03.033602+0000', 'last_fullsized': '2023-07-21T22:39:03.033602+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:39:08.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3b is not active+clean 2023-07-21T22:39:08.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.029514+0000', 'last_change': '2023-07-21T22:39:03.029514+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.029514+0000', 'last_undegraded': '2023-07-21T22:39:03.029514+0000', 'last_fullsized': '2023-07-21T22:39:03.029514+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:39:08.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3a is not active+clean 2023-07-21T22:39:08.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.027710+0000', 'last_change': '2023-07-21T22:39:03.027710+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.027710+0000', 'last_undegraded': '2023-07-21T22:39:03.027710+0000', 'last_fullsized': '2023-07-21T22:39:03.027710+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:39:08.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.39 is not active+clean 2023-07-21T22:39:08.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.045495+0000', 'last_change': '2023-07-21T22:39:03.045495+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.045495+0000', 'last_undegraded': '2023-07-21T22:39:03.045495+0000', 'last_fullsized': '2023-07-21T22:39:03.045495+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:39:08.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.38 is not active+clean 2023-07-21T22:39:08.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.032274+0000', 'last_change': '2023-07-21T22:39:03.032274+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.032274+0000', 'last_undegraded': '2023-07-21T22:39:03.032274+0000', 'last_fullsized': '2023-07-21T22:39:03.032274+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:39:08.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.37 is not active+clean 2023-07-21T22:39:08.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.028120+0000', 'last_change': '2023-07-21T22:39:03.028120+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.028120+0000', 'last_undegraded': '2023-07-21T22:39:03.028120+0000', 'last_fullsized': '2023-07-21T22:39:03.028120+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:39:08.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.36 is not active+clean 2023-07-21T22:39:08.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.032516+0000', 'last_change': '2023-07-21T22:39:03.032516+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.032516+0000', 'last_undegraded': '2023-07-21T22:39:03.032516+0000', 'last_fullsized': '2023-07-21T22:39:03.032516+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:39:08.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.35 is not active+clean 2023-07-21T22:39:08.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.033779+0000', 'last_change': '2023-07-21T22:39:03.033779+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.033779+0000', 'last_undegraded': '2023-07-21T22:39:03.033779+0000', 'last_fullsized': '2023-07-21T22:39:03.033779+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:39:08.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.34 is not active+clean 2023-07-21T22:39:08.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.030463+0000', 'last_change': '2023-07-21T22:39:03.030463+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.030463+0000', 'last_undegraded': '2023-07-21T22:39:03.030463+0000', 'last_fullsized': '2023-07-21T22:39:03.030463+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:39:08.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.33 is not active+clean 2023-07-21T22:39:08.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.028563+0000', 'last_change': '2023-07-21T22:39:03.028563+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.028563+0000', 'last_undegraded': '2023-07-21T22:39:03.028563+0000', 'last_fullsized': '2023-07-21T22:39:03.028563+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:39:08.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.32 is not active+clean 2023-07-21T22:39:08.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.032620+0000', 'last_change': '2023-07-21T22:39:03.032620+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.032620+0000', 'last_undegraded': '2023-07-21T22:39:03.032620+0000', 'last_fullsized': '2023-07-21T22:39:03.032620+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:39:08.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.31 is not active+clean 2023-07-21T22:39:08.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.034073+0000', 'last_change': '2023-07-21T22:39:03.034073+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.034073+0000', 'last_undegraded': '2023-07-21T22:39:03.034073+0000', 'last_fullsized': '2023-07-21T22:39:03.034073+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:39:08.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.30 is not active+clean 2023-07-21T22:39:08.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.030541+0000', 'last_change': '2023-07-21T22:39:03.030541+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.030541+0000', 'last_undegraded': '2023-07-21T22:39:03.030541+0000', 'last_fullsized': '2023-07-21T22:39:03.030541+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:39:08.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2f is not active+clean 2023-07-21T22:39:08.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.027650+0000', 'last_change': '2023-07-21T22:39:03.027650+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.027650+0000', 'last_undegraded': '2023-07-21T22:39:03.027650+0000', 'last_fullsized': '2023-07-21T22:39:03.027650+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:39:08.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2e is not active+clean 2023-07-21T22:39:08.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.031440+0000', 'last_change': '2023-07-21T22:39:03.031440+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.031440+0000', 'last_undegraded': '2023-07-21T22:39:03.031440+0000', 'last_fullsized': '2023-07-21T22:39:03.031440+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:39:08.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2d is not active+clean 2023-07-21T22:39:08.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.038813+0000', 'last_change': '2023-07-21T22:39:03.038813+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.038813+0000', 'last_undegraded': '2023-07-21T22:39:03.038813+0000', 'last_fullsized': '2023-07-21T22:39:03.038813+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:39:08.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2c is not active+clean 2023-07-21T22:39:08.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.032698+0000', 'last_change': '2023-07-21T22:39:03.032698+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.032698+0000', 'last_undegraded': '2023-07-21T22:39:03.032698+0000', 'last_fullsized': '2023-07-21T22:39:03.032698+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:39:08.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2b is not active+clean 2023-07-21T22:39:09.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.033863+0000', 'last_change': '2023-07-21T22:39:03.033863+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.033863+0000', 'last_undegraded': '2023-07-21T22:39:03.033863+0000', 'last_fullsized': '2023-07-21T22:39:03.033863+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:39:09.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2a is not active+clean 2023-07-21T22:39:09.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.033051+0000', 'last_change': '2023-07-21T22:39:03.033051+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.033051+0000', 'last_undegraded': '2023-07-21T22:39:03.033051+0000', 'last_fullsized': '2023-07-21T22:39:03.033051+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:39:09.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.29 is not active+clean 2023-07-21T22:39:09.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.034683+0000', 'last_change': '2023-07-21T22:39:03.034683+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.034683+0000', 'last_undegraded': '2023-07-21T22:39:03.034683+0000', 'last_fullsized': '2023-07-21T22:39:03.034683+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:39:09.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.28 is not active+clean 2023-07-21T22:39:09.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.030099+0000', 'last_change': '2023-07-21T22:39:03.030099+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.030099+0000', 'last_undegraded': '2023-07-21T22:39:03.030099+0000', 'last_fullsized': '2023-07-21T22:39:03.030099+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:39:09.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.27 is not active+clean 2023-07-21T22:39:09.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.037595+0000', 'last_change': '2023-07-21T22:39:03.037595+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.037595+0000', 'last_undegraded': '2023-07-21T22:39:03.037595+0000', 'last_fullsized': '2023-07-21T22:39:03.037595+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:39:09.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.26 is not active+clean 2023-07-21T22:39:09.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.036711+0000', 'last_change': '2023-07-21T22:39:03.036711+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.036711+0000', 'last_undegraded': '2023-07-21T22:39:03.036711+0000', 'last_fullsized': '2023-07-21T22:39:03.036711+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:39:09.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.25 is not active+clean 2023-07-21T22:39:09.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.038301+0000', 'last_change': '2023-07-21T22:39:03.038301+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.038301+0000', 'last_undegraded': '2023-07-21T22:39:03.038301+0000', 'last_fullsized': '2023-07-21T22:39:03.038301+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:39:09.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.24 is not active+clean 2023-07-21T22:39:09.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.032779+0000', 'last_change': '2023-07-21T22:39:03.032779+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.032779+0000', 'last_undegraded': '2023-07-21T22:39:03.032779+0000', 'last_fullsized': '2023-07-21T22:39:03.032779+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:39:09.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.23 is not active+clean 2023-07-21T22:39:09.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.036335+0000', 'last_change': '2023-07-21T22:39:03.036335+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.036335+0000', 'last_undegraded': '2023-07-21T22:39:03.036335+0000', 'last_fullsized': '2023-07-21T22:39:03.036335+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:39:09.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.22 is not active+clean 2023-07-21T22:39:09.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.035927+0000', 'last_change': '2023-07-21T22:39:03.035927+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.035927+0000', 'last_undegraded': '2023-07-21T22:39:03.035927+0000', 'last_fullsized': '2023-07-21T22:39:03.035927+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:39:09.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.21 is not active+clean 2023-07-21T22:39:09.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.031055+0000', 'last_change': '2023-07-21T22:39:03.031055+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.031055+0000', 'last_undegraded': '2023-07-21T22:39:03.031055+0000', 'last_fullsized': '2023-07-21T22:39:03.031055+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:39:09.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.20 is not active+clean 2023-07-21T22:39:09.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.032720+0000', 'last_change': '2023-07-21T22:39:03.032720+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.032720+0000', 'last_undegraded': '2023-07-21T22:39:03.032720+0000', 'last_fullsized': '2023-07-21T22:39:03.032720+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:39:09.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.18 is not active+clean 2023-07-21T22:39:09.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.031801+0000', 'last_change': '2023-07-21T22:39:03.031801+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.031801+0000', 'last_undegraded': '2023-07-21T22:39:03.031801+0000', 'last_fullsized': '2023-07-21T22:39:03.031801+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:39:09.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.19 is not active+clean 2023-07-21T22:39:09.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.033616+0000', 'last_change': '2023-07-21T22:39:03.033616+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.033616+0000', 'last_undegraded': '2023-07-21T22:39:03.033616+0000', 'last_fullsized': '2023-07-21T22:39:03.033616+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:39:09.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1a is not active+clean 2023-07-21T22:39:09.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.034520+0000', 'last_change': '2023-07-21T22:39:03.034520+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.034520+0000', 'last_undegraded': '2023-07-21T22:39:03.034520+0000', 'last_fullsized': '2023-07-21T22:39:03.034520+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:39:09.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1b is not active+clean 2023-07-21T22:39:09.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.028874+0000', 'last_change': '2023-07-21T22:39:03.028874+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.028874+0000', 'last_undegraded': '2023-07-21T22:39:03.028874+0000', 'last_fullsized': '2023-07-21T22:39:03.028874+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:39:09.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1c is not active+clean 2023-07-21T22:39:09.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.031271+0000', 'last_change': '2023-07-21T22:39:03.031271+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.031271+0000', 'last_undegraded': '2023-07-21T22:39:03.031271+0000', 'last_fullsized': '2023-07-21T22:39:03.031271+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:39:09.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1d is not active+clean 2023-07-21T22:39:09.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.031605+0000', 'last_change': '2023-07-21T22:39:03.031605+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.031605+0000', 'last_undegraded': '2023-07-21T22:39:03.031605+0000', 'last_fullsized': '2023-07-21T22:39:03.031605+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:39:09.012 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1e is not active+clean 2023-07-21T22:39:09.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.030986+0000', 'last_change': '2023-07-21T22:39:03.030986+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.030986+0000', 'last_undegraded': '2023-07-21T22:39:03.030986+0000', 'last_fullsized': '2023-07-21T22:39:03.030986+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:39:09.013 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1f is not active+clean 2023-07-21T22:39:09.013 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.039311+0000', 'last_change': '2023-07-21T22:39:03.039311+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.039311+0000', 'last_undegraded': '2023-07-21T22:39:03.039311+0000', 'last_fullsized': '2023-07-21T22:39:03.039311+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:39:09.014 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.8 is not active+clean 2023-07-21T22:39:09.014 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.041058+0000', 'last_change': '2023-07-21T22:39:03.041058+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.041058+0000', 'last_undegraded': '2023-07-21T22:39:03.041058+0000', 'last_fullsized': '2023-07-21T22:39:03.041058+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:39:09.014 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.9 is not active+clean 2023-07-21T22:39:09.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.039376+0000', 'last_change': '2023-07-21T22:39:03.039376+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.039376+0000', 'last_undegraded': '2023-07-21T22:39:03.039376+0000', 'last_fullsized': '2023-07-21T22:39:03.039376+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:39:09.015 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.a is not active+clean 2023-07-21T22:39:09.015 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.040150+0000', 'last_change': '2023-07-21T22:39:03.040150+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.040150+0000', 'last_undegraded': '2023-07-21T22:39:03.040150+0000', 'last_fullsized': '2023-07-21T22:39:03.040150+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:39:09.016 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.b is not active+clean 2023-07-21T22:39:09.016 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.033719+0000', 'last_change': '2023-07-21T22:39:03.033719+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.033719+0000', 'last_undegraded': '2023-07-21T22:39:03.033719+0000', 'last_fullsized': '2023-07-21T22:39:03.033719+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:39:09.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.c is not active+clean 2023-07-21T22:39:09.017 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.032262+0000', 'last_change': '2023-07-21T22:39:03.032262+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.032262+0000', 'last_undegraded': '2023-07-21T22:39:03.032262+0000', 'last_fullsized': '2023-07-21T22:39:03.032262+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:39:09.017 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.d is not active+clean 2023-07-21T22:39:09.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.030951+0000', 'last_change': '2023-07-21T22:39:03.030951+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.030951+0000', 'last_undegraded': '2023-07-21T22:39:03.030951+0000', 'last_fullsized': '2023-07-21T22:39:03.030951+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:39:09.018 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.e is not active+clean 2023-07-21T22:39:09.018 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.030440+0000', 'last_change': '2023-07-21T22:39:03.030440+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.030440+0000', 'last_undegraded': '2023-07-21T22:39:03.030440+0000', 'last_fullsized': '2023-07-21T22:39:03.030440+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:39:09.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.f is not active+clean 2023-07-21T22:39:09.019 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.035197+0000', 'last_change': '2023-07-21T22:39:03.035197+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.035197+0000', 'last_undegraded': '2023-07-21T22:39:03.035197+0000', 'last_fullsized': '2023-07-21T22:39:03.035197+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:39:09.019 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.0 is not active+clean 2023-07-21T22:39:09.020 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.029169+0000', 'last_change': '2023-07-21T22:39:03.029169+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.029169+0000', 'last_undegraded': '2023-07-21T22:39:03.029169+0000', 'last_fullsized': '2023-07-21T22:39:03.029169+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:39:09.020 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1 is not active+clean 2023-07-21T22:39:09.020 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.035264+0000', 'last_change': '2023-07-21T22:39:03.035264+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.035264+0000', 'last_undegraded': '2023-07-21T22:39:03.035264+0000', 'last_fullsized': '2023-07-21T22:39:03.035264+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:39:09.021 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2 is not active+clean 2023-07-21T22:39:09.021 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.045397+0000', 'last_change': '2023-07-21T22:39:03.045397+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.045397+0000', 'last_undegraded': '2023-07-21T22:39:03.045397+0000', 'last_fullsized': '2023-07-21T22:39:03.045397+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:39:09.021 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3 is not active+clean 2023-07-21T22:39:09.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.033267+0000', 'last_change': '2023-07-21T22:39:03.033267+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.033267+0000', 'last_undegraded': '2023-07-21T22:39:03.033267+0000', 'last_fullsized': '2023-07-21T22:39:03.033267+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:39:09.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.4 is not active+clean 2023-07-21T22:39:09.022 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.027521+0000', 'last_change': '2023-07-21T22:39:03.027521+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.027521+0000', 'last_undegraded': '2023-07-21T22:39:03.027521+0000', 'last_fullsized': '2023-07-21T22:39:03.027521+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:39:09.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.5 is not active+clean 2023-07-21T22:39:09.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.029054+0000', 'last_change': '2023-07-21T22:39:03.029054+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.029054+0000', 'last_undegraded': '2023-07-21T22:39:03.029054+0000', 'last_fullsized': '2023-07-21T22:39:03.029054+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:39:09.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.6 is not active+clean 2023-07-21T22:39:09.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.027536+0000', 'last_change': '2023-07-21T22:39:03.027536+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.027536+0000', 'last_undegraded': '2023-07-21T22:39:03.027536+0000', 'last_fullsized': '2023-07-21T22:39:03.027536+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:39:09.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.7 is not active+clean 2023-07-21T22:39:09.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.038663+0000', 'last_change': '2023-07-21T22:39:03.038663+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.038663+0000', 'last_undegraded': '2023-07-21T22:39:03.038663+0000', 'last_fullsized': '2023-07-21T22:39:03.038663+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:39:09.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.15 is not active+clean 2023-07-21T22:39:09.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.035845+0000', 'last_change': '2023-07-21T22:39:03.035845+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.035845+0000', 'last_undegraded': '2023-07-21T22:39:03.035845+0000', 'last_fullsized': '2023-07-21T22:39:03.035845+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:39:09.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.16 is not active+clean 2023-07-21T22:39:09.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.043333+0000', 'last_change': '2023-07-21T22:39:03.043333+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.043333+0000', 'last_undegraded': '2023-07-21T22:39:03.043333+0000', 'last_fullsized': '2023-07-21T22:39:03.043333+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:39:09.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.17 is not active+clean 2023-07-21T22:39:09.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.033051+0000', 'last_change': '2023-07-21T22:39:03.033051+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.033051+0000', 'last_undegraded': '2023-07-21T22:39:03.033051+0000', 'last_fullsized': '2023-07-21T22:39:03.033051+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:39:09.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.14 is not active+clean 2023-07-21T22:39:09.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.032057+0000', 'last_change': '2023-07-21T22:39:03.032057+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.032057+0000', 'last_undegraded': '2023-07-21T22:39:03.032057+0000', 'last_fullsized': '2023-07-21T22:39:03.032057+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:39:09.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.12 is not active+clean 2023-07-21T22:39:09.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.035385+0000', 'last_change': '2023-07-21T22:39:03.035385+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.035385+0000', 'last_undegraded': '2023-07-21T22:39:03.035385+0000', 'last_fullsized': '2023-07-21T22:39:03.035385+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:39:09.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.13 is not active+clean 2023-07-21T22:39:09.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.035875+0000', 'last_change': '2023-07-21T22:39:03.035875+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.035875+0000', 'last_undegraded': '2023-07-21T22:39:03.035875+0000', 'last_fullsized': '2023-07-21T22:39:03.035875+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:39:09.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.10 is not active+clean 2023-07-21T22:39:09.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.029967+0000', 'last_change': '2023-07-21T22:39:03.029967+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.029967+0000', 'last_undegraded': '2023-07-21T22:39:03.029967+0000', 'last_fullsized': '2023-07-21T22:39:03.029967+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:39:09.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.11 is not active+clean 2023-07-21T22:39:09.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 155, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:39:03.029529+0000', 'last_change': '2023-07-21T22:39:03.029529+0000', 'last_active': '2023-07-21T22:39:03.013057+0000', 'last_peered': '2023-07-21T22:39:03.013057+0000', 'last_clean': '2023-07-21T22:39:03.013057+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:39:03.029529+0000', 'last_undegraded': '2023-07-21T22:39:03.029529+0000', 'last_fullsized': '2023-07-21T22:39:03.029529+0000', 'mapping_epoch': 155, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 155, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'last_clean_scrub_stamp': '2023-07-21T22:39:03.013057+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:39:09.034 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-21T22:39:09.049 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-07-21T22:39:09.004+0000 7f0b9e30f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:39:09.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.132+0000 7fe7c9268640 1 Processor -- start 2023-07-21T22:39:09.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.132+0000 7fe7c9268640 1 -- start start 2023-07-21T22:39:09.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.136+0000 7fe7c9268640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe7c415f3f0 0x7fe7c40b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:09.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.136+0000 7fe7c9268640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c40b8020 con 0x7fe7c40b7bc0 2023-07-21T22:39:09.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.136+0000 7fe7c9268640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c40d0f60 con 0x7fe7c40d13f0 2023-07-21T22:39:09.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.136+0000 7fe7c9268640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c40d0390 con 0x7fe7c415f3f0 2023-07-21T22:39:09.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.136+0000 7fe7c3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe7c415f3f0 0x7fe7c40b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:09.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.136+0000 7fe7c3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe7c415f3f0 0x7fe7c40b7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54450/0 (socket says 172.21.15.6:54450) 2023-07-21T22:39:09.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.136+0000 7fe7c3fff640 1 -- 172.21.15.6:0/4050333586 learned_addr learned my addr 172.21.15.6:0/4050333586 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:09.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.136+0000 7fe7c8a67640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe7c40b7bc0 0x7fe7c40b5010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37316/0 (socket says 172.21.15.6:37316) 2023-07-21T22:39:09.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.136+0000 7fe7c3fff640 1 -- 172.21.15.6:0/4050333586 >> v1:172.21.15.161:6789/0 conn(0x7fe7c40d13f0 legacy=0x7fe7c40cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:09.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.136+0000 7fe7c3fff640 1 -- 172.21.15.6:0/4050333586 >> v1:172.21.15.6:6789/0 conn(0x7fe7c40b7bc0 legacy=0x7fe7c40b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:09.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.136+0000 7fe7c3fff640 1 -- 172.21.15.6:0/4050333586 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c40d0630 con 0x7fe7c415f3f0 2023-07-21T22:39:09.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.140+0000 7fe7c3fff640 1 --2- 172.21.15.6:0/4050333586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7c415f3f0 0x7fe7c40b7680 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4009870 tx=0x7fe7b401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3cbea5fd1e4abf6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:09.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.140+0000 7fe7c2ffd640 1 -- 172.21.15.6:0/4050333586 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b40ab600 con 0x7fe7c415f3f0 2023-07-21T22:39:09.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.140+0000 7fe7c2ffd640 1 -- 172.21.15.6:0/4050333586 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b40a7050 con 0x7fe7c415f3f0 2023-07-21T22:39:09.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.140+0000 7fe7c2ffd640 1 -- 172.21.15.6:0/4050333586 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b40ab980 con 0x7fe7c415f3f0 2023-07-21T22:39:09.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.140+0000 7fe7c9268640 1 -- 172.21.15.6:0/4050333586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7c415f3f0 msgr2=0x7fe7c40b7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:09.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.140+0000 7fe7c9268640 1 --2- 172.21.15.6:0/4050333586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7c415f3f0 0x7fe7c40b7680 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4009870 tx=0x7fe7b401c340 comp rx=0 tx=0).stop 2023-07-21T22:39:09.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.140+0000 7fe7c9268640 1 -- 172.21.15.6:0/4050333586 shutdown_connections 2023-07-21T22:39:09.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.140+0000 7fe7c9268640 1 --2- 172.21.15.6:0/4050333586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7c415f3f0 0x7fe7c40b7680 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:09.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.140+0000 7fe7c9268640 1 -- 172.21.15.6:0/4050333586 >> 172.21.15.6:0/4050333586 conn(0x7fe7c4069f50 msgr2=0x7fe7c406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:09.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.140+0000 7fe7c9268640 1 -- 172.21.15.6:0/4050333586 shutdown_connections 2023-07-21T22:39:09.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.140+0000 7fe7c9268640 1 -- 172.21.15.6:0/4050333586 wait complete. 2023-07-21T22:39:09.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.140+0000 7fe7c9268640 1 Processor -- start 2023-07-21T22:39:09.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.140+0000 7fe7c9268640 1 -- start start 2023-07-21T22:39:09.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.140+0000 7fe7c9268640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7c40b7bc0 0x7fe7c414afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:09.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c9268640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7c40d13f0 0x7fe7c4144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:09.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c9268640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7c415f3f0 0x7fe7c4155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:09.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c9268640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c40c8ac0 con 0x7fe7c40b7bc0 2023-07-21T22:39:09.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c9268640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c40ca2e0 con 0x7fe7c415f3f0 2023-07-21T22:39:09.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c9268640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c4158400 con 0x7fe7c40d13f0 2023-07-21T22:39:09.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7c40b7bc0 0x7fe7c414afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:09.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7c40b7bc0 0x7fe7c414afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54452/0 (socket says 172.21.15.6:54452) 2023-07-21T22:39:09.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c3fff640 1 -- 172.21.15.6:0/4092749225 learned_addr learned my addr 172.21.15.6:0/4092749225 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:09.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c37fe640 1 --2- 172.21.15.6:0/4092749225 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7c40d13f0 0x7fe7c4144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:09.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c8a67640 1 --2- 172.21.15.6:0/4092749225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7c415f3f0 0x7fe7c4155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:09.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c3fff640 1 -- 172.21.15.6:0/4092749225 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7c40d13f0 msgr2=0x7fe7c4144fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:09.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c3fff640 1 --2- 172.21.15.6:0/4092749225 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7c40d13f0 0x7fe7c4144fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:09.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c3fff640 1 -- 172.21.15.6:0/4092749225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7c415f3f0 msgr2=0x7fe7c4155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:09.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c3fff640 1 --2- 172.21.15.6:0/4092749225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7c415f3f0 0x7fe7c4155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:09.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c3fff640 1 -- 172.21.15.6:0/4092749225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b40094d0 con 0x7fe7c40b7bc0 2023-07-21T22:39:09.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c8a67640 1 --2- 172.21.15.6:0/4092749225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7c415f3f0 0x7fe7c4155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:39:09.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c3fff640 1 --2- 172.21.15.6:0/4092749225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7c40b7bc0 0x7fe7c414afb0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40ae040 tx=0x7fe7b40190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:09.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c0ff9640 1 -- 172.21.15.6:0/4092749225 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b40b4910 con 0x7fe7c40b7bc0 2023-07-21T22:39:09.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c0ff9640 1 -- 172.21.15.6:0/4092749225 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b40b4a70 con 0x7fe7c40b7bc0 2023-07-21T22:39:09.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c0ff9640 1 -- 172.21.15.6:0/4092749225 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b40b4e00 con 0x7fe7c40b7bc0 2023-07-21T22:39:09.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c9268640 1 -- 172.21.15.6:0/4092749225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c40ca530 con 0x7fe7c40b7bc0 2023-07-21T22:39:09.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c9268640 1 -- 172.21.15.6:0/4092749225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c40caaf0 con 0x7fe7c40b7bc0 2023-07-21T22:39:09.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c9268640 1 -- 172.21.15.6:0/4092749225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c40678d0 con 0x7fe7c40b7bc0 2023-07-21T22:39:09.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.144+0000 7fe7c0ff9640 1 -- 172.21.15.6:0/4092749225 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe7b40b2070 con 0x7fe7c40b7bc0 2023-07-21T22:39:09.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.148+0000 7fe7c0ff9640 1 --2- 172.21.15.6:0/4092749225 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe7b00663d0 0x7fe7b0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:09.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.148+0000 7fe7c0ff9640 1 -- 172.21.15.6:0/4092749225 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fe7b411e2d0 con 0x7fe7c40b7bc0 2023-07-21T22:39:09.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.148+0000 7fe7c37fe640 1 --2- 172.21.15.6:0/4092749225 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe7b00663d0 0x7fe7b0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:09.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.148+0000 7fe7c37fe640 1 --2- 172.21.15.6:0/4092749225 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe7b00663d0 0x7fe7b0068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4148160 tx=0x7fe7b8009040 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:09.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.152+0000 7fe7c0ff9640 1 -- 172.21.15.6:0/4092749225 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe7b40eb570 con 0x7fe7c40b7bc0 2023-07-21T22:39:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.360+0000 7fe7c9268640 1 -- 172.21.15.6:0/4092749225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe7c40d2ab0 con 0x7fe7c40b7bc0 2023-07-21T22:39:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.360+0000 7fe7c0ff9640 1 -- 172.21.15.6:0/4092749225 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3232 (secure 0 0 0) 0x7fe7b40eeb90 con 0x7fe7c40b7bc0 2023-07-21T22:39:09.404 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:39:09.404 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1251,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":157,"num_osds":8,"num_up_osds":8,"osd_up_since":1689977909,"num_in_osds":8,"osd_in_since":1689977900,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":347291648,"bytes_avail":772746821632,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":70,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":9309}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2023-07-21T22:38:51.690868+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-21T22:39:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.360+0000 7fe7c9268640 1 -- 172.21.15.6:0/4092749225 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe7b00663d0 msgr2=0x7fe7b0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.360+0000 7fe7c9268640 1 --2- 172.21.15.6:0/4092749225 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe7b00663d0 0x7fe7b0068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4148160 tx=0x7fe7b8009040 comp rx=0 tx=0).stop 2023-07-21T22:39:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.360+0000 7fe7c9268640 1 -- 172.21.15.6:0/4092749225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7c40b7bc0 msgr2=0x7fe7c414afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.360+0000 7fe7c9268640 1 --2- 172.21.15.6:0/4092749225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7c40b7bc0 0x7fe7c414afb0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40ae040 tx=0x7fe7b40190e0 comp rx=0 tx=0).stop 2023-07-21T22:39:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.360+0000 7fe7c9268640 1 -- 172.21.15.6:0/4092749225 shutdown_connections 2023-07-21T22:39:09.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.360+0000 7fe7c9268640 1 --2- 172.21.15.6:0/4092749225 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe7b00663d0 0x7fe7b0068880 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.360+0000 7fe7c9268640 1 --2- 172.21.15.6:0/4092749225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7c415f3f0 0x7fe7c4155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.360+0000 7fe7c9268640 1 --2- 172.21.15.6:0/4092749225 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7c40d13f0 0x7fe7c4144fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.360+0000 7fe7c9268640 1 --2- 172.21.15.6:0/4092749225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7c40b7bc0 0x7fe7c414afb0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.360+0000 7fe7c9268640 1 -- 172.21.15.6:0/4092749225 >> 172.21.15.6:0/4092749225 conn(0x7fe7c4069f50 msgr2=0x7fe7c40d1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.360+0000 7fe7c9268640 1 -- 172.21.15.6:0/4092749225 shutdown_connections 2023-07-21T22:39:09.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.360+0000 7fe7c9268640 1 -- 172.21.15.6:0/4092749225 wait complete. 2023-07-21T22:39:09.425 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-21T22:39:09.426 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:39:09.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.564+0000 7ff80c234640 1 Processor -- start 2023-07-21T22:39:09.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.564+0000 7ff80c234640 1 -- start start 2023-07-21T22:39:09.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.568+0000 7ff80c234640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff804158ce0 0x7ff804070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:09.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.568+0000 7ff80c234640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8040c8ad0 0x7ff8040c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:09.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.568+0000 7ff80c234640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8040cc700 con 0x7ff8040c9560 2023-07-21T22:39:09.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.568+0000 7ff80c234640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8040c99e0 con 0x7ff804158ce0 2023-07-21T22:39:09.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.568+0000 7ff80c234640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8040b0ff0 con 0x7ff8040c8ad0 2023-07-21T22:39:09.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.568+0000 7ff809fd0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff804158ce0 0x7ff804070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:09.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.568+0000 7ff809fd0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff804158ce0 0x7ff804070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54462/0 (socket says 172.21.15.6:54462) 2023-07-21T22:39:09.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.568+0000 7ff809fd0640 1 -- 172.21.15.6:0/3369205541 learned_addr learned my addr 172.21.15.6:0/3369205541 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:09.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.568+0000 7ff8097cf640 1 --2- 172.21.15.6:0/3369205541 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8040c8ad0 0x7ff8040c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:09.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.568+0000 7ff809fd0640 1 -- 172.21.15.6:0/3369205541 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8040c8ad0 msgr2=0x7ff8040c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:09.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.568+0000 7ff809fd0640 1 --2- 172.21.15.6:0/3369205541 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8040c8ad0 0x7ff8040c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:09.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.568+0000 7ff809fd0640 1 -- 172.21.15.6:0/3369205541 >> v1:172.21.15.6:6789/0 conn(0x7ff8040c9560 legacy=0x7ff8040cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:09.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.568+0000 7ff809fd0640 1 -- 172.21.15.6:0/3369205541 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff804070c80 con 0x7ff804158ce0 2023-07-21T22:39:09.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.568+0000 7ff809fd0640 1 --2- 172.21.15.6:0/3369205541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff804158ce0 0x7ff804070450 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7ff800009870 tx=0x7ff80001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94c53bb3eec4406 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:09.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.572+0000 7ff808fce640 1 -- 172.21.15.6:0/3369205541 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8040cba20 con 0x7ff804158ce0 2023-07-21T22:39:09.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.572+0000 7ff808fce640 1 -- 172.21.15.6:0/3369205541 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8000a7050 con 0x7ff804158ce0 2023-07-21T22:39:09.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.572+0000 7ff808fce640 1 -- 172.21.15.6:0/3369205541 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8000ab820 con 0x7ff804158ce0 2023-07-21T22:39:09.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.572+0000 7ff80c234640 1 -- 172.21.15.6:0/3369205541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff804158ce0 msgr2=0x7ff804070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:09.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.572+0000 7ff80c234640 1 --2- 172.21.15.6:0/3369205541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff804158ce0 0x7ff804070450 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7ff800009870 tx=0x7ff80001c3f0 comp rx=0 tx=0).stop 2023-07-21T22:39:09.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.572+0000 7ff80c234640 1 -- 172.21.15.6:0/3369205541 shutdown_connections 2023-07-21T22:39:09.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.572+0000 7ff80c234640 1 --2- 172.21.15.6:0/3369205541 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8040c8ad0 0x7ff8040c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.572+0000 7ff80c234640 1 --2- 172.21.15.6:0/3369205541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff804158ce0 0x7ff804070450 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.572+0000 7ff80c234640 1 -- 172.21.15.6:0/3369205541 >> 172.21.15.6:0/3369205541 conn(0x7ff8040afcf0 msgr2=0x7ff8040b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.572+0000 7ff80c234640 1 -- 172.21.15.6:0/3369205541 shutdown_connections 2023-07-21T22:39:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.572+0000 7ff80c234640 1 -- 172.21.15.6:0/3369205541 wait complete. 2023-07-21T22:39:09.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.572+0000 7ff80c234640 1 Processor -- start 2023-07-21T22:39:09.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.572+0000 7ff80c234640 1 -- start start 2023-07-21T22:39:09.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.572+0000 7ff80c234640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8040c8ad0 0x7ff8040c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:09.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.572+0000 7ff80c234640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8040c9560 0x7ff80406bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:09.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.572+0000 7ff80c234640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff804158ce0 0x7ff8041426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:09.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.572+0000 7ff80c234640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80414dd10 con 0x7ff804158ce0 2023-07-21T22:39:09.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.572+0000 7ff80c234640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80414df20 con 0x7ff8040c9560 2023-07-21T22:39:09.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.572+0000 7ff80c234640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80414e200 con 0x7ff8040c8ad0 2023-07-21T22:39:09.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.576+0000 7ff80a7d1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff804158ce0 0x7ff8041426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:09.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.576+0000 7ff80a7d1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff804158ce0 0x7ff8041426d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54464/0 (socket says 172.21.15.6:54464) 2023-07-21T22:39:09.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.576+0000 7ff80a7d1640 1 -- 172.21.15.6:0/2847939006 learned_addr learned my addr 172.21.15.6:0/2847939006 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:09.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.576+0000 7ff8097cf640 1 --2- 172.21.15.6:0/2847939006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8040c9560 0x7ff80406bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:09.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.576+0000 7ff809fd0640 1 --2- 172.21.15.6:0/2847939006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8040c8ad0 0x7ff8040c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:09.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.576+0000 7ff80a7d1640 1 -- 172.21.15.6:0/2847939006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8040c8ad0 msgr2=0x7ff8040c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:09.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.576+0000 7ff80a7d1640 1 --2- 172.21.15.6:0/2847939006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8040c8ad0 0x7ff8040c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:09.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.576+0000 7ff80a7d1640 1 -- 172.21.15.6:0/2847939006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8040c9560 msgr2=0x7ff80406bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:09.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.576+0000 7ff80a7d1640 1 --2- 172.21.15.6:0/2847939006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8040c9560 0x7ff80406bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:09.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.576+0000 7ff80a7d1640 1 -- 172.21.15.6:0/2847939006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8000094d0 con 0x7ff804158ce0 2023-07-21T22:39:09.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.576+0000 7ff80a7d1640 1 --2- 172.21.15.6:0/2847939006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff804158ce0 0x7ff8041426d0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc00c730 tx=0x7ff7fc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:09.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.576+0000 7ff7fa7fc640 1 -- 172.21.15.6:0/2847939006 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc003b80 con 0x7ff804158ce0 2023-07-21T22:39:09.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.576+0000 7ff7fa7fc640 1 -- 172.21.15.6:0/2847939006 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7fc003ce0 con 0x7ff804158ce0 2023-07-21T22:39:09.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.576+0000 7ff7fa7fc640 1 -- 172.21.15.6:0/2847939006 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc00aa30 con 0x7ff804158ce0 2023-07-21T22:39:09.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.576+0000 7ff80c234640 1 -- 172.21.15.6:0/2847939006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff80414e4e0 con 0x7ff804158ce0 2023-07-21T22:39:09.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.576+0000 7ff80c234640 1 -- 172.21.15.6:0/2847939006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80414eaa0 con 0x7ff804158ce0 2023-07-21T22:39:09.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.576+0000 7ff80c234640 1 -- 172.21.15.6:0/2847939006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8040ca1a0 con 0x7ff804158ce0 2023-07-21T22:39:09.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.576+0000 7ff7fa7fc640 1 -- 172.21.15.6:0/2847939006 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff7fc00ab90 con 0x7ff804158ce0 2023-07-21T22:39:09.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.576+0000 7ff7fa7fc640 1 --2- 172.21.15.6:0/2847939006 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7ff7e80663d0 0x7ff7e8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:09.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.576+0000 7ff7fa7fc640 1 -- 172.21.15.6:0/2847939006 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7ff7fc083af0 con 0x7ff804158ce0 2023-07-21T22:39:09.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.580+0000 7ff809fd0640 1 --2- 172.21.15.6:0/2847939006 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7ff7e80663d0 0x7ff7e8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:09.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.580+0000 7ff809fd0640 1 --2- 172.21.15.6:0/2847939006 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7ff7e80663d0 0x7ff7e8068880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff8000ad000 tx=0x7ff8000a4f90 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:09.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.580+0000 7ff7fa7fc640 1 -- 172.21.15.6:0/2847939006 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff7fc050ec0 con 0x7ff804158ce0 2023-07-21T22:39:09.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.736+0000 7ff80c234640 1 -- 172.21.15.6:0/2847939006 --> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff804070990 con 0x7ff7e80663d0 2023-07-21T22:39:09.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.744+0000 7ff7fa7fc640 1 -- 172.21.15.6:0/2847939006 <== mgr.7694 v2:172.21.15.161:6832/2692111396 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311703 (secure 0 0 0) 0x7ff8000ab680 con 0x7ff7e80663d0 2023-07-21T22:39:09.793 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:39:09.794 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:39:09.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.748+0000 7ff80c234640 1 -- 172.21.15.6:0/2847939006 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7ff7e80663d0 msgr2=0x7ff7e8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:09.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.748+0000 7ff80c234640 1 --2- 172.21.15.6:0/2847939006 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7ff7e80663d0 0x7ff7e8068880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff8000ad000 tx=0x7ff8000a4f90 comp rx=0 tx=0).stop 2023-07-21T22:39:09.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.748+0000 7ff80c234640 1 -- 172.21.15.6:0/2847939006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff804158ce0 msgr2=0x7ff8041426d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:09.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.748+0000 7ff80c234640 1 --2- 172.21.15.6:0/2847939006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff804158ce0 0x7ff8041426d0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc00c730 tx=0x7ff7fc00cbf0 comp rx=0 tx=0).stop 2023-07-21T22:39:09.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.748+0000 7ff80c234640 1 -- 172.21.15.6:0/2847939006 shutdown_connections 2023-07-21T22:39:09.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.748+0000 7ff80c234640 1 --2- 172.21.15.6:0/2847939006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff804158ce0 0x7ff8041426d0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:09.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.748+0000 7ff80c234640 1 --2- 172.21.15.6:0/2847939006 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7ff7e80663d0 0x7ff7e8068880 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:09.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.748+0000 7ff80c234640 1 --2- 172.21.15.6:0/2847939006 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8040c9560 0x7ff80406bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:09.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.748+0000 7ff80c234640 1 --2- 172.21.15.6:0/2847939006 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8040c8ad0 0x7ff8040c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:09.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.748+0000 7ff80c234640 1 -- 172.21.15.6:0/2847939006 >> 172.21.15.6:0/2847939006 conn(0x7ff8040afcf0 msgr2=0x7ff8040b1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:09.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.748+0000 7ff80c234640 1 -- 172.21.15.6:0/2847939006 shutdown_connections 2023-07-21T22:39:09.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:09.748+0000 7ff80c234640 1 -- 172.21.15.6:0/2847939006 wait complete. 2023-07-21T22:39:09.814 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-21T22:39:09.694725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":484,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":310,"ondisk_log_size":310,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":206,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":339432,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":322944,"kb_avail":754635288,"statfs":{"total":773094113280,"available":772746534912,"internally_reserved":0,"allocated":16818176,"data_stored":9092116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":330694656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.666071"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388670+0000","last_change":"2023-07-21T22:39:04.057641+0000","last_active":"2023-07-21T22:39:05.388670+0000","last_peered":"2023-07-21T22:39:05.388670+0000","last_clean":"2023-07-21T22:39:05.388670+0000","last_became_active":"2023-07-21T22:39:04.057354+0000","last_became_peered":"2023-07-21T22:39:04.057354+0000","last_unstale":"2023-07-21T22:39:05.388670+0000","last_undegraded":"2023-07-21T22:39:05.388670+0000","last_fullsized":"2023-07-21T22:39:05.388670+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:25:39.054685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392289+0000","last_change":"2023-07-21T22:39:04.044240+0000","last_active":"2023-07-21T22:39:05.392289+0000","last_peered":"2023-07-21T22:39:05.392289+0000","last_clean":"2023-07-21T22:39:05.392289+0000","last_became_active":"2023-07-21T22:39:04.043956+0000","last_became_peered":"2023-07-21T22:39:04.043956+0000","last_unstale":"2023-07-21T22:39:05.392289+0000","last_undegraded":"2023-07-21T22:39:05.392289+0000","last_fullsized":"2023-07-21T22:39:05.392289+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:27:20.991699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392604+0000","last_change":"2023-07-21T22:39:04.059414+0000","last_active":"2023-07-21T22:39:05.392604+0000","last_peered":"2023-07-21T22:39:05.392604+0000","last_clean":"2023-07-21T22:39:05.392604+0000","last_became_active":"2023-07-21T22:39:04.059043+0000","last_became_peered":"2023-07-21T22:39:04.059043+0000","last_unstale":"2023-07-21T22:39:05.392604+0000","last_undegraded":"2023-07-21T22:39:05.392604+0000","last_fullsized":"2023-07-21T22:39:05.392604+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:26:50.897262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392452+0000","last_change":"2023-07-21T22:39:04.063389+0000","last_active":"2023-07-21T22:39:05.392452+0000","last_peered":"2023-07-21T22:39:05.392452+0000","last_clean":"2023-07-21T22:39:05.392452+0000","last_became_active":"2023-07-21T22:39:04.063071+0000","last_became_peered":"2023-07-21T22:39:04.063071+0000","last_unstale":"2023-07-21T22:39:05.392452+0000","last_undegraded":"2023-07-21T22:39:05.392452+0000","last_fullsized":"2023-07-21T22:39:05.392452+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:50:00.388814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.028958+0000","last_change":"2023-07-21T22:39:04.046698+0000","last_active":"2023-07-21T22:39:05.028958+0000","last_peered":"2023-07-21T22:39:05.028958+0000","last_clean":"2023-07-21T22:39:05.028958+0000","last_became_active":"2023-07-21T22:39:04.046440+0000","last_became_peered":"2023-07-21T22:39:04.046440+0000","last_unstale":"2023-07-21T22:39:05.028958+0000","last_undegraded":"2023-07-21T22:39:05.028958+0000","last_fullsized":"2023-07-21T22:39:05.028958+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:49:10.404559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388620+0000","last_change":"2023-07-21T22:39:04.055173+0000","last_active":"2023-07-21T22:39:05.388620+0000","last_peered":"2023-07-21T22:39:05.388620+0000","last_clean":"2023-07-21T22:39:05.388620+0000","last_became_active":"2023-07-21T22:39:04.054811+0000","last_became_peered":"2023-07-21T22:39:04.054811+0000","last_unstale":"2023-07-21T22:39:05.388620+0000","last_undegraded":"2023-07-21T22:39:05.388620+0000","last_fullsized":"2023-07-21T22:39:05.388620+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:38:48.452779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.034781+0000","last_change":"2023-07-21T22:39:04.060080+0000","last_active":"2023-07-21T22:39:05.034781+0000","last_peered":"2023-07-21T22:39:05.034781+0000","last_clean":"2023-07-21T22:39:05.034781+0000","last_became_active":"2023-07-21T22:39:04.059783+0000","last_became_peered":"2023-07-21T22:39:04.059783+0000","last_unstale":"2023-07-21T22:39:05.034781+0000","last_undegraded":"2023-07-21T22:39:05.034781+0000","last_fullsized":"2023-07-21T22:39:05.034781+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:49:45.496175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035851+0000","last_change":"2023-07-21T22:39:04.061518+0000","last_active":"2023-07-21T22:39:05.035851+0000","last_peered":"2023-07-21T22:39:05.035851+0000","last_clean":"2023-07-21T22:39:05.035851+0000","last_became_active":"2023-07-21T22:39:04.061191+0000","last_became_peered":"2023-07-21T22:39:04.061191+0000","last_unstale":"2023-07-21T22:39:05.035851+0000","last_undegraded":"2023-07-21T22:39:05.035851+0000","last_fullsized":"2023-07-21T22:39:05.035851+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:46:10.615120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389418+0000","last_change":"2023-07-21T22:39:04.048087+0000","last_active":"2023-07-21T22:39:05.389418+0000","last_peered":"2023-07-21T22:39:05.389418+0000","last_clean":"2023-07-21T22:39:05.389418+0000","last_became_active":"2023-07-21T22:39:04.043863+0000","last_became_peered":"2023-07-21T22:39:04.043863+0000","last_unstale":"2023-07-21T22:39:05.389418+0000","last_undegraded":"2023-07-21T22:39:05.389418+0000","last_fullsized":"2023-07-21T22:39:05.389418+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:49:24.055468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388693+0000","last_change":"2023-07-21T22:39:04.065732+0000","last_active":"2023-07-21T22:39:05.388693+0000","last_peered":"2023-07-21T22:39:05.388693+0000","last_clean":"2023-07-21T22:39:05.388693+0000","last_became_active":"2023-07-21T22:39:04.065429+0000","last_became_peered":"2023-07-21T22:39:04.065429+0000","last_unstale":"2023-07-21T22:39:05.388693+0000","last_undegraded":"2023-07-21T22:39:05.388693+0000","last_fullsized":"2023-07-21T22:39:05.388693+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:47.453377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392069+0000","last_change":"2023-07-21T22:39:04.063218+0000","last_active":"2023-07-21T22:39:05.392069+0000","last_peered":"2023-07-21T22:39:05.392069+0000","last_clean":"2023-07-21T22:39:05.392069+0000","last_became_active":"2023-07-21T22:39:04.062868+0000","last_became_peered":"2023-07-21T22:39:04.062868+0000","last_unstale":"2023-07-21T22:39:05.392069+0000","last_undegraded":"2023-07-21T22:39:05.392069+0000","last_fullsized":"2023-07-21T22:39:05.392069+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:28:50.000104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388383+0000","last_change":"2023-07-21T22:39:04.047810+0000","last_active":"2023-07-21T22:39:05.388383+0000","last_peered":"2023-07-21T22:39:05.388383+0000","last_clean":"2023-07-21T22:39:05.388383+0000","last_became_active":"2023-07-21T22:39:04.047534+0000","last_became_peered":"2023-07-21T22:39:04.047534+0000","last_unstale":"2023-07-21T22:39:05.388383+0000","last_undegraded":"2023-07-21T22:39:05.388383+0000","last_fullsized":"2023-07-21T22:39:05.388383+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:21:51.268747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389078+0000","last_change":"2023-07-21T22:39:04.053489+0000","last_active":"2023-07-21T22:39:05.389078+0000","last_peered":"2023-07-21T22:39:05.389078+0000","last_clean":"2023-07-21T22:39:05.389078+0000","last_became_active":"2023-07-21T22:39:04.053071+0000","last_became_peered":"2023-07-21T22:39:04.053071+0000","last_unstale":"2023-07-21T22:39:05.389078+0000","last_undegraded":"2023-07-21T22:39:05.389078+0000","last_fullsized":"2023-07-21T22:39:05.389078+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:31:30.579070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389304+0000","last_change":"2023-07-21T22:39:04.064135+0000","last_active":"2023-07-21T22:39:05.389304+0000","last_peered":"2023-07-21T22:39:05.389304+0000","last_clean":"2023-07-21T22:39:05.389304+0000","last_became_active":"2023-07-21T22:39:04.063864+0000","last_became_peered":"2023-07-21T22:39:04.063864+0000","last_unstale":"2023-07-21T22:39:05.389304+0000","last_undegraded":"2023-07-21T22:39:05.389304+0000","last_fullsized":"2023-07-21T22:39:05.389304+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:27:29.546308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388086+0000","last_change":"2023-07-21T22:39:04.063736+0000","last_active":"2023-07-21T22:39:05.388086+0000","last_peered":"2023-07-21T22:39:05.388086+0000","last_clean":"2023-07-21T22:39:05.388086+0000","last_became_active":"2023-07-21T22:39:04.063415+0000","last_became_peered":"2023-07-21T22:39:04.063415+0000","last_unstale":"2023-07-21T22:39:05.388086+0000","last_undegraded":"2023-07-21T22:39:05.388086+0000","last_fullsized":"2023-07-21T22:39:05.388086+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:24:39.645041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389500+0000","last_change":"2023-07-21T22:39:04.046938+0000","last_active":"2023-07-21T22:39:05.389500+0000","last_peered":"2023-07-21T22:39:05.389500+0000","last_clean":"2023-07-21T22:39:05.389500+0000","last_became_active":"2023-07-21T22:39:04.046614+0000","last_became_peered":"2023-07-21T22:39:04.046614+0000","last_unstale":"2023-07-21T22:39:05.389500+0000","last_undegraded":"2023-07-21T22:39:05.389500+0000","last_fullsized":"2023-07-21T22:39:05.389500+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:40.975402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389564+0000","last_change":"2023-07-21T22:39:04.047887+0000","last_active":"2023-07-21T22:39:05.389564+0000","last_peered":"2023-07-21T22:39:05.389564+0000","last_clean":"2023-07-21T22:39:05.389564+0000","last_became_active":"2023-07-21T22:39:04.047615+0000","last_became_peered":"2023-07-21T22:39:04.047615+0000","last_unstale":"2023-07-21T22:39:05.389564+0000","last_undegraded":"2023-07-21T22:39:05.389564+0000","last_fullsized":"2023-07-21T22:39:05.389564+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:08:39.727578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.029133+0000","last_change":"2023-07-21T22:39:04.047942+0000","last_active":"2023-07-21T22:39:05.029133+0000","last_peered":"2023-07-21T22:39:05.029133+0000","last_clean":"2023-07-21T22:39:05.029133+0000","last_became_active":"2023-07-21T22:39:04.046911+0000","last_became_peered":"2023-07-21T22:39:04.046911+0000","last_unstale":"2023-07-21T22:39:05.029133+0000","last_undegraded":"2023-07-21T22:39:05.029133+0000","last_fullsized":"2023-07-21T22:39:05.029133+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:54:02.142880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035478+0000","last_change":"2023-07-21T22:39:04.051750+0000","last_active":"2023-07-21T22:39:05.035478+0000","last_peered":"2023-07-21T22:39:05.035478+0000","last_clean":"2023-07-21T22:39:05.035478+0000","last_became_active":"2023-07-21T22:39:04.051397+0000","last_became_peered":"2023-07-21T22:39:04.051397+0000","last_unstale":"2023-07-21T22:39:05.035478+0000","last_undegraded":"2023-07-21T22:39:05.035478+0000","last_fullsized":"2023-07-21T22:39:05.035478+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:17:35.053612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.029261+0000","last_change":"2023-07-21T22:39:04.064837+0000","last_active":"2023-07-21T22:39:05.029261+0000","last_peered":"2023-07-21T22:39:05.029261+0000","last_clean":"2023-07-21T22:39:05.029261+0000","last_became_active":"2023-07-21T22:39:04.064436+0000","last_became_peered":"2023-07-21T22:39:04.064436+0000","last_unstale":"2023-07-21T22:39:05.029261+0000","last_undegraded":"2023-07-21T22:39:05.029261+0000","last_fullsized":"2023-07-21T22:39:05.029261+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:50:11.072999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392866+0000","last_change":"2023-07-21T22:39:04.043257+0000","last_active":"2023-07-21T22:39:05.392866+0000","last_peered":"2023-07-21T22:39:05.392866+0000","last_clean":"2023-07-21T22:39:05.392866+0000","last_became_active":"2023-07-21T22:39:04.042923+0000","last_became_peered":"2023-07-21T22:39:04.042923+0000","last_unstale":"2023-07-21T22:39:05.392866+0000","last_undegraded":"2023-07-21T22:39:05.392866+0000","last_fullsized":"2023-07-21T22:39:05.392866+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:03:14.393774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389312+0000","last_change":"2023-07-21T22:39:04.047384+0000","last_active":"2023-07-21T22:39:05.389312+0000","last_peered":"2023-07-21T22:39:05.389312+0000","last_clean":"2023-07-21T22:39:05.389312+0000","last_became_active":"2023-07-21T22:39:04.047065+0000","last_became_peered":"2023-07-21T22:39:04.047065+0000","last_unstale":"2023-07-21T22:39:05.389312+0000","last_undegraded":"2023-07-21T22:39:05.389312+0000","last_fullsized":"2023-07-21T22:39:05.389312+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:27:36.179476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392010+0000","last_change":"2023-07-21T22:39:04.063652+0000","last_active":"2023-07-21T22:39:05.392010+0000","last_peered":"2023-07-21T22:39:05.392010+0000","last_clean":"2023-07-21T22:39:05.392010+0000","last_became_active":"2023-07-21T22:39:04.062761+0000","last_became_peered":"2023-07-21T22:39:04.062761+0000","last_unstale":"2023-07-21T22:39:05.392010+0000","last_undegraded":"2023-07-21T22:39:05.392010+0000","last_fullsized":"2023-07-21T22:39:05.392010+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:29:52.527370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389566+0000","last_change":"2023-07-21T22:39:04.035216+0000","last_active":"2023-07-21T22:39:05.389566+0000","last_peered":"2023-07-21T22:39:05.389566+0000","last_clean":"2023-07-21T22:39:05.389566+0000","last_became_active":"2023-07-21T22:39:04.034942+0000","last_became_peered":"2023-07-21T22:39:04.034942+0000","last_unstale":"2023-07-21T22:39:05.389566+0000","last_undegraded":"2023-07-21T22:39:05.389566+0000","last_fullsized":"2023-07-21T22:39:05.389566+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:13:29.546647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.393045+0000","last_change":"2023-07-21T22:39:04.057395+0000","last_active":"2023-07-21T22:39:05.393045+0000","last_peered":"2023-07-21T22:39:05.393045+0000","last_clean":"2023-07-21T22:39:05.393045+0000","last_became_active":"2023-07-21T22:39:04.057055+0000","last_became_peered":"2023-07-21T22:39:04.057055+0000","last_unstale":"2023-07-21T22:39:05.393045+0000","last_undegraded":"2023-07-21T22:39:05.393045+0000","last_fullsized":"2023-07-21T22:39:05.393045+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:35:12.409289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392497+0000","last_change":"2023-07-21T22:39:04.062638+0000","last_active":"2023-07-21T22:39:05.392497+0000","last_peered":"2023-07-21T22:39:05.392497+0000","last_clean":"2023-07-21T22:39:05.392497+0000","last_became_active":"2023-07-21T22:39:04.062359+0000","last_became_peered":"2023-07-21T22:39:04.062359+0000","last_unstale":"2023-07-21T22:39:05.392497+0000","last_undegraded":"2023-07-21T22:39:05.392497+0000","last_fullsized":"2023-07-21T22:39:05.392497+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:04:33.252428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035645+0000","last_change":"2023-07-21T22:39:04.066374+0000","last_active":"2023-07-21T22:39:05.035645+0000","last_peered":"2023-07-21T22:39:05.035645+0000","last_clean":"2023-07-21T22:39:05.035645+0000","last_became_active":"2023-07-21T22:39:04.065981+0000","last_became_peered":"2023-07-21T22:39:04.065981+0000","last_unstale":"2023-07-21T22:39:05.035645+0000","last_undegraded":"2023-07-21T22:39:05.035645+0000","last_fullsized":"2023-07-21T22:39:05.035645+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:43:26.114675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388100+0000","last_change":"2023-07-21T22:39:04.065768+0000","last_active":"2023-07-21T22:39:05.388100+0000","last_peered":"2023-07-21T22:39:05.388100+0000","last_clean":"2023-07-21T22:39:05.388100+0000","last_became_active":"2023-07-21T22:39:04.065480+0000","last_became_peered":"2023-07-21T22:39:04.065480+0000","last_unstale":"2023-07-21T22:39:05.388100+0000","last_undegraded":"2023-07-21T22:39:05.388100+0000","last_fullsized":"2023-07-21T22:39:05.388100+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:05:17.927873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392622+0000","last_change":"2023-07-21T22:39:04.056618+0000","last_active":"2023-07-21T22:39:05.392622+0000","last_peered":"2023-07-21T22:39:05.392622+0000","last_clean":"2023-07-21T22:39:05.392622+0000","last_became_active":"2023-07-21T22:39:04.056192+0000","last_became_peered":"2023-07-21T22:39:04.056192+0000","last_unstale":"2023-07-21T22:39:05.392622+0000","last_undegraded":"2023-07-21T22:39:05.392622+0000","last_fullsized":"2023-07-21T22:39:05.392622+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:25:51.700245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392736+0000","last_change":"2023-07-21T22:39:04.056513+0000","last_active":"2023-07-21T22:39:05.392736+0000","last_peered":"2023-07-21T22:39:05.392736+0000","last_clean":"2023-07-21T22:39:05.392736+0000","last_became_active":"2023-07-21T22:39:04.056222+0000","last_became_peered":"2023-07-21T22:39:04.056222+0000","last_unstale":"2023-07-21T22:39:05.392736+0000","last_undegraded":"2023-07-21T22:39:05.392736+0000","last_fullsized":"2023-07-21T22:39:05.392736+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:08:23.355354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035872+0000","last_change":"2023-07-21T22:39:04.055774+0000","last_active":"2023-07-21T22:39:05.035872+0000","last_peered":"2023-07-21T22:39:05.035872+0000","last_clean":"2023-07-21T22:39:05.035872+0000","last_became_active":"2023-07-21T22:39:04.055443+0000","last_became_peered":"2023-07-21T22:39:04.055443+0000","last_unstale":"2023-07-21T22:39:05.035872+0000","last_undegraded":"2023-07-21T22:39:05.035872+0000","last_fullsized":"2023-07-21T22:39:05.035872+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:36:05.344459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.387903+0000","last_change":"2023-07-21T22:39:04.056193+0000","last_active":"2023-07-21T22:39:05.387903+0000","last_peered":"2023-07-21T22:39:05.387903+0000","last_clean":"2023-07-21T22:39:05.387903+0000","last_became_active":"2023-07-21T22:39:04.054105+0000","last_became_peered":"2023-07-21T22:39:04.054105+0000","last_unstale":"2023-07-21T22:39:05.387903+0000","last_undegraded":"2023-07-21T22:39:05.387903+0000","last_fullsized":"2023-07-21T22:39:05.387903+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:38:29.680153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035910+0000","last_change":"2023-07-21T22:39:04.067430+0000","last_active":"2023-07-21T22:39:05.035910+0000","last_peered":"2023-07-21T22:39:05.035910+0000","last_clean":"2023-07-21T22:39:05.035910+0000","last_became_active":"2023-07-21T22:39:04.067062+0000","last_became_peered":"2023-07-21T22:39:04.067062+0000","last_unstale":"2023-07-21T22:39:05.035910+0000","last_undegraded":"2023-07-21T22:39:05.035910+0000","last_fullsized":"2023-07-21T22:39:05.035910+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:52:59.020137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"156'4","reported_seq":17,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.393009+0000","last_change":"2023-07-21T22:39:03.045196+0000","last_active":"2023-07-21T22:39:05.393009+0000","last_peered":"2023-07-21T22:39:05.393009+0000","last_clean":"2023-07-21T22:39:05.393009+0000","last_became_active":"2023-07-21T22:39:03.044911+0000","last_became_peered":"2023-07-21T22:39:03.044911+0000","last_unstale":"2023-07-21T22:39:05.393009+0000","last_undegraded":"2023-07-21T22:39:05.393009+0000","last_fullsized":"2023-07-21T22:39:05.393009+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:26:12.805777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388502+0000","last_change":"2023-07-21T22:39:04.043379+0000","last_active":"2023-07-21T22:39:05.388502+0000","last_peered":"2023-07-21T22:39:05.388502+0000","last_clean":"2023-07-21T22:39:05.388502+0000","last_became_active":"2023-07-21T22:39:04.043035+0000","last_became_peered":"2023-07-21T22:39:04.043035+0000","last_unstale":"2023-07-21T22:39:05.388502+0000","last_undegraded":"2023-07-21T22:39:05.388502+0000","last_fullsized":"2023-07-21T22:39:05.388502+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:30:25.608972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"156'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.029412+0000","last_change":"2023-07-21T22:39:03.043899+0000","last_active":"2023-07-21T22:39:05.029412+0000","last_peered":"2023-07-21T22:39:05.029412+0000","last_clean":"2023-07-21T22:39:05.029412+0000","last_became_active":"2023-07-21T22:39:03.043604+0000","last_became_peered":"2023-07-21T22:39:03.043604+0000","last_unstale":"2023-07-21T22:39:05.029412+0000","last_undegraded":"2023-07-21T22:39:05.029412+0000","last_fullsized":"2023-07-21T22:39:05.029412+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:49:14.048255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392496+0000","last_change":"2023-07-21T22:39:04.050387+0000","last_active":"2023-07-21T22:39:05.392496+0000","last_peered":"2023-07-21T22:39:05.392496+0000","last_clean":"2023-07-21T22:39:05.392496+0000","last_became_active":"2023-07-21T22:39:04.049441+0000","last_became_peered":"2023-07-21T22:39:04.049441+0000","last_unstale":"2023-07-21T22:39:05.392496+0000","last_undegraded":"2023-07-21T22:39:05.392496+0000","last_fullsized":"2023-07-21T22:39:05.392496+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:05:19.019902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035643+0000","last_change":"2023-07-21T22:39:03.047859+0000","last_active":"2023-07-21T22:39:05.035643+0000","last_peered":"2023-07-21T22:39:05.035643+0000","last_clean":"2023-07-21T22:39:05.035643+0000","last_became_active":"2023-07-21T22:39:03.047591+0000","last_became_peered":"2023-07-21T22:39:03.047591+0000","last_unstale":"2023-07-21T22:39:05.035643+0000","last_undegraded":"2023-07-21T22:39:05.035643+0000","last_fullsized":"2023-07-21T22:39:05.035643+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:59:29.101633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388552+0000","last_change":"2023-07-21T22:39:04.063554+0000","last_active":"2023-07-21T22:39:05.388552+0000","last_peered":"2023-07-21T22:39:05.388552+0000","last_clean":"2023-07-21T22:39:05.388552+0000","last_became_active":"2023-07-21T22:39:04.063242+0000","last_became_peered":"2023-07-21T22:39:04.063242+0000","last_unstale":"2023-07-21T22:39:05.388552+0000","last_undegraded":"2023-07-21T22:39:05.388552+0000","last_fullsized":"2023-07-21T22:39:05.388552+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:18.271597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035360+0000","last_change":"2023-07-21T22:39:03.052051+0000","last_active":"2023-07-21T22:39:05.035360+0000","last_peered":"2023-07-21T22:39:05.035360+0000","last_clean":"2023-07-21T22:39:05.035360+0000","last_became_active":"2023-07-21T22:39:03.051732+0000","last_became_peered":"2023-07-21T22:39:03.051732+0000","last_unstale":"2023-07-21T22:39:05.035360+0000","last_undegraded":"2023-07-21T22:39:05.035360+0000","last_fullsized":"2023-07-21T22:39:05.035360+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:38:28.728080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.036340+0000","last_change":"2023-07-21T22:39:04.054528+0000","last_active":"2023-07-21T22:39:05.036340+0000","last_peered":"2023-07-21T22:39:05.036340+0000","last_clean":"2023-07-21T22:39:05.036340+0000","last_became_active":"2023-07-21T22:39:04.053568+0000","last_became_peered":"2023-07-21T22:39:04.053568+0000","last_unstale":"2023-07-21T22:39:05.036340+0000","last_undegraded":"2023-07-21T22:39:05.036340+0000","last_fullsized":"2023-07-21T22:39:05.036340+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:11:32.612096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"156'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.036271+0000","last_change":"2023-07-21T22:39:03.047928+0000","last_active":"2023-07-21T22:39:05.036271+0000","last_peered":"2023-07-21T22:39:05.036271+0000","last_clean":"2023-07-21T22:39:05.036271+0000","last_became_active":"2023-07-21T22:39:03.047629+0000","last_became_peered":"2023-07-21T22:39:03.047629+0000","last_unstale":"2023-07-21T22:39:05.036271+0000","last_undegraded":"2023-07-21T22:39:05.036271+0000","last_fullsized":"2023-07-21T22:39:05.036271+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:33:16.850112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.036454+0000","last_change":"2023-07-21T22:39:04.059731+0000","last_active":"2023-07-21T22:39:05.036454+0000","last_peered":"2023-07-21T22:39:05.036454+0000","last_clean":"2023-07-21T22:39:05.036454+0000","last_became_active":"2023-07-21T22:39:04.059427+0000","last_became_peered":"2023-07-21T22:39:04.059427+0000","last_unstale":"2023-07-21T22:39:05.036454+0000","last_undegraded":"2023-07-21T22:39:05.036454+0000","last_fullsized":"2023-07-21T22:39:05.036454+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:36:22.063521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"156'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.028884+0000","last_change":"2023-07-21T22:39:03.035738+0000","last_active":"2023-07-21T22:39:05.028884+0000","last_peered":"2023-07-21T22:39:05.028884+0000","last_clean":"2023-07-21T22:39:05.028884+0000","last_became_active":"2023-07-21T22:39:03.035421+0000","last_became_peered":"2023-07-21T22:39:03.035421+0000","last_unstale":"2023-07-21T22:39:05.028884+0000","last_undegraded":"2023-07-21T22:39:05.028884+0000","last_fullsized":"2023-07-21T22:39:05.028884+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:23:07.861700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.029296+0000","last_change":"2023-07-21T22:39:04.059957+0000","last_active":"2023-07-21T22:39:05.029296+0000","last_peered":"2023-07-21T22:39:05.029296+0000","last_clean":"2023-07-21T22:39:05.029296+0000","last_became_active":"2023-07-21T22:39:04.059580+0000","last_became_peered":"2023-07-21T22:39:04.059580+0000","last_unstale":"2023-07-21T22:39:05.029296+0000","last_undegraded":"2023-07-21T22:39:05.029296+0000","last_fullsized":"2023-07-21T22:39:05.029296+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:18.911832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388990+0000","last_change":"2023-07-21T22:39:03.036395+0000","last_active":"2023-07-21T22:39:05.388990+0000","last_peered":"2023-07-21T22:39:05.388990+0000","last_clean":"2023-07-21T22:39:05.388990+0000","last_became_active":"2023-07-21T22:39:03.036126+0000","last_became_peered":"2023-07-21T22:39:03.036126+0000","last_unstale":"2023-07-21T22:39:05.388990+0000","last_undegraded":"2023-07-21T22:39:05.388990+0000","last_fullsized":"2023-07-21T22:39:05.388990+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:38:47.365979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035293+0000","last_change":"2023-07-21T22:39:04.066525+0000","last_active":"2023-07-21T22:39:05.035293+0000","last_peered":"2023-07-21T22:39:05.035293+0000","last_clean":"2023-07-21T22:39:05.035293+0000","last_became_active":"2023-07-21T22:39:04.066112+0000","last_became_peered":"2023-07-21T22:39:04.066112+0000","last_unstale":"2023-07-21T22:39:05.035293+0000","last_undegraded":"2023-07-21T22:39:05.035293+0000","last_fullsized":"2023-07-21T22:39:05.035293+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:19:53.977438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392834+0000","last_change":"2023-07-21T22:39:03.043496+0000","last_active":"2023-07-21T22:39:05.392834+0000","last_peered":"2023-07-21T22:39:05.392834+0000","last_clean":"2023-07-21T22:39:05.392834+0000","last_became_active":"2023-07-21T22:39:03.043150+0000","last_became_peered":"2023-07-21T22:39:03.043150+0000","last_unstale":"2023-07-21T22:39:05.392834+0000","last_undegraded":"2023-07-21T22:39:05.392834+0000","last_fullsized":"2023-07-21T22:39:05.392834+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:43.477160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392232+0000","last_change":"2023-07-21T22:39:04.056156+0000","last_active":"2023-07-21T22:39:05.392232+0000","last_peered":"2023-07-21T22:39:05.392232+0000","last_clean":"2023-07-21T22:39:05.392232+0000","last_became_active":"2023-07-21T22:39:04.055806+0000","last_became_peered":"2023-07-21T22:39:04.055806+0000","last_unstale":"2023-07-21T22:39:05.392232+0000","last_undegraded":"2023-07-21T22:39:05.392232+0000","last_fullsized":"2023-07-21T22:39:05.392232+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:03:23.359933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"156'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392467+0000","last_change":"2023-07-21T22:39:03.048717+0000","last_active":"2023-07-21T22:39:05.392467+0000","last_peered":"2023-07-21T22:39:05.392467+0000","last_clean":"2023-07-21T22:39:05.392467+0000","last_became_active":"2023-07-21T22:39:03.048384+0000","last_became_peered":"2023-07-21T22:39:03.048384+0000","last_unstale":"2023-07-21T22:39:05.392467+0000","last_undegraded":"2023-07-21T22:39:05.392467+0000","last_fullsized":"2023-07-21T22:39:05.392467+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:05:15.871318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.034999+0000","last_change":"2023-07-21T22:39:04.060504+0000","last_active":"2023-07-21T22:39:05.034999+0000","last_peered":"2023-07-21T22:39:05.034999+0000","last_clean":"2023-07-21T22:39:05.034999+0000","last_became_active":"2023-07-21T22:39:04.060167+0000","last_became_peered":"2023-07-21T22:39:04.060167+0000","last_unstale":"2023-07-21T22:39:05.034999+0000","last_undegraded":"2023-07-21T22:39:05.034999+0000","last_fullsized":"2023-07-21T22:39:05.034999+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:57:09.166782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392643+0000","last_change":"2023-07-21T22:39:03.045117+0000","last_active":"2023-07-21T22:39:05.392643+0000","last_peered":"2023-07-21T22:39:05.392643+0000","last_clean":"2023-07-21T22:39:05.392643+0000","last_became_active":"2023-07-21T22:39:03.044806+0000","last_became_peered":"2023-07-21T22:39:03.044806+0000","last_unstale":"2023-07-21T22:39:05.392643+0000","last_undegraded":"2023-07-21T22:39:05.392643+0000","last_fullsized":"2023-07-21T22:39:05.392643+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:08.519700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035586+0000","last_change":"2023-07-21T22:39:04.066243+0000","last_active":"2023-07-21T22:39:05.035586+0000","last_peered":"2023-07-21T22:39:05.035586+0000","last_clean":"2023-07-21T22:39:05.035586+0000","last_became_active":"2023-07-21T22:39:04.065930+0000","last_became_peered":"2023-07-21T22:39:04.065930+0000","last_unstale":"2023-07-21T22:39:05.035586+0000","last_undegraded":"2023-07-21T22:39:05.035586+0000","last_fullsized":"2023-07-21T22:39:05.035586+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:15:49.210312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"156'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389077+0000","last_change":"2023-07-21T22:39:03.039227+0000","last_active":"2023-07-21T22:39:05.389077+0000","last_peered":"2023-07-21T22:39:05.389077+0000","last_clean":"2023-07-21T22:39:05.389077+0000","last_became_active":"2023-07-21T22:39:03.038928+0000","last_became_peered":"2023-07-21T22:39:03.038928+0000","last_unstale":"2023-07-21T22:39:05.389077+0000","last_undegraded":"2023-07-21T22:39:05.389077+0000","last_fullsized":"2023-07-21T22:39:05.389077+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:48:05.408946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388240+0000","last_change":"2023-07-21T22:39:04.058107+0000","last_active":"2023-07-21T22:39:05.388240+0000","last_peered":"2023-07-21T22:39:05.388240+0000","last_clean":"2023-07-21T22:39:05.388240+0000","last_became_active":"2023-07-21T22:39:04.057795+0000","last_became_peered":"2023-07-21T22:39:04.057795+0000","last_unstale":"2023-07-21T22:39:05.388240+0000","last_undegraded":"2023-07-21T22:39:05.388240+0000","last_fullsized":"2023-07-21T22:39:05.388240+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:43:47.520691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.029405+0000","last_change":"2023-07-21T22:39:03.040678+0000","last_active":"2023-07-21T22:39:05.029405+0000","last_peered":"2023-07-21T22:39:05.029405+0000","last_clean":"2023-07-21T22:39:05.029405+0000","last_became_active":"2023-07-21T22:39:03.040326+0000","last_became_peered":"2023-07-21T22:39:03.040326+0000","last_unstale":"2023-07-21T22:39:05.029405+0000","last_undegraded":"2023-07-21T22:39:05.029405+0000","last_fullsized":"2023-07-21T22:39:05.029405+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:59:32.505683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.029332+0000","last_change":"2023-07-21T22:39:04.044526+0000","last_active":"2023-07-21T22:39:05.029332+0000","last_peered":"2023-07-21T22:39:05.029332+0000","last_clean":"2023-07-21T22:39:05.029332+0000","last_became_active":"2023-07-21T22:39:04.044206+0000","last_became_peered":"2023-07-21T22:39:04.044206+0000","last_unstale":"2023-07-21T22:39:05.029332+0000","last_undegraded":"2023-07-21T22:39:05.029332+0000","last_fullsized":"2023-07-21T22:39:05.029332+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:50:33.367291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.036309+0000","last_change":"2023-07-21T22:39:03.044385+0000","last_active":"2023-07-21T22:39:05.036309+0000","last_peered":"2023-07-21T22:39:05.036309+0000","last_clean":"2023-07-21T22:39:05.036309+0000","last_became_active":"2023-07-21T22:39:03.044051+0000","last_became_peered":"2023-07-21T22:39:03.044051+0000","last_unstale":"2023-07-21T22:39:05.036309+0000","last_undegraded":"2023-07-21T22:39:05.036309+0000","last_fullsized":"2023-07-21T22:39:05.036309+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:54:19.216620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388257+0000","last_change":"2023-07-21T22:39:04.063860+0000","last_active":"2023-07-21T22:39:05.388257+0000","last_peered":"2023-07-21T22:39:05.388257+0000","last_clean":"2023-07-21T22:39:05.388257+0000","last_became_active":"2023-07-21T22:39:04.063393+0000","last_became_peered":"2023-07-21T22:39:04.063393+0000","last_unstale":"2023-07-21T22:39:05.388257+0000","last_undegraded":"2023-07-21T22:39:05.388257+0000","last_fullsized":"2023-07-21T22:39:05.388257+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:24:09.570159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389444+0000","last_change":"2023-07-21T22:39:03.043464+0000","last_active":"2023-07-21T22:39:05.389444+0000","last_peered":"2023-07-21T22:39:05.389444+0000","last_clean":"2023-07-21T22:39:05.389444+0000","last_became_active":"2023-07-21T22:39:03.043147+0000","last_became_peered":"2023-07-21T22:39:03.043147+0000","last_unstale":"2023-07-21T22:39:05.389444+0000","last_undegraded":"2023-07-21T22:39:05.389444+0000","last_fullsized":"2023-07-21T22:39:05.389444+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:26:36.998574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.029305+0000","last_change":"2023-07-21T22:39:04.056375+0000","last_active":"2023-07-21T22:39:05.029305+0000","last_peered":"2023-07-21T22:39:05.029305+0000","last_clean":"2023-07-21T22:39:05.029305+0000","last_became_active":"2023-07-21T22:39:04.056069+0000","last_became_peered":"2023-07-21T22:39:04.056069+0000","last_unstale":"2023-07-21T22:39:05.029305+0000","last_undegraded":"2023-07-21T22:39:05.029305+0000","last_fullsized":"2023-07-21T22:39:05.029305+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:36:05.834812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035067+0000","last_change":"2023-07-21T22:39:03.053112+0000","last_active":"2023-07-21T22:39:05.035067+0000","last_peered":"2023-07-21T22:39:05.035067+0000","last_clean":"2023-07-21T22:39:05.035067+0000","last_became_active":"2023-07-21T22:39:03.052821+0000","last_became_peered":"2023-07-21T22:39:03.052821+0000","last_unstale":"2023-07-21T22:39:05.035067+0000","last_undegraded":"2023-07-21T22:39:05.035067+0000","last_fullsized":"2023-07-21T22:39:05.035067+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:35:11.478113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392203+0000","last_change":"2023-07-21T22:39:04.063816+0000","last_active":"2023-07-21T22:39:05.392203+0000","last_peered":"2023-07-21T22:39:05.392203+0000","last_clean":"2023-07-21T22:39:05.392203+0000","last_became_active":"2023-07-21T22:39:04.063208+0000","last_became_peered":"2023-07-21T22:39:04.063208+0000","last_unstale":"2023-07-21T22:39:05.392203+0000","last_undegraded":"2023-07-21T22:39:05.392203+0000","last_fullsized":"2023-07-21T22:39:05.392203+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:00.466148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389676+0000","last_change":"2023-07-21T22:39:03.042529+0000","last_active":"2023-07-21T22:39:05.389676+0000","last_peered":"2023-07-21T22:39:05.389676+0000","last_clean":"2023-07-21T22:39:05.389676+0000","last_became_active":"2023-07-21T22:39:03.042254+0000","last_became_peered":"2023-07-21T22:39:03.042254+0000","last_unstale":"2023-07-21T22:39:05.389676+0000","last_undegraded":"2023-07-21T22:39:05.389676+0000","last_fullsized":"2023-07-21T22:39:05.389676+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:07.327323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.028945+0000","last_change":"2023-07-21T22:39:04.058968+0000","last_active":"2023-07-21T22:39:05.028945+0000","last_peered":"2023-07-21T22:39:05.028945+0000","last_clean":"2023-07-21T22:39:05.028945+0000","last_became_active":"2023-07-21T22:39:04.058700+0000","last_became_peered":"2023-07-21T22:39:04.058700+0000","last_unstale":"2023-07-21T22:39:05.028945+0000","last_undegraded":"2023-07-21T22:39:05.028945+0000","last_fullsized":"2023-07-21T22:39:05.028945+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:07:55.217511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388790+0000","last_change":"2023-07-21T22:39:03.045034+0000","last_active":"2023-07-21T22:39:05.388790+0000","last_peered":"2023-07-21T22:39:05.388790+0000","last_clean":"2023-07-21T22:39:05.388790+0000","last_became_active":"2023-07-21T22:39:03.044569+0000","last_became_peered":"2023-07-21T22:39:03.044569+0000","last_unstale":"2023-07-21T22:39:05.388790+0000","last_undegraded":"2023-07-21T22:39:05.388790+0000","last_fullsized":"2023-07-21T22:39:05.388790+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:29:33.774339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392214+0000","last_change":"2023-07-21T22:39:04.061178+0000","last_active":"2023-07-21T22:39:05.392214+0000","last_peered":"2023-07-21T22:39:05.392214+0000","last_clean":"2023-07-21T22:39:05.392214+0000","last_became_active":"2023-07-21T22:39:04.060902+0000","last_became_peered":"2023-07-21T22:39:04.060902+0000","last_unstale":"2023-07-21T22:39:05.392214+0000","last_undegraded":"2023-07-21T22:39:05.392214+0000","last_fullsized":"2023-07-21T22:39:05.392214+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:16:43.587553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"157'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.036653+0000","last_change":"2023-07-21T22:39:03.043363+0000","last_active":"2023-07-21T22:39:05.036653+0000","last_peered":"2023-07-21T22:39:05.036653+0000","last_clean":"2023-07-21T22:39:05.036653+0000","last_became_active":"2023-07-21T22:39:03.043036+0000","last_became_peered":"2023-07-21T22:39:03.043036+0000","last_unstale":"2023-07-21T22:39:05.036653+0000","last_undegraded":"2023-07-21T22:39:05.036653+0000","last_fullsized":"2023-07-21T22:39:05.036653+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:56:19.372377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035084+0000","last_change":"2023-07-21T22:39:04.058556+0000","last_active":"2023-07-21T22:39:05.035084+0000","last_peered":"2023-07-21T22:39:05.035084+0000","last_clean":"2023-07-21T22:39:05.035084+0000","last_became_active":"2023-07-21T22:39:04.057335+0000","last_became_peered":"2023-07-21T22:39:04.057335+0000","last_unstale":"2023-07-21T22:39:05.035084+0000","last_undegraded":"2023-07-21T22:39:05.035084+0000","last_fullsized":"2023-07-21T22:39:05.035084+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:46:43.287353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.036590+0000","last_change":"2023-07-21T22:39:03.044365+0000","last_active":"2023-07-21T22:39:05.036590+0000","last_peered":"2023-07-21T22:39:05.036590+0000","last_clean":"2023-07-21T22:39:05.036590+0000","last_became_active":"2023-07-21T22:39:03.044104+0000","last_became_peered":"2023-07-21T22:39:03.044104+0000","last_unstale":"2023-07-21T22:39:05.036590+0000","last_undegraded":"2023-07-21T22:39:05.036590+0000","last_fullsized":"2023-07-21T22:39:05.036590+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:34:35.633875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388272+0000","last_change":"2023-07-21T22:39:04.066462+0000","last_active":"2023-07-21T22:39:05.388272+0000","last_peered":"2023-07-21T22:39:05.388272+0000","last_clean":"2023-07-21T22:39:05.388272+0000","last_became_active":"2023-07-21T22:39:04.066183+0000","last_became_peered":"2023-07-21T22:39:04.066183+0000","last_unstale":"2023-07-21T22:39:05.388272+0000","last_undegraded":"2023-07-21T22:39:05.388272+0000","last_fullsized":"2023-07-21T22:39:05.388272+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:43:57.677284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389390+0000","last_change":"2023-07-21T22:39:03.044807+0000","last_active":"2023-07-21T22:39:05.389390+0000","last_peered":"2023-07-21T22:39:05.389390+0000","last_clean":"2023-07-21T22:39:05.389390+0000","last_became_active":"2023-07-21T22:39:03.044482+0000","last_became_peered":"2023-07-21T22:39:03.044482+0000","last_unstale":"2023-07-21T22:39:05.389390+0000","last_undegraded":"2023-07-21T22:39:05.389390+0000","last_fullsized":"2023-07-21T22:39:05.389390+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:02:15.032934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389257+0000","last_change":"2023-07-21T22:39:04.043688+0000","last_active":"2023-07-21T22:39:05.389257+0000","last_peered":"2023-07-21T22:39:05.389257+0000","last_clean":"2023-07-21T22:39:05.389257+0000","last_became_active":"2023-07-21T22:39:04.043413+0000","last_became_peered":"2023-07-21T22:39:04.043413+0000","last_unstale":"2023-07-21T22:39:05.389257+0000","last_undegraded":"2023-07-21T22:39:05.389257+0000","last_fullsized":"2023-07-21T22:39:05.389257+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:10:56.651059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392050+0000","last_change":"2023-07-21T22:39:03.043971+0000","last_active":"2023-07-21T22:39:05.392050+0000","last_peered":"2023-07-21T22:39:05.392050+0000","last_clean":"2023-07-21T22:39:05.392050+0000","last_became_active":"2023-07-21T22:39:03.043698+0000","last_became_peered":"2023-07-21T22:39:03.043698+0000","last_unstale":"2023-07-21T22:39:05.392050+0000","last_undegraded":"2023-07-21T22:39:05.392050+0000","last_fullsized":"2023-07-21T22:39:05.392050+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:18:57.278955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388954+0000","last_change":"2023-07-21T22:39:04.044793+0000","last_active":"2023-07-21T22:39:05.388954+0000","last_peered":"2023-07-21T22:39:05.388954+0000","last_clean":"2023-07-21T22:39:05.388954+0000","last_became_active":"2023-07-21T22:39:04.043805+0000","last_became_peered":"2023-07-21T22:39:04.043805+0000","last_unstale":"2023-07-21T22:39:05.388954+0000","last_undegraded":"2023-07-21T22:39:05.388954+0000","last_fullsized":"2023-07-21T22:39:05.388954+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:08:15.225915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035638+0000","last_change":"2023-07-21T22:39:03.052780+0000","last_active":"2023-07-21T22:39:05.035638+0000","last_peered":"2023-07-21T22:39:05.035638+0000","last_clean":"2023-07-21T22:39:05.035638+0000","last_became_active":"2023-07-21T22:39:03.052324+0000","last_became_peered":"2023-07-21T22:39:03.052324+0000","last_unstale":"2023-07-21T22:39:05.035638+0000","last_undegraded":"2023-07-21T22:39:05.035638+0000","last_fullsized":"2023-07-21T22:39:05.035638+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:36:27.264655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389297+0000","last_change":"2023-07-21T22:39:04.063592+0000","last_active":"2023-07-21T22:39:05.389297+0000","last_peered":"2023-07-21T22:39:05.389297+0000","last_clean":"2023-07-21T22:39:05.389297+0000","last_became_active":"2023-07-21T22:39:04.063301+0000","last_became_peered":"2023-07-21T22:39:04.063301+0000","last_unstale":"2023-07-21T22:39:05.389297+0000","last_undegraded":"2023-07-21T22:39:05.389297+0000","last_fullsized":"2023-07-21T22:39:05.389297+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:17:52.311775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389121+0000","last_change":"2023-07-21T22:39:03.049975+0000","last_active":"2023-07-21T22:39:05.389121+0000","last_peered":"2023-07-21T22:39:05.389121+0000","last_clean":"2023-07-21T22:39:05.389121+0000","last_became_active":"2023-07-21T22:39:03.049641+0000","last_became_peered":"2023-07-21T22:39:03.049641+0000","last_unstale":"2023-07-21T22:39:05.389121+0000","last_undegraded":"2023-07-21T22:39:05.389121+0000","last_fullsized":"2023-07-21T22:39:05.389121+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:41:06.739764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035470+0000","last_change":"2023-07-21T22:39:04.062141+0000","last_active":"2023-07-21T22:39:05.035470+0000","last_peered":"2023-07-21T22:39:05.035470+0000","last_clean":"2023-07-21T22:39:05.035470+0000","last_became_active":"2023-07-21T22:39:04.061861+0000","last_became_peered":"2023-07-21T22:39:04.061861+0000","last_unstale":"2023-07-21T22:39:05.035470+0000","last_undegraded":"2023-07-21T22:39:05.035470+0000","last_fullsized":"2023-07-21T22:39:05.035470+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:53:51.439295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.029021+0000","last_change":"2023-07-21T22:39:03.039410+0000","last_active":"2023-07-21T22:39:05.029021+0000","last_peered":"2023-07-21T22:39:05.029021+0000","last_clean":"2023-07-21T22:39:05.029021+0000","last_became_active":"2023-07-21T22:39:03.039134+0000","last_became_peered":"2023-07-21T22:39:03.039134+0000","last_unstale":"2023-07-21T22:39:05.029021+0000","last_undegraded":"2023-07-21T22:39:05.029021+0000","last_fullsized":"2023-07-21T22:39:05.029021+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:12:51.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392779+0000","last_change":"2023-07-21T22:39:04.061519+0000","last_active":"2023-07-21T22:39:05.392779+0000","last_peered":"2023-07-21T22:39:05.392779+0000","last_clean":"2023-07-21T22:39:05.392779+0000","last_became_active":"2023-07-21T22:39:04.061229+0000","last_became_peered":"2023-07-21T22:39:04.061229+0000","last_unstale":"2023-07-21T22:39:05.392779+0000","last_undegraded":"2023-07-21T22:39:05.392779+0000","last_fullsized":"2023-07-21T22:39:05.392779+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:34:56.082185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035435+0000","last_change":"2023-07-21T22:39:03.053328+0000","last_active":"2023-07-21T22:39:05.035435+0000","last_peered":"2023-07-21T22:39:05.035435+0000","last_clean":"2023-07-21T22:39:05.035435+0000","last_became_active":"2023-07-21T22:39:03.052955+0000","last_became_peered":"2023-07-21T22:39:03.052955+0000","last_unstale":"2023-07-21T22:39:05.035435+0000","last_undegraded":"2023-07-21T22:39:05.035435+0000","last_fullsized":"2023-07-21T22:39:05.035435+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:35:46.000604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"145'271","reported_seq":953,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.034803+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:39:05.034803+0000","last_peered":"2023-07-21T22:39:05.034803+0000","last_clean":"2023-07-21T22:39:05.034803+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:39:05.034803+0000","last_undegraded":"2023-07-21T22:39:05.034803+0000","last_fullsized":"2023-07-21T22:39:05.034803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:12:17.171189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":280,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392190+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:39:05.392190+0000","last_peered":"2023-07-21T22:39:05.392190+0000","last_clean":"2023-07-21T22:39:05.392190+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:39:05.392190+0000","last_undegraded":"2023-07-21T22:39:05.392190+0000","last_fullsized":"2023-07-21T22:39:05.392190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:21:12.937569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035850+0000","last_change":"2023-07-21T22:39:04.060806+0000","last_active":"2023-07-21T22:39:05.035850+0000","last_peered":"2023-07-21T22:39:05.035850+0000","last_clean":"2023-07-21T22:39:05.035850+0000","last_became_active":"2023-07-21T22:39:04.060526+0000","last_became_peered":"2023-07-21T22:39:04.060526+0000","last_unstale":"2023-07-21T22:39:05.035850+0000","last_undegraded":"2023-07-21T22:39:05.035850+0000","last_fullsized":"2023-07-21T22:39:05.035850+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:19:17.833104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392204+0000","last_change":"2023-07-21T22:39:03.045628+0000","last_active":"2023-07-21T22:39:05.392204+0000","last_peered":"2023-07-21T22:39:05.392204+0000","last_clean":"2023-07-21T22:39:05.392204+0000","last_became_active":"2023-07-21T22:39:03.044601+0000","last_became_peered":"2023-07-21T22:39:03.044601+0000","last_unstale":"2023-07-21T22:39:05.392204+0000","last_undegraded":"2023-07-21T22:39:05.392204+0000","last_fullsized":"2023-07-21T22:39:05.392204+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:52:11.226500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":251,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.034700+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:39:05.034700+0000","last_peered":"2023-07-21T22:39:05.034700+0000","last_clean":"2023-07-21T22:39:05.034700+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:39:05.034700+0000","last_undegraded":"2023-07-21T22:39:05.034700+0000","last_fullsized":"2023-07-21T22:39:05.034700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:43:25.718602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.029288+0000","last_change":"2023-07-21T22:39:04.052730+0000","last_active":"2023-07-21T22:39:05.029288+0000","last_peered":"2023-07-21T22:39:05.029288+0000","last_clean":"2023-07-21T22:39:05.029288+0000","last_became_active":"2023-07-21T22:39:04.052431+0000","last_became_peered":"2023-07-21T22:39:04.052431+0000","last_unstale":"2023-07-21T22:39:05.029288+0000","last_undegraded":"2023-07-21T22:39:05.029288+0000","last_fullsized":"2023-07-21T22:39:05.029288+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:40:11.846854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"156'8","reported_seq":21,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389590+0000","last_change":"2023-07-21T22:39:03.046544+0000","last_active":"2023-07-21T22:39:05.389590+0000","last_peered":"2023-07-21T22:39:05.389590+0000","last_clean":"2023-07-21T22:39:05.389590+0000","last_became_active":"2023-07-21T22:39:03.046251+0000","last_became_peered":"2023-07-21T22:39:03.046251+0000","last_unstale":"2023-07-21T22:39:05.389590+0000","last_undegraded":"2023-07-21T22:39:05.389590+0000","last_fullsized":"2023-07-21T22:39:05.389590+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:25:13.171000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":252,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388617+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:39:05.388617+0000","last_peered":"2023-07-21T22:39:05.388617+0000","last_clean":"2023-07-21T22:39:05.388617+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:39:05.388617+0000","last_undegraded":"2023-07-21T22:39:05.388617+0000","last_fullsized":"2023-07-21T22:39:05.388617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:41:27.093486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388240+0000","last_change":"2023-07-21T22:39:04.055769+0000","last_active":"2023-07-21T22:39:05.388240+0000","last_peered":"2023-07-21T22:39:05.388240+0000","last_clean":"2023-07-21T22:39:05.388240+0000","last_became_active":"2023-07-21T22:39:04.055363+0000","last_became_peered":"2023-07-21T22:39:04.055363+0000","last_unstale":"2023-07-21T22:39:05.388240+0000","last_undegraded":"2023-07-21T22:39:05.388240+0000","last_fullsized":"2023-07-21T22:39:05.388240+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:40:36.964636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388689+0000","last_change":"2023-07-21T22:39:03.044488+0000","last_active":"2023-07-21T22:39:05.388689+0000","last_peered":"2023-07-21T22:39:05.388689+0000","last_clean":"2023-07-21T22:39:05.388689+0000","last_became_active":"2023-07-21T22:39:03.044193+0000","last_became_peered":"2023-07-21T22:39:03.044193+0000","last_unstale":"2023-07-21T22:39:05.388689+0000","last_undegraded":"2023-07-21T22:39:05.388689+0000","last_fullsized":"2023-07-21T22:39:05.388689+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:39:39.555656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":280,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392624+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:39:05.392624+0000","last_peered":"2023-07-21T22:39:05.392624+0000","last_clean":"2023-07-21T22:39:05.392624+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:39:05.392624+0000","last_undegraded":"2023-07-21T22:39:05.392624+0000","last_fullsized":"2023-07-21T22:39:05.392624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:50:15.389424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392836+0000","last_change":"2023-07-21T22:39:04.056483+0000","last_active":"2023-07-21T22:39:05.392836+0000","last_peered":"2023-07-21T22:39:05.392836+0000","last_clean":"2023-07-21T22:39:05.392836+0000","last_became_active":"2023-07-21T22:39:04.055902+0000","last_became_peered":"2023-07-21T22:39:04.055902+0000","last_unstale":"2023-07-21T22:39:05.392836+0000","last_undegraded":"2023-07-21T22:39:05.392836+0000","last_fullsized":"2023-07-21T22:39:05.392836+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:23:16.959823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"156'3","reported_seq":16,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035812+0000","last_change":"2023-07-21T22:39:03.050012+0000","last_active":"2023-07-21T22:39:05.035812+0000","last_peered":"2023-07-21T22:39:05.035812+0000","last_clean":"2023-07-21T22:39:05.035812+0000","last_became_active":"2023-07-21T22:39:03.049736+0000","last_became_peered":"2023-07-21T22:39:03.049736+0000","last_unstale":"2023-07-21T22:39:05.035812+0000","last_undegraded":"2023-07-21T22:39:05.035812+0000","last_fullsized":"2023-07-21T22:39:05.035812+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:39:25.018234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":264,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389522+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:39:05.389522+0000","last_peered":"2023-07-21T22:39:05.389522+0000","last_clean":"2023-07-21T22:39:05.389522+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:39:05.389522+0000","last_undegraded":"2023-07-21T22:39:05.389522+0000","last_fullsized":"2023-07-21T22:39:05.389522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:08.495700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392651+0000","last_change":"2023-07-21T22:39:04.059383+0000","last_active":"2023-07-21T22:39:05.392651+0000","last_peered":"2023-07-21T22:39:05.392651+0000","last_clean":"2023-07-21T22:39:05.392651+0000","last_became_active":"2023-07-21T22:39:04.058912+0000","last_became_peered":"2023-07-21T22:39:04.058912+0000","last_unstale":"2023-07-21T22:39:05.392651+0000","last_undegraded":"2023-07-21T22:39:05.392651+0000","last_fullsized":"2023-07-21T22:39:05.392651+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:59:48.043608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"156'6","reported_seq":19,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035695+0000","last_change":"2023-07-21T22:39:03.053828+0000","last_active":"2023-07-21T22:39:05.035695+0000","last_peered":"2023-07-21T22:39:05.035695+0000","last_clean":"2023-07-21T22:39:05.035695+0000","last_became_active":"2023-07-21T22:39:03.053526+0000","last_became_peered":"2023-07-21T22:39:03.053526+0000","last_unstale":"2023-07-21T22:39:05.035695+0000","last_undegraded":"2023-07-21T22:39:05.035695+0000","last_fullsized":"2023-07-21T22:39:05.035695+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:56:27.902286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":250,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035952+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:39:05.035952+0000","last_peered":"2023-07-21T22:39:05.035952+0000","last_clean":"2023-07-21T22:39:05.035952+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:39:05.035952+0000","last_undegraded":"2023-07-21T22:39:05.035952+0000","last_fullsized":"2023-07-21T22:39:05.035952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:09:08.663407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388086+0000","last_change":"2023-07-21T22:39:04.053931+0000","last_active":"2023-07-21T22:39:05.388086+0000","last_peered":"2023-07-21T22:39:05.388086+0000","last_clean":"2023-07-21T22:39:05.388086+0000","last_became_active":"2023-07-21T22:39:04.053655+0000","last_became_peered":"2023-07-21T22:39:04.053655+0000","last_unstale":"2023-07-21T22:39:05.388086+0000","last_undegraded":"2023-07-21T22:39:05.388086+0000","last_fullsized":"2023-07-21T22:39:05.388086+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:29:10.923948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392346+0000","last_change":"2023-07-21T22:39:03.042778+0000","last_active":"2023-07-21T22:39:05.392346+0000","last_peered":"2023-07-21T22:39:05.392346+0000","last_clean":"2023-07-21T22:39:05.392346+0000","last_became_active":"2023-07-21T22:39:03.042441+0000","last_became_peered":"2023-07-21T22:39:03.042441+0000","last_unstale":"2023-07-21T22:39:05.392346+0000","last_undegraded":"2023-07-21T22:39:05.392346+0000","last_fullsized":"2023-07-21T22:39:05.392346+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:54:38.441852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":264,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389410+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:39:05.389410+0000","last_peered":"2023-07-21T22:39:05.389410+0000","last_clean":"2023-07-21T22:39:05.389410+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:39:05.389410+0000","last_undegraded":"2023-07-21T22:39:05.389410+0000","last_fullsized":"2023-07-21T22:39:05.389410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:50:28.587260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389078+0000","last_change":"2023-07-21T22:39:04.055199+0000","last_active":"2023-07-21T22:39:05.389078+0000","last_peered":"2023-07-21T22:39:05.389078+0000","last_clean":"2023-07-21T22:39:05.389078+0000","last_became_active":"2023-07-21T22:39:04.054936+0000","last_became_peered":"2023-07-21T22:39:04.054936+0000","last_unstale":"2023-07-21T22:39:05.389078+0000","last_undegraded":"2023-07-21T22:39:05.389078+0000","last_fullsized":"2023-07-21T22:39:05.389078+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:02:05.262128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388811+0000","last_change":"2023-07-21T22:39:03.045134+0000","last_active":"2023-07-21T22:39:05.388811+0000","last_peered":"2023-07-21T22:39:05.388811+0000","last_clean":"2023-07-21T22:39:05.388811+0000","last_became_active":"2023-07-21T22:39:03.044863+0000","last_became_peered":"2023-07-21T22:39:03.044863+0000","last_unstale":"2023-07-21T22:39:05.388811+0000","last_undegraded":"2023-07-21T22:39:05.388811+0000","last_fullsized":"2023-07-21T22:39:05.388811+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:50:46.026092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":246,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.393087+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:39:05.393087+0000","last_peered":"2023-07-21T22:39:05.393087+0000","last_clean":"2023-07-21T22:39:05.393087+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:39:05.393087+0000","last_undegraded":"2023-07-21T22:39:05.393087+0000","last_fullsized":"2023-07-21T22:39:05.393087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:44:40.299560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509683,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59784,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312056,"statfs":{"total":96636764160,"available":96575545344,"internally_reserved":0,"allocated":2555904,"data_stored":1580354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67500000000000004,"15min":0.72499999999999998},"min":{"1min":0.46999999999999997,"5min":0.39800000000000002,"15min":0.35299999999999998},"max":{"1min":0.879,"5min":1.1180000000000001,"15min":3.5059999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65000000000000002,"15min":0.68700000000000006},"min":{"1min":0.432,"5min":0.40899999999999997,"15min":0.39500000000000002},"max":{"1min":0.89300000000000002,"5min":0.94199999999999995,"15min":3.2709999999999999},"last":0.59699999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.68000000000000005,"15min":0.71799999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.432},"max":{"1min":0.83099999999999996,"5min":1.0509999999999999,"15min":1.5429999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68000000000000005,"15min":0.70899999999999996},"min":{"1min":0.44800000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.998,"5min":1.093,"15min":1.093},"last":0.79000000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69999999999999996,"15min":0.73199999999999998},"min":{"1min":0.48899999999999999,"5min":0.46899999999999997,"15min":0.45500000000000002},"max":{"1min":0.92100000000000004,"5min":1.1399999999999999,"15min":1.405},"last":0.88},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.45800000000000002},"max":{"1min":0.93500000000000005,"5min":1.083,"15min":1.409},"last":0.75}]},{"osd":3,"last update":"Fri Jul 21 22:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.74199999999999999,"15min":0.75800000000000001},"min":{"1min":0.52900000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0129999999999999,"5min":1.1539999999999999,"15min":1.46},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71999999999999997,"15min":0.747},"min":{"1min":0.45000000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95399999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.83999999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56299999999999994,"15min":0.55700000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81999999999999995,"5min":0.89900000000000002,"15min":0.94999999999999996},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.627,"15min":0.621},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.153,"5min":1.153,"15min":1.7949999999999999},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.371,"5min":0.37,"15min":0.37},"max":{"1min":0.97199999999999998,"5min":0.98799999999999999,"15min":2.2120000000000002},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70999999999999996,"15min":0.68100000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.38300000000000001},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.506},"last":0.89400000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69399999999999995,"15min":0.68300000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65600000000000003,"15min":0.63600000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.90800000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542389,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37052,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334788,"statfs":{"total":96636764160,"available":96598822912,"internally_reserved":0,"allocated":1953792,"data_stored":989004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.755},"min":{"1min":0.47099999999999997,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.94399999999999995,"5min":1.016,"15min":1.016},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.437},"max":{"1min":0.96799999999999997,"5min":1.0289999999999999,"15min":1.1180000000000001},"last":0.67200000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.70099999999999996,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.49099999999999999,"15min":0.45300000000000001},"max":{"1min":0.872,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.45800000000000002,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.93300000000000005,"5min":0.99199999999999999,"15min":1.117},"last":0.501}]},{"osd":2,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71099999999999997,"15min":0.74199999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.42799999999999999},"max":{"1min":0.89600000000000002,"5min":0.98099999999999998,"15min":0.997},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.78700000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.45500000000000002},"max":{"1min":0.98199999999999998,"5min":1.0149999999999999,"15min":1.097},"last":0.70499999999999996}]},{"osd":3,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71999999999999997,"15min":0.748},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":1.048,"15min":1.048},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70499999999999996,"15min":0.72899999999999998},"min":{"1min":0.52300000000000002,"5min":0.49399999999999999,"15min":0.46899999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0049999999999999},"last":0.60799999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.93400000000000005,"15min":1.0229999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.39700000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.57699999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.054},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70299999999999996,"15min":0.68100000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.443},"max":{"1min":1.024,"5min":1.024,"15min":1.079},"last":0.624},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.68799999999999994}]}]},{"osd":5,"up_from":15,"seq":64424509682,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51000,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320840,"statfs":{"total":96636764160,"available":96584540160,"internally_reserved":0,"allocated":1949696,"data_stored":988354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.70999999999999996},"min":{"1min":0.48099999999999998,"5min":0.38500000000000001,"15min":0.35699999999999998},"max":{"1min":0.96499999999999997,"5min":1,"15min":1.8779999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.97999999999999998,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.55800000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.68600000000000005,"15min":0.70299999999999996},"min":{"1min":0.505,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.95899999999999996,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69099999999999995,"15min":0.72099999999999997},"min":{"1min":0.42699999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.617},"last":0.748}]},{"osd":2,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71099999999999997,"15min":0.72699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.33600000000000002},"max":{"1min":1.008,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.42199999999999999,"15min":0.377},"max":{"1min":0.89300000000000002,"5min":1.073,"15min":1.512},"last":0.76800000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76900000000000002,"15min":0.77800000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":1.0009999999999999,"15min":1.472},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76000000000000001,"15min":0.78700000000000003},"min":{"1min":0.60099999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.997,"5min":1.022,"15min":1.556},"last":0.80400000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.372,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83699999999999997,"5min":0.88900000000000001,"15min":0.96999999999999997},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72399999999999998,"15min":0.69599999999999995},"min":{"1min":0.58899999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.92300000000000004,"5min":0.92400000000000004,"15min":1.038},"last":0.83099999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":0.95499999999999996,"15min":1.0049999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.40200000000000002,"15min":0.40000000000000002},"max":{"1min":0.76600000000000001,"5min":0.93799999999999994,"15min":1.02},"last":0.65300000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70099999999999996,"15min":0.65700000000000003},"min":{"1min":0.46200000000000002,"5min":0.40999999999999998,"15min":0.374},"max":{"1min":0.96699999999999997,"5min":1.042,"15min":1.042},"last":0.624},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":0.73099999999999998},"min":{"1min":0.59799999999999998,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.88300000000000001,"5min":0.999,"15min":1.7390000000000001},"last":0.878}]}]},{"osd":4,"up_from":15,"seq":64424509683,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32948,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1945600,"data_stored":988332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68300000000000005,"15min":0.72999999999999998},"min":{"1min":0.48599999999999999,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":0.93600000000000005,"5min":1.077,"15min":1.077},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68899999999999995,"15min":0.72999999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89800000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.72699999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.66900000000000004,"15min":0.69699999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92200000000000004,"5min":1.044,"15min":1.044},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65600000000000003,"15min":0.69499999999999995},"min":{"1min":0.53100000000000003,"5min":0.43099999999999999,"15min":0.36899999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.96399999999999997},"last":0.60599999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.70499999999999996,"15min":0.746},"min":{"1min":0.441,"5min":0.441,"15min":0.371},"max":{"1min":0.88500000000000001,"5min":1.052,"15min":1.052},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71499999999999997,"15min":0.75700000000000001},"min":{"1min":0.501,"5min":0.47699999999999998,"15min":0.33000000000000002},"max":{"1min":0.89300000000000002,"5min":1.018,"15min":1.0660000000000001},"last":0.751}]},{"osd":3,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68000000000000005,"15min":0.72199999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.40100000000000002},"max":{"1min":0.90000000000000002,"5min":0.94599999999999995,"15min":1.0169999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.77500000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47999999999999998},"max":{"1min":0.94899999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.82299999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61099999999999999,"15min":0.58399999999999996},"min":{"1min":0.44400000000000001,"5min":0.35799999999999998,"15min":0.34399999999999997},"max":{"1min":0.86399999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.42799999999999999,"5min":0.42699999999999999,"15min":0.32800000000000001},"max":{"1min":0.82299999999999995,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.64100000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.439,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.90900000000000003,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72299999999999998,"15min":0.71599999999999997},"min":{"1min":0.48499999999999999,"5min":0.443,"15min":0.41599999999999998},"max":{"1min":0.96299999999999997,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.84699999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.39200000000000002},"max":{"1min":0.93999999999999995,"5min":1.028,"15min":1.028},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.47199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97099999999999997,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.89400000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509682,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32964,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338876,"statfs":{"total":96636764160,"available":96603009024,"internally_reserved":0,"allocated":1961984,"data_stored":989966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46899999999999997,"15min":0.47499999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":0.77800000000000002,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.38},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.40400000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46200000000000002,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60299999999999998,"5min":0.754,"15min":0.83499999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.41999999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71899999999999997,"5min":0.82599999999999996,"15min":0.90100000000000002},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67600000000000005,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.59599999999999997},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.99199999999999999},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.755,"15min":0.77000000000000002},"min":{"1min":0.57599999999999996,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91200000000000003,"5min":1.093,"15min":1.1279999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.81399999999999995},"min":{"1min":0.54500000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.93200000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.78600000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.76900000000000002},"min":{"1min":0.54900000000000004,"5min":0.501,"15min":0.48999999999999999},"max":{"1min":0.97799999999999998,"5min":1.0669999999999999,"15min":1.137},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.51300000000000001,"15min":0.42899999999999999},"max":{"1min":0.86399999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76900000000000002,"15min":0.79000000000000004},"min":{"1min":0.51900000000000002,"5min":0.51700000000000002,"15min":0.47399999999999998},"max":{"1min":0.91700000000000004,"5min":1.0680000000000001,"15min":1.169},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91300000000000003,"5min":1.107,"15min":1.1120000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79200000000000004,"15min":0.81299999999999994},"min":{"1min":0.621,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94299999999999995,"5min":1.083,"15min":1.099},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80900000000000005,"15min":0.82799999999999996},"min":{"1min":0.61299999999999999,"5min":0.55200000000000005,"15min":0.48599999999999999},"max":{"1min":0.92200000000000004,"5min":1.623,"15min":1.623},"last":0.86599999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509684,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55100,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316740,"statfs":{"total":96636764160,"available":96580341760,"internally_reserved":0,"allocated":1953792,"data_stored":988948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.46400000000000002},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.23899999999999999},"max":{"1min":0.624,"5min":0.75,"15min":0.94199999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50600000000000001,"15min":0.54100000000000004},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.308},"max":{"1min":0.64200000000000002,"5min":0.88300000000000001,"15min":1.0409999999999999},"last":0.44700000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.40699999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72599999999999998,"5min":0.86699999999999999,"15min":0.93999999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.012,"15min":1.085},"last":0.52700000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46300000000000002,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.623,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.56399999999999995},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.85299999999999998,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.46600000000000003,"15min":0.376},"max":{"1min":1.016,"5min":1.1579999999999999,"15min":1.3420000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73599999999999999,"15min":0.78500000000000003},"min":{"1min":0.48899999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.996,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0780000000000001,"5min":1.214,"15min":1.214},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77700000000000002,"15min":0.80600000000000005},"min":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.46400000000000002},"max":{"1min":1.012,"5min":1.2689999999999999,"15min":1.3089999999999999},"last":0.73799999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.746,"15min":0.78300000000000003},"min":{"1min":0.52800000000000002,"5min":0.499,"15min":0.40300000000000002},"max":{"1min":0.94399999999999995,"5min":1.536,"15min":1.536},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.46200000000000002},"max":{"1min":1.0289999999999999,"5min":1.1339999999999999,"15min":1.2649999999999999},"last":0.79200000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77500000000000002,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.008,"5min":1.143,"15min":1.214},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.751,"15min":0.79700000000000004},"min":{"1min":0.58899999999999997,"5min":0.50900000000000001,"15min":0.44700000000000001},"max":{"1min":0.91200000000000003,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.72599999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509683,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1949696,"data_stored":988402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.47499999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.22900000000000001},"max":{"1min":0.60399999999999998,"5min":0.78700000000000003,"15min":0.84599999999999997},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54100000000000004,"15min":0.55900000000000005},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.35099999999999998},"max":{"1min":0.80900000000000005,"5min":0.82499999999999996,"15min":0.872},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48999999999999999,"15min":0.502},"min":{"1min":0.36199999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"max":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":0.81000000000000005},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.29099999999999998},"max":{"1min":0.71899999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.41799999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.42299999999999999,"5min":0.378,"15min":0.33400000000000002},"max":{"1min":0.76100000000000001,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":0.77600000000000002,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.432},"max":{"1min":1.115,"5min":1.294,"15min":1.294},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77800000000000002,"15min":0.79000000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.498},"max":{"1min":1.1220000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.70299999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.753,"15min":0.77200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.41899999999999998},"max":{"1min":1.0980000000000001,"5min":1.242,"15min":1.242},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.55700000000000005,"5min":0.51500000000000001,"15min":0.376},"max":{"1min":1.1639999999999999,"5min":1.276,"15min":1.2849999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77700000000000002,"15min":0.80000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.47899999999999998},"max":{"1min":1.0800000000000001,"5min":1.208,"15min":1.23},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.78100000000000003},"min":{"1min":0.56100000000000005,"5min":0.50900000000000001,"15min":0.46500000000000002},"max":{"1min":1.0109999999999999,"5min":1.244,"15min":1.3240000000000001},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78500000000000003,"15min":0.80400000000000005},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.49199999999999999},"max":{"1min":1.089,"5min":1.3120000000000001,"15min":1.3149999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.45700000000000002},"max":{"1min":1.0289999999999999,"5min":1.1819999999999999,"15min":1.3380000000000001},"last":0.68799999999999994}]}]},{"osd":0,"up_from":15,"seq":64424509685,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37632,"kb_used_data":2488,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334208,"statfs":{"total":96636764160,"available":96598228992,"internally_reserved":0,"allocated":2547712,"data_stored":1578756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.33200000000000002,"5min":0.28399999999999997,"15min":0.26600000000000001},"max":{"1min":0.66300000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50900000000000001,"15min":0.51600000000000001},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.70599999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.42599999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.41599999999999998,"5min":0.32400000000000001,"15min":0.29799999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.3680000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.495,"5min":0.49099999999999999,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.871},"last":0.40100000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.432,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81899999999999995,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.33700000000000002},"max":{"1min":0.83599999999999997,"5min":0.88600000000000001,"15min":1.038},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.81000000000000005,"15min":0.78400000000000003},"min":{"1min":0.56899999999999995,"5min":0.499,"15min":0.45200000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.80500000000000005,"15min":0.80000000000000004},"min":{"1min":0.57899999999999996,"5min":0.505,"15min":0.44600000000000001},"max":{"1min":1.206,"5min":1.278,"15min":1.423},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.59599999999999997,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.0089999999999999,"5min":1.0960000000000001,"15min":1.2669999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80500000000000005,"15min":0.80300000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.39600000000000002},"max":{"1min":1.119,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.48899999999999999},"max":{"1min":1.2210000000000001,"5min":1.27,"15min":1.27},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.65500000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.86499999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80700000000000005,"15min":0.79500000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.53100000000000003},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80200000000000005,"15min":0.82199999999999995},"min":{"1min":0.58999999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1479999999999999,"5min":1.1930000000000001,"15min":1.296},"last":0.84099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:39:12.821 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:39:12.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.931+0000 7f616b374640 1 Processor -- start 2023-07-21T22:39:12.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.931+0000 7f616b374640 1 -- start start 2023-07-21T22:39:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.931+0000 7f616b374640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6164158ce0 0x7f6164070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.931+0000 7f616b374640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f61640c8ad0 0x7f61640c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.931+0000 7f616b374640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61640cc700 con 0x7f61640c9560 2023-07-21T22:39:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.931+0000 7f616b374640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61640c99e0 con 0x7f61640c8ad0 2023-07-21T22:39:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.931+0000 7f616b374640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61640b0ff0 con 0x7f6164158ce0 2023-07-21T22:39:12.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.931+0000 7f6169911640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f61640c9560 0x7f61640cab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37346/0 (socket says 172.21.15.6:37346) 2023-07-21T22:39:12.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.931+0000 7f6169911640 1 -- 172.21.15.6:0/2902048625 learned_addr learned my addr 172.21.15.6:0/2902048625 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:39:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f616890f640 1 --2- 172.21.15.6:0/2902048625 >> v2:172.21.15.161:3300/0 conn(0x7f61640c8ad0 0x7f61640c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f6169110640 1 --2- 172.21.15.6:0/2902048625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6164158ce0 0x7f6164070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f615bfff640 1 -- 172.21.15.6:0/2902048625 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73537219 0 0) 0x7f61640cc700 con 0x7f61640c9560 2023-07-21T22:39:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f615bfff640 1 -- 172.21.15.6:0/2902048625 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6150003530 con 0x7f61640c9560 2023-07-21T22:39:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f615bfff640 1 -- 172.21.15.6:0/2902048625 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1626253692 0 0) 0x7f6150003530 con 0x7f61640c9560 2023-07-21T22:39:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f615bfff640 1 -- 172.21.15.6:0/2902048625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6164158ce0 msgr2=0x7f6164070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f615bfff640 1 --2- 172.21.15.6:0/2902048625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6164158ce0 0x7f6164070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f615bfff640 1 -- 172.21.15.6:0/2902048625 >> v2:172.21.15.161:3300/0 conn(0x7f61640c8ad0 msgr2=0x7f61640c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f615bfff640 1 --2- 172.21.15.6:0/2902048625 >> v2:172.21.15.161:3300/0 conn(0x7f61640c8ad0 0x7f61640c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f615bfff640 1 -- 172.21.15.6:0/2902048625 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6164070c80 con 0x7f61640c9560 2023-07-21T22:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f615bfff640 1 -- 172.21.15.6:0/2902048625 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f615c001a00 con 0x7f61640c9560 2023-07-21T22:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f615bfff640 1 -- 172.21.15.6:0/2902048625 >> v1:172.21.15.6:6789/0 conn(0x7f61640c9560 legacy=0x7f61640cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f615bfff640 1 --2- 172.21.15.6:0/2902048625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6164158ce0 0x7f6150003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f615bfff640 1 --2- 172.21.15.6:0/2902048625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6150003f00 0x7f61500047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f615bfff640 1 --2- 172.21.15.6:0/2902048625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6150004d10 0x7f6150005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:12.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f615bfff640 1 -- 172.21.15.6:0/2902048625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61640c99e0 con 0x7f6150004d10 2023-07-21T22:39:12.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f615bfff640 1 -- 172.21.15.6:0/2902048625 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61640b0ff0 con 0x7f6150003f00 2023-07-21T22:39:12.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f615bfff640 1 -- 172.21.15.6:0/2902048625 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615000ba70 con 0x7f6164158ce0 2023-07-21T22:39:12.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f6169911640 1 --2- 172.21.15.6:0/2902048625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6150004d10 0x7f6150005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:12.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f6169110640 1 --2- 172.21.15.6:0/2902048625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6164158ce0 0x7f6150003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:12.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f616890f640 1 --2- 172.21.15.6:0/2902048625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6150003f00 0x7f61500047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:12.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f6169911640 1 -- 172.21.15.6:0/2902048625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6164158ce0 msgr2=0x7f6150003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:12.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f6169911640 1 --2- 172.21.15.6:0/2902048625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6164158ce0 0x7f6150003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:12.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f6169911640 1 -- 172.21.15.6:0/2902048625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6150003f00 msgr2=0x7f61500047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:12.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f6169911640 1 --2- 172.21.15.6:0/2902048625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6150003f00 0x7f61500047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:12.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.935+0000 7f6169911640 1 -- 172.21.15.6:0/2902048625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6150003530 con 0x7f6150004d10 2023-07-21T22:39:12.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.939+0000 7f6169911640 1 --2- 172.21.15.6:0/2902048625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6150004d10 0x7f6150005180 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f615c00a830 tx=0x7f615c01d310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f1f9d292ccc0dd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:12.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.939+0000 7f615bfff640 1 -- 172.21.15.6:0/2902048625 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61640cba20 con 0x7f6150004d10 2023-07-21T22:39:12.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.939+0000 7f615bfff640 1 -- 172.21.15.6:0/2902048625 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615c0a8070 con 0x7f6150004d10 2023-07-21T22:39:12.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.939+0000 7f615bfff640 1 -- 172.21.15.6:0/2902048625 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c0ad8d0 con 0x7f6150004d10 2023-07-21T22:39:12.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.939+0000 7f616b374640 1 -- 172.21.15.6:0/2902048625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6150004d10 msgr2=0x7f6150005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:12.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.939+0000 7f616b374640 1 --2- 172.21.15.6:0/2902048625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6150004d10 0x7f6150005180 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f615c00a830 tx=0x7f615c01d310 comp rx=0 tx=0).stop 2023-07-21T22:39:12.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.939+0000 7f6169911640 1 -- 172.21.15.6:0/2902048625 reap_dead start 2023-07-21T22:39:12.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.939+0000 7f616b374640 1 -- 172.21.15.6:0/2902048625 shutdown_connections 2023-07-21T22:39:12.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.939+0000 7f616b374640 1 -- 172.21.15.6:0/2902048625 >> 172.21.15.6:0/2902048625 conn(0x7f61640afcf0 msgr2=0x7f61640b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:12.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.939+0000 7f616b374640 1 -- 172.21.15.6:0/2902048625 shutdown_connections 2023-07-21T22:39:12.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.939+0000 7f616b374640 1 -- 172.21.15.6:0/2902048625 wait complete. 2023-07-21T22:39:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.939+0000 7f616b374640 1 Processor -- start 2023-07-21T22:39:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.939+0000 7f616b374640 1 -- start start 2023-07-21T22:39:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f616b374640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6150004d10 0x7f616414e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f616b374640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61641e91e0 0x7f61640c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f616b374640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61641e9650 0x7f61640c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f616b374640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61641f8cc0 con 0x7f61641e9650 2023-07-21T22:39:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f616b374640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61640c2350 con 0x7f6150004d10 2023-07-21T22:39:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f616b374640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61640b33e0 con 0x7f61641e91e0 2023-07-21T22:39:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f6169911640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61641e9650 0x7f61640c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:12.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f6169911640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61641e9650 0x7f61640c7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54486/0 (socket says 172.21.15.6:54486) 2023-07-21T22:39:12.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f6169911640 1 -- 172.21.15.6:0/63438609 learned_addr learned my addr 172.21.15.6:0/63438609 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:12.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f6169110640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6150004d10 0x7f616414e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:12.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f616890f640 1 --2- 172.21.15.6:0/63438609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61641e91e0 0x7f61640c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:12.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f6169911640 1 -- 172.21.15.6:0/63438609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61641e91e0 msgr2=0x7f61640c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:12.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f6169911640 1 --2- 172.21.15.6:0/63438609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61641e91e0 0x7f61640c7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:12.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f6169911640 1 -- 172.21.15.6:0/63438609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6150004d10 msgr2=0x7f616414e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:12.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f6169911640 1 --2- 172.21.15.6:0/63438609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6150004d10 0x7f616414e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:12.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f6169911640 1 -- 172.21.15.6:0/63438609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61640b36c0 con 0x7f61641e9650 2023-07-21T22:39:12.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f6169911640 1 --2- 172.21.15.6:0/63438609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61641e9650 0x7f61640c7940 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f615c01cd80 tx=0x7f6150005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:12.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f6159ffb640 1 -- 172.21.15.6:0/63438609 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c001fe0 con 0x7f61641e9650 2023-07-21T22:39:12.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f6159ffb640 1 -- 172.21.15.6:0/63438609 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615c0017c0 con 0x7f61641e9650 2023-07-21T22:39:12.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f6159ffb640 1 -- 172.21.15.6:0/63438609 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c004b70 con 0x7f61641e9650 2023-07-21T22:39:12.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f616b374640 1 -- 172.21.15.6:0/63438609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61640c1c90 con 0x7f61641e9650 2023-07-21T22:39:12.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f616b374640 1 -- 172.21.15.6:0/63438609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616414e770 con 0x7f61641e9650 2023-07-21T22:39:12.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.943+0000 7f616b374640 1 -- 172.21.15.6:0/63438609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61640ca1a0 con 0x7f61641e9650 2023-07-21T22:39:12.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.947+0000 7f6159ffb640 1 -- 172.21.15.6:0/63438609 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f615c0aa030 con 0x7f61641e9650 2023-07-21T22:39:12.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.947+0000 7f6159ffb640 1 --2- 172.21.15.6:0/63438609 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f61480663c0 0x7f6148068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:12.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.947+0000 7f6159ffb640 1 -- 172.21.15.6:0/63438609 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f615c11d690 con 0x7f61641e9650 2023-07-21T22:39:12.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.947+0000 7f6169110640 1 --2- 172.21.15.6:0/63438609 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f61480663c0 0x7f6148068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:12.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.947+0000 7f6169110640 1 --2- 172.21.15.6:0/63438609 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f61480663c0 0x7f6148068870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f61640cb160 tx=0x7f6160009190 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:12.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:12.951+0000 7f6159ffb640 1 -- 172.21.15.6:0/63438609 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f615c0ea9f0 con 0x7f61641e9650 2023-07-21T22:39:13.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.103+0000 7f616b374640 1 -- 172.21.15.6:0/63438609 --> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61640cc390 con 0x7f61480663c0 2023-07-21T22:39:13.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.111+0000 7f6159ffb640 1 -- 172.21.15.6:0/63438609 <== mgr.7694 v2:172.21.15.161:6832/2692111396 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311703 (secure 0 0 0) 0x7f6160019070 con 0x7f61480663c0 2023-07-21T22:39:13.161 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:39:13.163 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:39:13.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.115+0000 7f616b374640 1 -- 172.21.15.6:0/63438609 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f61480663c0 msgr2=0x7f6148068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:13.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.115+0000 7f616b374640 1 --2- 172.21.15.6:0/63438609 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f61480663c0 0x7f6148068870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f61640cb160 tx=0x7f6160009190 comp rx=0 tx=0).stop 2023-07-21T22:39:13.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.115+0000 7f616b374640 1 -- 172.21.15.6:0/63438609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61641e9650 msgr2=0x7f61640c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:13.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.115+0000 7f616b374640 1 --2- 172.21.15.6:0/63438609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61641e9650 0x7f61640c7940 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f615c01cd80 tx=0x7f6150005800 comp rx=0 tx=0).stop 2023-07-21T22:39:13.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.115+0000 7f616b374640 1 -- 172.21.15.6:0/63438609 shutdown_connections 2023-07-21T22:39:13.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.115+0000 7f616b374640 1 --2- 172.21.15.6:0/63438609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61641e9650 0x7f61640c7940 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.115+0000 7f616b374640 1 --2- 172.21.15.6:0/63438609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61641e91e0 0x7f61640c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.115+0000 7f616b374640 1 --2- 172.21.15.6:0/63438609 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f61480663c0 0x7f6148068870 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.115+0000 7f616b374640 1 --2- 172.21.15.6:0/63438609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6150004d10 0x7f616414e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.115+0000 7f616b374640 1 -- 172.21.15.6:0/63438609 >> 172.21.15.6:0/63438609 conn(0x7f61640afcf0 msgr2=0x7f6164156b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:13.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.115+0000 7f616b374640 1 -- 172.21.15.6:0/63438609 shutdown_connections 2023-07-21T22:39:13.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.115+0000 7f616b374640 1 -- 172.21.15.6:0/63438609 wait complete. 2023-07-21T22:39:13.182 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-21T22:39:11.695431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":484,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":310,"ondisk_log_size":310,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":206,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":339432,"kb_used_data":16424,"kb_used_omap":0,"kb_used_meta":322944,"kb_avail":754635288,"statfs":{"total":773094113280,"available":772746534912,"internally_reserved":0,"allocated":16818176,"data_stored":9092116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":330694656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002096"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388670+0000","last_change":"2023-07-21T22:39:04.057641+0000","last_active":"2023-07-21T22:39:05.388670+0000","last_peered":"2023-07-21T22:39:05.388670+0000","last_clean":"2023-07-21T22:39:05.388670+0000","last_became_active":"2023-07-21T22:39:04.057354+0000","last_became_peered":"2023-07-21T22:39:04.057354+0000","last_unstale":"2023-07-21T22:39:05.388670+0000","last_undegraded":"2023-07-21T22:39:05.388670+0000","last_fullsized":"2023-07-21T22:39:05.388670+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:25:39.054685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392289+0000","last_change":"2023-07-21T22:39:04.044240+0000","last_active":"2023-07-21T22:39:05.392289+0000","last_peered":"2023-07-21T22:39:05.392289+0000","last_clean":"2023-07-21T22:39:05.392289+0000","last_became_active":"2023-07-21T22:39:04.043956+0000","last_became_peered":"2023-07-21T22:39:04.043956+0000","last_unstale":"2023-07-21T22:39:05.392289+0000","last_undegraded":"2023-07-21T22:39:05.392289+0000","last_fullsized":"2023-07-21T22:39:05.392289+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:27:20.991699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392604+0000","last_change":"2023-07-21T22:39:04.059414+0000","last_active":"2023-07-21T22:39:05.392604+0000","last_peered":"2023-07-21T22:39:05.392604+0000","last_clean":"2023-07-21T22:39:05.392604+0000","last_became_active":"2023-07-21T22:39:04.059043+0000","last_became_peered":"2023-07-21T22:39:04.059043+0000","last_unstale":"2023-07-21T22:39:05.392604+0000","last_undegraded":"2023-07-21T22:39:05.392604+0000","last_fullsized":"2023-07-21T22:39:05.392604+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:26:50.897262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392452+0000","last_change":"2023-07-21T22:39:04.063389+0000","last_active":"2023-07-21T22:39:05.392452+0000","last_peered":"2023-07-21T22:39:05.392452+0000","last_clean":"2023-07-21T22:39:05.392452+0000","last_became_active":"2023-07-21T22:39:04.063071+0000","last_became_peered":"2023-07-21T22:39:04.063071+0000","last_unstale":"2023-07-21T22:39:05.392452+0000","last_undegraded":"2023-07-21T22:39:05.392452+0000","last_fullsized":"2023-07-21T22:39:05.392452+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:50:00.388814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.028958+0000","last_change":"2023-07-21T22:39:04.046698+0000","last_active":"2023-07-21T22:39:05.028958+0000","last_peered":"2023-07-21T22:39:05.028958+0000","last_clean":"2023-07-21T22:39:05.028958+0000","last_became_active":"2023-07-21T22:39:04.046440+0000","last_became_peered":"2023-07-21T22:39:04.046440+0000","last_unstale":"2023-07-21T22:39:05.028958+0000","last_undegraded":"2023-07-21T22:39:05.028958+0000","last_fullsized":"2023-07-21T22:39:05.028958+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:49:10.404559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388620+0000","last_change":"2023-07-21T22:39:04.055173+0000","last_active":"2023-07-21T22:39:05.388620+0000","last_peered":"2023-07-21T22:39:05.388620+0000","last_clean":"2023-07-21T22:39:05.388620+0000","last_became_active":"2023-07-21T22:39:04.054811+0000","last_became_peered":"2023-07-21T22:39:04.054811+0000","last_unstale":"2023-07-21T22:39:05.388620+0000","last_undegraded":"2023-07-21T22:39:05.388620+0000","last_fullsized":"2023-07-21T22:39:05.388620+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:38:48.452779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.034781+0000","last_change":"2023-07-21T22:39:04.060080+0000","last_active":"2023-07-21T22:39:05.034781+0000","last_peered":"2023-07-21T22:39:05.034781+0000","last_clean":"2023-07-21T22:39:05.034781+0000","last_became_active":"2023-07-21T22:39:04.059783+0000","last_became_peered":"2023-07-21T22:39:04.059783+0000","last_unstale":"2023-07-21T22:39:05.034781+0000","last_undegraded":"2023-07-21T22:39:05.034781+0000","last_fullsized":"2023-07-21T22:39:05.034781+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:49:45.496175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035851+0000","last_change":"2023-07-21T22:39:04.061518+0000","last_active":"2023-07-21T22:39:05.035851+0000","last_peered":"2023-07-21T22:39:05.035851+0000","last_clean":"2023-07-21T22:39:05.035851+0000","last_became_active":"2023-07-21T22:39:04.061191+0000","last_became_peered":"2023-07-21T22:39:04.061191+0000","last_unstale":"2023-07-21T22:39:05.035851+0000","last_undegraded":"2023-07-21T22:39:05.035851+0000","last_fullsized":"2023-07-21T22:39:05.035851+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:46:10.615120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389418+0000","last_change":"2023-07-21T22:39:04.048087+0000","last_active":"2023-07-21T22:39:05.389418+0000","last_peered":"2023-07-21T22:39:05.389418+0000","last_clean":"2023-07-21T22:39:05.389418+0000","last_became_active":"2023-07-21T22:39:04.043863+0000","last_became_peered":"2023-07-21T22:39:04.043863+0000","last_unstale":"2023-07-21T22:39:05.389418+0000","last_undegraded":"2023-07-21T22:39:05.389418+0000","last_fullsized":"2023-07-21T22:39:05.389418+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:49:24.055468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388693+0000","last_change":"2023-07-21T22:39:04.065732+0000","last_active":"2023-07-21T22:39:05.388693+0000","last_peered":"2023-07-21T22:39:05.388693+0000","last_clean":"2023-07-21T22:39:05.388693+0000","last_became_active":"2023-07-21T22:39:04.065429+0000","last_became_peered":"2023-07-21T22:39:04.065429+0000","last_unstale":"2023-07-21T22:39:05.388693+0000","last_undegraded":"2023-07-21T22:39:05.388693+0000","last_fullsized":"2023-07-21T22:39:05.388693+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:46:47.453377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392069+0000","last_change":"2023-07-21T22:39:04.063218+0000","last_active":"2023-07-21T22:39:05.392069+0000","last_peered":"2023-07-21T22:39:05.392069+0000","last_clean":"2023-07-21T22:39:05.392069+0000","last_became_active":"2023-07-21T22:39:04.062868+0000","last_became_peered":"2023-07-21T22:39:04.062868+0000","last_unstale":"2023-07-21T22:39:05.392069+0000","last_undegraded":"2023-07-21T22:39:05.392069+0000","last_fullsized":"2023-07-21T22:39:05.392069+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:28:50.000104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388383+0000","last_change":"2023-07-21T22:39:04.047810+0000","last_active":"2023-07-21T22:39:05.388383+0000","last_peered":"2023-07-21T22:39:05.388383+0000","last_clean":"2023-07-21T22:39:05.388383+0000","last_became_active":"2023-07-21T22:39:04.047534+0000","last_became_peered":"2023-07-21T22:39:04.047534+0000","last_unstale":"2023-07-21T22:39:05.388383+0000","last_undegraded":"2023-07-21T22:39:05.388383+0000","last_fullsized":"2023-07-21T22:39:05.388383+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:21:51.268747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389078+0000","last_change":"2023-07-21T22:39:04.053489+0000","last_active":"2023-07-21T22:39:05.389078+0000","last_peered":"2023-07-21T22:39:05.389078+0000","last_clean":"2023-07-21T22:39:05.389078+0000","last_became_active":"2023-07-21T22:39:04.053071+0000","last_became_peered":"2023-07-21T22:39:04.053071+0000","last_unstale":"2023-07-21T22:39:05.389078+0000","last_undegraded":"2023-07-21T22:39:05.389078+0000","last_fullsized":"2023-07-21T22:39:05.389078+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:31:30.579070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389304+0000","last_change":"2023-07-21T22:39:04.064135+0000","last_active":"2023-07-21T22:39:05.389304+0000","last_peered":"2023-07-21T22:39:05.389304+0000","last_clean":"2023-07-21T22:39:05.389304+0000","last_became_active":"2023-07-21T22:39:04.063864+0000","last_became_peered":"2023-07-21T22:39:04.063864+0000","last_unstale":"2023-07-21T22:39:05.389304+0000","last_undegraded":"2023-07-21T22:39:05.389304+0000","last_fullsized":"2023-07-21T22:39:05.389304+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:27:29.546308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388086+0000","last_change":"2023-07-21T22:39:04.063736+0000","last_active":"2023-07-21T22:39:05.388086+0000","last_peered":"2023-07-21T22:39:05.388086+0000","last_clean":"2023-07-21T22:39:05.388086+0000","last_became_active":"2023-07-21T22:39:04.063415+0000","last_became_peered":"2023-07-21T22:39:04.063415+0000","last_unstale":"2023-07-21T22:39:05.388086+0000","last_undegraded":"2023-07-21T22:39:05.388086+0000","last_fullsized":"2023-07-21T22:39:05.388086+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:24:39.645041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389500+0000","last_change":"2023-07-21T22:39:04.046938+0000","last_active":"2023-07-21T22:39:05.389500+0000","last_peered":"2023-07-21T22:39:05.389500+0000","last_clean":"2023-07-21T22:39:05.389500+0000","last_became_active":"2023-07-21T22:39:04.046614+0000","last_became_peered":"2023-07-21T22:39:04.046614+0000","last_unstale":"2023-07-21T22:39:05.389500+0000","last_undegraded":"2023-07-21T22:39:05.389500+0000","last_fullsized":"2023-07-21T22:39:05.389500+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:40.975402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389564+0000","last_change":"2023-07-21T22:39:04.047887+0000","last_active":"2023-07-21T22:39:05.389564+0000","last_peered":"2023-07-21T22:39:05.389564+0000","last_clean":"2023-07-21T22:39:05.389564+0000","last_became_active":"2023-07-21T22:39:04.047615+0000","last_became_peered":"2023-07-21T22:39:04.047615+0000","last_unstale":"2023-07-21T22:39:05.389564+0000","last_undegraded":"2023-07-21T22:39:05.389564+0000","last_fullsized":"2023-07-21T22:39:05.389564+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:08:39.727578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.029133+0000","last_change":"2023-07-21T22:39:04.047942+0000","last_active":"2023-07-21T22:39:05.029133+0000","last_peered":"2023-07-21T22:39:05.029133+0000","last_clean":"2023-07-21T22:39:05.029133+0000","last_became_active":"2023-07-21T22:39:04.046911+0000","last_became_peered":"2023-07-21T22:39:04.046911+0000","last_unstale":"2023-07-21T22:39:05.029133+0000","last_undegraded":"2023-07-21T22:39:05.029133+0000","last_fullsized":"2023-07-21T22:39:05.029133+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:54:02.142880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035478+0000","last_change":"2023-07-21T22:39:04.051750+0000","last_active":"2023-07-21T22:39:05.035478+0000","last_peered":"2023-07-21T22:39:05.035478+0000","last_clean":"2023-07-21T22:39:05.035478+0000","last_became_active":"2023-07-21T22:39:04.051397+0000","last_became_peered":"2023-07-21T22:39:04.051397+0000","last_unstale":"2023-07-21T22:39:05.035478+0000","last_undegraded":"2023-07-21T22:39:05.035478+0000","last_fullsized":"2023-07-21T22:39:05.035478+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:17:35.053612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.029261+0000","last_change":"2023-07-21T22:39:04.064837+0000","last_active":"2023-07-21T22:39:05.029261+0000","last_peered":"2023-07-21T22:39:05.029261+0000","last_clean":"2023-07-21T22:39:05.029261+0000","last_became_active":"2023-07-21T22:39:04.064436+0000","last_became_peered":"2023-07-21T22:39:04.064436+0000","last_unstale":"2023-07-21T22:39:05.029261+0000","last_undegraded":"2023-07-21T22:39:05.029261+0000","last_fullsized":"2023-07-21T22:39:05.029261+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:50:11.072999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392866+0000","last_change":"2023-07-21T22:39:04.043257+0000","last_active":"2023-07-21T22:39:05.392866+0000","last_peered":"2023-07-21T22:39:05.392866+0000","last_clean":"2023-07-21T22:39:05.392866+0000","last_became_active":"2023-07-21T22:39:04.042923+0000","last_became_peered":"2023-07-21T22:39:04.042923+0000","last_unstale":"2023-07-21T22:39:05.392866+0000","last_undegraded":"2023-07-21T22:39:05.392866+0000","last_fullsized":"2023-07-21T22:39:05.392866+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:03:14.393774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389312+0000","last_change":"2023-07-21T22:39:04.047384+0000","last_active":"2023-07-21T22:39:05.389312+0000","last_peered":"2023-07-21T22:39:05.389312+0000","last_clean":"2023-07-21T22:39:05.389312+0000","last_became_active":"2023-07-21T22:39:04.047065+0000","last_became_peered":"2023-07-21T22:39:04.047065+0000","last_unstale":"2023-07-21T22:39:05.389312+0000","last_undegraded":"2023-07-21T22:39:05.389312+0000","last_fullsized":"2023-07-21T22:39:05.389312+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:27:36.179476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392010+0000","last_change":"2023-07-21T22:39:04.063652+0000","last_active":"2023-07-21T22:39:05.392010+0000","last_peered":"2023-07-21T22:39:05.392010+0000","last_clean":"2023-07-21T22:39:05.392010+0000","last_became_active":"2023-07-21T22:39:04.062761+0000","last_became_peered":"2023-07-21T22:39:04.062761+0000","last_unstale":"2023-07-21T22:39:05.392010+0000","last_undegraded":"2023-07-21T22:39:05.392010+0000","last_fullsized":"2023-07-21T22:39:05.392010+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:29:52.527370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389566+0000","last_change":"2023-07-21T22:39:04.035216+0000","last_active":"2023-07-21T22:39:05.389566+0000","last_peered":"2023-07-21T22:39:05.389566+0000","last_clean":"2023-07-21T22:39:05.389566+0000","last_became_active":"2023-07-21T22:39:04.034942+0000","last_became_peered":"2023-07-21T22:39:04.034942+0000","last_unstale":"2023-07-21T22:39:05.389566+0000","last_undegraded":"2023-07-21T22:39:05.389566+0000","last_fullsized":"2023-07-21T22:39:05.389566+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:13:29.546647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.393045+0000","last_change":"2023-07-21T22:39:04.057395+0000","last_active":"2023-07-21T22:39:05.393045+0000","last_peered":"2023-07-21T22:39:05.393045+0000","last_clean":"2023-07-21T22:39:05.393045+0000","last_became_active":"2023-07-21T22:39:04.057055+0000","last_became_peered":"2023-07-21T22:39:04.057055+0000","last_unstale":"2023-07-21T22:39:05.393045+0000","last_undegraded":"2023-07-21T22:39:05.393045+0000","last_fullsized":"2023-07-21T22:39:05.393045+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:35:12.409289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392497+0000","last_change":"2023-07-21T22:39:04.062638+0000","last_active":"2023-07-21T22:39:05.392497+0000","last_peered":"2023-07-21T22:39:05.392497+0000","last_clean":"2023-07-21T22:39:05.392497+0000","last_became_active":"2023-07-21T22:39:04.062359+0000","last_became_peered":"2023-07-21T22:39:04.062359+0000","last_unstale":"2023-07-21T22:39:05.392497+0000","last_undegraded":"2023-07-21T22:39:05.392497+0000","last_fullsized":"2023-07-21T22:39:05.392497+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:04:33.252428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035645+0000","last_change":"2023-07-21T22:39:04.066374+0000","last_active":"2023-07-21T22:39:05.035645+0000","last_peered":"2023-07-21T22:39:05.035645+0000","last_clean":"2023-07-21T22:39:05.035645+0000","last_became_active":"2023-07-21T22:39:04.065981+0000","last_became_peered":"2023-07-21T22:39:04.065981+0000","last_unstale":"2023-07-21T22:39:05.035645+0000","last_undegraded":"2023-07-21T22:39:05.035645+0000","last_fullsized":"2023-07-21T22:39:05.035645+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:43:26.114675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388100+0000","last_change":"2023-07-21T22:39:04.065768+0000","last_active":"2023-07-21T22:39:05.388100+0000","last_peered":"2023-07-21T22:39:05.388100+0000","last_clean":"2023-07-21T22:39:05.388100+0000","last_became_active":"2023-07-21T22:39:04.065480+0000","last_became_peered":"2023-07-21T22:39:04.065480+0000","last_unstale":"2023-07-21T22:39:05.388100+0000","last_undegraded":"2023-07-21T22:39:05.388100+0000","last_fullsized":"2023-07-21T22:39:05.388100+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:05:17.927873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392622+0000","last_change":"2023-07-21T22:39:04.056618+0000","last_active":"2023-07-21T22:39:05.392622+0000","last_peered":"2023-07-21T22:39:05.392622+0000","last_clean":"2023-07-21T22:39:05.392622+0000","last_became_active":"2023-07-21T22:39:04.056192+0000","last_became_peered":"2023-07-21T22:39:04.056192+0000","last_unstale":"2023-07-21T22:39:05.392622+0000","last_undegraded":"2023-07-21T22:39:05.392622+0000","last_fullsized":"2023-07-21T22:39:05.392622+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:25:51.700245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392736+0000","last_change":"2023-07-21T22:39:04.056513+0000","last_active":"2023-07-21T22:39:05.392736+0000","last_peered":"2023-07-21T22:39:05.392736+0000","last_clean":"2023-07-21T22:39:05.392736+0000","last_became_active":"2023-07-21T22:39:04.056222+0000","last_became_peered":"2023-07-21T22:39:04.056222+0000","last_unstale":"2023-07-21T22:39:05.392736+0000","last_undegraded":"2023-07-21T22:39:05.392736+0000","last_fullsized":"2023-07-21T22:39:05.392736+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:08:23.355354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035872+0000","last_change":"2023-07-21T22:39:04.055774+0000","last_active":"2023-07-21T22:39:05.035872+0000","last_peered":"2023-07-21T22:39:05.035872+0000","last_clean":"2023-07-21T22:39:05.035872+0000","last_became_active":"2023-07-21T22:39:04.055443+0000","last_became_peered":"2023-07-21T22:39:04.055443+0000","last_unstale":"2023-07-21T22:39:05.035872+0000","last_undegraded":"2023-07-21T22:39:05.035872+0000","last_fullsized":"2023-07-21T22:39:05.035872+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:36:05.344459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.387903+0000","last_change":"2023-07-21T22:39:04.056193+0000","last_active":"2023-07-21T22:39:05.387903+0000","last_peered":"2023-07-21T22:39:05.387903+0000","last_clean":"2023-07-21T22:39:05.387903+0000","last_became_active":"2023-07-21T22:39:04.054105+0000","last_became_peered":"2023-07-21T22:39:04.054105+0000","last_unstale":"2023-07-21T22:39:05.387903+0000","last_undegraded":"2023-07-21T22:39:05.387903+0000","last_fullsized":"2023-07-21T22:39:05.387903+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:38:29.680153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035910+0000","last_change":"2023-07-21T22:39:04.067430+0000","last_active":"2023-07-21T22:39:05.035910+0000","last_peered":"2023-07-21T22:39:05.035910+0000","last_clean":"2023-07-21T22:39:05.035910+0000","last_became_active":"2023-07-21T22:39:04.067062+0000","last_became_peered":"2023-07-21T22:39:04.067062+0000","last_unstale":"2023-07-21T22:39:05.035910+0000","last_undegraded":"2023-07-21T22:39:05.035910+0000","last_fullsized":"2023-07-21T22:39:05.035910+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:52:59.020137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"156'4","reported_seq":17,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.393009+0000","last_change":"2023-07-21T22:39:03.045196+0000","last_active":"2023-07-21T22:39:05.393009+0000","last_peered":"2023-07-21T22:39:05.393009+0000","last_clean":"2023-07-21T22:39:05.393009+0000","last_became_active":"2023-07-21T22:39:03.044911+0000","last_became_peered":"2023-07-21T22:39:03.044911+0000","last_unstale":"2023-07-21T22:39:05.393009+0000","last_undegraded":"2023-07-21T22:39:05.393009+0000","last_fullsized":"2023-07-21T22:39:05.393009+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:26:12.805777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388502+0000","last_change":"2023-07-21T22:39:04.043379+0000","last_active":"2023-07-21T22:39:05.388502+0000","last_peered":"2023-07-21T22:39:05.388502+0000","last_clean":"2023-07-21T22:39:05.388502+0000","last_became_active":"2023-07-21T22:39:04.043035+0000","last_became_peered":"2023-07-21T22:39:04.043035+0000","last_unstale":"2023-07-21T22:39:05.388502+0000","last_undegraded":"2023-07-21T22:39:05.388502+0000","last_fullsized":"2023-07-21T22:39:05.388502+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:30:25.608972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"156'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.029412+0000","last_change":"2023-07-21T22:39:03.043899+0000","last_active":"2023-07-21T22:39:05.029412+0000","last_peered":"2023-07-21T22:39:05.029412+0000","last_clean":"2023-07-21T22:39:05.029412+0000","last_became_active":"2023-07-21T22:39:03.043604+0000","last_became_peered":"2023-07-21T22:39:03.043604+0000","last_unstale":"2023-07-21T22:39:05.029412+0000","last_undegraded":"2023-07-21T22:39:05.029412+0000","last_fullsized":"2023-07-21T22:39:05.029412+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:49:14.048255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392496+0000","last_change":"2023-07-21T22:39:04.050387+0000","last_active":"2023-07-21T22:39:05.392496+0000","last_peered":"2023-07-21T22:39:05.392496+0000","last_clean":"2023-07-21T22:39:05.392496+0000","last_became_active":"2023-07-21T22:39:04.049441+0000","last_became_peered":"2023-07-21T22:39:04.049441+0000","last_unstale":"2023-07-21T22:39:05.392496+0000","last_undegraded":"2023-07-21T22:39:05.392496+0000","last_fullsized":"2023-07-21T22:39:05.392496+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:05:19.019902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035643+0000","last_change":"2023-07-21T22:39:03.047859+0000","last_active":"2023-07-21T22:39:05.035643+0000","last_peered":"2023-07-21T22:39:05.035643+0000","last_clean":"2023-07-21T22:39:05.035643+0000","last_became_active":"2023-07-21T22:39:03.047591+0000","last_became_peered":"2023-07-21T22:39:03.047591+0000","last_unstale":"2023-07-21T22:39:05.035643+0000","last_undegraded":"2023-07-21T22:39:05.035643+0000","last_fullsized":"2023-07-21T22:39:05.035643+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:59:29.101633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388552+0000","last_change":"2023-07-21T22:39:04.063554+0000","last_active":"2023-07-21T22:39:05.388552+0000","last_peered":"2023-07-21T22:39:05.388552+0000","last_clean":"2023-07-21T22:39:05.388552+0000","last_became_active":"2023-07-21T22:39:04.063242+0000","last_became_peered":"2023-07-21T22:39:04.063242+0000","last_unstale":"2023-07-21T22:39:05.388552+0000","last_undegraded":"2023-07-21T22:39:05.388552+0000","last_fullsized":"2023-07-21T22:39:05.388552+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:18.271597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035360+0000","last_change":"2023-07-21T22:39:03.052051+0000","last_active":"2023-07-21T22:39:05.035360+0000","last_peered":"2023-07-21T22:39:05.035360+0000","last_clean":"2023-07-21T22:39:05.035360+0000","last_became_active":"2023-07-21T22:39:03.051732+0000","last_became_peered":"2023-07-21T22:39:03.051732+0000","last_unstale":"2023-07-21T22:39:05.035360+0000","last_undegraded":"2023-07-21T22:39:05.035360+0000","last_fullsized":"2023-07-21T22:39:05.035360+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:38:28.728080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.036340+0000","last_change":"2023-07-21T22:39:04.054528+0000","last_active":"2023-07-21T22:39:05.036340+0000","last_peered":"2023-07-21T22:39:05.036340+0000","last_clean":"2023-07-21T22:39:05.036340+0000","last_became_active":"2023-07-21T22:39:04.053568+0000","last_became_peered":"2023-07-21T22:39:04.053568+0000","last_unstale":"2023-07-21T22:39:05.036340+0000","last_undegraded":"2023-07-21T22:39:05.036340+0000","last_fullsized":"2023-07-21T22:39:05.036340+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:11:32.612096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"156'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.036271+0000","last_change":"2023-07-21T22:39:03.047928+0000","last_active":"2023-07-21T22:39:05.036271+0000","last_peered":"2023-07-21T22:39:05.036271+0000","last_clean":"2023-07-21T22:39:05.036271+0000","last_became_active":"2023-07-21T22:39:03.047629+0000","last_became_peered":"2023-07-21T22:39:03.047629+0000","last_unstale":"2023-07-21T22:39:05.036271+0000","last_undegraded":"2023-07-21T22:39:05.036271+0000","last_fullsized":"2023-07-21T22:39:05.036271+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:33:16.850112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.036454+0000","last_change":"2023-07-21T22:39:04.059731+0000","last_active":"2023-07-21T22:39:05.036454+0000","last_peered":"2023-07-21T22:39:05.036454+0000","last_clean":"2023-07-21T22:39:05.036454+0000","last_became_active":"2023-07-21T22:39:04.059427+0000","last_became_peered":"2023-07-21T22:39:04.059427+0000","last_unstale":"2023-07-21T22:39:05.036454+0000","last_undegraded":"2023-07-21T22:39:05.036454+0000","last_fullsized":"2023-07-21T22:39:05.036454+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:36:22.063521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"156'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.028884+0000","last_change":"2023-07-21T22:39:03.035738+0000","last_active":"2023-07-21T22:39:05.028884+0000","last_peered":"2023-07-21T22:39:05.028884+0000","last_clean":"2023-07-21T22:39:05.028884+0000","last_became_active":"2023-07-21T22:39:03.035421+0000","last_became_peered":"2023-07-21T22:39:03.035421+0000","last_unstale":"2023-07-21T22:39:05.028884+0000","last_undegraded":"2023-07-21T22:39:05.028884+0000","last_fullsized":"2023-07-21T22:39:05.028884+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:23:07.861700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.029296+0000","last_change":"2023-07-21T22:39:04.059957+0000","last_active":"2023-07-21T22:39:05.029296+0000","last_peered":"2023-07-21T22:39:05.029296+0000","last_clean":"2023-07-21T22:39:05.029296+0000","last_became_active":"2023-07-21T22:39:04.059580+0000","last_became_peered":"2023-07-21T22:39:04.059580+0000","last_unstale":"2023-07-21T22:39:05.029296+0000","last_undegraded":"2023-07-21T22:39:05.029296+0000","last_fullsized":"2023-07-21T22:39:05.029296+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:18.911832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388990+0000","last_change":"2023-07-21T22:39:03.036395+0000","last_active":"2023-07-21T22:39:05.388990+0000","last_peered":"2023-07-21T22:39:05.388990+0000","last_clean":"2023-07-21T22:39:05.388990+0000","last_became_active":"2023-07-21T22:39:03.036126+0000","last_became_peered":"2023-07-21T22:39:03.036126+0000","last_unstale":"2023-07-21T22:39:05.388990+0000","last_undegraded":"2023-07-21T22:39:05.388990+0000","last_fullsized":"2023-07-21T22:39:05.388990+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:38:47.365979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035293+0000","last_change":"2023-07-21T22:39:04.066525+0000","last_active":"2023-07-21T22:39:05.035293+0000","last_peered":"2023-07-21T22:39:05.035293+0000","last_clean":"2023-07-21T22:39:05.035293+0000","last_became_active":"2023-07-21T22:39:04.066112+0000","last_became_peered":"2023-07-21T22:39:04.066112+0000","last_unstale":"2023-07-21T22:39:05.035293+0000","last_undegraded":"2023-07-21T22:39:05.035293+0000","last_fullsized":"2023-07-21T22:39:05.035293+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:19:53.977438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392834+0000","last_change":"2023-07-21T22:39:03.043496+0000","last_active":"2023-07-21T22:39:05.392834+0000","last_peered":"2023-07-21T22:39:05.392834+0000","last_clean":"2023-07-21T22:39:05.392834+0000","last_became_active":"2023-07-21T22:39:03.043150+0000","last_became_peered":"2023-07-21T22:39:03.043150+0000","last_unstale":"2023-07-21T22:39:05.392834+0000","last_undegraded":"2023-07-21T22:39:05.392834+0000","last_fullsized":"2023-07-21T22:39:05.392834+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:43.477160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392232+0000","last_change":"2023-07-21T22:39:04.056156+0000","last_active":"2023-07-21T22:39:05.392232+0000","last_peered":"2023-07-21T22:39:05.392232+0000","last_clean":"2023-07-21T22:39:05.392232+0000","last_became_active":"2023-07-21T22:39:04.055806+0000","last_became_peered":"2023-07-21T22:39:04.055806+0000","last_unstale":"2023-07-21T22:39:05.392232+0000","last_undegraded":"2023-07-21T22:39:05.392232+0000","last_fullsized":"2023-07-21T22:39:05.392232+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:03:23.359933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"156'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392467+0000","last_change":"2023-07-21T22:39:03.048717+0000","last_active":"2023-07-21T22:39:05.392467+0000","last_peered":"2023-07-21T22:39:05.392467+0000","last_clean":"2023-07-21T22:39:05.392467+0000","last_became_active":"2023-07-21T22:39:03.048384+0000","last_became_peered":"2023-07-21T22:39:03.048384+0000","last_unstale":"2023-07-21T22:39:05.392467+0000","last_undegraded":"2023-07-21T22:39:05.392467+0000","last_fullsized":"2023-07-21T22:39:05.392467+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:05:15.871318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.034999+0000","last_change":"2023-07-21T22:39:04.060504+0000","last_active":"2023-07-21T22:39:05.034999+0000","last_peered":"2023-07-21T22:39:05.034999+0000","last_clean":"2023-07-21T22:39:05.034999+0000","last_became_active":"2023-07-21T22:39:04.060167+0000","last_became_peered":"2023-07-21T22:39:04.060167+0000","last_unstale":"2023-07-21T22:39:05.034999+0000","last_undegraded":"2023-07-21T22:39:05.034999+0000","last_fullsized":"2023-07-21T22:39:05.034999+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:57:09.166782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392643+0000","last_change":"2023-07-21T22:39:03.045117+0000","last_active":"2023-07-21T22:39:05.392643+0000","last_peered":"2023-07-21T22:39:05.392643+0000","last_clean":"2023-07-21T22:39:05.392643+0000","last_became_active":"2023-07-21T22:39:03.044806+0000","last_became_peered":"2023-07-21T22:39:03.044806+0000","last_unstale":"2023-07-21T22:39:05.392643+0000","last_undegraded":"2023-07-21T22:39:05.392643+0000","last_fullsized":"2023-07-21T22:39:05.392643+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:08.519700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035586+0000","last_change":"2023-07-21T22:39:04.066243+0000","last_active":"2023-07-21T22:39:05.035586+0000","last_peered":"2023-07-21T22:39:05.035586+0000","last_clean":"2023-07-21T22:39:05.035586+0000","last_became_active":"2023-07-21T22:39:04.065930+0000","last_became_peered":"2023-07-21T22:39:04.065930+0000","last_unstale":"2023-07-21T22:39:05.035586+0000","last_undegraded":"2023-07-21T22:39:05.035586+0000","last_fullsized":"2023-07-21T22:39:05.035586+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:15:49.210312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"156'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389077+0000","last_change":"2023-07-21T22:39:03.039227+0000","last_active":"2023-07-21T22:39:05.389077+0000","last_peered":"2023-07-21T22:39:05.389077+0000","last_clean":"2023-07-21T22:39:05.389077+0000","last_became_active":"2023-07-21T22:39:03.038928+0000","last_became_peered":"2023-07-21T22:39:03.038928+0000","last_unstale":"2023-07-21T22:39:05.389077+0000","last_undegraded":"2023-07-21T22:39:05.389077+0000","last_fullsized":"2023-07-21T22:39:05.389077+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:48:05.408946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388240+0000","last_change":"2023-07-21T22:39:04.058107+0000","last_active":"2023-07-21T22:39:05.388240+0000","last_peered":"2023-07-21T22:39:05.388240+0000","last_clean":"2023-07-21T22:39:05.388240+0000","last_became_active":"2023-07-21T22:39:04.057795+0000","last_became_peered":"2023-07-21T22:39:04.057795+0000","last_unstale":"2023-07-21T22:39:05.388240+0000","last_undegraded":"2023-07-21T22:39:05.388240+0000","last_fullsized":"2023-07-21T22:39:05.388240+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:43:47.520691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.029405+0000","last_change":"2023-07-21T22:39:03.040678+0000","last_active":"2023-07-21T22:39:05.029405+0000","last_peered":"2023-07-21T22:39:05.029405+0000","last_clean":"2023-07-21T22:39:05.029405+0000","last_became_active":"2023-07-21T22:39:03.040326+0000","last_became_peered":"2023-07-21T22:39:03.040326+0000","last_unstale":"2023-07-21T22:39:05.029405+0000","last_undegraded":"2023-07-21T22:39:05.029405+0000","last_fullsized":"2023-07-21T22:39:05.029405+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:59:32.505683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.029332+0000","last_change":"2023-07-21T22:39:04.044526+0000","last_active":"2023-07-21T22:39:05.029332+0000","last_peered":"2023-07-21T22:39:05.029332+0000","last_clean":"2023-07-21T22:39:05.029332+0000","last_became_active":"2023-07-21T22:39:04.044206+0000","last_became_peered":"2023-07-21T22:39:04.044206+0000","last_unstale":"2023-07-21T22:39:05.029332+0000","last_undegraded":"2023-07-21T22:39:05.029332+0000","last_fullsized":"2023-07-21T22:39:05.029332+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:50:33.367291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.036309+0000","last_change":"2023-07-21T22:39:03.044385+0000","last_active":"2023-07-21T22:39:05.036309+0000","last_peered":"2023-07-21T22:39:05.036309+0000","last_clean":"2023-07-21T22:39:05.036309+0000","last_became_active":"2023-07-21T22:39:03.044051+0000","last_became_peered":"2023-07-21T22:39:03.044051+0000","last_unstale":"2023-07-21T22:39:05.036309+0000","last_undegraded":"2023-07-21T22:39:05.036309+0000","last_fullsized":"2023-07-21T22:39:05.036309+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:54:19.216620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388257+0000","last_change":"2023-07-21T22:39:04.063860+0000","last_active":"2023-07-21T22:39:05.388257+0000","last_peered":"2023-07-21T22:39:05.388257+0000","last_clean":"2023-07-21T22:39:05.388257+0000","last_became_active":"2023-07-21T22:39:04.063393+0000","last_became_peered":"2023-07-21T22:39:04.063393+0000","last_unstale":"2023-07-21T22:39:05.388257+0000","last_undegraded":"2023-07-21T22:39:05.388257+0000","last_fullsized":"2023-07-21T22:39:05.388257+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:24:09.570159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389444+0000","last_change":"2023-07-21T22:39:03.043464+0000","last_active":"2023-07-21T22:39:05.389444+0000","last_peered":"2023-07-21T22:39:05.389444+0000","last_clean":"2023-07-21T22:39:05.389444+0000","last_became_active":"2023-07-21T22:39:03.043147+0000","last_became_peered":"2023-07-21T22:39:03.043147+0000","last_unstale":"2023-07-21T22:39:05.389444+0000","last_undegraded":"2023-07-21T22:39:05.389444+0000","last_fullsized":"2023-07-21T22:39:05.389444+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:26:36.998574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.029305+0000","last_change":"2023-07-21T22:39:04.056375+0000","last_active":"2023-07-21T22:39:05.029305+0000","last_peered":"2023-07-21T22:39:05.029305+0000","last_clean":"2023-07-21T22:39:05.029305+0000","last_became_active":"2023-07-21T22:39:04.056069+0000","last_became_peered":"2023-07-21T22:39:04.056069+0000","last_unstale":"2023-07-21T22:39:05.029305+0000","last_undegraded":"2023-07-21T22:39:05.029305+0000","last_fullsized":"2023-07-21T22:39:05.029305+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:36:05.834812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035067+0000","last_change":"2023-07-21T22:39:03.053112+0000","last_active":"2023-07-21T22:39:05.035067+0000","last_peered":"2023-07-21T22:39:05.035067+0000","last_clean":"2023-07-21T22:39:05.035067+0000","last_became_active":"2023-07-21T22:39:03.052821+0000","last_became_peered":"2023-07-21T22:39:03.052821+0000","last_unstale":"2023-07-21T22:39:05.035067+0000","last_undegraded":"2023-07-21T22:39:05.035067+0000","last_fullsized":"2023-07-21T22:39:05.035067+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:35:11.478113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392203+0000","last_change":"2023-07-21T22:39:04.063816+0000","last_active":"2023-07-21T22:39:05.392203+0000","last_peered":"2023-07-21T22:39:05.392203+0000","last_clean":"2023-07-21T22:39:05.392203+0000","last_became_active":"2023-07-21T22:39:04.063208+0000","last_became_peered":"2023-07-21T22:39:04.063208+0000","last_unstale":"2023-07-21T22:39:05.392203+0000","last_undegraded":"2023-07-21T22:39:05.392203+0000","last_fullsized":"2023-07-21T22:39:05.392203+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:00.466148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389676+0000","last_change":"2023-07-21T22:39:03.042529+0000","last_active":"2023-07-21T22:39:05.389676+0000","last_peered":"2023-07-21T22:39:05.389676+0000","last_clean":"2023-07-21T22:39:05.389676+0000","last_became_active":"2023-07-21T22:39:03.042254+0000","last_became_peered":"2023-07-21T22:39:03.042254+0000","last_unstale":"2023-07-21T22:39:05.389676+0000","last_undegraded":"2023-07-21T22:39:05.389676+0000","last_fullsized":"2023-07-21T22:39:05.389676+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:51:07.327323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.028945+0000","last_change":"2023-07-21T22:39:04.058968+0000","last_active":"2023-07-21T22:39:05.028945+0000","last_peered":"2023-07-21T22:39:05.028945+0000","last_clean":"2023-07-21T22:39:05.028945+0000","last_became_active":"2023-07-21T22:39:04.058700+0000","last_became_peered":"2023-07-21T22:39:04.058700+0000","last_unstale":"2023-07-21T22:39:05.028945+0000","last_undegraded":"2023-07-21T22:39:05.028945+0000","last_fullsized":"2023-07-21T22:39:05.028945+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:07:55.217511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388790+0000","last_change":"2023-07-21T22:39:03.045034+0000","last_active":"2023-07-21T22:39:05.388790+0000","last_peered":"2023-07-21T22:39:05.388790+0000","last_clean":"2023-07-21T22:39:05.388790+0000","last_became_active":"2023-07-21T22:39:03.044569+0000","last_became_peered":"2023-07-21T22:39:03.044569+0000","last_unstale":"2023-07-21T22:39:05.388790+0000","last_undegraded":"2023-07-21T22:39:05.388790+0000","last_fullsized":"2023-07-21T22:39:05.388790+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:29:33.774339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392214+0000","last_change":"2023-07-21T22:39:04.061178+0000","last_active":"2023-07-21T22:39:05.392214+0000","last_peered":"2023-07-21T22:39:05.392214+0000","last_clean":"2023-07-21T22:39:05.392214+0000","last_became_active":"2023-07-21T22:39:04.060902+0000","last_became_peered":"2023-07-21T22:39:04.060902+0000","last_unstale":"2023-07-21T22:39:05.392214+0000","last_undegraded":"2023-07-21T22:39:05.392214+0000","last_fullsized":"2023-07-21T22:39:05.392214+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:16:43.587553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"157'1","reported_seq":14,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.036653+0000","last_change":"2023-07-21T22:39:03.043363+0000","last_active":"2023-07-21T22:39:05.036653+0000","last_peered":"2023-07-21T22:39:05.036653+0000","last_clean":"2023-07-21T22:39:05.036653+0000","last_became_active":"2023-07-21T22:39:03.043036+0000","last_became_peered":"2023-07-21T22:39:03.043036+0000","last_unstale":"2023-07-21T22:39:05.036653+0000","last_undegraded":"2023-07-21T22:39:05.036653+0000","last_fullsized":"2023-07-21T22:39:05.036653+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:56:19.372377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035084+0000","last_change":"2023-07-21T22:39:04.058556+0000","last_active":"2023-07-21T22:39:05.035084+0000","last_peered":"2023-07-21T22:39:05.035084+0000","last_clean":"2023-07-21T22:39:05.035084+0000","last_became_active":"2023-07-21T22:39:04.057335+0000","last_became_peered":"2023-07-21T22:39:04.057335+0000","last_unstale":"2023-07-21T22:39:05.035084+0000","last_undegraded":"2023-07-21T22:39:05.035084+0000","last_fullsized":"2023-07-21T22:39:05.035084+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:46:43.287353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.036590+0000","last_change":"2023-07-21T22:39:03.044365+0000","last_active":"2023-07-21T22:39:05.036590+0000","last_peered":"2023-07-21T22:39:05.036590+0000","last_clean":"2023-07-21T22:39:05.036590+0000","last_became_active":"2023-07-21T22:39:03.044104+0000","last_became_peered":"2023-07-21T22:39:03.044104+0000","last_unstale":"2023-07-21T22:39:05.036590+0000","last_undegraded":"2023-07-21T22:39:05.036590+0000","last_fullsized":"2023-07-21T22:39:05.036590+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:34:35.633875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388272+0000","last_change":"2023-07-21T22:39:04.066462+0000","last_active":"2023-07-21T22:39:05.388272+0000","last_peered":"2023-07-21T22:39:05.388272+0000","last_clean":"2023-07-21T22:39:05.388272+0000","last_became_active":"2023-07-21T22:39:04.066183+0000","last_became_peered":"2023-07-21T22:39:04.066183+0000","last_unstale":"2023-07-21T22:39:05.388272+0000","last_undegraded":"2023-07-21T22:39:05.388272+0000","last_fullsized":"2023-07-21T22:39:05.388272+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:43:57.677284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389390+0000","last_change":"2023-07-21T22:39:03.044807+0000","last_active":"2023-07-21T22:39:05.389390+0000","last_peered":"2023-07-21T22:39:05.389390+0000","last_clean":"2023-07-21T22:39:05.389390+0000","last_became_active":"2023-07-21T22:39:03.044482+0000","last_became_peered":"2023-07-21T22:39:03.044482+0000","last_unstale":"2023-07-21T22:39:05.389390+0000","last_undegraded":"2023-07-21T22:39:05.389390+0000","last_fullsized":"2023-07-21T22:39:05.389390+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:02:15.032934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389257+0000","last_change":"2023-07-21T22:39:04.043688+0000","last_active":"2023-07-21T22:39:05.389257+0000","last_peered":"2023-07-21T22:39:05.389257+0000","last_clean":"2023-07-21T22:39:05.389257+0000","last_became_active":"2023-07-21T22:39:04.043413+0000","last_became_peered":"2023-07-21T22:39:04.043413+0000","last_unstale":"2023-07-21T22:39:05.389257+0000","last_undegraded":"2023-07-21T22:39:05.389257+0000","last_fullsized":"2023-07-21T22:39:05.389257+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:10:56.651059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392050+0000","last_change":"2023-07-21T22:39:03.043971+0000","last_active":"2023-07-21T22:39:05.392050+0000","last_peered":"2023-07-21T22:39:05.392050+0000","last_clean":"2023-07-21T22:39:05.392050+0000","last_became_active":"2023-07-21T22:39:03.043698+0000","last_became_peered":"2023-07-21T22:39:03.043698+0000","last_unstale":"2023-07-21T22:39:05.392050+0000","last_undegraded":"2023-07-21T22:39:05.392050+0000","last_fullsized":"2023-07-21T22:39:05.392050+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:18:57.278955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388954+0000","last_change":"2023-07-21T22:39:04.044793+0000","last_active":"2023-07-21T22:39:05.388954+0000","last_peered":"2023-07-21T22:39:05.388954+0000","last_clean":"2023-07-21T22:39:05.388954+0000","last_became_active":"2023-07-21T22:39:04.043805+0000","last_became_peered":"2023-07-21T22:39:04.043805+0000","last_unstale":"2023-07-21T22:39:05.388954+0000","last_undegraded":"2023-07-21T22:39:05.388954+0000","last_fullsized":"2023-07-21T22:39:05.388954+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:08:15.225915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035638+0000","last_change":"2023-07-21T22:39:03.052780+0000","last_active":"2023-07-21T22:39:05.035638+0000","last_peered":"2023-07-21T22:39:05.035638+0000","last_clean":"2023-07-21T22:39:05.035638+0000","last_became_active":"2023-07-21T22:39:03.052324+0000","last_became_peered":"2023-07-21T22:39:03.052324+0000","last_unstale":"2023-07-21T22:39:05.035638+0000","last_undegraded":"2023-07-21T22:39:05.035638+0000","last_fullsized":"2023-07-21T22:39:05.035638+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:36:27.264655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389297+0000","last_change":"2023-07-21T22:39:04.063592+0000","last_active":"2023-07-21T22:39:05.389297+0000","last_peered":"2023-07-21T22:39:05.389297+0000","last_clean":"2023-07-21T22:39:05.389297+0000","last_became_active":"2023-07-21T22:39:04.063301+0000","last_became_peered":"2023-07-21T22:39:04.063301+0000","last_unstale":"2023-07-21T22:39:05.389297+0000","last_undegraded":"2023-07-21T22:39:05.389297+0000","last_fullsized":"2023-07-21T22:39:05.389297+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:17:52.311775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389121+0000","last_change":"2023-07-21T22:39:03.049975+0000","last_active":"2023-07-21T22:39:05.389121+0000","last_peered":"2023-07-21T22:39:05.389121+0000","last_clean":"2023-07-21T22:39:05.389121+0000","last_became_active":"2023-07-21T22:39:03.049641+0000","last_became_peered":"2023-07-21T22:39:03.049641+0000","last_unstale":"2023-07-21T22:39:05.389121+0000","last_undegraded":"2023-07-21T22:39:05.389121+0000","last_fullsized":"2023-07-21T22:39:05.389121+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:41:06.739764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035470+0000","last_change":"2023-07-21T22:39:04.062141+0000","last_active":"2023-07-21T22:39:05.035470+0000","last_peered":"2023-07-21T22:39:05.035470+0000","last_clean":"2023-07-21T22:39:05.035470+0000","last_became_active":"2023-07-21T22:39:04.061861+0000","last_became_peered":"2023-07-21T22:39:04.061861+0000","last_unstale":"2023-07-21T22:39:05.035470+0000","last_undegraded":"2023-07-21T22:39:05.035470+0000","last_fullsized":"2023-07-21T22:39:05.035470+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:53:51.439295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.029021+0000","last_change":"2023-07-21T22:39:03.039410+0000","last_active":"2023-07-21T22:39:05.029021+0000","last_peered":"2023-07-21T22:39:05.029021+0000","last_clean":"2023-07-21T22:39:05.029021+0000","last_became_active":"2023-07-21T22:39:03.039134+0000","last_became_peered":"2023-07-21T22:39:03.039134+0000","last_unstale":"2023-07-21T22:39:05.029021+0000","last_undegraded":"2023-07-21T22:39:05.029021+0000","last_fullsized":"2023-07-21T22:39:05.029021+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:12:51.697778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392779+0000","last_change":"2023-07-21T22:39:04.061519+0000","last_active":"2023-07-21T22:39:05.392779+0000","last_peered":"2023-07-21T22:39:05.392779+0000","last_clean":"2023-07-21T22:39:05.392779+0000","last_became_active":"2023-07-21T22:39:04.061229+0000","last_became_peered":"2023-07-21T22:39:04.061229+0000","last_unstale":"2023-07-21T22:39:05.392779+0000","last_undegraded":"2023-07-21T22:39:05.392779+0000","last_fullsized":"2023-07-21T22:39:05.392779+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:34:56.082185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035435+0000","last_change":"2023-07-21T22:39:03.053328+0000","last_active":"2023-07-21T22:39:05.035435+0000","last_peered":"2023-07-21T22:39:05.035435+0000","last_clean":"2023-07-21T22:39:05.035435+0000","last_became_active":"2023-07-21T22:39:03.052955+0000","last_became_peered":"2023-07-21T22:39:03.052955+0000","last_unstale":"2023-07-21T22:39:05.035435+0000","last_undegraded":"2023-07-21T22:39:05.035435+0000","last_fullsized":"2023-07-21T22:39:05.035435+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:35:46.000604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"145'271","reported_seq":953,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.034803+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:39:05.034803+0000","last_peered":"2023-07-21T22:39:05.034803+0000","last_clean":"2023-07-21T22:39:05.034803+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:39:05.034803+0000","last_undegraded":"2023-07-21T22:39:05.034803+0000","last_fullsized":"2023-07-21T22:39:05.034803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:12:17.171189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":280,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392190+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:39:05.392190+0000","last_peered":"2023-07-21T22:39:05.392190+0000","last_clean":"2023-07-21T22:39:05.392190+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:39:05.392190+0000","last_undegraded":"2023-07-21T22:39:05.392190+0000","last_fullsized":"2023-07-21T22:39:05.392190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:21:12.937569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035850+0000","last_change":"2023-07-21T22:39:04.060806+0000","last_active":"2023-07-21T22:39:05.035850+0000","last_peered":"2023-07-21T22:39:05.035850+0000","last_clean":"2023-07-21T22:39:05.035850+0000","last_became_active":"2023-07-21T22:39:04.060526+0000","last_became_peered":"2023-07-21T22:39:04.060526+0000","last_unstale":"2023-07-21T22:39:05.035850+0000","last_undegraded":"2023-07-21T22:39:05.035850+0000","last_fullsized":"2023-07-21T22:39:05.035850+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:19:17.833104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392204+0000","last_change":"2023-07-21T22:39:03.045628+0000","last_active":"2023-07-21T22:39:05.392204+0000","last_peered":"2023-07-21T22:39:05.392204+0000","last_clean":"2023-07-21T22:39:05.392204+0000","last_became_active":"2023-07-21T22:39:03.044601+0000","last_became_peered":"2023-07-21T22:39:03.044601+0000","last_unstale":"2023-07-21T22:39:05.392204+0000","last_undegraded":"2023-07-21T22:39:05.392204+0000","last_fullsized":"2023-07-21T22:39:05.392204+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:52:11.226500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":251,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.034700+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:39:05.034700+0000","last_peered":"2023-07-21T22:39:05.034700+0000","last_clean":"2023-07-21T22:39:05.034700+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:39:05.034700+0000","last_undegraded":"2023-07-21T22:39:05.034700+0000","last_fullsized":"2023-07-21T22:39:05.034700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:43:25.718602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.029288+0000","last_change":"2023-07-21T22:39:04.052730+0000","last_active":"2023-07-21T22:39:05.029288+0000","last_peered":"2023-07-21T22:39:05.029288+0000","last_clean":"2023-07-21T22:39:05.029288+0000","last_became_active":"2023-07-21T22:39:04.052431+0000","last_became_peered":"2023-07-21T22:39:04.052431+0000","last_unstale":"2023-07-21T22:39:05.029288+0000","last_undegraded":"2023-07-21T22:39:05.029288+0000","last_fullsized":"2023-07-21T22:39:05.029288+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:40:11.846854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"156'8","reported_seq":21,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389590+0000","last_change":"2023-07-21T22:39:03.046544+0000","last_active":"2023-07-21T22:39:05.389590+0000","last_peered":"2023-07-21T22:39:05.389590+0000","last_clean":"2023-07-21T22:39:05.389590+0000","last_became_active":"2023-07-21T22:39:03.046251+0000","last_became_peered":"2023-07-21T22:39:03.046251+0000","last_unstale":"2023-07-21T22:39:05.389590+0000","last_undegraded":"2023-07-21T22:39:05.389590+0000","last_fullsized":"2023-07-21T22:39:05.389590+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:25:13.171000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":252,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388617+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:39:05.388617+0000","last_peered":"2023-07-21T22:39:05.388617+0000","last_clean":"2023-07-21T22:39:05.388617+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:39:05.388617+0000","last_undegraded":"2023-07-21T22:39:05.388617+0000","last_fullsized":"2023-07-21T22:39:05.388617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:41:27.093486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388240+0000","last_change":"2023-07-21T22:39:04.055769+0000","last_active":"2023-07-21T22:39:05.388240+0000","last_peered":"2023-07-21T22:39:05.388240+0000","last_clean":"2023-07-21T22:39:05.388240+0000","last_became_active":"2023-07-21T22:39:04.055363+0000","last_became_peered":"2023-07-21T22:39:04.055363+0000","last_unstale":"2023-07-21T22:39:05.388240+0000","last_undegraded":"2023-07-21T22:39:05.388240+0000","last_fullsized":"2023-07-21T22:39:05.388240+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:40:36.964636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"156'2","reported_seq":15,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388689+0000","last_change":"2023-07-21T22:39:03.044488+0000","last_active":"2023-07-21T22:39:05.388689+0000","last_peered":"2023-07-21T22:39:05.388689+0000","last_clean":"2023-07-21T22:39:05.388689+0000","last_became_active":"2023-07-21T22:39:03.044193+0000","last_became_peered":"2023-07-21T22:39:03.044193+0000","last_unstale":"2023-07-21T22:39:05.388689+0000","last_undegraded":"2023-07-21T22:39:05.388689+0000","last_fullsized":"2023-07-21T22:39:05.388689+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:39:39.555656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":280,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392624+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:39:05.392624+0000","last_peered":"2023-07-21T22:39:05.392624+0000","last_clean":"2023-07-21T22:39:05.392624+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:39:05.392624+0000","last_undegraded":"2023-07-21T22:39:05.392624+0000","last_fullsized":"2023-07-21T22:39:05.392624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:50:15.389424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392836+0000","last_change":"2023-07-21T22:39:04.056483+0000","last_active":"2023-07-21T22:39:05.392836+0000","last_peered":"2023-07-21T22:39:05.392836+0000","last_clean":"2023-07-21T22:39:05.392836+0000","last_became_active":"2023-07-21T22:39:04.055902+0000","last_became_peered":"2023-07-21T22:39:04.055902+0000","last_unstale":"2023-07-21T22:39:05.392836+0000","last_undegraded":"2023-07-21T22:39:05.392836+0000","last_fullsized":"2023-07-21T22:39:05.392836+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:23:16.959823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"156'3","reported_seq":16,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035812+0000","last_change":"2023-07-21T22:39:03.050012+0000","last_active":"2023-07-21T22:39:05.035812+0000","last_peered":"2023-07-21T22:39:05.035812+0000","last_clean":"2023-07-21T22:39:05.035812+0000","last_became_active":"2023-07-21T22:39:03.049736+0000","last_became_peered":"2023-07-21T22:39:03.049736+0000","last_unstale":"2023-07-21T22:39:05.035812+0000","last_undegraded":"2023-07-21T22:39:05.035812+0000","last_fullsized":"2023-07-21T22:39:05.035812+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:39:25.018234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":264,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389522+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:39:05.389522+0000","last_peered":"2023-07-21T22:39:05.389522+0000","last_clean":"2023-07-21T22:39:05.389522+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:39:05.389522+0000","last_undegraded":"2023-07-21T22:39:05.389522+0000","last_fullsized":"2023-07-21T22:39:05.389522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:11:08.495700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392651+0000","last_change":"2023-07-21T22:39:04.059383+0000","last_active":"2023-07-21T22:39:05.392651+0000","last_peered":"2023-07-21T22:39:05.392651+0000","last_clean":"2023-07-21T22:39:05.392651+0000","last_became_active":"2023-07-21T22:39:04.058912+0000","last_became_peered":"2023-07-21T22:39:04.058912+0000","last_unstale":"2023-07-21T22:39:05.392651+0000","last_undegraded":"2023-07-21T22:39:05.392651+0000","last_fullsized":"2023-07-21T22:39:05.392651+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:59:48.043608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"156'6","reported_seq":19,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035695+0000","last_change":"2023-07-21T22:39:03.053828+0000","last_active":"2023-07-21T22:39:05.035695+0000","last_peered":"2023-07-21T22:39:05.035695+0000","last_clean":"2023-07-21T22:39:05.035695+0000","last_became_active":"2023-07-21T22:39:03.053526+0000","last_became_peered":"2023-07-21T22:39:03.053526+0000","last_unstale":"2023-07-21T22:39:05.035695+0000","last_undegraded":"2023-07-21T22:39:05.035695+0000","last_fullsized":"2023-07-21T22:39:05.035695+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:56:27.902286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":250,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.035952+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:39:05.035952+0000","last_peered":"2023-07-21T22:39:05.035952+0000","last_clean":"2023-07-21T22:39:05.035952+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:39:05.035952+0000","last_undegraded":"2023-07-21T22:39:05.035952+0000","last_fullsized":"2023-07-21T22:39:05.035952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:09:08.663407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388086+0000","last_change":"2023-07-21T22:39:04.053931+0000","last_active":"2023-07-21T22:39:05.388086+0000","last_peered":"2023-07-21T22:39:05.388086+0000","last_clean":"2023-07-21T22:39:05.388086+0000","last_became_active":"2023-07-21T22:39:04.053655+0000","last_became_peered":"2023-07-21T22:39:04.053655+0000","last_unstale":"2023-07-21T22:39:05.388086+0000","last_undegraded":"2023-07-21T22:39:05.388086+0000","last_fullsized":"2023-07-21T22:39:05.388086+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:29:10.923948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.392346+0000","last_change":"2023-07-21T22:39:03.042778+0000","last_active":"2023-07-21T22:39:05.392346+0000","last_peered":"2023-07-21T22:39:05.392346+0000","last_clean":"2023-07-21T22:39:05.392346+0000","last_became_active":"2023-07-21T22:39:03.042441+0000","last_became_peered":"2023-07-21T22:39:03.042441+0000","last_unstale":"2023-07-21T22:39:05.392346+0000","last_undegraded":"2023-07-21T22:39:05.392346+0000","last_fullsized":"2023-07-21T22:39:05.392346+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:54:38.441852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":264,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389410+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:39:05.389410+0000","last_peered":"2023-07-21T22:39:05.389410+0000","last_clean":"2023-07-21T22:39:05.389410+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:39:05.389410+0000","last_undegraded":"2023-07-21T22:39:05.389410+0000","last_fullsized":"2023-07-21T22:39:05.389410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:50:28.587260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.389078+0000","last_change":"2023-07-21T22:39:04.055199+0000","last_active":"2023-07-21T22:39:05.389078+0000","last_peered":"2023-07-21T22:39:05.389078+0000","last_clean":"2023-07-21T22:39:05.389078+0000","last_became_active":"2023-07-21T22:39:04.054936+0000","last_became_peered":"2023-07-21T22:39:04.054936+0000","last_unstale":"2023-07-21T22:39:05.389078+0000","last_undegraded":"2023-07-21T22:39:05.389078+0000","last_fullsized":"2023-07-21T22:39:05.389078+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:03.013057+0000","last_clean_scrub_stamp":"2023-07-21T22:39:03.013057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:02:05.262128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.388811+0000","last_change":"2023-07-21T22:39:03.045134+0000","last_active":"2023-07-21T22:39:05.388811+0000","last_peered":"2023-07-21T22:39:05.388811+0000","last_clean":"2023-07-21T22:39:05.388811+0000","last_became_active":"2023-07-21T22:39:03.044863+0000","last_became_peered":"2023-07-21T22:39:03.044863+0000","last_unstale":"2023-07-21T22:39:05.388811+0000","last_undegraded":"2023-07-21T22:39:05.388811+0000","last_fullsized":"2023-07-21T22:39:05.388811+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:39:02.004450+0000","last_clean_scrub_stamp":"2023-07-21T22:39:02.004450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:50:46.026092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":246,"reported_epoch":157,"state":"active+clean","last_fresh":"2023-07-21T22:39:05.393087+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:39:05.393087+0000","last_peered":"2023-07-21T22:39:05.393087+0000","last_clean":"2023-07-21T22:39:05.393087+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:39:05.393087+0000","last_undegraded":"2023-07-21T22:39:05.393087+0000","last_fullsized":"2023-07-21T22:39:05.393087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:44:40.299560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509683,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59784,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312056,"statfs":{"total":96636764160,"available":96575545344,"internally_reserved":0,"allocated":2555904,"data_stored":1580354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67500000000000004,"15min":0.72499999999999998},"min":{"1min":0.46999999999999997,"5min":0.39800000000000002,"15min":0.35299999999999998},"max":{"1min":0.879,"5min":1.1180000000000001,"15min":3.5059999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.65000000000000002,"15min":0.68700000000000006},"min":{"1min":0.432,"5min":0.40899999999999997,"15min":0.39500000000000002},"max":{"1min":0.89300000000000002,"5min":0.94199999999999995,"15min":3.2709999999999999},"last":0.59699999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.68000000000000005,"15min":0.71799999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.432},"max":{"1min":0.83099999999999996,"5min":1.0509999999999999,"15min":1.5429999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68000000000000005,"15min":0.70899999999999996},"min":{"1min":0.44800000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.998,"5min":1.093,"15min":1.093},"last":0.79000000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.69999999999999996,"15min":0.73199999999999998},"min":{"1min":0.48899999999999999,"5min":0.46899999999999997,"15min":0.45500000000000002},"max":{"1min":0.92100000000000004,"5min":1.1399999999999999,"15min":1.405},"last":0.88},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.45800000000000002},"max":{"1min":0.93500000000000005,"5min":1.083,"15min":1.409},"last":0.75}]},{"osd":3,"last update":"Fri Jul 21 22:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.74199999999999999,"15min":0.75800000000000001},"min":{"1min":0.52900000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.0129999999999999,"5min":1.1539999999999999,"15min":1.46},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71999999999999997,"15min":0.747},"min":{"1min":0.45000000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95399999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.83999999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56299999999999994,"15min":0.55700000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81999999999999995,"5min":0.89900000000000002,"15min":0.94999999999999996},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.627,"15min":0.621},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.153,"5min":1.153,"15min":1.7949999999999999},"last":0.82199999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63100000000000001,"15min":0.626},"min":{"1min":0.371,"5min":0.37,"15min":0.37},"max":{"1min":0.97199999999999998,"5min":0.98799999999999999,"15min":2.2120000000000002},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70999999999999996,"15min":0.68100000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.38300000000000001},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.506},"last":0.89400000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.69399999999999995,"15min":0.68300000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.65600000000000003,"15min":0.63600000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.90800000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542389,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37052,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334788,"statfs":{"total":96636764160,"available":96598822912,"internally_reserved":0,"allocated":1953792,"data_stored":989004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.71399999999999997,"15min":0.755},"min":{"1min":0.47099999999999997,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.94399999999999995,"5min":1.016,"15min":1.016},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.437},"max":{"1min":0.96799999999999997,"5min":1.0289999999999999,"15min":1.1180000000000001},"last":0.67200000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.70099999999999996,"15min":0.72499999999999998},"min":{"1min":0.50700000000000001,"5min":0.49099999999999999,"15min":0.45300000000000001},"max":{"1min":0.872,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70399999999999996,"15min":0.72799999999999998},"min":{"1min":0.45800000000000002,"5min":0.44600000000000001,"15min":0.34399999999999997},"max":{"1min":0.93300000000000005,"5min":0.99199999999999999,"15min":1.117},"last":0.501}]},{"osd":2,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71099999999999997,"15min":0.74199999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.42799999999999999},"max":{"1min":0.89600000000000002,"5min":0.98099999999999998,"15min":0.997},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.78700000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.45500000000000002},"max":{"1min":0.98199999999999998,"5min":1.0149999999999999,"15min":1.097},"last":0.70499999999999996}]},{"osd":3,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.71999999999999997,"15min":0.748},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45000000000000001},"max":{"1min":0.90000000000000002,"5min":1.048,"15min":1.048},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70499999999999996,"15min":0.72899999999999998},"min":{"1min":0.52300000000000002,"5min":0.49399999999999999,"15min":0.46899999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":1.0049999999999999},"last":0.60799999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.36599999999999999},"max":{"1min":0.81299999999999994,"5min":0.93400000000000005,"15min":1.0229999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.39700000000000002},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.57699999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.629,"15min":0.61499999999999999},"min":{"1min":0.39800000000000002,"5min":0.38100000000000001,"15min":0.36899999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.004,"5min":1.004,"15min":1.054},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:38:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70299999999999996,"15min":0.68100000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.443},"max":{"1min":1.024,"5min":1.024,"15min":1.079},"last":0.624},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.68799999999999994}]}]},{"osd":5,"up_from":15,"seq":64424509682,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51000,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320840,"statfs":{"total":96636764160,"available":96584540160,"internally_reserved":0,"allocated":1949696,"data_stored":988354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.70999999999999996},"min":{"1min":0.48099999999999998,"5min":0.38500000000000001,"15min":0.35699999999999998},"max":{"1min":0.96499999999999997,"5min":1,"15min":1.8779999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.71399999999999997},"min":{"1min":0.39800000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.97999999999999998,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.55800000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.68600000000000005,"15min":0.70299999999999996},"min":{"1min":0.505,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.95899999999999996,"5min":0.97699999999999998,"15min":1.0009999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69099999999999995,"15min":0.72099999999999997},"min":{"1min":0.42699999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.617},"last":0.748}]},{"osd":2,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.71099999999999997,"15min":0.72699999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.33600000000000002},"max":{"1min":1.008,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.73099999999999998,"15min":0.745},"min":{"1min":0.48799999999999999,"5min":0.42199999999999999,"15min":0.377},"max":{"1min":0.89300000000000002,"5min":1.073,"15min":1.512},"last":0.76800000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.76900000000000002,"15min":0.77800000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.44800000000000001},"max":{"1min":0.91400000000000003,"5min":1.0009999999999999,"15min":1.472},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.76000000000000001,"15min":0.78700000000000003},"min":{"1min":0.60099999999999998,"5min":0.496,"15min":0.496},"max":{"1min":0.997,"5min":1.022,"15min":1.556},"last":0.80400000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.372,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.83699999999999997,"5min":0.88900000000000001,"15min":0.96999999999999997},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72399999999999998,"15min":0.69599999999999995},"min":{"1min":0.58899999999999997,"5min":0.433,"15min":0.433},"max":{"1min":0.92300000000000004,"5min":0.92400000000000004,"15min":1.038},"last":0.83099999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.59099999999999997},"min":{"1min":0.42199999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":0.95499999999999996,"15min":1.0049999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.61399999999999999},"min":{"1min":0.439,"5min":0.40200000000000002,"15min":0.40000000000000002},"max":{"1min":0.76600000000000001,"5min":0.93799999999999994,"15min":1.02},"last":0.65300000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:38:10 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70099999999999996,"15min":0.65700000000000003},"min":{"1min":0.46200000000000002,"5min":0.40999999999999998,"15min":0.374},"max":{"1min":0.96699999999999997,"5min":1.042,"15min":1.042},"last":0.624},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":0.73099999999999998},"min":{"1min":0.59799999999999998,"5min":0.48799999999999999,"15min":0.439},"max":{"1min":0.88300000000000001,"5min":0.999,"15min":1.7390000000000001},"last":0.878}]}]},{"osd":4,"up_from":15,"seq":64424509683,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32948,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1945600,"data_stored":988332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.68300000000000005,"15min":0.72999999999999998},"min":{"1min":0.48599999999999999,"5min":0.41999999999999998,"15min":0.40000000000000002},"max":{"1min":0.93600000000000005,"5min":1.077,"15min":1.077},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68899999999999995,"15min":0.72999999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.89800000000000002,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.72699999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.66900000000000004,"15min":0.69699999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92200000000000004,"5min":1.044,"15min":1.044},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65600000000000003,"15min":0.69499999999999995},"min":{"1min":0.53100000000000003,"5min":0.43099999999999999,"15min":0.36899999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.96399999999999997},"last":0.60599999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.70499999999999996,"15min":0.746},"min":{"1min":0.441,"5min":0.441,"15min":0.371},"max":{"1min":0.88500000000000001,"5min":1.052,"15min":1.052},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71499999999999997,"15min":0.75700000000000001},"min":{"1min":0.501,"5min":0.47699999999999998,"15min":0.33000000000000002},"max":{"1min":0.89300000000000002,"5min":1.018,"15min":1.0660000000000001},"last":0.751}]},{"osd":3,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68000000000000005,"15min":0.72199999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.40100000000000002},"max":{"1min":0.90000000000000002,"5min":0.94599999999999995,"15min":1.0169999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73499999999999999,"15min":0.77500000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47999999999999998},"max":{"1min":0.94899999999999995,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.82299999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61099999999999999,"15min":0.58399999999999996},"min":{"1min":0.44400000000000001,"5min":0.35799999999999998,"15min":0.34399999999999997},"max":{"1min":0.86399999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.42799999999999999,"5min":0.42699999999999999,"15min":0.32800000000000001},"max":{"1min":0.82299999999999995,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.64100000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.439,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.90900000000000003,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.72299999999999998,"15min":0.71599999999999997},"min":{"1min":0.48499999999999999,"5min":0.443,"15min":0.41599999999999998},"max":{"1min":0.96299999999999997,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.84699999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.65600000000000003,"15min":0.64700000000000002},"min":{"1min":0.46200000000000002,"5min":0.45500000000000002,"15min":0.39200000000000002},"max":{"1min":0.93999999999999995,"5min":1.028,"15min":1.028},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.68400000000000005,"15min":0.68200000000000005},"min":{"1min":0.47199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.97099999999999997,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.89400000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509682,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32964,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338876,"statfs":{"total":96636764160,"available":96603009024,"internally_reserved":0,"allocated":1961984,"data_stored":989966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46899999999999997,"15min":0.47499999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":0.77800000000000002,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.38},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.52100000000000002,"15min":0.53900000000000003},"min":{"1min":0.36199999999999999,"5min":0.34100000000000003,"15min":0.315},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.40400000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.46200000000000002,"15min":0.47699999999999998},"min":{"1min":0.33800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60299999999999998,"5min":0.754,"15min":0.83499999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54500000000000004,"15min":0.55100000000000005},"min":{"1min":0.41999999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71899999999999997,"5min":0.82599999999999996,"15min":0.90100000000000002},"last":0.47599999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.38800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67600000000000005,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":0.59599999999999997},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.99199999999999999},"last":0.45100000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.755,"15min":0.77000000000000002},"min":{"1min":0.57599999999999996,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91200000000000003,"5min":1.093,"15min":1.1279999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.81399999999999995},"min":{"1min":0.54500000000000004,"5min":0.442,"15min":0.442},"max":{"1min":0.93200000000000005,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.78600000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.76900000000000002},"min":{"1min":0.54900000000000004,"5min":0.501,"15min":0.48999999999999999},"max":{"1min":0.97799999999999998,"5min":1.0669999999999999,"15min":1.137},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.56200000000000006,"5min":0.51300000000000001,"15min":0.42899999999999999},"max":{"1min":0.86399999999999999,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76900000000000002,"15min":0.79000000000000004},"min":{"1min":0.51900000000000002,"5min":0.51700000000000002,"15min":0.47399999999999998},"max":{"1min":0.91700000000000004,"5min":1.0680000000000001,"15min":1.169},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.75,"15min":0.76800000000000002},"min":{"1min":0.52300000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91300000000000003,"5min":1.107,"15min":1.1120000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79200000000000004,"15min":0.81299999999999994},"min":{"1min":0.621,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94299999999999995,"5min":1.083,"15min":1.099},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80900000000000005,"15min":0.82799999999999996},"min":{"1min":0.61299999999999999,"5min":0.55200000000000005,"15min":0.48599999999999999},"max":{"1min":0.92200000000000004,"5min":1.623,"15min":1.623},"last":0.86599999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509684,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55100,"kb_used_data":1908,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316740,"statfs":{"total":96636764160,"available":96580341760,"internally_reserved":0,"allocated":1953792,"data_stored":988948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.44,"15min":0.46400000000000002},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.23899999999999999},"max":{"1min":0.624,"5min":0.75,"15min":0.94199999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50600000000000001,"15min":0.54100000000000004},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.308},"max":{"1min":0.64200000000000002,"5min":0.88300000000000001,"15min":1.0409999999999999},"last":0.44700000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53600000000000003,"15min":0.54500000000000004},"min":{"1min":0.40699999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72599999999999998,"5min":0.86699999999999999,"15min":0.93999999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71999999999999997,"5min":1.012,"15min":1.085},"last":0.52700000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.46300000000000002,"15min":0.47599999999999998},"min":{"1min":0.32000000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.623,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53700000000000003,"15min":0.56399999999999995},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.85299999999999998,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72799999999999998,"15min":0.77700000000000002},"min":{"1min":0.54700000000000004,"5min":0.46600000000000003,"15min":0.376},"max":{"1min":1.016,"5min":1.1579999999999999,"15min":1.3420000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73599999999999999,"15min":0.78500000000000003},"min":{"1min":0.48899999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.996,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0780000000000001,"5min":1.214,"15min":1.214},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77700000000000002,"15min":0.80600000000000005},"min":{"1min":0.55400000000000005,"5min":0.48799999999999999,"15min":0.46400000000000002},"max":{"1min":1.012,"5min":1.2689999999999999,"15min":1.3089999999999999},"last":0.73799999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.746,"15min":0.78300000000000003},"min":{"1min":0.52800000000000002,"5min":0.499,"15min":0.40300000000000002},"max":{"1min":0.94399999999999995,"5min":1.536,"15min":1.536},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76500000000000001,"15min":0.80200000000000005},"min":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.46200000000000002},"max":{"1min":1.0289999999999999,"5min":1.1339999999999999,"15min":1.2649999999999999},"last":0.79200000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:38:17 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77500000000000002,"15min":0.81299999999999994},"min":{"1min":0.60699999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.008,"5min":1.143,"15min":1.214},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.751,"15min":0.79700000000000004},"min":{"1min":0.58899999999999997,"5min":0.50900000000000001,"15min":0.44700000000000001},"max":{"1min":0.91200000000000003,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.72599999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509683,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1949696,"data_stored":988402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.47499999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.22900000000000001},"max":{"1min":0.60399999999999998,"5min":0.78700000000000003,"15min":0.84599999999999997},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54100000000000004,"15min":0.55900000000000005},"min":{"1min":0.39900000000000002,"5min":0.378,"15min":0.35099999999999998},"max":{"1min":0.80900000000000005,"5min":0.82499999999999996,"15min":0.872},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48999999999999999,"15min":0.502},"min":{"1min":0.36199999999999999,"5min":0.30099999999999999,"15min":0.29299999999999998},"max":{"1min":0.67800000000000005,"5min":0.72999999999999998,"15min":0.81000000000000005},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.29099999999999998},"max":{"1min":0.71899999999999997,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.41799999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.42299999999999999,"5min":0.378,"15min":0.33400000000000002},"max":{"1min":0.76100000000000001,"5min":0.81699999999999995,"15min":0.88400000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.50700000000000001,"15min":0.51300000000000001},"min":{"1min":0.33800000000000002,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":0.77600000000000002,"5min":0.79500000000000004,"15min":0.97199999999999998},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.74099999999999999,"15min":0.76400000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.432},"max":{"1min":1.115,"5min":1.294,"15min":1.294},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77800000000000002,"15min":0.79000000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.498},"max":{"1min":1.1220000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.70299999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.753,"15min":0.77200000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.41899999999999998},"max":{"1min":1.0980000000000001,"5min":1.242,"15min":1.242},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.77200000000000002,"15min":0.79200000000000004},"min":{"1min":0.55700000000000005,"5min":0.51500000000000001,"15min":0.376},"max":{"1min":1.1639999999999999,"5min":1.276,"15min":1.2849999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.77700000000000002,"15min":0.80000000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.47899999999999998},"max":{"1min":1.0800000000000001,"5min":1.208,"15min":1.23},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.75900000000000001,"15min":0.78100000000000003},"min":{"1min":0.56100000000000005,"5min":0.50900000000000001,"15min":0.46500000000000002},"max":{"1min":1.0109999999999999,"5min":1.244,"15min":1.3240000000000001},"last":0.67000000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:38:12 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78500000000000003,"15min":0.80400000000000005},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.49199999999999999},"max":{"1min":1.089,"5min":1.3120000000000001,"15min":1.3149999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78000000000000003,"15min":0.79800000000000004},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.45700000000000002},"max":{"1min":1.0289999999999999,"5min":1.1819999999999999,"15min":1.3380000000000001},"last":0.68799999999999994}]}]},{"osd":0,"up_from":15,"seq":64424509685,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37632,"kb_used_data":2488,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334208,"statfs":{"total":96636764160,"available":96598228992,"internally_reserved":0,"allocated":2547712,"data_stored":1578756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.33200000000000002,"5min":0.28399999999999997,"15min":0.26600000000000001},"max":{"1min":0.66300000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.50900000000000001,"15min":0.51600000000000001},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.247},"max":{"1min":0.70599999999999996,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.42599999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.41599999999999998,"5min":0.32400000000000001,"15min":0.29799999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.3680000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.495,"5min":0.49099999999999999,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.32600000000000001},"max":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.871},"last":0.40100000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.432,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81899999999999995,"5min":0.85999999999999999,"15min":0.88100000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.33700000000000002},"max":{"1min":0.83599999999999997,"5min":0.88600000000000001,"15min":1.038},"last":0.47399999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.81000000000000005,"15min":0.78400000000000003},"min":{"1min":0.56899999999999995,"5min":0.499,"15min":0.45200000000000001},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.80500000000000005,"15min":0.80000000000000004},"min":{"1min":0.57899999999999996,"5min":0.505,"15min":0.44600000000000001},"max":{"1min":1.206,"5min":1.278,"15min":1.423},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.59599999999999997,"5min":0.54200000000000004,"15min":0.45600000000000002},"max":{"1min":1.0089999999999999,"5min":1.0960000000000001,"15min":1.2669999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80500000000000005,"15min":0.80300000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.39600000000000002},"max":{"1min":1.119,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.48899999999999999},"max":{"1min":1.2210000000000001,"5min":1.27,"15min":1.27},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.65500000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.86499999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80700000000000005,"15min":0.79500000000000004},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.53100000000000003},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.80200000000000005,"15min":0.82199999999999995},"min":{"1min":0.58999999999999997,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1479999999999999,"5min":1.1930000000000001,"15min":1.296},"last":0.84099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:39:13.201 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T22:39:13.202 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-21T22:39:13.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.331+0000 7f3951448640 1 Processor -- start 2023-07-21T22:39:13.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.331+0000 7f3951448640 1 -- start start 2023-07-21T22:39:13.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.335+0000 7f3951448640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f394c0cb360 0x7f394c15df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:13.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.335+0000 7f3951448640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f394c0b38d0 0x7f394c070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:13.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.335+0000 7f3951448640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f394c0cd490 0x7f394c070e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:13.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.335+0000 7f3951448640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394c0713a0 con 0x7f394c0b38d0 2023-07-21T22:39:13.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.335+0000 7f3951448640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394c0cc900 con 0x7f394c0cd490 2023-07-21T22:39:13.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.335+0000 7f3951448640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0ccbe0 con 0x7f394c0cb360 2023-07-21T22:39:13.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.335+0000 7f3943fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f394c0b38d0 0x7f394c070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:13.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.335+0000 7f3943fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f394c0b38d0 0x7f394c070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54500/0 (socket says 172.21.15.6:54500) 2023-07-21T22:39:13.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.335+0000 7f3943fff640 1 -- 172.21.15.6:0/719569760 learned_addr learned my addr 172.21.15.6:0/719569760 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:13.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.335+0000 7f394b7fe640 1 --2- 172.21.15.6:0/719569760 >> v2:172.21.15.161:3300/0 conn(0x7f394c0cd490 0x7f394c070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.335+0000 7f394affd640 1 --2- 172.21.15.6:0/719569760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f394c0cb360 0x7f394c15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.335+0000 7f3943fff640 1 -- 172.21.15.6:0/719569760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f394c0cb360 msgr2=0x7f394c15df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.335+0000 7f3943fff640 1 --2- 172.21.15.6:0/719569760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f394c0cb360 0x7f394c15df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.335+0000 7f3943fff640 1 -- 172.21.15.6:0/719569760 >> v2:172.21.15.161:3300/0 conn(0x7f394c0cd490 msgr2=0x7f394c070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.335+0000 7f3943fff640 1 --2- 172.21.15.6:0/719569760 >> v2:172.21.15.161:3300/0 conn(0x7f394c0cd490 0x7f394c070e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.335+0000 7f3943fff640 1 -- 172.21.15.6:0/719569760 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c15d780 con 0x7f394c0b38d0 2023-07-21T22:39:13.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f3943fff640 1 --2- 172.21.15.6:0/719569760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f394c0b38d0 0x7f394c070920 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f394c0cc810 tx=0x7f393401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289fb9a1fa2a3bcc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f394a7fc640 1 -- 172.21.15.6:0/719569760 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39340ac640 con 0x7f394c0b38d0 2023-07-21T22:39:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f394a7fc640 1 -- 172.21.15.6:0/719569760 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39340ac7a0 con 0x7f394c0b38d0 2023-07-21T22:39:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f394a7fc640 1 -- 172.21.15.6:0/719569760 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39340acb30 con 0x7f394c0b38d0 2023-07-21T22:39:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f3951448640 1 -- 172.21.15.6:0/719569760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f394c0b38d0 msgr2=0x7f394c070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f3951448640 1 --2- 172.21.15.6:0/719569760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f394c0b38d0 0x7f394c070920 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f394c0cc810 tx=0x7f393401c440 comp rx=0 tx=0).stop 2023-07-21T22:39:13.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f3951448640 1 -- 172.21.15.6:0/719569760 shutdown_connections 2023-07-21T22:39:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f3951448640 1 --2- 172.21.15.6:0/719569760 >> v2:172.21.15.161:3300/0 conn(0x7f394c0cd490 0x7f394c070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f3951448640 1 --2- 172.21.15.6:0/719569760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f394c0b38d0 0x7f394c070920 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f3951448640 1 --2- 172.21.15.6:0/719569760 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f394c0cb360 0x7f394c15df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f3951448640 1 -- 172.21.15.6:0/719569760 >> 172.21.15.6:0/719569760 conn(0x7f394c0afac0 msgr2=0x7f394c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f3951448640 1 -- 172.21.15.6:0/719569760 shutdown_connections 2023-07-21T22:39:13.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f3951448640 1 -- 172.21.15.6:0/719569760 wait complete. 2023-07-21T22:39:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f3951448640 1 Processor -- start 2023-07-21T22:39:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f3951448640 1 -- start start 2023-07-21T22:39:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f3951448640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f394c0b38d0 0x7f394c15ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f3951448640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f394c0cb360 0x7f394c0b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f3951448640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f394c0cd490 0x7f394c0b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f3951448640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0c1c40 con 0x7f394c0cd490 2023-07-21T22:39:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f3951448640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0c1f20 con 0x7f394c0cb360 2023-07-21T22:39:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.339+0000 7f3951448640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0c2200 con 0x7f394c0b38d0 2023-07-21T22:39:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.343+0000 7f394b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f394c0cd490 0x7f394c0b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:13.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.343+0000 7f394b7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f394c0cd490 0x7f394c0b30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54516/0 (socket says 172.21.15.6:54516) 2023-07-21T22:39:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.343+0000 7f394b7fe640 1 -- 172.21.15.6:0/1221007924 learned_addr learned my addr 172.21.15.6:0/1221007924 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.343+0000 7f394affd640 1 --2- 172.21.15.6:0/1221007924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f394c0b38d0 0x7f394c15ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.343+0000 7f3943fff640 1 --2- 172.21.15.6:0/1221007924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f394c0cb360 0x7f394c0b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.343+0000 7f394b7fe640 1 -- 172.21.15.6:0/1221007924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f394c0b38d0 msgr2=0x7f394c15ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.343+0000 7f394b7fe640 1 --2- 172.21.15.6:0/1221007924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f394c0b38d0 0x7f394c15ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.343+0000 7f394b7fe640 1 -- 172.21.15.6:0/1221007924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f394c0cb360 msgr2=0x7f394c0b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.343+0000 7f394b7fe640 1 --2- 172.21.15.6:0/1221007924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f394c0cb360 0x7f394c0b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.343+0000 7f394b7fe640 1 -- 172.21.15.6:0/1221007924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39340094d0 con 0x7f394c0cd490 2023-07-21T22:39:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.343+0000 7f394b7fe640 1 --2- 172.21.15.6:0/1221007924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f394c0cd490 0x7f394c0b30f0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f394400efc0 tx=0x7f394400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.343+0000 7f39437fe640 1 -- 172.21.15.6:0/1221007924 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944009ca0 con 0x7f394c0cd490 2023-07-21T22:39:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.343+0000 7f39437fe640 1 -- 172.21.15.6:0/1221007924 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394400f040 con 0x7f394c0cd490 2023-07-21T22:39:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.343+0000 7f3951448640 1 -- 172.21.15.6:0/1221007924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f394c0c24e0 con 0x7f394c0cd490 2023-07-21T22:39:13.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.343+0000 7f39437fe640 1 -- 172.21.15.6:0/1221007924 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39440146c0 con 0x7f394c0cd490 2023-07-21T22:39:13.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.343+0000 7f3951448640 1 -- 172.21.15.6:0/1221007924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394c0c18d0 con 0x7f394c0cd490 2023-07-21T22:39:13.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.343+0000 7f3951448640 1 -- 172.21.15.6:0/1221007924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394c0678d0 con 0x7f394c0cd490 2023-07-21T22:39:13.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.343+0000 7f39437fe640 1 -- 172.21.15.6:0/1221007924 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3944014820 con 0x7f394c0cd490 2023-07-21T22:39:13.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.347+0000 7f39437fe640 1 --2- 172.21.15.6:0/1221007924 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f392c0663a0 0x7f392c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:13.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.347+0000 7f39437fe640 1 -- 172.21.15.6:0/1221007924 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f3944084e80 con 0x7f394c0cd490 2023-07-21T22:39:13.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.347+0000 7f394affd640 1 --2- 172.21.15.6:0/1221007924 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f392c0663a0 0x7f392c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:13.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.347+0000 7f394affd640 1 --2- 172.21.15.6:0/1221007924 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f392c0663a0 0x7f392c068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f393c009a40 tx=0x7f393c009190 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:13.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.351+0000 7f39437fe640 1 -- 172.21.15.6:0/1221007924 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f39440520a0 con 0x7f394c0cd490 2023-07-21T22:39:13.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.559+0000 7f3951448640 1 -- 172.21.15.6:0/1221007924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f394c0cd270 con 0x7f394c0cd490 2023-07-21T22:39:13.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.563+0000 7f39437fe640 1 -- 172.21.15.6:0/1221007924 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+147 (secure 0 0 0) 0x7f39440180b0 con 0x7f394c0cd490 2023-07-21T22:39:13.609 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-07-21T22:39:13.609 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA== 2023-07-21T22:39:13.609 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2023-07-21T22:39:13.609 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2023-07-21T22:39:13.609 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-21T22:39:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-07-21T22:39:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.563+0000 7f3951448640 1 -- 172.21.15.6:0/1221007924 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f392c0663a0 msgr2=0x7f392c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.563+0000 7f3951448640 1 --2- 172.21.15.6:0/1221007924 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f392c0663a0 0x7f392c068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f393c009a40 tx=0x7f393c009190 comp rx=0 tx=0).stop 2023-07-21T22:39:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.563+0000 7f3951448640 1 -- 172.21.15.6:0/1221007924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f394c0cd490 msgr2=0x7f394c0b30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.563+0000 7f3951448640 1 --2- 172.21.15.6:0/1221007924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f394c0cd490 0x7f394c0b30f0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f394400efc0 tx=0x7f394400c490 comp rx=0 tx=0).stop 2023-07-21T22:39:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.563+0000 7f3951448640 1 -- 172.21.15.6:0/1221007924 shutdown_connections 2023-07-21T22:39:13.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.563+0000 7f3951448640 1 --2- 172.21.15.6:0/1221007924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f394c0cd490 0x7f394c0b30f0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.563+0000 7f3951448640 1 --2- 172.21.15.6:0/1221007924 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f392c0663a0 0x7f392c068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.563+0000 7f3951448640 1 --2- 172.21.15.6:0/1221007924 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f394c0cb360 0x7f394c0b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.563+0000 7f3951448640 1 --2- 172.21.15.6:0/1221007924 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f394c0b38d0 0x7f394c15ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.563+0000 7f3951448640 1 -- 172.21.15.6:0/1221007924 >> 172.21.15.6:0/1221007924 conn(0x7f394c0afac0 msgr2=0x7f394c1554a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:13.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.563+0000 7f3951448640 1 -- 172.21.15.6:0/1221007924 shutdown_connections 2023-07-21T22:39:13.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.563+0000 7f3951448640 1 -- 172.21.15.6:0/1221007924 wait complete. 2023-07-21T22:39:13.630 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:39:13.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.731+0000 7f701567b640 1 Processor -- start 2023-07-21T22:39:13.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.731+0000 7f701567b640 1 -- start start 2023-07-21T22:39:13.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.731+0000 7f701567b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7010158ce0 0x7f7010070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:13.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.731+0000 7f701567b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f70100c8ad0 0x7f70100c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:13.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.731+0000 7f701567b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70100c9560 0x7f70100cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:13.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.731+0000 7f701567b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70100c99e0 con 0x7f7010158ce0 2023-07-21T22:39:13.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.731+0000 7f701567b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70100cc700 con 0x7f70100c8ad0 2023-07-21T22:39:13.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.731+0000 7f701567b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70100b0ff0 con 0x7f70100c9560 2023-07-21T22:39:13.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.731+0000 7f700effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7010158ce0 0x7f7010070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:13.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.731+0000 7f700effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7010158ce0 0x7f7010070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54522/0 (socket says 172.21.15.6:54522) 2023-07-21T22:39:13.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.731+0000 7f700effd640 1 -- 172.21.15.6:0/2029363768 learned_addr learned my addr 172.21.15.6:0/2029363768 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.731+0000 7f700f7fe640 1 --2- 172.21.15.6:0/2029363768 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70100c9560 0x7f70100cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.731+0000 7f7007fff640 1 --2- 172.21.15.6:0/2029363768 >> v2:172.21.15.161:3300/0 conn(0x7f70100c8ad0 0x7f70100c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.731+0000 7f700effd640 1 -- 172.21.15.6:0/2029363768 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70100c9560 msgr2=0x7f70100cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.731+0000 7f700effd640 1 --2- 172.21.15.6:0/2029363768 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70100c9560 0x7f70100cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.731+0000 7f700effd640 1 -- 172.21.15.6:0/2029363768 >> v2:172.21.15.161:3300/0 conn(0x7f70100c8ad0 msgr2=0x7f70100c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.731+0000 7f700effd640 1 --2- 172.21.15.6:0/2029363768 >> v2:172.21.15.161:3300/0 conn(0x7f70100c8ad0 0x7f70100c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.731+0000 7f700effd640 1 -- 172.21.15.6:0/2029363768 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7010070c80 con 0x7f7010158ce0 2023-07-21T22:39:13.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.735+0000 7f700effd640 1 --2- 172.21.15.6:0/2029363768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7010158ce0 0x7f7010070450 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f70100c1a30 tx=0x7f700001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a930f0e8f387b41 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:13.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.735+0000 7f700e7fc640 1 -- 172.21.15.6:0/2029363768 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70000ab600 con 0x7f7010158ce0 2023-07-21T22:39:13.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.735+0000 7f700e7fc640 1 -- 172.21.15.6:0/2029363768 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70000a7050 con 0x7f7010158ce0 2023-07-21T22:39:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.735+0000 7f700e7fc640 1 -- 172.21.15.6:0/2029363768 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70000ab980 con 0x7f7010158ce0 2023-07-21T22:39:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.735+0000 7f701567b640 1 -- 172.21.15.6:0/2029363768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7010158ce0 msgr2=0x7f7010070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.735+0000 7f701567b640 1 --2- 172.21.15.6:0/2029363768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7010158ce0 0x7f7010070450 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f70100c1a30 tx=0x7f700001c3b0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.735+0000 7f701567b640 1 -- 172.21.15.6:0/2029363768 shutdown_connections 2023-07-21T22:39:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.735+0000 7f701567b640 1 --2- 172.21.15.6:0/2029363768 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f70100c9560 0x7f70100cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.735+0000 7f701567b640 1 --2- 172.21.15.6:0/2029363768 >> v2:172.21.15.161:3300/0 conn(0x7f70100c8ad0 0x7f70100c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.735+0000 7f701567b640 1 --2- 172.21.15.6:0/2029363768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7010158ce0 0x7f7010070450 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.735+0000 7f701567b640 1 -- 172.21.15.6:0/2029363768 >> 172.21.15.6:0/2029363768 conn(0x7f70100afcf0 msgr2=0x7f70100b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.735+0000 7f701567b640 1 -- 172.21.15.6:0/2029363768 shutdown_connections 2023-07-21T22:39:13.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.735+0000 7f701567b640 1 -- 172.21.15.6:0/2029363768 wait complete. 2023-07-21T22:39:13.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f701567b640 1 Processor -- start 2023-07-21T22:39:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f701567b640 1 -- start start 2023-07-21T22:39:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f701567b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70100c8ad0 0x7f7010156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f701567b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70100c9560 0x7f7010135b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f701567b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7010158ce0 0x7f70101360d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f701567b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701014ea10 con 0x7f70100c8ad0 2023-07-21T22:39:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f701567b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701014ecf0 con 0x7f70100c9560 2023-07-21T22:39:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f701567b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701014efd0 con 0x7f7010158ce0 2023-07-21T22:39:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f700effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70100c8ad0 0x7f7010156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f700effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70100c8ad0 0x7f7010156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54534/0 (socket says 172.21.15.6:54534) 2023-07-21T22:39:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f700effd640 1 -- 172.21.15.6:0/937348327 learned_addr learned my addr 172.21.15.6:0/937348327 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f700f7fe640 1 --2- 172.21.15.6:0/937348327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7010158ce0 0x7f70101360d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f7007fff640 1 --2- 172.21.15.6:0/937348327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70100c9560 0x7f7010135b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f700effd640 1 -- 172.21.15.6:0/937348327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7010158ce0 msgr2=0x7f70101360d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f700effd640 1 --2- 172.21.15.6:0/937348327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7010158ce0 0x7f70101360d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f700effd640 1 -- 172.21.15.6:0/937348327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70100c9560 msgr2=0x7f7010135b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f700effd640 1 --2- 172.21.15.6:0/937348327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70100c9560 0x7f7010135b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f700effd640 1 -- 172.21.15.6:0/937348327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70000094d0 con 0x7f70100c8ad0 2023-07-21T22:39:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f7007fff640 1 --2- 172.21.15.6:0/937348327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70100c9560 0x7f7010135b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f700effd640 1 --2- 172.21.15.6:0/937348327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70100c8ad0 0x7f7010156ff0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f70000ae040 tx=0x7f7000019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:13.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f70077fe640 1 -- 172.21.15.6:0/937348327 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70000b4640 con 0x7f70100c8ad0 2023-07-21T22:39:13.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f70077fe640 1 -- 172.21.15.6:0/937348327 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70000b47c0 con 0x7f70100c8ad0 2023-07-21T22:39:13.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f70077fe640 1 -- 172.21.15.6:0/937348327 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70000b4b70 con 0x7f70100c8ad0 2023-07-21T22:39:13.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f701567b640 1 -- 172.21.15.6:0/937348327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701014f2b0 con 0x7f70100c8ad0 2023-07-21T22:39:13.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f701567b640 1 -- 172.21.15.6:0/937348327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7010136810 con 0x7f70100c8ad0 2023-07-21T22:39:13.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.739+0000 7f701567b640 1 -- 172.21.15.6:0/937348327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70100ca1a0 con 0x7f70100c8ad0 2023-07-21T22:39:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.743+0000 7f70077fe640 1 -- 172.21.15.6:0/937348327 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f70000b2070 con 0x7f70100c8ad0 2023-07-21T22:39:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.743+0000 7f70077fe640 1 --2- 172.21.15.6:0/937348327 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f6ff00663d0 0x7f6ff0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:13.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.743+0000 7f70077fe640 1 -- 172.21.15.6:0/937348327 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f700011df80 con 0x7f70100c8ad0 2023-07-21T22:39:13.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.743+0000 7f7007fff640 1 --2- 172.21.15.6:0/937348327 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f6ff00663d0 0x7f6ff0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:13.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.743+0000 7f7007fff640 1 --2- 172.21.15.6:0/937348327 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f6ff00663d0 0x7f6ff0068880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f70101f3b70 tx=0x7f6ff8008040 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:13.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.747+0000 7f70077fe640 1 -- 172.21.15.6:0/937348327 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f70000eb0f0 con 0x7f70100c8ad0 2023-07-21T22:39:13.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.935+0000 7f701567b640 1 -- 172.21.15.6:0/937348327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f701014eb50 con 0x7f70100c8ad0 2023-07-21T22:39:13.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.939+0000 7f70077fe640 1 -- 172.21.15.6:0/937348327 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4670 (secure 0 0 0) 0x7f701014eb50 con 0x7f70100c8ad0 2023-07-21T22:39:13.984 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:39:13.985 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/2365019581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2365019581},{"type":"v1","addr":"172.21.15.161:6836","nonce":2365019581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8968,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/798924835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":798924835},{"type":"v1","addr":"172.21.15.161:6837","nonce":798924835}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2487387353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2487387353},{"type":"v1","addr":"172.21.15.6:6834","nonce":2487387353}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:39:03.424297+0000","modified":"2023-07-21T22:39:07.057160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9309":{"gid":9309,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2700138945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2700138945},{"type":"v1","addr":"172.21.15.6:6835","nonce":2700138945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-21T22:39:13.986 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 70 2023-07-21T22:39:13.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.939+0000 7f701567b640 1 -- 172.21.15.6:0/937348327 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f6ff00663d0 msgr2=0x7f6ff0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:13.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.939+0000 7f701567b640 1 --2- 172.21.15.6:0/937348327 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f6ff00663d0 0x7f6ff0068880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f70101f3b70 tx=0x7f6ff8008040 comp rx=0 tx=0).stop 2023-07-21T22:39:13.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.939+0000 7f701567b640 1 -- 172.21.15.6:0/937348327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70100c8ad0 msgr2=0x7f7010156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:13.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.939+0000 7f701567b640 1 --2- 172.21.15.6:0/937348327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70100c8ad0 0x7f7010156ff0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f70000ae040 tx=0x7f7000019150 comp rx=0 tx=0).stop 2023-07-21T22:39:13.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.939+0000 7f701567b640 1 -- 172.21.15.6:0/937348327 shutdown_connections 2023-07-21T22:39:13.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.939+0000 7f701567b640 1 --2- 172.21.15.6:0/937348327 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7010158ce0 0x7f70101360d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.939+0000 7f701567b640 1 --2- 172.21.15.6:0/937348327 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f6ff00663d0 0x7f6ff0068880 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.939+0000 7f701567b640 1 --2- 172.21.15.6:0/937348327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f70100c9560 0x7f7010135b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.939+0000 7f701567b640 1 --2- 172.21.15.6:0/937348327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70100c8ad0 0x7f7010156ff0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:13.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.939+0000 7f701567b640 1 -- 172.21.15.6:0/937348327 >> 172.21.15.6:0/937348327 conn(0x7f70100afcf0 msgr2=0x7f70100b11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:13.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.939+0000 7f701567b640 1 -- 172.21.15.6:0/937348327 shutdown_connections 2023-07-21T22:39:13.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:13.939+0000 7f701567b640 1 -- 172.21.15.6:0/937348327 wait complete. 2023-07-21T22:39:14.023 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:39:14.027 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:39:14.407 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T22:39:03.424297+0000', 'modified': '2023-07-21T22:39:07.057160+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9309}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9309': {'gid': 9309, 'name': 'c', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/2700138945', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 2700138945}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 2700138945}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T22:39:14.408 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T22:39:14.408 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-21T22:39:14.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.511+0000 7fd818e0b640 1 Processor -- start 2023-07-21T22:39:14.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.511+0000 7fd818e0b640 1 -- start start 2023-07-21T22:39:14.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.511+0000 7fd818e0b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8140b7d90 0x7fd8140cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.511+0000 7fd818e0b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8140d0f60 con 0x7fd81415f3f0 2023-07-21T22:39:14.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.511+0000 7fd818e0b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8140d0390 con 0x7fd8140d13f0 2023-07-21T22:39:14.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.511+0000 7fd818e0b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8140d0630 con 0x7fd8140b7d90 2023-07-21T22:39:14.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.511+0000 7fd8137fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd81415f3f0 0x7fd8140b7680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37356/0 (socket says 172.21.15.6:37356) 2023-07-21T22:39:14.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.511+0000 7fd8137fe640 1 -- 172.21.15.6:0/3803466098 learned_addr learned my addr 172.21.15.6:0/3803466098 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:39:14.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.511+0000 7fd812ffd640 1 --2- 172.21.15.6:0/3803466098 >> v2:172.21.15.6:3300/0 conn(0x7fd8140b7d90 0x7fd8140cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.511+0000 7fd812ffd640 1 -- 172.21.15.6:0/3803466098 >> v1:172.21.15.161:6789/0 conn(0x7fd8140d13f0 legacy=0x7fd8140ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:14.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.511+0000 7fd812ffd640 1 -- 172.21.15.6:0/3803466098 >> v1:172.21.15.6:6789/0 conn(0x7fd81415f3f0 legacy=0x7fd8140b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:14.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.511+0000 7fd812ffd640 1 -- 172.21.15.6:0/3803466098 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8140d0910 con 0x7fd8140b7d90 2023-07-21T22:39:14.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.511+0000 7fd8127fc640 1 -- 172.21.15.6:0/3803466098 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999897321 0 0) 0x7fd8140d0f60 con 0x7fd81415f3f0 2023-07-21T22:39:14.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.515+0000 7fd812ffd640 1 --2- 172.21.15.6:0/3803466098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8140b7d90 0x7fd8140cc9a0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fd8080097c0 tx=0x7fd80801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93435794874ab106 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:14.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.515+0000 7fd8127fc640 1 -- 172.21.15.6:0/3803466098 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8080ab600 con 0x7fd8140b7d90 2023-07-21T22:39:14.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.515+0000 7fd8127fc640 1 -- 172.21.15.6:0/3803466098 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8080a7050 con 0x7fd8140b7d90 2023-07-21T22:39:14.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.515+0000 7fd8127fc640 1 -- 172.21.15.6:0/3803466098 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8080ab980 con 0x7fd8140b7d90 2023-07-21T22:39:14.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.515+0000 7fd818e0b640 1 -- 172.21.15.6:0/3803466098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8140b7d90 msgr2=0x7fd8140cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:14.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.515+0000 7fd818e0b640 1 --2- 172.21.15.6:0/3803466098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8140b7d90 0x7fd8140cc9a0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fd8080097c0 tx=0x7fd80801c3b0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.515+0000 7fd818e0b640 1 -- 172.21.15.6:0/3803466098 shutdown_connections 2023-07-21T22:39:14.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.515+0000 7fd818e0b640 1 --2- 172.21.15.6:0/3803466098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8140b7d90 0x7fd8140cc9a0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.515+0000 7fd818e0b640 1 -- 172.21.15.6:0/3803466098 >> 172.21.15.6:0/3803466098 conn(0x7fd814069f50 msgr2=0x7fd81406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:14.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.515+0000 7fd818e0b640 1 -- 172.21.15.6:0/3803466098 shutdown_connections 2023-07-21T22:39:14.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.515+0000 7fd818e0b640 1 -- 172.21.15.6:0/3803466098 wait complete. 2023-07-21T22:39:14.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd818e0b640 1 Processor -- start 2023-07-21T22:39:14.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd818e0b640 1 -- start start 2023-07-21T22:39:14.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd818e0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8140b7d90 0x7fd8140c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd818e0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8140d13f0 0x7fd8140c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd818e0b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd81415f3f0 0x7fd8140ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd818e0b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8140cb420 con 0x7fd8140b7d90 2023-07-21T22:39:14.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd818e0b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8140ca810 con 0x7fd81415f3f0 2023-07-21T22:39:14.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd818e0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8140caaf0 con 0x7fd8140d13f0 2023-07-21T22:39:14.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd8137fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8140b7d90 0x7fd8140c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd8137fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8140b7d90 0x7fd8140c7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54554/0 (socket says 172.21.15.6:54554) 2023-07-21T22:39:14.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd8137fe640 1 -- 172.21.15.6:0/2941863541 learned_addr learned my addr 172.21.15.6:0/2941863541 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:14.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd813fff640 1 --2- 172.21.15.6:0/2941863541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd81415f3f0 0x7fd8140ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd812ffd640 1 --2- 172.21.15.6:0/2941863541 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8140d13f0 0x7fd8140c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd8137fe640 1 -- 172.21.15.6:0/2941863541 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8140d13f0 msgr2=0x7fd8140c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:14.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd8137fe640 1 --2- 172.21.15.6:0/2941863541 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8140d13f0 0x7fd8140c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd8137fe640 1 -- 172.21.15.6:0/2941863541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd81415f3f0 msgr2=0x7fd8140ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:14.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd8137fe640 1 --2- 172.21.15.6:0/2941863541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd81415f3f0 0x7fd8140ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd8137fe640 1 -- 172.21.15.6:0/2941863541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd808009420 con 0x7fd8140b7d90 2023-07-21T22:39:14.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd8137fe640 1 --2- 172.21.15.6:0/2941863541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8140b7d90 0x7fd8140c7e10 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fd80400c480 tx=0x7fd80400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:14.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd7fbfff640 1 -- 172.21.15.6:0/2941863541 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040074e0 con 0x7fd8140b7d90 2023-07-21T22:39:14.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd7fbfff640 1 -- 172.21.15.6:0/2941863541 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd804007660 con 0x7fd8140b7d90 2023-07-21T22:39:14.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd818e0b640 1 -- 172.21.15.6:0/2941863541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8140cadd0 con 0x7fd8140b7d90 2023-07-21T22:39:14.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd7fbfff640 1 -- 172.21.15.6:0/2941863541 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd804004a30 con 0x7fd8140b7d90 2023-07-21T22:39:14.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.519+0000 7fd818e0b640 1 -- 172.21.15.6:0/2941863541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd814156290 con 0x7fd8140b7d90 2023-07-21T22:39:14.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.523+0000 7fd7fbfff640 1 -- 172.21.15.6:0/2941863541 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd804004b90 con 0x7fd8140b7d90 2023-07-21T22:39:14.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.523+0000 7fd7fbfff640 1 --2- 172.21.15.6:0/2941863541 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fd8000663a0 0x7fd800068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.523+0000 7fd7fbfff640 1 -- 172.21.15.6:0/2941863541 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fd804083160 con 0x7fd8140b7d90 2023-07-21T22:39:14.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.523+0000 7fd812ffd640 1 --2- 172.21.15.6:0/2941863541 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fd8000663a0 0x7fd800068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.523+0000 7fd81d3ca000 1 Processor -- start 2023-07-21T22:39:14.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.523+0000 7fd81d3ca000 1 -- start start 2023-07-21T22:39:14.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.523+0000 7fd812ffd640 1 --2- 172.21.15.6:0/2941863541 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fd8000663a0 0x7fd800068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd8080ad000 tx=0x7fd8080a6000 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:14.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd81d3ca000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cef00 0x5654cd5cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd81d3ca000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5cf810 0x5654cd585370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd81d3ca000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5858b0 0x5654cd585c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd81d3ca000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654cd44c880 con 0x5654cd5858b0 2023-07-21T22:39:14.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd81d3ca000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654cd386840 con 0x5654cd5cef00 2023-07-21T22:39:14.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd81d3ca000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654cd3da2e0 con 0x5654cd5cf810 2023-07-21T22:39:14.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd813fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5858b0 0x5654cd585c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd813fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5858b0 0x5654cd585c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54570/0 (socket says 172.21.15.6:54570) 2023-07-21T22:39:14.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd813fff640 1 -- 172.21.15.6:0/2151327511 learned_addr learned my addr 172.21.15.6:0/2151327511 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:14.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd812ffd640 1 --2- 172.21.15.6:0/2151327511 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5cf810 0x5654cd585370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd8137fe640 1 --2- 172.21.15.6:0/2151327511 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cef00 0x5654cd5cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd813fff640 1 -- 172.21.15.6:0/2151327511 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5cf810 msgr2=0x5654cd585370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:14.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd813fff640 1 --2- 172.21.15.6:0/2151327511 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5cf810 0x5654cd585370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd813fff640 1 -- 172.21.15.6:0/2151327511 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cef00 msgr2=0x5654cd5cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:14.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd813fff640 1 --2- 172.21.15.6:0/2151327511 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cef00 0x5654cd5cf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd813fff640 1 -- 172.21.15.6:0/2151327511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654cd0cf890 con 0x5654cd5858b0 2023-07-21T22:39:14.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd813fff640 1 --2- 172.21.15.6:0/2151327511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5858b0 0x5654cd585c80 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0053f0 tx=0x7fd80c0058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba77bba4aba47928 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:14.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd7f97fa640 1 -- 172.21.15.6:0/2151327511 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c006d70 con 0x5654cd5858b0 2023-07-21T22:39:14.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd7f97fa640 1 -- 172.21.15.6:0/2151327511 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c00e860 con 0x5654cd5858b0 2023-07-21T22:39:14.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd7f97fa640 1 -- 172.21.15.6:0/2151327511 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c00ec10 con 0x5654cd5858b0 2023-07-21T22:39:14.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd81d3ca000 1 -- 172.21.15.6:0/2151327511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5858b0 msgr2=0x5654cd585c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:14.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd81d3ca000 1 --2- 172.21.15.6:0/2151327511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5858b0 0x5654cd585c80 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0053f0 tx=0x7fd80c0058b0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd81d3ca000 1 -- 172.21.15.6:0/2151327511 shutdown_connections 2023-07-21T22:39:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd81d3ca000 1 --2- 172.21.15.6:0/2151327511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5858b0 0x5654cd585c80 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd81d3ca000 1 --2- 172.21.15.6:0/2151327511 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5cf810 0x5654cd585370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd81d3ca000 1 --2- 172.21.15.6:0/2151327511 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cef00 0x5654cd5cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd81d3ca000 1 -- 172.21.15.6:0/2151327511 >> 172.21.15.6:0/2151327511 conn(0x5654cd58ba10 msgr2=0x5654cd583c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd81d3ca000 1 -- 172.21.15.6:0/2151327511 shutdown_connections 2023-07-21T22:39:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd81d3ca000 1 -- 172.21.15.6:0/2151327511 wait complete. 2023-07-21T22:39:14.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd81d3ca000 1 -- start start 2023-07-21T22:39:14.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.527+0000 7fd81d3ca000 1 Processor -- start 2023-07-21T22:39:14.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd81d3ca000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5858b0 0x5654cd5908e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd81d3ca000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cef00 0x5654cd590e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd81d3ca000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5cf810 0x5654cd591360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd81d3ca000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654cd3d3380 con 0x5654cd5858b0 2023-07-21T22:39:14.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd81d3ca000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654cd38fae0 con 0x5654cd5cef00 2023-07-21T22:39:14.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd81d3ca000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654cd38f780 con 0x5654cd5cf810 2023-07-21T22:39:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd81d3ca000 10 client.0 _ll_register_callbacks cb 0x5654cd571240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:39:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd8137fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5858b0 0x5654cd5908e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd8137fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5858b0 0x5654cd5908e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54580/0 (socket says 172.21.15.6:54580) 2023-07-21T22:39:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd8137fe640 1 -- 172.21.15.6:0/1586418365 learned_addr learned my addr 172.21.15.6:0/1586418365 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd813fff640 1 --2- 172.21.15.6:0/1586418365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5cf810 0x5654cd591360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd812ffd640 1 --2- 172.21.15.6:0/1586418365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cef00 0x5654cd590e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd8137fe640 1 -- 172.21.15.6:0/1586418365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5cf810 msgr2=0x5654cd591360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:14.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd8137fe640 1 --2- 172.21.15.6:0/1586418365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5cf810 0x5654cd591360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd8137fe640 1 -- 172.21.15.6:0/1586418365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cef00 msgr2=0x5654cd590e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:14.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd8137fe640 1 --2- 172.21.15.6:0/1586418365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cef00 0x5654cd590e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd8137fe640 1 -- 172.21.15.6:0/1586418365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80c00f040 con 0x5654cd5858b0 2023-07-21T22:39:14.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd8137fe640 1 --2- 172.21.15.6:0/1586418365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5858b0 0x5654cd5908e0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fd8040077f0 tx=0x7fd80405c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f776764ba6cae5f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:14.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd7f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:39:14.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd7f27fc640 1 -- 172.21.15.6:0/1586418365 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040500a0 con 0x5654cd5858b0 2023-07-21T22:39:14.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd7f27fc640 1 -- 172.21.15.6:0/1586418365 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fd804050200 con 0x5654cd5858b0 2023-07-21T22:39:14.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd81d3ca000 1 -- 172.21.15.6:0/1586418365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654cd39aa20 con 0x5654cd5858b0 2023-07-21T22:39:14.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd7f27fc640 1 -- 172.21.15.6:0/1586418365 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd804072130 con 0x5654cd5858b0 2023-07-21T22:39:14.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd81d3ca000 10 client.9498 fetch_fsmap learned FSMap version 70 2023-07-21T22:39:14.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd81d3ca000 1 -- 172.21.15.6:0/1586418365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x5654cd397d10 con 0x5654cd5858b0 2023-07-21T22:39:14.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd7f27fc640 1 -- 172.21.15.6:0/1586418365 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80407f020 con 0x5654cd5858b0 2023-07-21T22:39:14.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd7f27fc640 1 -- 172.21.15.6:0/1586418365 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd804053010 con 0x5654cd5858b0 2023-07-21T22:39:14.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd81d3ca000 10 client.9498 fetch_fsmap finished waiting for FSMap version 70 2023-07-21T22:39:14.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd81d3ca000 10 client.9498 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-21T22:39:14.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd81d3ca000 20 client.9498 populate_metadata read hostname 'smithi006' 2023-07-21T22:39:14.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd81d3ca000 1 --2- 172.21.15.6:0/1586418365 >> [v2:172.21.15.6:6833/2700138945,v1:172.21.15.6:6835/2700138945] conn(0x5654cd591bd0 0x5654cd5e0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd81d3ca000 4 client.9498 mds_command: new command op to 9309 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:39:14.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd81d3ca000 1 -- 172.21.15.6:0/1586418365 --> [v2:172.21.15.6:6833/2700138945,v1:172.21.15.6:6835/2700138945] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5654cd401ec0 con 0x5654cd591bd0 2023-07-21T22:39:14.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd812ffd640 1 --2- 172.21.15.6:0/1586418365 >> [v2:172.21.15.6:6833/2700138945,v1:172.21.15.6:6835/2700138945] conn(0x5654cd591bd0 0x5654cd5e0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd812ffd640 1 --2- 172.21.15.6:0/1586418365 >> [v2:172.21.15.6:6833/2700138945,v1:172.21.15.6:6835/2700138945] conn(0x5654cd591bd0 0x5654cd5e0450 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3027cc104919799 server_cookie=68f443cb554f75e in_seq=0 out_seq=0 2023-07-21T22:39:14.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd7f27fc640 10 client.9498 ms_handle_connect on v2:172.21.15.6:6833/2700138945 2023-07-21T22:39:14.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd7f27fc640 1 -- 172.21.15.6:0/1586418365 <== mds.0 v2:172.21.15.6:6833/2700138945 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5654cd401ec0 con 0x5654cd591bd0 2023-07-21T22:39:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd7f27fc640 10 client.9498 handle_command_reply: tid=0 2023-07-21T22:39:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd81d3ca000 1 client.9498 shutdown 2023-07-21T22:39:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd81d3ca000 1 -- 172.21.15.6:0/1586418365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5858b0 msgr2=0x5654cd5908e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.531+0000 7fd81d3ca000 1 --2- 172.21.15.6:0/1586418365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5858b0 0x5654cd5908e0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fd8040077f0 tx=0x7fd80405c540 comp rx=0 tx=0).stop 2023-07-21T22:39:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.535+0000 7fd81d3ca000 1 -- 172.21.15.6:0/1586418365 shutdown_connections 2023-07-21T22:39:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.535+0000 7fd81d3ca000 1 --2- 172.21.15.6:0/1586418365 >> [v2:172.21.15.6:6833/2700138945,v1:172.21.15.6:6835/2700138945] conn(0x5654cd591bd0 0x5654cd5e0450 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.535+0000 7fd81d3ca000 1 --2- 172.21.15.6:0/1586418365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5cf810 0x5654cd591360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.535+0000 7fd81d3ca000 1 --2- 172.21.15.6:0/1586418365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cef00 0x5654cd590e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.535+0000 7fd81d3ca000 1 --2- 172.21.15.6:0/1586418365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5858b0 0x5654cd5908e0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.535+0000 7fd7f27fc640 0 client.9498 ms_handle_reset on v2:172.21.15.6:6833/2700138945 2023-07-21T22:39:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.535+0000 7fd81d3ca000 1 -- 172.21.15.6:0/1586418365 >> 172.21.15.6:0/1586418365 conn(0x5654cd58ba10 msgr2=0x5654cd584350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.535+0000 7fd81d3ca000 1 -- 172.21.15.6:0/1586418365 shutdown_connections 2023-07-21T22:39:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.535+0000 7fd81d3ca000 1 -- 172.21.15.6:0/1586418365 wait complete. 2023-07-21T22:39:14.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.535+0000 7fd81d3ca000 20 client.9498 trim_cache size 0 max 16384 2023-07-21T22:39:14.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.547+0000 7fd81d3ca000 1 Processor -- start 2023-07-21T22:39:14.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.547+0000 7fd81d3ca000 1 -- start start 2023-07-21T22:39:14.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd81d3ca000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5858b0 0x5654cd5e1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd81d3ca000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5cef00 0x5654cd5e20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd81d3ca000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cf810 0x5654cd5ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd81d3ca000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654cd588ee0 con 0x5654cd5cef00 2023-07-21T22:39:14.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd81d3ca000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654cd090940 con 0x5654cd5cf810 2023-07-21T22:39:14.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd81d3ca000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654cd416580 con 0x5654cd5858b0 2023-07-21T22:39:14.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd812ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5cef00 0x5654cd5e20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd812ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5cef00 0x5654cd5e20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54582/0 (socket says 172.21.15.6:54582) 2023-07-21T22:39:14.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd812ffd640 1 -- 172.21.15.6:0/2766626572 learned_addr learned my addr 172.21.15.6:0/2766626572 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:14.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd8137fe640 1 --2- 172.21.15.6:0/2766626572 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5858b0 0x5654cd5e1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd813fff640 1 --2- 172.21.15.6:0/2766626572 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cf810 0x5654cd5ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd812ffd640 1 -- 172.21.15.6:0/2766626572 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5858b0 msgr2=0x5654cd5e1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:14.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd812ffd640 1 --2- 172.21.15.6:0/2766626572 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5858b0 0x5654cd5e1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd812ffd640 1 -- 172.21.15.6:0/2766626572 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cf810 msgr2=0x5654cd5ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:14.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd812ffd640 1 --2- 172.21.15.6:0/2766626572 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cf810 0x5654cd5ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd812ffd640 1 -- 172.21.15.6:0/2766626572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654cd587f80 con 0x5654cd5cef00 2023-07-21T22:39:14.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd813fff640 1 --2- 172.21.15.6:0/2766626572 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cf810 0x5654cd5ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:39:14.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd812ffd640 1 --2- 172.21.15.6:0/2766626572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5cef00 0x5654cd5e20b0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fd8080ae040 tx=0x7fd808004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18015d4823216abc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:14.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd7f9ffb640 1 -- 172.21.15.6:0/2766626572 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8080b6480 con 0x5654cd5cef00 2023-07-21T22:39:14.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd7f9ffb640 1 -- 172.21.15.6:0/2766626572 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8080bd040 con 0x5654cd5cef00 2023-07-21T22:39:14.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd7f9ffb640 1 -- 172.21.15.6:0/2766626572 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8080b67e0 con 0x5654cd5cef00 2023-07-21T22:39:14.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd81d3ca000 1 -- 172.21.15.6:0/2766626572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5cef00 msgr2=0x5654cd5e20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:14.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd81d3ca000 1 --2- 172.21.15.6:0/2766626572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5cef00 0x5654cd5e20b0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fd8080ae040 tx=0x7fd808004740 comp rx=0 tx=0).stop 2023-07-21T22:39:14.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd81d3ca000 1 -- 172.21.15.6:0/2766626572 shutdown_connections 2023-07-21T22:39:14.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd81d3ca000 1 --2- 172.21.15.6:0/2766626572 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cf810 0x5654cd5ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd81d3ca000 1 --2- 172.21.15.6:0/2766626572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5cef00 0x5654cd5e20b0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd81d3ca000 1 --2- 172.21.15.6:0/2766626572 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5858b0 0x5654cd5e1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd81d3ca000 1 -- 172.21.15.6:0/2766626572 >> 172.21.15.6:0/2766626572 conn(0x5654cd58ba10 msgr2=0x5654cd5e0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:14.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd81d3ca000 1 -- 172.21.15.6:0/2766626572 shutdown_connections 2023-07-21T22:39:14.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd81d3ca000 1 -- 172.21.15.6:0/2766626572 wait complete. 2023-07-21T22:39:14.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd81d3ca000 1 -- start start 2023-07-21T22:39:14.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.551+0000 7fd81d3ca000 1 Processor -- start 2023-07-21T22:39:14.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5858b0 0x5654cd5ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cef00 0x5654cd5cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5cf810 0x5654cd5cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654cd3a2320 con 0x5654cd5cf810 2023-07-21T22:39:14.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654cd3d0b90 con 0x5654cd5cef00 2023-07-21T22:39:14.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x5654cd37b450 con 0x5654cd5858b0 2023-07-21T22:39:14.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 10 client.0 _ll_register_callbacks cb 0x5654cd551430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:39:14.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd813fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5cf810 0x5654cd5cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd813fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5cf810 0x5654cd5cd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54586/0 (socket says 172.21.15.6:54586) 2023-07-21T22:39:14.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd813fff640 1 -- 172.21.15.6:0/2281882479 learned_addr learned my addr 172.21.15.6:0/2281882479 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:14.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd8137fe640 1 --2- 172.21.15.6:0/2281882479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5858b0 0x5654cd5ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd812ffd640 1 --2- 172.21.15.6:0/2281882479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cef00 0x5654cd5cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd813fff640 1 -- 172.21.15.6:0/2281882479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5858b0 msgr2=0x5654cd5ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:14.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd813fff640 1 --2- 172.21.15.6:0/2281882479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5858b0 0x5654cd5ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd813fff640 1 -- 172.21.15.6:0/2281882479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cef00 msgr2=0x5654cd5cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:14.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd813fff640 1 --2- 172.21.15.6:0/2281882479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cef00 0x5654cd5cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd813fff640 1 -- 172.21.15.6:0/2281882479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8140d0910 con 0x5654cd5cf810 2023-07-21T22:39:14.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd8137fe640 1 --2- 172.21.15.6:0/2281882479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5858b0 0x5654cd5ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:39:14.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd812ffd640 1 --2- 172.21.15.6:0/2281882479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cef00 0x5654cd5cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:39:14.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd813fff640 1 --2- 172.21.15.6:0/2281882479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5cf810 0x5654cd5cd810 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009010 tx=0x7fd80c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db283d81f11ebede server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:14.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd7f27fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:39:14.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd7f27fc640 1 -- 172.21.15.6:0/2281882479 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c021040 con 0x5654cd5cf810 2023-07-21T22:39:14.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd7f27fc640 1 -- 172.21.15.6:0/2281882479 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fd80c00ea70 con 0x5654cd5cf810 2023-07-21T22:39:14.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 -- 172.21.15.6:0/2281882479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654cd3d1cd0 con 0x5654cd5cf810 2023-07-21T22:39:14.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd7f27fc640 1 -- 172.21.15.6:0/2281882479 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd80c00ec30 con 0x5654cd5cf810 2023-07-21T22:39:14.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 10 client.9504 fetch_fsmap learned FSMap version 70 2023-07-21T22:39:14.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 -- 172.21.15.6:0/2281882479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x5654cd37dfa0 con 0x5654cd5cf810 2023-07-21T22:39:14.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd7f27fc640 1 -- 172.21.15.6:0/2281882479 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5654cd3d1cd0 con 0x5654cd5cf810 2023-07-21T22:39:14.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd7f27fc640 1 -- 172.21.15.6:0/2281882479 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd80c013420 con 0x5654cd5cf810 2023-07-21T22:39:14.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 10 client.9504 fetch_fsmap finished waiting for FSMap version 70 2023-07-21T22:39:14.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 10 client.9504 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-21T22:39:14.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 20 client.9504 populate_metadata read hostname 'smithi006' 2023-07-21T22:39:14.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 --2- 172.21.15.6:0/2281882479 >> [v2:172.21.15.6:6833/2700138945,v1:172.21.15.6:6835/2700138945] conn(0x5654cd5cdd50 0x5654cd5ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 4 client.9504 mds_command: new command op to 9309 tid=0[{"prefix": "status"}] 2023-07-21T22:39:14.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 -- 172.21.15.6:0/2281882479 --> [v2:172.21.15.6:6833/2700138945,v1:172.21.15.6:6835/2700138945] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5654cd3cc360 con 0x5654cd5cdd50 2023-07-21T22:39:14.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd8137fe640 1 --2- 172.21.15.6:0/2281882479 >> [v2:172.21.15.6:6833/2700138945,v1:172.21.15.6:6835/2700138945] conn(0x5654cd5cdd50 0x5654cd5ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd7f27fc640 10 client.9504 ms_handle_connect on v2:172.21.15.6:6833/2700138945 2023-07-21T22:39:14.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd8137fe640 1 --2- 172.21.15.6:0/2281882479 >> [v2:172.21.15.6:6833/2700138945,v1:172.21.15.6:6835/2700138945] conn(0x5654cd5cdd50 0x5654cd5ce120 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa277f548596dea8 server_cookie=85b3ea75b6fe3b27 in_seq=0 out_seq=0 2023-07-21T22:39:14.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd7f27fc640 1 -- 172.21.15.6:0/2281882479 <== mds.0 v2:172.21.15.6:6833/2700138945 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5654cd3cc360 con 0x5654cd5cdd50 2023-07-21T22:39:14.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd7f27fc640 10 client.9504 handle_command_reply: tid=0 2023-07-21T22:39:14.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 client.9504 shutdown 2023-07-21T22:39:14.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 -- 172.21.15.6:0/2281882479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5cf810 msgr2=0x5654cd5cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:14.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 --2- 172.21.15.6:0/2281882479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5cf810 0x5654cd5cd810 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009010 tx=0x7fd80c011000 comp rx=0 tx=0).stop 2023-07-21T22:39:14.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 -- 172.21.15.6:0/2281882479 shutdown_connections 2023-07-21T22:39:14.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 --2- 172.21.15.6:0/2281882479 >> [v2:172.21.15.6:6833/2700138945,v1:172.21.15.6:6835/2700138945] conn(0x5654cd5cdd50 0x5654cd5ce120 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 --2- 172.21.15.6:0/2281882479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654cd5cf810 0x5654cd5cd810 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 --2- 172.21.15.6:0/2281882479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5654cd5cef00 0x5654cd5cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd7f27fc640 0 client.9504 ms_handle_reset on v2:172.21.15.6:6833/2700138945 2023-07-21T22:39:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 --2- 172.21.15.6:0/2281882479 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x5654cd5858b0 0x5654cd5ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 -- 172.21.15.6:0/2281882479 >> 172.21.15.6:0/2281882479 conn(0x5654cd58ba10 msgr2=0x5654cd58b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 -- 172.21.15.6:0/2281882479 shutdown_connections 2023-07-21T22:39:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 1 -- 172.21.15.6:0/2281882479 wait complete. 2023-07-21T22:39:14.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.555+0000 7fd81d3ca000 20 client.9504 trim_cache size 0 max 16384 2023-07-21T22:39:14.611 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:39:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "f3073df4-6cd1-4503-bd2e-d3e98fa18bdf", 2023-07-21T22:39:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-07-21T22:39:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 9309, 2023-07-21T22:39:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-07-21T22:39:14.611 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-07-21T22:39:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-07-21T22:39:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.535724882, 2023-07-21T22:39:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 70, 2023-07-21T22:39:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 157, 2023-07-21T22:39:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 157, 2023-07-21T22:39:14.612 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 16.444985285000001 2023-07-21T22:39:14.612 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:39:14.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.559+0000 7fd818e0b640 1 -- 172.21.15.6:0/2941863541 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fd8000663a0 msgr2=0x7fd800068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:14.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.559+0000 7fd818e0b640 1 --2- 172.21.15.6:0/2941863541 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fd8000663a0 0x7fd800068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd8080ad000 tx=0x7fd8080a6000 comp rx=0 tx=0).stop 2023-07-21T22:39:14.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.559+0000 7fd818e0b640 1 -- 172.21.15.6:0/2941863541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8140b7d90 msgr2=0x7fd8140c7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.559+0000 7fd818e0b640 1 --2- 172.21.15.6:0/2941863541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8140b7d90 0x7fd8140c7e10 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fd80400c480 tx=0x7fd80400c940 comp rx=0 tx=0).stop 2023-07-21T22:39:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.559+0000 7fd818e0b640 1 -- 172.21.15.6:0/2941863541 shutdown_connections 2023-07-21T22:39:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.559+0000 7fd818e0b640 1 --2- 172.21.15.6:0/2941863541 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fd8000663a0 0x7fd800068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.559+0000 7fd818e0b640 1 --2- 172.21.15.6:0/2941863541 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd81415f3f0 0x7fd8140ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.559+0000 7fd818e0b640 1 --2- 172.21.15.6:0/2941863541 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd8140d13f0 0x7fd8140c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.559+0000 7fd818e0b640 1 --2- 172.21.15.6:0/2941863541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8140b7d90 0x7fd8140c7e10 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.559+0000 7fd818e0b640 1 -- 172.21.15.6:0/2941863541 >> 172.21.15.6:0/2941863541 conn(0x7fd814069f50 msgr2=0x7fd8140cccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:14.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.559+0000 7fd818e0b640 1 -- 172.21.15.6:0/2941863541 shutdown_connections 2023-07-21T22:39:14.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.559+0000 7fd818e0b640 1 -- 172.21.15.6:0/2941863541 wait complete. 2023-07-21T22:39:14.622 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:39:14.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.719+0000 7efec3d03640 1 Processor -- start 2023-07-21T22:39:14.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.719+0000 7efec3d03640 1 -- start start 2023-07-21T22:39:14.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec3d03640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efebc158ce0 0x7efebc070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec3d03640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efebc0cc700 con 0x7efebc0c8ad0 2023-07-21T22:39:14.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec3d03640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efebc0b0ff0 con 0x7efebc0c9730 2023-07-21T22:39:14.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec3d03640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efebc070c80 con 0x7efebc158ce0 2023-07-21T22:39:14.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec129e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efebc0c8ad0 0x7efebc0c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37364/0 (socket says 172.21.15.6:37364) 2023-07-21T22:39:14.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec129e640 1 -- 172.21.15.6:0/3846889983 learned_addr learned my addr 172.21.15.6:0/3846889983 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:39:14.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec1a9f640 1 --2- 172.21.15.6:0/3846889983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efebc158ce0 0x7efebc070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec0a9d640 1 -- 172.21.15.6:0/3846889983 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916739423 0 0) 0x7efebc0cc700 con 0x7efebc0c8ad0 2023-07-21T22:39:14.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec0a9d640 1 -- 172.21.15.6:0/3846889983 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efea8003530 con 0x7efebc0c8ad0 2023-07-21T22:39:14.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec0a9d640 1 -- 172.21.15.6:0/3846889983 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117001222 0 0) 0x7efebc0b0ff0 con 0x7efebc0c9730 2023-07-21T22:39:14.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec0a9d640 1 -- 172.21.15.6:0/3846889983 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efebc0cc700 con 0x7efebc0c9730 2023-07-21T22:39:14.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec0a9d640 1 -- 172.21.15.6:0/3846889983 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4115911092 0 0) 0x7efea8003530 con 0x7efebc0c8ad0 2023-07-21T22:39:14.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec0a9d640 1 -- 172.21.15.6:0/3846889983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efebc158ce0 msgr2=0x7efebc070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:14.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec0a9d640 1 --2- 172.21.15.6:0/3846889983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efebc158ce0 0x7efebc070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec0a9d640 1 -- 172.21.15.6:0/3846889983 >> v1:172.21.15.161:6789/0 conn(0x7efebc0c9730 legacy=0x7efebc0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:14.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec0a9d640 1 -- 172.21.15.6:0/3846889983 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc0cbdd0 con 0x7efebc0c8ad0 2023-07-21T22:39:14.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec0a9d640 1 -- 172.21.15.6:0/3846889983 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7efeac001680 con 0x7efebc0c8ad0 2023-07-21T22:39:14.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec1a9f640 1 --2- 172.21.15.6:0/3846889983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efebc158ce0 0x7efebc070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:39:14.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec0a9d640 1 -- 172.21.15.6:0/3846889983 >> v1:172.21.15.6:6789/0 conn(0x7efebc0c8ad0 legacy=0x7efebc0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:14.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec0a9d640 1 --2- 172.21.15.6:0/3846889983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efea8003b40 0x7efea8003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec0a9d640 1 --2- 172.21.15.6:0/3846889983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efea80047d0 0x7efea8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec0a9d640 1 --2- 172.21.15.6:0/3846889983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efebc158ce0 0x7efea80051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec0a9d640 1 -- 172.21.15.6:0/3846889983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc070c80 con 0x7efea80047d0 2023-07-21T22:39:14.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec0a9d640 1 -- 172.21.15.6:0/3846889983 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea800bb20 con 0x7efea8003b40 2023-07-21T22:39:14.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec0a9d640 1 -- 172.21.15.6:0/3846889983 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea800bcb0 con 0x7efebc158ce0 2023-07-21T22:39:14.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec129e640 1 --2- 172.21.15.6:0/3846889983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efea80047d0 0x7efea8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec1a9f640 1 --2- 172.21.15.6:0/3846889983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efea8003b40 0x7efea8003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec22a0640 1 --2- 172.21.15.6:0/3846889983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efebc158ce0 0x7efea80051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec129e640 1 -- 172.21.15.6:0/3846889983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efebc158ce0 msgr2=0x7efea80051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:14.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec129e640 1 --2- 172.21.15.6:0/3846889983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efebc158ce0 0x7efea80051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec129e640 1 -- 172.21.15.6:0/3846889983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efea8003b40 msgr2=0x7efea8003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:14.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec129e640 1 --2- 172.21.15.6:0/3846889983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efea8003b40 0x7efea8003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec129e640 1 -- 172.21.15.6:0/3846889983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb8009420 con 0x7efea80047d0 2023-07-21T22:39:14.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.723+0000 7efec22a0640 1 --2- 172.21.15.6:0/3846889983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efebc158ce0 0x7efea80051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:14.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.727+0000 7efec129e640 1 --2- 172.21.15.6:0/3846889983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efea80047d0 0x7efea8004c40 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7efeac00c160 tx=0x7efeac01cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b9fe4b40e63557 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:14.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.727+0000 7efec0a9d640 1 -- 172.21.15.6:0/3846889983 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac0058e0 con 0x7efea80047d0 2023-07-21T22:39:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.727+0000 7efec0a9d640 1 -- 172.21.15.6:0/3846889983 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac005a60 con 0x7efea80047d0 2023-07-21T22:39:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.727+0000 7efec0a9d640 1 -- 172.21.15.6:0/3846889983 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac005e10 con 0x7efea80047d0 2023-07-21T22:39:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.727+0000 7efec3d03640 1 -- 172.21.15.6:0/3846889983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efea80047d0 msgr2=0x7efea8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.727+0000 7efec3d03640 1 --2- 172.21.15.6:0/3846889983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efea80047d0 0x7efea8004c40 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7efeac00c160 tx=0x7efeac01cb30 comp rx=0 tx=0).stop 2023-07-21T22:39:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.727+0000 7efec22a0640 1 -- 172.21.15.6:0/3846889983 reap_dead start 2023-07-21T22:39:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.727+0000 7efec3d03640 1 -- 172.21.15.6:0/3846889983 shutdown_connections 2023-07-21T22:39:14.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.727+0000 7efec3d03640 1 -- 172.21.15.6:0/3846889983 >> 172.21.15.6:0/3846889983 conn(0x7efebc0afcf0 msgr2=0x7efebc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:14.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.727+0000 7efec3d03640 1 -- 172.21.15.6:0/3846889983 shutdown_connections 2023-07-21T22:39:14.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.727+0000 7efec3d03640 1 -- 172.21.15.6:0/3846889983 wait complete. 2023-07-21T22:39:14.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec3d03640 1 Processor -- start 2023-07-21T22:39:14.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec3d03640 1 -- start start 2023-07-21T22:39:14.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec3d03640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efea80047d0 0x7efebc0ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec3d03640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efebc154a70 0x7efebc1579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec3d03640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efebc157ee0 0x7efebc0c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec3d03640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc158350 con 0x7efebc157ee0 2023-07-21T22:39:14.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec3d03640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0ac790 con 0x7efebc154a70 2023-07-21T22:39:14.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec3d03640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0ab940 con 0x7efea80047d0 2023-07-21T22:39:14.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec22a0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efebc157ee0 0x7efebc0c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec22a0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efebc157ee0 0x7efebc0c7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54612/0 (socket says 172.21.15.6:54612) 2023-07-21T22:39:14.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec22a0640 1 -- 172.21.15.6:0/4217391042 learned_addr learned my addr 172.21.15.6:0/4217391042 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:14.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec1a9f640 1 --2- 172.21.15.6:0/4217391042 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efea80047d0 0x7efebc0ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec129e640 1 --2- 172.21.15.6:0/4217391042 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efebc154a70 0x7efebc1579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec22a0640 1 -- 172.21.15.6:0/4217391042 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efea80047d0 msgr2=0x7efebc0ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:14.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec22a0640 1 --2- 172.21.15.6:0/4217391042 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efea80047d0 0x7efebc0ac250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec22a0640 1 -- 172.21.15.6:0/4217391042 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efebc154a70 msgr2=0x7efebc1579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:14.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec22a0640 1 --2- 172.21.15.6:0/4217391042 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efebc154a70 0x7efebc1579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec22a0640 1 -- 172.21.15.6:0/4217391042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc0ae790 con 0x7efebc157ee0 2023-07-21T22:39:14.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec22a0640 1 --2- 172.21.15.6:0/4217391042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efebc157ee0 0x7efebc0c7400 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7efeb4001340 tx=0x7efeb400e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:14.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efeb27fc640 1 -- 172.21.15.6:0/4217391042 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb400ed20 con 0x7efebc157ee0 2023-07-21T22:39:14.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efeb27fc640 1 -- 172.21.15.6:0/4217391042 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb400ee80 con 0x7efebc157ee0 2023-07-21T22:39:14.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efeb27fc640 1 -- 172.21.15.6:0/4217391042 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb4006da0 con 0x7efebc157ee0 2023-07-21T22:39:14.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec3d03640 1 -- 172.21.15.6:0/4217391042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efebc0aea70 con 0x7efebc157ee0 2023-07-21T22:39:14.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec3d03640 1 -- 172.21.15.6:0/4217391042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efebc0abec0 con 0x7efebc157ee0 2023-07-21T22:39:14.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.731+0000 7efec3d03640 1 -- 172.21.15.6:0/4217391042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efebc0ca1a0 con 0x7efebc157ee0 2023-07-21T22:39:14.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.735+0000 7efeb27fc640 1 -- 172.21.15.6:0/4217391042 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efeb4003980 con 0x7efebc157ee0 2023-07-21T22:39:14.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.735+0000 7efeb27fc640 1 --2- 172.21.15.6:0/4217391042 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7efea00663a0 0x7efea0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:14.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.735+0000 7efeb27fc640 1 -- 172.21.15.6:0/4217391042 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7efeb4082720 con 0x7efebc157ee0 2023-07-21T22:39:14.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.735+0000 7efec1a9f640 1 --2- 172.21.15.6:0/4217391042 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7efea00663a0 0x7efea0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:14.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.735+0000 7efec1a9f640 1 --2- 172.21.15.6:0/4217391042 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7efea00663a0 0x7efea0068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009c80 tx=0x7efeb8009190 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:14.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.739+0000 7efeb27fc640 1 -- 172.21.15.6:0/4217391042 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efeb40534e0 con 0x7efebc157ee0 2023-07-21T22:39:14.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.931+0000 7efec3d03640 1 -- 172.21.15.6:0/4217391042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efebc0678d0 con 0x7efebc157ee0 2023-07-21T22:39:14.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.931+0000 7efeb27fc640 1 -- 172.21.15.6:0/4217391042 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) v1 ==== 53+0+73 (secure 0 0 0) 0x7efeb4053070 con 0x7efebc157ee0 2023-07-21T22:39:14.978 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T22:39:14.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.935+0000 7efec3d03640 1 -- 172.21.15.6:0/4217391042 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7efea00663a0 msgr2=0x7efea0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:14.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.935+0000 7efec3d03640 1 --2- 172.21.15.6:0/4217391042 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7efea00663a0 0x7efea0068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009c80 tx=0x7efeb8009190 comp rx=0 tx=0).stop 2023-07-21T22:39:14.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.935+0000 7efec3d03640 1 -- 172.21.15.6:0/4217391042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efebc157ee0 msgr2=0x7efebc0c7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:14.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.935+0000 7efec3d03640 1 --2- 172.21.15.6:0/4217391042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efebc157ee0 0x7efebc0c7400 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7efeb4001340 tx=0x7efeb400e7c0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.935+0000 7efec3d03640 1 -- 172.21.15.6:0/4217391042 shutdown_connections 2023-07-21T22:39:14.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.935+0000 7efec3d03640 1 --2- 172.21.15.6:0/4217391042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efebc157ee0 0x7efebc0c7400 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.935+0000 7efec3d03640 1 --2- 172.21.15.6:0/4217391042 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7efea00663a0 0x7efea0068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.935+0000 7efec3d03640 1 --2- 172.21.15.6:0/4217391042 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efebc154a70 0x7efebc1579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.935+0000 7efec3d03640 1 --2- 172.21.15.6:0/4217391042 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efea80047d0 0x7efebc0ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:14.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.935+0000 7efec3d03640 1 -- 172.21.15.6:0/4217391042 >> 172.21.15.6:0/4217391042 conn(0x7efebc0afcf0 msgr2=0x7efebc06b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:14.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.935+0000 7efec3d03640 1 -- 172.21.15.6:0/4217391042 shutdown_connections 2023-07-21T22:39:14.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:14.935+0000 7efec3d03640 1 -- 172.21.15.6:0/4217391042 wait complete. 2023-07-21T22:39:14.998 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-21T22:39:14.999 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:39:14.999 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-07-21T22:39:14.999 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T22:39:15.000 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T22:39:15.000 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-21T22:39:15.000 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-21T22:39:15.001 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:39:15.001 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:39:15.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:39:15.002 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-07-21T22:39:15.011 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:39:15.011 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:39:15.011 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:39:15.012 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:39:15.012 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-21T22:39:15.012 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:39:15.012 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:39:15.012 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:39:15.012 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-07-21T22:39:15.012 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:39:15.013 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:39:15.013 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-07-21T22:39:15.013 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:39:15.013 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:39:15.013 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-07-21T22:39:15.013 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:39:15.013 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 40890sec preferred_lft 40890sec 2023-07-21T22:39:15.014 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-07-21T22:39:15.014 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:39:15.014 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:39:15.014 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:39:15.014 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-07-21T22:39:15.014 INFO:teuthology.orchestra.run.smithi006.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:39:15.014 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:42:2f:9a:3d:15 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:39:15.015 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:39:15.015 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:39:15.015 INFO:teuthology.orchestra.run.smithi006.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:39:15.015 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-21T22:39:15.015 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T22:39:15.015 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:39:15.015 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-21T22:39:15.015 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:39:15.016 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:39:15.016 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:39:15.016 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-21T22:39:15.016 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:39:15.016 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:39:15.016 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T22:39:15.016 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-21T22:39:15.016 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:39:15.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:39:15.018 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:39:15.078 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-07-21T22:39:15.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:39:15.080 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-07-21T22:39:15.133 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-07-21T22:39:15.133 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:39:15.133 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:39:15.133 INFO:teuthology.orchestra.run.smithi006.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:39:15.134 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:39:15.134 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:39:15.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:39:15.134 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T22:39:15.135 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T22:39:15.135 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:39:15.135 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:39:15.136 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:39:15.136 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T22:39:15.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:39:15.229 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T22:39:15.239 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-21T22:39:15.239 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T22:39:15.240 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:39:15.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:39:15.240 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-07-21T22:39:15.308 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:39:15.309 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T22:39:15.359 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:39:15.360 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:39:15.360 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:39:15.414 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-21T22:39:15.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:39:15.415 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:39:15.511 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:39:15.511 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:39:15.511 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:39:15.526 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:39:15.526 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:39:15.527 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:39:15.527 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:39:15.527 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:39:15.535 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:39:15.535 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:39:15.536 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:39:15.536 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:39:15.536 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:39:15.536 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-07-21T22:39:15.536 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-07-21T22:39:15.536 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f3073df4-6cd1-4503-bd2e-d3e98fa18bdf" will pass to kernel 2023-07-21T22:39:15.540 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T22:39:15.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:39:15.541 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:39:15.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:39:15.563 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:39:15.626 INFO:teuthology.orchestra.run.smithi006.stdout:client9513 2023-07-21T22:39:15.627 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:39:15.627 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:39:15.683 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-21T22:39:15.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f8296cca640 1 Processor -- start 2023-07-21T22:39:15.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f8296cca640 1 -- start start 2023-07-21T22:39:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f8296cca640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f82900cb780 0x7f82900cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f8296cca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f829006b8f0 0x7f82900cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:15.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f8296cca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829006f900 con 0x7f829015b7c0 2023-07-21T22:39:15.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f8296cca640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82900cdce0 con 0x7f82900cb780 2023-07-21T22:39:15.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f8296cca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82900ca830 con 0x7f829006b8f0 2023-07-21T22:39:15.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f8294a66640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f829015b7c0 0x7f829006b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37372/0 (socket says 172.21.15.6:37372) 2023-07-21T22:39:15.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f8294a66640 1 -- 172.21.15.6:0/599134121 learned_addr learned my addr 172.21.15.6:0/599134121 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:39:15.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f828ffff640 1 --2- 172.21.15.6:0/599134121 >> v2:172.21.15.161:3300/0 conn(0x7f82900cb780 0x7f82900cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:15.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f8295267640 1 --2- 172.21.15.6:0/599134121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f829006b8f0 0x7f82900cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:15.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f828f7fe640 1 -- 172.21.15.6:0/599134121 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730997737 0 0) 0x7f829006f900 con 0x7f829015b7c0 2023-07-21T22:39:15.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f828f7fe640 1 -- 172.21.15.6:0/599134121 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8280004640 con 0x7f829015b7c0 2023-07-21T22:39:15.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f828f7fe640 1 -- 172.21.15.6:0/599134121 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1784202872 0 0) 0x7f8280004640 con 0x7f829015b7c0 2023-07-21T22:39:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f828f7fe640 1 -- 172.21.15.6:0/599134121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f829006b8f0 msgr2=0x7f82900cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f828f7fe640 1 --2- 172.21.15.6:0/599134121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f829006b8f0 0x7f82900cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f828f7fe640 1 -- 172.21.15.6:0/599134121 >> v2:172.21.15.161:3300/0 conn(0x7f82900cb780 msgr2=0x7f82900cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f828f7fe640 1 --2- 172.21.15.6:0/599134121 >> v2:172.21.15.161:3300/0 conn(0x7f82900cb780 0x7f82900cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f828f7fe640 1 -- 172.21.15.6:0/599134121 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829015bb90 con 0x7f829015b7c0 2023-07-21T22:39:15.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f828f7fe640 1 -- 172.21.15.6:0/599134121 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f8284001680 con 0x7f829015b7c0 2023-07-21T22:39:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f828ffff640 1 --2- 172.21.15.6:0/599134121 >> v2:172.21.15.161:3300/0 conn(0x7f82900cb780 0x7f82900cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:39:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f828f7fe640 1 -- 172.21.15.6:0/599134121 >> v1:172.21.15.6:6789/0 conn(0x7f829015b7c0 legacy=0x7f829006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f828f7fe640 1 --2- 172.21.15.6:0/599134121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f829006b8f0 0x7f8280004a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f828f7fe640 1 --2- 172.21.15.6:0/599134121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8280005010 0x7f82800058e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f828f7fe640 1 --2- 172.21.15.6:0/599134121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8280005e20 0x7f8280006290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f828f7fe640 1 -- 172.21.15.6:0/599134121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82900cdce0 con 0x7f8280005e20 2023-07-21T22:39:15.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f828f7fe640 1 -- 172.21.15.6:0/599134121 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82900ca830 con 0x7f8280005010 2023-07-21T22:39:15.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f828f7fe640 1 -- 172.21.15.6:0/599134121 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8280003450 con 0x7f829006b8f0 2023-07-21T22:39:15.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f8295267640 1 --2- 172.21.15.6:0/599134121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8280005e20 0x7f8280006290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:15.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f8294a66640 1 --2- 172.21.15.6:0/599134121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f829006b8f0 0x7f8280004a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:15.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f828ffff640 1 --2- 172.21.15.6:0/599134121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8280005010 0x7f82800058e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:15.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f8295267640 1 -- 172.21.15.6:0/599134121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f829006b8f0 msgr2=0x7f8280004a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:15.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f8295267640 1 --2- 172.21.15.6:0/599134121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f829006b8f0 0x7f8280004a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:15.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f8295267640 1 -- 172.21.15.6:0/599134121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8280005010 msgr2=0x7f82800058e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:15.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f8295267640 1 --2- 172.21.15.6:0/599134121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8280005010 0x7f82800058e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:15.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f8295267640 1 -- 172.21.15.6:0/599134121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8280004640 con 0x7f8280005e20 2023-07-21T22:39:15.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.827+0000 7f828ffff640 1 --2- 172.21.15.6:0/599134121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8280005010 0x7f82800058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:15.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.831+0000 7f8295267640 1 --2- 172.21.15.6:0/599134121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8280005e20 0x7f8280006290 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f8288009fc0 tx=0x7f828801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8861de398104008f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:15.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.831+0000 7f828f7fe640 1 -- 172.21.15.6:0/599134121 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82880a5c70 con 0x7f8280005e20 2023-07-21T22:39:15.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.831+0000 7f828f7fe640 1 -- 172.21.15.6:0/599134121 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828800f040 con 0x7f8280005e20 2023-07-21T22:39:15.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.831+0000 7f828f7fe640 1 -- 172.21.15.6:0/599134121 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82880ad440 con 0x7f8280005e20 2023-07-21T22:39:15.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.831+0000 7f8296cca640 1 -- 172.21.15.6:0/599134121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8280005e20 msgr2=0x7f8280006290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:15.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.831+0000 7f8296cca640 1 --2- 172.21.15.6:0/599134121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8280005e20 0x7f8280006290 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f8288009fc0 tx=0x7f828801cc60 comp rx=0 tx=0).stop 2023-07-21T22:39:15.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.831+0000 7f8295267640 1 -- 172.21.15.6:0/599134121 reap_dead start 2023-07-21T22:39:15.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.831+0000 7f8296cca640 1 -- 172.21.15.6:0/599134121 shutdown_connections 2023-07-21T22:39:15.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.831+0000 7f8296cca640 1 -- 172.21.15.6:0/599134121 >> 172.21.15.6:0/599134121 conn(0x7f82900afcf0 msgr2=0x7f82900b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:15.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.831+0000 7f8296cca640 1 -- 172.21.15.6:0/599134121 shutdown_connections 2023-07-21T22:39:15.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.831+0000 7f8296cca640 1 -- 172.21.15.6:0/599134121 wait complete. 2023-07-21T22:39:15.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f8296cca640 1 Processor -- start 2023-07-21T22:39:15.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f8296cca640 1 -- start start 2023-07-21T22:39:15.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f8296cca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8280005e20 0x7f8290157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:15.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f8296cca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82900c2ca0 0x7f82900c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:15.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f8296cca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8290151460 0x7f82901581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:15.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f8296cca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82900c3c20 con 0x7f82900c2ca0 2023-07-21T22:39:15.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f8296cca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82900c1c90 con 0x7f8280005e20 2023-07-21T22:39:15.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f8296cca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82900c1ee0 con 0x7f8290151460 2023-07-21T22:39:15.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f828ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82900c2ca0 0x7f82900c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:15.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f828ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82900c2ca0 0x7f82900c36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54630/0 (socket says 172.21.15.6:54630) 2023-07-21T22:39:15.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f828ffff640 1 -- 172.21.15.6:0/2104941580 learned_addr learned my addr 172.21.15.6:0/2104941580 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:15.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f8294a66640 1 --2- 172.21.15.6:0/2104941580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8280005e20 0x7f8290157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:15.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f8295267640 1 --2- 172.21.15.6:0/2104941580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8290151460 0x7f82901581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:15.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f828ffff640 1 -- 172.21.15.6:0/2104941580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8290151460 msgr2=0x7f82901581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:15.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f828ffff640 1 --2- 172.21.15.6:0/2104941580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8290151460 0x7f82901581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:15.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f828ffff640 1 -- 172.21.15.6:0/2104941580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8280005e20 msgr2=0x7f8290157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:15.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f828ffff640 1 --2- 172.21.15.6:0/2104941580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8280005e20 0x7f8290157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:15.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f828ffff640 1 -- 172.21.15.6:0/2104941580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82900c21c0 con 0x7f82900c2ca0 2023-07-21T22:39:15.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f8294a66640 1 --2- 172.21.15.6:0/2104941580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8280005e20 0x7f8290157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:15.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f828ffff640 1 --2- 172.21.15.6:0/2104941580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82900c2ca0 0x7f82900c36e0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f827c0118d0 tx=0x7f827c011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:15.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f828d7fa640 1 -- 172.21.15.6:0/2104941580 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c00fbd0 con 0x7f82900c2ca0 2023-07-21T22:39:15.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f828d7fa640 1 -- 172.21.15.6:0/2104941580 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c00fd30 con 0x7f82900c2ca0 2023-07-21T22:39:15.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f828d7fa640 1 -- 172.21.15.6:0/2104941580 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c015660 con 0x7f82900c2ca0 2023-07-21T22:39:15.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f8296cca640 1 -- 172.21.15.6:0/2104941580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82900c24a0 con 0x7f82900c2ca0 2023-07-21T22:39:15.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.835+0000 7f8296cca640 1 -- 172.21.15.6:0/2104941580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82901518d0 con 0x7f82900c2ca0 2023-07-21T22:39:15.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.839+0000 7f8296cca640 1 -- 172.21.15.6:0/2104941580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82900678d0 con 0x7f82900c2ca0 2023-07-21T22:39:15.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.839+0000 7f828d7fa640 1 -- 172.21.15.6:0/2104941580 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f827c0157c0 con 0x7f82900c2ca0 2023-07-21T22:39:15.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.839+0000 7f828d7fa640 1 --2- 172.21.15.6:0/2104941580 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f82740663a0 0x7f8274068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:15.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.839+0000 7f828d7fa640 1 -- 172.21.15.6:0/2104941580 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f827c084ac0 con 0x7f82900c2ca0 2023-07-21T22:39:15.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.839+0000 7f8294a66640 1 --2- 172.21.15.6:0/2104941580 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f82740663a0 0x7f8274068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:15.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.839+0000 7f8294a66640 1 --2- 172.21.15.6:0/2104941580 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f82740663a0 0x7f8274068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8284001060 tx=0x7f8284009040 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:15.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:15.843+0000 7f828d7fa640 1 -- 172.21.15.6:0/2104941580 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f827c051d40 con 0x7f82900c2ca0 2023-07-21T22:39:16.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.019+0000 7f8296cca640 1 -- 172.21.15.6:0/2104941580 --> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f82900c2050 con 0x7f82740663a0 2023-07-21T22:39:16.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.023+0000 7f828d7fa640 1 -- 172.21.15.6:0/2104941580 <== mgr.7694 v2:172.21.15.161:6832/2692111396 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f82900c2050 con 0x7f82740663a0 2023-07-21T22:39:16.068 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:39:16.068 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:39:16.068 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephfs" 2023-07-21T22:39:16.069 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:39:16.069 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:39:16.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.023+0000 7f8296cca640 1 -- 172.21.15.6:0/2104941580 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f82740663a0 msgr2=0x7f8274068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:16.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.023+0000 7f8296cca640 1 --2- 172.21.15.6:0/2104941580 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f82740663a0 0x7f8274068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8284001060 tx=0x7f8284009040 comp rx=0 tx=0).stop 2023-07-21T22:39:16.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.023+0000 7f8296cca640 1 -- 172.21.15.6:0/2104941580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82900c2ca0 msgr2=0x7f82900c36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:16.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.023+0000 7f8296cca640 1 --2- 172.21.15.6:0/2104941580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82900c2ca0 0x7f82900c36e0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f827c0118d0 tx=0x7f827c011d90 comp rx=0 tx=0).stop 2023-07-21T22:39:16.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.023+0000 7f8296cca640 1 -- 172.21.15.6:0/2104941580 shutdown_connections 2023-07-21T22:39:16.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.023+0000 7f8296cca640 1 --2- 172.21.15.6:0/2104941580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8290151460 0x7f82901581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:16.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.023+0000 7f8296cca640 1 --2- 172.21.15.6:0/2104941580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82900c2ca0 0x7f82900c36e0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:16.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.023+0000 7f8296cca640 1 --2- 172.21.15.6:0/2104941580 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f82740663a0 0x7f8274068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:16.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.023+0000 7f8296cca640 1 --2- 172.21.15.6:0/2104941580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8280005e20 0x7f8290157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:16.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.023+0000 7f8296cca640 1 -- 172.21.15.6:0/2104941580 >> 172.21.15.6:0/2104941580 conn(0x7f82900afcf0 msgr2=0x7f8290159490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:16.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.023+0000 7f8296cca640 1 -- 172.21.15.6:0/2104941580 shutdown_connections 2023-07-21T22:39:16.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.023+0000 7f8296cca640 1 -- 172.21.15.6:0/2104941580 wait complete. 2023-07-21T22:39:16.089 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-21T22:39:16.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4bf300640 1 Processor -- start 2023-07-21T22:39:16.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4bf300640 1 -- start start 2023-07-21T22:39:16.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4bf300640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4b8164340 0x7fe4b80cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:16.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4bf300640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b806d420 con 0x7fe4b81600b0 2023-07-21T22:39:16.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4bf300640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b80c89f0 con 0x7fe4b806cf80 2023-07-21T22:39:16.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4bf300640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b80cbe50 con 0x7fe4b8164340 2023-07-21T22:39:16.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4bd09c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe4b81600b0 0x7fe4b8163c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37388/0 (socket says 172.21.15.6:37388) 2023-07-21T22:39:16.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4bd09c640 1 -- 172.21.15.6:0/786214469 learned_addr learned my addr 172.21.15.6:0/786214469 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:39:16.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4bc89b640 1 --2- 172.21.15.6:0/786214469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4b8164340 0x7fe4b80cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:16.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4affff640 1 -- 172.21.15.6:0/786214469 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292314038 0 0) 0x7fe4b4001120 con 0x7fe4b81600b0 2023-07-21T22:39:16.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4affff640 1 -- 172.21.15.6:0/786214469 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4a4003530 con 0x7fe4b81600b0 2023-07-21T22:39:16.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4affff640 1 -- 172.21.15.6:0/786214469 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1241746768 0 0) 0x7fe4a4003530 con 0x7fe4b81600b0 2023-07-21T22:39:16.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4affff640 1 -- 172.21.15.6:0/786214469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4b8164340 msgr2=0x7fe4b80cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:16.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4affff640 1 --2- 172.21.15.6:0/786214469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4b8164340 0x7fe4b80cd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:16.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4affff640 1 -- 172.21.15.6:0/786214469 >> v1:172.21.15.161:6789/0 conn(0x7fe4b806cf80 legacy=0x7fe4b80c0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:16.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4affff640 1 -- 172.21.15.6:0/786214469 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b80cc9d0 con 0x7fe4b81600b0 2023-07-21T22:39:16.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4affff640 1 -- 172.21.15.6:0/786214469 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fe4b4001810 con 0x7fe4b81600b0 2023-07-21T22:39:16.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4affff640 1 -- 172.21.15.6:0/786214469 >> v1:172.21.15.6:6789/0 conn(0x7fe4b81600b0 legacy=0x7fe4b8163c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:16.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4affff640 1 --2- 172.21.15.6:0/786214469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a40039b0 0x7fe4a4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:16.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4affff640 1 --2- 172.21.15.6:0/786214469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4b8164340 0x7fe4a40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:16.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4affff640 1 --2- 172.21.15.6:0/786214469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4a4004d10 0x7fe4a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:16.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4affff640 1 -- 172.21.15.6:0/786214469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b80cbe50 con 0x7fe4a40039b0 2023-07-21T22:39:16.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4affff640 1 -- 172.21.15.6:0/786214469 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a400b990 con 0x7fe4a4004d10 2023-07-21T22:39:16.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4affff640 1 -- 172.21.15.6:0/786214469 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a400bb50 con 0x7fe4b8164340 2023-07-21T22:39:16.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.191+0000 7fe4bd09c640 1 --2- 172.21.15.6:0/786214469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a40039b0 0x7fe4a4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:16.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.195+0000 7fe4bd89d640 1 --2- 172.21.15.6:0/786214469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4a4004d10 0x7fe4a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:16.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.195+0000 7fe4bc89b640 1 --2- 172.21.15.6:0/786214469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4b8164340 0x7fe4a40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:16.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.195+0000 7fe4bd09c640 1 -- 172.21.15.6:0/786214469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4b8164340 msgr2=0x7fe4a40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:16.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.195+0000 7fe4bd09c640 1 --2- 172.21.15.6:0/786214469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4b8164340 0x7fe4a40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:16.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.195+0000 7fe4bd09c640 1 -- 172.21.15.6:0/786214469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4a4004d10 msgr2=0x7fe4a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:16.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.195+0000 7fe4bd09c640 1 --2- 172.21.15.6:0/786214469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4a4004d10 0x7fe4a4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:16.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.195+0000 7fe4bd09c640 1 -- 172.21.15.6:0/786214469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a4003530 con 0x7fe4a40039b0 2023-07-21T22:39:16.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.195+0000 7fe4bd89d640 1 --2- 172.21.15.6:0/786214469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4a4004d10 0x7fe4a4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:16.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.195+0000 7fe4bd09c640 1 --2- 172.21.15.6:0/786214469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a40039b0 0x7fe4a4003d80 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400c240 tx=0x7fe4b401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d2f0cf00375720 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:16.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.195+0000 7fe4affff640 1 -- 172.21.15.6:0/786214469 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4005ae0 con 0x7fe4a40039b0 2023-07-21T22:39:16.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.195+0000 7fe4affff640 1 -- 172.21.15.6:0/786214469 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b4005c40 con 0x7fe4a40039b0 2023-07-21T22:39:16.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.195+0000 7fe4affff640 1 -- 172.21.15.6:0/786214469 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4007070 con 0x7fe4a40039b0 2023-07-21T22:39:16.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.195+0000 7fe4bf300640 1 -- 172.21.15.6:0/786214469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a40039b0 msgr2=0x7fe4a4003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:16.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.195+0000 7fe4bf300640 1 --2- 172.21.15.6:0/786214469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a40039b0 0x7fe4a4003d80 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400c240 tx=0x7fe4b401cc40 comp rx=0 tx=0).stop 2023-07-21T22:39:16.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.195+0000 7fe4bd89d640 1 -- 172.21.15.6:0/786214469 reap_dead start 2023-07-21T22:39:16.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.195+0000 7fe4bf300640 1 -- 172.21.15.6:0/786214469 shutdown_connections 2023-07-21T22:39:16.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.195+0000 7fe4bf300640 1 -- 172.21.15.6:0/786214469 >> 172.21.15.6:0/786214469 conn(0x7fe4b80afac0 msgr2=0x7fe4b80afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:16.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bf300640 1 -- 172.21.15.6:0/786214469 shutdown_connections 2023-07-21T22:39:16.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bf300640 1 -- 172.21.15.6:0/786214469 wait complete. 2023-07-21T22:39:16.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bf300640 1 Processor -- start 2023-07-21T22:39:16.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bf300640 1 -- start start 2023-07-21T22:39:16.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bf300640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a40039b0 0x7fe4b815e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:16.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bf300640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4b815d180 0x7fe4b80c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:16.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bf300640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4b815afd0 0x7fe4b80c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:16.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bf300640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b815d680 con 0x7fe4a40039b0 2023-07-21T22:39:16.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bf300640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b815d960 con 0x7fe4b815afd0 2023-07-21T22:39:16.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bf300640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b815dc40 con 0x7fe4b815d180 2023-07-21T22:39:16.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bd09c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a40039b0 0x7fe4b815e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:16.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bd09c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a40039b0 0x7fe4b815e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54662/0 (socket says 172.21.15.6:54662) 2023-07-21T22:39:16.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bd09c640 1 -- 172.21.15.6:0/2878213877 learned_addr learned my addr 172.21.15.6:0/2878213877 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:16.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bd89d640 1 --2- 172.21.15.6:0/2878213877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4b815afd0 0x7fe4b80c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:16.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bc89b640 1 --2- 172.21.15.6:0/2878213877 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4b815d180 0x7fe4b80c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:16.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bd09c640 1 -- 172.21.15.6:0/2878213877 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4b815d180 msgr2=0x7fe4b80c2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:16.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bd09c640 1 --2- 172.21.15.6:0/2878213877 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4b815d180 0x7fe4b80c2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:16.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bd09c640 1 -- 172.21.15.6:0/2878213877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4b815afd0 msgr2=0x7fe4b80c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:16.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bd09c640 1 --2- 172.21.15.6:0/2878213877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4b815afd0 0x7fe4b80c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:16.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bd09c640 1 -- 172.21.15.6:0/2878213877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b815df20 con 0x7fe4a40039b0 2023-07-21T22:39:16.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bd89d640 1 --2- 172.21.15.6:0/2878213877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4b815afd0 0x7fe4b80c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:16.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.199+0000 7fe4bd09c640 1 --2- 172.21.15.6:0/2878213877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a40039b0 0x7fe4b815e720 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4001ad0 tx=0x7fe4a4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:16.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.203+0000 7fe4adffb640 1 -- 172.21.15.6:0/2878213877 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b40b4070 con 0x7fe4a40039b0 2023-07-21T22:39:16.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.203+0000 7fe4adffb640 1 -- 172.21.15.6:0/2878213877 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b4005db0 con 0x7fe4a40039b0 2023-07-21T22:39:16.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.203+0000 7fe4adffb640 1 -- 172.21.15.6:0/2878213877 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b40017d0 con 0x7fe4a40039b0 2023-07-21T22:39:16.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.203+0000 7fe4bf300640 1 -- 172.21.15.6:0/2878213877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b815e200 con 0x7fe4a40039b0 2023-07-21T22:39:16.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.203+0000 7fe4bf300640 1 -- 172.21.15.6:0/2878213877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b80c2ba0 con 0x7fe4a40039b0 2023-07-21T22:39:16.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.203+0000 7fe4bf300640 1 -- 172.21.15.6:0/2878213877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b815e3c0 con 0x7fe4a40039b0 2023-07-21T22:39:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.203+0000 7fe4adffb640 1 -- 172.21.15.6:0/2878213877 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe4b4007040 con 0x7fe4a40039b0 2023-07-21T22:39:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.203+0000 7fe4adffb640 1 --2- 172.21.15.6:0/2878213877 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe49c0663d0 0x7fe49c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.203+0000 7fe4adffb640 1 -- 172.21.15.6:0/2878213877 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fe4b411d710 con 0x7fe4a40039b0 2023-07-21T22:39:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.203+0000 7fe4bc89b640 1 --2- 172.21.15.6:0/2878213877 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe49c0663d0 0x7fe49c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:16.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.207+0000 7fe4bc89b640 1 --2- 172.21.15.6:0/2878213877 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe49c0663d0 0x7fe49c068880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80cb2e0 tx=0x7fe4a8008040 comp rx=0 tx=0).ready entity=mgr.7694 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:16.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.207+0000 7fe4adffb640 1 -- 172.21.15.6:0/2878213877 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe4b40eaa20 con 0x7fe4a40039b0 2023-07-21T22:39:16.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.403+0000 7fe4bf300640 1 -- 172.21.15.6:0/2878213877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fe4b806d420 con 0x7fe4a40039b0 2023-07-21T22:39:16.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.927+0000 7fe4adffb640 1 -- 172.21.15.6:0/2878213877 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 67) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fe4b40eadf0 con 0x7fe4a40039b0 2023-07-21T22:39:16.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.927+0000 7fe4adffb640 1 -- 172.21.15.6:0/2878213877 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v67) v1 ==== 92+0+0 (secure 0 0 0) 0x7fe4b4116fd0 con 0x7fe4a40039b0 2023-07-21T22:39:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.931+0000 7fe4bf300640 1 -- 172.21.15.6:0/2878213877 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe49c0663d0 msgr2=0x7fe49c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.931+0000 7fe4bf300640 1 --2- 172.21.15.6:0/2878213877 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe49c0663d0 0x7fe49c068880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80cb2e0 tx=0x7fe4a8008040 comp rx=0 tx=0).stop 2023-07-21T22:39:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.931+0000 7fe4bf300640 1 -- 172.21.15.6:0/2878213877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a40039b0 msgr2=0x7fe4b815e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.931+0000 7fe4bf300640 1 --2- 172.21.15.6:0/2878213877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a40039b0 0x7fe4b815e720 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4001ad0 tx=0x7fe4a4005800 comp rx=0 tx=0).stop 2023-07-21T22:39:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.931+0000 7fe4bf300640 1 -- 172.21.15.6:0/2878213877 shutdown_connections 2023-07-21T22:39:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.931+0000 7fe4bf300640 1 --2- 172.21.15.6:0/2878213877 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fe49c0663d0 0x7fe49c068880 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.931+0000 7fe4bf300640 1 --2- 172.21.15.6:0/2878213877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4b815afd0 0x7fe4b80c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.931+0000 7fe4bf300640 1 --2- 172.21.15.6:0/2878213877 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4b815d180 0x7fe4b80c2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.931+0000 7fe4bf300640 1 --2- 172.21.15.6:0/2878213877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4a40039b0 0x7fe4b815e720 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.931+0000 7fe4bf300640 1 -- 172.21.15.6:0/2878213877 >> 172.21.15.6:0/2878213877 conn(0x7fe4b80afac0 msgr2=0x7fe4b80ce190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.931+0000 7fe4bf300640 1 -- 172.21.15.6:0/2878213877 shutdown_connections 2023-07-21T22:39:16.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:16.931+0000 7fe4bf300640 1 -- 172.21.15.6:0/2878213877 wait complete. 2023-07-21T22:39:16.999 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-21T22:39:17.150 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:17.110+0000 7fd5f1bff180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:39:17.156 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:17.111+0000 7fe6d824b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:39:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.111+0000 7f233e9fa640 1 Processor -- start 2023-07-21T22:39:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.111+0000 7f233e9fa640 1 -- start start 2023-07-21T22:39:17.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.111+0000 7f233e9fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23380d2300 0x7f23380d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:17.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.111+0000 7f233e9fa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23380b04c0 con 0x7f233815bde0 2023-07-21T22:39:17.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.111+0000 7f233e9fa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23380b1060 con 0x7f23380d2fc0 2023-07-21T22:39:17.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.111+0000 7f233e9fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233815c1b0 con 0x7f23380d2300 2023-07-21T22:39:17.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.111+0000 7f2337fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f233815bde0 0x7f23380d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37404/0 (socket says 172.21.15.6:37404) 2023-07-21T22:39:17.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.111+0000 7f2337fff640 1 -- 172.21.15.6:0/3616900322 learned_addr learned my addr 172.21.15.6:0/3616900322 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:39:17.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.111+0000 7f233cf97640 1 --2- 172.21.15.6:0/3616900322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23380d2300 0x7f23380d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:17.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.115+0000 7f2336ffd640 1 -- 172.21.15.6:0/3616900322 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576710301 0 0) 0x7f23380b04c0 con 0x7f233815bde0 2023-07-21T22:39:17.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.115+0000 7f2336ffd640 1 -- 172.21.15.6:0/3616900322 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2320003530 con 0x7f233815bde0 2023-07-21T22:39:17.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.115+0000 7f233cf97640 1 -- 172.21.15.6:0/3616900322 >> v1:172.21.15.161:6789/0 conn(0x7f23380d2fc0 legacy=0x7f23380b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:17.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.115+0000 7f2336ffd640 1 -- 172.21.15.6:0/3616900322 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068553431 0 0) 0x7f23380b1060 con 0x7f23380d2fc0 2023-07-21T22:39:17.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.115+0000 7f233cf97640 1 -- 172.21.15.6:0/3616900322 >> v1:172.21.15.6:6789/0 conn(0x7f233815bde0 legacy=0x7f23380d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:17.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.115+0000 7f233cf97640 1 -- 172.21.15.6:0/3616900322 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23380d0aa0 con 0x7f23380d2300 2023-07-21T22:39:17.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.115+0000 7f233cf97640 1 --2- 172.21.15.6:0/3616900322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23380d2300 0x7f23380d2780 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2330009dc0 tx=0x7f233001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8823c793a97a8253 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:17.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.115+0000 7f2336ffd640 1 -- 172.21.15.6:0/3616900322 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23300a5940 con 0x7f23380d2300 2023-07-21T22:39:17.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.115+0000 7f2336ffd640 1 -- 172.21.15.6:0/3616900322 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23300a5aa0 con 0x7f23380d2300 2023-07-21T22:39:17.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.115+0000 7f2336ffd640 1 -- 172.21.15.6:0/3616900322 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23300a5e30 con 0x7f23380d2300 2023-07-21T22:39:17.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f233e9fa640 1 -- 172.21.15.6:0/3616900322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23380d2300 msgr2=0x7f23380d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:17.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f233e9fa640 1 --2- 172.21.15.6:0/3616900322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23380d2300 0x7f23380d2780 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2330009dc0 tx=0x7f233001c970 comp rx=0 tx=0).stop 2023-07-21T22:39:17.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f233e9fa640 1 -- 172.21.15.6:0/3616900322 shutdown_connections 2023-07-21T22:39:17.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f233e9fa640 1 --2- 172.21.15.6:0/3616900322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23380d2300 0x7f23380d2780 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f233e9fa640 1 -- 172.21.15.6:0/3616900322 >> 172.21.15.6:0/3616900322 conn(0x7f23380659d0 msgr2=0x7f233809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:17.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f233e9fa640 1 -- 172.21.15.6:0/3616900322 shutdown_connections 2023-07-21T22:39:17.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f233e9fa640 1 -- 172.21.15.6:0/3616900322 wait complete. 2023-07-21T22:39:17.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f233e9fa640 1 Processor -- start 2023-07-21T22:39:17.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f233e9fa640 1 -- start start 2023-07-21T22:39:17.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f233e9fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23380d2300 0x7f23381508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:17.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f233e9fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23380d2fc0 0x7f2338151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:17.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f233e9fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f233815bde0 0x7f2338153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:17.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f233e9fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2338150e20 con 0x7f23380d2300 2023-07-21T22:39:17.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f233e9fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233815c360 con 0x7f23380d2fc0 2023-07-21T22:39:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f233e9fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233815c4f0 con 0x7f233815bde0 2023-07-21T22:39:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f2337fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23380d2300 0x7f23381508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f2337fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23380d2300 0x7f23381508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54690/0 (socket says 172.21.15.6:54690) 2023-07-21T22:39:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f2337fff640 1 -- 172.21.15.6:0/1756748138 learned_addr learned my addr 172.21.15.6:0/1756748138 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f23377fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23380d2fc0 0x7f2338151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:17.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f233cf97640 1 --2- 172.21.15.6:0/1756748138 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f233815bde0 0x7f2338153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:17.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f2337fff640 1 -- 172.21.15.6:0/1756748138 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f233815bde0 msgr2=0x7f2338153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:17.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f2337fff640 1 --2- 172.21.15.6:0/1756748138 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f233815bde0 0x7f2338153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f2337fff640 1 -- 172.21.15.6:0/1756748138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23380d2fc0 msgr2=0x7f2338151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:17.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f2337fff640 1 --2- 172.21.15.6:0/1756748138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23380d2fc0 0x7f2338151df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f2337fff640 1 -- 172.21.15.6:0/1756748138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2330009a70 con 0x7f23380d2300 2023-07-21T22:39:17.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.119+0000 7f23377fe640 1 --2- 172.21.15.6:0/1756748138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23380d2fc0 0x7f2338151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:39:17.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.123+0000 7f2337fff640 1 --2- 172.21.15.6:0/1756748138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23380d2300 0x7f23381508e0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f232800c700 tx=0x7f232800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:17.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.123+0000 7f2334ff9640 1 -- 172.21.15.6:0/1756748138 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328007270 con 0x7f23380d2300 2023-07-21T22:39:17.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.123+0000 7f2334ff9640 1 -- 172.21.15.6:0/1756748138 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23280073d0 con 0x7f23380d2300 2023-07-21T22:39:17.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.123+0000 7f233e9fa640 1 -- 172.21.15.6:0/1756748138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2338152760 con 0x7f23380d2300 2023-07-21T22:39:17.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.123+0000 7f2334ff9640 1 -- 172.21.15.6:0/1756748138 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328001d50 con 0x7f23380d2300 2023-07-21T22:39:17.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.123+0000 7f233e9fa640 1 -- 172.21.15.6:0/1756748138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2338152d20 con 0x7f23380d2300 2023-07-21T22:39:17.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.123+0000 7f233e9fa640 1 -- 172.21.15.6:0/1756748138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23380678d0 con 0x7f23380d2300 2023-07-21T22:39:17.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.123+0000 7f2334ff9640 1 -- 172.21.15.6:0/1756748138 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 67) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f23280057b0 con 0x7f23380d2300 2023-07-21T22:39:17.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.123+0000 7f2334ff9640 1 --2- 172.21.15.6:0/1756748138 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f23240663f0 0x7f23240688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:17.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.123+0000 7f2334ff9640 1 -- 172.21.15.6:0/1756748138 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f23280834a0 con 0x7f23380d2300 2023-07-21T22:39:17.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.123+0000 7f23377fe640 1 -- 172.21.15.6:0/1756748138 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f23240663f0 msgr2=0x7f23240688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2692111396 2023-07-21T22:39:17.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.127+0000 7f23377fe640 1 --2- 172.21.15.6:0/1756748138 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f23240663f0 0x7f23240688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:39:17.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.127+0000 7f2334ff9640 1 -- 172.21.15.6:0/1756748138 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2328050870 con 0x7f23380d2300 2023-07-21T22:39:17.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.287+0000 7f233e9fa640 1 -- 172.21.15.6:0/1756748138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f23380b0d00 con 0x7f23380d2300 2023-07-21T22:39:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.295+0000 7f2334ff9640 1 -- 172.21.15.6:0/1756748138 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v53)=0 v53) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2328053e90 con 0x7f23380d2300 2023-07-21T22:39:17.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.295+0000 7f233e9fa640 1 -- 172.21.15.6:0/1756748138 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f23240663f0 msgr2=0x7f23240688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:39:17.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.295+0000 7f233e9fa640 1 --2- 172.21.15.6:0/1756748138 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f23240663f0 0x7f23240688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.295+0000 7f233e9fa640 1 -- 172.21.15.6:0/1756748138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23380d2300 msgr2=0x7f23381508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:17.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.295+0000 7f233e9fa640 1 --2- 172.21.15.6:0/1756748138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23380d2300 0x7f23381508e0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f232800c700 tx=0x7f232800cbc0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.295+0000 7f233e9fa640 1 -- 172.21.15.6:0/1756748138 shutdown_connections 2023-07-21T22:39:17.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.295+0000 7f233e9fa640 1 --2- 172.21.15.6:0/1756748138 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f233815bde0 0x7f2338153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.295+0000 7f233e9fa640 1 --2- 172.21.15.6:0/1756748138 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7f23240663f0 0x7f23240688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.295+0000 7f233e9fa640 1 --2- 172.21.15.6:0/1756748138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23380d2fc0 0x7f2338151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.295+0000 7f233e9fa640 1 --2- 172.21.15.6:0/1756748138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23380d2300 0x7f23381508e0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.295+0000 7f233e9fa640 1 -- 172.21.15.6:0/1756748138 >> 172.21.15.6:0/1756748138 conn(0x7f23380659d0 msgr2=0x7f23380cd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.295+0000 7f233e9fa640 1 -- 172.21.15.6:0/1756748138 shutdown_connections 2023-07-21T22:39:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.295+0000 7f233e9fa640 1 -- 172.21.15.6:0/1756748138 wait complete. 2023-07-21T22:39:17.362 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-21T22:39:17.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.463+0000 7feee9419640 1 Processor -- start 2023-07-21T22:39:17.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.463+0000 7feee9419640 1 -- start start 2023-07-21T22:39:17.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.467+0000 7feee9419640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feee415bde0 0x7feee40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:17.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.467+0000 7feee9419640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feee40d2300 0x7feee40d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:17.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.467+0000 7feee9419640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee40b04c0 con 0x7feee40d2fc0 2023-07-21T22:39:17.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.467+0000 7feee9419640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee415c1b0 con 0x7feee415bde0 2023-07-21T22:39:17.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.467+0000 7feee9419640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee40b1060 con 0x7feee40d2300 2023-07-21T22:39:17.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.467+0000 7feee2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feee415bde0 0x7feee40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:17.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.467+0000 7feee2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7feee415bde0 0x7feee40d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46664/0 (socket says 172.21.15.6:46664) 2023-07-21T22:39:17.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.467+0000 7feee2ffd640 1 -- 172.21.15.6:0/103410946 learned_addr learned my addr 172.21.15.6:0/103410946 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:17.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.467+0000 7feee37fe640 1 --2- 172.21.15.6:0/103410946 >> v2:172.21.15.161:3300/0 conn(0x7feee40d2300 0x7feee40d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:17.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.467+0000 7feee2ffd640 1 -- 172.21.15.6:0/103410946 >> v2:172.21.15.161:3300/0 conn(0x7feee40d2300 msgr2=0x7feee40d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:17.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.467+0000 7feee2ffd640 1 --2- 172.21.15.6:0/103410946 >> v2:172.21.15.161:3300/0 conn(0x7feee40d2300 0x7feee40d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.467+0000 7feee2ffd640 1 -- 172.21.15.6:0/103410946 >> v1:172.21.15.161:6789/0 conn(0x7feee40d2fc0 legacy=0x7feee40b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:17.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.467+0000 7feee2ffd640 1 -- 172.21.15.6:0/103410946 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee40d2c80 con 0x7feee415bde0 2023-07-21T22:39:17.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.471+0000 7feee2ffd640 1 --2- 172.21.15.6:0/103410946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee415bde0 0x7feee40d0270 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7feee408c820 tx=0x7feed401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30663bb84e5921e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:17.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.471+0000 7feee27fc640 1 -- 172.21.15.6:0/103410946 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed40ab610 con 0x7feee415bde0 2023-07-21T22:39:17.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.471+0000 7feee27fc640 1 -- 172.21.15.6:0/103410946 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed40ab770 con 0x7feee415bde0 2023-07-21T22:39:17.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.471+0000 7feee27fc640 1 -- 172.21.15.6:0/103410946 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed40abb00 con 0x7feee415bde0 2023-07-21T22:39:17.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.471+0000 7feee9419640 1 -- 172.21.15.6:0/103410946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee415bde0 msgr2=0x7feee40d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:17.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.471+0000 7feee9419640 1 --2- 172.21.15.6:0/103410946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee415bde0 0x7feee40d0270 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7feee408c820 tx=0x7feed401c500 comp rx=0 tx=0).stop 2023-07-21T22:39:17.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.471+0000 7feee9419640 1 -- 172.21.15.6:0/103410946 shutdown_connections 2023-07-21T22:39:17.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.471+0000 7feee9419640 1 --2- 172.21.15.6:0/103410946 >> v2:172.21.15.161:3300/0 conn(0x7feee40d2300 0x7feee40d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.471+0000 7feee9419640 1 --2- 172.21.15.6:0/103410946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee415bde0 0x7feee40d0270 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.471+0000 7feee9419640 1 -- 172.21.15.6:0/103410946 >> 172.21.15.6:0/103410946 conn(0x7feee40659d0 msgr2=0x7feee409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:17.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.471+0000 7feee9419640 1 -- 172.21.15.6:0/103410946 shutdown_connections 2023-07-21T22:39:17.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.471+0000 7feee9419640 1 -- 172.21.15.6:0/103410946 wait complete. 2023-07-21T22:39:17.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.471+0000 7feee9419640 1 Processor -- start 2023-07-21T22:39:17.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.471+0000 7feee9419640 1 -- start start 2023-07-21T22:39:17.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feee9419640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee40d2300 0x7feee415dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:17.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feee9419640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee40d2fc0 0x7feee41552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:17.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feee9419640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee415bde0 0x7feee414e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:17.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feee9419640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee415d570 con 0x7feee40d2300 2023-07-21T22:39:17.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feee9419640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee415c8f0 con 0x7feee415bde0 2023-07-21T22:39:17.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feee9419640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee415cbd0 con 0x7feee40d2fc0 2023-07-21T22:39:17.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feee2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee40d2300 0x7feee415dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:17.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feee2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee40d2300 0x7feee415dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46680/0 (socket says 172.21.15.6:46680) 2023-07-21T22:39:17.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feee2ffd640 1 -- 172.21.15.6:0/891673571 learned_addr learned my addr 172.21.15.6:0/891673571 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:17.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feee37fe640 1 --2- 172.21.15.6:0/891673571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee415bde0 0x7feee414e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:17.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feedbfff640 1 --2- 172.21.15.6:0/891673571 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee40d2fc0 0x7feee41552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:17.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feee2ffd640 1 -- 172.21.15.6:0/891673571 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee40d2fc0 msgr2=0x7feee41552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:17.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feee2ffd640 1 --2- 172.21.15.6:0/891673571 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee40d2fc0 0x7feee41552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feee2ffd640 1 -- 172.21.15.6:0/891673571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee415bde0 msgr2=0x7feee414e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:17.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feee2ffd640 1 --2- 172.21.15.6:0/891673571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee415bde0 0x7feee414e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feee2ffd640 1 -- 172.21.15.6:0/891673571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed4009480 con 0x7feee40d2300 2023-07-21T22:39:17.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feee2ffd640 1 --2- 172.21.15.6:0/891673571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee40d2300 0x7feee415dee0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7feed401a130 tx=0x7feed40192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:17.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feedb7fe640 1 -- 172.21.15.6:0/891673571 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed40bc070 con 0x7feee40d2300 2023-07-21T22:39:17.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feedb7fe640 1 -- 172.21.15.6:0/891673571 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed40059a0 con 0x7feee40d2300 2023-07-21T22:39:17.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feedb7fe640 1 -- 172.21.15.6:0/891673571 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed4005d30 con 0x7feee40d2300 2023-07-21T22:39:17.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feee9419640 1 -- 172.21.15.6:0/891673571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee415ceb0 con 0x7feee40d2300 2023-07-21T22:39:17.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feee9419640 1 -- 172.21.15.6:0/891673571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee415e420 con 0x7feee40d2300 2023-07-21T22:39:17.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.475+0000 7feee9419640 1 -- 172.21.15.6:0/891673571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee40678d0 con 0x7feee40d2300 2023-07-21T22:39:17.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.479+0000 7feedb7fe640 1 -- 172.21.15.6:0/891673571 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 67) v1 ==== 85777+0+0 (secure 0 0 0) 0x7feed40ab8e0 con 0x7feee40d2300 2023-07-21T22:39:17.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.479+0000 7feedb7fe640 1 --2- 172.21.15.6:0/891673571 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7feec40663f0 0x7feec40688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:17.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.479+0000 7feedb7fe640 1 -- 172.21.15.6:0/891673571 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7feed411e080 con 0x7feee40d2300 2023-07-21T22:39:17.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.479+0000 7feedbfff640 1 -- 172.21.15.6:0/891673571 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7feec40663f0 msgr2=0x7feec40688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2692111396 2023-07-21T22:39:17.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.479+0000 7feedbfff640 1 --2- 172.21.15.6:0/891673571 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7feec40663f0 0x7feec40688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:39:17.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.483+0000 7feedb7fe640 1 -- 172.21.15.6:0/891673571 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feed40eb1f0 con 0x7feee40d2300 2023-07-21T22:39:17.569 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:17.530+0000 7fd5f1bff180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:39:17.607 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:17.563+0000 7fe6d824b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:39:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.643+0000 7feee9419640 1 -- 172.21.15.6:0/891673571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7feee4073040 con 0x7feee40d2300 2023-07-21T22:39:17.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.647+0000 7feedb7fe640 1 -- 172.21.15.6:0/891673571 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v54)=0 v54) v1 ==== 133+0+0 (secure 0 0 0) 0x7feed40ee810 con 0x7feee40d2300 2023-07-21T22:39:17.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.651+0000 7feee9419640 1 -- 172.21.15.6:0/891673571 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7feec40663f0 msgr2=0x7feec40688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:39:17.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.651+0000 7feee9419640 1 --2- 172.21.15.6:0/891673571 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7feec40663f0 0x7feec40688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.651+0000 7feee9419640 1 -- 172.21.15.6:0/891673571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee40d2300 msgr2=0x7feee415dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:17.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.651+0000 7feee9419640 1 --2- 172.21.15.6:0/891673571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee40d2300 0x7feee415dee0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7feed401a130 tx=0x7feed40192a0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.651+0000 7feee9419640 1 -- 172.21.15.6:0/891673571 shutdown_connections 2023-07-21T22:39:17.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.651+0000 7feee9419640 1 --2- 172.21.15.6:0/891673571 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7feec40663f0 0x7feec40688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.651+0000 7feee9419640 1 --2- 172.21.15.6:0/891673571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feee415bde0 0x7feee414e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.651+0000 7feee9419640 1 --2- 172.21.15.6:0/891673571 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7feee40d2fc0 0x7feee41552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.651+0000 7feee9419640 1 --2- 172.21.15.6:0/891673571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feee40d2300 0x7feee415dee0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.651+0000 7feee9419640 1 -- 172.21.15.6:0/891673571 >> 172.21.15.6:0/891673571 conn(0x7feee40659d0 msgr2=0x7feee40cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:17.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.651+0000 7feee9419640 1 -- 172.21.15.6:0/891673571 shutdown_connections 2023-07-21T22:39:17.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.651+0000 7feee9419640 1 -- 172.21.15.6:0/891673571 wait complete. 2023-07-21T22:39:17.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:39:17.717 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-21T22:39:17.719 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:17.678+0000 7fd5f1bff180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:39:17.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:39:17.733 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/test_restart) 2023-07-21T22:39:17.768 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:17.723+0000 7fe6d824b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:39:17.778 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/test_restart 1M 2023-07-21T22:39:17.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.927+0000 7fb77e231640 1 Processor -- start 2023-07-21T22:39:17.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.927+0000 7fb77e231640 1 -- start start 2023-07-21T22:39:17.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.927+0000 7fb77e231640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb7780cebd0 0x7fb7780cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:17.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.927+0000 7fb77e231640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb7780b5010 0x7fb7780cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:17.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.927+0000 7fb77e231640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77815bfa0 con 0x7fb7780cfd90 2023-07-21T22:39:17.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.927+0000 7fb77e231640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7780ccdf0 con 0x7fb7780cebd0 2023-07-21T22:39:17.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.927+0000 7fb77e231640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7780cd0d0 con 0x7fb7780b5010 2023-07-21T22:39:17.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.927+0000 7fb77ca2e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb7780cebd0 0x7fb7780cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:17.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.927+0000 7fb77ca2e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb7780cebd0 0x7fb7780cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46694/0 (socket says 172.21.15.6:46694) 2023-07-21T22:39:17.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.927+0000 7fb77ca2e640 1 -- 172.21.15.6:0/3902656502 learned_addr learned my addr 172.21.15.6:0/3902656502 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:17.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.927+0000 7fb77da30640 1 --2- 172.21.15.6:0/3902656502 >> v2:172.21.15.161:3300/0 conn(0x7fb7780b5010 0x7fb7780cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.927+0000 7fb76ffff640 1 -- 172.21.15.6:0/3902656502 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146038507 0 0) 0x7fb774001170 con 0x7fb7780cfd90 2023-07-21T22:39:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.927+0000 7fb76ffff640 1 -- 172.21.15.6:0/3902656502 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb764003530 con 0x7fb7780cfd90 2023-07-21T22:39:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.927+0000 7fb77ca2e640 1 -- 172.21.15.6:0/3902656502 >> v2:172.21.15.161:3300/0 conn(0x7fb7780b5010 msgr2=0x7fb7780cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:17.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.927+0000 7fb77ca2e640 1 --2- 172.21.15.6:0/3902656502 >> v2:172.21.15.161:3300/0 conn(0x7fb7780b5010 0x7fb7780cde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.927+0000 7fb77ca2e640 1 -- 172.21.15.6:0/3902656502 >> v1:172.21.15.161:6789/0 conn(0x7fb7780cfd90 legacy=0x7fb7780d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:17.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.927+0000 7fb77ca2e640 1 -- 172.21.15.6:0/3902656502 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7780cd3b0 con 0x7fb7780cebd0 2023-07-21T22:39:17.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.931+0000 7fb77ca2e640 1 --2- 172.21.15.6:0/3902656502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7780cebd0 0x7fb7780cc810 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fb778071ac0 tx=0x7fb76801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557488fed5cb74f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:17.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.931+0000 7fb76ffff640 1 -- 172.21.15.6:0/3902656502 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7680aa430 con 0x7fb7780cebd0 2023-07-21T22:39:17.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.931+0000 7fb76ffff640 1 -- 172.21.15.6:0/3902656502 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7680aa590 con 0x7fb7780cebd0 2023-07-21T22:39:17.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.931+0000 7fb76ffff640 1 -- 172.21.15.6:0/3902656502 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7680aa920 con 0x7fb7780cebd0 2023-07-21T22:39:17.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.931+0000 7fb77e231640 1 -- 172.21.15.6:0/3902656502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7780cebd0 msgr2=0x7fb7780cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:17.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.931+0000 7fb77e231640 1 --2- 172.21.15.6:0/3902656502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7780cebd0 0x7fb7780cc810 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fb778071ac0 tx=0x7fb76801c4d0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.931+0000 7fb77e231640 1 -- 172.21.15.6:0/3902656502 shutdown_connections 2023-07-21T22:39:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.931+0000 7fb77e231640 1 --2- 172.21.15.6:0/3902656502 >> v2:172.21.15.161:3300/0 conn(0x7fb7780b5010 0x7fb7780cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.931+0000 7fb77e231640 1 --2- 172.21.15.6:0/3902656502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7780cebd0 0x7fb7780cc810 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.931+0000 7fb77e231640 1 -- 172.21.15.6:0/3902656502 >> 172.21.15.6:0/3902656502 conn(0x7fb77809b490 msgr2=0x7fb7780d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.931+0000 7fb77e231640 1 -- 172.21.15.6:0/3902656502 shutdown_connections 2023-07-21T22:39:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.931+0000 7fb77e231640 1 -- 172.21.15.6:0/3902656502 wait complete. 2023-07-21T22:39:17.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.935+0000 7fb77e231640 1 Processor -- start 2023-07-21T22:39:17.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.935+0000 7fb77e231640 1 -- start start 2023-07-21T22:39:17.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.935+0000 7fb77e231640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7780b5010 0x7fb77814dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:17.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.935+0000 7fb77e231640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7780cebd0 0x7fb778151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:17.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.935+0000 7fb77e231640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7780cfd90 0x7fb77814c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:17.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.935+0000 7fb77e231640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77815ca70 con 0x7fb7780cebd0 2023-07-21T22:39:17.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.935+0000 7fb77e231640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7781542d0 con 0x7fb7780cfd90 2023-07-21T22:39:17.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.935+0000 7fb77e231640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb778152290 con 0x7fb7780b5010 2023-07-21T22:39:17.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.935+0000 7fb77ca2e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7780cebd0 0x7fb778151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:17.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.935+0000 7fb77ca2e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7780cebd0 0x7fb778151c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46706/0 (socket says 172.21.15.6:46706) 2023-07-21T22:39:17.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.935+0000 7fb77ca2e640 1 -- 172.21.15.6:0/3313540373 learned_addr learned my addr 172.21.15.6:0/3313540373 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:17.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.935+0000 7fb77da30640 1 --2- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7780cfd90 0x7fb77814c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:17.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.935+0000 7fb77d22f640 1 --2- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7780b5010 0x7fb77814dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:17.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.935+0000 7fb77ca2e640 1 -- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7780b5010 msgr2=0x7fb77814dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:17.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.935+0000 7fb77ca2e640 1 --2- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb7780b5010 0x7fb77814dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.935+0000 7fb77ca2e640 1 -- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7780cfd90 msgr2=0x7fb77814c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:17.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.935+0000 7fb77ca2e640 1 --2- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb7780cfd90 0x7fb77814c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:17.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.935+0000 7fb77ca2e640 1 -- 172.21.15.6:0/3313540373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7680094d0 con 0x7fb7780cebd0 2023-07-21T22:39:17.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.935+0000 7fb77ca2e640 1 --2- 172.21.15.6:0/3313540373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7780cebd0 0x7fb778151c00 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fb7680ac040 tx=0x7fb76801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:17.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.939+0000 7fb76dffb640 1 -- 172.21.15.6:0/3313540373 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7680aa430 con 0x7fb7780cebd0 2023-07-21T22:39:17.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.939+0000 7fb76dffb640 1 -- 172.21.15.6:0/3313540373 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7680b3800 con 0x7fb7780cebd0 2023-07-21T22:39:17.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.939+0000 7fb77e231640 1 -- 172.21.15.6:0/3313540373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77815c140 con 0x7fb7780cebd0 2023-07-21T22:39:17.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.939+0000 7fb76dffb640 1 -- 172.21.15.6:0/3313540373 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7680b3bb0 con 0x7fb7780cebd0 2023-07-21T22:39:17.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.939+0000 7fb77e231640 1 -- 172.21.15.6:0/3313540373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77815c700 con 0x7fb7780cebd0 2023-07-21T22:39:17.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.939+0000 7fb77e231640 1 -- 172.21.15.6:0/3313540373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77804e020 con 0x7fb7780cebd0 2023-07-21T22:39:17.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.939+0000 7fb76dffb640 1 -- 172.21.15.6:0/3313540373 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 67) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fb7680b3d10 con 0x7fb7780cebd0 2023-07-21T22:39:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.939+0000 7fb76dffb640 1 --2- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fb75c0663f0 0x7fb75c0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.939+0000 7fb76dffb640 1 -- 172.21.15.6:0/3313540373 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fb76811e840 con 0x7fb7780cebd0 2023-07-21T22:39:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.939+0000 7fb77d22f640 1 -- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fb75c0663f0 msgr2=0x7fb75c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2692111396 2023-07-21T22:39:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.939+0000 7fb77d22f640 1 --2- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fb75c0663f0 0x7fb75c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:39:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:17.947+0000 7fb76dffb640 1 -- 172.21.15.6:0/3313540373 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb7680eb9d0 con 0x7fb7780cebd0 2023-07-21T22:39:18.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:18.123+0000 7fb77e231640 1 -- 172.21.15.6:0/3313540373 --> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7780ce7e0 con 0x7fb75c0663f0 2023-07-21T22:39:18.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:18.143+0000 7fb77d22f640 1 -- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fb75c0663f0 msgr2=0x7fb75c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2692111396 2023-07-21T22:39:18.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:18.143+0000 7fb77d22f640 1 --2- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fb75c0663f0 0x7fb75c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:39:18.203 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:18.162+0000 7fd5f1bff180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:39:18.261 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:18.222+0000 7fd5f1bff180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:39:18.283 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:18.239+0000 7fe6d824b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:39:18.317 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:18.278+0000 7fd5f1bff180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:39:18.345 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:18.299+0000 7fe6d824b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:39:18.403 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:18.362+0000 7fd5f1bff180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:39:18.404 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:18.359+0000 7fe6d824b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:39:18.461 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:18.422+0000 7fd5f1bff180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:39:18.496 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:18.451+0000 7fe6d824b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:39:18.544 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:18.506+0000 7fd5f1bff180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:39:18.555 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:18.511+0000 7fe6d824b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:39:18.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:18.547+0000 7fb77d22f640 1 -- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fb75c0663f0 msgr2=0x7fb75c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2692111396 2023-07-21T22:39:18.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:18.547+0000 7fb77d22f640 1 --2- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fb75c0663f0 0x7fb75c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-21T22:39:18.601 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:18.562+0000 7fd5f1bff180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:39:18.644 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:18.599+0000 7fe6d824b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:39:18.703 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:18.659+0000 7fe6d824b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:39:18.743 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:18.702+0000 7fd5f1bff180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:39:18.800 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:18.758+0000 7fd5f1bff180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:39:18.853 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:18.807+0000 7fe6d824b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:39:18.914 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:18.867+0000 7fe6d824b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:39:19.040 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:39:19.041 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:39:19.041 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:39:19.049 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:19.010+0000 7fd5f1bff180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:39:19.165 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:39:19.165 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:39:19.166 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:39:19.174 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:19.127+0000 7fe6d824b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:39:19.185 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:19.146+0000 7fd5f1bff180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:39:19.309 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:19.270+0000 7fd5f1bff180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:39:19.314 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:19.267+0000 7fe6d824b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:39:19.380 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:19.338+0000 7fd5f1bff180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:39:19.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:19.351+0000 7fb77d22f640 1 -- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fb75c0663f0 msgr2=0x7fb75c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2692111396 2023-07-21T22:39:19.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:19.351+0000 7fb77d22f640 1 --2- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fb75c0663f0 0x7fb75c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-21T22:39:19.445 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:19.399+0000 7fe6d824b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:39:19.514 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:19.474+0000 7fd5f1bff180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:39:19.518 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:19.475+0000 7fe6d824b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:39:19.659 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:19.615+0000 7fe6d824b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:39:20.051 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:20.010+0000 7fd5f1bff180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:39:20.140 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:20.098+0000 7fd5f1bff180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:39:20.229 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:20.183+0000 7fe6d824b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:39:20.287 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:20.246+0000 7fd5f1bff180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:39:20.317 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:20.271+0000 7fe6d824b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:39:20.371 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:20.330+0000 7fd5f1bff180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:39:20.471 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:20.427+0000 7fe6d824b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:39:20.558 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:20.511+0000 7fe6d824b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:39:20.639 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:20.598+0000 7fd5f1bff180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:39:20.699 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:20.658+0000 7fd5f1bff180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:39:20.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:20.667+0000 7fb76dffb640 1 -- 172.21.15.6:0/3313540373 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 68) v1 ==== 85386+0+0 (secure 0 0 0) 0x7fb7680ebda0 con 0x7fb7780cebd0 2023-07-21T22:39:20.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:20.667+0000 7fb76dffb640 1 -- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fb75c0663f0 msgr2=0x7fb75c0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:39:20.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:20.667+0000 7fb76dffb640 1 --2- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:6832/2692111396,v1:172.21.15.161:6833/2692111396] conn(0x7fb75c0663f0 0x7fb75c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:20.843 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:20.802+0000 7fd570d5c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:39:20.843 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:20.802+0000 7fd570d5c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:39:20.843 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:20.802+0000 7fd570d5c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:39:20.843 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:20.802+0000 7fd570d5c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:39:20.844 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:20.802+0000 7fd570d5c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:39:20.844 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:20.802+0000 7fd573d62640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:39:20.844 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:20.802+0000 7fd573d62640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:39:20.845 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:20.802+0000 7fd573d62640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:39:20.845 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:20.802+0000 7fd573d62640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:39:20.845 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:39:20.802+0000 7fd573d62640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:39:20.858 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:20.815+0000 7fe6d824b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:39:20.921 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:39:20.875+0000 7fe6d824b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:39:21.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.675+0000 7fb76dffb640 1 -- 172.21.15.6:0/3313540373 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mgrmap(e 69) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fb76811cb10 con 0x7fb7780cebd0 2023-07-21T22:39:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.675+0000 7fb76dffb640 1 --2- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7fb75c034090 0x7fb75c0709b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.675+0000 7fb76dffb640 1 -- 172.21.15.6:0/3313540373 --> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb75c070ef0 con 0x7fb75c034090 2023-07-21T22:39:21.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.675+0000 7fb77d22f640 1 --2- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7fb75c034090 0x7fb75c0709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:21.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.683+0000 7fb77d22f640 1 --2- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7fb75c034090 0x7fb75c0709b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb774000fc0 tx=0x7fb774001340 comp rx=0 tx=0).ready entity=mgr.8015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:21.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.751+0000 7fb76dffb640 1 -- 172.21.15.6:0/3313540373 <== mgr.8015 v2:172.21.15.161:6832/3096900160 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fb75c070ef0 con 0x7fb75c034090 2023-07-21T22:39:21.797 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule set for path /snap_test_dir1/test_restart 2023-07-21T22:39:21.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.755+0000 7fb77e231640 1 -- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7fb75c034090 msgr2=0x7fb75c0709b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:21.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.755+0000 7fb77e231640 1 --2- 172.21.15.6:0/3313540373 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7fb75c034090 0x7fb75c0709b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb774000fc0 tx=0x7fb774001340 comp rx=0 tx=0).stop 2023-07-21T22:39:21.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.755+0000 7fb77e231640 1 -- 172.21.15.6:0/3313540373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7780cebd0 msgr2=0x7fb778151c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:21.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.755+0000 7fb77e231640 1 --2- 172.21.15.6:0/3313540373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7780cebd0 0x7fb778151c00 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fb7680ac040 tx=0x7fb76801ad10 comp rx=0 tx=0).stop 2023-07-21T22:39:21.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.755+0000 7fb77da30640 1 -- 172.21.15.6:0/3313540373 reap_dead start 2023-07-21T22:39:21.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.755+0000 7fb77e231640 1 -- 172.21.15.6:0/3313540373 shutdown_connections 2023-07-21T22:39:21.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.755+0000 7fb77e231640 1 -- 172.21.15.6:0/3313540373 >> 172.21.15.6:0/3313540373 conn(0x7fb77809b490 msgr2=0x7fb7780b5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:21.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.755+0000 7fb77e231640 1 -- 172.21.15.6:0/3313540373 shutdown_connections 2023-07-21T22:39:21.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.755+0000 7fb77e231640 1 -- 172.21.15.6:0/3313540373 wait complete. 2023-07-21T22:39:21.821 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/test_restart 2023-07-21T22:39:21.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/test_restart 1M 2023-07-21T22:39:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.927+0000 7f4e31434640 1 Processor -- start 2023-07-21T22:39:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.927+0000 7f4e31434640 1 -- start start 2023-07-21T22:39:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.931+0000 7f4e31434640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4e2c0cf2e0 0x7f4e2c0cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.931+0000 7f4e31434640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e2c0ca790 0x7f4e2c0cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.931+0000 7f4e31434640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e2c0d0920 con 0x7f4e2c06a540 2023-07-21T22:39:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.931+0000 7f4e31434640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e2c15bfd0 con 0x7f4e2c0cf2e0 2023-07-21T22:39:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.931+0000 7f4e31434640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c0cfd10 con 0x7f4e2c0ca790 2023-07-21T22:39:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.931+0000 7f4e23fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4e2c0cf2e0 0x7f4e2c0cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.931+0000 7f4e2affd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4e2c06a540 0x7f4e2c06a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:41086/0 (socket says 172.21.15.6:41086) 2023-07-21T22:39:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.931+0000 7f4e2affd640 1 -- 172.21.15.6:0/3042967633 learned_addr learned my addr 172.21.15.6:0/3042967633 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:39:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.931+0000 7f4e2b7fe640 1 --2- 172.21.15.6:0/3042967633 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e2c0ca790 0x7f4e2c0cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:21.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.931+0000 7f4e23fff640 1 -- 172.21.15.6:0/3042967633 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e2c0ca790 msgr2=0x7f4e2c0cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:21.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.931+0000 7f4e23fff640 1 --2- 172.21.15.6:0/3042967633 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e2c0ca790 0x7f4e2c0cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:21.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.931+0000 7f4e23fff640 1 -- 172.21.15.6:0/3042967633 >> v1:172.21.15.6:6789/0 conn(0x7f4e2c06a540 legacy=0x7f4e2c06a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:21.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.931+0000 7f4e23fff640 1 -- 172.21.15.6:0/3042967633 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2c0cfff0 con 0x7f4e2c0cf2e0 2023-07-21T22:39:21.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.931+0000 7f4e2a7fc640 1 -- 172.21.15.6:0/3042967633 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884219684 0 0) 0x7f4e2c0d0920 con 0x7f4e2c06a540 2023-07-21T22:39:21.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.931+0000 7f4e23fff640 1 --2- 172.21.15.6:0/3042967633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c0cf2e0 0x7f4e2c0cf710 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f4e140097c0 tx=0x7f4e1401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e780e590e0bf0cde server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:21.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.931+0000 7f4e2a7fc640 1 -- 172.21.15.6:0/3042967633 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140ab650 con 0x7f4e2c0cf2e0 2023-07-21T22:39:21.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.931+0000 7f4e2a7fc640 1 -- 172.21.15.6:0/3042967633 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e140ab7b0 con 0x7f4e2c0cf2e0 2023-07-21T22:39:21.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.931+0000 7f4e2a7fc640 1 -- 172.21.15.6:0/3042967633 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140abb40 con 0x7f4e2c0cf2e0 2023-07-21T22:39:21.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e31434640 1 -- 172.21.15.6:0/3042967633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c0cf2e0 msgr2=0x7f4e2c0cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:21.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e31434640 1 --2- 172.21.15.6:0/3042967633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c0cf2e0 0x7f4e2c0cf710 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f4e140097c0 tx=0x7f4e1401c450 comp rx=0 tx=0).stop 2023-07-21T22:39:21.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e31434640 1 -- 172.21.15.6:0/3042967633 shutdown_connections 2023-07-21T22:39:21.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e31434640 1 --2- 172.21.15.6:0/3042967633 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e2c0ca790 0x7f4e2c0cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:21.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e31434640 1 --2- 172.21.15.6:0/3042967633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c0cf2e0 0x7f4e2c0cf710 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:21.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e31434640 1 -- 172.21.15.6:0/3042967633 >> 172.21.15.6:0/3042967633 conn(0x7f4e2c099490 msgr2=0x7f4e2c089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:21.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e31434640 1 -- 172.21.15.6:0/3042967633 shutdown_connections 2023-07-21T22:39:21.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e31434640 1 -- 172.21.15.6:0/3042967633 wait complete. 2023-07-21T22:39:21.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e31434640 1 Processor -- start 2023-07-21T22:39:21.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e31434640 1 -- start start 2023-07-21T22:39:21.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e31434640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e2c06a540 0x7f4e2c1513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:21.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e31434640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c0ca790 0x7f4e2c1565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:21.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e31434640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e2c0cf2e0 0x7f4e2c156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:21.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e31434640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c157420 con 0x7f4e2c0ca790 2023-07-21T22:39:21.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e31434640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c0ade10 con 0x7f4e2c0cf2e0 2023-07-21T22:39:21.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e31434640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2c0ae0f0 con 0x7f4e2c06a540 2023-07-21T22:39:21.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e23fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c0ca790 0x7f4e2c1565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:21.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e23fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c0ca790 0x7f4e2c1565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46724/0 (socket says 172.21.15.6:46724) 2023-07-21T22:39:21.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e23fff640 1 -- 172.21.15.6:0/967149498 learned_addr learned my addr 172.21.15.6:0/967149498 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:39:21.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e2b7fe640 1 --2- 172.21.15.6:0/967149498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e2c0cf2e0 0x7f4e2c156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:21.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.935+0000 7f4e2affd640 1 --2- 172.21.15.6:0/967149498 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e2c06a540 0x7f4e2c1513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:21.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.939+0000 7f4e23fff640 1 -- 172.21.15.6:0/967149498 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e2c06a540 msgr2=0x7f4e2c1513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:21.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.939+0000 7f4e23fff640 1 --2- 172.21.15.6:0/967149498 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e2c06a540 0x7f4e2c1513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:21.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.939+0000 7f4e23fff640 1 -- 172.21.15.6:0/967149498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e2c0cf2e0 msgr2=0x7f4e2c156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:21.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.939+0000 7f4e23fff640 1 --2- 172.21.15.6:0/967149498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e2c0cf2e0 0x7f4e2c156b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:21.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.939+0000 7f4e23fff640 1 -- 172.21.15.6:0/967149498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e14009420 con 0x7f4e2c0ca790 2023-07-21T22:39:21.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.939+0000 7f4e2b7fe640 1 --2- 172.21.15.6:0/967149498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e2c0cf2e0 0x7f4e2c156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:39:21.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.939+0000 7f4e2affd640 1 --2- 172.21.15.6:0/967149498 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e2c06a540 0x7f4e2c1513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:39:21.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.939+0000 7f4e23fff640 1 --2- 172.21.15.6:0/967149498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c0ca790 0x7f4e2c1565c0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f4e140097c0 tx=0x7f4e1401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:21.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.939+0000 7f4e237fe640 1 -- 172.21.15.6:0/967149498 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14004220 con 0x7f4e2c0ca790 2023-07-21T22:39:21.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.939+0000 7f4e237fe640 1 -- 172.21.15.6:0/967149498 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e140b9070 con 0x7f4e2c0ca790 2023-07-21T22:39:21.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.939+0000 7f4e237fe640 1 -- 172.21.15.6:0/967149498 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14003620 con 0x7f4e2c0ca790 2023-07-21T22:39:21.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.939+0000 7f4e31434640 1 -- 172.21.15.6:0/967149498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2c0ae3d0 con 0x7f4e2c0ca790 2023-07-21T22:39:21.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.939+0000 7f4e31434640 1 -- 172.21.15.6:0/967149498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2c153040 con 0x7f4e2c0ca790 2023-07-21T22:39:21.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.939+0000 7f4e31434640 1 -- 172.21.15.6:0/967149498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e2c0678d0 con 0x7f4e2c0ca790 2023-07-21T22:39:21.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.939+0000 7f4e237fe640 1 -- 172.21.15.6:0/967149498 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 69) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f4e14003780 con 0x7f4e2c0ca790 2023-07-21T22:39:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.939+0000 7f4e237fe640 1 --2- 172.21.15.6:0/967149498 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7f4e0c066120 0x7f4e0c0685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.939+0000 7f4e237fe640 1 -- 172.21.15.6:0/967149498 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f4e140bb070 con 0x7f4e2c0ca790 2023-07-21T22:39:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.939+0000 7f4e2affd640 1 --2- 172.21.15.6:0/967149498 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7f4e0c066120 0x7f4e0c0685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.943+0000 7f4e2affd640 1 --2- 172.21.15.6:0/967149498 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7f4e0c066120 0x7f4e0c0685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c007fd0 tx=0x7f4e1c009040 comp rx=0 tx=0).ready entity=mgr.8015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:21.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:21.943+0000 7f4e237fe640 1 -- 172.21.15.6:0/967149498 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4e140ebd20 con 0x7f4e2c0ca790 2023-07-21T22:39:22.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:22.123+0000 7f4e31434640 1 -- 172.21.15.6:0/967149498 --> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e2c0cee70 con 0x7f4e0c066120 2023-07-21T22:39:22.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:22.171+0000 7f4e237fe640 1 -- 172.21.15.6:0/967149498 <== mgr.8015 v2:172.21.15.161:6832/3096900160 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+57 (secure 0 0 0) 0x7f4e1c001300 con 0x7f4e0c066120 2023-07-21T22:39:22.217 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule activated for path /snap_test_dir1/test_restart 2023-07-21T22:39:22.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:22.175+0000 7f4e31434640 1 -- 172.21.15.6:0/967149498 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7f4e0c066120 msgr2=0x7f4e0c0685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:22.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:22.175+0000 7f4e31434640 1 --2- 172.21.15.6:0/967149498 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7f4e0c066120 0x7f4e0c0685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c007fd0 tx=0x7f4e1c009040 comp rx=0 tx=0).stop 2023-07-21T22:39:22.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:22.175+0000 7f4e31434640 1 -- 172.21.15.6:0/967149498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c0ca790 msgr2=0x7f4e2c1565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:22.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:22.175+0000 7f4e31434640 1 --2- 172.21.15.6:0/967149498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c0ca790 0x7f4e2c1565c0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f4e140097c0 tx=0x7f4e1401ac90 comp rx=0 tx=0).stop 2023-07-21T22:39:22.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:22.175+0000 7f4e31434640 1 -- 172.21.15.6:0/967149498 shutdown_connections 2023-07-21T22:39:22.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:22.175+0000 7f4e31434640 1 --2- 172.21.15.6:0/967149498 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7f4e0c066120 0x7f4e0c0685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:22.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:22.175+0000 7f4e31434640 1 --2- 172.21.15.6:0/967149498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e2c0cf2e0 0x7f4e2c156b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:22.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:22.175+0000 7f4e31434640 1 --2- 172.21.15.6:0/967149498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e2c0ca790 0x7f4e2c1565c0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:22.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:22.175+0000 7f4e31434640 1 --2- 172.21.15.6:0/967149498 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4e2c06a540 0x7f4e2c1513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:22.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:22.175+0000 7f4e31434640 1 -- 172.21.15.6:0/967149498 >> 172.21.15.6:0/967149498 conn(0x7f4e2c099490 msgr2=0x7f4e2c06a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:22.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:22.175+0000 7f4e31434640 1 -- 172.21.15.6:0/967149498 shutdown_connections 2023-07-21T22:39:22.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:39:22.175+0000 7f4e31434640 1 -- 172.21.15.6:0/967149498 wait complete. 2023-07-21T22:39:22.239 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/test_restart 2023-07-21T22:39:44.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:39:44.264 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:40:00.228 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:40:00.189+0000 7fd562d40640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:40:00.229 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:40:00.189+0000 7fd562d40640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:40:00.229 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:40:00.189+0000 7fd562d40640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:40:00.229 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:40:00.189+0000 7fd562d40640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:40:00.229 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:40:00.189+0000 7fd562d40640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:40:14.321 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:40:14.325 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:40:44.385 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:40:44.389 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:41:14.448 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:41:14.452 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:41:44.544 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:41:44.548 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:42:14.753 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:42:14.757 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:42:44.838 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:42:44.842 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:43:15.210 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:43:15.214 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:43:45.281 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:43:45.285 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:44:15.344 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:44:15.348 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:44:45.407 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:44:45.412 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:45:15.524 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:45:15.528 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:45:45.589 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:45:45.593 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:46:15.654 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:46:15.658 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:46:45.726 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:46:45.730 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:47:15.790 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:47:15.794 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:47:45.879 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:47:45.883 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:48:16.142 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:48:16.146 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:48:46.213 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:48:46.218 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:49:16.569 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:49:16.573 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:49:46.724 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:49:46.728 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:50:16.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:50:16.241 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-07-21T22:50:16.254 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_40_00_UTC 2023-07-21T22:50:16.254 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_41_00_UTC 2023-07-21T22:50:16.254 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_42_00_UTC 2023-07-21T22:50:16.255 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_43_00_UTC 2023-07-21T22:50:16.255 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_44_00_UTC 2023-07-21T22:50:16.255 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_45_00_UTC 2023-07-21T22:50:16.255 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_46_00_UTC 2023-07-21T22:50:16.255 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_47_00_UTC 2023-07-21T22:50:16.255 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_48_00_UTC 2023-07-21T22:50:16.256 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_49_00_UTC 2023-07-21T22:50:16.256 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_50_00_UTC 2023-07-21T22:50:16.256 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-21-22_40_00_UTC', 'scheduled-2023-07-21-22_41_00_UTC', 'scheduled-2023-07-21-22_42_00_UTC', 'scheduled-2023-07-21-22_43_00_UTC', 'scheduled-2023-07-21-22_44_00_UTC', 'scheduled-2023-07-21-22_45_00_UTC', 'scheduled-2023-07-21-22_46_00_UTC', 'scheduled-2023-07-21-22_47_00_UTC', 'scheduled-2023-07-21-22_48_00_UTC', 'scheduled-2023-07-21-22_49_00_UTC', 'scheduled-2023-07-21-22_50_00_UTC'] 2023-07-21T22:50:16.257 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-07-21T22:50:16.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.425+0000 7fd448bc5640 1 Processor -- start 2023-07-21T22:50:16.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.425+0000 7fd448bc5640 1 -- start start 2023-07-21T22:50:16.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.425+0000 7fd448bc5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd4440aeb40 0x7fd44415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:16.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.425+0000 7fd448bc5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4440aef10 0x7fd444158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:16.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.425+0000 7fd448bc5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4441532b0 con 0x7fd444159270 2023-07-21T22:50:16.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.425+0000 7fd448bc5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4440ca6f0 con 0x7fd4440aeb40 2023-07-21T22:50:16.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.425+0000 7fd448bc5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4441599d0 con 0x7fd4440aef10 2023-07-21T22:50:16.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.425+0000 7fd442d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd444159270 0x7fd4440c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37968/0 (socket says 172.21.15.6:37968) 2023-07-21T22:50:16.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.425+0000 7fd442d9d640 1 -- 172.21.15.6:0/1094787208 learned_addr learned my addr 172.21.15.6:0/1094787208 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:50:16.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd44259c640 1 --2- 172.21.15.6:0/1094787208 >> v2:172.21.15.161:3300/0 conn(0x7fd4440aeb40 0x7fd44415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:16.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd43bfff640 1 --2- 172.21.15.6:0/1094787208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4440aef10 0x7fd444158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:16.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd441d9b640 1 -- 172.21.15.6:0/1094787208 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 427972161 0 0) 0x7fd4441532b0 con 0x7fd444159270 2023-07-21T22:50:16.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd441d9b640 1 -- 172.21.15.6:0/1094787208 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd430003530 con 0x7fd444159270 2023-07-21T22:50:16.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd441d9b640 1 -- 172.21.15.6:0/1094787208 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 187579487 0 0) 0x7fd430003530 con 0x7fd444159270 2023-07-21T22:50:16.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd441d9b640 1 -- 172.21.15.6:0/1094787208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4440aef10 msgr2=0x7fd444158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:16.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd441d9b640 1 --2- 172.21.15.6:0/1094787208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4440aef10 0x7fd444158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:16.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd441d9b640 1 -- 172.21.15.6:0/1094787208 >> v2:172.21.15.161:3300/0 conn(0x7fd4440aeb40 msgr2=0x7fd44415cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:16.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd441d9b640 1 --2- 172.21.15.6:0/1094787208 >> v2:172.21.15.161:3300/0 conn(0x7fd4440aeb40 0x7fd44415cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:16.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd441d9b640 1 -- 172.21.15.6:0/1094787208 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd444159cb0 con 0x7fd444159270 2023-07-21T22:50:16.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd441d9b640 1 -- 172.21.15.6:0/1094787208 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fd43c001a00 con 0x7fd444159270 2023-07-21T22:50:16.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd441d9b640 1 -- 172.21.15.6:0/1094787208 >> v1:172.21.15.6:6789/0 conn(0x7fd444159270 legacy=0x7fd4440c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:16.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd441d9b640 1 --2- 172.21.15.6:0/1094787208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd430003980 0x7fd430003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:16.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd441d9b640 1 --2- 172.21.15.6:0/1094787208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4440aef10 0x7fd4300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:16.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd441d9b640 1 --2- 172.21.15.6:0/1094787208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd430004d10 0x7fd430005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:16.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd441d9b640 1 -- 172.21.15.6:0/1094787208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4440ca6f0 con 0x7fd430003980 2023-07-21T22:50:16.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd441d9b640 1 -- 172.21.15.6:0/1094787208 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4441599d0 con 0x7fd430004d10 2023-07-21T22:50:16.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd441d9b640 1 -- 172.21.15.6:0/1094787208 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43000dba0 con 0x7fd4440aef10 2023-07-21T22:50:16.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd44259c640 1 --2- 172.21.15.6:0/1094787208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd430003980 0x7fd430003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:16.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd43bfff640 1 --2- 172.21.15.6:0/1094787208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4440aef10 0x7fd4300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:16.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd442d9d640 1 --2- 172.21.15.6:0/1094787208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd430004d10 0x7fd430005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:16.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd44259c640 1 -- 172.21.15.6:0/1094787208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4440aef10 msgr2=0x7fd4300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:16.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd44259c640 1 --2- 172.21.15.6:0/1094787208 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4440aef10 0x7fd4300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:16.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd44259c640 1 -- 172.21.15.6:0/1094787208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd430004d10 msgr2=0x7fd430005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:16.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd44259c640 1 --2- 172.21.15.6:0/1094787208 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd430004d10 0x7fd430005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:16.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.429+0000 7fd44259c640 1 -- 172.21.15.6:0/1094787208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd430003530 con 0x7fd430003980 2023-07-21T22:50:16.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.433+0000 7fd44259c640 1 --2- 172.21.15.6:0/1094787208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd430003980 0x7fd430003d90 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fd434009ae0 tx=0x7fd43401ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffcd1c97e701964 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:16.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.433+0000 7fd441d9b640 1 -- 172.21.15.6:0/1094787208 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4340a5540 con 0x7fd430003980 2023-07-21T22:50:16.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.433+0000 7fd441d9b640 1 -- 172.21.15.6:0/1094787208 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4340a56a0 con 0x7fd430003980 2023-07-21T22:50:16.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.433+0000 7fd441d9b640 1 -- 172.21.15.6:0/1094787208 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4340a5a50 con 0x7fd430003980 2023-07-21T22:50:16.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.433+0000 7fd448bc5640 1 -- 172.21.15.6:0/1094787208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd430003980 msgr2=0x7fd430003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:16.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.433+0000 7fd448bc5640 1 --2- 172.21.15.6:0/1094787208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd430003980 0x7fd430003d90 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fd434009ae0 tx=0x7fd43401ca60 comp rx=0 tx=0).stop 2023-07-21T22:50:16.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.433+0000 7fd442d9d640 1 -- 172.21.15.6:0/1094787208 reap_dead start 2023-07-21T22:50:16.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.433+0000 7fd448bc5640 1 -- 172.21.15.6:0/1094787208 shutdown_connections 2023-07-21T22:50:16.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.433+0000 7fd448bc5640 1 -- 172.21.15.6:0/1094787208 >> 172.21.15.6:0/1094787208 conn(0x7fd4440cde90 msgr2=0x7fd4440ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:16.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.433+0000 7fd448bc5640 1 -- 172.21.15.6:0/1094787208 shutdown_connections 2023-07-21T22:50:16.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.433+0000 7fd448bc5640 1 -- 172.21.15.6:0/1094787208 wait complete. 2023-07-21T22:50:16.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.433+0000 7fd448bc5640 1 Processor -- start 2023-07-21T22:50:16.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.433+0000 7fd448bc5640 1 -- start start 2023-07-21T22:50:16.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd448bc5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd430003980 0x7fd4441f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd448bc5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4440ae5b0 0x7fd44415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd448bc5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4441f4510 0x7fd444157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd448bc5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4440700b0 con 0x7fd430003980 2023-07-21T22:50:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd448bc5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd444070300 con 0x7fd4441f4510 2023-07-21T22:50:16.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd448bc5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4440705e0 con 0x7fd4440ae5b0 2023-07-21T22:50:16.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd44259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd430003980 0x7fd4441f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:16.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd44259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd430003980 0x7fd4441f4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53800/0 (socket says 172.21.15.6:53800) 2023-07-21T22:50:16.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd44259c640 1 -- 172.21.15.6:0/2217640897 learned_addr learned my addr 172.21.15.6:0/2217640897 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:50:16.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd43bfff640 1 --2- 172.21.15.6:0/2217640897 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4440ae5b0 0x7fd44415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:16.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd442d9d640 1 --2- 172.21.15.6:0/2217640897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4441f4510 0x7fd444157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:16.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd44259c640 1 -- 172.21.15.6:0/2217640897 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4440ae5b0 msgr2=0x7fd44415d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:16.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd44259c640 1 --2- 172.21.15.6:0/2217640897 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4440ae5b0 0x7fd44415d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:16.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd44259c640 1 -- 172.21.15.6:0/2217640897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4441f4510 msgr2=0x7fd444157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:16.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd44259c640 1 --2- 172.21.15.6:0/2217640897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4441f4510 0x7fd444157b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:16.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd44259c640 1 -- 172.21.15.6:0/2217640897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4440708c0 con 0x7fd430003980 2023-07-21T22:50:16.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd44259c640 1 --2- 172.21.15.6:0/2217640897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd430003980 0x7fd4441f4e20 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fd434009ae0 tx=0x7fd430005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:16.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd43affd640 1 -- 172.21.15.6:0/2217640897 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4340be070 con 0x7fd430003980 2023-07-21T22:50:16.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd43affd640 1 -- 172.21.15.6:0/2217640897 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4340a5e90 con 0x7fd430003980 2023-07-21T22:50:16.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd43affd640 1 -- 172.21.15.6:0/2217640897 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4340a5540 con 0x7fd430003980 2023-07-21T22:50:16.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd448bc5640 1 -- 172.21.15.6:0/2217640897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd444070ba0 con 0x7fd430003980 2023-07-21T22:50:16.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd448bc5640 1 -- 172.21.15.6:0/2217640897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44415da00 con 0x7fd430003980 2023-07-21T22:50:16.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd448bc5640 1 -- 172.21.15.6:0/2217640897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4440678d0 con 0x7fd430003980 2023-07-21T22:50:16.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.437+0000 7fd43affd640 1 -- 172.21.15.6:0/2217640897 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 72) v1 ==== 85789+0+0 (secure 0 0 0) 0x7fd4340b4040 con 0x7fd430003980 2023-07-21T22:50:16.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.441+0000 7fd43affd640 1 --2- 172.21.15.6:0/2217640897 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7fd4240663f0 0x7fd4240688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:16.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.441+0000 7fd43affd640 1 -- 172.21.15.6:0/2217640897 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fd43411d7f0 con 0x7fd430003980 2023-07-21T22:50:16.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.441+0000 7fd43bfff640 1 --2- 172.21.15.6:0/2217640897 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7fd4240663f0 0x7fd4240688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:16.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.441+0000 7fd43bfff640 1 --2- 172.21.15.6:0/2217640897 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7fd4240663f0 0x7fd4240688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd444152a80 tx=0x7fd42c009190 comp rx=0 tx=0).ready entity=mgr.8015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:16.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.445+0000 7fd43affd640 1 -- 172.21.15.6:0/2217640897 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd4340eaa70 con 0x7fd430003980 2023-07-21T22:50:16.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.621+0000 7fd448bc5640 1 -- 172.21.15.6:0/2217640897 --> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd44415dbf0 con 0x7fd4240663f0 2023-07-21T22:50:16.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.629+0000 7fd43affd640 1 -- 172.21.15.6:0/2217640897 <== mgr.8015 v2:172.21.15.161:6832/3096900160 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fd42c019070 con 0x7fd4240663f0 2023-07-21T22:50:16.667 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:50:16.667 INFO:teuthology.orchestra.run.smithi006.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:39:21", "first": "2023-07-21T22:40:00", "last": "2023-07-21T22:50:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-07-21T22:50:16.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.633+0000 7fd448bc5640 1 -- 172.21.15.6:0/2217640897 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7fd4240663f0 msgr2=0x7fd4240688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:16.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.633+0000 7fd448bc5640 1 --2- 172.21.15.6:0/2217640897 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7fd4240663f0 0x7fd4240688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd444152a80 tx=0x7fd42c009190 comp rx=0 tx=0).stop 2023-07-21T22:50:16.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.633+0000 7fd448bc5640 1 -- 172.21.15.6:0/2217640897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd430003980 msgr2=0x7fd4441f4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:16.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.633+0000 7fd448bc5640 1 --2- 172.21.15.6:0/2217640897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd430003980 0x7fd4441f4e20 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fd434009ae0 tx=0x7fd430005800 comp rx=0 tx=0).stop 2023-07-21T22:50:16.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.633+0000 7fd448bc5640 1 -- 172.21.15.6:0/2217640897 shutdown_connections 2023-07-21T22:50:16.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.633+0000 7fd448bc5640 1 --2- 172.21.15.6:0/2217640897 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7fd4240663f0 0x7fd4240688a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:16.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.633+0000 7fd448bc5640 1 --2- 172.21.15.6:0/2217640897 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4441f4510 0x7fd444157b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:16.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.633+0000 7fd448bc5640 1 --2- 172.21.15.6:0/2217640897 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd4440ae5b0 0x7fd44415d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:16.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.633+0000 7fd448bc5640 1 --2- 172.21.15.6:0/2217640897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd430003980 0x7fd4441f4e20 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:16.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.633+0000 7fd448bc5640 1 -- 172.21.15.6:0/2217640897 >> 172.21.15.6:0/2217640897 conn(0x7fd4440cde90 msgr2=0x7fd444159ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:16.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.633+0000 7fd448bc5640 1 -- 172.21.15.6:0/2217640897 shutdown_connections 2023-07-21T22:50:16.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.633+0000 7fd448bc5640 1 -- 172.21.15.6:0/2217640897 wait complete. 2023-07-21T22:50:16.688 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:39:21", "first": "2023-07-21T22:40:00", "last": "2023-07-21T22:50:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-07-21T22:50:16.689 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-07-21T00:00:00', 'created': '2023-07-21T22:39:21', 'first': '2023-07-21T22:40:00', 'last': '2023-07-21T22:50:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': True} 2023-07-21T22:50:16.690 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-21T22:50:16.803 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:50:16.807 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:50:16.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15f239d640 1 Processor -- start 2023-07-21T22:50:16.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15f239d640 1 -- start start 2023-07-21T22:50:16.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15f239d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f15ec15fd60 0x7f15ec0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:16.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15f239d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15ec0d1850 0x7f15ec0d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:16.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15f239d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ec0ccaf0 con 0x7f15ec0b7c70 2023-07-21T22:50:16.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15f239d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ec0d1190 con 0x7f15ec15fd60 2023-07-21T22:50:16.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15f239d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec160600 con 0x7f15ec0d1850 2023-07-21T22:50:16.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15ebfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f15ec0b7c70 0x7f15ec15f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:37980/0 (socket says 172.21.15.6:37980) 2023-07-21T22:50:16.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15ebfff640 1 -- 172.21.15.6:0/2250744387 learned_addr learned my addr 172.21.15.6:0/2250744387 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:50:16.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15f093a640 1 --2- 172.21.15.6:0/2250744387 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15ec0d1850 0x7f15ec0d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:16.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15eb7fe640 1 --2- 172.21.15.6:0/2250744387 >> v2:172.21.15.161:3300/0 conn(0x7f15ec15fd60 0x7f15ec0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15eaffd640 1 -- 172.21.15.6:0/2250744387 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704695845 0 0) 0x7f15ec0ccaf0 con 0x7f15ec0b7c70 2023-07-21T22:50:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15eaffd640 1 -- 172.21.15.6:0/2250744387 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15d4003530 con 0x7f15ec0b7c70 2023-07-21T22:50:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15eaffd640 1 -- 172.21.15.6:0/2250744387 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1068863690 0 0) 0x7f15d4003530 con 0x7f15ec0b7c70 2023-07-21T22:50:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15eaffd640 1 -- 172.21.15.6:0/2250744387 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15ec0d1850 msgr2=0x7f15ec0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15eaffd640 1 --2- 172.21.15.6:0/2250744387 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15ec0d1850 0x7f15ec0d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15eaffd640 1 -- 172.21.15.6:0/2250744387 >> v2:172.21.15.161:3300/0 conn(0x7f15ec15fd60 msgr2=0x7f15ec0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15eaffd640 1 --2- 172.21.15.6:0/2250744387 >> v2:172.21.15.161:3300/0 conn(0x7f15ec15fd60 0x7f15ec0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15eaffd640 1 -- 172.21.15.6:0/2250744387 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ec160320 con 0x7f15ec0b7c70 2023-07-21T22:50:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15eaffd640 1 -- 172.21.15.6:0/2250744387 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f15dc001680 con 0x7f15ec0b7c70 2023-07-21T22:50:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15eaffd640 1 -- 172.21.15.6:0/2250744387 >> v1:172.21.15.6:6789/0 conn(0x7f15ec0b7c70 legacy=0x7f15ec15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15eaffd640 1 --2- 172.21.15.6:0/2250744387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15d4003980 0x7f15d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15eaffd640 1 --2- 172.21.15.6:0/2250744387 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15d40043b0 0x7f15d4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15eaffd640 1 --2- 172.21.15.6:0/2250744387 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15ec0d1850 0x7f15d4004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15eaffd640 1 -- 172.21.15.6:0/2250744387 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec160600 con 0x7f15d4003980 2023-07-21T22:50:16.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15eaffd640 1 -- 172.21.15.6:0/2250744387 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d400b990 con 0x7f15d40043b0 2023-07-21T22:50:16.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15eaffd640 1 -- 172.21.15.6:0/2250744387 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d400bad0 con 0x7f15ec0d1850 2023-07-21T22:50:16.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15ebfff640 1 --2- 172.21.15.6:0/2250744387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15d4003980 0x7f15d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:16.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15eb7fe640 1 --2- 172.21.15.6:0/2250744387 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15d40043b0 0x7f15d4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:16.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15f093a640 1 --2- 172.21.15.6:0/2250744387 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15ec0d1850 0x7f15d4004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:16.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15ebfff640 1 -- 172.21.15.6:0/2250744387 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15ec0d1850 msgr2=0x7f15d4004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:16.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15ebfff640 1 --2- 172.21.15.6:0/2250744387 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15ec0d1850 0x7f15d4004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:16.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15ebfff640 1 -- 172.21.15.6:0/2250744387 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15d40043b0 msgr2=0x7f15d4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:16.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15ebfff640 1 --2- 172.21.15.6:0/2250744387 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15d40043b0 0x7f15d4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:16.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15ebfff640 1 -- 172.21.15.6:0/2250744387 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d4003530 con 0x7f15d4003980 2023-07-21T22:50:16.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15f093a640 1 --2- 172.21.15.6:0/2250744387 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15ec0d1850 0x7f15d4004f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:50:16.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.801+0000 7f15eb7fe640 1 --2- 172.21.15.6:0/2250744387 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15d40043b0 0x7f15d4004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:50:16.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.805+0000 7f15ebfff640 1 --2- 172.21.15.6:0/2250744387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15d4003980 0x7f15d4003d90 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f15dc00c290 tx=0x7f15dc01ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e8ba778eb268af server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:16.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.805+0000 7f15eaffd640 1 -- 172.21.15.6:0/2250744387 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc0a5920 con 0x7f15d4003980 2023-07-21T22:50:16.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.805+0000 7f15eaffd640 1 -- 172.21.15.6:0/2250744387 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15dc0a5a80 con 0x7f15d4003980 2023-07-21T22:50:16.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.805+0000 7f15eaffd640 1 -- 172.21.15.6:0/2250744387 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc0a5e30 con 0x7f15d4003980 2023-07-21T22:50:16.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.805+0000 7f15f239d640 1 -- 172.21.15.6:0/2250744387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15d4003980 msgr2=0x7f15d4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:16.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.805+0000 7f15f239d640 1 --2- 172.21.15.6:0/2250744387 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15d4003980 0x7f15d4003d90 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f15dc00c290 tx=0x7f15dc01ccb0 comp rx=0 tx=0).stop 2023-07-21T22:50:16.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.805+0000 7f15f093a640 1 -- 172.21.15.6:0/2250744387 reap_dead start 2023-07-21T22:50:16.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.805+0000 7f15f239d640 1 -- 172.21.15.6:0/2250744387 shutdown_connections 2023-07-21T22:50:16.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.805+0000 7f15f239d640 1 -- 172.21.15.6:0/2250744387 >> 172.21.15.6:0/2250744387 conn(0x7f15ec0650b0 msgr2=0x7f15ec0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:16.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.805+0000 7f15f239d640 1 -- 172.21.15.6:0/2250744387 shutdown_connections 2023-07-21T22:50:16.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.805+0000 7f15f239d640 1 -- 172.21.15.6:0/2250744387 wait complete. 2023-07-21T22:50:16.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15f239d640 1 Processor -- start 2023-07-21T22:50:16.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15f239d640 1 -- start start 2023-07-21T22:50:16.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15f239d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15d4003980 0x7f15ec164280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:16.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15f239d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15ec15b490 0x7f15ec160740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:16.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15f239d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15ec160c80 0x7f15ec0c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:16.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15f239d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0c7f20 con 0x7f15ec160c80 2023-07-21T22:50:16.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15f239d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0c7260 con 0x7f15d4003980 2023-07-21T22:50:16.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15f239d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec0c7bf0 con 0x7f15ec15b490 2023-07-21T22:50:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15f093a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15ec160c80 0x7f15ec0c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15f093a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15ec160c80 0x7f15ec0c83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53830/0 (socket says 172.21.15.6:53830) 2023-07-21T22:50:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15f093a640 1 -- 172.21.15.6:0/3115959236 learned_addr learned my addr 172.21.15.6:0/3115959236 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:50:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15ebfff640 1 --2- 172.21.15.6:0/3115959236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15d4003980 0x7f15ec164280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15eb7fe640 1 --2- 172.21.15.6:0/3115959236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15ec15b490 0x7f15ec160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15f093a640 1 -- 172.21.15.6:0/3115959236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15ec15b490 msgr2=0x7f15ec160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15f093a640 1 --2- 172.21.15.6:0/3115959236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15ec15b490 0x7f15ec160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:16.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15f093a640 1 -- 172.21.15.6:0/3115959236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15d4003980 msgr2=0x7f15ec164280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15f093a640 1 --2- 172.21.15.6:0/3115959236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15d4003980 0x7f15ec164280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15f093a640 1 -- 172.21.15.6:0/3115959236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ec0c7500 con 0x7f15ec160c80 2023-07-21T22:50:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15f093a640 1 --2- 172.21.15.6:0/3115959236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15ec160c80 0x7f15ec0c83b0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0cf880 tx=0x7f15e4007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15e8ff9640 1 -- 172.21.15.6:0/3115959236 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e400e050 con 0x7f15ec160c80 2023-07-21T22:50:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15e8ff9640 1 -- 172.21.15.6:0/3115959236 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e400f040 con 0x7f15ec160c80 2023-07-21T22:50:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15e8ff9640 1 -- 172.21.15.6:0/3115959236 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e4003be0 con 0x7f15ec160c80 2023-07-21T22:50:16.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.809+0000 7f15f239d640 1 -- 172.21.15.6:0/3115959236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ec0c77e0 con 0x7f15ec160c80 2023-07-21T22:50:16.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.813+0000 7f15f239d640 1 -- 172.21.15.6:0/3115959236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ec159ab0 con 0x7f15ec160c80 2023-07-21T22:50:16.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.813+0000 7f15f239d640 1 -- 172.21.15.6:0/3115959236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ec0c7d60 con 0x7f15ec160c80 2023-07-21T22:50:16.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.813+0000 7f15e8ff9640 1 -- 172.21.15.6:0/3115959236 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 72) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f15e4003d40 con 0x7f15ec160c80 2023-07-21T22:50:16.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.813+0000 7f15e8ff9640 1 --2- 172.21.15.6:0/3115959236 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7f15d80663f0 0x7f15d80688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:16.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.813+0000 7f15e8ff9640 1 -- 172.21.15.6:0/3115959236 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f15e4083ff0 con 0x7f15ec160c80 2023-07-21T22:50:16.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.813+0000 7f15ebfff640 1 --2- 172.21.15.6:0/3115959236 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7f15d80663f0 0x7f15d80688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:16.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.813+0000 7f15ebfff640 1 --2- 172.21.15.6:0/3115959236 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7f15d80663f0 0x7f15d80688a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0aa000 tx=0x7f15dc001a10 comp rx=0 tx=0).ready entity=mgr.8015 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:16.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:16.817+0000 7f15e8ff9640 1 -- 172.21.15.6:0/3115959236 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f15ec0c7d60 con 0x7f15ec160c80 2023-07-21T22:50:17.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:17.009+0000 7f15f239d640 1 -- 172.21.15.6:0/3115959236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f15ec0c7d60 con 0x7f15ec160c80 2023-07-21T22:50:17.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:17.013+0000 7f15e8ff9640 1 -- 172.21.15.6:0/3115959236 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v72) v1 ==== 74+0+164455 (secure 0 0 0) 0x7f15ec0c7d60 con 0x7f15ec160c80 2023-07-21T22:50:17.052 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:50:17.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:17.017+0000 7f15f239d640 1 -- 172.21.15.6:0/3115959236 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7f15d80663f0 msgr2=0x7f15d80688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:17.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:17.017+0000 7f15f239d640 1 --2- 172.21.15.6:0/3115959236 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7f15d80663f0 0x7f15d80688a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0aa000 tx=0x7f15dc001a10 comp rx=0 tx=0).stop 2023-07-21T22:50:17.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:17.017+0000 7f15f239d640 1 -- 172.21.15.6:0/3115959236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15ec160c80 msgr2=0x7f15ec0c83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:17.017+0000 7f15f239d640 1 --2- 172.21.15.6:0/3115959236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15ec160c80 0x7f15ec0c83b0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0cf880 tx=0x7f15e4007e40 comp rx=0 tx=0).stop 2023-07-21T22:50:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:17.017+0000 7f15f239d640 1 -- 172.21.15.6:0/3115959236 shutdown_connections 2023-07-21T22:50:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:17.017+0000 7f15f239d640 1 --2- 172.21.15.6:0/3115959236 >> [v2:172.21.15.161:6832/3096900160,v1:172.21.15.161:6833/3096900160] conn(0x7f15d80663f0 0x7f15d80688a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:17.017+0000 7f15f239d640 1 --2- 172.21.15.6:0/3115959236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15ec160c80 0x7f15ec0c83b0 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:17.017+0000 7f15f239d640 1 --2- 172.21.15.6:0/3115959236 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f15ec15b490 0x7f15ec160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:17.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:17.017+0000 7f15f239d640 1 --2- 172.21.15.6:0/3115959236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15d4003980 0x7f15ec164280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:17.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:17.017+0000 7f15f239d640 1 -- 172.21.15.6:0/3115959236 >> 172.21.15.6:0/3115959236 conn(0x7f15ec0650b0 msgr2=0x7f15ec0b6920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:17.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:17.017+0000 7f15f239d640 1 -- 172.21.15.6:0/3115959236 shutdown_connections 2023-07-21T22:50:17.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:50:17.017+0000 7f15f239d640 1 -- 172.21.15.6:0/3115959236 wait complete. 2023-07-21T22:50:17.072 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":72,"active_gid":8015,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3096900160},{"type":"v1","addr":"172.21.15.161:6833","nonce":3096900160}]},"active_addr":"172.21.15.161:6833/3096900160","active_change":"2023-07-21T22:39:20.661143+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":9537,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":158,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":3217579618}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":1641497343}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":107992510}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":52253068}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":1520394641}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":2485992449}]}]} 2023-07-21T22:50:17.077 DEBUG:tasks.cephfs.test_snap_schedules:restarting active mgr: x 2023-07-21T22:50:17.078 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-21T22:50:17.078 INFO:tasks.ceph.mgr.x:Stopping old one... 2023-07-21T22:50:17.078 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-21T22:50:17.079 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:50:17.141 INFO:tasks.ceph.mgr.x:Stopped 2023-07-21T22:50:17.141 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-21T22:50:17.145 INFO:tasks.ceph.mgr.x:Started 2023-07-21T22:50:17.324 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:17.289+0000 7f8d4cf08180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:50:17.737 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:17.705+0000 7f8d4cf08180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:50:17.886 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:17.853+0000 7f8d4cf08180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:50:18.379 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:18.345+0000 7f8d4cf08180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:50:18.437 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:18.405+0000 7f8d4cf08180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:50:18.493 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:18.461+0000 7f8d4cf08180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:50:18.581 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:18.549+0000 7f8d4cf08180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:50:18.637 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:18.605+0000 7f8d4cf08180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:50:18.721 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:18.689+0000 7f8d4cf08180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:50:18.777 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:18.745+0000 7f8d4cf08180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:50:18.916 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:18.885+0000 7f8d4cf08180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:50:18.975 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:18.941+0000 7f8d4cf08180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:50:19.213 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:50:19.214 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:50:19.214 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:50:19.222 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:19.189+0000 7f8d4cf08180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:50:19.355 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:19.321+0000 7f8d4cf08180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:50:19.478 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:19.445+0000 7f8d4cf08180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:50:19.548 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:19.517+0000 7f8d4cf08180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:50:19.680 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:19.649+0000 7f8d4cf08180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:50:20.218 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:20.185+0000 7f8d4cf08180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:50:20.302 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:20.269+0000 7f8d4cf08180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:50:20.449 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:20.417+0000 7f8d4cf08180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:50:20.532 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:20.501+0000 7f8d4cf08180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:50:20.800 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:20.765+0000 7f8d4cf08180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:50:20.859 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:20.825+0000 7f8d4cf08180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:50:21.026 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:20.993+0000 7f8ccb867640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:50:21.026 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:20.993+0000 7f8ccb867640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:50:21.026 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:20.993+0000 7f8ccb867640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:50:21.027 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:20.993+0000 7f8ccb867640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:50:21.027 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:20.993+0000 7f8ccb867640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:50:21.027 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:20.993+0000 7f8ccd86b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:50:21.027 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:20.993+0000 7f8ccd86b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:50:21.027 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:20.993+0000 7f8ccd86b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:50:21.027 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:20.993+0000 7f8ccd86b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:50:21.027 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:50:20.993+0000 7f8ccd86b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:50:46.858 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:50:46.863 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:51:01.022 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:51:00.989+0000 7f8cd687d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:51:01.023 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:51:00.989+0000 7f8cd687d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:51:01.023 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:51:00.989+0000 7f8cd687d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:51:01.023 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:51:00.989+0000 7f8cd687d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:51:01.023 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:51:00.989+0000 7f8cd687d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:51:17.214 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:51:17.218 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:51:47.301 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:51:47.309 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:52:17.389 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:52:17.394 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:52:47.470 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:52:47.475 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:53:17.582 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:53:17.586 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:53:47.639 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:53:47.643 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:54:17.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:54:18.004 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:54:48.068 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:54:48.077 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:55:17.146 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/test_restart 1M 2023-07-21T22:55:17.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.270+0000 7f7171a26640 1 Processor -- start 2023-07-21T22:55:17.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.270+0000 7f7171a26640 1 -- start start 2023-07-21T22:55:17.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.270+0000 7f7171a26640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f716c15bde0 0x7f716c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:17.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.270+0000 7f7171a26640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f716c0d2fc0 0x7f716c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:17.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.270+0000 7f7171a26640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f716c0d2300 0x7f716c0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:17.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.270+0000 7f7171a26640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716c0d2ce0 con 0x7f716c0d2300 2023-07-21T22:55:17.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.270+0000 7f7171a26640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716c15c1b0 con 0x7f716c0d2fc0 2023-07-21T22:55:17.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.270+0000 7f7171a26640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c0b04c0 con 0x7f716c15bde0 2023-07-21T22:55:17.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.270+0000 7f716b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f716c0d2300 0x7f716c0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:17.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.270+0000 7f716b7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f716c0d2300 0x7f716c0d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43434/0 (socket says 172.21.15.6:43434) 2023-07-21T22:55:17.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.270+0000 7f716b7fe640 1 -- 172.21.15.6:0/2888049068 learned_addr learned my addr 172.21.15.6:0/2888049068 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:17.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.270+0000 7f716affd640 1 --2- 172.21.15.6:0/2888049068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f716c15bde0 0x7f716c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:17.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.270+0000 7f7163fff640 1 --2- 172.21.15.6:0/2888049068 >> v2:172.21.15.161:3300/0 conn(0x7f716c0d2fc0 0x7f716c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:17.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.270+0000 7f716b7fe640 1 -- 172.21.15.6:0/2888049068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f716c15bde0 msgr2=0x7f716c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:17.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.270+0000 7f716b7fe640 1 --2- 172.21.15.6:0/2888049068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f716c15bde0 0x7f716c0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.270+0000 7f716b7fe640 1 -- 172.21.15.6:0/2888049068 >> v2:172.21.15.161:3300/0 conn(0x7f716c0d2fc0 msgr2=0x7f716c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:17.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.270+0000 7f716b7fe640 1 --2- 172.21.15.6:0/2888049068 >> v2:172.21.15.161:3300/0 conn(0x7f716c0d2fc0 0x7f716c0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.270+0000 7f716b7fe640 1 -- 172.21.15.6:0/2888049068 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c0d0aa0 con 0x7f716c0d2300 2023-07-21T22:55:17.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.274+0000 7f716b7fe640 1 --2- 172.21.15.6:0/2888049068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c0d2300 0x7f716c0d27a0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f716c08af30 tx=0x7f716401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df16ccc0a761681d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:17.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.274+0000 7f716a7fc640 1 -- 172.21.15.6:0/2888049068 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71640a5850 con 0x7f716c0d2300 2023-07-21T22:55:17.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.274+0000 7f716a7fc640 1 -- 172.21.15.6:0/2888049068 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71640a59b0 con 0x7f716c0d2300 2023-07-21T22:55:17.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.274+0000 7f716a7fc640 1 -- 172.21.15.6:0/2888049068 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71640a5d40 con 0x7f716c0d2300 2023-07-21T22:55:17.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.274+0000 7f7171a26640 1 -- 172.21.15.6:0/2888049068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c0d2300 msgr2=0x7f716c0d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:17.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.274+0000 7f7171a26640 1 --2- 172.21.15.6:0/2888049068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c0d2300 0x7f716c0d27a0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f716c08af30 tx=0x7f716401c9d0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.274+0000 7f7171a26640 1 -- 172.21.15.6:0/2888049068 shutdown_connections 2023-07-21T22:55:17.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.274+0000 7f7171a26640 1 --2- 172.21.15.6:0/2888049068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c0d2300 0x7f716c0d27a0 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.274+0000 7f7171a26640 1 --2- 172.21.15.6:0/2888049068 >> v2:172.21.15.161:3300/0 conn(0x7f716c0d2fc0 0x7f716c0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.274+0000 7f7171a26640 1 --2- 172.21.15.6:0/2888049068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f716c15bde0 0x7f716c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.274+0000 7f7171a26640 1 -- 172.21.15.6:0/2888049068 >> 172.21.15.6:0/2888049068 conn(0x7f716c0659d0 msgr2=0x7f716c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:17.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.274+0000 7f7171a26640 1 -- 172.21.15.6:0/2888049068 shutdown_connections 2023-07-21T22:55:17.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.274+0000 7f7171a26640 1 -- 172.21.15.6:0/2888049068 wait complete. 2023-07-21T22:55:17.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f7171a26640 1 Processor -- start 2023-07-21T22:55:17.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f7171a26640 1 -- start start 2023-07-21T22:55:17.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f7171a26640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c0d2300 0x7f716c0b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:17.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f7171a26640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f716c0d2fc0 0x7f716c0b6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:17.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f7171a26640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f716c15bde0 0x7f716c0b7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:17.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f7171a26640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c0b6200 con 0x7f716c0d2300 2023-07-21T22:55:17.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f7171a26640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c0b4150 con 0x7f716c0d2fc0 2023-07-21T22:55:17.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f7171a26640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c0b5580 con 0x7f716c15bde0 2023-07-21T22:55:17.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f716affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c0d2300 0x7f716c0b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:17.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f716affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c0d2300 0x7f716c0b3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43442/0 (socket says 172.21.15.6:43442) 2023-07-21T22:55:17.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f716affd640 1 -- 172.21.15.6:0/3117116056 learned_addr learned my addr 172.21.15.6:0/3117116056 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:17.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f716b7fe640 1 --2- 172.21.15.6:0/3117116056 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f716c15bde0 0x7f716c0b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:17.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f7163fff640 1 --2- 172.21.15.6:0/3117116056 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f716c0d2fc0 0x7f716c0b6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:17.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f716affd640 1 -- 172.21.15.6:0/3117116056 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f716c15bde0 msgr2=0x7f716c0b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:17.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f716affd640 1 --2- 172.21.15.6:0/3117116056 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f716c15bde0 0x7f716c0b7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f716affd640 1 -- 172.21.15.6:0/3117116056 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f716c0d2fc0 msgr2=0x7f716c0b6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:17.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f716affd640 1 --2- 172.21.15.6:0/3117116056 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f716c0d2fc0 0x7f716c0b6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f716affd640 1 -- 172.21.15.6:0/3117116056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7164009b30 con 0x7f716c0d2300 2023-07-21T22:55:17.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f716b7fe640 1 --2- 172.21.15.6:0/3117116056 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f716c15bde0 0x7f716c0b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:17.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f716affd640 1 --2- 172.21.15.6:0/3117116056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c0d2300 0x7f716c0b3c10 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f715c00d800 tx=0x7f715c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:17.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f7168ff9640 1 -- 172.21.15.6:0/3117116056 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c018070 con 0x7f716c0d2300 2023-07-21T22:55:17.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f7168ff9640 1 -- 172.21.15.6:0/3117116056 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715c0059a0 con 0x7f716c0d2300 2023-07-21T22:55:17.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f7168ff9640 1 -- 172.21.15.6:0/3117116056 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c005b50 con 0x7f716c0d2300 2023-07-21T22:55:17.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f7171a26640 1 -- 172.21.15.6:0/3117116056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716c0b5860 con 0x7f716c0d2300 2023-07-21T22:55:17.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.278+0000 7f7171a26640 1 -- 172.21.15.6:0/3117116056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716c0b5e20 con 0x7f716c0d2300 2023-07-21T22:55:17.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.282+0000 7f7171a26640 1 -- 172.21.15.6:0/3117116056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716c0678d0 con 0x7f716c0d2300 2023-07-21T22:55:17.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.282+0000 7f7168ff9640 1 -- 172.21.15.6:0/3117116056 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 77) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f715c005cb0 con 0x7f716c0d2300 2023-07-21T22:55:17.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.282+0000 7f7168ff9640 1 --2- 172.21.15.6:0/3117116056 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f714c0663f0 0x7f714c0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:17.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.282+0000 7f7168ff9640 1 -- 172.21.15.6:0/3117116056 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6822+0+0 (secure 0 0 0) 0x7f715c084110 con 0x7f716c0d2300 2023-07-21T22:55:17.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.282+0000 7f7163fff640 1 --2- 172.21.15.6:0/3117116056 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f714c0663f0 0x7f714c0688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:17.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.282+0000 7f7163fff640 1 --2- 172.21.15.6:0/3117116056 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f714c0663f0 0x7f714c0688a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f716c0ce110 tx=0x7f7154008040 comp rx=0 tx=0).ready entity=mgr.9211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:17.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.286+0000 7f7168ff9640 1 -- 172.21.15.6:0/3117116056 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f715c054c00 con 0x7f716c0d2300 2023-07-21T22:55:17.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.462+0000 7f7171a26640 1 -- 172.21.15.6:0/3117116056 --> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f716c0d07b0 con 0x7f714c0663f0 2023-07-21T22:55:17.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.526+0000 7f7168ff9640 1 -- 172.21.15.6:0/3117116056 <== mgr.9211 v2:172.21.15.161:6832/835248343 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7f715400b140 con 0x7f714c0663f0 2023-07-21T22:55:17.563 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule deactivated for path /snap_test_dir1/test_restart 2023-07-21T22:55:17.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.526+0000 7f7171a26640 1 -- 172.21.15.6:0/3117116056 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f714c0663f0 msgr2=0x7f714c0688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:17.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.526+0000 7f7171a26640 1 --2- 172.21.15.6:0/3117116056 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f714c0663f0 0x7f714c0688a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f716c0ce110 tx=0x7f7154008040 comp rx=0 tx=0).stop 2023-07-21T22:55:17.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.526+0000 7f7171a26640 1 -- 172.21.15.6:0/3117116056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c0d2300 msgr2=0x7f716c0b3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:17.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.526+0000 7f7171a26640 1 --2- 172.21.15.6:0/3117116056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c0d2300 0x7f716c0b3c10 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f715c00d800 tx=0x7f715c00dcc0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.526+0000 7f7171a26640 1 -- 172.21.15.6:0/3117116056 shutdown_connections 2023-07-21T22:55:17.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.526+0000 7f7171a26640 1 --2- 172.21.15.6:0/3117116056 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f714c0663f0 0x7f714c0688a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.526+0000 7f7171a26640 1 --2- 172.21.15.6:0/3117116056 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f716c15bde0 0x7f716c0b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.526+0000 7f7171a26640 1 --2- 172.21.15.6:0/3117116056 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f716c0d2fc0 0x7f716c0b6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.526+0000 7f7171a26640 1 --2- 172.21.15.6:0/3117116056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f716c0d2300 0x7f716c0b3c10 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.526+0000 7f7171a26640 1 -- 172.21.15.6:0/3117116056 >> 172.21.15.6:0/3117116056 conn(0x7f716c0659d0 msgr2=0x7f716c0cd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:17.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.526+0000 7f7171a26640 1 -- 172.21.15.6:0/3117116056 shutdown_connections 2023-07-21T22:55:17.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.526+0000 7f7171a26640 1 -- 172.21.15.6:0/3117116056 wait complete. 2023-07-21T22:55:17.584 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/test_restart 2023-07-21T22:55:17.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:17.585 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-07-21T22:55:17.595 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_40_00_UTC 2023-07-21T22:55:17.595 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_41_00_UTC 2023-07-21T22:55:17.595 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_42_00_UTC 2023-07-21T22:55:17.595 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_43_00_UTC 2023-07-21T22:55:17.596 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_44_00_UTC 2023-07-21T22:55:17.596 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_45_00_UTC 2023-07-21T22:55:17.596 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_46_00_UTC 2023-07-21T22:55:17.596 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_47_00_UTC 2023-07-21T22:55:17.596 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_48_00_UTC 2023-07-21T22:55:17.596 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_49_00_UTC 2023-07-21T22:55:17.596 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_50_00_UTC 2023-07-21T22:55:17.597 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_51_00_UTC 2023-07-21T22:55:17.597 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_52_00_UTC 2023-07-21T22:55:17.597 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_53_00_UTC 2023-07-21T22:55:17.597 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_54_00_UTC 2023-07-21T22:55:17.597 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_55_00_UTC 2023-07-21T22:55:17.598 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-21-22_40_00_UTC', 'scheduled-2023-07-21-22_41_00_UTC', 'scheduled-2023-07-21-22_42_00_UTC', 'scheduled-2023-07-21-22_43_00_UTC', 'scheduled-2023-07-21-22_44_00_UTC', 'scheduled-2023-07-21-22_45_00_UTC', 'scheduled-2023-07-21-22_46_00_UTC', 'scheduled-2023-07-21-22_47_00_UTC', 'scheduled-2023-07-21-22_48_00_UTC', 'scheduled-2023-07-21-22_49_00_UTC', 'scheduled-2023-07-21-22_50_00_UTC', 'scheduled-2023-07-21-22_51_00_UTC', 'scheduled-2023-07-21-22_52_00_UTC', 'scheduled-2023-07-21-22_53_00_UTC', 'scheduled-2023-07-21-22_54_00_UTC', 'scheduled-2023-07-21-22_55_00_UTC'] 2023-07-21T22:55:17.598 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-07-21T22:55:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.750+0000 7f649707b640 1 Processor -- start 2023-07-21T22:55:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.750+0000 7f649707b640 1 -- start start 2023-07-21T22:55:17.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.750+0000 7f649707b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f64900af2b0 0x7f649015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:17.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.750+0000 7f649707b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6490159d70 con 0x7f6490070f30 2023-07-21T22:55:17.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.750+0000 7f649707b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64900c9c60 con 0x7f6490069430 2023-07-21T22:55:17.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.750+0000 7f649707b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64900c9f40 con 0x7f64900af2b0 2023-07-21T22:55:17.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.754+0000 7f6495618640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f64900af2b0 0x7f649015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:17.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.754+0000 7f6495618640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f64900af2b0 0x7f649015a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35470/0 (socket says 172.21.15.6:35470) 2023-07-21T22:55:17.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.754+0000 7f6495618640 1 -- 172.21.15.6:0/560782023 learned_addr learned my addr 172.21.15.6:0/560782023 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:17.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.754+0000 7f648ffff640 1 --1- 172.21.15.6:0/560782023 >> v1:172.21.15.6:6789/0 conn(0x7f6490070f30 0x7f64900ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58482/0 (socket says 172.21.15.6:58482) 2023-07-21T22:55:17.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.754+0000 7f6495618640 1 -- 172.21.15.6:0/560782023 >> v1:172.21.15.161:6789/0 conn(0x7f6490069430 legacy=0x7f6490069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:17.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.754+0000 7f6495618640 1 -- 172.21.15.6:0/560782023 >> v1:172.21.15.6:6789/0 conn(0x7f6490070f30 legacy=0x7f64900ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:17.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.754+0000 7f6495618640 1 -- 172.21.15.6:0/560782023 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64900ca220 con 0x7f64900af2b0 2023-07-21T22:55:17.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.754+0000 7f648f7fe640 1 -- 172.21.15.6:0/560782023 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181827905 0 0) 0x7f647c001120 con 0x7f6490070f30 2023-07-21T22:55:17.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.754+0000 7f6495618640 1 --2- 172.21.15.6:0/560782023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900af2b0 0x7f649015a1f0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f6488009e50 tx=0x7f648801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86eab3b499cfa59c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.754+0000 7f648f7fe640 1 -- 172.21.15.6:0/560782023 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64880a5900 con 0x7f64900af2b0 2023-07-21T22:55:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.754+0000 7f648f7fe640 1 -- 172.21.15.6:0/560782023 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64880a5a60 con 0x7f64900af2b0 2023-07-21T22:55:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.754+0000 7f648f7fe640 1 -- 172.21.15.6:0/560782023 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64880a5df0 con 0x7f64900af2b0 2023-07-21T22:55:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.758+0000 7f649707b640 1 -- 172.21.15.6:0/560782023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900af2b0 msgr2=0x7f649015a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:17.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.758+0000 7f649707b640 1 --2- 172.21.15.6:0/560782023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900af2b0 0x7f649015a1f0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f6488009e50 tx=0x7f648801ca10 comp rx=0 tx=0).stop 2023-07-21T22:55:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.758+0000 7f649707b640 1 -- 172.21.15.6:0/560782023 shutdown_connections 2023-07-21T22:55:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.758+0000 7f649707b640 1 --2- 172.21.15.6:0/560782023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900af2b0 0x7f649015a1f0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.758+0000 7f649707b640 1 -- 172.21.15.6:0/560782023 >> 172.21.15.6:0/560782023 conn(0x7f64900cde90 msgr2=0x7f64900ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.758+0000 7f649707b640 1 -- 172.21.15.6:0/560782023 shutdown_connections 2023-07-21T22:55:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.758+0000 7f649707b640 1 -- 172.21.15.6:0/560782023 wait complete. 2023-07-21T22:55:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.758+0000 7f649707b640 1 Processor -- start 2023-07-21T22:55:17.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.758+0000 7f649707b640 1 -- start start 2023-07-21T22:55:17.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.758+0000 7f649707b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6490069430 0x7f649014f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:17.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.758+0000 7f649707b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6490070f30 0x7f64900cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:17.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.758+0000 7f649707b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900af2b0 0x7f64900b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:17.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.758+0000 7f649707b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64900adca0 con 0x7f64900af2b0 2023-07-21T22:55:17.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.758+0000 7f649707b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64900acc00 con 0x7f6490070f30 2023-07-21T22:55:17.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.758+0000 7f649707b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64900acee0 con 0x7f6490069430 2023-07-21T22:55:17.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.758+0000 7f6495618640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900af2b0 0x7f64900b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:17.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.758+0000 7f6495618640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900af2b0 0x7f64900b0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35484/0 (socket says 172.21.15.6:35484) 2023-07-21T22:55:17.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.758+0000 7f6495618640 1 -- 172.21.15.6:0/2989449553 learned_addr learned my addr 172.21.15.6:0/2989449553 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:17.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.758+0000 7f6494e17640 1 --2- 172.21.15.6:0/2989449553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6490069430 0x7f649014f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.758+0000 7f648ffff640 1 --2- 172.21.15.6:0/2989449553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6490070f30 0x7f64900cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.762+0000 7f6495618640 1 -- 172.21.15.6:0/2989449553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6490069430 msgr2=0x7f649014f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.762+0000 7f6495618640 1 --2- 172.21.15.6:0/2989449553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6490069430 0x7f649014f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.762+0000 7f6495618640 1 -- 172.21.15.6:0/2989449553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6490070f30 msgr2=0x7f64900cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.762+0000 7f6495618640 1 --2- 172.21.15.6:0/2989449553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6490070f30 0x7f64900cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.762+0000 7f6495618640 1 -- 172.21.15.6:0/2989449553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6488009b30 con 0x7f64900af2b0 2023-07-21T22:55:17.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.762+0000 7f648ffff640 1 --2- 172.21.15.6:0/2989449553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6490070f30 0x7f64900cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:17.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.762+0000 7f6495618640 1 --2- 172.21.15.6:0/2989449553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900af2b0 0x7f64900b0dc0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f64880af040 tx=0x7f64880197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:17.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.762+0000 7f648d7fa640 1 -- 172.21.15.6:0/2989449553 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64880b8880 con 0x7f64900af2b0 2023-07-21T22:55:17.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.762+0000 7f648d7fa640 1 -- 172.21.15.6:0/2989449553 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64880b89e0 con 0x7f64900af2b0 2023-07-21T22:55:17.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.762+0000 7f648d7fa640 1 -- 172.21.15.6:0/2989449553 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64880b8d90 con 0x7f64900af2b0 2023-07-21T22:55:17.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.762+0000 7f649707b640 1 -- 172.21.15.6:0/2989449553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64900ad1c0 con 0x7f64900af2b0 2023-07-21T22:55:17.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.762+0000 7f649707b640 1 -- 172.21.15.6:0/2989449553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64900ad780 con 0x7f64900af2b0 2023-07-21T22:55:17.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.762+0000 7f649707b640 1 -- 172.21.15.6:0/2989449553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64900678d0 con 0x7f64900af2b0 2023-07-21T22:55:17.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.762+0000 7f648d7fa640 1 -- 172.21.15.6:0/2989449553 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 77) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f64880b6440 con 0x7f64900af2b0 2023-07-21T22:55:17.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.762+0000 7f648d7fa640 1 --2- 172.21.15.6:0/2989449553 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f64740663f0 0x7f64740688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:17.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.762+0000 7f648d7fa640 1 -- 172.21.15.6:0/2989449553 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6822+0+0 (secure 0 0 0) 0x7f648811efa0 con 0x7f64900af2b0 2023-07-21T22:55:17.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.766+0000 7f6494e17640 1 --2- 172.21.15.6:0/2989449553 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f64740663f0 0x7f64740688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:17.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.766+0000 7f6494e17640 1 --2- 172.21.15.6:0/2989449553 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f64740663f0 0x7f64740688a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f64900c37d0 tx=0x7f6484009040 comp rx=0 tx=0).ready entity=mgr.9211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:17.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.766+0000 7f648d7fa640 1 -- 172.21.15.6:0/2989449553 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f64880ec000 con 0x7f64900af2b0 2023-07-21T22:55:17.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.946+0000 7f649707b640 1 -- 172.21.15.6:0/2989449553 --> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6490167740 con 0x7f64740663f0 2023-07-21T22:55:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.954+0000 7f648d7fa640 1 -- 172.21.15.6:0/2989449553 <== mgr.9211 v2:172.21.15.161:6832/835248343 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+361 (secure 0 0 0) 0x7f64840012d0 con 0x7f64740663f0 2023-07-21T22:55:17.993 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:17.993 INFO:teuthology.orchestra.run.smithi006.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:39:21", "first": "2023-07-21T22:40:00", "last": "2023-07-21T22:55:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-07-21T22:55:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.954+0000 7f649707b640 1 -- 172.21.15.6:0/2989449553 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f64740663f0 msgr2=0x7f64740688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.954+0000 7f649707b640 1 --2- 172.21.15.6:0/2989449553 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f64740663f0 0x7f64740688a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f64900c37d0 tx=0x7f6484009040 comp rx=0 tx=0).stop 2023-07-21T22:55:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.954+0000 7f649707b640 1 -- 172.21.15.6:0/2989449553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900af2b0 msgr2=0x7f64900b0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.954+0000 7f649707b640 1 --2- 172.21.15.6:0/2989449553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900af2b0 0x7f64900b0dc0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f64880af040 tx=0x7f64880197b0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.954+0000 7f649707b640 1 -- 172.21.15.6:0/2989449553 shutdown_connections 2023-07-21T22:55:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.954+0000 7f649707b640 1 --2- 172.21.15.6:0/2989449553 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f64740663f0 0x7f64740688a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.954+0000 7f649707b640 1 --2- 172.21.15.6:0/2989449553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64900af2b0 0x7f64900b0dc0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.954+0000 7f649707b640 1 --2- 172.21.15.6:0/2989449553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6490070f30 0x7f64900cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.954+0000 7f649707b640 1 --2- 172.21.15.6:0/2989449553 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6490069430 0x7f649014f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.954+0000 7f649707b640 1 -- 172.21.15.6:0/2989449553 >> 172.21.15.6:0/2989449553 conn(0x7f64900cde90 msgr2=0x7f64900c38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.954+0000 7f649707b640 1 -- 172.21.15.6:0/2989449553 shutdown_connections 2023-07-21T22:55:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:17.954+0000 7f649707b640 1 -- 172.21.15.6:0/2989449553 wait complete. 2023-07-21T22:55:18.013 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:39:21", "first": "2023-07-21T22:40:00", "last": "2023-07-21T22:55:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-07-21T22:55:18.013 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-07-21T00:00:00', 'created': '2023-07-21T22:39:21', 'first': '2023-07-21T22:40:00', 'last': '2023-07-21T22:55:00', 'last_pruned': None, 'created_count': 16, 'pruned_count': 0, 'active': False} 2023-07-21T22:55:18.014 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/test_restart 1M 2023-07-21T22:55:18.129 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:55:18.133 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:55:18.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.126+0000 7fc56e6d8640 1 Processor -- start 2023-07-21T22:55:18.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.126+0000 7fc56e6d8640 1 -- start start 2023-07-21T22:55:18.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.126+0000 7fc56e6d8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc5680d2300 0x7fc5680d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.126+0000 7fc56e6d8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5680b04c0 con 0x7fc5680d2fc0 2023-07-21T22:55:18.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.126+0000 7fc56e6d8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5680b1060 con 0x7fc56815bde0 2023-07-21T22:55:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.126+0000 7fc56e6d8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56815c1b0 con 0x7fc5680d2300 2023-07-21T22:55:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.126+0000 7fc56cc75640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc5680d2300 0x7fc5680d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.126+0000 7fc56cc75640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc5680d2300 0x7fc5680d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35500/0 (socket says 172.21.15.6:35500) 2023-07-21T22:55:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.126+0000 7fc56cc75640 1 -- 172.21.15.6:0/485140619 learned_addr learned my addr 172.21.15.6:0/485140619 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.126+0000 7fc56cc75640 1 -- 172.21.15.6:0/485140619 >> v1:172.21.15.161:6789/0 conn(0x7fc56815bde0 legacy=0x7fc5680d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.126+0000 7fc56cc75640 1 -- 172.21.15.6:0/485140619 >> v1:172.21.15.6:6789/0 conn(0x7fc5680d2fc0 legacy=0x7fc5680b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.126+0000 7fc566ffd640 1 -- 172.21.15.6:0/485140619 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184843907 0 0) 0x7fc5680b04c0 con 0x7fc5680d2fc0 2023-07-21T22:55:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.126+0000 7fc56cc75640 1 -- 172.21.15.6:0/485140619 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5680d2c80 con 0x7fc5680d2300 2023-07-21T22:55:18.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.130+0000 7fc56cc75640 1 --2- 172.21.15.6:0/485140619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5680d2300 0x7fc5680d2740 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fc560009e50 tx=0x7fc56001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d71e0ae88e50044 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:18.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.130+0000 7fc566ffd640 1 -- 172.21.15.6:0/485140619 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5600a57f0 con 0x7fc5680d2300 2023-07-21T22:55:18.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.130+0000 7fc566ffd640 1 -- 172.21.15.6:0/485140619 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5600a5950 con 0x7fc5680d2300 2023-07-21T22:55:18.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.130+0000 7fc566ffd640 1 -- 172.21.15.6:0/485140619 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5600a5ce0 con 0x7fc5680d2300 2023-07-21T22:55:18.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.130+0000 7fc56e6d8640 1 -- 172.21.15.6:0/485140619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5680d2300 msgr2=0x7fc5680d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:18.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.130+0000 7fc56e6d8640 1 --2- 172.21.15.6:0/485140619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5680d2300 0x7fc5680d2740 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7fc560009e50 tx=0x7fc56001ca10 comp rx=0 tx=0).stop 2023-07-21T22:55:18.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.130+0000 7fc56e6d8640 1 -- 172.21.15.6:0/485140619 shutdown_connections 2023-07-21T22:55:18.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.130+0000 7fc56e6d8640 1 --2- 172.21.15.6:0/485140619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5680d2300 0x7fc5680d2740 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.130+0000 7fc56e6d8640 1 -- 172.21.15.6:0/485140619 >> 172.21.15.6:0/485140619 conn(0x7fc5680659d0 msgr2=0x7fc56809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.130+0000 7fc56e6d8640 1 -- 172.21.15.6:0/485140619 shutdown_connections 2023-07-21T22:55:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.130+0000 7fc56e6d8640 1 -- 172.21.15.6:0/485140619 wait complete. 2023-07-21T22:55:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc56e6d8640 1 Processor -- start 2023-07-21T22:55:18.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc56e6d8640 1 -- start start 2023-07-21T22:55:18.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc56e6d8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5680d2300 0x7fc5680c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc56e6d8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5680d2fc0 0x7fc5680c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc56e6d8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc56815bde0 0x7fc5680cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc56e6d8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc568156f70 con 0x7fc5680d2300 2023-07-21T22:55:18.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc56e6d8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5680cb6b0 con 0x7fc56815bde0 2023-07-21T22:55:18.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc56e6d8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5680c63e0 con 0x7fc5680d2fc0 2023-07-21T22:55:18.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc567fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5680d2300 0x7fc5680c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:18.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc567fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5680d2300 0x7fc5680c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35506/0 (socket says 172.21.15.6:35506) 2023-07-21T22:55:18.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc567fff640 1 -- 172.21.15.6:0/468542742 learned_addr learned my addr 172.21.15.6:0/468542742 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:18.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc5677fe640 1 --2- 172.21.15.6:0/468542742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5680d2fc0 0x7fc5680c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:18.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc56cc75640 1 --2- 172.21.15.6:0/468542742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc56815bde0 0x7fc5680cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:18.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc567fff640 1 -- 172.21.15.6:0/468542742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5680d2fc0 msgr2=0x7fc5680c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:18.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc567fff640 1 --2- 172.21.15.6:0/468542742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5680d2fc0 0x7fc5680c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc567fff640 1 -- 172.21.15.6:0/468542742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc56815bde0 msgr2=0x7fc5680cbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:18.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc567fff640 1 --2- 172.21.15.6:0/468542742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc56815bde0 0x7fc5680cbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc567fff640 1 -- 172.21.15.6:0/468542742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc560009b30 con 0x7fc5680d2300 2023-07-21T22:55:18.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc567fff640 1 --2- 172.21.15.6:0/468542742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5680d2300 0x7fc5680c5ea0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fc55800c430 tx=0x7fc55800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:18.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc564ff9640 1 -- 172.21.15.6:0/468542742 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5580052d0 con 0x7fc5680d2300 2023-07-21T22:55:18.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc564ff9640 1 -- 172.21.15.6:0/468542742 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc558005430 con 0x7fc5680d2300 2023-07-21T22:55:18.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc564ff9640 1 -- 172.21.15.6:0/468542742 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558003890 con 0x7fc5680d2300 2023-07-21T22:55:18.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.134+0000 7fc56e6d8640 1 -- 172.21.15.6:0/468542742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5680caaa0 con 0x7fc5680d2300 2023-07-21T22:55:18.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.138+0000 7fc56e6d8640 1 -- 172.21.15.6:0/468542742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5680cb060 con 0x7fc5680d2300 2023-07-21T22:55:18.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.138+0000 7fc56e6d8640 1 -- 172.21.15.6:0/468542742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5680678d0 con 0x7fc5680d2300 2023-07-21T22:55:18.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.138+0000 7fc564ff9640 1 -- 172.21.15.6:0/468542742 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 77) v1 ==== 85789+0+0 (secure 0 0 0) 0x7fc5580039f0 con 0x7fc5680d2300 2023-07-21T22:55:18.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.138+0000 7fc564ff9640 1 --2- 172.21.15.6:0/468542742 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fc5540663f0 0x7fc5540688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.138+0000 7fc564ff9640 1 -- 172.21.15.6:0/468542742 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6822+0+0 (secure 0 0 0) 0x7fc558083740 con 0x7fc5680d2300 2023-07-21T22:55:18.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.138+0000 7fc5677fe640 1 --2- 172.21.15.6:0/468542742 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fc5540663f0 0x7fc5540688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:18.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.142+0000 7fc5677fe640 1 --2- 172.21.15.6:0/468542742 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fc5540663f0 0x7fc5540688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc5680c5700 tx=0x7fc55c009040 comp rx=0 tx=0).ready entity=mgr.9211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:18.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.142+0000 7fc564ff9640 1 -- 172.21.15.6:0/468542742 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc558050860 con 0x7fc5680d2300 2023-07-21T22:55:18.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.318+0000 7fc56e6d8640 1 -- 172.21.15.6:0/468542742 --> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5680b0150 con 0x7fc5540663f0 2023-07-21T22:55:18.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.382+0000 7fc564ff9640 1 -- 172.21.15.6:0/468542742 <== mgr.9211 v2:172.21.15.161:6832/835248343 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+55 (secure 0 0 0) 0x7fc55c0014a0 con 0x7fc5540663f0 2023-07-21T22:55:18.422 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule removed for path /snap_test_dir1/test_restart 2023-07-21T22:55:18.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.386+0000 7fc56e6d8640 1 -- 172.21.15.6:0/468542742 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fc5540663f0 msgr2=0x7fc5540688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:18.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.386+0000 7fc56e6d8640 1 --2- 172.21.15.6:0/468542742 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fc5540663f0 0x7fc5540688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc5680c5700 tx=0x7fc55c009040 comp rx=0 tx=0).stop 2023-07-21T22:55:18.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.386+0000 7fc56e6d8640 1 -- 172.21.15.6:0/468542742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5680d2300 msgr2=0x7fc5680c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:18.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.386+0000 7fc56e6d8640 1 --2- 172.21.15.6:0/468542742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5680d2300 0x7fc5680c5ea0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fc55800c430 tx=0x7fc55800c8f0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.386+0000 7fc56e6d8640 1 -- 172.21.15.6:0/468542742 shutdown_connections 2023-07-21T22:55:18.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.386+0000 7fc56e6d8640 1 --2- 172.21.15.6:0/468542742 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fc5540663f0 0x7fc5540688a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.386+0000 7fc56e6d8640 1 --2- 172.21.15.6:0/468542742 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc56815bde0 0x7fc5680cbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.386+0000 7fc56e6d8640 1 --2- 172.21.15.6:0/468542742 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc5680d2fc0 0x7fc5680c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.386+0000 7fc56e6d8640 1 --2- 172.21.15.6:0/468542742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5680d2300 0x7fc5680c5ea0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.386+0000 7fc56e6d8640 1 -- 172.21.15.6:0/468542742 >> 172.21.15.6:0/468542742 conn(0x7fc5680659d0 msgr2=0x7fc5680d0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:18.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.386+0000 7fc56e6d8640 1 -- 172.21.15.6:0/468542742 shutdown_connections 2023-07-21T22:55:18.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:18.386+0000 7fc56e6d8640 1 -- 172.21.15.6:0/468542742 wait complete. 2023-07-21T22:55:18.443 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/test_restart 2023-07-21T22:55:18.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:18.445 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-07-21T22:55:18.456 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_40_00_UTC 2023-07-21T22:55:18.456 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_41_00_UTC 2023-07-21T22:55:18.456 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_42_00_UTC 2023-07-21T22:55:18.456 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_43_00_UTC 2023-07-21T22:55:18.456 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_44_00_UTC 2023-07-21T22:55:18.457 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_45_00_UTC 2023-07-21T22:55:18.457 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_46_00_UTC 2023-07-21T22:55:18.457 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_47_00_UTC 2023-07-21T22:55:18.457 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_48_00_UTC 2023-07-21T22:55:18.457 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_49_00_UTC 2023-07-21T22:55:18.458 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_50_00_UTC 2023-07-21T22:55:18.458 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_51_00_UTC 2023-07-21T22:55:18.458 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_52_00_UTC 2023-07-21T22:55:18.458 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_53_00_UTC 2023-07-21T22:55:18.458 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_54_00_UTC 2023-07-21T22:55:18.458 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_55_00_UTC 2023-07-21T22:55:18.459 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_40_00_UTC 2023-07-21T22:55:18.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:18.460 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_40_00_UTC) 2023-07-21T22:55:18.520 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_41_00_UTC 2023-07-21T22:55:18.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:18.521 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_41_00_UTC) 2023-07-21T22:55:18.577 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_42_00_UTC 2023-07-21T22:55:18.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:18.578 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_42_00_UTC) 2023-07-21T22:55:18.633 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_43_00_UTC 2023-07-21T22:55:18.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:18.633 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_43_00_UTC) 2023-07-21T22:55:18.688 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_44_00_UTC 2023-07-21T22:55:18.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:18.690 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_44_00_UTC) 2023-07-21T22:55:18.744 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_45_00_UTC 2023-07-21T22:55:18.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:18.745 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_45_00_UTC) 2023-07-21T22:55:18.800 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_46_00_UTC 2023-07-21T22:55:18.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:18.801 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_46_00_UTC) 2023-07-21T22:55:18.857 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_47_00_UTC 2023-07-21T22:55:18.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:18.858 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_47_00_UTC) 2023-07-21T22:55:18.912 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_48_00_UTC 2023-07-21T22:55:18.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:18.913 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_48_00_UTC) 2023-07-21T22:55:18.968 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_49_00_UTC 2023-07-21T22:55:18.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:18.969 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_49_00_UTC) 2023-07-21T22:55:19.025 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_50_00_UTC 2023-07-21T22:55:19.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:19.026 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_50_00_UTC) 2023-07-21T22:55:19.081 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_51_00_UTC 2023-07-21T22:55:19.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:19.082 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_51_00_UTC) 2023-07-21T22:55:19.137 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_52_00_UTC 2023-07-21T22:55:19.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:19.138 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_52_00_UTC) 2023-07-21T22:55:19.193 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_53_00_UTC 2023-07-21T22:55:19.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:19.194 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_53_00_UTC) 2023-07-21T22:55:19.252 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_54_00_UTC 2023-07-21T22:55:19.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:19.253 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_54_00_UTC) 2023-07-21T22:55:19.310 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_55_00_UTC 2023-07-21T22:55:19.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:19.311 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-21-22_55_00_UTC) 2023-07-21T22:55:19.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:19.373 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart) 2023-07-21T22:55:19.425 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-21T22:55:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.578+0000 7f8312619640 1 Processor -- start 2023-07-21T22:55:19.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.578+0000 7f8312619640 1 -- start start 2023-07-21T22:55:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.578+0000 7f8312619640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f830c15fd60 0x7f830c0af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.578+0000 7f8312619640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f830c0c13d0 0x7f830c0708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:19.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.578+0000 7f8312619640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f830c070e10 0x7f830c0c8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:19.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.578+0000 7f8312619640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f830c06d470 con 0x7f830c0c13d0 2023-07-21T22:55:19.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.578+0000 7f8312619640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f830c0afe90 con 0x7f830c15fd60 2023-07-21T22:55:19.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.578+0000 7f8312619640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830c0b0170 con 0x7f830c070e10 2023-07-21T22:55:19.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.578+0000 7f8310e16640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f830c0c13d0 0x7f830c0708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:19.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.578+0000 7f8310e16640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f830c0c13d0 0x7f830c0708d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35522/0 (socket says 172.21.15.6:35522) 2023-07-21T22:55:19.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.578+0000 7f8310e16640 1 -- 172.21.15.6:0/3969276673 learned_addr learned my addr 172.21.15.6:0/3969276673 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.582+0000 7f8311617640 1 --2- 172.21.15.6:0/3969276673 >> v2:172.21.15.161:3300/0 conn(0x7f830c15fd60 0x7f830c0af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.582+0000 7f8311e18640 1 --2- 172.21.15.6:0/3969276673 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f830c070e10 0x7f830c0c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.582+0000 7f8310e16640 1 -- 172.21.15.6:0/3969276673 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f830c070e10 msgr2=0x7f830c0c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.582+0000 7f8310e16640 1 --2- 172.21.15.6:0/3969276673 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f830c070e10 0x7f830c0c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.582+0000 7f8310e16640 1 -- 172.21.15.6:0/3969276673 >> v2:172.21.15.161:3300/0 conn(0x7f830c15fd60 msgr2=0x7f830c0af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.582+0000 7f8310e16640 1 --2- 172.21.15.6:0/3969276673 >> v2:172.21.15.161:3300/0 conn(0x7f830c15fd60 0x7f830c0af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.582+0000 7f8310e16640 1 -- 172.21.15.6:0/3969276673 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c06c990 con 0x7f830c0c13d0 2023-07-21T22:55:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.582+0000 7f8311617640 1 --2- 172.21.15.6:0/3969276673 >> v2:172.21.15.161:3300/0 conn(0x7f830c15fd60 0x7f830c0af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.582+0000 7f8310e16640 1 --2- 172.21.15.6:0/3969276673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f830c0c13d0 0x7f830c0708d0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f830c0cdd90 tx=0x7f82fc01c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8545af6f32bb0e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:19.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.582+0000 7f8303fff640 1 -- 172.21.15.6:0/3969276673 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc0ab600 con 0x7f830c0c13d0 2023-07-21T22:55:19.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.582+0000 7f8303fff640 1 -- 172.21.15.6:0/3969276673 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82fc0a7050 con 0x7f830c0c13d0 2023-07-21T22:55:19.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.582+0000 7f8303fff640 1 -- 172.21.15.6:0/3969276673 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc0ab980 con 0x7f830c0c13d0 2023-07-21T22:55:19.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8312619640 1 -- 172.21.15.6:0/3969276673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f830c0c13d0 msgr2=0x7f830c0708d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:19.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8312619640 1 --2- 172.21.15.6:0/3969276673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f830c0c13d0 0x7f830c0708d0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f830c0cdd90 tx=0x7f82fc01c240 comp rx=0 tx=0).stop 2023-07-21T22:55:19.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8312619640 1 -- 172.21.15.6:0/3969276673 shutdown_connections 2023-07-21T22:55:19.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8312619640 1 --2- 172.21.15.6:0/3969276673 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f830c070e10 0x7f830c0c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:19.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8312619640 1 --2- 172.21.15.6:0/3969276673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f830c0c13d0 0x7f830c0708d0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:19.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8312619640 1 --2- 172.21.15.6:0/3969276673 >> v2:172.21.15.161:3300/0 conn(0x7f830c15fd60 0x7f830c0af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:19.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8312619640 1 -- 172.21.15.6:0/3969276673 >> 172.21.15.6:0/3969276673 conn(0x7f830c0ca8b0 msgr2=0x7f830c0cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:19.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8312619640 1 -- 172.21.15.6:0/3969276673 shutdown_connections 2023-07-21T22:55:19.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8312619640 1 -- 172.21.15.6:0/3969276673 wait complete. 2023-07-21T22:55:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8312619640 1 Processor -- start 2023-07-21T22:55:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8312619640 1 -- start start 2023-07-21T22:55:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8312619640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f830c070e10 0x7f830c1583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8312619640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f830c0c13d0 0x7f830c0b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8312619640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f830c15fd60 0x7f830c15ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8312619640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c0c3300 con 0x7f830c070e10 2023-07-21T22:55:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8312619640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830c0c29d0 con 0x7f830c0c13d0 2023-07-21T22:55:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8312619640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830c0c2cb0 con 0x7f830c15fd60 2023-07-21T22:55:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8311617640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f830c070e10 0x7f830c1583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:19.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8311617640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f830c070e10 0x7f830c1583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35526/0 (socket says 172.21.15.6:35526) 2023-07-21T22:55:19.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8311617640 1 -- 172.21.15.6:0/250350601 learned_addr learned my addr 172.21.15.6:0/250350601 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:19.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8311617640 1 -- 172.21.15.6:0/250350601 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f830c15fd60 msgr2=0x7f830c15ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:19.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8311617640 1 --2- 172.21.15.6:0/250350601 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f830c15fd60 0x7f830c15ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:19.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8311617640 1 -- 172.21.15.6:0/250350601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f830c0c13d0 msgr2=0x7f830c0b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:19.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8311617640 1 --2- 172.21.15.6:0/250350601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f830c0c13d0 0x7f830c0b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:19.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.586+0000 7f8311617640 1 -- 172.21.15.6:0/250350601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82fc0094d0 con 0x7f830c070e10 2023-07-21T22:55:19.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.590+0000 7f8311617640 1 --2- 172.21.15.6:0/250350601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f830c070e10 0x7f830c1583d0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f830800d800 tx=0x7f830800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:19.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.590+0000 7f8301ffb640 1 -- 172.21.15.6:0/250350601 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830800b6c0 con 0x7f830c070e10 2023-07-21T22:55:19.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.590+0000 7f8301ffb640 1 -- 172.21.15.6:0/250350601 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830800b840 con 0x7f830c070e10 2023-07-21T22:55:19.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.590+0000 7f8312619640 1 -- 172.21.15.6:0/250350601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830c0c2f90 con 0x7f830c070e10 2023-07-21T22:55:19.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.590+0000 7f8301ffb640 1 -- 172.21.15.6:0/250350601 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830800bbf0 con 0x7f830c070e10 2023-07-21T22:55:19.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.590+0000 7f8312619640 1 -- 172.21.15.6:0/250350601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830c15b840 con 0x7f830c070e10 2023-07-21T22:55:19.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.590+0000 7f8312619640 1 -- 172.21.15.6:0/250350601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f830c04e020 con 0x7f830c070e10 2023-07-21T22:55:19.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.590+0000 7f8301ffb640 1 -- 172.21.15.6:0/250350601 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 77) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f830800bd50 con 0x7f830c070e10 2023-07-21T22:55:19.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.590+0000 7f8301ffb640 1 --2- 172.21.15.6:0/250350601 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f82f0066420 0x7f82f00688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:19.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.590+0000 7f8301ffb640 1 -- 172.21.15.6:0/250350601 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6822+0+0 (secure 0 0 0) 0x7f8308084810 con 0x7f830c070e10 2023-07-21T22:55:19.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.590+0000 7f8310e16640 1 --2- 172.21.15.6:0/250350601 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f82f0066420 0x7f82f00688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:19.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.594+0000 7f8310e16640 1 --2- 172.21.15.6:0/250350601 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f82f0066420 0x7f82f00688d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0ad000 tx=0x7f82fc004740 comp rx=0 tx=0).ready entity=mgr.9211 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:19.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.594+0000 7f8301ffb640 1 -- 172.21.15.6:0/250350601 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8308051750 con 0x7f830c070e10 2023-07-21T22:55:19.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:19.786+0000 7f8312619640 1 -- 172.21.15.6:0/250350601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f830c0ca5b0 con 0x7f830c070e10 2023-07-21T22:55:20.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.274+0000 7f8301ffb640 1 -- 172.21.15.6:0/250350601 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f8308051b20 con 0x7f830c070e10 2023-07-21T22:55:20.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.278+0000 7f8301ffb640 1 -- 172.21.15.6:0/250350601 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v78) v1 ==== 93+0+0 (secure 0 0 0) 0x7f8308051750 con 0x7f830c070e10 2023-07-21T22:55:20.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.278+0000 7f8312619640 1 -- 172.21.15.6:0/250350601 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f82f0066420 msgr2=0x7f82f00688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:20.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.278+0000 7f8312619640 1 --2- 172.21.15.6:0/250350601 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f82f0066420 0x7f82f00688d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0ad000 tx=0x7f82fc004740 comp rx=0 tx=0).stop 2023-07-21T22:55:20.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.278+0000 7f8312619640 1 -- 172.21.15.6:0/250350601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f830c070e10 msgr2=0x7f830c1583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:20.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.278+0000 7f8312619640 1 --2- 172.21.15.6:0/250350601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f830c070e10 0x7f830c1583d0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f830800d800 tx=0x7f830800dcc0 comp rx=0 tx=0).stop 2023-07-21T22:55:20.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.278+0000 7f8312619640 1 -- 172.21.15.6:0/250350601 shutdown_connections 2023-07-21T22:55:20.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.278+0000 7f8312619640 1 --2- 172.21.15.6:0/250350601 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f82f0066420 0x7f82f00688d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:20.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.278+0000 7f8312619640 1 --2- 172.21.15.6:0/250350601 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f830c15fd60 0x7f830c15ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:20.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.278+0000 7f8312619640 1 --2- 172.21.15.6:0/250350601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f830c0c13d0 0x7f830c0b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:20.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.278+0000 7f8312619640 1 --2- 172.21.15.6:0/250350601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f830c070e10 0x7f830c1583d0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:20.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.278+0000 7f8312619640 1 -- 172.21.15.6:0/250350601 >> 172.21.15.6:0/250350601 conn(0x7f830c0ca8b0 msgr2=0x7f830c159270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:20.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.278+0000 7f8312619640 1 -- 172.21.15.6:0/250350601 shutdown_connections 2023-07-21T22:55:20.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.278+0000 7f8312619640 1 -- 172.21.15.6:0/250350601 wait complete. 2023-07-21T22:55:20.338 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:55:20.339 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:55:20.389 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:55:20.464 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:55:20.465 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:55:20.466 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:55:20.476 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:55:20.477 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:55:20.492 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:20.454+0000 7fac8ee2c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:55:20.495 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:20.465+0000 7f5115446180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:55:20.503 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:55:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.654+0000 7fc3ed834640 1 Processor -- start 2023-07-21T22:55:20.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.654+0000 7fc3ed834640 1 -- start start 2023-07-21T22:55:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.654+0000 7fc3ed834640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc3e815fd60 0x7fc3e80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:20.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.654+0000 7fc3ed834640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e80ccaf0 con 0x7fc3e80d1850 2023-07-21T22:55:20.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.654+0000 7fc3ed834640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e8160320 con 0x7fc3e80b7c70 2023-07-21T22:55:20.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.654+0000 7fc3ed834640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e80d1190 con 0x7fc3e815fd60 2023-07-21T22:55:20.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.654+0000 7fc3e77fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc3e80d1850 0x7fc3e80d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58516/0 (socket says 172.21.15.6:58516) 2023-07-21T22:55:20.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.654+0000 7fc3e77fe640 1 -- 172.21.15.6:0/3337679764 learned_addr learned my addr 172.21.15.6:0/3337679764 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:20.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.654+0000 7fc3dffff640 1 --2- 172.21.15.6:0/3337679764 >> v2:172.21.15.161:3300/0 conn(0x7fc3e815fd60 0x7fc3e80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:20.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.654+0000 7fc3e67fc640 1 -- 172.21.15.6:0/3337679764 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809645099 0 0) 0x7fc3e80ccaf0 con 0x7fc3e80d1850 2023-07-21T22:55:20.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.654+0000 7fc3e67fc640 1 -- 172.21.15.6:0/3337679764 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3d4003530 con 0x7fc3e80d1850 2023-07-21T22:55:20.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.654+0000 7fc3dffff640 1 -- 172.21.15.6:0/3337679764 >> v1:172.21.15.161:6789/0 conn(0x7fc3e80b7c70 legacy=0x7fc3e815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:20.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.654+0000 7fc3dffff640 1 -- 172.21.15.6:0/3337679764 >> v1:172.21.15.6:6789/0 conn(0x7fc3e80d1850 legacy=0x7fc3e80d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:20.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.654+0000 7fc3dffff640 1 -- 172.21.15.6:0/3337679764 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e80ccd90 con 0x7fc3e815fd60 2023-07-21T22:55:20.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.658+0000 7fc3dffff640 1 --2- 172.21.15.6:0/3337679764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3e815fd60 0x7fc3e80d0c50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00097c0 tx=0x7fc3d001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e7dc9f02eb2d1f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.658+0000 7fc3e67fc640 1 -- 172.21.15.6:0/3337679764 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d00a8050 con 0x7fc3e815fd60 2023-07-21T22:55:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.658+0000 7fc3e67fc640 1 -- 172.21.15.6:0/3337679764 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d00ac5f0 con 0x7fc3e815fd60 2023-07-21T22:55:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.658+0000 7fc3e67fc640 1 -- 172.21.15.6:0/3337679764 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d00ac960 con 0x7fc3e815fd60 2023-07-21T22:55:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.658+0000 7fc3ed834640 1 -- 172.21.15.6:0/3337679764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3e815fd60 msgr2=0x7fc3e80d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.658+0000 7fc3ed834640 1 --2- 172.21.15.6:0/3337679764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3e815fd60 0x7fc3e80d0c50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc3d00097c0 tx=0x7fc3d001c480 comp rx=0 tx=0).stop 2023-07-21T22:55:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.658+0000 7fc3ed834640 1 -- 172.21.15.6:0/3337679764 shutdown_connections 2023-07-21T22:55:20.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.658+0000 7fc3ed834640 1 --2- 172.21.15.6:0/3337679764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3e815fd60 0x7fc3e80d0c50 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:20.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.658+0000 7fc3ed834640 1 -- 172.21.15.6:0/3337679764 >> 172.21.15.6:0/3337679764 conn(0x7fc3e80650b0 msgr2=0x7fc3e80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:20.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.658+0000 7fc3ed834640 1 -- 172.21.15.6:0/3337679764 shutdown_connections 2023-07-21T22:55:20.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.658+0000 7fc3ed834640 1 -- 172.21.15.6:0/3337679764 wait complete. 2023-07-21T22:55:20.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.662+0000 7fc3ed834640 1 Processor -- start 2023-07-21T22:55:20.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.662+0000 7fc3ed834640 1 -- start start 2023-07-21T22:55:20.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.662+0000 7fc3ed834640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e80b7c70 0x7fc3e80c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.662+0000 7fc3ed834640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3e80d1850 0x7fc3e80b6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.662+0000 7fc3ed834640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3e815fd60 0x7fc3e80b6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.662+0000 7fc3ed834640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e80b71d0 con 0x7fc3e80b7c70 2023-07-21T22:55:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.662+0000 7fc3ed834640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e8156970 con 0x7fc3e815fd60 2023-07-21T22:55:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.662+0000 7fc3ed834640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e81566d0 con 0x7fc3e80d1850 2023-07-21T22:55:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.662+0000 7fc3e6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e80b7c70 0x7fc3e80c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:20.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.662+0000 7fc3e6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e80b7c70 0x7fc3e80c63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35544/0 (socket says 172.21.15.6:35544) 2023-07-21T22:55:20.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.662+0000 7fc3e6ffd640 1 -- 172.21.15.6:0/1362533766 learned_addr learned my addr 172.21.15.6:0/1362533766 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:20.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.662+0000 7fc3e77fe640 1 --2- 172.21.15.6:0/1362533766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3e815fd60 0x7fc3e80b6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:20.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.662+0000 7fc3dffff640 1 --2- 172.21.15.6:0/1362533766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3e80d1850 0x7fc3e80b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:20.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.662+0000 7fc3e6ffd640 1 -- 172.21.15.6:0/1362533766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3e80d1850 msgr2=0x7fc3e80b6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:20.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.662+0000 7fc3e6ffd640 1 --2- 172.21.15.6:0/1362533766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3e80d1850 0x7fc3e80b6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:20.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.662+0000 7fc3e6ffd640 1 -- 172.21.15.6:0/1362533766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3e815fd60 msgr2=0x7fc3e80b6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:20.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.662+0000 7fc3e6ffd640 1 --2- 172.21.15.6:0/1362533766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3e815fd60 0x7fc3e80b6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:20.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.662+0000 7fc3e6ffd640 1 -- 172.21.15.6:0/1362533766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d0009420 con 0x7fc3e80b7c70 2023-07-21T22:55:20.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.662+0000 7fc3e77fe640 1 --2- 172.21.15.6:0/1362533766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3e815fd60 0x7fc3e80b6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:55:20.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.662+0000 7fc3e6ffd640 1 --2- 172.21.15.6:0/1362533766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e80b7c70 0x7fc3e80c63f0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800c3c0 tx=0x7fc3d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:20.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.666+0000 7fc3e4ff9640 1 -- 172.21.15.6:0/1362533766 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d80052d0 con 0x7fc3e80b7c70 2023-07-21T22:55:20.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.666+0000 7fc3e4ff9640 1 -- 172.21.15.6:0/1362533766 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d8005430 con 0x7fc3e80b7c70 2023-07-21T22:55:20.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.666+0000 7fc3ed834640 1 -- 172.21.15.6:0/1362533766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e80b5c70 con 0x7fc3e80b7c70 2023-07-21T22:55:20.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.666+0000 7fc3e4ff9640 1 -- 172.21.15.6:0/1362533766 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8003840 con 0x7fc3e80b7c70 2023-07-21T22:55:20.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.666+0000 7fc3ed834640 1 -- 172.21.15.6:0/1362533766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e80b6230 con 0x7fc3e80b7c70 2023-07-21T22:55:20.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.666+0000 7fc3ed834640 1 -- 172.21.15.6:0/1362533766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e80b6450 con 0x7fc3e80b7c70 2023-07-21T22:55:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.666+0000 7fc3e4ff9640 1 -- 172.21.15.6:0/1362533766 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fc3d80039a0 con 0x7fc3e80b7c70 2023-07-21T22:55:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.670+0000 7fc3e4ff9640 1 --2- 172.21.15.6:0/1362533766 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fc3c80663a0 0x7fc3c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.670+0000 7fc3e4ff9640 1 -- 172.21.15.6:0/1362533766 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6822+0+0 (secure 0 0 0) 0x7fc3d8083570 con 0x7fc3e80b7c70 2023-07-21T22:55:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.670+0000 7fc3dffff640 1 -- 172.21.15.6:0/1362533766 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fc3c80663a0 msgr2=0x7fc3c8068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/835248343 2023-07-21T22:55:20.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.670+0000 7fc3dffff640 1 --2- 172.21.15.6:0/1362533766 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fc3c80663a0 0x7fc3c8068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:55:20.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.674+0000 7fc3e4ff9640 1 -- 172.21.15.6:0/1362533766 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc3d8050720 con 0x7fc3e80b7c70 2023-07-21T22:55:20.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.830+0000 7fc3ed834640 1 -- 172.21.15.6:0/1362533766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3e80678d0 con 0x7fc3e80b7c70 2023-07-21T22:55:20.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.830+0000 7fc3e4ff9640 1 -- 172.21.15.6:0/1362533766 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+19367 (secure 0 0 0) 0x7fc3d8053d40 con 0x7fc3e80b7c70 2023-07-21T22:55:20.870 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:20.870 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":159,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:50:20.828411+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:39:01.548583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-21T22:39:02.416927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/1641497343":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/1520394641":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/52253068":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/3217579618":"2023-07-22T22:50:20.828371+0000","172.21.15.161:6833/3096900160":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/1245542883":"2023-07-22T22:39:20.660905+0000","172.21.15.161:0/2766778262":"2023-07-22T22:39:20.660905+0000","172.21.15.161:0/2288195162":"2023-07-22T22:39:20.660905+0000","172.21.15.161:0/107992510":"2023-07-22T22:50:20.828371+0000","172.21.15.161:6833/2692111396":"2023-07-22T22:39:20.660905+0000","172.21.15.161:6832/3096900160":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/4115864188":"2023-07-22T22:39:20.660905+0000","172.21.15.161:6832/2692111396":"2023-07-22T22:39:20.660905+0000","172.21.15.161:0/2485992449":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/389976077":"2023-07-22T22:39:20.660905+0000","172.21.15.161:0/1635694091":"2023-07-22T22:39:20.660905+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:55:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.834+0000 7fc3ed834640 1 -- 172.21.15.6:0/1362533766 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fc3c80663a0 msgr2=0x7fc3c8068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:55:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.834+0000 7fc3ed834640 1 --2- 172.21.15.6:0/1362533766 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fc3c80663a0 0x7fc3c8068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.834+0000 7fc3ed834640 1 -- 172.21.15.6:0/1362533766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e80b7c70 msgr2=0x7fc3e80c63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.834+0000 7fc3ed834640 1 --2- 172.21.15.6:0/1362533766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e80b7c70 0x7fc3e80c63f0 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800c3c0 tx=0x7fc3d800c880 comp rx=0 tx=0).stop 2023-07-21T22:55:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.834+0000 7fc3ed834640 1 -- 172.21.15.6:0/1362533766 shutdown_connections 2023-07-21T22:55:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.834+0000 7fc3ed834640 1 --2- 172.21.15.6:0/1362533766 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fc3c80663a0 0x7fc3c8068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.834+0000 7fc3ed834640 1 --2- 172.21.15.6:0/1362533766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3e815fd60 0x7fc3e80b6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.834+0000 7fc3ed834640 1 --2- 172.21.15.6:0/1362533766 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3e80d1850 0x7fc3e80b6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.834+0000 7fc3ed834640 1 --2- 172.21.15.6:0/1362533766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3e80b7c70 0x7fc3e80c63f0 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.834+0000 7fc3ed834640 1 -- 172.21.15.6:0/1362533766 >> 172.21.15.6:0/1362533766 conn(0x7fc3e80650b0 msgr2=0x7fc3e8156e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.834+0000 7fc3ed834640 1 -- 172.21.15.6:0/1362533766 shutdown_connections 2023-07-21T22:55:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:20.834+0000 7fc3ed834640 1 -- 172.21.15.6:0/1362533766 wait complete. 2023-07-21T22:55:20.893 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:39:01.548583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '156', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:39:02.416927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:55:20.894 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:55:20.910 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:20.881+0000 7f5115446180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:55:20.940 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:20.902+0000 7fac8ee2c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:55:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.006+0000 7fa506c96640 1 Processor -- start 2023-07-21T22:55:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.006+0000 7fa506c96640 1 -- start start 2023-07-21T22:55:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.006+0000 7fa506c96640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5000d2fc0 0x7fa5000b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.006+0000 7fa506c96640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5000b04c0 con 0x7fa50015bde0 2023-07-21T22:55:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.010+0000 7fa506c96640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5000d0aa0 con 0x7fa5000d2300 2023-07-21T22:55:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.010+0000 7fa506c96640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50015c1b0 con 0x7fa5000d2fc0 2023-07-21T22:55:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.010+0000 7fa504a32640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa50015bde0 0x7fa5000d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58530/0 (socket says 172.21.15.6:58530) 2023-07-21T22:55:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.010+0000 7fa504a32640 1 -- 172.21.15.6:0/87397585 learned_addr learned my addr 172.21.15.6:0/87397585 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:21.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.010+0000 7fa4fffff640 1 --2- 172.21.15.6:0/87397585 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5000d2fc0 0x7fa5000b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.010+0000 7fa4ff7fe640 1 -- 172.21.15.6:0/87397585 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319954194 0 0) 0x7fa5000b04c0 con 0x7fa50015bde0 2023-07-21T22:55:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.010+0000 7fa4ff7fe640 1 -- 172.21.15.6:0/87397585 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4f0003530 con 0x7fa50015bde0 2023-07-21T22:55:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.010+0000 7fa4ff7fe640 1 -- 172.21.15.6:0/87397585 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678105382 0 0) 0x7fa5000d0aa0 con 0x7fa5000d2300 2023-07-21T22:55:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.010+0000 7fa4ff7fe640 1 -- 172.21.15.6:0/87397585 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5000b04c0 con 0x7fa5000d2300 2023-07-21T22:55:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.010+0000 7fa4fffff640 1 -- 172.21.15.6:0/87397585 >> v1:172.21.15.161:6789/0 conn(0x7fa5000d2300 legacy=0x7fa5000cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.010+0000 7fa4fffff640 1 -- 172.21.15.6:0/87397585 >> v1:172.21.15.6:6789/0 conn(0x7fa50015bde0 legacy=0x7fa5000d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:21.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.010+0000 7fa4ff7fe640 1 -- 172.21.15.6:0/87397585 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1476619151 0 0) 0x7fa4f0003530 con 0x7fa50015bde0 2023-07-21T22:55:21.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.010+0000 7fa4fffff640 1 -- 172.21.15.6:0/87397585 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5000afb90 con 0x7fa5000d2fc0 2023-07-21T22:55:21.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.010+0000 7fa4fffff640 1 --2- 172.21.15.6:0/87397585 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5000d2fc0 0x7fa5000b0950 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0097f0 tx=0x7fa4ec01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed487199a9162866 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:21.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.014+0000 7fa4ff7fe640 1 -- 172.21.15.6:0/87397585 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4001800 con 0x7fa5000d2fc0 2023-07-21T22:55:21.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.014+0000 7fa4ff7fe640 1 -- 172.21.15.6:0/87397585 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ec0ad460 con 0x7fa5000d2fc0 2023-07-21T22:55:21.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.014+0000 7fa4ff7fe640 1 -- 172.21.15.6:0/87397585 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec0ad7f0 con 0x7fa5000d2fc0 2023-07-21T22:55:21.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.014+0000 7fa506c96640 1 -- 172.21.15.6:0/87397585 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5000d2fc0 msgr2=0x7fa5000b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:21.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.014+0000 7fa506c96640 1 --2- 172.21.15.6:0/87397585 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5000d2fc0 0x7fa5000b0950 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0097f0 tx=0x7fa4ec01c3e0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.014+0000 7fa506c96640 1 -- 172.21.15.6:0/87397585 shutdown_connections 2023-07-21T22:55:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.014+0000 7fa506c96640 1 --2- 172.21.15.6:0/87397585 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5000d2fc0 0x7fa5000b0950 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.014+0000 7fa506c96640 1 -- 172.21.15.6:0/87397585 >> 172.21.15.6:0/87397585 conn(0x7fa5000659d0 msgr2=0x7fa50009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.014+0000 7fa506c96640 1 -- 172.21.15.6:0/87397585 shutdown_connections 2023-07-21T22:55:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.014+0000 7fa506c96640 1 -- 172.21.15.6:0/87397585 wait complete. 2023-07-21T22:55:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.014+0000 7fa506c96640 1 Processor -- start 2023-07-21T22:55:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.014+0000 7fa506c96640 1 -- start start 2023-07-21T22:55:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.014+0000 7fa506c96640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5000d2300 0x7fa50014d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.014+0000 7fa506c96640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5000d2fc0 0x7fa5000b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.014+0000 7fa506c96640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa50015bde0 0x7fa5000b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.014+0000 7fa506c96640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50015d380 con 0x7fa5000d2300 2023-07-21T22:55:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.014+0000 7fa506c96640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50015c420 con 0x7fa5000d2fc0 2023-07-21T22:55:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.014+0000 7fa506c96640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5000ccb80 con 0x7fa50015bde0 2023-07-21T22:55:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.018+0000 7fa504a32640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5000d2300 0x7fa50014d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.018+0000 7fa4fffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5000d2fc0 0x7fa5000b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.018+0000 7fa504a32640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5000d2300 0x7fa50014d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35556/0 (socket says 172.21.15.6:35556) 2023-07-21T22:55:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.018+0000 7fa504a32640 1 -- 172.21.15.6:0/2128094348 learned_addr learned my addr 172.21.15.6:0/2128094348 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.018+0000 7fa505233640 1 --2- 172.21.15.6:0/2128094348 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa50015bde0 0x7fa5000b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:21.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.018+0000 7fa504a32640 1 -- 172.21.15.6:0/2128094348 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa50015bde0 msgr2=0x7fa5000b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.018+0000 7fa504a32640 1 --2- 172.21.15.6:0/2128094348 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa50015bde0 0x7fa5000b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.018+0000 7fa504a32640 1 -- 172.21.15.6:0/2128094348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5000d2fc0 msgr2=0x7fa5000b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.018+0000 7fa504a32640 1 --2- 172.21.15.6:0/2128094348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5000d2fc0 0x7fa5000b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.018+0000 7fa504a32640 1 -- 172.21.15.6:0/2128094348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec009420 con 0x7fa5000d2300 2023-07-21T22:55:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.018+0000 7fa504a32640 1 --2- 172.21.15.6:0/2128094348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5000d2300 0x7fa50014d4f0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400c780 tx=0x7fa4f400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.018+0000 7fa4fd7fa640 1 -- 172.21.15.6:0/2128094348 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4007270 con 0x7fa5000d2300 2023-07-21T22:55:21.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.018+0000 7fa4fd7fa640 1 -- 172.21.15.6:0/2128094348 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f40073d0 con 0x7fa5000d2300 2023-07-21T22:55:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.018+0000 7fa4fd7fa640 1 -- 172.21.15.6:0/2128094348 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f40057b0 con 0x7fa5000d2300 2023-07-21T22:55:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.018+0000 7fa506c96640 1 -- 172.21.15.6:0/2128094348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50015ccc0 con 0x7fa5000d2300 2023-07-21T22:55:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.018+0000 7fa506c96640 1 -- 172.21.15.6:0/2128094348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5001504d0 con 0x7fa5000d2300 2023-07-21T22:55:21.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.018+0000 7fa506c96640 1 -- 172.21.15.6:0/2128094348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5000678d0 con 0x7fa5000d2300 2023-07-21T22:55:21.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.018+0000 7fa4fd7fa640 1 -- 172.21.15.6:0/2128094348 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fa4f4005910 con 0x7fa5000d2300 2023-07-21T22:55:21.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.022+0000 7fa4fd7fa640 1 --2- 172.21.15.6:0/2128094348 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fa4e40663a0 0x7fa4e4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:21.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.022+0000 7fa4fd7fa640 1 -- 172.21.15.6:0/2128094348 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6822+0+0 (secure 0 0 0) 0x7fa4f4083970 con 0x7fa5000d2300 2023-07-21T22:55:21.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.022+0000 7fa4fffff640 1 -- 172.21.15.6:0/2128094348 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fa4e40663a0 msgr2=0x7fa4e4068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/835248343 2023-07-21T22:55:21.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.022+0000 7fa4fffff640 1 --2- 172.21.15.6:0/2128094348 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fa4e40663a0 0x7fa4e4068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:55:21.061 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:21.033+0000 7f5115446180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:55:21.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.026+0000 7fa4fd7fa640 1 -- 172.21.15.6:0/2128094348 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa4f40509f0 con 0x7fa5000d2300 2023-07-21T22:55:21.103 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:21.066+0000 7fac8ee2c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:55:21.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.182+0000 7fa506c96640 1 -- 172.21.15.6:0/2128094348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5000d1500 con 0x7fa5000d2300 2023-07-21T22:55:21.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.182+0000 7fa4fd7fa640 1 -- 172.21.15.6:0/2128094348 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v159) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa4f40170a0 con 0x7fa5000d2300 2023-07-21T22:55:21.220 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:55:21.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.182+0000 7fa506c96640 1 -- 172.21.15.6:0/2128094348 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fa4e40663a0 msgr2=0x7fa4e4068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:55:21.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.182+0000 7fa506c96640 1 --2- 172.21.15.6:0/2128094348 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fa4e40663a0 0x7fa4e4068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.182+0000 7fa506c96640 1 -- 172.21.15.6:0/2128094348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5000d2300 msgr2=0x7fa50014d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:21.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.182+0000 7fa506c96640 1 --2- 172.21.15.6:0/2128094348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5000d2300 0x7fa50014d4f0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fa4f400c780 tx=0x7fa4f400cc40 comp rx=0 tx=0).stop 2023-07-21T22:55:21.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.186+0000 7fa506c96640 1 -- 172.21.15.6:0/2128094348 shutdown_connections 2023-07-21T22:55:21.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.186+0000 7fa506c96640 1 --2- 172.21.15.6:0/2128094348 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fa4e40663a0 0x7fa4e4068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.186+0000 7fa506c96640 1 --2- 172.21.15.6:0/2128094348 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa50015bde0 0x7fa5000b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.186+0000 7fa506c96640 1 --2- 172.21.15.6:0/2128094348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5000d2fc0 0x7fa5000b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.186+0000 7fa506c96640 1 --2- 172.21.15.6:0/2128094348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5000d2300 0x7fa50014d4f0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.186+0000 7fa506c96640 1 -- 172.21.15.6:0/2128094348 >> 172.21.15.6:0/2128094348 conn(0x7fa5000659d0 msgr2=0x7fa50006afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:21.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.186+0000 7fa506c96640 1 -- 172.21.15.6:0/2128094348 shutdown_connections 2023-07-21T22:55:21.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.186+0000 7fa506c96640 1 -- 172.21.15.6:0/2128094348 wait complete. 2023-07-21T22:55:21.243 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:55:21.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.394+0000 7f3ccce93640 1 Processor -- start 2023-07-21T22:55:21.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.394+0000 7f3ccce93640 1 -- start start 2023-07-21T22:55:21.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.398+0000 7f3ccce93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cc815bde0 0x7f3cc80d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:21.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.398+0000 7f3ccce93640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3cc80d2fc0 0x7f3cc80b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:21.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.398+0000 7f3ccce93640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc80b04c0 con 0x7f3cc80d2300 2023-07-21T22:55:21.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.398+0000 7f3ccce93640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cc815c1b0 con 0x7f3cc80d2fc0 2023-07-21T22:55:21.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.398+0000 7f3ccce93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc80d0aa0 con 0x7f3cc815bde0 2023-07-21T22:55:21.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.398+0000 7f3cc6d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3cc80d2300 0x7f3cc80cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58536/0 (socket says 172.21.15.6:58536) 2023-07-21T22:55:21.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.398+0000 7f3cc6d9d640 1 -- 172.21.15.6:0/3182546636 learned_addr learned my addr 172.21.15.6:0/3182546636 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:21.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.398+0000 7f3cc5d9b640 1 --2- 172.21.15.6:0/3182546636 >> v2:172.21.15.161:3300/0 conn(0x7f3cc80d2fc0 0x7f3cc80b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:21.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.398+0000 7f3cc659c640 1 --2- 172.21.15.6:0/3182546636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cc815bde0 0x7f3cc80d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:21.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.398+0000 7f3cc559a640 1 -- 172.21.15.6:0/3182546636 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3563116660 0 0) 0x7f3cc80b04c0 con 0x7f3cc80d2300 2023-07-21T22:55:21.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.398+0000 7f3cc559a640 1 -- 172.21.15.6:0/3182546636 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cb0003530 con 0x7f3cc80d2300 2023-07-21T22:55:21.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.398+0000 7f3cc5d9b640 1 -- 172.21.15.6:0/3182546636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cc815bde0 msgr2=0x7f3cc80d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:21.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.398+0000 7f3cc5d9b640 1 --2- 172.21.15.6:0/3182546636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cc815bde0 0x7f3cc80d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.398+0000 7f3cc5d9b640 1 -- 172.21.15.6:0/3182546636 >> v1:172.21.15.6:6789/0 conn(0x7f3cc80d2300 legacy=0x7f3cc80cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:21.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.398+0000 7f3cc5d9b640 1 -- 172.21.15.6:0/3182546636 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc80afb90 con 0x7f3cc80d2fc0 2023-07-21T22:55:21.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.398+0000 7f3cc659c640 1 --2- 172.21.15.6:0/3182546636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cc815bde0 0x7f3cc80d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:55:21.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.402+0000 7f3cc5d9b640 1 --2- 172.21.15.6:0/3182546636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cc80d2fc0 0x7f3cc80b0950 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc0097c0 tx=0x7f3cbc01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=300c317c20db006 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:21.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.402+0000 7f3cc559a640 1 -- 172.21.15.6:0/3182546636 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc0ab680 con 0x7f3cc80d2fc0 2023-07-21T22:55:21.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.402+0000 7f3cc559a640 1 -- 172.21.15.6:0/3182546636 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cbc0ab7e0 con 0x7f3cc80d2fc0 2023-07-21T22:55:21.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.402+0000 7f3cc559a640 1 -- 172.21.15.6:0/3182546636 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc0abb70 con 0x7f3cc80d2fc0 2023-07-21T22:55:21.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.402+0000 7f3ccce93640 1 -- 172.21.15.6:0/3182546636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cc80d2fc0 msgr2=0x7f3cc80b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:21.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.402+0000 7f3ccce93640 1 --2- 172.21.15.6:0/3182546636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cc80d2fc0 0x7f3cc80b0950 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc0097c0 tx=0x7f3cbc01c480 comp rx=0 tx=0).stop 2023-07-21T22:55:21.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.402+0000 7f3ccce93640 1 -- 172.21.15.6:0/3182546636 shutdown_connections 2023-07-21T22:55:21.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.402+0000 7f3ccce93640 1 --2- 172.21.15.6:0/3182546636 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cc80d2fc0 0x7f3cc80b0950 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.402+0000 7f3ccce93640 1 --2- 172.21.15.6:0/3182546636 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cc815bde0 0x7f3cc80d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.402+0000 7f3ccce93640 1 -- 172.21.15.6:0/3182546636 >> 172.21.15.6:0/3182546636 conn(0x7f3cc80659d0 msgr2=0x7f3cc809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:21.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.402+0000 7f3ccce93640 1 -- 172.21.15.6:0/3182546636 shutdown_connections 2023-07-21T22:55:21.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.402+0000 7f3ccce93640 1 -- 172.21.15.6:0/3182546636 wait complete. 2023-07-21T22:55:21.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3ccce93640 1 Processor -- start 2023-07-21T22:55:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3ccce93640 1 -- start start 2023-07-21T22:55:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3ccce93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cc80d2300 0x7f3cc8155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3ccce93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cc80d2fc0 0x7f3cc8159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3ccce93640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cc815bde0 0x7f3cc8159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3ccce93640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc815d360 con 0x7f3cc80d2fc0 2023-07-21T22:55:21.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3ccce93640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc815d640 con 0x7f3cc815bde0 2023-07-21T22:55:21.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3ccce93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc815d920 con 0x7f3cc80d2300 2023-07-21T22:55:21.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3cc5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cc80d2fc0 0x7f3cc8159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:21.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3cc5d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cc80d2fc0 0x7f3cc8159800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35560/0 (socket says 172.21.15.6:35560) 2023-07-21T22:55:21.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3cc5d9b640 1 -- 172.21.15.6:0/2685764503 learned_addr learned my addr 172.21.15.6:0/2685764503 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:21.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3cc6d9d640 1 --2- 172.21.15.6:0/2685764503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cc815bde0 0x7f3cc8159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:21.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3cc659c640 1 --2- 172.21.15.6:0/2685764503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cc80d2300 0x7f3cc8155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:21.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3cc5d9b640 1 -- 172.21.15.6:0/2685764503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cc80d2300 msgr2=0x7f3cc8155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:21.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3cc5d9b640 1 --2- 172.21.15.6:0/2685764503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cc80d2300 0x7f3cc8155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3cc5d9b640 1 -- 172.21.15.6:0/2685764503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cc815bde0 msgr2=0x7f3cc8159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:21.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3cc5d9b640 1 --2- 172.21.15.6:0/2685764503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cc815bde0 0x7f3cc8159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3cc5d9b640 1 -- 172.21.15.6:0/2685764503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb80093b0 con 0x7f3cc80d2fc0 2023-07-21T22:55:21.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3cc5d9b640 1 --2- 172.21.15.6:0/2685764503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cc80d2fc0 0x7f3cc8159800 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc0ad040 tx=0x7f3cbc01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:21.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3cb6ffd640 1 -- 172.21.15.6:0/2685764503 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc0bf610 con 0x7f3cc80d2fc0 2023-07-21T22:55:21.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3cb6ffd640 1 -- 172.21.15.6:0/2685764503 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cbc0bf790 con 0x7f3cc80d2fc0 2023-07-21T22:55:21.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3cb6ffd640 1 -- 172.21.15.6:0/2685764503 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc0bfb40 con 0x7f3cc80d2fc0 2023-07-21T22:55:21.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3ccce93640 1 -- 172.21.15.6:0/2685764503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cbc009420 con 0x7f3cc80d2fc0 2023-07-21T22:55:21.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3ccce93640 1 -- 172.21.15.6:0/2685764503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc815dee0 con 0x7f3cc80d2fc0 2023-07-21T22:55:21.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.406+0000 7f3ccce93640 1 -- 172.21.15.6:0/2685764503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc815e0d0 con 0x7f3cc80d2fc0 2023-07-21T22:55:21.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.410+0000 7f3cb6ffd640 1 -- 172.21.15.6:0/2685764503 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f3cbc0b5400 con 0x7f3cc80d2fc0 2023-07-21T22:55:21.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.410+0000 7f3cb6ffd640 1 --2- 172.21.15.6:0/2685764503 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f3ca80663a0 0x7f3ca8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:21.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.410+0000 7f3cb6ffd640 1 -- 172.21.15.6:0/2685764503 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6822+0+0 (secure 0 0 0) 0x7f3cbc11ecc0 con 0x7f3cc80d2fc0 2023-07-21T22:55:21.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.410+0000 7f3cc659c640 1 -- 172.21.15.6:0/2685764503 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f3ca80663a0 msgr2=0x7f3ca8068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/835248343 2023-07-21T22:55:21.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.410+0000 7f3cc659c640 1 --2- 172.21.15.6:0/2685764503 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f3ca80663a0 0x7f3ca8068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:55:21.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.414+0000 7f3cb6ffd640 1 -- 172.21.15.6:0/2685764503 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3cbc125080 con 0x7f3cc80d2fc0 2023-07-21T22:55:21.542 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:21.513+0000 7f5115446180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:55:21.601 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:21.573+0000 7f5115446180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:55:21.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.570+0000 7f3ccce93640 1 -- 172.21.15.6:0/2685764503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3cc80678d0 con 0x7f3cc80d2fc0 2023-07-21T22:55:21.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.570+0000 7f3cb6ffd640 1 -- 172.21.15.6:0/2685764503 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v159) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3cbc0ebc30 con 0x7f3cc80d2fc0 2023-07-21T22:55:21.609 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:55:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.574+0000 7f3ccce93640 1 -- 172.21.15.6:0/2685764503 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f3ca80663a0 msgr2=0x7f3ca8068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:55:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.574+0000 7f3ccce93640 1 --2- 172.21.15.6:0/2685764503 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f3ca80663a0 0x7f3ca8068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.574+0000 7f3ccce93640 1 -- 172.21.15.6:0/2685764503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cc80d2fc0 msgr2=0x7f3cc8159800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:21.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.574+0000 7f3ccce93640 1 --2- 172.21.15.6:0/2685764503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cc80d2fc0 0x7f3cc8159800 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc0ad040 tx=0x7f3cbc01acc0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.574+0000 7f3ccce93640 1 -- 172.21.15.6:0/2685764503 shutdown_connections 2023-07-21T22:55:21.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.574+0000 7f3ccce93640 1 --2- 172.21.15.6:0/2685764503 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f3ca80663a0 0x7f3ca8068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.574+0000 7f3ccce93640 1 --2- 172.21.15.6:0/2685764503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3cc815bde0 0x7f3cc8159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.574+0000 7f3ccce93640 1 --2- 172.21.15.6:0/2685764503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cc80d2fc0 0x7f3cc8159800 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.574+0000 7f3ccce93640 1 --2- 172.21.15.6:0/2685764503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3cc80d2300 0x7f3cc8155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.574+0000 7f3ccce93640 1 -- 172.21.15.6:0/2685764503 >> 172.21.15.6:0/2685764503 conn(0x7f3cc80659d0 msgr2=0x7f3cc815b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:21.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.574+0000 7f3ccce93640 1 -- 172.21.15.6:0/2685764503 shutdown_connections 2023-07-21T22:55:21.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.574+0000 7f3ccce93640 1 -- 172.21.15.6:0/2685764503 wait complete. 2023-07-21T22:55:21.619 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:21.582+0000 7fac8ee2c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:55:21.631 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:55:21.656 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:21.625+0000 7f5115446180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:55:21.682 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:21.646+0000 7fac8ee2c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:55:21.741 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:21.713+0000 7f5115446180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:55:21.743 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:21.706+0000 7fac8ee2c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:55:21.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.742+0000 7ff833426640 1 Processor -- start 2023-07-21T22:55:21.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.742+0000 7ff833426640 1 -- start start 2023-07-21T22:55:21.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.746+0000 7ff833426640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff82c160240 0x7ff82c0b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:21.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.746+0000 7ff833426640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff82c0aefc0 0x7ff82c0af440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:21.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.746+0000 7ff833426640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff82c0d0270 con 0x7ff82c0c58f0 2023-07-21T22:55:21.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.746+0000 7ff833426640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82c0d0550 con 0x7ff82c160240 2023-07-21T22:55:21.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.746+0000 7ff833426640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0b3530 con 0x7ff82c0aefc0 2023-07-21T22:55:21.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.746+0000 7ff8311c2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff82c160240 0x7ff82c0b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:21.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.746+0000 7ff8309c1640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff82c0c58f0 0x7ff82c0b2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58540/0 (socket says 172.21.15.6:58540) 2023-07-21T22:55:21.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.746+0000 7ff8309c1640 1 -- 172.21.15.6:0/3685022346 learned_addr learned my addr 172.21.15.6:0/3685022346 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:21.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.746+0000 7ff8319c3640 1 --2- 172.21.15.6:0/3685022346 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff82c0aefc0 0x7ff82c0af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:21.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.746+0000 7ff8311c2640 1 -- 172.21.15.6:0/3685022346 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff82c0aefc0 msgr2=0x7ff82c0af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:21.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.746+0000 7ff8311c2640 1 --2- 172.21.15.6:0/3685022346 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff82c0aefc0 0x7ff82c0af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.746+0000 7ff8311c2640 1 -- 172.21.15.6:0/3685022346 >> v1:172.21.15.6:6789/0 conn(0x7ff82c0c58f0 legacy=0x7ff82c0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:21.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.746+0000 7ff8311c2640 1 -- 172.21.15.6:0/3685022346 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c0b3810 con 0x7ff82c160240 2023-07-21T22:55:21.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.746+0000 7ff8319c3640 1 --2- 172.21.15.6:0/3685022346 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff82c0aefc0 0x7ff82c0af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:21.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.750+0000 7ff8311c2640 1 --2- 172.21.15.6:0/3685022346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff82c160240 0x7ff82c0b1b10 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7ff8280097a0 tx=0x7ff82801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539f858bcd749ad8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:21.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.750+0000 7ff823fff640 1 -- 172.21.15.6:0/3685022346 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8280ab600 con 0x7ff82c160240 2023-07-21T22:55:21.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.750+0000 7ff823fff640 1 -- 172.21.15.6:0/3685022346 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8280a7050 con 0x7ff82c160240 2023-07-21T22:55:21.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.750+0000 7ff823fff640 1 -- 172.21.15.6:0/3685022346 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8280ab980 con 0x7ff82c160240 2023-07-21T22:55:21.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.750+0000 7ff833426640 1 -- 172.21.15.6:0/3685022346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff82c160240 msgr2=0x7ff82c0b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:21.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.750+0000 7ff833426640 1 --2- 172.21.15.6:0/3685022346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff82c160240 0x7ff82c0b1b10 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7ff8280097a0 tx=0x7ff82801c3d0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.750+0000 7ff833426640 1 -- 172.21.15.6:0/3685022346 shutdown_connections 2023-07-21T22:55:21.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.750+0000 7ff833426640 1 --2- 172.21.15.6:0/3685022346 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff82c0aefc0 0x7ff82c0af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.750+0000 7ff833426640 1 --2- 172.21.15.6:0/3685022346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff82c160240 0x7ff82c0b1b10 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.750+0000 7ff833426640 1 -- 172.21.15.6:0/3685022346 >> 172.21.15.6:0/3685022346 conn(0x7ff82c0659d0 msgr2=0x7ff82c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:21.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.750+0000 7ff833426640 1 -- 172.21.15.6:0/3685022346 shutdown_connections 2023-07-21T22:55:21.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.750+0000 7ff833426640 1 -- 172.21.15.6:0/3685022346 wait complete. 2023-07-21T22:55:21.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.750+0000 7ff833426640 1 Processor -- start 2023-07-21T22:55:21.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.750+0000 7ff833426640 1 -- start start 2023-07-21T22:55:21.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff833426640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff82c0aefc0 0x7ff82c159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:21.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff833426640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff82c0c58f0 0x7ff82c15f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:21.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff833426640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff82c160240 0x7ff82c156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:21.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff833426640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c152580 con 0x7ff82c0c58f0 2023-07-21T22:55:21.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff833426640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0cb690 con 0x7ff82c160240 2023-07-21T22:55:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff833426640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c0cb970 con 0x7ff82c0aefc0 2023-07-21T22:55:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff8309c1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff82c0c58f0 0x7ff82c15f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff8311c2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff82c0aefc0 0x7ff82c159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff8311c2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff82c0aefc0 0x7ff82c159390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:55754/0 (socket says 172.21.15.6:55754) 2023-07-21T22:55:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff8319c3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff82c160240 0x7ff82c156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff8311c2640 1 -- 172.21.15.6:0/48975357 learned_addr learned my addr 172.21.15.6:0/48975357 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:21.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff8309c1640 1 -- 172.21.15.6:0/48975357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff82c0aefc0 msgr2=0x7ff82c159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:21.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff8309c1640 1 --2- 172.21.15.6:0/48975357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff82c0aefc0 0x7ff82c159390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff8309c1640 1 -- 172.21.15.6:0/48975357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff82c160240 msgr2=0x7ff82c156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:21.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff8309c1640 1 --2- 172.21.15.6:0/48975357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff82c160240 0x7ff82c156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff8309c1640 1 -- 172.21.15.6:0/48975357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8280093b0 con 0x7ff82c0c58f0 2023-07-21T22:55:21.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff8319c3640 1 --2- 172.21.15.6:0/48975357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff82c160240 0x7ff82c156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:55:21.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff8311c2640 1 --2- 172.21.15.6:0/48975357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff82c0aefc0 0x7ff82c159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:55:21.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff8309c1640 1 --2- 172.21.15.6:0/48975357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff82c0c58f0 0x7ff82c15f2b0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7ff82400cae0 tx=0x7ff82400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:21.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff821ffb640 1 -- 172.21.15.6:0/48975357 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82400ac40 con 0x7ff82c0c58f0 2023-07-21T22:55:21.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff821ffb640 1 -- 172.21.15.6:0/48975357 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82400ada0 con 0x7ff82c0c58f0 2023-07-21T22:55:21.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff821ffb640 1 -- 172.21.15.6:0/48975357 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff824012600 con 0x7ff82c0c58f0 2023-07-21T22:55:21.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff833426640 1 -- 172.21.15.6:0/48975357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82c0cbc50 con 0x7ff82c0c58f0 2023-07-21T22:55:21.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff833426640 1 -- 172.21.15.6:0/48975357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82c0cc210 con 0x7ff82c0c58f0 2023-07-21T22:55:21.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.754+0000 7ff833426640 1 -- 172.21.15.6:0/48975357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff82c0d09c0 con 0x7ff82c0c58f0 2023-07-21T22:55:21.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.758+0000 7ff821ffb640 1 -- 172.21.15.6:0/48975357 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7ff824007070 con 0x7ff82c0c58f0 2023-07-21T22:55:21.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.758+0000 7ff821ffb640 1 --2- 172.21.15.6:0/48975357 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7ff8100663a0 0x7ff810068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:21.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.758+0000 7ff821ffb640 1 -- 172.21.15.6:0/48975357 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6822+0+0 (secure 0 0 0) 0x7ff824084070 con 0x7ff82c0c58f0 2023-07-21T22:55:21.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.758+0000 7ff8311c2640 1 -- 172.21.15.6:0/48975357 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7ff8100663a0 msgr2=0x7ff810068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/835248343 2023-07-21T22:55:21.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.758+0000 7ff8311c2640 1 --2- 172.21.15.6:0/48975357 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7ff8100663a0 0x7ff810068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:55:21.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.762+0000 7ff821ffb640 1 -- 172.21.15.6:0/48975357 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8240b4700 con 0x7ff82c0c58f0 2023-07-21T22:55:21.800 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:21.769+0000 7f5115446180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:55:21.839 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:21.802+0000 7fac8ee2c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:55:21.884 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:21.853+0000 7f5115446180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:55:21.900 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:21.862+0000 7fac8ee2c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:55:21.940 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:21.909+0000 7f5115446180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:55:21.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.918+0000 7ff833426640 1 -- 172.21.15.6:0/48975357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff82c0678d0 con 0x7ff82c0c58f0 2023-07-21T22:55:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.918+0000 7ff821ffb640 1 -- 172.21.15.6:0/48975357 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v159) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff824017020 con 0x7ff82c0c58f0 2023-07-21T22:55:21.958 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:55:21.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.922+0000 7ff833426640 1 -- 172.21.15.6:0/48975357 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7ff8100663a0 msgr2=0x7ff810068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:55:21.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.922+0000 7ff833426640 1 --2- 172.21.15.6:0/48975357 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7ff8100663a0 0x7ff810068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.922+0000 7ff833426640 1 -- 172.21.15.6:0/48975357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff82c0c58f0 msgr2=0x7ff82c15f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.922+0000 7ff833426640 1 --2- 172.21.15.6:0/48975357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff82c0c58f0 0x7ff82c15f2b0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7ff82400cae0 tx=0x7ff82400a060 comp rx=0 tx=0).stop 2023-07-21T22:55:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.922+0000 7ff833426640 1 -- 172.21.15.6:0/48975357 shutdown_connections 2023-07-21T22:55:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.922+0000 7ff833426640 1 --2- 172.21.15.6:0/48975357 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7ff8100663a0 0x7ff810068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.922+0000 7ff833426640 1 --2- 172.21.15.6:0/48975357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff82c160240 0x7ff82c156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.922+0000 7ff833426640 1 --2- 172.21.15.6:0/48975357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff82c0c58f0 0x7ff82c15f2b0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.922+0000 7ff833426640 1 --2- 172.21.15.6:0/48975357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff82c0aefc0 0x7ff82c159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.922+0000 7ff833426640 1 -- 172.21.15.6:0/48975357 >> 172.21.15.6:0/48975357 conn(0x7ff82c0659d0 msgr2=0x7ff82c06b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.922+0000 7ff833426640 1 -- 172.21.15.6:0/48975357 shutdown_connections 2023-07-21T22:55:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:21.922+0000 7ff833426640 1 -- 172.21.15.6:0/48975357 wait complete. 2023-07-21T22:55:21.982 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:55:21.992 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:21.954+0000 7fac8ee2c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:55:22.053 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:22.014+0000 7fac8ee2c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:55:22.082 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:22.053+0000 7f5115446180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:55:22.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.094+0000 7ff1c3ef9640 1 Processor -- start 2023-07-21T22:55:22.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.094+0000 7ff1c3ef9640 1 -- start start 2023-07-21T22:55:22.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.094+0000 7ff1c3ef9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1bc15bde0 0x7ff1bc0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:22.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.094+0000 7ff1c3ef9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff1bc0d2fc0 0x7ff1bc0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:22.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.094+0000 7ff1c3ef9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1bc0b04c0 con 0x7ff1bc0d2300 2023-07-21T22:55:22.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.094+0000 7ff1c3ef9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1bc15c1b0 con 0x7ff1bc0d2fc0 2023-07-21T22:55:22.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.094+0000 7ff1c3ef9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc0d0aa0 con 0x7ff1bc15bde0 2023-07-21T22:55:22.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.094+0000 7ff1c1494640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff1bc0d2fc0 0x7ff1bc0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:22.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.094+0000 7ff1c1494640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff1bc0d2fc0 0x7ff1bc0b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:42088/0 (socket says 172.21.15.6:42088) 2023-07-21T22:55:22.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.094+0000 7ff1c1494640 1 -- 172.21.15.6:0/3614008089 learned_addr learned my addr 172.21.15.6:0/3614008089 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:22.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.094+0000 7ff1c1c95640 1 --2- 172.21.15.6:0/3614008089 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1bc15bde0 0x7ff1bc0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:22.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.094+0000 7ff1c1494640 1 -- 172.21.15.6:0/3614008089 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1bc15bde0 msgr2=0x7ff1bc0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:22.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.094+0000 7ff1c1494640 1 --2- 172.21.15.6:0/3614008089 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1bc15bde0 0x7ff1bc0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:22.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.094+0000 7ff1c1494640 1 -- 172.21.15.6:0/3614008089 >> v1:172.21.15.161:6789/0 conn(0x7ff1bc0d2300 legacy=0x7ff1bc0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:22.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.094+0000 7ff1c1494640 1 -- 172.21.15.6:0/3614008089 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc0afb90 con 0x7ff1bc0d2fc0 2023-07-21T22:55:22.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.094+0000 7ff1c0c93640 1 -- 172.21.15.6:0/3614008089 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2314784297 0 0) 0x7ff1bc0b04c0 con 0x7ff1bc0d2300 2023-07-21T22:55:22.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.098+0000 7ff1c1494640 1 --2- 172.21.15.6:0/3614008089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1bc0d2fc0 0x7ff1bc0b0950 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac009870 tx=0x7ff1ac01c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7906c3917209c0f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:22.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.098+0000 7ff1c0c93640 1 -- 172.21.15.6:0/3614008089 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac0a9400 con 0x7ff1bc0d2fc0 2023-07-21T22:55:22.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.098+0000 7ff1c0c93640 1 -- 172.21.15.6:0/3614008089 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ac0a9560 con 0x7ff1bc0d2fc0 2023-07-21T22:55:22.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.098+0000 7ff1c0c93640 1 -- 172.21.15.6:0/3614008089 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac0a98f0 con 0x7ff1bc0d2fc0 2023-07-21T22:55:22.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.098+0000 7ff1c3ef9640 1 -- 172.21.15.6:0/3614008089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1bc0d2fc0 msgr2=0x7ff1bc0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:22.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.098+0000 7ff1c3ef9640 1 --2- 172.21.15.6:0/3614008089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1bc0d2fc0 0x7ff1bc0b0950 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac009870 tx=0x7ff1ac01c540 comp rx=0 tx=0).stop 2023-07-21T22:55:22.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.098+0000 7ff1c3ef9640 1 -- 172.21.15.6:0/3614008089 shutdown_connections 2023-07-21T22:55:22.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.098+0000 7ff1c3ef9640 1 --2- 172.21.15.6:0/3614008089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1bc0d2fc0 0x7ff1bc0b0950 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:22.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.098+0000 7ff1c3ef9640 1 --2- 172.21.15.6:0/3614008089 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1bc15bde0 0x7ff1bc0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:22.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.098+0000 7ff1c3ef9640 1 -- 172.21.15.6:0/3614008089 >> 172.21.15.6:0/3614008089 conn(0x7ff1bc0659d0 msgr2=0x7ff1bc09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:22.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c3ef9640 1 -- 172.21.15.6:0/3614008089 shutdown_connections 2023-07-21T22:55:22.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c3ef9640 1 -- 172.21.15.6:0/3614008089 wait complete. 2023-07-21T22:55:22.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c3ef9640 1 Processor -- start 2023-07-21T22:55:22.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c3ef9640 1 -- start start 2023-07-21T22:55:22.140 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:22.109+0000 7f5115446180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:55:22.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c3ef9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1bc0d2300 0x7ff1bc0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:22.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c3ef9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1bc0d2fc0 0x7ff1bc1513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:22.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c3ef9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1bc15bde0 0x7ff1bc152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:22.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c3ef9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc153e40 con 0x7ff1bc15bde0 2023-07-21T22:55:22.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c3ef9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc1518e0 con 0x7ff1bc0d2300 2023-07-21T22:55:22.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c3ef9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc152f90 con 0x7ff1bc0d2fc0 2023-07-21T22:55:22.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c1c95640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1bc0d2300 0x7ff1bc0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:22.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c1c95640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1bc0d2300 0x7ff1bc0b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:42094/0 (socket says 172.21.15.6:42094) 2023-07-21T22:55:22.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c1c95640 1 -- 172.21.15.6:0/2561180865 learned_addr learned my addr 172.21.15.6:0/2561180865 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:22.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c1494640 1 --2- 172.21.15.6:0/2561180865 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1bc0d2fc0 0x7ff1bc1513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:22.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c2496640 1 --2- 172.21.15.6:0/2561180865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1bc15bde0 0x7ff1bc152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:22.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c1c95640 1 -- 172.21.15.6:0/2561180865 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1bc0d2fc0 msgr2=0x7ff1bc1513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:22.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c1c95640 1 --2- 172.21.15.6:0/2561180865 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1bc0d2fc0 0x7ff1bc1513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:22.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c1c95640 1 -- 172.21.15.6:0/2561180865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1bc15bde0 msgr2=0x7ff1bc152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:22.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c1c95640 1 --2- 172.21.15.6:0/2561180865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1bc15bde0 0x7ff1bc152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:22.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c1c95640 1 -- 172.21.15.6:0/2561180865 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac0094d0 con 0x7ff1bc0d2300 2023-07-21T22:55:22.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.102+0000 7ff1c1c95640 1 --2- 172.21.15.6:0/2561180865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1bc0d2300 0x7ff1bc0b34b0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ff1b800e9b0 tx=0x7ff1b800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:22.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.106+0000 7ff1b27fc640 1 -- 172.21.15.6:0/2561180865 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b8009670 con 0x7ff1bc0d2300 2023-07-21T22:55:22.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.106+0000 7ff1b27fc640 1 -- 172.21.15.6:0/2561180865 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b800c9a0 con 0x7ff1bc0d2300 2023-07-21T22:55:22.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.106+0000 7ff1b27fc640 1 -- 172.21.15.6:0/2561180865 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b800cd10 con 0x7ff1bc0d2300 2023-07-21T22:55:22.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.106+0000 7ff1c3ef9640 1 -- 172.21.15.6:0/2561180865 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1bc153230 con 0x7ff1bc0d2300 2023-07-21T22:55:22.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.106+0000 7ff1c3ef9640 1 -- 172.21.15.6:0/2561180865 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1bc1537f0 con 0x7ff1bc0d2300 2023-07-21T22:55:22.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.106+0000 7ff1c3ef9640 1 -- 172.21.15.6:0/2561180865 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1bc0678d0 con 0x7ff1bc0d2300 2023-07-21T22:55:22.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.106+0000 7ff1b27fc640 1 -- 172.21.15.6:0/2561180865 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7ff1b8013470 con 0x7ff1bc0d2300 2023-07-21T22:55:22.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.106+0000 7ff1b27fc640 1 --2- 172.21.15.6:0/2561180865 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7ff1a00663f0 0x7ff1a00688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:22.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.106+0000 7ff1b27fc640 1 -- 172.21.15.6:0/2561180865 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6822+0+0 (secure 0 0 0) 0x7ff1b80847e0 con 0x7ff1bc0d2300 2023-07-21T22:55:22.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.106+0000 7ff1c1494640 1 -- 172.21.15.6:0/2561180865 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7ff1a00663f0 msgr2=0x7ff1a00688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/835248343 2023-07-21T22:55:22.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.106+0000 7ff1c1494640 1 --2- 172.21.15.6:0/2561180865 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7ff1a00663f0 0x7ff1a00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:55:22.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.110+0000 7ff1b27fc640 1 -- 172.21.15.6:0/2561180865 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff1b8051850 con 0x7ff1bc0d2300 2023-07-21T22:55:22.208 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:22.170+0000 7fac8ee2c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:55:22.270 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:22.230+0000 7fac8ee2c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:55:22.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.266+0000 7ff1c3ef9640 1 -- 172.21.15.6:0/2561180865 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff1bc073040 con 0x7ff1bc0d2300 2023-07-21T22:55:22.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.270+0000 7ff1b27fc640 1 -- 172.21.15.6:0/2561180865 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v159) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff1b8021020 con 0x7ff1bc0d2300 2023-07-21T22:55:22.307 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:55:22.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.270+0000 7ff1c3ef9640 1 -- 172.21.15.6:0/2561180865 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7ff1a00663f0 msgr2=0x7ff1a00688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:55:22.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.270+0000 7ff1c3ef9640 1 --2- 172.21.15.6:0/2561180865 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7ff1a00663f0 0x7ff1a00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:22.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.270+0000 7ff1c3ef9640 1 -- 172.21.15.6:0/2561180865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1bc0d2300 msgr2=0x7ff1bc0b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:22.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.270+0000 7ff1c3ef9640 1 --2- 172.21.15.6:0/2561180865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1bc0d2300 0x7ff1bc0b34b0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ff1b800e9b0 tx=0x7ff1b800ee70 comp rx=0 tx=0).stop 2023-07-21T22:55:22.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.270+0000 7ff1c3ef9640 1 -- 172.21.15.6:0/2561180865 shutdown_connections 2023-07-21T22:55:22.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.270+0000 7ff1c3ef9640 1 --2- 172.21.15.6:0/2561180865 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7ff1a00663f0 0x7ff1a00688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:22.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.270+0000 7ff1c3ef9640 1 --2- 172.21.15.6:0/2561180865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1bc15bde0 0x7ff1bc152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:22.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.270+0000 7ff1c3ef9640 1 --2- 172.21.15.6:0/2561180865 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1bc0d2fc0 0x7ff1bc1513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:22.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.270+0000 7ff1c3ef9640 1 --2- 172.21.15.6:0/2561180865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1bc0d2300 0x7ff1bc0b34b0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:22.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.270+0000 7ff1c3ef9640 1 -- 172.21.15.6:0/2561180865 >> 172.21.15.6:0/2561180865 conn(0x7ff1bc0659d0 msgr2=0x7ff1bc0cd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:22.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.270+0000 7ff1c3ef9640 1 -- 172.21.15.6:0/2561180865 shutdown_connections 2023-07-21T22:55:22.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.270+0000 7ff1c3ef9640 1 -- 172.21.15.6:0/2561180865 wait complete. 2023-07-21T22:55:22.339 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:55:22.383 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:55:22.383 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:55:22.383 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:55:22.392 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:22.361+0000 7f5115446180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:55:22.524 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:22.493+0000 7f5115446180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:55:22.546 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:55:22.546 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:55:22.546 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:55:22.555 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:22.518+0000 7fac8ee2c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:55:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.526+0000 7f38d8500640 1 Processor -- start 2023-07-21T22:55:22.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.526+0000 7f38d8500640 1 -- start start 2023-07-21T22:55:22.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.526+0000 7f38d8500640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f38d015fd60 0x7f38d00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:22.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.526+0000 7f38d8500640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d00ccaf0 con 0x7f38d00d1850 2023-07-21T22:55:22.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.526+0000 7f38d8500640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d0160320 con 0x7f38d00b7c70 2023-07-21T22:55:22.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.526+0000 7f38d8500640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d00d1190 con 0x7f38d015fd60 2023-07-21T22:55:22.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.526+0000 7f38d5a9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f38d015fd60 0x7f38d00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:22.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.526+0000 7f38d6a9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f38d00d1850 0x7f38d00d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58548/0 (socket says 172.21.15.6:58548) 2023-07-21T22:55:22.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.526+0000 7f38d6a9d640 1 -- 172.21.15.6:0/2731500422 learned_addr learned my addr 172.21.15.6:0/2731500422 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:22.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.526+0000 7f38d5a9b640 1 -- 172.21.15.6:0/2731500422 >> v1:172.21.15.161:6789/0 conn(0x7f38d00b7c70 legacy=0x7f38d015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:22.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.526+0000 7f38d5a9b640 1 -- 172.21.15.6:0/2731500422 >> v1:172.21.15.6:6789/0 conn(0x7f38d00d1850 legacy=0x7f38d00d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:22.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.526+0000 7f38d5a9b640 1 -- 172.21.15.6:0/2731500422 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d00ccd90 con 0x7f38d015fd60 2023-07-21T22:55:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.530+0000 7f38d5a9b640 1 --2- 172.21.15.6:0/2731500422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38d015fd60 0x7f38d00d0c50 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f38c00097c0 tx=0x7f38c001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce296c5d4a708f7d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.530+0000 7f38d529a640 1 -- 172.21.15.6:0/2731500422 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c00a8050 con 0x7f38d015fd60 2023-07-21T22:55:22.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.530+0000 7f38d529a640 1 -- 172.21.15.6:0/2731500422 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c00ac5f0 con 0x7f38d015fd60 2023-07-21T22:55:22.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.530+0000 7f38d529a640 1 -- 172.21.15.6:0/2731500422 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c00ac980 con 0x7f38d015fd60 2023-07-21T22:55:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.530+0000 7f38d8500640 1 -- 172.21.15.6:0/2731500422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38d015fd60 msgr2=0x7f38d00d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.530+0000 7f38d8500640 1 --2- 172.21.15.6:0/2731500422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38d015fd60 0x7f38d00d0c50 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f38c00097c0 tx=0x7f38c001c480 comp rx=0 tx=0).stop 2023-07-21T22:55:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.530+0000 7f38d8500640 1 -- 172.21.15.6:0/2731500422 shutdown_connections 2023-07-21T22:55:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.530+0000 7f38d8500640 1 --2- 172.21.15.6:0/2731500422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38d015fd60 0x7f38d00d0c50 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.530+0000 7f38d8500640 1 -- 172.21.15.6:0/2731500422 >> 172.21.15.6:0/2731500422 conn(0x7f38d00650b0 msgr2=0x7f38d00654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.530+0000 7f38d8500640 1 -- 172.21.15.6:0/2731500422 shutdown_connections 2023-07-21T22:55:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.530+0000 7f38d8500640 1 -- 172.21.15.6:0/2731500422 wait complete. 2023-07-21T22:55:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d8500640 1 Processor -- start 2023-07-21T22:55:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d8500640 1 -- start start 2023-07-21T22:55:22.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d8500640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38d00b7c70 0x7f38d0150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:22.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d8500640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38d00d1850 0x7f38d015e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:22.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d8500640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38d015fd60 0x7f38d01f85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:22.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d8500640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d01544e0 con 0x7f38d00b7c70 2023-07-21T22:55:22.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d8500640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d01510a0 con 0x7f38d015fd60 2023-07-21T22:55:22.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d8500640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d0150800 con 0x7f38d00d1850 2023-07-21T22:55:22.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d629c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38d00b7c70 0x7f38d0150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:22.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d629c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38d00b7c70 0x7f38d0150100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35620/0 (socket says 172.21.15.6:35620) 2023-07-21T22:55:22.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d629c640 1 -- 172.21.15.6:0/851126477 learned_addr learned my addr 172.21.15.6:0/851126477 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:22.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d6a9d640 1 --2- 172.21.15.6:0/851126477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38d015fd60 0x7f38d01f85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:22.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d5a9b640 1 --2- 172.21.15.6:0/851126477 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38d00d1850 0x7f38d015e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:22.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d629c640 1 -- 172.21.15.6:0/851126477 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38d00d1850 msgr2=0x7f38d015e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:22.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d629c640 1 --2- 172.21.15.6:0/851126477 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38d00d1850 0x7f38d015e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:22.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d629c640 1 -- 172.21.15.6:0/851126477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38d015fd60 msgr2=0x7f38d01f85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:22.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d629c640 1 --2- 172.21.15.6:0/851126477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38d015fd60 0x7f38d01f85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:22.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d629c640 1 -- 172.21.15.6:0/851126477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c0009420 con 0x7f38d00b7c70 2023-07-21T22:55:22.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d6a9d640 1 --2- 172.21.15.6:0/851126477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38d015fd60 0x7f38d01f85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:22.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d629c640 1 --2- 172.21.15.6:0/851126477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38d00b7c70 0x7f38d0150100 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00c3c0 tx=0x7f38cc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38c6ffd640 1 -- 172.21.15.6:0/851126477 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc0052d0 con 0x7f38d00b7c70 2023-07-21T22:55:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38c6ffd640 1 -- 172.21.15.6:0/851126477 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc005430 con 0x7f38d00b7c70 2023-07-21T22:55:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38c6ffd640 1 -- 172.21.15.6:0/851126477 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc003840 con 0x7f38d00b7c70 2023-07-21T22:55:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d8500640 1 -- 172.21.15.6:0/851126477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d0150ae0 con 0x7f38d00b7c70 2023-07-21T22:55:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d8500640 1 -- 172.21.15.6:0/851126477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d0154ac0 con 0x7f38d00b7c70 2023-07-21T22:55:22.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.534+0000 7f38d8500640 1 -- 172.21.15.6:0/851126477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d00678d0 con 0x7f38d00b7c70 2023-07-21T22:55:22.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.538+0000 7f38c6ffd640 1 -- 172.21.15.6:0/851126477 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f38cc0039a0 con 0x7f38d00b7c70 2023-07-21T22:55:22.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.538+0000 7f38c6ffd640 1 --2- 172.21.15.6:0/851126477 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f38b40663a0 0x7f38b4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:22.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.538+0000 7f38c6ffd640 1 -- 172.21.15.6:0/851126477 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6822+0+0 (secure 0 0 0) 0x7f38cc083790 con 0x7f38d00b7c70 2023-07-21T22:55:22.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.538+0000 7f38d5a9b640 1 -- 172.21.15.6:0/851126477 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f38b40663a0 msgr2=0x7f38b4068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/835248343 2023-07-21T22:55:22.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.538+0000 7f38d5a9b640 1 --2- 172.21.15.6:0/851126477 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f38b40663a0 0x7f38b4068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:55:22.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.542+0000 7f38c6ffd640 1 -- 172.21.15.6:0/851126477 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f38cc050760 con 0x7f38d00b7c70 2023-07-21T22:55:22.649 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:22.621+0000 7f5115446180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:55:22.701 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:22.662+0000 7fac8ee2c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:55:22.720 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:22.689+0000 7f5115446180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:55:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.710+0000 7f38d8500640 1 -- 172.21.15.6:0/851126477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f38d0154cb0 con 0x7f38d00b7c70 2023-07-21T22:55:22.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.710+0000 7f38c6ffd640 1 -- 172.21.15.6:0/851126477 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v159) v1 ==== 81+0+952 (secure 0 0 0) 0x7f38cc053d80 con 0x7f38d00b7c70 2023-07-21T22:55:22.747 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/1641497343 2023-07-22T22:50:20.828371+0000 2023-07-21T22:55:22.748 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/1520394641 2023-07-22T22:50:20.828371+0000 2023-07-21T22:55:22.748 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/52253068 2023-07-22T22:50:20.828371+0000 2023-07-21T22:55:22.748 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/3217579618 2023-07-22T22:50:20.828371+0000 2023-07-21T22:55:22.748 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6833/3096900160 2023-07-22T22:50:20.828371+0000 2023-07-21T22:55:22.748 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/1245542883 2023-07-22T22:39:20.660905+0000 2023-07-21T22:55:22.748 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/2766778262 2023-07-22T22:39:20.660905+0000 2023-07-21T22:55:22.749 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/2288195162 2023-07-22T22:39:20.660905+0000 2023-07-21T22:55:22.749 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/107992510 2023-07-22T22:50:20.828371+0000 2023-07-21T22:55:22.749 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6833/2692111396 2023-07-22T22:39:20.660905+0000 2023-07-21T22:55:22.749 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6832/3096900160 2023-07-22T22:50:20.828371+0000 2023-07-21T22:55:22.749 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/4115864188 2023-07-22T22:39:20.660905+0000 2023-07-21T22:55:22.749 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6832/2692111396 2023-07-22T22:39:20.660905+0000 2023-07-21T22:55:22.749 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/2485992449 2023-07-22T22:50:20.828371+0000 2023-07-21T22:55:22.750 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/389976077 2023-07-22T22:39:20.660905+0000 2023-07-21T22:55:22.750 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/1635694091 2023-07-22T22:39:20.660905+0000 2023-07-21T22:55:22.751 INFO:teuthology.orchestra.run.smithi006.stderr:listed 16 entries 2023-07-21T22:55:22.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.710+0000 7f38d8500640 1 -- 172.21.15.6:0/851126477 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f38b40663a0 msgr2=0x7f38b4068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:55:22.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.710+0000 7f38d8500640 1 --2- 172.21.15.6:0/851126477 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f38b40663a0 0x7f38b4068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:22.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.710+0000 7f38d8500640 1 -- 172.21.15.6:0/851126477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38d00b7c70 msgr2=0x7f38d0150100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:22.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.710+0000 7f38d8500640 1 --2- 172.21.15.6:0/851126477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38d00b7c70 0x7f38d0150100 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00c3c0 tx=0x7f38cc00c880 comp rx=0 tx=0).stop 2023-07-21T22:55:22.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.710+0000 7f38d8500640 1 -- 172.21.15.6:0/851126477 shutdown_connections 2023-07-21T22:55:22.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.710+0000 7f38d8500640 1 --2- 172.21.15.6:0/851126477 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f38b40663a0 0x7f38b4068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:22.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.710+0000 7f38d8500640 1 --2- 172.21.15.6:0/851126477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f38d015fd60 0x7f38d01f85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:22.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.710+0000 7f38d8500640 1 --2- 172.21.15.6:0/851126477 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f38d00d1850 0x7f38d015e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:22.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.710+0000 7f38d8500640 1 --2- 172.21.15.6:0/851126477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38d00b7c70 0x7f38d0150100 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:22.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.710+0000 7f38d8500640 1 -- 172.21.15.6:0/851126477 >> 172.21.15.6:0/851126477 conn(0x7f38d00650b0 msgr2=0x7f38d0065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:22.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.710+0000 7f38d8500640 1 -- 172.21.15.6:0/851126477 shutdown_connections 2023-07-21T22:55:22.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:22.710+0000 7f38d8500640 1 -- 172.21.15.6:0/851126477 wait complete. 2023-07-21T22:55:22.769 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-21T22:55:22.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:22.770 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-21T22:55:22.836 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:22.798+0000 7fac8ee2c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:55:22.842 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:55:22.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:22.843 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T22:55:22.852 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:55:22.853 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:55:22.854 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:22.825+0000 7f5115446180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:55:22.862 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:55:22.863 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:55:22.863 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:55:22.904 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:55:22.905 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:55:22.905 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:55:22.911 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:22.874+0000 7fac8ee2c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:55:22.916 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:55:22.917 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:55:23.056 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:23.018+0000 7fac8ee2c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:55:23.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.026+0000 7f4a68093640 1 Processor -- start 2023-07-21T22:55:23.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.026+0000 7f4a68093640 1 -- start start 2023-07-21T22:55:23.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.026+0000 7f4a68093640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4a600cb780 0x7f4a600cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:23.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.026+0000 7f4a68093640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4a6006b8f0 0x7f4a600cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:23.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.026+0000 7f4a68093640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a6006f900 con 0x7f4a6015b7c0 2023-07-21T22:55:23.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.026+0000 7f4a68093640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a600cdce0 con 0x7f4a600cb780 2023-07-21T22:55:23.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.026+0000 7f4a68093640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a600ca830 con 0x7f4a6006b8f0 2023-07-21T22:55:23.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.026+0000 7f4a6562e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4a600cb780 0x7f4a600cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:23.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.026+0000 7f4a6562e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4a600cb780 0x7f4a600cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35636/0 (socket says 172.21.15.6:35636) 2023-07-21T22:55:23.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.026+0000 7f4a6562e640 1 -- 172.21.15.6:0/41024009 learned_addr learned my addr 172.21.15.6:0/41024009 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:23.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.026+0000 7f4a66630640 1 --2- 172.21.15.6:0/41024009 >> v2:172.21.15.161:3300/0 conn(0x7f4a6006b8f0 0x7f4a600cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:23.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.026+0000 7f4a6562e640 1 -- 172.21.15.6:0/41024009 >> v2:172.21.15.161:3300/0 conn(0x7f4a6006b8f0 msgr2=0x7f4a600cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:23.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.026+0000 7f4a6562e640 1 --2- 172.21.15.6:0/41024009 >> v2:172.21.15.161:3300/0 conn(0x7f4a6006b8f0 0x7f4a600cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.026+0000 7f4a6562e640 1 -- 172.21.15.6:0/41024009 >> v1:172.21.15.161:6789/0 conn(0x7f4a6015b7c0 legacy=0x7f4a6006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:23.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.026+0000 7f4a6562e640 1 -- 172.21.15.6:0/41024009 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6015bb90 con 0x7f4a600cb780 2023-07-21T22:55:23.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.030+0000 7f4a6562e640 1 --2- 172.21.15.6:0/41024009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a600cb780 0x7f4a600cbd30 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f4a6006a410 tx=0x7f4a5001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6372e7108b787b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:23.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.030+0000 7f4a64e2d640 1 -- 172.21.15.6:0/41024009 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500ab650 con 0x7f4a600cb780 2023-07-21T22:55:23.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.030+0000 7f4a64e2d640 1 -- 172.21.15.6:0/41024009 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a500ab7b0 con 0x7f4a600cb780 2023-07-21T22:55:23.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.030+0000 7f4a64e2d640 1 -- 172.21.15.6:0/41024009 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500abb40 con 0x7f4a600cb780 2023-07-21T22:55:23.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.030+0000 7f4a68093640 1 -- 172.21.15.6:0/41024009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a600cb780 msgr2=0x7f4a600cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:23.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.030+0000 7f4a68093640 1 --2- 172.21.15.6:0/41024009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a600cb780 0x7f4a600cbd30 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f4a6006a410 tx=0x7f4a5001c4d0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.030+0000 7f4a68093640 1 -- 172.21.15.6:0/41024009 shutdown_connections 2023-07-21T22:55:23.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.030+0000 7f4a68093640 1 --2- 172.21.15.6:0/41024009 >> v2:172.21.15.161:3300/0 conn(0x7f4a6006b8f0 0x7f4a600cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.030+0000 7f4a68093640 1 --2- 172.21.15.6:0/41024009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a600cb780 0x7f4a600cbd30 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.030+0000 7f4a68093640 1 -- 172.21.15.6:0/41024009 >> 172.21.15.6:0/41024009 conn(0x7f4a600afcf0 msgr2=0x7f4a600b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:23.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.030+0000 7f4a68093640 1 -- 172.21.15.6:0/41024009 shutdown_connections 2023-07-21T22:55:23.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.030+0000 7f4a68093640 1 -- 172.21.15.6:0/41024009 wait complete. 2023-07-21T22:55:23.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a68093640 1 Processor -- start 2023-07-21T22:55:23.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a68093640 1 -- start start 2023-07-21T22:55:23.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a68093640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a6006b8f0 0x7f4a60151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:23.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a68093640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a6015b7c0 0x7f4a60152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:23.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a68093640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a60155cf0 0x7f4a6014c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:23.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a68093640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a60151630 con 0x7f4a6015b7c0 2023-07-21T22:55:23.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a68093640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a60152270 con 0x7f4a60155cf0 2023-07-21T22:55:23.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a68093640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a60159310 con 0x7f4a6006b8f0 2023-07-21T22:55:23.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a6562e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a6015b7c0 0x7f4a60152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:23.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a6562e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a6015b7c0 0x7f4a60152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35652/0 (socket says 172.21.15.6:35652) 2023-07-21T22:55:23.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a6562e640 1 -- 172.21.15.6:0/3779894065 learned_addr learned my addr 172.21.15.6:0/3779894065 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:23.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a66630640 1 --2- 172.21.15.6:0/3779894065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a60155cf0 0x7f4a6014c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:23.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a65e2f640 1 --2- 172.21.15.6:0/3779894065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a6006b8f0 0x7f4a60151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:23.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a6562e640 1 -- 172.21.15.6:0/3779894065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a6006b8f0 msgr2=0x7f4a60151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:23.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a6562e640 1 --2- 172.21.15.6:0/3779894065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a6006b8f0 0x7f4a60151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a6562e640 1 -- 172.21.15.6:0/3779894065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a60155cf0 msgr2=0x7f4a6014c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:23.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a6562e640 1 --2- 172.21.15.6:0/3779894065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a60155cf0 0x7f4a6014c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a6562e640 1 -- 172.21.15.6:0/3779894065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a500094d0 con 0x7f4a6015b7c0 2023-07-21T22:55:23.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a65e2f640 1 --2- 172.21.15.6:0/3779894065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a6006b8f0 0x7f4a60151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:23.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a6562e640 1 --2- 172.21.15.6:0/3779894065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a6015b7c0 0x7f4a60152440 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f4a500ad040 tx=0x7f4a5001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:23.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a567fc640 1 -- 172.21.15.6:0/3779894065 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500b4800 con 0x7f4a6015b7c0 2023-07-21T22:55:23.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a567fc640 1 -- 172.21.15.6:0/3779894065 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a500b4980 con 0x7f4a6015b7c0 2023-07-21T22:55:23.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a68093640 1 -- 172.21.15.6:0/3779894065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6014cea0 con 0x7f4a6015b7c0 2023-07-21T22:55:23.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a567fc640 1 -- 172.21.15.6:0/3779894065 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500b4d30 con 0x7f4a6015b7c0 2023-07-21T22:55:23.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.034+0000 7f4a68093640 1 -- 172.21.15.6:0/3779894065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a60154480 con 0x7f4a6015b7c0 2023-07-21T22:55:23.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.038+0000 7f4a68093640 1 -- 172.21.15.6:0/3779894065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a600adad0 con 0x7f4a6015b7c0 2023-07-21T22:55:23.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.038+0000 7f4a567fc640 1 -- 172.21.15.6:0/3779894065 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f4a500b3380 con 0x7f4a6015b7c0 2023-07-21T22:55:23.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.038+0000 7f4a567fc640 1 --2- 172.21.15.6:0/3779894065 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f4a440663a0 0x7f4a44068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:23.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.038+0000 7f4a567fc640 1 -- 172.21.15.6:0/3779894065 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6822+0+0 (secure 0 0 0) 0x7f4a5011eac0 con 0x7f4a6015b7c0 2023-07-21T22:55:23.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.038+0000 7f4a65e2f640 1 -- 172.21.15.6:0/3779894065 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f4a440663a0 msgr2=0x7f4a44068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/835248343 2023-07-21T22:55:23.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.038+0000 7f4a65e2f640 1 --2- 172.21.15.6:0/3779894065 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f4a440663a0 0x7f4a44068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:55:23.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.042+0000 7f4a567fc640 1 -- 172.21.15.6:0/3779894065 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4a500ebbd0 con 0x7f4a6015b7c0 2023-07-21T22:55:23.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.242+0000 7f4a65e2f640 1 -- 172.21.15.6:0/3779894065 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f4a440663a0 msgr2=0x7f4a44068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/835248343 2023-07-21T22:55:23.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.242+0000 7f4a65e2f640 1 --2- 172.21.15.6:0/3779894065 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f4a440663a0 0x7f4a44068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:55:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.246+0000 7f4a68093640 1 -- 172.21.15.6:0/3779894065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a600678d0 con 0x7f4a6015b7c0 2023-07-21T22:55:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.246+0000 7f4a567fc640 1 -- 172.21.15.6:0/3779894065 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4670 (secure 0 0 0) 0x7f4a500ef1f0 con 0x7f4a6015b7c0 2023-07-21T22:55:23.284 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:23.284 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/2365019581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2365019581},{"type":"v1","addr":"172.21.15.161:6836","nonce":2365019581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8968,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/798924835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":798924835},{"type":"v1","addr":"172.21.15.161:6837","nonce":798924835}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2487387353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2487387353},{"type":"v1","addr":"172.21.15.6:6834","nonce":2487387353}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:39:03.424297+0000","modified":"2023-07-21T22:39:07.057160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9309":{"gid":9309,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2700138945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2700138945},{"type":"v1","addr":"172.21.15.6:6835","nonce":2700138945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-21T22:55:23.285 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 70 2023-07-21T22:55:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.246+0000 7f4a68093640 1 -- 172.21.15.6:0/3779894065 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f4a440663a0 msgr2=0x7f4a44068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:55:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.246+0000 7f4a68093640 1 --2- 172.21.15.6:0/3779894065 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f4a440663a0 0x7f4a44068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.246+0000 7f4a68093640 1 -- 172.21.15.6:0/3779894065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a6015b7c0 msgr2=0x7f4a60152440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.246+0000 7f4a68093640 1 --2- 172.21.15.6:0/3779894065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a6015b7c0 0x7f4a60152440 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f4a500ad040 tx=0x7f4a5001ad10 comp rx=0 tx=0).stop 2023-07-21T22:55:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.246+0000 7f4a68093640 1 -- 172.21.15.6:0/3779894065 shutdown_connections 2023-07-21T22:55:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.246+0000 7f4a68093640 1 --2- 172.21.15.6:0/3779894065 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f4a440663a0 0x7f4a44068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.250+0000 7f4a68093640 1 --2- 172.21.15.6:0/3779894065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a60155cf0 0x7f4a6014c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.250+0000 7f4a68093640 1 --2- 172.21.15.6:0/3779894065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a6015b7c0 0x7f4a60152440 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.250+0000 7f4a68093640 1 --2- 172.21.15.6:0/3779894065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a6006b8f0 0x7f4a60151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.250+0000 7f4a68093640 1 -- 172.21.15.6:0/3779894065 >> 172.21.15.6:0/3779894065 conn(0x7f4a600afcf0 msgr2=0x7f4a600cbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.250+0000 7f4a68093640 1 -- 172.21.15.6:0/3779894065 shutdown_connections 2023-07-21T22:55:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.250+0000 7f4a68093640 1 -- 172.21.15.6:0/3779894065 wait complete. 2023-07-21T22:55:23.307 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:55:23.425 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:23.393+0000 7f5115446180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:55:23.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.490+0000 7fe291093640 1 Processor -- start 2023-07-21T22:55:23.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.490+0000 7fe291093640 1 -- start start 2023-07-21T22:55:23.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.490+0000 7fe291093640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe28c0cb780 0x7fe28c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:23.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.490+0000 7fe291093640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe28c06b8f0 0x7fe28c0cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:23.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.490+0000 7fe291093640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe28c06f900 con 0x7fe28c15b7c0 2023-07-21T22:55:23.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.490+0000 7fe291093640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe28c0cdce0 con 0x7fe28c06b8f0 2023-07-21T22:55:23.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.490+0000 7fe291093640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c0ca830 con 0x7fe28c0cb780 2023-07-21T22:55:23.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.494+0000 7fe28ad9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe28c15b7c0 0x7fe28c06b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58558/0 (socket says 172.21.15.6:58558) 2023-07-21T22:55:23.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.494+0000 7fe28ad9d640 1 -- 172.21.15.6:0/1139412678 learned_addr learned my addr 172.21.15.6:0/1139412678 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:23.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.494+0000 7fe28b59e640 1 --2- 172.21.15.6:0/1139412678 >> v2:172.21.15.6:3300/0 conn(0x7fe28c06b8f0 0x7fe28c0cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:23.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.494+0000 7fe28a59c640 1 --2- 172.21.15.6:0/1139412678 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe28c0cb780 0x7fe28c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:23.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.494+0000 7fe28b59e640 1 -- 172.21.15.6:0/1139412678 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe28c0cb780 msgr2=0x7fe28c0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:23.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.494+0000 7fe28b59e640 1 --2- 172.21.15.6:0/1139412678 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe28c0cb780 0x7fe28c0cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.494+0000 7fe28b59e640 1 -- 172.21.15.6:0/1139412678 >> v1:172.21.15.6:6789/0 conn(0x7fe28c15b7c0 legacy=0x7fe28c06b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:23.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.494+0000 7fe28b59e640 1 -- 172.21.15.6:0/1139412678 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28c15bb90 con 0x7fe28c06b8f0 2023-07-21T22:55:23.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.494+0000 7fe289d9b640 1 -- 172.21.15.6:0/1139412678 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325265251 0 0) 0x7fe28c06f900 con 0x7fe28c15b7c0 2023-07-21T22:55:23.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.498+0000 7fe28b59e640 1 --2- 172.21.15.6:0/1139412678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c06b8f0 0x7fe28c0cc270 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0097c0 tx=0x7fe27c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfef59e43638c26 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:23.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.502+0000 7fe289d9b640 1 -- 172.21.15.6:0/1139412678 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c0ab600 con 0x7fe28c06b8f0 2023-07-21T22:55:23.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.502+0000 7fe289d9b640 1 -- 172.21.15.6:0/1139412678 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c0a7050 con 0x7fe28c06b8f0 2023-07-21T22:55:23.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.502+0000 7fe289d9b640 1 -- 172.21.15.6:0/1139412678 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c0ab980 con 0x7fe28c06b8f0 2023-07-21T22:55:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.502+0000 7fe291093640 1 -- 172.21.15.6:0/1139412678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c06b8f0 msgr2=0x7fe28c0cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.502+0000 7fe291093640 1 --2- 172.21.15.6:0/1139412678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c06b8f0 0x7fe28c0cc270 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0097c0 tx=0x7fe27c01c450 comp rx=0 tx=0).stop 2023-07-21T22:55:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.502+0000 7fe291093640 1 -- 172.21.15.6:0/1139412678 shutdown_connections 2023-07-21T22:55:23.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.502+0000 7fe291093640 1 --2- 172.21.15.6:0/1139412678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c06b8f0 0x7fe28c0cc270 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.502+0000 7fe291093640 1 --2- 172.21.15.6:0/1139412678 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe28c0cb780 0x7fe28c0cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.502+0000 7fe291093640 1 -- 172.21.15.6:0/1139412678 >> 172.21.15.6:0/1139412678 conn(0x7fe28c0afcf0 msgr2=0x7fe28c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:23.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.502+0000 7fe291093640 1 -- 172.21.15.6:0/1139412678 shutdown_connections 2023-07-21T22:55:23.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.502+0000 7fe291093640 1 -- 172.21.15.6:0/1139412678 wait complete. 2023-07-21T22:55:23.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.506+0000 7fe291093640 1 Processor -- start 2023-07-21T22:55:23.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.506+0000 7fe291093640 1 -- start start 2023-07-21T22:55:23.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.506+0000 7fe291093640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c06b8f0 0x7fe28c0ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:23.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.506+0000 7fe291093640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe28c15b7c0 0x7fe28c150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:23.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.510+0000 7fe291093640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe28c166380 0x7fe28c0b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:23.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.510+0000 7fe28ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c06b8f0 0x7fe28c0ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:23.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.510+0000 7fe291093640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c1652a0 con 0x7fe28c06b8f0 2023-07-21T22:55:23.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.510+0000 7fe291093640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c1512c0 con 0x7fe28c166380 2023-07-21T22:55:23.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.510+0000 7fe291093640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c164f90 con 0x7fe28c15b7c0 2023-07-21T22:55:23.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.510+0000 7fe28ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c06b8f0 0x7fe28c0ad550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35672/0 (socket says 172.21.15.6:35672) 2023-07-21T22:55:23.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.510+0000 7fe28ad9d640 1 -- 172.21.15.6:0/2399259854 learned_addr learned my addr 172.21.15.6:0/2399259854 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:23.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.510+0000 7fe28a59c640 1 --2- 172.21.15.6:0/2399259854 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe28c15b7c0 0x7fe28c150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:23.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.510+0000 7fe28b59e640 1 --2- 172.21.15.6:0/2399259854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe28c166380 0x7fe28c0b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:23.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.510+0000 7fe28ad9d640 1 -- 172.21.15.6:0/2399259854 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe28c15b7c0 msgr2=0x7fe28c150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:23.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.510+0000 7fe28ad9d640 1 --2- 172.21.15.6:0/2399259854 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe28c15b7c0 0x7fe28c150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.510+0000 7fe28ad9d640 1 -- 172.21.15.6:0/2399259854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe28c166380 msgr2=0x7fe28c0b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:23.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.510+0000 7fe28ad9d640 1 --2- 172.21.15.6:0/2399259854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe28c166380 0x7fe28c0b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.510+0000 7fe28ad9d640 1 -- 172.21.15.6:0/2399259854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c009420 con 0x7fe28c06b8f0 2023-07-21T22:55:23.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.510+0000 7fe28ad9d640 1 --2- 172.21.15.6:0/2399259854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c06b8f0 0x7fe28c0ad550 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fe28400c7c0 tx=0x7fe28400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:23.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.510+0000 7fe2737fe640 1 -- 172.21.15.6:0/2399259854 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28400a640 con 0x7fe28c06b8f0 2023-07-21T22:55:23.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.510+0000 7fe2737fe640 1 -- 172.21.15.6:0/2399259854 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28400a7c0 con 0x7fe28c06b8f0 2023-07-21T22:55:23.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.510+0000 7fe291093640 1 -- 172.21.15.6:0/2399259854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28c0ac2b0 con 0x7fe28c06b8f0 2023-07-21T22:55:23.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.510+0000 7fe291093640 1 -- 172.21.15.6:0/2399259854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28c0ac830 con 0x7fe28c06b8f0 2023-07-21T22:55:23.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.510+0000 7fe2737fe640 1 -- 172.21.15.6:0/2399259854 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28400ab70 con 0x7fe28c06b8f0 2023-07-21T22:55:23.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.514+0000 7fe2737fe640 1 -- 172.21.15.6:0/2399259854 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fe28400acd0 con 0x7fe28c06b8f0 2023-07-21T22:55:23.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.518+0000 7fe2737fe640 1 --2- 172.21.15.6:0/2399259854 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fe2740664a0 0x7fe274068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:23.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.518+0000 7fe2737fe640 1 -- 172.21.15.6:0/2399259854 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6878+0+0 (secure 0 0 0) 0x7fe284083a20 con 0x7fe28c06b8f0 2023-07-21T22:55:23.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.518+0000 7fe28a59c640 1 -- 172.21.15.6:0/2399259854 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fe2740664a0 msgr2=0x7fe274068950 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/835248343 2023-07-21T22:55:23.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.518+0000 7fe28a59c640 1 --2- 172.21.15.6:0/2399259854 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fe2740664a0 0x7fe274068950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:55:23.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.518+0000 7fe291093640 1 -- 172.21.15.6:0/2399259854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26c005260 con 0x7fe28c06b8f0 2023-07-21T22:55:23.557 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:23.525+0000 7f5115446180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:55:23.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.530+0000 7fe2737fe640 1 -- 172.21.15.6:0/2399259854 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe284050b50 con 0x7fe28c06b8f0 2023-07-21T22:55:23.726 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:23.697+0000 7f5115446180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:55:23.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.694+0000 7fe291093640 1 -- 172.21.15.6:0/2399259854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe26c0057e0 con 0x7fe28c06b8f0 2023-07-21T22:55:23.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.698+0000 7fe2737fe640 1 -- 172.21.15.6:0/2399259854 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+19482 (secure 0 0 0) 0x7fe284018020 con 0x7fe28c06b8f0 2023-07-21T22:55:23.735 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:23.735 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":160,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:55:23.279736+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:39:01.548583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-21T22:39:02.416927+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":160,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/1641497343":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/1520394641":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/52253068":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/3217579618":"2023-07-22T22:50:20.828371+0000","172.21.15.161:6833/3096900160":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/1245542883":"2023-07-22T22:39:20.660905+0000","172.21.15.161:0/2766778262":"2023-07-22T22:39:20.660905+0000","172.21.15.161:0/2288195162":"2023-07-22T22:39:20.660905+0000","172.21.15.161:0/107992510":"2023-07-22T22:50:20.828371+0000","172.21.15.161:6833/2692111396":"2023-07-22T22:39:20.660905+0000","172.21.15.161:6832/3096900160":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/4115864188":"2023-07-22T22:39:20.660905+0000","172.21.15.161:6832/2692111396":"2023-07-22T22:39:20.660905+0000","172.21.15.161:0/2485992449":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/389976077":"2023-07-22T22:39:20.660905+0000","172.21.15.161:0/1635694091":"2023-07-22T22:39:20.660905+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:55:23.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.698+0000 7fe291093640 1 -- 172.21.15.6:0/2399259854 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fe2740664a0 msgr2=0x7fe274068950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:55:23.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.698+0000 7fe291093640 1 --2- 172.21.15.6:0/2399259854 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fe2740664a0 0x7fe274068950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.698+0000 7fe291093640 1 -- 172.21.15.6:0/2399259854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c06b8f0 msgr2=0x7fe28c0ad550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:23.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.698+0000 7fe291093640 1 --2- 172.21.15.6:0/2399259854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c06b8f0 0x7fe28c0ad550 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fe28400c7c0 tx=0x7fe28400cc80 comp rx=0 tx=0).stop 2023-07-21T22:55:23.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.698+0000 7fe291093640 1 -- 172.21.15.6:0/2399259854 shutdown_connections 2023-07-21T22:55:23.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.698+0000 7fe291093640 1 --2- 172.21.15.6:0/2399259854 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7fe2740664a0 0x7fe274068950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.698+0000 7fe291093640 1 --2- 172.21.15.6:0/2399259854 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe28c166380 0x7fe28c0b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.698+0000 7fe291093640 1 --2- 172.21.15.6:0/2399259854 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe28c15b7c0 0x7fe28c150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.698+0000 7fe291093640 1 --2- 172.21.15.6:0/2399259854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe28c06b8f0 0x7fe28c0ad550 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.698+0000 7fe291093640 1 -- 172.21.15.6:0/2399259854 >> 172.21.15.6:0/2399259854 conn(0x7fe28c0afcf0 msgr2=0x7fe28c0c9220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:23.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.698+0000 7fe291093640 1 -- 172.21.15.6:0/2399259854 shutdown_connections 2023-07-21T22:55:23.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.698+0000 7fe291093640 1 -- 172.21.15.6:0/2399259854 wait complete. 2023-07-21T22:55:23.753 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:23.714+0000 7fac8ee2c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:55:23.757 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:39:01.548583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '156', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:39:02.416927+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 33, 'snap_epoch': 160, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:55:23.758 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:55:23.809 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:23.781+0000 7f5115446180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:55:23.843 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:23.806+0000 7fac8ee2c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:55:23.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.870+0000 7f04e549c640 1 Processor -- start 2023-07-21T22:55:23.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.870+0000 7f04e549c640 1 -- start start 2023-07-21T22:55:23.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.870+0000 7f04e549c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f04e00cba60 0x7f04e00c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:23.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.870+0000 7f04e549c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e00c37e0 con 0x7f04e01590a0 2023-07-21T22:55:23.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.870+0000 7f04e549c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e00c3ac0 con 0x7f04e015b9c0 2023-07-21T22:55:23.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.870+0000 7f04e549c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e00c3da0 con 0x7f04e00cba60 2023-07-21T22:55:23.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.870+0000 7f04deffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f04e00cba60 0x7f04e00c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:23.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.870+0000 7f04deffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f04e00cba60 0x7f04e00c3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35676/0 (socket says 172.21.15.6:35676) 2023-07-21T22:55:23.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.870+0000 7f04df7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f04e01590a0 0x7f04e0159930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58570/0 (socket says 172.21.15.6:58570) 2023-07-21T22:55:23.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.870+0000 7f04deffd640 1 -- 172.21.15.6:0/4099301054 learned_addr learned my addr 172.21.15.6:0/4099301054 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:23.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.870+0000 7f04deffd640 1 -- 172.21.15.6:0/4099301054 >> v1:172.21.15.161:6789/0 conn(0x7f04e015b9c0 legacy=0x7f04e00cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:23.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.870+0000 7f04deffd640 1 -- 172.21.15.6:0/4099301054 >> v1:172.21.15.6:6789/0 conn(0x7f04e01590a0 legacy=0x7f04e0159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:23.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.870+0000 7f04deffd640 1 -- 172.21.15.6:0/4099301054 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e00c4080 con 0x7f04e00cba60 2023-07-21T22:55:23.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.870+0000 7f04de7fc640 1 -- 172.21.15.6:0/4099301054 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553495565 0 0) 0x7f04e00c37e0 con 0x7f04e01590a0 2023-07-21T22:55:23.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.874+0000 7f04deffd640 1 --2- 172.21.15.6:0/4099301054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e00cba60 0x7f04e00c3150 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f04d0006fd0 tx=0x7f04d001e870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134d9f904d1766b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:23.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.874+0000 7f04de7fc640 1 -- 172.21.15.6:0/4099301054 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0004230 con 0x7f04e00cba60 2023-07-21T22:55:23.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.874+0000 7f04de7fc640 1 -- 172.21.15.6:0/4099301054 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d00ab070 con 0x7f04e00cba60 2023-07-21T22:55:23.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.874+0000 7f04de7fc640 1 -- 172.21.15.6:0/4099301054 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d00a7720 con 0x7f04e00cba60 2023-07-21T22:55:23.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.874+0000 7f04e549c640 1 -- 172.21.15.6:0/4099301054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e00cba60 msgr2=0x7f04e00c3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:23.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.874+0000 7f04e549c640 1 --2- 172.21.15.6:0/4099301054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e00cba60 0x7f04e00c3150 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f04d0006fd0 tx=0x7f04d001e870 comp rx=0 tx=0).stop 2023-07-21T22:55:23.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.874+0000 7f04e549c640 1 -- 172.21.15.6:0/4099301054 shutdown_connections 2023-07-21T22:55:23.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.874+0000 7f04e549c640 1 --2- 172.21.15.6:0/4099301054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e00cba60 0x7f04e00c3150 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.874+0000 7f04e549c640 1 -- 172.21.15.6:0/4099301054 >> 172.21.15.6:0/4099301054 conn(0x7f04e00cde90 msgr2=0x7f04e00ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:23.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.874+0000 7f04e549c640 1 -- 172.21.15.6:0/4099301054 shutdown_connections 2023-07-21T22:55:23.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.874+0000 7f04e549c640 1 -- 172.21.15.6:0/4099301054 wait complete. 2023-07-21T22:55:23.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.874+0000 7f04e549c640 1 Processor -- start 2023-07-21T22:55:23.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04e549c640 1 -- start start 2023-07-21T22:55:23.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04e549c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e00cba60 0x7f04e00b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:23.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04e549c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e01590a0 0x7f04e00b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:23.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04e549c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e015b9c0 0x7f04e01f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:23.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04e549c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e00b25b0 con 0x7f04e015b9c0 2023-07-21T22:55:23.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04e549c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e0163bc0 con 0x7f04e01590a0 2023-07-21T22:55:23.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04e549c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e00b1930 con 0x7f04e00cba60 2023-07-21T22:55:23.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04df7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e015b9c0 0x7f04e01f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:23.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04df7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e015b9c0 0x7f04e01f3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35678/0 (socket says 172.21.15.6:35678) 2023-07-21T22:55:23.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04df7fe640 1 -- 172.21.15.6:0/795536945 learned_addr learned my addr 172.21.15.6:0/795536945 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:23.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04deffd640 1 --2- 172.21.15.6:0/795536945 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e00cba60 0x7f04e00b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:23.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04d7fff640 1 --2- 172.21.15.6:0/795536945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e01590a0 0x7f04e00b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:23.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04df7fe640 1 -- 172.21.15.6:0/795536945 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e00cba60 msgr2=0x7f04e00b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:23.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04df7fe640 1 --2- 172.21.15.6:0/795536945 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e00cba60 0x7f04e00b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04df7fe640 1 -- 172.21.15.6:0/795536945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e01590a0 msgr2=0x7f04e00b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:23.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04df7fe640 1 --2- 172.21.15.6:0/795536945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e01590a0 0x7f04e00b1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:23.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04df7fe640 1 -- 172.21.15.6:0/795536945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d000b780 con 0x7f04e015b9c0 2023-07-21T22:55:23.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04deffd640 1 --2- 172.21.15.6:0/795536945 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e00cba60 0x7f04e00b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:55:23.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04df7fe640 1 --2- 172.21.15.6:0/795536945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e015b9c0 0x7f04e01f3b10 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f04d800c780 tx=0x7f04d800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:23.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04d77fe640 1 -- 172.21.15.6:0/795536945 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d800ce30 con 0x7f04e015b9c0 2023-07-21T22:55:23.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04d77fe640 1 -- 172.21.15.6:0/795536945 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d800a5e0 con 0x7f04e015b9c0 2023-07-21T22:55:23.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04d77fe640 1 -- 172.21.15.6:0/795536945 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d800a9d0 con 0x7f04e015b9c0 2023-07-21T22:55:23.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04e549c640 1 -- 172.21.15.6:0/795536945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e00b1c10 con 0x7f04e015b9c0 2023-07-21T22:55:23.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04e549c640 1 -- 172.21.15.6:0/795536945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e00b21d0 con 0x7f04e015b9c0 2023-07-21T22:55:23.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.878+0000 7f04e549c640 1 -- 172.21.15.6:0/795536945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e00714b0 con 0x7f04e015b9c0 2023-07-21T22:55:23.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.882+0000 7f04d77fe640 1 -- 172.21.15.6:0/795536945 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f04d800ab30 con 0x7f04e015b9c0 2023-07-21T22:55:23.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.882+0000 7f04d77fe640 1 --2- 172.21.15.6:0/795536945 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f04c00663a0 0x7f04c0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:23.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.882+0000 7f04d77fe640 1 -- 172.21.15.6:0/795536945 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6878+0+0 (secure 0 0 0) 0x7f04d8083e70 con 0x7f04e015b9c0 2023-07-21T22:55:23.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.882+0000 7f04deffd640 1 -- 172.21.15.6:0/795536945 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f04c00663a0 msgr2=0x7f04c0068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/835248343 2023-07-21T22:55:23.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.882+0000 7f04deffd640 1 --2- 172.21.15.6:0/795536945 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f04c00663a0 0x7f04c0068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:55:23.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:23.886+0000 7f04d77fe640 1 -- 172.21.15.6:0/795536945 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f04d8050ec0 con 0x7f04e015b9c0 2023-07-21T22:55:24.003 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:23.966+0000 7fac8ee2c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:55:24.078 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:24.049+0000 7f5115446180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:55:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.042+0000 7f04e549c640 1 -- 172.21.15.6:0/795536945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f04e00b26f0 con 0x7f04e015b9c0 2023-07-21T22:55:24.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.042+0000 7f04d77fe640 1 -- 172.21.15.6:0/795536945 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v160) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04e00b26f0 con 0x7f04e015b9c0 2023-07-21T22:55:24.080 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:55:24.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.042+0000 7f04e549c640 1 -- 172.21.15.6:0/795536945 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f04c00663a0 msgr2=0x7f04c0068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:55:24.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.042+0000 7f04e549c640 1 --2- 172.21.15.6:0/795536945 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f04c00663a0 0x7f04c0068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.042+0000 7f04e549c640 1 -- 172.21.15.6:0/795536945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e015b9c0 msgr2=0x7f04e01f3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:24.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.042+0000 7f04e549c640 1 --2- 172.21.15.6:0/795536945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e015b9c0 0x7f04e01f3b10 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f04d800c780 tx=0x7f04d800cc40 comp rx=0 tx=0).stop 2023-07-21T22:55:24.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.046+0000 7f04e549c640 1 -- 172.21.15.6:0/795536945 shutdown_connections 2023-07-21T22:55:24.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.046+0000 7f04e549c640 1 --2- 172.21.15.6:0/795536945 >> [v2:172.21.15.161:6832/835248343,v1:172.21.15.161:6833/835248343] conn(0x7f04c00663a0 0x7f04c0068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.046+0000 7f04e549c640 1 --2- 172.21.15.6:0/795536945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04e015b9c0 0x7f04e01f3b10 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.046+0000 7f04e549c640 1 --2- 172.21.15.6:0/795536945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e01590a0 0x7f04e00b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.046+0000 7f04e549c640 1 --2- 172.21.15.6:0/795536945 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e00cba60 0x7f04e00b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.046+0000 7f04e549c640 1 -- 172.21.15.6:0/795536945 >> 172.21.15.6:0/795536945 conn(0x7f04e00cde90 msgr2=0x7f04e006fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:24.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.046+0000 7f04e549c640 1 -- 172.21.15.6:0/795536945 shutdown_connections 2023-07-21T22:55:24.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.046+0000 7f04e549c640 1 -- 172.21.15.6:0/795536945 wait complete. 2023-07-21T22:55:24.092 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:24.054+0000 7fac8ee2c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:55:24.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:55:24.137 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:24.109+0000 7f5115446180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:55:24.222 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:24.193+0000 7f509c8b4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:55:24.222 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:24.193+0000 7f509c8b4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:55:24.222 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:24.193+0000 7f509c8b4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:55:24.222 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:24.193+0000 7f509c8b4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:55:24.223 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:24.193+0000 7f509c8b4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:55:24.223 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:24.193+0000 7f509f8ba640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:55:24.223 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:24.193+0000 7f509f8ba640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:55:24.223 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:24.193+0000 7f509f8ba640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:55:24.223 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:24.193+0000 7f509f8ba640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:55:24.224 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:24.193+0000 7f509f8ba640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:55:24.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.226+0000 7f875b093640 1 Processor -- start 2023-07-21T22:55:24.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.226+0000 7f875b093640 1 -- start start 2023-07-21T22:55:24.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.226+0000 7f875b093640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f875415bde0 0x7f87540d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:24.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.226+0000 7f875b093640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f87540d2fc0 0x7f87540b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:24.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.226+0000 7f875b093640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87540b04c0 con 0x7f87540d2300 2023-07-21T22:55:24.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.226+0000 7f875b093640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f875415c1b0 con 0x7f87540d2fc0 2023-07-21T22:55:24.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.226+0000 7f875b093640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87540d0aa0 con 0x7f875415bde0 2023-07-21T22:55:24.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.226+0000 7f8759630640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f87540d2300 0x7f87540cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58580/0 (socket says 172.21.15.6:58580) 2023-07-21T22:55:24.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.226+0000 7f8759630640 1 -- 172.21.15.6:0/651149041 learned_addr learned my addr 172.21.15.6:0/651149041 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:24.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.226+0000 7f8758e2f640 1 --2- 172.21.15.6:0/651149041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f875415bde0 0x7f87540d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:24.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.226+0000 7f8753fff640 1 --2- 172.21.15.6:0/651149041 >> v2:172.21.15.161:3300/0 conn(0x7f87540d2fc0 0x7f87540b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:24.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.226+0000 7f87537fe640 1 -- 172.21.15.6:0/651149041 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584237772 0 0) 0x7f87540b04c0 con 0x7f87540d2300 2023-07-21T22:55:24.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.226+0000 7f87537fe640 1 -- 172.21.15.6:0/651149041 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8744003530 con 0x7f87540d2300 2023-07-21T22:55:24.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.226+0000 7f8753fff640 1 -- 172.21.15.6:0/651149041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f875415bde0 msgr2=0x7f87540d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:24.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.226+0000 7f8753fff640 1 --2- 172.21.15.6:0/651149041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f875415bde0 0x7f87540d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.226+0000 7f8753fff640 1 -- 172.21.15.6:0/651149041 >> v1:172.21.15.6:6789/0 conn(0x7f87540d2300 legacy=0x7f87540cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:24.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.226+0000 7f8753fff640 1 -- 172.21.15.6:0/651149041 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87540afb90 con 0x7f87540d2fc0 2023-07-21T22:55:24.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.226+0000 7f8758e2f640 1 --2- 172.21.15.6:0/651149041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f875415bde0 0x7f87540d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:55:24.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.230+0000 7f8753fff640 1 --2- 172.21.15.6:0/651149041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87540d2fc0 0x7f87540b0950 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f87400097c0 tx=0x7f874001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6379125f35679abd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:24.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.230+0000 7f87537fe640 1 -- 172.21.15.6:0/651149041 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400ab680 con 0x7f87540d2fc0 2023-07-21T22:55:24.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.230+0000 7f87537fe640 1 -- 172.21.15.6:0/651149041 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87400ab7e0 con 0x7f87540d2fc0 2023-07-21T22:55:24.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.230+0000 7f87537fe640 1 -- 172.21.15.6:0/651149041 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400abb70 con 0x7f87540d2fc0 2023-07-21T22:55:24.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.230+0000 7f875b093640 1 -- 172.21.15.6:0/651149041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87540d2fc0 msgr2=0x7f87540b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:24.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.230+0000 7f875b093640 1 --2- 172.21.15.6:0/651149041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87540d2fc0 0x7f87540b0950 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f87400097c0 tx=0x7f874001c480 comp rx=0 tx=0).stop 2023-07-21T22:55:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.230+0000 7f875b093640 1 -- 172.21.15.6:0/651149041 shutdown_connections 2023-07-21T22:55:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.230+0000 7f875b093640 1 --2- 172.21.15.6:0/651149041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87540d2fc0 0x7f87540b0950 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.230+0000 7f875b093640 1 --2- 172.21.15.6:0/651149041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f875415bde0 0x7f87540d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.230+0000 7f875b093640 1 -- 172.21.15.6:0/651149041 >> 172.21.15.6:0/651149041 conn(0x7f87540659d0 msgr2=0x7f875409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:24.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.230+0000 7f875b093640 1 -- 172.21.15.6:0/651149041 shutdown_connections 2023-07-21T22:55:24.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.230+0000 7f875b093640 1 -- 172.21.15.6:0/651149041 wait complete. 2023-07-21T22:55:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f875b093640 1 Processor -- start 2023-07-21T22:55:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f875b093640 1 -- start start 2023-07-21T22:55:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f875b093640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f87540d2300 0x7f8754155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f875b093640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87540d2fc0 0x7f8754159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f875b093640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f875415bde0 0x7f8754159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f875b093640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875415d360 con 0x7f87540d2fc0 2023-07-21T22:55:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f875b093640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875415d640 con 0x7f875415bde0 2023-07-21T22:55:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f875b093640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875415d920 con 0x7f87540d2300 2023-07-21T22:55:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f8753fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87540d2fc0 0x7f8754159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f8753fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87540d2fc0 0x7f8754159800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35692/0 (socket says 172.21.15.6:35692) 2023-07-21T22:55:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f8753fff640 1 -- 172.21.15.6:0/881716548 learned_addr learned my addr 172.21.15.6:0/881716548 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f8758e2f640 1 --2- 172.21.15.6:0/881716548 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f87540d2300 0x7f8754155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:24.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f8759630640 1 --2- 172.21.15.6:0/881716548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f875415bde0 0x7f8754159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:24.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f8753fff640 1 -- 172.21.15.6:0/881716548 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f87540d2300 msgr2=0x7f8754155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:24.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f8753fff640 1 --2- 172.21.15.6:0/881716548 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f87540d2300 0x7f8754155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f8753fff640 1 -- 172.21.15.6:0/881716548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f875415bde0 msgr2=0x7f8754159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f8753fff640 1 --2- 172.21.15.6:0/881716548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f875415bde0 0x7f8754159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f8753fff640 1 -- 172.21.15.6:0/881716548 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87480093b0 con 0x7f87540d2fc0 2023-07-21T22:55:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f8753fff640 1 --2- 172.21.15.6:0/881716548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87540d2fc0 0x7f8754159800 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f87400ad040 tx=0x7f874001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f87517fa640 1 -- 172.21.15.6:0/881716548 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400bf610 con 0x7f87540d2fc0 2023-07-21T22:55:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f87517fa640 1 -- 172.21.15.6:0/881716548 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87400bf790 con 0x7f87540d2fc0 2023-07-21T22:55:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f87517fa640 1 -- 172.21.15.6:0/881716548 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400bfb40 con 0x7f87540d2fc0 2023-07-21T22:55:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f875b093640 1 -- 172.21.15.6:0/881716548 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8740009420 con 0x7f87540d2fc0 2023-07-21T22:55:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f875b093640 1 -- 172.21.15.6:0/881716548 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f875415dee0 con 0x7f87540d2fc0 2023-07-21T22:55:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.234+0000 7f875b093640 1 -- 172.21.15.6:0/881716548 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f875415e0d0 con 0x7f87540d2fc0 2023-07-21T22:55:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.238+0000 7f87517fa640 1 -- 172.21.15.6:0/881716548 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 79) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f87400b5400 con 0x7f87540d2fc0 2023-07-21T22:55:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.238+0000 7f87517fa640 1 -- 172.21.15.6:0/881716548 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7194+0+0 (secure 0 0 0) 0x7f874011e660 con 0x7f87540d2fc0 2023-07-21T22:55:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.242+0000 7f87517fa640 1 -- 172.21.15.6:0/881716548 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f87400eba80 con 0x7f87540d2fc0 2023-07-21T22:55:24.401 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:24.362+0000 7fac8ee2c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:55:24.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.398+0000 7f875b093640 1 -- 172.21.15.6:0/881716548 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f87540678d0 con 0x7f87540d2fc0 2023-07-21T22:55:24.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.398+0000 7f87517fa640 1 -- 172.21.15.6:0/881716548 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v161) v1 ==== 92+0+10 (secure 0 0 0) 0x7f87400ef0a0 con 0x7f87540d2fc0 2023-07-21T22:55:24.436 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:55:24.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.398+0000 7f875b093640 1 -- 172.21.15.6:0/881716548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87540d2fc0 msgr2=0x7f8754159800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:24.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.398+0000 7f875b093640 1 --2- 172.21.15.6:0/881716548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87540d2fc0 0x7f8754159800 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f87400ad040 tx=0x7f874001acc0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.398+0000 7f875b093640 1 -- 172.21.15.6:0/881716548 shutdown_connections 2023-07-21T22:55:24.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.398+0000 7f875b093640 1 --2- 172.21.15.6:0/881716548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f875415bde0 0x7f8754159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.398+0000 7f875b093640 1 --2- 172.21.15.6:0/881716548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87540d2fc0 0x7f8754159800 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.398+0000 7f875b093640 1 --2- 172.21.15.6:0/881716548 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f87540d2300 0x7f8754155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.398+0000 7f875b093640 1 -- 172.21.15.6:0/881716548 >> 172.21.15.6:0/881716548 conn(0x7f87540659d0 msgr2=0x7f875415b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:24.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.398+0000 7f875b093640 1 -- 172.21.15.6:0/881716548 shutdown_connections 2023-07-21T22:55:24.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.398+0000 7f875b093640 1 -- 172.21.15.6:0/881716548 wait complete. 2023-07-21T22:55:24.457 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:55:24.467 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:24.430+0000 7fac8ee2c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:55:24.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.570+0000 7f8eeb096640 1 Processor -- start 2023-07-21T22:55:24.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.570+0000 7f8eeb096640 1 -- start start 2023-07-21T22:55:24.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.570+0000 7f8eeb096640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8ee415bde0 0x7f8ee40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:24.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.570+0000 7f8eeb096640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ee40d2fc0 0x7f8ee40b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:24.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.570+0000 7f8eeb096640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee40b04c0 con 0x7f8ee40d2300 2023-07-21T22:55:24.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.570+0000 7f8eeb096640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee415c1b0 con 0x7f8ee415bde0 2023-07-21T22:55:24.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.570+0000 7f8eeb096640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee40d0aa0 con 0x7f8ee40d2fc0 2023-07-21T22:55:24.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.570+0000 7f8ee8e32640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8ee415bde0 0x7f8ee40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:24.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.570+0000 7f8ee8e32640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8ee415bde0 0x7f8ee40d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35704/0 (socket says 172.21.15.6:35704) 2023-07-21T22:55:24.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.570+0000 7f8ee8e32640 1 -- 172.21.15.6:0/4294730097 learned_addr learned my addr 172.21.15.6:0/4294730097 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:24.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.570+0000 7f8ee3fff640 1 --2- 172.21.15.6:0/4294730097 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ee40d2fc0 0x7f8ee40b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:24.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.570+0000 7f8ee8e32640 1 -- 172.21.15.6:0/4294730097 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ee40d2fc0 msgr2=0x7f8ee40b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:24.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.570+0000 7f8ee8e32640 1 --2- 172.21.15.6:0/4294730097 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ee40d2fc0 0x7f8ee40b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.570+0000 7f8ee8e32640 1 -- 172.21.15.6:0/4294730097 >> v1:172.21.15.161:6789/0 conn(0x7f8ee40d2300 legacy=0x7f8ee40cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:24.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.570+0000 7f8ee8e32640 1 -- 172.21.15.6:0/4294730097 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee40afb90 con 0x7f8ee415bde0 2023-07-21T22:55:24.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.574+0000 7f8ee8e32640 1 --2- 172.21.15.6:0/4294730097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ee415bde0 0x7f8ee40d0270 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8006fd0 tx=0x7f8ed801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ab28c305595d72 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:24.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.574+0000 7f8ee37fe640 1 -- 172.21.15.6:0/4294730097 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed80aa680 con 0x7f8ee415bde0 2023-07-21T22:55:24.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.574+0000 7f8ee37fe640 1 -- 172.21.15.6:0/4294730097 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed80aa7e0 con 0x7f8ee415bde0 2023-07-21T22:55:24.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.574+0000 7f8ee37fe640 1 -- 172.21.15.6:0/4294730097 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed80aab70 con 0x7f8ee415bde0 2023-07-21T22:55:24.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.574+0000 7f8eeb096640 1 -- 172.21.15.6:0/4294730097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ee415bde0 msgr2=0x7f8ee40d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:24.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.574+0000 7f8eeb096640 1 --2- 172.21.15.6:0/4294730097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ee415bde0 0x7f8ee40d0270 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8006fd0 tx=0x7f8ed801c520 comp rx=0 tx=0).stop 2023-07-21T22:55:24.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.574+0000 7f8eeb096640 1 -- 172.21.15.6:0/4294730097 shutdown_connections 2023-07-21T22:55:24.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.574+0000 7f8eeb096640 1 --2- 172.21.15.6:0/4294730097 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ee40d2fc0 0x7f8ee40b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.574+0000 7f8eeb096640 1 --2- 172.21.15.6:0/4294730097 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ee415bde0 0x7f8ee40d0270 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.574+0000 7f8eeb096640 1 -- 172.21.15.6:0/4294730097 >> 172.21.15.6:0/4294730097 conn(0x7f8ee40659d0 msgr2=0x7f8ee409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:24.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.574+0000 7f8eeb096640 1 -- 172.21.15.6:0/4294730097 shutdown_connections 2023-07-21T22:55:24.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.574+0000 7f8eeb096640 1 -- 172.21.15.6:0/4294730097 wait complete. 2023-07-21T22:55:24.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8eeb096640 1 Processor -- start 2023-07-21T22:55:24.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8eeb096640 1 -- start start 2023-07-21T22:55:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8eeb096640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ee40d2300 0x7f8ee414f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8eeb096640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ee40d2fc0 0x7f8ee4150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8eeb096640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ee415bde0 0x7f8ee41506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8eeb096640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee415cd00 con 0x7f8ee40d2fc0 2023-07-21T22:55:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8eeb096640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee415d5a0 con 0x7f8ee40d2300 2023-07-21T22:55:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8eeb096640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee40c8d60 con 0x7f8ee415bde0 2023-07-21T22:55:24.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8ee3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ee40d2fc0 0x7f8ee4150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:24.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8ee3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ee40d2fc0 0x7f8ee4150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35712/0 (socket says 172.21.15.6:35712) 2023-07-21T22:55:24.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8ee3fff640 1 -- 172.21.15.6:0/1421569790 learned_addr learned my addr 172.21.15.6:0/1421569790 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:24.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8ee8e32640 1 --2- 172.21.15.6:0/1421569790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ee40d2300 0x7f8ee414f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:24.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8ee9633640 1 --2- 172.21.15.6:0/1421569790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ee415bde0 0x7f8ee41506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:24.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8ee3fff640 1 -- 172.21.15.6:0/1421569790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ee415bde0 msgr2=0x7f8ee41506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:24.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8ee3fff640 1 --2- 172.21.15.6:0/1421569790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ee415bde0 0x7f8ee41506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8ee3fff640 1 -- 172.21.15.6:0/1421569790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ee40d2300 msgr2=0x7f8ee414f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:24.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8ee3fff640 1 --2- 172.21.15.6:0/1421569790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ee40d2300 0x7f8ee414f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8ee3fff640 1 -- 172.21.15.6:0/1421569790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed8009480 con 0x7f8ee40d2fc0 2023-07-21T22:55:24.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8ee8e32640 1 --2- 172.21.15.6:0/1421569790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ee40d2300 0x7f8ee414f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:24.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8ee3fff640 1 --2- 172.21.15.6:0/1421569790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ee40d2fc0 0x7f8ee4150180 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000d800 tx=0x7f8ed000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:24.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8ee17fa640 1 -- 172.21.15.6:0/1421569790 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed000b6c0 con 0x7f8ee40d2fc0 2023-07-21T22:55:24.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8ee17fa640 1 -- 172.21.15.6:0/1421569790 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed000b820 con 0x7f8ee40d2fc0 2023-07-21T22:55:24.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8eeb096640 1 -- 172.21.15.6:0/1421569790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee415cf50 con 0x7f8ee40d2fc0 2023-07-21T22:55:24.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8ee17fa640 1 -- 172.21.15.6:0/1421569790 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed000bb90 con 0x7f8ee40d2fc0 2023-07-21T22:55:24.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.578+0000 7f8eeb096640 1 -- 172.21.15.6:0/1421569790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee40c89c0 con 0x7f8ee40d2fc0 2023-07-21T22:55:24.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.582+0000 7f8eeb096640 1 -- 172.21.15.6:0/1421569790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee40678d0 con 0x7f8ee40d2fc0 2023-07-21T22:55:24.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.582+0000 7f8ee17fa640 1 -- 172.21.15.6:0/1421569790 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 79) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f8ed000bcf0 con 0x7f8ee40d2fc0 2023-07-21T22:55:24.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.582+0000 7f8ee17fa640 1 -- 172.21.15.6:0/1421569790 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7194+0+0 (secure 0 0 0) 0x7f8ed00842a0 con 0x7f8ee40d2fc0 2023-07-21T22:55:24.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.586+0000 7f8ee17fa640 1 -- 172.21.15.6:0/1421569790 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8ed0051440 con 0x7f8ee40d2fc0 2023-07-21T22:55:24.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.742+0000 7f8eeb096640 1 -- 172.21.15.6:0/1421569790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ee40d0f40 con 0x7f8ee40d2fc0 2023-07-21T22:55:24.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.742+0000 7f8ee17fa640 1 -- 172.21.15.6:0/1421569790 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v161) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ed0054c30 con 0x7f8ee40d2fc0 2023-07-21T22:55:24.780 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:55:24.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.742+0000 7f8eeb096640 1 -- 172.21.15.6:0/1421569790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ee40d2fc0 msgr2=0x7f8ee4150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:24.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.742+0000 7f8eeb096640 1 --2- 172.21.15.6:0/1421569790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ee40d2fc0 0x7f8ee4150180 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f8ed000d800 tx=0x7f8ed000dcc0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.742+0000 7f8eeb096640 1 -- 172.21.15.6:0/1421569790 shutdown_connections 2023-07-21T22:55:24.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.742+0000 7f8eeb096640 1 --2- 172.21.15.6:0/1421569790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8ee415bde0 0x7f8ee41506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.742+0000 7f8eeb096640 1 --2- 172.21.15.6:0/1421569790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ee40d2fc0 0x7f8ee4150180 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.742+0000 7f8eeb096640 1 --2- 172.21.15.6:0/1421569790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ee40d2300 0x7f8ee414f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:24.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.742+0000 7f8eeb096640 1 -- 172.21.15.6:0/1421569790 >> 172.21.15.6:0/1421569790 conn(0x7f8ee40659d0 msgr2=0x7f8ee41521c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:24.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.742+0000 7f8eeb096640 1 -- 172.21.15.6:0/1421569790 shutdown_connections 2023-07-21T22:55:24.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.742+0000 7f8eeb096640 1 -- 172.21.15.6:0/1421569790 wait complete. 2023-07-21T22:55:24.800 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:55:24.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.958+0000 7f336b59e640 1 Processor -- start 2023-07-21T22:55:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.958+0000 7f336b59e640 1 -- start start 2023-07-21T22:55:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.962+0000 7f336b59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f336c0cc960 0x7f336c0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.962+0000 7f336b59e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336c0cd270 con 0x7f336c160750 2023-07-21T22:55:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.962+0000 7f336b59e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336c0cf430 con 0x7f336c0b1620 2023-07-21T22:55:25.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.962+0000 7f336b59e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336c0cf710 con 0x7f336c0cc960 2023-07-21T22:55:25.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.962+0000 7f336ad9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f336c160750 0x7f336c15c310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58584/0 (socket says 172.21.15.6:58584) 2023-07-21T22:55:25.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.962+0000 7f336ad9d640 1 -- 172.21.15.6:0/4120339277 learned_addr learned my addr 172.21.15.6:0/4120339277 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:25.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.962+0000 7f336a59c640 1 --2- 172.21.15.6:0/4120339277 >> v2:172.21.15.161:3300/0 conn(0x7f336c0cc960 0x7f336c0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.962+0000 7f3369d9b640 1 -- 172.21.15.6:0/4120339277 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678146172 0 0) 0x7f336c0cd270 con 0x7f336c160750 2023-07-21T22:55:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.962+0000 7f3369d9b640 1 -- 172.21.15.6:0/4120339277 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3358003530 con 0x7f336c160750 2023-07-21T22:55:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.962+0000 7f3369d9b640 1 -- 172.21.15.6:0/4120339277 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940956529 0 0) 0x7f336c0cf430 con 0x7f336c0b1620 2023-07-21T22:55:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.962+0000 7f3369d9b640 1 -- 172.21.15.6:0/4120339277 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f336c0cd270 con 0x7f336c0b1620 2023-07-21T22:55:25.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.962+0000 7f336a59c640 1 -- 172.21.15.6:0/4120339277 >> v1:172.21.15.161:6789/0 conn(0x7f336c0b1620 legacy=0x7f336c0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:25.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.962+0000 7f336a59c640 1 -- 172.21.15.6:0/4120339277 >> v1:172.21.15.6:6789/0 conn(0x7f336c160750 legacy=0x7f336c15c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:25.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.962+0000 7f336a59c640 1 -- 172.21.15.6:0/4120339277 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c15fc70 con 0x7f336c0cc960 2023-07-21T22:55:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.966+0000 7f336a59c640 1 --2- 172.21.15.6:0/4120339277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f336c0cc960 0x7f336c0ccd30 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f335c0097c0 tx=0x7f335c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c017be01ad1b0676 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.966+0000 7f3369d9b640 1 -- 172.21.15.6:0/4120339277 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c0ab650 con 0x7f336c0cc960 2023-07-21T22:55:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.966+0000 7f3369d9b640 1 -- 172.21.15.6:0/4120339277 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c0ab7b0 con 0x7f336c0cc960 2023-07-21T22:55:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.966+0000 7f3369d9b640 1 -- 172.21.15.6:0/4120339277 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c0abb40 con 0x7f336c0cc960 2023-07-21T22:55:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.966+0000 7f336b59e640 1 -- 172.21.15.6:0/4120339277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f336c0cc960 msgr2=0x7f336c0ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.966+0000 7f336b59e640 1 --2- 172.21.15.6:0/4120339277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f336c0cc960 0x7f336c0ccd30 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f335c0097c0 tx=0x7f335c01c450 comp rx=0 tx=0).stop 2023-07-21T22:55:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.966+0000 7f336b59e640 1 -- 172.21.15.6:0/4120339277 shutdown_connections 2023-07-21T22:55:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.966+0000 7f336b59e640 1 --2- 172.21.15.6:0/4120339277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f336c0cc960 0x7f336c0ccd30 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.966+0000 7f336b59e640 1 -- 172.21.15.6:0/4120339277 >> 172.21.15.6:0/4120339277 conn(0x7f336c069f50 msgr2=0x7f336c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.966+0000 7f336b59e640 1 -- 172.21.15.6:0/4120339277 shutdown_connections 2023-07-21T22:55:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.966+0000 7f336b59e640 1 -- 172.21.15.6:0/4120339277 wait complete. 2023-07-21T22:55:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.966+0000 7f336b59e640 1 Processor -- start 2023-07-21T22:55:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.966+0000 7f336b59e640 1 -- start start 2023-07-21T22:55:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f336b59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f336c0b1620 0x7f336c0b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f336b59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f336c0cc960 0x7f336c1504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f336b59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f336c160750 0x7f336c150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f336b59e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c150f50 con 0x7f336c0b1620 2023-07-21T22:55:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f336b59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c0b4810 con 0x7f336c160750 2023-07-21T22:55:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f336b59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336c0b2db0 con 0x7f336c0cc960 2023-07-21T22:55:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f336a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f336c0b1620 0x7f336c0b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f336a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f336c0b1620 0x7f336c0b57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35728/0 (socket says 172.21.15.6:35728) 2023-07-21T22:55:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f336a59c640 1 -- 172.21.15.6:0/4044079781 learned_addr learned my addr 172.21.15.6:0/4044079781 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f336a59c640 1 -- 172.21.15.6:0/4044079781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f336c0cc960 msgr2=0x7f336c1504d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f336a59c640 1 --2- 172.21.15.6:0/4044079781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f336c0cc960 0x7f336c1504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f336a59c640 1 -- 172.21.15.6:0/4044079781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f336c160750 msgr2=0x7f336c150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f336a59c640 1 --2- 172.21.15.6:0/4044079781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f336c160750 0x7f336c150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f336a59c640 1 -- 172.21.15.6:0/4044079781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c009420 con 0x7f336c0b1620 2023-07-21T22:55:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f336a59c640 1 --2- 172.21.15.6:0/4044079781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f336c0b1620 0x7f336c0b57f0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f335c0ad040 tx=0x7f335c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:25.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f3362ffd640 1 -- 172.21.15.6:0/4044079781 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c0bf610 con 0x7f336c0b1620 2023-07-21T22:55:25.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f3362ffd640 1 -- 172.21.15.6:0/4044079781 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c0bf770 con 0x7f336c0b1620 2023-07-21T22:55:25.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f336b59e640 1 -- 172.21.15.6:0/4044079781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336c0b3090 con 0x7f336c0b1620 2023-07-21T22:55:25.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f3362ffd640 1 -- 172.21.15.6:0/4044079781 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c0bfb20 con 0x7f336c0b1620 2023-07-21T22:55:25.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f336b59e640 1 -- 172.21.15.6:0/4044079781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336c0b3650 con 0x7f336c0b1620 2023-07-21T22:55:25.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f336b59e640 1 -- 172.21.15.6:0/4044079781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336c04e020 con 0x7f336c0b1620 2023-07-21T22:55:25.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.970+0000 7f3362ffd640 1 -- 172.21.15.6:0/4044079781 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 79) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f335c0bfc80 con 0x7f336c0b1620 2023-07-21T22:55:25.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.974+0000 7f3362ffd640 1 -- 172.21.15.6:0/4044079781 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7194+0+0 (secure 0 0 0) 0x7f335c11e7e0 con 0x7f336c0b1620 2023-07-21T22:55:25.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:24.978+0000 7f3362ffd640 1 -- 172.21.15.6:0/4044079781 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f335c0ebad0 con 0x7f336c0b1620 2023-07-21T22:55:25.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.114+0000 7f3362ffd640 1 -- 172.21.15.6:0/4044079781 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 80) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f335c0eb580 con 0x7f336c0b1620 2023-07-21T22:55:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.114+0000 7f3362ffd640 1 --2- 172.21.15.6:0/4044079781 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f334c06c410 0x7f334c06e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:25.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.114+0000 7f3363fff640 1 --2- 172.21.15.6:0/4044079781 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f334c06c410 0x7f334c06e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:25.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.122+0000 7f3363fff640 1 --2- 172.21.15.6:0/4044079781 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f334c06c410 0x7f334c06e7f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3354007fd0 tx=0x7f3354007960 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:25.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.138+0000 7f336b59e640 1 -- 172.21.15.6:0/4044079781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f336c0d15d0 con 0x7f336c0b1620 2023-07-21T22:55:25.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.138+0000 7f3362ffd640 1 -- 172.21.15.6:0/4044079781 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v161) v1 ==== 100+0+11 (secure 0 0 0) 0x7f335c103390 con 0x7f336c0b1620 2023-07-21T22:55:25.177 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:55:25.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.142+0000 7f336b59e640 1 -- 172.21.15.6:0/4044079781 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f334c06c410 msgr2=0x7f334c06e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:25.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.142+0000 7f336b59e640 1 --2- 172.21.15.6:0/4044079781 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f334c06c410 0x7f334c06e7f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3354007fd0 tx=0x7f3354007960 comp rx=0 tx=0).stop 2023-07-21T22:55:25.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.142+0000 7f336b59e640 1 -- 172.21.15.6:0/4044079781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f336c0b1620 msgr2=0x7f336c0b57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:25.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.142+0000 7f336b59e640 1 --2- 172.21.15.6:0/4044079781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f336c0b1620 0x7f336c0b57f0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f335c0ad040 tx=0x7f335c01ac90 comp rx=0 tx=0).stop 2023-07-21T22:55:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.142+0000 7f336b59e640 1 -- 172.21.15.6:0/4044079781 shutdown_connections 2023-07-21T22:55:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.142+0000 7f336b59e640 1 --2- 172.21.15.6:0/4044079781 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f334c06c410 0x7f334c06e7f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.142+0000 7f336b59e640 1 --2- 172.21.15.6:0/4044079781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f336c160750 0x7f336c150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.142+0000 7f336b59e640 1 --2- 172.21.15.6:0/4044079781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f336c0cc960 0x7f336c1504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.142+0000 7f336b59e640 1 --2- 172.21.15.6:0/4044079781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f336c0b1620 0x7f336c0b57f0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.142+0000 7f336b59e640 1 -- 172.21.15.6:0/4044079781 >> 172.21.15.6:0/4044079781 conn(0x7f336c069f50 msgr2=0x7f336c15d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.142+0000 7f336b59e640 1 -- 172.21.15.6:0/4044079781 shutdown_connections 2023-07-21T22:55:25.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.142+0000 7f336b59e640 1 -- 172.21.15.6:0/4044079781 wait complete. 2023-07-21T22:55:25.197 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:55:25.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.306+0000 7faf6e99f640 1 Processor -- start 2023-07-21T22:55:25.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.306+0000 7faf6e99f640 1 -- start start 2023-07-21T22:55:25.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.306+0000 7faf6e99f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faf68160450 0x7faf6806e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:25.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.306+0000 7faf6e99f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf68069430 0x7faf68069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:25.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.306+0000 7faf6e99f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf680c9c30 con 0x7faf6815bc00 2023-07-21T22:55:25.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.306+0000 7faf6e99f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf680c96b0 con 0x7faf68160450 2023-07-21T22:55:25.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.306+0000 7faf6e99f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf68069db0 con 0x7faf68069430 2023-07-21T22:55:25.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.306+0000 7faf677fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faf68160450 0x7faf6806e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:25.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.306+0000 7faf67fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faf6815bc00 0x7faf680ce8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58598/0 (socket says 172.21.15.6:58598) 2023-07-21T22:55:25.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.306+0000 7faf677fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faf68160450 0x7faf6806e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35740/0 (socket says 172.21.15.6:35740) 2023-07-21T22:55:25.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.306+0000 7faf67fff640 1 -- 172.21.15.6:0/3439208101 learned_addr learned my addr 172.21.15.6:0/3439208101 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:25.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.306+0000 7faf6cf3c640 1 --2- 172.21.15.6:0/3439208101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf68069430 0x7faf68069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:25.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.306+0000 7faf677fe640 1 -- 172.21.15.6:0/3439208101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf68069430 msgr2=0x7faf68069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:25.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.306+0000 7faf677fe640 1 --2- 172.21.15.6:0/3439208101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf68069430 0x7faf68069870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.306+0000 7faf677fe640 1 -- 172.21.15.6:0/3439208101 >> v1:172.21.15.6:6789/0 conn(0x7faf6815bc00 legacy=0x7faf680ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:25.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.306+0000 7faf677fe640 1 -- 172.21.15.6:0/3439208101 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6815bfd0 con 0x7faf68160450 2023-07-21T22:55:25.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.310+0000 7faf677fe640 1 --2- 172.21.15.6:0/3439208101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf68160450 0x7faf6806e690 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7faf5c0097c0 tx=0x7faf5c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e725ca862792dbf8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:25.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.310+0000 7faf66ffd640 1 -- 172.21.15.6:0/3439208101 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0ab650 con 0x7faf68160450 2023-07-21T22:55:25.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.310+0000 7faf66ffd640 1 -- 172.21.15.6:0/3439208101 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c0ab7b0 con 0x7faf68160450 2023-07-21T22:55:25.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.310+0000 7faf66ffd640 1 -- 172.21.15.6:0/3439208101 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0abb40 con 0x7faf68160450 2023-07-21T22:55:25.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.310+0000 7faf6e99f640 1 -- 172.21.15.6:0/3439208101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf68160450 msgr2=0x7faf6806e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:25.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.310+0000 7faf6e99f640 1 --2- 172.21.15.6:0/3439208101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf68160450 0x7faf6806e690 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7faf5c0097c0 tx=0x7faf5c01c450 comp rx=0 tx=0).stop 2023-07-21T22:55:25.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.310+0000 7faf6e99f640 1 -- 172.21.15.6:0/3439208101 shutdown_connections 2023-07-21T22:55:25.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.310+0000 7faf6e99f640 1 --2- 172.21.15.6:0/3439208101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf68069430 0x7faf68069870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.310+0000 7faf6e99f640 1 --2- 172.21.15.6:0/3439208101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf68160450 0x7faf6806e690 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.310+0000 7faf6e99f640 1 -- 172.21.15.6:0/3439208101 >> 172.21.15.6:0/3439208101 conn(0x7faf680b1840 msgr2=0x7faf680cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:25.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.310+0000 7faf6e99f640 1 -- 172.21.15.6:0/3439208101 shutdown_connections 2023-07-21T22:55:25.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.310+0000 7faf6e99f640 1 -- 172.21.15.6:0/3439208101 wait complete. 2023-07-21T22:55:25.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.310+0000 7faf6e99f640 1 Processor -- start 2023-07-21T22:55:25.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.310+0000 7faf6e99f640 1 -- start start 2023-07-21T22:55:25.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf6e99f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf68069430 0x7faf680c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:25.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf6e99f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf6815bc00 0x7faf6806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:25.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf6e99f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf68160450 0x7faf68159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:25.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf6e99f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6806c530 con 0x7faf68160450 2023-07-21T22:55:25.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf6e99f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6806d7a0 con 0x7faf68069430 2023-07-21T22:55:25.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf6e99f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6806e830 con 0x7faf6815bc00 2023-07-21T22:55:25.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf6cf3c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf68160450 0x7faf68159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:25.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf6cf3c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf68160450 0x7faf68159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35746/0 (socket says 172.21.15.6:35746) 2023-07-21T22:55:25.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf6cf3c640 1 -- 172.21.15.6:0/492744608 learned_addr learned my addr 172.21.15.6:0/492744608 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:25.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf677fe640 1 --2- 172.21.15.6:0/492744608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf6815bc00 0x7faf6806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:25.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf67fff640 1 --2- 172.21.15.6:0/492744608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf68069430 0x7faf680c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:25.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf6cf3c640 1 -- 172.21.15.6:0/492744608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf6815bc00 msgr2=0x7faf6806d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:25.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf6cf3c640 1 --2- 172.21.15.6:0/492744608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf6815bc00 0x7faf6806d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf6cf3c640 1 -- 172.21.15.6:0/492744608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf68069430 msgr2=0x7faf680c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:25.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf6cf3c640 1 --2- 172.21.15.6:0/492744608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf68069430 0x7faf680c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf6cf3c640 1 -- 172.21.15.6:0/492744608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c009420 con 0x7faf68160450 2023-07-21T22:55:25.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf6cf3c640 1 --2- 172.21.15.6:0/492744608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf68160450 0x7faf68159790 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7faf6000efc0 tx=0x7faf6000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:25.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf64ff9640 1 -- 172.21.15.6:0/492744608 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60014480 con 0x7faf68160450 2023-07-21T22:55:25.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf64ff9640 1 -- 172.21.15.6:0/492744608 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6000f040 con 0x7faf68160450 2023-07-21T22:55:25.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf64ff9640 1 -- 172.21.15.6:0/492744608 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf60014820 con 0x7faf68160450 2023-07-21T22:55:25.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf6e99f640 1 -- 172.21.15.6:0/492744608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6806c780 con 0x7faf68160450 2023-07-21T22:55:25.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf6e99f640 1 -- 172.21.15.6:0/492744608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6806cd40 con 0x7faf68160450 2023-07-21T22:55:25.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.314+0000 7faf6e99f640 1 -- 172.21.15.6:0/492744608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf6806cf30 con 0x7faf68160450 2023-07-21T22:55:25.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.318+0000 7faf64ff9640 1 -- 172.21.15.6:0/492744608 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 80) v1 ==== 85496+0+0 (secure 0 0 0) 0x7faf60014980 con 0x7faf68160450 2023-07-21T22:55:25.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.318+0000 7faf64ff9640 1 --2- 172.21.15.6:0/492744608 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7faf540660d0 0x7faf54068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:25.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.318+0000 7faf64ff9640 1 -- 172.21.15.6:0/492744608 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7194+0+0 (secure 0 0 0) 0x7faf600848c0 con 0x7faf68160450 2023-07-21T22:55:25.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.318+0000 7faf67fff640 1 --2- 172.21.15.6:0/492744608 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7faf540660d0 0x7faf54068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:25.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.318+0000 7faf67fff640 1 --2- 172.21.15.6:0/492744608 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7faf540660d0 0x7faf54068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faf58005890 tx=0x7faf58009040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:25.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.322+0000 7faf64ff9640 1 -- 172.21.15.6:0/492744608 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf60051bf0 con 0x7faf68160450 2023-07-21T22:55:25.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.510+0000 7faf6e99f640 1 -- 172.21.15.6:0/492744608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf680678d0 con 0x7faf68160450 2023-07-21T22:55:25.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.510+0000 7faf64ff9640 1 -- 172.21.15.6:0/492744608 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4670 (secure 0 0 0) 0x7faf60055210 con 0x7faf68160450 2023-07-21T22:55:25.550 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:25.550 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/2365019581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2365019581},{"type":"v1","addr":"172.21.15.161:6836","nonce":2365019581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8968,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/798924835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":798924835},{"type":"v1","addr":"172.21.15.161:6837","nonce":798924835}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2487387353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2487387353},{"type":"v1","addr":"172.21.15.6:6834","nonce":2487387353}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:39:03.424297+0000","modified":"2023-07-21T22:39:07.057160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9309":{"gid":9309,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2700138945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2700138945},{"type":"v1","addr":"172.21.15.6:6835","nonce":2700138945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-21T22:55:25.551 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 70 2023-07-21T22:55:25.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.514+0000 7faf6e99f640 1 -- 172.21.15.6:0/492744608 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7faf540660d0 msgr2=0x7faf54068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:25.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.514+0000 7faf6e99f640 1 --2- 172.21.15.6:0/492744608 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7faf540660d0 0x7faf54068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faf58005890 tx=0x7faf58009040 comp rx=0 tx=0).stop 2023-07-21T22:55:25.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.514+0000 7faf6e99f640 1 -- 172.21.15.6:0/492744608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf68160450 msgr2=0x7faf68159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:25.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.514+0000 7faf6e99f640 1 --2- 172.21.15.6:0/492744608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf68160450 0x7faf68159790 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7faf6000efc0 tx=0x7faf6000c490 comp rx=0 tx=0).stop 2023-07-21T22:55:25.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.514+0000 7faf6e99f640 1 -- 172.21.15.6:0/492744608 shutdown_connections 2023-07-21T22:55:25.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.514+0000 7faf6e99f640 1 --2- 172.21.15.6:0/492744608 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7faf540660d0 0x7faf54068580 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.514+0000 7faf6e99f640 1 --2- 172.21.15.6:0/492744608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf68160450 0x7faf68159790 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.514+0000 7faf6e99f640 1 --2- 172.21.15.6:0/492744608 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faf6815bc00 0x7faf6806d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.514+0000 7faf6e99f640 1 --2- 172.21.15.6:0/492744608 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf68069430 0x7faf680c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.514+0000 7faf6e99f640 1 -- 172.21.15.6:0/492744608 >> 172.21.15.6:0/492744608 conn(0x7faf680b1840 msgr2=0x7faf68154700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:25.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.514+0000 7faf6e99f640 1 -- 172.21.15.6:0/492744608 shutdown_connections 2023-07-21T22:55:25.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.514+0000 7faf6e99f640 1 -- 172.21.15.6:0/492744608 wait complete. 2023-07-21T22:55:25.572 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:55:25.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.678+0000 7f93e4eca640 1 Processor -- start 2023-07-21T22:55:25.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.678+0000 7f93e4eca640 1 -- start start 2023-07-21T22:55:25.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.678+0000 7f93e4eca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f93e0158ce0 0x7f93e0070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:25.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.678+0000 7f93e4eca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93e00c9730 0x7f93e00ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:25.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.678+0000 7f93e4eca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e00cc700 con 0x7f93e00c8ad0 2023-07-21T22:55:25.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.682+0000 7f93e4eca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e00b0ff0 con 0x7f93e0158ce0 2023-07-21T22:55:25.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.682+0000 7f93e4eca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e0070c80 con 0x7f93e00c9730 2023-07-21T22:55:25.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.682+0000 7f93de59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f93e0158ce0 0x7f93e0070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:25.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.682+0000 7f93de59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f93e0158ce0 0x7f93e0070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35762/0 (socket says 172.21.15.6:35762) 2023-07-21T22:55:25.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.682+0000 7f93de59c640 1 -- 172.21.15.6:0/4049249966 learned_addr learned my addr 172.21.15.6:0/4049249966 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:25.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.682+0000 7f93ded9d640 1 --2- 172.21.15.6:0/4049249966 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93e00c9730 0x7f93e00ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:25.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.682+0000 7f93de59c640 1 -- 172.21.15.6:0/4049249966 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93e00c9730 msgr2=0x7f93e00ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:25.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.682+0000 7f93de59c640 1 --2- 172.21.15.6:0/4049249966 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93e00c9730 0x7f93e00ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.682+0000 7f93de59c640 1 -- 172.21.15.6:0/4049249966 >> v1:172.21.15.6:6789/0 conn(0x7f93e00c8ad0 legacy=0x7f93e00c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:25.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.682+0000 7f93de59c640 1 -- 172.21.15.6:0/4049249966 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e00cbdd0 con 0x7f93e0158ce0 2023-07-21T22:55:25.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.682+0000 7f93de59c640 1 --2- 172.21.15.6:0/4049249966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e0158ce0 0x7f93e0070450 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009870 tx=0x7f93d001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e195a3c0c8326a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:25.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.686+0000 7f93ddd9b640 1 -- 172.21.15.6:0/4049249966 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d00ab600 con 0x7f93e0158ce0 2023-07-21T22:55:25.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.686+0000 7f93ddd9b640 1 -- 172.21.15.6:0/4049249966 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d00a7050 con 0x7f93e0158ce0 2023-07-21T22:55:25.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.686+0000 7f93ddd9b640 1 -- 172.21.15.6:0/4049249966 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d00ab980 con 0x7f93e0158ce0 2023-07-21T22:55:25.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.686+0000 7f93e4eca640 1 -- 172.21.15.6:0/4049249966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e0158ce0 msgr2=0x7f93e0070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:25.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.686+0000 7f93e4eca640 1 --2- 172.21.15.6:0/4049249966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e0158ce0 0x7f93e0070450 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f93d0009870 tx=0x7f93d001c3f0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.686+0000 7f93e4eca640 1 -- 172.21.15.6:0/4049249966 shutdown_connections 2023-07-21T22:55:25.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.686+0000 7f93e4eca640 1 --2- 172.21.15.6:0/4049249966 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93e00c9730 0x7f93e00ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.686+0000 7f93e4eca640 1 --2- 172.21.15.6:0/4049249966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e0158ce0 0x7f93e0070450 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.686+0000 7f93e4eca640 1 -- 172.21.15.6:0/4049249966 >> 172.21.15.6:0/4049249966 conn(0x7f93e00afcf0 msgr2=0x7f93e00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:25.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.686+0000 7f93e4eca640 1 -- 172.21.15.6:0/4049249966 shutdown_connections 2023-07-21T22:55:25.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.686+0000 7f93e4eca640 1 -- 172.21.15.6:0/4049249966 wait complete. 2023-07-21T22:55:25.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.686+0000 7f93e4eca640 1 Processor -- start 2023-07-21T22:55:25.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.686+0000 7f93e4eca640 1 -- start start 2023-07-21T22:55:25.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.686+0000 7f93e4eca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93e00c8ad0 0x7f93e01457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:25.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.686+0000 7f93e4eca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e00c9730 0x7f93e00c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:25.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.686+0000 7f93e4eca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93e0158ce0 0x7f93e00c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:25.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.686+0000 7f93e4eca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00c1db0 con 0x7f93e00c9730 2023-07-21T22:55:25.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.686+0000 7f93e4eca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00c7930 con 0x7f93e0158ce0 2023-07-21T22:55:25.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.686+0000 7f93e4eca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00c7c10 con 0x7f93e00c8ad0 2023-07-21T22:55:25.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.686+0000 7f93d7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e00c9730 0x7f93e00c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:25.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.690+0000 7f93d7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e00c9730 0x7f93e00c4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35778/0 (socket says 172.21.15.6:35778) 2023-07-21T22:55:25.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.690+0000 7f93d7fff640 1 -- 172.21.15.6:0/4119775772 learned_addr learned my addr 172.21.15.6:0/4119775772 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:25.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.690+0000 7f93d7fff640 1 -- 172.21.15.6:0/4119775772 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93e00c8ad0 msgr2=0x7f93e01457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:25.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.690+0000 7f93d7fff640 1 --2- 172.21.15.6:0/4119775772 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93e00c8ad0 0x7f93e01457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.690+0000 7f93d7fff640 1 -- 172.21.15.6:0/4119775772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93e0158ce0 msgr2=0x7f93e00c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:25.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.690+0000 7f93d7fff640 1 --2- 172.21.15.6:0/4119775772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93e0158ce0 0x7f93e00c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.690+0000 7f93d7fff640 1 -- 172.21.15.6:0/4119775772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d00094d0 con 0x7f93e00c9730 2023-07-21T22:55:25.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.690+0000 7f93d7fff640 1 --2- 172.21.15.6:0/4119775772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e00c9730 0x7f93e00c4620 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f93c800c500 tx=0x7f93c800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.690+0000 7f93d6ffd640 1 -- 172.21.15.6:0/4119775772 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c8005220 con 0x7f93e00c9730 2023-07-21T22:55:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.690+0000 7f93d6ffd640 1 -- 172.21.15.6:0/4119775772 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c8005380 con 0x7f93e00c9730 2023-07-21T22:55:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.690+0000 7f93e4eca640 1 -- 172.21.15.6:0/4119775772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e00c7ef0 con 0x7f93e00c9730 2023-07-21T22:55:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.690+0000 7f93d6ffd640 1 -- 172.21.15.6:0/4119775772 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c8007270 con 0x7f93e00c9730 2023-07-21T22:55:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.690+0000 7f93e4eca640 1 -- 172.21.15.6:0/4119775772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e00c4b60 con 0x7f93e00c9730 2023-07-21T22:55:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.690+0000 7f93e4eca640 1 -- 172.21.15.6:0/4119775772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e00ca1a0 con 0x7f93e00c9730 2023-07-21T22:55:25.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.690+0000 7f93d6ffd640 1 -- 172.21.15.6:0/4119775772 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 80) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f93c80073d0 con 0x7f93e00c9730 2023-07-21T22:55:25.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.694+0000 7f93d6ffd640 1 --2- 172.21.15.6:0/4119775772 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f93c00660d0 0x7f93c0068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:25.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.694+0000 7f93d6ffd640 1 -- 172.21.15.6:0/4119775772 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7194+0+0 (secure 0 0 0) 0x7f93c8083800 con 0x7f93e00c9730 2023-07-21T22:55:25.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.694+0000 7f93de59c640 1 --2- 172.21.15.6:0/4119775772 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f93c00660d0 0x7f93c0068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:25.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.694+0000 7f93de59c640 1 --2- 172.21.15.6:0/4119775772 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f93c00660d0 0x7f93c0068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f93d00ad000 tx=0x7f93d0008040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.698+0000 7f93d6ffd640 1 -- 172.21.15.6:0/4119775772 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f93c8050a90 con 0x7f93e00c9730 2023-07-21T22:55:25.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.850+0000 7f93e4eca640 1 -- 172.21.15.6:0/4119775772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93e00678d0 con 0x7f93e00c9730 2023-07-21T22:55:25.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.854+0000 7f93d6ffd640 1 -- 172.21.15.6:0/4119775772 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+19945 (secure 0 0 0) 0x7f93c80540b0 con 0x7f93e00c9730 2023-07-21T22:55:25.892 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:25.892 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":161,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:55:24.107651+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:39:01.548583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-21T22:39:02.416927+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":160,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/3926753011":"2023-07-22T22:55:24.107597+0000","172.21.15.161:6833/835248343":"2023-07-22T22:55:24.107597+0000","172.21.15.161:6832/835248343":"2023-07-22T22:55:24.107597+0000","172.21.15.161:0/3919160506":"2023-07-22T22:55:24.107597+0000","172.21.15.161:0/3220660921":"2023-07-22T22:55:24.107597+0000","172.21.15.161:0/2510820144":"2023-07-22T22:55:24.107597+0000","172.21.15.161:0/3139687337":"2023-07-22T22:55:24.107597+0000","172.21.15.161:0/1641497343":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/1520394641":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/52253068":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/3217579618":"2023-07-22T22:50:20.828371+0000","172.21.15.161:6833/3096900160":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/1245542883":"2023-07-22T22:39:20.660905+0000","172.21.15.161:0/2766778262":"2023-07-22T22:39:20.660905+0000","172.21.15.161:0/3376805209":"2023-07-22T22:55:24.107597+0000","172.21.15.161:0/2288195162":"2023-07-22T22:39:20.660905+0000","172.21.15.161:0/107992510":"2023-07-22T22:50:20.828371+0000","172.21.15.161:6833/2692111396":"2023-07-22T22:39:20.660905+0000","172.21.15.161:6832/3096900160":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/4115864188":"2023-07-22T22:39:20.660905+0000","172.21.15.161:6832/2692111396":"2023-07-22T22:39:20.660905+0000","172.21.15.161:0/2485992449":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/389976077":"2023-07-22T22:39:20.660905+0000","172.21.15.161:0/1635694091":"2023-07-22T22:39:20.660905+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:55:25.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.854+0000 7f93e4eca640 1 -- 172.21.15.6:0/4119775772 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f93c00660d0 msgr2=0x7f93c0068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:25.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.854+0000 7f93e4eca640 1 --2- 172.21.15.6:0/4119775772 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f93c00660d0 0x7f93c0068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f93d00ad000 tx=0x7f93d0008040 comp rx=0 tx=0).stop 2023-07-21T22:55:25.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.854+0000 7f93e4eca640 1 -- 172.21.15.6:0/4119775772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e00c9730 msgr2=0x7f93e00c4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:25.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.854+0000 7f93e4eca640 1 --2- 172.21.15.6:0/4119775772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e00c9730 0x7f93e00c4620 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f93c800c500 tx=0x7f93c800c9c0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.854+0000 7f93e4eca640 1 -- 172.21.15.6:0/4119775772 shutdown_connections 2023-07-21T22:55:25.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.854+0000 7f93e4eca640 1 --2- 172.21.15.6:0/4119775772 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f93c00660d0 0x7f93c0068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.854+0000 7f93e4eca640 1 --2- 172.21.15.6:0/4119775772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93e0158ce0 0x7f93e00c6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.854+0000 7f93e4eca640 1 --2- 172.21.15.6:0/4119775772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93e00c9730 0x7f93e00c4620 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.854+0000 7f93e4eca640 1 --2- 172.21.15.6:0/4119775772 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f93e00c8ad0 0x7f93e01457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:25.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.854+0000 7f93e4eca640 1 -- 172.21.15.6:0/4119775772 >> 172.21.15.6:0/4119775772 conn(0x7f93e00afcf0 msgr2=0x7f93e0157f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:25.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.854+0000 7f93e4eca640 1 -- 172.21.15.6:0/4119775772 shutdown_connections 2023-07-21T22:55:25.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:25.854+0000 7f93e4eca640 1 -- 172.21.15.6:0/4119775772 wait complete. 2023-07-21T22:55:25.912 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-21T22:55:25.912 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:55:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.018+0000 7f39d0b00640 1 Processor -- start 2023-07-21T22:55:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.018+0000 7f39d0b00640 1 -- start start 2023-07-21T22:55:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.018+0000 7f39d0b00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f39cc158ce0 0x7f39cc070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.018+0000 7f39d0b00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f39cc0c9730 0x7f39cc0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.018+0000 7f39d0b00640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39cc0cc700 con 0x7f39cc0c8ad0 2023-07-21T22:55:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.018+0000 7f39d0b00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39cc0b0ff0 con 0x7f39cc158ce0 2023-07-21T22:55:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.018+0000 7f39d0b00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39cc070c80 con 0x7f39cc0c9730 2023-07-21T22:55:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.018+0000 7f39ca59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f39cc158ce0 0x7f39cc070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.018+0000 7f39ca59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f39cc158ce0 0x7f39cc070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35792/0 (socket says 172.21.15.6:35792) 2023-07-21T22:55:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.018+0000 7f39ca59c640 1 -- 172.21.15.6:0/2647707402 learned_addr learned my addr 172.21.15.6:0/2647707402 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.018+0000 7f39cad9d640 1 --2- 172.21.15.6:0/2647707402 >> v2:172.21.15.161:3300/0 conn(0x7f39cc0c9730 0x7f39cc0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.018+0000 7f39ca59c640 1 -- 172.21.15.6:0/2647707402 >> v2:172.21.15.161:3300/0 conn(0x7f39cc0c9730 msgr2=0x7f39cc0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:26.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.018+0000 7f39ca59c640 1 --2- 172.21.15.6:0/2647707402 >> v2:172.21.15.161:3300/0 conn(0x7f39cc0c9730 0x7f39cc0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.018+0000 7f39ca59c640 1 -- 172.21.15.6:0/2647707402 >> v1:172.21.15.161:6789/0 conn(0x7f39cc0c8ad0 legacy=0x7f39cc0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:26.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.018+0000 7f39ca59c640 1 -- 172.21.15.6:0/2647707402 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39cc0cbdd0 con 0x7f39cc158ce0 2023-07-21T22:55:26.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.022+0000 7f39ca59c640 1 --2- 172.21.15.6:0/2647707402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39cc158ce0 0x7f39cc070450 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f39cc0b0d70 tx=0x7f39bc01e580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c076d4707119bfc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:26.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.022+0000 7f39c9d9b640 1 -- 172.21.15.6:0/2647707402 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc0ab650 con 0x7f39cc158ce0 2023-07-21T22:55:26.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.022+0000 7f39c9d9b640 1 -- 172.21.15.6:0/2647707402 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39bc0ab7b0 con 0x7f39cc158ce0 2023-07-21T22:55:26.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.022+0000 7f39c9d9b640 1 -- 172.21.15.6:0/2647707402 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc0abb40 con 0x7f39cc158ce0 2023-07-21T22:55:26.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.022+0000 7f39d0b00640 1 -- 172.21.15.6:0/2647707402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39cc158ce0 msgr2=0x7f39cc070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:26.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.022+0000 7f39d0b00640 1 --2- 172.21.15.6:0/2647707402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39cc158ce0 0x7f39cc070450 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f39cc0b0d70 tx=0x7f39bc01e580 comp rx=0 tx=0).stop 2023-07-21T22:55:26.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.022+0000 7f39d0b00640 1 -- 172.21.15.6:0/2647707402 shutdown_connections 2023-07-21T22:55:26.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.022+0000 7f39d0b00640 1 --2- 172.21.15.6:0/2647707402 >> v2:172.21.15.161:3300/0 conn(0x7f39cc0c9730 0x7f39cc0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.022+0000 7f39d0b00640 1 --2- 172.21.15.6:0/2647707402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39cc158ce0 0x7f39cc070450 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.022+0000 7f39d0b00640 1 -- 172.21.15.6:0/2647707402 >> 172.21.15.6:0/2647707402 conn(0x7f39cc0afcf0 msgr2=0x7f39cc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:26.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.022+0000 7f39d0b00640 1 -- 172.21.15.6:0/2647707402 shutdown_connections 2023-07-21T22:55:26.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.022+0000 7f39d0b00640 1 -- 172.21.15.6:0/2647707402 wait complete. 2023-07-21T22:55:26.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.026+0000 7f39d0b00640 1 Processor -- start 2023-07-21T22:55:26.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.026+0000 7f39d0b00640 1 -- start start 2023-07-21T22:55:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.026+0000 7f39d0b00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39cc0c8ad0 0x7f39cc149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.026+0000 7f39d0b00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39cc0c9730 0x7f39cc0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.026+0000 7f39d0b00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39cc158ce0 0x7f39cc0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.026+0000 7f39d0b00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc14a030 con 0x7f39cc0c8ad0 2023-07-21T22:55:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.026+0000 7f39d0b00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc1f40c0 con 0x7f39cc0c9730 2023-07-21T22:55:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.026+0000 7f39d0b00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc1f43a0 con 0x7f39cc158ce0 2023-07-21T22:55:26.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.026+0000 7f39ca59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39cc0c8ad0 0x7f39cc149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:26.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.026+0000 7f39ca59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39cc0c8ad0 0x7f39cc149af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35804/0 (socket says 172.21.15.6:35804) 2023-07-21T22:55:26.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.026+0000 7f39ca59c640 1 -- 172.21.15.6:0/4269003916 learned_addr learned my addr 172.21.15.6:0/4269003916 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:26.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.026+0000 7f39c3fff640 1 --2- 172.21.15.6:0/4269003916 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39cc0c9730 0x7f39cc0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:26.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.026+0000 7f39cad9d640 1 --2- 172.21.15.6:0/4269003916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39cc158ce0 0x7f39cc0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:26.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.026+0000 7f39ca59c640 1 -- 172.21.15.6:0/4269003916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39cc158ce0 msgr2=0x7f39cc0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:26.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.026+0000 7f39ca59c640 1 --2- 172.21.15.6:0/4269003916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39cc158ce0 0x7f39cc0cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.026+0000 7f39ca59c640 1 -- 172.21.15.6:0/4269003916 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39cc0c9730 msgr2=0x7f39cc0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:26.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.026+0000 7f39ca59c640 1 --2- 172.21.15.6:0/4269003916 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39cc0c9730 0x7f39cc0ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.026+0000 7f39ca59c640 1 -- 172.21.15.6:0/4269003916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc0094d0 con 0x7f39cc0c8ad0 2023-07-21T22:55:26.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.026+0000 7f39ca59c640 1 --2- 172.21.15.6:0/4269003916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39cc0c8ad0 0x7f39cc149af0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f39bc01c1b0 tx=0x7f39bc01b320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:26.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.026+0000 7f39c2ffd640 1 -- 172.21.15.6:0/4269003916 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc0ab650 con 0x7f39cc0c8ad0 2023-07-21T22:55:26.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.030+0000 7f39c2ffd640 1 -- 172.21.15.6:0/4269003916 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39bc0b3800 con 0x7f39cc0c8ad0 2023-07-21T22:55:26.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.030+0000 7f39d0b00640 1 -- 172.21.15.6:0/4269003916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39cc1f4680 con 0x7f39cc0c8ad0 2023-07-21T22:55:26.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.030+0000 7f39c2ffd640 1 -- 172.21.15.6:0/4269003916 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc0b3bb0 con 0x7f39cc0c8ad0 2023-07-21T22:55:26.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.030+0000 7f39d0b00640 1 -- 172.21.15.6:0/4269003916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39cc1f4c40 con 0x7f39cc0c8ad0 2023-07-21T22:55:26.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.030+0000 7f39d0b00640 1 -- 172.21.15.6:0/4269003916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39cc0ca1a0 con 0x7f39cc0c8ad0 2023-07-21T22:55:26.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.030+0000 7f39c2ffd640 1 -- 172.21.15.6:0/4269003916 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 80) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f39bc0b3d10 con 0x7f39cc0c8ad0 2023-07-21T22:55:26.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.030+0000 7f39c2ffd640 1 --2- 172.21.15.6:0/4269003916 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f39ac0660d0 0x7f39ac068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:26.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.030+0000 7f39c2ffd640 1 -- 172.21.15.6:0/4269003916 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7194+0+0 (secure 0 0 0) 0x7f39bc11ec50 con 0x7f39cc0c8ad0 2023-07-21T22:55:26.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.030+0000 7f39c3fff640 1 --2- 172.21.15.6:0/4269003916 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f39ac0660d0 0x7f39ac068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:26.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.030+0000 7f39c3fff640 1 --2- 172.21.15.6:0/4269003916 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f39ac0660d0 0x7f39ac068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f39cc15be60 tx=0x7f39b4007e40 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:26.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.034+0000 7f39c2ffd640 1 -- 172.21.15.6:0/4269003916 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f39bc0ec000 con 0x7f39cc0c8ad0 2023-07-21T22:55:26.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.222+0000 7f39d0b00640 1 -- 172.21.15.6:0/4269003916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39cc1f4e30 con 0x7f39cc0c8ad0 2023-07-21T22:55:26.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.226+0000 7f39c2ffd640 1 -- 172.21.15.6:0/4269003916 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4670 (secure 0 0 0) 0x7f39bc0ef620 con 0x7f39cc0c8ad0 2023-07-21T22:55:26.263 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:26.263 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/2365019581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2365019581},{"type":"v1","addr":"172.21.15.161:6836","nonce":2365019581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8968,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/798924835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":798924835},{"type":"v1","addr":"172.21.15.161:6837","nonce":798924835}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2487387353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2487387353},{"type":"v1","addr":"172.21.15.6:6834","nonce":2487387353}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:39:03.424297+0000","modified":"2023-07-21T22:39:07.057160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9309":{"gid":9309,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2700138945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2700138945},{"type":"v1","addr":"172.21.15.6:6835","nonce":2700138945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-21T22:55:26.263 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 70 2023-07-21T22:55:26.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.226+0000 7f39d0b00640 1 -- 172.21.15.6:0/4269003916 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f39ac0660d0 msgr2=0x7f39ac068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:26.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.226+0000 7f39d0b00640 1 --2- 172.21.15.6:0/4269003916 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f39ac0660d0 0x7f39ac068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f39cc15be60 tx=0x7f39b4007e40 comp rx=0 tx=0).stop 2023-07-21T22:55:26.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.226+0000 7f39d0b00640 1 -- 172.21.15.6:0/4269003916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39cc0c8ad0 msgr2=0x7f39cc149af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:26.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.226+0000 7f39d0b00640 1 --2- 172.21.15.6:0/4269003916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39cc0c8ad0 0x7f39cc149af0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f39bc01c1b0 tx=0x7f39bc01b320 comp rx=0 tx=0).stop 2023-07-21T22:55:26.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.226+0000 7f39d0b00640 1 -- 172.21.15.6:0/4269003916 shutdown_connections 2023-07-21T22:55:26.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.226+0000 7f39d0b00640 1 --2- 172.21.15.6:0/4269003916 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f39ac0660d0 0x7f39ac068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.226+0000 7f39d0b00640 1 --2- 172.21.15.6:0/4269003916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39cc158ce0 0x7f39cc0cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.226+0000 7f39d0b00640 1 --2- 172.21.15.6:0/4269003916 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39cc0c9730 0x7f39cc0ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.226+0000 7f39d0b00640 1 --2- 172.21.15.6:0/4269003916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39cc0c8ad0 0x7f39cc149af0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.226+0000 7f39d0b00640 1 -- 172.21.15.6:0/4269003916 >> 172.21.15.6:0/4269003916 conn(0x7f39cc0afcf0 msgr2=0x7f39cc14dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:26.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.226+0000 7f39d0b00640 1 -- 172.21.15.6:0/4269003916 shutdown_connections 2023-07-21T22:55:26.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.226+0000 7f39d0b00640 1 -- 172.21.15.6:0/4269003916 wait complete. 2023-07-21T22:55:26.284 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:55:26.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.394+0000 7f0503f82640 1 Processor -- start 2023-07-21T22:55:26.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.394+0000 7f0503f82640 1 -- start start 2023-07-21T22:55:26.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.394+0000 7f0503f82640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04fc06a9c0 0x7f04fc0ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:26.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.394+0000 7f0503f82640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04fc0cdc80 con 0x7f04fc06a540 2023-07-21T22:55:26.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.394+0000 7f0503f82640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04fc06e4c0 con 0x7f04fc15f500 2023-07-21T22:55:26.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.394+0000 7f0503f82640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc06ae40 con 0x7f04fc06a9c0 2023-07-21T22:55:26.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.394+0000 7f050151d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f04fc06a540 0x7f04fc0ce0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58616/0 (socket says 172.21.15.6:58616) 2023-07-21T22:55:26.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.394+0000 7f050151d640 1 -- 172.21.15.6:0/2877678445 learned_addr learned my addr 172.21.15.6:0/2877678445 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:26.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.394+0000 7f050251f640 1 --2- 172.21.15.6:0/2877678445 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04fc06a9c0 0x7f04fc0ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:26.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.394+0000 7f0500d1c640 1 -- 172.21.15.6:0/2877678445 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896299211 0 0) 0x7f04fc0cdc80 con 0x7f04fc06a540 2023-07-21T22:55:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.394+0000 7f0500d1c640 1 -- 172.21.15.6:0/2877678445 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04e8003530 con 0x7f04fc06a540 2023-07-21T22:55:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.394+0000 7f0500d1c640 1 -- 172.21.15.6:0/2877678445 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794171107 0 0) 0x7f04fc06e4c0 con 0x7f04fc15f500 2023-07-21T22:55:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.394+0000 7f0500d1c640 1 -- 172.21.15.6:0/2877678445 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04fc0cdc80 con 0x7f04fc15f500 2023-07-21T22:55:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.394+0000 7f050251f640 1 -- 172.21.15.6:0/2877678445 >> v1:172.21.15.161:6789/0 conn(0x7f04fc15f500 legacy=0x7f04fc06cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.394+0000 7f050251f640 1 -- 172.21.15.6:0/2877678445 >> v1:172.21.15.6:6789/0 conn(0x7f04fc06a540 legacy=0x7f04fc0ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.394+0000 7f0500d1c640 1 -- 172.21.15.6:0/2877678445 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 746456877 0 0) 0x7f04e8003530 con 0x7f04fc06a540 2023-07-21T22:55:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.394+0000 7f050251f640 1 -- 172.21.15.6:0/2877678445 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04fc06d940 con 0x7f04fc06a9c0 2023-07-21T22:55:26.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.398+0000 7f050251f640 1 --2- 172.21.15.6:0/2877678445 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04fc06a9c0 0x7f04fc0ce800 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009dc0 tx=0x7f04f401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=642d04a2fe646f1e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:26.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.398+0000 7f0500d1c640 1 -- 172.21.15.6:0/2877678445 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f40a5920 con 0x7f04fc06a9c0 2023-07-21T22:55:26.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.398+0000 7f0500d1c640 1 -- 172.21.15.6:0/2877678445 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f40a5a80 con 0x7f04fc06a9c0 2023-07-21T22:55:26.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.398+0000 7f0500d1c640 1 -- 172.21.15.6:0/2877678445 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f40a5e10 con 0x7f04fc06a9c0 2023-07-21T22:55:26.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.398+0000 7f0503f82640 1 -- 172.21.15.6:0/2877678445 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04fc06a9c0 msgr2=0x7f04fc0ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:26.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.398+0000 7f0503f82640 1 --2- 172.21.15.6:0/2877678445 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04fc06a9c0 0x7f04fc0ce800 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009dc0 tx=0x7f04f401c970 comp rx=0 tx=0).stop 2023-07-21T22:55:26.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.398+0000 7f0503f82640 1 -- 172.21.15.6:0/2877678445 shutdown_connections 2023-07-21T22:55:26.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.398+0000 7f0503f82640 1 --2- 172.21.15.6:0/2877678445 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04fc06a9c0 0x7f04fc0ce800 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.398+0000 7f0503f82640 1 -- 172.21.15.6:0/2877678445 >> 172.21.15.6:0/2877678445 conn(0x7f04fc0659d0 msgr2=0x7f04fc099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:26.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.398+0000 7f0503f82640 1 -- 172.21.15.6:0/2877678445 shutdown_connections 2023-07-21T22:55:26.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.398+0000 7f0503f82640 1 -- 172.21.15.6:0/2877678445 wait complete. 2023-07-21T22:55:26.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f0503f82640 1 Processor -- start 2023-07-21T22:55:26.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f0503f82640 1 -- start start 2023-07-21T22:55:26.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f0503f82640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04fc06a540 0x7f04fc0cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:26.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f0503f82640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04fc06a9c0 0x7f04fc154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:26.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f0503f82640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04fc15f500 0x7f04fc14d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:26.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f0503f82640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc154bc0 con 0x7f04fc06a540 2023-07-21T22:55:26.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f0503f82640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc0cc6a0 con 0x7f04fc15f500 2023-07-21T22:55:26.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f0503f82640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc0cc980 con 0x7f04fc06a9c0 2023-07-21T22:55:26.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f0501d1e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04fc06a540 0x7f04fc0cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:26.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f0501d1e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04fc06a540 0x7f04fc0cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35818/0 (socket says 172.21.15.6:35818) 2023-07-21T22:55:26.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f0501d1e640 1 -- 172.21.15.6:0/669345721 learned_addr learned my addr 172.21.15.6:0/669345721 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:26.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f050251f640 1 --2- 172.21.15.6:0/669345721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04fc15f500 0x7f04fc14d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:26.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f050151d640 1 --2- 172.21.15.6:0/669345721 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04fc06a9c0 0x7f04fc154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:26.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f0501d1e640 1 -- 172.21.15.6:0/669345721 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04fc06a9c0 msgr2=0x7f04fc154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:26.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f0501d1e640 1 --2- 172.21.15.6:0/669345721 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04fc06a9c0 0x7f04fc154fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f0501d1e640 1 -- 172.21.15.6:0/669345721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04fc15f500 msgr2=0x7f04fc14d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f0501d1e640 1 --2- 172.21.15.6:0/669345721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04fc15f500 0x7f04fc14d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f0501d1e640 1 -- 172.21.15.6:0/669345721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f4009a70 con 0x7f04fc06a540 2023-07-21T22:55:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f050251f640 1 --2- 172.21.15.6:0/669345721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04fc15f500 0x7f04fc14d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f0501d1e640 1 --2- 172.21.15.6:0/669345721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04fc06a540 0x7f04fc0cbe50 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f04f800c420 tx=0x7f04f800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f04f27fc640 1 -- 172.21.15.6:0/669345721 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f80052d0 con 0x7f04fc06a540 2023-07-21T22:55:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f04f27fc640 1 -- 172.21.15.6:0/669345721 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f8005430 con 0x7f04fc06a540 2023-07-21T22:55:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f04f27fc640 1 -- 172.21.15.6:0/669345721 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8003870 con 0x7f04fc06a540 2023-07-21T22:55:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f0503f82640 1 -- 172.21.15.6:0/669345721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04fc1547e0 con 0x7f04fc06a540 2023-07-21T22:55:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.402+0000 7f0503f82640 1 -- 172.21.15.6:0/669345721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04fc155520 con 0x7f04fc06a540 2023-07-21T22:55:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.406+0000 7f0503f82640 1 -- 172.21.15.6:0/669345721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04fc154e30 con 0x7f04fc06a540 2023-07-21T22:55:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.406+0000 7f04f27fc640 1 -- 172.21.15.6:0/669345721 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f04f80039d0 con 0x7f04fc06a540 2023-07-21T22:55:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.406+0000 7f04f27fc640 1 --2- 172.21.15.6:0/669345721 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f04e00663a0 0x7f04e0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.406+0000 7f04f27fc640 1 -- 172.21.15.6:0/669345721 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7194+0+0 (secure 0 0 0) 0x7f04f8083970 con 0x7f04fc06a540 2023-07-21T22:55:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.406+0000 7f050151d640 1 --2- 172.21.15.6:0/669345721 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f04e00663a0 0x7f04e0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.406+0000 7f050151d640 1 --2- 172.21.15.6:0/669345721 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f04e00663a0 0x7f04e0068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f04fc0b5c00 tx=0x7f04ec009040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:26.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.410+0000 7f04f27fc640 1 -- 172.21.15.6:0/669345721 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f04f80507d0 con 0x7f04fc06a540 2023-07-21T22:55:26.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.598+0000 7f0503f82640 1 -- 172.21.15.6:0/669345721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04fc154970 con 0x7f04fc06a540 2023-07-21T22:55:26.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.598+0000 7f04f27fc640 1 -- 172.21.15.6:0/669345721 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4670 (secure 0 0 0) 0x7f04f8053df0 con 0x7f04fc06a540 2023-07-21T22:55:26.636 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:26.636 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/2365019581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2365019581},{"type":"v1","addr":"172.21.15.161:6836","nonce":2365019581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8968,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/798924835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":798924835},{"type":"v1","addr":"172.21.15.161:6837","nonce":798924835}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2487387353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2487387353},{"type":"v1","addr":"172.21.15.6:6834","nonce":2487387353}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:39:03.424297+0000","modified":"2023-07-21T22:39:07.057160+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9309},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9309":{"gid":9309,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/2700138945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2700138945},{"type":"v1","addr":"172.21.15.6:6835","nonce":2700138945}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-21T22:55:26.636 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 70 2023-07-21T22:55:26.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.598+0000 7f0503f82640 1 -- 172.21.15.6:0/669345721 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f04e00663a0 msgr2=0x7f04e0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:26.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.598+0000 7f0503f82640 1 --2- 172.21.15.6:0/669345721 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f04e00663a0 0x7f04e0068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f04fc0b5c00 tx=0x7f04ec009040 comp rx=0 tx=0).stop 2023-07-21T22:55:26.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.598+0000 7f0503f82640 1 -- 172.21.15.6:0/669345721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04fc06a540 msgr2=0x7f04fc0cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:26.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.598+0000 7f0503f82640 1 --2- 172.21.15.6:0/669345721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04fc06a540 0x7f04fc0cbe50 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f04f800c420 tx=0x7f04f800c8e0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.598+0000 7f0503f82640 1 -- 172.21.15.6:0/669345721 shutdown_connections 2023-07-21T22:55:26.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.598+0000 7f0503f82640 1 --2- 172.21.15.6:0/669345721 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f04e00663a0 0x7f04e0068850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.598+0000 7f0503f82640 1 --2- 172.21.15.6:0/669345721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04fc15f500 0x7f04fc14d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.598+0000 7f0503f82640 1 --2- 172.21.15.6:0/669345721 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04fc06a9c0 0x7f04fc154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.598+0000 7f0503f82640 1 --2- 172.21.15.6:0/669345721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04fc06a540 0x7f04fc0cbe50 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.598+0000 7f0503f82640 1 -- 172.21.15.6:0/669345721 >> 172.21.15.6:0/669345721 conn(0x7f04fc0659d0 msgr2=0x7f04fc06cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:26.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.598+0000 7f0503f82640 1 -- 172.21.15.6:0/669345721 shutdown_connections 2023-07-21T22:55:26.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.598+0000 7f0503f82640 1 -- 172.21.15.6:0/669345721 wait complete. 2023-07-21T22:55:26.657 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:55:26.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.766+0000 7fef58a9e640 1 Processor -- start 2023-07-21T22:55:26.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.766+0000 7fef58a9e640 1 -- start start 2023-07-21T22:55:26.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.766+0000 7fef58a9e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fef5415f3f0 0x7fef540b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:26.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.766+0000 7fef58a9e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef540d13f0 0x7fef540b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:26.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.766+0000 7fef58a9e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef540d0f60 con 0x7fef540cc9a0 2023-07-21T22:55:26.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.766+0000 7fef58a9e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef540cd4e0 con 0x7fef5415f3f0 2023-07-21T22:55:26.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.766+0000 7fef58a9e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef540d0390 con 0x7fef540d13f0 2023-07-21T22:55:26.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.766+0000 7fef52ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef540d13f0 0x7fef540b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:26.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.766+0000 7fef537fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fef5415f3f0 0x7fef540b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:26.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.766+0000 7fef52ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef540d13f0 0x7fef540b7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:55918/0 (socket says 172.21.15.6:55918) 2023-07-21T22:55:26.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.766+0000 7fef52ffd640 1 -- 172.21.15.6:0/1930358537 learned_addr learned my addr 172.21.15.6:0/1930358537 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:26.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.766+0000 7fef537fe640 1 --2- 172.21.15.6:0/1930358537 >> v2:172.21.15.161:3300/0 conn(0x7fef5415f3f0 0x7fef540b7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:42220/0 (socket says 172.21.15.6:42220) 2023-07-21T22:55:26.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.766+0000 7fef52ffd640 1 -- 172.21.15.6:0/1930358537 >> v2:172.21.15.161:3300/0 conn(0x7fef5415f3f0 msgr2=0x7fef540b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:26.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.766+0000 7fef52ffd640 1 --2- 172.21.15.6:0/1930358537 >> v2:172.21.15.161:3300/0 conn(0x7fef5415f3f0 0x7fef540b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.766+0000 7fef52ffd640 1 -- 172.21.15.6:0/1930358537 >> v1:172.21.15.161:6789/0 conn(0x7fef540cc9a0 legacy=0x7fef540ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:26.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.766+0000 7fef52ffd640 1 -- 172.21.15.6:0/1930358537 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef540d0630 con 0x7fef540d13f0 2023-07-21T22:55:26.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.766+0000 7fef537fe640 1 --2- 172.21.15.6:0/1930358537 >> v2:172.21.15.161:3300/0 conn(0x7fef5415f3f0 0x7fef540b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:55:26.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.770+0000 7fef52ffd640 1 --2- 172.21.15.6:0/1930358537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef540d13f0 0x7fef540b7bc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fef48009870 tx=0x7fef4801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72a0fd58842f42e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:26.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.770+0000 7fef527fc640 1 -- 172.21.15.6:0/1930358537 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef480ac600 con 0x7fef540d13f0 2023-07-21T22:55:26.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.770+0000 7fef527fc640 1 -- 172.21.15.6:0/1930358537 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef480a8050 con 0x7fef540d13f0 2023-07-21T22:55:26.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.770+0000 7fef527fc640 1 -- 172.21.15.6:0/1930358537 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef480ac980 con 0x7fef540d13f0 2023-07-21T22:55:26.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.770+0000 7fef58a9e640 1 -- 172.21.15.6:0/1930358537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef540d13f0 msgr2=0x7fef540b7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:26.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.770+0000 7fef58a9e640 1 --2- 172.21.15.6:0/1930358537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef540d13f0 0x7fef540b7bc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fef48009870 tx=0x7fef4801c4b0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.770+0000 7fef58a9e640 1 -- 172.21.15.6:0/1930358537 shutdown_connections 2023-07-21T22:55:26.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.770+0000 7fef58a9e640 1 --2- 172.21.15.6:0/1930358537 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef540d13f0 0x7fef540b7bc0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.770+0000 7fef58a9e640 1 --2- 172.21.15.6:0/1930358537 >> v2:172.21.15.161:3300/0 conn(0x7fef5415f3f0 0x7fef540b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.770+0000 7fef58a9e640 1 -- 172.21.15.6:0/1930358537 >> 172.21.15.6:0/1930358537 conn(0x7fef54069f50 msgr2=0x7fef5406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:26.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.770+0000 7fef58a9e640 1 -- 172.21.15.6:0/1930358537 shutdown_connections 2023-07-21T22:55:26.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.770+0000 7fef58a9e640 1 -- 172.21.15.6:0/1930358537 wait complete. 2023-07-21T22:55:26.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef58a9e640 1 Processor -- start 2023-07-21T22:55:26.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef58a9e640 1 -- start start 2023-07-21T22:55:26.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef58a9e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef540cc9a0 0x7fef54156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:26.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef58a9e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef540d13f0 0x7fef540c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:26.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef58a9e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef5415f3f0 0x7fef540ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:26.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef58a9e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef541517d0 con 0x7fef540cc9a0 2023-07-21T22:55:26.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef58a9e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef54151f60 con 0x7fef540d13f0 2023-07-21T22:55:26.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef58a9e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef54150b50 con 0x7fef5415f3f0 2023-07-21T22:55:26.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef537fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef540cc9a0 0x7fef54156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:26.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef537fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef540cc9a0 0x7fef54156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35834/0 (socket says 172.21.15.6:35834) 2023-07-21T22:55:26.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef537fe640 1 -- 172.21.15.6:0/3700851901 learned_addr learned my addr 172.21.15.6:0/3700851901 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:26.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef53fff640 1 --2- 172.21.15.6:0/3700851901 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef5415f3f0 0x7fef540ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:26.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef52ffd640 1 --2- 172.21.15.6:0/3700851901 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef540d13f0 0x7fef540c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:26.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef537fe640 1 -- 172.21.15.6:0/3700851901 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef5415f3f0 msgr2=0x7fef540ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:26.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef537fe640 1 --2- 172.21.15.6:0/3700851901 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef5415f3f0 0x7fef540ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef537fe640 1 -- 172.21.15.6:0/3700851901 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef540d13f0 msgr2=0x7fef540c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:26.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef537fe640 1 --2- 172.21.15.6:0/3700851901 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef540d13f0 0x7fef540c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef537fe640 1 -- 172.21.15.6:0/3700851901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef44009420 con 0x7fef540cc9a0 2023-07-21T22:55:26.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef52ffd640 1 --2- 172.21.15.6:0/3700851901 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef540d13f0 0x7fef540c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:26.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef53fff640 1 --2- 172.21.15.6:0/3700851901 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef5415f3f0 0x7fef540ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:26.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef537fe640 1 --2- 172.21.15.6:0/3700851901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef540cc9a0 0x7fef54156cd0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fef4400e980 tx=0x7fef4400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:26.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef3bfff640 1 -- 172.21.15.6:0/3700851901 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4400ca00 con 0x7fef540cc9a0 2023-07-21T22:55:26.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef3bfff640 1 -- 172.21.15.6:0/3700851901 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4400cb60 con 0x7fef540cc9a0 2023-07-21T22:55:26.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef3bfff640 1 -- 172.21.15.6:0/3700851901 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44013470 con 0x7fef540cc9a0 2023-07-21T22:55:26.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef58a9e640 1 -- 172.21.15.6:0/3700851901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef480094d0 con 0x7fef540cc9a0 2023-07-21T22:55:26.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.774+0000 7fef58a9e640 1 -- 172.21.15.6:0/3700851901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef54151110 con 0x7fef540cc9a0 2023-07-21T22:55:26.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.778+0000 7fef58a9e640 1 -- 172.21.15.6:0/3700851901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef540678d0 con 0x7fef540cc9a0 2023-07-21T22:55:26.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.778+0000 7fef3bfff640 1 -- 172.21.15.6:0/3700851901 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fef440135d0 con 0x7fef540cc9a0 2023-07-21T22:55:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.778+0000 7fef3bfff640 1 --2- 172.21.15.6:0/3700851901 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fef400663d0 0x7fef40068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:26.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.778+0000 7fef3bfff640 1 -- 172.21.15.6:0/3700851901 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7194+0+0 (secure 0 0 0) 0x7fef44084620 con 0x7fef540cc9a0 2023-07-21T22:55:26.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.778+0000 7fef52ffd640 1 --2- 172.21.15.6:0/3700851901 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fef400663d0 0x7fef40068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:26.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.778+0000 7fef52ffd640 1 --2- 172.21.15.6:0/3700851901 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fef400663d0 0x7fef40068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fef480ae000 tx=0x7fef48008040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:26.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.782+0000 7fef3bfff640 1 -- 172.21.15.6:0/3700851901 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fef440513f0 con 0x7fef540cc9a0 2023-07-21T22:55:26.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.938+0000 7fef58a9e640 1 -- 172.21.15.6:0/3700851901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef540c8f50 con 0x7fef540cc9a0 2023-07-21T22:55:26.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.942+0000 7fef3bfff640 1 -- 172.21.15.6:0/3700851901 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+19945 (secure 0 0 0) 0x7fef44054a10 con 0x7fef540cc9a0 2023-07-21T22:55:26.978 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:26.979 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":161,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:55:24.107651+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:39:01.548583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-21T22:39:02.416927+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":160,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/3926753011":"2023-07-22T22:55:24.107597+0000","172.21.15.161:6833/835248343":"2023-07-22T22:55:24.107597+0000","172.21.15.161:6832/835248343":"2023-07-22T22:55:24.107597+0000","172.21.15.161:0/3919160506":"2023-07-22T22:55:24.107597+0000","172.21.15.161:0/3220660921":"2023-07-22T22:55:24.107597+0000","172.21.15.161:0/2510820144":"2023-07-22T22:55:24.107597+0000","172.21.15.161:0/3139687337":"2023-07-22T22:55:24.107597+0000","172.21.15.161:0/1641497343":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/1520394641":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/52253068":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/3217579618":"2023-07-22T22:50:20.828371+0000","172.21.15.161:6833/3096900160":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/1245542883":"2023-07-22T22:39:20.660905+0000","172.21.15.161:0/2766778262":"2023-07-22T22:39:20.660905+0000","172.21.15.161:0/3376805209":"2023-07-22T22:55:24.107597+0000","172.21.15.161:0/2288195162":"2023-07-22T22:39:20.660905+0000","172.21.15.161:0/107992510":"2023-07-22T22:50:20.828371+0000","172.21.15.161:6833/2692111396":"2023-07-22T22:39:20.660905+0000","172.21.15.161:6832/3096900160":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/4115864188":"2023-07-22T22:39:20.660905+0000","172.21.15.161:6832/2692111396":"2023-07-22T22:39:20.660905+0000","172.21.15.161:0/2485992449":"2023-07-22T22:50:20.828371+0000","172.21.15.161:0/389976077":"2023-07-22T22:39:20.660905+0000","172.21.15.161:0/1635694091":"2023-07-22T22:39:20.660905+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:55:26.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.942+0000 7fef58a9e640 1 -- 172.21.15.6:0/3700851901 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fef400663d0 msgr2=0x7fef40068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:26.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.942+0000 7fef58a9e640 1 --2- 172.21.15.6:0/3700851901 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fef400663d0 0x7fef40068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fef480ae000 tx=0x7fef48008040 comp rx=0 tx=0).stop 2023-07-21T22:55:26.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.942+0000 7fef58a9e640 1 -- 172.21.15.6:0/3700851901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef540cc9a0 msgr2=0x7fef54156cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:26.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.942+0000 7fef58a9e640 1 --2- 172.21.15.6:0/3700851901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef540cc9a0 0x7fef54156cd0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fef4400e980 tx=0x7fef4400ee40 comp rx=0 tx=0).stop 2023-07-21T22:55:26.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.942+0000 7fef58a9e640 1 -- 172.21.15.6:0/3700851901 shutdown_connections 2023-07-21T22:55:26.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.942+0000 7fef58a9e640 1 --2- 172.21.15.6:0/3700851901 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fef400663d0 0x7fef40068880 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.942+0000 7fef58a9e640 1 --2- 172.21.15.6:0/3700851901 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fef5415f3f0 0x7fef540ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.942+0000 7fef58a9e640 1 --2- 172.21.15.6:0/3700851901 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fef540d13f0 0x7fef540c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.942+0000 7fef58a9e640 1 --2- 172.21.15.6:0/3700851901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef540cc9a0 0x7fef54156cd0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:26.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.942+0000 7fef58a9e640 1 -- 172.21.15.6:0/3700851901 >> 172.21.15.6:0/3700851901 conn(0x7fef54069f50 msgr2=0x7fef540b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:26.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.942+0000 7fef58a9e640 1 -- 172.21.15.6:0/3700851901 shutdown_connections 2023-07-21T22:55:26.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:26.942+0000 7fef58a9e640 1 -- 172.21.15.6:0/3700851901 wait complete. 2023-07-21T22:55:27.002 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-21T22:55:27.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.110+0000 7f20e0634640 1 Processor -- start 2023-07-21T22:55:27.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.110+0000 7f20e0634640 1 -- start start 2023-07-21T22:55:27.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.114+0000 7f20e0634640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f20d8158ce0 0x7f20d8070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:27.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.114+0000 7f20e0634640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d80cc700 con 0x7f20d80c9730 2023-07-21T22:55:27.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.114+0000 7f20e0634640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d80b0ff0 con 0x7f20d80c8ad0 2023-07-21T22:55:27.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.114+0000 7f20e0634640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d8070c80 con 0x7f20d8158ce0 2023-07-21T22:55:27.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.114+0000 7f20de3d0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f20d8158ce0 0x7f20d8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:27.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.114+0000 7f20de3d0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f20d8158ce0 0x7f20d8070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35844/0 (socket says 172.21.15.6:35844) 2023-07-21T22:55:27.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.114+0000 7f20de3d0640 1 -- 172.21.15.6:0/1169685479 learned_addr learned my addr 172.21.15.6:0/1169685479 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:27.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.114+0000 7f20de3d0640 1 -- 172.21.15.6:0/1169685479 >> v1:172.21.15.161:6789/0 conn(0x7f20d80c8ad0 legacy=0x7f20d80c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:27.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.114+0000 7f20de3d0640 1 -- 172.21.15.6:0/1169685479 >> v1:172.21.15.6:6789/0 conn(0x7f20d80c9730 legacy=0x7f20d80ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:27.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.114+0000 7f20de3d0640 1 -- 172.21.15.6:0/1169685479 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d80cbdd0 con 0x7f20d8158ce0 2023-07-21T22:55:27.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.118+0000 7f20de3d0640 1 --2- 172.21.15.6:0/1169685479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d8158ce0 0x7f20d8070450 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f20d400bb10 tx=0x7f20d401ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9de33ddeec96a9c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:27.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.118+0000 7f20dd3ce640 1 -- 172.21.15.6:0/1169685479 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d40a7b50 con 0x7f20d8158ce0 2023-07-21T22:55:27.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.118+0000 7f20dd3ce640 1 -- 172.21.15.6:0/1169685479 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d40a7cb0 con 0x7f20d8158ce0 2023-07-21T22:55:27.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.118+0000 7f20dd3ce640 1 -- 172.21.15.6:0/1169685479 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d40af660 con 0x7f20d8158ce0 2023-07-21T22:55:27.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.118+0000 7f20e0634640 1 -- 172.21.15.6:0/1169685479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d8158ce0 msgr2=0x7f20d8070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:27.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.118+0000 7f20e0634640 1 --2- 172.21.15.6:0/1169685479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d8158ce0 0x7f20d8070450 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f20d400bb10 tx=0x7f20d401ea80 comp rx=0 tx=0).stop 2023-07-21T22:55:27.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.118+0000 7f20e0634640 1 -- 172.21.15.6:0/1169685479 shutdown_connections 2023-07-21T22:55:27.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.118+0000 7f20e0634640 1 --2- 172.21.15.6:0/1169685479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d8158ce0 0x7f20d8070450 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:27.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.118+0000 7f20e0634640 1 -- 172.21.15.6:0/1169685479 >> 172.21.15.6:0/1169685479 conn(0x7f20d80afcf0 msgr2=0x7f20d80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:27.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.118+0000 7f20e0634640 1 -- 172.21.15.6:0/1169685479 shutdown_connections 2023-07-21T22:55:27.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.118+0000 7f20e0634640 1 -- 172.21.15.6:0/1169685479 wait complete. 2023-07-21T22:55:27.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.118+0000 7f20e0634640 1 Processor -- start 2023-07-21T22:55:27.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20e0634640 1 -- start start 2023-07-21T22:55:27.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20e0634640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20d80c8ad0 0x7f20d80b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:27.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20e0634640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d80c9730 0x7f20d81f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:27.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20e0634640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20d8158ce0 0x7f20d80c2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:27.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20e0634640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d815b0a0 con 0x7f20d80c9730 2023-07-21T22:55:27.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20e0634640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d815a490 con 0x7f20d80c8ad0 2023-07-21T22:55:27.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20e0634640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d815a770 con 0x7f20d8158ce0 2023-07-21T22:55:27.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20ddbcf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d80c9730 0x7f20d81f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:27.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20ddbcf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d80c9730 0x7f20d81f4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35858/0 (socket says 172.21.15.6:35858) 2023-07-21T22:55:27.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20ddbcf640 1 -- 172.21.15.6:0/4208704612 learned_addr learned my addr 172.21.15.6:0/4208704612 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:27.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20de3d0640 1 --2- 172.21.15.6:0/4208704612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20d80c8ad0 0x7f20d80b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:27.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20debd1640 1 --2- 172.21.15.6:0/4208704612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20d8158ce0 0x7f20d80c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:27.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20ddbcf640 1 -- 172.21.15.6:0/4208704612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20d8158ce0 msgr2=0x7f20d80c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:27.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20ddbcf640 1 --2- 172.21.15.6:0/4208704612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20d8158ce0 0x7f20d80c2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:27.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20ddbcf640 1 -- 172.21.15.6:0/4208704612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20d80c8ad0 msgr2=0x7f20d80b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:27.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20ddbcf640 1 --2- 172.21.15.6:0/4208704612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20d80c8ad0 0x7f20d80b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:27.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20ddbcf640 1 -- 172.21.15.6:0/4208704612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d400b770 con 0x7f20d80c9730 2023-07-21T22:55:27.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20debd1640 1 --2- 172.21.15.6:0/4208704612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20d8158ce0 0x7f20d80c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:27.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20ddbcf640 1 --2- 172.21.15.6:0/4208704612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d80c9730 0x7f20d81f4670 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c450 tx=0x7f20c800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:27.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20ceffd640 1 -- 172.21.15.6:0/4208704612 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c8012830 con 0x7f20d80c9730 2023-07-21T22:55:27.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20ceffd640 1 -- 172.21.15.6:0/4208704612 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c80129b0 con 0x7f20d80c9730 2023-07-21T22:55:27.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20e0634640 1 -- 172.21.15.6:0/4208704612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d815aa50 con 0x7f20d80c9730 2023-07-21T22:55:27.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20ceffd640 1 -- 172.21.15.6:0/4208704612 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c8012d60 con 0x7f20d80c9730 2023-07-21T22:55:27.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20e0634640 1 -- 172.21.15.6:0/4208704612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d80b23a0 con 0x7f20d80c9730 2023-07-21T22:55:27.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.122+0000 7f20e0634640 1 -- 172.21.15.6:0/4208704612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d815b250 con 0x7f20d80c9730 2023-07-21T22:55:27.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.126+0000 7f20ceffd640 1 -- 172.21.15.6:0/4208704612 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f20c801c460 con 0x7f20d80c9730 2023-07-21T22:55:27.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.126+0000 7f20ceffd640 1 --2- 172.21.15.6:0/4208704612 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f20bc0663a0 0x7f20bc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:27.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.126+0000 7f20ceffd640 1 -- 172.21.15.6:0/4208704612 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 7194+0+0 (secure 0 0 0) 0x7f20c80840e0 con 0x7f20d80c9730 2023-07-21T22:55:27.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.126+0000 7f20de3d0640 1 --2- 172.21.15.6:0/4208704612 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f20bc0663a0 0x7f20bc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:27.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.126+0000 7f20de3d0640 1 --2- 172.21.15.6:0/4208704612 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f20bc0663a0 0x7f20bc068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f20d40b1000 tx=0x7f20d40a9070 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:27.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.130+0000 7f20ceffd640 1 -- 172.21.15.6:0/4208704612 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f20d815b250 con 0x7f20d80c9730 2023-07-21T22:55:27.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.318+0000 7f20e0634640 1 -- 172.21.15.6:0/4208704612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f20d80678d0 con 0x7f20d80c9730 2023-07-21T22:55:27.356 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-07-21T22:55:27.318+0000 7f195e836640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-21T22:55:27.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.326+0000 7f20ceffd640 1 -- 172.21.15.6:0/4208704612 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v71) v1 ==== 161+0+0 (secure 0 0 0) 0x7f20c8050f40 con 0x7f20d80c9730 2023-07-21T22:55:27.363 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-21T22:55:27.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.326+0000 7f20e0634640 1 -- 172.21.15.6:0/4208704612 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f20bc0663a0 msgr2=0x7f20bc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:27.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.326+0000 7f20e0634640 1 --2- 172.21.15.6:0/4208704612 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f20bc0663a0 0x7f20bc068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f20d40b1000 tx=0x7f20d40a9070 comp rx=0 tx=0).stop 2023-07-21T22:55:27.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.326+0000 7f20e0634640 1 -- 172.21.15.6:0/4208704612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d80c9730 msgr2=0x7f20d81f4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:27.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.326+0000 7f20e0634640 1 --2- 172.21.15.6:0/4208704612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d80c9730 0x7f20d81f4670 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c450 tx=0x7f20c800c910 comp rx=0 tx=0).stop 2023-07-21T22:55:27.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.326+0000 7f20e0634640 1 -- 172.21.15.6:0/4208704612 shutdown_connections 2023-07-21T22:55:27.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.326+0000 7f20e0634640 1 --2- 172.21.15.6:0/4208704612 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f20bc0663a0 0x7f20bc068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:27.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.326+0000 7f20e0634640 1 --2- 172.21.15.6:0/4208704612 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f20d8158ce0 0x7f20d80c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:27.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.326+0000 7f20e0634640 1 --2- 172.21.15.6:0/4208704612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20d80c9730 0x7f20d81f4670 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:27.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.326+0000 7f20e0634640 1 --2- 172.21.15.6:0/4208704612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f20d80c8ad0 0x7f20d80b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:27.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.326+0000 7f20e0634640 1 -- 172.21.15.6:0/4208704612 >> 172.21.15.6:0/4208704612 conn(0x7f20d80afcf0 msgr2=0x7f20d8070dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:27.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.326+0000 7f20e0634640 1 -- 172.21.15.6:0/4208704612 shutdown_connections 2023-07-21T22:55:27.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.326+0000 7f20e0634640 1 -- 172.21.15.6:0/4208704612 wait complete. 2023-07-21T22:55:27.393 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-21T22:55:27.438 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-21T22:55:27.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.502+0000 7fde0e5c5640 1 Processor -- start 2023-07-21T22:55:27.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.502+0000 7fde0e5c5640 1 -- start start 2023-07-21T22:55:27.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.502+0000 7fde0e5c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde08159a70 0x7fde080ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:27.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde0e5c5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde080cbe50 con 0x7fde0815e060 2023-07-21T22:55:27.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde0e5c5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde080cd660 con 0x7fde08071030 2023-07-21T22:55:27.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde0e5c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde080cc0a0 con 0x7fde08159a70 2023-07-21T22:55:27.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde077fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fde0815e060 0x7fde08070920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58842/0 (socket says 172.21.15.6:58842) 2023-07-21T22:55:27.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde077fe640 1 -- 172.21.15.6:0/191038089 learned_addr learned my addr 172.21.15.6:0/191038089 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:27.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde07fff640 1 --2- 172.21.15.6:0/191038089 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde08159a70 0x7fde080ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:27.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde06ffd640 1 -- 172.21.15.6:0/191038089 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814703826 0 0) 0x7fde080cbe50 con 0x7fde0815e060 2023-07-21T22:55:27.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde06ffd640 1 -- 172.21.15.6:0/191038089 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf0003530 con 0x7fde0815e060 2023-07-21T22:55:27.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde06ffd640 1 -- 172.21.15.6:0/191038089 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1623237445 0 0) 0x7fde080cd660 con 0x7fde08071030 2023-07-21T22:55:27.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde06ffd640 1 -- 172.21.15.6:0/191038089 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde080cbe50 con 0x7fde08071030 2023-07-21T22:55:27.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde06ffd640 1 -- 172.21.15.6:0/191038089 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1573736127 0 0) 0x7fddf0003530 con 0x7fde0815e060 2023-07-21T22:55:27.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde06ffd640 1 -- 172.21.15.6:0/191038089 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde08159a70 msgr2=0x7fde080ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:27.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde06ffd640 1 --2- 172.21.15.6:0/191038089 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde08159a70 0x7fde080ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:27.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde06ffd640 1 -- 172.21.15.6:0/191038089 >> v1:172.21.15.161:6789/0 conn(0x7fde08071030 legacy=0x7fde080c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:27.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde06ffd640 1 -- 172.21.15.6:0/191038089 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde080cc380 con 0x7fde0815e060 2023-07-21T22:55:27.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde06ffd640 1 -- 172.21.15.6:0/191038089 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fddfc001680 con 0x7fde0815e060 2023-07-21T22:55:27.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde06ffd640 1 -- 172.21.15.6:0/191038089 >> v1:172.21.15.6:6789/0 conn(0x7fde0815e060 legacy=0x7fde08070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:27.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde06ffd640 1 --2- 172.21.15.6:0/191038089 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde08159a70 0x7fddf0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:27.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde06ffd640 1 --2- 172.21.15.6:0/191038089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddf00040a0 0x7fddf00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:27.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde06ffd640 1 --2- 172.21.15.6:0/191038089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddf0004d10 0x7fddf0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:27.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde06ffd640 1 -- 172.21.15.6:0/191038089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde080cc0a0 con 0x7fddf0004d10 2023-07-21T22:55:27.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde06ffd640 1 -- 172.21.15.6:0/191038089 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf000bb80 con 0x7fddf00040a0 2023-07-21T22:55:27.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde06ffd640 1 -- 172.21.15.6:0/191038089 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf000bd40 con 0x7fde08159a70 2023-07-21T22:55:27.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde0cb62640 1 --2- 172.21.15.6:0/191038089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddf0004d10 0x7fddf0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:27.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde07fff640 1 --2- 172.21.15.6:0/191038089 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde08159a70 0x7fddf0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:27.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde077fe640 1 --2- 172.21.15.6:0/191038089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddf00040a0 0x7fddf00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:27.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde0cb62640 1 -- 172.21.15.6:0/191038089 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde08159a70 msgr2=0x7fddf0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:27.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde0cb62640 1 --2- 172.21.15.6:0/191038089 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde08159a70 0x7fddf0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:27.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde0cb62640 1 -- 172.21.15.6:0/191038089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddf00040a0 msgr2=0x7fddf00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:27.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde0cb62640 1 --2- 172.21.15.6:0/191038089 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fddf00040a0 0x7fddf00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:27.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.506+0000 7fde0cb62640 1 -- 172.21.15.6:0/191038089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf0003530 con 0x7fddf0004d10 2023-07-21T22:55:27.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.510+0000 7fde0cb62640 1 --2- 172.21.15.6:0/191038089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddf0004d10 0x7fddf0005180 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fde00007fd0 tx=0x7fde0001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d1aa4760c2d97 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:27.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.510+0000 7fde06ffd640 1 -- 172.21.15.6:0/191038089 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00003b80 con 0x7fddf0004d10 2023-07-21T22:55:27.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.510+0000 7fde06ffd640 1 -- 172.21.15.6:0/191038089 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde00003d00 con 0x7fddf0004d10 2023-07-21T22:55:27.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.510+0000 7fde06ffd640 1 -- 172.21.15.6:0/191038089 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00005310 con 0x7fddf0004d10 2023-07-21T22:55:27.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.510+0000 7fde0e5c5640 1 -- 172.21.15.6:0/191038089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddf0004d10 msgr2=0x7fddf0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:27.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.510+0000 7fde0e5c5640 1 --2- 172.21.15.6:0/191038089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddf0004d10 0x7fddf0005180 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fde00007fd0 tx=0x7fde0001c890 comp rx=0 tx=0).stop 2023-07-21T22:55:27.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.510+0000 7fde0cb62640 1 -- 172.21.15.6:0/191038089 reap_dead start 2023-07-21T22:55:27.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.510+0000 7fde0e5c5640 1 -- 172.21.15.6:0/191038089 shutdown_connections 2023-07-21T22:55:27.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.510+0000 7fde0e5c5640 1 -- 172.21.15.6:0/191038089 >> 172.21.15.6:0/191038089 conn(0x7fde080afac0 msgr2=0x7fde080afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:27.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.510+0000 7fde0e5c5640 1 -- 172.21.15.6:0/191038089 shutdown_connections 2023-07-21T22:55:27.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.510+0000 7fde0e5c5640 1 -- 172.21.15.6:0/191038089 wait complete. 2023-07-21T22:55:27.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.510+0000 7fde0e5c5640 1 Processor -- start 2023-07-21T22:55:27.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.510+0000 7fde0e5c5640 1 -- start start 2023-07-21T22:55:27.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde0e5c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddf0004d10 0x7fde081f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:27.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde0e5c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde081f3580 0x7fde0806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:27.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde0e5c5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde081f39f0 0x7fde0806b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:27.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde0e5c5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde081f5030 con 0x7fddf0004d10 2023-07-21T22:55:27.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde0e5c5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde081f4e70 con 0x7fde081f39f0 2023-07-21T22:55:27.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde0e5c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde081f7460 con 0x7fde081f3580 2023-07-21T22:55:27.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde07fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddf0004d10 0x7fde081f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:27.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde07fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddf0004d10 0x7fde081f4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37536/0 (socket says 172.21.15.6:37536) 2023-07-21T22:55:27.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde07fff640 1 -- 172.21.15.6:0/4273321815 learned_addr learned my addr 172.21.15.6:0/4273321815 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:27.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde0cb62640 1 --2- 172.21.15.6:0/4273321815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde081f39f0 0x7fde0806b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:27.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde077fe640 1 --2- 172.21.15.6:0/4273321815 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde081f3580 0x7fde0806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:27.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde07fff640 1 -- 172.21.15.6:0/4273321815 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde081f3580 msgr2=0x7fde0806b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:27.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde07fff640 1 --2- 172.21.15.6:0/4273321815 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde081f3580 0x7fde0806b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:27.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde07fff640 1 -- 172.21.15.6:0/4273321815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde081f39f0 msgr2=0x7fde0806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:27.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde07fff640 1 --2- 172.21.15.6:0/4273321815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde081f39f0 0x7fde0806b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:27.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde07fff640 1 -- 172.21.15.6:0/4273321815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde081f7740 con 0x7fddf0004d10 2023-07-21T22:55:27.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde07fff640 1 --2- 172.21.15.6:0/4273321815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddf0004d10 0x7fde081f4930 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fddf80119d0 tx=0x7fddf8011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde04ff9640 1 -- 172.21.15.6:0/4273321815 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf800fb50 con 0x7fddf0004d10 2023-07-21T22:55:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde04ff9640 1 -- 172.21.15.6:0/4273321815 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf800fcb0 con 0x7fddf0004d10 2023-07-21T22:55:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde04ff9640 1 -- 172.21.15.6:0/4273321815 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf8014440 con 0x7fddf0004d10 2023-07-21T22:55:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde0e5c5640 1 -- 172.21.15.6:0/4273321815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde081f7a20 con 0x7fddf0004d10 2023-07-21T22:55:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde0e5c5640 1 -- 172.21.15.6:0/4273321815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde081f7fe0 con 0x7fddf0004d10 2023-07-21T22:55:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.514+0000 7fde0e5c5640 1 -- 172.21.15.6:0/4273321815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde080678d0 con 0x7fddf0004d10 2023-07-21T22:55:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.518+0000 7fde04ff9640 1 -- 172.21.15.6:0/4273321815 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fddf80145a0 con 0x7fddf0004d10 2023-07-21T22:55:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.518+0000 7fde04ff9640 1 --2- 172.21.15.6:0/4273321815 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fddf40663d0 0x7fddf4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.518+0000 7fde04ff9640 1 -- 172.21.15.6:0/4273321815 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 7280+0+0 (secure 0 0 0) 0x7fddf8084c40 con 0x7fddf0004d10 2023-07-21T22:55:27.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.518+0000 7fde077fe640 1 --2- 172.21.15.6:0/4273321815 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fddf40663d0 0x7fddf4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:27.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.518+0000 7fde077fe640 1 --2- 172.21.15.6:0/4273321815 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fddf40663d0 0x7fddf4068880 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fde0815a5a0 tx=0x7fddfc009040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:27.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.522+0000 7fde04ff9640 1 -- 172.21.15.6:0/4273321815 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fddf80555c0 con 0x7fddf0004d10 2023-07-21T22:55:27.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:27.710+0000 7fde0e5c5640 1 -- 172.21.15.6:0/4273321815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fde08150030 con 0x7fddf0004d10 2023-07-21T22:55:28.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.330+0000 7fde04ff9640 1 -- 172.21.15.6:0/4273321815 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v72) v1 ==== 104+0+0 (secure 0 0 0) 0x7fddf8055150 con 0x7fddf0004d10 2023-07-21T22:55:28.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.334+0000 7fde0e5c5640 1 -- 172.21.15.6:0/4273321815 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fddf40663d0 msgr2=0x7fddf4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:28.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.334+0000 7fde0e5c5640 1 --2- 172.21.15.6:0/4273321815 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fddf40663d0 0x7fddf4068880 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fde0815a5a0 tx=0x7fddfc009040 comp rx=0 tx=0).stop 2023-07-21T22:55:28.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.334+0000 7fde0e5c5640 1 -- 172.21.15.6:0/4273321815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddf0004d10 msgr2=0x7fde081f4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:28.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.334+0000 7fde0e5c5640 1 --2- 172.21.15.6:0/4273321815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddf0004d10 0x7fde081f4930 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fddf80119d0 tx=0x7fddf8011e90 comp rx=0 tx=0).stop 2023-07-21T22:55:28.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.334+0000 7fde0e5c5640 1 -- 172.21.15.6:0/4273321815 shutdown_connections 2023-07-21T22:55:28.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.334+0000 7fde0e5c5640 1 --2- 172.21.15.6:0/4273321815 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fddf40663d0 0x7fddf4068880 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:28.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.334+0000 7fde0e5c5640 1 --2- 172.21.15.6:0/4273321815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde081f39f0 0x7fde0806b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:28.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.334+0000 7fde0e5c5640 1 --2- 172.21.15.6:0/4273321815 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde081f3580 0x7fde0806b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:28.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.334+0000 7fde0e5c5640 1 --2- 172.21.15.6:0/4273321815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddf0004d10 0x7fde081f4930 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:28.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.334+0000 7fde0e5c5640 1 -- 172.21.15.6:0/4273321815 >> 172.21.15.6:0/4273321815 conn(0x7fde080afac0 msgr2=0x7fde080aeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:28.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.334+0000 7fde0e5c5640 1 -- 172.21.15.6:0/4273321815 shutdown_connections 2023-07-21T22:55:28.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.334+0000 7fde0e5c5640 1 -- 172.21.15.6:0/4273321815 wait complete. 2023-07-21T22:55:28.393 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-21T22:55:28.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.546+0000 7f00868ca640 1 Processor -- start 2023-07-21T22:55:28.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.546+0000 7f00868ca640 1 -- start start 2023-07-21T22:55:28.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.546+0000 7f00868ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f008015bde0 0x7f00800d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:28.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.546+0000 7f00868ca640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f00800d2fc0 0x7f00800b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:28.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.546+0000 7f00868ca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00800b04c0 con 0x7f00800d2300 2023-07-21T22:55:28.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.546+0000 7f00868ca640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f008015c1b0 con 0x7f00800d2fc0 2023-07-21T22:55:28.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.546+0000 7f00868ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00800d0aa0 con 0x7f008015bde0 2023-07-21T22:55:28.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.546+0000 7f0084e67640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f00800d2300 0x7f00800cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58854/0 (socket says 172.21.15.6:58854) 2023-07-21T22:55:28.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.546+0000 7f0084e67640 1 -- 172.21.15.6:0/3858984249 learned_addr learned my addr 172.21.15.6:0/3858984249 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.546+0000 7f007ffff640 1 --2- 172.21.15.6:0/3858984249 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f008015bde0 0x7f00800d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.546+0000 7f0077fff640 1 --2- 172.21.15.6:0/3858984249 >> v2:172.21.15.161:3300/0 conn(0x7f00800d2fc0 0x7f00800b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.546+0000 7f007f7fe640 1 -- 172.21.15.6:0/3858984249 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590544462 0 0) 0x7f00800b04c0 con 0x7f00800d2300 2023-07-21T22:55:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.546+0000 7f007f7fe640 1 -- 172.21.15.6:0/3858984249 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f006c003530 con 0x7f00800d2300 2023-07-21T22:55:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.546+0000 7f007ffff640 1 -- 172.21.15.6:0/3858984249 >> v2:172.21.15.161:3300/0 conn(0x7f00800d2fc0 msgr2=0x7f00800b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.546+0000 7f007ffff640 1 --2- 172.21.15.6:0/3858984249 >> v2:172.21.15.161:3300/0 conn(0x7f00800d2fc0 0x7f00800b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:28.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.546+0000 7f007ffff640 1 -- 172.21.15.6:0/3858984249 >> v1:172.21.15.6:6789/0 conn(0x7f00800d2300 legacy=0x7f00800cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:28.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.546+0000 7f007ffff640 1 -- 172.21.15.6:0/3858984249 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00800afb90 con 0x7f008015bde0 2023-07-21T22:55:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.546+0000 7f0077fff640 1 --2- 172.21.15.6:0/3858984249 >> v2:172.21.15.161:3300/0 conn(0x7f00800d2fc0 0x7f00800b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:55:28.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.550+0000 7f007ffff640 1 --2- 172.21.15.6:0/3858984249 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f008015bde0 0x7f00800d0270 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f00700097a0 tx=0x7f007001c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c512fe91afc56532 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:28.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.550+0000 7f007f7fe640 1 -- 172.21.15.6:0/3858984249 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00700ab660 con 0x7f008015bde0 2023-07-21T22:55:28.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.550+0000 7f007f7fe640 1 -- 172.21.15.6:0/3858984249 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00700ab7c0 con 0x7f008015bde0 2023-07-21T22:55:28.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.550+0000 7f007f7fe640 1 -- 172.21.15.6:0/3858984249 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00700abb50 con 0x7f008015bde0 2023-07-21T22:55:28.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.550+0000 7f00868ca640 1 -- 172.21.15.6:0/3858984249 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f008015bde0 msgr2=0x7f00800d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:28.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.550+0000 7f00868ca640 1 --2- 172.21.15.6:0/3858984249 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f008015bde0 0x7f00800d0270 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f00700097a0 tx=0x7f007001c460 comp rx=0 tx=0).stop 2023-07-21T22:55:28.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.550+0000 7f00868ca640 1 -- 172.21.15.6:0/3858984249 shutdown_connections 2023-07-21T22:55:28.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.550+0000 7f00868ca640 1 --2- 172.21.15.6:0/3858984249 >> v2:172.21.15.161:3300/0 conn(0x7f00800d2fc0 0x7f00800b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:28.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.550+0000 7f00868ca640 1 --2- 172.21.15.6:0/3858984249 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f008015bde0 0x7f00800d0270 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:28.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.550+0000 7f00868ca640 1 -- 172.21.15.6:0/3858984249 >> 172.21.15.6:0/3858984249 conn(0x7f00800659d0 msgr2=0x7f008009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:28.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.550+0000 7f00868ca640 1 -- 172.21.15.6:0/3858984249 shutdown_connections 2023-07-21T22:55:28.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.550+0000 7f00868ca640 1 -- 172.21.15.6:0/3858984249 wait complete. 2023-07-21T22:55:28.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f00868ca640 1 Processor -- start 2023-07-21T22:55:28.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f00868ca640 1 -- start start 2023-07-21T22:55:28.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f00868ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00800d2300 0x7f0080154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:28.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f00868ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00800d2fc0 0x7f0080154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:28.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f00868ca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f008015bde0 0x7f008015e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:28.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f00868ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00800b5be0 con 0x7f00800d2300 2023-07-21T22:55:28.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f00868ca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008015f180 con 0x7f008015bde0 2023-07-21T22:55:28.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f00868ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00800b52b0 con 0x7f00800d2fc0 2023-07-21T22:55:28.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f007ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00800d2300 0x7f0080154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f007ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00800d2300 0x7f0080154a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37550/0 (socket says 172.21.15.6:37550) 2023-07-21T22:55:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f007ffff640 1 -- 172.21.15.6:0/1072764269 learned_addr learned my addr 172.21.15.6:0/1072764269 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f0077fff640 1 --2- 172.21.15.6:0/1072764269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00800d2fc0 0x7f0080154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f0084e67640 1 --2- 172.21.15.6:0/1072764269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f008015bde0 0x7f008015e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f007ffff640 1 -- 172.21.15.6:0/1072764269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00800d2fc0 msgr2=0x7f0080154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f007ffff640 1 --2- 172.21.15.6:0/1072764269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00800d2fc0 0x7f0080154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f007ffff640 1 -- 172.21.15.6:0/1072764269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f008015bde0 msgr2=0x7f008015e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f007ffff640 1 --2- 172.21.15.6:0/1072764269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f008015bde0 0x7f008015e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f007ffff640 1 -- 172.21.15.6:0/1072764269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0068009420 con 0x7f00800d2300 2023-07-21T22:55:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f0077fff640 1 --2- 172.21.15.6:0/1072764269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00800d2fc0 0x7f0080154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f007ffff640 1 --2- 172.21.15.6:0/1072764269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00800d2300 0x7f0080154a50 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f007001ab10 tx=0x7f0070019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f007d7fa640 1 -- 172.21.15.6:0/1072764269 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0070005e70 con 0x7f00800d2300 2023-07-21T22:55:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f007d7fa640 1 -- 172.21.15.6:0/1072764269 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00700ab930 con 0x7f00800d2300 2023-07-21T22:55:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f007d7fa640 1 -- 172.21.15.6:0/1072764269 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00700abd00 con 0x7f00800d2300 2023-07-21T22:55:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f00868ca640 1 -- 172.21.15.6:0/1072764269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00700093b0 con 0x7f00800d2300 2023-07-21T22:55:28.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.554+0000 7f00868ca640 1 -- 172.21.15.6:0/1072764269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00800b5870 con 0x7f00800d2300 2023-07-21T22:55:28.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.558+0000 7f00868ca640 1 -- 172.21.15.6:0/1072764269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00800678d0 con 0x7f00800d2300 2023-07-21T22:55:28.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.558+0000 7f007d7fa640 1 -- 172.21.15.6:0/1072764269 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f00700a9070 con 0x7f00800d2300 2023-07-21T22:55:28.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.558+0000 7f007d7fa640 1 --2- 172.21.15.6:0/1072764269 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f00600663a0 0x7f0060068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:28.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.558+0000 7f007d7fa640 1 -- 172.21.15.6:0/1072764269 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 7280+0+0 (secure 0 0 0) 0x7f007011e650 con 0x7f00800d2300 2023-07-21T22:55:28.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.558+0000 7f0077fff640 1 --2- 172.21.15.6:0/1072764269 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f00600663a0 0x7f0060068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:28.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.558+0000 7f0077fff640 1 --2- 172.21.15.6:0/1072764269 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f00600663a0 0x7f0060068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0080070fe0 tx=0x7f0068008040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:28.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.562+0000 7f007d7fa640 1 -- 172.21.15.6:0/1072764269 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00700eb400 con 0x7f00800d2300 2023-07-21T22:55:28.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:28.722+0000 7f00868ca640 1 -- 172.21.15.6:0/1072764269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f008006b830 con 0x7f00800d2300 2023-07-21T22:55:29.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.334+0000 7f007d7fa640 1 -- 172.21.15.6:0/1072764269 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v164) v1 ==== 181+0+0 (secure 0 0 0) 0x7f00700abe60 con 0x7f00800d2300 2023-07-21T22:55:29.372 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-07-21T22:55:29.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.338+0000 7f00868ca640 1 -- 172.21.15.6:0/1072764269 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f00600663a0 msgr2=0x7f0060068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:29.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.338+0000 7f00868ca640 1 --2- 172.21.15.6:0/1072764269 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f00600663a0 0x7f0060068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0080070fe0 tx=0x7f0068008040 comp rx=0 tx=0).stop 2023-07-21T22:55:29.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.338+0000 7f00868ca640 1 -- 172.21.15.6:0/1072764269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00800d2300 msgr2=0x7f0080154a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:29.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.338+0000 7f00868ca640 1 --2- 172.21.15.6:0/1072764269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00800d2300 0x7f0080154a50 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f007001ab10 tx=0x7f0070019200 comp rx=0 tx=0).stop 2023-07-21T22:55:29.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.338+0000 7f00868ca640 1 -- 172.21.15.6:0/1072764269 shutdown_connections 2023-07-21T22:55:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.338+0000 7f00868ca640 1 --2- 172.21.15.6:0/1072764269 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f00600663a0 0x7f0060068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.338+0000 7f00868ca640 1 --2- 172.21.15.6:0/1072764269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f008015bde0 0x7f008015e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.338+0000 7f00868ca640 1 --2- 172.21.15.6:0/1072764269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f00800d2fc0 0x7f0080154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.338+0000 7f00868ca640 1 --2- 172.21.15.6:0/1072764269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f00800d2300 0x7f0080154a50 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.338+0000 7f00868ca640 1 -- 172.21.15.6:0/1072764269 >> 172.21.15.6:0/1072764269 conn(0x7f00800659d0 msgr2=0x7f00800ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.338+0000 7f00868ca640 1 -- 172.21.15.6:0/1072764269 shutdown_connections 2023-07-21T22:55:29.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.338+0000 7f00868ca640 1 -- 172.21.15.6:0/1072764269 wait complete. 2023-07-21T22:55:29.399 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-21T22:55:29.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.510+0000 7fe119f37640 1 Processor -- start 2023-07-21T22:55:29.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.510+0000 7fe119f37640 1 -- start start 2023-07-21T22:55:29.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.510+0000 7fe119f37640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe114069430 0x7fe1140cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:29.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.510+0000 7fe119f37640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe11406d2d0 0x7fe11406d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:29.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.510+0000 7fe119f37640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1140cb7d0 con 0x7fe114160030 2023-07-21T22:55:29.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.510+0000 7fe119f37640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11406c510 con 0x7fe11406d2d0 2023-07-21T22:55:29.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.510+0000 7fe119f37640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11406c7f0 con 0x7fe114069430 2023-07-21T22:55:29.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.514+0000 7fe113fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe11406d2d0 0x7fe11406d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:29.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.514+0000 7fe113fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe11406d2d0 0x7fe11406d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37566/0 (socket says 172.21.15.6:37566) 2023-07-21T22:55:29.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.514+0000 7fe113fff640 1 -- 172.21.15.6:0/595741132 learned_addr learned my addr 172.21.15.6:0/595741132 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:29.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.514+0000 7fe1137fe640 1 --2- 172.21.15.6:0/595741132 >> v2:172.21.15.161:3300/0 conn(0x7fe114069430 0x7fe1140cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:29.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.514+0000 7fe113fff640 1 -- 172.21.15.6:0/595741132 >> v2:172.21.15.161:3300/0 conn(0x7fe114069430 msgr2=0x7fe1140cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:29.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.514+0000 7fe113fff640 1 --2- 172.21.15.6:0/595741132 >> v2:172.21.15.161:3300/0 conn(0x7fe114069430 0x7fe1140cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:29.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.514+0000 7fe113fff640 1 -- 172.21.15.6:0/595741132 >> v1:172.21.15.161:6789/0 conn(0x7fe114160030 legacy=0x7fe114069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:29.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.514+0000 7fe113fff640 1 -- 172.21.15.6:0/595741132 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11406cad0 con 0x7fe11406d2d0 2023-07-21T22:55:29.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.514+0000 7fe113fff640 1 --2- 172.21.15.6:0/595741132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe11406d2d0 0x7fe11406d6f0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fe11406eee0 tx=0x7fe10c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10731008a2774e7b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:29.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.514+0000 7fe1127fc640 1 -- 172.21.15.6:0/595741132 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c0a5730 con 0x7fe11406d2d0 2023-07-21T22:55:29.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.514+0000 7fe1127fc640 1 -- 172.21.15.6:0/595741132 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c0a5890 con 0x7fe11406d2d0 2023-07-21T22:55:29.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.514+0000 7fe1127fc640 1 -- 172.21.15.6:0/595741132 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c0a5c20 con 0x7fe11406d2d0 2023-07-21T22:55:29.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe119f37640 1 -- 172.21.15.6:0/595741132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe11406d2d0 msgr2=0x7fe11406d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe119f37640 1 --2- 172.21.15.6:0/595741132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe11406d2d0 0x7fe11406d6f0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fe11406eee0 tx=0x7fe10c01c8d0 comp rx=0 tx=0).stop 2023-07-21T22:55:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe119f37640 1 -- 172.21.15.6:0/595741132 shutdown_connections 2023-07-21T22:55:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe119f37640 1 --2- 172.21.15.6:0/595741132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe11406d2d0 0x7fe11406d6f0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe119f37640 1 --2- 172.21.15.6:0/595741132 >> v2:172.21.15.161:3300/0 conn(0x7fe114069430 0x7fe1140cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe119f37640 1 -- 172.21.15.6:0/595741132 >> 172.21.15.6:0/595741132 conn(0x7fe1140b1840 msgr2=0x7fe1140cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe119f37640 1 -- 172.21.15.6:0/595741132 shutdown_connections 2023-07-21T22:55:29.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe119f37640 1 -- 172.21.15.6:0/595741132 wait complete. 2023-07-21T22:55:29.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe119f37640 1 Processor -- start 2023-07-21T22:55:29.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe119f37640 1 -- start start 2023-07-21T22:55:29.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe119f37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe114069430 0x7fe11415e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:29.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe119f37640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe11406d2d0 0x7fe114149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:29.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe119f37640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe114160030 0x7fe1140c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:29.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe119f37640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1140c69c0 con 0x7fe114069430 2023-07-21T22:55:29.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe119f37640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1141f81d0 con 0x7fe114160030 2023-07-21T22:55:29.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe119f37640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1141f84b0 con 0x7fe11406d2d0 2023-07-21T22:55:29.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe1137fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe114069430 0x7fe11415e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:29.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe1137fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe114069430 0x7fe11415e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37578/0 (socket says 172.21.15.6:37578) 2023-07-21T22:55:29.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe1137fe640 1 -- 172.21.15.6:0/3175018449 learned_addr learned my addr 172.21.15.6:0/3175018449 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:29.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe113fff640 1 --2- 172.21.15.6:0/3175018449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe114160030 0x7fe1140c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:29.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe112ffd640 1 --2- 172.21.15.6:0/3175018449 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe11406d2d0 0x7fe114149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:29.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe1137fe640 1 -- 172.21.15.6:0/3175018449 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe11406d2d0 msgr2=0x7fe114149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:29.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe1137fe640 1 --2- 172.21.15.6:0/3175018449 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe11406d2d0 0x7fe114149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:29.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe1137fe640 1 -- 172.21.15.6:0/3175018449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe114160030 msgr2=0x7fe1140c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe1137fe640 1 --2- 172.21.15.6:0/3175018449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe114160030 0x7fe1140c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.518+0000 7fe1137fe640 1 -- 172.21.15.6:0/3175018449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c009b30 con 0x7fe114069430 2023-07-21T22:55:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.522+0000 7fe1137fe640 1 --2- 172.21.15.6:0/3175018449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe114069430 0x7fe11415e730 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fe10400d800 tx=0x7fe10400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.522+0000 7fe0fbfff640 1 -- 172.21.15.6:0/3175018449 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10400b6c0 con 0x7fe114069430 2023-07-21T22:55:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.522+0000 7fe0fbfff640 1 -- 172.21.15.6:0/3175018449 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10400b820 con 0x7fe114069430 2023-07-21T22:55:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.522+0000 7fe0fbfff640 1 -- 172.21.15.6:0/3175018449 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10400bb90 con 0x7fe114069430 2023-07-21T22:55:29.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.522+0000 7fe119f37640 1 -- 172.21.15.6:0/3175018449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1141f8790 con 0x7fe114069430 2023-07-21T22:55:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.522+0000 7fe119f37640 1 -- 172.21.15.6:0/3175018449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11415e350 con 0x7fe114069430 2023-07-21T22:55:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.522+0000 7fe119f37640 1 -- 172.21.15.6:0/3175018449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1140678d0 con 0x7fe114069430 2023-07-21T22:55:29.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.522+0000 7fe0fbfff640 1 -- 172.21.15.6:0/3175018449 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe10400bcf0 con 0x7fe114069430 2023-07-21T22:55:29.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.522+0000 7fe0fbfff640 1 --2- 172.21.15.6:0/3175018449 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fe1000663a0 0x7fe100068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:29.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.526+0000 7fe0fbfff640 1 -- 172.21.15.6:0/3175018449 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6814+0+0 (secure 0 0 0) 0x7fe104084710 con 0x7fe114069430 2023-07-21T22:55:29.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.526+0000 7fe112ffd640 1 --2- 172.21.15.6:0/3175018449 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fe1000663a0 0x7fe100068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:29.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.526+0000 7fe112ffd640 1 --2- 172.21.15.6:0/3175018449 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fe1000663a0 0x7fe100068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe1141502b0 tx=0x7fe108008040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:29.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.530+0000 7fe0fbfff640 1 -- 172.21.15.6:0/3175018449 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe104055180 con 0x7fe114069430 2023-07-21T22:55:29.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:29.682+0000 7fe119f37640 1 -- 172.21.15.6:0/3175018449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe11406e920 con 0x7fe114069430 2023-07-21T22:55:30.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.342+0000 7fe0fbfff640 1 -- 172.21.15.6:0/3175018449 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v165) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe104054d10 con 0x7fe114069430 2023-07-21T22:55:30.382 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-07-21T22:55:30.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.346+0000 7fe119f37640 1 -- 172.21.15.6:0/3175018449 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fe1000663a0 msgr2=0x7fe100068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:30.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.346+0000 7fe119f37640 1 --2- 172.21.15.6:0/3175018449 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fe1000663a0 0x7fe100068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe1141502b0 tx=0x7fe108008040 comp rx=0 tx=0).stop 2023-07-21T22:55:30.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.346+0000 7fe119f37640 1 -- 172.21.15.6:0/3175018449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe114069430 msgr2=0x7fe11415e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:30.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.346+0000 7fe119f37640 1 --2- 172.21.15.6:0/3175018449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe114069430 0x7fe11415e730 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fe10400d800 tx=0x7fe10400dcc0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.346+0000 7fe119f37640 1 -- 172.21.15.6:0/3175018449 shutdown_connections 2023-07-21T22:55:30.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.346+0000 7fe119f37640 1 --2- 172.21.15.6:0/3175018449 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fe1000663a0 0x7fe100068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.346+0000 7fe119f37640 1 --2- 172.21.15.6:0/3175018449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe114160030 0x7fe1140c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.346+0000 7fe119f37640 1 --2- 172.21.15.6:0/3175018449 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe11406d2d0 0x7fe114149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.346+0000 7fe119f37640 1 --2- 172.21.15.6:0/3175018449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe114069430 0x7fe11415e730 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.346+0000 7fe119f37640 1 -- 172.21.15.6:0/3175018449 >> 172.21.15.6:0/3175018449 conn(0x7fe1140b1840 msgr2=0x7fe1140cc350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:30.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.346+0000 7fe119f37640 1 -- 172.21.15.6:0/3175018449 shutdown_connections 2023-07-21T22:55:30.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.346+0000 7fe119f37640 1 -- 172.21.15.6:0/3175018449 wait complete. 2023-07-21T22:55:30.410 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-21T22:55:30.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.526+0000 7f7f13782640 1 Processor -- start 2023-07-21T22:55:30.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.526+0000 7f7f13782640 1 -- start start 2023-07-21T22:55:30.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.526+0000 7f7f13782640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7f0c159a70 0x7f7f0c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:30.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.526+0000 7f7f13782640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7f0c15e060 0x7f7f0c070920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:30.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.526+0000 7f7f13782640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0c0cbe50 con 0x7f7f0c070e60 2023-07-21T22:55:30.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.526+0000 7f7f13782640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0c0cd660 con 0x7f7f0c15e060 2023-07-21T22:55:30.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.526+0000 7f7f13782640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0c0cc0a0 con 0x7f7f0c159a70 2023-07-21T22:55:30.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.526+0000 7f7f10d1d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7f0c15e060 0x7f7f0c070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:30.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.526+0000 7f7f10d1d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7f0c15e060 0x7f7f0c070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37582/0 (socket says 172.21.15.6:37582) 2023-07-21T22:55:30.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.526+0000 7f7f10d1d640 1 -- 172.21.15.6:0/4011038470 learned_addr learned my addr 172.21.15.6:0/4011038470 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:30.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.526+0000 7f7f11d1f640 1 --1- 172.21.15.6:0/4011038470 >> v1:172.21.15.6:6789/0 conn(0x7f7f0c070e60 0x7f7f0c0c85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58864/0 (socket says 172.21.15.6:58864) 2023-07-21T22:55:30.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.526+0000 7f7f1151e640 1 --2- 172.21.15.6:0/4011038470 >> v2:172.21.15.161:3300/0 conn(0x7f7f0c159a70 0x7f7f0c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:30.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.530+0000 7f7f10d1d640 1 -- 172.21.15.6:0/4011038470 >> v2:172.21.15.161:3300/0 conn(0x7f7f0c159a70 msgr2=0x7f7f0c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:30.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.530+0000 7f7f10d1d640 1 --2- 172.21.15.6:0/4011038470 >> v2:172.21.15.161:3300/0 conn(0x7f7f0c159a70 0x7f7f0c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.530+0000 7f7f10d1d640 1 -- 172.21.15.6:0/4011038470 >> v1:172.21.15.6:6789/0 conn(0x7f7f0c070e60 legacy=0x7f7f0c0c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:30.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.530+0000 7f7f10d1d640 1 -- 172.21.15.6:0/4011038470 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c0cc380 con 0x7f7f0c15e060 2023-07-21T22:55:30.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.530+0000 7f7f10d1d640 1 --2- 172.21.15.6:0/4011038470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f0c15e060 0x7f7f0c070920 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c071b50 tx=0x7f7efc01ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1ec321f2bf2e60 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:30.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.530+0000 7f7f03fff640 1 -- 172.21.15.6:0/4011038470 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0ab600 con 0x7f7f0c15e060 2023-07-21T22:55:30.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.530+0000 7f7f03fff640 1 -- 172.21.15.6:0/4011038470 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc0a7050 con 0x7f7f0c15e060 2023-07-21T22:55:30.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.530+0000 7f7f03fff640 1 -- 172.21.15.6:0/4011038470 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0ab980 con 0x7f7f0c15e060 2023-07-21T22:55:30.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.530+0000 7f7f13782640 1 -- 172.21.15.6:0/4011038470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f0c15e060 msgr2=0x7f7f0c070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:30.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.530+0000 7f7f13782640 1 --2- 172.21.15.6:0/4011038470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f0c15e060 0x7f7f0c070920 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c071b50 tx=0x7f7efc01ce10 comp rx=0 tx=0).stop 2023-07-21T22:55:30.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.530+0000 7f7f13782640 1 -- 172.21.15.6:0/4011038470 shutdown_connections 2023-07-21T22:55:30.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.530+0000 7f7f13782640 1 --2- 172.21.15.6:0/4011038470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f0c15e060 0x7f7f0c070920 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.530+0000 7f7f13782640 1 --2- 172.21.15.6:0/4011038470 >> v2:172.21.15.161:3300/0 conn(0x7f7f0c159a70 0x7f7f0c0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.530+0000 7f7f13782640 1 -- 172.21.15.6:0/4011038470 >> 172.21.15.6:0/4011038470 conn(0x7f7f0c0afac0 msgr2=0x7f7f0c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:30.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.530+0000 7f7f13782640 1 -- 172.21.15.6:0/4011038470 shutdown_connections 2023-07-21T22:55:30.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.530+0000 7f7f13782640 1 -- 172.21.15.6:0/4011038470 wait complete. 2023-07-21T22:55:30.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f13782640 1 Processor -- start 2023-07-21T22:55:30.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f13782640 1 -- start start 2023-07-21T22:55:30.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f13782640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f0c070e60 0x7f7f0c145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:30.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f13782640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f0c159a70 0x7f7f0c0afe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:30.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f13782640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0c15e060 0x7f7f0c0b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:30.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f13782640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c153600 con 0x7f7f0c070e60 2023-07-21T22:55:30.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f13782640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c155c30 con 0x7f7f0c15e060 2023-07-21T22:55:30.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f13782640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c157110 con 0x7f7f0c159a70 2023-07-21T22:55:30.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f1151e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f0c070e60 0x7f7f0c145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:30.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f1151e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f0c070e60 0x7f7f0c145a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37598/0 (socket says 172.21.15.6:37598) 2023-07-21T22:55:30.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f1151e640 1 -- 172.21.15.6:0/3917709029 learned_addr learned my addr 172.21.15.6:0/3917709029 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:30.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f10d1d640 1 --2- 172.21.15.6:0/3917709029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f0c159a70 0x7f7f0c0afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:30.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f11d1f640 1 --2- 172.21.15.6:0/3917709029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0c15e060 0x7f7f0c0b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:30.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f1151e640 1 -- 172.21.15.6:0/3917709029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f0c159a70 msgr2=0x7f7f0c0afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:30.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f1151e640 1 --2- 172.21.15.6:0/3917709029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f0c159a70 0x7f7f0c0afe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f1151e640 1 -- 172.21.15.6:0/3917709029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0c15e060 msgr2=0x7f7f0c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:30.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f1151e640 1 --2- 172.21.15.6:0/3917709029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0c15e060 0x7f7f0c0b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f1151e640 1 -- 172.21.15.6:0/3917709029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc0094d0 con 0x7f7f0c070e60 2023-07-21T22:55:30.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f11d1f640 1 --2- 172.21.15.6:0/3917709029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0c15e060 0x7f7f0c0b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:30.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f1151e640 1 --2- 172.21.15.6:0/3917709029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f0c070e60 0x7f7f0c145a80 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f7f0800d800 tx=0x7f7f0800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:30.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f01ffb640 1 -- 172.21.15.6:0/3917709029 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0800b6c0 con 0x7f7f0c070e60 2023-07-21T22:55:30.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f01ffb640 1 -- 172.21.15.6:0/3917709029 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0800b820 con 0x7f7f0c070e60 2023-07-21T22:55:30.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f01ffb640 1 -- 172.21.15.6:0/3917709029 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0800bb90 con 0x7f7f0c070e60 2023-07-21T22:55:30.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.534+0000 7f7f13782640 1 -- 172.21.15.6:0/3917709029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0c1573f0 con 0x7f7f0c070e60 2023-07-21T22:55:30.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.538+0000 7f7f13782640 1 -- 172.21.15.6:0/3917709029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c1579b0 con 0x7f7f0c070e60 2023-07-21T22:55:30.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.538+0000 7f7f13782640 1 -- 172.21.15.6:0/3917709029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0c0678d0 con 0x7f7f0c070e60 2023-07-21T22:55:30.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.538+0000 7f7f01ffb640 1 -- 172.21.15.6:0/3917709029 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7f0800bcf0 con 0x7f7f0c070e60 2023-07-21T22:55:30.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.538+0000 7f7f01ffb640 1 --2- 172.21.15.6:0/3917709029 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f7ef00663a0 0x7f7ef0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:30.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.538+0000 7f7f01ffb640 1 -- 172.21.15.6:0/3917709029 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6400+0+0 (secure 0 0 0) 0x7f7f080844c0 con 0x7f7f0c070e60 2023-07-21T22:55:30.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.538+0000 7f7f10d1d640 1 --2- 172.21.15.6:0/3917709029 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f7ef00663a0 0x7f7ef0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:30.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.542+0000 7f7f10d1d640 1 --2- 172.21.15.6:0/3917709029 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f7ef00663a0 0x7f7ef0068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0ad000 tx=0x7f7efc008040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:30.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.542+0000 7f7f01ffb640 1 -- 172.21.15.6:0/3917709029 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f08055180 con 0x7f7f0c070e60 2023-07-21T22:55:30.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.698+0000 7f7f13782640 1 -- 172.21.15.6:0/3917709029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f7f0c06a440 con 0x7f7f0c070e60 2023-07-21T22:55:30.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.702+0000 7f7f01ffb640 1 -- 172.21.15.6:0/3917709029 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v55) v1 ==== 115+0+0 (secure 0 0 0) 0x7f7f08054d10 con 0x7f7f0c070e60 2023-07-21T22:55:30.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.706+0000 7f7f13782640 1 -- 172.21.15.6:0/3917709029 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f7ef00663a0 msgr2=0x7f7ef0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:30.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.706+0000 7f7f13782640 1 --2- 172.21.15.6:0/3917709029 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f7ef00663a0 0x7f7ef0068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0ad000 tx=0x7f7efc008040 comp rx=0 tx=0).stop 2023-07-21T22:55:30.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.706+0000 7f7f13782640 1 -- 172.21.15.6:0/3917709029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f0c070e60 msgr2=0x7f7f0c145a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:30.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.706+0000 7f7f13782640 1 --2- 172.21.15.6:0/3917709029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f0c070e60 0x7f7f0c145a80 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f7f0800d800 tx=0x7f7f0800dcc0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.706+0000 7f7f13782640 1 -- 172.21.15.6:0/3917709029 shutdown_connections 2023-07-21T22:55:30.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.706+0000 7f7f13782640 1 --2- 172.21.15.6:0/3917709029 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f7ef00663a0 0x7f7ef0068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.706+0000 7f7f13782640 1 --2- 172.21.15.6:0/3917709029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f0c15e060 0x7f7f0c0b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.706+0000 7f7f13782640 1 --2- 172.21.15.6:0/3917709029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7f0c159a70 0x7f7f0c0afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.706+0000 7f7f13782640 1 --2- 172.21.15.6:0/3917709029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f0c070e60 0x7f7f0c145a80 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.706+0000 7f7f13782640 1 -- 172.21.15.6:0/3917709029 >> 172.21.15.6:0/3917709029 conn(0x7f7f0c0afac0 msgr2=0x7f7f0c0c8510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:30.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.706+0000 7f7f13782640 1 -- 172.21.15.6:0/3917709029 shutdown_connections 2023-07-21T22:55:30.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.706+0000 7f7f13782640 1 -- 172.21.15.6:0/3917709029 wait complete. 2023-07-21T22:55:30.764 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-21T22:55:30.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.882+0000 7fc46b096640 1 Processor -- start 2023-07-21T22:55:30.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.882+0000 7fc46b096640 1 -- start start 2023-07-21T22:55:30.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.882+0000 7fc46b096640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc4640aea90 0x7fc4640d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:30.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.882+0000 7fc46b096640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4640b0470 0x7fc4640cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:30.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.882+0000 7fc46b096640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4640b17d0 con 0x7fc4640ce210 2023-07-21T22:55:30.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.882+0000 7fc46b096640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4640aee60 con 0x7fc4640aea90 2023-07-21T22:55:30.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.882+0000 7fc46b096640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640ce690 con 0x7fc4640b0470 2023-07-21T22:55:30.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.882+0000 7fc468e32640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc4640aea90 0x7fc4640d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:30.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.882+0000 7fc468e32640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc4640aea90 0x7fc4640d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37614/0 (socket says 172.21.15.6:37614) 2023-07-21T22:55:30.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.882+0000 7fc468e32640 1 -- 172.21.15.6:0/2652157997 learned_addr learned my addr 172.21.15.6:0/2652157997 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.882+0000 7fc463fff640 1 --2- 172.21.15.6:0/2652157997 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4640b0470 0x7fc4640cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.882+0000 7fc468e32640 1 -- 172.21.15.6:0/2652157997 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4640b0470 msgr2=0x7fc4640cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.882+0000 7fc468e32640 1 --2- 172.21.15.6:0/2652157997 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4640b0470 0x7fc4640cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.882+0000 7fc468e32640 1 -- 172.21.15.6:0/2652157997 >> v1:172.21.15.161:6789/0 conn(0x7fc4640ce210 legacy=0x7fc464142be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.882+0000 7fc468e32640 1 -- 172.21.15.6:0/2652157997 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4640b0bc0 con 0x7fc4640aea90 2023-07-21T22:55:30.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.886+0000 7fc468e32640 1 --2- 172.21.15.6:0/2652157997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4640aea90 0x7fc4640d0610 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fc458006fd0 tx=0x7fc45801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83733c9b775569d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.886+0000 7fc4637fe640 1 -- 172.21.15.6:0/2652157997 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4580aa650 con 0x7fc4640aea90 2023-07-21T22:55:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.886+0000 7fc4637fe640 1 -- 172.21.15.6:0/2652157997 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4580aa7b0 con 0x7fc4640aea90 2023-07-21T22:55:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.886+0000 7fc4637fe640 1 -- 172.21.15.6:0/2652157997 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4580aab40 con 0x7fc4640aea90 2023-07-21T22:55:30.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.886+0000 7fc46b096640 1 -- 172.21.15.6:0/2652157997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4640aea90 msgr2=0x7fc4640d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:30.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.886+0000 7fc46b096640 1 --2- 172.21.15.6:0/2652157997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4640aea90 0x7fc4640d0610 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fc458006fd0 tx=0x7fc45801c4f0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.886+0000 7fc46b096640 1 -- 172.21.15.6:0/2652157997 shutdown_connections 2023-07-21T22:55:30.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.886+0000 7fc46b096640 1 --2- 172.21.15.6:0/2652157997 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4640b0470 0x7fc4640cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.886+0000 7fc46b096640 1 --2- 172.21.15.6:0/2652157997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4640aea90 0x7fc4640d0610 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.886+0000 7fc46b096640 1 -- 172.21.15.6:0/2652157997 >> 172.21.15.6:0/2652157997 conn(0x7fc464099490 msgr2=0x7fc464089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:30.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.886+0000 7fc46b096640 1 -- 172.21.15.6:0/2652157997 shutdown_connections 2023-07-21T22:55:30.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.886+0000 7fc46b096640 1 -- 172.21.15.6:0/2652157997 wait complete. 2023-07-21T22:55:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc46b096640 1 Processor -- start 2023-07-21T22:55:30.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc46b096640 1 -- start start 2023-07-21T22:55:30.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc46b096640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4640aea90 0x7fc464150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:30.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc46b096640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4640b0470 0x7fc46409b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:30.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc46b096640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4640ce210 0x7fc46409b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:30.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc46b096640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc464159510 con 0x7fc4640ce210 2023-07-21T22:55:30.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc46b096640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46409a8b0 con 0x7fc4640aea90 2023-07-21T22:55:30.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc46b096640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4640c5930 con 0x7fc4640b0470 2023-07-21T22:55:30.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc469633640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4640ce210 0x7fc46409b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:30.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc469633640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4640ce210 0x7fc46409b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37624/0 (socket says 172.21.15.6:37624) 2023-07-21T22:55:30.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc469633640 1 -- 172.21.15.6:0/1697535121 learned_addr learned my addr 172.21.15.6:0/1697535121 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:30.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc468e32640 1 --2- 172.21.15.6:0/1697535121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4640aea90 0x7fc464150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:30.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc463fff640 1 --2- 172.21.15.6:0/1697535121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4640b0470 0x7fc46409b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:30.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc469633640 1 -- 172.21.15.6:0/1697535121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4640b0470 msgr2=0x7fc46409b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:30.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc469633640 1 --2- 172.21.15.6:0/1697535121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4640b0470 0x7fc46409b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc469633640 1 -- 172.21.15.6:0/1697535121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4640aea90 msgr2=0x7fc464150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:30.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc469633640 1 --2- 172.21.15.6:0/1697535121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4640aea90 0x7fc464150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:30.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc469633640 1 -- 172.21.15.6:0/1697535121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc458009480 con 0x7fc4640ce210 2023-07-21T22:55:30.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc468e32640 1 --2- 172.21.15.6:0/1697535121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4640aea90 0x7fc464150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:55:30.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc469633640 1 --2- 172.21.15.6:0/1697535121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4640ce210 0x7fc46409b5b0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fc45c00c730 tx=0x7fc45c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:30.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc4617fa640 1 -- 172.21.15.6:0/1697535121 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c003b80 con 0x7fc4640ce210 2023-07-21T22:55:30.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc4617fa640 1 -- 172.21.15.6:0/1697535121 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45c003ce0 con 0x7fc4640ce210 2023-07-21T22:55:30.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc4617fa640 1 -- 172.21.15.6:0/1697535121 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c00aa30 con 0x7fc4640ce210 2023-07-21T22:55:30.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc46b096640 1 -- 172.21.15.6:0/1697535121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4640c5c10 con 0x7fc4640ce210 2023-07-21T22:55:30.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.890+0000 7fc46b096640 1 -- 172.21.15.6:0/1697535121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4640c5ef0 con 0x7fc4640ce210 2023-07-21T22:55:30.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.894+0000 7fc46b096640 1 -- 172.21.15.6:0/1697535121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc46409ad90 con 0x7fc4640ce210 2023-07-21T22:55:30.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.894+0000 7fc4617fa640 1 -- 172.21.15.6:0/1697535121 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc45c00ab90 con 0x7fc4640ce210 2023-07-21T22:55:30.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.894+0000 7fc4617fa640 1 --2- 172.21.15.6:0/1697535121 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fc4480663a0 0x7fc448068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:30.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.894+0000 7fc4617fa640 1 -- 172.21.15.6:0/1697535121 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6400+0+0 (secure 0 0 0) 0x7fc45c083c50 con 0x7fc4640ce210 2023-07-21T22:55:30.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.894+0000 7fc468e32640 1 --2- 172.21.15.6:0/1697535121 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fc4480663a0 0x7fc448068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:30.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.894+0000 7fc468e32640 1 --2- 172.21.15.6:0/1697535121 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fc4480663a0 0x7fc448068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc4580ae000 tx=0x7fc4580b5040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:30.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:30.898+0000 7fc4617fa640 1 -- 172.21.15.6:0/1697535121 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc46409ad90 con 0x7fc4640ce210 2023-07-21T22:55:31.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.062+0000 7fc46b096640 1 -- 172.21.15.6:0/1697535121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fc46409ad90 con 0x7fc4640ce210 2023-07-21T22:55:31.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.066+0000 7fc4617fa640 1 -- 172.21.15.6:0/1697535121 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v56) v1 ==== 120+0+0 (secure 0 0 0) 0x7fc46409ad90 con 0x7fc4640ce210 2023-07-21T22:55:31.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.070+0000 7fc46b096640 1 -- 172.21.15.6:0/1697535121 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fc4480663a0 msgr2=0x7fc448068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.070+0000 7fc46b096640 1 --2- 172.21.15.6:0/1697535121 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fc4480663a0 0x7fc448068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc4580ae000 tx=0x7fc4580b5040 comp rx=0 tx=0).stop 2023-07-21T22:55:31.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.070+0000 7fc46b096640 1 -- 172.21.15.6:0/1697535121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4640ce210 msgr2=0x7fc46409b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.070+0000 7fc46b096640 1 --2- 172.21.15.6:0/1697535121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4640ce210 0x7fc46409b5b0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fc45c00c730 tx=0x7fc45c00cbf0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.070+0000 7fc46b096640 1 -- 172.21.15.6:0/1697535121 shutdown_connections 2023-07-21T22:55:31.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.070+0000 7fc46b096640 1 --2- 172.21.15.6:0/1697535121 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fc4480663a0 0x7fc448068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.070+0000 7fc46b096640 1 --2- 172.21.15.6:0/1697535121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4640ce210 0x7fc46409b5b0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.070+0000 7fc46b096640 1 --2- 172.21.15.6:0/1697535121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4640b0470 0x7fc46409b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.070+0000 7fc46b096640 1 --2- 172.21.15.6:0/1697535121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4640aea90 0x7fc464150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.070+0000 7fc46b096640 1 -- 172.21.15.6:0/1697535121 >> 172.21.15.6:0/1697535121 conn(0x7fc464099490 msgr2=0x7fc4640b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.070+0000 7fc46b096640 1 -- 172.21.15.6:0/1697535121 shutdown_connections 2023-07-21T22:55:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.070+0000 7fc46b096640 1 -- 172.21.15.6:0/1697535121 wait complete. 2023-07-21T22:55:31.127 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-21T22:55:31.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.238+0000 7f4d6d8ca640 1 Processor -- start 2023-07-21T22:55:31.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.238+0000 7f4d6d8ca640 1 -- start start 2023-07-21T22:55:31.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.238+0000 7f4d6d8ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d6815bc40 0x7f4d68071630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.238+0000 7f4d6d8ca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d6815c720 0x7f4d680caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.238+0000 7f4d6d8ca640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d680abf90 con 0x7f4d680aba90 2023-07-21T22:55:31.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.238+0000 7f4d6d8ca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d680cf2f0 con 0x7f4d6815c720 2023-07-21T22:55:31.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.238+0000 7f4d6d8ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680ac270 con 0x7f4d6815bc40 2023-07-21T22:55:31.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.238+0000 7f4d677fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d6815c720 0x7f4d680caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.238+0000 7f4d677fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4d6815c720 0x7f4d680caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37638/0 (socket says 172.21.15.6:37638) 2023-07-21T22:55:31.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.238+0000 7f4d677fe640 1 -- 172.21.15.6:0/1588098520 learned_addr learned my addr 172.21.15.6:0/1588098520 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:31.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.238+0000 7f4d66ffd640 1 --2- 172.21.15.6:0/1588098520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d6815bc40 0x7f4d68071630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.238+0000 7f4d677fe640 1 -- 172.21.15.6:0/1588098520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d6815bc40 msgr2=0x7f4d68071630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:31.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.238+0000 7f4d677fe640 1 --2- 172.21.15.6:0/1588098520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d6815bc40 0x7f4d68071630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.238+0000 7f4d677fe640 1 -- 172.21.15.6:0/1588098520 >> v1:172.21.15.161:6789/0 conn(0x7f4d680aba90 legacy=0x7f4d6815c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.238+0000 7f4d677fe640 1 -- 172.21.15.6:0/1588098520 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d680ac550 con 0x7f4d6815c720 2023-07-21T22:55:31.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.242+0000 7f4d677fe640 1 --2- 172.21.15.6:0/1588098520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d6815c720 0x7f4d680caa40 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009e50 tx=0x7f4d6001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08270d1257347d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:31.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.242+0000 7f4d667fc640 1 -- 172.21.15.6:0/1588098520 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d600a5810 con 0x7f4d6815c720 2023-07-21T22:55:31.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.242+0000 7f4d667fc640 1 -- 172.21.15.6:0/1588098520 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d600a5970 con 0x7f4d6815c720 2023-07-21T22:55:31.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.242+0000 7f4d667fc640 1 -- 172.21.15.6:0/1588098520 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d600a5d00 con 0x7f4d6815c720 2023-07-21T22:55:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.242+0000 7f4d6d8ca640 1 -- 172.21.15.6:0/1588098520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d6815c720 msgr2=0x7f4d680caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.242+0000 7f4d6d8ca640 1 --2- 172.21.15.6:0/1588098520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d6815c720 0x7f4d680caa40 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009e50 tx=0x7f4d6001c950 comp rx=0 tx=0).stop 2023-07-21T22:55:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.242+0000 7f4d6d8ca640 1 -- 172.21.15.6:0/1588098520 shutdown_connections 2023-07-21T22:55:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.242+0000 7f4d6d8ca640 1 --2- 172.21.15.6:0/1588098520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d6815c720 0x7f4d680caa40 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.242+0000 7f4d6d8ca640 1 --2- 172.21.15.6:0/1588098520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d6815bc40 0x7f4d68071630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.242+0000 7f4d6d8ca640 1 -- 172.21.15.6:0/1588098520 >> 172.21.15.6:0/1588098520 conn(0x7f4d68070b20 msgr2=0x7f4d68070f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.242+0000 7f4d6d8ca640 1 -- 172.21.15.6:0/1588098520 shutdown_connections 2023-07-21T22:55:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.242+0000 7f4d6d8ca640 1 -- 172.21.15.6:0/1588098520 wait complete. 2023-07-21T22:55:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d6d8ca640 1 Processor -- start 2023-07-21T22:55:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d6d8ca640 1 -- start start 2023-07-21T22:55:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d6d8ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d680aba90 0x7f4d68153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d6d8ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d6815bc40 0x7f4d680b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d6d8ca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d6815c720 0x7f4d680b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d6d8ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680b2560 con 0x7f4d680aba90 2023-07-21T22:55:31.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d6d8ca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680b34e0 con 0x7f4d6815c720 2023-07-21T22:55:31.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d6d8ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680b37c0 con 0x7f4d6815bc40 2023-07-21T22:55:31.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d66ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d680aba90 0x7f4d68153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d66ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d680aba90 0x7f4d68153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37640/0 (socket says 172.21.15.6:37640) 2023-07-21T22:55:31.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d66ffd640 1 -- 172.21.15.6:0/1457119587 learned_addr learned my addr 172.21.15.6:0/1457119587 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d5ffff640 1 --2- 172.21.15.6:0/1457119587 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d6815bc40 0x7f4d680b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d677fe640 1 --2- 172.21.15.6:0/1457119587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d6815c720 0x7f4d680b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d66ffd640 1 -- 172.21.15.6:0/1457119587 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d6815bc40 msgr2=0x7f4d680b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d66ffd640 1 --2- 172.21.15.6:0/1457119587 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d6815bc40 0x7f4d680b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d66ffd640 1 -- 172.21.15.6:0/1457119587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d6815c720 msgr2=0x7f4d680b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d66ffd640 1 --2- 172.21.15.6:0/1457119587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d6815c720 0x7f4d680b1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d66ffd640 1 -- 172.21.15.6:0/1457119587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d60009b30 con 0x7f4d680aba90 2023-07-21T22:55:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d5ffff640 1 --2- 172.21.15.6:0/1457119587 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d6815bc40 0x7f4d680b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d66ffd640 1 --2- 172.21.15.6:0/1457119587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d680aba90 0x7f4d68153940 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800e9b0 tx=0x7f4d5800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d64ff9640 1 -- 172.21.15.6:0/1457119587 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58009670 con 0x7f4d680aba90 2023-07-21T22:55:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d64ff9640 1 -- 172.21.15.6:0/1457119587 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5800c9a0 con 0x7f4d680aba90 2023-07-21T22:55:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d64ff9640 1 -- 172.21.15.6:0/1457119587 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5800cd10 con 0x7f4d680aba90 2023-07-21T22:55:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d6d8ca640 1 -- 172.21.15.6:0/1457119587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d680b3aa0 con 0x7f4d680aba90 2023-07-21T22:55:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d6d8ca640 1 -- 172.21.15.6:0/1457119587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d680b3d80 con 0x7f4d680aba90 2023-07-21T22:55:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.246+0000 7f4d6d8ca640 1 -- 172.21.15.6:0/1457119587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6815ce40 con 0x7f4d680aba90 2023-07-21T22:55:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.250+0000 7f4d64ff9640 1 -- 172.21.15.6:0/1457119587 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4d58013470 con 0x7f4d680aba90 2023-07-21T22:55:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.250+0000 7f4d64ff9640 1 --2- 172.21.15.6:0/1457119587 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f4d480663a0 0x7f4d48068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.250+0000 7f4d64ff9640 1 -- 172.21.15.6:0/1457119587 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6400+0+0 (secure 0 0 0) 0x7f4d58084560 con 0x7f4d680aba90 2023-07-21T22:55:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.250+0000 7f4d5ffff640 1 --2- 172.21.15.6:0/1457119587 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f4d480663a0 0x7f4d48068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.250+0000 7f4d5ffff640 1 --2- 172.21.15.6:0/1457119587 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f4d480663a0 0x7f4d48068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4d681676b0 tx=0x7f4d50009040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:31.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.254+0000 7f4d64ff9640 1 -- 172.21.15.6:0/1457119587 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4d58051840 con 0x7f4d680aba90 2023-07-21T22:55:31.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.410+0000 7f4d6d8ca640 1 -- 172.21.15.6:0/1457119587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4d680678d0 con 0x7f4d680aba90 2023-07-21T22:55:31.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.418+0000 7f4d64ff9640 1 -- 172.21.15.6:0/1457119587 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v57) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4d58054e60 con 0x7f4d680aba90 2023-07-21T22:55:31.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.418+0000 7f4d6d8ca640 1 -- 172.21.15.6:0/1457119587 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f4d480663a0 msgr2=0x7f4d48068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.418+0000 7f4d6d8ca640 1 --2- 172.21.15.6:0/1457119587 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f4d480663a0 0x7f4d48068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4d681676b0 tx=0x7f4d50009040 comp rx=0 tx=0).stop 2023-07-21T22:55:31.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.418+0000 7f4d6d8ca640 1 -- 172.21.15.6:0/1457119587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d680aba90 msgr2=0x7f4d68153940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.418+0000 7f4d6d8ca640 1 --2- 172.21.15.6:0/1457119587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d680aba90 0x7f4d68153940 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800e9b0 tx=0x7f4d5800ee70 comp rx=0 tx=0).stop 2023-07-21T22:55:31.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.418+0000 7f4d6d8ca640 1 -- 172.21.15.6:0/1457119587 shutdown_connections 2023-07-21T22:55:31.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.418+0000 7f4d6d8ca640 1 --2- 172.21.15.6:0/1457119587 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f4d480663a0 0x7f4d48068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.418+0000 7f4d6d8ca640 1 --2- 172.21.15.6:0/1457119587 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d6815c720 0x7f4d680b1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.418+0000 7f4d6d8ca640 1 --2- 172.21.15.6:0/1457119587 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4d6815bc40 0x7f4d680b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.418+0000 7f4d6d8ca640 1 --2- 172.21.15.6:0/1457119587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d680aba90 0x7f4d68153940 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.418+0000 7f4d6d8ca640 1 -- 172.21.15.6:0/1457119587 >> 172.21.15.6:0/1457119587 conn(0x7f4d68070b20 msgr2=0x7f4d68156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:31.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.418+0000 7f4d6d8ca640 1 -- 172.21.15.6:0/1457119587 shutdown_connections 2023-07-21T22:55:31.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.418+0000 7f4d6d8ca640 1 -- 172.21.15.6:0/1457119587 wait complete. 2023-07-21T22:55:31.475 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-07-21T22:55:31.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.582+0000 7fcbd186d640 1 Processor -- start 2023-07-21T22:55:31.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.582+0000 7fcbd186d640 1 -- start start 2023-07-21T22:55:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.586+0000 7fcbd186d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcbcc0cdc80 0x7fcbcc0ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.586+0000 7fcbd186d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbcc0ad0d0 0x7fcbcc0ad550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.586+0000 7fcbd186d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbcc0ce5f0 con 0x7fcbcc15d0c0 2023-07-21T22:55:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.586+0000 7fcbd186d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbcc06d940 con 0x7fcbcc0cdc80 2023-07-21T22:55:31.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.586+0000 7fcbd186d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc06dc20 con 0x7fcbcc0ad0d0 2023-07-21T22:55:31.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.586+0000 7fcbc3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcbcc0cdc80 0x7fcbcc0ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.586+0000 7fcbcaffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcbcc15d0c0 0x7fcbcc06cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58880/0 (socket says 172.21.15.6:58880) 2023-07-21T22:55:31.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.586+0000 7fcbcaffd640 1 -- 172.21.15.6:0/801160961 learned_addr learned my addr 172.21.15.6:0/801160961 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:31.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.586+0000 7fcbcb7fe640 1 --2- 172.21.15.6:0/801160961 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbcc0ad0d0 0x7fcbcc0ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.586+0000 7fcbc3fff640 1 -- 172.21.15.6:0/801160961 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbcc0ad0d0 msgr2=0x7fcbcc0ad550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:31.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.586+0000 7fcbc3fff640 1 --2- 172.21.15.6:0/801160961 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbcc0ad0d0 0x7fcbcc0ad550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.586+0000 7fcbc3fff640 1 -- 172.21.15.6:0/801160961 >> v1:172.21.15.6:6789/0 conn(0x7fcbcc15d0c0 legacy=0x7fcbcc06cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.586+0000 7fcbc3fff640 1 -- 172.21.15.6:0/801160961 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbcc06df00 con 0x7fcbcc0cdc80 2023-07-21T22:55:31.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.586+0000 7fcbca7fc640 1 -- 172.21.15.6:0/801160961 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307858757 0 0) 0x7fcbcc0ce5f0 con 0x7fcbcc15d0c0 2023-07-21T22:55:31.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.590+0000 7fcbc3fff640 1 --2- 172.21.15.6:0/801160961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbcc0cdc80 0x7fcbcc0ce0b0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40097c0 tx=0x7fcbb401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e34ab8fef061153 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:31.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.590+0000 7fcbca7fc640 1 -- 172.21.15.6:0/801160961 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb40ab600 con 0x7fcbcc0cdc80 2023-07-21T22:55:31.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.590+0000 7fcbca7fc640 1 -- 172.21.15.6:0/801160961 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb40a7050 con 0x7fcbcc0cdc80 2023-07-21T22:55:31.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.590+0000 7fcbca7fc640 1 -- 172.21.15.6:0/801160961 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb40ab980 con 0x7fcbcc0cdc80 2023-07-21T22:55:31.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.590+0000 7fcbd186d640 1 -- 172.21.15.6:0/801160961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbcc0cdc80 msgr2=0x7fcbcc0ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.590+0000 7fcbd186d640 1 --2- 172.21.15.6:0/801160961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbcc0cdc80 0x7fcbcc0ce0b0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40097c0 tx=0x7fcbb401c480 comp rx=0 tx=0).stop 2023-07-21T22:55:31.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.590+0000 7fcbd186d640 1 -- 172.21.15.6:0/801160961 shutdown_connections 2023-07-21T22:55:31.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.590+0000 7fcbd186d640 1 --2- 172.21.15.6:0/801160961 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbcc0ad0d0 0x7fcbcc0ad550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.590+0000 7fcbd186d640 1 --2- 172.21.15.6:0/801160961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbcc0cdc80 0x7fcbcc0ce0b0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.590+0000 7fcbd186d640 1 -- 172.21.15.6:0/801160961 >> 172.21.15.6:0/801160961 conn(0x7fcbcc0659d0 msgr2=0x7fcbcc099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:31.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.590+0000 7fcbd186d640 1 -- 172.21.15.6:0/801160961 shutdown_connections 2023-07-21T22:55:31.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.590+0000 7fcbd186d640 1 -- 172.21.15.6:0/801160961 wait complete. 2023-07-21T22:55:31.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.590+0000 7fcbd186d640 1 Processor -- start 2023-07-21T22:55:31.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.590+0000 7fcbd186d640 1 -- start start 2023-07-21T22:55:31.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.590+0000 7fcbd186d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbcc0ad0d0 0x7fcbcc0b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.590+0000 7fcbd186d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbcc0cdc80 0x7fcbcc0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.590+0000 7fcbd186d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbcc15d0c0 0x7fcbcc0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.590+0000 7fcbd186d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc0b3a00 con 0x7fcbcc15d0c0 2023-07-21T22:55:31.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.590+0000 7fcbd186d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc14c110 con 0x7fcbcc0cdc80 2023-07-21T22:55:31.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.590+0000 7fcbd186d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc14c3f0 con 0x7fcbcc0ad0d0 2023-07-21T22:55:31.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.594+0000 7fcbcb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbcc15d0c0 0x7fcbcc0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.594+0000 7fcbcb7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbcc15d0c0 0x7fcbcc0cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37664/0 (socket says 172.21.15.6:37664) 2023-07-21T22:55:31.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.594+0000 7fcbcb7fe640 1 -- 172.21.15.6:0/2670649886 learned_addr learned my addr 172.21.15.6:0/2670649886 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:31.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.594+0000 7fcbcaffd640 1 --2- 172.21.15.6:0/2670649886 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbcc0ad0d0 0x7fcbcc0b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.594+0000 7fcbc3fff640 1 --2- 172.21.15.6:0/2670649886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbcc0cdc80 0x7fcbcc0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.594+0000 7fcbcb7fe640 1 -- 172.21.15.6:0/2670649886 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbcc0ad0d0 msgr2=0x7fcbcc0b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.594+0000 7fcbcb7fe640 1 --2- 172.21.15.6:0/2670649886 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbcc0ad0d0 0x7fcbcc0b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.594+0000 7fcbcb7fe640 1 -- 172.21.15.6:0/2670649886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbcc0cdc80 msgr2=0x7fcbcc0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.594+0000 7fcbcb7fe640 1 --2- 172.21.15.6:0/2670649886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbcc0cdc80 0x7fcbcc0cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.594+0000 7fcbcb7fe640 1 -- 172.21.15.6:0/2670649886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb4009420 con 0x7fcbcc15d0c0 2023-07-21T22:55:31.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.594+0000 7fcbc3fff640 1 --2- 172.21.15.6:0/2670649886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbcc0cdc80 0x7fcbcc0cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:31.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.594+0000 7fcbcb7fe640 1 --2- 172.21.15.6:0/2670649886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbcc15d0c0 0x7fcbcc0cbd30 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4007e40 tx=0x7fcbc400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:31.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.594+0000 7fcbc8ff9640 1 -- 172.21.15.6:0/2670649886 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4014620 con 0x7fcbcc15d0c0 2023-07-21T22:55:31.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.594+0000 7fcbc8ff9640 1 -- 172.21.15.6:0/2670649886 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc400ee90 con 0x7fcbcc15d0c0 2023-07-21T22:55:31.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.594+0000 7fcbc8ff9640 1 -- 172.21.15.6:0/2670649886 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc40149e0 con 0x7fcbcc15d0c0 2023-07-21T22:55:31.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.594+0000 7fcbd186d640 1 -- 172.21.15.6:0/2670649886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbcc14c6d0 con 0x7fcbcc15d0c0 2023-07-21T22:55:31.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.594+0000 7fcbd186d640 1 -- 172.21.15.6:0/2670649886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbcc0b3640 con 0x7fcbcc15d0c0 2023-07-21T22:55:31.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.594+0000 7fcbd186d640 1 -- 172.21.15.6:0/2670649886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbcc14c8c0 con 0x7fcbcc15d0c0 2023-07-21T22:55:31.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.594+0000 7fcbc8ff9640 1 -- 172.21.15.6:0/2670649886 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcbc4014b40 con 0x7fcbcc15d0c0 2023-07-21T22:55:31.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.594+0000 7fcbc8ff9640 1 --2- 172.21.15.6:0/2670649886 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fcbac0663a0 0x7fcbac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.598+0000 7fcbc8ff9640 1 -- 172.21.15.6:0/2670649886 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6400+0+0 (secure 0 0 0) 0x7fcbc4084960 con 0x7fcbcc15d0c0 2023-07-21T22:55:31.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.598+0000 7fcbcaffd640 1 --2- 172.21.15.6:0/2670649886 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fcbac0663a0 0x7fcbac068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.598+0000 7fcbcaffd640 1 --2- 172.21.15.6:0/2670649886 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fcbac0663a0 0x7fcbac068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc15e690 tx=0x7fcbbc009040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:31.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.598+0000 7fcbc8ff9640 1 -- 172.21.15.6:0/2670649886 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcbc4051b00 con 0x7fcbcc15d0c0 2023-07-21T22:55:31.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:31.810+0000 7fcbd186d640 1 -- 172.21.15.6:0/2670649886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7fcbcc0678d0 con 0x7fcbcc15d0c0 2023-07-21T22:55:32.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.346+0000 7fcbc8ff9640 1 -- 172.21.15.6:0/2670649886 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v1307) v1 ==== 165+0+0 (secure 0 0 0) 0x7fcbc4055120 con 0x7fcbcc15d0c0 2023-07-21T22:55:32.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.346+0000 7fcbd186d640 1 -- 172.21.15.6:0/2670649886 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fcbac0663a0 msgr2=0x7fcbac068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:32.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.346+0000 7fcbd186d640 1 --2- 172.21.15.6:0/2670649886 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fcbac0663a0 0x7fcbac068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc15e690 tx=0x7fcbbc009040 comp rx=0 tx=0).stop 2023-07-21T22:55:32.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.346+0000 7fcbd186d640 1 -- 172.21.15.6:0/2670649886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbcc15d0c0 msgr2=0x7fcbcc0cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:32.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.346+0000 7fcbd186d640 1 --2- 172.21.15.6:0/2670649886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbcc15d0c0 0x7fcbcc0cbd30 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4007e40 tx=0x7fcbc400e4b0 comp rx=0 tx=0).stop 2023-07-21T22:55:32.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.346+0000 7fcbd186d640 1 -- 172.21.15.6:0/2670649886 shutdown_connections 2023-07-21T22:55:32.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.346+0000 7fcbd186d640 1 --2- 172.21.15.6:0/2670649886 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fcbac0663a0 0x7fcbac068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:32.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.346+0000 7fcbd186d640 1 --2- 172.21.15.6:0/2670649886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbcc15d0c0 0x7fcbcc0cbd30 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:32.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.346+0000 7fcbd186d640 1 --2- 172.21.15.6:0/2670649886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbcc0cdc80 0x7fcbcc0cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:32.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.346+0000 7fcbd186d640 1 --2- 172.21.15.6:0/2670649886 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbcc0ad0d0 0x7fcbcc0b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:32.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.346+0000 7fcbd186d640 1 -- 172.21.15.6:0/2670649886 >> 172.21.15.6:0/2670649886 conn(0x7fcbcc0659d0 msgr2=0x7fcbcc0ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:32.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.346+0000 7fcbd186d640 1 -- 172.21.15.6:0/2670649886 shutdown_connections 2023-07-21T22:55:32.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.350+0000 7fcbd186d640 1 -- 172.21.15.6:0/2670649886 wait complete. 2023-07-21T22:55:32.409 INFO:tasks.cephfs_test_runner:Test that snap schedule is resumed after mgr restart ... ok 2023-07-21T22:55:32.409 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test scheduled snapshots along with rentention policy 2023-07-21T22:55:32.410 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-21T22:55:32.410 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-07-21T22:55:32.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.518+0000 7fda2b900640 1 Processor -- start 2023-07-21T22:55:32.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.518+0000 7fda2b900640 1 -- start start 2023-07-21T22:55:32.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.522+0000 7fda2b900640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fda240b7c70 0x7fda240d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:32.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.522+0000 7fda2b900640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda240d1850 0x7fda2415f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:32.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.522+0000 7fda2b900640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda240d1300 0x7fda2415fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:32.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.522+0000 7fda2b900640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda240d1190 con 0x7fda240d1300 2023-07-21T22:55:32.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.522+0000 7fda2b900640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda24160600 con 0x7fda240b7c70 2023-07-21T22:55:32.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.522+0000 7fda2b900640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda241600d0 con 0x7fda240d1850 2023-07-21T22:55:32.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.522+0000 7fda29e9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda240d1300 0x7fda2415fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:32.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.522+0000 7fda29e9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fda240d1300 0x7fda2415fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37674/0 (socket says 172.21.15.6:37674) 2023-07-21T22:55:32.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.522+0000 7fda29e9d640 1 -- 172.21.15.6:0/149597628 learned_addr learned my addr 172.21.15.6:0/149597628 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:32.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.522+0000 7fda28e9b640 1 --2- 172.21.15.6:0/149597628 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda240d1850 0x7fda2415f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:32.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.522+0000 7fda2969c640 1 --2- 172.21.15.6:0/149597628 >> v2:172.21.15.161:3300/0 conn(0x7fda240b7c70 0x7fda240d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:32.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.522+0000 7fda29e9d640 1 -- 172.21.15.6:0/149597628 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda240d1850 msgr2=0x7fda2415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:32.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.522+0000 7fda29e9d640 1 --2- 172.21.15.6:0/149597628 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda240d1850 0x7fda2415f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:32.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.522+0000 7fda29e9d640 1 -- 172.21.15.6:0/149597628 >> v2:172.21.15.161:3300/0 conn(0x7fda240b7c70 msgr2=0x7fda240d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:32.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.522+0000 7fda29e9d640 1 --2- 172.21.15.6:0/149597628 >> v2:172.21.15.161:3300/0 conn(0x7fda240b7c70 0x7fda240d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:32.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.522+0000 7fda29e9d640 1 -- 172.21.15.6:0/149597628 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda240ccaf0 con 0x7fda240d1300 2023-07-21T22:55:32.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.522+0000 7fda28e9b640 1 --2- 172.21.15.6:0/149597628 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda240d1850 0x7fda2415f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:32.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.526+0000 7fda29e9d640 1 --2- 172.21.15.6:0/149597628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda240d1300 0x7fda2415fb90 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fda240b40a0 tx=0x7fda1c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd85e232cb8258d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:32.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.526+0000 7fda1bfff640 1 -- 172.21.15.6:0/149597628 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0a5730 con 0x7fda240d1300 2023-07-21T22:55:32.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.526+0000 7fda1bfff640 1 -- 172.21.15.6:0/149597628 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c0a5890 con 0x7fda240d1300 2023-07-21T22:55:32.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.526+0000 7fda1bfff640 1 -- 172.21.15.6:0/149597628 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0a5c20 con 0x7fda240d1300 2023-07-21T22:55:32.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.526+0000 7fda2b900640 1 -- 172.21.15.6:0/149597628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda240d1300 msgr2=0x7fda2415fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:32.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.526+0000 7fda2b900640 1 --2- 172.21.15.6:0/149597628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda240d1300 0x7fda2415fb90 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fda240b40a0 tx=0x7fda1c01c9a0 comp rx=0 tx=0).stop 2023-07-21T22:55:32.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.526+0000 7fda2b900640 1 -- 172.21.15.6:0/149597628 shutdown_connections 2023-07-21T22:55:32.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.526+0000 7fda2b900640 1 --2- 172.21.15.6:0/149597628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda240d1300 0x7fda2415fb90 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:32.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.526+0000 7fda2b900640 1 --2- 172.21.15.6:0/149597628 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda240d1850 0x7fda2415f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:32.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.526+0000 7fda2b900640 1 --2- 172.21.15.6:0/149597628 >> v2:172.21.15.161:3300/0 conn(0x7fda240b7c70 0x7fda240d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:32.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.526+0000 7fda2b900640 1 -- 172.21.15.6:0/149597628 >> 172.21.15.6:0/149597628 conn(0x7fda240650b0 msgr2=0x7fda240654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:32.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.526+0000 7fda2b900640 1 -- 172.21.15.6:0/149597628 shutdown_connections 2023-07-21T22:55:32.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.526+0000 7fda2b900640 1 -- 172.21.15.6:0/149597628 wait complete. 2023-07-21T22:55:32.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.526+0000 7fda2b900640 1 Processor -- start 2023-07-21T22:55:32.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.526+0000 7fda2b900640 1 -- start start 2023-07-21T22:55:32.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda2b900640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda240b7c70 0x7fda241f8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:32.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda2b900640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda240d1300 0x7fda2415dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:32.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda2b900640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda240d1850 0x7fda241f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:32.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda2b900640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda241f4ad0 con 0x7fda240d1850 2023-07-21T22:55:32.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda2b900640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda241f4db0 con 0x7fda240d1300 2023-07-21T22:55:32.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda2b900640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda241f7540 con 0x7fda240b7c70 2023-07-21T22:55:32.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda29e9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda240d1850 0x7fda241f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:32.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda29e9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda240d1850 0x7fda241f3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37686/0 (socket says 172.21.15.6:37686) 2023-07-21T22:55:32.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda29e9d640 1 -- 172.21.15.6:0/2467345759 learned_addr learned my addr 172.21.15.6:0/2467345759 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:32.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda2969c640 1 --2- 172.21.15.6:0/2467345759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda240b7c70 0x7fda241f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:32.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda28e9b640 1 --2- 172.21.15.6:0/2467345759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda240d1300 0x7fda2415dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:32.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda29e9d640 1 -- 172.21.15.6:0/2467345759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda240b7c70 msgr2=0x7fda241f8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:32.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda29e9d640 1 --2- 172.21.15.6:0/2467345759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda240b7c70 0x7fda241f8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:32.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda29e9d640 1 -- 172.21.15.6:0/2467345759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda240d1300 msgr2=0x7fda2415dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:32.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda29e9d640 1 --2- 172.21.15.6:0/2467345759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda240d1300 0x7fda2415dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:32.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda29e9d640 1 -- 172.21.15.6:0/2467345759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c009b30 con 0x7fda240d1850 2023-07-21T22:55:32.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda2969c640 1 --2- 172.21.15.6:0/2467345759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda240b7c70 0x7fda241f8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:32.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda29e9d640 1 --2- 172.21.15.6:0/2467345759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda240d1850 0x7fda241f3f60 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fda1c01b050 tx=0x7fda1c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:32.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda19ffb640 1 -- 172.21.15.6:0/2467345759 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0b8670 con 0x7fda240d1850 2023-07-21T22:55:32.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda19ffb640 1 -- 172.21.15.6:0/2467345759 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c0b87d0 con 0x7fda240d1850 2023-07-21T22:55:32.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda19ffb640 1 -- 172.21.15.6:0/2467345759 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c0b8b80 con 0x7fda240d1850 2023-07-21T22:55:32.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda2b900640 1 -- 172.21.15.6:0/2467345759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda241f7820 con 0x7fda240d1850 2023-07-21T22:55:32.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda2b900640 1 -- 172.21.15.6:0/2467345759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda240c7fe0 con 0x7fda240d1850 2023-07-21T22:55:32.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.530+0000 7fda2b900640 1 -- 172.21.15.6:0/2467345759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda240678d0 con 0x7fda240d1850 2023-07-21T22:55:32.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.534+0000 7fda19ffb640 1 -- 172.21.15.6:0/2467345759 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fda1c0b8ce0 con 0x7fda240d1850 2023-07-21T22:55:32.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.534+0000 7fda19ffb640 1 --2- 172.21.15.6:0/2467345759 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fda080663a0 0x7fda08068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:32.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.534+0000 7fda19ffb640 1 -- 172.21.15.6:0/2467345759 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6400+0+0 (secure 0 0 0) 0x7fda1c11f6f0 con 0x7fda240d1850 2023-07-21T22:55:32.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.534+0000 7fda2969c640 1 --2- 172.21.15.6:0/2467345759 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fda080663a0 0x7fda08068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:32.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.534+0000 7fda2969c640 1 --2- 172.21.15.6:0/2467345759 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fda080663a0 0x7fda08068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda20007a70 tx=0x7fda20008040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:32.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.538+0000 7fda19ffb640 1 -- 172.21.15.6:0/2467345759 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fda1c0ecb20 con 0x7fda240d1850 2023-07-21T22:55:32.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:32.746+0000 7fda2b900640 1 -- 172.21.15.6:0/2467345759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7fda240c5bb0 con 0x7fda240d1850 2023-07-21T22:55:33.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.346+0000 7fda19ffb640 1 -- 172.21.15.6:0/2467345759 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v1308) v1 ==== 166+0+0 (secure 0 0 0) 0x7fda1c0f0140 con 0x7fda240d1850 2023-07-21T22:55:33.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.350+0000 7fda2b900640 1 -- 172.21.15.6:0/2467345759 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fda080663a0 msgr2=0x7fda08068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:33.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.350+0000 7fda2b900640 1 --2- 172.21.15.6:0/2467345759 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fda080663a0 0x7fda08068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda20007a70 tx=0x7fda20008040 comp rx=0 tx=0).stop 2023-07-21T22:55:33.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.350+0000 7fda2b900640 1 -- 172.21.15.6:0/2467345759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda240d1850 msgr2=0x7fda241f3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:33.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.350+0000 7fda2b900640 1 --2- 172.21.15.6:0/2467345759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda240d1850 0x7fda241f3f60 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fda1c01b050 tx=0x7fda1c019740 comp rx=0 tx=0).stop 2023-07-21T22:55:33.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.350+0000 7fda2b900640 1 -- 172.21.15.6:0/2467345759 shutdown_connections 2023-07-21T22:55:33.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.350+0000 7fda2b900640 1 --2- 172.21.15.6:0/2467345759 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fda080663a0 0x7fda08068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:33.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.350+0000 7fda2b900640 1 --2- 172.21.15.6:0/2467345759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda240d1850 0x7fda241f3f60 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:33.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.350+0000 7fda2b900640 1 --2- 172.21.15.6:0/2467345759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda240d1300 0x7fda2415dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:33.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.350+0000 7fda2b900640 1 --2- 172.21.15.6:0/2467345759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fda240b7c70 0x7fda241f8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:33.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.350+0000 7fda2b900640 1 -- 172.21.15.6:0/2467345759 >> 172.21.15.6:0/2467345759 conn(0x7fda240650b0 msgr2=0x7fda240cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:33.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.350+0000 7fda2b900640 1 -- 172.21.15.6:0/2467345759 shutdown_connections 2023-07-21T22:55:33.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.350+0000 7fda2b900640 1 -- 172.21.15.6:0/2467345759 wait complete. 2023-07-21T22:55:33.411 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-21T22:55:33.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.526+0000 7f97d9ae5640 1 Processor -- start 2023-07-21T22:55:33.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.526+0000 7f97d9ae5640 1 -- start start 2023-07-21T22:55:33.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.526+0000 7f97d9ae5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f97d415bde0 0x7f97d40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:33.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.526+0000 7f97d9ae5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d40d2fc0 0x7f97d40b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:33.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.526+0000 7f97d9ae5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97d40d2300 0x7f97d40d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.526+0000 7f97d9ae5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d40d2ce0 con 0x7f97d40d2300 2023-07-21T22:55:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.526+0000 7f97d9ae5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d415c1b0 con 0x7f97d415bde0 2023-07-21T22:55:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.526+0000 7f97d9ae5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d40b04c0 con 0x7f97d40d2fc0 2023-07-21T22:55:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.526+0000 7f97d3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97d40d2300 0x7f97d40d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.526+0000 7f97d3fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97d40d2300 0x7f97d40d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37700/0 (socket says 172.21.15.6:37700) 2023-07-21T22:55:33.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.526+0000 7f97d3fff640 1 -- 172.21.15.6:0/3036257563 learned_addr learned my addr 172.21.15.6:0/3036257563 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:33.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.526+0000 7f97cbfff640 1 --2- 172.21.15.6:0/3036257563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d40d2fc0 0x7f97d40b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:33.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.526+0000 7f97d37fe640 1 --2- 172.21.15.6:0/3036257563 >> v2:172.21.15.161:3300/0 conn(0x7f97d415bde0 0x7f97d40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:33.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.526+0000 7f97d3fff640 1 -- 172.21.15.6:0/3036257563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d40d2fc0 msgr2=0x7f97d40b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:33.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.526+0000 7f97d3fff640 1 --2- 172.21.15.6:0/3036257563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d40d2fc0 0x7f97d40b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.526+0000 7f97d3fff640 1 -- 172.21.15.6:0/3036257563 >> v2:172.21.15.161:3300/0 conn(0x7f97d415bde0 msgr2=0x7f97d40d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.526+0000 7f97d3fff640 1 --2- 172.21.15.6:0/3036257563 >> v2:172.21.15.161:3300/0 conn(0x7f97d415bde0 0x7f97d40d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.526+0000 7f97d3fff640 1 -- 172.21.15.6:0/3036257563 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d40d0aa0 con 0x7f97d40d2300 2023-07-21T22:55:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.526+0000 7f97d37fe640 1 --2- 172.21.15.6:0/3036257563 >> v2:172.21.15.161:3300/0 conn(0x7f97d415bde0 0x7f97d40d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.526+0000 7f97cbfff640 1 --2- 172.21.15.6:0/3036257563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d40d2fc0 0x7f97d40b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:33.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.530+0000 7f97d3fff640 1 --2- 172.21.15.6:0/3036257563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97d40d2300 0x7f97d40d27a0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f97d408b210 tx=0x7f97cc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6bf258f437c64b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:33.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.530+0000 7f97d2ffd640 1 -- 172.21.15.6:0/3036257563 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0a5850 con 0x7f97d40d2300 2023-07-21T22:55:33.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.530+0000 7f97d2ffd640 1 -- 172.21.15.6:0/3036257563 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc0a59b0 con 0x7f97d40d2300 2023-07-21T22:55:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.530+0000 7f97d2ffd640 1 -- 172.21.15.6:0/3036257563 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0a5d40 con 0x7f97d40d2300 2023-07-21T22:55:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.530+0000 7f97d9ae5640 1 -- 172.21.15.6:0/3036257563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97d40d2300 msgr2=0x7f97d40d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.530+0000 7f97d9ae5640 1 --2- 172.21.15.6:0/3036257563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97d40d2300 0x7f97d40d27a0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f97d408b210 tx=0x7f97cc01c9d0 comp rx=0 tx=0).stop 2023-07-21T22:55:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.530+0000 7f97d9ae5640 1 -- 172.21.15.6:0/3036257563 shutdown_connections 2023-07-21T22:55:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.530+0000 7f97d9ae5640 1 --2- 172.21.15.6:0/3036257563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97d40d2300 0x7f97d40d27a0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.530+0000 7f97d9ae5640 1 --2- 172.21.15.6:0/3036257563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d40d2fc0 0x7f97d40b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.530+0000 7f97d9ae5640 1 --2- 172.21.15.6:0/3036257563 >> v2:172.21.15.161:3300/0 conn(0x7f97d415bde0 0x7f97d40d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.530+0000 7f97d9ae5640 1 -- 172.21.15.6:0/3036257563 >> 172.21.15.6:0/3036257563 conn(0x7f97d40659d0 msgr2=0x7f97d409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.530+0000 7f97d9ae5640 1 -- 172.21.15.6:0/3036257563 shutdown_connections 2023-07-21T22:55:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.530+0000 7f97d9ae5640 1 -- 172.21.15.6:0/3036257563 wait complete. 2023-07-21T22:55:33.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97d9ae5640 1 Processor -- start 2023-07-21T22:55:33.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97d9ae5640 1 -- start start 2023-07-21T22:55:33.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97d9ae5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97d40d2300 0x7f97d4150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:33.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97d9ae5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97d40d2fc0 0x7f97d40b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:33.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97d9ae5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d415bde0 0x7f97d40c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:33.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97d9ae5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d40b36f0 con 0x7f97d40d2fc0 2023-07-21T22:55:33.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97d9ae5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d40b1750 con 0x7f97d40d2300 2023-07-21T22:55:33.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97d9ae5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d40c64e0 con 0x7f97d415bde0 2023-07-21T22:55:33.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97d40d2fc0 0x7f97d40b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:33.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97cbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97d40d2fc0 0x7f97d40b1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37708/0 (socket says 172.21.15.6:37708) 2023-07-21T22:55:33.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97cbfff640 1 -- 172.21.15.6:0/2256738462 learned_addr learned my addr 172.21.15.6:0/2256738462 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:33.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97d37fe640 1 --2- 172.21.15.6:0/2256738462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97d40d2300 0x7f97d4150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:33.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97d3fff640 1 --2- 172.21.15.6:0/2256738462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d415bde0 0x7f97d40c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:33.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97cbfff640 1 -- 172.21.15.6:0/2256738462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d415bde0 msgr2=0x7f97d40c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:33.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97cbfff640 1 --2- 172.21.15.6:0/2256738462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d415bde0 0x7f97d40c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:33.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97cbfff640 1 -- 172.21.15.6:0/2256738462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97d40d2300 msgr2=0x7f97d4150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:33.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97cbfff640 1 --2- 172.21.15.6:0/2256738462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97d40d2300 0x7f97d4150fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:33.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97cbfff640 1 -- 172.21.15.6:0/2256738462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc009b30 con 0x7f97d40d2fc0 2023-07-21T22:55:33.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97cbfff640 1 --2- 172.21.15.6:0/2256738462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97d40d2fc0 0x7f97d40b1210 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f97bc00d800 tx=0x7f97bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:33.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97d0ff9640 1 -- 172.21.15.6:0/2256738462 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc004030 con 0x7f97d40d2fc0 2023-07-21T22:55:33.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97d0ff9640 1 -- 172.21.15.6:0/2256738462 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97bc004190 con 0x7f97d40d2fc0 2023-07-21T22:55:33.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97d0ff9640 1 -- 172.21.15.6:0/2256738462 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc004520 con 0x7f97d40d2fc0 2023-07-21T22:55:33.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97d9ae5640 1 -- 172.21.15.6:0/2256738462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d40b3900 con 0x7f97d40d2fc0 2023-07-21T22:55:33.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.534+0000 7f97d9ae5640 1 -- 172.21.15.6:0/2256738462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d40b3ec0 con 0x7f97d40d2fc0 2023-07-21T22:55:33.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.538+0000 7f97d9ae5640 1 -- 172.21.15.6:0/2256738462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d40678d0 con 0x7f97d40d2fc0 2023-07-21T22:55:33.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.538+0000 7f97d0ff9640 1 -- 172.21.15.6:0/2256738462 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f97bc0096a0 con 0x7f97d40d2fc0 2023-07-21T22:55:33.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.538+0000 7f97d0ff9640 1 --2- 172.21.15.6:0/2256738462 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f97b40663a0 0x7f97b4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:33.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.538+0000 7f97d0ff9640 1 -- 172.21.15.6:0/2256738462 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6400+0+0 (secure 0 0 0) 0x7f97bc0840d0 con 0x7f97d40d2fc0 2023-07-21T22:55:33.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.538+0000 7f97d37fe640 1 --2- 172.21.15.6:0/2256738462 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f97b40663a0 0x7f97b4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:33.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.538+0000 7f97d37fe640 1 --2- 172.21.15.6:0/2256738462 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f97b40663a0 0x7f97b4068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f97d4065fa0 tx=0x7f97c4008040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:33.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.542+0000 7f97d0ff9640 1 -- 172.21.15.6:0/2256738462 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f97bc0513a0 con 0x7f97d40d2fc0 2023-07-21T22:55:33.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.694+0000 7f97d9ae5640 1 -- 172.21.15.6:0/2256738462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f97d415b1a0 con 0x7f97d40d2fc0 2023-07-21T22:55:33.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.702+0000 7f97d0ff9640 1 -- 172.21.15.6:0/2256738462 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v58)=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7f97bc0549c0 con 0x7f97d40d2fc0 2023-07-21T22:55:33.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.702+0000 7f97d9ae5640 1 -- 172.21.15.6:0/2256738462 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f97b40663a0 msgr2=0x7f97b4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:33.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.702+0000 7f97d9ae5640 1 --2- 172.21.15.6:0/2256738462 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f97b40663a0 0x7f97b4068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f97d4065fa0 tx=0x7f97c4008040 comp rx=0 tx=0).stop 2023-07-21T22:55:33.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.702+0000 7f97d9ae5640 1 -- 172.21.15.6:0/2256738462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97d40d2fc0 msgr2=0x7f97d40b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:33.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.702+0000 7f97d9ae5640 1 --2- 172.21.15.6:0/2256738462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97d40d2fc0 0x7f97d40b1210 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f97bc00d800 tx=0x7f97bc00dcc0 comp rx=0 tx=0).stop 2023-07-21T22:55:33.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.702+0000 7f97d9ae5640 1 -- 172.21.15.6:0/2256738462 shutdown_connections 2023-07-21T22:55:33.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.702+0000 7f97d9ae5640 1 --2- 172.21.15.6:0/2256738462 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f97b40663a0 0x7f97b4068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:33.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.702+0000 7f97d9ae5640 1 --2- 172.21.15.6:0/2256738462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d415bde0 0x7f97d40c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:33.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.702+0000 7f97d9ae5640 1 --2- 172.21.15.6:0/2256738462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97d40d2fc0 0x7f97d40b1210 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:33.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.702+0000 7f97d9ae5640 1 --2- 172.21.15.6:0/2256738462 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97d40d2300 0x7f97d4150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:33.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.702+0000 7f97d9ae5640 1 -- 172.21.15.6:0/2256738462 >> 172.21.15.6:0/2256738462 conn(0x7f97d40659d0 msgr2=0x7f97d415a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:33.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.702+0000 7f97d9ae5640 1 -- 172.21.15.6:0/2256738462 shutdown_connections 2023-07-21T22:55:33.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:33.702+0000 7f97d9ae5640 1 -- 172.21.15.6:0/2256738462 wait complete. 2023-07-21T22:55:33.761 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:55:33.762 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:55:33.806 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:55:33.863 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:55:33.864 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:55:33.864 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:55:33.873 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:55:33.874 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:55:33.874 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:55:33.883 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:55:33.884 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:55:33.884 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:55:33.926 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:55:33.926 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:55:33.927 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:55:33.937 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:55:33.938 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-21T22:55:33.939 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:55:34.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.074+0000 7f6346eca640 1 Processor -- start 2023-07-21T22:55:34.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.074+0000 7f6346eca640 1 -- start start 2023-07-21T22:55:34.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.078+0000 7f6346eca640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6340070b70 0x7f6340070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:34.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.078+0000 7f6346eca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f634006b1e0 0x7f63400c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:34.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.078+0000 7f6346eca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f63400c21f0 0x7f63400cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:34.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.078+0000 7f6346eca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63400cac70 con 0x7f63400c21f0 2023-07-21T22:55:34.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.078+0000 7f6346eca640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6340071480 con 0x7f6340070b70 2023-07-21T22:55:34.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.078+0000 7f6346eca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63400ca060 con 0x7f634006b1e0 2023-07-21T22:55:34.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.078+0000 7f6345467640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f63400c21f0 0x7f63400cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:34.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.078+0000 7f6345467640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f63400c21f0 0x7f63400cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37716/0 (socket says 172.21.15.6:37716) 2023-07-21T22:55:34.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.078+0000 7f6345467640 1 -- 172.21.15.6:0/3511232328 learned_addr learned my addr 172.21.15.6:0/3511232328 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:34.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.078+0000 7f633ffff640 1 --2- 172.21.15.6:0/3511232328 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f634006b1e0 0x7f63400c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.078+0000 7f6344c66640 1 --2- 172.21.15.6:0/3511232328 >> v2:172.21.15.161:3300/0 conn(0x7f6340070b70 0x7f6340070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.078+0000 7f6345467640 1 -- 172.21.15.6:0/3511232328 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f634006b1e0 msgr2=0x7f63400c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.078+0000 7f6345467640 1 --2- 172.21.15.6:0/3511232328 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f634006b1e0 0x7f63400c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.078+0000 7f6345467640 1 -- 172.21.15.6:0/3511232328 >> v2:172.21.15.161:3300/0 conn(0x7f6340070b70 msgr2=0x7f6340070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.078+0000 7f6345467640 1 --2- 172.21.15.6:0/3511232328 >> v2:172.21.15.161:3300/0 conn(0x7f6340070b70 0x7f6340070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.078+0000 7f6345467640 1 -- 172.21.15.6:0/3511232328 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63400ca340 con 0x7f63400c21f0 2023-07-21T22:55:34.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.078+0000 7f6345467640 1 --2- 172.21.15.6:0/3511232328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63400c21f0 0x7f63400cb100 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f634006f1f0 tx=0x7f633801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee921b2fba4212a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:34.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.082+0000 7f633f7fe640 1 -- 172.21.15.6:0/3511232328 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63380a57b0 con 0x7f63400c21f0 2023-07-21T22:55:34.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.082+0000 7f633f7fe640 1 -- 172.21.15.6:0/3511232328 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63380a5910 con 0x7f63400c21f0 2023-07-21T22:55:34.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.082+0000 7f633f7fe640 1 -- 172.21.15.6:0/3511232328 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63380a5ca0 con 0x7f63400c21f0 2023-07-21T22:55:34.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.082+0000 7f6346eca640 1 -- 172.21.15.6:0/3511232328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63400c21f0 msgr2=0x7f63400cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:34.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.082+0000 7f6346eca640 1 --2- 172.21.15.6:0/3511232328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63400c21f0 0x7f63400cb100 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f634006f1f0 tx=0x7f633801c910 comp rx=0 tx=0).stop 2023-07-21T22:55:34.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.082+0000 7f6346eca640 1 -- 172.21.15.6:0/3511232328 shutdown_connections 2023-07-21T22:55:34.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.082+0000 7f6346eca640 1 --2- 172.21.15.6:0/3511232328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63400c21f0 0x7f63400cb100 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:34.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.082+0000 7f6346eca640 1 --2- 172.21.15.6:0/3511232328 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f634006b1e0 0x7f63400c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:34.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.082+0000 7f6346eca640 1 --2- 172.21.15.6:0/3511232328 >> v2:172.21.15.161:3300/0 conn(0x7f6340070b70 0x7f6340070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.082+0000 7f6346eca640 1 -- 172.21.15.6:0/3511232328 >> 172.21.15.6:0/3511232328 conn(0x7f63400afcf0 msgr2=0x7f63400b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.082+0000 7f6346eca640 1 -- 172.21.15.6:0/3511232328 shutdown_connections 2023-07-21T22:55:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.082+0000 7f6346eca640 1 -- 172.21.15.6:0/3511232328 wait complete. 2023-07-21T22:55:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.082+0000 7f6346eca640 1 Processor -- start 2023-07-21T22:55:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.082+0000 7f6346eca640 1 -- start start 2023-07-21T22:55:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.082+0000 7f6346eca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f634006b1e0 0x7f6340154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.082+0000 7f6346eca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6340070b70 0x7f63400cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.082+0000 7f6346eca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63400c21f0 0x7f63401f4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.082+0000 7f6346eca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63400cddd0 con 0x7f634006b1e0 2023-07-21T22:55:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.082+0000 7f6346eca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63400c25f0 con 0x7f6340070b70 2023-07-21T22:55:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.082+0000 7f6346eca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63401f4e00 con 0x7f63400c21f0 2023-07-21T22:55:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.086+0000 7f6344c66640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f634006b1e0 0x7f6340154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.086+0000 7f6344c66640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f634006b1e0 0x7f6340154660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37726/0 (socket says 172.21.15.6:37726) 2023-07-21T22:55:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.086+0000 7f6344c66640 1 -- 172.21.15.6:0/3076898951 learned_addr learned my addr 172.21.15.6:0/3076898951 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.086+0000 7f6345467640 1 --2- 172.21.15.6:0/3076898951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63400c21f0 0x7f63401f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.086+0000 7f633ffff640 1 --2- 172.21.15.6:0/3076898951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6340070b70 0x7f63400cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.086+0000 7f6344c66640 1 -- 172.21.15.6:0/3076898951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63400c21f0 msgr2=0x7f63401f4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.086+0000 7f6344c66640 1 --2- 172.21.15.6:0/3076898951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63400c21f0 0x7f63401f4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:34.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.086+0000 7f6344c66640 1 -- 172.21.15.6:0/3076898951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6340070b70 msgr2=0x7f63400cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:34.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.086+0000 7f6344c66640 1 --2- 172.21.15.6:0/3076898951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6340070b70 0x7f63400cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:34.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.086+0000 7f6344c66640 1 -- 172.21.15.6:0/3076898951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6338009b30 con 0x7f634006b1e0 2023-07-21T22:55:34.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.086+0000 7f6344c66640 1 --2- 172.21.15.6:0/3076898951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f634006b1e0 0x7f6340154660 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f633400d800 tx=0x7f633400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:34.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.086+0000 7f633d7fa640 1 -- 172.21.15.6:0/3076898951 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633400b6c0 con 0x7f634006b1e0 2023-07-21T22:55:34.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.086+0000 7f633d7fa640 1 -- 172.21.15.6:0/3076898951 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633400b820 con 0x7f634006b1e0 2023-07-21T22:55:34.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.086+0000 7f633d7fa640 1 -- 172.21.15.6:0/3076898951 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633400bb90 con 0x7f634006b1e0 2023-07-21T22:55:34.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.086+0000 7f6346eca640 1 -- 172.21.15.6:0/3076898951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63401f50e0 con 0x7f634006b1e0 2023-07-21T22:55:34.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.086+0000 7f6346eca640 1 -- 172.21.15.6:0/3076898951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63400c2840 con 0x7f634006b1e0 2023-07-21T22:55:34.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.086+0000 7f6346eca640 1 -- 172.21.15.6:0/3076898951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63400c2a00 con 0x7f634006b1e0 2023-07-21T22:55:34.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.086+0000 7f633d7fa640 1 -- 172.21.15.6:0/3076898951 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f633400bcf0 con 0x7f634006b1e0 2023-07-21T22:55:34.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.086+0000 7f633d7fa640 1 --2- 172.21.15.6:0/3076898951 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f63240663a0 0x7f6324068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:34.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.090+0000 7f633d7fa640 1 -- 172.21.15.6:0/3076898951 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6400+0+0 (secure 0 0 0) 0x7f6334084570 con 0x7f634006b1e0 2023-07-21T22:55:34.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.090+0000 7f633ffff640 1 --2- 172.21.15.6:0/3076898951 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f63240663a0 0x7f6324068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:34.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.090+0000 7f633ffff640 1 --2- 172.21.15.6:0/3076898951 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f63240663a0 0x7f6324068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f63400b36b0 tx=0x7f632c008040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:34.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.094+0000 7f633d7fa640 1 -- 172.21.15.6:0/3076898951 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6334055230 con 0x7f634006b1e0 2023-07-21T22:55:34.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.282+0000 7f6346eca640 1 -- 172.21.15.6:0/3076898951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63400678d0 con 0x7f634006b1e0 2023-07-21T22:55:34.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.282+0000 7f633d7fa640 1 -- 172.21.15.6:0/3076898951 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f6334054dc0 con 0x7f634006b1e0 2023-07-21T22:55:34.320 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:34.320 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":72,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8965,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/2365019581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":2365019581},{"type":"v1","addr":"172.21.15.161:6836","nonce":2365019581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8968,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/798924835","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":798924835},{"type":"v1","addr":"172.21.15.161:6837","nonce":798924835}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9306,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2487387353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2487387353},{"type":"v1","addr":"172.21.15.6:6834","nonce":2487387353}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9867,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/2078734379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":2078734379},{"type":"v1","addr":"172.21.15.6:6835","nonce":2078734379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[]} 2023-07-21T22:55:34.321 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 72 2023-07-21T22:55:34.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.282+0000 7f6346eca640 1 -- 172.21.15.6:0/3076898951 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f63240663a0 msgr2=0x7f6324068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:34.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.282+0000 7f6346eca640 1 --2- 172.21.15.6:0/3076898951 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f63240663a0 0x7f6324068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f63400b36b0 tx=0x7f632c008040 comp rx=0 tx=0).stop 2023-07-21T22:55:34.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.282+0000 7f6346eca640 1 -- 172.21.15.6:0/3076898951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f634006b1e0 msgr2=0x7f6340154660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:34.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.282+0000 7f6346eca640 1 --2- 172.21.15.6:0/3076898951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f634006b1e0 0x7f6340154660 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f633400d800 tx=0x7f633400dcc0 comp rx=0 tx=0).stop 2023-07-21T22:55:34.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.286+0000 7f6346eca640 1 -- 172.21.15.6:0/3076898951 shutdown_connections 2023-07-21T22:55:34.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.286+0000 7f6346eca640 1 --2- 172.21.15.6:0/3076898951 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f63240663a0 0x7f6324068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:34.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.286+0000 7f6346eca640 1 --2- 172.21.15.6:0/3076898951 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f63400c21f0 0x7f63401f4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:34.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.286+0000 7f6346eca640 1 --2- 172.21.15.6:0/3076898951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6340070b70 0x7f63400cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:34.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.286+0000 7f6346eca640 1 --2- 172.21.15.6:0/3076898951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f634006b1e0 0x7f6340154660 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:34.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.286+0000 7f6346eca640 1 -- 172.21.15.6:0/3076898951 >> 172.21.15.6:0/3076898951 conn(0x7f63400afcf0 msgr2=0x7f63400b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:34.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.286+0000 7f6346eca640 1 -- 172.21.15.6:0/3076898951 shutdown_connections 2023-07-21T22:55:34.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.286+0000 7f6346eca640 1 -- 172.21.15.6:0/3076898951 wait complete. 2023-07-21T22:55:34.342 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-21T22:55:34.342 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-21T22:55:34.343 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-21T22:55:34.343 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:55:34.343 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-21T22:55:34.343 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-21T22:55:34.344 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-21T22:55:34.344 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:55:34.344 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-21T22:55:34.344 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-21T22:55:34.344 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-21T22:55:34.345 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:55:34.345 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-21T22:55:34.345 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-21T22:55:34.345 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-21T22:55:34.346 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:55:34.356 INFO:tasks.ceph.mds.a:Stopped 2023-07-21T22:55:34.357 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-21T22:55:34.358 INFO:tasks.ceph.mds.c:Stopped 2023-07-21T22:55:34.358 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-21T22:55:34.363 INFO:tasks.ceph.mds.b:Stopped 2023-07-21T22:55:34.363 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-21T22:55:34.365 INFO:tasks.ceph.mds.d:Stopped 2023-07-21T22:55:34.365 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-21T22:55:34.405 INFO:tasks.ceph.mds.a:Started 2023-07-21T22:55:34.405 DEBUG:teuthology.parallel:result is None 2023-07-21T22:55:34.407 INFO:tasks.ceph.mds.c:Started 2023-07-21T22:55:34.407 DEBUG:teuthology.parallel:result is None 2023-07-21T22:55:34.411 INFO:tasks.ceph.mds.b:Started 2023-07-21T22:55:34.411 DEBUG:teuthology.parallel:result is None 2023-07-21T22:55:34.414 INFO:tasks.ceph.mds.d:Started 2023-07-21T22:55:34.414 DEBUG:teuthology.parallel:result is None 2023-07-21T22:55:34.415 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-21T22:55:34.495 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-21T22:55:34.496 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-07-21T22:55:34.504 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-07-21T22:55:34.505 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2023-07-21T22:55:34.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.526+0000 7fecde5fa640 1 Processor -- start 2023-07-21T22:55:34.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.526+0000 7fecde5fa640 1 -- start start 2023-07-21T22:55:34.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.530+0000 7fecde5fa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fecd80c9e20 0x7fecd80ad720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:34.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.530+0000 7fecde5fa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd80ca300 con 0x7fecd80cbef0 2023-07-21T22:55:34.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.530+0000 7fecde5fa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd80ca5e0 con 0x7fecd815f240 2023-07-21T22:55:34.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.530+0000 7fecde5fa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd80caba0 con 0x7fecd80c9e20 2023-07-21T22:55:34.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.530+0000 7fecd77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fecd80c9e20 0x7fecd80ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:34.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.530+0000 7fecdcb97640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fecd80cbef0 0x7fecd80cd5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58898/0 (socket says 172.21.15.6:58898) 2023-07-21T22:55:34.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.530+0000 7fecdcb97640 1 -- 172.21.15.6:0/462741589 learned_addr learned my addr 172.21.15.6:0/462741589 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:34.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.530+0000 7fecd77fe640 1 -- 172.21.15.6:0/462741589 >> v1:172.21.15.161:6789/0 conn(0x7fecd815f240 legacy=0x7fecd815fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:34.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.530+0000 7fecd77fe640 1 -- 172.21.15.6:0/462741589 >> v1:172.21.15.6:6789/0 conn(0x7fecd80cbef0 legacy=0x7fecd80cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:34.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.530+0000 7fecd77fe640 1 -- 172.21.15.6:0/462741589 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd80ca8c0 con 0x7fecd80c9e20 2023-07-21T22:55:34.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.530+0000 7fecd6ffd640 1 -- 172.21.15.6:0/462741589 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971582983 0 0) 0x7fecd80ca300 con 0x7fecd80cbef0 2023-07-21T22:55:34.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.534+0000 7fecd77fe640 1 --2- 172.21.15.6:0/462741589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd80c9e20 0x7fecd80ad720 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7feccc0097c0 tx=0x7feccc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2a7d38a25f2bae server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:34.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.534+0000 7fecd6ffd640 1 -- 172.21.15.6:0/462741589 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc0ab600 con 0x7fecd80c9e20 2023-07-21T22:55:34.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.534+0000 7fecd6ffd640 1 -- 172.21.15.6:0/462741589 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc0a7050 con 0x7fecd80c9e20 2023-07-21T22:55:34.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.534+0000 7fecd6ffd640 1 -- 172.21.15.6:0/462741589 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc0ab980 con 0x7fecd80c9e20 2023-07-21T22:55:34.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.534+0000 7fecde5fa640 1 -- 172.21.15.6:0/462741589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd80c9e20 msgr2=0x7fecd80ad720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:34.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.534+0000 7fecde5fa640 1 --2- 172.21.15.6:0/462741589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd80c9e20 0x7fecd80ad720 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7feccc0097c0 tx=0x7feccc01c3f0 comp rx=0 tx=0).stop 2023-07-21T22:55:34.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.534+0000 7fecde5fa640 1 -- 172.21.15.6:0/462741589 shutdown_connections 2023-07-21T22:55:34.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.534+0000 7fecde5fa640 1 --2- 172.21.15.6:0/462741589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd80c9e20 0x7fecd80ad720 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:34.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.534+0000 7fecde5fa640 1 -- 172.21.15.6:0/462741589 >> 172.21.15.6:0/462741589 conn(0x7fecd80cada0 msgr2=0x7fecd80cb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:34.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.534+0000 7fecde5fa640 1 -- 172.21.15.6:0/462741589 shutdown_connections 2023-07-21T22:55:34.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.534+0000 7fecde5fa640 1 -- 172.21.15.6:0/462741589 wait complete. 2023-07-21T22:55:34.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.534+0000 7fecde5fa640 1 Processor -- start 2023-07-21T22:55:34.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.534+0000 7fecde5fa640 1 -- start start 2023-07-21T22:55:34.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecde5fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecd80c9e20 0x7fecd8156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:34.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecde5fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecd80cbef0 0x7fecd80b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:34.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecde5fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd80b31b0 0x7fecd80ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:34.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecde5fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80c5a20 con 0x7fecd80b31b0 2023-07-21T22:55:34.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecde5fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80b40a0 con 0x7fecd80c9e20 2023-07-21T22:55:34.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecde5fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80c53f0 con 0x7fecd80cbef0 2023-07-21T22:55:34.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecdcb97640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd80b31b0 0x7fecd80ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:34.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecdcb97640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd80b31b0 0x7fecd80ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37768/0 (socket says 172.21.15.6:37768) 2023-07-21T22:55:34.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecdcb97640 1 -- 172.21.15.6:0/4065902568 learned_addr learned my addr 172.21.15.6:0/4065902568 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:34.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecd7fff640 1 --2- 172.21.15.6:0/4065902568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecd80c9e20 0x7fecd8156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:34.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecd77fe640 1 --2- 172.21.15.6:0/4065902568 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecd80cbef0 0x7fecd80b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:34.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecdcb97640 1 -- 172.21.15.6:0/4065902568 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecd80cbef0 msgr2=0x7fecd80b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:34.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecdcb97640 1 --2- 172.21.15.6:0/4065902568 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecd80cbef0 0x7fecd80b2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:34.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecdcb97640 1 -- 172.21.15.6:0/4065902568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecd80c9e20 msgr2=0x7fecd8156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:34.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecdcb97640 1 --2- 172.21.15.6:0/4065902568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecd80c9e20 0x7fecd8156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:34.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecdcb97640 1 -- 172.21.15.6:0/4065902568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc009420 con 0x7fecd80b31b0 2023-07-21T22:55:34.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecdcb97640 1 --2- 172.21.15.6:0/4065902568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd80b31b0 0x7fecd80ae540 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fecd0001570 tx=0x7fecd000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:34.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecd4ff9640 1 -- 172.21.15.6:0/4065902568 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd000a640 con 0x7fecd80b31b0 2023-07-21T22:55:34.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecd4ff9640 1 -- 172.21.15.6:0/4065902568 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd000a7c0 con 0x7fecd80b31b0 2023-07-21T22:55:34.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecde5fa640 1 -- 172.21.15.6:0/4065902568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd80c7d80 con 0x7fecd80b31b0 2023-07-21T22:55:34.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecd4ff9640 1 -- 172.21.15.6:0/4065902568 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd000ab70 con 0x7fecd80b31b0 2023-07-21T22:55:34.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecde5fa640 1 -- 172.21.15.6:0/4065902568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd80c5640 con 0x7fecd80b31b0 2023-07-21T22:55:34.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecde5fa640 1 -- 172.21.15.6:0/4065902568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd80678d0 con 0x7fecd80b31b0 2023-07-21T22:55:34.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.538+0000 7fecd4ff9640 1 -- 172.21.15.6:0/4065902568 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fecd000acd0 con 0x7fecd80b31b0 2023-07-21T22:55:34.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.542+0000 7fecd4ff9640 1 --2- 172.21.15.6:0/4065902568 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fecc40663d0 0x7fecc4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:34.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.542+0000 7fecd4ff9640 1 -- 172.21.15.6:0/4065902568 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6400+0+0 (secure 0 0 0) 0x7fecd0083390 con 0x7fecd80b31b0 2023-07-21T22:55:34.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.542+0000 7fecd7fff640 1 --2- 172.21.15.6:0/4065902568 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fecc40663d0 0x7fecc4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:34.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.542+0000 7fecd7fff640 1 --2- 172.21.15.6:0/4065902568 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fecc40663d0 0x7fecc4068880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fecc8007fd0 tx=0x7fecc8009040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:34.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.546+0000 7fecd4ff9640 1 -- 172.21.15.6:0/4065902568 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fecd0050670 con 0x7fecd80b31b0 2023-07-21T22:55:34.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:34.714+0000 7fecde5fa640 1 -- 172.21.15.6:0/4065902568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fecd806df00 con 0x7fecd80b31b0 2023-07-21T22:55:35.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.726+0000 7fecd4ff9640 1 -- 172.21.15.6:0/4065902568 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v170) v1 ==== 97+0+0 (secure 0 0 0) 0x7fecd0053c90 con 0x7fecd80b31b0 2023-07-21T22:55:35.764 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-07-21T22:55:35.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.730+0000 7fecde5fa640 1 -- 172.21.15.6:0/4065902568 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fecc40663d0 msgr2=0x7fecc4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:35.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.730+0000 7fecde5fa640 1 --2- 172.21.15.6:0/4065902568 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fecc40663d0 0x7fecc4068880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fecc8007fd0 tx=0x7fecc8009040 comp rx=0 tx=0).stop 2023-07-21T22:55:35.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.730+0000 7fecde5fa640 1 -- 172.21.15.6:0/4065902568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd80b31b0 msgr2=0x7fecd80ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:35.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.730+0000 7fecde5fa640 1 --2- 172.21.15.6:0/4065902568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd80b31b0 0x7fecd80ae540 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fecd0001570 tx=0x7fecd000cca0 comp rx=0 tx=0).stop 2023-07-21T22:55:35.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.730+0000 7fecde5fa640 1 -- 172.21.15.6:0/4065902568 shutdown_connections 2023-07-21T22:55:35.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.730+0000 7fecde5fa640 1 --2- 172.21.15.6:0/4065902568 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fecc40663d0 0x7fecc4068880 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:35.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.730+0000 7fecde5fa640 1 --2- 172.21.15.6:0/4065902568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fecd80b31b0 0x7fecd80ae540 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:35.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.730+0000 7fecde5fa640 1 --2- 172.21.15.6:0/4065902568 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fecd80cbef0 0x7fecd80b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:35.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.730+0000 7fecde5fa640 1 --2- 172.21.15.6:0/4065902568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecd80c9e20 0x7fecd8156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:35.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.730+0000 7fecde5fa640 1 -- 172.21.15.6:0/4065902568 >> 172.21.15.6:0/4065902568 conn(0x7fecd80cada0 msgr2=0x7fecd8159a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:35.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.730+0000 7fecde5fa640 1 -- 172.21.15.6:0/4065902568 shutdown_connections 2023-07-21T22:55:35.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.730+0000 7fecde5fa640 1 -- 172.21.15.6:0/4065902568 wait complete. 2023-07-21T22:55:35.790 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-21T22:55:35.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.902+0000 7fd7f4b82640 1 Processor -- start 2023-07-21T22:55:35.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.902+0000 7fd7f4b82640 1 -- start start 2023-07-21T22:55:35.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.906+0000 7fd7f4b82640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7f0070b70 0x7fd7f0070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:35.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.906+0000 7fd7f4b82640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7f00cb100 0x7fd7f00cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:35.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.906+0000 7fd7f4b82640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f00cbac0 con 0x7fd7f006b1e0 2023-07-21T22:55:35.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.906+0000 7fd7f4b82640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f00cac70 con 0x7fd7f00cb100 2023-07-21T22:55:35.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.906+0000 7fd7f4b82640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f0071480 con 0x7fd7f0070b70 2023-07-21T22:55:35.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.906+0000 7fd7eed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd7f00cb100 0x7fd7f00cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:35.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.906+0000 7fd7e7fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd7f006b1e0 0x7fd7f00c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58912/0 (socket says 172.21.15.6:58912) 2023-07-21T22:55:35.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.906+0000 7fd7e7fff640 1 -- 172.21.15.6:0/3780477837 learned_addr learned my addr 172.21.15.6:0/3780477837 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:35.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.906+0000 7fd7eed9d640 1 --2- 172.21.15.6:0/3780477837 >> v2:172.21.15.6:3300/0 conn(0x7fd7f00cb100 0x7fd7f00cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37772/0 (socket says 172.21.15.6:37772) 2023-07-21T22:55:35.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.906+0000 7fd7ee59c640 1 --2- 172.21.15.6:0/3780477837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7f0070b70 0x7fd7f0070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:35.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.906+0000 7fd7eed9d640 1 -- 172.21.15.6:0/3780477837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7f0070b70 msgr2=0x7fd7f0070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:35.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.906+0000 7fd7eed9d640 1 --2- 172.21.15.6:0/3780477837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7f0070b70 0x7fd7f0070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:35.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.906+0000 7fd7eed9d640 1 -- 172.21.15.6:0/3780477837 >> v1:172.21.15.6:6789/0 conn(0x7fd7f006b1e0 legacy=0x7fd7f00c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:35.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.906+0000 7fd7eed9d640 1 -- 172.21.15.6:0/3780477837 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f00ca060 con 0x7fd7f00cb100 2023-07-21T22:55:35.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.906+0000 7fd7eed9d640 1 --2- 172.21.15.6:0/3780477837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f00cb100 0x7fd7f00cb580 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009d90 tx=0x7fd7e801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2edb8f29e9bbd2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:35.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.910+0000 7fd7edd9b640 1 -- 172.21.15.6:0/3780477837 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80a5950 con 0x7fd7f00cb100 2023-07-21T22:55:35.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.910+0000 7fd7edd9b640 1 -- 172.21.15.6:0/3780477837 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e80a5ab0 con 0x7fd7f00cb100 2023-07-21T22:55:35.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.910+0000 7fd7edd9b640 1 -- 172.21.15.6:0/3780477837 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80a5e40 con 0x7fd7f00cb100 2023-07-21T22:55:35.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.910+0000 7fd7f4b82640 1 -- 172.21.15.6:0/3780477837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f00cb100 msgr2=0x7fd7f00cb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.910+0000 7fd7f4b82640 1 --2- 172.21.15.6:0/3780477837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f00cb100 0x7fd7f00cb580 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009d90 tx=0x7fd7e801c890 comp rx=0 tx=0).stop 2023-07-21T22:55:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.910+0000 7fd7f4b82640 1 -- 172.21.15.6:0/3780477837 shutdown_connections 2023-07-21T22:55:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.910+0000 7fd7f4b82640 1 --2- 172.21.15.6:0/3780477837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f00cb100 0x7fd7f00cb580 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.910+0000 7fd7f4b82640 1 --2- 172.21.15.6:0/3780477837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7f0070b70 0x7fd7f0070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.910+0000 7fd7f4b82640 1 -- 172.21.15.6:0/3780477837 >> 172.21.15.6:0/3780477837 conn(0x7fd7f00afcf0 msgr2=0x7fd7f00b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.910+0000 7fd7f4b82640 1 -- 172.21.15.6:0/3780477837 shutdown_connections 2023-07-21T22:55:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.910+0000 7fd7f4b82640 1 -- 172.21.15.6:0/3780477837 wait complete. 2023-07-21T22:55:35.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.910+0000 7fd7f4b82640 1 Processor -- start 2023-07-21T22:55:35.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.910+0000 7fd7f4b82640 1 -- start start 2023-07-21T22:55:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.910+0000 7fd7f4b82640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f006b1e0 0x7fd7f00cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.910+0000 7fd7f4b82640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7f0070b70 0x7fd7f01545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.910+0000 7fd7f4b82640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7f00cb100 0x7fd7f01467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.910+0000 7fd7f4b82640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00cd5a0 con 0x7fd7f006b1e0 2023-07-21T22:55:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.910+0000 7fd7f4b82640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00cc990 con 0x7fd7f0070b70 2023-07-21T22:55:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.910+0000 7fd7f4b82640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00ccc70 con 0x7fd7f00cb100 2023-07-21T22:55:35.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.914+0000 7fd7ee59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f006b1e0 0x7fd7f00cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:35.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.914+0000 7fd7ee59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f006b1e0 0x7fd7f00cc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37776/0 (socket says 172.21.15.6:37776) 2023-07-21T22:55:35.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.914+0000 7fd7ee59c640 1 -- 172.21.15.6:0/1741075260 learned_addr learned my addr 172.21.15.6:0/1741075260 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:35.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.914+0000 7fd7e7fff640 1 --2- 172.21.15.6:0/1741075260 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7f0070b70 0x7fd7f01545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:35.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.914+0000 7fd7eed9d640 1 --2- 172.21.15.6:0/1741075260 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7f00cb100 0x7fd7f01467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:35.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.914+0000 7fd7ee59c640 1 -- 172.21.15.6:0/1741075260 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7f00cb100 msgr2=0x7fd7f01467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:35.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.914+0000 7fd7ee59c640 1 --2- 172.21.15.6:0/1741075260 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7f00cb100 0x7fd7f01467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:35.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.914+0000 7fd7ee59c640 1 -- 172.21.15.6:0/1741075260 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7f0070b70 msgr2=0x7fd7f01545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:35.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.914+0000 7fd7ee59c640 1 --2- 172.21.15.6:0/1741075260 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7f0070b70 0x7fd7f01545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:35.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.914+0000 7fd7ee59c640 1 -- 172.21.15.6:0/1741075260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e8009a70 con 0x7fd7f006b1e0 2023-07-21T22:55:35.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.914+0000 7fd7ee59c640 1 --2- 172.21.15.6:0/1741075260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f006b1e0 0x7fd7f00cc090 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fd7e000d800 tx=0x7fd7e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:35.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.914+0000 7fd7e6ffd640 1 -- 172.21.15.6:0/1741075260 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e000b6c0 con 0x7fd7f006b1e0 2023-07-21T22:55:35.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.914+0000 7fd7e6ffd640 1 -- 172.21.15.6:0/1741075260 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e000b820 con 0x7fd7f006b1e0 2023-07-21T22:55:35.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.914+0000 7fd7e6ffd640 1 -- 172.21.15.6:0/1741075260 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e000bb90 con 0x7fd7f006b1e0 2023-07-21T22:55:35.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.914+0000 7fd7f4b82640 1 -- 172.21.15.6:0/1741075260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f00ccf50 con 0x7fd7f006b1e0 2023-07-21T22:55:35.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.914+0000 7fd7f4b82640 1 -- 172.21.15.6:0/1741075260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f00cc5d0 con 0x7fd7f006b1e0 2023-07-21T22:55:35.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.914+0000 7fd7f4b82640 1 -- 172.21.15.6:0/1741075260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f00678d0 con 0x7fd7f006b1e0 2023-07-21T22:55:35.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.914+0000 7fd7e6ffd640 1 -- 172.21.15.6:0/1741075260 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd7e000bcf0 con 0x7fd7f006b1e0 2023-07-21T22:55:35.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.918+0000 7fd7e6ffd640 1 --2- 172.21.15.6:0/1741075260 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fd7d00663a0 0x7fd7d0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:35.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.918+0000 7fd7e6ffd640 1 -- 172.21.15.6:0/1741075260 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5282+0+0 (secure 0 0 0) 0x7fd7e00841d0 con 0x7fd7f006b1e0 2023-07-21T22:55:35.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.918+0000 7fd7e7fff640 1 --2- 172.21.15.6:0/1741075260 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fd7d00663a0 0x7fd7d0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:35.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.918+0000 7fd7e7fff640 1 --2- 172.21.15.6:0/1741075260 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fd7d00663a0 0x7fd7d0068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd7f014e820 tx=0x7fd7d8009040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:35.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:35.918+0000 7fd7e6ffd640 1 -- 172.21.15.6:0/1741075260 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd7e0055230 con 0x7fd7f006b1e0 2023-07-21T22:55:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.130+0000 7fd7f4b82640 1 -- 172.21.15.6:0/1741075260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd7f00c98c0 con 0x7fd7f006b1e0 2023-07-21T22:55:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.130+0000 7fd7e6ffd640 1 -- 172.21.15.6:0/1741075260 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v28) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd7e0054dc0 con 0x7fd7f006b1e0 2023-07-21T22:55:36.167 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:36.168 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:55:36.168 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-07-21T22:55:36.168 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:36.168 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-07-21T22:55:36.168 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkHn5HNxAADk0AaSGwZfEj3SwNvEm8hw==", 2023-07-21T22:55:36.168 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:55:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:55:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:55:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:55:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:55:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:55:36.169 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:36.170 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-07-21T22:55:36.170 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkQFvXCBAANxf0/I2RQcHy4iYiydjkcg==", 2023-07-21T22:55:36.170 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:55:36.170 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:55:36.170 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:55:36.170 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:55:36.170 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:55:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:55:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-07-21T22:55:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkYtGXAxAAy+RDDBSvc1FeZq+eg23tRA==", 2023-07-21T22:55:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:55:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:55:36.171 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:55:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:55:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:55:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:55:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-07-21T22:55:36.172 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkH+Y1EBAAl+qTqd+gFrB9LtJWwD5dgA==", 2023-07-21T22:55:36.173 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:55:36.173 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:55:36.173 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:55:36.173 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:55:36.173 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:55:36.173 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:36.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:55:36.174 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:36.174 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-07-21T22:55:36.174 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAKBLtkPwZrLBAAQHZECi2zHST1MKYgGoa/Iw==", 2023-07-21T22:55:36.174 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:55:36.174 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:55:36.174 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:55:36.174 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:55:36.175 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:36.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:55:36.175 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:36.175 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-07-21T22:55:36.175 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQANBLtkvwgwNBAApurMm8c3pSlX2r16Gli/Ag==", 2023-07-21T22:55:36.175 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:55:36.175 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:55:36.175 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:55:36.176 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:55:36.176 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:36.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:55:36.176 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:36.177 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-07-21T22:55:36.177 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAQBLtkf2p1OxAAcKYw2RixFefYAwcfkGnOKQ==", 2023-07-21T22:55:36.177 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:55:36.177 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:55:36.177 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:55:36.177 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:55:36.177 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:55:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-07-21T22:55:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAUBLtkQUl6BhAAXXT1ZK1h9aZEcp6qIHsLiA==", 2023-07-21T22:55:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:55:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:55:36.178 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:55:36.179 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:55:36.179 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:36.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:55:36.179 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:36.179 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-07-21T22:55:36.179 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAaBLtkc1VfExAAPzDz2k/c0qVePG9h1saQCw==", 2023-07-21T22:55:36.180 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:55:36.180 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:55:36.180 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:55:36.180 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:55:36.180 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:36.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:55:36.180 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:36.181 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-07-21T22:55:36.181 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAdBLtkJ6fcGhAAglVSJIQS04WYBv4APhl57g==", 2023-07-21T22:55:36.181 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:55:36.181 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:55:36.182 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:55:36.182 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:55:36.182 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:36.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:55:36.182 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:36.182 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-07-21T22:55:36.182 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAgBLtkPINGIRAAWKs1RNQIdhZYlDAzDgUkNw==", 2023-07-21T22:55:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:55:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:55:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:55:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:55:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:55:36.183 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:36.184 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-07-21T22:55:36.184 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAjBLtk83MCKBAAZH2NhMBphVv4QkRzy+NDgg==", 2023-07-21T22:55:36.184 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:55:36.184 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:55:36.184 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:55:36.184 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:55:36.184 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:36.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:55:36.185 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:36.185 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-07-21T22:55:36.186 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA==", 2023-07-21T22:55:36.186 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:55:36.186 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:55:36.186 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-07-21T22:55:36.186 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-21T22:55:36.186 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:36.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:55:36.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:36.187 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-07-21T22:55:36.187 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkPVXTHhAAYmkzwAvqsfrowpAucTnlUQ==", 2023-07-21T22:55:36.187 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:55:36.187 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:55:36.187 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:55:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:55:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:55:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:55:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-07-21T22:55:36.188 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkd7wSGxAArvSYwe+k48vgRzb3fQAEAQ==", 2023-07-21T22:55:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:55:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:55:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:55:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:55:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:55:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:55:36.189 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-07-21T22:55:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkoZ4YJRAAX4yh0Q1pR4wY7yEV6kg9QA==", 2023-07-21T22:55:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:55:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:55:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:55:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:55:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:55:36.190 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:55:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-07-21T22:55:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtk0ILFGhAAQZ+8lGNFVdOtZYOuLlfkoQ==", 2023-07-21T22:55:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:55:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:55:36.191 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:55:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:55:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:55:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:55:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-07-21T22:55:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkdobtMhAAQbwi3cvsrW9P0t3d52oEKw==", 2023-07-21T22:55:36.192 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:55:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:55:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T22:55:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:55:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:55:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-07-21T22:55:36.193 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkHhzpLhAAZTx4Vrc0Htk88104SzuAxQ==", 2023-07-21T22:55:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:55:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:55:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T22:55:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:55:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-07-21T22:55:36.195 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:55:36.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.130+0000 7fd7f4b82640 1 -- 172.21.15.6:0/1741075260 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fd7d00663a0 msgr2=0x7fd7d0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:36.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.130+0000 7fd7f4b82640 1 --2- 172.21.15.6:0/1741075260 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fd7d00663a0 0x7fd7d0068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd7f014e820 tx=0x7fd7d8009040 comp rx=0 tx=0).stop 2023-07-21T22:55:36.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.130+0000 7fd7f4b82640 1 -- 172.21.15.6:0/1741075260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f006b1e0 msgr2=0x7fd7f00cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:36.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.130+0000 7fd7f4b82640 1 --2- 172.21.15.6:0/1741075260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f006b1e0 0x7fd7f00cc090 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fd7e000d800 tx=0x7fd7e000dcc0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.130+0000 7fd7f4b82640 1 -- 172.21.15.6:0/1741075260 shutdown_connections 2023-07-21T22:55:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.130+0000 7fd7f4b82640 1 --2- 172.21.15.6:0/1741075260 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fd7d00663a0 0x7fd7d0068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.130+0000 7fd7f4b82640 1 --2- 172.21.15.6:0/1741075260 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7f00cb100 0x7fd7f01467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.130+0000 7fd7f4b82640 1 --2- 172.21.15.6:0/1741075260 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7f0070b70 0x7fd7f01545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.130+0000 7fd7f4b82640 1 --2- 172.21.15.6:0/1741075260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f006b1e0 0x7fd7f00cc090 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.130+0000 7fd7f4b82640 1 -- 172.21.15.6:0/1741075260 >> 172.21.15.6:0/1741075260 conn(0x7fd7f00afcf0 msgr2=0x7fd7f00c3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.130+0000 7fd7f4b82640 1 -- 172.21.15.6:0/1741075260 shutdown_connections 2023-07-21T22:55:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.130+0000 7fd7f4b82640 1 -- 172.21.15.6:0/1741075260 wait complete. 2023-07-21T22:55:36.198 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:55:36.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.306+0000 7ff17e848640 1 Processor -- start 2023-07-21T22:55:36.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.306+0000 7ff17e848640 1 -- start start 2023-07-21T22:55:36.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.306+0000 7ff17e848640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff178158ce0 0x7ff178070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:36.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.306+0000 7ff17e848640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1780c9730 0x7ff1780ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:36.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.306+0000 7ff17e848640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1780cc700 con 0x7ff1780c8ad0 2023-07-21T22:55:36.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.306+0000 7ff17e848640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1780b0ff0 con 0x7ff178158ce0 2023-07-21T22:55:36.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.306+0000 7ff17e848640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff178070c80 con 0x7ff1780c9730 2023-07-21T22:55:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.306+0000 7ff17cde5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1780c9730 0x7ff1780ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.306+0000 7ff177fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff178158ce0 0x7ff178070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:36.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.306+0000 7ff17cde5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1780c9730 0x7ff1780ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:37398/0 (socket says 172.21.15.6:37398) 2023-07-21T22:55:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.306+0000 7ff17cde5640 1 -- 172.21.15.6:0/3348228075 learned_addr learned my addr 172.21.15.6:0/3348228075 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.306+0000 7ff1777fe640 1 --1- 172.21.15.6:0/3348228075 >> v1:172.21.15.161:6789/0 conn(0x7ff1780c8ad0 0x7ff1780c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:38162/0 (socket says 172.21.15.6:38162) 2023-07-21T22:55:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.306+0000 7ff177fff640 1 -- 172.21.15.6:0/3348228075 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1780c9730 msgr2=0x7ff1780ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.306+0000 7ff177fff640 1 --2- 172.21.15.6:0/3348228075 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1780c9730 0x7ff1780ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.306+0000 7ff177fff640 1 -- 172.21.15.6:0/3348228075 >> v1:172.21.15.161:6789/0 conn(0x7ff1780c8ad0 legacy=0x7ff1780c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:36.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.306+0000 7ff177fff640 1 -- 172.21.15.6:0/3348228075 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1780cbdd0 con 0x7ff178158ce0 2023-07-21T22:55:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.306+0000 7ff176ffd640 1 -- 172.21.15.6:0/3348228075 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572919939 0 0) 0x7ff1780cc700 con 0x7ff1780c8ad0 2023-07-21T22:55:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.306+0000 7ff17cde5640 1 --2- 172.21.15.6:0/3348228075 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1780c9730 0x7ff1780ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:55:36.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.310+0000 7ff177fff640 1 --2- 172.21.15.6:0/3348228075 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff178158ce0 0x7ff178070450 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff1680097c0 tx=0x7ff16801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdbfe5668bdfdb32 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:36.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.310+0000 7ff176ffd640 1 -- 172.21.15.6:0/3348228075 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff168004230 con 0x7ff178158ce0 2023-07-21T22:55:36.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.310+0000 7ff176ffd640 1 -- 172.21.15.6:0/3348228075 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1680a7050 con 0x7ff178158ce0 2023-07-21T22:55:36.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.310+0000 7ff176ffd640 1 -- 172.21.15.6:0/3348228075 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff168003620 con 0x7ff178158ce0 2023-07-21T22:55:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.310+0000 7ff17e848640 1 -- 172.21.15.6:0/3348228075 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff178158ce0 msgr2=0x7ff178070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.310+0000 7ff17e848640 1 --2- 172.21.15.6:0/3348228075 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff178158ce0 0x7ff178070450 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff1680097c0 tx=0x7ff16801c330 comp rx=0 tx=0).stop 2023-07-21T22:55:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.310+0000 7ff17e848640 1 -- 172.21.15.6:0/3348228075 shutdown_connections 2023-07-21T22:55:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.310+0000 7ff17e848640 1 --2- 172.21.15.6:0/3348228075 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1780c9730 0x7ff1780ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.310+0000 7ff17e848640 1 --2- 172.21.15.6:0/3348228075 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff178158ce0 0x7ff178070450 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.310+0000 7ff17e848640 1 -- 172.21.15.6:0/3348228075 >> 172.21.15.6:0/3348228075 conn(0x7ff1780afcf0 msgr2=0x7ff1780b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.310+0000 7ff17e848640 1 -- 172.21.15.6:0/3348228075 shutdown_connections 2023-07-21T22:55:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.310+0000 7ff17e848640 1 -- 172.21.15.6:0/3348228075 wait complete. 2023-07-21T22:55:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff17e848640 1 Processor -- start 2023-07-21T22:55:36.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff17e848640 1 -- start start 2023-07-21T22:55:36.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff17e848640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1780c8ad0 0x7ff178159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:36.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff17e848640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1780c9730 0x7ff178159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:36.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff17e848640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff178158ce0 0x7ff17815afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:36.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff17e848640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17814cbb0 con 0x7ff178158ce0 2023-07-21T22:55:36.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff17e848640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1781380d0 con 0x7ff1780c9730 2023-07-21T22:55:36.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff17e848640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff178136060 con 0x7ff1780c8ad0 2023-07-21T22:55:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff17cde5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff178158ce0 0x7ff17815afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff17cde5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff178158ce0 0x7ff17815afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37786/0 (socket says 172.21.15.6:37786) 2023-07-21T22:55:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff17cde5640 1 -- 172.21.15.6:0/651000486 learned_addr learned my addr 172.21.15.6:0/651000486 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff177fff640 1 --2- 172.21.15.6:0/651000486 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1780c8ad0 0x7ff178159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff1777fe640 1 --2- 172.21.15.6:0/651000486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1780c9730 0x7ff178159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff17cde5640 1 -- 172.21.15.6:0/651000486 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1780c8ad0 msgr2=0x7ff178159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:36.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff17cde5640 1 --2- 172.21.15.6:0/651000486 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1780c8ad0 0x7ff178159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff17cde5640 1 -- 172.21.15.6:0/651000486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1780c9730 msgr2=0x7ff178159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:36.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff17cde5640 1 --2- 172.21.15.6:0/651000486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1780c9730 0x7ff178159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff17cde5640 1 -- 172.21.15.6:0/651000486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17000bd40 con 0x7ff178158ce0 2023-07-21T22:55:36.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff17cde5640 1 --2- 172.21.15.6:0/651000486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff178158ce0 0x7ff17815afc0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7ff17000e110 tx=0x7ff17000e5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:36.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff174ff9640 1 -- 172.21.15.6:0/651000486 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170019070 con 0x7ff178158ce0 2023-07-21T22:55:36.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff174ff9640 1 -- 172.21.15.6:0/651000486 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff170011040 con 0x7ff178158ce0 2023-07-21T22:55:36.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff174ff9640 1 -- 172.21.15.6:0/651000486 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170010050 con 0x7ff178158ce0 2023-07-21T22:55:36.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff17e848640 1 -- 172.21.15.6:0/651000486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff168009420 con 0x7ff178158ce0 2023-07-21T22:55:36.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.314+0000 7ff17e848640 1 -- 172.21.15.6:0/651000486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff178136620 con 0x7ff178158ce0 2023-07-21T22:55:36.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.318+0000 7ff17e848640 1 -- 172.21.15.6:0/651000486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1780ca1a0 con 0x7ff178158ce0 2023-07-21T22:55:36.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.318+0000 7ff174ff9640 1 -- 172.21.15.6:0/651000486 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff170009600 con 0x7ff178158ce0 2023-07-21T22:55:36.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.318+0000 7ff174ff9640 1 --2- 172.21.15.6:0/651000486 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7ff1640663a0 0x7ff164068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:36.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.318+0000 7ff174ff9640 1 -- 172.21.15.6:0/651000486 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5282+0+0 (secure 0 0 0) 0x7ff170085d20 con 0x7ff178158ce0 2023-07-21T22:55:36.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.318+0000 7ff177fff640 1 --2- 172.21.15.6:0/651000486 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7ff1640663a0 0x7ff164068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:36.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.322+0000 7ff177fff640 1 --2- 172.21.15.6:0/651000486 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7ff1640663a0 0x7ff164068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff1680ad000 tx=0x7ff1680a6000 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:36.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.322+0000 7ff174ff9640 1 -- 172.21.15.6:0/651000486 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff17008c080 con 0x7ff178158ce0 2023-07-21T22:55:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.482+0000 7ff17e848640 1 -- 172.21.15.6:0/651000486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1780678d0 con 0x7ff178158ce0 2023-07-21T22:55:36.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.482+0000 7ff174ff9640 1 -- 172.21.15.6:0/651000486 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+14692 (secure 0 0 0) 0x7ff170053320 con 0x7ff178158ce0 2023-07-21T22:55:36.519 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:36.520 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":170,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:55:35.722921+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:55:36.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.482+0000 7ff17e848640 1 -- 172.21.15.6:0/651000486 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7ff1640663a0 msgr2=0x7ff164068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:36.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.482+0000 7ff17e848640 1 --2- 172.21.15.6:0/651000486 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7ff1640663a0 0x7ff164068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff1680ad000 tx=0x7ff1680a6000 comp rx=0 tx=0).stop 2023-07-21T22:55:36.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.482+0000 7ff17e848640 1 -- 172.21.15.6:0/651000486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff178158ce0 msgr2=0x7ff17815afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:36.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.482+0000 7ff17e848640 1 --2- 172.21.15.6:0/651000486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff178158ce0 0x7ff17815afc0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7ff17000e110 tx=0x7ff17000e5d0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.482+0000 7ff17e848640 1 -- 172.21.15.6:0/651000486 shutdown_connections 2023-07-21T22:55:36.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.482+0000 7ff17e848640 1 --2- 172.21.15.6:0/651000486 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7ff1640663a0 0x7ff164068850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.482+0000 7ff17e848640 1 --2- 172.21.15.6:0/651000486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff178158ce0 0x7ff17815afc0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.482+0000 7ff17e848640 1 --2- 172.21.15.6:0/651000486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1780c9730 0x7ff178159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.482+0000 7ff17e848640 1 --2- 172.21.15.6:0/651000486 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff1780c8ad0 0x7ff178159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.482+0000 7ff17e848640 1 -- 172.21.15.6:0/651000486 >> 172.21.15.6:0/651000486 conn(0x7ff1780afcf0 msgr2=0x7ff1780ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:36.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.482+0000 7ff17e848640 1 -- 172.21.15.6:0/651000486 shutdown_connections 2023-07-21T22:55:36.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.482+0000 7ff17e848640 1 -- 172.21.15.6:0/651000486 wait complete. 2023-07-21T22:55:36.541 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:55:36.542 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:55:36.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.650+0000 7fbb3b59e640 1 Processor -- start 2023-07-21T22:55:36.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.650+0000 7fbb3b59e640 1 -- start start 2023-07-21T22:55:36.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.654+0000 7fbb3b59e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbb3c0cc960 0x7fbb3c0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:36.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.654+0000 7fbb3b59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbb3c0b1620 0x7fbb3c0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:36.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.654+0000 7fbb3b59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb3c160750 0x7fbb3c0b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:36.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.654+0000 7fbb3b59e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb3c0cf710 con 0x7fbb3c0cc960 2023-07-21T22:55:36.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.654+0000 7fbb3b59e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb3c0cd270 con 0x7fbb3c0b1620 2023-07-21T22:55:36.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.654+0000 7fbb3b59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0cf430 con 0x7fbb3c160750 2023-07-21T22:55:36.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.654+0000 7fbb3a59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbb3c0cc960 0x7fbb3c0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:36.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.654+0000 7fbb3a59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbb3c0cc960 0x7fbb3c0ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37796/0 (socket says 172.21.15.6:37796) 2023-07-21T22:55:36.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.654+0000 7fbb3a59c640 1 -- 172.21.15.6:0/4112903774 learned_addr learned my addr 172.21.15.6:0/4112903774 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.654+0000 7fbb33fff640 1 --2- 172.21.15.6:0/4112903774 >> v2:172.21.15.161:3300/0 conn(0x7fbb3c0b1620 0x7fbb3c0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.654+0000 7fbb3ad9d640 1 --2- 172.21.15.6:0/4112903774 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb3c160750 0x7fbb3c0b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.654+0000 7fbb3a59c640 1 -- 172.21.15.6:0/4112903774 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb3c160750 msgr2=0x7fbb3c0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.654+0000 7fbb3a59c640 1 --2- 172.21.15.6:0/4112903774 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb3c160750 0x7fbb3c0b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.654+0000 7fbb3a59c640 1 -- 172.21.15.6:0/4112903774 >> v2:172.21.15.161:3300/0 conn(0x7fbb3c0b1620 msgr2=0x7fbb3c0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:36.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.654+0000 7fbb3a59c640 1 --2- 172.21.15.6:0/4112903774 >> v2:172.21.15.161:3300/0 conn(0x7fbb3c0b1620 0x7fbb3c0ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.654+0000 7fbb3a59c640 1 -- 172.21.15.6:0/4112903774 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c15fc70 con 0x7fbb3c0cc960 2023-07-21T22:55:36.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.658+0000 7fbb3a59c640 1 --2- 172.21.15.6:0/4112903774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb3c0cc960 0x7fbb3c0ccd30 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c06ac10 tx=0x7fbb2c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06e2fc3224dfda7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.658+0000 7fbb39d9b640 1 -- 172.21.15.6:0/4112903774 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c0aa5f0 con 0x7fbb3c0cc960 2023-07-21T22:55:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.658+0000 7fbb39d9b640 1 -- 172.21.15.6:0/4112903774 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2c0aa750 con 0x7fbb3c0cc960 2023-07-21T22:55:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.658+0000 7fbb39d9b640 1 -- 172.21.15.6:0/4112903774 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c0aaae0 con 0x7fbb3c0cc960 2023-07-21T22:55:36.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.658+0000 7fbb3b59e640 1 -- 172.21.15.6:0/4112903774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb3c0cc960 msgr2=0x7fbb3c0ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:36.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.658+0000 7fbb3b59e640 1 --2- 172.21.15.6:0/4112903774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb3c0cc960 0x7fbb3c0ccd30 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c06ac10 tx=0x7fbb2c01c4d0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.658+0000 7fbb3b59e640 1 -- 172.21.15.6:0/4112903774 shutdown_connections 2023-07-21T22:55:36.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.658+0000 7fbb3b59e640 1 --2- 172.21.15.6:0/4112903774 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb3c160750 0x7fbb3c0b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.658+0000 7fbb3b59e640 1 --2- 172.21.15.6:0/4112903774 >> v2:172.21.15.161:3300/0 conn(0x7fbb3c0b1620 0x7fbb3c0ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.658+0000 7fbb3b59e640 1 --2- 172.21.15.6:0/4112903774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb3c0cc960 0x7fbb3c0ccd30 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.658+0000 7fbb3b59e640 1 -- 172.21.15.6:0/4112903774 >> 172.21.15.6:0/4112903774 conn(0x7fbb3c069f50 msgr2=0x7fbb3c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.658+0000 7fbb3b59e640 1 -- 172.21.15.6:0/4112903774 shutdown_connections 2023-07-21T22:55:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.658+0000 7fbb3b59e640 1 -- 172.21.15.6:0/4112903774 wait complete. 2023-07-21T22:55:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.658+0000 7fbb3b59e640 1 Processor -- start 2023-07-21T22:55:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.658+0000 7fbb3b59e640 1 -- start start 2023-07-21T22:55:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb3b59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb3c0b1620 0x7fbb3c156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb3b59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb3c0cc960 0x7fbb3c0b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb3b59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb3c160750 0x7fbb3c0b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb3b59e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0cb910 con 0x7fbb3c160750 2023-07-21T22:55:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb3b59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0cc470 con 0x7fbb3c0cc960 2023-07-21T22:55:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb3b59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c0c9790 con 0x7fbb3c0b1620 2023-07-21T22:55:36.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb3ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb3c160750 0x7fbb3c0b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:36.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb3ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb3c160750 0x7fbb3c0b2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37812/0 (socket says 172.21.15.6:37812) 2023-07-21T22:55:36.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb3ad9d640 1 -- 172.21.15.6:0/2621547041 learned_addr learned my addr 172.21.15.6:0/2621547041 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:36.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb3a59c640 1 --2- 172.21.15.6:0/2621547041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb3c0b1620 0x7fbb3c156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:36.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb33fff640 1 --2- 172.21.15.6:0/2621547041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb3c0cc960 0x7fbb3c0b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:36.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb3ad9d640 1 -- 172.21.15.6:0/2621547041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb3c0b1620 msgr2=0x7fbb3c156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:36.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb3ad9d640 1 --2- 172.21.15.6:0/2621547041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb3c0b1620 0x7fbb3c156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb3ad9d640 1 -- 172.21.15.6:0/2621547041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb3c0cc960 msgr2=0x7fbb3c0b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:36.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb3ad9d640 1 --2- 172.21.15.6:0/2621547041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb3c0cc960 0x7fbb3c0b2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb3ad9d640 1 -- 172.21.15.6:0/2621547041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c0094d0 con 0x7fbb3c160750 2023-07-21T22:55:36.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb3ad9d640 1 --2- 172.21.15.6:0/2621547041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb3c160750 0x7fbb3c0b2f80 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fbb34007e60 tx=0x7fbb3400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:36.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb32ffd640 1 -- 172.21.15.6:0/2621547041 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34014420 con 0x7fbb3c160750 2023-07-21T22:55:36.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb32ffd640 1 -- 172.21.15.6:0/2621547041 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb340145a0 con 0x7fbb3c160750 2023-07-21T22:55:36.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb32ffd640 1 -- 172.21.15.6:0/2621547041 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34014950 con 0x7fbb3c160750 2023-07-21T22:55:36.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb3b59e640 1 -- 172.21.15.6:0/2621547041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb3c0cbb40 con 0x7fbb3c160750 2023-07-21T22:55:36.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb3b59e640 1 -- 172.21.15.6:0/2621547041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3c0cc100 con 0x7fbb3c160750 2023-07-21T22:55:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb3b59e640 1 -- 172.21.15.6:0/2621547041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3c04e020 con 0x7fbb3c160750 2023-07-21T22:55:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.662+0000 7fbb32ffd640 1 -- 172.21.15.6:0/2621547041 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbb34014ab0 con 0x7fbb3c160750 2023-07-21T22:55:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.666+0000 7fbb32ffd640 1 --2- 172.21.15.6:0/2621547041 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbb1c0663a0 0x7fbb1c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.666+0000 7fbb32ffd640 1 -- 172.21.15.6:0/2621547041 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5282+0+0 (secure 0 0 0) 0x7fbb340842f0 con 0x7fbb3c160750 2023-07-21T22:55:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.666+0000 7fbb3a59c640 1 --2- 172.21.15.6:0/2621547041 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbb1c0663a0 0x7fbb1c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.666+0000 7fbb3a59c640 1 --2- 172.21.15.6:0/2621547041 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbb1c0663a0 0x7fbb1c068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c0ae000 tx=0x7fbb2c0b5040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.670+0000 7fbb32ffd640 1 -- 172.21.15.6:0/2621547041 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb340554a0 con 0x7fbb3c160750 2023-07-21T22:55:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.826+0000 7fbb3b59e640 1 -- 172.21.15.6:0/2621547041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb3c0cfad0 con 0x7fbb3c160750 2023-07-21T22:55:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.826+0000 7fbb32ffd640 1 -- 172.21.15.6:0/2621547041 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v170) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb34055030 con 0x7fbb3c160750 2023-07-21T22:55:36.863 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:55:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.826+0000 7fbb3b59e640 1 -- 172.21.15.6:0/2621547041 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbb1c0663a0 msgr2=0x7fbb1c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.826+0000 7fbb3b59e640 1 --2- 172.21.15.6:0/2621547041 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbb1c0663a0 0x7fbb1c068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c0ae000 tx=0x7fbb2c0b5040 comp rx=0 tx=0).stop 2023-07-21T22:55:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.826+0000 7fbb3b59e640 1 -- 172.21.15.6:0/2621547041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb3c160750 msgr2=0x7fbb3c0b2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.826+0000 7fbb3b59e640 1 --2- 172.21.15.6:0/2621547041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb3c160750 0x7fbb3c0b2f80 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fbb34007e60 tx=0x7fbb3400e4b0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.826+0000 7fbb3b59e640 1 -- 172.21.15.6:0/2621547041 shutdown_connections 2023-07-21T22:55:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.826+0000 7fbb3b59e640 1 --2- 172.21.15.6:0/2621547041 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbb1c0663a0 0x7fbb1c068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.826+0000 7fbb3b59e640 1 --2- 172.21.15.6:0/2621547041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb3c160750 0x7fbb3c0b2f80 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.826+0000 7fbb3b59e640 1 --2- 172.21.15.6:0/2621547041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbb3c0cc960 0x7fbb3c0b2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.826+0000 7fbb3b59e640 1 --2- 172.21.15.6:0/2621547041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbb3c0b1620 0x7fbb3c156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.826+0000 7fbb3b59e640 1 -- 172.21.15.6:0/2621547041 >> 172.21.15.6:0/2621547041 conn(0x7fbb3c069f50 msgr2=0x7fbb3c0b7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.826+0000 7fbb3b59e640 1 -- 172.21.15.6:0/2621547041 shutdown_connections 2023-07-21T22:55:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.826+0000 7fbb3b59e640 1 -- 172.21.15.6:0/2621547041 wait complete. 2023-07-21T22:55:36.884 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:55:37.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.994+0000 7fee6b9c5640 1 Processor -- start 2023-07-21T22:55:37.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.994+0000 7fee6b9c5640 1 -- start start 2023-07-21T22:55:37.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.994+0000 7fee6b9c5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fee64155c60 0x7fee6406b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:37.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.994+0000 7fee6b9c5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee641594f0 con 0x7fee640adb40 2023-07-21T22:55:37.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.994+0000 7fee6b9c5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee64158970 con 0x7fee640adfb0 2023-07-21T22:55:37.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.994+0000 7fee6b9c5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee64158c50 con 0x7fee64155c60 2023-07-21T22:55:37.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.998+0000 7fee69761640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fee64155c60 0x7fee6406b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:37.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.998+0000 7fee69761640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fee64155c60 0x7fee6406b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37828/0 (socket says 172.21.15.6:37828) 2023-07-21T22:55:37.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.998+0000 7fee69761640 1 -- 172.21.15.6:0/1767262741 learned_addr learned my addr 172.21.15.6:0/1767262741 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:37.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.998+0000 7fee68f60640 1 --1- 172.21.15.6:0/1767262741 >> v1:172.21.15.6:6789/0 conn(0x7fee640adb40 0x7fee640b1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58918/0 (socket says 172.21.15.6:58918) 2023-07-21T22:55:37.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.998+0000 7fee69761640 1 -- 172.21.15.6:0/1767262741 >> v1:172.21.15.161:6789/0 conn(0x7fee640adfb0 legacy=0x7fee6406a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:37.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.998+0000 7fee69761640 1 -- 172.21.15.6:0/1767262741 >> v1:172.21.15.6:6789/0 conn(0x7fee640adb40 legacy=0x7fee640b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:37.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.998+0000 7fee69761640 1 -- 172.21.15.6:0/1767262741 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee64158f30 con 0x7fee64155c60 2023-07-21T22:55:37.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.998+0000 7fee69761640 1 --2- 172.21.15.6:0/1767262741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee64155c60 0x7fee6406b8c0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fee60009870 tx=0x7fee6001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b8c497f603f763 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:37.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.998+0000 7fee5bfff640 1 -- 172.21.15.6:0/1767262741 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee600ab600 con 0x7fee64155c60 2023-07-21T22:55:37.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.998+0000 7fee5bfff640 1 -- 172.21.15.6:0/1767262741 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee600a7050 con 0x7fee64155c60 2023-07-21T22:55:37.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:36.998+0000 7fee5bfff640 1 -- 172.21.15.6:0/1767262741 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee600ab980 con 0x7fee64155c60 2023-07-21T22:55:37.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee6b9c5640 1 -- 172.21.15.6:0/1767262741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee64155c60 msgr2=0x7fee6406b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:37.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee6b9c5640 1 --2- 172.21.15.6:0/1767262741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee64155c60 0x7fee6406b8c0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fee60009870 tx=0x7fee6001c500 comp rx=0 tx=0).stop 2023-07-21T22:55:37.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee6b9c5640 1 -- 172.21.15.6:0/1767262741 shutdown_connections 2023-07-21T22:55:37.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee6b9c5640 1 --2- 172.21.15.6:0/1767262741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee64155c60 0x7fee6406b8c0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee6b9c5640 1 -- 172.21.15.6:0/1767262741 >> 172.21.15.6:0/1767262741 conn(0x7fee640b1210 msgr2=0x7fee640ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:37.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee6b9c5640 1 -- 172.21.15.6:0/1767262741 shutdown_connections 2023-07-21T22:55:37.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee6b9c5640 1 -- 172.21.15.6:0/1767262741 wait complete. 2023-07-21T22:55:37.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee6b9c5640 1 Processor -- start 2023-07-21T22:55:37.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee6b9c5640 1 -- start start 2023-07-21T22:55:37.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee6b9c5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee640adb40 0x7fee6413ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:37.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee6b9c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee640adfb0 0x7fee6413e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:37.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee6b9c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee64155c60 0x7fee6406beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:37.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee6b9c5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee640ab920 con 0x7fee640adfb0 2023-07-21T22:55:37.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee6b9c5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee640af970 con 0x7fee640adb40 2023-07-21T22:55:37.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee6b9c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee640afc50 con 0x7fee64155c60 2023-07-21T22:55:37.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee68f60640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee640adfb0 0x7fee6413e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:37.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee68f60640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee640adfb0 0x7fee6413e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37844/0 (socket says 172.21.15.6:37844) 2023-07-21T22:55:37.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee68f60640 1 -- 172.21.15.6:0/2706966138 learned_addr learned my addr 172.21.15.6:0/2706966138 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:37.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee68f60640 1 -- 172.21.15.6:0/2706966138 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee64155c60 msgr2=0x7fee6406beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:37.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee68f60640 1 --2- 172.21.15.6:0/2706966138 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee64155c60 0x7fee6406beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee68f60640 1 -- 172.21.15.6:0/2706966138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee640adb40 msgr2=0x7fee6413ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:37.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee69761640 1 --2- 172.21.15.6:0/2706966138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee640adb40 0x7fee6413ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:37.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee68f60640 1 --2- 172.21.15.6:0/2706966138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee640adb40 0x7fee6413ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee68f60640 1 -- 172.21.15.6:0/2706966138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee600094d0 con 0x7fee640adfb0 2023-07-21T22:55:37.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.002+0000 7fee69761640 1 --2- 172.21.15.6:0/2706966138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee640adb40 0x7fee6413ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:55:37.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.006+0000 7fee68f60640 1 --2- 172.21.15.6:0/2706966138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee640adfb0 0x7fee6413e880 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fee5400c490 tx=0x7fee5400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:37.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.006+0000 7fee59ffb640 1 -- 172.21.15.6:0/2706966138 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54007480 con 0x7fee640adfb0 2023-07-21T22:55:37.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.006+0000 7fee59ffb640 1 -- 172.21.15.6:0/2706966138 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee540075e0 con 0x7fee640adfb0 2023-07-21T22:55:37.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.006+0000 7fee59ffb640 1 -- 172.21.15.6:0/2706966138 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54004a10 con 0x7fee640adfb0 2023-07-21T22:55:37.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.006+0000 7fee6b9c5640 1 -- 172.21.15.6:0/2706966138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee640aff30 con 0x7fee640adfb0 2023-07-21T22:55:37.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.006+0000 7fee6b9c5640 1 -- 172.21.15.6:0/2706966138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee640af590 con 0x7fee640adfb0 2023-07-21T22:55:37.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.006+0000 7fee6b9c5640 1 -- 172.21.15.6:0/2706966138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee64163700 con 0x7fee640adfb0 2023-07-21T22:55:37.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.006+0000 7fee59ffb640 1 -- 172.21.15.6:0/2706966138 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fee54004b70 con 0x7fee640adfb0 2023-07-21T22:55:37.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.006+0000 7fee59ffb640 1 --2- 172.21.15.6:0/2706966138 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fee480663a0 0x7fee48068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:37.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.006+0000 7fee59ffb640 1 -- 172.21.15.6:0/2706966138 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5282+0+0 (secure 0 0 0) 0x7fee54082cd0 con 0x7fee640adfb0 2023-07-21T22:55:37.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.010+0000 7fee69761640 1 --2- 172.21.15.6:0/2706966138 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fee480663a0 0x7fee48068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:37.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.010+0000 7fee69761640 1 --2- 172.21.15.6:0/2706966138 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fee480663a0 0x7fee48068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fee600ad000 tx=0x7fee60008040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:37.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.010+0000 7fee59ffb640 1 -- 172.21.15.6:0/2706966138 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee540503b0 con 0x7fee640adfb0 2023-07-21T22:55:37.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.166+0000 7fee6b9c5640 1 -- 172.21.15.6:0/2706966138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fee640678d0 con 0x7fee640adfb0 2023-07-21T22:55:37.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.166+0000 7fee59ffb640 1 -- 172.21.15.6:0/2706966138 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v170) v1 ==== 92+0+10 (secure 0 0 0) 0x7fee540180a0 con 0x7fee640adfb0 2023-07-21T22:55:37.205 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:55:37.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.170+0000 7fee6b9c5640 1 -- 172.21.15.6:0/2706966138 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fee480663a0 msgr2=0x7fee48068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:37.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.170+0000 7fee6b9c5640 1 --2- 172.21.15.6:0/2706966138 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fee480663a0 0x7fee48068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fee600ad000 tx=0x7fee60008040 comp rx=0 tx=0).stop 2023-07-21T22:55:37.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.170+0000 7fee6b9c5640 1 -- 172.21.15.6:0/2706966138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee640adfb0 msgr2=0x7fee6413e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.170+0000 7fee6b9c5640 1 --2- 172.21.15.6:0/2706966138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee640adfb0 0x7fee6413e880 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fee5400c490 tx=0x7fee5400c950 comp rx=0 tx=0).stop 2023-07-21T22:55:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.170+0000 7fee6b9c5640 1 -- 172.21.15.6:0/2706966138 shutdown_connections 2023-07-21T22:55:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.170+0000 7fee6b9c5640 1 --2- 172.21.15.6:0/2706966138 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fee480663a0 0x7fee48068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.170+0000 7fee6b9c5640 1 --2- 172.21.15.6:0/2706966138 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fee64155c60 0x7fee6406beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.170+0000 7fee6b9c5640 1 --2- 172.21.15.6:0/2706966138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee640adfb0 0x7fee6413e880 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.170+0000 7fee6b9c5640 1 --2- 172.21.15.6:0/2706966138 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fee640adb40 0x7fee6413ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.170+0000 7fee6b9c5640 1 -- 172.21.15.6:0/2706966138 >> 172.21.15.6:0/2706966138 conn(0x7fee640b1210 msgr2=0x7fee6414bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.170+0000 7fee6b9c5640 1 -- 172.21.15.6:0/2706966138 shutdown_connections 2023-07-21T22:55:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.170+0000 7fee6b9c5640 1 -- 172.21.15.6:0/2706966138 wait complete. 2023-07-21T22:55:37.226 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T22:55:37.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.334+0000 7f5a9fe0b640 1 Processor -- start 2023-07-21T22:55:37.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.334+0000 7f5a9fe0b640 1 -- start start 2023-07-21T22:55:37.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.334+0000 7f5a9fe0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a980ae1f0 0x7f5a980b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:37.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.334+0000 7f5a9fe0b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5a9806e160 0x7f5a9806bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:37.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.334+0000 7f5a9fe0b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9806a440 con 0x7f5a9806c260 2023-07-21T22:55:37.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.334+0000 7f5a9fe0b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9806c680 con 0x7f5a9806e160 2023-07-21T22:55:37.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.334+0000 7f5a9fe0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a980b24f0 con 0x7f5a980ae1f0 2023-07-21T22:55:37.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.334+0000 7f5a9d3a6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5a9806e160 0x7f5a9806bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:37.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.334+0000 7f5a9d3a6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5a9806e160 0x7f5a9806bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37854/0 (socket says 172.21.15.6:37854) 2023-07-21T22:55:37.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.334+0000 7f5a9d3a6640 1 -- 172.21.15.6:0/2792221799 learned_addr learned my addr 172.21.15.6:0/2792221799 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:37.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.338+0000 7f5a9dba7640 1 --2- 172.21.15.6:0/2792221799 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a980ae1f0 0x7f5a980b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:37.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.338+0000 7f5a9d3a6640 1 -- 172.21.15.6:0/2792221799 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a980ae1f0 msgr2=0x7f5a980b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:37.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.338+0000 7f5a9d3a6640 1 --2- 172.21.15.6:0/2792221799 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a980ae1f0 0x7f5a980b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.338+0000 7f5a9d3a6640 1 -- 172.21.15.6:0/2792221799 >> v1:172.21.15.6:6789/0 conn(0x7f5a9806c260 legacy=0x7f5a9815f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:37.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.338+0000 7f5a9d3a6640 1 -- 172.21.15.6:0/2792221799 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a980b27d0 con 0x7f5a9806e160 2023-07-21T22:55:37.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.338+0000 7f5a9d3a6640 1 --2- 172.21.15.6:0/2792221799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9806e160 0x7f5a9806bd20 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009870 tx=0x7f5a8801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2bc3b953d1f37a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:37.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.338+0000 7f5a9cba5640 1 -- 172.21.15.6:0/2792221799 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a880a7070 con 0x7f5a9806e160 2023-07-21T22:55:37.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.338+0000 7f5a9cba5640 1 -- 172.21.15.6:0/2792221799 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a880ab430 con 0x7f5a9806e160 2023-07-21T22:55:37.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.338+0000 7f5a9cba5640 1 -- 172.21.15.6:0/2792221799 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a880ab7c0 con 0x7f5a9806e160 2023-07-21T22:55:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.338+0000 7f5a9fe0b640 1 -- 172.21.15.6:0/2792221799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9806e160 msgr2=0x7f5a9806bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.338+0000 7f5a9fe0b640 1 --2- 172.21.15.6:0/2792221799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9806e160 0x7f5a9806bd20 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f5a88009870 tx=0x7f5a8801c510 comp rx=0 tx=0).stop 2023-07-21T22:55:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9fe0b640 1 -- 172.21.15.6:0/2792221799 shutdown_connections 2023-07-21T22:55:37.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9fe0b640 1 --2- 172.21.15.6:0/2792221799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9806e160 0x7f5a9806bd20 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9fe0b640 1 --2- 172.21.15.6:0/2792221799 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a980ae1f0 0x7f5a980b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9fe0b640 1 -- 172.21.15.6:0/2792221799 >> 172.21.15.6:0/2792221799 conn(0x7f5a980b1300 msgr2=0x7f5a980ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:37.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9fe0b640 1 -- 172.21.15.6:0/2792221799 shutdown_connections 2023-07-21T22:55:37.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9fe0b640 1 -- 172.21.15.6:0/2792221799 wait complete. 2023-07-21T22:55:37.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9fe0b640 1 Processor -- start 2023-07-21T22:55:37.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9fe0b640 1 -- start start 2023-07-21T22:55:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9fe0b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9806c260 0x7f5a9815b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9fe0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a9806e160 0x7f5a9815ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9fe0b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a980ae1f0 0x7f5a98143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9fe0b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9815fae0 con 0x7f5a9806c260 2023-07-21T22:55:37.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9fe0b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9815b580 con 0x7f5a980ae1f0 2023-07-21T22:55:37.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9fe0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9815f800 con 0x7f5a9806e160 2023-07-21T22:55:37.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9dba7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9806c260 0x7f5a9815b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:37.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9dba7640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9806c260 0x7f5a9815b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37858/0 (socket says 172.21.15.6:37858) 2023-07-21T22:55:37.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9dba7640 1 -- 172.21.15.6:0/3783290165 learned_addr learned my addr 172.21.15.6:0/3783290165 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9d3a6640 1 --2- 172.21.15.6:0/3783290165 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a9806e160 0x7f5a9815ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9dba7640 1 -- 172.21.15.6:0/3783290165 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a9806e160 msgr2=0x7f5a9815ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9dba7640 1 --2- 172.21.15.6:0/3783290165 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a9806e160 0x7f5a9815ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9dba7640 1 -- 172.21.15.6:0/3783290165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a980ae1f0 msgr2=0x7f5a98143530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9e3a8640 1 --2- 172.21.15.6:0/3783290165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a980ae1f0 0x7f5a98143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9dba7640 1 --2- 172.21.15.6:0/3783290165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a980ae1f0 0x7f5a98143530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9dba7640 1 -- 172.21.15.6:0/3783290165 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a880094d0 con 0x7f5a9806c260 2023-07-21T22:55:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9d3a6640 1 --2- 172.21.15.6:0/3783290165 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a9806e160 0x7f5a9815ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:55:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9e3a8640 1 --2- 172.21.15.6:0/3783290165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a980ae1f0 0x7f5a98143530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:55:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.342+0000 7f5a9dba7640 1 --2- 172.21.15.6:0/3783290165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9806c260 0x7f5a9815b040 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400d5f0 tx=0x7f5a9400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:37.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.346+0000 7f5a8e7fc640 1 -- 172.21.15.6:0/3783290165 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a940125f0 con 0x7f5a9806c260 2023-07-21T22:55:37.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.346+0000 7f5a8e7fc640 1 -- 172.21.15.6:0/3783290165 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a94012750 con 0x7f5a9806c260 2023-07-21T22:55:37.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.346+0000 7f5a8e7fc640 1 -- 172.21.15.6:0/3783290165 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a94012ae0 con 0x7f5a9806c260 2023-07-21T22:55:37.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.346+0000 7f5a9fe0b640 1 -- 172.21.15.6:0/3783290165 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a980cb4a0 con 0x7f5a9806c260 2023-07-21T22:55:37.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.346+0000 7f5a9fe0b640 1 -- 172.21.15.6:0/3783290165 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a980cba60 con 0x7f5a9806c260 2023-07-21T22:55:37.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.346+0000 7f5a9fe0b640 1 -- 172.21.15.6:0/3783290165 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a980678d0 con 0x7f5a9806c260 2023-07-21T22:55:37.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.346+0000 7f5a8e7fc640 1 -- 172.21.15.6:0/3783290165 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5a94012c40 con 0x7f5a9806c260 2023-07-21T22:55:37.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.346+0000 7f5a8e7fc640 1 --2- 172.21.15.6:0/3783290165 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f5a7c0663a0 0x7f5a7c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:37.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.346+0000 7f5a8e7fc640 1 -- 172.21.15.6:0/3783290165 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f5a94084120 con 0x7f5a9806c260 2023-07-21T22:55:37.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.346+0000 7f5a9d3a6640 1 --2- 172.21.15.6:0/3783290165 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f5a7c0663a0 0x7f5a7c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:37.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.350+0000 7f5a9d3a6640 1 --2- 172.21.15.6:0/3783290165 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f5a7c0663a0 0x7f5a7c068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5a880af000 tx=0x7f5a88008040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.350+0000 7f5a8e7fc640 1 -- 172.21.15.6:0/3783290165 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5a940516f0 con 0x7f5a9806c260 2023-07-21T22:55:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.510+0000 7f5a9fe0b640 1 -- 172.21.15.6:0/3783290165 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5a98066810 con 0x7f5a9806c260 2023-07-21T22:55:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.510+0000 7f5a8e7fc640 1 -- 172.21.15.6:0/3783290165 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v170) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5a94054d10 con 0x7f5a9806c260 2023-07-21T22:55:37.549 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:37.549 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:55:37.549 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:37.549 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-07-21T22:55:37.550 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-07-21T22:55:37.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:55:37.550 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:37.550 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-07-21T22:55:37.550 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-07-21T22:55:37.550 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:37.550 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:55:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.514+0000 7f5a9fe0b640 1 -- 172.21.15.6:0/3783290165 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f5a7c0663a0 msgr2=0x7f5a7c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.514+0000 7f5a9fe0b640 1 --2- 172.21.15.6:0/3783290165 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f5a7c0663a0 0x7f5a7c068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5a880af000 tx=0x7f5a88008040 comp rx=0 tx=0).stop 2023-07-21T22:55:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.514+0000 7f5a9fe0b640 1 -- 172.21.15.6:0/3783290165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9806c260 msgr2=0x7f5a9815b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.514+0000 7f5a9fe0b640 1 --2- 172.21.15.6:0/3783290165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9806c260 0x7f5a9815b040 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400d5f0 tx=0x7f5a9400dab0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.514+0000 7f5a9fe0b640 1 -- 172.21.15.6:0/3783290165 shutdown_connections 2023-07-21T22:55:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.514+0000 7f5a9fe0b640 1 --2- 172.21.15.6:0/3783290165 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f5a7c0663a0 0x7f5a7c068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.514+0000 7f5a9fe0b640 1 --2- 172.21.15.6:0/3783290165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5a980ae1f0 0x7f5a98143530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.514+0000 7f5a9fe0b640 1 --2- 172.21.15.6:0/3783290165 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5a9806e160 0x7f5a9815ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.514+0000 7f5a9fe0b640 1 --2- 172.21.15.6:0/3783290165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a9806c260 0x7f5a9815b040 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.514+0000 7f5a9fe0b640 1 -- 172.21.15.6:0/3783290165 >> 172.21.15.6:0/3783290165 conn(0x7f5a980b1300 msgr2=0x7f5a980cab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:37.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.514+0000 7f5a9fe0b640 1 -- 172.21.15.6:0/3783290165 shutdown_connections 2023-07-21T22:55:37.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.514+0000 7f5a9fe0b640 1 -- 172.21.15.6:0/3783290165 wait complete. 2023-07-21T22:55:37.570 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-21T22:55:37.570 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-21T22:55:37.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.682+0000 7f1707696640 1 Processor -- start 2023-07-21T22:55:37.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.682+0000 7f1707696640 1 -- start start 2023-07-21T22:55:37.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.682+0000 7f1707696640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f17000cf2e0 0x7f17000cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:37.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.682+0000 7f1707696640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17000ca790 0x7f17000cac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:37.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.682+0000 7f1707696640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17000d0920 con 0x7f170006a540 2023-07-21T22:55:37.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.682+0000 7f1707696640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170015bfd0 con 0x7f17000cf2e0 2023-07-21T22:55:37.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.682+0000 7f1707696640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17000cfd10 con 0x7f17000ca790 2023-07-21T22:55:37.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.682+0000 7f1705c33640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17000ca790 0x7f17000cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:37.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.682+0000 7f1704c31640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f17000cf2e0 0x7f17000cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:37.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.682+0000 7f1705c33640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17000ca790 0x7f17000cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:40364/0 (socket says 172.21.15.6:40364) 2023-07-21T22:55:37.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.682+0000 7f1705c33640 1 -- 172.21.15.6:0/1058671304 learned_addr learned my addr 172.21.15.6:0/1058671304 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:37.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.682+0000 7f1705c33640 1 -- 172.21.15.6:0/1058671304 >> v2:172.21.15.161:3300/0 conn(0x7f17000cf2e0 msgr2=0x7f17000cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:37.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.682+0000 7f1705c33640 1 --2- 172.21.15.6:0/1058671304 >> v2:172.21.15.161:3300/0 conn(0x7f17000cf2e0 0x7f17000cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.682+0000 7f1705c33640 1 -- 172.21.15.6:0/1058671304 >> v1:172.21.15.161:6789/0 conn(0x7f170006a540 legacy=0x7f170006a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:37.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.682+0000 7f1705c33640 1 -- 172.21.15.6:0/1058671304 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17000cfff0 con 0x7f17000ca790 2023-07-21T22:55:37.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.682+0000 7f1704c31640 1 --2- 172.21.15.6:0/1058671304 >> v2:172.21.15.161:3300/0 conn(0x7f17000cf2e0 0x7f17000cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:55:37.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.686+0000 7f1705c33640 1 --2- 172.21.15.6:0/1058671304 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17000ca790 0x7f17000cac00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009e50 tx=0x7f16f801c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e997c9af32189b54 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:37.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.686+0000 7f16f7fff640 1 -- 172.21.15.6:0/1058671304 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f80a58a0 con 0x7f17000ca790 2023-07-21T22:55:37.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.686+0000 7f16f7fff640 1 -- 172.21.15.6:0/1058671304 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f80a5a00 con 0x7f17000ca790 2023-07-21T22:55:37.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.686+0000 7f16f7fff640 1 -- 172.21.15.6:0/1058671304 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f80a5d90 con 0x7f17000ca790 2023-07-21T22:55:37.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.686+0000 7f1707696640 1 -- 172.21.15.6:0/1058671304 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17000ca790 msgr2=0x7f17000cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:37.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.686+0000 7f1707696640 1 --2- 172.21.15.6:0/1058671304 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17000ca790 0x7f17000cac00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009e50 tx=0x7f16f801c9e0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.686+0000 7f1707696640 1 -- 172.21.15.6:0/1058671304 shutdown_connections 2023-07-21T22:55:37.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.686+0000 7f1707696640 1 --2- 172.21.15.6:0/1058671304 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f17000ca790 0x7f17000cac00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.686+0000 7f1707696640 1 --2- 172.21.15.6:0/1058671304 >> v2:172.21.15.161:3300/0 conn(0x7f17000cf2e0 0x7f17000cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.686+0000 7f1707696640 1 -- 172.21.15.6:0/1058671304 >> 172.21.15.6:0/1058671304 conn(0x7f1700099490 msgr2=0x7f1700089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:37.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.686+0000 7f1707696640 1 -- 172.21.15.6:0/1058671304 shutdown_connections 2023-07-21T22:55:37.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.686+0000 7f1707696640 1 -- 172.21.15.6:0/1058671304 wait complete. 2023-07-21T22:55:37.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1707696640 1 Processor -- start 2023-07-21T22:55:37.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1707696640 1 -- start start 2023-07-21T22:55:37.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1707696640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f170006a540 0x7f170014e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1707696640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17000ca790 0x7f1700153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1707696640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17000cf2e0 0x7f1700158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1707696640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17001540e0 con 0x7f17000cf2e0 2023-07-21T22:55:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1707696640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1700153e00 con 0x7f17000ca790 2023-07-21T22:55:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1707696640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17000af400 con 0x7f170006a540 2023-07-21T22:55:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1705c33640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17000cf2e0 0x7f1700158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1705c33640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17000cf2e0 0x7f1700158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53594/0 (socket says 172.21.15.6:53594) 2023-07-21T22:55:37.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1705c33640 1 -- 172.21.15.6:0/384574512 learned_addr learned my addr 172.21.15.6:0/384574512 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1704c31640 1 --2- 172.21.15.6:0/384574512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17000ca790 0x7f1700153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1705432640 1 --2- 172.21.15.6:0/384574512 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f170006a540 0x7f170014e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1705c33640 1 -- 172.21.15.6:0/384574512 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f170006a540 msgr2=0x7f170014e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1705c33640 1 --2- 172.21.15.6:0/384574512 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f170006a540 0x7f170014e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1705c33640 1 -- 172.21.15.6:0/384574512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17000ca790 msgr2=0x7f1700153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:37.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1705c33640 1 --2- 172.21.15.6:0/384574512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17000ca790 0x7f1700153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:37.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1705c33640 1 -- 172.21.15.6:0/384574512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f0009420 con 0x7f17000cf2e0 2023-07-21T22:55:37.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1705c33640 1 --2- 172.21.15.6:0/384574512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17000cf2e0 0x7f1700158df0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f16f80af040 tx=0x7f16f8019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:37.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f16f5ffb640 1 -- 172.21.15.6:0/384574512 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f80b8670 con 0x7f17000cf2e0 2023-07-21T22:55:37.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f16f5ffb640 1 -- 172.21.15.6:0/384574512 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f80b87d0 con 0x7f17000cf2e0 2023-07-21T22:55:37.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f16f5ffb640 1 -- 172.21.15.6:0/384574512 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f80b8b60 con 0x7f17000cf2e0 2023-07-21T22:55:37.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1707696640 1 -- 172.21.15.6:0/384574512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f8009b30 con 0x7f17000cf2e0 2023-07-21T22:55:37.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.690+0000 7f1707696640 1 -- 172.21.15.6:0/384574512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17000af9c0 con 0x7f17000cf2e0 2023-07-21T22:55:37.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.694+0000 7f1707696640 1 -- 172.21.15.6:0/384574512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17000afbb0 con 0x7f17000cf2e0 2023-07-21T22:55:37.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.694+0000 7f16f5ffb640 1 -- 172.21.15.6:0/384574512 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f16f80b8cc0 con 0x7f17000cf2e0 2023-07-21T22:55:37.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.694+0000 7f16f5ffb640 1 --2- 172.21.15.6:0/384574512 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f16e40663a0 0x7f16e4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:37.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.694+0000 7f16f5ffb640 1 -- 172.21.15.6:0/384574512 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f16f811f100 con 0x7f17000cf2e0 2023-07-21T22:55:37.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.694+0000 7f1705432640 1 --2- 172.21.15.6:0/384574512 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f16e40663a0 0x7f16e4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:37.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.694+0000 7f1705432640 1 --2- 172.21.15.6:0/384574512 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f16e40663a0 0x7f16e4068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f16fc001770 tx=0x7f16fc009040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:37.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.698+0000 7f16f5ffb640 1 -- 172.21.15.6:0/384574512 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f16f80ec820 con 0x7f17000cf2e0 2023-07-21T22:55:37.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:37.858+0000 7f1707696640 1 -- 172.21.15.6:0/384574512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f17000678d0 con 0x7f17000cf2e0 2023-07-21T22:55:38.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.370+0000 7f16f5ffb640 1 -- 172.21.15.6:0/384574512 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v171) v1 ==== 138+0+0 (secure 0 0 0) 0x7f16f80efe40 con 0x7f17000cf2e0 2023-07-21T22:55:38.410 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-07-21T22:55:38.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.374+0000 7f1707696640 1 -- 172.21.15.6:0/384574512 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f16e40663a0 msgr2=0x7f16e4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:38.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.374+0000 7f1707696640 1 --2- 172.21.15.6:0/384574512 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f16e40663a0 0x7f16e4068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f16fc001770 tx=0x7f16fc009040 comp rx=0 tx=0).stop 2023-07-21T22:55:38.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.374+0000 7f1707696640 1 -- 172.21.15.6:0/384574512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17000cf2e0 msgr2=0x7f1700158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.374+0000 7f1707696640 1 --2- 172.21.15.6:0/384574512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17000cf2e0 0x7f1700158df0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f16f80af040 tx=0x7f16f8019780 comp rx=0 tx=0).stop 2023-07-21T22:55:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.374+0000 7f1707696640 1 -- 172.21.15.6:0/384574512 shutdown_connections 2023-07-21T22:55:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.374+0000 7f1707696640 1 --2- 172.21.15.6:0/384574512 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f16e40663a0 0x7f16e4068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.374+0000 7f1707696640 1 --2- 172.21.15.6:0/384574512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17000cf2e0 0x7f1700158df0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.374+0000 7f1707696640 1 --2- 172.21.15.6:0/384574512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17000ca790 0x7f1700153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.374+0000 7f1707696640 1 --2- 172.21.15.6:0/384574512 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f170006a540 0x7f170014e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.374+0000 7f1707696640 1 -- 172.21.15.6:0/384574512 >> 172.21.15.6:0/384574512 conn(0x7f1700099490 msgr2=0x7f170006eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:38.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.374+0000 7f1707696640 1 -- 172.21.15.6:0/384574512 shutdown_connections 2023-07-21T22:55:38.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.374+0000 7f1707696640 1 -- 172.21.15.6:0/384574512 wait complete. 2023-07-21T22:55:38.436 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T22:55:38.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.550+0000 7f33ffffa640 1 Processor -- start 2023-07-21T22:55:38.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.550+0000 7f33ffffa640 1 -- start start 2023-07-21T22:55:38.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.554+0000 7f33ffffa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33f8158a40 0x7f33f80cb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:38.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.554+0000 7f33ffffa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f33f80c8940 0x7f33f80ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:38.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.554+0000 7f33ffffa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f8070c10 con 0x7f33f80cd4a0 2023-07-21T22:55:38.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.554+0000 7f33ffffa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f80cd940 con 0x7f33f80c8940 2023-07-21T22:55:38.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.554+0000 7f33ffffa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f80711b0 con 0x7f33f8158a40 2023-07-21T22:55:38.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.554+0000 7f33fd595640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f33f80c8940 0x7f33f80ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:38.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.554+0000 7f33fd595640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f33f80c8940 0x7f33f80ccf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53600/0 (socket says 172.21.15.6:53600) 2023-07-21T22:55:38.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.554+0000 7f33fd595640 1 -- 172.21.15.6:0/1147641252 learned_addr learned my addr 172.21.15.6:0/1147641252 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:38.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.554+0000 7f33fd595640 1 -- 172.21.15.6:0/1147641252 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33f8158a40 msgr2=0x7f33f80cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:38.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.554+0000 7f33fdd96640 1 --2- 172.21.15.6:0/1147641252 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33f8158a40 0x7f33f80cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:38.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.554+0000 7f33fd595640 1 --2- 172.21.15.6:0/1147641252 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33f8158a40 0x7f33f80cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:38.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.554+0000 7f33fd595640 1 -- 172.21.15.6:0/1147641252 >> v1:172.21.15.161:6789/0 conn(0x7f33f80cd4a0 legacy=0x7f33f815c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:38.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.554+0000 7f33fd595640 1 -- 172.21.15.6:0/1147641252 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f80c8e20 con 0x7f33f80c8940 2023-07-21T22:55:38.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.554+0000 7f33fdd96640 1 --2- 172.21.15.6:0/1147641252 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33f8158a40 0x7f33f80cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:55:38.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.558+0000 7f33fd595640 1 --2- 172.21.15.6:0/1147641252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f80c8940 0x7f33f80ccf60 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f33e80098a0 tx=0x7f33e801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8be046683317a00 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:38.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.558+0000 7f33fcd94640 1 -- 172.21.15.6:0/1147641252 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80ad640 con 0x7f33f80c8940 2023-07-21T22:55:38.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.558+0000 7f33fcd94640 1 -- 172.21.15.6:0/1147641252 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e80ad7a0 con 0x7f33f80c8940 2023-07-21T22:55:38.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.558+0000 7f33fcd94640 1 -- 172.21.15.6:0/1147641252 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e80adb30 con 0x7f33f80c8940 2023-07-21T22:55:38.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.558+0000 7f33ffffa640 1 -- 172.21.15.6:0/1147641252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f80c8940 msgr2=0x7f33f80ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:38.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.558+0000 7f33ffffa640 1 --2- 172.21.15.6:0/1147641252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f80c8940 0x7f33f80ccf60 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f33e80098a0 tx=0x7f33e801c4b0 comp rx=0 tx=0).stop 2023-07-21T22:55:38.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.558+0000 7f33ffffa640 1 -- 172.21.15.6:0/1147641252 shutdown_connections 2023-07-21T22:55:38.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.558+0000 7f33ffffa640 1 --2- 172.21.15.6:0/1147641252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f80c8940 0x7f33f80ccf60 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:38.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.558+0000 7f33ffffa640 1 --2- 172.21.15.6:0/1147641252 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33f8158a40 0x7f33f80cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:38.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.558+0000 7f33ffffa640 1 -- 172.21.15.6:0/1147641252 >> 172.21.15.6:0/1147641252 conn(0x7f33f80afac0 msgr2=0x7f33f80afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:38.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.558+0000 7f33ffffa640 1 -- 172.21.15.6:0/1147641252 shutdown_connections 2023-07-21T22:55:38.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.558+0000 7f33ffffa640 1 -- 172.21.15.6:0/1147641252 wait complete. 2023-07-21T22:55:38.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.558+0000 7f33ffffa640 1 Processor -- start 2023-07-21T22:55:38.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.558+0000 7f33ffffa640 1 -- start start 2023-07-21T22:55:38.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33ffffa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33f80c8940 0x7f33f814b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:38.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33ffffa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33f80cd4a0 0x7f33f80b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:38.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33ffffa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f814c010 0x7f33f8152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:38.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33ffffa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f815ae60 con 0x7f33f814c010 2023-07-21T22:55:38.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33ffffa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f80b27c0 con 0x7f33f80cd4a0 2023-07-21T22:55:38.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33ffffa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f815a530 con 0x7f33f80c8940 2023-07-21T22:55:38.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33fe597640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f814c010 0x7f33f8152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:38.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33fdd96640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33f80c8940 0x7f33f814b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:38.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33fe597640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f814c010 0x7f33f8152790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53610/0 (socket says 172.21.15.6:53610) 2023-07-21T22:55:38.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33fe597640 1 -- 172.21.15.6:0/3061706307 learned_addr learned my addr 172.21.15.6:0/3061706307 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:38.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33fd595640 1 --2- 172.21.15.6:0/3061706307 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33f80cd4a0 0x7f33f80b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:38.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33fdd96640 1 -- 172.21.15.6:0/3061706307 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33f80cd4a0 msgr2=0x7f33f80b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:38.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33fdd96640 1 --2- 172.21.15.6:0/3061706307 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33f80cd4a0 0x7f33f80b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:38.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33fdd96640 1 -- 172.21.15.6:0/3061706307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f814c010 msgr2=0x7f33f8152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:38.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33fdd96640 1 --2- 172.21.15.6:0/3061706307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f814c010 0x7f33f8152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:38.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33fdd96640 1 -- 172.21.15.6:0/3061706307 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e80094d0 con 0x7f33f80c8940 2023-07-21T22:55:38.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33fe597640 1 --2- 172.21.15.6:0/3061706307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f814c010 0x7f33f8152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:55:38.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33fdd96640 1 --2- 172.21.15.6:0/3061706307 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33f80c8940 0x7f33f814b970 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f33f400c820 tx=0x7f33f400cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:38.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33ee7fc640 1 -- 172.21.15.6:0/3061706307 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f4004220 con 0x7f33f80c8940 2023-07-21T22:55:38.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33ee7fc640 1 -- 172.21.15.6:0/3061706307 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f4004380 con 0x7f33f80c8940 2023-07-21T22:55:38.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33ffffa640 1 -- 172.21.15.6:0/3061706307 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f815a810 con 0x7f33f80c8940 2023-07-21T22:55:38.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33ee7fc640 1 -- 172.21.15.6:0/3061706307 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f4007a50 con 0x7f33f80c8940 2023-07-21T22:55:38.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33ffffa640 1 -- 172.21.15.6:0/3061706307 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f80b2400 con 0x7f33f80c8940 2023-07-21T22:55:38.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.562+0000 7f33ffffa640 1 -- 172.21.15.6:0/3061706307 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f80ca370 con 0x7f33f80c8940 2023-07-21T22:55:38.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.566+0000 7f33ee7fc640 1 -- 172.21.15.6:0/3061706307 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f33f4007bb0 con 0x7f33f80c8940 2023-07-21T22:55:38.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.566+0000 7f33ee7fc640 1 --2- 172.21.15.6:0/3061706307 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f33dc0663d0 0x7f33dc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:38.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.566+0000 7f33ee7fc640 1 -- 172.21.15.6:0/3061706307 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 5652+0+0 (secure 0 0 0) 0x7f33f40845e0 con 0x7f33f80c8940 2023-07-21T22:55:38.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.566+0000 7f33fd595640 1 --2- 172.21.15.6:0/3061706307 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f33dc0663d0 0x7f33dc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:38.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.566+0000 7f33fd595640 1 --2- 172.21.15.6:0/3061706307 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f33dc0663d0 0x7f33dc068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f33e80af000 tx=0x7f33e80a7070 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:38.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.570+0000 7f33ee7fc640 1 -- 172.21.15.6:0/3061706307 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f33f4051af0 con 0x7f33f80c8940 2023-07-21T22:55:38.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:38.722+0000 7f33ffffa640 1 -- 172.21.15.6:0/3061706307 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f33f80cb700 con 0x7f33f80c8940 2023-07-21T22:55:39.428 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-07-21T22:55:39.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.386+0000 7f33ee7fc640 1 -- 172.21.15.6:0/3061706307 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v172) v1 ==== 170+0+0 (secure 0 0 0) 0x7f33f4007e60 con 0x7f33f80c8940 2023-07-21T22:55:39.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.398+0000 7f33ffffa640 1 -- 172.21.15.6:0/3061706307 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f33dc0663d0 msgr2=0x7f33dc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:39.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.398+0000 7f33ffffa640 1 --2- 172.21.15.6:0/3061706307 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f33dc0663d0 0x7f33dc068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f33e80af000 tx=0x7f33e80a7070 comp rx=0 tx=0).stop 2023-07-21T22:55:39.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.398+0000 7f33ffffa640 1 -- 172.21.15.6:0/3061706307 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33f80c8940 msgr2=0x7f33f814b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:39.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.398+0000 7f33ffffa640 1 --2- 172.21.15.6:0/3061706307 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33f80c8940 0x7f33f814b970 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f33f400c820 tx=0x7f33f400cce0 comp rx=0 tx=0).stop 2023-07-21T22:55:39.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.398+0000 7f33ffffa640 1 -- 172.21.15.6:0/3061706307 shutdown_connections 2023-07-21T22:55:39.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.398+0000 7f33ffffa640 1 --2- 172.21.15.6:0/3061706307 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f33dc0663d0 0x7f33dc068880 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:39.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.398+0000 7f33ffffa640 1 --2- 172.21.15.6:0/3061706307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33f814c010 0x7f33f8152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:39.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.398+0000 7f33ffffa640 1 --2- 172.21.15.6:0/3061706307 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33f80cd4a0 0x7f33f80b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:39.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.398+0000 7f33ffffa640 1 --2- 172.21.15.6:0/3061706307 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33f80c8940 0x7f33f814b970 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:39.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.398+0000 7f33ffffa640 1 -- 172.21.15.6:0/3061706307 >> 172.21.15.6:0/3061706307 conn(0x7f33f80afac0 msgr2=0x7f33f8151d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:39.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.398+0000 7f33ffffa640 1 -- 172.21.15.6:0/3061706307 shutdown_connections 2023-07-21T22:55:39.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.398+0000 7f33ffffa640 1 -- 172.21.15.6:0/3061706307 wait complete. 2023-07-21T22:55:39.462 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-21T22:55:39.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.574+0000 7f0132eec640 1 Processor -- start 2023-07-21T22:55:39.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.574+0000 7f0132eec640 1 -- start start 2023-07-21T22:55:39.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.574+0000 7f0132eec640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f012c15f690 0x7f012c0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:39.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.574+0000 7f0132eec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f012c06a440 0x7f012c06c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:39.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.574+0000 7f0132eec640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012c06c040 con 0x7f012c1453a0 2023-07-21T22:55:39.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.574+0000 7f0132eec640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f012c160170 con 0x7f012c15f690 2023-07-21T22:55:39.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.574+0000 7f0132eec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012c160600 con 0x7f012c06a440 2023-07-21T22:55:39.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.574+0000 7f0123fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f012c1453a0 0x7f012c15fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56100/0 (socket says 172.21.15.6:56100) 2023-07-21T22:55:39.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.574+0000 7f0123fff640 1 -- 172.21.15.6:0/2870453040 learned_addr learned my addr 172.21.15.6:0/2870453040 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:39.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.574+0000 7f0130c88640 1 --2- 172.21.15.6:0/2870453040 >> v2:172.21.15.161:3300/0 conn(0x7f012c15f690 0x7f012c0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:39.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.574+0000 7f0131489640 1 --2- 172.21.15.6:0/2870453040 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f012c06a440 0x7f012c06c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:39.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.574+0000 7f01237fe640 1 -- 172.21.15.6:0/2870453040 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384418217 0 0) 0x7f012c06c040 con 0x7f012c1453a0 2023-07-21T22:55:39.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.574+0000 7f01237fe640 1 -- 172.21.15.6:0/2870453040 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0114003530 con 0x7f012c1453a0 2023-07-21T22:55:39.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.574+0000 7f0131489640 1 -- 172.21.15.6:0/2870453040 >> v2:172.21.15.161:3300/0 conn(0x7f012c15f690 msgr2=0x7f012c0b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:39.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.574+0000 7f0131489640 1 --2- 172.21.15.6:0/2870453040 >> v2:172.21.15.161:3300/0 conn(0x7f012c15f690 0x7f012c0b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:39.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.574+0000 7f0131489640 1 -- 172.21.15.6:0/2870453040 >> v1:172.21.15.6:6789/0 conn(0x7f012c1453a0 legacy=0x7f012c15fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:39.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.574+0000 7f0131489640 1 -- 172.21.15.6:0/2870453040 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012c160360 con 0x7f012c06a440 2023-07-21T22:55:39.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.574+0000 7f0130c88640 1 --2- 172.21.15.6:0/2870453040 >> v2:172.21.15.161:3300/0 conn(0x7f012c15f690 0x7f012c0b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:55:39.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.578+0000 7f0131489640 1 --2- 172.21.15.6:0/2870453040 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f012c06a440 0x7f012c06c4d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0124009d90 tx=0x7f012401c620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8018b3522ae91aa4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:39.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.578+0000 7f01237fe640 1 -- 172.21.15.6:0/2870453040 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01240a8660 con 0x7f012c06a440 2023-07-21T22:55:39.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.578+0000 7f01237fe640 1 -- 172.21.15.6:0/2870453040 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01240a87c0 con 0x7f012c06a440 2023-07-21T22:55:39.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.578+0000 7f01237fe640 1 -- 172.21.15.6:0/2870453040 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01240a8b50 con 0x7f012c06a440 2023-07-21T22:55:39.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.578+0000 7f0132eec640 1 -- 172.21.15.6:0/2870453040 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f012c06a440 msgr2=0x7f012c06c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:39.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.578+0000 7f0132eec640 1 --2- 172.21.15.6:0/2870453040 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f012c06a440 0x7f012c06c4d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0124009d90 tx=0x7f012401c620 comp rx=0 tx=0).stop 2023-07-21T22:55:39.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.578+0000 7f0132eec640 1 -- 172.21.15.6:0/2870453040 shutdown_connections 2023-07-21T22:55:39.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.578+0000 7f0132eec640 1 --2- 172.21.15.6:0/2870453040 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f012c06a440 0x7f012c06c4d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:39.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.578+0000 7f0132eec640 1 --2- 172.21.15.6:0/2870453040 >> v2:172.21.15.161:3300/0 conn(0x7f012c15f690 0x7f012c0b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:39.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.578+0000 7f0132eec640 1 -- 172.21.15.6:0/2870453040 >> 172.21.15.6:0/2870453040 conn(0x7f012c0b1210 msgr2=0x7f012c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:39.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.578+0000 7f0132eec640 1 -- 172.21.15.6:0/2870453040 shutdown_connections 2023-07-21T22:55:39.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.578+0000 7f0132eec640 1 -- 172.21.15.6:0/2870453040 wait complete. 2023-07-21T22:55:39.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0132eec640 1 Processor -- start 2023-07-21T22:55:39.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0132eec640 1 -- start start 2023-07-21T22:55:39.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0132eec640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f012c06a440 0x7f012c159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:39.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0132eec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f012c1453a0 0x7f012c15adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:39.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0132eec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f012c15f690 0x7f012c13ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:39.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0132eec640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c158990 con 0x7f012c06a440 2023-07-21T22:55:39.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0132eec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c1576a0 con 0x7f012c15f690 2023-07-21T22:55:39.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0132eec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012c1578f0 con 0x7f012c1453a0 2023-07-21T22:55:39.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0130c88640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f012c06a440 0x7f012c159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:39.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0130c88640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f012c06a440 0x7f012c159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53614/0 (socket says 172.21.15.6:53614) 2023-07-21T22:55:39.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0130c88640 1 -- 172.21.15.6:0/2284857322 learned_addr learned my addr 172.21.15.6:0/2284857322 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:39.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0123fff640 1 --2- 172.21.15.6:0/2284857322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f012c1453a0 0x7f012c15adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:39.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0131489640 1 --2- 172.21.15.6:0/2284857322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f012c15f690 0x7f012c13ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:39.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0130c88640 1 -- 172.21.15.6:0/2284857322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f012c1453a0 msgr2=0x7f012c15adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:39.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0130c88640 1 --2- 172.21.15.6:0/2284857322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f012c1453a0 0x7f012c15adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:39.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0130c88640 1 -- 172.21.15.6:0/2284857322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f012c15f690 msgr2=0x7f012c13ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:39.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0130c88640 1 --2- 172.21.15.6:0/2284857322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f012c15f690 0x7f012c13ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:39.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0130c88640 1 -- 172.21.15.6:0/2284857322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0128009420 con 0x7f012c06a440 2023-07-21T22:55:39.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0130c88640 1 --2- 172.21.15.6:0/2284857322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f012c06a440 0x7f012c159200 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f012800ebe0 tx=0x7f012800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:39.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f01217fa640 1 -- 172.21.15.6:0/2284857322 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012800eee0 con 0x7f012c06a440 2023-07-21T22:55:39.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f01217fa640 1 -- 172.21.15.6:0/2284857322 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012800cc30 con 0x7f012c06a440 2023-07-21T22:55:39.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f01217fa640 1 -- 172.21.15.6:0/2284857322 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0128013470 con 0x7f012c06a440 2023-07-21T22:55:39.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0132eec640 1 -- 172.21.15.6:0/2284857322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0124009a70 con 0x7f012c06a440 2023-07-21T22:55:39.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.582+0000 7f0132eec640 1 -- 172.21.15.6:0/2284857322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f012c157eb0 con 0x7f012c06a440 2023-07-21T22:55:39.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.586+0000 7f0132eec640 1 -- 172.21.15.6:0/2284857322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f012c0678d0 con 0x7f012c06a440 2023-07-21T22:55:39.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.586+0000 7f01217fa640 1 -- 172.21.15.6:0/2284857322 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f01280135d0 con 0x7f012c06a440 2023-07-21T22:55:39.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.586+0000 7f01217fa640 1 --2- 172.21.15.6:0/2284857322 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f01180663a0 0x7f0118068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:39.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.586+0000 7f01217fa640 1 -- 172.21.15.6:0/2284857322 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f01280848a0 con 0x7f012c06a440 2023-07-21T22:55:39.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.586+0000 7f0123fff640 1 --2- 172.21.15.6:0/2284857322 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f01180663a0 0x7f0118068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:39.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.590+0000 7f0123fff640 1 --2- 172.21.15.6:0/2284857322 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f01180663a0 0x7f0118068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f012c0ceb20 tx=0x7f011c007d40 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:39.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.590+0000 7f01217fa640 1 -- 172.21.15.6:0/2284857322 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0128051d40 con 0x7f012c06a440 2023-07-21T22:55:39.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:39.778+0000 7f0132eec640 1 -- 172.21.15.6:0/2284857322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f012c0cf300 con 0x7f012c06a440 2023-07-21T22:55:40.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.402+0000 7f01217fa640 1 -- 172.21.15.6:0/2284857322 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v74) v1 ==== 174+0+0 (secure 0 0 0) 0x7f0128055360 con 0x7f012c06a440 2023-07-21T22:55:40.444 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 21 and data pool 22 2023-07-21T22:55:40.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.410+0000 7f0132eec640 1 -- 172.21.15.6:0/2284857322 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f01180663a0 msgr2=0x7f0118068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:40.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.410+0000 7f0132eec640 1 --2- 172.21.15.6:0/2284857322 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f01180663a0 0x7f0118068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f012c0ceb20 tx=0x7f011c007d40 comp rx=0 tx=0).stop 2023-07-21T22:55:40.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.410+0000 7f0132eec640 1 -- 172.21.15.6:0/2284857322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f012c06a440 msgr2=0x7f012c159200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:40.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.410+0000 7f0132eec640 1 --2- 172.21.15.6:0/2284857322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f012c06a440 0x7f012c159200 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f012800ebe0 tx=0x7f012800c520 comp rx=0 tx=0).stop 2023-07-21T22:55:40.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.414+0000 7f0132eec640 1 -- 172.21.15.6:0/2284857322 shutdown_connections 2023-07-21T22:55:40.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.414+0000 7f0132eec640 1 --2- 172.21.15.6:0/2284857322 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f01180663a0 0x7f0118068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.414+0000 7f0132eec640 1 --2- 172.21.15.6:0/2284857322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f012c15f690 0x7f012c13ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.414+0000 7f0132eec640 1 --2- 172.21.15.6:0/2284857322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f012c1453a0 0x7f012c15adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.414+0000 7f0132eec640 1 --2- 172.21.15.6:0/2284857322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f012c06a440 0x7f012c159200 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.414+0000 7f0132eec640 1 -- 172.21.15.6:0/2284857322 >> 172.21.15.6:0/2284857322 conn(0x7f012c0b1210 msgr2=0x7f012c0b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:40.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.418+0000 7f0132eec640 1 -- 172.21.15.6:0/2284857322 shutdown_connections 2023-07-21T22:55:40.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.418+0000 7f0132eec640 1 -- 172.21.15.6:0/2284857322 wait complete. 2023-07-21T22:55:40.481 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:55:40.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.590+0000 7f634087b640 1 Processor -- start 2023-07-21T22:55:40.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.590+0000 7f634087b640 1 -- start start 2023-07-21T22:55:40.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.590+0000 7f634087b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c0b7990 0x7f633c0d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:40.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.590+0000 7f634087b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f633c0d12f0 0x7f633c15f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:40.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.590+0000 7f634087b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633c0b4840 con 0x7f633c0d1840 2023-07-21T22:55:40.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.590+0000 7f634087b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633c0cd060 con 0x7f633c0d12f0 2023-07-21T22:55:40.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.590+0000 7f634087b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c0d1180 con 0x7f633c0b7990 2023-07-21T22:55:40.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.590+0000 7f6333fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f633c0d12f0 0x7f633c15f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:40.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.590+0000 7f6333fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f633c0d12f0 0x7f633c15f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53622/0 (socket says 172.21.15.6:53622) 2023-07-21T22:55:40.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.590+0000 7f6333fff640 1 -- 172.21.15.6:0/3867395672 learned_addr learned my addr 172.21.15.6:0/3867395672 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:40.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.590+0000 7f633a59c640 1 --2- 172.21.15.6:0/3867395672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c0b7990 0x7f633c0d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:40.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.590+0000 7f6333fff640 1 -- 172.21.15.6:0/3867395672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c0b7990 msgr2=0x7f633c0d0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:40.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.590+0000 7f6333fff640 1 --2- 172.21.15.6:0/3867395672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c0b7990 0x7f633c0d0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.590+0000 7f6333fff640 1 -- 172.21.15.6:0/3867395672 >> v1:172.21.15.161:6789/0 conn(0x7f633c0d1840 legacy=0x7f633c0d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:40.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.590+0000 7f6333fff640 1 -- 172.21.15.6:0/3867395672 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c0ccae0 con 0x7f633c0d12f0 2023-07-21T22:55:40.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.594+0000 7f6333fff640 1 --2- 172.21.15.6:0/3867395672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f633c0d12f0 0x7f633c15f640 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f63240098a0 tx=0x7f632401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f446e479e36c45f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:40.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.594+0000 7f6339d9b640 1 -- 172.21.15.6:0/3867395672 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63240ab600 con 0x7f633c0d12f0 2023-07-21T22:55:40.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.594+0000 7f6339d9b640 1 -- 172.21.15.6:0/3867395672 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63240a7050 con 0x7f633c0d12f0 2023-07-21T22:55:40.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.594+0000 7f6339d9b640 1 -- 172.21.15.6:0/3867395672 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63240ab980 con 0x7f633c0d12f0 2023-07-21T22:55:40.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.594+0000 7f634087b640 1 -- 172.21.15.6:0/3867395672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f633c0d12f0 msgr2=0x7f633c15f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:40.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.594+0000 7f634087b640 1 --2- 172.21.15.6:0/3867395672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f633c0d12f0 0x7f633c15f640 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f63240098a0 tx=0x7f632401c400 comp rx=0 tx=0).stop 2023-07-21T22:55:40.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.594+0000 7f634087b640 1 -- 172.21.15.6:0/3867395672 shutdown_connections 2023-07-21T22:55:40.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.594+0000 7f634087b640 1 --2- 172.21.15.6:0/3867395672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f633c0d12f0 0x7f633c15f640 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.594+0000 7f634087b640 1 --2- 172.21.15.6:0/3867395672 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c0b7990 0x7f633c0d0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.594+0000 7f634087b640 1 -- 172.21.15.6:0/3867395672 >> 172.21.15.6:0/3867395672 conn(0x7f633c0650b0 msgr2=0x7f633c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:40.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.594+0000 7f634087b640 1 -- 172.21.15.6:0/3867395672 shutdown_connections 2023-07-21T22:55:40.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.594+0000 7f634087b640 1 -- 172.21.15.6:0/3867395672 wait complete. 2023-07-21T22:55:40.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f634087b640 1 Processor -- start 2023-07-21T22:55:40.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f634087b640 1 -- start start 2023-07-21T22:55:40.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f634087b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f633c0b7990 0x7f633c15d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:40.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f634087b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c0d12f0 0x7f633c154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:40.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f634087b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f633c0d1840 0x7f633c0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:40.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f634087b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c0c83d0 con 0x7f633c0b7990 2023-07-21T22:55:40.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f634087b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c15d560 con 0x7f633c0d1840 2023-07-21T22:55:40.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f634087b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c15c3b0 con 0x7f633c0d12f0 2023-07-21T22:55:40.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f633a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f633c0b7990 0x7f633c15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:40.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f633a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f633c0b7990 0x7f633c15d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53624/0 (socket says 172.21.15.6:53624) 2023-07-21T22:55:40.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f633a59c640 1 -- 172.21.15.6:0/3238404887 learned_addr learned my addr 172.21.15.6:0/3238404887 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:40.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f633ad9d640 1 --2- 172.21.15.6:0/3238404887 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f633c0d1840 0x7f633c0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:40.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f6333fff640 1 --2- 172.21.15.6:0/3238404887 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c0d12f0 0x7f633c154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:40.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f633a59c640 1 -- 172.21.15.6:0/3238404887 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c0d12f0 msgr2=0x7f633c154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:40.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f633a59c640 1 --2- 172.21.15.6:0/3238404887 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c0d12f0 0x7f633c154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f633a59c640 1 -- 172.21.15.6:0/3238404887 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f633c0d1840 msgr2=0x7f633c0b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:40.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f633a59c640 1 --2- 172.21.15.6:0/3238404887 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f633c0d1840 0x7f633c0b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f633a59c640 1 -- 172.21.15.6:0/3238404887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63240094d0 con 0x7f633c0b7990 2023-07-21T22:55:40.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f633ad9d640 1 --2- 172.21.15.6:0/3238404887 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f633c0d1840 0x7f633c0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:40.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f633a59c640 1 --2- 172.21.15.6:0/3238404887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f633c0b7990 0x7f633c15d020 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f632c00e870 tx=0x7f632c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:40.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f6332ffd640 1 -- 172.21.15.6:0/3238404887 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c009510 con 0x7f633c0b7990 2023-07-21T22:55:40.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f6332ffd640 1 -- 172.21.15.6:0/3238404887 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c00eec0 con 0x7f633c0b7990 2023-07-21T22:55:40.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f6332ffd640 1 -- 172.21.15.6:0/3238404887 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c00cb40 con 0x7f633c0b7990 2023-07-21T22:55:40.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f634087b640 1 -- 172.21.15.6:0/3238404887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633c0b7ee0 con 0x7f633c0b7990 2023-07-21T22:55:40.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.598+0000 7f634087b640 1 -- 172.21.15.6:0/3238404887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633c0c7a30 con 0x7f633c0b7990 2023-07-21T22:55:40.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.602+0000 7f634087b640 1 -- 172.21.15.6:0/3238404887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633c0c8640 con 0x7f633c0b7990 2023-07-21T22:55:40.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.602+0000 7f6332ffd640 1 -- 172.21.15.6:0/3238404887 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f632c00cca0 con 0x7f633c0b7990 2023-07-21T22:55:40.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.602+0000 7f6332ffd640 1 --2- 172.21.15.6:0/3238404887 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f631c0663a0 0x7f631c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:40.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.602+0000 7f6332ffd640 1 -- 172.21.15.6:0/3238404887 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f632c083ff0 con 0x7f633c0b7990 2023-07-21T22:55:40.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.602+0000 7f6333fff640 1 --2- 172.21.15.6:0/3238404887 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f631c0663a0 0x7f631c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:40.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.602+0000 7f6333fff640 1 --2- 172.21.15.6:0/3238404887 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f631c0663a0 0x7f631c068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f63240ad000 tx=0x7f6324008040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:40.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.606+0000 7f6332ffd640 1 -- 172.21.15.6:0/3238404887 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f632c0b4700 con 0x7f633c0b7990 2023-07-21T22:55:40.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.762+0000 7f634087b640 1 -- 172.21.15.6:0/3238404887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f633c0678d0 con 0x7f633c0b7990 2023-07-21T22:55:40.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.766+0000 7f6332ffd640 1 -- 172.21.15.6:0/3238404887 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+18357 (secure 0 0 0) 0x7f632c017090 con 0x7f633c0b7990 2023-07-21T22:55:40.802 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:40.803 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":173,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:55:39.783675+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:55:37.909970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-21T22:55:38.777920+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:55:40.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.766+0000 7f634087b640 1 -- 172.21.15.6:0/3238404887 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f631c0663a0 msgr2=0x7f631c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:40.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.766+0000 7f634087b640 1 --2- 172.21.15.6:0/3238404887 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f631c0663a0 0x7f631c068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f63240ad000 tx=0x7f6324008040 comp rx=0 tx=0).stop 2023-07-21T22:55:40.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.766+0000 7f634087b640 1 -- 172.21.15.6:0/3238404887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f633c0b7990 msgr2=0x7f633c15d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:40.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.766+0000 7f634087b640 1 --2- 172.21.15.6:0/3238404887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f633c0b7990 0x7f633c15d020 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f632c00e870 tx=0x7f632c00ec70 comp rx=0 tx=0).stop 2023-07-21T22:55:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.766+0000 7f634087b640 1 -- 172.21.15.6:0/3238404887 shutdown_connections 2023-07-21T22:55:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.766+0000 7f634087b640 1 --2- 172.21.15.6:0/3238404887 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f631c0663a0 0x7f631c068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.766+0000 7f634087b640 1 --2- 172.21.15.6:0/3238404887 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f633c0d1840 0x7f633c0b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.766+0000 7f634087b640 1 --2- 172.21.15.6:0/3238404887 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f633c0d12f0 0x7f633c154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.766+0000 7f634087b640 1 --2- 172.21.15.6:0/3238404887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f633c0b7990 0x7f633c15d020 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.766+0000 7f634087b640 1 -- 172.21.15.6:0/3238404887 >> 172.21.15.6:0/3238404887 conn(0x7f633c0650b0 msgr2=0x7f633c065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.766+0000 7f634087b640 1 -- 172.21.15.6:0/3238404887 shutdown_connections 2023-07-21T22:55:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.766+0000 7f634087b640 1 -- 172.21.15.6:0/3238404887 wait complete. 2023-07-21T22:55:40.824 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:55:40.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.930+0000 7f979eb40640 1 Processor -- start 2023-07-21T22:55:40.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.930+0000 7f979eb40640 1 -- start start 2023-07-21T22:55:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.930+0000 7f979eb40640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f979815b7c0 0x7f979806b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.930+0000 7f979eb40640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97980cb780 0x7f979806b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.930+0000 7f979eb40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f979806fd90 0x7f9798070210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.930+0000 7f979eb40640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97980cdce0 con 0x7f97980cb780 2023-07-21T22:55:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.930+0000 7f979eb40640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97980ca830 con 0x7f979815b7c0 2023-07-21T22:55:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.930+0000 7f979eb40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979806f900 con 0x7f979806fd90 2023-07-21T22:55:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.934+0000 7f9797fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97980cb780 0x7f979806b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.934+0000 7f9797fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f97980cb780 0x7f979806b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53636/0 (socket says 172.21.15.6:53636) 2023-07-21T22:55:40.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.934+0000 7f9797fff640 1 -- 172.21.15.6:0/2080731213 learned_addr learned my addr 172.21.15.6:0/2080731213 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.934+0000 7f979c8dc640 1 --2- 172.21.15.6:0/2080731213 >> v2:172.21.15.161:3300/0 conn(0x7f979815b7c0 0x7f979806b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.934+0000 7f979d0dd640 1 --2- 172.21.15.6:0/2080731213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f979806fd90 0x7f9798070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.934+0000 7f9797fff640 1 -- 172.21.15.6:0/2080731213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f979806fd90 msgr2=0x7f9798070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.934+0000 7f9797fff640 1 --2- 172.21.15.6:0/2080731213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f979806fd90 0x7f9798070210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.934+0000 7f9797fff640 1 -- 172.21.15.6:0/2080731213 >> v2:172.21.15.161:3300/0 conn(0x7f979815b7c0 msgr2=0x7f979806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:40.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.934+0000 7f9797fff640 1 --2- 172.21.15.6:0/2080731213 >> v2:172.21.15.161:3300/0 conn(0x7f979815b7c0 0x7f979806b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.934+0000 7f9797fff640 1 -- 172.21.15.6:0/2080731213 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979815bb90 con 0x7f97980cb780 2023-07-21T22:55:40.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.934+0000 7f979d0dd640 1 --2- 172.21.15.6:0/2080731213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f979806fd90 0x7f9798070210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:40.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.934+0000 7f9797fff640 1 --2- 172.21.15.6:0/2080731213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97980cb780 0x7f979806b720 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f9798066260 tx=0x7f978401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4900d2de86e5b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:40.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.934+0000 7f97977fe640 1 -- 172.21.15.6:0/2080731213 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97840ab5f0 con 0x7f97980cb780 2023-07-21T22:55:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.934+0000 7f97977fe640 1 -- 172.21.15.6:0/2080731213 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97840ab750 con 0x7f97980cb780 2023-07-21T22:55:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.934+0000 7f97977fe640 1 -- 172.21.15.6:0/2080731213 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97840abae0 con 0x7f97980cb780 2023-07-21T22:55:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f979eb40640 1 -- 172.21.15.6:0/2080731213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97980cb780 msgr2=0x7f979806b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f979eb40640 1 --2- 172.21.15.6:0/2080731213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97980cb780 0x7f979806b720 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f9798066260 tx=0x7f978401c4a0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f979eb40640 1 -- 172.21.15.6:0/2080731213 shutdown_connections 2023-07-21T22:55:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f979eb40640 1 --2- 172.21.15.6:0/2080731213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f979806fd90 0x7f9798070210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f979eb40640 1 --2- 172.21.15.6:0/2080731213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97980cb780 0x7f979806b720 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f979eb40640 1 --2- 172.21.15.6:0/2080731213 >> v2:172.21.15.161:3300/0 conn(0x7f979815b7c0 0x7f979806b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f979eb40640 1 -- 172.21.15.6:0/2080731213 >> 172.21.15.6:0/2080731213 conn(0x7f97980afcf0 msgr2=0x7f97980b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:40.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f979eb40640 1 -- 172.21.15.6:0/2080731213 shutdown_connections 2023-07-21T22:55:40.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f979eb40640 1 -- 172.21.15.6:0/2080731213 wait complete. 2023-07-21T22:55:40.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f979eb40640 1 Processor -- start 2023-07-21T22:55:40.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f979eb40640 1 -- start start 2023-07-21T22:55:40.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f979eb40640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f979806fd90 0x7f9798156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:40.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f979eb40640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f979815b7c0 0x7f97980b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:40.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f979eb40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97981562b0 0x7f97980c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:40.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f979eb40640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97980c6750 con 0x7f979815b7c0 2023-07-21T22:55:40.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f979eb40640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97980af8c0 con 0x7f979806fd90 2023-07-21T22:55:40.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f979eb40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97980b35d0 con 0x7f97981562b0 2023-07-21T22:55:40.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f9797fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f979815b7c0 0x7f97980b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:40.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f9797fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f979815b7c0 0x7f97980b2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53644/0 (socket says 172.21.15.6:53644) 2023-07-21T22:55:40.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f9797fff640 1 -- 172.21.15.6:0/2815114965 learned_addr learned my addr 172.21.15.6:0/2815114965 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:40.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.938+0000 7f979c8dc640 1 --2- 172.21.15.6:0/2815114965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f979806fd90 0x7f9798156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:40.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.942+0000 7f979d0dd640 1 --2- 172.21.15.6:0/2815114965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97981562b0 0x7f97980c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:40.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.942+0000 7f9797fff640 1 -- 172.21.15.6:0/2815114965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97981562b0 msgr2=0x7f97980c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:40.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.942+0000 7f9797fff640 1 --2- 172.21.15.6:0/2815114965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97981562b0 0x7f97980c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.942+0000 7f9797fff640 1 -- 172.21.15.6:0/2815114965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f979806fd90 msgr2=0x7f9798156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:40.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.942+0000 7f9797fff640 1 --2- 172.21.15.6:0/2815114965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f979806fd90 0x7f9798156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:40.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.942+0000 7f9797fff640 1 -- 172.21.15.6:0/2815114965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97840094d0 con 0x7f979815b7c0 2023-07-21T22:55:40.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.942+0000 7f979c8dc640 1 --2- 172.21.15.6:0/2815114965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f979806fd90 0x7f9798156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:40.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.942+0000 7f9797fff640 1 --2- 172.21.15.6:0/2815114965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f979815b7c0 0x7f97980b2ed0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f978401c980 tx=0x7f978401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.942+0000 7f97957fa640 1 -- 172.21.15.6:0/2815114965 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97840be5f0 con 0x7f979815b7c0 2023-07-21T22:55:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.942+0000 7f97957fa640 1 -- 172.21.15.6:0/2815114965 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97840be750 con 0x7f979815b7c0 2023-07-21T22:55:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.942+0000 7f97957fa640 1 -- 172.21.15.6:0/2815114965 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97840beb00 con 0x7f979815b7c0 2023-07-21T22:55:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.942+0000 7f979eb40640 1 -- 172.21.15.6:0/2815114965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97980b38b0 con 0x7f979815b7c0 2023-07-21T22:55:40.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.942+0000 7f979eb40640 1 -- 172.21.15.6:0/2815114965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9798156750 con 0x7f979815b7c0 2023-07-21T22:55:40.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.942+0000 7f979eb40640 1 -- 172.21.15.6:0/2815114965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97980c6890 con 0x7f979815b7c0 2023-07-21T22:55:40.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.942+0000 7f97957fa640 1 -- 172.21.15.6:0/2815114965 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f97840b43f0 con 0x7f979815b7c0 2023-07-21T22:55:40.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.942+0000 7f97957fa640 1 --2- 172.21.15.6:0/2815114965 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f977c0663d0 0x7f977c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:40.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.942+0000 7f97957fa640 1 -- 172.21.15.6:0/2815114965 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f97840a8050 con 0x7f979815b7c0 2023-07-21T22:55:40.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.946+0000 7f979c8dc640 1 --2- 172.21.15.6:0/2815114965 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f977c0663d0 0x7f977c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:40.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.946+0000 7f979c8dc640 1 --2- 172.21.15.6:0/2815114965 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f977c0663d0 0x7f977c068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f97981f7850 tx=0x7f978c008040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:40.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:40.946+0000 7f97957fa640 1 -- 172.21.15.6:0/2815114965 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f97980c6890 con 0x7f979815b7c0 2023-07-21T22:55:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.102+0000 7f979eb40640 1 -- 172.21.15.6:0/2815114965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97980c6890 con 0x7f979815b7c0 2023-07-21T22:55:41.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.106+0000 7f97957fa640 1 -- 172.21.15.6:0/2815114965 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+18357 (secure 0 0 0) 0x7f97980c6890 con 0x7f979815b7c0 2023-07-21T22:55:41.143 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:41.144 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":173,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:55:39.783675+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:55:37.909970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-21T22:55:38.777920+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:55:41.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.106+0000 7f979eb40640 1 -- 172.21.15.6:0/2815114965 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f977c0663d0 msgr2=0x7f977c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:41.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.106+0000 7f979eb40640 1 --2- 172.21.15.6:0/2815114965 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f977c0663d0 0x7f977c068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f97981f7850 tx=0x7f978c008040 comp rx=0 tx=0).stop 2023-07-21T22:55:41.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.106+0000 7f979eb40640 1 -- 172.21.15.6:0/2815114965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f979815b7c0 msgr2=0x7f97980b2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:41.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.106+0000 7f979eb40640 1 --2- 172.21.15.6:0/2815114965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f979815b7c0 0x7f97980b2ed0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f978401c980 tx=0x7f978401ace0 comp rx=0 tx=0).stop 2023-07-21T22:55:41.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.106+0000 7f979eb40640 1 -- 172.21.15.6:0/2815114965 shutdown_connections 2023-07-21T22:55:41.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.106+0000 7f979eb40640 1 --2- 172.21.15.6:0/2815114965 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f977c0663d0 0x7f977c068880 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:41.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.106+0000 7f979eb40640 1 --2- 172.21.15.6:0/2815114965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97981562b0 0x7f97980c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:41.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.106+0000 7f979eb40640 1 --2- 172.21.15.6:0/2815114965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f979815b7c0 0x7f97980b2ed0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.106+0000 7f979eb40640 1 --2- 172.21.15.6:0/2815114965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f979806fd90 0x7f9798156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.106+0000 7f979eb40640 1 -- 172.21.15.6:0/2815114965 >> 172.21.15.6:0/2815114965 conn(0x7f97980afcf0 msgr2=0x7f979806b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.106+0000 7f979eb40640 1 -- 172.21.15.6:0/2815114965 shutdown_connections 2023-07-21T22:55:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.106+0000 7f979eb40640 1 -- 172.21.15.6:0/2815114965 wait complete. 2023-07-21T22:55:41.165 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-21T22:55:41.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff0947c5640 1 Processor -- start 2023-07-21T22:55:41.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff0947c5640 1 -- start start 2023-07-21T22:55:41.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff0947c5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff08c06a540 0x7ff08c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:41.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff0947c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff08c0cf710 0x7ff08c0cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:41.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff0947c5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff08c0cb7a0 con 0x7ff08c0cf2e0 2023-07-21T22:55:41.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff0947c5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff08c0d0920 con 0x7ff08c06a540 2023-07-21T22:55:41.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff0947c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c15bfd0 con 0x7ff08c0cf710 2023-07-21T22:55:41.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff091d60640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff08c0cf2e0 0x7ff08c0cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56104/0 (socket says 172.21.15.6:56104) 2023-07-21T22:55:41.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff091d60640 1 -- 172.21.15.6:0/2430993841 learned_addr learned my addr 172.21.15.6:0/2430993841 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:41.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff092561640 1 --2- 172.21.15.6:0/2430993841 >> v2:172.21.15.161:3300/0 conn(0x7ff08c06a540 0x7ff08c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff092d62640 1 --2- 172.21.15.6:0/2430993841 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff08c0cf710 0x7ff08c0cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff09155f640 1 -- 172.21.15.6:0/2430993841 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866727624 0 0) 0x7ff08c0cb7a0 con 0x7ff08c0cf2e0 2023-07-21T22:55:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff09155f640 1 -- 172.21.15.6:0/2430993841 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff078003530 con 0x7ff08c0cf2e0 2023-07-21T22:55:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff09155f640 1 -- 172.21.15.6:0/2430993841 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 762663933 0 0) 0x7ff078003530 con 0x7ff08c0cf2e0 2023-07-21T22:55:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff09155f640 1 -- 172.21.15.6:0/2430993841 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff08c0cf710 msgr2=0x7ff08c0cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff09155f640 1 --2- 172.21.15.6:0/2430993841 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff08c0cf710 0x7ff08c0cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff09155f640 1 -- 172.21.15.6:0/2430993841 >> v2:172.21.15.161:3300/0 conn(0x7ff08c06a540 msgr2=0x7ff08c06a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff09155f640 1 --2- 172.21.15.6:0/2430993841 >> v2:172.21.15.161:3300/0 conn(0x7ff08c06a540 0x7ff08c06a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff09155f640 1 -- 172.21.15.6:0/2430993841 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c06ae50 con 0x7ff08c0cf2e0 2023-07-21T22:55:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff09155f640 1 -- 172.21.15.6:0/2430993841 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7ff07c001680 con 0x7ff08c0cf2e0 2023-07-21T22:55:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff09155f640 1 -- 172.21.15.6:0/2430993841 >> v1:172.21.15.6:6789/0 conn(0x7ff08c0cf2e0 legacy=0x7ff08c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff09155f640 1 --2- 172.21.15.6:0/2430993841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff078003980 0x7ff078003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff09155f640 1 --2- 172.21.15.6:0/2430993841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0780043b0 0x7ff078004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff09155f640 1 --2- 172.21.15.6:0/2430993841 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff08c0cf710 0x7ff078004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff09155f640 1 -- 172.21.15.6:0/2430993841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c0d0920 con 0x7ff0780043b0 2023-07-21T22:55:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff09155f640 1 -- 172.21.15.6:0/2430993841 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c15bfd0 con 0x7ff078003980 2023-07-21T22:55:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff09155f640 1 -- 172.21.15.6:0/2430993841 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07800b990 con 0x7ff08c0cf710 2023-07-21T22:55:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff092561640 1 --2- 172.21.15.6:0/2430993841 >> v2:172.21.15.161:3300/0 conn(0x7ff08c06a540 0x7ff08c06a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:55:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff091d60640 1 --2- 172.21.15.6:0/2430993841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0780043b0 0x7ff078004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff091d60640 1 -- 172.21.15.6:0/2430993841 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff08c0cf710 msgr2=0x7ff078004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff091d60640 1 --2- 172.21.15.6:0/2430993841 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff08c0cf710 0x7ff078004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff091d60640 1 -- 172.21.15.6:0/2430993841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff078003980 msgr2=0x7ff078003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff091d60640 1 --2- 172.21.15.6:0/2430993841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff078003980 0x7ff078003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:41.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.278+0000 7ff091d60640 1 -- 172.21.15.6:0/2430993841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff078003530 con 0x7ff0780043b0 2023-07-21T22:55:41.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.282+0000 7ff091d60640 1 --2- 172.21.15.6:0/2430993841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0780043b0 0x7ff078004870 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00c210 tx=0x7ff07c01f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7aaaa67eca4239 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:41.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.282+0000 7ff09155f640 1 -- 172.21.15.6:0/2430993841 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c005ae0 con 0x7ff0780043b0 2023-07-21T22:55:41.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.282+0000 7ff09155f640 1 -- 172.21.15.6:0/2430993841 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07c0ab070 con 0x7ff0780043b0 2023-07-21T22:55:41.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.282+0000 7ff09155f640 1 -- 172.21.15.6:0/2430993841 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c005e60 con 0x7ff0780043b0 2023-07-21T22:55:41.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.282+0000 7ff0947c5640 1 -- 172.21.15.6:0/2430993841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0780043b0 msgr2=0x7ff078004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:41.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.282+0000 7ff0947c5640 1 --2- 172.21.15.6:0/2430993841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0780043b0 0x7ff078004870 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00c210 tx=0x7ff07c01f390 comp rx=0 tx=0).stop 2023-07-21T22:55:41.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.282+0000 7ff092d62640 1 -- 172.21.15.6:0/2430993841 reap_dead start 2023-07-21T22:55:41.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.282+0000 7ff0947c5640 1 -- 172.21.15.6:0/2430993841 shutdown_connections 2023-07-21T22:55:41.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.282+0000 7ff0947c5640 1 -- 172.21.15.6:0/2430993841 >> 172.21.15.6:0/2430993841 conn(0x7ff08c099490 msgr2=0x7ff08c089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:41.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.282+0000 7ff0947c5640 1 -- 172.21.15.6:0/2430993841 shutdown_connections 2023-07-21T22:55:41.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.282+0000 7ff0947c5640 1 -- 172.21.15.6:0/2430993841 wait complete. 2023-07-21T22:55:41.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.282+0000 7ff0947c5640 1 Processor -- start 2023-07-21T22:55:41.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.282+0000 7ff0947c5640 1 -- start start 2023-07-21T22:55:41.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff0947c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0780043b0 0x7ff08c14afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:41.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff0947c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff08c159c40 0x7ff08c14a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:41.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff0947c5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff08c0c6420 0x7ff08c0c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:41.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff0947c5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c15d300 con 0x7ff0780043b0 2023-07-21T22:55:41.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff0947c5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c15d510 con 0x7ff08c0c6420 2023-07-21T22:55:41.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff0947c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c15d7f0 con 0x7ff08c159c40 2023-07-21T22:55:41.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff092561640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0780043b0 0x7ff08c14afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:41.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff092561640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0780043b0 0x7ff08c14afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53652/0 (socket says 172.21.15.6:53652) 2023-07-21T22:55:41.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff092561640 1 -- 172.21.15.6:0/3960087835 learned_addr learned my addr 172.21.15.6:0/3960087835 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:41.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff092d62640 1 --2- 172.21.15.6:0/3960087835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff08c0c6420 0x7ff08c0c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:41.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff091d60640 1 --2- 172.21.15.6:0/3960087835 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff08c159c40 0x7ff08c14a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:41.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff092561640 1 -- 172.21.15.6:0/3960087835 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff08c159c40 msgr2=0x7ff08c14a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff092561640 1 --2- 172.21.15.6:0/3960087835 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff08c159c40 0x7ff08c14a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff092561640 1 -- 172.21.15.6:0/3960087835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff08c0c6420 msgr2=0x7ff08c0c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff092561640 1 --2- 172.21.15.6:0/3960087835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff08c0c6420 0x7ff08c0c43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff092561640 1 -- 172.21.15.6:0/3960087835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c15dad0 con 0x7ff0780043b0 2023-07-21T22:55:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff092561640 1 --2- 172.21.15.6:0/3960087835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0780043b0 0x7ff08c14afd0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7ff08800e920 tx=0x7ff08800ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff082ffd640 1 -- 172.21.15.6:0/3960087835 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08800ca00 con 0x7ff0780043b0 2023-07-21T22:55:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff082ffd640 1 -- 172.21.15.6:0/3960087835 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08800cb80 con 0x7ff0780043b0 2023-07-21T22:55:41.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff082ffd640 1 -- 172.21.15.6:0/3960087835 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff088004030 con 0x7ff0780043b0 2023-07-21T22:55:41.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff0947c5640 1 -- 172.21.15.6:0/3960087835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08c15ddb0 con 0x7ff0780043b0 2023-07-21T22:55:41.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff0947c5640 1 -- 172.21.15.6:0/3960087835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08c14b510 con 0x7ff0780043b0 2023-07-21T22:55:41.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff0947c5640 1 -- 172.21.15.6:0/3960087835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff08c0678d0 con 0x7ff0780043b0 2023-07-21T22:55:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.286+0000 7ff082ffd640 1 -- 172.21.15.6:0/3960087835 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff088004190 con 0x7ff0780043b0 2023-07-21T22:55:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.290+0000 7ff082ffd640 1 --2- 172.21.15.6:0/3960087835 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7ff0700663d0 0x7ff070068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.290+0000 7ff082ffd640 1 -- 172.21.15.6:0/3960087835 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6134+0+0 (secure 0 0 0) 0x7ff088084190 con 0x7ff0780043b0 2023-07-21T22:55:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.290+0000 7ff091d60640 1 --2- 172.21.15.6:0/3960087835 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7ff0700663d0 0x7ff070068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.290+0000 7ff091d60640 1 --2- 172.21.15.6:0/3960087835 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7ff0700663d0 0x7ff070068880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff07c0ae000 tx=0x7ff07c001a80 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:41.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.298+0000 7ff082ffd640 1 -- 172.21.15.6:0/3960087835 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff088051410 con 0x7ff0780043b0 2023-07-21T22:55:41.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:41.486+0000 7ff0947c5640 1 -- 172.21.15.6:0/3960087835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff08c0b2a90 con 0x7ff0780043b0 2023-07-21T22:55:42.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.418+0000 7ff082ffd640 1 -- 172.21.15.6:0/3960087835 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v77) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff088054a30 con 0x7ff0780043b0 2023-07-21T22:55:42.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.426+0000 7ff0947c5640 1 -- 172.21.15.6:0/3960087835 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7ff0700663d0 msgr2=0x7ff070068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.426+0000 7ff0947c5640 1 --2- 172.21.15.6:0/3960087835 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7ff0700663d0 0x7ff070068880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff07c0ae000 tx=0x7ff07c001a80 comp rx=0 tx=0).stop 2023-07-21T22:55:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.426+0000 7ff0947c5640 1 -- 172.21.15.6:0/3960087835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0780043b0 msgr2=0x7ff08c14afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:42.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.426+0000 7ff0947c5640 1 --2- 172.21.15.6:0/3960087835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0780043b0 0x7ff08c14afd0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7ff08800e920 tx=0x7ff08800ede0 comp rx=0 tx=0).stop 2023-07-21T22:55:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.426+0000 7ff0947c5640 1 -- 172.21.15.6:0/3960087835 shutdown_connections 2023-07-21T22:55:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.426+0000 7ff0947c5640 1 --2- 172.21.15.6:0/3960087835 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7ff0700663d0 0x7ff070068880 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:42.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.426+0000 7ff0947c5640 1 --2- 172.21.15.6:0/3960087835 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff08c0c6420 0x7ff08c0c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.426+0000 7ff0947c5640 1 --2- 172.21.15.6:0/3960087835 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff08c159c40 0x7ff08c14a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.426+0000 7ff0947c5640 1 --2- 172.21.15.6:0/3960087835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0780043b0 0x7ff08c14afd0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.426+0000 7ff0947c5640 1 -- 172.21.15.6:0/3960087835 >> 172.21.15.6:0/3960087835 conn(0x7ff08c099490 msgr2=0x7ff08c0b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:42.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.426+0000 7ff0947c5640 1 -- 172.21.15.6:0/3960087835 shutdown_connections 2023-07-21T22:55:42.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.426+0000 7ff0947c5640 1 -- 172.21.15.6:0/3960087835 wait complete. 2023-07-21T22:55:42.485 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-21T22:55:42.485 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-21T22:55:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.602+0000 7fbca4774640 1 Processor -- start 2023-07-21T22:55:42.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.602+0000 7fbca4774640 1 -- start start 2023-07-21T22:55:42.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.602+0000 7fbca4774640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc9c0aeb40 0x7fbc9c15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:42.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.602+0000 7fbca4774640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbc9c0aef10 0x7fbc9c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:42.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.602+0000 7fbca4774640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9c1532b0 con 0x7fbc9c159270 2023-07-21T22:55:42.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.602+0000 7fbca4774640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9c0ca6f0 con 0x7fbc9c0aef10 2023-07-21T22:55:42.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.602+0000 7fbca4774640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c1599d0 con 0x7fbc9c0aeb40 2023-07-21T22:55:42.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.602+0000 7fbca1d0f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbc9c0aef10 0x7fbc9c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:42.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.602+0000 7fbca1d0f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbc9c0aef10 0x7fbc9c158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53662/0 (socket says 172.21.15.6:53662) 2023-07-21T22:55:42.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.602+0000 7fbca1d0f640 1 -- 172.21.15.6:0/3899210645 learned_addr learned my addr 172.21.15.6:0/3899210645 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:42.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.602+0000 7fbca2510640 1 --2- 172.21.15.6:0/3899210645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc9c0aeb40 0x7fbc9c15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:42.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.602+0000 7fbca1d0f640 1 -- 172.21.15.6:0/3899210645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc9c0aeb40 msgr2=0x7fbc9c15cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:42.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.602+0000 7fbca1d0f640 1 --2- 172.21.15.6:0/3899210645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc9c0aeb40 0x7fbc9c15cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:42.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.602+0000 7fbca1d0f640 1 -- 172.21.15.6:0/3899210645 >> v1:172.21.15.161:6789/0 conn(0x7fbc9c159270 legacy=0x7fbc9c0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:42.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.602+0000 7fbca1d0f640 1 -- 172.21.15.6:0/3899210645 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c159cb0 con 0x7fbc9c0aef10 2023-07-21T22:55:42.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.602+0000 7fbca2510640 1 --2- 172.21.15.6:0/3899210645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc9c0aeb40 0x7fbc9c15cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:42.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.610+0000 7fbca1d0f640 1 --2- 172.21.15.6:0/3899210645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc9c0aef10 0x7fbc9c158d30 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c009870 tx=0x7fbc8c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d9b3b6cfe654ed server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:42.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.610+0000 7fbca150e640 1 -- 172.21.15.6:0/3899210645 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c0ab680 con 0x7fbc9c0aef10 2023-07-21T22:55:42.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.610+0000 7fbca150e640 1 -- 172.21.15.6:0/3899210645 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8c0ab7e0 con 0x7fbc9c0aef10 2023-07-21T22:55:42.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.610+0000 7fbca150e640 1 -- 172.21.15.6:0/3899210645 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c0abb70 con 0x7fbc9c0aef10 2023-07-21T22:55:42.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.610+0000 7fbca4774640 1 -- 172.21.15.6:0/3899210645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc9c0aef10 msgr2=0x7fbc9c158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:42.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.610+0000 7fbca4774640 1 --2- 172.21.15.6:0/3899210645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc9c0aef10 0x7fbc9c158d30 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c009870 tx=0x7fbc8c01c480 comp rx=0 tx=0).stop 2023-07-21T22:55:42.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.610+0000 7fbca4774640 1 -- 172.21.15.6:0/3899210645 shutdown_connections 2023-07-21T22:55:42.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.610+0000 7fbca4774640 1 --2- 172.21.15.6:0/3899210645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc9c0aef10 0x7fbc9c158d30 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:42.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.610+0000 7fbca4774640 1 --2- 172.21.15.6:0/3899210645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc9c0aeb40 0x7fbc9c15cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:42.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.610+0000 7fbca4774640 1 -- 172.21.15.6:0/3899210645 >> 172.21.15.6:0/3899210645 conn(0x7fbc9c0cde90 msgr2=0x7fbc9c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:42.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.610+0000 7fbca4774640 1 -- 172.21.15.6:0/3899210645 shutdown_connections 2023-07-21T22:55:42.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.610+0000 7fbca4774640 1 -- 172.21.15.6:0/3899210645 wait complete. 2023-07-21T22:55:42.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.610+0000 7fbca4774640 1 Processor -- start 2023-07-21T22:55:42.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.610+0000 7fbca4774640 1 -- start start 2023-07-21T22:55:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca4774640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc9c0aeb40 0x7fbc9c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca4774640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc9c0aef10 0x7fbc9c140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca4774640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc9c159270 0x7fbc9c0b2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca4774640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c0711e0 con 0x7fbc9c0aeb40 2023-07-21T22:55:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca4774640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c070560 con 0x7fbc9c0aef10 2023-07-21T22:55:42.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca4774640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c070840 con 0x7fbc9c159270 2023-07-21T22:55:42.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca2510640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc9c0aeb40 0x7fbc9c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:42.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca2510640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc9c0aeb40 0x7fbc9c06ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53668/0 (socket says 172.21.15.6:53668) 2023-07-21T22:55:42.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca2510640 1 -- 172.21.15.6:0/2215270328 learned_addr learned my addr 172.21.15.6:0/2215270328 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:42.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca1d0f640 1 --2- 172.21.15.6:0/2215270328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc9c0aef10 0x7fbc9c140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:42.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca2d11640 1 --2- 172.21.15.6:0/2215270328 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc9c159270 0x7fbc9c0b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:42.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca2510640 1 -- 172.21.15.6:0/2215270328 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc9c159270 msgr2=0x7fbc9c0b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:42.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca2510640 1 --2- 172.21.15.6:0/2215270328 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc9c159270 0x7fbc9c0b2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:42.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca2510640 1 -- 172.21.15.6:0/2215270328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc9c0aef10 msgr2=0x7fbc9c140730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:42.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca2510640 1 --2- 172.21.15.6:0/2215270328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc9c0aef10 0x7fbc9c140730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:42.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca2510640 1 -- 172.21.15.6:0/2215270328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8c0094d0 con 0x7fbc9c0aeb40 2023-07-21T22:55:42.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca1d0f640 1 --2- 172.21.15.6:0/2215270328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc9c0aef10 0x7fbc9c140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:42.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca2510640 1 --2- 172.21.15.6:0/2215270328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc9c0aeb40 0x7fbc9c06ff50 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800e810 tx=0x7fbc9800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:42.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbc92ffd640 1 -- 172.21.15.6:0/2215270328 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9800c8d0 con 0x7fbc9c0aeb40 2023-07-21T22:55:42.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbc92ffd640 1 -- 172.21.15.6:0/2215270328 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9800ca30 con 0x7fbc9c0aeb40 2023-07-21T22:55:42.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbc92ffd640 1 -- 172.21.15.6:0/2215270328 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9800cde0 con 0x7fbc9c0aeb40 2023-07-21T22:55:42.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca4774640 1 -- 172.21.15.6:0/2215270328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9c070b20 con 0x7fbc9c0aeb40 2023-07-21T22:55:42.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca4774640 1 -- 172.21.15.6:0/2215270328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9c15b3e0 con 0x7fbc9c0aeb40 2023-07-21T22:55:42.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbca4774640 1 -- 172.21.15.6:0/2215270328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9c0678d0 con 0x7fbc9c0aeb40 2023-07-21T22:55:42.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.614+0000 7fbc92ffd640 1 -- 172.21.15.6:0/2215270328 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbc98013410 con 0x7fbc9c0aeb40 2023-07-21T22:55:42.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.618+0000 7fbc92ffd640 1 --2- 172.21.15.6:0/2215270328 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbc800663a0 0x7fbc80068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:42.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.618+0000 7fbc92ffd640 1 -- 172.21.15.6:0/2215270328 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fbc98083eb0 con 0x7fbc9c0aeb40 2023-07-21T22:55:42.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.618+0000 7fbca1d0f640 1 --2- 172.21.15.6:0/2215270328 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbc800663a0 0x7fbc80068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:42.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.618+0000 7fbca1d0f640 1 --2- 172.21.15.6:0/2215270328 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbc800663a0 0x7fbc80068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0af000 tx=0x7fbc8c0a7000 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:42.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.622+0000 7fbc92ffd640 1 -- 172.21.15.6:0/2215270328 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbc98051020 con 0x7fbc9c0aeb40 2023-07-21T22:55:42.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:42.810+0000 7fbca4774640 1 -- 172.21.15.6:0/2215270328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbc9c0c2ee0 con 0x7fbc9c0aeb40 2023-07-21T22:55:43.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.434+0000 7fbc92ffd640 1 -- 172.21.15.6:0/2215270328 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v78) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbc98054640 con 0x7fbc9c0aeb40 2023-07-21T22:55:43.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.434+0000 7fbca4774640 1 -- 172.21.15.6:0/2215270328 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbc800663a0 msgr2=0x7fbc80068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:43.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.434+0000 7fbca4774640 1 --2- 172.21.15.6:0/2215270328 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbc800663a0 0x7fbc80068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c0af000 tx=0x7fbc8c0a7000 comp rx=0 tx=0).stop 2023-07-21T22:55:43.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.434+0000 7fbca4774640 1 -- 172.21.15.6:0/2215270328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc9c0aeb40 msgr2=0x7fbc9c06ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:43.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.434+0000 7fbca4774640 1 --2- 172.21.15.6:0/2215270328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc9c0aeb40 0x7fbc9c06ff50 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800e810 tx=0x7fbc9800ecd0 comp rx=0 tx=0).stop 2023-07-21T22:55:43.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.434+0000 7fbca4774640 1 -- 172.21.15.6:0/2215270328 shutdown_connections 2023-07-21T22:55:43.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.434+0000 7fbca4774640 1 --2- 172.21.15.6:0/2215270328 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbc800663a0 0x7fbc80068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:43.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.434+0000 7fbca4774640 1 --2- 172.21.15.6:0/2215270328 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbc9c159270 0x7fbc9c0b2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:43.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.434+0000 7fbca4774640 1 --2- 172.21.15.6:0/2215270328 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc9c0aef10 0x7fbc9c140730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:43.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.434+0000 7fbca4774640 1 --2- 172.21.15.6:0/2215270328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc9c0aeb40 0x7fbc9c06ff50 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:43.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.434+0000 7fbca4774640 1 -- 172.21.15.6:0/2215270328 >> 172.21.15.6:0/2215270328 conn(0x7fbc9c0cde90 msgr2=0x7fbc9c0c88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:43.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.434+0000 7fbca4774640 1 -- 172.21.15.6:0/2215270328 shutdown_connections 2023-07-21T22:55:43.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.434+0000 7fbca4774640 1 -- 172.21.15.6:0/2215270328 wait complete. 2023-07-21T22:55:43.493 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-21T22:55:43.493 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:55:43.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.610+0000 7ff4b0e3a640 1 Processor -- start 2023-07-21T22:55:43.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.610+0000 7ff4b0e3a640 1 -- start start 2023-07-21T22:55:43.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.610+0000 7ff4b0e3a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff4ac0b42c0 0x7ff4ac06a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:43.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.610+0000 7ff4b0e3a640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff4ac0cee90 0x7ff4ac0d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:43.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.610+0000 7ff4b0e3a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4ac0ccee0 con 0x7ff4ac0b7a10 2023-07-21T22:55:43.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.610+0000 7ff4b0e3a640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ac0cff30 con 0x7ff4ac0cee90 2023-07-21T22:55:43.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.610+0000 7ff4b0e3a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4ac0cc920 con 0x7ff4ac0b42c0 2023-07-21T22:55:43.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.610+0000 7ff4abfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff4ac0cee90 0x7ff4ac0d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:43.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.610+0000 7ff4abfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff4ac0cee90 0x7ff4ac0d0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53684/0 (socket says 172.21.15.6:53684) 2023-07-21T22:55:43.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.610+0000 7ff4abfff640 1 -- 172.21.15.6:0/2497518766 learned_addr learned my addr 172.21.15.6:0/2497518766 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:43.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.610+0000 7ff4aaffd640 1 --2- 172.21.15.6:0/2497518766 >> v2:172.21.15.161:3300/0 conn(0x7ff4ac0b42c0 0x7ff4ac06a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:43.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.610+0000 7ff4abfff640 1 -- 172.21.15.6:0/2497518766 >> v2:172.21.15.161:3300/0 conn(0x7ff4ac0b42c0 msgr2=0x7ff4ac06a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:43.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.610+0000 7ff4abfff640 1 --2- 172.21.15.6:0/2497518766 >> v2:172.21.15.161:3300/0 conn(0x7ff4ac0b42c0 0x7ff4ac06a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:43.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.610+0000 7ff4abfff640 1 -- 172.21.15.6:0/2497518766 >> v1:172.21.15.161:6789/0 conn(0x7ff4ac0b7a10 legacy=0x7ff4ac0b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:43.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.610+0000 7ff4abfff640 1 -- 172.21.15.6:0/2497518766 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac0ccc00 con 0x7ff4ac0cee90 2023-07-21T22:55:43.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.614+0000 7ff4abfff640 1 --2- 172.21.15.6:0/2497518766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ac0cee90 0x7ff4ac0d0380 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac0cfc30 tx=0x7ff4a401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff5cee385eee988 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:43.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.614+0000 7ff4aa7fc640 1 -- 172.21.15.6:0/2497518766 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a40a5840 con 0x7ff4ac0cee90 2023-07-21T22:55:43.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.614+0000 7ff4aa7fc640 1 -- 172.21.15.6:0/2497518766 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a40a59a0 con 0x7ff4ac0cee90 2023-07-21T22:55:43.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.614+0000 7ff4aa7fc640 1 -- 172.21.15.6:0/2497518766 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a40a5d30 con 0x7ff4ac0cee90 2023-07-21T22:55:43.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.614+0000 7ff4b0e3a640 1 -- 172.21.15.6:0/2497518766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ac0cee90 msgr2=0x7ff4ac0d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:43.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.614+0000 7ff4b0e3a640 1 --2- 172.21.15.6:0/2497518766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ac0cee90 0x7ff4ac0d0380 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac0cfc30 tx=0x7ff4a401c960 comp rx=0 tx=0).stop 2023-07-21T22:55:43.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.614+0000 7ff4b0e3a640 1 -- 172.21.15.6:0/2497518766 shutdown_connections 2023-07-21T22:55:43.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.614+0000 7ff4b0e3a640 1 --2- 172.21.15.6:0/2497518766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ac0cee90 0x7ff4ac0d0380 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:43.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.614+0000 7ff4b0e3a640 1 --2- 172.21.15.6:0/2497518766 >> v2:172.21.15.161:3300/0 conn(0x7ff4ac0b42c0 0x7ff4ac06a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:43.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.614+0000 7ff4b0e3a640 1 -- 172.21.15.6:0/2497518766 >> 172.21.15.6:0/2497518766 conn(0x7ff4ac069ea0 msgr2=0x7ff4ac06a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:43.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.614+0000 7ff4b0e3a640 1 -- 172.21.15.6:0/2497518766 shutdown_connections 2023-07-21T22:55:43.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.614+0000 7ff4b0e3a640 1 -- 172.21.15.6:0/2497518766 wait complete. 2023-07-21T22:55:43.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.614+0000 7ff4b0e3a640 1 Processor -- start 2023-07-21T22:55:43.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.614+0000 7ff4b0e3a640 1 -- start start 2023-07-21T22:55:43.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff4b0e3a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4ac0b42c0 0x7ff4ac15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:43.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff4b0e3a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4ac0b7a10 0x7ff4ac158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:43.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff4b0e3a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ac0cee90 0x7ff4ac15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:43.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff4b0e3a640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac158cd0 con 0x7ff4ac0cee90 2023-07-21T22:55:43.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff4b0e3a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac15c460 con 0x7ff4ac0b7a10 2023-07-21T22:55:43.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff4b0e3a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac15c740 con 0x7ff4ac0b42c0 2023-07-21T22:55:43.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff4abfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ac0cee90 0x7ff4ac15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:43.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff4abfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ac0cee90 0x7ff4ac15b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53692/0 (socket says 172.21.15.6:53692) 2023-07-21T22:55:43.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff4abfff640 1 -- 172.21.15.6:0/629421644 learned_addr learned my addr 172.21.15.6:0/629421644 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:43.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff4ab7fe640 1 --2- 172.21.15.6:0/629421644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4ac0b42c0 0x7ff4ac15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:43.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff4aaffd640 1 --2- 172.21.15.6:0/629421644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4ac0b7a10 0x7ff4ac158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:43.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff4abfff640 1 -- 172.21.15.6:0/629421644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4ac0b42c0 msgr2=0x7ff4ac15dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:43.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff4abfff640 1 --2- 172.21.15.6:0/629421644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4ac0b42c0 0x7ff4ac15dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:43.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff4abfff640 1 -- 172.21.15.6:0/629421644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4ac0b7a10 msgr2=0x7ff4ac158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:43.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff4abfff640 1 --2- 172.21.15.6:0/629421644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4ac0b7a10 0x7ff4ac158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:43.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff4abfff640 1 -- 172.21.15.6:0/629421644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a4009b30 con 0x7ff4ac0cee90 2023-07-21T22:55:43.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff4abfff640 1 --2- 172.21.15.6:0/629421644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ac0cee90 0x7ff4ac15b0a0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7ff4a401a590 tx=0x7ff4a4019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:43.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff493fff640 1 -- 172.21.15.6:0/629421644 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a40b8880 con 0x7ff4ac0cee90 2023-07-21T22:55:43.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff493fff640 1 -- 172.21.15.6:0/629421644 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a40b8a00 con 0x7ff4ac0cee90 2023-07-21T22:55:43.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff493fff640 1 -- 172.21.15.6:0/629421644 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a40b8db0 con 0x7ff4ac0cee90 2023-07-21T22:55:43.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff4b0e3a640 1 -- 172.21.15.6:0/629421644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ac15ca20 con 0x7ff4ac0cee90 2023-07-21T22:55:43.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff4b0e3a640 1 -- 172.21.15.6:0/629421644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ac15cfe0 con 0x7ff4ac0cee90 2023-07-21T22:55:43.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.618+0000 7ff4b0e3a640 1 -- 172.21.15.6:0/629421644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ac15d1d0 con 0x7ff4ac0cee90 2023-07-21T22:55:43.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.622+0000 7ff493fff640 1 -- 172.21.15.6:0/629421644 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff4a40c3460 con 0x7ff4ac0cee90 2023-07-21T22:55:43.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.622+0000 7ff493fff640 1 --2- 172.21.15.6:0/629421644 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7ff4980663a0 0x7ff498068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:43.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.622+0000 7ff493fff640 1 -- 172.21.15.6:0/629421644 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6134+0+0 (secure 0 0 0) 0x7ff4a411f840 con 0x7ff4ac0cee90 2023-07-21T22:55:43.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.622+0000 7ff4ab7fe640 1 --2- 172.21.15.6:0/629421644 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7ff4980663a0 0x7ff498068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:43.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.622+0000 7ff4ab7fe640 1 --2- 172.21.15.6:0/629421644 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7ff4980663a0 0x7ff498068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff49c007fd0 tx=0x7ff49c007e40 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:43.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.626+0000 7ff493fff640 1 -- 172.21.15.6:0/629421644 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff4a40ecca0 con 0x7ff4ac0cee90 2023-07-21T22:55:43.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.814+0000 7ff4b0e3a640 1 -- 172.21.15.6:0/629421644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4ac15d1d0 con 0x7ff4ac0cee90 2023-07-21T22:55:43.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.814+0000 7ff493fff640 1 -- 172.21.15.6:0/629421644 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4675 (secure 0 0 0) 0x7ff4a40f02c0 con 0x7ff4ac0cee90 2023-07-21T22:55:43.851 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:43.851 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9508,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/1909144233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1909144233},{"type":"v1","addr":"172.21.15.161:6836","nonce":1909144233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9511,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1479759663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1479759663},{"type":"v1","addr":"172.21.15.161:6837","nonce":1479759663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9954,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2241291399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2241291399},{"type":"v1","addr":"172.21.15.6:6834","nonce":2241291399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:55:39.784030+0000","modified":"2023-07-21T22:55:43.422319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9957},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9957":{"gid":9957,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1921950839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1921950839},{"type":"v1","addr":"172.21.15.6:6835","nonce":1921950839}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-21T22:55:43.853 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 78 2023-07-21T22:55:43.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.818+0000 7ff4b0e3a640 1 -- 172.21.15.6:0/629421644 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7ff4980663a0 msgr2=0x7ff498068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:43.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.818+0000 7ff4b0e3a640 1 --2- 172.21.15.6:0/629421644 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7ff4980663a0 0x7ff498068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff49c007fd0 tx=0x7ff49c007e40 comp rx=0 tx=0).stop 2023-07-21T22:55:43.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.818+0000 7ff4b0e3a640 1 -- 172.21.15.6:0/629421644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ac0cee90 msgr2=0x7ff4ac15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:43.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.818+0000 7ff4b0e3a640 1 --2- 172.21.15.6:0/629421644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ac0cee90 0x7ff4ac15b0a0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7ff4a401a590 tx=0x7ff4a4019700 comp rx=0 tx=0).stop 2023-07-21T22:55:43.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.818+0000 7ff4b0e3a640 1 -- 172.21.15.6:0/629421644 shutdown_connections 2023-07-21T22:55:43.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.818+0000 7ff4b0e3a640 1 --2- 172.21.15.6:0/629421644 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7ff4980663a0 0x7ff498068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:43.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.818+0000 7ff4b0e3a640 1 --2- 172.21.15.6:0/629421644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4ac0cee90 0x7ff4ac15b0a0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:43.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.818+0000 7ff4b0e3a640 1 --2- 172.21.15.6:0/629421644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4ac0b7a10 0x7ff4ac158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:43.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.818+0000 7ff4b0e3a640 1 --2- 172.21.15.6:0/629421644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff4ac0b42c0 0x7ff4ac15dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:43.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.818+0000 7ff4b0e3a640 1 -- 172.21.15.6:0/629421644 >> 172.21.15.6:0/629421644 conn(0x7ff4ac069ea0 msgr2=0x7ff4ac0ce6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:43.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.818+0000 7ff4b0e3a640 1 -- 172.21.15.6:0/629421644 shutdown_connections 2023-07-21T22:55:43.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.818+0000 7ff4b0e3a640 1 -- 172.21.15.6:0/629421644 wait complete. 2023-07-21T22:55:43.871 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:55:44.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.982+0000 7fed169fa640 1 Processor -- start 2023-07-21T22:55:44.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.982+0000 7fed169fa640 1 -- start start 2023-07-21T22:55:44.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.982+0000 7fed169fa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fed100d06b0 0x7fed100b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.982+0000 7fed169fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed10145430 0x7fed100b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.982+0000 7fed169fa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed100b1f70 0x7fed100d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.982+0000 7fed169fa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed100b2410 con 0x7fed100b1f70 2023-07-21T22:55:44.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.982+0000 7fed169fa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed100b26f0 con 0x7fed100d06b0 2023-07-21T22:55:44.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.982+0000 7fed169fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed100b29d0 con 0x7fed10145430 2023-07-21T22:55:44.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.982+0000 7fed14f97640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed100b1f70 0x7fed100d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.982+0000 7fed14f97640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fed100b1f70 0x7fed100d22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53708/0 (socket says 172.21.15.6:53708) 2023-07-21T22:55:44.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.982+0000 7fed14f97640 1 -- 172.21.15.6:0/2103899994 learned_addr learned my addr 172.21.15.6:0/2103899994 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:44.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.982+0000 7fed0f7fe640 1 --2- 172.21.15.6:0/2103899994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed10145430 0x7fed100b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.982+0000 7fed0ffff640 1 --2- 172.21.15.6:0/2103899994 >> v2:172.21.15.161:3300/0 conn(0x7fed100d06b0 0x7fed100b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.982+0000 7fed14f97640 1 -- 172.21.15.6:0/2103899994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed10145430 msgr2=0x7fed100b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:44.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.982+0000 7fed14f97640 1 --2- 172.21.15.6:0/2103899994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed10145430 0x7fed100b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.982+0000 7fed14f97640 1 -- 172.21.15.6:0/2103899994 >> v2:172.21.15.161:3300/0 conn(0x7fed100d06b0 msgr2=0x7fed100b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:44.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.982+0000 7fed14f97640 1 --2- 172.21.15.6:0/2103899994 >> v2:172.21.15.161:3300/0 conn(0x7fed100d06b0 0x7fed100b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.982+0000 7fed14f97640 1 -- 172.21.15.6:0/2103899994 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed100b2cb0 con 0x7fed100b1f70 2023-07-21T22:55:44.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.986+0000 7fed14f97640 1 --2- 172.21.15.6:0/2103899994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed100b1f70 0x7fed100d22e0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fed1008b420 tx=0x7fed0801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aefb188b12432f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:44.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.986+0000 7fed0effd640 1 -- 172.21.15.6:0/2103899994 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed080a5840 con 0x7fed100b1f70 2023-07-21T22:55:44.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.986+0000 7fed0effd640 1 -- 172.21.15.6:0/2103899994 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed080a59a0 con 0x7fed100b1f70 2023-07-21T22:55:44.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.986+0000 7fed0effd640 1 -- 172.21.15.6:0/2103899994 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed080a5d30 con 0x7fed100b1f70 2023-07-21T22:55:44.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.986+0000 7fed169fa640 1 -- 172.21.15.6:0/2103899994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed100b1f70 msgr2=0x7fed100d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.986+0000 7fed169fa640 1 --2- 172.21.15.6:0/2103899994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed100b1f70 0x7fed100d22e0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fed1008b420 tx=0x7fed0801c9a0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.986+0000 7fed169fa640 1 -- 172.21.15.6:0/2103899994 shutdown_connections 2023-07-21T22:55:44.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.986+0000 7fed169fa640 1 --2- 172.21.15.6:0/2103899994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed100b1f70 0x7fed100d22e0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.986+0000 7fed169fa640 1 --2- 172.21.15.6:0/2103899994 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed10145430 0x7fed100b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.986+0000 7fed169fa640 1 --2- 172.21.15.6:0/2103899994 >> v2:172.21.15.161:3300/0 conn(0x7fed100d06b0 0x7fed100b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.986+0000 7fed169fa640 1 -- 172.21.15.6:0/2103899994 >> 172.21.15.6:0/2103899994 conn(0x7fed100659d0 msgr2=0x7fed1009b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:44.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.986+0000 7fed169fa640 1 -- 172.21.15.6:0/2103899994 shutdown_connections 2023-07-21T22:55:44.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.986+0000 7fed169fa640 1 -- 172.21.15.6:0/2103899994 wait complete. 2023-07-21T22:55:44.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed169fa640 1 Processor -- start 2023-07-21T22:55:44.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed169fa640 1 -- start start 2023-07-21T22:55:44.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed169fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed100b1f70 0x7fed100c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed169fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed100d06b0 0x7fed100c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed169fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed10156260 0x7fed1015fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed169fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed100c4870 con 0x7fed10156260 2023-07-21T22:55:44.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed169fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed100c3ba0 con 0x7fed100d06b0 2023-07-21T22:55:44.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed169fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed100c59d0 con 0x7fed100b1f70 2023-07-21T22:55:44.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed14f97640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed10156260 0x7fed1015fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed14f97640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed10156260 0x7fed1015fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53720/0 (socket says 172.21.15.6:53720) 2023-07-21T22:55:44.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed14f97640 1 -- 172.21.15.6:0/1166644585 learned_addr learned my addr 172.21.15.6:0/1166644585 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:44.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed0f7fe640 1 --2- 172.21.15.6:0/1166644585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed100d06b0 0x7fed100c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed0ffff640 1 --2- 172.21.15.6:0/1166644585 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed100b1f70 0x7fed100c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed14f97640 1 -- 172.21.15.6:0/1166644585 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed100b1f70 msgr2=0x7fed100c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed14f97640 1 --2- 172.21.15.6:0/1166644585 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed100b1f70 0x7fed100c4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed14f97640 1 -- 172.21.15.6:0/1166644585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed100d06b0 msgr2=0x7fed100c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed14f97640 1 --2- 172.21.15.6:0/1166644585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed100d06b0 0x7fed100c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed14f97640 1 -- 172.21.15.6:0/1166644585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed08009b30 con 0x7fed10156260 2023-07-21T22:55:44.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed14f97640 1 --2- 172.21.15.6:0/1166644585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed10156260 0x7fed1015fc90 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fed0801d240 tx=0x7fed08019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:44.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed0cff9640 1 -- 172.21.15.6:0/1166644585 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed080b8670 con 0x7fed10156260 2023-07-21T22:55:44.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed0cff9640 1 -- 172.21.15.6:0/1166644585 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed080b87f0 con 0x7fed10156260 2023-07-21T22:55:44.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed169fa640 1 -- 172.21.15.6:0/1166644585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed100c41f0 con 0x7fed10156260 2023-07-21T22:55:44.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed0cff9640 1 -- 172.21.15.6:0/1166644585 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed080b8ba0 con 0x7fed10156260 2023-07-21T22:55:44.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.990+0000 7fed169fa640 1 -- 172.21.15.6:0/1166644585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed100c38c0 con 0x7fed10156260 2023-07-21T22:55:44.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.994+0000 7fed169fa640 1 -- 172.21.15.6:0/1166644585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed10072e70 con 0x7fed10156260 2023-07-21T22:55:44.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.994+0000 7fed0cff9640 1 -- 172.21.15.6:0/1166644585 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fed080b8d00 con 0x7fed10156260 2023-07-21T22:55:44.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.994+0000 7fed0cff9640 1 --2- 172.21.15.6:0/1166644585 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fecfc0663a0 0x7fecfc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.994+0000 7fed0cff9640 1 -- 172.21.15.6:0/1166644585 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fed0811f2d0 con 0x7fed10156260 2023-07-21T22:55:44.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.994+0000 7fed0ffff640 1 --2- 172.21.15.6:0/1166644585 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fecfc0663a0 0x7fecfc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.994+0000 7fed0ffff640 1 --2- 172.21.15.6:0/1166644585 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fecfc0663a0 0x7fecfc068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fed1015bef0 tx=0x7fed00009190 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:44.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:43.998+0000 7fed0cff9640 1 -- 172.21.15.6:0/1166644585 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed080ec690 con 0x7fed10156260 2023-07-21T22:55:44.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.158+0000 7fed169fa640 1 -- 172.21.15.6:0/1166644585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed100c4050 con 0x7fed10156260 2023-07-21T22:55:44.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.158+0000 7fed0cff9640 1 -- 172.21.15.6:0/1166644585 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+18344 (secure 0 0 0) 0x7fed100c4050 con 0x7fed10156260 2023-07-21T22:55:44.192 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:44.193 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":174,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:55:41.398297+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:55:37.909970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-21T22:55:38.777920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:55:44.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.158+0000 7fed169fa640 1 -- 172.21.15.6:0/1166644585 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fecfc0663a0 msgr2=0x7fecfc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.158+0000 7fed169fa640 1 --2- 172.21.15.6:0/1166644585 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fecfc0663a0 0x7fecfc068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fed1015bef0 tx=0x7fed00009190 comp rx=0 tx=0).stop 2023-07-21T22:55:44.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.158+0000 7fed169fa640 1 -- 172.21.15.6:0/1166644585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed10156260 msgr2=0x7fed1015fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.158+0000 7fed169fa640 1 --2- 172.21.15.6:0/1166644585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed10156260 0x7fed1015fc90 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fed0801d240 tx=0x7fed08019740 comp rx=0 tx=0).stop 2023-07-21T22:55:44.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.158+0000 7fed169fa640 1 -- 172.21.15.6:0/1166644585 shutdown_connections 2023-07-21T22:55:44.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.158+0000 7fed169fa640 1 --2- 172.21.15.6:0/1166644585 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fecfc0663a0 0x7fecfc068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.158+0000 7fed169fa640 1 --2- 172.21.15.6:0/1166644585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed10156260 0x7fed1015fc90 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.158+0000 7fed169fa640 1 --2- 172.21.15.6:0/1166644585 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed100d06b0 0x7fed100c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.162+0000 7fed169fa640 1 --2- 172.21.15.6:0/1166644585 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed100b1f70 0x7fed100c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.162+0000 7fed169fa640 1 -- 172.21.15.6:0/1166644585 >> 172.21.15.6:0/1166644585 conn(0x7fed100659d0 msgr2=0x7fed1015cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:44.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.162+0000 7fed169fa640 1 -- 172.21.15.6:0/1166644585 shutdown_connections 2023-07-21T22:55:44.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.162+0000 7fed169fa640 1 -- 172.21.15.6:0/1166644585 wait complete. 2023-07-21T22:55:44.214 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T22:55:44.215 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:55:44.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.326+0000 7fab25a34640 1 Processor -- start 2023-07-21T22:55:44.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.326+0000 7fab25a34640 1 -- start start 2023-07-21T22:55:44.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.326+0000 7fab25a34640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fab20158ce0 0x7fab20070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.326+0000 7fab25a34640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fab200c9730 0x7fab200ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.326+0000 7fab25a34640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab200cc700 con 0x7fab200c8ad0 2023-07-21T22:55:44.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.326+0000 7fab25a34640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab200b0ff0 con 0x7fab200c9730 2023-07-21T22:55:44.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.326+0000 7fab25a34640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab20070c80 con 0x7fab20158ce0 2023-07-21T22:55:44.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.326+0000 7fab1f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fab200c9730 0x7fab200ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.326+0000 7fab1f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fab200c9730 0x7fab200ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53722/0 (socket says 172.21.15.6:53722) 2023-07-21T22:55:44.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.326+0000 7fab1f7fe640 1 -- 172.21.15.6:0/3160364878 learned_addr learned my addr 172.21.15.6:0/3160364878 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:44.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.326+0000 7fab1effd640 1 --2- 172.21.15.6:0/3160364878 >> v2:172.21.15.161:3300/0 conn(0x7fab20158ce0 0x7fab20070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.326+0000 7fab1f7fe640 1 -- 172.21.15.6:0/3160364878 >> v2:172.21.15.161:3300/0 conn(0x7fab20158ce0 msgr2=0x7fab20070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:44.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.326+0000 7fab1f7fe640 1 --2- 172.21.15.6:0/3160364878 >> v2:172.21.15.161:3300/0 conn(0x7fab20158ce0 0x7fab20070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.326+0000 7fab1f7fe640 1 -- 172.21.15.6:0/3160364878 >> v1:172.21.15.161:6789/0 conn(0x7fab200c8ad0 legacy=0x7fab200c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.326+0000 7fab1f7fe640 1 -- 172.21.15.6:0/3160364878 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab200cbdd0 con 0x7fab200c9730 2023-07-21T22:55:44.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.330+0000 7fab1f7fe640 1 --2- 172.21.15.6:0/3160364878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab200c9730 0x7fab200ccb90 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fab20071be0 tx=0x7fab1801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfaff53e735eb161 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:44.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.330+0000 7fab1e7fc640 1 -- 172.21.15.6:0/3160364878 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180a5650 con 0x7fab200c9730 2023-07-21T22:55:44.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.330+0000 7fab1e7fc640 1 -- 172.21.15.6:0/3160364878 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab180a57b0 con 0x7fab200c9730 2023-07-21T22:55:44.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.330+0000 7fab1e7fc640 1 -- 172.21.15.6:0/3160364878 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180a5b40 con 0x7fab200c9730 2023-07-21T22:55:44.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.330+0000 7fab25a34640 1 -- 172.21.15.6:0/3160364878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab200c9730 msgr2=0x7fab200ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.330+0000 7fab25a34640 1 --2- 172.21.15.6:0/3160364878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab200c9730 0x7fab200ccb90 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fab20071be0 tx=0x7fab1801c880 comp rx=0 tx=0).stop 2023-07-21T22:55:44.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.330+0000 7fab25a34640 1 -- 172.21.15.6:0/3160364878 shutdown_connections 2023-07-21T22:55:44.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.330+0000 7fab25a34640 1 --2- 172.21.15.6:0/3160364878 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab200c9730 0x7fab200ccb90 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.330+0000 7fab25a34640 1 --2- 172.21.15.6:0/3160364878 >> v2:172.21.15.161:3300/0 conn(0x7fab20158ce0 0x7fab20070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.330+0000 7fab25a34640 1 -- 172.21.15.6:0/3160364878 >> 172.21.15.6:0/3160364878 conn(0x7fab200afcf0 msgr2=0x7fab200b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:44.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.330+0000 7fab25a34640 1 -- 172.21.15.6:0/3160364878 shutdown_connections 2023-07-21T22:55:44.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.330+0000 7fab25a34640 1 -- 172.21.15.6:0/3160364878 wait complete. 2023-07-21T22:55:44.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab25a34640 1 Processor -- start 2023-07-21T22:55:44.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab25a34640 1 -- start start 2023-07-21T22:55:44.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab25a34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab200c8ad0 0x7fab200c4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab25a34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab200c9730 0x7fab20159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab25a34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab20158ce0 0x7fab2015a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab25a34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab200c46a0 con 0x7fab200c8ad0 2023-07-21T22:55:44.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab25a34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab200c3cd0 con 0x7fab20158ce0 2023-07-21T22:55:44.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab25a34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab20159870 con 0x7fab200c9730 2023-07-21T22:55:44.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab1effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab200c8ad0 0x7fab200c4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab1effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab200c8ad0 0x7fab200c4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53730/0 (socket says 172.21.15.6:53730) 2023-07-21T22:55:44.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab1effd640 1 -- 172.21.15.6:0/1875398269 learned_addr learned my addr 172.21.15.6:0/1875398269 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:44.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab1f7fe640 1 --2- 172.21.15.6:0/1875398269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab20158ce0 0x7fab2015a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab17fff640 1 --2- 172.21.15.6:0/1875398269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab200c9730 0x7fab20159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab1effd640 1 -- 172.21.15.6:0/1875398269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab200c9730 msgr2=0x7fab20159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab1effd640 1 --2- 172.21.15.6:0/1875398269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab200c9730 0x7fab20159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab1effd640 1 -- 172.21.15.6:0/1875398269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab20158ce0 msgr2=0x7fab2015a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab1effd640 1 --2- 172.21.15.6:0/1875398269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab20158ce0 0x7fab2015a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab1effd640 1 -- 172.21.15.6:0/1875398269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab18009b30 con 0x7fab200c8ad0 2023-07-21T22:55:44.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab1f7fe640 1 --2- 172.21.15.6:0/1875398269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab20158ce0 0x7fab2015a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:44.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab1effd640 1 --2- 172.21.15.6:0/1875398269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab200c8ad0 0x7fab200c4160 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fab1000e8a0 tx=0x7fab1000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:44.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab1cff9640 1 -- 172.21.15.6:0/1875398269 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab10009510 con 0x7fab200c8ad0 2023-07-21T22:55:44.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab1cff9640 1 -- 172.21.15.6:0/1875398269 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1000c940 con 0x7fab200c8ad0 2023-07-21T22:55:44.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab25a34640 1 -- 172.21.15.6:0/1875398269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2015a740 con 0x7fab200c8ad0 2023-07-21T22:55:44.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab1cff9640 1 -- 172.21.15.6:0/1875398269 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1000ccb0 con 0x7fab200c8ad0 2023-07-21T22:55:44.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab25a34640 1 -- 172.21.15.6:0/1875398269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab200c33a0 con 0x7fab200c8ad0 2023-07-21T22:55:44.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.334+0000 7fab25a34640 1 -- 172.21.15.6:0/1875398269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab200ca1a0 con 0x7fab200c8ad0 2023-07-21T22:55:44.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.338+0000 7fab1cff9640 1 -- 172.21.15.6:0/1875398269 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fab10013470 con 0x7fab200c8ad0 2023-07-21T22:55:44.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.338+0000 7fab1cff9640 1 --2- 172.21.15.6:0/1875398269 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fab000663a0 0x7fab00068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.338+0000 7fab1cff9640 1 -- 172.21.15.6:0/1875398269 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fab10084400 con 0x7fab200c8ad0 2023-07-21T22:55:44.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.338+0000 7fab17fff640 1 --2- 172.21.15.6:0/1875398269 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fab000663a0 0x7fab00068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.338+0000 7fab17fff640 1 --2- 172.21.15.6:0/1875398269 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fab000663a0 0x7fab00068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fab2014d400 tx=0x7fab08009040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:44.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.342+0000 7fab1cff9640 1 -- 172.21.15.6:0/1875398269 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab10051680 con 0x7fab200c8ad0 2023-07-21T22:55:44.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.494+0000 7fab25a34640 1 -- 172.21.15.6:0/1875398269 --> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab201590b0 con 0x7fab000663a0 2023-07-21T22:55:44.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.506+0000 7fab1cff9640 1 -- 172.21.15.6:0/1875398269 <== mgr.9289 v2:172.21.15.161:6832/2346358146 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306469 (secure 0 0 0) 0x7fab08001370 con 0x7fab000663a0 2023-07-21T22:55:44.542 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:44.543 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:55:44.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.510+0000 7fab25a34640 1 -- 172.21.15.6:0/1875398269 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fab000663a0 msgr2=0x7fab00068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.510+0000 7fab25a34640 1 --2- 172.21.15.6:0/1875398269 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fab000663a0 0x7fab00068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fab2014d400 tx=0x7fab08009040 comp rx=0 tx=0).stop 2023-07-21T22:55:44.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.510+0000 7fab25a34640 1 -- 172.21.15.6:0/1875398269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab200c8ad0 msgr2=0x7fab200c4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.510+0000 7fab25a34640 1 --2- 172.21.15.6:0/1875398269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab200c8ad0 0x7fab200c4160 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fab1000e8a0 tx=0x7fab1000eca0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.510+0000 7fab25a34640 1 -- 172.21.15.6:0/1875398269 shutdown_connections 2023-07-21T22:55:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.510+0000 7fab25a34640 1 --2- 172.21.15.6:0/1875398269 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fab000663a0 0x7fab00068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.510+0000 7fab25a34640 1 --2- 172.21.15.6:0/1875398269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab20158ce0 0x7fab2015a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.510+0000 7fab25a34640 1 --2- 172.21.15.6:0/1875398269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab200c9730 0x7fab20159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.510+0000 7fab25a34640 1 --2- 172.21.15.6:0/1875398269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab200c8ad0 0x7fab200c4160 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.510+0000 7fab25a34640 1 -- 172.21.15.6:0/1875398269 >> 172.21.15.6:0/1875398269 conn(0x7fab200afcf0 msgr2=0x7fab20157f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.510+0000 7fab25a34640 1 -- 172.21.15.6:0/1875398269 shutdown_connections 2023-07-21T22:55:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.510+0000 7fab25a34640 1 -- 172.21.15.6:0/1875398269 wait complete. 2023-07-21T22:55:44.563 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-21T22:55:44.145145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":357232,"kb_used_data":17840,"kb_used_omap":0,"kb_used_meta":339328,"kb_avail":754617488,"statfs":{"total":773094113280,"available":772728307712,"internally_reserved":0,"allocated":18268160,"data_stored":9913296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":347471872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.762405"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.399624+0000","last_change":"2023-07-21T22:55:39.399624+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.399624+0000","last_undegraded":"2023-07-21T22:55:39.399624+0000","last_fullsized":"2023-07-21T22:55:39.399624+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.393154+0000","last_change":"2023-07-21T22:55:39.393154+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.393154+0000","last_undegraded":"2023-07-21T22:55:39.393154+0000","last_fullsized":"2023-07-21T22:55:39.393154+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.395530+0000","last_change":"2023-07-21T22:55:39.395530+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.395530+0000","last_undegraded":"2023-07-21T22:55:39.395530+0000","last_fullsized":"2023-07-21T22:55:39.395530+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.404333+0000","last_change":"2023-07-21T22:55:39.404333+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.404333+0000","last_undegraded":"2023-07-21T22:55:39.404333+0000","last_fullsized":"2023-07-21T22:55:39.404333+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.392099+0000","last_change":"2023-07-21T22:55:39.392099+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.392099+0000","last_undegraded":"2023-07-21T22:55:39.392099+0000","last_fullsized":"2023-07-21T22:55:39.392099+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390841+0000","last_change":"2023-07-21T22:55:39.390841+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390841+0000","last_undegraded":"2023-07-21T22:55:39.390841+0000","last_fullsized":"2023-07-21T22:55:39.390841+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.398437+0000","last_change":"2023-07-21T22:55:39.398437+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.398437+0000","last_undegraded":"2023-07-21T22:55:39.398437+0000","last_fullsized":"2023-07-21T22:55:39.398437+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.406996+0000","last_change":"2023-07-21T22:55:39.406996+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.406996+0000","last_undegraded":"2023-07-21T22:55:39.406996+0000","last_fullsized":"2023-07-21T22:55:39.406996+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.391293+0000","last_change":"2023-07-21T22:55:39.391293+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.391293+0000","last_undegraded":"2023-07-21T22:55:39.391293+0000","last_fullsized":"2023-07-21T22:55:39.391293+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389753+0000","last_change":"2023-07-21T22:55:39.389753+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389753+0000","last_undegraded":"2023-07-21T22:55:39.389753+0000","last_fullsized":"2023-07-21T22:55:39.389753+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.392664+0000","last_change":"2023-07-21T22:55:39.392664+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.392664+0000","last_undegraded":"2023-07-21T22:55:39.392664+0000","last_fullsized":"2023-07-21T22:55:39.392664+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.403881+0000","last_change":"2023-07-21T22:55:39.403881+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.403881+0000","last_undegraded":"2023-07-21T22:55:39.403881+0000","last_fullsized":"2023-07-21T22:55:39.403881+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.391610+0000","last_change":"2023-07-21T22:55:39.391610+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.391610+0000","last_undegraded":"2023-07-21T22:55:39.391610+0000","last_fullsized":"2023-07-21T22:55:39.391610+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.405647+0000","last_change":"2023-07-21T22:55:39.405647+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.405647+0000","last_undegraded":"2023-07-21T22:55:39.405647+0000","last_fullsized":"2023-07-21T22:55:39.405647+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.396468+0000","last_change":"2023-07-21T22:55:39.396468+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.396468+0000","last_undegraded":"2023-07-21T22:55:39.396468+0000","last_fullsized":"2023-07-21T22:55:39.396468+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389748+0000","last_change":"2023-07-21T22:55:39.389748+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389748+0000","last_undegraded":"2023-07-21T22:55:39.389748+0000","last_fullsized":"2023-07-21T22:55:39.389748+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.405747+0000","last_change":"2023-07-21T22:55:39.405747+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.405747+0000","last_undegraded":"2023-07-21T22:55:39.405747+0000","last_fullsized":"2023-07-21T22:55:39.405747+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390592+0000","last_change":"2023-07-21T22:55:39.390592+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390592+0000","last_undegraded":"2023-07-21T22:55:39.390592+0000","last_fullsized":"2023-07-21T22:55:39.390592+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400596+0000","last_change":"2023-07-21T22:55:39.400596+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400596+0000","last_undegraded":"2023-07-21T22:55:39.400596+0000","last_fullsized":"2023-07-21T22:55:39.400596+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.393035+0000","last_change":"2023-07-21T22:55:39.393035+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.393035+0000","last_undegraded":"2023-07-21T22:55:39.393035+0000","last_fullsized":"2023-07-21T22:55:39.393035+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389757+0000","last_change":"2023-07-21T22:55:39.389757+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389757+0000","last_undegraded":"2023-07-21T22:55:39.389757+0000","last_fullsized":"2023-07-21T22:55:39.389757+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.399359+0000","last_change":"2023-07-21T22:55:39.399359+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.399359+0000","last_undegraded":"2023-07-21T22:55:39.399359+0000","last_fullsized":"2023-07-21T22:55:39.399359+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.409241+0000","last_change":"2023-07-21T22:55:39.409241+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.409241+0000","last_undegraded":"2023-07-21T22:55:39.409241+0000","last_fullsized":"2023-07-21T22:55:39.409241+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390489+0000","last_change":"2023-07-21T22:55:39.390489+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390489+0000","last_undegraded":"2023-07-21T22:55:39.390489+0000","last_fullsized":"2023-07-21T22:55:39.390489+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.398600+0000","last_change":"2023-07-21T22:55:39.398600+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.398600+0000","last_undegraded":"2023-07-21T22:55:39.398600+0000","last_fullsized":"2023-07-21T22:55:39.398600+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400546+0000","last_change":"2023-07-21T22:55:39.400546+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400546+0000","last_undegraded":"2023-07-21T22:55:39.400546+0000","last_fullsized":"2023-07-21T22:55:39.400546+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389737+0000","last_change":"2023-07-21T22:55:39.389737+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389737+0000","last_undegraded":"2023-07-21T22:55:39.389737+0000","last_fullsized":"2023-07-21T22:55:39.389737+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389926+0000","last_change":"2023-07-21T22:55:39.389926+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389926+0000","last_undegraded":"2023-07-21T22:55:39.389926+0000","last_fullsized":"2023-07-21T22:55:39.389926+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.410559+0000","last_change":"2023-07-21T22:55:39.410559+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.410559+0000","last_undegraded":"2023-07-21T22:55:39.410559+0000","last_fullsized":"2023-07-21T22:55:39.410559+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.391617+0000","last_change":"2023-07-21T22:55:39.391617+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.391617+0000","last_undegraded":"2023-07-21T22:55:39.391617+0000","last_fullsized":"2023-07-21T22:55:39.391617+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390428+0000","last_change":"2023-07-21T22:55:39.390428+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390428+0000","last_undegraded":"2023-07-21T22:55:39.390428+0000","last_fullsized":"2023-07-21T22:55:39.390428+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.406454+0000","last_change":"2023-07-21T22:55:39.406454+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.406454+0000","last_undegraded":"2023-07-21T22:55:39.406454+0000","last_fullsized":"2023-07-21T22:55:39.406454+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.394271+0000","last_change":"2023-07-21T22:55:39.394271+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.394271+0000","last_undegraded":"2023-07-21T22:55:39.394271+0000","last_fullsized":"2023-07-21T22:55:39.394271+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.402955+0000","last_change":"2023-07-21T22:55:39.401202+0000","last_active":"2023-07-21T22:55:39.402955+0000","last_peered":"2023-07-21T22:55:39.402955+0000","last_clean":"2023-07-21T22:55:39.402955+0000","last_became_active":"2023-07-21T22:55:39.400656+0000","last_became_peered":"2023-07-21T22:55:39.400656+0000","last_unstale":"2023-07-21T22:55:39.402955+0000","last_undegraded":"2023-07-21T22:55:39.402955+0000","last_fullsized":"2023-07-21T22:55:39.402955+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:04.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.395074+0000","last_change":"2023-07-21T22:55:39.395074+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.395074+0000","last_undegraded":"2023-07-21T22:55:39.395074+0000","last_fullsized":"2023-07-21T22:55:39.395074+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.416584+0000","last_change":"2023-07-21T22:55:39.415451+0000","last_active":"2023-07-21T22:55:39.416584+0000","last_peered":"2023-07-21T22:55:39.416584+0000","last_clean":"2023-07-21T22:55:39.416584+0000","last_became_active":"2023-07-21T22:55:39.415164+0000","last_became_peered":"2023-07-21T22:55:39.415164+0000","last_unstale":"2023-07-21T22:55:39.416584+0000","last_undegraded":"2023-07-21T22:55:39.416584+0000","last_fullsized":"2023-07-21T22:55:39.416584+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:03:06.312844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.404288+0000","last_change":"2023-07-21T22:55:39.404288+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.404288+0000","last_undegraded":"2023-07-21T22:55:39.404288+0000","last_fullsized":"2023-07-21T22:55:39.404288+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.416031+0000","last_change":"2023-07-21T22:55:39.414669+0000","last_active":"2023-07-21T22:55:39.416031+0000","last_peered":"2023-07-21T22:55:39.416031+0000","last_clean":"2023-07-21T22:55:39.416031+0000","last_became_active":"2023-07-21T22:55:39.414403+0000","last_became_peered":"2023-07-21T22:55:39.414403+0000","last_unstale":"2023-07-21T22:55:39.416031+0000","last_undegraded":"2023-07-21T22:55:39.416031+0000","last_fullsized":"2023-07-21T22:55:39.416031+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:27:09.502436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.401846+0000","last_change":"2023-07-21T22:55:39.401846+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.401846+0000","last_undegraded":"2023-07-21T22:55:39.401846+0000","last_fullsized":"2023-07-21T22:55:39.401846+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.414112+0000","last_change":"2023-07-21T22:55:39.413053+0000","last_active":"2023-07-21T22:55:39.414112+0000","last_peered":"2023-07-21T22:55:39.414112+0000","last_clean":"2023-07-21T22:55:39.414112+0000","last_became_active":"2023-07-21T22:55:39.412694+0000","last_became_peered":"2023-07-21T22:55:39.412694+0000","last_unstale":"2023-07-21T22:55:39.414112+0000","last_undegraded":"2023-07-21T22:55:39.414112+0000","last_fullsized":"2023-07-21T22:55:39.414112+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:21:56.166474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.392092+0000","last_change":"2023-07-21T22:55:39.392092+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.392092+0000","last_undegraded":"2023-07-21T22:55:39.392092+0000","last_fullsized":"2023-07-21T22:55:39.392092+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.421505+0000","last_change":"2023-07-21T22:55:39.418236+0000","last_active":"2023-07-21T22:55:39.421505+0000","last_peered":"2023-07-21T22:55:39.421505+0000","last_clean":"2023-07-21T22:55:39.421505+0000","last_became_active":"2023-07-21T22:55:39.417975+0000","last_became_peered":"2023-07-21T22:55:39.417975+0000","last_unstale":"2023-07-21T22:55:39.421505+0000","last_undegraded":"2023-07-21T22:55:39.421505+0000","last_fullsized":"2023-07-21T22:55:39.421505+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:14:45.372222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.402061+0000","last_change":"2023-07-21T22:55:39.402061+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.402061+0000","last_undegraded":"2023-07-21T22:55:39.402061+0000","last_fullsized":"2023-07-21T22:55:39.402061+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.408618+0000","last_change":"2023-07-21T22:55:39.407508+0000","last_active":"2023-07-21T22:55:39.408618+0000","last_peered":"2023-07-21T22:55:39.408618+0000","last_clean":"2023-07-21T22:55:39.408618+0000","last_became_active":"2023-07-21T22:55:39.407178+0000","last_became_peered":"2023-07-21T22:55:39.407178+0000","last_unstale":"2023-07-21T22:55:39.408618+0000","last_undegraded":"2023-07-21T22:55:39.408618+0000","last_fullsized":"2023-07-21T22:55:39.408618+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:57.640218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.393735+0000","last_change":"2023-07-21T22:55:39.393735+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.393735+0000","last_undegraded":"2023-07-21T22:55:39.393735+0000","last_fullsized":"2023-07-21T22:55:39.393735+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.414400+0000","last_change":"2023-07-21T22:55:39.411817+0000","last_active":"2023-07-21T22:55:39.414400+0000","last_peered":"2023-07-21T22:55:39.414400+0000","last_clean":"2023-07-21T22:55:39.414400+0000","last_became_active":"2023-07-21T22:55:39.411096+0000","last_became_peered":"2023-07-21T22:55:39.411096+0000","last_unstale":"2023-07-21T22:55:39.414400+0000","last_undegraded":"2023-07-21T22:55:39.414400+0000","last_fullsized":"2023-07-21T22:55:39.414400+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:37:11.626613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.398075+0000","last_change":"2023-07-21T22:55:39.398075+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.398075+0000","last_undegraded":"2023-07-21T22:55:39.398075+0000","last_fullsized":"2023-07-21T22:55:39.398075+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.401777+0000","last_change":"2023-07-21T22:55:39.398085+0000","last_active":"2023-07-21T22:55:39.401777+0000","last_peered":"2023-07-21T22:55:39.401777+0000","last_clean":"2023-07-21T22:55:39.401777+0000","last_became_active":"2023-07-21T22:55:39.397730+0000","last_became_peered":"2023-07-21T22:55:39.397730+0000","last_unstale":"2023-07-21T22:55:39.401777+0000","last_undegraded":"2023-07-21T22:55:39.401777+0000","last_fullsized":"2023-07-21T22:55:39.401777+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:58:28.209192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400927+0000","last_change":"2023-07-21T22:55:39.400927+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400927+0000","last_undegraded":"2023-07-21T22:55:39.400927+0000","last_fullsized":"2023-07-21T22:55:39.400927+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.404167+0000","last_change":"2023-07-21T22:55:39.401715+0000","last_active":"2023-07-21T22:55:39.404167+0000","last_peered":"2023-07-21T22:55:39.404167+0000","last_clean":"2023-07-21T22:55:39.404167+0000","last_became_active":"2023-07-21T22:55:39.401360+0000","last_became_peered":"2023-07-21T22:55:39.401360+0000","last_unstale":"2023-07-21T22:55:39.404167+0000","last_undegraded":"2023-07-21T22:55:39.404167+0000","last_fullsized":"2023-07-21T22:55:39.404167+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:54:37.310776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.402158+0000","last_change":"2023-07-21T22:55:39.402158+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.402158+0000","last_undegraded":"2023-07-21T22:55:39.402158+0000","last_fullsized":"2023-07-21T22:55:39.402158+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.413599+0000","last_change":"2023-07-21T22:55:39.410646+0000","last_active":"2023-07-21T22:55:39.413599+0000","last_peered":"2023-07-21T22:55:39.413599+0000","last_clean":"2023-07-21T22:55:39.413599+0000","last_became_active":"2023-07-21T22:55:39.410319+0000","last_became_peered":"2023-07-21T22:55:39.410319+0000","last_unstale":"2023-07-21T22:55:39.413599+0000","last_undegraded":"2023-07-21T22:55:39.413599+0000","last_fullsized":"2023-07-21T22:55:39.413599+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:37:16.993672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400095+0000","last_change":"2023-07-21T22:55:39.400095+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400095+0000","last_undegraded":"2023-07-21T22:55:39.400095+0000","last_fullsized":"2023-07-21T22:55:39.400095+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.411672+0000","last_change":"2023-07-21T22:55:39.409616+0000","last_active":"2023-07-21T22:55:39.411672+0000","last_peered":"2023-07-21T22:55:39.411672+0000","last_clean":"2023-07-21T22:55:39.411672+0000","last_became_active":"2023-07-21T22:55:39.409314+0000","last_became_peered":"2023-07-21T22:55:39.409314+0000","last_unstale":"2023-07-21T22:55:39.411672+0000","last_undegraded":"2023-07-21T22:55:39.411672+0000","last_fullsized":"2023-07-21T22:55:39.411672+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:21:46.525218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.397798+0000","last_change":"2023-07-21T22:55:39.397798+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.397798+0000","last_undegraded":"2023-07-21T22:55:39.397798+0000","last_fullsized":"2023-07-21T22:55:39.397798+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.424162+0000","last_change":"2023-07-21T22:55:39.421460+0000","last_active":"2023-07-21T22:55:39.424162+0000","last_peered":"2023-07-21T22:55:39.424162+0000","last_clean":"2023-07-21T22:55:39.424162+0000","last_became_active":"2023-07-21T22:55:39.421077+0000","last_became_peered":"2023-07-21T22:55:39.421077+0000","last_unstale":"2023-07-21T22:55:39.424162+0000","last_undegraded":"2023-07-21T22:55:39.424162+0000","last_fullsized":"2023-07-21T22:55:39.424162+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:46:13.990885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400048+0000","last_change":"2023-07-21T22:55:39.400048+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400048+0000","last_undegraded":"2023-07-21T22:55:39.400048+0000","last_fullsized":"2023-07-21T22:55:39.400048+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.413967+0000","last_change":"2023-07-21T22:55:39.413026+0000","last_active":"2023-07-21T22:55:39.413967+0000","last_peered":"2023-07-21T22:55:39.413967+0000","last_clean":"2023-07-21T22:55:39.413967+0000","last_became_active":"2023-07-21T22:55:39.412686+0000","last_became_peered":"2023-07-21T22:55:39.412686+0000","last_unstale":"2023-07-21T22:55:39.413967+0000","last_undegraded":"2023-07-21T22:55:39.413967+0000","last_fullsized":"2023-07-21T22:55:39.413967+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:38:37.952444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.395632+0000","last_change":"2023-07-21T22:55:39.395632+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.395632+0000","last_undegraded":"2023-07-21T22:55:39.395632+0000","last_fullsized":"2023-07-21T22:55:39.395632+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.420502+0000","last_change":"2023-07-21T22:55:39.415018+0000","last_active":"2023-07-21T22:55:39.420502+0000","last_peered":"2023-07-21T22:55:39.420502+0000","last_clean":"2023-07-21T22:55:39.420502+0000","last_became_active":"2023-07-21T22:55:39.414713+0000","last_became_peered":"2023-07-21T22:55:39.414713+0000","last_unstale":"2023-07-21T22:55:39.420502+0000","last_undegraded":"2023-07-21T22:55:39.420502+0000","last_fullsized":"2023-07-21T22:55:39.420502+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:41:31.314913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400785+0000","last_change":"2023-07-21T22:55:39.400785+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400785+0000","last_undegraded":"2023-07-21T22:55:39.400785+0000","last_fullsized":"2023-07-21T22:55:39.400785+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.413948+0000","last_change":"2023-07-21T22:55:39.412811+0000","last_active":"2023-07-21T22:55:39.413948+0000","last_peered":"2023-07-21T22:55:39.413948+0000","last_clean":"2023-07-21T22:55:39.413948+0000","last_became_active":"2023-07-21T22:55:39.412344+0000","last_became_peered":"2023-07-21T22:55:39.412344+0000","last_unstale":"2023-07-21T22:55:39.413948+0000","last_undegraded":"2023-07-21T22:55:39.413948+0000","last_fullsized":"2023-07-21T22:55:39.413948+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:13:16.596486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.394645+0000","last_change":"2023-07-21T22:55:39.394645+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.394645+0000","last_undegraded":"2023-07-21T22:55:39.394645+0000","last_fullsized":"2023-07-21T22:55:39.394645+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.420587+0000","last_change":"2023-07-21T22:55:39.416526+0000","last_active":"2023-07-21T22:55:39.420587+0000","last_peered":"2023-07-21T22:55:39.420587+0000","last_clean":"2023-07-21T22:55:39.420587+0000","last_became_active":"2023-07-21T22:55:39.416238+0000","last_became_peered":"2023-07-21T22:55:39.416238+0000","last_unstale":"2023-07-21T22:55:39.420587+0000","last_undegraded":"2023-07-21T22:55:39.420587+0000","last_fullsized":"2023-07-21T22:55:39.420587+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:33:27.404274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389979+0000","last_change":"2023-07-21T22:55:39.389979+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389979+0000","last_undegraded":"2023-07-21T22:55:39.389979+0000","last_fullsized":"2023-07-21T22:55:39.389979+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.424174+0000","last_change":"2023-07-21T22:55:39.421412+0000","last_active":"2023-07-21T22:55:39.424174+0000","last_peered":"2023-07-21T22:55:39.424174+0000","last_clean":"2023-07-21T22:55:39.424174+0000","last_became_active":"2023-07-21T22:55:39.421070+0000","last_became_peered":"2023-07-21T22:55:39.421070+0000","last_unstale":"2023-07-21T22:55:39.424174+0000","last_undegraded":"2023-07-21T22:55:39.424174+0000","last_fullsized":"2023-07-21T22:55:39.424174+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:10:42.306495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.403699+0000","last_change":"2023-07-21T22:55:39.403699+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.403699+0000","last_undegraded":"2023-07-21T22:55:39.403699+0000","last_fullsized":"2023-07-21T22:55:39.403699+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.414106+0000","last_change":"2023-07-21T22:55:39.410781+0000","last_active":"2023-07-21T22:55:39.414106+0000","last_peered":"2023-07-21T22:55:39.414106+0000","last_clean":"2023-07-21T22:55:39.414106+0000","last_became_active":"2023-07-21T22:55:39.410464+0000","last_became_peered":"2023-07-21T22:55:39.410464+0000","last_unstale":"2023-07-21T22:55:39.414106+0000","last_undegraded":"2023-07-21T22:55:39.414106+0000","last_fullsized":"2023-07-21T22:55:39.414106+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:38.264202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.398664+0000","last_change":"2023-07-21T22:55:39.398664+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.398664+0000","last_undegraded":"2023-07-21T22:55:39.398664+0000","last_fullsized":"2023-07-21T22:55:39.398664+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.415219+0000","last_change":"2023-07-21T22:55:39.414668+0000","last_active":"2023-07-21T22:55:39.415219+0000","last_peered":"2023-07-21T22:55:39.415219+0000","last_clean":"2023-07-21T22:55:39.415219+0000","last_became_active":"2023-07-21T22:55:39.414446+0000","last_became_peered":"2023-07-21T22:55:39.414446+0000","last_unstale":"2023-07-21T22:55:39.415219+0000","last_undegraded":"2023-07-21T22:55:39.415219+0000","last_fullsized":"2023-07-21T22:55:39.415219+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:43:53.073313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390838+0000","last_change":"2023-07-21T22:55:39.390838+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390838+0000","last_undegraded":"2023-07-21T22:55:39.390838+0000","last_fullsized":"2023-07-21T22:55:39.390838+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.411654+0000","last_change":"2023-07-21T22:55:39.410389+0000","last_active":"2023-07-21T22:55:39.411654+0000","last_peered":"2023-07-21T22:55:39.411654+0000","last_clean":"2023-07-21T22:55:39.411654+0000","last_became_active":"2023-07-21T22:55:39.410069+0000","last_became_peered":"2023-07-21T22:55:39.410069+0000","last_unstale":"2023-07-21T22:55:39.411654+0000","last_undegraded":"2023-07-21T22:55:39.411654+0000","last_fullsized":"2023-07-21T22:55:39.411654+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:57:24.219727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.405357+0000","last_change":"2023-07-21T22:55:39.405357+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.405357+0000","last_undegraded":"2023-07-21T22:55:39.405357+0000","last_fullsized":"2023-07-21T22:55:39.405357+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.414038+0000","last_change":"2023-07-21T22:55:39.409683+0000","last_active":"2023-07-21T22:55:39.414038+0000","last_peered":"2023-07-21T22:55:39.414038+0000","last_clean":"2023-07-21T22:55:39.414038+0000","last_became_active":"2023-07-21T22:55:39.409275+0000","last_became_peered":"2023-07-21T22:55:39.409275+0000","last_unstale":"2023-07-21T22:55:39.414038+0000","last_undegraded":"2023-07-21T22:55:39.414038+0000","last_fullsized":"2023-07-21T22:55:39.414038+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:22:24.546522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.401528+0000","last_change":"2023-07-21T22:55:39.401528+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.401528+0000","last_undegraded":"2023-07-21T22:55:39.401528+0000","last_fullsized":"2023-07-21T22:55:39.401528+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.409681+0000","last_change":"2023-07-21T22:55:39.408656+0000","last_active":"2023-07-21T22:55:39.409681+0000","last_peered":"2023-07-21T22:55:39.409681+0000","last_clean":"2023-07-21T22:55:39.409681+0000","last_became_active":"2023-07-21T22:55:39.408375+0000","last_became_peered":"2023-07-21T22:55:39.408375+0000","last_unstale":"2023-07-21T22:55:39.409681+0000","last_undegraded":"2023-07-21T22:55:39.409681+0000","last_fullsized":"2023-07-21T22:55:39.409681+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:37:46.249905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.393131+0000","last_change":"2023-07-21T22:55:39.393131+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.393131+0000","last_undegraded":"2023-07-21T22:55:39.393131+0000","last_fullsized":"2023-07-21T22:55:39.393131+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.408131+0000","last_change":"2023-07-21T22:55:39.405548+0000","last_active":"2023-07-21T22:55:39.408131+0000","last_peered":"2023-07-21T22:55:39.408131+0000","last_clean":"2023-07-21T22:55:39.408131+0000","last_became_active":"2023-07-21T22:55:39.405263+0000","last_became_peered":"2023-07-21T22:55:39.405263+0000","last_unstale":"2023-07-21T22:55:39.408131+0000","last_undegraded":"2023-07-21T22:55:39.408131+0000","last_fullsized":"2023-07-21T22:55:39.408131+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:25.424089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.411717+0000","last_change":"2023-07-21T22:55:39.411717+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.411717+0000","last_undegraded":"2023-07-21T22:55:39.411717+0000","last_fullsized":"2023-07-21T22:55:39.411717+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.413391+0000","last_change":"2023-07-21T22:55:39.410357+0000","last_active":"2023-07-21T22:55:39.413391+0000","last_peered":"2023-07-21T22:55:39.413391+0000","last_clean":"2023-07-21T22:55:39.413391+0000","last_became_active":"2023-07-21T22:55:39.410057+0000","last_became_peered":"2023-07-21T22:55:39.410057+0000","last_unstale":"2023-07-21T22:55:39.413391+0000","last_undegraded":"2023-07-21T22:55:39.413391+0000","last_fullsized":"2023-07-21T22:55:39.413391+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:17.185704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.403054+0000","last_change":"2023-07-21T22:55:39.403054+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.403054+0000","last_undegraded":"2023-07-21T22:55:39.403054+0000","last_fullsized":"2023-07-21T22:55:39.403054+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.408793+0000","last_change":"2023-07-21T22:55:39.408029+0000","last_active":"2023-07-21T22:55:39.408793+0000","last_peered":"2023-07-21T22:55:39.408793+0000","last_clean":"2023-07-21T22:55:39.408793+0000","last_became_active":"2023-07-21T22:55:39.407599+0000","last_became_peered":"2023-07-21T22:55:39.407599+0000","last_unstale":"2023-07-21T22:55:39.408793+0000","last_undegraded":"2023-07-21T22:55:39.408793+0000","last_fullsized":"2023-07-21T22:55:39.408793+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:47:28.521879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"161'304","reported_seq":1102,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.403239+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:55:39.403239+0000","last_peered":"2023-07-21T22:55:39.403239+0000","last_clean":"2023-07-21T22:55:39.403239+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:55:39.403239+0000","last_undegraded":"2023-07-21T22:55:39.403239+0000","last_fullsized":"2023-07-21T22:55:39.403239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:59:21.958943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":318,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.400239+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:55:39.400239+0000","last_peered":"2023-07-21T22:55:39.400239+0000","last_clean":"2023-07-21T22:55:39.400239+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:55:39.400239+0000","last_undegraded":"2023-07-21T22:55:39.400239+0000","last_fullsized":"2023-07-21T22:55:39.400239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:05.686648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.406020+0000","last_change":"2023-07-21T22:55:39.406020+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.406020+0000","last_undegraded":"2023-07-21T22:55:39.406020+0000","last_fullsized":"2023-07-21T22:55:39.406020+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.413420+0000","last_change":"2023-07-21T22:55:39.408771+0000","last_active":"2023-07-21T22:55:39.413420+0000","last_peered":"2023-07-21T22:55:39.413420+0000","last_clean":"2023-07-21T22:55:39.413420+0000","last_became_active":"2023-07-21T22:55:39.408492+0000","last_became_peered":"2023-07-21T22:55:39.408492+0000","last_unstale":"2023-07-21T22:55:39.413420+0000","last_undegraded":"2023-07-21T22:55:39.413420+0000","last_fullsized":"2023-07-21T22:55:39.413420+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:19:33.763010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":283,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.403087+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:55:39.403087+0000","last_peered":"2023-07-21T22:55:39.403087+0000","last_clean":"2023-07-21T22:55:39.403087+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:55:39.403087+0000","last_undegraded":"2023-07-21T22:55:39.403087+0000","last_fullsized":"2023-07-21T22:55:39.403087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:36:16.226544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.391374+0000","last_change":"2023-07-21T22:55:39.391374+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.391374+0000","last_undegraded":"2023-07-21T22:55:39.391374+0000","last_fullsized":"2023-07-21T22:55:39.391374+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.412261+0000","last_change":"2023-07-21T22:55:39.407686+0000","last_active":"2023-07-21T22:55:39.412261+0000","last_peered":"2023-07-21T22:55:39.412261+0000","last_clean":"2023-07-21T22:55:39.412261+0000","last_became_active":"2023-07-21T22:55:39.407414+0000","last_became_peered":"2023-07-21T22:55:39.407414+0000","last_unstale":"2023-07-21T22:55:39.412261+0000","last_undegraded":"2023-07-21T22:55:39.412261+0000","last_fullsized":"2023-07-21T22:55:39.412261+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:34:16.780319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":286,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.395421+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:55:39.395421+0000","last_peered":"2023-07-21T22:55:39.395421+0000","last_clean":"2023-07-21T22:55:39.395421+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:55:39.395421+0000","last_undegraded":"2023-07-21T22:55:39.395421+0000","last_fullsized":"2023-07-21T22:55:39.395421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:54:19.537921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390156+0000","last_change":"2023-07-21T22:55:39.390156+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390156+0000","last_undegraded":"2023-07-21T22:55:39.390156+0000","last_fullsized":"2023-07-21T22:55:39.390156+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.401574+0000","last_change":"2023-07-21T22:55:39.399053+0000","last_active":"2023-07-21T22:55:39.401574+0000","last_peered":"2023-07-21T22:55:39.401574+0000","last_clean":"2023-07-21T22:55:39.401574+0000","last_became_active":"2023-07-21T22:55:39.398779+0000","last_became_peered":"2023-07-21T22:55:39.398779+0000","last_unstale":"2023-07-21T22:55:39.401574+0000","last_undegraded":"2023-07-21T22:55:39.401574+0000","last_fullsized":"2023-07-21T22:55:39.401574+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:02:52.668876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":318,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.399640+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:55:39.399640+0000","last_peered":"2023-07-21T22:55:39.399640+0000","last_clean":"2023-07-21T22:55:39.399640+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:55:39.399640+0000","last_undegraded":"2023-07-21T22:55:39.399640+0000","last_fullsized":"2023-07-21T22:55:39.399640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:43:22.060057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.405829+0000","last_change":"2023-07-21T22:55:39.405829+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.405829+0000","last_undegraded":"2023-07-21T22:55:39.405829+0000","last_fullsized":"2023-07-21T22:55:39.405829+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.402349+0000","last_change":"2023-07-21T22:55:39.398435+0000","last_active":"2023-07-21T22:55:39.402349+0000","last_peered":"2023-07-21T22:55:39.402349+0000","last_clean":"2023-07-21T22:55:39.402349+0000","last_became_active":"2023-07-21T22:55:39.398171+0000","last_became_peered":"2023-07-21T22:55:39.398171+0000","last_unstale":"2023-07-21T22:55:39.402349+0000","last_undegraded":"2023-07-21T22:55:39.402349+0000","last_fullsized":"2023-07-21T22:55:39.402349+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:36.093425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":298,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.394565+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:55:39.394565+0000","last_peered":"2023-07-21T22:55:39.394565+0000","last_clean":"2023-07-21T22:55:39.394565+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:55:39.394565+0000","last_undegraded":"2023-07-21T22:55:39.394565+0000","last_fullsized":"2023-07-21T22:55:39.394565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:54:05.783821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.396061+0000","last_change":"2023-07-21T22:55:39.396061+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.396061+0000","last_undegraded":"2023-07-21T22:55:39.396061+0000","last_fullsized":"2023-07-21T22:55:39.396061+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.424121+0000","last_change":"2023-07-21T22:55:39.421220+0000","last_active":"2023-07-21T22:55:39.424121+0000","last_peered":"2023-07-21T22:55:39.424121+0000","last_clean":"2023-07-21T22:55:39.424121+0000","last_became_active":"2023-07-21T22:55:39.420898+0000","last_became_peered":"2023-07-21T22:55:39.420898+0000","last_unstale":"2023-07-21T22:55:39.424121+0000","last_undegraded":"2023-07-21T22:55:39.424121+0000","last_fullsized":"2023-07-21T22:55:39.424121+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:43:41.626753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":282,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.403123+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:55:39.403123+0000","last_peered":"2023-07-21T22:55:39.403123+0000","last_clean":"2023-07-21T22:55:39.403123+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:55:39.403123+0000","last_undegraded":"2023-07-21T22:55:39.403123+0000","last_fullsized":"2023-07-21T22:55:39.403123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:31:30.358830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390327+0000","last_change":"2023-07-21T22:55:39.390327+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390327+0000","last_undegraded":"2023-07-21T22:55:39.390327+0000","last_fullsized":"2023-07-21T22:55:39.390327+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.412393+0000","last_change":"2023-07-21T22:55:39.407762+0000","last_active":"2023-07-21T22:55:39.412393+0000","last_peered":"2023-07-21T22:55:39.412393+0000","last_clean":"2023-07-21T22:55:39.412393+0000","last_became_active":"2023-07-21T22:55:39.407480+0000","last_became_peered":"2023-07-21T22:55:39.407480+0000","last_unstale":"2023-07-21T22:55:39.412393+0000","last_undegraded":"2023-07-21T22:55:39.412393+0000","last_fullsized":"2023-07-21T22:55:39.412393+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:11:42.677965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":298,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.393672+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:55:39.393672+0000","last_peered":"2023-07-21T22:55:39.393672+0000","last_clean":"2023-07-21T22:55:39.393672+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:55:39.393672+0000","last_undegraded":"2023-07-21T22:55:39.393672+0000","last_fullsized":"2023-07-21T22:55:39.393672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:57:19.939012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.395164+0000","last_change":"2023-07-21T22:55:39.395164+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.395164+0000","last_undegraded":"2023-07-21T22:55:39.395164+0000","last_fullsized":"2023-07-21T22:55:39.395164+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.412302+0000","last_change":"2023-07-21T22:55:39.408717+0000","last_active":"2023-07-21T22:55:39.412302+0000","last_peered":"2023-07-21T22:55:39.412302+0000","last_clean":"2023-07-21T22:55:39.412302+0000","last_became_active":"2023-07-21T22:55:39.408445+0000","last_became_peered":"2023-07-21T22:55:39.408445+0000","last_unstale":"2023-07-21T22:55:39.412302+0000","last_undegraded":"2023-07-21T22:55:39.412302+0000","last_fullsized":"2023-07-21T22:55:39.412302+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:03:08.912070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":280,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.406693+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:55:39.406693+0000","last_peered":"2023-07-21T22:55:39.406693+0000","last_clean":"2023-07-21T22:55:39.406693+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:55:39.406693+0000","last_undegraded":"2023-07-21T22:55:39.406693+0000","last_fullsized":"2023-07-21T22:55:39.406693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:25:05.889779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509880,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59944,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94311896,"statfs":{"total":96636764160,"available":96575381504,"internally_reserved":0,"allocated":2719744,"data_stored":1676913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.34999999999999998},"max":{"1min":0.89300000000000002,"5min":1.032,"15min":1.143},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.54700000000000004,"5min":0.47999999999999998,"15min":0.39000000000000001},"max":{"1min":0.875,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.61899999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.749,"15min":0.76400000000000001},"min":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.40600000000000003},"max":{"1min":0.86199999999999999,"5min":0.96599999999999997,"15min":1.0820000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73899999999999999,"15min":0.746},"min":{"1min":0.51500000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94399999999999995,"5min":0.97299999999999998,"15min":1.02},"last":0.752}]},{"osd":2,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75,"15min":0.76000000000000001},"min":{"1min":0.61099999999999999,"5min":0.54800000000000004,"15min":0.47999999999999998},"max":{"1min":0.89500000000000002,"5min":1.0049999999999999,"15min":1.0780000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.624,"5min":0.51100000000000001,"15min":0.42299999999999999},"max":{"1min":0.93100000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.63700000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77300000000000002,"15min":0.78000000000000003},"min":{"1min":0.61199999999999999,"5min":0.48399999999999999,"15min":0.45600000000000002},"max":{"1min":0.88300000000000001,"5min":1.077,"15min":1.0980000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.64900000000000002,"5min":0.57699999999999996,"15min":0.53400000000000003},"max":{"1min":0.92800000000000005,"5min":1.026,"15min":1.036},"last":0.82499999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.34999999999999998},"max":{"1min":0.68300000000000005,"5min":0.81299999999999994,"15min":0.89700000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.60599999999999998},"min":{"1min":0.439,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":0.83299999999999996,"5min":0.88,"15min":1.0940000000000001},"last":0.80200000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58699999999999997,"15min":0.60599999999999998},"min":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.41199999999999998},"max":{"1min":0.81000000000000005,"5min":0.88300000000000001,"15min":0.99399999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65800000000000003,"15min":0.66600000000000004},"min":{"1min":0.48599999999999999,"5min":0.433,"15min":0.40699999999999997},"max":{"1min":0.84999999999999998,"5min":1.0129999999999999,"15min":1.077},"last":0.89200000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.51900000000000002,"5min":0.47999999999999998,"15min":0.45500000000000002},"max":{"1min":0.81299999999999994,"5min":0.91100000000000003,"15min":0.97399999999999998},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.63300000000000001,"15min":0.63100000000000001},"min":{"1min":0.47999999999999998,"5min":0.41299999999999998,"15min":0.41099999999999998},"max":{"1min":0.86699999999999999,"5min":0.871,"15min":1.105},"last":1.1539999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542586,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37220,"kb_used_data":2076,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334620,"statfs":{"total":96636764160,"available":96598650880,"internally_reserved":0,"allocated":2125824,"data_stored":1086545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0009999999999999,"5min":1.024,"15min":1.024},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80200000000000005,"15min":0.80800000000000005},"min":{"1min":0.63800000000000001,"5min":0.58299999999999996,"15min":0.54000000000000004},"max":{"1min":1,"5min":1,"15min":1.0780000000000001},"last":0.72999999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.51400000000000001,"5min":0.51000000000000001,"15min":0.50900000000000001},"max":{"1min":0.96199999999999997,"5min":0.96599999999999997,"15min":1.006},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.54200000000000004,"5min":0.48899999999999999,"15min":0.42499999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78500000000000003,"15min":0.78300000000000003},"min":{"1min":0.59599999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.92100000000000004,"5min":1.002,"15min":1.0409999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.80900000000000005,"15min":0.80600000000000005},"min":{"1min":0.61299999999999999,"5min":0.498,"15min":0.46600000000000003},"max":{"1min":0.98799999999999999,"5min":1.0089999999999999,"15min":1.0600000000000001},"last":0.61499999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.754,"15min":0.754},"min":{"1min":0.66600000000000004,"5min":0.53000000000000003,"15min":0.48999999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76200000000000001,"15min":0.753},"min":{"1min":0.58799999999999997,"5min":0.53300000000000003,"15min":0.52300000000000002},"max":{"1min":0.93000000000000005,"5min":0.96199999999999997,"15min":1.0389999999999999},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.92300000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.46400000000000002,"5min":0.41899999999999998,"15min":0.33500000000000002},"max":{"1min":0.93600000000000005,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65200000000000002,"15min":0.64700000000000002},"min":{"1min":0.503,"5min":0.44600000000000001,"15min":0.38900000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.96299999999999997},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.66100000000000003},"min":{"1min":0.46300000000000002,"5min":0.45600000000000002,"15min":0.38700000000000001},"max":{"1min":0.81999999999999995,"5min":0.91600000000000004,"15min":1.0129999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48299999999999998,"5min":0.46800000000000003,"15min":0.432},"max":{"1min":0.90000000000000002,"5min":0.96299999999999997,"15min":1.0780000000000001},"last":0.57899999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509879,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55280,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316560,"statfs":{"total":96636764160,"available":96580157440,"internally_reserved":0,"allocated":2138112,"data_stored":1093245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.57599999999999996,"5min":0.39200000000000002,"15min":0.32100000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.73099999999999998},"min":{"1min":0.53300000000000003,"5min":0.432,"15min":0.41499999999999998},"max":{"1min":0.91300000000000003,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.67300000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.74299999999999999,"15min":0.73299999999999998},"min":{"1min":0.60799999999999998,"5min":0.495,"15min":0.42399999999999999},"max":{"1min":0.89000000000000001,"5min":0.999,"15min":1.0289999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.745,"15min":0.73999999999999999},"min":{"1min":0.60599999999999998,"5min":0.45800000000000002,"15min":0.42999999999999999},"max":{"1min":0.97999999999999998,"5min":1.054,"15min":1.054},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.752,"15min":0.752},"min":{"1min":0.64300000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88400000000000001,"5min":1.119,"15min":1.119},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.75700000000000001,"15min":0.748},"min":{"1min":0.57799999999999996,"5min":0.53600000000000003,"15min":0.49299999999999999},"max":{"1min":0.95699999999999996,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.79900000000000004,"15min":0.78500000000000003},"min":{"1min":0.69199999999999995,"5min":0.61499999999999999,"15min":0.47299999999999998},"max":{"1min":1.0009999999999999,"5min":1.169,"15min":1.169},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80000000000000004,"15min":0.80700000000000005},"min":{"1min":0.56399999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0169999999999999,"5min":1.0409999999999999,"15min":1.0429999999999999},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84799999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.47399999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97999999999999998,"5min":1.01,"15min":1.0369999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.59099999999999997},"min":{"1min":0.47999999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91900000000000004,"5min":0.93600000000000005,"15min":1.0629999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63600000000000001,"15min":0.65000000000000002},"min":{"1min":0.45700000000000002,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":0.95899999999999996,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72399999999999998,"15min":0.72099999999999997},"min":{"1min":0.51000000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.84299999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37232,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334608,"statfs":{"total":96636764160,"available":96598638592,"internally_reserved":0,"allocated":2138112,"data_stored":1093245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.73799999999999999,"15min":0.75800000000000001},"min":{"1min":0.64500000000000002,"5min":0.41299999999999998,"15min":0.34599999999999997},"max":{"1min":0.93500000000000005,"5min":0.94199999999999995,"15min":1.0509999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.35299999999999998},"max":{"1min":0.96899999999999997,"5min":1.006,"15min":1.03},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.72299999999999998,"15min":0.72599999999999998},"min":{"1min":0.55800000000000005,"5min":0.502,"15min":0.432},"max":{"1min":1.0229999999999999,"5min":1.089,"15min":1.089},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.54400000000000004,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":0.871,"5min":0.97599999999999998,"15min":1.0129999999999999},"last":0.68600000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79100000000000004,"15min":0.78500000000000003},"min":{"1min":0.625,"5min":0.59899999999999998,"15min":0.46899999999999997},"max":{"1min":0.95099999999999996,"5min":1.292,"15min":1.292},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.65100000000000002,"5min":0.51300000000000001,"15min":0.501},"max":{"1min":0.99099999999999999,"5min":1.038,"15min":1.038},"last":0.752}]},{"osd":3,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.752,"15min":0.747},"min":{"1min":0.68999999999999995,"5min":0.51400000000000001,"15min":0.49299999999999999},"max":{"1min":1.0069999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.70399999999999996,"5min":0.61399999999999999,"15min":0.54200000000000004},"max":{"1min":0.98399999999999999,"5min":1.218,"15min":1.218},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.371},"max":{"1min":0.70399999999999996,"5min":1.028,"15min":1.028},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.59499999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.93300000000000005,"5min":1.151,"15min":1.151},"last":0.91900000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65300000000000002,"15min":0.65500000000000003},"min":{"1min":0.45800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93400000000000005,"5min":1.252,"15min":1.252},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.39100000000000001},"max":{"1min":0.80500000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.88200000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89300000000000002,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68600000000000005,"15min":0.68200000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.42999999999999999},"max":{"1min":0.83999999999999997,"5min":1.206,"15min":1.206},"last":0.83999999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37232,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334608,"statfs":{"total":96636764160,"available":96598638592,"internally_reserved":0,"allocated":2138112,"data_stored":1093245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52500000000000002,"15min":0.505},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.27900000000000003},"max":{"1min":0.746,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.46000000000000002,"5min":0.441,"15min":0.39300000000000002},"max":{"1min":0.68100000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53200000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.64300000000000002,"5min":0.71399999999999997,"15min":0.81599999999999995},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.35599999999999998},"max":{"1min":0.68700000000000006,"5min":0.79100000000000004,"15min":0.93899999999999995},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.45100000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72199999999999998,"5min":0.83199999999999996,"15min":1.0249999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.36299999999999999},"max":{"1min":0.76500000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48099999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.78300000000000003,"15min":0.78900000000000003},"min":{"1min":0.53300000000000003,"5min":0.441,"15min":0.441},"max":{"1min":1.071,"5min":1.101,"15min":1.343},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84599999999999997,"15min":0.85099999999999998},"min":{"1min":0.63100000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.002,"5min":1.119,"15min":1.373},"last":0.67700000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79800000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.99099999999999999,"5min":1.085,"15min":1.3799999999999999},"last":0.746},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80300000000000005,"15min":0.81000000000000005},"min":{"1min":0.69099999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94699999999999995,"5min":1.087,"15min":1.2230000000000001},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.81599999999999995},"min":{"1min":0.61799999999999999,"5min":0.55700000000000005,"15min":0.55300000000000005},"max":{"1min":1.0249999999999999,"5min":1.127,"15min":1.2689999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53000000000000003},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.3660000000000001},"last":0.70699999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83199999999999996,"15min":0.83499999999999996},"min":{"1min":0.56399999999999995,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":1.0109999999999999,"5min":1.1399999999999999,"15min":1.4510000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84099999999999997,"15min":0.85499999999999998},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.57299999999999995},"max":{"1min":1.0489999999999999,"5min":1.0820000000000001,"15min":1.427},"last":0.61399999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509881,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55280,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316560,"statfs":{"total":96636764160,"available":96580157440,"internally_reserved":0,"allocated":2138112,"data_stored":1093245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.502,"15min":0.502},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.26500000000000001},"max":{"1min":0.72699999999999998,"5min":0.73999999999999999,"15min":1.0680000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.377},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":1.0780000000000001},"last":0.52800000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.437,"5min":0.38800000000000001,"15min":0.35599999999999998},"max":{"1min":0.751,"5min":0.86199999999999999,"15min":0.90300000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.60699999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.752,"5min":0.89100000000000001,"15min":0.91300000000000003},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.495,"15min":0.5},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.65900000000000003,"5min":0.71099999999999997,"15min":0.92800000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.42099999999999999,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.81899999999999995,"15min":0.95399999999999996},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.81100000000000005,"15min":0.81499999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.002,"5min":1.1839999999999999,"15min":1.2809999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81699999999999995,"15min":0.82799999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.439},"max":{"1min":1.1359999999999999,"5min":1.391,"15min":1.391},"last":0.69199999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81000000000000005,"15min":0.81799999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98999999999999999,"5min":1.218,"15min":1.218},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.81999999999999995,"15min":0.83499999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.47499999999999998},"max":{"1min":1.0660000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.81499999999999995,"15min":0.82199999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.495},"max":{"1min":1.048,"5min":1.262,"15min":1.2969999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.627,"5min":0.55600000000000005,"15min":0.55500000000000005},"max":{"1min":1.085,"5min":1.214,"15min":1.2390000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83099999999999996,"15min":0.84499999999999997},"min":{"1min":0.65600000000000003,"5min":0.60199999999999998,"15min":0.51300000000000001},"max":{"1min":1.1200000000000001,"5min":1.2629999999999999,"15min":1.3360000000000001},"last":0.623},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82799999999999996,"15min":0.84399999999999997},"min":{"1min":0.60599999999999998,"5min":0.57999999999999996,"15min":0.54400000000000004},"max":{"1min":1.101,"5min":1.335,"15min":1.3939999999999999},"last":0.745}]}]},{"osd":1,"up_from":15,"seq":64424509880,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37232,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334608,"statfs":{"total":96636764160,"available":96598638592,"internally_reserved":0,"allocated":2138112,"data_stored":1093245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.5,"15min":0.501},"min":{"1min":0.34899999999999998,"5min":0.30499999999999999,"15min":0.30399999999999999},"max":{"1min":0.57099999999999995,"5min":0.76200000000000001,"15min":0.86499999999999999},"last":0.251},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.46300000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.751,"5min":0.874,"15min":0.876},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52700000000000002,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64400000000000002,"5min":0.80800000000000005,"15min":0.82799999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39900000000000002,"5min":0.38900000000000001,"15min":0.373},"max":{"1min":0.72399999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60099999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.46100000000000002,"5min":0.438,"15min":0.43099999999999999},"max":{"1min":0.71599999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35099999999999998},"max":{"1min":0.62,"5min":0.77700000000000002,"15min":0.86199999999999999},"last":0.42999999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80000000000000004,"15min":0.80100000000000005},"min":{"1min":0.53700000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1040000000000001,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82199999999999995,"15min":0.82599999999999996},"min":{"1min":0.69299999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1180000000000001,"5min":1.2350000000000001,"15min":1.302},"last":0.70999999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.81699999999999995,"15min":0.81000000000000005},"min":{"1min":0.59299999999999997,"5min":0.52900000000000003,"15min":0.499},"max":{"1min":1.153,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81499999999999995,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.51800000000000002,"15min":0.48799999999999999},"max":{"1min":1.171,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.57599999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.83399999999999996,"15min":0.82899999999999996},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.59699999999999998},"max":{"1min":1.083,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.747},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80500000000000005,"15min":0.81799999999999995},"min":{"1min":0.64100000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.034,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.82999999999999996,"15min":0.83899999999999997},"min":{"1min":0.60799999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1040000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.626},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.83499999999999996},"min":{"1min":0.67100000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.131,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.72899999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509882,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37812,"kb_used_data":2668,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334028,"statfs":{"total":96636764160,"available":96598044672,"internally_reserved":0,"allocated":2732032,"data_stored":1683613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.498,"15min":0.48399999999999999},"min":{"1min":0.36699999999999999,"5min":0.29999999999999999,"15min":0.28499999999999998},"max":{"1min":0.79200000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.38300000000000001,"5min":0.32800000000000001,"15min":0.29799999999999999},"max":{"1min":0.79500000000000004,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.52600000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.42899999999999999,"5min":0.378,"15min":0.35899999999999999},"max":{"1min":0.74199999999999999,"5min":0.80900000000000005,"15min":0.87},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38400000000000001,"5min":0.35799999999999998,"15min":0.33900000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.442}]},{"osd":3,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.622,"15min":0.61899999999999999},"min":{"1min":0.504,"5min":0.47599999999999998,"15min":0.441},"max":{"1min":0.77200000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.46999999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.98599999999999999},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.67500000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.018,"5min":1.081,"15min":1.4370000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.63800000000000001,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2789999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.81699999999999995,"15min":0.81899999999999995},"min":{"1min":0.61099999999999999,"5min":0.60799999999999998,"15min":0.56599999999999995},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.88,"5min":0.86399999999999999,"15min":0.84999999999999998},"min":{"1min":0.68500000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1140000000000001,"5min":1.206,"15min":1.351},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.85699999999999998,"15min":0.86199999999999999},"min":{"1min":0.70699999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.121,"5min":1.1739999999999999,"15min":1.385},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.84799999999999998,"15min":0.84299999999999997},"min":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.60299999999999998},"max":{"1min":1.091,"5min":1.165,"15min":1.347},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.82899999999999996,"15min":0.83399999999999996},"min":{"1min":0.624,"5min":0.624,"15min":0.54100000000000004},"max":{"1min":1.0980000000000001,"5min":1.1100000000000001,"15min":1.3180000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.86599999999999999,"15min":0.878},"min":{"1min":0.66200000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.411},"last":0.622}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:55:44.570 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:55:44.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.718+0000 7fd2ed848640 1 Processor -- start 2023-07-21T22:55:44.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.718+0000 7fd2ed848640 1 -- start start 2023-07-21T22:55:44.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.722+0000 7fd2ed848640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2e8158ce0 0x7fd2e8070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.722+0000 7fd2ed848640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2e80c9730 0x7fd2e80ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.722+0000 7fd2ed848640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e80cc700 con 0x7fd2e80c8ad0 2023-07-21T22:55:44.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.722+0000 7fd2ed848640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e80b0ff0 con 0x7fd2e8158ce0 2023-07-21T22:55:44.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.722+0000 7fd2ed848640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e8070c80 con 0x7fd2e80c9730 2023-07-21T22:55:44.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.722+0000 7fd2e6ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd2e8158ce0 0x7fd2e8070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.722+0000 7fd2dffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd2e80c8ad0 0x7fd2e80c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56118/0 (socket says 172.21.15.6:56118) 2023-07-21T22:55:44.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.722+0000 7fd2dffff640 1 -- 172.21.15.6:0/2241889833 learned_addr learned my addr 172.21.15.6:0/2241889833 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.722+0000 7fd2e6ffd640 1 -- 172.21.15.6:0/2241889833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2e80c9730 msgr2=0x7fd2e80ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.722+0000 7fd2e6ffd640 1 --2- 172.21.15.6:0/2241889833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2e80c9730 0x7fd2e80ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.722+0000 7fd2e6ffd640 1 -- 172.21.15.6:0/2241889833 >> v1:172.21.15.6:6789/0 conn(0x7fd2e80c8ad0 legacy=0x7fd2e80c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.722+0000 7fd2e67fc640 1 -- 172.21.15.6:0/2241889833 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168764645 0 0) 0x7fd2e80cc700 con 0x7fd2e80c8ad0 2023-07-21T22:55:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.722+0000 7fd2e6ffd640 1 -- 172.21.15.6:0/2241889833 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e80cbdd0 con 0x7fd2e8158ce0 2023-07-21T22:55:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.722+0000 7fd2e6ffd640 1 --2- 172.21.15.6:0/2241889833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e8158ce0 0x7fd2e8070450 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80097c0 tx=0x7fd2d801e560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7497d21d649ff26 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:44.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2e67fc640 1 -- 172.21.15.6:0/2241889833 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d80ab650 con 0x7fd2e8158ce0 2023-07-21T22:55:44.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2e67fc640 1 -- 172.21.15.6:0/2241889833 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d80ab7b0 con 0x7fd2e8158ce0 2023-07-21T22:55:44.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2e67fc640 1 -- 172.21.15.6:0/2241889833 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d80abb40 con 0x7fd2e8158ce0 2023-07-21T22:55:44.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2ed848640 1 -- 172.21.15.6:0/2241889833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e8158ce0 msgr2=0x7fd2e8070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2ed848640 1 --2- 172.21.15.6:0/2241889833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e8158ce0 0x7fd2e8070450 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7fd2d80097c0 tx=0x7fd2d801e560 comp rx=0 tx=0).stop 2023-07-21T22:55:44.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2ed848640 1 -- 172.21.15.6:0/2241889833 shutdown_connections 2023-07-21T22:55:44.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2ed848640 1 --2- 172.21.15.6:0/2241889833 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2e80c9730 0x7fd2e80ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2ed848640 1 --2- 172.21.15.6:0/2241889833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e8158ce0 0x7fd2e8070450 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2ed848640 1 -- 172.21.15.6:0/2241889833 >> 172.21.15.6:0/2241889833 conn(0x7fd2e80afcf0 msgr2=0x7fd2e80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:44.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2ed848640 1 -- 172.21.15.6:0/2241889833 shutdown_connections 2023-07-21T22:55:44.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2ed848640 1 -- 172.21.15.6:0/2241889833 wait complete. 2023-07-21T22:55:44.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2ed848640 1 Processor -- start 2023-07-21T22:55:44.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2ed848640 1 -- start start 2023-07-21T22:55:44.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2ed848640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e80c8ad0 0x7fd2e80b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2ed848640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2e80c9730 0x7fd2e80c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2ed848640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2e8158ce0 0x7fd2e80c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2ed848640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e80b3190 con 0x7fd2e80c8ad0 2023-07-21T22:55:44.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2ed848640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e815c0b0 con 0x7fd2e80c9730 2023-07-21T22:55:44.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2ed848640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e80b2580 con 0x7fd2e8158ce0 2023-07-21T22:55:44.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2e6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e80c8ad0 0x7fd2e80b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2e6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e80c8ad0 0x7fd2e80b3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53752/0 (socket says 172.21.15.6:53752) 2023-07-21T22:55:44.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.726+0000 7fd2e6ffd640 1 -- 172.21.15.6:0/693461715 learned_addr learned my addr 172.21.15.6:0/693461715 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:44.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.730+0000 7fd2dffff640 1 --2- 172.21.15.6:0/693461715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2e80c9730 0x7fd2e80c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.730+0000 7fd2e77fe640 1 --2- 172.21.15.6:0/693461715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2e8158ce0 0x7fd2e80c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.730+0000 7fd2e6ffd640 1 -- 172.21.15.6:0/693461715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2e8158ce0 msgr2=0x7fd2e80c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.730+0000 7fd2e6ffd640 1 --2- 172.21.15.6:0/693461715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2e8158ce0 0x7fd2e80c5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.730+0000 7fd2e6ffd640 1 -- 172.21.15.6:0/693461715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2e80c9730 msgr2=0x7fd2e80c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.730+0000 7fd2e6ffd640 1 --2- 172.21.15.6:0/693461715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2e80c9730 0x7fd2e80c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.730+0000 7fd2e6ffd640 1 -- 172.21.15.6:0/693461715 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d8009420 con 0x7fd2e80c8ad0 2023-07-21T22:55:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.730+0000 7fd2dffff640 1 --2- 172.21.15.6:0/693461715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2e80c9730 0x7fd2e80c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:55:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.730+0000 7fd2e77fe640 1 --2- 172.21.15.6:0/693461715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2e8158ce0 0x7fd2e80c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:55:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.730+0000 7fd2e6ffd640 1 --2- 172.21.15.6:0/693461715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e80c8ad0 0x7fd2e80b3620 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fd2d801c190 tx=0x7fd2d80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.730+0000 7fd2e4ff9640 1 -- 172.21.15.6:0/693461715 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8004220 con 0x7fd2e80c8ad0 2023-07-21T22:55:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.730+0000 7fd2e4ff9640 1 -- 172.21.15.6:0/693461715 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d8004380 con 0x7fd2e80c8ad0 2023-07-21T22:55:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.730+0000 7fd2e4ff9640 1 -- 172.21.15.6:0/693461715 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8003820 con 0x7fd2e80c8ad0 2023-07-21T22:55:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.730+0000 7fd2ed848640 1 -- 172.21.15.6:0/693461715 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e80b2860 con 0x7fd2e80c8ad0 2023-07-21T22:55:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.730+0000 7fd2ed848640 1 -- 172.21.15.6:0/693461715 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e80b2e20 con 0x7fd2e80c8ad0 2023-07-21T22:55:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.730+0000 7fd2ed848640 1 -- 172.21.15.6:0/693461715 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e80678d0 con 0x7fd2e80c8ad0 2023-07-21T22:55:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.730+0000 7fd2e4ff9640 1 -- 172.21.15.6:0/693461715 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd2d8003980 con 0x7fd2e80c8ad0 2023-07-21T22:55:44.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.730+0000 7fd2e4ff9640 1 --2- 172.21.15.6:0/693461715 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fd2c80663a0 0x7fd2c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.730+0000 7fd2e4ff9640 1 -- 172.21.15.6:0/693461715 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fd2d81208e0 con 0x7fd2e80c8ad0 2023-07-21T22:55:44.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.734+0000 7fd2dffff640 1 --2- 172.21.15.6:0/693461715 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fd2c80663a0 0x7fd2c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.734+0000 7fd2dffff640 1 --2- 172.21.15.6:0/693461715 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fd2c80663a0 0x7fd2c8068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80c5190 tx=0x7fd2d0009040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:44.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.734+0000 7fd2e4ff9640 1 -- 172.21.15.6:0/693461715 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd2d80eda50 con 0x7fd2e80c8ad0 2023-07-21T22:55:44.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.886+0000 7fd2ed848640 1 -- 172.21.15.6:0/693461715 --> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2e81590b0 con 0x7fd2c80663a0 2023-07-21T22:55:44.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.894+0000 7fd2e4ff9640 1 -- 172.21.15.6:0/693461715 <== mgr.9289 v2:172.21.15.161:6832/2346358146 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306469 (secure 0 0 0) 0x7fd2d0001d60 con 0x7fd2c80663a0 2023-07-21T22:55:44.932 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:44.934 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:55:44.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.898+0000 7fd2ed848640 1 -- 172.21.15.6:0/693461715 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fd2c80663a0 msgr2=0x7fd2c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.898+0000 7fd2ed848640 1 --2- 172.21.15.6:0/693461715 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fd2c80663a0 0x7fd2c8068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80c5190 tx=0x7fd2d0009040 comp rx=0 tx=0).stop 2023-07-21T22:55:44.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.898+0000 7fd2ed848640 1 -- 172.21.15.6:0/693461715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e80c8ad0 msgr2=0x7fd2e80b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.898+0000 7fd2ed848640 1 --2- 172.21.15.6:0/693461715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e80c8ad0 0x7fd2e80b3620 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fd2d801c190 tx=0x7fd2d80046d0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.898+0000 7fd2ed848640 1 -- 172.21.15.6:0/693461715 shutdown_connections 2023-07-21T22:55:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.898+0000 7fd2ed848640 1 --2- 172.21.15.6:0/693461715 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fd2c80663a0 0x7fd2c8068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.898+0000 7fd2ed848640 1 --2- 172.21.15.6:0/693461715 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd2e8158ce0 0x7fd2e80c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.898+0000 7fd2ed848640 1 --2- 172.21.15.6:0/693461715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2e80c9730 0x7fd2e80c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.898+0000 7fd2ed848640 1 --2- 172.21.15.6:0/693461715 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e80c8ad0 0x7fd2e80b3620 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.898+0000 7fd2ed848640 1 -- 172.21.15.6:0/693461715 >> 172.21.15.6:0/693461715 conn(0x7fd2e80afcf0 msgr2=0x7fd2e8157550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:44.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.898+0000 7fd2ed848640 1 -- 172.21.15.6:0/693461715 shutdown_connections 2023-07-21T22:55:44.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:44.898+0000 7fd2ed848640 1 -- 172.21.15.6:0/693461715 wait complete. 2023-07-21T22:55:44.953 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-21T22:55:44.145145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":357232,"kb_used_data":17840,"kb_used_omap":0,"kb_used_meta":339328,"kb_avail":754617488,"statfs":{"total":773094113280,"available":772728307712,"internally_reserved":0,"allocated":18268160,"data_stored":9913296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":347471872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.762405"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.399624+0000","last_change":"2023-07-21T22:55:39.399624+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.399624+0000","last_undegraded":"2023-07-21T22:55:39.399624+0000","last_fullsized":"2023-07-21T22:55:39.399624+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.393154+0000","last_change":"2023-07-21T22:55:39.393154+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.393154+0000","last_undegraded":"2023-07-21T22:55:39.393154+0000","last_fullsized":"2023-07-21T22:55:39.393154+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.395530+0000","last_change":"2023-07-21T22:55:39.395530+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.395530+0000","last_undegraded":"2023-07-21T22:55:39.395530+0000","last_fullsized":"2023-07-21T22:55:39.395530+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.404333+0000","last_change":"2023-07-21T22:55:39.404333+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.404333+0000","last_undegraded":"2023-07-21T22:55:39.404333+0000","last_fullsized":"2023-07-21T22:55:39.404333+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.392099+0000","last_change":"2023-07-21T22:55:39.392099+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.392099+0000","last_undegraded":"2023-07-21T22:55:39.392099+0000","last_fullsized":"2023-07-21T22:55:39.392099+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390841+0000","last_change":"2023-07-21T22:55:39.390841+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390841+0000","last_undegraded":"2023-07-21T22:55:39.390841+0000","last_fullsized":"2023-07-21T22:55:39.390841+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.398437+0000","last_change":"2023-07-21T22:55:39.398437+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.398437+0000","last_undegraded":"2023-07-21T22:55:39.398437+0000","last_fullsized":"2023-07-21T22:55:39.398437+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.406996+0000","last_change":"2023-07-21T22:55:39.406996+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.406996+0000","last_undegraded":"2023-07-21T22:55:39.406996+0000","last_fullsized":"2023-07-21T22:55:39.406996+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.391293+0000","last_change":"2023-07-21T22:55:39.391293+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.391293+0000","last_undegraded":"2023-07-21T22:55:39.391293+0000","last_fullsized":"2023-07-21T22:55:39.391293+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389753+0000","last_change":"2023-07-21T22:55:39.389753+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389753+0000","last_undegraded":"2023-07-21T22:55:39.389753+0000","last_fullsized":"2023-07-21T22:55:39.389753+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.392664+0000","last_change":"2023-07-21T22:55:39.392664+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.392664+0000","last_undegraded":"2023-07-21T22:55:39.392664+0000","last_fullsized":"2023-07-21T22:55:39.392664+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.403881+0000","last_change":"2023-07-21T22:55:39.403881+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.403881+0000","last_undegraded":"2023-07-21T22:55:39.403881+0000","last_fullsized":"2023-07-21T22:55:39.403881+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.391610+0000","last_change":"2023-07-21T22:55:39.391610+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.391610+0000","last_undegraded":"2023-07-21T22:55:39.391610+0000","last_fullsized":"2023-07-21T22:55:39.391610+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.405647+0000","last_change":"2023-07-21T22:55:39.405647+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.405647+0000","last_undegraded":"2023-07-21T22:55:39.405647+0000","last_fullsized":"2023-07-21T22:55:39.405647+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.396468+0000","last_change":"2023-07-21T22:55:39.396468+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.396468+0000","last_undegraded":"2023-07-21T22:55:39.396468+0000","last_fullsized":"2023-07-21T22:55:39.396468+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389748+0000","last_change":"2023-07-21T22:55:39.389748+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389748+0000","last_undegraded":"2023-07-21T22:55:39.389748+0000","last_fullsized":"2023-07-21T22:55:39.389748+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.405747+0000","last_change":"2023-07-21T22:55:39.405747+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.405747+0000","last_undegraded":"2023-07-21T22:55:39.405747+0000","last_fullsized":"2023-07-21T22:55:39.405747+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390592+0000","last_change":"2023-07-21T22:55:39.390592+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390592+0000","last_undegraded":"2023-07-21T22:55:39.390592+0000","last_fullsized":"2023-07-21T22:55:39.390592+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400596+0000","last_change":"2023-07-21T22:55:39.400596+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400596+0000","last_undegraded":"2023-07-21T22:55:39.400596+0000","last_fullsized":"2023-07-21T22:55:39.400596+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.393035+0000","last_change":"2023-07-21T22:55:39.393035+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.393035+0000","last_undegraded":"2023-07-21T22:55:39.393035+0000","last_fullsized":"2023-07-21T22:55:39.393035+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389757+0000","last_change":"2023-07-21T22:55:39.389757+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389757+0000","last_undegraded":"2023-07-21T22:55:39.389757+0000","last_fullsized":"2023-07-21T22:55:39.389757+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.399359+0000","last_change":"2023-07-21T22:55:39.399359+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.399359+0000","last_undegraded":"2023-07-21T22:55:39.399359+0000","last_fullsized":"2023-07-21T22:55:39.399359+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.409241+0000","last_change":"2023-07-21T22:55:39.409241+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.409241+0000","last_undegraded":"2023-07-21T22:55:39.409241+0000","last_fullsized":"2023-07-21T22:55:39.409241+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390489+0000","last_change":"2023-07-21T22:55:39.390489+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390489+0000","last_undegraded":"2023-07-21T22:55:39.390489+0000","last_fullsized":"2023-07-21T22:55:39.390489+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.398600+0000","last_change":"2023-07-21T22:55:39.398600+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.398600+0000","last_undegraded":"2023-07-21T22:55:39.398600+0000","last_fullsized":"2023-07-21T22:55:39.398600+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400546+0000","last_change":"2023-07-21T22:55:39.400546+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400546+0000","last_undegraded":"2023-07-21T22:55:39.400546+0000","last_fullsized":"2023-07-21T22:55:39.400546+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389737+0000","last_change":"2023-07-21T22:55:39.389737+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389737+0000","last_undegraded":"2023-07-21T22:55:39.389737+0000","last_fullsized":"2023-07-21T22:55:39.389737+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389926+0000","last_change":"2023-07-21T22:55:39.389926+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389926+0000","last_undegraded":"2023-07-21T22:55:39.389926+0000","last_fullsized":"2023-07-21T22:55:39.389926+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.410559+0000","last_change":"2023-07-21T22:55:39.410559+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.410559+0000","last_undegraded":"2023-07-21T22:55:39.410559+0000","last_fullsized":"2023-07-21T22:55:39.410559+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.391617+0000","last_change":"2023-07-21T22:55:39.391617+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.391617+0000","last_undegraded":"2023-07-21T22:55:39.391617+0000","last_fullsized":"2023-07-21T22:55:39.391617+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390428+0000","last_change":"2023-07-21T22:55:39.390428+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390428+0000","last_undegraded":"2023-07-21T22:55:39.390428+0000","last_fullsized":"2023-07-21T22:55:39.390428+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.406454+0000","last_change":"2023-07-21T22:55:39.406454+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.406454+0000","last_undegraded":"2023-07-21T22:55:39.406454+0000","last_fullsized":"2023-07-21T22:55:39.406454+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.394271+0000","last_change":"2023-07-21T22:55:39.394271+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.394271+0000","last_undegraded":"2023-07-21T22:55:39.394271+0000","last_fullsized":"2023-07-21T22:55:39.394271+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.402955+0000","last_change":"2023-07-21T22:55:39.401202+0000","last_active":"2023-07-21T22:55:39.402955+0000","last_peered":"2023-07-21T22:55:39.402955+0000","last_clean":"2023-07-21T22:55:39.402955+0000","last_became_active":"2023-07-21T22:55:39.400656+0000","last_became_peered":"2023-07-21T22:55:39.400656+0000","last_unstale":"2023-07-21T22:55:39.402955+0000","last_undegraded":"2023-07-21T22:55:39.402955+0000","last_fullsized":"2023-07-21T22:55:39.402955+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:04.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.395074+0000","last_change":"2023-07-21T22:55:39.395074+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.395074+0000","last_undegraded":"2023-07-21T22:55:39.395074+0000","last_fullsized":"2023-07-21T22:55:39.395074+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.416584+0000","last_change":"2023-07-21T22:55:39.415451+0000","last_active":"2023-07-21T22:55:39.416584+0000","last_peered":"2023-07-21T22:55:39.416584+0000","last_clean":"2023-07-21T22:55:39.416584+0000","last_became_active":"2023-07-21T22:55:39.415164+0000","last_became_peered":"2023-07-21T22:55:39.415164+0000","last_unstale":"2023-07-21T22:55:39.416584+0000","last_undegraded":"2023-07-21T22:55:39.416584+0000","last_fullsized":"2023-07-21T22:55:39.416584+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:03:06.312844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.404288+0000","last_change":"2023-07-21T22:55:39.404288+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.404288+0000","last_undegraded":"2023-07-21T22:55:39.404288+0000","last_fullsized":"2023-07-21T22:55:39.404288+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.416031+0000","last_change":"2023-07-21T22:55:39.414669+0000","last_active":"2023-07-21T22:55:39.416031+0000","last_peered":"2023-07-21T22:55:39.416031+0000","last_clean":"2023-07-21T22:55:39.416031+0000","last_became_active":"2023-07-21T22:55:39.414403+0000","last_became_peered":"2023-07-21T22:55:39.414403+0000","last_unstale":"2023-07-21T22:55:39.416031+0000","last_undegraded":"2023-07-21T22:55:39.416031+0000","last_fullsized":"2023-07-21T22:55:39.416031+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:27:09.502436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.401846+0000","last_change":"2023-07-21T22:55:39.401846+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.401846+0000","last_undegraded":"2023-07-21T22:55:39.401846+0000","last_fullsized":"2023-07-21T22:55:39.401846+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.414112+0000","last_change":"2023-07-21T22:55:39.413053+0000","last_active":"2023-07-21T22:55:39.414112+0000","last_peered":"2023-07-21T22:55:39.414112+0000","last_clean":"2023-07-21T22:55:39.414112+0000","last_became_active":"2023-07-21T22:55:39.412694+0000","last_became_peered":"2023-07-21T22:55:39.412694+0000","last_unstale":"2023-07-21T22:55:39.414112+0000","last_undegraded":"2023-07-21T22:55:39.414112+0000","last_fullsized":"2023-07-21T22:55:39.414112+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:21:56.166474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.392092+0000","last_change":"2023-07-21T22:55:39.392092+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.392092+0000","last_undegraded":"2023-07-21T22:55:39.392092+0000","last_fullsized":"2023-07-21T22:55:39.392092+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.421505+0000","last_change":"2023-07-21T22:55:39.418236+0000","last_active":"2023-07-21T22:55:39.421505+0000","last_peered":"2023-07-21T22:55:39.421505+0000","last_clean":"2023-07-21T22:55:39.421505+0000","last_became_active":"2023-07-21T22:55:39.417975+0000","last_became_peered":"2023-07-21T22:55:39.417975+0000","last_unstale":"2023-07-21T22:55:39.421505+0000","last_undegraded":"2023-07-21T22:55:39.421505+0000","last_fullsized":"2023-07-21T22:55:39.421505+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:14:45.372222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.402061+0000","last_change":"2023-07-21T22:55:39.402061+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.402061+0000","last_undegraded":"2023-07-21T22:55:39.402061+0000","last_fullsized":"2023-07-21T22:55:39.402061+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.408618+0000","last_change":"2023-07-21T22:55:39.407508+0000","last_active":"2023-07-21T22:55:39.408618+0000","last_peered":"2023-07-21T22:55:39.408618+0000","last_clean":"2023-07-21T22:55:39.408618+0000","last_became_active":"2023-07-21T22:55:39.407178+0000","last_became_peered":"2023-07-21T22:55:39.407178+0000","last_unstale":"2023-07-21T22:55:39.408618+0000","last_undegraded":"2023-07-21T22:55:39.408618+0000","last_fullsized":"2023-07-21T22:55:39.408618+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:57.640218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.393735+0000","last_change":"2023-07-21T22:55:39.393735+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.393735+0000","last_undegraded":"2023-07-21T22:55:39.393735+0000","last_fullsized":"2023-07-21T22:55:39.393735+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.414400+0000","last_change":"2023-07-21T22:55:39.411817+0000","last_active":"2023-07-21T22:55:39.414400+0000","last_peered":"2023-07-21T22:55:39.414400+0000","last_clean":"2023-07-21T22:55:39.414400+0000","last_became_active":"2023-07-21T22:55:39.411096+0000","last_became_peered":"2023-07-21T22:55:39.411096+0000","last_unstale":"2023-07-21T22:55:39.414400+0000","last_undegraded":"2023-07-21T22:55:39.414400+0000","last_fullsized":"2023-07-21T22:55:39.414400+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:37:11.626613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.398075+0000","last_change":"2023-07-21T22:55:39.398075+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.398075+0000","last_undegraded":"2023-07-21T22:55:39.398075+0000","last_fullsized":"2023-07-21T22:55:39.398075+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.401777+0000","last_change":"2023-07-21T22:55:39.398085+0000","last_active":"2023-07-21T22:55:39.401777+0000","last_peered":"2023-07-21T22:55:39.401777+0000","last_clean":"2023-07-21T22:55:39.401777+0000","last_became_active":"2023-07-21T22:55:39.397730+0000","last_became_peered":"2023-07-21T22:55:39.397730+0000","last_unstale":"2023-07-21T22:55:39.401777+0000","last_undegraded":"2023-07-21T22:55:39.401777+0000","last_fullsized":"2023-07-21T22:55:39.401777+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:58:28.209192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400927+0000","last_change":"2023-07-21T22:55:39.400927+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400927+0000","last_undegraded":"2023-07-21T22:55:39.400927+0000","last_fullsized":"2023-07-21T22:55:39.400927+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.404167+0000","last_change":"2023-07-21T22:55:39.401715+0000","last_active":"2023-07-21T22:55:39.404167+0000","last_peered":"2023-07-21T22:55:39.404167+0000","last_clean":"2023-07-21T22:55:39.404167+0000","last_became_active":"2023-07-21T22:55:39.401360+0000","last_became_peered":"2023-07-21T22:55:39.401360+0000","last_unstale":"2023-07-21T22:55:39.404167+0000","last_undegraded":"2023-07-21T22:55:39.404167+0000","last_fullsized":"2023-07-21T22:55:39.404167+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:54:37.310776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.402158+0000","last_change":"2023-07-21T22:55:39.402158+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.402158+0000","last_undegraded":"2023-07-21T22:55:39.402158+0000","last_fullsized":"2023-07-21T22:55:39.402158+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.413599+0000","last_change":"2023-07-21T22:55:39.410646+0000","last_active":"2023-07-21T22:55:39.413599+0000","last_peered":"2023-07-21T22:55:39.413599+0000","last_clean":"2023-07-21T22:55:39.413599+0000","last_became_active":"2023-07-21T22:55:39.410319+0000","last_became_peered":"2023-07-21T22:55:39.410319+0000","last_unstale":"2023-07-21T22:55:39.413599+0000","last_undegraded":"2023-07-21T22:55:39.413599+0000","last_fullsized":"2023-07-21T22:55:39.413599+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:37:16.993672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400095+0000","last_change":"2023-07-21T22:55:39.400095+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400095+0000","last_undegraded":"2023-07-21T22:55:39.400095+0000","last_fullsized":"2023-07-21T22:55:39.400095+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.411672+0000","last_change":"2023-07-21T22:55:39.409616+0000","last_active":"2023-07-21T22:55:39.411672+0000","last_peered":"2023-07-21T22:55:39.411672+0000","last_clean":"2023-07-21T22:55:39.411672+0000","last_became_active":"2023-07-21T22:55:39.409314+0000","last_became_peered":"2023-07-21T22:55:39.409314+0000","last_unstale":"2023-07-21T22:55:39.411672+0000","last_undegraded":"2023-07-21T22:55:39.411672+0000","last_fullsized":"2023-07-21T22:55:39.411672+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:21:46.525218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.397798+0000","last_change":"2023-07-21T22:55:39.397798+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.397798+0000","last_undegraded":"2023-07-21T22:55:39.397798+0000","last_fullsized":"2023-07-21T22:55:39.397798+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.424162+0000","last_change":"2023-07-21T22:55:39.421460+0000","last_active":"2023-07-21T22:55:39.424162+0000","last_peered":"2023-07-21T22:55:39.424162+0000","last_clean":"2023-07-21T22:55:39.424162+0000","last_became_active":"2023-07-21T22:55:39.421077+0000","last_became_peered":"2023-07-21T22:55:39.421077+0000","last_unstale":"2023-07-21T22:55:39.424162+0000","last_undegraded":"2023-07-21T22:55:39.424162+0000","last_fullsized":"2023-07-21T22:55:39.424162+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:46:13.990885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400048+0000","last_change":"2023-07-21T22:55:39.400048+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400048+0000","last_undegraded":"2023-07-21T22:55:39.400048+0000","last_fullsized":"2023-07-21T22:55:39.400048+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.413967+0000","last_change":"2023-07-21T22:55:39.413026+0000","last_active":"2023-07-21T22:55:39.413967+0000","last_peered":"2023-07-21T22:55:39.413967+0000","last_clean":"2023-07-21T22:55:39.413967+0000","last_became_active":"2023-07-21T22:55:39.412686+0000","last_became_peered":"2023-07-21T22:55:39.412686+0000","last_unstale":"2023-07-21T22:55:39.413967+0000","last_undegraded":"2023-07-21T22:55:39.413967+0000","last_fullsized":"2023-07-21T22:55:39.413967+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:38:37.952444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.395632+0000","last_change":"2023-07-21T22:55:39.395632+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.395632+0000","last_undegraded":"2023-07-21T22:55:39.395632+0000","last_fullsized":"2023-07-21T22:55:39.395632+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.420502+0000","last_change":"2023-07-21T22:55:39.415018+0000","last_active":"2023-07-21T22:55:39.420502+0000","last_peered":"2023-07-21T22:55:39.420502+0000","last_clean":"2023-07-21T22:55:39.420502+0000","last_became_active":"2023-07-21T22:55:39.414713+0000","last_became_peered":"2023-07-21T22:55:39.414713+0000","last_unstale":"2023-07-21T22:55:39.420502+0000","last_undegraded":"2023-07-21T22:55:39.420502+0000","last_fullsized":"2023-07-21T22:55:39.420502+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:41:31.314913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400785+0000","last_change":"2023-07-21T22:55:39.400785+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400785+0000","last_undegraded":"2023-07-21T22:55:39.400785+0000","last_fullsized":"2023-07-21T22:55:39.400785+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.413948+0000","last_change":"2023-07-21T22:55:39.412811+0000","last_active":"2023-07-21T22:55:39.413948+0000","last_peered":"2023-07-21T22:55:39.413948+0000","last_clean":"2023-07-21T22:55:39.413948+0000","last_became_active":"2023-07-21T22:55:39.412344+0000","last_became_peered":"2023-07-21T22:55:39.412344+0000","last_unstale":"2023-07-21T22:55:39.413948+0000","last_undegraded":"2023-07-21T22:55:39.413948+0000","last_fullsized":"2023-07-21T22:55:39.413948+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:13:16.596486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.394645+0000","last_change":"2023-07-21T22:55:39.394645+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.394645+0000","last_undegraded":"2023-07-21T22:55:39.394645+0000","last_fullsized":"2023-07-21T22:55:39.394645+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.420587+0000","last_change":"2023-07-21T22:55:39.416526+0000","last_active":"2023-07-21T22:55:39.420587+0000","last_peered":"2023-07-21T22:55:39.420587+0000","last_clean":"2023-07-21T22:55:39.420587+0000","last_became_active":"2023-07-21T22:55:39.416238+0000","last_became_peered":"2023-07-21T22:55:39.416238+0000","last_unstale":"2023-07-21T22:55:39.420587+0000","last_undegraded":"2023-07-21T22:55:39.420587+0000","last_fullsized":"2023-07-21T22:55:39.420587+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:33:27.404274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389979+0000","last_change":"2023-07-21T22:55:39.389979+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389979+0000","last_undegraded":"2023-07-21T22:55:39.389979+0000","last_fullsized":"2023-07-21T22:55:39.389979+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.424174+0000","last_change":"2023-07-21T22:55:39.421412+0000","last_active":"2023-07-21T22:55:39.424174+0000","last_peered":"2023-07-21T22:55:39.424174+0000","last_clean":"2023-07-21T22:55:39.424174+0000","last_became_active":"2023-07-21T22:55:39.421070+0000","last_became_peered":"2023-07-21T22:55:39.421070+0000","last_unstale":"2023-07-21T22:55:39.424174+0000","last_undegraded":"2023-07-21T22:55:39.424174+0000","last_fullsized":"2023-07-21T22:55:39.424174+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:10:42.306495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.403699+0000","last_change":"2023-07-21T22:55:39.403699+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.403699+0000","last_undegraded":"2023-07-21T22:55:39.403699+0000","last_fullsized":"2023-07-21T22:55:39.403699+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.414106+0000","last_change":"2023-07-21T22:55:39.410781+0000","last_active":"2023-07-21T22:55:39.414106+0000","last_peered":"2023-07-21T22:55:39.414106+0000","last_clean":"2023-07-21T22:55:39.414106+0000","last_became_active":"2023-07-21T22:55:39.410464+0000","last_became_peered":"2023-07-21T22:55:39.410464+0000","last_unstale":"2023-07-21T22:55:39.414106+0000","last_undegraded":"2023-07-21T22:55:39.414106+0000","last_fullsized":"2023-07-21T22:55:39.414106+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:38.264202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.398664+0000","last_change":"2023-07-21T22:55:39.398664+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.398664+0000","last_undegraded":"2023-07-21T22:55:39.398664+0000","last_fullsized":"2023-07-21T22:55:39.398664+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.415219+0000","last_change":"2023-07-21T22:55:39.414668+0000","last_active":"2023-07-21T22:55:39.415219+0000","last_peered":"2023-07-21T22:55:39.415219+0000","last_clean":"2023-07-21T22:55:39.415219+0000","last_became_active":"2023-07-21T22:55:39.414446+0000","last_became_peered":"2023-07-21T22:55:39.414446+0000","last_unstale":"2023-07-21T22:55:39.415219+0000","last_undegraded":"2023-07-21T22:55:39.415219+0000","last_fullsized":"2023-07-21T22:55:39.415219+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:43:53.073313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390838+0000","last_change":"2023-07-21T22:55:39.390838+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390838+0000","last_undegraded":"2023-07-21T22:55:39.390838+0000","last_fullsized":"2023-07-21T22:55:39.390838+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.411654+0000","last_change":"2023-07-21T22:55:39.410389+0000","last_active":"2023-07-21T22:55:39.411654+0000","last_peered":"2023-07-21T22:55:39.411654+0000","last_clean":"2023-07-21T22:55:39.411654+0000","last_became_active":"2023-07-21T22:55:39.410069+0000","last_became_peered":"2023-07-21T22:55:39.410069+0000","last_unstale":"2023-07-21T22:55:39.411654+0000","last_undegraded":"2023-07-21T22:55:39.411654+0000","last_fullsized":"2023-07-21T22:55:39.411654+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:57:24.219727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.405357+0000","last_change":"2023-07-21T22:55:39.405357+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.405357+0000","last_undegraded":"2023-07-21T22:55:39.405357+0000","last_fullsized":"2023-07-21T22:55:39.405357+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.414038+0000","last_change":"2023-07-21T22:55:39.409683+0000","last_active":"2023-07-21T22:55:39.414038+0000","last_peered":"2023-07-21T22:55:39.414038+0000","last_clean":"2023-07-21T22:55:39.414038+0000","last_became_active":"2023-07-21T22:55:39.409275+0000","last_became_peered":"2023-07-21T22:55:39.409275+0000","last_unstale":"2023-07-21T22:55:39.414038+0000","last_undegraded":"2023-07-21T22:55:39.414038+0000","last_fullsized":"2023-07-21T22:55:39.414038+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:22:24.546522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.401528+0000","last_change":"2023-07-21T22:55:39.401528+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.401528+0000","last_undegraded":"2023-07-21T22:55:39.401528+0000","last_fullsized":"2023-07-21T22:55:39.401528+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.409681+0000","last_change":"2023-07-21T22:55:39.408656+0000","last_active":"2023-07-21T22:55:39.409681+0000","last_peered":"2023-07-21T22:55:39.409681+0000","last_clean":"2023-07-21T22:55:39.409681+0000","last_became_active":"2023-07-21T22:55:39.408375+0000","last_became_peered":"2023-07-21T22:55:39.408375+0000","last_unstale":"2023-07-21T22:55:39.409681+0000","last_undegraded":"2023-07-21T22:55:39.409681+0000","last_fullsized":"2023-07-21T22:55:39.409681+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:37:46.249905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.393131+0000","last_change":"2023-07-21T22:55:39.393131+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.393131+0000","last_undegraded":"2023-07-21T22:55:39.393131+0000","last_fullsized":"2023-07-21T22:55:39.393131+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.408131+0000","last_change":"2023-07-21T22:55:39.405548+0000","last_active":"2023-07-21T22:55:39.408131+0000","last_peered":"2023-07-21T22:55:39.408131+0000","last_clean":"2023-07-21T22:55:39.408131+0000","last_became_active":"2023-07-21T22:55:39.405263+0000","last_became_peered":"2023-07-21T22:55:39.405263+0000","last_unstale":"2023-07-21T22:55:39.408131+0000","last_undegraded":"2023-07-21T22:55:39.408131+0000","last_fullsized":"2023-07-21T22:55:39.408131+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:25.424089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.411717+0000","last_change":"2023-07-21T22:55:39.411717+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.411717+0000","last_undegraded":"2023-07-21T22:55:39.411717+0000","last_fullsized":"2023-07-21T22:55:39.411717+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.413391+0000","last_change":"2023-07-21T22:55:39.410357+0000","last_active":"2023-07-21T22:55:39.413391+0000","last_peered":"2023-07-21T22:55:39.413391+0000","last_clean":"2023-07-21T22:55:39.413391+0000","last_became_active":"2023-07-21T22:55:39.410057+0000","last_became_peered":"2023-07-21T22:55:39.410057+0000","last_unstale":"2023-07-21T22:55:39.413391+0000","last_undegraded":"2023-07-21T22:55:39.413391+0000","last_fullsized":"2023-07-21T22:55:39.413391+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:17.185704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.403054+0000","last_change":"2023-07-21T22:55:39.403054+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.403054+0000","last_undegraded":"2023-07-21T22:55:39.403054+0000","last_fullsized":"2023-07-21T22:55:39.403054+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.408793+0000","last_change":"2023-07-21T22:55:39.408029+0000","last_active":"2023-07-21T22:55:39.408793+0000","last_peered":"2023-07-21T22:55:39.408793+0000","last_clean":"2023-07-21T22:55:39.408793+0000","last_became_active":"2023-07-21T22:55:39.407599+0000","last_became_peered":"2023-07-21T22:55:39.407599+0000","last_unstale":"2023-07-21T22:55:39.408793+0000","last_undegraded":"2023-07-21T22:55:39.408793+0000","last_fullsized":"2023-07-21T22:55:39.408793+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:47:28.521879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"161'304","reported_seq":1102,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.403239+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:55:39.403239+0000","last_peered":"2023-07-21T22:55:39.403239+0000","last_clean":"2023-07-21T22:55:39.403239+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:55:39.403239+0000","last_undegraded":"2023-07-21T22:55:39.403239+0000","last_fullsized":"2023-07-21T22:55:39.403239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:59:21.958943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":318,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.400239+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:55:39.400239+0000","last_peered":"2023-07-21T22:55:39.400239+0000","last_clean":"2023-07-21T22:55:39.400239+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:55:39.400239+0000","last_undegraded":"2023-07-21T22:55:39.400239+0000","last_fullsized":"2023-07-21T22:55:39.400239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:05.686648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.406020+0000","last_change":"2023-07-21T22:55:39.406020+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.406020+0000","last_undegraded":"2023-07-21T22:55:39.406020+0000","last_fullsized":"2023-07-21T22:55:39.406020+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.413420+0000","last_change":"2023-07-21T22:55:39.408771+0000","last_active":"2023-07-21T22:55:39.413420+0000","last_peered":"2023-07-21T22:55:39.413420+0000","last_clean":"2023-07-21T22:55:39.413420+0000","last_became_active":"2023-07-21T22:55:39.408492+0000","last_became_peered":"2023-07-21T22:55:39.408492+0000","last_unstale":"2023-07-21T22:55:39.413420+0000","last_undegraded":"2023-07-21T22:55:39.413420+0000","last_fullsized":"2023-07-21T22:55:39.413420+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:19:33.763010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":283,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.403087+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:55:39.403087+0000","last_peered":"2023-07-21T22:55:39.403087+0000","last_clean":"2023-07-21T22:55:39.403087+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:55:39.403087+0000","last_undegraded":"2023-07-21T22:55:39.403087+0000","last_fullsized":"2023-07-21T22:55:39.403087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:36:16.226544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.391374+0000","last_change":"2023-07-21T22:55:39.391374+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.391374+0000","last_undegraded":"2023-07-21T22:55:39.391374+0000","last_fullsized":"2023-07-21T22:55:39.391374+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.412261+0000","last_change":"2023-07-21T22:55:39.407686+0000","last_active":"2023-07-21T22:55:39.412261+0000","last_peered":"2023-07-21T22:55:39.412261+0000","last_clean":"2023-07-21T22:55:39.412261+0000","last_became_active":"2023-07-21T22:55:39.407414+0000","last_became_peered":"2023-07-21T22:55:39.407414+0000","last_unstale":"2023-07-21T22:55:39.412261+0000","last_undegraded":"2023-07-21T22:55:39.412261+0000","last_fullsized":"2023-07-21T22:55:39.412261+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:34:16.780319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":286,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.395421+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:55:39.395421+0000","last_peered":"2023-07-21T22:55:39.395421+0000","last_clean":"2023-07-21T22:55:39.395421+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:55:39.395421+0000","last_undegraded":"2023-07-21T22:55:39.395421+0000","last_fullsized":"2023-07-21T22:55:39.395421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:54:19.537921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390156+0000","last_change":"2023-07-21T22:55:39.390156+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390156+0000","last_undegraded":"2023-07-21T22:55:39.390156+0000","last_fullsized":"2023-07-21T22:55:39.390156+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.401574+0000","last_change":"2023-07-21T22:55:39.399053+0000","last_active":"2023-07-21T22:55:39.401574+0000","last_peered":"2023-07-21T22:55:39.401574+0000","last_clean":"2023-07-21T22:55:39.401574+0000","last_became_active":"2023-07-21T22:55:39.398779+0000","last_became_peered":"2023-07-21T22:55:39.398779+0000","last_unstale":"2023-07-21T22:55:39.401574+0000","last_undegraded":"2023-07-21T22:55:39.401574+0000","last_fullsized":"2023-07-21T22:55:39.401574+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:02:52.668876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":318,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.399640+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:55:39.399640+0000","last_peered":"2023-07-21T22:55:39.399640+0000","last_clean":"2023-07-21T22:55:39.399640+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:55:39.399640+0000","last_undegraded":"2023-07-21T22:55:39.399640+0000","last_fullsized":"2023-07-21T22:55:39.399640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:43:22.060057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.405829+0000","last_change":"2023-07-21T22:55:39.405829+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.405829+0000","last_undegraded":"2023-07-21T22:55:39.405829+0000","last_fullsized":"2023-07-21T22:55:39.405829+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.402349+0000","last_change":"2023-07-21T22:55:39.398435+0000","last_active":"2023-07-21T22:55:39.402349+0000","last_peered":"2023-07-21T22:55:39.402349+0000","last_clean":"2023-07-21T22:55:39.402349+0000","last_became_active":"2023-07-21T22:55:39.398171+0000","last_became_peered":"2023-07-21T22:55:39.398171+0000","last_unstale":"2023-07-21T22:55:39.402349+0000","last_undegraded":"2023-07-21T22:55:39.402349+0000","last_fullsized":"2023-07-21T22:55:39.402349+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:36.093425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":298,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.394565+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:55:39.394565+0000","last_peered":"2023-07-21T22:55:39.394565+0000","last_clean":"2023-07-21T22:55:39.394565+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:55:39.394565+0000","last_undegraded":"2023-07-21T22:55:39.394565+0000","last_fullsized":"2023-07-21T22:55:39.394565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:54:05.783821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.396061+0000","last_change":"2023-07-21T22:55:39.396061+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.396061+0000","last_undegraded":"2023-07-21T22:55:39.396061+0000","last_fullsized":"2023-07-21T22:55:39.396061+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.424121+0000","last_change":"2023-07-21T22:55:39.421220+0000","last_active":"2023-07-21T22:55:39.424121+0000","last_peered":"2023-07-21T22:55:39.424121+0000","last_clean":"2023-07-21T22:55:39.424121+0000","last_became_active":"2023-07-21T22:55:39.420898+0000","last_became_peered":"2023-07-21T22:55:39.420898+0000","last_unstale":"2023-07-21T22:55:39.424121+0000","last_undegraded":"2023-07-21T22:55:39.424121+0000","last_fullsized":"2023-07-21T22:55:39.424121+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:43:41.626753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":282,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.403123+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:55:39.403123+0000","last_peered":"2023-07-21T22:55:39.403123+0000","last_clean":"2023-07-21T22:55:39.403123+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:55:39.403123+0000","last_undegraded":"2023-07-21T22:55:39.403123+0000","last_fullsized":"2023-07-21T22:55:39.403123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:31:30.358830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390327+0000","last_change":"2023-07-21T22:55:39.390327+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390327+0000","last_undegraded":"2023-07-21T22:55:39.390327+0000","last_fullsized":"2023-07-21T22:55:39.390327+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.412393+0000","last_change":"2023-07-21T22:55:39.407762+0000","last_active":"2023-07-21T22:55:39.412393+0000","last_peered":"2023-07-21T22:55:39.412393+0000","last_clean":"2023-07-21T22:55:39.412393+0000","last_became_active":"2023-07-21T22:55:39.407480+0000","last_became_peered":"2023-07-21T22:55:39.407480+0000","last_unstale":"2023-07-21T22:55:39.412393+0000","last_undegraded":"2023-07-21T22:55:39.412393+0000","last_fullsized":"2023-07-21T22:55:39.412393+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:11:42.677965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":298,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.393672+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:55:39.393672+0000","last_peered":"2023-07-21T22:55:39.393672+0000","last_clean":"2023-07-21T22:55:39.393672+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:55:39.393672+0000","last_undegraded":"2023-07-21T22:55:39.393672+0000","last_fullsized":"2023-07-21T22:55:39.393672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:57:19.939012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.395164+0000","last_change":"2023-07-21T22:55:39.395164+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.395164+0000","last_undegraded":"2023-07-21T22:55:39.395164+0000","last_fullsized":"2023-07-21T22:55:39.395164+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.412302+0000","last_change":"2023-07-21T22:55:39.408717+0000","last_active":"2023-07-21T22:55:39.412302+0000","last_peered":"2023-07-21T22:55:39.412302+0000","last_clean":"2023-07-21T22:55:39.412302+0000","last_became_active":"2023-07-21T22:55:39.408445+0000","last_became_peered":"2023-07-21T22:55:39.408445+0000","last_unstale":"2023-07-21T22:55:39.412302+0000","last_undegraded":"2023-07-21T22:55:39.412302+0000","last_fullsized":"2023-07-21T22:55:39.412302+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:03:08.912070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":280,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.406693+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:55:39.406693+0000","last_peered":"2023-07-21T22:55:39.406693+0000","last_clean":"2023-07-21T22:55:39.406693+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:55:39.406693+0000","last_undegraded":"2023-07-21T22:55:39.406693+0000","last_fullsized":"2023-07-21T22:55:39.406693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:25:05.889779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509880,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59944,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94311896,"statfs":{"total":96636764160,"available":96575381504,"internally_reserved":0,"allocated":2719744,"data_stored":1676913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.34999999999999998},"max":{"1min":0.89300000000000002,"5min":1.032,"15min":1.143},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.54700000000000004,"5min":0.47999999999999998,"15min":0.39000000000000001},"max":{"1min":0.875,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.61899999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.749,"15min":0.76400000000000001},"min":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.40600000000000003},"max":{"1min":0.86199999999999999,"5min":0.96599999999999997,"15min":1.0820000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73899999999999999,"15min":0.746},"min":{"1min":0.51500000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94399999999999995,"5min":0.97299999999999998,"15min":1.02},"last":0.752}]},{"osd":2,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75,"15min":0.76000000000000001},"min":{"1min":0.61099999999999999,"5min":0.54800000000000004,"15min":0.47999999999999998},"max":{"1min":0.89500000000000002,"5min":1.0049999999999999,"15min":1.0780000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.624,"5min":0.51100000000000001,"15min":0.42299999999999999},"max":{"1min":0.93100000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.63700000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77300000000000002,"15min":0.78000000000000003},"min":{"1min":0.61199999999999999,"5min":0.48399999999999999,"15min":0.45600000000000002},"max":{"1min":0.88300000000000001,"5min":1.077,"15min":1.0980000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.64900000000000002,"5min":0.57699999999999996,"15min":0.53400000000000003},"max":{"1min":0.92800000000000005,"5min":1.026,"15min":1.036},"last":0.82499999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.34999999999999998},"max":{"1min":0.68300000000000005,"5min":0.81299999999999994,"15min":0.89700000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.60599999999999998},"min":{"1min":0.439,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":0.83299999999999996,"5min":0.88,"15min":1.0940000000000001},"last":0.80200000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58699999999999997,"15min":0.60599999999999998},"min":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.41199999999999998},"max":{"1min":0.81000000000000005,"5min":0.88300000000000001,"15min":0.99399999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65800000000000003,"15min":0.66600000000000004},"min":{"1min":0.48599999999999999,"5min":0.433,"15min":0.40699999999999997},"max":{"1min":0.84999999999999998,"5min":1.0129999999999999,"15min":1.077},"last":0.89200000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.51900000000000002,"5min":0.47999999999999998,"15min":0.45500000000000002},"max":{"1min":0.81299999999999994,"5min":0.91100000000000003,"15min":0.97399999999999998},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.63300000000000001,"15min":0.63100000000000001},"min":{"1min":0.47999999999999998,"5min":0.41299999999999998,"15min":0.41099999999999998},"max":{"1min":0.86699999999999999,"5min":0.871,"15min":1.105},"last":1.1539999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542586,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37220,"kb_used_data":2076,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334620,"statfs":{"total":96636764160,"available":96598650880,"internally_reserved":0,"allocated":2125824,"data_stored":1086545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0009999999999999,"5min":1.024,"15min":1.024},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80200000000000005,"15min":0.80800000000000005},"min":{"1min":0.63800000000000001,"5min":0.58299999999999996,"15min":0.54000000000000004},"max":{"1min":1,"5min":1,"15min":1.0780000000000001},"last":0.72999999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.51400000000000001,"5min":0.51000000000000001,"15min":0.50900000000000001},"max":{"1min":0.96199999999999997,"5min":0.96599999999999997,"15min":1.006},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.54200000000000004,"5min":0.48899999999999999,"15min":0.42499999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78500000000000003,"15min":0.78300000000000003},"min":{"1min":0.59599999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.92100000000000004,"5min":1.002,"15min":1.0409999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.80900000000000005,"15min":0.80600000000000005},"min":{"1min":0.61299999999999999,"5min":0.498,"15min":0.46600000000000003},"max":{"1min":0.98799999999999999,"5min":1.0089999999999999,"15min":1.0600000000000001},"last":0.61499999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.754,"15min":0.754},"min":{"1min":0.66600000000000004,"5min":0.53000000000000003,"15min":0.48999999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76200000000000001,"15min":0.753},"min":{"1min":0.58799999999999997,"5min":0.53300000000000003,"15min":0.52300000000000002},"max":{"1min":0.93000000000000005,"5min":0.96199999999999997,"15min":1.0389999999999999},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.92300000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.46400000000000002,"5min":0.41899999999999998,"15min":0.33500000000000002},"max":{"1min":0.93600000000000005,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65200000000000002,"15min":0.64700000000000002},"min":{"1min":0.503,"5min":0.44600000000000001,"15min":0.38900000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.96299999999999997},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.66100000000000003},"min":{"1min":0.46300000000000002,"5min":0.45600000000000002,"15min":0.38700000000000001},"max":{"1min":0.81999999999999995,"5min":0.91600000000000004,"15min":1.0129999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48299999999999998,"5min":0.46800000000000003,"15min":0.432},"max":{"1min":0.90000000000000002,"5min":0.96299999999999997,"15min":1.0780000000000001},"last":0.57899999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509879,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55280,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316560,"statfs":{"total":96636764160,"available":96580157440,"internally_reserved":0,"allocated":2138112,"data_stored":1093245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.57599999999999996,"5min":0.39200000000000002,"15min":0.32100000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.73099999999999998},"min":{"1min":0.53300000000000003,"5min":0.432,"15min":0.41499999999999998},"max":{"1min":0.91300000000000003,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.67300000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.74299999999999999,"15min":0.73299999999999998},"min":{"1min":0.60799999999999998,"5min":0.495,"15min":0.42399999999999999},"max":{"1min":0.89000000000000001,"5min":0.999,"15min":1.0289999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.745,"15min":0.73999999999999999},"min":{"1min":0.60599999999999998,"5min":0.45800000000000002,"15min":0.42999999999999999},"max":{"1min":0.97999999999999998,"5min":1.054,"15min":1.054},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.752,"15min":0.752},"min":{"1min":0.64300000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88400000000000001,"5min":1.119,"15min":1.119},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.75700000000000001,"15min":0.748},"min":{"1min":0.57799999999999996,"5min":0.53600000000000003,"15min":0.49299999999999999},"max":{"1min":0.95699999999999996,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.79900000000000004,"15min":0.78500000000000003},"min":{"1min":0.69199999999999995,"5min":0.61499999999999999,"15min":0.47299999999999998},"max":{"1min":1.0009999999999999,"5min":1.169,"15min":1.169},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80000000000000004,"15min":0.80700000000000005},"min":{"1min":0.56399999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0169999999999999,"5min":1.0409999999999999,"15min":1.0429999999999999},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84799999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.47399999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97999999999999998,"5min":1.01,"15min":1.0369999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.59099999999999997},"min":{"1min":0.47999999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91900000000000004,"5min":0.93600000000000005,"15min":1.0629999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63600000000000001,"15min":0.65000000000000002},"min":{"1min":0.45700000000000002,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":0.95899999999999996,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72399999999999998,"15min":0.72099999999999997},"min":{"1min":0.51000000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.84299999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37232,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334608,"statfs":{"total":96636764160,"available":96598638592,"internally_reserved":0,"allocated":2138112,"data_stored":1093245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.73799999999999999,"15min":0.75800000000000001},"min":{"1min":0.64500000000000002,"5min":0.41299999999999998,"15min":0.34599999999999997},"max":{"1min":0.93500000000000005,"5min":0.94199999999999995,"15min":1.0509999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.35299999999999998},"max":{"1min":0.96899999999999997,"5min":1.006,"15min":1.03},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.72299999999999998,"15min":0.72599999999999998},"min":{"1min":0.55800000000000005,"5min":0.502,"15min":0.432},"max":{"1min":1.0229999999999999,"5min":1.089,"15min":1.089},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.54400000000000004,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":0.871,"5min":0.97599999999999998,"15min":1.0129999999999999},"last":0.68600000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79100000000000004,"15min":0.78500000000000003},"min":{"1min":0.625,"5min":0.59899999999999998,"15min":0.46899999999999997},"max":{"1min":0.95099999999999996,"5min":1.292,"15min":1.292},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.65100000000000002,"5min":0.51300000000000001,"15min":0.501},"max":{"1min":0.99099999999999999,"5min":1.038,"15min":1.038},"last":0.752}]},{"osd":3,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.752,"15min":0.747},"min":{"1min":0.68999999999999995,"5min":0.51400000000000001,"15min":0.49299999999999999},"max":{"1min":1.0069999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.70399999999999996,"5min":0.61399999999999999,"15min":0.54200000000000004},"max":{"1min":0.98399999999999999,"5min":1.218,"15min":1.218},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.371},"max":{"1min":0.70399999999999996,"5min":1.028,"15min":1.028},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.59499999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.93300000000000005,"5min":1.151,"15min":1.151},"last":0.91900000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65300000000000002,"15min":0.65500000000000003},"min":{"1min":0.45800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93400000000000005,"5min":1.252,"15min":1.252},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.39100000000000001},"max":{"1min":0.80500000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.88200000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89300000000000002,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68600000000000005,"15min":0.68200000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.42999999999999999},"max":{"1min":0.83999999999999997,"5min":1.206,"15min":1.206},"last":0.83999999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37232,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334608,"statfs":{"total":96636764160,"available":96598638592,"internally_reserved":0,"allocated":2138112,"data_stored":1093245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52500000000000002,"15min":0.505},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.27900000000000003},"max":{"1min":0.746,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.46000000000000002,"5min":0.441,"15min":0.39300000000000002},"max":{"1min":0.68100000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53200000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.64300000000000002,"5min":0.71399999999999997,"15min":0.81599999999999995},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.35599999999999998},"max":{"1min":0.68700000000000006,"5min":0.79100000000000004,"15min":0.93899999999999995},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.45100000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72199999999999998,"5min":0.83199999999999996,"15min":1.0249999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.36299999999999999},"max":{"1min":0.76500000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48099999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.78300000000000003,"15min":0.78900000000000003},"min":{"1min":0.53300000000000003,"5min":0.441,"15min":0.441},"max":{"1min":1.071,"5min":1.101,"15min":1.343},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84599999999999997,"15min":0.85099999999999998},"min":{"1min":0.63100000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.002,"5min":1.119,"15min":1.373},"last":0.67700000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79800000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.99099999999999999,"5min":1.085,"15min":1.3799999999999999},"last":0.746},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80300000000000005,"15min":0.81000000000000005},"min":{"1min":0.69099999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94699999999999995,"5min":1.087,"15min":1.2230000000000001},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.81599999999999995},"min":{"1min":0.61799999999999999,"5min":0.55700000000000005,"15min":0.55300000000000005},"max":{"1min":1.0249999999999999,"5min":1.127,"15min":1.2689999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53000000000000003},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.3660000000000001},"last":0.70699999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83199999999999996,"15min":0.83499999999999996},"min":{"1min":0.56399999999999995,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":1.0109999999999999,"5min":1.1399999999999999,"15min":1.4510000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84099999999999997,"15min":0.85499999999999998},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.57299999999999995},"max":{"1min":1.0489999999999999,"5min":1.0820000000000001,"15min":1.427},"last":0.61399999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509881,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55280,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316560,"statfs":{"total":96636764160,"available":96580157440,"internally_reserved":0,"allocated":2138112,"data_stored":1093245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.502,"15min":0.502},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.26500000000000001},"max":{"1min":0.72699999999999998,"5min":0.73999999999999999,"15min":1.0680000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.377},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":1.0780000000000001},"last":0.52800000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.437,"5min":0.38800000000000001,"15min":0.35599999999999998},"max":{"1min":0.751,"5min":0.86199999999999999,"15min":0.90300000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.60699999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.752,"5min":0.89100000000000001,"15min":0.91300000000000003},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.495,"15min":0.5},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.65900000000000003,"5min":0.71099999999999997,"15min":0.92800000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.42099999999999999,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.81899999999999995,"15min":0.95399999999999996},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.81100000000000005,"15min":0.81499999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.002,"5min":1.1839999999999999,"15min":1.2809999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81699999999999995,"15min":0.82799999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.439},"max":{"1min":1.1359999999999999,"5min":1.391,"15min":1.391},"last":0.69199999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81000000000000005,"15min":0.81799999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98999999999999999,"5min":1.218,"15min":1.218},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.81999999999999995,"15min":0.83499999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.47499999999999998},"max":{"1min":1.0660000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.81499999999999995,"15min":0.82199999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.495},"max":{"1min":1.048,"5min":1.262,"15min":1.2969999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.627,"5min":0.55600000000000005,"15min":0.55500000000000005},"max":{"1min":1.085,"5min":1.214,"15min":1.2390000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83099999999999996,"15min":0.84499999999999997},"min":{"1min":0.65600000000000003,"5min":0.60199999999999998,"15min":0.51300000000000001},"max":{"1min":1.1200000000000001,"5min":1.2629999999999999,"15min":1.3360000000000001},"last":0.623},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82799999999999996,"15min":0.84399999999999997},"min":{"1min":0.60599999999999998,"5min":0.57999999999999996,"15min":0.54400000000000004},"max":{"1min":1.101,"5min":1.335,"15min":1.3939999999999999},"last":0.745}]}]},{"osd":1,"up_from":15,"seq":64424509880,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37232,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334608,"statfs":{"total":96636764160,"available":96598638592,"internally_reserved":0,"allocated":2138112,"data_stored":1093245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.5,"15min":0.501},"min":{"1min":0.34899999999999998,"5min":0.30499999999999999,"15min":0.30399999999999999},"max":{"1min":0.57099999999999995,"5min":0.76200000000000001,"15min":0.86499999999999999},"last":0.251},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.46300000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.751,"5min":0.874,"15min":0.876},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52700000000000002,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64400000000000002,"5min":0.80800000000000005,"15min":0.82799999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39900000000000002,"5min":0.38900000000000001,"15min":0.373},"max":{"1min":0.72399999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60099999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.46100000000000002,"5min":0.438,"15min":0.43099999999999999},"max":{"1min":0.71599999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35099999999999998},"max":{"1min":0.62,"5min":0.77700000000000002,"15min":0.86199999999999999},"last":0.42999999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80000000000000004,"15min":0.80100000000000005},"min":{"1min":0.53700000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1040000000000001,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82199999999999995,"15min":0.82599999999999996},"min":{"1min":0.69299999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1180000000000001,"5min":1.2350000000000001,"15min":1.302},"last":0.70999999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.81699999999999995,"15min":0.81000000000000005},"min":{"1min":0.59299999999999997,"5min":0.52900000000000003,"15min":0.499},"max":{"1min":1.153,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81499999999999995,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.51800000000000002,"15min":0.48799999999999999},"max":{"1min":1.171,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.57599999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.83399999999999996,"15min":0.82899999999999996},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.59699999999999998},"max":{"1min":1.083,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.747},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80500000000000005,"15min":0.81799999999999995},"min":{"1min":0.64100000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.034,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.82999999999999996,"15min":0.83899999999999997},"min":{"1min":0.60799999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1040000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.626},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.83499999999999996},"min":{"1min":0.67100000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.131,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.72899999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509882,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37812,"kb_used_data":2668,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334028,"statfs":{"total":96636764160,"available":96598044672,"internally_reserved":0,"allocated":2732032,"data_stored":1683613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.498,"15min":0.48399999999999999},"min":{"1min":0.36699999999999999,"5min":0.29999999999999999,"15min":0.28499999999999998},"max":{"1min":0.79200000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.38300000000000001,"5min":0.32800000000000001,"15min":0.29799999999999999},"max":{"1min":0.79500000000000004,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.52600000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.42899999999999999,"5min":0.378,"15min":0.35899999999999999},"max":{"1min":0.74199999999999999,"5min":0.80900000000000005,"15min":0.87},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38400000000000001,"5min":0.35799999999999998,"15min":0.33900000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.442}]},{"osd":3,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.622,"15min":0.61899999999999999},"min":{"1min":0.504,"5min":0.47599999999999998,"15min":0.441},"max":{"1min":0.77200000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.46999999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.98599999999999999},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.67500000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.018,"5min":1.081,"15min":1.4370000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.63800000000000001,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2789999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.81699999999999995,"15min":0.81899999999999995},"min":{"1min":0.61099999999999999,"5min":0.60799999999999998,"15min":0.56599999999999995},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.88,"5min":0.86399999999999999,"15min":0.84999999999999998},"min":{"1min":0.68500000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1140000000000001,"5min":1.206,"15min":1.351},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.85699999999999998,"15min":0.86199999999999999},"min":{"1min":0.70699999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.121,"5min":1.1739999999999999,"15min":1.385},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.84799999999999998,"15min":0.84299999999999997},"min":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.60299999999999998},"max":{"1min":1.091,"5min":1.165,"15min":1.347},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.82899999999999996,"15min":0.83399999999999996},"min":{"1min":0.624,"5min":0.624,"15min":0.54100000000000004},"max":{"1min":1.0980000000000001,"5min":1.1100000000000001,"15min":1.3180000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.86599999999999999,"15min":0.878},"min":{"1min":0.66200000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.411},"last":0.622}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:55:44.961 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:55:45.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.102+0000 7fba2e303640 1 Processor -- start 2023-07-21T22:55:45.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.102+0000 7fba2e303640 1 -- start start 2023-07-21T22:55:45.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.102+0000 7fba2e303640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba2815b7c0 0x7fba2806b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:45.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.102+0000 7fba2e303640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba280cb780 0x7fba2806b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:45.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.102+0000 7fba2e303640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2806f900 con 0x7fba2806fd90 2023-07-21T22:55:45.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.102+0000 7fba2e303640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba280cdce0 con 0x7fba2815b7c0 2023-07-21T22:55:45.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.102+0000 7fba2e303640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba280ca830 con 0x7fba280cb780 2023-07-21T22:55:45.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.106+0000 7fba27fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba2815b7c0 0x7fba2806b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:45.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.106+0000 7fba2c8a0640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fba2806fd90 0x7fba28070180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56124/0 (socket says 172.21.15.6:56124) 2023-07-21T22:55:45.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.106+0000 7fba2c8a0640 1 -- 172.21.15.6:0/1334076029 learned_addr learned my addr 172.21.15.6:0/1334076029 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:45.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.106+0000 7fba277fe640 1 --2- 172.21.15.6:0/1334076029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba280cb780 0x7fba2806b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:45.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.106+0000 7fba27fff640 1 -- 172.21.15.6:0/1334076029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba280cb780 msgr2=0x7fba2806b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:45.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.106+0000 7fba27fff640 1 --2- 172.21.15.6:0/1334076029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba280cb780 0x7fba2806b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.106+0000 7fba27fff640 1 -- 172.21.15.6:0/1334076029 >> v1:172.21.15.6:6789/0 conn(0x7fba2806fd90 legacy=0x7fba28070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:45.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.106+0000 7fba27fff640 1 -- 172.21.15.6:0/1334076029 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2815bb90 con 0x7fba2815b7c0 2023-07-21T22:55:45.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.106+0000 7fba26ffd640 1 -- 172.21.15.6:0/1334076029 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556779098 0 0) 0x7fba2806f900 con 0x7fba2806fd90 2023-07-21T22:55:45.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.106+0000 7fba27fff640 1 --2- 172.21.15.6:0/1334076029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba2815b7c0 0x7fba2806b1e0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fba180097c0 tx=0x7fba1801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73fd85acc2b1ea3b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:45.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.106+0000 7fba26ffd640 1 -- 172.21.15.6:0/1334076029 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba180ac630 con 0x7fba2815b7c0 2023-07-21T22:55:45.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.106+0000 7fba26ffd640 1 -- 172.21.15.6:0/1334076029 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba180ac790 con 0x7fba2815b7c0 2023-07-21T22:55:45.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.106+0000 7fba26ffd640 1 -- 172.21.15.6:0/1334076029 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba180acb20 con 0x7fba2815b7c0 2023-07-21T22:55:45.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba2e303640 1 -- 172.21.15.6:0/1334076029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba2815b7c0 msgr2=0x7fba2806b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:45.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba2e303640 1 --2- 172.21.15.6:0/1334076029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba2815b7c0 0x7fba2806b1e0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fba180097c0 tx=0x7fba1801c450 comp rx=0 tx=0).stop 2023-07-21T22:55:45.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba2e303640 1 -- 172.21.15.6:0/1334076029 shutdown_connections 2023-07-21T22:55:45.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba2e303640 1 --2- 172.21.15.6:0/1334076029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba280cb780 0x7fba2806b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba2e303640 1 --2- 172.21.15.6:0/1334076029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba2815b7c0 0x7fba2806b1e0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba2e303640 1 -- 172.21.15.6:0/1334076029 >> 172.21.15.6:0/1334076029 conn(0x7fba280afcf0 msgr2=0x7fba280b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:45.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba2e303640 1 -- 172.21.15.6:0/1334076029 shutdown_connections 2023-07-21T22:55:45.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba2e303640 1 -- 172.21.15.6:0/1334076029 wait complete. 2023-07-21T22:55:45.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba2e303640 1 Processor -- start 2023-07-21T22:55:45.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba2e303640 1 -- start start 2023-07-21T22:55:45.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba2e303640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba2806fd90 0x7fba280b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:45.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba2e303640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba2815b7c0 0x7fba280c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:45.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba2e303640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba28140960 0x7fba280aed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:45.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba2e303640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2814e830 con 0x7fba28140960 2023-07-21T22:55:45.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba2e303640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba281559d0 con 0x7fba2815b7c0 2023-07-21T22:55:45.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba2e303640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba280b3810 con 0x7fba2806fd90 2023-07-21T22:55:45.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba2c8a0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba28140960 0x7fba280aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:45.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba2c8a0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba28140960 0x7fba280aed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53764/0 (socket says 172.21.15.6:53764) 2023-07-21T22:55:45.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba2c8a0640 1 -- 172.21.15.6:0/4181556294 learned_addr learned my addr 172.21.15.6:0/4181556294 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:45.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba27fff640 1 --2- 172.21.15.6:0/4181556294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba2806fd90 0x7fba280b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:45.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.110+0000 7fba277fe640 1 --2- 172.21.15.6:0/4181556294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba2815b7c0 0x7fba280c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:45.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.114+0000 7fba2c8a0640 1 -- 172.21.15.6:0/4181556294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba2806fd90 msgr2=0x7fba280b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:45.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.114+0000 7fba2c8a0640 1 --2- 172.21.15.6:0/4181556294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba2806fd90 0x7fba280b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.114+0000 7fba2c8a0640 1 -- 172.21.15.6:0/4181556294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba2815b7c0 msgr2=0x7fba280c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:45.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.114+0000 7fba2c8a0640 1 --2- 172.21.15.6:0/4181556294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba2815b7c0 0x7fba280c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.114+0000 7fba2c8a0640 1 -- 172.21.15.6:0/4181556294 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba18009420 con 0x7fba28140960 2023-07-21T22:55:45.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.114+0000 7fba2c8a0640 1 --2- 172.21.15.6:0/4181556294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba28140960 0x7fba280aed00 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fba20001570 tx=0x7fba2000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:45.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.114+0000 7fba24ff9640 1 -- 172.21.15.6:0/4181556294 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2000a5e0 con 0x7fba28140960 2023-07-21T22:55:45.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.114+0000 7fba24ff9640 1 -- 172.21.15.6:0/4181556294 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2000a760 con 0x7fba28140960 2023-07-21T22:55:45.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.114+0000 7fba24ff9640 1 -- 172.21.15.6:0/4181556294 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2000ab10 con 0x7fba28140960 2023-07-21T22:55:45.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.114+0000 7fba2e303640 1 -- 172.21.15.6:0/4181556294 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba280b3af0 con 0x7fba28140960 2023-07-21T22:55:45.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.114+0000 7fba2e303640 1 -- 172.21.15.6:0/4181556294 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba28155c20 con 0x7fba28140960 2023-07-21T22:55:45.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.114+0000 7fba2e303640 1 -- 172.21.15.6:0/4181556294 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba28155e40 con 0x7fba28140960 2023-07-21T22:55:45.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.114+0000 7fba24ff9640 1 -- 172.21.15.6:0/4181556294 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fba2000ac70 con 0x7fba28140960 2023-07-21T22:55:45.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.114+0000 7fba24ff9640 1 --2- 172.21.15.6:0/4181556294 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fba140663a0 0x7fba14068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:45.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.114+0000 7fba24ff9640 1 -- 172.21.15.6:0/4181556294 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fba20083380 con 0x7fba28140960 2023-07-21T22:55:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.118+0000 7fba27fff640 1 --2- 172.21.15.6:0/4181556294 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fba140663a0 0x7fba14068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.118+0000 7fba27fff640 1 --2- 172.21.15.6:0/4181556294 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fba140663a0 0x7fba14068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fba180ae000 tx=0x7fba180a7000 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:45.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.118+0000 7fba24ff9640 1 -- 172.21.15.6:0/4181556294 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fba200506b0 con 0x7fba28140960 2023-07-21T22:55:45.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.274+0000 7fba2e303640 1 -- 172.21.15.6:0/4181556294 --> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba2806f590 con 0x7fba140663a0 2023-07-21T22:55:45.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.282+0000 7fba24ff9640 1 -- 172.21.15.6:0/4181556294 <== mgr.9289 v2:172.21.15.161:6832/2346358146 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306469 (secure 0 0 0) 0x7fba180ac900 con 0x7fba140663a0 2023-07-21T22:55:45.318 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:45.320 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:55:45.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.286+0000 7fba2e303640 1 -- 172.21.15.6:0/4181556294 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fba140663a0 msgr2=0x7fba14068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:45.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.286+0000 7fba2e303640 1 --2- 172.21.15.6:0/4181556294 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fba140663a0 0x7fba14068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fba180ae000 tx=0x7fba180a7000 comp rx=0 tx=0).stop 2023-07-21T22:55:45.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.286+0000 7fba2e303640 1 -- 172.21.15.6:0/4181556294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba28140960 msgr2=0x7fba280aed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:45.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.286+0000 7fba2e303640 1 --2- 172.21.15.6:0/4181556294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba28140960 0x7fba280aed00 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fba20001570 tx=0x7fba2000cca0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.286+0000 7fba2e303640 1 -- 172.21.15.6:0/4181556294 shutdown_connections 2023-07-21T22:55:45.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.286+0000 7fba2e303640 1 --2- 172.21.15.6:0/4181556294 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fba140663a0 0x7fba14068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.286+0000 7fba2e303640 1 --2- 172.21.15.6:0/4181556294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba28140960 0x7fba280aed00 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.286+0000 7fba2e303640 1 --2- 172.21.15.6:0/4181556294 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba2815b7c0 0x7fba280c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.286+0000 7fba2e303640 1 --2- 172.21.15.6:0/4181556294 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba2806fd90 0x7fba280b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.286+0000 7fba2e303640 1 -- 172.21.15.6:0/4181556294 >> 172.21.15.6:0/4181556294 conn(0x7fba280afcf0 msgr2=0x7fba280c8790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:45.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.286+0000 7fba2e303640 1 -- 172.21.15.6:0/4181556294 shutdown_connections 2023-07-21T22:55:45.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.286+0000 7fba2e303640 1 -- 172.21.15.6:0/4181556294 wait complete. 2023-07-21T22:55:45.338 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-21T22:55:44.145145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":357232,"kb_used_data":17840,"kb_used_omap":0,"kb_used_meta":339328,"kb_avail":754617488,"statfs":{"total":773094113280,"available":772728307712,"internally_reserved":0,"allocated":18268160,"data_stored":9913296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":347471872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.762405"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.399624+0000","last_change":"2023-07-21T22:55:39.399624+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.399624+0000","last_undegraded":"2023-07-21T22:55:39.399624+0000","last_fullsized":"2023-07-21T22:55:39.399624+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.393154+0000","last_change":"2023-07-21T22:55:39.393154+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.393154+0000","last_undegraded":"2023-07-21T22:55:39.393154+0000","last_fullsized":"2023-07-21T22:55:39.393154+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.395530+0000","last_change":"2023-07-21T22:55:39.395530+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.395530+0000","last_undegraded":"2023-07-21T22:55:39.395530+0000","last_fullsized":"2023-07-21T22:55:39.395530+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.404333+0000","last_change":"2023-07-21T22:55:39.404333+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.404333+0000","last_undegraded":"2023-07-21T22:55:39.404333+0000","last_fullsized":"2023-07-21T22:55:39.404333+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.392099+0000","last_change":"2023-07-21T22:55:39.392099+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.392099+0000","last_undegraded":"2023-07-21T22:55:39.392099+0000","last_fullsized":"2023-07-21T22:55:39.392099+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390841+0000","last_change":"2023-07-21T22:55:39.390841+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390841+0000","last_undegraded":"2023-07-21T22:55:39.390841+0000","last_fullsized":"2023-07-21T22:55:39.390841+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.398437+0000","last_change":"2023-07-21T22:55:39.398437+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.398437+0000","last_undegraded":"2023-07-21T22:55:39.398437+0000","last_fullsized":"2023-07-21T22:55:39.398437+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.406996+0000","last_change":"2023-07-21T22:55:39.406996+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.406996+0000","last_undegraded":"2023-07-21T22:55:39.406996+0000","last_fullsized":"2023-07-21T22:55:39.406996+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.391293+0000","last_change":"2023-07-21T22:55:39.391293+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.391293+0000","last_undegraded":"2023-07-21T22:55:39.391293+0000","last_fullsized":"2023-07-21T22:55:39.391293+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389753+0000","last_change":"2023-07-21T22:55:39.389753+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389753+0000","last_undegraded":"2023-07-21T22:55:39.389753+0000","last_fullsized":"2023-07-21T22:55:39.389753+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.392664+0000","last_change":"2023-07-21T22:55:39.392664+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.392664+0000","last_undegraded":"2023-07-21T22:55:39.392664+0000","last_fullsized":"2023-07-21T22:55:39.392664+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.403881+0000","last_change":"2023-07-21T22:55:39.403881+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.403881+0000","last_undegraded":"2023-07-21T22:55:39.403881+0000","last_fullsized":"2023-07-21T22:55:39.403881+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.391610+0000","last_change":"2023-07-21T22:55:39.391610+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.391610+0000","last_undegraded":"2023-07-21T22:55:39.391610+0000","last_fullsized":"2023-07-21T22:55:39.391610+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.405647+0000","last_change":"2023-07-21T22:55:39.405647+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.405647+0000","last_undegraded":"2023-07-21T22:55:39.405647+0000","last_fullsized":"2023-07-21T22:55:39.405647+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.396468+0000","last_change":"2023-07-21T22:55:39.396468+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.396468+0000","last_undegraded":"2023-07-21T22:55:39.396468+0000","last_fullsized":"2023-07-21T22:55:39.396468+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389748+0000","last_change":"2023-07-21T22:55:39.389748+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389748+0000","last_undegraded":"2023-07-21T22:55:39.389748+0000","last_fullsized":"2023-07-21T22:55:39.389748+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.405747+0000","last_change":"2023-07-21T22:55:39.405747+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.405747+0000","last_undegraded":"2023-07-21T22:55:39.405747+0000","last_fullsized":"2023-07-21T22:55:39.405747+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390592+0000","last_change":"2023-07-21T22:55:39.390592+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390592+0000","last_undegraded":"2023-07-21T22:55:39.390592+0000","last_fullsized":"2023-07-21T22:55:39.390592+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400596+0000","last_change":"2023-07-21T22:55:39.400596+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400596+0000","last_undegraded":"2023-07-21T22:55:39.400596+0000","last_fullsized":"2023-07-21T22:55:39.400596+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.393035+0000","last_change":"2023-07-21T22:55:39.393035+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.393035+0000","last_undegraded":"2023-07-21T22:55:39.393035+0000","last_fullsized":"2023-07-21T22:55:39.393035+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389757+0000","last_change":"2023-07-21T22:55:39.389757+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389757+0000","last_undegraded":"2023-07-21T22:55:39.389757+0000","last_fullsized":"2023-07-21T22:55:39.389757+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.399359+0000","last_change":"2023-07-21T22:55:39.399359+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.399359+0000","last_undegraded":"2023-07-21T22:55:39.399359+0000","last_fullsized":"2023-07-21T22:55:39.399359+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.409241+0000","last_change":"2023-07-21T22:55:39.409241+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.409241+0000","last_undegraded":"2023-07-21T22:55:39.409241+0000","last_fullsized":"2023-07-21T22:55:39.409241+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390489+0000","last_change":"2023-07-21T22:55:39.390489+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390489+0000","last_undegraded":"2023-07-21T22:55:39.390489+0000","last_fullsized":"2023-07-21T22:55:39.390489+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.398600+0000","last_change":"2023-07-21T22:55:39.398600+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.398600+0000","last_undegraded":"2023-07-21T22:55:39.398600+0000","last_fullsized":"2023-07-21T22:55:39.398600+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400546+0000","last_change":"2023-07-21T22:55:39.400546+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400546+0000","last_undegraded":"2023-07-21T22:55:39.400546+0000","last_fullsized":"2023-07-21T22:55:39.400546+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389737+0000","last_change":"2023-07-21T22:55:39.389737+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389737+0000","last_undegraded":"2023-07-21T22:55:39.389737+0000","last_fullsized":"2023-07-21T22:55:39.389737+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389926+0000","last_change":"2023-07-21T22:55:39.389926+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389926+0000","last_undegraded":"2023-07-21T22:55:39.389926+0000","last_fullsized":"2023-07-21T22:55:39.389926+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.410559+0000","last_change":"2023-07-21T22:55:39.410559+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.410559+0000","last_undegraded":"2023-07-21T22:55:39.410559+0000","last_fullsized":"2023-07-21T22:55:39.410559+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.391617+0000","last_change":"2023-07-21T22:55:39.391617+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.391617+0000","last_undegraded":"2023-07-21T22:55:39.391617+0000","last_fullsized":"2023-07-21T22:55:39.391617+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390428+0000","last_change":"2023-07-21T22:55:39.390428+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390428+0000","last_undegraded":"2023-07-21T22:55:39.390428+0000","last_fullsized":"2023-07-21T22:55:39.390428+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.406454+0000","last_change":"2023-07-21T22:55:39.406454+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.406454+0000","last_undegraded":"2023-07-21T22:55:39.406454+0000","last_fullsized":"2023-07-21T22:55:39.406454+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.394271+0000","last_change":"2023-07-21T22:55:39.394271+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.394271+0000","last_undegraded":"2023-07-21T22:55:39.394271+0000","last_fullsized":"2023-07-21T22:55:39.394271+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.402955+0000","last_change":"2023-07-21T22:55:39.401202+0000","last_active":"2023-07-21T22:55:39.402955+0000","last_peered":"2023-07-21T22:55:39.402955+0000","last_clean":"2023-07-21T22:55:39.402955+0000","last_became_active":"2023-07-21T22:55:39.400656+0000","last_became_peered":"2023-07-21T22:55:39.400656+0000","last_unstale":"2023-07-21T22:55:39.402955+0000","last_undegraded":"2023-07-21T22:55:39.402955+0000","last_fullsized":"2023-07-21T22:55:39.402955+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:04.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.395074+0000","last_change":"2023-07-21T22:55:39.395074+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.395074+0000","last_undegraded":"2023-07-21T22:55:39.395074+0000","last_fullsized":"2023-07-21T22:55:39.395074+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.416584+0000","last_change":"2023-07-21T22:55:39.415451+0000","last_active":"2023-07-21T22:55:39.416584+0000","last_peered":"2023-07-21T22:55:39.416584+0000","last_clean":"2023-07-21T22:55:39.416584+0000","last_became_active":"2023-07-21T22:55:39.415164+0000","last_became_peered":"2023-07-21T22:55:39.415164+0000","last_unstale":"2023-07-21T22:55:39.416584+0000","last_undegraded":"2023-07-21T22:55:39.416584+0000","last_fullsized":"2023-07-21T22:55:39.416584+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:03:06.312844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.404288+0000","last_change":"2023-07-21T22:55:39.404288+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.404288+0000","last_undegraded":"2023-07-21T22:55:39.404288+0000","last_fullsized":"2023-07-21T22:55:39.404288+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.416031+0000","last_change":"2023-07-21T22:55:39.414669+0000","last_active":"2023-07-21T22:55:39.416031+0000","last_peered":"2023-07-21T22:55:39.416031+0000","last_clean":"2023-07-21T22:55:39.416031+0000","last_became_active":"2023-07-21T22:55:39.414403+0000","last_became_peered":"2023-07-21T22:55:39.414403+0000","last_unstale":"2023-07-21T22:55:39.416031+0000","last_undegraded":"2023-07-21T22:55:39.416031+0000","last_fullsized":"2023-07-21T22:55:39.416031+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:27:09.502436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.401846+0000","last_change":"2023-07-21T22:55:39.401846+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.401846+0000","last_undegraded":"2023-07-21T22:55:39.401846+0000","last_fullsized":"2023-07-21T22:55:39.401846+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.414112+0000","last_change":"2023-07-21T22:55:39.413053+0000","last_active":"2023-07-21T22:55:39.414112+0000","last_peered":"2023-07-21T22:55:39.414112+0000","last_clean":"2023-07-21T22:55:39.414112+0000","last_became_active":"2023-07-21T22:55:39.412694+0000","last_became_peered":"2023-07-21T22:55:39.412694+0000","last_unstale":"2023-07-21T22:55:39.414112+0000","last_undegraded":"2023-07-21T22:55:39.414112+0000","last_fullsized":"2023-07-21T22:55:39.414112+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:21:56.166474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.392092+0000","last_change":"2023-07-21T22:55:39.392092+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.392092+0000","last_undegraded":"2023-07-21T22:55:39.392092+0000","last_fullsized":"2023-07-21T22:55:39.392092+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.421505+0000","last_change":"2023-07-21T22:55:39.418236+0000","last_active":"2023-07-21T22:55:39.421505+0000","last_peered":"2023-07-21T22:55:39.421505+0000","last_clean":"2023-07-21T22:55:39.421505+0000","last_became_active":"2023-07-21T22:55:39.417975+0000","last_became_peered":"2023-07-21T22:55:39.417975+0000","last_unstale":"2023-07-21T22:55:39.421505+0000","last_undegraded":"2023-07-21T22:55:39.421505+0000","last_fullsized":"2023-07-21T22:55:39.421505+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:14:45.372222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.402061+0000","last_change":"2023-07-21T22:55:39.402061+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.402061+0000","last_undegraded":"2023-07-21T22:55:39.402061+0000","last_fullsized":"2023-07-21T22:55:39.402061+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.408618+0000","last_change":"2023-07-21T22:55:39.407508+0000","last_active":"2023-07-21T22:55:39.408618+0000","last_peered":"2023-07-21T22:55:39.408618+0000","last_clean":"2023-07-21T22:55:39.408618+0000","last_became_active":"2023-07-21T22:55:39.407178+0000","last_became_peered":"2023-07-21T22:55:39.407178+0000","last_unstale":"2023-07-21T22:55:39.408618+0000","last_undegraded":"2023-07-21T22:55:39.408618+0000","last_fullsized":"2023-07-21T22:55:39.408618+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:57.640218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.393735+0000","last_change":"2023-07-21T22:55:39.393735+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.393735+0000","last_undegraded":"2023-07-21T22:55:39.393735+0000","last_fullsized":"2023-07-21T22:55:39.393735+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.414400+0000","last_change":"2023-07-21T22:55:39.411817+0000","last_active":"2023-07-21T22:55:39.414400+0000","last_peered":"2023-07-21T22:55:39.414400+0000","last_clean":"2023-07-21T22:55:39.414400+0000","last_became_active":"2023-07-21T22:55:39.411096+0000","last_became_peered":"2023-07-21T22:55:39.411096+0000","last_unstale":"2023-07-21T22:55:39.414400+0000","last_undegraded":"2023-07-21T22:55:39.414400+0000","last_fullsized":"2023-07-21T22:55:39.414400+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:37:11.626613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.398075+0000","last_change":"2023-07-21T22:55:39.398075+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.398075+0000","last_undegraded":"2023-07-21T22:55:39.398075+0000","last_fullsized":"2023-07-21T22:55:39.398075+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.401777+0000","last_change":"2023-07-21T22:55:39.398085+0000","last_active":"2023-07-21T22:55:39.401777+0000","last_peered":"2023-07-21T22:55:39.401777+0000","last_clean":"2023-07-21T22:55:39.401777+0000","last_became_active":"2023-07-21T22:55:39.397730+0000","last_became_peered":"2023-07-21T22:55:39.397730+0000","last_unstale":"2023-07-21T22:55:39.401777+0000","last_undegraded":"2023-07-21T22:55:39.401777+0000","last_fullsized":"2023-07-21T22:55:39.401777+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:58:28.209192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400927+0000","last_change":"2023-07-21T22:55:39.400927+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400927+0000","last_undegraded":"2023-07-21T22:55:39.400927+0000","last_fullsized":"2023-07-21T22:55:39.400927+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.404167+0000","last_change":"2023-07-21T22:55:39.401715+0000","last_active":"2023-07-21T22:55:39.404167+0000","last_peered":"2023-07-21T22:55:39.404167+0000","last_clean":"2023-07-21T22:55:39.404167+0000","last_became_active":"2023-07-21T22:55:39.401360+0000","last_became_peered":"2023-07-21T22:55:39.401360+0000","last_unstale":"2023-07-21T22:55:39.404167+0000","last_undegraded":"2023-07-21T22:55:39.404167+0000","last_fullsized":"2023-07-21T22:55:39.404167+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:54:37.310776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.402158+0000","last_change":"2023-07-21T22:55:39.402158+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.402158+0000","last_undegraded":"2023-07-21T22:55:39.402158+0000","last_fullsized":"2023-07-21T22:55:39.402158+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.413599+0000","last_change":"2023-07-21T22:55:39.410646+0000","last_active":"2023-07-21T22:55:39.413599+0000","last_peered":"2023-07-21T22:55:39.413599+0000","last_clean":"2023-07-21T22:55:39.413599+0000","last_became_active":"2023-07-21T22:55:39.410319+0000","last_became_peered":"2023-07-21T22:55:39.410319+0000","last_unstale":"2023-07-21T22:55:39.413599+0000","last_undegraded":"2023-07-21T22:55:39.413599+0000","last_fullsized":"2023-07-21T22:55:39.413599+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:37:16.993672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400095+0000","last_change":"2023-07-21T22:55:39.400095+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400095+0000","last_undegraded":"2023-07-21T22:55:39.400095+0000","last_fullsized":"2023-07-21T22:55:39.400095+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.411672+0000","last_change":"2023-07-21T22:55:39.409616+0000","last_active":"2023-07-21T22:55:39.411672+0000","last_peered":"2023-07-21T22:55:39.411672+0000","last_clean":"2023-07-21T22:55:39.411672+0000","last_became_active":"2023-07-21T22:55:39.409314+0000","last_became_peered":"2023-07-21T22:55:39.409314+0000","last_unstale":"2023-07-21T22:55:39.411672+0000","last_undegraded":"2023-07-21T22:55:39.411672+0000","last_fullsized":"2023-07-21T22:55:39.411672+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:21:46.525218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.397798+0000","last_change":"2023-07-21T22:55:39.397798+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.397798+0000","last_undegraded":"2023-07-21T22:55:39.397798+0000","last_fullsized":"2023-07-21T22:55:39.397798+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.424162+0000","last_change":"2023-07-21T22:55:39.421460+0000","last_active":"2023-07-21T22:55:39.424162+0000","last_peered":"2023-07-21T22:55:39.424162+0000","last_clean":"2023-07-21T22:55:39.424162+0000","last_became_active":"2023-07-21T22:55:39.421077+0000","last_became_peered":"2023-07-21T22:55:39.421077+0000","last_unstale":"2023-07-21T22:55:39.424162+0000","last_undegraded":"2023-07-21T22:55:39.424162+0000","last_fullsized":"2023-07-21T22:55:39.424162+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:46:13.990885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400048+0000","last_change":"2023-07-21T22:55:39.400048+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400048+0000","last_undegraded":"2023-07-21T22:55:39.400048+0000","last_fullsized":"2023-07-21T22:55:39.400048+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.413967+0000","last_change":"2023-07-21T22:55:39.413026+0000","last_active":"2023-07-21T22:55:39.413967+0000","last_peered":"2023-07-21T22:55:39.413967+0000","last_clean":"2023-07-21T22:55:39.413967+0000","last_became_active":"2023-07-21T22:55:39.412686+0000","last_became_peered":"2023-07-21T22:55:39.412686+0000","last_unstale":"2023-07-21T22:55:39.413967+0000","last_undegraded":"2023-07-21T22:55:39.413967+0000","last_fullsized":"2023-07-21T22:55:39.413967+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:38:37.952444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.395632+0000","last_change":"2023-07-21T22:55:39.395632+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.395632+0000","last_undegraded":"2023-07-21T22:55:39.395632+0000","last_fullsized":"2023-07-21T22:55:39.395632+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.420502+0000","last_change":"2023-07-21T22:55:39.415018+0000","last_active":"2023-07-21T22:55:39.420502+0000","last_peered":"2023-07-21T22:55:39.420502+0000","last_clean":"2023-07-21T22:55:39.420502+0000","last_became_active":"2023-07-21T22:55:39.414713+0000","last_became_peered":"2023-07-21T22:55:39.414713+0000","last_unstale":"2023-07-21T22:55:39.420502+0000","last_undegraded":"2023-07-21T22:55:39.420502+0000","last_fullsized":"2023-07-21T22:55:39.420502+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:41:31.314913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400785+0000","last_change":"2023-07-21T22:55:39.400785+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400785+0000","last_undegraded":"2023-07-21T22:55:39.400785+0000","last_fullsized":"2023-07-21T22:55:39.400785+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.413948+0000","last_change":"2023-07-21T22:55:39.412811+0000","last_active":"2023-07-21T22:55:39.413948+0000","last_peered":"2023-07-21T22:55:39.413948+0000","last_clean":"2023-07-21T22:55:39.413948+0000","last_became_active":"2023-07-21T22:55:39.412344+0000","last_became_peered":"2023-07-21T22:55:39.412344+0000","last_unstale":"2023-07-21T22:55:39.413948+0000","last_undegraded":"2023-07-21T22:55:39.413948+0000","last_fullsized":"2023-07-21T22:55:39.413948+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:13:16.596486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.394645+0000","last_change":"2023-07-21T22:55:39.394645+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.394645+0000","last_undegraded":"2023-07-21T22:55:39.394645+0000","last_fullsized":"2023-07-21T22:55:39.394645+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.420587+0000","last_change":"2023-07-21T22:55:39.416526+0000","last_active":"2023-07-21T22:55:39.420587+0000","last_peered":"2023-07-21T22:55:39.420587+0000","last_clean":"2023-07-21T22:55:39.420587+0000","last_became_active":"2023-07-21T22:55:39.416238+0000","last_became_peered":"2023-07-21T22:55:39.416238+0000","last_unstale":"2023-07-21T22:55:39.420587+0000","last_undegraded":"2023-07-21T22:55:39.420587+0000","last_fullsized":"2023-07-21T22:55:39.420587+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:33:27.404274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389979+0000","last_change":"2023-07-21T22:55:39.389979+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389979+0000","last_undegraded":"2023-07-21T22:55:39.389979+0000","last_fullsized":"2023-07-21T22:55:39.389979+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.424174+0000","last_change":"2023-07-21T22:55:39.421412+0000","last_active":"2023-07-21T22:55:39.424174+0000","last_peered":"2023-07-21T22:55:39.424174+0000","last_clean":"2023-07-21T22:55:39.424174+0000","last_became_active":"2023-07-21T22:55:39.421070+0000","last_became_peered":"2023-07-21T22:55:39.421070+0000","last_unstale":"2023-07-21T22:55:39.424174+0000","last_undegraded":"2023-07-21T22:55:39.424174+0000","last_fullsized":"2023-07-21T22:55:39.424174+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:10:42.306495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.403699+0000","last_change":"2023-07-21T22:55:39.403699+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.403699+0000","last_undegraded":"2023-07-21T22:55:39.403699+0000","last_fullsized":"2023-07-21T22:55:39.403699+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.414106+0000","last_change":"2023-07-21T22:55:39.410781+0000","last_active":"2023-07-21T22:55:39.414106+0000","last_peered":"2023-07-21T22:55:39.414106+0000","last_clean":"2023-07-21T22:55:39.414106+0000","last_became_active":"2023-07-21T22:55:39.410464+0000","last_became_peered":"2023-07-21T22:55:39.410464+0000","last_unstale":"2023-07-21T22:55:39.414106+0000","last_undegraded":"2023-07-21T22:55:39.414106+0000","last_fullsized":"2023-07-21T22:55:39.414106+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:38.264202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.398664+0000","last_change":"2023-07-21T22:55:39.398664+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.398664+0000","last_undegraded":"2023-07-21T22:55:39.398664+0000","last_fullsized":"2023-07-21T22:55:39.398664+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.415219+0000","last_change":"2023-07-21T22:55:39.414668+0000","last_active":"2023-07-21T22:55:39.415219+0000","last_peered":"2023-07-21T22:55:39.415219+0000","last_clean":"2023-07-21T22:55:39.415219+0000","last_became_active":"2023-07-21T22:55:39.414446+0000","last_became_peered":"2023-07-21T22:55:39.414446+0000","last_unstale":"2023-07-21T22:55:39.415219+0000","last_undegraded":"2023-07-21T22:55:39.415219+0000","last_fullsized":"2023-07-21T22:55:39.415219+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:43:53.073313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390838+0000","last_change":"2023-07-21T22:55:39.390838+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390838+0000","last_undegraded":"2023-07-21T22:55:39.390838+0000","last_fullsized":"2023-07-21T22:55:39.390838+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.411654+0000","last_change":"2023-07-21T22:55:39.410389+0000","last_active":"2023-07-21T22:55:39.411654+0000","last_peered":"2023-07-21T22:55:39.411654+0000","last_clean":"2023-07-21T22:55:39.411654+0000","last_became_active":"2023-07-21T22:55:39.410069+0000","last_became_peered":"2023-07-21T22:55:39.410069+0000","last_unstale":"2023-07-21T22:55:39.411654+0000","last_undegraded":"2023-07-21T22:55:39.411654+0000","last_fullsized":"2023-07-21T22:55:39.411654+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:57:24.219727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.405357+0000","last_change":"2023-07-21T22:55:39.405357+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.405357+0000","last_undegraded":"2023-07-21T22:55:39.405357+0000","last_fullsized":"2023-07-21T22:55:39.405357+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.414038+0000","last_change":"2023-07-21T22:55:39.409683+0000","last_active":"2023-07-21T22:55:39.414038+0000","last_peered":"2023-07-21T22:55:39.414038+0000","last_clean":"2023-07-21T22:55:39.414038+0000","last_became_active":"2023-07-21T22:55:39.409275+0000","last_became_peered":"2023-07-21T22:55:39.409275+0000","last_unstale":"2023-07-21T22:55:39.414038+0000","last_undegraded":"2023-07-21T22:55:39.414038+0000","last_fullsized":"2023-07-21T22:55:39.414038+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:22:24.546522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.401528+0000","last_change":"2023-07-21T22:55:39.401528+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.401528+0000","last_undegraded":"2023-07-21T22:55:39.401528+0000","last_fullsized":"2023-07-21T22:55:39.401528+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.409681+0000","last_change":"2023-07-21T22:55:39.408656+0000","last_active":"2023-07-21T22:55:39.409681+0000","last_peered":"2023-07-21T22:55:39.409681+0000","last_clean":"2023-07-21T22:55:39.409681+0000","last_became_active":"2023-07-21T22:55:39.408375+0000","last_became_peered":"2023-07-21T22:55:39.408375+0000","last_unstale":"2023-07-21T22:55:39.409681+0000","last_undegraded":"2023-07-21T22:55:39.409681+0000","last_fullsized":"2023-07-21T22:55:39.409681+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:37:46.249905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.393131+0000","last_change":"2023-07-21T22:55:39.393131+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.393131+0000","last_undegraded":"2023-07-21T22:55:39.393131+0000","last_fullsized":"2023-07-21T22:55:39.393131+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.408131+0000","last_change":"2023-07-21T22:55:39.405548+0000","last_active":"2023-07-21T22:55:39.408131+0000","last_peered":"2023-07-21T22:55:39.408131+0000","last_clean":"2023-07-21T22:55:39.408131+0000","last_became_active":"2023-07-21T22:55:39.405263+0000","last_became_peered":"2023-07-21T22:55:39.405263+0000","last_unstale":"2023-07-21T22:55:39.408131+0000","last_undegraded":"2023-07-21T22:55:39.408131+0000","last_fullsized":"2023-07-21T22:55:39.408131+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:25.424089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.411717+0000","last_change":"2023-07-21T22:55:39.411717+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.411717+0000","last_undegraded":"2023-07-21T22:55:39.411717+0000","last_fullsized":"2023-07-21T22:55:39.411717+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.413391+0000","last_change":"2023-07-21T22:55:39.410357+0000","last_active":"2023-07-21T22:55:39.413391+0000","last_peered":"2023-07-21T22:55:39.413391+0000","last_clean":"2023-07-21T22:55:39.413391+0000","last_became_active":"2023-07-21T22:55:39.410057+0000","last_became_peered":"2023-07-21T22:55:39.410057+0000","last_unstale":"2023-07-21T22:55:39.413391+0000","last_undegraded":"2023-07-21T22:55:39.413391+0000","last_fullsized":"2023-07-21T22:55:39.413391+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:17.185704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.403054+0000","last_change":"2023-07-21T22:55:39.403054+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.403054+0000","last_undegraded":"2023-07-21T22:55:39.403054+0000","last_fullsized":"2023-07-21T22:55:39.403054+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.408793+0000","last_change":"2023-07-21T22:55:39.408029+0000","last_active":"2023-07-21T22:55:39.408793+0000","last_peered":"2023-07-21T22:55:39.408793+0000","last_clean":"2023-07-21T22:55:39.408793+0000","last_became_active":"2023-07-21T22:55:39.407599+0000","last_became_peered":"2023-07-21T22:55:39.407599+0000","last_unstale":"2023-07-21T22:55:39.408793+0000","last_undegraded":"2023-07-21T22:55:39.408793+0000","last_fullsized":"2023-07-21T22:55:39.408793+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:47:28.521879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"161'304","reported_seq":1102,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.403239+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:55:39.403239+0000","last_peered":"2023-07-21T22:55:39.403239+0000","last_clean":"2023-07-21T22:55:39.403239+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:55:39.403239+0000","last_undegraded":"2023-07-21T22:55:39.403239+0000","last_fullsized":"2023-07-21T22:55:39.403239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:59:21.958943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":318,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.400239+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:55:39.400239+0000","last_peered":"2023-07-21T22:55:39.400239+0000","last_clean":"2023-07-21T22:55:39.400239+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:55:39.400239+0000","last_undegraded":"2023-07-21T22:55:39.400239+0000","last_fullsized":"2023-07-21T22:55:39.400239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:05.686648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.406020+0000","last_change":"2023-07-21T22:55:39.406020+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.406020+0000","last_undegraded":"2023-07-21T22:55:39.406020+0000","last_fullsized":"2023-07-21T22:55:39.406020+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.413420+0000","last_change":"2023-07-21T22:55:39.408771+0000","last_active":"2023-07-21T22:55:39.413420+0000","last_peered":"2023-07-21T22:55:39.413420+0000","last_clean":"2023-07-21T22:55:39.413420+0000","last_became_active":"2023-07-21T22:55:39.408492+0000","last_became_peered":"2023-07-21T22:55:39.408492+0000","last_unstale":"2023-07-21T22:55:39.413420+0000","last_undegraded":"2023-07-21T22:55:39.413420+0000","last_fullsized":"2023-07-21T22:55:39.413420+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:19:33.763010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":283,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.403087+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:55:39.403087+0000","last_peered":"2023-07-21T22:55:39.403087+0000","last_clean":"2023-07-21T22:55:39.403087+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:55:39.403087+0000","last_undegraded":"2023-07-21T22:55:39.403087+0000","last_fullsized":"2023-07-21T22:55:39.403087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:36:16.226544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.391374+0000","last_change":"2023-07-21T22:55:39.391374+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.391374+0000","last_undegraded":"2023-07-21T22:55:39.391374+0000","last_fullsized":"2023-07-21T22:55:39.391374+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.412261+0000","last_change":"2023-07-21T22:55:39.407686+0000","last_active":"2023-07-21T22:55:39.412261+0000","last_peered":"2023-07-21T22:55:39.412261+0000","last_clean":"2023-07-21T22:55:39.412261+0000","last_became_active":"2023-07-21T22:55:39.407414+0000","last_became_peered":"2023-07-21T22:55:39.407414+0000","last_unstale":"2023-07-21T22:55:39.412261+0000","last_undegraded":"2023-07-21T22:55:39.412261+0000","last_fullsized":"2023-07-21T22:55:39.412261+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:34:16.780319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":286,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.395421+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:55:39.395421+0000","last_peered":"2023-07-21T22:55:39.395421+0000","last_clean":"2023-07-21T22:55:39.395421+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:55:39.395421+0000","last_undegraded":"2023-07-21T22:55:39.395421+0000","last_fullsized":"2023-07-21T22:55:39.395421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:54:19.537921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390156+0000","last_change":"2023-07-21T22:55:39.390156+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390156+0000","last_undegraded":"2023-07-21T22:55:39.390156+0000","last_fullsized":"2023-07-21T22:55:39.390156+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.401574+0000","last_change":"2023-07-21T22:55:39.399053+0000","last_active":"2023-07-21T22:55:39.401574+0000","last_peered":"2023-07-21T22:55:39.401574+0000","last_clean":"2023-07-21T22:55:39.401574+0000","last_became_active":"2023-07-21T22:55:39.398779+0000","last_became_peered":"2023-07-21T22:55:39.398779+0000","last_unstale":"2023-07-21T22:55:39.401574+0000","last_undegraded":"2023-07-21T22:55:39.401574+0000","last_fullsized":"2023-07-21T22:55:39.401574+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:02:52.668876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":318,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.399640+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:55:39.399640+0000","last_peered":"2023-07-21T22:55:39.399640+0000","last_clean":"2023-07-21T22:55:39.399640+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:55:39.399640+0000","last_undegraded":"2023-07-21T22:55:39.399640+0000","last_fullsized":"2023-07-21T22:55:39.399640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:43:22.060057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.405829+0000","last_change":"2023-07-21T22:55:39.405829+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.405829+0000","last_undegraded":"2023-07-21T22:55:39.405829+0000","last_fullsized":"2023-07-21T22:55:39.405829+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.402349+0000","last_change":"2023-07-21T22:55:39.398435+0000","last_active":"2023-07-21T22:55:39.402349+0000","last_peered":"2023-07-21T22:55:39.402349+0000","last_clean":"2023-07-21T22:55:39.402349+0000","last_became_active":"2023-07-21T22:55:39.398171+0000","last_became_peered":"2023-07-21T22:55:39.398171+0000","last_unstale":"2023-07-21T22:55:39.402349+0000","last_undegraded":"2023-07-21T22:55:39.402349+0000","last_fullsized":"2023-07-21T22:55:39.402349+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:36.093425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":298,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.394565+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:55:39.394565+0000","last_peered":"2023-07-21T22:55:39.394565+0000","last_clean":"2023-07-21T22:55:39.394565+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:55:39.394565+0000","last_undegraded":"2023-07-21T22:55:39.394565+0000","last_fullsized":"2023-07-21T22:55:39.394565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:54:05.783821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.396061+0000","last_change":"2023-07-21T22:55:39.396061+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.396061+0000","last_undegraded":"2023-07-21T22:55:39.396061+0000","last_fullsized":"2023-07-21T22:55:39.396061+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.424121+0000","last_change":"2023-07-21T22:55:39.421220+0000","last_active":"2023-07-21T22:55:39.424121+0000","last_peered":"2023-07-21T22:55:39.424121+0000","last_clean":"2023-07-21T22:55:39.424121+0000","last_became_active":"2023-07-21T22:55:39.420898+0000","last_became_peered":"2023-07-21T22:55:39.420898+0000","last_unstale":"2023-07-21T22:55:39.424121+0000","last_undegraded":"2023-07-21T22:55:39.424121+0000","last_fullsized":"2023-07-21T22:55:39.424121+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:43:41.626753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":282,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.403123+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:55:39.403123+0000","last_peered":"2023-07-21T22:55:39.403123+0000","last_clean":"2023-07-21T22:55:39.403123+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:55:39.403123+0000","last_undegraded":"2023-07-21T22:55:39.403123+0000","last_fullsized":"2023-07-21T22:55:39.403123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:31:30.358830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390327+0000","last_change":"2023-07-21T22:55:39.390327+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390327+0000","last_undegraded":"2023-07-21T22:55:39.390327+0000","last_fullsized":"2023-07-21T22:55:39.390327+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.412393+0000","last_change":"2023-07-21T22:55:39.407762+0000","last_active":"2023-07-21T22:55:39.412393+0000","last_peered":"2023-07-21T22:55:39.412393+0000","last_clean":"2023-07-21T22:55:39.412393+0000","last_became_active":"2023-07-21T22:55:39.407480+0000","last_became_peered":"2023-07-21T22:55:39.407480+0000","last_unstale":"2023-07-21T22:55:39.412393+0000","last_undegraded":"2023-07-21T22:55:39.412393+0000","last_fullsized":"2023-07-21T22:55:39.412393+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:11:42.677965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":298,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.393672+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:55:39.393672+0000","last_peered":"2023-07-21T22:55:39.393672+0000","last_clean":"2023-07-21T22:55:39.393672+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:55:39.393672+0000","last_undegraded":"2023-07-21T22:55:39.393672+0000","last_fullsized":"2023-07-21T22:55:39.393672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:57:19.939012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.395164+0000","last_change":"2023-07-21T22:55:39.395164+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.395164+0000","last_undegraded":"2023-07-21T22:55:39.395164+0000","last_fullsized":"2023-07-21T22:55:39.395164+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.412302+0000","last_change":"2023-07-21T22:55:39.408717+0000","last_active":"2023-07-21T22:55:39.412302+0000","last_peered":"2023-07-21T22:55:39.412302+0000","last_clean":"2023-07-21T22:55:39.412302+0000","last_became_active":"2023-07-21T22:55:39.408445+0000","last_became_peered":"2023-07-21T22:55:39.408445+0000","last_unstale":"2023-07-21T22:55:39.412302+0000","last_undegraded":"2023-07-21T22:55:39.412302+0000","last_fullsized":"2023-07-21T22:55:39.412302+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:03:08.912070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":280,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.406693+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:55:39.406693+0000","last_peered":"2023-07-21T22:55:39.406693+0000","last_clean":"2023-07-21T22:55:39.406693+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:55:39.406693+0000","last_undegraded":"2023-07-21T22:55:39.406693+0000","last_fullsized":"2023-07-21T22:55:39.406693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:25:05.889779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509880,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59944,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94311896,"statfs":{"total":96636764160,"available":96575381504,"internally_reserved":0,"allocated":2719744,"data_stored":1676913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.34999999999999998},"max":{"1min":0.89300000000000002,"5min":1.032,"15min":1.143},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.54700000000000004,"5min":0.47999999999999998,"15min":0.39000000000000001},"max":{"1min":0.875,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.61899999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.749,"15min":0.76400000000000001},"min":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.40600000000000003},"max":{"1min":0.86199999999999999,"5min":0.96599999999999997,"15min":1.0820000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73899999999999999,"15min":0.746},"min":{"1min":0.51500000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94399999999999995,"5min":0.97299999999999998,"15min":1.02},"last":0.752}]},{"osd":2,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75,"15min":0.76000000000000001},"min":{"1min":0.61099999999999999,"5min":0.54800000000000004,"15min":0.47999999999999998},"max":{"1min":0.89500000000000002,"5min":1.0049999999999999,"15min":1.0780000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.624,"5min":0.51100000000000001,"15min":0.42299999999999999},"max":{"1min":0.93100000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.63700000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77300000000000002,"15min":0.78000000000000003},"min":{"1min":0.61199999999999999,"5min":0.48399999999999999,"15min":0.45600000000000002},"max":{"1min":0.88300000000000001,"5min":1.077,"15min":1.0980000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.64900000000000002,"5min":0.57699999999999996,"15min":0.53400000000000003},"max":{"1min":0.92800000000000005,"5min":1.026,"15min":1.036},"last":0.82499999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.34999999999999998},"max":{"1min":0.68300000000000005,"5min":0.81299999999999994,"15min":0.89700000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.60599999999999998},"min":{"1min":0.439,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":0.83299999999999996,"5min":0.88,"15min":1.0940000000000001},"last":0.80200000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58699999999999997,"15min":0.60599999999999998},"min":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.41199999999999998},"max":{"1min":0.81000000000000005,"5min":0.88300000000000001,"15min":0.99399999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65800000000000003,"15min":0.66600000000000004},"min":{"1min":0.48599999999999999,"5min":0.433,"15min":0.40699999999999997},"max":{"1min":0.84999999999999998,"5min":1.0129999999999999,"15min":1.077},"last":0.89200000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.51900000000000002,"5min":0.47999999999999998,"15min":0.45500000000000002},"max":{"1min":0.81299999999999994,"5min":0.91100000000000003,"15min":0.97399999999999998},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.63300000000000001,"15min":0.63100000000000001},"min":{"1min":0.47999999999999998,"5min":0.41299999999999998,"15min":0.41099999999999998},"max":{"1min":0.86699999999999999,"5min":0.871,"15min":1.105},"last":1.1539999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542586,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37220,"kb_used_data":2076,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334620,"statfs":{"total":96636764160,"available":96598650880,"internally_reserved":0,"allocated":2125824,"data_stored":1086545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0009999999999999,"5min":1.024,"15min":1.024},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80200000000000005,"15min":0.80800000000000005},"min":{"1min":0.63800000000000001,"5min":0.58299999999999996,"15min":0.54000000000000004},"max":{"1min":1,"5min":1,"15min":1.0780000000000001},"last":0.72999999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.51400000000000001,"5min":0.51000000000000001,"15min":0.50900000000000001},"max":{"1min":0.96199999999999997,"5min":0.96599999999999997,"15min":1.006},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.54200000000000004,"5min":0.48899999999999999,"15min":0.42499999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78500000000000003,"15min":0.78300000000000003},"min":{"1min":0.59599999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.92100000000000004,"5min":1.002,"15min":1.0409999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.80900000000000005,"15min":0.80600000000000005},"min":{"1min":0.61299999999999999,"5min":0.498,"15min":0.46600000000000003},"max":{"1min":0.98799999999999999,"5min":1.0089999999999999,"15min":1.0600000000000001},"last":0.61499999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.754,"15min":0.754},"min":{"1min":0.66600000000000004,"5min":0.53000000000000003,"15min":0.48999999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76200000000000001,"15min":0.753},"min":{"1min":0.58799999999999997,"5min":0.53300000000000003,"15min":0.52300000000000002},"max":{"1min":0.93000000000000005,"5min":0.96199999999999997,"15min":1.0389999999999999},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.92300000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.46400000000000002,"5min":0.41899999999999998,"15min":0.33500000000000002},"max":{"1min":0.93600000000000005,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65200000000000002,"15min":0.64700000000000002},"min":{"1min":0.503,"5min":0.44600000000000001,"15min":0.38900000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.96299999999999997},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.66100000000000003},"min":{"1min":0.46300000000000002,"5min":0.45600000000000002,"15min":0.38700000000000001},"max":{"1min":0.81999999999999995,"5min":0.91600000000000004,"15min":1.0129999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48299999999999998,"5min":0.46800000000000003,"15min":0.432},"max":{"1min":0.90000000000000002,"5min":0.96299999999999997,"15min":1.0780000000000001},"last":0.57899999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509879,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55280,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316560,"statfs":{"total":96636764160,"available":96580157440,"internally_reserved":0,"allocated":2138112,"data_stored":1093245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.57599999999999996,"5min":0.39200000000000002,"15min":0.32100000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.73099999999999998},"min":{"1min":0.53300000000000003,"5min":0.432,"15min":0.41499999999999998},"max":{"1min":0.91300000000000003,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.67300000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.74299999999999999,"15min":0.73299999999999998},"min":{"1min":0.60799999999999998,"5min":0.495,"15min":0.42399999999999999},"max":{"1min":0.89000000000000001,"5min":0.999,"15min":1.0289999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.745,"15min":0.73999999999999999},"min":{"1min":0.60599999999999998,"5min":0.45800000000000002,"15min":0.42999999999999999},"max":{"1min":0.97999999999999998,"5min":1.054,"15min":1.054},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.752,"15min":0.752},"min":{"1min":0.64300000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88400000000000001,"5min":1.119,"15min":1.119},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.75700000000000001,"15min":0.748},"min":{"1min":0.57799999999999996,"5min":0.53600000000000003,"15min":0.49299999999999999},"max":{"1min":0.95699999999999996,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.79900000000000004,"15min":0.78500000000000003},"min":{"1min":0.69199999999999995,"5min":0.61499999999999999,"15min":0.47299999999999998},"max":{"1min":1.0009999999999999,"5min":1.169,"15min":1.169},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80000000000000004,"15min":0.80700000000000005},"min":{"1min":0.56399999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0169999999999999,"5min":1.0409999999999999,"15min":1.0429999999999999},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84799999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.47399999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97999999999999998,"5min":1.01,"15min":1.0369999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.59099999999999997},"min":{"1min":0.47999999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91900000000000004,"5min":0.93600000000000005,"15min":1.0629999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63600000000000001,"15min":0.65000000000000002},"min":{"1min":0.45700000000000002,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":0.95899999999999996,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72399999999999998,"15min":0.72099999999999997},"min":{"1min":0.51000000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.84299999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37232,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334608,"statfs":{"total":96636764160,"available":96598638592,"internally_reserved":0,"allocated":2138112,"data_stored":1093245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.73799999999999999,"15min":0.75800000000000001},"min":{"1min":0.64500000000000002,"5min":0.41299999999999998,"15min":0.34599999999999997},"max":{"1min":0.93500000000000005,"5min":0.94199999999999995,"15min":1.0509999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.35299999999999998},"max":{"1min":0.96899999999999997,"5min":1.006,"15min":1.03},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.72299999999999998,"15min":0.72599999999999998},"min":{"1min":0.55800000000000005,"5min":0.502,"15min":0.432},"max":{"1min":1.0229999999999999,"5min":1.089,"15min":1.089},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.54400000000000004,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":0.871,"5min":0.97599999999999998,"15min":1.0129999999999999},"last":0.68600000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79100000000000004,"15min":0.78500000000000003},"min":{"1min":0.625,"5min":0.59899999999999998,"15min":0.46899999999999997},"max":{"1min":0.95099999999999996,"5min":1.292,"15min":1.292},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.65100000000000002,"5min":0.51300000000000001,"15min":0.501},"max":{"1min":0.99099999999999999,"5min":1.038,"15min":1.038},"last":0.752}]},{"osd":3,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.752,"15min":0.747},"min":{"1min":0.68999999999999995,"5min":0.51400000000000001,"15min":0.49299999999999999},"max":{"1min":1.0069999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.70399999999999996,"5min":0.61399999999999999,"15min":0.54200000000000004},"max":{"1min":0.98399999999999999,"5min":1.218,"15min":1.218},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.371},"max":{"1min":0.70399999999999996,"5min":1.028,"15min":1.028},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.59499999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.93300000000000005,"5min":1.151,"15min":1.151},"last":0.91900000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65300000000000002,"15min":0.65500000000000003},"min":{"1min":0.45800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93400000000000005,"5min":1.252,"15min":1.252},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.39100000000000001},"max":{"1min":0.80500000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.88200000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89300000000000002,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68600000000000005,"15min":0.68200000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.42999999999999999},"max":{"1min":0.83999999999999997,"5min":1.206,"15min":1.206},"last":0.83999999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37232,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334608,"statfs":{"total":96636764160,"available":96598638592,"internally_reserved":0,"allocated":2138112,"data_stored":1093245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52500000000000002,"15min":0.505},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.27900000000000003},"max":{"1min":0.746,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.46000000000000002,"5min":0.441,"15min":0.39300000000000002},"max":{"1min":0.68100000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53200000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.64300000000000002,"5min":0.71399999999999997,"15min":0.81599999999999995},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.35599999999999998},"max":{"1min":0.68700000000000006,"5min":0.79100000000000004,"15min":0.93899999999999995},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.45100000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72199999999999998,"5min":0.83199999999999996,"15min":1.0249999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.36299999999999999},"max":{"1min":0.76500000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48099999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.78300000000000003,"15min":0.78900000000000003},"min":{"1min":0.53300000000000003,"5min":0.441,"15min":0.441},"max":{"1min":1.071,"5min":1.101,"15min":1.343},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84599999999999997,"15min":0.85099999999999998},"min":{"1min":0.63100000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.002,"5min":1.119,"15min":1.373},"last":0.67700000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79800000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.99099999999999999,"5min":1.085,"15min":1.3799999999999999},"last":0.746},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80300000000000005,"15min":0.81000000000000005},"min":{"1min":0.69099999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94699999999999995,"5min":1.087,"15min":1.2230000000000001},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.81599999999999995},"min":{"1min":0.61799999999999999,"5min":0.55700000000000005,"15min":0.55300000000000005},"max":{"1min":1.0249999999999999,"5min":1.127,"15min":1.2689999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53000000000000003},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.3660000000000001},"last":0.70699999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83199999999999996,"15min":0.83499999999999996},"min":{"1min":0.56399999999999995,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":1.0109999999999999,"5min":1.1399999999999999,"15min":1.4510000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84099999999999997,"15min":0.85499999999999998},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.57299999999999995},"max":{"1min":1.0489999999999999,"5min":1.0820000000000001,"15min":1.427},"last":0.61399999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509881,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55280,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316560,"statfs":{"total":96636764160,"available":96580157440,"internally_reserved":0,"allocated":2138112,"data_stored":1093245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.502,"15min":0.502},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.26500000000000001},"max":{"1min":0.72699999999999998,"5min":0.73999999999999999,"15min":1.0680000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.377},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":1.0780000000000001},"last":0.52800000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.437,"5min":0.38800000000000001,"15min":0.35599999999999998},"max":{"1min":0.751,"5min":0.86199999999999999,"15min":0.90300000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.60699999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.752,"5min":0.89100000000000001,"15min":0.91300000000000003},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.495,"15min":0.5},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.65900000000000003,"5min":0.71099999999999997,"15min":0.92800000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.42099999999999999,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.81899999999999995,"15min":0.95399999999999996},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.81100000000000005,"15min":0.81499999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.002,"5min":1.1839999999999999,"15min":1.2809999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81699999999999995,"15min":0.82799999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.439},"max":{"1min":1.1359999999999999,"5min":1.391,"15min":1.391},"last":0.69199999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81000000000000005,"15min":0.81799999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98999999999999999,"5min":1.218,"15min":1.218},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.81999999999999995,"15min":0.83499999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.47499999999999998},"max":{"1min":1.0660000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.81499999999999995,"15min":0.82199999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.495},"max":{"1min":1.048,"5min":1.262,"15min":1.2969999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.627,"5min":0.55600000000000005,"15min":0.55500000000000005},"max":{"1min":1.085,"5min":1.214,"15min":1.2390000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83099999999999996,"15min":0.84499999999999997},"min":{"1min":0.65600000000000003,"5min":0.60199999999999998,"15min":0.51300000000000001},"max":{"1min":1.1200000000000001,"5min":1.2629999999999999,"15min":1.3360000000000001},"last":0.623},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82799999999999996,"15min":0.84399999999999997},"min":{"1min":0.60599999999999998,"5min":0.57999999999999996,"15min":0.54400000000000004},"max":{"1min":1.101,"5min":1.335,"15min":1.3939999999999999},"last":0.745}]}]},{"osd":1,"up_from":15,"seq":64424509880,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37232,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334608,"statfs":{"total":96636764160,"available":96598638592,"internally_reserved":0,"allocated":2138112,"data_stored":1093245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.5,"15min":0.501},"min":{"1min":0.34899999999999998,"5min":0.30499999999999999,"15min":0.30399999999999999},"max":{"1min":0.57099999999999995,"5min":0.76200000000000001,"15min":0.86499999999999999},"last":0.251},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.46300000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.751,"5min":0.874,"15min":0.876},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52700000000000002,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64400000000000002,"5min":0.80800000000000005,"15min":0.82799999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39900000000000002,"5min":0.38900000000000001,"15min":0.373},"max":{"1min":0.72399999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60099999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.46100000000000002,"5min":0.438,"15min":0.43099999999999999},"max":{"1min":0.71599999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35099999999999998},"max":{"1min":0.62,"5min":0.77700000000000002,"15min":0.86199999999999999},"last":0.42999999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80000000000000004,"15min":0.80100000000000005},"min":{"1min":0.53700000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1040000000000001,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82199999999999995,"15min":0.82599999999999996},"min":{"1min":0.69299999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1180000000000001,"5min":1.2350000000000001,"15min":1.302},"last":0.70999999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.81699999999999995,"15min":0.81000000000000005},"min":{"1min":0.59299999999999997,"5min":0.52900000000000003,"15min":0.499},"max":{"1min":1.153,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81499999999999995,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.51800000000000002,"15min":0.48799999999999999},"max":{"1min":1.171,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.57599999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.83399999999999996,"15min":0.82899999999999996},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.59699999999999998},"max":{"1min":1.083,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.747},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80500000000000005,"15min":0.81799999999999995},"min":{"1min":0.64100000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.034,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.82999999999999996,"15min":0.83899999999999997},"min":{"1min":0.60799999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1040000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.626},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.83499999999999996},"min":{"1min":0.67100000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.131,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.72899999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509882,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37812,"kb_used_data":2668,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334028,"statfs":{"total":96636764160,"available":96598044672,"internally_reserved":0,"allocated":2732032,"data_stored":1683613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.498,"15min":0.48399999999999999},"min":{"1min":0.36699999999999999,"5min":0.29999999999999999,"15min":0.28499999999999998},"max":{"1min":0.79200000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.38300000000000001,"5min":0.32800000000000001,"15min":0.29799999999999999},"max":{"1min":0.79500000000000004,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.52600000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.42899999999999999,"5min":0.378,"15min":0.35899999999999999},"max":{"1min":0.74199999999999999,"5min":0.80900000000000005,"15min":0.87},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38400000000000001,"5min":0.35799999999999998,"15min":0.33900000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.442}]},{"osd":3,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.622,"15min":0.61899999999999999},"min":{"1min":0.504,"5min":0.47599999999999998,"15min":0.441},"max":{"1min":0.77200000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.46999999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.98599999999999999},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.67500000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.018,"5min":1.081,"15min":1.4370000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.63800000000000001,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2789999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.81699999999999995,"15min":0.81899999999999995},"min":{"1min":0.61099999999999999,"5min":0.60799999999999998,"15min":0.56599999999999995},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.88,"5min":0.86399999999999999,"15min":0.84999999999999998},"min":{"1min":0.68500000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1140000000000001,"5min":1.206,"15min":1.351},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.85699999999999998,"15min":0.86199999999999999},"min":{"1min":0.70699999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.121,"5min":1.1739999999999999,"15min":1.385},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.84799999999999998,"15min":0.84299999999999997},"min":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.60299999999999998},"max":{"1min":1.091,"5min":1.165,"15min":1.347},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.82899999999999996,"15min":0.83399999999999996},"min":{"1min":0.624,"5min":0.624,"15min":0.54100000000000004},"max":{"1min":1.0980000000000001,"5min":1.1100000000000001,"15min":1.3180000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.86599999999999999,"15min":0.878},"min":{"1min":0.66200000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.411},"last":0.622}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:55:45.347 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3f is not active+clean 2023-07-21T22:55:45.347 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.399624+0000', 'last_change': '2023-07-21T22:55:39.399624+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.399624+0000', 'last_undegraded': '2023-07-21T22:55:39.399624+0000', 'last_fullsized': '2023-07-21T22:55:39.399624+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:55:45.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3e is not active+clean 2023-07-21T22:55:45.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.393154+0000', 'last_change': '2023-07-21T22:55:39.393154+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.393154+0000', 'last_undegraded': '2023-07-21T22:55:39.393154+0000', 'last_fullsized': '2023-07-21T22:55:39.393154+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:55:45.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3d is not active+clean 2023-07-21T22:55:45.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.395530+0000', 'last_change': '2023-07-21T22:55:39.395530+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.395530+0000', 'last_undegraded': '2023-07-21T22:55:39.395530+0000', 'last_fullsized': '2023-07-21T22:55:39.395530+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:55:45.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3c is not active+clean 2023-07-21T22:55:45.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.404333+0000', 'last_change': '2023-07-21T22:55:39.404333+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.404333+0000', 'last_undegraded': '2023-07-21T22:55:39.404333+0000', 'last_fullsized': '2023-07-21T22:55:39.404333+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:55:45.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3b is not active+clean 2023-07-21T22:55:45.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.392099+0000', 'last_change': '2023-07-21T22:55:39.392099+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.392099+0000', 'last_undegraded': '2023-07-21T22:55:39.392099+0000', 'last_fullsized': '2023-07-21T22:55:39.392099+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:55:45.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3a is not active+clean 2023-07-21T22:55:45.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.390841+0000', 'last_change': '2023-07-21T22:55:39.390841+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.390841+0000', 'last_undegraded': '2023-07-21T22:55:39.390841+0000', 'last_fullsized': '2023-07-21T22:55:39.390841+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:55:45.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.39 is not active+clean 2023-07-21T22:55:45.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.398437+0000', 'last_change': '2023-07-21T22:55:39.398437+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.398437+0000', 'last_undegraded': '2023-07-21T22:55:39.398437+0000', 'last_fullsized': '2023-07-21T22:55:39.398437+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:55:45.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.38 is not active+clean 2023-07-21T22:55:45.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.406996+0000', 'last_change': '2023-07-21T22:55:39.406996+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.406996+0000', 'last_undegraded': '2023-07-21T22:55:39.406996+0000', 'last_fullsized': '2023-07-21T22:55:39.406996+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:55:45.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.37 is not active+clean 2023-07-21T22:55:45.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.391293+0000', 'last_change': '2023-07-21T22:55:39.391293+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.391293+0000', 'last_undegraded': '2023-07-21T22:55:39.391293+0000', 'last_fullsized': '2023-07-21T22:55:39.391293+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:55:45.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.36 is not active+clean 2023-07-21T22:55:45.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.389753+0000', 'last_change': '2023-07-21T22:55:39.389753+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.389753+0000', 'last_undegraded': '2023-07-21T22:55:39.389753+0000', 'last_fullsized': '2023-07-21T22:55:39.389753+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:55:45.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.35 is not active+clean 2023-07-21T22:55:45.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.392664+0000', 'last_change': '2023-07-21T22:55:39.392664+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.392664+0000', 'last_undegraded': '2023-07-21T22:55:39.392664+0000', 'last_fullsized': '2023-07-21T22:55:39.392664+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:55:45.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.34 is not active+clean 2023-07-21T22:55:45.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.403881+0000', 'last_change': '2023-07-21T22:55:39.403881+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.403881+0000', 'last_undegraded': '2023-07-21T22:55:39.403881+0000', 'last_fullsized': '2023-07-21T22:55:39.403881+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:55:45.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.33 is not active+clean 2023-07-21T22:55:45.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.391610+0000', 'last_change': '2023-07-21T22:55:39.391610+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.391610+0000', 'last_undegraded': '2023-07-21T22:55:39.391610+0000', 'last_fullsized': '2023-07-21T22:55:39.391610+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:55:45.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.32 is not active+clean 2023-07-21T22:55:45.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.405647+0000', 'last_change': '2023-07-21T22:55:39.405647+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.405647+0000', 'last_undegraded': '2023-07-21T22:55:39.405647+0000', 'last_fullsized': '2023-07-21T22:55:39.405647+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:55:45.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.31 is not active+clean 2023-07-21T22:55:45.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.396468+0000', 'last_change': '2023-07-21T22:55:39.396468+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.396468+0000', 'last_undegraded': '2023-07-21T22:55:39.396468+0000', 'last_fullsized': '2023-07-21T22:55:39.396468+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:55:45.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.30 is not active+clean 2023-07-21T22:55:45.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.389748+0000', 'last_change': '2023-07-21T22:55:39.389748+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.389748+0000', 'last_undegraded': '2023-07-21T22:55:39.389748+0000', 'last_fullsized': '2023-07-21T22:55:39.389748+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:55:45.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2f is not active+clean 2023-07-21T22:55:45.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.405747+0000', 'last_change': '2023-07-21T22:55:39.405747+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.405747+0000', 'last_undegraded': '2023-07-21T22:55:39.405747+0000', 'last_fullsized': '2023-07-21T22:55:39.405747+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:55:45.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2e is not active+clean 2023-07-21T22:55:45.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.390592+0000', 'last_change': '2023-07-21T22:55:39.390592+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.390592+0000', 'last_undegraded': '2023-07-21T22:55:39.390592+0000', 'last_fullsized': '2023-07-21T22:55:39.390592+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:55:45.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2d is not active+clean 2023-07-21T22:55:45.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.400596+0000', 'last_change': '2023-07-21T22:55:39.400596+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.400596+0000', 'last_undegraded': '2023-07-21T22:55:39.400596+0000', 'last_fullsized': '2023-07-21T22:55:39.400596+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:55:45.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2c is not active+clean 2023-07-21T22:55:45.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.393035+0000', 'last_change': '2023-07-21T22:55:39.393035+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.393035+0000', 'last_undegraded': '2023-07-21T22:55:39.393035+0000', 'last_fullsized': '2023-07-21T22:55:39.393035+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:55:45.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2b is not active+clean 2023-07-21T22:55:45.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.389757+0000', 'last_change': '2023-07-21T22:55:39.389757+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.389757+0000', 'last_undegraded': '2023-07-21T22:55:39.389757+0000', 'last_fullsized': '2023-07-21T22:55:39.389757+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:55:45.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2a is not active+clean 2023-07-21T22:55:45.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.399359+0000', 'last_change': '2023-07-21T22:55:39.399359+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.399359+0000', 'last_undegraded': '2023-07-21T22:55:39.399359+0000', 'last_fullsized': '2023-07-21T22:55:39.399359+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:55:45.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.29 is not active+clean 2023-07-21T22:55:45.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.409241+0000', 'last_change': '2023-07-21T22:55:39.409241+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.409241+0000', 'last_undegraded': '2023-07-21T22:55:39.409241+0000', 'last_fullsized': '2023-07-21T22:55:39.409241+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:55:45.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.28 is not active+clean 2023-07-21T22:55:45.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.390489+0000', 'last_change': '2023-07-21T22:55:39.390489+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.390489+0000', 'last_undegraded': '2023-07-21T22:55:39.390489+0000', 'last_fullsized': '2023-07-21T22:55:39.390489+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:55:45.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.27 is not active+clean 2023-07-21T22:55:45.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.398600+0000', 'last_change': '2023-07-21T22:55:39.398600+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.398600+0000', 'last_undegraded': '2023-07-21T22:55:39.398600+0000', 'last_fullsized': '2023-07-21T22:55:39.398600+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:55:45.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.26 is not active+clean 2023-07-21T22:55:45.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.400546+0000', 'last_change': '2023-07-21T22:55:39.400546+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.400546+0000', 'last_undegraded': '2023-07-21T22:55:39.400546+0000', 'last_fullsized': '2023-07-21T22:55:39.400546+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:55:45.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.25 is not active+clean 2023-07-21T22:55:45.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.389737+0000', 'last_change': '2023-07-21T22:55:39.389737+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.389737+0000', 'last_undegraded': '2023-07-21T22:55:39.389737+0000', 'last_fullsized': '2023-07-21T22:55:39.389737+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:55:45.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.24 is not active+clean 2023-07-21T22:55:45.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.389926+0000', 'last_change': '2023-07-21T22:55:39.389926+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.389926+0000', 'last_undegraded': '2023-07-21T22:55:39.389926+0000', 'last_fullsized': '2023-07-21T22:55:39.389926+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:55:45.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.23 is not active+clean 2023-07-21T22:55:45.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.410559+0000', 'last_change': '2023-07-21T22:55:39.410559+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.410559+0000', 'last_undegraded': '2023-07-21T22:55:39.410559+0000', 'last_fullsized': '2023-07-21T22:55:39.410559+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:55:45.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.22 is not active+clean 2023-07-21T22:55:45.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.391617+0000', 'last_change': '2023-07-21T22:55:39.391617+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.391617+0000', 'last_undegraded': '2023-07-21T22:55:39.391617+0000', 'last_fullsized': '2023-07-21T22:55:39.391617+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:55:45.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.21 is not active+clean 2023-07-21T22:55:45.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.390428+0000', 'last_change': '2023-07-21T22:55:39.390428+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.390428+0000', 'last_undegraded': '2023-07-21T22:55:39.390428+0000', 'last_fullsized': '2023-07-21T22:55:39.390428+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:55:45.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.20 is not active+clean 2023-07-21T22:55:45.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.406454+0000', 'last_change': '2023-07-21T22:55:39.406454+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.406454+0000', 'last_undegraded': '2023-07-21T22:55:39.406454+0000', 'last_fullsized': '2023-07-21T22:55:39.406454+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:55:45.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1c is not active+clean 2023-07-21T22:55:45.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.394271+0000', 'last_change': '2023-07-21T22:55:39.394271+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.394271+0000', 'last_undegraded': '2023-07-21T22:55:39.394271+0000', 'last_fullsized': '2023-07-21T22:55:39.394271+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:55:45.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1d is not active+clean 2023-07-21T22:55:45.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.395074+0000', 'last_change': '2023-07-21T22:55:39.395074+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.395074+0000', 'last_undegraded': '2023-07-21T22:55:39.395074+0000', 'last_fullsized': '2023-07-21T22:55:39.395074+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:55:45.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1e is not active+clean 2023-07-21T22:55:45.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.404288+0000', 'last_change': '2023-07-21T22:55:39.404288+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.404288+0000', 'last_undegraded': '2023-07-21T22:55:39.404288+0000', 'last_fullsized': '2023-07-21T22:55:39.404288+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:55:45.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1f is not active+clean 2023-07-21T22:55:45.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.401846+0000', 'last_change': '2023-07-21T22:55:39.401846+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.401846+0000', 'last_undegraded': '2023-07-21T22:55:39.401846+0000', 'last_fullsized': '2023-07-21T22:55:39.401846+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:55:45.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.18 is not active+clean 2023-07-21T22:55:45.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.392092+0000', 'last_change': '2023-07-21T22:55:39.392092+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.392092+0000', 'last_undegraded': '2023-07-21T22:55:39.392092+0000', 'last_fullsized': '2023-07-21T22:55:39.392092+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:55:45.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.19 is not active+clean 2023-07-21T22:55:45.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.402061+0000', 'last_change': '2023-07-21T22:55:39.402061+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.402061+0000', 'last_undegraded': '2023-07-21T22:55:39.402061+0000', 'last_fullsized': '2023-07-21T22:55:39.402061+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:55:45.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1a is not active+clean 2023-07-21T22:55:45.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.393735+0000', 'last_change': '2023-07-21T22:55:39.393735+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.393735+0000', 'last_undegraded': '2023-07-21T22:55:39.393735+0000', 'last_fullsized': '2023-07-21T22:55:39.393735+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:55:45.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1b is not active+clean 2023-07-21T22:55:45.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.398075+0000', 'last_change': '2023-07-21T22:55:39.398075+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.398075+0000', 'last_undegraded': '2023-07-21T22:55:39.398075+0000', 'last_fullsized': '2023-07-21T22:55:39.398075+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:55:45.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.c is not active+clean 2023-07-21T22:55:45.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.400927+0000', 'last_change': '2023-07-21T22:55:39.400927+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.400927+0000', 'last_undegraded': '2023-07-21T22:55:39.400927+0000', 'last_fullsized': '2023-07-21T22:55:39.400927+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:55:45.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.d is not active+clean 2023-07-21T22:55:45.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.402158+0000', 'last_change': '2023-07-21T22:55:39.402158+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.402158+0000', 'last_undegraded': '2023-07-21T22:55:39.402158+0000', 'last_fullsized': '2023-07-21T22:55:39.402158+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:55:45.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.e is not active+clean 2023-07-21T22:55:45.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.400095+0000', 'last_change': '2023-07-21T22:55:39.400095+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.400095+0000', 'last_undegraded': '2023-07-21T22:55:39.400095+0000', 'last_fullsized': '2023-07-21T22:55:39.400095+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:55:45.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.f is not active+clean 2023-07-21T22:55:45.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.397798+0000', 'last_change': '2023-07-21T22:55:39.397798+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.397798+0000', 'last_undegraded': '2023-07-21T22:55:39.397798+0000', 'last_fullsized': '2023-07-21T22:55:39.397798+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:55:45.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.8 is not active+clean 2023-07-21T22:55:45.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.400048+0000', 'last_change': '2023-07-21T22:55:39.400048+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.400048+0000', 'last_undegraded': '2023-07-21T22:55:39.400048+0000', 'last_fullsized': '2023-07-21T22:55:39.400048+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:55:45.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.9 is not active+clean 2023-07-21T22:55:45.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.395632+0000', 'last_change': '2023-07-21T22:55:39.395632+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.395632+0000', 'last_undegraded': '2023-07-21T22:55:39.395632+0000', 'last_fullsized': '2023-07-21T22:55:39.395632+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:55:45.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.a is not active+clean 2023-07-21T22:55:45.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.400785+0000', 'last_change': '2023-07-21T22:55:39.400785+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.400785+0000', 'last_undegraded': '2023-07-21T22:55:39.400785+0000', 'last_fullsized': '2023-07-21T22:55:39.400785+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:55:45.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.b is not active+clean 2023-07-21T22:55:45.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.394645+0000', 'last_change': '2023-07-21T22:55:39.394645+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.394645+0000', 'last_undegraded': '2023-07-21T22:55:39.394645+0000', 'last_fullsized': '2023-07-21T22:55:39.394645+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:55:45.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.4 is not active+clean 2023-07-21T22:55:45.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.389979+0000', 'last_change': '2023-07-21T22:55:39.389979+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.389979+0000', 'last_undegraded': '2023-07-21T22:55:39.389979+0000', 'last_fullsized': '2023-07-21T22:55:39.389979+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:55:45.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.5 is not active+clean 2023-07-21T22:55:45.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.403699+0000', 'last_change': '2023-07-21T22:55:39.403699+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.403699+0000', 'last_undegraded': '2023-07-21T22:55:39.403699+0000', 'last_fullsized': '2023-07-21T22:55:39.403699+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:55:45.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.6 is not active+clean 2023-07-21T22:55:45.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.398664+0000', 'last_change': '2023-07-21T22:55:39.398664+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.398664+0000', 'last_undegraded': '2023-07-21T22:55:39.398664+0000', 'last_fullsized': '2023-07-21T22:55:39.398664+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:55:45.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.7 is not active+clean 2023-07-21T22:55:45.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.390838+0000', 'last_change': '2023-07-21T22:55:39.390838+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.390838+0000', 'last_undegraded': '2023-07-21T22:55:39.390838+0000', 'last_fullsized': '2023-07-21T22:55:39.390838+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:55:45.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.0 is not active+clean 2023-07-21T22:55:45.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.405357+0000', 'last_change': '2023-07-21T22:55:39.405357+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.405357+0000', 'last_undegraded': '2023-07-21T22:55:39.405357+0000', 'last_fullsized': '2023-07-21T22:55:39.405357+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:55:45.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1 is not active+clean 2023-07-21T22:55:45.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.401528+0000', 'last_change': '2023-07-21T22:55:39.401528+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.401528+0000', 'last_undegraded': '2023-07-21T22:55:39.401528+0000', 'last_fullsized': '2023-07-21T22:55:39.401528+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:55:45.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2 is not active+clean 2023-07-21T22:55:45.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.393131+0000', 'last_change': '2023-07-21T22:55:39.393131+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.393131+0000', 'last_undegraded': '2023-07-21T22:55:39.393131+0000', 'last_fullsized': '2023-07-21T22:55:39.393131+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:55:45.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3 is not active+clean 2023-07-21T22:55:45.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.411717+0000', 'last_change': '2023-07-21T22:55:39.411717+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.411717+0000', 'last_undegraded': '2023-07-21T22:55:39.411717+0000', 'last_fullsized': '2023-07-21T22:55:39.411717+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:55:45.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.17 is not active+clean 2023-07-21T22:55:45.401 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.403054+0000', 'last_change': '2023-07-21T22:55:39.403054+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.403054+0000', 'last_undegraded': '2023-07-21T22:55:39.403054+0000', 'last_fullsized': '2023-07-21T22:55:39.403054+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:55:45.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.14 is not active+clean 2023-07-21T22:55:45.402 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.406020+0000', 'last_change': '2023-07-21T22:55:39.406020+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.406020+0000', 'last_undegraded': '2023-07-21T22:55:39.406020+0000', 'last_fullsized': '2023-07-21T22:55:39.406020+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:55:45.402 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.15 is not active+clean 2023-07-21T22:55:45.402 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.391374+0000', 'last_change': '2023-07-21T22:55:39.391374+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.391374+0000', 'last_undegraded': '2023-07-21T22:55:39.391374+0000', 'last_fullsized': '2023-07-21T22:55:39.391374+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:55:45.403 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.16 is not active+clean 2023-07-21T22:55:45.403 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.390156+0000', 'last_change': '2023-07-21T22:55:39.390156+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.390156+0000', 'last_undegraded': '2023-07-21T22:55:39.390156+0000', 'last_fullsized': '2023-07-21T22:55:39.390156+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:55:45.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.10 is not active+clean 2023-07-21T22:55:45.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.405829+0000', 'last_change': '2023-07-21T22:55:39.405829+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.405829+0000', 'last_undegraded': '2023-07-21T22:55:39.405829+0000', 'last_fullsized': '2023-07-21T22:55:39.405829+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:55:45.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.11 is not active+clean 2023-07-21T22:55:45.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.396061+0000', 'last_change': '2023-07-21T22:55:39.396061+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.396061+0000', 'last_undegraded': '2023-07-21T22:55:39.396061+0000', 'last_fullsized': '2023-07-21T22:55:39.396061+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:55:45.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.12 is not active+clean 2023-07-21T22:55:45.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.390327+0000', 'last_change': '2023-07-21T22:55:39.390327+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.390327+0000', 'last_undegraded': '2023-07-21T22:55:39.390327+0000', 'last_fullsized': '2023-07-21T22:55:39.390327+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:55:45.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.13 is not active+clean 2023-07-21T22:55:45.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 172, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:55:39.395164+0000', 'last_change': '2023-07-21T22:55:39.395164+0000', 'last_active': '2023-07-21T22:55:39.373623+0000', 'last_peered': '2023-07-21T22:55:39.373623+0000', 'last_clean': '2023-07-21T22:55:39.373623+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:55:39.395164+0000', 'last_undegraded': '2023-07-21T22:55:39.395164+0000', 'last_fullsized': '2023-07-21T22:55:39.395164+0000', 'mapping_epoch': 172, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 172, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'last_clean_scrub_stamp': '2023-07-21T22:55:39.373623+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:55:45.408 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-21T22:55:45.409 INFO:tasks.ceph.mds.a.smithi006.stderr:2023-07-21T22:55:45.362+0000 7f7a62ab0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:55:45.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.518+0000 7f5bfa648640 1 Processor -- start 2023-07-21T22:55:45.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.518+0000 7f5bfa648640 1 -- start start 2023-07-21T22:55:45.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.518+0000 7f5bfa648640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4158ce0 0x7f5bf4070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:45.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.518+0000 7f5bfa648640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5bf40c9730 0x7f5bf40ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:45.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.518+0000 7f5bfa648640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf40cc700 con 0x7f5bf40c8ad0 2023-07-21T22:55:45.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.518+0000 7f5bfa648640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf40b0ff0 con 0x7f5bf40c9730 2023-07-21T22:55:45.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.518+0000 7f5bfa648640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf4070c80 con 0x7f5bf4158ce0 2023-07-21T22:55:45.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.518+0000 7f5bf37fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5bf40c8ad0 0x7f5bf40c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56134/0 (socket says 172.21.15.6:56134) 2023-07-21T22:55:45.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.518+0000 7f5bf37fe640 1 -- 172.21.15.6:0/1262040758 learned_addr learned my addr 172.21.15.6:0/1262040758 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:45.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.518+0000 7f5bf3fff640 1 --2- 172.21.15.6:0/1262040758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4158ce0 0x7f5bf4070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:45.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.518+0000 7f5bf8be5640 1 --2- 172.21.15.6:0/1262040758 >> v2:172.21.15.161:3300/0 conn(0x7f5bf40c9730 0x7f5bf40ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:45.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.518+0000 7f5bf2ffd640 1 -- 172.21.15.6:0/1262040758 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4278103944 0 0) 0x7f5bf40cc700 con 0x7f5bf40c8ad0 2023-07-21T22:55:45.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.518+0000 7f5bf2ffd640 1 -- 172.21.15.6:0/1262040758 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bdc003530 con 0x7f5bf40c8ad0 2023-07-21T22:55:45.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.522+0000 7f5bf8be5640 1 -- 172.21.15.6:0/1262040758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4158ce0 msgr2=0x7f5bf4070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:45.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.522+0000 7f5bf8be5640 1 --2- 172.21.15.6:0/1262040758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4158ce0 0x7f5bf4070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.522+0000 7f5bf8be5640 1 -- 172.21.15.6:0/1262040758 >> v1:172.21.15.6:6789/0 conn(0x7f5bf40c8ad0 legacy=0x7f5bf40c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:45.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.522+0000 7f5bf2ffd640 1 -- 172.21.15.6:0/1262040758 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2160963494 0 0) 0x7f5bdc003530 con 0x7f5bf40c8ad0 2023-07-21T22:55:45.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.522+0000 7f5bf8be5640 1 -- 172.21.15.6:0/1262040758 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf40cbdd0 con 0x7f5bf40c9730 2023-07-21T22:55:45.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.522+0000 7f5bf3fff640 1 --2- 172.21.15.6:0/1262040758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4158ce0 0x7f5bf4070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:55:45.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.522+0000 7f5bf8be5640 1 --2- 172.21.15.6:0/1262040758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf40c9730 0x7f5bf40ccb90 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009d90 tx=0x7f5bec01c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=835e9fcf65237121 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:45.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.522+0000 7f5bf2ffd640 1 -- 172.21.15.6:0/1262040758 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8001680 con 0x7f5bf40c9730 2023-07-21T22:55:45.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.522+0000 7f5bf2ffd640 1 -- 172.21.15.6:0/1262040758 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bec0a5520 con 0x7f5bf40c9730 2023-07-21T22:55:45.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.522+0000 7f5bf2ffd640 1 -- 172.21.15.6:0/1262040758 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec0a58b0 con 0x7f5bf40c9730 2023-07-21T22:55:45.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bfa648640 1 -- 172.21.15.6:0/1262040758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf40c9730 msgr2=0x7f5bf40ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:45.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bfa648640 1 --2- 172.21.15.6:0/1262040758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf40c9730 0x7f5bf40ccb90 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f5bec009d90 tx=0x7f5bec01c720 comp rx=0 tx=0).stop 2023-07-21T22:55:45.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bfa648640 1 -- 172.21.15.6:0/1262040758 shutdown_connections 2023-07-21T22:55:45.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bfa648640 1 --2- 172.21.15.6:0/1262040758 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf40c9730 0x7f5bf40ccb90 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bfa648640 1 --2- 172.21.15.6:0/1262040758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4158ce0 0x7f5bf4070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bfa648640 1 -- 172.21.15.6:0/1262040758 >> 172.21.15.6:0/1262040758 conn(0x7f5bf40afcf0 msgr2=0x7f5bf40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:45.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bfa648640 1 -- 172.21.15.6:0/1262040758 shutdown_connections 2023-07-21T22:55:45.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bfa648640 1 -- 172.21.15.6:0/1262040758 wait complete. 2023-07-21T22:55:45.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bfa648640 1 Processor -- start 2023-07-21T22:55:45.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bfa648640 1 -- start start 2023-07-21T22:55:45.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bfa648640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bf40c8ad0 0x7f5bf4152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:45.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bfa648640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf40c9730 0x7f5bf414dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:45.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bfa648640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4158ce0 0x7f5bf4162450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:45.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bfa648640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf41501f0 con 0x7f5bf40c8ad0 2023-07-21T22:55:45.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bfa648640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf4151b50 con 0x7f5bf40c9730 2023-07-21T22:55:45.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bfa648640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf4151e30 con 0x7f5bf4158ce0 2023-07-21T22:55:45.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bf3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bf40c8ad0 0x7f5bf4152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:45.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bf3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bf40c8ad0 0x7f5bf4152bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53780/0 (socket says 172.21.15.6:53780) 2023-07-21T22:55:45.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bf3fff640 1 -- 172.21.15.6:0/33931824 learned_addr learned my addr 172.21.15.6:0/33931824 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:45.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bf3fff640 1 -- 172.21.15.6:0/33931824 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4158ce0 msgr2=0x7f5bf4162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:45.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bf3fff640 1 --2- 172.21.15.6:0/33931824 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4158ce0 0x7f5bf4162450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bf3fff640 1 -- 172.21.15.6:0/33931824 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf40c9730 msgr2=0x7f5bf414dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:45.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bf3fff640 1 --2- 172.21.15.6:0/33931824 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf40c9730 0x7f5bf414dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.526+0000 7f5bf3fff640 1 -- 172.21.15.6:0/33931824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be4009420 con 0x7f5bf40c8ad0 2023-07-21T22:55:45.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.530+0000 7f5bf3fff640 1 --2- 172.21.15.6:0/33931824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bf40c8ad0 0x7f5bf4152bf0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f5be400e980 tx=0x7f5be400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:45.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.530+0000 7f5bf0ff9640 1 -- 172.21.15.6:0/33931824 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be400ca00 con 0x7f5bf40c8ad0 2023-07-21T22:55:45.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.530+0000 7f5bf0ff9640 1 -- 172.21.15.6:0/33931824 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be400cb60 con 0x7f5bf40c8ad0 2023-07-21T22:55:45.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.530+0000 7f5bf0ff9640 1 -- 172.21.15.6:0/33931824 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4013470 con 0x7f5bf40c8ad0 2023-07-21T22:55:45.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.530+0000 7f5bfa648640 1 -- 172.21.15.6:0/33931824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bec009a70 con 0x7f5bf40c8ad0 2023-07-21T22:55:45.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.530+0000 7f5bfa648640 1 -- 172.21.15.6:0/33931824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf41523f0 con 0x7f5bf40c8ad0 2023-07-21T22:55:45.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.530+0000 7f5bfa648640 1 -- 172.21.15.6:0/33931824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf40ca1a0 con 0x7f5bf40c8ad0 2023-07-21T22:55:45.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.530+0000 7f5bf0ff9640 1 -- 172.21.15.6:0/33931824 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5be40135d0 con 0x7f5bf40c8ad0 2023-07-21T22:55:45.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.530+0000 7f5bf0ff9640 1 --2- 172.21.15.6:0/33931824 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f5be00663d0 0x7f5be0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:45.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.530+0000 7f5bf0ff9640 1 -- 172.21.15.6:0/33931824 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f5be4084140 con 0x7f5bf40c8ad0 2023-07-21T22:55:45.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.534+0000 7f5bf37fe640 1 --2- 172.21.15.6:0/33931824 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f5be00663d0 0x7f5be0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:45.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.534+0000 7f5bf37fe640 1 --2- 172.21.15.6:0/33931824 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f5be00663d0 0x7f5be0068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5be8001ec0 tx=0x7f5be8001a30 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:45.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.534+0000 7f5bf0ff9640 1 -- 172.21.15.6:0/33931824 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5be40513c0 con 0x7f5bf40c8ad0 2023-07-21T22:55:45.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.742+0000 7f5bfa648640 1 -- 172.21.15.6:0/33931824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f5bf40678d0 con 0x7f5bf40c8ad0 2023-07-21T22:55:45.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.742+0000 7f5bf0ff9640 1 -- 172.21.15.6:0/33931824 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3234 (secure 0 0 0) 0x7f5be40549e0 con 0x7f5bf40c8ad0 2023-07-21T22:55:45.777 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:45.778 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":2247,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":174,"num_osds":8,"num_up_osds":8,"osd_up_since":1689977909,"num_in_osds":8,"osd_in_since":1689977900,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":365805568,"bytes_avail":772728307712,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":78,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9957}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2023-07-21T22:55:28.141356+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-21T22:55:45.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.746+0000 7f5bfa648640 1 -- 172.21.15.6:0/33931824 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f5be00663d0 msgr2=0x7f5be0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:45.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.746+0000 7f5bfa648640 1 --2- 172.21.15.6:0/33931824 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f5be00663d0 0x7f5be0068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5be8001ec0 tx=0x7f5be8001a30 comp rx=0 tx=0).stop 2023-07-21T22:55:45.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.746+0000 7f5bfa648640 1 -- 172.21.15.6:0/33931824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bf40c8ad0 msgr2=0x7f5bf4152bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:45.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.746+0000 7f5bfa648640 1 --2- 172.21.15.6:0/33931824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bf40c8ad0 0x7f5bf4152bf0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f5be400e980 tx=0x7f5be400ee40 comp rx=0 tx=0).stop 2023-07-21T22:55:45.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.746+0000 7f5bfa648640 1 -- 172.21.15.6:0/33931824 shutdown_connections 2023-07-21T22:55:45.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.746+0000 7f5bfa648640 1 --2- 172.21.15.6:0/33931824 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f5be00663d0 0x7f5be0068880 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.746+0000 7f5bfa648640 1 --2- 172.21.15.6:0/33931824 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5bf4158ce0 0x7f5bf4162450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.746+0000 7f5bfa648640 1 --2- 172.21.15.6:0/33931824 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bf40c9730 0x7f5bf414dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.746+0000 7f5bfa648640 1 --2- 172.21.15.6:0/33931824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5bf40c8ad0 0x7f5bf4152bf0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.746+0000 7f5bfa648640 1 -- 172.21.15.6:0/33931824 >> 172.21.15.6:0/33931824 conn(0x7f5bf40afcf0 msgr2=0x7f5bf414f630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:45.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.746+0000 7f5bfa648640 1 -- 172.21.15.6:0/33931824 shutdown_connections 2023-07-21T22:55:45.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.746+0000 7f5bfa648640 1 -- 172.21.15.6:0/33931824 wait complete. 2023-07-21T22:55:45.798 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-21T22:55:45.799 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:55:45.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad34c48640 1 Processor -- start 2023-07-21T22:55:45.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad34c48640 1 -- start start 2023-07-21T22:55:45.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad34c48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad3006a540 0x7fad3006a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:45.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad34c48640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad300cdc80 con 0x7fad300ce0f0 2023-07-21T22:55:45.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad34c48640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad3006aed0 con 0x7fad3015f500 2023-07-21T22:55:45.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad34c48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3006e4c0 con 0x7fad3006a540 2023-07-21T22:55:45.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2ed9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fad300ce0f0 0x7fad300ce570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:56144/0 (socket says 172.21.15.6:56144) 2023-07-21T22:55:45.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2ed9d640 1 -- 172.21.15.6:0/1186255253 learned_addr learned my addr 172.21.15.6:0/1186255253 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:45.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad27fff640 1 --2- 172.21.15.6:0/1186255253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad3006a540 0x7fad3006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:45.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2dd9b640 1 -- 172.21.15.6:0/1186255253 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154902524 0 0) 0x7fad300cdc80 con 0x7fad300ce0f0 2023-07-21T22:55:45.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2dd9b640 1 -- 172.21.15.6:0/1186255253 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad1c003530 con 0x7fad300ce0f0 2023-07-21T22:55:45.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2dd9b640 1 -- 172.21.15.6:0/1186255253 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126802619 0 0) 0x7fad20001170 con 0x7fad3015f500 2023-07-21T22:55:45.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2dd9b640 1 -- 172.21.15.6:0/1186255253 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad300cdc80 con 0x7fad3015f500 2023-07-21T22:55:45.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2dd9b640 1 -- 172.21.15.6:0/1186255253 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1366227320 0 0) 0x7fad1c003530 con 0x7fad300ce0f0 2023-07-21T22:55:45.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2dd9b640 1 -- 172.21.15.6:0/1186255253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad3006a540 msgr2=0x7fad3006a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:45.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2dd9b640 1 --2- 172.21.15.6:0/1186255253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad3006a540 0x7fad3006a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2dd9b640 1 -- 172.21.15.6:0/1186255253 >> v1:172.21.15.161:6789/0 conn(0x7fad3015f500 legacy=0x7fad3006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:45.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2dd9b640 1 -- 172.21.15.6:0/1186255253 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3006d940 con 0x7fad300ce0f0 2023-07-21T22:55:45.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2dd9b640 1 -- 172.21.15.6:0/1186255253 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fad28001a00 con 0x7fad300ce0f0 2023-07-21T22:55:45.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2dd9b640 1 -- 172.21.15.6:0/1186255253 >> v1:172.21.15.6:6789/0 conn(0x7fad300ce0f0 legacy=0x7fad300ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:45.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2dd9b640 1 --2- 172.21.15.6:0/1186255253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad3006a540 0x7fad1c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:45.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2dd9b640 1 --2- 172.21.15.6:0/1186255253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0040a0 0x7fad1c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:45.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2dd9b640 1 --2- 172.21.15.6:0/1186255253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad1c004d10 0x7fad1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:45.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2dd9b640 1 -- 172.21.15.6:0/1186255253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3006e4c0 con 0x7fad1c0040a0 2023-07-21T22:55:45.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2dd9b640 1 -- 172.21.15.6:0/1186255253 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c00ba40 con 0x7fad1c004d10 2023-07-21T22:55:45.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2dd9b640 1 -- 172.21.15.6:0/1186255253 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c00bc00 con 0x7fad3006a540 2023-07-21T22:55:45.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad27fff640 1 --2- 172.21.15.6:0/1186255253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0040a0 0x7fad1c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:45.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2ed9d640 1 --2- 172.21.15.6:0/1186255253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad1c004d10 0x7fad1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:45.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2e59c640 1 --2- 172.21.15.6:0/1186255253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad3006a540 0x7fad1c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:45.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad27fff640 1 -- 172.21.15.6:0/1186255253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad3006a540 msgr2=0x7fad1c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:45.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad27fff640 1 --2- 172.21.15.6:0/1186255253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad3006a540 0x7fad1c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad27fff640 1 -- 172.21.15.6:0/1186255253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad1c004d10 msgr2=0x7fad1c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:45.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad27fff640 1 --2- 172.21.15.6:0/1186255253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad1c004d10 0x7fad1c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad27fff640 1 -- 172.21.15.6:0/1186255253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c003530 con 0x7fad1c0040a0 2023-07-21T22:55:45.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.910+0000 7fad2ed9d640 1 --2- 172.21.15.6:0/1186255253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad1c004d10 0x7fad1c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:45.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.914+0000 7fad27fff640 1 --2- 172.21.15.6:0/1186255253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0040a0 0x7fad1c0047d0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fad18009ab0 tx=0x7fad1801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac01f38cb8704d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:45.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.914+0000 7fad2dd9b640 1 -- 172.21.15.6:0/1186255253 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad180a5620 con 0x7fad1c0040a0 2023-07-21T22:55:45.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.914+0000 7fad2dd9b640 1 -- 172.21.15.6:0/1186255253 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad180a5780 con 0x7fad1c0040a0 2023-07-21T22:55:45.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.914+0000 7fad2dd9b640 1 -- 172.21.15.6:0/1186255253 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad180a5930 con 0x7fad1c0040a0 2023-07-21T22:55:45.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.914+0000 7fad34c48640 1 -- 172.21.15.6:0/1186255253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0040a0 msgr2=0x7fad1c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:45.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.914+0000 7fad34c48640 1 --2- 172.21.15.6:0/1186255253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0040a0 0x7fad1c0047d0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fad18009ab0 tx=0x7fad1801ca30 comp rx=0 tx=0).stop 2023-07-21T22:55:45.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.914+0000 7fad2ed9d640 1 -- 172.21.15.6:0/1186255253 reap_dead start 2023-07-21T22:55:45.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.914+0000 7fad34c48640 1 -- 172.21.15.6:0/1186255253 shutdown_connections 2023-07-21T22:55:45.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.914+0000 7fad34c48640 1 -- 172.21.15.6:0/1186255253 >> 172.21.15.6:0/1186255253 conn(0x7fad300659d0 msgr2=0x7fad30099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:45.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.914+0000 7fad34c48640 1 -- 172.21.15.6:0/1186255253 shutdown_connections 2023-07-21T22:55:45.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.914+0000 7fad34c48640 1 -- 172.21.15.6:0/1186255253 wait complete. 2023-07-21T22:55:45.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.918+0000 7fad34c48640 1 Processor -- start 2023-07-21T22:55:45.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.918+0000 7fad34c48640 1 -- start start 2023-07-21T22:55:45.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.918+0000 7fad34c48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0040a0 0x7fad30153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:45.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.918+0000 7fad34c48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad30153e30 0x7fad30155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:45.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.918+0000 7fad34c48640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad301561a0 0x7fad30151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:45.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.918+0000 7fad34c48640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad30153b30 con 0x7fad1c0040a0 2023-07-21T22:55:45.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.918+0000 7fad34c48640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad30154ea0 con 0x7fad301561a0 2023-07-21T22:55:45.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.918+0000 7fad34c48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad30155180 con 0x7fad30153e30 2023-07-21T22:55:45.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.918+0000 7fad2e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0040a0 0x7fad30153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:45.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.918+0000 7fad2e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0040a0 0x7fad30153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53794/0 (socket says 172.21.15.6:53794) 2023-07-21T22:55:45.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.918+0000 7fad2e59c640 1 -- 172.21.15.6:0/3920760690 learned_addr learned my addr 172.21.15.6:0/3920760690 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:45.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.918+0000 7fad2ed9d640 1 --2- 172.21.15.6:0/3920760690 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad301561a0 0x7fad30151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:45.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.918+0000 7fad27fff640 1 --2- 172.21.15.6:0/3920760690 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad30153e30 0x7fad30155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:45.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.918+0000 7fad2e59c640 1 -- 172.21.15.6:0/3920760690 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad30153e30 msgr2=0x7fad30155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:45.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.918+0000 7fad2e59c640 1 --2- 172.21.15.6:0/3920760690 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad30153e30 0x7fad30155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.918+0000 7fad2e59c640 1 -- 172.21.15.6:0/3920760690 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad301561a0 msgr2=0x7fad30151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:45.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.918+0000 7fad2e59c640 1 --2- 172.21.15.6:0/3920760690 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad301561a0 0x7fad30151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:45.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.918+0000 7fad2e59c640 1 -- 172.21.15.6:0/3920760690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad30155460 con 0x7fad1c0040a0 2023-07-21T22:55:45.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.918+0000 7fad2ed9d640 1 --2- 172.21.15.6:0/3920760690 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad301561a0 0x7fad30151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:45.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.918+0000 7fad2e59c640 1 --2- 172.21.15.6:0/3920760690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0040a0 0x7fad30153250 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fad20011b80 tx=0x7fad2000f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:45.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.922+0000 7fad26ffd640 1 -- 172.21.15.6:0/3920760690 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2000fe50 con 0x7fad1c0040a0 2023-07-21T22:55:45.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.922+0000 7fad26ffd640 1 -- 172.21.15.6:0/3920760690 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad20015410 con 0x7fad1c0040a0 2023-07-21T22:55:45.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.922+0000 7fad26ffd640 1 -- 172.21.15.6:0/3920760690 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad200157c0 con 0x7fad1c0040a0 2023-07-21T22:55:45.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.922+0000 7fad34c48640 1 -- 172.21.15.6:0/3920760690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad30155740 con 0x7fad1c0040a0 2023-07-21T22:55:45.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.922+0000 7fad34c48640 1 -- 172.21.15.6:0/3920760690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad30152250 con 0x7fad1c0040a0 2023-07-21T22:55:45.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.922+0000 7fad34c48640 1 -- 172.21.15.6:0/3920760690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad300678d0 con 0x7fad1c0040a0 2023-07-21T22:55:45.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.922+0000 7fad26ffd640 1 -- 172.21.15.6:0/3920760690 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fad20015920 con 0x7fad1c0040a0 2023-07-21T22:55:45.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.922+0000 7fad26ffd640 1 --2- 172.21.15.6:0/3920760690 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fad100663a0 0x7fad10068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:45.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.922+0000 7fad26ffd640 1 -- 172.21.15.6:0/3920760690 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fad20087430 con 0x7fad1c0040a0 2023-07-21T22:55:45.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.922+0000 7fad27fff640 1 --2- 172.21.15.6:0/3920760690 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fad100663a0 0x7fad10068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:45.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.926+0000 7fad27fff640 1 --2- 172.21.15.6:0/3920760690 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fad100663a0 0x7fad10068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fad180af000 tx=0x7fad180046d0 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:45.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:45.926+0000 7fad26ffd640 1 -- 172.21.15.6:0/3920760690 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fad200546b0 con 0x7fad1c0040a0 2023-07-21T22:55:46.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:46.078+0000 7fad34c48640 1 -- 172.21.15.6:0/3920760690 --> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad3006df00 con 0x7fad100663a0 2023-07-21T22:55:46.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:46.086+0000 7fad26ffd640 1 -- 172.21.15.6:0/3920760690 <== mgr.9289 v2:172.21.15.161:6832/2346358146 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306469 (secure 0 0 0) 0x7fad180a5910 con 0x7fad100663a0 2023-07-21T22:55:46.124 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:46.125 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:55:46.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:46.090+0000 7fad34c48640 1 -- 172.21.15.6:0/3920760690 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fad100663a0 msgr2=0x7fad10068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:46.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:46.090+0000 7fad34c48640 1 --2- 172.21.15.6:0/3920760690 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fad100663a0 0x7fad10068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fad180af000 tx=0x7fad180046d0 comp rx=0 tx=0).stop 2023-07-21T22:55:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:46.090+0000 7fad34c48640 1 -- 172.21.15.6:0/3920760690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0040a0 msgr2=0x7fad30153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:46.090+0000 7fad34c48640 1 --2- 172.21.15.6:0/3920760690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0040a0 0x7fad30153250 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fad20011b80 tx=0x7fad2000f540 comp rx=0 tx=0).stop 2023-07-21T22:55:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:46.090+0000 7fad34c48640 1 -- 172.21.15.6:0/3920760690 shutdown_connections 2023-07-21T22:55:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:46.090+0000 7fad34c48640 1 --2- 172.21.15.6:0/3920760690 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fad100663a0 0x7fad10068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:46.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:46.090+0000 7fad34c48640 1 --2- 172.21.15.6:0/3920760690 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad301561a0 0x7fad30151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:46.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:46.090+0000 7fad34c48640 1 --2- 172.21.15.6:0/3920760690 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad30153e30 0x7fad30155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:46.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:46.090+0000 7fad34c48640 1 --2- 172.21.15.6:0/3920760690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1c0040a0 0x7fad30153250 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:46.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:46.090+0000 7fad34c48640 1 -- 172.21.15.6:0/3920760690 >> 172.21.15.6:0/3920760690 conn(0x7fad300659d0 msgr2=0x7fad3015e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:46.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:46.090+0000 7fad34c48640 1 -- 172.21.15.6:0/3920760690 shutdown_connections 2023-07-21T22:55:46.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:46.090+0000 7fad34c48640 1 -- 172.21.15.6:0/3920760690 wait complete. 2023-07-21T22:55:46.145 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-21T22:55:44.145145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":357232,"kb_used_data":17840,"kb_used_omap":0,"kb_used_meta":339328,"kb_avail":754617488,"statfs":{"total":773094113280,"available":772728307712,"internally_reserved":0,"allocated":18268160,"data_stored":9913296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":347471872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.762405"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.399624+0000","last_change":"2023-07-21T22:55:39.399624+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.399624+0000","last_undegraded":"2023-07-21T22:55:39.399624+0000","last_fullsized":"2023-07-21T22:55:39.399624+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.393154+0000","last_change":"2023-07-21T22:55:39.393154+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.393154+0000","last_undegraded":"2023-07-21T22:55:39.393154+0000","last_fullsized":"2023-07-21T22:55:39.393154+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.395530+0000","last_change":"2023-07-21T22:55:39.395530+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.395530+0000","last_undegraded":"2023-07-21T22:55:39.395530+0000","last_fullsized":"2023-07-21T22:55:39.395530+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.404333+0000","last_change":"2023-07-21T22:55:39.404333+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.404333+0000","last_undegraded":"2023-07-21T22:55:39.404333+0000","last_fullsized":"2023-07-21T22:55:39.404333+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.392099+0000","last_change":"2023-07-21T22:55:39.392099+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.392099+0000","last_undegraded":"2023-07-21T22:55:39.392099+0000","last_fullsized":"2023-07-21T22:55:39.392099+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390841+0000","last_change":"2023-07-21T22:55:39.390841+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390841+0000","last_undegraded":"2023-07-21T22:55:39.390841+0000","last_fullsized":"2023-07-21T22:55:39.390841+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.398437+0000","last_change":"2023-07-21T22:55:39.398437+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.398437+0000","last_undegraded":"2023-07-21T22:55:39.398437+0000","last_fullsized":"2023-07-21T22:55:39.398437+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.406996+0000","last_change":"2023-07-21T22:55:39.406996+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.406996+0000","last_undegraded":"2023-07-21T22:55:39.406996+0000","last_fullsized":"2023-07-21T22:55:39.406996+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.391293+0000","last_change":"2023-07-21T22:55:39.391293+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.391293+0000","last_undegraded":"2023-07-21T22:55:39.391293+0000","last_fullsized":"2023-07-21T22:55:39.391293+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389753+0000","last_change":"2023-07-21T22:55:39.389753+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389753+0000","last_undegraded":"2023-07-21T22:55:39.389753+0000","last_fullsized":"2023-07-21T22:55:39.389753+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.392664+0000","last_change":"2023-07-21T22:55:39.392664+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.392664+0000","last_undegraded":"2023-07-21T22:55:39.392664+0000","last_fullsized":"2023-07-21T22:55:39.392664+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.403881+0000","last_change":"2023-07-21T22:55:39.403881+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.403881+0000","last_undegraded":"2023-07-21T22:55:39.403881+0000","last_fullsized":"2023-07-21T22:55:39.403881+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.391610+0000","last_change":"2023-07-21T22:55:39.391610+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.391610+0000","last_undegraded":"2023-07-21T22:55:39.391610+0000","last_fullsized":"2023-07-21T22:55:39.391610+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.405647+0000","last_change":"2023-07-21T22:55:39.405647+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.405647+0000","last_undegraded":"2023-07-21T22:55:39.405647+0000","last_fullsized":"2023-07-21T22:55:39.405647+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.396468+0000","last_change":"2023-07-21T22:55:39.396468+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.396468+0000","last_undegraded":"2023-07-21T22:55:39.396468+0000","last_fullsized":"2023-07-21T22:55:39.396468+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389748+0000","last_change":"2023-07-21T22:55:39.389748+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389748+0000","last_undegraded":"2023-07-21T22:55:39.389748+0000","last_fullsized":"2023-07-21T22:55:39.389748+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.405747+0000","last_change":"2023-07-21T22:55:39.405747+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.405747+0000","last_undegraded":"2023-07-21T22:55:39.405747+0000","last_fullsized":"2023-07-21T22:55:39.405747+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390592+0000","last_change":"2023-07-21T22:55:39.390592+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390592+0000","last_undegraded":"2023-07-21T22:55:39.390592+0000","last_fullsized":"2023-07-21T22:55:39.390592+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400596+0000","last_change":"2023-07-21T22:55:39.400596+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400596+0000","last_undegraded":"2023-07-21T22:55:39.400596+0000","last_fullsized":"2023-07-21T22:55:39.400596+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.393035+0000","last_change":"2023-07-21T22:55:39.393035+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.393035+0000","last_undegraded":"2023-07-21T22:55:39.393035+0000","last_fullsized":"2023-07-21T22:55:39.393035+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389757+0000","last_change":"2023-07-21T22:55:39.389757+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389757+0000","last_undegraded":"2023-07-21T22:55:39.389757+0000","last_fullsized":"2023-07-21T22:55:39.389757+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.399359+0000","last_change":"2023-07-21T22:55:39.399359+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.399359+0000","last_undegraded":"2023-07-21T22:55:39.399359+0000","last_fullsized":"2023-07-21T22:55:39.399359+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.409241+0000","last_change":"2023-07-21T22:55:39.409241+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.409241+0000","last_undegraded":"2023-07-21T22:55:39.409241+0000","last_fullsized":"2023-07-21T22:55:39.409241+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390489+0000","last_change":"2023-07-21T22:55:39.390489+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390489+0000","last_undegraded":"2023-07-21T22:55:39.390489+0000","last_fullsized":"2023-07-21T22:55:39.390489+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.398600+0000","last_change":"2023-07-21T22:55:39.398600+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.398600+0000","last_undegraded":"2023-07-21T22:55:39.398600+0000","last_fullsized":"2023-07-21T22:55:39.398600+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400546+0000","last_change":"2023-07-21T22:55:39.400546+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400546+0000","last_undegraded":"2023-07-21T22:55:39.400546+0000","last_fullsized":"2023-07-21T22:55:39.400546+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389737+0000","last_change":"2023-07-21T22:55:39.389737+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389737+0000","last_undegraded":"2023-07-21T22:55:39.389737+0000","last_fullsized":"2023-07-21T22:55:39.389737+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389926+0000","last_change":"2023-07-21T22:55:39.389926+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389926+0000","last_undegraded":"2023-07-21T22:55:39.389926+0000","last_fullsized":"2023-07-21T22:55:39.389926+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.410559+0000","last_change":"2023-07-21T22:55:39.410559+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.410559+0000","last_undegraded":"2023-07-21T22:55:39.410559+0000","last_fullsized":"2023-07-21T22:55:39.410559+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.391617+0000","last_change":"2023-07-21T22:55:39.391617+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.391617+0000","last_undegraded":"2023-07-21T22:55:39.391617+0000","last_fullsized":"2023-07-21T22:55:39.391617+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390428+0000","last_change":"2023-07-21T22:55:39.390428+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390428+0000","last_undegraded":"2023-07-21T22:55:39.390428+0000","last_fullsized":"2023-07-21T22:55:39.390428+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.406454+0000","last_change":"2023-07-21T22:55:39.406454+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.406454+0000","last_undegraded":"2023-07-21T22:55:39.406454+0000","last_fullsized":"2023-07-21T22:55:39.406454+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.394271+0000","last_change":"2023-07-21T22:55:39.394271+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.394271+0000","last_undegraded":"2023-07-21T22:55:39.394271+0000","last_fullsized":"2023-07-21T22:55:39.394271+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.402955+0000","last_change":"2023-07-21T22:55:39.401202+0000","last_active":"2023-07-21T22:55:39.402955+0000","last_peered":"2023-07-21T22:55:39.402955+0000","last_clean":"2023-07-21T22:55:39.402955+0000","last_became_active":"2023-07-21T22:55:39.400656+0000","last_became_peered":"2023-07-21T22:55:39.400656+0000","last_unstale":"2023-07-21T22:55:39.402955+0000","last_undegraded":"2023-07-21T22:55:39.402955+0000","last_fullsized":"2023-07-21T22:55:39.402955+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:04.688417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.395074+0000","last_change":"2023-07-21T22:55:39.395074+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.395074+0000","last_undegraded":"2023-07-21T22:55:39.395074+0000","last_fullsized":"2023-07-21T22:55:39.395074+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.416584+0000","last_change":"2023-07-21T22:55:39.415451+0000","last_active":"2023-07-21T22:55:39.416584+0000","last_peered":"2023-07-21T22:55:39.416584+0000","last_clean":"2023-07-21T22:55:39.416584+0000","last_became_active":"2023-07-21T22:55:39.415164+0000","last_became_peered":"2023-07-21T22:55:39.415164+0000","last_unstale":"2023-07-21T22:55:39.416584+0000","last_undegraded":"2023-07-21T22:55:39.416584+0000","last_fullsized":"2023-07-21T22:55:39.416584+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:03:06.312844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.404288+0000","last_change":"2023-07-21T22:55:39.404288+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.404288+0000","last_undegraded":"2023-07-21T22:55:39.404288+0000","last_fullsized":"2023-07-21T22:55:39.404288+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.416031+0000","last_change":"2023-07-21T22:55:39.414669+0000","last_active":"2023-07-21T22:55:39.416031+0000","last_peered":"2023-07-21T22:55:39.416031+0000","last_clean":"2023-07-21T22:55:39.416031+0000","last_became_active":"2023-07-21T22:55:39.414403+0000","last_became_peered":"2023-07-21T22:55:39.414403+0000","last_unstale":"2023-07-21T22:55:39.416031+0000","last_undegraded":"2023-07-21T22:55:39.416031+0000","last_fullsized":"2023-07-21T22:55:39.416031+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:27:09.502436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.401846+0000","last_change":"2023-07-21T22:55:39.401846+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.401846+0000","last_undegraded":"2023-07-21T22:55:39.401846+0000","last_fullsized":"2023-07-21T22:55:39.401846+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.414112+0000","last_change":"2023-07-21T22:55:39.413053+0000","last_active":"2023-07-21T22:55:39.414112+0000","last_peered":"2023-07-21T22:55:39.414112+0000","last_clean":"2023-07-21T22:55:39.414112+0000","last_became_active":"2023-07-21T22:55:39.412694+0000","last_became_peered":"2023-07-21T22:55:39.412694+0000","last_unstale":"2023-07-21T22:55:39.414112+0000","last_undegraded":"2023-07-21T22:55:39.414112+0000","last_fullsized":"2023-07-21T22:55:39.414112+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:21:56.166474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.392092+0000","last_change":"2023-07-21T22:55:39.392092+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.392092+0000","last_undegraded":"2023-07-21T22:55:39.392092+0000","last_fullsized":"2023-07-21T22:55:39.392092+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.421505+0000","last_change":"2023-07-21T22:55:39.418236+0000","last_active":"2023-07-21T22:55:39.421505+0000","last_peered":"2023-07-21T22:55:39.421505+0000","last_clean":"2023-07-21T22:55:39.421505+0000","last_became_active":"2023-07-21T22:55:39.417975+0000","last_became_peered":"2023-07-21T22:55:39.417975+0000","last_unstale":"2023-07-21T22:55:39.421505+0000","last_undegraded":"2023-07-21T22:55:39.421505+0000","last_fullsized":"2023-07-21T22:55:39.421505+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:14:45.372222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.402061+0000","last_change":"2023-07-21T22:55:39.402061+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.402061+0000","last_undegraded":"2023-07-21T22:55:39.402061+0000","last_fullsized":"2023-07-21T22:55:39.402061+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.408618+0000","last_change":"2023-07-21T22:55:39.407508+0000","last_active":"2023-07-21T22:55:39.408618+0000","last_peered":"2023-07-21T22:55:39.408618+0000","last_clean":"2023-07-21T22:55:39.408618+0000","last_became_active":"2023-07-21T22:55:39.407178+0000","last_became_peered":"2023-07-21T22:55:39.407178+0000","last_unstale":"2023-07-21T22:55:39.408618+0000","last_undegraded":"2023-07-21T22:55:39.408618+0000","last_fullsized":"2023-07-21T22:55:39.408618+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:57.640218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.393735+0000","last_change":"2023-07-21T22:55:39.393735+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.393735+0000","last_undegraded":"2023-07-21T22:55:39.393735+0000","last_fullsized":"2023-07-21T22:55:39.393735+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.414400+0000","last_change":"2023-07-21T22:55:39.411817+0000","last_active":"2023-07-21T22:55:39.414400+0000","last_peered":"2023-07-21T22:55:39.414400+0000","last_clean":"2023-07-21T22:55:39.414400+0000","last_became_active":"2023-07-21T22:55:39.411096+0000","last_became_peered":"2023-07-21T22:55:39.411096+0000","last_unstale":"2023-07-21T22:55:39.414400+0000","last_undegraded":"2023-07-21T22:55:39.414400+0000","last_fullsized":"2023-07-21T22:55:39.414400+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:37:11.626613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.398075+0000","last_change":"2023-07-21T22:55:39.398075+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.398075+0000","last_undegraded":"2023-07-21T22:55:39.398075+0000","last_fullsized":"2023-07-21T22:55:39.398075+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.401777+0000","last_change":"2023-07-21T22:55:39.398085+0000","last_active":"2023-07-21T22:55:39.401777+0000","last_peered":"2023-07-21T22:55:39.401777+0000","last_clean":"2023-07-21T22:55:39.401777+0000","last_became_active":"2023-07-21T22:55:39.397730+0000","last_became_peered":"2023-07-21T22:55:39.397730+0000","last_unstale":"2023-07-21T22:55:39.401777+0000","last_undegraded":"2023-07-21T22:55:39.401777+0000","last_fullsized":"2023-07-21T22:55:39.401777+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:58:28.209192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400927+0000","last_change":"2023-07-21T22:55:39.400927+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400927+0000","last_undegraded":"2023-07-21T22:55:39.400927+0000","last_fullsized":"2023-07-21T22:55:39.400927+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.404167+0000","last_change":"2023-07-21T22:55:39.401715+0000","last_active":"2023-07-21T22:55:39.404167+0000","last_peered":"2023-07-21T22:55:39.404167+0000","last_clean":"2023-07-21T22:55:39.404167+0000","last_became_active":"2023-07-21T22:55:39.401360+0000","last_became_peered":"2023-07-21T22:55:39.401360+0000","last_unstale":"2023-07-21T22:55:39.404167+0000","last_undegraded":"2023-07-21T22:55:39.404167+0000","last_fullsized":"2023-07-21T22:55:39.404167+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:54:37.310776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.402158+0000","last_change":"2023-07-21T22:55:39.402158+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.402158+0000","last_undegraded":"2023-07-21T22:55:39.402158+0000","last_fullsized":"2023-07-21T22:55:39.402158+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.413599+0000","last_change":"2023-07-21T22:55:39.410646+0000","last_active":"2023-07-21T22:55:39.413599+0000","last_peered":"2023-07-21T22:55:39.413599+0000","last_clean":"2023-07-21T22:55:39.413599+0000","last_became_active":"2023-07-21T22:55:39.410319+0000","last_became_peered":"2023-07-21T22:55:39.410319+0000","last_unstale":"2023-07-21T22:55:39.413599+0000","last_undegraded":"2023-07-21T22:55:39.413599+0000","last_fullsized":"2023-07-21T22:55:39.413599+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:37:16.993672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400095+0000","last_change":"2023-07-21T22:55:39.400095+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400095+0000","last_undegraded":"2023-07-21T22:55:39.400095+0000","last_fullsized":"2023-07-21T22:55:39.400095+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.411672+0000","last_change":"2023-07-21T22:55:39.409616+0000","last_active":"2023-07-21T22:55:39.411672+0000","last_peered":"2023-07-21T22:55:39.411672+0000","last_clean":"2023-07-21T22:55:39.411672+0000","last_became_active":"2023-07-21T22:55:39.409314+0000","last_became_peered":"2023-07-21T22:55:39.409314+0000","last_unstale":"2023-07-21T22:55:39.411672+0000","last_undegraded":"2023-07-21T22:55:39.411672+0000","last_fullsized":"2023-07-21T22:55:39.411672+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:21:46.525218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.397798+0000","last_change":"2023-07-21T22:55:39.397798+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.397798+0000","last_undegraded":"2023-07-21T22:55:39.397798+0000","last_fullsized":"2023-07-21T22:55:39.397798+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.424162+0000","last_change":"2023-07-21T22:55:39.421460+0000","last_active":"2023-07-21T22:55:39.424162+0000","last_peered":"2023-07-21T22:55:39.424162+0000","last_clean":"2023-07-21T22:55:39.424162+0000","last_became_active":"2023-07-21T22:55:39.421077+0000","last_became_peered":"2023-07-21T22:55:39.421077+0000","last_unstale":"2023-07-21T22:55:39.424162+0000","last_undegraded":"2023-07-21T22:55:39.424162+0000","last_fullsized":"2023-07-21T22:55:39.424162+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:46:13.990885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400048+0000","last_change":"2023-07-21T22:55:39.400048+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400048+0000","last_undegraded":"2023-07-21T22:55:39.400048+0000","last_fullsized":"2023-07-21T22:55:39.400048+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.413967+0000","last_change":"2023-07-21T22:55:39.413026+0000","last_active":"2023-07-21T22:55:39.413967+0000","last_peered":"2023-07-21T22:55:39.413967+0000","last_clean":"2023-07-21T22:55:39.413967+0000","last_became_active":"2023-07-21T22:55:39.412686+0000","last_became_peered":"2023-07-21T22:55:39.412686+0000","last_unstale":"2023-07-21T22:55:39.413967+0000","last_undegraded":"2023-07-21T22:55:39.413967+0000","last_fullsized":"2023-07-21T22:55:39.413967+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:38:37.952444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.395632+0000","last_change":"2023-07-21T22:55:39.395632+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.395632+0000","last_undegraded":"2023-07-21T22:55:39.395632+0000","last_fullsized":"2023-07-21T22:55:39.395632+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.420502+0000","last_change":"2023-07-21T22:55:39.415018+0000","last_active":"2023-07-21T22:55:39.420502+0000","last_peered":"2023-07-21T22:55:39.420502+0000","last_clean":"2023-07-21T22:55:39.420502+0000","last_became_active":"2023-07-21T22:55:39.414713+0000","last_became_peered":"2023-07-21T22:55:39.414713+0000","last_unstale":"2023-07-21T22:55:39.420502+0000","last_undegraded":"2023-07-21T22:55:39.420502+0000","last_fullsized":"2023-07-21T22:55:39.420502+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:41:31.314913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.400785+0000","last_change":"2023-07-21T22:55:39.400785+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.400785+0000","last_undegraded":"2023-07-21T22:55:39.400785+0000","last_fullsized":"2023-07-21T22:55:39.400785+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.413948+0000","last_change":"2023-07-21T22:55:39.412811+0000","last_active":"2023-07-21T22:55:39.413948+0000","last_peered":"2023-07-21T22:55:39.413948+0000","last_clean":"2023-07-21T22:55:39.413948+0000","last_became_active":"2023-07-21T22:55:39.412344+0000","last_became_peered":"2023-07-21T22:55:39.412344+0000","last_unstale":"2023-07-21T22:55:39.413948+0000","last_undegraded":"2023-07-21T22:55:39.413948+0000","last_fullsized":"2023-07-21T22:55:39.413948+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:13:16.596486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.394645+0000","last_change":"2023-07-21T22:55:39.394645+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.394645+0000","last_undegraded":"2023-07-21T22:55:39.394645+0000","last_fullsized":"2023-07-21T22:55:39.394645+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.420587+0000","last_change":"2023-07-21T22:55:39.416526+0000","last_active":"2023-07-21T22:55:39.420587+0000","last_peered":"2023-07-21T22:55:39.420587+0000","last_clean":"2023-07-21T22:55:39.420587+0000","last_became_active":"2023-07-21T22:55:39.416238+0000","last_became_peered":"2023-07-21T22:55:39.416238+0000","last_unstale":"2023-07-21T22:55:39.420587+0000","last_undegraded":"2023-07-21T22:55:39.420587+0000","last_fullsized":"2023-07-21T22:55:39.420587+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:33:27.404274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.389979+0000","last_change":"2023-07-21T22:55:39.389979+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.389979+0000","last_undegraded":"2023-07-21T22:55:39.389979+0000","last_fullsized":"2023-07-21T22:55:39.389979+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.424174+0000","last_change":"2023-07-21T22:55:39.421412+0000","last_active":"2023-07-21T22:55:39.424174+0000","last_peered":"2023-07-21T22:55:39.424174+0000","last_clean":"2023-07-21T22:55:39.424174+0000","last_became_active":"2023-07-21T22:55:39.421070+0000","last_became_peered":"2023-07-21T22:55:39.421070+0000","last_unstale":"2023-07-21T22:55:39.424174+0000","last_undegraded":"2023-07-21T22:55:39.424174+0000","last_fullsized":"2023-07-21T22:55:39.424174+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:10:42.306495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.403699+0000","last_change":"2023-07-21T22:55:39.403699+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.403699+0000","last_undegraded":"2023-07-21T22:55:39.403699+0000","last_fullsized":"2023-07-21T22:55:39.403699+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.414106+0000","last_change":"2023-07-21T22:55:39.410781+0000","last_active":"2023-07-21T22:55:39.414106+0000","last_peered":"2023-07-21T22:55:39.414106+0000","last_clean":"2023-07-21T22:55:39.414106+0000","last_became_active":"2023-07-21T22:55:39.410464+0000","last_became_peered":"2023-07-21T22:55:39.410464+0000","last_unstale":"2023-07-21T22:55:39.414106+0000","last_undegraded":"2023-07-21T22:55:39.414106+0000","last_fullsized":"2023-07-21T22:55:39.414106+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:33:38.264202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.398664+0000","last_change":"2023-07-21T22:55:39.398664+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.398664+0000","last_undegraded":"2023-07-21T22:55:39.398664+0000","last_fullsized":"2023-07-21T22:55:39.398664+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.415219+0000","last_change":"2023-07-21T22:55:39.414668+0000","last_active":"2023-07-21T22:55:39.415219+0000","last_peered":"2023-07-21T22:55:39.415219+0000","last_clean":"2023-07-21T22:55:39.415219+0000","last_became_active":"2023-07-21T22:55:39.414446+0000","last_became_peered":"2023-07-21T22:55:39.414446+0000","last_unstale":"2023-07-21T22:55:39.415219+0000","last_undegraded":"2023-07-21T22:55:39.415219+0000","last_fullsized":"2023-07-21T22:55:39.415219+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:43:53.073313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390838+0000","last_change":"2023-07-21T22:55:39.390838+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390838+0000","last_undegraded":"2023-07-21T22:55:39.390838+0000","last_fullsized":"2023-07-21T22:55:39.390838+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.411654+0000","last_change":"2023-07-21T22:55:39.410389+0000","last_active":"2023-07-21T22:55:39.411654+0000","last_peered":"2023-07-21T22:55:39.411654+0000","last_clean":"2023-07-21T22:55:39.411654+0000","last_became_active":"2023-07-21T22:55:39.410069+0000","last_became_peered":"2023-07-21T22:55:39.410069+0000","last_unstale":"2023-07-21T22:55:39.411654+0000","last_undegraded":"2023-07-21T22:55:39.411654+0000","last_fullsized":"2023-07-21T22:55:39.411654+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:57:24.219727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.405357+0000","last_change":"2023-07-21T22:55:39.405357+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.405357+0000","last_undegraded":"2023-07-21T22:55:39.405357+0000","last_fullsized":"2023-07-21T22:55:39.405357+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.414038+0000","last_change":"2023-07-21T22:55:39.409683+0000","last_active":"2023-07-21T22:55:39.414038+0000","last_peered":"2023-07-21T22:55:39.414038+0000","last_clean":"2023-07-21T22:55:39.414038+0000","last_became_active":"2023-07-21T22:55:39.409275+0000","last_became_peered":"2023-07-21T22:55:39.409275+0000","last_unstale":"2023-07-21T22:55:39.414038+0000","last_undegraded":"2023-07-21T22:55:39.414038+0000","last_fullsized":"2023-07-21T22:55:39.414038+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:22:24.546522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.401528+0000","last_change":"2023-07-21T22:55:39.401528+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.401528+0000","last_undegraded":"2023-07-21T22:55:39.401528+0000","last_fullsized":"2023-07-21T22:55:39.401528+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.409681+0000","last_change":"2023-07-21T22:55:39.408656+0000","last_active":"2023-07-21T22:55:39.409681+0000","last_peered":"2023-07-21T22:55:39.409681+0000","last_clean":"2023-07-21T22:55:39.409681+0000","last_became_active":"2023-07-21T22:55:39.408375+0000","last_became_peered":"2023-07-21T22:55:39.408375+0000","last_unstale":"2023-07-21T22:55:39.409681+0000","last_undegraded":"2023-07-21T22:55:39.409681+0000","last_fullsized":"2023-07-21T22:55:39.409681+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:37:46.249905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.393131+0000","last_change":"2023-07-21T22:55:39.393131+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.393131+0000","last_undegraded":"2023-07-21T22:55:39.393131+0000","last_fullsized":"2023-07-21T22:55:39.393131+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.408131+0000","last_change":"2023-07-21T22:55:39.405548+0000","last_active":"2023-07-21T22:55:39.408131+0000","last_peered":"2023-07-21T22:55:39.408131+0000","last_clean":"2023-07-21T22:55:39.408131+0000","last_became_active":"2023-07-21T22:55:39.405263+0000","last_became_peered":"2023-07-21T22:55:39.405263+0000","last_unstale":"2023-07-21T22:55:39.408131+0000","last_undegraded":"2023-07-21T22:55:39.408131+0000","last_fullsized":"2023-07-21T22:55:39.408131+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:25.424089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.411717+0000","last_change":"2023-07-21T22:55:39.411717+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.411717+0000","last_undegraded":"2023-07-21T22:55:39.411717+0000","last_fullsized":"2023-07-21T22:55:39.411717+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.413391+0000","last_change":"2023-07-21T22:55:39.410357+0000","last_active":"2023-07-21T22:55:39.413391+0000","last_peered":"2023-07-21T22:55:39.413391+0000","last_clean":"2023-07-21T22:55:39.413391+0000","last_became_active":"2023-07-21T22:55:39.410057+0000","last_became_peered":"2023-07-21T22:55:39.410057+0000","last_unstale":"2023-07-21T22:55:39.413391+0000","last_undegraded":"2023-07-21T22:55:39.413391+0000","last_fullsized":"2023-07-21T22:55:39.413391+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:17.185704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.403054+0000","last_change":"2023-07-21T22:55:39.403054+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.403054+0000","last_undegraded":"2023-07-21T22:55:39.403054+0000","last_fullsized":"2023-07-21T22:55:39.403054+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.408793+0000","last_change":"2023-07-21T22:55:39.408029+0000","last_active":"2023-07-21T22:55:39.408793+0000","last_peered":"2023-07-21T22:55:39.408793+0000","last_clean":"2023-07-21T22:55:39.408793+0000","last_became_active":"2023-07-21T22:55:39.407599+0000","last_became_peered":"2023-07-21T22:55:39.407599+0000","last_unstale":"2023-07-21T22:55:39.408793+0000","last_undegraded":"2023-07-21T22:55:39.408793+0000","last_fullsized":"2023-07-21T22:55:39.408793+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:47:28.521879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"161'304","reported_seq":1102,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.403239+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:55:39.403239+0000","last_peered":"2023-07-21T22:55:39.403239+0000","last_clean":"2023-07-21T22:55:39.403239+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:55:39.403239+0000","last_undegraded":"2023-07-21T22:55:39.403239+0000","last_fullsized":"2023-07-21T22:55:39.403239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:59:21.958943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":318,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.400239+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:55:39.400239+0000","last_peered":"2023-07-21T22:55:39.400239+0000","last_clean":"2023-07-21T22:55:39.400239+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:55:39.400239+0000","last_undegraded":"2023-07-21T22:55:39.400239+0000","last_fullsized":"2023-07-21T22:55:39.400239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:05.686648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.406020+0000","last_change":"2023-07-21T22:55:39.406020+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.406020+0000","last_undegraded":"2023-07-21T22:55:39.406020+0000","last_fullsized":"2023-07-21T22:55:39.406020+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.413420+0000","last_change":"2023-07-21T22:55:39.408771+0000","last_active":"2023-07-21T22:55:39.413420+0000","last_peered":"2023-07-21T22:55:39.413420+0000","last_clean":"2023-07-21T22:55:39.413420+0000","last_became_active":"2023-07-21T22:55:39.408492+0000","last_became_peered":"2023-07-21T22:55:39.408492+0000","last_unstale":"2023-07-21T22:55:39.413420+0000","last_undegraded":"2023-07-21T22:55:39.413420+0000","last_fullsized":"2023-07-21T22:55:39.413420+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:19:33.763010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":283,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.403087+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:55:39.403087+0000","last_peered":"2023-07-21T22:55:39.403087+0000","last_clean":"2023-07-21T22:55:39.403087+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:55:39.403087+0000","last_undegraded":"2023-07-21T22:55:39.403087+0000","last_fullsized":"2023-07-21T22:55:39.403087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:36:16.226544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.391374+0000","last_change":"2023-07-21T22:55:39.391374+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.391374+0000","last_undegraded":"2023-07-21T22:55:39.391374+0000","last_fullsized":"2023-07-21T22:55:39.391374+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.412261+0000","last_change":"2023-07-21T22:55:39.407686+0000","last_active":"2023-07-21T22:55:39.412261+0000","last_peered":"2023-07-21T22:55:39.412261+0000","last_clean":"2023-07-21T22:55:39.412261+0000","last_became_active":"2023-07-21T22:55:39.407414+0000","last_became_peered":"2023-07-21T22:55:39.407414+0000","last_unstale":"2023-07-21T22:55:39.412261+0000","last_undegraded":"2023-07-21T22:55:39.412261+0000","last_fullsized":"2023-07-21T22:55:39.412261+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:34:16.780319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":286,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.395421+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:55:39.395421+0000","last_peered":"2023-07-21T22:55:39.395421+0000","last_clean":"2023-07-21T22:55:39.395421+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:55:39.395421+0000","last_undegraded":"2023-07-21T22:55:39.395421+0000","last_fullsized":"2023-07-21T22:55:39.395421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:54:19.537921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390156+0000","last_change":"2023-07-21T22:55:39.390156+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390156+0000","last_undegraded":"2023-07-21T22:55:39.390156+0000","last_fullsized":"2023-07-21T22:55:39.390156+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.401574+0000","last_change":"2023-07-21T22:55:39.399053+0000","last_active":"2023-07-21T22:55:39.401574+0000","last_peered":"2023-07-21T22:55:39.401574+0000","last_clean":"2023-07-21T22:55:39.401574+0000","last_became_active":"2023-07-21T22:55:39.398779+0000","last_became_peered":"2023-07-21T22:55:39.398779+0000","last_unstale":"2023-07-21T22:55:39.401574+0000","last_undegraded":"2023-07-21T22:55:39.401574+0000","last_fullsized":"2023-07-21T22:55:39.401574+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:02:52.668876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":318,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.399640+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:55:39.399640+0000","last_peered":"2023-07-21T22:55:39.399640+0000","last_clean":"2023-07-21T22:55:39.399640+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:55:39.399640+0000","last_undegraded":"2023-07-21T22:55:39.399640+0000","last_fullsized":"2023-07-21T22:55:39.399640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:43:22.060057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.405829+0000","last_change":"2023-07-21T22:55:39.405829+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.405829+0000","last_undegraded":"2023-07-21T22:55:39.405829+0000","last_fullsized":"2023-07-21T22:55:39.405829+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.402349+0000","last_change":"2023-07-21T22:55:39.398435+0000","last_active":"2023-07-21T22:55:39.402349+0000","last_peered":"2023-07-21T22:55:39.402349+0000","last_clean":"2023-07-21T22:55:39.402349+0000","last_became_active":"2023-07-21T22:55:39.398171+0000","last_became_peered":"2023-07-21T22:55:39.398171+0000","last_unstale":"2023-07-21T22:55:39.402349+0000","last_undegraded":"2023-07-21T22:55:39.402349+0000","last_fullsized":"2023-07-21T22:55:39.402349+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:36.093425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":298,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.394565+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:55:39.394565+0000","last_peered":"2023-07-21T22:55:39.394565+0000","last_clean":"2023-07-21T22:55:39.394565+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:55:39.394565+0000","last_undegraded":"2023-07-21T22:55:39.394565+0000","last_fullsized":"2023-07-21T22:55:39.394565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:54:05.783821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.396061+0000","last_change":"2023-07-21T22:55:39.396061+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.396061+0000","last_undegraded":"2023-07-21T22:55:39.396061+0000","last_fullsized":"2023-07-21T22:55:39.396061+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.424121+0000","last_change":"2023-07-21T22:55:39.421220+0000","last_active":"2023-07-21T22:55:39.424121+0000","last_peered":"2023-07-21T22:55:39.424121+0000","last_clean":"2023-07-21T22:55:39.424121+0000","last_became_active":"2023-07-21T22:55:39.420898+0000","last_became_peered":"2023-07-21T22:55:39.420898+0000","last_unstale":"2023-07-21T22:55:39.424121+0000","last_undegraded":"2023-07-21T22:55:39.424121+0000","last_fullsized":"2023-07-21T22:55:39.424121+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:43:41.626753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":282,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.403123+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:55:39.403123+0000","last_peered":"2023-07-21T22:55:39.403123+0000","last_clean":"2023-07-21T22:55:39.403123+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:55:39.403123+0000","last_undegraded":"2023-07-21T22:55:39.403123+0000","last_fullsized":"2023-07-21T22:55:39.403123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:31:30.358830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.390327+0000","last_change":"2023-07-21T22:55:39.390327+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.390327+0000","last_undegraded":"2023-07-21T22:55:39.390327+0000","last_fullsized":"2023-07-21T22:55:39.390327+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.412393+0000","last_change":"2023-07-21T22:55:39.407762+0000","last_active":"2023-07-21T22:55:39.412393+0000","last_peered":"2023-07-21T22:55:39.412393+0000","last_clean":"2023-07-21T22:55:39.412393+0000","last_became_active":"2023-07-21T22:55:39.407480+0000","last_became_peered":"2023-07-21T22:55:39.407480+0000","last_unstale":"2023-07-21T22:55:39.412393+0000","last_undegraded":"2023-07-21T22:55:39.412393+0000","last_fullsized":"2023-07-21T22:55:39.412393+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:11:42.677965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":298,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.393672+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:55:39.393672+0000","last_peered":"2023-07-21T22:55:39.393672+0000","last_clean":"2023-07-21T22:55:39.393672+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:55:39.393672+0000","last_undegraded":"2023-07-21T22:55:39.393672+0000","last_fullsized":"2023-07-21T22:55:39.393672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:57:19.939012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":1,"reported_epoch":172,"state":"creating+peering","last_fresh":"2023-07-21T22:55:39.395164+0000","last_change":"2023-07-21T22:55:39.395164+0000","last_active":"2023-07-21T22:55:39.373623+0000","last_peered":"2023-07-21T22:55:39.373623+0000","last_clean":"2023-07-21T22:55:39.373623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:55:39.395164+0000","last_undegraded":"2023-07-21T22:55:39.395164+0000","last_fullsized":"2023-07-21T22:55:39.395164+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.412302+0000","last_change":"2023-07-21T22:55:39.408717+0000","last_active":"2023-07-21T22:55:39.412302+0000","last_peered":"2023-07-21T22:55:39.412302+0000","last_clean":"2023-07-21T22:55:39.412302+0000","last_became_active":"2023-07-21T22:55:39.408445+0000","last_became_peered":"2023-07-21T22:55:39.408445+0000","last_unstale":"2023-07-21T22:55:39.412302+0000","last_undegraded":"2023-07-21T22:55:39.412302+0000","last_fullsized":"2023-07-21T22:55:39.412302+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:03:08.912070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":280,"reported_epoch":172,"state":"active+clean","last_fresh":"2023-07-21T22:55:39.406693+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:55:39.406693+0000","last_peered":"2023-07-21T22:55:39.406693+0000","last_clean":"2023-07-21T22:55:39.406693+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:55:39.406693+0000","last_undegraded":"2023-07-21T22:55:39.406693+0000","last_fullsized":"2023-07-21T22:55:39.406693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:25:05.889779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509880,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59944,"kb_used_data":2656,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94311896,"statfs":{"total":96636764160,"available":96575381504,"internally_reserved":0,"allocated":2719744,"data_stored":1676913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.76300000000000001,"15min":0.76400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.34999999999999998},"max":{"1min":0.89300000000000002,"5min":1.032,"15min":1.143},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71599999999999997,"15min":0.71799999999999997},"min":{"1min":0.54700000000000004,"5min":0.47999999999999998,"15min":0.39000000000000001},"max":{"1min":0.875,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.61899999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.749,"15min":0.76400000000000001},"min":{"1min":0.55800000000000005,"5min":0.53400000000000003,"15min":0.40600000000000003},"max":{"1min":0.86199999999999999,"5min":0.96599999999999997,"15min":1.0820000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73899999999999999,"15min":0.746},"min":{"1min":0.51500000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94399999999999995,"5min":0.97299999999999998,"15min":1.02},"last":0.752}]},{"osd":2,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75,"15min":0.76000000000000001},"min":{"1min":0.61099999999999999,"5min":0.54800000000000004,"15min":0.47999999999999998},"max":{"1min":0.89500000000000002,"5min":1.0049999999999999,"15min":1.0780000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.624,"5min":0.51100000000000001,"15min":0.42299999999999999},"max":{"1min":0.93100000000000005,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.63700000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77300000000000002,"15min":0.78000000000000003},"min":{"1min":0.61199999999999999,"5min":0.48399999999999999,"15min":0.45600000000000002},"max":{"1min":0.88300000000000001,"5min":1.077,"15min":1.0980000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77700000000000002,"15min":0.77900000000000003},"min":{"1min":0.64900000000000002,"5min":0.57699999999999996,"15min":0.53400000000000003},"max":{"1min":0.92800000000000005,"5min":1.026,"15min":1.036},"last":0.82499999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.34999999999999998},"max":{"1min":0.68300000000000005,"5min":0.81299999999999994,"15min":0.89700000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59099999999999997,"15min":0.60599999999999998},"min":{"1min":0.439,"5min":0.38500000000000001,"15min":0.34699999999999998},"max":{"1min":0.83299999999999996,"5min":0.88,"15min":1.0940000000000001},"last":0.80200000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58699999999999997,"15min":0.60599999999999998},"min":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.41199999999999998},"max":{"1min":0.81000000000000005,"5min":0.88300000000000001,"15min":0.99399999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65800000000000003,"15min":0.66600000000000004},"min":{"1min":0.48599999999999999,"5min":0.433,"15min":0.40699999999999997},"max":{"1min":0.84999999999999998,"5min":1.0129999999999999,"15min":1.077},"last":0.89200000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:54:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.51900000000000002,"5min":0.47999999999999998,"15min":0.45500000000000002},"max":{"1min":0.81299999999999994,"5min":0.91100000000000003,"15min":0.97399999999999998},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.63300000000000001,"15min":0.63100000000000001},"min":{"1min":0.47999999999999998,"5min":0.41299999999999998,"15min":0.41099999999999998},"max":{"1min":0.86699999999999999,"5min":0.871,"15min":1.105},"last":1.1539999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542586,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37220,"kb_used_data":2076,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334620,"statfs":{"total":96636764160,"available":96598650880,"internally_reserved":0,"allocated":2125824,"data_stored":1086545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0009999999999999,"5min":1.024,"15min":1.024},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80200000000000005,"15min":0.80800000000000005},"min":{"1min":0.63800000000000001,"5min":0.58299999999999996,"15min":0.54000000000000004},"max":{"1min":1,"5min":1,"15min":1.0780000000000001},"last":0.72999999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.51400000000000001,"5min":0.51000000000000001,"15min":0.50900000000000001},"max":{"1min":0.96199999999999997,"5min":0.96599999999999997,"15min":1.006},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.54200000000000004,"5min":0.48899999999999999,"15min":0.42499999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78500000000000003,"15min":0.78300000000000003},"min":{"1min":0.59599999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.92100000000000004,"5min":1.002,"15min":1.0409999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.80900000000000005,"15min":0.80600000000000005},"min":{"1min":0.61299999999999999,"5min":0.498,"15min":0.46600000000000003},"max":{"1min":0.98799999999999999,"5min":1.0089999999999999,"15min":1.0600000000000001},"last":0.61499999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.754,"15min":0.754},"min":{"1min":0.66600000000000004,"5min":0.53000000000000003,"15min":0.48999999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76200000000000001,"15min":0.753},"min":{"1min":0.58799999999999997,"5min":0.53300000000000003,"15min":0.52300000000000002},"max":{"1min":0.93000000000000005,"5min":0.96199999999999997,"15min":1.0389999999999999},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.92300000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.46400000000000002,"5min":0.41899999999999998,"15min":0.33500000000000002},"max":{"1min":0.93600000000000005,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65200000000000002,"15min":0.64700000000000002},"min":{"1min":0.503,"5min":0.44600000000000001,"15min":0.38900000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.96299999999999997},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.66100000000000003},"min":{"1min":0.46300000000000002,"5min":0.45600000000000002,"15min":0.38700000000000001},"max":{"1min":0.81999999999999995,"5min":0.91600000000000004,"15min":1.0129999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48299999999999998,"5min":0.46800000000000003,"15min":0.432},"max":{"1min":0.90000000000000002,"5min":0.96299999999999997,"15min":1.0780000000000001},"last":0.57899999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509879,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55280,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316560,"statfs":{"total":96636764160,"available":96580157440,"internally_reserved":0,"allocated":2138112,"data_stored":1093245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.57599999999999996,"5min":0.39200000000000002,"15min":0.32100000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.73099999999999998},"min":{"1min":0.53300000000000003,"5min":0.432,"15min":0.41499999999999998},"max":{"1min":0.91300000000000003,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.67300000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.74299999999999999,"15min":0.73299999999999998},"min":{"1min":0.60799999999999998,"5min":0.495,"15min":0.42399999999999999},"max":{"1min":0.89000000000000001,"5min":0.999,"15min":1.0289999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.745,"15min":0.73999999999999999},"min":{"1min":0.60599999999999998,"5min":0.45800000000000002,"15min":0.42999999999999999},"max":{"1min":0.97999999999999998,"5min":1.054,"15min":1.054},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.752,"15min":0.752},"min":{"1min":0.64300000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88400000000000001,"5min":1.119,"15min":1.119},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.75700000000000001,"15min":0.748},"min":{"1min":0.57799999999999996,"5min":0.53600000000000003,"15min":0.49299999999999999},"max":{"1min":0.95699999999999996,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.79900000000000004,"15min":0.78500000000000003},"min":{"1min":0.69199999999999995,"5min":0.61499999999999999,"15min":0.47299999999999998},"max":{"1min":1.0009999999999999,"5min":1.169,"15min":1.169},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80000000000000004,"15min":0.80700000000000005},"min":{"1min":0.56399999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0169999999999999,"5min":1.0409999999999999,"15min":1.0429999999999999},"last":0.64900000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84799999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.47399999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97999999999999998,"5min":1.01,"15min":1.0369999999999999},"last":0.78100000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.59099999999999997},"min":{"1min":0.47999999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91900000000000004,"5min":0.93600000000000005,"15min":1.0629999999999999},"last":0.76100000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63600000000000001,"15min":0.65000000000000002},"min":{"1min":0.45700000000000002,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":0.95899999999999996,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72399999999999998,"15min":0.72099999999999997},"min":{"1min":0.51000000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.84299999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509880,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37232,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334608,"statfs":{"total":96636764160,"available":96598638592,"internally_reserved":0,"allocated":2138112,"data_stored":1093245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.73799999999999999,"15min":0.75800000000000001},"min":{"1min":0.64500000000000002,"5min":0.41299999999999998,"15min":0.34599999999999997},"max":{"1min":0.93500000000000005,"5min":0.94199999999999995,"15min":1.0509999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.35299999999999998},"max":{"1min":0.96899999999999997,"5min":1.006,"15min":1.03},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.72299999999999998,"15min":0.72599999999999998},"min":{"1min":0.55800000000000005,"5min":0.502,"15min":0.432},"max":{"1min":1.0229999999999999,"5min":1.089,"15min":1.089},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.54400000000000004,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":0.871,"5min":0.97599999999999998,"15min":1.0129999999999999},"last":0.68600000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79100000000000004,"15min":0.78500000000000003},"min":{"1min":0.625,"5min":0.59899999999999998,"15min":0.46899999999999997},"max":{"1min":0.95099999999999996,"5min":1.292,"15min":1.292},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.65100000000000002,"5min":0.51300000000000001,"15min":0.501},"max":{"1min":0.99099999999999999,"5min":1.038,"15min":1.038},"last":0.752}]},{"osd":3,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.752,"15min":0.747},"min":{"1min":0.68999999999999995,"5min":0.51400000000000001,"15min":0.49299999999999999},"max":{"1min":1.0069999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.70399999999999996,"5min":0.61399999999999999,"15min":0.54200000000000004},"max":{"1min":0.98399999999999999,"5min":1.218,"15min":1.218},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.371},"max":{"1min":0.70399999999999996,"5min":1.028,"15min":1.028},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.59499999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.93300000000000005,"5min":1.151,"15min":1.151},"last":0.91900000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65300000000000002,"15min":0.65500000000000003},"min":{"1min":0.45800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93400000000000005,"5min":1.252,"15min":1.252},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.39100000000000001},"max":{"1min":0.80500000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.88200000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89300000000000002,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68600000000000005,"15min":0.68200000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.42999999999999999},"max":{"1min":0.83999999999999997,"5min":1.206,"15min":1.206},"last":0.83999999999999997}]}]},{"osd":3,"up_from":15,"seq":64424509879,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37232,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334608,"statfs":{"total":96636764160,"available":96598638592,"internally_reserved":0,"allocated":2138112,"data_stored":1093245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52500000000000002,"15min":0.505},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.27900000000000003},"max":{"1min":0.746,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.46000000000000002,"5min":0.441,"15min":0.39300000000000002},"max":{"1min":0.68100000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53200000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.64300000000000002,"5min":0.71399999999999997,"15min":0.81599999999999995},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.35599999999999998},"max":{"1min":0.68700000000000006,"5min":0.79100000000000004,"15min":0.93899999999999995},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.45100000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72199999999999998,"5min":0.83199999999999996,"15min":1.0249999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.36299999999999999},"max":{"1min":0.76500000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48099999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.78300000000000003,"15min":0.78900000000000003},"min":{"1min":0.53300000000000003,"5min":0.441,"15min":0.441},"max":{"1min":1.071,"5min":1.101,"15min":1.343},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84599999999999997,"15min":0.85099999999999998},"min":{"1min":0.63100000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.002,"5min":1.119,"15min":1.373},"last":0.67700000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79800000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.99099999999999999,"5min":1.085,"15min":1.3799999999999999},"last":0.746},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80300000000000005,"15min":0.81000000000000005},"min":{"1min":0.69099999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94699999999999995,"5min":1.087,"15min":1.2230000000000001},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.81599999999999995},"min":{"1min":0.61799999999999999,"5min":0.55700000000000005,"15min":0.55300000000000005},"max":{"1min":1.0249999999999999,"5min":1.127,"15min":1.2689999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53000000000000003},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.3660000000000001},"last":0.70699999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83199999999999996,"15min":0.83499999999999996},"min":{"1min":0.56399999999999995,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":1.0109999999999999,"5min":1.1399999999999999,"15min":1.4510000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84099999999999997,"15min":0.85499999999999998},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.57299999999999995},"max":{"1min":1.0489999999999999,"5min":1.0820000000000001,"15min":1.427},"last":0.61399999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509881,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55280,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316560,"statfs":{"total":96636764160,"available":96580157440,"internally_reserved":0,"allocated":2138112,"data_stored":1093245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.502,"15min":0.502},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.26500000000000001},"max":{"1min":0.72699999999999998,"5min":0.73999999999999999,"15min":1.0680000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.377},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":1.0780000000000001},"last":0.52800000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.437,"5min":0.38800000000000001,"15min":0.35599999999999998},"max":{"1min":0.751,"5min":0.86199999999999999,"15min":0.90300000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.60699999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.752,"5min":0.89100000000000001,"15min":0.91300000000000003},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.495,"15min":0.5},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.65900000000000003,"5min":0.71099999999999997,"15min":0.92800000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.42099999999999999,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.81899999999999995,"15min":0.95399999999999996},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.81100000000000005,"15min":0.81499999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.002,"5min":1.1839999999999999,"15min":1.2809999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81699999999999995,"15min":0.82799999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.439},"max":{"1min":1.1359999999999999,"5min":1.391,"15min":1.391},"last":0.69199999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81000000000000005,"15min":0.81799999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98999999999999999,"5min":1.218,"15min":1.218},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.81999999999999995,"15min":0.83499999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.47499999999999998},"max":{"1min":1.0660000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.81499999999999995,"15min":0.82199999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.495},"max":{"1min":1.048,"5min":1.262,"15min":1.2969999999999999},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.627,"5min":0.55600000000000005,"15min":0.55500000000000005},"max":{"1min":1.085,"5min":1.214,"15min":1.2390000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83099999999999996,"15min":0.84499999999999997},"min":{"1min":0.65600000000000003,"5min":0.60199999999999998,"15min":0.51300000000000001},"max":{"1min":1.1200000000000001,"5min":1.2629999999999999,"15min":1.3360000000000001},"last":0.623},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82799999999999996,"15min":0.84399999999999997},"min":{"1min":0.60599999999999998,"5min":0.57999999999999996,"15min":0.54400000000000004},"max":{"1min":1.101,"5min":1.335,"15min":1.3939999999999999},"last":0.745}]}]},{"osd":1,"up_from":15,"seq":64424509880,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37232,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334608,"statfs":{"total":96636764160,"available":96598638592,"internally_reserved":0,"allocated":2138112,"data_stored":1093245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.5,"15min":0.501},"min":{"1min":0.34899999999999998,"5min":0.30499999999999999,"15min":0.30399999999999999},"max":{"1min":0.57099999999999995,"5min":0.76200000000000001,"15min":0.86499999999999999},"last":0.251},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.59799999999999998},"min":{"1min":0.46300000000000002,"5min":0.437,"15min":0.437},"max":{"1min":0.751,"5min":0.874,"15min":0.876},"last":0.53500000000000003}]},{"osd":2,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.52700000000000002,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.64400000000000002,"5min":0.80800000000000005,"15min":0.82799999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39900000000000002,"5min":0.38900000000000001,"15min":0.373},"max":{"1min":0.72399999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60099999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61499999999999999,"15min":0.61399999999999999},"min":{"1min":0.46100000000000002,"5min":0.438,"15min":0.43099999999999999},"max":{"1min":0.71599999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35099999999999998},"max":{"1min":0.62,"5min":0.77700000000000002,"15min":0.86199999999999999},"last":0.42999999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80000000000000004,"15min":0.80100000000000005},"min":{"1min":0.53700000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1040000000000001,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82199999999999995,"15min":0.82599999999999996},"min":{"1min":0.69299999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1180000000000001,"5min":1.2350000000000001,"15min":1.302},"last":0.70999999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.81699999999999995,"15min":0.81000000000000005},"min":{"1min":0.59299999999999997,"5min":0.52900000000000003,"15min":0.499},"max":{"1min":1.153,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81499999999999995,"15min":0.81999999999999995},"min":{"1min":0.57399999999999995,"5min":0.51800000000000002,"15min":0.48799999999999999},"max":{"1min":1.171,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.57599999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.83399999999999996,"15min":0.82899999999999996},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.59699999999999998},"max":{"1min":1.083,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.747},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80500000000000005,"15min":0.81799999999999995},"min":{"1min":0.64100000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.034,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.50900000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.82999999999999996,"15min":0.83899999999999997},"min":{"1min":0.60799999999999998,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.1040000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.626},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.83499999999999996},"min":{"1min":0.67100000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.131,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.72899999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509882,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37812,"kb_used_data":2668,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334028,"statfs":{"total":96636764160,"available":96598044672,"internally_reserved":0,"allocated":2732032,"data_stored":1683613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.498,"15min":0.48399999999999999},"min":{"1min":0.36699999999999999,"5min":0.29999999999999999,"15min":0.28499999999999998},"max":{"1min":0.79200000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.38300000000000001,"5min":0.32800000000000001,"15min":0.29799999999999999},"max":{"1min":0.79500000000000004,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.52600000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.42899999999999999,"5min":0.378,"15min":0.35899999999999999},"max":{"1min":0.74199999999999999,"5min":0.80900000000000005,"15min":0.87},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38400000000000001,"5min":0.35799999999999998,"15min":0.33900000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.442}]},{"osd":3,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.622,"15min":0.61899999999999999},"min":{"1min":0.504,"5min":0.47599999999999998,"15min":0.441},"max":{"1min":0.77200000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.46999999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.98599999999999999},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.67500000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.018,"5min":1.081,"15min":1.4370000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.63800000000000001,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2789999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.81699999999999995,"15min":0.81899999999999995},"min":{"1min":0.61099999999999999,"5min":0.60799999999999998,"15min":0.56599999999999995},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.88,"5min":0.86399999999999999,"15min":0.84999999999999998},"min":{"1min":0.68500000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1140000000000001,"5min":1.206,"15min":1.351},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.85699999999999998,"15min":0.86199999999999999},"min":{"1min":0.70699999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.121,"5min":1.1739999999999999,"15min":1.385},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.84799999999999998,"15min":0.84299999999999997},"min":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.60299999999999998},"max":{"1min":1.091,"5min":1.165,"15min":1.347},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.82899999999999996,"15min":0.83399999999999996},"min":{"1min":0.624,"5min":0.624,"15min":0.54100000000000004},"max":{"1min":1.0980000000000001,"5min":1.1100000000000001,"15min":1.3180000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.86599999999999999,"15min":0.878},"min":{"1min":0.66200000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.411},"last":0.622}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:55:48.210 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:55:48.216 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:55:49.164 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:55:49.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.285+0000 7f6df1e7b640 1 Processor -- start 2023-07-21T22:55:49.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.285+0000 7f6df1e7b640 1 -- start start 2023-07-21T22:55:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.285+0000 7f6df1e7b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6dec15b7c0 0x7f6dec06b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.285+0000 7f6df1e7b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6dec06b720 0x7f6dec0ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.285+0000 7f6df1e7b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dec06f900 con 0x7f6dec0cb780 2023-07-21T22:55:49.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.285+0000 7f6df1e7b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dec0cdce0 con 0x7f6dec15b7c0 2023-07-21T22:55:49.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.285+0000 7f6df1e7b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec0ca830 con 0x7f6dec06b720 2023-07-21T22:55:49.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.285+0000 7f6deb7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6dec15b7c0 0x7f6dec06b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:49.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.285+0000 7f6debfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6dec06b720 0x7f6dec0ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:49.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.285+0000 7f6deb7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6dec15b7c0 0x7f6dec06b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:44008/0 (socket says 172.21.15.6:44008) 2023-07-21T22:55:49.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.285+0000 7f6deb7fe640 1 -- 172.21.15.6:0/2864643213 learned_addr learned my addr 172.21.15.6:0/2864643213 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:49.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.289+0000 7f6deb7fe640 1 -- 172.21.15.6:0/2864643213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6dec06b720 msgr2=0x7f6dec0ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:49.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.289+0000 7f6deb7fe640 1 --2- 172.21.15.6:0/2864643213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6dec06b720 0x7f6dec0ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.289+0000 7f6deb7fe640 1 -- 172.21.15.6:0/2864643213 >> v1:172.21.15.161:6789/0 conn(0x7f6dec0cb780 legacy=0x7f6dec06fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:49.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.289+0000 7f6deb7fe640 1 -- 172.21.15.6:0/2864643213 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec15bb90 con 0x7f6dec15b7c0 2023-07-21T22:55:49.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.289+0000 7f6deb7fe640 1 --2- 172.21.15.6:0/2864643213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dec15b7c0 0x7f6dec06b1e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc00aa10 tx=0x7f6ddc01ea20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31675a702b282a59 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:49.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.289+0000 7f6dea7fc640 1 -- 172.21.15.6:0/2864643213 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc0a7960 con 0x7f6dec15b7c0 2023-07-21T22:55:49.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.289+0000 7f6dea7fc640 1 -- 172.21.15.6:0/2864643213 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ddc0a7ac0 con 0x7f6dec15b7c0 2023-07-21T22:55:49.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.289+0000 7f6dea7fc640 1 -- 172.21.15.6:0/2864643213 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc0a7e50 con 0x7f6dec15b7c0 2023-07-21T22:55:49.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.289+0000 7f6df1e7b640 1 -- 172.21.15.6:0/2864643213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dec15b7c0 msgr2=0x7f6dec06b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:49.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.289+0000 7f6df1e7b640 1 --2- 172.21.15.6:0/2864643213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dec15b7c0 0x7f6dec06b1e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc00aa10 tx=0x7f6ddc01ea20 comp rx=0 tx=0).stop 2023-07-21T22:55:49.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.289+0000 7f6df1e7b640 1 -- 172.21.15.6:0/2864643213 shutdown_connections 2023-07-21T22:55:49.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.289+0000 7f6df1e7b640 1 --2- 172.21.15.6:0/2864643213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6dec06b720 0x7f6dec0ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.289+0000 7f6df1e7b640 1 --2- 172.21.15.6:0/2864643213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dec15b7c0 0x7f6dec06b1e0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.289+0000 7f6df1e7b640 1 -- 172.21.15.6:0/2864643213 >> 172.21.15.6:0/2864643213 conn(0x7f6dec0afcf0 msgr2=0x7f6dec0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:49.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6df1e7b640 1 -- 172.21.15.6:0/2864643213 shutdown_connections 2023-07-21T22:55:49.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6df1e7b640 1 -- 172.21.15.6:0/2864643213 wait complete. 2023-07-21T22:55:49.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6df1e7b640 1 Processor -- start 2023-07-21T22:55:49.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6df1e7b640 1 -- start start 2023-07-21T22:55:49.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6df1e7b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6dec06b720 0x7f6dec152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:49.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6df1e7b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dec15b7c0 0x7f6dec14d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:49.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6df1e7b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dec14f0c0 0x7f6dec0c5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:49.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6df1e7b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec14deb0 con 0x7f6dec15b7c0 2023-07-21T22:55:49.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6df1e7b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec14d9f0 con 0x7f6dec14f0c0 2023-07-21T22:55:49.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6df1e7b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec0c7d00 con 0x7f6dec06b720 2023-07-21T22:55:49.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6deaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dec15b7c0 0x7f6dec14d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:49.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6deaffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dec15b7c0 0x7f6dec14d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52132/0 (socket says 172.21.15.6:52132) 2023-07-21T22:55:49.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6deaffd640 1 -- 172.21.15.6:0/3957801720 learned_addr learned my addr 172.21.15.6:0/3957801720 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:49.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6deb7fe640 1 --2- 172.21.15.6:0/3957801720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6dec06b720 0x7f6dec152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:49.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6debfff640 1 --2- 172.21.15.6:0/3957801720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dec14f0c0 0x7f6dec0c5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:49.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6deaffd640 1 -- 172.21.15.6:0/3957801720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6dec06b720 msgr2=0x7f6dec152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:49.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6deaffd640 1 --2- 172.21.15.6:0/3957801720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6dec06b720 0x7f6dec152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6deaffd640 1 -- 172.21.15.6:0/3957801720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dec14f0c0 msgr2=0x7f6dec0c5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:49.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6deaffd640 1 --2- 172.21.15.6:0/3957801720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dec14f0c0 0x7f6dec0c5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6deaffd640 1 -- 172.21.15.6:0/3957801720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc00a670 con 0x7f6dec15b7c0 2023-07-21T22:55:49.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.293+0000 7f6deaffd640 1 --2- 172.21.15.6:0/3957801720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dec15b7c0 0x7f6dec14d4b0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f6de000c430 tx=0x7f6de000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:49.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.297+0000 7f6dd3fff640 1 -- 172.21.15.6:0/3957801720 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de00052d0 con 0x7f6dec15b7c0 2023-07-21T22:55:49.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.297+0000 7f6dd3fff640 1 -- 172.21.15.6:0/3957801720 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de0005430 con 0x7f6dec15b7c0 2023-07-21T22:55:49.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.297+0000 7f6dd3fff640 1 -- 172.21.15.6:0/3957801720 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de0007260 con 0x7f6dec15b7c0 2023-07-21T22:55:49.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.297+0000 7f6df1e7b640 1 -- 172.21.15.6:0/3957801720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dec14db60 con 0x7f6dec15b7c0 2023-07-21T22:55:49.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.297+0000 7f6df1e7b640 1 -- 172.21.15.6:0/3957801720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dec0c7f50 con 0x7f6dec15b7c0 2023-07-21T22:55:49.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.297+0000 7f6df1e7b640 1 -- 172.21.15.6:0/3957801720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dec14dff0 con 0x7f6dec15b7c0 2023-07-21T22:55:49.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.297+0000 7f6dd3fff640 1 -- 172.21.15.6:0/3957801720 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6de00073c0 con 0x7f6dec15b7c0 2023-07-21T22:55:49.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.297+0000 7f6dd3fff640 1 --2- 172.21.15.6:0/3957801720 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f6dd80663a0 0x7f6dd8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:49.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.297+0000 7f6dd3fff640 1 -- 172.21.15.6:0/3957801720 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f6de0083240 con 0x7f6dec15b7c0 2023-07-21T22:55:49.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.297+0000 7f6deb7fe640 1 --2- 172.21.15.6:0/3957801720 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f6dd80663a0 0x7f6dd8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:49.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.301+0000 7f6deb7fe640 1 --2- 172.21.15.6:0/3957801720 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f6dd80663a0 0x7f6dd8068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc0b1000 tx=0x7f6ddc0a9070 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:49.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.301+0000 7f6dd3fff640 1 -- 172.21.15.6:0/3957801720 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6dec14dff0 con 0x7f6dec15b7c0 2023-07-21T22:55:49.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.457+0000 7f6df1e7b640 1 -- 172.21.15.6:0/3957801720 --> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6dec06f590 con 0x7f6dd80663a0 2023-07-21T22:55:49.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.465+0000 7f6dd3fff640 1 -- 172.21.15.6:0/3957801720 <== mgr.9289 v2:172.21.15.161:6832/2346358146 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311881 (secure 0 0 0) 0x7f6ddc0a7940 con 0x7f6dd80663a0 2023-07-21T22:55:49.502 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:49.503 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:55:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.469+0000 7f6df1e7b640 1 -- 172.21.15.6:0/3957801720 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f6dd80663a0 msgr2=0x7f6dd8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.469+0000 7f6df1e7b640 1 --2- 172.21.15.6:0/3957801720 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f6dd80663a0 0x7f6dd8068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc0b1000 tx=0x7f6ddc0a9070 comp rx=0 tx=0).stop 2023-07-21T22:55:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.469+0000 7f6df1e7b640 1 -- 172.21.15.6:0/3957801720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dec15b7c0 msgr2=0x7f6dec14d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.469+0000 7f6df1e7b640 1 --2- 172.21.15.6:0/3957801720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dec15b7c0 0x7f6dec14d4b0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f6de000c430 tx=0x7f6de000c8f0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.469+0000 7f6df1e7b640 1 -- 172.21.15.6:0/3957801720 shutdown_connections 2023-07-21T22:55:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.469+0000 7f6df1e7b640 1 --2- 172.21.15.6:0/3957801720 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f6dd80663a0 0x7f6dd8068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.469+0000 7f6df1e7b640 1 --2- 172.21.15.6:0/3957801720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6dec14f0c0 0x7f6dec0c5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.469+0000 7f6df1e7b640 1 --2- 172.21.15.6:0/3957801720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6dec15b7c0 0x7f6dec14d4b0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.469+0000 7f6df1e7b640 1 --2- 172.21.15.6:0/3957801720 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6dec06b720 0x7f6dec152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.469+0000 7f6df1e7b640 1 -- 172.21.15.6:0/3957801720 >> 172.21.15.6:0/3957801720 conn(0x7f6dec0afcf0 msgr2=0x7f6dec0aefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:49.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.469+0000 7f6df1e7b640 1 -- 172.21.15.6:0/3957801720 shutdown_connections 2023-07-21T22:55:49.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.469+0000 7f6df1e7b640 1 -- 172.21.15.6:0/3957801720 wait complete. 2023-07-21T22:55:49.523 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-21T22:55:48.146363+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":544,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":343,"ondisk_log_size":343,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":357512,"kb_used_data":18120,"kb_used_omap":0,"kb_used_meta":339328,"kb_avail":754617208,"statfs":{"total":773094113280,"available":772728020992,"internally_reserved":0,"allocated":18554880,"data_stored":10042820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":347471872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002120"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.411721+0000","last_change":"2023-07-21T22:55:40.412368+0000","last_active":"2023-07-21T22:55:41.411721+0000","last_peered":"2023-07-21T22:55:41.411721+0000","last_clean":"2023-07-21T22:55:41.411721+0000","last_became_active":"2023-07-21T22:55:40.412048+0000","last_became_peered":"2023-07-21T22:55:40.412048+0000","last_unstale":"2023-07-21T22:55:41.411721+0000","last_undegraded":"2023-07-21T22:55:41.411721+0000","last_fullsized":"2023-07-21T22:55:41.411721+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:24:55.668646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.403549+0000","last_change":"2023-07-21T22:55:40.420767+0000","last_active":"2023-07-21T22:55:41.403549+0000","last_peered":"2023-07-21T22:55:41.403549+0000","last_clean":"2023-07-21T22:55:41.403549+0000","last_became_active":"2023-07-21T22:55:40.420350+0000","last_became_peered":"2023-07-21T22:55:40.420350+0000","last_unstale":"2023-07-21T22:55:41.403549+0000","last_undegraded":"2023-07-21T22:55:41.403549+0000","last_fullsized":"2023-07-21T22:55:41.403549+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:59:07.234232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.403334+0000","last_change":"2023-07-21T22:55:40.414615+0000","last_active":"2023-07-21T22:55:41.403334+0000","last_peered":"2023-07-21T22:55:41.403334+0000","last_clean":"2023-07-21T22:55:41.403334+0000","last_became_active":"2023-07-21T22:55:40.414314+0000","last_became_peered":"2023-07-21T22:55:40.414314+0000","last_unstale":"2023-07-21T22:55:41.403334+0000","last_undegraded":"2023-07-21T22:55:41.403334+0000","last_fullsized":"2023-07-21T22:55:41.403334+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:06:13.283045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.443395+0000","last_change":"2023-07-21T22:55:40.420063+0000","last_active":"2023-07-21T22:55:41.443395+0000","last_peered":"2023-07-21T22:55:41.443395+0000","last_clean":"2023-07-21T22:55:41.443395+0000","last_became_active":"2023-07-21T22:55:40.419592+0000","last_became_peered":"2023-07-21T22:55:40.419592+0000","last_unstale":"2023-07-21T22:55:41.443395+0000","last_undegraded":"2023-07-21T22:55:41.443395+0000","last_fullsized":"2023-07-21T22:55:41.443395+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:00:24.607183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.437176+0000","last_change":"2023-07-21T22:55:40.407862+0000","last_active":"2023-07-21T22:55:41.437176+0000","last_peered":"2023-07-21T22:55:41.437176+0000","last_clean":"2023-07-21T22:55:41.437176+0000","last_became_active":"2023-07-21T22:55:40.407570+0000","last_became_peered":"2023-07-21T22:55:40.407570+0000","last_unstale":"2023-07-21T22:55:41.437176+0000","last_undegraded":"2023-07-21T22:55:41.437176+0000","last_fullsized":"2023-07-21T22:55:41.437176+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:09:06.744437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436316+0000","last_change":"2023-07-21T22:55:40.403000+0000","last_active":"2023-07-21T22:55:41.436316+0000","last_peered":"2023-07-21T22:55:41.436316+0000","last_clean":"2023-07-21T22:55:41.436316+0000","last_became_active":"2023-07-21T22:55:40.402622+0000","last_became_peered":"2023-07-21T22:55:40.402622+0000","last_unstale":"2023-07-21T22:55:41.436316+0000","last_undegraded":"2023-07-21T22:55:41.436316+0000","last_fullsized":"2023-07-21T22:55:41.436316+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:28:21.577327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.411184+0000","last_change":"2023-07-21T22:55:40.422032+0000","last_active":"2023-07-21T22:55:41.411184+0000","last_peered":"2023-07-21T22:55:41.411184+0000","last_clean":"2023-07-21T22:55:41.411184+0000","last_became_active":"2023-07-21T22:55:40.421500+0000","last_became_peered":"2023-07-21T22:55:40.421500+0000","last_unstale":"2023-07-21T22:55:41.411184+0000","last_undegraded":"2023-07-21T22:55:41.411184+0000","last_fullsized":"2023-07-21T22:55:41.411184+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:00:01.268022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.411801+0000","last_change":"2023-07-21T22:55:40.409873+0000","last_active":"2023-07-21T22:55:41.411801+0000","last_peered":"2023-07-21T22:55:41.411801+0000","last_clean":"2023-07-21T22:55:41.411801+0000","last_became_active":"2023-07-21T22:55:40.409620+0000","last_became_peered":"2023-07-21T22:55:40.409620+0000","last_unstale":"2023-07-21T22:55:41.411801+0000","last_undegraded":"2023-07-21T22:55:41.411801+0000","last_fullsized":"2023-07-21T22:55:41.411801+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:58:45.459920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.437162+0000","last_change":"2023-07-21T22:55:40.419727+0000","last_active":"2023-07-21T22:55:41.437162+0000","last_peered":"2023-07-21T22:55:41.437162+0000","last_clean":"2023-07-21T22:55:41.437162+0000","last_became_active":"2023-07-21T22:55:40.415130+0000","last_became_peered":"2023-07-21T22:55:40.415130+0000","last_unstale":"2023-07-21T22:55:41.437162+0000","last_undegraded":"2023-07-21T22:55:41.437162+0000","last_fullsized":"2023-07-21T22:55:41.437162+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:37:47.250830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.437024+0000","last_change":"2023-07-21T22:55:40.420005+0000","last_active":"2023-07-21T22:55:41.437024+0000","last_peered":"2023-07-21T22:55:41.437024+0000","last_clean":"2023-07-21T22:55:41.437024+0000","last_became_active":"2023-07-21T22:55:40.415358+0000","last_became_peered":"2023-07-21T22:55:40.415358+0000","last_unstale":"2023-07-21T22:55:41.437024+0000","last_undegraded":"2023-07-21T22:55:41.437024+0000","last_fullsized":"2023-07-21T22:55:41.437024+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:08:42.744428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.435893+0000","last_change":"2023-07-21T22:55:40.417315+0000","last_active":"2023-07-21T22:55:41.435893+0000","last_peered":"2023-07-21T22:55:41.435893+0000","last_clean":"2023-07-21T22:55:41.435893+0000","last_became_active":"2023-07-21T22:55:40.416859+0000","last_became_peered":"2023-07-21T22:55:40.416859+0000","last_unstale":"2023-07-21T22:55:41.435893+0000","last_undegraded":"2023-07-21T22:55:41.435893+0000","last_fullsized":"2023-07-21T22:55:41.435893+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:05.644528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.443581+0000","last_change":"2023-07-21T22:55:40.432473+0000","last_active":"2023-07-21T22:55:41.443581+0000","last_peered":"2023-07-21T22:55:41.443581+0000","last_clean":"2023-07-21T22:55:41.443581+0000","last_became_active":"2023-07-21T22:55:40.432120+0000","last_became_peered":"2023-07-21T22:55:40.432120+0000","last_unstale":"2023-07-21T22:55:41.443581+0000","last_undegraded":"2023-07-21T22:55:41.443581+0000","last_fullsized":"2023-07-21T22:55:41.443581+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:17:21.496030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436923+0000","last_change":"2023-07-21T22:55:40.420572+0000","last_active":"2023-07-21T22:55:41.436923+0000","last_peered":"2023-07-21T22:55:41.436923+0000","last_clean":"2023-07-21T22:55:41.436923+0000","last_became_active":"2023-07-21T22:55:40.415306+0000","last_became_peered":"2023-07-21T22:55:40.415306+0000","last_unstale":"2023-07-21T22:55:41.436923+0000","last_undegraded":"2023-07-21T22:55:41.436923+0000","last_fullsized":"2023-07-21T22:55:41.436923+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:29:16.789359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.443331+0000","last_change":"2023-07-21T22:55:40.433168+0000","last_active":"2023-07-21T22:55:41.443331+0000","last_peered":"2023-07-21T22:55:41.443331+0000","last_clean":"2023-07-21T22:55:41.443331+0000","last_became_active":"2023-07-21T22:55:40.432109+0000","last_became_peered":"2023-07-21T22:55:40.432109+0000","last_unstale":"2023-07-21T22:55:41.443331+0000","last_undegraded":"2023-07-21T22:55:41.443331+0000","last_fullsized":"2023-07-21T22:55:41.443331+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:44:17.848046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.403125+0000","last_change":"2023-07-21T22:55:40.420420+0000","last_active":"2023-07-21T22:55:41.403125+0000","last_peered":"2023-07-21T22:55:41.403125+0000","last_clean":"2023-07-21T22:55:41.403125+0000","last_became_active":"2023-07-21T22:55:40.420074+0000","last_became_peered":"2023-07-21T22:55:40.420074+0000","last_unstale":"2023-07-21T22:55:41.403125+0000","last_undegraded":"2023-07-21T22:55:41.403125+0000","last_fullsized":"2023-07-21T22:55:41.403125+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:07:00.772536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436240+0000","last_change":"2023-07-21T22:55:40.406090+0000","last_active":"2023-07-21T22:55:41.436240+0000","last_peered":"2023-07-21T22:55:41.436240+0000","last_clean":"2023-07-21T22:55:41.436240+0000","last_became_active":"2023-07-21T22:55:40.405785+0000","last_became_peered":"2023-07-21T22:55:40.405785+0000","last_unstale":"2023-07-21T22:55:41.436240+0000","last_undegraded":"2023-07-21T22:55:41.436240+0000","last_fullsized":"2023-07-21T22:55:41.436240+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:02:08.006553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.443772+0000","last_change":"2023-07-21T22:55:40.424701+0000","last_active":"2023-07-21T22:55:41.443772+0000","last_peered":"2023-07-21T22:55:41.443772+0000","last_clean":"2023-07-21T22:55:41.443772+0000","last_became_active":"2023-07-21T22:55:40.424328+0000","last_became_peered":"2023-07-21T22:55:40.424328+0000","last_unstale":"2023-07-21T22:55:41.443772+0000","last_undegraded":"2023-07-21T22:55:41.443772+0000","last_fullsized":"2023-07-21T22:55:41.443772+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:16:13.346314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436427+0000","last_change":"2023-07-21T22:55:40.408149+0000","last_active":"2023-07-21T22:55:41.436427+0000","last_peered":"2023-07-21T22:55:41.436427+0000","last_clean":"2023-07-21T22:55:41.436427+0000","last_became_active":"2023-07-21T22:55:40.407190+0000","last_became_peered":"2023-07-21T22:55:40.407190+0000","last_unstale":"2023-07-21T22:55:41.436427+0000","last_undegraded":"2023-07-21T22:55:41.436427+0000","last_fullsized":"2023-07-21T22:55:41.436427+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:11:21.030329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.443341+0000","last_change":"2023-07-21T22:55:40.430797+0000","last_active":"2023-07-21T22:55:41.443341+0000","last_peered":"2023-07-21T22:55:41.443341+0000","last_clean":"2023-07-21T22:55:41.443341+0000","last_became_active":"2023-07-21T22:55:40.430527+0000","last_became_peered":"2023-07-21T22:55:40.430527+0000","last_unstale":"2023-07-21T22:55:41.443341+0000","last_undegraded":"2023-07-21T22:55:41.443341+0000","last_fullsized":"2023-07-21T22:55:41.443341+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:04:27.316688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.437039+0000","last_change":"2023-07-21T22:55:40.406145+0000","last_active":"2023-07-21T22:55:41.437039+0000","last_peered":"2023-07-21T22:55:41.437039+0000","last_clean":"2023-07-21T22:55:41.437039+0000","last_became_active":"2023-07-21T22:55:40.405748+0000","last_became_peered":"2023-07-21T22:55:40.405748+0000","last_unstale":"2023-07-21T22:55:41.437039+0000","last_undegraded":"2023-07-21T22:55:41.437039+0000","last_fullsized":"2023-07-21T22:55:41.437039+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:47:08.638999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.437055+0000","last_change":"2023-07-21T22:55:40.419907+0000","last_active":"2023-07-21T22:55:41.437055+0000","last_peered":"2023-07-21T22:55:41.437055+0000","last_clean":"2023-07-21T22:55:41.437055+0000","last_became_active":"2023-07-21T22:55:40.419504+0000","last_became_peered":"2023-07-21T22:55:40.419504+0000","last_unstale":"2023-07-21T22:55:41.437055+0000","last_undegraded":"2023-07-21T22:55:41.437055+0000","last_fullsized":"2023-07-21T22:55:41.437055+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:43:26.999618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.411080+0000","last_change":"2023-07-21T22:55:40.421309+0000","last_active":"2023-07-21T22:55:41.411080+0000","last_peered":"2023-07-21T22:55:41.411080+0000","last_clean":"2023-07-21T22:55:41.411080+0000","last_became_active":"2023-07-21T22:55:40.418858+0000","last_became_peered":"2023-07-21T22:55:40.418858+0000","last_unstale":"2023-07-21T22:55:41.411080+0000","last_undegraded":"2023-07-21T22:55:41.411080+0000","last_fullsized":"2023-07-21T22:55:41.411080+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:52:30.720252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.411343+0000","last_change":"2023-07-21T22:55:40.413923+0000","last_active":"2023-07-21T22:55:41.411343+0000","last_peered":"2023-07-21T22:55:41.411343+0000","last_clean":"2023-07-21T22:55:41.411343+0000","last_became_active":"2023-07-21T22:55:40.413546+0000","last_became_peered":"2023-07-21T22:55:40.413546+0000","last_unstale":"2023-07-21T22:55:41.411343+0000","last_undegraded":"2023-07-21T22:55:41.411343+0000","last_fullsized":"2023-07-21T22:55:41.411343+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:04:17.166872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.435849+0000","last_change":"2023-07-21T22:55:40.405576+0000","last_active":"2023-07-21T22:55:41.435849+0000","last_peered":"2023-07-21T22:55:41.435849+0000","last_clean":"2023-07-21T22:55:41.435849+0000","last_became_active":"2023-07-21T22:55:40.405222+0000","last_became_peered":"2023-07-21T22:55:40.405222+0000","last_unstale":"2023-07-21T22:55:41.435849+0000","last_undegraded":"2023-07-21T22:55:41.435849+0000","last_fullsized":"2023-07-21T22:55:41.435849+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:29:43.511018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.411876+0000","last_change":"2023-07-21T22:55:40.423280+0000","last_active":"2023-07-21T22:55:41.411876+0000","last_peered":"2023-07-21T22:55:41.411876+0000","last_clean":"2023-07-21T22:55:41.411876+0000","last_became_active":"2023-07-21T22:55:40.422981+0000","last_became_peered":"2023-07-21T22:55:40.422981+0000","last_unstale":"2023-07-21T22:55:41.411876+0000","last_undegraded":"2023-07-21T22:55:41.411876+0000","last_fullsized":"2023-07-21T22:55:41.411876+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:38:55.063937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.411439+0000","last_change":"2023-07-21T22:55:40.412554+0000","last_active":"2023-07-21T22:55:41.411439+0000","last_peered":"2023-07-21T22:55:41.411439+0000","last_clean":"2023-07-21T22:55:41.411439+0000","last_became_active":"2023-07-21T22:55:40.412170+0000","last_became_peered":"2023-07-21T22:55:40.412170+0000","last_unstale":"2023-07-21T22:55:41.411439+0000","last_undegraded":"2023-07-21T22:55:41.411439+0000","last_fullsized":"2023-07-21T22:55:41.411439+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:58:48.327790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436795+0000","last_change":"2023-07-21T22:55:40.412640+0000","last_active":"2023-07-21T22:55:41.436795+0000","last_peered":"2023-07-21T22:55:41.436795+0000","last_clean":"2023-07-21T22:55:41.436795+0000","last_became_active":"2023-07-21T22:55:40.412364+0000","last_became_peered":"2023-07-21T22:55:40.412364+0000","last_unstale":"2023-07-21T22:55:41.436795+0000","last_undegraded":"2023-07-21T22:55:41.436795+0000","last_fullsized":"2023-07-21T22:55:41.436795+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:41:41.144232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436015+0000","last_change":"2023-07-21T22:55:40.407122+0000","last_active":"2023-07-21T22:55:41.436015+0000","last_peered":"2023-07-21T22:55:41.436015+0000","last_clean":"2023-07-21T22:55:41.436015+0000","last_became_active":"2023-07-21T22:55:40.406838+0000","last_became_peered":"2023-07-21T22:55:40.406838+0000","last_unstale":"2023-07-21T22:55:41.436015+0000","last_undegraded":"2023-07-21T22:55:41.436015+0000","last_fullsized":"2023-07-21T22:55:41.436015+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:33:54.802151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.412601+0000","last_change":"2023-07-21T22:55:40.417199+0000","last_active":"2023-07-21T22:55:41.412601+0000","last_peered":"2023-07-21T22:55:41.412601+0000","last_clean":"2023-07-21T22:55:41.412601+0000","last_became_active":"2023-07-21T22:55:40.416695+0000","last_became_peered":"2023-07-21T22:55:40.416695+0000","last_unstale":"2023-07-21T22:55:41.412601+0000","last_undegraded":"2023-07-21T22:55:41.412601+0000","last_fullsized":"2023-07-21T22:55:41.412601+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:09:39.619934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436251+0000","last_change":"2023-07-21T22:55:40.408672+0000","last_active":"2023-07-21T22:55:41.436251+0000","last_peered":"2023-07-21T22:55:41.436251+0000","last_clean":"2023-07-21T22:55:41.436251+0000","last_became_active":"2023-07-21T22:55:40.408405+0000","last_became_peered":"2023-07-21T22:55:40.408405+0000","last_unstale":"2023-07-21T22:55:41.436251+0000","last_undegraded":"2023-07-21T22:55:41.436251+0000","last_fullsized":"2023-07-21T22:55:41.436251+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:02:36.093776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436102+0000","last_change":"2023-07-21T22:55:40.406187+0000","last_active":"2023-07-21T22:55:41.436102+0000","last_peered":"2023-07-21T22:55:41.436102+0000","last_clean":"2023-07-21T22:55:41.436102+0000","last_became_active":"2023-07-21T22:55:40.405872+0000","last_became_peered":"2023-07-21T22:55:40.405872+0000","last_unstale":"2023-07-21T22:55:41.436102+0000","last_undegraded":"2023-07-21T22:55:41.436102+0000","last_fullsized":"2023-07-21T22:55:41.436102+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:10:43.315797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.411938+0000","last_change":"2023-07-21T22:55:40.409812+0000","last_active":"2023-07-21T22:55:41.411938+0000","last_peered":"2023-07-21T22:55:41.411938+0000","last_clean":"2023-07-21T22:55:41.411938+0000","last_became_active":"2023-07-21T22:55:40.409474+0000","last_became_peered":"2023-07-21T22:55:40.409474+0000","last_unstale":"2023-07-21T22:55:41.411938+0000","last_undegraded":"2023-07-21T22:55:41.411938+0000","last_fullsized":"2023-07-21T22:55:41.411938+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:01:55.038929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.403267+0000","last_change":"2023-07-21T22:55:40.414611+0000","last_active":"2023-07-21T22:55:41.403267+0000","last_peered":"2023-07-21T22:55:41.403267+0000","last_clean":"2023-07-21T22:55:41.403267+0000","last_became_active":"2023-07-21T22:55:40.414274+0000","last_became_peered":"2023-07-21T22:55:40.414274+0000","last_unstale":"2023-07-21T22:55:41.403267+0000","last_undegraded":"2023-07-21T22:55:41.403267+0000","last_fullsized":"2023-07-21T22:55:41.403267+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:04:30.991891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"173'4","reported_seq":17,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.437316+0000","last_change":"2023-07-21T22:55:39.401202+0000","last_active":"2023-07-21T22:55:41.437316+0000","last_peered":"2023-07-21T22:55:41.437316+0000","last_clean":"2023-07-21T22:55:41.437316+0000","last_became_active":"2023-07-21T22:55:39.400656+0000","last_became_peered":"2023-07-21T22:55:39.400656+0000","last_unstale":"2023-07-21T22:55:41.437316+0000","last_undegraded":"2023-07-21T22:55:41.437316+0000","last_fullsized":"2023-07-21T22:55:41.437316+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:23:52.321846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.403369+0000","last_change":"2023-07-21T22:55:40.409656+0000","last_active":"2023-07-21T22:55:41.403369+0000","last_peered":"2023-07-21T22:55:41.403369+0000","last_clean":"2023-07-21T22:55:41.403369+0000","last_became_active":"2023-07-21T22:55:40.409375+0000","last_became_peered":"2023-07-21T22:55:40.409375+0000","last_unstale":"2023-07-21T22:55:41.403369+0000","last_undegraded":"2023-07-21T22:55:41.403369+0000","last_fullsized":"2023-07-21T22:55:41.403369+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:06:26.254507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"173'1","reported_seq":14,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.443284+0000","last_change":"2023-07-21T22:55:39.415451+0000","last_active":"2023-07-21T22:55:41.443284+0000","last_peered":"2023-07-21T22:55:41.443284+0000","last_clean":"2023-07-21T22:55:41.443284+0000","last_became_active":"2023-07-21T22:55:39.415164+0000","last_became_peered":"2023-07-21T22:55:39.415164+0000","last_unstale":"2023-07-21T22:55:41.443284+0000","last_undegraded":"2023-07-21T22:55:41.443284+0000","last_fullsized":"2023-07-21T22:55:41.443284+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:03:37.814145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.412756+0000","last_change":"2023-07-21T22:55:40.425940+0000","last_active":"2023-07-21T22:55:41.412756+0000","last_peered":"2023-07-21T22:55:41.412756+0000","last_clean":"2023-07-21T22:55:41.412756+0000","last_became_active":"2023-07-21T22:55:40.425362+0000","last_became_peered":"2023-07-21T22:55:40.425362+0000","last_unstale":"2023-07-21T22:55:41.412756+0000","last_undegraded":"2023-07-21T22:55:41.412756+0000","last_fullsized":"2023-07-21T22:55:41.412756+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:36:13.836823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"173'2","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.443263+0000","last_change":"2023-07-21T22:55:39.414669+0000","last_active":"2023-07-21T22:55:41.443263+0000","last_peered":"2023-07-21T22:55:41.443263+0000","last_clean":"2023-07-21T22:55:41.443263+0000","last_became_active":"2023-07-21T22:55:39.414403+0000","last_became_peered":"2023-07-21T22:55:39.414403+0000","last_unstale":"2023-07-21T22:55:41.443263+0000","last_undegraded":"2023-07-21T22:55:41.443263+0000","last_fullsized":"2023-07-21T22:55:41.443263+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:10:29.163823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.443005+0000","last_change":"2023-07-21T22:55:40.426872+0000","last_active":"2023-07-21T22:55:41.443005+0000","last_peered":"2023-07-21T22:55:41.443005+0000","last_clean":"2023-07-21T22:55:41.443005+0000","last_became_active":"2023-07-21T22:55:40.426588+0000","last_became_peered":"2023-07-21T22:55:40.426588+0000","last_unstale":"2023-07-21T22:55:41.443005+0000","last_undegraded":"2023-07-21T22:55:41.443005+0000","last_fullsized":"2023-07-21T22:55:41.443005+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:50:29.056001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"173'2","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.403403+0000","last_change":"2023-07-21T22:55:39.413053+0000","last_active":"2023-07-21T22:55:41.403403+0000","last_peered":"2023-07-21T22:55:41.403403+0000","last_clean":"2023-07-21T22:55:41.403403+0000","last_became_active":"2023-07-21T22:55:39.412694+0000","last_became_peered":"2023-07-21T22:55:39.412694+0000","last_unstale":"2023-07-21T22:55:41.403403+0000","last_undegraded":"2023-07-21T22:55:41.403403+0000","last_fullsized":"2023-07-21T22:55:41.403403+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:19:42.956811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436576+0000","last_change":"2023-07-21T22:55:40.413456+0000","last_active":"2023-07-21T22:55:41.436576+0000","last_peered":"2023-07-21T22:55:41.436576+0000","last_clean":"2023-07-21T22:55:41.436576+0000","last_became_active":"2023-07-21T22:55:40.413170+0000","last_became_peered":"2023-07-21T22:55:40.413170+0000","last_unstale":"2023-07-21T22:55:41.436576+0000","last_undegraded":"2023-07-21T22:55:41.436576+0000","last_fullsized":"2023-07-21T22:55:41.436576+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:18:14.871773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"173'1","reported_seq":14,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.412746+0000","last_change":"2023-07-21T22:55:39.418236+0000","last_active":"2023-07-21T22:55:41.412746+0000","last_peered":"2023-07-21T22:55:41.412746+0000","last_clean":"2023-07-21T22:55:41.412746+0000","last_became_active":"2023-07-21T22:55:39.417975+0000","last_became_peered":"2023-07-21T22:55:39.417975+0000","last_unstale":"2023-07-21T22:55:41.412746+0000","last_undegraded":"2023-07-21T22:55:41.412746+0000","last_fullsized":"2023-07-21T22:55:41.412746+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:33:57.188177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.442701+0000","last_change":"2023-07-21T22:55:40.414344+0000","last_active":"2023-07-21T22:55:41.442701+0000","last_peered":"2023-07-21T22:55:41.442701+0000","last_clean":"2023-07-21T22:55:41.442701+0000","last_became_active":"2023-07-21T22:55:40.414010+0000","last_became_peered":"2023-07-21T22:55:40.414010+0000","last_unstale":"2023-07-21T22:55:41.442701+0000","last_undegraded":"2023-07-21T22:55:41.442701+0000","last_fullsized":"2023-07-21T22:55:41.442701+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:56:34.666095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"173'1","reported_seq":14,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436566+0000","last_change":"2023-07-21T22:55:39.407508+0000","last_active":"2023-07-21T22:55:41.436566+0000","last_peered":"2023-07-21T22:55:41.436566+0000","last_clean":"2023-07-21T22:55:41.436566+0000","last_became_active":"2023-07-21T22:55:39.407178+0000","last_became_peered":"2023-07-21T22:55:39.407178+0000","last_unstale":"2023-07-21T22:55:41.436566+0000","last_undegraded":"2023-07-21T22:55:41.436566+0000","last_fullsized":"2023-07-21T22:55:41.436566+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:48:44.006022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.403126+0000","last_change":"2023-07-21T22:55:40.406651+0000","last_active":"2023-07-21T22:55:41.403126+0000","last_peered":"2023-07-21T22:55:41.403126+0000","last_clean":"2023-07-21T22:55:41.403126+0000","last_became_active":"2023-07-21T22:55:40.406373+0000","last_became_peered":"2023-07-21T22:55:40.406373+0000","last_unstale":"2023-07-21T22:55:41.403126+0000","last_undegraded":"2023-07-21T22:55:41.403126+0000","last_fullsized":"2023-07-21T22:55:41.403126+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:33:14.819157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.411180+0000","last_change":"2023-07-21T22:55:39.411817+0000","last_active":"2023-07-21T22:55:41.411180+0000","last_peered":"2023-07-21T22:55:41.411180+0000","last_clean":"2023-07-21T22:55:41.411180+0000","last_became_active":"2023-07-21T22:55:39.411096+0000","last_became_peered":"2023-07-21T22:55:39.411096+0000","last_unstale":"2023-07-21T22:55:41.411180+0000","last_undegraded":"2023-07-21T22:55:41.411180+0000","last_fullsized":"2023-07-21T22:55:41.411180+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:02:20.161907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.411351+0000","last_change":"2023-07-21T22:55:40.410533+0000","last_active":"2023-07-21T22:55:41.411351+0000","last_peered":"2023-07-21T22:55:41.411351+0000","last_clean":"2023-07-21T22:55:41.411351+0000","last_became_active":"2023-07-21T22:55:40.410250+0000","last_became_peered":"2023-07-21T22:55:40.410250+0000","last_unstale":"2023-07-21T22:55:41.411351+0000","last_undegraded":"2023-07-21T22:55:41.411351+0000","last_fullsized":"2023-07-21T22:55:41.411351+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:25:42.435637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436331+0000","last_change":"2023-07-21T22:55:39.398085+0000","last_active":"2023-07-21T22:55:41.436331+0000","last_peered":"2023-07-21T22:55:41.436331+0000","last_clean":"2023-07-21T22:55:41.436331+0000","last_became_active":"2023-07-21T22:55:39.397730+0000","last_became_peered":"2023-07-21T22:55:39.397730+0000","last_unstale":"2023-07-21T22:55:41.436331+0000","last_undegraded":"2023-07-21T22:55:41.436331+0000","last_fullsized":"2023-07-21T22:55:41.436331+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:11:27.320329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.442821+0000","last_change":"2023-07-21T22:55:40.422097+0000","last_active":"2023-07-21T22:55:41.442821+0000","last_peered":"2023-07-21T22:55:41.442821+0000","last_clean":"2023-07-21T22:55:41.442821+0000","last_became_active":"2023-07-21T22:55:40.421800+0000","last_became_peered":"2023-07-21T22:55:40.421800+0000","last_unstale":"2023-07-21T22:55:41.442821+0000","last_undegraded":"2023-07-21T22:55:41.442821+0000","last_fullsized":"2023-07-21T22:55:41.442821+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:58:29.541962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"173'1","reported_seq":14,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436071+0000","last_change":"2023-07-21T22:55:39.401715+0000","last_active":"2023-07-21T22:55:41.436071+0000","last_peered":"2023-07-21T22:55:41.436071+0000","last_clean":"2023-07-21T22:55:41.436071+0000","last_became_active":"2023-07-21T22:55:39.401360+0000","last_became_peered":"2023-07-21T22:55:39.401360+0000","last_unstale":"2023-07-21T22:55:41.436071+0000","last_undegraded":"2023-07-21T22:55:41.436071+0000","last_fullsized":"2023-07-21T22:55:41.436071+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:29:12.410645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.443192+0000","last_change":"2023-07-21T22:55:40.423486+0000","last_active":"2023-07-21T22:55:41.443192+0000","last_peered":"2023-07-21T22:55:41.443192+0000","last_clean":"2023-07-21T22:55:41.443192+0000","last_became_active":"2023-07-21T22:55:40.423196+0000","last_became_peered":"2023-07-21T22:55:40.423196+0000","last_unstale":"2023-07-21T22:55:41.443192+0000","last_undegraded":"2023-07-21T22:55:41.443192+0000","last_fullsized":"2023-07-21T22:55:41.443192+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:23:36.460180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"173'2","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.443439+0000","last_change":"2023-07-21T22:55:39.410646+0000","last_active":"2023-07-21T22:55:41.443439+0000","last_peered":"2023-07-21T22:55:41.443439+0000","last_clean":"2023-07-21T22:55:41.443439+0000","last_became_active":"2023-07-21T22:55:39.410319+0000","last_became_peered":"2023-07-21T22:55:39.410319+0000","last_unstale":"2023-07-21T22:55:41.443439+0000","last_undegraded":"2023-07-21T22:55:41.443439+0000","last_fullsized":"2023-07-21T22:55:41.443439+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:32:56.086956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.411613+0000","last_change":"2023-07-21T22:55:40.412469+0000","last_active":"2023-07-21T22:55:41.411613+0000","last_peered":"2023-07-21T22:55:41.411613+0000","last_clean":"2023-07-21T22:55:41.411613+0000","last_became_active":"2023-07-21T22:55:40.411851+0000","last_became_peered":"2023-07-21T22:55:40.411851+0000","last_unstale":"2023-07-21T22:55:41.411613+0000","last_undegraded":"2023-07-21T22:55:41.411613+0000","last_fullsized":"2023-07-21T22:55:41.411613+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:18:59.487068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"173'1","reported_seq":14,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.403474+0000","last_change":"2023-07-21T22:55:39.409616+0000","last_active":"2023-07-21T22:55:41.403474+0000","last_peered":"2023-07-21T22:55:41.403474+0000","last_clean":"2023-07-21T22:55:41.403474+0000","last_became_active":"2023-07-21T22:55:39.409314+0000","last_became_peered":"2023-07-21T22:55:39.409314+0000","last_unstale":"2023-07-21T22:55:41.403474+0000","last_undegraded":"2023-07-21T22:55:41.403474+0000","last_fullsized":"2023-07-21T22:55:41.403474+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:54:39.954197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.411964+0000","last_change":"2023-07-21T22:55:40.414759+0000","last_active":"2023-07-21T22:55:41.411964+0000","last_peered":"2023-07-21T22:55:41.411964+0000","last_clean":"2023-07-21T22:55:41.411964+0000","last_became_active":"2023-07-21T22:55:40.414464+0000","last_became_peered":"2023-07-21T22:55:40.414464+0000","last_unstale":"2023-07-21T22:55:41.411964+0000","last_undegraded":"2023-07-21T22:55:41.411964+0000","last_fullsized":"2023-07-21T22:55:41.411964+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:59:01.361276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.443544+0000","last_change":"2023-07-21T22:55:39.421460+0000","last_active":"2023-07-21T22:55:41.443544+0000","last_peered":"2023-07-21T22:55:41.443544+0000","last_clean":"2023-07-21T22:55:41.443544+0000","last_became_active":"2023-07-21T22:55:39.421077+0000","last_became_peered":"2023-07-21T22:55:39.421077+0000","last_unstale":"2023-07-21T22:55:41.443544+0000","last_undegraded":"2023-07-21T22:55:41.443544+0000","last_fullsized":"2023-07-21T22:55:41.443544+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:49:49.338594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.442634+0000","last_change":"2023-07-21T22:55:40.415396+0000","last_active":"2023-07-21T22:55:41.442634+0000","last_peered":"2023-07-21T22:55:41.442634+0000","last_clean":"2023-07-21T22:55:41.442634+0000","last_became_active":"2023-07-21T22:55:40.415071+0000","last_became_peered":"2023-07-21T22:55:40.415071+0000","last_unstale":"2023-07-21T22:55:41.442634+0000","last_undegraded":"2023-07-21T22:55:41.442634+0000","last_fullsized":"2023-07-21T22:55:41.442634+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:26:37.039537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"173'2","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436650+0000","last_change":"2023-07-21T22:55:39.413026+0000","last_active":"2023-07-21T22:55:41.436650+0000","last_peered":"2023-07-21T22:55:41.436650+0000","last_clean":"2023-07-21T22:55:41.436650+0000","last_became_active":"2023-07-21T22:55:39.412686+0000","last_became_peered":"2023-07-21T22:55:39.412686+0000","last_unstale":"2023-07-21T22:55:41.436650+0000","last_undegraded":"2023-07-21T22:55:41.436650+0000","last_fullsized":"2023-07-21T22:55:41.436650+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:47:39.345630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.403300+0000","last_change":"2023-07-21T22:55:40.407248+0000","last_active":"2023-07-21T22:55:41.403300+0000","last_peered":"2023-07-21T22:55:41.403300+0000","last_clean":"2023-07-21T22:55:41.403300+0000","last_became_active":"2023-07-21T22:55:40.406968+0000","last_became_peered":"2023-07-21T22:55:40.406968+0000","last_unstale":"2023-07-21T22:55:41.403300+0000","last_undegraded":"2023-07-21T22:55:41.403300+0000","last_fullsized":"2023-07-21T22:55:41.403300+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:27:43.572343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.412455+0000","last_change":"2023-07-21T22:55:39.415018+0000","last_active":"2023-07-21T22:55:41.412455+0000","last_peered":"2023-07-21T22:55:41.412455+0000","last_clean":"2023-07-21T22:55:41.412455+0000","last_became_active":"2023-07-21T22:55:39.414713+0000","last_became_peered":"2023-07-21T22:55:39.414713+0000","last_unstale":"2023-07-21T22:55:41.412455+0000","last_undegraded":"2023-07-21T22:55:41.412455+0000","last_fullsized":"2023-07-21T22:55:41.412455+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:41:31.496003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.442815+0000","last_change":"2023-07-21T22:55:40.420418+0000","last_active":"2023-07-21T22:55:41.442815+0000","last_peered":"2023-07-21T22:55:41.442815+0000","last_clean":"2023-07-21T22:55:41.442815+0000","last_became_active":"2023-07-21T22:55:40.420133+0000","last_became_peered":"2023-07-21T22:55:40.420133+0000","last_unstale":"2023-07-21T22:55:41.442815+0000","last_undegraded":"2023-07-21T22:55:41.442815+0000","last_fullsized":"2023-07-21T22:55:41.442815+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:40:03.056637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436576+0000","last_change":"2023-07-21T22:55:39.412811+0000","last_active":"2023-07-21T22:55:41.436576+0000","last_peered":"2023-07-21T22:55:41.436576+0000","last_clean":"2023-07-21T22:55:41.436576+0000","last_became_active":"2023-07-21T22:55:39.412344+0000","last_became_peered":"2023-07-21T22:55:39.412344+0000","last_unstale":"2023-07-21T22:55:41.436576+0000","last_undegraded":"2023-07-21T22:55:41.436576+0000","last_fullsized":"2023-07-21T22:55:41.436576+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:55:39.274747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.403391+0000","last_change":"2023-07-21T22:55:40.409276+0000","last_active":"2023-07-21T22:55:41.403391+0000","last_peered":"2023-07-21T22:55:41.403391+0000","last_clean":"2023-07-21T22:55:41.403391+0000","last_became_active":"2023-07-21T22:55:40.408771+0000","last_became_peered":"2023-07-21T22:55:40.408771+0000","last_unstale":"2023-07-21T22:55:41.403391+0000","last_undegraded":"2023-07-21T22:55:41.403391+0000","last_fullsized":"2023-07-21T22:55:41.403391+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:32:31.085198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.412216+0000","last_change":"2023-07-21T22:55:39.416526+0000","last_active":"2023-07-21T22:55:41.412216+0000","last_peered":"2023-07-21T22:55:41.412216+0000","last_clean":"2023-07-21T22:55:41.412216+0000","last_became_active":"2023-07-21T22:55:39.416238+0000","last_became_peered":"2023-07-21T22:55:39.416238+0000","last_unstale":"2023-07-21T22:55:41.412216+0000","last_undegraded":"2023-07-21T22:55:41.412216+0000","last_fullsized":"2023-07-21T22:55:41.412216+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:53:29.876401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436342+0000","last_change":"2023-07-21T22:55:40.403102+0000","last_active":"2023-07-21T22:55:41.436342+0000","last_peered":"2023-07-21T22:55:41.436342+0000","last_clean":"2023-07-21T22:55:41.436342+0000","last_became_active":"2023-07-21T22:55:40.402827+0000","last_became_peered":"2023-07-21T22:55:40.402827+0000","last_unstale":"2023-07-21T22:55:41.436342+0000","last_undegraded":"2023-07-21T22:55:41.436342+0000","last_fullsized":"2023-07-21T22:55:41.436342+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:10:25.739447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"173'2","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.443839+0000","last_change":"2023-07-21T22:55:39.421412+0000","last_active":"2023-07-21T22:55:41.443839+0000","last_peered":"2023-07-21T22:55:41.443839+0000","last_clean":"2023-07-21T22:55:41.443839+0000","last_became_active":"2023-07-21T22:55:39.421070+0000","last_became_peered":"2023-07-21T22:55:39.421070+0000","last_unstale":"2023-07-21T22:55:41.443839+0000","last_undegraded":"2023-07-21T22:55:41.443839+0000","last_fullsized":"2023-07-21T22:55:41.443839+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:32:24.579706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.443767+0000","last_change":"2023-07-21T22:55:40.432545+0000","last_active":"2023-07-21T22:55:41.443767+0000","last_peered":"2023-07-21T22:55:41.443767+0000","last_clean":"2023-07-21T22:55:41.443767+0000","last_became_active":"2023-07-21T22:55:40.432259+0000","last_became_peered":"2023-07-21T22:55:40.432259+0000","last_unstale":"2023-07-21T22:55:41.443767+0000","last_undegraded":"2023-07-21T22:55:41.443767+0000","last_fullsized":"2023-07-21T22:55:41.443767+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:17:53.495630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"174'1","reported_seq":14,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.411713+0000","last_change":"2023-07-21T22:55:39.410781+0000","last_active":"2023-07-21T22:55:41.411713+0000","last_peered":"2023-07-21T22:55:41.411713+0000","last_clean":"2023-07-21T22:55:41.411713+0000","last_became_active":"2023-07-21T22:55:39.410464+0000","last_became_peered":"2023-07-21T22:55:39.410464+0000","last_unstale":"2023-07-21T22:55:41.411713+0000","last_undegraded":"2023-07-21T22:55:41.411713+0000","last_fullsized":"2023-07-21T22:55:41.411713+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:25:33.500669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.411764+0000","last_change":"2023-07-21T22:55:40.412337+0000","last_active":"2023-07-21T22:55:41.411764+0000","last_peered":"2023-07-21T22:55:41.411764+0000","last_clean":"2023-07-21T22:55:41.411764+0000","last_became_active":"2023-07-21T22:55:40.411828+0000","last_became_peered":"2023-07-21T22:55:40.411828+0000","last_unstale":"2023-07-21T22:55:41.411764+0000","last_undegraded":"2023-07-21T22:55:41.411764+0000","last_fullsized":"2023-07-21T22:55:41.411764+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:44.095416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.403494+0000","last_change":"2023-07-21T22:55:39.414668+0000","last_active":"2023-07-21T22:55:41.403494+0000","last_peered":"2023-07-21T22:55:41.403494+0000","last_clean":"2023-07-21T22:55:41.403494+0000","last_became_active":"2023-07-21T22:55:39.414446+0000","last_became_peered":"2023-07-21T22:55:39.414446+0000","last_unstale":"2023-07-21T22:55:41.403494+0000","last_undegraded":"2023-07-21T22:55:41.403494+0000","last_fullsized":"2023-07-21T22:55:41.403494+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:58:38.236793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.437296+0000","last_change":"2023-07-21T22:55:40.422742+0000","last_active":"2023-07-21T22:55:41.437296+0000","last_peered":"2023-07-21T22:55:41.437296+0000","last_clean":"2023-07-21T22:55:41.437296+0000","last_became_active":"2023-07-21T22:55:40.422470+0000","last_became_peered":"2023-07-21T22:55:40.422470+0000","last_unstale":"2023-07-21T22:55:41.437296+0000","last_undegraded":"2023-07-21T22:55:41.437296+0000","last_fullsized":"2023-07-21T22:55:41.437296+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:24:33.140849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436460+0000","last_change":"2023-07-21T22:55:39.410389+0000","last_active":"2023-07-21T22:55:41.436460+0000","last_peered":"2023-07-21T22:55:41.436460+0000","last_clean":"2023-07-21T22:55:41.436460+0000","last_became_active":"2023-07-21T22:55:39.410069+0000","last_became_peered":"2023-07-21T22:55:39.410069+0000","last_unstale":"2023-07-21T22:55:41.436460+0000","last_undegraded":"2023-07-21T22:55:41.436460+0000","last_fullsized":"2023-07-21T22:55:41.436460+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:54:49.455961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.412145+0000","last_change":"2023-07-21T22:55:40.413239+0000","last_active":"2023-07-21T22:55:41.412145+0000","last_peered":"2023-07-21T22:55:41.412145+0000","last_clean":"2023-07-21T22:55:41.412145+0000","last_became_active":"2023-07-21T22:55:40.412458+0000","last_became_peered":"2023-07-21T22:55:40.412458+0000","last_unstale":"2023-07-21T22:55:41.412145+0000","last_undegraded":"2023-07-21T22:55:41.412145+0000","last_fullsized":"2023-07-21T22:55:41.412145+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:49:18.534736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.411395+0000","last_change":"2023-07-21T22:55:39.409683+0000","last_active":"2023-07-21T22:55:41.411395+0000","last_peered":"2023-07-21T22:55:41.411395+0000","last_clean":"2023-07-21T22:55:41.411395+0000","last_became_active":"2023-07-21T22:55:39.409275+0000","last_became_peered":"2023-07-21T22:55:39.409275+0000","last_unstale":"2023-07-21T22:55:41.411395+0000","last_undegraded":"2023-07-21T22:55:41.411395+0000","last_fullsized":"2023-07-21T22:55:41.411395+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:40:58.577885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.442748+0000","last_change":"2023-07-21T22:55:40.432766+0000","last_active":"2023-07-21T22:55:41.442748+0000","last_peered":"2023-07-21T22:55:41.442748+0000","last_clean":"2023-07-21T22:55:41.442748+0000","last_became_active":"2023-07-21T22:55:40.432438+0000","last_became_peered":"2023-07-21T22:55:40.432438+0000","last_unstale":"2023-07-21T22:55:41.442748+0000","last_undegraded":"2023-07-21T22:55:41.442748+0000","last_fullsized":"2023-07-21T22:55:41.442748+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:45:36.637991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436374+0000","last_change":"2023-07-21T22:55:39.408656+0000","last_active":"2023-07-21T22:55:41.436374+0000","last_peered":"2023-07-21T22:55:41.436374+0000","last_clean":"2023-07-21T22:55:41.436374+0000","last_became_active":"2023-07-21T22:55:39.408375+0000","last_became_peered":"2023-07-21T22:55:39.408375+0000","last_unstale":"2023-07-21T22:55:41.436374+0000","last_undegraded":"2023-07-21T22:55:41.436374+0000","last_fullsized":"2023-07-21T22:55:41.436374+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:49:30.905892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.403144+0000","last_change":"2023-07-21T22:55:40.405794+0000","last_active":"2023-07-21T22:55:41.403144+0000","last_peered":"2023-07-21T22:55:41.403144+0000","last_clean":"2023-07-21T22:55:41.403144+0000","last_became_active":"2023-07-21T22:55:40.404807+0000","last_became_peered":"2023-07-21T22:55:40.404807+0000","last_unstale":"2023-07-21T22:55:41.403144+0000","last_undegraded":"2023-07-21T22:55:41.403144+0000","last_fullsized":"2023-07-21T22:55:41.403144+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:44:15.439141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.411972+0000","last_change":"2023-07-21T22:55:39.405548+0000","last_active":"2023-07-21T22:55:41.411972+0000","last_peered":"2023-07-21T22:55:41.411972+0000","last_clean":"2023-07-21T22:55:41.411972+0000","last_became_active":"2023-07-21T22:55:39.405263+0000","last_became_peered":"2023-07-21T22:55:39.405263+0000","last_unstale":"2023-07-21T22:55:41.411972+0000","last_undegraded":"2023-07-21T22:55:41.411972+0000","last_fullsized":"2023-07-21T22:55:41.411972+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:34:07.703756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.412403+0000","last_change":"2023-07-21T22:55:40.417386+0000","last_active":"2023-07-21T22:55:41.412403+0000","last_peered":"2023-07-21T22:55:41.412403+0000","last_clean":"2023-07-21T22:55:41.412403+0000","last_became_active":"2023-07-21T22:55:40.417107+0000","last_became_peered":"2023-07-21T22:55:40.417107+0000","last_unstale":"2023-07-21T22:55:41.412403+0000","last_undegraded":"2023-07-21T22:55:41.412403+0000","last_fullsized":"2023-07-21T22:55:41.412403+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:28:58.421758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.442964+0000","last_change":"2023-07-21T22:55:39.410357+0000","last_active":"2023-07-21T22:55:41.442964+0000","last_peered":"2023-07-21T22:55:41.442964+0000","last_clean":"2023-07-21T22:55:41.442964+0000","last_became_active":"2023-07-21T22:55:39.410057+0000","last_became_peered":"2023-07-21T22:55:39.410057+0000","last_unstale":"2023-07-21T22:55:41.442964+0000","last_undegraded":"2023-07-21T22:55:41.442964+0000","last_fullsized":"2023-07-21T22:55:41.442964+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:46:57.240499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.413083+0000","last_change":"2023-07-21T22:55:40.410444+0000","last_active":"2023-07-21T22:55:41.413083+0000","last_peered":"2023-07-21T22:55:41.413083+0000","last_clean":"2023-07-21T22:55:41.413083+0000","last_became_active":"2023-07-21T22:55:40.410153+0000","last_became_peered":"2023-07-21T22:55:40.410153+0000","last_unstale":"2023-07-21T22:55:41.413083+0000","last_undegraded":"2023-07-21T22:55:41.413083+0000","last_fullsized":"2023-07-21T22:55:41.413083+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:59:14.684473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"173'6","reported_seq":19,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436903+0000","last_change":"2023-07-21T22:55:39.408029+0000","last_active":"2023-07-21T22:55:41.436903+0000","last_peered":"2023-07-21T22:55:41.436903+0000","last_clean":"2023-07-21T22:55:41.436903+0000","last_became_active":"2023-07-21T22:55:39.407599+0000","last_became_peered":"2023-07-21T22:55:39.407599+0000","last_unstale":"2023-07-21T22:55:41.436903+0000","last_undegraded":"2023-07-21T22:55:41.436903+0000","last_fullsized":"2023-07-21T22:55:41.436903+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:12:36.921653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"161'304","reported_seq":1106,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.443142+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:55:41.443142+0000","last_peered":"2023-07-21T22:55:41.443142+0000","last_clean":"2023-07-21T22:55:41.443142+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:55:41.443142+0000","last_undegraded":"2023-07-21T22:55:41.443142+0000","last_fullsized":"2023-07-21T22:55:41.443142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:44:51.922929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":322,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.411473+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:55:41.411473+0000","last_peered":"2023-07-21T22:55:41.411473+0000","last_clean":"2023-07-21T22:55:41.411473+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:55:41.411473+0000","last_undegraded":"2023-07-21T22:55:41.411473+0000","last_fullsized":"2023-07-21T22:55:41.411473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:13:25.122072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.412852+0000","last_change":"2023-07-21T22:55:40.421548+0000","last_active":"2023-07-21T22:55:41.412852+0000","last_peered":"2023-07-21T22:55:41.412852+0000","last_clean":"2023-07-21T22:55:41.412852+0000","last_became_active":"2023-07-21T22:55:40.421239+0000","last_became_peered":"2023-07-21T22:55:40.421239+0000","last_unstale":"2023-07-21T22:55:41.412852+0000","last_undegraded":"2023-07-21T22:55:41.412852+0000","last_fullsized":"2023-07-21T22:55:41.412852+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:53:37.969085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.443138+0000","last_change":"2023-07-21T22:55:39.408771+0000","last_active":"2023-07-21T22:55:41.443138+0000","last_peered":"2023-07-21T22:55:41.443138+0000","last_clean":"2023-07-21T22:55:41.443138+0000","last_became_active":"2023-07-21T22:55:39.408492+0000","last_became_peered":"2023-07-21T22:55:39.408492+0000","last_unstale":"2023-07-21T22:55:41.443138+0000","last_undegraded":"2023-07-21T22:55:41.443138+0000","last_fullsized":"2023-07-21T22:55:41.443138+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:57:36.061862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":287,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.443128+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:55:41.443128+0000","last_peered":"2023-07-21T22:55:41.443128+0000","last_clean":"2023-07-21T22:55:41.443128+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:55:41.443128+0000","last_undegraded":"2023-07-21T22:55:41.443128+0000","last_fullsized":"2023-07-21T22:55:41.443128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:28:55.373710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436035+0000","last_change":"2023-07-21T22:55:40.417111+0000","last_active":"2023-07-21T22:55:41.436035+0000","last_peered":"2023-07-21T22:55:41.436035+0000","last_clean":"2023-07-21T22:55:41.436035+0000","last_became_active":"2023-07-21T22:55:40.416488+0000","last_became_peered":"2023-07-21T22:55:40.416488+0000","last_unstale":"2023-07-21T22:55:41.436035+0000","last_undegraded":"2023-07-21T22:55:41.436035+0000","last_fullsized":"2023-07-21T22:55:41.436035+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:10:01.960325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.411816+0000","last_change":"2023-07-21T22:55:39.407686+0000","last_active":"2023-07-21T22:55:41.411816+0000","last_peered":"2023-07-21T22:55:41.411816+0000","last_clean":"2023-07-21T22:55:41.411816+0000","last_became_active":"2023-07-21T22:55:39.407414+0000","last_became_peered":"2023-07-21T22:55:39.407414+0000","last_unstale":"2023-07-21T22:55:41.411816+0000","last_undegraded":"2023-07-21T22:55:41.411816+0000","last_fullsized":"2023-07-21T22:55:41.411816+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:09:19.666926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":290,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.435947+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:55:41.435947+0000","last_peered":"2023-07-21T22:55:41.435947+0000","last_clean":"2023-07-21T22:55:41.435947+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:55:41.435947+0000","last_undegraded":"2023-07-21T22:55:41.435947+0000","last_fullsized":"2023-07-21T22:55:41.435947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:46:01.422375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436545+0000","last_change":"2023-07-21T22:55:40.408334+0000","last_active":"2023-07-21T22:55:41.436545+0000","last_peered":"2023-07-21T22:55:41.436545+0000","last_clean":"2023-07-21T22:55:41.436545+0000","last_became_active":"2023-07-21T22:55:40.407620+0000","last_became_peered":"2023-07-21T22:55:40.407620+0000","last_unstale":"2023-07-21T22:55:41.436545+0000","last_undegraded":"2023-07-21T22:55:41.436545+0000","last_fullsized":"2023-07-21T22:55:41.436545+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:48:44.035971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"173'3","reported_seq":16,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436155+0000","last_change":"2023-07-21T22:55:39.399053+0000","last_active":"2023-07-21T22:55:41.436155+0000","last_peered":"2023-07-21T22:55:41.436155+0000","last_clean":"2023-07-21T22:55:41.436155+0000","last_became_active":"2023-07-21T22:55:39.398779+0000","last_became_peered":"2023-07-21T22:55:39.398779+0000","last_unstale":"2023-07-21T22:55:41.436155+0000","last_undegraded":"2023-07-21T22:55:41.436155+0000","last_fullsized":"2023-07-21T22:55:41.436155+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:40:53.999567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":322,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.411152+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:55:41.411152+0000","last_peered":"2023-07-21T22:55:41.411152+0000","last_clean":"2023-07-21T22:55:41.411152+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:55:41.411152+0000","last_undegraded":"2023-07-21T22:55:41.411152+0000","last_fullsized":"2023-07-21T22:55:41.411152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:07:07.056590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.412083+0000","last_change":"2023-07-21T22:55:40.417722+0000","last_active":"2023-07-21T22:55:41.412083+0000","last_peered":"2023-07-21T22:55:41.412083+0000","last_clean":"2023-07-21T22:55:41.412083+0000","last_became_active":"2023-07-21T22:55:40.416990+0000","last_became_peered":"2023-07-21T22:55:40.416990+0000","last_unstale":"2023-07-21T22:55:41.412083+0000","last_undegraded":"2023-07-21T22:55:41.412083+0000","last_fullsized":"2023-07-21T22:55:41.412083+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:02:15.096800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"173'2","reported_seq":15,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.437229+0000","last_change":"2023-07-21T22:55:39.398435+0000","last_active":"2023-07-21T22:55:41.437229+0000","last_peered":"2023-07-21T22:55:41.437229+0000","last_clean":"2023-07-21T22:55:41.437229+0000","last_became_active":"2023-07-21T22:55:39.398171+0000","last_became_peered":"2023-07-21T22:55:39.398171+0000","last_unstale":"2023-07-21T22:55:41.437229+0000","last_undegraded":"2023-07-21T22:55:41.437229+0000","last_fullsized":"2023-07-21T22:55:41.437229+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:12:36.011227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":302,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.403595+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:55:41.403595+0000","last_peered":"2023-07-21T22:55:41.403595+0000","last_clean":"2023-07-21T22:55:41.403595+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:55:41.403595+0000","last_undegraded":"2023-07-21T22:55:41.403595+0000","last_fullsized":"2023-07-21T22:55:41.403595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:10:36.431881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.403127+0000","last_change":"2023-07-21T22:55:40.409256+0000","last_active":"2023-07-21T22:55:41.403127+0000","last_peered":"2023-07-21T22:55:41.403127+0000","last_clean":"2023-07-21T22:55:41.403127+0000","last_became_active":"2023-07-21T22:55:40.408795+0000","last_became_peered":"2023-07-21T22:55:40.408795+0000","last_unstale":"2023-07-21T22:55:41.403127+0000","last_undegraded":"2023-07-21T22:55:41.403127+0000","last_fullsized":"2023-07-21T22:55:41.403127+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:45:55.042642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.443685+0000","last_change":"2023-07-21T22:55:39.421220+0000","last_active":"2023-07-21T22:55:41.443685+0000","last_peered":"2023-07-21T22:55:41.443685+0000","last_clean":"2023-07-21T22:55:41.443685+0000","last_became_active":"2023-07-21T22:55:39.420898+0000","last_became_peered":"2023-07-21T22:55:39.420898+0000","last_unstale":"2023-07-21T22:55:41.443685+0000","last_undegraded":"2023-07-21T22:55:41.443685+0000","last_fullsized":"2023-07-21T22:55:41.443685+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:16:20.266061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":286,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.443396+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:55:41.443396+0000","last_peered":"2023-07-21T22:55:41.443396+0000","last_clean":"2023-07-21T22:55:41.443396+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:55:41.443396+0000","last_undegraded":"2023-07-21T22:55:41.443396+0000","last_fullsized":"2023-07-21T22:55:41.443396+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:57:23.455040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.436447+0000","last_change":"2023-07-21T22:55:40.398868+0000","last_active":"2023-07-21T22:55:41.436447+0000","last_peered":"2023-07-21T22:55:41.436447+0000","last_clean":"2023-07-21T22:55:41.436447+0000","last_became_active":"2023-07-21T22:55:40.398571+0000","last_became_peered":"2023-07-21T22:55:40.398571+0000","last_unstale":"2023-07-21T22:55:41.436447+0000","last_undegraded":"2023-07-21T22:55:41.436447+0000","last_fullsized":"2023-07-21T22:55:41.436447+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:38:51.299341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.442844+0000","last_change":"2023-07-21T22:55:39.407762+0000","last_active":"2023-07-21T22:55:41.442844+0000","last_peered":"2023-07-21T22:55:41.442844+0000","last_clean":"2023-07-21T22:55:41.442844+0000","last_became_active":"2023-07-21T22:55:39.407480+0000","last_became_peered":"2023-07-21T22:55:39.407480+0000","last_unstale":"2023-07-21T22:55:41.442844+0000","last_undegraded":"2023-07-21T22:55:41.442844+0000","last_fullsized":"2023-07-21T22:55:41.442844+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:11:56.687249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":302,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.403629+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:55:41.403629+0000","last_peered":"2023-07-21T22:55:41.403629+0000","last_clean":"2023-07-21T22:55:41.403629+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:55:41.403629+0000","last_undegraded":"2023-07-21T22:55:41.403629+0000","last_fullsized":"2023-07-21T22:55:41.403629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:22:04.828889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.403254+0000","last_change":"2023-07-21T22:55:40.409051+0000","last_active":"2023-07-21T22:55:41.403254+0000","last_peered":"2023-07-21T22:55:41.403254+0000","last_clean":"2023-07-21T22:55:41.403254+0000","last_became_active":"2023-07-21T22:55:40.408373+0000","last_became_peered":"2023-07-21T22:55:40.408373+0000","last_unstale":"2023-07-21T22:55:41.403254+0000","last_undegraded":"2023-07-21T22:55:41.403254+0000","last_fullsized":"2023-07-21T22:55:41.403254+0000","mapping_epoch":172,"log_start":"0'0","ondisk_log_start":"0'0","created":172,"last_epoch_clean":173,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:39.373623+0000","last_clean_scrub_stamp":"2023-07-21T22:55:39.373623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:57:46.769122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"173'8","reported_seq":21,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.410960+0000","last_change":"2023-07-21T22:55:39.408717+0000","last_active":"2023-07-21T22:55:41.410960+0000","last_peered":"2023-07-21T22:55:41.410960+0000","last_clean":"2023-07-21T22:55:41.410960+0000","last_became_active":"2023-07-21T22:55:39.408445+0000","last_became_peered":"2023-07-21T22:55:39.408445+0000","last_unstale":"2023-07-21T22:55:41.410960+0000","last_undegraded":"2023-07-21T22:55:41.410960+0000","last_fullsized":"2023-07-21T22:55:41.410960+0000","mapping_epoch":171,"log_start":"0'0","ondisk_log_start":"0'0","created":171,"last_epoch_clean":172,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:55:38.364321+0000","last_clean_scrub_stamp":"2023-07-21T22:55:38.364321+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:32:45.971726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":284,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-21T22:55:41.443879+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:55:41.443879+0000","last_peered":"2023-07-21T22:55:41.443879+0000","last_clean":"2023-07-21T22:55:41.443879+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:55:41.443879+0000","last_undegraded":"2023-07-21T22:55:41.443879+0000","last_fullsized":"2023-07-21T22:55:41.443879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:29:46.856083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509881,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59984,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94311856,"statfs":{"total":96636764160,"available":96575340544,"internally_reserved":0,"allocated":2760704,"data_stored":1697560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.504,"5min":0.35999999999999999,"15min":0.34999999999999998},"max":{"1min":0.92400000000000004,"5min":1.032,"15min":1.143},"last":0.755},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.55600000000000005,"5min":0.47999999999999998,"15min":0.39000000000000001},"max":{"1min":0.83099999999999996,"5min":0.94699999999999995,"15min":1.0349999999999999},"last":0.70499999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.751,"15min":0.76600000000000001},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.40600000000000003},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73999999999999999,"15min":0.746},"min":{"1min":0.58099999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86399999999999999,"5min":0.97299999999999998,"15min":1.02},"last":0.48699999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.75700000000000001,"15min":0.76000000000000001},"min":{"1min":0.63900000000000001,"5min":0.54800000000000004,"15min":0.47999999999999998},"max":{"1min":0.93200000000000005,"5min":1.0049999999999999,"15min":1.0780000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.77800000000000002,"15min":0.78700000000000003},"min":{"1min":0.627,"5min":0.51100000000000001,"15min":0.42299999999999999},"max":{"1min":0.95199999999999996,"5min":1.02,"15min":1.0660000000000001},"last":0.81399999999999995}]},{"osd":3,"last update":"Fri Jul 21 22:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76800000000000002,"15min":0.78000000000000003},"min":{"1min":0.60399999999999998,"5min":0.48399999999999999,"15min":0.45600000000000002},"max":{"1min":0.98099999999999998,"5min":1.077,"15min":1.0980000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.77600000000000002,"15min":0.78100000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54600000000000004},"max":{"1min":0.88500000000000001,"5min":0.98299999999999998,"15min":1.036},"last":0.59199999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.40500000000000003,"5min":0.36899999999999999,"15min":0.34999999999999998},"max":{"1min":0.70999999999999996,"5min":0.81299999999999994,"15min":0.89700000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.60299999999999998,"15min":0.60499999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.34699999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":1.0940000000000001},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60199999999999998,"15min":0.61099999999999999},"min":{"1min":0.48699999999999999,"5min":0.44900000000000001,"15min":0.41199999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.99399999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66400000000000003,"15min":0.66900000000000004},"min":{"1min":0.49099999999999999,"5min":0.48499999999999999,"15min":0.40699999999999997},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.0429999999999999},"last":0.871}]},{"osd":6,"last update":"Fri Jul 21 22:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67100000000000004,"15min":0.67400000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.45500000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.97399999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.47799999999999998,"5min":0.41299999999999998,"15min":0.41099999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.78100000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542587,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37260,"kb_used_data":2116,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334580,"statfs":{"total":96636764160,"available":96598609920,"internally_reserved":0,"allocated":2166784,"data_stored":1107240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0009999999999999,"5min":1.024,"15min":1.024},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80200000000000005,"15min":0.80800000000000005},"min":{"1min":0.63800000000000001,"5min":0.58299999999999996,"15min":0.54000000000000004},"max":{"1min":1,"5min":1,"15min":1.0780000000000001},"last":0.76400000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.51400000000000001,"5min":0.51000000000000001,"15min":0.50900000000000001},"max":{"1min":0.96199999999999997,"5min":0.96599999999999997,"15min":1.006},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.73999999999999999,"15min":0.74199999999999999},"min":{"1min":0.54200000000000004,"5min":0.48899999999999999,"15min":0.42499999999999999},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.81499999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78500000000000003,"15min":0.78300000000000003},"min":{"1min":0.59599999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.92100000000000004,"5min":1.002,"15min":1.0409999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.80900000000000005,"15min":0.80600000000000005},"min":{"1min":0.61299999999999999,"5min":0.498,"15min":0.46600000000000003},"max":{"1min":0.98799999999999999,"5min":1.0089999999999999,"15min":1.0600000000000001},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.754,"15min":0.754},"min":{"1min":0.66600000000000004,"5min":0.53000000000000003,"15min":0.48999999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76200000000000001,"15min":0.753},"min":{"1min":0.58799999999999997,"5min":0.53300000000000003,"15min":0.52300000000000002},"max":{"1min":0.93000000000000005,"5min":0.96199999999999997,"15min":1.0389999999999999},"last":0.55500000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58899999999999997,"15min":0.58799999999999997},"min":{"1min":0.41599999999999998,"5min":0.39600000000000002,"15min":0.36099999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.92300000000000004},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.46400000000000002,"5min":0.41899999999999998,"15min":0.33500000000000002},"max":{"1min":0.93600000000000005,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61799999999999999,"15min":0.61199999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.40100000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65200000000000002,"15min":0.64700000000000002},"min":{"1min":0.503,"5min":0.44600000000000001,"15min":0.38900000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.96299999999999997},"last":0.82599999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.66100000000000003},"min":{"1min":0.46300000000000002,"5min":0.45600000000000002,"15min":0.38700000000000001},"max":{"1min":0.81999999999999995,"5min":0.91600000000000004,"15min":1.0129999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48299999999999998,"5min":0.46800000000000003,"15min":0.432},"max":{"1min":0.90000000000000002,"5min":0.96299999999999997,"15min":1.0780000000000001},"last":0.70599999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55304,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316536,"statfs":{"total":96636764160,"available":96580132864,"internally_reserved":0,"allocated":2162688,"data_stored":1107170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.57599999999999996,"5min":0.39200000000000002,"15min":0.32100000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.624},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.73099999999999998},"min":{"1min":0.53300000000000003,"5min":0.432,"15min":0.41499999999999998},"max":{"1min":0.91300000000000003,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.70399999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.74299999999999999,"15min":0.73299999999999998},"min":{"1min":0.60799999999999998,"5min":0.495,"15min":0.42399999999999999},"max":{"1min":0.89000000000000001,"5min":0.999,"15min":1.0289999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.745,"15min":0.73999999999999999},"min":{"1min":0.60599999999999998,"5min":0.45800000000000002,"15min":0.42999999999999999},"max":{"1min":0.97999999999999998,"5min":1.054,"15min":1.054},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.752,"15min":0.752},"min":{"1min":0.64300000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.88400000000000001,"5min":1.119,"15min":1.119},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.75700000000000001,"15min":0.748},"min":{"1min":0.57799999999999996,"5min":0.53600000000000003,"15min":0.49299999999999999},"max":{"1min":0.95699999999999996,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.71699999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.79900000000000004,"15min":0.78500000000000003},"min":{"1min":0.69199999999999995,"5min":0.61499999999999999,"15min":0.47299999999999998},"max":{"1min":1.0009999999999999,"5min":1.169,"15min":1.169},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80000000000000004,"15min":0.80700000000000005},"min":{"1min":0.56399999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0169999999999999,"5min":1.0409999999999999,"15min":1.0429999999999999},"last":0.63900000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.38600000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.84799999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68200000000000005,"15min":0.68400000000000005},"min":{"1min":0.47399999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.97999999999999998,"5min":1.01,"15min":1.0369999999999999},"last":0.56000000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.59499999999999997,"15min":0.59099999999999997},"min":{"1min":0.47999999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60899999999999999,"15min":0.60299999999999998},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91900000000000004,"5min":0.93600000000000005,"15min":1.0629999999999999},"last":0.49299999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63600000000000001,"15min":0.65000000000000002},"min":{"1min":0.45700000000000002,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":0.95899999999999996,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72399999999999998,"15min":0.72099999999999997},"min":{"1min":0.51000000000000001,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.74299999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509881,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37268,"kb_used_data":2124,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334572,"statfs":{"total":96636764160,"available":96598601728,"internally_reserved":0,"allocated":2174976,"data_stored":1108734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.73799999999999999,"15min":0.75800000000000001},"min":{"1min":0.64500000000000002,"5min":0.41299999999999998,"15min":0.34599999999999997},"max":{"1min":0.93500000000000005,"5min":0.94199999999999995,"15min":1.0509999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76700000000000002,"15min":0.76800000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.35299999999999998},"max":{"1min":0.96899999999999997,"5min":1.006,"15min":1.03},"last":0.78900000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.72299999999999998,"15min":0.72599999999999998},"min":{"1min":0.55800000000000005,"5min":0.502,"15min":0.432},"max":{"1min":1.0229999999999999,"5min":1.089,"15min":1.089},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.70499999999999996,"15min":0.71299999999999997},"min":{"1min":0.54400000000000004,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":0.871,"5min":0.97599999999999998,"15min":1.0129999999999999},"last":0.68899999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.79100000000000004,"15min":0.78500000000000003},"min":{"1min":0.625,"5min":0.59899999999999998,"15min":0.46899999999999997},"max":{"1min":0.95099999999999996,"5min":1.292,"15min":1.292},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.65100000000000002,"5min":0.51300000000000001,"15min":0.501},"max":{"1min":0.99099999999999999,"5min":1.038,"15min":1.038},"last":0.74199999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.752,"15min":0.747},"min":{"1min":0.68999999999999995,"5min":0.51400000000000001,"15min":0.49299999999999999},"max":{"1min":1.0069999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.70399999999999996,"5min":0.61399999999999999,"15min":0.54200000000000004},"max":{"1min":0.98399999999999999,"5min":1.218,"15min":1.218},"last":0.94299999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.371},"max":{"1min":0.70399999999999996,"5min":1.028,"15min":1.028},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.60599999999999998,"15min":0.59499999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.93300000000000005,"5min":1.151,"15min":1.151},"last":0.86399999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65300000000000002,"15min":0.65500000000000003},"min":{"1min":0.45800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93400000000000005,"5min":1.252,"15min":1.252},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70499999999999996,"15min":0.70799999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.39100000000000001},"max":{"1min":0.80500000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.81999999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65400000000000003,"15min":0.65000000000000002},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89300000000000002,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.68600000000000005,"15min":0.68200000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.42999999999999999},"max":{"1min":0.83999999999999997,"5min":1.206,"15min":1.206},"last":0.91000000000000003}]}]},{"osd":3,"up_from":15,"seq":64424509880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37264,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334576,"statfs":{"total":96636764160,"available":96598605824,"internally_reserved":0,"allocated":2170880,"data_stored":1107786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52500000000000002,"15min":0.505},"min":{"1min":0.32900000000000001,"5min":0.30399999999999999,"15min":0.27900000000000003},"max":{"1min":0.746,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.46000000000000002,"5min":0.441,"15min":0.39300000000000002},"max":{"1min":0.68100000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.51400000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.34000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.64300000000000002,"5min":0.71399999999999997,"15min":0.81599999999999995},"last":0.433},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.441,"5min":0.36099999999999999,"15min":0.35599999999999998},"max":{"1min":0.68700000000000006,"5min":0.79100000000000004,"15min":0.93899999999999995},"last":0.44900000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.45100000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72199999999999998,"5min":0.83199999999999996,"15min":1.0249999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.36299999999999999},"max":{"1min":0.76500000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.78300000000000003,"15min":0.78900000000000003},"min":{"1min":0.53300000000000003,"5min":0.441,"15min":0.441},"max":{"1min":1.071,"5min":1.101,"15min":1.343},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84599999999999997,"15min":0.85099999999999998},"min":{"1min":0.63100000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.002,"5min":1.119,"15min":1.373},"last":0.86399999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79800000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.99099999999999999,"5min":1.085,"15min":1.3799999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80300000000000005,"15min":0.81000000000000005},"min":{"1min":0.69099999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94699999999999995,"5min":1.087,"15min":1.2230000000000001},"last":0.81000000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.81599999999999995},"min":{"1min":0.61799999999999999,"5min":0.55700000000000005,"15min":0.55300000000000005},"max":{"1min":1.0249999999999999,"5min":1.127,"15min":1.2689999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.78600000000000003,"15min":0.79100000000000004},"min":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53000000000000003},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.3660000000000001},"last":0.77700000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:55:01 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83199999999999996,"15min":0.83499999999999996},"min":{"1min":0.56399999999999995,"5min":0.53200000000000003,"15min":0.50900000000000001},"max":{"1min":1.0109999999999999,"5min":1.1399999999999999,"15min":1.4510000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84099999999999997,"15min":0.85499999999999998},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.57299999999999995},"max":{"1min":1.0489999999999999,"5min":1.0820000000000001,"15min":1.427},"last":0.68200000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509882,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55312,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316528,"statfs":{"total":96636764160,"available":96580124672,"internally_reserved":0,"allocated":2170880,"data_stored":1107282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.502,"15min":0.502},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.26500000000000001},"max":{"1min":0.72699999999999998,"5min":0.73999999999999999,"15min":1.0680000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55600000000000005,"15min":0.56699999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.377},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":1.0780000000000001},"last":0.438}]},{"osd":1,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.437,"5min":0.38800000000000001,"15min":0.35599999999999998},"max":{"1min":0.751,"5min":0.86199999999999999,"15min":0.90300000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.60699999999999998},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.752,"5min":0.89100000000000001,"15min":0.91300000000000003},"last":0.52700000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.495,"15min":0.5},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.30399999999999999},"max":{"1min":0.65900000000000003,"5min":0.71099999999999997,"15min":0.92800000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.58999999999999997},"min":{"1min":0.42099999999999999,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":0.80400000000000005,"5min":0.81899999999999995,"15min":0.95399999999999996},"last":0.61099999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.81100000000000005,"15min":0.81499999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.002,"5min":1.1839999999999999,"15min":1.2809999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81699999999999995,"15min":0.82799999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.439},"max":{"1min":1.1359999999999999,"5min":1.391,"15min":1.391},"last":0.83399999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.81000000000000005,"15min":0.81799999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98999999999999999,"5min":1.218,"15min":1.218},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.81999999999999995,"15min":0.83499999999999996},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.47499999999999998},"max":{"1min":1.0660000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.95499999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.81499999999999995,"15min":0.82199999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.495},"max":{"1min":1.048,"5min":1.262,"15min":1.2969999999999999},"last":0.873},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.627,"5min":0.55600000000000005,"15min":0.55500000000000005},"max":{"1min":1.085,"5min":1.214,"15min":1.2390000000000001},"last":0.90100000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:54:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83099999999999996,"15min":0.84499999999999997},"min":{"1min":0.65600000000000003,"5min":0.60199999999999998,"15min":0.51300000000000001},"max":{"1min":1.1200000000000001,"5min":1.2629999999999999,"15min":1.3360000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82799999999999996,"15min":0.84399999999999997},"min":{"1min":0.60599999999999998,"5min":0.57999999999999996,"15min":0.54400000000000004},"max":{"1min":1.101,"5min":1.335,"15min":1.3939999999999999},"last":0.99199999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509881,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37260,"kb_used_data":2116,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334580,"statfs":{"total":96636764160,"available":96598609920,"internally_reserved":0,"allocated":2166784,"data_stored":1107240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.49099999999999999,"15min":0.498},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.61499999999999999,"5min":0.69699999999999995,"15min":0.86499999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61199999999999999,"15min":0.59999999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.437},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.48899999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51600000000000001,"15min":0.52700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33100000000000002},"max":{"1min":0.72299999999999998,"5min":0.80800000000000005,"15min":0.82799999999999996},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89300000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.51200000000000001,"15min":0.52200000000000002},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.86199999999999999},"last":0.35099999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78800000000000003,"15min":0.79800000000000004},"min":{"1min":0.57599999999999996,"5min":0.53700000000000003,"15min":0.46500000000000002},"max":{"1min":0.99099999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.82799999999999996,"15min":0.82599999999999996},"min":{"1min":0.65900000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.302},"last":1.05}]},{"osd":5,"last update":"Fri Jul 21 22:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.80400000000000005,"15min":0.80600000000000005},"min":{"1min":0.55400000000000005,"5min":0.52900000000000003,"15min":0.499},"max":{"1min":0.98199999999999998,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.79900000000000004,"15min":0.81399999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.48799999999999999},"max":{"1min":0.92000000000000004,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.75}]},{"osd":6,"last update":"Fri Jul 21 22:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.83999999999999997,"15min":0.82799999999999996},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.2509999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.089},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79300000000000004,"15min":0.81200000000000006},"min":{"1min":0.50900000000000001,"5min":0.495,"15min":0.495},"max":{"1min":1.042,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.82299999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:55:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.81799999999999995,"15min":0.83299999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96799999999999997,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.83499999999999996,"15min":0.83299999999999996},"min":{"1min":0.63400000000000001,"5min":0.61799999999999999,"15min":0.55000000000000004},"max":{"1min":0.998,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.95299999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37860,"kb_used_data":2716,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333980,"statfs":{"total":96636764160,"available":96597995520,"internally_reserved":0,"allocated":2781184,"data_stored":1699808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.498,"15min":0.48399999999999999},"min":{"1min":0.36699999999999999,"5min":0.29999999999999999,"15min":0.28499999999999998},"max":{"1min":0.79200000000000004,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.38300000000000001,"5min":0.32800000000000001,"15min":0.29799999999999999},"max":{"1min":0.79500000000000004,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.29899999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.54400000000000004},"min":{"1min":0.42899999999999999,"5min":0.378,"15min":0.35899999999999999},"max":{"1min":0.74199999999999999,"5min":0.80900000000000005,"15min":0.87},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51700000000000002,"15min":0.52700000000000002},"min":{"1min":0.38400000000000001,"5min":0.35799999999999998,"15min":0.33900000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.44800000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.622,"15min":0.61899999999999999},"min":{"1min":0.504,"5min":0.47599999999999998,"15min":0.441},"max":{"1min":0.77200000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.46999999999999997,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.73199999999999998,"5min":0.76800000000000002,"15min":0.98599999999999999},"last":0.49299999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.67500000000000004,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.018,"5min":1.081,"15min":1.4370000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.81899999999999995,"15min":0.82599999999999996},"min":{"1min":0.63800000000000001,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2789999999999999},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.81699999999999995,"15min":0.81899999999999995},"min":{"1min":0.61099999999999999,"5min":0.60799999999999998,"15min":0.56599999999999995},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.88,"5min":0.86399999999999999,"15min":0.84999999999999998},"min":{"1min":0.68500000000000005,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1140000000000001,"5min":1.206,"15min":1.351},"last":0.77600000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.85699999999999998,"15min":0.86199999999999999},"min":{"1min":0.70699999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.121,"5min":1.1739999999999999,"15min":1.385},"last":0.754},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.84799999999999998,"15min":0.84299999999999997},"min":{"1min":0.64700000000000002,"5min":0.61899999999999999,"15min":0.60299999999999998},"max":{"1min":1.091,"5min":1.165,"15min":1.347},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.82899999999999996,"15min":0.83399999999999996},"min":{"1min":0.624,"5min":0.624,"15min":0.54100000000000004},"max":{"1min":1.0980000000000001,"5min":1.1100000000000001,"15min":1.3180000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.876,"5min":0.86599999999999999,"15min":0.878},"min":{"1min":0.66200000000000003,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.411},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:55:49.534 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T22:55:49.535 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-21T22:55:49.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.685+0000 7fbd0bb59640 1 Processor -- start 2023-07-21T22:55:49.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.685+0000 7fbd0bb59640 1 -- start start 2023-07-21T22:55:49.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.685+0000 7fbd0bb59640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd0415fc20 0x7fbd040cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:49.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.685+0000 7fbd0bb59640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbd0406c240 0x7fbd04070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:49.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.685+0000 7fbd0bb59640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd04070b30 con 0x7fbd0415fff0 2023-07-21T22:55:49.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.685+0000 7fbd0bb59640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0406b4c0 con 0x7fbd0406c240 2023-07-21T22:55:49.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.685+0000 7fbd0bb59640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0406b760 con 0x7fbd0415fc20 2023-07-21T22:55:49.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.685+0000 7fbd090f4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbd0406c240 0x7fbd04070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:49.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.685+0000 7fbd0a0f6640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbd0415fff0 0x7fbd04163c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53136/0 (socket says 172.21.15.6:53136) 2023-07-21T22:55:49.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.685+0000 7fbd0a0f6640 1 -- 172.21.15.6:0/1479403530 learned_addr learned my addr 172.21.15.6:0/1479403530 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:49.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.685+0000 7fbd098f5640 1 --2- 172.21.15.6:0/1479403530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd0415fc20 0x7fbd040cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:49.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.689+0000 7fbd090f4640 1 -- 172.21.15.6:0/1479403530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd0415fc20 msgr2=0x7fbd040cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:49.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.689+0000 7fbd090f4640 1 --2- 172.21.15.6:0/1479403530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd0415fc20 0x7fbd040cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.689+0000 7fbd090f4640 1 -- 172.21.15.6:0/1479403530 >> v1:172.21.15.6:6789/0 conn(0x7fbd0415fff0 legacy=0x7fbd04163c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:49.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.689+0000 7fbd090f4640 1 -- 172.21.15.6:0/1479403530 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0406ba40 con 0x7fbd0406c240 2023-07-21T22:55:49.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.689+0000 7fbd090f4640 1 --2- 172.21.15.6:0/1479403530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd0406c240 0x7fbd04070ed0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40097c0 tx=0x7fbcf401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af77e10e10d3f939 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:49.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.689+0000 7fbd088f3640 1 -- 172.21.15.6:0/1479403530 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf40a6040 con 0x7fbd0406c240 2023-07-21T22:55:49.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.689+0000 7fbd088f3640 1 -- 172.21.15.6:0/1479403530 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf40aa600 con 0x7fbd0406c240 2023-07-21T22:55:49.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.689+0000 7fbd088f3640 1 -- 172.21.15.6:0/1479403530 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf40aa990 con 0x7fbd0406c240 2023-07-21T22:55:49.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.689+0000 7fbd0bb59640 1 -- 172.21.15.6:0/1479403530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd0406c240 msgr2=0x7fbd04070ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:49.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.689+0000 7fbd0bb59640 1 --2- 172.21.15.6:0/1479403530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd0406c240 0x7fbd04070ed0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40097c0 tx=0x7fbcf401cee0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.689+0000 7fbd0bb59640 1 -- 172.21.15.6:0/1479403530 shutdown_connections 2023-07-21T22:55:49.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.689+0000 7fbd0bb59640 1 --2- 172.21.15.6:0/1479403530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd0406c240 0x7fbd04070ed0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.689+0000 7fbd0bb59640 1 --2- 172.21.15.6:0/1479403530 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd0415fc20 0x7fbd040cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.689+0000 7fbd0bb59640 1 -- 172.21.15.6:0/1479403530 >> 172.21.15.6:0/1479403530 conn(0x7fbd040afac0 msgr2=0x7fbd040afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:49.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.689+0000 7fbd0bb59640 1 -- 172.21.15.6:0/1479403530 shutdown_connections 2023-07-21T22:55:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbd0bb59640 1 -- 172.21.15.6:0/1479403530 wait complete. 2023-07-21T22:55:49.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbd0bb59640 1 Processor -- start 2023-07-21T22:55:49.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbd0bb59640 1 -- start start 2023-07-21T22:55:49.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbd0bb59640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd0406c240 0x7fbd041598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:49.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbd0bb59640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd0415fc20 0x7fbd041525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:49.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbd0bb59640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd0415fff0 0x7fbd04157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:49.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbd0bb59640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd040c2020 con 0x7fbd0415fc20 2023-07-21T22:55:49.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbd0bb59640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd04152ae0 con 0x7fbd0415fff0 2023-07-21T22:55:49.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbd0bb59640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd04152d10 con 0x7fbd0406c240 2023-07-21T22:55:49.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbd090f4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd0415fc20 0x7fbd041525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:49.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbd090f4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd0415fc20 0x7fbd041525a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52154/0 (socket says 172.21.15.6:52154) 2023-07-21T22:55:49.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbd090f4640 1 -- 172.21.15.6:0/3501388256 learned_addr learned my addr 172.21.15.6:0/3501388256 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:49.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbd0a0f6640 1 --2- 172.21.15.6:0/3501388256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd0415fff0 0x7fbd04157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:49.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbd098f5640 1 --2- 172.21.15.6:0/3501388256 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd0406c240 0x7fbd041598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:49.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbd090f4640 1 -- 172.21.15.6:0/3501388256 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd0406c240 msgr2=0x7fbd041598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:49.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbd090f4640 1 --2- 172.21.15.6:0/3501388256 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd0406c240 0x7fbd041598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbd090f4640 1 -- 172.21.15.6:0/3501388256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd0415fff0 msgr2=0x7fbd04157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:49.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbd090f4640 1 --2- 172.21.15.6:0/3501388256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd0415fff0 0x7fbd04157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbd090f4640 1 -- 172.21.15.6:0/3501388256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf4009420 con 0x7fbd0415fc20 2023-07-21T22:55:49.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbd090f4640 1 --2- 172.21.15.6:0/3501388256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd0415fc20 0x7fbd041525a0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fbcf401ab30 tx=0x7fbcf401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:49.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbcfa7fc640 1 -- 172.21.15.6:0/3501388256 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf40b3600 con 0x7fbd0415fc20 2023-07-21T22:55:49.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbcfa7fc640 1 -- 172.21.15.6:0/3501388256 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf40b3780 con 0x7fbd0415fc20 2023-07-21T22:55:49.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.693+0000 7fbcfa7fc640 1 -- 172.21.15.6:0/3501388256 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf40b3b30 con 0x7fbd0415fc20 2023-07-21T22:55:49.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.697+0000 7fbd0bb59640 1 -- 172.21.15.6:0/3501388256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd04152ff0 con 0x7fbd0415fc20 2023-07-21T22:55:49.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.697+0000 7fbd0bb59640 1 -- 172.21.15.6:0/3501388256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd041535b0 con 0x7fbd0415fc20 2023-07-21T22:55:49.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.697+0000 7fbd0bb59640 1 -- 172.21.15.6:0/3501388256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd040c21d0 con 0x7fbd0415fc20 2023-07-21T22:55:49.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.697+0000 7fbcfa7fc640 1 -- 172.21.15.6:0/3501388256 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbcf40b3c90 con 0x7fbd0415fc20 2023-07-21T22:55:49.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.697+0000 7fbcfa7fc640 1 --2- 172.21.15.6:0/3501388256 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbce80663d0 0x7fbce8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:49.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.697+0000 7fbcfa7fc640 1 -- 172.21.15.6:0/3501388256 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fbcf411e2d0 con 0x7fbd0415fc20 2023-07-21T22:55:49.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.697+0000 7fbd098f5640 1 --2- 172.21.15.6:0/3501388256 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbce80663d0 0x7fbce8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:49.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.697+0000 7fbd098f5640 1 --2- 172.21.15.6:0/3501388256 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbce80663d0 0x7fbce8068880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbd00009b60 tx=0x7fbd00009190 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.701+0000 7fbcfa7fc640 1 -- 172.21.15.6:0/3501388256 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbd040c21d0 con 0x7fbd0415fc20 2023-07-21T22:55:49.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.909+0000 7fbd0bb59640 1 -- 172.21.15.6:0/3501388256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbd040c21d0 con 0x7fbd0415fc20 2023-07-21T22:55:49.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.913+0000 7fbcfa7fc640 1 -- 172.21.15.6:0/3501388256 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v29) v1 ==== 190+0+147 (secure 0 0 0) 0x7fbd040c21d0 con 0x7fbd0415fc20 2023-07-21T22:55:49.948 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-07-21T22:55:49.949 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA== 2023-07-21T22:55:49.949 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2023-07-21T22:55:49.949 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2023-07-21T22:55:49.949 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-21T22:55:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-07-21T22:55:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.917+0000 7fbd0bb59640 1 -- 172.21.15.6:0/3501388256 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbce80663d0 msgr2=0x7fbce8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.917+0000 7fbd0bb59640 1 --2- 172.21.15.6:0/3501388256 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbce80663d0 0x7fbce8068880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbd00009b60 tx=0x7fbd00009190 comp rx=0 tx=0).stop 2023-07-21T22:55:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.917+0000 7fbd0bb59640 1 -- 172.21.15.6:0/3501388256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd0415fc20 msgr2=0x7fbd041525a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.917+0000 7fbd0bb59640 1 --2- 172.21.15.6:0/3501388256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd0415fc20 0x7fbd041525a0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fbcf401ab30 tx=0x7fbcf401acc0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.917+0000 7fbd0bb59640 1 -- 172.21.15.6:0/3501388256 shutdown_connections 2023-07-21T22:55:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.917+0000 7fbd0bb59640 1 --2- 172.21.15.6:0/3501388256 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbce80663d0 0x7fbce8068880 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.917+0000 7fbd0bb59640 1 --2- 172.21.15.6:0/3501388256 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd0415fff0 0x7fbd04157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.917+0000 7fbd0bb59640 1 --2- 172.21.15.6:0/3501388256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd0415fc20 0x7fbd041525a0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.917+0000 7fbd0bb59640 1 --2- 172.21.15.6:0/3501388256 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd0406c240 0x7fbd041598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.917+0000 7fbd0bb59640 1 -- 172.21.15.6:0/3501388256 >> 172.21.15.6:0/3501388256 conn(0x7fbd040afac0 msgr2=0x7fbd040ca710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.917+0000 7fbd0bb59640 1 -- 172.21.15.6:0/3501388256 shutdown_connections 2023-07-21T22:55:49.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:49.917+0000 7fbd0bb59640 1 -- 172.21.15.6:0/3501388256 wait complete. 2023-07-21T22:55:49.970 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:55:50.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.077+0000 7f3784f40640 1 Processor -- start 2023-07-21T22:55:50.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.077+0000 7f3784f40640 1 -- start start 2023-07-21T22:55:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.081+0000 7f3784f40640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f378006b8f0 0x7f3780162e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.081+0000 7f3784f40640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f378006f900 con 0x7f378015b7c0 2023-07-21T22:55:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.081+0000 7f3784f40640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f378015bb90 con 0x7f37800cb780 2023-07-21T22:55:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.081+0000 7f3784f40640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37800cdce0 con 0x7f378006b8f0 2023-07-21T22:55:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.081+0000 7f377e59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f378015b7c0 0x7f378006b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53140/0 (socket says 172.21.15.6:53140) 2023-07-21T22:55:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.081+0000 7f377e59c640 1 -- 172.21.15.6:0/254753907 learned_addr learned my addr 172.21.15.6:0/254753907 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.081+0000 7f377ed9d640 1 --2- 172.21.15.6:0/254753907 >> v2:172.21.15.6:3300/0 conn(0x7f378006b8f0 0x7f3780162e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.081+0000 7f377ed9d640 1 -- 172.21.15.6:0/254753907 >> v1:172.21.15.161:6789/0 conn(0x7f37800cb780 legacy=0x7f37800cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.081+0000 7f377ed9d640 1 -- 172.21.15.6:0/254753907 >> v1:172.21.15.6:6789/0 conn(0x7f378015b7c0 legacy=0x7f378006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.081+0000 7f377ed9d640 1 -- 172.21.15.6:0/254753907 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37800cd450 con 0x7f378006b8f0 2023-07-21T22:55:50.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.085+0000 7f377ed9d640 1 --2- 172.21.15.6:0/254753907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f378006b8f0 0x7f3780162e70 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f3778009d90 tx=0x7f377801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a39d3556bdc963d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:50.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.085+0000 7f377dd9b640 1 -- 172.21.15.6:0/254753907 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37780a5880 con 0x7f378006b8f0 2023-07-21T22:55:50.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.085+0000 7f377dd9b640 1 -- 172.21.15.6:0/254753907 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37780a59e0 con 0x7f378006b8f0 2023-07-21T22:55:50.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.085+0000 7f377dd9b640 1 -- 172.21.15.6:0/254753907 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37780a5d70 con 0x7f378006b8f0 2023-07-21T22:55:50.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.085+0000 7f3784f40640 1 -- 172.21.15.6:0/254753907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f378006b8f0 msgr2=0x7f3780162e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:50.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.085+0000 7f3784f40640 1 --2- 172.21.15.6:0/254753907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f378006b8f0 0x7f3780162e70 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f3778009d90 tx=0x7f377801c950 comp rx=0 tx=0).stop 2023-07-21T22:55:50.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.085+0000 7f3784f40640 1 -- 172.21.15.6:0/254753907 shutdown_connections 2023-07-21T22:55:50.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.085+0000 7f3784f40640 1 --2- 172.21.15.6:0/254753907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f378006b8f0 0x7f3780162e70 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.085+0000 7f3784f40640 1 -- 172.21.15.6:0/254753907 >> 172.21.15.6:0/254753907 conn(0x7f37800afcf0 msgr2=0x7f37800b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:50.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.085+0000 7f3784f40640 1 -- 172.21.15.6:0/254753907 shutdown_connections 2023-07-21T22:55:50.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.085+0000 7f3784f40640 1 -- 172.21.15.6:0/254753907 wait complete. 2023-07-21T22:55:50.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.085+0000 7f3784f40640 1 Processor -- start 2023-07-21T22:55:50.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.085+0000 7f3784f40640 1 -- start start 2023-07-21T22:55:50.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f3784f40640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f378006b8f0 0x7f37800ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f3784f40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f378015b7c0 0x7f37800c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f3784f40640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3780149510 0x7f37800ce160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f3784f40640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37800c80f0 con 0x7f3780149510 2023-07-21T22:55:50.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f3784f40640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37800ad470 con 0x7f378006b8f0 2023-07-21T22:55:50.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f3784f40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37800c7330 con 0x7f378015b7c0 2023-07-21T22:55:50.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f377ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3780149510 0x7f37800ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f377ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3780149510 0x7f37800ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52170/0 (socket says 172.21.15.6:52170) 2023-07-21T22:55:50.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f377ed9d640 1 -- 172.21.15.6:0/335671762 learned_addr learned my addr 172.21.15.6:0/335671762 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:50.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f377e59c640 1 --2- 172.21.15.6:0/335671762 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f378006b8f0 0x7f37800ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f3777fff640 1 --2- 172.21.15.6:0/335671762 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f378015b7c0 0x7f37800c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f377ed9d640 1 -- 172.21.15.6:0/335671762 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f378015b7c0 msgr2=0x7f37800c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:50.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f377ed9d640 1 --2- 172.21.15.6:0/335671762 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f378015b7c0 0x7f37800c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f377ed9d640 1 -- 172.21.15.6:0/335671762 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f378006b8f0 msgr2=0x7f37800ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:50.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f377ed9d640 1 --2- 172.21.15.6:0/335671762 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f378006b8f0 0x7f37800ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f377ed9d640 1 -- 172.21.15.6:0/335671762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3778009a70 con 0x7f3780149510 2023-07-21T22:55:50.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f377ed9d640 1 --2- 172.21.15.6:0/335671762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3780149510 0x7f37800ce160 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f377801a580 tx=0x7f37780196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:50.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f3776ffd640 1 -- 172.21.15.6:0/335671762 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37780b9860 con 0x7f3780149510 2023-07-21T22:55:50.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f3776ffd640 1 -- 172.21.15.6:0/335671762 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37780b99c0 con 0x7f3780149510 2023-07-21T22:55:50.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f3776ffd640 1 -- 172.21.15.6:0/335671762 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37780b9d50 con 0x7f3780149510 2023-07-21T22:55:50.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f3784f40640 1 -- 172.21.15.6:0/335671762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37800c7610 con 0x7f3780149510 2023-07-21T22:55:50.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f3784f40640 1 -- 172.21.15.6:0/335671762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37800c7bd0 con 0x7f3780149510 2023-07-21T22:55:50.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.089+0000 7f3784f40640 1 -- 172.21.15.6:0/335671762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37800c7dc0 con 0x7f3780149510 2023-07-21T22:55:50.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.093+0000 7f3776ffd640 1 -- 172.21.15.6:0/335671762 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f37780ad440 con 0x7f3780149510 2023-07-21T22:55:50.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.093+0000 7f3776ffd640 1 --2- 172.21.15.6:0/335671762 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f37600663a0 0x7f3760068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.093+0000 7f3776ffd640 1 -- 172.21.15.6:0/335671762 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f377811f230 con 0x7f3780149510 2023-07-21T22:55:50.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.093+0000 7f377e59c640 1 --2- 172.21.15.6:0/335671762 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f37600663a0 0x7f3760068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.093+0000 7f377e59c640 1 --2- 172.21.15.6:0/335671762 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f37600663a0 0x7f3760068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3770005890 tx=0x7f3770009040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:50.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.097+0000 7f3776ffd640 1 -- 172.21.15.6:0/335671762 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f37780ec7d0 con 0x7f3780149510 2023-07-21T22:55:50.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.285+0000 7f3784f40640 1 -- 172.21.15.6:0/335671762 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37800678d0 con 0x7f3780149510 2023-07-21T22:55:50.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.285+0000 7f3776ffd640 1 -- 172.21.15.6:0/335671762 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4675 (secure 0 0 0) 0x7f37780efdf0 con 0x7f3780149510 2023-07-21T22:55:50.321 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:50.321 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9508,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/1909144233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1909144233},{"type":"v1","addr":"172.21.15.161:6836","nonce":1909144233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9511,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1479759663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1479759663},{"type":"v1","addr":"172.21.15.161:6837","nonce":1479759663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9954,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2241291399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2241291399},{"type":"v1","addr":"172.21.15.6:6834","nonce":2241291399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:55:39.784030+0000","modified":"2023-07-21T22:55:43.422319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9957},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9957":{"gid":9957,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1921950839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1921950839},{"type":"v1","addr":"172.21.15.6:6835","nonce":1921950839}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-21T22:55:50.322 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 78 2023-07-21T22:55:50.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.285+0000 7f3784f40640 1 -- 172.21.15.6:0/335671762 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f37600663a0 msgr2=0x7f3760068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:50.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.285+0000 7f3784f40640 1 --2- 172.21.15.6:0/335671762 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f37600663a0 0x7f3760068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3770005890 tx=0x7f3770009040 comp rx=0 tx=0).stop 2023-07-21T22:55:50.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.285+0000 7f3784f40640 1 -- 172.21.15.6:0/335671762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3780149510 msgr2=0x7f37800ce160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:50.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.285+0000 7f3784f40640 1 --2- 172.21.15.6:0/335671762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3780149510 0x7f37800ce160 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f377801a580 tx=0x7f37780196f0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.285+0000 7f3784f40640 1 -- 172.21.15.6:0/335671762 shutdown_connections 2023-07-21T22:55:50.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.285+0000 7f3784f40640 1 --2- 172.21.15.6:0/335671762 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f37600663a0 0x7f3760068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.285+0000 7f3784f40640 1 --2- 172.21.15.6:0/335671762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3780149510 0x7f37800ce160 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.285+0000 7f3784f40640 1 --2- 172.21.15.6:0/335671762 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f378015b7c0 0x7f37800c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.285+0000 7f3784f40640 1 --2- 172.21.15.6:0/335671762 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f378006b8f0 0x7f37800ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.285+0000 7f3784f40640 1 -- 172.21.15.6:0/335671762 >> 172.21.15.6:0/335671762 conn(0x7f37800afcf0 msgr2=0x7f3780159760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:50.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.285+0000 7f3784f40640 1 -- 172.21.15.6:0/335671762 shutdown_connections 2023-07-21T22:55:50.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.285+0000 7f3784f40640 1 -- 172.21.15.6:0/335671762 wait complete. 2023-07-21T22:55:50.743 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T22:55:39.784030+0000', 'modified': '2023-07-21T22:55:43.422319+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9957}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9957': {'gid': 9957, 'name': 'a', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/1921950839', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 1921950839}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 1921950839}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T22:55:50.744 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T22:55:50.744 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-21T22:55:50.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.857+0000 7fbbf4634640 1 Processor -- start 2023-07-21T22:55:50.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.857+0000 7fbbf4634640 1 -- start start 2023-07-21T22:55:50.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.861+0000 7fbbf4634640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbbec0c9730 0x7fbbec1638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.861+0000 7fbbf4634640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbec0cc700 con 0x7fbbec158ce0 2023-07-21T22:55:50.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.861+0000 7fbbf4634640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbec0b0ff0 con 0x7fbbec0c8ad0 2023-07-21T22:55:50.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.861+0000 7fbbf4634640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbec070c80 con 0x7fbbec0c9730 2023-07-21T22:55:50.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.861+0000 7fbbf23d0640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbbec158ce0 0x7fbbec070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53148/0 (socket says 172.21.15.6:53148) 2023-07-21T22:55:50.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.861+0000 7fbbf23d0640 1 -- 172.21.15.6:0/2566801161 learned_addr learned my addr 172.21.15.6:0/2566801161 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:50.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.861+0000 7fbbf2bd1640 1 --2- 172.21.15.6:0/2566801161 >> v2:172.21.15.6:3300/0 conn(0x7fbbec0c9730 0x7fbbec1638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.861+0000 7fbbf2bd1640 1 -- 172.21.15.6:0/2566801161 >> v1:172.21.15.161:6789/0 conn(0x7fbbec0c8ad0 legacy=0x7fbbec0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:50.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.861+0000 7fbbf2bd1640 1 -- 172.21.15.6:0/2566801161 >> v1:172.21.15.6:6789/0 conn(0x7fbbec158ce0 legacy=0x7fbbec070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:50.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.861+0000 7fbbf2bd1640 1 -- 172.21.15.6:0/2566801161 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec0cbdd0 con 0x7fbbec0c9730 2023-07-21T22:55:50.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.861+0000 7fbbf13ce640 1 -- 172.21.15.6:0/2566801161 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714572102 0 0) 0x7fbbec0cc700 con 0x7fbbec158ce0 2023-07-21T22:55:50.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.861+0000 7fbbf2bd1640 1 --2- 172.21.15.6:0/2566801161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbec0c9730 0x7fbbec1638b0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009d90 tx=0x7fbbe401c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a874b6226af30775 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:50.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.861+0000 7fbbf13ce640 1 -- 172.21.15.6:0/2566801161 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40a5880 con 0x7fbbec0c9730 2023-07-21T22:55:50.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.861+0000 7fbbf13ce640 1 -- 172.21.15.6:0/2566801161 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe40a59e0 con 0x7fbbec0c9730 2023-07-21T22:55:50.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.861+0000 7fbbf13ce640 1 -- 172.21.15.6:0/2566801161 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40a5d70 con 0x7fbbec0c9730 2023-07-21T22:55:50.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.865+0000 7fbbf4634640 1 -- 172.21.15.6:0/2566801161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbec0c9730 msgr2=0x7fbbec1638b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:50.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.865+0000 7fbbf4634640 1 --2- 172.21.15.6:0/2566801161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbec0c9730 0x7fbbec1638b0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009d90 tx=0x7fbbe401c7c0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.865+0000 7fbbf4634640 1 -- 172.21.15.6:0/2566801161 shutdown_connections 2023-07-21T22:55:50.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.865+0000 7fbbf4634640 1 --2- 172.21.15.6:0/2566801161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbec0c9730 0x7fbbec1638b0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.865+0000 7fbbf4634640 1 -- 172.21.15.6:0/2566801161 >> 172.21.15.6:0/2566801161 conn(0x7fbbec0afcf0 msgr2=0x7fbbec0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:50.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.865+0000 7fbbf4634640 1 -- 172.21.15.6:0/2566801161 shutdown_connections 2023-07-21T22:55:50.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.865+0000 7fbbf4634640 1 -- 172.21.15.6:0/2566801161 wait complete. 2023-07-21T22:55:50.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.865+0000 7fbbf4634640 1 Processor -- start 2023-07-21T22:55:50.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.865+0000 7fbbf4634640 1 -- start start 2023-07-21T22:55:50.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.865+0000 7fbbf4634640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbec0c8ad0 0x7fbbec0b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.865+0000 7fbbf4634640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbec0c9730 0x7fbbec0b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.865+0000 7fbbf4634640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbec158ce0 0x7fbbec14c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.865+0000 7fbbf4634640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec14e010 con 0x7fbbec0c8ad0 2023-07-21T22:55:50.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.865+0000 7fbbf4634640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec0b3c30 con 0x7fbbec0c9730 2023-07-21T22:55:50.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.865+0000 7fbbf4634640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec0b3f10 con 0x7fbbec158ce0 2023-07-21T22:55:50.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.865+0000 7fbbf23d0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbec0c8ad0 0x7fbbec0b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.865+0000 7fbbf23d0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbec0c8ad0 0x7fbbec0b1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52188/0 (socket says 172.21.15.6:52188) 2023-07-21T22:55:50.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.865+0000 7fbbf23d0640 1 -- 172.21.15.6:0/2521983 learned_addr learned my addr 172.21.15.6:0/2521983 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:50.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.865+0000 7fbbf2bd1640 1 --2- 172.21.15.6:0/2521983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbec158ce0 0x7fbbec14c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.865+0000 7fbbf1bcf640 1 --2- 172.21.15.6:0/2521983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbec0c9730 0x7fbbec0b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.869+0000 7fbbf23d0640 1 -- 172.21.15.6:0/2521983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbec158ce0 msgr2=0x7fbbec14c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:50.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.869+0000 7fbbf23d0640 1 --2- 172.21.15.6:0/2521983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbec158ce0 0x7fbbec14c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.869+0000 7fbbf23d0640 1 -- 172.21.15.6:0/2521983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbec0c9730 msgr2=0x7fbbec0b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:50.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.869+0000 7fbbf23d0640 1 --2- 172.21.15.6:0/2521983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbec0c9730 0x7fbbec0b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.869+0000 7fbbf23d0640 1 -- 172.21.15.6:0/2521983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe4009a70 con 0x7fbbec0c8ad0 2023-07-21T22:55:50.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.869+0000 7fbbf23d0640 1 --2- 172.21.15.6:0/2521983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbec0c8ad0 0x7fbbec0b1a60 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800c480 tx=0x7fbbe800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:50.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.869+0000 7fbbe2ffd640 1 -- 172.21.15.6:0/2521983 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe80074e0 con 0x7fbbec0c8ad0 2023-07-21T22:55:50.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.869+0000 7fbbe2ffd640 1 -- 172.21.15.6:0/2521983 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe8007660 con 0x7fbbec0c8ad0 2023-07-21T22:55:50.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.869+0000 7fbbf4634640 1 -- 172.21.15.6:0/2521983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbec14e1f0 con 0x7fbbec0c8ad0 2023-07-21T22:55:50.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.869+0000 7fbbe2ffd640 1 -- 172.21.15.6:0/2521983 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8004a30 con 0x7fbbec0c8ad0 2023-07-21T22:55:50.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.869+0000 7fbbf4634640 1 -- 172.21.15.6:0/2521983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbec0b3860 con 0x7fbbec0c8ad0 2023-07-21T22:55:50.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.869+0000 7fbbe2ffd640 1 -- 172.21.15.6:0/2521983 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbbe8004b90 con 0x7fbbec0c8ad0 2023-07-21T22:55:50.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.869+0000 7fbbe2ffd640 1 --2- 172.21.15.6:0/2521983 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbbd00663a0 0x7fbbd0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.869+0000 7fbbe2ffd640 1 -- 172.21.15.6:0/2521983 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fbbe8083060 con 0x7fbbec0c8ad0 2023-07-21T22:55:50.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf797d000 1 Processor -- start 2023-07-21T22:55:50.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf1bcf640 1 --2- 172.21.15.6:0/2521983 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbbd00663a0 0x7fbbd0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf797d000 1 -- start start 2023-07-21T22:55:50.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf1bcf640 1 --2- 172.21.15.6:0/2521983 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbbd00663a0 0x7fbbd0068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbbec1f7420 tx=0x7fbbdc007e40 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:50.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf797d000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727cf00 0x562f5727d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf797d000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f5727d810 0x562f57233370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf797d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 0x562f57233c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf797d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f570fa880 con 0x562f572338b0 2023-07-21T22:55:50.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf797d000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f57034840 con 0x562f5727cf00 2023-07-21T22:55:50.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf797d000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f570882e0 con 0x562f5727d810 2023-07-21T22:55:50.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf2bd1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 0x562f57233c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf2bd1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 0x562f57233c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52192/0 (socket says 172.21.15.6:52192) 2023-07-21T22:55:50.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf2bd1640 1 -- 172.21.15.6:0/391824503 learned_addr learned my addr 172.21.15.6:0/391824503 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:50.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf23d0640 1 --2- 172.21.15.6:0/391824503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727cf00 0x562f5727d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf1bcf640 1 --2- 172.21.15.6:0/391824503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f5727d810 0x562f57233370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf2bd1640 1 -- 172.21.15.6:0/391824503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f5727d810 msgr2=0x562f57233370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:50.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf2bd1640 1 --2- 172.21.15.6:0/391824503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f5727d810 0x562f57233370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf2bd1640 1 -- 172.21.15.6:0/391824503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727cf00 msgr2=0x562f5727d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:50.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf2bd1640 1 --2- 172.21.15.6:0/391824503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727cf00 0x562f5727d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf2bd1640 1 -- 172.21.15.6:0/391824503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f56d7d890 con 0x562f572338b0 2023-07-21T22:55:50.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf23d0640 1 --2- 172.21.15.6:0/391824503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727cf00 0x562f5727d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:55:50.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf2bd1640 1 --2- 172.21.15.6:0/391824503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 0x562f57233c80 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40b0040 tx=0x7fbbe4004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf6b3b8b348b159 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:50.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbcffff640 1 -- 172.21.15.6:0/391824503 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40a5dd0 con 0x562f572338b0 2023-07-21T22:55:50.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbcffff640 1 -- 172.21.15.6:0/391824503 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe40bc070 con 0x562f572338b0 2023-07-21T22:55:50.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbcffff640 1 -- 172.21.15.6:0/391824503 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40c36c0 con 0x562f572338b0 2023-07-21T22:55:50.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf797d000 1 -- 172.21.15.6:0/391824503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 msgr2=0x562f57233c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:50.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf797d000 1 --2- 172.21.15.6:0/391824503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 0x562f57233c80 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40b0040 tx=0x7fbbe4004ac0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf797d000 1 -- 172.21.15.6:0/391824503 shutdown_connections 2023-07-21T22:55:50.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf797d000 1 --2- 172.21.15.6:0/391824503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 0x562f57233c80 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf797d000 1 --2- 172.21.15.6:0/391824503 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f5727d810 0x562f57233370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf797d000 1 --2- 172.21.15.6:0/391824503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727cf00 0x562f5727d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf797d000 1 -- 172.21.15.6:0/391824503 >> 172.21.15.6:0/391824503 conn(0x562f57239a10 msgr2=0x562f57231c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:50.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf797d000 1 -- 172.21.15.6:0/391824503 shutdown_connections 2023-07-21T22:55:50.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.873+0000 7fbbf797d000 1 -- 172.21.15.6:0/391824503 wait complete. 2023-07-21T22:55:50.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf797d000 1 -- start start 2023-07-21T22:55:50.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf797d000 1 Processor -- start 2023-07-21T22:55:50.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf797d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 0x562f57284030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf797d000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727cf00 0x562f57284570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf797d000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f5727d810 0x562f5723e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf797d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f57081380 con 0x562f572338b0 2023-07-21T22:55:50.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf797d000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f5703dae0 con 0x562f5727cf00 2023-07-21T22:55:50.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf797d000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f5703d780 con 0x562f5727d810 2023-07-21T22:55:50.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf797d000 10 client.0 _ll_register_callbacks cb 0x562f5721f240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:55:50.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf23d0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 0x562f57284030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf23d0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 0x562f57284030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52204/0 (socket says 172.21.15.6:52204) 2023-07-21T22:55:50.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf23d0640 1 -- 172.21.15.6:0/2742702867 learned_addr learned my addr 172.21.15.6:0/2742702867 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:50.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf1bcf640 1 --2- 172.21.15.6:0/2742702867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727cf00 0x562f57284570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf2bd1640 1 --2- 172.21.15.6:0/2742702867 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f5727d810 0x562f5723e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf23d0640 1 -- 172.21.15.6:0/2742702867 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f5727d810 msgr2=0x562f5723e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:50.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf23d0640 1 --2- 172.21.15.6:0/2742702867 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f5727d810 0x562f5723e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf23d0640 1 -- 172.21.15.6:0/2742702867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727cf00 msgr2=0x562f57284570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:50.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf23d0640 1 --2- 172.21.15.6:0/2742702867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727cf00 0x562f57284570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf23d0640 1 -- 172.21.15.6:0/2742702867 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbec0b3860 con 0x562f572338b0 2023-07-21T22:55:50.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf23d0640 1 --2- 172.21.15.6:0/2742702867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 0x562f57284030 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8053de0 tx=0x7fbbe8052480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7890193896ba82d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:50.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbcd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:55:50.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbcd7fa640 1 -- 172.21.15.6:0/2742702867 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe806b070 con 0x562f572338b0 2023-07-21T22:55:50.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbcd7fa640 1 -- 172.21.15.6:0/2742702867 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(174..174 src has 1..174) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fbbe8053040 con 0x562f572338b0 2023-07-21T22:55:50.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf797d000 1 -- 172.21.15.6:0/2742702867 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f57048a20 con 0x562f572338b0 2023-07-21T22:55:50.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbcd7fa640 1 -- 172.21.15.6:0/2742702867 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbe8053200 con 0x562f572338b0 2023-07-21T22:55:50.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf797d000 10 client.10131 fetch_fsmap learned FSMap version 78 2023-07-21T22:55:50.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf797d000 1 -- 172.21.15.6:0/2742702867 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x7fbbec0cbdd0 con 0x562f572338b0 2023-07-21T22:55:50.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbcd7fa640 1 -- 172.21.15.6:0/2742702867 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562f57048a20 con 0x562f572338b0 2023-07-21T22:55:50.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbcd7fa640 1 -- 172.21.15.6:0/2742702867 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 78) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fbbe806ba00 con 0x562f572338b0 2023-07-21T22:55:50.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf797d000 10 client.10131 fetch_fsmap finished waiting for FSMap version 78 2023-07-21T22:55:50.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf797d000 10 client.10131 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-21T22:55:50.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf797d000 20 client.10131 populate_metadata read hostname 'smithi006' 2023-07-21T22:55:50.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf797d000 1 --2- 172.21.15.6:0/2742702867 >> [v2:172.21.15.6:6833/1921950839,v1:172.21.15.6:6835/1921950839] conn(0x562f5723f230 0x562f5723f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf797d000 4 client.10131 mds_command: new command op to 9957 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:55:50.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf797d000 1 -- 172.21.15.6:0/2742702867 --> [v2:172.21.15.6:6833/1921950839,v1:172.21.15.6:6835/1921950839] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f570afec0 con 0x562f5723f230 2023-07-21T22:55:50.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.877+0000 7fbbf1bcf640 1 --2- 172.21.15.6:0/2742702867 >> [v2:172.21.15.6:6833/1921950839,v1:172.21.15.6:6835/1921950839] conn(0x562f5723f230 0x562f5723f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.881+0000 7fbbf1bcf640 1 --2- 172.21.15.6:0/2742702867 >> [v2:172.21.15.6:6833/1921950839,v1:172.21.15.6:6835/1921950839] conn(0x562f5723f230 0x562f5723f600 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77221408e01c280c server_cookie=aa6d6046bbe4a3e2 in_seq=0 out_seq=0 2023-07-21T22:55:50.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.881+0000 7fbbcd7fa640 10 client.10131 ms_handle_connect on v2:172.21.15.6:6833/1921950839 2023-07-21T22:55:50.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.881+0000 7fbbcd7fa640 1 -- 172.21.15.6:0/2742702867 <== mds.0 v2:172.21.15.6:6833/1921950839 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562f570afec0 con 0x562f5723f230 2023-07-21T22:55:50.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.881+0000 7fbbcd7fa640 10 client.10131 handle_command_reply: tid=0 2023-07-21T22:55:50.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.881+0000 7fbbf797d000 1 client.10131 shutdown 2023-07-21T22:55:50.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.881+0000 7fbbf797d000 1 -- 172.21.15.6:0/2742702867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 msgr2=0x562f57284030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:50.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.881+0000 7fbbf797d000 1 --2- 172.21.15.6:0/2742702867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 0x562f57284030 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8053de0 tx=0x7fbbe8052480 comp rx=0 tx=0).stop 2023-07-21T22:55:50.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.881+0000 7fbbf797d000 1 -- 172.21.15.6:0/2742702867 shutdown_connections 2023-07-21T22:55:50.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.881+0000 7fbbf797d000 1 --2- 172.21.15.6:0/2742702867 >> [v2:172.21.15.6:6833/1921950839,v1:172.21.15.6:6835/1921950839] conn(0x562f5723f230 0x562f5723f600 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.881+0000 7fbbf797d000 1 --2- 172.21.15.6:0/2742702867 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f5727d810 0x562f5723e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.881+0000 7fbbf797d000 1 --2- 172.21.15.6:0/2742702867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727cf00 0x562f57284570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.881+0000 7fbbcd7fa640 0 client.10131 ms_handle_reset on v2:172.21.15.6:6833/1921950839 2023-07-21T22:55:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.881+0000 7fbbf797d000 1 --2- 172.21.15.6:0/2742702867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 0x562f57284030 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.881+0000 7fbbf797d000 1 -- 172.21.15.6:0/2742702867 >> 172.21.15.6:0/2742702867 conn(0x562f57239a10 msgr2=0x562f57232350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.881+0000 7fbbf797d000 1 -- 172.21.15.6:0/2742702867 shutdown_connections 2023-07-21T22:55:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.881+0000 7fbbf797d000 1 -- 172.21.15.6:0/2742702867 wait complete. 2023-07-21T22:55:50.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.881+0000 7fbbf797d000 20 client.10131 trim_cache size 0 max 16384 2023-07-21T22:55:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf797d000 1 Processor -- start 2023-07-21T22:55:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf797d000 1 -- start start 2023-07-21T22:55:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf797d000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f572338b0 0x562f572d6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf797d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f5727cf00 0x562f572d7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf797d000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727d810 0x562f572d7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf797d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f56d3e940 con 0x562f5727cf00 2023-07-21T22:55:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf797d000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f5728aab0 con 0x562f5727d810 2023-07-21T22:55:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf797d000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f570564c0 con 0x562f572338b0 2023-07-21T22:55:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf1bcf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f5727cf00 0x562f572d7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf1bcf640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f5727cf00 0x562f572d7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52218/0 (socket says 172.21.15.6:52218) 2023-07-21T22:55:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf1bcf640 1 -- 172.21.15.6:0/2514051670 learned_addr learned my addr 172.21.15.6:0/2514051670 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf2bd1640 1 --2- 172.21.15.6:0/2514051670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727d810 0x562f572d7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf23d0640 1 --2- 172.21.15.6:0/2514051670 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f572338b0 0x562f572d6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf1bcf640 1 -- 172.21.15.6:0/2514051670 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f572338b0 msgr2=0x562f572d6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:50.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf1bcf640 1 --2- 172.21.15.6:0/2514051670 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f572338b0 0x562f572d6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf1bcf640 1 -- 172.21.15.6:0/2514051670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727d810 msgr2=0x562f572d7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:50.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf1bcf640 1 --2- 172.21.15.6:0/2514051670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727d810 0x562f572d7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf1bcf640 1 -- 172.21.15.6:0/2514051670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f57235f80 con 0x562f5727cf00 2023-07-21T22:55:50.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf2bd1640 1 --2- 172.21.15.6:0/2514051670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727d810 0x562f572d7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf1bcf640 1 --2- 172.21.15.6:0/2514051670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f5727cf00 0x562f572d7010 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc004ab0 tx=0x7fbbdc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82addca1be2abcc5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbe0ff9640 1 -- 172.21.15.6:0/2514051670 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc029e40 con 0x562f5727cf00 2023-07-21T22:55:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbe0ff9640 1 -- 172.21.15.6:0/2514051670 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc029290 con 0x562f5727cf00 2023-07-21T22:55:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbe0ff9640 1 -- 172.21.15.6:0/2514051670 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc029600 con 0x562f5727cf00 2023-07-21T22:55:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf797d000 1 -- 172.21.15.6:0/2514051670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f5727cf00 msgr2=0x562f572d7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf797d000 1 --2- 172.21.15.6:0/2514051670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f5727cf00 0x562f572d7010 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc004ab0 tx=0x7fbbdc014000 comp rx=0 tx=0).stop 2023-07-21T22:55:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf797d000 1 -- 172.21.15.6:0/2514051670 shutdown_connections 2023-07-21T22:55:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf797d000 1 --2- 172.21.15.6:0/2514051670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727d810 0x562f572d7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf797d000 1 --2- 172.21.15.6:0/2514051670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f5727cf00 0x562f572d7010 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf797d000 1 --2- 172.21.15.6:0/2514051670 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f572338b0 0x562f572d6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf797d000 1 -- 172.21.15.6:0/2514051670 >> 172.21.15.6:0/2514051670 conn(0x562f57239a10 msgr2=0x562f57237970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf797d000 1 -- 172.21.15.6:0/2514051670 shutdown_connections 2023-07-21T22:55:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.897+0000 7fbbf797d000 1 -- 172.21.15.6:0/2514051670 wait complete. 2023-07-21T22:55:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf797d000 1 -- start start 2023-07-21T22:55:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf797d000 1 Processor -- start 2023-07-21T22:55:50.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf797d000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 0x562f57281820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf797d000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f5727cf00 0x562f57281d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf797d000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727d810 0x562f572822a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf797d000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f5704fe10 con 0x562f572338b0 2023-07-21T22:55:50.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf797d000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f57030310 con 0x562f5727d810 2023-07-21T22:55:50.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf797d000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x562f570f61a0 con 0x562f5727cf00 2023-07-21T22:55:50.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf797d000 10 client.0 _ll_register_callbacks cb 0x562f571ff430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:55:50.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf23d0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 0x562f57281820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf23d0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 0x562f57281820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52232/0 (socket says 172.21.15.6:52232) 2023-07-21T22:55:50.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf23d0640 1 -- 172.21.15.6:0/3894789759 learned_addr learned my addr 172.21.15.6:0/3894789759 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:50.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf2bd1640 1 --2- 172.21.15.6:0/3894789759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727d810 0x562f572822a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf1bcf640 1 --2- 172.21.15.6:0/3894789759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f5727cf00 0x562f57281d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf23d0640 1 -- 172.21.15.6:0/3894789759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f5727cf00 msgr2=0x562f57281d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:50.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf23d0640 1 --2- 172.21.15.6:0/3894789759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f5727cf00 0x562f57281d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf23d0640 1 -- 172.21.15.6:0/3894789759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727d810 msgr2=0x562f572822a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:50.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf23d0640 1 --2- 172.21.15.6:0/3894789759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727d810 0x562f572822a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf23d0640 1 -- 172.21.15.6:0/3894789759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbdc00f840 con 0x562f572338b0 2023-07-21T22:55:50.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf1bcf640 1 --2- 172.21.15.6:0/3894789759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f5727cf00 0x562f57281d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:50.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf2bd1640 1 --2- 172.21.15.6:0/3894789759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727d810 0x562f572822a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:50.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf23d0640 1 --2- 172.21.15.6:0/3894789759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 0x562f57281820 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8053bb0 tx=0x7fbbe8050420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea0327634245c8b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:50.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbcd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:55:50.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbcd7fa640 1 -- 172.21.15.6:0/3894789759 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe806b040 con 0x562f572338b0 2023-07-21T22:55:50.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbcd7fa640 1 -- 172.21.15.6:0/3894789759 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(174..174 src has 1..174) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fbbe8004e40 con 0x562f572338b0 2023-07-21T22:55:50.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf797d000 1 -- 172.21.15.6:0/3894789759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f5707fcd0 con 0x562f572338b0 2023-07-21T22:55:50.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbcd7fa640 1 -- 172.21.15.6:0/3894789759 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbe8058080 con 0x562f572338b0 2023-07-21T22:55:50.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf797d000 10 client.10137 fetch_fsmap learned FSMap version 78 2023-07-21T22:55:50.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf797d000 1 -- 172.21.15.6:0/3894789759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x562f57045d10 con 0x562f572338b0 2023-07-21T22:55:50.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbcd7fa640 1 -- 172.21.15.6:0/3894789759 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562f5707fcd0 con 0x562f572338b0 2023-07-21T22:55:50.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbcd7fa640 1 -- 172.21.15.6:0/3894789759 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 78) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fbbe80540e0 con 0x562f572338b0 2023-07-21T22:55:50.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf797d000 10 client.10137 fetch_fsmap finished waiting for FSMap version 78 2023-07-21T22:55:50.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf797d000 10 client.10137 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-21T22:55:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf797d000 20 client.10137 populate_metadata read hostname 'smithi006' 2023-07-21T22:55:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf797d000 1 --2- 172.21.15.6:0/3894789759 >> [v2:172.21.15.6:6833/1921950839,v1:172.21.15.6:6835/1921950839] conn(0x562f57282c60 0x562f572e2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf797d000 4 client.10137 mds_command: new command op to 9957 tid=0[{"prefix": "status"}] 2023-07-21T22:55:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf797d000 1 -- 172.21.15.6:0/3894789759 --> [v2:172.21.15.6:6833/1921950839,v1:172.21.15.6:6835/1921950839] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562f5707a360 con 0x562f57282c60 2023-07-21T22:55:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf1bcf640 1 --2- 172.21.15.6:0/3894789759 >> [v2:172.21.15.6:6833/1921950839,v1:172.21.15.6:6835/1921950839] conn(0x562f57282c60 0x562f572e2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbf1bcf640 1 --2- 172.21.15.6:0/3894789759 >> [v2:172.21.15.6:6833/1921950839,v1:172.21.15.6:6835/1921950839] conn(0x562f57282c60 0x562f572e2d60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d66720b8bf918ce4 server_cookie=8e6ef4acf3499ea7 in_seq=0 out_seq=0 2023-07-21T22:55:50.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.901+0000 7fbbcd7fa640 10 client.10137 ms_handle_connect on v2:172.21.15.6:6833/1921950839 2023-07-21T22:55:50.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbcd7fa640 1 -- 172.21.15.6:0/3894789759 <== mds.0 v2:172.21.15.6:6833/1921950839 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x562f5707a360 con 0x562f57282c60 2023-07-21T22:55:50.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbcd7fa640 10 client.10137 handle_command_reply: tid=0 2023-07-21T22:55:50.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf797d000 1 client.10137 shutdown 2023-07-21T22:55:50.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf797d000 1 -- 172.21.15.6:0/3894789759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 msgr2=0x562f57281820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:50.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf797d000 1 --2- 172.21.15.6:0/3894789759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 0x562f57281820 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8053bb0 tx=0x7fbbe8050420 comp rx=0 tx=0).stop 2023-07-21T22:55:50.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf797d000 1 -- 172.21.15.6:0/3894789759 shutdown_connections 2023-07-21T22:55:50.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf797d000 1 --2- 172.21.15.6:0/3894789759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x562f5727d810 0x562f572822a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf797d000 1 --2- 172.21.15.6:0/3894789759 >> [v2:172.21.15.6:6833/1921950839,v1:172.21.15.6:6835/1921950839] conn(0x562f57282c60 0x562f572e2d60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf797d000 1 --2- 172.21.15.6:0/3894789759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x562f5727cf00 0x562f57281d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf797d000 1 --2- 172.21.15.6:0/3894789759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f572338b0 0x562f57281820 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbcd7fa640 0 client.10137 ms_handle_reset on v2:172.21.15.6:6833/1921950839 2023-07-21T22:55:50.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf797d000 1 -- 172.21.15.6:0/3894789759 >> 172.21.15.6:0/3894789759 conn(0x562f57239a10 msgr2=0x562f57238200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:50.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf797d000 1 -- 172.21.15.6:0/3894789759 shutdown_connections 2023-07-21T22:55:50.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf797d000 1 -- 172.21.15.6:0/3894789759 wait complete. 2023-07-21T22:55:50.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf797d000 20 client.10137 trim_cache size 0 max 16384 2023-07-21T22:55:50.948 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:55:50.948 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "f3073df4-6cd1-4503-bd2e-d3e98fa18bdf", 2023-07-21T22:55:50.948 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-07-21T22:55:50.948 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 9957, 2023-07-21T22:55:50.949 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-07-21T22:55:50.949 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-07-21T22:55:50.949 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-07-21T22:55:50.949 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.506144762, 2023-07-21T22:55:50.949 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 78, 2023-07-21T22:55:50.949 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 174, 2023-07-21T22:55:50.949 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 174, 2023-07-21T22:55:50.949 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 16.437877084 2023-07-21T22:55:50.950 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:55:50.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf4634640 1 -- 172.21.15.6:0/2521983 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbbd00663a0 msgr2=0x7fbbd0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:50.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf4634640 1 --2- 172.21.15.6:0/2521983 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbbd00663a0 0x7fbbd0068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbbec1f7420 tx=0x7fbbdc007e40 comp rx=0 tx=0).stop 2023-07-21T22:55:50.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf4634640 1 -- 172.21.15.6:0/2521983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbec0c8ad0 msgr2=0x7fbbec0b1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:50.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf4634640 1 --2- 172.21.15.6:0/2521983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbec0c8ad0 0x7fbbec0b1a60 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800c480 tx=0x7fbbe800c940 comp rx=0 tx=0).stop 2023-07-21T22:55:50.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf4634640 1 -- 172.21.15.6:0/2521983 shutdown_connections 2023-07-21T22:55:50.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf4634640 1 --2- 172.21.15.6:0/2521983 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fbbd00663a0 0x7fbbd0068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf4634640 1 --2- 172.21.15.6:0/2521983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbec158ce0 0x7fbbec14c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf4634640 1 --2- 172.21.15.6:0/2521983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbec0c9730 0x7fbbec0b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf4634640 1 --2- 172.21.15.6:0/2521983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbbec0c8ad0 0x7fbbec0b1a60 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:50.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf4634640 1 -- 172.21.15.6:0/2521983 >> 172.21.15.6:0/2521983 conn(0x7fbbec0afcf0 msgr2=0x7fbbec157770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:50.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf4634640 1 -- 172.21.15.6:0/2521983 shutdown_connections 2023-07-21T22:55:50.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:50.905+0000 7fbbf4634640 1 -- 172.21.15.6:0/2521983 wait complete. 2023-07-21T22:55:50.959 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:55:51.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.069+0000 7fe7b2696640 1 Processor -- start 2023-07-21T22:55:51.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.069+0000 7fe7b2696640 1 -- start start 2023-07-21T22:55:51.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.069+0000 7fe7b2696640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe7ac0ae1f0 0x7fe7ac0b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:51.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.069+0000 7fe7b2696640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe7ac06e160 0x7fe7ac06bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:51.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.069+0000 7fe7b2696640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7ac06a440 con 0x7fe7ac06c260 2023-07-21T22:55:51.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.069+0000 7fe7b2696640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7ac06c660 con 0x7fe7ac0ae1f0 2023-07-21T22:55:51.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.069+0000 7fe7b2696640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7ac0b24f0 con 0x7fe7ac06e160 2023-07-21T22:55:51.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.069+0000 7fe7abfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe7ac0ae1f0 0x7fe7ac0b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:51.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.069+0000 7fe7abfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe7ac0ae1f0 0x7fe7ac0b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52244/0 (socket says 172.21.15.6:52244) 2023-07-21T22:55:51.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.069+0000 7fe7abfff640 1 -- 172.21.15.6:0/1368805555 learned_addr learned my addr 172.21.15.6:0/1368805555 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:51.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.069+0000 7fe7ab7fe640 1 --2- 172.21.15.6:0/1368805555 >> v2:172.21.15.161:3300/0 conn(0x7fe7ac06e160 0x7fe7ac06bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:51.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.069+0000 7fe7abfff640 1 -- 172.21.15.6:0/1368805555 >> v2:172.21.15.161:3300/0 conn(0x7fe7ac06e160 msgr2=0x7fe7ac06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:51.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.069+0000 7fe7abfff640 1 --2- 172.21.15.6:0/1368805555 >> v2:172.21.15.161:3300/0 conn(0x7fe7ac06e160 0x7fe7ac06bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:51.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.069+0000 7fe7abfff640 1 -- 172.21.15.6:0/1368805555 >> v1:172.21.15.161:6789/0 conn(0x7fe7ac06c260 legacy=0x7fe7ac15f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:51.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.069+0000 7fe7abfff640 1 -- 172.21.15.6:0/1368805555 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac0b27d0 con 0x7fe7ac0ae1f0 2023-07-21T22:55:51.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.069+0000 7fe7ab7fe640 1 --2- 172.21.15.6:0/1368805555 >> v2:172.21.15.161:3300/0 conn(0x7fe7ac06e160 0x7fe7ac06bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:51.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.073+0000 7fe7abfff640 1 --2- 172.21.15.6:0/1368805555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ac0ae1f0 0x7fe7ac0b1e60 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0cf720 tx=0x7fe79c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8412355f7e959f1f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:51.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.073+0000 7fe7aaffd640 1 -- 172.21.15.6:0/1368805555 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c0ab5f0 con 0x7fe7ac0ae1f0 2023-07-21T22:55:51.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.073+0000 7fe7aaffd640 1 -- 172.21.15.6:0/1368805555 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c0ab750 con 0x7fe7ac0ae1f0 2023-07-21T22:55:51.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.073+0000 7fe7aaffd640 1 -- 172.21.15.6:0/1368805555 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c0abae0 con 0x7fe7ac0ae1f0 2023-07-21T22:55:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.073+0000 7fe7b2696640 1 -- 172.21.15.6:0/1368805555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ac0ae1f0 msgr2=0x7fe7ac0b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.073+0000 7fe7b2696640 1 --2- 172.21.15.6:0/1368805555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ac0ae1f0 0x7fe7ac0b1e60 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0cf720 tx=0x7fe79c01c4d0 comp rx=0 tx=0).stop 2023-07-21T22:55:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.073+0000 7fe7b2696640 1 -- 172.21.15.6:0/1368805555 shutdown_connections 2023-07-21T22:55:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.073+0000 7fe7b2696640 1 --2- 172.21.15.6:0/1368805555 >> v2:172.21.15.161:3300/0 conn(0x7fe7ac06e160 0x7fe7ac06bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.073+0000 7fe7b2696640 1 --2- 172.21.15.6:0/1368805555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ac0ae1f0 0x7fe7ac0b1e60 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:51.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.073+0000 7fe7b2696640 1 -- 172.21.15.6:0/1368805555 >> 172.21.15.6:0/1368805555 conn(0x7fe7ac0b1300 msgr2=0x7fe7ac0ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.073+0000 7fe7b2696640 1 -- 172.21.15.6:0/1368805555 shutdown_connections 2023-07-21T22:55:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.073+0000 7fe7b2696640 1 -- 172.21.15.6:0/1368805555 wait complete. 2023-07-21T22:55:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7b2696640 1 Processor -- start 2023-07-21T22:55:51.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7b2696640 1 -- start start 2023-07-21T22:55:51.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7b2696640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7ac06c260 0x7fe7ac0c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:51.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7b2696640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ac06e160 0x7fe7ac142bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:51.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7b2696640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7ac0ae1f0 0x7fe7ac131d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:51.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7b2696640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac132e60 con 0x7fe7ac06e160 2023-07-21T22:55:51.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7b2696640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac0699d0 con 0x7fe7ac0ae1f0 2023-07-21T22:55:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7b2696640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ac0c3e20 con 0x7fe7ac06c260 2023-07-21T22:55:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7ab7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ac06e160 0x7fe7ac142bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7ab7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ac06e160 0x7fe7ac142bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52248/0 (socket says 172.21.15.6:52248) 2023-07-21T22:55:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7ab7fe640 1 -- 172.21.15.6:0/4073595308 learned_addr learned my addr 172.21.15.6:0/4073595308 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7abfff640 1 --2- 172.21.15.6:0/4073595308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7ac06c260 0x7fe7ac0c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7b0c33640 1 --2- 172.21.15.6:0/4073595308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7ac0ae1f0 0x7fe7ac131d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:51.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7ab7fe640 1 -- 172.21.15.6:0/4073595308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7ac06c260 msgr2=0x7fe7ac0c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:51.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7ab7fe640 1 --2- 172.21.15.6:0/4073595308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7ac06c260 0x7fe7ac0c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:51.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7ab7fe640 1 -- 172.21.15.6:0/4073595308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7ac0ae1f0 msgr2=0x7fe7ac131d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:51.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7ab7fe640 1 --2- 172.21.15.6:0/4073595308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7ac0ae1f0 0x7fe7ac131d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:51.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7ab7fe640 1 -- 172.21.15.6:0/4073595308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c0094d0 con 0x7fe7ac06e160 2023-07-21T22:55:51.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7b0c33640 1 --2- 172.21.15.6:0/4073595308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7ac0ae1f0 0x7fe7ac131d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:55:51.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7abfff640 1 --2- 172.21.15.6:0/4073595308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7ac06c260 0x7fe7ac0c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:55:51.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7ab7fe640 1 --2- 172.21.15.6:0/4073595308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ac06e160 0x7fe7ac142bc0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fe7a000e810 tx=0x7fe7a000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:51.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7a8ff9640 1 -- 172.21.15.6:0/4073595308 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a000c8d0 con 0x7fe7ac06e160 2023-07-21T22:55:51.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7a8ff9640 1 -- 172.21.15.6:0/4073595308 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a000ca30 con 0x7fe7ac06e160 2023-07-21T22:55:51.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7a8ff9640 1 -- 172.21.15.6:0/4073595308 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a000cde0 con 0x7fe7ac06e160 2023-07-21T22:55:51.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7b2696640 1 -- 172.21.15.6:0/4073595308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7ac069f00 con 0x7fe7ac06e160 2023-07-21T22:55:51.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.077+0000 7fe7b2696640 1 -- 172.21.15.6:0/4073595308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7ac069c20 con 0x7fe7ac06e160 2023-07-21T22:55:51.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.081+0000 7fe7b2696640 1 -- 172.21.15.6:0/4073595308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7ac0678d0 con 0x7fe7ac06e160 2023-07-21T22:55:51.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.081+0000 7fe7a8ff9640 1 -- 172.21.15.6:0/4073595308 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe7a0013410 con 0x7fe7ac06e160 2023-07-21T22:55:51.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.081+0000 7fe7a8ff9640 1 --2- 172.21.15.6:0/4073595308 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fe7980663a0 0x7fe798068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:51.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.081+0000 7fe7a8ff9640 1 -- 172.21.15.6:0/4073595308 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fe7a0083ea0 con 0x7fe7ac06e160 2023-07-21T22:55:51.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.081+0000 7fe7abfff640 1 --2- 172.21.15.6:0/4073595308 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fe7980663a0 0x7fe798068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:51.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.081+0000 7fe7abfff640 1 --2- 172.21.15.6:0/4073595308 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fe7980663a0 0x7fe798068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0af000 tx=0x7fe79c008040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:51.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.085+0000 7fe7a8ff9640 1 -- 172.21.15.6:0/4073595308 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe7a0051010 con 0x7fe7ac06e160 2023-07-21T22:55:51.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.281+0000 7fe7b2696640 1 -- 172.21.15.6:0/4073595308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe7ac066810 con 0x7fe7ac06e160 2023-07-21T22:55:51.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.281+0000 7fe7a8ff9640 1 -- 172.21.15.6:0/4073595308 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v78) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe7a0054630 con 0x7fe7ac06e160 2023-07-21T22:55:51.317 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T22:55:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.285+0000 7fe7b2696640 1 -- 172.21.15.6:0/4073595308 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fe7980663a0 msgr2=0x7fe798068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.285+0000 7fe7b2696640 1 --2- 172.21.15.6:0/4073595308 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fe7980663a0 0x7fe798068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe79c0af000 tx=0x7fe79c008040 comp rx=0 tx=0).stop 2023-07-21T22:55:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.285+0000 7fe7b2696640 1 -- 172.21.15.6:0/4073595308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ac06e160 msgr2=0x7fe7ac142bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.285+0000 7fe7b2696640 1 --2- 172.21.15.6:0/4073595308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ac06e160 0x7fe7ac142bc0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fe7a000e810 tx=0x7fe7a000ecd0 comp rx=0 tx=0).stop 2023-07-21T22:55:51.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.285+0000 7fe7b2696640 1 -- 172.21.15.6:0/4073595308 shutdown_connections 2023-07-21T22:55:51.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.285+0000 7fe7b2696640 1 --2- 172.21.15.6:0/4073595308 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fe7980663a0 0x7fe798068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:51.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.285+0000 7fe7b2696640 1 --2- 172.21.15.6:0/4073595308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7ac0ae1f0 0x7fe7ac131d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:51.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.285+0000 7fe7b2696640 1 --2- 172.21.15.6:0/4073595308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ac06e160 0x7fe7ac142bc0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:51.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.285+0000 7fe7b2696640 1 --2- 172.21.15.6:0/4073595308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe7ac06c260 0x7fe7ac0c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:51.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.285+0000 7fe7b2696640 1 -- 172.21.15.6:0/4073595308 >> 172.21.15.6:0/4073595308 conn(0x7fe7ac0b1300 msgr2=0x7fe7ac06a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:51.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.285+0000 7fe7b2696640 1 -- 172.21.15.6:0/4073595308 shutdown_connections 2023-07-21T22:55:51.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:51.285+0000 7fe7b2696640 1 -- 172.21.15.6:0/4073595308 wait complete. 2023-07-21T22:55:51.338 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-21T22:55:51.339 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:55:51.340 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-07-21T22:55:51.340 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T22:55:51.341 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T22:55:51.342 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-21T22:55:51.342 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-21T22:55:51.343 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:55:51.344 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:55:51.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:51.346 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-07-21T22:55:51.356 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:55:51.356 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:55:51.356 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:55:51.357 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:55:51.357 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-21T22:55:51.357 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:55:51.357 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:55:51.357 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:55:51.357 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-07-21T22:55:51.358 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:55:51.358 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:55:51.358 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-07-21T22:55:51.358 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:55:51.358 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:55:51.358 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-07-21T22:55:51.358 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:55:51.358 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 39894sec preferred_lft 39894sec 2023-07-21T22:55:51.359 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-07-21T22:55:51.359 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:55:51.359 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:55:51.359 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:55:51.359 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-07-21T22:55:51.359 INFO:teuthology.orchestra.run.smithi006.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:55:51.359 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:42:2f:9a:3d:15 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:55:51.360 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:55:51.360 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:55:51.360 INFO:teuthology.orchestra.run.smithi006.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:55:51.360 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-21T22:55:51.360 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T22:55:51.360 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:55:51.360 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-21T22:55:51.360 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:55:51.361 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:55:51.361 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:55:51.361 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-21T22:55:51.361 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:55:51.361 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:55:51.361 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T22:55:51.361 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-21T22:55:51.362 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:55:51.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:51.363 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:55:51.425 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-07-21T22:55:51.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:51.429 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-07-21T22:55:51.480 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-07-21T22:55:51.480 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:55:51.480 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:55:51.480 INFO:teuthology.orchestra.run.smithi006.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:55:51.481 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:55:51.481 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:55:51.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:51.482 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T22:55:51.482 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T22:55:51.482 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:55:51.483 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:55:51.483 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:55:51.483 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T22:55:51.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:51.580 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T22:55:51.590 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-21T22:55:51.591 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T22:55:51.591 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:55:51.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:51.592 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-07-21T22:55:51.655 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:55:51.656 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T22:55:51.706 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:55:51.707 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:55:51.707 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:55:51.758 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-21T22:55:51.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:51.759 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:55:51.853 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:55:51.854 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:55:51.854 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:55:51.870 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:55:51.870 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:55:51.870 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:55:51.871 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:55:51.871 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:55:51.878 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:55:51.878 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:55:51.879 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:55:51.879 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:55:51.879 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:55:51.879 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-07-21T22:55:51.879 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-07-21T22:55:51.879 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f3073df4-6cd1-4503-bd2e-d3e98fa18bdf" will pass to kernel 2023-07-21T22:55:51.882 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T22:55:51.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:51.883 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:55:51.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:51.905 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:55:51.962 INFO:teuthology.orchestra.run.smithi006.stdout:client10146 2023-07-21T22:55:51.963 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:55:51.964 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:55:52.014 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-21T22:55:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.165+0000 7fae227d2640 1 Processor -- start 2023-07-21T22:55:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.165+0000 7fae227d2640 1 -- start start 2023-07-21T22:55:52.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.169+0000 7fae227d2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fae1c0c8ad0 0x7fae1c0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.169+0000 7fae227d2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fae1c0c9560 0x7fae1c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.169+0000 7fae227d2640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1c0c99c0 con 0x7fae1c158ce0 2023-07-21T22:55:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.169+0000 7fae227d2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1c0cc700 con 0x7fae1c0c8ad0 2023-07-21T22:55:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.169+0000 7fae227d2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1c0b0ff0 con 0x7fae1c0c9560 2023-07-21T22:55:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.169+0000 7fae13fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fae1c0c8ad0 0x7fae1c0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.169+0000 7fae1bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fae1c158ce0 0x7fae1c070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53154/0 (socket says 172.21.15.6:53154) 2023-07-21T22:55:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.169+0000 7fae1bfff640 1 -- 172.21.15.6:0/1354551105 learned_addr learned my addr 172.21.15.6:0/1354551105 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.169+0000 7fae20d6f640 1 --2- 172.21.15.6:0/1354551105 >> v2:172.21.15.161:3300/0 conn(0x7fae1c0c9560 0x7fae1c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.169+0000 7fae13fff640 1 -- 172.21.15.6:0/1354551105 >> v2:172.21.15.161:3300/0 conn(0x7fae1c0c9560 msgr2=0x7fae1c0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.169+0000 7fae13fff640 1 --2- 172.21.15.6:0/1354551105 >> v2:172.21.15.161:3300/0 conn(0x7fae1c0c9560 0x7fae1c0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.169+0000 7fae13fff640 1 -- 172.21.15.6:0/1354551105 >> v1:172.21.15.6:6789/0 conn(0x7fae1c158ce0 legacy=0x7fae1c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.169+0000 7fae13fff640 1 -- 172.21.15.6:0/1354551105 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c070c80 con 0x7fae1c0c8ad0 2023-07-21T22:55:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.169+0000 7fae1b7fe640 1 -- 172.21.15.6:0/1354551105 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475941895 0 0) 0x7fae1c0c99c0 con 0x7fae1c158ce0 2023-07-21T22:55:52.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.169+0000 7fae13fff640 1 --2- 172.21.15.6:0/1354551105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c0c8ad0 0x7fae1c0c9020 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0b0d70 tx=0x7fae0401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e96733f147898f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:52.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.169+0000 7fae1b7fe640 1 -- 172.21.15.6:0/1354551105 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae040ac640 con 0x7fae1c0c8ad0 2023-07-21T22:55:52.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae1b7fe640 1 -- 172.21.15.6:0/1354551105 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae040ac7a0 con 0x7fae1c0c8ad0 2023-07-21T22:55:52.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae1b7fe640 1 -- 172.21.15.6:0/1354551105 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae040acb30 con 0x7fae1c0c8ad0 2023-07-21T22:55:52.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae227d2640 1 -- 172.21.15.6:0/1354551105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c0c8ad0 msgr2=0x7fae1c0c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:52.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae227d2640 1 --2- 172.21.15.6:0/1354551105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c0c8ad0 0x7fae1c0c9020 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0b0d70 tx=0x7fae0401c310 comp rx=0 tx=0).stop 2023-07-21T22:55:52.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae227d2640 1 -- 172.21.15.6:0/1354551105 shutdown_connections 2023-07-21T22:55:52.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae227d2640 1 --2- 172.21.15.6:0/1354551105 >> v2:172.21.15.161:3300/0 conn(0x7fae1c0c9560 0x7fae1c0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:52.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae227d2640 1 --2- 172.21.15.6:0/1354551105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c0c8ad0 0x7fae1c0c9020 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:52.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae227d2640 1 -- 172.21.15.6:0/1354551105 >> 172.21.15.6:0/1354551105 conn(0x7fae1c0afcf0 msgr2=0x7fae1c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:52.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae227d2640 1 -- 172.21.15.6:0/1354551105 shutdown_connections 2023-07-21T22:55:52.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae227d2640 1 -- 172.21.15.6:0/1354551105 wait complete. 2023-07-21T22:55:52.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae227d2640 1 Processor -- start 2023-07-21T22:55:52.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae227d2640 1 -- start start 2023-07-21T22:55:52.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae227d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae1c0c8ad0 0x7fae1c0c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:52.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae227d2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae1c0c9560 0x7fae1c147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae227d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c158ce0 0x7fae1c0c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae227d2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c0b2fa0 con 0x7fae1c158ce0 2023-07-21T22:55:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae227d2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c1f8250 con 0x7fae1c0c9560 2023-07-21T22:55:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae227d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c1f76d0 con 0x7fae1c0c8ad0 2023-07-21T22:55:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae20d6f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c158ce0 0x7fae1c0c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae20d6f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c158ce0 0x7fae1c0c44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52272/0 (socket says 172.21.15.6:52272) 2023-07-21T22:55:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae20d6f640 1 -- 172.21.15.6:0/644876660 learned_addr learned my addr 172.21.15.6:0/644876660 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae13fff640 1 --2- 172.21.15.6:0/644876660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae1c0c9560 0x7fae1c147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.173+0000 7fae1bfff640 1 --2- 172.21.15.6:0/644876660 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae1c0c8ad0 0x7fae1c0c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.177+0000 7fae20d6f640 1 -- 172.21.15.6:0/644876660 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae1c0c8ad0 msgr2=0x7fae1c0c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.177+0000 7fae20d6f640 1 --2- 172.21.15.6:0/644876660 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae1c0c8ad0 0x7fae1c0c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.177+0000 7fae20d6f640 1 -- 172.21.15.6:0/644876660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae1c0c9560 msgr2=0x7fae1c147cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.177+0000 7fae20d6f640 1 --2- 172.21.15.6:0/644876660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae1c0c9560 0x7fae1c147cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.177+0000 7fae20d6f640 1 -- 172.21.15.6:0/644876660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae04009420 con 0x7fae1c158ce0 2023-07-21T22:55:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.177+0000 7fae13fff640 1 --2- 172.21.15.6:0/644876660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae1c0c9560 0x7fae1c147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.177+0000 7fae20d6f640 1 --2- 172.21.15.6:0/644876660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c158ce0 0x7fae1c0c44a0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fae14007e70 tx=0x7fae1400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.177+0000 7fae197fa640 1 -- 172.21.15.6:0/644876660 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14014620 con 0x7fae1c158ce0 2023-07-21T22:55:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.177+0000 7fae197fa640 1 -- 172.21.15.6:0/644876660 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae140147a0 con 0x7fae1c158ce0 2023-07-21T22:55:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.177+0000 7fae227d2640 1 -- 172.21.15.6:0/644876660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1c1f79b0 con 0x7fae1c158ce0 2023-07-21T22:55:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.177+0000 7fae197fa640 1 -- 172.21.15.6:0/644876660 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14014b50 con 0x7fae1c158ce0 2023-07-21T22:55:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.177+0000 7fae227d2640 1 -- 172.21.15.6:0/644876660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1c1f7f70 con 0x7fae1c158ce0 2023-07-21T22:55:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.177+0000 7fae227d2640 1 -- 172.21.15.6:0/644876660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1c0ca1a0 con 0x7fae1c158ce0 2023-07-21T22:55:52.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.177+0000 7fae197fa640 1 -- 172.21.15.6:0/644876660 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fae14014cb0 con 0x7fae1c158ce0 2023-07-21T22:55:52.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.177+0000 7fae197fa640 1 --2- 172.21.15.6:0/644876660 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fadfc0663a0 0x7fadfc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:52.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.177+0000 7fae197fa640 1 -- 172.21.15.6:0/644876660 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fae14084870 con 0x7fae1c158ce0 2023-07-21T22:55:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.177+0000 7fae1bfff640 1 --2- 172.21.15.6:0/644876660 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fadfc0663a0 0x7fadfc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.181+0000 7fae1bfff640 1 --2- 172.21.15.6:0/644876660 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fadfc0663a0 0x7fadfc068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fae0c000f70 tx=0x7fae0c007c10 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.181+0000 7fae197fa640 1 -- 172.21.15.6:0/644876660 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fae14055610 con 0x7fae1c158ce0 2023-07-21T22:55:52.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.357+0000 7fae227d2640 1 -- 172.21.15.6:0/644876660 --> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fae1c1590b0 con 0x7fadfc0663a0 2023-07-21T22:55:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.357+0000 7fae197fa640 1 -- 172.21.15.6:0/644876660 <== mgr.9289 v2:172.21.15.161:6832/2346358146 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fae0c007da0 con 0x7fadfc0663a0 2023-07-21T22:55:52.393 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:55:52.393 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:55:52.393 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephfs" 2023-07-21T22:55:52.393 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:55:52.393 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:55:52.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.361+0000 7fae227d2640 1 -- 172.21.15.6:0/644876660 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fadfc0663a0 msgr2=0x7fadfc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:52.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.361+0000 7fae227d2640 1 --2- 172.21.15.6:0/644876660 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fadfc0663a0 0x7fadfc068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fae0c000f70 tx=0x7fae0c007c10 comp rx=0 tx=0).stop 2023-07-21T22:55:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.361+0000 7fae227d2640 1 -- 172.21.15.6:0/644876660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c158ce0 msgr2=0x7fae1c0c44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.361+0000 7fae227d2640 1 --2- 172.21.15.6:0/644876660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c158ce0 0x7fae1c0c44a0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fae14007e70 tx=0x7fae1400e4b0 comp rx=0 tx=0).stop 2023-07-21T22:55:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.361+0000 7fae227d2640 1 -- 172.21.15.6:0/644876660 shutdown_connections 2023-07-21T22:55:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.361+0000 7fae227d2640 1 --2- 172.21.15.6:0/644876660 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fadfc0663a0 0x7fadfc068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.361+0000 7fae227d2640 1 --2- 172.21.15.6:0/644876660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae1c158ce0 0x7fae1c0c44a0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.361+0000 7fae227d2640 1 --2- 172.21.15.6:0/644876660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae1c0c9560 0x7fae1c147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.361+0000 7fae227d2640 1 --2- 172.21.15.6:0/644876660 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fae1c0c8ad0 0x7fae1c0c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.361+0000 7fae227d2640 1 -- 172.21.15.6:0/644876660 >> 172.21.15.6:0/644876660 conn(0x7fae1c0afcf0 msgr2=0x7fae1c0caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.361+0000 7fae227d2640 1 -- 172.21.15.6:0/644876660 shutdown_connections 2023-07-21T22:55:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.361+0000 7fae227d2640 1 -- 172.21.15.6:0/644876660 wait complete. 2023-07-21T22:55:52.417 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-21T22:55:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.529+0000 7fd7fdd11640 1 Processor -- start 2023-07-21T22:55:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.529+0000 7fd7fdd11640 1 -- start start 2023-07-21T22:55:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7fdd11640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7f80ccff0 0x7fd7f815e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7fdd11640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f80cbe50 con 0x7fd7f8159a70 2023-07-21T22:55:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7fdd11640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f815e5a0 con 0x7fd7f8071030 2023-07-21T22:55:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7fdd11640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80cd450 con 0x7fd7f80ccff0 2023-07-21T22:55:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f77fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd7f8159a70 0x7fd7f8070920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53158/0 (socket says 172.21.15.6:53158) 2023-07-21T22:55:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f77fe640 1 -- 172.21.15.6:0/3374239669 learned_addr learned my addr 172.21.15.6:0/3374239669 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f7fff640 1 --2- 172.21.15.6:0/3374239669 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7f80ccff0 0x7fd7f815e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f67fc640 1 -- 172.21.15.6:0/3374239669 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2691269728 0 0) 0x7fd7f80cbe50 con 0x7fd7f8159a70 2023-07-21T22:55:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f67fc640 1 -- 172.21.15.6:0/3374239669 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7e0003530 con 0x7fd7f8159a70 2023-07-21T22:55:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f67fc640 1 -- 172.21.15.6:0/3374239669 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3965857752 0 0) 0x7fd7f815e5a0 con 0x7fd7f8071030 2023-07-21T22:55:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f67fc640 1 -- 172.21.15.6:0/3374239669 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7f80cbe50 con 0x7fd7f8071030 2023-07-21T22:55:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f67fc640 1 -- 172.21.15.6:0/3374239669 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1510690070 0 0) 0x7fd7e0003530 con 0x7fd7f8159a70 2023-07-21T22:55:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f67fc640 1 -- 172.21.15.6:0/3374239669 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7f80ccff0 msgr2=0x7fd7f815e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f67fc640 1 --2- 172.21.15.6:0/3374239669 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7f80ccff0 0x7fd7f815e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f67fc640 1 -- 172.21.15.6:0/3374239669 >> v1:172.21.15.161:6789/0 conn(0x7fd7f8071030 legacy=0x7fd7f80c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f67fc640 1 -- 172.21.15.6:0/3374239669 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f80cd660 con 0x7fd7f8159a70 2023-07-21T22:55:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f67fc640 1 -- 172.21.15.6:0/3374239669 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fd7e8001680 con 0x7fd7f8159a70 2023-07-21T22:55:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f67fc640 1 -- 172.21.15.6:0/3374239669 >> v1:172.21.15.6:6789/0 conn(0x7fd7f8159a70 legacy=0x7fd7f8070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f67fc640 1 --2- 172.21.15.6:0/3374239669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7e0003b40 0x7fd7e0003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f67fc640 1 --2- 172.21.15.6:0/3374239669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e00047d0 0x7fd7e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f67fc640 1 --2- 172.21.15.6:0/3374239669 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7f80ccff0 0x7fd7e00051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f67fc640 1 -- 172.21.15.6:0/3374239669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80cd450 con 0x7fd7e00047d0 2023-07-21T22:55:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f67fc640 1 -- 172.21.15.6:0/3374239669 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e000ff30 con 0x7fd7e0003b40 2023-07-21T22:55:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f67fc640 1 -- 172.21.15.6:0/3374239669 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e00100f0 con 0x7fd7f80ccff0 2023-07-21T22:55:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f6ffd640 1 --2- 172.21.15.6:0/3374239669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e00047d0 0x7fd7e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f7fff640 1 --2- 172.21.15.6:0/3374239669 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7f80ccff0 0x7fd7e00051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f77fe640 1 --2- 172.21.15.6:0/3374239669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7e0003b40 0x7fd7e0003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f6ffd640 1 -- 172.21.15.6:0/3374239669 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7f80ccff0 msgr2=0x7fd7e00051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f6ffd640 1 --2- 172.21.15.6:0/3374239669 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7f80ccff0 0x7fd7e00051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f6ffd640 1 -- 172.21.15.6:0/3374239669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7e0003b40 msgr2=0x7fd7e0003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f6ffd640 1 --2- 172.21.15.6:0/3374239669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7e0003b40 0x7fd7e0003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.533+0000 7fd7f6ffd640 1 -- 172.21.15.6:0/3374239669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e0003530 con 0x7fd7e00047d0 2023-07-21T22:55:52.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.537+0000 7fd7f6ffd640 1 --2- 172.21.15.6:0/3374239669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e00047d0 0x7fd7e0004c40 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec0018d0 tx=0x7fd7ec01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980351cc23d3b216 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:52.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.537+0000 7fd7f67fc640 1 -- 172.21.15.6:0/3374239669 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec0050d0 con 0x7fd7e00047d0 2023-07-21T22:55:52.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.537+0000 7fd7f67fc640 1 -- 172.21.15.6:0/3374239669 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ec005250 con 0x7fd7e00047d0 2023-07-21T22:55:52.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.537+0000 7fd7f67fc640 1 -- 172.21.15.6:0/3374239669 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec003600 con 0x7fd7e00047d0 2023-07-21T22:55:52.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.537+0000 7fd7fdd11640 1 -- 172.21.15.6:0/3374239669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e00047d0 msgr2=0x7fd7e0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:52.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.537+0000 7fd7fdd11640 1 --2- 172.21.15.6:0/3374239669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7e00047d0 0x7fd7e0004c40 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fd7ec0018d0 tx=0x7fd7ec01c530 comp rx=0 tx=0).stop 2023-07-21T22:55:52.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.537+0000 7fd7f7fff640 1 -- 172.21.15.6:0/3374239669 reap_dead start 2023-07-21T22:55:52.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.537+0000 7fd7fdd11640 1 -- 172.21.15.6:0/3374239669 shutdown_connections 2023-07-21T22:55:52.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.537+0000 7fd7fdd11640 1 -- 172.21.15.6:0/3374239669 >> 172.21.15.6:0/3374239669 conn(0x7fd7f80afac0 msgr2=0x7fd7f80afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:52.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.537+0000 7fd7fdd11640 1 -- 172.21.15.6:0/3374239669 shutdown_connections 2023-07-21T22:55:52.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.537+0000 7fd7fdd11640 1 -- 172.21.15.6:0/3374239669 wait complete. 2023-07-21T22:55:52.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.537+0000 7fd7fdd11640 1 Processor -- start 2023-07-21T22:55:52.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7fdd11640 1 -- start start 2023-07-21T22:55:52.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7fdd11640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7e00047d0 0x7fd7f81525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:52.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7fdd11640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7f815c2a0 0x7fd7f81570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:52.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7fdd11640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f80c2470 0x7fd7f80c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:52.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7fdd11640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80c2de0 con 0x7fd7f80c2470 2023-07-21T22:55:52.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7fdd11640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f815aa90 con 0x7fd7f815c2a0 2023-07-21T22:55:52.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7fdd11640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f8152af0 con 0x7fd7e00047d0 2023-07-21T22:55:52.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7f7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f80c2470 0x7fd7f80c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:52.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7f7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f80c2470 0x7fd7f80c3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52286/0 (socket says 172.21.15.6:52286) 2023-07-21T22:55:52.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7f7fff640 1 -- 172.21.15.6:0/3063332679 learned_addr learned my addr 172.21.15.6:0/3063332679 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:52.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7f6ffd640 1 --2- 172.21.15.6:0/3063332679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7f815c2a0 0x7fd7f81570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7f77fe640 1 --2- 172.21.15.6:0/3063332679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7e00047d0 0x7fd7f81525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7f7fff640 1 -- 172.21.15.6:0/3063332679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7e00047d0 msgr2=0x7fd7f81525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7f7fff640 1 --2- 172.21.15.6:0/3063332679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7e00047d0 0x7fd7f81525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7f7fff640 1 -- 172.21.15.6:0/3063332679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7f815c2a0 msgr2=0x7fd7f81570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7f7fff640 1 --2- 172.21.15.6:0/3063332679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7f815c2a0 0x7fd7f81570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7f7fff640 1 -- 172.21.15.6:0/3063332679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f815a160 con 0x7fd7f80c2470 2023-07-21T22:55:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7f77fe640 1 --2- 172.21.15.6:0/3063332679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7e00047d0 0x7fd7f81525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:55:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7f6ffd640 1 --2- 172.21.15.6:0/3063332679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7f815c2a0 0x7fd7f81570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:55:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7f7fff640 1 --2- 172.21.15.6:0/3063332679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f80c2470 0x7fd7f80c3b90 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80ad9c0 tx=0x7fd7f0011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7dffff640 1 -- 172.21.15.6:0/3063332679 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f000e040 con 0x7fd7f80c2470 2023-07-21T22:55:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7dffff640 1 -- 172.21.15.6:0/3063332679 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f000f040 con 0x7fd7f80c2470 2023-07-21T22:55:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7dffff640 1 -- 172.21.15.6:0/3063332679 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0015b60 con 0x7fd7f80c2470 2023-07-21T22:55:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7fdd11640 1 -- 172.21.15.6:0/3063332679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f815a440 con 0x7fd7f80c2470 2023-07-21T22:55:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7fdd11640 1 -- 172.21.15.6:0/3063332679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f8157600 con 0x7fd7f80c2470 2023-07-21T22:55:52.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.541+0000 7fd7fdd11640 1 -- 172.21.15.6:0/3063332679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f815ac40 con 0x7fd7f80c2470 2023-07-21T22:55:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.545+0000 7fd7dffff640 1 -- 172.21.15.6:0/3063332679 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd7f0015cc0 con 0x7fd7f80c2470 2023-07-21T22:55:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.545+0000 7fd7dffff640 1 --2- 172.21.15.6:0/3063332679 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fd7e40663a0 0x7fd7e4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.545+0000 7fd7dffff640 1 -- 172.21.15.6:0/3063332679 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fd7f0083fd0 con 0x7fd7f80c2470 2023-07-21T22:55:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.545+0000 7fd7f77fe640 1 --2- 172.21.15.6:0/3063332679 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fd7e40663a0 0x7fd7e4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.545+0000 7fd7f77fe640 1 --2- 172.21.15.6:0/3063332679 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fd7e40663a0 0x7fd7e4068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8001ec0 tx=0x7fd7e8009040 comp rx=0 tx=0).ready entity=mgr.9289 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:52.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.549+0000 7fd7dffff640 1 -- 172.21.15.6:0/3063332679 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd7f815ac40 con 0x7fd7f80c2470 2023-07-21T22:55:52.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:52.741+0000 7fd7fdd11640 1 -- 172.21.15.6:0/3063332679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fd7f815ac40 con 0x7fd7f80c2470 2023-07-21T22:55:53.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.261+0000 7fd7dffff640 1 -- 172.21.15.6:0/3063332679 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 82) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fd7f0082340 con 0x7fd7f80c2470 2023-07-21T22:55:53.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.261+0000 7fd7dffff640 1 -- 172.21.15.6:0/3063332679 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v82) v1 ==== 92+0+0 (secure 0 0 0) 0x7fd7f00181e0 con 0x7fd7f80c2470 2023-07-21T22:55:53.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.265+0000 7fd7fdd11640 1 -- 172.21.15.6:0/3063332679 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fd7e40663a0 msgr2=0x7fd7e4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:53.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.265+0000 7fd7fdd11640 1 --2- 172.21.15.6:0/3063332679 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fd7e40663a0 0x7fd7e4068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8001ec0 tx=0x7fd7e8009040 comp rx=0 tx=0).stop 2023-07-21T22:55:53.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.265+0000 7fd7fdd11640 1 -- 172.21.15.6:0/3063332679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f80c2470 msgr2=0x7fd7f80c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:53.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.265+0000 7fd7fdd11640 1 --2- 172.21.15.6:0/3063332679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f80c2470 0x7fd7f80c3b90 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80ad9c0 tx=0x7fd7f0011d40 comp rx=0 tx=0).stop 2023-07-21T22:55:53.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.265+0000 7fd7fdd11640 1 -- 172.21.15.6:0/3063332679 shutdown_connections 2023-07-21T22:55:53.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.265+0000 7fd7fdd11640 1 --2- 172.21.15.6:0/3063332679 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fd7e40663a0 0x7fd7e4068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:53.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.265+0000 7fd7fdd11640 1 --2- 172.21.15.6:0/3063332679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f80c2470 0x7fd7f80c3b90 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:53.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.265+0000 7fd7fdd11640 1 --2- 172.21.15.6:0/3063332679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7f815c2a0 0x7fd7f81570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:53.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.265+0000 7fd7fdd11640 1 --2- 172.21.15.6:0/3063332679 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd7e00047d0 0x7fd7f81525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:53.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.265+0000 7fd7fdd11640 1 -- 172.21.15.6:0/3063332679 >> 172.21.15.6:0/3063332679 conn(0x7fd7f80afac0 msgr2=0x7fd7f81543d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:53.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.265+0000 7fd7fdd11640 1 -- 172.21.15.6:0/3063332679 shutdown_connections 2023-07-21T22:55:53.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.265+0000 7fd7fdd11640 1 -- 172.21.15.6:0/3063332679 wait complete. 2023-07-21T22:55:53.325 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-21T22:55:53.476 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:53.444+0000 7fe98cc48180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:55:53.480 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:53.445+0000 7fc565922180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:55:53.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.445+0000 7f42157fa640 1 Processor -- start 2023-07-21T22:55:53.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.445+0000 7f42157fa640 1 -- start start 2023-07-21T22:55:53.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.445+0000 7f42157fa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f421015bde0 0x7f42100d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:53.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.445+0000 7f42157fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42100d2300 0x7f42100d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:53.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.449+0000 7f42157fa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42100b04c0 con 0x7f42100d2fc0 2023-07-21T22:55:53.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.449+0000 7f42157fa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f421015c1b0 con 0x7f421015bde0 2023-07-21T22:55:53.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.449+0000 7f42157fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42100d2cc0 con 0x7f42100d2300 2023-07-21T22:55:53.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.449+0000 7f420effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f421015bde0 0x7f42100d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:53.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.449+0000 7f420f7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42100d2300 0x7f42100d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:53.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.449+0000 7f420e7fc640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f42100d2fc0 0x7f42100b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:56808/0 (socket says 172.21.15.6:56808) 2023-07-21T22:55:53.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.449+0000 7f420effd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f421015bde0 0x7f42100d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52326/0 (socket says 172.21.15.6:52326) 2023-07-21T22:55:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.449+0000 7f420e7fc640 1 -- 172.21.15.6:0/1515261927 learned_addr learned my addr 172.21.15.6:0/1515261927 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.449+0000 7f420effd640 1 -- 172.21.15.6:0/1515261927 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42100d2300 msgr2=0x7f42100d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.449+0000 7f420effd640 1 --2- 172.21.15.6:0/1515261927 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42100d2300 0x7f42100d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.449+0000 7f420effd640 1 -- 172.21.15.6:0/1515261927 >> v1:172.21.15.161:6789/0 conn(0x7f42100d2fc0 legacy=0x7f42100b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:53.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.449+0000 7f420effd640 1 -- 172.21.15.6:0/1515261927 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42100b1060 con 0x7f421015bde0 2023-07-21T22:55:53.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.449+0000 7f420dffb640 1 -- 172.21.15.6:0/1515261927 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147558951 0 0) 0x7f42100b04c0 con 0x7f42100d2fc0 2023-07-21T22:55:53.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.449+0000 7f420effd640 1 --2- 172.21.15.6:0/1515261927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f421015bde0 0x7f42100d0270 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f42000097a0 tx=0x7f420001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5128083c71cab0d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:53.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.453+0000 7f420dffb640 1 -- 172.21.15.6:0/1515261927 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42000ab600 con 0x7f421015bde0 2023-07-21T22:55:53.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.453+0000 7f420dffb640 1 -- 172.21.15.6:0/1515261927 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42000a7050 con 0x7f421015bde0 2023-07-21T22:55:53.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.453+0000 7f420dffb640 1 -- 172.21.15.6:0/1515261927 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42000ab980 con 0x7f421015bde0 2023-07-21T22:55:53.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.453+0000 7f42157fa640 1 -- 172.21.15.6:0/1515261927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f421015bde0 msgr2=0x7f42100d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:53.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.453+0000 7f42157fa640 1 --2- 172.21.15.6:0/1515261927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f421015bde0 0x7f42100d0270 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f42000097a0 tx=0x7f420001c460 comp rx=0 tx=0).stop 2023-07-21T22:55:53.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.453+0000 7f42157fa640 1 -- 172.21.15.6:0/1515261927 shutdown_connections 2023-07-21T22:55:53.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.453+0000 7f42157fa640 1 --2- 172.21.15.6:0/1515261927 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42100d2300 0x7f42100d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:53.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.453+0000 7f42157fa640 1 --2- 172.21.15.6:0/1515261927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f421015bde0 0x7f42100d0270 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:53.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.453+0000 7f42157fa640 1 -- 172.21.15.6:0/1515261927 >> 172.21.15.6:0/1515261927 conn(0x7f42100659d0 msgr2=0x7f421009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:53.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.453+0000 7f42157fa640 1 -- 172.21.15.6:0/1515261927 shutdown_connections 2023-07-21T22:55:53.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.453+0000 7f42157fa640 1 -- 172.21.15.6:0/1515261927 wait complete. 2023-07-21T22:55:53.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.453+0000 7f42157fa640 1 Processor -- start 2023-07-21T22:55:53.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.453+0000 7f42157fa640 1 -- start start 2023-07-21T22:55:53.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f42157fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42100d2300 0x7f42100c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:53.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f42157fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42100d2fc0 0x7f421013e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:53.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f42157fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f421015bde0 0x7f421013e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:53.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f42157fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42100b5510 con 0x7f42100d2fc0 2023-07-21T22:55:53.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f42157fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42100cbbf0 con 0x7f421015bde0 2023-07-21T22:55:53.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f42157fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42100cbed0 con 0x7f42100d2300 2023-07-21T22:55:53.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f420e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42100d2fc0 0x7f421013e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:53.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f420effd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42100d2300 0x7f42100c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:53.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f420e7fc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42100d2fc0 0x7f421013e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52340/0 (socket says 172.21.15.6:52340) 2023-07-21T22:55:53.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f420e7fc640 1 -- 172.21.15.6:0/58132355 learned_addr learned my addr 172.21.15.6:0/58132355 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f420f7fe640 1 --2- 172.21.15.6:0/58132355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f421015bde0 0x7f421013e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f420e7fc640 1 -- 172.21.15.6:0/58132355 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42100d2300 msgr2=0x7f42100c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f420e7fc640 1 --2- 172.21.15.6:0/58132355 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42100d2300 0x7f42100c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f420e7fc640 1 -- 172.21.15.6:0/58132355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f421015bde0 msgr2=0x7f421013e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:53.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f420e7fc640 1 --2- 172.21.15.6:0/58132355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f421015bde0 0x7f421013e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f420e7fc640 1 -- 172.21.15.6:0/58132355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42000093b0 con 0x7f42100d2fc0 2023-07-21T22:55:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f420e7fc640 1 --2- 172.21.15.6:0/58132355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42100d2fc0 0x7f421013e430 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f420400c450 tx=0x7f420400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f41f77fe640 1 -- 172.21.15.6:0/58132355 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42040074e0 con 0x7f42100d2fc0 2023-07-21T22:55:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f41f77fe640 1 -- 172.21.15.6:0/58132355 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4204007640 con 0x7f42100d2fc0 2023-07-21T22:55:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f41f77fe640 1 -- 172.21.15.6:0/58132355 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42040049f0 con 0x7f42100d2fc0 2023-07-21T22:55:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f42157fa640 1 -- 172.21.15.6:0/58132355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42100cc1b0 con 0x7f42100d2fc0 2023-07-21T22:55:53.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f42157fa640 1 -- 172.21.15.6:0/58132355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421013f190 con 0x7f42100d2fc0 2023-07-21T22:55:53.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f42157fa640 1 -- 172.21.15.6:0/58132355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42100b56b0 con 0x7f42100d2fc0 2023-07-21T22:55:53.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.457+0000 7f41f77fe640 1 -- 172.21.15.6:0/58132355 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 82) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f4204004b50 con 0x7f42100d2fc0 2023-07-21T22:55:53.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.461+0000 7f41f77fe640 1 --2- 172.21.15.6:0/58132355 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f41fc0663f0 0x7f41fc0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:53.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.461+0000 7f41f77fe640 1 -- 172.21.15.6:0/58132355 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f4204083100 con 0x7f42100d2fc0 2023-07-21T22:55:53.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.461+0000 7f420effd640 1 -- 172.21.15.6:0/58132355 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f41fc0663f0 msgr2=0x7f41fc0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2346358146 2023-07-21T22:55:53.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.461+0000 7f420effd640 1 --2- 172.21.15.6:0/58132355 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f41fc0663f0 0x7f41fc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:55:53.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.465+0000 7f41f77fe640 1 -- 172.21.15.6:0/58132355 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f42040504c0 con 0x7f42100d2fc0 2023-07-21T22:55:53.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.625+0000 7f42157fa640 1 -- 172.21.15.6:0/58132355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f42100678d0 con 0x7f42100d2fc0 2023-07-21T22:55:53.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.629+0000 7f41f77fe640 1 -- 172.21.15.6:0/58132355 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v59)=0 v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7f42040180d0 con 0x7f42100d2fc0 2023-07-21T22:55:53.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.629+0000 7f42157fa640 1 -- 172.21.15.6:0/58132355 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f41fc0663f0 msgr2=0x7f41fc0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:55:53.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.629+0000 7f42157fa640 1 --2- 172.21.15.6:0/58132355 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f41fc0663f0 0x7f41fc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:53.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.629+0000 7f42157fa640 1 -- 172.21.15.6:0/58132355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42100d2fc0 msgr2=0x7f421013e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:53.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.629+0000 7f42157fa640 1 --2- 172.21.15.6:0/58132355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42100d2fc0 0x7f421013e430 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f420400c450 tx=0x7f420400c910 comp rx=0 tx=0).stop 2023-07-21T22:55:53.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.629+0000 7f42157fa640 1 -- 172.21.15.6:0/58132355 shutdown_connections 2023-07-21T22:55:53.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.629+0000 7f42157fa640 1 --2- 172.21.15.6:0/58132355 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f41fc0663f0 0x7f41fc0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:53.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.629+0000 7f42157fa640 1 --2- 172.21.15.6:0/58132355 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f421015bde0 0x7f421013e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:53.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.629+0000 7f42157fa640 1 --2- 172.21.15.6:0/58132355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42100d2fc0 0x7f421013e430 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:53.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.629+0000 7f42157fa640 1 --2- 172.21.15.6:0/58132355 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42100d2300 0x7f42100c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:53.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.629+0000 7f42157fa640 1 -- 172.21.15.6:0/58132355 >> 172.21.15.6:0/58132355 conn(0x7f42100659d0 msgr2=0x7f421006afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:53.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.633+0000 7f42157fa640 1 -- 172.21.15.6:0/58132355 shutdown_connections 2023-07-21T22:55:53.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.633+0000 7f42157fa640 1 -- 172.21.15.6:0/58132355 wait complete. 2023-07-21T22:55:53.687 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-21T22:55:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.801+0000 7fe1a8e7b640 1 Processor -- start 2023-07-21T22:55:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.801+0000 7fe1a8e7b640 1 -- start start 2023-07-21T22:55:53.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.805+0000 7fe1a8e7b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1a415bde0 0x7fe1a40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:53.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.805+0000 7fe1a8e7b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe1a40d2fc0 0x7fe1a40b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:53.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.805+0000 7fe1a8e7b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a40b04c0 con 0x7fe1a40d2300 2023-07-21T22:55:53.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.805+0000 7fe1a8e7b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a415c1b0 con 0x7fe1a40d2fc0 2023-07-21T22:55:53.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.805+0000 7fe1a8e7b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40d0aa0 con 0x7fe1a415bde0 2023-07-21T22:55:53.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.805+0000 7fe1a2d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe1a40d2300 0x7fe1a40cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53174/0 (socket says 172.21.15.6:53174) 2023-07-21T22:55:53.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.805+0000 7fe1a2d9d640 1 -- 172.21.15.6:0/1619323219 learned_addr learned my addr 172.21.15.6:0/1619323219 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:53.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.805+0000 7fe1a259c640 1 --2- 172.21.15.6:0/1619323219 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1a415bde0 0x7fe1a40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:53.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.805+0000 7fe1a1d9b640 1 --2- 172.21.15.6:0/1619323219 >> v2:172.21.15.161:3300/0 conn(0x7fe1a40d2fc0 0x7fe1a40b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:53.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.805+0000 7fe1a159a640 1 -- 172.21.15.6:0/1619323219 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048758238 0 0) 0x7fe1a40b04c0 con 0x7fe1a40d2300 2023-07-21T22:55:53.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.805+0000 7fe1a159a640 1 -- 172.21.15.6:0/1619323219 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe18c003530 con 0x7fe1a40d2300 2023-07-21T22:55:53.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.805+0000 7fe1a259c640 1 -- 172.21.15.6:0/1619323219 >> v2:172.21.15.161:3300/0 conn(0x7fe1a40d2fc0 msgr2=0x7fe1a40b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:53.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.805+0000 7fe1a259c640 1 --2- 172.21.15.6:0/1619323219 >> v2:172.21.15.161:3300/0 conn(0x7fe1a40d2fc0 0x7fe1a40b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:53.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.805+0000 7fe1a259c640 1 -- 172.21.15.6:0/1619323219 >> v1:172.21.15.6:6789/0 conn(0x7fe1a40d2300 legacy=0x7fe1a40cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:53.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.805+0000 7fe1a259c640 1 -- 172.21.15.6:0/1619323219 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a40afb90 con 0x7fe1a415bde0 2023-07-21T22:55:53.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.809+0000 7fe1a259c640 1 --2- 172.21.15.6:0/1619323219 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1a415bde0 0x7fe1a40d0270 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe1940097a0 tx=0x7fe19401c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fbe5298314962cd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:53.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.809+0000 7fe1a159a640 1 -- 172.21.15.6:0/1619323219 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1940ab660 con 0x7fe1a415bde0 2023-07-21T22:55:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.809+0000 7fe1a159a640 1 -- 172.21.15.6:0/1619323219 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1940ab7c0 con 0x7fe1a415bde0 2023-07-21T22:55:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.809+0000 7fe1a159a640 1 -- 172.21.15.6:0/1619323219 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1940abb50 con 0x7fe1a415bde0 2023-07-21T22:55:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.809+0000 7fe1a8e7b640 1 -- 172.21.15.6:0/1619323219 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1a415bde0 msgr2=0x7fe1a40d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:53.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.809+0000 7fe1a8e7b640 1 --2- 172.21.15.6:0/1619323219 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1a415bde0 0x7fe1a40d0270 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe1940097a0 tx=0x7fe19401c460 comp rx=0 tx=0).stop 2023-07-21T22:55:53.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.809+0000 7fe1a8e7b640 1 -- 172.21.15.6:0/1619323219 shutdown_connections 2023-07-21T22:55:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.809+0000 7fe1a8e7b640 1 --2- 172.21.15.6:0/1619323219 >> v2:172.21.15.161:3300/0 conn(0x7fe1a40d2fc0 0x7fe1a40b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.809+0000 7fe1a8e7b640 1 --2- 172.21.15.6:0/1619323219 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1a415bde0 0x7fe1a40d0270 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:53.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.809+0000 7fe1a8e7b640 1 -- 172.21.15.6:0/1619323219 >> 172.21.15.6:0/1619323219 conn(0x7fe1a40659d0 msgr2=0x7fe1a409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.809+0000 7fe1a8e7b640 1 -- 172.21.15.6:0/1619323219 shutdown_connections 2023-07-21T22:55:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.809+0000 7fe1a8e7b640 1 -- 172.21.15.6:0/1619323219 wait complete. 2023-07-21T22:55:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.809+0000 7fe1a8e7b640 1 Processor -- start 2023-07-21T22:55:53.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.809+0000 7fe1a8e7b640 1 -- start start 2023-07-21T22:55:53.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe1a8e7b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1a40d2300 0x7fe1a4154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:53.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe1a8e7b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1a40d2fc0 0x7fe1a4154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:53.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe1a8e7b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1a415bde0 0x7fe1a415e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:53.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe1a8e7b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40b5be0 con 0x7fe1a40d2fc0 2023-07-21T22:55:53.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe1a8e7b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a415f180 con 0x7fe1a40d2300 2023-07-21T22:55:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe1a8e7b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40b52b0 con 0x7fe1a415bde0 2023-07-21T22:55:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe1a1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1a40d2fc0 0x7fe1a4154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:53.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe1a1d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1a40d2fc0 0x7fe1a4154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52356/0 (socket says 172.21.15.6:52356) 2023-07-21T22:55:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe1a1d9b640 1 -- 172.21.15.6:0/2014419132 learned_addr learned my addr 172.21.15.6:0/2014419132 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe1a259c640 1 --2- 172.21.15.6:0/2014419132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1a40d2300 0x7fe1a4154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe1a2d9d640 1 --2- 172.21.15.6:0/2014419132 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1a415bde0 0x7fe1a415e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe1a1d9b640 1 -- 172.21.15.6:0/2014419132 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1a415bde0 msgr2=0x7fe1a415e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:53.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe1a1d9b640 1 --2- 172.21.15.6:0/2014419132 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1a415bde0 0x7fe1a415e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:53.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe1a1d9b640 1 -- 172.21.15.6:0/2014419132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1a40d2300 msgr2=0x7fe1a4154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:53.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe1a1d9b640 1 --2- 172.21.15.6:0/2014419132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1a40d2300 0x7fe1a4154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:53.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe1a1d9b640 1 -- 172.21.15.6:0/2014419132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1940093b0 con 0x7fe1a40d2fc0 2023-07-21T22:55:53.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe1a1d9b640 1 --2- 172.21.15.6:0/2014419132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1a40d2fc0 0x7fe1a4154f90 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fe19800e960 tx=0x7fe19800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:53.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe192ffd640 1 -- 172.21.15.6:0/2014419132 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe198009690 con 0x7fe1a40d2fc0 2023-07-21T22:55:53.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe192ffd640 1 -- 172.21.15.6:0/2014419132 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19800ca00 con 0x7fe1a40d2fc0 2023-07-21T22:55:53.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe1a8e7b640 1 -- 172.21.15.6:0/2014419132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a40b5590 con 0x7fe1a40d2fc0 2023-07-21T22:55:53.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe192ffd640 1 -- 172.21.15.6:0/2014419132 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19800cd70 con 0x7fe1a40d2fc0 2023-07-21T22:55:53.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe1a8e7b640 1 -- 172.21.15.6:0/2014419132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a415cbe0 con 0x7fe1a40d2fc0 2023-07-21T22:55:53.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.813+0000 7fe1a8e7b640 1 -- 172.21.15.6:0/2014419132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a40b5d90 con 0x7fe1a40d2fc0 2023-07-21T22:55:53.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.817+0000 7fe192ffd640 1 -- 172.21.15.6:0/2014419132 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 82) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fe198013470 con 0x7fe1a40d2fc0 2023-07-21T22:55:53.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.817+0000 7fe192ffd640 1 --2- 172.21.15.6:0/2014419132 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fe1840663f0 0x7fe1840688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:53.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.817+0000 7fe192ffd640 1 -- 172.21.15.6:0/2014419132 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fe198084260 con 0x7fe1a40d2fc0 2023-07-21T22:55:53.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.817+0000 7fe1a259c640 1 -- 172.21.15.6:0/2014419132 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fe1840663f0 msgr2=0x7fe1840688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2346358146 2023-07-21T22:55:53.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.817+0000 7fe1a259c640 1 --2- 172.21.15.6:0/2014419132 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fe1840663f0 0x7fe1840688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:55:53.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.821+0000 7fe192ffd640 1 -- 172.21.15.6:0/2014419132 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe198051500 con 0x7fe1a40d2fc0 2023-07-21T22:55:53.893 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:53.864+0000 7fe98cc48180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:55:53.941 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:53.905+0000 7fc565922180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:55:54.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.993+0000 7fe1a8e7b640 1 -- 172.21.15.6:0/2014419132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fe1a40678d0 con 0x7fe1a40d2fc0 2023-07-21T22:55:54.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.997+0000 7fe192ffd640 1 -- 172.21.15.6:0/2014419132 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v60)=0 v60) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe198054b20 con 0x7fe1a40d2fc0 2023-07-21T22:55:54.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.997+0000 7fe1a8e7b640 1 -- 172.21.15.6:0/2014419132 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fe1840663f0 msgr2=0x7fe1840688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:55:54.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.997+0000 7fe1a8e7b640 1 --2- 172.21.15.6:0/2014419132 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fe1840663f0 0x7fe1840688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:54.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.997+0000 7fe1a8e7b640 1 -- 172.21.15.6:0/2014419132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1a40d2fc0 msgr2=0x7fe1a4154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:54.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.997+0000 7fe1a8e7b640 1 --2- 172.21.15.6:0/2014419132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1a40d2fc0 0x7fe1a4154f90 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fe19800e960 tx=0x7fe19800ee20 comp rx=0 tx=0).stop 2023-07-21T22:55:54.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.997+0000 7fe1a8e7b640 1 -- 172.21.15.6:0/2014419132 shutdown_connections 2023-07-21T22:55:54.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.997+0000 7fe1a8e7b640 1 --2- 172.21.15.6:0/2014419132 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7fe1840663f0 0x7fe1840688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:54.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.997+0000 7fe1a8e7b640 1 --2- 172.21.15.6:0/2014419132 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe1a415bde0 0x7fe1a415e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.997+0000 7fe1a8e7b640 1 --2- 172.21.15.6:0/2014419132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1a40d2fc0 0x7fe1a4154f90 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.997+0000 7fe1a8e7b640 1 --2- 172.21.15.6:0/2014419132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1a40d2300 0x7fe1a4154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.997+0000 7fe1a8e7b640 1 -- 172.21.15.6:0/2014419132 >> 172.21.15.6:0/2014419132 conn(0x7fe1a40659d0 msgr2=0x7fe1a40ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.997+0000 7fe1a8e7b640 1 -- 172.21.15.6:0/2014419132 shutdown_connections 2023-07-21T22:55:54.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:53.997+0000 7fe1a8e7b640 1 -- 172.21.15.6:0/2014419132 wait complete. 2023-07-21T22:55:54.044 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:54.012+0000 7fe98cc48180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:55:54.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:54.054 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-21T22:55:54.070 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-07-21T22:55:54.105 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:54.069+0000 7fc565922180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:55:54.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.221+0000 7f31caa48640 1 Processor -- start 2023-07-21T22:55:54.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.221+0000 7f31caa48640 1 -- start start 2023-07-21T22:55:54.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.221+0000 7f31caa48640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31c40d2fc0 0x7f31c40b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:54.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.221+0000 7f31caa48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31c40d2300 0x7f31c40d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:54.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.221+0000 7f31caa48640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c40b04c0 con 0x7f31c415bde0 2023-07-21T22:55:54.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.221+0000 7f31caa48640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c415c1b0 con 0x7f31c40d2fc0 2023-07-21T22:55:54.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.221+0000 7f31caa48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c40d2cc0 con 0x7f31c40d2300 2023-07-21T22:55:54.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.221+0000 7f31c37fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31c40d2fc0 0x7f31c40b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:54.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.221+0000 7f31c37fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31c40d2fc0 0x7f31c40b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52358/0 (socket says 172.21.15.6:52358) 2023-07-21T22:55:54.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.221+0000 7f31c37fe640 1 -- 172.21.15.6:0/1977803402 learned_addr learned my addr 172.21.15.6:0/1977803402 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:54.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.221+0000 7f31c8fe5640 1 --2- 172.21.15.6:0/1977803402 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31c40d2300 0x7f31c40d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:54.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.221+0000 7f31c37fe640 1 -- 172.21.15.6:0/1977803402 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31c40d2300 msgr2=0x7f31c40d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:54.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.221+0000 7f31c37fe640 1 --2- 172.21.15.6:0/1977803402 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31c40d2300 0x7f31c40d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:54.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.221+0000 7f31c37fe640 1 -- 172.21.15.6:0/1977803402 >> v1:172.21.15.161:6789/0 conn(0x7f31c415bde0 legacy=0x7f31c40d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:54.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.221+0000 7f31c37fe640 1 -- 172.21.15.6:0/1977803402 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c40d0aa0 con 0x7f31c40d2fc0 2023-07-21T22:55:54.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.221+0000 7f31c2ffd640 1 -- 172.21.15.6:0/1977803402 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384341874 0 0) 0x7f31c40b04c0 con 0x7f31c415bde0 2023-07-21T22:55:54.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.225+0000 7f31c37fe640 1 --2- 172.21.15.6:0/1977803402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2fc0 0x7f31c40b0950 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009870 tx=0x7f31b801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f168e14076cf91 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:54.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.225+0000 7f31c2ffd640 1 -- 172.21.15.6:0/1977803402 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b80a9400 con 0x7f31c40d2fc0 2023-07-21T22:55:54.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.225+0000 7f31c2ffd640 1 -- 172.21.15.6:0/1977803402 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b80a9560 con 0x7f31c40d2fc0 2023-07-21T22:55:54.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.225+0000 7f31c2ffd640 1 -- 172.21.15.6:0/1977803402 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b80a98f0 con 0x7f31c40d2fc0 2023-07-21T22:55:54.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31caa48640 1 -- 172.21.15.6:0/1977803402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2fc0 msgr2=0x7f31c40b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:54.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31caa48640 1 --2- 172.21.15.6:0/1977803402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2fc0 0x7f31c40b0950 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009870 tx=0x7f31b801c540 comp rx=0 tx=0).stop 2023-07-21T22:55:54.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31caa48640 1 -- 172.21.15.6:0/1977803402 shutdown_connections 2023-07-21T22:55:54.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31caa48640 1 --2- 172.21.15.6:0/1977803402 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31c40d2300 0x7f31c40d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:54.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31caa48640 1 --2- 172.21.15.6:0/1977803402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2fc0 0x7f31c40b0950 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:54.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31caa48640 1 -- 172.21.15.6:0/1977803402 >> 172.21.15.6:0/1977803402 conn(0x7f31c40659d0 msgr2=0x7f31c409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:54.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31caa48640 1 -- 172.21.15.6:0/1977803402 shutdown_connections 2023-07-21T22:55:54.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31caa48640 1 -- 172.21.15.6:0/1977803402 wait complete. 2023-07-21T22:55:54.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31caa48640 1 Processor -- start 2023-07-21T22:55:54.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31caa48640 1 -- start start 2023-07-21T22:55:54.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31caa48640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31c40d2300 0x7f31c41532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:54.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31caa48640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2fc0 0x7f31c4141cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:54.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31caa48640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31c415bde0 0x7f31c4152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:54.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31caa48640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4142200 con 0x7f31c40d2fc0 2023-07-21T22:55:54.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31caa48640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4153950 con 0x7f31c415bde0 2023-07-21T22:55:54.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31caa48640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4153c30 con 0x7f31c40d2300 2023-07-21T22:55:54.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31c37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2fc0 0x7f31c4141cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:54.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31c37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2fc0 0x7f31c4141cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52370/0 (socket says 172.21.15.6:52370) 2023-07-21T22:55:54.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31c37fe640 1 -- 172.21.15.6:0/3306752999 learned_addr learned my addr 172.21.15.6:0/3306752999 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:54.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31c8fe5640 1 --2- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31c415bde0 0x7f31c4152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:54.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31c3fff640 1 --2- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31c40d2300 0x7f31c41532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:54.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31c37fe640 1 -- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31c40d2300 msgr2=0x7f31c41532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:54.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31c37fe640 1 --2- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f31c40d2300 0x7f31c41532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:54.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31c37fe640 1 -- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31c415bde0 msgr2=0x7f31c4152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:54.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31c37fe640 1 --2- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31c415bde0 0x7f31c4152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:54.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31c37fe640 1 -- 172.21.15.6:0/3306752999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b80094d0 con 0x7f31c40d2fc0 2023-07-21T22:55:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.229+0000 7f31c8fe5640 1 --2- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31c415bde0 0x7f31c4152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:55:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.233+0000 7f31c37fe640 1 --2- 172.21.15.6:0/3306752999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2fc0 0x7f31c4141cc0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f31b801a170 tx=0x7f31b801ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.233+0000 7f31c0ff9640 1 -- 172.21.15.6:0/3306752999 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b80a9400 con 0x7f31c40d2fc0 2023-07-21T22:55:54.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.233+0000 7f31c0ff9640 1 -- 172.21.15.6:0/3306752999 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b8004220 con 0x7f31c40d2fc0 2023-07-21T22:55:54.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.233+0000 7f31caa48640 1 -- 172.21.15.6:0/3306752999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c4153f10 con 0x7f31c40d2fc0 2023-07-21T22:55:54.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.233+0000 7f31c0ff9640 1 -- 172.21.15.6:0/3306752999 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8003620 con 0x7f31c40d2fc0 2023-07-21T22:55:54.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.233+0000 7f31caa48640 1 -- 172.21.15.6:0/3306752999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c41544d0 con 0x7f31c40d2fc0 2023-07-21T22:55:54.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.233+0000 7f31caa48640 1 -- 172.21.15.6:0/3306752999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c4153d70 con 0x7f31c40d2fc0 2023-07-21T22:55:54.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.233+0000 7f31c0ff9640 1 -- 172.21.15.6:0/3306752999 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 82) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f31b80b9070 con 0x7f31c40d2fc0 2023-07-21T22:55:54.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.233+0000 7f31c0ff9640 1 --2- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f31b00663f0 0x7f31b00688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:54.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.233+0000 7f31c0ff9640 1 -- 172.21.15.6:0/3306752999 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f31b811e210 con 0x7f31c40d2fc0 2023-07-21T22:55:54.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.233+0000 7f31c3fff640 1 -- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f31b00663f0 msgr2=0x7f31b00688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2346358146 2023-07-21T22:55:54.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.233+0000 7f31c3fff640 1 --2- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f31b00663f0 0x7f31b00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:55:54.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.237+0000 7f31c0ff9640 1 -- 172.21.15.6:0/3306752999 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f31c4153d70 con 0x7f31c40d2fc0 2023-07-21T22:55:54.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.417+0000 7f31caa48640 1 -- 172.21.15.6:0/3306752999 --> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f31c4153d70 con 0x7f31b00663f0 2023-07-21T22:55:54.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.437+0000 7f31c3fff640 1 -- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f31b00663f0 msgr2=0x7f31b00688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2346358146 2023-07-21T22:55:54.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.437+0000 7f31c3fff640 1 --2- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f31b00663f0 0x7f31b00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:55:54.526 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:54.496+0000 7fe98cc48180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:55:54.585 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:54.556+0000 7fe98cc48180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:55:54.620 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:54.585+0000 7fc565922180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:55:54.640 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:54.608+0000 7fe98cc48180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:55:54.682 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:54.649+0000 7fc565922180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:55:54.725 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:54.696+0000 7fe98cc48180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:55:54.741 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:54.705+0000 7fc565922180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:55:54.783 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:54.752+0000 7fe98cc48180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:55:54.832 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:54.797+0000 7fc565922180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:55:54.866 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:54.836+0000 7fe98cc48180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:55:54.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.841+0000 7f31c3fff640 1 -- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f31b00663f0 msgr2=0x7f31b00688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2346358146 2023-07-21T22:55:54.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:54.841+0000 7f31c3fff640 1 --2- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f31b00663f0 0x7f31b00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-21T22:55:54.891 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:54.857+0000 7fc565922180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:55:54.922 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:54.892+0000 7fe98cc48180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:55:54.980 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:54.945+0000 7fc565922180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:55:55.039 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:55.005+0000 7fc565922180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:55:55.064 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:55.032+0000 7fe98cc48180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:55:55.121 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:55.092+0000 7fe98cc48180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:55:55.189 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:55.153+0000 7fc565922180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:55:55.250 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:55.213+0000 7fc565922180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:55:55.360 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:55:55.361 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:55:55.361 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:55:55.369 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:55.340+0000 7fe98cc48180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:55:55.502 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:55:55.503 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:55:55.503 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:55:55.504 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:55.472+0000 7fe98cc48180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:55:55.511 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:55.477+0000 7fc565922180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:55:55.628 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:55.596+0000 7fe98cc48180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:55:55.652 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:55.617+0000 7fc565922180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:55:55.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:55.645+0000 7f31c3fff640 1 -- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f31b00663f0 msgr2=0x7f31b00688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2346358146 2023-07-21T22:55:55.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:55.645+0000 7f31c3fff640 1 --2- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f31b00663f0 0x7f31b00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-21T22:55:55.698 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:55.668+0000 7fe98cc48180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:55:55.784 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:55.749+0000 7fc565922180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:55:55.838 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:55.800+0000 7fe98cc48180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:55:55.858 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:55.821+0000 7fc565922180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:55:55.999 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:55.965+0000 7fc565922180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:55:56.364 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:56.332+0000 7fe98cc48180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:55:56.451 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:56.420+0000 7fe98cc48180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:55:56.570 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:56.537+0000 7fc565922180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:55:56.601 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:56.568+0000 7fe98cc48180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:55:56.659 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:56.625+0000 7fc565922180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:55:56.683 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:56.652+0000 7fe98cc48180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:55:56.814 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:56.777+0000 7fc565922180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:55:56.902 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:56.865+0000 7fc565922180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:55:56.949 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:56.920+0000 7fe98cc48180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:55:57.009 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:56.980+0000 7fe98cc48180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:55:57.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:56.989+0000 7f31c0ff9640 1 -- 172.21.15.6:0/3306752999 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 83) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f31b80eb890 con 0x7f31c40d2fc0 2023-07-21T22:55:57.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:56.989+0000 7f31c0ff9640 1 -- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f31b00663f0 msgr2=0x7f31b00688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:55:57.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:56.989+0000 7f31c0ff9640 1 --2- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:6832/2346358146,v1:172.21.15.161:6833/2346358146] conn(0x7f31b00663f0 0x7f31b00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:57.151 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:57.120+0000 7fe90e0dd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:55:57.151 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:57.120+0000 7fe90e0dd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:55:57.151 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:57.120+0000 7fe90e0dd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:55:57.151 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:57.120+0000 7fe90e0dd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:55:57.151 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:57.120+0000 7fe90e0dd640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:55:57.152 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:57.120+0000 7fe90b0d7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:55:57.152 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:57.120+0000 7fe90b0d7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:55:57.152 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:57.120+0000 7fe90b0d7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:55:57.152 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:57.120+0000 7fe90b0d7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:55:57.152 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:55:57.120+0000 7fe90b0d7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:55:57.206 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:57.173+0000 7fc565922180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:55:57.269 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:55:57.233+0000 7fc565922180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:55:58.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:57.993+0000 7f31c0ff9640 1 -- 172.21.15.6:0/3306752999 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mgrmap(e 84) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f31b811c4e0 con 0x7f31c40d2fc0 2023-07-21T22:55:58.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:57.993+0000 7f31c0ff9640 1 --2- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f31b0033920 0x7f31b0033cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:57.993+0000 7f31c0ff9640 1 -- 172.21.15.6:0/3306752999 --> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f31c4153d70 con 0x7f31b0033920 2023-07-21T22:55:58.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:57.997+0000 7f31c3fff640 1 --2- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f31b0033920 0x7f31b0033cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.005+0000 7f31c3fff640 1 --2- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f31b0033920 0x7f31b0033cf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f31b4007f70 tx=0x7f31b4007cc0 comp rx=0 tx=0).ready entity=mgr.9667 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:58.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.065+0000 7f31c0ff9640 1 -- 172.21.15.6:0/3306752999 <== mgr.9667 v2:172.21.15.161:6832/2516914157 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f31c4153d70 con 0x7f31b0033920 2023-07-21T22:55:58.101 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule set for path snap_test_dir1 2023-07-21T22:55:58.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.069+0000 7f31caa48640 1 -- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f31b0033920 msgr2=0x7f31b0033cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.069+0000 7f31caa48640 1 --2- 172.21.15.6:0/3306752999 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f31b0033920 0x7f31b0033cf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f31b4007f70 tx=0x7f31b4007cc0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.069+0000 7f31caa48640 1 -- 172.21.15.6:0/3306752999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2fc0 msgr2=0x7f31c4141cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.069+0000 7f31caa48640 1 --2- 172.21.15.6:0/3306752999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c40d2fc0 0x7f31c4141cc0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f31b801a170 tx=0x7f31b801ad80 comp rx=0 tx=0).stop 2023-07-21T22:55:58.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.069+0000 7f31c8fe5640 1 -- 172.21.15.6:0/3306752999 reap_dead start 2023-07-21T22:55:58.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.069+0000 7f31caa48640 1 -- 172.21.15.6:0/3306752999 shutdown_connections 2023-07-21T22:55:58.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.069+0000 7f31caa48640 1 -- 172.21.15.6:0/3306752999 >> 172.21.15.6:0/3306752999 conn(0x7f31c40659d0 msgr2=0x7f31c415ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:58.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.069+0000 7f31caa48640 1 -- 172.21.15.6:0/3306752999 shutdown_connections 2023-07-21T22:55:58.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.069+0000 7f31caa48640 1 -- 172.21.15.6:0/3306752999 wait complete. 2023-07-21T22:55:58.125 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-21T22:55:58.125 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-07-21T22:55:58.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.241+0000 7f0c450cb640 1 Processor -- start 2023-07-21T22:55:58.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.241+0000 7f0c450cb640 1 -- start start 2023-07-21T22:55:58.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.245+0000 7f0c450cb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0c400aeb40 0x7f0c4015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.245+0000 7f0c450cb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c400aef10 0x7f0c40158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.245+0000 7f0c450cb640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c401532b0 con 0x7f0c40159270 2023-07-21T22:55:58.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.245+0000 7f0c450cb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c400ca6f0 con 0x7f0c400aeb40 2023-07-21T22:55:58.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.245+0000 7f0c450cb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c401599d0 con 0x7f0c400aef10 2023-07-21T22:55:58.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.245+0000 7f0c3f59e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0c40159270 0x7f0c400c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49754/0 (socket says 172.21.15.6:49754) 2023-07-21T22:55:58.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.245+0000 7f0c3f59e640 1 -- 172.21.15.6:0/2978349821 learned_addr learned my addr 172.21.15.6:0/2978349821 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:58.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.245+0000 7f0c37fff640 1 --2- 172.21.15.6:0/2978349821 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c400aef10 0x7f0c40158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.245+0000 7f0c3ed9d640 1 --2- 172.21.15.6:0/2978349821 >> v2:172.21.15.161:3300/0 conn(0x7f0c400aeb40 0x7f0c4015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.245+0000 7f0c3e59c640 1 -- 172.21.15.6:0/2978349821 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600062544 0 0) 0x7f0c401532b0 con 0x7f0c40159270 2023-07-21T22:55:58.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.245+0000 7f0c3e59c640 1 -- 172.21.15.6:0/2978349821 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c2c003530 con 0x7f0c40159270 2023-07-21T22:55:58.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.245+0000 7f0c37fff640 1 -- 172.21.15.6:0/2978349821 >> v2:172.21.15.161:3300/0 conn(0x7f0c400aeb40 msgr2=0x7f0c4015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:58.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.245+0000 7f0c37fff640 1 --2- 172.21.15.6:0/2978349821 >> v2:172.21.15.161:3300/0 conn(0x7f0c400aeb40 0x7f0c4015cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.245+0000 7f0c37fff640 1 -- 172.21.15.6:0/2978349821 >> v1:172.21.15.6:6789/0 conn(0x7f0c40159270 legacy=0x7f0c400c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.245+0000 7f0c37fff640 1 -- 172.21.15.6:0/2978349821 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c40159cb0 con 0x7f0c400aef10 2023-07-21T22:55:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.245+0000 7f0c3ed9d640 1 --2- 172.21.15.6:0/2978349821 >> v2:172.21.15.161:3300/0 conn(0x7f0c400aeb40 0x7f0c4015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:55:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.249+0000 7f0c37fff640 1 --2- 172.21.15.6:0/2978349821 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c400aef10 0x7f0c40158d30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0c280097c0 tx=0x7f0c2801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1025625dcc51bbe server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.249+0000 7f0c3e59c640 1 -- 172.21.15.6:0/2978349821 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c280ac620 con 0x7f0c400aef10 2023-07-21T22:55:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.249+0000 7f0c3e59c640 1 -- 172.21.15.6:0/2978349821 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c280ac780 con 0x7f0c400aef10 2023-07-21T22:55:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.249+0000 7f0c3e59c640 1 -- 172.21.15.6:0/2978349821 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c280acb10 con 0x7f0c400aef10 2023-07-21T22:55:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.249+0000 7f0c450cb640 1 -- 172.21.15.6:0/2978349821 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c400aef10 msgr2=0x7f0c40158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.249+0000 7f0c450cb640 1 --2- 172.21.15.6:0/2978349821 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c400aef10 0x7f0c40158d30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f0c280097c0 tx=0x7f0c2801c3c0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.249+0000 7f0c450cb640 1 -- 172.21.15.6:0/2978349821 shutdown_connections 2023-07-21T22:55:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.249+0000 7f0c450cb640 1 --2- 172.21.15.6:0/2978349821 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c400aef10 0x7f0c40158d30 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.249+0000 7f0c450cb640 1 --2- 172.21.15.6:0/2978349821 >> v2:172.21.15.161:3300/0 conn(0x7f0c400aeb40 0x7f0c4015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.249+0000 7f0c450cb640 1 -- 172.21.15.6:0/2978349821 >> 172.21.15.6:0/2978349821 conn(0x7f0c400cde90 msgr2=0x7f0c400ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.249+0000 7f0c450cb640 1 -- 172.21.15.6:0/2978349821 shutdown_connections 2023-07-21T22:55:58.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.249+0000 7f0c450cb640 1 -- 172.21.15.6:0/2978349821 wait complete. 2023-07-21T22:55:58.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.249+0000 7f0c450cb640 1 Processor -- start 2023-07-21T22:55:58.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c450cb640 1 -- start start 2023-07-21T22:55:58.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c450cb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c400aeb40 0x7f0c4006bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c450cb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c400aef10 0x7f0c400adb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c450cb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c40159270 0x7f0c4014f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c450cb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c40157df0 con 0x7f0c400aeb40 2023-07-21T22:55:58.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c450cb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c40157b10 con 0x7f0c400aef10 2023-07-21T22:55:58.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c450cb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c401657b0 con 0x7f0c40159270 2023-07-21T22:55:58.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c3ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c400aeb40 0x7f0c4006bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c3ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c400aeb40 0x7f0c4006bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50946/0 (socket says 172.21.15.6:50946) 2023-07-21T22:55:58.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c3ed9d640 1 -- 172.21.15.6:0/3377116920 learned_addr learned my addr 172.21.15.6:0/3377116920 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:58.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c3f59e640 1 --2- 172.21.15.6:0/3377116920 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c40159270 0x7f0c4014f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c37fff640 1 --2- 172.21.15.6:0/3377116920 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c400aef10 0x7f0c400adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c3ed9d640 1 -- 172.21.15.6:0/3377116920 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c40159270 msgr2=0x7f0c4014f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c3ed9d640 1 --2- 172.21.15.6:0/3377116920 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c40159270 0x7f0c4014f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c3ed9d640 1 -- 172.21.15.6:0/3377116920 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c400aef10 msgr2=0x7f0c400adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c3ed9d640 1 --2- 172.21.15.6:0/3377116920 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c400aef10 0x7f0c400adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c3ed9d640 1 -- 172.21.15.6:0/3377116920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c30009420 con 0x7f0c400aeb40 2023-07-21T22:55:58.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c3ed9d640 1 --2- 172.21.15.6:0/3377116920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c400aeb40 0x7f0c4006bb70 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000ebe0 tx=0x7f0c3000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:58.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c377fe640 1 -- 172.21.15.6:0/3377116920 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3000eee0 con 0x7f0c400aeb40 2023-07-21T22:55:58.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c377fe640 1 -- 172.21.15.6:0/3377116920 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3000cc30 con 0x7f0c400aeb40 2023-07-21T22:55:58.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c377fe640 1 -- 172.21.15.6:0/3377116920 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c30013470 con 0x7f0c400aeb40 2023-07-21T22:55:58.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c450cb640 1 -- 172.21.15.6:0/3377116920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c28009420 con 0x7f0c400aeb40 2023-07-21T22:55:58.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c450cb640 1 -- 172.21.15.6:0/3377116920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c40165d70 con 0x7f0c400aeb40 2023-07-21T22:55:58.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.253+0000 7f0c450cb640 1 -- 172.21.15.6:0/3377116920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c400678d0 con 0x7f0c400aeb40 2023-07-21T22:55:58.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.257+0000 7f0c377fe640 1 -- 172.21.15.6:0/3377116920 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 84) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f0c300135d0 con 0x7f0c400aeb40 2023-07-21T22:55:58.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.257+0000 7f0c377fe640 1 --2- 172.21.15.6:0/3377116920 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f0c20066120 0x7f0c200685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.257+0000 7f0c377fe640 1 -- 172.21.15.6:0/3377116920 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f0c30083e60 con 0x7f0c400aeb40 2023-07-21T22:55:58.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.257+0000 7f0c37fff640 1 --2- 172.21.15.6:0/3377116920 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f0c20066120 0x7f0c200685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.257+0000 7f0c37fff640 1 --2- 172.21.15.6:0/3377116920 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f0c20066120 0x7f0c200685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0c280ae000 tx=0x7f0c28008040 comp rx=0 tx=0).ready entity=mgr.9667 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:58.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.261+0000 7f0c377fe640 1 -- 172.21.15.6:0/3377116920 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c30051460 con 0x7f0c400aeb40 2023-07-21T22:55:58.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.437+0000 7f0c450cb640 1 -- 172.21.15.6:0/3377116920 --> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c40159670 con 0x7f0c20066120 2023-07-21T22:55:58.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.485+0000 7f0c377fe640 1 -- 172.21.15.6:0/3377116920 <== mgr.9667 v2:172.21.15.161:6832/2516914157 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f0c280bd0e0 con 0x7f0c20066120 2023-07-21T22:55:58.522 INFO:teuthology.orchestra.run.smithi006.stdout:Retention added to path snap_test_dir1 2023-07-21T22:55:58.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.489+0000 7f0c450cb640 1 -- 172.21.15.6:0/3377116920 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f0c20066120 msgr2=0x7f0c200685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.489+0000 7f0c450cb640 1 --2- 172.21.15.6:0/3377116920 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f0c20066120 0x7f0c200685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0c280ae000 tx=0x7f0c28008040 comp rx=0 tx=0).stop 2023-07-21T22:55:58.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.489+0000 7f0c450cb640 1 -- 172.21.15.6:0/3377116920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c400aeb40 msgr2=0x7f0c4006bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.489+0000 7f0c450cb640 1 --2- 172.21.15.6:0/3377116920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c400aeb40 0x7f0c4006bb70 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000ebe0 tx=0x7f0c3000c520 comp rx=0 tx=0).stop 2023-07-21T22:55:58.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.489+0000 7f0c450cb640 1 -- 172.21.15.6:0/3377116920 shutdown_connections 2023-07-21T22:55:58.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.489+0000 7f0c450cb640 1 --2- 172.21.15.6:0/3377116920 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f0c20066120 0x7f0c200685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.489+0000 7f0c450cb640 1 --2- 172.21.15.6:0/3377116920 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c40159270 0x7f0c4014f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.489+0000 7f0c450cb640 1 --2- 172.21.15.6:0/3377116920 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c400aef10 0x7f0c400adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.489+0000 7f0c450cb640 1 --2- 172.21.15.6:0/3377116920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c400aeb40 0x7f0c4006bb70 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.489+0000 7f0c450cb640 1 -- 172.21.15.6:0/3377116920 >> 172.21.15.6:0/3377116920 conn(0x7f0c400cde90 msgr2=0x7f0c40152910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:58.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.489+0000 7f0c450cb640 1 -- 172.21.15.6:0/3377116920 shutdown_connections 2023-07-21T22:55:58.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.489+0000 7f0c450cb640 1 -- 172.21.15.6:0/3377116920 wait complete. 2023-07-21T22:55:58.543 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-07-21T22:55:58.544 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-21-22_56_00 in ~2s... 2023-07-21T22:55:58.545 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-07-21T22:55:58.546 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-07-21T22:55:58.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.661+0000 7f4cadcf9640 1 Processor -- start 2023-07-21T22:55:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.661+0000 7f4cadcf9640 1 -- start start 2023-07-21T22:55:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.661+0000 7f4cadcf9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ca8159440 0x7f4ca80c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.661+0000 7f4cadcf9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca81532b0 con 0x7f4ca815cef0 2023-07-21T22:55:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.661+0000 7f4cadcf9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca80ca6f0 con 0x7f4ca80aeb40 2023-07-21T22:55:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.661+0000 7f4cadcf9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca815d360 con 0x7f4ca8159440 2023-07-21T22:55:58.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.661+0000 7f4ca6ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4ca815cef0 0x7f4ca8158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49768/0 (socket says 172.21.15.6:49768) 2023-07-21T22:55:58.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.661+0000 7f4ca6ffd640 1 -- 172.21.15.6:0/2606775338 learned_addr learned my addr 172.21.15.6:0/2606775338 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:55:58.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.661+0000 7f4ca7fff640 1 --2- 172.21.15.6:0/2606775338 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ca8159440 0x7f4ca80c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.661+0000 7f4ca67fc640 1 -- 172.21.15.6:0/2606775338 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093143909 0 0) 0x7f4ca81532b0 con 0x7f4ca815cef0 2023-07-21T22:55:58.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.661+0000 7f4ca67fc640 1 -- 172.21.15.6:0/2606775338 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c90003530 con 0x7f4ca815cef0 2023-07-21T22:55:58.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.661+0000 7f4ca67fc640 1 -- 172.21.15.6:0/2606775338 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485604293 0 0) 0x7f4ca80ca6f0 con 0x7f4ca80aeb40 2023-07-21T22:55:58.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.661+0000 7f4ca67fc640 1 -- 172.21.15.6:0/2606775338 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ca81532b0 con 0x7f4ca80aeb40 2023-07-21T22:55:58.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.661+0000 7f4ca7fff640 1 -- 172.21.15.6:0/2606775338 >> v1:172.21.15.161:6789/0 conn(0x7f4ca80aeb40 legacy=0x7f4ca80aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.661+0000 7f4ca7fff640 1 -- 172.21.15.6:0/2606775338 >> v1:172.21.15.6:6789/0 conn(0x7f4ca815cef0 legacy=0x7f4ca8158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.661+0000 7f4ca7fff640 1 -- 172.21.15.6:0/2606775338 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca81599d0 con 0x7f4ca8159440 2023-07-21T22:55:58.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.665+0000 7f4ca7fff640 1 --2- 172.21.15.6:0/2606775338 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ca8159440 0x7f4ca80c88c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009dc0 tx=0x7f4ca001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b082e5f8018a37c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.665+0000 7f4ca67fc640 1 -- 172.21.15.6:0/2606775338 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00a5a00 con 0x7f4ca8159440 2023-07-21T22:55:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.665+0000 7f4ca67fc640 1 -- 172.21.15.6:0/2606775338 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca00a5b60 con 0x7f4ca8159440 2023-07-21T22:55:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.665+0000 7f4ca67fc640 1 -- 172.21.15.6:0/2606775338 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00ad440 con 0x7f4ca8159440 2023-07-21T22:55:58.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.665+0000 7f4cadcf9640 1 -- 172.21.15.6:0/2606775338 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ca8159440 msgr2=0x7f4ca80c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.665+0000 7f4cadcf9640 1 --2- 172.21.15.6:0/2606775338 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ca8159440 0x7f4ca80c88c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009dc0 tx=0x7f4ca001c940 comp rx=0 tx=0).stop 2023-07-21T22:55:58.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.665+0000 7f4cadcf9640 1 -- 172.21.15.6:0/2606775338 shutdown_connections 2023-07-21T22:55:58.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.665+0000 7f4cadcf9640 1 --2- 172.21.15.6:0/2606775338 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ca8159440 0x7f4ca80c88c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.665+0000 7f4cadcf9640 1 -- 172.21.15.6:0/2606775338 >> 172.21.15.6:0/2606775338 conn(0x7f4ca80cde90 msgr2=0x7f4ca80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.665+0000 7f4cadcf9640 1 -- 172.21.15.6:0/2606775338 shutdown_connections 2023-07-21T22:55:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.665+0000 7f4cadcf9640 1 -- 172.21.15.6:0/2606775338 wait complete. 2023-07-21T22:55:58.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4cadcf9640 1 Processor -- start 2023-07-21T22:55:58.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4cadcf9640 1 -- start start 2023-07-21T22:55:58.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4cadcf9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ca80aeb40 0x7f4ca814da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4cadcf9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca8159440 0x7f4ca81505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4cadcf9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ca815cef0 0x7f4ca806cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4cadcf9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca806d2e0 con 0x7f4ca8159440 2023-07-21T22:55:58.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4cadcf9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca815a570 con 0x7f4ca815cef0 2023-07-21T22:55:58.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4cadcf9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca8159f90 con 0x7f4ca80aeb40 2023-07-21T22:55:58.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4ca6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca8159440 0x7f4ca81505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4ca77fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ca80aeb40 0x7f4ca814da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4ca6ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca8159440 0x7f4ca81505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50954/0 (socket says 172.21.15.6:50954) 2023-07-21T22:55:58.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4ca77fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ca80aeb40 0x7f4ca814da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:54830/0 (socket says 172.21.15.6:54830) 2023-07-21T22:55:58.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4ca6ffd640 1 -- 172.21.15.6:0/1868996667 learned_addr learned my addr 172.21.15.6:0/1868996667 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:55:58.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4ca7fff640 1 --2- 172.21.15.6:0/1868996667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ca815cef0 0x7f4ca806cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4ca77fe640 1 -- 172.21.15.6:0/1868996667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ca815cef0 msgr2=0x7f4ca806cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4ca77fe640 1 --2- 172.21.15.6:0/1868996667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ca815cef0 0x7f4ca806cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4ca77fe640 1 -- 172.21.15.6:0/1868996667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca8159440 msgr2=0x7f4ca81505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4ca77fe640 1 --2- 172.21.15.6:0/1868996667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca8159440 0x7f4ca81505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4ca77fe640 1 -- 172.21.15.6:0/1868996667 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca0009a70 con 0x7f4ca80aeb40 2023-07-21T22:55:58.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4ca6ffd640 1 --2- 172.21.15.6:0/1868996667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca8159440 0x7f4ca81505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:55:58.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4ca77fe640 1 --2- 172.21.15.6:0/1868996667 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ca80aeb40 0x7f4ca814da90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800c460 tx=0x7f4c9800c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:58.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4c8ffff640 1 -- 172.21.15.6:0/1868996667 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c980052d0 con 0x7f4ca80aeb40 2023-07-21T22:55:58.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4c8ffff640 1 -- 172.21.15.6:0/1868996667 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c98005430 con 0x7f4ca80aeb40 2023-07-21T22:55:58.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4c8ffff640 1 -- 172.21.15.6:0/1868996667 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98003840 con 0x7f4ca80aeb40 2023-07-21T22:55:58.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4cadcf9640 1 -- 172.21.15.6:0/1868996667 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca8150cd0 con 0x7f4ca80aeb40 2023-07-21T22:55:58.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.669+0000 7f4cadcf9640 1 -- 172.21.15.6:0/1868996667 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca8150fb0 con 0x7f4ca80aeb40 2023-07-21T22:55:58.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.673+0000 7f4cadcf9640 1 -- 172.21.15.6:0/1868996667 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca80678d0 con 0x7f4ca80aeb40 2023-07-21T22:55:58.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.673+0000 7f4c8ffff640 1 -- 172.21.15.6:0/1868996667 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 84) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f4c980039a0 con 0x7f4ca80aeb40 2023-07-21T22:55:58.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.673+0000 7f4c8ffff640 1 --2- 172.21.15.6:0/1868996667 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f4c94066120 0x7f4c940685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.673+0000 7f4c8ffff640 1 -- 172.21.15.6:0/1868996667 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f4c98083140 con 0x7f4ca80aeb40 2023-07-21T22:55:58.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.673+0000 7f4ca6ffd640 1 --2- 172.21.15.6:0/1868996667 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f4c94066120 0x7f4c940685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.673+0000 7f4ca6ffd640 1 --2- 172.21.15.6:0/1868996667 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f4c94066120 0x7f4c940685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80cc1b0 tx=0x7f4c9c009040 comp rx=0 tx=0).ready entity=mgr.9667 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:58.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.677+0000 7f4c8ffff640 1 -- 172.21.15.6:0/1868996667 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4c98050740 con 0x7f4ca80aeb40 2023-07-21T22:55:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.849+0000 7f4cadcf9640 1 -- 172.21.15.6:0/1868996667 --> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4ca815c9d0 con 0x7f4c94066120 2023-07-21T22:55:58.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.857+0000 7f4c8ffff640 1 -- 172.21.15.6:0/1868996667 <== mgr.9667 v2:172.21.15.161:6832/2516914157 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f4c9c001970 con 0x7f4c94066120 2023-07-21T22:55:58.893 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:55:58.893 INFO:teuthology.orchestra.run.smithi006.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-07-21T22:55:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.861+0000 7f4cadcf9640 1 -- 172.21.15.6:0/1868996667 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f4c94066120 msgr2=0x7f4c940685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.861+0000 7f4cadcf9640 1 --2- 172.21.15.6:0/1868996667 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f4c94066120 0x7f4c940685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80cc1b0 tx=0x7f4c9c009040 comp rx=0 tx=0).stop 2023-07-21T22:55:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.861+0000 7f4cadcf9640 1 -- 172.21.15.6:0/1868996667 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ca80aeb40 msgr2=0x7f4ca814da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.861+0000 7f4cadcf9640 1 --2- 172.21.15.6:0/1868996667 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ca80aeb40 0x7f4ca814da90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800c460 tx=0x7f4c9800c920 comp rx=0 tx=0).stop 2023-07-21T22:55:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.861+0000 7f4cadcf9640 1 -- 172.21.15.6:0/1868996667 shutdown_connections 2023-07-21T22:55:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.861+0000 7f4cadcf9640 1 --2- 172.21.15.6:0/1868996667 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f4c94066120 0x7f4c940685d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.861+0000 7f4cadcf9640 1 --2- 172.21.15.6:0/1868996667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ca815cef0 0x7f4ca806cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.861+0000 7f4cadcf9640 1 --2- 172.21.15.6:0/1868996667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca8159440 0x7f4ca81505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.861+0000 7f4cadcf9640 1 --2- 172.21.15.6:0/1868996667 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ca80aeb40 0x7f4ca814da90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.861+0000 7f4cadcf9640 1 -- 172.21.15.6:0/1868996667 >> 172.21.15.6:0/1868996667 conn(0x7f4ca80cde90 msgr2=0x7f4ca80ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.861+0000 7f4cadcf9640 1 -- 172.21.15.6:0/1868996667 shutdown_connections 2023-07-21T22:55:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:55:58.861+0000 7f4cadcf9640 1 -- 172.21.15.6:0/1868996667 wait complete. 2023-07-21T22:55:58.914 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-07-21T22:55:58.914 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-07-21T22:55:58.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:58.915 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:55:58.926 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:55:58.927 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:55:58.927 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:55:59.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:55:59.929 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:55:59.942 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-21T22:55:59.942 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:55:59.942 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:00.534 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:56:00.504+0000 7fe8fd0bb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:56:00.534 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:56:00.504+0000 7fe8fd0bb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:56:00.534 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:56:00.504+0000 7fe8fd0bb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:56:00.534 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:56:00.504+0000 7fe8fd0bb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:56:00.535 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:56:00.504+0000 7fe8fd0bb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:56:00.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:00.944 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:00.966 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:00.970 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:00.970 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:00.971 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:00.972 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-07-21-22_56_00_UTC'] 2023-07-21T22:56:00.972 DEBUG:tasks.cephfs.test_snap_schedules:exec=1689980158.5444, now = 1689980160.9723916, timo = 2 2023-07-21T22:56:01.973 DEBUG:tasks.cephfs.test_snap_schedules:expecting removal of snap snap_test_dir1/.snap/scheduled-2023-07-21-22_56_00 in ~62s... 2023-07-21T22:56:01.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:01.974 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:01.988 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:01.990 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:01.990 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:01.990 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:02.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:02.993 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:03.004 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:03.005 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:03.006 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:03.007 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:04.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:04.008 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:04.019 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:04.020 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:04.021 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:04.021 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:05.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:05.022 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:05.033 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:05.034 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:05.034 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:05.035 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:06.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:06.036 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:06.047 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:06.048 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:06.049 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:06.049 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:07.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:07.051 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:07.063 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:07.064 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:07.065 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:07.065 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:08.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:08.068 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:08.080 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:08.081 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:08.081 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:08.082 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:09.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:09.083 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:09.095 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:09.095 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:09.096 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:09.096 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:10.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:10.098 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:10.108 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:10.109 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:10.110 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:10.110 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:11.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:11.112 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:11.125 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:11.125 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:11.125 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:11.126 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:12.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:12.127 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:12.139 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:12.140 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:12.140 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:12.141 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:13.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:13.142 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:13.153 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:13.154 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:13.155 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:13.155 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:14.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:14.157 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:14.168 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:14.169 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:14.170 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:14.170 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:15.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:15.172 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:15.183 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:15.184 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:15.184 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:15.185 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:16.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:16.187 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:16.200 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:16.200 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:16.201 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:16.201 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:17.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:17.203 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:17.214 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:17.216 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:17.216 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:17.216 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:18.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:18.218 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:18.228 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:18.229 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:18.230 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:18.230 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:18.273 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:56:18.280 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:56:19.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:19.232 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:19.243 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:19.244 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:19.245 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:19.245 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:20.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:20.247 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:20.258 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:20.259 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:20.259 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:20.259 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:21.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:21.261 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:21.272 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:21.273 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:21.273 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:21.274 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:22.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:22.276 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:22.288 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:22.289 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:22.290 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:22.291 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:23.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:23.292 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:23.303 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:23.304 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:23.305 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:23.305 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:24.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:24.307 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:24.318 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:24.319 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:24.319 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:24.320 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:25.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:25.322 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:25.333 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:25.334 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:25.334 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:25.334 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:26.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:26.336 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:26.347 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:26.348 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:26.348 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:26.348 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:27.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:27.350 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:27.361 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:27.362 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:27.362 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:27.363 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:28.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:28.364 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:28.376 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:28.378 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:28.379 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:28.379 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:29.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:29.381 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:29.392 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:29.393 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:29.394 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:29.394 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:30.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:30.396 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:30.407 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:30.408 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:30.408 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:30.408 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:31.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:31.410 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:31.421 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:31.422 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:31.422 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:31.423 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:32.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:32.425 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:32.437 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:32.438 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:32.438 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:32.438 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:33.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:33.440 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:33.451 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:33.453 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:33.454 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:33.454 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:34.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:34.457 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:34.469 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:34.469 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:34.470 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:34.470 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:35.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:35.473 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:35.485 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:35.486 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:35.486 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:35.486 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:36.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:36.488 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:36.500 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:36.501 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:36.501 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:36.501 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:37.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:37.503 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:37.517 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:37.518 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:37.519 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:37.520 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:38.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:38.522 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:38.535 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:38.536 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:38.536 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:38.537 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:39.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:39.539 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:39.550 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:39.551 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:39.552 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:39.552 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:40.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:40.553 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:40.564 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:40.566 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:40.566 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:40.567 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:41.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:41.568 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:41.580 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:41.582 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:41.583 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:41.584 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:42.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:42.586 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:42.597 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:42.598 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:42.599 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:42.599 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:43.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:43.600 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:43.611 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:43.613 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:43.613 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:43.614 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:44.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:44.616 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:44.627 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:44.628 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:44.629 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:44.629 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:45.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:45.630 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:45.642 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:45.643 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:45.643 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:45.643 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:46.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:46.645 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:46.657 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:46.658 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:46.659 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:46.659 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:47.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:47.661 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:47.672 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:47.673 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:47.673 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:47.673 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:48.346 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:56:48.350 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:56:48.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:48.675 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:48.686 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:48.687 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:48.688 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:48.688 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:49.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:49.690 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:49.701 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:49.702 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:49.703 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:49.703 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:50.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:50.704 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:50.716 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:50.717 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:50.717 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:50.717 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:51.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:51.719 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:51.731 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:51.732 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:51.733 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:51.734 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:52.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:52.736 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:52.747 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:52.748 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:52.749 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:52.749 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:53.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:53.750 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:53.762 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:53.763 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:53.763 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:53.764 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:54.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:54.765 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:54.777 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:54.778 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:54.778 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:54.778 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:55.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:55.780 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:55.791 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:55.793 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:55.793 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:55.793 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:56.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:56.796 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:56.809 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:56.809 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:56.809 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:56.810 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:57.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:57.812 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:57.824 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:57.825 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:57.825 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:57.825 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:58.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:58.828 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:58.840 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:58.841 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:58.841 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:58.841 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:56:59.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:56:59.842 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:56:59.853 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_56_00_UTC 2023-07-21T22:56:59.855 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:56:59.855 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-21T22:56:59.855 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-21T22:57:00.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:00.857 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:57:00.868 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_57_00_UTC 2023-07-21T22:57:00.870 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-21-22_57_00_UTC'} 2023-07-21T22:57:00.870 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-21-22_57_00_UTC'} 2023-07-21T22:57:00.871 INFO:tasks.cephfs.test_snap_schedules:removed: {'scheduled-2023-07-21-22_56_00_UTC'} 2023-07-21T22:57:00.871 DEBUG:tasks.cephfs.test_snap_schedules:snapshots removed=['scheduled-2023-07-21-22_56_00_UTC'] 2023-07-21T22:57:00.871 DEBUG:tasks.cephfs.test_snap_schedules:exec=1689980158.5444, now = 1689980220.8715587, timo = 62 2023-07-21T22:57:01.873 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-21T22:57:02.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:01.997+0000 7fbe83aca640 1 Processor -- start 2023-07-21T22:57:02.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:01.997+0000 7fbe83aca640 1 -- start start 2023-07-21T22:57:02.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:01.997+0000 7fbe83aca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbe7c0cd830 0x7fbe7c0c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:02.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:01.997+0000 7fbe83aca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7c0695b0 con 0x7fbe7c0af2b0 2023-07-21T22:57:02.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:01.997+0000 7fbe83aca640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7c069890 con 0x7fbe7c0c3ac0 2023-07-21T22:57:02.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:01.997+0000 7fbe83aca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7c069b70 con 0x7fbe7c0cd830 2023-07-21T22:57:02.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:01.997+0000 7fbe82067640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbe7c0cd830 0x7fbe7c0c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:02.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:01.997+0000 7fbe82067640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbe7c0cd830 0x7fbe7c0c2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41778/0 (socket says 172.21.15.6:41778) 2023-07-21T22:57:02.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:01.997+0000 7fbe82067640 1 -- 172.21.15.6:0/2900165228 learned_addr learned my addr 172.21.15.6:0/2900165228 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:02.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:01.997+0000 7fbe82067640 1 -- 172.21.15.6:0/2900165228 >> v1:172.21.15.161:6789/0 conn(0x7fbe7c0c3ac0 legacy=0x7fbe7c0ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:02.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:01.997+0000 7fbe82067640 1 -- 172.21.15.6:0/2900165228 >> v1:172.21.15.6:6789/0 conn(0x7fbe7c0af2b0 legacy=0x7fbe7c0cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:02.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:01.997+0000 7fbe82067640 1 -- 172.21.15.6:0/2900165228 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c069e50 con 0x7fbe7c0cd830 2023-07-21T22:57:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.001+0000 7fbe82067640 1 --2- 172.21.15.6:0/2900165228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe7c0cd830 0x7fbe7c0c2d30 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009e50 tx=0x7fbe7401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b78736213de2666 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.001+0000 7fbe80864640 1 -- 172.21.15.6:0/2900165228 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740a58b0 con 0x7fbe7c0cd830 2023-07-21T22:57:02.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.001+0000 7fbe80864640 1 -- 172.21.15.6:0/2900165228 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe740a5a10 con 0x7fbe7c0cd830 2023-07-21T22:57:02.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.001+0000 7fbe80864640 1 -- 172.21.15.6:0/2900165228 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740a5da0 con 0x7fbe7c0cd830 2023-07-21T22:57:02.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.001+0000 7fbe83aca640 1 -- 172.21.15.6:0/2900165228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe7c0cd830 msgr2=0x7fbe7c0c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:02.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.001+0000 7fbe83aca640 1 --2- 172.21.15.6:0/2900165228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe7c0cd830 0x7fbe7c0c2d30 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009e50 tx=0x7fbe7401c9d0 comp rx=0 tx=0).stop 2023-07-21T22:57:02.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.001+0000 7fbe83aca640 1 -- 172.21.15.6:0/2900165228 shutdown_connections 2023-07-21T22:57:02.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.001+0000 7fbe83aca640 1 --2- 172.21.15.6:0/2900165228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe7c0cd830 0x7fbe7c0c2d30 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:02.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.001+0000 7fbe83aca640 1 -- 172.21.15.6:0/2900165228 >> 172.21.15.6:0/2900165228 conn(0x7fbe7c0cde90 msgr2=0x7fbe7c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:02.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.001+0000 7fbe83aca640 1 -- 172.21.15.6:0/2900165228 shutdown_connections 2023-07-21T22:57:02.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.001+0000 7fbe83aca640 1 -- 172.21.15.6:0/2900165228 wait complete. 2023-07-21T22:57:02.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe83aca640 1 Processor -- start 2023-07-21T22:57:02.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe83aca640 1 -- start start 2023-07-21T22:57:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe83aca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe7c0af2b0 0x7fbe7c144f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe83aca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe7c0c3ac0 0x7fbe7c0c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe83aca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe7c0cd830 0x7fbe7c159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe83aca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0b0dc0 con 0x7fbe7c0af2b0 2023-07-21T22:57:02.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe83aca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0b1c20 con 0x7fbe7c0c3ac0 2023-07-21T22:57:02.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe83aca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0b0fa0 con 0x7fbe7c0cd830 2023-07-21T22:57:02.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe81866640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe7c0af2b0 0x7fbe7c144f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:02.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe81866640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe7c0af2b0 0x7fbe7c144f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41790/0 (socket says 172.21.15.6:41790) 2023-07-21T22:57:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe81866640 1 -- 172.21.15.6:0/4269498285 learned_addr learned my addr 172.21.15.6:0/4269498285 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe82067640 1 --2- 172.21.15.6:0/4269498285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe7c0cd830 0x7fbe7c159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe81065640 1 --2- 172.21.15.6:0/4269498285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe7c0c3ac0 0x7fbe7c0c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:02.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe81866640 1 -- 172.21.15.6:0/4269498285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe7c0cd830 msgr2=0x7fbe7c159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:02.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe81866640 1 --2- 172.21.15.6:0/4269498285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe7c0cd830 0x7fbe7c159e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:02.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe81866640 1 -- 172.21.15.6:0/4269498285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe7c0c3ac0 msgr2=0x7fbe7c0c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:02.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe81866640 1 --2- 172.21.15.6:0/4269498285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe7c0c3ac0 0x7fbe7c0c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:02.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe81866640 1 -- 172.21.15.6:0/4269498285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe74009b30 con 0x7fbe7c0af2b0 2023-07-21T22:57:02.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe82067640 1 --2- 172.21.15.6:0/4269498285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe7c0cd830 0x7fbe7c159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:02.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe81065640 1 --2- 172.21.15.6:0/4269498285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe7c0c3ac0 0x7fbe7c0c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe81866640 1 --2- 172.21.15.6:0/4269498285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe7c0af2b0 0x7fbe7c144f70 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800c450 tx=0x7fbe7800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe727fc640 1 -- 172.21.15.6:0/4269498285 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe78012830 con 0x7fbe7c0af2b0 2023-07-21T22:57:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe727fc640 1 -- 172.21.15.6:0/4269498285 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe780129b0 con 0x7fbe7c0af2b0 2023-07-21T22:57:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe727fc640 1 -- 172.21.15.6:0/4269498285 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe78012d60 con 0x7fbe7c0af2b0 2023-07-21T22:57:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe83aca640 1 -- 172.21.15.6:0/4269498285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7c0b1280 con 0x7fbe7c0af2b0 2023-07-21T22:57:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.005+0000 7fbe83aca640 1 -- 172.21.15.6:0/4269498285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7c0b1840 con 0x7fbe7c0af2b0 2023-07-21T22:57:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.009+0000 7fbe83aca640 1 -- 172.21.15.6:0/4269498285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7c0678d0 con 0x7fbe7c0af2b0 2023-07-21T22:57:02.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.009+0000 7fbe727fc640 1 -- 172.21.15.6:0/4269498285 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 86) v1 ==== 85891+0+0 (secure 0 0 0) 0x7fbe7801c460 con 0x7fbe7c0af2b0 2023-07-21T22:57:02.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.009+0000 7fbe727fc640 1 --2- 172.21.15.6:0/4269498285 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fbe60066510 0x7fbe600689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:02.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.009+0000 7fbe727fc640 1 -- 172.21.15.6:0/4269498285 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6536+0+0 (secure 0 0 0) 0x7fbe780842a0 con 0x7fbe7c0af2b0 2023-07-21T22:57:02.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.009+0000 7fbe81065640 1 --2- 172.21.15.6:0/4269498285 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fbe60066510 0x7fbe600689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:02.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.013+0000 7fbe81065640 1 --2- 172.21.15.6:0/4269498285 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fbe60066510 0x7fbe600689c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c070e90 tx=0x7fbe6c009040 comp rx=0 tx=0).ready entity=mgr.9667 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:02.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.013+0000 7fbe727fc640 1 -- 172.21.15.6:0/4269498285 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbe78054be0 con 0x7fbe7c0af2b0 2023-07-21T22:57:02.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.189+0000 7fbe83aca640 1 -- 172.21.15.6:0/4269498285 --> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe7c0aeb80 con 0x7fbe60066510 2023-07-21T22:57:02.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.257+0000 7fbe727fc640 1 -- 172.21.15.6:0/4269498285 <== mgr.9667 v2:172.21.15.161:6832/2516914157 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fbe7c0aeb80 con 0x7fbe60066510 2023-07-21T22:57:02.292 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule removed for path snap_test_dir1 2023-07-21T22:57:02.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.257+0000 7fbe83aca640 1 -- 172.21.15.6:0/4269498285 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fbe60066510 msgr2=0x7fbe600689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.257+0000 7fbe83aca640 1 --2- 172.21.15.6:0/4269498285 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fbe60066510 0x7fbe600689c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c070e90 tx=0x7fbe6c009040 comp rx=0 tx=0).stop 2023-07-21T22:57:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.257+0000 7fbe83aca640 1 -- 172.21.15.6:0/4269498285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe7c0af2b0 msgr2=0x7fbe7c144f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.257+0000 7fbe83aca640 1 --2- 172.21.15.6:0/4269498285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe7c0af2b0 0x7fbe7c144f70 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800c450 tx=0x7fbe7800c910 comp rx=0 tx=0).stop 2023-07-21T22:57:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.257+0000 7fbe83aca640 1 -- 172.21.15.6:0/4269498285 shutdown_connections 2023-07-21T22:57:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.257+0000 7fbe83aca640 1 --2- 172.21.15.6:0/4269498285 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fbe60066510 0x7fbe600689c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:02.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.257+0000 7fbe83aca640 1 --2- 172.21.15.6:0/4269498285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe7c0cd830 0x7fbe7c159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:02.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.257+0000 7fbe83aca640 1 --2- 172.21.15.6:0/4269498285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe7c0c3ac0 0x7fbe7c0c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:02.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.257+0000 7fbe83aca640 1 --2- 172.21.15.6:0/4269498285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe7c0af2b0 0x7fbe7c144f70 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:02.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.257+0000 7fbe83aca640 1 -- 172.21.15.6:0/4269498285 >> 172.21.15.6:0/4269498285 conn(0x7fbe7c0cde90 msgr2=0x7fbe7c0cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:02.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.257+0000 7fbe83aca640 1 -- 172.21.15.6:0/4269498285 shutdown_connections 2023-07-21T22:57:02.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.257+0000 7fbe83aca640 1 -- 172.21.15.6:0/4269498285 wait complete. 2023-07-21T22:57:02.312 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-21T22:57:02.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:02.313 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:57:02.325 INFO:teuthology.orchestra.run.smithi006.stdout:scheduled-2023-07-21-22_57_00_UTC 2023-07-21T22:57:02.326 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-21-22_57_00_UTC 2023-07-21T22:57:02.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:02.326 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-21-22_57_00_UTC) 2023-07-21T22:57:02.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:02.388 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-21T22:57:02.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-21T22:57:02.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.593+0000 7f8771398640 1 Processor -- start 2023-07-21T22:57:02.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.593+0000 7f8771398640 1 -- start start 2023-07-21T22:57:02.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.593+0000 7f8771398640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cd930 0x7f876c0ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:02.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.593+0000 7f8771398640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f876c160380 con 0x7f876c0cd560 2023-07-21T22:57:02.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.593+0000 7f8771398640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f876c15f770 con 0x7f876c069430 2023-07-21T22:57:02.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.593+0000 7f8771398640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c15fa50 con 0x7f876c0cd930 2023-07-21T22:57:02.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.597+0000 7f876bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f876c0cd560 0x7f876c0ce6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53590/0 (socket says 172.21.15.6:53590) 2023-07-21T22:57:02.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.597+0000 7f876bfff640 1 -- 172.21.15.6:0/3905140491 learned_addr learned my addr 172.21.15.6:0/3905140491 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.597+0000 7f876b7fe640 1 --2- 172.21.15.6:0/3905140491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cd930 0x7f876c0ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.597+0000 7f876affd640 1 -- 172.21.15.6:0/3905140491 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392465621 0 0) 0x7f876c160380 con 0x7f876c0cd560 2023-07-21T22:57:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.597+0000 7f876affd640 1 -- 172.21.15.6:0/3905140491 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8754003530 con 0x7f876c0cd560 2023-07-21T22:57:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.597+0000 7f876affd640 1 -- 172.21.15.6:0/3905140491 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4194621944 0 0) 0x7f876c15f770 con 0x7f876c069430 2023-07-21T22:57:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.597+0000 7f876affd640 1 -- 172.21.15.6:0/3905140491 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f876c160380 con 0x7f876c069430 2023-07-21T22:57:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.597+0000 7f876b7fe640 1 -- 172.21.15.6:0/3905140491 >> v1:172.21.15.161:6789/0 conn(0x7f876c069430 legacy=0x7f876c06df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.597+0000 7f876b7fe640 1 -- 172.21.15.6:0/3905140491 >> v1:172.21.15.6:6789/0 conn(0x7f876c0cd560 legacy=0x7f876c0ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.597+0000 7f876affd640 1 -- 172.21.15.6:0/3905140491 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1507708657 0 0) 0x7f8754003530 con 0x7f876c0cd560 2023-07-21T22:57:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.597+0000 7f876b7fe640 1 -- 172.21.15.6:0/3905140491 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c15fd30 con 0x7f876c0cd930 2023-07-21T22:57:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.597+0000 7f876b7fe640 1 --2- 172.21.15.6:0/3905140491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cd930 0x7f876c0ccb20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f87600097f0 tx=0x7f876001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6e902537b8e1f09 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f876affd640 1 -- 172.21.15.6:0/3905140491 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c001680 con 0x7f876c0cd930 2023-07-21T22:57:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f876affd640 1 -- 172.21.15.6:0/3905140491 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87600a7050 con 0x7f876c0cd930 2023-07-21T22:57:02.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f876affd640 1 -- 172.21.15.6:0/3905140491 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87600ab620 con 0x7f876c0cd930 2023-07-21T22:57:02.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f8771398640 1 -- 172.21.15.6:0/3905140491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cd930 msgr2=0x7f876c0ccb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:02.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f8771398640 1 --2- 172.21.15.6:0/3905140491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cd930 0x7f876c0ccb20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f87600097f0 tx=0x7f876001c3e0 comp rx=0 tx=0).stop 2023-07-21T22:57:02.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f8771398640 1 -- 172.21.15.6:0/3905140491 shutdown_connections 2023-07-21T22:57:02.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f8771398640 1 --2- 172.21.15.6:0/3905140491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cd930 0x7f876c0ccb20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:02.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f8771398640 1 -- 172.21.15.6:0/3905140491 >> 172.21.15.6:0/3905140491 conn(0x7f876c06a540 msgr2=0x7f876c06a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:02.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f8771398640 1 -- 172.21.15.6:0/3905140491 shutdown_connections 2023-07-21T22:57:02.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f8771398640 1 -- 172.21.15.6:0/3905140491 wait complete. 2023-07-21T22:57:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f8771398640 1 Processor -- start 2023-07-21T22:57:02.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f8771398640 1 -- start start 2023-07-21T22:57:02.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f8771398640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f876c069430 0x7f876c15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:02.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f8771398640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cd560 0x7f876c15e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:02.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f8771398640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f876c0cd930 0x7f876c157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:02.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f8771398640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0c6520 con 0x7f876c0cd930 2023-07-21T22:57:02.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f8771398640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0c6800 con 0x7f876c069430 2023-07-21T22:57:02.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f8771398640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0c6ae0 con 0x7f876c0cd560 2023-07-21T22:57:02.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f8770b97640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f876c0cd930 0x7f876c157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:02.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f8770b97640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f876c0cd930 0x7f876c157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41802/0 (socket says 172.21.15.6:41802) 2023-07-21T22:57:02.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f8770b97640 1 -- 172.21.15.6:0/1304095331 learned_addr learned my addr 172.21.15.6:0/1304095331 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:02.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f876bfff640 1 --2- 172.21.15.6:0/1304095331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f876c069430 0x7f876c15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:02.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.601+0000 7f876b7fe640 1 --2- 172.21.15.6:0/1304095331 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cd560 0x7f876c15e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:02.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.605+0000 7f8770b97640 1 -- 172.21.15.6:0/1304095331 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cd560 msgr2=0x7f876c15e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:02.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.605+0000 7f8770b97640 1 --2- 172.21.15.6:0/1304095331 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cd560 0x7f876c15e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:02.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.605+0000 7f8770b97640 1 -- 172.21.15.6:0/1304095331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f876c069430 msgr2=0x7f876c15ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:02.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.605+0000 7f8770b97640 1 --2- 172.21.15.6:0/1304095331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f876c069430 0x7f876c15ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:02.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.605+0000 7f8770b97640 1 -- 172.21.15.6:0/1304095331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8760009420 con 0x7f876c0cd930 2023-07-21T22:57:02.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.605+0000 7f8770b97640 1 --2- 172.21.15.6:0/1304095331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f876c0cd930 0x7f876c157b00 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f876400c790 tx=0x7f876400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:02.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.605+0000 7f8768ff9640 1 -- 172.21.15.6:0/1304095331 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876400cea0 con 0x7f876c0cd930 2023-07-21T22:57:02.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.605+0000 7f8768ff9640 1 -- 172.21.15.6:0/1304095331 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8764003b80 con 0x7f876c0cd930 2023-07-21T22:57:02.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.605+0000 7f8768ff9640 1 -- 172.21.15.6:0/1304095331 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876400a850 con 0x7f876c0cd930 2023-07-21T22:57:02.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.605+0000 7f8771398640 1 -- 172.21.15.6:0/1304095331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876c0c6dc0 con 0x7f876c0cd930 2023-07-21T22:57:02.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.605+0000 7f8771398640 1 -- 172.21.15.6:0/1304095331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876c1588a0 con 0x7f876c0cd930 2023-07-21T22:57:02.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.605+0000 7f8771398640 1 -- 172.21.15.6:0/1304095331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f876c04e020 con 0x7f876c0cd930 2023-07-21T22:57:02.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.605+0000 7f8768ff9640 1 -- 172.21.15.6:0/1304095331 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 86) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f876400a9b0 con 0x7f876c0cd930 2023-07-21T22:57:02.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.609+0000 7f8768ff9640 1 --2- 172.21.15.6:0/1304095331 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f8758066510 0x7f87580689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:02.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.609+0000 7f8768ff9640 1 -- 172.21.15.6:0/1304095331 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6536+0+0 (secure 0 0 0) 0x7f87640841b0 con 0x7f876c0cd930 2023-07-21T22:57:02.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.609+0000 7f876bfff640 1 --2- 172.21.15.6:0/1304095331 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f8758066510 0x7f87580689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:02.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.609+0000 7f876bfff640 1 --2- 172.21.15.6:0/1304095331 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f8758066510 0x7f87580689c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f875c000f70 tx=0x7f875c0016c0 comp rx=0 tx=0).ready entity=mgr.9667 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:02.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.613+0000 7f8768ff9640 1 -- 172.21.15.6:0/1304095331 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8764051100 con 0x7f876c0cd930 2023-07-21T22:57:02.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:02.805+0000 7f8771398640 1 -- 172.21.15.6:0/1304095331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f876c0c7270 con 0x7f876c0cd930 2023-07-21T22:57:03.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.325+0000 7f8768ff9640 1 -- 172.21.15.6:0/1304095331 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 87) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f87640514d0 con 0x7f876c0cd930 2023-07-21T22:57:03.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.325+0000 7f8768ff9640 1 -- 172.21.15.6:0/1304095331 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v87) v1 ==== 93+0+0 (secure 0 0 0) 0x7f876406f430 con 0x7f876c0cd930 2023-07-21T22:57:03.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.329+0000 7f8771398640 1 -- 172.21.15.6:0/1304095331 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f8758066510 msgr2=0x7f87580689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:03.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.329+0000 7f8771398640 1 --2- 172.21.15.6:0/1304095331 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f8758066510 0x7f87580689c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f875c000f70 tx=0x7f875c0016c0 comp rx=0 tx=0).stop 2023-07-21T22:57:03.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.329+0000 7f8771398640 1 -- 172.21.15.6:0/1304095331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f876c0cd930 msgr2=0x7f876c157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:03.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.329+0000 7f8771398640 1 --2- 172.21.15.6:0/1304095331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f876c0cd930 0x7f876c157b00 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f876400c790 tx=0x7f876400cc50 comp rx=0 tx=0).stop 2023-07-21T22:57:03.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.329+0000 7f8771398640 1 -- 172.21.15.6:0/1304095331 shutdown_connections 2023-07-21T22:57:03.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.329+0000 7f8771398640 1 --2- 172.21.15.6:0/1304095331 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f8758066510 0x7f87580689c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:03.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.329+0000 7f8771398640 1 --2- 172.21.15.6:0/1304095331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f876c0cd930 0x7f876c157b00 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:03.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.329+0000 7f8771398640 1 --2- 172.21.15.6:0/1304095331 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f876c0cd560 0x7f876c15e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:03.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.329+0000 7f8771398640 1 --2- 172.21.15.6:0/1304095331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f876c069430 0x7f876c15ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:03.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.329+0000 7f8771398640 1 -- 172.21.15.6:0/1304095331 >> 172.21.15.6:0/1304095331 conn(0x7f876c06a540 msgr2=0x7f876c06df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:03.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.329+0000 7f8771398640 1 -- 172.21.15.6:0/1304095331 shutdown_connections 2023-07-21T22:57:03.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.329+0000 7f8771398640 1 -- 172.21.15.6:0/1304095331 wait complete. 2023-07-21T22:57:03.384 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:57:03.384 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:57:03.437 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:57:03.499 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:57:03.500 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:57:03.500 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:57:03.514 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:57:03.514 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:57:03.547 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:03.511+0000 7fec1deef180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:57:03.548 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:03.509+0000 7f3fbac3a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:57:03.557 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:57:03.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.717+0000 7fe849a26640 1 Processor -- start 2023-07-21T22:57:03.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.717+0000 7fe849a26640 1 -- start start 2023-07-21T22:57:03.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.717+0000 7fe849a26640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe84406a9c0 0x7fe8440ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:03.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.717+0000 7fe849a26640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8440cdc80 con 0x7fe84415f500 2023-07-21T22:57:03.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.717+0000 7fe849a26640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84406e4c0 con 0x7fe84406a540 2023-07-21T22:57:03.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.717+0000 7fe849a26640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84406d940 con 0x7fe84406a9c0 2023-07-21T22:57:03.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.717+0000 7fe8437fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe84406a9c0 0x7fe8440ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:03.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.717+0000 7fe8437fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe84406a9c0 0x7fe8440ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41828/0 (socket says 172.21.15.6:41828) 2023-07-21T22:57:03.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.717+0000 7fe8437fe640 1 -- 172.21.15.6:0/621092197 learned_addr learned my addr 172.21.15.6:0/621092197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:03.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.721+0000 7fe8427fc640 1 -- 172.21.15.6:0/621092197 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 253481021 0 0) 0x7fe8440cdc80 con 0x7fe84415f500 2023-07-21T22:57:03.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.721+0000 7fe8437fe640 1 -- 172.21.15.6:0/621092197 >> v1:172.21.15.161:6789/0 conn(0x7fe84406a540 legacy=0x7fe8440ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:03.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.721+0000 7fe8437fe640 1 -- 172.21.15.6:0/621092197 >> v1:172.21.15.6:6789/0 conn(0x7fe84415f500 legacy=0x7fe84406cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:03.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.721+0000 7fe8437fe640 1 -- 172.21.15.6:0/621092197 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84406dc20 con 0x7fe84406a9c0 2023-07-21T22:57:03.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.721+0000 7fe8437fe640 1 --2- 172.21.15.6:0/621092197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe84406a9c0 0x7fe8440ce800 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009e50 tx=0x7fe83c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73c95dab835cf93 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:03.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.721+0000 7fe8427fc640 1 -- 172.21.15.6:0/621092197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c0a55f0 con 0x7fe84406a9c0 2023-07-21T22:57:03.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.721+0000 7fe8427fc640 1 -- 172.21.15.6:0/621092197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c0a5750 con 0x7fe84406a9c0 2023-07-21T22:57:03.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.721+0000 7fe8427fc640 1 -- 172.21.15.6:0/621092197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c0a5ae0 con 0x7fe84406a9c0 2023-07-21T22:57:03.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.721+0000 7fe849a26640 1 -- 172.21.15.6:0/621092197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe84406a9c0 msgr2=0x7fe8440ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:03.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.721+0000 7fe849a26640 1 --2- 172.21.15.6:0/621092197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe84406a9c0 0x7fe8440ce800 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009e50 tx=0x7fe83c01c8c0 comp rx=0 tx=0).stop 2023-07-21T22:57:03.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe849a26640 1 -- 172.21.15.6:0/621092197 shutdown_connections 2023-07-21T22:57:03.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe849a26640 1 --2- 172.21.15.6:0/621092197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe84406a9c0 0x7fe8440ce800 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:03.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe849a26640 1 -- 172.21.15.6:0/621092197 >> 172.21.15.6:0/621092197 conn(0x7fe8440659d0 msgr2=0x7fe844099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:03.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe849a26640 1 -- 172.21.15.6:0/621092197 shutdown_connections 2023-07-21T22:57:03.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe849a26640 1 -- 172.21.15.6:0/621092197 wait complete. 2023-07-21T22:57:03.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe849a26640 1 Processor -- start 2023-07-21T22:57:03.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe849a26640 1 -- start start 2023-07-21T22:57:03.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe849a26640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84406a540 0x7fe844155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:03.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe849a26640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe84406a9c0 0x7fe844155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:03.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe849a26640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe84415f500 0x7fe8440c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe849a26640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440c5070 con 0x7fe84415f500 2023-07-21T22:57:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe849a26640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84415eb10 con 0x7fe84406a540 2023-07-21T22:57:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe849a26640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440c4d70 con 0x7fe84406a9c0 2023-07-21T22:57:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe8437fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe84415f500 0x7fe8440c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe842ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84406a540 0x7fe844155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe8437fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe84415f500 0x7fe8440c3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41842/0 (socket says 172.21.15.6:41842) 2023-07-21T22:57:03.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe8437fe640 1 -- 172.21.15.6:0/1726870761 learned_addr learned my addr 172.21.15.6:0/1726870761 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe83bfff640 1 --2- 172.21.15.6:0/1726870761 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe84406a9c0 0x7fe844155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe8437fe640 1 -- 172.21.15.6:0/1726870761 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe84406a9c0 msgr2=0x7fe844155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe8437fe640 1 --2- 172.21.15.6:0/1726870761 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe84406a9c0 0x7fe844155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe8437fe640 1 -- 172.21.15.6:0/1726870761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84406a540 msgr2=0x7fe844155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe8437fe640 1 --2- 172.21.15.6:0/1726870761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84406a540 0x7fe844155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe8437fe640 1 -- 172.21.15.6:0/1726870761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c009b30 con 0x7fe84415f500 2023-07-21T22:57:03.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe842ffd640 1 --2- 172.21.15.6:0/1726870761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84406a540 0x7fe844155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:03.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.725+0000 7fe83bfff640 1 --2- 172.21.15.6:0/1726870761 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe84406a9c0 0x7fe844155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:03.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.729+0000 7fe8437fe640 1 --2- 172.21.15.6:0/1726870761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe84415f500 0x7fe8440c3ba0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fe83c0af040 tx=0x7fe8440cf550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:03.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.729+0000 7fe840ff9640 1 -- 172.21.15.6:0/1726870761 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c003ba0 con 0x7fe84415f500 2023-07-21T22:57:03.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.729+0000 7fe840ff9640 1 -- 172.21.15.6:0/1726870761 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c003d00 con 0x7fe84415f500 2023-07-21T22:57:03.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.729+0000 7fe849a26640 1 -- 172.21.15.6:0/1726870761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe844156b00 con 0x7fe84415f500 2023-07-21T22:57:03.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.729+0000 7fe840ff9640 1 -- 172.21.15.6:0/1726870761 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c004250 con 0x7fe84415f500 2023-07-21T22:57:03.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.729+0000 7fe849a26640 1 -- 172.21.15.6:0/1726870761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84415e730 con 0x7fe84415f500 2023-07-21T22:57:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.729+0000 7fe849a26640 1 -- 172.21.15.6:0/1726870761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8440c5220 con 0x7fe84415f500 2023-07-21T22:57:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.729+0000 7fe840ff9640 1 -- 172.21.15.6:0/1726870761 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 87) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fe83c0043b0 con 0x7fe84415f500 2023-07-21T22:57:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.729+0000 7fe840ff9640 1 --2- 172.21.15.6:0/1726870761 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fe8240664c0 0x7fe824068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.729+0000 7fe840ff9640 1 -- 172.21.15.6:0/1726870761 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6536+0+0 (secure 0 0 0) 0x7fe83c11e490 con 0x7fe84415f500 2023-07-21T22:57:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.733+0000 7fe842ffd640 1 -- 172.21.15.6:0/1726870761 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fe8240664c0 msgr2=0x7fe824068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2516914157 2023-07-21T22:57:03.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.733+0000 7fe842ffd640 1 --2- 172.21.15.6:0/1726870761 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fe8240664c0 0x7fe824068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:03.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.737+0000 7fe840ff9640 1 -- 172.21.15.6:0/1726870761 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe8440c5220 con 0x7fe84415f500 2023-07-21T22:57:03.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.897+0000 7fe849a26640 1 -- 172.21.15.6:0/1726870761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8440c51b0 con 0x7fe84415f500 2023-07-21T22:57:03.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.901+0000 7fe840ff9640 1 -- 172.21.15.6:0/1726870761 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+19010 (secure 0 0 0) 0x7fe83c0eb3e0 con 0x7fe84415f500 2023-07-21T22:57:03.935 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:03.936 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":177,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:56:58.294894+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:55:37.909970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-21T22:55:38.777920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.21","mappings":[{"from":3,"to":0}]},{"pgid":"22.30","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/1340525209":"2023-07-22T22:55:56.979202+0000","172.21.15.161:0/586248075":"2023-07-22T22:55:56.979202+0000","172.21.15.161:0/3856824963":"2023-07-22T22:55:56.979202+0000","172.21.15.161:6833/2346358146":"2023-07-22T22:55:56.979202+0000","172.21.15.161:0/1537566959":"2023-07-22T22:55:56.979202+0000","172.21.15.161:6832/2346358146":"2023-07-22T22:55:56.979202+0000","172.21.15.161:0/1490152306":"2023-07-22T22:55:56.979202+0000","172.21.15.161:0/4205584408":"2023-07-22T22:55:56.979202+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:57:03.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.901+0000 7fe849a26640 1 -- 172.21.15.6:0/1726870761 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fe8240664c0 msgr2=0x7fe824068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:03.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.901+0000 7fe849a26640 1 --2- 172.21.15.6:0/1726870761 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fe8240664c0 0x7fe824068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:03.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.901+0000 7fe849a26640 1 -- 172.21.15.6:0/1726870761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe84415f500 msgr2=0x7fe8440c3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:03.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.901+0000 7fe849a26640 1 --2- 172.21.15.6:0/1726870761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe84415f500 0x7fe8440c3ba0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fe83c0af040 tx=0x7fe8440cf550 comp rx=0 tx=0).stop 2023-07-21T22:57:03.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.901+0000 7fe849a26640 1 -- 172.21.15.6:0/1726870761 shutdown_connections 2023-07-21T22:57:03.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.901+0000 7fe849a26640 1 --2- 172.21.15.6:0/1726870761 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fe8240664c0 0x7fe824068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:03.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.901+0000 7fe849a26640 1 --2- 172.21.15.6:0/1726870761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe84415f500 0x7fe8440c3ba0 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:03.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.901+0000 7fe849a26640 1 --2- 172.21.15.6:0/1726870761 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe84406a9c0 0x7fe844155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:03.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.901+0000 7fe849a26640 1 --2- 172.21.15.6:0/1726870761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84406a540 0x7fe844155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:03.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.901+0000 7fe849a26640 1 -- 172.21.15.6:0/1726870761 >> 172.21.15.6:0/1726870761 conn(0x7fe8440659d0 msgr2=0x7fe84415fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:03.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.901+0000 7fe849a26640 1 -- 172.21.15.6:0/1726870761 shutdown_connections 2023-07-21T22:57:03.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:03.901+0000 7fe849a26640 1 -- 172.21.15.6:0/1726870761 wait complete. 2023-07-21T22:57:03.959 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:55:37.909970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '173', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:55:38.777920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '174', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:57:03.961 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:57:03.962 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:03.931+0000 7fec1deef180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:57:03.988 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:03.953+0000 7f3fbac3a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:57:04.114 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:04.083+0000 7fec1deef180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:57:04.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.081+0000 7f148fd40640 1 Processor -- start 2023-07-21T22:57:04.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.081+0000 7f148fd40640 1 -- start start 2023-07-21T22:57:04.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.081+0000 7f148fd40640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f148815cef0 0x7f1488158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:04.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.081+0000 7f148fd40640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14881532b0 con 0x7f1488159270 2023-07-21T22:57:04.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.081+0000 7f148fd40640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14880ca6f0 con 0x7f14880aeb40 2023-07-21T22:57:04.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.081+0000 7f148fd40640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148815d360 con 0x7f148815cef0 2023-07-21T22:57:04.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.081+0000 7f148d2db640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f148815cef0 0x7f1488158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:04.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.081+0000 7f148e2dd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1488159270 0x7f14880c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53614/0 (socket says 172.21.15.6:53614) 2023-07-21T22:57:04.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.081+0000 7f148e2dd640 1 -- 172.21.15.6:0/3015921098 learned_addr learned my addr 172.21.15.6:0/3015921098 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:04.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.081+0000 7f148d2db640 1 -- 172.21.15.6:0/3015921098 >> v1:172.21.15.161:6789/0 conn(0x7f14880aeb40 legacy=0x7f14880aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:04.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.081+0000 7f148d2db640 1 -- 172.21.15.6:0/3015921098 >> v1:172.21.15.6:6789/0 conn(0x7f1488159270 legacy=0x7f14880c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:04.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.081+0000 7f148d2db640 1 -- 172.21.15.6:0/3015921098 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14881599d0 con 0x7f148815cef0 2023-07-21T22:57:04.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.085+0000 7f148d2db640 1 --2- 172.21.15.6:0/3015921098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148815cef0 0x7f1488158d30 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f14780097c0 tx=0x7f147801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46269f480aad315e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:04.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.085+0000 7f148cada640 1 -- 172.21.15.6:0/3015921098 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14780ab650 con 0x7f148815cef0 2023-07-21T22:57:04.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.085+0000 7f148cada640 1 -- 172.21.15.6:0/3015921098 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14780ab7b0 con 0x7f148815cef0 2023-07-21T22:57:04.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.085+0000 7f148cada640 1 -- 172.21.15.6:0/3015921098 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14780abb40 con 0x7f148815cef0 2023-07-21T22:57:04.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.085+0000 7f148fd40640 1 -- 172.21.15.6:0/3015921098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148815cef0 msgr2=0x7f1488158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:04.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.085+0000 7f148fd40640 1 --2- 172.21.15.6:0/3015921098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148815cef0 0x7f1488158d30 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f14780097c0 tx=0x7f147801c450 comp rx=0 tx=0).stop 2023-07-21T22:57:04.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.085+0000 7f148fd40640 1 -- 172.21.15.6:0/3015921098 shutdown_connections 2023-07-21T22:57:04.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.085+0000 7f148fd40640 1 --2- 172.21.15.6:0/3015921098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148815cef0 0x7f1488158d30 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.085+0000 7f148fd40640 1 -- 172.21.15.6:0/3015921098 >> 172.21.15.6:0/3015921098 conn(0x7f14880cde90 msgr2=0x7f14880ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:04.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.085+0000 7f148fd40640 1 -- 172.21.15.6:0/3015921098 shutdown_connections 2023-07-21T22:57:04.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.085+0000 7f148fd40640 1 -- 172.21.15.6:0/3015921098 wait complete. 2023-07-21T22:57:04.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.089+0000 7f148fd40640 1 Processor -- start 2023-07-21T22:57:04.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.089+0000 7f148fd40640 1 -- start start 2023-07-21T22:57:04.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.089+0000 7f148fd40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14880aeb40 0x7f148813b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:04.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.089+0000 7f148fd40640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1488159270 0x7f14881506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:04.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.089+0000 7f148fd40640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148815cef0 0x7f148806f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:04.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.089+0000 7f148fd40640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148806b1f0 con 0x7f148815cef0 2023-07-21T22:57:04.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.089+0000 7f148fd40640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148806b4d0 con 0x7f1488159270 2023-07-21T22:57:04.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.089+0000 7f148fd40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148806b7b0 con 0x7f14880aeb40 2023-07-21T22:57:04.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.089+0000 7f148e2dd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148815cef0 0x7f148806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:04.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.089+0000 7f148d2db640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1488159270 0x7f14881506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:04.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.089+0000 7f148e2dd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148815cef0 0x7f148806f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41870/0 (socket says 172.21.15.6:41870) 2023-07-21T22:57:04.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.089+0000 7f148e2dd640 1 -- 172.21.15.6:0/1221921645 learned_addr learned my addr 172.21.15.6:0/1221921645 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:04.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.089+0000 7f148dadc640 1 --2- 172.21.15.6:0/1221921645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14880aeb40 0x7f148813b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:04.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.089+0000 7f148e2dd640 1 -- 172.21.15.6:0/1221921645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14880aeb40 msgr2=0x7f148813b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:04.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.089+0000 7f148e2dd640 1 --2- 172.21.15.6:0/1221921645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14880aeb40 0x7f148813b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.089+0000 7f148e2dd640 1 -- 172.21.15.6:0/1221921645 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1488159270 msgr2=0x7f14881506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:04.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.089+0000 7f148e2dd640 1 --2- 172.21.15.6:0/1221921645 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1488159270 0x7f14881506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.089+0000 7f148e2dd640 1 -- 172.21.15.6:0/1221921645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1478009420 con 0x7f148815cef0 2023-07-21T22:57:04.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.089+0000 7f148e2dd640 1 --2- 172.21.15.6:0/1221921645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148815cef0 0x7f148806f060 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f148000cbc0 tx=0x7f148000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:04.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.093+0000 7f147e7fc640 1 -- 172.21.15.6:0/1221921645 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148000ad40 con 0x7f148815cef0 2023-07-21T22:57:04.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.093+0000 7f147e7fc640 1 -- 172.21.15.6:0/1221921645 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1480012400 con 0x7f148815cef0 2023-07-21T22:57:04.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.093+0000 7f147e7fc640 1 -- 172.21.15.6:0/1221921645 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148000aea0 con 0x7f148815cef0 2023-07-21T22:57:04.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.093+0000 7f148fd40640 1 -- 172.21.15.6:0/1221921645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148806ba90 con 0x7f148815cef0 2023-07-21T22:57:04.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.093+0000 7f148fd40640 1 -- 172.21.15.6:0/1221921645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148806c050 con 0x7f148815cef0 2023-07-21T22:57:04.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.093+0000 7f148fd40640 1 -- 172.21.15.6:0/1221921645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148806c240 con 0x7f148815cef0 2023-07-21T22:57:04.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.093+0000 7f147e7fc640 1 -- 172.21.15.6:0/1221921645 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 87) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f1480007070 con 0x7f148815cef0 2023-07-21T22:57:04.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.093+0000 7f147e7fc640 1 --2- 172.21.15.6:0/1221921645 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f146c0664f0 0x7f146c0689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:04.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.093+0000 7f147e7fc640 1 -- 172.21.15.6:0/1221921645 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6536+0+0 (secure 0 0 0) 0x7f14800841a0 con 0x7f148815cef0 2023-07-21T22:57:04.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.093+0000 7f148dadc640 1 -- 172.21.15.6:0/1221921645 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f146c0664f0 msgr2=0x7f146c0689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2516914157 2023-07-21T22:57:04.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.093+0000 7f148dadc640 1 --2- 172.21.15.6:0/1221921645 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f146c0664f0 0x7f146c0689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:04.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.097+0000 7f147e7fc640 1 -- 172.21.15.6:0/1221921645 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1480051180 con 0x7f148815cef0 2023-07-21T22:57:04.151 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:04.117+0000 7f3fbac3a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:57:04.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.257+0000 7f148fd40640 1 -- 172.21.15.6:0/1221921645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f14880678d0 con 0x7f148815cef0 2023-07-21T22:57:04.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.257+0000 7f147e7fc640 1 -- 172.21.15.6:0/1221921645 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v177) v1 ==== 93+0+10 (secure 0 0 0) 0x7f14800547a0 con 0x7f148815cef0 2023-07-21T22:57:04.292 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:57:04.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.257+0000 7f148fd40640 1 -- 172.21.15.6:0/1221921645 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f146c0664f0 msgr2=0x7f146c0689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:04.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.257+0000 7f148fd40640 1 --2- 172.21.15.6:0/1221921645 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f146c0664f0 0x7f146c0689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.257+0000 7f148fd40640 1 -- 172.21.15.6:0/1221921645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148815cef0 msgr2=0x7f148806f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:04.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.257+0000 7f148fd40640 1 --2- 172.21.15.6:0/1221921645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148815cef0 0x7f148806f060 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f148000cbc0 tx=0x7f148000a430 comp rx=0 tx=0).stop 2023-07-21T22:57:04.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.257+0000 7f148fd40640 1 -- 172.21.15.6:0/1221921645 shutdown_connections 2023-07-21T22:57:04.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.257+0000 7f148fd40640 1 --2- 172.21.15.6:0/1221921645 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f146c0664f0 0x7f146c0689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.257+0000 7f148fd40640 1 --2- 172.21.15.6:0/1221921645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148815cef0 0x7f148806f060 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.257+0000 7f148fd40640 1 --2- 172.21.15.6:0/1221921645 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1488159270 0x7f14881506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.257+0000 7f148fd40640 1 --2- 172.21.15.6:0/1221921645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14880aeb40 0x7f148813b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.257+0000 7f148fd40640 1 -- 172.21.15.6:0/1221921645 >> 172.21.15.6:0/1221921645 conn(0x7f14880cde90 msgr2=0x7f14880c88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:04.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.257+0000 7f148fd40640 1 -- 172.21.15.6:0/1221921645 shutdown_connections 2023-07-21T22:57:04.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.257+0000 7f148fd40640 1 -- 172.21.15.6:0/1221921645 wait complete. 2023-07-21T22:57:04.313 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:57:04.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.473+0000 7f516647b640 1 Processor -- start 2023-07-21T22:57:04.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.473+0000 7f516647b640 1 -- start start 2023-07-21T22:57:04.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.473+0000 7f516647b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f516015bde0 0x7f51600d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:04.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.473+0000 7f516647b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51600b04c0 con 0x7f51600d2300 2023-07-21T22:57:04.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.473+0000 7f516647b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51600b1060 con 0x7f51600d2fc0 2023-07-21T22:57:04.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.473+0000 7f516647b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f516015c1b0 con 0x7f516015bde0 2023-07-21T22:57:04.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.473+0000 7f515f7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f51600d2fc0 0x7f51600b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:39728/0 (socket says 172.21.15.6:39728) 2023-07-21T22:57:04.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.473+0000 7f5164a18640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f51600d2300 0x7f51600cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53630/0 (socket says 172.21.15.6:53630) 2023-07-21T22:57:04.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.473+0000 7f515f7fe640 1 -- 172.21.15.6:0/364105213 learned_addr learned my addr 172.21.15.6:0/364105213 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:04.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.473+0000 7f515ffff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f516015bde0 0x7f51600d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:04.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.473+0000 7f515ffff640 1 -- 172.21.15.6:0/364105213 >> v1:172.21.15.161:6789/0 conn(0x7f51600d2fc0 legacy=0x7f51600b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:04.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.473+0000 7f515ffff640 1 -- 172.21.15.6:0/364105213 >> v1:172.21.15.6:6789/0 conn(0x7f51600d2300 legacy=0x7f51600cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:04.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.473+0000 7f515effd640 1 -- 172.21.15.6:0/364105213 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3732522759 0 0) 0x7f51600b1060 con 0x7f51600d2fc0 2023-07-21T22:57:04.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.473+0000 7f515ffff640 1 -- 172.21.15.6:0/364105213 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51600d0aa0 con 0x7f516015bde0 2023-07-21T22:57:04.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.477+0000 7f515ffff640 1 --2- 172.21.15.6:0/364105213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f516015bde0 0x7f51600d0270 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f51500097d0 tx=0x7f515001c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfb9639b89931512 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:04.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.477+0000 7f515effd640 1 -- 172.21.15.6:0/364105213 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51500ab600 con 0x7f516015bde0 2023-07-21T22:57:04.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.477+0000 7f515effd640 1 -- 172.21.15.6:0/364105213 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51500a7050 con 0x7f516015bde0 2023-07-21T22:57:04.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.477+0000 7f515effd640 1 -- 172.21.15.6:0/364105213 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51500ab980 con 0x7f516015bde0 2023-07-21T22:57:04.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.477+0000 7f516647b640 1 -- 172.21.15.6:0/364105213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f516015bde0 msgr2=0x7f51600d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:04.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.477+0000 7f516647b640 1 --2- 172.21.15.6:0/364105213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f516015bde0 0x7f51600d0270 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f51500097d0 tx=0x7f515001c330 comp rx=0 tx=0).stop 2023-07-21T22:57:04.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.477+0000 7f516647b640 1 -- 172.21.15.6:0/364105213 shutdown_connections 2023-07-21T22:57:04.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.477+0000 7f516647b640 1 --2- 172.21.15.6:0/364105213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f516015bde0 0x7f51600d0270 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.477+0000 7f516647b640 1 -- 172.21.15.6:0/364105213 >> 172.21.15.6:0/364105213 conn(0x7f51600659d0 msgr2=0x7f516009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:04.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f516647b640 1 -- 172.21.15.6:0/364105213 shutdown_connections 2023-07-21T22:57:04.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f516647b640 1 -- 172.21.15.6:0/364105213 wait complete. 2023-07-21T22:57:04.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f516647b640 1 Processor -- start 2023-07-21T22:57:04.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f516647b640 1 -- start start 2023-07-21T22:57:04.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f516647b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51600d2300 0x7f516014f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:04.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f516647b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51600d2fc0 0x7f51601f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:04.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f516647b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f516015bde0 0x7f51601f0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:04.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f516647b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5160151bd0 con 0x7f51600d2fc0 2023-07-21T22:57:04.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f516647b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5160151eb0 con 0x7f516015bde0 2023-07-21T22:57:04.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f516647b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5160152190 con 0x7f51600d2300 2023-07-21T22:57:04.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f515f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51600d2fc0 0x7f51601f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:04.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f515ffff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51600d2300 0x7f516014f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:04.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f515f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51600d2fc0 0x7f51601f0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41878/0 (socket says 172.21.15.6:41878) 2023-07-21T22:57:04.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f515f7fe640 1 -- 172.21.15.6:0/3570136401 learned_addr learned my addr 172.21.15.6:0/3570136401 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:04.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f5164a18640 1 --2- 172.21.15.6:0/3570136401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f516015bde0 0x7f51601f0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:04.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f515ffff640 1 -- 172.21.15.6:0/3570136401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f516015bde0 msgr2=0x7f51601f0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f515ffff640 1 --2- 172.21.15.6:0/3570136401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f516015bde0 0x7f51601f0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f515ffff640 1 -- 172.21.15.6:0/3570136401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51600d2fc0 msgr2=0x7f51601f0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:04.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f515ffff640 1 --2- 172.21.15.6:0/3570136401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51600d2fc0 0x7f51601f0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f515ffff640 1 -- 172.21.15.6:0/3570136401 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51500093b0 con 0x7f51600d2300 2023-07-21T22:57:04.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.481+0000 7f515f7fe640 1 --2- 172.21.15.6:0/3570136401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51600d2fc0 0x7f51601f0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:04.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.485+0000 7f515ffff640 1 --2- 172.21.15.6:0/3570136401 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51600d2300 0x7f516014f340 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f51500ab000 tx=0x7f51500190d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:04.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.485+0000 7f515cff9640 1 -- 172.21.15.6:0/3570136401 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5150005e70 con 0x7f51600d2300 2023-07-21T22:57:04.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.485+0000 7f515cff9640 1 -- 172.21.15.6:0/3570136401 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5150006030 con 0x7f51600d2300 2023-07-21T22:57:04.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.485+0000 7f515cff9640 1 -- 172.21.15.6:0/3570136401 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51500063e0 con 0x7f51600d2300 2023-07-21T22:57:04.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.485+0000 7f516647b640 1 -- 172.21.15.6:0/3570136401 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5160152470 con 0x7f51600d2300 2023-07-21T22:57:04.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.485+0000 7f516647b640 1 -- 172.21.15.6:0/3570136401 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516014f880 con 0x7f51600d2300 2023-07-21T22:57:04.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.485+0000 7f516647b640 1 -- 172.21.15.6:0/3570136401 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51600678d0 con 0x7f51600d2300 2023-07-21T22:57:04.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.485+0000 7f515cff9640 1 -- 172.21.15.6:0/3570136401 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 87) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f51500b2040 con 0x7f51600d2300 2023-07-21T22:57:04.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.485+0000 7f515cff9640 1 --2- 172.21.15.6:0/3570136401 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f514c0664c0 0x7f514c068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:04.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.485+0000 7f515cff9640 1 -- 172.21.15.6:0/3570136401 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6536+0+0 (secure 0 0 0) 0x7f515011de70 con 0x7f51600d2300 2023-07-21T22:57:04.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.485+0000 7f515f7fe640 1 -- 172.21.15.6:0/3570136401 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f514c0664c0 msgr2=0x7f514c068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2516914157 2023-07-21T22:57:04.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.485+0000 7f515f7fe640 1 --2- 172.21.15.6:0/3570136401 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f514c0664c0 0x7f514c068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:04.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.493+0000 7f515cff9640 1 -- 172.21.15.6:0/3570136401 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f51500eaea0 con 0x7f51600d2300 2023-07-21T22:57:04.602 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:04.575+0000 7fec1deef180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:57:04.661 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:04.635+0000 7fec1deef180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:57:04.666 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:04.633+0000 7f3fbac3a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:57:04.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.649+0000 7f516647b640 1 -- 172.21.15.6:0/3570136401 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f516015d370 con 0x7f51600d2300 2023-07-21T22:57:04.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.649+0000 7f515cff9640 1 -- 172.21.15.6:0/3570136401 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v177) v1 ==== 92+0+10 (secure 0 0 0) 0x7f51500bf0a0 con 0x7f51600d2300 2023-07-21T22:57:04.683 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:57:04.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.649+0000 7f516647b640 1 -- 172.21.15.6:0/3570136401 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f514c0664c0 msgr2=0x7f514c068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:04.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.649+0000 7f516647b640 1 --2- 172.21.15.6:0/3570136401 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f514c0664c0 0x7f514c068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.649+0000 7f516647b640 1 -- 172.21.15.6:0/3570136401 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51600d2300 msgr2=0x7f516014f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:04.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.649+0000 7f516647b640 1 --2- 172.21.15.6:0/3570136401 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51600d2300 0x7f516014f340 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f51500ab000 tx=0x7f51500190d0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.649+0000 7f516647b640 1 -- 172.21.15.6:0/3570136401 shutdown_connections 2023-07-21T22:57:04.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.649+0000 7f516647b640 1 --2- 172.21.15.6:0/3570136401 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f514c0664c0 0x7f514c068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.649+0000 7f516647b640 1 --2- 172.21.15.6:0/3570136401 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f516015bde0 0x7f51601f0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.649+0000 7f516647b640 1 --2- 172.21.15.6:0/3570136401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51600d2fc0 0x7f51601f0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.649+0000 7f516647b640 1 --2- 172.21.15.6:0/3570136401 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f51600d2300 0x7f516014f340 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.649+0000 7f516647b640 1 -- 172.21.15.6:0/3570136401 >> 172.21.15.6:0/3570136401 conn(0x7f51600659d0 msgr2=0x7f51601571f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:04.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.649+0000 7f516647b640 1 -- 172.21.15.6:0/3570136401 shutdown_connections 2023-07-21T22:57:04.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.649+0000 7f516647b640 1 -- 172.21.15.6:0/3570136401 wait complete. 2023-07-21T22:57:04.705 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:57:04.717 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:04.691+0000 7fec1deef180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:57:04.730 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:04.697+0000 7f3fbac3a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:57:04.790 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:04.757+0000 7f3fbac3a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:57:04.803 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:04.775+0000 7fec1deef180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:57:04.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.821+0000 7fb32e937640 1 Processor -- start 2023-07-21T22:57:04.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.821+0000 7fb32e937640 1 -- start start 2023-07-21T22:57:04.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.821+0000 7fb32e937640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb32815bde0 0x7fb3280d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:04.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.821+0000 7fb32e937640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3280d2300 0x7fb3280d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:04.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.821+0000 7fb32e937640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3280b04c0 con 0x7fb3280d2fc0 2023-07-21T22:57:04.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.821+0000 7fb32e937640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb32815c1b0 con 0x7fb32815bde0 2023-07-21T22:57:04.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.821+0000 7fb32e937640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3280d2cc0 con 0x7fb3280d2300 2023-07-21T22:57:04.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.821+0000 7fb327fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb32815bde0 0x7fb3280d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:04.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.821+0000 7fb32ced4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3280d2300 0x7fb3280d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:04.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.821+0000 7fb3277fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb3280d2fc0 0x7fb3280b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:39730/0 (socket says 172.21.15.6:39730) 2023-07-21T22:57:04.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.821+0000 7fb32ced4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3280d2300 0x7fb3280d2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:45928/0 (socket says 172.21.15.6:45928) 2023-07-21T22:57:04.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.821+0000 7fb32ced4640 1 -- 172.21.15.6:0/4021257276 learned_addr learned my addr 172.21.15.6:0/4021257276 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:04.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.821+0000 7fb327fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb32815bde0 0x7fb3280d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:38722/0 (socket says 172.21.15.6:38722) 2023-07-21T22:57:04.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.821+0000 7fb32ced4640 1 -- 172.21.15.6:0/4021257276 >> v2:172.21.15.161:3300/0 conn(0x7fb32815bde0 msgr2=0x7fb3280d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:04.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.821+0000 7fb32ced4640 1 --2- 172.21.15.6:0/4021257276 >> v2:172.21.15.161:3300/0 conn(0x7fb32815bde0 0x7fb3280d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.821+0000 7fb32ced4640 1 -- 172.21.15.6:0/4021257276 >> v1:172.21.15.161:6789/0 conn(0x7fb3280d2fc0 legacy=0x7fb3280b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:04.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.821+0000 7fb32ced4640 1 -- 172.21.15.6:0/4021257276 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3280b1060 con 0x7fb3280d2300 2023-07-21T22:57:04.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.821+0000 7fb327fff640 1 --2- 172.21.15.6:0/4021257276 >> v2:172.21.15.161:3300/0 conn(0x7fb32815bde0 0x7fb3280d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:04.860 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:04.835+0000 7fec1deef180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:57:04.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.829+0000 7fb32ced4640 1 --2- 172.21.15.6:0/4021257276 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3280d2300 0x7fb3280d2780 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb320009e50 tx=0x7fb32001ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d965ec4cff6524be server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:04.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.829+0000 7fb326ffd640 1 -- 172.21.15.6:0/4021257276 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3200a57f0 con 0x7fb3280d2300 2023-07-21T22:57:04.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.829+0000 7fb326ffd640 1 -- 172.21.15.6:0/4021257276 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3200a5950 con 0x7fb3280d2300 2023-07-21T22:57:04.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.829+0000 7fb326ffd640 1 -- 172.21.15.6:0/4021257276 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3200a5ce0 con 0x7fb3280d2300 2023-07-21T22:57:04.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.829+0000 7fb32e937640 1 -- 172.21.15.6:0/4021257276 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3280d2300 msgr2=0x7fb3280d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:04.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.829+0000 7fb32e937640 1 --2- 172.21.15.6:0/4021257276 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3280d2300 0x7fb3280d2780 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb320009e50 tx=0x7fb32001ca10 comp rx=0 tx=0).stop 2023-07-21T22:57:04.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.829+0000 7fb32e937640 1 -- 172.21.15.6:0/4021257276 shutdown_connections 2023-07-21T22:57:04.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.829+0000 7fb32e937640 1 --2- 172.21.15.6:0/4021257276 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3280d2300 0x7fb3280d2780 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.829+0000 7fb32e937640 1 --2- 172.21.15.6:0/4021257276 >> v2:172.21.15.161:3300/0 conn(0x7fb32815bde0 0x7fb3280d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.829+0000 7fb32e937640 1 -- 172.21.15.6:0/4021257276 >> 172.21.15.6:0/4021257276 conn(0x7fb3280659d0 msgr2=0x7fb32809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:04.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.829+0000 7fb32e937640 1 -- 172.21.15.6:0/4021257276 shutdown_connections 2023-07-21T22:57:04.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.829+0000 7fb32e937640 1 -- 172.21.15.6:0/4021257276 wait complete. 2023-07-21T22:57:04.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.829+0000 7fb32e937640 1 Processor -- start 2023-07-21T22:57:04.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.829+0000 7fb32e937640 1 -- start start 2023-07-21T22:57:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb32e937640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3280d2300 0x7fb32814c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb32e937640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3280d2fc0 0x7fb3280b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb32e937640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb32815bde0 0x7fb3280b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb32e937640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32814cb20 con 0x7fb3280d2300 2023-07-21T22:57:04.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb32e937640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3280b7bd0 con 0x7fb3280d2fc0 2023-07-21T22:57:04.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb32e937640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3280b4020 con 0x7fb32815bde0 2023-07-21T22:57:04.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb327fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3280d2300 0x7fb32814c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:04.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb327fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3280d2300 0x7fb32814c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41884/0 (socket says 172.21.15.6:41884) 2023-07-21T22:57:04.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb327fff640 1 -- 172.21.15.6:0/716892515 learned_addr learned my addr 172.21.15.6:0/716892515 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:04.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb3277fe640 1 --2- 172.21.15.6:0/716892515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3280d2fc0 0x7fb3280b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:04.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb32ced4640 1 --2- 172.21.15.6:0/716892515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb32815bde0 0x7fb3280b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:04.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb327fff640 1 -- 172.21.15.6:0/716892515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb32815bde0 msgr2=0x7fb3280b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:04.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb327fff640 1 --2- 172.21.15.6:0/716892515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb32815bde0 0x7fb3280b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb327fff640 1 -- 172.21.15.6:0/716892515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3280d2fc0 msgr2=0x7fb3280b3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:04.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb327fff640 1 --2- 172.21.15.6:0/716892515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3280d2fc0 0x7fb3280b3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:04.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb327fff640 1 -- 172.21.15.6:0/716892515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3180093b0 con 0x7fb3280d2300 2023-07-21T22:57:04.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb327fff640 1 --2- 172.21.15.6:0/716892515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3280d2300 0x7fb32814c5e0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fb31800ebe0 tx=0x7fb31800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:04.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb324ff9640 1 -- 172.21.15.6:0/716892515 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb318009760 con 0x7fb3280d2300 2023-07-21T22:57:04.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb324ff9640 1 -- 172.21.15.6:0/716892515 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31800cc30 con 0x7fb3280d2300 2023-07-21T22:57:04.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb324ff9640 1 -- 172.21.15.6:0/716892515 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31800eee0 con 0x7fb3280d2300 2023-07-21T22:57:04.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb32e937640 1 -- 172.21.15.6:0/716892515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb320009b30 con 0x7fb3280d2300 2023-07-21T22:57:04.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb32e937640 1 -- 172.21.15.6:0/716892515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3280b7860 con 0x7fb3280d2300 2023-07-21T22:57:04.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.833+0000 7fb32e937640 1 -- 172.21.15.6:0/716892515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3280678d0 con 0x7fb3280d2300 2023-07-21T22:57:04.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.837+0000 7fb324ff9640 1 -- 172.21.15.6:0/716892515 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 87) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fb3180059a0 con 0x7fb3280d2300 2023-07-21T22:57:04.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.837+0000 7fb324ff9640 1 --2- 172.21.15.6:0/716892515 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fb3140664c0 0x7fb314068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:04.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.837+0000 7fb324ff9640 1 -- 172.21.15.6:0/716892515 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6536+0+0 (secure 0 0 0) 0x7fb3180847c0 con 0x7fb3280d2300 2023-07-21T22:57:04.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.837+0000 7fb3277fe640 1 -- 172.21.15.6:0/716892515 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fb3140664c0 msgr2=0x7fb314068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2516914157 2023-07-21T22:57:04.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.837+0000 7fb3277fe640 1 --2- 172.21.15.6:0/716892515 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fb3140664c0 0x7fb314068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:04.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.841+0000 7fb324ff9640 1 -- 172.21.15.6:0/716892515 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb3180517a0 con 0x7fb3280d2300 2023-07-21T22:57:04.888 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:04.853+0000 7f3fbac3a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:57:04.945 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:04.919+0000 7fec1deef180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:57:04.948 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:04.913+0000 7f3fbac3a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:57:05.003 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:04.975+0000 7fec1deef180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:57:05.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.993+0000 7fb32e937640 1 -- 172.21.15.6:0/716892515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb32815b3e0 con 0x7fb3280d2300 2023-07-21T22:57:05.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.997+0000 7fb324ff9640 1 -- 172.21.15.6:0/716892515 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v177) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb318054dc0 con 0x7fb3280d2300 2023-07-21T22:57:05.031 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:57:05.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.997+0000 7fb32e937640 1 -- 172.21.15.6:0/716892515 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fb3140664c0 msgr2=0x7fb314068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:05.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.997+0000 7fb32e937640 1 --2- 172.21.15.6:0/716892515 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fb3140664c0 0x7fb314068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.997+0000 7fb32e937640 1 -- 172.21.15.6:0/716892515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3280d2300 msgr2=0x7fb32814c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.997+0000 7fb32e937640 1 --2- 172.21.15.6:0/716892515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3280d2300 0x7fb32814c5e0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fb31800ebe0 tx=0x7fb31800c520 comp rx=0 tx=0).stop 2023-07-21T22:57:05.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.997+0000 7fb32e937640 1 -- 172.21.15.6:0/716892515 shutdown_connections 2023-07-21T22:57:05.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.997+0000 7fb32e937640 1 --2- 172.21.15.6:0/716892515 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fb3140664c0 0x7fb314068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.997+0000 7fb32e937640 1 --2- 172.21.15.6:0/716892515 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb32815bde0 0x7fb3280b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.997+0000 7fb32e937640 1 --2- 172.21.15.6:0/716892515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3280d2fc0 0x7fb3280b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.997+0000 7fb32e937640 1 --2- 172.21.15.6:0/716892515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3280d2300 0x7fb32814c5e0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.997+0000 7fb32e937640 1 -- 172.21.15.6:0/716892515 >> 172.21.15.6:0/716892515 conn(0x7fb3280659d0 msgr2=0x7fb3280aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:05.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.997+0000 7fb32e937640 1 -- 172.21.15.6:0/716892515 shutdown_connections 2023-07-21T22:57:05.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:04.997+0000 7fb32e937640 1 -- 172.21.15.6:0/716892515 wait complete. 2023-07-21T22:57:05.038 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:05.005+0000 7f3fbac3a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:57:05.053 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:57:05.099 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:05.065+0000 7f3fbac3a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:57:05.147 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:05.119+0000 7fec1deef180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:57:05.204 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:05.175+0000 7fec1deef180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:57:05.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.205+0000 7fa6d0f03640 1 Processor -- start 2023-07-21T22:57:05.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.205+0000 7fa6d0f03640 1 -- start start 2023-07-21T22:57:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.209+0000 7fa6d0f03640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6cc15bde0 0x7fa6cc0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.209+0000 7fa6d0f03640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6cc0b04c0 con 0x7fa6cc0d2300 2023-07-21T22:57:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.209+0000 7fa6d0f03640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6cc0b1060 con 0x7fa6cc0d2fc0 2023-07-21T22:57:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.209+0000 7fa6d0f03640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc15c1b0 con 0x7fa6cc15bde0 2023-07-21T22:57:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.209+0000 7fa6cad9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa6cc0d2300 0x7fa6cc0cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53632/0 (socket says 172.21.15.6:53632) 2023-07-21T22:57:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.209+0000 7fa6cad9d640 1 -- 172.21.15.6:0/2155708538 learned_addr learned my addr 172.21.15.6:0/2155708538 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.209+0000 7fa6ca59c640 1 --2- 172.21.15.6:0/2155708538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6cc15bde0 0x7fa6cc0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.209+0000 7fa6c9d9b640 1 -- 172.21.15.6:0/2155708538 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 939730541 0 0) 0x7fa6cc0b04c0 con 0x7fa6cc0d2300 2023-07-21T22:57:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.209+0000 7fa6c9d9b640 1 -- 172.21.15.6:0/2155708538 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6b8003530 con 0x7fa6cc0d2300 2023-07-21T22:57:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.209+0000 7fa6c9d9b640 1 -- 172.21.15.6:0/2155708538 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874914842 0 0) 0x7fa6cc0b1060 con 0x7fa6cc0d2fc0 2023-07-21T22:57:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.209+0000 7fa6c9d9b640 1 -- 172.21.15.6:0/2155708538 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6cc0b04c0 con 0x7fa6cc0d2fc0 2023-07-21T22:57:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.209+0000 7fa6ca59c640 1 -- 172.21.15.6:0/2155708538 >> v1:172.21.15.161:6789/0 conn(0x7fa6cc0d2fc0 legacy=0x7fa6cc0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.209+0000 7fa6ca59c640 1 -- 172.21.15.6:0/2155708538 >> v1:172.21.15.6:6789/0 conn(0x7fa6cc0d2300 legacy=0x7fa6cc0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.209+0000 7fa6ca59c640 1 -- 172.21.15.6:0/2155708538 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc0d0aa0 con 0x7fa6cc15bde0 2023-07-21T22:57:05.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.213+0000 7fa6ca59c640 1 --2- 172.21.15.6:0/2155708538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6cc15bde0 0x7fa6cc0d0270 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc0097d0 tx=0x7fa6bc01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1134c90afc23117b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.213+0000 7fa6c9d9b640 1 -- 172.21.15.6:0/2155708538 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc0a6040 con 0x7fa6cc15bde0 2023-07-21T22:57:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.213+0000 7fa6c9d9b640 1 -- 172.21.15.6:0/2155708538 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6bc0aa600 con 0x7fa6cc15bde0 2023-07-21T22:57:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.213+0000 7fa6c9d9b640 1 -- 172.21.15.6:0/2155708538 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc0aa990 con 0x7fa6cc15bde0 2023-07-21T22:57:05.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.213+0000 7fa6d0f03640 1 -- 172.21.15.6:0/2155708538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6cc15bde0 msgr2=0x7fa6cc0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.213+0000 7fa6d0f03640 1 --2- 172.21.15.6:0/2155708538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6cc15bde0 0x7fa6cc0d0270 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc0097d0 tx=0x7fa6bc01c4a0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.213+0000 7fa6d0f03640 1 -- 172.21.15.6:0/2155708538 shutdown_connections 2023-07-21T22:57:05.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6d0f03640 1 --2- 172.21.15.6:0/2155708538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6cc15bde0 0x7fa6cc0d0270 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6d0f03640 1 -- 172.21.15.6:0/2155708538 >> 172.21.15.6:0/2155708538 conn(0x7fa6cc0659d0 msgr2=0x7fa6cc09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:05.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6d0f03640 1 -- 172.21.15.6:0/2155708538 shutdown_connections 2023-07-21T22:57:05.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6d0f03640 1 -- 172.21.15.6:0/2155708538 wait complete. 2023-07-21T22:57:05.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6d0f03640 1 Processor -- start 2023-07-21T22:57:05.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6d0f03640 1 -- start start 2023-07-21T22:57:05.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6d0f03640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6cc0d2300 0x7fa6cc155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6d0f03640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6cc0d2fc0 0x7fa6cc157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6d0f03640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6cc15bde0 0x7fa6cc158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6d0f03640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc0ccf40 con 0x7fa6cc0d2300 2023-07-21T22:57:05.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6d0f03640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc159440 con 0x7fa6cc0d2fc0 2023-07-21T22:57:05.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6d0f03640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc15a210 con 0x7fa6cc15bde0 2023-07-21T22:57:05.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6ca59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6cc0d2300 0x7fa6cc155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6ca59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6cc0d2300 0x7fa6cc155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41886/0 (socket says 172.21.15.6:41886) 2023-07-21T22:57:05.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6ca59c640 1 -- 172.21.15.6:0/2942170322 learned_addr learned my addr 172.21.15.6:0/2942170322 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:05.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6cad9d640 1 --2- 172.21.15.6:0/2942170322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6cc15bde0 0x7fa6cc158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6c3fff640 1 --2- 172.21.15.6:0/2942170322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6cc0d2fc0 0x7fa6cc157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6ca59c640 1 -- 172.21.15.6:0/2942170322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6cc15bde0 msgr2=0x7fa6cc158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6ca59c640 1 --2- 172.21.15.6:0/2942170322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6cc15bde0 0x7fa6cc158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6ca59c640 1 -- 172.21.15.6:0/2942170322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6cc0d2fc0 msgr2=0x7fa6cc157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6ca59c640 1 --2- 172.21.15.6:0/2942170322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6cc0d2fc0 0x7fa6cc157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.217+0000 7fa6ca59c640 1 -- 172.21.15.6:0/2942170322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6bc0093b0 con 0x7fa6cc0d2300 2023-07-21T22:57:05.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.221+0000 7fa6ca59c640 1 --2- 172.21.15.6:0/2942170322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6cc0d2300 0x7fa6cc155e50 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc01a0d0 tx=0x7fa6bc019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:05.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.221+0000 7fa6c2ffd640 1 -- 172.21.15.6:0/2942170322 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc005e70 con 0x7fa6cc0d2300 2023-07-21T22:57:05.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.221+0000 7fa6c2ffd640 1 -- 172.21.15.6:0/2942170322 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6bc0aa8f0 con 0x7fa6cc0d2300 2023-07-21T22:57:05.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.221+0000 7fa6d0f03640 1 -- 172.21.15.6:0/2942170322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6cc159690 con 0x7fa6cc0d2300 2023-07-21T22:57:05.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.221+0000 7fa6c2ffd640 1 -- 172.21.15.6:0/2942170322 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc0aaca0 con 0x7fa6cc0d2300 2023-07-21T22:57:05.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.221+0000 7fa6d0f03640 1 -- 172.21.15.6:0/2942170322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6cc159c50 con 0x7fa6cc0d2300 2023-07-21T22:57:05.258 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:05.221+0000 7f3fbac3a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:57:05.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.221+0000 7fa6d0f03640 1 -- 172.21.15.6:0/2942170322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6cc15c3b0 con 0x7fa6cc0d2300 2023-07-21T22:57:05.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.221+0000 7fa6c2ffd640 1 -- 172.21.15.6:0/2942170322 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 87) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fa6bc006030 con 0x7fa6cc0d2300 2023-07-21T22:57:05.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.225+0000 7fa6c2ffd640 1 --2- 172.21.15.6:0/2942170322 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fa6ac0664c0 0x7fa6ac068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.225+0000 7fa6c2ffd640 1 -- 172.21.15.6:0/2942170322 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6536+0+0 (secure 0 0 0) 0x7fa6bc11ed30 con 0x7fa6cc0d2300 2023-07-21T22:57:05.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.225+0000 7fa6c3fff640 1 -- 172.21.15.6:0/2942170322 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fa6ac0664c0 msgr2=0x7fa6ac068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2516914157 2023-07-21T22:57:05.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.225+0000 7fa6c3fff640 1 --2- 172.21.15.6:0/2942170322 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fa6ac0664c0 0x7fa6ac068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:05.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.229+0000 7fa6c2ffd640 1 -- 172.21.15.6:0/2942170322 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa6cc15c3b0 con 0x7fa6cc0d2300 2023-07-21T22:57:05.334 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:05.301+0000 7f3fbac3a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:57:05.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.405+0000 7fa6d0f03640 1 -- 172.21.15.6:0/2942170322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa6cc15c3b0 con 0x7fa6cc0d2300 2023-07-21T22:57:05.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.405+0000 7fa6c2ffd640 1 -- 172.21.15.6:0/2942170322 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v178) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa6cc15c3b0 con 0x7fa6cc0d2300 2023-07-21T22:57:05.441 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:57:05.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.409+0000 7fa6d0f03640 1 -- 172.21.15.6:0/2942170322 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fa6ac0664c0 msgr2=0x7fa6ac068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:05.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.409+0000 7fa6d0f03640 1 --2- 172.21.15.6:0/2942170322 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fa6ac0664c0 0x7fa6ac068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.409+0000 7fa6d0f03640 1 -- 172.21.15.6:0/2942170322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6cc0d2300 msgr2=0x7fa6cc155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.409+0000 7fa6d0f03640 1 --2- 172.21.15.6:0/2942170322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6cc0d2300 0x7fa6cc155e50 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc01a0d0 tx=0x7fa6bc019240 comp rx=0 tx=0).stop 2023-07-21T22:57:05.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.409+0000 7fa6d0f03640 1 -- 172.21.15.6:0/2942170322 shutdown_connections 2023-07-21T22:57:05.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.409+0000 7fa6d0f03640 1 --2- 172.21.15.6:0/2942170322 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7fa6ac0664c0 0x7fa6ac068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.409+0000 7fa6d0f03640 1 --2- 172.21.15.6:0/2942170322 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6cc15bde0 0x7fa6cc158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.409+0000 7fa6d0f03640 1 --2- 172.21.15.6:0/2942170322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6cc0d2fc0 0x7fa6cc157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.409+0000 7fa6d0f03640 1 --2- 172.21.15.6:0/2942170322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6cc0d2300 0x7fa6cc155e50 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.409+0000 7fa6d0f03640 1 -- 172.21.15.6:0/2942170322 >> 172.21.15.6:0/2942170322 conn(0x7fa6cc0659d0 msgr2=0x7fa6cc0cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:05.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.409+0000 7fa6d0f03640 1 -- 172.21.15.6:0/2942170322 shutdown_connections 2023-07-21T22:57:05.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.409+0000 7fa6d0f03640 1 -- 172.21.15.6:0/2942170322 wait complete. 2023-07-21T22:57:05.450 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:57:05.450 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:57:05.450 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:57:05.458 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:05.431+0000 7fec1deef180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:57:05.463 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:57:05.592 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:05.567+0000 7fec1deef180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:57:05.593 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:57:05.593 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:57:05.593 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:57:05.602 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:05.569+0000 7f3fbac3a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:57:05.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.661+0000 7f38367a9640 1 Processor -- start 2023-07-21T22:57:05.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.661+0000 7f38367a9640 1 -- start start 2023-07-21T22:57:05.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.661+0000 7f38367a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f383006e770 0x7f38300abd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.661+0000 7f38367a9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383006eb40 con 0x7f3830069b40 2023-07-21T22:57:05.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.661+0000 7f38367a9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383015f900 con 0x7f38300ce650 2023-07-21T22:57:05.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.661+0000 7f38367a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38300c9950 con 0x7f383006e770 2023-07-21T22:57:05.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.661+0000 7f3835fa8640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3830069b40 0x7f38300cce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53638/0 (socket says 172.21.15.6:53638) 2023-07-21T22:57:05.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.661+0000 7f3835fa8640 1 -- 172.21.15.6:0/2003220835 learned_addr learned my addr 172.21.15.6:0/2003220835 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:05.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.661+0000 7f38357a7640 1 --2- 172.21.15.6:0/2003220835 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f383006e770 0x7f38300abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.661+0000 7f3827fff640 1 -- 172.21.15.6:0/2003220835 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289115490 0 0) 0x7f383006eb40 con 0x7f3830069b40 2023-07-21T22:57:05.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.661+0000 7f3827fff640 1 -- 172.21.15.6:0/2003220835 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f381c003530 con 0x7f3830069b40 2023-07-21T22:57:05.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.661+0000 7f3827fff640 1 -- 172.21.15.6:0/2003220835 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106828247 0 0) 0x7f383015f900 con 0x7f38300ce650 2023-07-21T22:57:05.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.661+0000 7f3827fff640 1 -- 172.21.15.6:0/2003220835 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f383006eb40 con 0x7f38300ce650 2023-07-21T22:57:05.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.661+0000 7f38357a7640 1 -- 172.21.15.6:0/2003220835 >> v1:172.21.15.161:6789/0 conn(0x7f38300ce650 legacy=0x7f3830069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.661+0000 7f38357a7640 1 -- 172.21.15.6:0/2003220835 >> v1:172.21.15.6:6789/0 conn(0x7f3830069b40 legacy=0x7f38300cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.661+0000 7f38357a7640 1 -- 172.21.15.6:0/2003220835 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383015fbe0 con 0x7f383006e770 2023-07-21T22:57:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.665+0000 7f38357a7640 1 --2- 172.21.15.6:0/2003220835 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f383006e770 0x7f38300abd60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f382c0097f0 tx=0x7f382c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=180e9f9c6fe79311 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.665+0000 7f3827fff640 1 -- 172.21.15.6:0/2003220835 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c0ab670 con 0x7f383006e770 2023-07-21T22:57:05.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.665+0000 7f3827fff640 1 -- 172.21.15.6:0/2003220835 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c0ab7d0 con 0x7f383006e770 2023-07-21T22:57:05.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.665+0000 7f3827fff640 1 -- 172.21.15.6:0/2003220835 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c0abb60 con 0x7f383006e770 2023-07-21T22:57:05.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.665+0000 7f38367a9640 1 -- 172.21.15.6:0/2003220835 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f383006e770 msgr2=0x7f38300abd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.665+0000 7f38367a9640 1 --2- 172.21.15.6:0/2003220835 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f383006e770 0x7f38300abd60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f382c0097f0 tx=0x7f382c01c490 comp rx=0 tx=0).stop 2023-07-21T22:57:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.665+0000 7f38367a9640 1 -- 172.21.15.6:0/2003220835 shutdown_connections 2023-07-21T22:57:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.665+0000 7f38367a9640 1 --2- 172.21.15.6:0/2003220835 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f383006e770 0x7f38300abd60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.665+0000 7f38367a9640 1 -- 172.21.15.6:0/2003220835 >> 172.21.15.6:0/2003220835 conn(0x7f383006a540 msgr2=0x7f383006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.665+0000 7f38367a9640 1 -- 172.21.15.6:0/2003220835 shutdown_connections 2023-07-21T22:57:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.665+0000 7f38367a9640 1 -- 172.21.15.6:0/2003220835 wait complete. 2023-07-21T22:57:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.669+0000 7f38367a9640 1 Processor -- start 2023-07-21T22:57:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.669+0000 7f38367a9640 1 -- start start 2023-07-21T22:57:05.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f38367a9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3830069b40 0x7f3830154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f38367a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f383006e770 0x7f38300b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f38367a9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38300ce650 0x7f38300b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f38367a9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38300b1810 con 0x7f38300ce650 2023-07-21T22:57:05.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f38367a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383006ddc0 con 0x7f383006e770 2023-07-21T22:57:05.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f38367a9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383006e030 con 0x7f3830069b40 2023-07-21T22:57:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f3835fa8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38300ce650 0x7f38300b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f3835fa8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38300ce650 0x7f38300b12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41896/0 (socket says 172.21.15.6:41896) 2023-07-21T22:57:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f3835fa8640 1 -- 172.21.15.6:0/1936869786 learned_addr learned my addr 172.21.15.6:0/1936869786 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f38357a7640 1 --2- 172.21.15.6:0/1936869786 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3830069b40 0x7f3830154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f3834fa6640 1 --2- 172.21.15.6:0/1936869786 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f383006e770 0x7f38300b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f38357a7640 1 -- 172.21.15.6:0/1936869786 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f383006e770 msgr2=0x7f38300b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f38357a7640 1 --2- 172.21.15.6:0/1936869786 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f383006e770 0x7f38300b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f38357a7640 1 -- 172.21.15.6:0/1936869786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38300ce650 msgr2=0x7f38300b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f38357a7640 1 --2- 172.21.15.6:0/1936869786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38300ce650 0x7f38300b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f38357a7640 1 -- 172.21.15.6:0/1936869786 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c009420 con 0x7f3830069b40 2023-07-21T22:57:05.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f3835fa8640 1 --2- 172.21.15.6:0/1936869786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38300ce650 0x7f38300b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f38357a7640 1 --2- 172.21.15.6:0/1936869786 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3830069b40 0x7f3830154430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f382c0ac000 tx=0x7f382c01acd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f3825ffb640 1 -- 172.21.15.6:0/1936869786 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c0bf610 con 0x7f3830069b40 2023-07-21T22:57:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f3825ffb640 1 -- 172.21.15.6:0/1936869786 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c0bf7b0 con 0x7f3830069b40 2023-07-21T22:57:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f3825ffb640 1 -- 172.21.15.6:0/1936869786 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c0bfb60 con 0x7f3830069b40 2023-07-21T22:57:05.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f38367a9640 1 -- 172.21.15.6:0/1936869786 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38300c6bb0 con 0x7f3830069b40 2023-07-21T22:57:05.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f38367a9640 1 -- 172.21.15.6:0/1936869786 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3830154970 con 0x7f3830069b40 2023-07-21T22:57:05.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.673+0000 7f38367a9640 1 -- 172.21.15.6:0/1936869786 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38300678d0 con 0x7f3830069b40 2023-07-21T22:57:05.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.677+0000 7f3825ffb640 1 -- 172.21.15.6:0/1936869786 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 87) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f382c0bfcc0 con 0x7f3830069b40 2023-07-21T22:57:05.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.677+0000 7f3825ffb640 1 --2- 172.21.15.6:0/1936869786 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f38140664c0 0x7f3814068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.677+0000 7f3825ffb640 1 -- 172.21.15.6:0/1936869786 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f382c11eca0 con 0x7f3830069b40 2023-07-21T22:57:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.677+0000 7f3834fa6640 1 -- 172.21.15.6:0/1936869786 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f38140664c0 msgr2=0x7f3814068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2516914157 2023-07-21T22:57:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.677+0000 7f3834fa6640 1 --2- 172.21.15.6:0/1936869786 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f38140664c0 0x7f3814068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.681+0000 7f3825ffb640 1 -- 172.21.15.6:0/1936869786 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f382c0eba20 con 0x7f3830069b40 2023-07-21T22:57:05.723 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:05.695+0000 7fec1deef180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:57:05.752 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:05.717+0000 7f3fbac3a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:57:05.797 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:05.771+0000 7fec1deef180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:57:05.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.849+0000 7f38367a9640 1 -- 172.21.15.6:0/1936869786 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f38300b4ed0 con 0x7f3830069b40 2023-07-21T22:57:05.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.849+0000 7f3825ffb640 1 -- 172.21.15.6:0/1936869786 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v178) v1 ==== 80+0+477 (secure 0 0 0) 0x7f382c0ef040 con 0x7f3830069b40 2023-07-21T22:57:05.884 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/1340525209 2023-07-22T22:55:56.979202+0000 2023-07-21T22:57:05.884 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/586248075 2023-07-22T22:55:56.979202+0000 2023-07-21T22:57:05.884 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/3856824963 2023-07-22T22:55:56.979202+0000 2023-07-21T22:57:05.885 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6833/2346358146 2023-07-22T22:55:56.979202+0000 2023-07-21T22:57:05.885 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/1537566959 2023-07-22T22:55:56.979202+0000 2023-07-21T22:57:05.886 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6832/2346358146 2023-07-22T22:55:56.979202+0000 2023-07-21T22:57:05.886 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/1490152306 2023-07-22T22:55:56.979202+0000 2023-07-21T22:57:05.886 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/4205584408 2023-07-22T22:55:56.979202+0000 2023-07-21T22:57:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:listed 8 entries 2023-07-21T22:57:05.887 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:05.849+0000 7f3fbac3a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:57:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.849+0000 7f38367a9640 1 -- 172.21.15.6:0/1936869786 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f38140664c0 msgr2=0x7f3814068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.849+0000 7f38367a9640 1 --2- 172.21.15.6:0/1936869786 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f38140664c0 0x7f3814068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.849+0000 7f38367a9640 1 -- 172.21.15.6:0/1936869786 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3830069b40 msgr2=0x7f3830154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.849+0000 7f38367a9640 1 --2- 172.21.15.6:0/1936869786 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3830069b40 0x7f3830154430 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f382c0ac000 tx=0x7f382c01acd0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.853+0000 7f38367a9640 1 -- 172.21.15.6:0/1936869786 shutdown_connections 2023-07-21T22:57:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.853+0000 7f38367a9640 1 --2- 172.21.15.6:0/1936869786 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f38140664c0 0x7f3814068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.853+0000 7f38367a9640 1 --2- 172.21.15.6:0/1936869786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38300ce650 0x7f38300b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.853+0000 7f38367a9640 1 --2- 172.21.15.6:0/1936869786 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f383006e770 0x7f38300b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.853+0000 7f38367a9640 1 --2- 172.21.15.6:0/1936869786 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3830069b40 0x7f3830154430 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.853+0000 7f38367a9640 1 -- 172.21.15.6:0/1936869786 >> 172.21.15.6:0/1936869786 conn(0x7f383006a540 msgr2=0x7f383006a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.853+0000 7f38367a9640 1 -- 172.21.15.6:0/1936869786 shutdown_connections 2023-07-21T22:57:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:05.853+0000 7f38367a9640 1 -- 172.21.15.6:0/1936869786 wait complete. 2023-07-21T22:57:05.905 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-21T22:57:05.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:05.906 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-21T22:57:05.931 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:05.903+0000 7fec1deef180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:57:05.963 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:05.929+0000 7f3fbac3a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:57:05.974 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:57:05.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:05.975 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T22:57:05.985 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:57:05.985 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:57:05.995 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:57:05.995 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:57:05.996 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:57:06.034 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:57:06.034 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:57:06.035 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:57:06.044 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:57:06.045 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:57:06.105 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:06.069+0000 7f3fbac3a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:57:06.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.189+0000 7f7564540640 1 Processor -- start 2023-07-21T22:57:06.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.189+0000 7f7564540640 1 -- start start 2023-07-21T22:57:06.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.193+0000 7f7564540640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f755c15fd60 0x7f755c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:06.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.193+0000 7f7564540640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f755c0d1850 0x7f755c0d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:06.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.193+0000 7f7564540640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755c0ccaf0 con 0x7f755c0b7c70 2023-07-21T22:57:06.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.193+0000 7f7564540640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f755c0d1190 con 0x7f755c15fd60 2023-07-21T22:57:06.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.193+0000 7f7564540640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755c160600 con 0x7f755c0d1850 2023-07-21T22:57:06.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.193+0000 7f7561adb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f755c15fd60 0x7f755c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:06.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.193+0000 7f7562add640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f755c0d1850 0x7f755c0d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:06.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.193+0000 7f7561adb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f755c15fd60 0x7f755c0d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:38770/0 (socket says 172.21.15.6:38770) 2023-07-21T22:57:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.193+0000 7f7561adb640 1 -- 172.21.15.6:0/3628038497 learned_addr learned my addr 172.21.15.6:0/3628038497 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.193+0000 7f75622dc640 1 --1- 172.21.15.6:0/3628038497 >> v1:172.21.15.161:6789/0 conn(0x7f755c0b7c70 0x7f755c15f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:39770/0 (socket says 172.21.15.6:39770) 2023-07-21T22:57:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.193+0000 7f7561adb640 1 -- 172.21.15.6:0/3628038497 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f755c0d1850 msgr2=0x7f755c0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.193+0000 7f7561adb640 1 --2- 172.21.15.6:0/3628038497 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f755c0d1850 0x7f755c0d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.193+0000 7f7561adb640 1 -- 172.21.15.6:0/3628038497 >> v1:172.21.15.161:6789/0 conn(0x7f755c0b7c70 legacy=0x7f755c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.193+0000 7f75612da640 1 -- 172.21.15.6:0/3628038497 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 75894739 0 0) 0x7f755c0ccaf0 con 0x7f755c0b7c70 2023-07-21T22:57:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.193+0000 7f7561adb640 1 -- 172.21.15.6:0/3628038497 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c160320 con 0x7f755c15fd60 2023-07-21T22:57:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.193+0000 7f7562add640 1 --2- 172.21.15.6:0/3628038497 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f755c0d1850 0x7f755c0d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.197+0000 7f7561adb640 1 --2- 172.21.15.6:0/3628038497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f755c15fd60 0x7f755c0d0c50 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f754c009870 tx=0x7f754c01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4790d7fc4e65b2d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:06.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.197+0000 7f75612da640 1 -- 172.21.15.6:0/3628038497 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c0a95f0 con 0x7f755c15fd60 2023-07-21T22:57:06.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.197+0000 7f75612da640 1 -- 172.21.15.6:0/3628038497 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c0a9750 con 0x7f755c15fd60 2023-07-21T22:57:06.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.197+0000 7f75612da640 1 -- 172.21.15.6:0/3628038497 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c0a9ae0 con 0x7f755c15fd60 2023-07-21T22:57:06.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.197+0000 7f7564540640 1 -- 172.21.15.6:0/3628038497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f755c15fd60 msgr2=0x7f755c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.197+0000 7f7564540640 1 --2- 172.21.15.6:0/3628038497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f755c15fd60 0x7f755c0d0c50 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f754c009870 tx=0x7f754c01c510 comp rx=0 tx=0).stop 2023-07-21T22:57:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.197+0000 7f7564540640 1 -- 172.21.15.6:0/3628038497 shutdown_connections 2023-07-21T22:57:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.197+0000 7f7564540640 1 --2- 172.21.15.6:0/3628038497 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f755c0d1850 0x7f755c0d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.197+0000 7f7564540640 1 --2- 172.21.15.6:0/3628038497 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f755c15fd60 0x7f755c0d0c50 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.197+0000 7f7564540640 1 -- 172.21.15.6:0/3628038497 >> 172.21.15.6:0/3628038497 conn(0x7f755c0650b0 msgr2=0x7f755c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.197+0000 7f7564540640 1 -- 172.21.15.6:0/3628038497 shutdown_connections 2023-07-21T22:57:06.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.197+0000 7f7564540640 1 -- 172.21.15.6:0/3628038497 wait complete. 2023-07-21T22:57:06.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.197+0000 7f7564540640 1 Processor -- start 2023-07-21T22:57:06.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.197+0000 7f7564540640 1 -- start start 2023-07-21T22:57:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f7564540640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f755c0b7c70 0x7f755c15b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f7564540640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f755c0d1850 0x7f755c159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f7564540640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f755c15fd60 0x7f755c1403e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f7564540640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c14f210 con 0x7f755c15fd60 2023-07-21T22:57:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f7564540640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c15be40 con 0x7f755c0d1850 2023-07-21T22:57:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f7564540640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755c150370 con 0x7f755c0b7c70 2023-07-21T22:57:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f7562add640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f755c15fd60 0x7f755c1403e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f75622dc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f755c0b7c70 0x7f755c15b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:06.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f7561adb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f755c0d1850 0x7f755c159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:06.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f7562add640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f755c15fd60 0x7f755c1403e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41906/0 (socket says 172.21.15.6:41906) 2023-07-21T22:57:06.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f7562add640 1 -- 172.21.15.6:0/3090761124 learned_addr learned my addr 172.21.15.6:0/3090761124 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f75622dc640 1 -- 172.21.15.6:0/3090761124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f755c0d1850 msgr2=0x7f755c159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f75622dc640 1 --2- 172.21.15.6:0/3090761124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f755c0d1850 0x7f755c159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f75622dc640 1 -- 172.21.15.6:0/3090761124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f755c15fd60 msgr2=0x7f755c1403e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f75622dc640 1 --2- 172.21.15.6:0/3090761124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f755c15fd60 0x7f755c1403e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f75622dc640 1 -- 172.21.15.6:0/3090761124 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7554009a70 con 0x7f755c0b7c70 2023-07-21T22:57:06.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f75622dc640 1 --2- 172.21.15.6:0/3090761124 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f755c0b7c70 0x7f755c15b900 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f755800c410 tx=0x7f755800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:06.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f7552ffd640 1 -- 172.21.15.6:0/3090761124 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75580074e0 con 0x7f755c0b7c70 2023-07-21T22:57:06.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f7552ffd640 1 -- 172.21.15.6:0/3090761124 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7558007640 con 0x7f755c0b7c70 2023-07-21T22:57:06.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f7564540640 1 -- 172.21.15.6:0/3090761124 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754c0094d0 con 0x7f755c0b7c70 2023-07-21T22:57:06.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f7552ffd640 1 -- 172.21.15.6:0/3090761124 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7558004a30 con 0x7f755c0b7c70 2023-07-21T22:57:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f7564540640 1 -- 172.21.15.6:0/3090761124 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755c14f3f0 con 0x7f755c0b7c70 2023-07-21T22:57:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.201+0000 7f7564540640 1 -- 172.21.15.6:0/3090761124 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755c1504e0 con 0x7f755c0b7c70 2023-07-21T22:57:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.205+0000 7f7552ffd640 1 -- 172.21.15.6:0/3090761124 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 87) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f7558004b90 con 0x7f755c0b7c70 2023-07-21T22:57:06.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.205+0000 7f7552ffd640 1 --2- 172.21.15.6:0/3090761124 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f7540066490 0x7f7540068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:06.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.205+0000 7f7552ffd640 1 -- 172.21.15.6:0/3090761124 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6624+0+0 (secure 0 0 0) 0x7f7558083ff0 con 0x7f755c0b7c70 2023-07-21T22:57:06.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.205+0000 7f7561adb640 1 -- 172.21.15.6:0/3090761124 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f7540066490 msgr2=0x7f7540068940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2516914157 2023-07-21T22:57:06.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.205+0000 7f7561adb640 1 --2- 172.21.15.6:0/3090761124 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f7540066490 0x7f7540068940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:06.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.209+0000 7f7552ffd640 1 -- 172.21.15.6:0/3090761124 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f755c1504e0 con 0x7f755c0b7c70 2023-07-21T22:57:06.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.409+0000 7f7561adb640 1 -- 172.21.15.6:0/3090761124 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f7540066490 msgr2=0x7f7540068940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2516914157 2023-07-21T22:57:06.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.409+0000 7f7561adb640 1 --2- 172.21.15.6:0/3090761124 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f7540066490 0x7f7540068940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:57:06.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.417+0000 7f7564540640 1 -- 172.21.15.6:0/3090761124 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f755c1504b0 con 0x7f755c0b7c70 2023-07-21T22:57:06.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.417+0000 7f7552ffd640 1 -- 172.21.15.6:0/3090761124 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4675 (secure 0 0 0) 0x7f7558051080 con 0x7f755c0b7c70 2023-07-21T22:57:06.453 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:06.453 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9508,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/1909144233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1909144233},{"type":"v1","addr":"172.21.15.161:6836","nonce":1909144233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9511,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1479759663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1479759663},{"type":"v1","addr":"172.21.15.161:6837","nonce":1479759663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9954,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2241291399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2241291399},{"type":"v1","addr":"172.21.15.6:6834","nonce":2241291399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:55:39.784030+0000","modified":"2023-07-21T22:55:43.422319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9957},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9957":{"gid":9957,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1921950839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1921950839},{"type":"v1","addr":"172.21.15.6:6835","nonce":1921950839}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-21T22:57:06.453 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 78 2023-07-21T22:57:06.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.421+0000 7f7564540640 1 -- 172.21.15.6:0/3090761124 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f7540066490 msgr2=0x7f7540068940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:06.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.421+0000 7f7564540640 1 --2- 172.21.15.6:0/3090761124 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f7540066490 0x7f7540068940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.421+0000 7f7564540640 1 -- 172.21.15.6:0/3090761124 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f755c0b7c70 msgr2=0x7f755c15b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:06.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.421+0000 7f7564540640 1 --2- 172.21.15.6:0/3090761124 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f755c0b7c70 0x7f755c15b900 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f755800c410 tx=0x7f755800c8d0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.421+0000 7f7564540640 1 -- 172.21.15.6:0/3090761124 shutdown_connections 2023-07-21T22:57:06.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.421+0000 7f7564540640 1 --2- 172.21.15.6:0/3090761124 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f7540066490 0x7f7540068940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.421+0000 7f7564540640 1 --2- 172.21.15.6:0/3090761124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f755c15fd60 0x7f755c1403e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.421+0000 7f7564540640 1 --2- 172.21.15.6:0/3090761124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f755c0d1850 0x7f755c159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.421+0000 7f7564540640 1 --2- 172.21.15.6:0/3090761124 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f755c0b7c70 0x7f755c15b900 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.421+0000 7f7564540640 1 -- 172.21.15.6:0/3090761124 >> 172.21.15.6:0/3090761124 conn(0x7f755c0650b0 msgr2=0x7f755c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:06.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.421+0000 7f7564540640 1 -- 172.21.15.6:0/3090761124 shutdown_connections 2023-07-21T22:57:06.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.421+0000 7f7564540640 1 -- 172.21.15.6:0/3090761124 wait complete. 2023-07-21T22:57:06.475 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:57:06.487 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:06.459+0000 7fec1deef180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:57:06.573 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:06.547+0000 7fec1deef180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:57:06.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.629+0000 7ff844d74640 1 Processor -- start 2023-07-21T22:57:06.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.629+0000 7ff844d74640 1 -- start start 2023-07-21T22:57:06.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.633+0000 7ff844d74640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff84015fd60 0x7ff8400d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:06.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.633+0000 7ff844d74640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff8400d1850 0x7ff8400d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:06.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.633+0000 7ff844d74640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8400ccaf0 con 0x7ff8400b7c70 2023-07-21T22:57:06.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.633+0000 7ff844d74640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8400d1190 con 0x7ff8400d1850 2023-07-21T22:57:06.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.633+0000 7ff844d74640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff840160600 con 0x7ff84015fd60 2023-07-21T22:57:06.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.633+0000 7ff83ed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff8400d1850 0x7ff8400d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:06.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.633+0000 7ff83ed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff8400d1850 0x7ff8400d1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41914/0 (socket says 172.21.15.6:41914) 2023-07-21T22:57:06.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.633+0000 7ff83ed9d640 1 -- 172.21.15.6:0/3665758925 learned_addr learned my addr 172.21.15.6:0/3665758925 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:06.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.633+0000 7ff837fff640 1 --2- 172.21.15.6:0/3665758925 >> v2:172.21.15.161:3300/0 conn(0x7ff84015fd60 0x7ff8400d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:06.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.633+0000 7ff83ed9d640 1 -- 172.21.15.6:0/3665758925 >> v2:172.21.15.161:3300/0 conn(0x7ff84015fd60 msgr2=0x7ff8400d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:06.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.633+0000 7ff83ed9d640 1 --2- 172.21.15.6:0/3665758925 >> v2:172.21.15.161:3300/0 conn(0x7ff84015fd60 0x7ff8400d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.633+0000 7ff83ed9d640 1 -- 172.21.15.6:0/3665758925 >> v1:172.21.15.161:6789/0 conn(0x7ff8400b7c70 legacy=0x7ff84015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:06.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.633+0000 7ff83ed9d640 1 -- 172.21.15.6:0/3665758925 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff840160320 con 0x7ff8400d1850 2023-07-21T22:57:06.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.633+0000 7ff83ed9d640 1 --2- 172.21.15.6:0/3665758925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400d1850 0x7ff8400d1da0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7ff8400b1180 tx=0x7ff83801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58269e34be203b57 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:06.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.637+0000 7ff83dd9b640 1 -- 172.21.15.6:0/3665758925 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8380a5880 con 0x7ff8400d1850 2023-07-21T22:57:06.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.637+0000 7ff83dd9b640 1 -- 172.21.15.6:0/3665758925 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8380a59e0 con 0x7ff8400d1850 2023-07-21T22:57:06.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.637+0000 7ff83dd9b640 1 -- 172.21.15.6:0/3665758925 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8380a5d70 con 0x7ff8400d1850 2023-07-21T22:57:06.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.637+0000 7ff844d74640 1 -- 172.21.15.6:0/3665758925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400d1850 msgr2=0x7ff8400d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:06.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.637+0000 7ff844d74640 1 --2- 172.21.15.6:0/3665758925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400d1850 0x7ff8400d1da0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7ff8400b1180 tx=0x7ff83801c9a0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.637+0000 7ff844d74640 1 -- 172.21.15.6:0/3665758925 shutdown_connections 2023-07-21T22:57:06.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.637+0000 7ff844d74640 1 --2- 172.21.15.6:0/3665758925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400d1850 0x7ff8400d1da0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.637+0000 7ff844d74640 1 --2- 172.21.15.6:0/3665758925 >> v2:172.21.15.161:3300/0 conn(0x7ff84015fd60 0x7ff8400d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.637+0000 7ff844d74640 1 -- 172.21.15.6:0/3665758925 >> 172.21.15.6:0/3665758925 conn(0x7ff8400650b0 msgr2=0x7ff8400654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:06.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.637+0000 7ff844d74640 1 -- 172.21.15.6:0/3665758925 shutdown_connections 2023-07-21T22:57:06.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.637+0000 7ff844d74640 1 -- 172.21.15.6:0/3665758925 wait complete. 2023-07-21T22:57:06.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.637+0000 7ff844d74640 1 Processor -- start 2023-07-21T22:57:06.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.637+0000 7ff844d74640 1 -- start start 2023-07-21T22:57:06.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.637+0000 7ff844d74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400b7c70 0x7ff8400b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:06.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.637+0000 7ff844d74640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8400d1850 0x7ff84014dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:06.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.637+0000 7ff844d74640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff84015fd60 0x7ff8400b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.637+0000 7ff844d74640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8400c8c70 con 0x7ff8400b7c70 2023-07-21T22:57:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.637+0000 7ff844d74640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8400c83d0 con 0x7ff84015fd60 2023-07-21T22:57:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.637+0000 7ff844d74640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8400c86b0 con 0x7ff8400d1850 2023-07-21T22:57:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.637+0000 7ff83e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400b7c70 0x7ff8400b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.641+0000 7ff83e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400b7c70 0x7ff8400b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41920/0 (socket says 172.21.15.6:41920) 2023-07-21T22:57:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.641+0000 7ff83e59c640 1 -- 172.21.15.6:0/773489844 learned_addr learned my addr 172.21.15.6:0/773489844 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:06.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.641+0000 7ff837fff640 1 --2- 172.21.15.6:0/773489844 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8400d1850 0x7ff84014dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:06.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.641+0000 7ff83ed9d640 1 --2- 172.21.15.6:0/773489844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff84015fd60 0x7ff8400b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:06.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.641+0000 7ff83e59c640 1 -- 172.21.15.6:0/773489844 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8400d1850 msgr2=0x7ff84014dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:06.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.641+0000 7ff83e59c640 1 --2- 172.21.15.6:0/773489844 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8400d1850 0x7ff84014dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.641+0000 7ff83e59c640 1 -- 172.21.15.6:0/773489844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff84015fd60 msgr2=0x7ff8400b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:06.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.641+0000 7ff83e59c640 1 --2- 172.21.15.6:0/773489844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff84015fd60 0x7ff8400b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.641+0000 7ff83e59c640 1 -- 172.21.15.6:0/773489844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff838009b30 con 0x7ff8400b7c70 2023-07-21T22:57:06.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.641+0000 7ff83e59c640 1 --2- 172.21.15.6:0/773489844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400b7c70 0x7ff8400b5330 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7ff83000c3c0 tx=0x7ff83000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:06.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.641+0000 7ff836ffd640 1 -- 172.21.15.6:0/773489844 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8300052d0 con 0x7ff8400b7c70 2023-07-21T22:57:06.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.641+0000 7ff836ffd640 1 -- 172.21.15.6:0/773489844 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff830005430 con 0x7ff8400b7c70 2023-07-21T22:57:06.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.641+0000 7ff836ffd640 1 -- 172.21.15.6:0/773489844 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff830003840 con 0x7ff8400b7c70 2023-07-21T22:57:06.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.641+0000 7ff844d74640 1 -- 172.21.15.6:0/773489844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8400c8990 con 0x7ff8400b7c70 2023-07-21T22:57:06.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.641+0000 7ff844d74640 1 -- 172.21.15.6:0/773489844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84014ff10 con 0x7ff8400b7c70 2023-07-21T22:57:06.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.641+0000 7ff844d74640 1 -- 172.21.15.6:0/773489844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8400678d0 con 0x7ff8400b7c70 2023-07-21T22:57:06.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.641+0000 7ff836ffd640 1 -- 172.21.15.6:0/773489844 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 87) v1 ==== 85874+0+0 (secure 0 0 0) 0x7ff8300039a0 con 0x7ff8400b7c70 2023-07-21T22:57:06.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.645+0000 7ff836ffd640 1 --2- 172.21.15.6:0/773489844 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7ff8200664c0 0x7ff820068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:06.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.645+0000 7ff836ffd640 1 -- 172.21.15.6:0/773489844 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6608+0+0 (secure 0 0 0) 0x7ff830083b60 con 0x7ff8400b7c70 2023-07-21T22:57:06.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.645+0000 7ff837fff640 1 -- 172.21.15.6:0/773489844 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7ff8200664c0 msgr2=0x7ff820068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2516914157 2023-07-21T22:57:06.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.645+0000 7ff837fff640 1 --2- 172.21.15.6:0/773489844 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7ff8200664c0 0x7ff820068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:06.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.645+0000 7ff836ffd640 1 -- 172.21.15.6:0/773489844 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff830050c70 con 0x7ff8400b7c70 2023-07-21T22:57:06.704 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:06.669+0000 7f3fbac3a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:57:06.725 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:06.699+0000 7fec1deef180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:57:06.801 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:06.765+0000 7f3fbac3a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:57:06.814 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:06.787+0000 7fec1deef180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:57:06.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.813+0000 7ff844d74640 1 -- 172.21.15.6:0/773489844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8400b1470 con 0x7ff8400b7c70 2023-07-21T22:57:06.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.813+0000 7ff836ffd640 1 -- 172.21.15.6:0/773489844 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+19145 (secure 0 0 0) 0x7ff830017090 con 0x7ff8400b7c70 2023-07-21T22:57:06.848 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:06.849 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":179,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:57:06.336215+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:55:37.909970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-21T22:55:38.777920+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":179,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.21","mappings":[{"from":3,"to":0}]},{"pgid":"22.30","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/1340525209":"2023-07-22T22:55:56.979202+0000","172.21.15.161:0/586248075":"2023-07-22T22:55:56.979202+0000","172.21.15.161:0/3856824963":"2023-07-22T22:55:56.979202+0000","172.21.15.161:6833/2346358146":"2023-07-22T22:55:56.979202+0000","172.21.15.161:0/1537566959":"2023-07-22T22:55:56.979202+0000","172.21.15.161:6832/2346358146":"2023-07-22T22:55:56.979202+0000","172.21.15.161:0/1490152306":"2023-07-22T22:55:56.979202+0000","172.21.15.161:0/4205584408":"2023-07-22T22:55:56.979202+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:57:06.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.817+0000 7ff844d74640 1 -- 172.21.15.6:0/773489844 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7ff8200664c0 msgr2=0x7ff820068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:06.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.817+0000 7ff844d74640 1 --2- 172.21.15.6:0/773489844 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7ff8200664c0 0x7ff820068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.817+0000 7ff844d74640 1 -- 172.21.15.6:0/773489844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400b7c70 msgr2=0x7ff8400b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:06.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.817+0000 7ff844d74640 1 --2- 172.21.15.6:0/773489844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400b7c70 0x7ff8400b5330 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7ff83000c3c0 tx=0x7ff83000c880 comp rx=0 tx=0).stop 2023-07-21T22:57:06.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.817+0000 7ff844d74640 1 -- 172.21.15.6:0/773489844 shutdown_connections 2023-07-21T22:57:06.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.817+0000 7ff844d74640 1 --2- 172.21.15.6:0/773489844 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7ff8200664c0 0x7ff820068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.817+0000 7ff844d74640 1 --2- 172.21.15.6:0/773489844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff84015fd60 0x7ff8400b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.817+0000 7ff844d74640 1 --2- 172.21.15.6:0/773489844 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8400d1850 0x7ff84014dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.817+0000 7ff844d74640 1 --2- 172.21.15.6:0/773489844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8400b7c70 0x7ff8400b5330 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:06.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.817+0000 7ff844d74640 1 -- 172.21.15.6:0/773489844 >> 172.21.15.6:0/773489844 conn(0x7ff8400650b0 msgr2=0x7ff8400cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:06.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.817+0000 7ff844d74640 1 -- 172.21.15.6:0/773489844 shutdown_connections 2023-07-21T22:57:06.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.817+0000 7ff844d74640 1 -- 172.21.15.6:0/773489844 wait complete. 2023-07-21T22:57:06.871 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:55:37.909970+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '173', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:55:38.777920+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '179', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 5, 'snap_epoch': 179, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:57:06.872 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:57:06.958 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:06.925+0000 7f3fbac3a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:57:07.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.985+0000 7f7ec9a9c640 1 Processor -- start 2023-07-21T22:57:07.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.985+0000 7f7ec9a9c640 1 -- start start 2023-07-21T22:57:07.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.985+0000 7f7ec9a9c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7ec415bde0 0x7f7ec40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:07.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.985+0000 7f7ec9a9c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ec40d2300 0x7f7ec40d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:07.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.985+0000 7f7ec9a9c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec40b04c0 con 0x7f7ec40d2fc0 2023-07-21T22:57:07.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.985+0000 7f7ec9a9c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec415c1b0 con 0x7f7ec415bde0 2023-07-21T22:57:07.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.985+0000 7f7ec9a9c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec40d2cc0 con 0x7f7ec40d2300 2023-07-21T22:57:07.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.985+0000 7f7ec2ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7ec40d2fc0 0x7f7ec40b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53650/0 (socket says 172.21.15.6:53650) 2023-07-21T22:57:07.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.985+0000 7f7ec2ffd640 1 -- 172.21.15.6:0/4211571036 learned_addr learned my addr 172.21.15.6:0/4211571036 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.989+0000 7f7ec37fe640 1 --2- 172.21.15.6:0/4211571036 >> v2:172.21.15.161:3300/0 conn(0x7f7ec415bde0 0x7f7ec40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.989+0000 7f7ec3fff640 1 --2- 172.21.15.6:0/4211571036 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ec40d2300 0x7f7ec40d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.989+0000 7f7ec27fc640 1 -- 172.21.15.6:0/4211571036 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210263370 0 0) 0x7f7ec40b04c0 con 0x7f7ec40d2fc0 2023-07-21T22:57:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.989+0000 7f7ec27fc640 1 -- 172.21.15.6:0/4211571036 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eac003530 con 0x7f7ec40d2fc0 2023-07-21T22:57:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.989+0000 7f7ec3fff640 1 -- 172.21.15.6:0/4211571036 >> v2:172.21.15.161:3300/0 conn(0x7f7ec415bde0 msgr2=0x7f7ec40d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:07.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.989+0000 7f7ec3fff640 1 --2- 172.21.15.6:0/4211571036 >> v2:172.21.15.161:3300/0 conn(0x7f7ec415bde0 0x7f7ec40d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.989+0000 7f7ec3fff640 1 -- 172.21.15.6:0/4211571036 >> v1:172.21.15.6:6789/0 conn(0x7f7ec40d2fc0 legacy=0x7f7ec40b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:07.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.989+0000 7f7ec3fff640 1 -- 172.21.15.6:0/4211571036 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec40b1060 con 0x7f7ec40d2300 2023-07-21T22:57:07.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.989+0000 7f7ec37fe640 1 --2- 172.21.15.6:0/4211571036 >> v2:172.21.15.161:3300/0 conn(0x7f7ec415bde0 0x7f7ec40d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:07.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.989+0000 7f7ec3fff640 1 --2- 172.21.15.6:0/4211571036 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ec40d2300 0x7f7ec40d2780 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc009d90 tx=0x7f7ebc01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e98a7e79e0c4bef5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:07.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.989+0000 7f7ec27fc640 1 -- 172.21.15.6:0/4211571036 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc0a5920 con 0x7f7ec40d2300 2023-07-21T22:57:07.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.989+0000 7f7ec27fc640 1 -- 172.21.15.6:0/4211571036 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ebc0a5a80 con 0x7f7ec40d2300 2023-07-21T22:57:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.989+0000 7f7ec27fc640 1 -- 172.21.15.6:0/4211571036 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc0a5df0 con 0x7f7ec40d2300 2023-07-21T22:57:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec9a9c640 1 -- 172.21.15.6:0/4211571036 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ec40d2300 msgr2=0x7f7ec40d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:07.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec9a9c640 1 --2- 172.21.15.6:0/4211571036 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ec40d2300 0x7f7ec40d2780 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc009d90 tx=0x7f7ebc01c950 comp rx=0 tx=0).stop 2023-07-21T22:57:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec9a9c640 1 -- 172.21.15.6:0/4211571036 shutdown_connections 2023-07-21T22:57:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec9a9c640 1 --2- 172.21.15.6:0/4211571036 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ec40d2300 0x7f7ec40d2780 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec9a9c640 1 --2- 172.21.15.6:0/4211571036 >> v2:172.21.15.161:3300/0 conn(0x7f7ec415bde0 0x7f7ec40d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec9a9c640 1 -- 172.21.15.6:0/4211571036 >> 172.21.15.6:0/4211571036 conn(0x7f7ec40659d0 msgr2=0x7f7ec409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec9a9c640 1 -- 172.21.15.6:0/4211571036 shutdown_connections 2023-07-21T22:57:07.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec9a9c640 1 -- 172.21.15.6:0/4211571036 wait complete. 2023-07-21T22:57:07.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec9a9c640 1 Processor -- start 2023-07-21T22:57:07.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec9a9c640 1 -- start start 2023-07-21T22:57:07.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec9a9c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ec40d2300 0x7f7ec40b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:07.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec9a9c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ec40d2fc0 0x7f7ec41532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:07.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec9a9c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ec415bde0 0x7f7ec40caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:07.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec9a9c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec40b3a90 con 0x7f7ec415bde0 2023-07-21T22:57:07.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec9a9c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec40b26d0 con 0x7f7ec40d2300 2023-07-21T22:57:07.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec9a9c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec40b1da0 con 0x7f7ec40d2fc0 2023-07-21T22:57:07.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ec415bde0 0x7f7ec40caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:07.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ec415bde0 0x7f7ec40caf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41922/0 (socket says 172.21.15.6:41922) 2023-07-21T22:57:07.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec3fff640 1 -- 172.21.15.6:0/579756270 learned_addr learned my addr 172.21.15.6:0/579756270 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:07.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec2ffd640 1 --2- 172.21.15.6:0/579756270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ec40d2fc0 0x7f7ec41532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:07.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.993+0000 7f7ec37fe640 1 --2- 172.21.15.6:0/579756270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ec40d2300 0x7f7ec40b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:07.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.997+0000 7f7ec3fff640 1 -- 172.21.15.6:0/579756270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ec40d2fc0 msgr2=0x7f7ec41532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:07.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.997+0000 7f7ec3fff640 1 --2- 172.21.15.6:0/579756270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ec40d2fc0 0x7f7ec41532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.997+0000 7f7ec3fff640 1 -- 172.21.15.6:0/579756270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ec40d2300 msgr2=0x7f7ec40b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:07.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.997+0000 7f7ec3fff640 1 --2- 172.21.15.6:0/579756270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ec40d2300 0x7f7ec40b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.997+0000 7f7ec3fff640 1 -- 172.21.15.6:0/579756270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb40093b0 con 0x7f7ec415bde0 2023-07-21T22:57:07.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.997+0000 7f7ec3fff640 1 --2- 172.21.15.6:0/579756270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ec415bde0 0x7f7ec40caf00 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc009d90 tx=0x7f7ebc0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:07.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.997+0000 7f7eabfff640 1 -- 172.21.15.6:0/579756270 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc007000 con 0x7f7ec415bde0 2023-07-21T22:57:07.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.997+0000 7f7eabfff640 1 -- 172.21.15.6:0/579756270 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ebc0aed30 con 0x7f7ec415bde0 2023-07-21T22:57:07.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.997+0000 7f7eabfff640 1 -- 172.21.15.6:0/579756270 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc0aeea0 con 0x7f7ec415bde0 2023-07-21T22:57:07.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.997+0000 7f7ec9a9c640 1 -- 172.21.15.6:0/579756270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ebc009a70 con 0x7f7ec415bde0 2023-07-21T22:57:07.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.997+0000 7f7ec9a9c640 1 -- 172.21.15.6:0/579756270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec40b2360 con 0x7f7ec415bde0 2023-07-21T22:57:07.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.997+0000 7f7ec9a9c640 1 -- 172.21.15.6:0/579756270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec40b2880 con 0x7f7ec415bde0 2023-07-21T22:57:07.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.997+0000 7f7eabfff640 1 -- 172.21.15.6:0/579756270 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 87) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f7ebc0b4050 con 0x7f7ec415bde0 2023-07-21T22:57:07.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:06.997+0000 7f7eabfff640 1 --2- 172.21.15.6:0/579756270 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f7eb00664c0 0x7f7eb0068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:07.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.001+0000 7f7eabfff640 1 -- 172.21.15.6:0/579756270 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f7ebc11f370 con 0x7f7ec415bde0 2023-07-21T22:57:07.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.001+0000 7f7ec37fe640 1 -- 172.21.15.6:0/579756270 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f7eb00664c0 msgr2=0x7f7eb0068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2516914157 2023-07-21T22:57:07.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.001+0000 7f7ec37fe640 1 --2- 172.21.15.6:0/579756270 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f7eb00664c0 0x7f7eb0068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:07.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.001+0000 7f7eabfff640 1 -- 172.21.15.6:0/579756270 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7ec40b2880 con 0x7f7ec415bde0 2023-07-21T22:57:07.050 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:07.017+0000 7f3fbac3a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:57:07.090 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:07.063+0000 7fec1deef180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:57:07.150 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:07.123+0000 7fec1deef180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:57:07.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.129+0000 7f7eabfff640 1 -- 172.21.15.6:0/579756270 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 88) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f7ebc0ec700 con 0x7f7ec415bde0 2023-07-21T22:57:07.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.129+0000 7f7eabfff640 1 -- 172.21.15.6:0/579756270 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f7eb00664c0 msgr2=0x7f7eb0068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:07.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.129+0000 7f7eabfff640 1 --2- 172.21.15.6:0/579756270 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f7eb00664c0 0x7f7eb0068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.169+0000 7f7ec9a9c640 1 -- 172.21.15.6:0/579756270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ec40b2840 con 0x7f7ec415bde0 2023-07-21T22:57:07.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.169+0000 7f7eabfff640 1 -- 172.21.15.6:0/579756270 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v180) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ebc0c4d00 con 0x7f7ec415bde0 2023-07-21T22:57:07.204 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:57:07.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.169+0000 7f7ec9a9c640 1 -- 172.21.15.6:0/579756270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ec415bde0 msgr2=0x7f7ec40caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:07.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.169+0000 7f7ec9a9c640 1 --2- 172.21.15.6:0/579756270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ec415bde0 0x7f7ec40caf00 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc009d90 tx=0x7f7ebc0196f0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.169+0000 7f7ec9a9c640 1 -- 172.21.15.6:0/579756270 shutdown_connections 2023-07-21T22:57:07.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.169+0000 7f7ec9a9c640 1 --2- 172.21.15.6:0/579756270 >> [v2:172.21.15.161:6832/2516914157,v1:172.21.15.161:6833/2516914157] conn(0x7f7eb00664c0 0x7f7eb0068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.169+0000 7f7ec9a9c640 1 --2- 172.21.15.6:0/579756270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ec415bde0 0x7f7ec40caf00 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.169+0000 7f7ec9a9c640 1 --2- 172.21.15.6:0/579756270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7ec40d2fc0 0x7f7ec41532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.169+0000 7f7ec9a9c640 1 --2- 172.21.15.6:0/579756270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ec40d2300 0x7f7ec40b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.169+0000 7f7ec9a9c640 1 -- 172.21.15.6:0/579756270 >> 172.21.15.6:0/579756270 conn(0x7f7ec40659d0 msgr2=0x7f7ec40b7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:07.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.169+0000 7f7ec9a9c640 1 -- 172.21.15.6:0/579756270 shutdown_connections 2023-07-21T22:57:07.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.169+0000 7f7ec9a9c640 1 -- 172.21.15.6:0/579756270 wait complete. 2023-07-21T22:57:07.227 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:57:07.236 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:07.207+0000 7feba9871640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:07.236 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:07.207+0000 7feba9871640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:07.236 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:07.207+0000 7feba9871640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:07.236 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:07.207+0000 7feba9871640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:07.237 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:07.207+0000 7feba9871640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:07.237 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:07.211+0000 7feba606a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:07.237 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:07.211+0000 7feba606a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:07.237 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:07.211+0000 7feba606a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:07.238 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:07.211+0000 7feba606a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:07.238 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:07.211+0000 7feba606a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:07.355 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:07.321+0000 7f3fbac3a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:57:07.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.345+0000 7f132cf1e640 1 Processor -- start 2023-07-21T22:57:07.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.345+0000 7f132cf1e640 1 -- start start 2023-07-21T22:57:07.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.349+0000 7f132cf1e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f132815bde0 0x7f13280d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:07.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.349+0000 7f132cf1e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f13280d2300 0x7f13280d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:07.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.349+0000 7f132cf1e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13280b04c0 con 0x7f13280d2fc0 2023-07-21T22:57:07.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.349+0000 7f132cf1e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13280d2ce0 con 0x7f13280d2300 2023-07-21T22:57:07.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.349+0000 7f132cf1e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132815c1b0 con 0x7f132815bde0 2023-07-21T22:57:07.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.349+0000 7f132659c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f132815bde0 0x7f13280d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:07.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.349+0000 7f1325d9b640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f13280d2fc0 0x7f13280b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:39792/0 (socket says 172.21.15.6:39792) 2023-07-21T22:57:07.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.349+0000 7f1325d9b640 1 -- 172.21.15.6:0/2620289792 learned_addr learned my addr 172.21.15.6:0/2620289792 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:07.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.349+0000 7f1326d9d640 1 --2- 172.21.15.6:0/2620289792 >> v2:172.21.15.6:3300/0 conn(0x7f13280d2300 0x7f13280d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:07.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.349+0000 7f132559a640 1 -- 172.21.15.6:0/2620289792 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4181431956 0 0) 0x7f13280b04c0 con 0x7f13280d2fc0 2023-07-21T22:57:07.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.349+0000 7f132659c640 1 -- 172.21.15.6:0/2620289792 >> v2:172.21.15.6:3300/0 conn(0x7f13280d2300 msgr2=0x7f13280d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:07.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.349+0000 7f132659c640 1 --2- 172.21.15.6:0/2620289792 >> v2:172.21.15.6:3300/0 conn(0x7f13280d2300 0x7f13280d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.349+0000 7f132659c640 1 -- 172.21.15.6:0/2620289792 >> v1:172.21.15.161:6789/0 conn(0x7f13280d2fc0 legacy=0x7f13280b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:07.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.349+0000 7f132659c640 1 -- 172.21.15.6:0/2620289792 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13280b1060 con 0x7f132815bde0 2023-07-21T22:57:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.353+0000 7f132659c640 1 --2- 172.21.15.6:0/2620289792 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f132815bde0 0x7f13280d0270 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f13180097a0 tx=0x7f131801c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c0ea2cb5989f23a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.353+0000 7f132559a640 1 -- 172.21.15.6:0/2620289792 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13180ab600 con 0x7f132815bde0 2023-07-21T22:57:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.353+0000 7f132559a640 1 -- 172.21.15.6:0/2620289792 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13180a7050 con 0x7f132815bde0 2023-07-21T22:57:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.353+0000 7f132559a640 1 -- 172.21.15.6:0/2620289792 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13180ab980 con 0x7f132815bde0 2023-07-21T22:57:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.353+0000 7f132cf1e640 1 -- 172.21.15.6:0/2620289792 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f132815bde0 msgr2=0x7f13280d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:07.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.353+0000 7f132cf1e640 1 --2- 172.21.15.6:0/2620289792 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f132815bde0 0x7f13280d0270 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f13180097a0 tx=0x7f131801c460 comp rx=0 tx=0).stop 2023-07-21T22:57:07.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.353+0000 7f132cf1e640 1 -- 172.21.15.6:0/2620289792 shutdown_connections 2023-07-21T22:57:07.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.353+0000 7f132cf1e640 1 --2- 172.21.15.6:0/2620289792 >> v2:172.21.15.6:3300/0 conn(0x7f13280d2300 0x7f13280d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.353+0000 7f132cf1e640 1 --2- 172.21.15.6:0/2620289792 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f132815bde0 0x7f13280d0270 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.353+0000 7f132cf1e640 1 -- 172.21.15.6:0/2620289792 >> 172.21.15.6:0/2620289792 conn(0x7f13280659d0 msgr2=0x7f132809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:07.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.353+0000 7f132cf1e640 1 -- 172.21.15.6:0/2620289792 shutdown_connections 2023-07-21T22:57:07.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.353+0000 7f132cf1e640 1 -- 172.21.15.6:0/2620289792 wait complete. 2023-07-21T22:57:07.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f132cf1e640 1 Processor -- start 2023-07-21T22:57:07.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f132cf1e640 1 -- start start 2023-07-21T22:57:07.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f132cf1e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13280d2300 0x7f13280b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:07.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f132cf1e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13280d2fc0 0x7f13281f7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:07.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f132cf1e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f132815bde0 0x7f132814c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:07.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f132cf1e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13280b2bb0 con 0x7f13280d2fc0 2023-07-21T22:57:07.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f132cf1e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13281f84e0 con 0x7f13280d2300 2023-07-21T22:57:07.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f132cf1e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13281527a0 con 0x7f132815bde0 2023-07-21T22:57:07.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f1325d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13280d2fc0 0x7f13281f7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:07.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f132659c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13280d2300 0x7f13280b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:07.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f1325d9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13280d2fc0 0x7f13281f7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41932/0 (socket says 172.21.15.6:41932) 2023-07-21T22:57:07.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f1326d9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f132815bde0 0x7f132814c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:07.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f1325d9b640 1 -- 172.21.15.6:0/4235832856 learned_addr learned my addr 172.21.15.6:0/4235832856 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:07.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f132659c640 1 -- 172.21.15.6:0/4235832856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f132815bde0 msgr2=0x7f132814c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:07.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f132659c640 1 --2- 172.21.15.6:0/4235832856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f132815bde0 0x7f132814c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f132659c640 1 -- 172.21.15.6:0/4235832856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13280d2fc0 msgr2=0x7f13281f7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:07.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f132659c640 1 --2- 172.21.15.6:0/4235832856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13280d2fc0 0x7f13281f7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f132659c640 1 -- 172.21.15.6:0/4235832856 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13180093b0 con 0x7f13280d2300 2023-07-21T22:57:07.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f1325d9b640 1 --2- 172.21.15.6:0/4235832856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13280d2fc0 0x7f13281f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:07.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f132659c640 1 --2- 172.21.15.6:0/4235832856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13280d2300 0x7f13280b2670 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f13180ab000 tx=0x7f1318019200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:07.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f1316ffd640 1 -- 172.21.15.6:0/4235832856 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1318005ba0 con 0x7f13280d2300 2023-07-21T22:57:07.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f1316ffd640 1 -- 172.21.15.6:0/4235832856 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1318005d20 con 0x7f13280d2300 2023-07-21T22:57:07.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f1316ffd640 1 -- 172.21.15.6:0/4235832856 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1318006270 con 0x7f13280d2300 2023-07-21T22:57:07.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f132cf1e640 1 -- 172.21.15.6:0/4235832856 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1328152a80 con 0x7f13280d2300 2023-07-21T22:57:07.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.357+0000 7f132cf1e640 1 -- 172.21.15.6:0/4235832856 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1328153040 con 0x7f13280d2300 2023-07-21T22:57:07.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.361+0000 7f132cf1e640 1 -- 172.21.15.6:0/4235832856 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13280b6670 con 0x7f13280d2300 2023-07-21T22:57:07.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.361+0000 7f1316ffd640 1 -- 172.21.15.6:0/4235832856 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 88) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f13180b2040 con 0x7f13280d2300 2023-07-21T22:57:07.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.361+0000 7f1316ffd640 1 -- 172.21.15.6:0/4235832856 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6994+0+0 (secure 0 0 0) 0x7f131811cd60 con 0x7f13280d2300 2023-07-21T22:57:07.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.365+0000 7f1316ffd640 1 -- 172.21.15.6:0/4235832856 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f13180ea240 con 0x7f13280d2300 2023-07-21T22:57:07.422 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:07.389+0000 7f3fbac3a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:57:07.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.525+0000 7f132cf1e640 1 -- 172.21.15.6:0/4235832856 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f13280678d0 con 0x7f13280d2300 2023-07-21T22:57:07.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.525+0000 7f1316ffd640 1 -- 172.21.15.6:0/4235832856 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v180) v1 ==== 92+0+10 (secure 0 0 0) 0x7f13180b0070 con 0x7f13280d2300 2023-07-21T22:57:07.560 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:57:07.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.529+0000 7f132cf1e640 1 -- 172.21.15.6:0/4235832856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13280d2300 msgr2=0x7f13280b2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:07.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.529+0000 7f132cf1e640 1 --2- 172.21.15.6:0/4235832856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13280d2300 0x7f13280b2670 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f13180ab000 tx=0x7f1318019200 comp rx=0 tx=0).stop 2023-07-21T22:57:07.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.529+0000 7f132cf1e640 1 -- 172.21.15.6:0/4235832856 shutdown_connections 2023-07-21T22:57:07.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.529+0000 7f132cf1e640 1 --2- 172.21.15.6:0/4235832856 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f132815bde0 0x7f132814c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.529+0000 7f132cf1e640 1 --2- 172.21.15.6:0/4235832856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13280d2fc0 0x7f13281f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.529+0000 7f132cf1e640 1 --2- 172.21.15.6:0/4235832856 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f13280d2300 0x7f13280b2670 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.529+0000 7f132cf1e640 1 -- 172.21.15.6:0/4235832856 >> 172.21.15.6:0/4235832856 conn(0x7f13280659d0 msgr2=0x7f13280aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:07.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.529+0000 7f132cf1e640 1 -- 172.21.15.6:0/4235832856 shutdown_connections 2023-07-21T22:57:07.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.529+0000 7f132cf1e640 1 -- 172.21.15.6:0/4235832856 wait complete. 2023-07-21T22:57:07.581 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:57:07.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.693+0000 7fdb85974640 1 Processor -- start 2023-07-21T22:57:07.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.693+0000 7fdb85974640 1 -- start start 2023-07-21T22:57:07.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.693+0000 7fdb85974640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdb80069430 0x7fdb80069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:07.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.693+0000 7fdb85974640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb80159d70 con 0x7fdb80070f30 2023-07-21T22:57:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.693+0000 7fdb85974640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb80069d40 con 0x7fdb800af2b0 2023-07-21T22:57:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.693+0000 7fdb85974640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb800c9c60 con 0x7fdb80069430 2023-07-21T22:57:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.693+0000 7fdb77fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdb80070f30 0x7fdb800ad6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49258/0 (socket says 172.21.15.6:49258) 2023-07-21T22:57:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.693+0000 7fdb77fff640 1 -- 172.21.15.6:0/1439729747 learned_addr learned my addr 172.21.15.6:0/1439729747 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:07.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb7effd640 1 --2- 172.21.15.6:0/1439729747 >> v2:172.21.15.161:3300/0 conn(0x7fdb80069430 0x7fdb80069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:07.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb7e7fc640 1 -- 172.21.15.6:0/1439729747 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255560016 0 0) 0x7fdb68001120 con 0x7fdb80070f30 2023-07-21T22:57:07.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb7e7fc640 1 -- 172.21.15.6:0/1439729747 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb6c003530 con 0x7fdb80070f30 2023-07-21T22:57:07.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb7e7fc640 1 -- 172.21.15.6:0/1439729747 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2745551835 0 0) 0x7fdb6c003530 con 0x7fdb80070f30 2023-07-21T22:57:07.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb7e7fc640 1 -- 172.21.15.6:0/1439729747 >> v2:172.21.15.161:3300/0 conn(0x7fdb80069430 msgr2=0x7fdb80069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:07.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb7e7fc640 1 --2- 172.21.15.6:0/1439729747 >> v2:172.21.15.161:3300/0 conn(0x7fdb80069430 0x7fdb80069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb7e7fc640 1 -- 172.21.15.6:0/1439729747 >> v1:172.21.15.161:6789/0 conn(0x7fdb800af2b0 legacy=0x7fdb8015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb7e7fc640 1 -- 172.21.15.6:0/1439729747 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb800c9f40 con 0x7fdb80070f30 2023-07-21T22:57:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb7e7fc640 1 -- 172.21.15.6:0/1439729747 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fdb68001810 con 0x7fdb80070f30 2023-07-21T22:57:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb7e7fc640 1 -- 172.21.15.6:0/1439729747 >> v1:172.21.15.6:6789/0 conn(0x7fdb80070f30 legacy=0x7fdb800ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb7e7fc640 1 --2- 172.21.15.6:0/1439729747 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb6c003980 0x7fdb6c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb7e7fc640 1 --2- 172.21.15.6:0/1439729747 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb6c0047d0 0x7fdb6c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb7e7fc640 1 --2- 172.21.15.6:0/1439729747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6c005180 0x7fdb6c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb7e7fc640 1 -- 172.21.15.6:0/1439729747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800c9c60 con 0x7fdb6c005180 2023-07-21T22:57:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb7e7fc640 1 -- 172.21.15.6:0/1439729747 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c00c000 con 0x7fdb6c003980 2023-07-21T22:57:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb7e7fc640 1 -- 172.21.15.6:0/1439729747 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c00c1c0 con 0x7fdb6c0047d0 2023-07-21T22:57:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb7f7fe640 1 --2- 172.21.15.6:0/1439729747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6c005180 0x7fdb6c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb77fff640 1 --2- 172.21.15.6:0/1439729747 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb6c0047d0 0x7fdb6c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb7effd640 1 --2- 172.21.15.6:0/1439729747 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb6c003980 0x7fdb6c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb77fff640 1 -- 172.21.15.6:0/1439729747 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb6c003980 msgr2=0x7fdb6c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb77fff640 1 --2- 172.21.15.6:0/1439729747 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb6c003980 0x7fdb6c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb77fff640 1 -- 172.21.15.6:0/1439729747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6c005180 msgr2=0x7fdb6c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb77fff640 1 --2- 172.21.15.6:0/1439729747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6c005180 0x7fdb6c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb77fff640 1 -- 172.21.15.6:0/1439729747 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6c003530 con 0x7fdb6c0047d0 2023-07-21T22:57:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.697+0000 7fdb7f7fe640 1 -- 172.21.15.6:0/1439729747 reap_dead start 2023-07-21T22:57:07.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.701+0000 7fdb77fff640 1 --2- 172.21.15.6:0/1439729747 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb6c0047d0 0x7fdb6c004c40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800c240 tx=0x7fdb6801cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49721a411e6c2bb9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:07.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.701+0000 7fdb7e7fc640 1 -- 172.21.15.6:0/1439729747 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb68005ae0 con 0x7fdb6c0047d0 2023-07-21T22:57:07.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.701+0000 7fdb7e7fc640 1 -- 172.21.15.6:0/1439729747 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb68005c60 con 0x7fdb6c0047d0 2023-07-21T22:57:07.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.701+0000 7fdb7e7fc640 1 -- 172.21.15.6:0/1439729747 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb680a5aa0 con 0x7fdb6c0047d0 2023-07-21T22:57:07.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.701+0000 7fdb85974640 1 -- 172.21.15.6:0/1439729747 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb6c0047d0 msgr2=0x7fdb6c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:07.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.701+0000 7fdb85974640 1 --2- 172.21.15.6:0/1439729747 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb6c0047d0 0x7fdb6c004c40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800c240 tx=0x7fdb6801cc40 comp rx=0 tx=0).stop 2023-07-21T22:57:07.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.701+0000 7fdb85974640 1 -- 172.21.15.6:0/1439729747 shutdown_connections 2023-07-21T22:57:07.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.701+0000 7fdb85974640 1 --2- 172.21.15.6:0/1439729747 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb6c0047d0 0x7fdb6c004c40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.701+0000 7fdb85974640 1 -- 172.21.15.6:0/1439729747 >> 172.21.15.6:0/1439729747 conn(0x7fdb800cde90 msgr2=0x7fdb800ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:07.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.701+0000 7fdb85974640 1 -- 172.21.15.6:0/1439729747 shutdown_connections 2023-07-21T22:57:07.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.701+0000 7fdb85974640 1 -- 172.21.15.6:0/1439729747 wait complete. 2023-07-21T22:57:07.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.701+0000 7fdb85974640 1 Processor -- start 2023-07-21T22:57:07.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.701+0000 7fdb85974640 1 -- start start 2023-07-21T22:57:07.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.701+0000 7fdb85974640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6c0047d0 0x7fdb801525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:07.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.701+0000 7fdb85974640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb8014faf0 0x7fdb801417b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:07.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.701+0000 7fdb85974640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb801504f0 0x7fdb80150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:07.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.701+0000 7fdb85974640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800c7410 con 0x7fdb6c0047d0 2023-07-21T22:57:07.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.701+0000 7fdb85974640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb80141cf0 con 0x7fdb8014faf0 2023-07-21T22:57:07.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.701+0000 7fdb85974640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb80150e60 con 0x7fdb801504f0 2023-07-21T22:57:07.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.705+0000 7fdb7effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6c0047d0 0x7fdb801525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:07.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.705+0000 7fdb7effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6c0047d0 0x7fdb801525a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39578/0 (socket says 172.21.15.6:39578) 2023-07-21T22:57:07.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.705+0000 7fdb7effd640 1 -- 172.21.15.6:0/2295384539 learned_addr learned my addr 172.21.15.6:0/2295384539 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:07.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.705+0000 7fdb77fff640 1 --2- 172.21.15.6:0/2295384539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb8014faf0 0x7fdb801417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:07.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.705+0000 7fdb7f7fe640 1 --2- 172.21.15.6:0/2295384539 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb801504f0 0x7fdb80150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:07.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.705+0000 7fdb7effd640 1 -- 172.21.15.6:0/2295384539 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb801504f0 msgr2=0x7fdb80150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:07.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.705+0000 7fdb7effd640 1 --2- 172.21.15.6:0/2295384539 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb801504f0 0x7fdb80150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.705+0000 7fdb7effd640 1 -- 172.21.15.6:0/2295384539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb8014faf0 msgr2=0x7fdb801417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:07.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.705+0000 7fdb7effd640 1 --2- 172.21.15.6:0/2295384539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb8014faf0 0x7fdb801417b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.705+0000 7fdb7effd640 1 -- 172.21.15.6:0/2295384539 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb801500b0 con 0x7fdb6c0047d0 2023-07-21T22:57:07.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.705+0000 7fdb7f7fe640 1 --2- 172.21.15.6:0/2295384539 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb801504f0 0x7fdb80150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:07.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.705+0000 7fdb7effd640 1 --2- 172.21.15.6:0/2295384539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6c0047d0 0x7fdb801525a0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fdb70011930 tx=0x7fdb70011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:07.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.705+0000 7fdb7cff9640 1 -- 172.21.15.6:0/2295384539 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70004240 con 0x7fdb6c0047d0 2023-07-21T22:57:07.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.705+0000 7fdb7cff9640 1 -- 172.21.15.6:0/2295384539 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb700043a0 con 0x7fdb6c0047d0 2023-07-21T22:57:07.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.705+0000 7fdb7cff9640 1 -- 172.21.15.6:0/2295384539 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70003860 con 0x7fdb6c0047d0 2023-07-21T22:57:07.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.705+0000 7fdb85974640 1 -- 172.21.15.6:0/2295384539 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb800c6ae0 con 0x7fdb6c0047d0 2023-07-21T22:57:07.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.705+0000 7fdb85974640 1 -- 172.21.15.6:0/2295384539 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb800c70a0 con 0x7fdb6c0047d0 2023-07-21T22:57:07.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.705+0000 7fdb85974640 1 -- 172.21.15.6:0/2295384539 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb800678d0 con 0x7fdb6c0047d0 2023-07-21T22:57:07.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.705+0000 7fdb7cff9640 1 -- 172.21.15.6:0/2295384539 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 88) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fdb700039c0 con 0x7fdb6c0047d0 2023-07-21T22:57:07.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.709+0000 7fdb7cff9640 1 -- 172.21.15.6:0/2295384539 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6994+0+0 (secure 0 0 0) 0x7fdb70083f00 con 0x7fdb6c0047d0 2023-07-21T22:57:07.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.709+0000 7fdb7cff9640 1 -- 172.21.15.6:0/2295384539 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdb70051330 con 0x7fdb6c0047d0 2023-07-21T22:57:07.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.865+0000 7fdb85974640 1 -- 172.21.15.6:0/2295384539 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdb800b3df0 con 0x7fdb6c0047d0 2023-07-21T22:57:07.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.865+0000 7fdb7cff9640 1 -- 172.21.15.6:0/2295384539 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v180) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdb70023020 con 0x7fdb6c0047d0 2023-07-21T22:57:07.900 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:57:07.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.869+0000 7fdb85974640 1 -- 172.21.15.6:0/2295384539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6c0047d0 msgr2=0x7fdb801525a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:07.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.869+0000 7fdb85974640 1 --2- 172.21.15.6:0/2295384539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6c0047d0 0x7fdb801525a0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fdb70011930 tx=0x7fdb70011a20 comp rx=0 tx=0).stop 2023-07-21T22:57:07.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.869+0000 7fdb85974640 1 -- 172.21.15.6:0/2295384539 shutdown_connections 2023-07-21T22:57:07.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.869+0000 7fdb85974640 1 --2- 172.21.15.6:0/2295384539 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdb801504f0 0x7fdb80150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.869+0000 7fdb85974640 1 --2- 172.21.15.6:0/2295384539 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb8014faf0 0x7fdb801417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.869+0000 7fdb85974640 1 --2- 172.21.15.6:0/2295384539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb6c0047d0 0x7fdb801525a0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:07.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.869+0000 7fdb85974640 1 -- 172.21.15.6:0/2295384539 >> 172.21.15.6:0/2295384539 conn(0x7fdb800cde90 msgr2=0x7fdb800cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:07.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.869+0000 7fdb85974640 1 -- 172.21.15.6:0/2295384539 shutdown_connections 2023-07-21T22:57:07.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:07.869+0000 7fdb85974640 1 -- 172.21.15.6:0/2295384539 wait complete. 2023-07-21T22:57:07.921 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:57:08.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.033+0000 7fb2ab3a2640 1 Processor -- start 2023-07-21T22:57:08.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.033+0000 7fb2ab3a2640 1 -- start start 2023-07-21T22:57:08.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.037+0000 7fb2ab3a2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2a40af8b0 0x7fb2a40afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:08.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.037+0000 7fb2ab3a2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb2a40c8db0 0x7fb2a40c9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:08.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.037+0000 7fb2ab3a2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a40703a0 con 0x7fb2a415c2a0 2023-07-21T22:57:08.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.037+0000 7fb2ab3a2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a415ce20 con 0x7fb2a40c8db0 2023-07-21T22:57:08.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.037+0000 7fb2ab3a2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a40b01c0 con 0x7fb2a40af8b0 2023-07-21T22:57:08.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.037+0000 7fb2aaba1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb2a40c8db0 0x7fb2a40c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:08.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.037+0000 7fb2aaba1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb2a40c8db0 0x7fb2a40c9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39580/0 (socket says 172.21.15.6:39580) 2023-07-21T22:57:08.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.037+0000 7fb2aaba1640 1 -- 172.21.15.6:0/3433848759 learned_addr learned my addr 172.21.15.6:0/3433848759 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:08.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.037+0000 7fb2aa3a0640 1 --2- 172.21.15.6:0/3433848759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2a40af8b0 0x7fb2a40afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:08.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.037+0000 7fb2aaba1640 1 -- 172.21.15.6:0/3433848759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2a40af8b0 msgr2=0x7fb2a40afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:08.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.037+0000 7fb2aaba1640 1 --2- 172.21.15.6:0/3433848759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2a40af8b0 0x7fb2a40afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.037+0000 7fb2aaba1640 1 -- 172.21.15.6:0/3433848759 >> v1:172.21.15.161:6789/0 conn(0x7fb2a415c2a0 legacy=0x7fb2a415c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:08.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.037+0000 7fb2aaba1640 1 -- 172.21.15.6:0/3433848759 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a415d010 con 0x7fb2a40c8db0 2023-07-21T22:57:08.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.041+0000 7fb2aaba1640 1 --2- 172.21.15.6:0/3433848759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a40c8db0 0x7fb2a40c9230 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fb29c009e50 tx=0x7fb29c01eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f8ed71c9785934 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.041+0000 7fb2a939e640 1 -- 172.21.15.6:0/3433848759 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c0a7a60 con 0x7fb2a40c8db0 2023-07-21T22:57:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.041+0000 7fb2a939e640 1 -- 172.21.15.6:0/3433848759 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29c0a7bc0 con 0x7fb2a40c8db0 2023-07-21T22:57:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.041+0000 7fb2a939e640 1 -- 172.21.15.6:0/3433848759 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c0af3f0 con 0x7fb2a40c8db0 2023-07-21T22:57:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.041+0000 7fb2ab3a2640 1 -- 172.21.15.6:0/3433848759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a40c8db0 msgr2=0x7fb2a40c9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.041+0000 7fb2ab3a2640 1 --2- 172.21.15.6:0/3433848759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a40c8db0 0x7fb2a40c9230 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fb29c009e50 tx=0x7fb29c01eb90 comp rx=0 tx=0).stop 2023-07-21T22:57:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.041+0000 7fb2ab3a2640 1 -- 172.21.15.6:0/3433848759 shutdown_connections 2023-07-21T22:57:08.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.041+0000 7fb2ab3a2640 1 --2- 172.21.15.6:0/3433848759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a40c8db0 0x7fb2a40c9230 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.041+0000 7fb2ab3a2640 1 --2- 172.21.15.6:0/3433848759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2a40af8b0 0x7fb2a40afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.041+0000 7fb2ab3a2640 1 -- 172.21.15.6:0/3433848759 >> 172.21.15.6:0/3433848759 conn(0x7fb2a40ca8b0 msgr2=0x7fb2a40cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:08.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.041+0000 7fb2ab3a2640 1 -- 172.21.15.6:0/3433848759 shutdown_connections 2023-07-21T22:57:08.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.041+0000 7fb2ab3a2640 1 -- 172.21.15.6:0/3433848759 wait complete. 2023-07-21T22:57:08.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.041+0000 7fb2ab3a2640 1 Processor -- start 2023-07-21T22:57:08.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.041+0000 7fb2ab3a2640 1 -- start start 2023-07-21T22:57:08.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb2ab3a2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a40af8b0 0x7fb2a406c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb2ab3a2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a40c8db0 0x7fb2a40c1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb2ab3a2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2a415c2a0 0x7fb2a41572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb2ab3a2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a4144d30 con 0x7fb2a40c8db0 2023-07-21T22:57:08.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb2ab3a2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a406ca00 con 0x7fb2a40af8b0 2023-07-21T22:57:08.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb2ab3a2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a406d3d0 con 0x7fb2a415c2a0 2023-07-21T22:57:08.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb2a9b9f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a40c8db0 0x7fb2a40c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:08.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb2aa3a0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a40af8b0 0x7fb2a406c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:08.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb2a9b9f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a40c8db0 0x7fb2a40c1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39588/0 (socket says 172.21.15.6:39588) 2023-07-21T22:57:08.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb2a9b9f640 1 -- 172.21.15.6:0/4204990268 learned_addr learned my addr 172.21.15.6:0/4204990268 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:08.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb2aaba1640 1 --2- 172.21.15.6:0/4204990268 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2a415c2a0 0x7fb2a41572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:08.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb2a9b9f640 1 -- 172.21.15.6:0/4204990268 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2a415c2a0 msgr2=0x7fb2a41572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:08.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb2a9b9f640 1 --2- 172.21.15.6:0/4204990268 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2a415c2a0 0x7fb2a41572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb2a9b9f640 1 -- 172.21.15.6:0/4204990268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a40af8b0 msgr2=0x7fb2a406c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:08.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb2a9b9f640 1 --2- 172.21.15.6:0/4204990268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a40af8b0 0x7fb2a406c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb2a9b9f640 1 -- 172.21.15.6:0/4204990268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29c009b30 con 0x7fb2a40c8db0 2023-07-21T22:57:08.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb2a9b9f640 1 --2- 172.21.15.6:0/4204990268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a40c8db0 0x7fb2a40c1960 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7fb29400c530 tx=0x7fb29400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:08.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb29affd640 1 -- 172.21.15.6:0/4204990268 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294005220 con 0x7fb2a40c8db0 2023-07-21T22:57:08.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb29affd640 1 -- 172.21.15.6:0/4204990268 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb294005380 con 0x7fb2a40c8db0 2023-07-21T22:57:08.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb29affd640 1 -- 172.21.15.6:0/4204990268 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294007270 con 0x7fb2a40c8db0 2023-07-21T22:57:08.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb2ab3a2640 1 -- 172.21.15.6:0/4204990268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a406cf40 con 0x7fb2a40c8db0 2023-07-21T22:57:08.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb2ab3a2640 1 -- 172.21.15.6:0/4204990268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a40b1810 con 0x7fb2a40c8db0 2023-07-21T22:57:08.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.045+0000 7fb2ab3a2640 1 -- 172.21.15.6:0/4204990268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a406d0d0 con 0x7fb2a40c8db0 2023-07-21T22:57:08.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.049+0000 7fb29affd640 1 -- 172.21.15.6:0/4204990268 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 88) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fb2940073d0 con 0x7fb2a40c8db0 2023-07-21T22:57:08.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.049+0000 7fb29affd640 1 -- 172.21.15.6:0/4204990268 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6994+0+0 (secure 0 0 0) 0x7fb294083140 con 0x7fb2a40c8db0 2023-07-21T22:57:08.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.053+0000 7fb29affd640 1 -- 172.21.15.6:0/4204990268 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb294050710 con 0x7fb2a40c8db0 2023-07-21T22:57:08.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.133+0000 7fb29affd640 1 -- 172.21.15.6:0/4204990268 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 89) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fb2940501c0 con 0x7fb2a40c8db0 2023-07-21T22:57:08.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.133+0000 7fb29affd640 1 --2- 172.21.15.6:0/4204990268 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fb28806c340 0x7fb28806e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:08.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.133+0000 7fb2aa3a0640 1 --2- 172.21.15.6:0/4204990268 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fb28806c340 0x7fb28806e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:08.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.141+0000 7fb2aa3a0640 1 --2- 172.21.15.6:0/4204990268 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fb28806c340 0x7fb28806e720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0009ac0 tx=0x7fb2a0009190 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:08.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.213+0000 7fb2ab3a2640 1 -- 172.21.15.6:0/4204990268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2a4070380 con 0x7fb2a40c8db0 2023-07-21T22:57:08.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.213+0000 7fb29affd640 1 -- 172.21.15.6:0/4204990268 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v180) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb2940810b0 con 0x7fb2a40c8db0 2023-07-21T22:57:08.247 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:57:08.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.213+0000 7fb2ab3a2640 1 -- 172.21.15.6:0/4204990268 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fb28806c340 msgr2=0x7fb28806e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:08.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.213+0000 7fb2ab3a2640 1 --2- 172.21.15.6:0/4204990268 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fb28806c340 0x7fb28806e720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0009ac0 tx=0x7fb2a0009190 comp rx=0 tx=0).stop 2023-07-21T22:57:08.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.213+0000 7fb2ab3a2640 1 -- 172.21.15.6:0/4204990268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a40c8db0 msgr2=0x7fb2a40c1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:08.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.213+0000 7fb2ab3a2640 1 --2- 172.21.15.6:0/4204990268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a40c8db0 0x7fb2a40c1960 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7fb29400c530 tx=0x7fb29400c9f0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.213+0000 7fb2ab3a2640 1 -- 172.21.15.6:0/4204990268 shutdown_connections 2023-07-21T22:57:08.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.213+0000 7fb2ab3a2640 1 --2- 172.21.15.6:0/4204990268 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fb28806c340 0x7fb28806e720 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.213+0000 7fb2ab3a2640 1 --2- 172.21.15.6:0/4204990268 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2a415c2a0 0x7fb2a41572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.213+0000 7fb2ab3a2640 1 --2- 172.21.15.6:0/4204990268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2a40c8db0 0x7fb2a40c1960 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.213+0000 7fb2ab3a2640 1 --2- 172.21.15.6:0/4204990268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a40af8b0 0x7fb2a406c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.213+0000 7fb2ab3a2640 1 -- 172.21.15.6:0/4204990268 >> 172.21.15.6:0/4204990268 conn(0x7fb2a40ca8b0 msgr2=0x7fb2a415b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:08.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.213+0000 7fb2ab3a2640 1 -- 172.21.15.6:0/4204990268 shutdown_connections 2023-07-21T22:57:08.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.213+0000 7fb2ab3a2640 1 -- 172.21.15.6:0/4204990268 wait complete. 2023-07-21T22:57:08.269 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:57:08.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.381+0000 7efdcd87b640 1 Processor -- start 2023-07-21T22:57:08.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.381+0000 7efdcd87b640 1 -- start start 2023-07-21T22:57:08.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.381+0000 7efdcd87b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdc815b7c0 0x7efdc806b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:08.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.381+0000 7efdcd87b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efdc806b720 0x7efdc80ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:08.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.381+0000 7efdcd87b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc806f900 con 0x7efdc80cb780 2023-07-21T22:57:08.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.381+0000 7efdcd87b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc80cdce0 con 0x7efdc806b720 2023-07-21T22:57:08.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.381+0000 7efdcd87b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc80ca830 con 0x7efdc815b7c0 2023-07-21T22:57:08.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.381+0000 7efdc77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efdc806b720 0x7efdc80ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:08.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.381+0000 7efdbffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efdc80cb780 0x7efdc806fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49272/0 (socket says 172.21.15.6:49272) 2023-07-21T22:57:08.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.381+0000 7efdbffff640 1 -- 172.21.15.6:0/3132613086 learned_addr learned my addr 172.21.15.6:0/3132613086 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:08.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.381+0000 7efdc6ffd640 1 --2- 172.21.15.6:0/3132613086 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdc815b7c0 0x7efdc806b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:08.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.381+0000 7efdc77fe640 1 -- 172.21.15.6:0/3132613086 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdc815b7c0 msgr2=0x7efdc806b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:08.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.381+0000 7efdc77fe640 1 --2- 172.21.15.6:0/3132613086 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdc815b7c0 0x7efdc806b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.385+0000 7efdc77fe640 1 -- 172.21.15.6:0/3132613086 >> v1:172.21.15.6:6789/0 conn(0x7efdc80cb780 legacy=0x7efdc806fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:08.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.385+0000 7efdc77fe640 1 -- 172.21.15.6:0/3132613086 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc806bb10 con 0x7efdc806b720 2023-07-21T22:57:08.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.385+0000 7efdc77fe640 1 --2- 172.21.15.6:0/3132613086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdc806b720 0x7efdc80ccd40 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009d90 tx=0x7efdc001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203fe51484b259ce server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:08.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.385+0000 7efdc67fc640 1 -- 172.21.15.6:0/3132613086 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc00a5860 con 0x7efdc806b720 2023-07-21T22:57:08.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.385+0000 7efdc67fc640 1 -- 172.21.15.6:0/3132613086 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc00a59c0 con 0x7efdc806b720 2023-07-21T22:57:08.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.385+0000 7efdc67fc640 1 -- 172.21.15.6:0/3132613086 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc00a5d50 con 0x7efdc806b720 2023-07-21T22:57:08.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.385+0000 7efdcd87b640 1 -- 172.21.15.6:0/3132613086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdc806b720 msgr2=0x7efdc80ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:08.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.385+0000 7efdcd87b640 1 --2- 172.21.15.6:0/3132613086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdc806b720 0x7efdc80ccd40 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009d90 tx=0x7efdc001c930 comp rx=0 tx=0).stop 2023-07-21T22:57:08.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.385+0000 7efdcd87b640 1 -- 172.21.15.6:0/3132613086 shutdown_connections 2023-07-21T22:57:08.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.385+0000 7efdcd87b640 1 --2- 172.21.15.6:0/3132613086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdc806b720 0x7efdc80ccd40 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.385+0000 7efdcd87b640 1 --2- 172.21.15.6:0/3132613086 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdc815b7c0 0x7efdc806b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.385+0000 7efdcd87b640 1 -- 172.21.15.6:0/3132613086 >> 172.21.15.6:0/3132613086 conn(0x7efdc80afcf0 msgr2=0x7efdc80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:08.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.385+0000 7efdcd87b640 1 -- 172.21.15.6:0/3132613086 shutdown_connections 2023-07-21T22:57:08.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.385+0000 7efdcd87b640 1 -- 172.21.15.6:0/3132613086 wait complete. 2023-07-21T22:57:08.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdcd87b640 1 Processor -- start 2023-07-21T22:57:08.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdcd87b640 1 -- start start 2023-07-21T22:57:08.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdcd87b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdc806b720 0x7efdc80b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdcd87b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdc815b7c0 0x7efdc80b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdcd87b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdc80c7240 0x7efdc80adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdcd87b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc80b2350 con 0x7efdc80c7240 2023-07-21T22:57:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdcd87b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc80b16d0 con 0x7efdc815b7c0 2023-07-21T22:57:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdcd87b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc80b19b0 con 0x7efdc806b720 2023-07-21T22:57:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdc77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdc80c7240 0x7efdc80adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:08.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdc77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdc80c7240 0x7efdc80adf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39614/0 (socket says 172.21.15.6:39614) 2023-07-21T22:57:08.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdc77fe640 1 -- 172.21.15.6:0/3491326088 learned_addr learned my addr 172.21.15.6:0/3491326088 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:08.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdc6ffd640 1 --2- 172.21.15.6:0/3491326088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdc806b720 0x7efdc80b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:08.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdbffff640 1 --2- 172.21.15.6:0/3491326088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdc815b7c0 0x7efdc80b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:08.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdc77fe640 1 -- 172.21.15.6:0/3491326088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdc806b720 msgr2=0x7efdc80b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:08.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdc77fe640 1 --2- 172.21.15.6:0/3491326088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdc806b720 0x7efdc80b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdc77fe640 1 -- 172.21.15.6:0/3491326088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdc815b7c0 msgr2=0x7efdc80b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:08.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdc77fe640 1 --2- 172.21.15.6:0/3491326088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdc815b7c0 0x7efdc80b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdc77fe640 1 -- 172.21.15.6:0/3491326088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc0009a70 con 0x7efdc80c7240 2023-07-21T22:57:08.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdc77fe640 1 --2- 172.21.15.6:0/3491326088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdc80c7240 0x7efdc80adf50 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7efdc001afe0 tx=0x7efdc00196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:08.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdc4ff9640 1 -- 172.21.15.6:0/3491326088 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc00b9860 con 0x7efdc80c7240 2023-07-21T22:57:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdc4ff9640 1 -- 172.21.15.6:0/3491326088 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc00b99c0 con 0x7efdc80c7240 2023-07-21T22:57:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdc4ff9640 1 -- 172.21.15.6:0/3491326088 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc00b9d30 con 0x7efdc80c7240 2023-07-21T22:57:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.389+0000 7efdcd87b640 1 -- 172.21.15.6:0/3491326088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc80b1c90 con 0x7efdc80c7240 2023-07-21T22:57:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.393+0000 7efdcd87b640 1 -- 172.21.15.6:0/3491326088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc80c76c0 con 0x7efdc80c7240 2023-07-21T22:57:08.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.393+0000 7efdcd87b640 1 -- 172.21.15.6:0/3491326088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc80b2490 con 0x7efdc80c7240 2023-07-21T22:57:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.393+0000 7efdc4ff9640 1 -- 172.21.15.6:0/3491326088 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 89) v1 ==== 85496+0+0 (secure 0 0 0) 0x7efdc00c4460 con 0x7efdc80c7240 2023-07-21T22:57:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.393+0000 7efdc4ff9640 1 --2- 172.21.15.6:0/3491326088 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7efda8066100 0x7efda80685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.393+0000 7efdc4ff9640 1 -- 172.21.15.6:0/3491326088 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6994+0+0 (secure 0 0 0) 0x7efdc011f090 con 0x7efdc80c7240 2023-07-21T22:57:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.393+0000 7efdc6ffd640 1 --2- 172.21.15.6:0/3491326088 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7efda8066100 0x7efda80685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.393+0000 7efdc6ffd640 1 --2- 172.21.15.6:0/3491326088 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7efda8066100 0x7efda80685b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efdc80aeb20 tx=0x7efdb8008040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.397+0000 7efdc4ff9640 1 -- 172.21.15.6:0/3491326088 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efdc80b2490 con 0x7efdc80c7240 2023-07-21T22:57:08.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.593+0000 7efdcd87b640 1 -- 172.21.15.6:0/3491326088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdc80b2490 con 0x7efdc80c7240 2023-07-21T22:57:08.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.593+0000 7efdc4ff9640 1 -- 172.21.15.6:0/3491326088 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4675 (secure 0 0 0) 0x7efdc80b2490 con 0x7efdc80c7240 2023-07-21T22:57:08.628 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:08.628 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9508,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/1909144233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1909144233},{"type":"v1","addr":"172.21.15.161:6836","nonce":1909144233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9511,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1479759663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1479759663},{"type":"v1","addr":"172.21.15.161:6837","nonce":1479759663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9954,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2241291399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2241291399},{"type":"v1","addr":"172.21.15.6:6834","nonce":2241291399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:55:39.784030+0000","modified":"2023-07-21T22:55:43.422319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9957},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9957":{"gid":9957,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1921950839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1921950839},{"type":"v1","addr":"172.21.15.6:6835","nonce":1921950839}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-21T22:57:08.629 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 78 2023-07-21T22:57:08.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.597+0000 7efdcd87b640 1 -- 172.21.15.6:0/3491326088 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7efda8066100 msgr2=0x7efda80685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:08.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.597+0000 7efdcd87b640 1 --2- 172.21.15.6:0/3491326088 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7efda8066100 0x7efda80685b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efdc80aeb20 tx=0x7efdb8008040 comp rx=0 tx=0).stop 2023-07-21T22:57:08.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.597+0000 7efdcd87b640 1 -- 172.21.15.6:0/3491326088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdc80c7240 msgr2=0x7efdc80adf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:08.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.597+0000 7efdcd87b640 1 --2- 172.21.15.6:0/3491326088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdc80c7240 0x7efdc80adf50 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7efdc001afe0 tx=0x7efdc00196d0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.597+0000 7efdcd87b640 1 -- 172.21.15.6:0/3491326088 shutdown_connections 2023-07-21T22:57:08.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.597+0000 7efdcd87b640 1 --2- 172.21.15.6:0/3491326088 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7efda8066100 0x7efda80685b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.597+0000 7efdcd87b640 1 --2- 172.21.15.6:0/3491326088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdc80c7240 0x7efdc80adf50 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.597+0000 7efdcd87b640 1 --2- 172.21.15.6:0/3491326088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdc815b7c0 0x7efdc80b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.597+0000 7efdcd87b640 1 --2- 172.21.15.6:0/3491326088 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efdc806b720 0x7efdc80b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.597+0000 7efdcd87b640 1 -- 172.21.15.6:0/3491326088 >> 172.21.15.6:0/3491326088 conn(0x7efdc80afcf0 msgr2=0x7efdc806fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:08.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.597+0000 7efdcd87b640 1 -- 172.21.15.6:0/3491326088 shutdown_connections 2023-07-21T22:57:08.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.597+0000 7efdcd87b640 1 -- 172.21.15.6:0/3491326088 wait complete. 2023-07-21T22:57:08.649 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:57:08.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.761+0000 7f99adf9d640 1 Processor -- start 2023-07-21T22:57:08.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.761+0000 7f99adf9d640 1 -- start start 2023-07-21T22:57:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.761+0000 7f99adf9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f99a8070b70 0x7f99a8070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.761+0000 7f99adf9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f99a80cb100 0x7f99a80cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:08.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.761+0000 7f99adf9d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a80cac70 con 0x7f99a806b1e0 2023-07-21T22:57:08.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.761+0000 7f99adf9d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a80cba60 con 0x7f99a8070b70 2023-07-21T22:57:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.761+0000 7f99adf9d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a8071480 con 0x7f99a80cb100 2023-07-21T22:57:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.761+0000 7f99a77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f99a8070b70 0x7f99a8070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.761+0000 7f99a77fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f99a8070b70 0x7f99a8070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39626/0 (socket says 172.21.15.6:39626) 2023-07-21T22:57:08.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.761+0000 7f99a77fe640 1 -- 172.21.15.6:0/3733265161 learned_addr learned my addr 172.21.15.6:0/3733265161 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.761+0000 7f99a77fe640 1 -- 172.21.15.6:0/3733265161 >> v2:172.21.15.161:3300/0 conn(0x7f99a80cb100 msgr2=0x7f99a80cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.761+0000 7f99a77fe640 1 --2- 172.21.15.6:0/3733265161 >> v2:172.21.15.161:3300/0 conn(0x7f99a80cb100 0x7f99a80cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.761+0000 7f99a77fe640 1 -- 172.21.15.6:0/3733265161 >> v1:172.21.15.161:6789/0 conn(0x7f99a806b1e0 legacy=0x7f99a80c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:08.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.761+0000 7f99a77fe640 1 -- 172.21.15.6:0/3733265161 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a80ca060 con 0x7f99a8070b70 2023-07-21T22:57:08.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.765+0000 7f99a77fe640 1 --2- 172.21.15.6:0/3733265161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99a8070b70 0x7f99a8070f40 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f99a80c19c0 tx=0x7f999801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ac9b0f83402400 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:08.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.765+0000 7f99a67fc640 1 -- 172.21.15.6:0/3733265161 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99980aa5f0 con 0x7f99a8070b70 2023-07-21T22:57:08.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.765+0000 7f99a67fc640 1 -- 172.21.15.6:0/3733265161 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99980aa750 con 0x7f99a8070b70 2023-07-21T22:57:08.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.765+0000 7f99a67fc640 1 -- 172.21.15.6:0/3733265161 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99980aaae0 con 0x7f99a8070b70 2023-07-21T22:57:08.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.765+0000 7f99adf9d640 1 -- 172.21.15.6:0/3733265161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99a8070b70 msgr2=0x7f99a8070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:08.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.765+0000 7f99adf9d640 1 --2- 172.21.15.6:0/3733265161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99a8070b70 0x7f99a8070f40 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f99a80c19c0 tx=0x7f999801c490 comp rx=0 tx=0).stop 2023-07-21T22:57:08.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.765+0000 7f99adf9d640 1 -- 172.21.15.6:0/3733265161 shutdown_connections 2023-07-21T22:57:08.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.765+0000 7f99adf9d640 1 --2- 172.21.15.6:0/3733265161 >> v2:172.21.15.161:3300/0 conn(0x7f99a80cb100 0x7f99a80cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.765+0000 7f99adf9d640 1 --2- 172.21.15.6:0/3733265161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99a8070b70 0x7f99a8070f40 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.765+0000 7f99adf9d640 1 -- 172.21.15.6:0/3733265161 >> 172.21.15.6:0/3733265161 conn(0x7f99a80afcf0 msgr2=0x7f99a80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.765+0000 7f99adf9d640 1 -- 172.21.15.6:0/3733265161 shutdown_connections 2023-07-21T22:57:08.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.765+0000 7f99adf9d640 1 -- 172.21.15.6:0/3733265161 wait complete. 2023-07-21T22:57:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99adf9d640 1 Processor -- start 2023-07-21T22:57:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99adf9d640 1 -- start start 2023-07-21T22:57:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99adf9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99a806b1e0 0x7f99a81497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:08.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99adf9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99a8070b70 0x7f99a81574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99adf9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99a80cb100 0x7f99a814ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99adf9d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a8149d00 con 0x7f99a806b1e0 2023-07-21T22:57:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99adf9d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a81502c0 con 0x7f99a80cb100 2023-07-21T22:57:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99adf9d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a81505a0 con 0x7f99a8070b70 2023-07-21T22:57:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99a77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99a806b1e0 0x7f99a81497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:08.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99a77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99a806b1e0 0x7f99a81497c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39630/0 (socket says 172.21.15.6:39630) 2023-07-21T22:57:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99a77fe640 1 -- 172.21.15.6:0/3805459185 learned_addr learned my addr 172.21.15.6:0/3805459185 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99a7fff640 1 --2- 172.21.15.6:0/3805459185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99a80cb100 0x7f99a814ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99a6ffd640 1 --2- 172.21.15.6:0/3805459185 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99a8070b70 0x7f99a81574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99a77fe640 1 -- 172.21.15.6:0/3805459185 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99a8070b70 msgr2=0x7f99a81574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99a77fe640 1 --2- 172.21.15.6:0/3805459185 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99a8070b70 0x7f99a81574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99a77fe640 1 -- 172.21.15.6:0/3805459185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99a80cb100 msgr2=0x7f99a814ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:08.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99a77fe640 1 --2- 172.21.15.6:0/3805459185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99a80cb100 0x7f99a814ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99a77fe640 1 -- 172.21.15.6:0/3805459185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99980094d0 con 0x7f99a806b1e0 2023-07-21T22:57:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99a6ffd640 1 --2- 172.21.15.6:0/3805459185 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99a8070b70 0x7f99a81574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99a77fe640 1 --2- 172.21.15.6:0/3805459185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99a806b1e0 0x7f99a81497c0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f999801a0c0 tx=0x7f999801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f998ffff640 1 -- 172.21.15.6:0/3805459185 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99980b3800 con 0x7f99a806b1e0 2023-07-21T22:57:08.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f998ffff640 1 -- 172.21.15.6:0/3805459185 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99980b3960 con 0x7f99a806b1e0 2023-07-21T22:57:08.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f998ffff640 1 -- 172.21.15.6:0/3805459185 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99980b3d10 con 0x7f99a806b1e0 2023-07-21T22:57:08.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99adf9d640 1 -- 172.21.15.6:0/3805459185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a8150880 con 0x7f99a806b1e0 2023-07-21T22:57:08.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99adf9d640 1 -- 172.21.15.6:0/3805459185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a8150e40 con 0x7f99a806b1e0 2023-07-21T22:57:08.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.769+0000 7f99adf9d640 1 -- 172.21.15.6:0/3805459185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a8151030 con 0x7f99a806b1e0 2023-07-21T22:57:08.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.773+0000 7f998ffff640 1 -- 172.21.15.6:0/3805459185 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 89) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f99980c73a0 con 0x7f99a806b1e0 2023-07-21T22:57:08.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.773+0000 7f998ffff640 1 --2- 172.21.15.6:0/3805459185 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f99940660d0 0x7f9994068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:08.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.773+0000 7f998ffff640 1 -- 172.21.15.6:0/3805459185 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6994+0+0 (secure 0 0 0) 0x7f99980a7070 con 0x7f99a806b1e0 2023-07-21T22:57:08.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.773+0000 7f99a6ffd640 1 --2- 172.21.15.6:0/3805459185 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f99940660d0 0x7f9994068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:08.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.773+0000 7f99a6ffd640 1 --2- 172.21.15.6:0/3805459185 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f99940660d0 0x7f9994068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f99a81f5380 tx=0x7f999c009040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:08.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.777+0000 7f998ffff640 1 -- 172.21.15.6:0/3805459185 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99980ebcd0 con 0x7f99a806b1e0 2023-07-21T22:57:08.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.933+0000 7f99adf9d640 1 -- 172.21.15.6:0/3805459185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99a80678d0 con 0x7f99a806b1e0 2023-07-21T22:57:08.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.937+0000 7f998ffff640 1 -- 172.21.15.6:0/3805459185 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+19712 (secure 0 0 0) 0x7f99980ef2f0 con 0x7f99a806b1e0 2023-07-21T22:57:08.971 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:08.971 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":180,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:57:07.121417+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:55:37.909970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-21T22:55:38.777920+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":179,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.21","mappings":[{"from":3,"to":0}]},{"pgid":"22.30","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/3565536750":"2023-07-22T22:57:07.121362+0000","172.21.15.161:6833/2516914157":"2023-07-22T22:57:07.121362+0000","172.21.15.161:6832/2516914157":"2023-07-22T22:57:07.121362+0000","172.21.15.161:0/4209565887":"2023-07-22T22:57:07.121362+0000","172.21.15.161:0/143221604":"2023-07-22T22:57:07.121362+0000","172.21.15.161:0/4165961314":"2023-07-22T22:57:07.121362+0000","172.21.15.161:0/1521619119":"2023-07-22T22:57:07.121362+0000","172.21.15.161:0/1340525209":"2023-07-22T22:55:56.979202+0000","172.21.15.161:0/586248075":"2023-07-22T22:55:56.979202+0000","172.21.15.161:0/149384631":"2023-07-22T22:57:07.121362+0000","172.21.15.161:0/3856824963":"2023-07-22T22:55:56.979202+0000","172.21.15.161:6833/2346358146":"2023-07-22T22:55:56.979202+0000","172.21.15.161:0/3561989325":"2023-07-22T22:57:07.121362+0000","172.21.15.161:0/1537566959":"2023-07-22T22:55:56.979202+0000","172.21.15.161:6832/2346358146":"2023-07-22T22:55:56.979202+0000","172.21.15.161:0/1242436623":"2023-07-22T22:57:07.121362+0000","172.21.15.161:0/1490152306":"2023-07-22T22:55:56.979202+0000","172.21.15.161:0/4205584408":"2023-07-22T22:55:56.979202+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:57:08.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.937+0000 7f99adf9d640 1 -- 172.21.15.6:0/3805459185 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f99940660d0 msgr2=0x7f9994068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:08.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.937+0000 7f99adf9d640 1 --2- 172.21.15.6:0/3805459185 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f99940660d0 0x7f9994068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f99a81f5380 tx=0x7f999c009040 comp rx=0 tx=0).stop 2023-07-21T22:57:08.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.937+0000 7f99adf9d640 1 -- 172.21.15.6:0/3805459185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99a806b1e0 msgr2=0x7f99a81497c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:08.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.937+0000 7f99adf9d640 1 --2- 172.21.15.6:0/3805459185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99a806b1e0 0x7f99a81497c0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f999801a0c0 tx=0x7f999801acd0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.937+0000 7f99adf9d640 1 -- 172.21.15.6:0/3805459185 shutdown_connections 2023-07-21T22:57:08.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.937+0000 7f99adf9d640 1 --2- 172.21.15.6:0/3805459185 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f99940660d0 0x7f9994068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.937+0000 7f99adf9d640 1 --2- 172.21.15.6:0/3805459185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99a80cb100 0x7f99a814ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.937+0000 7f99adf9d640 1 --2- 172.21.15.6:0/3805459185 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f99a8070b70 0x7f99a81574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.937+0000 7f99adf9d640 1 --2- 172.21.15.6:0/3805459185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99a806b1e0 0x7f99a81497c0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:08.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.937+0000 7f99adf9d640 1 -- 172.21.15.6:0/3805459185 >> 172.21.15.6:0/3805459185 conn(0x7f99a80afcf0 msgr2=0x7f99a8152410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.937+0000 7f99adf9d640 1 -- 172.21.15.6:0/3805459185 shutdown_connections 2023-07-21T22:57:08.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:08.937+0000 7f99adf9d640 1 -- 172.21.15.6:0/3805459185 wait complete. 2023-07-21T22:57:08.993 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-21T22:57:08.993 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:57:09.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.101+0000 7fd205774640 1 Processor -- start 2023-07-21T22:57:09.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.101+0000 7fd205774640 1 -- start start 2023-07-21T22:57:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.105+0000 7fd205774640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd20006b1e0 0x7fd2000c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.105+0000 7fd205774640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd2000c21f0 0x7fd2000cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:09.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.105+0000 7fd205774640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2000cac70 con 0x7fd200070b70 2023-07-21T22:57:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.105+0000 7fd205774640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2000ca060 con 0x7fd20006b1e0 2023-07-21T22:57:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.105+0000 7fd205774640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2000ca340 con 0x7fd2000c21f0 2023-07-21T22:57:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.105+0000 7fd1feffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd200070b70 0x7fd200070f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49278/0 (socket says 172.21.15.6:49278) 2023-07-21T22:57:09.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.105+0000 7fd1feffd640 1 -- 172.21.15.6:0/1125923524 learned_addr learned my addr 172.21.15.6:0/1125923524 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:09.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.105+0000 7fd1f7fff640 1 --2- 172.21.15.6:0/1125923524 >> v2:172.21.15.6:3300/0 conn(0x7fd20006b1e0 0x7fd2000c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:09.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.105+0000 7fd1ff7fe640 1 --2- 172.21.15.6:0/1125923524 >> v2:172.21.15.161:3300/0 conn(0x7fd2000c21f0 0x7fd2000cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:09.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.105+0000 7fd1f7fff640 1 -- 172.21.15.6:0/1125923524 >> v2:172.21.15.161:3300/0 conn(0x7fd2000c21f0 msgr2=0x7fd2000cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:09.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.105+0000 7fd1f7fff640 1 --2- 172.21.15.6:0/1125923524 >> v2:172.21.15.161:3300/0 conn(0x7fd2000c21f0 0x7fd2000cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.105+0000 7fd1f7fff640 1 -- 172.21.15.6:0/1125923524 >> v1:172.21.15.6:6789/0 conn(0x7fd200070b70 legacy=0x7fd200070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:09.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.105+0000 7fd1f7fff640 1 -- 172.21.15.6:0/1125923524 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2000ca620 con 0x7fd20006b1e0 2023-07-21T22:57:09.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.105+0000 7fd1ff7fe640 1 --2- 172.21.15.6:0/1125923524 >> v2:172.21.15.161:3300/0 conn(0x7fd2000c21f0 0x7fd2000cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:09.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.109+0000 7fd1f7fff640 1 --2- 172.21.15.6:0/1125923524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd20006b1e0 0x7fd2000c1cb0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fd2000c19c0 tx=0x7fd1e801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90add346455e85d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:09.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.109+0000 7fd1fe7fc640 1 -- 172.21.15.6:0/1125923524 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e80ab650 con 0x7fd20006b1e0 2023-07-21T22:57:09.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.109+0000 7fd1fe7fc640 1 -- 172.21.15.6:0/1125923524 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e80ab7b0 con 0x7fd20006b1e0 2023-07-21T22:57:09.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.109+0000 7fd1fe7fc640 1 -- 172.21.15.6:0/1125923524 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e80abb40 con 0x7fd20006b1e0 2023-07-21T22:57:09.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.109+0000 7fd205774640 1 -- 172.21.15.6:0/1125923524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd20006b1e0 msgr2=0x7fd2000c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:09.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.109+0000 7fd205774640 1 --2- 172.21.15.6:0/1125923524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd20006b1e0 0x7fd2000c1cb0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fd2000c19c0 tx=0x7fd1e801c430 comp rx=0 tx=0).stop 2023-07-21T22:57:09.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.109+0000 7fd205774640 1 -- 172.21.15.6:0/1125923524 shutdown_connections 2023-07-21T22:57:09.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.109+0000 7fd205774640 1 --2- 172.21.15.6:0/1125923524 >> v2:172.21.15.161:3300/0 conn(0x7fd2000c21f0 0x7fd2000cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.109+0000 7fd205774640 1 --2- 172.21.15.6:0/1125923524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd20006b1e0 0x7fd2000c1cb0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.109+0000 7fd205774640 1 -- 172.21.15.6:0/1125923524 >> 172.21.15.6:0/1125923524 conn(0x7fd2000afcf0 msgr2=0x7fd2000b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:09.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.109+0000 7fd205774640 1 -- 172.21.15.6:0/1125923524 shutdown_connections 2023-07-21T22:57:09.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.109+0000 7fd205774640 1 -- 172.21.15.6:0/1125923524 wait complete. 2023-07-21T22:57:09.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.109+0000 7fd205774640 1 Processor -- start 2023-07-21T22:57:09.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.109+0000 7fd205774640 1 -- start start 2023-07-21T22:57:09.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd205774640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd20006b1e0 0x7fd20014d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:09.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd205774640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd200070b70 0x7fd200157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:09.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd205774640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2000c21f0 0x7fd200157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:09.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd205774640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20014dc20 con 0x7fd20006b1e0 2023-07-21T22:57:09.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd205774640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000cddd0 con 0x7fd2000c21f0 2023-07-21T22:57:09.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd205774640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000c5860 con 0x7fd200070b70 2023-07-21T22:57:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd1feffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd20006b1e0 0x7fd20014d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd1feffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd20006b1e0 0x7fd20014d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39658/0 (socket says 172.21.15.6:39658) 2023-07-21T22:57:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd1feffd640 1 -- 172.21.15.6:0/1685575806 learned_addr learned my addr 172.21.15.6:0/1685575806 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd1ff7fe640 1 --2- 172.21.15.6:0/1685575806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2000c21f0 0x7fd200157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd1f7fff640 1 --2- 172.21.15.6:0/1685575806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd200070b70 0x7fd200157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd1feffd640 1 -- 172.21.15.6:0/1685575806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd200070b70 msgr2=0x7fd200157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:09.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd1feffd640 1 --2- 172.21.15.6:0/1685575806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd200070b70 0x7fd200157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd1feffd640 1 -- 172.21.15.6:0/1685575806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2000c21f0 msgr2=0x7fd200157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:09.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd1feffd640 1 --2- 172.21.15.6:0/1685575806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2000c21f0 0x7fd200157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd1feffd640 1 -- 172.21.15.6:0/1685575806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e8009420 con 0x7fd20006b1e0 2023-07-21T22:57:09.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd1f7fff640 1 --2- 172.21.15.6:0/1685575806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd200070b70 0x7fd200157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:09.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd1feffd640 1 --2- 172.21.15.6:0/1685575806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd20006b1e0 0x7fd20014d6e0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000c530 tx=0x7fd1f000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:09.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd1f77fe640 1 -- 172.21.15.6:0/1685575806 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0005cf0 con 0x7fd20006b1e0 2023-07-21T22:57:09.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd1f77fe640 1 -- 172.21.15.6:0/1685575806 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f0005e50 con 0x7fd20006b1e0 2023-07-21T22:57:09.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd205774640 1 -- 172.21.15.6:0/1685575806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2000cd1c0 con 0x7fd20006b1e0 2023-07-21T22:57:09.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd1f77fe640 1 -- 172.21.15.6:0/1685575806 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f0007270 con 0x7fd20006b1e0 2023-07-21T22:57:09.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd205774640 1 -- 172.21.15.6:0/1685575806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2000cd780 con 0x7fd20006b1e0 2023-07-21T22:57:09.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd205774640 1 -- 172.21.15.6:0/1685575806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2000678d0 con 0x7fd20006b1e0 2023-07-21T22:57:09.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.113+0000 7fd1f77fe640 1 -- 172.21.15.6:0/1685575806 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 89) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fd1f00073d0 con 0x7fd20006b1e0 2023-07-21T22:57:09.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.117+0000 7fd1f77fe640 1 --2- 172.21.15.6:0/1685575806 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fd1e0066100 0x7fd1e00685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:09.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.117+0000 7fd1f77fe640 1 -- 172.21.15.6:0/1685575806 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6994+0+0 (secure 0 0 0) 0x7fd1f0083300 con 0x7fd20006b1e0 2023-07-21T22:57:09.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.117+0000 7fd1f7fff640 1 --2- 172.21.15.6:0/1685575806 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fd1e0066100 0x7fd1e00685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:09.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.117+0000 7fd1f7fff640 1 --2- 172.21.15.6:0/1685575806 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fd1e0066100 0x7fd1e00685b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80af000 tx=0x7fd1e80a7000 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:09.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.121+0000 7fd1f77fe640 1 -- 172.21.15.6:0/1685575806 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd1f0050660 con 0x7fd20006b1e0 2023-07-21T22:57:09.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.321+0000 7fd205774640 1 -- 172.21.15.6:0/1685575806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2000c98c0 con 0x7fd20006b1e0 2023-07-21T22:57:09.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.321+0000 7fd1f77fe640 1 -- 172.21.15.6:0/1685575806 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4675 (secure 0 0 0) 0x7fd1f0017020 con 0x7fd20006b1e0 2023-07-21T22:57:09.357 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:09.357 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9508,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/1909144233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1909144233},{"type":"v1","addr":"172.21.15.161:6836","nonce":1909144233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9511,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1479759663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1479759663},{"type":"v1","addr":"172.21.15.161:6837","nonce":1479759663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9954,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2241291399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2241291399},{"type":"v1","addr":"172.21.15.6:6834","nonce":2241291399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:55:39.784030+0000","modified":"2023-07-21T22:55:43.422319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9957},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9957":{"gid":9957,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1921950839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1921950839},{"type":"v1","addr":"172.21.15.6:6835","nonce":1921950839}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-21T22:57:09.358 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 78 2023-07-21T22:57:09.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.325+0000 7fd205774640 1 -- 172.21.15.6:0/1685575806 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fd1e0066100 msgr2=0x7fd1e00685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:09.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.325+0000 7fd205774640 1 --2- 172.21.15.6:0/1685575806 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fd1e0066100 0x7fd1e00685b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80af000 tx=0x7fd1e80a7000 comp rx=0 tx=0).stop 2023-07-21T22:57:09.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.325+0000 7fd205774640 1 -- 172.21.15.6:0/1685575806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd20006b1e0 msgr2=0x7fd20014d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:09.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.325+0000 7fd205774640 1 --2- 172.21.15.6:0/1685575806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd20006b1e0 0x7fd20014d6e0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000c530 tx=0x7fd1f000c9f0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.325+0000 7fd205774640 1 -- 172.21.15.6:0/1685575806 shutdown_connections 2023-07-21T22:57:09.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.325+0000 7fd205774640 1 --2- 172.21.15.6:0/1685575806 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fd1e0066100 0x7fd1e00685b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.325+0000 7fd205774640 1 --2- 172.21.15.6:0/1685575806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2000c21f0 0x7fd200157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.325+0000 7fd205774640 1 --2- 172.21.15.6:0/1685575806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd200070b70 0x7fd200157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.325+0000 7fd205774640 1 --2- 172.21.15.6:0/1685575806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd20006b1e0 0x7fd20014d6e0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.325+0000 7fd205774640 1 -- 172.21.15.6:0/1685575806 >> 172.21.15.6:0/1685575806 conn(0x7fd2000afcf0 msgr2=0x7fd2000c4450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:09.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.325+0000 7fd205774640 1 -- 172.21.15.6:0/1685575806 shutdown_connections 2023-07-21T22:57:09.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.325+0000 7fd205774640 1 -- 172.21.15.6:0/1685575806 wait complete. 2023-07-21T22:57:09.378 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:57:09.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.489+0000 7fa4303fa640 1 Processor -- start 2023-07-21T22:57:09.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.493+0000 7fa4303fa640 1 -- start start 2023-07-21T22:57:09.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.493+0000 7fa4303fa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa4280b7c70 0x7fa4280d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:09.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.493+0000 7fa4303fa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa4280d1850 0x7fa42815f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:09.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.493+0000 7fa4303fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4280d1300 0x7fa42815fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:09.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.493+0000 7fa4303fa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4280d1190 con 0x7fa4280b7c70 2023-07-21T22:57:09.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.493+0000 7fa4303fa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa428160600 con 0x7fa4280d1850 2023-07-21T22:57:09.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.493+0000 7fa4303fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4281600d0 con 0x7fa4280d1300 2023-07-21T22:57:09.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.493+0000 7fa42e196640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa4280b7c70 0x7fa4280d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:09.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.493+0000 7fa42e196640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa4280b7c70 0x7fa4280d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39666/0 (socket says 172.21.15.6:39666) 2023-07-21T22:57:09.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.493+0000 7fa42e196640 1 -- 172.21.15.6:0/406183122 learned_addr learned my addr 172.21.15.6:0/406183122 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:09.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.493+0000 7fa42d995640 1 --2- 172.21.15.6:0/406183122 >> v2:172.21.15.161:3300/0 conn(0x7fa4280d1850 0x7fa42815f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:09.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.493+0000 7fa42e997640 1 --2- 172.21.15.6:0/406183122 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4280d1300 0x7fa42815fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:09.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.493+0000 7fa42e196640 1 -- 172.21.15.6:0/406183122 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4280d1300 msgr2=0x7fa42815fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:09.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.493+0000 7fa42e196640 1 --2- 172.21.15.6:0/406183122 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4280d1300 0x7fa42815fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.493+0000 7fa42e196640 1 -- 172.21.15.6:0/406183122 >> v2:172.21.15.161:3300/0 conn(0x7fa4280d1850 msgr2=0x7fa42815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:09.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.493+0000 7fa42e196640 1 --2- 172.21.15.6:0/406183122 >> v2:172.21.15.161:3300/0 conn(0x7fa4280d1850 0x7fa42815f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.493+0000 7fa42e196640 1 -- 172.21.15.6:0/406183122 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4280ccaf0 con 0x7fa4280b7c70 2023-07-21T22:57:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.497+0000 7fa42e196640 1 --2- 172.21.15.6:0/406183122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4280b7c70 0x7fa4280d0c50 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fa4280b1180 tx=0x7fa42401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa1b2baa3362cd0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.497+0000 7fa42d194640 1 -- 172.21.15.6:0/406183122 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4240ac600 con 0x7fa4280b7c70 2023-07-21T22:57:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.497+0000 7fa42d194640 1 -- 172.21.15.6:0/406183122 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4240a8050 con 0x7fa4280b7c70 2023-07-21T22:57:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.497+0000 7fa42d194640 1 -- 172.21.15.6:0/406183122 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4240ac980 con 0x7fa4280b7c70 2023-07-21T22:57:09.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.497+0000 7fa4303fa640 1 -- 172.21.15.6:0/406183122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4280b7c70 msgr2=0x7fa4280d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:09.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.497+0000 7fa4303fa640 1 --2- 172.21.15.6:0/406183122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4280b7c70 0x7fa4280d0c50 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fa4280b1180 tx=0x7fa42401c4d0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.497+0000 7fa4303fa640 1 -- 172.21.15.6:0/406183122 shutdown_connections 2023-07-21T22:57:09.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.497+0000 7fa4303fa640 1 --2- 172.21.15.6:0/406183122 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4280d1300 0x7fa42815fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.497+0000 7fa4303fa640 1 --2- 172.21.15.6:0/406183122 >> v2:172.21.15.161:3300/0 conn(0x7fa4280d1850 0x7fa42815f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.497+0000 7fa4303fa640 1 --2- 172.21.15.6:0/406183122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4280b7c70 0x7fa4280d0c50 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.497+0000 7fa4303fa640 1 -- 172.21.15.6:0/406183122 >> 172.21.15.6:0/406183122 conn(0x7fa4280650b0 msgr2=0x7fa4280654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:09.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.497+0000 7fa4303fa640 1 -- 172.21.15.6:0/406183122 shutdown_connections 2023-07-21T22:57:09.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.497+0000 7fa4303fa640 1 -- 172.21.15.6:0/406183122 wait complete. 2023-07-21T22:57:09.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.497+0000 7fa4303fa640 1 Processor -- start 2023-07-21T22:57:09.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.497+0000 7fa4303fa640 1 -- start start 2023-07-21T22:57:09.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa4303fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4280b7c70 0x7fa4280cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:09.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa4303fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4280d1300 0x7fa42815b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:09.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa4303fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4280d1850 0x7fa428156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:09.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa4303fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4280cb720 con 0x7fa4280d1850 2023-07-21T22:57:09.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa4303fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42815c8e0 con 0x7fa4280d1300 2023-07-21T22:57:09.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa4303fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42815bda0 con 0x7fa4280b7c70 2023-07-21T22:57:09.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa42e997640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4280d1850 0x7fa428156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:09.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa42e997640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4280d1850 0x7fa428156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39678/0 (socket says 172.21.15.6:39678) 2023-07-21T22:57:09.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa42e997640 1 -- 172.21.15.6:0/2079937972 learned_addr learned my addr 172.21.15.6:0/2079937972 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:09.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa42d995640 1 --2- 172.21.15.6:0/2079937972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4280d1300 0x7fa42815b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:09.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa42e196640 1 --2- 172.21.15.6:0/2079937972 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4280b7c70 0x7fa4280cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:09.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa42e997640 1 -- 172.21.15.6:0/2079937972 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4280b7c70 msgr2=0x7fa4280cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:09.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa42e997640 1 --2- 172.21.15.6:0/2079937972 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4280b7c70 0x7fa4280cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa42e997640 1 -- 172.21.15.6:0/2079937972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4280d1300 msgr2=0x7fa42815b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:09.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa42e997640 1 --2- 172.21.15.6:0/2079937972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4280d1300 0x7fa42815b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa42e997640 1 -- 172.21.15.6:0/2079937972 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4240094d0 con 0x7fa4280d1850 2023-07-21T22:57:09.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa42e997640 1 --2- 172.21.15.6:0/2079937972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4280d1850 0x7fa428156710 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fa420007e40 tx=0x7fa42000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:09.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa41effd640 1 -- 172.21.15.6:0/2079937972 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa420014620 con 0x7fa4280d1850 2023-07-21T22:57:09.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa41effd640 1 -- 172.21.15.6:0/2079937972 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42000ee90 con 0x7fa4280d1850 2023-07-21T22:57:09.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa41effd640 1 -- 172.21.15.6:0/2079937972 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4200149e0 con 0x7fa4280d1850 2023-07-21T22:57:09.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa4303fa640 1 -- 172.21.15.6:0/2079937972 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4280cb440 con 0x7fa4280d1850 2023-07-21T22:57:09.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa4303fa640 1 -- 172.21.15.6:0/2079937972 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42815c570 con 0x7fa4280d1850 2023-07-21T22:57:09.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.501+0000 7fa4303fa640 1 -- 172.21.15.6:0/2079937972 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42815c0f0 con 0x7fa4280d1850 2023-07-21T22:57:09.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.505+0000 7fa41effd640 1 -- 172.21.15.6:0/2079937972 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa420014b40 con 0x7fa4280d1850 2023-07-21T22:57:09.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.505+0000 7fa41effd640 1 --2- 172.21.15.6:0/2079937972 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa40c0663d0 0x7fa40c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:09.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.505+0000 7fa41effd640 1 -- 172.21.15.6:0/2079937972 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6994+0+0 (secure 0 0 0) 0x7fa420084ac0 con 0x7fa4280d1850 2023-07-21T22:57:09.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.505+0000 7fa42e196640 1 --2- 172.21.15.6:0/2079937972 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa40c0663d0 0x7fa40c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:09.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.505+0000 7fa42e196640 1 --2- 172.21.15.6:0/2079937972 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa40c0663d0 0x7fa40c068880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa4240ae000 tx=0x7fa4240a7000 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:09.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.509+0000 7fa41effd640 1 -- 172.21.15.6:0/2079937972 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa42815c0f0 con 0x7fa4280d1850 2023-07-21T22:57:09.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.693+0000 7fa4303fa640 1 -- 172.21.15.6:0/2079937972 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa42815c0c0 con 0x7fa4280d1850 2023-07-21T22:57:09.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.697+0000 7fa41effd640 1 -- 172.21.15.6:0/2079937972 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4675 (secure 0 0 0) 0x7fa420082e60 con 0x7fa4280d1850 2023-07-21T22:57:09.730 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:09.730 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9508,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/1909144233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1909144233},{"type":"v1","addr":"172.21.15.161:6836","nonce":1909144233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9511,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1479759663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1479759663},{"type":"v1","addr":"172.21.15.161:6837","nonce":1479759663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9954,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2241291399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2241291399},{"type":"v1","addr":"172.21.15.6:6834","nonce":2241291399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:55:39.784030+0000","modified":"2023-07-21T22:55:43.422319+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9957},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9957":{"gid":9957,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/1921950839","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1921950839},{"type":"v1","addr":"172.21.15.6:6835","nonce":1921950839}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-21T22:57:09.731 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 78 2023-07-21T22:57:09.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.697+0000 7fa4303fa640 1 -- 172.21.15.6:0/2079937972 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa40c0663d0 msgr2=0x7fa40c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:09.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.697+0000 7fa4303fa640 1 --2- 172.21.15.6:0/2079937972 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa40c0663d0 0x7fa40c068880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa4240ae000 tx=0x7fa4240a7000 comp rx=0 tx=0).stop 2023-07-21T22:57:09.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.697+0000 7fa4303fa640 1 -- 172.21.15.6:0/2079937972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4280d1850 msgr2=0x7fa428156710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:09.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.697+0000 7fa4303fa640 1 --2- 172.21.15.6:0/2079937972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4280d1850 0x7fa428156710 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fa420007e40 tx=0x7fa42000e4b0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.697+0000 7fa4303fa640 1 -- 172.21.15.6:0/2079937972 shutdown_connections 2023-07-21T22:57:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.697+0000 7fa4303fa640 1 --2- 172.21.15.6:0/2079937972 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa40c0663d0 0x7fa40c068880 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.697+0000 7fa4303fa640 1 --2- 172.21.15.6:0/2079937972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4280d1850 0x7fa428156710 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.697+0000 7fa4303fa640 1 --2- 172.21.15.6:0/2079937972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4280d1300 0x7fa42815b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.697+0000 7fa4303fa640 1 --2- 172.21.15.6:0/2079937972 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4280b7c70 0x7fa4280cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.697+0000 7fa4303fa640 1 -- 172.21.15.6:0/2079937972 >> 172.21.15.6:0/2079937972 conn(0x7fa4280650b0 msgr2=0x7fa4280b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.697+0000 7fa4303fa640 1 -- 172.21.15.6:0/2079937972 shutdown_connections 2023-07-21T22:57:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.697+0000 7fa4303fa640 1 -- 172.21.15.6:0/2079937972 wait complete. 2023-07-21T22:57:09.751 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:57:09.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.861+0000 7f984dd00640 1 Processor -- start 2023-07-21T22:57:09.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.861+0000 7f984dd00640 1 -- start start 2023-07-21T22:57:09.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.865+0000 7f984dd00640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f984815f500 0x7f984806cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:09.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.865+0000 7f984dd00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f984806d430 0x7f984806a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:09.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.865+0000 7f984dd00640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f984806aa80 0x7f98480b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:09.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.865+0000 7f984dd00640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984806af20 con 0x7f984815f500 2023-07-21T22:57:09.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.865+0000 7f984dd00640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98480cdc80 con 0x7f984806aa80 2023-07-21T22:57:09.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.865+0000 7f984dd00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984806e4c0 con 0x7f984806d430 2023-07-21T22:57:09.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.865+0000 7f98477fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f984815f500 0x7f984806cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:09.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.865+0000 7f98477fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f984815f500 0x7f984806cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39686/0 (socket says 172.21.15.6:39686) 2023-07-21T22:57:09.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.865+0000 7f98477fe640 1 -- 172.21.15.6:0/3366702465 learned_addr learned my addr 172.21.15.6:0/3366702465 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:09.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.865+0000 7f9847fff640 1 --2- 172.21.15.6:0/3366702465 >> v2:172.21.15.161:3300/0 conn(0x7f984806aa80 0x7f98480b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:09.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.865+0000 7f98477fe640 1 -- 172.21.15.6:0/3366702465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f984806d430 msgr2=0x7f984806a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:09.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.865+0000 7f9846ffd640 1 --2- 172.21.15.6:0/3366702465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f984806d430 0x7f984806a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:09.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.865+0000 7f98477fe640 1 --2- 172.21.15.6:0/3366702465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f984806d430 0x7f984806a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.865+0000 7f98477fe640 1 -- 172.21.15.6:0/3366702465 >> v2:172.21.15.161:3300/0 conn(0x7f984806aa80 msgr2=0x7f98480b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:09.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.865+0000 7f98477fe640 1 --2- 172.21.15.6:0/3366702465 >> v2:172.21.15.161:3300/0 conn(0x7f984806aa80 0x7f98480b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.865+0000 7f98477fe640 1 -- 172.21.15.6:0/3366702465 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984806d940 con 0x7f984815f500 2023-07-21T22:57:09.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.865+0000 7f9847fff640 1 --2- 172.21.15.6:0/3366702465 >> v2:172.21.15.161:3300/0 conn(0x7f984806aa80 0x7f98480b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:09.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.865+0000 7f9846ffd640 1 --2- 172.21.15.6:0/3366702465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f984806d430 0x7f984806a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:09.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.865+0000 7f98477fe640 1 --2- 172.21.15.6:0/3366702465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f984815f500 0x7f984806cef0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f98480713b0 tx=0x7f983801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99fbdf6d662607a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:09.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.869+0000 7f98467fc640 1 -- 172.21.15.6:0/3366702465 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98380ab600 con 0x7f984815f500 2023-07-21T22:57:09.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.869+0000 7f98467fc640 1 -- 172.21.15.6:0/3366702465 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98380a7050 con 0x7f984815f500 2023-07-21T22:57:09.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.869+0000 7f98467fc640 1 -- 172.21.15.6:0/3366702465 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98380ab980 con 0x7f984815f500 2023-07-21T22:57:09.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.869+0000 7f984dd00640 1 -- 172.21.15.6:0/3366702465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f984815f500 msgr2=0x7f984806cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:09.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.869+0000 7f984dd00640 1 --2- 172.21.15.6:0/3366702465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f984815f500 0x7f984806cef0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f98480713b0 tx=0x7f983801c240 comp rx=0 tx=0).stop 2023-07-21T22:57:09.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.869+0000 7f984dd00640 1 -- 172.21.15.6:0/3366702465 shutdown_connections 2023-07-21T22:57:09.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.869+0000 7f984dd00640 1 --2- 172.21.15.6:0/3366702465 >> v2:172.21.15.161:3300/0 conn(0x7f984806aa80 0x7f98480b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.869+0000 7f984dd00640 1 --2- 172.21.15.6:0/3366702465 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f984806d430 0x7f984806a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.869+0000 7f984dd00640 1 --2- 172.21.15.6:0/3366702465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f984815f500 0x7f984806cef0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.869+0000 7f984dd00640 1 -- 172.21.15.6:0/3366702465 >> 172.21.15.6:0/3366702465 conn(0x7f98480659d0 msgr2=0x7f9848099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:09.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.869+0000 7f984dd00640 1 -- 172.21.15.6:0/3366702465 shutdown_connections 2023-07-21T22:57:09.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.869+0000 7f984dd00640 1 -- 172.21.15.6:0/3366702465 wait complete. 2023-07-21T22:57:09.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.869+0000 7f984dd00640 1 Processor -- start 2023-07-21T22:57:09.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.869+0000 7f984dd00640 1 -- start start 2023-07-21T22:57:09.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.869+0000 7f984dd00640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f984806aa80 0x7f984814cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:09.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.869+0000 7f984dd00640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f984806d430 0x7f9848155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:09.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.869+0000 7f984dd00640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f984815f500 0x7f98480ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:09.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.869+0000 7f984dd00640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9848157200 con 0x7f984806d430 2023-07-21T22:57:09.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.869+0000 7f984dd00640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98480aeda0 con 0x7f984815f500 2023-07-21T22:57:09.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.869+0000 7f984dd00640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9848156580 con 0x7f984806aa80 2023-07-21T22:57:09.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.873+0000 7f9846ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f984806d430 0x7f9848155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:09.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.873+0000 7f9846ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f984806d430 0x7f9848155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39690/0 (socket says 172.21.15.6:39690) 2023-07-21T22:57:09.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.873+0000 7f9846ffd640 1 -- 172.21.15.6:0/2721947645 learned_addr learned my addr 172.21.15.6:0/2721947645 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:09.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.873+0000 7f98477fe640 1 --2- 172.21.15.6:0/2721947645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f984806aa80 0x7f984814cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:09.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.873+0000 7f9847fff640 1 --2- 172.21.15.6:0/2721947645 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f984815f500 0x7f98480ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:09.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.873+0000 7f9846ffd640 1 -- 172.21.15.6:0/2721947645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f984806aa80 msgr2=0x7f984814cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:09.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.873+0000 7f9846ffd640 1 --2- 172.21.15.6:0/2721947645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f984806aa80 0x7f984814cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.873+0000 7f9846ffd640 1 -- 172.21.15.6:0/2721947645 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f984815f500 msgr2=0x7f98480ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:09.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.873+0000 7f9846ffd640 1 --2- 172.21.15.6:0/2721947645 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f984815f500 0x7f98480ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:09.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.873+0000 7f9846ffd640 1 -- 172.21.15.6:0/2721947645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9838009480 con 0x7f984806d430 2023-07-21T22:57:09.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.873+0000 7f9846ffd640 1 --2- 172.21.15.6:0/2721947645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f984806d430 0x7f9848155ef0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f983c00c7f0 tx=0x7f983c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:09.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.873+0000 7f982ffff640 1 -- 172.21.15.6:0/2721947645 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c00cea0 con 0x7f984806d430 2023-07-21T22:57:09.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.873+0000 7f982ffff640 1 -- 172.21.15.6:0/2721947645 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983c007a30 con 0x7f984806d430 2023-07-21T22:57:09.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.873+0000 7f982ffff640 1 -- 172.21.15.6:0/2721947645 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983c007de0 con 0x7f984806d430 2023-07-21T22:57:09.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.873+0000 7f984dd00640 1 -- 172.21.15.6:0/2721947645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9848156860 con 0x7f984806d430 2023-07-21T22:57:09.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.873+0000 7f984dd00640 1 -- 172.21.15.6:0/2721947645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9848156e20 con 0x7f984806d430 2023-07-21T22:57:09.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.873+0000 7f984dd00640 1 -- 172.21.15.6:0/2721947645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9848157340 con 0x7f984806d430 2023-07-21T22:57:09.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.873+0000 7f982ffff640 1 -- 172.21.15.6:0/2721947645 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f983c0113f0 con 0x7f984806d430 2023-07-21T22:57:09.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.877+0000 7f982ffff640 1 --2- 172.21.15.6:0/2721947645 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f98340663d0 0x7f9834068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:09.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.877+0000 7f982ffff640 1 -- 172.21.15.6:0/2721947645 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6994+0+0 (secure 0 0 0) 0x7f983c0843d0 con 0x7f984806d430 2023-07-21T22:57:09.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.877+0000 7f98477fe640 1 --2- 172.21.15.6:0/2721947645 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f98340663d0 0x7f9834068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:09.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.877+0000 7f98477fe640 1 --2- 172.21.15.6:0/2721947645 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f98340663d0 0x7f9834068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f98380ad000 tx=0x7f98380a6000 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:09.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:09.881+0000 7f982ffff640 1 -- 172.21.15.6:0/2721947645 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9848157340 con 0x7f984806d430 2023-07-21T22:57:10.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.037+0000 7f984dd00640 1 -- 172.21.15.6:0/2721947645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9848157340 con 0x7f984806d430 2023-07-21T22:57:10.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.037+0000 7f982ffff640 1 -- 172.21.15.6:0/2721947645 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+19712 (secure 0 0 0) 0x7f9848157340 con 0x7f984806d430 2023-07-21T22:57:10.072 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:10.073 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":180,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:57:07.121417+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:55:37.909970+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-21T22:55:38.777920+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":179,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.21","mappings":[{"from":3,"to":0}]},{"pgid":"22.30","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/3565536750":"2023-07-22T22:57:07.121362+0000","172.21.15.161:6833/2516914157":"2023-07-22T22:57:07.121362+0000","172.21.15.161:6832/2516914157":"2023-07-22T22:57:07.121362+0000","172.21.15.161:0/4209565887":"2023-07-22T22:57:07.121362+0000","172.21.15.161:0/143221604":"2023-07-22T22:57:07.121362+0000","172.21.15.161:0/4165961314":"2023-07-22T22:57:07.121362+0000","172.21.15.161:0/1521619119":"2023-07-22T22:57:07.121362+0000","172.21.15.161:0/1340525209":"2023-07-22T22:55:56.979202+0000","172.21.15.161:0/586248075":"2023-07-22T22:55:56.979202+0000","172.21.15.161:0/149384631":"2023-07-22T22:57:07.121362+0000","172.21.15.161:0/3856824963":"2023-07-22T22:55:56.979202+0000","172.21.15.161:6833/2346358146":"2023-07-22T22:55:56.979202+0000","172.21.15.161:0/3561989325":"2023-07-22T22:57:07.121362+0000","172.21.15.161:0/1537566959":"2023-07-22T22:55:56.979202+0000","172.21.15.161:6832/2346358146":"2023-07-22T22:55:56.979202+0000","172.21.15.161:0/1242436623":"2023-07-22T22:57:07.121362+0000","172.21.15.161:0/1490152306":"2023-07-22T22:55:56.979202+0000","172.21.15.161:0/4205584408":"2023-07-22T22:55:56.979202+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:57:10.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.041+0000 7f984dd00640 1 -- 172.21.15.6:0/2721947645 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f98340663d0 msgr2=0x7f9834068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:10.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.041+0000 7f984dd00640 1 --2- 172.21.15.6:0/2721947645 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f98340663d0 0x7f9834068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f98380ad000 tx=0x7f98380a6000 comp rx=0 tx=0).stop 2023-07-21T22:57:10.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.041+0000 7f984dd00640 1 -- 172.21.15.6:0/2721947645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f984806d430 msgr2=0x7f9848155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:10.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.041+0000 7f984dd00640 1 --2- 172.21.15.6:0/2721947645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f984806d430 0x7f9848155ef0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f983c00c7f0 tx=0x7f983c00ccb0 comp rx=0 tx=0).stop 2023-07-21T22:57:10.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.041+0000 7f984dd00640 1 -- 172.21.15.6:0/2721947645 shutdown_connections 2023-07-21T22:57:10.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.041+0000 7f984dd00640 1 --2- 172.21.15.6:0/2721947645 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f98340663d0 0x7f9834068880 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:10.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.041+0000 7f984dd00640 1 --2- 172.21.15.6:0/2721947645 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f984815f500 0x7f98480ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:10.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.041+0000 7f984dd00640 1 --2- 172.21.15.6:0/2721947645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f984806d430 0x7f9848155ef0 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:10.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.041+0000 7f984dd00640 1 --2- 172.21.15.6:0/2721947645 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f984806aa80 0x7f984814cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:10.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.041+0000 7f984dd00640 1 -- 172.21.15.6:0/2721947645 >> 172.21.15.6:0/2721947645 conn(0x7f98480659d0 msgr2=0x7f98480b0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:10.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.041+0000 7f984dd00640 1 -- 172.21.15.6:0/2721947645 shutdown_connections 2023-07-21T22:57:10.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.041+0000 7f984dd00640 1 -- 172.21.15.6:0/2721947645 wait complete. 2023-07-21T22:57:10.095 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-21T22:57:10.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.205+0000 7f14ba796640 1 Processor -- start 2023-07-21T22:57:10.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.209+0000 7f14ba796640 1 -- start start 2023-07-21T22:57:10.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.209+0000 7f14ba796640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f14b415f500 0x7f14b406cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:10.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.209+0000 7f14ba796640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14b406d430 0x7f14b406a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:10.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.209+0000 7f14ba796640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b40cdc80 con 0x7f14b406aa80 2023-07-21T22:57:10.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.209+0000 7f14ba796640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b406af20 con 0x7f14b415f500 2023-07-21T22:57:10.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.209+0000 7f14ba796640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b406e4c0 con 0x7f14b406d430 2023-07-21T22:57:10.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.209+0000 7f14b8d33640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f14b406aa80 0x7f14b40b1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49288/0 (socket says 172.21.15.6:49288) 2023-07-21T22:57:10.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.209+0000 7f14b8d33640 1 -- 172.21.15.6:0/2992016812 learned_addr learned my addr 172.21.15.6:0/2992016812 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:10.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.209+0000 7f14b37fe640 1 --2- 172.21.15.6:0/2992016812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14b406d430 0x7f14b406a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:10.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.209+0000 7f14b3fff640 1 --2- 172.21.15.6:0/2992016812 >> v2:172.21.15.161:3300/0 conn(0x7f14b415f500 0x7f14b406cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:10.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.209+0000 7f14b2ffd640 1 -- 172.21.15.6:0/2992016812 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604173209 0 0) 0x7f14b40cdc80 con 0x7f14b406aa80 2023-07-21T22:57:10.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.209+0000 7f14b2ffd640 1 -- 172.21.15.6:0/2992016812 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f149c003530 con 0x7f14b406aa80 2023-07-21T22:57:10.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.209+0000 7f14b3fff640 1 -- 172.21.15.6:0/2992016812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14b406d430 msgr2=0x7f14b406a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:10.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.209+0000 7f14b3fff640 1 --2- 172.21.15.6:0/2992016812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14b406d430 0x7f14b406a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:10.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.209+0000 7f14b3fff640 1 -- 172.21.15.6:0/2992016812 >> v1:172.21.15.6:6789/0 conn(0x7f14b406aa80 legacy=0x7f14b40b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:10.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.209+0000 7f14b3fff640 1 -- 172.21.15.6:0/2992016812 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b406d940 con 0x7f14b415f500 2023-07-21T22:57:10.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.209+0000 7f14b37fe640 1 --2- 172.21.15.6:0/2992016812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14b406d430 0x7f14b406a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:10.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.213+0000 7f14b3fff640 1 --2- 172.21.15.6:0/2992016812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14b415f500 0x7f14b406cef0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f14a40097a0 tx=0x7f14a401c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=804d08e681d4d547 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:10.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.213+0000 7f14b2ffd640 1 -- 172.21.15.6:0/2992016812 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4004230 con 0x7f14b415f500 2023-07-21T22:57:10.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.213+0000 7f14b2ffd640 1 -- 172.21.15.6:0/2992016812 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a40a7050 con 0x7f14b415f500 2023-07-21T22:57:10.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.213+0000 7f14b2ffd640 1 -- 172.21.15.6:0/2992016812 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4003620 con 0x7f14b415f500 2023-07-21T22:57:10.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.213+0000 7f14ba796640 1 -- 172.21.15.6:0/2992016812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14b415f500 msgr2=0x7f14b406cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:10.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.213+0000 7f14ba796640 1 --2- 172.21.15.6:0/2992016812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14b415f500 0x7f14b406cef0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f14a40097a0 tx=0x7f14a401c460 comp rx=0 tx=0).stop 2023-07-21T22:57:10.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.213+0000 7f14ba796640 1 -- 172.21.15.6:0/2992016812 shutdown_connections 2023-07-21T22:57:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.213+0000 7f14ba796640 1 --2- 172.21.15.6:0/2992016812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14b406d430 0x7f14b406a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.213+0000 7f14ba796640 1 --2- 172.21.15.6:0/2992016812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14b415f500 0x7f14b406cef0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.213+0000 7f14ba796640 1 -- 172.21.15.6:0/2992016812 >> 172.21.15.6:0/2992016812 conn(0x7f14b40659d0 msgr2=0x7f14b4099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.213+0000 7f14ba796640 1 -- 172.21.15.6:0/2992016812 shutdown_connections 2023-07-21T22:57:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.213+0000 7f14ba796640 1 -- 172.21.15.6:0/2992016812 wait complete. 2023-07-21T22:57:10.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.213+0000 7f14ba796640 1 Processor -- start 2023-07-21T22:57:10.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14ba796640 1 -- start start 2023-07-21T22:57:10.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14ba796640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b406aa80 0x7f14b40cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:10.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14ba796640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14b406d430 0x7f14b40acf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14ba796640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14b415f500 0x7f14b41570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14ba796640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40ca880 con 0x7f14b406aa80 2023-07-21T22:57:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14ba796640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40cab60 con 0x7f14b406d430 2023-07-21T22:57:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14ba796640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40cae40 con 0x7f14b415f500 2023-07-21T22:57:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14b3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b406aa80 0x7f14b40cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14b3fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b406aa80 0x7f14b40cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39700/0 (socket says 172.21.15.6:39700) 2023-07-21T22:57:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14b3fff640 1 -- 172.21.15.6:0/2050801581 learned_addr learned my addr 172.21.15.6:0/2050801581 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14b37fe640 1 --2- 172.21.15.6:0/2050801581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14b406d430 0x7f14b40acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14b8d33640 1 --2- 172.21.15.6:0/2050801581 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14b415f500 0x7f14b41570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14b3fff640 1 -- 172.21.15.6:0/2050801581 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14b415f500 msgr2=0x7f14b41570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14b3fff640 1 --2- 172.21.15.6:0/2050801581 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14b415f500 0x7f14b41570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14b3fff640 1 -- 172.21.15.6:0/2050801581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14b406d430 msgr2=0x7f14b40acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14b3fff640 1 --2- 172.21.15.6:0/2050801581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14b406d430 0x7f14b40acf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14b3fff640 1 -- 172.21.15.6:0/2050801581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a8009420 con 0x7f14b406aa80 2023-07-21T22:57:10.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14b3fff640 1 --2- 172.21.15.6:0/2050801581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b406aa80 0x7f14b40cb920 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f14a401a090 tx=0x7f14a4019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14b0ff9640 1 -- 172.21.15.6:0/2050801581 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4005ba0 con 0x7f14b406aa80 2023-07-21T22:57:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14b0ff9640 1 -- 172.21.15.6:0/2050801581 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a4005d00 con 0x7f14b406aa80 2023-07-21T22:57:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14b0ff9640 1 -- 172.21.15.6:0/2050801581 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4003b30 con 0x7f14b406aa80 2023-07-21T22:57:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14ba796640 1 -- 172.21.15.6:0/2050801581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a40093b0 con 0x7f14b406aa80 2023-07-21T22:57:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14ba796640 1 -- 172.21.15.6:0/2050801581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b40cb400 con 0x7f14b406aa80 2023-07-21T22:57:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.217+0000 7f14ba796640 1 -- 172.21.15.6:0/2050801581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b40678d0 con 0x7f14b406aa80 2023-07-21T22:57:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.221+0000 7f14b0ff9640 1 -- 172.21.15.6:0/2050801581 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f14a40b2040 con 0x7f14b406aa80 2023-07-21T22:57:10.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.221+0000 7f14b0ff9640 1 --2- 172.21.15.6:0/2050801581 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f14a00663d0 0x7f14a0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:10.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.221+0000 7f14b0ff9640 1 -- 172.21.15.6:0/2050801581 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6994+0+0 (secure 0 0 0) 0x7f14a411e0d0 con 0x7f14b406aa80 2023-07-21T22:57:10.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.221+0000 7f14b37fe640 1 --2- 172.21.15.6:0/2050801581 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f14a00663d0 0x7f14a0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:10.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.221+0000 7f14b37fe640 1 --2- 172.21.15.6:0/2050801581 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f14a00663d0 0x7f14a0068880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009c80 tx=0x7f14a8008040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:10.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.225+0000 7f14b0ff9640 1 -- 172.21.15.6:0/2050801581 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14a40eaf70 con 0x7f14b406aa80 2023-07-21T22:57:10.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.417+0000 7f14ba796640 1 -- 172.21.15.6:0/2050801581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f14b40ca2d0 con 0x7f14b406aa80 2023-07-21T22:57:10.452 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-07-21T22:57:10.417+0000 7f195e836640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-21T22:57:10.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.421+0000 7f14b0ff9640 1 -- 172.21.15.6:0/2050801581 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v79) v1 ==== 161+0+0 (secure 0 0 0) 0x7f14a40b0090 con 0x7f14b406aa80 2023-07-21T22:57:10.457 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-21T22:57:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.425+0000 7f14ba796640 1 -- 172.21.15.6:0/2050801581 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f14a00663d0 msgr2=0x7f14a0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.425+0000 7f14ba796640 1 --2- 172.21.15.6:0/2050801581 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f14a00663d0 0x7f14a0068880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009c80 tx=0x7f14a8008040 comp rx=0 tx=0).stop 2023-07-21T22:57:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.425+0000 7f14ba796640 1 -- 172.21.15.6:0/2050801581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b406aa80 msgr2=0x7f14b40cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:10.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.425+0000 7f14ba796640 1 --2- 172.21.15.6:0/2050801581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b406aa80 0x7f14b40cb920 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f14a401a090 tx=0x7f14a4019200 comp rx=0 tx=0).stop 2023-07-21T22:57:10.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.425+0000 7f14ba796640 1 -- 172.21.15.6:0/2050801581 shutdown_connections 2023-07-21T22:57:10.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.425+0000 7f14ba796640 1 --2- 172.21.15.6:0/2050801581 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f14a00663d0 0x7f14a0068880 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:10.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.425+0000 7f14ba796640 1 --2- 172.21.15.6:0/2050801581 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14b415f500 0x7f14b41570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:10.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.425+0000 7f14ba796640 1 --2- 172.21.15.6:0/2050801581 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14b406d430 0x7f14b40acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:10.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.425+0000 7f14ba796640 1 --2- 172.21.15.6:0/2050801581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b406aa80 0x7f14b40cb920 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:10.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.425+0000 7f14ba796640 1 -- 172.21.15.6:0/2050801581 >> 172.21.15.6:0/2050801581 conn(0x7f14b40659d0 msgr2=0x7f14b415b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:10.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.425+0000 7f14ba796640 1 -- 172.21.15.6:0/2050801581 shutdown_connections 2023-07-21T22:57:10.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.425+0000 7f14ba796640 1 -- 172.21.15.6:0/2050801581 wait complete. 2023-07-21T22:57:10.480 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-21T22:57:10.522 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-07-21T22:57:10.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.593+0000 7f07e892c640 1 Processor -- start 2023-07-21T22:57:10.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.593+0000 7f07e892c640 1 -- start start 2023-07-21T22:57:10.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.597+0000 7f07e892c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07e40ce3e0 0x7f07e40d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.597+0000 7f07e892c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f07e40b0470 0x7f07e4142be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.597+0000 7f07e892c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e40b17d0 con 0x7f07e40aea90 2023-07-21T22:57:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.597+0000 7f07e892c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e40aee60 con 0x7f07e40b0470 2023-07-21T22:57:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.597+0000 7f07e892c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e40b08f0 con 0x7f07e40ce3e0 2023-07-21T22:57:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.597+0000 7f07e259c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f07e40aea90 0x7f07e40cdcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49316/0 (socket says 172.21.15.6:49316) 2023-07-21T22:57:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.597+0000 7f07e259c640 1 -- 172.21.15.6:0/2018995643 learned_addr learned my addr 172.21.15.6:0/2018995643 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.597+0000 7f07e2d9d640 1 --2- 172.21.15.6:0/2018995643 >> v2:172.21.15.6:3300/0 conn(0x7f07e40b0470 0x7f07e4142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:10.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.597+0000 7f07dbfff640 1 --2- 172.21.15.6:0/2018995643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07e40ce3e0 0x7f07e40d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:10.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.597+0000 7f07e2d9d640 1 -- 172.21.15.6:0/2018995643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07e40ce3e0 msgr2=0x7f07e40d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:10.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.597+0000 7f07e2d9d640 1 --2- 172.21.15.6:0/2018995643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07e40ce3e0 0x7f07e40d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:10.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.597+0000 7f07e2d9d640 1 -- 172.21.15.6:0/2018995643 >> v1:172.21.15.6:6789/0 conn(0x7f07e40aea90 legacy=0x7f07e40cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:10.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.597+0000 7f07e2d9d640 1 -- 172.21.15.6:0/2018995643 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e40b0bc0 con 0x7f07e40b0470 2023-07-21T22:57:10.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.601+0000 7f07e2d9d640 1 --2- 172.21.15.6:0/2018995643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e40b0470 0x7f07e4142be0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009d90 tx=0x7f07dc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c121a89d8d06ac9f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:10.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.601+0000 7f07e1d9b640 1 -- 172.21.15.6:0/2018995643 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc0a59e0 con 0x7f07e40b0470 2023-07-21T22:57:10.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.601+0000 7f07e1d9b640 1 -- 172.21.15.6:0/2018995643 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07dc0a5b40 con 0x7f07e40b0470 2023-07-21T22:57:10.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.601+0000 7f07e1d9b640 1 -- 172.21.15.6:0/2018995643 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc0ad440 con 0x7f07e40b0470 2023-07-21T22:57:10.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.601+0000 7f07e892c640 1 -- 172.21.15.6:0/2018995643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e40b0470 msgr2=0x7f07e4142be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:10.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.601+0000 7f07e892c640 1 --2- 172.21.15.6:0/2018995643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e40b0470 0x7f07e4142be0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009d90 tx=0x7f07dc01c920 comp rx=0 tx=0).stop 2023-07-21T22:57:10.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.601+0000 7f07e892c640 1 -- 172.21.15.6:0/2018995643 shutdown_connections 2023-07-21T22:57:10.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.601+0000 7f07e892c640 1 --2- 172.21.15.6:0/2018995643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e40b0470 0x7f07e4142be0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:10.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.601+0000 7f07e892c640 1 --2- 172.21.15.6:0/2018995643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07e40ce3e0 0x7f07e40d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:10.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.601+0000 7f07e892c640 1 -- 172.21.15.6:0/2018995643 >> 172.21.15.6:0/2018995643 conn(0x7f07e4099490 msgr2=0x7f07e4089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:10.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.601+0000 7f07e892c640 1 -- 172.21.15.6:0/2018995643 shutdown_connections 2023-07-21T22:57:10.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.601+0000 7f07e892c640 1 -- 172.21.15.6:0/2018995643 wait complete. 2023-07-21T22:57:10.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.601+0000 7f07e892c640 1 Processor -- start 2023-07-21T22:57:10.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.601+0000 7f07e892c640 1 -- start start 2023-07-21T22:57:10.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.601+0000 7f07e892c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e40aea90 0x7f07e415c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:10.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07e892c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07e40b0470 0x7f07e40b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:10.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07e892c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07e40ce3e0 0x7f07e406dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:10.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07e892c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e415d1e0 con 0x7f07e40aea90 2023-07-21T22:57:10.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07e892c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e40b55a0 con 0x7f07e40b0470 2023-07-21T22:57:10.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07e892c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e409dc60 con 0x7f07e40ce3e0 2023-07-21T22:57:10.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07e259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e40aea90 0x7f07e415c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:10.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07e259c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e40aea90 0x7f07e415c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39732/0 (socket says 172.21.15.6:39732) 2023-07-21T22:57:10.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07e259c640 1 -- 172.21.15.6:0/2303320781 learned_addr learned my addr 172.21.15.6:0/2303320781 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:10.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07dbfff640 1 --2- 172.21.15.6:0/2303320781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07e40b0470 0x7f07e40b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:10.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07e259c640 1 -- 172.21.15.6:0/2303320781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07e40ce3e0 msgr2=0x7f07e406dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:10.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07e259c640 1 --2- 172.21.15.6:0/2303320781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07e40ce3e0 0x7f07e406dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:10.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07e259c640 1 -- 172.21.15.6:0/2303320781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07e40b0470 msgr2=0x7f07e40b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:10.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07e259c640 1 --2- 172.21.15.6:0/2303320781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07e40b0470 0x7f07e40b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:10.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07e259c640 1 -- 172.21.15.6:0/2303320781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc009a70 con 0x7f07e40aea90 2023-07-21T22:57:10.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07dbfff640 1 --2- 172.21.15.6:0/2303320781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07e40b0470 0x7f07e40b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:10.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07e259c640 1 --2- 172.21.15.6:0/2303320781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e40aea90 0x7f07e415c990 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f07d400c4d0 tx=0x7f07d400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:10.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07daffd640 1 -- 172.21.15.6:0/2303320781 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d4007480 con 0x7f07e40aea90 2023-07-21T22:57:10.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07daffd640 1 -- 172.21.15.6:0/2303320781 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d40075e0 con 0x7f07e40aea90 2023-07-21T22:57:10.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07daffd640 1 -- 172.21.15.6:0/2303320781 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40059b0 con 0x7f07e40aea90 2023-07-21T22:57:10.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07e892c640 1 -- 172.21.15.6:0/2303320781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e409d6a0 con 0x7f07e40aea90 2023-07-21T22:57:10.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07e892c640 1 -- 172.21.15.6:0/2303320781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e415a240 con 0x7f07e40aea90 2023-07-21T22:57:10.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07e892c640 1 -- 172.21.15.6:0/2303320781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e40678d0 con 0x7f07e40aea90 2023-07-21T22:57:10.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07daffd640 1 -- 172.21.15.6:0/2303320781 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f07d4005b10 con 0x7f07e40aea90 2023-07-21T22:57:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.605+0000 7f07daffd640 1 --2- 172.21.15.6:0/2303320781 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f07c40663a0 0x7f07c4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.609+0000 7f07daffd640 1 -- 172.21.15.6:0/2303320781 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7080+0+0 (secure 0 0 0) 0x7f07d40836d0 con 0x7f07e40aea90 2023-07-21T22:57:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.609+0000 7f07dbfff640 1 --2- 172.21.15.6:0/2303320781 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f07c40663a0 0x7f07c4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.609+0000 7f07dbfff640 1 --2- 172.21.15.6:0/2303320781 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f07c40663a0 0x7f07c4068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f07e406e9a0 tx=0x7f07cc008040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.609+0000 7f07daffd640 1 -- 172.21.15.6:0/2303320781 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f07d40506e0 con 0x7f07e40aea90 2023-07-21T22:57:10.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:10.797+0000 7f07e892c640 1 -- 172.21.15.6:0/2303320781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f07e40b1460 con 0x7f07e40aea90 2023-07-21T22:57:11.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.429+0000 7f07daffd640 1 -- 172.21.15.6:0/2303320781 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v80) v1 ==== 104+0+0 (secure 0 0 0) 0x7f07d4053d00 con 0x7f07e40aea90 2023-07-21T22:57:11.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.429+0000 7f07e892c640 1 -- 172.21.15.6:0/2303320781 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f07c40663a0 msgr2=0x7f07c4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:11.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.429+0000 7f07e892c640 1 --2- 172.21.15.6:0/2303320781 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f07c40663a0 0x7f07c4068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f07e406e9a0 tx=0x7f07cc008040 comp rx=0 tx=0).stop 2023-07-21T22:57:11.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.429+0000 7f07e892c640 1 -- 172.21.15.6:0/2303320781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e40aea90 msgr2=0x7f07e415c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:11.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.429+0000 7f07e892c640 1 --2- 172.21.15.6:0/2303320781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e40aea90 0x7f07e415c990 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f07d400c4d0 tx=0x7f07d400c990 comp rx=0 tx=0).stop 2023-07-21T22:57:11.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.429+0000 7f07e892c640 1 -- 172.21.15.6:0/2303320781 shutdown_connections 2023-07-21T22:57:11.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.429+0000 7f07e892c640 1 --2- 172.21.15.6:0/2303320781 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f07c40663a0 0x7f07c4068850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:11.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.429+0000 7f07e892c640 1 --2- 172.21.15.6:0/2303320781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07e40ce3e0 0x7f07e406dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:11.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.429+0000 7f07e892c640 1 --2- 172.21.15.6:0/2303320781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07e40b0470 0x7f07e40b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:11.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.429+0000 7f07e892c640 1 --2- 172.21.15.6:0/2303320781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e40aea90 0x7f07e415c990 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:11.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.429+0000 7f07e892c640 1 -- 172.21.15.6:0/2303320781 >> 172.21.15.6:0/2303320781 conn(0x7f07e4099490 msgr2=0x7f07e40afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:11.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.429+0000 7f07e892c640 1 -- 172.21.15.6:0/2303320781 shutdown_connections 2023-07-21T22:57:11.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.429+0000 7f07e892c640 1 -- 172.21.15.6:0/2303320781 wait complete. 2023-07-21T22:57:11.486 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-21T22:57:11.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.645+0000 7f7667974640 1 Processor -- start 2023-07-21T22:57:11.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.645+0000 7f7667974640 1 -- start start 2023-07-21T22:57:11.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.645+0000 7f7667974640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7660069430 0x7f76600cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:11.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.645+0000 7f7667974640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7660160030 0x7f7660069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:11.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.645+0000 7f7667974640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7660069d40 con 0x7f7660070330 2023-07-21T22:57:11.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.645+0000 7f7667974640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76600cb7d0 con 0x7f7660069430 2023-07-21T22:57:11.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.645+0000 7f7667974640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766006c510 con 0x7f7660160030 2023-07-21T22:57:11.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.645+0000 7f7665710640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7660069430 0x7f76600cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:11.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.645+0000 7f7665710640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7660069430 0x7f76600cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39736/0 (socket says 172.21.15.6:39736) 2023-07-21T22:57:11.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.645+0000 7f7665710640 1 -- 172.21.15.6:0/4070322484 learned_addr learned my addr 172.21.15.6:0/4070322484 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:11.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.649+0000 7f7664f0f640 1 --2- 172.21.15.6:0/4070322484 >> v2:172.21.15.161:3300/0 conn(0x7f7660160030 0x7f7660069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:11.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.649+0000 7f7665710640 1 -- 172.21.15.6:0/4070322484 >> v2:172.21.15.161:3300/0 conn(0x7f7660160030 msgr2=0x7f7660069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:11.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.649+0000 7f7665710640 1 --2- 172.21.15.6:0/4070322484 >> v2:172.21.15.161:3300/0 conn(0x7f7660160030 0x7f7660069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:11.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.649+0000 7f7665710640 1 -- 172.21.15.6:0/4070322484 >> v1:172.21.15.161:6789/0 conn(0x7f7660070330 legacy=0x7f7660070750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:11.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.649+0000 7f7665710640 1 -- 172.21.15.6:0/4070322484 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766006c7f0 con 0x7f7660069430 2023-07-21T22:57:11.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.649+0000 7f7664f0f640 1 --2- 172.21.15.6:0/4070322484 >> v2:172.21.15.161:3300/0 conn(0x7f7660160030 0x7f7660069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.649+0000 7f7665710640 1 --2- 172.21.15.6:0/4070322484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7660069430 0x7f76600cb0f0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f7660065f00 tx=0x7f765c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7fd49032b965d5f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.649+0000 7f7657fff640 1 -- 172.21.15.6:0/4070322484 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c0ab600 con 0x7f7660069430 2023-07-21T22:57:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.649+0000 7f7657fff640 1 -- 172.21.15.6:0/4070322484 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765c0ab760 con 0x7f7660069430 2023-07-21T22:57:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.649+0000 7f7657fff640 1 -- 172.21.15.6:0/4070322484 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c0abaf0 con 0x7f7660069430 2023-07-21T22:57:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.649+0000 7f7667974640 1 -- 172.21.15.6:0/4070322484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7660069430 msgr2=0x7f76600cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.649+0000 7f7667974640 1 --2- 172.21.15.6:0/4070322484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7660069430 0x7f76600cb0f0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f7660065f00 tx=0x7f765c01c400 comp rx=0 tx=0).stop 2023-07-21T22:57:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.649+0000 7f7667974640 1 -- 172.21.15.6:0/4070322484 shutdown_connections 2023-07-21T22:57:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.649+0000 7f7667974640 1 --2- 172.21.15.6:0/4070322484 >> v2:172.21.15.161:3300/0 conn(0x7f7660160030 0x7f7660069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.649+0000 7f7667974640 1 --2- 172.21.15.6:0/4070322484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7660069430 0x7f76600cb0f0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.649+0000 7f7667974640 1 -- 172.21.15.6:0/4070322484 >> 172.21.15.6:0/4070322484 conn(0x7f76600b1840 msgr2=0x7f76600cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7667974640 1 -- 172.21.15.6:0/4070322484 shutdown_connections 2023-07-21T22:57:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7667974640 1 -- 172.21.15.6:0/4070322484 wait complete. 2023-07-21T22:57:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7667974640 1 Processor -- start 2023-07-21T22:57:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7667974640 1 -- start start 2023-07-21T22:57:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7667974640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7660069430 0x7f766014b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7667974640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7660070330 0x7f766014bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7667974640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7660160030 0x7f766014c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7667974640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766014bbd0 con 0x7f7660160030 2023-07-21T22:57:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7667974640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f766015cf00 con 0x7f7660069430 2023-07-21T22:57:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7667974640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76600c8d30 con 0x7f7660070330 2023-07-21T22:57:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7665f11640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7660160030 0x7f766014c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7665f11640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7660160030 0x7f766014c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39740/0 (socket says 172.21.15.6:39740) 2023-07-21T22:57:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7665f11640 1 -- 172.21.15.6:0/3637175900 learned_addr learned my addr 172.21.15.6:0/3637175900 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7664f0f640 1 --2- 172.21.15.6:0/3637175900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7660070330 0x7f766014bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7665710640 1 --2- 172.21.15.6:0/3637175900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7660069430 0x7f766014b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7665f11640 1 -- 172.21.15.6:0/3637175900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7660070330 msgr2=0x7f766014bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7665f11640 1 --2- 172.21.15.6:0/3637175900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7660070330 0x7f766014bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7665f11640 1 -- 172.21.15.6:0/3637175900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7660069430 msgr2=0x7f766014b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7665f11640 1 --2- 172.21.15.6:0/3637175900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7660069430 0x7f766014b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7665f11640 1 -- 172.21.15.6:0/3637175900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c0094d0 con 0x7f7660160030 2023-07-21T22:57:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.653+0000 7f7665f11640 1 --2- 172.21.15.6:0/3637175900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7660160030 0x7f766014c2b0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f765800b970 tx=0x7f765800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.657+0000 7f7655ffb640 1 -- 172.21.15.6:0/3637175900 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765800cb40 con 0x7f7660160030 2023-07-21T22:57:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.657+0000 7f7655ffb640 1 -- 172.21.15.6:0/3637175900 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765800cca0 con 0x7f7660160030 2023-07-21T22:57:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.657+0000 7f7667974640 1 -- 172.21.15.6:0/3637175900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76601605b0 con 0x7f7660160030 2023-07-21T22:57:11.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.657+0000 7f7655ffb640 1 -- 172.21.15.6:0/3637175900 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7658014680 con 0x7f7660160030 2023-07-21T22:57:11.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.657+0000 7f7667974640 1 -- 172.21.15.6:0/3637175900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766015cb90 con 0x7f7660160030 2023-07-21T22:57:11.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.657+0000 7f7667974640 1 -- 172.21.15.6:0/3637175900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766015c710 con 0x7f7660160030 2023-07-21T22:57:11.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.657+0000 7f7655ffb640 1 -- 172.21.15.6:0/3637175900 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f765801d3b0 con 0x7f7660160030 2023-07-21T22:57:11.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.657+0000 7f7655ffb640 1 --2- 172.21.15.6:0/3637175900 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f76440663a0 0x7f7644068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:11.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.657+0000 7f7655ffb640 1 -- 172.21.15.6:0/3637175900 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 7080+0+0 (secure 0 0 0) 0x7f7658083fd0 con 0x7f7660160030 2023-07-21T22:57:11.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.657+0000 7f7665710640 1 --2- 172.21.15.6:0/3637175900 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f76440663a0 0x7f7644068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:11.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.661+0000 7f7665710640 1 --2- 172.21.15.6:0/3637175900 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f76440663a0 0x7f7644068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f765c0af000 tx=0x7f765c0b6040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:11.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.661+0000 7f7655ffb640 1 -- 172.21.15.6:0/3637175900 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f766015c710 con 0x7f7660160030 2023-07-21T22:57:11.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:11.817+0000 7f7667974640 1 -- 172.21.15.6:0/3637175900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f766015c710 con 0x7f7660160030 2023-07-21T22:57:12.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.433+0000 7f7655ffb640 1 -- 172.21.15.6:0/3637175900 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v182) v1 ==== 181+0+0 (secure 0 0 0) 0x7f766015c710 con 0x7f7660160030 2023-07-21T22:57:12.467 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-07-21T22:57:12.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.433+0000 7f7667974640 1 -- 172.21.15.6:0/3637175900 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f76440663a0 msgr2=0x7f7644068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:12.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.433+0000 7f7667974640 1 --2- 172.21.15.6:0/3637175900 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f76440663a0 0x7f7644068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f765c0af000 tx=0x7f765c0b6040 comp rx=0 tx=0).stop 2023-07-21T22:57:12.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.433+0000 7f7667974640 1 -- 172.21.15.6:0/3637175900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7660160030 msgr2=0x7f766014c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:12.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.433+0000 7f7667974640 1 --2- 172.21.15.6:0/3637175900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7660160030 0x7f766014c2b0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f765800b970 tx=0x7f765800be30 comp rx=0 tx=0).stop 2023-07-21T22:57:12.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.437+0000 7f7667974640 1 -- 172.21.15.6:0/3637175900 shutdown_connections 2023-07-21T22:57:12.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.437+0000 7f7667974640 1 --2- 172.21.15.6:0/3637175900 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f76440663a0 0x7f7644068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:12.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.437+0000 7f7667974640 1 --2- 172.21.15.6:0/3637175900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7660160030 0x7f766014c2b0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:12.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.437+0000 7f7667974640 1 --2- 172.21.15.6:0/3637175900 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7660070330 0x7f766014bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:12.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.437+0000 7f7667974640 1 --2- 172.21.15.6:0/3637175900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7660069430 0x7f766014b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:12.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.437+0000 7f7667974640 1 -- 172.21.15.6:0/3637175900 >> 172.21.15.6:0/3637175900 conn(0x7f76600b1840 msgr2=0x7f76600ceaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:12.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.437+0000 7f7667974640 1 -- 172.21.15.6:0/3637175900 shutdown_connections 2023-07-21T22:57:12.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.437+0000 7f7667974640 1 -- 172.21.15.6:0/3637175900 wait complete. 2023-07-21T22:57:12.495 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-21T22:57:12.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f1286d640 1 Processor -- start 2023-07-21T22:57:12.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f1286d640 1 -- start start 2023-07-21T22:57:12.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f1286d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f0c06a440 0x7f2f0c0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:12.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f1286d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2f0c1453a0 0x7f2f0c06c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:12.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f1286d640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0c06c040 con 0x7f2f0c15f690 2023-07-21T22:57:12.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f1286d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0c160170 con 0x7f2f0c1453a0 2023-07-21T22:57:12.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f1286d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c160600 con 0x7f2f0c06a440 2023-07-21T22:57:12.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0bfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2f0c15f690 0x7f2f0c15fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49328/0 (socket says 172.21.15.6:49328) 2023-07-21T22:57:12.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0bfff640 1 -- 172.21.15.6:0/3480859613 learned_addr learned my addr 172.21.15.6:0/3480859613 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:12.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f10e0a640 1 --2- 172.21.15.6:0/3480859613 >> v2:172.21.15.161:3300/0 conn(0x7f2f0c1453a0 0x7f2f0c06c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:12.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0b7fe640 1 --2- 172.21.15.6:0/3480859613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f0c06a440 0x7f2f0c0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:12.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0affd640 1 -- 172.21.15.6:0/3480859613 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080325942 0 0) 0x7f2f0c06c040 con 0x7f2f0c15f690 2023-07-21T22:57:12.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0affd640 1 -- 172.21.15.6:0/3480859613 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ef4003530 con 0x7f2f0c15f690 2023-07-21T22:57:12.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0affd640 1 -- 172.21.15.6:0/3480859613 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 874432172 0 0) 0x7f2ef4003530 con 0x7f2f0c15f690 2023-07-21T22:57:12.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0affd640 1 -- 172.21.15.6:0/3480859613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f0c06a440 msgr2=0x7f2f0c0b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:12.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0affd640 1 --2- 172.21.15.6:0/3480859613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f0c06a440 0x7f2f0c0b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:12.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0affd640 1 -- 172.21.15.6:0/3480859613 >> v2:172.21.15.161:3300/0 conn(0x7f2f0c1453a0 msgr2=0x7f2f0c06c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:12.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0affd640 1 --2- 172.21.15.6:0/3480859613 >> v2:172.21.15.161:3300/0 conn(0x7f2f0c1453a0 0x7f2f0c06c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:12.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0affd640 1 -- 172.21.15.6:0/3480859613 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c160360 con 0x7f2f0c15f690 2023-07-21T22:57:12.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0affd640 1 -- 172.21.15.6:0/3480859613 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f2efc001680 con 0x7f2f0c15f690 2023-07-21T22:57:12.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0affd640 1 -- 172.21.15.6:0/3480859613 >> v1:172.21.15.6:6789/0 conn(0x7f2f0c15f690 legacy=0x7f2f0c15fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:12.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0affd640 1 --2- 172.21.15.6:0/3480859613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f0c06a440 0x7f2ef4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:12.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0affd640 1 --2- 172.21.15.6:0/3480859613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ef4003f00 0x7f2ef40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:12.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0affd640 1 --2- 172.21.15.6:0/3480859613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef4004d10 0x7f2ef4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:12.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0affd640 1 -- 172.21.15.6:0/3480859613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c160600 con 0x7f2ef4004d10 2023-07-21T22:57:12.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0affd640 1 -- 172.21.15.6:0/3480859613 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef400b990 con 0x7f2ef4003f00 2023-07-21T22:57:12.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0affd640 1 -- 172.21.15.6:0/3480859613 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef400bb00 con 0x7f2f0c06a440 2023-07-21T22:57:12.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f10e0a640 1 --2- 172.21.15.6:0/3480859613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef4004d10 0x7f2ef4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:12.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0b7fe640 1 --2- 172.21.15.6:0/3480859613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ef4003f00 0x7f2ef40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:12.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.617+0000 7f2f0bfff640 1 --2- 172.21.15.6:0/3480859613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f0c06a440 0x7f2ef4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:12.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.621+0000 7f2f10e0a640 1 -- 172.21.15.6:0/3480859613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f0c06a440 msgr2=0x7f2ef4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:12.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.621+0000 7f2f10e0a640 1 --2- 172.21.15.6:0/3480859613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f0c06a440 0x7f2ef4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:12.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.621+0000 7f2f10e0a640 1 -- 172.21.15.6:0/3480859613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ef4003f00 msgr2=0x7f2ef40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:12.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.621+0000 7f2f10e0a640 1 --2- 172.21.15.6:0/3480859613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ef4003f00 0x7f2ef40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:12.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.621+0000 7f2f10e0a640 1 -- 172.21.15.6:0/3480859613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef4003530 con 0x7f2ef4004d10 2023-07-21T22:57:12.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.621+0000 7f2f10e0a640 1 --2- 172.21.15.6:0/3480859613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef4004d10 0x7f2ef4005180 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009fc0 tx=0x7f2f0401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e780f3d3e80fb6e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:12.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.621+0000 7f2f0affd640 1 -- 172.21.15.6:0/3480859613 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f040a5ba0 con 0x7f2ef4004d10 2023-07-21T22:57:12.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.621+0000 7f2f0affd640 1 -- 172.21.15.6:0/3480859613 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0400f040 con 0x7f2ef4004d10 2023-07-21T22:57:12.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.621+0000 7f2f0affd640 1 -- 172.21.15.6:0/3480859613 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f040ad440 con 0x7f2ef4004d10 2023-07-21T22:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.621+0000 7f2f1286d640 1 -- 172.21.15.6:0/3480859613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef4004d10 msgr2=0x7f2ef4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.621+0000 7f2f1286d640 1 --2- 172.21.15.6:0/3480859613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef4004d10 0x7f2ef4005180 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009fc0 tx=0x7f2f0401cc40 comp rx=0 tx=0).stop 2023-07-21T22:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.621+0000 7f2f10e0a640 1 -- 172.21.15.6:0/3480859613 reap_dead start 2023-07-21T22:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.621+0000 7f2f1286d640 1 -- 172.21.15.6:0/3480859613 shutdown_connections 2023-07-21T22:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.621+0000 7f2f1286d640 1 -- 172.21.15.6:0/3480859613 >> 172.21.15.6:0/3480859613 conn(0x7f2f0c0b1210 msgr2=0x7f2f0c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.621+0000 7f2f1286d640 1 -- 172.21.15.6:0/3480859613 shutdown_connections 2023-07-21T22:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.621+0000 7f2f1286d640 1 -- 172.21.15.6:0/3480859613 wait complete. 2023-07-21T22:57:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f1286d640 1 Processor -- start 2023-07-21T22:57:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f1286d640 1 -- start start 2023-07-21T22:57:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f1286d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef4004d10 0x7f2f0c15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f1286d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f0c1430a0 0x7f2f0c15af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f1286d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f0c0abd50 0x7f2f0c0ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f1286d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c15efd0 con 0x7f2ef4004d10 2023-07-21T22:57:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f1286d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0ac700 con 0x7f2f0c0abd50 2023-07-21T22:57:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f1286d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c13ef80 con 0x7f2f0c1430a0 2023-07-21T22:57:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f0bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef4004d10 0x7f2f0c15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:12.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f0bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef4004d10 0x7f2f0c15e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39768/0 (socket says 172.21.15.6:39768) 2023-07-21T22:57:12.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f0bfff640 1 -- 172.21.15.6:0/658973643 learned_addr learned my addr 172.21.15.6:0/658973643 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:12.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f0bfff640 1 -- 172.21.15.6:0/658973643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f0c1430a0 msgr2=0x7f2f0c15af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:12.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f0bfff640 1 --2- 172.21.15.6:0/658973643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f0c1430a0 0x7f2f0c15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:12.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f0bfff640 1 -- 172.21.15.6:0/658973643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f0c0abd50 msgr2=0x7f2f0c0ac1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:12.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f10e0a640 1 --2- 172.21.15.6:0/658973643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f0c0abd50 0x7f2f0c0ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:12.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f0bfff640 1 --2- 172.21.15.6:0/658973643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f0c0abd50 0x7f2f0c0ac1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:12.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f0bfff640 1 -- 172.21.15.6:0/658973643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c15ed30 con 0x7f2ef4004d10 2023-07-21T22:57:12.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f10e0a640 1 --2- 172.21.15.6:0/658973643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f0c0abd50 0x7f2f0c0ac1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:12.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f0bfff640 1 --2- 172.21.15.6:0/658973643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef4004d10 0x7f2f0c15e7f0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f2efc011980 tx=0x7f2efc011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:12.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f08ff9640 1 -- 172.21.15.6:0/658973643 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc00fc20 con 0x7f2ef4004d10 2023-07-21T22:57:12.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f08ff9640 1 -- 172.21.15.6:0/658973643 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc00fd80 con 0x7f2ef4004d10 2023-07-21T22:57:12.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f08ff9640 1 -- 172.21.15.6:0/658973643 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc015650 con 0x7f2ef4004d10 2023-07-21T22:57:12.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.625+0000 7f2f1286d640 1 -- 172.21.15.6:0/658973643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0c13f200 con 0x7f2ef4004d10 2023-07-21T22:57:12.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.629+0000 7f2f1286d640 1 -- 172.21.15.6:0/658973643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0c13f7c0 con 0x7f2ef4004d10 2023-07-21T22:57:12.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.629+0000 7f2f1286d640 1 -- 172.21.15.6:0/658973643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0c0678d0 con 0x7f2ef4004d10 2023-07-21T22:57:12.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.629+0000 7f2f08ff9640 1 -- 172.21.15.6:0/658973643 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2efc0157b0 con 0x7f2ef4004d10 2023-07-21T22:57:12.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.629+0000 7f2f08ff9640 1 --2- 172.21.15.6:0/658973643 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f2ef80663a0 0x7f2ef8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:12.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.629+0000 7f2f08ff9640 1 -- 172.21.15.6:0/658973643 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6642+0+0 (secure 0 0 0) 0x7f2efc0875d0 con 0x7f2ef4004d10 2023-07-21T22:57:12.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.629+0000 7f2f0b7fe640 1 --2- 172.21.15.6:0/658973643 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f2ef80663a0 0x7f2ef8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:12.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.629+0000 7f2f0b7fe640 1 --2- 172.21.15.6:0/658973643 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f2ef80663a0 0x7f2ef8068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0cd910 tx=0x7f2f000095f0 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:12.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.633+0000 7f2f08ff9640 1 -- 172.21.15.6:0/658973643 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2efc0546d0 con 0x7f2ef4004d10 2023-07-21T22:57:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:12.789+0000 7f2f1286d640 1 -- 172.21.15.6:0/658973643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2f0c0cf300 con 0x7f2ef4004d10 2023-07-21T22:57:13.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.265+0000 7f2f08ff9640 1 -- 172.21.15.6:0/658973643 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v183) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2efc057cf0 con 0x7f2ef4004d10 2023-07-21T22:57:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-07-21T22:57:13.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.269+0000 7f2f1286d640 1 -- 172.21.15.6:0/658973643 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f2ef80663a0 msgr2=0x7f2ef8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:13.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.269+0000 7f2f1286d640 1 --2- 172.21.15.6:0/658973643 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f2ef80663a0 0x7f2ef8068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c0cd910 tx=0x7f2f000095f0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.269+0000 7f2f1286d640 1 -- 172.21.15.6:0/658973643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef4004d10 msgr2=0x7f2f0c15e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:13.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.269+0000 7f2f1286d640 1 --2- 172.21.15.6:0/658973643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef4004d10 0x7f2f0c15e7f0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f2efc011980 tx=0x7f2efc011e40 comp rx=0 tx=0).stop 2023-07-21T22:57:13.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.269+0000 7f2f1286d640 1 -- 172.21.15.6:0/658973643 shutdown_connections 2023-07-21T22:57:13.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.269+0000 7f2f1286d640 1 --2- 172.21.15.6:0/658973643 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f2ef80663a0 0x7f2ef8068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.269+0000 7f2f1286d640 1 --2- 172.21.15.6:0/658973643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2f0c0abd50 0x7f2f0c0ac1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.269+0000 7f2f1286d640 1 --2- 172.21.15.6:0/658973643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2f0c1430a0 0x7f2f0c15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.269+0000 7f2f1286d640 1 --2- 172.21.15.6:0/658973643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ef4004d10 0x7f2f0c15e7f0 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.269+0000 7f2f1286d640 1 -- 172.21.15.6:0/658973643 >> 172.21.15.6:0/658973643 conn(0x7f2f0c0b1210 msgr2=0x7f2f0c15fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:13.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.269+0000 7f2f1286d640 1 -- 172.21.15.6:0/658973643 shutdown_connections 2023-07-21T22:57:13.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.269+0000 7f2f1286d640 1 -- 172.21.15.6:0/658973643 wait complete. 2023-07-21T22:57:13.328 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-21T22:57:13.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.445+0000 7f3c26d40640 1 Processor -- start 2023-07-21T22:57:13.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.445+0000 7f3c26d40640 1 -- start start 2023-07-21T22:57:13.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.449+0000 7f3c26d40640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3c20145430 0x7f3c200b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:13.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.449+0000 7f3c26d40640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3c200b39f0 0x7f3c200d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:13.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.449+0000 7f3c26d40640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c200b2140 con 0x7f3c200d06b0 2023-07-21T22:57:13.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.449+0000 7f3c26d40640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c200b2410 con 0x7f3c200b39f0 2023-07-21T22:57:13.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.449+0000 7f3c26d40640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c200b26f0 con 0x7f3c20145430 2023-07-21T22:57:13.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.449+0000 7f3c24adc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3c200d06b0 0x7f3c200b1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49334/0 (socket says 172.21.15.6:49334) 2023-07-21T22:57:13.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.449+0000 7f3c24adc640 1 -- 172.21.15.6:0/218772340 learned_addr learned my addr 172.21.15.6:0/218772340 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:13.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.449+0000 7f3c252dd640 1 --2- 172.21.15.6:0/218772340 >> v2:172.21.15.6:3300/0 conn(0x7f3c200b39f0 0x7f3c200d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:13.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.449+0000 7f3c1ffff640 1 --2- 172.21.15.6:0/218772340 >> v2:172.21.15.161:3300/0 conn(0x7f3c20145430 0x7f3c200b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:13.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.449+0000 7f3c252dd640 1 -- 172.21.15.6:0/218772340 >> v2:172.21.15.161:3300/0 conn(0x7f3c20145430 msgr2=0x7f3c200b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:13.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.449+0000 7f3c252dd640 1 --2- 172.21.15.6:0/218772340 >> v2:172.21.15.161:3300/0 conn(0x7f3c20145430 0x7f3c200b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.449+0000 7f3c252dd640 1 -- 172.21.15.6:0/218772340 >> v1:172.21.15.6:6789/0 conn(0x7f3c200d06b0 legacy=0x7f3c200b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:13.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.449+0000 7f3c252dd640 1 -- 172.21.15.6:0/218772340 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c200b29d0 con 0x7f3c200b39f0 2023-07-21T22:57:13.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.449+0000 7f3c1ffff640 1 --2- 172.21.15.6:0/218772340 >> v2:172.21.15.161:3300/0 conn(0x7f3c20145430 0x7f3c200b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:13.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.449+0000 7f3c252dd640 1 --2- 172.21.15.6:0/218772340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c200b39f0 0x7f3c200d22e0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f3c2008b230 tx=0x7f3c1801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5942629ec9ae9a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:13.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.449+0000 7f3c1f7fe640 1 -- 172.21.15.6:0/218772340 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c180a58b0 con 0x7f3c200b39f0 2023-07-21T22:57:13.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.449+0000 7f3c1f7fe640 1 -- 172.21.15.6:0/218772340 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c180a5a10 con 0x7f3c200b39f0 2023-07-21T22:57:13.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.449+0000 7f3c1f7fe640 1 -- 172.21.15.6:0/218772340 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c180a5da0 con 0x7f3c200b39f0 2023-07-21T22:57:13.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.453+0000 7f3c26d40640 1 -- 172.21.15.6:0/218772340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c200b39f0 msgr2=0x7f3c200d22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:13.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.453+0000 7f3c26d40640 1 --2- 172.21.15.6:0/218772340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c200b39f0 0x7f3c200d22e0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f3c2008b230 tx=0x7f3c1801c8e0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.453+0000 7f3c26d40640 1 -- 172.21.15.6:0/218772340 shutdown_connections 2023-07-21T22:57:13.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.453+0000 7f3c26d40640 1 --2- 172.21.15.6:0/218772340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c200b39f0 0x7f3c200d22e0 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.453+0000 7f3c26d40640 1 --2- 172.21.15.6:0/218772340 >> v2:172.21.15.161:3300/0 conn(0x7f3c20145430 0x7f3c200b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.453+0000 7f3c26d40640 1 -- 172.21.15.6:0/218772340 >> 172.21.15.6:0/218772340 conn(0x7f3c200659d0 msgr2=0x7f3c2009b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:13.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.453+0000 7f3c26d40640 1 -- 172.21.15.6:0/218772340 shutdown_connections 2023-07-21T22:57:13.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.453+0000 7f3c26d40640 1 -- 172.21.15.6:0/218772340 wait complete. 2023-07-21T22:57:13.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.453+0000 7f3c26d40640 1 Processor -- start 2023-07-21T22:57:13.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.453+0000 7f3c26d40640 1 -- start start 2023-07-21T22:57:13.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.453+0000 7f3c26d40640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c200b39f0 0x7f3c20156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:13.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.453+0000 7f3c26d40640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c200d06b0 0x7f3c200cf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:13.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.453+0000 7f3c26d40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c201f7c40 0x7f3c201f80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:13.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.453+0000 7f3c26d40640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c201f8b30 con 0x7f3c200b39f0 2023-07-21T22:57:13.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.453+0000 7f3c26d40640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c201f8620 con 0x7f3c200d06b0 2023-07-21T22:57:13.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.453+0000 7f3c26d40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c200ced60 con 0x7f3c201f7c40 2023-07-21T22:57:13.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.453+0000 7f3c24adc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c200b39f0 0x7f3c20156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:13.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.453+0000 7f3c24adc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c200b39f0 0x7f3c20156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39788/0 (socket says 172.21.15.6:39788) 2023-07-21T22:57:13.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.453+0000 7f3c24adc640 1 -- 172.21.15.6:0/4025644609 learned_addr learned my addr 172.21.15.6:0/4025644609 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:13.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.457+0000 7f3c1ffff640 1 --2- 172.21.15.6:0/4025644609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c200d06b0 0x7f3c200cf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:13.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.457+0000 7f3c24adc640 1 -- 172.21.15.6:0/4025644609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c201f7c40 msgr2=0x7f3c201f80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:13.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.457+0000 7f3c252dd640 1 --2- 172.21.15.6:0/4025644609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c201f7c40 0x7f3c201f80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:13.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.457+0000 7f3c24adc640 1 --2- 172.21.15.6:0/4025644609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c201f7c40 0x7f3c201f80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.457+0000 7f3c24adc640 1 -- 172.21.15.6:0/4025644609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c200d06b0 msgr2=0x7f3c200cf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:13.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.457+0000 7f3c24adc640 1 --2- 172.21.15.6:0/4025644609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c200d06b0 0x7f3c200cf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.457+0000 7f3c24adc640 1 -- 172.21.15.6:0/4025644609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c18009a70 con 0x7f3c200b39f0 2023-07-21T22:57:13.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.457+0000 7f3c1ffff640 1 --2- 172.21.15.6:0/4025644609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c200d06b0 0x7f3c200cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:13.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.457+0000 7f3c252dd640 1 --2- 172.21.15.6:0/4025644609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c201f7c40 0x7f3c201f80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:13.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.457+0000 7f3c24adc640 1 --2- 172.21.15.6:0/4025644609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c200b39f0 0x7f3c20156b80 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f3c1400c530 tx=0x7f3c1400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:13.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.457+0000 7f3c1d7fa640 1 -- 172.21.15.6:0/4025644609 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c14005cf0 con 0x7f3c200b39f0 2023-07-21T22:57:13.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.457+0000 7f3c1d7fa640 1 -- 172.21.15.6:0/4025644609 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c14005e50 con 0x7f3c200b39f0 2023-07-21T22:57:13.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.457+0000 7f3c26d40640 1 -- 172.21.15.6:0/4025644609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c200ce150 con 0x7f3c200b39f0 2023-07-21T22:57:13.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.457+0000 7f3c1d7fa640 1 -- 172.21.15.6:0/4025644609 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c14007270 con 0x7f3c200b39f0 2023-07-21T22:57:13.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.457+0000 7f3c26d40640 1 -- 172.21.15.6:0/4025644609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c200ce710 con 0x7f3c200b39f0 2023-07-21T22:57:13.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.457+0000 7f3c26d40640 1 -- 172.21.15.6:0/4025644609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c20072e70 con 0x7f3c200b39f0 2023-07-21T22:57:13.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.457+0000 7f3c1d7fa640 1 -- 172.21.15.6:0/4025644609 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3c140073d0 con 0x7f3c200b39f0 2023-07-21T22:57:13.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.461+0000 7f3c1d7fa640 1 --2- 172.21.15.6:0/4025644609 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f3c040663a0 0x7f3c04068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:13.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.461+0000 7f3c1d7fa640 1 -- 172.21.15.6:0/4025644609 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6170+0+0 (secure 0 0 0) 0x7f3c14083320 con 0x7f3c200b39f0 2023-07-21T22:57:13.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.461+0000 7f3c1ffff640 1 --2- 172.21.15.6:0/4025644609 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f3c040663a0 0x7f3c04068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:13.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.461+0000 7f3c1ffff640 1 --2- 172.21.15.6:0/4025644609 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f3c040663a0 0x7f3c04068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3c20166da0 tx=0x7f3c0c008040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:13.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.465+0000 7f3c1d7fa640 1 -- 172.21.15.6:0/4025644609 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3c140506d0 con 0x7f3c200b39f0 2023-07-21T22:57:13.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.617+0000 7f3c26d40640 1 -- 172.21.15.6:0/4025644609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f3c200678d0 con 0x7f3c200b39f0 2023-07-21T22:57:13.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.625+0000 7f3c1d7fa640 1 -- 172.21.15.6:0/4025644609 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v61) v1 ==== 115+0+0 (secure 0 0 0) 0x7f3c14053cf0 con 0x7f3c200b39f0 2023-07-21T22:57:13.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.625+0000 7f3c26d40640 1 -- 172.21.15.6:0/4025644609 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f3c040663a0 msgr2=0x7f3c04068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:13.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.625+0000 7f3c26d40640 1 --2- 172.21.15.6:0/4025644609 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f3c040663a0 0x7f3c04068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3c20166da0 tx=0x7f3c0c008040 comp rx=0 tx=0).stop 2023-07-21T22:57:13.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.625+0000 7f3c26d40640 1 -- 172.21.15.6:0/4025644609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c200b39f0 msgr2=0x7f3c20156b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:13.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.625+0000 7f3c26d40640 1 --2- 172.21.15.6:0/4025644609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c200b39f0 0x7f3c20156b80 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f3c1400c530 tx=0x7f3c1400c9f0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.625+0000 7f3c26d40640 1 -- 172.21.15.6:0/4025644609 shutdown_connections 2023-07-21T22:57:13.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.625+0000 7f3c26d40640 1 --2- 172.21.15.6:0/4025644609 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f3c040663a0 0x7f3c04068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.625+0000 7f3c26d40640 1 --2- 172.21.15.6:0/4025644609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3c201f7c40 0x7f3c201f80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.625+0000 7f3c26d40640 1 --2- 172.21.15.6:0/4025644609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c200d06b0 0x7f3c200cf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.625+0000 7f3c26d40640 1 --2- 172.21.15.6:0/4025644609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c200b39f0 0x7f3c20156b80 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.625+0000 7f3c26d40640 1 -- 172.21.15.6:0/4025644609 >> 172.21.15.6:0/4025644609 conn(0x7f3c200659d0 msgr2=0x7f3c2015fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:13.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.625+0000 7f3c26d40640 1 -- 172.21.15.6:0/4025644609 shutdown_connections 2023-07-21T22:57:13.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.625+0000 7f3c26d40640 1 -- 172.21.15.6:0/4025644609 wait complete. 2023-07-21T22:57:13.680 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-21T22:57:13.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.801+0000 7f7d2efd2640 1 Processor -- start 2023-07-21T22:57:13.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.801+0000 7f7d2efd2640 1 -- start start 2023-07-21T22:57:13.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.801+0000 7f7d2efd2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7d280ce620 0x7f7d280ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:13.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.801+0000 7f7d2efd2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7d2815c050 0x7f7d2815f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:13.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.801+0000 7f7d2efd2640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d2815fee0 0x7f7d2806e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:13.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.801+0000 7f7d2efd2640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d2806c3f0 con 0x7f7d2815fee0 2023-07-21T22:57:13.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.801+0000 7f7d2efd2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d280c6140 con 0x7f7d2815c050 2023-07-21T22:57:13.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.801+0000 7f7d2efd2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d280cef30 con 0x7f7d280ce620 2023-07-21T22:57:13.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.801+0000 7f7d2d56f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d2815fee0 0x7f7d2806e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:13.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.801+0000 7f7d2d56f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7d2815fee0 0x7f7d2806e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39794/0 (socket says 172.21.15.6:39794) 2023-07-21T22:57:13.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.801+0000 7f7d2d56f640 1 -- 172.21.15.6:0/1008488796 learned_addr learned my addr 172.21.15.6:0/1008488796 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:13.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.801+0000 7f7d2d56f640 1 -- 172.21.15.6:0/1008488796 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7d280ce620 msgr2=0x7f7d280ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:13.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.801+0000 7f7d2cd6e640 1 --2- 172.21.15.6:0/1008488796 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7d280ce620 0x7f7d280ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:13.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.801+0000 7f7d27fff640 1 --2- 172.21.15.6:0/1008488796 >> v2:172.21.15.161:3300/0 conn(0x7f7d2815c050 0x7f7d2815f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:13.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.801+0000 7f7d2d56f640 1 --2- 172.21.15.6:0/1008488796 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7d280ce620 0x7f7d280ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.801+0000 7f7d2d56f640 1 -- 172.21.15.6:0/1008488796 >> v2:172.21.15.161:3300/0 conn(0x7f7d2815c050 msgr2=0x7f7d2815f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:13.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.801+0000 7f7d2d56f640 1 --2- 172.21.15.6:0/1008488796 >> v2:172.21.15.161:3300/0 conn(0x7f7d2815c050 0x7f7d2815f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.801+0000 7f7d2d56f640 1 -- 172.21.15.6:0/1008488796 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2806dab0 con 0x7f7d2815fee0 2023-07-21T22:57:13.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.801+0000 7f7d2cd6e640 1 --2- 172.21.15.6:0/1008488796 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7d280ce620 0x7f7d280ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:13.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.801+0000 7f7d27fff640 1 --2- 172.21.15.6:0/1008488796 >> v2:172.21.15.161:3300/0 conn(0x7f7d2815c050 0x7f7d2815f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:13.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.805+0000 7f7d2d56f640 1 --2- 172.21.15.6:0/1008488796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d2815fee0 0x7f7d2806e700 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f7d2806b830 tx=0x7f7d2001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00035ba9b914cd8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:13.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.805+0000 7f7d277fe640 1 -- 172.21.15.6:0/1008488796 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d200a6460 con 0x7f7d2815fee0 2023-07-21T22:57:13.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.805+0000 7f7d277fe640 1 -- 172.21.15.6:0/1008488796 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d200a65c0 con 0x7f7d2815fee0 2023-07-21T22:57:13.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.805+0000 7f7d277fe640 1 -- 172.21.15.6:0/1008488796 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d200a6950 con 0x7f7d2815fee0 2023-07-21T22:57:13.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.805+0000 7f7d2efd2640 1 -- 172.21.15.6:0/1008488796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d2815fee0 msgr2=0x7f7d2806e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:13.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.805+0000 7f7d2efd2640 1 --2- 172.21.15.6:0/1008488796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d2815fee0 0x7f7d2806e700 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f7d2806b830 tx=0x7f7d2001c9a0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.805+0000 7f7d2efd2640 1 -- 172.21.15.6:0/1008488796 shutdown_connections 2023-07-21T22:57:13.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.805+0000 7f7d2efd2640 1 --2- 172.21.15.6:0/1008488796 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d2815fee0 0x7f7d2806e700 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.805+0000 7f7d2efd2640 1 --2- 172.21.15.6:0/1008488796 >> v2:172.21.15.161:3300/0 conn(0x7f7d2815c050 0x7f7d2815f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.805+0000 7f7d2efd2640 1 --2- 172.21.15.6:0/1008488796 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7d280ce620 0x7f7d280ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.805+0000 7f7d2efd2640 1 -- 172.21.15.6:0/1008488796 >> 172.21.15.6:0/1008488796 conn(0x7f7d280cc9a0 msgr2=0x7f7d280cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:13.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.805+0000 7f7d2efd2640 1 -- 172.21.15.6:0/1008488796 shutdown_connections 2023-07-21T22:57:13.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.805+0000 7f7d2efd2640 1 -- 172.21.15.6:0/1008488796 wait complete. 2023-07-21T22:57:13.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2efd2640 1 Processor -- start 2023-07-21T22:57:13.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2efd2640 1 -- start start 2023-07-21T22:57:13.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2efd2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d280ce620 0x7f7d281537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:13.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2efd2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d2815c050 0x7f7d280c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:13.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2efd2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7d2815fee0 0x7f7d28153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:13.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2efd2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d28153d10 con 0x7f7d280ce620 2023-07-21T22:57:13.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2efd2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d280c76a0 con 0x7f7d2815c050 2023-07-21T22:57:13.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2efd2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d280c7980 con 0x7f7d2815fee0 2023-07-21T22:57:13.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2cd6e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d280ce620 0x7f7d281537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:13.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2cd6e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d280ce620 0x7f7d281537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39806/0 (socket says 172.21.15.6:39806) 2023-07-21T22:57:13.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2cd6e640 1 -- 172.21.15.6:0/4028799193 learned_addr learned my addr 172.21.15.6:0/4028799193 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:13.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2d56f640 1 --2- 172.21.15.6:0/4028799193 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7d2815fee0 0x7f7d28153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:13.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d27fff640 1 --2- 172.21.15.6:0/4028799193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d2815c050 0x7f7d280c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:13.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2cd6e640 1 -- 172.21.15.6:0/4028799193 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7d2815fee0 msgr2=0x7f7d28153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:13.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2cd6e640 1 --2- 172.21.15.6:0/4028799193 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7d2815fee0 0x7f7d28153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2cd6e640 1 -- 172.21.15.6:0/4028799193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d2815c050 msgr2=0x7f7d280c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:13.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2cd6e640 1 --2- 172.21.15.6:0/4028799193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d2815c050 0x7f7d280c6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:13.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2cd6e640 1 -- 172.21.15.6:0/4028799193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d20009b30 con 0x7f7d280ce620 2023-07-21T22:57:13.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2cd6e640 1 --2- 172.21.15.6:0/4028799193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d280ce620 0x7f7d281537d0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00c7c0 tx=0x7f7d1c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:13.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d257fa640 1 -- 172.21.15.6:0/4028799193 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c007a30 con 0x7f7d280ce620 2023-07-21T22:57:13.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d257fa640 1 -- 172.21.15.6:0/4028799193 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1c007b90 con 0x7f7d280ce620 2023-07-21T22:57:13.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d257fa640 1 -- 172.21.15.6:0/4028799193 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1c00ce70 con 0x7f7d280ce620 2023-07-21T22:57:13.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2efd2640 1 -- 172.21.15.6:0/4028799193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d280b3840 con 0x7f7d280ce620 2023-07-21T22:57:13.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2efd2640 1 -- 172.21.15.6:0/4028799193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d28155610 con 0x7f7d280ce620 2023-07-21T22:57:13.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.809+0000 7f7d2efd2640 1 -- 172.21.15.6:0/4028799193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d280b36a0 con 0x7f7d280ce620 2023-07-21T22:57:13.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.813+0000 7f7d257fa640 1 -- 172.21.15.6:0/4028799193 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7d1c0113f0 con 0x7f7d280ce620 2023-07-21T22:57:13.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.813+0000 7f7d257fa640 1 --2- 172.21.15.6:0/4028799193 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f7d0c0663a0 0x7f7d0c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:13.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.813+0000 7f7d257fa640 1 -- 172.21.15.6:0/4028799193 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6170+0+0 (secure 0 0 0) 0x7f7d1c084400 con 0x7f7d280ce620 2023-07-21T22:57:13.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.813+0000 7f7d27fff640 1 --2- 172.21.15.6:0/4028799193 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f7d0c0663a0 0x7f7d0c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:13.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.813+0000 7f7d27fff640 1 --2- 172.21.15.6:0/4028799193 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f7d0c0663a0 0x7f7d0c068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7d280ade30 tx=0x7f7d14008040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:13.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.817+0000 7f7d257fa640 1 -- 172.21.15.6:0/4028799193 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7d280b36a0 con 0x7f7d280ce620 2023-07-21T22:57:14.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.969+0000 7f7d2efd2640 1 -- 172.21.15.6:0/4028799193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f7d280b36a0 con 0x7f7d280ce620 2023-07-21T22:57:14.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.973+0000 7f7d257fa640 1 -- 172.21.15.6:0/4028799193 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v62) v1 ==== 120+0+0 (secure 0 0 0) 0x7f7d280b36a0 con 0x7f7d280ce620 2023-07-21T22:57:14.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.977+0000 7f7d2efd2640 1 -- 172.21.15.6:0/4028799193 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f7d0c0663a0 msgr2=0x7f7d0c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.977+0000 7f7d2efd2640 1 --2- 172.21.15.6:0/4028799193 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f7d0c0663a0 0x7f7d0c068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7d280ade30 tx=0x7f7d14008040 comp rx=0 tx=0).stop 2023-07-21T22:57:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.977+0000 7f7d2efd2640 1 -- 172.21.15.6:0/4028799193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d280ce620 msgr2=0x7f7d281537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.977+0000 7f7d2efd2640 1 --2- 172.21.15.6:0/4028799193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d280ce620 0x7f7d281537d0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c00c7c0 tx=0x7f7d1c00cc80 comp rx=0 tx=0).stop 2023-07-21T22:57:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.977+0000 7f7d2efd2640 1 -- 172.21.15.6:0/4028799193 shutdown_connections 2023-07-21T22:57:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.977+0000 7f7d2efd2640 1 --2- 172.21.15.6:0/4028799193 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f7d0c0663a0 0x7f7d0c068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.977+0000 7f7d2efd2640 1 --2- 172.21.15.6:0/4028799193 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7d2815fee0 0x7f7d28153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.977+0000 7f7d2efd2640 1 --2- 172.21.15.6:0/4028799193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7d2815c050 0x7f7d280c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.977+0000 7f7d2efd2640 1 --2- 172.21.15.6:0/4028799193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d280ce620 0x7f7d281537d0 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.977+0000 7f7d2efd2640 1 -- 172.21.15.6:0/4028799193 >> 172.21.15.6:0/4028799193 conn(0x7f7d280cc9a0 msgr2=0x7f7d280ad5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:14.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.977+0000 7f7d2efd2640 1 -- 172.21.15.6:0/4028799193 shutdown_connections 2023-07-21T22:57:14.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:13.977+0000 7f7d2efd2640 1 -- 172.21.15.6:0/4028799193 wait complete. 2023-07-21T22:57:14.031 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-21T22:57:14.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.145+0000 7fb088448640 1 Processor -- start 2023-07-21T22:57:14.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.145+0000 7fb088448640 1 -- start start 2023-07-21T22:57:14.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.145+0000 7fb088448640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0800aea90 0x7fb0800d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:14.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.145+0000 7fb088448640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb0800ce3e0 0x7fb080142be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:14.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.145+0000 7fb088448640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0800b17d0 con 0x7fb0800b0470 2023-07-21T22:57:14.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.145+0000 7fb088448640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0800aee60 con 0x7fb0800aea90 2023-07-21T22:57:14.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.145+0000 7fb088448640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0800b08f0 con 0x7fb0800ce3e0 2023-07-21T22:57:14.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.145+0000 7fb0861e4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0800aea90 0x7fb0800d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:14.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.145+0000 7fb0861e4640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0800aea90 0x7fb0800d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39818/0 (socket says 172.21.15.6:39818) 2023-07-21T22:57:14.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.145+0000 7fb0861e4640 1 -- 172.21.15.6:0/3004065001 learned_addr learned my addr 172.21.15.6:0/3004065001 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:14.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.145+0000 7fb0869e5640 1 --2- 172.21.15.6:0/3004065001 >> v2:172.21.15.161:3300/0 conn(0x7fb0800ce3e0 0x7fb080142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:14.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.145+0000 7fb0861e4640 1 -- 172.21.15.6:0/3004065001 >> v2:172.21.15.161:3300/0 conn(0x7fb0800ce3e0 msgr2=0x7fb080142be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:14.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.145+0000 7fb0861e4640 1 --2- 172.21.15.6:0/3004065001 >> v2:172.21.15.161:3300/0 conn(0x7fb0800ce3e0 0x7fb080142be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:14.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.145+0000 7fb0861e4640 1 -- 172.21.15.6:0/3004065001 >> v1:172.21.15.161:6789/0 conn(0x7fb0800b0470 legacy=0x7fb0800cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:14.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.145+0000 7fb0861e4640 1 -- 172.21.15.6:0/3004065001 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0800b0bc0 con 0x7fb0800aea90 2023-07-21T22:57:14.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.149+0000 7fb0861e4640 1 --2- 172.21.15.6:0/3004065001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0800aea90 0x7fb0800d0610 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fb07c006fd0 tx=0x7fb07c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34c6d72f01d47f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:14.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.149+0000 7fb0851e2640 1 -- 172.21.15.6:0/3004065001 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0aa610 con 0x7fb0800aea90 2023-07-21T22:57:14.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.149+0000 7fb0851e2640 1 -- 172.21.15.6:0/3004065001 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c0a6040 con 0x7fb0800aea90 2023-07-21T22:57:14.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.149+0000 7fb0851e2640 1 -- 172.21.15.6:0/3004065001 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0aa990 con 0x7fb0800aea90 2023-07-21T22:57:14.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.149+0000 7fb088448640 1 -- 172.21.15.6:0/3004065001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0800aea90 msgr2=0x7fb0800d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:14.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.149+0000 7fb088448640 1 --2- 172.21.15.6:0/3004065001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0800aea90 0x7fb0800d0610 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fb07c006fd0 tx=0x7fb07c01c4b0 comp rx=0 tx=0).stop 2023-07-21T22:57:14.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.149+0000 7fb088448640 1 -- 172.21.15.6:0/3004065001 shutdown_connections 2023-07-21T22:57:14.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.149+0000 7fb088448640 1 --2- 172.21.15.6:0/3004065001 >> v2:172.21.15.161:3300/0 conn(0x7fb0800ce3e0 0x7fb080142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:14.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.149+0000 7fb088448640 1 --2- 172.21.15.6:0/3004065001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0800aea90 0x7fb0800d0610 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:14.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.149+0000 7fb088448640 1 -- 172.21.15.6:0/3004065001 >> 172.21.15.6:0/3004065001 conn(0x7fb080099490 msgr2=0x7fb080089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:14.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.149+0000 7fb088448640 1 -- 172.21.15.6:0/3004065001 shutdown_connections 2023-07-21T22:57:14.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.149+0000 7fb088448640 1 -- 172.21.15.6:0/3004065001 wait complete. 2023-07-21T22:57:14.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb088448640 1 Processor -- start 2023-07-21T22:57:14.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb088448640 1 -- start start 2023-07-21T22:57:14.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb088448640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0800aea90 0x7fb0801545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:14.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb088448640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0800b0470 0x7fb0801570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:14.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb088448640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0800ce3e0 0x7fb080155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:14.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb088448640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb080154b30 con 0x7fb0800aea90 2023-07-21T22:57:14.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb088448640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800c5900 con 0x7fb0800b0470 2023-07-21T22:57:14.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb088448640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800c4a50 con 0x7fb0800ce3e0 2023-07-21T22:57:14.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb0861e4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0800aea90 0x7fb0801545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:14.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb0861e4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0800aea90 0x7fb0801545f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39834/0 (socket says 172.21.15.6:39834) 2023-07-21T22:57:14.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb0861e4640 1 -- 172.21.15.6:0/1950267233 learned_addr learned my addr 172.21.15.6:0/1950267233 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:14.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb0869e5640 1 --2- 172.21.15.6:0/1950267233 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0800ce3e0 0x7fb080155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:14.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb0859e3640 1 --2- 172.21.15.6:0/1950267233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0800b0470 0x7fb0801570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:14.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb0861e4640 1 -- 172.21.15.6:0/1950267233 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0800ce3e0 msgr2=0x7fb080155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:14.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb0861e4640 1 --2- 172.21.15.6:0/1950267233 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0800ce3e0 0x7fb080155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:14.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb0861e4640 1 -- 172.21.15.6:0/1950267233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0800b0470 msgr2=0x7fb0801570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:14.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb0861e4640 1 --2- 172.21.15.6:0/1950267233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0800b0470 0x7fb0801570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:14.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb0861e4640 1 -- 172.21.15.6:0/1950267233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c009480 con 0x7fb0800aea90 2023-07-21T22:57:14.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb0861e4640 1 --2- 172.21.15.6:0/1950267233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0800aea90 0x7fb0801545f0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0190c0 tx=0x7fb07c019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:14.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb076ffd640 1 -- 172.21.15.6:0/1950267233 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c003c70 con 0x7fb0800aea90 2023-07-21T22:57:14.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb076ffd640 1 -- 172.21.15.6:0/1950267233 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07c003dd0 con 0x7fb0800aea90 2023-07-21T22:57:14.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb088448640 1 -- 172.21.15.6:0/1950267233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0800c4cf0 con 0x7fb0800aea90 2023-07-21T22:57:14.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb076ffd640 1 -- 172.21.15.6:0/1950267233 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07c0aa650 con 0x7fb0800aea90 2023-07-21T22:57:14.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb088448640 1 -- 172.21.15.6:0/1950267233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0800c52b0 con 0x7fb0800aea90 2023-07-21T22:57:14.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.153+0000 7fb088448640 1 -- 172.21.15.6:0/1950267233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0800678d0 con 0x7fb0800aea90 2023-07-21T22:57:14.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.157+0000 7fb076ffd640 1 -- 172.21.15.6:0/1950267233 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb07c0aa7b0 con 0x7fb0800aea90 2023-07-21T22:57:14.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.157+0000 7fb076ffd640 1 --2- 172.21.15.6:0/1950267233 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fb0640663d0 0x7fb064068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:14.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.157+0000 7fb076ffd640 1 -- 172.21.15.6:0/1950267233 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6170+0+0 (secure 0 0 0) 0x7fb080143930 con 0x7fb0800aea90 2023-07-21T22:57:14.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.157+0000 7fb0859e3640 1 --2- 172.21.15.6:0/1950267233 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fb0640663d0 0x7fb064068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:14.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.157+0000 7fb0859e3640 1 --2- 172.21.15.6:0/1950267233 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fb0640663d0 0x7fb064068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb0800cb830 tx=0x7fb070009040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:14.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.161+0000 7fb076ffd640 1 -- 172.21.15.6:0/1950267233 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb07c0ebad0 con 0x7fb0800aea90 2023-07-21T22:57:14.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.313+0000 7fb088448640 1 -- 172.21.15.6:0/1950267233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb0800cdfb0 con 0x7fb0800aea90 2023-07-21T22:57:14.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.321+0000 7fb076ffd640 1 -- 172.21.15.6:0/1950267233 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v63) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb07c0ef0f0 con 0x7fb0800aea90 2023-07-21T22:57:14.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.321+0000 7fb088448640 1 -- 172.21.15.6:0/1950267233 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fb0640663d0 msgr2=0x7fb064068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:14.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.321+0000 7fb088448640 1 --2- 172.21.15.6:0/1950267233 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fb0640663d0 0x7fb064068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb0800cb830 tx=0x7fb070009040 comp rx=0 tx=0).stop 2023-07-21T22:57:14.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.321+0000 7fb088448640 1 -- 172.21.15.6:0/1950267233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0800aea90 msgr2=0x7fb0801545f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:14.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.321+0000 7fb088448640 1 --2- 172.21.15.6:0/1950267233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0800aea90 0x7fb0801545f0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0190c0 tx=0x7fb07c019250 comp rx=0 tx=0).stop 2023-07-21T22:57:14.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.321+0000 7fb088448640 1 -- 172.21.15.6:0/1950267233 shutdown_connections 2023-07-21T22:57:14.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.321+0000 7fb088448640 1 --2- 172.21.15.6:0/1950267233 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fb0640663d0 0x7fb064068880 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:14.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.321+0000 7fb088448640 1 --2- 172.21.15.6:0/1950267233 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0800ce3e0 0x7fb080155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:14.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.321+0000 7fb088448640 1 --2- 172.21.15.6:0/1950267233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0800b0470 0x7fb0801570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:14.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.321+0000 7fb088448640 1 --2- 172.21.15.6:0/1950267233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0800aea90 0x7fb0801545f0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:14.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.321+0000 7fb088448640 1 -- 172.21.15.6:0/1950267233 >> 172.21.15.6:0/1950267233 conn(0x7fb080099490 msgr2=0x7fb0800cb880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:14.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.321+0000 7fb088448640 1 -- 172.21.15.6:0/1950267233 shutdown_connections 2023-07-21T22:57:14.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.321+0000 7fb088448640 1 -- 172.21.15.6:0/1950267233 wait complete. 2023-07-21T22:57:14.377 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-07-21T22:57:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.489+0000 7fd13d426640 1 Processor -- start 2023-07-21T22:57:14.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.489+0000 7fd13d426640 1 -- start start 2023-07-21T22:57:14.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.489+0000 7fd13d426640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1380d22e0 0x7fd1380d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.489+0000 7fd13d426640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1380b2140 con 0x7fd1380d06b0 2023-07-21T22:57:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.489+0000 7fd13d426640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1380b2410 con 0x7fd138145430 2023-07-21T22:57:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.489+0000 7fd13d426640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380d2cc0 con 0x7fd1380d22e0 2023-07-21T22:57:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.489+0000 7fd136ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd1380d06b0 0x7fd1380b1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49338/0 (socket says 172.21.15.6:49338) 2023-07-21T22:57:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.489+0000 7fd136ffd640 1 -- 172.21.15.6:0/2726720839 learned_addr learned my addr 172.21.15.6:0/2726720839 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.489+0000 7fd1367fc640 1 -- 172.21.15.6:0/2726720839 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228676825 0 0) 0x7fd1380b2140 con 0x7fd1380d06b0 2023-07-21T22:57:14.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.489+0000 7fd1377fe640 1 --2- 172.21.15.6:0/2726720839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1380d22e0 0x7fd1380d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.489+0000 7fd1367fc640 1 -- 172.21.15.6:0/2726720839 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd124003530 con 0x7fd1380d06b0 2023-07-21T22:57:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.489+0000 7fd1367fc640 1 -- 172.21.15.6:0/2726720839 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2958771502 0 0) 0x7fd124003530 con 0x7fd1380d06b0 2023-07-21T22:57:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.489+0000 7fd1367fc640 1 -- 172.21.15.6:0/2726720839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1380d22e0 msgr2=0x7fd1380d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.489+0000 7fd1367fc640 1 --2- 172.21.15.6:0/2726720839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1380d22e0 0x7fd1380d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.489+0000 7fd1367fc640 1 -- 172.21.15.6:0/2726720839 >> v1:172.21.15.161:6789/0 conn(0x7fd138145430 legacy=0x7fd1380b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:14.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.489+0000 7fd1367fc640 1 -- 172.21.15.6:0/2726720839 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1380b26f0 con 0x7fd1380d06b0 2023-07-21T22:57:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.489+0000 7fd1367fc640 1 -- 172.21.15.6:0/2726720839 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fd128001680 con 0x7fd1380d06b0 2023-07-21T22:57:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.493+0000 7fd1367fc640 1 -- 172.21.15.6:0/2726720839 >> v1:172.21.15.6:6789/0 conn(0x7fd1380d06b0 legacy=0x7fd1380b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.493+0000 7fd1367fc640 1 --2- 172.21.15.6:0/2726720839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1240039b0 0x7fd124003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.493+0000 7fd1367fc640 1 --2- 172.21.15.6:0/2726720839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1380d22e0 0x7fd1240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.493+0000 7fd1367fc640 1 --2- 172.21.15.6:0/2726720839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd124004d10 0x7fd124005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.493+0000 7fd1367fc640 1 -- 172.21.15.6:0/2726720839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12400ba40 con 0x7fd1240039b0 2023-07-21T22:57:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.493+0000 7fd1367fc640 1 -- 172.21.15.6:0/2726720839 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12400bb80 con 0x7fd124004d10 2023-07-21T22:57:14.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.493+0000 7fd1367fc640 1 -- 172.21.15.6:0/2726720839 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd12400bd40 con 0x7fd1380d22e0 2023-07-21T22:57:14.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.493+0000 7fd136ffd640 1 --2- 172.21.15.6:0/2726720839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1240039b0 0x7fd124003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:14.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.493+0000 7fd12ffff640 1 --2- 172.21.15.6:0/2726720839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1380d22e0 0x7fd1240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:14.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.493+0000 7fd1377fe640 1 --2- 172.21.15.6:0/2726720839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd124004d10 0x7fd124005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:14.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.493+0000 7fd136ffd640 1 -- 172.21.15.6:0/2726720839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1380d22e0 msgr2=0x7fd1240047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:14.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.493+0000 7fd136ffd640 1 --2- 172.21.15.6:0/2726720839 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1380d22e0 0x7fd1240047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:14.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.493+0000 7fd136ffd640 1 -- 172.21.15.6:0/2726720839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd124004d10 msgr2=0x7fd124005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:14.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.493+0000 7fd136ffd640 1 --2- 172.21.15.6:0/2726720839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd124004d10 0x7fd124005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:14.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.493+0000 7fd136ffd640 1 -- 172.21.15.6:0/2726720839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd124003530 con 0x7fd1240039b0 2023-07-21T22:57:14.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.493+0000 7fd1377fe640 1 --2- 172.21.15.6:0/2726720839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd124004d10 0x7fd124005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:14.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.493+0000 7fd136ffd640 1 --2- 172.21.15.6:0/2726720839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1240039b0 0x7fd124003dc0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fd12800c240 tx=0x7fd12801cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c332e6b578f5cb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:14.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.493+0000 7fd1367fc640 1 -- 172.21.15.6:0/2726720839 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd128005ae0 con 0x7fd1240039b0 2023-07-21T22:57:14.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.493+0000 7fd1367fc640 1 -- 172.21.15.6:0/2726720839 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd128005c40 con 0x7fd1240039b0 2023-07-21T22:57:14.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.493+0000 7fd1367fc640 1 -- 172.21.15.6:0/2726720839 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1280a5800 con 0x7fd1240039b0 2023-07-21T22:57:14.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd13d426640 1 -- 172.21.15.6:0/2726720839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1240039b0 msgr2=0x7fd124003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:14.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd13d426640 1 --2- 172.21.15.6:0/2726720839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1240039b0 0x7fd124003dc0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fd12800c240 tx=0x7fd12801cc10 comp rx=0 tx=0).stop 2023-07-21T22:57:14.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd1377fe640 1 -- 172.21.15.6:0/2726720839 reap_dead start 2023-07-21T22:57:14.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd13d426640 1 -- 172.21.15.6:0/2726720839 shutdown_connections 2023-07-21T22:57:14.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd13d426640 1 -- 172.21.15.6:0/2726720839 >> 172.21.15.6:0/2726720839 conn(0x7fd1380659d0 msgr2=0x7fd13809b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:14.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd13d426640 1 -- 172.21.15.6:0/2726720839 shutdown_connections 2023-07-21T22:57:14.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd13d426640 1 -- 172.21.15.6:0/2726720839 wait complete. 2023-07-21T22:57:14.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd13d426640 1 Processor -- start 2023-07-21T22:57:14.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd13d426640 1 -- start start 2023-07-21T22:57:14.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd13d426640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1240039b0 0x7fd1380c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:14.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd13d426640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1380c5630 0x7fd138155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:14.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd13d426640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1380c1b50 0x7fd1380c1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:14.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd13d426640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380c4b30 con 0x7fd1380c5630 2023-07-21T22:57:14.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd13d426640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380b6d80 con 0x7fd1240039b0 2023-07-21T22:57:14.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd13d426640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380b5300 con 0x7fd1380c1b50 2023-07-21T22:57:14.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd12ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1380c5630 0x7fd138155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:14.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd12ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1380c5630 0x7fd138155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39858/0 (socket says 172.21.15.6:39858) 2023-07-21T22:57:14.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd12ffff640 1 -- 172.21.15.6:0/2847744460 learned_addr learned my addr 172.21.15.6:0/2847744460 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:14.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd136ffd640 1 --2- 172.21.15.6:0/2847744460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1240039b0 0x7fd1380c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:14.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd1377fe640 1 --2- 172.21.15.6:0/2847744460 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1380c1b50 0x7fd1380c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:14.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd12ffff640 1 -- 172.21.15.6:0/2847744460 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1380c1b50 msgr2=0x7fd1380c1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:14.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd12ffff640 1 --2- 172.21.15.6:0/2847744460 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1380c1b50 0x7fd1380c1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:14.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd12ffff640 1 -- 172.21.15.6:0/2847744460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1240039b0 msgr2=0x7fd1380c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:14.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.497+0000 7fd12ffff640 1 --2- 172.21.15.6:0/2847744460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1240039b0 0x7fd1380c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:14.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.501+0000 7fd12ffff640 1 -- 172.21.15.6:0/2847744460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1380b55e0 con 0x7fd1380c5630 2023-07-21T22:57:14.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.501+0000 7fd1377fe640 1 --2- 172.21.15.6:0/2847744460 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1380c1b50 0x7fd1380c1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:14.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.501+0000 7fd12ffff640 1 --2- 172.21.15.6:0/2847744460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1380c5630 0x7fd138155150 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fd12000f7f0 tx=0x7fd12000fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:14.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.501+0000 7fd12f7fe640 1 -- 172.21.15.6:0/2847744460 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1200050d0 con 0x7fd1380c5630 2023-07-21T22:57:14.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.501+0000 7fd12f7fe640 1 -- 172.21.15.6:0/2847744460 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd120005230 con 0x7fd1380c5630 2023-07-21T22:57:14.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.501+0000 7fd13d426640 1 -- 172.21.15.6:0/2847744460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1380b58c0 con 0x7fd1380c5630 2023-07-21T22:57:14.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.501+0000 7fd12f7fe640 1 -- 172.21.15.6:0/2847744460 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12000d730 con 0x7fd1380c5630 2023-07-21T22:57:14.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.501+0000 7fd13d426640 1 -- 172.21.15.6:0/2847744460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1380b7300 con 0x7fd1380c5630 2023-07-21T22:57:14.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.501+0000 7fd13d426640 1 -- 172.21.15.6:0/2847744460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1380b3b70 con 0x7fd1380c5630 2023-07-21T22:57:14.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.501+0000 7fd12f7fe640 1 -- 172.21.15.6:0/2847744460 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd12000d890 con 0x7fd1380c5630 2023-07-21T22:57:14.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.501+0000 7fd12f7fe640 1 --2- 172.21.15.6:0/2847744460 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fd1180663a0 0x7fd118068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:14.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.501+0000 7fd12f7fe640 1 -- 172.21.15.6:0/2847744460 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6170+0+0 (secure 0 0 0) 0x7fd120083f50 con 0x7fd1380c5630 2023-07-21T22:57:14.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.501+0000 7fd136ffd640 1 --2- 172.21.15.6:0/2847744460 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fd1180663a0 0x7fd118068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:14.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.505+0000 7fd136ffd640 1 --2- 172.21.15.6:0/2847744460 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fd1180663a0 0x7fd118068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd1280ab000 tx=0x7fd1280a7070 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:14.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.505+0000 7fd12f7fe640 1 -- 172.21.15.6:0/2847744460 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd1200511b0 con 0x7fd1380c5630 2023-07-21T22:57:14.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:14.713+0000 7fd13d426640 1 -- 172.21.15.6:0/2847744460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7fd1380678d0 con 0x7fd1380c5630 2023-07-21T22:57:15.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.445+0000 7fd12f7fe640 1 -- 172.21.15.6:0/2847744460 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v1377) v1 ==== 163+0+0 (secure 0 0 0) 0x7fd12001a310 con 0x7fd1380c5630 2023-07-21T22:57:15.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.449+0000 7fd13d426640 1 -- 172.21.15.6:0/2847744460 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fd1180663a0 msgr2=0x7fd118068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:15.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.449+0000 7fd13d426640 1 --2- 172.21.15.6:0/2847744460 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fd1180663a0 0x7fd118068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd1280ab000 tx=0x7fd1280a7070 comp rx=0 tx=0).stop 2023-07-21T22:57:15.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.449+0000 7fd13d426640 1 -- 172.21.15.6:0/2847744460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1380c5630 msgr2=0x7fd138155150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:15.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.449+0000 7fd13d426640 1 --2- 172.21.15.6:0/2847744460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1380c5630 0x7fd138155150 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fd12000f7f0 tx=0x7fd12000fcb0 comp rx=0 tx=0).stop 2023-07-21T22:57:15.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.449+0000 7fd13d426640 1 -- 172.21.15.6:0/2847744460 shutdown_connections 2023-07-21T22:57:15.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.449+0000 7fd13d426640 1 --2- 172.21.15.6:0/2847744460 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fd1180663a0 0x7fd118068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:15.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.449+0000 7fd13d426640 1 --2- 172.21.15.6:0/2847744460 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd1380c1b50 0x7fd1380c1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:15.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.449+0000 7fd13d426640 1 --2- 172.21.15.6:0/2847744460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1380c5630 0x7fd138155150 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:15.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.449+0000 7fd13d426640 1 --2- 172.21.15.6:0/2847744460 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd1240039b0 0x7fd1380c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:15.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.449+0000 7fd13d426640 1 -- 172.21.15.6:0/2847744460 >> 172.21.15.6:0/2847744460 conn(0x7fd1380659d0 msgr2=0x7fd13806b030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:15.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.449+0000 7fd13d426640 1 -- 172.21.15.6:0/2847744460 shutdown_connections 2023-07-21T22:57:15.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.449+0000 7fd13d426640 1 -- 172.21.15.6:0/2847744460 wait complete. 2023-07-21T22:57:15.507 INFO:tasks.cephfs_test_runner:Test scheduled snapshots along with rentention policy ... ok 2023-07-21T22:57:15.508 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2023-07-21T22:57:15.508 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2023-07-21T22:57:15.508 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-07-21T22:57:15.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.625+0000 7f76c3374640 1 Processor -- start 2023-07-21T22:57:15.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.625+0000 7f76c3374640 1 -- start start 2023-07-21T22:57:15.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.625+0000 7f76c3374640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76bc0b7c70 0x7f76bc0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:15.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.625+0000 7f76c3374640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f76bc0d1850 0x7f76bc15f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:15.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.625+0000 7f76c3374640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76bc0ccaf0 con 0x7f76bc0d1300 2023-07-21T22:57:15.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.625+0000 7f76c3374640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76bc0d1190 con 0x7f76bc0d1850 2023-07-21T22:57:15.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.625+0000 7f76c3374640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc160600 con 0x7f76bc0b7c70 2023-07-21T22:57:15.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.625+0000 7f76c090f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f76bc0d1850 0x7f76bc15f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:15.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.625+0000 7f76c090f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f76bc0d1850 0x7f76bc15f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39862/0 (socket says 172.21.15.6:39862) 2023-07-21T22:57:15.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.625+0000 7f76c090f640 1 -- 172.21.15.6:0/3653153065 learned_addr learned my addr 172.21.15.6:0/3653153065 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:15.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.625+0000 7f76c1110640 1 --2- 172.21.15.6:0/3653153065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76bc0b7c70 0x7f76bc0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:15.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.625+0000 7f76c090f640 1 -- 172.21.15.6:0/3653153065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76bc0b7c70 msgr2=0x7f76bc0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:15.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.625+0000 7f76c090f640 1 --2- 172.21.15.6:0/3653153065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76bc0b7c70 0x7f76bc0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:15.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.625+0000 7f76c090f640 1 -- 172.21.15.6:0/3653153065 >> v1:172.21.15.161:6789/0 conn(0x7f76bc0d1300 legacy=0x7f76bc0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:15.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.625+0000 7f76c090f640 1 -- 172.21.15.6:0/3653153065 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc160320 con 0x7f76bc0d1850 2023-07-21T22:57:15.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.629+0000 7f76c090f640 1 --2- 172.21.15.6:0/3653153065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76bc0d1850 0x7f76bc15f650 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0098a0 tx=0x7f76ac01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c51e8dbd9dd915 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:15.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.629+0000 7f76b3fff640 1 -- 172.21.15.6:0/3653153065 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac0ab600 con 0x7f76bc0d1850 2023-07-21T22:57:15.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.629+0000 7f76b3fff640 1 -- 172.21.15.6:0/3653153065 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac0ab760 con 0x7f76bc0d1850 2023-07-21T22:57:15.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.629+0000 7f76b3fff640 1 -- 172.21.15.6:0/3653153065 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac0abaf0 con 0x7f76bc0d1850 2023-07-21T22:57:15.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.629+0000 7f76c3374640 1 -- 172.21.15.6:0/3653153065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76bc0d1850 msgr2=0x7f76bc15f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:15.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.629+0000 7f76c3374640 1 --2- 172.21.15.6:0/3653153065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76bc0d1850 0x7f76bc15f650 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0098a0 tx=0x7f76ac01c4f0 comp rx=0 tx=0).stop 2023-07-21T22:57:15.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.629+0000 7f76c3374640 1 -- 172.21.15.6:0/3653153065 shutdown_connections 2023-07-21T22:57:15.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.629+0000 7f76c3374640 1 --2- 172.21.15.6:0/3653153065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76bc0d1850 0x7f76bc15f650 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:15.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.629+0000 7f76c3374640 1 --2- 172.21.15.6:0/3653153065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76bc0b7c70 0x7f76bc0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:15.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.629+0000 7f76c3374640 1 -- 172.21.15.6:0/3653153065 >> 172.21.15.6:0/3653153065 conn(0x7f76bc0650b0 msgr2=0x7f76bc0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:15.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.629+0000 7f76c3374640 1 -- 172.21.15.6:0/3653153065 shutdown_connections 2023-07-21T22:57:15.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.629+0000 7f76c3374640 1 -- 172.21.15.6:0/3653153065 wait complete. 2023-07-21T22:57:15.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c3374640 1 Processor -- start 2023-07-21T22:57:15.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c3374640 1 -- start start 2023-07-21T22:57:15.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c3374640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76bc0b7c70 0x7f76bc0c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:15.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c3374640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76bc0d1300 0x7f76bc154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:15.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c3374640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76bc0d1850 0x7f76bc154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:15.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c3374640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc153f40 con 0x7f76bc0b7c70 2023-07-21T22:57:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c3374640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc0c6370 con 0x7f76bc0d1850 2023-07-21T22:57:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c3374640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76bc0b2270 con 0x7f76bc0d1300 2023-07-21T22:57:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c1110640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76bc0b7c70 0x7f76bc0c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:15.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c1110640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76bc0b7c70 0x7f76bc0c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39868/0 (socket says 172.21.15.6:39868) 2023-07-21T22:57:15.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c1110640 1 -- 172.21.15.6:0/2948534410 learned_addr learned my addr 172.21.15.6:0/2948534410 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c090f640 1 --2- 172.21.15.6:0/2948534410 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76bc0d1300 0x7f76bc154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c1911640 1 --2- 172.21.15.6:0/2948534410 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76bc0d1850 0x7f76bc154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:15.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c1110640 1 -- 172.21.15.6:0/2948534410 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76bc0d1300 msgr2=0x7f76bc154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c1110640 1 --2- 172.21.15.6:0/2948534410 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76bc0d1300 0x7f76bc154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c1110640 1 -- 172.21.15.6:0/2948534410 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76bc0d1850 msgr2=0x7f76bc154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:15.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c1110640 1 --2- 172.21.15.6:0/2948534410 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76bc0d1850 0x7f76bc154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:15.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c1110640 1 -- 172.21.15.6:0/2948534410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ac0094d0 con 0x7f76bc0b7c70 2023-07-21T22:57:15.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c1110640 1 --2- 172.21.15.6:0/2948534410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76bc0b7c70 0x7f76bc0c5e30 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f76b800e870 tx=0x7f76b800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:15.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76b1ffb640 1 -- 172.21.15.6:0/2948534410 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b8009510 con 0x7f76bc0b7c70 2023-07-21T22:57:15.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76b1ffb640 1 -- 172.21.15.6:0/2948534410 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b800eec0 con 0x7f76bc0b7c70 2023-07-21T22:57:15.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76b1ffb640 1 -- 172.21.15.6:0/2948534410 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b800cb40 con 0x7f76bc0b7c70 2023-07-21T22:57:15.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c3374640 1 -- 172.21.15.6:0/2948534410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76bc0b2550 con 0x7f76bc0b7c70 2023-07-21T22:57:15.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c3374640 1 -- 172.21.15.6:0/2948534410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76bc1541e0 con 0x7f76bc0b7c70 2023-07-21T22:57:15.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.633+0000 7f76c3374640 1 -- 172.21.15.6:0/2948534410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76bc0678d0 con 0x7f76bc0b7c70 2023-07-21T22:57:15.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.637+0000 7f76b1ffb640 1 -- 172.21.15.6:0/2948534410 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f76b800cca0 con 0x7f76bc0b7c70 2023-07-21T22:57:15.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.637+0000 7f76b1ffb640 1 --2- 172.21.15.6:0/2948534410 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f76a00663a0 0x7f76a0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:15.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.637+0000 7f76b1ffb640 1 -- 172.21.15.6:0/2948534410 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6170+0+0 (secure 0 0 0) 0x7f76b8083f40 con 0x7f76bc0b7c70 2023-07-21T22:57:15.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.637+0000 7f76c090f640 1 --2- 172.21.15.6:0/2948534410 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f76a00663a0 0x7f76a0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:15.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.637+0000 7f76c090f640 1 --2- 172.21.15.6:0/2948534410 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f76a00663a0 0x7f76a0068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0af000 tx=0x7f76ac0b6040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:15.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.641+0000 7f76b1ffb640 1 -- 172.21.15.6:0/2948534410 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76b80512e0 con 0x7f76bc0b7c70 2023-07-21T22:57:15.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:15.849+0000 7f76c3374640 1 -- 172.21.15.6:0/2948534410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f76bc0b6c30 con 0x7f76bc0b7c70 2023-07-21T22:57:16.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.448+0000 7f76b1ffb640 1 -- 172.21.15.6:0/2948534410 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v1378) v1 ==== 158+0+0 (secure 0 0 0) 0x7f76b80170e0 con 0x7f76bc0b7c70 2023-07-21T22:57:16.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.448+0000 7f76c3374640 1 -- 172.21.15.6:0/2948534410 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f76a00663a0 msgr2=0x7f76a0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:16.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.448+0000 7f76c3374640 1 --2- 172.21.15.6:0/2948534410 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f76a00663a0 0x7f76a0068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0af000 tx=0x7f76ac0b6040 comp rx=0 tx=0).stop 2023-07-21T22:57:16.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.448+0000 7f76c3374640 1 -- 172.21.15.6:0/2948534410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76bc0b7c70 msgr2=0x7f76bc0c5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:16.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.448+0000 7f76c3374640 1 --2- 172.21.15.6:0/2948534410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76bc0b7c70 0x7f76bc0c5e30 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f76b800e870 tx=0x7f76b800ec70 comp rx=0 tx=0).stop 2023-07-21T22:57:16.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.448+0000 7f76c3374640 1 -- 172.21.15.6:0/2948534410 shutdown_connections 2023-07-21T22:57:16.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.448+0000 7f76c3374640 1 --2- 172.21.15.6:0/2948534410 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f76a00663a0 0x7f76a0068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:16.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.448+0000 7f76c3374640 1 --2- 172.21.15.6:0/2948534410 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76bc0d1850 0x7f76bc154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:16.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.448+0000 7f76c3374640 1 --2- 172.21.15.6:0/2948534410 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f76bc0d1300 0x7f76bc154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:16.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.448+0000 7f76c3374640 1 --2- 172.21.15.6:0/2948534410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76bc0b7c70 0x7f76bc0c5e30 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:16.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.448+0000 7f76c3374640 1 -- 172.21.15.6:0/2948534410 >> 172.21.15.6:0/2948534410 conn(0x7f76bc0650b0 msgr2=0x7f76bc0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:16.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.452+0000 7f76c3374640 1 -- 172.21.15.6:0/2948534410 shutdown_connections 2023-07-21T22:57:16.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.452+0000 7f76c3374640 1 -- 172.21.15.6:0/2948534410 wait complete. 2023-07-21T22:57:16.508 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-21T22:57:16.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.624+0000 7f0ce546d640 1 Processor -- start 2023-07-21T22:57:16.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.624+0000 7f0ce546d640 1 -- start start 2023-07-21T22:57:16.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.624+0000 7f0ce546d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0ce0069430 0x7f0ce0069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:16.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.624+0000 7f0ce546d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0ce0070f30 0x7f0ce00ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:16.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.624+0000 7f0ce546d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ce00af2b0 0x7f0ce015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:16.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.624+0000 7f0ce546d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce0159d70 con 0x7f0ce0069430 2023-07-21T22:57:16.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.624+0000 7f0ce546d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce0069d40 con 0x7f0ce0070f30 2023-07-21T22:57:16.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.624+0000 7f0ce546d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00c9c60 con 0x7f0ce00af2b0 2023-07-21T22:57:16.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.624+0000 7f0cdeffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0ce0069430 0x7f0ce0069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:16.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.624+0000 7f0cdeffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0ce0069430 0x7f0ce0069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39876/0 (socket says 172.21.15.6:39876) 2023-07-21T22:57:16.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.624+0000 7f0cdeffd640 1 -- 172.21.15.6:0/3081967987 learned_addr learned my addr 172.21.15.6:0/3081967987 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:16.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.628+0000 7f0cd7fff640 1 --2- 172.21.15.6:0/3081967987 >> v2:172.21.15.161:3300/0 conn(0x7f0ce0070f30 0x7f0ce00ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:16.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.628+0000 7f0cdf7fe640 1 --2- 172.21.15.6:0/3081967987 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ce00af2b0 0x7f0ce015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:16.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.628+0000 7f0cdeffd640 1 -- 172.21.15.6:0/3081967987 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ce00af2b0 msgr2=0x7f0ce015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:16.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.628+0000 7f0cdeffd640 1 --2- 172.21.15.6:0/3081967987 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ce00af2b0 0x7f0ce015a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:16.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.628+0000 7f0cdeffd640 1 -- 172.21.15.6:0/3081967987 >> v2:172.21.15.161:3300/0 conn(0x7f0ce0070f30 msgr2=0x7f0ce00ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:16.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.628+0000 7f0cdeffd640 1 --2- 172.21.15.6:0/3081967987 >> v2:172.21.15.161:3300/0 conn(0x7f0ce0070f30 0x7f0ce00ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:16.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.628+0000 7f0cdeffd640 1 -- 172.21.15.6:0/3081967987 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce00c9f40 con 0x7f0ce0069430 2023-07-21T22:57:16.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.628+0000 7f0cdf7fe640 1 --2- 172.21.15.6:0/3081967987 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ce00af2b0 0x7f0ce015a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:16.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.628+0000 7f0cdeffd640 1 --2- 172.21.15.6:0/3081967987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ce0069430 0x7f0ce0069800 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00c9830 tx=0x7f0cd001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ecf9266dff754b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:16.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.628+0000 7f0cde7fc640 1 -- 172.21.15.6:0/3081967987 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00ac630 con 0x7f0ce0069430 2023-07-21T22:57:16.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.628+0000 7f0cde7fc640 1 -- 172.21.15.6:0/3081967987 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd00ac790 con 0x7f0ce0069430 2023-07-21T22:57:16.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.628+0000 7f0cde7fc640 1 -- 172.21.15.6:0/3081967987 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00acb20 con 0x7f0ce0069430 2023-07-21T22:57:16.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0ce546d640 1 -- 172.21.15.6:0/3081967987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ce0069430 msgr2=0x7f0ce0069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:16.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0ce546d640 1 --2- 172.21.15.6:0/3081967987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ce0069430 0x7f0ce0069800 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f0ce00c9830 tx=0x7f0cd001c500 comp rx=0 tx=0).stop 2023-07-21T22:57:16.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0ce546d640 1 -- 172.21.15.6:0/3081967987 shutdown_connections 2023-07-21T22:57:16.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0ce546d640 1 --2- 172.21.15.6:0/3081967987 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ce00af2b0 0x7f0ce015a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:16.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0ce546d640 1 --2- 172.21.15.6:0/3081967987 >> v2:172.21.15.161:3300/0 conn(0x7f0ce0070f30 0x7f0ce00ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:16.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0ce546d640 1 --2- 172.21.15.6:0/3081967987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ce0069430 0x7f0ce0069800 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:16.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0ce546d640 1 -- 172.21.15.6:0/3081967987 >> 172.21.15.6:0/3081967987 conn(0x7f0ce00cde90 msgr2=0x7f0ce00ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:16.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0ce546d640 1 -- 172.21.15.6:0/3081967987 shutdown_connections 2023-07-21T22:57:16.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0ce546d640 1 -- 172.21.15.6:0/3081967987 wait complete. 2023-07-21T22:57:16.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0ce546d640 1 Processor -- start 2023-07-21T22:57:16.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0ce546d640 1 -- start start 2023-07-21T22:57:16.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0ce546d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ce0069430 0x7f0ce014bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:16.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0ce546d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ce0070f30 0x7f0ce01566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:16.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0ce546d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ce00af2b0 0x7f0ce013dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:16.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0ce546d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce014d380 con 0x7f0ce0070f30 2023-07-21T22:57:16.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0ce546d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce014cd40 con 0x7f0ce00af2b0 2023-07-21T22:57:16.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0ce546d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce00b1860 con 0x7f0ce0069430 2023-07-21T22:57:16.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0cd7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ce0070f30 0x7f0ce01566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:16.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0cd7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ce0070f30 0x7f0ce01566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39888/0 (socket says 172.21.15.6:39888) 2023-07-21T22:57:16.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0cd7fff640 1 -- 172.21.15.6:0/3173622520 learned_addr learned my addr 172.21.15.6:0/3173622520 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:16.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0cdf7fe640 1 --2- 172.21.15.6:0/3173622520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ce00af2b0 0x7f0ce013dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:16.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0cdeffd640 1 --2- 172.21.15.6:0/3173622520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ce0069430 0x7f0ce014bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:16.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0cd7fff640 1 -- 172.21.15.6:0/3173622520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ce0069430 msgr2=0x7f0ce014bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:16.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0cd7fff640 1 --2- 172.21.15.6:0/3173622520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ce0069430 0x7f0ce014bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:16.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0cd7fff640 1 -- 172.21.15.6:0/3173622520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ce00af2b0 msgr2=0x7f0ce013dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:16.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0cd7fff640 1 --2- 172.21.15.6:0/3173622520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ce00af2b0 0x7f0ce013dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:16.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0cd7fff640 1 -- 172.21.15.6:0/3173622520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd00094d0 con 0x7f0ce0070f30 2023-07-21T22:57:16.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0cdf7fe640 1 --2- 172.21.15.6:0/3173622520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ce00af2b0 0x7f0ce013dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:16.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.632+0000 7f0cdeffd640 1 --2- 172.21.15.6:0/3173622520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ce0069430 0x7f0ce014bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:16.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.636+0000 7f0cd7fff640 1 --2- 172.21.15.6:0/3173622520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ce0070f30 0x7f0ce01566b0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800d830 tx=0x7f0cc800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:16.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.636+0000 7f0cd77fe640 1 -- 172.21.15.6:0/3173622520 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc800b6c0 con 0x7f0ce0070f30 2023-07-21T22:57:16.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.636+0000 7f0cd77fe640 1 -- 172.21.15.6:0/3173622520 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc800b820 con 0x7f0ce0070f30 2023-07-21T22:57:16.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.636+0000 7f0cd77fe640 1 -- 172.21.15.6:0/3173622520 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc800bb90 con 0x7f0ce0070f30 2023-07-21T22:57:16.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.636+0000 7f0ce546d640 1 -- 172.21.15.6:0/3173622520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce014c130 con 0x7f0ce0070f30 2023-07-21T22:57:16.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.636+0000 7f0ce546d640 1 -- 172.21.15.6:0/3173622520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce014c6f0 con 0x7f0ce0070f30 2023-07-21T22:57:16.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.636+0000 7f0ce546d640 1 -- 172.21.15.6:0/3173622520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce00678d0 con 0x7f0ce0070f30 2023-07-21T22:57:16.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.636+0000 7f0cd77fe640 1 -- 172.21.15.6:0/3173622520 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0cc801e460 con 0x7f0ce0070f30 2023-07-21T22:57:16.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.636+0000 7f0cd77fe640 1 --2- 172.21.15.6:0/3173622520 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f0cc00663d0 0x7f0cc0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:16.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.636+0000 7f0cd77fe640 1 -- 172.21.15.6:0/3173622520 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6170+0+0 (secure 0 0 0) 0x7f0cc8084680 con 0x7f0ce0070f30 2023-07-21T22:57:16.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.640+0000 7f0cdeffd640 1 --2- 172.21.15.6:0/3173622520 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f0cc00663d0 0x7f0cc0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:16.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.640+0000 7f0cdeffd640 1 --2- 172.21.15.6:0/3173622520 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f0cc00663d0 0x7f0cc0068880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00ae000 tx=0x7f0cd00a7000 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:16.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.640+0000 7f0cd77fe640 1 -- 172.21.15.6:0/3173622520 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0cc8051970 con 0x7f0ce0070f30 2023-07-21T22:57:16.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.796+0000 7f0ce546d640 1 -- 172.21.15.6:0/3173622520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0ce00aeb80 con 0x7f0ce0070f30 2023-07-21T22:57:16.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.804+0000 7f0cd77fe640 1 -- 172.21.15.6:0/3173622520 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v64)=0 v64) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0cc8054f90 con 0x7f0ce0070f30 2023-07-21T22:57:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.804+0000 7f0ce546d640 1 -- 172.21.15.6:0/3173622520 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f0cc00663d0 msgr2=0x7f0cc0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.804+0000 7f0ce546d640 1 --2- 172.21.15.6:0/3173622520 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f0cc00663d0 0x7f0cc0068880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00ae000 tx=0x7f0cd00a7000 comp rx=0 tx=0).stop 2023-07-21T22:57:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.804+0000 7f0ce546d640 1 -- 172.21.15.6:0/3173622520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ce0070f30 msgr2=0x7f0ce01566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.804+0000 7f0ce546d640 1 --2- 172.21.15.6:0/3173622520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ce0070f30 0x7f0ce01566b0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800d830 tx=0x7f0cc800dcf0 comp rx=0 tx=0).stop 2023-07-21T22:57:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.804+0000 7f0ce546d640 1 -- 172.21.15.6:0/3173622520 shutdown_connections 2023-07-21T22:57:16.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.804+0000 7f0ce546d640 1 --2- 172.21.15.6:0/3173622520 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f0cc00663d0 0x7f0cc0068880 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.804+0000 7f0ce546d640 1 --2- 172.21.15.6:0/3173622520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ce00af2b0 0x7f0ce013dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.804+0000 7f0ce546d640 1 --2- 172.21.15.6:0/3173622520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ce0070f30 0x7f0ce01566b0 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.804+0000 7f0ce546d640 1 --2- 172.21.15.6:0/3173622520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0ce0069430 0x7f0ce014bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.804+0000 7f0ce546d640 1 -- 172.21.15.6:0/3173622520 >> 172.21.15.6:0/3173622520 conn(0x7f0ce00cde90 msgr2=0x7f0ce00cc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.804+0000 7f0ce546d640 1 -- 172.21.15.6:0/3173622520 shutdown_connections 2023-07-21T22:57:16.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:16.804+0000 7f0ce546d640 1 -- 172.21.15.6:0/3173622520 wait complete. 2023-07-21T22:57:16.861 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:57:16.861 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:57:16.928 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:57:16.979 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:57:16.979 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:57:16.980 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:57:16.989 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:57:16.989 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:57:16.990 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:57:16.999 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:57:16.999 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:57:17.000 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:57:17.041 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:57:17.042 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:57:17.042 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:57:17.052 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:57:17.053 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-21T22:57:17.053 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:57:17.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f68093640 1 Processor -- start 2023-07-21T22:57:17.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f68093640 1 -- start start 2023-07-21T22:57:17.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f68093640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9f600b7c70 0x7f9f600d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:17.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f68093640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f600ccaf0 con 0x7f9f6015fd60 2023-07-21T22:57:17.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f68093640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f60160320 con 0x7f9f600d1850 2023-07-21T22:57:17.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f68093640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f600d1190 con 0x7f9f600b7c70 2023-07-21T22:57:17.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f66630640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f9f6015fd60 0x7f9f600d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49342/0 (socket says 172.21.15.6:49342) 2023-07-21T22:57:17.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f66630640 1 -- 172.21.15.6:0/2158511068 learned_addr learned my addr 172.21.15.6:0/2158511068 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f65e2f640 1 --2- 172.21.15.6:0/2158511068 >> v2:172.21.15.161:3300/0 conn(0x7f9f600b7c70 0x7f9f600d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f64e2d640 1 -- 172.21.15.6:0/2158511068 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734690742 0 0) 0x7f9f600ccaf0 con 0x7f9f6015fd60 2023-07-21T22:57:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f64e2d640 1 -- 172.21.15.6:0/2158511068 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f4c003530 con 0x7f9f6015fd60 2023-07-21T22:57:17.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f64e2d640 1 -- 172.21.15.6:0/2158511068 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1652456888 0 0) 0x7f9f4c003530 con 0x7f9f6015fd60 2023-07-21T22:57:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f64e2d640 1 -- 172.21.15.6:0/2158511068 >> v2:172.21.15.161:3300/0 conn(0x7f9f600b7c70 msgr2=0x7f9f600d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f64e2d640 1 --2- 172.21.15.6:0/2158511068 >> v2:172.21.15.161:3300/0 conn(0x7f9f600b7c70 0x7f9f600d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f64e2d640 1 -- 172.21.15.6:0/2158511068 >> v1:172.21.15.161:6789/0 conn(0x7f9f600d1850 legacy=0x7f9f6015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f64e2d640 1 -- 172.21.15.6:0/2158511068 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f600ccd90 con 0x7f9f6015fd60 2023-07-21T22:57:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f64e2d640 1 -- 172.21.15.6:0/2158511068 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f9f58001a00 con 0x7f9f6015fd60 2023-07-21T22:57:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f64e2d640 1 -- 172.21.15.6:0/2158511068 >> v1:172.21.15.6:6789/0 conn(0x7f9f6015fd60 legacy=0x7f9f600d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f64e2d640 1 --2- 172.21.15.6:0/2158511068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f4c003980 0x7f9f4c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f64e2d640 1 --2- 172.21.15.6:0/2158511068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f4c004370 0x7f9f4c004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f64e2d640 1 --2- 172.21.15.6:0/2158511068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f4c005030 0x7f9f4c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f64e2d640 1 -- 172.21.15.6:0/2158511068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c00bf80 con 0x7f9f4c005030 2023-07-21T22:57:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f64e2d640 1 -- 172.21.15.6:0/2158511068 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c00c0c0 con 0x7f9f4c004370 2023-07-21T22:57:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f64e2d640 1 -- 172.21.15.6:0/2158511068 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c00c280 con 0x7f9f4c003980 2023-07-21T22:57:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f66630640 1 --2- 172.21.15.6:0/2158511068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f4c005030 0x7f9f4c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f6562e640 1 --2- 172.21.15.6:0/2158511068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f4c004370 0x7f9f4c004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f65e2f640 1 --2- 172.21.15.6:0/2158511068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f4c003980 0x7f9f4c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f66630640 1 -- 172.21.15.6:0/2158511068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f4c003980 msgr2=0x7f9f4c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f66630640 1 --2- 172.21.15.6:0/2158511068 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f4c003980 0x7f9f4c003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f66630640 1 -- 172.21.15.6:0/2158511068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f4c004370 msgr2=0x7f9f4c004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f66630640 1 --2- 172.21.15.6:0/2158511068 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f4c004370 0x7f9f4c004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.196+0000 7f9f66630640 1 -- 172.21.15.6:0/2158511068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c003530 con 0x7f9f4c005030 2023-07-21T22:57:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.200+0000 7f9f66630640 1 -- 172.21.15.6:0/2158511068 reap_dead start 2023-07-21T22:57:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.200+0000 7f9f66630640 1 --2- 172.21.15.6:0/2158511068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f4c005030 0x7f9f4c00b990 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800a830 tx=0x7f9f5801faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a995abf89c58cf9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.200+0000 7f9f64e2d640 1 -- 172.21.15.6:0/2158511068 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f580af070 con 0x7f9f4c005030 2023-07-21T22:57:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.200+0000 7f9f64e2d640 1 -- 172.21.15.6:0/2158511068 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f580aa4d0 con 0x7f9f4c005030 2023-07-21T22:57:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.200+0000 7f9f64e2d640 1 -- 172.21.15.6:0/2158511068 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f580aa8a0 con 0x7f9f4c005030 2023-07-21T22:57:17.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.200+0000 7f9f68093640 1 -- 172.21.15.6:0/2158511068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f4c005030 msgr2=0x7f9f4c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.200+0000 7f9f68093640 1 --2- 172.21.15.6:0/2158511068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f4c005030 0x7f9f4c00b990 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800a830 tx=0x7f9f5801faa0 comp rx=0 tx=0).stop 2023-07-21T22:57:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.200+0000 7f9f68093640 1 -- 172.21.15.6:0/2158511068 shutdown_connections 2023-07-21T22:57:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.200+0000 7f9f68093640 1 --2- 172.21.15.6:0/2158511068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f4c005030 0x7f9f4c00b990 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.200+0000 7f9f68093640 1 -- 172.21.15.6:0/2158511068 >> 172.21.15.6:0/2158511068 conn(0x7f9f600650b0 msgr2=0x7f9f600654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.200+0000 7f9f68093640 1 -- 172.21.15.6:0/2158511068 shutdown_connections 2023-07-21T22:57:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.200+0000 7f9f68093640 1 -- 172.21.15.6:0/2158511068 wait complete. 2023-07-21T22:57:17.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f68093640 1 Processor -- start 2023-07-21T22:57:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f68093640 1 -- start start 2023-07-21T22:57:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f68093640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f4c005030 0x7f9f60152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f68093640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f600c6f10 0x7f9f600c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f68093640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f600b0f60 0x7f9f600b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f68093640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f600b1910 con 0x7f9f600c6f10 2023-07-21T22:57:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f68093640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f600c8a90 con 0x7f9f600b0f60 2023-07-21T22:57:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f68093640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f600c7380 con 0x7f9f4c005030 2023-07-21T22:57:17.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f6562e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f600c6f10 0x7f9f600c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f6562e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f600c6f10 0x7f9f600c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39904/0 (socket says 172.21.15.6:39904) 2023-07-21T22:57:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f6562e640 1 -- 172.21.15.6:0/3047731925 learned_addr learned my addr 172.21.15.6:0/3047731925 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f66630640 1 --2- 172.21.15.6:0/3047731925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f600b0f60 0x7f9f600b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f65e2f640 1 --2- 172.21.15.6:0/3047731925 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f4c005030 0x7f9f60152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f6562e640 1 -- 172.21.15.6:0/3047731925 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f4c005030 msgr2=0x7f9f60152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f6562e640 1 --2- 172.21.15.6:0/3047731925 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f4c005030 0x7f9f60152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:17.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f6562e640 1 -- 172.21.15.6:0/3047731925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f600b0f60 msgr2=0x7f9f600b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f6562e640 1 --2- 172.21.15.6:0/3047731925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f600b0f60 0x7f9f600b13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f6562e640 1 -- 172.21.15.6:0/3047731925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f600c7e80 con 0x7f9f600c6f10 2023-07-21T22:57:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f66630640 1 --2- 172.21.15.6:0/3047731925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f600b0f60 0x7f9f600b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f6562e640 1 --2- 172.21.15.6:0/3047731925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f600c6f10 0x7f9f600c7780 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000f820 tx=0x7f9f5000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f567fc640 1 -- 172.21.15.6:0/3047731925 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5000fed0 con 0x7f9f600c6f10 2023-07-21T22:57:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f567fc640 1 -- 172.21.15.6:0/3047731925 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f500052e0 con 0x7f9f600c6f10 2023-07-21T22:57:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f567fc640 1 -- 172.21.15.6:0/3047731925 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5000d970 con 0x7f9f600c6f10 2023-07-21T22:57:17.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f68093640 1 -- 172.21.15.6:0/3047731925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f600c8160 con 0x7f9f600c6f10 2023-07-21T22:57:17.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.204+0000 7f9f68093640 1 -- 172.21.15.6:0/3047731925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f600c8720 con 0x7f9f600c6f10 2023-07-21T22:57:17.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.208+0000 7f9f68093640 1 -- 172.21.15.6:0/3047731925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f600c88e0 con 0x7f9f600c6f10 2023-07-21T22:57:17.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.208+0000 7f9f567fc640 1 -- 172.21.15.6:0/3047731925 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9f5000dad0 con 0x7f9f600c6f10 2023-07-21T22:57:17.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.208+0000 7f9f567fc640 1 --2- 172.21.15.6:0/3047731925 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f9f440663a0 0x7f9f44068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:17.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.208+0000 7f9f567fc640 1 -- 172.21.15.6:0/3047731925 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6170+0+0 (secure 0 0 0) 0x7f9f50083f80 con 0x7f9f600c6f10 2023-07-21T22:57:17.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.208+0000 7f9f65e2f640 1 --2- 172.21.15.6:0/3047731925 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f9f440663a0 0x7f9f44068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:17.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.208+0000 7f9f65e2f640 1 --2- 172.21.15.6:0/3047731925 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f9f440663a0 0x7f9f44068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9f600cc850 tx=0x7f9f5c008040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:17.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.212+0000 7f9f567fc640 1 -- 172.21.15.6:0/3047731925 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9f500511e0 con 0x7f9f600c6f10 2023-07-21T22:57:17.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.400+0000 7f9f68093640 1 -- 172.21.15.6:0/3047731925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f600678d0 con 0x7f9f600c6f10 2023-07-21T22:57:17.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.404+0000 7f9f567fc640 1 -- 172.21.15.6:0/3047731925 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+3527 (secure 0 0 0) 0x7f9f50054800 con 0x7f9f600c6f10 2023-07-21T22:57:17.438 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:17.438 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":80,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9508,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/1909144233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1909144233},{"type":"v1","addr":"172.21.15.161:6836","nonce":1909144233}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9511,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/1479759663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":1479759663},{"type":"v1","addr":"172.21.15.161:6837","nonce":1479759663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":9954,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/2241291399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":2241291399},{"type":"v1","addr":"172.21.15.6:6834","nonce":2241291399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":10428,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/559156268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":559156268},{"type":"v1","addr":"172.21.15.6:6835","nonce":559156268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[]} 2023-07-21T22:57:17.439 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 80 2023-07-21T22:57:17.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.404+0000 7f9f68093640 1 -- 172.21.15.6:0/3047731925 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f9f440663a0 msgr2=0x7f9f44068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:17.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.404+0000 7f9f68093640 1 --2- 172.21.15.6:0/3047731925 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f9f440663a0 0x7f9f44068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9f600cc850 tx=0x7f9f5c008040 comp rx=0 tx=0).stop 2023-07-21T22:57:17.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.404+0000 7f9f68093640 1 -- 172.21.15.6:0/3047731925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f600c6f10 msgr2=0x7f9f600c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:17.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.404+0000 7f9f68093640 1 --2- 172.21.15.6:0/3047731925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f600c6f10 0x7f9f600c7780 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000f820 tx=0x7f9f5000fce0 comp rx=0 tx=0).stop 2023-07-21T22:57:17.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.404+0000 7f9f68093640 1 -- 172.21.15.6:0/3047731925 shutdown_connections 2023-07-21T22:57:17.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.404+0000 7f9f68093640 1 --2- 172.21.15.6:0/3047731925 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f9f440663a0 0x7f9f44068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:17.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.404+0000 7f9f68093640 1 --2- 172.21.15.6:0/3047731925 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f600b0f60 0x7f9f600b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:17.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.404+0000 7f9f68093640 1 --2- 172.21.15.6:0/3047731925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f600c6f10 0x7f9f600c7780 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:17.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.404+0000 7f9f68093640 1 --2- 172.21.15.6:0/3047731925 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9f4c005030 0x7f9f60152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:17.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.404+0000 7f9f68093640 1 -- 172.21.15.6:0/3047731925 >> 172.21.15.6:0/3047731925 conn(0x7f9f600650b0 msgr2=0x7f9f600cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:17.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.404+0000 7f9f68093640 1 -- 172.21.15.6:0/3047731925 shutdown_connections 2023-07-21T22:57:17.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.404+0000 7f9f68093640 1 -- 172.21.15.6:0/3047731925 wait complete. 2023-07-21T22:57:17.459 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-21T22:57:17.459 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-21T22:57:17.460 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-21T22:57:17.460 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:57:17.460 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-21T22:57:17.460 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-21T22:57:17.461 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-21T22:57:17.461 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:57:17.461 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-21T22:57:17.461 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-21T22:57:17.461 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-21T22:57:17.462 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:57:17.462 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-21T22:57:17.462 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-21T22:57:17.462 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-21T22:57:17.462 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:57:17.472 INFO:tasks.ceph.mds.a:Stopped 2023-07-21T22:57:17.473 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-21T22:57:17.474 INFO:tasks.ceph.mds.c:Stopped 2023-07-21T22:57:17.474 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-21T22:57:17.478 INFO:tasks.ceph.mds.b:Stopped 2023-07-21T22:57:17.478 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-21T22:57:17.479 INFO:tasks.ceph.mds.d:Stopped 2023-07-21T22:57:17.479 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-21T22:57:17.521 INFO:tasks.ceph.mds.a:Started 2023-07-21T22:57:17.521 DEBUG:teuthology.parallel:result is None 2023-07-21T22:57:17.522 INFO:tasks.ceph.mds.c:Started 2023-07-21T22:57:17.523 DEBUG:teuthology.parallel:result is None 2023-07-21T22:57:17.527 INFO:tasks.ceph.mds.b:Started 2023-07-21T22:57:17.527 DEBUG:teuthology.parallel:result is None 2023-07-21T22:57:17.529 INFO:tasks.ceph.mds.d:Started 2023-07-21T22:57:17.530 DEBUG:teuthology.parallel:result is None 2023-07-21T22:57:17.530 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-21T22:57:17.611 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-07-21T22:57:17.612 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-21T22:57:17.622 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-07-21T22:57:17.623 INFO:tasks.ceph.mds.d.smithi161.stdout:starting mds.d at 2023-07-21T22:57:17.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.644+0000 7f489359e640 1 Processor -- start 2023-07-21T22:57:17.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.644+0000 7f489359e640 1 -- start start 2023-07-21T22:57:17.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.648+0000 7f489359e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f489415f3f0 0x7f48940b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:17.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.648+0000 7f489359e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f48940d13f0 0x7f48940b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:17.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.648+0000 7f489359e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48940d0f60 con 0x7f48940cc9a0 2023-07-21T22:57:17.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.648+0000 7f489359e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48940cd4e0 con 0x7f48940d13f0 2023-07-21T22:57:17.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.648+0000 7f489359e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48940d0390 con 0x7f489415f3f0 2023-07-21T22:57:17.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.648+0000 7f4892d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f48940cc9a0 0x7f48940ccdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53470/0 (socket says 172.21.15.6:53470) 2023-07-21T22:57:17.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.648+0000 7f4892d9d640 1 -- 172.21.15.6:0/3462085203 learned_addr learned my addr 172.21.15.6:0/3462085203 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:17.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.648+0000 7f489259c640 1 --2- 172.21.15.6:0/3462085203 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f489415f3f0 0x7f48940b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:17.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.648+0000 7f488bfff640 1 --2- 172.21.15.6:0/3462085203 >> v2:172.21.15.161:3300/0 conn(0x7f48940d13f0 0x7f48940b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:17.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.648+0000 7f4891d9b640 1 -- 172.21.15.6:0/3462085203 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171139853 0 0) 0x7f48940d0f60 con 0x7f48940cc9a0 2023-07-21T22:57:17.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.648+0000 7f4891d9b640 1 -- 172.21.15.6:0/3462085203 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4880003530 con 0x7f48940cc9a0 2023-07-21T22:57:17.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.648+0000 7f488bfff640 1 -- 172.21.15.6:0/3462085203 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f489415f3f0 msgr2=0x7f48940b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:17.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.648+0000 7f488bfff640 1 --2- 172.21.15.6:0/3462085203 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f489415f3f0 0x7f48940b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:17.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.648+0000 7f488bfff640 1 -- 172.21.15.6:0/3462085203 >> v1:172.21.15.6:6789/0 conn(0x7f48940cc9a0 legacy=0x7f48940ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:17.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.648+0000 7f488bfff640 1 -- 172.21.15.6:0/3462085203 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48940d0630 con 0x7f48940d13f0 2023-07-21T22:57:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.652+0000 7f488bfff640 1 --2- 172.21.15.6:0/3462085203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48940d13f0 0x7f48940b7bc0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f487c0097c0 tx=0x7f487c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa4123a60c14fbd0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.652+0000 7f4891d9b640 1 -- 172.21.15.6:0/3462085203 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c0ab600 con 0x7f48940d13f0 2023-07-21T22:57:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.652+0000 7f4891d9b640 1 -- 172.21.15.6:0/3462085203 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487c0a7050 con 0x7f48940d13f0 2023-07-21T22:57:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.652+0000 7f4891d9b640 1 -- 172.21.15.6:0/3462085203 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c0ab960 con 0x7f48940d13f0 2023-07-21T22:57:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.652+0000 7f489359e640 1 -- 172.21.15.6:0/3462085203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48940d13f0 msgr2=0x7f48940b7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.652+0000 7f489359e640 1 --2- 172.21.15.6:0/3462085203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48940d13f0 0x7f48940b7bc0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f487c0097c0 tx=0x7f487c01c3f0 comp rx=0 tx=0).stop 2023-07-21T22:57:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.652+0000 7f489359e640 1 -- 172.21.15.6:0/3462085203 shutdown_connections 2023-07-21T22:57:17.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.652+0000 7f489359e640 1 --2- 172.21.15.6:0/3462085203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48940d13f0 0x7f48940b7bc0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:17.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.652+0000 7f489359e640 1 --2- 172.21.15.6:0/3462085203 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f489415f3f0 0x7f48940b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:17.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.652+0000 7f489359e640 1 -- 172.21.15.6:0/3462085203 >> 172.21.15.6:0/3462085203 conn(0x7f4894069f50 msgr2=0x7f489406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:17.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.652+0000 7f489359e640 1 -- 172.21.15.6:0/3462085203 shutdown_connections 2023-07-21T22:57:17.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.652+0000 7f489359e640 1 -- 172.21.15.6:0/3462085203 wait complete. 2023-07-21T22:57:17.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.652+0000 7f489359e640 1 Processor -- start 2023-07-21T22:57:17.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.652+0000 7f489359e640 1 -- start start 2023-07-21T22:57:17.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f489359e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48940cc9a0 0x7f4894144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:17.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f489359e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48940d13f0 0x7f4894147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:17.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f489359e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f489415f3f0 0x7f4894144120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:17.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f489359e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4894145c40 con 0x7f489415f3f0 2023-07-21T22:57:17.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f489359e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48941479c0 con 0x7f48940cc9a0 2023-07-21T22:57:17.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f489359e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4894145030 con 0x7f48940d13f0 2023-07-21T22:57:17.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f4892d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f489415f3f0 0x7f4894144120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:17.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f4892d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f489415f3f0 0x7f4894144120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37198/0 (socket says 172.21.15.6:37198) 2023-07-21T22:57:17.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f4892d9d640 1 -- 172.21.15.6:0/1553530033 learned_addr learned my addr 172.21.15.6:0/1553530033 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:17.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f489259c640 1 --2- 172.21.15.6:0/1553530033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48940cc9a0 0x7f4894144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:17.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f488bfff640 1 --2- 172.21.15.6:0/1553530033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48940d13f0 0x7f4894147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:17.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f4892d9d640 1 -- 172.21.15.6:0/1553530033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48940d13f0 msgr2=0x7f4894147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f4892d9d640 1 --2- 172.21.15.6:0/1553530033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48940d13f0 0x7f4894147480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f4892d9d640 1 -- 172.21.15.6:0/1553530033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48940cc9a0 msgr2=0x7f4894144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f4892d9d640 1 --2- 172.21.15.6:0/1553530033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48940cc9a0 0x7f4894144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f4892d9d640 1 -- 172.21.15.6:0/1553530033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c009420 con 0x7f489415f3f0 2023-07-21T22:57:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f488bfff640 1 --2- 172.21.15.6:0/1553530033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48940d13f0 0x7f4894147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f4892d9d640 1 --2- 172.21.15.6:0/1553530033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f489415f3f0 0x7f4894144120 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f488c00cb40 tx=0x7f488c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f488affd640 1 -- 172.21.15.6:0/1553530033 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c00aca0 con 0x7f489415f3f0 2023-07-21T22:57:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f488affd640 1 -- 172.21.15.6:0/1553530033 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488c00ae00 con 0x7f489415f3f0 2023-07-21T22:57:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f489359e640 1 -- 172.21.15.6:0/1553530033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4894145310 con 0x7f489415f3f0 2023-07-21T22:57:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f488affd640 1 -- 172.21.15.6:0/1553530033 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c012620 con 0x7f489415f3f0 2023-07-21T22:57:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f489359e640 1 -- 172.21.15.6:0/1553530033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48941458d0 con 0x7f489415f3f0 2023-07-21T22:57:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f489359e640 1 -- 172.21.15.6:0/1553530033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4894145db0 con 0x7f489415f3f0 2023-07-21T22:57:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.656+0000 7f488affd640 1 -- 172.21.15.6:0/1553530033 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f488c007070 con 0x7f489415f3f0 2023-07-21T22:57:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.660+0000 7f488affd640 1 --2- 172.21.15.6:0/1553530033 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f48740663d0 0x7f4874068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.660+0000 7f488affd640 1 -- 172.21.15.6:0/1553530033 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6170+0+0 (secure 0 0 0) 0x7f488c083ef0 con 0x7f489415f3f0 2023-07-21T22:57:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.660+0000 7f489259c640 1 --2- 172.21.15.6:0/1553530033 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f48740663d0 0x7f4874068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.660+0000 7f489259c640 1 --2- 172.21.15.6:0/1553530033 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f48740663d0 0x7f4874068880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4884009ac0 tx=0x7f4884009190 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.664+0000 7f488affd640 1 -- 172.21.15.6:0/1553530033 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f488c051200 con 0x7f489415f3f0 2023-07-21T22:57:17.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:17.840+0000 7f489359e640 1 -- 172.21.15.6:0/1553530033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f48940678d0 con 0x7f489415f3f0 2023-07-21T22:57:18.700 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:57:18.705 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:57:18.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:18.832+0000 7f488affd640 1 -- 172.21.15.6:0/1553530033 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v188) v1 ==== 97+0+0 (secure 0 0 0) 0x7f488c017020 con 0x7f489415f3f0 2023-07-21T22:57:18.868 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-07-21T22:57:18.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:18.836+0000 7f489359e640 1 -- 172.21.15.6:0/1553530033 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f48740663d0 msgr2=0x7f4874068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:18.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:18.836+0000 7f489359e640 1 --2- 172.21.15.6:0/1553530033 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f48740663d0 0x7f4874068880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4884009ac0 tx=0x7f4884009190 comp rx=0 tx=0).stop 2023-07-21T22:57:18.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:18.836+0000 7f489359e640 1 -- 172.21.15.6:0/1553530033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f489415f3f0 msgr2=0x7f4894144120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:18.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:18.836+0000 7f489359e640 1 --2- 172.21.15.6:0/1553530033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f489415f3f0 0x7f4894144120 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f488c00cb40 tx=0x7f488c00a060 comp rx=0 tx=0).stop 2023-07-21T22:57:18.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:18.836+0000 7f489359e640 1 -- 172.21.15.6:0/1553530033 shutdown_connections 2023-07-21T22:57:18.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:18.836+0000 7f489359e640 1 --2- 172.21.15.6:0/1553530033 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f48740663d0 0x7f4874068880 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:18.836+0000 7f489359e640 1 --2- 172.21.15.6:0/1553530033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f489415f3f0 0x7f4894144120 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:18.836+0000 7f489359e640 1 --2- 172.21.15.6:0/1553530033 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f48940d13f0 0x7f4894147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:18.836+0000 7f489359e640 1 --2- 172.21.15.6:0/1553530033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f48940cc9a0 0x7f4894144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:18.836+0000 7f489359e640 1 -- 172.21.15.6:0/1553530033 >> 172.21.15.6:0/1553530033 conn(0x7f4894069f50 msgr2=0x7f489415ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:18.836+0000 7f489359e640 1 -- 172.21.15.6:0/1553530033 shutdown_connections 2023-07-21T22:57:18.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:18.836+0000 7f489359e640 1 -- 172.21.15.6:0/1553530033 wait complete. 2023-07-21T22:57:18.895 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-21T22:57:19.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.012+0000 7f44e6900640 1 Processor -- start 2023-07-21T22:57:19.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.012+0000 7f44e6900640 1 -- start start 2023-07-21T22:57:19.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.012+0000 7f44e6900640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44e015f500 0x7f44e006cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.012+0000 7f44e6900640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e006d430 0x7f44e006a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.012+0000 7f44e6900640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f44e006aa80 0x7f44e00b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.012+0000 7f44e6900640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e006af20 con 0x7f44e015f500 2023-07-21T22:57:19.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.012+0000 7f44e6900640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e00cdc80 con 0x7f44e006aa80 2023-07-21T22:57:19.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.012+0000 7f44e6900640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e006e4c0 con 0x7f44e006d430 2023-07-21T22:57:19.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.012+0000 7f44dffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44e015f500 0x7f44e006cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.012+0000 7f44dffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f44e015f500 0x7f44e006cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37210/0 (socket says 172.21.15.6:37210) 2023-07-21T22:57:19.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.012+0000 7f44dffff640 1 -- 172.21.15.6:0/3086365644 learned_addr learned my addr 172.21.15.6:0/3086365644 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:19.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.012+0000 7f44df7fe640 1 --2- 172.21.15.6:0/3086365644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e006d430 0x7f44e006a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.012+0000 7f44e4e9d640 1 --2- 172.21.15.6:0/3086365644 >> v2:172.21.15.161:3300/0 conn(0x7f44e006aa80 0x7f44e00b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.012+0000 7f44dffff640 1 -- 172.21.15.6:0/3086365644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e006d430 msgr2=0x7f44e006a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:19.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.012+0000 7f44dffff640 1 --2- 172.21.15.6:0/3086365644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e006d430 0x7f44e006a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.012+0000 7f44dffff640 1 -- 172.21.15.6:0/3086365644 >> v2:172.21.15.161:3300/0 conn(0x7f44e006aa80 msgr2=0x7f44e00b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:19.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.012+0000 7f44dffff640 1 --2- 172.21.15.6:0/3086365644 >> v2:172.21.15.161:3300/0 conn(0x7f44e006aa80 0x7f44e00b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.012+0000 7f44dffff640 1 -- 172.21.15.6:0/3086365644 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e006d940 con 0x7f44e015f500 2023-07-21T22:57:19.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.012+0000 7f44e4e9d640 1 --2- 172.21.15.6:0/3086365644 >> v2:172.21.15.161:3300/0 conn(0x7f44e006aa80 0x7f44e00b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:19.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.012+0000 7f44df7fe640 1 --2- 172.21.15.6:0/3086365644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e006d430 0x7f44e006a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:19.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.016+0000 7f44dffff640 1 --2- 172.21.15.6:0/3086365644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44e015f500 0x7f44e006cef0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f44e00713b0 tx=0x7f44d001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6bd7f5a2af4963d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:19.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.016+0000 7f44deffd640 1 -- 172.21.15.6:0/3086365644 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d00ab600 con 0x7f44e015f500 2023-07-21T22:57:19.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.016+0000 7f44deffd640 1 -- 172.21.15.6:0/3086365644 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d00a7050 con 0x7f44e015f500 2023-07-21T22:57:19.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.016+0000 7f44deffd640 1 -- 172.21.15.6:0/3086365644 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d00ab980 con 0x7f44e015f500 2023-07-21T22:57:19.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.016+0000 7f44e6900640 1 -- 172.21.15.6:0/3086365644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44e015f500 msgr2=0x7f44e006cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:19.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.016+0000 7f44e6900640 1 --2- 172.21.15.6:0/3086365644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44e015f500 0x7f44e006cef0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f44e00713b0 tx=0x7f44d001c240 comp rx=0 tx=0).stop 2023-07-21T22:57:19.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.016+0000 7f44e6900640 1 -- 172.21.15.6:0/3086365644 shutdown_connections 2023-07-21T22:57:19.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.016+0000 7f44e6900640 1 --2- 172.21.15.6:0/3086365644 >> v2:172.21.15.161:3300/0 conn(0x7f44e006aa80 0x7f44e00b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.016+0000 7f44e6900640 1 --2- 172.21.15.6:0/3086365644 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e006d430 0x7f44e006a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.016+0000 7f44e6900640 1 --2- 172.21.15.6:0/3086365644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44e015f500 0x7f44e006cef0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.016+0000 7f44e6900640 1 -- 172.21.15.6:0/3086365644 >> 172.21.15.6:0/3086365644 conn(0x7f44e00659d0 msgr2=0x7f44e0099460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:19.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.016+0000 7f44e6900640 1 -- 172.21.15.6:0/3086365644 shutdown_connections 2023-07-21T22:57:19.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.016+0000 7f44e6900640 1 -- 172.21.15.6:0/3086365644 wait complete. 2023-07-21T22:57:19.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44e6900640 1 Processor -- start 2023-07-21T22:57:19.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44e6900640 1 -- start start 2023-07-21T22:57:19.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44e6900640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44e006aa80 0x7f44e00ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44e6900640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e006d430 0x7f44e015cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44e6900640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44e015f500 0x7f44e014d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44e6900640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e015d7f0 con 0x7f44e015f500 2023-07-21T22:57:19.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44e6900640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e015dad0 con 0x7f44e006aa80 2023-07-21T22:57:19.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44e6900640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e015ddb0 con 0x7f44e006d430 2023-07-21T22:57:19.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44e4e9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44e015f500 0x7f44e014d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44dffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44e006aa80 0x7f44e00ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44e4e9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44e015f500 0x7f44e014d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37226/0 (socket says 172.21.15.6:37226) 2023-07-21T22:57:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44e4e9d640 1 -- 172.21.15.6:0/671452187 learned_addr learned my addr 172.21.15.6:0/671452187 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44df7fe640 1 --2- 172.21.15.6:0/671452187 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e006d430 0x7f44e015cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44e4e9d640 1 -- 172.21.15.6:0/671452187 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e006d430 msgr2=0x7f44e015cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44e4e9d640 1 --2- 172.21.15.6:0/671452187 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e006d430 0x7f44e015cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44e4e9d640 1 -- 172.21.15.6:0/671452187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44e006aa80 msgr2=0x7f44e00ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:19.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44e4e9d640 1 --2- 172.21.15.6:0/671452187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44e006aa80 0x7f44e00ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44e4e9d640 1 -- 172.21.15.6:0/671452187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d0009480 con 0x7f44e015f500 2023-07-21T22:57:19.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44dffff640 1 --2- 172.21.15.6:0/671452187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44e006aa80 0x7f44e00ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:19.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44e4e9d640 1 --2- 172.21.15.6:0/671452187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44e015f500 0x7f44e014d5a0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f44d800cef0 tx=0x7f44d800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:19.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44dcff9640 1 -- 172.21.15.6:0/671452187 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d800d840 con 0x7f44e015f500 2023-07-21T22:57:19.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44dcff9640 1 -- 172.21.15.6:0/671452187 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d800d9a0 con 0x7f44e015f500 2023-07-21T22:57:19.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44dcff9640 1 -- 172.21.15.6:0/671452187 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d800dd50 con 0x7f44e015f500 2023-07-21T22:57:19.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44e6900640 1 -- 172.21.15.6:0/671452187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e015e090 con 0x7f44e015f500 2023-07-21T22:57:19.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.020+0000 7f44e6900640 1 -- 172.21.15.6:0/671452187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e014dae0 con 0x7f44e015f500 2023-07-21T22:57:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.024+0000 7f44e6900640 1 -- 172.21.15.6:0/671452187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e00cb160 con 0x7f44e015f500 2023-07-21T22:57:19.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.024+0000 7f44dcff9640 1 -- 172.21.15.6:0/671452187 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f44d801e3b0 con 0x7f44e015f500 2023-07-21T22:57:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.024+0000 7f44dcff9640 1 --2- 172.21.15.6:0/671452187 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f44cc0663a0 0x7f44cc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.024+0000 7f44dcff9640 1 -- 172.21.15.6:0/671452187 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f44d8084510 con 0x7f44e015f500 2023-07-21T22:57:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.024+0000 7f44dffff640 1 --2- 172.21.15.6:0/671452187 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f44cc0663a0 0x7f44cc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.024+0000 7f44dffff640 1 --2- 172.21.15.6:0/671452187 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f44cc0663a0 0x7f44cc068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f44d00ad000 tx=0x7f44d00a6000 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.028+0000 7f44dcff9640 1 -- 172.21.15.6:0/671452187 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f44e00cb160 con 0x7f44e015f500 2023-07-21T22:57:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.232+0000 7f44e6900640 1 -- 172.21.15.6:0/671452187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f44e00cb160 con 0x7f44e015f500 2023-07-21T22:57:19.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.232+0000 7f44dcff9640 1 -- 172.21.15.6:0/671452187 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v29) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f44e00cb160 con 0x7f44e015f500 2023-07-21T22:57:19.271 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:19.271 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:57:19.271 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-07-21T22:57:19.272 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:19.272 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-07-21T22:57:19.272 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkHn5HNxAADk0AaSGwZfEj3SwNvEm8hw==", 2023-07-21T22:57:19.272 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:57:19.273 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:57:19.273 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:57:19.273 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:57:19.273 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:57:19.273 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:19.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:57:19.274 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:19.274 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-07-21T22:57:19.274 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkQFvXCBAANxf0/I2RQcHy4iYiydjkcg==", 2023-07-21T22:57:19.274 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:57:19.275 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:57:19.275 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:57:19.275 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:57:19.275 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:57:19.276 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:19.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:57:19.276 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:19.276 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-07-21T22:57:19.276 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkYtGXAxAAy+RDDBSvc1FeZq+eg23tRA==", 2023-07-21T22:57:19.277 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:57:19.277 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:57:19.277 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:57:19.277 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:57:19.278 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:57:19.278 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:19.278 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:57:19.278 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:19.278 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-07-21T22:57:19.278 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkH+Y1EBAAl+qTqd+gFrB9LtJWwD5dgA==", 2023-07-21T22:57:19.279 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:57:19.279 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:57:19.279 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:57:19.279 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:57:19.279 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:57:19.279 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:19.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:57:19.280 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:19.280 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-07-21T22:57:19.280 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAKBLtkPwZrLBAAQHZECi2zHST1MKYgGoa/Iw==", 2023-07-21T22:57:19.280 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:57:19.280 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:57:19.280 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:57:19.281 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:57:19.281 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:19.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:57:19.281 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:19.281 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-07-21T22:57:19.281 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQANBLtkvwgwNBAApurMm8c3pSlX2r16Gli/Ag==", 2023-07-21T22:57:19.281 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:57:19.281 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:57:19.282 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:57:19.282 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:57:19.282 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:19.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:57:19.282 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:19.282 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-07-21T22:57:19.282 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAQBLtkf2p1OxAAcKYw2RixFefYAwcfkGnOKQ==", 2023-07-21T22:57:19.283 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:57:19.283 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:57:19.283 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:57:19.283 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:57:19.283 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:19.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:57:19.283 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:19.283 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-07-21T22:57:19.284 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAUBLtkQUl6BhAAXXT1ZK1h9aZEcp6qIHsLiA==", 2023-07-21T22:57:19.284 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:57:19.284 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:57:19.284 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:57:19.284 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:57:19.284 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:19.284 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:57:19.285 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:19.285 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-07-21T22:57:19.285 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAaBLtkc1VfExAAPzDz2k/c0qVePG9h1saQCw==", 2023-07-21T22:57:19.285 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:57:19.285 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:57:19.285 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:57:19.285 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:57:19.286 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:19.286 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:57:19.286 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:19.286 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-07-21T22:57:19.286 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAdBLtkJ6fcGhAAglVSJIQS04WYBv4APhl57g==", 2023-07-21T22:57:19.286 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:57:19.286 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:57:19.287 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:57:19.287 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:57:19.287 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:19.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:57:19.287 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:19.287 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-07-21T22:57:19.287 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAgBLtkPINGIRAAWKs1RNQIdhZYlDAzDgUkNw==", 2023-07-21T22:57:19.288 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:57:19.288 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:57:19.288 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:57:19.288 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:57:19.288 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:19.289 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:57:19.289 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:19.289 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-07-21T22:57:19.289 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAjBLtk83MCKBAAZH2NhMBphVv4QkRzy+NDgg==", 2023-07-21T22:57:19.289 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:57:19.289 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-21T22:57:19.289 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-21T22:57:19.290 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:57:19.290 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:19.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:57:19.290 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:19.290 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-07-21T22:57:19.290 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA==", 2023-07-21T22:57:19.290 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:57:19.291 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:57:19.291 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow r", 2023-07-21T22:57:19.291 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-21T22:57:19.291 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:19.291 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:57:19.291 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:19.291 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-07-21T22:57:19.291 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkPVXTHhAAYmkzwAvqsfrowpAucTnlUQ==", 2023-07-21T22:57:19.292 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:57:19.292 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:57:19.292 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:57:19.292 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:57:19.293 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:57:19.293 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:19.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:57:19.294 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:19.294 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-07-21T22:57:19.294 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkd7wSGxAArvSYwe+k48vgRzb3fQAEAQ==", 2023-07-21T22:57:19.294 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:57:19.295 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:57:19.295 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:57:19.295 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:57:19.295 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:57:19.296 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:19.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:57:19.296 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:19.296 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-07-21T22:57:19.297 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAHBLtkoZ4YJRAAX4yh0Q1pR4wY7yEV6kg9QA==", 2023-07-21T22:57:19.297 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:57:19.297 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-21T22:57:19.298 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-21T22:57:19.298 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-21T22:57:19.298 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-21T22:57:19.298 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:19.299 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:57:19.299 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:19.299 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-07-21T22:57:19.299 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtk0ILFGhAAQZ+8lGNFVdOtZYOuLlfkoQ==", 2023-07-21T22:57:19.299 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:57:19.299 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:57:19.300 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-21T22:57:19.300 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-21T22:57:19.300 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:57:19.300 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:19.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:57:19.300 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:19.300 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-07-21T22:57:19.301 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkdobtMhAAQbwi3cvsrW9P0t3d52oEKw==", 2023-07-21T22:57:19.301 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:57:19.301 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:57:19.301 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T22:57:19.301 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:57:19.301 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:19.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:57:19.301 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:19.302 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-07-21T22:57:19.302 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQAGBLtkHhzpLhAAZTx4Vrc0Htk88104SzuAxQ==", 2023-07-21T22:57:19.302 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-21T22:57:19.302 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-21T22:57:19.302 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-21T22:57:19.302 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-21T22:57:19.302 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:19.303 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:19.303 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-07-21T22:57:19.303 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:57:19.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.236+0000 7f44e6900640 1 -- 172.21.15.6:0/671452187 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f44cc0663a0 msgr2=0x7f44cc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.236+0000 7f44e6900640 1 --2- 172.21.15.6:0/671452187 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f44cc0663a0 0x7f44cc068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f44d00ad000 tx=0x7f44d00a6000 comp rx=0 tx=0).stop 2023-07-21T22:57:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.236+0000 7f44e6900640 1 -- 172.21.15.6:0/671452187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44e015f500 msgr2=0x7f44e014d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.236+0000 7f44e6900640 1 --2- 172.21.15.6:0/671452187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44e015f500 0x7f44e014d5a0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f44d800cef0 tx=0x7f44d800a710 comp rx=0 tx=0).stop 2023-07-21T22:57:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.236+0000 7f44e6900640 1 -- 172.21.15.6:0/671452187 shutdown_connections 2023-07-21T22:57:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.236+0000 7f44e6900640 1 --2- 172.21.15.6:0/671452187 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f44cc0663a0 0x7f44cc068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.236+0000 7f44e6900640 1 --2- 172.21.15.6:0/671452187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44e015f500 0x7f44e014d5a0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.236+0000 7f44e6900640 1 --2- 172.21.15.6:0/671452187 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f44e006d430 0x7f44e015cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.236+0000 7f44e6900640 1 --2- 172.21.15.6:0/671452187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f44e006aa80 0x7f44e00ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.236+0000 7f44e6900640 1 -- 172.21.15.6:0/671452187 >> 172.21.15.6:0/671452187 conn(0x7f44e00659d0 msgr2=0x7f44e00b0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.236+0000 7f44e6900640 1 -- 172.21.15.6:0/671452187 shutdown_connections 2023-07-21T22:57:19.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.236+0000 7f44e6900640 1 -- 172.21.15.6:0/671452187 wait complete. 2023-07-21T22:57:19.308 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:57:19.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.416+0000 7f5afcf11640 1 Processor -- start 2023-07-21T22:57:19.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.416+0000 7f5afcf11640 1 -- start start 2023-07-21T22:57:19.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.420+0000 7f5afcf11640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5af80ae1f0 0x7f5af80b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.420+0000 7f5afcf11640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5af806e160 0x7f5af806bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.420+0000 7f5afcf11640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af806a440 con 0x7f5af806c260 2023-07-21T22:57:19.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.420+0000 7f5afcf11640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af806c660 con 0x7f5af80ae1f0 2023-07-21T22:57:19.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.420+0000 7f5afcf11640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af80b24f0 con 0x7f5af806e160 2023-07-21T22:57:19.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.420+0000 7f5af659c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5af80ae1f0 0x7f5af80b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.420+0000 7f5af6d9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5af806c260 0x7f5af815f7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53484/0 (socket says 172.21.15.6:53484) 2023-07-21T22:57:19.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.420+0000 7f5af6d9d640 1 -- 172.21.15.6:0/4072220075 learned_addr learned my addr 172.21.15.6:0/4072220075 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:19.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.420+0000 7f5aeffff640 1 --2- 172.21.15.6:0/4072220075 >> v2:172.21.15.161:3300/0 conn(0x7f5af806e160 0x7f5af806bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.420+0000 7f5af659c640 1 -- 172.21.15.6:0/4072220075 >> v2:172.21.15.161:3300/0 conn(0x7f5af806e160 msgr2=0x7f5af806bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:19.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.420+0000 7f5af659c640 1 --2- 172.21.15.6:0/4072220075 >> v2:172.21.15.161:3300/0 conn(0x7f5af806e160 0x7f5af806bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.420+0000 7f5af659c640 1 -- 172.21.15.6:0/4072220075 >> v1:172.21.15.6:6789/0 conn(0x7f5af806c260 legacy=0x7f5af815f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:19.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.420+0000 7f5af659c640 1 -- 172.21.15.6:0/4072220075 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af80b27d0 con 0x7f5af80ae1f0 2023-07-21T22:57:19.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.420+0000 7f5aeffff640 1 --2- 172.21.15.6:0/4072220075 >> v2:172.21.15.161:3300/0 conn(0x7f5af806e160 0x7f5af806bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:19.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.420+0000 7f5af5d9b640 1 -- 172.21.15.6:0/4072220075 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895528953 0 0) 0x7f5af806a440 con 0x7f5af806c260 2023-07-21T22:57:19.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.424+0000 7f5af659c640 1 --2- 172.21.15.6:0/4072220075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af80ae1f0 0x7f5af80b1e60 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f5af80cf720 tx=0x7f5ae801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7906fbfd8f204ec server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:19.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.424+0000 7f5af5d9b640 1 -- 172.21.15.6:0/4072220075 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8004230 con 0x7f5af80ae1f0 2023-07-21T22:57:19.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.424+0000 7f5af5d9b640 1 -- 172.21.15.6:0/4072220075 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae80a7050 con 0x7f5af80ae1f0 2023-07-21T22:57:19.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.424+0000 7f5af5d9b640 1 -- 172.21.15.6:0/4072220075 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8003620 con 0x7f5af80ae1f0 2023-07-21T22:57:19.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.424+0000 7f5afcf11640 1 -- 172.21.15.6:0/4072220075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af80ae1f0 msgr2=0x7f5af80b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:19.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.424+0000 7f5afcf11640 1 --2- 172.21.15.6:0/4072220075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af80ae1f0 0x7f5af80b1e60 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f5af80cf720 tx=0x7f5ae801c430 comp rx=0 tx=0).stop 2023-07-21T22:57:19.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.424+0000 7f5afcf11640 1 -- 172.21.15.6:0/4072220075 shutdown_connections 2023-07-21T22:57:19.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.424+0000 7f5afcf11640 1 --2- 172.21.15.6:0/4072220075 >> v2:172.21.15.161:3300/0 conn(0x7f5af806e160 0x7f5af806bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.424+0000 7f5afcf11640 1 --2- 172.21.15.6:0/4072220075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af80ae1f0 0x7f5af80b1e60 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.424+0000 7f5afcf11640 1 -- 172.21.15.6:0/4072220075 >> 172.21.15.6:0/4072220075 conn(0x7f5af80b1300 msgr2=0x7f5af80ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:19.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.424+0000 7f5afcf11640 1 -- 172.21.15.6:0/4072220075 shutdown_connections 2023-07-21T22:57:19.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.424+0000 7f5afcf11640 1 -- 172.21.15.6:0/4072220075 wait complete. 2023-07-21T22:57:19.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.424+0000 7f5afcf11640 1 Processor -- start 2023-07-21T22:57:19.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.424+0000 7f5afcf11640 1 -- start start 2023-07-21T22:57:19.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5afcf11640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af806c260 0x7f5af815f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5afcf11640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5af806e160 0x7f5af8143350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5afcf11640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5af80ae1f0 0x7f5af8144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5afcf11640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af8069430 con 0x7f5af806c260 2023-07-21T22:57:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5afcf11640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af8143c50 con 0x7f5af80ae1f0 2023-07-21T22:57:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5afcf11640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af8069640 con 0x7f5af806e160 2023-07-21T22:57:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5af659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af806c260 0x7f5af815f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5af659c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af806c260 0x7f5af815f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37240/0 (socket says 172.21.15.6:37240) 2023-07-21T22:57:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5af659c640 1 -- 172.21.15.6:0/1615323269 learned_addr learned my addr 172.21.15.6:0/1615323269 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5aeffff640 1 --2- 172.21.15.6:0/1615323269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5af806e160 0x7f5af8143350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5af6d9d640 1 --2- 172.21.15.6:0/1615323269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5af80ae1f0 0x7f5af8144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5af659c640 1 -- 172.21.15.6:0/1615323269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5af806e160 msgr2=0x7f5af8143350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5af659c640 1 --2- 172.21.15.6:0/1615323269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5af806e160 0x7f5af8143350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5af659c640 1 -- 172.21.15.6:0/1615323269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5af80ae1f0 msgr2=0x7f5af8144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5af659c640 1 --2- 172.21.15.6:0/1615323269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5af80ae1f0 0x7f5af8144050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5af659c640 1 -- 172.21.15.6:0/1615323269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae8009420 con 0x7f5af806c260 2023-07-21T22:57:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5af659c640 1 --2- 172.21.15.6:0/1615323269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af806c260 0x7f5af815f2b0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8019040 tx=0x7f5ae80191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5aeeffd640 1 -- 172.21.15.6:0/1615323269 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8003bb0 con 0x7f5af806c260 2023-07-21T22:57:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5aeeffd640 1 -- 172.21.15.6:0/1615323269 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae8003d10 con 0x7f5af806c260 2023-07-21T22:57:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5aeeffd640 1 -- 172.21.15.6:0/1615323269 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80ab640 con 0x7f5af806c260 2023-07-21T22:57:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5afcf11640 1 -- 172.21.15.6:0/1615323269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af8069920 con 0x7f5af806c260 2023-07-21T22:57:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5afcf11640 1 -- 172.21.15.6:0/1615323269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af815f7f0 con 0x7f5af806c260 2023-07-21T22:57:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5afcf11640 1 -- 172.21.15.6:0/1615323269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af80678d0 con 0x7f5af806c260 2023-07-21T22:57:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.428+0000 7f5aeeffd640 1 -- 172.21.15.6:0/1615323269 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5ae80b2050 con 0x7f5af806c260 2023-07-21T22:57:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.432+0000 7f5aeeffd640 1 --2- 172.21.15.6:0/1615323269 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f5ad80663a0 0x7f5ad8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.432+0000 7f5aeeffd640 1 -- 172.21.15.6:0/1615323269 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f5ae811dff0 con 0x7f5af806c260 2023-07-21T22:57:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.432+0000 7f5aeffff640 1 --2- 172.21.15.6:0/1615323269 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f5ad80663a0 0x7f5ad8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.432+0000 7f5aeffff640 1 --2- 172.21.15.6:0/1615323269 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f5ad80663a0 0x7f5ad8068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5af813c7c0 tx=0x7f5ae0008040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:19.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.436+0000 7f5aeeffd640 1 -- 172.21.15.6:0/1615323269 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5ae80eb510 con 0x7f5af806c260 2023-07-21T22:57:19.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.592+0000 7f5afcf11640 1 -- 172.21.15.6:0/1615323269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5af8066810 con 0x7f5af806c260 2023-07-21T22:57:19.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.592+0000 7f5aeeffd640 1 -- 172.21.15.6:0/1615323269 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+14692 (secure 0 0 0) 0x7f5ae80eeb30 con 0x7f5af806c260 2023-07-21T22:57:19.628 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:19.628 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":188,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:57:18.829716+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":172,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:57:19.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.596+0000 7f5afcf11640 1 -- 172.21.15.6:0/1615323269 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f5ad80663a0 msgr2=0x7f5ad8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:19.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.596+0000 7f5afcf11640 1 --2- 172.21.15.6:0/1615323269 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f5ad80663a0 0x7f5ad8068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5af813c7c0 tx=0x7f5ae0008040 comp rx=0 tx=0).stop 2023-07-21T22:57:19.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.596+0000 7f5afcf11640 1 -- 172.21.15.6:0/1615323269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af806c260 msgr2=0x7f5af815f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:19.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.596+0000 7f5afcf11640 1 --2- 172.21.15.6:0/1615323269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af806c260 0x7f5af815f2b0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8019040 tx=0x7f5ae80191d0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.596+0000 7f5afcf11640 1 -- 172.21.15.6:0/1615323269 shutdown_connections 2023-07-21T22:57:19.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.596+0000 7f5afcf11640 1 --2- 172.21.15.6:0/1615323269 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f5ad80663a0 0x7f5ad8068850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.596+0000 7f5afcf11640 1 --2- 172.21.15.6:0/1615323269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5af80ae1f0 0x7f5af8144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.596+0000 7f5afcf11640 1 --2- 172.21.15.6:0/1615323269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5af806e160 0x7f5af8143350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.596+0000 7f5afcf11640 1 --2- 172.21.15.6:0/1615323269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5af806c260 0x7f5af815f2b0 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.596+0000 7f5afcf11640 1 -- 172.21.15.6:0/1615323269 >> 172.21.15.6:0/1615323269 conn(0x7f5af80b1300 msgr2=0x7f5af80ab890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:19.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.596+0000 7f5afcf11640 1 -- 172.21.15.6:0/1615323269 shutdown_connections 2023-07-21T22:57:19.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.596+0000 7f5afcf11640 1 -- 172.21.15.6:0/1615323269 wait complete. 2023-07-21T22:57:19.650 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:57:19.650 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:57:19.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.760+0000 7f954f111640 1 Processor -- start 2023-07-21T22:57:19.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.760+0000 7f954f111640 1 -- start start 2023-07-21T22:57:19.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f954f111640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f95481453a0 0x7f95480b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f954f111640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f954806c040 con 0x7f954806a440 2023-07-21T22:57:19.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f954f111640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9548160600 con 0x7f954815f690 2023-07-21T22:57:19.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f954f111640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9548160170 con 0x7f95481453a0 2023-07-21T22:57:19.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f9547fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f954806a440 0x7f954806c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53496/0 (socket says 172.21.15.6:53496) 2023-07-21T22:57:19.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f9547fff640 1 -- 172.21.15.6:0/410088420 learned_addr learned my addr 172.21.15.6:0/410088420 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:19.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f954d6ae640 1 --2- 172.21.15.6:0/410088420 >> v2:172.21.15.161:3300/0 conn(0x7f95481453a0 0x7f95480b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f95477fe640 1 -- 172.21.15.6:0/410088420 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130288092 0 0) 0x7f954806c040 con 0x7f954806a440 2023-07-21T22:57:19.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f95477fe640 1 -- 172.21.15.6:0/410088420 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9538003530 con 0x7f954806a440 2023-07-21T22:57:19.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f95477fe640 1 -- 172.21.15.6:0/410088420 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3910261633 0 0) 0x7f9538003530 con 0x7f954806a440 2023-07-21T22:57:19.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f95477fe640 1 -- 172.21.15.6:0/410088420 >> v2:172.21.15.161:3300/0 conn(0x7f95481453a0 msgr2=0x7f95480b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f95477fe640 1 --2- 172.21.15.6:0/410088420 >> v2:172.21.15.161:3300/0 conn(0x7f95481453a0 0x7f95480b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f95477fe640 1 -- 172.21.15.6:0/410088420 >> v1:172.21.15.161:6789/0 conn(0x7f954815f690 legacy=0x7f954815fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f95477fe640 1 -- 172.21.15.6:0/410088420 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9548160360 con 0x7f954806a440 2023-07-21T22:57:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f95477fe640 1 -- 172.21.15.6:0/410088420 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f9534001680 con 0x7f954806a440 2023-07-21T22:57:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f95477fe640 1 -- 172.21.15.6:0/410088420 >> v1:172.21.15.6:6789/0 conn(0x7f954806a440 legacy=0x7f954806c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f95477fe640 1 --2- 172.21.15.6:0/410088420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9538003980 0x7f9538003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f95477fe640 1 --2- 172.21.15.6:0/410088420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95380047d0 0x7f9538004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f95477fe640 1 --2- 172.21.15.6:0/410088420 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9538005180 0x7f953800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f95477fe640 1 -- 172.21.15.6:0/410088420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953800c060 con 0x7f9538003980 2023-07-21T22:57:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f95477fe640 1 -- 172.21.15.6:0/410088420 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953800c1d0 con 0x7f95380047d0 2023-07-21T22:57:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f95477fe640 1 -- 172.21.15.6:0/410088420 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953800c390 con 0x7f9538005180 2023-07-21T22:57:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f954cead640 1 --2- 172.21.15.6:0/410088420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9538003980 0x7f9538003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f9547fff640 1 --2- 172.21.15.6:0/410088420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95380047d0 0x7f9538004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f954d6ae640 1 --2- 172.21.15.6:0/410088420 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9538005180 0x7f953800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f954cead640 1 -- 172.21.15.6:0/410088420 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9538005180 msgr2=0x7f953800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:19.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f954cead640 1 --2- 172.21.15.6:0/410088420 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9538005180 0x7f953800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f954cead640 1 -- 172.21.15.6:0/410088420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95380047d0 msgr2=0x7f9538004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:19.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f954cead640 1 --2- 172.21.15.6:0/410088420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95380047d0 0x7f9538004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f954cead640 1 -- 172.21.15.6:0/410088420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9538003530 con 0x7f9538003980 2023-07-21T22:57:19.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.764+0000 7f954d6ae640 1 -- 172.21.15.6:0/410088420 reap_dead start 2023-07-21T22:57:19.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.768+0000 7f954cead640 1 --2- 172.21.15.6:0/410088420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9538003980 0x7f9538003d90 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f953c001780 tx=0x7f953c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328467e9db737ec2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:19.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.768+0000 7f95477fe640 1 -- 172.21.15.6:0/410088420 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c0052d0 con 0x7f9538003980 2023-07-21T22:57:19.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.768+0000 7f95477fe640 1 -- 172.21.15.6:0/410088420 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953c0a7050 con 0x7f9538003980 2023-07-21T22:57:19.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.768+0000 7f95477fe640 1 -- 172.21.15.6:0/410088420 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c003600 con 0x7f9538003980 2023-07-21T22:57:19.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.768+0000 7f954f111640 1 -- 172.21.15.6:0/410088420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9538003980 msgr2=0x7f9538003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:19.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.768+0000 7f954f111640 1 --2- 172.21.15.6:0/410088420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9538003980 0x7f9538003d90 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f953c001780 tx=0x7f953c01c390 comp rx=0 tx=0).stop 2023-07-21T22:57:19.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.768+0000 7f954f111640 1 -- 172.21.15.6:0/410088420 shutdown_connections 2023-07-21T22:57:19.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.768+0000 7f954f111640 1 --2- 172.21.15.6:0/410088420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9538003980 0x7f9538003d90 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.768+0000 7f954f111640 1 -- 172.21.15.6:0/410088420 >> 172.21.15.6:0/410088420 conn(0x7f95480b1210 msgr2=0x7f95480ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:19.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.768+0000 7f954f111640 1 -- 172.21.15.6:0/410088420 shutdown_connections 2023-07-21T22:57:19.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.768+0000 7f954f111640 1 -- 172.21.15.6:0/410088420 wait complete. 2023-07-21T22:57:19.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f954f111640 1 Processor -- start 2023-07-21T22:57:19.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f954f111640 1 -- start start 2023-07-21T22:57:19.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f954f111640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9538003980 0x7f95480b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f954f111640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9548158da0 0x7f9548159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f954f111640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95481f7c00 0x7f95481f8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f954f111640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954813e9e0 con 0x7f9548158da0 2023-07-21T22:57:19.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f954f111640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95481f8930 con 0x7f9538003980 2023-07-21T22:57:19.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f954f111640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954813e320 con 0x7f95481f7c00 2023-07-21T22:57:19.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f9547fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9548158da0 0x7f9548159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f9547fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9548158da0 0x7f9548159210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37254/0 (socket says 172.21.15.6:37254) 2023-07-21T22:57:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f9547fff640 1 -- 172.21.15.6:0/405702991 learned_addr learned my addr 172.21.15.6:0/405702991 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f954cead640 1 --2- 172.21.15.6:0/405702991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9538003980 0x7f95480b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f954d6ae640 1 --2- 172.21.15.6:0/405702991 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95481f7c00 0x7f95481f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f9547fff640 1 -- 172.21.15.6:0/405702991 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95481f7c00 msgr2=0x7f95481f8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f9547fff640 1 --2- 172.21.15.6:0/405702991 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95481f7c00 0x7f95481f8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f9547fff640 1 -- 172.21.15.6:0/405702991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9538003980 msgr2=0x7f95480b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f9547fff640 1 --2- 172.21.15.6:0/405702991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9538003980 0x7f95480b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f9547fff640 1 -- 172.21.15.6:0/405702991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954813e600 con 0x7f9548158da0 2023-07-21T22:57:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f954cead640 1 --2- 172.21.15.6:0/405702991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9538003980 0x7f95480b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f9547fff640 1 --2- 172.21.15.6:0/405702991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9548158da0 0x7f9548159210 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f953400e730 tx=0x7f953400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f95457fa640 1 -- 172.21.15.6:0/405702991 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953400ee40 con 0x7f9548158da0 2023-07-21T22:57:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f95457fa640 1 -- 172.21.15.6:0/405702991 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953400c8d0 con 0x7f9548158da0 2023-07-21T22:57:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f95457fa640 1 -- 172.21.15.6:0/405702991 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953400cc80 con 0x7f9548158da0 2023-07-21T22:57:19.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f954f111640 1 -- 172.21.15.6:0/405702991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9548159750 con 0x7f9548158da0 2023-07-21T22:57:19.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f954f111640 1 -- 172.21.15.6:0/405702991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95480b4440 con 0x7f9548158da0 2023-07-21T22:57:19.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.772+0000 7f954f111640 1 -- 172.21.15.6:0/405702991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95480678d0 con 0x7f9548158da0 2023-07-21T22:57:19.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.776+0000 7f95457fa640 1 -- 172.21.15.6:0/405702991 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f953401d460 con 0x7f9548158da0 2023-07-21T22:57:19.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.776+0000 7f95457fa640 1 --2- 172.21.15.6:0/405702991 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f952c0663a0 0x7f952c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:19.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.776+0000 7f95457fa640 1 -- 172.21.15.6:0/405702991 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f9534083b50 con 0x7f9548158da0 2023-07-21T22:57:19.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.776+0000 7f954cead640 1 --2- 172.21.15.6:0/405702991 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f952c0663a0 0x7f952c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:19.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.776+0000 7f954cead640 1 --2- 172.21.15.6:0/405702991 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f952c0663a0 0x7f952c068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f953c001750 tx=0x7f953c0011a0 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:19.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.780+0000 7f95457fa640 1 -- 172.21.15.6:0/405702991 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9534051120 con 0x7f9548158da0 2023-07-21T22:57:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.936+0000 7f954f111640 1 -- 172.21.15.6:0/405702991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95480cf300 con 0x7f9548158da0 2023-07-21T22:57:19.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.936+0000 7f95457fa640 1 -- 172.21.15.6:0/405702991 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v188) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9534054740 con 0x7f9548158da0 2023-07-21T22:57:19.974 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:57:19.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.940+0000 7f954f111640 1 -- 172.21.15.6:0/405702991 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f952c0663a0 msgr2=0x7f952c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:19.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.940+0000 7f954f111640 1 --2- 172.21.15.6:0/405702991 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f952c0663a0 0x7f952c068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f953c001750 tx=0x7f953c0011a0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.940+0000 7f954f111640 1 -- 172.21.15.6:0/405702991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9548158da0 msgr2=0x7f9548159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:19.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.940+0000 7f954f111640 1 --2- 172.21.15.6:0/405702991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9548158da0 0x7f9548159210 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f953400e730 tx=0x7f953400ebf0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.940+0000 7f954f111640 1 -- 172.21.15.6:0/405702991 shutdown_connections 2023-07-21T22:57:19.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.940+0000 7f954f111640 1 --2- 172.21.15.6:0/405702991 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f952c0663a0 0x7f952c068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.940+0000 7f954f111640 1 --2- 172.21.15.6:0/405702991 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f95481f7c00 0x7f95481f8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.940+0000 7f954f111640 1 --2- 172.21.15.6:0/405702991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9548158da0 0x7f9548159210 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.940+0000 7f954f111640 1 --2- 172.21.15.6:0/405702991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9538003980 0x7f95480b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.940+0000 7f954f111640 1 -- 172.21.15.6:0/405702991 >> 172.21.15.6:0/405702991 conn(0x7f95480b1210 msgr2=0x7f954806fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.940+0000 7f954f111640 1 -- 172.21.15.6:0/405702991 shutdown_connections 2023-07-21T22:57:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:19.940+0000 7f954f111640 1 -- 172.21.15.6:0/405702991 wait complete. 2023-07-21T22:57:19.995 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:57:20.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.108+0000 7fe030e7b640 1 Processor -- start 2023-07-21T22:57:20.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.108+0000 7fe030e7b640 1 -- start start 2023-07-21T22:57:20.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.108+0000 7fe030e7b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe02c15f690 0x7fe02c0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:20.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.108+0000 7fe030e7b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe02c06a440 0x7fe02c06c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:20.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.108+0000 7fe030e7b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe02c06c040 con 0x7fe02c1453a0 2023-07-21T22:57:20.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.108+0000 7fe030e7b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe02c160170 con 0x7fe02c15f690 2023-07-21T22:57:20.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.108+0000 7fe030e7b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe02c160600 con 0x7fe02c06a440 2023-07-21T22:57:20.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.108+0000 7fe02a59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe02c15f690 0x7fe02c0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:20.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.108+0000 7fe02a59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe02c15f690 0x7fe02c0b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37262/0 (socket says 172.21.15.6:37262) 2023-07-21T22:57:20.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.108+0000 7fe02a59c640 1 -- 172.21.15.6:0/805881837 learned_addr learned my addr 172.21.15.6:0/805881837 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:20.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.108+0000 7fe02a59c640 1 -- 172.21.15.6:0/805881837 >> v2:172.21.15.161:3300/0 conn(0x7fe02c06a440 msgr2=0x7fe02c06c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:20.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.108+0000 7fe02a59c640 1 --2- 172.21.15.6:0/805881837 >> v2:172.21.15.161:3300/0 conn(0x7fe02c06a440 0x7fe02c06c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.108+0000 7fe02a59c640 1 -- 172.21.15.6:0/805881837 >> v1:172.21.15.161:6789/0 conn(0x7fe02c1453a0 legacy=0x7fe02c15fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:20.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.108+0000 7fe02a59c640 1 -- 172.21.15.6:0/805881837 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c160360 con 0x7fe02c15f690 2023-07-21T22:57:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.112+0000 7fe02a59c640 1 --2- 172.21.15.6:0/805881837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe02c15f690 0x7fe02c0b1890 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fe02c06f580 tx=0x7fe01c01c190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3351207359475ce server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.112+0000 7fe029d9b640 1 -- 172.21.15.6:0/805881837 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c0ab600 con 0x7fe02c15f690 2023-07-21T22:57:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.112+0000 7fe029d9b640 1 -- 172.21.15.6:0/805881837 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01c0a7050 con 0x7fe02c15f690 2023-07-21T22:57:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.112+0000 7fe029d9b640 1 -- 172.21.15.6:0/805881837 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c0ab980 con 0x7fe02c15f690 2023-07-21T22:57:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.112+0000 7fe030e7b640 1 -- 172.21.15.6:0/805881837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe02c15f690 msgr2=0x7fe02c0b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.112+0000 7fe030e7b640 1 --2- 172.21.15.6:0/805881837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe02c15f690 0x7fe02c0b1890 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fe02c06f580 tx=0x7fe01c01c190 comp rx=0 tx=0).stop 2023-07-21T22:57:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.112+0000 7fe030e7b640 1 -- 172.21.15.6:0/805881837 shutdown_connections 2023-07-21T22:57:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.112+0000 7fe030e7b640 1 --2- 172.21.15.6:0/805881837 >> v2:172.21.15.161:3300/0 conn(0x7fe02c06a440 0x7fe02c06c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.112+0000 7fe030e7b640 1 --2- 172.21.15.6:0/805881837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe02c15f690 0x7fe02c0b1890 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.112+0000 7fe030e7b640 1 -- 172.21.15.6:0/805881837 >> 172.21.15.6:0/805881837 conn(0x7fe02c0b1210 msgr2=0x7fe02c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.112+0000 7fe030e7b640 1 -- 172.21.15.6:0/805881837 shutdown_connections 2023-07-21T22:57:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.112+0000 7fe030e7b640 1 -- 172.21.15.6:0/805881837 wait complete. 2023-07-21T22:57:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe030e7b640 1 Processor -- start 2023-07-21T22:57:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe030e7b640 1 -- start start 2023-07-21T22:57:20.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe030e7b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe02c06a440 0x7fe02c15b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:20.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe030e7b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe02c1453a0 0x7fe02c13fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:20.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe030e7b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe02c15f690 0x7fe02c1607a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe030e7b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c13f940 con 0x7fe02c06a440 2023-07-21T22:57:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe030e7b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c15b7d0 con 0x7fe02c1453a0 2023-07-21T22:57:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe030e7b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c13ece0 con 0x7fe02c15f690 2023-07-21T22:57:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe02a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe02c06a440 0x7fe02c15b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe02a59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe02c06a440 0x7fe02c15b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37264/0 (socket says 172.21.15.6:37264) 2023-07-21T22:57:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe02a59c640 1 -- 172.21.15.6:0/2881718889 learned_addr learned my addr 172.21.15.6:0/2881718889 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:20.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe02ad9d640 1 --2- 172.21.15.6:0/2881718889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe02c15f690 0x7fe02c1607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:20.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe023fff640 1 --2- 172.21.15.6:0/2881718889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe02c1453a0 0x7fe02c13fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:20.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe02a59c640 1 -- 172.21.15.6:0/2881718889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe02c15f690 msgr2=0x7fe02c1607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:20.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe02a59c640 1 --2- 172.21.15.6:0/2881718889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe02c15f690 0x7fe02c1607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe02a59c640 1 -- 172.21.15.6:0/2881718889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe02c1453a0 msgr2=0x7fe02c13fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:20.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe02a59c640 1 --2- 172.21.15.6:0/2881718889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe02c1453a0 0x7fe02c13fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe02a59c640 1 -- 172.21.15.6:0/2881718889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01c0094d0 con 0x7fe02c06a440 2023-07-21T22:57:20.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe02ad9d640 1 --2- 172.21.15.6:0/2881718889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe02c15f690 0x7fe02c1607a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:20.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe023fff640 1 --2- 172.21.15.6:0/2881718889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe02c1453a0 0x7fe02c13fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:20.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe02a59c640 1 --2- 172.21.15.6:0/2881718889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe02c06a440 0x7fe02c15b290 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0ae040 tx=0x7fe01c01a9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:20.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe022ffd640 1 -- 172.21.15.6:0/2881718889 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c0b6620 con 0x7fe02c06a440 2023-07-21T22:57:20.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe022ffd640 1 -- 172.21.15.6:0/2881718889 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01c0b67a0 con 0x7fe02c06a440 2023-07-21T22:57:20.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe022ffd640 1 -- 172.21.15.6:0/2881718889 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c0b6b50 con 0x7fe02c06a440 2023-07-21T22:57:20.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe030e7b640 1 -- 172.21.15.6:0/2881718889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe02c13efa0 con 0x7fe02c06a440 2023-07-21T22:57:20.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe030e7b640 1 -- 172.21.15.6:0/2881718889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe02c13f560 con 0x7fe02c06a440 2023-07-21T22:57:20.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.116+0000 7fe030e7b640 1 -- 172.21.15.6:0/2881718889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02c13fbb0 con 0x7fe02c06a440 2023-07-21T22:57:20.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.120+0000 7fe022ffd640 1 -- 172.21.15.6:0/2881718889 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe01c0b2040 con 0x7fe02c06a440 2023-07-21T22:57:20.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.120+0000 7fe022ffd640 1 --2- 172.21.15.6:0/2881718889 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fe00c0663a0 0x7fe00c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:20.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.120+0000 7fe022ffd640 1 -- 172.21.15.6:0/2881718889 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5282+0+0 (secure 0 0 0) 0x7fe01c11e250 con 0x7fe02c06a440 2023-07-21T22:57:20.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.120+0000 7fe023fff640 1 --2- 172.21.15.6:0/2881718889 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fe00c0663a0 0x7fe00c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:20.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.120+0000 7fe023fff640 1 --2- 172.21.15.6:0/2881718889 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fe00c0663a0 0x7fe00c068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0b41d0 tx=0x7fe014008040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:20.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.124+0000 7fe022ffd640 1 -- 172.21.15.6:0/2881718889 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe01c0eb7a0 con 0x7fe02c06a440 2023-07-21T22:57:20.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.276+0000 7fe030e7b640 1 -- 172.21.15.6:0/2881718889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe02c0678d0 con 0x7fe02c06a440 2023-07-21T22:57:20.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.280+0000 7fe022ffd640 1 -- 172.21.15.6:0/2881718889 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v188) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe01c0eedc0 con 0x7fe02c06a440 2023-07-21T22:57:20.314 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:57:20.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.280+0000 7fe030e7b640 1 -- 172.21.15.6:0/2881718889 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fe00c0663a0 msgr2=0x7fe00c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:20.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.280+0000 7fe030e7b640 1 --2- 172.21.15.6:0/2881718889 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fe00c0663a0 0x7fe00c068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0b41d0 tx=0x7fe014008040 comp rx=0 tx=0).stop 2023-07-21T22:57:20.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.280+0000 7fe030e7b640 1 -- 172.21.15.6:0/2881718889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe02c06a440 msgr2=0x7fe02c15b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:20.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.280+0000 7fe030e7b640 1 --2- 172.21.15.6:0/2881718889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe02c06a440 0x7fe02c15b290 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0ae040 tx=0x7fe01c01a9d0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.280+0000 7fe030e7b640 1 -- 172.21.15.6:0/2881718889 shutdown_connections 2023-07-21T22:57:20.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.280+0000 7fe030e7b640 1 --2- 172.21.15.6:0/2881718889 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fe00c0663a0 0x7fe00c068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.280+0000 7fe030e7b640 1 --2- 172.21.15.6:0/2881718889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe02c15f690 0x7fe02c1607a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.280+0000 7fe030e7b640 1 --2- 172.21.15.6:0/2881718889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe02c1453a0 0x7fe02c13fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.280+0000 7fe030e7b640 1 --2- 172.21.15.6:0/2881718889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe02c06a440 0x7fe02c15b290 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.280+0000 7fe030e7b640 1 -- 172.21.15.6:0/2881718889 >> 172.21.15.6:0/2881718889 conn(0x7fe02c0b1210 msgr2=0x7fe02c0b29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:20.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.280+0000 7fe030e7b640 1 -- 172.21.15.6:0/2881718889 shutdown_connections 2023-07-21T22:57:20.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.280+0000 7fe030e7b640 1 -- 172.21.15.6:0/2881718889 wait complete. 2023-07-21T22:57:20.335 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T22:57:20.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.444+0000 7f5b4c7ac640 1 Processor -- start 2023-07-21T22:57:20.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.444+0000 7f5b4c7ac640 1 -- start start 2023-07-21T22:57:20.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.444+0000 7f5b4c7ac640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5b44158ce0 0x7f5b44070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:20.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.444+0000 7f5b4c7ac640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b440c9730 0x7f5b440ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:20.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.444+0000 7f5b4c7ac640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b440cc700 con 0x7f5b440c8ad0 2023-07-21T22:57:20.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.444+0000 7f5b4c7ac640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b440b0ff0 con 0x7f5b440c9730 2023-07-21T22:57:20.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.444+0000 7f5b4c7ac640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b44070c80 con 0x7f5b44158ce0 2023-07-21T22:57:20.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.444+0000 7f5b4ad49640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b440c9730 0x7f5b440ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:20.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.444+0000 7f5b4ad49640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b440c9730 0x7f5b440ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37270/0 (socket says 172.21.15.6:37270) 2023-07-21T22:57:20.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.444+0000 7f5b4ad49640 1 -- 172.21.15.6:0/1190476877 learned_addr learned my addr 172.21.15.6:0/1190476877 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:20.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.444+0000 7f5b4a548640 1 --2- 172.21.15.6:0/1190476877 >> v2:172.21.15.161:3300/0 conn(0x7f5b44158ce0 0x7f5b44070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:20.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.448+0000 7f5b4ad49640 1 -- 172.21.15.6:0/1190476877 >> v2:172.21.15.161:3300/0 conn(0x7f5b44158ce0 msgr2=0x7f5b44070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:20.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.448+0000 7f5b4ad49640 1 --2- 172.21.15.6:0/1190476877 >> v2:172.21.15.161:3300/0 conn(0x7f5b44158ce0 0x7f5b44070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.448+0000 7f5b4ad49640 1 -- 172.21.15.6:0/1190476877 >> v1:172.21.15.161:6789/0 conn(0x7f5b440c8ad0 legacy=0x7f5b440c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:20.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.448+0000 7f5b4ad49640 1 -- 172.21.15.6:0/1190476877 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b440cbdd0 con 0x7f5b440c9730 2023-07-21T22:57:20.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.448+0000 7f5b4ad49640 1 --2- 172.21.15.6:0/1190476877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b440c9730 0x7f5b440ccb90 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f5b44071be0 tx=0x7f5b3c01ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd9b428e820654e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:20.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.448+0000 7f5b49546640 1 -- 172.21.15.6:0/1190476877 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c00b2d0 con 0x7f5b440c9730 2023-07-21T22:57:20.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.448+0000 7f5b49546640 1 -- 172.21.15.6:0/1190476877 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c00b430 con 0x7f5b440c9730 2023-07-21T22:57:20.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.448+0000 7f5b49546640 1 -- 172.21.15.6:0/1190476877 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c0a7a80 con 0x7f5b440c9730 2023-07-21T22:57:20.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.448+0000 7f5b4c7ac640 1 -- 172.21.15.6:0/1190476877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b440c9730 msgr2=0x7f5b440ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:20.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.448+0000 7f5b4c7ac640 1 --2- 172.21.15.6:0/1190476877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b440c9730 0x7f5b440ccb90 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f5b44071be0 tx=0x7f5b3c01ea80 comp rx=0 tx=0).stop 2023-07-21T22:57:20.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4c7ac640 1 -- 172.21.15.6:0/1190476877 shutdown_connections 2023-07-21T22:57:20.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4c7ac640 1 --2- 172.21.15.6:0/1190476877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b440c9730 0x7f5b440ccb90 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4c7ac640 1 --2- 172.21.15.6:0/1190476877 >> v2:172.21.15.161:3300/0 conn(0x7f5b44158ce0 0x7f5b44070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4c7ac640 1 -- 172.21.15.6:0/1190476877 >> 172.21.15.6:0/1190476877 conn(0x7f5b440afcf0 msgr2=0x7f5b440b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:20.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4c7ac640 1 -- 172.21.15.6:0/1190476877 shutdown_connections 2023-07-21T22:57:20.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4c7ac640 1 -- 172.21.15.6:0/1190476877 wait complete. 2023-07-21T22:57:20.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4c7ac640 1 Processor -- start 2023-07-21T22:57:20.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4c7ac640 1 -- start start 2023-07-21T22:57:20.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4c7ac640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b440c8ad0 0x7f5b44149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:20.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4c7ac640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b440c9730 0x7f5b441f7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:20.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4c7ac640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b44158ce0 0x7f5b44154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:20.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4c7ac640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b44149c90 con 0x7f5b440c8ad0 2023-07-21T22:57:20.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4c7ac640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b441497b0 con 0x7f5b44158ce0 2023-07-21T22:57:20.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4c7ac640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b44159230 con 0x7f5b440c9730 2023-07-21T22:57:20.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4a548640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b440c8ad0 0x7f5b44149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:20.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4a548640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b440c8ad0 0x7f5b44149270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37278/0 (socket says 172.21.15.6:37278) 2023-07-21T22:57:20.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4a548640 1 -- 172.21.15.6:0/4175794785 learned_addr learned my addr 172.21.15.6:0/4175794785 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:20.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4a548640 1 -- 172.21.15.6:0/4175794785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b440c9730 msgr2=0x7f5b441f7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:20.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4a548640 1 --2- 172.21.15.6:0/4175794785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b440c9730 0x7f5b441f7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4a548640 1 -- 172.21.15.6:0/4175794785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b44158ce0 msgr2=0x7f5b44154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:20.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4a548640 1 --2- 172.21.15.6:0/4175794785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b44158ce0 0x7f5b44154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4a548640 1 -- 172.21.15.6:0/4175794785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3c00bd40 con 0x7f5b440c8ad0 2023-07-21T22:57:20.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.452+0000 7f5b4a548640 1 --2- 172.21.15.6:0/4175794785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b440c8ad0 0x7f5b44149270 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f5b4000d5f0 tx=0x7f5b4000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:20.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.456+0000 7f5b3affd640 1 -- 172.21.15.6:0/4175794785 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b400125f0 con 0x7f5b440c8ad0 2023-07-21T22:57:20.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.456+0000 7f5b3affd640 1 -- 172.21.15.6:0/4175794785 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b40012750 con 0x7f5b440c8ad0 2023-07-21T22:57:20.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.456+0000 7f5b3affd640 1 -- 172.21.15.6:0/4175794785 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b40012ae0 con 0x7f5b440c8ad0 2023-07-21T22:57:20.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.456+0000 7f5b4c7ac640 1 -- 172.21.15.6:0/4175794785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b441f8230 con 0x7f5b440c8ad0 2023-07-21T22:57:20.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.456+0000 7f5b4c7ac640 1 -- 172.21.15.6:0/4175794785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b441f4500 con 0x7f5b440c8ad0 2023-07-21T22:57:20.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.456+0000 7f5b4c7ac640 1 -- 172.21.15.6:0/4175794785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b440ca1a0 con 0x7f5b440c8ad0 2023-07-21T22:57:20.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.456+0000 7f5b3affd640 1 -- 172.21.15.6:0/4175794785 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5b40012c40 con 0x7f5b440c8ad0 2023-07-21T22:57:20.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.456+0000 7f5b3affd640 1 --2- 172.21.15.6:0/4175794785 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f5b280663a0 0x7f5b28068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:20.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.456+0000 7f5b3affd640 1 -- 172.21.15.6:0/4175794785 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5282+0+0 (secure 0 0 0) 0x7f5b400840c0 con 0x7f5b440c8ad0 2023-07-21T22:57:20.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.460+0000 7f5b49d47640 1 --2- 172.21.15.6:0/4175794785 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f5b280663a0 0x7f5b28068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:20.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.460+0000 7f5b49d47640 1 --2- 172.21.15.6:0/4175794785 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f5b280663a0 0x7f5b28068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5b34000f70 tx=0x7f5b340079c0 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:20.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.460+0000 7f5b3affd640 1 -- 172.21.15.6:0/4175794785 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5b40051720 con 0x7f5b440c8ad0 2023-07-21T22:57:20.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.620+0000 7f5b4c7ac640 1 -- 172.21.15.6:0/4175794785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5b440678d0 con 0x7f5b440c8ad0 2023-07-21T22:57:20.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.620+0000 7f5b3affd640 1 -- 172.21.15.6:0/4175794785 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v188) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5b40054d40 con 0x7f5b440c8ad0 2023-07-21T22:57:20.657 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:20.657 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:57:20.657 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:20.657 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-07-21T22:57:20.657 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-07-21T22:57:20.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-21T22:57:20.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:20.658 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-07-21T22:57:20.658 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-07-21T22:57:20.658 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:20.658 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:57:20.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.624+0000 7f5b4c7ac640 1 -- 172.21.15.6:0/4175794785 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f5b280663a0 msgr2=0x7f5b28068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:20.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.624+0000 7f5b4c7ac640 1 --2- 172.21.15.6:0/4175794785 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f5b280663a0 0x7f5b28068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5b34000f70 tx=0x7f5b340079c0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.624+0000 7f5b4c7ac640 1 -- 172.21.15.6:0/4175794785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b440c8ad0 msgr2=0x7f5b44149270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:20.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.624+0000 7f5b4c7ac640 1 --2- 172.21.15.6:0/4175794785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b440c8ad0 0x7f5b44149270 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f5b4000d5f0 tx=0x7f5b4000dab0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.624+0000 7f5b4c7ac640 1 -- 172.21.15.6:0/4175794785 shutdown_connections 2023-07-21T22:57:20.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.624+0000 7f5b4c7ac640 1 --2- 172.21.15.6:0/4175794785 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f5b280663a0 0x7f5b28068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.624+0000 7f5b4c7ac640 1 --2- 172.21.15.6:0/4175794785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b44158ce0 0x7f5b44154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.624+0000 7f5b4c7ac640 1 --2- 172.21.15.6:0/4175794785 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b440c9730 0x7f5b441f7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.624+0000 7f5b4c7ac640 1 --2- 172.21.15.6:0/4175794785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b440c8ad0 0x7f5b44149270 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.624+0000 7f5b4c7ac640 1 -- 172.21.15.6:0/4175794785 >> 172.21.15.6:0/4175794785 conn(0x7f5b440afcf0 msgr2=0x7f5b44157f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:20.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.624+0000 7f5b4c7ac640 1 -- 172.21.15.6:0/4175794785 shutdown_connections 2023-07-21T22:57:20.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.624+0000 7f5b4c7ac640 1 -- 172.21.15.6:0/4175794785 wait complete. 2023-07-21T22:57:20.677 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-21T22:57:20.678 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-21T22:57:20.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7faff58d8640 1 Processor -- start 2023-07-21T22:57:20.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7faff58d8640 1 -- start start 2023-07-21T22:57:20.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7faff58d8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faff00cf710 0x7faff00caea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:20.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7faff58d8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff00d0920 con 0x7faff006a540 2023-07-21T22:57:20.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7faff58d8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff015bfd0 con 0x7faff00cf2e0 2023-07-21T22:57:20.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7faff58d8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff00cfd10 con 0x7faff00cf710 2023-07-21T22:57:20.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafeeffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7faff006a540 0x7faff006a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53506/0 (socket says 172.21.15.6:53506) 2023-07-21T22:57:20.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafeeffd640 1 -- 172.21.15.6:0/65153964 learned_addr learned my addr 172.21.15.6:0/65153964 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:20.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafef7fe640 1 --2- 172.21.15.6:0/65153964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faff00cf710 0x7faff00caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:20.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafedffb640 1 -- 172.21.15.6:0/65153964 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2526808115 0 0) 0x7faff00d0920 con 0x7faff006a540 2023-07-21T22:57:20.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafedffb640 1 -- 172.21.15.6:0/65153964 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafd8003530 con 0x7faff006a540 2023-07-21T22:57:20.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafedffb640 1 -- 172.21.15.6:0/65153964 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2001374693 0 0) 0x7fafd8003530 con 0x7faff006a540 2023-07-21T22:57:20.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafedffb640 1 -- 172.21.15.6:0/65153964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faff00cf710 msgr2=0x7faff00caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:20.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafedffb640 1 --2- 172.21.15.6:0/65153964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faff00cf710 0x7faff00caea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafedffb640 1 -- 172.21.15.6:0/65153964 >> v1:172.21.15.161:6789/0 conn(0x7faff00cf2e0 legacy=0x7faff00ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:20.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafedffb640 1 -- 172.21.15.6:0/65153964 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff00cfff0 con 0x7faff006a540 2023-07-21T22:57:20.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafedffb640 1 -- 172.21.15.6:0/65153964 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fafe0001680 con 0x7faff006a540 2023-07-21T22:57:20.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafedffb640 1 -- 172.21.15.6:0/65153964 >> v1:172.21.15.6:6789/0 conn(0x7faff006a540 legacy=0x7faff006a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:20.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafedffb640 1 --2- 172.21.15.6:0/65153964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faff00cf710 0x7fafd80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:20.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafedffb640 1 --2- 172.21.15.6:0/65153964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd8003ef0 0x7fafd80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:20.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafedffb640 1 --2- 172.21.15.6:0/65153964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafd8004d10 0x7fafd8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:20.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafedffb640 1 -- 172.21.15.6:0/65153964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff00cfd10 con 0x7fafd8003ef0 2023-07-21T22:57:20.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafedffb640 1 -- 172.21.15.6:0/65153964 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd800b9c0 con 0x7fafd8004d10 2023-07-21T22:57:20.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafedffb640 1 -- 172.21.15.6:0/65153964 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd800bb80 con 0x7faff00cf710 2023-07-21T22:57:20.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafee7fc640 1 --2- 172.21.15.6:0/65153964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd8003ef0 0x7fafd80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:20.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafeeffd640 1 --2- 172.21.15.6:0/65153964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faff00cf710 0x7fafd80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:20.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafef7fe640 1 --2- 172.21.15.6:0/65153964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafd8004d10 0x7fafd8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:20.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafee7fc640 1 -- 172.21.15.6:0/65153964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faff00cf710 msgr2=0x7fafd80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:20.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafee7fc640 1 --2- 172.21.15.6:0/65153964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faff00cf710 0x7fafd80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafee7fc640 1 -- 172.21.15.6:0/65153964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafd8004d10 msgr2=0x7fafd8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:20.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafee7fc640 1 --2- 172.21.15.6:0/65153964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fafd8004d10 0x7fafd8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafee7fc640 1 -- 172.21.15.6:0/65153964 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd8003530 con 0x7fafd8003ef0 2023-07-21T22:57:20.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.792+0000 7fafeeffd640 1 --2- 172.21.15.6:0/65153964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faff00cf710 0x7fafd80039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.796+0000 7fafee7fc640 1 --2- 172.21.15.6:0/65153964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd8003ef0 0x7fafd80047d0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7faff00cdbd0 tx=0x7fafe401ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf607852ef9fb13 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.796+0000 7fafedffb640 1 -- 172.21.15.6:0/65153964 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe40a8830 con 0x7fafd8003ef0 2023-07-21T22:57:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.796+0000 7fafedffb640 1 -- 172.21.15.6:0/65153964 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe40a8990 con 0x7fafd8003ef0 2023-07-21T22:57:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.796+0000 7fafedffb640 1 -- 172.21.15.6:0/65153964 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe40a8d80 con 0x7fafd8003ef0 2023-07-21T22:57:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.796+0000 7faff58d8640 1 -- 172.21.15.6:0/65153964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd8003ef0 msgr2=0x7fafd80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.796+0000 7faff58d8640 1 --2- 172.21.15.6:0/65153964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd8003ef0 0x7fafd80047d0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7faff00cdbd0 tx=0x7fafe401ec10 comp rx=0 tx=0).stop 2023-07-21T22:57:20.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.796+0000 7fafef7fe640 1 -- 172.21.15.6:0/65153964 reap_dead start 2023-07-21T22:57:20.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.796+0000 7faff58d8640 1 -- 172.21.15.6:0/65153964 shutdown_connections 2023-07-21T22:57:20.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.796+0000 7faff58d8640 1 -- 172.21.15.6:0/65153964 >> 172.21.15.6:0/65153964 conn(0x7faff0099490 msgr2=0x7faff0089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:20.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.796+0000 7faff58d8640 1 -- 172.21.15.6:0/65153964 shutdown_connections 2023-07-21T22:57:20.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.796+0000 7faff58d8640 1 -- 172.21.15.6:0/65153964 wait complete. 2023-07-21T22:57:20.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7faff58d8640 1 Processor -- start 2023-07-21T22:57:20.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7faff58d8640 1 -- start start 2023-07-21T22:57:20.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7faff58d8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd8003ef0 0x7faff0151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:20.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7faff58d8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faff006e690 0x7faff006eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:20.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7faff58d8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faff015dac0 0x7faff015df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:20.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7faff58d8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff00c4580 con 0x7fafd8003ef0 2023-07-21T22:57:20.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7faff58d8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff006f040 con 0x7faff015dac0 2023-07-21T22:57:20.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7faff58d8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff01f4e20 con 0x7faff006e690 2023-07-21T22:57:20.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7fafeeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd8003ef0 0x7faff0151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:20.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7fafeeffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd8003ef0 0x7faff0151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37310/0 (socket says 172.21.15.6:37310) 2023-07-21T22:57:20.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7fafeeffd640 1 -- 172.21.15.6:0/343716999 learned_addr learned my addr 172.21.15.6:0/343716999 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:20.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7fafef7fe640 1 --2- 172.21.15.6:0/343716999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faff015dac0 0x7faff015df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:20.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7fafee7fc640 1 --2- 172.21.15.6:0/343716999 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faff006e690 0x7faff006eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:20.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7fafeeffd640 1 -- 172.21.15.6:0/343716999 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faff006e690 msgr2=0x7faff006eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:20.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7fafeeffd640 1 --2- 172.21.15.6:0/343716999 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faff006e690 0x7faff006eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7fafeeffd640 1 -- 172.21.15.6:0/343716999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faff015dac0 msgr2=0x7faff015df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:20.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7fafeeffd640 1 --2- 172.21.15.6:0/343716999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faff015dac0 0x7faff015df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7fafeeffd640 1 -- 172.21.15.6:0/343716999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff01f4560 con 0x7fafd8003ef0 2023-07-21T22:57:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7fafef7fe640 1 --2- 172.21.15.6:0/343716999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faff015dac0 0x7faff015df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7fafee7fc640 1 --2- 172.21.15.6:0/343716999 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faff006e690 0x7faff006eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7fafeeffd640 1 --2- 172.21.15.6:0/343716999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd8003ef0 0x7faff0151420 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fafe00072f0 tx=0x7fafe00077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7fafd7fff640 1 -- 172.21.15.6:0/343716999 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe000f9e0 con 0x7fafd8003ef0 2023-07-21T22:57:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7fafd7fff640 1 -- 172.21.15.6:0/343716999 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe000fb40 con 0x7fafd8003ef0 2023-07-21T22:57:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7fafd7fff640 1 -- 172.21.15.6:0/343716999 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0012350 con 0x7fafd8003ef0 2023-07-21T22:57:20.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7faff58d8640 1 -- 172.21.15.6:0/343716999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff015e470 con 0x7fafd8003ef0 2023-07-21T22:57:20.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.800+0000 7faff58d8640 1 -- 172.21.15.6:0/343716999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff01f4ab0 con 0x7fafd8003ef0 2023-07-21T22:57:20.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.804+0000 7faff58d8640 1 -- 172.21.15.6:0/343716999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff00678d0 con 0x7fafd8003ef0 2023-07-21T22:57:20.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.804+0000 7fafd7fff640 1 -- 172.21.15.6:0/343716999 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fafe00124b0 con 0x7fafd8003ef0 2023-07-21T22:57:20.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.804+0000 7fafd7fff640 1 --2- 172.21.15.6:0/343716999 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fafdc0663a0 0x7fafdc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:20.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.804+0000 7fafd7fff640 1 -- 172.21.15.6:0/343716999 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5282+0+0 (secure 0 0 0) 0x7fafe0083720 con 0x7fafd8003ef0 2023-07-21T22:57:20.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.804+0000 7fafee7fc640 1 --2- 172.21.15.6:0/343716999 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fafdc0663a0 0x7fafdc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:20.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.804+0000 7fafee7fc640 1 --2- 172.21.15.6:0/343716999 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fafdc0663a0 0x7fafdc068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fafe40b2000 tx=0x7fafe40aa070 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:20.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.808+0000 7fafd7fff640 1 -- 172.21.15.6:0/343716999 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fafe0050d80 con 0x7fafd8003ef0 2023-07-21T22:57:20.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:20.964+0000 7faff58d8640 1 -- 172.21.15.6:0/343716999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7faff00d02a0 con 0x7fafd8003ef0 2023-07-21T22:57:21.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.480+0000 7fafd7fff640 1 -- 172.21.15.6:0/343716999 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v189) v1 ==== 138+0+0 (secure 0 0 0) 0x7fafe0083030 con 0x7fafd8003ef0 2023-07-21T22:57:21.514 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-07-21T22:57:21.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.484+0000 7faff58d8640 1 -- 172.21.15.6:0/343716999 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fafdc0663a0 msgr2=0x7fafdc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:21.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.484+0000 7faff58d8640 1 --2- 172.21.15.6:0/343716999 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fafdc0663a0 0x7fafdc068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fafe40b2000 tx=0x7fafe40aa070 comp rx=0 tx=0).stop 2023-07-21T22:57:21.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.484+0000 7faff58d8640 1 -- 172.21.15.6:0/343716999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd8003ef0 msgr2=0x7faff0151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:21.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.484+0000 7faff58d8640 1 --2- 172.21.15.6:0/343716999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd8003ef0 0x7faff0151420 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fafe00072f0 tx=0x7fafe00077b0 comp rx=0 tx=0).stop 2023-07-21T22:57:21.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.484+0000 7faff58d8640 1 -- 172.21.15.6:0/343716999 shutdown_connections 2023-07-21T22:57:21.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.484+0000 7faff58d8640 1 --2- 172.21.15.6:0/343716999 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fafdc0663a0 0x7fafdc068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:21.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.484+0000 7faff58d8640 1 --2- 172.21.15.6:0/343716999 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faff015dac0 0x7faff015df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:21.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.484+0000 7faff58d8640 1 --2- 172.21.15.6:0/343716999 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faff006e690 0x7faff006eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:21.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.484+0000 7faff58d8640 1 --2- 172.21.15.6:0/343716999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd8003ef0 0x7faff0151420 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:21.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.484+0000 7faff58d8640 1 -- 172.21.15.6:0/343716999 >> 172.21.15.6:0/343716999 conn(0x7faff0099490 msgr2=0x7faff006a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:21.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.484+0000 7faff58d8640 1 -- 172.21.15.6:0/343716999 shutdown_connections 2023-07-21T22:57:21.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.484+0000 7faff58d8640 1 -- 172.21.15.6:0/343716999 wait complete. 2023-07-21T22:57:21.543 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T22:57:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.660+0000 7f39882ca640 1 Processor -- start 2023-07-21T22:57:21.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.660+0000 7f39882ca640 1 -- start start 2023-07-21T22:57:21.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.660+0000 7f39882ca640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f39800d0250 0x7f39800d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:21.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.660+0000 7f39882ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39800d2820 0x7f39800b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:21.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.660+0000 7f39882ca640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39800d0aa0 con 0x7f398015bec0 2023-07-21T22:57:21.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.660+0000 7f39882ca640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39800d2ca0 con 0x7f39800d0250 2023-07-21T22:57:21.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.660+0000 7f39882ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39800d07c0 con 0x7f39800d2820 2023-07-21T22:57:21.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.660+0000 7f3986867640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39800d2820 0x7f39800b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:21.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.660+0000 7f3985865640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f39800d0250 0x7f39800d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:21.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.660+0000 7f3986066640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f398015bec0 0x7f39800cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:50962/0 (socket says 172.21.15.6:50962) 2023-07-21T22:57:21.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.660+0000 7f3986066640 1 -- 172.21.15.6:0/2781122216 learned_addr learned my addr 172.21.15.6:0/2781122216 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:21.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.664+0000 7f3986867640 1 -- 172.21.15.6:0/2781122216 >> v2:172.21.15.161:3300/0 conn(0x7f39800d0250 msgr2=0x7f39800d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:21.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.664+0000 7f3986867640 1 --2- 172.21.15.6:0/2781122216 >> v2:172.21.15.161:3300/0 conn(0x7f39800d0250 0x7f39800d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:21.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.664+0000 7f3986867640 1 -- 172.21.15.6:0/2781122216 >> v1:172.21.15.161:6789/0 conn(0x7f398015bec0 legacy=0x7f39800cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:21.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.664+0000 7f3986867640 1 -- 172.21.15.6:0/2781122216 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39800b1dc0 con 0x7f39800d2820 2023-07-21T22:57:21.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.664+0000 7f3986867640 1 --2- 172.21.15.6:0/2781122216 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39800d2820 0x7f39800b28a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3978009d90 tx=0x7f397801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d968b6a86dc075b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:21.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.664+0000 7f3985064640 1 -- 172.21.15.6:0/2781122216 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39780a59e0 con 0x7f39800d2820 2023-07-21T22:57:21.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.664+0000 7f3985064640 1 -- 172.21.15.6:0/2781122216 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39780a5b40 con 0x7f39800d2820 2023-07-21T22:57:21.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.664+0000 7f3985064640 1 -- 172.21.15.6:0/2781122216 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39780ad440 con 0x7f39800d2820 2023-07-21T22:57:21.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.664+0000 7f39882ca640 1 -- 172.21.15.6:0/2781122216 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39800d2820 msgr2=0x7f39800b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:21.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.664+0000 7f39882ca640 1 --2- 172.21.15.6:0/2781122216 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39800d2820 0x7f39800b28a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3978009d90 tx=0x7f397801c920 comp rx=0 tx=0).stop 2023-07-21T22:57:21.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f39882ca640 1 -- 172.21.15.6:0/2781122216 shutdown_connections 2023-07-21T22:57:21.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f39882ca640 1 --2- 172.21.15.6:0/2781122216 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39800d2820 0x7f39800b28a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:21.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f39882ca640 1 --2- 172.21.15.6:0/2781122216 >> v2:172.21.15.161:3300/0 conn(0x7f39800d0250 0x7f39800d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:21.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f39882ca640 1 -- 172.21.15.6:0/2781122216 >> 172.21.15.6:0/2781122216 conn(0x7f39800659d0 msgr2=0x7f398009b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:21.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f39882ca640 1 -- 172.21.15.6:0/2781122216 shutdown_connections 2023-07-21T22:57:21.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f39882ca640 1 -- 172.21.15.6:0/2781122216 wait complete. 2023-07-21T22:57:21.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f39882ca640 1 Processor -- start 2023-07-21T22:57:21.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f39882ca640 1 -- start start 2023-07-21T22:57:21.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f39882ca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39800d0250 0x7f39801526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:21.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f39882ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39800d2820 0x7f39801563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:21.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f39882ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398015bec0 0x7f39801f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:21.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f39882ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3980151600 con 0x7f398015bec0 2023-07-21T22:57:21.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f39882ca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39801518e0 con 0x7f39800d0250 2023-07-21T22:57:21.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f39882ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3980151bc0 con 0x7f39800d2820 2023-07-21T22:57:21.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f3986867640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398015bec0 0x7f39801f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:21.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f3985865640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39800d2820 0x7f39801563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:21.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f3986066640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39800d0250 0x7f39801526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:21.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f3986867640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398015bec0 0x7f39801f46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37318/0 (socket says 172.21.15.6:37318) 2023-07-21T22:57:21.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f3986867640 1 -- 172.21.15.6:0/2565297007 learned_addr learned my addr 172.21.15.6:0/2565297007 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:21.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f3986867640 1 -- 172.21.15.6:0/2565297007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39800d2820 msgr2=0x7f39801563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:21.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f3986867640 1 --2- 172.21.15.6:0/2565297007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39800d2820 0x7f39801563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:21.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f3986867640 1 -- 172.21.15.6:0/2565297007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39800d0250 msgr2=0x7f39801526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:21.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f3986867640 1 --2- 172.21.15.6:0/2565297007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39800d0250 0x7f39801526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:21.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f3986867640 1 -- 172.21.15.6:0/2565297007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3978009a70 con 0x7f398015bec0 2023-07-21T22:57:21.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f3985865640 1 --2- 172.21.15.6:0/2565297007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39800d2820 0x7f39801563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:21.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.668+0000 7f3986867640 1 --2- 172.21.15.6:0/2565297007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398015bec0 0x7f39801f46d0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f397801afd0 tx=0x7f39780196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:21.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.672+0000 7f3976ffd640 1 -- 172.21.15.6:0/2565297007 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39780add90 con 0x7f398015bec0 2023-07-21T22:57:21.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.672+0000 7f3976ffd640 1 -- 172.21.15.6:0/2565297007 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3978009450 con 0x7f398015bec0 2023-07-21T22:57:21.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.672+0000 7f3976ffd640 1 -- 172.21.15.6:0/2565297007 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39780b9670 con 0x7f398015bec0 2023-07-21T22:57:21.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.672+0000 7f39882ca640 1 -- 172.21.15.6:0/2565297007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3980151ea0 con 0x7f398015bec0 2023-07-21T22:57:21.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.672+0000 7f39882ca640 1 -- 172.21.15.6:0/2565297007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3980156920 con 0x7f398015bec0 2023-07-21T22:57:21.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.672+0000 7f39882ca640 1 -- 172.21.15.6:0/2565297007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39800678d0 con 0x7f398015bec0 2023-07-21T22:57:21.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.672+0000 7f3976ffd640 1 -- 172.21.15.6:0/2565297007 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f39780b97d0 con 0x7f398015bec0 2023-07-21T22:57:21.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.672+0000 7f3976ffd640 1 --2- 172.21.15.6:0/2565297007 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f39640663a0 0x7f3964068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:21.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.672+0000 7f3976ffd640 1 -- 172.21.15.6:0/2565297007 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5652+0+0 (secure 0 0 0) 0x7f397811f3e0 con 0x7f398015bec0 2023-07-21T22:57:21.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.672+0000 7f3986066640 1 --2- 172.21.15.6:0/2565297007 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f39640663a0 0x7f3964068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:21.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.676+0000 7f3986066640 1 --2- 172.21.15.6:0/2565297007 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f39640663a0 0x7f3964068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f397c005890 tx=0x7f397c009040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:21.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.676+0000 7f3976ffd640 1 -- 172.21.15.6:0/2565297007 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f39780ec8f0 con 0x7f398015bec0 2023-07-21T22:57:21.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:21.832+0000 7f39882ca640 1 -- 172.21.15.6:0/2565297007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3980152350 con 0x7f398015bec0 2023-07-21T22:57:22.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.492+0000 7f3976ffd640 1 -- 172.21.15.6:0/2565297007 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v190) v1 ==== 170+0+0 (secure 0 0 0) 0x7f39780eff10 con 0x7f398015bec0 2023-07-21T22:57:22.529 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-07-21T22:57:22.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.500+0000 7f39882ca640 1 -- 172.21.15.6:0/2565297007 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f39640663a0 msgr2=0x7f3964068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:22.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.500+0000 7f39882ca640 1 --2- 172.21.15.6:0/2565297007 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f39640663a0 0x7f3964068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f397c005890 tx=0x7f397c009040 comp rx=0 tx=0).stop 2023-07-21T22:57:22.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.500+0000 7f39882ca640 1 -- 172.21.15.6:0/2565297007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398015bec0 msgr2=0x7f39801f46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:22.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.500+0000 7f39882ca640 1 --2- 172.21.15.6:0/2565297007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398015bec0 0x7f39801f46d0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f397801afd0 tx=0x7f39780196c0 comp rx=0 tx=0).stop 2023-07-21T22:57:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.500+0000 7f39882ca640 1 -- 172.21.15.6:0/2565297007 shutdown_connections 2023-07-21T22:57:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.500+0000 7f39882ca640 1 --2- 172.21.15.6:0/2565297007 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f39640663a0 0x7f3964068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.500+0000 7f39882ca640 1 --2- 172.21.15.6:0/2565297007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398015bec0 0x7f39801f46d0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.500+0000 7f39882ca640 1 --2- 172.21.15.6:0/2565297007 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f39800d2820 0x7f39801563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.500+0000 7f39882ca640 1 --2- 172.21.15.6:0/2565297007 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39800d0250 0x7f39801526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:22.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.500+0000 7f39882ca640 1 -- 172.21.15.6:0/2565297007 >> 172.21.15.6:0/2565297007 conn(0x7f39800659d0 msgr2=0x7f398006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:22.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.504+0000 7f39882ca640 1 -- 172.21.15.6:0/2565297007 shutdown_connections 2023-07-21T22:57:22.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.504+0000 7f39882ca640 1 -- 172.21.15.6:0/2565297007 wait complete. 2023-07-21T22:57:22.575 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-21T22:57:22.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.688+0000 7f36fd9d2640 1 Processor -- start 2023-07-21T22:57:22.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.688+0000 7f36fd9d2640 1 -- start start 2023-07-21T22:57:22.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.688+0000 7f36fd9d2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f36f815bba0 0x7f36f80c4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:22.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.688+0000 7f36fd9d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36f80ad450 0x7f36f80ad930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:22.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.688+0000 7f36fd9d2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f815bf70 con 0x7f36f80c2d30 2023-07-21T22:57:22.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.688+0000 7f36fd9d2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f81600e0 con 0x7f36f815bba0 2023-07-21T22:57:22.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.688+0000 7f36fd9d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f80c4d00 con 0x7f36f80ad450 2023-07-21T22:57:22.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.688+0000 7f36f6ffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f36f815bba0 0x7f36f80c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:22.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.688+0000 7f36f77fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36f80ad450 0x7f36f80ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:22.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.692+0000 7f36f77fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36f80ad450 0x7f36f80ad930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:39800/0 (socket says 172.21.15.6:39800) 2023-07-21T22:57:22.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.692+0000 7f36effff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f36f80c2d30 0x7f36f80acd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:50970/0 (socket says 172.21.15.6:50970) 2023-07-21T22:57:22.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.692+0000 7f36f77fe640 1 -- 172.21.15.6:0/3596997532 learned_addr learned my addr 172.21.15.6:0/3596997532 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:22.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.692+0000 7f36f6ffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f36f815bba0 0x7f36f80c4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:59728/0 (socket says 172.21.15.6:59728) 2023-07-21T22:57:22.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.692+0000 7f36f6ffd640 1 -- 172.21.15.6:0/3596997532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36f80ad450 msgr2=0x7f36f80ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:22.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.692+0000 7f36f6ffd640 1 --2- 172.21.15.6:0/3596997532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36f80ad450 0x7f36f80ad930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:22.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.692+0000 7f36f6ffd640 1 -- 172.21.15.6:0/3596997532 >> v1:172.21.15.161:6789/0 conn(0x7f36f80c2d30 legacy=0x7f36f80acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:22.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.692+0000 7f36f6ffd640 1 -- 172.21.15.6:0/3596997532 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f8160570 con 0x7f36f815bba0 2023-07-21T22:57:22.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.692+0000 7f36f6ffd640 1 --2- 172.21.15.6:0/3596997532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36f815bba0 0x7f36f80c4620 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f36e80097c0 tx=0x7f36e801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=367bda1b206997fd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:22.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.692+0000 7f36f67fc640 1 -- 172.21.15.6:0/3596997532 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e80ab600 con 0x7f36f815bba0 2023-07-21T22:57:22.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.692+0000 7f36f67fc640 1 -- 172.21.15.6:0/3596997532 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e80a7050 con 0x7f36f815bba0 2023-07-21T22:57:22.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.692+0000 7f36f67fc640 1 -- 172.21.15.6:0/3596997532 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e80ab980 con 0x7f36f815bba0 2023-07-21T22:57:22.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36fd9d2640 1 -- 172.21.15.6:0/3596997532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36f815bba0 msgr2=0x7f36f80c4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:22.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36fd9d2640 1 --2- 172.21.15.6:0/3596997532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36f815bba0 0x7f36f80c4620 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f36e80097c0 tx=0x7f36e801c330 comp rx=0 tx=0).stop 2023-07-21T22:57:22.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36fd9d2640 1 -- 172.21.15.6:0/3596997532 shutdown_connections 2023-07-21T22:57:22.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36fd9d2640 1 --2- 172.21.15.6:0/3596997532 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36f80ad450 0x7f36f80ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:22.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36fd9d2640 1 --2- 172.21.15.6:0/3596997532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36f815bba0 0x7f36f80c4620 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:22.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36fd9d2640 1 -- 172.21.15.6:0/3596997532 >> 172.21.15.6:0/3596997532 conn(0x7f36f80cde90 msgr2=0x7f36f80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:22.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36fd9d2640 1 -- 172.21.15.6:0/3596997532 shutdown_connections 2023-07-21T22:57:22.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36fd9d2640 1 -- 172.21.15.6:0/3596997532 wait complete. 2023-07-21T22:57:22.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36fd9d2640 1 Processor -- start 2023-07-21T22:57:22.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36fd9d2640 1 -- start start 2023-07-21T22:57:22.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36fd9d2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36f80ad450 0x7f36f8149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:22.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36fd9d2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36f80c2d30 0x7f36f814a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:22.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36fd9d2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f815bba0 0x7f36f8155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:22.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36fd9d2640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f8159b70 con 0x7f36f815bba0 2023-07-21T22:57:22.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36fd9d2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f8153720 con 0x7f36f80c2d30 2023-07-21T22:57:22.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36fd9d2640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f81591d0 con 0x7f36f80ad450 2023-07-21T22:57:22.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36f77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f815bba0 0x7f36f8155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:22.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36f77fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f815bba0 0x7f36f8155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37332/0 (socket says 172.21.15.6:37332) 2023-07-21T22:57:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36f77fe640 1 -- 172.21.15.6:0/1792683647 learned_addr learned my addr 172.21.15.6:0/1792683647 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36effff640 1 --2- 172.21.15.6:0/1792683647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36f80c2d30 0x7f36f814a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36f6ffd640 1 --2- 172.21.15.6:0/1792683647 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36f80ad450 0x7f36f8149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36f77fe640 1 -- 172.21.15.6:0/1792683647 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36f80ad450 msgr2=0x7f36f8149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:22.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36f77fe640 1 --2- 172.21.15.6:0/1792683647 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36f80ad450 0x7f36f8149b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:22.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36f77fe640 1 -- 172.21.15.6:0/1792683647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36f80c2d30 msgr2=0x7f36f814a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:22.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36f77fe640 1 --2- 172.21.15.6:0/1792683647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36f80c2d30 0x7f36f814a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:22.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36f77fe640 1 -- 172.21.15.6:0/1792683647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e8009420 con 0x7f36f815bba0 2023-07-21T22:57:22.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.696+0000 7f36effff640 1 --2- 172.21.15.6:0/1792683647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36f80c2d30 0x7f36f814a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:22.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.700+0000 7f36f77fe640 1 --2- 172.21.15.6:0/1792683647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f815bba0 0x7f36f8155550 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f36f000efc0 tx=0x7f36f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.700+0000 7f36f4ff9640 1 -- 172.21.15.6:0/1792683647 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f000cd20 con 0x7f36f815bba0 2023-07-21T22:57:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.700+0000 7f36f4ff9640 1 -- 172.21.15.6:0/1792683647 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f000f040 con 0x7f36f815bba0 2023-07-21T22:57:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.700+0000 7f36f4ff9640 1 -- 172.21.15.6:0/1792683647 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f0003be0 con 0x7f36f815bba0 2023-07-21T22:57:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.700+0000 7f36fd9d2640 1 -- 172.21.15.6:0/1792683647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f81594b0 con 0x7f36f815bba0 2023-07-21T22:57:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.700+0000 7f36fd9d2640 1 -- 172.21.15.6:0/1792683647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f8156860 con 0x7f36f815bba0 2023-07-21T22:57:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.700+0000 7f36fd9d2640 1 -- 172.21.15.6:0/1792683647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f8159cb0 con 0x7f36f815bba0 2023-07-21T22:57:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.700+0000 7f36f4ff9640 1 -- 172.21.15.6:0/1792683647 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f36f0003d40 con 0x7f36f815bba0 2023-07-21T22:57:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.700+0000 7f36f4ff9640 1 --2- 172.21.15.6:0/1792683647 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f36d80663a0 0x7f36d8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.700+0000 7f36f4ff9640 1 -- 172.21.15.6:0/1792683647 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6034+0+0 (secure 0 0 0) 0x7f36f00851c0 con 0x7f36f815bba0 2023-07-21T22:57:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.700+0000 7f36f6ffd640 1 --2- 172.21.15.6:0/1792683647 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f36d80663a0 0x7f36d8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.704+0000 7f36f6ffd640 1 --2- 172.21.15.6:0/1792683647 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f36d80663a0 0x7f36d8068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f36e80ad000 tx=0x7f36e80a6000 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:22.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.704+0000 7f36f4ff9640 1 -- 172.21.15.6:0/1792683647 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f36f00524a0 con 0x7f36f815bba0 2023-07-21T22:57:22.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:22.892+0000 7f36fd9d2640 1 -- 172.21.15.6:0/1792683647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f36f8159cb0 con 0x7f36f815bba0 2023-07-21T22:57:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.500+0000 7f36f4ff9640 1 -- 172.21.15.6:0/1792683647 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v82) v1 ==== 174+0+0 (secure 0 0 0) 0x7f36f8159cb0 con 0x7f36f815bba0 2023-07-21T22:57:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 23 and data pool 24 2023-07-21T22:57:23.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.504+0000 7f36fd9d2640 1 -- 172.21.15.6:0/1792683647 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f36d80663a0 msgr2=0x7f36d8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.504+0000 7f36fd9d2640 1 --2- 172.21.15.6:0/1792683647 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f36d80663a0 0x7f36d8068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f36e80ad000 tx=0x7f36e80a6000 comp rx=0 tx=0).stop 2023-07-21T22:57:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.504+0000 7f36fd9d2640 1 -- 172.21.15.6:0/1792683647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f815bba0 msgr2=0x7f36f8155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.504+0000 7f36fd9d2640 1 --2- 172.21.15.6:0/1792683647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f815bba0 0x7f36f8155550 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f36f000efc0 tx=0x7f36f000c490 comp rx=0 tx=0).stop 2023-07-21T22:57:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.504+0000 7f36fd9d2640 1 -- 172.21.15.6:0/1792683647 shutdown_connections 2023-07-21T22:57:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.504+0000 7f36fd9d2640 1 --2- 172.21.15.6:0/1792683647 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f36d80663a0 0x7f36d8068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.504+0000 7f36fd9d2640 1 --2- 172.21.15.6:0/1792683647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36f815bba0 0x7f36f8155550 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.504+0000 7f36fd9d2640 1 --2- 172.21.15.6:0/1792683647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36f80c2d30 0x7f36f814a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:23.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.504+0000 7f36fd9d2640 1 --2- 172.21.15.6:0/1792683647 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36f80ad450 0x7f36f8149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:23.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.504+0000 7f36fd9d2640 1 -- 172.21.15.6:0/1792683647 >> 172.21.15.6:0/1792683647 conn(0x7f36f80cde90 msgr2=0x7f36f806b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:23.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.508+0000 7f36fd9d2640 1 -- 172.21.15.6:0/1792683647 shutdown_connections 2023-07-21T22:57:23.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.508+0000 7f36fd9d2640 1 -- 172.21.15.6:0/1792683647 wait complete. 2023-07-21T22:57:23.568 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:57:23.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.716+0000 7f02bc3db640 1 Processor -- start 2023-07-21T22:57:23.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.716+0000 7f02bc3db640 1 -- start start 2023-07-21T22:57:23.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.720+0000 7f02bc3db640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f02b40c8ad0 0x7f02b40c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:23.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.720+0000 7f02bc3db640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f02b40c9560 0x7f02b40ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:23.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.720+0000 7f02bc3db640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b40c99c0 con 0x7f02b4158ce0 2023-07-21T22:57:23.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.720+0000 7f02bc3db640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b40cc700 con 0x7f02b40c9560 2023-07-21T22:57:23.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.720+0000 7f02bc3db640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b40b0ff0 con 0x7f02b40c8ad0 2023-07-21T22:57:23.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.720+0000 7f02ba978640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f02b40c9560 0x7f02b40ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:23.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.720+0000 7f02ba177640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f02b4158ce0 0x7f02b4070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53522/0 (socket says 172.21.15.6:53522) 2023-07-21T22:57:23.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.720+0000 7f02ba177640 1 -- 172.21.15.6:0/1545846347 learned_addr learned my addr 172.21.15.6:0/1545846347 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:23.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.720+0000 7f02b9976640 1 --2- 172.21.15.6:0/1545846347 >> v2:172.21.15.161:3300/0 conn(0x7f02b40c8ad0 0x7f02b40c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:23.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.720+0000 7f02ba978640 1 -- 172.21.15.6:0/1545846347 >> v2:172.21.15.161:3300/0 conn(0x7f02b40c8ad0 msgr2=0x7f02b40c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:23.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.720+0000 7f02ba978640 1 --2- 172.21.15.6:0/1545846347 >> v2:172.21.15.161:3300/0 conn(0x7f02b40c8ad0 0x7f02b40c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:23.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.720+0000 7f02ba978640 1 -- 172.21.15.6:0/1545846347 >> v1:172.21.15.6:6789/0 conn(0x7f02b4158ce0 legacy=0x7f02b4070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:23.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.720+0000 7f02ba978640 1 -- 172.21.15.6:0/1545846347 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b4070c80 con 0x7f02b40c9560 2023-07-21T22:57:23.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.720+0000 7f02b9175640 1 -- 172.21.15.6:0/1545846347 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373600168 0 0) 0x7f02b40c99c0 con 0x7f02b4158ce0 2023-07-21T22:57:23.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.724+0000 7f02ba978640 1 --2- 172.21.15.6:0/1545846347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b40c9560 0x7f02b40ccb90 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f02b40c1a30 tx=0x7f02ac01c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2a3105474b7cc6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:23.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.724+0000 7f02b9175640 1 -- 172.21.15.6:0/1545846347 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0a5790 con 0x7f02b40c9560 2023-07-21T22:57:23.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.724+0000 7f02b9175640 1 -- 172.21.15.6:0/1545846347 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac0a58f0 con 0x7f02b40c9560 2023-07-21T22:57:23.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.724+0000 7f02b9175640 1 -- 172.21.15.6:0/1545846347 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0a5c80 con 0x7f02b40c9560 2023-07-21T22:57:23.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.724+0000 7f02bc3db640 1 -- 172.21.15.6:0/1545846347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b40c9560 msgr2=0x7f02b40ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:23.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.724+0000 7f02bc3db640 1 --2- 172.21.15.6:0/1545846347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b40c9560 0x7f02b40ccb90 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f02b40c1a30 tx=0x7f02ac01c7c0 comp rx=0 tx=0).stop 2023-07-21T22:57:23.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.724+0000 7f02bc3db640 1 -- 172.21.15.6:0/1545846347 shutdown_connections 2023-07-21T22:57:23.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.724+0000 7f02bc3db640 1 --2- 172.21.15.6:0/1545846347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b40c9560 0x7f02b40ccb90 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:23.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.724+0000 7f02bc3db640 1 --2- 172.21.15.6:0/1545846347 >> v2:172.21.15.161:3300/0 conn(0x7f02b40c8ad0 0x7f02b40c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:23.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.724+0000 7f02bc3db640 1 -- 172.21.15.6:0/1545846347 >> 172.21.15.6:0/1545846347 conn(0x7f02b40afcf0 msgr2=0x7f02b40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:23.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.724+0000 7f02bc3db640 1 -- 172.21.15.6:0/1545846347 shutdown_connections 2023-07-21T22:57:23.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.724+0000 7f02bc3db640 1 -- 172.21.15.6:0/1545846347 wait complete. 2023-07-21T22:57:23.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.724+0000 7f02bc3db640 1 Processor -- start 2023-07-21T22:57:23.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.724+0000 7f02bc3db640 1 -- start start 2023-07-21T22:57:23.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02bc3db640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02b40c8ad0 0x7f02b41f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:23.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02bc3db640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02b40c9560 0x7f02b40aca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:23.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02bc3db640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b4158ce0 0x7f02b4142630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:23.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02bc3db640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b40acf60 con 0x7f02b4158ce0 2023-07-21T22:57:23.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02bc3db640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b4151fd0 con 0x7f02b40c9560 2023-07-21T22:57:23.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02bc3db640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b4152460 con 0x7f02b40c8ad0 2023-07-21T22:57:23.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02ba978640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b4158ce0 0x7f02b4142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:23.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02ba978640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b4158ce0 0x7f02b4142630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37348/0 (socket says 172.21.15.6:37348) 2023-07-21T22:57:23.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02ba978640 1 -- 172.21.15.6:0/635960545 learned_addr learned my addr 172.21.15.6:0/635960545 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:23.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02b9976640 1 --2- 172.21.15.6:0/635960545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02b40c9560 0x7f02b40aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:23.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02ba177640 1 --2- 172.21.15.6:0/635960545 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02b40c8ad0 0x7f02b41f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:23.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02ba978640 1 -- 172.21.15.6:0/635960545 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02b40c8ad0 msgr2=0x7f02b41f7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:23.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02ba978640 1 --2- 172.21.15.6:0/635960545 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02b40c8ad0 0x7f02b41f7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:23.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02ba978640 1 -- 172.21.15.6:0/635960545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02b40c9560 msgr2=0x7f02b40aca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:23.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02ba978640 1 --2- 172.21.15.6:0/635960545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02b40c9560 0x7f02b40aca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:23.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02ba978640 1 -- 172.21.15.6:0/635960545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ac009a70 con 0x7f02b4158ce0 2023-07-21T22:57:23.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02b9976640 1 --2- 172.21.15.6:0/635960545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02b40c9560 0x7f02b40aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:23.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02ba177640 1 --2- 172.21.15.6:0/635960545 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02b40c8ad0 0x7f02b41f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:23.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02ba978640 1 --2- 172.21.15.6:0/635960545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b4158ce0 0x7f02b4142630 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f02ac01cca0 tx=0x7f02ac019560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:23.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02aaffd640 1 -- 172.21.15.6:0/635960545 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0ad850 con 0x7f02b4158ce0 2023-07-21T22:57:23.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02aaffd640 1 -- 172.21.15.6:0/635960545 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac0ad9b0 con 0x7f02b4158ce0 2023-07-21T22:57:23.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02aaffd640 1 -- 172.21.15.6:0/635960545 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0add40 con 0x7f02b4158ce0 2023-07-21T22:57:23.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02bc3db640 1 -- 172.21.15.6:0/635960545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b4142b70 con 0x7f02b4158ce0 2023-07-21T22:57:23.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02bc3db640 1 -- 172.21.15.6:0/635960545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b41516a0 con 0x7f02b4158ce0 2023-07-21T22:57:23.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02bc3db640 1 -- 172.21.15.6:0/635960545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b40ca1a0 con 0x7f02b4158ce0 2023-07-21T22:57:23.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.728+0000 7f02aaffd640 1 -- 172.21.15.6:0/635960545 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f02ac0b4070 con 0x7f02b4158ce0 2023-07-21T22:57:23.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.732+0000 7f02aaffd640 1 --2- 172.21.15.6:0/635960545 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f02980663a0 0x7f0298068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:23.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.732+0000 7f02aaffd640 1 -- 172.21.15.6:0/635960545 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f02ac11eae0 con 0x7f02b4158ce0 2023-07-21T22:57:23.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.732+0000 7f02ba177640 1 --2- 172.21.15.6:0/635960545 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f02980663a0 0x7f0298068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:23.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.732+0000 7f02ba177640 1 --2- 172.21.15.6:0/635960545 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f02980663a0 0x7f0298068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f02b0007fd0 tx=0x7f02b0009040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:23.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.736+0000 7f02aaffd640 1 -- 172.21.15.6:0/635960545 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f02ac0ebe80 con 0x7f02b4158ce0 2023-07-21T22:57:23.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.892+0000 7f02bc3db640 1 -- 172.21.15.6:0/635960545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02b40678d0 con 0x7f02b4158ce0 2023-07-21T22:57:23.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.892+0000 7f02aaffd640 1 -- 172.21.15.6:0/635960545 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) v1 ==== 74+0+18349 (secure 0 0 0) 0x7f02ac0a5750 con 0x7f02b4158ce0 2023-07-21T22:57:23.929 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:23.929 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":191,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:57:22.895518+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:57:21.014468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-21T22:57:21.883517+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:57:23.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.896+0000 7f02bc3db640 1 -- 172.21.15.6:0/635960545 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f02980663a0 msgr2=0x7f0298068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:23.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.896+0000 7f02bc3db640 1 --2- 172.21.15.6:0/635960545 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f02980663a0 0x7f0298068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f02b0007fd0 tx=0x7f02b0009040 comp rx=0 tx=0).stop 2023-07-21T22:57:23.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.896+0000 7f02bc3db640 1 -- 172.21.15.6:0/635960545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b4158ce0 msgr2=0x7f02b4142630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:23.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.896+0000 7f02bc3db640 1 --2- 172.21.15.6:0/635960545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b4158ce0 0x7f02b4142630 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f02ac01cca0 tx=0x7f02ac019560 comp rx=0 tx=0).stop 2023-07-21T22:57:23.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.896+0000 7f02bc3db640 1 -- 172.21.15.6:0/635960545 shutdown_connections 2023-07-21T22:57:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.896+0000 7f02bc3db640 1 --2- 172.21.15.6:0/635960545 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f02980663a0 0x7f0298068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.896+0000 7f02bc3db640 1 --2- 172.21.15.6:0/635960545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b4158ce0 0x7f02b4142630 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.896+0000 7f02bc3db640 1 --2- 172.21.15.6:0/635960545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f02b40c9560 0x7f02b40aca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.896+0000 7f02bc3db640 1 --2- 172.21.15.6:0/635960545 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f02b40c8ad0 0x7f02b41f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.896+0000 7f02bc3db640 1 -- 172.21.15.6:0/635960545 >> 172.21.15.6:0/635960545 conn(0x7f02b40afcf0 msgr2=0x7f02b41559e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.896+0000 7f02bc3db640 1 -- 172.21.15.6:0/635960545 shutdown_connections 2023-07-21T22:57:23.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:23.896+0000 7f02bc3db640 1 -- 172.21.15.6:0/635960545 wait complete. 2023-07-21T22:57:23.950 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:57:24.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.060+0000 7fa293582640 1 Processor -- start 2023-07-21T22:57:24.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.060+0000 7fa293582640 1 -- start start 2023-07-21T22:57:24.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.060+0000 7fa293582640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa28c15fd60 0x7fa28c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:24.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.060+0000 7fa293582640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28c0ccaf0 con 0x7fa28c0d1850 2023-07-21T22:57:24.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.060+0000 7fa293582640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28c160320 con 0x7fa28c0b7c70 2023-07-21T22:57:24.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.060+0000 7fa293582640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa28c0d1190 con 0x7fa28c15fd60 2023-07-21T22:57:24.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.060+0000 7fa291b1f640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa28c0d1850 0x7fa28c0d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53524/0 (socket says 172.21.15.6:53524) 2023-07-21T22:57:24.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.060+0000 7fa291b1f640 1 -- 172.21.15.6:0/2194639670 learned_addr learned my addr 172.21.15.6:0/2194639670 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:24.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.060+0000 7fa290b1d640 1 --2- 172.21.15.6:0/2194639670 >> v2:172.21.15.161:3300/0 conn(0x7fa28c15fd60 0x7fa28c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:24.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.060+0000 7fa283fff640 1 -- 172.21.15.6:0/2194639670 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599961482 0 0) 0x7fa28c0ccaf0 con 0x7fa28c0d1850 2023-07-21T22:57:24.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.060+0000 7fa283fff640 1 -- 172.21.15.6:0/2194639670 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa278003530 con 0x7fa28c0d1850 2023-07-21T22:57:24.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.060+0000 7fa283fff640 1 -- 172.21.15.6:0/2194639670 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2867172278 0 0) 0x7fa278003530 con 0x7fa28c0d1850 2023-07-21T22:57:24.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.060+0000 7fa283fff640 1 -- 172.21.15.6:0/2194639670 >> v2:172.21.15.161:3300/0 conn(0x7fa28c15fd60 msgr2=0x7fa28c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:24.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa283fff640 1 --2- 172.21.15.6:0/2194639670 >> v2:172.21.15.161:3300/0 conn(0x7fa28c15fd60 0x7fa28c0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:24.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa283fff640 1 -- 172.21.15.6:0/2194639670 >> v1:172.21.15.161:6789/0 conn(0x7fa28c0b7c70 legacy=0x7fa28c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:24.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa283fff640 1 -- 172.21.15.6:0/2194639670 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c0ccd90 con 0x7fa28c0d1850 2023-07-21T22:57:24.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa283fff640 1 -- 172.21.15.6:0/2194639670 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fa284001a00 con 0x7fa28c0d1850 2023-07-21T22:57:24.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa283fff640 1 -- 172.21.15.6:0/2194639670 >> v1:172.21.15.6:6789/0 conn(0x7fa28c0d1850 legacy=0x7fa28c0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:24.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa283fff640 1 --2- 172.21.15.6:0/2194639670 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa278003980 0x7fa278003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:24.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa283fff640 1 --2- 172.21.15.6:0/2194639670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2780047d0 0x7fa278004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:24.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa283fff640 1 --2- 172.21.15.6:0/2194639670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa278005180 0x7fa27800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:24.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa283fff640 1 -- 172.21.15.6:0/2194639670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27800bfd0 con 0x7fa278005180 2023-07-21T22:57:24.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa283fff640 1 -- 172.21.15.6:0/2194639670 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27800c140 con 0x7fa2780047d0 2023-07-21T22:57:24.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa283fff640 1 -- 172.21.15.6:0/2194639670 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27800c300 con 0x7fa278003980 2023-07-21T22:57:24.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa291b1f640 1 --2- 172.21.15.6:0/2194639670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa278005180 0x7fa27800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:24.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa290b1d640 1 --2- 172.21.15.6:0/2194639670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2780047d0 0x7fa278004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:24.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa29131e640 1 --2- 172.21.15.6:0/2194639670 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa278003980 0x7fa278003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:24.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa291b1f640 1 -- 172.21.15.6:0/2194639670 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa278003980 msgr2=0x7fa278003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:24.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa291b1f640 1 --2- 172.21.15.6:0/2194639670 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa278003980 0x7fa278003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:24.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa291b1f640 1 -- 172.21.15.6:0/2194639670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2780047d0 msgr2=0x7fa278004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:24.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa291b1f640 1 --2- 172.21.15.6:0/2194639670 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2780047d0 0x7fa278004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:24.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa291b1f640 1 -- 172.21.15.6:0/2194639670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa278003530 con 0x7fa278005180 2023-07-21T22:57:24.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa291b1f640 1 -- 172.21.15.6:0/2194639670 reap_dead start 2023-07-21T22:57:24.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa291b1f640 1 --2- 172.21.15.6:0/2194639670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa278005180 0x7fa27800b990 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7fa28400a830 tx=0x7fa28401d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c64de3f330e21 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:24.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa283fff640 1 -- 172.21.15.6:0/2194639670 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2840072d0 con 0x7fa278005180 2023-07-21T22:57:24.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa283fff640 1 -- 172.21.15.6:0/2194639670 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2840a8070 con 0x7fa278005180 2023-07-21T22:57:24.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.064+0000 7fa283fff640 1 -- 172.21.15.6:0/2194639670 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2840076b0 con 0x7fa278005180 2023-07-21T22:57:24.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.068+0000 7fa293582640 1 -- 172.21.15.6:0/2194639670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa278005180 msgr2=0x7fa27800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:24.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.068+0000 7fa293582640 1 --2- 172.21.15.6:0/2194639670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa278005180 0x7fa27800b990 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7fa28400a830 tx=0x7fa28401d340 comp rx=0 tx=0).stop 2023-07-21T22:57:24.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.068+0000 7fa293582640 1 -- 172.21.15.6:0/2194639670 shutdown_connections 2023-07-21T22:57:24.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.068+0000 7fa293582640 1 --2- 172.21.15.6:0/2194639670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa278005180 0x7fa27800b990 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:24.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.068+0000 7fa293582640 1 -- 172.21.15.6:0/2194639670 >> 172.21.15.6:0/2194639670 conn(0x7fa28c0650b0 msgr2=0x7fa28c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:24.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.068+0000 7fa293582640 1 -- 172.21.15.6:0/2194639670 shutdown_connections 2023-07-21T22:57:24.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.068+0000 7fa293582640 1 -- 172.21.15.6:0/2194639670 wait complete. 2023-07-21T22:57:24.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.068+0000 7fa293582640 1 Processor -- start 2023-07-21T22:57:24.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.068+0000 7fa293582640 1 -- start start 2023-07-21T22:57:24.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.068+0000 7fa293582640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa278005180 0x7fa28c14c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:24.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.068+0000 7fa293582640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa28c15e300 0x7fa28c0c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:24.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.068+0000 7fa293582640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa28c15c1f0 0x7fa28c15c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:24.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.068+0000 7fa293582640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c14cc70 con 0x7fa28c15e300 2023-07-21T22:57:24.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.068+0000 7fa293582640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c0c8430 con 0x7fa278005180 2023-07-21T22:57:24.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.068+0000 7fa293582640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c15b430 con 0x7fa28c15c1f0 2023-07-21T22:57:24.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.068+0000 7fa290b1d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa28c15e300 0x7fa28c0c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:24.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.068+0000 7fa290b1d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa28c15e300 0x7fa28c0c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37364/0 (socket says 172.21.15.6:37364) 2023-07-21T22:57:24.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.068+0000 7fa290b1d640 1 -- 172.21.15.6:0/947342563 learned_addr learned my addr 172.21.15.6:0/947342563 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:24.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.068+0000 7fa29131e640 1 --2- 172.21.15.6:0/947342563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa278005180 0x7fa28c14c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:24.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.068+0000 7fa291b1f640 1 --2- 172.21.15.6:0/947342563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa28c15c1f0 0x7fa28c15c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:24.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.072+0000 7fa290b1d640 1 -- 172.21.15.6:0/947342563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa28c15c1f0 msgr2=0x7fa28c15c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:24.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.072+0000 7fa290b1d640 1 --2- 172.21.15.6:0/947342563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa28c15c1f0 0x7fa28c15c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:24.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.072+0000 7fa290b1d640 1 -- 172.21.15.6:0/947342563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa278005180 msgr2=0x7fa28c14c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:24.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.072+0000 7fa290b1d640 1 --2- 172.21.15.6:0/947342563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa278005180 0x7fa28c14c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:24.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.072+0000 7fa290b1d640 1 -- 172.21.15.6:0/947342563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c15b710 con 0x7fa28c15e300 2023-07-21T22:57:24.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.072+0000 7fa291b1f640 1 --2- 172.21.15.6:0/947342563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa28c15c1f0 0x7fa28c15c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:24.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.072+0000 7fa290b1d640 1 --2- 172.21.15.6:0/947342563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa28c15e300 0x7fa28c0c7a90 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7fa27c011960 tx=0x7fa27c011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:24.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.072+0000 7fa281ffb640 1 -- 172.21.15.6:0/947342563 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c00faf0 con 0x7fa28c15e300 2023-07-21T22:57:24.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.072+0000 7fa281ffb640 1 -- 172.21.15.6:0/947342563 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27c00fc50 con 0x7fa28c15e300 2023-07-21T22:57:24.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.072+0000 7fa281ffb640 1 -- 172.21.15.6:0/947342563 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c014440 con 0x7fa28c15e300 2023-07-21T22:57:24.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.072+0000 7fa293582640 1 -- 172.21.15.6:0/947342563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28c15b9f0 con 0x7fa28c15e300 2023-07-21T22:57:24.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.072+0000 7fa293582640 1 -- 172.21.15.6:0/947342563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28c0c7fd0 con 0x7fa28c15e300 2023-07-21T22:57:24.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.072+0000 7fa293582640 1 -- 172.21.15.6:0/947342563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa28c0678d0 con 0x7fa28c15e300 2023-07-21T22:57:24.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.072+0000 7fa281ffb640 1 -- 172.21.15.6:0/947342563 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa27c0145a0 con 0x7fa28c15e300 2023-07-21T22:57:24.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.072+0000 7fa281ffb640 1 --2- 172.21.15.6:0/947342563 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa2700663d0 0x7fa270068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:24.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.076+0000 7fa281ffb640 1 -- 172.21.15.6:0/947342563 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fa27c0846f0 con 0x7fa28c15e300 2023-07-21T22:57:24.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.076+0000 7fa29131e640 1 --2- 172.21.15.6:0/947342563 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa2700663d0 0x7fa270068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:24.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.076+0000 7fa29131e640 1 --2- 172.21.15.6:0/947342563 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa2700663d0 0x7fa270068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa288000c10 tx=0x7fa288009040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:24.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.076+0000 7fa281ffb640 1 -- 172.21.15.6:0/947342563 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa27c051970 con 0x7fa28c15e300 2023-07-21T22:57:24.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.236+0000 7fa293582640 1 -- 172.21.15.6:0/947342563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa28c0cd370 con 0x7fa28c15e300 2023-07-21T22:57:24.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.236+0000 7fa281ffb640 1 -- 172.21.15.6:0/947342563 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) v1 ==== 74+0+18349 (secure 0 0 0) 0x7fa27c054f90 con 0x7fa28c15e300 2023-07-21T22:57:24.272 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:24.272 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":191,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:57:22.895518+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:57:21.014468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-21T22:57:21.883517+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:57:24.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.236+0000 7fa293582640 1 -- 172.21.15.6:0/947342563 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa2700663d0 msgr2=0x7fa270068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:24.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.236+0000 7fa293582640 1 --2- 172.21.15.6:0/947342563 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa2700663d0 0x7fa270068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa288000c10 tx=0x7fa288009040 comp rx=0 tx=0).stop 2023-07-21T22:57:24.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.236+0000 7fa293582640 1 -- 172.21.15.6:0/947342563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa28c15e300 msgr2=0x7fa28c0c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:24.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.236+0000 7fa293582640 1 --2- 172.21.15.6:0/947342563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa28c15e300 0x7fa28c0c7a90 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7fa27c011960 tx=0x7fa27c011e20 comp rx=0 tx=0).stop 2023-07-21T22:57:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.236+0000 7fa293582640 1 -- 172.21.15.6:0/947342563 shutdown_connections 2023-07-21T22:57:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.236+0000 7fa293582640 1 --2- 172.21.15.6:0/947342563 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa2700663d0 0x7fa270068880 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.236+0000 7fa293582640 1 --2- 172.21.15.6:0/947342563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa28c15c1f0 0x7fa28c15c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.236+0000 7fa293582640 1 --2- 172.21.15.6:0/947342563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa28c15e300 0x7fa28c0c7a90 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.236+0000 7fa293582640 1 --2- 172.21.15.6:0/947342563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa278005180 0x7fa28c14c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.236+0000 7fa293582640 1 -- 172.21.15.6:0/947342563 >> 172.21.15.6:0/947342563 conn(0x7fa28c0650b0 msgr2=0x7fa28c15aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:24.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.236+0000 7fa293582640 1 -- 172.21.15.6:0/947342563 shutdown_connections 2023-07-21T22:57:24.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.236+0000 7fa293582640 1 -- 172.21.15.6:0/947342563 wait complete. 2023-07-21T22:57:24.293 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-21T22:57:24.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.404+0000 7fa59cdfa640 1 Processor -- start 2023-07-21T22:57:24.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.408+0000 7fa59cdfa640 1 -- start start 2023-07-21T22:57:24.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.408+0000 7fa59cdfa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa598069430 0x7fa5980cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:24.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.408+0000 7fa59cdfa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa598160030 0x7fa598069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:24.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.408+0000 7fa59cdfa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa598070330 0x7fa598070790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:24.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.408+0000 7fa59cdfa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa598069d40 con 0x7fa598160030 2023-07-21T22:57:24.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.408+0000 7fa59cdfa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5980cb7d0 con 0x7fa598069430 2023-07-21T22:57:24.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.408+0000 7fa59cdfa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59806c510 con 0x7fa598070330 2023-07-21T22:57:24.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.408+0000 7fa595d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa598160030 0x7fa598069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:24.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.408+0000 7fa595d9b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa598160030 0x7fa598069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37368/0 (socket says 172.21.15.6:37368) 2023-07-21T22:57:24.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.408+0000 7fa595d9b640 1 -- 172.21.15.6:0/1887814038 learned_addr learned my addr 172.21.15.6:0/1887814038 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:24.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.408+0000 7fa596d9d640 1 --2- 172.21.15.6:0/1887814038 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa598070330 0x7fa598070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:24.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.408+0000 7fa59659c640 1 --2- 172.21.15.6:0/1887814038 >> v2:172.21.15.161:3300/0 conn(0x7fa598069430 0x7fa5980cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:24.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.408+0000 7fa595d9b640 1 -- 172.21.15.6:0/1887814038 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa598070330 msgr2=0x7fa598070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:24.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.408+0000 7fa595d9b640 1 --2- 172.21.15.6:0/1887814038 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa598070330 0x7fa598070790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:24.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.408+0000 7fa595d9b640 1 -- 172.21.15.6:0/1887814038 >> v2:172.21.15.161:3300/0 conn(0x7fa598069430 msgr2=0x7fa5980cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:24.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.408+0000 7fa595d9b640 1 --2- 172.21.15.6:0/1887814038 >> v2:172.21.15.161:3300/0 conn(0x7fa598069430 0x7fa5980cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:24.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.408+0000 7fa595d9b640 1 -- 172.21.15.6:0/1887814038 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59806c7f0 con 0x7fa598160030 2023-07-21T22:57:24.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.412+0000 7fa595d9b640 1 --2- 172.21.15.6:0/1887814038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa598160030 0x7fa598069800 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7fa59806eee0 tx=0x7fa58c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da539727e2869a00 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:24.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.412+0000 7fa59559a640 1 -- 172.21.15.6:0/1887814038 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c0ab600 con 0x7fa598160030 2023-07-21T22:57:24.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.412+0000 7fa59559a640 1 -- 172.21.15.6:0/1887814038 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58c0a7050 con 0x7fa598160030 2023-07-21T22:57:24.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.412+0000 7fa59559a640 1 -- 172.21.15.6:0/1887814038 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c0ab980 con 0x7fa598160030 2023-07-21T22:57:24.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.412+0000 7fa59cdfa640 1 -- 172.21.15.6:0/1887814038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa598160030 msgr2=0x7fa598069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:24.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.412+0000 7fa59cdfa640 1 --2- 172.21.15.6:0/1887814038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa598160030 0x7fa598069800 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7fa59806eee0 tx=0x7fa58c01c440 comp rx=0 tx=0).stop 2023-07-21T22:57:24.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.412+0000 7fa59cdfa640 1 -- 172.21.15.6:0/1887814038 shutdown_connections 2023-07-21T22:57:24.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.412+0000 7fa59cdfa640 1 --2- 172.21.15.6:0/1887814038 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa598070330 0x7fa598070790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:24.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.412+0000 7fa59cdfa640 1 --2- 172.21.15.6:0/1887814038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa598160030 0x7fa598069800 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:24.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.412+0000 7fa59cdfa640 1 --2- 172.21.15.6:0/1887814038 >> v2:172.21.15.161:3300/0 conn(0x7fa598069430 0x7fa5980cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:24.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.412+0000 7fa59cdfa640 1 -- 172.21.15.6:0/1887814038 >> 172.21.15.6:0/1887814038 conn(0x7fa5980b1840 msgr2=0x7fa5980cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:24.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.412+0000 7fa59cdfa640 1 -- 172.21.15.6:0/1887814038 shutdown_connections 2023-07-21T22:57:24.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.412+0000 7fa59cdfa640 1 -- 172.21.15.6:0/1887814038 wait complete. 2023-07-21T22:57:24.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa59cdfa640 1 Processor -- start 2023-07-21T22:57:24.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa59cdfa640 1 -- start start 2023-07-21T22:57:24.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa59cdfa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa598069430 0x7fa598155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:24.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa59cdfa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa598070330 0x7fa59815bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:24.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa59cdfa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa598160030 0x7fa59814e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:24.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa59cdfa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5980b2880 con 0x7fa598160030 2023-07-21T22:57:24.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa59cdfa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa598155a50 con 0x7fa598070330 2023-07-21T22:57:24.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa59cdfa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5980b1f50 con 0x7fa598069430 2023-07-21T22:57:24.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa596d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa598160030 0x7fa59814e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:24.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa59659c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa598069430 0x7fa598155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:24.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa596d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa598160030 0x7fa59814e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37382/0 (socket says 172.21.15.6:37382) 2023-07-21T22:57:24.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa596d9d640 1 -- 172.21.15.6:0/1919130475 learned_addr learned my addr 172.21.15.6:0/1919130475 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:24.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa595d9b640 1 --2- 172.21.15.6:0/1919130475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa598070330 0x7fa59815bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:24.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa596d9d640 1 -- 172.21.15.6:0/1919130475 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa598069430 msgr2=0x7fa598155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:24.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa596d9d640 1 --2- 172.21.15.6:0/1919130475 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa598069430 0x7fa598155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:24.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa596d9d640 1 -- 172.21.15.6:0/1919130475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa598070330 msgr2=0x7fa59815bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:24.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa596d9d640 1 --2- 172.21.15.6:0/1919130475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa598070330 0x7fa59815bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:24.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa596d9d640 1 -- 172.21.15.6:0/1919130475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c0094d0 con 0x7fa598160030 2023-07-21T22:57:24.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa59659c640 1 --2- 172.21.15.6:0/1919130475 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa598069430 0x7fa598155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:24.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa596d9d640 1 --2- 172.21.15.6:0/1919130475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa598160030 0x7fa59814e070 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fa59000efc0 tx=0x7fa59000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:24.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa586ffd640 1 -- 172.21.15.6:0/1919130475 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa590009ba0 con 0x7fa598160030 2023-07-21T22:57:24.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa586ffd640 1 -- 172.21.15.6:0/1919130475 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59000f040 con 0x7fa598160030 2023-07-21T22:57:24.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa586ffd640 1 -- 172.21.15.6:0/1919130475 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5900146c0 con 0x7fa598160030 2023-07-21T22:57:24.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa59cdfa640 1 -- 172.21.15.6:0/1919130475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5980b2230 con 0x7fa598160030 2023-07-21T22:57:24.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa59cdfa640 1 -- 172.21.15.6:0/1919130475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59814e5b0 con 0x7fa598160030 2023-07-21T22:57:24.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.416+0000 7fa59cdfa640 1 -- 172.21.15.6:0/1919130475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa59815fd80 con 0x7fa598160030 2023-07-21T22:57:24.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.420+0000 7fa586ffd640 1 -- 172.21.15.6:0/1919130475 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa590014820 con 0x7fa598160030 2023-07-21T22:57:24.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.420+0000 7fa586ffd640 1 --2- 172.21.15.6:0/1919130475 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa5780663d0 0x7fa578068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:24.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.420+0000 7fa586ffd640 1 -- 172.21.15.6:0/1919130475 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fa5900849d0 con 0x7fa598160030 2023-07-21T22:57:24.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.420+0000 7fa59659c640 1 --2- 172.21.15.6:0/1919130475 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa5780663d0 0x7fa578068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:24.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.420+0000 7fa59659c640 1 --2- 172.21.15.6:0/1919130475 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa5780663d0 0x7fa578068880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa598157760 tx=0x7fa588009190 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:24.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.424+0000 7fa586ffd640 1 -- 172.21.15.6:0/1919130475 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa590051bf0 con 0x7fa598160030 2023-07-21T22:57:24.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:24.612+0000 7fa59cdfa640 1 -- 172.21.15.6:0/1919130475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa5980678d0 con 0x7fa598160030 2023-07-21T22:57:25.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.520+0000 7fa586ffd640 1 -- 172.21.15.6:0/1919130475 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v85) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa5900180b0 con 0x7fa598160030 2023-07-21T22:57:25.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.520+0000 7fa59cdfa640 1 -- 172.21.15.6:0/1919130475 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa5780663d0 msgr2=0x7fa578068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:25.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.520+0000 7fa59cdfa640 1 --2- 172.21.15.6:0/1919130475 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa5780663d0 0x7fa578068880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa598157760 tx=0x7fa588009190 comp rx=0 tx=0).stop 2023-07-21T22:57:25.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.520+0000 7fa59cdfa640 1 -- 172.21.15.6:0/1919130475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa598160030 msgr2=0x7fa59814e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:25.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.520+0000 7fa59cdfa640 1 --2- 172.21.15.6:0/1919130475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa598160030 0x7fa59814e070 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fa59000efc0 tx=0x7fa59000c490 comp rx=0 tx=0).stop 2023-07-21T22:57:25.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.520+0000 7fa59cdfa640 1 -- 172.21.15.6:0/1919130475 shutdown_connections 2023-07-21T22:57:25.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.520+0000 7fa59cdfa640 1 --2- 172.21.15.6:0/1919130475 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa5780663d0 0x7fa578068880 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:25.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.520+0000 7fa59cdfa640 1 --2- 172.21.15.6:0/1919130475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa598160030 0x7fa59814e070 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:25.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.520+0000 7fa59cdfa640 1 --2- 172.21.15.6:0/1919130475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa598070330 0x7fa59815bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:25.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.520+0000 7fa59cdfa640 1 --2- 172.21.15.6:0/1919130475 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa598069430 0x7fa598155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:25.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.520+0000 7fa59cdfa640 1 -- 172.21.15.6:0/1919130475 >> 172.21.15.6:0/1919130475 conn(0x7fa5980b1840 msgr2=0x7fa5980cb0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:25.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.520+0000 7fa59cdfa640 1 -- 172.21.15.6:0/1919130475 shutdown_connections 2023-07-21T22:57:25.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.520+0000 7fa59cdfa640 1 -- 172.21.15.6:0/1919130475 wait complete. 2023-07-21T22:57:25.580 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-21T22:57:25.581 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-21T22:57:25.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.696+0000 7f6b68d40640 1 Processor -- start 2023-07-21T22:57:25.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.696+0000 7f6b68d40640 1 -- start start 2023-07-21T22:57:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.700+0000 7f6b68d40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b64069430 0x7f6b64069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.700+0000 7f6b68d40640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6b640af2b0 0x7f6b6415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.700+0000 7f6b68d40640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b64159d70 con 0x7f6b64070f30 2023-07-21T22:57:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.700+0000 7f6b68d40640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b64069d40 con 0x7f6b640af2b0 2023-07-21T22:57:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.700+0000 7f6b68d40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b640c9c60 con 0x7f6b64069430 2023-07-21T22:57:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.700+0000 7f6b62d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6b640af2b0 0x7f6b6415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.700+0000 7f6b62d9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6b640af2b0 0x7f6b6415a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37386/0 (socket says 172.21.15.6:37386) 2023-07-21T22:57:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.700+0000 7f6b62d9d640 1 -- 172.21.15.6:0/1794831700 learned_addr learned my addr 172.21.15.6:0/1794831700 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.700+0000 7f6b6259c640 1 --2- 172.21.15.6:0/1794831700 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b64069430 0x7f6b64069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:25.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.700+0000 7f6b62d9d640 1 -- 172.21.15.6:0/1794831700 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b64069430 msgr2=0x7f6b64069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:25.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.700+0000 7f6b62d9d640 1 --2- 172.21.15.6:0/1794831700 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b64069430 0x7f6b64069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:25.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.700+0000 7f6b62d9d640 1 -- 172.21.15.6:0/1794831700 >> v1:172.21.15.161:6789/0 conn(0x7f6b64070f30 legacy=0x7f6b640ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:25.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.700+0000 7f6b62d9d640 1 -- 172.21.15.6:0/1794831700 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b640c9f40 con 0x7f6b640af2b0 2023-07-21T22:57:25.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.700+0000 7f6b62d9d640 1 --2- 172.21.15.6:0/1794831700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b640af2b0 0x7f6b6415a1f0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009e50 tx=0x7f6b5c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1ca5fd933b6220 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:25.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.700+0000 7f6b61d9b640 1 -- 172.21.15.6:0/1794831700 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c0a57f0 con 0x7f6b640af2b0 2023-07-21T22:57:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b61d9b640 1 -- 172.21.15.6:0/1794831700 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5c0a5950 con 0x7f6b640af2b0 2023-07-21T22:57:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b61d9b640 1 -- 172.21.15.6:0/1794831700 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c0a5ce0 con 0x7f6b640af2b0 2023-07-21T22:57:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b68d40640 1 -- 172.21.15.6:0/1794831700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b640af2b0 msgr2=0x7f6b6415a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b68d40640 1 --2- 172.21.15.6:0/1794831700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b640af2b0 0x7f6b6415a1f0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009e50 tx=0x7f6b5c01ca10 comp rx=0 tx=0).stop 2023-07-21T22:57:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b68d40640 1 -- 172.21.15.6:0/1794831700 shutdown_connections 2023-07-21T22:57:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b68d40640 1 --2- 172.21.15.6:0/1794831700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b640af2b0 0x7f6b6415a1f0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b68d40640 1 --2- 172.21.15.6:0/1794831700 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b64069430 0x7f6b64069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b68d40640 1 -- 172.21.15.6:0/1794831700 >> 172.21.15.6:0/1794831700 conn(0x7f6b640cde90 msgr2=0x7f6b640ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b68d40640 1 -- 172.21.15.6:0/1794831700 shutdown_connections 2023-07-21T22:57:25.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b68d40640 1 -- 172.21.15.6:0/1794831700 wait complete. 2023-07-21T22:57:25.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b68d40640 1 Processor -- start 2023-07-21T22:57:25.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b68d40640 1 -- start start 2023-07-21T22:57:25.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b68d40640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b64069430 0x7f6b640ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:25.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b68d40640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b64070f30 0x7f6b6406c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:25.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b68d40640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b640af2b0 0x7f6b6406c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:25.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b68d40640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6406b190 con 0x7f6b64070f30 2023-07-21T22:57:25.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b68d40640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6406b430 con 0x7f6b640af2b0 2023-07-21T22:57:25.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b68d40640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6406b710 con 0x7f6b64069430 2023-07-21T22:57:25.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b5bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b64070f30 0x7f6b6406c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:25.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b62d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b640af2b0 0x7f6b6406c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:25.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b5bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b64070f30 0x7f6b6406c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37402/0 (socket says 172.21.15.6:37402) 2023-07-21T22:57:25.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b5bfff640 1 -- 172.21.15.6:0/1924188405 learned_addr learned my addr 172.21.15.6:0/1924188405 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:25.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.704+0000 7f6b6259c640 1 --2- 172.21.15.6:0/1924188405 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b64069430 0x7f6b640ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:25.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.708+0000 7f6b5bfff640 1 -- 172.21.15.6:0/1924188405 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b64069430 msgr2=0x7f6b640ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:25.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.708+0000 7f6b5bfff640 1 --2- 172.21.15.6:0/1924188405 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b64069430 0x7f6b640ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:25.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.708+0000 7f6b5bfff640 1 -- 172.21.15.6:0/1924188405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b640af2b0 msgr2=0x7f6b6406c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:25.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.708+0000 7f6b5bfff640 1 --2- 172.21.15.6:0/1924188405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b640af2b0 0x7f6b6406c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:25.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.708+0000 7f6b5bfff640 1 -- 172.21.15.6:0/1924188405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c009b30 con 0x7f6b64070f30 2023-07-21T22:57:25.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.708+0000 7f6b5bfff640 1 --2- 172.21.15.6:0/1924188405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b64070f30 0x7f6b6406c1f0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00c3c0 tx=0x7f6b4c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:25.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.708+0000 7f6b5affd640 1 -- 172.21.15.6:0/1924188405 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c0052d0 con 0x7f6b64070f30 2023-07-21T22:57:25.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.708+0000 7f6b5affd640 1 -- 172.21.15.6:0/1924188405 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4c005430 con 0x7f6b64070f30 2023-07-21T22:57:25.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.708+0000 7f6b68d40640 1 -- 172.21.15.6:0/1924188405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6406b9f0 con 0x7f6b64070f30 2023-07-21T22:57:25.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.708+0000 7f6b5affd640 1 -- 172.21.15.6:0/1924188405 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c003840 con 0x7f6b64070f30 2023-07-21T22:57:25.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.708+0000 7f6b68d40640 1 -- 172.21.15.6:0/1924188405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b640abdd0 con 0x7f6b64070f30 2023-07-21T22:57:25.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.708+0000 7f6b68d40640 1 -- 172.21.15.6:0/1924188405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b640ac020 con 0x7f6b64070f30 2023-07-21T22:57:25.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.708+0000 7f6b5affd640 1 -- 172.21.15.6:0/1924188405 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6b4c0039a0 con 0x7f6b64070f30 2023-07-21T22:57:25.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.708+0000 7f6b5affd640 1 --2- 172.21.15.6:0/1924188405 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f6b440663d0 0x7f6b44068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:25.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.712+0000 7f6b5affd640 1 -- 172.21.15.6:0/1924188405 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f6b4c0831f0 con 0x7f6b64070f30 2023-07-21T22:57:25.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.712+0000 7f6b6259c640 1 --2- 172.21.15.6:0/1924188405 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f6b440663d0 0x7f6b44068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:25.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.712+0000 7f6b6259c640 1 --2- 172.21.15.6:0/1924188405 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f6b440663d0 0x7f6b44068880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b540079c0 tx=0x7f6b54008040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:25.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.712+0000 7f6b5affd640 1 -- 172.21.15.6:0/1924188405 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6b4c050520 con 0x7f6b64070f30 2023-07-21T22:57:25.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:25.904+0000 7f6b68d40640 1 -- 172.21.15.6:0/1924188405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6b64159d70 con 0x7f6b64070f30 2023-07-21T22:57:26.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.520+0000 7f6b5affd640 1 -- 172.21.15.6:0/1924188405 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v86) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6b64159d70 con 0x7f6b64070f30 2023-07-21T22:57:26.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.524+0000 7f6b68d40640 1 -- 172.21.15.6:0/1924188405 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f6b440663d0 msgr2=0x7f6b44068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:26.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.524+0000 7f6b68d40640 1 --2- 172.21.15.6:0/1924188405 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f6b440663d0 0x7f6b44068880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b540079c0 tx=0x7f6b54008040 comp rx=0 tx=0).stop 2023-07-21T22:57:26.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.524+0000 7f6b68d40640 1 -- 172.21.15.6:0/1924188405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b64070f30 msgr2=0x7f6b6406c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:26.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.524+0000 7f6b68d40640 1 --2- 172.21.15.6:0/1924188405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b64070f30 0x7f6b6406c1f0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00c3c0 tx=0x7f6b4c00c880 comp rx=0 tx=0).stop 2023-07-21T22:57:26.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.524+0000 7f6b68d40640 1 -- 172.21.15.6:0/1924188405 shutdown_connections 2023-07-21T22:57:26.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.524+0000 7f6b68d40640 1 --2- 172.21.15.6:0/1924188405 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f6b440663d0 0x7f6b44068880 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:26.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.524+0000 7f6b68d40640 1 --2- 172.21.15.6:0/1924188405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b640af2b0 0x7f6b6406c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:26.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.524+0000 7f6b68d40640 1 --2- 172.21.15.6:0/1924188405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b64070f30 0x7f6b6406c1f0 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:26.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.524+0000 7f6b68d40640 1 --2- 172.21.15.6:0/1924188405 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b64069430 0x7f6b640ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:26.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.524+0000 7f6b68d40640 1 -- 172.21.15.6:0/1924188405 >> 172.21.15.6:0/1924188405 conn(0x7f6b640cde90 msgr2=0x7f6b64155a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:26.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.524+0000 7f6b68d40640 1 -- 172.21.15.6:0/1924188405 shutdown_connections 2023-07-21T22:57:26.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.524+0000 7f6b68d40640 1 -- 172.21.15.6:0/1924188405 wait complete. 2023-07-21T22:57:26.582 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-21T22:57:26.582 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:57:26.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.696+0000 7f6e82c68640 1 Processor -- start 2023-07-21T22:57:26.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.696+0000 7f6e82c68640 1 -- start start 2023-07-21T22:57:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.696+0000 7f6e82c68640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e7c15f3f0 0x7f6e7c0b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.696+0000 7f6e82c68640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6e7c0b7bc0 0x7f6e7c0cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.696+0000 7f6e82c68640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e7c0d0f60 con 0x7f6e7c0d13f0 2023-07-21T22:57:26.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.696+0000 7f6e82c68640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e7c0b7ff0 con 0x7f6e7c0b7bc0 2023-07-21T22:57:26.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.696+0000 7f6e82c68640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c0d0390 con 0x7f6e7c15f3f0 2023-07-21T22:57:26.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.696+0000 7f6e81465640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6e7c0d13f0 0x7f6e7c0cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53530/0 (socket says 172.21.15.6:53530) 2023-07-21T22:57:26.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.696+0000 7f6e81465640 1 -- 172.21.15.6:0/1872485389 learned_addr learned my addr 172.21.15.6:0/1872485389 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:26.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.696+0000 7f6e82467640 1 --2- 172.21.15.6:0/1872485389 >> v2:172.21.15.161:3300/0 conn(0x7f6e7c0b7bc0 0x7f6e7c0cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:26.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.696+0000 7f6e81c66640 1 --2- 172.21.15.6:0/1872485389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e7c15f3f0 0x7f6e7c0b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:26.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.696+0000 7f6e80c64640 1 -- 172.21.15.6:0/1872485389 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144135659 0 0) 0x7f6e7c0d0f60 con 0x7f6e7c0d13f0 2023-07-21T22:57:26.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.696+0000 7f6e80c64640 1 -- 172.21.15.6:0/1872485389 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e68003530 con 0x7f6e7c0d13f0 2023-07-21T22:57:26.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.696+0000 7f6e80c64640 1 -- 172.21.15.6:0/1872485389 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3689336416 0 0) 0x7f6e68003530 con 0x7f6e7c0d13f0 2023-07-21T22:57:26.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.696+0000 7f6e82467640 1 -- 172.21.15.6:0/1872485389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e7c15f3f0 msgr2=0x7f6e7c0b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.696+0000 7f6e82467640 1 --2- 172.21.15.6:0/1872485389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e7c15f3f0 0x7f6e7c0b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.696+0000 7f6e82467640 1 -- 172.21.15.6:0/1872485389 >> v1:172.21.15.6:6789/0 conn(0x7f6e7c0d13f0 legacy=0x7f6e7c0cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.696+0000 7f6e82467640 1 -- 172.21.15.6:0/1872485389 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7c0d0630 con 0x7f6e7c0b7bc0 2023-07-21T22:57:26.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.700+0000 7f6e82467640 1 --2- 172.21.15.6:0/1872485389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e7c0b7bc0 0x7f6e7c0cd0b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009d90 tx=0x7f6e7401c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3599129cd2f8b5d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.700+0000 7f6e80c64640 1 -- 172.21.15.6:0/1872485389 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c001680 con 0x7f6e7c0b7bc0 2023-07-21T22:57:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.700+0000 7f6e80c64640 1 -- 172.21.15.6:0/1872485389 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e740a64e0 con 0x7f6e7c0b7bc0 2023-07-21T22:57:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.700+0000 7f6e80c64640 1 -- 172.21.15.6:0/1872485389 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e740a6870 con 0x7f6e7c0b7bc0 2023-07-21T22:57:26.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.700+0000 7f6e82c68640 1 -- 172.21.15.6:0/1872485389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e7c0b7bc0 msgr2=0x7f6e7c0cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.700+0000 7f6e82c68640 1 --2- 172.21.15.6:0/1872485389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e7c0b7bc0 0x7f6e7c0cd0b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f6e74009d90 tx=0x7f6e7401c7e0 comp rx=0 tx=0).stop 2023-07-21T22:57:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.700+0000 7f6e82c68640 1 -- 172.21.15.6:0/1872485389 shutdown_connections 2023-07-21T22:57:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.700+0000 7f6e82c68640 1 --2- 172.21.15.6:0/1872485389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e7c0b7bc0 0x7f6e7c0cd0b0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.700+0000 7f6e82c68640 1 --2- 172.21.15.6:0/1872485389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e7c15f3f0 0x7f6e7c0b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.700+0000 7f6e82c68640 1 -- 172.21.15.6:0/1872485389 >> 172.21.15.6:0/1872485389 conn(0x7f6e7c069f50 msgr2=0x7f6e7c06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:26.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.700+0000 7f6e82c68640 1 -- 172.21.15.6:0/1872485389 shutdown_connections 2023-07-21T22:57:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.700+0000 7f6e82c68640 1 -- 172.21.15.6:0/1872485389 wait complete. 2023-07-21T22:57:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e82c68640 1 Processor -- start 2023-07-21T22:57:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e82c68640 1 -- start start 2023-07-21T22:57:26.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e82c68640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e7c0b7bc0 0x7f6e7c14a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:26.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e82c68640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e7c0d13f0 0x7f6e7c0b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:26.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e82c68640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e7c15f3f0 0x7f6e7c0b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e82c68640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c14aaa0 con 0x7f6e7c15f3f0 2023-07-21T22:57:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e82c68640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c160720 con 0x7f6e7c0b7bc0 2023-07-21T22:57:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e82c68640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c160a00 con 0x7f6e7c0d13f0 2023-07-21T22:57:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e82467640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e7c15f3f0 0x7f6e7c0b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e82467640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e7c15f3f0 0x7f6e7c0b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37418/0 (socket says 172.21.15.6:37418) 2023-07-21T22:57:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e82467640 1 -- 172.21.15.6:0/2902547310 learned_addr learned my addr 172.21.15.6:0/2902547310 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:26.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e81c66640 1 --2- 172.21.15.6:0/2902547310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e7c0b7bc0 0x7f6e7c14a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:26.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e81465640 1 --2- 172.21.15.6:0/2902547310 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e7c0d13f0 0x7f6e7c0b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:26.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e82467640 1 -- 172.21.15.6:0/2902547310 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e7c0d13f0 msgr2=0x7f6e7c0b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:26.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e82467640 1 --2- 172.21.15.6:0/2902547310 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e7c0d13f0 0x7f6e7c0b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:26.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e82467640 1 -- 172.21.15.6:0/2902547310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e7c0b7bc0 msgr2=0x7f6e7c14a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:26.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e82467640 1 --2- 172.21.15.6:0/2902547310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e7c0b7bc0 0x7f6e7c14a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:26.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e82467640 1 -- 172.21.15.6:0/2902547310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e74009a70 con 0x7f6e7c15f3f0 2023-07-21T22:57:26.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e82467640 1 --2- 172.21.15.6:0/2902547310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e7c15f3f0 0x7f6e7c0b2060 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f6e740b0040 tx=0x7f6e74019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:26.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e727fc640 1 -- 172.21.15.6:0/2902547310 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e740b8630 con 0x7f6e7c15f3f0 2023-07-21T22:57:26.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e727fc640 1 -- 172.21.15.6:0/2902547310 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e740b87b0 con 0x7f6e7c15f3f0 2023-07-21T22:57:26.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e727fc640 1 -- 172.21.15.6:0/2902547310 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e740b8b60 con 0x7f6e7c15f3f0 2023-07-21T22:57:26.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e82c68640 1 -- 172.21.15.6:0/2902547310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e7c160ce0 con 0x7f6e7c15f3f0 2023-07-21T22:57:26.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e82c68640 1 -- 172.21.15.6:0/2902547310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e7c1612a0 con 0x7f6e7c15f3f0 2023-07-21T22:57:26.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.704+0000 7f6e82c68640 1 -- 172.21.15.6:0/2902547310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e7c161490 con 0x7f6e7c15f3f0 2023-07-21T22:57:26.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.708+0000 7f6e727fc640 1 -- 172.21.15.6:0/2902547310 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6e740b8cc0 con 0x7f6e7c15f3f0 2023-07-21T22:57:26.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.708+0000 7f6e727fc640 1 --2- 172.21.15.6:0/2902547310 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f6e600663a0 0x7f6e60068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:26.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.708+0000 7f6e727fc640 1 -- 172.21.15.6:0/2902547310 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f6e740aa070 con 0x7f6e7c15f3f0 2023-07-21T22:57:26.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.708+0000 7f6e81c66640 1 --2- 172.21.15.6:0/2902547310 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f6e600663a0 0x7f6e60068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:26.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.708+0000 7f6e81c66640 1 --2- 172.21.15.6:0/2902547310 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f6e600663a0 0x7f6e60068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6e78009ac0 tx=0x7f6e78009190 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:26.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.712+0000 7f6e727fc640 1 -- 172.21.15.6:0/2902547310 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6e740ec640 con 0x7f6e7c15f3f0 2023-07-21T22:57:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.900+0000 7f6e82c68640 1 -- 172.21.15.6:0/2902547310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e7c0678d0 con 0x7f6e7c15f3f0 2023-07-21T22:57:26.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.900+0000 7f6e727fc640 1 -- 172.21.15.6:0/2902547310 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4667 (secure 0 0 0) 0x7f6e740efc60 con 0x7f6e7c15f3f0 2023-07-21T22:57:26.936 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:26.936 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8765,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/617196146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":617196146},{"type":"v1","addr":"172.21.15.161:6836","nonce":617196146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9976,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/618083440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":618083440},{"type":"v1","addr":"172.21.15.161:6837","nonce":618083440}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":10503,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/205515898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":205515898},{"type":"v1","addr":"172.21.15.6:6834","nonce":205515898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:57:22.895862+0000","modified":"2023-07-21T22:57:26.519881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10506":{"gid":10506,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/963904366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":963904366},{"type":"v1","addr":"172.21.15.6:6835","nonce":963904366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-21T22:57:26.937 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 86 2023-07-21T22:57:26.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.904+0000 7f6e82c68640 1 -- 172.21.15.6:0/2902547310 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f6e600663a0 msgr2=0x7f6e60068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:26.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.904+0000 7f6e82c68640 1 --2- 172.21.15.6:0/2902547310 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f6e600663a0 0x7f6e60068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6e78009ac0 tx=0x7f6e78009190 comp rx=0 tx=0).stop 2023-07-21T22:57:26.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.904+0000 7f6e82c68640 1 -- 172.21.15.6:0/2902547310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e7c15f3f0 msgr2=0x7f6e7c0b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:26.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.904+0000 7f6e82c68640 1 --2- 172.21.15.6:0/2902547310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e7c15f3f0 0x7f6e7c0b2060 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f6e740b0040 tx=0x7f6e74019580 comp rx=0 tx=0).stop 2023-07-21T22:57:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.904+0000 7f6e82c68640 1 -- 172.21.15.6:0/2902547310 shutdown_connections 2023-07-21T22:57:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.904+0000 7f6e82c68640 1 --2- 172.21.15.6:0/2902547310 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f6e600663a0 0x7f6e60068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.904+0000 7f6e82c68640 1 --2- 172.21.15.6:0/2902547310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e7c15f3f0 0x7f6e7c0b2060 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.904+0000 7f6e82c68640 1 --2- 172.21.15.6:0/2902547310 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6e7c0d13f0 0x7f6e7c0b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.904+0000 7f6e82c68640 1 --2- 172.21.15.6:0/2902547310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6e7c0b7bc0 0x7f6e7c14a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.904+0000 7f6e82c68640 1 -- 172.21.15.6:0/2902547310 >> 172.21.15.6:0/2902547310 conn(0x7f6e7c069f50 msgr2=0x7f6e7c0b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.904+0000 7f6e82c68640 1 -- 172.21.15.6:0/2902547310 shutdown_connections 2023-07-21T22:57:26.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:26.904+0000 7f6e82c68640 1 -- 172.21.15.6:0/2902547310 wait complete. 2023-07-21T22:57:26.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:57:27.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.068+0000 7fa63f59e640 1 Processor -- start 2023-07-21T22:57:27.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.068+0000 7fa63f59e640 1 -- start start 2023-07-21T22:57:27.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.068+0000 7fa63f59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa64015f3f0 0x7fa6400b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:27.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.068+0000 7fa63f59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa6400d13f0 0x7fa6400b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:27.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.068+0000 7fa63f59e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa6400cc9a0 0x7fa6400ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:27.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.068+0000 7fa63f59e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6400d0f60 con 0x7fa6400cc9a0 2023-07-21T22:57:27.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.068+0000 7fa63f59e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6400d0390 con 0x7fa6400d13f0 2023-07-21T22:57:27.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.068+0000 7fa63f59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6400d0630 con 0x7fa64015f3f0 2023-07-21T22:57:27.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.068+0000 7fa63ed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa6400cc9a0 0x7fa6400ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:27.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.068+0000 7fa63ed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa6400cc9a0 0x7fa6400ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37426/0 (socket says 172.21.15.6:37426) 2023-07-21T22:57:27.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.068+0000 7fa63ed9d640 1 -- 172.21.15.6:0/4022692529 learned_addr learned my addr 172.21.15.6:0/4022692529 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:27.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.068+0000 7fa637fff640 1 --2- 172.21.15.6:0/4022692529 >> v2:172.21.15.161:3300/0 conn(0x7fa6400d13f0 0x7fa6400b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:27.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.068+0000 7fa63e59c640 1 --2- 172.21.15.6:0/4022692529 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa64015f3f0 0x7fa6400b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:27.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.068+0000 7fa63ed9d640 1 -- 172.21.15.6:0/4022692529 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa64015f3f0 msgr2=0x7fa6400b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:27.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.068+0000 7fa63ed9d640 1 --2- 172.21.15.6:0/4022692529 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa64015f3f0 0x7fa6400b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.068+0000 7fa63ed9d640 1 -- 172.21.15.6:0/4022692529 >> v2:172.21.15.161:3300/0 conn(0x7fa6400d13f0 msgr2=0x7fa6400b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:27.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.068+0000 7fa63ed9d640 1 --2- 172.21.15.6:0/4022692529 >> v2:172.21.15.161:3300/0 conn(0x7fa6400d13f0 0x7fa6400b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.068+0000 7fa63ed9d640 1 -- 172.21.15.6:0/4022692529 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6400d0910 con 0x7fa6400cc9a0 2023-07-21T22:57:27.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.068+0000 7fa63e59c640 1 --2- 172.21.15.6:0/4022692529 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa64015f3f0 0x7fa6400b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:27.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.072+0000 7fa63ed9d640 1 --2- 172.21.15.6:0/4022692529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6400cc9a0 0x7fa6400ccdd0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fa640066090 tx=0x7fa63801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9eb8eddc835b212 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:27.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.072+0000 7fa63dd9b640 1 -- 172.21.15.6:0/4022692529 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6380a5640 con 0x7fa6400cc9a0 2023-07-21T22:57:27.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.072+0000 7fa63dd9b640 1 -- 172.21.15.6:0/4022692529 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6380a57a0 con 0x7fa6400cc9a0 2023-07-21T22:57:27.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.072+0000 7fa63dd9b640 1 -- 172.21.15.6:0/4022692529 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6380a5b30 con 0x7fa6400cc9a0 2023-07-21T22:57:27.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.072+0000 7fa63f59e640 1 -- 172.21.15.6:0/4022692529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6400cc9a0 msgr2=0x7fa6400ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:27.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.072+0000 7fa63f59e640 1 --2- 172.21.15.6:0/4022692529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6400cc9a0 0x7fa6400ccdd0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fa640066090 tx=0x7fa63801c940 comp rx=0 tx=0).stop 2023-07-21T22:57:27.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.072+0000 7fa63f59e640 1 -- 172.21.15.6:0/4022692529 shutdown_connections 2023-07-21T22:57:27.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.072+0000 7fa63f59e640 1 --2- 172.21.15.6:0/4022692529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6400cc9a0 0x7fa6400ccdd0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.072+0000 7fa63f59e640 1 --2- 172.21.15.6:0/4022692529 >> v2:172.21.15.161:3300/0 conn(0x7fa6400d13f0 0x7fa6400b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.072+0000 7fa63f59e640 1 --2- 172.21.15.6:0/4022692529 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa64015f3f0 0x7fa6400b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.072+0000 7fa63f59e640 1 -- 172.21.15.6:0/4022692529 >> 172.21.15.6:0/4022692529 conn(0x7fa640069f50 msgr2=0x7fa64006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:27.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.072+0000 7fa63f59e640 1 -- 172.21.15.6:0/4022692529 shutdown_connections 2023-07-21T22:57:27.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.072+0000 7fa63f59e640 1 -- 172.21.15.6:0/4022692529 wait complete. 2023-07-21T22:57:27.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63f59e640 1 Processor -- start 2023-07-21T22:57:27.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63f59e640 1 -- start start 2023-07-21T22:57:27.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63f59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6400cc9a0 0x7fa640158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:27.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63f59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6400d13f0 0x7fa6401516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:27.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63f59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa64015f3f0 0x7fa6400cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:27.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63f59e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6400c9290 con 0x7fa64015f3f0 2023-07-21T22:57:27.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63f59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6400c9530 con 0x7fa6400cc9a0 2023-07-21T22:57:27.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63f59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6400c9810 con 0x7fa6400d13f0 2023-07-21T22:57:27.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa64015f3f0 0x7fa6400cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:27.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa64015f3f0 0x7fa6400cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37430/0 (socket says 172.21.15.6:37430) 2023-07-21T22:57:27.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63ed9d640 1 -- 172.21.15.6:0/3101345967 learned_addr learned my addr 172.21.15.6:0/3101345967 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:27.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa637fff640 1 --2- 172.21.15.6:0/3101345967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6400d13f0 0x7fa6401516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:27.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63e59c640 1 --2- 172.21.15.6:0/3101345967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6400cc9a0 0x7fa640158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:27.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63ed9d640 1 -- 172.21.15.6:0/3101345967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6400d13f0 msgr2=0x7fa6401516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:27.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63ed9d640 1 --2- 172.21.15.6:0/3101345967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6400d13f0 0x7fa6401516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63ed9d640 1 -- 172.21.15.6:0/3101345967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6400cc9a0 msgr2=0x7fa640158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:27.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63ed9d640 1 --2- 172.21.15.6:0/3101345967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6400cc9a0 0x7fa640158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63ed9d640 1 -- 172.21.15.6:0/3101345967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa638009b30 con 0x7fa64015f3f0 2023-07-21T22:57:27.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63e59c640 1 --2- 172.21.15.6:0/3101345967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6400cc9a0 0x7fa640158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:27.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa637fff640 1 --2- 172.21.15.6:0/3101345967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6400d13f0 0x7fa6401516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:27.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63ed9d640 1 --2- 172.21.15.6:0/3101345967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa64015f3f0 0x7fa6400cba20 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fa6380af040 tx=0x7fa6380196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:27.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa636ffd640 1 -- 172.21.15.6:0/3101345967 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6380b8670 con 0x7fa64015f3f0 2023-07-21T22:57:27.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa636ffd640 1 -- 172.21.15.6:0/3101345967 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6380b87d0 con 0x7fa64015f3f0 2023-07-21T22:57:27.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa636ffd640 1 -- 172.21.15.6:0/3101345967 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6380b8b80 con 0x7fa64015f3f0 2023-07-21T22:57:27.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63f59e640 1 -- 172.21.15.6:0/3101345967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6400c9af0 con 0x7fa64015f3f0 2023-07-21T22:57:27.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63f59e640 1 -- 172.21.15.6:0/3101345967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6400ca0b0 con 0x7fa64015f3f0 2023-07-21T22:57:27.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.076+0000 7fa63f59e640 1 -- 172.21.15.6:0/3101345967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6400678d0 con 0x7fa64015f3f0 2023-07-21T22:57:27.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.080+0000 7fa636ffd640 1 -- 172.21.15.6:0/3101345967 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa6380b8ce0 con 0x7fa64015f3f0 2023-07-21T22:57:27.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.080+0000 7fa636ffd640 1 --2- 172.21.15.6:0/3101345967 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa6200663a0 0x7fa620068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:27.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.080+0000 7fa636ffd640 1 -- 172.21.15.6:0/3101345967 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fa63811f400 con 0x7fa64015f3f0 2023-07-21T22:57:27.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.080+0000 7fa63e59c640 1 --2- 172.21.15.6:0/3101345967 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa6200663a0 0x7fa620068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:27.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.080+0000 7fa63e59c640 1 --2- 172.21.15.6:0/3101345967 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa6200663a0 0x7fa620068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa6401549c0 tx=0x7fa630008040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:27.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.084+0000 7fa636ffd640 1 -- 172.21.15.6:0/3101345967 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa6380ec800 con 0x7fa64015f3f0 2023-07-21T22:57:27.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.244+0000 7fa63f59e640 1 -- 172.21.15.6:0/3101345967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6400b7e60 con 0x7fa64015f3f0 2023-07-21T22:57:27.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.244+0000 7fa636ffd640 1 -- 172.21.15.6:0/3101345967 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+18336 (secure 0 0 0) 0x7fa638009510 con 0x7fa64015f3f0 2023-07-21T22:57:27.280 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:27.280 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":192,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:57:24.268905+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:57:21.014468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-21T22:57:21.883517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:57:27.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.244+0000 7fa63f59e640 1 -- 172.21.15.6:0/3101345967 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa6200663a0 msgr2=0x7fa620068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:27.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.244+0000 7fa63f59e640 1 --2- 172.21.15.6:0/3101345967 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa6200663a0 0x7fa620068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa6401549c0 tx=0x7fa630008040 comp rx=0 tx=0).stop 2023-07-21T22:57:27.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.244+0000 7fa63f59e640 1 -- 172.21.15.6:0/3101345967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa64015f3f0 msgr2=0x7fa6400cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:27.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.244+0000 7fa63f59e640 1 --2- 172.21.15.6:0/3101345967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa64015f3f0 0x7fa6400cba20 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fa6380af040 tx=0x7fa6380196e0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.244+0000 7fa63f59e640 1 -- 172.21.15.6:0/3101345967 shutdown_connections 2023-07-21T22:57:27.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.244+0000 7fa63f59e640 1 --2- 172.21.15.6:0/3101345967 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa6200663a0 0x7fa620068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.244+0000 7fa63f59e640 1 --2- 172.21.15.6:0/3101345967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa64015f3f0 0x7fa6400cba20 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.244+0000 7fa63f59e640 1 --2- 172.21.15.6:0/3101345967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6400d13f0 0x7fa6401516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.248+0000 7fa63f59e640 1 --2- 172.21.15.6:0/3101345967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6400cc9a0 0x7fa640158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.248+0000 7fa63f59e640 1 -- 172.21.15.6:0/3101345967 >> 172.21.15.6:0/3101345967 conn(0x7fa640069f50 msgr2=0x7fa64015b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:27.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.248+0000 7fa63f59e640 1 -- 172.21.15.6:0/3101345967 shutdown_connections 2023-07-21T22:57:27.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.248+0000 7fa63f59e640 1 -- 172.21.15.6:0/3101345967 wait complete. 2023-07-21T22:57:27.302 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T22:57:27.302 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:57:27.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.412+0000 7fde9c503640 1 Processor -- start 2023-07-21T22:57:27.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.412+0000 7fde9c503640 1 -- start start 2023-07-21T22:57:27.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.412+0000 7fde9c503640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fde940d22e0 0x7fde940d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:27.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.412+0000 7fde9c503640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde940b2140 con 0x7fde94145430 2023-07-21T22:57:27.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.412+0000 7fde9c503640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde940b2410 con 0x7fde940d06b0 2023-07-21T22:57:27.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.412+0000 7fde9c503640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde940d2cc0 con 0x7fde940d22e0 2023-07-21T22:57:27.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.412+0000 7fde9aaa0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fde940d22e0 0x7fde940d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:27.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.412+0000 7fde99a9e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fde94145430 0x7fde940b34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:53542/0 (socket says 172.21.15.6:53542) 2023-07-21T22:57:27.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.412+0000 7fde99a9e640 1 -- 172.21.15.6:0/734359002 learned_addr learned my addr 172.21.15.6:0/734359002 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:27.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.412+0000 7fde9aaa0640 1 -- 172.21.15.6:0/734359002 >> v1:172.21.15.161:6789/0 conn(0x7fde940d06b0 legacy=0x7fde940b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:27.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.412+0000 7fde9aaa0640 1 -- 172.21.15.6:0/734359002 >> v1:172.21.15.6:6789/0 conn(0x7fde94145430 legacy=0x7fde940b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:27.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.412+0000 7fde9aaa0640 1 -- 172.21.15.6:0/734359002 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde940b26f0 con 0x7fde940d22e0 2023-07-21T22:57:27.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.416+0000 7fde9aaa0640 1 --2- 172.21.15.6:0/734359002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde940d22e0 0x7fde940d2780 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009d90 tx=0x7fde8c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d86783a6864db018 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:27.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.416+0000 7fde9929d640 1 -- 172.21.15.6:0/734359002 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c0a59e0 con 0x7fde940d22e0 2023-07-21T22:57:27.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.416+0000 7fde9929d640 1 -- 172.21.15.6:0/734359002 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8c0a5b40 con 0x7fde940d22e0 2023-07-21T22:57:27.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.416+0000 7fde9929d640 1 -- 172.21.15.6:0/734359002 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c0ad440 con 0x7fde940d22e0 2023-07-21T22:57:27.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.416+0000 7fde9c503640 1 -- 172.21.15.6:0/734359002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde940d22e0 msgr2=0x7fde940d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:27.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.416+0000 7fde9c503640 1 --2- 172.21.15.6:0/734359002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde940d22e0 0x7fde940d2780 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009d90 tx=0x7fde8c01c920 comp rx=0 tx=0).stop 2023-07-21T22:57:27.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.416+0000 7fde9c503640 1 -- 172.21.15.6:0/734359002 shutdown_connections 2023-07-21T22:57:27.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.416+0000 7fde9c503640 1 --2- 172.21.15.6:0/734359002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde940d22e0 0x7fde940d2780 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.416+0000 7fde9c503640 1 -- 172.21.15.6:0/734359002 >> 172.21.15.6:0/734359002 conn(0x7fde940659d0 msgr2=0x7fde9409b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:27.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.416+0000 7fde9c503640 1 -- 172.21.15.6:0/734359002 shutdown_connections 2023-07-21T22:57:27.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.416+0000 7fde9c503640 1 -- 172.21.15.6:0/734359002 wait complete. 2023-07-21T22:57:27.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde9c503640 1 Processor -- start 2023-07-21T22:57:27.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde9c503640 1 -- start start 2023-07-21T22:57:27.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde9c503640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde940d06b0 0x7fde940cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:27.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde9c503640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde940d22e0 0x7fde940ce070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:27.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde9c503640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde940b5d50 0x7fde940cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:27.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde9c503640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde940ccfd0 con 0x7fde940b5d50 2023-07-21T22:57:27.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde9c503640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde940cd2b0 con 0x7fde940d22e0 2023-07-21T22:57:27.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde9c503640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde940cd590 con 0x7fde940d06b0 2023-07-21T22:57:27.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde9aaa0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde940b5d50 0x7fde940cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:27.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde9aaa0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde940b5d50 0x7fde940cefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38914/0 (socket says 172.21.15.6:38914) 2023-07-21T22:57:27.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde9aaa0640 1 -- 172.21.15.6:0/1052618879 learned_addr learned my addr 172.21.15.6:0/1052618879 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:27.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde99a9e640 1 --2- 172.21.15.6:0/1052618879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde940d22e0 0x7fde940ce070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:27.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde9a29f640 1 --2- 172.21.15.6:0/1052618879 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde940d06b0 0x7fde940cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:27.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde9aaa0640 1 -- 172.21.15.6:0/1052618879 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde940d06b0 msgr2=0x7fde940cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:27.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde9aaa0640 1 --2- 172.21.15.6:0/1052618879 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde940d06b0 0x7fde940cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde9aaa0640 1 -- 172.21.15.6:0/1052618879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde940d22e0 msgr2=0x7fde940ce070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:27.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde9aaa0640 1 --2- 172.21.15.6:0/1052618879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde940d22e0 0x7fde940ce070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde9aaa0640 1 -- 172.21.15.6:0/1052618879 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8c009a70 con 0x7fde940b5d50 2023-07-21T22:57:27.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde9aaa0640 1 --2- 172.21.15.6:0/1052618879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde940b5d50 0x7fde940cefd0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fde8c0b0040 tx=0x7fde8c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:27.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde8affd640 1 -- 172.21.15.6:0/1052618879 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c0ade40 con 0x7fde940b5d50 2023-07-21T22:57:27.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde8affd640 1 -- 172.21.15.6:0/1052618879 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8c0b9450 con 0x7fde940b5d50 2023-07-21T22:57:27.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde8affd640 1 -- 172.21.15.6:0/1052618879 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8c0b9800 con 0x7fde940b5d50 2023-07-21T22:57:27.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde9c503640 1 -- 172.21.15.6:0/1052618879 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde940cd870 con 0x7fde940b5d50 2023-07-21T22:57:27.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.420+0000 7fde9c503640 1 -- 172.21.15.6:0/1052618879 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde940b61d0 con 0x7fde940b5d50 2023-07-21T22:57:27.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.424+0000 7fde9c503640 1 -- 172.21.15.6:0/1052618879 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde940678d0 con 0x7fde940b5d50 2023-07-21T22:57:27.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.424+0000 7fde8affd640 1 -- 172.21.15.6:0/1052618879 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fde8c0b9960 con 0x7fde940b5d50 2023-07-21T22:57:27.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.424+0000 7fde8affd640 1 --2- 172.21.15.6:0/1052618879 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fde780663a0 0x7fde78068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:27.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.424+0000 7fde8affd640 1 -- 172.21.15.6:0/1052618879 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fde8c11f790 con 0x7fde940b5d50 2023-07-21T22:57:27.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.424+0000 7fde9a29f640 1 --2- 172.21.15.6:0/1052618879 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fde780663a0 0x7fde78068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:27.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.424+0000 7fde9a29f640 1 --2- 172.21.15.6:0/1052618879 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fde780663a0 0x7fde78068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fde90000f70 tx=0x7fde90009040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:27.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.428+0000 7fde8affd640 1 -- 172.21.15.6:0/1052618879 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fde8c0ecc80 con 0x7fde940b5d50 2023-07-21T22:57:27.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.580+0000 7fde9c503640 1 -- 172.21.15.6:0/1052618879 --> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde940b2f90 con 0x7fde780663a0 2023-07-21T22:57:27.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.592+0000 7fde8affd640 1 -- 172.21.15.6:0/1052618879 <== mgr.9760 v2:172.21.15.161:6832/406143921 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306209 (secure 0 0 0) 0x7fde90001380 con 0x7fde780663a0 2023-07-21T22:57:27.628 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:27.630 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:57:27.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.592+0000 7fde9c503640 1 -- 172.21.15.6:0/1052618879 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fde780663a0 msgr2=0x7fde78068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:27.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.592+0000 7fde9c503640 1 --2- 172.21.15.6:0/1052618879 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fde780663a0 0x7fde78068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fde90000f70 tx=0x7fde90009040 comp rx=0 tx=0).stop 2023-07-21T22:57:27.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.592+0000 7fde9c503640 1 -- 172.21.15.6:0/1052618879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde940b5d50 msgr2=0x7fde940cefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:27.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.592+0000 7fde9c503640 1 --2- 172.21.15.6:0/1052618879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde940b5d50 0x7fde940cefd0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fde8c0b0040 tx=0x7fde8c0196c0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.592+0000 7fde9c503640 1 -- 172.21.15.6:0/1052618879 shutdown_connections 2023-07-21T22:57:27.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.592+0000 7fde9c503640 1 --2- 172.21.15.6:0/1052618879 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fde780663a0 0x7fde78068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.592+0000 7fde9c503640 1 --2- 172.21.15.6:0/1052618879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde940b5d50 0x7fde940cefd0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.592+0000 7fde9c503640 1 --2- 172.21.15.6:0/1052618879 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde940d22e0 0x7fde940ce070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.592+0000 7fde9c503640 1 --2- 172.21.15.6:0/1052618879 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fde940d06b0 0x7fde940cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.592+0000 7fde9c503640 1 -- 172.21.15.6:0/1052618879 >> 172.21.15.6:0/1052618879 conn(0x7fde940659d0 msgr2=0x7fde9406a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:27.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.596+0000 7fde9c503640 1 -- 172.21.15.6:0/1052618879 shutdown_connections 2023-07-21T22:57:27.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.596+0000 7fde9c503640 1 -- 172.21.15.6:0/1052618879 wait complete. 2023-07-21T22:57:27.649 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-21T22:57:27.157054+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":363132,"kb_used_data":19644,"kb_used_omap":0,"kb_used_meta":343424,"kb_avail":754611588,"statfs":{"total":773094113280,"available":772722266112,"internally_reserved":0,"allocated":20115456,"data_stored":10903612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":351666176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.672691"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.505320+0000","last_change":"2023-07-21T22:57:22.505320+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.505320+0000","last_undegraded":"2023-07-21T22:57:22.505320+0000","last_fullsized":"2023-07-21T22:57:22.505320+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.508207+0000","last_change":"2023-07-21T22:57:22.508207+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.508207+0000","last_undegraded":"2023-07-21T22:57:22.508207+0000","last_fullsized":"2023-07-21T22:57:22.508207+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.504124+0000","last_change":"2023-07-21T22:57:22.504124+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.504124+0000","last_undegraded":"2023-07-21T22:57:22.504124+0000","last_fullsized":"2023-07-21T22:57:22.504124+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.504260+0000","last_change":"2023-07-21T22:57:22.504260+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.504260+0000","last_undegraded":"2023-07-21T22:57:22.504260+0000","last_fullsized":"2023-07-21T22:57:22.504260+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507646+0000","last_change":"2023-07-21T22:57:22.507646+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507646+0000","last_undegraded":"2023-07-21T22:57:22.507646+0000","last_fullsized":"2023-07-21T22:57:22.507646+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.506798+0000","last_change":"2023-07-21T22:57:22.506798+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.506798+0000","last_undegraded":"2023-07-21T22:57:22.506798+0000","last_fullsized":"2023-07-21T22:57:22.506798+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.502003+0000","last_change":"2023-07-21T22:57:22.502003+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.502003+0000","last_undegraded":"2023-07-21T22:57:22.502003+0000","last_fullsized":"2023-07-21T22:57:22.502003+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.502238+0000","last_change":"2023-07-21T22:57:22.502238+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.502238+0000","last_undegraded":"2023-07-21T22:57:22.502238+0000","last_fullsized":"2023-07-21T22:57:22.502238+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501753+0000","last_change":"2023-07-21T22:57:22.501753+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501753+0000","last_undegraded":"2023-07-21T22:57:22.501753+0000","last_fullsized":"2023-07-21T22:57:22.501753+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501227+0000","last_change":"2023-07-21T22:57:22.501227+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501227+0000","last_undegraded":"2023-07-21T22:57:22.501227+0000","last_fullsized":"2023-07-21T22:57:22.501227+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.503205+0000","last_change":"2023-07-21T22:57:22.503205+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.503205+0000","last_undegraded":"2023-07-21T22:57:22.503205+0000","last_fullsized":"2023-07-21T22:57:22.503205+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.508398+0000","last_change":"2023-07-21T22:57:22.508398+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.508398+0000","last_undegraded":"2023-07-21T22:57:22.508398+0000","last_fullsized":"2023-07-21T22:57:22.508398+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501674+0000","last_change":"2023-07-21T22:57:22.501674+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501674+0000","last_undegraded":"2023-07-21T22:57:22.501674+0000","last_fullsized":"2023-07-21T22:57:22.501674+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501933+0000","last_change":"2023-07-21T22:57:22.501933+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501933+0000","last_undegraded":"2023-07-21T22:57:22.501933+0000","last_fullsized":"2023-07-21T22:57:22.501933+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.502440+0000","last_change":"2023-07-21T22:57:22.502440+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.502440+0000","last_undegraded":"2023-07-21T22:57:22.502440+0000","last_fullsized":"2023-07-21T22:57:22.502440+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.504429+0000","last_change":"2023-07-21T22:57:22.504429+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.504429+0000","last_undegraded":"2023-07-21T22:57:22.504429+0000","last_fullsized":"2023-07-21T22:57:22.504429+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501213+0000","last_change":"2023-07-21T22:57:22.501213+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501213+0000","last_undegraded":"2023-07-21T22:57:22.501213+0000","last_fullsized":"2023-07-21T22:57:22.501213+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.506940+0000","last_change":"2023-07-21T22:57:22.506940+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.506940+0000","last_undegraded":"2023-07-21T22:57:22.506940+0000","last_fullsized":"2023-07-21T22:57:22.506940+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.502755+0000","last_change":"2023-07-21T22:57:22.502755+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.502755+0000","last_undegraded":"2023-07-21T22:57:22.502755+0000","last_fullsized":"2023-07-21T22:57:22.502755+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.510199+0000","last_change":"2023-07-21T22:57:22.510199+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.510199+0000","last_undegraded":"2023-07-21T22:57:22.510199+0000","last_fullsized":"2023-07-21T22:57:22.510199+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501147+0000","last_change":"2023-07-21T22:57:22.501147+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501147+0000","last_undegraded":"2023-07-21T22:57:22.501147+0000","last_fullsized":"2023-07-21T22:57:22.501147+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.506257+0000","last_change":"2023-07-21T22:57:22.506257+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.506257+0000","last_undegraded":"2023-07-21T22:57:22.506257+0000","last_fullsized":"2023-07-21T22:57:22.506257+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501209+0000","last_change":"2023-07-21T22:57:22.501209+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501209+0000","last_undegraded":"2023-07-21T22:57:22.501209+0000","last_fullsized":"2023-07-21T22:57:22.501209+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.503707+0000","last_change":"2023-07-21T22:57:22.503707+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.503707+0000","last_undegraded":"2023-07-21T22:57:22.503707+0000","last_fullsized":"2023-07-21T22:57:22.503707+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501575+0000","last_change":"2023-07-21T22:57:22.501575+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501575+0000","last_undegraded":"2023-07-21T22:57:22.501575+0000","last_fullsized":"2023-07-21T22:57:22.501575+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.509358+0000","last_change":"2023-07-21T22:57:22.509358+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.509358+0000","last_undegraded":"2023-07-21T22:57:22.509358+0000","last_fullsized":"2023-07-21T22:57:22.509358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.508452+0000","last_change":"2023-07-21T22:57:22.508452+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.508452+0000","last_undegraded":"2023-07-21T22:57:22.508452+0000","last_fullsized":"2023-07-21T22:57:22.508452+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.511958+0000","last_change":"2023-07-21T22:57:22.511958+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.511958+0000","last_undegraded":"2023-07-21T22:57:22.511958+0000","last_fullsized":"2023-07-21T22:57:22.511958+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507891+0000","last_change":"2023-07-21T22:57:22.507891+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507891+0000","last_undegraded":"2023-07-21T22:57:22.507891+0000","last_fullsized":"2023-07-21T22:57:22.507891+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507642+0000","last_change":"2023-07-21T22:57:22.507642+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507642+0000","last_undegraded":"2023-07-21T22:57:22.507642+0000","last_fullsized":"2023-07-21T22:57:22.507642+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501878+0000","last_change":"2023-07-21T22:57:22.501878+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501878+0000","last_undegraded":"2023-07-21T22:57:22.501878+0000","last_fullsized":"2023-07-21T22:57:22.501878+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507713+0000","last_change":"2023-07-21T22:57:22.507713+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507713+0000","last_undegraded":"2023-07-21T22:57:22.507713+0000","last_fullsized":"2023-07-21T22:57:22.507713+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.506691+0000","last_change":"2023-07-21T22:57:22.506691+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.506691+0000","last_undegraded":"2023-07-21T22:57:22.506691+0000","last_fullsized":"2023-07-21T22:57:22.506691+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.527165+0000","last_change":"2023-07-21T22:57:22.526058+0000","last_active":"2023-07-21T22:57:22.527165+0000","last_peered":"2023-07-21T22:57:22.527165+0000","last_clean":"2023-07-21T22:57:22.527165+0000","last_became_active":"2023-07-21T22:57:22.525745+0000","last_became_peered":"2023-07-21T22:57:22.525745+0000","last_unstale":"2023-07-21T22:57:22.527165+0000","last_undegraded":"2023-07-21T22:57:22.527165+0000","last_fullsized":"2023-07-21T22:57:22.527165+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:58.912111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.503648+0000","last_change":"2023-07-21T22:57:22.503648+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.503648+0000","last_undegraded":"2023-07-21T22:57:22.503648+0000","last_fullsized":"2023-07-21T22:57:22.503648+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.517378+0000","last_change":"2023-07-21T22:57:22.513972+0000","last_active":"2023-07-21T22:57:22.517378+0000","last_peered":"2023-07-21T22:57:22.517378+0000","last_clean":"2023-07-21T22:57:22.517378+0000","last_became_active":"2023-07-21T22:57:22.513687+0000","last_became_peered":"2023-07-21T22:57:22.513687+0000","last_unstale":"2023-07-21T22:57:22.517378+0000","last_undegraded":"2023-07-21T22:57:22.517378+0000","last_fullsized":"2023-07-21T22:57:22.517378+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:27:58.827939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501360+0000","last_change":"2023-07-21T22:57:22.501360+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501360+0000","last_undegraded":"2023-07-21T22:57:22.501360+0000","last_fullsized":"2023-07-21T22:57:22.501360+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.522189+0000","last_change":"2023-07-21T22:57:22.520699+0000","last_active":"2023-07-21T22:57:22.522189+0000","last_peered":"2023-07-21T22:57:22.522189+0000","last_clean":"2023-07-21T22:57:22.522189+0000","last_became_active":"2023-07-21T22:57:22.520379+0000","last_became_peered":"2023-07-21T22:57:22.520379+0000","last_unstale":"2023-07-21T22:57:22.522189+0000","last_undegraded":"2023-07-21T22:57:22.522189+0000","last_fullsized":"2023-07-21T22:57:22.522189+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:07:38.295787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507416+0000","last_change":"2023-07-21T22:57:22.507416+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507416+0000","last_undegraded":"2023-07-21T22:57:22.507416+0000","last_fullsized":"2023-07-21T22:57:22.507416+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.518230+0000","last_change":"2023-07-21T22:57:22.512994+0000","last_active":"2023-07-21T22:57:22.518230+0000","last_peered":"2023-07-21T22:57:22.518230+0000","last_clean":"2023-07-21T22:57:22.518230+0000","last_became_active":"2023-07-21T22:57:22.512632+0000","last_became_peered":"2023-07-21T22:57:22.512632+0000","last_unstale":"2023-07-21T22:57:22.518230+0000","last_undegraded":"2023-07-21T22:57:22.518230+0000","last_fullsized":"2023-07-21T22:57:22.518230+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:23:39.269897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.498988+0000","last_change":"2023-07-21T22:57:22.498988+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.498988+0000","last_undegraded":"2023-07-21T22:57:22.498988+0000","last_fullsized":"2023-07-21T22:57:22.498988+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.523892+0000","last_change":"2023-07-21T22:57:22.520897+0000","last_active":"2023-07-21T22:57:22.523892+0000","last_peered":"2023-07-21T22:57:22.523892+0000","last_clean":"2023-07-21T22:57:22.523892+0000","last_became_active":"2023-07-21T22:57:22.520541+0000","last_became_peered":"2023-07-21T22:57:22.520541+0000","last_unstale":"2023-07-21T22:57:22.523892+0000","last_undegraded":"2023-07-21T22:57:22.523892+0000","last_fullsized":"2023-07-21T22:57:22.523892+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:24:59.305924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.500012+0000","last_change":"2023-07-21T22:57:22.500012+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.500012+0000","last_undegraded":"2023-07-21T22:57:22.500012+0000","last_fullsized":"2023-07-21T22:57:22.500012+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521216+0000","last_change":"2023-07-21T22:57:22.516123+0000","last_active":"2023-07-21T22:57:22.521216+0000","last_peered":"2023-07-21T22:57:22.521216+0000","last_clean":"2023-07-21T22:57:22.521216+0000","last_became_active":"2023-07-21T22:57:22.515462+0000","last_became_peered":"2023-07-21T22:57:22.515462+0000","last_unstale":"2023-07-21T22:57:22.521216+0000","last_undegraded":"2023-07-21T22:57:22.521216+0000","last_fullsized":"2023-07-21T22:57:22.521216+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:59:16.614841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.505427+0000","last_change":"2023-07-21T22:57:22.505427+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.505427+0000","last_undegraded":"2023-07-21T22:57:22.505427+0000","last_fullsized":"2023-07-21T22:57:22.505427+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.518744+0000","last_change":"2023-07-21T22:57:22.516916+0000","last_active":"2023-07-21T22:57:22.518744+0000","last_peered":"2023-07-21T22:57:22.518744+0000","last_clean":"2023-07-21T22:57:22.518744+0000","last_became_active":"2023-07-21T22:57:22.516644+0000","last_became_peered":"2023-07-21T22:57:22.516644+0000","last_unstale":"2023-07-21T22:57:22.518744+0000","last_undegraded":"2023-07-21T22:57:22.518744+0000","last_fullsized":"2023-07-21T22:57:22.518744+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:37:05.914994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.504855+0000","last_change":"2023-07-21T22:57:22.504855+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.504855+0000","last_undegraded":"2023-07-21T22:57:22.504855+0000","last_fullsized":"2023-07-21T22:57:22.504855+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.511885+0000","last_change":"2023-07-21T22:57:22.509620+0000","last_active":"2023-07-21T22:57:22.511885+0000","last_peered":"2023-07-21T22:57:22.511885+0000","last_clean":"2023-07-21T22:57:22.511885+0000","last_became_active":"2023-07-21T22:57:22.509333+0000","last_became_peered":"2023-07-21T22:57:22.509333+0000","last_unstale":"2023-07-21T22:57:22.511885+0000","last_undegraded":"2023-07-21T22:57:22.511885+0000","last_fullsized":"2023-07-21T22:57:22.511885+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:23:03.803937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.499063+0000","last_change":"2023-07-21T22:57:22.499063+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.499063+0000","last_undegraded":"2023-07-21T22:57:22.499063+0000","last_fullsized":"2023-07-21T22:57:22.499063+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521476+0000","last_change":"2023-07-21T22:57:22.515998+0000","last_active":"2023-07-21T22:57:22.521476+0000","last_peered":"2023-07-21T22:57:22.521476+0000","last_clean":"2023-07-21T22:57:22.521476+0000","last_became_active":"2023-07-21T22:57:22.514997+0000","last_became_peered":"2023-07-21T22:57:22.514997+0000","last_unstale":"2023-07-21T22:57:22.521476+0000","last_undegraded":"2023-07-21T22:57:22.521476+0000","last_fullsized":"2023-07-21T22:57:22.521476+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:23.065484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507152+0000","last_change":"2023-07-21T22:57:22.507152+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507152+0000","last_undegraded":"2023-07-21T22:57:22.507152+0000","last_fullsized":"2023-07-21T22:57:22.507152+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521842+0000","last_change":"2023-07-21T22:57:22.516566+0000","last_active":"2023-07-21T22:57:22.521842+0000","last_peered":"2023-07-21T22:57:22.521842+0000","last_clean":"2023-07-21T22:57:22.521842+0000","last_became_active":"2023-07-21T22:57:22.516280+0000","last_became_peered":"2023-07-21T22:57:22.516280+0000","last_unstale":"2023-07-21T22:57:22.521842+0000","last_undegraded":"2023-07-21T22:57:22.521842+0000","last_fullsized":"2023-07-21T22:57:22.521842+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:49:23.225650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501999+0000","last_change":"2023-07-21T22:57:22.501999+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501999+0000","last_undegraded":"2023-07-21T22:57:22.501999+0000","last_fullsized":"2023-07-21T22:57:22.501999+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521305+0000","last_change":"2023-07-21T22:57:22.516536+0000","last_active":"2023-07-21T22:57:22.521305+0000","last_peered":"2023-07-21T22:57:22.521305+0000","last_clean":"2023-07-21T22:57:22.521305+0000","last_became_active":"2023-07-21T22:57:22.516241+0000","last_became_peered":"2023-07-21T22:57:22.516241+0000","last_unstale":"2023-07-21T22:57:22.521305+0000","last_undegraded":"2023-07-21T22:57:22.521305+0000","last_fullsized":"2023-07-21T22:57:22.521305+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:23:33.195419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.502316+0000","last_change":"2023-07-21T22:57:22.502316+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.502316+0000","last_undegraded":"2023-07-21T22:57:22.502316+0000","last_fullsized":"2023-07-21T22:57:22.502316+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.513214+0000","last_change":"2023-07-21T22:57:22.511600+0000","last_active":"2023-07-21T22:57:22.513214+0000","last_peered":"2023-07-21T22:57:22.513214+0000","last_clean":"2023-07-21T22:57:22.513214+0000","last_became_active":"2023-07-21T22:57:22.511263+0000","last_became_peered":"2023-07-21T22:57:22.511263+0000","last_unstale":"2023-07-21T22:57:22.513214+0000","last_undegraded":"2023-07-21T22:57:22.513214+0000","last_fullsized":"2023-07-21T22:57:22.513214+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:29:57.199767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.505444+0000","last_change":"2023-07-21T22:57:22.505444+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.505444+0000","last_undegraded":"2023-07-21T22:57:22.505444+0000","last_fullsized":"2023-07-21T22:57:22.505444+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.517415+0000","last_change":"2023-07-21T22:57:22.513380+0000","last_active":"2023-07-21T22:57:22.517415+0000","last_peered":"2023-07-21T22:57:22.517415+0000","last_clean":"2023-07-21T22:57:22.517415+0000","last_became_active":"2023-07-21T22:57:22.512923+0000","last_became_peered":"2023-07-21T22:57:22.512923+0000","last_unstale":"2023-07-21T22:57:22.517415+0000","last_undegraded":"2023-07-21T22:57:22.517415+0000","last_fullsized":"2023-07-21T22:57:22.517415+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:10:24.583845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.503913+0000","last_change":"2023-07-21T22:57:22.503913+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.503913+0000","last_undegraded":"2023-07-21T22:57:22.503913+0000","last_fullsized":"2023-07-21T22:57:22.503913+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.522701+0000","last_change":"2023-07-21T22:57:22.521562+0000","last_active":"2023-07-21T22:57:22.522701+0000","last_peered":"2023-07-21T22:57:22.522701+0000","last_clean":"2023-07-21T22:57:22.522701+0000","last_became_active":"2023-07-21T22:57:22.521270+0000","last_became_peered":"2023-07-21T22:57:22.521270+0000","last_unstale":"2023-07-21T22:57:22.522701+0000","last_undegraded":"2023-07-21T22:57:22.522701+0000","last_fullsized":"2023-07-21T22:57:22.522701+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:09:59.644328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.505067+0000","last_change":"2023-07-21T22:57:22.505067+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.505067+0000","last_undegraded":"2023-07-21T22:57:22.505067+0000","last_fullsized":"2023-07-21T22:57:22.505067+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.518162+0000","last_change":"2023-07-21T22:57:22.512259+0000","last_active":"2023-07-21T22:57:22.518162+0000","last_peered":"2023-07-21T22:57:22.518162+0000","last_clean":"2023-07-21T22:57:22.518162+0000","last_became_active":"2023-07-21T22:57:22.511911+0000","last_became_peered":"2023-07-21T22:57:22.511911+0000","last_unstale":"2023-07-21T22:57:22.518162+0000","last_undegraded":"2023-07-21T22:57:22.518162+0000","last_fullsized":"2023-07-21T22:57:22.518162+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:32:49.994716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.508740+0000","last_change":"2023-07-21T22:57:22.508740+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.508740+0000","last_undegraded":"2023-07-21T22:57:22.508740+0000","last_fullsized":"2023-07-21T22:57:22.508740+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.514840+0000","last_change":"2023-07-21T22:57:22.514061+0000","last_active":"2023-07-21T22:57:22.514840+0000","last_peered":"2023-07-21T22:57:22.514840+0000","last_clean":"2023-07-21T22:57:22.514840+0000","last_became_active":"2023-07-21T22:57:22.513784+0000","last_became_peered":"2023-07-21T22:57:22.513784+0000","last_unstale":"2023-07-21T22:57:22.514840+0000","last_undegraded":"2023-07-21T22:57:22.514840+0000","last_fullsized":"2023-07-21T22:57:22.514840+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:26:35.733602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501393+0000","last_change":"2023-07-21T22:57:22.501393+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501393+0000","last_undegraded":"2023-07-21T22:57:22.501393+0000","last_fullsized":"2023-07-21T22:57:22.501393+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521245+0000","last_change":"2023-07-21T22:57:22.516848+0000","last_active":"2023-07-21T22:57:22.521245+0000","last_peered":"2023-07-21T22:57:22.521245+0000","last_clean":"2023-07-21T22:57:22.521245+0000","last_became_active":"2023-07-21T22:57:22.516566+0000","last_became_peered":"2023-07-21T22:57:22.516566+0000","last_unstale":"2023-07-21T22:57:22.521245+0000","last_undegraded":"2023-07-21T22:57:22.521245+0000","last_fullsized":"2023-07-21T22:57:22.521245+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:05:17.516983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.499454+0000","last_change":"2023-07-21T22:57:22.499454+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.499454+0000","last_undegraded":"2023-07-21T22:57:22.499454+0000","last_fullsized":"2023-07-21T22:57:22.499454+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.524505+0000","last_change":"2023-07-21T22:57:22.522644+0000","last_active":"2023-07-21T22:57:22.524505+0000","last_peered":"2023-07-21T22:57:22.524505+0000","last_clean":"2023-07-21T22:57:22.524505+0000","last_became_active":"2023-07-21T22:57:22.522294+0000","last_became_peered":"2023-07-21T22:57:22.522294+0000","last_unstale":"2023-07-21T22:57:22.524505+0000","last_undegraded":"2023-07-21T22:57:22.524505+0000","last_fullsized":"2023-07-21T22:57:22.524505+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:00:59.804414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.499971+0000","last_change":"2023-07-21T22:57:22.499971+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.499971+0000","last_undegraded":"2023-07-21T22:57:22.499971+0000","last_fullsized":"2023-07-21T22:57:22.499971+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521580+0000","last_change":"2023-07-21T22:57:22.518224+0000","last_active":"2023-07-21T22:57:22.521580+0000","last_peered":"2023-07-21T22:57:22.521580+0000","last_clean":"2023-07-21T22:57:22.521580+0000","last_became_active":"2023-07-21T22:57:22.517933+0000","last_became_peered":"2023-07-21T22:57:22.517933+0000","last_unstale":"2023-07-21T22:57:22.521580+0000","last_undegraded":"2023-07-21T22:57:22.521580+0000","last_fullsized":"2023-07-21T22:57:22.521580+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:50:21.438717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.499952+0000","last_change":"2023-07-21T22:57:22.499952+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.499952+0000","last_undegraded":"2023-07-21T22:57:22.499952+0000","last_fullsized":"2023-07-21T22:57:22.499952+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.518212+0000","last_change":"2023-07-21T22:57:22.512688+0000","last_active":"2023-07-21T22:57:22.518212+0000","last_peered":"2023-07-21T22:57:22.518212+0000","last_clean":"2023-07-21T22:57:22.518212+0000","last_became_active":"2023-07-21T22:57:22.512404+0000","last_became_peered":"2023-07-21T22:57:22.512404+0000","last_unstale":"2023-07-21T22:57:22.518212+0000","last_undegraded":"2023-07-21T22:57:22.518212+0000","last_fullsized":"2023-07-21T22:57:22.518212+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:36:04.149908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.503744+0000","last_change":"2023-07-21T22:57:22.503744+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.503744+0000","last_undegraded":"2023-07-21T22:57:22.503744+0000","last_fullsized":"2023-07-21T22:57:22.503744+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.523928+0000","last_change":"2023-07-21T22:57:22.523033+0000","last_active":"2023-07-21T22:57:22.523928+0000","last_peered":"2023-07-21T22:57:22.523928+0000","last_clean":"2023-07-21T22:57:22.523928+0000","last_became_active":"2023-07-21T22:57:22.522687+0000","last_became_peered":"2023-07-21T22:57:22.522687+0000","last_unstale":"2023-07-21T22:57:22.523928+0000","last_undegraded":"2023-07-21T22:57:22.523928+0000","last_fullsized":"2023-07-21T22:57:22.523928+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:32:04.938461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507997+0000","last_change":"2023-07-21T22:57:22.507997+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507997+0000","last_undegraded":"2023-07-21T22:57:22.507997+0000","last_fullsized":"2023-07-21T22:57:22.507997+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.523852+0000","last_change":"2023-07-21T22:57:22.520034+0000","last_active":"2023-07-21T22:57:22.523852+0000","last_peered":"2023-07-21T22:57:22.523852+0000","last_clean":"2023-07-21T22:57:22.523852+0000","last_became_active":"2023-07-21T22:57:22.518945+0000","last_became_peered":"2023-07-21T22:57:22.518945+0000","last_unstale":"2023-07-21T22:57:22.523852+0000","last_undegraded":"2023-07-21T22:57:22.523852+0000","last_fullsized":"2023-07-21T22:57:22.523852+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:58:55.877448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.512514+0000","last_change":"2023-07-21T22:57:22.512514+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.512514+0000","last_undegraded":"2023-07-21T22:57:22.512514+0000","last_fullsized":"2023-07-21T22:57:22.512514+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.520035+0000","last_change":"2023-07-21T22:57:22.519089+0000","last_active":"2023-07-21T22:57:22.520035+0000","last_peered":"2023-07-21T22:57:22.520035+0000","last_clean":"2023-07-21T22:57:22.520035+0000","last_became_active":"2023-07-21T22:57:22.518879+0000","last_became_peered":"2023-07-21T22:57:22.518879+0000","last_unstale":"2023-07-21T22:57:22.520035+0000","last_undegraded":"2023-07-21T22:57:22.520035+0000","last_fullsized":"2023-07-21T22:57:22.520035+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:13:00.596939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.503477+0000","last_change":"2023-07-21T22:57:22.503477+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.503477+0000","last_undegraded":"2023-07-21T22:57:22.503477+0000","last_fullsized":"2023-07-21T22:57:22.503477+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.517334+0000","last_change":"2023-07-21T22:57:22.513969+0000","last_active":"2023-07-21T22:57:22.517334+0000","last_peered":"2023-07-21T22:57:22.517334+0000","last_clean":"2023-07-21T22:57:22.517334+0000","last_became_active":"2023-07-21T22:57:22.513667+0000","last_became_peered":"2023-07-21T22:57:22.513667+0000","last_unstale":"2023-07-21T22:57:22.517334+0000","last_undegraded":"2023-07-21T22:57:22.517334+0000","last_fullsized":"2023-07-21T22:57:22.517334+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:33:06.835207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.509163+0000","last_change":"2023-07-21T22:57:22.509163+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.509163+0000","last_undegraded":"2023-07-21T22:57:22.509163+0000","last_fullsized":"2023-07-21T22:57:22.509163+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.524484+0000","last_change":"2023-07-21T22:57:22.522623+0000","last_active":"2023-07-21T22:57:22.524484+0000","last_peered":"2023-07-21T22:57:22.524484+0000","last_clean":"2023-07-21T22:57:22.524484+0000","last_became_active":"2023-07-21T22:57:22.522369+0000","last_became_peered":"2023-07-21T22:57:22.522369+0000","last_unstale":"2023-07-21T22:57:22.524484+0000","last_undegraded":"2023-07-21T22:57:22.524484+0000","last_fullsized":"2023-07-21T22:57:22.524484+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:16:06.371322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"180'326","reported_seq":1211,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.507739+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:57:22.507739+0000","last_peered":"2023-07-21T22:57:22.507739+0000","last_clean":"2023-07-21T22:57:22.507739+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:57:22.507739+0000","last_undegraded":"2023-07-21T22:57:22.507739+0000","last_fullsized":"2023-07-21T22:57:22.507739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:53:36.607636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":353,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.505706+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:57:22.505706+0000","last_peered":"2023-07-21T22:57:22.505706+0000","last_clean":"2023-07-21T22:57:22.505706+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:57:22.505706+0000","last_undegraded":"2023-07-21T22:57:22.505706+0000","last_fullsized":"2023-07-21T22:57:22.505706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:52:45.754065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.509650+0000","last_change":"2023-07-21T22:57:22.509650+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.509650+0000","last_undegraded":"2023-07-21T22:57:22.509650+0000","last_fullsized":"2023-07-21T22:57:22.509650+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.512458+0000","last_change":"2023-07-21T22:57:22.511800+0000","last_active":"2023-07-21T22:57:22.512458+0000","last_peered":"2023-07-21T22:57:22.512458+0000","last_clean":"2023-07-21T22:57:22.512458+0000","last_became_active":"2023-07-21T22:57:22.511372+0000","last_became_peered":"2023-07-21T22:57:22.511372+0000","last_unstale":"2023-07-21T22:57:22.512458+0000","last_undegraded":"2023-07-21T22:57:22.512458+0000","last_fullsized":"2023-07-21T22:57:22.512458+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:05:20.517665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":314,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.507608+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:57:22.507608+0000","last_peered":"2023-07-21T22:57:22.507608+0000","last_clean":"2023-07-21T22:57:22.507608+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:57:22.507608+0000","last_undegraded":"2023-07-21T22:57:22.507608+0000","last_fullsized":"2023-07-21T22:57:22.507608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:34:26.252489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.499199+0000","last_change":"2023-07-21T22:57:22.499199+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.499199+0000","last_undegraded":"2023-07-21T22:57:22.499199+0000","last_fullsized":"2023-07-21T22:57:22.499199+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.518672+0000","last_change":"2023-07-21T22:57:22.515084+0000","last_active":"2023-07-21T22:57:22.518672+0000","last_peered":"2023-07-21T22:57:22.518672+0000","last_clean":"2023-07-21T22:57:22.518672+0000","last_became_active":"2023-07-21T22:57:22.514810+0000","last_became_peered":"2023-07-21T22:57:22.514810+0000","last_unstale":"2023-07-21T22:57:22.518672+0000","last_undegraded":"2023-07-21T22:57:22.518672+0000","last_fullsized":"2023-07-21T22:57:22.518672+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:13:41.728908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":317,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.505310+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:57:22.505310+0000","last_peered":"2023-07-21T22:57:22.505310+0000","last_clean":"2023-07-21T22:57:22.505310+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:57:22.505310+0000","last_undegraded":"2023-07-21T22:57:22.505310+0000","last_fullsized":"2023-07-21T22:57:22.505310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:06:51.965840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507228+0000","last_change":"2023-07-21T22:57:22.507228+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507228+0000","last_undegraded":"2023-07-21T22:57:22.507228+0000","last_fullsized":"2023-07-21T22:57:22.507228+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521495+0000","last_change":"2023-07-21T22:57:22.516060+0000","last_active":"2023-07-21T22:57:22.521495+0000","last_peered":"2023-07-21T22:57:22.521495+0000","last_clean":"2023-07-21T22:57:22.521495+0000","last_became_active":"2023-07-21T22:57:22.515686+0000","last_became_peered":"2023-07-21T22:57:22.515686+0000","last_unstale":"2023-07-21T22:57:22.521495+0000","last_undegraded":"2023-07-21T22:57:22.521495+0000","last_fullsized":"2023-07-21T22:57:22.521495+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:18:25.503485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":353,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.505347+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:57:22.505347+0000","last_peered":"2023-07-21T22:57:22.505347+0000","last_clean":"2023-07-21T22:57:22.505347+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:57:22.505347+0000","last_undegraded":"2023-07-21T22:57:22.505347+0000","last_fullsized":"2023-07-21T22:57:22.505347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:59:49.297136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501476+0000","last_change":"2023-07-21T22:57:22.501476+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501476+0000","last_undegraded":"2023-07-21T22:57:22.501476+0000","last_fullsized":"2023-07-21T22:57:22.501476+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.518719+0000","last_change":"2023-07-21T22:57:22.518008+0000","last_active":"2023-07-21T22:57:22.518719+0000","last_peered":"2023-07-21T22:57:22.518719+0000","last_clean":"2023-07-21T22:57:22.518719+0000","last_became_active":"2023-07-21T22:57:22.517728+0000","last_became_peered":"2023-07-21T22:57:22.517728+0000","last_unstale":"2023-07-21T22:57:22.518719+0000","last_undegraded":"2023-07-21T22:57:22.518719+0000","last_fullsized":"2023-07-21T22:57:22.518719+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:18:59.282736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":331,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.495713+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:57:22.495713+0000","last_peered":"2023-07-21T22:57:22.495713+0000","last_clean":"2023-07-21T22:57:22.495713+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:57:22.495713+0000","last_undegraded":"2023-07-21T22:57:22.495713+0000","last_fullsized":"2023-07-21T22:57:22.495713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:26:35.475867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507980+0000","last_change":"2023-07-21T22:57:22.507980+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507980+0000","last_undegraded":"2023-07-21T22:57:22.507980+0000","last_fullsized":"2023-07-21T22:57:22.507980+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.506936+0000","last_change":"2023-07-21T22:57:22.505531+0000","last_active":"2023-07-21T22:57:22.506936+0000","last_peered":"2023-07-21T22:57:22.506936+0000","last_clean":"2023-07-21T22:57:22.506936+0000","last_became_active":"2023-07-21T22:57:22.505255+0000","last_became_peered":"2023-07-21T22:57:22.505255+0000","last_unstale":"2023-07-21T22:57:22.506936+0000","last_undegraded":"2023-07-21T22:57:22.506936+0000","last_fullsized":"2023-07-21T22:57:22.506936+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:39:42.411463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":313,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.508725+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:57:22.508725+0000","last_peered":"2023-07-21T22:57:22.508725+0000","last_clean":"2023-07-21T22:57:22.508725+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:57:22.508725+0000","last_undegraded":"2023-07-21T22:57:22.508725+0000","last_fullsized":"2023-07-21T22:57:22.508725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:50:42.472612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507008+0000","last_change":"2023-07-21T22:57:22.507008+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507008+0000","last_undegraded":"2023-07-21T22:57:22.507008+0000","last_fullsized":"2023-07-21T22:57:22.507008+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521537+0000","last_change":"2023-07-21T22:57:22.516962+0000","last_active":"2023-07-21T22:57:22.521537+0000","last_peered":"2023-07-21T22:57:22.521537+0000","last_clean":"2023-07-21T22:57:22.521537+0000","last_became_active":"2023-07-21T22:57:22.516672+0000","last_became_peered":"2023-07-21T22:57:22.516672+0000","last_unstale":"2023-07-21T22:57:22.521537+0000","last_undegraded":"2023-07-21T22:57:22.521537+0000","last_fullsized":"2023-07-21T22:57:22.521537+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:08:03.586522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":331,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.495782+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:57:22.495782+0000","last_peered":"2023-07-21T22:57:22.495782+0000","last_clean":"2023-07-21T22:57:22.495782+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:57:22.495782+0000","last_undegraded":"2023-07-21T22:57:22.495782+0000","last_fullsized":"2023-07-21T22:57:22.495782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:05:49.844805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.498848+0000","last_change":"2023-07-21T22:57:22.498848+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.498848+0000","last_undegraded":"2023-07-21T22:57:22.498848+0000","last_fullsized":"2023-07-21T22:57:22.498848+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521394+0000","last_change":"2023-07-21T22:57:22.517887+0000","last_active":"2023-07-21T22:57:22.521394+0000","last_peered":"2023-07-21T22:57:22.521394+0000","last_clean":"2023-07-21T22:57:22.521394+0000","last_became_active":"2023-07-21T22:57:22.517612+0000","last_became_peered":"2023-07-21T22:57:22.517612+0000","last_unstale":"2023-07-21T22:57:22.521394+0000","last_undegraded":"2023-07-21T22:57:22.521394+0000","last_fullsized":"2023-07-21T22:57:22.521394+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:24:34.120003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":310,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.507419+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:57:22.507419+0000","last_peered":"2023-07-21T22:57:22.507419+0000","last_clean":"2023-07-21T22:57:22.507419+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:57:22.507419+0000","last_undegraded":"2023-07-21T22:57:22.507419+0000","last_fullsized":"2023-07-21T22:57:22.507419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:16:09.635893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509900,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64276,"kb_used_data":2892,"kb_used_omap":0,"kb_used_meta":61376,"kb_avail":94307564,"statfs":{"total":96636764160,"available":96570945536,"internally_reserved":0,"allocated":2961408,"data_stored":1806564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":62849024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.749,"15min":0.76200000000000001},"min":{"1min":0.42699999999999999,"5min":0.35999999999999999,"15min":0.34999999999999998},"max":{"1min":0.93400000000000005,"5min":0.96799999999999997,"15min":1.143},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39000000000000001},"max":{"1min":0.90200000000000002,"5min":0.93200000000000005,"15min":1.0349999999999999},"last":0.78800000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.752,"15min":0.76300000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.40600000000000003},"max":{"1min":0.94099999999999995,"5min":1.089,"15min":1.089},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.73099999999999998,"15min":0.74099999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88800000000000001,"5min":0.95599999999999996,"15min":1.02},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.747,"15min":0.755},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.47999999999999998},"max":{"1min":0.95899999999999996,"5min":1.0049999999999999,"15min":1.0780000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.78400000000000003},"min":{"1min":0.53000000000000003,"5min":0.51100000000000001,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":0.98899999999999999,"15min":1.0660000000000001},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.76100000000000001,"15min":0.77400000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97399999999999998,"5min":0.98099999999999998,"15min":1.0980000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.77200000000000002,"15min":0.77900000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.89100000000000001,"5min":0.98299999999999998,"15min":1.036},"last":0.86899999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.34999999999999998},"max":{"1min":0.77000000000000002,"5min":0.81299999999999994,"15min":0.89700000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.60399999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.34699999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.0940000000000001},"last":0.89900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.99399999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.52300000000000002,"5min":0.48499999999999999,"15min":0.40699999999999997},"max":{"1min":0.871,"5min":0.91000000000000003,"15min":1.0429999999999999},"last":0.97199999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.97399999999999998},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.64000000000000001,"15min":0.63400000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84499999999999997,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.84999999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542606,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37456,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334384,"statfs":{"total":96636764160,"available":96598409216,"internally_reserved":0,"allocated":2367488,"data_stored":1216196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.59299999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.97899999999999998,"5min":1.022,"15min":1.024},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79900000000000004,"15min":0.80400000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93400000000000005,"5min":1,"15min":1.0780000000000001},"last":0.746}]},{"osd":1,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.874,"5min":0.96999999999999997,"15min":1.006},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.747,"15min":0.74099999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90600000000000003,"5min":1.046,"15min":1.046},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.75700000000000001,"15min":0.77200000000000002},"min":{"1min":0.58999999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.88500000000000001,"5min":0.97399999999999998,"15min":1.038},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.56200000000000006,"5min":0.438,"15min":0.438},"max":{"1min":0.93400000000000005,"5min":0.98799999999999999,"15min":1.0600000000000001},"last":0.75900000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.753,"15min":0.751},"min":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.48999999999999999},"max":{"1min":0.93700000000000006,"5min":1.089,"15min":1.089},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.749,"15min":0.75},"min":{"1min":0.52800000000000002,"5min":0.499,"15min":0.499},"max":{"1min":0.89100000000000001,"5min":0.96199999999999997,"15min":0.96999999999999997},"last":0.65300000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.36099999999999999},"max":{"1min":0.81799999999999995,"5min":0.88400000000000001,"15min":0.92300000000000004},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":0.77900000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.66600000000000004,"5min":0.89600000000000002,"15min":0.91300000000000003},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42299999999999999},"max":{"1min":0.77700000000000002,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.86199999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.64000000000000001,"15min":0.65500000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.38700000000000001},"max":{"1min":0.76400000000000001,"5min":0.91600000000000004,"15min":1.0129999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.432},"max":{"1min":0.78500000000000003,"5min":0.90000000000000002,"15min":0.96299999999999997},"last":0.89800000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509899,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55504,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316336,"statfs":{"total":96636764160,"available":96579928064,"internally_reserved":0,"allocated":2367488,"data_stored":1216196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.46600000000000003,"5min":0.437,"15min":0.32100000000000001},"max":{"1min":0.92900000000000005,"5min":1.044,"15min":1.044},"last":0.748},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.41499999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.91700000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.42399999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73099999999999998,"15min":0.73299999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.89800000000000002,"5min":1.038,"15min":1.054},"last":0.82499999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.52200000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.119},"last":0.871},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.747,"15min":0.74199999999999999},"min":{"1min":0.56999999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95099999999999996,"5min":0.96899999999999997,"15min":1.0880000000000001},"last":0.84899999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79200000000000004,"15min":0.78600000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.47299999999999998},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.89900000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57399999999999995,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76500000000000001,"5min":0.90400000000000003,"15min":0.91300000000000003},"last":0.623},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68500000000000005,"15min":0.68100000000000005},"min":{"1min":0.52600000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.022,"5min":1.022,"15min":1.0369999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90500000000000003,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.44700000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92400000000000004,"5min":0.93600000000000005,"15min":1.0629999999999999},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":0.88100000000000001,"5min":1.028,"15min":1.0549999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73499999999999999,"15min":0.72299999999999998},"min":{"1min":0.496,"5min":0.48699999999999999,"15min":0.45900000000000002},"max":{"1min":1.034,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.70699999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37456,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334384,"statfs":{"total":96636764160,"available":96598409216,"internally_reserved":0,"allocated":2367488,"data_stored":1216196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.34599999999999997},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.76900000000000002},"min":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.35299999999999998},"max":{"1min":1.3500000000000001,"5min":1.488,"15min":1.488},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.52700000000000002,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":2.7320000000000002,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.80300000000000005,"15min":0.78800000000000003},"min":{"1min":0.62,"5min":0.60699999999999998,"15min":0.46899999999999997},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.621},{"interface":"front","average":{"1min":0.878,"5min":0.79800000000000004,"15min":0.78600000000000003},"min":{"1min":0.623,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":0.71999999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.78800000000000003,"15min":0.75600000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.0169999999999999,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82299999999999995,"15min":0.81599999999999995},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73299999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.44500000000000001,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.151},"last":0.55300000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.57899999999999996,"5min":0.45800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94999999999999996,"5min":0.96299999999999997,"15min":1.252},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.44400000000000001,"15min":0.437},"max":{"1min":1.006,"5min":1.006,"15min":1.0609999999999999},"last":0.77600000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68300000000000005,"15min":0.66000000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.39500000000000002},"max":{"1min":1.0189999999999999,"5min":1.526,"15min":1.526},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.53600000000000003,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.99099999999999999,"5min":1.0820000000000001,"15min":1.206},"last":0.67100000000000004}]}]},{"osd":3,"up_from":15,"seq":64424509899,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37456,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334384,"statfs":{"total":96636764160,"available":96598409216,"internally_reserved":0,"allocated":2367488,"data_stored":1216196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.503,"15min":0.496},"min":{"1min":0.29899999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57899999999999996,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.312},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.65100000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.35299999999999998,"5min":0.317,"15min":0.312},"max":{"1min":0.72999999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79700000000000004,"5min":0.81799999999999995,"15min":0.88100000000000001},"last":0.496}]},{"osd":2,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.80000000000000004,"5min":0.83199999999999996,"15min":0.84699999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.36899999999999999,"15min":0.36299999999999999},"max":{"1min":0.78600000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77600000000000002,"15min":0.77900000000000003},"min":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.441},"max":{"1min":1.046,"5min":1.101,"15min":1.244},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.84399999999999997},"min":{"1min":0.58099999999999996,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.75700000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.57099999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.628},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.59499999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.006,"5min":1.087,"15min":1.2230000000000001},"last":0.58199999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81200000000000006,"15min":0.80600000000000005},"min":{"1min":0.58799999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0820000000000001,"5min":1.127,"15min":1.147},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78500000000000003,"15min":0.78600000000000003},"min":{"1min":0.56799999999999995,"5min":0.55100000000000005,"15min":0.53000000000000003},"max":{"1min":1.296,"5min":1.296,"15min":1.3660000000000001},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83299999999999996,"15min":0.82999999999999996},"min":{"1min":0.624,"5min":0.55000000000000004,"15min":0.50900000000000001},"max":{"1min":1.175,"5min":1.175,"15min":1.4510000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82799999999999996,"15min":0.84299999999999997},"min":{"1min":0.61499999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.427},"last":0.68500000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509901,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55504,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316336,"statfs":{"total":96636764160,"available":96579928064,"internally_reserved":0,"allocated":2367488,"data_stored":1216196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.52700000000000002,"15min":0.51000000000000001},"min":{"1min":0.33400000000000002,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.45900000000000002,"5min":0.38,"15min":0.377},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.49199999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.35599999999999998},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.47199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.53900000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.499},"min":{"1min":0.379,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69399999999999995,"5min":0.73099999999999998,"15min":0.92800000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.60599999999999998,"15min":0.59399999999999997},"min":{"1min":0.53400000000000003,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.58699999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.82499999999999996,"15min":0.82599999999999996},"min":{"1min":0.66000000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.55900000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1240000000000001,"5min":1.1359999999999999,"15min":1.391},"last":0.80800000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.67200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.82599999999999996,"15min":0.83699999999999997},"min":{"1min":0.57699999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.749}]},{"osd":6,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.80000000000000004,"15min":0.81899999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1220000000000001,"5min":1.1499999999999999,"15min":1.2969999999999999},"last":0.875},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.84399999999999997,"15min":0.84699999999999998},"min":{"1min":0.63600000000000001,"5min":0.59999999999999998,"15min":0.55600000000000005},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.85299999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.84399999999999997,"15min":0.85099999999999998},"min":{"1min":0.748,"5min":0.62,"15min":0.56000000000000005},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81999999999999995,"15min":0.84399999999999997},"min":{"1min":0.59599999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"max":{"1min":1.1679999999999999,"5min":1.2749999999999999,"15min":1.3939999999999999},"last":0.90400000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509900,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37456,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334384,"statfs":{"total":96636764160,"available":96598409216,"internally_reserved":0,"allocated":2367488,"data_stored":1216196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48799999999999999,"15min":0.497},"min":{"1min":0.29899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89500000000000002,"5min":1.149,"15min":1.149},"last":0.41499999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50900000000000001,"15min":0.52600000000000002},"min":{"1min":0.39500000000000002,"5min":0.33900000000000002,"15min":0.33100000000000002},"max":{"1min":0.64900000000000002,"5min":0.80800000000000005,"15min":0.82799999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73699999999999999,"5min":1.21,"15min":1.21},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60199999999999998,"15min":0.61099999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.878,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.38900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.77300000000000002,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.34100000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78200000000000003,"15min":0.80100000000000005},"min":{"1min":0.59499999999999997,"5min":0.53700000000000003,"15min":0.46500000000000002},"max":{"1min":1.0329999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81999999999999995,"15min":0.82299999999999995},"min":{"1min":0.59199999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0169999999999999,"5min":1.2849999999999999,"15min":1.302},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80900000000000005},"min":{"1min":0.57999999999999996,"5min":0.52900000000000003,"15min":0.499},"max":{"1min":1.002,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79000000000000004,"15min":0.80900000000000005},"min":{"1min":0.57899999999999996,"5min":0.52800000000000002,"15min":0.48799999999999999},"max":{"1min":1.052,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.58699999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83299999999999996,"15min":0.82899999999999996},"min":{"1min":0.68000000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0700000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78600000000000003,"15min":0.81100000000000005},"min":{"1min":0.56200000000000006,"5min":0.495,"15min":0.495},"max":{"1min":1.028,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80600000000000005,"15min":0.82999999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0009999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.82899999999999996,"15min":0.83399999999999996},"min":{"1min":0.63,"5min":0.61799999999999999,"15min":0.55000000000000004},"max":{"1min":1.0009999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.61599999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509902,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38024,"kb_used_data":2880,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333816,"statfs":{"total":96636764160,"available":96597827584,"internally_reserved":0,"allocated":2949120,"data_stored":1799872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.498,"15min":0.48799999999999999},"min":{"1min":0.317,"5min":0.29999999999999999,"15min":0.28499999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54300000000000004,"15min":0.54000000000000004},"min":{"1min":0.40000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.38}]},{"osd":2,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.36499999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33900000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.40600000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.627,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.498},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.629,"5min":0.51200000000000001,"15min":0.51000000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.4370000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.82999999999999996,"15min":0.82699999999999996},"min":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.85799999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.83199999999999996,"15min":0.82199999999999995},"min":{"1min":0.63500000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2130000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.87,"15min":0.84899999999999998},"min":{"1min":0.628,"5min":0.497,"15min":0.497},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.351},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.58499999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.627,"5min":0.60699999999999998,"15min":0.60299999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.81899999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.83499999999999996,"15min":0.83199999999999996},"min":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"max":{"1min":1.1699999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.877,"15min":0.873},"min":{"1min":0.64900000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.411},"last":0.94599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:57:27.658 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:57:27.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.800+0000 7f5c7499f640 1 Processor -- start 2023-07-21T22:57:27.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.800+0000 7f5c7499f640 1 -- start start 2023-07-21T22:57:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.800+0000 7f5c7499f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5c70155c40 0x7f5c700c8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.800+0000 7f5c7499f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c700cdd30 0x7f5c7015bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.800+0000 7f5c7499f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c70156010 con 0x7f5c700c8eb0 2023-07-21T22:57:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.800+0000 7f5c7499f640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c701588f0 con 0x7f5c700cdd30 2023-07-21T22:57:27.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.800+0000 7f5c7499f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c70158bd0 con 0x7f5c70155c40 2023-07-21T22:57:27.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.804+0000 7f5c6ed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c700cdd30 0x7f5c7015bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:27.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.804+0000 7f5c6ed9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c700cdd30 0x7f5c7015bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38922/0 (socket says 172.21.15.6:38922) 2023-07-21T22:57:27.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.804+0000 7f5c6ed9d640 1 -- 172.21.15.6:0/3601662852 learned_addr learned my addr 172.21.15.6:0/3601662852 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:27.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.804+0000 7f5c6e59c640 1 --2- 172.21.15.6:0/3601662852 >> v2:172.21.15.161:3300/0 conn(0x7f5c70155c40 0x7f5c700c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:27.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.804+0000 7f5c6ed9d640 1 -- 172.21.15.6:0/3601662852 >> v2:172.21.15.161:3300/0 conn(0x7f5c70155c40 msgr2=0x7f5c700c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:27.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.804+0000 7f5c6ed9d640 1 --2- 172.21.15.6:0/3601662852 >> v2:172.21.15.161:3300/0 conn(0x7f5c70155c40 0x7f5c700c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.804+0000 7f5c6ed9d640 1 -- 172.21.15.6:0/3601662852 >> v1:172.21.15.161:6789/0 conn(0x7f5c700c8eb0 legacy=0x7f5c700cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:27.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.804+0000 7f5c6ed9d640 1 -- 172.21.15.6:0/3601662852 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c70158eb0 con 0x7f5c700cdd30 2023-07-21T22:57:27.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.804+0000 7f5c6e59c640 1 --2- 172.21.15.6:0/3601662852 >> v2:172.21.15.161:3300/0 conn(0x7f5c70155c40 0x7f5c700c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:27.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.804+0000 7f5c6ed9d640 1 --2- 172.21.15.6:0/3601662852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c700cdd30 0x7f5c7015bbb0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f5c7006e120 tx=0x7f5c6801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b3bd8fe1f5d076 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:27.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.804+0000 7f5c6dd9b640 1 -- 172.21.15.6:0/3601662852 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c680a56b0 con 0x7f5c700cdd30 2023-07-21T22:57:27.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.804+0000 7f5c6dd9b640 1 -- 172.21.15.6:0/3601662852 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c680a5810 con 0x7f5c700cdd30 2023-07-21T22:57:27.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.804+0000 7f5c6dd9b640 1 -- 172.21.15.6:0/3601662852 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c680a5ba0 con 0x7f5c700cdd30 2023-07-21T22:57:27.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c7499f640 1 -- 172.21.15.6:0/3601662852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c700cdd30 msgr2=0x7f5c7015bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:27.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c7499f640 1 --2- 172.21.15.6:0/3601662852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c700cdd30 0x7f5c7015bbb0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f5c7006e120 tx=0x7f5c6801c960 comp rx=0 tx=0).stop 2023-07-21T22:57:27.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c7499f640 1 -- 172.21.15.6:0/3601662852 shutdown_connections 2023-07-21T22:57:27.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c7499f640 1 --2- 172.21.15.6:0/3601662852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c700cdd30 0x7f5c7015bbb0 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c7499f640 1 --2- 172.21.15.6:0/3601662852 >> v2:172.21.15.161:3300/0 conn(0x7f5c70155c40 0x7f5c700c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c7499f640 1 -- 172.21.15.6:0/3601662852 >> 172.21.15.6:0/3601662852 conn(0x7f5c700cada0 msgr2=0x7f5c700cb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c7499f640 1 -- 172.21.15.6:0/3601662852 shutdown_connections 2023-07-21T22:57:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c7499f640 1 -- 172.21.15.6:0/3601662852 wait complete. 2023-07-21T22:57:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c7499f640 1 Processor -- start 2023-07-21T22:57:27.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c7499f640 1 -- start start 2023-07-21T22:57:27.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c7499f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c700c8eb0 0x7f5c7014f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:27.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c7499f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c700cdd30 0x7f5c70165150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:27.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c7499f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c70155c40 0x7f5c70165690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:27.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c7499f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7014fe00 con 0x7f5c70155c40 2023-07-21T22:57:27.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c7499f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c701661d0 con 0x7f5c700cdd30 2023-07-21T22:57:27.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c7499f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c701664b0 con 0x7f5c700c8eb0 2023-07-21T22:57:27.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c6ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c70155c40 0x7f5c70165690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:27.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c6ed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c70155c40 0x7f5c70165690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38934/0 (socket says 172.21.15.6:38934) 2023-07-21T22:57:27.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c6ed9d640 1 -- 172.21.15.6:0/1360768313 learned_addr learned my addr 172.21.15.6:0/1360768313 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:27.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c67fff640 1 --2- 172.21.15.6:0/1360768313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c700cdd30 0x7f5c70165150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:27.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.808+0000 7f5c6e59c640 1 --2- 172.21.15.6:0/1360768313 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c700c8eb0 0x7f5c7014f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:27.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.812+0000 7f5c6ed9d640 1 -- 172.21.15.6:0/1360768313 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c700c8eb0 msgr2=0x7f5c7014f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:27.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.812+0000 7f5c6ed9d640 1 --2- 172.21.15.6:0/1360768313 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c700c8eb0 0x7f5c7014f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.812+0000 7f5c6ed9d640 1 -- 172.21.15.6:0/1360768313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c700cdd30 msgr2=0x7f5c70165150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:27.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.812+0000 7f5c6ed9d640 1 --2- 172.21.15.6:0/1360768313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c700cdd30 0x7f5c70165150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:27.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.812+0000 7f5c6ed9d640 1 -- 172.21.15.6:0/1360768313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c68009b30 con 0x7f5c70155c40 2023-07-21T22:57:27.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.812+0000 7f5c67fff640 1 --2- 172.21.15.6:0/1360768313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c700cdd30 0x7f5c70165150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:27.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.812+0000 7f5c6ed9d640 1 --2- 172.21.15.6:0/1360768313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c70155c40 0x7f5c70165690 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f5c6801a590 tx=0x7f5c68019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:27.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.812+0000 7f5c66ffd640 1 -- 172.21.15.6:0/1360768313 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c680b8670 con 0x7f5c70155c40 2023-07-21T22:57:27.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.812+0000 7f5c66ffd640 1 -- 172.21.15.6:0/1360768313 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c680b87d0 con 0x7f5c70155c40 2023-07-21T22:57:27.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.812+0000 7f5c7499f640 1 -- 172.21.15.6:0/1360768313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c70157290 con 0x7f5c70155c40 2023-07-21T22:57:27.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.812+0000 7f5c66ffd640 1 -- 172.21.15.6:0/1360768313 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c680b8bc0 con 0x7f5c70155c40 2023-07-21T22:57:27.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.812+0000 7f5c7499f640 1 -- 172.21.15.6:0/1360768313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c70157850 con 0x7f5c70155c40 2023-07-21T22:57:27.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.812+0000 7f5c7499f640 1 -- 172.21.15.6:0/1360768313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c700678d0 con 0x7f5c70155c40 2023-07-21T22:57:27.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.812+0000 7f5c66ffd640 1 -- 172.21.15.6:0/1360768313 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5c680b8d20 con 0x7f5c70155c40 2023-07-21T22:57:27.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.812+0000 7f5c66ffd640 1 --2- 172.21.15.6:0/1360768313 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f5c500663d0 0x7f5c50068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:27.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.812+0000 7f5c66ffd640 1 -- 172.21.15.6:0/1360768313 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f5c6811f200 con 0x7f5c70155c40 2023-07-21T22:57:27.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.816+0000 7f5c6e59c640 1 --2- 172.21.15.6:0/1360768313 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f5c500663d0 0x7f5c50068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:27.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.816+0000 7f5c6e59c640 1 --2- 172.21.15.6:0/1360768313 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f5c500663d0 0x7f5c50068880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c60006fd0 tx=0x7f5c60008040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:27.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.816+0000 7f5c66ffd640 1 -- 172.21.15.6:0/1360768313 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5c680ec5a0 con 0x7f5c70155c40 2023-07-21T22:57:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.968+0000 7f5c7499f640 1 -- 172.21.15.6:0/1360768313 --> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c7006c1b0 con 0x7f5c500663d0 2023-07-21T22:57:28.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.976+0000 7f5c66ffd640 1 -- 172.21.15.6:0/1360768313 <== mgr.9760 v2:172.21.15.161:6832/406143921 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306209 (secure 0 0 0) 0x7f5c6000c050 con 0x7f5c500663d0 2023-07-21T22:57:28.016 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:28.018 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:57:28.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.980+0000 7f5c7499f640 1 -- 172.21.15.6:0/1360768313 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f5c500663d0 msgr2=0x7f5c50068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:28.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.980+0000 7f5c7499f640 1 --2- 172.21.15.6:0/1360768313 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f5c500663d0 0x7f5c50068880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c60006fd0 tx=0x7f5c60008040 comp rx=0 tx=0).stop 2023-07-21T22:57:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.980+0000 7f5c7499f640 1 -- 172.21.15.6:0/1360768313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c70155c40 msgr2=0x7f5c70165690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.980+0000 7f5c7499f640 1 --2- 172.21.15.6:0/1360768313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c70155c40 0x7f5c70165690 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f5c6801a590 tx=0x7f5c68019700 comp rx=0 tx=0).stop 2023-07-21T22:57:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.980+0000 7f5c7499f640 1 -- 172.21.15.6:0/1360768313 shutdown_connections 2023-07-21T22:57:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.980+0000 7f5c7499f640 1 --2- 172.21.15.6:0/1360768313 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f5c500663d0 0x7f5c50068880 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.980+0000 7f5c7499f640 1 --2- 172.21.15.6:0/1360768313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c70155c40 0x7f5c70165690 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.980+0000 7f5c7499f640 1 --2- 172.21.15.6:0/1360768313 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c700cdd30 0x7f5c70165150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.980+0000 7f5c7499f640 1 --2- 172.21.15.6:0/1360768313 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c700c8eb0 0x7f5c7014f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.980+0000 7f5c7499f640 1 -- 172.21.15.6:0/1360768313 >> 172.21.15.6:0/1360768313 conn(0x7f5c700cada0 msgr2=0x7f5c70152580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.980+0000 7f5c7499f640 1 -- 172.21.15.6:0/1360768313 shutdown_connections 2023-07-21T22:57:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:27.980+0000 7f5c7499f640 1 -- 172.21.15.6:0/1360768313 wait complete. 2023-07-21T22:57:28.035 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-21T22:57:27.157054+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":363132,"kb_used_data":19644,"kb_used_omap":0,"kb_used_meta":343424,"kb_avail":754611588,"statfs":{"total":773094113280,"available":772722266112,"internally_reserved":0,"allocated":20115456,"data_stored":10903612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":351666176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.672691"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.505320+0000","last_change":"2023-07-21T22:57:22.505320+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.505320+0000","last_undegraded":"2023-07-21T22:57:22.505320+0000","last_fullsized":"2023-07-21T22:57:22.505320+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.508207+0000","last_change":"2023-07-21T22:57:22.508207+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.508207+0000","last_undegraded":"2023-07-21T22:57:22.508207+0000","last_fullsized":"2023-07-21T22:57:22.508207+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.504124+0000","last_change":"2023-07-21T22:57:22.504124+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.504124+0000","last_undegraded":"2023-07-21T22:57:22.504124+0000","last_fullsized":"2023-07-21T22:57:22.504124+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.504260+0000","last_change":"2023-07-21T22:57:22.504260+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.504260+0000","last_undegraded":"2023-07-21T22:57:22.504260+0000","last_fullsized":"2023-07-21T22:57:22.504260+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507646+0000","last_change":"2023-07-21T22:57:22.507646+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507646+0000","last_undegraded":"2023-07-21T22:57:22.507646+0000","last_fullsized":"2023-07-21T22:57:22.507646+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.506798+0000","last_change":"2023-07-21T22:57:22.506798+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.506798+0000","last_undegraded":"2023-07-21T22:57:22.506798+0000","last_fullsized":"2023-07-21T22:57:22.506798+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.502003+0000","last_change":"2023-07-21T22:57:22.502003+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.502003+0000","last_undegraded":"2023-07-21T22:57:22.502003+0000","last_fullsized":"2023-07-21T22:57:22.502003+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.502238+0000","last_change":"2023-07-21T22:57:22.502238+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.502238+0000","last_undegraded":"2023-07-21T22:57:22.502238+0000","last_fullsized":"2023-07-21T22:57:22.502238+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501753+0000","last_change":"2023-07-21T22:57:22.501753+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501753+0000","last_undegraded":"2023-07-21T22:57:22.501753+0000","last_fullsized":"2023-07-21T22:57:22.501753+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501227+0000","last_change":"2023-07-21T22:57:22.501227+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501227+0000","last_undegraded":"2023-07-21T22:57:22.501227+0000","last_fullsized":"2023-07-21T22:57:22.501227+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.503205+0000","last_change":"2023-07-21T22:57:22.503205+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.503205+0000","last_undegraded":"2023-07-21T22:57:22.503205+0000","last_fullsized":"2023-07-21T22:57:22.503205+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.508398+0000","last_change":"2023-07-21T22:57:22.508398+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.508398+0000","last_undegraded":"2023-07-21T22:57:22.508398+0000","last_fullsized":"2023-07-21T22:57:22.508398+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501674+0000","last_change":"2023-07-21T22:57:22.501674+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501674+0000","last_undegraded":"2023-07-21T22:57:22.501674+0000","last_fullsized":"2023-07-21T22:57:22.501674+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501933+0000","last_change":"2023-07-21T22:57:22.501933+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501933+0000","last_undegraded":"2023-07-21T22:57:22.501933+0000","last_fullsized":"2023-07-21T22:57:22.501933+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.502440+0000","last_change":"2023-07-21T22:57:22.502440+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.502440+0000","last_undegraded":"2023-07-21T22:57:22.502440+0000","last_fullsized":"2023-07-21T22:57:22.502440+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.504429+0000","last_change":"2023-07-21T22:57:22.504429+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.504429+0000","last_undegraded":"2023-07-21T22:57:22.504429+0000","last_fullsized":"2023-07-21T22:57:22.504429+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501213+0000","last_change":"2023-07-21T22:57:22.501213+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501213+0000","last_undegraded":"2023-07-21T22:57:22.501213+0000","last_fullsized":"2023-07-21T22:57:22.501213+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.506940+0000","last_change":"2023-07-21T22:57:22.506940+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.506940+0000","last_undegraded":"2023-07-21T22:57:22.506940+0000","last_fullsized":"2023-07-21T22:57:22.506940+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.502755+0000","last_change":"2023-07-21T22:57:22.502755+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.502755+0000","last_undegraded":"2023-07-21T22:57:22.502755+0000","last_fullsized":"2023-07-21T22:57:22.502755+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.510199+0000","last_change":"2023-07-21T22:57:22.510199+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.510199+0000","last_undegraded":"2023-07-21T22:57:22.510199+0000","last_fullsized":"2023-07-21T22:57:22.510199+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501147+0000","last_change":"2023-07-21T22:57:22.501147+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501147+0000","last_undegraded":"2023-07-21T22:57:22.501147+0000","last_fullsized":"2023-07-21T22:57:22.501147+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.506257+0000","last_change":"2023-07-21T22:57:22.506257+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.506257+0000","last_undegraded":"2023-07-21T22:57:22.506257+0000","last_fullsized":"2023-07-21T22:57:22.506257+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501209+0000","last_change":"2023-07-21T22:57:22.501209+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501209+0000","last_undegraded":"2023-07-21T22:57:22.501209+0000","last_fullsized":"2023-07-21T22:57:22.501209+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.503707+0000","last_change":"2023-07-21T22:57:22.503707+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.503707+0000","last_undegraded":"2023-07-21T22:57:22.503707+0000","last_fullsized":"2023-07-21T22:57:22.503707+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501575+0000","last_change":"2023-07-21T22:57:22.501575+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501575+0000","last_undegraded":"2023-07-21T22:57:22.501575+0000","last_fullsized":"2023-07-21T22:57:22.501575+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.509358+0000","last_change":"2023-07-21T22:57:22.509358+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.509358+0000","last_undegraded":"2023-07-21T22:57:22.509358+0000","last_fullsized":"2023-07-21T22:57:22.509358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.508452+0000","last_change":"2023-07-21T22:57:22.508452+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.508452+0000","last_undegraded":"2023-07-21T22:57:22.508452+0000","last_fullsized":"2023-07-21T22:57:22.508452+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.511958+0000","last_change":"2023-07-21T22:57:22.511958+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.511958+0000","last_undegraded":"2023-07-21T22:57:22.511958+0000","last_fullsized":"2023-07-21T22:57:22.511958+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507891+0000","last_change":"2023-07-21T22:57:22.507891+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507891+0000","last_undegraded":"2023-07-21T22:57:22.507891+0000","last_fullsized":"2023-07-21T22:57:22.507891+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507642+0000","last_change":"2023-07-21T22:57:22.507642+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507642+0000","last_undegraded":"2023-07-21T22:57:22.507642+0000","last_fullsized":"2023-07-21T22:57:22.507642+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501878+0000","last_change":"2023-07-21T22:57:22.501878+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501878+0000","last_undegraded":"2023-07-21T22:57:22.501878+0000","last_fullsized":"2023-07-21T22:57:22.501878+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507713+0000","last_change":"2023-07-21T22:57:22.507713+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507713+0000","last_undegraded":"2023-07-21T22:57:22.507713+0000","last_fullsized":"2023-07-21T22:57:22.507713+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.506691+0000","last_change":"2023-07-21T22:57:22.506691+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.506691+0000","last_undegraded":"2023-07-21T22:57:22.506691+0000","last_fullsized":"2023-07-21T22:57:22.506691+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.527165+0000","last_change":"2023-07-21T22:57:22.526058+0000","last_active":"2023-07-21T22:57:22.527165+0000","last_peered":"2023-07-21T22:57:22.527165+0000","last_clean":"2023-07-21T22:57:22.527165+0000","last_became_active":"2023-07-21T22:57:22.525745+0000","last_became_peered":"2023-07-21T22:57:22.525745+0000","last_unstale":"2023-07-21T22:57:22.527165+0000","last_undegraded":"2023-07-21T22:57:22.527165+0000","last_fullsized":"2023-07-21T22:57:22.527165+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:58.912111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.503648+0000","last_change":"2023-07-21T22:57:22.503648+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.503648+0000","last_undegraded":"2023-07-21T22:57:22.503648+0000","last_fullsized":"2023-07-21T22:57:22.503648+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.517378+0000","last_change":"2023-07-21T22:57:22.513972+0000","last_active":"2023-07-21T22:57:22.517378+0000","last_peered":"2023-07-21T22:57:22.517378+0000","last_clean":"2023-07-21T22:57:22.517378+0000","last_became_active":"2023-07-21T22:57:22.513687+0000","last_became_peered":"2023-07-21T22:57:22.513687+0000","last_unstale":"2023-07-21T22:57:22.517378+0000","last_undegraded":"2023-07-21T22:57:22.517378+0000","last_fullsized":"2023-07-21T22:57:22.517378+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:27:58.827939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501360+0000","last_change":"2023-07-21T22:57:22.501360+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501360+0000","last_undegraded":"2023-07-21T22:57:22.501360+0000","last_fullsized":"2023-07-21T22:57:22.501360+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.522189+0000","last_change":"2023-07-21T22:57:22.520699+0000","last_active":"2023-07-21T22:57:22.522189+0000","last_peered":"2023-07-21T22:57:22.522189+0000","last_clean":"2023-07-21T22:57:22.522189+0000","last_became_active":"2023-07-21T22:57:22.520379+0000","last_became_peered":"2023-07-21T22:57:22.520379+0000","last_unstale":"2023-07-21T22:57:22.522189+0000","last_undegraded":"2023-07-21T22:57:22.522189+0000","last_fullsized":"2023-07-21T22:57:22.522189+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:07:38.295787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507416+0000","last_change":"2023-07-21T22:57:22.507416+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507416+0000","last_undegraded":"2023-07-21T22:57:22.507416+0000","last_fullsized":"2023-07-21T22:57:22.507416+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.518230+0000","last_change":"2023-07-21T22:57:22.512994+0000","last_active":"2023-07-21T22:57:22.518230+0000","last_peered":"2023-07-21T22:57:22.518230+0000","last_clean":"2023-07-21T22:57:22.518230+0000","last_became_active":"2023-07-21T22:57:22.512632+0000","last_became_peered":"2023-07-21T22:57:22.512632+0000","last_unstale":"2023-07-21T22:57:22.518230+0000","last_undegraded":"2023-07-21T22:57:22.518230+0000","last_fullsized":"2023-07-21T22:57:22.518230+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:23:39.269897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.498988+0000","last_change":"2023-07-21T22:57:22.498988+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.498988+0000","last_undegraded":"2023-07-21T22:57:22.498988+0000","last_fullsized":"2023-07-21T22:57:22.498988+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.523892+0000","last_change":"2023-07-21T22:57:22.520897+0000","last_active":"2023-07-21T22:57:22.523892+0000","last_peered":"2023-07-21T22:57:22.523892+0000","last_clean":"2023-07-21T22:57:22.523892+0000","last_became_active":"2023-07-21T22:57:22.520541+0000","last_became_peered":"2023-07-21T22:57:22.520541+0000","last_unstale":"2023-07-21T22:57:22.523892+0000","last_undegraded":"2023-07-21T22:57:22.523892+0000","last_fullsized":"2023-07-21T22:57:22.523892+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:24:59.305924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.500012+0000","last_change":"2023-07-21T22:57:22.500012+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.500012+0000","last_undegraded":"2023-07-21T22:57:22.500012+0000","last_fullsized":"2023-07-21T22:57:22.500012+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521216+0000","last_change":"2023-07-21T22:57:22.516123+0000","last_active":"2023-07-21T22:57:22.521216+0000","last_peered":"2023-07-21T22:57:22.521216+0000","last_clean":"2023-07-21T22:57:22.521216+0000","last_became_active":"2023-07-21T22:57:22.515462+0000","last_became_peered":"2023-07-21T22:57:22.515462+0000","last_unstale":"2023-07-21T22:57:22.521216+0000","last_undegraded":"2023-07-21T22:57:22.521216+0000","last_fullsized":"2023-07-21T22:57:22.521216+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:59:16.614841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.505427+0000","last_change":"2023-07-21T22:57:22.505427+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.505427+0000","last_undegraded":"2023-07-21T22:57:22.505427+0000","last_fullsized":"2023-07-21T22:57:22.505427+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.518744+0000","last_change":"2023-07-21T22:57:22.516916+0000","last_active":"2023-07-21T22:57:22.518744+0000","last_peered":"2023-07-21T22:57:22.518744+0000","last_clean":"2023-07-21T22:57:22.518744+0000","last_became_active":"2023-07-21T22:57:22.516644+0000","last_became_peered":"2023-07-21T22:57:22.516644+0000","last_unstale":"2023-07-21T22:57:22.518744+0000","last_undegraded":"2023-07-21T22:57:22.518744+0000","last_fullsized":"2023-07-21T22:57:22.518744+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:37:05.914994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.504855+0000","last_change":"2023-07-21T22:57:22.504855+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.504855+0000","last_undegraded":"2023-07-21T22:57:22.504855+0000","last_fullsized":"2023-07-21T22:57:22.504855+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.511885+0000","last_change":"2023-07-21T22:57:22.509620+0000","last_active":"2023-07-21T22:57:22.511885+0000","last_peered":"2023-07-21T22:57:22.511885+0000","last_clean":"2023-07-21T22:57:22.511885+0000","last_became_active":"2023-07-21T22:57:22.509333+0000","last_became_peered":"2023-07-21T22:57:22.509333+0000","last_unstale":"2023-07-21T22:57:22.511885+0000","last_undegraded":"2023-07-21T22:57:22.511885+0000","last_fullsized":"2023-07-21T22:57:22.511885+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:23:03.803937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.499063+0000","last_change":"2023-07-21T22:57:22.499063+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.499063+0000","last_undegraded":"2023-07-21T22:57:22.499063+0000","last_fullsized":"2023-07-21T22:57:22.499063+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521476+0000","last_change":"2023-07-21T22:57:22.515998+0000","last_active":"2023-07-21T22:57:22.521476+0000","last_peered":"2023-07-21T22:57:22.521476+0000","last_clean":"2023-07-21T22:57:22.521476+0000","last_became_active":"2023-07-21T22:57:22.514997+0000","last_became_peered":"2023-07-21T22:57:22.514997+0000","last_unstale":"2023-07-21T22:57:22.521476+0000","last_undegraded":"2023-07-21T22:57:22.521476+0000","last_fullsized":"2023-07-21T22:57:22.521476+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:23.065484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507152+0000","last_change":"2023-07-21T22:57:22.507152+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507152+0000","last_undegraded":"2023-07-21T22:57:22.507152+0000","last_fullsized":"2023-07-21T22:57:22.507152+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521842+0000","last_change":"2023-07-21T22:57:22.516566+0000","last_active":"2023-07-21T22:57:22.521842+0000","last_peered":"2023-07-21T22:57:22.521842+0000","last_clean":"2023-07-21T22:57:22.521842+0000","last_became_active":"2023-07-21T22:57:22.516280+0000","last_became_peered":"2023-07-21T22:57:22.516280+0000","last_unstale":"2023-07-21T22:57:22.521842+0000","last_undegraded":"2023-07-21T22:57:22.521842+0000","last_fullsized":"2023-07-21T22:57:22.521842+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:49:23.225650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501999+0000","last_change":"2023-07-21T22:57:22.501999+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501999+0000","last_undegraded":"2023-07-21T22:57:22.501999+0000","last_fullsized":"2023-07-21T22:57:22.501999+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521305+0000","last_change":"2023-07-21T22:57:22.516536+0000","last_active":"2023-07-21T22:57:22.521305+0000","last_peered":"2023-07-21T22:57:22.521305+0000","last_clean":"2023-07-21T22:57:22.521305+0000","last_became_active":"2023-07-21T22:57:22.516241+0000","last_became_peered":"2023-07-21T22:57:22.516241+0000","last_unstale":"2023-07-21T22:57:22.521305+0000","last_undegraded":"2023-07-21T22:57:22.521305+0000","last_fullsized":"2023-07-21T22:57:22.521305+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:23:33.195419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.502316+0000","last_change":"2023-07-21T22:57:22.502316+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.502316+0000","last_undegraded":"2023-07-21T22:57:22.502316+0000","last_fullsized":"2023-07-21T22:57:22.502316+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.513214+0000","last_change":"2023-07-21T22:57:22.511600+0000","last_active":"2023-07-21T22:57:22.513214+0000","last_peered":"2023-07-21T22:57:22.513214+0000","last_clean":"2023-07-21T22:57:22.513214+0000","last_became_active":"2023-07-21T22:57:22.511263+0000","last_became_peered":"2023-07-21T22:57:22.511263+0000","last_unstale":"2023-07-21T22:57:22.513214+0000","last_undegraded":"2023-07-21T22:57:22.513214+0000","last_fullsized":"2023-07-21T22:57:22.513214+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:29:57.199767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.505444+0000","last_change":"2023-07-21T22:57:22.505444+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.505444+0000","last_undegraded":"2023-07-21T22:57:22.505444+0000","last_fullsized":"2023-07-21T22:57:22.505444+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.517415+0000","last_change":"2023-07-21T22:57:22.513380+0000","last_active":"2023-07-21T22:57:22.517415+0000","last_peered":"2023-07-21T22:57:22.517415+0000","last_clean":"2023-07-21T22:57:22.517415+0000","last_became_active":"2023-07-21T22:57:22.512923+0000","last_became_peered":"2023-07-21T22:57:22.512923+0000","last_unstale":"2023-07-21T22:57:22.517415+0000","last_undegraded":"2023-07-21T22:57:22.517415+0000","last_fullsized":"2023-07-21T22:57:22.517415+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:10:24.583845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.503913+0000","last_change":"2023-07-21T22:57:22.503913+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.503913+0000","last_undegraded":"2023-07-21T22:57:22.503913+0000","last_fullsized":"2023-07-21T22:57:22.503913+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.522701+0000","last_change":"2023-07-21T22:57:22.521562+0000","last_active":"2023-07-21T22:57:22.522701+0000","last_peered":"2023-07-21T22:57:22.522701+0000","last_clean":"2023-07-21T22:57:22.522701+0000","last_became_active":"2023-07-21T22:57:22.521270+0000","last_became_peered":"2023-07-21T22:57:22.521270+0000","last_unstale":"2023-07-21T22:57:22.522701+0000","last_undegraded":"2023-07-21T22:57:22.522701+0000","last_fullsized":"2023-07-21T22:57:22.522701+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:09:59.644328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.505067+0000","last_change":"2023-07-21T22:57:22.505067+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.505067+0000","last_undegraded":"2023-07-21T22:57:22.505067+0000","last_fullsized":"2023-07-21T22:57:22.505067+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.518162+0000","last_change":"2023-07-21T22:57:22.512259+0000","last_active":"2023-07-21T22:57:22.518162+0000","last_peered":"2023-07-21T22:57:22.518162+0000","last_clean":"2023-07-21T22:57:22.518162+0000","last_became_active":"2023-07-21T22:57:22.511911+0000","last_became_peered":"2023-07-21T22:57:22.511911+0000","last_unstale":"2023-07-21T22:57:22.518162+0000","last_undegraded":"2023-07-21T22:57:22.518162+0000","last_fullsized":"2023-07-21T22:57:22.518162+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:32:49.994716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.508740+0000","last_change":"2023-07-21T22:57:22.508740+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.508740+0000","last_undegraded":"2023-07-21T22:57:22.508740+0000","last_fullsized":"2023-07-21T22:57:22.508740+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.514840+0000","last_change":"2023-07-21T22:57:22.514061+0000","last_active":"2023-07-21T22:57:22.514840+0000","last_peered":"2023-07-21T22:57:22.514840+0000","last_clean":"2023-07-21T22:57:22.514840+0000","last_became_active":"2023-07-21T22:57:22.513784+0000","last_became_peered":"2023-07-21T22:57:22.513784+0000","last_unstale":"2023-07-21T22:57:22.514840+0000","last_undegraded":"2023-07-21T22:57:22.514840+0000","last_fullsized":"2023-07-21T22:57:22.514840+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:26:35.733602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501393+0000","last_change":"2023-07-21T22:57:22.501393+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501393+0000","last_undegraded":"2023-07-21T22:57:22.501393+0000","last_fullsized":"2023-07-21T22:57:22.501393+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521245+0000","last_change":"2023-07-21T22:57:22.516848+0000","last_active":"2023-07-21T22:57:22.521245+0000","last_peered":"2023-07-21T22:57:22.521245+0000","last_clean":"2023-07-21T22:57:22.521245+0000","last_became_active":"2023-07-21T22:57:22.516566+0000","last_became_peered":"2023-07-21T22:57:22.516566+0000","last_unstale":"2023-07-21T22:57:22.521245+0000","last_undegraded":"2023-07-21T22:57:22.521245+0000","last_fullsized":"2023-07-21T22:57:22.521245+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:05:17.516983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.499454+0000","last_change":"2023-07-21T22:57:22.499454+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.499454+0000","last_undegraded":"2023-07-21T22:57:22.499454+0000","last_fullsized":"2023-07-21T22:57:22.499454+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.524505+0000","last_change":"2023-07-21T22:57:22.522644+0000","last_active":"2023-07-21T22:57:22.524505+0000","last_peered":"2023-07-21T22:57:22.524505+0000","last_clean":"2023-07-21T22:57:22.524505+0000","last_became_active":"2023-07-21T22:57:22.522294+0000","last_became_peered":"2023-07-21T22:57:22.522294+0000","last_unstale":"2023-07-21T22:57:22.524505+0000","last_undegraded":"2023-07-21T22:57:22.524505+0000","last_fullsized":"2023-07-21T22:57:22.524505+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:00:59.804414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.499971+0000","last_change":"2023-07-21T22:57:22.499971+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.499971+0000","last_undegraded":"2023-07-21T22:57:22.499971+0000","last_fullsized":"2023-07-21T22:57:22.499971+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521580+0000","last_change":"2023-07-21T22:57:22.518224+0000","last_active":"2023-07-21T22:57:22.521580+0000","last_peered":"2023-07-21T22:57:22.521580+0000","last_clean":"2023-07-21T22:57:22.521580+0000","last_became_active":"2023-07-21T22:57:22.517933+0000","last_became_peered":"2023-07-21T22:57:22.517933+0000","last_unstale":"2023-07-21T22:57:22.521580+0000","last_undegraded":"2023-07-21T22:57:22.521580+0000","last_fullsized":"2023-07-21T22:57:22.521580+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:50:21.438717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.499952+0000","last_change":"2023-07-21T22:57:22.499952+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.499952+0000","last_undegraded":"2023-07-21T22:57:22.499952+0000","last_fullsized":"2023-07-21T22:57:22.499952+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.518212+0000","last_change":"2023-07-21T22:57:22.512688+0000","last_active":"2023-07-21T22:57:22.518212+0000","last_peered":"2023-07-21T22:57:22.518212+0000","last_clean":"2023-07-21T22:57:22.518212+0000","last_became_active":"2023-07-21T22:57:22.512404+0000","last_became_peered":"2023-07-21T22:57:22.512404+0000","last_unstale":"2023-07-21T22:57:22.518212+0000","last_undegraded":"2023-07-21T22:57:22.518212+0000","last_fullsized":"2023-07-21T22:57:22.518212+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:36:04.149908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.503744+0000","last_change":"2023-07-21T22:57:22.503744+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.503744+0000","last_undegraded":"2023-07-21T22:57:22.503744+0000","last_fullsized":"2023-07-21T22:57:22.503744+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.523928+0000","last_change":"2023-07-21T22:57:22.523033+0000","last_active":"2023-07-21T22:57:22.523928+0000","last_peered":"2023-07-21T22:57:22.523928+0000","last_clean":"2023-07-21T22:57:22.523928+0000","last_became_active":"2023-07-21T22:57:22.522687+0000","last_became_peered":"2023-07-21T22:57:22.522687+0000","last_unstale":"2023-07-21T22:57:22.523928+0000","last_undegraded":"2023-07-21T22:57:22.523928+0000","last_fullsized":"2023-07-21T22:57:22.523928+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:32:04.938461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507997+0000","last_change":"2023-07-21T22:57:22.507997+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507997+0000","last_undegraded":"2023-07-21T22:57:22.507997+0000","last_fullsized":"2023-07-21T22:57:22.507997+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.523852+0000","last_change":"2023-07-21T22:57:22.520034+0000","last_active":"2023-07-21T22:57:22.523852+0000","last_peered":"2023-07-21T22:57:22.523852+0000","last_clean":"2023-07-21T22:57:22.523852+0000","last_became_active":"2023-07-21T22:57:22.518945+0000","last_became_peered":"2023-07-21T22:57:22.518945+0000","last_unstale":"2023-07-21T22:57:22.523852+0000","last_undegraded":"2023-07-21T22:57:22.523852+0000","last_fullsized":"2023-07-21T22:57:22.523852+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:58:55.877448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.512514+0000","last_change":"2023-07-21T22:57:22.512514+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.512514+0000","last_undegraded":"2023-07-21T22:57:22.512514+0000","last_fullsized":"2023-07-21T22:57:22.512514+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.520035+0000","last_change":"2023-07-21T22:57:22.519089+0000","last_active":"2023-07-21T22:57:22.520035+0000","last_peered":"2023-07-21T22:57:22.520035+0000","last_clean":"2023-07-21T22:57:22.520035+0000","last_became_active":"2023-07-21T22:57:22.518879+0000","last_became_peered":"2023-07-21T22:57:22.518879+0000","last_unstale":"2023-07-21T22:57:22.520035+0000","last_undegraded":"2023-07-21T22:57:22.520035+0000","last_fullsized":"2023-07-21T22:57:22.520035+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:13:00.596939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.503477+0000","last_change":"2023-07-21T22:57:22.503477+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.503477+0000","last_undegraded":"2023-07-21T22:57:22.503477+0000","last_fullsized":"2023-07-21T22:57:22.503477+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.517334+0000","last_change":"2023-07-21T22:57:22.513969+0000","last_active":"2023-07-21T22:57:22.517334+0000","last_peered":"2023-07-21T22:57:22.517334+0000","last_clean":"2023-07-21T22:57:22.517334+0000","last_became_active":"2023-07-21T22:57:22.513667+0000","last_became_peered":"2023-07-21T22:57:22.513667+0000","last_unstale":"2023-07-21T22:57:22.517334+0000","last_undegraded":"2023-07-21T22:57:22.517334+0000","last_fullsized":"2023-07-21T22:57:22.517334+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:33:06.835207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.509163+0000","last_change":"2023-07-21T22:57:22.509163+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.509163+0000","last_undegraded":"2023-07-21T22:57:22.509163+0000","last_fullsized":"2023-07-21T22:57:22.509163+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.524484+0000","last_change":"2023-07-21T22:57:22.522623+0000","last_active":"2023-07-21T22:57:22.524484+0000","last_peered":"2023-07-21T22:57:22.524484+0000","last_clean":"2023-07-21T22:57:22.524484+0000","last_became_active":"2023-07-21T22:57:22.522369+0000","last_became_peered":"2023-07-21T22:57:22.522369+0000","last_unstale":"2023-07-21T22:57:22.524484+0000","last_undegraded":"2023-07-21T22:57:22.524484+0000","last_fullsized":"2023-07-21T22:57:22.524484+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:16:06.371322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"180'326","reported_seq":1211,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.507739+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:57:22.507739+0000","last_peered":"2023-07-21T22:57:22.507739+0000","last_clean":"2023-07-21T22:57:22.507739+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:57:22.507739+0000","last_undegraded":"2023-07-21T22:57:22.507739+0000","last_fullsized":"2023-07-21T22:57:22.507739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:53:36.607636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":353,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.505706+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:57:22.505706+0000","last_peered":"2023-07-21T22:57:22.505706+0000","last_clean":"2023-07-21T22:57:22.505706+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:57:22.505706+0000","last_undegraded":"2023-07-21T22:57:22.505706+0000","last_fullsized":"2023-07-21T22:57:22.505706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:52:45.754065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.509650+0000","last_change":"2023-07-21T22:57:22.509650+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.509650+0000","last_undegraded":"2023-07-21T22:57:22.509650+0000","last_fullsized":"2023-07-21T22:57:22.509650+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.512458+0000","last_change":"2023-07-21T22:57:22.511800+0000","last_active":"2023-07-21T22:57:22.512458+0000","last_peered":"2023-07-21T22:57:22.512458+0000","last_clean":"2023-07-21T22:57:22.512458+0000","last_became_active":"2023-07-21T22:57:22.511372+0000","last_became_peered":"2023-07-21T22:57:22.511372+0000","last_unstale":"2023-07-21T22:57:22.512458+0000","last_undegraded":"2023-07-21T22:57:22.512458+0000","last_fullsized":"2023-07-21T22:57:22.512458+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:05:20.517665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":314,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.507608+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:57:22.507608+0000","last_peered":"2023-07-21T22:57:22.507608+0000","last_clean":"2023-07-21T22:57:22.507608+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:57:22.507608+0000","last_undegraded":"2023-07-21T22:57:22.507608+0000","last_fullsized":"2023-07-21T22:57:22.507608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:34:26.252489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.499199+0000","last_change":"2023-07-21T22:57:22.499199+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.499199+0000","last_undegraded":"2023-07-21T22:57:22.499199+0000","last_fullsized":"2023-07-21T22:57:22.499199+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.518672+0000","last_change":"2023-07-21T22:57:22.515084+0000","last_active":"2023-07-21T22:57:22.518672+0000","last_peered":"2023-07-21T22:57:22.518672+0000","last_clean":"2023-07-21T22:57:22.518672+0000","last_became_active":"2023-07-21T22:57:22.514810+0000","last_became_peered":"2023-07-21T22:57:22.514810+0000","last_unstale":"2023-07-21T22:57:22.518672+0000","last_undegraded":"2023-07-21T22:57:22.518672+0000","last_fullsized":"2023-07-21T22:57:22.518672+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:13:41.728908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":317,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.505310+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:57:22.505310+0000","last_peered":"2023-07-21T22:57:22.505310+0000","last_clean":"2023-07-21T22:57:22.505310+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:57:22.505310+0000","last_undegraded":"2023-07-21T22:57:22.505310+0000","last_fullsized":"2023-07-21T22:57:22.505310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:06:51.965840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507228+0000","last_change":"2023-07-21T22:57:22.507228+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507228+0000","last_undegraded":"2023-07-21T22:57:22.507228+0000","last_fullsized":"2023-07-21T22:57:22.507228+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521495+0000","last_change":"2023-07-21T22:57:22.516060+0000","last_active":"2023-07-21T22:57:22.521495+0000","last_peered":"2023-07-21T22:57:22.521495+0000","last_clean":"2023-07-21T22:57:22.521495+0000","last_became_active":"2023-07-21T22:57:22.515686+0000","last_became_peered":"2023-07-21T22:57:22.515686+0000","last_unstale":"2023-07-21T22:57:22.521495+0000","last_undegraded":"2023-07-21T22:57:22.521495+0000","last_fullsized":"2023-07-21T22:57:22.521495+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:18:25.503485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":353,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.505347+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:57:22.505347+0000","last_peered":"2023-07-21T22:57:22.505347+0000","last_clean":"2023-07-21T22:57:22.505347+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:57:22.505347+0000","last_undegraded":"2023-07-21T22:57:22.505347+0000","last_fullsized":"2023-07-21T22:57:22.505347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:59:49.297136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501476+0000","last_change":"2023-07-21T22:57:22.501476+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501476+0000","last_undegraded":"2023-07-21T22:57:22.501476+0000","last_fullsized":"2023-07-21T22:57:22.501476+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.518719+0000","last_change":"2023-07-21T22:57:22.518008+0000","last_active":"2023-07-21T22:57:22.518719+0000","last_peered":"2023-07-21T22:57:22.518719+0000","last_clean":"2023-07-21T22:57:22.518719+0000","last_became_active":"2023-07-21T22:57:22.517728+0000","last_became_peered":"2023-07-21T22:57:22.517728+0000","last_unstale":"2023-07-21T22:57:22.518719+0000","last_undegraded":"2023-07-21T22:57:22.518719+0000","last_fullsized":"2023-07-21T22:57:22.518719+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:18:59.282736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":331,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.495713+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:57:22.495713+0000","last_peered":"2023-07-21T22:57:22.495713+0000","last_clean":"2023-07-21T22:57:22.495713+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:57:22.495713+0000","last_undegraded":"2023-07-21T22:57:22.495713+0000","last_fullsized":"2023-07-21T22:57:22.495713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:26:35.475867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507980+0000","last_change":"2023-07-21T22:57:22.507980+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507980+0000","last_undegraded":"2023-07-21T22:57:22.507980+0000","last_fullsized":"2023-07-21T22:57:22.507980+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.506936+0000","last_change":"2023-07-21T22:57:22.505531+0000","last_active":"2023-07-21T22:57:22.506936+0000","last_peered":"2023-07-21T22:57:22.506936+0000","last_clean":"2023-07-21T22:57:22.506936+0000","last_became_active":"2023-07-21T22:57:22.505255+0000","last_became_peered":"2023-07-21T22:57:22.505255+0000","last_unstale":"2023-07-21T22:57:22.506936+0000","last_undegraded":"2023-07-21T22:57:22.506936+0000","last_fullsized":"2023-07-21T22:57:22.506936+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:39:42.411463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":313,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.508725+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:57:22.508725+0000","last_peered":"2023-07-21T22:57:22.508725+0000","last_clean":"2023-07-21T22:57:22.508725+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:57:22.508725+0000","last_undegraded":"2023-07-21T22:57:22.508725+0000","last_fullsized":"2023-07-21T22:57:22.508725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:50:42.472612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507008+0000","last_change":"2023-07-21T22:57:22.507008+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507008+0000","last_undegraded":"2023-07-21T22:57:22.507008+0000","last_fullsized":"2023-07-21T22:57:22.507008+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521537+0000","last_change":"2023-07-21T22:57:22.516962+0000","last_active":"2023-07-21T22:57:22.521537+0000","last_peered":"2023-07-21T22:57:22.521537+0000","last_clean":"2023-07-21T22:57:22.521537+0000","last_became_active":"2023-07-21T22:57:22.516672+0000","last_became_peered":"2023-07-21T22:57:22.516672+0000","last_unstale":"2023-07-21T22:57:22.521537+0000","last_undegraded":"2023-07-21T22:57:22.521537+0000","last_fullsized":"2023-07-21T22:57:22.521537+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:08:03.586522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":331,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.495782+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:57:22.495782+0000","last_peered":"2023-07-21T22:57:22.495782+0000","last_clean":"2023-07-21T22:57:22.495782+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:57:22.495782+0000","last_undegraded":"2023-07-21T22:57:22.495782+0000","last_fullsized":"2023-07-21T22:57:22.495782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:05:49.844805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.498848+0000","last_change":"2023-07-21T22:57:22.498848+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.498848+0000","last_undegraded":"2023-07-21T22:57:22.498848+0000","last_fullsized":"2023-07-21T22:57:22.498848+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521394+0000","last_change":"2023-07-21T22:57:22.517887+0000","last_active":"2023-07-21T22:57:22.521394+0000","last_peered":"2023-07-21T22:57:22.521394+0000","last_clean":"2023-07-21T22:57:22.521394+0000","last_became_active":"2023-07-21T22:57:22.517612+0000","last_became_peered":"2023-07-21T22:57:22.517612+0000","last_unstale":"2023-07-21T22:57:22.521394+0000","last_undegraded":"2023-07-21T22:57:22.521394+0000","last_fullsized":"2023-07-21T22:57:22.521394+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:24:34.120003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":310,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.507419+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:57:22.507419+0000","last_peered":"2023-07-21T22:57:22.507419+0000","last_clean":"2023-07-21T22:57:22.507419+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:57:22.507419+0000","last_undegraded":"2023-07-21T22:57:22.507419+0000","last_fullsized":"2023-07-21T22:57:22.507419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:16:09.635893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509900,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64276,"kb_used_data":2892,"kb_used_omap":0,"kb_used_meta":61376,"kb_avail":94307564,"statfs":{"total":96636764160,"available":96570945536,"internally_reserved":0,"allocated":2961408,"data_stored":1806564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":62849024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.749,"15min":0.76200000000000001},"min":{"1min":0.42699999999999999,"5min":0.35999999999999999,"15min":0.34999999999999998},"max":{"1min":0.93400000000000005,"5min":0.96799999999999997,"15min":1.143},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39000000000000001},"max":{"1min":0.90200000000000002,"5min":0.93200000000000005,"15min":1.0349999999999999},"last":0.78800000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.752,"15min":0.76300000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.40600000000000003},"max":{"1min":0.94099999999999995,"5min":1.089,"15min":1.089},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.73099999999999998,"15min":0.74099999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88800000000000001,"5min":0.95599999999999996,"15min":1.02},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.747,"15min":0.755},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.47999999999999998},"max":{"1min":0.95899999999999996,"5min":1.0049999999999999,"15min":1.0780000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.78400000000000003},"min":{"1min":0.53000000000000003,"5min":0.51100000000000001,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":0.98899999999999999,"15min":1.0660000000000001},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.76100000000000001,"15min":0.77400000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97399999999999998,"5min":0.98099999999999998,"15min":1.0980000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.77200000000000002,"15min":0.77900000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.89100000000000001,"5min":0.98299999999999998,"15min":1.036},"last":0.86899999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.34999999999999998},"max":{"1min":0.77000000000000002,"5min":0.81299999999999994,"15min":0.89700000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.60399999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.34699999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.0940000000000001},"last":0.89900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.99399999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.52300000000000002,"5min":0.48499999999999999,"15min":0.40699999999999997},"max":{"1min":0.871,"5min":0.91000000000000003,"15min":1.0429999999999999},"last":0.97199999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.97399999999999998},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.64000000000000001,"15min":0.63400000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84499999999999997,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.84999999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542606,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37456,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334384,"statfs":{"total":96636764160,"available":96598409216,"internally_reserved":0,"allocated":2367488,"data_stored":1216196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.59299999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.97899999999999998,"5min":1.022,"15min":1.024},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79900000000000004,"15min":0.80400000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93400000000000005,"5min":1,"15min":1.0780000000000001},"last":0.746}]},{"osd":1,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.874,"5min":0.96999999999999997,"15min":1.006},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.747,"15min":0.74099999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90600000000000003,"5min":1.046,"15min":1.046},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.75700000000000001,"15min":0.77200000000000002},"min":{"1min":0.58999999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.88500000000000001,"5min":0.97399999999999998,"15min":1.038},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.56200000000000006,"5min":0.438,"15min":0.438},"max":{"1min":0.93400000000000005,"5min":0.98799999999999999,"15min":1.0600000000000001},"last":0.75900000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.753,"15min":0.751},"min":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.48999999999999999},"max":{"1min":0.93700000000000006,"5min":1.089,"15min":1.089},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.749,"15min":0.75},"min":{"1min":0.52800000000000002,"5min":0.499,"15min":0.499},"max":{"1min":0.89100000000000001,"5min":0.96199999999999997,"15min":0.96999999999999997},"last":0.65300000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.36099999999999999},"max":{"1min":0.81799999999999995,"5min":0.88400000000000001,"15min":0.92300000000000004},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":0.77900000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.66600000000000004,"5min":0.89600000000000002,"15min":0.91300000000000003},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42299999999999999},"max":{"1min":0.77700000000000002,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.86199999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.64000000000000001,"15min":0.65500000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.38700000000000001},"max":{"1min":0.76400000000000001,"5min":0.91600000000000004,"15min":1.0129999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.432},"max":{"1min":0.78500000000000003,"5min":0.90000000000000002,"15min":0.96299999999999997},"last":0.89800000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509899,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55504,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316336,"statfs":{"total":96636764160,"available":96579928064,"internally_reserved":0,"allocated":2367488,"data_stored":1216196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.46600000000000003,"5min":0.437,"15min":0.32100000000000001},"max":{"1min":0.92900000000000005,"5min":1.044,"15min":1.044},"last":0.748},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.41499999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.91700000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.42399999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73099999999999998,"15min":0.73299999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.89800000000000002,"5min":1.038,"15min":1.054},"last":0.82499999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.52200000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.119},"last":0.871},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.747,"15min":0.74199999999999999},"min":{"1min":0.56999999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95099999999999996,"5min":0.96899999999999997,"15min":1.0880000000000001},"last":0.84899999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79200000000000004,"15min":0.78600000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.47299999999999998},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.89900000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57399999999999995,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76500000000000001,"5min":0.90400000000000003,"15min":0.91300000000000003},"last":0.623},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68500000000000005,"15min":0.68100000000000005},"min":{"1min":0.52600000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.022,"5min":1.022,"15min":1.0369999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90500000000000003,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.44700000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92400000000000004,"5min":0.93600000000000005,"15min":1.0629999999999999},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":0.88100000000000001,"5min":1.028,"15min":1.0549999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73499999999999999,"15min":0.72299999999999998},"min":{"1min":0.496,"5min":0.48699999999999999,"15min":0.45900000000000002},"max":{"1min":1.034,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.70699999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37456,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334384,"statfs":{"total":96636764160,"available":96598409216,"internally_reserved":0,"allocated":2367488,"data_stored":1216196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.34599999999999997},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.76900000000000002},"min":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.35299999999999998},"max":{"1min":1.3500000000000001,"5min":1.488,"15min":1.488},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.52700000000000002,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":2.7320000000000002,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.80300000000000005,"15min":0.78800000000000003},"min":{"1min":0.62,"5min":0.60699999999999998,"15min":0.46899999999999997},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.621},{"interface":"front","average":{"1min":0.878,"5min":0.79800000000000004,"15min":0.78600000000000003},"min":{"1min":0.623,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":0.71999999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.78800000000000003,"15min":0.75600000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.0169999999999999,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82299999999999995,"15min":0.81599999999999995},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73299999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.44500000000000001,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.151},"last":0.55300000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.57899999999999996,"5min":0.45800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94999999999999996,"5min":0.96299999999999997,"15min":1.252},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.44400000000000001,"15min":0.437},"max":{"1min":1.006,"5min":1.006,"15min":1.0609999999999999},"last":0.77600000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68300000000000005,"15min":0.66000000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.39500000000000002},"max":{"1min":1.0189999999999999,"5min":1.526,"15min":1.526},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.53600000000000003,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.99099999999999999,"5min":1.0820000000000001,"15min":1.206},"last":0.67100000000000004}]}]},{"osd":3,"up_from":15,"seq":64424509899,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37456,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334384,"statfs":{"total":96636764160,"available":96598409216,"internally_reserved":0,"allocated":2367488,"data_stored":1216196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.503,"15min":0.496},"min":{"1min":0.29899999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57899999999999996,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.312},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.65100000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.35299999999999998,"5min":0.317,"15min":0.312},"max":{"1min":0.72999999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79700000000000004,"5min":0.81799999999999995,"15min":0.88100000000000001},"last":0.496}]},{"osd":2,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.80000000000000004,"5min":0.83199999999999996,"15min":0.84699999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.36899999999999999,"15min":0.36299999999999999},"max":{"1min":0.78600000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77600000000000002,"15min":0.77900000000000003},"min":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.441},"max":{"1min":1.046,"5min":1.101,"15min":1.244},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.84399999999999997},"min":{"1min":0.58099999999999996,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.75700000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.57099999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.628},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.59499999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.006,"5min":1.087,"15min":1.2230000000000001},"last":0.58199999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81200000000000006,"15min":0.80600000000000005},"min":{"1min":0.58799999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0820000000000001,"5min":1.127,"15min":1.147},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78500000000000003,"15min":0.78600000000000003},"min":{"1min":0.56799999999999995,"5min":0.55100000000000005,"15min":0.53000000000000003},"max":{"1min":1.296,"5min":1.296,"15min":1.3660000000000001},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83299999999999996,"15min":0.82999999999999996},"min":{"1min":0.624,"5min":0.55000000000000004,"15min":0.50900000000000001},"max":{"1min":1.175,"5min":1.175,"15min":1.4510000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82799999999999996,"15min":0.84299999999999997},"min":{"1min":0.61499999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.427},"last":0.68500000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509901,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55504,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316336,"statfs":{"total":96636764160,"available":96579928064,"internally_reserved":0,"allocated":2367488,"data_stored":1216196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.52700000000000002,"15min":0.51000000000000001},"min":{"1min":0.33400000000000002,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.45900000000000002,"5min":0.38,"15min":0.377},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.49199999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.35599999999999998},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.47199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.53900000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.499},"min":{"1min":0.379,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69399999999999995,"5min":0.73099999999999998,"15min":0.92800000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.60599999999999998,"15min":0.59399999999999997},"min":{"1min":0.53400000000000003,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.58699999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.82499999999999996,"15min":0.82599999999999996},"min":{"1min":0.66000000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.55900000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1240000000000001,"5min":1.1359999999999999,"15min":1.391},"last":0.80800000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.67200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.82599999999999996,"15min":0.83699999999999997},"min":{"1min":0.57699999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.749}]},{"osd":6,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.80000000000000004,"15min":0.81899999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1220000000000001,"5min":1.1499999999999999,"15min":1.2969999999999999},"last":0.875},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.84399999999999997,"15min":0.84699999999999998},"min":{"1min":0.63600000000000001,"5min":0.59999999999999998,"15min":0.55600000000000005},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.85299999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.84399999999999997,"15min":0.85099999999999998},"min":{"1min":0.748,"5min":0.62,"15min":0.56000000000000005},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81999999999999995,"15min":0.84399999999999997},"min":{"1min":0.59599999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"max":{"1min":1.1679999999999999,"5min":1.2749999999999999,"15min":1.3939999999999999},"last":0.90400000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509900,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37456,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334384,"statfs":{"total":96636764160,"available":96598409216,"internally_reserved":0,"allocated":2367488,"data_stored":1216196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48799999999999999,"15min":0.497},"min":{"1min":0.29899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89500000000000002,"5min":1.149,"15min":1.149},"last":0.41499999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50900000000000001,"15min":0.52600000000000002},"min":{"1min":0.39500000000000002,"5min":0.33900000000000002,"15min":0.33100000000000002},"max":{"1min":0.64900000000000002,"5min":0.80800000000000005,"15min":0.82799999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73699999999999999,"5min":1.21,"15min":1.21},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60199999999999998,"15min":0.61099999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.878,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.38900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.77300000000000002,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.34100000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78200000000000003,"15min":0.80100000000000005},"min":{"1min":0.59499999999999997,"5min":0.53700000000000003,"15min":0.46500000000000002},"max":{"1min":1.0329999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81999999999999995,"15min":0.82299999999999995},"min":{"1min":0.59199999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0169999999999999,"5min":1.2849999999999999,"15min":1.302},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80900000000000005},"min":{"1min":0.57999999999999996,"5min":0.52900000000000003,"15min":0.499},"max":{"1min":1.002,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79000000000000004,"15min":0.80900000000000005},"min":{"1min":0.57899999999999996,"5min":0.52800000000000002,"15min":0.48799999999999999},"max":{"1min":1.052,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.58699999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83299999999999996,"15min":0.82899999999999996},"min":{"1min":0.68000000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0700000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78600000000000003,"15min":0.81100000000000005},"min":{"1min":0.56200000000000006,"5min":0.495,"15min":0.495},"max":{"1min":1.028,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80600000000000005,"15min":0.82999999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0009999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.82899999999999996,"15min":0.83399999999999996},"min":{"1min":0.63,"5min":0.61799999999999999,"15min":0.55000000000000004},"max":{"1min":1.0009999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.61599999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509902,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38024,"kb_used_data":2880,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333816,"statfs":{"total":96636764160,"available":96597827584,"internally_reserved":0,"allocated":2949120,"data_stored":1799872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.498,"15min":0.48799999999999999},"min":{"1min":0.317,"5min":0.29999999999999999,"15min":0.28499999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54300000000000004,"15min":0.54000000000000004},"min":{"1min":0.40000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.38}]},{"osd":2,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.36499999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33900000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.40600000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.627,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.498},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.629,"5min":0.51200000000000001,"15min":0.51000000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.4370000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.82999999999999996,"15min":0.82699999999999996},"min":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.85799999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.83199999999999996,"15min":0.82199999999999995},"min":{"1min":0.63500000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2130000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.87,"15min":0.84899999999999998},"min":{"1min":0.628,"5min":0.497,"15min":0.497},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.351},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.58499999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.627,"5min":0.60699999999999998,"15min":0.60299999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.81899999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.83499999999999996,"15min":0.83199999999999996},"min":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"max":{"1min":1.1699999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.877,"15min":0.873},"min":{"1min":0.64900000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.411},"last":0.94599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:57:28.043 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:57:28.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.184+0000 7f4db9e9c640 1 Processor -- start 2023-07-21T22:57:28.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.188+0000 7f4db9e9c640 1 -- start start 2023-07-21T22:57:28.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.188+0000 7f4db9e9c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4db40c8ad0 0x7f4db40c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:28.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.188+0000 7f4db9e9c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4db40c9560 0x7f4db40ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:28.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.188+0000 7f4db9e9c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db40c99c0 con 0x7f4db4158ce0 2023-07-21T22:57:28.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.188+0000 7f4db9e9c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db40cc700 con 0x7f4db40c8ad0 2023-07-21T22:57:28.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.188+0000 7f4db9e9c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db40b0ff0 con 0x7f4db40c9560 2023-07-21T22:57:28.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.188+0000 7f4db37fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4db4158ce0 0x7f4db4070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58234/0 (socket says 172.21.15.6:58234) 2023-07-21T22:57:28.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.188+0000 7f4db2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4db40c8ad0 0x7f4db40c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:28.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.188+0000 7f4db37fe640 1 -- 172.21.15.6:0/2774712557 learned_addr learned my addr 172.21.15.6:0/2774712557 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:28.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.188+0000 7f4db3fff640 1 --2- 172.21.15.6:0/2774712557 >> v2:172.21.15.161:3300/0 conn(0x7f4db40c9560 0x7f4db40ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:28.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.188+0000 7f4db2ffd640 1 -- 172.21.15.6:0/2774712557 >> v2:172.21.15.161:3300/0 conn(0x7f4db40c9560 msgr2=0x7f4db40ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:28.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.188+0000 7f4db2ffd640 1 --2- 172.21.15.6:0/2774712557 >> v2:172.21.15.161:3300/0 conn(0x7f4db40c9560 0x7f4db40ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.188+0000 7f4db2ffd640 1 -- 172.21.15.6:0/2774712557 >> v1:172.21.15.6:6789/0 conn(0x7f4db4158ce0 legacy=0x7f4db4070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:28.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.188+0000 7f4db2ffd640 1 -- 172.21.15.6:0/2774712557 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db4070c80 con 0x7f4db40c8ad0 2023-07-21T22:57:28.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.188+0000 7f4db27fc640 1 -- 172.21.15.6:0/2774712557 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1358138688 0 0) 0x7f4db40c99c0 con 0x7f4db4158ce0 2023-07-21T22:57:28.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.192+0000 7f4db2ffd640 1 --2- 172.21.15.6:0/2774712557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4db40c8ad0 0x7f4db40c9020 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f4db40b0d70 tx=0x7f4da801c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0cbfae65c5df134 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:28.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.192+0000 7f4db27fc640 1 -- 172.21.15.6:0/2774712557 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da80ac640 con 0x7f4db40c8ad0 2023-07-21T22:57:28.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.192+0000 7f4db27fc640 1 -- 172.21.15.6:0/2774712557 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da80ac7a0 con 0x7f4db40c8ad0 2023-07-21T22:57:28.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.192+0000 7f4db27fc640 1 -- 172.21.15.6:0/2774712557 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da80acb30 con 0x7f4db40c8ad0 2023-07-21T22:57:28.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.192+0000 7f4db9e9c640 1 -- 172.21.15.6:0/2774712557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4db40c8ad0 msgr2=0x7f4db40c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.192+0000 7f4db9e9c640 1 --2- 172.21.15.6:0/2774712557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4db40c8ad0 0x7f4db40c9020 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f4db40b0d70 tx=0x7f4da801c310 comp rx=0 tx=0).stop 2023-07-21T22:57:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.192+0000 7f4db9e9c640 1 -- 172.21.15.6:0/2774712557 shutdown_connections 2023-07-21T22:57:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.192+0000 7f4db9e9c640 1 --2- 172.21.15.6:0/2774712557 >> v2:172.21.15.161:3300/0 conn(0x7f4db40c9560 0x7f4db40ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.192+0000 7f4db9e9c640 1 --2- 172.21.15.6:0/2774712557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4db40c8ad0 0x7f4db40c9020 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.192+0000 7f4db9e9c640 1 -- 172.21.15.6:0/2774712557 >> 172.21.15.6:0/2774712557 conn(0x7f4db40afcf0 msgr2=0x7f4db40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.192+0000 7f4db9e9c640 1 -- 172.21.15.6:0/2774712557 shutdown_connections 2023-07-21T22:57:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.192+0000 7f4db9e9c640 1 -- 172.21.15.6:0/2774712557 wait complete. 2023-07-21T22:57:28.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.192+0000 7f4db9e9c640 1 Processor -- start 2023-07-21T22:57:28.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.192+0000 7f4db9e9c640 1 -- start start 2023-07-21T22:57:28.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db9e9c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4db40c8ad0 0x7f4db40c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:28.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db9e9c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4db40c9560 0x7f4db4147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:28.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db9e9c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4db4158ce0 0x7f4db40c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:28.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db9e9c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db40b2fa0 con 0x7f4db40c9560 2023-07-21T22:57:28.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db9e9c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db41f8250 con 0x7f4db40c8ad0 2023-07-21T22:57:28.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db9e9c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db41f76d0 con 0x7f4db4158ce0 2023-07-21T22:57:28.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4db40c9560 0x7f4db4147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:28.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4db40c9560 0x7f4db4147cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38952/0 (socket says 172.21.15.6:38952) 2023-07-21T22:57:28.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db2ffd640 1 -- 172.21.15.6:0/2355698437 learned_addr learned my addr 172.21.15.6:0/2355698437 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:28.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db37fe640 1 --2- 172.21.15.6:0/2355698437 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4db40c8ad0 0x7f4db40c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:28.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db3fff640 1 --2- 172.21.15.6:0/2355698437 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4db4158ce0 0x7f4db40c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:28.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db2ffd640 1 -- 172.21.15.6:0/2355698437 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4db4158ce0 msgr2=0x7f4db40c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:28.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db2ffd640 1 --2- 172.21.15.6:0/2355698437 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4db4158ce0 0x7f4db40c44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db2ffd640 1 -- 172.21.15.6:0/2355698437 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4db40c8ad0 msgr2=0x7f4db40c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:28.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db2ffd640 1 --2- 172.21.15.6:0/2355698437 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4db40c8ad0 0x7f4db40c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db2ffd640 1 -- 172.21.15.6:0/2355698437 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da8009420 con 0x7f4db40c9560 2023-07-21T22:57:28.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db37fe640 1 --2- 172.21.15.6:0/2355698437 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4db40c8ad0 0x7f4db40c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:28.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db3fff640 1 --2- 172.21.15.6:0/2355698437 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4db4158ce0 0x7f4db40c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:28.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db2ffd640 1 --2- 172.21.15.6:0/2355698437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4db40c9560 0x7f4db4147cb0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f4da8018f20 tx=0x7f4da80190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:28.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4d9bfff640 1 -- 172.21.15.6:0/2355698437 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da80b5610 con 0x7f4db40c9560 2023-07-21T22:57:28.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4d9bfff640 1 -- 172.21.15.6:0/2355698437 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da80b5770 con 0x7f4db40c9560 2023-07-21T22:57:28.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db9e9c640 1 -- 172.21.15.6:0/2355698437 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db41f79b0 con 0x7f4db40c9560 2023-07-21T22:57:28.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4d9bfff640 1 -- 172.21.15.6:0/2355698437 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da80b5ae0 con 0x7f4db40c9560 2023-07-21T22:57:28.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db9e9c640 1 -- 172.21.15.6:0/2355698437 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db41f7f70 con 0x7f4db40c9560 2023-07-21T22:57:28.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4db9e9c640 1 -- 172.21.15.6:0/2355698437 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db40ca1a0 con 0x7f4db40c9560 2023-07-21T22:57:28.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.196+0000 7f4d9bfff640 1 -- 172.21.15.6:0/2355698437 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4da80b3040 con 0x7f4db40c9560 2023-07-21T22:57:28.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.200+0000 7f4d9bfff640 1 --2- 172.21.15.6:0/2355698437 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f4da00663a0 0x7f4da0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:28.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.200+0000 7f4d9bfff640 1 -- 172.21.15.6:0/2355698437 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f4da811e290 con 0x7f4db40c9560 2023-07-21T22:57:28.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.200+0000 7f4db37fe640 1 --2- 172.21.15.6:0/2355698437 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f4da00663a0 0x7f4da0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:28.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.200+0000 7f4db37fe640 1 --2- 172.21.15.6:0/2355698437 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f4da00663a0 0x7f4da0068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4da4000f70 tx=0x7f4da4009040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:28.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.204+0000 7f4d9bfff640 1 -- 172.21.15.6:0/2355698437 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4da80eb5a0 con 0x7f4db40c9560 2023-07-21T22:57:28.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.356+0000 7f4db9e9c640 1 -- 172.21.15.6:0/2355698437 --> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4db41590b0 con 0x7f4da00663a0 2023-07-21T22:57:28.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.368+0000 7f4d9bfff640 1 -- 172.21.15.6:0/2355698437 <== mgr.9760 v2:172.21.15.161:6832/406143921 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306209 (secure 0 0 0) 0x7f4da4001ca0 con 0x7f4da00663a0 2023-07-21T22:57:28.405 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:28.406 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:57:28.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.368+0000 7f4db9e9c640 1 -- 172.21.15.6:0/2355698437 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f4da00663a0 msgr2=0x7f4da0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:28.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.368+0000 7f4db9e9c640 1 --2- 172.21.15.6:0/2355698437 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f4da00663a0 0x7f4da0068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4da4000f70 tx=0x7f4da4009040 comp rx=0 tx=0).stop 2023-07-21T22:57:28.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.368+0000 7f4db9e9c640 1 -- 172.21.15.6:0/2355698437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4db40c9560 msgr2=0x7f4db4147cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:28.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.368+0000 7f4db9e9c640 1 --2- 172.21.15.6:0/2355698437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4db40c9560 0x7f4db4147cb0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f4da8018f20 tx=0x7f4da80190b0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.372+0000 7f4db9e9c640 1 -- 172.21.15.6:0/2355698437 shutdown_connections 2023-07-21T22:57:28.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.372+0000 7f4db9e9c640 1 --2- 172.21.15.6:0/2355698437 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f4da00663a0 0x7f4da0068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.372+0000 7f4db9e9c640 1 --2- 172.21.15.6:0/2355698437 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4db4158ce0 0x7f4db40c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.372+0000 7f4db9e9c640 1 --2- 172.21.15.6:0/2355698437 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4db40c9560 0x7f4db4147cb0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.372+0000 7f4db9e9c640 1 --2- 172.21.15.6:0/2355698437 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4db40c8ad0 0x7f4db40c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.372+0000 7f4db9e9c640 1 -- 172.21.15.6:0/2355698437 >> 172.21.15.6:0/2355698437 conn(0x7f4db40afcf0 msgr2=0x7f4db40caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:28.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.372+0000 7f4db9e9c640 1 -- 172.21.15.6:0/2355698437 shutdown_connections 2023-07-21T22:57:28.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.372+0000 7f4db9e9c640 1 -- 172.21.15.6:0/2355698437 wait complete. 2023-07-21T22:57:28.425 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-21T22:57:27.157054+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":53,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":363132,"kb_used_data":19644,"kb_used_omap":0,"kb_used_meta":343424,"kb_avail":754611588,"statfs":{"total":773094113280,"available":772722266112,"internally_reserved":0,"allocated":20115456,"data_stored":10903612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":351666176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.672691"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.505320+0000","last_change":"2023-07-21T22:57:22.505320+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.505320+0000","last_undegraded":"2023-07-21T22:57:22.505320+0000","last_fullsized":"2023-07-21T22:57:22.505320+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.508207+0000","last_change":"2023-07-21T22:57:22.508207+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.508207+0000","last_undegraded":"2023-07-21T22:57:22.508207+0000","last_fullsized":"2023-07-21T22:57:22.508207+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.504124+0000","last_change":"2023-07-21T22:57:22.504124+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.504124+0000","last_undegraded":"2023-07-21T22:57:22.504124+0000","last_fullsized":"2023-07-21T22:57:22.504124+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.504260+0000","last_change":"2023-07-21T22:57:22.504260+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.504260+0000","last_undegraded":"2023-07-21T22:57:22.504260+0000","last_fullsized":"2023-07-21T22:57:22.504260+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507646+0000","last_change":"2023-07-21T22:57:22.507646+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507646+0000","last_undegraded":"2023-07-21T22:57:22.507646+0000","last_fullsized":"2023-07-21T22:57:22.507646+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.506798+0000","last_change":"2023-07-21T22:57:22.506798+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.506798+0000","last_undegraded":"2023-07-21T22:57:22.506798+0000","last_fullsized":"2023-07-21T22:57:22.506798+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.502003+0000","last_change":"2023-07-21T22:57:22.502003+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.502003+0000","last_undegraded":"2023-07-21T22:57:22.502003+0000","last_fullsized":"2023-07-21T22:57:22.502003+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.502238+0000","last_change":"2023-07-21T22:57:22.502238+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.502238+0000","last_undegraded":"2023-07-21T22:57:22.502238+0000","last_fullsized":"2023-07-21T22:57:22.502238+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501753+0000","last_change":"2023-07-21T22:57:22.501753+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501753+0000","last_undegraded":"2023-07-21T22:57:22.501753+0000","last_fullsized":"2023-07-21T22:57:22.501753+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501227+0000","last_change":"2023-07-21T22:57:22.501227+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501227+0000","last_undegraded":"2023-07-21T22:57:22.501227+0000","last_fullsized":"2023-07-21T22:57:22.501227+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.503205+0000","last_change":"2023-07-21T22:57:22.503205+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.503205+0000","last_undegraded":"2023-07-21T22:57:22.503205+0000","last_fullsized":"2023-07-21T22:57:22.503205+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.508398+0000","last_change":"2023-07-21T22:57:22.508398+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.508398+0000","last_undegraded":"2023-07-21T22:57:22.508398+0000","last_fullsized":"2023-07-21T22:57:22.508398+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501674+0000","last_change":"2023-07-21T22:57:22.501674+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501674+0000","last_undegraded":"2023-07-21T22:57:22.501674+0000","last_fullsized":"2023-07-21T22:57:22.501674+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501933+0000","last_change":"2023-07-21T22:57:22.501933+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501933+0000","last_undegraded":"2023-07-21T22:57:22.501933+0000","last_fullsized":"2023-07-21T22:57:22.501933+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.502440+0000","last_change":"2023-07-21T22:57:22.502440+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.502440+0000","last_undegraded":"2023-07-21T22:57:22.502440+0000","last_fullsized":"2023-07-21T22:57:22.502440+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.504429+0000","last_change":"2023-07-21T22:57:22.504429+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.504429+0000","last_undegraded":"2023-07-21T22:57:22.504429+0000","last_fullsized":"2023-07-21T22:57:22.504429+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501213+0000","last_change":"2023-07-21T22:57:22.501213+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501213+0000","last_undegraded":"2023-07-21T22:57:22.501213+0000","last_fullsized":"2023-07-21T22:57:22.501213+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.506940+0000","last_change":"2023-07-21T22:57:22.506940+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.506940+0000","last_undegraded":"2023-07-21T22:57:22.506940+0000","last_fullsized":"2023-07-21T22:57:22.506940+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.502755+0000","last_change":"2023-07-21T22:57:22.502755+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.502755+0000","last_undegraded":"2023-07-21T22:57:22.502755+0000","last_fullsized":"2023-07-21T22:57:22.502755+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.510199+0000","last_change":"2023-07-21T22:57:22.510199+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.510199+0000","last_undegraded":"2023-07-21T22:57:22.510199+0000","last_fullsized":"2023-07-21T22:57:22.510199+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501147+0000","last_change":"2023-07-21T22:57:22.501147+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501147+0000","last_undegraded":"2023-07-21T22:57:22.501147+0000","last_fullsized":"2023-07-21T22:57:22.501147+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.506257+0000","last_change":"2023-07-21T22:57:22.506257+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.506257+0000","last_undegraded":"2023-07-21T22:57:22.506257+0000","last_fullsized":"2023-07-21T22:57:22.506257+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501209+0000","last_change":"2023-07-21T22:57:22.501209+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501209+0000","last_undegraded":"2023-07-21T22:57:22.501209+0000","last_fullsized":"2023-07-21T22:57:22.501209+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.503707+0000","last_change":"2023-07-21T22:57:22.503707+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.503707+0000","last_undegraded":"2023-07-21T22:57:22.503707+0000","last_fullsized":"2023-07-21T22:57:22.503707+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501575+0000","last_change":"2023-07-21T22:57:22.501575+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501575+0000","last_undegraded":"2023-07-21T22:57:22.501575+0000","last_fullsized":"2023-07-21T22:57:22.501575+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.509358+0000","last_change":"2023-07-21T22:57:22.509358+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.509358+0000","last_undegraded":"2023-07-21T22:57:22.509358+0000","last_fullsized":"2023-07-21T22:57:22.509358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.508452+0000","last_change":"2023-07-21T22:57:22.508452+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.508452+0000","last_undegraded":"2023-07-21T22:57:22.508452+0000","last_fullsized":"2023-07-21T22:57:22.508452+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.511958+0000","last_change":"2023-07-21T22:57:22.511958+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.511958+0000","last_undegraded":"2023-07-21T22:57:22.511958+0000","last_fullsized":"2023-07-21T22:57:22.511958+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507891+0000","last_change":"2023-07-21T22:57:22.507891+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507891+0000","last_undegraded":"2023-07-21T22:57:22.507891+0000","last_fullsized":"2023-07-21T22:57:22.507891+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507642+0000","last_change":"2023-07-21T22:57:22.507642+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507642+0000","last_undegraded":"2023-07-21T22:57:22.507642+0000","last_fullsized":"2023-07-21T22:57:22.507642+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501878+0000","last_change":"2023-07-21T22:57:22.501878+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501878+0000","last_undegraded":"2023-07-21T22:57:22.501878+0000","last_fullsized":"2023-07-21T22:57:22.501878+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507713+0000","last_change":"2023-07-21T22:57:22.507713+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507713+0000","last_undegraded":"2023-07-21T22:57:22.507713+0000","last_fullsized":"2023-07-21T22:57:22.507713+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.506691+0000","last_change":"2023-07-21T22:57:22.506691+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.506691+0000","last_undegraded":"2023-07-21T22:57:22.506691+0000","last_fullsized":"2023-07-21T22:57:22.506691+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.527165+0000","last_change":"2023-07-21T22:57:22.526058+0000","last_active":"2023-07-21T22:57:22.527165+0000","last_peered":"2023-07-21T22:57:22.527165+0000","last_clean":"2023-07-21T22:57:22.527165+0000","last_became_active":"2023-07-21T22:57:22.525745+0000","last_became_peered":"2023-07-21T22:57:22.525745+0000","last_unstale":"2023-07-21T22:57:22.527165+0000","last_undegraded":"2023-07-21T22:57:22.527165+0000","last_fullsized":"2023-07-21T22:57:22.527165+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:58.912111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.503648+0000","last_change":"2023-07-21T22:57:22.503648+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.503648+0000","last_undegraded":"2023-07-21T22:57:22.503648+0000","last_fullsized":"2023-07-21T22:57:22.503648+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.517378+0000","last_change":"2023-07-21T22:57:22.513972+0000","last_active":"2023-07-21T22:57:22.517378+0000","last_peered":"2023-07-21T22:57:22.517378+0000","last_clean":"2023-07-21T22:57:22.517378+0000","last_became_active":"2023-07-21T22:57:22.513687+0000","last_became_peered":"2023-07-21T22:57:22.513687+0000","last_unstale":"2023-07-21T22:57:22.517378+0000","last_undegraded":"2023-07-21T22:57:22.517378+0000","last_fullsized":"2023-07-21T22:57:22.517378+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:27:58.827939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501360+0000","last_change":"2023-07-21T22:57:22.501360+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501360+0000","last_undegraded":"2023-07-21T22:57:22.501360+0000","last_fullsized":"2023-07-21T22:57:22.501360+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.522189+0000","last_change":"2023-07-21T22:57:22.520699+0000","last_active":"2023-07-21T22:57:22.522189+0000","last_peered":"2023-07-21T22:57:22.522189+0000","last_clean":"2023-07-21T22:57:22.522189+0000","last_became_active":"2023-07-21T22:57:22.520379+0000","last_became_peered":"2023-07-21T22:57:22.520379+0000","last_unstale":"2023-07-21T22:57:22.522189+0000","last_undegraded":"2023-07-21T22:57:22.522189+0000","last_fullsized":"2023-07-21T22:57:22.522189+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:07:38.295787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507416+0000","last_change":"2023-07-21T22:57:22.507416+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507416+0000","last_undegraded":"2023-07-21T22:57:22.507416+0000","last_fullsized":"2023-07-21T22:57:22.507416+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.518230+0000","last_change":"2023-07-21T22:57:22.512994+0000","last_active":"2023-07-21T22:57:22.518230+0000","last_peered":"2023-07-21T22:57:22.518230+0000","last_clean":"2023-07-21T22:57:22.518230+0000","last_became_active":"2023-07-21T22:57:22.512632+0000","last_became_peered":"2023-07-21T22:57:22.512632+0000","last_unstale":"2023-07-21T22:57:22.518230+0000","last_undegraded":"2023-07-21T22:57:22.518230+0000","last_fullsized":"2023-07-21T22:57:22.518230+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:23:39.269897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.498988+0000","last_change":"2023-07-21T22:57:22.498988+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.498988+0000","last_undegraded":"2023-07-21T22:57:22.498988+0000","last_fullsized":"2023-07-21T22:57:22.498988+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.523892+0000","last_change":"2023-07-21T22:57:22.520897+0000","last_active":"2023-07-21T22:57:22.523892+0000","last_peered":"2023-07-21T22:57:22.523892+0000","last_clean":"2023-07-21T22:57:22.523892+0000","last_became_active":"2023-07-21T22:57:22.520541+0000","last_became_peered":"2023-07-21T22:57:22.520541+0000","last_unstale":"2023-07-21T22:57:22.523892+0000","last_undegraded":"2023-07-21T22:57:22.523892+0000","last_fullsized":"2023-07-21T22:57:22.523892+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:24:59.305924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.500012+0000","last_change":"2023-07-21T22:57:22.500012+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.500012+0000","last_undegraded":"2023-07-21T22:57:22.500012+0000","last_fullsized":"2023-07-21T22:57:22.500012+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521216+0000","last_change":"2023-07-21T22:57:22.516123+0000","last_active":"2023-07-21T22:57:22.521216+0000","last_peered":"2023-07-21T22:57:22.521216+0000","last_clean":"2023-07-21T22:57:22.521216+0000","last_became_active":"2023-07-21T22:57:22.515462+0000","last_became_peered":"2023-07-21T22:57:22.515462+0000","last_unstale":"2023-07-21T22:57:22.521216+0000","last_undegraded":"2023-07-21T22:57:22.521216+0000","last_fullsized":"2023-07-21T22:57:22.521216+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:59:16.614841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.505427+0000","last_change":"2023-07-21T22:57:22.505427+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.505427+0000","last_undegraded":"2023-07-21T22:57:22.505427+0000","last_fullsized":"2023-07-21T22:57:22.505427+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.518744+0000","last_change":"2023-07-21T22:57:22.516916+0000","last_active":"2023-07-21T22:57:22.518744+0000","last_peered":"2023-07-21T22:57:22.518744+0000","last_clean":"2023-07-21T22:57:22.518744+0000","last_became_active":"2023-07-21T22:57:22.516644+0000","last_became_peered":"2023-07-21T22:57:22.516644+0000","last_unstale":"2023-07-21T22:57:22.518744+0000","last_undegraded":"2023-07-21T22:57:22.518744+0000","last_fullsized":"2023-07-21T22:57:22.518744+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:37:05.914994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.504855+0000","last_change":"2023-07-21T22:57:22.504855+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.504855+0000","last_undegraded":"2023-07-21T22:57:22.504855+0000","last_fullsized":"2023-07-21T22:57:22.504855+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.511885+0000","last_change":"2023-07-21T22:57:22.509620+0000","last_active":"2023-07-21T22:57:22.511885+0000","last_peered":"2023-07-21T22:57:22.511885+0000","last_clean":"2023-07-21T22:57:22.511885+0000","last_became_active":"2023-07-21T22:57:22.509333+0000","last_became_peered":"2023-07-21T22:57:22.509333+0000","last_unstale":"2023-07-21T22:57:22.511885+0000","last_undegraded":"2023-07-21T22:57:22.511885+0000","last_fullsized":"2023-07-21T22:57:22.511885+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:23:03.803937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.499063+0000","last_change":"2023-07-21T22:57:22.499063+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.499063+0000","last_undegraded":"2023-07-21T22:57:22.499063+0000","last_fullsized":"2023-07-21T22:57:22.499063+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521476+0000","last_change":"2023-07-21T22:57:22.515998+0000","last_active":"2023-07-21T22:57:22.521476+0000","last_peered":"2023-07-21T22:57:22.521476+0000","last_clean":"2023-07-21T22:57:22.521476+0000","last_became_active":"2023-07-21T22:57:22.514997+0000","last_became_peered":"2023-07-21T22:57:22.514997+0000","last_unstale":"2023-07-21T22:57:22.521476+0000","last_undegraded":"2023-07-21T22:57:22.521476+0000","last_fullsized":"2023-07-21T22:57:22.521476+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:23.065484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507152+0000","last_change":"2023-07-21T22:57:22.507152+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507152+0000","last_undegraded":"2023-07-21T22:57:22.507152+0000","last_fullsized":"2023-07-21T22:57:22.507152+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521842+0000","last_change":"2023-07-21T22:57:22.516566+0000","last_active":"2023-07-21T22:57:22.521842+0000","last_peered":"2023-07-21T22:57:22.521842+0000","last_clean":"2023-07-21T22:57:22.521842+0000","last_became_active":"2023-07-21T22:57:22.516280+0000","last_became_peered":"2023-07-21T22:57:22.516280+0000","last_unstale":"2023-07-21T22:57:22.521842+0000","last_undegraded":"2023-07-21T22:57:22.521842+0000","last_fullsized":"2023-07-21T22:57:22.521842+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:49:23.225650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501999+0000","last_change":"2023-07-21T22:57:22.501999+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501999+0000","last_undegraded":"2023-07-21T22:57:22.501999+0000","last_fullsized":"2023-07-21T22:57:22.501999+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521305+0000","last_change":"2023-07-21T22:57:22.516536+0000","last_active":"2023-07-21T22:57:22.521305+0000","last_peered":"2023-07-21T22:57:22.521305+0000","last_clean":"2023-07-21T22:57:22.521305+0000","last_became_active":"2023-07-21T22:57:22.516241+0000","last_became_peered":"2023-07-21T22:57:22.516241+0000","last_unstale":"2023-07-21T22:57:22.521305+0000","last_undegraded":"2023-07-21T22:57:22.521305+0000","last_fullsized":"2023-07-21T22:57:22.521305+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:23:33.195419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.502316+0000","last_change":"2023-07-21T22:57:22.502316+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.502316+0000","last_undegraded":"2023-07-21T22:57:22.502316+0000","last_fullsized":"2023-07-21T22:57:22.502316+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.513214+0000","last_change":"2023-07-21T22:57:22.511600+0000","last_active":"2023-07-21T22:57:22.513214+0000","last_peered":"2023-07-21T22:57:22.513214+0000","last_clean":"2023-07-21T22:57:22.513214+0000","last_became_active":"2023-07-21T22:57:22.511263+0000","last_became_peered":"2023-07-21T22:57:22.511263+0000","last_unstale":"2023-07-21T22:57:22.513214+0000","last_undegraded":"2023-07-21T22:57:22.513214+0000","last_fullsized":"2023-07-21T22:57:22.513214+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:29:57.199767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.505444+0000","last_change":"2023-07-21T22:57:22.505444+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.505444+0000","last_undegraded":"2023-07-21T22:57:22.505444+0000","last_fullsized":"2023-07-21T22:57:22.505444+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.517415+0000","last_change":"2023-07-21T22:57:22.513380+0000","last_active":"2023-07-21T22:57:22.517415+0000","last_peered":"2023-07-21T22:57:22.517415+0000","last_clean":"2023-07-21T22:57:22.517415+0000","last_became_active":"2023-07-21T22:57:22.512923+0000","last_became_peered":"2023-07-21T22:57:22.512923+0000","last_unstale":"2023-07-21T22:57:22.517415+0000","last_undegraded":"2023-07-21T22:57:22.517415+0000","last_fullsized":"2023-07-21T22:57:22.517415+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:10:24.583845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.503913+0000","last_change":"2023-07-21T22:57:22.503913+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.503913+0000","last_undegraded":"2023-07-21T22:57:22.503913+0000","last_fullsized":"2023-07-21T22:57:22.503913+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.522701+0000","last_change":"2023-07-21T22:57:22.521562+0000","last_active":"2023-07-21T22:57:22.522701+0000","last_peered":"2023-07-21T22:57:22.522701+0000","last_clean":"2023-07-21T22:57:22.522701+0000","last_became_active":"2023-07-21T22:57:22.521270+0000","last_became_peered":"2023-07-21T22:57:22.521270+0000","last_unstale":"2023-07-21T22:57:22.522701+0000","last_undegraded":"2023-07-21T22:57:22.522701+0000","last_fullsized":"2023-07-21T22:57:22.522701+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:09:59.644328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.505067+0000","last_change":"2023-07-21T22:57:22.505067+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.505067+0000","last_undegraded":"2023-07-21T22:57:22.505067+0000","last_fullsized":"2023-07-21T22:57:22.505067+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.518162+0000","last_change":"2023-07-21T22:57:22.512259+0000","last_active":"2023-07-21T22:57:22.518162+0000","last_peered":"2023-07-21T22:57:22.518162+0000","last_clean":"2023-07-21T22:57:22.518162+0000","last_became_active":"2023-07-21T22:57:22.511911+0000","last_became_peered":"2023-07-21T22:57:22.511911+0000","last_unstale":"2023-07-21T22:57:22.518162+0000","last_undegraded":"2023-07-21T22:57:22.518162+0000","last_fullsized":"2023-07-21T22:57:22.518162+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:32:49.994716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.508740+0000","last_change":"2023-07-21T22:57:22.508740+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.508740+0000","last_undegraded":"2023-07-21T22:57:22.508740+0000","last_fullsized":"2023-07-21T22:57:22.508740+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.514840+0000","last_change":"2023-07-21T22:57:22.514061+0000","last_active":"2023-07-21T22:57:22.514840+0000","last_peered":"2023-07-21T22:57:22.514840+0000","last_clean":"2023-07-21T22:57:22.514840+0000","last_became_active":"2023-07-21T22:57:22.513784+0000","last_became_peered":"2023-07-21T22:57:22.513784+0000","last_unstale":"2023-07-21T22:57:22.514840+0000","last_undegraded":"2023-07-21T22:57:22.514840+0000","last_fullsized":"2023-07-21T22:57:22.514840+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:26:35.733602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501393+0000","last_change":"2023-07-21T22:57:22.501393+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501393+0000","last_undegraded":"2023-07-21T22:57:22.501393+0000","last_fullsized":"2023-07-21T22:57:22.501393+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521245+0000","last_change":"2023-07-21T22:57:22.516848+0000","last_active":"2023-07-21T22:57:22.521245+0000","last_peered":"2023-07-21T22:57:22.521245+0000","last_clean":"2023-07-21T22:57:22.521245+0000","last_became_active":"2023-07-21T22:57:22.516566+0000","last_became_peered":"2023-07-21T22:57:22.516566+0000","last_unstale":"2023-07-21T22:57:22.521245+0000","last_undegraded":"2023-07-21T22:57:22.521245+0000","last_fullsized":"2023-07-21T22:57:22.521245+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:05:17.516983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.499454+0000","last_change":"2023-07-21T22:57:22.499454+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.499454+0000","last_undegraded":"2023-07-21T22:57:22.499454+0000","last_fullsized":"2023-07-21T22:57:22.499454+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.524505+0000","last_change":"2023-07-21T22:57:22.522644+0000","last_active":"2023-07-21T22:57:22.524505+0000","last_peered":"2023-07-21T22:57:22.524505+0000","last_clean":"2023-07-21T22:57:22.524505+0000","last_became_active":"2023-07-21T22:57:22.522294+0000","last_became_peered":"2023-07-21T22:57:22.522294+0000","last_unstale":"2023-07-21T22:57:22.524505+0000","last_undegraded":"2023-07-21T22:57:22.524505+0000","last_fullsized":"2023-07-21T22:57:22.524505+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:00:59.804414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.499971+0000","last_change":"2023-07-21T22:57:22.499971+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.499971+0000","last_undegraded":"2023-07-21T22:57:22.499971+0000","last_fullsized":"2023-07-21T22:57:22.499971+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521580+0000","last_change":"2023-07-21T22:57:22.518224+0000","last_active":"2023-07-21T22:57:22.521580+0000","last_peered":"2023-07-21T22:57:22.521580+0000","last_clean":"2023-07-21T22:57:22.521580+0000","last_became_active":"2023-07-21T22:57:22.517933+0000","last_became_peered":"2023-07-21T22:57:22.517933+0000","last_unstale":"2023-07-21T22:57:22.521580+0000","last_undegraded":"2023-07-21T22:57:22.521580+0000","last_fullsized":"2023-07-21T22:57:22.521580+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:50:21.438717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.499952+0000","last_change":"2023-07-21T22:57:22.499952+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.499952+0000","last_undegraded":"2023-07-21T22:57:22.499952+0000","last_fullsized":"2023-07-21T22:57:22.499952+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.518212+0000","last_change":"2023-07-21T22:57:22.512688+0000","last_active":"2023-07-21T22:57:22.518212+0000","last_peered":"2023-07-21T22:57:22.518212+0000","last_clean":"2023-07-21T22:57:22.518212+0000","last_became_active":"2023-07-21T22:57:22.512404+0000","last_became_peered":"2023-07-21T22:57:22.512404+0000","last_unstale":"2023-07-21T22:57:22.518212+0000","last_undegraded":"2023-07-21T22:57:22.518212+0000","last_fullsized":"2023-07-21T22:57:22.518212+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:36:04.149908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.503744+0000","last_change":"2023-07-21T22:57:22.503744+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.503744+0000","last_undegraded":"2023-07-21T22:57:22.503744+0000","last_fullsized":"2023-07-21T22:57:22.503744+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.523928+0000","last_change":"2023-07-21T22:57:22.523033+0000","last_active":"2023-07-21T22:57:22.523928+0000","last_peered":"2023-07-21T22:57:22.523928+0000","last_clean":"2023-07-21T22:57:22.523928+0000","last_became_active":"2023-07-21T22:57:22.522687+0000","last_became_peered":"2023-07-21T22:57:22.522687+0000","last_unstale":"2023-07-21T22:57:22.523928+0000","last_undegraded":"2023-07-21T22:57:22.523928+0000","last_fullsized":"2023-07-21T22:57:22.523928+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:32:04.938461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507997+0000","last_change":"2023-07-21T22:57:22.507997+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507997+0000","last_undegraded":"2023-07-21T22:57:22.507997+0000","last_fullsized":"2023-07-21T22:57:22.507997+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.523852+0000","last_change":"2023-07-21T22:57:22.520034+0000","last_active":"2023-07-21T22:57:22.523852+0000","last_peered":"2023-07-21T22:57:22.523852+0000","last_clean":"2023-07-21T22:57:22.523852+0000","last_became_active":"2023-07-21T22:57:22.518945+0000","last_became_peered":"2023-07-21T22:57:22.518945+0000","last_unstale":"2023-07-21T22:57:22.523852+0000","last_undegraded":"2023-07-21T22:57:22.523852+0000","last_fullsized":"2023-07-21T22:57:22.523852+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:58:55.877448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.512514+0000","last_change":"2023-07-21T22:57:22.512514+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.512514+0000","last_undegraded":"2023-07-21T22:57:22.512514+0000","last_fullsized":"2023-07-21T22:57:22.512514+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.520035+0000","last_change":"2023-07-21T22:57:22.519089+0000","last_active":"2023-07-21T22:57:22.520035+0000","last_peered":"2023-07-21T22:57:22.520035+0000","last_clean":"2023-07-21T22:57:22.520035+0000","last_became_active":"2023-07-21T22:57:22.518879+0000","last_became_peered":"2023-07-21T22:57:22.518879+0000","last_unstale":"2023-07-21T22:57:22.520035+0000","last_undegraded":"2023-07-21T22:57:22.520035+0000","last_fullsized":"2023-07-21T22:57:22.520035+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:13:00.596939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.503477+0000","last_change":"2023-07-21T22:57:22.503477+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.503477+0000","last_undegraded":"2023-07-21T22:57:22.503477+0000","last_fullsized":"2023-07-21T22:57:22.503477+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.517334+0000","last_change":"2023-07-21T22:57:22.513969+0000","last_active":"2023-07-21T22:57:22.517334+0000","last_peered":"2023-07-21T22:57:22.517334+0000","last_clean":"2023-07-21T22:57:22.517334+0000","last_became_active":"2023-07-21T22:57:22.513667+0000","last_became_peered":"2023-07-21T22:57:22.513667+0000","last_unstale":"2023-07-21T22:57:22.517334+0000","last_undegraded":"2023-07-21T22:57:22.517334+0000","last_fullsized":"2023-07-21T22:57:22.517334+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:33:06.835207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.509163+0000","last_change":"2023-07-21T22:57:22.509163+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.509163+0000","last_undegraded":"2023-07-21T22:57:22.509163+0000","last_fullsized":"2023-07-21T22:57:22.509163+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.524484+0000","last_change":"2023-07-21T22:57:22.522623+0000","last_active":"2023-07-21T22:57:22.524484+0000","last_peered":"2023-07-21T22:57:22.524484+0000","last_clean":"2023-07-21T22:57:22.524484+0000","last_became_active":"2023-07-21T22:57:22.522369+0000","last_became_peered":"2023-07-21T22:57:22.522369+0000","last_unstale":"2023-07-21T22:57:22.524484+0000","last_undegraded":"2023-07-21T22:57:22.524484+0000","last_fullsized":"2023-07-21T22:57:22.524484+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:16:06.371322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"180'326","reported_seq":1211,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.507739+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:57:22.507739+0000","last_peered":"2023-07-21T22:57:22.507739+0000","last_clean":"2023-07-21T22:57:22.507739+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:57:22.507739+0000","last_undegraded":"2023-07-21T22:57:22.507739+0000","last_fullsized":"2023-07-21T22:57:22.507739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:53:36.607636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":353,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.505706+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:57:22.505706+0000","last_peered":"2023-07-21T22:57:22.505706+0000","last_clean":"2023-07-21T22:57:22.505706+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:57:22.505706+0000","last_undegraded":"2023-07-21T22:57:22.505706+0000","last_fullsized":"2023-07-21T22:57:22.505706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:52:45.754065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.509650+0000","last_change":"2023-07-21T22:57:22.509650+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.509650+0000","last_undegraded":"2023-07-21T22:57:22.509650+0000","last_fullsized":"2023-07-21T22:57:22.509650+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.512458+0000","last_change":"2023-07-21T22:57:22.511800+0000","last_active":"2023-07-21T22:57:22.512458+0000","last_peered":"2023-07-21T22:57:22.512458+0000","last_clean":"2023-07-21T22:57:22.512458+0000","last_became_active":"2023-07-21T22:57:22.511372+0000","last_became_peered":"2023-07-21T22:57:22.511372+0000","last_unstale":"2023-07-21T22:57:22.512458+0000","last_undegraded":"2023-07-21T22:57:22.512458+0000","last_fullsized":"2023-07-21T22:57:22.512458+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:05:20.517665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":314,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.507608+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:57:22.507608+0000","last_peered":"2023-07-21T22:57:22.507608+0000","last_clean":"2023-07-21T22:57:22.507608+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:57:22.507608+0000","last_undegraded":"2023-07-21T22:57:22.507608+0000","last_fullsized":"2023-07-21T22:57:22.507608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:34:26.252489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.499199+0000","last_change":"2023-07-21T22:57:22.499199+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.499199+0000","last_undegraded":"2023-07-21T22:57:22.499199+0000","last_fullsized":"2023-07-21T22:57:22.499199+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.518672+0000","last_change":"2023-07-21T22:57:22.515084+0000","last_active":"2023-07-21T22:57:22.518672+0000","last_peered":"2023-07-21T22:57:22.518672+0000","last_clean":"2023-07-21T22:57:22.518672+0000","last_became_active":"2023-07-21T22:57:22.514810+0000","last_became_peered":"2023-07-21T22:57:22.514810+0000","last_unstale":"2023-07-21T22:57:22.518672+0000","last_undegraded":"2023-07-21T22:57:22.518672+0000","last_fullsized":"2023-07-21T22:57:22.518672+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:13:41.728908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":317,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.505310+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:57:22.505310+0000","last_peered":"2023-07-21T22:57:22.505310+0000","last_clean":"2023-07-21T22:57:22.505310+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:57:22.505310+0000","last_undegraded":"2023-07-21T22:57:22.505310+0000","last_fullsized":"2023-07-21T22:57:22.505310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:06:51.965840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507228+0000","last_change":"2023-07-21T22:57:22.507228+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507228+0000","last_undegraded":"2023-07-21T22:57:22.507228+0000","last_fullsized":"2023-07-21T22:57:22.507228+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521495+0000","last_change":"2023-07-21T22:57:22.516060+0000","last_active":"2023-07-21T22:57:22.521495+0000","last_peered":"2023-07-21T22:57:22.521495+0000","last_clean":"2023-07-21T22:57:22.521495+0000","last_became_active":"2023-07-21T22:57:22.515686+0000","last_became_peered":"2023-07-21T22:57:22.515686+0000","last_unstale":"2023-07-21T22:57:22.521495+0000","last_undegraded":"2023-07-21T22:57:22.521495+0000","last_fullsized":"2023-07-21T22:57:22.521495+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:18:25.503485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":353,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.505347+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:57:22.505347+0000","last_peered":"2023-07-21T22:57:22.505347+0000","last_clean":"2023-07-21T22:57:22.505347+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:57:22.505347+0000","last_undegraded":"2023-07-21T22:57:22.505347+0000","last_fullsized":"2023-07-21T22:57:22.505347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:59:49.297136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.501476+0000","last_change":"2023-07-21T22:57:22.501476+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.501476+0000","last_undegraded":"2023-07-21T22:57:22.501476+0000","last_fullsized":"2023-07-21T22:57:22.501476+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.518719+0000","last_change":"2023-07-21T22:57:22.518008+0000","last_active":"2023-07-21T22:57:22.518719+0000","last_peered":"2023-07-21T22:57:22.518719+0000","last_clean":"2023-07-21T22:57:22.518719+0000","last_became_active":"2023-07-21T22:57:22.517728+0000","last_became_peered":"2023-07-21T22:57:22.517728+0000","last_unstale":"2023-07-21T22:57:22.518719+0000","last_undegraded":"2023-07-21T22:57:22.518719+0000","last_fullsized":"2023-07-21T22:57:22.518719+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:18:59.282736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":331,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.495713+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:57:22.495713+0000","last_peered":"2023-07-21T22:57:22.495713+0000","last_clean":"2023-07-21T22:57:22.495713+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:57:22.495713+0000","last_undegraded":"2023-07-21T22:57:22.495713+0000","last_fullsized":"2023-07-21T22:57:22.495713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:26:35.475867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507980+0000","last_change":"2023-07-21T22:57:22.507980+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507980+0000","last_undegraded":"2023-07-21T22:57:22.507980+0000","last_fullsized":"2023-07-21T22:57:22.507980+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.506936+0000","last_change":"2023-07-21T22:57:22.505531+0000","last_active":"2023-07-21T22:57:22.506936+0000","last_peered":"2023-07-21T22:57:22.506936+0000","last_clean":"2023-07-21T22:57:22.506936+0000","last_became_active":"2023-07-21T22:57:22.505255+0000","last_became_peered":"2023-07-21T22:57:22.505255+0000","last_unstale":"2023-07-21T22:57:22.506936+0000","last_undegraded":"2023-07-21T22:57:22.506936+0000","last_fullsized":"2023-07-21T22:57:22.506936+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:39:42.411463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":313,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.508725+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:57:22.508725+0000","last_peered":"2023-07-21T22:57:22.508725+0000","last_clean":"2023-07-21T22:57:22.508725+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:57:22.508725+0000","last_undegraded":"2023-07-21T22:57:22.508725+0000","last_fullsized":"2023-07-21T22:57:22.508725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:50:42.472612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.507008+0000","last_change":"2023-07-21T22:57:22.507008+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.507008+0000","last_undegraded":"2023-07-21T22:57:22.507008+0000","last_fullsized":"2023-07-21T22:57:22.507008+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521537+0000","last_change":"2023-07-21T22:57:22.516962+0000","last_active":"2023-07-21T22:57:22.521537+0000","last_peered":"2023-07-21T22:57:22.521537+0000","last_clean":"2023-07-21T22:57:22.521537+0000","last_became_active":"2023-07-21T22:57:22.516672+0000","last_became_peered":"2023-07-21T22:57:22.516672+0000","last_unstale":"2023-07-21T22:57:22.521537+0000","last_undegraded":"2023-07-21T22:57:22.521537+0000","last_fullsized":"2023-07-21T22:57:22.521537+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:08:03.586522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":331,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.495782+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:57:22.495782+0000","last_peered":"2023-07-21T22:57:22.495782+0000","last_clean":"2023-07-21T22:57:22.495782+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:57:22.495782+0000","last_undegraded":"2023-07-21T22:57:22.495782+0000","last_fullsized":"2023-07-21T22:57:22.495782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:05:49.844805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":1,"reported_epoch":190,"state":"creating+peering","last_fresh":"2023-07-21T22:57:22.498848+0000","last_change":"2023-07-21T22:57:22.498848+0000","last_active":"2023-07-21T22:57:22.477152+0000","last_peered":"2023-07-21T22:57:22.477152+0000","last_clean":"2023-07-21T22:57:22.477152+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-21T22:57:22.498848+0000","last_undegraded":"2023-07-21T22:57:22.498848+0000","last_fullsized":"2023-07-21T22:57:22.498848+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.521394+0000","last_change":"2023-07-21T22:57:22.517887+0000","last_active":"2023-07-21T22:57:22.521394+0000","last_peered":"2023-07-21T22:57:22.521394+0000","last_clean":"2023-07-21T22:57:22.521394+0000","last_became_active":"2023-07-21T22:57:22.517612+0000","last_became_peered":"2023-07-21T22:57:22.517612+0000","last_unstale":"2023-07-21T22:57:22.521394+0000","last_undegraded":"2023-07-21T22:57:22.521394+0000","last_fullsized":"2023-07-21T22:57:22.521394+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:24:34.120003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":310,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-07-21T22:57:22.507419+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:57:22.507419+0000","last_peered":"2023-07-21T22:57:22.507419+0000","last_clean":"2023-07-21T22:57:22.507419+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:57:22.507419+0000","last_undegraded":"2023-07-21T22:57:22.507419+0000","last_fullsized":"2023-07-21T22:57:22.507419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:16:09.635893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509900,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64276,"kb_used_data":2892,"kb_used_omap":0,"kb_used_meta":61376,"kb_avail":94307564,"statfs":{"total":96636764160,"available":96570945536,"internally_reserved":0,"allocated":2961408,"data_stored":1806564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":62849024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.749,"15min":0.76200000000000001},"min":{"1min":0.42699999999999999,"5min":0.35999999999999999,"15min":0.34999999999999998},"max":{"1min":0.93400000000000005,"5min":0.96799999999999997,"15min":1.143},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39000000000000001},"max":{"1min":0.90200000000000002,"5min":0.93200000000000005,"15min":1.0349999999999999},"last":0.78800000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.752,"15min":0.76300000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.40600000000000003},"max":{"1min":0.94099999999999995,"5min":1.089,"15min":1.089},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.73099999999999998,"15min":0.74099999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88800000000000001,"5min":0.95599999999999996,"15min":1.02},"last":0.56100000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.747,"15min":0.755},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.47999999999999998},"max":{"1min":0.95899999999999996,"5min":1.0049999999999999,"15min":1.0780000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.78400000000000003},"min":{"1min":0.53000000000000003,"5min":0.51100000000000001,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":0.98899999999999999,"15min":1.0660000000000001},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.76100000000000001,"15min":0.77400000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97399999999999998,"5min":0.98099999999999998,"15min":1.0980000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.77200000000000002,"15min":0.77900000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.89100000000000001,"5min":0.98299999999999998,"15min":1.036},"last":0.86899999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.34999999999999998},"max":{"1min":0.77000000000000002,"5min":0.81299999999999994,"15min":0.89700000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.60399999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.34699999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.0940000000000001},"last":0.89900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.99399999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.52300000000000002,"5min":0.48499999999999999,"15min":0.40699999999999997},"max":{"1min":0.871,"5min":0.91000000000000003,"15min":1.0429999999999999},"last":0.97199999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.97399999999999998},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.64000000000000001,"15min":0.63400000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84499999999999997,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.84999999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542606,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37456,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334384,"statfs":{"total":96636764160,"available":96598409216,"internally_reserved":0,"allocated":2367488,"data_stored":1216196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.59299999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.97899999999999998,"5min":1.022,"15min":1.024},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79900000000000004,"15min":0.80400000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93400000000000005,"5min":1,"15min":1.0780000000000001},"last":0.746}]},{"osd":1,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.874,"5min":0.96999999999999997,"15min":1.006},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.747,"15min":0.74099999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90600000000000003,"5min":1.046,"15min":1.046},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.75700000000000001,"15min":0.77200000000000002},"min":{"1min":0.58999999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.88500000000000001,"5min":0.97399999999999998,"15min":1.038},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.56200000000000006,"5min":0.438,"15min":0.438},"max":{"1min":0.93400000000000005,"5min":0.98799999999999999,"15min":1.0600000000000001},"last":0.75900000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.753,"15min":0.751},"min":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.48999999999999999},"max":{"1min":0.93700000000000006,"5min":1.089,"15min":1.089},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.749,"15min":0.75},"min":{"1min":0.52800000000000002,"5min":0.499,"15min":0.499},"max":{"1min":0.89100000000000001,"5min":0.96199999999999997,"15min":0.96999999999999997},"last":0.65300000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.36099999999999999},"max":{"1min":0.81799999999999995,"5min":0.88400000000000001,"15min":0.92300000000000004},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":0.77900000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.66600000000000004,"5min":0.89600000000000002,"15min":0.91300000000000003},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42299999999999999},"max":{"1min":0.77700000000000002,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.86199999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.64000000000000001,"15min":0.65500000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.38700000000000001},"max":{"1min":0.76400000000000001,"5min":0.91600000000000004,"15min":1.0129999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.432},"max":{"1min":0.78500000000000003,"5min":0.90000000000000002,"15min":0.96299999999999997},"last":0.89800000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509899,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55504,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316336,"statfs":{"total":96636764160,"available":96579928064,"internally_reserved":0,"allocated":2367488,"data_stored":1216196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.46600000000000003,"5min":0.437,"15min":0.32100000000000001},"max":{"1min":0.92900000000000005,"5min":1.044,"15min":1.044},"last":0.748},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.41499999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.91700000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.42399999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73099999999999998,"15min":0.73299999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.89800000000000002,"5min":1.038,"15min":1.054},"last":0.82499999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.52200000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.119},"last":0.871},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.747,"15min":0.74199999999999999},"min":{"1min":0.56999999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95099999999999996,"5min":0.96899999999999997,"15min":1.0880000000000001},"last":0.84899999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79200000000000004,"15min":0.78600000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.47299999999999998},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.89900000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57399999999999995,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76500000000000001,"5min":0.90400000000000003,"15min":0.91300000000000003},"last":0.623},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68500000000000005,"15min":0.68100000000000005},"min":{"1min":0.52600000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.022,"5min":1.022,"15min":1.0369999999999999},"last":0.66000000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90500000000000003,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.44700000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92400000000000004,"5min":0.93600000000000005,"15min":1.0629999999999999},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":0.88100000000000001,"5min":1.028,"15min":1.0549999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73499999999999999,"15min":0.72299999999999998},"min":{"1min":0.496,"5min":0.48699999999999999,"15min":0.45900000000000002},"max":{"1min":1.034,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.70699999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37456,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334384,"statfs":{"total":96636764160,"available":96598409216,"internally_reserved":0,"allocated":2367488,"data_stored":1216196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.34599999999999997},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.76900000000000002},"min":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.35299999999999998},"max":{"1min":1.3500000000000001,"5min":1.488,"15min":1.488},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.52700000000000002,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":2.7320000000000002,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.80300000000000005,"15min":0.78800000000000003},"min":{"1min":0.62,"5min":0.60699999999999998,"15min":0.46899999999999997},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.621},{"interface":"front","average":{"1min":0.878,"5min":0.79800000000000004,"15min":0.78600000000000003},"min":{"1min":0.623,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":0.71999999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.78800000000000003,"15min":0.75600000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.0169999999999999,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82299999999999995,"15min":0.81599999999999995},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73299999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.44500000000000001,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.151},"last":0.55300000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.57899999999999996,"5min":0.45800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94999999999999996,"5min":0.96299999999999997,"15min":1.252},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.44400000000000001,"15min":0.437},"max":{"1min":1.006,"5min":1.006,"15min":1.0609999999999999},"last":0.77600000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68300000000000005,"15min":0.66000000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.39500000000000002},"max":{"1min":1.0189999999999999,"5min":1.526,"15min":1.526},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.53600000000000003,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.99099999999999999,"5min":1.0820000000000001,"15min":1.206},"last":0.67100000000000004}]}]},{"osd":3,"up_from":15,"seq":64424509899,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37456,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334384,"statfs":{"total":96636764160,"available":96598409216,"internally_reserved":0,"allocated":2367488,"data_stored":1216196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.503,"15min":0.496},"min":{"1min":0.29899999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57899999999999996,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.312},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.65100000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.35299999999999998,"5min":0.317,"15min":0.312},"max":{"1min":0.72999999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79700000000000004,"5min":0.81799999999999995,"15min":0.88100000000000001},"last":0.496}]},{"osd":2,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.80000000000000004,"5min":0.83199999999999996,"15min":0.84699999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.36899999999999999,"15min":0.36299999999999999},"max":{"1min":0.78600000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77600000000000002,"15min":0.77900000000000003},"min":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.441},"max":{"1min":1.046,"5min":1.101,"15min":1.244},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.84399999999999997},"min":{"1min":0.58099999999999996,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.75700000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.57099999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.628},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.59499999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.006,"5min":1.087,"15min":1.2230000000000001},"last":0.58199999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81200000000000006,"15min":0.80600000000000005},"min":{"1min":0.58799999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0820000000000001,"5min":1.127,"15min":1.147},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78500000000000003,"15min":0.78600000000000003},"min":{"1min":0.56799999999999995,"5min":0.55100000000000005,"15min":0.53000000000000003},"max":{"1min":1.296,"5min":1.296,"15min":1.3660000000000001},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83299999999999996,"15min":0.82999999999999996},"min":{"1min":0.624,"5min":0.55000000000000004,"15min":0.50900000000000001},"max":{"1min":1.175,"5min":1.175,"15min":1.4510000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82799999999999996,"15min":0.84299999999999997},"min":{"1min":0.61499999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.427},"last":0.68500000000000005}]}]},{"osd":2,"up_from":15,"seq":64424509901,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55504,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316336,"statfs":{"total":96636764160,"available":96579928064,"internally_reserved":0,"allocated":2367488,"data_stored":1216196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.52700000000000002,"15min":0.51000000000000001},"min":{"1min":0.33400000000000002,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.45900000000000002,"5min":0.38,"15min":0.377},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.49199999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.35599999999999998},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.47199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.53900000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.499},"min":{"1min":0.379,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69399999999999995,"5min":0.73099999999999998,"15min":0.92800000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.60599999999999998,"15min":0.59399999999999997},"min":{"1min":0.53400000000000003,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.58699999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.82499999999999996,"15min":0.82599999999999996},"min":{"1min":0.66000000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.55900000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1240000000000001,"5min":1.1359999999999999,"15min":1.391},"last":0.80800000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.67200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.82599999999999996,"15min":0.83699999999999997},"min":{"1min":0.57699999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.749}]},{"osd":6,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.80000000000000004,"15min":0.81899999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1220000000000001,"5min":1.1499999999999999,"15min":1.2969999999999999},"last":0.875},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.84399999999999997,"15min":0.84699999999999998},"min":{"1min":0.63600000000000001,"5min":0.59999999999999998,"15min":0.55600000000000005},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.85299999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.84399999999999997,"15min":0.85099999999999998},"min":{"1min":0.748,"5min":0.62,"15min":0.56000000000000005},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81999999999999995,"15min":0.84399999999999997},"min":{"1min":0.59599999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"max":{"1min":1.1679999999999999,"5min":1.2749999999999999,"15min":1.3939999999999999},"last":0.90400000000000003}]}]},{"osd":1,"up_from":15,"seq":64424509900,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37456,"kb_used_data":2312,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334384,"statfs":{"total":96636764160,"available":96598409216,"internally_reserved":0,"allocated":2367488,"data_stored":1216196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48799999999999999,"15min":0.497},"min":{"1min":0.29899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89500000000000002,"5min":1.149,"15min":1.149},"last":0.41499999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50900000000000001,"15min":0.52600000000000002},"min":{"1min":0.39500000000000002,"5min":0.33900000000000002,"15min":0.33100000000000002},"max":{"1min":0.64900000000000002,"5min":0.80800000000000005,"15min":0.82799999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73699999999999999,"5min":1.21,"15min":1.21},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60199999999999998,"15min":0.61099999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.878,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.38900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.77300000000000002,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.34100000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78200000000000003,"15min":0.80100000000000005},"min":{"1min":0.59499999999999997,"5min":0.53700000000000003,"15min":0.46500000000000002},"max":{"1min":1.0329999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81999999999999995,"15min":0.82299999999999995},"min":{"1min":0.59199999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0169999999999999,"5min":1.2849999999999999,"15min":1.302},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80900000000000005},"min":{"1min":0.57999999999999996,"5min":0.52900000000000003,"15min":0.499},"max":{"1min":1.002,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79000000000000004,"15min":0.80900000000000005},"min":{"1min":0.57899999999999996,"5min":0.52800000000000002,"15min":0.48799999999999999},"max":{"1min":1.052,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.58699999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83299999999999996,"15min":0.82899999999999996},"min":{"1min":0.68000000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0700000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78600000000000003,"15min":0.81100000000000005},"min":{"1min":0.56200000000000006,"5min":0.495,"15min":0.495},"max":{"1min":1.028,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80600000000000005,"15min":0.82999999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0009999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.82899999999999996,"15min":0.83399999999999996},"min":{"1min":0.63,"5min":0.61799999999999999,"15min":0.55000000000000004},"max":{"1min":1.0009999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.61599999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509902,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38024,"kb_used_data":2880,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333816,"statfs":{"total":96636764160,"available":96597827584,"internally_reserved":0,"allocated":2949120,"data_stored":1799872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.498,"15min":0.48799999999999999},"min":{"1min":0.317,"5min":0.29999999999999999,"15min":0.28499999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54300000000000004,"15min":0.54000000000000004},"min":{"1min":0.40000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.38}]},{"osd":2,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.36499999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33900000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.40600000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.627,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.498},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.629,"5min":0.51200000000000001,"15min":0.51000000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.4370000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.82999999999999996,"15min":0.82699999999999996},"min":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.85799999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.83199999999999996,"15min":0.82199999999999995},"min":{"1min":0.63500000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2130000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.87,"15min":0.84899999999999998},"min":{"1min":0.628,"5min":0.497,"15min":0.497},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.351},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.58499999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.627,"5min":0.60699999999999998,"15min":0.60299999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.81899999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.83499999999999996,"15min":0.83199999999999996},"min":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"max":{"1min":1.1699999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.877,"15min":0.873},"min":{"1min":0.64900000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.411},"last":0.94599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:57:28.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3f is not active+clean 2023-07-21T22:57:28.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.505320+0000', 'last_change': '2023-07-21T22:57:22.505320+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.505320+0000', 'last_undegraded': '2023-07-21T22:57:22.505320+0000', 'last_fullsized': '2023-07-21T22:57:22.505320+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:57:28.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3e is not active+clean 2023-07-21T22:57:28.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.508207+0000', 'last_change': '2023-07-21T22:57:22.508207+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.508207+0000', 'last_undegraded': '2023-07-21T22:57:22.508207+0000', 'last_fullsized': '2023-07-21T22:57:22.508207+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:57:28.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3d is not active+clean 2023-07-21T22:57:28.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.504124+0000', 'last_change': '2023-07-21T22:57:22.504124+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.504124+0000', 'last_undegraded': '2023-07-21T22:57:22.504124+0000', 'last_fullsized': '2023-07-21T22:57:22.504124+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:57:28.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3c is not active+clean 2023-07-21T22:57:28.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.504260+0000', 'last_change': '2023-07-21T22:57:22.504260+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.504260+0000', 'last_undegraded': '2023-07-21T22:57:22.504260+0000', 'last_fullsized': '2023-07-21T22:57:22.504260+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:57:28.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3b is not active+clean 2023-07-21T22:57:28.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.507646+0000', 'last_change': '2023-07-21T22:57:22.507646+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.507646+0000', 'last_undegraded': '2023-07-21T22:57:22.507646+0000', 'last_fullsized': '2023-07-21T22:57:22.507646+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:57:28.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3a is not active+clean 2023-07-21T22:57:28.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.506798+0000', 'last_change': '2023-07-21T22:57:22.506798+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.506798+0000', 'last_undegraded': '2023-07-21T22:57:22.506798+0000', 'last_fullsized': '2023-07-21T22:57:22.506798+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:57:28.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.39 is not active+clean 2023-07-21T22:57:28.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.502003+0000', 'last_change': '2023-07-21T22:57:22.502003+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.502003+0000', 'last_undegraded': '2023-07-21T22:57:22.502003+0000', 'last_fullsized': '2023-07-21T22:57:22.502003+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:57:28.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.38 is not active+clean 2023-07-21T22:57:28.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.502238+0000', 'last_change': '2023-07-21T22:57:22.502238+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.502238+0000', 'last_undegraded': '2023-07-21T22:57:22.502238+0000', 'last_fullsized': '2023-07-21T22:57:22.502238+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:57:28.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.37 is not active+clean 2023-07-21T22:57:28.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.501753+0000', 'last_change': '2023-07-21T22:57:22.501753+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.501753+0000', 'last_undegraded': '2023-07-21T22:57:22.501753+0000', 'last_fullsized': '2023-07-21T22:57:22.501753+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:57:28.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.36 is not active+clean 2023-07-21T22:57:28.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.501227+0000', 'last_change': '2023-07-21T22:57:22.501227+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.501227+0000', 'last_undegraded': '2023-07-21T22:57:22.501227+0000', 'last_fullsized': '2023-07-21T22:57:22.501227+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:57:28.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.35 is not active+clean 2023-07-21T22:57:28.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.503205+0000', 'last_change': '2023-07-21T22:57:22.503205+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.503205+0000', 'last_undegraded': '2023-07-21T22:57:22.503205+0000', 'last_fullsized': '2023-07-21T22:57:22.503205+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:57:28.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.34 is not active+clean 2023-07-21T22:57:28.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.508398+0000', 'last_change': '2023-07-21T22:57:22.508398+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.508398+0000', 'last_undegraded': '2023-07-21T22:57:22.508398+0000', 'last_fullsized': '2023-07-21T22:57:22.508398+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:57:28.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.33 is not active+clean 2023-07-21T22:57:28.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.501674+0000', 'last_change': '2023-07-21T22:57:22.501674+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.501674+0000', 'last_undegraded': '2023-07-21T22:57:22.501674+0000', 'last_fullsized': '2023-07-21T22:57:22.501674+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:57:28.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.32 is not active+clean 2023-07-21T22:57:28.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.501933+0000', 'last_change': '2023-07-21T22:57:22.501933+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.501933+0000', 'last_undegraded': '2023-07-21T22:57:22.501933+0000', 'last_fullsized': '2023-07-21T22:57:22.501933+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:57:28.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.31 is not active+clean 2023-07-21T22:57:28.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.502440+0000', 'last_change': '2023-07-21T22:57:22.502440+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.502440+0000', 'last_undegraded': '2023-07-21T22:57:22.502440+0000', 'last_fullsized': '2023-07-21T22:57:22.502440+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:57:28.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.30 is not active+clean 2023-07-21T22:57:28.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.504429+0000', 'last_change': '2023-07-21T22:57:22.504429+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.504429+0000', 'last_undegraded': '2023-07-21T22:57:22.504429+0000', 'last_fullsized': '2023-07-21T22:57:22.504429+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:57:28.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2f is not active+clean 2023-07-21T22:57:28.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.501213+0000', 'last_change': '2023-07-21T22:57:22.501213+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.501213+0000', 'last_undegraded': '2023-07-21T22:57:22.501213+0000', 'last_fullsized': '2023-07-21T22:57:22.501213+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:57:28.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2e is not active+clean 2023-07-21T22:57:28.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.506940+0000', 'last_change': '2023-07-21T22:57:22.506940+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.506940+0000', 'last_undegraded': '2023-07-21T22:57:22.506940+0000', 'last_fullsized': '2023-07-21T22:57:22.506940+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:57:28.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2d is not active+clean 2023-07-21T22:57:28.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.502755+0000', 'last_change': '2023-07-21T22:57:22.502755+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.502755+0000', 'last_undegraded': '2023-07-21T22:57:22.502755+0000', 'last_fullsized': '2023-07-21T22:57:22.502755+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:57:28.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2c is not active+clean 2023-07-21T22:57:28.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.510199+0000', 'last_change': '2023-07-21T22:57:22.510199+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.510199+0000', 'last_undegraded': '2023-07-21T22:57:22.510199+0000', 'last_fullsized': '2023-07-21T22:57:22.510199+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:57:28.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2b is not active+clean 2023-07-21T22:57:28.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.501147+0000', 'last_change': '2023-07-21T22:57:22.501147+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.501147+0000', 'last_undegraded': '2023-07-21T22:57:22.501147+0000', 'last_fullsized': '2023-07-21T22:57:22.501147+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:57:28.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2a is not active+clean 2023-07-21T22:57:28.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.506257+0000', 'last_change': '2023-07-21T22:57:22.506257+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.506257+0000', 'last_undegraded': '2023-07-21T22:57:22.506257+0000', 'last_fullsized': '2023-07-21T22:57:22.506257+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:57:28.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.29 is not active+clean 2023-07-21T22:57:28.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.501209+0000', 'last_change': '2023-07-21T22:57:22.501209+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.501209+0000', 'last_undegraded': '2023-07-21T22:57:22.501209+0000', 'last_fullsized': '2023-07-21T22:57:22.501209+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:57:28.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.28 is not active+clean 2023-07-21T22:57:28.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.503707+0000', 'last_change': '2023-07-21T22:57:22.503707+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.503707+0000', 'last_undegraded': '2023-07-21T22:57:22.503707+0000', 'last_fullsized': '2023-07-21T22:57:22.503707+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:57:28.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.27 is not active+clean 2023-07-21T22:57:28.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.501575+0000', 'last_change': '2023-07-21T22:57:22.501575+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.501575+0000', 'last_undegraded': '2023-07-21T22:57:22.501575+0000', 'last_fullsized': '2023-07-21T22:57:22.501575+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:57:28.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.26 is not active+clean 2023-07-21T22:57:28.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.509358+0000', 'last_change': '2023-07-21T22:57:22.509358+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.509358+0000', 'last_undegraded': '2023-07-21T22:57:22.509358+0000', 'last_fullsized': '2023-07-21T22:57:22.509358+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:57:28.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.25 is not active+clean 2023-07-21T22:57:28.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.508452+0000', 'last_change': '2023-07-21T22:57:22.508452+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.508452+0000', 'last_undegraded': '2023-07-21T22:57:22.508452+0000', 'last_fullsized': '2023-07-21T22:57:22.508452+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:57:28.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.24 is not active+clean 2023-07-21T22:57:28.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.511958+0000', 'last_change': '2023-07-21T22:57:22.511958+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.511958+0000', 'last_undegraded': '2023-07-21T22:57:22.511958+0000', 'last_fullsized': '2023-07-21T22:57:22.511958+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:57:28.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.23 is not active+clean 2023-07-21T22:57:28.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.507891+0000', 'last_change': '2023-07-21T22:57:22.507891+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.507891+0000', 'last_undegraded': '2023-07-21T22:57:22.507891+0000', 'last_fullsized': '2023-07-21T22:57:22.507891+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:57:28.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.22 is not active+clean 2023-07-21T22:57:28.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.507642+0000', 'last_change': '2023-07-21T22:57:22.507642+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.507642+0000', 'last_undegraded': '2023-07-21T22:57:22.507642+0000', 'last_fullsized': '2023-07-21T22:57:22.507642+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:57:28.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.21 is not active+clean 2023-07-21T22:57:28.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.501878+0000', 'last_change': '2023-07-21T22:57:22.501878+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.501878+0000', 'last_undegraded': '2023-07-21T22:57:22.501878+0000', 'last_fullsized': '2023-07-21T22:57:22.501878+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:57:28.459 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.20 is not active+clean 2023-07-21T22:57:28.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.507713+0000', 'last_change': '2023-07-21T22:57:22.507713+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.507713+0000', 'last_undegraded': '2023-07-21T22:57:22.507713+0000', 'last_fullsized': '2023-07-21T22:57:22.507713+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:57:28.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.10 is not active+clean 2023-07-21T22:57:28.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.506691+0000', 'last_change': '2023-07-21T22:57:22.506691+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.506691+0000', 'last_undegraded': '2023-07-21T22:57:22.506691+0000', 'last_fullsized': '2023-07-21T22:57:22.506691+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:57:28.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.11 is not active+clean 2023-07-21T22:57:28.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.503648+0000', 'last_change': '2023-07-21T22:57:22.503648+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.503648+0000', 'last_undegraded': '2023-07-21T22:57:22.503648+0000', 'last_fullsized': '2023-07-21T22:57:22.503648+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:57:28.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.12 is not active+clean 2023-07-21T22:57:28.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.501360+0000', 'last_change': '2023-07-21T22:57:22.501360+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.501360+0000', 'last_undegraded': '2023-07-21T22:57:22.501360+0000', 'last_fullsized': '2023-07-21T22:57:22.501360+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:57:28.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.13 is not active+clean 2023-07-21T22:57:28.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.507416+0000', 'last_change': '2023-07-21T22:57:22.507416+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.507416+0000', 'last_undegraded': '2023-07-21T22:57:22.507416+0000', 'last_fullsized': '2023-07-21T22:57:22.507416+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:57:28.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.14 is not active+clean 2023-07-21T22:57:28.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.498988+0000', 'last_change': '2023-07-21T22:57:22.498988+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.498988+0000', 'last_undegraded': '2023-07-21T22:57:22.498988+0000', 'last_fullsized': '2023-07-21T22:57:22.498988+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:57:28.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.15 is not active+clean 2023-07-21T22:57:28.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.500012+0000', 'last_change': '2023-07-21T22:57:22.500012+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.500012+0000', 'last_undegraded': '2023-07-21T22:57:22.500012+0000', 'last_fullsized': '2023-07-21T22:57:22.500012+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:57:28.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.16 is not active+clean 2023-07-21T22:57:28.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.505427+0000', 'last_change': '2023-07-21T22:57:22.505427+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.505427+0000', 'last_undegraded': '2023-07-21T22:57:22.505427+0000', 'last_fullsized': '2023-07-21T22:57:22.505427+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:57:28.469 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.17 is not active+clean 2023-07-21T22:57:28.469 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.504855+0000', 'last_change': '2023-07-21T22:57:22.504855+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.504855+0000', 'last_undegraded': '2023-07-21T22:57:22.504855+0000', 'last_fullsized': '2023-07-21T22:57:22.504855+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:57:28.470 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.0 is not active+clean 2023-07-21T22:57:28.470 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.499063+0000', 'last_change': '2023-07-21T22:57:22.499063+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.499063+0000', 'last_undegraded': '2023-07-21T22:57:22.499063+0000', 'last_fullsized': '2023-07-21T22:57:22.499063+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:57:28.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1 is not active+clean 2023-07-21T22:57:28.471 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.507152+0000', 'last_change': '2023-07-21T22:57:22.507152+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.507152+0000', 'last_undegraded': '2023-07-21T22:57:22.507152+0000', 'last_fullsized': '2023-07-21T22:57:22.507152+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:57:28.471 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2 is not active+clean 2023-07-21T22:57:28.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.501999+0000', 'last_change': '2023-07-21T22:57:22.501999+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.501999+0000', 'last_undegraded': '2023-07-21T22:57:22.501999+0000', 'last_fullsized': '2023-07-21T22:57:22.501999+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:57:28.472 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3 is not active+clean 2023-07-21T22:57:28.472 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.502316+0000', 'last_change': '2023-07-21T22:57:22.502316+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.502316+0000', 'last_undegraded': '2023-07-21T22:57:22.502316+0000', 'last_fullsized': '2023-07-21T22:57:22.502316+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:57:28.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.4 is not active+clean 2023-07-21T22:57:28.473 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.505444+0000', 'last_change': '2023-07-21T22:57:22.505444+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.505444+0000', 'last_undegraded': '2023-07-21T22:57:22.505444+0000', 'last_fullsized': '2023-07-21T22:57:22.505444+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:57:28.473 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.5 is not active+clean 2023-07-21T22:57:28.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.503913+0000', 'last_change': '2023-07-21T22:57:22.503913+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.503913+0000', 'last_undegraded': '2023-07-21T22:57:22.503913+0000', 'last_fullsized': '2023-07-21T22:57:22.503913+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:57:28.474 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.6 is not active+clean 2023-07-21T22:57:28.474 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.505067+0000', 'last_change': '2023-07-21T22:57:22.505067+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.505067+0000', 'last_undegraded': '2023-07-21T22:57:22.505067+0000', 'last_fullsized': '2023-07-21T22:57:22.505067+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-21T22:57:28.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.7 is not active+clean 2023-07-21T22:57:28.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.508740+0000', 'last_change': '2023-07-21T22:57:22.508740+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.508740+0000', 'last_undegraded': '2023-07-21T22:57:22.508740+0000', 'last_fullsized': '2023-07-21T22:57:22.508740+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:57:28.475 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.8 is not active+clean 2023-07-21T22:57:28.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.501393+0000', 'last_change': '2023-07-21T22:57:22.501393+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.501393+0000', 'last_undegraded': '2023-07-21T22:57:22.501393+0000', 'last_fullsized': '2023-07-21T22:57:22.501393+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:57:28.476 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.9 is not active+clean 2023-07-21T22:57:28.476 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.499454+0000', 'last_change': '2023-07-21T22:57:22.499454+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.499454+0000', 'last_undegraded': '2023-07-21T22:57:22.499454+0000', 'last_fullsized': '2023-07-21T22:57:22.499454+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:57:28.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.a is not active+clean 2023-07-21T22:57:28.477 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.499971+0000', 'last_change': '2023-07-21T22:57:22.499971+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.499971+0000', 'last_undegraded': '2023-07-21T22:57:22.499971+0000', 'last_fullsized': '2023-07-21T22:57:22.499971+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:57:28.477 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.b is not active+clean 2023-07-21T22:57:28.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.499952+0000', 'last_change': '2023-07-21T22:57:22.499952+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.499952+0000', 'last_undegraded': '2023-07-21T22:57:22.499952+0000', 'last_fullsized': '2023-07-21T22:57:22.499952+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:57:28.478 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.c is not active+clean 2023-07-21T22:57:28.478 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.503744+0000', 'last_change': '2023-07-21T22:57:22.503744+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.503744+0000', 'last_undegraded': '2023-07-21T22:57:22.503744+0000', 'last_fullsized': '2023-07-21T22:57:22.503744+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-21T22:57:28.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.d is not active+clean 2023-07-21T22:57:28.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.507997+0000', 'last_change': '2023-07-21T22:57:22.507997+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.507997+0000', 'last_undegraded': '2023-07-21T22:57:22.507997+0000', 'last_fullsized': '2023-07-21T22:57:22.507997+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:57:28.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.e is not active+clean 2023-07-21T22:57:28.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.512514+0000', 'last_change': '2023-07-21T22:57:22.512514+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.512514+0000', 'last_undegraded': '2023-07-21T22:57:22.512514+0000', 'last_fullsized': '2023-07-21T22:57:22.512514+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:57:28.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.f is not active+clean 2023-07-21T22:57:28.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.503477+0000', 'last_change': '2023-07-21T22:57:22.503477+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.503477+0000', 'last_undegraded': '2023-07-21T22:57:22.503477+0000', 'last_fullsized': '2023-07-21T22:57:22.503477+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:57:28.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.19 is not active+clean 2023-07-21T22:57:28.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.509163+0000', 'last_change': '2023-07-21T22:57:22.509163+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.509163+0000', 'last_undegraded': '2023-07-21T22:57:22.509163+0000', 'last_fullsized': '2023-07-21T22:57:22.509163+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:57:28.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1a is not active+clean 2023-07-21T22:57:28.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.509650+0000', 'last_change': '2023-07-21T22:57:22.509650+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.509650+0000', 'last_undegraded': '2023-07-21T22:57:22.509650+0000', 'last_fullsized': '2023-07-21T22:57:22.509650+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-21T22:57:28.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1b is not active+clean 2023-07-21T22:57:28.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.499199+0000', 'last_change': '2023-07-21T22:57:22.499199+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.499199+0000', 'last_undegraded': '2023-07-21T22:57:22.499199+0000', 'last_fullsized': '2023-07-21T22:57:22.499199+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:57:28.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.18 is not active+clean 2023-07-21T22:57:28.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.507228+0000', 'last_change': '2023-07-21T22:57:22.507228+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.507228+0000', 'last_undegraded': '2023-07-21T22:57:22.507228+0000', 'last_fullsized': '2023-07-21T22:57:22.507228+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-21T22:57:28.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1e is not active+clean 2023-07-21T22:57:28.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.501476+0000', 'last_change': '2023-07-21T22:57:22.501476+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.501476+0000', 'last_undegraded': '2023-07-21T22:57:22.501476+0000', 'last_fullsized': '2023-07-21T22:57:22.501476+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-21T22:57:28.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1f is not active+clean 2023-07-21T22:57:28.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.507980+0000', 'last_change': '2023-07-21T22:57:22.507980+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.507980+0000', 'last_undegraded': '2023-07-21T22:57:22.507980+0000', 'last_fullsized': '2023-07-21T22:57:22.507980+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-21T22:57:28.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1c is not active+clean 2023-07-21T22:57:28.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.507008+0000', 'last_change': '2023-07-21T22:57:22.507008+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.507008+0000', 'last_undegraded': '2023-07-21T22:57:22.507008+0000', 'last_fullsized': '2023-07-21T22:57:22.507008+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-21T22:57:28.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1d is not active+clean 2023-07-21T22:57:28.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 190, 'state': 'creating+peering', 'last_fresh': '2023-07-21T22:57:22.498848+0000', 'last_change': '2023-07-21T22:57:22.498848+0000', 'last_active': '2023-07-21T22:57:22.477152+0000', 'last_peered': '2023-07-21T22:57:22.477152+0000', 'last_clean': '2023-07-21T22:57:22.477152+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-21T22:57:22.498848+0000', 'last_undegraded': '2023-07-21T22:57:22.498848+0000', 'last_fullsized': '2023-07-21T22:57:22.498848+0000', 'mapping_epoch': 190, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 190, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'last_clean_scrub_stamp': '2023-07-21T22:57:22.477152+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-21T22:57:28.486 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-21T22:57:28.502 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-07-21T22:57:28.468+0000 7f761d341640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:57:28.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.592+0000 7f86cb59e640 1 Processor -- start 2023-07-21T22:57:28.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.592+0000 7f86cb59e640 1 -- start start 2023-07-21T22:57:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.596+0000 7f86cb59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f86cc0b7d90 0x7f86cc0cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.596+0000 7f86cb59e640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f86cc0d13f0 0x7f86cc0ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.596+0000 7f86cb59e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86cc0d0f60 con 0x7f86cc15f3f0 2023-07-21T22:57:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.596+0000 7f86cb59e640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86cc0d0390 con 0x7f86cc0d13f0 2023-07-21T22:57:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.596+0000 7f86cb59e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86cc0d0630 con 0x7f86cc0b7d90 2023-07-21T22:57:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.596+0000 7f86cad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f86cc0d13f0 0x7f86cc0ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.596+0000 7f86cad9d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f86cc0d13f0 0x7f86cc0ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38954/0 (socket says 172.21.15.6:38954) 2023-07-21T22:57:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.596+0000 7f86cad9d640 1 -- 172.21.15.6:0/4158021645 learned_addr learned my addr 172.21.15.6:0/4158021645 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.596+0000 7f86c3fff640 1 --2- 172.21.15.6:0/4158021645 >> v2:172.21.15.161:3300/0 conn(0x7f86cc0b7d90 0x7f86cc0cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.596+0000 7f86cad9d640 1 -- 172.21.15.6:0/4158021645 >> v2:172.21.15.161:3300/0 conn(0x7f86cc0b7d90 msgr2=0x7f86cc0cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.596+0000 7f86cad9d640 1 --2- 172.21.15.6:0/4158021645 >> v2:172.21.15.161:3300/0 conn(0x7f86cc0b7d90 0x7f86cc0cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.596+0000 7f86cad9d640 1 -- 172.21.15.6:0/4158021645 >> v1:172.21.15.161:6789/0 conn(0x7f86cc15f3f0 legacy=0x7f86cc0b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.596+0000 7f86cad9d640 1 -- 172.21.15.6:0/4158021645 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86cc0d0910 con 0x7f86cc0d13f0 2023-07-21T22:57:28.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.600+0000 7f86cad9d640 1 --2- 172.21.15.6:0/4158021645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86cc0d13f0 0x7f86cc0ccee0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0c5cc0 tx=0x7f86c401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fcc847a58e95d2e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:28.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.600+0000 7f86c9d9b640 1 -- 172.21.15.6:0/4158021645 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c40a55f0 con 0x7f86cc0d13f0 2023-07-21T22:57:28.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.600+0000 7f86c9d9b640 1 -- 172.21.15.6:0/4158021645 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c40a5750 con 0x7f86cc0d13f0 2023-07-21T22:57:28.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.600+0000 7f86c9d9b640 1 -- 172.21.15.6:0/4158021645 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c40a5ae0 con 0x7f86cc0d13f0 2023-07-21T22:57:28.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.600+0000 7f86cb59e640 1 -- 172.21.15.6:0/4158021645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86cc0d13f0 msgr2=0x7f86cc0ccee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:28.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.600+0000 7f86cb59e640 1 --2- 172.21.15.6:0/4158021645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86cc0d13f0 0x7f86cc0ccee0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0c5cc0 tx=0x7f86c401c8b0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.600+0000 7f86cb59e640 1 -- 172.21.15.6:0/4158021645 shutdown_connections 2023-07-21T22:57:28.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.600+0000 7f86cb59e640 1 --2- 172.21.15.6:0/4158021645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86cc0d13f0 0x7f86cc0ccee0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.600+0000 7f86cb59e640 1 --2- 172.21.15.6:0/4158021645 >> v2:172.21.15.161:3300/0 conn(0x7f86cc0b7d90 0x7f86cc0cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.600+0000 7f86cb59e640 1 -- 172.21.15.6:0/4158021645 >> 172.21.15.6:0/4158021645 conn(0x7f86cc069f50 msgr2=0x7f86cc06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:28.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.600+0000 7f86cb59e640 1 -- 172.21.15.6:0/4158021645 shutdown_connections 2023-07-21T22:57:28.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.600+0000 7f86cb59e640 1 -- 172.21.15.6:0/4158021645 wait complete. 2023-07-21T22:57:28.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.600+0000 7f86cb59e640 1 Processor -- start 2023-07-21T22:57:28.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.600+0000 7f86cb59e640 1 -- start start 2023-07-21T22:57:28.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86cb59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86cc0b7d90 0x7f86cc155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:28.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86cb59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86cc0d13f0 0x7f86cc151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:28.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86cb59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86cc15f3f0 0x7f86cc1544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:28.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86cb59e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc1564e0 con 0x7f86cc0b7d90 2023-07-21T22:57:28.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86cb59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc154f00 con 0x7f86cc0d13f0 2023-07-21T22:57:28.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86cb59e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc1551e0 con 0x7f86cc15f3f0 2023-07-21T22:57:28.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86ca59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86cc0b7d90 0x7f86cc155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:28.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86ca59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86cc0b7d90 0x7f86cc155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38970/0 (socket says 172.21.15.6:38970) 2023-07-21T22:57:28.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86ca59c640 1 -- 172.21.15.6:0/3692178297 learned_addr learned my addr 172.21.15.6:0/3692178297 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:28.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86c3fff640 1 --2- 172.21.15.6:0/3692178297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86cc0d13f0 0x7f86cc151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:28.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86cad9d640 1 --2- 172.21.15.6:0/3692178297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86cc15f3f0 0x7f86cc1544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:28.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86ca59c640 1 -- 172.21.15.6:0/3692178297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86cc15f3f0 msgr2=0x7f86cc1544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:28.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86ca59c640 1 --2- 172.21.15.6:0/3692178297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86cc15f3f0 0x7f86cc1544b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86ca59c640 1 -- 172.21.15.6:0/3692178297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86cc0d13f0 msgr2=0x7f86cc151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:28.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86ca59c640 1 --2- 172.21.15.6:0/3692178297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86cc0d13f0 0x7f86cc151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86ca59c640 1 -- 172.21.15.6:0/3692178297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c4009b30 con 0x7f86cc0b7d90 2023-07-21T22:57:28.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86ca59c640 1 --2- 172.21.15.6:0/3692178297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86cc0b7d90 0x7f86cc155fa0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00c3c0 tx=0x7f86bc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:28.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86c2ffd640 1 -- 172.21.15.6:0/3692178297 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0052d0 con 0x7f86cc0b7d90 2023-07-21T22:57:28.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86c2ffd640 1 -- 172.21.15.6:0/3692178297 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc005430 con 0x7f86cc0b7d90 2023-07-21T22:57:28.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86cb59e640 1 -- 172.21.15.6:0/3692178297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86cc1554c0 con 0x7f86cc0b7d90 2023-07-21T22:57:28.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86c2ffd640 1 -- 172.21.15.6:0/3692178297 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc003840 con 0x7f86cc0b7d90 2023-07-21T22:57:28.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86cb59e640 1 -- 172.21.15.6:0/3692178297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86cc155a80 con 0x7f86cc0b7d90 2023-07-21T22:57:28.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86cb59e640 1 -- 172.21.15.6:0/3692178297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86cc0678d0 con 0x7f86cc0b7d90 2023-07-21T22:57:28.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.604+0000 7f86c2ffd640 1 -- 172.21.15.6:0/3692178297 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f86bc0039a0 con 0x7f86cc0b7d90 2023-07-21T22:57:28.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.608+0000 7f86c2ffd640 1 --2- 172.21.15.6:0/3692178297 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f86ac0663a0 0x7f86ac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:28.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.608+0000 7f86c2ffd640 1 -- 172.21.15.6:0/3692178297 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f86bc0834b0 con 0x7f86cc0b7d90 2023-07-21T22:57:28.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.608+0000 7f86c3fff640 1 --2- 172.21.15.6:0/3692178297 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f86ac0663a0 0x7f86ac068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:28.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.608+0000 7f86c3fff640 1 --2- 172.21.15.6:0/3692178297 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f86ac0663a0 0x7f86ac068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f86cc153810 tx=0x7f86b4008040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:28.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.612+0000 7f86c2ffd640 1 -- 172.21.15.6:0/3692178297 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f86bc050730 con 0x7f86cc0b7d90 2023-07-21T22:57:28.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.820+0000 7f86cb59e640 1 -- 172.21.15.6:0/3692178297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f86cc0c8a30 con 0x7f86cc0b7d90 2023-07-21T22:57:28.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.824+0000 7f86c2ffd640 1 -- 172.21.15.6:0/3692178297 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3235 (secure 0 0 0) 0x7f86bc053d50 con 0x7f86cc0b7d90 2023-07-21T22:57:28.858 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:28.858 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":2351,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":192,"num_osds":8,"num_up_osds":8,"osd_up_since":1689977909,"num_in_osds":8,"osd_in_since":1689977900,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":371847168,"bytes_avail":772722266112,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":86,"id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":10506}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2023-07-21T22:57:11.153682+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-21T22:57:28.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.824+0000 7f86cb59e640 1 -- 172.21.15.6:0/3692178297 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f86ac0663a0 msgr2=0x7f86ac068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:28.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.824+0000 7f86cb59e640 1 --2- 172.21.15.6:0/3692178297 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f86ac0663a0 0x7f86ac068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f86cc153810 tx=0x7f86b4008040 comp rx=0 tx=0).stop 2023-07-21T22:57:28.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.824+0000 7f86cb59e640 1 -- 172.21.15.6:0/3692178297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86cc0b7d90 msgr2=0x7f86cc155fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:28.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.824+0000 7f86cb59e640 1 --2- 172.21.15.6:0/3692178297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86cc0b7d90 0x7f86cc155fa0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00c3c0 tx=0x7f86bc00c880 comp rx=0 tx=0).stop 2023-07-21T22:57:28.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.824+0000 7f86cb59e640 1 -- 172.21.15.6:0/3692178297 shutdown_connections 2023-07-21T22:57:28.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.824+0000 7f86cb59e640 1 --2- 172.21.15.6:0/3692178297 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f86ac0663a0 0x7f86ac068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.824+0000 7f86cb59e640 1 --2- 172.21.15.6:0/3692178297 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f86cc15f3f0 0x7f86cc1544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.824+0000 7f86cb59e640 1 --2- 172.21.15.6:0/3692178297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86cc0d13f0 0x7f86cc151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.824+0000 7f86cb59e640 1 --2- 172.21.15.6:0/3692178297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86cc0b7d90 0x7f86cc155fa0 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.824+0000 7f86cb59e640 1 -- 172.21.15.6:0/3692178297 >> 172.21.15.6:0/3692178297 conn(0x7f86cc069f50 msgr2=0x7f86cc06a320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.824+0000 7f86cb59e640 1 -- 172.21.15.6:0/3692178297 shutdown_connections 2023-07-21T22:57:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:28.824+0000 7f86cb59e640 1 -- 172.21.15.6:0/3692178297 wait complete. 2023-07-21T22:57:28.880 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-21T22:57:28.881 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:57:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.032+0000 7f537b9c5640 1 Processor -- start 2023-07-21T22:57:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.032+0000 7f537b9c5640 1 -- start start 2023-07-21T22:57:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.036+0000 7f537b9c5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5374158ab0 0x7f5374071230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.036+0000 7f537b9c5640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53740c8a50 0x7f537406f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.036+0000 7f537b9c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f537406b1e0 0x7f537406b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.036+0000 7f537b9c5640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f537406bba0 con 0x7f53740c8a50 2023-07-21T22:57:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.036+0000 7f537b9c5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5374158e80 con 0x7f5374158ab0 2023-07-21T22:57:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.036+0000 7f537b9c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5374070da0 con 0x7f537406b1e0 2023-07-21T22:57:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.036+0000 7f5378f60640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53740c8a50 0x7f537406f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.036+0000 7f5378f60640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f53740c8a50 0x7f537406f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38986/0 (socket says 172.21.15.6:38986) 2023-07-21T22:57:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.036+0000 7f5378f60640 1 -- 172.21.15.6:0/1196749405 learned_addr learned my addr 172.21.15.6:0/1196749405 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.036+0000 7f5379761640 1 --2- 172.21.15.6:0/1196749405 >> v2:172.21.15.161:3300/0 conn(0x7f5374158ab0 0x7f5374071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.036+0000 7f5379f62640 1 --2- 172.21.15.6:0/1196749405 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f537406b1e0 0x7f537406b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.036+0000 7f5378f60640 1 -- 172.21.15.6:0/1196749405 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f537406b1e0 msgr2=0x7f537406b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.036+0000 7f5378f60640 1 --2- 172.21.15.6:0/1196749405 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f537406b1e0 0x7f537406b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.036+0000 7f5378f60640 1 -- 172.21.15.6:0/1196749405 >> v2:172.21.15.161:3300/0 conn(0x7f5374158ab0 msgr2=0x7f5374071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.036+0000 7f5378f60640 1 --2- 172.21.15.6:0/1196749405 >> v2:172.21.15.161:3300/0 conn(0x7f5374158ab0 0x7f5374071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.036+0000 7f5378f60640 1 -- 172.21.15.6:0/1196749405 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5374070190 con 0x7f53740c8a50 2023-07-21T22:57:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.036+0000 7f5378f60640 1 --2- 172.21.15.6:0/1196749405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53740c8a50 0x7f537406f8b0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f5374071be0 tx=0x7f536401ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea60d55f4d4969a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f536bfff640 1 -- 172.21.15.6:0/1196749405 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53640a7b10 con 0x7f53740c8a50 2023-07-21T22:57:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f536bfff640 1 -- 172.21.15.6:0/1196749405 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53640a7c70 con 0x7f53740c8a50 2023-07-21T22:57:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f536bfff640 1 -- 172.21.15.6:0/1196749405 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53640af440 con 0x7f53740c8a50 2023-07-21T22:57:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f537b9c5640 1 -- 172.21.15.6:0/1196749405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53740c8a50 msgr2=0x7f537406f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f537b9c5640 1 --2- 172.21.15.6:0/1196749405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53740c8a50 0x7f537406f8b0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f5374071be0 tx=0x7f536401ea80 comp rx=0 tx=0).stop 2023-07-21T22:57:29.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f537b9c5640 1 -- 172.21.15.6:0/1196749405 shutdown_connections 2023-07-21T22:57:29.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f537b9c5640 1 --2- 172.21.15.6:0/1196749405 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f537406b1e0 0x7f537406b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:29.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f537b9c5640 1 --2- 172.21.15.6:0/1196749405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53740c8a50 0x7f537406f8b0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:29.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f537b9c5640 1 --2- 172.21.15.6:0/1196749405 >> v2:172.21.15.161:3300/0 conn(0x7f5374158ab0 0x7f5374071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:29.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f537b9c5640 1 -- 172.21.15.6:0/1196749405 >> 172.21.15.6:0/1196749405 conn(0x7f53740b0980 msgr2=0x7f53740ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:29.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f537b9c5640 1 -- 172.21.15.6:0/1196749405 shutdown_connections 2023-07-21T22:57:29.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f537b9c5640 1 -- 172.21.15.6:0/1196749405 wait complete. 2023-07-21T22:57:29.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f537b9c5640 1 Processor -- start 2023-07-21T22:57:29.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f537b9c5640 1 -- start start 2023-07-21T22:57:29.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f537b9c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f537406b1e0 0x7f537414baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:29.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f537b9c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53740c8a50 0x7f537414db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:29.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f537b9c5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5374158ab0 0x7f5374161a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:29.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f537b9c5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537414c030 con 0x7f53740c8a50 2023-07-21T22:57:29.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f537b9c5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53741f79c0 con 0x7f5374158ab0 2023-07-21T22:57:29.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f537b9c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53741f7ca0 con 0x7f537406b1e0 2023-07-21T22:57:29.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f5378f60640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53740c8a50 0x7f537414db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:29.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f5378f60640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53740c8a50 0x7f537414db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38994/0 (socket says 172.21.15.6:38994) 2023-07-21T22:57:29.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f5378f60640 1 -- 172.21.15.6:0/2615865671 learned_addr learned my addr 172.21.15.6:0/2615865671 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:29.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f5379f62640 1 --2- 172.21.15.6:0/2615865671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5374158ab0 0x7f5374161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:29.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.040+0000 7f5379761640 1 --2- 172.21.15.6:0/2615865671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f537406b1e0 0x7f537414baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.044+0000 7f5378f60640 1 -- 172.21.15.6:0/2615865671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f537406b1e0 msgr2=0x7f537414baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.044+0000 7f5378f60640 1 --2- 172.21.15.6:0/2615865671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f537406b1e0 0x7f537414baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.044+0000 7f5378f60640 1 -- 172.21.15.6:0/2615865671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5374158ab0 msgr2=0x7f5374161a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.044+0000 7f5378f60640 1 --2- 172.21.15.6:0/2615865671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5374158ab0 0x7f5374161a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.044+0000 7f5378f60640 1 -- 172.21.15.6:0/2615865671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536400b770 con 0x7f53740c8a50 2023-07-21T22:57:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.044+0000 7f5379f62640 1 --2- 172.21.15.6:0/2615865671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5374158ab0 0x7f5374161a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:29.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.044+0000 7f5379761640 1 --2- 172.21.15.6:0/2615865671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f537406b1e0 0x7f537414baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:29.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.044+0000 7f5378f60640 1 --2- 172.21.15.6:0/2615865671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53740c8a50 0x7f537414db10 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f536401d130 tx=0x7f536401b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:29.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.044+0000 7f5369ffb640 1 -- 172.21.15.6:0/2615865671 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53640ba660 con 0x7f53740c8a50 2023-07-21T22:57:29.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.044+0000 7f5369ffb640 1 -- 172.21.15.6:0/2615865671 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53640ba7c0 con 0x7f53740c8a50 2023-07-21T22:57:29.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.044+0000 7f5369ffb640 1 -- 172.21.15.6:0/2615865671 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53640bab70 con 0x7f53740c8a50 2023-07-21T22:57:29.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.044+0000 7f537b9c5640 1 -- 172.21.15.6:0/2615865671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53741f7f80 con 0x7f53740c8a50 2023-07-21T22:57:29.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.044+0000 7f537b9c5640 1 -- 172.21.15.6:0/2615865671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53741f8540 con 0x7f53740c8a50 2023-07-21T22:57:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.044+0000 7f537b9c5640 1 -- 172.21.15.6:0/2615865671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53741f8730 con 0x7f53740c8a50 2023-07-21T22:57:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.044+0000 7f5369ffb640 1 -- 172.21.15.6:0/2615865671 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f53640c2360 con 0x7f53740c8a50 2023-07-21T22:57:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.044+0000 7f5369ffb640 1 --2- 172.21.15.6:0/2615865671 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f53580663a0 0x7f5358068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.044+0000 7f5369ffb640 1 -- 172.21.15.6:0/2615865671 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f536411ee10 con 0x7f53740c8a50 2023-07-21T22:57:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.048+0000 7f5379761640 1 --2- 172.21.15.6:0/2615865671 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f53580663a0 0x7f5358068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.048+0000 7f5379761640 1 --2- 172.21.15.6:0/2615865671 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f53580663a0 0x7f5358068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f537406b780 tx=0x7f5370008040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:29.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.048+0000 7f5369ffb640 1 -- 172.21.15.6:0/2615865671 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5364122030 con 0x7f53740c8a50 2023-07-21T22:57:29.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.200+0000 7f537b9c5640 1 -- 172.21.15.6:0/2615865671 --> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5374070a30 con 0x7f53580663a0 2023-07-21T22:57:29.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.212+0000 7f5369ffb640 1 -- 172.21.15.6:0/2615865671 <== mgr.9760 v2:172.21.15.161:6832/406143921 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311668 (secure 0 0 0) 0x7f5370009d70 con 0x7f53580663a0 2023-07-21T22:57:29.248 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:57:29.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.212+0000 7f537b9c5640 1 -- 172.21.15.6:0/2615865671 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f53580663a0 msgr2=0x7f5358068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:29.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.212+0000 7f537b9c5640 1 --2- 172.21.15.6:0/2615865671 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f53580663a0 0x7f5358068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f537406b780 tx=0x7f5370008040 comp rx=0 tx=0).stop 2023-07-21T22:57:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.212+0000 7f537b9c5640 1 -- 172.21.15.6:0/2615865671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53740c8a50 msgr2=0x7f537414db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.212+0000 7f537b9c5640 1 --2- 172.21.15.6:0/2615865671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53740c8a50 0x7f537414db10 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f536401d130 tx=0x7f536401b820 comp rx=0 tx=0).stop 2023-07-21T22:57:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.212+0000 7f537b9c5640 1 -- 172.21.15.6:0/2615865671 shutdown_connections 2023-07-21T22:57:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.212+0000 7f537b9c5640 1 --2- 172.21.15.6:0/2615865671 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f53580663a0 0x7f5358068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.212+0000 7f537b9c5640 1 --2- 172.21.15.6:0/2615865671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5374158ab0 0x7f5374161a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:29.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.212+0000 7f537b9c5640 1 --2- 172.21.15.6:0/2615865671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53740c8a50 0x7f537414db10 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:29.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.212+0000 7f537b9c5640 1 --2- 172.21.15.6:0/2615865671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f537406b1e0 0x7f537414baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:29.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.212+0000 7f537b9c5640 1 -- 172.21.15.6:0/2615865671 >> 172.21.15.6:0/2615865671 conn(0x7f53740b0980 msgr2=0x7f537406ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:29.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.212+0000 7f537b9c5640 1 -- 172.21.15.6:0/2615865671 shutdown_connections 2023-07-21T22:57:29.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:29.212+0000 7f537b9c5640 1 -- 172.21.15.6:0/2615865671 wait complete. 2023-07-21T22:57:29.269 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-21T22:57:29.157460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":584,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":365,"ondisk_log_size":365,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":363400,"kb_used_data":19912,"kb_used_omap":0,"kb_used_meta":343424,"kb_avail":754611320,"statfs":{"total":773094113280,"available":772721991680,"internally_reserved":0,"allocated":20389888,"data_stored":11026428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":351666176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.658108"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.762863+0000","last_change":"2023-07-21T22:57:23.293665+0000","last_active":"2023-07-21T22:57:24.762863+0000","last_peered":"2023-07-21T22:57:24.762863+0000","last_clean":"2023-07-21T22:57:24.762863+0000","last_became_active":"2023-07-21T22:57:23.293364+0000","last_became_peered":"2023-07-21T22:57:23.293364+0000","last_unstale":"2023-07-21T22:57:24.762863+0000","last_undegraded":"2023-07-21T22:57:24.762863+0000","last_fullsized":"2023-07-21T22:57:24.762863+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:13:06.274375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049659+0000","last_change":"2023-07-21T22:57:23.302116+0000","last_active":"2023-07-21T22:57:25.049659+0000","last_peered":"2023-07-21T22:57:25.049659+0000","last_clean":"2023-07-21T22:57:25.049659+0000","last_became_active":"2023-07-21T22:57:23.301819+0000","last_became_peered":"2023-07-21T22:57:23.301819+0000","last_unstale":"2023-07-21T22:57:25.049659+0000","last_undegraded":"2023-07-21T22:57:25.049659+0000","last_fullsized":"2023-07-21T22:57:25.049659+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:08:09.235568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.762730+0000","last_change":"2023-07-21T22:57:23.290722+0000","last_active":"2023-07-21T22:57:24.762730+0000","last_peered":"2023-07-21T22:57:24.762730+0000","last_clean":"2023-07-21T22:57:24.762730+0000","last_became_active":"2023-07-21T22:57:23.290442+0000","last_became_peered":"2023-07-21T22:57:23.290442+0000","last_unstale":"2023-07-21T22:57:24.762730+0000","last_undegraded":"2023-07-21T22:57:24.762730+0000","last_fullsized":"2023-07-21T22:57:24.762730+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:53.442644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.762734+0000","last_change":"2023-07-21T22:57:23.290093+0000","last_active":"2023-07-21T22:57:24.762734+0000","last_peered":"2023-07-21T22:57:24.762734+0000","last_clean":"2023-07-21T22:57:24.762734+0000","last_became_active":"2023-07-21T22:57:23.289787+0000","last_became_peered":"2023-07-21T22:57:23.289787+0000","last_unstale":"2023-07-21T22:57:24.762734+0000","last_undegraded":"2023-07-21T22:57:24.762734+0000","last_fullsized":"2023-07-21T22:57:24.762734+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:25:55.134664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276696+0000","last_change":"2023-07-21T22:57:23.297258+0000","last_active":"2023-07-21T22:57:24.276696+0000","last_peered":"2023-07-21T22:57:24.276696+0000","last_clean":"2023-07-21T22:57:24.276696+0000","last_became_active":"2023-07-21T22:57:23.296962+0000","last_became_peered":"2023-07-21T22:57:23.296962+0000","last_unstale":"2023-07-21T22:57:24.276696+0000","last_undegraded":"2023-07-21T22:57:24.276696+0000","last_fullsized":"2023-07-21T22:57:24.276696+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:33:29.368982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049019+0000","last_change":"2023-07-21T22:57:23.298699+0000","last_active":"2023-07-21T22:57:25.049019+0000","last_peered":"2023-07-21T22:57:25.049019+0000","last_clean":"2023-07-21T22:57:25.049019+0000","last_became_active":"2023-07-21T22:57:23.298391+0000","last_became_peered":"2023-07-21T22:57:23.298391+0000","last_unstale":"2023-07-21T22:57:25.049019+0000","last_undegraded":"2023-07-21T22:57:25.049019+0000","last_fullsized":"2023-07-21T22:57:25.049019+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:52:33.561779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274237+0000","last_change":"2023-07-21T22:57:23.286490+0000","last_active":"2023-07-21T22:57:24.274237+0000","last_peered":"2023-07-21T22:57:24.274237+0000","last_clean":"2023-07-21T22:57:24.274237+0000","last_became_active":"2023-07-21T22:57:23.286225+0000","last_became_peered":"2023-07-21T22:57:23.286225+0000","last_unstale":"2023-07-21T22:57:24.274237+0000","last_undegraded":"2023-07-21T22:57:24.274237+0000","last_fullsized":"2023-07-21T22:57:24.274237+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:03:44.289979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274115+0000","last_change":"2023-07-21T22:57:23.285418+0000","last_active":"2023-07-21T22:57:24.274115+0000","last_peered":"2023-07-21T22:57:24.274115+0000","last_clean":"2023-07-21T22:57:24.274115+0000","last_became_active":"2023-07-21T22:57:23.285159+0000","last_became_peered":"2023-07-21T22:57:23.285159+0000","last_unstale":"2023-07-21T22:57:24.274115+0000","last_undegraded":"2023-07-21T22:57:24.274115+0000","last_fullsized":"2023-07-21T22:57:24.274115+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:06:30.046205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274604+0000","last_change":"2023-07-21T22:57:23.288718+0000","last_active":"2023-07-21T22:57:24.274604+0000","last_peered":"2023-07-21T22:57:24.274604+0000","last_clean":"2023-07-21T22:57:24.274604+0000","last_became_active":"2023-07-21T22:57:23.288421+0000","last_became_peered":"2023-07-21T22:57:23.288421+0000","last_unstale":"2023-07-21T22:57:24.274604+0000","last_undegraded":"2023-07-21T22:57:24.274604+0000","last_fullsized":"2023-07-21T22:57:24.274604+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:44:35.654561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274648+0000","last_change":"2023-07-21T22:57:23.291029+0000","last_active":"2023-07-21T22:57:24.274648+0000","last_peered":"2023-07-21T22:57:24.274648+0000","last_clean":"2023-07-21T22:57:24.274648+0000","last_became_active":"2023-07-21T22:57:23.290757+0000","last_became_peered":"2023-07-21T22:57:23.290757+0000","last_unstale":"2023-07-21T22:57:24.274648+0000","last_undegraded":"2023-07-21T22:57:24.274648+0000","last_fullsized":"2023-07-21T22:57:24.274648+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:18:47.144339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283722+0000","last_change":"2023-07-21T22:57:23.297978+0000","last_active":"2023-07-21T22:57:24.283722+0000","last_peered":"2023-07-21T22:57:24.283722+0000","last_clean":"2023-07-21T22:57:24.283722+0000","last_became_active":"2023-07-21T22:57:23.297483+0000","last_became_peered":"2023-07-21T22:57:23.297483+0000","last_unstale":"2023-07-21T22:57:24.283722+0000","last_undegraded":"2023-07-21T22:57:24.283722+0000","last_fullsized":"2023-07-21T22:57:24.283722+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:48:20.595827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049394+0000","last_change":"2023-07-21T22:57:23.299916+0000","last_active":"2023-07-21T22:57:25.049394+0000","last_peered":"2023-07-21T22:57:25.049394+0000","last_clean":"2023-07-21T22:57:25.049394+0000","last_became_active":"2023-07-21T22:57:23.299632+0000","last_became_peered":"2023-07-21T22:57:23.299632+0000","last_unstale":"2023-07-21T22:57:25.049394+0000","last_undegraded":"2023-07-21T22:57:25.049394+0000","last_fullsized":"2023-07-21T22:57:25.049394+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:18:57.143809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043997+0000","last_change":"2023-07-21T22:57:23.291085+0000","last_active":"2023-07-21T22:57:25.043997+0000","last_peered":"2023-07-21T22:57:25.043997+0000","last_clean":"2023-07-21T22:57:25.043997+0000","last_became_active":"2023-07-21T22:57:23.290824+0000","last_became_peered":"2023-07-21T22:57:23.290824+0000","last_unstale":"2023-07-21T22:57:25.043997+0000","last_undegraded":"2023-07-21T22:57:25.043997+0000","last_fullsized":"2023-07-21T22:57:25.043997+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:26:00.575302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276545+0000","last_change":"2023-07-21T22:57:23.295360+0000","last_active":"2023-07-21T22:57:24.276545+0000","last_peered":"2023-07-21T22:57:24.276545+0000","last_clean":"2023-07-21T22:57:24.276545+0000","last_became_active":"2023-07-21T22:57:23.294879+0000","last_became_peered":"2023-07-21T22:57:23.294879+0000","last_unstale":"2023-07-21T22:57:24.276545+0000","last_undegraded":"2023-07-21T22:57:24.276545+0000","last_fullsized":"2023-07-21T22:57:24.276545+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:30:01.508373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283416+0000","last_change":"2023-07-21T22:57:23.289002+0000","last_active":"2023-07-21T22:57:24.283416+0000","last_peered":"2023-07-21T22:57:24.283416+0000","last_clean":"2023-07-21T22:57:24.283416+0000","last_became_active":"2023-07-21T22:57:23.288641+0000","last_became_peered":"2023-07-21T22:57:23.288641+0000","last_unstale":"2023-07-21T22:57:24.283416+0000","last_undegraded":"2023-07-21T22:57:24.283416+0000","last_fullsized":"2023-07-21T22:57:24.283416+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:13:46.546255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.762553+0000","last_change":"2023-07-21T22:57:23.290271+0000","last_active":"2023-07-21T22:57:24.762553+0000","last_peered":"2023-07-21T22:57:24.762553+0000","last_clean":"2023-07-21T22:57:24.762553+0000","last_became_active":"2023-07-21T22:57:23.289872+0000","last_became_peered":"2023-07-21T22:57:23.289872+0000","last_unstale":"2023-07-21T22:57:24.762553+0000","last_undegraded":"2023-07-21T22:57:24.762553+0000","last_fullsized":"2023-07-21T22:57:24.762553+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:07.185619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274655+0000","last_change":"2023-07-21T22:57:23.282814+0000","last_active":"2023-07-21T22:57:24.274655+0000","last_peered":"2023-07-21T22:57:24.274655+0000","last_clean":"2023-07-21T22:57:24.274655+0000","last_became_active":"2023-07-21T22:57:23.282535+0000","last_became_peered":"2023-07-21T22:57:23.282535+0000","last_unstale":"2023-07-21T22:57:24.274655+0000","last_undegraded":"2023-07-21T22:57:24.274655+0000","last_fullsized":"2023-07-21T22:57:24.274655+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:25:21.377134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049301+0000","last_change":"2023-07-21T22:57:23.301912+0000","last_active":"2023-07-21T22:57:25.049301+0000","last_peered":"2023-07-21T22:57:25.049301+0000","last_clean":"2023-07-21T22:57:25.049301+0000","last_became_active":"2023-07-21T22:57:23.301584+0000","last_became_peered":"2023-07-21T22:57:23.301584+0000","last_unstale":"2023-07-21T22:57:25.049301+0000","last_undegraded":"2023-07-21T22:57:25.049301+0000","last_fullsized":"2023-07-21T22:57:25.049301+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:19:17.319927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283908+0000","last_change":"2023-07-21T22:57:23.289229+0000","last_active":"2023-07-21T22:57:24.283908+0000","last_peered":"2023-07-21T22:57:24.283908+0000","last_clean":"2023-07-21T22:57:24.283908+0000","last_became_active":"2023-07-21T22:57:23.288879+0000","last_became_peered":"2023-07-21T22:57:23.288879+0000","last_unstale":"2023-07-21T22:57:24.283908+0000","last_undegraded":"2023-07-21T22:57:24.283908+0000","last_fullsized":"2023-07-21T22:57:24.283908+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:31:26.121012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043394+0000","last_change":"2023-07-21T22:57:23.291116+0000","last_active":"2023-07-21T22:57:25.043394+0000","last_peered":"2023-07-21T22:57:25.043394+0000","last_clean":"2023-07-21T22:57:25.043394+0000","last_became_active":"2023-07-21T22:57:23.290799+0000","last_became_peered":"2023-07-21T22:57:23.290799+0000","last_unstale":"2023-07-21T22:57:25.043394+0000","last_undegraded":"2023-07-21T22:57:25.043394+0000","last_fullsized":"2023-07-21T22:57:25.043394+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:06:14.095420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.044156+0000","last_change":"2023-07-21T22:57:23.277622+0000","last_active":"2023-07-21T22:57:25.044156+0000","last_peered":"2023-07-21T22:57:25.044156+0000","last_clean":"2023-07-21T22:57:25.044156+0000","last_became_active":"2023-07-21T22:57:23.277337+0000","last_became_peered":"2023-07-21T22:57:23.277337+0000","last_unstale":"2023-07-21T22:57:25.044156+0000","last_undegraded":"2023-07-21T22:57:25.044156+0000","last_fullsized":"2023-07-21T22:57:25.044156+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:44:21.402323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049160+0000","last_change":"2023-07-21T22:57:23.304116+0000","last_active":"2023-07-21T22:57:25.049160+0000","last_peered":"2023-07-21T22:57:25.049160+0000","last_clean":"2023-07-21T22:57:25.049160+0000","last_became_active":"2023-07-21T22:57:23.303760+0000","last_became_peered":"2023-07-21T22:57:23.303760+0000","last_unstale":"2023-07-21T22:57:25.049160+0000","last_undegraded":"2023-07-21T22:57:25.049160+0000","last_fullsized":"2023-07-21T22:57:25.049160+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:04:20.603123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276452+0000","last_change":"2023-07-21T22:57:23.298037+0000","last_active":"2023-07-21T22:57:24.276452+0000","last_peered":"2023-07-21T22:57:24.276452+0000","last_clean":"2023-07-21T22:57:24.276452+0000","last_became_active":"2023-07-21T22:57:23.297757+0000","last_became_peered":"2023-07-21T22:57:23.297757+0000","last_unstale":"2023-07-21T22:57:24.276452+0000","last_undegraded":"2023-07-21T22:57:24.276452+0000","last_fullsized":"2023-07-21T22:57:24.276452+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:21:32.264233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.762772+0000","last_change":"2023-07-21T22:57:23.287569+0000","last_active":"2023-07-21T22:57:24.762772+0000","last_peered":"2023-07-21T22:57:24.762772+0000","last_clean":"2023-07-21T22:57:24.762772+0000","last_became_active":"2023-07-21T22:57:23.287278+0000","last_became_peered":"2023-07-21T22:57:23.287278+0000","last_unstale":"2023-07-21T22:57:24.762772+0000","last_undegraded":"2023-07-21T22:57:24.762772+0000","last_fullsized":"2023-07-21T22:57:24.762772+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:38:24.347745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043974+0000","last_change":"2023-07-21T22:57:23.279747+0000","last_active":"2023-07-21T22:57:25.043974+0000","last_peered":"2023-07-21T22:57:25.043974+0000","last_clean":"2023-07-21T22:57:25.043974+0000","last_became_active":"2023-07-21T22:57:23.279469+0000","last_became_peered":"2023-07-21T22:57:23.279469+0000","last_unstale":"2023-07-21T22:57:25.043974+0000","last_undegraded":"2023-07-21T22:57:25.043974+0000","last_fullsized":"2023-07-21T22:57:25.043974+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:42:26.759246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043490+0000","last_change":"2023-07-21T22:57:23.285913+0000","last_active":"2023-07-21T22:57:25.043490+0000","last_peered":"2023-07-21T22:57:25.043490+0000","last_clean":"2023-07-21T22:57:25.043490+0000","last_became_active":"2023-07-21T22:57:23.285642+0000","last_became_peered":"2023-07-21T22:57:23.285642+0000","last_unstale":"2023-07-21T22:57:25.043490+0000","last_undegraded":"2023-07-21T22:57:25.043490+0000","last_fullsized":"2023-07-21T22:57:25.043490+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:29:26.675872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049113+0000","last_change":"2023-07-21T22:57:23.297503+0000","last_active":"2023-07-21T22:57:25.049113+0000","last_peered":"2023-07-21T22:57:25.049113+0000","last_clean":"2023-07-21T22:57:25.049113+0000","last_became_active":"2023-07-21T22:57:23.297172+0000","last_became_peered":"2023-07-21T22:57:23.297172+0000","last_unstale":"2023-07-21T22:57:25.049113+0000","last_undegraded":"2023-07-21T22:57:25.049113+0000","last_fullsized":"2023-07-21T22:57:25.049113+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:46:38.604846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043575+0000","last_change":"2023-07-21T22:57:23.284109+0000","last_active":"2023-07-21T22:57:25.043575+0000","last_peered":"2023-07-21T22:57:25.043575+0000","last_clean":"2023-07-21T22:57:25.043575+0000","last_became_active":"2023-07-21T22:57:23.283799+0000","last_became_peered":"2023-07-21T22:57:23.283799+0000","last_unstale":"2023-07-21T22:57:25.043575+0000","last_undegraded":"2023-07-21T22:57:25.043575+0000","last_fullsized":"2023-07-21T22:57:25.043575+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:16:41.470014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049237+0000","last_change":"2023-07-21T22:57:23.302475+0000","last_active":"2023-07-21T22:57:25.049237+0000","last_peered":"2023-07-21T22:57:25.049237+0000","last_clean":"2023-07-21T22:57:25.049237+0000","last_became_active":"2023-07-21T22:57:23.302166+0000","last_became_peered":"2023-07-21T22:57:23.302166+0000","last_unstale":"2023-07-21T22:57:25.049237+0000","last_undegraded":"2023-07-21T22:57:25.049237+0000","last_fullsized":"2023-07-21T22:57:25.049237+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:39:32.998573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049688+0000","last_change":"2023-07-21T22:57:23.304540+0000","last_active":"2023-07-21T22:57:25.049688+0000","last_peered":"2023-07-21T22:57:25.049688+0000","last_clean":"2023-07-21T22:57:25.049688+0000","last_became_active":"2023-07-21T22:57:23.304220+0000","last_became_peered":"2023-07-21T22:57:23.304220+0000","last_unstale":"2023-07-21T22:57:25.049688+0000","last_undegraded":"2023-07-21T22:57:25.049688+0000","last_fullsized":"2023-07-21T22:57:25.049688+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:24.074892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283913+0000","last_change":"2023-07-21T22:57:23.296146+0000","last_active":"2023-07-21T22:57:24.283913+0000","last_peered":"2023-07-21T22:57:24.283913+0000","last_clean":"2023-07-21T22:57:24.283913+0000","last_became_active":"2023-07-21T22:57:23.295858+0000","last_became_peered":"2023-07-21T22:57:23.295858+0000","last_unstale":"2023-07-21T22:57:24.283913+0000","last_undegraded":"2023-07-21T22:57:24.283913+0000","last_fullsized":"2023-07-21T22:57:24.283913+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:30:30.965688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049419+0000","last_change":"2023-07-21T22:57:23.300759+0000","last_active":"2023-07-21T22:57:25.049419+0000","last_peered":"2023-07-21T22:57:25.049419+0000","last_clean":"2023-07-21T22:57:25.049419+0000","last_became_active":"2023-07-21T22:57:23.300161+0000","last_became_peered":"2023-07-21T22:57:23.300161+0000","last_unstale":"2023-07-21T22:57:25.049419+0000","last_undegraded":"2023-07-21T22:57:25.049419+0000","last_fullsized":"2023-07-21T22:57:25.049419+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:52:49.843756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049068+0000","last_change":"2023-07-21T22:57:23.298562+0000","last_active":"2023-07-21T22:57:25.049068+0000","last_peered":"2023-07-21T22:57:25.049068+0000","last_clean":"2023-07-21T22:57:25.049068+0000","last_became_active":"2023-07-21T22:57:23.298229+0000","last_became_peered":"2023-07-21T22:57:23.298229+0000","last_unstale":"2023-07-21T22:57:25.049068+0000","last_undegraded":"2023-07-21T22:57:25.049068+0000","last_fullsized":"2023-07-21T22:57:25.049068+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:25:59.327580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"191'4","reported_seq":17,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.762947+0000","last_change":"2023-07-21T22:57:22.526058+0000","last_active":"2023-07-21T22:57:24.762947+0000","last_peered":"2023-07-21T22:57:24.762947+0000","last_clean":"2023-07-21T22:57:24.762947+0000","last_became_active":"2023-07-21T22:57:22.525745+0000","last_became_peered":"2023-07-21T22:57:22.525745+0000","last_unstale":"2023-07-21T22:57:24.762947+0000","last_undegraded":"2023-07-21T22:57:24.762947+0000","last_fullsized":"2023-07-21T22:57:24.762947+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:19:13.852883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043331+0000","last_change":"2023-07-21T22:57:23.289884+0000","last_active":"2023-07-21T22:57:25.043331+0000","last_peered":"2023-07-21T22:57:25.043331+0000","last_clean":"2023-07-21T22:57:25.043331+0000","last_became_active":"2023-07-21T22:57:23.289605+0000","last_became_peered":"2023-07-21T22:57:23.289605+0000","last_unstale":"2023-07-21T22:57:25.043331+0000","last_undegraded":"2023-07-21T22:57:25.043331+0000","last_fullsized":"2023-07-21T22:57:25.043331+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:07:10.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"191'1","reported_seq":14,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.277053+0000","last_change":"2023-07-21T22:57:22.513972+0000","last_active":"2023-07-21T22:57:24.277053+0000","last_peered":"2023-07-21T22:57:24.277053+0000","last_clean":"2023-07-21T22:57:24.277053+0000","last_became_active":"2023-07-21T22:57:22.513687+0000","last_became_peered":"2023-07-21T22:57:22.513687+0000","last_unstale":"2023-07-21T22:57:24.277053+0000","last_undegraded":"2023-07-21T22:57:24.277053+0000","last_fullsized":"2023-07-21T22:57:24.277053+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:09:21.771161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276553+0000","last_change":"2023-07-21T22:57:23.294918+0000","last_active":"2023-07-21T22:57:24.276553+0000","last_peered":"2023-07-21T22:57:24.276553+0000","last_clean":"2023-07-21T22:57:24.276553+0000","last_became_active":"2023-07-21T22:57:23.294506+0000","last_became_peered":"2023-07-21T22:57:23.294506+0000","last_unstale":"2023-07-21T22:57:24.276553+0000","last_undegraded":"2023-07-21T22:57:24.276553+0000","last_fullsized":"2023-07-21T22:57:24.276553+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:04:51.815709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"191'2","reported_seq":15,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283946+0000","last_change":"2023-07-21T22:57:22.520699+0000","last_active":"2023-07-21T22:57:24.283946+0000","last_peered":"2023-07-21T22:57:24.283946+0000","last_clean":"2023-07-21T22:57:24.283946+0000","last_became_active":"2023-07-21T22:57:22.520379+0000","last_became_peered":"2023-07-21T22:57:22.520379+0000","last_unstale":"2023-07-21T22:57:24.283946+0000","last_undegraded":"2023-07-21T22:57:24.283946+0000","last_fullsized":"2023-07-21T22:57:24.283946+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:44:03.288208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049356+0000","last_change":"2023-07-21T22:57:23.300859+0000","last_active":"2023-07-21T22:57:25.049356+0000","last_peered":"2023-07-21T22:57:25.049356+0000","last_clean":"2023-07-21T22:57:25.049356+0000","last_became_active":"2023-07-21T22:57:23.300539+0000","last_became_peered":"2023-07-21T22:57:23.300539+0000","last_unstale":"2023-07-21T22:57:25.049356+0000","last_undegraded":"2023-07-21T22:57:25.049356+0000","last_fullsized":"2023-07-21T22:57:25.049356+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:56:45.061742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"191'2","reported_seq":15,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043536+0000","last_change":"2023-07-21T22:57:22.512994+0000","last_active":"2023-07-21T22:57:25.043536+0000","last_peered":"2023-07-21T22:57:25.043536+0000","last_clean":"2023-07-21T22:57:25.043536+0000","last_became_active":"2023-07-21T22:57:22.512632+0000","last_became_peered":"2023-07-21T22:57:22.512632+0000","last_unstale":"2023-07-21T22:57:25.043536+0000","last_undegraded":"2023-07-21T22:57:25.043536+0000","last_fullsized":"2023-07-21T22:57:25.043536+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:07:55.377165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274879+0000","last_change":"2023-07-21T22:57:23.290282+0000","last_active":"2023-07-21T22:57:24.274879+0000","last_peered":"2023-07-21T22:57:24.274879+0000","last_clean":"2023-07-21T22:57:24.274879+0000","last_became_active":"2023-07-21T22:57:23.290005+0000","last_became_peered":"2023-07-21T22:57:23.290005+0000","last_unstale":"2023-07-21T22:57:24.274879+0000","last_undegraded":"2023-07-21T22:57:24.274879+0000","last_fullsized":"2023-07-21T22:57:24.274879+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:15:25.820622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"191'1","reported_seq":14,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274737+0000","last_change":"2023-07-21T22:57:22.520897+0000","last_active":"2023-07-21T22:57:24.274737+0000","last_peered":"2023-07-21T22:57:24.274737+0000","last_clean":"2023-07-21T22:57:24.274737+0000","last_became_active":"2023-07-21T22:57:22.520541+0000","last_became_peered":"2023-07-21T22:57:22.520541+0000","last_unstale":"2023-07-21T22:57:24.274737+0000","last_undegraded":"2023-07-21T22:57:24.274737+0000","last_fullsized":"2023-07-21T22:57:24.274737+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:23:02.735650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043655+0000","last_change":"2023-07-21T22:57:23.280903+0000","last_active":"2023-07-21T22:57:25.043655+0000","last_peered":"2023-07-21T22:57:25.043655+0000","last_clean":"2023-07-21T22:57:25.043655+0000","last_became_active":"2023-07-21T22:57:23.280443+0000","last_became_peered":"2023-07-21T22:57:23.280443+0000","last_unstale":"2023-07-21T22:57:25.043655+0000","last_undegraded":"2023-07-21T22:57:25.043655+0000","last_fullsized":"2023-07-21T22:57:25.043655+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:08:09.358036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"191'1","reported_seq":14,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276695+0000","last_change":"2023-07-21T22:57:22.516123+0000","last_active":"2023-07-21T22:57:24.276695+0000","last_peered":"2023-07-21T22:57:24.276695+0000","last_clean":"2023-07-21T22:57:24.276695+0000","last_became_active":"2023-07-21T22:57:22.515462+0000","last_became_peered":"2023-07-21T22:57:22.515462+0000","last_unstale":"2023-07-21T22:57:24.276695+0000","last_undegraded":"2023-07-21T22:57:24.276695+0000","last_fullsized":"2023-07-21T22:57:24.276695+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:24:31.127317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043564+0000","last_change":"2023-07-21T22:57:23.289901+0000","last_active":"2023-07-21T22:57:25.043564+0000","last_peered":"2023-07-21T22:57:25.043564+0000","last_clean":"2023-07-21T22:57:25.043564+0000","last_became_active":"2023-07-21T22:57:23.289557+0000","last_became_peered":"2023-07-21T22:57:23.289557+0000","last_unstale":"2023-07-21T22:57:25.043564+0000","last_undegraded":"2023-07-21T22:57:25.043564+0000","last_fullsized":"2023-07-21T22:57:25.043564+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:45:58.542670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043077+0000","last_change":"2023-07-21T22:57:22.516916+0000","last_active":"2023-07-21T22:57:25.043077+0000","last_peered":"2023-07-21T22:57:25.043077+0000","last_clean":"2023-07-21T22:57:25.043077+0000","last_became_active":"2023-07-21T22:57:22.516644+0000","last_became_peered":"2023-07-21T22:57:22.516644+0000","last_unstale":"2023-07-21T22:57:25.043077+0000","last_undegraded":"2023-07-21T22:57:25.043077+0000","last_fullsized":"2023-07-21T22:57:25.043077+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:34:56.913278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.762830+0000","last_change":"2023-07-21T22:57:23.286202+0000","last_active":"2023-07-21T22:57:24.762830+0000","last_peered":"2023-07-21T22:57:24.762830+0000","last_clean":"2023-07-21T22:57:24.762830+0000","last_became_active":"2023-07-21T22:57:23.285914+0000","last_became_peered":"2023-07-21T22:57:23.285914+0000","last_unstale":"2023-07-21T22:57:24.762830+0000","last_undegraded":"2023-07-21T22:57:24.762830+0000","last_fullsized":"2023-07-21T22:57:24.762830+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:37:15.087735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274405+0000","last_change":"2023-07-21T22:57:22.509620+0000","last_active":"2023-07-21T22:57:24.274405+0000","last_peered":"2023-07-21T22:57:24.274405+0000","last_clean":"2023-07-21T22:57:24.274405+0000","last_became_active":"2023-07-21T22:57:22.509333+0000","last_became_peered":"2023-07-21T22:57:22.509333+0000","last_unstale":"2023-07-21T22:57:24.274405+0000","last_undegraded":"2023-07-21T22:57:24.274405+0000","last_fullsized":"2023-07-21T22:57:24.274405+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:18:52.308959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274130+0000","last_change":"2023-07-21T22:57:23.283678+0000","last_active":"2023-07-21T22:57:24.274130+0000","last_peered":"2023-07-21T22:57:24.274130+0000","last_clean":"2023-07-21T22:57:24.274130+0000","last_became_active":"2023-07-21T22:57:23.283224+0000","last_became_peered":"2023-07-21T22:57:23.283224+0000","last_unstale":"2023-07-21T22:57:24.274130+0000","last_undegraded":"2023-07-21T22:57:24.274130+0000","last_fullsized":"2023-07-21T22:57:24.274130+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:10:35.355157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"191'1","reported_seq":14,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.044026+0000","last_change":"2023-07-21T22:57:22.515998+0000","last_active":"2023-07-21T22:57:25.044026+0000","last_peered":"2023-07-21T22:57:25.044026+0000","last_clean":"2023-07-21T22:57:25.044026+0000","last_became_active":"2023-07-21T22:57:22.514997+0000","last_became_peered":"2023-07-21T22:57:22.514997+0000","last_unstale":"2023-07-21T22:57:25.044026+0000","last_undegraded":"2023-07-21T22:57:25.044026+0000","last_fullsized":"2023-07-21T22:57:25.044026+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:09:38.402098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049882+0000","last_change":"2023-07-21T22:57:23.303049+0000","last_active":"2023-07-21T22:57:25.049882+0000","last_peered":"2023-07-21T22:57:25.049882+0000","last_clean":"2023-07-21T22:57:25.049882+0000","last_became_active":"2023-07-21T22:57:23.302199+0000","last_became_peered":"2023-07-21T22:57:23.302199+0000","last_unstale":"2023-07-21T22:57:25.049882+0000","last_undegraded":"2023-07-21T22:57:25.049882+0000","last_fullsized":"2023-07-21T22:57:25.049882+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:18:26.512893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"191'2","reported_seq":15,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274761+0000","last_change":"2023-07-21T22:57:22.516566+0000","last_active":"2023-07-21T22:57:24.274761+0000","last_peered":"2023-07-21T22:57:24.274761+0000","last_clean":"2023-07-21T22:57:24.274761+0000","last_became_active":"2023-07-21T22:57:22.516280+0000","last_became_peered":"2023-07-21T22:57:22.516280+0000","last_unstale":"2023-07-21T22:57:24.274761+0000","last_undegraded":"2023-07-21T22:57:24.274761+0000","last_fullsized":"2023-07-21T22:57:24.274761+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:43.158201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283532+0000","last_change":"2023-07-21T22:57:23.290701+0000","last_active":"2023-07-21T22:57:24.283532+0000","last_peered":"2023-07-21T22:57:24.283532+0000","last_clean":"2023-07-21T22:57:24.283532+0000","last_became_active":"2023-07-21T22:57:23.290401+0000","last_became_peered":"2023-07-21T22:57:23.290401+0000","last_unstale":"2023-07-21T22:57:24.283532+0000","last_undegraded":"2023-07-21T22:57:24.283532+0000","last_fullsized":"2023-07-21T22:57:24.283532+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:42:49.704049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"191'1","reported_seq":14,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276902+0000","last_change":"2023-07-21T22:57:22.516536+0000","last_active":"2023-07-21T22:57:24.276902+0000","last_peered":"2023-07-21T22:57:24.276902+0000","last_clean":"2023-07-21T22:57:24.276902+0000","last_became_active":"2023-07-21T22:57:22.516241+0000","last_became_peered":"2023-07-21T22:57:22.516241+0000","last_unstale":"2023-07-21T22:57:24.276902+0000","last_undegraded":"2023-07-21T22:57:24.276902+0000","last_fullsized":"2023-07-21T22:57:24.276902+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:39.652403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283599+0000","last_change":"2023-07-21T22:57:23.301064+0000","last_active":"2023-07-21T22:57:24.283599+0000","last_peered":"2023-07-21T22:57:24.283599+0000","last_clean":"2023-07-21T22:57:24.283599+0000","last_became_active":"2023-07-21T22:57:23.300764+0000","last_became_peered":"2023-07-21T22:57:23.300764+0000","last_unstale":"2023-07-21T22:57:24.283599+0000","last_undegraded":"2023-07-21T22:57:24.283599+0000","last_fullsized":"2023-07-21T22:57:24.283599+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:21:52.895592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274457+0000","last_change":"2023-07-21T22:57:22.511600+0000","last_active":"2023-07-21T22:57:24.274457+0000","last_peered":"2023-07-21T22:57:24.274457+0000","last_clean":"2023-07-21T22:57:24.274457+0000","last_became_active":"2023-07-21T22:57:22.511263+0000","last_became_peered":"2023-07-21T22:57:22.511263+0000","last_unstale":"2023-07-21T22:57:24.274457+0000","last_undegraded":"2023-07-21T22:57:24.274457+0000","last_fullsized":"2023-07-21T22:57:24.274457+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:46:10.402928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043730+0000","last_change":"2023-07-21T22:57:23.281262+0000","last_active":"2023-07-21T22:57:25.043730+0000","last_peered":"2023-07-21T22:57:25.043730+0000","last_clean":"2023-07-21T22:57:25.043730+0000","last_became_active":"2023-07-21T22:57:23.280989+0000","last_became_peered":"2023-07-21T22:57:23.280989+0000","last_unstale":"2023-07-21T22:57:25.043730+0000","last_undegraded":"2023-07-21T22:57:25.043730+0000","last_fullsized":"2023-07-21T22:57:25.043730+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:49:43.067775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"191'2","reported_seq":15,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276850+0000","last_change":"2023-07-21T22:57:22.513380+0000","last_active":"2023-07-21T22:57:24.276850+0000","last_peered":"2023-07-21T22:57:24.276850+0000","last_clean":"2023-07-21T22:57:24.276850+0000","last_became_active":"2023-07-21T22:57:22.512923+0000","last_became_peered":"2023-07-21T22:57:22.512923+0000","last_unstale":"2023-07-21T22:57:24.276850+0000","last_undegraded":"2023-07-21T22:57:24.276850+0000","last_fullsized":"2023-07-21T22:57:24.276850+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:41:50.730708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276840+0000","last_change":"2023-07-21T22:57:23.294179+0000","last_active":"2023-07-21T22:57:24.276840+0000","last_peered":"2023-07-21T22:57:24.276840+0000","last_clean":"2023-07-21T22:57:24.276840+0000","last_became_active":"2023-07-21T22:57:23.293839+0000","last_became_peered":"2023-07-21T22:57:23.293839+0000","last_unstale":"2023-07-21T22:57:24.276840+0000","last_undegraded":"2023-07-21T22:57:24.276840+0000","last_fullsized":"2023-07-21T22:57:24.276840+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:56:50.990762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283588+0000","last_change":"2023-07-21T22:57:22.521562+0000","last_active":"2023-07-21T22:57:24.283588+0000","last_peered":"2023-07-21T22:57:24.283588+0000","last_clean":"2023-07-21T22:57:24.283588+0000","last_became_active":"2023-07-21T22:57:22.521270+0000","last_became_peered":"2023-07-21T22:57:22.521270+0000","last_unstale":"2023-07-21T22:57:24.283588+0000","last_undegraded":"2023-07-21T22:57:24.283588+0000","last_fullsized":"2023-07-21T22:57:24.283588+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:12:16.779781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276957+0000","last_change":"2023-07-21T22:57:23.296653+0000","last_active":"2023-07-21T22:57:24.276957+0000","last_peered":"2023-07-21T22:57:24.276957+0000","last_clean":"2023-07-21T22:57:24.276957+0000","last_became_active":"2023-07-21T22:57:23.295362+0000","last_became_peered":"2023-07-21T22:57:23.295362+0000","last_unstale":"2023-07-21T22:57:24.276957+0000","last_undegraded":"2023-07-21T22:57:24.276957+0000","last_fullsized":"2023-07-21T22:57:24.276957+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:29:54.855842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043229+0000","last_change":"2023-07-21T22:57:22.512259+0000","last_active":"2023-07-21T22:57:25.043229+0000","last_peered":"2023-07-21T22:57:25.043229+0000","last_clean":"2023-07-21T22:57:25.043229+0000","last_became_active":"2023-07-21T22:57:22.511911+0000","last_became_peered":"2023-07-21T22:57:22.511911+0000","last_unstale":"2023-07-21T22:57:25.043229+0000","last_undegraded":"2023-07-21T22:57:25.043229+0000","last_fullsized":"2023-07-21T22:57:25.043229+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:08:42.866657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049803+0000","last_change":"2023-07-21T22:57:23.301223+0000","last_active":"2023-07-21T22:57:25.049803+0000","last_peered":"2023-07-21T22:57:25.049803+0000","last_clean":"2023-07-21T22:57:25.049803+0000","last_became_active":"2023-07-21T22:57:23.300305+0000","last_became_peered":"2023-07-21T22:57:23.300305+0000","last_unstale":"2023-07-21T22:57:25.049803+0000","last_undegraded":"2023-07-21T22:57:25.049803+0000","last_fullsized":"2023-07-21T22:57:25.049803+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:38:22.993699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049570+0000","last_change":"2023-07-21T22:57:22.514061+0000","last_active":"2023-07-21T22:57:25.049570+0000","last_peered":"2023-07-21T22:57:25.049570+0000","last_clean":"2023-07-21T22:57:25.049570+0000","last_became_active":"2023-07-21T22:57:22.513784+0000","last_became_peered":"2023-07-21T22:57:22.513784+0000","last_unstale":"2023-07-21T22:57:25.049570+0000","last_undegraded":"2023-07-21T22:57:25.049570+0000","last_fullsized":"2023-07-21T22:57:25.049570+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:54:01.639581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283407+0000","last_change":"2023-07-21T22:57:23.296270+0000","last_active":"2023-07-21T22:57:24.283407+0000","last_peered":"2023-07-21T22:57:24.283407+0000","last_clean":"2023-07-21T22:57:24.283407+0000","last_became_active":"2023-07-21T22:57:23.295980+0000","last_became_peered":"2023-07-21T22:57:23.295980+0000","last_unstale":"2023-07-21T22:57:24.283407+0000","last_undegraded":"2023-07-21T22:57:24.283407+0000","last_fullsized":"2023-07-21T22:57:24.283407+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:56:12.366679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"191'2","reported_seq":15,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.277008+0000","last_change":"2023-07-21T22:57:22.516848+0000","last_active":"2023-07-21T22:57:24.277008+0000","last_peered":"2023-07-21T22:57:24.277008+0000","last_clean":"2023-07-21T22:57:24.277008+0000","last_became_active":"2023-07-21T22:57:22.516566+0000","last_became_peered":"2023-07-21T22:57:22.516566+0000","last_unstale":"2023-07-21T22:57:24.277008+0000","last_undegraded":"2023-07-21T22:57:24.277008+0000","last_fullsized":"2023-07-21T22:57:24.277008+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:54:53.846788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274309+0000","last_change":"2023-07-21T22:57:23.287773+0000","last_active":"2023-07-21T22:57:24.274309+0000","last_peered":"2023-07-21T22:57:24.274309+0000","last_clean":"2023-07-21T22:57:24.274309+0000","last_became_active":"2023-07-21T22:57:23.287491+0000","last_became_peered":"2023-07-21T22:57:23.287491+0000","last_unstale":"2023-07-21T22:57:24.274309+0000","last_undegraded":"2023-07-21T22:57:24.274309+0000","last_fullsized":"2023-07-21T22:57:24.274309+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:18:33.574176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"192'1","reported_seq":14,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.044098+0000","last_change":"2023-07-21T22:57:22.522644+0000","last_active":"2023-07-21T22:57:25.044098+0000","last_peered":"2023-07-21T22:57:25.044098+0000","last_clean":"2023-07-21T22:57:25.044098+0000","last_became_active":"2023-07-21T22:57:22.522294+0000","last_became_peered":"2023-07-21T22:57:22.522294+0000","last_unstale":"2023-07-21T22:57:25.044098+0000","last_undegraded":"2023-07-21T22:57:25.044098+0000","last_fullsized":"2023-07-21T22:57:25.044098+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:53:47.689625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043382+0000","last_change":"2023-07-21T22:57:23.287670+0000","last_active":"2023-07-21T22:57:25.043382+0000","last_peered":"2023-07-21T22:57:25.043382+0000","last_clean":"2023-07-21T22:57:25.043382+0000","last_became_active":"2023-07-21T22:57:23.287351+0000","last_became_peered":"2023-07-21T22:57:23.287351+0000","last_unstale":"2023-07-21T22:57:25.043382+0000","last_undegraded":"2023-07-21T22:57:25.043382+0000","last_fullsized":"2023-07-21T22:57:25.043382+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:59:29.872650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043898+0000","last_change":"2023-07-21T22:57:22.518224+0000","last_active":"2023-07-21T22:57:25.043898+0000","last_peered":"2023-07-21T22:57:25.043898+0000","last_clean":"2023-07-21T22:57:25.043898+0000","last_became_active":"2023-07-21T22:57:22.517933+0000","last_became_peered":"2023-07-21T22:57:22.517933+0000","last_unstale":"2023-07-21T22:57:25.043898+0000","last_undegraded":"2023-07-21T22:57:25.043898+0000","last_fullsized":"2023-07-21T22:57:25.043898+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:18:29.879949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274599+0000","last_change":"2023-07-21T22:57:23.283995+0000","last_active":"2023-07-21T22:57:24.274599+0000","last_peered":"2023-07-21T22:57:24.274599+0000","last_clean":"2023-07-21T22:57:24.274599+0000","last_became_active":"2023-07-21T22:57:23.283745+0000","last_became_peered":"2023-07-21T22:57:23.283745+0000","last_unstale":"2023-07-21T22:57:24.274599+0000","last_undegraded":"2023-07-21T22:57:24.274599+0000","last_fullsized":"2023-07-21T22:57:24.274599+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:42:58.635822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043661+0000","last_change":"2023-07-21T22:57:22.512688+0000","last_active":"2023-07-21T22:57:25.043661+0000","last_peered":"2023-07-21T22:57:25.043661+0000","last_clean":"2023-07-21T22:57:25.043661+0000","last_became_active":"2023-07-21T22:57:22.512404+0000","last_became_peered":"2023-07-21T22:57:22.512404+0000","last_unstale":"2023-07-21T22:57:25.043661+0000","last_undegraded":"2023-07-21T22:57:25.043661+0000","last_fullsized":"2023-07-21T22:57:25.043661+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:34:13.179318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.762857+0000","last_change":"2023-07-21T22:57:23.297547+0000","last_active":"2023-07-21T22:57:24.762857+0000","last_peered":"2023-07-21T22:57:24.762857+0000","last_clean":"2023-07-21T22:57:24.762857+0000","last_became_active":"2023-07-21T22:57:23.297182+0000","last_became_peered":"2023-07-21T22:57:23.297182+0000","last_unstale":"2023-07-21T22:57:24.762857+0000","last_undegraded":"2023-07-21T22:57:24.762857+0000","last_fullsized":"2023-07-21T22:57:24.762857+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:42:11.053450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.762621+0000","last_change":"2023-07-21T22:57:22.523033+0000","last_active":"2023-07-21T22:57:24.762621+0000","last_peered":"2023-07-21T22:57:24.762621+0000","last_clean":"2023-07-21T22:57:24.762621+0000","last_became_active":"2023-07-21T22:57:22.522687+0000","last_became_peered":"2023-07-21T22:57:22.522687+0000","last_unstale":"2023-07-21T22:57:24.762621+0000","last_undegraded":"2023-07-21T22:57:24.762621+0000","last_fullsized":"2023-07-21T22:57:24.762621+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:14:21.451780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049273+0000","last_change":"2023-07-21T22:57:23.301139+0000","last_active":"2023-07-21T22:57:25.049273+0000","last_peered":"2023-07-21T22:57:25.049273+0000","last_clean":"2023-07-21T22:57:25.049273+0000","last_became_active":"2023-07-21T22:57:23.300812+0000","last_became_peered":"2023-07-21T22:57:23.300812+0000","last_unstale":"2023-07-21T22:57:25.049273+0000","last_undegraded":"2023-07-21T22:57:25.049273+0000","last_fullsized":"2023-07-21T22:57:25.049273+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:20:15.024184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043710+0000","last_change":"2023-07-21T22:57:22.520034+0000","last_active":"2023-07-21T22:57:25.043710+0000","last_peered":"2023-07-21T22:57:25.043710+0000","last_clean":"2023-07-21T22:57:25.043710+0000","last_became_active":"2023-07-21T22:57:22.518945+0000","last_became_peered":"2023-07-21T22:57:22.518945+0000","last_unstale":"2023-07-21T22:57:25.043710+0000","last_undegraded":"2023-07-21T22:57:25.043710+0000","last_fullsized":"2023-07-21T22:57:25.043710+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:06:00.968100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043935+0000","last_change":"2023-07-21T22:57:23.279904+0000","last_active":"2023-07-21T22:57:25.043935+0000","last_peered":"2023-07-21T22:57:25.043935+0000","last_clean":"2023-07-21T22:57:25.043935+0000","last_became_active":"2023-07-21T22:57:23.279594+0000","last_became_peered":"2023-07-21T22:57:23.279594+0000","last_unstale":"2023-07-21T22:57:25.043935+0000","last_undegraded":"2023-07-21T22:57:25.043935+0000","last_fullsized":"2023-07-21T22:57:25.043935+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:42:43.038728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.284060+0000","last_change":"2023-07-21T22:57:22.519089+0000","last_active":"2023-07-21T22:57:24.284060+0000","last_peered":"2023-07-21T22:57:24.284060+0000","last_clean":"2023-07-21T22:57:24.284060+0000","last_became_active":"2023-07-21T22:57:22.518879+0000","last_became_peered":"2023-07-21T22:57:22.518879+0000","last_unstale":"2023-07-21T22:57:24.284060+0000","last_undegraded":"2023-07-21T22:57:24.284060+0000","last_fullsized":"2023-07-21T22:57:24.284060+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:52:06.987576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.044241+0000","last_change":"2023-07-21T22:57:23.295376+0000","last_active":"2023-07-21T22:57:25.044241+0000","last_peered":"2023-07-21T22:57:25.044241+0000","last_clean":"2023-07-21T22:57:25.044241+0000","last_became_active":"2023-07-21T22:57:23.295103+0000","last_became_peered":"2023-07-21T22:57:23.295103+0000","last_unstale":"2023-07-21T22:57:25.044241+0000","last_undegraded":"2023-07-21T22:57:25.044241+0000","last_fullsized":"2023-07-21T22:57:25.044241+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:00:22.349624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276385+0000","last_change":"2023-07-21T22:57:22.513969+0000","last_active":"2023-07-21T22:57:24.276385+0000","last_peered":"2023-07-21T22:57:24.276385+0000","last_clean":"2023-07-21T22:57:24.276385+0000","last_became_active":"2023-07-21T22:57:22.513667+0000","last_became_peered":"2023-07-21T22:57:22.513667+0000","last_unstale":"2023-07-21T22:57:24.276385+0000","last_undegraded":"2023-07-21T22:57:24.276385+0000","last_fullsized":"2023-07-21T22:57:24.276385+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:05:49.216445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.048979+0000","last_change":"2023-07-21T22:57:23.297140+0000","last_active":"2023-07-21T22:57:25.048979+0000","last_peered":"2023-07-21T22:57:25.048979+0000","last_clean":"2023-07-21T22:57:25.048979+0000","last_became_active":"2023-07-21T22:57:23.296866+0000","last_became_peered":"2023-07-21T22:57:23.296866+0000","last_unstale":"2023-07-21T22:57:25.048979+0000","last_undegraded":"2023-07-21T22:57:25.048979+0000","last_fullsized":"2023-07-21T22:57:25.048979+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:31:16.592400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043996+0000","last_change":"2023-07-21T22:57:22.522623+0000","last_active":"2023-07-21T22:57:25.043996+0000","last_peered":"2023-07-21T22:57:25.043996+0000","last_clean":"2023-07-21T22:57:25.043996+0000","last_became_active":"2023-07-21T22:57:22.522369+0000","last_became_peered":"2023-07-21T22:57:22.522369+0000","last_unstale":"2023-07-21T22:57:25.043996+0000","last_undegraded":"2023-07-21T22:57:25.043996+0000","last_fullsized":"2023-07-21T22:57:25.043996+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:44:16.439024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"180'326","reported_seq":1215,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049938+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:57:25.049938+0000","last_peered":"2023-07-21T22:57:25.049938+0000","last_clean":"2023-07-21T22:57:25.049938+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:57:25.049938+0000","last_undegraded":"2023-07-21T22:57:25.049938+0000","last_fullsized":"2023-07-21T22:57:25.049938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:10:17.675431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":357,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283700+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:57:24.283700+0000","last_peered":"2023-07-21T22:57:24.283700+0000","last_clean":"2023-07-21T22:57:24.283700+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:57:24.283700+0000","last_undegraded":"2023-07-21T22:57:24.283700+0000","last_fullsized":"2023-07-21T22:57:24.283700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:36:06.616209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043477+0000","last_change":"2023-07-21T22:57:23.282189+0000","last_active":"2023-07-21T22:57:25.043477+0000","last_peered":"2023-07-21T22:57:25.043477+0000","last_clean":"2023-07-21T22:57:25.043477+0000","last_became_active":"2023-07-21T22:57:23.281885+0000","last_became_peered":"2023-07-21T22:57:23.281885+0000","last_unstale":"2023-07-21T22:57:25.043477+0000","last_undegraded":"2023-07-21T22:57:25.043477+0000","last_fullsized":"2023-07-21T22:57:25.043477+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:25.882428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"191'3","reported_seq":16,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.762831+0000","last_change":"2023-07-21T22:57:22.511800+0000","last_active":"2023-07-21T22:57:24.762831+0000","last_peered":"2023-07-21T22:57:24.762831+0000","last_clean":"2023-07-21T22:57:24.762831+0000","last_became_active":"2023-07-21T22:57:22.511372+0000","last_became_peered":"2023-07-21T22:57:22.511372+0000","last_unstale":"2023-07-21T22:57:24.762831+0000","last_undegraded":"2023-07-21T22:57:24.762831+0000","last_fullsized":"2023-07-21T22:57:24.762831+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:20:13.197466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":318,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049762+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:57:25.049762+0000","last_peered":"2023-07-21T22:57:25.049762+0000","last_clean":"2023-07-21T22:57:25.049762+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:57:25.049762+0000","last_undegraded":"2023-07-21T22:57:25.049762+0000","last_fullsized":"2023-07-21T22:57:25.049762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:26:26.668909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043896+0000","last_change":"2023-07-21T22:57:23.298779+0000","last_active":"2023-07-21T22:57:25.043896+0000","last_peered":"2023-07-21T22:57:25.043896+0000","last_clean":"2023-07-21T22:57:25.043896+0000","last_became_active":"2023-07-21T22:57:23.298449+0000","last_became_peered":"2023-07-21T22:57:23.298449+0000","last_unstale":"2023-07-21T22:57:25.043896+0000","last_undegraded":"2023-07-21T22:57:25.043896+0000","last_fullsized":"2023-07-21T22:57:25.043896+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:21:27.069642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"191'6","reported_seq":19,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043868+0000","last_change":"2023-07-21T22:57:22.515084+0000","last_active":"2023-07-21T22:57:25.043868+0000","last_peered":"2023-07-21T22:57:25.043868+0000","last_clean":"2023-07-21T22:57:25.043868+0000","last_became_active":"2023-07-21T22:57:22.514810+0000","last_became_peered":"2023-07-21T22:57:22.514810+0000","last_unstale":"2023-07-21T22:57:25.043868+0000","last_undegraded":"2023-07-21T22:57:25.043868+0000","last_fullsized":"2023-07-21T22:57:25.043868+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:22:21.229244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":321,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043326+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:57:25.043326+0000","last_peered":"2023-07-21T22:57:25.043326+0000","last_clean":"2023-07-21T22:57:25.043326+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:57:25.043326+0000","last_undegraded":"2023-07-21T22:57:25.043326+0000","last_fullsized":"2023-07-21T22:57:25.043326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:08:52.925868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049916+0000","last_change":"2023-07-21T22:57:23.301000+0000","last_active":"2023-07-21T22:57:25.049916+0000","last_peered":"2023-07-21T22:57:25.049916+0000","last_clean":"2023-07-21T22:57:25.049916+0000","last_became_active":"2023-07-21T22:57:23.300660+0000","last_became_peered":"2023-07-21T22:57:23.300660+0000","last_unstale":"2023-07-21T22:57:25.049916+0000","last_undegraded":"2023-07-21T22:57:25.049916+0000","last_fullsized":"2023-07-21T22:57:25.049916+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:43:12.491919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043820+0000","last_change":"2023-07-21T22:57:22.516060+0000","last_active":"2023-07-21T22:57:25.043820+0000","last_peered":"2023-07-21T22:57:25.043820+0000","last_clean":"2023-07-21T22:57:25.043820+0000","last_became_active":"2023-07-21T22:57:22.515686+0000","last_became_peered":"2023-07-21T22:57:22.515686+0000","last_unstale":"2023-07-21T22:57:25.043820+0000","last_undegraded":"2023-07-21T22:57:25.043820+0000","last_fullsized":"2023-07-21T22:57:25.043820+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:23:40.846280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":357,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.284020+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:57:24.284020+0000","last_peered":"2023-07-21T22:57:24.284020+0000","last_clean":"2023-07-21T22:57:24.284020+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:57:24.284020+0000","last_undegraded":"2023-07-21T22:57:24.284020+0000","last_fullsized":"2023-07-21T22:57:24.284020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:13:23.560357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283813+0000","last_change":"2023-07-21T22:57:23.295787+0000","last_active":"2023-07-21T22:57:24.283813+0000","last_peered":"2023-07-21T22:57:24.283813+0000","last_clean":"2023-07-21T22:57:24.283813+0000","last_became_active":"2023-07-21T22:57:23.295510+0000","last_became_peered":"2023-07-21T22:57:23.295510+0000","last_unstale":"2023-07-21T22:57:24.283813+0000","last_undegraded":"2023-07-21T22:57:24.283813+0000","last_fullsized":"2023-07-21T22:57:24.283813+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:10:55.956717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283864+0000","last_change":"2023-07-21T22:57:22.518008+0000","last_active":"2023-07-21T22:57:24.283864+0000","last_peered":"2023-07-21T22:57:24.283864+0000","last_clean":"2023-07-21T22:57:24.283864+0000","last_became_active":"2023-07-21T22:57:22.517728+0000","last_became_peered":"2023-07-21T22:57:22.517728+0000","last_unstale":"2023-07-21T22:57:24.283864+0000","last_undegraded":"2023-07-21T22:57:24.283864+0000","last_fullsized":"2023-07-21T22:57:24.283864+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:00:38.119286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":335,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274652+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:57:24.274652+0000","last_peered":"2023-07-21T22:57:24.274652+0000","last_clean":"2023-07-21T22:57:24.274652+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:57:24.274652+0000","last_undegraded":"2023-07-21T22:57:24.274652+0000","last_fullsized":"2023-07-21T22:57:24.274652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:27:54.418745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.044216+0000","last_change":"2023-07-21T22:57:23.285757+0000","last_active":"2023-07-21T22:57:25.044216+0000","last_peered":"2023-07-21T22:57:25.044216+0000","last_clean":"2023-07-21T22:57:25.044216+0000","last_became_active":"2023-07-21T22:57:23.285489+0000","last_became_peered":"2023-07-21T22:57:23.285489+0000","last_unstale":"2023-07-21T22:57:25.044216+0000","last_undegraded":"2023-07-21T22:57:25.044216+0000","last_fullsized":"2023-07-21T22:57:25.044216+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:56:24.067028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"191'8","reported_seq":21,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274270+0000","last_change":"2023-07-21T22:57:22.505531+0000","last_active":"2023-07-21T22:57:24.274270+0000","last_peered":"2023-07-21T22:57:24.274270+0000","last_clean":"2023-07-21T22:57:24.274270+0000","last_became_active":"2023-07-21T22:57:22.505255+0000","last_became_peered":"2023-07-21T22:57:22.505255+0000","last_unstale":"2023-07-21T22:57:24.274270+0000","last_undegraded":"2023-07-21T22:57:24.274270+0000","last_fullsized":"2023-07-21T22:57:24.274270+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:36:31.365260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":317,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049406+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:57:25.049406+0000","last_peered":"2023-07-21T22:57:25.049406+0000","last_clean":"2023-07-21T22:57:25.049406+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:57:25.049406+0000","last_undegraded":"2023-07-21T22:57:25.049406+0000","last_fullsized":"2023-07-21T22:57:25.049406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:18.799521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049436+0000","last_change":"2023-07-21T22:57:23.301683+0000","last_active":"2023-07-21T22:57:25.049436+0000","last_peered":"2023-07-21T22:57:25.049436+0000","last_clean":"2023-07-21T22:57:25.049436+0000","last_became_active":"2023-07-21T22:57:23.301314+0000","last_became_peered":"2023-07-21T22:57:23.301314+0000","last_unstale":"2023-07-21T22:57:25.049436+0000","last_undegraded":"2023-07-21T22:57:25.049436+0000","last_fullsized":"2023-07-21T22:57:25.049436+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:36:58.572211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"191'2","reported_seq":15,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276829+0000","last_change":"2023-07-21T22:57:22.516962+0000","last_active":"2023-07-21T22:57:24.276829+0000","last_peered":"2023-07-21T22:57:24.276829+0000","last_clean":"2023-07-21T22:57:24.276829+0000","last_became_active":"2023-07-21T22:57:22.516672+0000","last_became_peered":"2023-07-21T22:57:22.516672+0000","last_unstale":"2023-07-21T22:57:24.276829+0000","last_undegraded":"2023-07-21T22:57:24.276829+0000","last_fullsized":"2023-07-21T22:57:24.276829+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:58.699337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":335,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274928+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:57:24.274928+0000","last_peered":"2023-07-21T22:57:24.274928+0000","last_clean":"2023-07-21T22:57:24.274928+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:57:24.274928+0000","last_undegraded":"2023-07-21T22:57:24.274928+0000","last_fullsized":"2023-07-21T22:57:24.274928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:26:15.379511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274379+0000","last_change":"2023-07-21T22:57:23.291619+0000","last_active":"2023-07-21T22:57:24.274379+0000","last_peered":"2023-07-21T22:57:24.274379+0000","last_clean":"2023-07-21T22:57:24.274379+0000","last_became_active":"2023-07-21T22:57:23.291189+0000","last_became_peered":"2023-07-21T22:57:23.291189+0000","last_unstale":"2023-07-21T22:57:24.274379+0000","last_undegraded":"2023-07-21T22:57:24.274379+0000","last_fullsized":"2023-07-21T22:57:24.274379+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:50:56.877936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043600+0000","last_change":"2023-07-21T22:57:22.517887+0000","last_active":"2023-07-21T22:57:25.043600+0000","last_peered":"2023-07-21T22:57:25.043600+0000","last_clean":"2023-07-21T22:57:25.043600+0000","last_became_active":"2023-07-21T22:57:22.517612+0000","last_became_peered":"2023-07-21T22:57:22.517612+0000","last_unstale":"2023-07-21T22:57:25.043600+0000","last_undegraded":"2023-07-21T22:57:25.043600+0000","last_fullsized":"2023-07-21T22:57:25.043600+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:02:36.810558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":314,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049919+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:57:25.049919+0000","last_peered":"2023-07-21T22:57:25.049919+0000","last_clean":"2023-07-21T22:57:25.049919+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:57:25.049919+0000","last_undegraded":"2023-07-21T22:57:25.049919+0000","last_fullsized":"2023-07-21T22:57:25.049919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:34:57.518013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509901,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64300,"kb_used_data":2916,"kb_used_omap":0,"kb_used_meta":61376,"kb_avail":94307540,"statfs":{"total":96636764160,"available":96570920960,"internally_reserved":0,"allocated":2985984,"data_stored":1820489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":62849024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.749,"15min":0.76200000000000001},"min":{"1min":0.42699999999999999,"5min":0.35999999999999999,"15min":0.34999999999999998},"max":{"1min":0.93400000000000005,"5min":0.96799999999999997,"15min":1.143},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39000000000000001},"max":{"1min":0.90200000000000002,"5min":0.93200000000000005,"15min":1.0349999999999999},"last":0.61799999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.752,"15min":0.76300000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.40600000000000003},"max":{"1min":0.94099999999999995,"5min":1.089,"15min":1.089},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.73099999999999998,"15min":0.74099999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88800000000000001,"5min":0.95599999999999996,"15min":1.02},"last":0.69199999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.747,"15min":0.755},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.47999999999999998},"max":{"1min":0.95899999999999996,"5min":1.0049999999999999,"15min":1.0780000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.78400000000000003},"min":{"1min":0.53000000000000003,"5min":0.51100000000000001,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":0.98899999999999999,"15min":1.0660000000000001},"last":0.80600000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.76100000000000001,"15min":0.77400000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97399999999999998,"5min":0.98099999999999998,"15min":1.0980000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.77200000000000002,"15min":0.77900000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.89100000000000001,"5min":0.98299999999999998,"15min":1.036},"last":0.72599999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.34999999999999998},"max":{"1min":0.77000000000000002,"5min":0.81299999999999994,"15min":0.89700000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.60399999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.34699999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.0940000000000001},"last":0.53900000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.99399999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.52300000000000002,"5min":0.48499999999999999,"15min":0.40699999999999997},"max":{"1min":0.871,"5min":0.91000000000000003,"15min":1.0429999999999999},"last":0.74199999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.97399999999999998},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.64000000000000001,"15min":0.63400000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84499999999999997,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71199999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542607,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37480,"kb_used_data":2336,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334360,"statfs":{"total":96636764160,"available":96598384640,"internally_reserved":0,"allocated":2392064,"data_stored":1230121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.59299999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.97899999999999998,"5min":1.022,"15min":1.024},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79900000000000004,"15min":0.80400000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93400000000000005,"5min":1,"15min":1.0780000000000001},"last":0.77400000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.874,"5min":0.96999999999999997,"15min":1.006},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.747,"15min":0.74099999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90600000000000003,"5min":1.046,"15min":1.046},"last":0.622}]},{"osd":2,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.75700000000000001,"15min":0.77200000000000002},"min":{"1min":0.58999999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.88500000000000001,"5min":0.97399999999999998,"15min":1.038},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.56200000000000006,"5min":0.438,"15min":0.438},"max":{"1min":0.93400000000000005,"5min":0.98799999999999999,"15min":1.0600000000000001},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.753,"15min":0.751},"min":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.48999999999999999},"max":{"1min":0.93700000000000006,"5min":1.089,"15min":1.089},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.749,"15min":0.75},"min":{"1min":0.52800000000000002,"5min":0.499,"15min":0.499},"max":{"1min":0.89100000000000001,"5min":0.96199999999999997,"15min":0.96999999999999997},"last":0.754}]},{"osd":4,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.36099999999999999},"max":{"1min":0.81799999999999995,"5min":0.88400000000000001,"15min":0.92300000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":0.77900000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.66600000000000004,"5min":0.89600000000000002,"15min":0.91300000000000003},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42299999999999999},"max":{"1min":0.77700000000000002,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.64000000000000001,"15min":0.65500000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.38700000000000001},"max":{"1min":0.76400000000000001,"5min":0.91600000000000004,"15min":1.0129999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.432},"max":{"1min":0.78500000000000003,"5min":0.90000000000000002,"15min":0.96299999999999997},"last":0.55900000000000005}]}]},{"osd":5,"up_from":15,"seq":64424509900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55536,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316304,"statfs":{"total":96636764160,"available":96579895296,"internally_reserved":0,"allocated":2400256,"data_stored":1230245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.46600000000000003,"5min":0.437,"15min":0.32100000000000001},"max":{"1min":0.92900000000000005,"5min":1.044,"15min":1.044},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.41499999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.83999999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.42399999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73099999999999998,"15min":0.73299999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.89800000000000002,"5min":1.038,"15min":1.054},"last":0.86299999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.52200000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.119},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.747,"15min":0.74199999999999999},"min":{"1min":0.56999999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95099999999999996,"5min":0.96899999999999997,"15min":1.0880000000000001},"last":0.78500000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79200000000000004,"15min":0.78600000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.47299999999999998},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.94499999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57399999999999995,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76500000000000001,"5min":0.90400000000000003,"15min":0.91300000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68500000000000005,"15min":0.68100000000000005},"min":{"1min":0.52600000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.022,"5min":1.022,"15min":1.0369999999999999},"last":0.73299999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90500000000000003,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.44700000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92400000000000004,"5min":0.93600000000000005,"15min":1.0629999999999999},"last":0.81499999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":0.88100000000000001,"5min":1.028,"15min":1.0549999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73499999999999999,"15min":0.72299999999999998},"min":{"1min":0.496,"5min":0.48699999999999999,"15min":0.45900000000000002},"max":{"1min":1.034,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.88400000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509901,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37496,"kb_used_data":2352,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334344,"statfs":{"total":96636764160,"available":96598368256,"internally_reserved":0,"allocated":2408448,"data_stored":1230885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.34599999999999997},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.76900000000000002},"min":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.35299999999999998},"max":{"1min":1.3500000000000001,"5min":1.488,"15min":1.488},"last":0.80800000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.52700000000000002,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":2.7320000000000002,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.72199999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.80300000000000005,"15min":0.78800000000000003},"min":{"1min":0.62,"5min":0.60699999999999998,"15min":0.46899999999999997},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.747},{"interface":"front","average":{"1min":0.878,"5min":0.79800000000000004,"15min":0.78600000000000003},"min":{"1min":0.623,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":0.91300000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.78800000000000003,"15min":0.75600000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.0169999999999999,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82299999999999995,"15min":0.81599999999999995},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.89700000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73299999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.44500000000000001,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.151},"last":0.58999999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.57899999999999996,"5min":0.45800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94999999999999996,"5min":0.96299999999999997,"15min":1.252},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.44400000000000001,"15min":0.437},"max":{"1min":1.006,"5min":1.006,"15min":1.0609999999999999},"last":0.78500000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68300000000000005,"15min":0.66000000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.39500000000000002},"max":{"1min":1.0189999999999999,"5min":1.526,"15min":1.526},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.53600000000000003,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.99099999999999999,"5min":1.0820000000000001,"15min":1.206},"last":0.87}]}]},{"osd":3,"up_from":15,"seq":64424509900,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37500,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334340,"statfs":{"total":96636764160,"available":96598364160,"internally_reserved":0,"allocated":2412544,"data_stored":1232289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.503,"15min":0.496},"min":{"1min":0.29899999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57899999999999996,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.65100000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.35299999999999998,"5min":0.317,"15min":0.312},"max":{"1min":0.72999999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79700000000000004,"5min":0.81799999999999995,"15min":0.88100000000000001},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.80000000000000004,"5min":0.83199999999999996,"15min":0.84699999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.36899999999999999,"15min":0.36299999999999999},"max":{"1min":0.78600000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58999999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77600000000000002,"15min":0.77900000000000003},"min":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.441},"max":{"1min":1.046,"5min":1.101,"15min":1.244},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.84399999999999997},"min":{"1min":0.58099999999999996,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.66200000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.57099999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.626},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.59499999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.006,"5min":1.087,"15min":1.2230000000000001},"last":0.68000000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81200000000000006,"15min":0.80600000000000005},"min":{"1min":0.58799999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0820000000000001,"5min":1.127,"15min":1.147},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78500000000000003,"15min":0.78600000000000003},"min":{"1min":0.56799999999999995,"5min":0.55100000000000005,"15min":0.53000000000000003},"max":{"1min":1.296,"5min":1.296,"15min":1.3660000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83299999999999996,"15min":0.82999999999999996},"min":{"1min":0.624,"5min":0.55000000000000004,"15min":0.50900000000000001},"max":{"1min":1.175,"5min":1.175,"15min":1.4510000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82799999999999996,"15min":0.84299999999999997},"min":{"1min":0.61499999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.427},"last":0.71999999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509902,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55528,"kb_used_data":2336,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316312,"statfs":{"total":96636764160,"available":96579903488,"internally_reserved":0,"allocated":2392064,"data_stored":1230121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.52700000000000002,"15min":0.51000000000000001},"min":{"1min":0.33400000000000002,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.45900000000000002,"5min":0.38,"15min":0.377},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.35599999999999998},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.47199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.51000000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.499},"min":{"1min":0.379,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69399999999999995,"5min":0.73099999999999998,"15min":0.92800000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.60599999999999998,"15min":0.59399999999999997},"min":{"1min":0.53400000000000003,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.41999999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.82499999999999996,"15min":0.82599999999999996},"min":{"1min":0.66000000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.55900000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1240000000000001,"5min":1.1359999999999999,"15min":1.391},"last":0.55400000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.67200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.82599999999999996,"15min":0.83699999999999997},"min":{"1min":0.57699999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.80000000000000004,"15min":0.81899999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1220000000000001,"5min":1.1499999999999999,"15min":1.2969999999999999},"last":0.624},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.84399999999999997,"15min":0.84699999999999998},"min":{"1min":0.63600000000000001,"5min":0.59999999999999998,"15min":0.55600000000000005},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.63900000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.84399999999999997,"15min":0.85099999999999998},"min":{"1min":0.748,"5min":0.62,"15min":0.56000000000000005},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81999999999999995,"15min":0.84399999999999997},"min":{"1min":0.59599999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"max":{"1min":1.1679999999999999,"5min":1.2749999999999999,"15min":1.3939999999999999},"last":0.67300000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509901,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37492,"kb_used_data":2348,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334348,"statfs":{"total":96636764160,"available":96598372352,"internally_reserved":0,"allocated":2404352,"data_stored":1231685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48799999999999999,"15min":0.497},"min":{"1min":0.29899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89500000000000002,"5min":1.149,"15min":1.149},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50900000000000001,"15min":0.52600000000000002},"min":{"1min":0.39500000000000002,"5min":0.33900000000000002,"15min":0.33100000000000002},"max":{"1min":0.64900000000000002,"5min":0.80800000000000005,"15min":0.82799999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73699999999999999,"5min":1.21,"15min":1.21},"last":0.44900000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60199999999999998,"15min":0.61099999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.878,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.38900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.77300000000000002,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78200000000000003,"15min":0.80100000000000005},"min":{"1min":0.59499999999999997,"5min":0.53700000000000003,"15min":0.46500000000000002},"max":{"1min":1.0329999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81999999999999995,"15min":0.82299999999999995},"min":{"1min":0.59199999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0169999999999999,"5min":1.2849999999999999,"15min":1.302},"last":0.629}]},{"osd":5,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80900000000000005},"min":{"1min":0.57999999999999996,"5min":0.52900000000000003,"15min":0.499},"max":{"1min":1.002,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79000000000000004,"15min":0.80900000000000005},"min":{"1min":0.57899999999999996,"5min":0.52800000000000002,"15min":0.48799999999999999},"max":{"1min":1.052,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.57399999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83299999999999996,"15min":0.82899999999999996},"min":{"1min":0.68000000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0700000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78600000000000003,"15min":0.81100000000000005},"min":{"1min":0.56200000000000006,"5min":0.495,"15min":0.495},"max":{"1min":1.028,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80600000000000005,"15min":0.82999999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0009999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.82899999999999996,"15min":0.83399999999999996},"min":{"1min":0.63,"5min":0.61799999999999999,"15min":0.55000000000000004},"max":{"1min":1.0009999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.68300000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509903,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38068,"kb_used_data":2924,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333772,"statfs":{"total":96636764160,"available":96597782528,"internally_reserved":0,"allocated":2994176,"data_stored":1820593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.498,"15min":0.48799999999999999},"min":{"1min":0.317,"5min":0.29999999999999999,"15min":0.28499999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54300000000000004,"15min":0.54000000000000004},"min":{"1min":0.40000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.36499999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33900000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.39600000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.627,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.41599999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.629,"5min":0.51200000000000001,"15min":0.51000000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.4370000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.82999999999999996,"15min":0.82699999999999996},"min":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.72899999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.83199999999999996,"15min":0.82199999999999995},"min":{"1min":0.63500000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2130000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.87,"15min":0.84899999999999998},"min":{"1min":0.628,"5min":0.497,"15min":0.497},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.351},"last":0.68000000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.58499999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.627,"5min":0.60699999999999998,"15min":0.60299999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.83499999999999996,"15min":0.83199999999999996},"min":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"max":{"1min":1.1699999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.877,"15min":0.873},"min":{"1min":0.64900000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.411},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:57:32.277 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:57:32.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdc7511640 1 Processor -- start 2023-07-21T22:57:32.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdc7511640 1 -- start start 2023-07-21T22:57:32.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdc7511640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdc00b7c70 0x7fbdc00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdc7511640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbdc00d1850 0x7fbdc015f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdc7511640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc00ccaf0 con 0x7fbdc00d1300 2023-07-21T22:57:32.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdc7511640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc00d1190 con 0x7fbdc00d1850 2023-07-21T22:57:32.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdc7511640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc0160600 con 0x7fbdc00b7c70 2023-07-21T22:57:32.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdc5aae640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbdc00d1300 0x7fbdc00d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58244/0 (socket says 172.21.15.6:58244) 2023-07-21T22:57:32.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdc5aae640 1 -- 172.21.15.6:0/81177139 learned_addr learned my addr 172.21.15.6:0/81177139 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:32.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdc4aac640 1 --2- 172.21.15.6:0/81177139 >> v2:172.21.15.161:3300/0 conn(0x7fbdc00d1850 0x7fbdc015f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdc52ad640 1 --2- 172.21.15.6:0/81177139 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdc00b7c70 0x7fbdc00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdb7fff640 1 -- 172.21.15.6:0/81177139 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680813298 0 0) 0x7fbdc00ccaf0 con 0x7fbdc00d1300 2023-07-21T22:57:32.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdb7fff640 1 -- 172.21.15.6:0/81177139 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdac003530 con 0x7fbdc00d1300 2023-07-21T22:57:32.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdb7fff640 1 -- 172.21.15.6:0/81177139 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 580444342 0 0) 0x7fbdac003530 con 0x7fbdc00d1300 2023-07-21T22:57:32.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdb7fff640 1 -- 172.21.15.6:0/81177139 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdc00b7c70 msgr2=0x7fbdc00d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:32.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdb7fff640 1 --2- 172.21.15.6:0/81177139 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdc00b7c70 0x7fbdc00d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdb7fff640 1 -- 172.21.15.6:0/81177139 >> v2:172.21.15.161:3300/0 conn(0x7fbdc00d1850 msgr2=0x7fbdc015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:32.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdb7fff640 1 --2- 172.21.15.6:0/81177139 >> v2:172.21.15.161:3300/0 conn(0x7fbdc00d1850 0x7fbdc015f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdb7fff640 1 -- 172.21.15.6:0/81177139 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc0160320 con 0x7fbdc00d1300 2023-07-21T22:57:32.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdb7fff640 1 -- 172.21.15.6:0/81177139 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fbdb8001a00 con 0x7fbdc00d1300 2023-07-21T22:57:32.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdb7fff640 1 -- 172.21.15.6:0/81177139 >> v1:172.21.15.6:6789/0 conn(0x7fbdc00d1300 legacy=0x7fbdc00d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:32.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdb7fff640 1 --2- 172.21.15.6:0/81177139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdac0039b0 0x7fbdac003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdb7fff640 1 --2- 172.21.15.6:0/81177139 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdc00b7c70 0x7fbdac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdb7fff640 1 --2- 172.21.15.6:0/81177139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdac004d10 0x7fbdac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdb7fff640 1 -- 172.21.15.6:0/81177139 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc0160600 con 0x7fbdac0039b0 2023-07-21T22:57:32.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdb7fff640 1 -- 172.21.15.6:0/81177139 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac00b990 con 0x7fbdac004d10 2023-07-21T22:57:32.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdb7fff640 1 -- 172.21.15.6:0/81177139 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac00bad0 con 0x7fbdc00b7c70 2023-07-21T22:57:32.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdc4aac640 1 --2- 172.21.15.6:0/81177139 >> v2:172.21.15.161:3300/0 conn(0x7fbdc00d1850 0x7fbdc015f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:32.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdc52ad640 1 --2- 172.21.15.6:0/81177139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdac0039b0 0x7fbdac003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdc5aae640 1 --2- 172.21.15.6:0/81177139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdac004d10 0x7fbdac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.400+0000 7fbdc4aac640 1 --2- 172.21.15.6:0/81177139 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdc00b7c70 0x7fbdac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.404+0000 7fbdc52ad640 1 -- 172.21.15.6:0/81177139 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdc00b7c70 msgr2=0x7fbdac0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:32.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.404+0000 7fbdc52ad640 1 --2- 172.21.15.6:0/81177139 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdc00b7c70 0x7fbdac0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.404+0000 7fbdc52ad640 1 -- 172.21.15.6:0/81177139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdac004d10 msgr2=0x7fbdac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:32.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.404+0000 7fbdc52ad640 1 --2- 172.21.15.6:0/81177139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdac004d10 0x7fbdac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.404+0000 7fbdc52ad640 1 -- 172.21.15.6:0/81177139 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac003530 con 0x7fbdac0039b0 2023-07-21T22:57:32.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.404+0000 7fbdc52ad640 1 --2- 172.21.15.6:0/81177139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdac0039b0 0x7fbdac003dc0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc009ae0 tx=0x7fbdbc01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd42ec5c944e466 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:32.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.404+0000 7fbdb7fff640 1 -- 172.21.15.6:0/81177139 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc0a6510 con 0x7fbdac0039b0 2023-07-21T22:57:32.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.404+0000 7fbdb7fff640 1 -- 172.21.15.6:0/81177139 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdbc0a6670 con 0x7fbdac0039b0 2023-07-21T22:57:32.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.404+0000 7fbdb7fff640 1 -- 172.21.15.6:0/81177139 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc0a6a20 con 0x7fbdac0039b0 2023-07-21T22:57:32.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.404+0000 7fbdc7511640 1 -- 172.21.15.6:0/81177139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdac0039b0 msgr2=0x7fbdac003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:32.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.404+0000 7fbdc7511640 1 --2- 172.21.15.6:0/81177139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdac0039b0 0x7fbdac003dc0 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc009ae0 tx=0x7fbdbc01c9c0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.404+0000 7fbdc5aae640 1 -- 172.21.15.6:0/81177139 reap_dead start 2023-07-21T22:57:32.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.404+0000 7fbdc7511640 1 -- 172.21.15.6:0/81177139 shutdown_connections 2023-07-21T22:57:32.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.404+0000 7fbdc7511640 1 -- 172.21.15.6:0/81177139 >> 172.21.15.6:0/81177139 conn(0x7fbdc00650b0 msgr2=0x7fbdc00654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:32.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.404+0000 7fbdc7511640 1 -- 172.21.15.6:0/81177139 shutdown_connections 2023-07-21T22:57:32.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.408+0000 7fbdc7511640 1 -- 172.21.15.6:0/81177139 wait complete. 2023-07-21T22:57:32.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.408+0000 7fbdc7511640 1 Processor -- start 2023-07-21T22:57:32.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.408+0000 7fbdc7511640 1 -- start start 2023-07-21T22:57:32.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.408+0000 7fbdc7511640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdac0039b0 0x7fbdc0151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.408+0000 7fbdc7511640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdc01649e0 0x7fbdc00b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.408+0000 7fbdc7511640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc00b3490 0x7fbdc0162970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.408+0000 7fbdc7511640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc00b3900 con 0x7fbdc00b3490 2023-07-21T22:57:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.408+0000 7fbdc7511640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc0163c20 con 0x7fbdac0039b0 2023-07-21T22:57:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.408+0000 7fbdc7511640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc0163f00 con 0x7fbdc01649e0 2023-07-21T22:57:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.408+0000 7fbdc5aae640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc00b3490 0x7fbdc0162970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.408+0000 7fbdc5aae640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc00b3490 0x7fbdc0162970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39010/0 (socket says 172.21.15.6:39010) 2023-07-21T22:57:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.408+0000 7fbdc5aae640 1 -- 172.21.15.6:0/1006134959 learned_addr learned my addr 172.21.15.6:0/1006134959 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.408+0000 7fbdc4aac640 1 --2- 172.21.15.6:0/1006134959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdc01649e0 0x7fbdc00b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.408+0000 7fbdc52ad640 1 --2- 172.21.15.6:0/1006134959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdac0039b0 0x7fbdc0151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.408+0000 7fbdc5aae640 1 -- 172.21.15.6:0/1006134959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdc01649e0 msgr2=0x7fbdc00b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.408+0000 7fbdc5aae640 1 --2- 172.21.15.6:0/1006134959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdc01649e0 0x7fbdc00b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.408+0000 7fbdc5aae640 1 -- 172.21.15.6:0/1006134959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdac0039b0 msgr2=0x7fbdc0151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.408+0000 7fbdc5aae640 1 --2- 172.21.15.6:0/1006134959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdac0039b0 0x7fbdc0151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.408+0000 7fbdc5aae640 1 -- 172.21.15.6:0/1006134959 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc01641e0 con 0x7fbdc00b3490 2023-07-21T22:57:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.412+0000 7fbdc5aae640 1 --2- 172.21.15.6:0/1006134959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc00b3490 0x7fbdc0162970 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00b44a0 tx=0x7fbdb8007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:32.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.412+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/1006134959 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8013600 con 0x7fbdc00b3490 2023-07-21T22:57:32.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.412+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/1006134959 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb8013760 con 0x7fbdc00b3490 2023-07-21T22:57:32.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.412+0000 7fbdc7511640 1 -- 172.21.15.6:0/1006134959 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc01644c0 con 0x7fbdc00b3490 2023-07-21T22:57:32.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.412+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/1006134959 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8013af0 con 0x7fbdc00b3490 2023-07-21T22:57:32.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.412+0000 7fbdc7511640 1 -- 172.21.15.6:0/1006134959 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc01636a0 con 0x7fbdc00b3490 2023-07-21T22:57:32.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.412+0000 7fbdc7511640 1 -- 172.21.15.6:0/1006134959 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc00678d0 con 0x7fbdc00b3490 2023-07-21T22:57:32.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.412+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/1006134959 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbdb8013c50 con 0x7fbdc00b3490 2023-07-21T22:57:32.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.412+0000 7fbdb5ffb640 1 --2- 172.21.15.6:0/1006134959 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fbda40663d0 0x7fbda4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.412+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/1006134959 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fbdb8083de0 con 0x7fbdc00b3490 2023-07-21T22:57:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.412+0000 7fbdc52ad640 1 --2- 172.21.15.6:0/1006134959 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fbda40663d0 0x7fbda4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.416+0000 7fbdc52ad640 1 --2- 172.21.15.6:0/1006134959 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fbda40663d0 0x7fbda4068880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0af000 tx=0x7fbdbc0046d0 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.416+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/1006134959 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbdb8051110 con 0x7fbdc00b3490 2023-07-21T22:57:32.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.572+0000 7fbdc7511640 1 -- 172.21.15.6:0/1006134959 --> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbdc0163d90 con 0x7fbda40663d0 2023-07-21T22:57:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.580+0000 7fbdb5ffb640 1 -- 172.21.15.6:0/1006134959 <== mgr.9760 v2:172.21.15.161:6832/406143921 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311668 (secure 0 0 0) 0x7fbdc0163d90 con 0x7fbda40663d0 2023-07-21T22:57:32.621 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:32.623 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:57:32.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.584+0000 7fbdc7511640 1 -- 172.21.15.6:0/1006134959 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fbda40663d0 msgr2=0x7fbda4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:32.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.584+0000 7fbdc7511640 1 --2- 172.21.15.6:0/1006134959 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fbda40663d0 0x7fbda4068880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0af000 tx=0x7fbdbc0046d0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.584+0000 7fbdc7511640 1 -- 172.21.15.6:0/1006134959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc00b3490 msgr2=0x7fbdc0162970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:32.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.584+0000 7fbdc7511640 1 --2- 172.21.15.6:0/1006134959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc00b3490 0x7fbdc0162970 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00b44a0 tx=0x7fbdb8007800 comp rx=0 tx=0).stop 2023-07-21T22:57:32.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.584+0000 7fbdc7511640 1 -- 172.21.15.6:0/1006134959 shutdown_connections 2023-07-21T22:57:32.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.584+0000 7fbdc7511640 1 --2- 172.21.15.6:0/1006134959 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fbda40663d0 0x7fbda4068880 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.584+0000 7fbdc7511640 1 --2- 172.21.15.6:0/1006134959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdc00b3490 0x7fbdc0162970 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.584+0000 7fbdc7511640 1 --2- 172.21.15.6:0/1006134959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdc01649e0 0x7fbdc00b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.584+0000 7fbdc7511640 1 --2- 172.21.15.6:0/1006134959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdac0039b0 0x7fbdc0151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.584+0000 7fbdc7511640 1 -- 172.21.15.6:0/1006134959 >> 172.21.15.6:0/1006134959 conn(0x7fbdc00650b0 msgr2=0x7fbdc00b2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:32.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.584+0000 7fbdc7511640 1 -- 172.21.15.6:0/1006134959 shutdown_connections 2023-07-21T22:57:32.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.584+0000 7fbdc7511640 1 -- 172.21.15.6:0/1006134959 wait complete. 2023-07-21T22:57:32.640 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-21T22:57:31.158084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":584,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":365,"ondisk_log_size":365,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":363400,"kb_used_data":19912,"kb_used_omap":0,"kb_used_meta":343424,"kb_avail":754611320,"statfs":{"total":773094113280,"available":772721991680,"internally_reserved":0,"allocated":20389888,"data_stored":11026428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":351666176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002104"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.762863+0000","last_change":"2023-07-21T22:57:23.293665+0000","last_active":"2023-07-21T22:57:24.762863+0000","last_peered":"2023-07-21T22:57:24.762863+0000","last_clean":"2023-07-21T22:57:24.762863+0000","last_became_active":"2023-07-21T22:57:23.293364+0000","last_became_peered":"2023-07-21T22:57:23.293364+0000","last_unstale":"2023-07-21T22:57:24.762863+0000","last_undegraded":"2023-07-21T22:57:24.762863+0000","last_fullsized":"2023-07-21T22:57:24.762863+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:13:06.274375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049659+0000","last_change":"2023-07-21T22:57:23.302116+0000","last_active":"2023-07-21T22:57:25.049659+0000","last_peered":"2023-07-21T22:57:25.049659+0000","last_clean":"2023-07-21T22:57:25.049659+0000","last_became_active":"2023-07-21T22:57:23.301819+0000","last_became_peered":"2023-07-21T22:57:23.301819+0000","last_unstale":"2023-07-21T22:57:25.049659+0000","last_undegraded":"2023-07-21T22:57:25.049659+0000","last_fullsized":"2023-07-21T22:57:25.049659+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:08:09.235568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.762730+0000","last_change":"2023-07-21T22:57:23.290722+0000","last_active":"2023-07-21T22:57:24.762730+0000","last_peered":"2023-07-21T22:57:24.762730+0000","last_clean":"2023-07-21T22:57:24.762730+0000","last_became_active":"2023-07-21T22:57:23.290442+0000","last_became_peered":"2023-07-21T22:57:23.290442+0000","last_unstale":"2023-07-21T22:57:24.762730+0000","last_undegraded":"2023-07-21T22:57:24.762730+0000","last_fullsized":"2023-07-21T22:57:24.762730+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:36:53.442644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.762734+0000","last_change":"2023-07-21T22:57:23.290093+0000","last_active":"2023-07-21T22:57:24.762734+0000","last_peered":"2023-07-21T22:57:24.762734+0000","last_clean":"2023-07-21T22:57:24.762734+0000","last_became_active":"2023-07-21T22:57:23.289787+0000","last_became_peered":"2023-07-21T22:57:23.289787+0000","last_unstale":"2023-07-21T22:57:24.762734+0000","last_undegraded":"2023-07-21T22:57:24.762734+0000","last_fullsized":"2023-07-21T22:57:24.762734+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:25:55.134664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276696+0000","last_change":"2023-07-21T22:57:23.297258+0000","last_active":"2023-07-21T22:57:24.276696+0000","last_peered":"2023-07-21T22:57:24.276696+0000","last_clean":"2023-07-21T22:57:24.276696+0000","last_became_active":"2023-07-21T22:57:23.296962+0000","last_became_peered":"2023-07-21T22:57:23.296962+0000","last_unstale":"2023-07-21T22:57:24.276696+0000","last_undegraded":"2023-07-21T22:57:24.276696+0000","last_fullsized":"2023-07-21T22:57:24.276696+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:33:29.368982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049019+0000","last_change":"2023-07-21T22:57:23.298699+0000","last_active":"2023-07-21T22:57:25.049019+0000","last_peered":"2023-07-21T22:57:25.049019+0000","last_clean":"2023-07-21T22:57:25.049019+0000","last_became_active":"2023-07-21T22:57:23.298391+0000","last_became_peered":"2023-07-21T22:57:23.298391+0000","last_unstale":"2023-07-21T22:57:25.049019+0000","last_undegraded":"2023-07-21T22:57:25.049019+0000","last_fullsized":"2023-07-21T22:57:25.049019+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:52:33.561779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274237+0000","last_change":"2023-07-21T22:57:23.286490+0000","last_active":"2023-07-21T22:57:24.274237+0000","last_peered":"2023-07-21T22:57:24.274237+0000","last_clean":"2023-07-21T22:57:24.274237+0000","last_became_active":"2023-07-21T22:57:23.286225+0000","last_became_peered":"2023-07-21T22:57:23.286225+0000","last_unstale":"2023-07-21T22:57:24.274237+0000","last_undegraded":"2023-07-21T22:57:24.274237+0000","last_fullsized":"2023-07-21T22:57:24.274237+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:03:44.289979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274115+0000","last_change":"2023-07-21T22:57:23.285418+0000","last_active":"2023-07-21T22:57:24.274115+0000","last_peered":"2023-07-21T22:57:24.274115+0000","last_clean":"2023-07-21T22:57:24.274115+0000","last_became_active":"2023-07-21T22:57:23.285159+0000","last_became_peered":"2023-07-21T22:57:23.285159+0000","last_unstale":"2023-07-21T22:57:24.274115+0000","last_undegraded":"2023-07-21T22:57:24.274115+0000","last_fullsized":"2023-07-21T22:57:24.274115+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:06:30.046205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274604+0000","last_change":"2023-07-21T22:57:23.288718+0000","last_active":"2023-07-21T22:57:24.274604+0000","last_peered":"2023-07-21T22:57:24.274604+0000","last_clean":"2023-07-21T22:57:24.274604+0000","last_became_active":"2023-07-21T22:57:23.288421+0000","last_became_peered":"2023-07-21T22:57:23.288421+0000","last_unstale":"2023-07-21T22:57:24.274604+0000","last_undegraded":"2023-07-21T22:57:24.274604+0000","last_fullsized":"2023-07-21T22:57:24.274604+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:44:35.654561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274648+0000","last_change":"2023-07-21T22:57:23.291029+0000","last_active":"2023-07-21T22:57:24.274648+0000","last_peered":"2023-07-21T22:57:24.274648+0000","last_clean":"2023-07-21T22:57:24.274648+0000","last_became_active":"2023-07-21T22:57:23.290757+0000","last_became_peered":"2023-07-21T22:57:23.290757+0000","last_unstale":"2023-07-21T22:57:24.274648+0000","last_undegraded":"2023-07-21T22:57:24.274648+0000","last_fullsized":"2023-07-21T22:57:24.274648+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:18:47.144339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283722+0000","last_change":"2023-07-21T22:57:23.297978+0000","last_active":"2023-07-21T22:57:24.283722+0000","last_peered":"2023-07-21T22:57:24.283722+0000","last_clean":"2023-07-21T22:57:24.283722+0000","last_became_active":"2023-07-21T22:57:23.297483+0000","last_became_peered":"2023-07-21T22:57:23.297483+0000","last_unstale":"2023-07-21T22:57:24.283722+0000","last_undegraded":"2023-07-21T22:57:24.283722+0000","last_fullsized":"2023-07-21T22:57:24.283722+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:48:20.595827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049394+0000","last_change":"2023-07-21T22:57:23.299916+0000","last_active":"2023-07-21T22:57:25.049394+0000","last_peered":"2023-07-21T22:57:25.049394+0000","last_clean":"2023-07-21T22:57:25.049394+0000","last_became_active":"2023-07-21T22:57:23.299632+0000","last_became_peered":"2023-07-21T22:57:23.299632+0000","last_unstale":"2023-07-21T22:57:25.049394+0000","last_undegraded":"2023-07-21T22:57:25.049394+0000","last_fullsized":"2023-07-21T22:57:25.049394+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:18:57.143809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043997+0000","last_change":"2023-07-21T22:57:23.291085+0000","last_active":"2023-07-21T22:57:25.043997+0000","last_peered":"2023-07-21T22:57:25.043997+0000","last_clean":"2023-07-21T22:57:25.043997+0000","last_became_active":"2023-07-21T22:57:23.290824+0000","last_became_peered":"2023-07-21T22:57:23.290824+0000","last_unstale":"2023-07-21T22:57:25.043997+0000","last_undegraded":"2023-07-21T22:57:25.043997+0000","last_fullsized":"2023-07-21T22:57:25.043997+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:26:00.575302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276545+0000","last_change":"2023-07-21T22:57:23.295360+0000","last_active":"2023-07-21T22:57:24.276545+0000","last_peered":"2023-07-21T22:57:24.276545+0000","last_clean":"2023-07-21T22:57:24.276545+0000","last_became_active":"2023-07-21T22:57:23.294879+0000","last_became_peered":"2023-07-21T22:57:23.294879+0000","last_unstale":"2023-07-21T22:57:24.276545+0000","last_undegraded":"2023-07-21T22:57:24.276545+0000","last_fullsized":"2023-07-21T22:57:24.276545+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:30:01.508373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283416+0000","last_change":"2023-07-21T22:57:23.289002+0000","last_active":"2023-07-21T22:57:24.283416+0000","last_peered":"2023-07-21T22:57:24.283416+0000","last_clean":"2023-07-21T22:57:24.283416+0000","last_became_active":"2023-07-21T22:57:23.288641+0000","last_became_peered":"2023-07-21T22:57:23.288641+0000","last_unstale":"2023-07-21T22:57:24.283416+0000","last_undegraded":"2023-07-21T22:57:24.283416+0000","last_fullsized":"2023-07-21T22:57:24.283416+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:13:46.546255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.762553+0000","last_change":"2023-07-21T22:57:23.290271+0000","last_active":"2023-07-21T22:57:24.762553+0000","last_peered":"2023-07-21T22:57:24.762553+0000","last_clean":"2023-07-21T22:57:24.762553+0000","last_became_active":"2023-07-21T22:57:23.289872+0000","last_became_peered":"2023-07-21T22:57:23.289872+0000","last_unstale":"2023-07-21T22:57:24.762553+0000","last_undegraded":"2023-07-21T22:57:24.762553+0000","last_fullsized":"2023-07-21T22:57:24.762553+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:07.185619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274655+0000","last_change":"2023-07-21T22:57:23.282814+0000","last_active":"2023-07-21T22:57:24.274655+0000","last_peered":"2023-07-21T22:57:24.274655+0000","last_clean":"2023-07-21T22:57:24.274655+0000","last_became_active":"2023-07-21T22:57:23.282535+0000","last_became_peered":"2023-07-21T22:57:23.282535+0000","last_unstale":"2023-07-21T22:57:24.274655+0000","last_undegraded":"2023-07-21T22:57:24.274655+0000","last_fullsized":"2023-07-21T22:57:24.274655+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:25:21.377134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049301+0000","last_change":"2023-07-21T22:57:23.301912+0000","last_active":"2023-07-21T22:57:25.049301+0000","last_peered":"2023-07-21T22:57:25.049301+0000","last_clean":"2023-07-21T22:57:25.049301+0000","last_became_active":"2023-07-21T22:57:23.301584+0000","last_became_peered":"2023-07-21T22:57:23.301584+0000","last_unstale":"2023-07-21T22:57:25.049301+0000","last_undegraded":"2023-07-21T22:57:25.049301+0000","last_fullsized":"2023-07-21T22:57:25.049301+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:19:17.319927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283908+0000","last_change":"2023-07-21T22:57:23.289229+0000","last_active":"2023-07-21T22:57:24.283908+0000","last_peered":"2023-07-21T22:57:24.283908+0000","last_clean":"2023-07-21T22:57:24.283908+0000","last_became_active":"2023-07-21T22:57:23.288879+0000","last_became_peered":"2023-07-21T22:57:23.288879+0000","last_unstale":"2023-07-21T22:57:24.283908+0000","last_undegraded":"2023-07-21T22:57:24.283908+0000","last_fullsized":"2023-07-21T22:57:24.283908+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:31:26.121012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043394+0000","last_change":"2023-07-21T22:57:23.291116+0000","last_active":"2023-07-21T22:57:25.043394+0000","last_peered":"2023-07-21T22:57:25.043394+0000","last_clean":"2023-07-21T22:57:25.043394+0000","last_became_active":"2023-07-21T22:57:23.290799+0000","last_became_peered":"2023-07-21T22:57:23.290799+0000","last_unstale":"2023-07-21T22:57:25.043394+0000","last_undegraded":"2023-07-21T22:57:25.043394+0000","last_fullsized":"2023-07-21T22:57:25.043394+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:06:14.095420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.044156+0000","last_change":"2023-07-21T22:57:23.277622+0000","last_active":"2023-07-21T22:57:25.044156+0000","last_peered":"2023-07-21T22:57:25.044156+0000","last_clean":"2023-07-21T22:57:25.044156+0000","last_became_active":"2023-07-21T22:57:23.277337+0000","last_became_peered":"2023-07-21T22:57:23.277337+0000","last_unstale":"2023-07-21T22:57:25.044156+0000","last_undegraded":"2023-07-21T22:57:25.044156+0000","last_fullsized":"2023-07-21T22:57:25.044156+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:44:21.402323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049160+0000","last_change":"2023-07-21T22:57:23.304116+0000","last_active":"2023-07-21T22:57:25.049160+0000","last_peered":"2023-07-21T22:57:25.049160+0000","last_clean":"2023-07-21T22:57:25.049160+0000","last_became_active":"2023-07-21T22:57:23.303760+0000","last_became_peered":"2023-07-21T22:57:23.303760+0000","last_unstale":"2023-07-21T22:57:25.049160+0000","last_undegraded":"2023-07-21T22:57:25.049160+0000","last_fullsized":"2023-07-21T22:57:25.049160+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:04:20.603123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276452+0000","last_change":"2023-07-21T22:57:23.298037+0000","last_active":"2023-07-21T22:57:24.276452+0000","last_peered":"2023-07-21T22:57:24.276452+0000","last_clean":"2023-07-21T22:57:24.276452+0000","last_became_active":"2023-07-21T22:57:23.297757+0000","last_became_peered":"2023-07-21T22:57:23.297757+0000","last_unstale":"2023-07-21T22:57:24.276452+0000","last_undegraded":"2023-07-21T22:57:24.276452+0000","last_fullsized":"2023-07-21T22:57:24.276452+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:21:32.264233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.762772+0000","last_change":"2023-07-21T22:57:23.287569+0000","last_active":"2023-07-21T22:57:24.762772+0000","last_peered":"2023-07-21T22:57:24.762772+0000","last_clean":"2023-07-21T22:57:24.762772+0000","last_became_active":"2023-07-21T22:57:23.287278+0000","last_became_peered":"2023-07-21T22:57:23.287278+0000","last_unstale":"2023-07-21T22:57:24.762772+0000","last_undegraded":"2023-07-21T22:57:24.762772+0000","last_fullsized":"2023-07-21T22:57:24.762772+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:38:24.347745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043974+0000","last_change":"2023-07-21T22:57:23.279747+0000","last_active":"2023-07-21T22:57:25.043974+0000","last_peered":"2023-07-21T22:57:25.043974+0000","last_clean":"2023-07-21T22:57:25.043974+0000","last_became_active":"2023-07-21T22:57:23.279469+0000","last_became_peered":"2023-07-21T22:57:23.279469+0000","last_unstale":"2023-07-21T22:57:25.043974+0000","last_undegraded":"2023-07-21T22:57:25.043974+0000","last_fullsized":"2023-07-21T22:57:25.043974+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:42:26.759246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043490+0000","last_change":"2023-07-21T22:57:23.285913+0000","last_active":"2023-07-21T22:57:25.043490+0000","last_peered":"2023-07-21T22:57:25.043490+0000","last_clean":"2023-07-21T22:57:25.043490+0000","last_became_active":"2023-07-21T22:57:23.285642+0000","last_became_peered":"2023-07-21T22:57:23.285642+0000","last_unstale":"2023-07-21T22:57:25.043490+0000","last_undegraded":"2023-07-21T22:57:25.043490+0000","last_fullsized":"2023-07-21T22:57:25.043490+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:29:26.675872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049113+0000","last_change":"2023-07-21T22:57:23.297503+0000","last_active":"2023-07-21T22:57:25.049113+0000","last_peered":"2023-07-21T22:57:25.049113+0000","last_clean":"2023-07-21T22:57:25.049113+0000","last_became_active":"2023-07-21T22:57:23.297172+0000","last_became_peered":"2023-07-21T22:57:23.297172+0000","last_unstale":"2023-07-21T22:57:25.049113+0000","last_undegraded":"2023-07-21T22:57:25.049113+0000","last_fullsized":"2023-07-21T22:57:25.049113+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:46:38.604846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043575+0000","last_change":"2023-07-21T22:57:23.284109+0000","last_active":"2023-07-21T22:57:25.043575+0000","last_peered":"2023-07-21T22:57:25.043575+0000","last_clean":"2023-07-21T22:57:25.043575+0000","last_became_active":"2023-07-21T22:57:23.283799+0000","last_became_peered":"2023-07-21T22:57:23.283799+0000","last_unstale":"2023-07-21T22:57:25.043575+0000","last_undegraded":"2023-07-21T22:57:25.043575+0000","last_fullsized":"2023-07-21T22:57:25.043575+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:16:41.470014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049237+0000","last_change":"2023-07-21T22:57:23.302475+0000","last_active":"2023-07-21T22:57:25.049237+0000","last_peered":"2023-07-21T22:57:25.049237+0000","last_clean":"2023-07-21T22:57:25.049237+0000","last_became_active":"2023-07-21T22:57:23.302166+0000","last_became_peered":"2023-07-21T22:57:23.302166+0000","last_unstale":"2023-07-21T22:57:25.049237+0000","last_undegraded":"2023-07-21T22:57:25.049237+0000","last_fullsized":"2023-07-21T22:57:25.049237+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:39:32.998573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049688+0000","last_change":"2023-07-21T22:57:23.304540+0000","last_active":"2023-07-21T22:57:25.049688+0000","last_peered":"2023-07-21T22:57:25.049688+0000","last_clean":"2023-07-21T22:57:25.049688+0000","last_became_active":"2023-07-21T22:57:23.304220+0000","last_became_peered":"2023-07-21T22:57:23.304220+0000","last_unstale":"2023-07-21T22:57:25.049688+0000","last_undegraded":"2023-07-21T22:57:25.049688+0000","last_fullsized":"2023-07-21T22:57:25.049688+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:30:24.074892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283913+0000","last_change":"2023-07-21T22:57:23.296146+0000","last_active":"2023-07-21T22:57:24.283913+0000","last_peered":"2023-07-21T22:57:24.283913+0000","last_clean":"2023-07-21T22:57:24.283913+0000","last_became_active":"2023-07-21T22:57:23.295858+0000","last_became_peered":"2023-07-21T22:57:23.295858+0000","last_unstale":"2023-07-21T22:57:24.283913+0000","last_undegraded":"2023-07-21T22:57:24.283913+0000","last_fullsized":"2023-07-21T22:57:24.283913+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:30:30.965688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049419+0000","last_change":"2023-07-21T22:57:23.300759+0000","last_active":"2023-07-21T22:57:25.049419+0000","last_peered":"2023-07-21T22:57:25.049419+0000","last_clean":"2023-07-21T22:57:25.049419+0000","last_became_active":"2023-07-21T22:57:23.300161+0000","last_became_peered":"2023-07-21T22:57:23.300161+0000","last_unstale":"2023-07-21T22:57:25.049419+0000","last_undegraded":"2023-07-21T22:57:25.049419+0000","last_fullsized":"2023-07-21T22:57:25.049419+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:52:49.843756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049068+0000","last_change":"2023-07-21T22:57:23.298562+0000","last_active":"2023-07-21T22:57:25.049068+0000","last_peered":"2023-07-21T22:57:25.049068+0000","last_clean":"2023-07-21T22:57:25.049068+0000","last_became_active":"2023-07-21T22:57:23.298229+0000","last_became_peered":"2023-07-21T22:57:23.298229+0000","last_unstale":"2023-07-21T22:57:25.049068+0000","last_undegraded":"2023-07-21T22:57:25.049068+0000","last_fullsized":"2023-07-21T22:57:25.049068+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:25:59.327580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"191'4","reported_seq":17,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.762947+0000","last_change":"2023-07-21T22:57:22.526058+0000","last_active":"2023-07-21T22:57:24.762947+0000","last_peered":"2023-07-21T22:57:24.762947+0000","last_clean":"2023-07-21T22:57:24.762947+0000","last_became_active":"2023-07-21T22:57:22.525745+0000","last_became_peered":"2023-07-21T22:57:22.525745+0000","last_unstale":"2023-07-21T22:57:24.762947+0000","last_undegraded":"2023-07-21T22:57:24.762947+0000","last_fullsized":"2023-07-21T22:57:24.762947+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:19:13.852883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043331+0000","last_change":"2023-07-21T22:57:23.289884+0000","last_active":"2023-07-21T22:57:25.043331+0000","last_peered":"2023-07-21T22:57:25.043331+0000","last_clean":"2023-07-21T22:57:25.043331+0000","last_became_active":"2023-07-21T22:57:23.289605+0000","last_became_peered":"2023-07-21T22:57:23.289605+0000","last_unstale":"2023-07-21T22:57:25.043331+0000","last_undegraded":"2023-07-21T22:57:25.043331+0000","last_fullsized":"2023-07-21T22:57:25.043331+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:07:10.453342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"191'1","reported_seq":14,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.277053+0000","last_change":"2023-07-21T22:57:22.513972+0000","last_active":"2023-07-21T22:57:24.277053+0000","last_peered":"2023-07-21T22:57:24.277053+0000","last_clean":"2023-07-21T22:57:24.277053+0000","last_became_active":"2023-07-21T22:57:22.513687+0000","last_became_peered":"2023-07-21T22:57:22.513687+0000","last_unstale":"2023-07-21T22:57:24.277053+0000","last_undegraded":"2023-07-21T22:57:24.277053+0000","last_fullsized":"2023-07-21T22:57:24.277053+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:09:21.771161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276553+0000","last_change":"2023-07-21T22:57:23.294918+0000","last_active":"2023-07-21T22:57:24.276553+0000","last_peered":"2023-07-21T22:57:24.276553+0000","last_clean":"2023-07-21T22:57:24.276553+0000","last_became_active":"2023-07-21T22:57:23.294506+0000","last_became_peered":"2023-07-21T22:57:23.294506+0000","last_unstale":"2023-07-21T22:57:24.276553+0000","last_undegraded":"2023-07-21T22:57:24.276553+0000","last_fullsized":"2023-07-21T22:57:24.276553+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:04:51.815709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"191'2","reported_seq":15,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283946+0000","last_change":"2023-07-21T22:57:22.520699+0000","last_active":"2023-07-21T22:57:24.283946+0000","last_peered":"2023-07-21T22:57:24.283946+0000","last_clean":"2023-07-21T22:57:24.283946+0000","last_became_active":"2023-07-21T22:57:22.520379+0000","last_became_peered":"2023-07-21T22:57:22.520379+0000","last_unstale":"2023-07-21T22:57:24.283946+0000","last_undegraded":"2023-07-21T22:57:24.283946+0000","last_fullsized":"2023-07-21T22:57:24.283946+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:44:03.288208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049356+0000","last_change":"2023-07-21T22:57:23.300859+0000","last_active":"2023-07-21T22:57:25.049356+0000","last_peered":"2023-07-21T22:57:25.049356+0000","last_clean":"2023-07-21T22:57:25.049356+0000","last_became_active":"2023-07-21T22:57:23.300539+0000","last_became_peered":"2023-07-21T22:57:23.300539+0000","last_unstale":"2023-07-21T22:57:25.049356+0000","last_undegraded":"2023-07-21T22:57:25.049356+0000","last_fullsized":"2023-07-21T22:57:25.049356+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:56:45.061742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"191'2","reported_seq":15,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043536+0000","last_change":"2023-07-21T22:57:22.512994+0000","last_active":"2023-07-21T22:57:25.043536+0000","last_peered":"2023-07-21T22:57:25.043536+0000","last_clean":"2023-07-21T22:57:25.043536+0000","last_became_active":"2023-07-21T22:57:22.512632+0000","last_became_peered":"2023-07-21T22:57:22.512632+0000","last_unstale":"2023-07-21T22:57:25.043536+0000","last_undegraded":"2023-07-21T22:57:25.043536+0000","last_fullsized":"2023-07-21T22:57:25.043536+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:07:55.377165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274879+0000","last_change":"2023-07-21T22:57:23.290282+0000","last_active":"2023-07-21T22:57:24.274879+0000","last_peered":"2023-07-21T22:57:24.274879+0000","last_clean":"2023-07-21T22:57:24.274879+0000","last_became_active":"2023-07-21T22:57:23.290005+0000","last_became_peered":"2023-07-21T22:57:23.290005+0000","last_unstale":"2023-07-21T22:57:24.274879+0000","last_undegraded":"2023-07-21T22:57:24.274879+0000","last_fullsized":"2023-07-21T22:57:24.274879+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:15:25.820622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"191'1","reported_seq":14,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274737+0000","last_change":"2023-07-21T22:57:22.520897+0000","last_active":"2023-07-21T22:57:24.274737+0000","last_peered":"2023-07-21T22:57:24.274737+0000","last_clean":"2023-07-21T22:57:24.274737+0000","last_became_active":"2023-07-21T22:57:22.520541+0000","last_became_peered":"2023-07-21T22:57:22.520541+0000","last_unstale":"2023-07-21T22:57:24.274737+0000","last_undegraded":"2023-07-21T22:57:24.274737+0000","last_fullsized":"2023-07-21T22:57:24.274737+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:23:02.735650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043655+0000","last_change":"2023-07-21T22:57:23.280903+0000","last_active":"2023-07-21T22:57:25.043655+0000","last_peered":"2023-07-21T22:57:25.043655+0000","last_clean":"2023-07-21T22:57:25.043655+0000","last_became_active":"2023-07-21T22:57:23.280443+0000","last_became_peered":"2023-07-21T22:57:23.280443+0000","last_unstale":"2023-07-21T22:57:25.043655+0000","last_undegraded":"2023-07-21T22:57:25.043655+0000","last_fullsized":"2023-07-21T22:57:25.043655+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:08:09.358036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"191'1","reported_seq":14,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276695+0000","last_change":"2023-07-21T22:57:22.516123+0000","last_active":"2023-07-21T22:57:24.276695+0000","last_peered":"2023-07-21T22:57:24.276695+0000","last_clean":"2023-07-21T22:57:24.276695+0000","last_became_active":"2023-07-21T22:57:22.515462+0000","last_became_peered":"2023-07-21T22:57:22.515462+0000","last_unstale":"2023-07-21T22:57:24.276695+0000","last_undegraded":"2023-07-21T22:57:24.276695+0000","last_fullsized":"2023-07-21T22:57:24.276695+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:24:31.127317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043564+0000","last_change":"2023-07-21T22:57:23.289901+0000","last_active":"2023-07-21T22:57:25.043564+0000","last_peered":"2023-07-21T22:57:25.043564+0000","last_clean":"2023-07-21T22:57:25.043564+0000","last_became_active":"2023-07-21T22:57:23.289557+0000","last_became_peered":"2023-07-21T22:57:23.289557+0000","last_unstale":"2023-07-21T22:57:25.043564+0000","last_undegraded":"2023-07-21T22:57:25.043564+0000","last_fullsized":"2023-07-21T22:57:25.043564+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:45:58.542670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043077+0000","last_change":"2023-07-21T22:57:22.516916+0000","last_active":"2023-07-21T22:57:25.043077+0000","last_peered":"2023-07-21T22:57:25.043077+0000","last_clean":"2023-07-21T22:57:25.043077+0000","last_became_active":"2023-07-21T22:57:22.516644+0000","last_became_peered":"2023-07-21T22:57:22.516644+0000","last_unstale":"2023-07-21T22:57:25.043077+0000","last_undegraded":"2023-07-21T22:57:25.043077+0000","last_fullsized":"2023-07-21T22:57:25.043077+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:34:56.913278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.762830+0000","last_change":"2023-07-21T22:57:23.286202+0000","last_active":"2023-07-21T22:57:24.762830+0000","last_peered":"2023-07-21T22:57:24.762830+0000","last_clean":"2023-07-21T22:57:24.762830+0000","last_became_active":"2023-07-21T22:57:23.285914+0000","last_became_peered":"2023-07-21T22:57:23.285914+0000","last_unstale":"2023-07-21T22:57:24.762830+0000","last_undegraded":"2023-07-21T22:57:24.762830+0000","last_fullsized":"2023-07-21T22:57:24.762830+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:37:15.087735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274405+0000","last_change":"2023-07-21T22:57:22.509620+0000","last_active":"2023-07-21T22:57:24.274405+0000","last_peered":"2023-07-21T22:57:24.274405+0000","last_clean":"2023-07-21T22:57:24.274405+0000","last_became_active":"2023-07-21T22:57:22.509333+0000","last_became_peered":"2023-07-21T22:57:22.509333+0000","last_unstale":"2023-07-21T22:57:24.274405+0000","last_undegraded":"2023-07-21T22:57:24.274405+0000","last_fullsized":"2023-07-21T22:57:24.274405+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:18:52.308959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274130+0000","last_change":"2023-07-21T22:57:23.283678+0000","last_active":"2023-07-21T22:57:24.274130+0000","last_peered":"2023-07-21T22:57:24.274130+0000","last_clean":"2023-07-21T22:57:24.274130+0000","last_became_active":"2023-07-21T22:57:23.283224+0000","last_became_peered":"2023-07-21T22:57:23.283224+0000","last_unstale":"2023-07-21T22:57:24.274130+0000","last_undegraded":"2023-07-21T22:57:24.274130+0000","last_fullsized":"2023-07-21T22:57:24.274130+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:10:35.355157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"191'1","reported_seq":14,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.044026+0000","last_change":"2023-07-21T22:57:22.515998+0000","last_active":"2023-07-21T22:57:25.044026+0000","last_peered":"2023-07-21T22:57:25.044026+0000","last_clean":"2023-07-21T22:57:25.044026+0000","last_became_active":"2023-07-21T22:57:22.514997+0000","last_became_peered":"2023-07-21T22:57:22.514997+0000","last_unstale":"2023-07-21T22:57:25.044026+0000","last_undegraded":"2023-07-21T22:57:25.044026+0000","last_fullsized":"2023-07-21T22:57:25.044026+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:09:38.402098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049882+0000","last_change":"2023-07-21T22:57:23.303049+0000","last_active":"2023-07-21T22:57:25.049882+0000","last_peered":"2023-07-21T22:57:25.049882+0000","last_clean":"2023-07-21T22:57:25.049882+0000","last_became_active":"2023-07-21T22:57:23.302199+0000","last_became_peered":"2023-07-21T22:57:23.302199+0000","last_unstale":"2023-07-21T22:57:25.049882+0000","last_undegraded":"2023-07-21T22:57:25.049882+0000","last_fullsized":"2023-07-21T22:57:25.049882+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:18:26.512893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"191'2","reported_seq":15,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274761+0000","last_change":"2023-07-21T22:57:22.516566+0000","last_active":"2023-07-21T22:57:24.274761+0000","last_peered":"2023-07-21T22:57:24.274761+0000","last_clean":"2023-07-21T22:57:24.274761+0000","last_became_active":"2023-07-21T22:57:22.516280+0000","last_became_peered":"2023-07-21T22:57:22.516280+0000","last_unstale":"2023-07-21T22:57:24.274761+0000","last_undegraded":"2023-07-21T22:57:24.274761+0000","last_fullsized":"2023-07-21T22:57:24.274761+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:15:43.158201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283532+0000","last_change":"2023-07-21T22:57:23.290701+0000","last_active":"2023-07-21T22:57:24.283532+0000","last_peered":"2023-07-21T22:57:24.283532+0000","last_clean":"2023-07-21T22:57:24.283532+0000","last_became_active":"2023-07-21T22:57:23.290401+0000","last_became_peered":"2023-07-21T22:57:23.290401+0000","last_unstale":"2023-07-21T22:57:24.283532+0000","last_undegraded":"2023-07-21T22:57:24.283532+0000","last_fullsized":"2023-07-21T22:57:24.283532+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:42:49.704049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"191'1","reported_seq":14,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276902+0000","last_change":"2023-07-21T22:57:22.516536+0000","last_active":"2023-07-21T22:57:24.276902+0000","last_peered":"2023-07-21T22:57:24.276902+0000","last_clean":"2023-07-21T22:57:24.276902+0000","last_became_active":"2023-07-21T22:57:22.516241+0000","last_became_peered":"2023-07-21T22:57:22.516241+0000","last_unstale":"2023-07-21T22:57:24.276902+0000","last_undegraded":"2023-07-21T22:57:24.276902+0000","last_fullsized":"2023-07-21T22:57:24.276902+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:39.652403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283599+0000","last_change":"2023-07-21T22:57:23.301064+0000","last_active":"2023-07-21T22:57:24.283599+0000","last_peered":"2023-07-21T22:57:24.283599+0000","last_clean":"2023-07-21T22:57:24.283599+0000","last_became_active":"2023-07-21T22:57:23.300764+0000","last_became_peered":"2023-07-21T22:57:23.300764+0000","last_unstale":"2023-07-21T22:57:24.283599+0000","last_undegraded":"2023-07-21T22:57:24.283599+0000","last_fullsized":"2023-07-21T22:57:24.283599+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:21:52.895592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274457+0000","last_change":"2023-07-21T22:57:22.511600+0000","last_active":"2023-07-21T22:57:24.274457+0000","last_peered":"2023-07-21T22:57:24.274457+0000","last_clean":"2023-07-21T22:57:24.274457+0000","last_became_active":"2023-07-21T22:57:22.511263+0000","last_became_peered":"2023-07-21T22:57:22.511263+0000","last_unstale":"2023-07-21T22:57:24.274457+0000","last_undegraded":"2023-07-21T22:57:24.274457+0000","last_fullsized":"2023-07-21T22:57:24.274457+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:46:10.402928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043730+0000","last_change":"2023-07-21T22:57:23.281262+0000","last_active":"2023-07-21T22:57:25.043730+0000","last_peered":"2023-07-21T22:57:25.043730+0000","last_clean":"2023-07-21T22:57:25.043730+0000","last_became_active":"2023-07-21T22:57:23.280989+0000","last_became_peered":"2023-07-21T22:57:23.280989+0000","last_unstale":"2023-07-21T22:57:25.043730+0000","last_undegraded":"2023-07-21T22:57:25.043730+0000","last_fullsized":"2023-07-21T22:57:25.043730+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:49:43.067775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"191'2","reported_seq":15,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276850+0000","last_change":"2023-07-21T22:57:22.513380+0000","last_active":"2023-07-21T22:57:24.276850+0000","last_peered":"2023-07-21T22:57:24.276850+0000","last_clean":"2023-07-21T22:57:24.276850+0000","last_became_active":"2023-07-21T22:57:22.512923+0000","last_became_peered":"2023-07-21T22:57:22.512923+0000","last_unstale":"2023-07-21T22:57:24.276850+0000","last_undegraded":"2023-07-21T22:57:24.276850+0000","last_fullsized":"2023-07-21T22:57:24.276850+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:41:50.730708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276840+0000","last_change":"2023-07-21T22:57:23.294179+0000","last_active":"2023-07-21T22:57:24.276840+0000","last_peered":"2023-07-21T22:57:24.276840+0000","last_clean":"2023-07-21T22:57:24.276840+0000","last_became_active":"2023-07-21T22:57:23.293839+0000","last_became_peered":"2023-07-21T22:57:23.293839+0000","last_unstale":"2023-07-21T22:57:24.276840+0000","last_undegraded":"2023-07-21T22:57:24.276840+0000","last_fullsized":"2023-07-21T22:57:24.276840+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:56:50.990762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283588+0000","last_change":"2023-07-21T22:57:22.521562+0000","last_active":"2023-07-21T22:57:24.283588+0000","last_peered":"2023-07-21T22:57:24.283588+0000","last_clean":"2023-07-21T22:57:24.283588+0000","last_became_active":"2023-07-21T22:57:22.521270+0000","last_became_peered":"2023-07-21T22:57:22.521270+0000","last_unstale":"2023-07-21T22:57:24.283588+0000","last_undegraded":"2023-07-21T22:57:24.283588+0000","last_fullsized":"2023-07-21T22:57:24.283588+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:12:16.779781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276957+0000","last_change":"2023-07-21T22:57:23.296653+0000","last_active":"2023-07-21T22:57:24.276957+0000","last_peered":"2023-07-21T22:57:24.276957+0000","last_clean":"2023-07-21T22:57:24.276957+0000","last_became_active":"2023-07-21T22:57:23.295362+0000","last_became_peered":"2023-07-21T22:57:23.295362+0000","last_unstale":"2023-07-21T22:57:24.276957+0000","last_undegraded":"2023-07-21T22:57:24.276957+0000","last_fullsized":"2023-07-21T22:57:24.276957+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:29:54.855842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043229+0000","last_change":"2023-07-21T22:57:22.512259+0000","last_active":"2023-07-21T22:57:25.043229+0000","last_peered":"2023-07-21T22:57:25.043229+0000","last_clean":"2023-07-21T22:57:25.043229+0000","last_became_active":"2023-07-21T22:57:22.511911+0000","last_became_peered":"2023-07-21T22:57:22.511911+0000","last_unstale":"2023-07-21T22:57:25.043229+0000","last_undegraded":"2023-07-21T22:57:25.043229+0000","last_fullsized":"2023-07-21T22:57:25.043229+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:08:42.866657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049803+0000","last_change":"2023-07-21T22:57:23.301223+0000","last_active":"2023-07-21T22:57:25.049803+0000","last_peered":"2023-07-21T22:57:25.049803+0000","last_clean":"2023-07-21T22:57:25.049803+0000","last_became_active":"2023-07-21T22:57:23.300305+0000","last_became_peered":"2023-07-21T22:57:23.300305+0000","last_unstale":"2023-07-21T22:57:25.049803+0000","last_undegraded":"2023-07-21T22:57:25.049803+0000","last_fullsized":"2023-07-21T22:57:25.049803+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:38:22.993699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049570+0000","last_change":"2023-07-21T22:57:22.514061+0000","last_active":"2023-07-21T22:57:25.049570+0000","last_peered":"2023-07-21T22:57:25.049570+0000","last_clean":"2023-07-21T22:57:25.049570+0000","last_became_active":"2023-07-21T22:57:22.513784+0000","last_became_peered":"2023-07-21T22:57:22.513784+0000","last_unstale":"2023-07-21T22:57:25.049570+0000","last_undegraded":"2023-07-21T22:57:25.049570+0000","last_fullsized":"2023-07-21T22:57:25.049570+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:54:01.639581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283407+0000","last_change":"2023-07-21T22:57:23.296270+0000","last_active":"2023-07-21T22:57:24.283407+0000","last_peered":"2023-07-21T22:57:24.283407+0000","last_clean":"2023-07-21T22:57:24.283407+0000","last_became_active":"2023-07-21T22:57:23.295980+0000","last_became_peered":"2023-07-21T22:57:23.295980+0000","last_unstale":"2023-07-21T22:57:24.283407+0000","last_undegraded":"2023-07-21T22:57:24.283407+0000","last_fullsized":"2023-07-21T22:57:24.283407+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:56:12.366679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"191'2","reported_seq":15,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.277008+0000","last_change":"2023-07-21T22:57:22.516848+0000","last_active":"2023-07-21T22:57:24.277008+0000","last_peered":"2023-07-21T22:57:24.277008+0000","last_clean":"2023-07-21T22:57:24.277008+0000","last_became_active":"2023-07-21T22:57:22.516566+0000","last_became_peered":"2023-07-21T22:57:22.516566+0000","last_unstale":"2023-07-21T22:57:24.277008+0000","last_undegraded":"2023-07-21T22:57:24.277008+0000","last_fullsized":"2023-07-21T22:57:24.277008+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:54:53.846788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274309+0000","last_change":"2023-07-21T22:57:23.287773+0000","last_active":"2023-07-21T22:57:24.274309+0000","last_peered":"2023-07-21T22:57:24.274309+0000","last_clean":"2023-07-21T22:57:24.274309+0000","last_became_active":"2023-07-21T22:57:23.287491+0000","last_became_peered":"2023-07-21T22:57:23.287491+0000","last_unstale":"2023-07-21T22:57:24.274309+0000","last_undegraded":"2023-07-21T22:57:24.274309+0000","last_fullsized":"2023-07-21T22:57:24.274309+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:18:33.574176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"192'1","reported_seq":14,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.044098+0000","last_change":"2023-07-21T22:57:22.522644+0000","last_active":"2023-07-21T22:57:25.044098+0000","last_peered":"2023-07-21T22:57:25.044098+0000","last_clean":"2023-07-21T22:57:25.044098+0000","last_became_active":"2023-07-21T22:57:22.522294+0000","last_became_peered":"2023-07-21T22:57:22.522294+0000","last_unstale":"2023-07-21T22:57:25.044098+0000","last_undegraded":"2023-07-21T22:57:25.044098+0000","last_fullsized":"2023-07-21T22:57:25.044098+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:53:47.689625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043382+0000","last_change":"2023-07-21T22:57:23.287670+0000","last_active":"2023-07-21T22:57:25.043382+0000","last_peered":"2023-07-21T22:57:25.043382+0000","last_clean":"2023-07-21T22:57:25.043382+0000","last_became_active":"2023-07-21T22:57:23.287351+0000","last_became_peered":"2023-07-21T22:57:23.287351+0000","last_unstale":"2023-07-21T22:57:25.043382+0000","last_undegraded":"2023-07-21T22:57:25.043382+0000","last_fullsized":"2023-07-21T22:57:25.043382+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:59:29.872650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043898+0000","last_change":"2023-07-21T22:57:22.518224+0000","last_active":"2023-07-21T22:57:25.043898+0000","last_peered":"2023-07-21T22:57:25.043898+0000","last_clean":"2023-07-21T22:57:25.043898+0000","last_became_active":"2023-07-21T22:57:22.517933+0000","last_became_peered":"2023-07-21T22:57:22.517933+0000","last_unstale":"2023-07-21T22:57:25.043898+0000","last_undegraded":"2023-07-21T22:57:25.043898+0000","last_fullsized":"2023-07-21T22:57:25.043898+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:18:29.879949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274599+0000","last_change":"2023-07-21T22:57:23.283995+0000","last_active":"2023-07-21T22:57:24.274599+0000","last_peered":"2023-07-21T22:57:24.274599+0000","last_clean":"2023-07-21T22:57:24.274599+0000","last_became_active":"2023-07-21T22:57:23.283745+0000","last_became_peered":"2023-07-21T22:57:23.283745+0000","last_unstale":"2023-07-21T22:57:24.274599+0000","last_undegraded":"2023-07-21T22:57:24.274599+0000","last_fullsized":"2023-07-21T22:57:24.274599+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:42:58.635822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043661+0000","last_change":"2023-07-21T22:57:22.512688+0000","last_active":"2023-07-21T22:57:25.043661+0000","last_peered":"2023-07-21T22:57:25.043661+0000","last_clean":"2023-07-21T22:57:25.043661+0000","last_became_active":"2023-07-21T22:57:22.512404+0000","last_became_peered":"2023-07-21T22:57:22.512404+0000","last_unstale":"2023-07-21T22:57:25.043661+0000","last_undegraded":"2023-07-21T22:57:25.043661+0000","last_fullsized":"2023-07-21T22:57:25.043661+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:34:13.179318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.762857+0000","last_change":"2023-07-21T22:57:23.297547+0000","last_active":"2023-07-21T22:57:24.762857+0000","last_peered":"2023-07-21T22:57:24.762857+0000","last_clean":"2023-07-21T22:57:24.762857+0000","last_became_active":"2023-07-21T22:57:23.297182+0000","last_became_peered":"2023-07-21T22:57:23.297182+0000","last_unstale":"2023-07-21T22:57:24.762857+0000","last_undegraded":"2023-07-21T22:57:24.762857+0000","last_fullsized":"2023-07-21T22:57:24.762857+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:42:11.053450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.762621+0000","last_change":"2023-07-21T22:57:22.523033+0000","last_active":"2023-07-21T22:57:24.762621+0000","last_peered":"2023-07-21T22:57:24.762621+0000","last_clean":"2023-07-21T22:57:24.762621+0000","last_became_active":"2023-07-21T22:57:22.522687+0000","last_became_peered":"2023-07-21T22:57:22.522687+0000","last_unstale":"2023-07-21T22:57:24.762621+0000","last_undegraded":"2023-07-21T22:57:24.762621+0000","last_fullsized":"2023-07-21T22:57:24.762621+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:14:21.451780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049273+0000","last_change":"2023-07-21T22:57:23.301139+0000","last_active":"2023-07-21T22:57:25.049273+0000","last_peered":"2023-07-21T22:57:25.049273+0000","last_clean":"2023-07-21T22:57:25.049273+0000","last_became_active":"2023-07-21T22:57:23.300812+0000","last_became_peered":"2023-07-21T22:57:23.300812+0000","last_unstale":"2023-07-21T22:57:25.049273+0000","last_undegraded":"2023-07-21T22:57:25.049273+0000","last_fullsized":"2023-07-21T22:57:25.049273+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:20:15.024184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043710+0000","last_change":"2023-07-21T22:57:22.520034+0000","last_active":"2023-07-21T22:57:25.043710+0000","last_peered":"2023-07-21T22:57:25.043710+0000","last_clean":"2023-07-21T22:57:25.043710+0000","last_became_active":"2023-07-21T22:57:22.518945+0000","last_became_peered":"2023-07-21T22:57:22.518945+0000","last_unstale":"2023-07-21T22:57:25.043710+0000","last_undegraded":"2023-07-21T22:57:25.043710+0000","last_fullsized":"2023-07-21T22:57:25.043710+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:06:00.968100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043935+0000","last_change":"2023-07-21T22:57:23.279904+0000","last_active":"2023-07-21T22:57:25.043935+0000","last_peered":"2023-07-21T22:57:25.043935+0000","last_clean":"2023-07-21T22:57:25.043935+0000","last_became_active":"2023-07-21T22:57:23.279594+0000","last_became_peered":"2023-07-21T22:57:23.279594+0000","last_unstale":"2023-07-21T22:57:25.043935+0000","last_undegraded":"2023-07-21T22:57:25.043935+0000","last_fullsized":"2023-07-21T22:57:25.043935+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:42:43.038728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.284060+0000","last_change":"2023-07-21T22:57:22.519089+0000","last_active":"2023-07-21T22:57:24.284060+0000","last_peered":"2023-07-21T22:57:24.284060+0000","last_clean":"2023-07-21T22:57:24.284060+0000","last_became_active":"2023-07-21T22:57:22.518879+0000","last_became_peered":"2023-07-21T22:57:22.518879+0000","last_unstale":"2023-07-21T22:57:24.284060+0000","last_undegraded":"2023-07-21T22:57:24.284060+0000","last_fullsized":"2023-07-21T22:57:24.284060+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:52:06.987576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.044241+0000","last_change":"2023-07-21T22:57:23.295376+0000","last_active":"2023-07-21T22:57:25.044241+0000","last_peered":"2023-07-21T22:57:25.044241+0000","last_clean":"2023-07-21T22:57:25.044241+0000","last_became_active":"2023-07-21T22:57:23.295103+0000","last_became_peered":"2023-07-21T22:57:23.295103+0000","last_unstale":"2023-07-21T22:57:25.044241+0000","last_undegraded":"2023-07-21T22:57:25.044241+0000","last_fullsized":"2023-07-21T22:57:25.044241+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:00:22.349624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276385+0000","last_change":"2023-07-21T22:57:22.513969+0000","last_active":"2023-07-21T22:57:24.276385+0000","last_peered":"2023-07-21T22:57:24.276385+0000","last_clean":"2023-07-21T22:57:24.276385+0000","last_became_active":"2023-07-21T22:57:22.513667+0000","last_became_peered":"2023-07-21T22:57:22.513667+0000","last_unstale":"2023-07-21T22:57:24.276385+0000","last_undegraded":"2023-07-21T22:57:24.276385+0000","last_fullsized":"2023-07-21T22:57:24.276385+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:05:49.216445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.048979+0000","last_change":"2023-07-21T22:57:23.297140+0000","last_active":"2023-07-21T22:57:25.048979+0000","last_peered":"2023-07-21T22:57:25.048979+0000","last_clean":"2023-07-21T22:57:25.048979+0000","last_became_active":"2023-07-21T22:57:23.296866+0000","last_became_peered":"2023-07-21T22:57:23.296866+0000","last_unstale":"2023-07-21T22:57:25.048979+0000","last_undegraded":"2023-07-21T22:57:25.048979+0000","last_fullsized":"2023-07-21T22:57:25.048979+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:31:16.592400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043996+0000","last_change":"2023-07-21T22:57:22.522623+0000","last_active":"2023-07-21T22:57:25.043996+0000","last_peered":"2023-07-21T22:57:25.043996+0000","last_clean":"2023-07-21T22:57:25.043996+0000","last_became_active":"2023-07-21T22:57:22.522369+0000","last_became_peered":"2023-07-21T22:57:22.522369+0000","last_unstale":"2023-07-21T22:57:25.043996+0000","last_undegraded":"2023-07-21T22:57:25.043996+0000","last_fullsized":"2023-07-21T22:57:25.043996+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:44:16.439024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"180'326","reported_seq":1215,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049938+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:57:25.049938+0000","last_peered":"2023-07-21T22:57:25.049938+0000","last_clean":"2023-07-21T22:57:25.049938+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:57:25.049938+0000","last_undegraded":"2023-07-21T22:57:25.049938+0000","last_fullsized":"2023-07-21T22:57:25.049938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:10:17.675431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":357,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283700+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:57:24.283700+0000","last_peered":"2023-07-21T22:57:24.283700+0000","last_clean":"2023-07-21T22:57:24.283700+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:57:24.283700+0000","last_undegraded":"2023-07-21T22:57:24.283700+0000","last_fullsized":"2023-07-21T22:57:24.283700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:36:06.616209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043477+0000","last_change":"2023-07-21T22:57:23.282189+0000","last_active":"2023-07-21T22:57:25.043477+0000","last_peered":"2023-07-21T22:57:25.043477+0000","last_clean":"2023-07-21T22:57:25.043477+0000","last_became_active":"2023-07-21T22:57:23.281885+0000","last_became_peered":"2023-07-21T22:57:23.281885+0000","last_unstale":"2023-07-21T22:57:25.043477+0000","last_undegraded":"2023-07-21T22:57:25.043477+0000","last_fullsized":"2023-07-21T22:57:25.043477+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:26:25.882428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"191'3","reported_seq":16,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.762831+0000","last_change":"2023-07-21T22:57:22.511800+0000","last_active":"2023-07-21T22:57:24.762831+0000","last_peered":"2023-07-21T22:57:24.762831+0000","last_clean":"2023-07-21T22:57:24.762831+0000","last_became_active":"2023-07-21T22:57:22.511372+0000","last_became_peered":"2023-07-21T22:57:22.511372+0000","last_unstale":"2023-07-21T22:57:24.762831+0000","last_undegraded":"2023-07-21T22:57:24.762831+0000","last_fullsized":"2023-07-21T22:57:24.762831+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:20:13.197466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":318,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049762+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:57:25.049762+0000","last_peered":"2023-07-21T22:57:25.049762+0000","last_clean":"2023-07-21T22:57:25.049762+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:57:25.049762+0000","last_undegraded":"2023-07-21T22:57:25.049762+0000","last_fullsized":"2023-07-21T22:57:25.049762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:26:26.668909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043896+0000","last_change":"2023-07-21T22:57:23.298779+0000","last_active":"2023-07-21T22:57:25.043896+0000","last_peered":"2023-07-21T22:57:25.043896+0000","last_clean":"2023-07-21T22:57:25.043896+0000","last_became_active":"2023-07-21T22:57:23.298449+0000","last_became_peered":"2023-07-21T22:57:23.298449+0000","last_unstale":"2023-07-21T22:57:25.043896+0000","last_undegraded":"2023-07-21T22:57:25.043896+0000","last_fullsized":"2023-07-21T22:57:25.043896+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:21:27.069642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"191'6","reported_seq":19,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043868+0000","last_change":"2023-07-21T22:57:22.515084+0000","last_active":"2023-07-21T22:57:25.043868+0000","last_peered":"2023-07-21T22:57:25.043868+0000","last_clean":"2023-07-21T22:57:25.043868+0000","last_became_active":"2023-07-21T22:57:22.514810+0000","last_became_peered":"2023-07-21T22:57:22.514810+0000","last_unstale":"2023-07-21T22:57:25.043868+0000","last_undegraded":"2023-07-21T22:57:25.043868+0000","last_fullsized":"2023-07-21T22:57:25.043868+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:22:21.229244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":321,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043326+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:57:25.043326+0000","last_peered":"2023-07-21T22:57:25.043326+0000","last_clean":"2023-07-21T22:57:25.043326+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:57:25.043326+0000","last_undegraded":"2023-07-21T22:57:25.043326+0000","last_fullsized":"2023-07-21T22:57:25.043326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:08:52.925868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049916+0000","last_change":"2023-07-21T22:57:23.301000+0000","last_active":"2023-07-21T22:57:25.049916+0000","last_peered":"2023-07-21T22:57:25.049916+0000","last_clean":"2023-07-21T22:57:25.049916+0000","last_became_active":"2023-07-21T22:57:23.300660+0000","last_became_peered":"2023-07-21T22:57:23.300660+0000","last_unstale":"2023-07-21T22:57:25.049916+0000","last_undegraded":"2023-07-21T22:57:25.049916+0000","last_fullsized":"2023-07-21T22:57:25.049916+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:43:12.491919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043820+0000","last_change":"2023-07-21T22:57:22.516060+0000","last_active":"2023-07-21T22:57:25.043820+0000","last_peered":"2023-07-21T22:57:25.043820+0000","last_clean":"2023-07-21T22:57:25.043820+0000","last_became_active":"2023-07-21T22:57:22.515686+0000","last_became_peered":"2023-07-21T22:57:22.515686+0000","last_unstale":"2023-07-21T22:57:25.043820+0000","last_undegraded":"2023-07-21T22:57:25.043820+0000","last_fullsized":"2023-07-21T22:57:25.043820+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:23:40.846280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":357,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.284020+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:57:24.284020+0000","last_peered":"2023-07-21T22:57:24.284020+0000","last_clean":"2023-07-21T22:57:24.284020+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:57:24.284020+0000","last_undegraded":"2023-07-21T22:57:24.284020+0000","last_fullsized":"2023-07-21T22:57:24.284020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:13:23.560357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283813+0000","last_change":"2023-07-21T22:57:23.295787+0000","last_active":"2023-07-21T22:57:24.283813+0000","last_peered":"2023-07-21T22:57:24.283813+0000","last_clean":"2023-07-21T22:57:24.283813+0000","last_became_active":"2023-07-21T22:57:23.295510+0000","last_became_peered":"2023-07-21T22:57:23.295510+0000","last_unstale":"2023-07-21T22:57:24.283813+0000","last_undegraded":"2023-07-21T22:57:24.283813+0000","last_fullsized":"2023-07-21T22:57:24.283813+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:10:55.956717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.283864+0000","last_change":"2023-07-21T22:57:22.518008+0000","last_active":"2023-07-21T22:57:24.283864+0000","last_peered":"2023-07-21T22:57:24.283864+0000","last_clean":"2023-07-21T22:57:24.283864+0000","last_became_active":"2023-07-21T22:57:22.517728+0000","last_became_peered":"2023-07-21T22:57:22.517728+0000","last_unstale":"2023-07-21T22:57:24.283864+0000","last_undegraded":"2023-07-21T22:57:24.283864+0000","last_fullsized":"2023-07-21T22:57:24.283864+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:00:38.119286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":335,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274652+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:57:24.274652+0000","last_peered":"2023-07-21T22:57:24.274652+0000","last_clean":"2023-07-21T22:57:24.274652+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:57:24.274652+0000","last_undegraded":"2023-07-21T22:57:24.274652+0000","last_fullsized":"2023-07-21T22:57:24.274652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:27:54.418745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.044216+0000","last_change":"2023-07-21T22:57:23.285757+0000","last_active":"2023-07-21T22:57:25.044216+0000","last_peered":"2023-07-21T22:57:25.044216+0000","last_clean":"2023-07-21T22:57:25.044216+0000","last_became_active":"2023-07-21T22:57:23.285489+0000","last_became_peered":"2023-07-21T22:57:23.285489+0000","last_unstale":"2023-07-21T22:57:25.044216+0000","last_undegraded":"2023-07-21T22:57:25.044216+0000","last_fullsized":"2023-07-21T22:57:25.044216+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:56:24.067028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"191'8","reported_seq":21,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274270+0000","last_change":"2023-07-21T22:57:22.505531+0000","last_active":"2023-07-21T22:57:24.274270+0000","last_peered":"2023-07-21T22:57:24.274270+0000","last_clean":"2023-07-21T22:57:24.274270+0000","last_became_active":"2023-07-21T22:57:22.505255+0000","last_became_peered":"2023-07-21T22:57:22.505255+0000","last_unstale":"2023-07-21T22:57:24.274270+0000","last_undegraded":"2023-07-21T22:57:24.274270+0000","last_fullsized":"2023-07-21T22:57:24.274270+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:36:31.365260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":317,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049406+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:57:25.049406+0000","last_peered":"2023-07-21T22:57:25.049406+0000","last_clean":"2023-07-21T22:57:25.049406+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:57:25.049406+0000","last_undegraded":"2023-07-21T22:57:25.049406+0000","last_fullsized":"2023-07-21T22:57:25.049406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:18.799521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049436+0000","last_change":"2023-07-21T22:57:23.301683+0000","last_active":"2023-07-21T22:57:25.049436+0000","last_peered":"2023-07-21T22:57:25.049436+0000","last_clean":"2023-07-21T22:57:25.049436+0000","last_became_active":"2023-07-21T22:57:23.301314+0000","last_became_peered":"2023-07-21T22:57:23.301314+0000","last_unstale":"2023-07-21T22:57:25.049436+0000","last_undegraded":"2023-07-21T22:57:25.049436+0000","last_fullsized":"2023-07-21T22:57:25.049436+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:36:58.572211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"191'2","reported_seq":15,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.276829+0000","last_change":"2023-07-21T22:57:22.516962+0000","last_active":"2023-07-21T22:57:24.276829+0000","last_peered":"2023-07-21T22:57:24.276829+0000","last_clean":"2023-07-21T22:57:24.276829+0000","last_became_active":"2023-07-21T22:57:22.516672+0000","last_became_peered":"2023-07-21T22:57:22.516672+0000","last_unstale":"2023-07-21T22:57:24.276829+0000","last_undegraded":"2023-07-21T22:57:24.276829+0000","last_fullsized":"2023-07-21T22:57:24.276829+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:27:58.699337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":335,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274928+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:57:24.274928+0000","last_peered":"2023-07-21T22:57:24.274928+0000","last_clean":"2023-07-21T22:57:24.274928+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:57:24.274928+0000","last_undegraded":"2023-07-21T22:57:24.274928+0000","last_fullsized":"2023-07-21T22:57:24.274928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:26:15.379511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":11,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:24.274379+0000","last_change":"2023-07-21T22:57:23.291619+0000","last_active":"2023-07-21T22:57:24.274379+0000","last_peered":"2023-07-21T22:57:24.274379+0000","last_clean":"2023-07-21T22:57:24.274379+0000","last_became_active":"2023-07-21T22:57:23.291189+0000","last_became_peered":"2023-07-21T22:57:23.291189+0000","last_unstale":"2023-07-21T22:57:24.274379+0000","last_undegraded":"2023-07-21T22:57:24.274379+0000","last_fullsized":"2023-07-21T22:57:24.274379+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:22.477152+0000","last_clean_scrub_stamp":"2023-07-21T22:57:22.477152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:50:56.877936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.043600+0000","last_change":"2023-07-21T22:57:22.517887+0000","last_active":"2023-07-21T22:57:25.043600+0000","last_peered":"2023-07-21T22:57:25.043600+0000","last_clean":"2023-07-21T22:57:25.043600+0000","last_became_active":"2023-07-21T22:57:22.517612+0000","last_became_peered":"2023-07-21T22:57:22.517612+0000","last_unstale":"2023-07-21T22:57:25.043600+0000","last_undegraded":"2023-07-21T22:57:25.043600+0000","last_fullsized":"2023-07-21T22:57:25.043600+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:57:21.467744+0000","last_clean_scrub_stamp":"2023-07-21T22:57:21.467744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:02:36.810558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":314,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-07-21T22:57:25.049919+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:57:25.049919+0000","last_peered":"2023-07-21T22:57:25.049919+0000","last_clean":"2023-07-21T22:57:25.049919+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:57:25.049919+0000","last_undegraded":"2023-07-21T22:57:25.049919+0000","last_fullsized":"2023-07-21T22:57:25.049919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:34:57.518013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509901,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64300,"kb_used_data":2916,"kb_used_omap":0,"kb_used_meta":61376,"kb_avail":94307540,"statfs":{"total":96636764160,"available":96570920960,"internally_reserved":0,"allocated":2985984,"data_stored":1820489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":62849024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.749,"15min":0.76200000000000001},"min":{"1min":0.42699999999999999,"5min":0.35999999999999999,"15min":0.34999999999999998},"max":{"1min":0.93400000000000005,"5min":0.96799999999999997,"15min":1.143},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.71399999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39000000000000001},"max":{"1min":0.90200000000000002,"5min":0.93200000000000005,"15min":1.0349999999999999},"last":0.61799999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.752,"15min":0.76300000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.40600000000000003},"max":{"1min":0.94099999999999995,"5min":1.089,"15min":1.089},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.73099999999999998,"15min":0.74099999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88800000000000001,"5min":0.95599999999999996,"15min":1.02},"last":0.69199999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.747,"15min":0.755},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.47999999999999998},"max":{"1min":0.95899999999999996,"5min":1.0049999999999999,"15min":1.0780000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.746,"5min":0.77000000000000002,"15min":0.78400000000000003},"min":{"1min":0.53000000000000003,"5min":0.51100000000000001,"15min":0.42299999999999999},"max":{"1min":0.91100000000000003,"5min":0.98899999999999999,"15min":1.0660000000000001},"last":0.80600000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.76100000000000001,"15min":0.77400000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97399999999999998,"5min":0.98099999999999998,"15min":1.0980000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.77200000000000002,"15min":0.77900000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.89100000000000001,"5min":0.98299999999999998,"15min":1.036},"last":0.72599999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55500000000000005,"15min":0.55600000000000005},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.34999999999999998},"max":{"1min":0.77000000000000002,"5min":0.81299999999999994,"15min":0.89700000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.60399999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.34699999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":1.0940000000000001},"last":0.53900000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60799999999999998,"15min":0.60999999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.99399999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.52300000000000002,"5min":0.48499999999999999,"15min":0.40699999999999997},"max":{"1min":0.871,"5min":0.91000000000000003,"15min":1.0429999999999999},"last":0.74199999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66900000000000004,"15min":0.67300000000000004},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.97399999999999998},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.64000000000000001,"15min":0.63400000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84499999999999997,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71199999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542607,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37480,"kb_used_data":2336,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334360,"statfs":{"total":96636764160,"available":96598384640,"internally_reserved":0,"allocated":2392064,"data_stored":1230121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.77300000000000002,"15min":0.78200000000000003},"min":{"1min":0.59299999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.97899999999999998,"5min":1.022,"15min":1.024},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79900000000000004,"15min":0.80400000000000005},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93400000000000005,"5min":1,"15min":1.0780000000000001},"last":0.77400000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71899999999999997,"15min":0.72999999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.874,"5min":0.96999999999999997,"15min":1.006},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.747,"15min":0.74099999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90600000000000003,"5min":1.046,"15min":1.046},"last":0.622}]},{"osd":2,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.75700000000000001,"15min":0.77200000000000002},"min":{"1min":0.58999999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.88500000000000001,"5min":0.97399999999999998,"15min":1.038},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.56200000000000006,"5min":0.438,"15min":0.438},"max":{"1min":0.93400000000000005,"5min":0.98799999999999999,"15min":1.0600000000000001},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.753,"15min":0.751},"min":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.48999999999999999},"max":{"1min":0.93700000000000006,"5min":1.089,"15min":1.089},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.749,"15min":0.75},"min":{"1min":0.52800000000000002,"5min":0.499,"15min":0.499},"max":{"1min":0.89100000000000001,"5min":0.96199999999999997,"15min":0.96999999999999997},"last":0.754}]},{"osd":4,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.36099999999999999},"max":{"1min":0.81799999999999995,"5min":0.88400000000000001,"15min":0.92300000000000004},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60899999999999999,"15min":0.61199999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":0.77900000000000003,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.66600000000000004,"5min":0.89600000000000002,"15min":0.91300000000000003},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.64100000000000001,"15min":0.64600000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42299999999999999},"max":{"1min":0.77700000000000002,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:56:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.64000000000000001,"15min":0.65500000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.38700000000000001},"max":{"1min":0.76400000000000001,"5min":0.91600000000000004,"15min":1.0129999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66000000000000003,"15min":0.66600000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.432},"max":{"1min":0.78500000000000003,"5min":0.90000000000000002,"15min":0.96299999999999997},"last":0.55900000000000005}]}]},{"osd":5,"up_from":15,"seq":64424509900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55536,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316304,"statfs":{"total":96636764160,"available":96579895296,"internally_reserved":0,"allocated":2400256,"data_stored":1230245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.46600000000000003,"5min":0.437,"15min":0.32100000000000001},"max":{"1min":0.92900000000000005,"5min":1.044,"15min":1.044},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71999999999999997,"15min":0.72799999999999998},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.41499999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.83999999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.42399999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.999},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.73099999999999998,"15min":0.73299999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.89800000000000002,"5min":1.038,"15min":1.054},"last":0.86299999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.52200000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.119},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.747,"15min":0.74199999999999999},"min":{"1min":0.56999999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95099999999999996,"5min":0.96899999999999997,"15min":1.0880000000000001},"last":0.78500000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79200000000000004,"15min":0.78600000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.47299999999999998},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79100000000000004,"15min":0.80000000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.94499999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.57399999999999995,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76500000000000001,"5min":0.90400000000000003,"15min":0.91300000000000003},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68500000000000005,"15min":0.68100000000000005},"min":{"1min":0.52600000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.022,"5min":1.022,"15min":1.0369999999999999},"last":0.73299999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.58699999999999997},"min":{"1min":0.433,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90500000000000003,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.60499999999999998,"15min":0.60099999999999998},"min":{"1min":0.44700000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.92400000000000004,"5min":0.93600000000000005,"15min":1.0629999999999999},"last":0.81499999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:56:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.63500000000000001,"15min":0.64100000000000001},"min":{"1min":0.45300000000000001,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":0.88100000000000001,"5min":1.028,"15min":1.0549999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73499999999999999,"15min":0.72299999999999998},"min":{"1min":0.496,"5min":0.48699999999999999,"15min":0.45900000000000002},"max":{"1min":1.034,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.88400000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509901,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37496,"kb_used_data":2352,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334344,"statfs":{"total":96636764160,"available":96598368256,"internally_reserved":0,"allocated":2408448,"data_stored":1230885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.34599999999999997},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.76900000000000002},"min":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.35299999999999998},"max":{"1min":1.3500000000000001,"5min":1.488,"15min":1.488},"last":0.80800000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.52700000000000002,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":2.7320000000000002,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.72199999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.80300000000000005,"15min":0.78800000000000003},"min":{"1min":0.62,"5min":0.60699999999999998,"15min":0.46899999999999997},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.747},{"interface":"front","average":{"1min":0.878,"5min":0.79800000000000004,"15min":0.78600000000000003},"min":{"1min":0.623,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":0.91300000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.78800000000000003,"15min":0.75600000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.0169999999999999,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82299999999999995,"15min":0.81599999999999995},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.89700000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73299999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.44500000000000001,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.151},"last":0.58999999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.57899999999999996,"5min":0.45800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94999999999999996,"5min":0.96299999999999997,"15min":1.252},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.44400000000000001,"15min":0.437},"max":{"1min":1.006,"5min":1.006,"15min":1.0609999999999999},"last":0.78500000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68300000000000005,"15min":0.66000000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.39500000000000002},"max":{"1min":1.0189999999999999,"5min":1.526,"15min":1.526},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.53600000000000003,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.99099999999999999,"5min":1.0820000000000001,"15min":1.206},"last":0.87}]}]},{"osd":3,"up_from":15,"seq":64424509900,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37500,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334340,"statfs":{"total":96636764160,"available":96598364160,"internally_reserved":0,"allocated":2412544,"data_stored":1232289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.503,"15min":0.496},"min":{"1min":0.29899999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57899999999999996,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.65100000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.35299999999999998,"5min":0.317,"15min":0.312},"max":{"1min":0.72999999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79700000000000004,"5min":0.81799999999999995,"15min":0.88100000000000001},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.80000000000000004,"5min":0.83199999999999996,"15min":0.84699999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.36899999999999999,"15min":0.36299999999999999},"max":{"1min":0.78600000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58999999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77600000000000002,"15min":0.77900000000000003},"min":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.441},"max":{"1min":1.046,"5min":1.101,"15min":1.244},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.84399999999999997},"min":{"1min":0.58099999999999996,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.66200000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.57099999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.626},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.59499999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.006,"5min":1.087,"15min":1.2230000000000001},"last":0.68000000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81200000000000006,"15min":0.80600000000000005},"min":{"1min":0.58799999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0820000000000001,"5min":1.127,"15min":1.147},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78500000000000003,"15min":0.78600000000000003},"min":{"1min":0.56799999999999995,"5min":0.55100000000000005,"15min":0.53000000000000003},"max":{"1min":1.296,"5min":1.296,"15min":1.3660000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83299999999999996,"15min":0.82999999999999996},"min":{"1min":0.624,"5min":0.55000000000000004,"15min":0.50900000000000001},"max":{"1min":1.175,"5min":1.175,"15min":1.4510000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82799999999999996,"15min":0.84299999999999997},"min":{"1min":0.61499999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.427},"last":0.71999999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509902,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55528,"kb_used_data":2336,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316312,"statfs":{"total":96636764160,"available":96579903488,"internally_reserved":0,"allocated":2392064,"data_stored":1230121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.52700000000000002,"15min":0.51000000000000001},"min":{"1min":0.33400000000000002,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.45900000000000002,"5min":0.38,"15min":0.377},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.35599999999999998},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.47199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.51000000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.499},"min":{"1min":0.379,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69399999999999995,"5min":0.73099999999999998,"15min":0.92800000000000005},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.60599999999999998,"15min":0.59399999999999997},"min":{"1min":0.53400000000000003,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.41999999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.82499999999999996,"15min":0.82599999999999996},"min":{"1min":0.66000000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.55900000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1240000000000001,"5min":1.1359999999999999,"15min":1.391},"last":0.55400000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.67200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.82599999999999996,"15min":0.83699999999999997},"min":{"1min":0.57699999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.69199999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.80000000000000004,"15min":0.81899999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1220000000000001,"5min":1.1499999999999999,"15min":1.2969999999999999},"last":0.624},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.84399999999999997,"15min":0.84699999999999998},"min":{"1min":0.63600000000000001,"5min":0.59999999999999998,"15min":0.55600000000000005},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.63900000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.84399999999999997,"15min":0.85099999999999998},"min":{"1min":0.748,"5min":0.62,"15min":0.56000000000000005},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81999999999999995,"15min":0.84399999999999997},"min":{"1min":0.59599999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"max":{"1min":1.1679999999999999,"5min":1.2749999999999999,"15min":1.3939999999999999},"last":0.67300000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509901,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37492,"kb_used_data":2348,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334348,"statfs":{"total":96636764160,"available":96598372352,"internally_reserved":0,"allocated":2404352,"data_stored":1231685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48799999999999999,"15min":0.497},"min":{"1min":0.29899999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59999999999999998,"15min":0.59799999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89500000000000002,"5min":1.149,"15min":1.149},"last":0.48999999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50900000000000001,"15min":0.52600000000000002},"min":{"1min":0.39500000000000002,"5min":0.33900000000000002,"15min":0.33100000000000002},"max":{"1min":0.64900000000000002,"5min":0.80800000000000005,"15min":0.82799999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.376,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73699999999999999,"5min":1.21,"15min":1.21},"last":0.44900000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60199999999999998,"15min":0.61099999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.878,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51100000000000001,"15min":0.52100000000000002},"min":{"1min":0.38900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.77300000000000002,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.78200000000000003,"15min":0.80100000000000005},"min":{"1min":0.59499999999999997,"5min":0.53700000000000003,"15min":0.46500000000000002},"max":{"1min":1.0329999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81999999999999995,"15min":0.82299999999999995},"min":{"1min":0.59199999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0169999999999999,"5min":1.2849999999999999,"15min":1.302},"last":0.629}]},{"osd":5,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80900000000000005},"min":{"1min":0.57999999999999996,"5min":0.52900000000000003,"15min":0.499},"max":{"1min":1.002,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.79000000000000004,"15min":0.80900000000000005},"min":{"1min":0.57899999999999996,"5min":0.52800000000000002,"15min":0.48799999999999999},"max":{"1min":1.052,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.57399999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83299999999999996,"15min":0.82899999999999996},"min":{"1min":0.68000000000000005,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.0700000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78600000000000003,"15min":0.81100000000000005},"min":{"1min":0.56200000000000006,"5min":0.495,"15min":0.495},"max":{"1min":1.028,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:56:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80600000000000005,"15min":0.82999999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0009999999999999,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.82899999999999996,"15min":0.83399999999999996},"min":{"1min":0.63,"5min":0.61799999999999999,"15min":0.55000000000000004},"max":{"1min":1.0009999999999999,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.68300000000000005}]}]},{"osd":0,"up_from":15,"seq":64424509903,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38068,"kb_used_data":2924,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333772,"statfs":{"total":96636764160,"available":96597782528,"internally_reserved":0,"allocated":2994176,"data_stored":1820593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.498,"15min":0.48799999999999999},"min":{"1min":0.317,"5min":0.29999999999999999,"15min":0.28499999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54300000000000004,"15min":0.54000000000000004},"min":{"1min":0.40000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.36499999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33900000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.39600000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.627,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.41599999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.629,"5min":0.51200000000000001,"15min":0.51000000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.4370000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.82999999999999996,"15min":0.82699999999999996},"min":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.72899999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.83199999999999996,"15min":0.82199999999999995},"min":{"1min":0.63500000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2130000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.87,"15min":0.84899999999999998},"min":{"1min":0.628,"5min":0.497,"15min":0.497},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.351},"last":0.68000000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.58499999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.627,"5min":0.60699999999999998,"15min":0.60299999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.83499999999999996,"15min":0.83199999999999996},"min":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"max":{"1min":1.1699999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.877,"15min":0.873},"min":{"1min":0.64900000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.411},"last":0.69699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:57:32.651 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T22:57:32.652 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-21T22:57:32.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac59a34640 1 Processor -- start 2023-07-21T22:57:32.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac59a34640 1 -- start start 2023-07-21T22:57:32.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac59a34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac540cb360 0x7fac5415df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac59a34640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac540cc900 con 0x7fac540cd490 2023-07-21T22:57:32.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac59a34640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac540ccbe0 con 0x7fac540b38d0 2023-07-21T22:57:32.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac59a34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5415d780 con 0x7fac540cb360 2023-07-21T22:57:32.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac537fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fac540cd490 0x7fac540c9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58258/0 (socket says 172.21.15.6:58258) 2023-07-21T22:57:32.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac537fe640 1 -- 172.21.15.6:0/990072050 learned_addr learned my addr 172.21.15.6:0/990072050 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:32.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac52ffd640 1 --2- 172.21.15.6:0/990072050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac540cb360 0x7fac5415df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac527fc640 1 -- 172.21.15.6:0/990072050 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451556905 0 0) 0x7fac540cc900 con 0x7fac540cd490 2023-07-21T22:57:32.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac527fc640 1 -- 172.21.15.6:0/990072050 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac40003530 con 0x7fac540cd490 2023-07-21T22:57:32.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac527fc640 1 -- 172.21.15.6:0/990072050 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009028979 0 0) 0x7fac540ccbe0 con 0x7fac540b38d0 2023-07-21T22:57:32.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac527fc640 1 -- 172.21.15.6:0/990072050 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac540cc900 con 0x7fac540b38d0 2023-07-21T22:57:32.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac527fc640 1 -- 172.21.15.6:0/990072050 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 303862295 0 0) 0x7fac40003530 con 0x7fac540cd490 2023-07-21T22:57:32.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac527fc640 1 -- 172.21.15.6:0/990072050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac540cb360 msgr2=0x7fac5415df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:32.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac527fc640 1 --2- 172.21.15.6:0/990072050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac540cb360 0x7fac5415df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac527fc640 1 -- 172.21.15.6:0/990072050 >> v1:172.21.15.161:6789/0 conn(0x7fac540b38d0 legacy=0x7fac54070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:32.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac527fc640 1 -- 172.21.15.6:0/990072050 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5415da60 con 0x7fac540cd490 2023-07-21T22:57:32.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac527fc640 1 -- 172.21.15.6:0/990072050 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fac4c001a00 con 0x7fac540cd490 2023-07-21T22:57:32.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac527fc640 1 -- 172.21.15.6:0/990072050 >> v1:172.21.15.6:6789/0 conn(0x7fac540cd490 legacy=0x7fac540c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:32.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac527fc640 1 --2- 172.21.15.6:0/990072050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac40003b40 0x7fac40003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac527fc640 1 --2- 172.21.15.6:0/990072050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac540cb360 0x7fac400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac527fc640 1 --2- 172.21.15.6:0/990072050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac40004d10 0x7fac40005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac527fc640 1 -- 172.21.15.6:0/990072050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5415d780 con 0x7fac40003b40 2023-07-21T22:57:32.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac527fc640 1 -- 172.21.15.6:0/990072050 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4000ba90 con 0x7fac40004d10 2023-07-21T22:57:32.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.796+0000 7fac527fc640 1 -- 172.21.15.6:0/990072050 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4000bc50 con 0x7fac540cb360 2023-07-21T22:57:32.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.800+0000 7fac52ffd640 1 --2- 172.21.15.6:0/990072050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac40003b40 0x7fac40003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.800+0000 7fac4bfff640 1 --2- 172.21.15.6:0/990072050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac540cb360 0x7fac400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.800+0000 7fac537fe640 1 --2- 172.21.15.6:0/990072050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac40004d10 0x7fac40005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.800+0000 7fac52ffd640 1 -- 172.21.15.6:0/990072050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac540cb360 msgr2=0x7fac400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:32.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.800+0000 7fac52ffd640 1 --2- 172.21.15.6:0/990072050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac540cb360 0x7fac400047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.800+0000 7fac52ffd640 1 -- 172.21.15.6:0/990072050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac40004d10 msgr2=0x7fac40005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:32.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.800+0000 7fac52ffd640 1 --2- 172.21.15.6:0/990072050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac40004d10 0x7fac40005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.800+0000 7fac52ffd640 1 -- 172.21.15.6:0/990072050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac40003530 con 0x7fac40003b40 2023-07-21T22:57:32.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.800+0000 7fac52ffd640 1 --2- 172.21.15.6:0/990072050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac40003b40 0x7fac40003f30 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fac44009ae0 tx=0x7fac4401c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4edf2f000191ed80 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:32.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.800+0000 7fac527fc640 1 -- 172.21.15.6:0/990072050 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac440a4870 con 0x7fac40003b40 2023-07-21T22:57:32.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.800+0000 7fac527fc640 1 -- 172.21.15.6:0/990072050 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5415e5a0 con 0x7fac40003b40 2023-07-21T22:57:32.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.800+0000 7fac527fc640 1 -- 172.21.15.6:0/990072050 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac440a4c10 con 0x7fac40003b40 2023-07-21T22:57:32.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac59a34640 1 -- 172.21.15.6:0/990072050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac40003b40 msgr2=0x7fac40003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:32.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac59a34640 1 --2- 172.21.15.6:0/990072050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac40003b40 0x7fac40003f30 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fac44009ae0 tx=0x7fac4401c730 comp rx=0 tx=0).stop 2023-07-21T22:57:32.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac537fe640 1 -- 172.21.15.6:0/990072050 reap_dead start 2023-07-21T22:57:32.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac59a34640 1 -- 172.21.15.6:0/990072050 shutdown_connections 2023-07-21T22:57:32.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac59a34640 1 -- 172.21.15.6:0/990072050 >> 172.21.15.6:0/990072050 conn(0x7fac540afac0 msgr2=0x7fac540afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:32.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac59a34640 1 -- 172.21.15.6:0/990072050 shutdown_connections 2023-07-21T22:57:32.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac59a34640 1 -- 172.21.15.6:0/990072050 wait complete. 2023-07-21T22:57:32.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac59a34640 1 Processor -- start 2023-07-21T22:57:32.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac59a34640 1 -- start start 2023-07-21T22:57:32.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac59a34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac40003b40 0x7fac541f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac59a34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac5415c900 0x7fac540c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac59a34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac540c34d0 0x7fac54143c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac59a34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac540c3940 con 0x7fac540c34d0 2023-07-21T22:57:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac59a34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5415c470 con 0x7fac5415c900 2023-07-21T22:57:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac59a34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5415b860 con 0x7fac40003b40 2023-07-21T22:57:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac537fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac540c34d0 0x7fac54143c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac537fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac540c34d0 0x7fac54143c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39028/0 (socket says 172.21.15.6:39028) 2023-07-21T22:57:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac537fe640 1 -- 172.21.15.6:0/5298304 learned_addr learned my addr 172.21.15.6:0/5298304 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac4bfff640 1 --2- 172.21.15.6:0/5298304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac5415c900 0x7fac540c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac52ffd640 1 --2- 172.21.15.6:0/5298304 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac40003b40 0x7fac541f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac537fe640 1 -- 172.21.15.6:0/5298304 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac40003b40 msgr2=0x7fac541f4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac537fe640 1 --2- 172.21.15.6:0/5298304 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac40003b40 0x7fac541f4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac537fe640 1 -- 172.21.15.6:0/5298304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac5415c900 msgr2=0x7fac540c2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac537fe640 1 --2- 172.21.15.6:0/5298304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac5415c900 0x7fac540c2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac537fe640 1 -- 172.21.15.6:0/5298304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5415bb40 con 0x7fac540c34d0 2023-07-21T22:57:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.804+0000 7fac52ffd640 1 --2- 172.21.15.6:0/5298304 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac40003b40 0x7fac541f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.808+0000 7fac537fe640 1 --2- 172.21.15.6:0/5298304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac540c34d0 0x7fac54143c70 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fac540cd860 tx=0x7fac4c0077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.808+0000 7fac50ff9640 1 -- 172.21.15.6:0/5298304 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c0114f0 con 0x7fac540c34d0 2023-07-21T22:57:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.808+0000 7fac50ff9640 1 -- 172.21.15.6:0/5298304 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c011670 con 0x7fac540c34d0 2023-07-21T22:57:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.808+0000 7fac50ff9640 1 -- 172.21.15.6:0/5298304 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c011a20 con 0x7fac540c34d0 2023-07-21T22:57:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.808+0000 7fac59a34640 1 -- 172.21.15.6:0/5298304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5415be20 con 0x7fac540c34d0 2023-07-21T22:57:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.808+0000 7fac59a34640 1 -- 172.21.15.6:0/5298304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5415cd70 con 0x7fac540c34d0 2023-07-21T22:57:32.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.808+0000 7fac59a34640 1 -- 172.21.15.6:0/5298304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac540678d0 con 0x7fac540c34d0 2023-07-21T22:57:32.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.808+0000 7fac50ff9640 1 -- 172.21.15.6:0/5298304 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fac4c011b80 con 0x7fac540c34d0 2023-07-21T22:57:32.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.808+0000 7fac50ff9640 1 --2- 172.21.15.6:0/5298304 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fac340663d0 0x7fac34068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.808+0000 7fac50ff9640 1 -- 172.21.15.6:0/5298304 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fac4c083190 con 0x7fac540c34d0 2023-07-21T22:57:32.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.812+0000 7fac52ffd640 1 --2- 172.21.15.6:0/5298304 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fac340663d0 0x7fac34068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.812+0000 7fac52ffd640 1 --2- 172.21.15.6:0/5298304 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fac340663d0 0x7fac34068880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fac440ae000 tx=0x7fac440046d0 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:32.812+0000 7fac50ff9640 1 -- 172.21.15.6:0/5298304 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fac4c050550 con 0x7fac540c34d0 2023-07-21T22:57:33.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.024+0000 7fac59a34640 1 -- 172.21.15.6:0/5298304 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fac5415c5b0 con 0x7fac540c34d0 2023-07-21T22:57:33.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.028+0000 7fac50ff9640 1 -- 172.21.15.6:0/5298304 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v30) v1 ==== 190+0+147 (secure 0 0 0) 0x7fac4c053b70 con 0x7fac540c34d0 2023-07-21T22:57:33.064 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-07-21T22:57:33.065 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAHBLtki0mQFBAAHWyVsG241pbGj9q9mdVdYA== 2023-07-21T22:57:33.065 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2023-07-21T22:57:33.065 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2023-07-21T22:57:33.065 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-21T22:57:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-07-21T22:57:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.032+0000 7fac59a34640 1 -- 172.21.15.6:0/5298304 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fac340663d0 msgr2=0x7fac34068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.032+0000 7fac59a34640 1 --2- 172.21.15.6:0/5298304 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fac340663d0 0x7fac34068880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fac440ae000 tx=0x7fac440046d0 comp rx=0 tx=0).stop 2023-07-21T22:57:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.032+0000 7fac59a34640 1 -- 172.21.15.6:0/5298304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac540c34d0 msgr2=0x7fac54143c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.032+0000 7fac59a34640 1 --2- 172.21.15.6:0/5298304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac540c34d0 0x7fac54143c70 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fac540cd860 tx=0x7fac4c0077d0 comp rx=0 tx=0).stop 2023-07-21T22:57:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.032+0000 7fac59a34640 1 -- 172.21.15.6:0/5298304 shutdown_connections 2023-07-21T22:57:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.032+0000 7fac59a34640 1 --2- 172.21.15.6:0/5298304 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fac340663d0 0x7fac34068880 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.032+0000 7fac59a34640 1 --2- 172.21.15.6:0/5298304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac540c34d0 0x7fac54143c70 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.032+0000 7fac59a34640 1 --2- 172.21.15.6:0/5298304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac5415c900 0x7fac540c2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.032+0000 7fac59a34640 1 --2- 172.21.15.6:0/5298304 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fac40003b40 0x7fac541f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.032+0000 7fac59a34640 1 -- 172.21.15.6:0/5298304 >> 172.21.15.6:0/5298304 conn(0x7fac540afac0 msgr2=0x7fac540b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.032+0000 7fac59a34640 1 -- 172.21.15.6:0/5298304 shutdown_connections 2023-07-21T22:57:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.032+0000 7fac59a34640 1 -- 172.21.15.6:0/5298304 wait complete. 2023-07-21T22:57:33.085 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:57:33.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.196+0000 7fa969582640 1 Processor -- start 2023-07-21T22:57:33.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.196+0000 7fa969582640 1 -- start start 2023-07-21T22:57:33.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.196+0000 7fa969582640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9640b7c70 0x7fa9640d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:33.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.196+0000 7fa969582640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9640d1850 0x7fa96415f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:33.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.196+0000 7fa969582640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9640ccaf0 con 0x7fa9640d1300 2023-07-21T22:57:33.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.196+0000 7fa969582640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9640d1190 con 0x7fa9640b7c70 2023-07-21T22:57:33.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.196+0000 7fa969582640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa964160600 con 0x7fa9640d1850 2023-07-21T22:57:33.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.196+0000 7fa962ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9640b7c70 0x7fa9640d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:33.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.196+0000 7fa962ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9640b7c70 0x7fa9640d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39040/0 (socket says 172.21.15.6:39040) 2023-07-21T22:57:33.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.196+0000 7fa962ffd640 1 -- 172.21.15.6:0/2181215843 learned_addr learned my addr 172.21.15.6:0/2181215843 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:33.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.196+0000 7fa962ffd640 1 -- 172.21.15.6:0/2181215843 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9640d1850 msgr2=0x7fa96415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:33.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.196+0000 7fa962ffd640 1 --2- 172.21.15.6:0/2181215843 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9640d1850 0x7fa96415f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:33.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.196+0000 7fa962ffd640 1 -- 172.21.15.6:0/2181215843 >> v1:172.21.15.161:6789/0 conn(0x7fa9640d1300 legacy=0x7fa9640d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:33.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.196+0000 7fa962ffd640 1 -- 172.21.15.6:0/2181215843 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa964160320 con 0x7fa9640b7c70 2023-07-21T22:57:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.200+0000 7fa962ffd640 1 --2- 172.21.15.6:0/2181215843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9640b7c70 0x7fa9640d0c50 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fa9540098a0 tx=0x7fa95401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c894bf1d18ce739e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.200+0000 7fa9627fc640 1 -- 172.21.15.6:0/2181215843 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9540ab650 con 0x7fa9640b7c70 2023-07-21T22:57:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.200+0000 7fa9627fc640 1 -- 172.21.15.6:0/2181215843 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9540ab7b0 con 0x7fa9640b7c70 2023-07-21T22:57:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.200+0000 7fa9627fc640 1 -- 172.21.15.6:0/2181215843 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9540abb40 con 0x7fa9640b7c70 2023-07-21T22:57:33.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.200+0000 7fa969582640 1 -- 172.21.15.6:0/2181215843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9640b7c70 msgr2=0x7fa9640d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:33.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.200+0000 7fa969582640 1 --2- 172.21.15.6:0/2181215843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9640b7c70 0x7fa9640d0c50 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fa9540098a0 tx=0x7fa95401c4b0 comp rx=0 tx=0).stop 2023-07-21T22:57:33.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.200+0000 7fa969582640 1 -- 172.21.15.6:0/2181215843 shutdown_connections 2023-07-21T22:57:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.200+0000 7fa969582640 1 --2- 172.21.15.6:0/2181215843 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9640d1850 0x7fa96415f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.200+0000 7fa969582640 1 --2- 172.21.15.6:0/2181215843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9640b7c70 0x7fa9640d0c50 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.200+0000 7fa969582640 1 -- 172.21.15.6:0/2181215843 >> 172.21.15.6:0/2181215843 conn(0x7fa9640650b0 msgr2=0x7fa9640654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.200+0000 7fa969582640 1 -- 172.21.15.6:0/2181215843 shutdown_connections 2023-07-21T22:57:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.200+0000 7fa969582640 1 -- 172.21.15.6:0/2181215843 wait complete. 2023-07-21T22:57:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa969582640 1 Processor -- start 2023-07-21T22:57:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa969582640 1 -- start start 2023-07-21T22:57:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa969582640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9640b7c70 0x7fa9640c5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa969582640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9640d1300 0x7fa96415c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa969582640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9640d1850 0x7fa9640b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa969582640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9640c56a0 con 0x7fa9640d1850 2023-07-21T22:57:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa969582640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96415c670 con 0x7fa9640d1300 2023-07-21T22:57:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa969582640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96414d1b0 con 0x7fa9640b7c70 2023-07-21T22:57:33.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa9637fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9640d1850 0x7fa9640b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:33.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa9637fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9640d1850 0x7fa9640b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39050/0 (socket says 172.21.15.6:39050) 2023-07-21T22:57:33.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa9637fe640 1 -- 172.21.15.6:0/3350310818 learned_addr learned my addr 172.21.15.6:0/3350310818 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:33.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa962ffd640 1 --2- 172.21.15.6:0/3350310818 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9640b7c70 0x7fa9640c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:33.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa95a7fc640 1 --2- 172.21.15.6:0/3350310818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9640d1300 0x7fa96415c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:33.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa9637fe640 1 -- 172.21.15.6:0/3350310818 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9640b7c70 msgr2=0x7fa9640c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:33.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa9637fe640 1 --2- 172.21.15.6:0/3350310818 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9640b7c70 0x7fa9640c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:33.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa9637fe640 1 -- 172.21.15.6:0/3350310818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9640d1300 msgr2=0x7fa96415c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:33.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa9637fe640 1 --2- 172.21.15.6:0/3350310818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9640d1300 0x7fa96415c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:33.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa9637fe640 1 -- 172.21.15.6:0/3350310818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9540094d0 con 0x7fa9640d1850 2023-07-21T22:57:33.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa962ffd640 1 --2- 172.21.15.6:0/3350310818 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9640b7c70 0x7fa9640c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:33.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa95a7fc640 1 --2- 172.21.15.6:0/3350310818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9640d1300 0x7fa96415c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:33.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa9637fe640 1 --2- 172.21.15.6:0/3350310818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9640d1850 0x7fa9640b5420 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fa95c00b9a0 tx=0x7fa95c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:33.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa95bfff640 1 -- 172.21.15.6:0/3350310818 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c00cba0 con 0x7fa9640d1850 2023-07-21T22:57:33.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa95bfff640 1 -- 172.21.15.6:0/3350310818 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95c00cd00 con 0x7fa9640d1850 2023-07-21T22:57:33.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa969582640 1 -- 172.21.15.6:0/3350310818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9640c29f0 con 0x7fa9640d1850 2023-07-21T22:57:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa95bfff640 1 -- 172.21.15.6:0/3350310818 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c014680 con 0x7fa9640d1850 2023-07-21T22:57:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.204+0000 7fa969582640 1 -- 172.21.15.6:0/3350310818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9640c2fb0 con 0x7fa9640d1850 2023-07-21T22:57:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.208+0000 7fa969582640 1 -- 172.21.15.6:0/3350310818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9640678d0 con 0x7fa9640d1850 2023-07-21T22:57:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.208+0000 7fa95bfff640 1 -- 172.21.15.6:0/3350310818 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa95c01d3b0 con 0x7fa9640d1850 2023-07-21T22:57:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.208+0000 7fa95bfff640 1 --2- 172.21.15.6:0/3350310818 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa9440663a0 0x7fa944068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.208+0000 7fa95bfff640 1 -- 172.21.15.6:0/3350310818 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fa95c083db0 con 0x7fa9640d1850 2023-07-21T22:57:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.208+0000 7fa962ffd640 1 --2- 172.21.15.6:0/3350310818 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa9440663a0 0x7fa944068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.208+0000 7fa962ffd640 1 --2- 172.21.15.6:0/3350310818 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa9440663a0 0x7fa944068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa9540af000 tx=0x7fa954008040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:33.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.212+0000 7fa95bfff640 1 -- 172.21.15.6:0/3350310818 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa95c088070 con 0x7fa9640d1850 2023-07-21T22:57:33.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.400+0000 7fa969582640 1 -- 172.21.15.6:0/3350310818 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9640c9190 con 0x7fa9640d1850 2023-07-21T22:57:33.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.400+0000 7fa95bfff640 1 -- 172.21.15.6:0/3350310818 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4667 (secure 0 0 0) 0x7fa95c051030 con 0x7fa9640d1850 2023-07-21T22:57:33.436 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:33.437 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8765,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/617196146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":617196146},{"type":"v1","addr":"172.21.15.161:6836","nonce":617196146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9976,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/618083440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":618083440},{"type":"v1","addr":"172.21.15.161:6837","nonce":618083440}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":10503,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/205515898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":205515898},{"type":"v1","addr":"172.21.15.6:6834","nonce":205515898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:57:22.895862+0000","modified":"2023-07-21T22:57:26.519881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10506":{"gid":10506,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/963904366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":963904366},{"type":"v1","addr":"172.21.15.6:6835","nonce":963904366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-21T22:57:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 86 2023-07-21T22:57:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.400+0000 7fa969582640 1 -- 172.21.15.6:0/3350310818 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa9440663a0 msgr2=0x7fa944068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.400+0000 7fa969582640 1 --2- 172.21.15.6:0/3350310818 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa9440663a0 0x7fa944068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa9540af000 tx=0x7fa954008040 comp rx=0 tx=0).stop 2023-07-21T22:57:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.400+0000 7fa969582640 1 -- 172.21.15.6:0/3350310818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9640d1850 msgr2=0x7fa9640b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.400+0000 7fa969582640 1 --2- 172.21.15.6:0/3350310818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9640d1850 0x7fa9640b5420 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fa95c00b9a0 tx=0x7fa95c00be60 comp rx=0 tx=0).stop 2023-07-21T22:57:33.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.400+0000 7fa969582640 1 -- 172.21.15.6:0/3350310818 shutdown_connections 2023-07-21T22:57:33.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.400+0000 7fa969582640 1 --2- 172.21.15.6:0/3350310818 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fa9440663a0 0x7fa944068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:33.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.400+0000 7fa969582640 1 --2- 172.21.15.6:0/3350310818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9640d1850 0x7fa9640b5420 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:33.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.400+0000 7fa969582640 1 --2- 172.21.15.6:0/3350310818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9640d1300 0x7fa96415c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:33.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.400+0000 7fa969582640 1 --2- 172.21.15.6:0/3350310818 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9640b7c70 0x7fa9640c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:33.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.400+0000 7fa969582640 1 -- 172.21.15.6:0/3350310818 >> 172.21.15.6:0/3350310818 conn(0x7fa9640650b0 msgr2=0x7fa964065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:33.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.404+0000 7fa969582640 1 -- 172.21.15.6:0/3350310818 shutdown_connections 2023-07-21T22:57:33.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.404+0000 7fa969582640 1 -- 172.21.15.6:0/3350310818 wait complete. 2023-07-21T22:57:33.859 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-21T22:57:22.895862+0000', 'modified': '2023-07-21T22:57:26.519881+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10506}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10506': {'gid': 10506, 'name': 'c', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6835/963904366', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6833', 'nonce': 963904366}, {'type': 'v1', 'addr': '172.21.15.6:6835', 'nonce': 963904366}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T22:57:33.859 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-21T22:57:33.859 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-21T22:57:34.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.972+0000 7fd335b37640 1 Processor -- start 2023-07-21T22:57:34.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.972+0000 7fd335b37640 1 -- start start 2023-07-21T22:57:34.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.972+0000 7fd335b37640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd3300cb100 0x7fd3300cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.972+0000 7fd335b37640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3300cac70 con 0x7fd33006b1e0 2023-07-21T22:57:34.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.972+0000 7fd335b37640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3300cba60 con 0x7fd330070b70 2023-07-21T22:57:34.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.972+0000 7fd335b37640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3300ca060 con 0x7fd3300cb100 2023-07-21T22:57:34.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.972+0000 7fd32ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd3300cb100 0x7fd3300cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.972+0000 7fd32effd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd33006b1e0 0x7fd3300c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58266/0 (socket says 172.21.15.6:58266) 2023-07-21T22:57:34.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.972+0000 7fd32effd640 1 -- 172.21.15.6:0/2136575667 learned_addr learned my addr 172.21.15.6:0/2136575667 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.972+0000 7fd32ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd3300cb100 0x7fd3300cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39066/0 (socket says 172.21.15.6:39066) 2023-07-21T22:57:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.972+0000 7fd32ffff640 1 -- 172.21.15.6:0/2136575667 >> v1:172.21.15.161:6789/0 conn(0x7fd330070b70 legacy=0x7fd330070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.972+0000 7fd32ffff640 1 -- 172.21.15.6:0/2136575667 >> v1:172.21.15.6:6789/0 conn(0x7fd33006b1e0 legacy=0x7fd3300c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.972+0000 7fd32ffff640 1 -- 172.21.15.6:0/2136575667 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3300ca340 con 0x7fd3300cb100 2023-07-21T22:57:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.972+0000 7fd32e7fc640 1 -- 172.21.15.6:0/2136575667 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963636671 0 0) 0x7fd3300cac70 con 0x7fd33006b1e0 2023-07-21T22:57:34.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.976+0000 7fd32ffff640 1 --2- 172.21.15.6:0/2136575667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3300cb100 0x7fd3300cb520 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fd328009d90 tx=0x7fd32801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298a45d243b3529c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.976+0000 7fd32e7fc640 1 -- 172.21.15.6:0/2136575667 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3280a59a0 con 0x7fd3300cb100 2023-07-21T22:57:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.976+0000 7fd32e7fc640 1 -- 172.21.15.6:0/2136575667 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3280a5b00 con 0x7fd3300cb100 2023-07-21T22:57:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.976+0000 7fd32e7fc640 1 -- 172.21.15.6:0/2136575667 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3280a5e90 con 0x7fd3300cb100 2023-07-21T22:57:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.976+0000 7fd335b37640 1 -- 172.21.15.6:0/2136575667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3300cb100 msgr2=0x7fd3300cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.976+0000 7fd335b37640 1 --2- 172.21.15.6:0/2136575667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3300cb100 0x7fd3300cb520 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fd328009d90 tx=0x7fd32801c8e0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.976+0000 7fd335b37640 1 -- 172.21.15.6:0/2136575667 shutdown_connections 2023-07-21T22:57:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.976+0000 7fd335b37640 1 --2- 172.21.15.6:0/2136575667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3300cb100 0x7fd3300cb520 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.976+0000 7fd335b37640 1 -- 172.21.15.6:0/2136575667 >> 172.21.15.6:0/2136575667 conn(0x7fd3300afcf0 msgr2=0x7fd3300b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:34.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.976+0000 7fd335b37640 1 -- 172.21.15.6:0/2136575667 shutdown_connections 2023-07-21T22:57:34.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.976+0000 7fd335b37640 1 -- 172.21.15.6:0/2136575667 wait complete. 2023-07-21T22:57:34.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.976+0000 7fd335b37640 1 Processor -- start 2023-07-21T22:57:34.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.976+0000 7fd335b37640 1 -- start start 2023-07-21T22:57:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd335b37640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd33006b1e0 0x7fd3300c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd335b37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd330070b70 0x7fd3301471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd335b37640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd3300cb100 0x7fd330147730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd335b37640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33014c890 con 0x7fd330070b70 2023-07-21T22:57:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd335b37640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33014cb70 con 0x7fd33006b1e0 2023-07-21T22:57:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd335b37640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33014ce50 con 0x7fd3300cb100 2023-07-21T22:57:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd32effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd330070b70 0x7fd3301471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd32effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd330070b70 0x7fd3301471f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39068/0 (socket says 172.21.15.6:39068) 2023-07-21T22:57:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd32effd640 1 -- 172.21.15.6:0/367029625 learned_addr learned my addr 172.21.15.6:0/367029625 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd32ffff640 1 --2- 172.21.15.6:0/367029625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd3300cb100 0x7fd330147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd32f7fe640 1 --2- 172.21.15.6:0/367029625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd33006b1e0 0x7fd3300c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd32effd640 1 -- 172.21.15.6:0/367029625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd3300cb100 msgr2=0x7fd330147730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd32effd640 1 --2- 172.21.15.6:0/367029625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd3300cb100 0x7fd330147730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd32effd640 1 -- 172.21.15.6:0/367029625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd33006b1e0 msgr2=0x7fd3300c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd32effd640 1 --2- 172.21.15.6:0/367029625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd33006b1e0 0x7fd3300c2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd32effd640 1 -- 172.21.15.6:0/367029625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd328009a70 con 0x7fd330070b70 2023-07-21T22:57:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd32f7fe640 1 --2- 172.21.15.6:0/367029625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd33006b1e0 0x7fd3300c2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd32effd640 1 --2- 172.21.15.6:0/367029625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd330070b70 0x7fd3301471f0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fd3240011f0 tx=0x7fd32400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd317fff640 1 -- 172.21.15.6:0/367029625 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3240074e0 con 0x7fd330070b70 2023-07-21T22:57:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd317fff640 1 -- 172.21.15.6:0/367029625 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd324007640 con 0x7fd330070b70 2023-07-21T22:57:34.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd317fff640 1 -- 172.21.15.6:0/367029625 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd324004a10 con 0x7fd330070b70 2023-07-21T22:57:34.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd335b37640 1 -- 172.21.15.6:0/367029625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33014d130 con 0x7fd330070b70 2023-07-21T22:57:34.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.980+0000 7fd335b37640 1 -- 172.21.15.6:0/367029625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3300c3230 con 0x7fd330070b70 2023-07-21T22:57:34.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.984+0000 7fd317fff640 1 -- 172.21.15.6:0/367029625 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd324004b70 con 0x7fd330070b70 2023-07-21T22:57:34.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.984+0000 7fd317fff640 1 --2- 172.21.15.6:0/367029625 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fd31c0663a0 0x7fd31c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.984+0000 7fd317fff640 1 -- 172.21.15.6:0/367029625 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fd3240832e0 con 0x7fd330070b70 2023-07-21T22:57:34.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.984+0000 7fd32f7fe640 1 --2- 172.21.15.6:0/367029625 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fd31c0663a0 0x7fd31c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.984+0000 7fd338e95000 1 Processor -- start 2023-07-21T22:57:34.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.984+0000 7fd338e95000 1 -- start start 2023-07-21T22:57:34.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.984+0000 7fd32f7fe640 1 --2- 172.21.15.6:0/367029625 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fd31c0663a0 0x7fd31c068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd320003e40 tx=0x7fd320009040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:34.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.984+0000 7fd338e95000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25ccf00 0x55cca25cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.984+0000 7fd338e95000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25cd810 0x55cca2583370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.984+0000 7fd338e95000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25838b0 0x55cca2583c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.984+0000 7fd338e95000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca244a880 con 0x55cca25cd810 2023-07-21T22:57:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.984+0000 7fd338e95000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca2384840 con 0x55cca25ccf00 2023-07-21T22:57:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.984+0000 7fd338e95000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cca23d82e0 con 0x55cca25838b0 2023-07-21T22:57:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.984+0000 7fd32effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25cd810 0x55cca2583370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.984+0000 7fd32effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25cd810 0x55cca2583370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39080/0 (socket says 172.21.15.6:39080) 2023-07-21T22:57:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.984+0000 7fd32effd640 1 -- 172.21.15.6:0/2084013959 learned_addr learned my addr 172.21.15.6:0/2084013959 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:34.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.984+0000 7fd32f7fe640 1 --2- 172.21.15.6:0/2084013959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25ccf00 0x55cca25cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.984+0000 7fd32ffff640 1 --2- 172.21.15.6:0/2084013959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25838b0 0x55cca2583c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd32effd640 1 -- 172.21.15.6:0/2084013959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25838b0 msgr2=0x55cca2583c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:34.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd32effd640 1 --2- 172.21.15.6:0/2084013959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25838b0 0x55cca2583c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd32effd640 1 -- 172.21.15.6:0/2084013959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25ccf00 msgr2=0x55cca25cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:34.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd32effd640 1 --2- 172.21.15.6:0/2084013959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25ccf00 0x55cca25cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd32effd640 1 -- 172.21.15.6:0/2084013959 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cca20cd890 con 0x55cca25cd810 2023-07-21T22:57:34.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd32effd640 1 --2- 172.21.15.6:0/2084013959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25cd810 0x55cca2583370 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fd324001130 tx=0x7fd324054090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d517ce6647838833 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:34.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd3157fa640 1 -- 172.21.15.6:0/2084013959 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd324052390 con 0x55cca25cd810 2023-07-21T22:57:34.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd3157fa640 1 -- 172.21.15.6:0/2084013959 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3240815b0 con 0x55cca25cd810 2023-07-21T22:57:34.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd3157fa640 1 -- 172.21.15.6:0/2084013959 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd324081720 con 0x55cca25cd810 2023-07-21T22:57:34.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd338e95000 1 -- 172.21.15.6:0/2084013959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25cd810 msgr2=0x55cca2583370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:34.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd338e95000 1 --2- 172.21.15.6:0/2084013959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25cd810 0x55cca2583370 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fd324001130 tx=0x7fd324054090 comp rx=0 tx=0).stop 2023-07-21T22:57:34.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd338e95000 1 -- 172.21.15.6:0/2084013959 shutdown_connections 2023-07-21T22:57:34.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd338e95000 1 --2- 172.21.15.6:0/2084013959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25838b0 0x55cca2583c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd338e95000 1 --2- 172.21.15.6:0/2084013959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25cd810 0x55cca2583370 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd338e95000 1 --2- 172.21.15.6:0/2084013959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25ccf00 0x55cca25cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd338e95000 1 -- 172.21.15.6:0/2084013959 >> 172.21.15.6:0/2084013959 conn(0x55cca2589a10 msgr2=0x55cca2581c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:34.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd338e95000 1 -- 172.21.15.6:0/2084013959 shutdown_connections 2023-07-21T22:57:34.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd338e95000 1 -- 172.21.15.6:0/2084013959 wait complete. 2023-07-21T22:57:34.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd338e95000 1 -- start start 2023-07-21T22:57:34.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd338e95000 1 Processor -- start 2023-07-21T22:57:34.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd338e95000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25838b0 0x55cca25d8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd338e95000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25ccf00 0x55cca25d87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd338e95000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25cd810 0x55cca2592900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd338e95000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca23d1380 con 0x55cca25838b0 2023-07-21T22:57:34.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd338e95000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca238dae0 con 0x55cca25cd810 2023-07-21T22:57:34.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd338e95000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cca238d780 con 0x55cca25ccf00 2023-07-21T22:57:34.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd338e95000 10 client.0 _ll_register_callbacks cb 0x55cca256f240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:57:34.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd32f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25838b0 0x55cca25d8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd32f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25838b0 0x55cca25d8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39096/0 (socket says 172.21.15.6:39096) 2023-07-21T22:57:34.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.988+0000 7fd32f7fe640 1 -- 172.21.15.6:0/1368984804 learned_addr learned my addr 172.21.15.6:0/1368984804 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:34.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd32effd640 1 --2- 172.21.15.6:0/1368984804 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25ccf00 0x55cca25d87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd32ffff640 1 --2- 172.21.15.6:0/1368984804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25cd810 0x55cca2592900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd32f7fe640 1 -- 172.21.15.6:0/1368984804 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25ccf00 msgr2=0x55cca25d87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:34.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd32f7fe640 1 --2- 172.21.15.6:0/1368984804 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25ccf00 0x55cca25d87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd32f7fe640 1 -- 172.21.15.6:0/1368984804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25cd810 msgr2=0x55cca2592900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:34.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd32f7fe640 1 --2- 172.21.15.6:0/1368984804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25cd810 0x55cca2592900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd32f7fe640 1 -- 172.21.15.6:0/1368984804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3300c3230 con 0x55cca25838b0 2023-07-21T22:57:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd32effd640 1 --2- 172.21.15.6:0/1368984804 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25ccf00 0x55cca25d87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd32f7fe640 1 --2- 172.21.15.6:0/1368984804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25838b0 0x55cca25d8280 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fd320003c20 tx=0x7fd320003770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d89547c0feee3e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd30e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:57:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd30e7fc640 1 -- 172.21.15.6:0/1368984804 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd320014e30 con 0x55cca25838b0 2023-07-21T22:57:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 1 -- 172.21.15.6:0/1368984804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cca2398a20 con 0x55cca25838b0 2023-07-21T22:57:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd30e7fc640 1 -- 172.21.15.6:0/1368984804 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fd320020600 con 0x55cca25838b0 2023-07-21T22:57:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd30e7fc640 1 -- 172.21.15.6:0/1368984804 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3200207c0 con 0x55cca25838b0 2023-07-21T22:57:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 10 client.10677 fetch_fsmap learned FSMap version 86 2023-07-21T22:57:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 1 -- 172.21.15.6:0/1368984804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) v3 -- 0x55cca2395d10 con 0x55cca25838b0 2023-07-21T22:57:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd30e7fc640 1 -- 172.21.15.6:0/1368984804 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cca2398a20 con 0x55cca25838b0 2023-07-21T22:57:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd30e7fc640 1 -- 172.21.15.6:0/1368984804 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 86) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd32001f070 con 0x55cca25838b0 2023-07-21T22:57:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 10 client.10677 fetch_fsmap finished waiting for FSMap version 86 2023-07-21T22:57:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 10 client.10677 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-21T22:57:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 20 client.10677 populate_metadata read hostname 'smithi006' 2023-07-21T22:57:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 1 --2- 172.21.15.6:0/1368984804 >> [v2:172.21.15.6:6833/963904366,v1:172.21.15.6:6835/963904366] conn(0x55cca25936a0 0x55cca2593a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 4 client.10677 mds_command: new command op to 10506 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:57:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 1 -- 172.21.15.6:0/1368984804 --> [v2:172.21.15.6:6833/963904366,v1:172.21.15.6:6835/963904366] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cca23ffec0 con 0x55cca25936a0 2023-07-21T22:57:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd32effd640 1 --2- 172.21.15.6:0/1368984804 >> [v2:172.21.15.6:6833/963904366,v1:172.21.15.6:6835/963904366] conn(0x55cca25936a0 0x55cca2593a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd32effd640 1 --2- 172.21.15.6:0/1368984804 >> [v2:172.21.15.6:6833/963904366,v1:172.21.15.6:6835/963904366] conn(0x55cca25936a0 0x55cca2593a70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fba55b685bbdb49 server_cookie=8253063b28324f47 in_seq=0 out_seq=0 2023-07-21T22:57:34.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd30e7fc640 10 client.10677 ms_handle_connect on v2:172.21.15.6:6833/963904366 2023-07-21T22:57:34.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd30e7fc640 1 -- 172.21.15.6:0/1368984804 <== mds.0 v2:172.21.15.6:6833/963904366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55cca23ffec0 con 0x55cca25936a0 2023-07-21T22:57:34.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd30e7fc640 10 client.10677 handle_command_reply: tid=0 2023-07-21T22:57:34.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 1 client.10677 shutdown 2023-07-21T22:57:34.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 1 -- 172.21.15.6:0/1368984804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25838b0 msgr2=0x55cca25d8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:34.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 1 --2- 172.21.15.6:0/1368984804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25838b0 0x55cca25d8280 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fd320003c20 tx=0x7fd320003770 comp rx=0 tx=0).stop 2023-07-21T22:57:34.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 1 -- 172.21.15.6:0/1368984804 shutdown_connections 2023-07-21T22:57:34.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 1 --2- 172.21.15.6:0/1368984804 >> [v2:172.21.15.6:6833/963904366,v1:172.21.15.6:6835/963904366] conn(0x55cca25936a0 0x55cca2593a70 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 1 --2- 172.21.15.6:0/1368984804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25cd810 0x55cca2592900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 1 --2- 172.21.15.6:0/1368984804 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25ccf00 0x55cca25d87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd30e7fc640 0 client.10677 ms_handle_reset on v2:172.21.15.6:6833/963904366 2023-07-21T22:57:34.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 1 --2- 172.21.15.6:0/1368984804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25838b0 0x55cca25d8280 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 1 -- 172.21.15.6:0/1368984804 >> 172.21.15.6:0/1368984804 conn(0x55cca2589a10 msgr2=0x55cca2582350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:34.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 1 -- 172.21.15.6:0/1368984804 shutdown_connections 2023-07-21T22:57:34.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 1 -- 172.21.15.6:0/1368984804 wait complete. 2023-07-21T22:57:34.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:33.992+0000 7fd338e95000 20 client.10677 trim_cache size 0 max 16384 2023-07-21T22:57:34.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.008+0000 7fd338e95000 1 Processor -- start 2023-07-21T22:57:34.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.008+0000 7fd338e95000 1 -- start start 2023-07-21T22:57:34.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd338e95000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25838b0 0x55cca25e7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd338e95000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25ccf00 0x55cca25e23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd338e95000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25cd810 0x55cca25e2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd338e95000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca208e940 con 0x55cca25ccf00 2023-07-21T22:57:34.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd338e95000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca239d340 con 0x55cca25cd810 2023-07-21T22:57:34.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd338e95000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cca238f670 con 0x55cca25838b0 2023-07-21T22:57:34.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd32effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25ccf00 0x55cca25e23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd32f7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25838b0 0x55cca25e7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd32effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25ccf00 0x55cca25e23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39108/0 (socket says 172.21.15.6:39108) 2023-07-21T22:57:34.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd32effd640 1 -- 172.21.15.6:0/3776666916 learned_addr learned my addr 172.21.15.6:0/3776666916 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:34.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd32ffff640 1 --2- 172.21.15.6:0/3776666916 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25cd810 0x55cca25e2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd32effd640 1 -- 172.21.15.6:0/3776666916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25838b0 msgr2=0x55cca25e7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:34.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd32effd640 1 --2- 172.21.15.6:0/3776666916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25838b0 0x55cca25e7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd32effd640 1 -- 172.21.15.6:0/3776666916 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25cd810 msgr2=0x55cca25e2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:34.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd32effd640 1 --2- 172.21.15.6:0/3776666916 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25cd810 0x55cca25e2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd32effd640 1 -- 172.21.15.6:0/3776666916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cca2585f80 con 0x55cca25ccf00 2023-07-21T22:57:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd32effd640 1 --2- 172.21.15.6:0/3776666916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25ccf00 0x55cca25e23f0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fd32405c730 tx=0x7fd324083000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234348ec9fc4c155 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd315ffb640 1 -- 172.21.15.6:0/3776666916 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd324052630 con 0x55cca25ccf00 2023-07-21T22:57:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd315ffb640 1 -- 172.21.15.6:0/3776666916 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd324081520 con 0x55cca25ccf00 2023-07-21T22:57:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd315ffb640 1 -- 172.21.15.6:0/3776666916 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32404ff80 con 0x55cca25ccf00 2023-07-21T22:57:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd338e95000 1 -- 172.21.15.6:0/3776666916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25ccf00 msgr2=0x55cca25e23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd338e95000 1 --2- 172.21.15.6:0/3776666916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25ccf00 0x55cca25e23f0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fd32405c730 tx=0x7fd324083000 comp rx=0 tx=0).stop 2023-07-21T22:57:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd338e95000 1 -- 172.21.15.6:0/3776666916 shutdown_connections 2023-07-21T22:57:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd338e95000 1 --2- 172.21.15.6:0/3776666916 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25cd810 0x55cca25e2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd338e95000 1 --2- 172.21.15.6:0/3776666916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25ccf00 0x55cca25e23f0 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd338e95000 1 --2- 172.21.15.6:0/3776666916 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25838b0 0x55cca25e7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd338e95000 1 -- 172.21.15.6:0/3776666916 >> 172.21.15.6:0/3776666916 conn(0x55cca2589a10 msgr2=0x55cca25887f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd338e95000 1 -- 172.21.15.6:0/3776666916 shutdown_connections 2023-07-21T22:57:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd338e95000 1 -- 172.21.15.6:0/3776666916 wait complete. 2023-07-21T22:57:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd338e95000 1 -- start start 2023-07-21T22:57:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.012+0000 7fd338e95000 1 Processor -- start 2023-07-21T22:57:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25838b0 0x55cca25e5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25ccf00 0x55cca25e60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25cd810 0x55cca25ec310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca2414580 con 0x55cca25838b0 2023-07-21T22:57:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cca25833d0 con 0x55cca25cd810 2023-07-21T22:57:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cca2393540 con 0x55cca25ccf00 2023-07-21T22:57:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 10 client.0 _ll_register_callbacks cb 0x55cca254f430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:57:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd32f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25838b0 0x55cca25e5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd32f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25838b0 0x55cca25e5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39118/0 (socket says 172.21.15.6:39118) 2023-07-21T22:57:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd32f7fe640 1 -- 172.21.15.6:0/3442024041 learned_addr learned my addr 172.21.15.6:0/3442024041 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd32effd640 1 --2- 172.21.15.6:0/3442024041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25ccf00 0x55cca25e60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd32ffff640 1 --2- 172.21.15.6:0/3442024041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25cd810 0x55cca25ec310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd32f7fe640 1 -- 172.21.15.6:0/3442024041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25ccf00 msgr2=0x55cca25e60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd32f7fe640 1 --2- 172.21.15.6:0/3442024041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25ccf00 0x55cca25e60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd32f7fe640 1 -- 172.21.15.6:0/3442024041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25cd810 msgr2=0x55cca25ec310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:34.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd32f7fe640 1 --2- 172.21.15.6:0/3442024041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25cd810 0x55cca25ec310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd32f7fe640 1 -- 172.21.15.6:0/3442024041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cca20cd890 con 0x55cca25838b0 2023-07-21T22:57:34.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd32ffff640 1 --2- 172.21.15.6:0/3442024041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25cd810 0x55cca25ec310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:34.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd32f7fe640 1 --2- 172.21.15.6:0/3442024041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25838b0 0x55cca25e5b60 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fd3200208b0 tx=0x7fd320020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1761d58b528e7676 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:34.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd30e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-21T22:57:34.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd30e7fc640 1 -- 172.21.15.6:0/3442024041 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd320029800 con 0x55cca25838b0 2023-07-21T22:57:34.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 -- 172.21.15.6:0/3442024041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cca23cfcd0 con 0x55cca25838b0 2023-07-21T22:57:34.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd30e7fc640 1 -- 172.21.15.6:0/3442024041 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fd320029960 con 0x55cca25838b0 2023-07-21T22:57:34.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd30e7fc640 1 -- 172.21.15.6:0/3442024041 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3200323f0 con 0x55cca25838b0 2023-07-21T22:57:34.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 10 client.10683 fetch_fsmap learned FSMap version 86 2023-07-21T22:57:34.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 -- 172.21.15.6:0/3442024041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=2+}) v3 -- 0x55cca237bfa0 con 0x55cca25838b0 2023-07-21T22:57:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd30e7fc640 1 -- 172.21.15.6:0/3442024041 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cca23cfcd0 con 0x55cca25838b0 2023-07-21T22:57:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd30e7fc640 1 -- 172.21.15.6:0/3442024041 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 86) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd32003d430 con 0x55cca25838b0 2023-07-21T22:57:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 10 client.10683 fetch_fsmap finished waiting for FSMap version 86 2023-07-21T22:57:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 10 client.10683 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-21T22:57:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 20 client.10683 populate_metadata read hostname 'smithi006' 2023-07-21T22:57:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 --2- 172.21.15.6:0/3442024041 >> [v2:172.21.15.6:6833/963904366,v1:172.21.15.6:6835/963904366] conn(0x55cca25ec850 0x55cca25ecc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 4 client.10683 mds_command: new command op to 10506 tid=0[{"prefix": "status"}] 2023-07-21T22:57:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 -- 172.21.15.6:0/3442024041 --> [v2:172.21.15.6:6833/963904366,v1:172.21.15.6:6835/963904366] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cca23ca360 con 0x55cca25ec850 2023-07-21T22:57:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd32effd640 1 --2- 172.21.15.6:0/3442024041 >> [v2:172.21.15.6:6833/963904366,v1:172.21.15.6:6835/963904366] conn(0x55cca25ec850 0x55cca25ecc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd30e7fc640 10 client.10683 ms_handle_connect on v2:172.21.15.6:6833/963904366 2023-07-21T22:57:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd32effd640 1 --2- 172.21.15.6:0/3442024041 >> [v2:172.21.15.6:6833/963904366,v1:172.21.15.6:6835/963904366] conn(0x55cca25ec850 0x55cca25ecc20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ff4d3e8653799ea server_cookie=c9b9105302dc9066 in_seq=0 out_seq=0 2023-07-21T22:57:34.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd30e7fc640 1 -- 172.21.15.6:0/3442024041 <== mds.0 v2:172.21.15.6:6833/963904366 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x55cca23ca360 con 0x55cca25ec850 2023-07-21T22:57:34.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd30e7fc640 10 client.10683 handle_command_reply: tid=0 2023-07-21T22:57:34.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 client.10683 shutdown 2023-07-21T22:57:34.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 -- 172.21.15.6:0/3442024041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25838b0 msgr2=0x55cca25e5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:34.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 --2- 172.21.15.6:0/3442024041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25838b0 0x55cca25e5b60 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7fd3200208b0 tx=0x7fd320020000 comp rx=0 tx=0).stop 2023-07-21T22:57:34.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 -- 172.21.15.6:0/3442024041 shutdown_connections 2023-07-21T22:57:34.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 --2- 172.21.15.6:0/3442024041 >> [v2:172.21.15.6:6833/963904366,v1:172.21.15.6:6835/963904366] conn(0x55cca25ec850 0x55cca25ecc20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 --2- 172.21.15.6:0/3442024041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55cca25cd810 0x55cca25ec310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 --2- 172.21.15.6:0/3442024041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55cca25ccf00 0x55cca25e60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd30e7fc640 0 client.10683 ms_handle_reset on v2:172.21.15.6:6833/963904366 2023-07-21T22:57:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 --2- 172.21.15.6:0/3442024041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cca25838b0 0x55cca25e5b60 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 -- 172.21.15.6:0/3442024041 >> 172.21.15.6:0/3442024041 conn(0x55cca2589a10 msgr2=0x55cca2588ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 -- 172.21.15.6:0/3442024041 shutdown_connections 2023-07-21T22:57:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 1 -- 172.21.15.6:0/3442024041 wait complete. 2023-07-21T22:57:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.016+0000 7fd338e95000 20 client.10683 trim_cache size 0 max 16384 2023-07-21T22:57:34.067 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:57:34.068 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "f3073df4-6cd1-4503-bd2e-d3e98fa18bdf", 2023-07-21T22:57:34.068 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-07-21T22:57:34.068 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 10506, 2023-07-21T22:57:34.068 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-07-21T22:57:34.068 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-07-21T22:57:34.069 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-07-21T22:57:34.069 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.519687669, 2023-07-21T22:57:34.069 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 86, 2023-07-21T22:57:34.069 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 192, 2023-07-21T22:57:34.069 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 192, 2023-07-21T22:57:34.069 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 16.438361913000001 2023-07-21T22:57:34.070 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:57:34.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.020+0000 7fd335b37640 1 -- 172.21.15.6:0/367029625 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fd31c0663a0 msgr2=0x7fd31c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:34.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.020+0000 7fd335b37640 1 --2- 172.21.15.6:0/367029625 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fd31c0663a0 0x7fd31c068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd320003e40 tx=0x7fd320009040 comp rx=0 tx=0).stop 2023-07-21T22:57:34.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.020+0000 7fd335b37640 1 -- 172.21.15.6:0/367029625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd330070b70 msgr2=0x7fd3301471f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:34.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.020+0000 7fd335b37640 1 --2- 172.21.15.6:0/367029625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd330070b70 0x7fd3301471f0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fd3240011f0 tx=0x7fd32400c9b0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.020+0000 7fd335b37640 1 -- 172.21.15.6:0/367029625 shutdown_connections 2023-07-21T22:57:34.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.020+0000 7fd335b37640 1 --2- 172.21.15.6:0/367029625 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fd31c0663a0 0x7fd31c068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.020+0000 7fd335b37640 1 --2- 172.21.15.6:0/367029625 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd3300cb100 0x7fd330147730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.020+0000 7fd335b37640 1 --2- 172.21.15.6:0/367029625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd330070b70 0x7fd3301471f0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.020+0000 7fd335b37640 1 --2- 172.21.15.6:0/367029625 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd33006b1e0 0x7fd3300c2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.020+0000 7fd335b37640 1 -- 172.21.15.6:0/367029625 >> 172.21.15.6:0/367029625 conn(0x7fd3300afcf0 msgr2=0x7fd330154f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:34.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.020+0000 7fd335b37640 1 -- 172.21.15.6:0/367029625 shutdown_connections 2023-07-21T22:57:34.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.020+0000 7fd335b37640 1 -- 172.21.15.6:0/367029625 wait complete. 2023-07-21T22:57:34.075 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-21T22:57:34.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.184+0000 7f28b98cb640 1 Processor -- start 2023-07-21T22:57:34.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.184+0000 7f28b98cb640 1 -- start start 2023-07-21T22:57:34.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.184+0000 7f28b98cb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f28b406b8f0 0x7f28b4162e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.184+0000 7f28b98cb640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b406f900 con 0x7f28b40cb780 2023-07-21T22:57:34.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.184+0000 7f28b98cb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b415bb90 con 0x7f28b415b7c0 2023-07-21T22:57:34.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.184+0000 7f28b98cb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b40cdce0 con 0x7f28b406b8f0 2023-07-21T22:57:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.184+0000 7f28abfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f28b40cb780 0x7f28b40cbd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58280/0 (socket says 172.21.15.6:58280) 2023-07-21T22:57:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.184+0000 7f28abfff640 1 -- 172.21.15.6:0/3945084687 learned_addr learned my addr 172.21.15.6:0/3945084687 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:34.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.184+0000 7f28b37fe640 1 --2- 172.21.15.6:0/3945084687 >> v2:172.21.15.161:3300/0 conn(0x7f28b406b8f0 0x7f28b4162e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b27fc640 1 -- 172.21.15.6:0/3945084687 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972424653 0 0) 0x7f28b406f900 con 0x7f28b40cb780 2023-07-21T22:57:34.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b27fc640 1 -- 172.21.15.6:0/3945084687 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28a0003530 con 0x7f28b40cb780 2023-07-21T22:57:34.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b27fc640 1 -- 172.21.15.6:0/3945084687 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62297231 0 0) 0x7f28b415bb90 con 0x7f28b415b7c0 2023-07-21T22:57:34.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b27fc640 1 -- 172.21.15.6:0/3945084687 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28b406f900 con 0x7f28b415b7c0 2023-07-21T22:57:34.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b27fc640 1 -- 172.21.15.6:0/3945084687 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 637705126 0 0) 0x7f28a0003530 con 0x7f28b40cb780 2023-07-21T22:57:34.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b27fc640 1 -- 172.21.15.6:0/3945084687 >> v2:172.21.15.161:3300/0 conn(0x7f28b406b8f0 msgr2=0x7f28b4162e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b27fc640 1 --2- 172.21.15.6:0/3945084687 >> v2:172.21.15.161:3300/0 conn(0x7f28b406b8f0 0x7f28b4162e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b27fc640 1 -- 172.21.15.6:0/3945084687 >> v1:172.21.15.161:6789/0 conn(0x7f28b415b7c0 legacy=0x7f28b406b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b27fc640 1 -- 172.21.15.6:0/3945084687 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b40cd450 con 0x7f28b40cb780 2023-07-21T22:57:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b27fc640 1 -- 172.21.15.6:0/3945084687 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f289c001680 con 0x7f28b40cb780 2023-07-21T22:57:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b37fe640 1 --2- 172.21.15.6:0/3945084687 >> v2:172.21.15.161:3300/0 conn(0x7f28b406b8f0 0x7f28b4162e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b27fc640 1 -- 172.21.15.6:0/3945084687 >> v1:172.21.15.6:6789/0 conn(0x7f28b40cb780 legacy=0x7f28b40cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b27fc640 1 --2- 172.21.15.6:0/3945084687 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28a0003b10 0x7f28a0003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b27fc640 1 --2- 172.21.15.6:0/3945084687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28a00047d0 0x7f28a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b27fc640 1 --2- 172.21.15.6:0/3945084687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a0005180 0x7f28a000dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b27fc640 1 -- 172.21.15.6:0/3945084687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b40cdce0 con 0x7f28a00047d0 2023-07-21T22:57:34.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b27fc640 1 -- 172.21.15.6:0/3945084687 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a000e1f0 con 0x7f28a0005180 2023-07-21T22:57:34.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b27fc640 1 -- 172.21.15.6:0/3945084687 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a000e3b0 con 0x7f28a0003b10 2023-07-21T22:57:34.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28abfff640 1 --2- 172.21.15.6:0/3945084687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28a00047d0 0x7f28a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b2ffd640 1 --2- 172.21.15.6:0/3945084687 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28a0003b10 0x7f28a0003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b37fe640 1 --2- 172.21.15.6:0/3945084687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a0005180 0x7f28a000dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28abfff640 1 -- 172.21.15.6:0/3945084687 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28a0003b10 msgr2=0x7f28a0003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:34.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28abfff640 1 --2- 172.21.15.6:0/3945084687 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28a0003b10 0x7f28a0003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28abfff640 1 -- 172.21.15.6:0/3945084687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a0005180 msgr2=0x7f28a000dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:34.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28abfff640 1 --2- 172.21.15.6:0/3945084687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a0005180 0x7f28a000dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28abfff640 1 -- 172.21.15.6:0/3945084687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a0003530 con 0x7f28a00047d0 2023-07-21T22:57:34.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.188+0000 7f28b37fe640 1 -- 172.21.15.6:0/3945084687 reap_dead start 2023-07-21T22:57:34.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.192+0000 7f28abfff640 1 --2- 172.21.15.6:0/3945084687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28a00047d0 0x7f28a0004c40 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f28b40ce130 tx=0x7f289c01cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264d42439b3e5c99 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:34.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.192+0000 7f28b27fc640 1 -- 172.21.15.6:0/3945084687 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c0058e0 con 0x7f28a00047d0 2023-07-21T22:57:34.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.192+0000 7f28b27fc640 1 -- 172.21.15.6:0/3945084687 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289c005a60 con 0x7f28a00047d0 2023-07-21T22:57:34.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.192+0000 7f28b27fc640 1 -- 172.21.15.6:0/3945084687 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c005e50 con 0x7f28a00047d0 2023-07-21T22:57:34.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.192+0000 7f28b98cb640 1 -- 172.21.15.6:0/3945084687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28a00047d0 msgr2=0x7f28a0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:34.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.192+0000 7f28b98cb640 1 --2- 172.21.15.6:0/3945084687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28a00047d0 0x7f28a0004c40 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f28b40ce130 tx=0x7f289c01cb40 comp rx=0 tx=0).stop 2023-07-21T22:57:34.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.192+0000 7f28b98cb640 1 -- 172.21.15.6:0/3945084687 shutdown_connections 2023-07-21T22:57:34.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.192+0000 7f28b98cb640 1 --2- 172.21.15.6:0/3945084687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28a00047d0 0x7f28a0004c40 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.192+0000 7f28b98cb640 1 -- 172.21.15.6:0/3945084687 >> 172.21.15.6:0/3945084687 conn(0x7f28b40afcf0 msgr2=0x7f28b40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:34.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.192+0000 7f28b98cb640 1 -- 172.21.15.6:0/3945084687 shutdown_connections 2023-07-21T22:57:34.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.192+0000 7f28b98cb640 1 -- 172.21.15.6:0/3945084687 wait complete. 2023-07-21T22:57:34.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.192+0000 7f28b98cb640 1 Processor -- start 2023-07-21T22:57:34.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.192+0000 7f28b98cb640 1 -- start start 2023-07-21T22:57:34.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.192+0000 7f28b98cb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a00047d0 0x7f28b4159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.192+0000 7f28b98cb640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b40c4a40 0x7f28b40ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.192+0000 7f28b98cb640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28b40c79b0 0x7f28b4151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.192+0000 7f28b98cb640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b40af8e0 con 0x7f28b40c4a40 2023-07-21T22:57:34.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.192+0000 7f28b98cb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b40abde0 con 0x7f28a00047d0 2023-07-21T22:57:34.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.192+0000 7f28b98cb640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b40c61e0 con 0x7f28b40c79b0 2023-07-21T22:57:34.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.196+0000 7f28abfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b40c4a40 0x7f28b40ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.196+0000 7f28abfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b40c4a40 0x7f28b40ab8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39126/0 (socket says 172.21.15.6:39126) 2023-07-21T22:57:34.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.196+0000 7f28abfff640 1 -- 172.21.15.6:0/969102665 learned_addr learned my addr 172.21.15.6:0/969102665 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:34.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.196+0000 7f28b37fe640 1 --2- 172.21.15.6:0/969102665 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28b40c79b0 0x7f28b4151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.196+0000 7f28b2ffd640 1 --2- 172.21.15.6:0/969102665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a00047d0 0x7f28b4159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.196+0000 7f28abfff640 1 -- 172.21.15.6:0/969102665 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28b40c79b0 msgr2=0x7f28b4151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:34.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.196+0000 7f28abfff640 1 --2- 172.21.15.6:0/969102665 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28b40c79b0 0x7f28b4151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.196+0000 7f28abfff640 1 -- 172.21.15.6:0/969102665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a00047d0 msgr2=0x7f28b4159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:34.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.196+0000 7f28abfff640 1 --2- 172.21.15.6:0/969102665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a00047d0 0x7f28b4159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.196+0000 7f28abfff640 1 -- 172.21.15.6:0/969102665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b40c5f00 con 0x7f28b40c4a40 2023-07-21T22:57:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.196+0000 7f28abfff640 1 --2- 172.21.15.6:0/969102665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b40c4a40 0x7f28b40ab8a0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f289c0018c0 tx=0x7f28a0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.196+0000 7f28b0ff9640 1 -- 172.21.15.6:0/969102665 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c004c00 con 0x7f28b40c4a40 2023-07-21T22:57:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.196+0000 7f28b0ff9640 1 -- 172.21.15.6:0/969102665 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289c004d60 con 0x7f28b40c4a40 2023-07-21T22:57:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.196+0000 7f28b98cb640 1 -- 172.21.15.6:0/969102665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b40af8e0 con 0x7f28b40c4a40 2023-07-21T22:57:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.196+0000 7f28b0ff9640 1 -- 172.21.15.6:0/969102665 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289c007310 con 0x7f28b40c4a40 2023-07-21T22:57:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.196+0000 7f28b98cb640 1 -- 172.21.15.6:0/969102665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b40af600 con 0x7f28b40c4a40 2023-07-21T22:57:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.196+0000 7f28b98cb640 1 -- 172.21.15.6:0/969102665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b40af180 con 0x7f28b40c4a40 2023-07-21T22:57:34.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.196+0000 7f28b0ff9640 1 -- 172.21.15.6:0/969102665 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f289c007470 con 0x7f28b40c4a40 2023-07-21T22:57:34.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.200+0000 7f28b0ff9640 1 --2- 172.21.15.6:0/969102665 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f28940663a0 0x7f2894068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:34.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.200+0000 7f28b0ff9640 1 -- 172.21.15.6:0/969102665 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f28a4001d30 con 0x7f28b40c4a40 2023-07-21T22:57:34.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.200+0000 7f28b2ffd640 1 --2- 172.21.15.6:0/969102665 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f28940663a0 0x7f2894068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:34.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.200+0000 7f28b2ffd640 1 --2- 172.21.15.6:0/969102665 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f28940663a0 0x7f2894068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f28a4005630 tx=0x7f28a4009040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:34.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.204+0000 7f28b0ff9640 1 -- 172.21.15.6:0/969102665 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f28b40af180 con 0x7f28b40c4a40 2023-07-21T22:57:34.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.392+0000 7f28b98cb640 1 -- 172.21.15.6:0/969102665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f28b40af180 con 0x7f28b40c4a40 2023-07-21T22:57:34.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.392+0000 7f28b0ff9640 1 -- 172.21.15.6:0/969102665 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v86) v1 ==== 53+0+73 (secure 0 0 0) 0x7f28b40af180 con 0x7f28b40c4a40 2023-07-21T22:57:34.427 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T22:57:34.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.392+0000 7f28b98cb640 1 -- 172.21.15.6:0/969102665 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f28940663a0 msgr2=0x7f2894068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:34.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.392+0000 7f28b98cb640 1 --2- 172.21.15.6:0/969102665 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f28940663a0 0x7f2894068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f28a4005630 tx=0x7f28a4009040 comp rx=0 tx=0).stop 2023-07-21T22:57:34.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.392+0000 7f28b98cb640 1 -- 172.21.15.6:0/969102665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b40c4a40 msgr2=0x7f28b40ab8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:34.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.392+0000 7f28b98cb640 1 --2- 172.21.15.6:0/969102665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b40c4a40 0x7f28b40ab8a0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f289c0018c0 tx=0x7f28a0005800 comp rx=0 tx=0).stop 2023-07-21T22:57:34.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.392+0000 7f28b98cb640 1 -- 172.21.15.6:0/969102665 shutdown_connections 2023-07-21T22:57:34.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.392+0000 7f28b98cb640 1 --2- 172.21.15.6:0/969102665 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f28940663a0 0x7f2894068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.392+0000 7f28b98cb640 1 --2- 172.21.15.6:0/969102665 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28b40c79b0 0x7f28b4151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.392+0000 7f28b98cb640 1 --2- 172.21.15.6:0/969102665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b40c4a40 0x7f28b40ab8a0 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.392+0000 7f28b98cb640 1 --2- 172.21.15.6:0/969102665 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a00047d0 0x7f28b4159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:34.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.392+0000 7f28b98cb640 1 -- 172.21.15.6:0/969102665 >> 172.21.15.6:0/969102665 conn(0x7f28b40afcf0 msgr2=0x7f28b40cc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:34.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.392+0000 7f28b98cb640 1 -- 172.21.15.6:0/969102665 shutdown_connections 2023-07-21T22:57:34.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:34.392+0000 7f28b98cb640 1 -- 172.21.15.6:0/969102665 wait complete. 2023-07-21T22:57:34.447 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-21T22:57:34.448 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:57:34.448 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-07-21T22:57:34.449 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T22:57:34.449 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-21T22:57:34.449 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-21T22:57:34.449 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-21T22:57:34.450 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:57:34.450 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:57:34.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:34.451 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-07-21T22:57:34.463 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:57:34.463 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:57:34.463 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:57:34.464 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:57:34.464 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-21T22:57:34.464 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:57:34.464 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:57:34.464 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:57:34.464 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2023-07-21T22:57:34.464 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:57:34.465 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:57:34.465 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2023-07-21T22:57:34.465 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:57:34.465 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:57:34.465 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2023-07-21T22:57:34.465 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-21T22:57:34.465 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 39791sec preferred_lft 39791sec 2023-07-21T22:57:34.465 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-07-21T22:57:34.466 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:57:34.466 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-21T22:57:34.466 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:57:34.466 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2023-07-21T22:57:34.466 INFO:teuthology.orchestra.run.smithi006.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-21T22:57:34.466 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 02:42:2f:9a:3d:15 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:57:34.467 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-21T22:57:34.467 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:57:34.467 INFO:teuthology.orchestra.run.smithi006.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-21T22:57:34.467 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-21T22:57:34.467 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-21T22:57:34.467 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:57:34.467 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-21T22:57:34.468 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:57:34.468 INFO:teuthology.orchestra.run.smithi006.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:57:34.468 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:57:34.468 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-21T22:57:34.468 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:57:34.468 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-21T22:57:34.468 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T22:57:34.469 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-21T22:57:34.469 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:57:34.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:34.470 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:57:34.525 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-07-21T22:57:34.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:34.527 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-07-21T22:57:34.578 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-07-21T22:57:34.579 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:57:34.579 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-21T22:57:34.579 INFO:teuthology.orchestra.run.smithi006.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-21T22:57:34.579 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-21T22:57:34.579 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:57:34.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:34.580 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-21T22:57:34.580 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-21T22:57:34.581 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-21T22:57:34.581 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-21T22:57:34.581 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-21T22:57:34.582 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-21T22:57:34.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:34.675 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T22:57:34.686 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-21T22:57:34.687 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T22:57:34.687 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:57:34.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:34.689 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-07-21T22:57:34.751 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:57:34.751 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-21T22:57:34.806 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-21T22:57:34.807 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:57:34.807 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:57:34.857 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-21T22:57:34.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:34.858 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:57:34.954 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:57:34.954 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:57:34.955 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:57:34.969 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:57:34.970 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:57:34.970 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:57:34.970 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:57:34.970 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:57:34.978 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-21T22:57:34.978 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-21T22:57:34.978 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-21T22:57:34.978 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-07-21T22:57:34.978 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-21T22:57:34.978 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-07-21T22:57:34.979 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-07-21T22:57:34.979 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f3073df4-6cd1-4503-bd2e-d3e98fa18bdf" will pass to kernel 2023-07-21T22:57:34.981 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-21T22:57:34.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:34.982 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-21T22:57:35.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:35.005 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-21T22:57:35.061 INFO:teuthology.orchestra.run.smithi006.stdout:client8873 2023-07-21T22:57:35.062 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:57:35.062 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:57:35.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-21T22:57:35.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.268+0000 7f143065c640 1 Processor -- start 2023-07-21T22:57:35.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.272+0000 7f143065c640 1 -- start start 2023-07-21T22:57:35.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.272+0000 7f143065c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1428070b70 0x7f1428070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:35.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.272+0000 7f143065c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f14280cb100 0x7f14280cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:35.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.272+0000 7f143065c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14280cbac0 con 0x7f142806b1e0 2023-07-21T22:57:35.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.272+0000 7f143065c640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14280cac70 con 0x7f14280cb100 2023-07-21T22:57:35.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.272+0000 7f143065c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1428071480 con 0x7f1428070b70 2023-07-21T22:57:35.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.272+0000 7f142ebf9640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f14280cb100 0x7f14280cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:35.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.272+0000 7f142dbf7640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f142806b1e0 0x7f14280c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58288/0 (socket says 172.21.15.6:58288) 2023-07-21T22:57:35.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.272+0000 7f142dbf7640 1 -- 172.21.15.6:0/562688758 learned_addr learned my addr 172.21.15.6:0/562688758 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:35.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.272+0000 7f142e3f8640 1 --2- 172.21.15.6:0/562688758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1428070b70 0x7f1428070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:35.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.272+0000 7f142ebf9640 1 -- 172.21.15.6:0/562688758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1428070b70 msgr2=0x7f1428070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:35.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.272+0000 7f142ebf9640 1 --2- 172.21.15.6:0/562688758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1428070b70 0x7f1428070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:35.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.272+0000 7f142ebf9640 1 -- 172.21.15.6:0/562688758 >> v1:172.21.15.6:6789/0 conn(0x7f142806b1e0 legacy=0x7f14280c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:35.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.272+0000 7f142ebf9640 1 -- 172.21.15.6:0/562688758 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14280ca060 con 0x7f14280cb100 2023-07-21T22:57:35.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.272+0000 7f142e3f8640 1 --2- 172.21.15.6:0/562688758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1428070b70 0x7f1428070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:35.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.276+0000 7f142ebf9640 1 --2- 172.21.15.6:0/562688758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14280cb100 0x7f14280cb580 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f1420009d90 tx=0x7f142001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eda2ebc30fd704b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:35.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.276+0000 7f142d3f6640 1 -- 172.21.15.6:0/562688758 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14200a5950 con 0x7f14280cb100 2023-07-21T22:57:35.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.276+0000 7f142d3f6640 1 -- 172.21.15.6:0/562688758 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14200a5ab0 con 0x7f14280cb100 2023-07-21T22:57:35.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.276+0000 7f142d3f6640 1 -- 172.21.15.6:0/562688758 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14200a5e40 con 0x7f14280cb100 2023-07-21T22:57:35.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.276+0000 7f143065c640 1 -- 172.21.15.6:0/562688758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14280cb100 msgr2=0x7f14280cb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:35.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.276+0000 7f143065c640 1 --2- 172.21.15.6:0/562688758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14280cb100 0x7f14280cb580 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f1420009d90 tx=0x7f142001c890 comp rx=0 tx=0).stop 2023-07-21T22:57:35.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.276+0000 7f143065c640 1 -- 172.21.15.6:0/562688758 shutdown_connections 2023-07-21T22:57:35.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.276+0000 7f143065c640 1 --2- 172.21.15.6:0/562688758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14280cb100 0x7f14280cb580 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:35.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.276+0000 7f143065c640 1 --2- 172.21.15.6:0/562688758 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1428070b70 0x7f1428070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:35.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.276+0000 7f143065c640 1 -- 172.21.15.6:0/562688758 >> 172.21.15.6:0/562688758 conn(0x7f14280afcf0 msgr2=0x7f14280b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:35.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.276+0000 7f143065c640 1 -- 172.21.15.6:0/562688758 shutdown_connections 2023-07-21T22:57:35.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.276+0000 7f143065c640 1 -- 172.21.15.6:0/562688758 wait complete. 2023-07-21T22:57:35.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.276+0000 7f143065c640 1 Processor -- start 2023-07-21T22:57:35.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f143065c640 1 -- start start 2023-07-21T22:57:35.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f143065c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f142806b1e0 0x7f1428151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:35.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f143065c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1428070b70 0x7f1428158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:35.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f143065c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14280cb100 0x7f142814fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:35.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f143065c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14281580f0 con 0x7f14280cb100 2023-07-21T22:57:35.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f143065c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14281574e0 con 0x7f1428070b70 2023-07-21T22:57:35.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f143065c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14281577c0 con 0x7f142806b1e0 2023-07-21T22:57:35.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f142ebf9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14280cb100 0x7f142814fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:35.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f142ebf9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14280cb100 0x7f142814fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39144/0 (socket says 172.21.15.6:39144) 2023-07-21T22:57:35.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f142ebf9640 1 -- 172.21.15.6:0/122428388 learned_addr learned my addr 172.21.15.6:0/122428388 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:35.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f142e3f8640 1 --2- 172.21.15.6:0/122428388 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f142806b1e0 0x7f1428151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:35.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f142dbf7640 1 --2- 172.21.15.6:0/122428388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1428070b70 0x7f1428158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:35.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f142ebf9640 1 -- 172.21.15.6:0/122428388 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f142806b1e0 msgr2=0x7f1428151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:35.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f142ebf9640 1 --2- 172.21.15.6:0/122428388 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f142806b1e0 0x7f1428151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:35.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f142ebf9640 1 -- 172.21.15.6:0/122428388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1428070b70 msgr2=0x7f1428158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:35.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f142ebf9640 1 --2- 172.21.15.6:0/122428388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1428070b70 0x7f1428158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:35.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f142ebf9640 1 -- 172.21.15.6:0/122428388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1420009a70 con 0x7f14280cb100 2023-07-21T22:57:35.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f142e3f8640 1 --2- 172.21.15.6:0/122428388 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f142806b1e0 0x7f1428151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f142dbf7640 1 --2- 172.21.15.6:0/122428388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1428070b70 0x7f1428158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f142ebf9640 1 --2- 172.21.15.6:0/122428388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14280cb100 0x7f142814fee0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f142001af40 tx=0x7f1420019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f141effd640 1 -- 172.21.15.6:0/122428388 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14200addc0 con 0x7f14280cb100 2023-07-21T22:57:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f141effd640 1 -- 172.21.15.6:0/122428388 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14200b9450 con 0x7f14280cb100 2023-07-21T22:57:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f141effd640 1 -- 172.21.15.6:0/122428388 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14200b97e0 con 0x7f14280cb100 2023-07-21T22:57:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f143065c640 1 -- 172.21.15.6:0/122428388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1428157aa0 con 0x7f14280cb100 2023-07-21T22:57:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f143065c640 1 -- 172.21.15.6:0/122428388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1428158ac0 con 0x7f14280cb100 2023-07-21T22:57:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.280+0000 7f143065c640 1 -- 172.21.15.6:0/122428388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14280678d0 con 0x7f14280cb100 2023-07-21T22:57:35.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.284+0000 7f141effd640 1 -- 172.21.15.6:0/122428388 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f14200b9940 con 0x7f14280cb100 2023-07-21T22:57:35.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.284+0000 7f141effd640 1 --2- 172.21.15.6:0/122428388 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f140c0663a0 0x7f140c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:35.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.284+0000 7f141effd640 1 -- 172.21.15.6:0/122428388 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f142011f770 con 0x7f14280cb100 2023-07-21T22:57:35.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.284+0000 7f142e3f8640 1 --2- 172.21.15.6:0/122428388 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f140c0663a0 0x7f140c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:35.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.284+0000 7f142e3f8640 1 --2- 172.21.15.6:0/122428388 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f140c0663a0 0x7f140c068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1424008930 tx=0x7f1424008040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:35.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.288+0000 7f141effd640 1 -- 172.21.15.6:0/122428388 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14200ecc20 con 0x7f14280cb100 2023-07-21T22:57:35.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.464+0000 7f143065c640 1 -- 172.21.15.6:0/122428388 --> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1428157f50 con 0x7f140c0663a0 2023-07-21T22:57:35.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.468+0000 7f141effd640 1 -- 172.21.15.6:0/122428388 <== mgr.9760 v2:172.21.15.161:6832/406143921 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f142400c040 con 0x7f140c0663a0 2023-07-21T22:57:35.504 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-21T22:57:35.504 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-21T22:57:35.504 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephfs" 2023-07-21T22:57:35.504 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-21T22:57:35.504 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-21T22:57:35.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.468+0000 7f143065c640 1 -- 172.21.15.6:0/122428388 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f140c0663a0 msgr2=0x7f140c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.468+0000 7f143065c640 1 --2- 172.21.15.6:0/122428388 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f140c0663a0 0x7f140c068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1424008930 tx=0x7f1424008040 comp rx=0 tx=0).stop 2023-07-21T22:57:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.468+0000 7f143065c640 1 -- 172.21.15.6:0/122428388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14280cb100 msgr2=0x7f142814fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.468+0000 7f143065c640 1 --2- 172.21.15.6:0/122428388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14280cb100 0x7f142814fee0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f142001af40 tx=0x7f1420019630 comp rx=0 tx=0).stop 2023-07-21T22:57:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.468+0000 7f143065c640 1 -- 172.21.15.6:0/122428388 shutdown_connections 2023-07-21T22:57:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.468+0000 7f143065c640 1 --2- 172.21.15.6:0/122428388 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f140c0663a0 0x7f140c068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:35.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.468+0000 7f143065c640 1 --2- 172.21.15.6:0/122428388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14280cb100 0x7f142814fee0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:35.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.468+0000 7f143065c640 1 --2- 172.21.15.6:0/122428388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1428070b70 0x7f1428158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:35.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.468+0000 7f143065c640 1 --2- 172.21.15.6:0/122428388 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f142806b1e0 0x7f1428151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:35.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.468+0000 7f143065c640 1 -- 172.21.15.6:0/122428388 >> 172.21.15.6:0/122428388 conn(0x7f14280afcf0 msgr2=0x7f14280c3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:35.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.472+0000 7f143065c640 1 -- 172.21.15.6:0/122428388 shutdown_connections 2023-07-21T22:57:35.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.472+0000 7f143065c640 1 -- 172.21.15.6:0/122428388 wait complete. 2023-07-21T22:57:35.525 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-21T22:57:35.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.636+0000 7f4f4dcd8640 1 Processor -- start 2023-07-21T22:57:35.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.636+0000 7f4f4dcd8640 1 -- start start 2023-07-21T22:57:35.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.636+0000 7f4f4dcd8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f4806a540 0x7f4f480cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:35.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.636+0000 7f4f4dcd8640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f4806a910 0x7f4f480d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:35.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.636+0000 7f4f4dcd8640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f480cd1f0 con 0x7f4f481601f0 2023-07-21T22:57:35.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.636+0000 7f4f4dcd8640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f480cd4d0 con 0x7f4f4806a910 2023-07-21T22:57:35.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.636+0000 7f4f4dcd8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f480cd7b0 con 0x7f4f4806a540 2023-07-21T22:57:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.636+0000 7f4f47fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f4806a910 0x7f4f480d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.636+0000 7f4f46ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4f481601f0 0x7f4f480cca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58290/0 (socket says 172.21.15.6:58290) 2023-07-21T22:57:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.636+0000 7f4f46ffd640 1 -- 172.21.15.6:0/248869525 learned_addr learned my addr 172.21.15.6:0/248869525 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.636+0000 7f4f477fe640 1 --2- 172.21.15.6:0/248869525 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f4806a540 0x7f4f480cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:35.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.636+0000 7f4f47fff640 1 -- 172.21.15.6:0/248869525 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f4806a540 msgr2=0x7f4f480cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.636+0000 7f4f47fff640 1 --2- 172.21.15.6:0/248869525 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f4806a540 0x7f4f480cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.636+0000 7f4f47fff640 1 -- 172.21.15.6:0/248869525 >> v1:172.21.15.6:6789/0 conn(0x7f4f481601f0 legacy=0x7f4f480cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.636+0000 7f4f47fff640 1 -- 172.21.15.6:0/248869525 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f480cfe40 con 0x7f4f4806a910 2023-07-21T22:57:35.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.636+0000 7f4f467fc640 1 -- 172.21.15.6:0/248869525 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063047916 0 0) 0x7f4f480cd1f0 con 0x7f4f481601f0 2023-07-21T22:57:35.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.640+0000 7f4f47fff640 1 --2- 172.21.15.6:0/248869525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f4806a910 0x7f4f480d0360 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009d90 tx=0x7f4f4001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a73c885c5159a0e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:35.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.640+0000 7f4f467fc640 1 -- 172.21.15.6:0/248869525 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f400a5860 con 0x7f4f4806a910 2023-07-21T22:57:35.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.640+0000 7f4f467fc640 1 -- 172.21.15.6:0/248869525 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f400a59c0 con 0x7f4f4806a910 2023-07-21T22:57:35.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.640+0000 7f4f467fc640 1 -- 172.21.15.6:0/248869525 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f400a5d50 con 0x7f4f4806a910 2023-07-21T22:57:35.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.640+0000 7f4f4dcd8640 1 -- 172.21.15.6:0/248869525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f4806a910 msgr2=0x7f4f480d0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:35.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.640+0000 7f4f4dcd8640 1 --2- 172.21.15.6:0/248869525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f4806a910 0x7f4f480d0360 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009d90 tx=0x7f4f4001c8c0 comp rx=0 tx=0).stop 2023-07-21T22:57:35.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.640+0000 7f4f4dcd8640 1 -- 172.21.15.6:0/248869525 shutdown_connections 2023-07-21T22:57:35.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.640+0000 7f4f4dcd8640 1 --2- 172.21.15.6:0/248869525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f4806a910 0x7f4f480d0360 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:35.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.640+0000 7f4f4dcd8640 1 --2- 172.21.15.6:0/248869525 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f4806a540 0x7f4f480cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:35.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.640+0000 7f4f4dcd8640 1 -- 172.21.15.6:0/248869525 >> 172.21.15.6:0/248869525 conn(0x7f4f48099490 msgr2=0x7f4f48089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:35.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.640+0000 7f4f4dcd8640 1 -- 172.21.15.6:0/248869525 shutdown_connections 2023-07-21T22:57:35.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.640+0000 7f4f4dcd8640 1 -- 172.21.15.6:0/248869525 wait complete. 2023-07-21T22:57:35.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f4dcd8640 1 Processor -- start 2023-07-21T22:57:35.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f4dcd8640 1 -- start start 2023-07-21T22:57:35.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f4dcd8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f4806a540 0x7f4f4814df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:35.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f4dcd8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f4806a910 0x7f4f480aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:35.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f4dcd8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f481601f0 0x7f4f480accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:35.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f4dcd8640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4814e470 con 0x7f4f4806a910 2023-07-21T22:57:35.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f4dcd8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f480b4e50 con 0x7f4f4806a540 2023-07-21T22:57:35.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f4dcd8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f480af400 con 0x7f4f481601f0 2023-07-21T22:57:35.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f46ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f4806a910 0x7f4f480aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:35.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f46ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f4806a910 0x7f4f480aeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39166/0 (socket says 172.21.15.6:39166) 2023-07-21T22:57:35.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f46ffd640 1 -- 172.21.15.6:0/3960224567 learned_addr learned my addr 172.21.15.6:0/3960224567 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:35.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f477fe640 1 --2- 172.21.15.6:0/3960224567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f4806a540 0x7f4f4814df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:35.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f47fff640 1 --2- 172.21.15.6:0/3960224567 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f481601f0 0x7f4f480accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:35.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f46ffd640 1 -- 172.21.15.6:0/3960224567 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f481601f0 msgr2=0x7f4f480accf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:35.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f46ffd640 1 --2- 172.21.15.6:0/3960224567 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f481601f0 0x7f4f480accf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:35.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f46ffd640 1 -- 172.21.15.6:0/3960224567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f4806a540 msgr2=0x7f4f4814df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:35.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f46ffd640 1 --2- 172.21.15.6:0/3960224567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f4806a540 0x7f4f4814df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:35.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f46ffd640 1 -- 172.21.15.6:0/3960224567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f40009a70 con 0x7f4f4806a910 2023-07-21T22:57:35.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f47fff640 1 --2- 172.21.15.6:0/3960224567 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f481601f0 0x7f4f480accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:35.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f46ffd640 1 --2- 172.21.15.6:0/3960224567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f4806a910 0x7f4f480aeec0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c00c450 tx=0x7f4f3c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:35.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f2ffff640 1 -- 172.21.15.6:0/3960224567 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c0074e0 con 0x7f4f4806a910 2023-07-21T22:57:35.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f2ffff640 1 -- 172.21.15.6:0/3960224567 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c007640 con 0x7f4f4806a910 2023-07-21T22:57:35.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f2ffff640 1 -- 172.21.15.6:0/3960224567 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c0049f0 con 0x7f4f4806a910 2023-07-21T22:57:35.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f4dcd8640 1 -- 172.21.15.6:0/3960224567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4815dcb0 con 0x7f4f4806a910 2023-07-21T22:57:35.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.644+0000 7f4f4dcd8640 1 -- 172.21.15.6:0/3960224567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4815e270 con 0x7f4f4806a910 2023-07-21T22:57:35.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.648+0000 7f4f4dcd8640 1 -- 172.21.15.6:0/3960224567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f480678d0 con 0x7f4f4806a910 2023-07-21T22:57:35.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.648+0000 7f4f2ffff640 1 -- 172.21.15.6:0/3960224567 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4f3c004b50 con 0x7f4f4806a910 2023-07-21T22:57:35.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.648+0000 7f4f2ffff640 1 --2- 172.21.15.6:0/3960224567 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f4f340663a0 0x7f4f34068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:35.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.648+0000 7f4f2ffff640 1 -- 172.21.15.6:0/3960224567 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f4f3c083ba0 con 0x7f4f4806a910 2023-07-21T22:57:35.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.648+0000 7f4f477fe640 1 --2- 172.21.15.6:0/3960224567 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f4f340663a0 0x7f4f34068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:35.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.652+0000 7f4f477fe640 1 --2- 172.21.15.6:0/3960224567 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f4f340663a0 0x7f4f34068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4f38006fd0 tx=0x7f4f38008040 comp rx=0 tx=0).ready entity=mgr.9760 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:35.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.652+0000 7f4f2ffff640 1 -- 172.21.15.6:0/3960224567 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4f3c054940 con 0x7f4f4806a910 2023-07-21T22:57:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:35.844+0000 7f4f4dcd8640 1 -- 172.21.15.6:0/3960224567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f4f480b4f90 con 0x7f4f4806a910 2023-07-21T22:57:36.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.304+0000 7f4f2ffff640 1 -- 172.21.15.6:0/3960224567 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 91) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f4f3c051280 con 0x7f4f4806a910 2023-07-21T22:57:36.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.304+0000 7f4f2ffff640 1 -- 172.21.15.6:0/3960224567 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v91) v1 ==== 92+0+0 (secure 0 0 0) 0x7f4f3c071e00 con 0x7f4f4806a910 2023-07-21T22:57:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.304+0000 7f4f4dcd8640 1 -- 172.21.15.6:0/3960224567 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f4f340663a0 msgr2=0x7f4f34068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.304+0000 7f4f4dcd8640 1 --2- 172.21.15.6:0/3960224567 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f4f340663a0 0x7f4f34068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4f38006fd0 tx=0x7f4f38008040 comp rx=0 tx=0).stop 2023-07-21T22:57:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.304+0000 7f4f4dcd8640 1 -- 172.21.15.6:0/3960224567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f4806a910 msgr2=0x7f4f480aeec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.304+0000 7f4f4dcd8640 1 --2- 172.21.15.6:0/3960224567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f4806a910 0x7f4f480aeec0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c00c450 tx=0x7f4f3c00c910 comp rx=0 tx=0).stop 2023-07-21T22:57:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.308+0000 7f4f4dcd8640 1 -- 172.21.15.6:0/3960224567 shutdown_connections 2023-07-21T22:57:36.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.308+0000 7f4f4dcd8640 1 --2- 172.21.15.6:0/3960224567 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f4f340663a0 0x7f4f34068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.308+0000 7f4f4dcd8640 1 --2- 172.21.15.6:0/3960224567 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4f481601f0 0x7f4f480accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.308+0000 7f4f4dcd8640 1 --2- 172.21.15.6:0/3960224567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f4806a910 0x7f4f480aeec0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.308+0000 7f4f4dcd8640 1 --2- 172.21.15.6:0/3960224567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4f4806a540 0x7f4f4814df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.308+0000 7f4f4dcd8640 1 -- 172.21.15.6:0/3960224567 >> 172.21.15.6:0/3960224567 conn(0x7f4f48099490 msgr2=0x7f4f48089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.308+0000 7f4f4dcd8640 1 -- 172.21.15.6:0/3960224567 shutdown_connections 2023-07-21T22:57:36.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.308+0000 7f4f4dcd8640 1 -- 172.21.15.6:0/3960224567 wait complete. 2023-07-21T22:57:36.364 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-21T22:57:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.480+0000 7fe057937640 1 Processor -- start 2023-07-21T22:57:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.484+0000 7fe057937640 1 -- start start 2023-07-21T22:57:36.519 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:36.484+0000 7fd18d7d4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:57:36.519 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:36.490+0000 7feba5c46180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:57:36.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.484+0000 7fe057937640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe0500af2b0 0x7fe05015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:36.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.484+0000 7fe057937640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe050159d70 con 0x7fe050069430 2023-07-21T22:57:36.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.484+0000 7fe057937640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0500c9c60 con 0x7fe050070f30 2023-07-21T22:57:36.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.484+0000 7fe057937640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0500c9f40 con 0x7fe0500af2b0 2023-07-21T22:57:36.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.484+0000 7fe0556d3640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe050069430 0x7fe050069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58312/0 (socket says 172.21.15.6:58312) 2023-07-21T22:57:36.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.484+0000 7fe0556d3640 1 -- 172.21.15.6:0/2921197320 learned_addr learned my addr 172.21.15.6:0/2921197320 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:36.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.484+0000 7fe055ed4640 1 --2- 172.21.15.6:0/2921197320 >> v2:172.21.15.6:3300/0 conn(0x7fe0500af2b0 0x7fe05015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:36.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.484+0000 7fe047fff640 1 -- 172.21.15.6:0/2921197320 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 303889684 0 0) 0x7fe04c001120 con 0x7fe050069430 2023-07-21T22:57:36.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.484+0000 7fe047fff640 1 -- 172.21.15.6:0/2921197320 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe03c003530 con 0x7fe050069430 2023-07-21T22:57:36.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.484+0000 7fe047fff640 1 -- 172.21.15.6:0/2921197320 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798591416 0 0) 0x7fe0500c9c60 con 0x7fe050070f30 2023-07-21T22:57:36.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.484+0000 7fe047fff640 1 -- 172.21.15.6:0/2921197320 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe04c001120 con 0x7fe050070f30 2023-07-21T22:57:36.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.484+0000 7fe055ed4640 1 -- 172.21.15.6:0/2921197320 >> v1:172.21.15.161:6789/0 conn(0x7fe050070f30 legacy=0x7fe0500ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:36.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.484+0000 7fe055ed4640 1 -- 172.21.15.6:0/2921197320 >> v1:172.21.15.6:6789/0 conn(0x7fe050069430 legacy=0x7fe050069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:36.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.484+0000 7fe055ed4640 1 -- 172.21.15.6:0/2921197320 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0500ca220 con 0x7fe0500af2b0 2023-07-21T22:57:36.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.488+0000 7fe055ed4640 1 --2- 172.21.15.6:0/2921197320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0500af2b0 0x7fe05015a1f0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7fe048009d90 tx=0x7fe04801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f2864c66d54803 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:36.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.488+0000 7fe047fff640 1 -- 172.21.15.6:0/2921197320 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0480a5920 con 0x7fe0500af2b0 2023-07-21T22:57:36.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.488+0000 7fe047fff640 1 -- 172.21.15.6:0/2921197320 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0480a5a80 con 0x7fe0500af2b0 2023-07-21T22:57:36.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.488+0000 7fe047fff640 1 -- 172.21.15.6:0/2921197320 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0480a5df0 con 0x7fe0500af2b0 2023-07-21T22:57:36.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe057937640 1 -- 172.21.15.6:0/2921197320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0500af2b0 msgr2=0x7fe05015a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:36.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe057937640 1 --2- 172.21.15.6:0/2921197320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0500af2b0 0x7fe05015a1f0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7fe048009d90 tx=0x7fe04801c950 comp rx=0 tx=0).stop 2023-07-21T22:57:36.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe057937640 1 -- 172.21.15.6:0/2921197320 shutdown_connections 2023-07-21T22:57:36.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe057937640 1 --2- 172.21.15.6:0/2921197320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0500af2b0 0x7fe05015a1f0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:36.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe057937640 1 -- 172.21.15.6:0/2921197320 >> 172.21.15.6:0/2921197320 conn(0x7fe0500cde90 msgr2=0x7fe0500ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:36.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe057937640 1 -- 172.21.15.6:0/2921197320 shutdown_connections 2023-07-21T22:57:36.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe057937640 1 -- 172.21.15.6:0/2921197320 wait complete. 2023-07-21T22:57:36.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe057937640 1 Processor -- start 2023-07-21T22:57:36.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe057937640 1 -- start start 2023-07-21T22:57:36.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe057937640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe050069430 0x7fe0500c3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:36.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe057937640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe050070f30 0x7fe050146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:36.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe057937640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0500af2b0 0x7fe05014d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:36.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe057937640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe050147950 con 0x7fe050070f30 2023-07-21T22:57:36.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe057937640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0500c4240 con 0x7fe0500af2b0 2023-07-21T22:57:36.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe057937640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe050147430 con 0x7fe050069430 2023-07-21T22:57:36.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe054ed2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe050070f30 0x7fe050146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:36.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe054ed2640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe050070f30 0x7fe050146ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39184/0 (socket says 172.21.15.6:39184) 2023-07-21T22:57:36.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe054ed2640 1 -- 172.21.15.6:0/1851579808 learned_addr learned my addr 172.21.15.6:0/1851579808 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:36.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe0556d3640 1 --2- 172.21.15.6:0/1851579808 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe050069430 0x7fe0500c3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:36.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe055ed4640 1 --2- 172.21.15.6:0/1851579808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0500af2b0 0x7fe05014d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:36.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe054ed2640 1 -- 172.21.15.6:0/1851579808 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe050069430 msgr2=0x7fe0500c3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:36.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe054ed2640 1 --2- 172.21.15.6:0/1851579808 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe050069430 0x7fe0500c3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:36.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe054ed2640 1 -- 172.21.15.6:0/1851579808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0500af2b0 msgr2=0x7fe05014d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:36.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe054ed2640 1 --2- 172.21.15.6:0/1851579808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0500af2b0 0x7fe05014d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:36.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.492+0000 7fe054ed2640 1 -- 172.21.15.6:0/1851579808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe048009a70 con 0x7fe050070f30 2023-07-21T22:57:36.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.496+0000 7fe054ed2640 1 --2- 172.21.15.6:0/1851579808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe050070f30 0x7fe050146ef0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7fe04000c530 tx=0x7fe04000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:36.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.496+0000 7fe045ffb640 1 -- 172.21.15.6:0/1851579808 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0400052d0 con 0x7fe050070f30 2023-07-21T22:57:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.496+0000 7fe045ffb640 1 -- 172.21.15.6:0/1851579808 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe040005450 con 0x7fe050070f30 2023-07-21T22:57:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.496+0000 7fe057937640 1 -- 172.21.15.6:0/1851579808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05014db70 con 0x7fe050070f30 2023-07-21T22:57:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.496+0000 7fe045ffb640 1 -- 172.21.15.6:0/1851579808 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe040012870 con 0x7fe050070f30 2023-07-21T22:57:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.496+0000 7fe057937640 1 -- 172.21.15.6:0/1851579808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0500c3910 con 0x7fe050070f30 2023-07-21T22:57:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.496+0000 7fe057937640 1 -- 172.21.15.6:0/1851579808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0500678d0 con 0x7fe050070f30 2023-07-21T22:57:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.496+0000 7fe045ffb640 1 -- 172.21.15.6:0/1851579808 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 91) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fe0400129d0 con 0x7fe050070f30 2023-07-21T22:57:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.500+0000 7fe045ffb640 1 --2- 172.21.15.6:0/1851579808 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fe0340663f0 0x7fe0340688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.500+0000 7fe045ffb640 1 -- 172.21.15.6:0/1851579808 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7fe0400839c0 con 0x7fe050070f30 2023-07-21T22:57:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.500+0000 7fe0556d3640 1 -- 172.21.15.6:0/1851579808 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fe0340663f0 msgr2=0x7fe0340688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/406143921 2023-07-21T22:57:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.500+0000 7fe0556d3640 1 --2- 172.21.15.6:0/1851579808 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fe0340663f0 0x7fe0340688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:36.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.504+0000 7fe045ffb640 1 -- 172.21.15.6:0/1851579808 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe040050d00 con 0x7fe050070f30 2023-07-21T22:57:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.660+0000 7fe057937640 1 -- 172.21.15.6:0/1851579808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fe0500b3df0 con 0x7fe050070f30 2023-07-21T22:57:36.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.668+0000 7fe045ffb640 1 -- 172.21.15.6:0/1851579808 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v65)=0 v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe040054320 con 0x7fe050070f30 2023-07-21T22:57:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.668+0000 7fe057937640 1 -- 172.21.15.6:0/1851579808 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fe0340663f0 msgr2=0x7fe0340688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.668+0000 7fe057937640 1 --2- 172.21.15.6:0/1851579808 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fe0340663f0 0x7fe0340688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.668+0000 7fe057937640 1 -- 172.21.15.6:0/1851579808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe050070f30 msgr2=0x7fe050146ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.668+0000 7fe057937640 1 --2- 172.21.15.6:0/1851579808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe050070f30 0x7fe050146ef0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7fe04000c530 tx=0x7fe04000c9f0 comp rx=0 tx=0).stop 2023-07-21T22:57:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.668+0000 7fe057937640 1 -- 172.21.15.6:0/1851579808 shutdown_connections 2023-07-21T22:57:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.668+0000 7fe057937640 1 --2- 172.21.15.6:0/1851579808 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7fe0340663f0 0x7fe0340688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.668+0000 7fe057937640 1 --2- 172.21.15.6:0/1851579808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe0500af2b0 0x7fe05014d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.668+0000 7fe057937640 1 --2- 172.21.15.6:0/1851579808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe050070f30 0x7fe050146ef0 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.668+0000 7fe057937640 1 --2- 172.21.15.6:0/1851579808 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe050069430 0x7fe0500c3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.668+0000 7fe057937640 1 -- 172.21.15.6:0/1851579808 >> 172.21.15.6:0/1851579808 conn(0x7fe0500cde90 msgr2=0x7fe050157920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.668+0000 7fe057937640 1 -- 172.21.15.6:0/1851579808 shutdown_connections 2023-07-21T22:57:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.668+0000 7fe057937640 1 -- 172.21.15.6:0/1851579808 wait complete. 2023-07-21T22:57:36.724 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-21T22:57:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.836+0000 7f8c74303640 1 Processor -- start 2023-07-21T22:57:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.836+0000 7f8c74303640 1 -- start start 2023-07-21T22:57:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.840+0000 7f8c74303640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c6c15bde0 0x7f8c6c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.840+0000 7f8c74303640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c6c0d2300 0x7f8c6c0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.840+0000 7f8c74303640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6c0b04c0 con 0x7f8c6c0d2fc0 2023-07-21T22:57:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.840+0000 7f8c74303640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c0d2ce0 con 0x7f8c6c0d2300 2023-07-21T22:57:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.840+0000 7f8c74303640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c15c1b0 con 0x7f8c6c15bde0 2023-07-21T22:57:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.840+0000 7f8c728a0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c6c0d2300 0x7f8c6c0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.840+0000 7f8c728a0640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c6c0d2300 0x7f8c6c0d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39186/0 (socket says 172.21.15.6:39186) 2023-07-21T22:57:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.840+0000 7f8c7189e640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8c6c0d2fc0 0x7f8c6c0b0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58324/0 (socket says 172.21.15.6:58324) 2023-07-21T22:57:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.840+0000 7f8c728a0640 1 -- 172.21.15.6:0/8951954 learned_addr learned my addr 172.21.15.6:0/8951954 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.840+0000 7f8c7209f640 1 --2- 172.21.15.6:0/8951954 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c6c15bde0 0x7f8c6c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.840+0000 7f8c728a0640 1 -- 172.21.15.6:0/8951954 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c6c15bde0 msgr2=0x7f8c6c0d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.840+0000 7f8c728a0640 1 --2- 172.21.15.6:0/8951954 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c6c15bde0 0x7f8c6c0d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:36.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.840+0000 7f8c728a0640 1 -- 172.21.15.6:0/8951954 >> v1:172.21.15.6:6789/0 conn(0x7f8c6c0d2fc0 legacy=0x7f8c6c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.840+0000 7f8c728a0640 1 -- 172.21.15.6:0/8951954 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c0b1060 con 0x7f8c6c0d2300 2023-07-21T22:57:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.840+0000 7f8c7109d640 1 -- 172.21.15.6:0/8951954 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907490077 0 0) 0x7f8c6c0b04c0 con 0x7f8c6c0d2fc0 2023-07-21T22:57:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.844+0000 7f8c728a0640 1 --2- 172.21.15.6:0/8951954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c0d2300 0x7f8c6c0d27a0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f8c64009e50 tx=0x7f8c6401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda37b91f9814482 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.844+0000 7f8c7109d640 1 -- 172.21.15.6:0/8951954 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c640a57f0 con 0x7f8c6c0d2300 2023-07-21T22:57:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.844+0000 7f8c7109d640 1 -- 172.21.15.6:0/8951954 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c640a5950 con 0x7f8c6c0d2300 2023-07-21T22:57:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.844+0000 7f8c7109d640 1 -- 172.21.15.6:0/8951954 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c640a5ce0 con 0x7f8c6c0d2300 2023-07-21T22:57:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.844+0000 7f8c74303640 1 -- 172.21.15.6:0/8951954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c0d2300 msgr2=0x7f8c6c0d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.844+0000 7f8c74303640 1 --2- 172.21.15.6:0/8951954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c0d2300 0x7f8c6c0d27a0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f8c64009e50 tx=0x7f8c6401ca10 comp rx=0 tx=0).stop 2023-07-21T22:57:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.844+0000 7f8c74303640 1 -- 172.21.15.6:0/8951954 shutdown_connections 2023-07-21T22:57:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.844+0000 7f8c74303640 1 --2- 172.21.15.6:0/8951954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c0d2300 0x7f8c6c0d27a0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.844+0000 7f8c74303640 1 --2- 172.21.15.6:0/8951954 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c6c15bde0 0x7f8c6c0d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.844+0000 7f8c74303640 1 -- 172.21.15.6:0/8951954 >> 172.21.15.6:0/8951954 conn(0x7f8c6c0659d0 msgr2=0x7f8c6c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.844+0000 7f8c74303640 1 -- 172.21.15.6:0/8951954 shutdown_connections 2023-07-21T22:57:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.844+0000 7f8c74303640 1 -- 172.21.15.6:0/8951954 wait complete. 2023-07-21T22:57:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.844+0000 7f8c74303640 1 Processor -- start 2023-07-21T22:57:36.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.844+0000 7f8c74303640 1 -- start start 2023-07-21T22:57:36.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c74303640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c0d2300 0x7f8c6c14da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:36.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c74303640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c6c0d2fc0 0x7f8c6c14f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:36.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c74303640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c6c15bde0 0x7f8c6c15e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:36.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c74303640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c156400 con 0x7f8c6c0d2300 2023-07-21T22:57:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c74303640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c153d90 con 0x7f8c6c15bde0 2023-07-21T22:57:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c74303640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c156120 con 0x7f8c6c0d2fc0 2023-07-21T22:57:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c7209f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c0d2300 0x7f8c6c14da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c7209f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c0d2300 0x7f8c6c14da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39196/0 (socket says 172.21.15.6:39196) 2023-07-21T22:57:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c7209f640 1 -- 172.21.15.6:0/1235306628 learned_addr learned my addr 172.21.15.6:0/1235306628 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c7189e640 1 --2- 172.21.15.6:0/1235306628 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c6c0d2fc0 0x7f8c6c14f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c728a0640 1 --2- 172.21.15.6:0/1235306628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c6c15bde0 0x7f8c6c15e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:36.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c7209f640 1 -- 172.21.15.6:0/1235306628 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c6c0d2fc0 msgr2=0x7f8c6c14f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:36.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c7209f640 1 --2- 172.21.15.6:0/1235306628 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c6c0d2fc0 0x7f8c6c14f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:36.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c7209f640 1 -- 172.21.15.6:0/1235306628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c6c15bde0 msgr2=0x7f8c6c15e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:36.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c7209f640 1 --2- 172.21.15.6:0/1235306628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c6c15bde0 0x7f8c6c15e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:36.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c7209f640 1 -- 172.21.15.6:0/1235306628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c64009b30 con 0x7f8c6c0d2300 2023-07-21T22:57:36.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c728a0640 1 --2- 172.21.15.6:0/1235306628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c6c15bde0 0x7f8c6c15e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:36.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c7209f640 1 --2- 172.21.15.6:0/1235306628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c0d2300 0x7f8c6c14da70 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800e9b0 tx=0x7f8c6800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:36.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c62ffd640 1 -- 172.21.15.6:0/1235306628 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68009670 con 0x7f8c6c0d2300 2023-07-21T22:57:36.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c62ffd640 1 -- 172.21.15.6:0/1235306628 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6800c9a0 con 0x7f8c6c0d2300 2023-07-21T22:57:36.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c62ffd640 1 -- 172.21.15.6:0/1235306628 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800cd10 con 0x7f8c6c0d2300 2023-07-21T22:57:36.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c74303640 1 -- 172.21.15.6:0/1235306628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6c153740 con 0x7f8c6c0d2300 2023-07-21T22:57:36.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c74303640 1 -- 172.21.15.6:0/1235306628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6c14fc30 con 0x7f8c6c0d2300 2023-07-21T22:57:36.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.848+0000 7f8c74303640 1 -- 172.21.15.6:0/1235306628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6c14fe50 con 0x7f8c6c0d2300 2023-07-21T22:57:36.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.852+0000 7f8c62ffd640 1 -- 172.21.15.6:0/1235306628 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 91) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f8c68013470 con 0x7f8c6c0d2300 2023-07-21T22:57:36.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.852+0000 7f8c62ffd640 1 --2- 172.21.15.6:0/1235306628 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f8c50066420 0x7f8c500688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:36.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.852+0000 7f8c62ffd640 1 -- 172.21.15.6:0/1235306628 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f8c68084680 con 0x7f8c6c0d2300 2023-07-21T22:57:36.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.852+0000 7f8c7189e640 1 -- 172.21.15.6:0/1235306628 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f8c50066420 msgr2=0x7f8c500688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/406143921 2023-07-21T22:57:36.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.852+0000 7f8c7189e640 1 --2- 172.21.15.6:0/1235306628 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f8c50066420 0x7f8c500688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:36.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:36.856+0000 7f8c62ffd640 1 -- 172.21.15.6:0/1235306628 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8c68051870 con 0x7f8c6c0d2300 2023-07-21T22:57:36.934 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:36.906+0000 7feba5c46180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:57:36.969 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:36.932+0000 7fd18d7d4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:57:37.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.016+0000 7f8c74303640 1 -- 172.21.15.6:0/1235306628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f8c6c1535a0 con 0x7f8c6c0d2300 2023-07-21T22:57:37.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.024+0000 7f8c62ffd640 1 -- 172.21.15.6:0/1235306628 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v66)=0 v66) v1 ==== 133+0+0 (secure 0 0 0) 0x7f8c6c1535a0 con 0x7f8c6c0d2300 2023-07-21T22:57:37.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.024+0000 7f8c74303640 1 -- 172.21.15.6:0/1235306628 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f8c50066420 msgr2=0x7f8c500688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:37.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.024+0000 7f8c74303640 1 --2- 172.21.15.6:0/1235306628 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f8c50066420 0x7f8c500688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:37.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.024+0000 7f8c74303640 1 -- 172.21.15.6:0/1235306628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c0d2300 msgr2=0x7f8c6c14da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:37.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.024+0000 7f8c74303640 1 --2- 172.21.15.6:0/1235306628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c0d2300 0x7f8c6c14da70 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800e9b0 tx=0x7f8c6800ee70 comp rx=0 tx=0).stop 2023-07-21T22:57:37.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.024+0000 7f8c74303640 1 -- 172.21.15.6:0/1235306628 shutdown_connections 2023-07-21T22:57:37.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.024+0000 7f8c74303640 1 --2- 172.21.15.6:0/1235306628 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f8c50066420 0x7f8c500688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:37.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.024+0000 7f8c74303640 1 --2- 172.21.15.6:0/1235306628 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8c6c15bde0 0x7f8c6c15e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:37.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.024+0000 7f8c74303640 1 --2- 172.21.15.6:0/1235306628 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8c6c0d2fc0 0x7f8c6c14f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:37.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.024+0000 7f8c74303640 1 --2- 172.21.15.6:0/1235306628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c6c0d2300 0x7f8c6c14da70 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:37.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.024+0000 7f8c74303640 1 -- 172.21.15.6:0/1235306628 >> 172.21.15.6:0/1235306628 conn(0x7f8c6c0659d0 msgr2=0x7f8c6c0cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:37.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.024+0000 7f8c74303640 1 -- 172.21.15.6:0/1235306628 shutdown_connections 2023-07-21T22:57:37.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.024+0000 7f8c74303640 1 -- 172.21.15.6:0/1235306628 wait complete. 2023-07-21T22:57:37.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:37.081 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-21T22:57:37.086 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:37.058+0000 7feba5c46180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:57:37.096 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-07-21T22:57:37.132 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:37.096+0000 7fd18d7d4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:57:37.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.248+0000 7f1870774640 1 Processor -- start 2023-07-21T22:57:37.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.248+0000 7f1870774640 1 -- start start 2023-07-21T22:57:37.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.248+0000 7f1870774640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f18680d2fc0 0x7f18680b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:37.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.248+0000 7f1870774640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18680d2300 0x7f18680d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:37.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.248+0000 7f1870774640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18680b04c0 con 0x7f186815bde0 2023-07-21T22:57:37.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.248+0000 7f1870774640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186815c1b0 con 0x7f18680d2fc0 2023-07-21T22:57:37.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.248+0000 7f1870774640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18680d2cc0 con 0x7f18680d2300 2023-07-21T22:57:37.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.248+0000 7f186e510640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f186815bde0 0x7f18680d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58330/0 (socket says 172.21.15.6:58330) 2023-07-21T22:57:37.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.248+0000 7f186e510640 1 -- 172.21.15.6:0/2776509321 learned_addr learned my addr 172.21.15.6:0/2776509321 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:37.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.248+0000 7f186dd0f640 1 --2- 172.21.15.6:0/2776509321 >> v2:172.21.15.161:3300/0 conn(0x7f18680d2fc0 0x7f18680b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:37.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.248+0000 7f186ed11640 1 --2- 172.21.15.6:0/2776509321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18680d2300 0x7f18680d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:37.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.248+0000 7f186d50e640 1 -- 172.21.15.6:0/2776509321 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 288827775 0 0) 0x7f18680b04c0 con 0x7f186815bde0 2023-07-21T22:57:37.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.248+0000 7f186d50e640 1 -- 172.21.15.6:0/2776509321 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1854003530 con 0x7f186815bde0 2023-07-21T22:57:37.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.248+0000 7f186dd0f640 1 -- 172.21.15.6:0/2776509321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18680d2300 msgr2=0x7f18680d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:37.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.248+0000 7f186dd0f640 1 --2- 172.21.15.6:0/2776509321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18680d2300 0x7f18680d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:37.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.248+0000 7f186dd0f640 1 -- 172.21.15.6:0/2776509321 >> v1:172.21.15.6:6789/0 conn(0x7f186815bde0 legacy=0x7f18680d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:37.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.248+0000 7f186dd0f640 1 -- 172.21.15.6:0/2776509321 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18680d0aa0 con 0x7f18680d2fc0 2023-07-21T22:57:37.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.252+0000 7f186dd0f640 1 --2- 172.21.15.6:0/2776509321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18680d2fc0 0x7f18680b0950 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f18580097c0 tx=0x7f185801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1461d75cf57d2e71 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:37.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.252+0000 7f186d50e640 1 -- 172.21.15.6:0/2776509321 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18580ab680 con 0x7f18680d2fc0 2023-07-21T22:57:37.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.252+0000 7f186d50e640 1 -- 172.21.15.6:0/2776509321 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18580ab7e0 con 0x7f18680d2fc0 2023-07-21T22:57:37.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.252+0000 7f186d50e640 1 -- 172.21.15.6:0/2776509321 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18580abb70 con 0x7f18680d2fc0 2023-07-21T22:57:37.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.252+0000 7f1870774640 1 -- 172.21.15.6:0/2776509321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18680d2fc0 msgr2=0x7f18680b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:37.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.252+0000 7f1870774640 1 --2- 172.21.15.6:0/2776509321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18680d2fc0 0x7f18680b0950 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f18580097c0 tx=0x7f185801c480 comp rx=0 tx=0).stop 2023-07-21T22:57:37.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.252+0000 7f1870774640 1 -- 172.21.15.6:0/2776509321 shutdown_connections 2023-07-21T22:57:37.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.252+0000 7f1870774640 1 --2- 172.21.15.6:0/2776509321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f18680d2300 0x7f18680d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:37.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.252+0000 7f1870774640 1 --2- 172.21.15.6:0/2776509321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18680d2fc0 0x7f18680b0950 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:37.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.252+0000 7f1870774640 1 -- 172.21.15.6:0/2776509321 >> 172.21.15.6:0/2776509321 conn(0x7f18680659d0 msgr2=0x7f186809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:37.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.252+0000 7f1870774640 1 -- 172.21.15.6:0/2776509321 shutdown_connections 2023-07-21T22:57:37.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.252+0000 7f1870774640 1 -- 172.21.15.6:0/2776509321 wait complete. 2023-07-21T22:57:37.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f1870774640 1 Processor -- start 2023-07-21T22:57:37.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f1870774640 1 -- start start 2023-07-21T22:57:37.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f1870774640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18680d2300 0x7f18680c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:37.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f1870774640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18680d2fc0 0x7f186814f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:37.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f1870774640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f186815bde0 0x7f1868158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:37.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f1870774640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18680b65c0 con 0x7f18680d2fc0 2023-07-21T22:57:37.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f1870774640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1868153de0 con 0x7f18680d2300 2023-07-21T22:57:37.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f1870774640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18680b7f00 con 0x7f186815bde0 2023-07-21T22:57:37.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f186dd0f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18680d2fc0 0x7f186814f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:37.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f186dd0f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18680d2fc0 0x7f186814f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39200/0 (socket says 172.21.15.6:39200) 2023-07-21T22:57:37.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f186dd0f640 1 -- 172.21.15.6:0/1728513830 learned_addr learned my addr 172.21.15.6:0/1728513830 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:37.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f186e510640 1 --2- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18680d2300 0x7f18680c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:37.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f186ed11640 1 --2- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f186815bde0 0x7f1868158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:37.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f186dd0f640 1 -- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f186815bde0 msgr2=0x7f1868158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:37.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f186dd0f640 1 --2- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f186815bde0 0x7f1868158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:37.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f186dd0f640 1 -- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18680d2300 msgr2=0x7f18680c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:37.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f186dd0f640 1 --2- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18680d2300 0x7f18680c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:37.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f186dd0f640 1 -- 172.21.15.6:0/1728513830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1858009420 con 0x7f18680d2fc0 2023-07-21T22:57:37.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f186e510640 1 --2- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18680d2300 0x7f18680c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:37.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f186dd0f640 1 --2- 172.21.15.6:0/1728513830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18680d2fc0 0x7f186814f9f0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f18580ad040 tx=0x7f185801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:37.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f185effd640 1 -- 172.21.15.6:0/1728513830 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18580bf610 con 0x7f18680d2fc0 2023-07-21T22:57:37.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f185effd640 1 -- 172.21.15.6:0/1728513830 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18580bf770 con 0x7f18680d2fc0 2023-07-21T22:57:37.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f1870774640 1 -- 172.21.15.6:0/1728513830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18680b6810 con 0x7f18680d2fc0 2023-07-21T22:57:37.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f185effd640 1 -- 172.21.15.6:0/1728513830 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18580bfb20 con 0x7f18680d2fc0 2023-07-21T22:57:37.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f1870774640 1 -- 172.21.15.6:0/1728513830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186814ff30 con 0x7f18680d2fc0 2023-07-21T22:57:37.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.256+0000 7f1870774640 1 -- 172.21.15.6:0/1728513830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18680678d0 con 0x7f18680d2fc0 2023-07-21T22:57:37.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.260+0000 7f185effd640 1 -- 172.21.15.6:0/1728513830 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 91) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f18580bfc80 con 0x7f18680d2fc0 2023-07-21T22:57:37.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.260+0000 7f185effd640 1 --2- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f184c0663f0 0x7f184c0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:37.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.260+0000 7f185effd640 1 -- 172.21.15.6:0/1728513830 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6134+0+0 (secure 0 0 0) 0x7f185811edd0 con 0x7f18680d2fc0 2023-07-21T22:57:37.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.260+0000 7f186e510640 1 -- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f184c0663f0 msgr2=0x7f184c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/406143921 2023-07-21T22:57:37.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.260+0000 7f186e510640 1 --2- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f184c0663f0 0x7f184c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:37.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.264+0000 7f185effd640 1 -- 172.21.15.6:0/1728513830 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f18580ec080 con 0x7f18680d2fc0 2023-07-21T22:57:37.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.440+0000 7f1870774640 1 -- 172.21.15.6:0/1728513830 --> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f18680b0150 con 0x7f184c0663f0 2023-07-21T22:57:37.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.464+0000 7f186e510640 1 -- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f184c0663f0 msgr2=0x7f184c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/406143921 2023-07-21T22:57:37.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.464+0000 7f186e510640 1 --2- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f184c0663f0 0x7f184c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:57:37.564 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:37.538+0000 7feba5c46180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:57:37.624 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:37.594+0000 7feba5c46180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:57:37.645 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:37.608+0000 7fd18d7d4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:57:37.680 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:37.650+0000 7feba5c46180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:57:37.707 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:37.672+0000 7fd18d7d4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:57:37.764 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:37.734+0000 7feba5c46180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:57:37.766 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:37.732+0000 7fd18d7d4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:57:37.822 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:37.794+0000 7feba5c46180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:57:37.857 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:37.820+0000 7fd18d7d4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:57:37.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.868+0000 7f186e510640 1 -- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f184c0663f0 msgr2=0x7f184c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/406143921 2023-07-21T22:57:37.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:37.868+0000 7f186e510640 1 --2- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f184c0663f0 0x7f184c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-21T22:57:37.905 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:37.878+0000 7feba5c46180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:57:37.916 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:37.880+0000 7fd18d7d4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:57:37.961 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:37.934+0000 7feba5c46180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:57:38.005 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:37.968+0000 7fd18d7d4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:57:38.067 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:38.032+0000 7fd18d7d4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:57:38.103 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:38.074+0000 7feba5c46180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:57:38.160 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:38.130+0000 7feba5c46180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:57:38.218 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:38.184+0000 7fd18d7d4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:57:38.279 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:38.244+0000 7fd18d7d4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:57:38.400 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:57:38.400 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:57:38.401 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:57:38.409 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:38.382+0000 7feba5c46180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:57:38.529 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:57:38.530 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:57:38.530 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:57:38.538 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:38.504+0000 7fd18d7d4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:57:38.541 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:38.514+0000 7feba5c46180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:57:38.666 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:38.638+0000 7feba5c46180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:57:38.681 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:38.644+0000 7fd18d7d4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:57:38.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:38.672+0000 7f186e510640 1 -- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f184c0663f0 msgr2=0x7f184c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/406143921 2023-07-21T22:57:38.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:38.672+0000 7f186e510640 1 --2- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f184c0663f0 0x7f184c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-21T22:57:38.736 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:38.710+0000 7feba5c46180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:57:38.812 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:38.776+0000 7fd18d7d4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:57:38.870 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:38.842+0000 7feba5c46180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:57:38.887 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:38.852+0000 7fd18d7d4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:57:39.027 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:38.992+0000 7fd18d7d4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:57:39.405 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:39.378+0000 7feba5c46180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:57:39.491 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:39.462+0000 7feba5c46180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:57:39.598 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:39.564+0000 7fd18d7d4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:57:39.637 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:39.610+0000 7feba5c46180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:57:39.687 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:39.652+0000 7fd18d7d4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:57:39.720 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:39.694+0000 7feba5c46180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:57:39.842 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:39.808+0000 7fd18d7d4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:57:39.930 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:39.896+0000 7fd18d7d4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:57:39.988 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:39.958+0000 7feba5c46180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:57:40.047 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:40.018+0000 7feba5c46180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:57:40.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:40.024+0000 7f185effd640 1 -- 172.21.15.6:0/1728513830 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 92) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f1858125080 con 0x7f18680d2fc0 2023-07-21T22:57:40.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:40.024+0000 7f185effd640 1 -- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f184c0663f0 msgr2=0x7f184c0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:40.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:40.024+0000 7f185effd640 1 --2- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:6832/406143921,v1:172.21.15.161:6833/406143921] conn(0x7f184c0663f0 0x7f184c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:40.192 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:40.162+0000 7feb26b0a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:40.192 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:40.162+0000 7feb26b0a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:40.192 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:40.162+0000 7feb26b0a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:40.192 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:40.162+0000 7feb26b0a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:40.192 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:40.162+0000 7feb26b0a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:40.193 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:40.162+0000 7feb23303640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:40.193 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:40.162+0000 7feb23303640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:40.193 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:40.162+0000 7feb23303640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:40.193 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:40.162+0000 7feb23303640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:40.193 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:40.162+0000 7feb23303640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:40.240 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:40.204+0000 7fd18d7d4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:57:40.303 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:40.268+0000 7fd18d7d4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:57:41.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.032+0000 7f185effd640 1 -- 172.21.15.6:0/1728513830 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mgrmap(e 93) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f18580ec450 con 0x7f18680d2fc0 2023-07-21T22:57:41.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.032+0000 7f185effd640 1 --2- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f184c033e90 0x7f184c0709b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:41.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.032+0000 7f185effd640 1 -- 172.21.15.6:0/1728513830 --> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f184c034260 con 0x7f184c033e90 2023-07-21T22:57:41.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.036+0000 7f186e510640 1 --2- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f184c033e90 0x7f184c0709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:41.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.040+0000 7f186e510640 1 --2- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f184c033e90 0x7f184c0709b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f18640010f0 tx=0x7f1864007bf0 comp rx=0 tx=0).ready entity=mgr.10135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:41.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.108+0000 7f185effd640 1 -- 172.21.15.6:0/1728513830 <== mgr.10135 v2:172.21.15.161:6832/2599285906 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f184c034260 con 0x7f184c033e90 2023-07-21T22:57:41.144 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule set for path snap_test_dir1 2023-07-21T22:57:41.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.112+0000 7f1870774640 1 -- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f184c033e90 msgr2=0x7f184c0709b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:41.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.112+0000 7f1870774640 1 --2- 172.21.15.6:0/1728513830 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f184c033e90 0x7f184c0709b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f18640010f0 tx=0x7f1864007bf0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.112+0000 7f1870774640 1 -- 172.21.15.6:0/1728513830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18680d2fc0 msgr2=0x7f186814f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.112+0000 7f1870774640 1 --2- 172.21.15.6:0/1728513830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18680d2fc0 0x7f186814f9f0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f18580ad040 tx=0x7f185801acc0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.112+0000 7f186ed11640 1 -- 172.21.15.6:0/1728513830 reap_dead start 2023-07-21T22:57:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.112+0000 7f1870774640 1 -- 172.21.15.6:0/1728513830 shutdown_connections 2023-07-21T22:57:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.112+0000 7f1870774640 1 -- 172.21.15.6:0/1728513830 >> 172.21.15.6:0/1728513830 conn(0x7f18680659d0 msgr2=0x7f186815a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.112+0000 7f1870774640 1 -- 172.21.15.6:0/1728513830 shutdown_connections 2023-07-21T22:57:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.112+0000 7f1870774640 1 -- 172.21.15.6:0/1728513830 wait complete. 2023-07-21T22:57:41.167 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-21T22:57:41.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-07-21T22:57:41.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.284+0000 7f6f879f6640 1 Processor -- start 2023-07-21T22:57:41.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.284+0000 7f6f879f6640 1 -- start start 2023-07-21T22:57:41.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.284+0000 7f6f879f6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f80069430 0x7f6f80069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:41.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.284+0000 7f6f879f6640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6f800af2b0 0x7f6f8015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:41.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.284+0000 7f6f879f6640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f80159d70 con 0x7f6f80070f30 2023-07-21T22:57:41.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.284+0000 7f6f879f6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f80069d40 con 0x7f6f80069430 2023-07-21T22:57:41.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.284+0000 7f6f879f6640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f800c9c60 con 0x7f6f800af2b0 2023-07-21T22:57:41.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.284+0000 7f6f85792640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f80069430 0x7f6f80069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:41.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.284+0000 7f6f85792640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6f80069430 0x7f6f80069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46120/0 (socket says 172.21.15.6:46120) 2023-07-21T22:57:41.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.284+0000 7f6f85792640 1 -- 172.21.15.6:0/2745630260 learned_addr learned my addr 172.21.15.6:0/2745630260 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:41.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.288+0000 7f6f85f93640 1 --2- 172.21.15.6:0/2745630260 >> v2:172.21.15.161:3300/0 conn(0x7f6f800af2b0 0x7f6f8015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:41.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.288+0000 7f6f85792640 1 -- 172.21.15.6:0/2745630260 >> v2:172.21.15.161:3300/0 conn(0x7f6f800af2b0 msgr2=0x7f6f8015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:41.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.288+0000 7f6f85792640 1 --2- 172.21.15.6:0/2745630260 >> v2:172.21.15.161:3300/0 conn(0x7f6f800af2b0 0x7f6f8015a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.288+0000 7f6f85792640 1 -- 172.21.15.6:0/2745630260 >> v1:172.21.15.161:6789/0 conn(0x7f6f80070f30 legacy=0x7f6f800ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:41.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.288+0000 7f6f85792640 1 -- 172.21.15.6:0/2745630260 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f800c9f40 con 0x7f6f80069430 2023-07-21T22:57:41.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.288+0000 7f6f85792640 1 --2- 172.21.15.6:0/2745630260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f80069430 0x7f6f80069800 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f6f800cef70 tx=0x7f6f7c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=623fc1b80690d436 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:41.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.288+0000 7f6f77fff640 1 -- 172.21.15.6:0/2745630260 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c0ab610 con 0x7f6f80069430 2023-07-21T22:57:41.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.288+0000 7f6f77fff640 1 -- 172.21.15.6:0/2745630260 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c0ab770 con 0x7f6f80069430 2023-07-21T22:57:41.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.288+0000 7f6f77fff640 1 -- 172.21.15.6:0/2745630260 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c0abb00 con 0x7f6f80069430 2023-07-21T22:57:41.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f879f6640 1 -- 172.21.15.6:0/2745630260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f80069430 msgr2=0x7f6f80069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:41.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f879f6640 1 --2- 172.21.15.6:0/2745630260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f80069430 0x7f6f80069800 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f6f800cef70 tx=0x7f6f7c01c500 comp rx=0 tx=0).stop 2023-07-21T22:57:41.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f879f6640 1 -- 172.21.15.6:0/2745630260 shutdown_connections 2023-07-21T22:57:41.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f879f6640 1 --2- 172.21.15.6:0/2745630260 >> v2:172.21.15.161:3300/0 conn(0x7f6f800af2b0 0x7f6f8015a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f879f6640 1 --2- 172.21.15.6:0/2745630260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f80069430 0x7f6f80069800 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f879f6640 1 -- 172.21.15.6:0/2745630260 >> 172.21.15.6:0/2745630260 conn(0x7f6f800cde90 msgr2=0x7f6f800ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f879f6640 1 -- 172.21.15.6:0/2745630260 shutdown_connections 2023-07-21T22:57:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f879f6640 1 -- 172.21.15.6:0/2745630260 wait complete. 2023-07-21T22:57:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f879f6640 1 Processor -- start 2023-07-21T22:57:41.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f879f6640 1 -- start start 2023-07-21T22:57:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f879f6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f80069430 0x7f6f80151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f879f6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f80070f30 0x7f6f80150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f879f6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f800af2b0 0x7f6f800cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f879f6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f801524b0 con 0x7f6f80070f30 2023-07-21T22:57:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f879f6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f80152790 con 0x7f6f80069430 2023-07-21T22:57:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f879f6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f80152a70 con 0x7f6f800af2b0 2023-07-21T22:57:41.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f84f91640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f80070f30 0x7f6f80150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:41.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f84f91640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f80070f30 0x7f6f80150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46124/0 (socket says 172.21.15.6:46124) 2023-07-21T22:57:41.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f84f91640 1 -- 172.21.15.6:0/313635047 learned_addr learned my addr 172.21.15.6:0/313635047 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:41.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f85792640 1 --2- 172.21.15.6:0/313635047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f80069430 0x7f6f80151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:41.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f85f93640 1 --2- 172.21.15.6:0/313635047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f800af2b0 0x7f6f800cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f84f91640 1 -- 172.21.15.6:0/313635047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f800af2b0 msgr2=0x7f6f800cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f84f91640 1 --2- 172.21.15.6:0/313635047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f800af2b0 0x7f6f800cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f84f91640 1 -- 172.21.15.6:0/313635047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f80069430 msgr2=0x7f6f80151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f84f91640 1 --2- 172.21.15.6:0/313635047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f80069430 0x7f6f80151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.292+0000 7f6f84f91640 1 -- 172.21.15.6:0/313635047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c0094d0 con 0x7f6f80070f30 2023-07-21T22:57:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.296+0000 7f6f84f91640 1 --2- 172.21.15.6:0/313635047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f80070f30 0x7f6f80150330 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000c500 tx=0x7f6f7000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.296+0000 7f6f75ffb640 1 -- 172.21.15.6:0/313635047 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f70005220 con 0x7f6f80070f30 2023-07-21T22:57:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.296+0000 7f6f75ffb640 1 -- 172.21.15.6:0/313635047 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f70005380 con 0x7f6f80070f30 2023-07-21T22:57:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.296+0000 7f6f75ffb640 1 -- 172.21.15.6:0/313635047 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f70007270 con 0x7f6f80070f30 2023-07-21T22:57:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.296+0000 7f6f879f6640 1 -- 172.21.15.6:0/313635047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f80152d50 con 0x7f6f80070f30 2023-07-21T22:57:41.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.296+0000 7f6f879f6640 1 -- 172.21.15.6:0/313635047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f80152160 con 0x7f6f80070f30 2023-07-21T22:57:41.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.296+0000 7f6f879f6640 1 -- 172.21.15.6:0/313635047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f800678d0 con 0x7f6f80070f30 2023-07-21T22:57:41.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.296+0000 7f6f75ffb640 1 -- 172.21.15.6:0/313635047 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 93) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f6f700073d0 con 0x7f6f80070f30 2023-07-21T22:57:41.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.296+0000 7f6f75ffb640 1 --2- 172.21.15.6:0/313635047 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f6f64066150 0x7f6f64068600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:41.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.296+0000 7f6f75ffb640 1 -- 172.21.15.6:0/313635047 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f6f70083240 con 0x7f6f80070f30 2023-07-21T22:57:41.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.296+0000 7f6f85792640 1 --2- 172.21.15.6:0/313635047 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f6f64066150 0x7f6f64068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:41.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.300+0000 7f6f85792640 1 --2- 172.21.15.6:0/313635047 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f6f64066150 0x7f6f64068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0af000 tx=0x7f6f7c0b6040 comp rx=0 tx=0).ready entity=mgr.10135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.300+0000 7f6f75ffb640 1 -- 172.21.15.6:0/313635047 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6f700507c0 con 0x7f6f80070f30 2023-07-21T22:57:41.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.480+0000 7f6f879f6640 1 -- 172.21.15.6:0/313635047 --> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f80159d70 con 0x7f6f64066150 2023-07-21T22:57:41.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.540+0000 7f6f75ffb640 1 -- 172.21.15.6:0/313635047 <== mgr.10135 v2:172.21.15.161:6832/2599285906 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f6f80159d70 con 0x7f6f64066150 2023-07-21T22:57:41.576 INFO:teuthology.orchestra.run.smithi006.stdout:Retention added to path snap_test_dir1 2023-07-21T22:57:41.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.540+0000 7f6f879f6640 1 -- 172.21.15.6:0/313635047 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f6f64066150 msgr2=0x7f6f64068600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:41.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.540+0000 7f6f879f6640 1 --2- 172.21.15.6:0/313635047 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f6f64066150 0x7f6f64068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c0af000 tx=0x7f6f7c0b6040 comp rx=0 tx=0).stop 2023-07-21T22:57:41.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.540+0000 7f6f879f6640 1 -- 172.21.15.6:0/313635047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f80070f30 msgr2=0x7f6f80150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:41.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.540+0000 7f6f879f6640 1 --2- 172.21.15.6:0/313635047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f80070f30 0x7f6f80150330 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000c500 tx=0x7f6f7000c9c0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.540+0000 7f6f879f6640 1 -- 172.21.15.6:0/313635047 shutdown_connections 2023-07-21T22:57:41.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.540+0000 7f6f879f6640 1 --2- 172.21.15.6:0/313635047 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f6f64066150 0x7f6f64068600 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.540+0000 7f6f879f6640 1 --2- 172.21.15.6:0/313635047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6f800af2b0 0x7f6f800cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.540+0000 7f6f879f6640 1 --2- 172.21.15.6:0/313635047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f80070f30 0x7f6f80150330 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.540+0000 7f6f879f6640 1 --2- 172.21.15.6:0/313635047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f80069430 0x7f6f80151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.540+0000 7f6f879f6640 1 -- 172.21.15.6:0/313635047 >> 172.21.15.6:0/313635047 conn(0x7f6f800cde90 msgr2=0x7f6f800adb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:41.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.540+0000 7f6f879f6640 1 -- 172.21.15.6:0/313635047 shutdown_connections 2023-07-21T22:57:41.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.544+0000 7f6f879f6640 1 -- 172.21.15.6:0/313635047 wait complete. 2023-07-21T22:57:41.597 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-07-21T22:57:41.602 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-21-22_58_00 in ~19s... 2023-07-21T22:57:41.603 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-07-21T22:57:41.603 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-07-21T22:57:41.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.716+0000 7f7e7491e640 1 Processor -- start 2023-07-21T22:57:41.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.716+0000 7f7e7491e640 1 -- start start 2023-07-21T22:57:41.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.716+0000 7f7e7491e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e700aeb40 0x7f7e7015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:41.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.716+0000 7f7e7491e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7e700aef10 0x7f7e70158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:41.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.716+0000 7f7e7491e640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e701532b0 con 0x7f7e70159270 2023-07-21T22:57:41.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.716+0000 7f7e7491e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e700ca6f0 con 0x7f7e700aef10 2023-07-21T22:57:41.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.716+0000 7f7e7491e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e701599d0 con 0x7f7e700aeb40 2023-07-21T22:57:41.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.716+0000 7f7e6ed9d640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7e70159270 0x7f7e700c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35162/0 (socket says 172.21.15.6:35162) 2023-07-21T22:57:41.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.716+0000 7f7e6ed9d640 1 -- 172.21.15.6:0/4030255029 learned_addr learned my addr 172.21.15.6:0/4030255029 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:41.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.716+0000 7f7e67fff640 1 --2- 172.21.15.6:0/4030255029 >> v2:172.21.15.161:3300/0 conn(0x7f7e700aef10 0x7f7e70158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:41.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.716+0000 7f7e6e59c640 1 --2- 172.21.15.6:0/4030255029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e700aeb40 0x7f7e7015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:41.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.716+0000 7f7e6dd9b640 1 -- 172.21.15.6:0/4030255029 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557916769 0 0) 0x7f7e701532b0 con 0x7f7e70159270 2023-07-21T22:57:41.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.716+0000 7f7e6dd9b640 1 -- 172.21.15.6:0/4030255029 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e5c003530 con 0x7f7e70159270 2023-07-21T22:57:41.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.720+0000 7f7e67fff640 1 -- 172.21.15.6:0/4030255029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e700aeb40 msgr2=0x7f7e7015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:41.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.720+0000 7f7e67fff640 1 --2- 172.21.15.6:0/4030255029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e700aeb40 0x7f7e7015cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.720+0000 7f7e67fff640 1 -- 172.21.15.6:0/4030255029 >> v1:172.21.15.6:6789/0 conn(0x7f7e70159270 legacy=0x7f7e700c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:41.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.720+0000 7f7e67fff640 1 -- 172.21.15.6:0/4030255029 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e70159cb0 con 0x7f7e700aef10 2023-07-21T22:57:41.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.720+0000 7f7e6e59c640 1 --2- 172.21.15.6:0/4030255029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e700aeb40 0x7f7e7015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:41.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.720+0000 7f7e67fff640 1 --2- 172.21.15.6:0/4030255029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e700aef10 0x7f7e70158d30 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f7e580097c0 tx=0x7f7e5801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46357188a48cf992 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:41.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.720+0000 7f7e6dd9b640 1 -- 172.21.15.6:0/4030255029 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e580ac620 con 0x7f7e700aef10 2023-07-21T22:57:41.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.720+0000 7f7e6dd9b640 1 -- 172.21.15.6:0/4030255029 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e580ac780 con 0x7f7e700aef10 2023-07-21T22:57:41.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.720+0000 7f7e6dd9b640 1 -- 172.21.15.6:0/4030255029 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e580acaf0 con 0x7f7e700aef10 2023-07-21T22:57:41.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.720+0000 7f7e7491e640 1 -- 172.21.15.6:0/4030255029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e700aef10 msgr2=0x7f7e70158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:41.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.720+0000 7f7e7491e640 1 --2- 172.21.15.6:0/4030255029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e700aef10 0x7f7e70158d30 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f7e580097c0 tx=0x7f7e5801c3c0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.720+0000 7f7e7491e640 1 -- 172.21.15.6:0/4030255029 shutdown_connections 2023-07-21T22:57:41.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.720+0000 7f7e7491e640 1 --2- 172.21.15.6:0/4030255029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e700aef10 0x7f7e70158d30 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.720+0000 7f7e7491e640 1 --2- 172.21.15.6:0/4030255029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e700aeb40 0x7f7e7015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.720+0000 7f7e7491e640 1 -- 172.21.15.6:0/4030255029 >> 172.21.15.6:0/4030255029 conn(0x7f7e700cde90 msgr2=0x7f7e700ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:41.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.720+0000 7f7e7491e640 1 -- 172.21.15.6:0/4030255029 shutdown_connections 2023-07-21T22:57:41.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e7491e640 1 -- 172.21.15.6:0/4030255029 wait complete. 2023-07-21T22:57:41.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e7491e640 1 Processor -- start 2023-07-21T22:57:41.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e7491e640 1 -- start start 2023-07-21T22:57:41.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e7491e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e700aeb40 0x7f7e7014d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:41.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e7491e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e700aef10 0x7f7e70070a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:41.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e7491e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e70159270 0x7f7e7006f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:41.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e7491e640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e701f3e30 con 0x7f7e700aeb40 2023-07-21T22:57:41.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e7491e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e70070570 con 0x7f7e70159270 2023-07-21T22:57:41.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e7491e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7014dd20 con 0x7f7e700aef10 2023-07-21T22:57:41.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e6e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e700aeb40 0x7f7e7014d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:41.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e6e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e700aeb40 0x7f7e7014d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46130/0 (socket says 172.21.15.6:46130) 2023-07-21T22:57:41.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e6e59c640 1 -- 172.21.15.6:0/3063301095 learned_addr learned my addr 172.21.15.6:0/3063301095 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:41.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e67fff640 1 --2- 172.21.15.6:0/3063301095 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e700aef10 0x7f7e70070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:41.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e6ed9d640 1 --2- 172.21.15.6:0/3063301095 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e70159270 0x7f7e7006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:41.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e6e59c640 1 -- 172.21.15.6:0/3063301095 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e700aef10 msgr2=0x7f7e70070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:41.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e6e59c640 1 --2- 172.21.15.6:0/3063301095 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e700aef10 0x7f7e70070a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e6e59c640 1 -- 172.21.15.6:0/3063301095 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e70159270 msgr2=0x7f7e7006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:41.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e6e59c640 1 --2- 172.21.15.6:0/3063301095 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e70159270 0x7f7e7006f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e6e59c640 1 -- 172.21.15.6:0/3063301095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e60009420 con 0x7f7e700aeb40 2023-07-21T22:57:41.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e6e59c640 1 --2- 172.21.15.6:0/3063301095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e700aeb40 0x7f7e7014d7e0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000ebe0 tx=0x7f7e6000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:41.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.724+0000 7f7e66ffd640 1 -- 172.21.15.6:0/3063301095 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6000eee0 con 0x7f7e700aeb40 2023-07-21T22:57:41.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.728+0000 7f7e66ffd640 1 -- 172.21.15.6:0/3063301095 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6000cc30 con 0x7f7e700aeb40 2023-07-21T22:57:41.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.728+0000 7f7e66ffd640 1 -- 172.21.15.6:0/3063301095 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60013470 con 0x7f7e700aeb40 2023-07-21T22:57:41.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.728+0000 7f7e7491e640 1 -- 172.21.15.6:0/3063301095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e58009420 con 0x7f7e700aeb40 2023-07-21T22:57:41.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.728+0000 7f7e7491e640 1 -- 172.21.15.6:0/3063301095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e7006fc40 con 0x7f7e700aeb40 2023-07-21T22:57:41.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.728+0000 7f7e7491e640 1 -- 172.21.15.6:0/3063301095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e700678d0 con 0x7f7e700aeb40 2023-07-21T22:57:41.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.728+0000 7f7e66ffd640 1 -- 172.21.15.6:0/3063301095 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 93) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f7e600135d0 con 0x7f7e700aeb40 2023-07-21T22:57:41.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.728+0000 7f7e66ffd640 1 --2- 172.21.15.6:0/3063301095 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f7e50066120 0x7f7e500685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:41.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.728+0000 7f7e66ffd640 1 -- 172.21.15.6:0/3063301095 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f7e60083ec0 con 0x7f7e700aeb40 2023-07-21T22:57:41.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.728+0000 7f7e67fff640 1 --2- 172.21.15.6:0/3063301095 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f7e50066120 0x7f7e500685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:41.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.732+0000 7f7e67fff640 1 --2- 172.21.15.6:0/3063301095 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f7e50066120 0x7f7e500685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7e580ae000 tx=0x7f7e580a7000 comp rx=0 tx=0).ready entity=mgr.10135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:41.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.732+0000 7f7e66ffd640 1 -- 172.21.15.6:0/3063301095 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e60054ea0 con 0x7f7e700aeb40 2023-07-21T22:57:41.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.904+0000 7f7e7491e640 1 -- 172.21.15.6:0/3063301095 --> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7e70159670 con 0x7f7e50066120 2023-07-21T22:57:41.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.912+0000 7f7e66ffd640 1 -- 172.21.15.6:0/3063301095 <== mgr.10135 v2:172.21.15.161:6832/2599285906 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f7e580ac8f0 con 0x7f7e50066120 2023-07-21T22:57:41.950 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:41.950 INFO:teuthology.orchestra.run.smithi006.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-07-21T22:57:41.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.916+0000 7f7e7491e640 1 -- 172.21.15.6:0/3063301095 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f7e50066120 msgr2=0x7f7e500685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:41.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.916+0000 7f7e7491e640 1 --2- 172.21.15.6:0/3063301095 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f7e50066120 0x7f7e500685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7e580ae000 tx=0x7f7e580a7000 comp rx=0 tx=0).stop 2023-07-21T22:57:41.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.916+0000 7f7e7491e640 1 -- 172.21.15.6:0/3063301095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e700aeb40 msgr2=0x7f7e7014d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:41.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.916+0000 7f7e7491e640 1 --2- 172.21.15.6:0/3063301095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e700aeb40 0x7f7e7014d7e0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000ebe0 tx=0x7f7e6000c520 comp rx=0 tx=0).stop 2023-07-21T22:57:41.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.916+0000 7f7e7491e640 1 -- 172.21.15.6:0/3063301095 shutdown_connections 2023-07-21T22:57:41.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.916+0000 7f7e7491e640 1 --2- 172.21.15.6:0/3063301095 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f7e50066120 0x7f7e500685d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.916+0000 7f7e7491e640 1 --2- 172.21.15.6:0/3063301095 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e70159270 0x7f7e7006f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.916+0000 7f7e7491e640 1 --2- 172.21.15.6:0/3063301095 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e700aef10 0x7f7e70070a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.916+0000 7f7e7491e640 1 --2- 172.21.15.6:0/3063301095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e700aeb40 0x7f7e7014d7e0 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:41.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.916+0000 7f7e7491e640 1 -- 172.21.15.6:0/3063301095 >> 172.21.15.6:0/3063301095 conn(0x7f7e700cde90 msgr2=0x7f7e700c88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:41.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.916+0000 7f7e7491e640 1 -- 172.21.15.6:0/3063301095 shutdown_connections 2023-07-21T22:57:41.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:41.916+0000 7f7e7491e640 1 -- 172.21.15.6:0/3063301095 wait complete. 2023-07-21T22:57:41.971 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-07-21T22:57:41.971 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-07-21T22:57:41.972 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-21T22:57:42.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.088+0000 7f56c367b640 1 Processor -- start 2023-07-21T22:57:42.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.088+0000 7f56c367b640 1 -- start start 2023-07-21T22:57:42.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.088+0000 7f56c367b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56bc15bba0 0x7f56bc0c4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:42.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.088+0000 7f56c367b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f56bc0c2d30 0x7f56bc0acd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:42.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.088+0000 7f56c367b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56bc0ad280 0x7f56bc0ab890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:42.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.088+0000 7f56c367b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56bc0ad700 con 0x7f56bc0ad280 2023-07-21T22:57:42.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.088+0000 7f56c367b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56bc15bf70 con 0x7f56bc0c2d30 2023-07-21T22:57:42.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.088+0000 7f56c367b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc1600e0 con 0x7f56bc15bba0 2023-07-21T22:57:42.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.088+0000 7f56c1c18640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56bc0ad280 0x7f56bc0ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:42.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.088+0000 7f56c1c18640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f56bc0ad280 0x7f56bc0ab890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46144/0 (socket says 172.21.15.6:46144) 2023-07-21T22:57:42.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.088+0000 7f56c1c18640 1 -- 172.21.15.6:0/2491593872 learned_addr learned my addr 172.21.15.6:0/2491593872 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:42.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.088+0000 7f56c1417640 1 --2- 172.21.15.6:0/2491593872 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56bc15bba0 0x7f56bc0c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:42.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.088+0000 7f56c0c16640 1 --2- 172.21.15.6:0/2491593872 >> v2:172.21.15.161:3300/0 conn(0x7f56bc0c2d30 0x7f56bc0acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:42.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.088+0000 7f56c1c18640 1 -- 172.21.15.6:0/2491593872 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56bc15bba0 msgr2=0x7f56bc0c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:42.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.088+0000 7f56c1c18640 1 --2- 172.21.15.6:0/2491593872 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56bc15bba0 0x7f56bc0c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:42.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.088+0000 7f56c1c18640 1 -- 172.21.15.6:0/2491593872 >> v2:172.21.15.161:3300/0 conn(0x7f56bc0c2d30 msgr2=0x7f56bc0acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:42.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.088+0000 7f56c1c18640 1 --2- 172.21.15.6:0/2491593872 >> v2:172.21.15.161:3300/0 conn(0x7f56bc0c2d30 0x7f56bc0acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:42.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.088+0000 7f56c1c18640 1 -- 172.21.15.6:0/2491593872 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56bc0c4d00 con 0x7f56bc0ad280 2023-07-21T22:57:42.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.092+0000 7f56c1c18640 1 --2- 172.21.15.6:0/2491593872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56bc0ad280 0x7f56bc0ab890 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f56bc06ed50 tx=0x7f56b401c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42fbd444ba6bb49b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:42.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.092+0000 7f56b3fff640 1 -- 172.21.15.6:0/2491593872 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b40a6450 con 0x7f56bc0ad280 2023-07-21T22:57:42.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.092+0000 7f56b3fff640 1 -- 172.21.15.6:0/2491593872 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b40a65b0 con 0x7f56bc0ad280 2023-07-21T22:57:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.092+0000 7f56b3fff640 1 -- 172.21.15.6:0/2491593872 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b40a6940 con 0x7f56bc0ad280 2023-07-21T22:57:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.092+0000 7f56c367b640 1 -- 172.21.15.6:0/2491593872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56bc0ad280 msgr2=0x7f56bc0ab890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:42.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.092+0000 7f56c367b640 1 --2- 172.21.15.6:0/2491593872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56bc0ad280 0x7f56bc0ab890 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f56bc06ed50 tx=0x7f56b401c5c0 comp rx=0 tx=0).stop 2023-07-21T22:57:42.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.092+0000 7f56c367b640 1 -- 172.21.15.6:0/2491593872 shutdown_connections 2023-07-21T22:57:42.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.092+0000 7f56c367b640 1 --2- 172.21.15.6:0/2491593872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56bc0ad280 0x7f56bc0ab890 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:42.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.092+0000 7f56c367b640 1 --2- 172.21.15.6:0/2491593872 >> v2:172.21.15.161:3300/0 conn(0x7f56bc0c2d30 0x7f56bc0acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:42.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.092+0000 7f56c367b640 1 --2- 172.21.15.6:0/2491593872 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56bc15bba0 0x7f56bc0c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:42.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.092+0000 7f56c367b640 1 -- 172.21.15.6:0/2491593872 >> 172.21.15.6:0/2491593872 conn(0x7f56bc0cde90 msgr2=0x7f56bc0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:42.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.092+0000 7f56c367b640 1 -- 172.21.15.6:0/2491593872 shutdown_connections 2023-07-21T22:57:42.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.092+0000 7f56c367b640 1 -- 172.21.15.6:0/2491593872 wait complete. 2023-07-21T22:57:42.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c367b640 1 Processor -- start 2023-07-21T22:57:42.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c367b640 1 -- start start 2023-07-21T22:57:42.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c367b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56bc0ad280 0x7f56bc0cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:42.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c367b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56bc0c2d30 0x7f56bc13d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:42.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c367b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56bc15bba0 0x7f56bc153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c367b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc0cc510 con 0x7f56bc0ad280 2023-07-21T22:57:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c367b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc153c80 con 0x7f56bc15bba0 2023-07-21T22:57:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c367b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc0cbbe0 con 0x7f56bc0c2d30 2023-07-21T22:57:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c1417640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56bc0ad280 0x7f56bc0cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c1417640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56bc0ad280 0x7f56bc0cd7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46158/0 (socket says 172.21.15.6:46158) 2023-07-21T22:57:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c1417640 1 -- 172.21.15.6:0/1880502382 learned_addr learned my addr 172.21.15.6:0/1880502382 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:42.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c0c16640 1 --2- 172.21.15.6:0/1880502382 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56bc0c2d30 0x7f56bc13d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:42.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c1c18640 1 --2- 172.21.15.6:0/1880502382 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56bc15bba0 0x7f56bc153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:42.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c1417640 1 -- 172.21.15.6:0/1880502382 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56bc0c2d30 msgr2=0x7f56bc13d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:42.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c1417640 1 --2- 172.21.15.6:0/1880502382 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56bc0c2d30 0x7f56bc13d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:42.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c1417640 1 -- 172.21.15.6:0/1880502382 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56bc15bba0 msgr2=0x7f56bc153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:42.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c1417640 1 --2- 172.21.15.6:0/1880502382 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56bc15bba0 0x7f56bc153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:42.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c1417640 1 -- 172.21.15.6:0/1880502382 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b4009b30 con 0x7f56bc0ad280 2023-07-21T22:57:42.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c1417640 1 --2- 172.21.15.6:0/1880502382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56bc0ad280 0x7f56bc0cd7f0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f56b800e870 tx=0x7f56b800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:42.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56b1ffb640 1 -- 172.21.15.6:0/1880502382 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b8009510 con 0x7f56bc0ad280 2023-07-21T22:57:42.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56b1ffb640 1 -- 172.21.15.6:0/1880502382 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b800eec0 con 0x7f56bc0ad280 2023-07-21T22:57:42.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56b1ffb640 1 -- 172.21.15.6:0/1880502382 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b800cb40 con 0x7f56bc0ad280 2023-07-21T22:57:42.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c367b640 1 -- 172.21.15.6:0/1880502382 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56bc0cbec0 con 0x7f56bc0ad280 2023-07-21T22:57:42.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.096+0000 7f56c367b640 1 -- 172.21.15.6:0/1880502382 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56bc13e0d0 con 0x7f56bc0ad280 2023-07-21T22:57:42.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.100+0000 7f56c367b640 1 -- 172.21.15.6:0/1880502382 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56bc0678d0 con 0x7f56bc0ad280 2023-07-21T22:57:42.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.100+0000 7f56b1ffb640 1 -- 172.21.15.6:0/1880502382 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 94) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f56b800cca0 con 0x7f56bc0ad280 2023-07-21T22:57:42.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.100+0000 7f56b1ffb640 1 --2- 172.21.15.6:0/1880502382 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f56a00664b0 0x7f56a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:42.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.100+0000 7f56b1ffb640 1 -- 172.21.15.6:0/1880502382 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f56b8084380 con 0x7f56bc0ad280 2023-07-21T22:57:42.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.100+0000 7f56c0c16640 1 --2- 172.21.15.6:0/1880502382 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f56a00664b0 0x7f56a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:42.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.100+0000 7f56c0c16640 1 --2- 172.21.15.6:0/1880502382 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f56a00664b0 0x7f56a0068960 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f56bc15b4f0 tx=0x7f56ac008040 comp rx=0 tx=0).ready entity=mgr.10135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:42.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.104+0000 7f56b1ffb640 1 -- 172.21.15.6:0/1880502382 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f56b80513d0 con 0x7f56bc0ad280 2023-07-21T22:57:42.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.276+0000 7f56c367b640 1 -- 172.21.15.6:0/1880502382 --> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f56bc0cbd50 con 0x7f56a00664b0 2023-07-21T22:57:42.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.344+0000 7f56b1ffb640 1 -- 172.21.15.6:0/1880502382 <== mgr.10135 v2:172.21.15.161:6832/2599285906 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f56bc0cbd50 con 0x7f56a00664b0 2023-07-21T22:57:42.379 INFO:teuthology.orchestra.run.smithi006.stdout:Schedule removed for path snap_test_dir1 2023-07-21T22:57:42.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.344+0000 7f56c367b640 1 -- 172.21.15.6:0/1880502382 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f56a00664b0 msgr2=0x7f56a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.344+0000 7f56c367b640 1 --2- 172.21.15.6:0/1880502382 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f56a00664b0 0x7f56a0068960 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f56bc15b4f0 tx=0x7f56ac008040 comp rx=0 tx=0).stop 2023-07-21T22:57:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.344+0000 7f56c367b640 1 -- 172.21.15.6:0/1880502382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56bc0ad280 msgr2=0x7f56bc0cd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.344+0000 7f56c367b640 1 --2- 172.21.15.6:0/1880502382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56bc0ad280 0x7f56bc0cd7f0 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f56b800e870 tx=0x7f56b800ec70 comp rx=0 tx=0).stop 2023-07-21T22:57:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.344+0000 7f56c367b640 1 -- 172.21.15.6:0/1880502382 shutdown_connections 2023-07-21T22:57:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.344+0000 7f56c367b640 1 --2- 172.21.15.6:0/1880502382 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f56a00664b0 0x7f56a0068960 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:42.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.344+0000 7f56c367b640 1 --2- 172.21.15.6:0/1880502382 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56bc15bba0 0x7f56bc153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.344+0000 7f56c367b640 1 --2- 172.21.15.6:0/1880502382 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f56bc0c2d30 0x7f56bc13d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.344+0000 7f56c367b640 1 --2- 172.21.15.6:0/1880502382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56bc0ad280 0x7f56bc0cd7f0 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.344+0000 7f56c367b640 1 -- 172.21.15.6:0/1880502382 >> 172.21.15.6:0/1880502382 conn(0x7f56bc0cde90 msgr2=0x7f56bc06f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.344+0000 7f56c367b640 1 -- 172.21.15.6:0/1880502382 shutdown_connections 2023-07-21T22:57:42.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.344+0000 7f56c367b640 1 -- 172.21.15.6:0/1880502382 wait complete. 2023-07-21T22:57:42.400 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-21T22:57:42.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:42.400 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-21T22:57:42.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:42.411 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-21T22:57:42.468 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-21T22:57:42.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.620+0000 7f816580b640 1 Processor -- start 2023-07-21T22:57:42.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.620+0000 7f816580b640 1 -- start start 2023-07-21T22:57:42.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.620+0000 7f816580b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81600d22e0 0x7f81600d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:42.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.620+0000 7f816580b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81600b2140 con 0x7f8160145430 2023-07-21T22:57:42.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.620+0000 7f816580b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81600b2410 con 0x7f81600d06b0 2023-07-21T22:57:42.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.620+0000 7f816580b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81600d2cc0 con 0x7f81600d22e0 2023-07-21T22:57:42.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.620+0000 7f815e7fc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8160145430 0x7f81600b34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35178/0 (socket says 172.21.15.6:35178) 2023-07-21T22:57:42.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.620+0000 7f815e7fc640 1 -- 172.21.15.6:0/542795736 learned_addr learned my addr 172.21.15.6:0/542795736 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:42.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815f7fe640 1 --2- 172.21.15.6:0/542795736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81600d22e0 0x7f81600d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:42.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815dffb640 1 -- 172.21.15.6:0/542795736 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501537084 0 0) 0x7f81600b2140 con 0x7f8160145430 2023-07-21T22:57:42.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815dffb640 1 -- 172.21.15.6:0/542795736 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8148003530 con 0x7f8160145430 2023-07-21T22:57:42.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815dffb640 1 -- 172.21.15.6:0/542795736 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039070721 0 0) 0x7f81600b2410 con 0x7f81600d06b0 2023-07-21T22:57:42.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815dffb640 1 -- 172.21.15.6:0/542795736 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81600b2140 con 0x7f81600d06b0 2023-07-21T22:57:42.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815dffb640 1 -- 172.21.15.6:0/542795736 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2393389913 0 0) 0x7f8148003530 con 0x7f8160145430 2023-07-21T22:57:42.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815dffb640 1 -- 172.21.15.6:0/542795736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81600d22e0 msgr2=0x7f81600d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:42.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815dffb640 1 --2- 172.21.15.6:0/542795736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81600d22e0 0x7f81600d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:42.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815dffb640 1 -- 172.21.15.6:0/542795736 >> v1:172.21.15.161:6789/0 conn(0x7f81600d06b0 legacy=0x7f81600b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:42.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815dffb640 1 -- 172.21.15.6:0/542795736 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81600b26f0 con 0x7f8160145430 2023-07-21T22:57:42.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815dffb640 1 -- 172.21.15.6:0/542795736 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f8154001680 con 0x7f8160145430 2023-07-21T22:57:42.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815dffb640 1 -- 172.21.15.6:0/542795736 >> v1:172.21.15.6:6789/0 conn(0x7f8160145430 legacy=0x7f81600b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:42.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815dffb640 1 --2- 172.21.15.6:0/542795736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8148003b40 0x7f8148003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:42.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815dffb640 1 --2- 172.21.15.6:0/542795736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81600d22e0 0x7f81480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:42.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815dffb640 1 --2- 172.21.15.6:0/542795736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8148004d10 0x7f8148005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:42.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815dffb640 1 -- 172.21.15.6:0/542795736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814800ba40 con 0x7f8148003b40 2023-07-21T22:57:42.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815dffb640 1 -- 172.21.15.6:0/542795736 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814800bb80 con 0x7f8148004d10 2023-07-21T22:57:42.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815dffb640 1 -- 172.21.15.6:0/542795736 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814800bd10 con 0x7f81600d22e0 2023-07-21T22:57:42.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815effd640 1 --2- 172.21.15.6:0/542795736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8148003b40 0x7f8148003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:42.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815e7fc640 1 --2- 172.21.15.6:0/542795736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81600d22e0 0x7f81480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:42.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815f7fe640 1 --2- 172.21.15.6:0/542795736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8148004d10 0x7f8148005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:42.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815effd640 1 -- 172.21.15.6:0/542795736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81600d22e0 msgr2=0x7f81480047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:42.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815effd640 1 --2- 172.21.15.6:0/542795736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81600d22e0 0x7f81480047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:42.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815effd640 1 -- 172.21.15.6:0/542795736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8148004d10 msgr2=0x7f8148005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:42.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815effd640 1 --2- 172.21.15.6:0/542795736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8148004d10 0x7f8148005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:42.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.624+0000 7f815effd640 1 -- 172.21.15.6:0/542795736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8148003530 con 0x7f8148003b40 2023-07-21T22:57:42.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.628+0000 7f815effd640 1 --2- 172.21.15.6:0/542795736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8148003b40 0x7f8148003f30 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f81500018d0 tx=0x7f815001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc65b60901c3102 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:42.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.628+0000 7f815dffb640 1 -- 172.21.15.6:0/542795736 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81500052d0 con 0x7f8148003b40 2023-07-21T22:57:42.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.628+0000 7f815dffb640 1 -- 172.21.15.6:0/542795736 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8150005450 con 0x7f8148003b40 2023-07-21T22:57:42.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.628+0000 7f815dffb640 1 -- 172.21.15.6:0/542795736 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8150003840 con 0x7f8148003b40 2023-07-21T22:57:42.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.628+0000 7f816580b640 1 -- 172.21.15.6:0/542795736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8148003b40 msgr2=0x7f8148003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:42.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.628+0000 7f816580b640 1 --2- 172.21.15.6:0/542795736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8148003b40 0x7f8148003f30 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f81500018d0 tx=0x7f815001c530 comp rx=0 tx=0).stop 2023-07-21T22:57:42.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.628+0000 7f815f7fe640 1 -- 172.21.15.6:0/542795736 reap_dead start 2023-07-21T22:57:42.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.628+0000 7f816580b640 1 -- 172.21.15.6:0/542795736 shutdown_connections 2023-07-21T22:57:42.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.628+0000 7f816580b640 1 -- 172.21.15.6:0/542795736 >> 172.21.15.6:0/542795736 conn(0x7f81600659d0 msgr2=0x7f816009b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:42.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.628+0000 7f816580b640 1 -- 172.21.15.6:0/542795736 shutdown_connections 2023-07-21T22:57:42.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.628+0000 7f816580b640 1 -- 172.21.15.6:0/542795736 wait complete. 2023-07-21T22:57:42.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.628+0000 7f816580b640 1 Processor -- start 2023-07-21T22:57:42.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.628+0000 7f816580b640 1 -- start start 2023-07-21T22:57:42.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.628+0000 7f816580b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8148003b40 0x7f8160154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:42.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.628+0000 7f816580b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8160153e40 0x7f81600c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:42.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.628+0000 7f816580b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81600c63c0 0x7f81600c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:42.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.628+0000 7f816580b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81600c7eb0 con 0x7f81600c63c0 2023-07-21T22:57:42.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.628+0000 7f816580b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816015afa0 con 0x7f8160153e40 2023-07-21T22:57:42.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.628+0000 7f816580b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f816015b1f0 con 0x7f8148003b40 2023-07-21T22:57:42.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.632+0000 7f815f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81600c63c0 0x7f81600c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:42.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.632+0000 7f815f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81600c63c0 0x7f81600c6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46174/0 (socket says 172.21.15.6:46174) 2023-07-21T22:57:42.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.632+0000 7f815f7fe640 1 -- 172.21.15.6:0/1764911677 learned_addr learned my addr 172.21.15.6:0/1764911677 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:42.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.632+0000 7f815e7fc640 1 --2- 172.21.15.6:0/1764911677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8160153e40 0x7f81600c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.632+0000 7f815effd640 1 --2- 172.21.15.6:0/1764911677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8148003b40 0x7f8160154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.632+0000 7f815f7fe640 1 -- 172.21.15.6:0/1764911677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8148003b40 msgr2=0x7f8160154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.632+0000 7f815f7fe640 1 --2- 172.21.15.6:0/1764911677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8148003b40 0x7f8160154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.632+0000 7f815f7fe640 1 -- 172.21.15.6:0/1764911677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8160153e40 msgr2=0x7f81600c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.632+0000 7f815f7fe640 1 --2- 172.21.15.6:0/1764911677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8160153e40 0x7f81600c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.632+0000 7f815f7fe640 1 -- 172.21.15.6:0/1764911677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81600c80c0 con 0x7f81600c63c0 2023-07-21T22:57:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.632+0000 7f815f7fe640 1 --2- 172.21.15.6:0/1764911677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81600c63c0 0x7f81600c6830 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f816008bb70 tx=0x7f8158007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:42.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.632+0000 7f8147fff640 1 -- 172.21.15.6:0/1764911677 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815800e070 con 0x7f81600c63c0 2023-07-21T22:57:42.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.632+0000 7f8147fff640 1 -- 172.21.15.6:0/1764911677 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8158003c70 con 0x7f81600c63c0 2023-07-21T22:57:42.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.632+0000 7f8147fff640 1 -- 172.21.15.6:0/1764911677 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8158003e60 con 0x7f81600c63c0 2023-07-21T22:57:42.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.632+0000 7f816580b640 1 -- 172.21.15.6:0/1764911677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81600c83a0 con 0x7f81600c63c0 2023-07-21T22:57:42.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.632+0000 7f816580b640 1 -- 172.21.15.6:0/1764911677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81600c8ba0 con 0x7f81600c63c0 2023-07-21T22:57:42.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.632+0000 7f816580b640 1 -- 172.21.15.6:0/1764911677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81600c8dc0 con 0x7f81600c63c0 2023-07-21T22:57:42.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.632+0000 7f8147fff640 1 -- 172.21.15.6:0/1764911677 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 94) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f8158004030 con 0x7f81600c63c0 2023-07-21T22:57:42.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.636+0000 7f8147fff640 1 --2- 172.21.15.6:0/1764911677 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f814c0664b0 0x7f814c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:42.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.636+0000 7f8147fff640 1 -- 172.21.15.6:0/1764911677 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f8158084180 con 0x7f81600c63c0 2023-07-21T22:57:42.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.636+0000 7f815effd640 1 --2- 172.21.15.6:0/1764911677 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f814c0664b0 0x7f814c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:42.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.636+0000 7f815effd640 1 --2- 172.21.15.6:0/1764911677 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f814c0664b0 0x7f814c068960 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f81500ad000 tx=0x7f81500a7000 comp rx=0 tx=0).ready entity=mgr.10135 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:42.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.640+0000 7f8147fff640 1 -- 172.21.15.6:0/1764911677 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f81600c8dc0 con 0x7f81600c63c0 2023-07-21T22:57:42.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:42.832+0000 7f816580b640 1 -- 172.21.15.6:0/1764911677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f81600c8dc0 con 0x7f81600c63c0 2023-07-21T22:57:43.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.092+0000 7f8147fff640 1 -- 172.21.15.6:0/1764911677 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 95) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f81580514b0 con 0x7f81600c63c0 2023-07-21T22:57:43.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.092+0000 7f8147fff640 1 -- 172.21.15.6:0/1764911677 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v95) v1 ==== 93+0+0 (secure 0 0 0) 0x7f8158080730 con 0x7f81600c63c0 2023-07-21T22:57:43.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.096+0000 7f816580b640 1 -- 172.21.15.6:0/1764911677 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f814c0664b0 msgr2=0x7f814c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:43.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.096+0000 7f816580b640 1 --2- 172.21.15.6:0/1764911677 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f814c0664b0 0x7f814c068960 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f81500ad000 tx=0x7f81500a7000 comp rx=0 tx=0).stop 2023-07-21T22:57:43.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.096+0000 7f816580b640 1 -- 172.21.15.6:0/1764911677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81600c63c0 msgr2=0x7f81600c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.096+0000 7f816580b640 1 --2- 172.21.15.6:0/1764911677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81600c63c0 0x7f81600c6830 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f816008bb70 tx=0x7f8158007dd0 comp rx=0 tx=0).stop 2023-07-21T22:57:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.096+0000 7f816580b640 1 -- 172.21.15.6:0/1764911677 shutdown_connections 2023-07-21T22:57:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.096+0000 7f816580b640 1 --2- 172.21.15.6:0/1764911677 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f814c0664b0 0x7f814c068960 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.096+0000 7f816580b640 1 --2- 172.21.15.6:0/1764911677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81600c63c0 0x7f81600c6830 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.096+0000 7f816580b640 1 --2- 172.21.15.6:0/1764911677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8160153e40 0x7f81600c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.096+0000 7f816580b640 1 --2- 172.21.15.6:0/1764911677 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8148003b40 0x7f8160154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.096+0000 7f816580b640 1 -- 172.21.15.6:0/1764911677 >> 172.21.15.6:0/1764911677 conn(0x7f81600659d0 msgr2=0x7f816015b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:43.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.096+0000 7f816580b640 1 -- 172.21.15.6:0/1764911677 shutdown_connections 2023-07-21T22:57:43.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.096+0000 7f816580b640 1 -- 172.21.15.6:0/1764911677 wait complete. 2023-07-21T22:57:43.154 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-21T22:57:43.154 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:57:43.224 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-21T22:57:43.271 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-21T22:57:43.271 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:57:43.272 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:57:43.281 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:57:43.281 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:57:43.306 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:43.272+0000 7efc1464b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:57:43.306 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:43.278+0000 7ff762e2c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:57:43.314 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:57:43.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.468+0000 7f2e51974640 1 Processor -- start 2023-07-21T22:57:43.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.468+0000 7f2e51974640 1 -- start start 2023-07-21T22:57:43.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.468+0000 7f2e51974640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2e4c0d12f0 0x7f2e4c0d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:43.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.468+0000 7f2e51974640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4c0b4840 con 0x7f2e4c0d1840 2023-07-21T22:57:43.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.468+0000 7f2e51974640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4c0ccae0 con 0x7f2e4c0b7990 2023-07-21T22:57:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.468+0000 7f2e51974640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4c0cd060 con 0x7f2e4c0d12f0 2023-07-21T22:57:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.472+0000 7f2e43fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2e4c0d12f0 0x7f2e4c0d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.472+0000 7f2e43fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2e4c0d12f0 0x7f2e4c0d0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46200/0 (socket says 172.21.15.6:46200) 2023-07-21T22:57:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.472+0000 7f2e43fff640 1 -- 172.21.15.6:0/1764867777 learned_addr learned my addr 172.21.15.6:0/1764867777 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.472+0000 7f2e43fff640 1 -- 172.21.15.6:0/1764867777 >> v1:172.21.15.161:6789/0 conn(0x7f2e4c0b7990 legacy=0x7f2e4c15f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.472+0000 7f2e43fff640 1 -- 172.21.15.6:0/1764867777 >> v1:172.21.15.6:6789/0 conn(0x7f2e4c0d1840 legacy=0x7f2e4c0d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:43.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.472+0000 7f2e4a7fc640 1 -- 172.21.15.6:0/1764867777 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386355359 0 0) 0x7f2e4c0b4840 con 0x7f2e4c0d1840 2023-07-21T22:57:43.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.472+0000 7f2e43fff640 1 -- 172.21.15.6:0/1764867777 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c160310 con 0x7f2e4c0d12f0 2023-07-21T22:57:43.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.472+0000 7f2e43fff640 1 --2- 172.21.15.6:0/1764867777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4c0d12f0 0x7f2e4c0d0c40 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f2e34009870 tx=0x7f2e3401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36915b6027c786ab server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:43.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.472+0000 7f2e4a7fc640 1 -- 172.21.15.6:0/1764867777 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e340ab600 con 0x7f2e4c0d12f0 2023-07-21T22:57:43.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.472+0000 7f2e4a7fc640 1 -- 172.21.15.6:0/1764867777 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e340a7050 con 0x7f2e4c0d12f0 2023-07-21T22:57:43.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.472+0000 7f2e4a7fc640 1 -- 172.21.15.6:0/1764867777 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e340ab980 con 0x7f2e4c0d12f0 2023-07-21T22:57:43.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.476+0000 7f2e51974640 1 -- 172.21.15.6:0/1764867777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4c0d12f0 msgr2=0x7f2e4c0d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:43.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.476+0000 7f2e51974640 1 --2- 172.21.15.6:0/1764867777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4c0d12f0 0x7f2e4c0d0c40 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f2e34009870 tx=0x7f2e3401c4b0 comp rx=0 tx=0).stop 2023-07-21T22:57:43.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.476+0000 7f2e51974640 1 -- 172.21.15.6:0/1764867777 shutdown_connections 2023-07-21T22:57:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.476+0000 7f2e51974640 1 --2- 172.21.15.6:0/1764867777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4c0d12f0 0x7f2e4c0d0c40 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.476+0000 7f2e51974640 1 -- 172.21.15.6:0/1764867777 >> 172.21.15.6:0/1764867777 conn(0x7f2e4c0650b0 msgr2=0x7f2e4c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.476+0000 7f2e51974640 1 -- 172.21.15.6:0/1764867777 shutdown_connections 2023-07-21T22:57:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.476+0000 7f2e51974640 1 -- 172.21.15.6:0/1764867777 wait complete. 2023-07-21T22:57:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.476+0000 7f2e51974640 1 Processor -- start 2023-07-21T22:57:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.476+0000 7f2e51974640 1 -- start start 2023-07-21T22:57:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.476+0000 7f2e51974640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4c0b7990 0x7f2e4c151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.476+0000 7f2e51974640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e4c0d12f0 0x7f2e4c15b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:43.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.476+0000 7f2e51974640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e4c0d1840 0x7f2e4c15b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:43.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.476+0000 7f2e51974640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0b3730 con 0x7f2e4c0b7990 2023-07-21T22:57:43.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.476+0000 7f2e51974640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c15a2d0 con 0x7f2e4c0d1840 2023-07-21T22:57:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.476+0000 7f2e51974640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c15c8e0 con 0x7f2e4c0d12f0 2023-07-21T22:57:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.476+0000 7f2e4affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4c0b7990 0x7f2e4c151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.476+0000 7f2e4affd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4c0b7990 0x7f2e4c151320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46212/0 (socket says 172.21.15.6:46212) 2023-07-21T22:57:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.476+0000 7f2e4affd640 1 -- 172.21.15.6:0/1899474740 learned_addr learned my addr 172.21.15.6:0/1899474740 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:43.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.476+0000 7f2e43fff640 1 --2- 172.21.15.6:0/1899474740 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e4c0d12f0 0x7f2e4c15b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:43.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.476+0000 7f2e4b7fe640 1 --2- 172.21.15.6:0/1899474740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e4c0d1840 0x7f2e4c15b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:43.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.480+0000 7f2e4affd640 1 -- 172.21.15.6:0/1899474740 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e4c0d12f0 msgr2=0x7f2e4c15b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:43.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.480+0000 7f2e4affd640 1 --2- 172.21.15.6:0/1899474740 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e4c0d12f0 0x7f2e4c15b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:43.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.480+0000 7f2e4affd640 1 -- 172.21.15.6:0/1899474740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e4c0d1840 msgr2=0x7f2e4c15b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:43.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.480+0000 7f2e4affd640 1 --2- 172.21.15.6:0/1899474740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e4c0d1840 0x7f2e4c15b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:43.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.480+0000 7f2e4affd640 1 -- 172.21.15.6:0/1899474740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e340094d0 con 0x7f2e4c0b7990 2023-07-21T22:57:43.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.480+0000 7f2e4b7fe640 1 --2- 172.21.15.6:0/1899474740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e4c0d1840 0x7f2e4c15b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:43.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.480+0000 7f2e4affd640 1 --2- 172.21.15.6:0/1899474740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4c0b7990 0x7f2e4c151320 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00c3f0 tx=0x7f2e3c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:43.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.480+0000 7f2e48ff9640 1 -- 172.21.15.6:0/1899474740 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c0052d0 con 0x7f2e4c0b7990 2023-07-21T22:57:43.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.480+0000 7f2e48ff9640 1 -- 172.21.15.6:0/1899474740 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3c005430 con 0x7f2e4c0b7990 2023-07-21T22:57:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.480+0000 7f2e48ff9640 1 -- 172.21.15.6:0/1899474740 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e3c003840 con 0x7f2e4c0b7990 2023-07-21T22:57:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.480+0000 7f2e51974640 1 -- 172.21.15.6:0/1899474740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e4c0b3450 con 0x7f2e4c0b7990 2023-07-21T22:57:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.480+0000 7f2e51974640 1 -- 172.21.15.6:0/1899474740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4c15c570 con 0x7f2e4c0b7990 2023-07-21T22:57:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.480+0000 7f2e51974640 1 -- 172.21.15.6:0/1899474740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4c15c0f0 con 0x7f2e4c0b7990 2023-07-21T22:57:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.480+0000 7f2e48ff9640 1 -- 172.21.15.6:0/1899474740 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 95) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f2e3c0039a0 con 0x7f2e4c0b7990 2023-07-21T22:57:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.480+0000 7f2e48ff9640 1 --2- 172.21.15.6:0/1899474740 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f2e2c066460 0x7f2e2c068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.480+0000 7f2e48ff9640 1 -- 172.21.15.6:0/1899474740 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f2e3c083700 con 0x7f2e4c0b7990 2023-07-21T22:57:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.480+0000 7f2e43fff640 1 -- 172.21.15.6:0/1899474740 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f2e2c066460 msgr2=0x7f2e2c068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2599285906 2023-07-21T22:57:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.484+0000 7f2e43fff640 1 --2- 172.21.15.6:0/1899474740 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f2e2c066460 0x7f2e2c068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.488+0000 7f2e48ff9640 1 -- 172.21.15.6:0/1899474740 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2e4c15c0f0 con 0x7f2e4c0b7990 2023-07-21T22:57:43.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.644+0000 7f2e51974640 1 -- 172.21.15.6:0/1899474740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e4c15c0f0 con 0x7f2e4c0b7990 2023-07-21T22:57:43.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.644+0000 7f2e48ff9640 1 -- 172.21.15.6:0/1899474740 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+18840 (secure 0 0 0) 0x7f2e4c15c0f0 con 0x7f2e4c0b7990 2023-07-21T22:57:43.680 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:43.680 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":193,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:57:40.018593+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:57:21.014468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-21T22:57:21.883517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/568512462":"2023-07-22T22:57:40.018539+0000","172.21.15.161:6833/406143921":"2023-07-22T22:57:40.018539+0000","172.21.15.161:6832/406143921":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/2299078826":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/1726684525":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/319560030":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/389011228":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/3791982345":"2023-07-22T22:57:40.018539+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:57:43.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.644+0000 7f2e51974640 1 -- 172.21.15.6:0/1899474740 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f2e2c066460 msgr2=0x7f2e2c068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.644+0000 7f2e51974640 1 --2- 172.21.15.6:0/1899474740 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f2e2c066460 0x7f2e2c068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.644+0000 7f2e51974640 1 -- 172.21.15.6:0/1899474740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4c0b7990 msgr2=0x7f2e4c151320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.644+0000 7f2e51974640 1 --2- 172.21.15.6:0/1899474740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4c0b7990 0x7f2e4c151320 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00c3f0 tx=0x7f2e3c00c8b0 comp rx=0 tx=0).stop 2023-07-21T22:57:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.644+0000 7f2e51974640 1 -- 172.21.15.6:0/1899474740 shutdown_connections 2023-07-21T22:57:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.644+0000 7f2e51974640 1 --2- 172.21.15.6:0/1899474740 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f2e2c066460 0x7f2e2c068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.644+0000 7f2e51974640 1 --2- 172.21.15.6:0/1899474740 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e4c0d1840 0x7f2e4c15b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:43.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.644+0000 7f2e51974640 1 --2- 172.21.15.6:0/1899474740 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2e4c0d12f0 0x7f2e4c15b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:43.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.644+0000 7f2e51974640 1 --2- 172.21.15.6:0/1899474740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e4c0b7990 0x7f2e4c151320 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:43.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.644+0000 7f2e51974640 1 -- 172.21.15.6:0/1899474740 >> 172.21.15.6:0/1899474740 conn(0x7f2e4c0650b0 msgr2=0x7f2e4c065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:43.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.648+0000 7f2e51974640 1 -- 172.21.15.6:0/1899474740 shutdown_connections 2023-07-21T22:57:43.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.648+0000 7f2e51974640 1 -- 172.21.15.6:0/1899474740 wait complete. 2023-07-21T22:57:43.702 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:57:21.014468+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '191', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:57:21.883517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '192', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:57:43.703 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:57:43.721 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:43.694+0000 7ff762e2c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:57:43.755 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:43.720+0000 7efc1464b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:57:43.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.820+0000 7f75d1ebc640 1 Processor -- start 2023-07-21T22:57:43.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.820+0000 7f75d1ebc640 1 -- start start 2023-07-21T22:57:43.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.820+0000 7f75d1ebc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f75cc0cc960 0x7f75cc0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:43.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.824+0000 7f75d1ebc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75cc160750 0x7f75cc15c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:43.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.824+0000 7f75d1ebc640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75cc0cd270 con 0x7f75cc0b1620 2023-07-21T22:57:43.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.824+0000 7f75d1ebc640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75cc0cf710 con 0x7f75cc0cc960 2023-07-21T22:57:43.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.824+0000 7f75d1ebc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0cf430 con 0x7f75cc160750 2023-07-21T22:57:43.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.824+0000 7f75cbfff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f75cc0b1620 0x7f75cc0ce950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35204/0 (socket says 172.21.15.6:35204) 2023-07-21T22:57:43.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.824+0000 7f75cbfff640 1 -- 172.21.15.6:0/224375073 learned_addr learned my addr 172.21.15.6:0/224375073 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:43.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.824+0000 7f75d0eba640 1 --2- 172.21.15.6:0/224375073 >> v2:172.21.15.161:3300/0 conn(0x7f75cc0cc960 0x7f75cc0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:43.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.824+0000 7f75d16bb640 1 --2- 172.21.15.6:0/224375073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75cc160750 0x7f75cc15c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:43.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.824+0000 7f75cb7fe640 1 -- 172.21.15.6:0/224375073 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549223861 0 0) 0x7f75cc0cd270 con 0x7f75cc0b1620 2023-07-21T22:57:43.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.824+0000 7f75cb7fe640 1 -- 172.21.15.6:0/224375073 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75bc003530 con 0x7f75cc0b1620 2023-07-21T22:57:43.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.824+0000 7f75d0eba640 1 -- 172.21.15.6:0/224375073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75cc160750 msgr2=0x7f75cc15c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:43.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.824+0000 7f75d0eba640 1 --2- 172.21.15.6:0/224375073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75cc160750 0x7f75cc15c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:43.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.824+0000 7f75d0eba640 1 -- 172.21.15.6:0/224375073 >> v1:172.21.15.6:6789/0 conn(0x7f75cc0b1620 legacy=0x7f75cc0ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:43.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.824+0000 7f75d0eba640 1 -- 172.21.15.6:0/224375073 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc15fc70 con 0x7f75cc0cc960 2023-07-21T22:57:43.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.824+0000 7f75d0eba640 1 --2- 172.21.15.6:0/224375073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75cc0cc960 0x7f75cc0ccd30 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f75c00097c0 tx=0x7f75c001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69226a70006bc876 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:43.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.828+0000 7f75cb7fe640 1 -- 172.21.15.6:0/224375073 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c00ab650 con 0x7f75cc0cc960 2023-07-21T22:57:43.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.828+0000 7f75cb7fe640 1 -- 172.21.15.6:0/224375073 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c00ab7b0 con 0x7f75cc0cc960 2023-07-21T22:57:43.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.828+0000 7f75cb7fe640 1 -- 172.21.15.6:0/224375073 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c00abb40 con 0x7f75cc0cc960 2023-07-21T22:57:43.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.828+0000 7f75d1ebc640 1 -- 172.21.15.6:0/224375073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75cc0cc960 msgr2=0x7f75cc0ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:43.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.828+0000 7f75d1ebc640 1 --2- 172.21.15.6:0/224375073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75cc0cc960 0x7f75cc0ccd30 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f75c00097c0 tx=0x7f75c001c450 comp rx=0 tx=0).stop 2023-07-21T22:57:43.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.828+0000 7f75d1ebc640 1 -- 172.21.15.6:0/224375073 shutdown_connections 2023-07-21T22:57:43.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.828+0000 7f75d1ebc640 1 --2- 172.21.15.6:0/224375073 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75cc160750 0x7f75cc15c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:43.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.828+0000 7f75d1ebc640 1 --2- 172.21.15.6:0/224375073 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75cc0cc960 0x7f75cc0ccd30 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:43.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.828+0000 7f75d1ebc640 1 -- 172.21.15.6:0/224375073 >> 172.21.15.6:0/224375073 conn(0x7f75cc069f50 msgr2=0x7f75cc06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:43.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.828+0000 7f75d1ebc640 1 -- 172.21.15.6:0/224375073 shutdown_connections 2023-07-21T22:57:43.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.828+0000 7f75d1ebc640 1 -- 172.21.15.6:0/224375073 wait complete. 2023-07-21T22:57:43.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.828+0000 7f75d1ebc640 1 Processor -- start 2023-07-21T22:57:43.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.828+0000 7f75d1ebc640 1 -- start start 2023-07-21T22:57:43.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75d1ebc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75cc0b1620 0x7f75cc155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:43.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75d1ebc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75cc0cc960 0x7f75cc0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:43.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75d1ebc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75cc160750 0x7f75cc0cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:43.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75d1ebc640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0b3d90 con 0x7f75cc0b1620 2023-07-21T22:57:43.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75d1ebc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0b4030 con 0x7f75cc0cc960 2023-07-21T22:57:43.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75d1ebc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75cc0b4310 con 0x7f75cc160750 2023-07-21T22:57:43.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75d0eba640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75cc0b1620 0x7f75cc155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:43.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75d0eba640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75cc0b1620 0x7f75cc155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46224/0 (socket says 172.21.15.6:46224) 2023-07-21T22:57:43.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75d0eba640 1 -- 172.21.15.6:0/1130115861 learned_addr learned my addr 172.21.15.6:0/1130115861 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:43.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75cbfff640 1 --2- 172.21.15.6:0/1130115861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75cc0cc960 0x7f75cc0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:43.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75d16bb640 1 --2- 172.21.15.6:0/1130115861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75cc160750 0x7f75cc0cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:43.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75d0eba640 1 -- 172.21.15.6:0/1130115861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75cc160750 msgr2=0x7f75cc0cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:43.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75d0eba640 1 --2- 172.21.15.6:0/1130115861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75cc160750 0x7f75cc0cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:43.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75d0eba640 1 -- 172.21.15.6:0/1130115861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75cc0cc960 msgr2=0x7f75cc0b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:43.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75d0eba640 1 --2- 172.21.15.6:0/1130115861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75cc0cc960 0x7f75cc0b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:43.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75d0eba640 1 -- 172.21.15.6:0/1130115861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c0009420 con 0x7f75cc0b1620 2023-07-21T22:57:43.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75d0eba640 1 --2- 172.21.15.6:0/1130115861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75cc0b1620 0x7f75cc155810 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f75c00ad040 tx=0x7f75c001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:43.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75c97fa640 1 -- 172.21.15.6:0/1130115861 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c00bf610 con 0x7f75cc0b1620 2023-07-21T22:57:43.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75c97fa640 1 -- 172.21.15.6:0/1130115861 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c00bf7b0 con 0x7f75cc0b1620 2023-07-21T22:57:43.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75d1ebc640 1 -- 172.21.15.6:0/1130115861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75cc0b45f0 con 0x7f75cc0b1620 2023-07-21T22:57:43.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75c97fa640 1 -- 172.21.15.6:0/1130115861 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c00bfb60 con 0x7f75cc0b1620 2023-07-21T22:57:43.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75d1ebc640 1 -- 172.21.15.6:0/1130115861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75cc0c5cf0 con 0x7f75cc0b1620 2023-07-21T22:57:43.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75d1ebc640 1 -- 172.21.15.6:0/1130115861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75cc04e020 con 0x7f75cc0b1620 2023-07-21T22:57:43.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.832+0000 7f75c97fa640 1 -- 172.21.15.6:0/1130115861 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 95) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f75c00b5400 con 0x7f75cc0b1620 2023-07-21T22:57:43.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.836+0000 7f75c97fa640 1 --2- 172.21.15.6:0/1130115861 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f75b0066430 0x7f75b00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:43.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.836+0000 7f75c97fa640 1 -- 172.21.15.6:0/1130115861 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f75c011efe0 con 0x7f75cc0b1620 2023-07-21T22:57:43.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.836+0000 7f75cbfff640 1 -- 172.21.15.6:0/1130115861 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f75b0066430 msgr2=0x7f75b00688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2599285906 2023-07-21T22:57:43.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.836+0000 7f75cbfff640 1 --2- 172.21.15.6:0/1130115861 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f75b0066430 0x7f75b00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:43.874 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:43.846+0000 7ff762e2c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:57:43.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:43.840+0000 7f75c97fa640 1 -- 172.21.15.6:0/1130115861 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f75c00ec2f0 con 0x7f75cc0b1620 2023-07-21T22:57:43.929 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:43.896+0000 7efc1464b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:57:44.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.008+0000 7f75d1ebc640 1 -- 172.21.15.6:0/1130115861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f75cc0cfad0 con 0x7f75cc0b1620 2023-07-21T22:57:44.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.008+0000 7f75c97fa640 1 -- 172.21.15.6:0/1130115861 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v193) v1 ==== 93+0+10 (secure 0 0 0) 0x7f75c00ef910 con 0x7f75cc0b1620 2023-07-21T22:57:44.044 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:57:44.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.008+0000 7f75d1ebc640 1 -- 172.21.15.6:0/1130115861 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f75b0066430 msgr2=0x7f75b00688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:44.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.008+0000 7f75d1ebc640 1 --2- 172.21.15.6:0/1130115861 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f75b0066430 0x7f75b00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.008+0000 7f75d1ebc640 1 -- 172.21.15.6:0/1130115861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75cc0b1620 msgr2=0x7f75cc155810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:44.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.008+0000 7f75d1ebc640 1 --2- 172.21.15.6:0/1130115861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75cc0b1620 0x7f75cc155810 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f75c00ad040 tx=0x7f75c001ac90 comp rx=0 tx=0).stop 2023-07-21T22:57:44.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.012+0000 7f75d1ebc640 1 -- 172.21.15.6:0/1130115861 shutdown_connections 2023-07-21T22:57:44.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.012+0000 7f75d1ebc640 1 --2- 172.21.15.6:0/1130115861 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f75b0066430 0x7f75b00688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.012+0000 7f75d1ebc640 1 --2- 172.21.15.6:0/1130115861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75cc160750 0x7f75cc0cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.012+0000 7f75d1ebc640 1 --2- 172.21.15.6:0/1130115861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75cc0cc960 0x7f75cc0b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.012+0000 7f75d1ebc640 1 --2- 172.21.15.6:0/1130115861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75cc0b1620 0x7f75cc155810 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.012+0000 7f75d1ebc640 1 -- 172.21.15.6:0/1130115861 >> 172.21.15.6:0/1130115861 conn(0x7f75cc069f50 msgr2=0x7f75cc15d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:44.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.012+0000 7f75d1ebc640 1 -- 172.21.15.6:0/1130115861 shutdown_connections 2023-07-21T22:57:44.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.012+0000 7f75d1ebc640 1 -- 172.21.15.6:0/1130115861 wait complete. 2023-07-21T22:57:44.067 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:57:44.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.180+0000 7f65c0248640 1 Processor -- start 2023-07-21T22:57:44.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.180+0000 7f65c0248640 1 -- start start 2023-07-21T22:57:44.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.180+0000 7f65c0248640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65b80d2300 0x7f65b80d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:44.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.180+0000 7f65c0248640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b80b04c0 con 0x7f65b815bde0 2023-07-21T22:57:44.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.180+0000 7f65c0248640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b80b1060 con 0x7f65b80d2fc0 2023-07-21T22:57:44.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.180+0000 7f65c0248640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b815c1b0 con 0x7f65b80d2300 2023-07-21T22:57:44.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.180+0000 7f65bdfe4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f65b815bde0 0x7f65b80d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35214/0 (socket says 172.21.15.6:35214) 2023-07-21T22:57:44.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.180+0000 7f65bdfe4640 1 -- 172.21.15.6:0/3653587773 learned_addr learned my addr 172.21.15.6:0/3653587773 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:44.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.180+0000 7f65be7e5640 1 --2- 172.21.15.6:0/3653587773 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65b80d2300 0x7f65b80d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:44.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.180+0000 7f65bcfe2640 1 -- 172.21.15.6:0/3653587773 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707422165 0 0) 0x7f65b80b04c0 con 0x7f65b815bde0 2023-07-21T22:57:44.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.180+0000 7f65bcfe2640 1 -- 172.21.15.6:0/3653587773 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65a4003530 con 0x7f65b815bde0 2023-07-21T22:57:44.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.180+0000 7f65bcfe2640 1 -- 172.21.15.6:0/3653587773 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604539862 0 0) 0x7f65b80b1060 con 0x7f65b80d2fc0 2023-07-21T22:57:44.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.180+0000 7f65bcfe2640 1 -- 172.21.15.6:0/3653587773 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65b80b04c0 con 0x7f65b80d2fc0 2023-07-21T22:57:44.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.180+0000 7f65be7e5640 1 -- 172.21.15.6:0/3653587773 >> v1:172.21.15.161:6789/0 conn(0x7f65b80d2fc0 legacy=0x7f65b80b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:44.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.184+0000 7f65be7e5640 1 -- 172.21.15.6:0/3653587773 >> v1:172.21.15.6:6789/0 conn(0x7f65b815bde0 legacy=0x7f65b80d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:44.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.184+0000 7f65bcfe2640 1 -- 172.21.15.6:0/3653587773 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2775004438 0 0) 0x7f65a4003530 con 0x7f65b815bde0 2023-07-21T22:57:44.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.184+0000 7f65be7e5640 1 -- 172.21.15.6:0/3653587773 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b80d0aa0 con 0x7f65b80d2300 2023-07-21T22:57:44.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.184+0000 7f65be7e5640 1 --2- 172.21.15.6:0/3653587773 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65b80d2300 0x7f65b80d2780 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f65b0009dc0 tx=0x7f65b001c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8cf1a1f663f7cf5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:44.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.184+0000 7f65bcfe2640 1 -- 172.21.15.6:0/3653587773 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b4001800 con 0x7f65b80d2300 2023-07-21T22:57:44.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.184+0000 7f65bcfe2640 1 -- 172.21.15.6:0/3653587773 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b00a55e0 con 0x7f65b80d2300 2023-07-21T22:57:44.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.184+0000 7f65bcfe2640 1 -- 172.21.15.6:0/3653587773 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00a5970 con 0x7f65b80d2300 2023-07-21T22:57:44.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.184+0000 7f65c0248640 1 -- 172.21.15.6:0/3653587773 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65b80d2300 msgr2=0x7f65b80d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:44.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.184+0000 7f65c0248640 1 --2- 172.21.15.6:0/3653587773 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65b80d2300 0x7f65b80d2780 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f65b0009dc0 tx=0x7f65b001c890 comp rx=0 tx=0).stop 2023-07-21T22:57:44.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65c0248640 1 -- 172.21.15.6:0/3653587773 shutdown_connections 2023-07-21T22:57:44.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65c0248640 1 --2- 172.21.15.6:0/3653587773 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65b80d2300 0x7f65b80d2780 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65c0248640 1 -- 172.21.15.6:0/3653587773 >> 172.21.15.6:0/3653587773 conn(0x7f65b80659d0 msgr2=0x7f65b809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:44.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65c0248640 1 -- 172.21.15.6:0/3653587773 shutdown_connections 2023-07-21T22:57:44.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65c0248640 1 -- 172.21.15.6:0/3653587773 wait complete. 2023-07-21T22:57:44.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65c0248640 1 Processor -- start 2023-07-21T22:57:44.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65c0248640 1 -- start start 2023-07-21T22:57:44.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65c0248640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65b80d2300 0x7f65b80cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:44.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65c0248640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65b80d2fc0 0x7f65b8153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:44.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65c0248640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65b815bde0 0x7f65b80c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:44.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65c0248640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b80c63e0 con 0x7f65b80d2300 2023-07-21T22:57:44.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65c0248640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b80c6680 con 0x7f65b80d2fc0 2023-07-21T22:57:44.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65c0248640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b80c6960 con 0x7f65b815bde0 2023-07-21T22:57:44.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65bdfe4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65b80d2300 0x7f65b80cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:44.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65bdfe4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65b80d2300 0x7f65b80cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46226/0 (socket says 172.21.15.6:46226) 2023-07-21T22:57:44.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65bdfe4640 1 -- 172.21.15.6:0/206720365 learned_addr learned my addr 172.21.15.6:0/206720365 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:44.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65bd7e3640 1 --2- 172.21.15.6:0/206720365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65b80d2fc0 0x7f65b8153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:44.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65be7e5640 1 --2- 172.21.15.6:0/206720365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65b815bde0 0x7f65b80c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:44.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65bdfe4640 1 -- 172.21.15.6:0/206720365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65b815bde0 msgr2=0x7f65b80c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:44.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65bdfe4640 1 --2- 172.21.15.6:0/206720365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65b815bde0 0x7f65b80c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65bdfe4640 1 -- 172.21.15.6:0/206720365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65b80d2fc0 msgr2=0x7f65b8153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:44.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65bdfe4640 1 --2- 172.21.15.6:0/206720365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65b80d2fc0 0x7f65b8153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65bdfe4640 1 -- 172.21.15.6:0/206720365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b0009a70 con 0x7f65b80d2300 2023-07-21T22:57:44.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.188+0000 7f65be7e5640 1 --2- 172.21.15.6:0/206720365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65b815bde0 0x7f65b80c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:44.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.192+0000 7f65bdfe4640 1 --2- 172.21.15.6:0/206720365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65b80d2300 0x7f65b80cc410 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f65b400c780 tx=0x7f65b400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:44.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.192+0000 7f65ae7fc640 1 -- 172.21.15.6:0/206720365 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b4007480 con 0x7f65b80d2300 2023-07-21T22:57:44.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.192+0000 7f65ae7fc640 1 -- 172.21.15.6:0/206720365 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b40075e0 con 0x7f65b80d2300 2023-07-21T22:57:44.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.192+0000 7f65ae7fc640 1 -- 172.21.15.6:0/206720365 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b40059f0 con 0x7f65b80d2300 2023-07-21T22:57:44.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.192+0000 7f65c0248640 1 -- 172.21.15.6:0/206720365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b80c6c40 con 0x7f65b80d2300 2023-07-21T22:57:44.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.192+0000 7f65c0248640 1 -- 172.21.15.6:0/206720365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b80c7200 con 0x7f65b80d2300 2023-07-21T22:57:44.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.192+0000 7f65c0248640 1 -- 172.21.15.6:0/206720365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b80c7420 con 0x7f65b80d2300 2023-07-21T22:57:44.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.192+0000 7f65ae7fc640 1 -- 172.21.15.6:0/206720365 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 95) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f65b4005b50 con 0x7f65b80d2300 2023-07-21T22:57:44.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.192+0000 7f65ae7fc640 1 --2- 172.21.15.6:0/206720365 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f659c066430 0x7f659c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:44.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.192+0000 7f65ae7fc640 1 -- 172.21.15.6:0/206720365 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f65b4083990 con 0x7f65b80d2300 2023-07-21T22:57:44.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.192+0000 7f65bd7e3640 1 -- 172.21.15.6:0/206720365 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f659c066430 msgr2=0x7f659c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2599285906 2023-07-21T22:57:44.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.192+0000 7f65bd7e3640 1 --2- 172.21.15.6:0/206720365 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f659c066430 0x7f659c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:44.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.196+0000 7f65ae7fc640 1 -- 172.21.15.6:0/206720365 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f65b4050a00 con 0x7f65b80d2300 2023-07-21T22:57:44.350 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:44.322+0000 7ff762e2c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:57:44.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.352+0000 7f65c0248640 1 -- 172.21.15.6:0/206720365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f65b80678d0 con 0x7f65b80d2300 2023-07-21T22:57:44.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.352+0000 7f65ae7fc640 1 -- 172.21.15.6:0/206720365 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v193) v1 ==== 92+0+10 (secure 0 0 0) 0x7f65b40170a0 con 0x7f65b80d2300 2023-07-21T22:57:44.389 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:57:44.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.356+0000 7f65c0248640 1 -- 172.21.15.6:0/206720365 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f659c066430 msgr2=0x7f659c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:44.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.356+0000 7f65c0248640 1 --2- 172.21.15.6:0/206720365 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f659c066430 0x7f659c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.356+0000 7f65c0248640 1 -- 172.21.15.6:0/206720365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65b80d2300 msgr2=0x7f65b80cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:44.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.356+0000 7f65c0248640 1 --2- 172.21.15.6:0/206720365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65b80d2300 0x7f65b80cc410 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f65b400c780 tx=0x7f65b400cc40 comp rx=0 tx=0).stop 2023-07-21T22:57:44.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.356+0000 7f65c0248640 1 -- 172.21.15.6:0/206720365 shutdown_connections 2023-07-21T22:57:44.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.356+0000 7f65c0248640 1 --2- 172.21.15.6:0/206720365 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f659c066430 0x7f659c0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.356+0000 7f65c0248640 1 --2- 172.21.15.6:0/206720365 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65b815bde0 0x7f65b80c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.356+0000 7f65c0248640 1 --2- 172.21.15.6:0/206720365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65b80d2fc0 0x7f65b8153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.356+0000 7f65c0248640 1 --2- 172.21.15.6:0/206720365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65b80d2300 0x7f65b80cc410 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.356+0000 7f65c0248640 1 -- 172.21.15.6:0/206720365 >> 172.21.15.6:0/206720365 conn(0x7f65b80659d0 msgr2=0x7f65b80ce810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:44.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.356+0000 7f65c0248640 1 -- 172.21.15.6:0/206720365 shutdown_connections 2023-07-21T22:57:44.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.356+0000 7f65c0248640 1 -- 172.21.15.6:0/206720365 wait complete. 2023-07-21T22:57:44.409 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:44.382+0000 7ff762e2c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:57:44.411 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:57:44.448 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:44.412+0000 7efc1464b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:57:44.464 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:44.438+0000 7ff762e2c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:57:44.511 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:44.476+0000 7efc1464b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:57:44.550 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:44.522+0000 7ff762e2c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:57:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.524+0000 7f1ba5170640 1 Processor -- start 2023-07-21T22:57:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.524+0000 7f1ba5170640 1 -- start start 2023-07-21T22:57:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.528+0000 7f1ba5170640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ba00cc960 0x7f1ba00ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.528+0000 7f1ba5170640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1ba00b1620 0x7f1ba00ce950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.528+0000 7f1ba5170640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1ba0160750 0x7f1ba00b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.528+0000 7f1ba5170640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba00cf710 con 0x7f1ba0160750 2023-07-21T22:57:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.528+0000 7f1ba5170640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba00cd270 con 0x7f1ba00b1620 2023-07-21T22:57:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.528+0000 7f1ba5170640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba00cf430 con 0x7f1ba00cc960 2023-07-21T22:57:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.528+0000 7f1ba496f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1ba0160750 0x7f1ba00b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.528+0000 7f1ba496f640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1ba0160750 0x7f1ba00b3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46242/0 (socket says 172.21.15.6:46242) 2023-07-21T22:57:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.528+0000 7f1ba496f640 1 -- 172.21.15.6:0/854784887 learned_addr learned my addr 172.21.15.6:0/854784887 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.528+0000 7f1b9ffff640 1 --2- 172.21.15.6:0/854784887 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ba00cc960 0x7f1ba00ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.528+0000 7f1b9f7fe640 1 --2- 172.21.15.6:0/854784887 >> v2:172.21.15.161:3300/0 conn(0x7f1ba00b1620 0x7f1ba00ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:44.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.528+0000 7f1ba496f640 1 -- 172.21.15.6:0/854784887 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ba00cc960 msgr2=0x7f1ba00ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:44.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.528+0000 7f1ba496f640 1 --2- 172.21.15.6:0/854784887 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ba00cc960 0x7f1ba00ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.528+0000 7f1ba496f640 1 -- 172.21.15.6:0/854784887 >> v2:172.21.15.161:3300/0 conn(0x7f1ba00b1620 msgr2=0x7f1ba00ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:44.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.528+0000 7f1ba496f640 1 --2- 172.21.15.6:0/854784887 >> v2:172.21.15.161:3300/0 conn(0x7f1ba00b1620 0x7f1ba00ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.528+0000 7f1ba496f640 1 -- 172.21.15.6:0/854784887 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba015fc70 con 0x7f1ba0160750 2023-07-21T22:57:44.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.532+0000 7f1ba496f640 1 --2- 172.21.15.6:0/854784887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ba0160750 0x7f1ba00b3c40 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f1ba008b150 tx=0x7f1b9801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d35ad99295a7cf5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:44.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.532+0000 7f1b9effd640 1 -- 172.21.15.6:0/854784887 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b980a5820 con 0x7f1ba0160750 2023-07-21T22:57:44.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.532+0000 7f1b9effd640 1 -- 172.21.15.6:0/854784887 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b980a5980 con 0x7f1ba0160750 2023-07-21T22:57:44.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.532+0000 7f1b9effd640 1 -- 172.21.15.6:0/854784887 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b980a5d10 con 0x7f1ba0160750 2023-07-21T22:57:44.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.532+0000 7f1ba5170640 1 -- 172.21.15.6:0/854784887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ba0160750 msgr2=0x7f1ba00b3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:44.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.532+0000 7f1ba5170640 1 --2- 172.21.15.6:0/854784887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ba0160750 0x7f1ba00b3c40 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f1ba008b150 tx=0x7f1b9801c9a0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.532+0000 7f1ba5170640 1 -- 172.21.15.6:0/854784887 shutdown_connections 2023-07-21T22:57:44.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.532+0000 7f1ba5170640 1 --2- 172.21.15.6:0/854784887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ba0160750 0x7f1ba00b3c40 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.532+0000 7f1ba5170640 1 --2- 172.21.15.6:0/854784887 >> v2:172.21.15.161:3300/0 conn(0x7f1ba00b1620 0x7f1ba00ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.532+0000 7f1ba5170640 1 --2- 172.21.15.6:0/854784887 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ba00cc960 0x7f1ba00ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.532+0000 7f1ba5170640 1 -- 172.21.15.6:0/854784887 >> 172.21.15.6:0/854784887 conn(0x7f1ba0069f50 msgr2=0x7f1ba006a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:44.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.532+0000 7f1ba5170640 1 -- 172.21.15.6:0/854784887 shutdown_connections 2023-07-21T22:57:44.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.532+0000 7f1ba5170640 1 -- 172.21.15.6:0/854784887 wait complete. 2023-07-21T22:57:44.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.532+0000 7f1ba5170640 1 Processor -- start 2023-07-21T22:57:44.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.532+0000 7f1ba5170640 1 -- start start 2023-07-21T22:57:44.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1ba5170640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ba00b1620 0x7f1ba0158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:44.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1ba5170640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ba00cc960 0x7f1ba00b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:44.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1ba5170640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ba0160750 0x7f1ba0153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:44.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1ba5170640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba0158980 con 0x7f1ba00cc960 2023-07-21T22:57:44.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1ba5170640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba0152b20 con 0x7f1ba00b1620 2023-07-21T22:57:44.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1ba5170640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba01580e0 con 0x7f1ba0160750 2023-07-21T22:57:44.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1b9f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ba00cc960 0x7f1ba00b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:44.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1b9ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ba00b1620 0x7f1ba0158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:44.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1b9f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ba00cc960 0x7f1ba00b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46246/0 (socket says 172.21.15.6:46246) 2023-07-21T22:57:44.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1b9ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ba00b1620 0x7f1ba0158e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:46508/0 (socket says 172.21.15.6:46508) 2023-07-21T22:57:44.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1b9f7fe640 1 -- 172.21.15.6:0/3468186603 learned_addr learned my addr 172.21.15.6:0/3468186603 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:44.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1ba496f640 1 --2- 172.21.15.6:0/3468186603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ba0160750 0x7f1ba0153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:44.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1b9ffff640 1 -- 172.21.15.6:0/3468186603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ba0160750 msgr2=0x7f1ba0153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:44.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1b9ffff640 1 --2- 172.21.15.6:0/3468186603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ba0160750 0x7f1ba0153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1b9ffff640 1 -- 172.21.15.6:0/3468186603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ba00cc960 msgr2=0x7f1ba00b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:44.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1b9ffff640 1 --2- 172.21.15.6:0/3468186603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ba00cc960 0x7f1ba00b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1b9ffff640 1 -- 172.21.15.6:0/3468186603 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b98009b30 con 0x7f1ba00b1620 2023-07-21T22:57:44.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1b9f7fe640 1 --2- 172.21.15.6:0/3468186603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ba00cc960 0x7f1ba00b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:44.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1b9ffff640 1 --2- 172.21.15.6:0/3468186603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ba00b1620 0x7f1ba0158e00 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000e870 tx=0x7f1b9000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:44.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1b9cff9640 1 -- 172.21.15.6:0/3468186603 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900095d0 con 0x7f1ba00b1620 2023-07-21T22:57:44.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1b9cff9640 1 -- 172.21.15.6:0/3468186603 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9000c940 con 0x7f1ba00b1620 2023-07-21T22:57:44.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1b9cff9640 1 -- 172.21.15.6:0/3468186603 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9000ccb0 con 0x7f1ba00b1620 2023-07-21T22:57:44.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1ba5170640 1 -- 172.21.15.6:0/3468186603 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba01583c0 con 0x7f1ba00b1620 2023-07-21T22:57:44.575 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:44.536+0000 7efc1464b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:57:44.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.536+0000 7f1ba5170640 1 -- 172.21.15.6:0/3468186603 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba0153370 con 0x7f1ba00b1620 2023-07-21T22:57:44.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.540+0000 7f1ba5170640 1 -- 172.21.15.6:0/3468186603 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba01531d0 con 0x7f1ba00b1620 2023-07-21T22:57:44.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.540+0000 7f1b9cff9640 1 -- 172.21.15.6:0/3468186603 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 95) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f1b90013470 con 0x7f1ba00b1620 2023-07-21T22:57:44.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.540+0000 7f1b9cff9640 1 --2- 172.21.15.6:0/3468186603 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f1b8c066460 0x7f1b8c068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:44.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.540+0000 7f1b9cff9640 1 -- 172.21.15.6:0/3468186603 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f1b90084270 con 0x7f1ba00b1620 2023-07-21T22:57:44.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.540+0000 7f1b9f7fe640 1 -- 172.21.15.6:0/3468186603 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f1b8c066460 msgr2=0x7f1b8c068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2599285906 2023-07-21T22:57:44.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.540+0000 7f1b9f7fe640 1 --2- 172.21.15.6:0/3468186603 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f1b8c066460 0x7f1b8c068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:44.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.544+0000 7f1b9cff9640 1 -- 172.21.15.6:0/3468186603 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1ba01531d0 con 0x7f1ba00b1620 2023-07-21T22:57:44.609 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:44.582+0000 7ff762e2c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:57:44.670 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:44.636+0000 7efc1464b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:57:44.694 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:44.666+0000 7ff762e2c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:57:44.730 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:44.696+0000 7efc1464b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:57:44.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.708+0000 7f1ba5170640 1 -- 172.21.15.6:0/3468186603 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1ba01531d0 con 0x7f1ba00b1620 2023-07-21T22:57:44.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.708+0000 7f1b9cff9640 1 -- 172.21.15.6:0/3468186603 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v193) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ba01531d0 con 0x7f1ba00b1620 2023-07-21T22:57:44.744 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:57:44.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.712+0000 7f1ba5170640 1 -- 172.21.15.6:0/3468186603 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f1b8c066460 msgr2=0x7f1b8c068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:44.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.712+0000 7f1ba5170640 1 --2- 172.21.15.6:0/3468186603 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f1b8c066460 0x7f1b8c068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.712+0000 7f1ba5170640 1 -- 172.21.15.6:0/3468186603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ba00b1620 msgr2=0x7f1ba0158e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:44.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.712+0000 7f1ba5170640 1 --2- 172.21.15.6:0/3468186603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ba00b1620 0x7f1ba0158e00 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000e870 tx=0x7f1b9000ed30 comp rx=0 tx=0).stop 2023-07-21T22:57:44.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.712+0000 7f1ba5170640 1 -- 172.21.15.6:0/3468186603 shutdown_connections 2023-07-21T22:57:44.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.712+0000 7f1ba5170640 1 --2- 172.21.15.6:0/3468186603 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f1b8c066460 0x7f1b8c068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.712+0000 7f1ba5170640 1 --2- 172.21.15.6:0/3468186603 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ba0160750 0x7f1ba0153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.712+0000 7f1ba5170640 1 --2- 172.21.15.6:0/3468186603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ba00cc960 0x7f1ba00b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.712+0000 7f1ba5170640 1 --2- 172.21.15.6:0/3468186603 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ba00b1620 0x7f1ba0158e00 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.712+0000 7f1ba5170640 1 -- 172.21.15.6:0/3468186603 >> 172.21.15.6:0/3468186603 conn(0x7f1ba0069f50 msgr2=0x7f1ba00d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:44.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.712+0000 7f1ba5170640 1 -- 172.21.15.6:0/3468186603 shutdown_connections 2023-07-21T22:57:44.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.712+0000 7f1ba5170640 1 -- 172.21.15.6:0/3468186603 wait complete. 2023-07-21T22:57:44.750 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:44.722+0000 7ff762e2c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:57:44.767 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:57:44.820 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:44.784+0000 7efc1464b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:57:44.881 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:44.844+0000 7efc1464b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:57:44.893 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:44.866+0000 7ff762e2c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:57:44.950 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:44.922+0000 7ff762e2c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:57:44.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.924+0000 7f3f7cb2c640 1 Processor -- start 2023-07-21T22:57:44.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.924+0000 7f3f7cb2c640 1 -- start start 2023-07-21T22:57:44.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.924+0000 7f3f7cb2c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3f780d2fc0 0x7f3f780b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:44.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.924+0000 7f3f7cb2c640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f780b04c0 con 0x7f3f7815bde0 2023-07-21T22:57:44.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.924+0000 7f3f7cb2c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f780d0aa0 con 0x7f3f780d2300 2023-07-21T22:57:44.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.924+0000 7f3f7cb2c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f7815c1b0 con 0x7f3f780d2fc0 2023-07-21T22:57:44.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.924+0000 7f3f7659c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3f7815bde0 0x7f3f780d0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35222/0 (socket says 172.21.15.6:35222) 2023-07-21T22:57:44.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.924+0000 7f3f7659c640 1 -- 172.21.15.6:0/2143879229 learned_addr learned my addr 172.21.15.6:0/2143879229 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:44.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.924+0000 7f3f6ffff640 1 --2- 172.21.15.6:0/2143879229 >> v2:172.21.15.161:3300/0 conn(0x7f3f780d2fc0 0x7f3f780b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:44.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.924+0000 7f3f75d9b640 1 -- 172.21.15.6:0/2143879229 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306902348 0 0) 0x7f3f780b04c0 con 0x7f3f7815bde0 2023-07-21T22:57:44.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.924+0000 7f3f75d9b640 1 -- 172.21.15.6:0/2143879229 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f64003530 con 0x7f3f7815bde0 2023-07-21T22:57:44.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.924+0000 7f3f75d9b640 1 -- 172.21.15.6:0/2143879229 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881314631 0 0) 0x7f3f780d0aa0 con 0x7f3f780d2300 2023-07-21T22:57:44.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.924+0000 7f3f75d9b640 1 -- 172.21.15.6:0/2143879229 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f780b04c0 con 0x7f3f780d2300 2023-07-21T22:57:44.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.924+0000 7f3f6ffff640 1 -- 172.21.15.6:0/2143879229 >> v1:172.21.15.161:6789/0 conn(0x7f3f780d2300 legacy=0x7f3f780cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:44.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.924+0000 7f3f6ffff640 1 -- 172.21.15.6:0/2143879229 >> v1:172.21.15.6:6789/0 conn(0x7f3f7815bde0 legacy=0x7f3f780d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:44.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.924+0000 7f3f6ffff640 1 -- 172.21.15.6:0/2143879229 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f780afb90 con 0x7f3f780d2fc0 2023-07-21T22:57:44.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.928+0000 7f3f6ffff640 1 --2- 172.21.15.6:0/2143879229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f780d2fc0 0x7f3f780b0950 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f3f600097c0 tx=0x7f3f6001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=818bb0496d98a086 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:44.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.928+0000 7f3f75d9b640 1 -- 172.21.15.6:0/2143879229 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f600ab680 con 0x7f3f780d2fc0 2023-07-21T22:57:44.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.928+0000 7f3f75d9b640 1 -- 172.21.15.6:0/2143879229 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f600ab7e0 con 0x7f3f780d2fc0 2023-07-21T22:57:44.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.928+0000 7f3f75d9b640 1 -- 172.21.15.6:0/2143879229 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f600abb70 con 0x7f3f780d2fc0 2023-07-21T22:57:44.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.928+0000 7f3f7cb2c640 1 -- 172.21.15.6:0/2143879229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f780d2fc0 msgr2=0x7f3f780b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:44.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.928+0000 7f3f7cb2c640 1 --2- 172.21.15.6:0/2143879229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f780d2fc0 0x7f3f780b0950 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f3f600097c0 tx=0x7f3f6001c480 comp rx=0 tx=0).stop 2023-07-21T22:57:44.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.928+0000 7f3f7cb2c640 1 -- 172.21.15.6:0/2143879229 shutdown_connections 2023-07-21T22:57:44.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.928+0000 7f3f7cb2c640 1 --2- 172.21.15.6:0/2143879229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f780d2fc0 0x7f3f780b0950 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.928+0000 7f3f7cb2c640 1 -- 172.21.15.6:0/2143879229 >> 172.21.15.6:0/2143879229 conn(0x7f3f780659d0 msgr2=0x7f3f7809b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:44.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.928+0000 7f3f7cb2c640 1 -- 172.21.15.6:0/2143879229 shutdown_connections 2023-07-21T22:57:44.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.928+0000 7f3f7cb2c640 1 -- 172.21.15.6:0/2143879229 wait complete. 2023-07-21T22:57:44.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f7cb2c640 1 Processor -- start 2023-07-21T22:57:44.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f7cb2c640 1 -- start start 2023-07-21T22:57:44.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f7cb2c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f780d2300 0x7f3f78150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:44.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f7cb2c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f780d2fc0 0x7f3f780c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:44.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f7cb2c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f7815bde0 0x7f3f780b71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:44.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f7cb2c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f78150db0 con 0x7f3f7815bde0 2023-07-21T22:57:44.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f7cb2c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f780c7370 con 0x7f3f780d2fc0 2023-07-21T22:57:44.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f7cb2c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f780c7650 con 0x7f3f780d2300 2023-07-21T22:57:44.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f76d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f7815bde0 0x7f3f780b71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:44.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f76d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f7815bde0 0x7f3f780b71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46262/0 (socket says 172.21.15.6:46262) 2023-07-21T22:57:44.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f76d9d640 1 -- 172.21.15.6:0/2810988357 learned_addr learned my addr 172.21.15.6:0/2810988357 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:44.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f6ffff640 1 --2- 172.21.15.6:0/2810988357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f780d2fc0 0x7f3f780c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:44.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f7659c640 1 --2- 172.21.15.6:0/2810988357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f780d2300 0x7f3f78150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:44.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f6ffff640 1 -- 172.21.15.6:0/2810988357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f780d2300 msgr2=0x7f3f78150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:44.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f6ffff640 1 --2- 172.21.15.6:0/2810988357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f780d2300 0x7f3f78150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f6ffff640 1 -- 172.21.15.6:0/2810988357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f7815bde0 msgr2=0x7f3f780b71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:44.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f6ffff640 1 --2- 172.21.15.6:0/2810988357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f7815bde0 0x7f3f780b71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:44.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f6ffff640 1 -- 172.21.15.6:0/2810988357 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f60009420 con 0x7f3f780d2fc0 2023-07-21T22:57:44.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f76d9d640 1 --2- 172.21.15.6:0/2810988357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f7815bde0 0x7f3f780b71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:44.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f6ffff640 1 --2- 172.21.15.6:0/2810988357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f780d2fc0 0x7f3f780c68b0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f3f600ac000 tx=0x7f3f6001acc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:44.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f6effd640 1 -- 172.21.15.6:0/2810988357 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f600bf610 con 0x7f3f780d2fc0 2023-07-21T22:57:44.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f6effd640 1 -- 172.21.15.6:0/2810988357 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f600bf770 con 0x7f3f780d2fc0 2023-07-21T22:57:44.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f6effd640 1 -- 172.21.15.6:0/2810988357 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f600bfb20 con 0x7f3f780d2fc0 2023-07-21T22:57:44.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f7cb2c640 1 -- 172.21.15.6:0/2810988357 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f780c7930 con 0x7f3f780d2fc0 2023-07-21T22:57:44.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f7cb2c640 1 -- 172.21.15.6:0/2810988357 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f780b1400 con 0x7f3f780d2fc0 2023-07-21T22:57:44.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.932+0000 7f3f7cb2c640 1 -- 172.21.15.6:0/2810988357 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f780678d0 con 0x7f3f780d2fc0 2023-07-21T22:57:44.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.936+0000 7f3f6effd640 1 -- 172.21.15.6:0/2810988357 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 95) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f3f600bfc80 con 0x7f3f780d2fc0 2023-07-21T22:57:44.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.936+0000 7f3f6effd640 1 --2- 172.21.15.6:0/2810988357 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f3f58066430 0x7f3f580688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:44.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.936+0000 7f3f6effd640 1 -- 172.21.15.6:0/2810988357 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f3f6011f770 con 0x7f3f780d2fc0 2023-07-21T22:57:44.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.936+0000 7f3f7659c640 1 -- 172.21.15.6:0/2810988357 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f3f58066430 msgr2=0x7f3f580688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2599285906 2023-07-21T22:57:44.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.936+0000 7f3f7659c640 1 --2- 172.21.15.6:0/2810988357 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f3f58066430 0x7f3f580688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:44.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:44.940+0000 7f3f6effd640 1 -- 172.21.15.6:0/2810988357 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3f600ec890 con 0x7f3f780d2fc0 2023-07-21T22:57:45.035 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:45.000+0000 7efc1464b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:57:45.096 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:45.060+0000 7efc1464b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:57:45.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.092+0000 7f3f7cb2c640 1 -- 172.21.15.6:0/2810988357 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3f780c7790 con 0x7f3f780d2fc0 2023-07-21T22:57:45.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.096+0000 7f3f6effd640 1 -- 172.21.15.6:0/2810988357 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v193) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3f780c7790 con 0x7f3f780d2fc0 2023-07-21T22:57:45.130 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:57:45.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.096+0000 7f3f7cb2c640 1 -- 172.21.15.6:0/2810988357 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f3f58066430 msgr2=0x7f3f580688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:45.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.096+0000 7f3f7cb2c640 1 --2- 172.21.15.6:0/2810988357 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f3f58066430 0x7f3f580688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.096+0000 7f3f7cb2c640 1 -- 172.21.15.6:0/2810988357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f780d2fc0 msgr2=0x7f3f780c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:45.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.096+0000 7f3f7cb2c640 1 --2- 172.21.15.6:0/2810988357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f780d2fc0 0x7f3f780c68b0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f3f600ac000 tx=0x7f3f6001acc0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.096+0000 7f3f7cb2c640 1 -- 172.21.15.6:0/2810988357 shutdown_connections 2023-07-21T22:57:45.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.096+0000 7f3f7cb2c640 1 --2- 172.21.15.6:0/2810988357 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f3f58066430 0x7f3f580688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.096+0000 7f3f7cb2c640 1 --2- 172.21.15.6:0/2810988357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f7815bde0 0x7f3f780b71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.096+0000 7f3f7cb2c640 1 --2- 172.21.15.6:0/2810988357 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f780d2fc0 0x7f3f780c68b0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.096+0000 7f3f7cb2c640 1 --2- 172.21.15.6:0/2810988357 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f780d2300 0x7f3f78150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.096+0000 7f3f7cb2c640 1 -- 172.21.15.6:0/2810988357 >> 172.21.15.6:0/2810988357 conn(0x7f3f780659d0 msgr2=0x7f3f780ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:45.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.096+0000 7f3f7cb2c640 1 -- 172.21.15.6:0/2810988357 shutdown_connections 2023-07-21T22:57:45.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.096+0000 7f3f7cb2c640 1 -- 172.21.15.6:0/2810988357 wait complete. 2023-07-21T22:57:45.153 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T22:57:45.192 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:57:45.192 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:57:45.192 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:57:45.200 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:45.174+0000 7ff762e2c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:57:45.333 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:45.306+0000 7ff762e2c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:57:45.356 INFO:tasks.ceph.mgr.y.smithi006.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-21T22:57:45.357 INFO:tasks.ceph.mgr.y.smithi006.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-21T22:57:45.357 INFO:tasks.ceph.mgr.y.smithi006.stderr: from numpy import show_config as show_numpy_config 2023-07-21T22:57:45.365 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:45.328+0000 7efc1464b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:57:45.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.336+0000 7fa6b51fa640 1 Processor -- start 2023-07-21T22:57:45.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.336+0000 7fa6b51fa640 1 -- start start 2023-07-21T22:57:45.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.340+0000 7fa6b51fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6b00b7c70 0x7fa6b00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.340+0000 7fa6b51fa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa6b015fd60 0x7fa6b00d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.340+0000 7fa6b51fa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6b00ccaf0 con 0x7fa6b00d1850 2023-07-21T22:57:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.340+0000 7fa6b51fa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6b00d1190 con 0x7fa6b015fd60 2023-07-21T22:57:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.340+0000 7fa6b51fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b0160600 con 0x7fa6b00b7c70 2023-07-21T22:57:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.340+0000 7fa6a7fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa6b00d1850 0x7fa6b015f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35224/0 (socket says 172.21.15.6:35224) 2023-07-21T22:57:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.340+0000 7fa6a7fff640 1 -- 172.21.15.6:0/1747328577 learned_addr learned my addr 172.21.15.6:0/1747328577 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.340+0000 7fa6aed9d640 1 --2- 172.21.15.6:0/1747328577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6b00b7c70 0x7fa6b00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.340+0000 7fa6af59e640 1 --2- 172.21.15.6:0/1747328577 >> v2:172.21.15.161:3300/0 conn(0x7fa6b015fd60 0x7fa6b00d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.340+0000 7fa6ae59c640 1 -- 172.21.15.6:0/1747328577 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 870047929 0 0) 0x7fa6b00ccaf0 con 0x7fa6b00d1850 2023-07-21T22:57:45.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.340+0000 7fa6ae59c640 1 -- 172.21.15.6:0/1747328577 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa69c003530 con 0x7fa6b00d1850 2023-07-21T22:57:45.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.340+0000 7fa6aed9d640 1 -- 172.21.15.6:0/1747328577 >> v2:172.21.15.161:3300/0 conn(0x7fa6b015fd60 msgr2=0x7fa6b00d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:45.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.340+0000 7fa6aed9d640 1 --2- 172.21.15.6:0/1747328577 >> v2:172.21.15.161:3300/0 conn(0x7fa6b015fd60 0x7fa6b00d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.340+0000 7fa6aed9d640 1 -- 172.21.15.6:0/1747328577 >> v1:172.21.15.6:6789/0 conn(0x7fa6b00d1850 legacy=0x7fa6b015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:45.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.340+0000 7fa6aed9d640 1 -- 172.21.15.6:0/1747328577 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b0160320 con 0x7fa6b00b7c70 2023-07-21T22:57:45.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.340+0000 7fa6af59e640 1 --2- 172.21.15.6:0/1747328577 >> v2:172.21.15.161:3300/0 conn(0x7fa6b015fd60 0x7fa6b00d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:45.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.344+0000 7fa6aed9d640 1 --2- 172.21.15.6:0/1747328577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6b00b7c70 0x7fa6b00d0c50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00097c0 tx=0x7fa6a001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5305be79f05d50e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:45.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.344+0000 7fa6ae59c640 1 -- 172.21.15.6:0/1747328577 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00ab670 con 0x7fa6b00b7c70 2023-07-21T22:57:45.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.344+0000 7fa6ae59c640 1 -- 172.21.15.6:0/1747328577 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a00ab7d0 con 0x7fa6b00b7c70 2023-07-21T22:57:45.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.344+0000 7fa6ae59c640 1 -- 172.21.15.6:0/1747328577 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00abb60 con 0x7fa6b00b7c70 2023-07-21T22:57:45.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.344+0000 7fa6b51fa640 1 -- 172.21.15.6:0/1747328577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6b00b7c70 msgr2=0x7fa6b00d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:45.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.344+0000 7fa6b51fa640 1 --2- 172.21.15.6:0/1747328577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6b00b7c70 0x7fa6b00d0c50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00097c0 tx=0x7fa6a001c450 comp rx=0 tx=0).stop 2023-07-21T22:57:45.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.344+0000 7fa6b51fa640 1 -- 172.21.15.6:0/1747328577 shutdown_connections 2023-07-21T22:57:45.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.344+0000 7fa6b51fa640 1 --2- 172.21.15.6:0/1747328577 >> v2:172.21.15.161:3300/0 conn(0x7fa6b015fd60 0x7fa6b00d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.344+0000 7fa6b51fa640 1 --2- 172.21.15.6:0/1747328577 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6b00b7c70 0x7fa6b00d0c50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.344+0000 7fa6b51fa640 1 -- 172.21.15.6:0/1747328577 >> 172.21.15.6:0/1747328577 conn(0x7fa6b00650b0 msgr2=0x7fa6b00654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:45.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.344+0000 7fa6b51fa640 1 -- 172.21.15.6:0/1747328577 shutdown_connections 2023-07-21T22:57:45.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.344+0000 7fa6b51fa640 1 -- 172.21.15.6:0/1747328577 wait complete. 2023-07-21T22:57:45.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.344+0000 7fa6b51fa640 1 Processor -- start 2023-07-21T22:57:45.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.344+0000 7fa6b51fa640 1 -- start start 2023-07-21T22:57:45.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.344+0000 7fa6b51fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6b00b7c70 0x7fa6b01536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.344+0000 7fa6b51fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6b00d1850 0x7fa6b014f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.344+0000 7fa6b51fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6b015fd60 0x7fa6b0156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.344+0000 7fa6b51fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b0153ed0 con 0x7fa6b00b7c70 2023-07-21T22:57:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.344+0000 7fa6b51fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b01541b0 con 0x7fa6b015fd60 2023-07-21T22:57:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.344+0000 7fa6b51fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b0154490 con 0x7fa6b00d1850 2023-07-21T22:57:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.348+0000 7fa6aed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6b00b7c70 0x7fa6b01536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.348+0000 7fa6a7fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6b00d1850 0x7fa6b014f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.348+0000 7fa6aed9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6b00b7c70 0x7fa6b01536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46266/0 (socket says 172.21.15.6:46266) 2023-07-21T22:57:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.348+0000 7fa6aed9d640 1 -- 172.21.15.6:0/1822399092 learned_addr learned my addr 172.21.15.6:0/1822399092 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.348+0000 7fa6af59e640 1 --2- 172.21.15.6:0/1822399092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6b015fd60 0x7fa6b0156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.348+0000 7fa6aed9d640 1 -- 172.21.15.6:0/1822399092 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6b00d1850 msgr2=0x7fa6b014f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.348+0000 7fa6aed9d640 1 --2- 172.21.15.6:0/1822399092 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6b00d1850 0x7fa6b014f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.348+0000 7fa6aed9d640 1 -- 172.21.15.6:0/1822399092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6b015fd60 msgr2=0x7fa6b0156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.348+0000 7fa6aed9d640 1 --2- 172.21.15.6:0/1822399092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6b015fd60 0x7fa6b0156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.348+0000 7fa6aed9d640 1 -- 172.21.15.6:0/1822399092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a8009a70 con 0x7fa6b00b7c70 2023-07-21T22:57:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.348+0000 7fa6a7fff640 1 --2- 172.21.15.6:0/1822399092 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6b00d1850 0x7fa6b014f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.348+0000 7fa6af59e640 1 --2- 172.21.15.6:0/1822399092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6b015fd60 0x7fa6b0156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.348+0000 7fa6aed9d640 1 --2- 172.21.15.6:0/1822399092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6b00b7c70 0x7fa6b01536a0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00ad040 tx=0x7fa6a001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.348+0000 7fa6a77fe640 1 -- 172.21.15.6:0/1822399092 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00bf610 con 0x7fa6b00b7c70 2023-07-21T22:57:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.348+0000 7fa6a77fe640 1 -- 172.21.15.6:0/1822399092 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a00bf790 con 0x7fa6b00b7c70 2023-07-21T22:57:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.348+0000 7fa6a77fe640 1 -- 172.21.15.6:0/1822399092 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a00bfb40 con 0x7fa6b00b7c70 2023-07-21T22:57:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.348+0000 7fa6b51fa640 1 -- 172.21.15.6:0/1822399092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a0009420 con 0x7fa6b00b7c70 2023-07-21T22:57:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.348+0000 7fa6b51fa640 1 -- 172.21.15.6:0/1822399092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b0151310 con 0x7fa6b00b7c70 2023-07-21T22:57:45.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.348+0000 7fa6b51fa640 1 -- 172.21.15.6:0/1822399092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b0154940 con 0x7fa6b00b7c70 2023-07-21T22:57:45.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.348+0000 7fa6a77fe640 1 -- 172.21.15.6:0/1822399092 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 95) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fa6a00bfca0 con 0x7fa6b00b7c70 2023-07-21T22:57:45.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.352+0000 7fa6a77fe640 1 --2- 172.21.15.6:0/1822399092 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7fa690066460 0x7fa690068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.352+0000 7fa6a77fe640 1 -- 172.21.15.6:0/1822399092 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fa6a011e930 con 0x7fa6b00b7c70 2023-07-21T22:57:45.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.352+0000 7fa6a7fff640 1 -- 172.21.15.6:0/1822399092 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7fa690066460 msgr2=0x7fa690068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2599285906 2023-07-21T22:57:45.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.352+0000 7fa6a7fff640 1 --2- 172.21.15.6:0/1822399092 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7fa690066460 0x7fa690068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:45.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.356+0000 7fa6a77fe640 1 -- 172.21.15.6:0/1822399092 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa6a00eb930 con 0x7fa6b00b7c70 2023-07-21T22:57:45.459 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:45.430+0000 7ff762e2c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:57:45.509 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:45.472+0000 7efc1464b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:57:45.529 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:45.502+0000 7ff762e2c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:57:45.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.524+0000 7fa6b51fa640 1 -- 172.21.15.6:0/1822399092 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa6b01545d0 con 0x7fa6b00b7c70 2023-07-21T22:57:45.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.524+0000 7fa6a77fe640 1 -- 172.21.15.6:0/1822399092 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v193) v1 ==== 80+0+473 (secure 0 0 0) 0x7fa6b01545d0 con 0x7fa6b00b7c70 2023-07-21T22:57:45.560 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/568512462 2023-07-22T22:57:40.018539+0000 2023-07-21T22:57:45.561 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6833/406143921 2023-07-22T22:57:40.018539+0000 2023-07-21T22:57:45.561 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:6832/406143921 2023-07-22T22:57:40.018539+0000 2023-07-21T22:57:45.561 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/2299078826 2023-07-22T22:57:40.018539+0000 2023-07-21T22:57:45.561 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/1726684525 2023-07-22T22:57:40.018539+0000 2023-07-21T22:57:45.561 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/319560030 2023-07-22T22:57:40.018539+0000 2023-07-21T22:57:45.561 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/389011228 2023-07-22T22:57:40.018539+0000 2023-07-21T22:57:45.561 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.161:0/3791982345 2023-07-22T22:57:40.018539+0000 2023-07-21T22:57:45.562 INFO:teuthology.orchestra.run.smithi006.stderr:listed 8 entries 2023-07-21T22:57:45.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.528+0000 7fa6b51fa640 1 -- 172.21.15.6:0/1822399092 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7fa690066460 msgr2=0x7fa690068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:45.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.528+0000 7fa6b51fa640 1 --2- 172.21.15.6:0/1822399092 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7fa690066460 0x7fa690068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.528+0000 7fa6b51fa640 1 -- 172.21.15.6:0/1822399092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6b00b7c70 msgr2=0x7fa6b01536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:45.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.528+0000 7fa6b51fa640 1 --2- 172.21.15.6:0/1822399092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6b00b7c70 0x7fa6b01536a0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fa6a00ad040 tx=0x7fa6a001ac90 comp rx=0 tx=0).stop 2023-07-21T22:57:45.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.528+0000 7fa6b51fa640 1 -- 172.21.15.6:0/1822399092 shutdown_connections 2023-07-21T22:57:45.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.528+0000 7fa6b51fa640 1 --2- 172.21.15.6:0/1822399092 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7fa690066460 0x7fa690068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.528+0000 7fa6b51fa640 1 --2- 172.21.15.6:0/1822399092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6b015fd60 0x7fa6b0156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.528+0000 7fa6b51fa640 1 --2- 172.21.15.6:0/1822399092 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6b00d1850 0x7fa6b014f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.528+0000 7fa6b51fa640 1 --2- 172.21.15.6:0/1822399092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6b00b7c70 0x7fa6b01536a0 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.528+0000 7fa6b51fa640 1 -- 172.21.15.6:0/1822399092 >> 172.21.15.6:0/1822399092 conn(0x7fa6b00650b0 msgr2=0x7fa6b0065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:45.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.528+0000 7fa6b51fa640 1 -- 172.21.15.6:0/1822399092 shutdown_connections 2023-07-21T22:57:45.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.528+0000 7fa6b51fa640 1 -- 172.21.15.6:0/1822399092 wait complete. 2023-07-21T22:57:45.582 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-21T22:57:45.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:45.583 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-21T22:57:45.645 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:57:45.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:45.647 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-21T22:57:45.648 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:45.612+0000 7efc1464b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:57:45.657 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:57:45.658 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:57:45.666 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:45.638+0000 7ff762e2c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:57:45.667 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:57:45.668 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:57:45.669 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:57:45.710 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:57:45.710 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:57:45.711 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:57:45.720 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:57:45.720 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:57:45.721 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:45.684+0000 7efc1464b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:57:45.865 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:45.828+0000 7efc1464b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:57:45.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.832+0000 7fdec92f9640 1 Processor -- start 2023-07-21T22:57:45.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.832+0000 7fdec92f9640 1 -- start start 2023-07-21T22:57:45.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.832+0000 7fdec92f9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdec4070b70 0x7fdec4070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.832+0000 7fdec92f9640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec40cac70 con 0x7fdec40cb100 2023-07-21T22:57:45.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.832+0000 7fdec92f9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdec4071480 con 0x7fdec406b1e0 2023-07-21T22:57:45.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.832+0000 7fdec92f9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec40ca060 con 0x7fdec4070b70 2023-07-21T22:57:45.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.832+0000 7fdec37fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdec40cb100 0x7fdec41642e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35230/0 (socket says 172.21.15.6:35230) 2023-07-21T22:57:45.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.832+0000 7fdec37fe640 1 -- 172.21.15.6:0/1978083653 learned_addr learned my addr 172.21.15.6:0/1978083653 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:45.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.832+0000 7fdec2ffd640 1 --2- 172.21.15.6:0/1978083653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdec4070b70 0x7fdec4070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.832+0000 7fdec27fc640 1 -- 172.21.15.6:0/1978083653 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887565842 0 0) 0x7fdec40cac70 con 0x7fdec40cb100 2023-07-21T22:57:45.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.832+0000 7fdec27fc640 1 -- 172.21.15.6:0/1978083653 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdeb0003530 con 0x7fdec40cb100 2023-07-21T22:57:45.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.832+0000 7fdec27fc640 1 -- 172.21.15.6:0/1978083653 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54485851 0 0) 0x7fdec4071480 con 0x7fdec406b1e0 2023-07-21T22:57:45.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.832+0000 7fdec27fc640 1 -- 172.21.15.6:0/1978083653 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdec40cac70 con 0x7fdec406b1e0 2023-07-21T22:57:45.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.832+0000 7fdec2ffd640 1 -- 172.21.15.6:0/1978083653 >> v1:172.21.15.161:6789/0 conn(0x7fdec406b1e0 legacy=0x7fdec40c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:45.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.832+0000 7fdec2ffd640 1 -- 172.21.15.6:0/1978083653 >> v1:172.21.15.6:6789/0 conn(0x7fdec40cb100 legacy=0x7fdec41642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:45.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.832+0000 7fdec2ffd640 1 -- 172.21.15.6:0/1978083653 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec40ca340 con 0x7fdec4070b70 2023-07-21T22:57:45.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.836+0000 7fdec2ffd640 1 --2- 172.21.15.6:0/1978083653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdec4070b70 0x7fdec4070f40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40097f0 tx=0x7fdeb401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cdd5dcabefd73f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:45.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.836+0000 7fdec27fc640 1 -- 172.21.15.6:0/1978083653 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb40ab600 con 0x7fdec4070b70 2023-07-21T22:57:45.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.836+0000 7fdec27fc640 1 -- 172.21.15.6:0/1978083653 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb40ab760 con 0x7fdec4070b70 2023-07-21T22:57:45.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.836+0000 7fdec27fc640 1 -- 172.21.15.6:0/1978083653 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb40abaf0 con 0x7fdec4070b70 2023-07-21T22:57:45.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.836+0000 7fdec92f9640 1 -- 172.21.15.6:0/1978083653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdec4070b70 msgr2=0x7fdec4070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:45.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.836+0000 7fdec92f9640 1 --2- 172.21.15.6:0/1978083653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdec4070b70 0x7fdec4070f40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40097f0 tx=0x7fdeb401c400 comp rx=0 tx=0).stop 2023-07-21T22:57:45.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.836+0000 7fdec92f9640 1 -- 172.21.15.6:0/1978083653 shutdown_connections 2023-07-21T22:57:45.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.836+0000 7fdec92f9640 1 --2- 172.21.15.6:0/1978083653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdec4070b70 0x7fdec4070f40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.836+0000 7fdec92f9640 1 -- 172.21.15.6:0/1978083653 >> 172.21.15.6:0/1978083653 conn(0x7fdec40afcf0 msgr2=0x7fdec40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:45.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.836+0000 7fdec92f9640 1 -- 172.21.15.6:0/1978083653 shutdown_connections 2023-07-21T22:57:45.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.836+0000 7fdec92f9640 1 -- 172.21.15.6:0/1978083653 wait complete. 2023-07-21T22:57:45.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdec92f9640 1 Processor -- start 2023-07-21T22:57:45.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdec92f9640 1 -- start start 2023-07-21T22:57:45.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdec92f9640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdec406b1e0 0x7fdec4147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdec92f9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdec4070b70 0x7fdec40b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdec92f9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdec40cb100 0x7fdec40b2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdec92f9640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec4149220 con 0x7fdec406b1e0 2023-07-21T22:57:45.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdec92f9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec4148420 con 0x7fdec40cb100 2023-07-21T22:57:45.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdec92f9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec41518f0 con 0x7fdec4070b70 2023-07-21T22:57:45.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdec2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdec406b1e0 0x7fdec4147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdec2ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdec406b1e0 0x7fdec4147ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46268/0 (socket says 172.21.15.6:46268) 2023-07-21T22:57:45.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdec2ffd640 1 -- 172.21.15.6:0/805990982 learned_addr learned my addr 172.21.15.6:0/805990982 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:45.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdec37fe640 1 --2- 172.21.15.6:0/805990982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdec40cb100 0x7fdec40b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdebbfff640 1 --2- 172.21.15.6:0/805990982 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdec4070b70 0x7fdec40b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdec2ffd640 1 -- 172.21.15.6:0/805990982 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdec4070b70 msgr2=0x7fdec40b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:45.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdec2ffd640 1 --2- 172.21.15.6:0/805990982 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdec4070b70 0x7fdec40b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdec2ffd640 1 -- 172.21.15.6:0/805990982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdec40cb100 msgr2=0x7fdec40b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:45.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdec2ffd640 1 --2- 172.21.15.6:0/805990982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdec40cb100 0x7fdec40b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdec2ffd640 1 -- 172.21.15.6:0/805990982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb4009420 con 0x7fdec406b1e0 2023-07-21T22:57:45.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdec2ffd640 1 --2- 172.21.15.6:0/805990982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdec406b1e0 0x7fdec4147ee0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4019010 tx=0x7fdeb401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:45.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdebb7fe640 1 -- 172.21.15.6:0/805990982 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb40bf610 con 0x7fdec406b1e0 2023-07-21T22:57:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdebb7fe640 1 -- 172.21.15.6:0/805990982 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb40bf770 con 0x7fdec406b1e0 2023-07-21T22:57:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdebb7fe640 1 -- 172.21.15.6:0/805990982 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb40bfb20 con 0x7fdec406b1e0 2023-07-21T22:57:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdec92f9640 1 -- 172.21.15.6:0/805990982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdec41485c0 con 0x7fdec406b1e0 2023-07-21T22:57:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.840+0000 7fdec92f9640 1 -- 172.21.15.6:0/805990982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdec4148b60 con 0x7fdec406b1e0 2023-07-21T22:57:45.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.844+0000 7fdec92f9640 1 -- 172.21.15.6:0/805990982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdec4153c80 con 0x7fdec406b1e0 2023-07-21T22:57:45.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.844+0000 7fdebb7fe640 1 -- 172.21.15.6:0/805990982 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 95) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fdeb40b5400 con 0x7fdec406b1e0 2023-07-21T22:57:45.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.844+0000 7fdebb7fe640 1 --2- 172.21.15.6:0/805990982 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7fdea4066460 0x7fdea4068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.844+0000 7fdebb7fe640 1 -- 172.21.15.6:0/805990982 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6478+0+0 (secure 0 0 0) 0x7fdeb411ebc0 con 0x7fdec406b1e0 2023-07-21T22:57:45.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.844+0000 7fdebbfff640 1 -- 172.21.15.6:0/805990982 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7fdea4066460 msgr2=0x7fdea4068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2599285906 2023-07-21T22:57:45.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.844+0000 7fdebbfff640 1 --2- 172.21.15.6:0/805990982 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7fdea4066460 0x7fdea4068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:45.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:45.848+0000 7fdebb7fe640 1 -- 172.21.15.6:0/805990982 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdeb40ebcf0 con 0x7fdec406b1e0 2023-07-21T22:57:46.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.036+0000 7fdec92f9640 1 -- 172.21.15.6:0/805990982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdec40678d0 con 0x7fdec406b1e0 2023-07-21T22:57:46.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.036+0000 7fdebb7fe640 1 -- 172.21.15.6:0/805990982 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4667 (secure 0 0 0) 0x7fdeb411e070 con 0x7fdec406b1e0 2023-07-21T22:57:46.073 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:46.074 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8765,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/617196146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":617196146},{"type":"v1","addr":"172.21.15.161:6836","nonce":617196146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9976,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/618083440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":618083440},{"type":"v1","addr":"172.21.15.161:6837","nonce":618083440}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":10503,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/205515898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":205515898},{"type":"v1","addr":"172.21.15.6:6834","nonce":205515898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:57:22.895862+0000","modified":"2023-07-21T22:57:26.519881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10506":{"gid":10506,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/963904366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":963904366},{"type":"v1","addr":"172.21.15.6:6835","nonce":963904366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-21T22:57:46.074 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 86 2023-07-21T22:57:46.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.040+0000 7fdec92f9640 1 -- 172.21.15.6:0/805990982 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7fdea4066460 msgr2=0x7fdea4068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:46.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.040+0000 7fdec92f9640 1 --2- 172.21.15.6:0/805990982 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7fdea4066460 0x7fdea4068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.040+0000 7fdec92f9640 1 -- 172.21.15.6:0/805990982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdec406b1e0 msgr2=0x7fdec4147ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:46.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.040+0000 7fdec92f9640 1 --2- 172.21.15.6:0/805990982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdec406b1e0 0x7fdec4147ee0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7fdeb4019010 tx=0x7fdeb401ac40 comp rx=0 tx=0).stop 2023-07-21T22:57:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.040+0000 7fdec92f9640 1 -- 172.21.15.6:0/805990982 shutdown_connections 2023-07-21T22:57:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.040+0000 7fdec92f9640 1 --2- 172.21.15.6:0/805990982 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7fdea4066460 0x7fdea4068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.040+0000 7fdec92f9640 1 --2- 172.21.15.6:0/805990982 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdec40cb100 0x7fdec40b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.040+0000 7fdec92f9640 1 --2- 172.21.15.6:0/805990982 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdec4070b70 0x7fdec40b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.040+0000 7fdec92f9640 1 --2- 172.21.15.6:0/805990982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdec406b1e0 0x7fdec4147ee0 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.040+0000 7fdec92f9640 1 -- 172.21.15.6:0/805990982 >> 172.21.15.6:0/805990982 conn(0x7fdec40afcf0 msgr2=0x7fdec4153570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.040+0000 7fdec92f9640 1 -- 172.21.15.6:0/805990982 shutdown_connections 2023-07-21T22:57:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.040+0000 7fdec92f9640 1 -- 172.21.15.6:0/805990982 wait complete. 2023-07-21T22:57:46.095 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:57:46.203 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:46.174+0000 7ff762e2c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:57:46.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.208+0000 7f289d559640 1 Processor -- start 2023-07-21T22:57:46.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.208+0000 7f289d559640 1 -- start start 2023-07-21T22:57:46.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.212+0000 7f289d559640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f28980b7990 0x7f28980d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:46.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.212+0000 7f289d559640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28980b4840 con 0x7f28980d12f0 2023-07-21T22:57:46.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.212+0000 7f289d559640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28980ccae0 con 0x7f28980d1840 2023-07-21T22:57:46.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.212+0000 7f289d559640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28980cd060 con 0x7f28980b7990 2023-07-21T22:57:46.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.212+0000 7f2896ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f28980b7990 0x7f28980d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:46.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.212+0000 7f288ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f28980d12f0 0x7f289815f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35232/0 (socket says 172.21.15.6:35232) 2023-07-21T22:57:46.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.212+0000 7f288ffff640 1 -- 172.21.15.6:0/1247392157 learned_addr learned my addr 172.21.15.6:0/1247392157 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:46.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.212+0000 7f2896ffd640 1 -- 172.21.15.6:0/1247392157 >> v1:172.21.15.161:6789/0 conn(0x7f28980d1840 legacy=0x7f28980d1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:46.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.212+0000 7f2896ffd640 1 -- 172.21.15.6:0/1247392157 >> v1:172.21.15.6:6789/0 conn(0x7f28980d12f0 legacy=0x7f289815f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:46.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.212+0000 7f2896ffd640 1 -- 172.21.15.6:0/1247392157 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2898160310 con 0x7f28980b7990 2023-07-21T22:57:46.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.212+0000 7f28967fc640 1 -- 172.21.15.6:0/1247392157 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3614184577 0 0) 0x7f28980b4840 con 0x7f28980d12f0 2023-07-21T22:57:46.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.212+0000 7f2896ffd640 1 --2- 172.21.15.6:0/1247392157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980b7990 0x7f28980d0c40 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f28880097c0 tx=0x7f288801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9467a227ee1b04c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:46.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.216+0000 7f28967fc640 1 -- 172.21.15.6:0/1247392157 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28880ab600 con 0x7f28980b7990 2023-07-21T22:57:46.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.216+0000 7f28967fc640 1 -- 172.21.15.6:0/1247392157 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28880a7050 con 0x7f28980b7990 2023-07-21T22:57:46.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.216+0000 7f28967fc640 1 -- 172.21.15.6:0/1247392157 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28880ab980 con 0x7f28980b7990 2023-07-21T22:57:46.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.216+0000 7f289d559640 1 -- 172.21.15.6:0/1247392157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980b7990 msgr2=0x7f28980d0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:46.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.216+0000 7f289d559640 1 --2- 172.21.15.6:0/1247392157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980b7990 0x7f28980d0c40 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f28880097c0 tx=0x7f288801c3f0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.216+0000 7f289d559640 1 -- 172.21.15.6:0/1247392157 shutdown_connections 2023-07-21T22:57:46.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.216+0000 7f289d559640 1 --2- 172.21.15.6:0/1247392157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980b7990 0x7f28980d0c40 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.216+0000 7f289d559640 1 -- 172.21.15.6:0/1247392157 >> 172.21.15.6:0/1247392157 conn(0x7f28980650b0 msgr2=0x7f28980654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:46.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.216+0000 7f289d559640 1 -- 172.21.15.6:0/1247392157 shutdown_connections 2023-07-21T22:57:46.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.216+0000 7f289d559640 1 -- 172.21.15.6:0/1247392157 wait complete. 2023-07-21T22:57:46.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.216+0000 7f289d559640 1 Processor -- start 2023-07-21T22:57:46.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.216+0000 7f289d559640 1 -- start start 2023-07-21T22:57:46.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.216+0000 7f289d559640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28980b7990 0x7f28980b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:46.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.216+0000 7f289d559640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980d12f0 0x7f289814b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:46.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.216+0000 7f289d559640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28980d1840 0x7f2898148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:46.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.216+0000 7f289d559640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2898154b70 con 0x7f28980d12f0 2023-07-21T22:57:46.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.216+0000 7f289d559640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2898154e50 con 0x7f28980b7990 2023-07-21T22:57:46.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.216+0000 7f289d559640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289815df70 con 0x7f28980d1840 2023-07-21T22:57:46.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.220+0000 7f288ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980d12f0 0x7f289814b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:46.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.220+0000 7f2896ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28980b7990 0x7f28980b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:46.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.220+0000 7f2896ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28980b7990 0x7f28980b35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:46544/0 (socket says 172.21.15.6:46544) 2023-07-21T22:57:46.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.220+0000 7f2896ffd640 1 -- 172.21.15.6:0/247106567 learned_addr learned my addr 172.21.15.6:0/247106567 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:46.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.220+0000 7f288ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980d12f0 0x7f289814b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46284/0 (socket says 172.21.15.6:46284) 2023-07-21T22:57:46.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.220+0000 7f28977fe640 1 --2- 172.21.15.6:0/247106567 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28980d1840 0x7f2898148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:46.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.220+0000 7f288ffff640 1 -- 172.21.15.6:0/247106567 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28980d1840 msgr2=0x7f2898148670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:46.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.220+0000 7f288ffff640 1 --2- 172.21.15.6:0/247106567 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28980d1840 0x7f2898148670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.220+0000 7f288ffff640 1 -- 172.21.15.6:0/247106567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28980b7990 msgr2=0x7f28980b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:46.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.220+0000 7f288ffff640 1 --2- 172.21.15.6:0/247106567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28980b7990 0x7f28980b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.220+0000 7f288ffff640 1 -- 172.21.15.6:0/247106567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2888009420 con 0x7f28980d12f0 2023-07-21T22:57:46.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.220+0000 7f28977fe640 1 --2- 172.21.15.6:0/247106567 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28980d1840 0x7f2898148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:46.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.220+0000 7f288ffff640 1 --2- 172.21.15.6:0/247106567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980d12f0 0x7f289814b4c0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f288000c3e0 tx=0x7f288000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:46.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.220+0000 7f288f7fe640 1 -- 172.21.15.6:0/247106567 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28800074e0 con 0x7f28980d12f0 2023-07-21T22:57:46.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.220+0000 7f288f7fe640 1 -- 172.21.15.6:0/247106567 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2880007640 con 0x7f28980d12f0 2023-07-21T22:57:46.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.220+0000 7f288f7fe640 1 -- 172.21.15.6:0/247106567 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2880004a30 con 0x7f28980d12f0 2023-07-21T22:57:46.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.220+0000 7f289d559640 1 -- 172.21.15.6:0/247106567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289815e250 con 0x7f28980d12f0 2023-07-21T22:57:46.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.220+0000 7f289d559640 1 -- 172.21.15.6:0/247106567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2898148bb0 con 0x7f28980d12f0 2023-07-21T22:57:46.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.220+0000 7f289d559640 1 -- 172.21.15.6:0/247106567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2898149760 con 0x7f28980d12f0 2023-07-21T22:57:46.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.220+0000 7f288f7fe640 1 -- 172.21.15.6:0/247106567 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 95) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f2880004b90 con 0x7f28980d12f0 2023-07-21T22:57:46.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.224+0000 7f288f7fe640 1 --2- 172.21.15.6:0/247106567 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f2878066430 0x7f28780688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:46.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.224+0000 7f288f7fe640 1 -- 172.21.15.6:0/247106567 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6478+0+0 (secure 0 0 0) 0x7f2880083e80 con 0x7f28980d12f0 2023-07-21T22:57:46.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.224+0000 7f2896ffd640 1 -- 172.21.15.6:0/247106567 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f2878066430 msgr2=0x7f28780688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2599285906 2023-07-21T22:57:46.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.224+0000 7f2896ffd640 1 --2- 172.21.15.6:0/247106567 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f2878066430 0x7f28780688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:46.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.224+0000 7f288f7fe640 1 -- 172.21.15.6:0/247106567 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2880050ee0 con 0x7f28980d12f0 2023-07-21T22:57:46.289 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:46.262+0000 7ff762e2c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:57:46.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.388+0000 7f289d559640 1 -- 172.21.15.6:0/247106567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28980678d0 con 0x7f28980d12f0 2023-07-21T22:57:46.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.388+0000 7f288f7fe640 1 -- 172.21.15.6:0/247106567 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+18840 (secure 0 0 0) 0x7f2880001070 con 0x7f28980d12f0 2023-07-21T22:57:46.425 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:46.425 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":193,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:57:40.018593+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:57:21.014468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-21T22:57:21.883517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/568512462":"2023-07-22T22:57:40.018539+0000","172.21.15.161:6833/406143921":"2023-07-22T22:57:40.018539+0000","172.21.15.161:6832/406143921":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/2299078826":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/1726684525":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/319560030":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/389011228":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/3791982345":"2023-07-22T22:57:40.018539+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:57:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.392+0000 7f289d559640 1 -- 172.21.15.6:0/247106567 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f2878066430 msgr2=0x7f28780688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:46.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.392+0000 7f289d559640 1 --2- 172.21.15.6:0/247106567 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f2878066430 0x7f28780688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.392+0000 7f289d559640 1 -- 172.21.15.6:0/247106567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980d12f0 msgr2=0x7f289814b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.392+0000 7f289d559640 1 --2- 172.21.15.6:0/247106567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980d12f0 0x7f289814b4c0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f288000c3e0 tx=0x7f288000c8a0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.392+0000 7f289d559640 1 -- 172.21.15.6:0/247106567 shutdown_connections 2023-07-21T22:57:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.392+0000 7f289d559640 1 --2- 172.21.15.6:0/247106567 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7f2878066430 0x7f28780688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.392+0000 7f289d559640 1 --2- 172.21.15.6:0/247106567 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f28980d1840 0x7f2898148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.392+0000 7f289d559640 1 --2- 172.21.15.6:0/247106567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28980d12f0 0x7f289814b4c0 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.392+0000 7f289d559640 1 --2- 172.21.15.6:0/247106567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28980b7990 0x7f28980b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.392+0000 7f289d559640 1 -- 172.21.15.6:0/247106567 >> 172.21.15.6:0/247106567 conn(0x7f28980650b0 msgr2=0x7f28980ce500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:46.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.392+0000 7f289d559640 1 -- 172.21.15.6:0/247106567 shutdown_connections 2023-07-21T22:57:46.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.392+0000 7f289d559640 1 -- 172.21.15.6:0/247106567 wait complete. 2023-07-21T22:57:46.436 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:46.410+0000 7ff762e2c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:57:46.447 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:18:30.828350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-21T22:18:36.339908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:57:21.014468+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '191', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:57:21.883517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '192', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:57:46.448 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:57:46.454 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:46.416+0000 7efc1464b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:57:46.519 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:46.490+0000 7ff762e2c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:57:46.542 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:46.508+0000 7efc1464b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:57:46.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.564+0000 7ffb33937640 1 Processor -- start 2023-07-21T22:57:46.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.564+0000 7ffb33937640 1 -- start start 2023-07-21T22:57:46.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.564+0000 7ffb33937640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ffb2c15bde0 0x7ffb2c0d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:46.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.564+0000 7ffb33937640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb2c0d2fc0 0x7ffb2c0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:46.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.564+0000 7ffb33937640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb2c0b04c0 con 0x7ffb2c0d2300 2023-07-21T22:57:46.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.564+0000 7ffb33937640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2c15c1b0 con 0x7ffb2c15bde0 2023-07-21T22:57:46.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.564+0000 7ffb33937640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c0d0aa0 con 0x7ffb2c0d2fc0 2023-07-21T22:57:46.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.568+0000 7ffb31ed4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ffb2c0d2300 0x7ffb2c0cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35248/0 (socket says 172.21.15.6:35248) 2023-07-21T22:57:46.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.568+0000 7ffb31ed4640 1 -- 172.21.15.6:0/1472870932 learned_addr learned my addr 172.21.15.6:0/1472870932 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:46.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.568+0000 7ffb30ed2640 1 --2- 172.21.15.6:0/1472870932 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb2c0d2fc0 0x7ffb2c0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:46.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.568+0000 7ffb316d3640 1 --2- 172.21.15.6:0/1472870932 >> v2:172.21.15.161:3300/0 conn(0x7ffb2c15bde0 0x7ffb2c0d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:46.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.568+0000 7ffb23fff640 1 -- 172.21.15.6:0/1472870932 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296202031 0 0) 0x7ffb2c0b04c0 con 0x7ffb2c0d2300 2023-07-21T22:57:46.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.568+0000 7ffb316d3640 1 -- 172.21.15.6:0/1472870932 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb2c0d2fc0 msgr2=0x7ffb2c0b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:46.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.568+0000 7ffb316d3640 1 --2- 172.21.15.6:0/1472870932 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb2c0d2fc0 0x7ffb2c0b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.568+0000 7ffb316d3640 1 -- 172.21.15.6:0/1472870932 >> v1:172.21.15.6:6789/0 conn(0x7ffb2c0d2300 legacy=0x7ffb2c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:46.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.568+0000 7ffb316d3640 1 -- 172.21.15.6:0/1472870932 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c0afb90 con 0x7ffb2c15bde0 2023-07-21T22:57:46.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.568+0000 7ffb30ed2640 1 --2- 172.21.15.6:0/1472870932 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb2c0d2fc0 0x7ffb2c0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:46.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.568+0000 7ffb316d3640 1 --2- 172.21.15.6:0/1472870932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb2c15bde0 0x7ffb2c0d0270 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ffb280097a0 tx=0x7ffb2801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6e2723d1decf501 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:46.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.568+0000 7ffb23fff640 1 -- 172.21.15.6:0/1472870932 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb280ab660 con 0x7ffb2c15bde0 2023-07-21T22:57:46.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.568+0000 7ffb23fff640 1 -- 172.21.15.6:0/1472870932 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb280ab7c0 con 0x7ffb2c15bde0 2023-07-21T22:57:46.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.568+0000 7ffb23fff640 1 -- 172.21.15.6:0/1472870932 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb280abb50 con 0x7ffb2c15bde0 2023-07-21T22:57:46.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.572+0000 7ffb33937640 1 -- 172.21.15.6:0/1472870932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb2c15bde0 msgr2=0x7ffb2c0d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:46.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.572+0000 7ffb33937640 1 --2- 172.21.15.6:0/1472870932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb2c15bde0 0x7ffb2c0d0270 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ffb280097a0 tx=0x7ffb2801c460 comp rx=0 tx=0).stop 2023-07-21T22:57:46.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.572+0000 7ffb33937640 1 -- 172.21.15.6:0/1472870932 shutdown_connections 2023-07-21T22:57:46.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.572+0000 7ffb33937640 1 --2- 172.21.15.6:0/1472870932 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb2c0d2fc0 0x7ffb2c0b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.572+0000 7ffb33937640 1 --2- 172.21.15.6:0/1472870932 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb2c15bde0 0x7ffb2c0d0270 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.572+0000 7ffb33937640 1 -- 172.21.15.6:0/1472870932 >> 172.21.15.6:0/1472870932 conn(0x7ffb2c0659d0 msgr2=0x7ffb2c09b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:46.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.572+0000 7ffb33937640 1 -- 172.21.15.6:0/1472870932 shutdown_connections 2023-07-21T22:57:46.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.572+0000 7ffb33937640 1 -- 172.21.15.6:0/1472870932 wait complete. 2023-07-21T22:57:46.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.572+0000 7ffb33937640 1 Processor -- start 2023-07-21T22:57:46.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.572+0000 7ffb33937640 1 -- start start 2023-07-21T22:57:46.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.572+0000 7ffb33937640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb2c0d2300 0x7ffb2c15cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.572+0000 7ffb33937640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb2c0d2fc0 0x7ffb2c1f7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.572+0000 7ffb33937640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb2c15bde0 0x7ffb2c0b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.572+0000 7ffb33937640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c15d600 con 0x7ffb2c15bde0 2023-07-21T22:57:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.572+0000 7ffb33937640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c15d8e0 con 0x7ffb2c0d2fc0 2023-07-21T22:57:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.572+0000 7ffb33937640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c15dbc0 con 0x7ffb2c0d2300 2023-07-21T22:57:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.576+0000 7ffb31ed4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb2c15bde0 0x7ffb2c0b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.576+0000 7ffb31ed4640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb2c15bde0 0x7ffb2c0b1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46290/0 (socket says 172.21.15.6:46290) 2023-07-21T22:57:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.576+0000 7ffb31ed4640 1 -- 172.21.15.6:0/1319302781 learned_addr learned my addr 172.21.15.6:0/1319302781 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.576+0000 7ffb30ed2640 1 --2- 172.21.15.6:0/1319302781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb2c0d2fc0 0x7ffb2c1f7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.576+0000 7ffb316d3640 1 --2- 172.21.15.6:0/1319302781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb2c0d2300 0x7ffb2c15cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.576+0000 7ffb31ed4640 1 -- 172.21.15.6:0/1319302781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb2c0d2300 msgr2=0x7ffb2c15cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.576+0000 7ffb31ed4640 1 --2- 172.21.15.6:0/1319302781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb2c0d2300 0x7ffb2c15cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.576+0000 7ffb31ed4640 1 -- 172.21.15.6:0/1319302781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb2c0d2fc0 msgr2=0x7ffb2c1f7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.576+0000 7ffb31ed4640 1 --2- 172.21.15.6:0/1319302781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb2c0d2fc0 0x7ffb2c1f7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.576+0000 7ffb31ed4640 1 -- 172.21.15.6:0/1319302781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c009420 con 0x7ffb2c15bde0 2023-07-21T22:57:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.576+0000 7ffb30ed2640 1 --2- 172.21.15.6:0/1319302781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb2c0d2fc0 0x7ffb2c1f7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.576+0000 7ffb31ed4640 1 --2- 172.21.15.6:0/1319302781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb2c15bde0 0x7ffb2c0b1210 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400c780 tx=0x7ffb2400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.576+0000 7ffb21ffb640 1 -- 172.21.15.6:0/1319302781 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2400ce90 con 0x7ffb2c15bde0 2023-07-21T22:57:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.576+0000 7ffb21ffb640 1 -- 172.21.15.6:0/1319302781 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2400a640 con 0x7ffb2c15bde0 2023-07-21T22:57:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.576+0000 7ffb21ffb640 1 -- 172.21.15.6:0/1319302781 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2400a9d0 con 0x7ffb2c15bde0 2023-07-21T22:57:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.576+0000 7ffb33937640 1 -- 172.21.15.6:0/1319302781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb280093b0 con 0x7ffb2c15bde0 2023-07-21T22:57:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.576+0000 7ffb33937640 1 -- 172.21.15.6:0/1319302781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2c15e180 con 0x7ffb2c15bde0 2023-07-21T22:57:46.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.576+0000 7ffb33937640 1 -- 172.21.15.6:0/1319302781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2c15e390 con 0x7ffb2c15bde0 2023-07-21T22:57:46.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.576+0000 7ffb21ffb640 1 -- 172.21.15.6:0/1319302781 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 95) v1 ==== 85817+0+0 (secure 0 0 0) 0x7ffb2400ab30 con 0x7ffb2c15bde0 2023-07-21T22:57:46.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.580+0000 7ffb21ffb640 1 --2- 172.21.15.6:0/1319302781 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7ffb10066460 0x7ffb10068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:46.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.580+0000 7ffb21ffb640 1 -- 172.21.15.6:0/1319302781 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6478+0+0 (secure 0 0 0) 0x7ffb240834a0 con 0x7ffb2c15bde0 2023-07-21T22:57:46.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.580+0000 7ffb316d3640 1 -- 172.21.15.6:0/1319302781 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7ffb10066460 msgr2=0x7ffb10068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.161:6832/2599285906 2023-07-21T22:57:46.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.580+0000 7ffb316d3640 1 --2- 172.21.15.6:0/1319302781 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7ffb10066460 0x7ffb10068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:57:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.584+0000 7ffb21ffb640 1 -- 172.21.15.6:0/1319302781 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffb24050650 con 0x7ffb2c15bde0 2023-07-21T22:57:46.708 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:46.672+0000 7efc1464b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:57:46.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.744+0000 7ffb33937640 1 -- 172.21.15.6:0/1319302781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb2c0678d0 con 0x7ffb2c15bde0 2023-07-21T22:57:46.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.744+0000 7ffb21ffb640 1 -- 172.21.15.6:0/1319302781 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v193) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb24053c70 con 0x7ffb2c15bde0 2023-07-21T22:57:46.779 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-21T22:57:46.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.744+0000 7ffb33937640 1 -- 172.21.15.6:0/1319302781 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7ffb10066460 msgr2=0x7ffb10068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:46.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.744+0000 7ffb33937640 1 --2- 172.21.15.6:0/1319302781 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7ffb10066460 0x7ffb10068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.744+0000 7ffb33937640 1 -- 172.21.15.6:0/1319302781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb2c15bde0 msgr2=0x7ffb2c0b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:46.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.744+0000 7ffb33937640 1 --2- 172.21.15.6:0/1319302781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb2c15bde0 0x7ffb2c0b1210 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400c780 tx=0x7ffb2400cc40 comp rx=0 tx=0).stop 2023-07-21T22:57:46.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.744+0000 7ffb33937640 1 -- 172.21.15.6:0/1319302781 shutdown_connections 2023-07-21T22:57:46.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.744+0000 7ffb33937640 1 --2- 172.21.15.6:0/1319302781 >> [v2:172.21.15.161:6832/2599285906,v1:172.21.15.161:6833/2599285906] conn(0x7ffb10066460 0x7ffb10068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.744+0000 7ffb33937640 1 --2- 172.21.15.6:0/1319302781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb2c15bde0 0x7ffb2c0b1210 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.744+0000 7ffb33937640 1 --2- 172.21.15.6:0/1319302781 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb2c0d2fc0 0x7ffb2c1f7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.744+0000 7ffb33937640 1 --2- 172.21.15.6:0/1319302781 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ffb2c0d2300 0x7ffb2c15cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.744+0000 7ffb33937640 1 -- 172.21.15.6:0/1319302781 >> 172.21.15.6:0/1319302781 conn(0x7ffb2c0659d0 msgr2=0x7ffb2c0ceff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:46.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.744+0000 7ffb33937640 1 -- 172.21.15.6:0/1319302781 shutdown_connections 2023-07-21T22:57:46.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.744+0000 7ffb33937640 1 -- 172.21.15.6:0/1319302781 wait complete. 2023-07-21T22:57:46.792 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:46.762+0000 7ff762e2c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:57:46.797 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:46.764+0000 7efc1464b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:57:46.800 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-21T22:57:46.852 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:46.822+0000 7ff762e2c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:57:46.930 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:46.902+0000 7ff6ebfaf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:46.930 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:46.902+0000 7ff6ebfaf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:46.930 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:46.902+0000 7ff6ebfaf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:46.931 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:46.902+0000 7ff6ebfaf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:46.931 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:46.902+0000 7ff6ebfaf640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:46.931 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:46.902+0000 7ff6edfb3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:46.932 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:46.902+0000 7ff6edfb3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:46.932 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:46.902+0000 7ff6edfb3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:46.932 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:46.902+0000 7ff6edfb3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:46.932 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-07-21T22:57:46.902+0000 7ff6edfb3640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:57:46.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.924+0000 7fe21a7d3640 1 Processor -- start 2023-07-21T22:57:46.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.924+0000 7fe21a7d3640 1 -- start start 2023-07-21T22:57:46.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.928+0000 7fe21a7d3640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe21415bde0 0x7fe2140d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:46.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.928+0000 7fe21a7d3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe2140d2fc0 0x7fe2140b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:46.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.928+0000 7fe21a7d3640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2140b04c0 con 0x7fe2140d2300 2023-07-21T22:57:46.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.928+0000 7fe21a7d3640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe21415c1b0 con 0x7fe2140d2fc0 2023-07-21T22:57:46.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.928+0000 7fe21a7d3640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2140d0aa0 con 0x7fe21415bde0 2023-07-21T22:57:46.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.928+0000 7fe218d70640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe2140d2300 0x7fe2140cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35252/0 (socket says 172.21.15.6:35252) 2023-07-21T22:57:46.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.928+0000 7fe218d70640 1 -- 172.21.15.6:0/3964609024 learned_addr learned my addr 172.21.15.6:0/3964609024 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:46.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.928+0000 7fe213fff640 1 --2- 172.21.15.6:0/3964609024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe21415bde0 0x7fe2140d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:46.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.928+0000 7fe2137fe640 1 --2- 172.21.15.6:0/3964609024 >> v2:172.21.15.161:3300/0 conn(0x7fe2140d2fc0 0x7fe2140b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:46.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.928+0000 7fe212ffd640 1 -- 172.21.15.6:0/3964609024 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411133774 0 0) 0x7fe2140b04c0 con 0x7fe2140d2300 2023-07-21T22:57:46.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.928+0000 7fe212ffd640 1 -- 172.21.15.6:0/3964609024 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1fc003530 con 0x7fe2140d2300 2023-07-21T22:57:46.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.928+0000 7fe213fff640 1 -- 172.21.15.6:0/3964609024 >> v2:172.21.15.161:3300/0 conn(0x7fe2140d2fc0 msgr2=0x7fe2140b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:46.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.928+0000 7fe213fff640 1 --2- 172.21.15.6:0/3964609024 >> v2:172.21.15.161:3300/0 conn(0x7fe2140d2fc0 0x7fe2140b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.928+0000 7fe213fff640 1 -- 172.21.15.6:0/3964609024 >> v1:172.21.15.6:6789/0 conn(0x7fe2140d2300 legacy=0x7fe2140cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:46.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.928+0000 7fe213fff640 1 -- 172.21.15.6:0/3964609024 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2140afb90 con 0x7fe21415bde0 2023-07-21T22:57:46.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.928+0000 7fe2137fe640 1 --2- 172.21.15.6:0/3964609024 >> v2:172.21.15.161:3300/0 conn(0x7fe2140d2fc0 0x7fe2140b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:46.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.932+0000 7fe213fff640 1 --2- 172.21.15.6:0/3964609024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe21415bde0 0x7fe2140d0270 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe2040097a0 tx=0x7fe20401c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6cebcffa27c290f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:46.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.932+0000 7fe212ffd640 1 -- 172.21.15.6:0/3964609024 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2040ab660 con 0x7fe21415bde0 2023-07-21T22:57:46.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.932+0000 7fe212ffd640 1 -- 172.21.15.6:0/3964609024 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2040ab7c0 con 0x7fe21415bde0 2023-07-21T22:57:46.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.932+0000 7fe212ffd640 1 -- 172.21.15.6:0/3964609024 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2040abb50 con 0x7fe21415bde0 2023-07-21T22:57:46.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.932+0000 7fe21a7d3640 1 -- 172.21.15.6:0/3964609024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe21415bde0 msgr2=0x7fe2140d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:46.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.932+0000 7fe21a7d3640 1 --2- 172.21.15.6:0/3964609024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe21415bde0 0x7fe2140d0270 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe2040097a0 tx=0x7fe20401c460 comp rx=0 tx=0).stop 2023-07-21T22:57:46.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.932+0000 7fe21a7d3640 1 -- 172.21.15.6:0/3964609024 shutdown_connections 2023-07-21T22:57:46.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.932+0000 7fe21a7d3640 1 --2- 172.21.15.6:0/3964609024 >> v2:172.21.15.161:3300/0 conn(0x7fe2140d2fc0 0x7fe2140b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.932+0000 7fe21a7d3640 1 --2- 172.21.15.6:0/3964609024 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe21415bde0 0x7fe2140d0270 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.932+0000 7fe21a7d3640 1 -- 172.21.15.6:0/3964609024 >> 172.21.15.6:0/3964609024 conn(0x7fe2140659d0 msgr2=0x7fe21409b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:46.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.932+0000 7fe21a7d3640 1 -- 172.21.15.6:0/3964609024 shutdown_connections 2023-07-21T22:57:46.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.932+0000 7fe21a7d3640 1 -- 172.21.15.6:0/3964609024 wait complete. 2023-07-21T22:57:46.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.932+0000 7fe21a7d3640 1 Processor -- start 2023-07-21T22:57:46.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.932+0000 7fe21a7d3640 1 -- start start 2023-07-21T22:57:46.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe21a7d3640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2140d2300 0x7fe21414ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:46.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe21a7d3640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2140d2fc0 0x7fe21414a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:46.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe21a7d3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe21415bde0 0x7fe21414e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:46.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe21a7d3640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21414a630 con 0x7fe2140d2300 2023-07-21T22:57:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe21a7d3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21414e640 con 0x7fe21415bde0 2023-07-21T22:57:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe21a7d3640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21414e8e0 con 0x7fe2140d2fc0 2023-07-21T22:57:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe213fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2140d2300 0x7fe21414ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe213fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2140d2300 0x7fe21414ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46296/0 (socket says 172.21.15.6:46296) 2023-07-21T22:57:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe213fff640 1 -- 172.21.15.6:0/4009719341 learned_addr learned my addr 172.21.15.6:0/4009719341 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe2137fe640 1 --2- 172.21.15.6:0/4009719341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2140d2fc0 0x7fe21414a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:46.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe218d70640 1 --2- 172.21.15.6:0/4009719341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe21415bde0 0x7fe21414e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:46.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe2137fe640 1 -- 172.21.15.6:0/4009719341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe21415bde0 msgr2=0x7fe21414e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:46.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe2137fe640 1 --2- 172.21.15.6:0/4009719341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe21415bde0 0x7fe21414e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe2137fe640 1 -- 172.21.15.6:0/4009719341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2140d2300 msgr2=0x7fe21414ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:46.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe2137fe640 1 --2- 172.21.15.6:0/4009719341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2140d2300 0x7fe21414ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:46.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe2137fe640 1 -- 172.21.15.6:0/4009719341 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe208009420 con 0x7fe2140d2fc0 2023-07-21T22:57:46.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe213fff640 1 --2- 172.21.15.6:0/4009719341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2140d2300 0x7fe21414ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:46.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe2137fe640 1 --2- 172.21.15.6:0/4009719341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2140d2fc0 0x7fe21414a0f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe20800e9b0 tx=0x7fe20800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:46.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe210ff9640 1 -- 172.21.15.6:0/4009719341 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20800c9a0 con 0x7fe2140d2fc0 2023-07-21T22:57:46.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe210ff9640 1 -- 172.21.15.6:0/4009719341 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20800cb00 con 0x7fe2140d2fc0 2023-07-21T22:57:46.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe21a7d3640 1 -- 172.21.15.6:0/4009719341 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2040093b0 con 0x7fe2140d2fc0 2023-07-21T22:57:46.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe210ff9640 1 -- 172.21.15.6:0/4009719341 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe208013470 con 0x7fe2140d2fc0 2023-07-21T22:57:46.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe21a7d3640 1 -- 172.21.15.6:0/4009719341 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe21414eea0 con 0x7fe2140d2fc0 2023-07-21T22:57:46.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe21a7d3640 1 -- 172.21.15.6:0/4009719341 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2140678d0 con 0x7fe2140d2fc0 2023-07-21T22:57:46.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.936+0000 7fe210ff9640 1 -- 172.21.15.6:0/4009719341 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 96) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fe2080135d0 con 0x7fe2140d2fc0 2023-07-21T22:57:46.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.940+0000 7fe210ff9640 1 -- 172.21.15.6:0/4009719341 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6865+0+0 (secure 0 0 0) 0x7fe208083da0 con 0x7fe2140d2fc0 2023-07-21T22:57:46.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:46.944+0000 7fe210ff9640 1 -- 172.21.15.6:0/4009719341 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe208051300 con 0x7fe2140d2fc0 2023-07-21T22:57:47.103 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:47.068+0000 7efc1464b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:57:47.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.100+0000 7fe21a7d3640 1 -- 172.21.15.6:0/4009719341 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe214065ea0 con 0x7fe2140d2fc0 2023-07-21T22:57:47.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.100+0000 7fe210ff9640 1 -- 172.21.15.6:0/4009719341 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v194) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe208054920 con 0x7fe2140d2fc0 2023-07-21T22:57:47.135 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-21T22:57:47.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.100+0000 7fe21a7d3640 1 -- 172.21.15.6:0/4009719341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2140d2fc0 msgr2=0x7fe21414a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:47.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.100+0000 7fe21a7d3640 1 --2- 172.21.15.6:0/4009719341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2140d2fc0 0x7fe21414a0f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe20800e9b0 tx=0x7fe20800ee70 comp rx=0 tx=0).stop 2023-07-21T22:57:47.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.104+0000 7fe21a7d3640 1 -- 172.21.15.6:0/4009719341 shutdown_connections 2023-07-21T22:57:47.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.104+0000 7fe21a7d3640 1 --2- 172.21.15.6:0/4009719341 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe21415bde0 0x7fe21414e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.104+0000 7fe21a7d3640 1 --2- 172.21.15.6:0/4009719341 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2140d2fc0 0x7fe21414a0f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.104+0000 7fe21a7d3640 1 --2- 172.21.15.6:0/4009719341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2140d2300 0x7fe21414ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.104+0000 7fe21a7d3640 1 -- 172.21.15.6:0/4009719341 >> 172.21.15.6:0/4009719341 conn(0x7fe2140659d0 msgr2=0x7fe2140cd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:47.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.104+0000 7fe21a7d3640 1 -- 172.21.15.6:0/4009719341 shutdown_connections 2023-07-21T22:57:47.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.104+0000 7fe21a7d3640 1 -- 172.21.15.6:0/4009719341 wait complete. 2023-07-21T22:57:47.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:57:47.178 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-21T22:57:47.144+0000 7efc1464b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:57:47.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.280+0000 7f60f699f640 1 Processor -- start 2023-07-21T22:57:47.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.280+0000 7f60f699f640 1 -- start start 2023-07-21T22:57:47.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.284+0000 7f60f699f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f60f015bde0 0x7f60f00d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:47.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.284+0000 7f60f699f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60f00d2fc0 0x7f60f00b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:47.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.284+0000 7f60f699f640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f00b04c0 con 0x7f60f00d2300 2023-07-21T22:57:47.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.284+0000 7f60f699f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f015c1b0 con 0x7f60f015bde0 2023-07-21T22:57:47.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.284+0000 7f60f699f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f00d0aa0 con 0x7f60f00d2fc0 2023-07-21T22:57:47.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.284+0000 7f60f4f3c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f60f00d2300 0x7f60f00cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:35264/0 (socket says 172.21.15.6:35264) 2023-07-21T22:57:47.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.284+0000 7f60f4f3c640 1 -- 172.21.15.6:0/20738130 learned_addr learned my addr 172.21.15.6:0/20738130 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:47.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.284+0000 7f60effff640 1 --2- 172.21.15.6:0/20738130 >> v2:172.21.15.161:3300/0 conn(0x7f60f015bde0 0x7f60f00d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:47.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.284+0000 7f60ef7fe640 1 --2- 172.21.15.6:0/20738130 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60f00d2fc0 0x7f60f00b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:47.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.284+0000 7f60eeffd640 1 -- 172.21.15.6:0/20738130 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556040634 0 0) 0x7f60f00b04c0 con 0x7f60f00d2300 2023-07-21T22:57:47.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.284+0000 7f60eeffd640 1 -- 172.21.15.6:0/20738130 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60d8003530 con 0x7f60f00d2300 2023-07-21T22:57:47.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.284+0000 7f60effff640 1 -- 172.21.15.6:0/20738130 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60f00d2fc0 msgr2=0x7f60f00b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:47.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.284+0000 7f60effff640 1 --2- 172.21.15.6:0/20738130 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60f00d2fc0 0x7f60f00b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.284+0000 7f60effff640 1 -- 172.21.15.6:0/20738130 >> v1:172.21.15.6:6789/0 conn(0x7f60f00d2300 legacy=0x7f60f00cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:47.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.284+0000 7f60effff640 1 -- 172.21.15.6:0/20738130 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f00afb90 con 0x7f60f015bde0 2023-07-21T22:57:47.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.284+0000 7f60ef7fe640 1 --2- 172.21.15.6:0/20738130 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60f00d2fc0 0x7f60f00b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:47.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.288+0000 7f60effff640 1 --2- 172.21.15.6:0/20738130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60f015bde0 0x7f60f00d0270 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f60e00097a0 tx=0x7f60e001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e348debbfd13b44 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:47.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.288+0000 7f60eeffd640 1 -- 172.21.15.6:0/20738130 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e00ab660 con 0x7f60f015bde0 2023-07-21T22:57:47.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.288+0000 7f60eeffd640 1 -- 172.21.15.6:0/20738130 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e00ab7c0 con 0x7f60f015bde0 2023-07-21T22:57:47.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.288+0000 7f60eeffd640 1 -- 172.21.15.6:0/20738130 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e00abb50 con 0x7f60f015bde0 2023-07-21T22:57:47.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.288+0000 7f60f699f640 1 -- 172.21.15.6:0/20738130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60f015bde0 msgr2=0x7f60f00d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:47.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.288+0000 7f60f699f640 1 --2- 172.21.15.6:0/20738130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60f015bde0 0x7f60f00d0270 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f60e00097a0 tx=0x7f60e001c460 comp rx=0 tx=0).stop 2023-07-21T22:57:47.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.288+0000 7f60f699f640 1 -- 172.21.15.6:0/20738130 shutdown_connections 2023-07-21T22:57:47.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.288+0000 7f60f699f640 1 --2- 172.21.15.6:0/20738130 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60f00d2fc0 0x7f60f00b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.288+0000 7f60f699f640 1 --2- 172.21.15.6:0/20738130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60f015bde0 0x7f60f00d0270 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.288+0000 7f60f699f640 1 -- 172.21.15.6:0/20738130 >> 172.21.15.6:0/20738130 conn(0x7f60f00659d0 msgr2=0x7f60f009b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:47.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.288+0000 7f60f699f640 1 -- 172.21.15.6:0/20738130 shutdown_connections 2023-07-21T22:57:47.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.288+0000 7f60f699f640 1 -- 172.21.15.6:0/20738130 wait complete. 2023-07-21T22:57:47.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.288+0000 7f60f699f640 1 Processor -- start 2023-07-21T22:57:47.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.288+0000 7f60f699f640 1 -- start start 2023-07-21T22:57:47.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60f699f640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60f00d2300 0x7f60f009f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:47.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60f699f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60f00d2fc0 0x7f60f015eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:47.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60f699f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60f015bde0 0x7f60f01529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:47.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60f699f640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f009fe50 con 0x7f60f00d2300 2023-07-21T22:57:47.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60f699f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f00caab0 con 0x7f60f00d2fc0 2023-07-21T22:57:47.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60f699f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f00cad90 con 0x7f60f015bde0 2023-07-21T22:57:47.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60effff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60f00d2300 0x7f60f009f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:47.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60effff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60f00d2300 0x7f60f009f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46312/0 (socket says 172.21.15.6:46312) 2023-07-21T22:57:47.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60effff640 1 -- 172.21.15.6:0/3960645464 learned_addr learned my addr 172.21.15.6:0/3960645464 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:47.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60ef7fe640 1 --2- 172.21.15.6:0/3960645464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60f00d2fc0 0x7f60f015eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:47.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60f4f3c640 1 --2- 172.21.15.6:0/3960645464 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60f015bde0 0x7f60f01529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:47.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60ef7fe640 1 -- 172.21.15.6:0/3960645464 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60f015bde0 msgr2=0x7f60f01529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:47.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60ef7fe640 1 --2- 172.21.15.6:0/3960645464 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60f015bde0 0x7f60f01529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60ef7fe640 1 -- 172.21.15.6:0/3960645464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60f00d2300 msgr2=0x7f60f009f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:47.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60ef7fe640 1 --2- 172.21.15.6:0/3960645464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60f00d2300 0x7f60f009f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60ef7fe640 1 -- 172.21.15.6:0/3960645464 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e4009420 con 0x7f60f00d2fc0 2023-07-21T22:57:47.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60effff640 1 --2- 172.21.15.6:0/3960645464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60f00d2300 0x7f60f009f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:47.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60ef7fe640 1 --2- 172.21.15.6:0/3960645464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60f00d2fc0 0x7f60f015eea0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f60e400e9b0 tx=0x7f60e400ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:47.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60ecff9640 1 -- 172.21.15.6:0/3960645464 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e400c9a0 con 0x7f60f00d2fc0 2023-07-21T22:57:47.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60ecff9640 1 -- 172.21.15.6:0/3960645464 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e400cb00 con 0x7f60f00d2fc0 2023-07-21T22:57:47.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60ecff9640 1 -- 172.21.15.6:0/3960645464 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4013470 con 0x7f60f00d2fc0 2023-07-21T22:57:47.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60f699f640 1 -- 172.21.15.6:0/3960645464 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e00093b0 con 0x7f60f00d2fc0 2023-07-21T22:57:47.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.292+0000 7f60f699f640 1 -- 172.21.15.6:0/3960645464 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f00cb350 con 0x7f60f00d2fc0 2023-07-21T22:57:47.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.296+0000 7f60f699f640 1 -- 172.21.15.6:0/3960645464 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f00678d0 con 0x7f60f00d2fc0 2023-07-21T22:57:47.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.296+0000 7f60ecff9640 1 -- 172.21.15.6:0/3960645464 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 96) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f60e40135d0 con 0x7f60f00d2fc0 2023-07-21T22:57:47.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.296+0000 7f60ecff9640 1 -- 172.21.15.6:0/3960645464 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6865+0+0 (secure 0 0 0) 0x7f60e4083d50 con 0x7f60f00d2fc0 2023-07-21T22:57:47.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.300+0000 7f60ecff9640 1 -- 172.21.15.6:0/3960645464 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f60e40512b0 con 0x7f60f00d2fc0 2023-07-21T22:57:47.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.456+0000 7f60f699f640 1 -- 172.21.15.6:0/3960645464 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f60f00cdf10 con 0x7f60f00d2fc0 2023-07-21T22:57:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.456+0000 7f60ecff9640 1 -- 172.21.15.6:0/3960645464 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v194) v1 ==== 104+0+11 (secure 0 0 0) 0x7f60e40830a0 con 0x7f60f00d2fc0 2023-07-21T22:57:47.492 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-21T22:57:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.456+0000 7f60f699f640 1 -- 172.21.15.6:0/3960645464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60f00d2fc0 msgr2=0x7f60f015eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:47.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.456+0000 7f60f699f640 1 --2- 172.21.15.6:0/3960645464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60f00d2fc0 0x7f60f015eea0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f60e400e9b0 tx=0x7f60e400ee70 comp rx=0 tx=0).stop 2023-07-21T22:57:47.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.460+0000 7f60f699f640 1 -- 172.21.15.6:0/3960645464 shutdown_connections 2023-07-21T22:57:47.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.460+0000 7f60f699f640 1 --2- 172.21.15.6:0/3960645464 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f60f015bde0 0x7f60f01529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.460+0000 7f60f699f640 1 --2- 172.21.15.6:0/3960645464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60f00d2fc0 0x7f60f015eea0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.460+0000 7f60f699f640 1 --2- 172.21.15.6:0/3960645464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60f00d2300 0x7f60f009f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.460+0000 7f60f699f640 1 -- 172.21.15.6:0/3960645464 >> 172.21.15.6:0/3960645464 conn(0x7f60f00659d0 msgr2=0x7f60f015acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:47.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.460+0000 7f60f699f640 1 -- 172.21.15.6:0/3960645464 shutdown_connections 2023-07-21T22:57:47.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.460+0000 7f60f699f640 1 -- 172.21.15.6:0/3960645464 wait complete. 2023-07-21T22:57:47.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:57:47.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.664+0000 7f87387f6640 1 Processor -- start 2023-07-21T22:57:47.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.664+0000 7f87387f6640 1 -- start start 2023-07-21T22:57:47.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.668+0000 7f87387f6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f87300aeb40 0x7f873015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:47.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.668+0000 7f87387f6640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f87300aef10 0x7f8730158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:47.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.668+0000 7f87387f6640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87301532b0 con 0x7f8730159270 2023-07-21T22:57:47.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.668+0000 7f87387f6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87300ca6f0 con 0x7f87300aeb40 2023-07-21T22:57:47.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.668+0000 7f87387f6640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87301599d0 con 0x7f87300aef10 2023-07-21T22:57:47.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.668+0000 7f8736592640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f87300aeb40 0x7f873015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:47.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.668+0000 7f8736d93640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8730159270 0x7f87300c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33738/0 (socket says 172.21.15.6:33738) 2023-07-21T22:57:47.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.668+0000 7f8736d93640 1 -- 172.21.15.6:0/1110405422 learned_addr learned my addr 172.21.15.6:0/1110405422 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:47.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.668+0000 7f8735d91640 1 --2- 172.21.15.6:0/1110405422 >> v2:172.21.15.161:3300/0 conn(0x7f87300aef10 0x7f8730158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:47.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.668+0000 7f8736592640 1 -- 172.21.15.6:0/1110405422 >> v2:172.21.15.161:3300/0 conn(0x7f87300aef10 msgr2=0x7f8730158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:47.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.668+0000 7f8736592640 1 --2- 172.21.15.6:0/1110405422 >> v2:172.21.15.161:3300/0 conn(0x7f87300aef10 0x7f8730158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.668+0000 7f8736592640 1 -- 172.21.15.6:0/1110405422 >> v1:172.21.15.6:6789/0 conn(0x7f8730159270 legacy=0x7f87300c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.668+0000 7f8736592640 1 -- 172.21.15.6:0/1110405422 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8730159cb0 con 0x7f87300aeb40 2023-07-21T22:57:47.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.668+0000 7f8735590640 1 -- 172.21.15.6:0/1110405422 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643322463 0 0) 0x7f87301532b0 con 0x7f8730159270 2023-07-21T22:57:47.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.672+0000 7f8736592640 1 --2- 172.21.15.6:0/1110405422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87300aeb40 0x7f873015cef0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f87300cee90 tx=0x7f872c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3316170b122e01e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:47.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.672+0000 7f8735590640 1 -- 172.21.15.6:0/1110405422 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c0ac600 con 0x7f87300aeb40 2023-07-21T22:57:47.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.672+0000 7f8735590640 1 -- 172.21.15.6:0/1110405422 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872c0a8050 con 0x7f87300aeb40 2023-07-21T22:57:47.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.672+0000 7f8735590640 1 -- 172.21.15.6:0/1110405422 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c0ac980 con 0x7f87300aeb40 2023-07-21T22:57:47.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.672+0000 7f87387f6640 1 -- 172.21.15.6:0/1110405422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87300aeb40 msgr2=0x7f873015cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:47.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.672+0000 7f87387f6640 1 --2- 172.21.15.6:0/1110405422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87300aeb40 0x7f873015cef0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f87300cee90 tx=0x7f872c01c3a0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.672+0000 7f87387f6640 1 -- 172.21.15.6:0/1110405422 shutdown_connections 2023-07-21T22:57:47.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.672+0000 7f87387f6640 1 --2- 172.21.15.6:0/1110405422 >> v2:172.21.15.161:3300/0 conn(0x7f87300aef10 0x7f8730158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.672+0000 7f87387f6640 1 --2- 172.21.15.6:0/1110405422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87300aeb40 0x7f873015cef0 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.672+0000 7f87387f6640 1 -- 172.21.15.6:0/1110405422 >> 172.21.15.6:0/1110405422 conn(0x7f87300cde90 msgr2=0x7f87300ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:47.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.672+0000 7f87387f6640 1 -- 172.21.15.6:0/1110405422 shutdown_connections 2023-07-21T22:57:47.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.672+0000 7f87387f6640 1 -- 172.21.15.6:0/1110405422 wait complete. 2023-07-21T22:57:47.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.672+0000 7f87387f6640 1 Processor -- start 2023-07-21T22:57:47.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.672+0000 7f87387f6640 1 -- start start 2023-07-21T22:57:47.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f87387f6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87300aeb40 0x7f873013c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:47.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f87387f6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87300aef10 0x7f873013eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:47.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f87387f6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8730159270 0x7f87300abae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:47.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f87387f6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873013cae0 con 0x7f87300aef10 2023-07-21T22:57:47.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f87387f6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873013d060 con 0x7f87300aeb40 2023-07-21T22:57:47.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f87387f6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873013f630 con 0x7f8730159270 2023-07-21T22:57:47.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f8735d91640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87300aef10 0x7f873013eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:47.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f8735d91640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87300aef10 0x7f873013eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36016/0 (socket says 172.21.15.6:36016) 2023-07-21T22:57:47.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f8735d91640 1 -- 172.21.15.6:0/2413320449 learned_addr learned my addr 172.21.15.6:0/2413320449 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:47.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f8736592640 1 --2- 172.21.15.6:0/2413320449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87300aeb40 0x7f873013c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:47.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f8736d93640 1 --2- 172.21.15.6:0/2413320449 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8730159270 0x7f87300abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:47.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f8735d91640 1 -- 172.21.15.6:0/2413320449 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8730159270 msgr2=0x7f87300abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:47.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f8735d91640 1 --2- 172.21.15.6:0/2413320449 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8730159270 0x7f87300abae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f8735d91640 1 -- 172.21.15.6:0/2413320449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87300aeb40 msgr2=0x7f873013c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:47.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f8735d91640 1 --2- 172.21.15.6:0/2413320449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87300aeb40 0x7f873013c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f8735d91640 1 -- 172.21.15.6:0/2413320449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c009420 con 0x7f87300aef10 2023-07-21T22:57:47.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f8735d91640 1 --2- 172.21.15.6:0/2413320449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87300aef10 0x7f873013eb70 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f872000d830 tx=0x7f872000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:47.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f8726ffd640 1 -- 172.21.15.6:0/2413320449 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872000b6c0 con 0x7f87300aef10 2023-07-21T22:57:47.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f8726ffd640 1 -- 172.21.15.6:0/2413320449 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872000b820 con 0x7f87300aef10 2023-07-21T22:57:47.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f87387f6640 1 -- 172.21.15.6:0/2413320449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873013f910 con 0x7f87300aef10 2023-07-21T22:57:47.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f8726ffd640 1 -- 172.21.15.6:0/2413320449 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872000bb90 con 0x7f87300aef10 2023-07-21T22:57:47.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f87387f6640 1 -- 172.21.15.6:0/2413320449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87300ad2c0 con 0x7f87300aef10 2023-07-21T22:57:47.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f87387f6640 1 -- 172.21.15.6:0/2413320449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87300678d0 con 0x7f87300aef10 2023-07-21T22:57:47.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.676+0000 7f8726ffd640 1 -- 172.21.15.6:0/2413320449 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 96) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f872001e460 con 0x7f87300aef10 2023-07-21T22:57:47.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.680+0000 7f8726ffd640 1 -- 172.21.15.6:0/2413320449 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6865+0+0 (secure 0 0 0) 0x7f8720084340 con 0x7f87300aef10 2023-07-21T22:57:47.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.684+0000 7f8726ffd640 1 -- 172.21.15.6:0/2413320449 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f87200517f0 con 0x7f87300aef10 2023-07-21T22:57:47.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.836+0000 7f8726ffd640 1 -- 172.21.15.6:0/2413320449 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 97) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f87200512a0 con 0x7f87300aef10 2023-07-21T22:57:47.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.836+0000 7f8726ffd640 1 --2- 172.21.15.6:0/2413320449 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f871406c180 0x7f871406e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:47.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.836+0000 7f8736592640 1 --2- 172.21.15.6:0/2413320449 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f871406c180 0x7f871406e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:47.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.840+0000 7f87387f6640 1 -- 172.21.15.6:0/2413320449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87300ace00 con 0x7f87300aef10 2023-07-21T22:57:47.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.840+0000 7f8726ffd640 1 -- 172.21.15.6:0/2413320449 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v194) v1 ==== 100+0+11 (secure 0 0 0) 0x7f872007fed0 con 0x7f87300aef10 2023-07-21T22:57:47.876 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-21T22:57:47.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.844+0000 7f87387f6640 1 -- 172.21.15.6:0/2413320449 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f871406c180 msgr2=0x7f871406e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:47.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.844+0000 7f87387f6640 1 --2- 172.21.15.6:0/2413320449 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f871406c180 0x7f871406e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.844+0000 7f87387f6640 1 -- 172.21.15.6:0/2413320449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87300aef10 msgr2=0x7f873013eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:47.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.844+0000 7f87387f6640 1 --2- 172.21.15.6:0/2413320449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87300aef10 0x7f873013eb70 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f872000d830 tx=0x7f872000dcf0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.844+0000 7f87387f6640 1 -- 172.21.15.6:0/2413320449 shutdown_connections 2023-07-21T22:57:47.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.844+0000 7f87387f6640 1 --2- 172.21.15.6:0/2413320449 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f871406c180 0x7f871406e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.844+0000 7f87387f6640 1 --2- 172.21.15.6:0/2413320449 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8730159270 0x7f87300abae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.844+0000 7f87387f6640 1 --2- 172.21.15.6:0/2413320449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87300aef10 0x7f873013eb70 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.844+0000 7f87387f6640 1 --2- 172.21.15.6:0/2413320449 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87300aeb40 0x7f873013c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:47.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.844+0000 7f87387f6640 1 -- 172.21.15.6:0/2413320449 >> 172.21.15.6:0/2413320449 conn(0x7f87300cde90 msgr2=0x7f87300c44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:47.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.844+0000 7f87387f6640 1 -- 172.21.15.6:0/2413320449 shutdown_connections 2023-07-21T22:57:47.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:47.844+0000 7f87387f6640 1 -- 172.21.15.6:0/2413320449 wait complete. 2023-07-21T22:57:47.899 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:57:48.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.008+0000 7fb325337640 1 Processor -- start 2023-07-21T22:57:48.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.008+0000 7fb325337640 1 -- start start 2023-07-21T22:57:48.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.008+0000 7fb325337640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3200c8ad0 0x7fb3200c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:48.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.008+0000 7fb325337640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb3200c9560 0x7fb3200ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:48.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.008+0000 7fb325337640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3200cc700 con 0x7fb320158ce0 2023-07-21T22:57:48.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.008+0000 7fb325337640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3200c99e0 con 0x7fb3200c9560 2023-07-21T22:57:48.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.008+0000 7fb325337640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3200b0ff0 con 0x7fb3200c8ad0 2023-07-21T22:57:48.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.012+0000 7fb31f7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb3200c9560 0x7fb3200ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:48.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.012+0000 7fb317fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3200c8ad0 0x7fb3200c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:48.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.012+0000 7fb31effd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb320158ce0 0x7fb320070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:57096/0 (socket says 172.21.15.6:57096) 2023-07-21T22:57:48.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.012+0000 7fb31f7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb3200c9560 0x7fb3200ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:44336/0 (socket says 172.21.15.6:44336) 2023-07-21T22:57:48.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.012+0000 7fb31effd640 1 -- 172.21.15.6:0/3870142053 learned_addr learned my addr 172.21.15.6:0/3870142053 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:48.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.012+0000 7fb31f7fe640 1 -- 172.21.15.6:0/3870142053 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3200c8ad0 msgr2=0x7fb3200c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:48.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.012+0000 7fb31f7fe640 1 --2- 172.21.15.6:0/3870142053 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3200c8ad0 0x7fb3200c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.012+0000 7fb31f7fe640 1 -- 172.21.15.6:0/3870142053 >> v1:172.21.15.161:6789/0 conn(0x7fb320158ce0 legacy=0x7fb320070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:48.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.012+0000 7fb31f7fe640 1 -- 172.21.15.6:0/3870142053 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb320070c80 con 0x7fb3200c9560 2023-07-21T22:57:48.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.012+0000 7fb317fff640 1 --2- 172.21.15.6:0/3870142053 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3200c8ad0 0x7fb3200c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:48.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.012+0000 7fb31f7fe640 1 --2- 172.21.15.6:0/3870142053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3200c9560 0x7fb3200ccb90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fb318009d90 tx=0x7fb31801c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1334a1e9fc11e0fe server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:48.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.012+0000 7fb31e7fc640 1 -- 172.21.15.6:0/3870142053 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3180a57d0 con 0x7fb3200c9560 2023-07-21T22:57:48.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.012+0000 7fb31e7fc640 1 -- 172.21.15.6:0/3870142053 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3180a5930 con 0x7fb3200c9560 2023-07-21T22:57:48.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.012+0000 7fb31e7fc640 1 -- 172.21.15.6:0/3870142053 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3180a5cc0 con 0x7fb3200c9560 2023-07-21T22:57:48.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.016+0000 7fb325337640 1 -- 172.21.15.6:0/3870142053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3200c9560 msgr2=0x7fb3200ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:48.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.016+0000 7fb325337640 1 --2- 172.21.15.6:0/3870142053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3200c9560 0x7fb3200ccb90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fb318009d90 tx=0x7fb31801c800 comp rx=0 tx=0).stop 2023-07-21T22:57:48.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.016+0000 7fb325337640 1 -- 172.21.15.6:0/3870142053 shutdown_connections 2023-07-21T22:57:48.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.016+0000 7fb325337640 1 --2- 172.21.15.6:0/3870142053 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3200c9560 0x7fb3200ccb90 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.016+0000 7fb325337640 1 --2- 172.21.15.6:0/3870142053 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3200c8ad0 0x7fb3200c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.016+0000 7fb325337640 1 -- 172.21.15.6:0/3870142053 >> 172.21.15.6:0/3870142053 conn(0x7fb3200afcf0 msgr2=0x7fb3200b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:48.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.016+0000 7fb325337640 1 -- 172.21.15.6:0/3870142053 shutdown_connections 2023-07-21T22:57:48.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.016+0000 7fb325337640 1 -- 172.21.15.6:0/3870142053 wait complete. 2023-07-21T22:57:48.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.016+0000 7fb325337640 1 Processor -- start 2023-07-21T22:57:48.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.016+0000 7fb325337640 1 -- start start 2023-07-21T22:57:48.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.016+0000 7fb325337640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3200c8ad0 0x7fb320143210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:48.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.016+0000 7fb325337640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3200c9560 0x7fb3200cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:48.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.016+0000 7fb325337640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb320158ce0 0x7fb32015b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.016+0000 7fb325337640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32015b4a0 con 0x7fb3200c8ad0 2023-07-21T22:57:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.016+0000 7fb325337640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb320143750 con 0x7fb320158ce0 2023-07-21T22:57:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.016+0000 7fb325337640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb320144740 con 0x7fb3200c9560 2023-07-21T22:57:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.016+0000 7fb31effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3200c8ad0 0x7fb320143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.016+0000 7fb31effd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3200c8ad0 0x7fb320143210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36018/0 (socket says 172.21.15.6:36018) 2023-07-21T22:57:48.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.016+0000 7fb31effd640 1 -- 172.21.15.6:0/1210176890 learned_addr learned my addr 172.21.15.6:0/1210176890 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:48.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.016+0000 7fb317fff640 1 --2- 172.21.15.6:0/1210176890 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3200c9560 0x7fb3200cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:48.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.020+0000 7fb31f7fe640 1 --2- 172.21.15.6:0/1210176890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb320158ce0 0x7fb32015b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:48.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.020+0000 7fb31effd640 1 -- 172.21.15.6:0/1210176890 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3200c9560 msgr2=0x7fb3200cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:48.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.020+0000 7fb31effd640 1 --2- 172.21.15.6:0/1210176890 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3200c9560 0x7fb3200cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.020+0000 7fb31effd640 1 -- 172.21.15.6:0/1210176890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb320158ce0 msgr2=0x7fb32015b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:48.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.020+0000 7fb31effd640 1 --2- 172.21.15.6:0/1210176890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb320158ce0 0x7fb32015b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.020+0000 7fb31effd640 1 -- 172.21.15.6:0/1210176890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb308009420 con 0x7fb3200c8ad0 2023-07-21T22:57:48.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.020+0000 7fb31f7fe640 1 --2- 172.21.15.6:0/1210176890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb320158ce0 0x7fb32015b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:48.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.020+0000 7fb31effd640 1 --2- 172.21.15.6:0/1210176890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3200c8ad0 0x7fb320143210 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7fb31000c400 tx=0x7fb31000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:48.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.020+0000 7fb3177fe640 1 -- 172.21.15.6:0/1210176890 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310005cf0 con 0x7fb3200c8ad0 2023-07-21T22:57:48.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.020+0000 7fb3177fe640 1 -- 172.21.15.6:0/1210176890 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb310005e50 con 0x7fb3200c8ad0 2023-07-21T22:57:48.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.020+0000 7fb325337640 1 -- 172.21.15.6:0/1210176890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb318009a70 con 0x7fb3200c8ad0 2023-07-21T22:57:48.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.020+0000 7fb3177fe640 1 -- 172.21.15.6:0/1210176890 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3100072d0 con 0x7fb3200c8ad0 2023-07-21T22:57:48.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.020+0000 7fb325337640 1 -- 172.21.15.6:0/1210176890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32015b0c0 con 0x7fb3200c8ad0 2023-07-21T22:57:48.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.020+0000 7fb325337640 1 -- 172.21.15.6:0/1210176890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3200ca1a0 con 0x7fb3200c8ad0 2023-07-21T22:57:48.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.020+0000 7fb3177fe640 1 -- 172.21.15.6:0/1210176890 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 97) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fb310007430 con 0x7fb3200c8ad0 2023-07-21T22:57:48.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.020+0000 7fb3177fe640 1 --2- 172.21.15.6:0/1210176890 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fb3000660d0 0x7fb300068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:48.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.020+0000 7fb3177fe640 1 -- 172.21.15.6:0/1210176890 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6865+0+0 (secure 0 0 0) 0x7fb310083140 con 0x7fb3200c8ad0 2023-07-21T22:57:48.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.024+0000 7fb317fff640 1 --2- 172.21.15.6:0/1210176890 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fb3000660d0 0x7fb300068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:48.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.024+0000 7fb317fff640 1 --2- 172.21.15.6:0/1210176890 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fb3000660d0 0x7fb300068580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb3201480f0 tx=0x7fb308009190 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:48.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.024+0000 7fb3177fe640 1 -- 172.21.15.6:0/1210176890 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb310050680 con 0x7fb3200c8ad0 2023-07-21T22:57:48.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.216+0000 7fb325337640 1 -- 172.21.15.6:0/1210176890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb32015b710 con 0x7fb3200c8ad0 2023-07-21T22:57:48.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.216+0000 7fb3177fe640 1 -- 172.21.15.6:0/1210176890 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4667 (secure 0 0 0) 0x7fb310053ca0 con 0x7fb3200c8ad0 2023-07-21T22:57:48.253 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:48.253 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8765,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/617196146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":617196146},{"type":"v1","addr":"172.21.15.161:6836","nonce":617196146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9976,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/618083440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":618083440},{"type":"v1","addr":"172.21.15.161:6837","nonce":618083440}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":10503,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/205515898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":205515898},{"type":"v1","addr":"172.21.15.6:6834","nonce":205515898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:57:22.895862+0000","modified":"2023-07-21T22:57:26.519881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10506":{"gid":10506,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/963904366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":963904366},{"type":"v1","addr":"172.21.15.6:6835","nonce":963904366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-21T22:57:48.253 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 86 2023-07-21T22:57:48.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.220+0000 7fb325337640 1 -- 172.21.15.6:0/1210176890 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fb3000660d0 msgr2=0x7fb300068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:48.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.220+0000 7fb325337640 1 --2- 172.21.15.6:0/1210176890 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fb3000660d0 0x7fb300068580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb3201480f0 tx=0x7fb308009190 comp rx=0 tx=0).stop 2023-07-21T22:57:48.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.220+0000 7fb325337640 1 -- 172.21.15.6:0/1210176890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3200c8ad0 msgr2=0x7fb320143210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:48.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.220+0000 7fb325337640 1 --2- 172.21.15.6:0/1210176890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3200c8ad0 0x7fb320143210 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7fb31000c400 tx=0x7fb31000c8c0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.220+0000 7fb325337640 1 -- 172.21.15.6:0/1210176890 shutdown_connections 2023-07-21T22:57:48.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.220+0000 7fb325337640 1 --2- 172.21.15.6:0/1210176890 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fb3000660d0 0x7fb300068580 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.220+0000 7fb325337640 1 --2- 172.21.15.6:0/1210176890 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb320158ce0 0x7fb32015b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.220+0000 7fb325337640 1 --2- 172.21.15.6:0/1210176890 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3200c9560 0x7fb3200cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.220+0000 7fb325337640 1 --2- 172.21.15.6:0/1210176890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3200c8ad0 0x7fb320143210 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.220+0000 7fb325337640 1 -- 172.21.15.6:0/1210176890 >> 172.21.15.6:0/1210176890 conn(0x7fb3200afcf0 msgr2=0x7fb32014dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:48.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.220+0000 7fb325337640 1 -- 172.21.15.6:0/1210176890 shutdown_connections 2023-07-21T22:57:48.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.220+0000 7fb325337640 1 -- 172.21.15.6:0/1210176890 wait complete. 2023-07-21T22:57:48.273 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:57:48.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.380+0000 7f4191d37640 1 Processor -- start 2023-07-21T22:57:48.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.380+0000 7f4191d37640 1 -- start start 2023-07-21T22:57:48.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.384+0000 7f4191d37640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f418c0c9730 0x7f418c1638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:48.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.384+0000 7f4191d37640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418c0cc700 con 0x7f418c0c8ad0 2023-07-21T22:57:48.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.384+0000 7f4191d37640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418c0b0ff0 con 0x7f418c158ce0 2023-07-21T22:57:48.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.384+0000 7f4191d37640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418c070c80 con 0x7f418c0c9730 2023-07-21T22:57:48.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.384+0000 7f418bfff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f418c0c9730 0x7f418c1638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:48.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.384+0000 7f4183fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f418c0c8ad0 0x7f418c0c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33746/0 (socket says 172.21.15.6:33746) 2023-07-21T22:57:48.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.384+0000 7f4183fff640 1 -- 172.21.15.6:0/1034212672 learned_addr learned my addr 172.21.15.6:0/1034212672 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:48.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.384+0000 7f418bfff640 1 -- 172.21.15.6:0/1034212672 >> v1:172.21.15.161:6789/0 conn(0x7f418c158ce0 legacy=0x7f418c070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:48.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.384+0000 7f418bfff640 1 -- 172.21.15.6:0/1034212672 >> v1:172.21.15.6:6789/0 conn(0x7f418c0c8ad0 legacy=0x7f418c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:48.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.384+0000 7f418bfff640 1 -- 172.21.15.6:0/1034212672 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c0cbdd0 con 0x7f418c0c9730 2023-07-21T22:57:48.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.384+0000 7f418affd640 1 -- 172.21.15.6:0/1034212672 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644712573 0 0) 0x7f418c0cc700 con 0x7f418c0c8ad0 2023-07-21T22:57:48.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.388+0000 7f418bfff640 1 --2- 172.21.15.6:0/1034212672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c0c9730 0x7f418c1638b0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f4184009d90 tx=0x7f418401c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b350e3c4b9f26b12 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:48.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.388+0000 7f418affd640 1 -- 172.21.15.6:0/1034212672 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41840a58e0 con 0x7f418c0c9730 2023-07-21T22:57:48.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.388+0000 7f418affd640 1 -- 172.21.15.6:0/1034212672 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41840a5a40 con 0x7f418c0c9730 2023-07-21T22:57:48.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.388+0000 7f418affd640 1 -- 172.21.15.6:0/1034212672 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41840a5dd0 con 0x7f418c0c9730 2023-07-21T22:57:48.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.388+0000 7f4191d37640 1 -- 172.21.15.6:0/1034212672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c0c9730 msgr2=0x7f418c1638b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:48.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.388+0000 7f4191d37640 1 --2- 172.21.15.6:0/1034212672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c0c9730 0x7f418c1638b0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f4184009d90 tx=0x7f418401c800 comp rx=0 tx=0).stop 2023-07-21T22:57:48.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.388+0000 7f4191d37640 1 -- 172.21.15.6:0/1034212672 shutdown_connections 2023-07-21T22:57:48.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.388+0000 7f4191d37640 1 --2- 172.21.15.6:0/1034212672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c0c9730 0x7f418c1638b0 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.388+0000 7f4191d37640 1 -- 172.21.15.6:0/1034212672 >> 172.21.15.6:0/1034212672 conn(0x7f418c0afcf0 msgr2=0x7f418c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:48.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.388+0000 7f4191d37640 1 -- 172.21.15.6:0/1034212672 shutdown_connections 2023-07-21T22:57:48.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.388+0000 7f4191d37640 1 -- 172.21.15.6:0/1034212672 wait complete. 2023-07-21T22:57:48.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.388+0000 7f4191d37640 1 Processor -- start 2023-07-21T22:57:48.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.388+0000 7f4191d37640 1 -- start start 2023-07-21T22:57:48.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f4191d37640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f418c0c8ad0 0x7f418c1f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:48.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f4191d37640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f418c0c9730 0x7f418c14b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:48.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f4191d37640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c158ce0 0x7f418c151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:48.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f4191d37640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0c2490 con 0x7f418c158ce0 2023-07-21T22:57:48.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f4191d37640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0c2770 con 0x7f418c0c8ad0 2023-07-21T22:57:48.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f4191d37640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418c0c2a50 con 0x7f418c0c9730 2023-07-21T22:57:48.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f418bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c158ce0 0x7f418c151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:48.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f418bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c158ce0 0x7f418c151630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36028/0 (socket says 172.21.15.6:36028) 2023-07-21T22:57:48.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f418bfff640 1 -- 172.21.15.6:0/2786699946 learned_addr learned my addr 172.21.15.6:0/2786699946 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:48.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f418b7fe640 1 --2- 172.21.15.6:0/2786699946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f418c0c8ad0 0x7f418c1f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:48.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f4183fff640 1 --2- 172.21.15.6:0/2786699946 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f418c0c9730 0x7f418c14b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:48.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f418bfff640 1 -- 172.21.15.6:0/2786699946 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f418c0c9730 msgr2=0x7f418c14b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:48.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f418bfff640 1 --2- 172.21.15.6:0/2786699946 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f418c0c9730 0x7f418c14b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f418bfff640 1 -- 172.21.15.6:0/2786699946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f418c0c8ad0 msgr2=0x7f418c1f5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:48.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f418bfff640 1 --2- 172.21.15.6:0/2786699946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f418c0c8ad0 0x7f418c1f5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f418bfff640 1 -- 172.21.15.6:0/2786699946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4184009a70 con 0x7f418c158ce0 2023-07-21T22:57:48.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f418b7fe640 1 --2- 172.21.15.6:0/2786699946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f418c0c8ad0 0x7f418c1f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:48.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f418bfff640 1 --2- 172.21.15.6:0/2786699946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c158ce0 0x7f418c151630 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f418401a430 tx=0x7f41840195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:48.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f4188ff9640 1 -- 172.21.15.6:0/2786699946 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41840b9860 con 0x7f418c158ce0 2023-07-21T22:57:48.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f4188ff9640 1 -- 172.21.15.6:0/2786699946 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41840b99c0 con 0x7f418c158ce0 2023-07-21T22:57:48.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f4188ff9640 1 -- 172.21.15.6:0/2786699946 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41840b9d50 con 0x7f418c158ce0 2023-07-21T22:57:48.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f4191d37640 1 -- 172.21.15.6:0/2786699946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418c0c2d30 con 0x7f418c158ce0 2023-07-21T22:57:48.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f4191d37640 1 -- 172.21.15.6:0/2786699946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418c14b7d0 con 0x7f418c158ce0 2023-07-21T22:57:48.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f4191d37640 1 -- 172.21.15.6:0/2786699946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418c0ca1a0 con 0x7f418c158ce0 2023-07-21T22:57:48.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.392+0000 7f4188ff9640 1 -- 172.21.15.6:0/2786699946 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 97) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f41840ad440 con 0x7f418c158ce0 2023-07-21T22:57:48.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.396+0000 7f4188ff9640 1 --2- 172.21.15.6:0/2786699946 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f416c066100 0x7f416c0685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:48.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.396+0000 7f4188ff9640 1 -- 172.21.15.6:0/2786699946 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6865+0+0 (secure 0 0 0) 0x7f418411ee10 con 0x7f418c158ce0 2023-07-21T22:57:48.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.396+0000 7f418b7fe640 1 --2- 172.21.15.6:0/2786699946 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f416c066100 0x7f416c0685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:48.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.396+0000 7f418b7fe640 1 --2- 172.21.15.6:0/2786699946 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f416c066100 0x7f416c0685b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f418c1f51b0 tx=0x7f417c009040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:48.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.400+0000 7f4188ff9640 1 -- 172.21.15.6:0/2786699946 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f41840ec2a0 con 0x7f418c158ce0 2023-07-21T22:57:48.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.552+0000 7f4191d37640 1 -- 172.21.15.6:0/2786699946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f418c0c31e0 con 0x7f418c158ce0 2023-07-21T22:57:48.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.556+0000 7f4188ff9640 1 -- 172.21.15.6:0/2786699946 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) v1 ==== 74+0+19412 (secure 0 0 0) 0x7f418c0c31e0 con 0x7f418c158ce0 2023-07-21T22:57:48.591 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:48.592 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":194,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:57:46.822875+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:57:21.014468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-21T22:57:21.883517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/3754480080":"2023-07-22T22:57:46.822841+0000","172.21.15.161:0/2032388246":"2023-07-22T22:57:46.822841+0000","172.21.15.161:6832/2599285906":"2023-07-22T22:57:46.822841+0000","172.21.15.161:0/2086729558":"2023-07-22T22:57:46.822841+0000","172.21.15.161:6833/2599285906":"2023-07-22T22:57:46.822841+0000","172.21.15.161:0/3809050192":"2023-07-22T22:57:46.822841+0000","172.21.15.161:0/568512462":"2023-07-22T22:57:40.018539+0000","172.21.15.161:6833/406143921":"2023-07-22T22:57:40.018539+0000","172.21.15.161:6832/406143921":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/2047544093":"2023-07-22T22:57:46.822841+0000","172.21.15.161:0/323615512":"2023-07-22T22:57:46.822841+0000","172.21.15.161:0/2299078826":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/1726684525":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/319560030":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/3583156451":"2023-07-22T22:57:46.822841+0000","172.21.15.161:0/389011228":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/3791982345":"2023-07-22T22:57:40.018539+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:57:48.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.556+0000 7f4191d37640 1 -- 172.21.15.6:0/2786699946 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f416c066100 msgr2=0x7f416c0685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:48.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.556+0000 7f4191d37640 1 --2- 172.21.15.6:0/2786699946 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f416c066100 0x7f416c0685b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f418c1f51b0 tx=0x7f417c009040 comp rx=0 tx=0).stop 2023-07-21T22:57:48.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.556+0000 7f4191d37640 1 -- 172.21.15.6:0/2786699946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c158ce0 msgr2=0x7f418c151630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:48.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.556+0000 7f4191d37640 1 --2- 172.21.15.6:0/2786699946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c158ce0 0x7f418c151630 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f418401a430 tx=0x7f41840195a0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.556+0000 7f4191d37640 1 -- 172.21.15.6:0/2786699946 shutdown_connections 2023-07-21T22:57:48.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.556+0000 7f4191d37640 1 --2- 172.21.15.6:0/2786699946 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f416c066100 0x7f416c0685b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.556+0000 7f4191d37640 1 --2- 172.21.15.6:0/2786699946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f418c158ce0 0x7f418c151630 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.556+0000 7f4191d37640 1 --2- 172.21.15.6:0/2786699946 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f418c0c9730 0x7f418c14b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.556+0000 7f4191d37640 1 --2- 172.21.15.6:0/2786699946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f418c0c8ad0 0x7f418c1f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.556+0000 7f4191d37640 1 -- 172.21.15.6:0/2786699946 >> 172.21.15.6:0/2786699946 conn(0x7f418c0afcf0 msgr2=0x7f418c14e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:48.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.556+0000 7f4191d37640 1 -- 172.21.15.6:0/2786699946 shutdown_connections 2023-07-21T22:57:48.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.556+0000 7f4191d37640 1 -- 172.21.15.6:0/2786699946 wait complete. 2023-07-21T22:57:48.612 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-21T22:57:48.612 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:57:48.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.720+0000 7f4af93c5640 1 Processor -- start 2023-07-21T22:57:48.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.720+0000 7f4af93c5640 1 -- start start 2023-07-21T22:57:48.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.724+0000 7f4af93c5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4af40c8ad0 0x7f4af40c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:48.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.724+0000 7f4af93c5640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af40c99c0 con 0x7f4af40c9560 2023-07-21T22:57:48.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.724+0000 7f4af93c5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af40cc700 con 0x7f4af4158ce0 2023-07-21T22:57:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.724+0000 7f4af93c5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af40b0ff0 con 0x7f4af40c8ad0 2023-07-21T22:57:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.724+0000 7f4af37fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4af40c9560 0x7f4af40ccb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33756/0 (socket says 172.21.15.6:33756) 2023-07-21T22:57:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.724+0000 7f4af37fe640 1 -- 172.21.15.6:0/4246300516 learned_addr learned my addr 172.21.15.6:0/4246300516 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.724+0000 7f4aebfff640 1 --2- 172.21.15.6:0/4246300516 >> v2:172.21.15.161:3300/0 conn(0x7f4af40c8ad0 0x7f4af40c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:48.759 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:57:48.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.724+0000 7f4af27fc640 1 -- 172.21.15.6:0/4246300516 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756446490 0 0) 0x7f4af40c99c0 con 0x7f4af40c9560 2023-07-21T22:57:48.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.724+0000 7f4af27fc640 1 -- 172.21.15.6:0/4246300516 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ae0003530 con 0x7f4af40c9560 2023-07-21T22:57:48.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.724+0000 7f4af27fc640 1 -- 172.21.15.6:0/4246300516 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770532766 0 0) 0x7f4af40cc700 con 0x7f4af4158ce0 2023-07-21T22:57:48.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.724+0000 7f4af27fc640 1 -- 172.21.15.6:0/4246300516 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4af40c99c0 con 0x7f4af4158ce0 2023-07-21T22:57:48.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.724+0000 7f4aebfff640 1 -- 172.21.15.6:0/4246300516 >> v1:172.21.15.161:6789/0 conn(0x7f4af4158ce0 legacy=0x7f4af4070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:48.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.724+0000 7f4aebfff640 1 -- 172.21.15.6:0/4246300516 >> v1:172.21.15.6:6789/0 conn(0x7f4af40c9560 legacy=0x7f4af40ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:48.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.724+0000 7f4aebfff640 1 -- 172.21.15.6:0/4246300516 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af4070c80 con 0x7f4af40c8ad0 2023-07-21T22:57:48.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.728+0000 7f4aebfff640 1 --2- 172.21.15.6:0/4246300516 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4af40c8ad0 0x7f4af40c9020 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0097c0 tx=0x7f4adc01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9095fac20aae21ee server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:48.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.728+0000 7f4af27fc640 1 -- 172.21.15.6:0/4246300516 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc0ab600 con 0x7f4af40c8ad0 2023-07-21T22:57:48.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.728+0000 7f4af27fc640 1 -- 172.21.15.6:0/4246300516 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc0a7050 con 0x7f4af40c8ad0 2023-07-21T22:57:48.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.728+0000 7f4af27fc640 1 -- 172.21.15.6:0/4246300516 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4adc0ab980 con 0x7f4af40c8ad0 2023-07-21T22:57:48.765 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:57:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.728+0000 7f4af93c5640 1 -- 172.21.15.6:0/4246300516 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4af40c8ad0 msgr2=0x7f4af40c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.728+0000 7f4af93c5640 1 --2- 172.21.15.6:0/4246300516 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4af40c8ad0 0x7f4af40c9020 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f4adc0097c0 tx=0x7f4adc01c330 comp rx=0 tx=0).stop 2023-07-21T22:57:48.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.728+0000 7f4af93c5640 1 -- 172.21.15.6:0/4246300516 shutdown_connections 2023-07-21T22:57:48.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.728+0000 7f4af93c5640 1 --2- 172.21.15.6:0/4246300516 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4af40c8ad0 0x7f4af40c9020 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.728+0000 7f4af93c5640 1 -- 172.21.15.6:0/4246300516 >> 172.21.15.6:0/4246300516 conn(0x7f4af40afcf0 msgr2=0x7f4af40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:48.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.728+0000 7f4af93c5640 1 -- 172.21.15.6:0/4246300516 shutdown_connections 2023-07-21T22:57:48.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.728+0000 7f4af93c5640 1 -- 172.21.15.6:0/4246300516 wait complete. 2023-07-21T22:57:48.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.728+0000 7f4af93c5640 1 Processor -- start 2023-07-21T22:57:48.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.728+0000 7f4af93c5640 1 -- start start 2023-07-21T22:57:48.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.728+0000 7f4af93c5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4af40c8ad0 0x7f4af4142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:48.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.728+0000 7f4af93c5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4af40c9560 0x7f4af40ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:48.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4af93c5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af4158ce0 0x7f4af4166df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:48.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4af93c5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af414b5e0 con 0x7f4af4158ce0 2023-07-21T22:57:48.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4af93c5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af414b8c0 con 0x7f4af40c9560 2023-07-21T22:57:48.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4af93c5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af414bba0 con 0x7f4af40c8ad0 2023-07-21T22:57:48.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4af37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af4158ce0 0x7f4af4166df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:48.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4af37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af4158ce0 0x7f4af4166df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36044/0 (socket says 172.21.15.6:36044) 2023-07-21T22:57:48.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4af37fe640 1 -- 172.21.15.6:0/3412574054 learned_addr learned my addr 172.21.15.6:0/3412574054 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:48.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4af2ffd640 1 --2- 172.21.15.6:0/3412574054 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4af40c8ad0 0x7f4af4142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:48.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4aebfff640 1 --2- 172.21.15.6:0/3412574054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4af40c9560 0x7f4af40ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:48.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4af37fe640 1 -- 172.21.15.6:0/3412574054 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4af40c8ad0 msgr2=0x7f4af4142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:48.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4af37fe640 1 --2- 172.21.15.6:0/3412574054 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4af40c8ad0 0x7f4af4142f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4af37fe640 1 -- 172.21.15.6:0/3412574054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4af40c9560 msgr2=0x7f4af40ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:48.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4af37fe640 1 --2- 172.21.15.6:0/3412574054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4af40c9560 0x7f4af40ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4af37fe640 1 -- 172.21.15.6:0/3412574054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc009420 con 0x7f4af4158ce0 2023-07-21T22:57:48.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4af37fe640 1 --2- 172.21.15.6:0/3412574054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af4158ce0 0x7f4af4166df0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00cba0 tx=0x7f4aec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:48.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4aeb7fe640 1 -- 172.21.15.6:0/3412574054 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec00ace0 con 0x7f4af4158ce0 2023-07-21T22:57:48.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4aeb7fe640 1 -- 172.21.15.6:0/3412574054 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aec00ae40 con 0x7f4af4158ce0 2023-07-21T22:57:48.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4aeb7fe640 1 -- 172.21.15.6:0/3412574054 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aec012620 con 0x7f4af4158ce0 2023-07-21T22:57:48.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4af93c5640 1 -- 172.21.15.6:0/3412574054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af414be80 con 0x7f4af4158ce0 2023-07-21T22:57:48.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4af93c5640 1 -- 172.21.15.6:0/3412574054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af4143590 con 0x7f4af4158ce0 2023-07-21T22:57:48.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4af93c5640 1 -- 172.21.15.6:0/3412574054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af40ca1a0 con 0x7f4af4158ce0 2023-07-21T22:57:48.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.732+0000 7f4aeb7fe640 1 -- 172.21.15.6:0/3412574054 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 97) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f4aec007070 con 0x7f4af4158ce0 2023-07-21T22:57:48.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.736+0000 7f4aeb7fe640 1 --2- 172.21.15.6:0/3412574054 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f4ad4066100 0x7f4ad40685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:48.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.736+0000 7f4aeb7fe640 1 -- 172.21.15.6:0/3412574054 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6865+0+0 (secure 0 0 0) 0x7f4aec083d90 con 0x7f4af4158ce0 2023-07-21T22:57:48.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.736+0000 7f4af2ffd640 1 --2- 172.21.15.6:0/3412574054 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f4ad4066100 0x7f4ad40685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:48.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.736+0000 7f4af2ffd640 1 --2- 172.21.15.6:0/3412574054 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f4ad4066100 0x7f4ad40685b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40011f0 tx=0x7f4ae4009040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:48.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.740+0000 7f4aeb7fe640 1 -- 172.21.15.6:0/3412574054 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4aec054be0 con 0x7f4af4158ce0 2023-07-21T22:57:48.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.928+0000 7f4af93c5640 1 -- 172.21.15.6:0/3412574054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4af414b720 con 0x7f4af4158ce0 2023-07-21T22:57:48.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.928+0000 7f4aeb7fe640 1 -- 172.21.15.6:0/3412574054 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4667 (secure 0 0 0) 0x7f4af414b720 con 0x7f4af4158ce0 2023-07-21T22:57:48.965 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:48.965 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8765,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/617196146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":617196146},{"type":"v1","addr":"172.21.15.161:6836","nonce":617196146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9976,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/618083440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":618083440},{"type":"v1","addr":"172.21.15.161:6837","nonce":618083440}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":10503,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/205515898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":205515898},{"type":"v1","addr":"172.21.15.6:6834","nonce":205515898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:57:22.895862+0000","modified":"2023-07-21T22:57:26.519881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10506":{"gid":10506,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/963904366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":963904366},{"type":"v1","addr":"172.21.15.6:6835","nonce":963904366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-21T22:57:48.966 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 86 2023-07-21T22:57:48.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.928+0000 7f4af93c5640 1 -- 172.21.15.6:0/3412574054 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f4ad4066100 msgr2=0x7f4ad40685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:48.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.928+0000 7f4af93c5640 1 --2- 172.21.15.6:0/3412574054 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f4ad4066100 0x7f4ad40685b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40011f0 tx=0x7f4ae4009040 comp rx=0 tx=0).stop 2023-07-21T22:57:48.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.928+0000 7f4af93c5640 1 -- 172.21.15.6:0/3412574054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af4158ce0 msgr2=0x7f4af4166df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:48.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.928+0000 7f4af93c5640 1 --2- 172.21.15.6:0/3412574054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af4158ce0 0x7f4af4166df0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00cba0 tx=0x7f4aec00a430 comp rx=0 tx=0).stop 2023-07-21T22:57:48.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.928+0000 7f4af93c5640 1 -- 172.21.15.6:0/3412574054 shutdown_connections 2023-07-21T22:57:48.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.928+0000 7f4af93c5640 1 --2- 172.21.15.6:0/3412574054 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f4ad4066100 0x7f4ad40685b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.928+0000 7f4af93c5640 1 --2- 172.21.15.6:0/3412574054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af4158ce0 0x7f4af4166df0 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.928+0000 7f4af93c5640 1 --2- 172.21.15.6:0/3412574054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4af40c9560 0x7f4af40ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.928+0000 7f4af93c5640 1 --2- 172.21.15.6:0/3412574054 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4af40c8ad0 0x7f4af4142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:48.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.928+0000 7f4af93c5640 1 -- 172.21.15.6:0/3412574054 >> 172.21.15.6:0/3412574054 conn(0x7f4af40afcf0 msgr2=0x7f4af40ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:48.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.932+0000 7f4af93c5640 1 -- 172.21.15.6:0/3412574054 shutdown_connections 2023-07-21T22:57:48.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:48.932+0000 7f4af93c5640 1 -- 172.21.15.6:0/3412574054 wait complete. 2023-07-21T22:57:48.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:57:49.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.092+0000 7f7f02dc5640 1 Processor -- start 2023-07-21T22:57:49.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.092+0000 7f7f02dc5640 1 -- start start 2023-07-21T22:57:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.096+0000 7f7f02dc5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7efc0c8ad0 0x7f7efc0c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.096+0000 7f7f02dc5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7efc0c9560 0x7f7efc0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.096+0000 7f7f02dc5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7efc0cc700 con 0x7f7efc158ce0 2023-07-21T22:57:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.096+0000 7f7f02dc5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7efc0c99e0 con 0x7f7efc0c8ad0 2023-07-21T22:57:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.096+0000 7f7f02dc5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0b0ff0 con 0x7f7efc0c9560 2023-07-21T22:57:49.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.096+0000 7f7f00b61640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7efc158ce0 0x7f7efc070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:57130/0 (socket says 172.21.15.6:57130) 2023-07-21T22:57:49.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.096+0000 7f7f00b61640 1 -- 172.21.15.6:0/2946059350 learned_addr learned my addr 172.21.15.6:0/2946059350 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:49.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.096+0000 7f7efbfff640 1 --2- 172.21.15.6:0/2946059350 >> v2:172.21.15.161:3300/0 conn(0x7f7efc0c8ad0 0x7f7efc0c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:49.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.096+0000 7f7f01362640 1 --2- 172.21.15.6:0/2946059350 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7efc0c9560 0x7f7efc0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:49.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.096+0000 7f7efb7fe640 1 -- 172.21.15.6:0/2946059350 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98648161 0 0) 0x7f7efc0cc700 con 0x7f7efc158ce0 2023-07-21T22:57:49.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.096+0000 7f7efb7fe640 1 -- 172.21.15.6:0/2946059350 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eec005740 con 0x7f7efc158ce0 2023-07-21T22:57:49.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.096+0000 7f7efbfff640 1 -- 172.21.15.6:0/2946059350 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7efc0c9560 msgr2=0x7f7efc0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:49.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.096+0000 7f7efbfff640 1 --2- 172.21.15.6:0/2946059350 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7efc0c9560 0x7f7efc0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.096+0000 7f7efbfff640 1 -- 172.21.15.6:0/2946059350 >> v1:172.21.15.161:6789/0 conn(0x7f7efc158ce0 legacy=0x7f7efc070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:49.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.096+0000 7f7efbfff640 1 -- 172.21.15.6:0/2946059350 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc070c80 con 0x7f7efc0c8ad0 2023-07-21T22:57:49.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.096+0000 7f7f01362640 1 --2- 172.21.15.6:0/2946059350 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7efc0c9560 0x7f7efc0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:49.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.100+0000 7f7efbfff640 1 --2- 172.21.15.6:0/2946059350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7efc0c8ad0 0x7f7efc0c9020 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f7ee80097c0 tx=0x7f7ee801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7bb178d5925010e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:49.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.100+0000 7f7efb7fe640 1 -- 172.21.15.6:0/2946059350 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee80ab600 con 0x7f7efc0c8ad0 2023-07-21T22:57:49.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.100+0000 7f7efb7fe640 1 -- 172.21.15.6:0/2946059350 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee80a7050 con 0x7f7efc0c8ad0 2023-07-21T22:57:49.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.100+0000 7f7efb7fe640 1 -- 172.21.15.6:0/2946059350 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee80ab980 con 0x7f7efc0c8ad0 2023-07-21T22:57:49.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.100+0000 7f7f02dc5640 1 -- 172.21.15.6:0/2946059350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7efc0c8ad0 msgr2=0x7f7efc0c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:49.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.100+0000 7f7f02dc5640 1 --2- 172.21.15.6:0/2946059350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7efc0c8ad0 0x7f7efc0c9020 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f7ee80097c0 tx=0x7f7ee801c330 comp rx=0 tx=0).stop 2023-07-21T22:57:49.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.100+0000 7f7f02dc5640 1 -- 172.21.15.6:0/2946059350 shutdown_connections 2023-07-21T22:57:49.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.100+0000 7f7f02dc5640 1 --2- 172.21.15.6:0/2946059350 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7efc0c9560 0x7f7efc0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.100+0000 7f7f02dc5640 1 --2- 172.21.15.6:0/2946059350 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7efc0c8ad0 0x7f7efc0c9020 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.100+0000 7f7f02dc5640 1 -- 172.21.15.6:0/2946059350 >> 172.21.15.6:0/2946059350 conn(0x7f7efc0afcf0 msgr2=0x7f7efc0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:49.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.100+0000 7f7f02dc5640 1 -- 172.21.15.6:0/2946059350 shutdown_connections 2023-07-21T22:57:49.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.100+0000 7f7f02dc5640 1 -- 172.21.15.6:0/2946059350 wait complete. 2023-07-21T22:57:49.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.100+0000 7f7f02dc5640 1 Processor -- start 2023-07-21T22:57:49.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.100+0000 7f7f02dc5640 1 -- start start 2023-07-21T22:57:49.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7f02dc5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7efc0c8ad0 0x7f7efc0c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:49.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7f02dc5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7efc0c9560 0x7f7efc1501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:49.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7f02dc5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7efc158ce0 0x7f7efc0ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:49.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7f02dc5640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0c4be0 con 0x7f7efc0c9560 2023-07-21T22:57:49.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7f02dc5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc147e60 con 0x7f7efc158ce0 2023-07-21T22:57:49.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7f02dc5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0c2530 con 0x7f7efc0c8ad0 2023-07-21T22:57:49.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7efbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7efc0c9560 0x7f7efc1501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:49.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7efbfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7efc0c9560 0x7f7efc1501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36058/0 (socket says 172.21.15.6:36058) 2023-07-21T22:57:49.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7efbfff640 1 -- 172.21.15.6:0/907140646 learned_addr learned my addr 172.21.15.6:0/907140646 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:49.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7f00b61640 1 --2- 172.21.15.6:0/907140646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7efc0c8ad0 0x7f7efc0c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:49.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7f01362640 1 --2- 172.21.15.6:0/907140646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7efc158ce0 0x7f7efc0ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:49.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7efbfff640 1 -- 172.21.15.6:0/907140646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7efc0c8ad0 msgr2=0x7f7efc0c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:49.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7efbfff640 1 --2- 172.21.15.6:0/907140646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7efc0c8ad0 0x7f7efc0c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7efbfff640 1 -- 172.21.15.6:0/907140646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7efc158ce0 msgr2=0x7f7efc0ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:49.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7efbfff640 1 --2- 172.21.15.6:0/907140646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7efc158ce0 0x7f7efc0ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7efbfff640 1 -- 172.21.15.6:0/907140646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef4009a70 con 0x7f7efc0c9560 2023-07-21T22:57:49.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7efbfff640 1 --2- 172.21.15.6:0/907140646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7efc0c9560 0x7f7efc1501a0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f7ee80ae040 tx=0x7f7ee80190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:49.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7ef97fa640 1 -- 172.21.15.6:0/907140646 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8006e20 con 0x7f7efc0c9560 2023-07-21T22:57:49.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7ef97fa640 1 -- 172.21.15.6:0/907140646 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee80b4410 con 0x7f7efc0c9560 2023-07-21T22:57:49.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7ef97fa640 1 -- 172.21.15.6:0/907140646 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee80b47e0 con 0x7f7efc0c9560 2023-07-21T22:57:49.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7f02dc5640 1 -- 172.21.15.6:0/907140646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee8009420 con 0x7f7efc0c9560 2023-07-21T22:57:49.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7f02dc5640 1 -- 172.21.15.6:0/907140646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7efc14f380 con 0x7f7efc0c9560 2023-07-21T22:57:49.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.104+0000 7f7f02dc5640 1 -- 172.21.15.6:0/907140646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7efc0ca1a0 con 0x7f7efc0c9560 2023-07-21T22:57:49.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.108+0000 7f7ef97fa640 1 -- 172.21.15.6:0/907140646 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 97) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f7ee80b2040 con 0x7f7efc0c9560 2023-07-21T22:57:49.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.108+0000 7f7ef97fa640 1 --2- 172.21.15.6:0/907140646 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f7ee00660d0 0x7f7ee0068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:49.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.108+0000 7f7ef97fa640 1 -- 172.21.15.6:0/907140646 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6865+0+0 (secure 0 0 0) 0x7f7ee811dbf0 con 0x7f7efc0c9560 2023-07-21T22:57:49.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.108+0000 7f7f00b61640 1 --2- 172.21.15.6:0/907140646 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f7ee00660d0 0x7f7ee0068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:49.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.108+0000 7f7f00b61640 1 --2- 172.21.15.6:0/907140646 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f7ee00660d0 0x7f7ee0068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00011f0 tx=0x7f7ef0007d40 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:49.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.112+0000 7f7ef97fa640 1 -- 172.21.15.6:0/907140646 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7ee80eb060 con 0x7f7efc0c9560 2023-07-21T22:57:49.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.280+0000 7f7ef97fa640 1 -- 172.21.15.6:0/907140646 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7ee80eb430 con 0x7f7efc0c9560 2023-07-21T22:57:49.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.300+0000 7f7f02dc5640 1 -- 172.21.15.6:0/907140646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7efc0678d0 con 0x7f7efc0c9560 2023-07-21T22:57:49.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.304+0000 7f7ef97fa640 1 -- 172.21.15.6:0/907140646 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4667 (secure 0 0 0) 0x7f7ee8105b20 con 0x7f7efc0c9560 2023-07-21T22:57:49.338 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:49.338 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8765,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/617196146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":617196146},{"type":"v1","addr":"172.21.15.161:6836","nonce":617196146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9976,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/618083440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":618083440},{"type":"v1","addr":"172.21.15.161:6837","nonce":618083440}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":10503,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/205515898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":205515898},{"type":"v1","addr":"172.21.15.6:6834","nonce":205515898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-21T22:57:22.895862+0000","modified":"2023-07-21T22:57:26.519881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10506},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10506":{"gid":10506,"name":"c","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6835/963904366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":963904366},{"type":"v1","addr":"172.21.15.6:6835","nonce":963904366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-21T22:57:49.339 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 86 2023-07-21T22:57:49.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.304+0000 7f7f02dc5640 1 -- 172.21.15.6:0/907140646 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f7ee00660d0 msgr2=0x7f7ee0068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:49.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.304+0000 7f7f02dc5640 1 --2- 172.21.15.6:0/907140646 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f7ee00660d0 0x7f7ee0068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00011f0 tx=0x7f7ef0007d40 comp rx=0 tx=0).stop 2023-07-21T22:57:49.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.304+0000 7f7f02dc5640 1 -- 172.21.15.6:0/907140646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7efc0c9560 msgr2=0x7f7efc1501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:49.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.304+0000 7f7f02dc5640 1 --2- 172.21.15.6:0/907140646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7efc0c9560 0x7f7efc1501a0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7f7ee80ae040 tx=0x7f7ee80190d0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.304+0000 7f7f02dc5640 1 -- 172.21.15.6:0/907140646 shutdown_connections 2023-07-21T22:57:49.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.304+0000 7f7f02dc5640 1 --2- 172.21.15.6:0/907140646 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f7ee00660d0 0x7f7ee0068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.304+0000 7f7f02dc5640 1 --2- 172.21.15.6:0/907140646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7efc158ce0 0x7f7efc0ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.304+0000 7f7f02dc5640 1 --2- 172.21.15.6:0/907140646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7efc0c9560 0x7f7efc1501a0 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.304+0000 7f7f02dc5640 1 --2- 172.21.15.6:0/907140646 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7efc0c8ad0 0x7f7efc0c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.304+0000 7f7f02dc5640 1 -- 172.21.15.6:0/907140646 >> 172.21.15.6:0/907140646 conn(0x7f7efc0afcf0 msgr2=0x7f7efc070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:49.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.304+0000 7f7f02dc5640 1 -- 172.21.15.6:0/907140646 shutdown_connections 2023-07-21T22:57:49.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.304+0000 7f7f02dc5640 1 -- 172.21.15.6:0/907140646 wait complete. 2023-07-21T22:57:49.359 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:57:49.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.468+0000 7f6263700640 1 Processor -- start 2023-07-21T22:57:49.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.468+0000 7f6263700640 1 -- start start 2023-07-21T22:57:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.468+0000 7f6263700640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f625c069430 0x7f625c069830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.468+0000 7f6263700640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625c0c9c30 con 0x7f625c160450 2023-07-21T22:57:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.468+0000 7f6263700640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625c15bfd0 con 0x7f625c15bc00 2023-07-21T22:57:49.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.468+0000 7f6263700640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f625c0c96b0 con 0x7f625c069430 2023-07-21T22:57:49.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.468+0000 7f6260c9b640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f625c160450 0x7f625c06e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33758/0 (socket says 172.21.15.6:33758) 2023-07-21T22:57:49.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.468+0000 7f6260c9b640 1 -- 172.21.15.6:0/2263373644 learned_addr learned my addr 172.21.15.6:0/2263373644 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:49.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.468+0000 7f6261c9d640 1 --2- 172.21.15.6:0/2263373644 >> v2:172.21.15.161:3300/0 conn(0x7f625c069430 0x7f625c069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:49.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.468+0000 7f6253fff640 1 -- 172.21.15.6:0/2263373644 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 6572731 0 0) 0x7f625c0c9c30 con 0x7f625c160450 2023-07-21T22:57:49.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.468+0000 7f6253fff640 1 -- 172.21.15.6:0/2263373644 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6248003530 con 0x7f625c160450 2023-07-21T22:57:49.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.472+0000 7f6261c9d640 1 -- 172.21.15.6:0/2263373644 >> v1:172.21.15.161:6789/0 conn(0x7f625c15bc00 legacy=0x7f625c0ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:49.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.472+0000 7f6253fff640 1 -- 172.21.15.6:0/2263373644 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703762816 0 0) 0x7f625c15bfd0 con 0x7f625c15bc00 2023-07-21T22:57:49.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.472+0000 7f6261c9d640 1 -- 172.21.15.6:0/2263373644 >> v1:172.21.15.6:6789/0 conn(0x7f625c160450 legacy=0x7f625c06e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:49.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.472+0000 7f6261c9d640 1 -- 172.21.15.6:0/2263373644 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c069d70 con 0x7f625c069430 2023-07-21T22:57:49.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.472+0000 7f6261c9d640 1 --2- 172.21.15.6:0/2263373644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f625c069430 0x7f625c069830 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f6254009d90 tx=0x7f625401c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d64c3dc6f5ccfd1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:49.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.472+0000 7f6253fff640 1 -- 172.21.15.6:0/2263373644 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c001600 con 0x7f625c069430 2023-07-21T22:57:49.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.472+0000 7f6253fff640 1 -- 172.21.15.6:0/2263373644 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62540a55e0 con 0x7f625c069430 2023-07-21T22:57:49.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.472+0000 7f6253fff640 1 -- 172.21.15.6:0/2263373644 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62540a5950 con 0x7f625c069430 2023-07-21T22:57:49.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.472+0000 7f6263700640 1 -- 172.21.15.6:0/2263373644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f625c069430 msgr2=0x7f625c069830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:49.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.472+0000 7f6263700640 1 --2- 172.21.15.6:0/2263373644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f625c069430 0x7f625c069830 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f6254009d90 tx=0x7f625401c760 comp rx=0 tx=0).stop 2023-07-21T22:57:49.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.472+0000 7f6263700640 1 -- 172.21.15.6:0/2263373644 shutdown_connections 2023-07-21T22:57:49.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.472+0000 7f6263700640 1 --2- 172.21.15.6:0/2263373644 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f625c069430 0x7f625c069830 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.472+0000 7f6263700640 1 -- 172.21.15.6:0/2263373644 >> 172.21.15.6:0/2263373644 conn(0x7f625c0b1840 msgr2=0x7f625c0cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:49.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6263700640 1 -- 172.21.15.6:0/2263373644 shutdown_connections 2023-07-21T22:57:49.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6263700640 1 -- 172.21.15.6:0/2263373644 wait complete. 2023-07-21T22:57:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6263700640 1 Processor -- start 2023-07-21T22:57:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6263700640 1 -- start start 2023-07-21T22:57:49.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6263700640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f625c069430 0x7f625c1511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6263700640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f625c15bc00 0x7f625c146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6263700640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f625c160450 0x7f625c14b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6263700640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c147c60 con 0x7f625c15bc00 2023-07-21T22:57:49.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6263700640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c146d50 con 0x7f625c160450 2023-07-21T22:57:49.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6263700640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625c146fe0 con 0x7f625c069430 2023-07-21T22:57:49.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6260c9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f625c15bc00 0x7f625c146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:49.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6260c9b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f625c15bc00 0x7f625c146810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36074/0 (socket says 172.21.15.6:36074) 2023-07-21T22:57:49.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6260c9b640 1 -- 172.21.15.6:0/1963814038 learned_addr learned my addr 172.21.15.6:0/1963814038 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:49.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f626149c640 1 --2- 172.21.15.6:0/1963814038 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f625c069430 0x7f625c1511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:49.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6261c9d640 1 --2- 172.21.15.6:0/1963814038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f625c160450 0x7f625c14b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:49.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6260c9b640 1 -- 172.21.15.6:0/1963814038 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f625c069430 msgr2=0x7f625c1511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:49.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6260c9b640 1 --2- 172.21.15.6:0/1963814038 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f625c069430 0x7f625c1511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6260c9b640 1 -- 172.21.15.6:0/1963814038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f625c160450 msgr2=0x7f625c14b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:49.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6260c9b640 1 --2- 172.21.15.6:0/1963814038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f625c160450 0x7f625c14b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6260c9b640 1 -- 172.21.15.6:0/1963814038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6254009a70 con 0x7f625c15bc00 2023-07-21T22:57:49.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6260c9b640 1 --2- 172.21.15.6:0/1963814038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f625c15bc00 0x7f625c146810 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f624c00c760 tx=0x7f624c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:49.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6251ffb640 1 -- 172.21.15.6:0/1963814038 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c0074e0 con 0x7f625c15bc00 2023-07-21T22:57:49.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.476+0000 7f6251ffb640 1 -- 172.21.15.6:0/1963814038 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c007660 con 0x7f625c15bc00 2023-07-21T22:57:49.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.480+0000 7f6263700640 1 -- 172.21.15.6:0/1963814038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625c1472c0 con 0x7f625c15bc00 2023-07-21T22:57:49.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.480+0000 7f6251ffb640 1 -- 172.21.15.6:0/1963814038 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c004a30 con 0x7f625c15bc00 2023-07-21T22:57:49.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.480+0000 7f6263700640 1 -- 172.21.15.6:0/1963814038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f625c147880 con 0x7f625c15bc00 2023-07-21T22:57:49.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.480+0000 7f6263700640 1 -- 172.21.15.6:0/1963814038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625c147a40 con 0x7f625c15bc00 2023-07-21T22:57:49.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.480+0000 7f6251ffb640 1 -- 172.21.15.6:0/1963814038 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f624c004b90 con 0x7f625c15bc00 2023-07-21T22:57:49.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.480+0000 7f6251ffb640 1 --2- 172.21.15.6:0/1963814038 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f62400663a0 0x7f6240068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:49.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.480+0000 7f6251ffb640 1 -- 172.21.15.6:0/1963814038 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6865+0+0 (secure 0 0 0) 0x7f624c083750 con 0x7f625c15bc00 2023-07-21T22:57:49.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.480+0000 7f626149c640 1 --2- 172.21.15.6:0/1963814038 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f62400663a0 0x7f6240068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:49.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.484+0000 7f626149c640 1 --2- 172.21.15.6:0/1963814038 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f62400663a0 0x7f6240068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6258001130 tx=0x7f6258009040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:49.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.484+0000 7f6251ffb640 1 -- 172.21.15.6:0/1963814038 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f624c050780 con 0x7f625c15bc00 2023-07-21T22:57:49.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.644+0000 7f6263700640 1 -- 172.21.15.6:0/1963814038 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f625c0c9500 con 0x7f625c15bc00 2023-07-21T22:57:49.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.644+0000 7f6251ffb640 1 -- 172.21.15.6:0/1963814038 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) v1 ==== 74+0+19412 (secure 0 0 0) 0x7f624c053da0 con 0x7f625c15bc00 2023-07-21T22:57:49.680 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:49.681 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":194,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:57:46.822875+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:57:21.014468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-21T22:57:21.883517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:0/3754480080":"2023-07-22T22:57:46.822841+0000","172.21.15.161:0/2032388246":"2023-07-22T22:57:46.822841+0000","172.21.15.161:6832/2599285906":"2023-07-22T22:57:46.822841+0000","172.21.15.161:0/2086729558":"2023-07-22T22:57:46.822841+0000","172.21.15.161:6833/2599285906":"2023-07-22T22:57:46.822841+0000","172.21.15.161:0/3809050192":"2023-07-22T22:57:46.822841+0000","172.21.15.161:0/568512462":"2023-07-22T22:57:40.018539+0000","172.21.15.161:6833/406143921":"2023-07-22T22:57:40.018539+0000","172.21.15.161:6832/406143921":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/2047544093":"2023-07-22T22:57:46.822841+0000","172.21.15.161:0/323615512":"2023-07-22T22:57:46.822841+0000","172.21.15.161:0/2299078826":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/1726684525":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/319560030":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/3583156451":"2023-07-22T22:57:46.822841+0000","172.21.15.161:0/389011228":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/3791982345":"2023-07-22T22:57:40.018539+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:57:49.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.648+0000 7f6263700640 1 -- 172.21.15.6:0/1963814038 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f62400663a0 msgr2=0x7f6240068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:49.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.648+0000 7f6263700640 1 --2- 172.21.15.6:0/1963814038 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f62400663a0 0x7f6240068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6258001130 tx=0x7f6258009040 comp rx=0 tx=0).stop 2023-07-21T22:57:49.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.648+0000 7f6263700640 1 -- 172.21.15.6:0/1963814038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f625c15bc00 msgr2=0x7f625c146810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:49.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.648+0000 7f6263700640 1 --2- 172.21.15.6:0/1963814038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f625c15bc00 0x7f625c146810 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f624c00c760 tx=0x7f624c00cc20 comp rx=0 tx=0).stop 2023-07-21T22:57:49.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.648+0000 7f6263700640 1 -- 172.21.15.6:0/1963814038 shutdown_connections 2023-07-21T22:57:49.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.648+0000 7f6263700640 1 --2- 172.21.15.6:0/1963814038 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f62400663a0 0x7f6240068850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.648+0000 7f6263700640 1 --2- 172.21.15.6:0/1963814038 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f625c160450 0x7f625c14b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.648+0000 7f6263700640 1 --2- 172.21.15.6:0/1963814038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f625c15bc00 0x7f625c146810 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.648+0000 7f6263700640 1 --2- 172.21.15.6:0/1963814038 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f625c069430 0x7f625c1511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.648+0000 7f6263700640 1 -- 172.21.15.6:0/1963814038 >> 172.21.15.6:0/1963814038 conn(0x7f625c0b1840 msgr2=0x7f625c15f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:49.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.648+0000 7f6263700640 1 -- 172.21.15.6:0/1963814038 shutdown_connections 2023-07-21T22:57:49.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.648+0000 7f6263700640 1 -- 172.21.15.6:0/1963814038 wait complete. 2023-07-21T22:57:49.702 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-21T22:57:49.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.812+0000 7fa3eaf74640 1 Processor -- start 2023-07-21T22:57:49.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.812+0000 7fa3eaf74640 1 -- start start 2023-07-21T22:57:49.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.816+0000 7fa3eaf74640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa3e406cc40 0x7fa3e40acc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:49.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.816+0000 7fa3eaf74640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa3e406b550 0x7fa3e40cf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:49.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.816+0000 7fa3eaf74640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e40ce1b0 con 0x7fa3e40cdc30 2023-07-21T22:57:49.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.816+0000 7fa3eaf74640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e40cee10 con 0x7fa3e406b550 2023-07-21T22:57:49.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.816+0000 7fa3eaf74640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e40ad1d0 con 0x7fa3e406cc40 2023-07-21T22:57:49.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.816+0000 7fa3e3fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa3e40cdc30 0x7fa3e406d010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33774/0 (socket says 172.21.15.6:33774) 2023-07-21T22:57:49.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.816+0000 7fa3e3fff640 1 -- 172.21.15.6:0/3442047692 learned_addr learned my addr 172.21.15.6:0/3442047692 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:49.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.816+0000 7fa3e9511640 1 --2- 172.21.15.6:0/3442047692 >> v2:172.21.15.6:3300/0 conn(0x7fa3e406b550 0x7fa3e40cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.816+0000 7fa3e8d10640 1 --2- 172.21.15.6:0/3442047692 >> v2:172.21.15.161:3300/0 conn(0x7fa3e406cc40 0x7fa3e40acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.816+0000 7fa3e9511640 1 -- 172.21.15.6:0/3442047692 >> v2:172.21.15.161:3300/0 conn(0x7fa3e406cc40 msgr2=0x7fa3e40acc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.816+0000 7fa3e9511640 1 --2- 172.21.15.6:0/3442047692 >> v2:172.21.15.161:3300/0 conn(0x7fa3e406cc40 0x7fa3e40acc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.816+0000 7fa3e9511640 1 -- 172.21.15.6:0/3442047692 >> v1:172.21.15.6:6789/0 conn(0x7fa3e40cdc30 legacy=0x7fa3e406d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.816+0000 7fa3e37fe640 1 -- 172.21.15.6:0/3442047692 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050242716 0 0) 0x7fa3e40ce1b0 con 0x7fa3e40cdc30 2023-07-21T22:57:49.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.816+0000 7fa3e9511640 1 -- 172.21.15.6:0/3442047692 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e40ce470 con 0x7fa3e406b550 2023-07-21T22:57:49.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.820+0000 7fa3e9511640 1 --2- 172.21.15.6:0/3442047692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3e406b550 0x7fa3e40cf230 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fa3e408a8b0 tx=0x7fa3dc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125bef6ada174a6a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.820+0000 7fa3e37fe640 1 -- 172.21.15.6:0/3442047692 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0a58c0 con 0x7fa3e406b550 2023-07-21T22:57:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.820+0000 7fa3e37fe640 1 -- 172.21.15.6:0/3442047692 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc0a5a20 con 0x7fa3e406b550 2023-07-21T22:57:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.820+0000 7fa3e37fe640 1 -- 172.21.15.6:0/3442047692 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0a5db0 con 0x7fa3e406b550 2023-07-21T22:57:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.820+0000 7fa3eaf74640 1 -- 172.21.15.6:0/3442047692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3e406b550 msgr2=0x7fa3e40cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.820+0000 7fa3eaf74640 1 --2- 172.21.15.6:0/3442047692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3e406b550 0x7fa3e40cf230 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fa3e408a8b0 tx=0x7fa3dc01c910 comp rx=0 tx=0).stop 2023-07-21T22:57:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.820+0000 7fa3eaf74640 1 -- 172.21.15.6:0/3442047692 shutdown_connections 2023-07-21T22:57:49.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.820+0000 7fa3eaf74640 1 --2- 172.21.15.6:0/3442047692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3e406b550 0x7fa3e40cf230 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.820+0000 7fa3eaf74640 1 --2- 172.21.15.6:0/3442047692 >> v2:172.21.15.161:3300/0 conn(0x7fa3e406cc40 0x7fa3e40acc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.820+0000 7fa3eaf74640 1 -- 172.21.15.6:0/3442047692 >> 172.21.15.6:0/3442047692 conn(0x7fa3e4099430 msgr2=0x7fa3e40d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:49.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.820+0000 7fa3eaf74640 1 -- 172.21.15.6:0/3442047692 shutdown_connections 2023-07-21T22:57:49.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.820+0000 7fa3eaf74640 1 -- 172.21.15.6:0/3442047692 wait complete. 2023-07-21T22:57:49.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.820+0000 7fa3eaf74640 1 Processor -- start 2023-07-21T22:57:49.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.820+0000 7fa3eaf74640 1 -- start start 2023-07-21T22:57:49.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3eaf74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3e406b550 0x7fa3e4150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:49.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3eaf74640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3e406cc40 0x7fa3e41529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:49.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3eaf74640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3e40cdc30 0x7fa3e415c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:49.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3eaf74640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e414fd50 con 0x7fa3e406b550 2023-07-21T22:57:49.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3eaf74640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e4151070 con 0x7fa3e406cc40 2023-07-21T22:57:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3eaf74640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e4151280 con 0x7fa3e40cdc30 2023-07-21T22:57:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3e8d10640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3e406b550 0x7fa3e4150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3e8d10640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3e406b550 0x7fa3e4150b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36094/0 (socket says 172.21.15.6:36094) 2023-07-21T22:57:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3e8d10640 1 -- 172.21.15.6:0/2530600019 learned_addr learned my addr 172.21.15.6:0/2530600019 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3e8d10640 1 -- 172.21.15.6:0/2530600019 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3e40cdc30 msgr2=0x7fa3e415c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:49.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3e8d10640 1 --2- 172.21.15.6:0/2530600019 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3e40cdc30 0x7fa3e415c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3e8d10640 1 -- 172.21.15.6:0/2530600019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3e406cc40 msgr2=0x7fa3e41529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3e8d10640 1 --2- 172.21.15.6:0/2530600019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3e406cc40 0x7fa3e41529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:49.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3e8d10640 1 -- 172.21.15.6:0/2530600019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc009a70 con 0x7fa3e406b550 2023-07-21T22:57:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3e8d10640 1 --2- 172.21.15.6:0/2530600019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3e406b550 0x7fa3e4150b30 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800e870 tx=0x7fa3d800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3e17fa640 1 -- 172.21.15.6:0/2530600019 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d800eec0 con 0x7fa3e406b550 2023-07-21T22:57:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3e17fa640 1 -- 172.21.15.6:0/2530600019 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d800c940 con 0x7fa3e406b550 2023-07-21T22:57:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3e17fa640 1 -- 172.21.15.6:0/2530600019 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d800ccb0 con 0x7fa3e406b550 2023-07-21T22:57:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3eaf74640 1 -- 172.21.15.6:0/2530600019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e415f470 con 0x7fa3e406b550 2023-07-21T22:57:49.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3eaf74640 1 -- 172.21.15.6:0/2530600019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e40afec0 con 0x7fa3e406b550 2023-07-21T22:57:49.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3eaf74640 1 -- 172.21.15.6:0/2530600019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e4151670 con 0x7fa3e406b550 2023-07-21T22:57:49.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.824+0000 7fa3e17fa640 1 -- 172.21.15.6:0/2530600019 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa3d8013470 con 0x7fa3e406b550 2023-07-21T22:57:49.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.828+0000 7fa3e17fa640 1 --2- 172.21.15.6:0/2530600019 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa3c80663a0 0x7fa3c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:49.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.828+0000 7fa3e17fa640 1 -- 172.21.15.6:0/2530600019 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6865+0+0 (secure 0 0 0) 0x7fa3d8084250 con 0x7fa3e406b550 2023-07-21T22:57:49.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.828+0000 7fa3e3fff640 1 --2- 172.21.15.6:0/2530600019 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa3c80663a0 0x7fa3c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:49.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.828+0000 7fa3e3fff640 1 --2- 172.21.15.6:0/2530600019 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa3c80663a0 0x7fa3c8068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00011f0 tx=0x7fa3d0007930 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:49.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:49.832+0000 7fa3e17fa640 1 -- 172.21.15.6:0/2530600019 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa3d8054d20 con 0x7fa3e406b550 2023-07-21T22:57:50.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.020+0000 7fa3eaf74640 1 -- 172.21.15.6:0/2530600019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa3e4151440 con 0x7fa3e406b550 2023-07-21T22:57:50.058 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-07-21T22:57:50.024+0000 7f195e836640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-21T22:57:50.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.028+0000 7fa3e17fa640 1 -- 172.21.15.6:0/2530600019 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v87) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa3d80548b0 con 0x7fa3e406b550 2023-07-21T22:57:50.065 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-21T22:57:50.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.032+0000 7fa3eaf74640 1 -- 172.21.15.6:0/2530600019 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa3c80663a0 msgr2=0x7fa3c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:50.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.032+0000 7fa3eaf74640 1 --2- 172.21.15.6:0/2530600019 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa3c80663a0 0x7fa3c8068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00011f0 tx=0x7fa3d0007930 comp rx=0 tx=0).stop 2023-07-21T22:57:50.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.032+0000 7fa3eaf74640 1 -- 172.21.15.6:0/2530600019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3e406b550 msgr2=0x7fa3e4150b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:50.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.032+0000 7fa3eaf74640 1 --2- 172.21.15.6:0/2530600019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3e406b550 0x7fa3e4150b30 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fa3d800e870 tx=0x7fa3d800ec70 comp rx=0 tx=0).stop 2023-07-21T22:57:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.032+0000 7fa3eaf74640 1 -- 172.21.15.6:0/2530600019 shutdown_connections 2023-07-21T22:57:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.032+0000 7fa3eaf74640 1 --2- 172.21.15.6:0/2530600019 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa3c80663a0 0x7fa3c8068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.032+0000 7fa3eaf74640 1 --2- 172.21.15.6:0/2530600019 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3e40cdc30 0x7fa3e415c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.032+0000 7fa3eaf74640 1 --2- 172.21.15.6:0/2530600019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3e406cc40 0x7fa3e41529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.032+0000 7fa3eaf74640 1 --2- 172.21.15.6:0/2530600019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3e406b550 0x7fa3e4150b30 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.032+0000 7fa3eaf74640 1 -- 172.21.15.6:0/2530600019 >> 172.21.15.6:0/2530600019 conn(0x7fa3e4099430 msgr2=0x7fa3e40b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.032+0000 7fa3eaf74640 1 -- 172.21.15.6:0/2530600019 shutdown_connections 2023-07-21T22:57:50.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.032+0000 7fa3eaf74640 1 -- 172.21.15.6:0/2530600019 wait complete. 2023-07-21T22:57:50.071 INFO:tasks.ceph.mds.c.smithi006.stderr: -4096> 2023-07-21T22:57:28.468+0000 7f761d341640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:57:50.089 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-21T22:57:50.124 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-21T22:57:50.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.200+0000 7ff8ef7df640 1 Processor -- start 2023-07-21T22:57:50.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.200+0000 7ff8ef7df640 1 -- start start 2023-07-21T22:57:50.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.204+0000 7ff8ef7df640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff8e81600b0 0x7ff8e80cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:50.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.204+0000 7ff8ef7df640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e80c89f0 con 0x7ff8e8164340 2023-07-21T22:57:50.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.204+0000 7ff8ef7df640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e80cbe50 con 0x7ff8e806cf80 2023-07-21T22:57:50.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.204+0000 7ff8ef7df640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e80cc9d0 con 0x7ff8e81600b0 2023-07-21T22:57:50.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.204+0000 7ff8ed57b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff8e81600b0 0x7ff8e80cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:50.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.204+0000 7ff8edd7c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff8e8164340 0x7ff8e80c0b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33802/0 (socket says 172.21.15.6:33802) 2023-07-21T22:57:50.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.204+0000 7ff8ed57b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff8e81600b0 0x7ff8e80cd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36116/0 (socket says 172.21.15.6:36116) 2023-07-21T22:57:50.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.204+0000 7ff8edd7c640 1 -- 172.21.15.6:0/1598438166 learned_addr learned my addr 172.21.15.6:0/1598438166 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:50.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.204+0000 7ff8ed57b640 1 -- 172.21.15.6:0/1598438166 >> v1:172.21.15.161:6789/0 conn(0x7ff8e806cf80 legacy=0x7ff8e8163c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:50.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.204+0000 7ff8ed57b640 1 -- 172.21.15.6:0/1598438166 >> v1:172.21.15.6:6789/0 conn(0x7ff8e8164340 legacy=0x7ff8e80c0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:50.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.204+0000 7ff8ed57b640 1 -- 172.21.15.6:0/1598438166 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e80c9e20 con 0x7ff8e81600b0 2023-07-21T22:57:50.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.208+0000 7ff8ed57b640 1 --2- 172.21.15.6:0/1598438166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e81600b0 0x7ff8e80cd980 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7ff8e40097c0 tx=0x7ff8e401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a44525275e0267f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:50.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.208+0000 7ff8dffff640 1 -- 172.21.15.6:0/1598438166 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e40ab600 con 0x7ff8e81600b0 2023-07-21T22:57:50.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.208+0000 7ff8dffff640 1 -- 172.21.15.6:0/1598438166 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e40a7050 con 0x7ff8e81600b0 2023-07-21T22:57:50.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.208+0000 7ff8dffff640 1 -- 172.21.15.6:0/1598438166 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e40ab980 con 0x7ff8e81600b0 2023-07-21T22:57:50.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.208+0000 7ff8ef7df640 1 -- 172.21.15.6:0/1598438166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e81600b0 msgr2=0x7ff8e80cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:50.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.208+0000 7ff8ef7df640 1 --2- 172.21.15.6:0/1598438166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e81600b0 0x7ff8e80cd980 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7ff8e40097c0 tx=0x7ff8e401c440 comp rx=0 tx=0).stop 2023-07-21T22:57:50.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.208+0000 7ff8ef7df640 1 -- 172.21.15.6:0/1598438166 shutdown_connections 2023-07-21T22:57:50.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.208+0000 7ff8ef7df640 1 --2- 172.21.15.6:0/1598438166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e81600b0 0x7ff8e80cd980 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:50.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.208+0000 7ff8ef7df640 1 -- 172.21.15.6:0/1598438166 >> 172.21.15.6:0/1598438166 conn(0x7ff8e80afac0 msgr2=0x7ff8e80afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:50.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.208+0000 7ff8ef7df640 1 -- 172.21.15.6:0/1598438166 shutdown_connections 2023-07-21T22:57:50.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.208+0000 7ff8ef7df640 1 -- 172.21.15.6:0/1598438166 wait complete. 2023-07-21T22:57:50.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.208+0000 7ff8ef7df640 1 Processor -- start 2023-07-21T22:57:50.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.208+0000 7ff8ef7df640 1 -- start start 2023-07-21T22:57:50.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ef7df640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8e806cf80 0x7ff8e8162be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:50.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ef7df640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e81600b0 0x7ff8e8163120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:50.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ef7df640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8e8164340 0x7ff8e8154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:50.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ef7df640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80c3d00 con 0x7ff8e81600b0 2023-07-21T22:57:50.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ef7df640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80c3fe0 con 0x7ff8e806cf80 2023-07-21T22:57:50.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ef7df640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80c42c0 con 0x7ff8e8164340 2023-07-21T22:57:50.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ecd7a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e81600b0 0x7ff8e8163120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:50.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ecd7a640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e81600b0 0x7ff8e8163120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36132/0 (socket says 172.21.15.6:36132) 2023-07-21T22:57:50.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ecd7a640 1 -- 172.21.15.6:0/1971513185 learned_addr learned my addr 172.21.15.6:0/1971513185 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:50.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ed57b640 1 --2- 172.21.15.6:0/1971513185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8e806cf80 0x7ff8e8162be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:50.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8edd7c640 1 --2- 172.21.15.6:0/1971513185 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8e8164340 0x7ff8e8154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:50.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ecd7a640 1 -- 172.21.15.6:0/1971513185 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8e8164340 msgr2=0x7ff8e8154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:50.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ecd7a640 1 --2- 172.21.15.6:0/1971513185 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8e8164340 0x7ff8e8154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:50.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ecd7a640 1 -- 172.21.15.6:0/1971513185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8e806cf80 msgr2=0x7ff8e8162be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:50.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ecd7a640 1 --2- 172.21.15.6:0/1971513185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8e806cf80 0x7ff8e8162be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:50.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ecd7a640 1 -- 172.21.15.6:0/1971513185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e4009420 con 0x7ff8e81600b0 2023-07-21T22:57:50.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ecd7a640 1 --2- 172.21.15.6:0/1971513185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e81600b0 0x7ff8e8163120 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800b410 tx=0x7ff8d800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:50.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ddffb640 1 -- 172.21.15.6:0/1971513185 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8004020 con 0x7ff8e81600b0 2023-07-21T22:57:50.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ddffb640 1 -- 172.21.15.6:0/1971513185 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d8004180 con 0x7ff8e81600b0 2023-07-21T22:57:50.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ddffb640 1 -- 172.21.15.6:0/1971513185 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8011630 con 0x7ff8e81600b0 2023-07-21T22:57:50.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ef7df640 1 -- 172.21.15.6:0/1971513185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e80c45a0 con 0x7ff8e81600b0 2023-07-21T22:57:50.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ef7df640 1 -- 172.21.15.6:0/1971513185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e8158dc0 con 0x7ff8e81600b0 2023-07-21T22:57:50.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ef7df640 1 -- 172.21.15.6:0/1971513185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e80678d0 con 0x7ff8e81600b0 2023-07-21T22:57:50.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.212+0000 7ff8ddffb640 1 -- 172.21.15.6:0/1971513185 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff8d8011790 con 0x7ff8e81600b0 2023-07-21T22:57:50.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.216+0000 7ff8ddffb640 1 --2- 172.21.15.6:0/1971513185 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff8cc0663d0 0x7ff8cc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:50.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.216+0000 7ff8ddffb640 1 -- 172.21.15.6:0/1971513185 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6951+0+0 (secure 0 0 0) 0x7ff8d8083e20 con 0x7ff8e81600b0 2023-07-21T22:57:50.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.216+0000 7ff8ed57b640 1 --2- 172.21.15.6:0/1971513185 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff8cc0663d0 0x7ff8cc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:50.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.216+0000 7ff8ed57b640 1 --2- 172.21.15.6:0/1971513185 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff8cc0663d0 0x7ff8cc068880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff8e40ad000 tx=0x7ff8e4008040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:50.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.220+0000 7ff8ddffb640 1 -- 172.21.15.6:0/1971513185 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8d8050e20 con 0x7ff8e81600b0 2023-07-21T22:57:50.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:50.408+0000 7ff8ef7df640 1 -- 172.21.15.6:0/1971513185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff8e80cd250 con 0x7ff8e81600b0 2023-07-21T22:57:51.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.028+0000 7ff8ddffb640 1 -- 172.21.15.6:0/1971513185 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v88) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff8d8054440 con 0x7ff8e81600b0 2023-07-21T22:57:51.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.032+0000 7ff8ef7df640 1 -- 172.21.15.6:0/1971513185 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff8cc0663d0 msgr2=0x7ff8cc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:51.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.032+0000 7ff8ef7df640 1 --2- 172.21.15.6:0/1971513185 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff8cc0663d0 0x7ff8cc068880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff8e40ad000 tx=0x7ff8e4008040 comp rx=0 tx=0).stop 2023-07-21T22:57:51.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.032+0000 7ff8ef7df640 1 -- 172.21.15.6:0/1971513185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e81600b0 msgr2=0x7ff8e8163120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:51.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.032+0000 7ff8ef7df640 1 --2- 172.21.15.6:0/1971513185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e81600b0 0x7ff8e8163120 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7ff8d800b410 tx=0x7ff8d800b8d0 comp rx=0 tx=0).stop 2023-07-21T22:57:51.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.032+0000 7ff8ef7df640 1 -- 172.21.15.6:0/1971513185 shutdown_connections 2023-07-21T22:57:51.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.032+0000 7ff8ef7df640 1 --2- 172.21.15.6:0/1971513185 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff8cc0663d0 0x7ff8cc068880 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:51.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.032+0000 7ff8ef7df640 1 --2- 172.21.15.6:0/1971513185 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8e8164340 0x7ff8e8154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:51.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.032+0000 7ff8ef7df640 1 --2- 172.21.15.6:0/1971513185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8e81600b0 0x7ff8e8163120 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:51.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.032+0000 7ff8ef7df640 1 --2- 172.21.15.6:0/1971513185 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8e806cf80 0x7ff8e8162be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:51.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.032+0000 7ff8ef7df640 1 -- 172.21.15.6:0/1971513185 >> 172.21.15.6:0/1971513185 conn(0x7ff8e80afac0 msgr2=0x7ff8e80afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:51.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.032+0000 7ff8ef7df640 1 -- 172.21.15.6:0/1971513185 shutdown_connections 2023-07-21T22:57:51.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.032+0000 7ff8ef7df640 1 -- 172.21.15.6:0/1971513185 wait complete. 2023-07-21T22:57:51.094 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-21T22:57:51.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.260+0000 7f3a3119d640 1 Processor -- start 2023-07-21T22:57:51.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.260+0000 7f3a3119d640 1 -- start start 2023-07-21T22:57:51.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.264+0000 7f3a3119d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3a2c06a440 0x7f3a2c0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:51.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.264+0000 7f3a3119d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a2c1453a0 0x7f3a2c06c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:51.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.264+0000 7f3a3119d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2c06c040 con 0x7f3a2c15f690 2023-07-21T22:57:51.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.264+0000 7f3a3119d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a2c160170 con 0x7f3a2c06a440 2023-07-21T22:57:51.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.264+0000 7f3a3119d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c160600 con 0x7f3a2c1453a0 2023-07-21T22:57:51.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.264+0000 7f3a2a59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3a2c06a440 0x7f3a2c0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:51.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.264+0000 7f3a2a59c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3a2c06a440 0x7f3a2c0b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36134/0 (socket says 172.21.15.6:36134) 2023-07-21T22:57:51.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.264+0000 7f3a2a59c640 1 -- 172.21.15.6:0/2485029247 learned_addr learned my addr 172.21.15.6:0/2485029247 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.264+0000 7f3a2b59e640 1 --2- 172.21.15.6:0/2485029247 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a2c1453a0 0x7f3a2c06c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.264+0000 7f3a2a59c640 1 -- 172.21.15.6:0/2485029247 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a2c1453a0 msgr2=0x7f3a2c06c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.264+0000 7f3a2a59c640 1 --2- 172.21.15.6:0/2485029247 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a2c1453a0 0x7f3a2c06c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.264+0000 7f3a2a59c640 1 -- 172.21.15.6:0/2485029247 >> v1:172.21.15.161:6789/0 conn(0x7f3a2c15f690 legacy=0x7f3a2c15fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.264+0000 7f3a2a59c640 1 -- 172.21.15.6:0/2485029247 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c160360 con 0x7f3a2c06a440 2023-07-21T22:57:51.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.268+0000 7f3a2a59c640 1 --2- 172.21.15.6:0/2485029247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c06a440 0x7f3a2c0b1890 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009870 tx=0x7f3a2001c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8582c076804a9a3f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:51.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.268+0000 7f3a29d9b640 1 -- 172.21.15.6:0/2485029247 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a200ab600 con 0x7f3a2c06a440 2023-07-21T22:57:51.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.268+0000 7f3a29d9b640 1 -- 172.21.15.6:0/2485029247 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a200a7050 con 0x7f3a2c06a440 2023-07-21T22:57:51.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.268+0000 7f3a29d9b640 1 -- 172.21.15.6:0/2485029247 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a200ab980 con 0x7f3a2c06a440 2023-07-21T22:57:51.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.268+0000 7f3a3119d640 1 -- 172.21.15.6:0/2485029247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c06a440 msgr2=0x7f3a2c0b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:51.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.268+0000 7f3a3119d640 1 --2- 172.21.15.6:0/2485029247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c06a440 0x7f3a2c0b1890 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009870 tx=0x7f3a2001c2a0 comp rx=0 tx=0).stop 2023-07-21T22:57:51.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.268+0000 7f3a3119d640 1 -- 172.21.15.6:0/2485029247 shutdown_connections 2023-07-21T22:57:51.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.268+0000 7f3a3119d640 1 --2- 172.21.15.6:0/2485029247 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a2c1453a0 0x7f3a2c06c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:51.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.268+0000 7f3a3119d640 1 --2- 172.21.15.6:0/2485029247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c06a440 0x7f3a2c0b1890 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:51.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.268+0000 7f3a3119d640 1 -- 172.21.15.6:0/2485029247 >> 172.21.15.6:0/2485029247 conn(0x7f3a2c0b1210 msgr2=0x7f3a2c0ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:51.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.268+0000 7f3a3119d640 1 -- 172.21.15.6:0/2485029247 shutdown_connections 2023-07-21T22:57:51.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.268+0000 7f3a3119d640 1 -- 172.21.15.6:0/2485029247 wait complete. 2023-07-21T22:57:51.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.268+0000 7f3a3119d640 1 Processor -- start 2023-07-21T22:57:51.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.268+0000 7f3a3119d640 1 -- start start 2023-07-21T22:57:51.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a3119d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a2c06a440 0x7f3a2c15b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a3119d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a2c1453a0 0x7f3a2c13c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a3119d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c15f690 0x7f3a2c13c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a3119d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c13b070 con 0x7f3a2c15f690 2023-07-21T22:57:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a3119d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c15caf0 con 0x7f3a2c06a440 2023-07-21T22:57:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a3119d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c15cdd0 con 0x7f3a2c1453a0 2023-07-21T22:57:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a2b59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c15f690 0x7f3a2c13c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a2b59e640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c15f690 0x7f3a2c13c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36142/0 (socket says 172.21.15.6:36142) 2023-07-21T22:57:51.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a2b59e640 1 -- 172.21.15.6:0/3385937136 learned_addr learned my addr 172.21.15.6:0/3385937136 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:51.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a2ad9d640 1 --2- 172.21.15.6:0/3385937136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a2c06a440 0x7f3a2c15b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:51.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a2a59c640 1 --2- 172.21.15.6:0/3385937136 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a2c1453a0 0x7f3a2c13c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:51.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a2b59e640 1 -- 172.21.15.6:0/3385937136 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a2c1453a0 msgr2=0x7f3a2c13c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:51.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a2b59e640 1 --2- 172.21.15.6:0/3385937136 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a2c1453a0 0x7f3a2c13c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:51.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a2b59e640 1 -- 172.21.15.6:0/3385937136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a2c06a440 msgr2=0x7f3a2c15b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:51.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a2b59e640 1 --2- 172.21.15.6:0/3385937136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a2c06a440 0x7f3a2c15b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:51.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a2b59e640 1 -- 172.21.15.6:0/3385937136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a200094d0 con 0x7f3a2c15f690 2023-07-21T22:57:51.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a2b59e640 1 --2- 172.21.15.6:0/3385937136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c15f690 0x7f3a2c13c880 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f3a24007e40 tx=0x7f3a2400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:51.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a137fe640 1 -- 172.21.15.6:0/3385937136 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a24014620 con 0x7f3a2c15f690 2023-07-21T22:57:51.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a137fe640 1 -- 172.21.15.6:0/3385937136 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2400ee90 con 0x7f3a2c15f690 2023-07-21T22:57:51.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a3119d640 1 -- 172.21.15.6:0/3385937136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2c15d0b0 con 0x7f3a2c15f690 2023-07-21T22:57:51.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a137fe640 1 -- 172.21.15.6:0/3385937136 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a240149e0 con 0x7f3a2c15f690 2023-07-21T22:57:51.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a3119d640 1 -- 172.21.15.6:0/3385937136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2c0ae4a0 con 0x7f3a2c15f690 2023-07-21T22:57:51.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.272+0000 7f3a3119d640 1 -- 172.21.15.6:0/3385937136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2c0678d0 con 0x7f3a2c15f690 2023-07-21T22:57:51.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.276+0000 7f3a137fe640 1 -- 172.21.15.6:0/3385937136 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3a24014b40 con 0x7f3a2c15f690 2023-07-21T22:57:51.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.276+0000 7f3a137fe640 1 --2- 172.21.15.6:0/3385937136 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f3a180663a0 0x7f3a18068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:51.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.276+0000 7f3a137fe640 1 -- 172.21.15.6:0/3385937136 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6951+0+0 (secure 0 0 0) 0x7f3a24084b60 con 0x7f3a2c15f690 2023-07-21T22:57:51.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.276+0000 7f3a2ad9d640 1 --2- 172.21.15.6:0/3385937136 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f3a180663a0 0x7f3a18068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:51.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.276+0000 7f3a2ad9d640 1 --2- 172.21.15.6:0/3385937136 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f3a180663a0 0x7f3a18068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c000f70 tx=0x7f3a1c009040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:51.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.280+0000 7f3a137fe640 1 -- 172.21.15.6:0/3385937136 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3a24051b50 con 0x7f3a2c15f690 2023-07-21T22:57:51.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:51.436+0000 7f3a3119d640 1 -- 172.21.15.6:0/3385937136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3a2c0cf300 con 0x7f3a2c15f690 2023-07-21T22:57:52.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.128+0000 7f3a137fe640 1 -- 172.21.15.6:0/3385937136 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v196) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3a24055170 con 0x7f3a2c15f690 2023-07-21T22:57:52.165 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-07-21T22:57:52.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.132+0000 7f3a3119d640 1 -- 172.21.15.6:0/3385937136 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f3a180663a0 msgr2=0x7f3a18068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:52.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.132+0000 7f3a3119d640 1 --2- 172.21.15.6:0/3385937136 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f3a180663a0 0x7f3a18068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c000f70 tx=0x7f3a1c009040 comp rx=0 tx=0).stop 2023-07-21T22:57:52.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.132+0000 7f3a3119d640 1 -- 172.21.15.6:0/3385937136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c15f690 msgr2=0x7f3a2c13c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:52.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.132+0000 7f3a3119d640 1 --2- 172.21.15.6:0/3385937136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c15f690 0x7f3a2c13c880 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f3a24007e40 tx=0x7f3a2400e4b0 comp rx=0 tx=0).stop 2023-07-21T22:57:52.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.132+0000 7f3a3119d640 1 -- 172.21.15.6:0/3385937136 shutdown_connections 2023-07-21T22:57:52.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.132+0000 7f3a3119d640 1 --2- 172.21.15.6:0/3385937136 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f3a180663a0 0x7f3a18068850 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:52.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.132+0000 7f3a3119d640 1 --2- 172.21.15.6:0/3385937136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a2c15f690 0x7f3a2c13c880 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:52.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.132+0000 7f3a3119d640 1 --2- 172.21.15.6:0/3385937136 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a2c1453a0 0x7f3a2c13c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:52.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.132+0000 7f3a3119d640 1 --2- 172.21.15.6:0/3385937136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a2c06a440 0x7f3a2c15b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:52.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.132+0000 7f3a3119d640 1 -- 172.21.15.6:0/3385937136 >> 172.21.15.6:0/3385937136 conn(0x7f3a2c0b1210 msgr2=0x7f3a2c141940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:52.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.132+0000 7f3a3119d640 1 -- 172.21.15.6:0/3385937136 shutdown_connections 2023-07-21T22:57:52.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.136+0000 7f3a3119d640 1 -- 172.21.15.6:0/3385937136 wait complete. 2023-07-21T22:57:52.195 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-21T22:57:52.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.312+0000 7fba1e07b640 1 Processor -- start 2023-07-21T22:57:52.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.312+0000 7fba1e07b640 1 -- start start 2023-07-21T22:57:52.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.312+0000 7fba1e07b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba180aeb40 0x7fba1815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:52.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.312+0000 7fba1e07b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba180aef10 0x7fba18158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:52.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.312+0000 7fba1e07b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba181532b0 con 0x7fba18159270 2023-07-21T22:57:52.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.312+0000 7fba1e07b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba180ca6f0 con 0x7fba180aef10 2023-07-21T22:57:52.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.312+0000 7fba1e07b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba181599d0 con 0x7fba180aeb40 2023-07-21T22:57:52.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.312+0000 7fba16ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba180aef10 0x7fba18158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:52.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.312+0000 7fba16ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fba180aef10 0x7fba18158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36148/0 (socket says 172.21.15.6:36148) 2023-07-21T22:57:52.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.312+0000 7fba16ffd640 1 -- 172.21.15.6:0/1117378141 learned_addr learned my addr 172.21.15.6:0/1117378141 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:52.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.312+0000 7fba177fe640 1 --2- 172.21.15.6:0/1117378141 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba180aeb40 0x7fba1815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:52.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.312+0000 7fba16ffd640 1 -- 172.21.15.6:0/1117378141 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba180aeb40 msgr2=0x7fba1815cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:52.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.312+0000 7fba16ffd640 1 --2- 172.21.15.6:0/1117378141 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba180aeb40 0x7fba1815cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:52.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.312+0000 7fba16ffd640 1 -- 172.21.15.6:0/1117378141 >> v1:172.21.15.6:6789/0 conn(0x7fba18159270 legacy=0x7fba180c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:52.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.312+0000 7fba16ffd640 1 -- 172.21.15.6:0/1117378141 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba18159cb0 con 0x7fba180aef10 2023-07-21T22:57:52.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.316+0000 7fba16ffd640 1 --2- 172.21.15.6:0/1117378141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba180aef10 0x7fba18158d30 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009870 tx=0x7fba0c01e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a90c7f3a449b44 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:52.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.316+0000 7fba167fc640 1 -- 172.21.15.6:0/1117378141 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c0a8660 con 0x7fba180aef10 2023-07-21T22:57:52.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.316+0000 7fba167fc640 1 -- 172.21.15.6:0/1117378141 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c0a87c0 con 0x7fba180aef10 2023-07-21T22:57:52.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.316+0000 7fba167fc640 1 -- 172.21.15.6:0/1117378141 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c0a8b50 con 0x7fba180aef10 2023-07-21T22:57:52.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.316+0000 7fba1e07b640 1 -- 172.21.15.6:0/1117378141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba180aef10 msgr2=0x7fba18158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:52.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.316+0000 7fba1e07b640 1 --2- 172.21.15.6:0/1117378141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba180aef10 0x7fba18158d30 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009870 tx=0x7fba0c01e690 comp rx=0 tx=0).stop 2023-07-21T22:57:52.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.316+0000 7fba1e07b640 1 -- 172.21.15.6:0/1117378141 shutdown_connections 2023-07-21T22:57:52.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.316+0000 7fba1e07b640 1 --2- 172.21.15.6:0/1117378141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba180aef10 0x7fba18158d30 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:52.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.316+0000 7fba1e07b640 1 --2- 172.21.15.6:0/1117378141 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba180aeb40 0x7fba1815cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:52.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.316+0000 7fba1e07b640 1 -- 172.21.15.6:0/1117378141 >> 172.21.15.6:0/1117378141 conn(0x7fba180cde90 msgr2=0x7fba180ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:52.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.316+0000 7fba1e07b640 1 -- 172.21.15.6:0/1117378141 shutdown_connections 2023-07-21T22:57:52.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.316+0000 7fba1e07b640 1 -- 172.21.15.6:0/1117378141 wait complete. 2023-07-21T22:57:52.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba1e07b640 1 Processor -- start 2023-07-21T22:57:52.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba1e07b640 1 -- start start 2023-07-21T22:57:52.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba1e07b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba180aeb40 0x7fba1806f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:52.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba1e07b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba180aef10 0x7fba18150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:52.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba1e07b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba18159270 0x7fba181f7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:52.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba1e07b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba18070300 con 0x7fba180aef10 2023-07-21T22:57:52.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba1e07b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba18150a40 con 0x7fba180aeb40 2023-07-21T22:57:52.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba1e07b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1806f6f0 con 0x7fba18159270 2023-07-21T22:57:52.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba16ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba180aef10 0x7fba18150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:52.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba16ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba180aef10 0x7fba18150500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36150/0 (socket says 172.21.15.6:36150) 2023-07-21T22:57:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba16ffd640 1 -- 172.21.15.6:0/3099987934 learned_addr learned my addr 172.21.15.6:0/3099987934 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba17fff640 1 --2- 172.21.15.6:0/3099987934 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba18159270 0x7fba181f7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba177fe640 1 --2- 172.21.15.6:0/3099987934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba180aeb40 0x7fba1806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba16ffd640 1 -- 172.21.15.6:0/3099987934 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba18159270 msgr2=0x7fba181f7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba16ffd640 1 --2- 172.21.15.6:0/3099987934 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba18159270 0x7fba181f7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba16ffd640 1 -- 172.21.15.6:0/3099987934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba180aeb40 msgr2=0x7fba1806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:52.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba16ffd640 1 --2- 172.21.15.6:0/3099987934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba180aeb40 0x7fba1806f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:52.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba16ffd640 1 -- 172.21.15.6:0/3099987934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c0094d0 con 0x7fba180aef10 2023-07-21T22:57:52.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba16ffd640 1 --2- 172.21.15.6:0/3099987934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba180aef10 0x7fba18150500 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fba0c024c80 tx=0x7fba0c01b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fb9fffff640 1 -- 172.21.15.6:0/3099987934 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c0a8660 con 0x7fba180aef10 2023-07-21T22:57:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fb9fffff640 1 -- 172.21.15.6:0/3099987934 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c0b3880 con 0x7fba180aef10 2023-07-21T22:57:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fb9fffff640 1 -- 172.21.15.6:0/3099987934 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c0b3c30 con 0x7fba180aef10 2023-07-21T22:57:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba1e07b640 1 -- 172.21.15.6:0/3099987934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1806f9d0 con 0x7fba180aef10 2023-07-21T22:57:52.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.320+0000 7fba1e07b640 1 -- 172.21.15.6:0/3099987934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1806ff90 con 0x7fba180aef10 2023-07-21T22:57:52.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.324+0000 7fba1e07b640 1 -- 172.21.15.6:0/3099987934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba180678d0 con 0x7fba180aef10 2023-07-21T22:57:52.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.324+0000 7fb9fffff640 1 -- 172.21.15.6:0/3099987934 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fba0c0c0450 con 0x7fba180aef10 2023-07-21T22:57:52.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.324+0000 7fb9fffff640 1 --2- 172.21.15.6:0/3099987934 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fba040663a0 0x7fba04068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:52.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.324+0000 7fb9fffff640 1 -- 172.21.15.6:0/3099987934 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6513+0+0 (secure 0 0 0) 0x7fba0c11dc00 con 0x7fba180aef10 2023-07-21T22:57:52.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.324+0000 7fba177fe640 1 --2- 172.21.15.6:0/3099987934 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fba040663a0 0x7fba04068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:52.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.324+0000 7fba177fe640 1 --2- 172.21.15.6:0/3099987934 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fba040663a0 0x7fba04068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fba0800b9d0 tx=0x7fba08008040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:52.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.328+0000 7fb9fffff640 1 -- 172.21.15.6:0/3099987934 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fba0c0ead00 con 0x7fba180aef10 2023-07-21T22:57:52.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:52.496+0000 7fba1e07b640 1 -- 172.21.15.6:0/3099987934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fba180c2ee0 con 0x7fba180aef10 2023-07-21T22:57:53.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.148+0000 7fb9fffff640 1 -- 172.21.15.6:0/3099987934 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v197) v1 ==== 169+0+0 (secure 0 0 0) 0x7fba0c0ee320 con 0x7fba180aef10 2023-07-21T22:57:53.184 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-07-21T22:57:53.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.152+0000 7fba1e07b640 1 -- 172.21.15.6:0/3099987934 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fba040663a0 msgr2=0x7fba04068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:53.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.152+0000 7fba1e07b640 1 --2- 172.21.15.6:0/3099987934 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fba040663a0 0x7fba04068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fba0800b9d0 tx=0x7fba08008040 comp rx=0 tx=0).stop 2023-07-21T22:57:53.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.152+0000 7fba1e07b640 1 -- 172.21.15.6:0/3099987934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba180aef10 msgr2=0x7fba18150500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:53.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.152+0000 7fba1e07b640 1 --2- 172.21.15.6:0/3099987934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba180aef10 0x7fba18150500 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fba0c024c80 tx=0x7fba0c01b430 comp rx=0 tx=0).stop 2023-07-21T22:57:53.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.152+0000 7fba1e07b640 1 -- 172.21.15.6:0/3099987934 shutdown_connections 2023-07-21T22:57:53.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.152+0000 7fba1e07b640 1 --2- 172.21.15.6:0/3099987934 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fba040663a0 0x7fba04068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.152+0000 7fba1e07b640 1 --2- 172.21.15.6:0/3099987934 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fba18159270 0x7fba181f7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.152+0000 7fba1e07b640 1 --2- 172.21.15.6:0/3099987934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba180aef10 0x7fba18150500 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.152+0000 7fba1e07b640 1 --2- 172.21.15.6:0/3099987934 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba180aeb40 0x7fba1806f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.152+0000 7fba1e07b640 1 -- 172.21.15.6:0/3099987934 >> 172.21.15.6:0/3099987934 conn(0x7fba180cde90 msgr2=0x7fba180c3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:53.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.152+0000 7fba1e07b640 1 -- 172.21.15.6:0/3099987934 shutdown_connections 2023-07-21T22:57:53.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.152+0000 7fba1e07b640 1 -- 172.21.15.6:0/3099987934 wait complete. 2023-07-21T22:57:53.212 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-21T22:57:53.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.328+0000 7fa9845fa640 1 Processor -- start 2023-07-21T22:57:53.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.328+0000 7fa9845fa640 1 -- start start 2023-07-21T22:57:53.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.328+0000 7fa9845fa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa97c0b7c70 0x7fa97c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:53.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.328+0000 7fa9845fa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa97c15fd60 0x7fa97c0d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:53.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.328+0000 7fa9845fa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97c0ccaf0 con 0x7fa97c0d1850 2023-07-21T22:57:53.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.328+0000 7fa9845fa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa97c0d1190 con 0x7fa97c0b7c70 2023-07-21T22:57:53.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.328+0000 7fa9845fa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa97c160600 con 0x7fa97c15fd60 2023-07-21T22:57:53.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.328+0000 7fa982396640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa97c0b7c70 0x7fa97c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:53.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.328+0000 7fa981b95640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa97c0d1850 0x7fa97c15f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33820/0 (socket says 172.21.15.6:33820) 2023-07-21T22:57:53.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.328+0000 7fa981b95640 1 -- 172.21.15.6:0/646510501 learned_addr learned my addr 172.21.15.6:0/646510501 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:53.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.328+0000 7fa982b97640 1 --2- 172.21.15.6:0/646510501 >> v2:172.21.15.161:3300/0 conn(0x7fa97c15fd60 0x7fa97c0d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:53.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.328+0000 7fa982396640 1 -- 172.21.15.6:0/646510501 >> v2:172.21.15.161:3300/0 conn(0x7fa97c15fd60 msgr2=0x7fa97c0d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:53.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.328+0000 7fa982396640 1 --2- 172.21.15.6:0/646510501 >> v2:172.21.15.161:3300/0 conn(0x7fa97c15fd60 0x7fa97c0d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.328+0000 7fa982396640 1 -- 172.21.15.6:0/646510501 >> v1:172.21.15.6:6789/0 conn(0x7fa97c0d1850 legacy=0x7fa97c15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:53.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.328+0000 7fa981394640 1 -- 172.21.15.6:0/646510501 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576996153 0 0) 0x7fa97c0ccaf0 con 0x7fa97c0d1850 2023-07-21T22:57:53.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.328+0000 7fa982396640 1 -- 172.21.15.6:0/646510501 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97c160320 con 0x7fa97c0b7c70 2023-07-21T22:57:53.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.332+0000 7fa982396640 1 --2- 172.21.15.6:0/646510501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97c0b7c70 0x7fa97c0d0c50 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0b4040 tx=0x7fa97801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466d3a7d40822df8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:53.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.332+0000 7fa981394640 1 -- 172.21.15.6:0/646510501 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9780a7070 con 0x7fa97c0b7c70 2023-07-21T22:57:53.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.332+0000 7fa981394640 1 -- 172.21.15.6:0/646510501 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9780ab430 con 0x7fa97c0b7c70 2023-07-21T22:57:53.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.332+0000 7fa981394640 1 -- 172.21.15.6:0/646510501 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9780ab7c0 con 0x7fa97c0b7c70 2023-07-21T22:57:53.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.332+0000 7fa9845fa640 1 -- 172.21.15.6:0/646510501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97c0b7c70 msgr2=0x7fa97c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:53.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.332+0000 7fa9845fa640 1 --2- 172.21.15.6:0/646510501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97c0b7c70 0x7fa97c0d0c50 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0b4040 tx=0x7fa97801c410 comp rx=0 tx=0).stop 2023-07-21T22:57:53.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.332+0000 7fa9845fa640 1 -- 172.21.15.6:0/646510501 shutdown_connections 2023-07-21T22:57:53.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.332+0000 7fa9845fa640 1 --2- 172.21.15.6:0/646510501 >> v2:172.21.15.161:3300/0 conn(0x7fa97c15fd60 0x7fa97c0d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.332+0000 7fa9845fa640 1 --2- 172.21.15.6:0/646510501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97c0b7c70 0x7fa97c0d0c50 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.332+0000 7fa9845fa640 1 -- 172.21.15.6:0/646510501 >> 172.21.15.6:0/646510501 conn(0x7fa97c0650b0 msgr2=0x7fa97c0654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:53.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.332+0000 7fa9845fa640 1 -- 172.21.15.6:0/646510501 shutdown_connections 2023-07-21T22:57:53.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.332+0000 7fa9845fa640 1 -- 172.21.15.6:0/646510501 wait complete. 2023-07-21T22:57:53.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa9845fa640 1 Processor -- start 2023-07-21T22:57:53.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa9845fa640 1 -- start start 2023-07-21T22:57:53.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa9845fa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa97c0b7c70 0x7fa97c0cb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:53.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa9845fa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97c0d1850 0x7fa97c0c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:53.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa9845fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa97c15fd60 0x7fa97c159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:53.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa9845fa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c0cc030 con 0x7fa97c0d1850 2023-07-21T22:57:53.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa9845fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c0cc310 con 0x7fa97c15fd60 2023-07-21T22:57:53.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa9845fa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97c0c93d0 con 0x7fa97c0b7c70 2023-07-21T22:57:53.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa981b95640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97c0d1850 0x7fa97c0c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:53.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa981b95640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97c0d1850 0x7fa97c0c9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36164/0 (socket says 172.21.15.6:36164) 2023-07-21T22:57:53.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa981b95640 1 -- 172.21.15.6:0/4078858954 learned_addr learned my addr 172.21.15.6:0/4078858954 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:53.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa982396640 1 --2- 172.21.15.6:0/4078858954 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa97c0b7c70 0x7fa97c0cb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:53.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa982b97640 1 --2- 172.21.15.6:0/4078858954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa97c15fd60 0x7fa97c159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:53.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa981b95640 1 -- 172.21.15.6:0/4078858954 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa97c0b7c70 msgr2=0x7fa97c0cb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:53.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa981b95640 1 --2- 172.21.15.6:0/4078858954 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa97c0b7c70 0x7fa97c0cb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa981b95640 1 -- 172.21.15.6:0/4078858954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa97c15fd60 msgr2=0x7fa97c159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:53.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa981b95640 1 --2- 172.21.15.6:0/4078858954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa97c15fd60 0x7fa97c159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa981b95640 1 -- 172.21.15.6:0/4078858954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa978009420 con 0x7fa97c0d1850 2023-07-21T22:57:53.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa981b95640 1 --2- 172.21.15.6:0/4078858954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97c0d1850 0x7fa97c0c9eb0 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00c480 tx=0x7fa96c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:53.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa972ffd640 1 -- 172.21.15.6:0/4078858954 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0074e0 con 0x7fa97c0d1850 2023-07-21T22:57:53.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa972ffd640 1 -- 172.21.15.6:0/4078858954 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96c007660 con 0x7fa97c0d1850 2023-07-21T22:57:53.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa9845fa640 1 -- 172.21.15.6:0/4078858954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa97c0c96b0 con 0x7fa97c0d1850 2023-07-21T22:57:53.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa972ffd640 1 -- 172.21.15.6:0/4078858954 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c004a30 con 0x7fa97c0d1850 2023-07-21T22:57:53.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.336+0000 7fa9845fa640 1 -- 172.21.15.6:0/4078858954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97c0ca3f0 con 0x7fa97c0d1850 2023-07-21T22:57:53.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.340+0000 7fa9845fa640 1 -- 172.21.15.6:0/4078858954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa97c0678d0 con 0x7fa97c0d1850 2023-07-21T22:57:53.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.340+0000 7fa972ffd640 1 -- 172.21.15.6:0/4078858954 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa96c004b90 con 0x7fa97c0d1850 2023-07-21T22:57:53.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.340+0000 7fa972ffd640 1 --2- 172.21.15.6:0/4078858954 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa9600663a0 0x7fa960068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:53.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.340+0000 7fa972ffd640 1 -- 172.21.15.6:0/4078858954 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7fa96c0833a0 con 0x7fa97c0d1850 2023-07-21T22:57:53.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.340+0000 7fa982396640 1 --2- 172.21.15.6:0/4078858954 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa9600663a0 0x7fa960068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:53.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.340+0000 7fa982396640 1 --2- 172.21.15.6:0/4078858954 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa9600663a0 0x7fa960068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa9780af000 tx=0x7fa9780a7000 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:53.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.344+0000 7fa972ffd640 1 -- 172.21.15.6:0/4078858954 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa96c054210 con 0x7fa97c0d1850 2023-07-21T22:57:53.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.508+0000 7fa9845fa640 1 -- 172.21.15.6:0/4078858954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fa97c0cc170 con 0x7fa97c0d1850 2023-07-21T22:57:53.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.512+0000 7fa972ffd640 1 -- 172.21.15.6:0/4078858954 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v67) v1 ==== 115+0+0 (secure 0 0 0) 0x7fa97c0cc170 con 0x7fa97c0d1850 2023-07-21T22:57:53.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.516+0000 7fa9845fa640 1 -- 172.21.15.6:0/4078858954 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa9600663a0 msgr2=0x7fa960068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:53.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.516+0000 7fa9845fa640 1 --2- 172.21.15.6:0/4078858954 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa9600663a0 0x7fa960068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa9780af000 tx=0x7fa9780a7000 comp rx=0 tx=0).stop 2023-07-21T22:57:53.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.516+0000 7fa9845fa640 1 -- 172.21.15.6:0/4078858954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97c0d1850 msgr2=0x7fa97c0c9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:53.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.516+0000 7fa9845fa640 1 --2- 172.21.15.6:0/4078858954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97c0d1850 0x7fa97c0c9eb0 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00c480 tx=0x7fa96c00c940 comp rx=0 tx=0).stop 2023-07-21T22:57:53.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.516+0000 7fa9845fa640 1 -- 172.21.15.6:0/4078858954 shutdown_connections 2023-07-21T22:57:53.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.516+0000 7fa9845fa640 1 --2- 172.21.15.6:0/4078858954 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa9600663a0 0x7fa960068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.516+0000 7fa9845fa640 1 --2- 172.21.15.6:0/4078858954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa97c15fd60 0x7fa97c159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.516+0000 7fa9845fa640 1 --2- 172.21.15.6:0/4078858954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa97c0d1850 0x7fa97c0c9eb0 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.516+0000 7fa9845fa640 1 --2- 172.21.15.6:0/4078858954 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa97c0b7c70 0x7fa97c0cb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.516+0000 7fa9845fa640 1 -- 172.21.15.6:0/4078858954 >> 172.21.15.6:0/4078858954 conn(0x7fa97c0650b0 msgr2=0x7fa97c0b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:53.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.516+0000 7fa9845fa640 1 -- 172.21.15.6:0/4078858954 shutdown_connections 2023-07-21T22:57:53.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.516+0000 7fa9845fa640 1 -- 172.21.15.6:0/4078858954 wait complete. 2023-07-21T22:57:53.569 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-21T22:57:53.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.680+0000 7ff2a1096640 1 Processor -- start 2023-07-21T22:57:53.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.680+0000 7ff2a1096640 1 -- start start 2023-07-21T22:57:53.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.680+0000 7ff2a1096640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c0d06b0 0x7ff29c0b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:53.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.680+0000 7ff2a1096640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff29c145430 0x7ff29c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:53.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.680+0000 7ff2a1096640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff29c0b2410 con 0x7ff29c0b1f70 2023-07-21T22:57:53.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.680+0000 7ff2a1096640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29c0b26f0 con 0x7ff29c145430 2023-07-21T22:57:53.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.680+0000 7ff2a1096640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c0b29d0 con 0x7ff29c0d06b0 2023-07-21T22:57:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.680+0000 7ff29ad9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c0d06b0 0x7ff29c0b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.680+0000 7ff293fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff29c145430 0x7ff29c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.680+0000 7ff29ad9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c0d06b0 0x7ff29c0b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:54902/0 (socket says 172.21.15.6:54902) 2023-07-21T22:57:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.680+0000 7ff29ad9d640 1 -- 172.21.15.6:0/2639252888 learned_addr learned my addr 172.21.15.6:0/2639252888 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.684+0000 7ff29ad9d640 1 -- 172.21.15.6:0/2639252888 >> v2:172.21.15.161:3300/0 conn(0x7ff29c145430 msgr2=0x7ff29c0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.684+0000 7ff29ad9d640 1 --2- 172.21.15.6:0/2639252888 >> v2:172.21.15.161:3300/0 conn(0x7ff29c145430 0x7ff29c0b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.684+0000 7ff29ad9d640 1 -- 172.21.15.6:0/2639252888 >> v1:172.21.15.161:6789/0 conn(0x7ff29c0b1f70 legacy=0x7ff29c0d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.684+0000 7ff29ad9d640 1 -- 172.21.15.6:0/2639252888 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c0b2cb0 con 0x7ff29c0d06b0 2023-07-21T22:57:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.684+0000 7ff293fff640 1 --2- 172.21.15.6:0/2639252888 >> v2:172.21.15.161:3300/0 conn(0x7ff29c145430 0x7ff29c0b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:53.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.684+0000 7ff29ad9d640 1 --2- 172.21.15.6:0/2639252888 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c0d06b0 0x7ff29c0b1a30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff28c009870 tx=0x7ff28c01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c09ee450fcc686d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:53.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.684+0000 7ff29a59c640 1 -- 172.21.15.6:0/2639252888 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c0a95f0 con 0x7ff29c0d06b0 2023-07-21T22:57:53.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.684+0000 7ff29a59c640 1 -- 172.21.15.6:0/2639252888 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c0a9750 con 0x7ff29c0d06b0 2023-07-21T22:57:53.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.684+0000 7ff29a59c640 1 -- 172.21.15.6:0/2639252888 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c0a9ae0 con 0x7ff29c0d06b0 2023-07-21T22:57:53.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff2a1096640 1 -- 172.21.15.6:0/2639252888 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c0d06b0 msgr2=0x7ff29c0b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:53.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff2a1096640 1 --2- 172.21.15.6:0/2639252888 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c0d06b0 0x7ff29c0b1a30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff28c009870 tx=0x7ff28c01c510 comp rx=0 tx=0).stop 2023-07-21T22:57:53.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff2a1096640 1 -- 172.21.15.6:0/2639252888 shutdown_connections 2023-07-21T22:57:53.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff2a1096640 1 --2- 172.21.15.6:0/2639252888 >> v2:172.21.15.161:3300/0 conn(0x7ff29c145430 0x7ff29c0b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff2a1096640 1 --2- 172.21.15.6:0/2639252888 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c0d06b0 0x7ff29c0b1a30 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff2a1096640 1 -- 172.21.15.6:0/2639252888 >> 172.21.15.6:0/2639252888 conn(0x7ff29c0659d0 msgr2=0x7ff29c09b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:53.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff2a1096640 1 -- 172.21.15.6:0/2639252888 shutdown_connections 2023-07-21T22:57:53.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff2a1096640 1 -- 172.21.15.6:0/2639252888 wait complete. 2023-07-21T22:57:53.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff2a1096640 1 Processor -- start 2023-07-21T22:57:53.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff2a1096640 1 -- start start 2023-07-21T22:57:53.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff2a1096640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff29c0b1f70 0x7ff29c15b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:53.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff2a1096640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c0d06b0 0x7ff29c0c2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:53.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff2a1096640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff29c0c9420 0x7ff29c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:53.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff2a1096640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c15bd30 con 0x7ff29c0b1f70 2023-07-21T22:57:53.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff2a1096640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c15ba50 con 0x7ff29c0c9420 2023-07-21T22:57:53.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff2a1096640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29c0cb250 con 0x7ff29c0d06b0 2023-07-21T22:57:53.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff29ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff29c0b1f70 0x7ff29c15b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:53.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff29ad9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff29c0b1f70 0x7ff29c15b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36180/0 (socket says 172.21.15.6:36180) 2023-07-21T22:57:53.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff29ad9d640 1 -- 172.21.15.6:0/3654430454 learned_addr learned my addr 172.21.15.6:0/3654430454 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:53.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff293fff640 1 --2- 172.21.15.6:0/3654430454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c0d06b0 0x7ff29c0c2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:53.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.688+0000 7ff29b59e640 1 --2- 172.21.15.6:0/3654430454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff29c0c9420 0x7ff29c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:53.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.692+0000 7ff29ad9d640 1 -- 172.21.15.6:0/3654430454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c0d06b0 msgr2=0x7ff29c0c2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:53.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.692+0000 7ff29ad9d640 1 --2- 172.21.15.6:0/3654430454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c0d06b0 0x7ff29c0c2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.692+0000 7ff29ad9d640 1 -- 172.21.15.6:0/3654430454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff29c0c9420 msgr2=0x7ff29c0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:53.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.692+0000 7ff29ad9d640 1 --2- 172.21.15.6:0/3654430454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff29c0c9420 0x7ff29c0cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.692+0000 7ff29ad9d640 1 -- 172.21.15.6:0/3654430454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff284009420 con 0x7ff29c0b1f70 2023-07-21T22:57:53.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.692+0000 7ff29ad9d640 1 --2- 172.21.15.6:0/3654430454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff29c0b1f70 0x7ff29c15b470 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7ff28c0ab040 tx=0x7ff28c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:53.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.692+0000 7ff2937fe640 1 -- 172.21.15.6:0/3654430454 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c0b1800 con 0x7ff29c0b1f70 2023-07-21T22:57:53.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.692+0000 7ff2937fe640 1 -- 172.21.15.6:0/3654430454 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c0b1980 con 0x7ff29c0b1f70 2023-07-21T22:57:53.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.692+0000 7ff2937fe640 1 -- 172.21.15.6:0/3654430454 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c0b1d30 con 0x7ff29c0b1f70 2023-07-21T22:57:53.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.692+0000 7ff2a1096640 1 -- 172.21.15.6:0/3654430454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28c0094d0 con 0x7ff29c0b1f70 2023-07-21T22:57:53.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.692+0000 7ff2a1096640 1 -- 172.21.15.6:0/3654430454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29c0cb810 con 0x7ff29c0b1f70 2023-07-21T22:57:53.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.692+0000 7ff2a1096640 1 -- 172.21.15.6:0/3654430454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29c072e70 con 0x7ff29c0b1f70 2023-07-21T22:57:53.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.692+0000 7ff2937fe640 1 -- 172.21.15.6:0/3654430454 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff28c0bc450 con 0x7ff29c0b1f70 2023-07-21T22:57:53.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.692+0000 7ff2937fe640 1 --2- 172.21.15.6:0/3654430454 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff27c0663a0 0x7ff27c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:53.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.692+0000 7ff2937fe640 1 -- 172.21.15.6:0/3654430454 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7ff28c11e980 con 0x7ff29c0b1f70 2023-07-21T22:57:53.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.692+0000 7ff293fff640 1 --2- 172.21.15.6:0/3654430454 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff27c0663a0 0x7ff27c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:53.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.696+0000 7ff293fff640 1 --2- 172.21.15.6:0/3654430454 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff27c0663a0 0x7ff27c068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0b49c0 tx=0x7ff284008040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:53.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.696+0000 7ff2937fe640 1 -- 172.21.15.6:0/3654430454 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff28c0ebb10 con 0x7ff29c0b1f70 2023-07-21T22:57:53.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.852+0000 7ff2a1096640 1 -- 172.21.15.6:0/3654430454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7ff29c0cb390 con 0x7ff29c0b1f70 2023-07-21T22:57:53.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.856+0000 7ff2937fe640 1 -- 172.21.15.6:0/3654430454 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v68) v1 ==== 120+0+0 (secure 0 0 0) 0x7ff29c0cb390 con 0x7ff29c0b1f70 2023-07-21T22:57:53.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.856+0000 7ff2a1096640 1 -- 172.21.15.6:0/3654430454 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff27c0663a0 msgr2=0x7ff27c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:53.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.856+0000 7ff2a1096640 1 --2- 172.21.15.6:0/3654430454 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff27c0663a0 0x7ff27c068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0b49c0 tx=0x7ff284008040 comp rx=0 tx=0).stop 2023-07-21T22:57:53.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.856+0000 7ff2a1096640 1 -- 172.21.15.6:0/3654430454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff29c0b1f70 msgr2=0x7ff29c15b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.856+0000 7ff2a1096640 1 --2- 172.21.15.6:0/3654430454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff29c0b1f70 0x7ff29c15b470 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7ff28c0ab040 tx=0x7ff28c01ad50 comp rx=0 tx=0).stop 2023-07-21T22:57:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.860+0000 7ff2a1096640 1 -- 172.21.15.6:0/3654430454 shutdown_connections 2023-07-21T22:57:53.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.860+0000 7ff2a1096640 1 --2- 172.21.15.6:0/3654430454 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff27c0663a0 0x7ff27c068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.860+0000 7ff2a1096640 1 --2- 172.21.15.6:0/3654430454 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff29c0c9420 0x7ff29c0cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.860+0000 7ff2a1096640 1 --2- 172.21.15.6:0/3654430454 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff29c0d06b0 0x7ff29c0c2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.860+0000 7ff2a1096640 1 --2- 172.21.15.6:0/3654430454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff29c0b1f70 0x7ff29c15b470 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:53.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.860+0000 7ff2a1096640 1 -- 172.21.15.6:0/3654430454 >> 172.21.15.6:0/3654430454 conn(0x7ff29c0659d0 msgr2=0x7ff29c06a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:53.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.860+0000 7ff2a1096640 1 -- 172.21.15.6:0/3654430454 shutdown_connections 2023-07-21T22:57:53.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:53.860+0000 7ff2a1096640 1 -- 172.21.15.6:0/3654430454 wait complete. 2023-07-21T22:57:53.913 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-21T22:57:54.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.024+0000 7f221032c640 1 Processor -- start 2023-07-21T22:57:54.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.024+0000 7f221032c640 1 -- start start 2023-07-21T22:57:54.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.024+0000 7f221032c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2208159a70 0x7f22080ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:54.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.024+0000 7f221032c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2208071030 0x7f22080c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:54.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.024+0000 7f221032c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22080cbe50 con 0x7f220815e060 2023-07-21T22:57:54.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.024+0000 7f221032c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22080cd660 con 0x7f2208071030 2023-07-21T22:57:54.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.024+0000 7f221032c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22080cc0a0 con 0x7f2208159a70 2023-07-21T22:57:54.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.024+0000 7f220e0c8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2208159a70 0x7f22080ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:54.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.024+0000 7f220e0c8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2208159a70 0x7f22080ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.6:54914/0 (socket says 172.21.15.6:54914) 2023-07-21T22:57:54.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.024+0000 7f220e0c8640 1 -- 172.21.15.6:0/3047065471 learned_addr learned my addr 172.21.15.6:0/3047065471 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:54.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.024+0000 7f220e8c9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2208071030 0x7f22080c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:54.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.024+0000 7f220e0c8640 1 -- 172.21.15.6:0/3047065471 >> v2:172.21.15.161:3300/0 conn(0x7f2208071030 msgr2=0x7f22080c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:54.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.024+0000 7f220e0c8640 1 --2- 172.21.15.6:0/3047065471 >> v2:172.21.15.161:3300/0 conn(0x7f2208071030 0x7f22080c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:54.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.024+0000 7f220e0c8640 1 -- 172.21.15.6:0/3047065471 >> v1:172.21.15.161:6789/0 conn(0x7f220815e060 legacy=0x7f2208070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:54.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.024+0000 7f220e0c8640 1 -- 172.21.15.6:0/3047065471 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22080cc380 con 0x7f2208159a70 2023-07-21T22:57:54.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.028+0000 7f220e0c8640 1 --2- 172.21.15.6:0/3047065471 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2208159a70 0x7f22080ccff0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2204009870 tx=0x7f220401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43f111bb7fc35efd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:54.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.028+0000 7f220d0c6640 1 -- 172.21.15.6:0/3047065471 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22040ab610 con 0x7f2208159a70 2023-07-21T22:57:54.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.028+0000 7f220d0c6640 1 -- 172.21.15.6:0/3047065471 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22040ab770 con 0x7f2208159a70 2023-07-21T22:57:54.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.028+0000 7f220d0c6640 1 -- 172.21.15.6:0/3047065471 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22040abb00 con 0x7f2208159a70 2023-07-21T22:57:54.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.028+0000 7f221032c640 1 -- 172.21.15.6:0/3047065471 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2208159a70 msgr2=0x7f22080ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:54.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.028+0000 7f221032c640 1 --2- 172.21.15.6:0/3047065471 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2208159a70 0x7f22080ccff0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2204009870 tx=0x7f220401c3f0 comp rx=0 tx=0).stop 2023-07-21T22:57:54.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.028+0000 7f221032c640 1 -- 172.21.15.6:0/3047065471 shutdown_connections 2023-07-21T22:57:54.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.028+0000 7f221032c640 1 --2- 172.21.15.6:0/3047065471 >> v2:172.21.15.161:3300/0 conn(0x7f2208071030 0x7f22080c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:54.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.028+0000 7f221032c640 1 --2- 172.21.15.6:0/3047065471 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2208159a70 0x7f22080ccff0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:54.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.028+0000 7f221032c640 1 -- 172.21.15.6:0/3047065471 >> 172.21.15.6:0/3047065471 conn(0x7f22080afac0 msgr2=0x7f22080afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:54.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.028+0000 7f221032c640 1 -- 172.21.15.6:0/3047065471 shutdown_connections 2023-07-21T22:57:54.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.028+0000 7f221032c640 1 -- 172.21.15.6:0/3047065471 wait complete. 2023-07-21T22:57:54.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f221032c640 1 Processor -- start 2023-07-21T22:57:54.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f221032c640 1 -- start start 2023-07-21T22:57:54.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f221032c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2208071030 0x7f22080b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:54.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f221032c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2208159a70 0x7f220815a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:54.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f221032c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220815e060 0x7f220814d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:54.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f221032c640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22080ae9e0 con 0x7f2208071030 2023-07-21T22:57:54.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f221032c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22080ae420 con 0x7f220815e060 2023-07-21T22:57:54.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f221032c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22080ae700 con 0x7f2208159a70 2023-07-21T22:57:54.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f220e0c8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2208071030 0x7f22080b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:54.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f220e0c8640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2208071030 0x7f22080b2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36188/0 (socket says 172.21.15.6:36188) 2023-07-21T22:57:54.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f220e0c8640 1 -- 172.21.15.6:0/1449719875 learned_addr learned my addr 172.21.15.6:0/1449719875 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:54.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f220d8c7640 1 --2- 172.21.15.6:0/1449719875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2208159a70 0x7f220815a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:54.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f220e8c9640 1 --2- 172.21.15.6:0/1449719875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220815e060 0x7f220814d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f220e0c8640 1 -- 172.21.15.6:0/1449719875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2208159a70 msgr2=0x7f220815a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f220e0c8640 1 --2- 172.21.15.6:0/1449719875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2208159a70 0x7f220815a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f220e0c8640 1 -- 172.21.15.6:0/1449719875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220815e060 msgr2=0x7f220814d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f220e0c8640 1 --2- 172.21.15.6:0/1449719875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220815e060 0x7f220814d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f220e0c8640 1 -- 172.21.15.6:0/1449719875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22040094d0 con 0x7f2208071030 2023-07-21T22:57:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f220d8c7640 1 --2- 172.21.15.6:0/1449719875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2208159a70 0x7f220815a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:54.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f220e8c9640 1 --2- 172.21.15.6:0/1449719875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220815e060 0x7f220814d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f220e0c8640 1 --2- 172.21.15.6:0/1449719875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2208071030 0x7f22080b2f90 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f22040ad040 tx=0x7f220401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f21feffd640 1 -- 172.21.15.6:0/1449719875 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22040b4800 con 0x7f2208071030 2023-07-21T22:57:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f21feffd640 1 -- 172.21.15.6:0/1449719875 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22040b4960 con 0x7f2208071030 2023-07-21T22:57:54.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f221032c640 1 -- 172.21.15.6:0/1449719875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22080af3e0 con 0x7f2208071030 2023-07-21T22:57:54.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f21feffd640 1 -- 172.21.15.6:0/1449719875 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22040b4d10 con 0x7f2208071030 2023-07-21T22:57:54.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.032+0000 7f221032c640 1 -- 172.21.15.6:0/1449719875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f220815a610 con 0x7f2208071030 2023-07-21T22:57:54.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.036+0000 7f221032c640 1 -- 172.21.15.6:0/1449719875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22080678d0 con 0x7f2208071030 2023-07-21T22:57:54.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.036+0000 7f21feffd640 1 -- 172.21.15.6:0/1449719875 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f22040c7440 con 0x7f2208071030 2023-07-21T22:57:54.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.036+0000 7f21feffd640 1 --2- 172.21.15.6:0/1449719875 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f21ec0663a0 0x7f21ec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:54.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.036+0000 7f21feffd640 1 -- 172.21.15.6:0/1449719875 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f220411ea00 con 0x7f2208071030 2023-07-21T22:57:54.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.036+0000 7f220d8c7640 1 --2- 172.21.15.6:0/1449719875 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f21ec0663a0 0x7f21ec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:54.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.036+0000 7f220d8c7640 1 --2- 172.21.15.6:0/1449719875 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f21ec0663a0 0x7f21ec068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f22080c14f0 tx=0x7f21f8009040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:54.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.040+0000 7f21feffd640 1 -- 172.21.15.6:0/1449719875 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f22040ebd40 con 0x7f2208071030 2023-07-21T22:57:54.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.200+0000 7f221032c640 1 -- 172.21.15.6:0/1449719875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f22080af890 con 0x7f2208071030 2023-07-21T22:57:54.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.204+0000 7f21feffd640 1 -- 172.21.15.6:0/1449719875 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v69) v1 ==== 104+0+0 (secure 0 0 0) 0x7f22040ef360 con 0x7f2208071030 2023-07-21T22:57:54.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.204+0000 7f221032c640 1 -- 172.21.15.6:0/1449719875 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f21ec0663a0 msgr2=0x7f21ec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:54.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.204+0000 7f221032c640 1 --2- 172.21.15.6:0/1449719875 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f21ec0663a0 0x7f21ec068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f22080c14f0 tx=0x7f21f8009040 comp rx=0 tx=0).stop 2023-07-21T22:57:54.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.204+0000 7f221032c640 1 -- 172.21.15.6:0/1449719875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2208071030 msgr2=0x7f22080b2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:54.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.204+0000 7f221032c640 1 --2- 172.21.15.6:0/1449719875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2208071030 0x7f22080b2f90 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f22040ad040 tx=0x7f220401ac30 comp rx=0 tx=0).stop 2023-07-21T22:57:54.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.204+0000 7f221032c640 1 -- 172.21.15.6:0/1449719875 shutdown_connections 2023-07-21T22:57:54.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.204+0000 7f221032c640 1 --2- 172.21.15.6:0/1449719875 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f21ec0663a0 0x7f21ec068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:54.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.204+0000 7f221032c640 1 --2- 172.21.15.6:0/1449719875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f220815e060 0x7f220814d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:54.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.204+0000 7f221032c640 1 --2- 172.21.15.6:0/1449719875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2208159a70 0x7f220815a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:54.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.208+0000 7f221032c640 1 --2- 172.21.15.6:0/1449719875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2208071030 0x7f22080b2f90 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:54.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.208+0000 7f221032c640 1 -- 172.21.15.6:0/1449719875 >> 172.21.15.6:0/1449719875 conn(0x7f22080afac0 msgr2=0x7f22080afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:54.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.208+0000 7f221032c640 1 -- 172.21.15.6:0/1449719875 shutdown_connections 2023-07-21T22:57:54.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.208+0000 7f221032c640 1 -- 172.21.15.6:0/1449719875 wait complete. 2023-07-21T22:57:54.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-07-21T22:57:54.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.368+0000 7fa975dfa640 1 Processor -- start 2023-07-21T22:57:54.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.368+0000 7fa975dfa640 1 -- start start 2023-07-21T22:57:54.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.372+0000 7fa975dfa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa970158ce0 0x7fa970070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:54.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.372+0000 7fa975dfa640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9700c9730 0x7fa9700ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:54.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.372+0000 7fa975dfa640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9700cc700 con 0x7fa9700c8ad0 2023-07-21T22:57:54.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.372+0000 7fa975dfa640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9700b0ff0 con 0x7fa9700c9730 2023-07-21T22:57:54.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.372+0000 7fa975dfa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa970070c80 con 0x7fa970158ce0 2023-07-21T22:57:54.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.372+0000 7fa96ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9700c9730 0x7fa9700ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:54.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.372+0000 7fa96ffff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa9700c9730 0x7fa9700ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36192/0 (socket says 172.21.15.6:36192) 2023-07-21T22:57:54.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.372+0000 7fa96ffff640 1 -- 172.21.15.6:0/482322939 learned_addr learned my addr 172.21.15.6:0/482322939 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:54.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.372+0000 7fa96effd640 1 --1- 172.21.15.6:0/482322939 >> v1:172.21.15.6:6789/0 conn(0x7fa9700c8ad0 0x7fa9700c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33822/0 (socket says 172.21.15.6:33822) 2023-07-21T22:57:54.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.372+0000 7fa96f7fe640 1 --2- 172.21.15.6:0/482322939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa970158ce0 0x7fa970070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:54.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.372+0000 7fa96ffff640 1 -- 172.21.15.6:0/482322939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa970158ce0 msgr2=0x7fa970070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:54.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.372+0000 7fa96ffff640 1 --2- 172.21.15.6:0/482322939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa970158ce0 0x7fa970070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:54.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.372+0000 7fa96ffff640 1 -- 172.21.15.6:0/482322939 >> v1:172.21.15.6:6789/0 conn(0x7fa9700c8ad0 legacy=0x7fa9700c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:54.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.372+0000 7fa96ffff640 1 -- 172.21.15.6:0/482322939 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9700cbdd0 con 0x7fa9700c9730 2023-07-21T22:57:54.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.376+0000 7fa96ffff640 1 --2- 172.21.15.6:0/482322939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9700c9730 0x7fa9700ccb90 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7fa968009e50 tx=0x7fa96801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520d1ba46cf14ad server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:54.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.376+0000 7fa96e7fc640 1 -- 172.21.15.6:0/482322939 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9680a5690 con 0x7fa9700c9730 2023-07-21T22:57:54.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.376+0000 7fa96e7fc640 1 -- 172.21.15.6:0/482322939 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9680a57f0 con 0x7fa9700c9730 2023-07-21T22:57:54.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.376+0000 7fa96e7fc640 1 -- 172.21.15.6:0/482322939 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9680a5b80 con 0x7fa9700c9730 2023-07-21T22:57:54.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.376+0000 7fa975dfa640 1 -- 172.21.15.6:0/482322939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9700c9730 msgr2=0x7fa9700ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:54.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.376+0000 7fa975dfa640 1 --2- 172.21.15.6:0/482322939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9700c9730 0x7fa9700ccb90 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7fa968009e50 tx=0x7fa96801c8c0 comp rx=0 tx=0).stop 2023-07-21T22:57:54.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.376+0000 7fa975dfa640 1 -- 172.21.15.6:0/482322939 shutdown_connections 2023-07-21T22:57:54.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.376+0000 7fa975dfa640 1 --2- 172.21.15.6:0/482322939 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9700c9730 0x7fa9700ccb90 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:54.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.376+0000 7fa975dfa640 1 --2- 172.21.15.6:0/482322939 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa970158ce0 0x7fa970070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:54.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.376+0000 7fa975dfa640 1 -- 172.21.15.6:0/482322939 >> 172.21.15.6:0/482322939 conn(0x7fa9700afcf0 msgr2=0x7fa9700b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:54.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.376+0000 7fa975dfa640 1 -- 172.21.15.6:0/482322939 shutdown_connections 2023-07-21T22:57:54.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.376+0000 7fa975dfa640 1 -- 172.21.15.6:0/482322939 wait complete. 2023-07-21T22:57:54.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa975dfa640 1 Processor -- start 2023-07-21T22:57:54.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa975dfa640 1 -- start start 2023-07-21T22:57:54.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa975dfa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9700c8ad0 0x7fa9700acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:54.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa975dfa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700c9730 0x7fa970156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:54.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa975dfa640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa970158ce0 0x7fa9701533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:54.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa975dfa640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9700b1130 con 0x7fa970158ce0 2023-07-21T22:57:54.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa975dfa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9700ac590 con 0x7fa9700c8ad0 2023-07-21T22:57:54.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa975dfa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9700b1340 con 0x7fa9700c9730 2023-07-21T22:57:54.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa96ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa970158ce0 0x7fa9701533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:54.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa96ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa970158ce0 0x7fa9701533b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36200/0 (socket says 172.21.15.6:36200) 2023-07-21T22:57:54.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa96ffff640 1 -- 172.21.15.6:0/1937634066 learned_addr learned my addr 172.21.15.6:0/1937634066 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:54.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa96f7fe640 1 --2- 172.21.15.6:0/1937634066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9700c8ad0 0x7fa9700acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:54.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa96effd640 1 --2- 172.21.15.6:0/1937634066 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700c9730 0x7fa970156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:54.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa96ffff640 1 -- 172.21.15.6:0/1937634066 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700c9730 msgr2=0x7fa970156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:54.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa96ffff640 1 --2- 172.21.15.6:0/1937634066 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700c9730 0x7fa970156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:54.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa96ffff640 1 -- 172.21.15.6:0/1937634066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9700c8ad0 msgr2=0x7fa9700acb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:54.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa96ffff640 1 --2- 172.21.15.6:0/1937634066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9700c8ad0 0x7fa9700acb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:54.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa96ffff640 1 -- 172.21.15.6:0/1937634066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa968009b30 con 0x7fa970158ce0 2023-07-21T22:57:54.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa96ffff640 1 --2- 172.21.15.6:0/1937634066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa970158ce0 0x7fa9701533b0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fa9680af040 tx=0x7fa968019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:54.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa957fff640 1 -- 172.21.15.6:0/1937634066 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9680b8670 con 0x7fa970158ce0 2023-07-21T22:57:54.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa957fff640 1 -- 172.21.15.6:0/1937634066 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9680b87d0 con 0x7fa970158ce0 2023-07-21T22:57:54.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa975dfa640 1 -- 172.21.15.6:0/1937634066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9700b1620 con 0x7fa970158ce0 2023-07-21T22:57:54.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa957fff640 1 -- 172.21.15.6:0/1937634066 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9680b8b60 con 0x7fa970158ce0 2023-07-21T22:57:54.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.380+0000 7fa975dfa640 1 -- 172.21.15.6:0/1937634066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9700ac280 con 0x7fa970158ce0 2023-07-21T22:57:54.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.384+0000 7fa975dfa640 1 -- 172.21.15.6:0/1937634066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9700678d0 con 0x7fa970158ce0 2023-07-21T22:57:54.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.384+0000 7fa957fff640 1 -- 172.21.15.6:0/1937634066 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa9680b8cc0 con 0x7fa970158ce0 2023-07-21T22:57:54.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.384+0000 7fa957fff640 1 --2- 172.21.15.6:0/1937634066 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa95c0663a0 0x7fa95c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:54.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.384+0000 7fa957fff640 1 -- 172.21.15.6:0/1937634066 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7fa96811f2a0 con 0x7fa970158ce0 2023-07-21T22:57:54.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.384+0000 7fa96f7fe640 1 --2- 172.21.15.6:0/1937634066 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa95c0663a0 0x7fa95c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:54.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.388+0000 7fa96f7fe640 1 --2- 172.21.15.6:0/1937634066 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa95c0663a0 0x7fa95c068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa9600079c0 tx=0x7fa960008040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:54.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.388+0000 7fa957fff640 1 -- 172.21.15.6:0/1937634066 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa9680ec680 con 0x7fa970158ce0 2023-07-21T22:57:54.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:54.624+0000 7fa975dfa640 1 -- 172.21.15.6:0/1937634066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7fa9700c81d0 con 0x7fa970158ce0 2023-07-21T22:57:55.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:55.148+0000 7fa957fff640 1 -- 172.21.15.6:0/1937634066 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v1413) v1 ==== 155+0+0 (secure 0 0 0) 0x7fa968009510 con 0x7fa970158ce0 2023-07-21T22:57:55.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:55.152+0000 7fa975dfa640 1 -- 172.21.15.6:0/1937634066 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa95c0663a0 msgr2=0x7fa95c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:55.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:55.152+0000 7fa975dfa640 1 --2- 172.21.15.6:0/1937634066 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa95c0663a0 0x7fa95c068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa9600079c0 tx=0x7fa960008040 comp rx=0 tx=0).stop 2023-07-21T22:57:55.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:55.152+0000 7fa975dfa640 1 -- 172.21.15.6:0/1937634066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa970158ce0 msgr2=0x7fa9701533b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:55.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:55.152+0000 7fa975dfa640 1 --2- 172.21.15.6:0/1937634066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa970158ce0 0x7fa9701533b0 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fa9680af040 tx=0x7fa968019660 comp rx=0 tx=0).stop 2023-07-21T22:57:55.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:55.152+0000 7fa975dfa640 1 -- 172.21.15.6:0/1937634066 shutdown_connections 2023-07-21T22:57:55.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:55.152+0000 7fa975dfa640 1 --2- 172.21.15.6:0/1937634066 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa95c0663a0 0x7fa95c068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:55.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:55.152+0000 7fa975dfa640 1 --2- 172.21.15.6:0/1937634066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa970158ce0 0x7fa9701533b0 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:55.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:55.152+0000 7fa975dfa640 1 --2- 172.21.15.6:0/1937634066 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa9700c9730 0x7fa970156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:55.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:55.152+0000 7fa975dfa640 1 --2- 172.21.15.6:0/1937634066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9700c8ad0 0x7fa9700acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:55.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:55.152+0000 7fa975dfa640 1 -- 172.21.15.6:0/1937634066 >> 172.21.15.6:0/1937634066 conn(0x7fa9700afcf0 msgr2=0x7fa970155580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:55.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:55.152+0000 7fa975dfa640 1 -- 172.21.15.6:0/1937634066 shutdown_connections 2023-07-21T22:57:55.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:55.152+0000 7fa975dfa640 1 -- 172.21.15.6:0/1937634066 wait complete. 2023-07-21T22:57:55.209 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2023-07-21T22:57:55.209 INFO:tasks.cephfs_test_runner: 2023-07-21T22:57:55.210 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-21T22:57:55.210 INFO:tasks.cephfs_test_runner:Ran 10 tests in 2315.109s 2023-07-21T22:57:55.210 INFO:tasks.cephfs_test_runner: 2023-07-21T22:57:55.211 INFO:tasks.cephfs_test_runner:OK 2023-07-21T22:57:55.211 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-07-21T22:57:55.222 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-07-21T22:57:55.230 INFO:tasks.kclient:Unmounting kernel clients... 2023-07-21T22:57:55.230 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:57:55.231 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:57:55.241 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:57:55.241 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-21T22:57:55.241 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:57:55.295 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357776k,nr_inodes=4089444,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12155 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-21T22:57:55.296 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:57:55.296 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:57:55.307 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:57:55.308 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-07-21T22:57:55.308 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T22:57:55.357 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354688k,nr_inodes=4088672,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=12031 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275392k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-21T22:57:55.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:55.357 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T22:57:55.368 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-21T22:57:55.368 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-21T22:57:55.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:55.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-21T22:57:55.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:55.433 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-21T22:57:55.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:55.519 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-07-21T22:57:55.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:55.692 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-21T22:57:55.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:55.703 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-07-21T22:57:55.772 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2023-07-21T22:57:55.774 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:57:55.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:55.775 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-07-21T22:57:55.785 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-21T22:57:55.785 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-21T22:57:55.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:55.786 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-21T22:57:55.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:55.853 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-21T22:57:55.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:55.919 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2023-07-21T22:57:56.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:56.153 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-07-21T22:57:56.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:57:56.164 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2023-07-21T22:57:56.228 INFO:teuthology.orchestra.run.smithi161.stderr:Cannot find device "ceph-brx" 2023-07-21T22:57:56.230 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:57:56.231 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-07-21T22:57:56.242 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-21T22:57:56.242 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:57:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.352+0000 7f1b8e711640 1 Processor -- start 2023-07-21T22:57:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.352+0000 7f1b8e711640 1 -- start start 2023-07-21T22:57:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b8e711640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1b8815fdf0 0x7f1b880c9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b8e711640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b880cb080 con 0x7f1b8815f970 2023-07-21T22:57:56.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b8e711640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b880cb2e0 con 0x7f1b8815bdf0 2023-07-21T22:57:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b8e711640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b880cb5c0 con 0x7f1b8815fdf0 2023-07-21T22:57:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b7ffff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1b8815f970 0x7f1b880c8e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33826/0 (socket says 172.21.15.6:33826) 2023-07-21T22:57:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b7ffff640 1 -- 172.21.15.6:0/3113001443 learned_addr learned my addr 172.21.15.6:0/3113001443 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:56.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b8ccae640 1 --2- 172.21.15.6:0/3113001443 >> v2:172.21.15.161:3300/0 conn(0x7f1b8815fdf0 0x7f1b880c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:56.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b877fe640 1 -- 172.21.15.6:0/3113001443 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1471001245 0 0) 0x7f1b880cb080 con 0x7f1b8815f970 2023-07-21T22:57:56.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b877fe640 1 -- 172.21.15.6:0/3113001443 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b74003530 con 0x7f1b8815f970 2023-07-21T22:57:56.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b877fe640 1 -- 172.21.15.6:0/3113001443 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3232380930 0 0) 0x7f1b74003530 con 0x7f1b8815f970 2023-07-21T22:57:56.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b877fe640 1 -- 172.21.15.6:0/3113001443 >> v2:172.21.15.161:3300/0 conn(0x7f1b8815fdf0 msgr2=0x7f1b880c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:56.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b877fe640 1 --2- 172.21.15.6:0/3113001443 >> v2:172.21.15.161:3300/0 conn(0x7f1b8815fdf0 0x7f1b880c9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:56.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b877fe640 1 -- 172.21.15.6:0/3113001443 >> v1:172.21.15.161:6789/0 conn(0x7f1b8815bdf0 legacy=0x7f1b880ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:56.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b877fe640 1 -- 172.21.15.6:0/3113001443 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b880cb8a0 con 0x7f1b8815f970 2023-07-21T22:57:56.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b877fe640 1 -- 172.21.15.6:0/3113001443 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f1b70001680 con 0x7f1b8815f970 2023-07-21T22:57:56.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b877fe640 1 -- 172.21.15.6:0/3113001443 >> v1:172.21.15.6:6789/0 conn(0x7f1b8815f970 legacy=0x7f1b880c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:56.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b877fe640 1 --2- 172.21.15.6:0/3113001443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b74003980 0x7f1b74003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:56.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b877fe640 1 --2- 172.21.15.6:0/3113001443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b740047d0 0x7f1b74004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:56.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b877fe640 1 --2- 172.21.15.6:0/3113001443 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b74005180 0x7f1b7400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:56.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b877fe640 1 -- 172.21.15.6:0/3113001443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b880cb5c0 con 0x7f1b74003980 2023-07-21T22:57:56.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b877fe640 1 -- 172.21.15.6:0/3113001443 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7400c090 con 0x7f1b740047d0 2023-07-21T22:57:56.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b877fe640 1 -- 172.21.15.6:0/3113001443 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7400c250 con 0x7f1b74005180 2023-07-21T22:57:56.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b87fff640 1 --2- 172.21.15.6:0/3113001443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b74003980 0x7f1b74003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b7ffff640 1 --2- 172.21.15.6:0/3113001443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b740047d0 0x7f1b74004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b8ccae640 1 --2- 172.21.15.6:0/3113001443 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b74005180 0x7f1b7400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b87fff640 1 -- 172.21.15.6:0/3113001443 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b74005180 msgr2=0x7f1b7400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:56.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b87fff640 1 --2- 172.21.15.6:0/3113001443 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b74005180 0x7f1b7400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:56.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b87fff640 1 -- 172.21.15.6:0/3113001443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b740047d0 msgr2=0x7f1b74004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:56.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b87fff640 1 --2- 172.21.15.6:0/3113001443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b740047d0 0x7f1b74004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:56.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b87fff640 1 -- 172.21.15.6:0/3113001443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b74003530 con 0x7f1b74003980 2023-07-21T22:57:56.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b7ffff640 1 --2- 172.21.15.6:0/3113001443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b740047d0 0x7f1b74004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:56.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.356+0000 7f1b8ccae640 1 -- 172.21.15.6:0/3113001443 reap_dead start 2023-07-21T22:57:56.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.360+0000 7f1b87fff640 1 --2- 172.21.15.6:0/3113001443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b74003980 0x7f1b74003d90 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f1b78001780 tx=0x7f1b7801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9dc7da38e1f93c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:56.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.360+0000 7f1b877fe640 1 -- 172.21.15.6:0/3113001443 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b780052d0 con 0x7f1b74003980 2023-07-21T22:57:56.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.360+0000 7f1b877fe640 1 -- 172.21.15.6:0/3113001443 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b780a7050 con 0x7f1b74003980 2023-07-21T22:57:56.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.360+0000 7f1b877fe640 1 -- 172.21.15.6:0/3113001443 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b78003600 con 0x7f1b74003980 2023-07-21T22:57:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.360+0000 7f1b8e711640 1 -- 172.21.15.6:0/3113001443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b74003980 msgr2=0x7f1b74003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.360+0000 7f1b8e711640 1 --2- 172.21.15.6:0/3113001443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b74003980 0x7f1b74003d90 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f1b78001780 tx=0x7f1b7801c3b0 comp rx=0 tx=0).stop 2023-07-21T22:57:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.360+0000 7f1b8e711640 1 -- 172.21.15.6:0/3113001443 shutdown_connections 2023-07-21T22:57:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.360+0000 7f1b8e711640 1 --2- 172.21.15.6:0/3113001443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b74003980 0x7f1b74003d90 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.360+0000 7f1b8e711640 1 -- 172.21.15.6:0/3113001443 >> 172.21.15.6:0/3113001443 conn(0x7f1b880afcf0 msgr2=0x7f1b880b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.360+0000 7f1b8e711640 1 -- 172.21.15.6:0/3113001443 shutdown_connections 2023-07-21T22:57:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.360+0000 7f1b8e711640 1 -- 172.21.15.6:0/3113001443 wait complete. 2023-07-21T22:57:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b8e711640 1 Processor -- start 2023-07-21T22:57:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b8e711640 1 -- start start 2023-07-21T22:57:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b8e711640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b74003980 0x7f1b880c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b8e711640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b880c9bd0 0x7f1b88159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b8e711640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b880b3210 0x7f1b880c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:56.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b8e711640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8815daa0 con 0x7f1b880c9bd0 2023-07-21T22:57:56.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b8e711640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b880b3af0 con 0x7f1b74003980 2023-07-21T22:57:56.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b8e711640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b880b3dd0 con 0x7f1b880b3210 2023-07-21T22:57:56.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b7ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b880c9bd0 0x7f1b88159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:56.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b7ffff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b880c9bd0 0x7f1b88159ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36218/0 (socket says 172.21.15.6:36218) 2023-07-21T22:57:56.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b87fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b74003980 0x7f1b880c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:56.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b7ffff640 1 -- 172.21.15.6:0/2190347047 learned_addr learned my addr 172.21.15.6:0/2190347047 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:56.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b8ccae640 1 --2- 172.21.15.6:0/2190347047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b880b3210 0x7f1b880c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:56.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b7ffff640 1 -- 172.21.15.6:0/2190347047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b880b3210 msgr2=0x7f1b880c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:56.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b7ffff640 1 --2- 172.21.15.6:0/2190347047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b880b3210 0x7f1b880c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:56.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b7ffff640 1 -- 172.21.15.6:0/2190347047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b74003980 msgr2=0x7f1b880c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:56.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b7ffff640 1 --2- 172.21.15.6:0/2190347047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b74003980 0x7f1b880c1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:56.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b7ffff640 1 -- 172.21.15.6:0/2190347047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8815d6c0 con 0x7f1b880c9bd0 2023-07-21T22:57:56.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b7ffff640 1 --2- 172.21.15.6:0/2190347047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b880c9bd0 0x7f1b88159ac0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f1b70007fd0 tx=0x7f1b70007350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:56.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b857fa640 1 -- 172.21.15.6:0/2190347047 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b70011580 con 0x7f1b880c9bd0 2023-07-21T22:57:56.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b857fa640 1 -- 172.21.15.6:0/2190347047 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b700116e0 con 0x7f1b880c9bd0 2023-07-21T22:57:56.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b8e711640 1 -- 172.21.15.6:0/2190347047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8815a000 con 0x7f1b880c9bd0 2023-07-21T22:57:56.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b857fa640 1 -- 172.21.15.6:0/2190347047 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b70011a50 con 0x7f1b880c9bd0 2023-07-21T22:57:56.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b8e711640 1 -- 172.21.15.6:0/2190347047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b880b3830 con 0x7f1b880c9bd0 2023-07-21T22:57:56.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.364+0000 7f1b8e711640 1 -- 172.21.15.6:0/2190347047 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b880678d0 con 0x7f1b880c9bd0 2023-07-21T22:57:56.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.368+0000 7f1b857fa640 1 -- 172.21.15.6:0/2190347047 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1b70011bb0 con 0x7f1b880c9bd0 2023-07-21T22:57:56.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.368+0000 7f1b857fa640 1 --2- 172.21.15.6:0/2190347047 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f1b680663a0 0x7f1b68068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:56.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.368+0000 7f1b857fa640 1 -- 172.21.15.6:0/2190347047 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f1b70083990 con 0x7f1b880c9bd0 2023-07-21T22:57:56.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.368+0000 7f1b87fff640 1 --2- 172.21.15.6:0/2190347047 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f1b680663a0 0x7f1b68068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:56.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.368+0000 7f1b87fff640 1 --2- 172.21.15.6:0/2190347047 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f1b680663a0 0x7f1b68068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1b78001750 tx=0x7f1b780011a0 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:56.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.372+0000 7f1b857fa640 1 -- 172.21.15.6:0/2190347047 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1b70050e10 con 0x7f1b880c9bd0 2023-07-21T22:57:56.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.524+0000 7f1b8e711640 1 -- 172.21.15.6:0/2190347047 --> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b880b4010 con 0x7f1b680663a0 2023-07-21T22:57:56.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.528+0000 7f1b857fa640 1 -- 172.21.15.6:0/2190347047 <== mgr.10231 v2:172.21.15.161:6832/1416042622 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72452 (secure 0 0 0) 0x7f1b880b4010 con 0x7f1b680663a0 2023-07-21T22:57:56.565 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:56.566 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:57:56.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.532+0000 7f1b8e711640 1 -- 172.21.15.6:0/2190347047 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f1b680663a0 msgr2=0x7f1b68068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:56.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.532+0000 7f1b8e711640 1 --2- 172.21.15.6:0/2190347047 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f1b680663a0 0x7f1b68068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1b78001750 tx=0x7f1b780011a0 comp rx=0 tx=0).stop 2023-07-21T22:57:56.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.532+0000 7f1b8e711640 1 -- 172.21.15.6:0/2190347047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b880c9bd0 msgr2=0x7f1b88159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:56.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.532+0000 7f1b8e711640 1 --2- 172.21.15.6:0/2190347047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b880c9bd0 0x7f1b88159ac0 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f1b70007fd0 tx=0x7f1b70007350 comp rx=0 tx=0).stop 2023-07-21T22:57:56.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.532+0000 7f1b8e711640 1 -- 172.21.15.6:0/2190347047 shutdown_connections 2023-07-21T22:57:56.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.532+0000 7f1b8e711640 1 --2- 172.21.15.6:0/2190347047 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f1b680663a0 0x7f1b68068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:56.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.532+0000 7f1b8e711640 1 --2- 172.21.15.6:0/2190347047 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1b880b3210 0x7f1b880c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:56.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.532+0000 7f1b8e711640 1 --2- 172.21.15.6:0/2190347047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b880c9bd0 0x7f1b88159ac0 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:56.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.532+0000 7f1b8e711640 1 --2- 172.21.15.6:0/2190347047 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b74003980 0x7f1b880c1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:56.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.532+0000 7f1b8e711640 1 -- 172.21.15.6:0/2190347047 >> 172.21.15.6:0/2190347047 conn(0x7f1b880afcf0 msgr2=0x7f1b8806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:56.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.532+0000 7f1b8e711640 1 -- 172.21.15.6:0/2190347047 shutdown_connections 2023-07-21T22:57:56.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.532+0000 7f1b8e711640 1 -- 172.21.15.6:0/2190347047 wait complete. 2023-07-21T22:57:56.586 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-07-21T22:57:54.852739+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":364068,"kb_used_data":20580,"kb_used_omap":0,"kb_used_meta":343424,"kb_avail":754610652,"statfs":{"total":773094113280,"available":772721307648,"internally_reserved":0,"allocated":21073920,"data_stored":11572752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":351666176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-669867,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-317,"num_read_kb":-281,"num_write":-284,"num_write_kb":-2057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001258"},"pg_stats":[{"pgid":"1.0","version":"194'348","reported_seq":1301,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.361580+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:57:52.361580+0000","last_peered":"2023-07-21T22:57:52.361580+0000","last_clean":"2023-07-21T22:57:52.361580+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:57:52.361580+0000","last_undegraded":"2023-07-21T22:57:52.361580+0000","last_fullsized":"2023-07-21T22:57:52.361580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:03:32.609855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":365,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.139727+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:57:52.139727+0000","last_peered":"2023-07-21T22:57:52.139727+0000","last_clean":"2023-07-21T22:57:52.139727+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:57:52.139727+0000","last_undegraded":"2023-07-21T22:57:52.139727+0000","last_fullsized":"2023-07-21T22:57:52.139727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:15:17.428686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":326,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.361481+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:57:52.361481+0000","last_peered":"2023-07-21T22:57:52.361481+0000","last_clean":"2023-07-21T22:57:52.361481+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:57:52.361481+0000","last_undegraded":"2023-07-21T22:57:52.361481+0000","last_fullsized":"2023-07-21T22:57:52.361481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:49:16.786704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":329,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.354568+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:57:52.354568+0000","last_peered":"2023-07-21T22:57:52.354568+0000","last_clean":"2023-07-21T22:57:52.354568+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:57:52.354568+0000","last_undegraded":"2023-07-21T22:57:52.354568+0000","last_fullsized":"2023-07-21T22:57:52.354568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:42:41.337652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":365,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.138791+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:57:52.138791+0000","last_peered":"2023-07-21T22:57:52.138791+0000","last_clean":"2023-07-21T22:57:52.138791+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:57:52.138791+0000","last_undegraded":"2023-07-21T22:57:52.138791+0000","last_fullsized":"2023-07-21T22:57:52.138791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:41:29.803880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":343,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.132889+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:57:52.132889+0000","last_peered":"2023-07-21T22:57:52.132889+0000","last_clean":"2023-07-21T22:57:52.132889+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:57:52.132889+0000","last_undegraded":"2023-07-21T22:57:52.132889+0000","last_fullsized":"2023-07-21T22:57:52.132889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:53:24.136788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":325,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.361627+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:57:52.361627+0000","last_peered":"2023-07-21T22:57:52.361627+0000","last_clean":"2023-07-21T22:57:52.361627+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:57:52.361627+0000","last_undegraded":"2023-07-21T22:57:52.361627+0000","last_fullsized":"2023-07-21T22:57:52.361627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:15:06.984719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":343,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.132992+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:57:52.132992+0000","last_peered":"2023-07-21T22:57:52.132992+0000","last_clean":"2023-07-21T22:57:52.132992+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:57:52.132992+0000","last_undegraded":"2023-07-21T22:57:52.132992+0000","last_fullsized":"2023-07-21T22:57:52.132992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:17:43.978687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":323,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.140692+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:57:52.140692+0000","last_peered":"2023-07-21T22:57:52.140692+0000","last_clean":"2023-07-21T22:57:52.140692+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:57:52.140692+0000","last_undegraded":"2023-07-21T22:57:52.140692+0000","last_fullsized":"2023-07-21T22:57:52.140692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:55:10.640049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509905,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64336,"kb_used_data":2952,"kb_used_omap":0,"kb_used_meta":61376,"kb_avail":94307504,"statfs":{"total":96636764160,"available":96570884096,"internally_reserved":0,"allocated":3022848,"data_stored":1842200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":62849024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.35999999999999999,"15min":0.34999999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":1.143},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.44500000000000001,"5min":0.39700000000000002,"15min":0.39000000000000001},"max":{"1min":0.84699999999999998,"5min":0.93200000000000005,"15min":1.0349999999999999},"last":0.71399999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.58499999999999996,"5min":0.48499999999999999,"15min":0.40600000000000003},"max":{"1min":1.0289999999999999,"5min":1.089,"15min":1.089},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.879,"5min":0.94399999999999995,"15min":1.02},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.871,"5min":0.95899999999999996,"15min":1.018},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.42299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98899999999999999,"15min":1.0660000000000001},"last":0.78100000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.77100000000000002},"min":{"1min":0.55100000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97499999999999998,"5min":0.98099999999999998,"15min":1.0980000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.86899999999999999,"5min":0.96599999999999997,"15min":1.026},"last":0.70099999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.89700000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60999999999999999,"15min":0.60399999999999998},"min":{"1min":0.42999999999999999,"5min":0.40300000000000002,"15min":0.34699999999999998},"max":{"1min":0.89900000000000002,"5min":0.91000000000000003,"15min":1.0940000000000001},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.99399999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68600000000000005,"15min":0.67100000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.0429999999999999},"last":0.622}]},{"osd":6,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68200000000000005,"15min":0.67500000000000004},"min":{"1min":0.56799999999999995,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.97399999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.46600000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85199999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.56200000000000006}]}]},{"osd":6,"up_from":14,"seq":60129542611,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37532,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334308,"statfs":{"total":96636764160,"available":96598331392,"internally_reserved":0,"allocated":2445312,"data_stored":1258991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.55000000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93700000000000006,"5min":1.022,"15min":1.024},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.56699999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.0780000000000001},"last":0.82099999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71999999999999997,"15min":0.73199999999999998},"min":{"1min":0.47999999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.89000000000000001,"5min":0.96999999999999997,"15min":1.006},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.754,"15min":0.74299999999999999},"min":{"1min":0.495,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95999999999999996,"5min":1.046,"15min":1.046},"last":0.68700000000000006}]},{"osd":2,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.76900000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90500000000000003,"5min":0.97399999999999998,"15min":1.038},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.80200000000000005},"min":{"1min":0.59499999999999997,"5min":0.438,"15min":0.438},"max":{"1min":0.89100000000000001,"5min":0.98799999999999999,"15min":1.0600000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.749,"15min":0.747},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0029999999999999,"5min":1.089,"15min":1.089},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88700000000000001,"5min":0.96199999999999997,"15min":0.96999999999999997},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.39500000000000002,"5min":0.378,"15min":0.36099999999999999},"max":{"1min":0.72199999999999998,"5min":0.88400000000000001,"15min":0.92300000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.622,"15min":0.60899999999999999},"min":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":0.93799999999999994,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42299999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.437}]},{"osd":7,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.38700000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66300000000000003,"15min":0.66700000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.432},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.96299999999999997},"last":0.45900000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509904,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55576,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316264,"statfs":{"total":96636764160,"available":96579854336,"internally_reserved":0,"allocated":2441216,"data_stored":1252057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.69299999999999995,"15min":0.70199999999999996},"min":{"1min":0.503,"5min":0.46200000000000002,"15min":0.32100000000000001},"max":{"1min":0.90700000000000003,"5min":1.044,"15min":1.044},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.75600000000000001,"15min":0.73599999999999999},"min":{"1min":0.49199999999999999,"5min":0.432,"15min":0.41499999999999998},"max":{"1min":3.2280000000000002,"5min":3.2280000000000002,"15min":3.2280000000000002},"last":0.83299999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.75,"15min":0.73899999999999999},"min":{"1min":0.51300000000000001,"5min":0.439,"15min":0.42399999999999999},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.505,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86299999999999999,"5min":1.038,"15min":1.054},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.77100000000000002,"15min":0.75800000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.3159999999999998,"5min":3.3159999999999998,"15min":3.3159999999999998},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.747,"15min":0.74299999999999999},"min":{"1min":0.56999999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.81799999999999995,"15min":0.79300000000000004},"min":{"1min":0.58899999999999997,"5min":0.55900000000000005,"15min":0.47299999999999998},"max":{"1min":3.3540000000000001,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.65300000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.81299999999999994}]},{"osd":4,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57699999999999996,"15min":0.55900000000000005},"min":{"1min":0.443,"5min":0.373,"15min":0.34599999999999997},"max":{"1min":0.86499999999999999,"5min":0.86899999999999999,"15min":0.91300000000000003},"last":0.5},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.71299999999999997,"15min":0.69099999999999995},"min":{"1min":0.496,"5min":0.47399999999999998,"15min":0.46700000000000003},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":0.66900000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.60899999999999999,"15min":0.59299999999999997},"min":{"1min":0.46600000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.754},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.61299999999999999,"15min":0.60199999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.39400000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.77400000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.67000000000000004,"15min":0.65000000000000002},"min":{"1min":0.46400000000000002,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":3.3889999999999998,"5min":3.3889999999999998,"15min":3.3889999999999998},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.754,"15min":0.72499999999999998},"min":{"1min":0.54800000000000004,"5min":0.496,"15min":0.45900000000000002},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.85499999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509905,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37532,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334308,"statfs":{"total":96636764160,"available":96598331392,"internally_reserved":0,"allocated":2445312,"data_stored":1258991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.34599999999999997},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.76900000000000002},"min":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.35299999999999998},"max":{"1min":1.3500000000000001,"5min":1.488,"15min":1.488},"last":0.72199999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.52700000000000002,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":2.7320000000000002,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.80300000000000005,"15min":0.78800000000000003},"min":{"1min":0.62,"5min":0.60699999999999998,"15min":0.46899999999999997},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.878,"5min":0.79800000000000004,"15min":0.78600000000000003},"min":{"1min":0.623,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":0.753}]},{"osd":3,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.78800000000000003,"15min":0.75600000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.0169999999999999,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82299999999999995,"15min":0.81599999999999995},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.93200000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73299999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.44500000000000001,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.151},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.57899999999999996,"5min":0.45800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94999999999999996,"5min":0.96299999999999997,"15min":1.252},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.44400000000000001,"15min":0.437},"max":{"1min":1.006,"5min":1.006,"15min":1.0609999999999999},"last":0.87}]},{"osd":7,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68300000000000005,"15min":0.66000000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.39500000000000002},"max":{"1min":1.0189999999999999,"5min":1.526,"15min":1.526},"last":0.88},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.53600000000000003,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.99099999999999999,"5min":1.0820000000000001,"15min":1.206},"last":0.98399999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509904,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37868,"kb_used_data":2724,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333972,"statfs":{"total":96636764160,"available":96597987328,"internally_reserved":0,"allocated":2789376,"data_stored":1593172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.503,"15min":0.496},"min":{"1min":0.29899999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57899999999999996,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.376},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.65100000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53300000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.35299999999999998,"5min":0.317,"15min":0.312},"max":{"1min":0.72999999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79700000000000004,"5min":0.81799999999999995,"15min":0.88100000000000001},"last":0.438}]},{"osd":2,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.80000000000000004,"5min":0.83199999999999996,"15min":0.84699999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.36899999999999999,"15min":0.36299999999999999},"max":{"1min":0.78600000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58699999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77600000000000002,"15min":0.77900000000000003},"min":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.441},"max":{"1min":1.046,"5min":1.101,"15min":1.244},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.84399999999999997},"min":{"1min":0.58099999999999996,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.877}]},{"osd":5,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.57099999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.59499999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.006,"5min":1.087,"15min":1.2230000000000001},"last":0.78800000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81200000000000006,"15min":0.80600000000000005},"min":{"1min":0.58799999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0820000000000001,"5min":1.127,"15min":1.147},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78500000000000003,"15min":0.78600000000000003},"min":{"1min":0.56799999999999995,"5min":0.55100000000000005,"15min":0.53000000000000003},"max":{"1min":1.296,"5min":1.296,"15min":1.3660000000000001},"last":0.81699999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83299999999999996,"15min":0.82999999999999996},"min":{"1min":0.624,"5min":0.55000000000000004,"15min":0.50900000000000001},"max":{"1min":1.175,"5min":1.175,"15min":1.4510000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82799999999999996,"15min":0.84299999999999997},"min":{"1min":0.61499999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.427},"last":0.77400000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509906,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55580,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316260,"statfs":{"total":96636764160,"available":96579850240,"internally_reserved":0,"allocated":2445312,"data_stored":1258991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.52700000000000002,"15min":0.51000000000000001},"min":{"1min":0.33400000000000002,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.45900000000000002,"5min":0.38,"15min":0.377},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.61199999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.35599999999999998},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.47199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.64700000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.499},"min":{"1min":0.379,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69399999999999995,"5min":0.73099999999999998,"15min":0.92800000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.60599999999999998,"15min":0.59399999999999997},"min":{"1min":0.53400000000000003,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.63}]},{"osd":4,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.82499999999999996,"15min":0.82599999999999996},"min":{"1min":0.66000000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.55900000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1240000000000001,"5min":1.1359999999999999,"15min":1.391},"last":0.99399999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.67200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.82599999999999996,"15min":0.83699999999999997},"min":{"1min":0.57699999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.876}]},{"osd":6,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.80000000000000004,"15min":0.81899999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1220000000000001,"5min":1.1499999999999999,"15min":1.2969999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.84399999999999997,"15min":0.84699999999999998},"min":{"1min":0.63600000000000001,"5min":0.59999999999999998,"15min":0.55600000000000005},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.86599999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.84399999999999997,"15min":0.85099999999999998},"min":{"1min":0.748,"5min":0.62,"15min":0.56000000000000005},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81999999999999995,"15min":0.84399999999999997},"min":{"1min":0.59599999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"max":{"1min":1.1679999999999999,"5min":1.2749999999999999,"15min":1.3939999999999999},"last":0.89400000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509905,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37532,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334308,"statfs":{"total":96636764160,"available":96598331392,"internally_reserved":0,"allocated":2445312,"data_stored":1258991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.255,"5min":0.251,"15min":0.251},"max":{"1min":0.77500000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.69399999999999995,"5min":1.149,"15min":1.149},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.496,"15min":0.52100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66900000000000004,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":1.21,"15min":1.21},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59399999999999997,"15min":0.60899999999999999},"min":{"1min":0.42499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77100000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.505,"15min":0.52000000000000002},"min":{"1min":0.34100000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.34300000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76600000000000001,"15min":0.79600000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.46500000000000002},"max":{"1min":1.046,"5min":1.222,"15min":1.3819999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.62,"5min":0.58699999999999997,"15min":0.53400000000000003},"max":{"1min":1.2150000000000001,"5min":1.2849999999999999,"15min":1.302},"last":0.82999999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.78200000000000003,"15min":0.80400000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0189999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77900000000000003,"15min":0.80600000000000005},"min":{"1min":0.53900000000000003,"5min":0.52800000000000002,"15min":0.48799999999999999},"max":{"1min":1.107,"5min":1.171,"15min":1.3100000000000001},"last":0.878}]},{"osd":6,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.81399999999999995,"15min":0.82399999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.149,"5min":1.3300000000000001,"15min":1.3500000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77200000000000002,"15min":0.80700000000000005},"min":{"1min":0.55800000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.169,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.80900000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78400000000000003,"15min":0.82399999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0700000000000001,"5min":1.2569999999999999,"15min":1.4930000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.55000000000000004},"max":{"1min":1.1899999999999999,"5min":1.292,"15min":1.4430000000000001},"last":0.94599999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509907,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38112,"kb_used_data":2968,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333728,"statfs":{"total":96636764160,"available":96597737472,"internally_reserved":0,"allocated":3039232,"data_stored":1849359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.498,"15min":0.48799999999999999},"min":{"1min":0.317,"5min":0.29999999999999999,"15min":0.28499999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.498},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54300000000000004,"15min":0.54000000000000004},"min":{"1min":0.40000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.36499999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33900000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.58799999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.627,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.41399999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.629,"5min":0.51200000000000001,"15min":0.51000000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.4370000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.82999999999999996,"15min":0.82699999999999996},"min":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.83199999999999996,"15min":0.82199999999999995},"min":{"1min":0.63500000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2130000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.87,"15min":0.84899999999999998},"min":{"1min":0.628,"5min":0.497,"15min":0.497},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.351},"last":0.76700000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.58499999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.627,"5min":0.60699999999999998,"15min":0.60299999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.73399999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.83499999999999996,"15min":0.83199999999999996},"min":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"max":{"1min":1.1699999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.877,"15min":0.873},"min":{"1min":0.64900000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.411},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:57:56.589 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:57:56.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.700+0000 7ff798aa1640 1 Processor -- start 2023-07-21T22:57:56.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.700+0000 7ff798aa1640 1 -- start start 2023-07-21T22:57:56.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.700+0000 7ff798aa1640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7940b7d90 0x7ff7940cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:56.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.700+0000 7ff798aa1640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7940d0f60 con 0x7ff7940d13f0 2023-07-21T22:57:56.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.700+0000 7ff798aa1640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7940d0390 con 0x7ff79415f3f0 2023-07-21T22:57:56.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.700+0000 7ff798aa1640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7940d0630 con 0x7ff7940b7d90 2023-07-21T22:57:56.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.700+0000 7ff792ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff7940b7d90 0x7ff7940cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:56.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.700+0000 7ff793fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff7940d13f0 0x7ff7940ccee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33828/0 (socket says 172.21.15.6:33828) 2023-07-21T22:57:56.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.700+0000 7ff793fff640 1 -- 172.21.15.6:0/3937925012 learned_addr learned my addr 172.21.15.6:0/3937925012 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:56.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.700+0000 7ff792ffd640 1 -- 172.21.15.6:0/3937925012 >> v1:172.21.15.161:6789/0 conn(0x7ff79415f3f0 legacy=0x7ff7940b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:56.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.700+0000 7ff792ffd640 1 -- 172.21.15.6:0/3937925012 >> v1:172.21.15.6:6789/0 conn(0x7ff7940d13f0 legacy=0x7ff7940ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:56.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.700+0000 7ff792ffd640 1 -- 172.21.15.6:0/3937925012 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7940d0910 con 0x7ff7940b7d90 2023-07-21T22:57:56.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.704+0000 7ff792ffd640 1 --2- 172.21.15.6:0/3937925012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7940b7d90 0x7ff7940cc9a0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7ff7880097c0 tx=0x7ff78801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b377009bc5ff8e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:56.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.704+0000 7ff7927fc640 1 -- 172.21.15.6:0/3937925012 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7880ab600 con 0x7ff7940b7d90 2023-07-21T22:57:56.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.704+0000 7ff7927fc640 1 -- 172.21.15.6:0/3937925012 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7880a7050 con 0x7ff7940b7d90 2023-07-21T22:57:56.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.704+0000 7ff7927fc640 1 -- 172.21.15.6:0/3937925012 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7880ab980 con 0x7ff7940b7d90 2023-07-21T22:57:56.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.704+0000 7ff798aa1640 1 -- 172.21.15.6:0/3937925012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7940b7d90 msgr2=0x7ff7940cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:56.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.704+0000 7ff798aa1640 1 --2- 172.21.15.6:0/3937925012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7940b7d90 0x7ff7940cc9a0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7ff7880097c0 tx=0x7ff78801c3f0 comp rx=0 tx=0).stop 2023-07-21T22:57:56.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.704+0000 7ff798aa1640 1 -- 172.21.15.6:0/3937925012 shutdown_connections 2023-07-21T22:57:56.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.704+0000 7ff798aa1640 1 --2- 172.21.15.6:0/3937925012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7940b7d90 0x7ff7940cc9a0 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:56.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.704+0000 7ff798aa1640 1 -- 172.21.15.6:0/3937925012 >> 172.21.15.6:0/3937925012 conn(0x7ff794069f50 msgr2=0x7ff79406a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:56.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.704+0000 7ff798aa1640 1 -- 172.21.15.6:0/3937925012 shutdown_connections 2023-07-21T22:57:56.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.704+0000 7ff798aa1640 1 -- 172.21.15.6:0/3937925012 wait complete. 2023-07-21T22:57:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.704+0000 7ff798aa1640 1 Processor -- start 2023-07-21T22:57:56.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff798aa1640 1 -- start start 2023-07-21T22:57:56.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff798aa1640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7940b7d90 0x7ff794150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:56.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff798aa1640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7940d13f0 0x7ff7940c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:56.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff798aa1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff79415f3f0 0x7ff7940c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:56.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff798aa1640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7940c8610 con 0x7ff7940d13f0 2023-07-21T22:57:56.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff798aa1640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff794151f30 con 0x7ff79415f3f0 2023-07-21T22:57:56.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff798aa1640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7940b4030 con 0x7ff7940b7d90 2023-07-21T22:57:56.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff792ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7940d13f0 0x7ff7940c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:56.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff792ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7940d13f0 0x7ff7940c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36248/0 (socket says 172.21.15.6:36248) 2023-07-21T22:57:56.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff792ffd640 1 -- 172.21.15.6:0/344631504 learned_addr learned my addr 172.21.15.6:0/344631504 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:56.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff793fff640 1 --2- 172.21.15.6:0/344631504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff79415f3f0 0x7ff7940c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:56.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff7937fe640 1 --2- 172.21.15.6:0/344631504 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7940b7d90 0x7ff794150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:56.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff792ffd640 1 -- 172.21.15.6:0/344631504 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7940b7d90 msgr2=0x7ff794150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:56.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff792ffd640 1 --2- 172.21.15.6:0/344631504 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7940b7d90 0x7ff794150a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:56.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff792ffd640 1 -- 172.21.15.6:0/344631504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff79415f3f0 msgr2=0x7ff7940c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:56.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff792ffd640 1 --2- 172.21.15.6:0/344631504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff79415f3f0 0x7ff7940c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:56.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff792ffd640 1 -- 172.21.15.6:0/344631504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff788009420 con 0x7ff7940d13f0 2023-07-21T22:57:56.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff7937fe640 1 --2- 172.21.15.6:0/344631504 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7940b7d90 0x7ff794150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:56.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff792ffd640 1 --2- 172.21.15.6:0/344631504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7940d13f0 0x7ff7940c7b90 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7ff7880097c0 tx=0x7ff78801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:56.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff77bfff640 1 -- 172.21.15.6:0/344631504 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7880b7650 con 0x7ff7940d13f0 2023-07-21T22:57:56.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff77bfff640 1 -- 172.21.15.6:0/344631504 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7880abe90 con 0x7ff7940d13f0 2023-07-21T22:57:56.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff798aa1640 1 -- 172.21.15.6:0/344631504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff794152180 con 0x7ff7940d13f0 2023-07-21T22:57:56.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff77bfff640 1 -- 172.21.15.6:0/344631504 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7880b7a10 con 0x7ff7940d13f0 2023-07-21T22:57:56.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff798aa1640 1 -- 172.21.15.6:0/344631504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff794152740 con 0x7ff7940d13f0 2023-07-21T22:57:56.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.708+0000 7ff798aa1640 1 -- 172.21.15.6:0/344631504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff794152930 con 0x7ff7940d13f0 2023-07-21T22:57:56.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.712+0000 7ff77bfff640 1 -- 172.21.15.6:0/344631504 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff7880b7b70 con 0x7ff7940d13f0 2023-07-21T22:57:56.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.712+0000 7ff77bfff640 1 --2- 172.21.15.6:0/344631504 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff7800663a0 0x7ff780068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:56.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.712+0000 7ff77bfff640 1 -- 172.21.15.6:0/344631504 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7ff78811ea90 con 0x7ff7940d13f0 2023-07-21T22:57:56.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.712+0000 7ff7937fe640 1 --2- 172.21.15.6:0/344631504 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff7800663a0 0x7ff780068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:56.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.712+0000 7ff7937fe640 1 --2- 172.21.15.6:0/344631504 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff7800663a0 0x7ff780068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff784001670 tx=0x7ff784009040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:56.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.716+0000 7ff77bfff640 1 -- 172.21.15.6:0/344631504 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff7880ebd40 con 0x7ff7940d13f0 2023-07-21T22:57:56.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.868+0000 7ff798aa1640 1 -- 172.21.15.6:0/344631504 --> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff79414f070 con 0x7ff7800663a0 2023-07-21T22:57:56.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.872+0000 7ff77bfff640 1 -- 172.21.15.6:0/344631504 <== mgr.10231 v2:172.21.15.161:6832/1416042622 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72452 (secure 0 0 0) 0x7ff7840012f0 con 0x7ff7800663a0 2023-07-21T22:57:56.908 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:56.908 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:57:56.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.872+0000 7ff798aa1640 1 -- 172.21.15.6:0/344631504 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff7800663a0 msgr2=0x7ff780068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:56.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.872+0000 7ff798aa1640 1 --2- 172.21.15.6:0/344631504 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff7800663a0 0x7ff780068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff784001670 tx=0x7ff784009040 comp rx=0 tx=0).stop 2023-07-21T22:57:56.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.872+0000 7ff798aa1640 1 -- 172.21.15.6:0/344631504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7940d13f0 msgr2=0x7ff7940c7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:56.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.872+0000 7ff798aa1640 1 --2- 172.21.15.6:0/344631504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7940d13f0 0x7ff7940c7b90 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7ff7880097c0 tx=0x7ff78801ac30 comp rx=0 tx=0).stop 2023-07-21T22:57:56.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.872+0000 7ff798aa1640 1 -- 172.21.15.6:0/344631504 shutdown_connections 2023-07-21T22:57:56.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.872+0000 7ff798aa1640 1 --2- 172.21.15.6:0/344631504 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff7800663a0 0x7ff780068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:56.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.872+0000 7ff798aa1640 1 --2- 172.21.15.6:0/344631504 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff79415f3f0 0x7ff7940c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:56.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.872+0000 7ff798aa1640 1 --2- 172.21.15.6:0/344631504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7940d13f0 0x7ff7940c7b90 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:56.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.872+0000 7ff798aa1640 1 --2- 172.21.15.6:0/344631504 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff7940b7d90 0x7ff794150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:56.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.872+0000 7ff798aa1640 1 -- 172.21.15.6:0/344631504 >> 172.21.15.6:0/344631504 conn(0x7ff794069f50 msgr2=0x7ff7940ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:56.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.872+0000 7ff798aa1640 1 -- 172.21.15.6:0/344631504 shutdown_connections 2023-07-21T22:57:56.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:56.872+0000 7ff798aa1640 1 -- 172.21.15.6:0/344631504 wait complete. 2023-07-21T22:57:56.928 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-07-21T22:57:56.853223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":364068,"kb_used_data":20580,"kb_used_omap":0,"kb_used_meta":343424,"kb_avail":754610652,"statfs":{"total":773094113280,"available":772721307648,"internally_reserved":0,"allocated":21073920,"data_stored":11572752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":351666176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-669867,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-317,"num_read_kb":-281,"num_write":-284,"num_write_kb":-2057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.816481"},"pg_stats":[{"pgid":"1.0","version":"194'348","reported_seq":1301,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.361580+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:57:52.361580+0000","last_peered":"2023-07-21T22:57:52.361580+0000","last_clean":"2023-07-21T22:57:52.361580+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:57:52.361580+0000","last_undegraded":"2023-07-21T22:57:52.361580+0000","last_fullsized":"2023-07-21T22:57:52.361580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:03:32.609855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":365,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.139727+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:57:52.139727+0000","last_peered":"2023-07-21T22:57:52.139727+0000","last_clean":"2023-07-21T22:57:52.139727+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:57:52.139727+0000","last_undegraded":"2023-07-21T22:57:52.139727+0000","last_fullsized":"2023-07-21T22:57:52.139727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:15:17.428686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":326,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.361481+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:57:52.361481+0000","last_peered":"2023-07-21T22:57:52.361481+0000","last_clean":"2023-07-21T22:57:52.361481+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:57:52.361481+0000","last_undegraded":"2023-07-21T22:57:52.361481+0000","last_fullsized":"2023-07-21T22:57:52.361481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:49:16.786704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":329,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.354568+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:57:52.354568+0000","last_peered":"2023-07-21T22:57:52.354568+0000","last_clean":"2023-07-21T22:57:52.354568+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:57:52.354568+0000","last_undegraded":"2023-07-21T22:57:52.354568+0000","last_fullsized":"2023-07-21T22:57:52.354568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:42:41.337652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":365,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.138791+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:57:52.138791+0000","last_peered":"2023-07-21T22:57:52.138791+0000","last_clean":"2023-07-21T22:57:52.138791+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:57:52.138791+0000","last_undegraded":"2023-07-21T22:57:52.138791+0000","last_fullsized":"2023-07-21T22:57:52.138791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:41:29.803880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":343,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.132889+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:57:52.132889+0000","last_peered":"2023-07-21T22:57:52.132889+0000","last_clean":"2023-07-21T22:57:52.132889+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:57:52.132889+0000","last_undegraded":"2023-07-21T22:57:52.132889+0000","last_fullsized":"2023-07-21T22:57:52.132889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:53:24.136788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":325,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.361627+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:57:52.361627+0000","last_peered":"2023-07-21T22:57:52.361627+0000","last_clean":"2023-07-21T22:57:52.361627+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:57:52.361627+0000","last_undegraded":"2023-07-21T22:57:52.361627+0000","last_fullsized":"2023-07-21T22:57:52.361627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:15:06.984719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":343,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.132992+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:57:52.132992+0000","last_peered":"2023-07-21T22:57:52.132992+0000","last_clean":"2023-07-21T22:57:52.132992+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:57:52.132992+0000","last_undegraded":"2023-07-21T22:57:52.132992+0000","last_fullsized":"2023-07-21T22:57:52.132992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:17:43.978687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":323,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.140692+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:57:52.140692+0000","last_peered":"2023-07-21T22:57:52.140692+0000","last_clean":"2023-07-21T22:57:52.140692+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:57:52.140692+0000","last_undegraded":"2023-07-21T22:57:52.140692+0000","last_fullsized":"2023-07-21T22:57:52.140692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:55:10.640049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509905,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64336,"kb_used_data":2952,"kb_used_omap":0,"kb_used_meta":61376,"kb_avail":94307504,"statfs":{"total":96636764160,"available":96570884096,"internally_reserved":0,"allocated":3022848,"data_stored":1842200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":62849024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.35999999999999999,"15min":0.34999999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":1.143},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.44500000000000001,"5min":0.39700000000000002,"15min":0.39000000000000001},"max":{"1min":0.84699999999999998,"5min":0.93200000000000005,"15min":1.0349999999999999},"last":0.71399999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.58499999999999996,"5min":0.48499999999999999,"15min":0.40600000000000003},"max":{"1min":1.0289999999999999,"5min":1.089,"15min":1.089},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.879,"5min":0.94399999999999995,"15min":1.02},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.871,"5min":0.95899999999999996,"15min":1.018},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.42299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98899999999999999,"15min":1.0660000000000001},"last":0.78100000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.77100000000000002},"min":{"1min":0.55100000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97499999999999998,"5min":0.98099999999999998,"15min":1.0980000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.86899999999999999,"5min":0.96599999999999997,"15min":1.026},"last":0.70099999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.89700000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60999999999999999,"15min":0.60399999999999998},"min":{"1min":0.42999999999999999,"5min":0.40300000000000002,"15min":0.34699999999999998},"max":{"1min":0.89900000000000002,"5min":0.91000000000000003,"15min":1.0940000000000001},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.99399999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68600000000000005,"15min":0.67100000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.0429999999999999},"last":0.622}]},{"osd":6,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68200000000000005,"15min":0.67500000000000004},"min":{"1min":0.56799999999999995,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.97399999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.46600000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85199999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.56200000000000006}]}]},{"osd":6,"up_from":14,"seq":60129542611,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37532,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334308,"statfs":{"total":96636764160,"available":96598331392,"internally_reserved":0,"allocated":2445312,"data_stored":1258991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.55000000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93700000000000006,"5min":1.022,"15min":1.024},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.56699999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.0780000000000001},"last":0.82099999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71999999999999997,"15min":0.73199999999999998},"min":{"1min":0.47999999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.89000000000000001,"5min":0.96999999999999997,"15min":1.006},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.754,"15min":0.74299999999999999},"min":{"1min":0.495,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95999999999999996,"5min":1.046,"15min":1.046},"last":0.68700000000000006}]},{"osd":2,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.76900000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90500000000000003,"5min":0.97399999999999998,"15min":1.038},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.80200000000000005},"min":{"1min":0.59499999999999997,"5min":0.438,"15min":0.438},"max":{"1min":0.89100000000000001,"5min":0.98799999999999999,"15min":1.0600000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.749,"15min":0.747},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0029999999999999,"5min":1.089,"15min":1.089},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88700000000000001,"5min":0.96199999999999997,"15min":0.96999999999999997},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.39500000000000002,"5min":0.378,"15min":0.36099999999999999},"max":{"1min":0.72199999999999998,"5min":0.88400000000000001,"15min":0.92300000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.622,"15min":0.60899999999999999},"min":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":0.93799999999999994,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42299999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.437}]},{"osd":7,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.38700000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66300000000000003,"15min":0.66700000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.432},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.96299999999999997},"last":0.45900000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509904,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55576,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316264,"statfs":{"total":96636764160,"available":96579854336,"internally_reserved":0,"allocated":2441216,"data_stored":1252057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.69299999999999995,"15min":0.70199999999999996},"min":{"1min":0.503,"5min":0.46200000000000002,"15min":0.32100000000000001},"max":{"1min":0.90700000000000003,"5min":1.044,"15min":1.044},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.75600000000000001,"15min":0.73599999999999999},"min":{"1min":0.49199999999999999,"5min":0.432,"15min":0.41499999999999998},"max":{"1min":3.2280000000000002,"5min":3.2280000000000002,"15min":3.2280000000000002},"last":0.83299999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.75,"15min":0.73899999999999999},"min":{"1min":0.51300000000000001,"5min":0.439,"15min":0.42399999999999999},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.505,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86299999999999999,"5min":1.038,"15min":1.054},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.77100000000000002,"15min":0.75800000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.3159999999999998,"5min":3.3159999999999998,"15min":3.3159999999999998},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.747,"15min":0.74299999999999999},"min":{"1min":0.56999999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.81799999999999995,"15min":0.79300000000000004},"min":{"1min":0.58899999999999997,"5min":0.55900000000000005,"15min":0.47299999999999998},"max":{"1min":3.3540000000000001,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.65300000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.81299999999999994}]},{"osd":4,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57699999999999996,"15min":0.55900000000000005},"min":{"1min":0.443,"5min":0.373,"15min":0.34599999999999997},"max":{"1min":0.86499999999999999,"5min":0.86899999999999999,"15min":0.91300000000000003},"last":0.5},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.71299999999999997,"15min":0.69099999999999995},"min":{"1min":0.496,"5min":0.47399999999999998,"15min":0.46700000000000003},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":0.66900000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.60899999999999999,"15min":0.59299999999999997},"min":{"1min":0.46600000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.754},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.61299999999999999,"15min":0.60199999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.39400000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.77400000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.67000000000000004,"15min":0.65000000000000002},"min":{"1min":0.46400000000000002,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":3.3889999999999998,"5min":3.3889999999999998,"15min":3.3889999999999998},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.754,"15min":0.72499999999999998},"min":{"1min":0.54800000000000004,"5min":0.496,"15min":0.45900000000000002},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.85499999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509905,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37532,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334308,"statfs":{"total":96636764160,"available":96598331392,"internally_reserved":0,"allocated":2445312,"data_stored":1258991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.34599999999999997},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.76900000000000002},"min":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.35299999999999998},"max":{"1min":1.3500000000000001,"5min":1.488,"15min":1.488},"last":0.72199999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.52700000000000002,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":2.7320000000000002,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.80300000000000005,"15min":0.78800000000000003},"min":{"1min":0.62,"5min":0.60699999999999998,"15min":0.46899999999999997},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.878,"5min":0.79800000000000004,"15min":0.78600000000000003},"min":{"1min":0.623,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":0.753}]},{"osd":3,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.78800000000000003,"15min":0.75600000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.0169999999999999,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82299999999999995,"15min":0.81599999999999995},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.93200000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73299999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.44500000000000001,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.151},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.57899999999999996,"5min":0.45800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94999999999999996,"5min":0.96299999999999997,"15min":1.252},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.44400000000000001,"15min":0.437},"max":{"1min":1.006,"5min":1.006,"15min":1.0609999999999999},"last":0.87}]},{"osd":7,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68300000000000005,"15min":0.66000000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.39500000000000002},"max":{"1min":1.0189999999999999,"5min":1.526,"15min":1.526},"last":0.88},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.53600000000000003,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.99099999999999999,"5min":1.0820000000000001,"15min":1.206},"last":0.98399999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509904,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37868,"kb_used_data":2724,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333972,"statfs":{"total":96636764160,"available":96597987328,"internally_reserved":0,"allocated":2789376,"data_stored":1593172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.503,"15min":0.496},"min":{"1min":0.29899999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57899999999999996,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.376},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.65100000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53300000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.35299999999999998,"5min":0.317,"15min":0.312},"max":{"1min":0.72999999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79700000000000004,"5min":0.81799999999999995,"15min":0.88100000000000001},"last":0.438}]},{"osd":2,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.80000000000000004,"5min":0.83199999999999996,"15min":0.84699999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.36899999999999999,"15min":0.36299999999999999},"max":{"1min":0.78600000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58699999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77600000000000002,"15min":0.77900000000000003},"min":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.441},"max":{"1min":1.046,"5min":1.101,"15min":1.244},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.84399999999999997},"min":{"1min":0.58099999999999996,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.877}]},{"osd":5,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.57099999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.59499999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.006,"5min":1.087,"15min":1.2230000000000001},"last":0.78800000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81200000000000006,"15min":0.80600000000000005},"min":{"1min":0.58799999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0820000000000001,"5min":1.127,"15min":1.147},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78500000000000003,"15min":0.78600000000000003},"min":{"1min":0.56799999999999995,"5min":0.55100000000000005,"15min":0.53000000000000003},"max":{"1min":1.296,"5min":1.296,"15min":1.3660000000000001},"last":0.81699999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83299999999999996,"15min":0.82999999999999996},"min":{"1min":0.624,"5min":0.55000000000000004,"15min":0.50900000000000001},"max":{"1min":1.175,"5min":1.175,"15min":1.4510000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82799999999999996,"15min":0.84299999999999997},"min":{"1min":0.61499999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.427},"last":0.77400000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509906,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55580,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316260,"statfs":{"total":96636764160,"available":96579850240,"internally_reserved":0,"allocated":2445312,"data_stored":1258991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.52700000000000002,"15min":0.51000000000000001},"min":{"1min":0.33400000000000002,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.45900000000000002,"5min":0.38,"15min":0.377},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.61199999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.35599999999999998},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.47199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.64700000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.499},"min":{"1min":0.379,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69399999999999995,"5min":0.73099999999999998,"15min":0.92800000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.60599999999999998,"15min":0.59399999999999997},"min":{"1min":0.53400000000000003,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.63}]},{"osd":4,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.82499999999999996,"15min":0.82599999999999996},"min":{"1min":0.66000000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.55900000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1240000000000001,"5min":1.1359999999999999,"15min":1.391},"last":0.99399999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.67200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.82599999999999996,"15min":0.83699999999999997},"min":{"1min":0.57699999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.876}]},{"osd":6,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.80000000000000004,"15min":0.81899999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1220000000000001,"5min":1.1499999999999999,"15min":1.2969999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.84399999999999997,"15min":0.84699999999999998},"min":{"1min":0.63600000000000001,"5min":0.59999999999999998,"15min":0.55600000000000005},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.86599999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.84399999999999997,"15min":0.85099999999999998},"min":{"1min":0.748,"5min":0.62,"15min":0.56000000000000005},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81999999999999995,"15min":0.84399999999999997},"min":{"1min":0.59599999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"max":{"1min":1.1679999999999999,"5min":1.2749999999999999,"15min":1.3939999999999999},"last":0.89400000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509905,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37532,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334308,"statfs":{"total":96636764160,"available":96598331392,"internally_reserved":0,"allocated":2445312,"data_stored":1258991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.255,"5min":0.251,"15min":0.251},"max":{"1min":0.77500000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.69399999999999995,"5min":1.149,"15min":1.149},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.496,"15min":0.52100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66900000000000004,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":1.21,"15min":1.21},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59399999999999997,"15min":0.60899999999999999},"min":{"1min":0.42499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77100000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.505,"15min":0.52000000000000002},"min":{"1min":0.34100000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.34300000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76600000000000001,"15min":0.79600000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.46500000000000002},"max":{"1min":1.046,"5min":1.222,"15min":1.3819999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.62,"5min":0.58699999999999997,"15min":0.53400000000000003},"max":{"1min":1.2150000000000001,"5min":1.2849999999999999,"15min":1.302},"last":0.82999999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.78200000000000003,"15min":0.80400000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0189999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77900000000000003,"15min":0.80600000000000005},"min":{"1min":0.53900000000000003,"5min":0.52800000000000002,"15min":0.48799999999999999},"max":{"1min":1.107,"5min":1.171,"15min":1.3100000000000001},"last":0.878}]},{"osd":6,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.81399999999999995,"15min":0.82399999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.149,"5min":1.3300000000000001,"15min":1.3500000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77200000000000002,"15min":0.80700000000000005},"min":{"1min":0.55800000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.169,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.80900000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78400000000000003,"15min":0.82399999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0700000000000001,"5min":1.2569999999999999,"15min":1.4930000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.55000000000000004},"max":{"1min":1.1899999999999999,"5min":1.292,"15min":1.4430000000000001},"last":0.94599999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509907,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38112,"kb_used_data":2968,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333728,"statfs":{"total":96636764160,"available":96597737472,"internally_reserved":0,"allocated":3039232,"data_stored":1849359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.498,"15min":0.48799999999999999},"min":{"1min":0.317,"5min":0.29999999999999999,"15min":0.28499999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.498},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54300000000000004,"15min":0.54000000000000004},"min":{"1min":0.40000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.36499999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33900000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.58799999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.627,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.41399999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.629,"5min":0.51200000000000001,"15min":0.51000000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.4370000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.82999999999999996,"15min":0.82699999999999996},"min":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.83199999999999996,"15min":0.82199999999999995},"min":{"1min":0.63500000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2130000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.87,"15min":0.84899999999999998},"min":{"1min":0.628,"5min":0.497,"15min":0.497},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.351},"last":0.76700000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.58499999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.627,"5min":0.60699999999999998,"15min":0.60299999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.73399999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.83499999999999996,"15min":0.83199999999999996},"min":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"max":{"1min":1.1699999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.877,"15min":0.873},"min":{"1min":0.64900000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.411},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:57:56.930 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-21T22:57:56.931 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:57:57.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.040+0000 7f52efc34640 1 Processor -- start 2023-07-21T22:57:57.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.040+0000 7f52efc34640 1 -- start start 2023-07-21T22:57:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.040+0000 7f52efc34640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52e815fd60 0x7f52e80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:57.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.040+0000 7f52efc34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52e80d1850 0x7f52e80d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:57.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.040+0000 7f52efc34640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e80ccaf0 con 0x7f52e80b7c70 2023-07-21T22:57:57.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.040+0000 7f52efc34640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e80d1190 con 0x7f52e815fd60 2023-07-21T22:57:57.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.040+0000 7f52efc34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e8160600 con 0x7f52e80d1850 2023-07-21T22:57:57.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.040+0000 7f52ed1cf640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52e815fd60 0x7f52e80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:57.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.040+0000 7f52ed1cf640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52e815fd60 0x7f52e80d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36264/0 (socket says 172.21.15.6:36264) 2023-07-21T22:57:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.040+0000 7f52ed1cf640 1 -- 172.21.15.6:0/267293759 learned_addr learned my addr 172.21.15.6:0/267293759 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:57.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.040+0000 7f52ee1d1640 1 --2- 172.21.15.6:0/267293759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52e80d1850 0x7f52e80d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.040+0000 7f52ed1cf640 1 -- 172.21.15.6:0/267293759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52e80d1850 msgr2=0x7f52e80d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.040+0000 7f52ed1cf640 1 --2- 172.21.15.6:0/267293759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52e80d1850 0x7f52e80d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.040+0000 7f52ed1cf640 1 -- 172.21.15.6:0/267293759 >> v1:172.21.15.161:6789/0 conn(0x7f52e80b7c70 legacy=0x7f52e815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.040+0000 7f52ed1cf640 1 -- 172.21.15.6:0/267293759 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e8160320 con 0x7f52e815fd60 2023-07-21T22:57:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.040+0000 7f52ee1d1640 1 --2- 172.21.15.6:0/267293759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52e80d1850 0x7f52e80d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:57.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.044+0000 7f52ed1cf640 1 --2- 172.21.15.6:0/267293759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e815fd60 0x7f52e80d0c50 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009870 tx=0x7f52d801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afa9a8d2988cb7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:57.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.044+0000 7f52ec9ce640 1 -- 172.21.15.6:0/267293759 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d80a95f0 con 0x7f52e815fd60 2023-07-21T22:57:57.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.044+0000 7f52ec9ce640 1 -- 172.21.15.6:0/267293759 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d80a9750 con 0x7f52e815fd60 2023-07-21T22:57:57.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.044+0000 7f52ec9ce640 1 -- 172.21.15.6:0/267293759 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d80a9ae0 con 0x7f52e815fd60 2023-07-21T22:57:57.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.044+0000 7f52efc34640 1 -- 172.21.15.6:0/267293759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e815fd60 msgr2=0x7f52e80d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:57.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.044+0000 7f52efc34640 1 --2- 172.21.15.6:0/267293759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e815fd60 0x7f52e80d0c50 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009870 tx=0x7f52d801c510 comp rx=0 tx=0).stop 2023-07-21T22:57:57.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.044+0000 7f52efc34640 1 -- 172.21.15.6:0/267293759 shutdown_connections 2023-07-21T22:57:57.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.044+0000 7f52efc34640 1 --2- 172.21.15.6:0/267293759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52e80d1850 0x7f52e80d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:57.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.044+0000 7f52efc34640 1 --2- 172.21.15.6:0/267293759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e815fd60 0x7f52e80d0c50 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:57.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.044+0000 7f52efc34640 1 -- 172.21.15.6:0/267293759 >> 172.21.15.6:0/267293759 conn(0x7f52e80650b0 msgr2=0x7f52e80654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:57.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.044+0000 7f52efc34640 1 -- 172.21.15.6:0/267293759 shutdown_connections 2023-07-21T22:57:57.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.044+0000 7f52efc34640 1 -- 172.21.15.6:0/267293759 wait complete. 2023-07-21T22:57:57.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52efc34640 1 Processor -- start 2023-07-21T22:57:57.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52efc34640 1 -- start start 2023-07-21T22:57:57.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52efc34640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e80b7c70 0x7f52e8159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:57.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52efc34640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52e80d1850 0x7f52e8155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:57.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52efc34640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52e815fd60 0x7f52e815e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:57.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52efc34640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e8153b70 con 0x7f52e80b7c70 2023-07-21T22:57:57.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52efc34640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e8155960 con 0x7f52e80d1850 2023-07-21T22:57:57.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52efc34640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e815afc0 con 0x7f52e815fd60 2023-07-21T22:57:57.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52ed9d0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e80b7c70 0x7f52e8159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:57.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52ed9d0640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e80b7c70 0x7f52e8159570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36270/0 (socket says 172.21.15.6:36270) 2023-07-21T22:57:57.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52ed9d0640 1 -- 172.21.15.6:0/2387765498 learned_addr learned my addr 172.21.15.6:0/2387765498 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:57.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52ee1d1640 1 --2- 172.21.15.6:0/2387765498 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52e815fd60 0x7f52e815e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:57.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52ed1cf640 1 --2- 172.21.15.6:0/2387765498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52e80d1850 0x7f52e8155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:57.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52ed9d0640 1 -- 172.21.15.6:0/2387765498 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52e815fd60 msgr2=0x7f52e815e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:57.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52ed9d0640 1 --2- 172.21.15.6:0/2387765498 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52e815fd60 0x7f52e815e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:57.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52ed9d0640 1 -- 172.21.15.6:0/2387765498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52e80d1850 msgr2=0x7f52e8155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:57.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52ed9d0640 1 --2- 172.21.15.6:0/2387765498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52e80d1850 0x7f52e8155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:57.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52ed9d0640 1 -- 172.21.15.6:0/2387765498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d80094d0 con 0x7f52e80b7c70 2023-07-21T22:57:57.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52ed1cf640 1 --2- 172.21.15.6:0/2387765498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52e80d1850 0x7f52e8155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:57.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52ed9d0640 1 --2- 172.21.15.6:0/2387765498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e80b7c70 0x7f52e8159570 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f52e400c3c0 tx=0x7f52e400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:57.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52de7fc640 1 -- 172.21.15.6:0/2387765498 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e40052d0 con 0x7f52e80b7c70 2023-07-21T22:57:57.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52de7fc640 1 -- 172.21.15.6:0/2387765498 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e4005430 con 0x7f52e80b7c70 2023-07-21T22:57:57.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52de7fc640 1 -- 172.21.15.6:0/2387765498 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4003840 con 0x7f52e80b7c70 2023-07-21T22:57:57.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52efc34640 1 -- 172.21.15.6:0/2387765498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e815b2a0 con 0x7f52e80b7c70 2023-07-21T22:57:57.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.048+0000 7f52efc34640 1 -- 172.21.15.6:0/2387765498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e815b580 con 0x7f52e80b7c70 2023-07-21T22:57:57.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.052+0000 7f52efc34640 1 -- 172.21.15.6:0/2387765498 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e80678d0 con 0x7f52e80b7c70 2023-07-21T22:57:57.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.052+0000 7f52de7fc640 1 -- 172.21.15.6:0/2387765498 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f52e40039a0 con 0x7f52e80b7c70 2023-07-21T22:57:57.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.052+0000 7f52de7fc640 1 --2- 172.21.15.6:0/2387765498 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f52cc0663a0 0x7f52cc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:57.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.052+0000 7f52de7fc640 1 -- 172.21.15.6:0/2387765498 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f52e40832b0 con 0x7f52e80b7c70 2023-07-21T22:57:57.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.052+0000 7f52ed1cf640 1 --2- 172.21.15.6:0/2387765498 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f52cc0663a0 0x7f52cc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:57.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.052+0000 7f52ed1cf640 1 --2- 172.21.15.6:0/2387765498 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f52cc0663a0 0x7f52cc068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f52d80ae000 tx=0x7f52d80b3040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:57.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.056+0000 7f52de7fc640 1 -- 172.21.15.6:0/2387765498 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f52e4050730 con 0x7f52e80b7c70 2023-07-21T22:57:57.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.208+0000 7f52efc34640 1 -- 172.21.15.6:0/2387765498 --> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f52e8153cb0 con 0x7f52cc0663a0 2023-07-21T22:57:57.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.212+0000 7f52de7fc640 1 -- 172.21.15.6:0/2387765498 <== mgr.10231 v2:172.21.15.161:6832/1416042622 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72452 (secure 0 0 0) 0x7f52d80a9940 con 0x7f52cc0663a0 2023-07-21T22:57:57.247 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:57.248 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:57:57.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.212+0000 7f52efc34640 1 -- 172.21.15.6:0/2387765498 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f52cc0663a0 msgr2=0x7f52cc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:57.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.212+0000 7f52efc34640 1 --2- 172.21.15.6:0/2387765498 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f52cc0663a0 0x7f52cc068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f52d80ae000 tx=0x7f52d80b3040 comp rx=0 tx=0).stop 2023-07-21T22:57:57.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.212+0000 7f52efc34640 1 -- 172.21.15.6:0/2387765498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e80b7c70 msgr2=0x7f52e8159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:57.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.212+0000 7f52efc34640 1 --2- 172.21.15.6:0/2387765498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e80b7c70 0x7f52e8159570 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f52e400c3c0 tx=0x7f52e400c880 comp rx=0 tx=0).stop 2023-07-21T22:57:57.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.212+0000 7f52efc34640 1 -- 172.21.15.6:0/2387765498 shutdown_connections 2023-07-21T22:57:57.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.212+0000 7f52efc34640 1 --2- 172.21.15.6:0/2387765498 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f52cc0663a0 0x7f52cc068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:57.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.212+0000 7f52efc34640 1 --2- 172.21.15.6:0/2387765498 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52e815fd60 0x7f52e815e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:57.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.212+0000 7f52efc34640 1 --2- 172.21.15.6:0/2387765498 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52e80d1850 0x7f52e8155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:57.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.212+0000 7f52efc34640 1 --2- 172.21.15.6:0/2387765498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52e80b7c70 0x7f52e8159570 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:57.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.212+0000 7f52efc34640 1 -- 172.21.15.6:0/2387765498 >> 172.21.15.6:0/2387765498 conn(0x7f52e80650b0 msgr2=0x7f52e80b0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:57.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.212+0000 7f52efc34640 1 -- 172.21.15.6:0/2387765498 shutdown_connections 2023-07-21T22:57:57.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.212+0000 7f52efc34640 1 -- 172.21.15.6:0/2387765498 wait complete. 2023-07-21T22:57:57.268 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-07-21T22:57:56.853223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":364068,"kb_used_data":20580,"kb_used_omap":0,"kb_used_meta":343424,"kb_avail":754610652,"statfs":{"total":773094113280,"available":772721307648,"internally_reserved":0,"allocated":21073920,"data_stored":11572752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":351666176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-669867,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-317,"num_read_kb":-281,"num_write":-284,"num_write_kb":-2057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.816481"},"pg_stats":[{"pgid":"1.0","version":"194'348","reported_seq":1301,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.361580+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:57:52.361580+0000","last_peered":"2023-07-21T22:57:52.361580+0000","last_clean":"2023-07-21T22:57:52.361580+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:57:52.361580+0000","last_undegraded":"2023-07-21T22:57:52.361580+0000","last_fullsized":"2023-07-21T22:57:52.361580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:03:32.609855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":365,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.139727+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:57:52.139727+0000","last_peered":"2023-07-21T22:57:52.139727+0000","last_clean":"2023-07-21T22:57:52.139727+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:57:52.139727+0000","last_undegraded":"2023-07-21T22:57:52.139727+0000","last_fullsized":"2023-07-21T22:57:52.139727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:15:17.428686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":326,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.361481+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:57:52.361481+0000","last_peered":"2023-07-21T22:57:52.361481+0000","last_clean":"2023-07-21T22:57:52.361481+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:57:52.361481+0000","last_undegraded":"2023-07-21T22:57:52.361481+0000","last_fullsized":"2023-07-21T22:57:52.361481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:49:16.786704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":329,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.354568+0000","last_change":"2023-07-21T22:18:38.474519+0000","last_active":"2023-07-21T22:57:52.354568+0000","last_peered":"2023-07-21T22:57:52.354568+0000","last_clean":"2023-07-21T22:57:52.354568+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:57:52.354568+0000","last_undegraded":"2023-07-21T22:57:52.354568+0000","last_fullsized":"2023-07-21T22:57:52.354568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:42:41.337652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":365,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.138791+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:57:52.138791+0000","last_peered":"2023-07-21T22:57:52.138791+0000","last_clean":"2023-07-21T22:57:52.138791+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:57:52.138791+0000","last_undegraded":"2023-07-21T22:57:52.138791+0000","last_fullsized":"2023-07-21T22:57:52.138791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:41:29.803880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":343,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.132889+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:57:52.132889+0000","last_peered":"2023-07-21T22:57:52.132889+0000","last_clean":"2023-07-21T22:57:52.132889+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:57:52.132889+0000","last_undegraded":"2023-07-21T22:57:52.132889+0000","last_fullsized":"2023-07-21T22:57:52.132889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:53:24.136788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":325,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.361627+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:57:52.361627+0000","last_peered":"2023-07-21T22:57:52.361627+0000","last_clean":"2023-07-21T22:57:52.361627+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:57:52.361627+0000","last_undegraded":"2023-07-21T22:57:52.361627+0000","last_fullsized":"2023-07-21T22:57:52.361627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:15:06.984719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":343,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.132992+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:57:52.132992+0000","last_peered":"2023-07-21T22:57:52.132992+0000","last_clean":"2023-07-21T22:57:52.132992+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:57:52.132992+0000","last_undegraded":"2023-07-21T22:57:52.132992+0000","last_fullsized":"2023-07-21T22:57:52.132992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:17:43.978687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":323,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-21T22:57:52.140692+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:57:52.140692+0000","last_peered":"2023-07-21T22:57:52.140692+0000","last_clean":"2023-07-21T22:57:52.140692+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:57:52.140692+0000","last_undegraded":"2023-07-21T22:57:52.140692+0000","last_fullsized":"2023-07-21T22:57:52.140692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:55:10.640049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509905,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64336,"kb_used_data":2952,"kb_used_omap":0,"kb_used_meta":61376,"kb_avail":94307504,"statfs":{"total":96636764160,"available":96570884096,"internally_reserved":0,"allocated":3022848,"data_stored":1842200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":62849024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.35999999999999999,"15min":0.34999999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":1.143},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.44500000000000001,"5min":0.39700000000000002,"15min":0.39000000000000001},"max":{"1min":0.84699999999999998,"5min":0.93200000000000005,"15min":1.0349999999999999},"last":0.71399999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.58499999999999996,"5min":0.48499999999999999,"15min":0.40600000000000003},"max":{"1min":1.0289999999999999,"5min":1.089,"15min":1.089},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.879,"5min":0.94399999999999995,"15min":1.02},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.871,"5min":0.95899999999999996,"15min":1.018},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.42299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98899999999999999,"15min":1.0660000000000001},"last":0.78100000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.77100000000000002},"min":{"1min":0.55100000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97499999999999998,"5min":0.98099999999999998,"15min":1.0980000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.86899999999999999,"5min":0.96599999999999997,"15min":1.026},"last":0.70099999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.89700000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60999999999999999,"15min":0.60399999999999998},"min":{"1min":0.42999999999999999,"5min":0.40300000000000002,"15min":0.34699999999999998},"max":{"1min":0.89900000000000002,"5min":0.91000000000000003,"15min":1.0940000000000001},"last":0.51100000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.99399999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68600000000000005,"15min":0.67100000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.0429999999999999},"last":0.622}]},{"osd":6,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68200000000000005,"15min":0.67500000000000004},"min":{"1min":0.56799999999999995,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.97399999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.46600000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85199999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.56200000000000006}]}]},{"osd":6,"up_from":14,"seq":60129542611,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37532,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334308,"statfs":{"total":96636764160,"available":96598331392,"internally_reserved":0,"allocated":2445312,"data_stored":1258991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.55000000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93700000000000006,"5min":1.022,"15min":1.024},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.56699999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.0780000000000001},"last":0.82099999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71999999999999997,"15min":0.73199999999999998},"min":{"1min":0.47999999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.89000000000000001,"5min":0.96999999999999997,"15min":1.006},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.754,"15min":0.74299999999999999},"min":{"1min":0.495,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95999999999999996,"5min":1.046,"15min":1.046},"last":0.68700000000000006}]},{"osd":2,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.76900000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90500000000000003,"5min":0.97399999999999998,"15min":1.038},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.80200000000000005},"min":{"1min":0.59499999999999997,"5min":0.438,"15min":0.438},"max":{"1min":0.89100000000000001,"5min":0.98799999999999999,"15min":1.0600000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.749,"15min":0.747},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0029999999999999,"5min":1.089,"15min":1.089},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88700000000000001,"5min":0.96199999999999997,"15min":0.96999999999999997},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.39500000000000002,"5min":0.378,"15min":0.36099999999999999},"max":{"1min":0.72199999999999998,"5min":0.88400000000000001,"15min":0.92300000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.622,"15min":0.60899999999999999},"min":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":0.93799999999999994,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61699999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42299999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.437}]},{"osd":7,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.38700000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66300000000000003,"15min":0.66700000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.432},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.96299999999999997},"last":0.45900000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509904,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55576,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316264,"statfs":{"total":96636764160,"available":96579854336,"internally_reserved":0,"allocated":2441216,"data_stored":1252057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.69299999999999995,"15min":0.70199999999999996},"min":{"1min":0.503,"5min":0.46200000000000002,"15min":0.32100000000000001},"max":{"1min":0.90700000000000003,"5min":1.044,"15min":1.044},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.75600000000000001,"15min":0.73599999999999999},"min":{"1min":0.49199999999999999,"5min":0.432,"15min":0.41499999999999998},"max":{"1min":3.2280000000000002,"5min":3.2280000000000002,"15min":3.2280000000000002},"last":0.83299999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.75,"15min":0.73899999999999999},"min":{"1min":0.51300000000000001,"5min":0.439,"15min":0.42399999999999999},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.505,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86299999999999999,"5min":1.038,"15min":1.054},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.77100000000000002,"15min":0.75800000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.3159999999999998,"5min":3.3159999999999998,"15min":3.3159999999999998},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.747,"15min":0.74299999999999999},"min":{"1min":0.56999999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.81799999999999995,"15min":0.79300000000000004},"min":{"1min":0.58899999999999997,"5min":0.55900000000000005,"15min":0.47299999999999998},"max":{"1min":3.3540000000000001,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.65300000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.81299999999999994}]},{"osd":4,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57699999999999996,"15min":0.55900000000000005},"min":{"1min":0.443,"5min":0.373,"15min":0.34599999999999997},"max":{"1min":0.86499999999999999,"5min":0.86899999999999999,"15min":0.91300000000000003},"last":0.5},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.71299999999999997,"15min":0.69099999999999995},"min":{"1min":0.496,"5min":0.47399999999999998,"15min":0.46700000000000003},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":0.66900000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.60899999999999999,"15min":0.59299999999999997},"min":{"1min":0.46600000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.754},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.61299999999999999,"15min":0.60199999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.39400000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.77400000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.67000000000000004,"15min":0.65000000000000002},"min":{"1min":0.46400000000000002,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":3.3889999999999998,"5min":3.3889999999999998,"15min":3.3889999999999998},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.754,"15min":0.72499999999999998},"min":{"1min":0.54800000000000004,"5min":0.496,"15min":0.45900000000000002},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.85499999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509905,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37532,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334308,"statfs":{"total":96636764160,"available":96598331392,"internally_reserved":0,"allocated":2445312,"data_stored":1258991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.34599999999999997},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.76900000000000002},"min":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.35299999999999998},"max":{"1min":1.3500000000000001,"5min":1.488,"15min":1.488},"last":0.72199999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.52700000000000002,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":2.7320000000000002,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.80300000000000005,"15min":0.78800000000000003},"min":{"1min":0.62,"5min":0.60699999999999998,"15min":0.46899999999999997},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.878,"5min":0.79800000000000004,"15min":0.78600000000000003},"min":{"1min":0.623,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":0.753}]},{"osd":3,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.78800000000000003,"15min":0.75600000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.0169999999999999,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82299999999999995,"15min":0.81599999999999995},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.93200000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73299999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.44500000000000001,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.151},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.57899999999999996,"5min":0.45800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94999999999999996,"5min":0.96299999999999997,"15min":1.252},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.44400000000000001,"15min":0.437},"max":{"1min":1.006,"5min":1.006,"15min":1.0609999999999999},"last":0.87}]},{"osd":7,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68300000000000005,"15min":0.66000000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.39500000000000002},"max":{"1min":1.0189999999999999,"5min":1.526,"15min":1.526},"last":0.88},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.53600000000000003,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.99099999999999999,"5min":1.0820000000000001,"15min":1.206},"last":0.98399999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509904,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37868,"kb_used_data":2724,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333972,"statfs":{"total":96636764160,"available":96597987328,"internally_reserved":0,"allocated":2789376,"data_stored":1593172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.503,"15min":0.496},"min":{"1min":0.29899999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57899999999999996,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.376},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.65100000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53300000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.35299999999999998,"5min":0.317,"15min":0.312},"max":{"1min":0.72999999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79700000000000004,"5min":0.81799999999999995,"15min":0.88100000000000001},"last":0.438}]},{"osd":2,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.80000000000000004,"5min":0.83199999999999996,"15min":0.84699999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.36899999999999999,"15min":0.36299999999999999},"max":{"1min":0.78600000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58699999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77600000000000002,"15min":0.77900000000000003},"min":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.441},"max":{"1min":1.046,"5min":1.101,"15min":1.244},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.84399999999999997},"min":{"1min":0.58099999999999996,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.877}]},{"osd":5,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.57099999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.59499999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.006,"5min":1.087,"15min":1.2230000000000001},"last":0.78800000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81200000000000006,"15min":0.80600000000000005},"min":{"1min":0.58799999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0820000000000001,"5min":1.127,"15min":1.147},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78500000000000003,"15min":0.78600000000000003},"min":{"1min":0.56799999999999995,"5min":0.55100000000000005,"15min":0.53000000000000003},"max":{"1min":1.296,"5min":1.296,"15min":1.3660000000000001},"last":0.81699999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83299999999999996,"15min":0.82999999999999996},"min":{"1min":0.624,"5min":0.55000000000000004,"15min":0.50900000000000001},"max":{"1min":1.175,"5min":1.175,"15min":1.4510000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82799999999999996,"15min":0.84299999999999997},"min":{"1min":0.61499999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.427},"last":0.77400000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509906,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55580,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316260,"statfs":{"total":96636764160,"available":96579850240,"internally_reserved":0,"allocated":2445312,"data_stored":1258991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.52700000000000002,"15min":0.51000000000000001},"min":{"1min":0.33400000000000002,"5min":0.314,"15min":0.30399999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.45900000000000002,"5min":0.38,"15min":0.377},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.61199999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.35599999999999998},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.47199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.64700000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.502,"15min":0.499},"min":{"1min":0.379,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.69399999999999995,"5min":0.73099999999999998,"15min":0.92800000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.60599999999999998,"15min":0.59399999999999997},"min":{"1min":0.53400000000000003,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.63}]},{"osd":4,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.82499999999999996,"15min":0.82599999999999996},"min":{"1min":0.66000000000000003,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.81399999999999995,"15min":0.82899999999999996},"min":{"1min":0.55900000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.1240000000000001,"5min":1.1359999999999999,"15min":1.391},"last":0.99399999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.80200000000000005,"15min":0.81699999999999995},"min":{"1min":0.67200000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.82599999999999996,"15min":0.83699999999999997},"min":{"1min":0.57699999999999996,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.876}]},{"osd":6,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.80000000000000004,"15min":0.81899999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1220000000000001,"5min":1.1499999999999999,"15min":1.2969999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.84399999999999997,"15min":0.84699999999999998},"min":{"1min":0.63600000000000001,"5min":0.59999999999999998,"15min":0.55600000000000005},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.86599999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:56:52 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.84399999999999997,"15min":0.85099999999999998},"min":{"1min":0.748,"5min":0.62,"15min":0.56000000000000005},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.81999999999999995,"15min":0.84399999999999997},"min":{"1min":0.59599999999999997,"5min":0.58199999999999996,"15min":0.57999999999999996},"max":{"1min":1.1679999999999999,"5min":1.2749999999999999,"15min":1.3939999999999999},"last":0.89400000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509905,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37532,"kb_used_data":2388,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334308,"statfs":{"total":96636764160,"available":96598331392,"internally_reserved":0,"allocated":2445312,"data_stored":1258991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.255,"5min":0.251,"15min":0.251},"max":{"1min":0.77500000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.69399999999999995,"5min":1.149,"15min":1.149},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.496,"15min":0.52100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66900000000000004,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":1.21,"15min":1.21},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59399999999999997,"15min":0.60899999999999999},"min":{"1min":0.42499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77100000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.505,"15min":0.52000000000000002},"min":{"1min":0.34100000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.34300000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76600000000000001,"15min":0.79600000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.46500000000000002},"max":{"1min":1.046,"5min":1.222,"15min":1.3819999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.62,"5min":0.58699999999999997,"15min":0.53400000000000003},"max":{"1min":1.2150000000000001,"5min":1.2849999999999999,"15min":1.302},"last":0.82999999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.78200000000000003,"15min":0.80400000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0189999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77900000000000003,"15min":0.80600000000000005},"min":{"1min":0.53900000000000003,"5min":0.52800000000000002,"15min":0.48799999999999999},"max":{"1min":1.107,"5min":1.171,"15min":1.3100000000000001},"last":0.878}]},{"osd":6,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.81399999999999995,"15min":0.82399999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.149,"5min":1.3300000000000001,"15min":1.3500000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77200000000000002,"15min":0.80700000000000005},"min":{"1min":0.55800000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.169,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.80900000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78400000000000003,"15min":0.82399999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0700000000000001,"5min":1.2569999999999999,"15min":1.4930000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.55000000000000004},"max":{"1min":1.1899999999999999,"5min":1.292,"15min":1.4430000000000001},"last":0.94599999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509907,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38112,"kb_used_data":2968,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333728,"statfs":{"total":96636764160,"available":96597737472,"internally_reserved":0,"allocated":3039232,"data_stored":1849359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.498,"15min":0.48799999999999999},"min":{"1min":0.317,"5min":0.29999999999999999,"15min":0.28499999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.498},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54300000000000004,"15min":0.54000000000000004},"min":{"1min":0.40000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.36499999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33900000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.58799999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.627,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.41399999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.629,"5min":0.51200000000000001,"15min":0.51000000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.4370000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.82999999999999996,"15min":0.82699999999999996},"min":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.83199999999999996,"15min":0.82199999999999995},"min":{"1min":0.63500000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2130000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.87,"15min":0.84899999999999998},"min":{"1min":0.628,"5min":0.497,"15min":0.497},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.351},"last":0.76700000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.58499999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.627,"5min":0.60699999999999998,"15min":0.60299999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.73399999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.83499999999999996,"15min":0.83199999999999996},"min":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"max":{"1min":1.1699999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.877,"15min":0.873},"min":{"1min":0.64900000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.411},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:57:57.270 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:57:57.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.380+0000 7faea6774640 1 Processor -- start 2023-07-21T22:57:57.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.380+0000 7faea6774640 1 -- start start 2023-07-21T22:57:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.380+0000 7faea6774640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faea015fd60 0x7faea00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.380+0000 7faea6774640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faea00d1850 0x7faea00d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.380+0000 7faea6774640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea00ccaf0 con 0x7faea00b7c70 2023-07-21T22:57:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.380+0000 7faea6774640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea00d1190 con 0x7faea015fd60 2023-07-21T22:57:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.380+0000 7faea6774640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea0160600 con 0x7faea00d1850 2023-07-21T22:57:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.380+0000 7fae9f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faea015fd60 0x7faea00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.380+0000 7fae9f7fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7faea015fd60 0x7faea00d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36280/0 (socket says 172.21.15.6:36280) 2023-07-21T22:57:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.380+0000 7fae9f7fe640 1 -- 172.21.15.6:0/872532071 learned_addr learned my addr 172.21.15.6:0/872532071 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.380+0000 7faea4d11640 1 --2- 172.21.15.6:0/872532071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faea00d1850 0x7faea00d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.380+0000 7fae9f7fe640 1 -- 172.21.15.6:0/872532071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faea00d1850 msgr2=0x7faea00d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.380+0000 7fae9f7fe640 1 --2- 172.21.15.6:0/872532071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faea00d1850 0x7faea00d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.380+0000 7fae9f7fe640 1 -- 172.21.15.6:0/872532071 >> v1:172.21.15.161:6789/0 conn(0x7faea00b7c70 legacy=0x7faea015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.380+0000 7fae9f7fe640 1 -- 172.21.15.6:0/872532071 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea0160320 con 0x7faea015fd60 2023-07-21T22:57:57.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.384+0000 7fae9f7fe640 1 --2- 172.21.15.6:0/872532071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faea015fd60 0x7faea00d0c50 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7fae94009870 tx=0x7fae9401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cfa8be23602cd5b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:57.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.384+0000 7fae9effd640 1 -- 172.21.15.6:0/872532071 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae940a95f0 con 0x7faea015fd60 2023-07-21T22:57:57.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.384+0000 7fae9effd640 1 -- 172.21.15.6:0/872532071 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae940a9750 con 0x7faea015fd60 2023-07-21T22:57:57.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.384+0000 7fae9effd640 1 -- 172.21.15.6:0/872532071 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae940a9ae0 con 0x7faea015fd60 2023-07-21T22:57:57.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.384+0000 7faea6774640 1 -- 172.21.15.6:0/872532071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faea015fd60 msgr2=0x7faea00d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:57.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.384+0000 7faea6774640 1 --2- 172.21.15.6:0/872532071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faea015fd60 0x7faea00d0c50 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7fae94009870 tx=0x7fae9401c510 comp rx=0 tx=0).stop 2023-07-21T22:57:57.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.384+0000 7faea6774640 1 -- 172.21.15.6:0/872532071 shutdown_connections 2023-07-21T22:57:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.384+0000 7faea6774640 1 --2- 172.21.15.6:0/872532071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faea00d1850 0x7faea00d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.384+0000 7faea6774640 1 --2- 172.21.15.6:0/872532071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faea015fd60 0x7faea00d0c50 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.384+0000 7faea6774640 1 -- 172.21.15.6:0/872532071 >> 172.21.15.6:0/872532071 conn(0x7faea00650b0 msgr2=0x7faea00654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.384+0000 7faea6774640 1 -- 172.21.15.6:0/872532071 shutdown_connections 2023-07-21T22:57:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.384+0000 7faea6774640 1 -- 172.21.15.6:0/872532071 wait complete. 2023-07-21T22:57:57.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7faea6774640 1 Processor -- start 2023-07-21T22:57:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7faea6774640 1 -- start start 2023-07-21T22:57:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7faea6774640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faea00b7c70 0x7faea0154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7faea6774640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faea00d1850 0x7faea00c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7faea6774640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faea015fd60 0x7faea015e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7faea6774640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea015b7b0 con 0x7faea00d1850 2023-07-21T22:57:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7faea6774640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea00c88e0 con 0x7faea00b7c70 2023-07-21T22:57:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7faea6774640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea00c8bc0 con 0x7faea015fd60 2023-07-21T22:57:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7fae9f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faea00d1850 0x7faea00c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7fae9f7fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faea00d1850 0x7faea00c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36294/0 (socket says 172.21.15.6:36294) 2023-07-21T22:57:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7fae9f7fe640 1 -- 172.21.15.6:0/262516926 learned_addr learned my addr 172.21.15.6:0/262516926 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7fae9ffff640 1 --2- 172.21.15.6:0/262516926 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faea00b7c70 0x7faea0154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7fae9f7fe640 1 -- 172.21.15.6:0/262516926 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faea015fd60 msgr2=0x7faea015e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7faea4d11640 1 --2- 172.21.15.6:0/262516926 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faea015fd60 0x7faea015e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7fae9f7fe640 1 --2- 172.21.15.6:0/262516926 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faea015fd60 0x7faea015e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7fae9f7fe640 1 -- 172.21.15.6:0/262516926 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faea00b7c70 msgr2=0x7faea0154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7fae9f7fe640 1 --2- 172.21.15.6:0/262516926 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faea00b7c70 0x7faea0154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7fae9f7fe640 1 -- 172.21.15.6:0/262516926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae940094d0 con 0x7faea00d1850 2023-07-21T22:57:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7fae9ffff640 1 --2- 172.21.15.6:0/262516926 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faea00b7c70 0x7faea0154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7faea4d11640 1 --2- 172.21.15.6:0/262516926 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faea015fd60 0x7faea015e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:57:57.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7fae9f7fe640 1 --2- 172.21.15.6:0/262516926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faea00d1850 0x7faea00c7e40 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7fae940ab040 tx=0x7fae940192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:57.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7fae9cff9640 1 -- 172.21.15.6:0/262516926 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae940a95f0 con 0x7faea00d1850 2023-07-21T22:57:57.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7fae9cff9640 1 -- 172.21.15.6:0/262516926 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae940b1600 con 0x7faea00d1850 2023-07-21T22:57:57.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7faea6774640 1 -- 172.21.15.6:0/262516926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea00c8ea0 con 0x7faea00d1850 2023-07-21T22:57:57.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7fae9cff9640 1 -- 172.21.15.6:0/262516926 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae940b19d0 con 0x7faea00d1850 2023-07-21T22:57:57.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7faea6774640 1 -- 172.21.15.6:0/262516926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea00c8380 con 0x7faea00d1850 2023-07-21T22:57:57.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.388+0000 7faea6774640 1 -- 172.21.15.6:0/262516926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea00678d0 con 0x7faea00d1850 2023-07-21T22:57:57.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.392+0000 7fae9cff9640 1 -- 172.21.15.6:0/262516926 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fae940b1b30 con 0x7faea00d1850 2023-07-21T22:57:57.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.392+0000 7fae9cff9640 1 --2- 172.21.15.6:0/262516926 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fae8c0663a0 0x7fae8c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:57.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.392+0000 7fae9cff9640 1 -- 172.21.15.6:0/262516926 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7fae9411e360 con 0x7faea00d1850 2023-07-21T22:57:57.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.392+0000 7fae9ffff640 1 --2- 172.21.15.6:0/262516926 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fae8c0663a0 0x7fae8c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:57.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.392+0000 7fae9ffff640 1 --2- 172.21.15.6:0/262516926 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fae8c0663a0 0x7fae8c068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faea00659e0 tx=0x7fae90009040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:57.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.396+0000 7fae9cff9640 1 -- 172.21.15.6:0/262516926 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fae940eb610 con 0x7faea00d1850 2023-07-21T22:57:57.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.556+0000 7faea6774640 1 -- 172.21.15.6:0/262516926 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faea00c7a60 con 0x7faea00d1850 2023-07-21T22:57:57.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.556+0000 7fae9cff9640 1 -- 172.21.15.6:0/262516926 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+15894 (secure 0 0 0) 0x7fae940eec30 con 0x7faea00d1850 2023-07-21T22:57:57.591 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:57:57.591 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":197,"fsid":"f3073df4-6cd1-4503-bd2e-d3e98fa18bdf","created":"2023-07-21T22:18:17.756760+0000","modified":"2023-07-21T22:57:53.137670+0000","last_up_change":"2023-07-21T22:18:29.089644+0000","last_in_change":"2023-07-21T22:18:20.314356+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:18:30.828350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-21T22:18:36.339908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9ce560da-84c1-494d-bc1f-33760d20ecad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6801","nonce":45975211}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6803","nonce":45975211}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6807","nonce":45975211}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":45975211},{"type":"v1","addr":"172.21.15.6:6805","nonce":45975211}]},"public_addr":"172.21.15.6:6801/45975211","cluster_addr":"172.21.15.6:6803/45975211","heartbeat_back_addr":"172.21.15.6:6807/45975211","heartbeat_front_addr":"172.21.15.6:6805/45975211","state":["exists","up"]},{"osd":1,"uuid":"3f855e10-abc8-4e13-a119-4e856e9897a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6817","nonce":2815481744}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6819","nonce":2815481744}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6823","nonce":2815481744}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2815481744},{"type":"v1","addr":"172.21.15.6:6821","nonce":2815481744}]},"public_addr":"172.21.15.6:6817/2815481744","cluster_addr":"172.21.15.6:6819/2815481744","heartbeat_back_addr":"172.21.15.6:6823/2815481744","heartbeat_front_addr":"172.21.15.6:6821/2815481744","state":["exists","up"]},{"osd":2,"uuid":"f840e3e0-4927-47ec-8916-a14bc9edaf44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6809","nonce":3480578303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6811","nonce":3480578303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6815","nonce":3480578303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":3480578303},{"type":"v1","addr":"172.21.15.6:6813","nonce":3480578303}]},"public_addr":"172.21.15.6:6809/3480578303","cluster_addr":"172.21.15.6:6811/3480578303","heartbeat_back_addr":"172.21.15.6:6815/3480578303","heartbeat_front_addr":"172.21.15.6:6813/3480578303","state":["exists","up"]},{"osd":3,"uuid":"e48323c3-775a-4c9b-bbb1-a72389f82791","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6825","nonce":3751691192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6827","nonce":3751691192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6831","nonce":3751691192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3751691192},{"type":"v1","addr":"172.21.15.6:6829","nonce":3751691192}]},"public_addr":"172.21.15.6:6825/3751691192","cluster_addr":"172.21.15.6:6827/3751691192","heartbeat_back_addr":"172.21.15.6:6831/3751691192","heartbeat_front_addr":"172.21.15.6:6829/3751691192","state":["exists","up"]},{"osd":4,"uuid":"b8627d99-2cb3-454a-b51d-898c7d22a607","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6825","nonce":3485236199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6827","nonce":3485236199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6831","nonce":3485236199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3485236199},{"type":"v1","addr":"172.21.15.161:6829","nonce":3485236199}]},"public_addr":"172.21.15.161:6825/3485236199","cluster_addr":"172.21.15.161:6827/3485236199","heartbeat_back_addr":"172.21.15.161:6831/3485236199","heartbeat_front_addr":"172.21.15.161:6829/3485236199","state":["exists","up"]},{"osd":5,"uuid":"8ee31a26-d2c9-4975-a11c-447ea07dd1ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6809","nonce":1291367445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6811","nonce":1291367445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6815","nonce":1291367445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":1291367445},{"type":"v1","addr":"172.21.15.161:6813","nonce":1291367445}]},"public_addr":"172.21.15.161:6809/1291367445","cluster_addr":"172.21.15.161:6811/1291367445","heartbeat_back_addr":"172.21.15.161:6815/1291367445","heartbeat_front_addr":"172.21.15.161:6813/1291367445","state":["exists","up"]},{"osd":6,"uuid":"c7cde6d1-0eed-4f00-b78b-0e1473dce186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6801","nonce":771066506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6803","nonce":771066506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6807","nonce":771066506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":771066506},{"type":"v1","addr":"172.21.15.161:6805","nonce":771066506}]},"public_addr":"172.21.15.161:6801/771066506","cluster_addr":"172.21.15.161:6803/771066506","heartbeat_back_addr":"172.21.15.161:6807/771066506","heartbeat_front_addr":"172.21.15.161:6805/771066506","state":["exists","up"]},{"osd":7,"uuid":"929a10f2-4c08-4e2e-b60f-9a89bca9443e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6817","nonce":2760284950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6819","nonce":2760284950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6823","nonce":2760284950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":2760284950},{"type":"v1","addr":"172.21.15.161:6821","nonce":2760284950}]},"public_addr":"172.21.15.161:6817/2760284950","cluster_addr":"172.21.15.161:6819/2760284950","heartbeat_back_addr":"172.21.15.161:6823/2760284950","heartbeat_front_addr":"172.21.15.161:6821/2760284950","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.738247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.734930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.739244+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.600491+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.020476+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.095899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:25.751463+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:18:26.032624+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6835/963904366":"2023-07-22T22:57:50.026390+0000","172.21.15.161:0/3754480080":"2023-07-22T22:57:46.822841+0000","172.21.15.161:0/2032388246":"2023-07-22T22:57:46.822841+0000","172.21.15.161:6832/2599285906":"2023-07-22T22:57:46.822841+0000","172.21.15.6:6833/963904366":"2023-07-22T22:57:50.026390+0000","172.21.15.161:0/2086729558":"2023-07-22T22:57:46.822841+0000","172.21.15.161:6833/2599285906":"2023-07-22T22:57:46.822841+0000","172.21.15.161:0/3809050192":"2023-07-22T22:57:46.822841+0000","172.21.15.161:0/568512462":"2023-07-22T22:57:40.018539+0000","172.21.15.161:6833/406143921":"2023-07-22T22:57:40.018539+0000","172.21.15.161:6832/406143921":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/2047544093":"2023-07-22T22:57:46.822841+0000","172.21.15.161:0/323615512":"2023-07-22T22:57:46.822841+0000","172.21.15.161:0/2299078826":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/1726684525":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/319560030":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/3583156451":"2023-07-22T22:57:46.822841+0000","172.21.15.161:0/389011228":"2023-07-22T22:57:40.018539+0000","172.21.15.161:0/3791982345":"2023-07-22T22:57:40.018539+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":107,"length":1},{"begin":221,"length":1}]},{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:57:57.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.556+0000 7faea6774640 1 -- 172.21.15.6:0/262516926 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fae8c0663a0 msgr2=0x7fae8c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:57.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.556+0000 7faea6774640 1 --2- 172.21.15.6:0/262516926 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fae8c0663a0 0x7fae8c068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faea00659e0 tx=0x7fae90009040 comp rx=0 tx=0).stop 2023-07-21T22:57:57.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.556+0000 7faea6774640 1 -- 172.21.15.6:0/262516926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faea00d1850 msgr2=0x7faea00c7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:57.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.556+0000 7faea6774640 1 --2- 172.21.15.6:0/262516926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faea00d1850 0x7faea00c7e40 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7fae940ab040 tx=0x7fae940192b0 comp rx=0 tx=0).stop 2023-07-21T22:57:57.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.556+0000 7faea6774640 1 -- 172.21.15.6:0/262516926 shutdown_connections 2023-07-21T22:57:57.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.556+0000 7faea6774640 1 --2- 172.21.15.6:0/262516926 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fae8c0663a0 0x7fae8c068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:57.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.556+0000 7faea6774640 1 --2- 172.21.15.6:0/262516926 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faea015fd60 0x7faea015e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:57.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.556+0000 7faea6774640 1 --2- 172.21.15.6:0/262516926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faea00d1850 0x7faea00c7e40 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:57.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.556+0000 7faea6774640 1 --2- 172.21.15.6:0/262516926 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faea00b7c70 0x7faea0154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:57.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.556+0000 7faea6774640 1 -- 172.21.15.6:0/262516926 >> 172.21.15.6:0/262516926 conn(0x7faea00650b0 msgr2=0x7faea00b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:57.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.556+0000 7faea6774640 1 -- 172.21.15.6:0/262516926 shutdown_connections 2023-07-21T22:57:57.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:57.556+0000 7faea6774640 1 -- 172.21.15.6:0/262516926 wait complete. 2023-07-21T22:57:58.613 INFO:tasks.ceph:Scrubbing osd.0 2023-07-21T22:57:58.614 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-07-21T22:57:58.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.736+0000 7f45b3e7b640 1 Processor -- start 2023-07-21T22:57:58.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.736+0000 7f45b3e7b640 1 -- start start 2023-07-21T22:57:58.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.736+0000 7f45b3e7b640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45ac0aeb40 0x7f45ac15cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.736+0000 7f45b3e7b640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ac1532b0 con 0x7f45ac159440 2023-07-21T22:57:58.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.736+0000 7f45b3e7b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ac0ca6f0 con 0x7f45ac0aef10 2023-07-21T22:57:58.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.736+0000 7f45b3e7b640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ac1599d0 con 0x7f45ac0aeb40 2023-07-21T22:57:58.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.736+0000 7f45b1c17640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f45ac0aeb40 0x7f45ac15cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.736+0000 7f45b2418640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f45ac159440 0x7f45ac0c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39916/0 (socket says 172.21.15.6:39916) 2023-07-21T22:57:58.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.736+0000 7f45b2418640 1 -- 172.21.15.6:0/465671710 learned_addr learned my addr 172.21.15.6:0/465671710 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:58.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.736+0000 7f45b1c17640 1 -- 172.21.15.6:0/465671710 >> v1:172.21.15.161:6789/0 conn(0x7f45ac0aef10 legacy=0x7f45ac158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:58.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.736+0000 7f45b1c17640 1 -- 172.21.15.6:0/465671710 >> v1:172.21.15.6:6789/0 conn(0x7f45ac159440 legacy=0x7f45ac0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:58.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.736+0000 7f45b1c17640 1 -- 172.21.15.6:0/465671710 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac159cb0 con 0x7f45ac0aeb40 2023-07-21T22:57:58.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.740+0000 7f45b1c17640 1 --2- 172.21.15.6:0/465671710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45ac0aeb40 0x7f45ac15cef0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f45a80097c0 tx=0x7f45a801e590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a742ffb02237b1a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:58.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.740+0000 7f45b0c15640 1 -- 172.21.15.6:0/465671710 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a80ab660 con 0x7f45ac0aeb40 2023-07-21T22:57:58.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.740+0000 7f45b0c15640 1 -- 172.21.15.6:0/465671710 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a80ab7c0 con 0x7f45ac0aeb40 2023-07-21T22:57:58.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.740+0000 7f45b0c15640 1 -- 172.21.15.6:0/465671710 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a80abb50 con 0x7f45ac0aeb40 2023-07-21T22:57:58.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.740+0000 7f45b3e7b640 1 -- 172.21.15.6:0/465671710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45ac0aeb40 msgr2=0x7f45ac15cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:58.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.740+0000 7f45b3e7b640 1 --2- 172.21.15.6:0/465671710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45ac0aeb40 0x7f45ac15cef0 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f45a80097c0 tx=0x7f45a801e590 comp rx=0 tx=0).stop 2023-07-21T22:57:58.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.740+0000 7f45b3e7b640 1 -- 172.21.15.6:0/465671710 shutdown_connections 2023-07-21T22:57:58.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.740+0000 7f45b3e7b640 1 --2- 172.21.15.6:0/465671710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45ac0aeb40 0x7f45ac15cef0 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.740+0000 7f45b3e7b640 1 -- 172.21.15.6:0/465671710 >> 172.21.15.6:0/465671710 conn(0x7f45ac0cde90 msgr2=0x7f45ac0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:58.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.740+0000 7f45b3e7b640 1 -- 172.21.15.6:0/465671710 shutdown_connections 2023-07-21T22:57:58.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.740+0000 7f45b3e7b640 1 -- 172.21.15.6:0/465671710 wait complete. 2023-07-21T22:57:58.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b3e7b640 1 Processor -- start 2023-07-21T22:57:58.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b3e7b640 1 -- start start 2023-07-21T22:57:58.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b3e7b640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45ac0aeb40 0x7f45ac144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b3e7b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45ac0aef10 0x7f45ac148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b3e7b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45ac159440 0x7f45ac1490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b3e7b640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac06cac0 con 0x7f45ac0aeb40 2023-07-21T22:57:58.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b3e7b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac06f9b0 con 0x7f45ac159440 2023-07-21T22:57:58.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b3e7b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ac06bf40 con 0x7f45ac0aef10 2023-07-21T22:57:58.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b1c17640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45ac0aeb40 0x7f45ac144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b1c17640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45ac0aeb40 0x7f45ac144550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50570/0 (socket says 172.21.15.6:50570) 2023-07-21T22:57:58.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b1c17640 1 -- 172.21.15.6:0/40715201 learned_addr learned my addr 172.21.15.6:0/40715201 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:58.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b1416640 1 --2- 172.21.15.6:0/40715201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45ac0aef10 0x7f45ac148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b2418640 1 --2- 172.21.15.6:0/40715201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45ac159440 0x7f45ac1490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b1c17640 1 -- 172.21.15.6:0/40715201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45ac0aef10 msgr2=0x7f45ac148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:58.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b1c17640 1 --2- 172.21.15.6:0/40715201 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f45ac0aef10 0x7f45ac148b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b1c17640 1 -- 172.21.15.6:0/40715201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45ac159440 msgr2=0x7f45ac1490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:58.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b1c17640 1 --2- 172.21.15.6:0/40715201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f45ac159440 0x7f45ac1490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b1c17640 1 -- 172.21.15.6:0/40715201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a8009420 con 0x7f45ac0aeb40 2023-07-21T22:57:58.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b1c17640 1 --2- 172.21.15.6:0/40715201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45ac0aeb40 0x7f45ac144550 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f45a80ad040 tx=0x7f45a801cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45a27fc640 1 -- 172.21.15.6:0/40715201 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a80be680 con 0x7f45ac0aeb40 2023-07-21T22:57:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45a27fc640 1 -- 172.21.15.6:0/40715201 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a80b7070 con 0x7f45ac0aeb40 2023-07-21T22:57:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b3e7b640 1 -- 172.21.15.6:0/40715201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ac06c220 con 0x7f45ac0aeb40 2023-07-21T22:57:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45a27fc640 1 -- 172.21.15.6:0/40715201 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a80bea00 con 0x7f45ac0aeb40 2023-07-21T22:57:58.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.744+0000 7f45b3e7b640 1 -- 172.21.15.6:0/40715201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ac06c7e0 con 0x7f45ac0aeb40 2023-07-21T22:57:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.748+0000 7f45b3e7b640 1 -- 172.21.15.6:0/40715201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f45ac0af380 con 0x7f45ac0aeb40 2023-07-21T22:57:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.748+0000 7f45a27fc640 1 -- 172.21.15.6:0/40715201 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f45a80b33f0 con 0x7f45ac0aeb40 2023-07-21T22:57:58.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.748+0000 7f45a27fc640 1 --2- 172.21.15.6:0/40715201 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f45900663a0 0x7f4590068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.748+0000 7f45a27fc640 1 -- 172.21.15.6:0/40715201 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f45a80b9070 con 0x7f45ac0aeb40 2023-07-21T22:57:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.748+0000 7f45a27fc640 1 --2- 172.21.15.6:0/40715201 >> [v2:172.21.15.6:6800/45975211,v1:172.21.15.6:6801/45975211] conn(0x7f459006ce80 0x7f459006f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.748+0000 7f45a27fc640 1 -- 172.21.15.6:0/40715201 --> [v2:172.21.15.6:6800/45975211,v1:172.21.15.6:6801/45975211] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f459006f960 con 0x7f459006ce80 2023-07-21T22:57:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.748+0000 7f45a27fc640 1 -- 172.21.15.6:0/40715201 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45a81232a0 con 0x7f45ac0aeb40 2023-07-21T22:57:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.748+0000 7f45b1416640 1 --2- 172.21.15.6:0/40715201 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f45900663a0 0x7f4590068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.748+0000 7f45b2418640 1 --2- 172.21.15.6:0/40715201 >> [v2:172.21.15.6:6800/45975211,v1:172.21.15.6:6801/45975211] conn(0x7f459006ce80 0x7f459006f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.748+0000 7f45b1416640 1 --2- 172.21.15.6:0/40715201 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f45900663a0 0x7f4590068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f45ac0715d0 tx=0x7f459c009040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.748+0000 7f45b2418640 1 --2- 172.21.15.6:0/40715201 >> [v2:172.21.15.6:6800/45975211,v1:172.21.15.6:6801/45975211] conn(0x7f459006ce80 0x7f459006f290 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.752+0000 7f45a27fc640 1 -- 172.21.15.6:0/40715201 <== osd.0 v2:172.21.15.6:6800/45975211 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f459006f960 con 0x7f459006ce80 2023-07-21T22:57:58.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.764+0000 7f45b3e7b640 1 -- 172.21.15.6:0/40715201 --> [v2:172.21.15.6:6800/45975211,v1:172.21.15.6:6801/45975211] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f45ac15c9d0 con 0x7f459006ce80 2023-07-21T22:57:58.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.764+0000 7f45a27fc640 1 -- 172.21.15.6:0/40715201 <== osd.0 v2:172.21.15.6:6800/45975211 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f45a4001cc0 con 0x7f459006ce80 2023-07-21T22:57:58.799 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:57:58.800 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-21T22:57:58.800 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:57:58.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.764+0000 7f45b3e7b640 1 -- 172.21.15.6:0/40715201 >> [v2:172.21.15.6:6800/45975211,v1:172.21.15.6:6801/45975211] conn(0x7f459006ce80 msgr2=0x7f459006f290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:58.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.764+0000 7f45b3e7b640 1 --2- 172.21.15.6:0/40715201 >> [v2:172.21.15.6:6800/45975211,v1:172.21.15.6:6801/45975211] conn(0x7f459006ce80 0x7f459006f290 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.764+0000 7f45b3e7b640 1 -- 172.21.15.6:0/40715201 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f45900663a0 msgr2=0x7f4590068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:58.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.764+0000 7f45b3e7b640 1 --2- 172.21.15.6:0/40715201 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f45900663a0 0x7f4590068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f45ac0715d0 tx=0x7f459c009040 comp rx=0 tx=0).stop 2023-07-21T22:57:58.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.764+0000 7f45b3e7b640 1 -- 172.21.15.6:0/40715201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45ac0aeb40 msgr2=0x7f45ac144550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:58.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.764+0000 7f45b3e7b640 1 --2- 172.21.15.6:0/40715201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45ac0aeb40 0x7f45ac144550 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f45a80ad040 tx=0x7f45a801cdd0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.764+0000 7f45b2418640 1 -- 172.21.15.6:0/40715201 reap_dead start 2023-07-21T22:57:58.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.764+0000 7f45b3e7b640 1 -- 172.21.15.6:0/40715201 shutdown_connections 2023-07-21T22:57:58.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.764+0000 7f45b3e7b640 1 -- 172.21.15.6:0/40715201 >> 172.21.15.6:0/40715201 conn(0x7f45ac0cde90 msgr2=0x7f45ac0ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:58.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.764+0000 7f45b3e7b640 1 -- 172.21.15.6:0/40715201 shutdown_connections 2023-07-21T22:57:58.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.764+0000 7f45b3e7b640 1 -- 172.21.15.6:0/40715201 wait complete. 2023-07-21T22:57:58.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-07-21T22:57:58.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.928+0000 7fe4374ca640 1 Processor -- start 2023-07-21T22:57:58.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.928+0000 7fe4374ca640 1 -- start start 2023-07-21T22:57:58.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.928+0000 7fe4374ca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe430070b70 0x7fe430070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.928+0000 7fe4374ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4300cb100 0x7fe4300cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.928+0000 7fe4374ca640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4300cac70 con 0x7fe43006b1e0 2023-07-21T22:57:58.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.928+0000 7fe4374ca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4300cbaa0 con 0x7fe430070b70 2023-07-21T22:57:58.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.928+0000 7fe4374ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe430071480 con 0x7fe4300cb100 2023-07-21T22:57:58.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.928+0000 7fe435266640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe430070b70 0x7fe430070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.928+0000 7fe434a65640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe43006b1e0 0x7fe4300c1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39918/0 (socket says 172.21.15.6:39918) 2023-07-21T22:57:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.928+0000 7fe434a65640 1 -- 172.21.15.6:0/611605067 learned_addr learned my addr 172.21.15.6:0/611605067 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.928+0000 7fe435266640 1 -- 172.21.15.6:0/611605067 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4300cb100 msgr2=0x7fe4300cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.928+0000 7fe435266640 1 --2- 172.21.15.6:0/611605067 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4300cb100 0x7fe4300cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.928+0000 7fe435266640 1 -- 172.21.15.6:0/611605067 >> v1:172.21.15.6:6789/0 conn(0x7fe43006b1e0 legacy=0x7fe4300c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:58.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.928+0000 7fe435266640 1 -- 172.21.15.6:0/611605067 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4300ca060 con 0x7fe430070b70 2023-07-21T22:57:58.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.932+0000 7fe435266640 1 --2- 172.21.15.6:0/611605067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe430070b70 0x7fe430070f40 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0097c0 tx=0x7fe42c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd6ec1a5af5a5ac server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:58.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.932+0000 7fe427fff640 1 -- 172.21.15.6:0/611605067 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0ab650 con 0x7fe430070b70 2023-07-21T22:57:58.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.932+0000 7fe427fff640 1 -- 172.21.15.6:0/611605067 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42c0ab7b0 con 0x7fe430070b70 2023-07-21T22:57:58.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.932+0000 7fe427fff640 1 -- 172.21.15.6:0/611605067 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42c0abb40 con 0x7fe430070b70 2023-07-21T22:57:58.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.932+0000 7fe4374ca640 1 -- 172.21.15.6:0/611605067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe430070b70 msgr2=0x7fe430070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:58.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.932+0000 7fe4374ca640 1 --2- 172.21.15.6:0/611605067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe430070b70 0x7fe430070f40 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0097c0 tx=0x7fe42c01c450 comp rx=0 tx=0).stop 2023-07-21T22:57:58.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.932+0000 7fe4374ca640 1 -- 172.21.15.6:0/611605067 shutdown_connections 2023-07-21T22:57:58.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.932+0000 7fe4374ca640 1 --2- 172.21.15.6:0/611605067 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4300cb100 0x7fe4300cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.932+0000 7fe4374ca640 1 --2- 172.21.15.6:0/611605067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe430070b70 0x7fe430070f40 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.932+0000 7fe4374ca640 1 -- 172.21.15.6:0/611605067 >> 172.21.15.6:0/611605067 conn(0x7fe4300afcf0 msgr2=0x7fe4300b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:58.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.932+0000 7fe4374ca640 1 -- 172.21.15.6:0/611605067 shutdown_connections 2023-07-21T22:57:58.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.932+0000 7fe4374ca640 1 -- 172.21.15.6:0/611605067 wait complete. 2023-07-21T22:57:58.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe4374ca640 1 Processor -- start 2023-07-21T22:57:58.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe4374ca640 1 -- start start 2023-07-21T22:57:58.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe4374ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe43006b1e0 0x7fe430152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe4374ca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe430070b70 0x7fe43014cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe4374ca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4300cb100 0x7fe4300cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe4374ca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43014db80 con 0x7fe4300cb100 2023-07-21T22:57:58.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe4374ca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe430151f00 con 0x7fe430070b70 2023-07-21T22:57:58.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe4374ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4301521e0 con 0x7fe43006b1e0 2023-07-21T22:57:58.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe435a67640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4300cb100 0x7fe4300cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe435a67640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4300cb100 0x7fe4300cd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50574/0 (socket says 172.21.15.6:50574) 2023-07-21T22:57:58.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe435a67640 1 -- 172.21.15.6:0/2470887519 learned_addr learned my addr 172.21.15.6:0/2470887519 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:58.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe435266640 1 --2- 172.21.15.6:0/2470887519 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe43006b1e0 0x7fe430152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe434a65640 1 --2- 172.21.15.6:0/2470887519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe430070b70 0x7fe43014cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe435a67640 1 -- 172.21.15.6:0/2470887519 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe43006b1e0 msgr2=0x7fe430152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:58.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe435a67640 1 --2- 172.21.15.6:0/2470887519 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe43006b1e0 0x7fe430152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe435a67640 1 -- 172.21.15.6:0/2470887519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe430070b70 msgr2=0x7fe43014cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:58.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe435a67640 1 --2- 172.21.15.6:0/2470887519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe430070b70 0x7fe43014cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe435a67640 1 -- 172.21.15.6:0/2470887519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c009420 con 0x7fe4300cb100 2023-07-21T22:57:58.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe434a65640 1 --2- 172.21.15.6:0/2470887519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe430070b70 0x7fe43014cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:58.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe435a67640 1 --2- 172.21.15.6:0/2470887519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4300cb100 0x7fe4300cd3b0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7fe42800b970 tx=0x7fe42800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:58.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe425ffb640 1 -- 172.21.15.6:0/2470887519 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42800cb40 con 0x7fe4300cb100 2023-07-21T22:57:58.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe425ffb640 1 -- 172.21.15.6:0/2470887519 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42800ccc0 con 0x7fe4300cb100 2023-07-21T22:57:58.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe425ffb640 1 -- 172.21.15.6:0/2470887519 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428014680 con 0x7fe4300cb100 2023-07-21T22:57:58.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe4374ca640 1 -- 172.21.15.6:0/2470887519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4301524c0 con 0x7fe4300cb100 2023-07-21T22:57:58.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.936+0000 7fe4374ca640 1 -- 172.21.15.6:0/2470887519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe430152a80 con 0x7fe4300cb100 2023-07-21T22:57:58.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.940+0000 7fe4374ca640 1 -- 172.21.15.6:0/2470887519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4300678d0 con 0x7fe4300cb100 2023-07-21T22:57:58.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.940+0000 7fe425ffb640 1 -- 172.21.15.6:0/2470887519 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe42801d3b0 con 0x7fe4300cb100 2023-07-21T22:57:58.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.940+0000 7fe425ffb640 1 --2- 172.21.15.6:0/2470887519 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fe4140663a0 0x7fe414068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.940+0000 7fe425ffb640 1 -- 172.21.15.6:0/2470887519 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7fe428083e80 con 0x7fe4300cb100 2023-07-21T22:57:58.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.940+0000 7fe435266640 1 --2- 172.21.15.6:0/2470887519 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fe4140663a0 0x7fe414068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.940+0000 7fe435266640 1 --2- 172.21.15.6:0/2470887519 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fe4140663a0 0x7fe414068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0af000 tx=0x7fe42c0a7000 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:58.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:58.944+0000 7fe425ffb640 1 -- 172.21.15.6:0/2470887519 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe4280511d0 con 0x7fe4300cb100 2023-07-21T22:57:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.100+0000 7fe4374ca640 1 -- 172.21.15.6:0/2470887519 --> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fe43006f5b0 con 0x7fe4140663a0 2023-07-21T22:57:59.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.100+0000 7fe425ffb640 1 -- 172.21.15.6:0/2470887519 <== mgr.10231 v2:172.21.15.161:6832/1416042622 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe42c0aba20 con 0x7fe4140663a0 2023-07-21T22:57:59.136 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 0 to deep-scrub 2023-07-21T22:57:59.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.100+0000 7fe4374ca640 1 -- 172.21.15.6:0/2470887519 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fe4140663a0 msgr2=0x7fe414068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.100+0000 7fe4374ca640 1 --2- 172.21.15.6:0/2470887519 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fe4140663a0 0x7fe414068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe42c0af000 tx=0x7fe42c0a7000 comp rx=0 tx=0).stop 2023-07-21T22:57:59.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.100+0000 7fe4374ca640 1 -- 172.21.15.6:0/2470887519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4300cb100 msgr2=0x7fe4300cd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.100+0000 7fe4374ca640 1 --2- 172.21.15.6:0/2470887519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4300cb100 0x7fe4300cd3b0 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7fe42800b970 tx=0x7fe42800be30 comp rx=0 tx=0).stop 2023-07-21T22:57:59.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.104+0000 7fe4374ca640 1 -- 172.21.15.6:0/2470887519 shutdown_connections 2023-07-21T22:57:59.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.104+0000 7fe4374ca640 1 --2- 172.21.15.6:0/2470887519 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fe4140663a0 0x7fe414068850 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.104+0000 7fe4374ca640 1 --2- 172.21.15.6:0/2470887519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4300cb100 0x7fe4300cd3b0 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.104+0000 7fe4374ca640 1 --2- 172.21.15.6:0/2470887519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe430070b70 0x7fe43014cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.104+0000 7fe4374ca640 1 --2- 172.21.15.6:0/2470887519 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe43006b1e0 0x7fe430152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.104+0000 7fe4374ca640 1 -- 172.21.15.6:0/2470887519 >> 172.21.15.6:0/2470887519 conn(0x7fe4300afcf0 msgr2=0x7fe4300c1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:59.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.104+0000 7fe4374ca640 1 -- 172.21.15.6:0/2470887519 shutdown_connections 2023-07-21T22:57:59.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.104+0000 7fe4374ca640 1 -- 172.21.15.6:0/2470887519 wait complete. 2023-07-21T22:57:59.157 INFO:tasks.ceph:Scrubbing osd.1 2023-07-21T22:57:59.158 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-07-21T22:57:59.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.272+0000 7f31519ad640 1 Processor -- start 2023-07-21T22:57:59.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.272+0000 7f31519ad640 1 -- start start 2023-07-21T22:57:59.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.272+0000 7f31519ad640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f314c06a540 0x7f314c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:59.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.272+0000 7f31519ad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f314c0cf710 0x7f314c0cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:59.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.272+0000 7f31519ad640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314c0cb7a0 con 0x7f314c0cf2e0 2023-07-21T22:57:59.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.272+0000 7f31519ad640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314c0d0920 con 0x7f314c06a540 2023-07-21T22:57:59.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.272+0000 7f31519ad640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314c15bfd0 con 0x7f314c0cf710 2023-07-21T22:57:59.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.272+0000 7f314b7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f314c0cf710 0x7f314c0cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.272+0000 7f314affd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f314c06a540 0x7f314c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.272+0000 7f3143fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f314c0cf2e0 0x7f314c0cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.6:60254/0 (socket says 172.21.15.6:60254) 2023-07-21T22:57:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.272+0000 7f3143fff640 1 -- 172.21.15.6:0/2202450225 learned_addr learned my addr 172.21.15.6:0/2202450225 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:57:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.272+0000 7f314affd640 1 -- 172.21.15.6:0/2202450225 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f314c0cf710 msgr2=0x7f314c0cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.272+0000 7f314affd640 1 --2- 172.21.15.6:0/2202450225 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f314c0cf710 0x7f314c0cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.272+0000 7f314affd640 1 -- 172.21.15.6:0/2202450225 >> v1:172.21.15.161:6789/0 conn(0x7f314c0cf2e0 legacy=0x7f314c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.272+0000 7f314affd640 1 -- 172.21.15.6:0/2202450225 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c06ae50 con 0x7f314c06a540 2023-07-21T22:57:59.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.276+0000 7f314affd640 1 --2- 172.21.15.6:0/2202450225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f314c06a540 0x7f314c06a910 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f313c0097c0 tx=0x7f313c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc0b15a9c74db357 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:59.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.280+0000 7f314a7fc640 1 -- 172.21.15.6:0/2202450225 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c0ad660 con 0x7f314c06a540 2023-07-21T22:57:59.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.280+0000 7f314a7fc640 1 -- 172.21.15.6:0/2202450225 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c0ad7c0 con 0x7f314c06a540 2023-07-21T22:57:59.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.280+0000 7f314a7fc640 1 -- 172.21.15.6:0/2202450225 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c0adb50 con 0x7f314c06a540 2023-07-21T22:57:59.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.280+0000 7f31519ad640 1 -- 172.21.15.6:0/2202450225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f314c06a540 msgr2=0x7f314c06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.280+0000 7f31519ad640 1 --2- 172.21.15.6:0/2202450225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f314c06a540 0x7f314c06a910 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f313c0097c0 tx=0x7f313c01c450 comp rx=0 tx=0).stop 2023-07-21T22:57:59.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.280+0000 7f31519ad640 1 -- 172.21.15.6:0/2202450225 shutdown_connections 2023-07-21T22:57:59.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.280+0000 7f31519ad640 1 --2- 172.21.15.6:0/2202450225 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f314c0cf710 0x7f314c0cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.280+0000 7f31519ad640 1 --2- 172.21.15.6:0/2202450225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f314c06a540 0x7f314c06a910 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.280+0000 7f31519ad640 1 -- 172.21.15.6:0/2202450225 >> 172.21.15.6:0/2202450225 conn(0x7f314c099490 msgr2=0x7f314c089fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:59.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.280+0000 7f31519ad640 1 -- 172.21.15.6:0/2202450225 shutdown_connections 2023-07-21T22:57:59.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.280+0000 7f31519ad640 1 -- 172.21.15.6:0/2202450225 wait complete. 2023-07-21T22:57:59.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f31519ad640 1 Processor -- start 2023-07-21T22:57:59.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f31519ad640 1 -- start start 2023-07-21T22:57:59.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f31519ad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f314c06a540 0x7f314c14a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:59.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f31519ad640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f314c0cf2e0 0x7f314c1590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:59.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f31519ad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f314c0cf710 0x7f314c0b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:59.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f31519ad640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c153c20 con 0x7f314c0cf2e0 2023-07-21T22:57:59.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f31519ad640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c153380 con 0x7f314c06a540 2023-07-21T22:57:59.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f31519ad640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314c153660 con 0x7f314c0cf710 2023-07-21T22:57:59.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f3143fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f314c0cf2e0 0x7f314c1590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:59.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f314affd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f314c06a540 0x7f314c14a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:59.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f314affd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f314c06a540 0x7f314c14a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35072/0 (socket says 172.21.15.6:35072) 2023-07-21T22:57:59.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f314affd640 1 -- 172.21.15.6:0/791214115 learned_addr learned my addr 172.21.15.6:0/791214115 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:59.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f314b7fe640 1 --2- 172.21.15.6:0/791214115 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f314c0cf710 0x7f314c0b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:59.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f3143fff640 1 -- 172.21.15.6:0/791214115 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f314c0cf710 msgr2=0x7f314c0b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f3143fff640 1 --2- 172.21.15.6:0/791214115 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f314c0cf710 0x7f314c0b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f3143fff640 1 -- 172.21.15.6:0/791214115 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f314c06a540 msgr2=0x7f314c14a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f3143fff640 1 --2- 172.21.15.6:0/791214115 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f314c06a540 0x7f314c14a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f3143fff640 1 -- 172.21.15.6:0/791214115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c009420 con 0x7f314c0cf2e0 2023-07-21T22:57:59.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f3143fff640 1 --2- 172.21.15.6:0/791214115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f314c0cf2e0 0x7f314c1590b0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f314c0cdbd0 tx=0x7f313400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:59.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f3148ff9640 1 -- 172.21.15.6:0/791214115 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3134005cf0 con 0x7f314c0cf2e0 2023-07-21T22:57:59.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f3148ff9640 1 -- 172.21.15.6:0/791214115 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3134005e50 con 0x7f314c0cf2e0 2023-07-21T22:57:59.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f3148ff9640 1 -- 172.21.15.6:0/791214115 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31340072d0 con 0x7f314c0cf2e0 2023-07-21T22:57:59.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f31519ad640 1 -- 172.21.15.6:0/791214115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314c153940 con 0x7f314c0cf2e0 2023-07-21T22:57:59.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.284+0000 7f31519ad640 1 -- 172.21.15.6:0/791214115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314c14add0 con 0x7f314c0cf2e0 2023-07-21T22:57:59.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.288+0000 7f31519ad640 1 -- 172.21.15.6:0/791214115 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f314c0d05b0 con 0x7f314c0cf2e0 2023-07-21T22:57:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.288+0000 7f3148ff9640 1 -- 172.21.15.6:0/791214115 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3134007430 con 0x7f314c0cf2e0 2023-07-21T22:57:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.288+0000 7f3148ff9640 1 --2- 172.21.15.6:0/791214115 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f312c0663a0 0x7f312c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:59.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.288+0000 7f3148ff9640 1 -- 172.21.15.6:0/791214115 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f3134083320 con 0x7f314c0cf2e0 2023-07-21T22:57:59.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.288+0000 7f3148ff9640 1 --2- 172.21.15.6:0/791214115 >> [v2:172.21.15.6:6816/2815481744,v1:172.21.15.6:6817/2815481744] conn(0x7f312c06ce80 0x7f312c06f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:59.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.288+0000 7f3148ff9640 1 -- 172.21.15.6:0/791214115 --> [v2:172.21.15.6:6816/2815481744,v1:172.21.15.6:6817/2815481744] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f312c06f960 con 0x7f312c06ce80 2023-07-21T22:57:59.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.288+0000 7f3148ff9640 1 -- 172.21.15.6:0/791214115 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3134085900 con 0x7f314c0cf2e0 2023-07-21T22:57:59.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.288+0000 7f314affd640 1 --2- 172.21.15.6:0/791214115 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f312c0663a0 0x7f312c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:59.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.288+0000 7f314b7fe640 1 --2- 172.21.15.6:0/791214115 >> [v2:172.21.15.6:6816/2815481744,v1:172.21.15.6:6817/2815481744] conn(0x7f312c06ce80 0x7f312c06f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:59.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.288+0000 7f314b7fe640 1 --2- 172.21.15.6:0/791214115 >> [v2:172.21.15.6:6816/2815481744,v1:172.21.15.6:6817/2815481744] conn(0x7f312c06ce80 0x7f312c06f290 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:59.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.288+0000 7f314affd640 1 --2- 172.21.15.6:0/791214115 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f312c0663a0 0x7f312c068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f313c01c490 tx=0x7f313c008040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:59.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.292+0000 7f3148ff9640 1 -- 172.21.15.6:0/791214115 <== osd.1 v2:172.21.15.6:6816/2815481744 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f312c06f960 con 0x7f312c06ce80 2023-07-21T22:57:59.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.304+0000 7f31519ad640 1 -- 172.21.15.6:0/791214115 --> [v2:172.21.15.6:6816/2815481744,v1:172.21.15.6:6817/2815481744] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f314c0d02d0 con 0x7f312c06ce80 2023-07-21T22:57:59.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.304+0000 7f3148ff9640 1 -- 172.21.15.6:0/791214115 <== osd.1 v2:172.21.15.6:6816/2815481744 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f314400f040 con 0x7f312c06ce80 2023-07-21T22:57:59.339 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:57:59.339 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-21T22:57:59.340 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:57:59.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.304+0000 7f31519ad640 1 -- 172.21.15.6:0/791214115 >> [v2:172.21.15.6:6816/2815481744,v1:172.21.15.6:6817/2815481744] conn(0x7f312c06ce80 msgr2=0x7f312c06f290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.304+0000 7f31519ad640 1 --2- 172.21.15.6:0/791214115 >> [v2:172.21.15.6:6816/2815481744,v1:172.21.15.6:6817/2815481744] conn(0x7f312c06ce80 0x7f312c06f290 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.304+0000 7f31519ad640 1 -- 172.21.15.6:0/791214115 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f312c0663a0 msgr2=0x7f312c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.304+0000 7f31519ad640 1 --2- 172.21.15.6:0/791214115 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f312c0663a0 0x7f312c068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f313c01c490 tx=0x7f313c008040 comp rx=0 tx=0).stop 2023-07-21T22:57:59.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.304+0000 7f31519ad640 1 -- 172.21.15.6:0/791214115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f314c0cf2e0 msgr2=0x7f314c1590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.304+0000 7f31519ad640 1 --2- 172.21.15.6:0/791214115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f314c0cf2e0 0x7f314c1590b0 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f314c0cdbd0 tx=0x7f313400c820 comp rx=0 tx=0).stop 2023-07-21T22:57:59.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.304+0000 7f314b7fe640 1 -- 172.21.15.6:0/791214115 reap_dead start 2023-07-21T22:57:59.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.304+0000 7f31519ad640 1 -- 172.21.15.6:0/791214115 shutdown_connections 2023-07-21T22:57:59.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.304+0000 7f31519ad640 1 -- 172.21.15.6:0/791214115 >> 172.21.15.6:0/791214115 conn(0x7f314c099490 msgr2=0x7f314c0ae1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:59.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.304+0000 7f31519ad640 1 -- 172.21.15.6:0/791214115 shutdown_connections 2023-07-21T22:57:59.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.304+0000 7f31519ad640 1 -- 172.21.15.6:0/791214115 wait complete. 2023-07-21T22:57:59.357 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-07-21T22:57:59.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.468+0000 7fb0ae1e6640 1 Processor -- start 2023-07-21T22:57:59.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.468+0000 7fb0ae1e6640 1 -- start start 2023-07-21T22:57:59.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.468+0000 7fb0ae1e6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0a815f3f0 0x7fb0a80b7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:59.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.468+0000 7fb0ae1e6640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0a80d13f0 0x7fb0a80b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:59.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.468+0000 7fb0ae1e6640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a80d0f60 con 0x7fb0a80cc9a0 2023-07-21T22:57:59.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.468+0000 7fb0ae1e6640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a80cd4e0 con 0x7fb0a80d13f0 2023-07-21T22:57:59.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.468+0000 7fb0ae1e6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80d0390 con 0x7fb0a815f3f0 2023-07-21T22:57:59.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.468+0000 7fb0ac9e3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0a80d13f0 0x7fb0a80b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:59.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.468+0000 7fb0ac9e3640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb0a80d13f0 0x7fb0a80b7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50598/0 (socket says 172.21.15.6:50598) 2023-07-21T22:57:59.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.468+0000 7fb0ac9e3640 1 -- 172.21.15.6:0/1884282121 learned_addr learned my addr 172.21.15.6:0/1884282121 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:59.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.468+0000 7fb0ad1e4640 1 --2- 172.21.15.6:0/1884282121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0a815f3f0 0x7fb0a80b7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:59.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.468+0000 7fb0ac9e3640 1 -- 172.21.15.6:0/1884282121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0a815f3f0 msgr2=0x7fb0a80b7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:59.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.468+0000 7fb0ac9e3640 1 --2- 172.21.15.6:0/1884282121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0a815f3f0 0x7fb0a80b7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.468+0000 7fb0ac9e3640 1 -- 172.21.15.6:0/1884282121 >> v1:172.21.15.161:6789/0 conn(0x7fb0a80cc9a0 legacy=0x7fb0a80ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.468+0000 7fb0ac9e3640 1 -- 172.21.15.6:0/1884282121 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a80d0630 con 0x7fb0a80d13f0 2023-07-21T22:57:59.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.472+0000 7fb0ac9e3640 1 --2- 172.21.15.6:0/1884282121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a80d13f0 0x7fb0a80b7bc0 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7fb098009870 tx=0x7fb09801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e119509c85951bc5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:59.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.472+0000 7fb09ffff640 1 -- 172.21.15.6:0/1884282121 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0980ac600 con 0x7fb0a80d13f0 2023-07-21T22:57:59.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.472+0000 7fb09ffff640 1 -- 172.21.15.6:0/1884282121 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0980a8050 con 0x7fb0a80d13f0 2023-07-21T22:57:59.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.472+0000 7fb09ffff640 1 -- 172.21.15.6:0/1884282121 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0980ac980 con 0x7fb0a80d13f0 2023-07-21T22:57:59.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.472+0000 7fb0ae1e6640 1 -- 172.21.15.6:0/1884282121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a80d13f0 msgr2=0x7fb0a80b7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.472+0000 7fb0ae1e6640 1 --2- 172.21.15.6:0/1884282121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a80d13f0 0x7fb0a80b7bc0 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7fb098009870 tx=0x7fb09801c4b0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.472+0000 7fb0ae1e6640 1 -- 172.21.15.6:0/1884282121 shutdown_connections 2023-07-21T22:57:59.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.472+0000 7fb0ae1e6640 1 --2- 172.21.15.6:0/1884282121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a80d13f0 0x7fb0a80b7bc0 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.472+0000 7fb0ae1e6640 1 --2- 172.21.15.6:0/1884282121 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0a815f3f0 0x7fb0a80b7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.472+0000 7fb0ae1e6640 1 -- 172.21.15.6:0/1884282121 >> 172.21.15.6:0/1884282121 conn(0x7fb0a8069f50 msgr2=0x7fb0a806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:59.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.472+0000 7fb0ae1e6640 1 -- 172.21.15.6:0/1884282121 shutdown_connections 2023-07-21T22:57:59.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.472+0000 7fb0ae1e6640 1 -- 172.21.15.6:0/1884282121 wait complete. 2023-07-21T22:57:59.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ae1e6640 1 Processor -- start 2023-07-21T22:57:59.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ae1e6640 1 -- start start 2023-07-21T22:57:59.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ae1e6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0a80cc9a0 0x7fb0a80caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:59.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ae1e6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0a80d13f0 0x7fb0a814e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:59.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ae1e6640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a815f3f0 0x7fb0a80c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:59.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ae1e6640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80c9c00 con 0x7fb0a815f3f0 2023-07-21T22:57:59.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ae1e6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80c9ee0 con 0x7fb0a80cc9a0 2023-07-21T22:57:59.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ae1e6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80ca1c0 con 0x7fb0a80d13f0 2023-07-21T22:57:59.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ad9e5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a815f3f0 0x7fb0a80c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:59.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ad9e5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a815f3f0 0x7fb0a80c9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50600/0 (socket says 172.21.15.6:50600) 2023-07-21T22:57:59.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ad9e5640 1 -- 172.21.15.6:0/1884910004 learned_addr learned my addr 172.21.15.6:0/1884910004 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:59.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ad1e4640 1 --2- 172.21.15.6:0/1884910004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0a80cc9a0 0x7fb0a80caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:59.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ac9e3640 1 --2- 172.21.15.6:0/1884910004 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0a80d13f0 0x7fb0a814e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:59.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ad9e5640 1 -- 172.21.15.6:0/1884910004 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0a80d13f0 msgr2=0x7fb0a814e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ad9e5640 1 --2- 172.21.15.6:0/1884910004 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0a80d13f0 0x7fb0a814e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ad9e5640 1 -- 172.21.15.6:0/1884910004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0a80cc9a0 msgr2=0x7fb0a80caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ad9e5640 1 --2- 172.21.15.6:0/1884910004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0a80cc9a0 0x7fb0a80caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ad9e5640 1 -- 172.21.15.6:0/1884910004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0980094d0 con 0x7fb0a815f3f0 2023-07-21T22:57:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ad9e5640 1 --2- 172.21.15.6:0/1884910004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a815f3f0 0x7fb0a80c9290 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000c770 tx=0x7fb0a000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb09dffb640 1 -- 172.21.15.6:0/1884910004 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0003b80 con 0x7fb0a815f3f0 2023-07-21T22:57:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb09dffb640 1 -- 172.21.15.6:0/1884910004 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a0003ce0 con 0x7fb0a815f3f0 2023-07-21T22:57:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ae1e6640 1 -- 172.21.15.6:0/1884910004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a80ca4a0 con 0x7fb0a815f3f0 2023-07-21T22:57:59.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb09dffb640 1 -- 172.21.15.6:0/1884910004 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a000aa90 con 0x7fb0a815f3f0 2023-07-21T22:57:59.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.476+0000 7fb0ae1e6640 1 -- 172.21.15.6:0/1884910004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a80c97d0 con 0x7fb0a815f3f0 2023-07-21T22:57:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.480+0000 7fb0ae1e6640 1 -- 172.21.15.6:0/1884910004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a80678d0 con 0x7fb0a815f3f0 2023-07-21T22:57:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.480+0000 7fb09dffb640 1 -- 172.21.15.6:0/1884910004 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb0a000abf0 con 0x7fb0a815f3f0 2023-07-21T22:57:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.480+0000 7fb09dffb640 1 --2- 172.21.15.6:0/1884910004 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fb08c0663a0 0x7fb08c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:59.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.480+0000 7fb09dffb640 1 -- 172.21.15.6:0/1884910004 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7fb0a0083c90 con 0x7fb0a815f3f0 2023-07-21T22:57:59.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.480+0000 7fb0ad1e4640 1 --2- 172.21.15.6:0/1884910004 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fb08c0663a0 0x7fb08c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:59.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.480+0000 7fb0ad1e4640 1 --2- 172.21.15.6:0/1884910004 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fb08c0663a0 0x7fb08c068850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40079c0 tx=0x7fb0a4008040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:59.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.484+0000 7fb09dffb640 1 -- 172.21.15.6:0/1884910004 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0a0050fe0 con 0x7fb0a815f3f0 2023-07-21T22:57:59.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.640+0000 7fb0ae1e6640 1 -- 172.21.15.6:0/1884910004 --> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0a815f7c0 con 0x7fb08c0663a0 2023-07-21T22:57:59.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.640+0000 7fb09dffb640 1 -- 172.21.15.6:0/1884910004 <== mgr.10231 v2:172.21.15.161:6832/1416042622 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb0a40108d0 con 0x7fb08c0663a0 2023-07-21T22:57:59.674 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 1 to deep-scrub 2023-07-21T22:57:59.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.640+0000 7fb0ae1e6640 1 -- 172.21.15.6:0/1884910004 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fb08c0663a0 msgr2=0x7fb08c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.640+0000 7fb0ae1e6640 1 --2- 172.21.15.6:0/1884910004 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fb08c0663a0 0x7fb08c068850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb0a40079c0 tx=0x7fb0a4008040 comp rx=0 tx=0).stop 2023-07-21T22:57:59.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.640+0000 7fb0ae1e6640 1 -- 172.21.15.6:0/1884910004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a815f3f0 msgr2=0x7fb0a80c9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.640+0000 7fb0ae1e6640 1 --2- 172.21.15.6:0/1884910004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a815f3f0 0x7fb0a80c9290 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000c770 tx=0x7fb0a000cc30 comp rx=0 tx=0).stop 2023-07-21T22:57:59.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.640+0000 7fb0ae1e6640 1 -- 172.21.15.6:0/1884910004 shutdown_connections 2023-07-21T22:57:59.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.640+0000 7fb0ae1e6640 1 --2- 172.21.15.6:0/1884910004 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fb08c0663a0 0x7fb08c068850 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.640+0000 7fb0ae1e6640 1 --2- 172.21.15.6:0/1884910004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0a815f3f0 0x7fb0a80c9290 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.640+0000 7fb0ae1e6640 1 --2- 172.21.15.6:0/1884910004 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb0a80d13f0 0x7fb0a814e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.640+0000 7fb0ae1e6640 1 --2- 172.21.15.6:0/1884910004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0a80cc9a0 0x7fb0a80caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.640+0000 7fb0ae1e6640 1 -- 172.21.15.6:0/1884910004 >> 172.21.15.6:0/1884910004 conn(0x7fb0a8069f50 msgr2=0x7fb0a80b7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:59.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.640+0000 7fb0ae1e6640 1 -- 172.21.15.6:0/1884910004 shutdown_connections 2023-07-21T22:57:59.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.640+0000 7fb0ae1e6640 1 -- 172.21.15.6:0/1884910004 wait complete. 2023-07-21T22:57:59.696 INFO:tasks.ceph:Scrubbing osd.2 2023-07-21T22:57:59.697 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-07-21T22:57:59.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.808+0000 7f1938cca640 1 Processor -- start 2023-07-21T22:57:59.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.808+0000 7f1938cca640 1 -- start start 2023-07-21T22:57:59.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.808+0000 7f1938cca640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1934069430 0x7f1934069800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:59.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.812+0000 7f1938cca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1934070f30 0x7f19340ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:59.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.812+0000 7f1938cca640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1934159d70 con 0x7f19340af2b0 2023-07-21T22:57:59.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.812+0000 7f1938cca640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1934069d40 con 0x7f1934069430 2023-07-21T22:57:59.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.812+0000 7f1938cca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19340c9c60 con 0x7f1934070f30 2023-07-21T22:57:59.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.812+0000 7f193259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1934069430 0x7f1934069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:59.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.812+0000 7f193259c640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1934069430 0x7f1934069800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50606/0 (socket says 172.21.15.6:50606) 2023-07-21T22:57:59.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.812+0000 7f193259c640 1 -- 172.21.15.6:0/2183548671 learned_addr learned my addr 172.21.15.6:0/2183548671 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:59.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.812+0000 7f192bfff640 1 --2- 172.21.15.6:0/2183548671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1934070f30 0x7f19340ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:59.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.812+0000 7f193259c640 1 -- 172.21.15.6:0/2183548671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1934070f30 msgr2=0x7f19340ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:59.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.812+0000 7f193259c640 1 --2- 172.21.15.6:0/2183548671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1934070f30 0x7f19340ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.812+0000 7f193259c640 1 -- 172.21.15.6:0/2183548671 >> v1:172.21.15.161:6789/0 conn(0x7f19340af2b0 legacy=0x7f193415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.812+0000 7f193259c640 1 -- 172.21.15.6:0/2183548671 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19340c9f40 con 0x7f1934069430 2023-07-21T22:57:59.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.812+0000 7f192bfff640 1 --2- 172.21.15.6:0/2183548671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1934070f30 0x7f19340ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:59.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.812+0000 7f193259c640 1 --2- 172.21.15.6:0/2183548671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1934069430 0x7f1934069800 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f1924009870 tx=0x7f192401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1671de62c1b9993 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:59.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.816+0000 7f1931d9b640 1 -- 172.21.15.6:0/2183548671 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19240ab650 con 0x7f1934069430 2023-07-21T22:57:59.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.816+0000 7f1931d9b640 1 -- 172.21.15.6:0/2183548671 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19240ab7b0 con 0x7f1934069430 2023-07-21T22:57:59.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.816+0000 7f1931d9b640 1 -- 172.21.15.6:0/2183548671 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19240abb40 con 0x7f1934069430 2023-07-21T22:57:59.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.816+0000 7f1938cca640 1 -- 172.21.15.6:0/2183548671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1934069430 msgr2=0x7f1934069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.816+0000 7f1938cca640 1 --2- 172.21.15.6:0/2183548671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1934069430 0x7f1934069800 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f1924009870 tx=0x7f192401c540 comp rx=0 tx=0).stop 2023-07-21T22:57:59.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.816+0000 7f1938cca640 1 -- 172.21.15.6:0/2183548671 shutdown_connections 2023-07-21T22:57:59.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.816+0000 7f1938cca640 1 --2- 172.21.15.6:0/2183548671 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1934070f30 0x7f19340ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.816+0000 7f1938cca640 1 --2- 172.21.15.6:0/2183548671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1934069430 0x7f1934069800 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.816+0000 7f1938cca640 1 -- 172.21.15.6:0/2183548671 >> 172.21.15.6:0/2183548671 conn(0x7f19340cde90 msgr2=0x7f19340ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:59.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.816+0000 7f1938cca640 1 -- 172.21.15.6:0/2183548671 shutdown_connections 2023-07-21T22:57:59.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.816+0000 7f1938cca640 1 -- 172.21.15.6:0/2183548671 wait complete. 2023-07-21T22:57:59.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.816+0000 7f1938cca640 1 Processor -- start 2023-07-21T22:57:59.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.816+0000 7f1938cca640 1 -- start start 2023-07-21T22:57:59.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.816+0000 7f1938cca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1934069430 0x7f193406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:59.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.816+0000 7f1938cca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1934070f30 0x7f1934149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.816+0000 7f1938cca640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19340af2b0 0x7f19340c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.816+0000 7f1938cca640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193406b7e0 con 0x7f19340af2b0 2023-07-21T22:57:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.816+0000 7f1938cca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193406c1b0 con 0x7f1934069430 2023-07-21T22:57:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.816+0000 7f1938cca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19341495c0 con 0x7f1934070f30 2023-07-21T22:57:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.816+0000 7f1932d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19340af2b0 0x7f19340c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:59.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.820+0000 7f1932d9d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19340af2b0 0x7f19340c2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50622/0 (socket says 172.21.15.6:50622) 2023-07-21T22:57:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.820+0000 7f1932d9d640 1 -- 172.21.15.6:0/3223409668 learned_addr learned my addr 172.21.15.6:0/3223409668 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:57:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.820+0000 7f193259c640 1 --2- 172.21.15.6:0/3223409668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1934069430 0x7f193406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.820+0000 7f192bfff640 1 --2- 172.21.15.6:0/3223409668 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1934070f30 0x7f1934149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.820+0000 7f1932d9d640 1 -- 172.21.15.6:0/3223409668 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1934070f30 msgr2=0x7f1934149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.820+0000 7f1932d9d640 1 --2- 172.21.15.6:0/3223409668 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1934070f30 0x7f1934149080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.820+0000 7f1932d9d640 1 -- 172.21.15.6:0/3223409668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1934069430 msgr2=0x7f193406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.820+0000 7f1932d9d640 1 --2- 172.21.15.6:0/3223409668 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1934069430 0x7f193406bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.820+0000 7f1932d9d640 1 -- 172.21.15.6:0/3223409668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19240094d0 con 0x7f19340af2b0 2023-07-21T22:57:59.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.820+0000 7f192bfff640 1 --2- 172.21.15.6:0/3223409668 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1934070f30 0x7f1934149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:59.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.820+0000 7f1932d9d640 1 --2- 172.21.15.6:0/3223409668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19340af2b0 0x7f19340c2d30 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f192c00c770 tx=0x7f192c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:59.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.820+0000 7f192affd640 1 -- 172.21.15.6:0/3223409668 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c003b80 con 0x7f19340af2b0 2023-07-21T22:57:59.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.820+0000 7f192affd640 1 -- 172.21.15.6:0/3223409668 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c003ce0 con 0x7f19340af2b0 2023-07-21T22:57:59.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.820+0000 7f1938cca640 1 -- 172.21.15.6:0/3223409668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1934070300 con 0x7f19340af2b0 2023-07-21T22:57:59.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.820+0000 7f192affd640 1 -- 172.21.15.6:0/3223409668 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c00aa90 con 0x7f19340af2b0 2023-07-21T22:57:59.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.820+0000 7f1938cca640 1 -- 172.21.15.6:0/3223409668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193406b190 con 0x7f19340af2b0 2023-07-21T22:57:59.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.820+0000 7f1938cca640 1 -- 172.21.15.6:0/3223409668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f19340adc30 con 0x7f19340af2b0 2023-07-21T22:57:59.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.820+0000 7f192affd640 1 -- 172.21.15.6:0/3223409668 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f192c00abf0 con 0x7f19340af2b0 2023-07-21T22:57:59.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.820+0000 7f192affd640 1 --2- 172.21.15.6:0/3223409668 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f19140663d0 0x7f1914068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:59.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.824+0000 7f192affd640 1 -- 172.21.15.6:0/3223409668 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f192c0844f0 con 0x7f19340af2b0 2023-07-21T22:57:59.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.824+0000 7f192affd640 1 --2- 172.21.15.6:0/3223409668 >> [v2:172.21.15.6:6808/3480578303,v1:172.21.15.6:6809/3480578303] conn(0x7f191406ceb0 0x7f191406f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:59.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.824+0000 7f192affd640 1 -- 172.21.15.6:0/3223409668 --> [v2:172.21.15.6:6808/3480578303,v1:172.21.15.6:6809/3480578303] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f191406f990 con 0x7f191406ceb0 2023-07-21T22:57:59.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.824+0000 7f192affd640 1 -- 172.21.15.6:0/3223409668 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f192c084860 con 0x7f19340af2b0 2023-07-21T22:57:59.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.824+0000 7f193259c640 1 --2- 172.21.15.6:0/3223409668 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f19140663d0 0x7f1914068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:59.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.824+0000 7f192bfff640 1 --2- 172.21.15.6:0/3223409668 >> [v2:172.21.15.6:6808/3480578303,v1:172.21.15.6:6809/3480578303] conn(0x7f191406ceb0 0x7f191406f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:59.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.824+0000 7f193259c640 1 --2- 172.21.15.6:0/3223409668 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f19140663d0 0x7f1914068880 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f19240af000 tx=0x7f19240b6040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:59.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.824+0000 7f192bfff640 1 --2- 172.21.15.6:0/3223409668 >> [v2:172.21.15.6:6808/3480578303,v1:172.21.15.6:6809/3480578303] conn(0x7f191406ceb0 0x7f191406f2c0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:59.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.824+0000 7f192affd640 1 -- 172.21.15.6:0/3223409668 <== osd.2 v2:172.21.15.6:6808/3480578303 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f191406f990 con 0x7f191406ceb0 2023-07-21T22:57:59.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.836+0000 7f1938cca640 1 -- 172.21.15.6:0/3223409668 --> [v2:172.21.15.6:6808/3480578303,v1:172.21.15.6:6809/3480578303] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f19340ca500 con 0x7f191406ceb0 2023-07-21T22:57:59.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.836+0000 7f192affd640 1 -- 172.21.15.6:0/3223409668 <== osd.2 v2:172.21.15.6:6808/3480578303 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f191c009aa0 con 0x7f191406ceb0 2023-07-21T22:57:59.873 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:57:59.873 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-21T22:57:59.874 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:57:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.836+0000 7f1938cca640 1 -- 172.21.15.6:0/3223409668 >> [v2:172.21.15.6:6808/3480578303,v1:172.21.15.6:6809/3480578303] conn(0x7f191406ceb0 msgr2=0x7f191406f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.836+0000 7f1938cca640 1 --2- 172.21.15.6:0/3223409668 >> [v2:172.21.15.6:6808/3480578303,v1:172.21.15.6:6809/3480578303] conn(0x7f191406ceb0 0x7f191406f2c0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.836+0000 7f1938cca640 1 -- 172.21.15.6:0/3223409668 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f19140663d0 msgr2=0x7f1914068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.836+0000 7f1938cca640 1 --2- 172.21.15.6:0/3223409668 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f19140663d0 0x7f1914068880 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f19240af000 tx=0x7f19240b6040 comp rx=0 tx=0).stop 2023-07-21T22:57:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.836+0000 7f1938cca640 1 -- 172.21.15.6:0/3223409668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19340af2b0 msgr2=0x7f19340c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.836+0000 7f1938cca640 1 --2- 172.21.15.6:0/3223409668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19340af2b0 0x7f19340c2d30 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f192c00c770 tx=0x7f192c00cc30 comp rx=0 tx=0).stop 2023-07-21T22:57:59.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.836+0000 7f1932d9d640 1 -- 172.21.15.6:0/3223409668 reap_dead start 2023-07-21T22:57:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.836+0000 7f1938cca640 1 -- 172.21.15.6:0/3223409668 shutdown_connections 2023-07-21T22:57:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.836+0000 7f1938cca640 1 -- 172.21.15.6:0/3223409668 >> 172.21.15.6:0/3223409668 conn(0x7f19340cde90 msgr2=0x7f19340ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.836+0000 7f1938cca640 1 -- 172.21.15.6:0/3223409668 shutdown_connections 2023-07-21T22:57:59.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:57:59.836+0000 7f1938cca640 1 -- 172.21.15.6:0/3223409668 wait complete. 2023-07-21T22:57:59.891 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-07-21T22:58:00.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.000+0000 7f5791448640 1 Processor -- start 2023-07-21T22:58:00.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.000+0000 7f5791448640 1 -- start start 2023-07-21T22:58:00.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.004+0000 7f5791448640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f578c0b1e60 0x7f578c06e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.004+0000 7f5791448640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f578c06e6a0 con 0x7f578c06c430 2023-07-21T22:58:00.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.004+0000 7f5791448640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f578c0b2280 con 0x7f578c0ae1f0 2023-07-21T22:58:00.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.004+0000 7f5791448640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c0b24f0 con 0x7f578c0b1e60 2023-07-21T22:58:00.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.004+0000 7f5783fff640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f578c06c430 0x7f578c069430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39932/0 (socket says 172.21.15.6:39932) 2023-07-21T22:58:00.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.004+0000 7f5783fff640 1 -- 172.21.15.6:0/1517125244 learned_addr learned my addr 172.21.15.6:0/1517125244 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:58:00.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.004+0000 7f578b7fe640 1 --2- 172.21.15.6:0/1517125244 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f578c0b1e60 0x7f578c06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.004+0000 7f578a7fc640 1 -- 172.21.15.6:0/1517125244 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986765415 0 0) 0x7f5774001120 con 0x7f578c06c430 2023-07-21T22:58:00.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.004+0000 7f578a7fc640 1 -- 172.21.15.6:0/1517125244 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5778003530 con 0x7f578c06c430 2023-07-21T22:58:00.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.004+0000 7f578a7fc640 1 -- 172.21.15.6:0/1517125244 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393522820 0 0) 0x7f578c0b2280 con 0x7f578c0ae1f0 2023-07-21T22:58:00.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.004+0000 7f578a7fc640 1 -- 172.21.15.6:0/1517125244 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5774001120 con 0x7f578c0ae1f0 2023-07-21T22:58:00.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.004+0000 7f578a7fc640 1 -- 172.21.15.6:0/1517125244 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1305759264 0 0) 0x7f5778003530 con 0x7f578c06c430 2023-07-21T22:58:00.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.004+0000 7f578b7fe640 1 -- 172.21.15.6:0/1517125244 >> v1:172.21.15.161:6789/0 conn(0x7f578c0ae1f0 legacy=0x7f578c06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.004+0000 7f578b7fe640 1 -- 172.21.15.6:0/1517125244 >> v1:172.21.15.6:6789/0 conn(0x7f578c06c430 legacy=0x7f578c069430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.004+0000 7f578b7fe640 1 -- 172.21.15.6:0/1517125244 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c0b27d0 con 0x7f578c0b1e60 2023-07-21T22:58:00.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.008+0000 7f578b7fe640 1 --2- 172.21.15.6:0/1517125244 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f578c0b1e60 0x7f578c06e160 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5784009dc0 tx=0x7f578401c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89363f29ec03186e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:00.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.008+0000 7f578a7fc640 1 -- 172.21.15.6:0/1517125244 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774001810 con 0x7f578c0b1e60 2023-07-21T22:58:00.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.008+0000 7f578a7fc640 1 -- 172.21.15.6:0/1517125244 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57840a56a0 con 0x7f578c0b1e60 2023-07-21T22:58:00.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.008+0000 7f578a7fc640 1 -- 172.21.15.6:0/1517125244 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57840a5a30 con 0x7f578c0b1e60 2023-07-21T22:58:00.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.008+0000 7f5791448640 1 -- 172.21.15.6:0/1517125244 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f578c0b1e60 msgr2=0x7f578c06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.008+0000 7f5791448640 1 --2- 172.21.15.6:0/1517125244 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f578c0b1e60 0x7f578c06e160 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5784009dc0 tx=0x7f578401c860 comp rx=0 tx=0).stop 2023-07-21T22:58:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.008+0000 7f5791448640 1 -- 172.21.15.6:0/1517125244 shutdown_connections 2023-07-21T22:58:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.008+0000 7f5791448640 1 --2- 172.21.15.6:0/1517125244 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f578c0b1e60 0x7f578c06e160 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.008+0000 7f5791448640 1 -- 172.21.15.6:0/1517125244 >> 172.21.15.6:0/1517125244 conn(0x7f578c0b1300 msgr2=0x7f578c0ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.008+0000 7f5791448640 1 -- 172.21.15.6:0/1517125244 shutdown_connections 2023-07-21T22:58:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.008+0000 7f5791448640 1 -- 172.21.15.6:0/1517125244 wait complete. 2023-07-21T22:58:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.008+0000 7f5791448640 1 Processor -- start 2023-07-21T22:58:00.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.008+0000 7f5791448640 1 -- start start 2023-07-21T22:58:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f5791448640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f578c06c430 0x7f578c15ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f5791448640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f578c0ae1f0 0x7f578c140f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f5791448640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f578c0b1e60 0x7f578c0cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f5791448640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c15b410 con 0x7f578c0ae1f0 2023-07-21T22:58:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f5791448640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c13dd80 con 0x7f578c06c430 2023-07-21T22:58:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f5791448640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c0cd8f0 con 0x7f578c0b1e60 2023-07-21T22:58:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f5783fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f578c0ae1f0 0x7f578c140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f5783fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f578c0ae1f0 0x7f578c140f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50630/0 (socket says 172.21.15.6:50630) 2023-07-21T22:58:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f5783fff640 1 -- 172.21.15.6:0/2248915913 learned_addr learned my addr 172.21.15.6:0/2248915913 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:00.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f578affd640 1 --2- 172.21.15.6:0/2248915913 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f578c06c430 0x7f578c15ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f578b7fe640 1 --2- 172.21.15.6:0/2248915913 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f578c0b1e60 0x7f578c0cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f5783fff640 1 -- 172.21.15.6:0/2248915913 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f578c0b1e60 msgr2=0x7f578c0cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f5783fff640 1 --2- 172.21.15.6:0/2248915913 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f578c0b1e60 0x7f578c0cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f5783fff640 1 -- 172.21.15.6:0/2248915913 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f578c06c430 msgr2=0x7f578c15ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f5783fff640 1 --2- 172.21.15.6:0/2248915913 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f578c06c430 0x7f578c15ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f5783fff640 1 -- 172.21.15.6:0/2248915913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5784009a70 con 0x7f578c0ae1f0 2023-07-21T22:58:00.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f5783fff640 1 --2- 172.21.15.6:0/2248915913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f578c0ae1f0 0x7f578c140f00 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f577400c6d0 tx=0x7f577400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f57837fe640 1 -- 172.21.15.6:0/2248915913 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774005ae0 con 0x7f578c0ae1f0 2023-07-21T22:58:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f57837fe640 1 -- 172.21.15.6:0/2248915913 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5774005c40 con 0x7f578c0ae1f0 2023-07-21T22:58:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f57837fe640 1 -- 172.21.15.6:0/2248915913 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774007070 con 0x7f578c0ae1f0 2023-07-21T22:58:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f5791448640 1 -- 172.21.15.6:0/2248915913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f578c0b3710 con 0x7f578c0ae1f0 2023-07-21T22:58:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f5791448640 1 -- 172.21.15.6:0/2248915913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f578c13e060 con 0x7f578c0ae1f0 2023-07-21T22:58:00.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f5791448640 1 -- 172.21.15.6:0/2248915913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f578c140c20 con 0x7f578c0ae1f0 2023-07-21T22:58:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.012+0000 7f57837fe640 1 -- 172.21.15.6:0/2248915913 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5774007400 con 0x7f578c0ae1f0 2023-07-21T22:58:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.016+0000 7f57837fe640 1 --2- 172.21.15.6:0/2248915913 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f576c0663a0 0x7f576c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.016+0000 7f57837fe640 1 -- 172.21.15.6:0/2248915913 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f5774083c60 con 0x7f578c0ae1f0 2023-07-21T22:58:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.016+0000 7f578affd640 1 --2- 172.21.15.6:0/2248915913 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f576c0663a0 0x7f576c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.016+0000 7f578affd640 1 --2- 172.21.15.6:0/2248915913 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f576c0663a0 0x7f576c068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f577c0011f0 tx=0x7f577c009040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:00.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.020+0000 7f57837fe640 1 -- 172.21.15.6:0/2248915913 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f578c140c20 con 0x7f578c0ae1f0 2023-07-21T22:58:00.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.188+0000 7f5791448640 1 -- 172.21.15.6:0/2248915913 --> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f578c141440 con 0x7f576c0663a0 2023-07-21T22:58:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.188+0000 7f57837fe640 1 -- 172.21.15.6:0/2248915913 <== mgr.10231 v2:172.21.15.161:6832/1416042622 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f578c141440 con 0x7f576c0663a0 2023-07-21T22:58:00.223 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 2 to deep-scrub 2023-07-21T22:58:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.188+0000 7f5791448640 1 -- 172.21.15.6:0/2248915913 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f576c0663a0 msgr2=0x7f576c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.188+0000 7f5791448640 1 --2- 172.21.15.6:0/2248915913 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f576c0663a0 0x7f576c068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f577c0011f0 tx=0x7f577c009040 comp rx=0 tx=0).stop 2023-07-21T22:58:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.188+0000 7f5791448640 1 -- 172.21.15.6:0/2248915913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f578c0ae1f0 msgr2=0x7f578c140f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.188+0000 7f5791448640 1 --2- 172.21.15.6:0/2248915913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f578c0ae1f0 0x7f578c140f00 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f577400c6d0 tx=0x7f577400cb90 comp rx=0 tx=0).stop 2023-07-21T22:58:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.188+0000 7f5791448640 1 -- 172.21.15.6:0/2248915913 shutdown_connections 2023-07-21T22:58:00.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.188+0000 7f5791448640 1 --2- 172.21.15.6:0/2248915913 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f576c0663a0 0x7f576c068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.188+0000 7f5791448640 1 --2- 172.21.15.6:0/2248915913 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f578c0b1e60 0x7f578c0cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.188+0000 7f5791448640 1 --2- 172.21.15.6:0/2248915913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f578c0ae1f0 0x7f578c140f00 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.188+0000 7f5791448640 1 --2- 172.21.15.6:0/2248915913 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f578c06c430 0x7f578c15ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.188+0000 7f5791448640 1 -- 172.21.15.6:0/2248915913 >> 172.21.15.6:0/2248915913 conn(0x7f578c0b1300 msgr2=0x7f578c06a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.188+0000 7f5791448640 1 -- 172.21.15.6:0/2248915913 shutdown_connections 2023-07-21T22:58:00.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.188+0000 7f5791448640 1 -- 172.21.15.6:0/2248915913 wait complete. 2023-07-21T22:58:00.245 INFO:tasks.ceph:Scrubbing osd.3 2023-07-21T22:58:00.245 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-07-21T22:58:00.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.360+0000 7efc0da97640 1 Processor -- start 2023-07-21T22:58:00.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.360+0000 7efc0da97640 1 -- start start 2023-07-21T22:58:00.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.360+0000 7efc0da97640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efc080cc7d0 0x7efc080ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.360+0000 7efc0da97640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc080b0d50 0x7efc080b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.360+0000 7efc0da97640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efc080cf1d0 0x7efc080b4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.360+0000 7efc0da97640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc0815f820 con 0x7efc080cf1d0 2023-07-21T22:58:00.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.360+0000 7efc0da97640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc080cd0e0 con 0x7efc080cc7d0 2023-07-21T22:58:00.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.360+0000 7efc0da97640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0815fa70 con 0x7efc080b0d50 2023-07-21T22:58:00.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.360+0000 7efc0d296640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efc080cf1d0 0x7efc080b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.360+0000 7efc0d296640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efc080cf1d0 0x7efc080b4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50646/0 (socket says 172.21.15.6:50646) 2023-07-21T22:58:00.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.360+0000 7efc0d296640 1 -- 172.21.15.6:0/1313106666 learned_addr learned my addr 172.21.15.6:0/1313106666 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:00.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.360+0000 7efc07fff640 1 --2- 172.21.15.6:0/1313106666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc080b0d50 0x7efc080b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.360+0000 7efc0ca95640 1 --2- 172.21.15.6:0/1313106666 >> v2:172.21.15.161:3300/0 conn(0x7efc080cc7d0 0x7efc080ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.360+0000 7efc0d296640 1 -- 172.21.15.6:0/1313106666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc080b0d50 msgr2=0x7efc080b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:00.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.360+0000 7efc0d296640 1 --2- 172.21.15.6:0/1313106666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc080b0d50 0x7efc080b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.360+0000 7efc0d296640 1 -- 172.21.15.6:0/1313106666 >> v2:172.21.15.161:3300/0 conn(0x7efc080cc7d0 msgr2=0x7efc080ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:00.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.360+0000 7efc0d296640 1 --2- 172.21.15.6:0/1313106666 >> v2:172.21.15.161:3300/0 conn(0x7efc080cc7d0 0x7efc080ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.360+0000 7efc0d296640 1 -- 172.21.15.6:0/1313106666 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0815fd50 con 0x7efc080cf1d0 2023-07-21T22:58:00.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.364+0000 7efc0d296640 1 --2- 172.21.15.6:0/1313106666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc080cf1d0 0x7efc080b4140 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7efc080b82f0 tx=0x7efc0001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c121d56323fcae36 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:00.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.364+0000 7efc077fe640 1 -- 172.21.15.6:0/1313106666 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc000a5760 con 0x7efc080cf1d0 2023-07-21T22:58:00.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.364+0000 7efc077fe640 1 -- 172.21.15.6:0/1313106666 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc000a58c0 con 0x7efc080cf1d0 2023-07-21T22:58:00.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.364+0000 7efc077fe640 1 -- 172.21.15.6:0/1313106666 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc000a5c50 con 0x7efc080cf1d0 2023-07-21T22:58:00.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.364+0000 7efc0da97640 1 -- 172.21.15.6:0/1313106666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc080cf1d0 msgr2=0x7efc080b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.364+0000 7efc0da97640 1 --2- 172.21.15.6:0/1313106666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc080cf1d0 0x7efc080b4140 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7efc080b82f0 tx=0x7efc0001c9d0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.364+0000 7efc0da97640 1 -- 172.21.15.6:0/1313106666 shutdown_connections 2023-07-21T22:58:00.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.364+0000 7efc0da97640 1 --2- 172.21.15.6:0/1313106666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc080cf1d0 0x7efc080b4140 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.364+0000 7efc0da97640 1 --2- 172.21.15.6:0/1313106666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc080b0d50 0x7efc080b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.364+0000 7efc0da97640 1 --2- 172.21.15.6:0/1313106666 >> v2:172.21.15.161:3300/0 conn(0x7efc080cc7d0 0x7efc080ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.364+0000 7efc0da97640 1 -- 172.21.15.6:0/1313106666 >> 172.21.15.6:0/1313106666 conn(0x7efc08069e10 msgr2=0x7efc0806a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:00.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.364+0000 7efc0da97640 1 -- 172.21.15.6:0/1313106666 shutdown_connections 2023-07-21T22:58:00.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.364+0000 7efc0da97640 1 -- 172.21.15.6:0/1313106666 wait complete. 2023-07-21T22:58:00.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.364+0000 7efc0da97640 1 Processor -- start 2023-07-21T22:58:00.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.364+0000 7efc0da97640 1 -- start start 2023-07-21T22:58:00.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc0da97640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc080b0d50 0x7efc080c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc0da97640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc080cc7d0 0x7efc0815d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc0da97640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc080cf1d0 0x7efc08153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc0da97640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc08158eb0 con 0x7efc080cc7d0 2023-07-21T22:58:00.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc0da97640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc080c8830 con 0x7efc080b0d50 2023-07-21T22:58:00.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc0da97640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0815ddf0 con 0x7efc080cf1d0 2023-07-21T22:58:00.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc07fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc080cc7d0 0x7efc0815d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc07fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc080cc7d0 0x7efc0815d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50652/0 (socket says 172.21.15.6:50652) 2023-07-21T22:58:00.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc07fff640 1 -- 172.21.15.6:0/2373605198 learned_addr learned my addr 172.21.15.6:0/2373605198 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:00.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc0ca95640 1 --2- 172.21.15.6:0/2373605198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc080b0d50 0x7efc080c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc0d296640 1 --2- 172.21.15.6:0/2373605198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc080cf1d0 0x7efc08153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc07fff640 1 -- 172.21.15.6:0/2373605198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc080cf1d0 msgr2=0x7efc08153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc07fff640 1 --2- 172.21.15.6:0/2373605198 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efc080cf1d0 0x7efc08153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc07fff640 1 -- 172.21.15.6:0/2373605198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc080b0d50 msgr2=0x7efc080c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc07fff640 1 --2- 172.21.15.6:0/2373605198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc080b0d50 0x7efc080c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc07fff640 1 -- 172.21.15.6:0/2373605198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc00009b30 con 0x7efc080cc7d0 2023-07-21T22:58:00.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc07fff640 1 --2- 172.21.15.6:0/2373605198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc080cc7d0 0x7efc0815d8b0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7efbf400e8b0 tx=0x7efbf400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:00.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc057fa640 1 -- 172.21.15.6:0/2373605198 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf400c940 con 0x7efc080cc7d0 2023-07-21T22:58:00.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc057fa640 1 -- 172.21.15.6:0/2373605198 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf400caa0 con 0x7efc080cc7d0 2023-07-21T22:58:00.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc057fa640 1 -- 172.21.15.6:0/2373605198 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf400ce30 con 0x7efc080cc7d0 2023-07-21T22:58:00.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc0da97640 1 -- 172.21.15.6:0/2373605198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc08158bd0 con 0x7efc080cc7d0 2023-07-21T22:58:00.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc0da97640 1 -- 172.21.15.6:0/2373605198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0815d0b0 con 0x7efc080cc7d0 2023-07-21T22:58:00.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.368+0000 7efc0da97640 1 -- 172.21.15.6:0/2373605198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efc0815bf80 con 0x7efc080cc7d0 2023-07-21T22:58:00.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.372+0000 7efc057fa640 1 -- 172.21.15.6:0/2373605198 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efbf4013470 con 0x7efc080cc7d0 2023-07-21T22:58:00.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.372+0000 7efc057fa640 1 --2- 172.21.15.6:0/2373605198 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7efbec0663a0 0x7efbec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.372+0000 7efc057fa640 1 -- 172.21.15.6:0/2373605198 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7efbf40843a0 con 0x7efc080cc7d0 2023-07-21T22:58:00.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.372+0000 7efc057fa640 1 --2- 172.21.15.6:0/2373605198 >> [v2:172.21.15.6:6824/3751691192,v1:172.21.15.6:6825/3751691192] conn(0x7efbec06ce80 0x7efbec06f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.372+0000 7efc057fa640 1 -- 172.21.15.6:0/2373605198 --> [v2:172.21.15.6:6824/3751691192,v1:172.21.15.6:6825/3751691192] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efbec06f960 con 0x7efbec06ce80 2023-07-21T22:58:00.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.372+0000 7efc057fa640 1 -- 172.21.15.6:0/2373605198 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7efbf40847c0 con 0x7efc080cc7d0 2023-07-21T22:58:00.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.372+0000 7efc0ca95640 1 --2- 172.21.15.6:0/2373605198 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7efbec0663a0 0x7efbec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.372+0000 7efc0d296640 1 --2- 172.21.15.6:0/2373605198 >> [v2:172.21.15.6:6824/3751691192,v1:172.21.15.6:6825/3751691192] conn(0x7efbec06ce80 0x7efbec06f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.372+0000 7efc0ca95640 1 --2- 172.21.15.6:0/2373605198 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7efbec0663a0 0x7efbec068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009b60 tx=0x7efbfc009190 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:00.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.372+0000 7efc0d296640 1 --2- 172.21.15.6:0/2373605198 >> [v2:172.21.15.6:6824/3751691192,v1:172.21.15.6:6825/3751691192] conn(0x7efbec06ce80 0x7efbec06f290 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:00.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.372+0000 7efc057fa640 1 -- 172.21.15.6:0/2373605198 <== osd.3 v2:172.21.15.6:6824/3751691192 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7efbec06f960 con 0x7efbec06ce80 2023-07-21T22:58:00.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.384+0000 7efc0da97640 1 -- 172.21.15.6:0/2373605198 --> [v2:172.21.15.6:6824/3751691192,v1:172.21.15.6:6825/3751691192] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efc0804e020 con 0x7efbec06ce80 2023-07-21T22:58:00.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.384+0000 7efc057fa640 1 -- 172.21.15.6:0/2373605198 <== osd.3 v2:172.21.15.6:6824/3751691192 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7efc0804e020 con 0x7efbec06ce80 2023-07-21T22:58:00.422 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:58:00.422 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-21T22:58:00.423 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:58:00.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.388+0000 7efc0da97640 1 -- 172.21.15.6:0/2373605198 >> [v2:172.21.15.6:6824/3751691192,v1:172.21.15.6:6825/3751691192] conn(0x7efbec06ce80 msgr2=0x7efbec06f290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.388+0000 7efc0da97640 1 --2- 172.21.15.6:0/2373605198 >> [v2:172.21.15.6:6824/3751691192,v1:172.21.15.6:6825/3751691192] conn(0x7efbec06ce80 0x7efbec06f290 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.388+0000 7efc0da97640 1 -- 172.21.15.6:0/2373605198 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7efbec0663a0 msgr2=0x7efbec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.388+0000 7efc0da97640 1 --2- 172.21.15.6:0/2373605198 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7efbec0663a0 0x7efbec068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009b60 tx=0x7efbfc009190 comp rx=0 tx=0).stop 2023-07-21T22:58:00.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.388+0000 7efc0da97640 1 -- 172.21.15.6:0/2373605198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc080cc7d0 msgr2=0x7efc0815d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.388+0000 7efc0da97640 1 --2- 172.21.15.6:0/2373605198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc080cc7d0 0x7efc0815d8b0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7efbf400e8b0 tx=0x7efbf400ed70 comp rx=0 tx=0).stop 2023-07-21T22:58:00.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.388+0000 7efc0d296640 1 -- 172.21.15.6:0/2373605198 reap_dead start 2023-07-21T22:58:00.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.388+0000 7efc0da97640 1 -- 172.21.15.6:0/2373605198 shutdown_connections 2023-07-21T22:58:00.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.388+0000 7efc0da97640 1 -- 172.21.15.6:0/2373605198 >> 172.21.15.6:0/2373605198 conn(0x7efc08069e10 msgr2=0x7efc08159580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:00.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.388+0000 7efc0da97640 1 -- 172.21.15.6:0/2373605198 shutdown_connections 2023-07-21T22:58:00.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.388+0000 7efc0da97640 1 -- 172.21.15.6:0/2373605198 wait complete. 2023-07-21T22:58:00.440 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-07-21T22:58:00.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.548+0000 7fa239834640 1 Processor -- start 2023-07-21T22:58:00.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.548+0000 7fa239834640 1 -- start start 2023-07-21T22:58:00.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.552+0000 7fa239834640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa23406b1e0 0x7fa2340c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.552+0000 7fa239834640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2340c21f0 0x7fa2340cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.552+0000 7fa239834640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2340cac70 con 0x7fa234070b70 2023-07-21T22:58:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.552+0000 7fa239834640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2340ca060 con 0x7fa2340c21f0 2023-07-21T22:58:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.552+0000 7fa239834640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2340ca340 con 0x7fa23406b1e0 2023-07-21T22:58:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.552+0000 7fa2337fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2340c21f0 0x7fa2340cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.552+0000 7fa2337fe640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa2340c21f0 0x7fa2340cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50666/0 (socket says 172.21.15.6:50666) 2023-07-21T22:58:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.552+0000 7fa2337fe640 1 -- 172.21.15.6:0/2717278917 learned_addr learned my addr 172.21.15.6:0/2717278917 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:00.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.552+0000 7fa22bfff640 1 --2- 172.21.15.6:0/2717278917 >> v2:172.21.15.161:3300/0 conn(0x7fa23406b1e0 0x7fa2340c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.552+0000 7fa2337fe640 1 -- 172.21.15.6:0/2717278917 >> v2:172.21.15.161:3300/0 conn(0x7fa23406b1e0 msgr2=0x7fa2340c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:00.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.552+0000 7fa2337fe640 1 --2- 172.21.15.6:0/2717278917 >> v2:172.21.15.161:3300/0 conn(0x7fa23406b1e0 0x7fa2340c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.552+0000 7fa2337fe640 1 -- 172.21.15.6:0/2717278917 >> v1:172.21.15.161:6789/0 conn(0x7fa234070b70 legacy=0x7fa234070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.552+0000 7fa2337fe640 1 -- 172.21.15.6:0/2717278917 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2340ca620 con 0x7fa2340c21f0 2023-07-21T22:58:00.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.556+0000 7fa2337fe640 1 --2- 172.21.15.6:0/2717278917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2340c21f0 0x7fa2340cb100 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7fa23406f380 tx=0x7fa22c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9331907fe947a787 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:00.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.556+0000 7fa2327fc640 1 -- 172.21.15.6:0/2717278917 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c0a5880 con 0x7fa2340c21f0 2023-07-21T22:58:00.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.556+0000 7fa2327fc640 1 -- 172.21.15.6:0/2717278917 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c0a59e0 con 0x7fa2340c21f0 2023-07-21T22:58:00.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.556+0000 7fa2327fc640 1 -- 172.21.15.6:0/2717278917 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c0a5d70 con 0x7fa2340c21f0 2023-07-21T22:58:00.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.556+0000 7fa239834640 1 -- 172.21.15.6:0/2717278917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2340c21f0 msgr2=0x7fa2340cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.556+0000 7fa239834640 1 --2- 172.21.15.6:0/2717278917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2340c21f0 0x7fa2340cb100 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7fa23406f380 tx=0x7fa22c01c9a0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.556+0000 7fa239834640 1 -- 172.21.15.6:0/2717278917 shutdown_connections 2023-07-21T22:58:00.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.556+0000 7fa239834640 1 --2- 172.21.15.6:0/2717278917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2340c21f0 0x7fa2340cb100 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.556+0000 7fa239834640 1 --2- 172.21.15.6:0/2717278917 >> v2:172.21.15.161:3300/0 conn(0x7fa23406b1e0 0x7fa2340c1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.556+0000 7fa239834640 1 -- 172.21.15.6:0/2717278917 >> 172.21.15.6:0/2717278917 conn(0x7fa2340afcf0 msgr2=0x7fa2340b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:00.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.556+0000 7fa239834640 1 -- 172.21.15.6:0/2717278917 shutdown_connections 2023-07-21T22:58:00.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.556+0000 7fa239834640 1 -- 172.21.15.6:0/2717278917 wait complete. 2023-07-21T22:58:00.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.556+0000 7fa239834640 1 Processor -- start 2023-07-21T22:58:00.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.556+0000 7fa239834640 1 -- start start 2023-07-21T22:58:00.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa239834640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa23406b1e0 0x7fa234158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa239834640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa234070b70 0x7fa2341504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa239834640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2340c21f0 0x7fa234158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa239834640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2340cc110 con 0x7fa234070b70 2023-07-21T22:58:00.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa239834640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2340cc3f0 con 0x7fa23406b1e0 2023-07-21T22:58:00.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa239834640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2340cc6d0 con 0x7fa2340c21f0 2023-07-21T22:58:00.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa22bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa234070b70 0x7fa2341504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa22bfff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa234070b70 0x7fa2341504d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50678/0 (socket says 172.21.15.6:50678) 2023-07-21T22:58:00.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa22bfff640 1 -- 172.21.15.6:0/623026562 learned_addr learned my addr 172.21.15.6:0/623026562 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:00.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa2337fe640 1 --2- 172.21.15.6:0/623026562 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2340c21f0 0x7fa234158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa232ffd640 1 --2- 172.21.15.6:0/623026562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa23406b1e0 0x7fa234158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa22bfff640 1 -- 172.21.15.6:0/623026562 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2340c21f0 msgr2=0x7fa234158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa22bfff640 1 --2- 172.21.15.6:0/623026562 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2340c21f0 0x7fa234158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa22bfff640 1 -- 172.21.15.6:0/623026562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa23406b1e0 msgr2=0x7fa234158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa22bfff640 1 --2- 172.21.15.6:0/623026562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa23406b1e0 0x7fa234158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa22bfff640 1 -- 172.21.15.6:0/623026562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c009b30 con 0x7fa234070b70 2023-07-21T22:58:00.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa232ffd640 1 --2- 172.21.15.6:0/623026562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa23406b1e0 0x7fa234158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:58:00.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa22bfff640 1 --2- 172.21.15.6:0/623026562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa234070b70 0x7fa2341504d0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00e930 tx=0x7fa21c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:00.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa230ff9640 1 -- 172.21.15.6:0/623026562 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c009690 con 0x7fa234070b70 2023-07-21T22:58:00.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa230ff9640 1 -- 172.21.15.6:0/623026562 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21c00ca00 con 0x7fa234070b70 2023-07-21T22:58:00.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa230ff9640 1 -- 172.21.15.6:0/623026562 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c00cd70 con 0x7fa234070b70 2023-07-21T22:58:00.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa239834640 1 -- 172.21.15.6:0/623026562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2340cc9b0 con 0x7fa234070b70 2023-07-21T22:58:00.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa239834640 1 -- 172.21.15.6:0/623026562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa234150a10 con 0x7fa234070b70 2023-07-21T22:58:00.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa239834640 1 -- 172.21.15.6:0/623026562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2340678d0 con 0x7fa234070b70 2023-07-21T22:58:00.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.560+0000 7fa230ff9640 1 -- 172.21.15.6:0/623026562 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa21c013470 con 0x7fa234070b70 2023-07-21T22:58:00.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.564+0000 7fa230ff9640 1 --2- 172.21.15.6:0/623026562 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa2140663a0 0x7fa214068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.564+0000 7fa230ff9640 1 -- 172.21.15.6:0/623026562 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7fa21c084050 con 0x7fa234070b70 2023-07-21T22:58:00.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.564+0000 7fa232ffd640 1 --2- 172.21.15.6:0/623026562 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa2140663a0 0x7fa214068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.564+0000 7fa232ffd640 1 --2- 172.21.15.6:0/623026562 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa2140663a0 0x7fa214068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa224000f70 tx=0x7fa224009040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:00.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.568+0000 7fa230ff9640 1 -- 172.21.15.6:0/623026562 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa21c0514e0 con 0x7fa234070b70 2023-07-21T22:58:00.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.724+0000 7fa239834640 1 -- 172.21.15.6:0/623026562 --> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2340c9cf0 con 0x7fa2140663a0 2023-07-21T22:58:00.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.724+0000 7fa230ff9640 1 -- 172.21.15.6:0/623026562 <== mgr.10231 v2:172.21.15.161:6832/1416042622 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa2240013f0 con 0x7fa2140663a0 2023-07-21T22:58:00.760 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 3 to deep-scrub 2023-07-21T22:58:00.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.728+0000 7fa239834640 1 -- 172.21.15.6:0/623026562 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa2140663a0 msgr2=0x7fa214068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.728+0000 7fa239834640 1 --2- 172.21.15.6:0/623026562 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa2140663a0 0x7fa214068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa224000f70 tx=0x7fa224009040 comp rx=0 tx=0).stop 2023-07-21T22:58:00.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.728+0000 7fa239834640 1 -- 172.21.15.6:0/623026562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa234070b70 msgr2=0x7fa2341504d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.728+0000 7fa239834640 1 --2- 172.21.15.6:0/623026562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa234070b70 0x7fa2341504d0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00e930 tx=0x7fa21c00edf0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.728+0000 7fa239834640 1 -- 172.21.15.6:0/623026562 shutdown_connections 2023-07-21T22:58:00.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.728+0000 7fa239834640 1 --2- 172.21.15.6:0/623026562 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa2140663a0 0x7fa214068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.728+0000 7fa239834640 1 --2- 172.21.15.6:0/623026562 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2340c21f0 0x7fa234158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.728+0000 7fa239834640 1 --2- 172.21.15.6:0/623026562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa234070b70 0x7fa2341504d0 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.728+0000 7fa239834640 1 --2- 172.21.15.6:0/623026562 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa23406b1e0 0x7fa234158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.728+0000 7fa239834640 1 -- 172.21.15.6:0/623026562 >> 172.21.15.6:0/623026562 conn(0x7fa2340afcf0 msgr2=0x7fa2340b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:00.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.728+0000 7fa239834640 1 -- 172.21.15.6:0/623026562 shutdown_connections 2023-07-21T22:58:00.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.728+0000 7fa239834640 1 -- 172.21.15.6:0/623026562 wait complete. 2023-07-21T22:58:00.781 INFO:tasks.ceph:Scrubbing osd.4 2023-07-21T22:58:00.782 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-07-21T22:58:00.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.896+0000 7f3454c93640 1 Processor -- start 2023-07-21T22:58:00.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.896+0000 7f3454c93640 1 -- start start 2023-07-21T22:58:00.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.896+0000 7f3454c93640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3450070f30 0x7f34500ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.896+0000 7f3454c93640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3450159d70 con 0x7f3450069430 2023-07-21T22:58:00.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.896+0000 7f3454c93640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34500c9c60 con 0x7f34500af2b0 2023-07-21T22:58:00.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.896+0000 7f3454c93640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34500c9f40 con 0x7f3450070f30 2023-07-21T22:58:00.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.896+0000 7f344e59c640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3450069430 0x7f3450069800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39940/0 (socket says 172.21.15.6:39940) 2023-07-21T22:58:00.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.896+0000 7f344e59c640 1 -- 172.21.15.6:0/962117677 learned_addr learned my addr 172.21.15.6:0/962117677 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:58:00.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.896+0000 7f3447fff640 1 --2- 172.21.15.6:0/962117677 >> v2:172.21.15.161:3300/0 conn(0x7f3450070f30 0x7f34500ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.896+0000 7f344dd9b640 1 -- 172.21.15.6:0/962117677 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600578642 0 0) 0x7f3440001120 con 0x7f3450069430 2023-07-21T22:58:00.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.896+0000 7f344dd9b640 1 -- 172.21.15.6:0/962117677 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f343c003530 con 0x7f3450069430 2023-07-21T22:58:00.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.896+0000 7f344dd9b640 1 -- 172.21.15.6:0/962117677 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139453623 0 0) 0x7f34500c9c60 con 0x7f34500af2b0 2023-07-21T22:58:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.896+0000 7f344dd9b640 1 -- 172.21.15.6:0/962117677 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3440001120 con 0x7f34500af2b0 2023-07-21T22:58:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.896+0000 7f3447fff640 1 -- 172.21.15.6:0/962117677 >> v1:172.21.15.161:6789/0 conn(0x7f34500af2b0 legacy=0x7f345015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.896+0000 7f3447fff640 1 -- 172.21.15.6:0/962117677 >> v1:172.21.15.6:6789/0 conn(0x7f3450069430 legacy=0x7f3450069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.896+0000 7f3447fff640 1 -- 172.21.15.6:0/962117677 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34500ca220 con 0x7f3450070f30 2023-07-21T22:58:00.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.900+0000 7f3447fff640 1 --2- 172.21.15.6:0/962117677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3450070f30 0x7f34500ad6f0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f34380097c0 tx=0x7f343801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7dc49975f589614 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:00.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.900+0000 7f344dd9b640 1 -- 172.21.15.6:0/962117677 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34380ab680 con 0x7f3450070f30 2023-07-21T22:58:00.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.900+0000 7f344dd9b640 1 -- 172.21.15.6:0/962117677 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34380ab7e0 con 0x7f3450070f30 2023-07-21T22:58:00.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.900+0000 7f344dd9b640 1 -- 172.21.15.6:0/962117677 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34380abb50 con 0x7f3450070f30 2023-07-21T22:58:00.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.900+0000 7f3454c93640 1 -- 172.21.15.6:0/962117677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3450070f30 msgr2=0x7f34500ad6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.900+0000 7f3454c93640 1 --2- 172.21.15.6:0/962117677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3450070f30 0x7f34500ad6f0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f34380097c0 tx=0x7f343801c480 comp rx=0 tx=0).stop 2023-07-21T22:58:00.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.900+0000 7f3454c93640 1 -- 172.21.15.6:0/962117677 shutdown_connections 2023-07-21T22:58:00.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.900+0000 7f3454c93640 1 --2- 172.21.15.6:0/962117677 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3450070f30 0x7f34500ad6f0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.900+0000 7f3454c93640 1 -- 172.21.15.6:0/962117677 >> 172.21.15.6:0/962117677 conn(0x7f34500cde90 msgr2=0x7f34500ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:00.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.900+0000 7f3454c93640 1 -- 172.21.15.6:0/962117677 shutdown_connections 2023-07-21T22:58:00.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.900+0000 7f3454c93640 1 -- 172.21.15.6:0/962117677 wait complete. 2023-07-21T22:58:00.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.904+0000 7f3454c93640 1 Processor -- start 2023-07-21T22:58:00.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.904+0000 7f3454c93640 1 -- start start 2023-07-21T22:58:00.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.904+0000 7f3454c93640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3450069430 0x7f345014d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.904+0000 7f3454c93640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3450070f30 0x7f34500b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.904+0000 7f3454c93640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34500af2b0 0x7f34500cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.904+0000 7f3454c93640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34500cb4c0 con 0x7f3450069430 2023-07-21T22:58:00.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.904+0000 7f3454c93640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34500b29d0 con 0x7f34500af2b0 2023-07-21T22:58:00.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.904+0000 7f3454c93640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34500b1dc0 con 0x7f3450070f30 2023-07-21T22:58:00.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.904+0000 7f344e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3450069430 0x7f345014d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.904+0000 7f344e59c640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3450069430 0x7f345014d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50692/0 (socket says 172.21.15.6:50692) 2023-07-21T22:58:00.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.904+0000 7f344e59c640 1 -- 172.21.15.6:0/3812146983 learned_addr learned my addr 172.21.15.6:0/3812146983 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:00.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.904+0000 7f3447fff640 1 --2- 172.21.15.6:0/3812146983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3450070f30 0x7f34500b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.904+0000 7f344ed9d640 1 --2- 172.21.15.6:0/3812146983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34500af2b0 0x7f34500cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.904+0000 7f344e59c640 1 -- 172.21.15.6:0/3812146983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3450070f30 msgr2=0x7f34500b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.904+0000 7f344e59c640 1 --2- 172.21.15.6:0/3812146983 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3450070f30 0x7f34500b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.904+0000 7f344e59c640 1 -- 172.21.15.6:0/3812146983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34500af2b0 msgr2=0x7f34500cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.904+0000 7f344e59c640 1 --2- 172.21.15.6:0/3812146983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34500af2b0 0x7f34500cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.904+0000 7f344e59c640 1 -- 172.21.15.6:0/3812146983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3438009420 con 0x7f3450069430 2023-07-21T22:58:00.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.904+0000 7f344e59c640 1 --2- 172.21.15.6:0/3812146983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3450069430 0x7f345014d2f0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f344000c700 tx=0x7f344000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:00.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.904+0000 7f3446ffd640 1 -- 172.21.15.6:0/3812146983 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440005ac0 con 0x7f3450069430 2023-07-21T22:58:00.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.908+0000 7f3446ffd640 1 -- 172.21.15.6:0/3812146983 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3440005c20 con 0x7f3450069430 2023-07-21T22:58:00.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.908+0000 7f3454c93640 1 -- 172.21.15.6:0/3812146983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34500b20a0 con 0x7f3450069430 2023-07-21T22:58:00.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.908+0000 7f3446ffd640 1 -- 172.21.15.6:0/3812146983 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440007070 con 0x7f3450069430 2023-07-21T22:58:00.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.908+0000 7f3454c93640 1 -- 172.21.15.6:0/3812146983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34500b2660 con 0x7f3450069430 2023-07-21T22:58:00.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.908+0000 7f3454c93640 1 -- 172.21.15.6:0/3812146983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3450157710 con 0x7f3450069430 2023-07-21T22:58:00.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.908+0000 7f3446ffd640 1 -- 172.21.15.6:0/3812146983 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f34400071f0 con 0x7f3450069430 2023-07-21T22:58:00.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.908+0000 7f3446ffd640 1 --2- 172.21.15.6:0/3812146983 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f34300663a0 0x7f3430068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.908+0000 7f3446ffd640 1 -- 172.21.15.6:0/3812146983 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f3440083c40 con 0x7f3450069430 2023-07-21T22:58:00.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.908+0000 7f3446ffd640 1 --2- 172.21.15.6:0/3812146983 >> [v2:172.21.15.161:6824/3485236199,v1:172.21.15.161:6825/3485236199] conn(0x7f343006ce80 0x7f343006f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:00.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.908+0000 7f3446ffd640 1 -- 172.21.15.6:0/3812146983 --> [v2:172.21.15.161:6824/3485236199,v1:172.21.15.161:6825/3485236199] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f343006f960 con 0x7f343006ce80 2023-07-21T22:58:00.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.908+0000 7f3446ffd640 1 -- 172.21.15.6:0/3812146983 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3440083fb0 con 0x7f3450069430 2023-07-21T22:58:00.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.908+0000 7f3447fff640 1 --2- 172.21.15.6:0/3812146983 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f34300663a0 0x7f3430068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.908+0000 7f344ed9d640 1 --2- 172.21.15.6:0/3812146983 >> [v2:172.21.15.161:6824/3485236199,v1:172.21.15.161:6825/3485236199] conn(0x7f343006ce80 0x7f343006f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:00.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.912+0000 7f3447fff640 1 --2- 172.21.15.6:0/3812146983 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f34300663a0 0x7f3430068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f34380af000 tx=0x7f34380a7000 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:00.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.912+0000 7f344ed9d640 1 --2- 172.21.15.6:0/3812146983 >> [v2:172.21.15.161:6824/3485236199,v1:172.21.15.161:6825/3485236199] conn(0x7f343006ce80 0x7f343006f290 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:00.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.912+0000 7f3446ffd640 1 -- 172.21.15.6:0/3812146983 <== osd.4 v2:172.21.15.161:6824/3485236199 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f343006f960 con 0x7f343006ce80 2023-07-21T22:58:00.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.924+0000 7f3454c93640 1 -- 172.21.15.6:0/3812146983 --> [v2:172.21.15.161:6824/3485236199,v1:172.21.15.161:6825/3485236199] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f34500adc30 con 0x7f343006ce80 2023-07-21T22:58:00.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.924+0000 7f3446ffd640 1 -- 172.21.15.6:0/3812146983 <== osd.4 v2:172.21.15.161:6824/3485236199 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3448001a80 con 0x7f343006ce80 2023-07-21T22:58:00.960 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:58:00.961 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-21T22:58:00.961 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:58:00.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.924+0000 7f3454c93640 1 -- 172.21.15.6:0/3812146983 >> [v2:172.21.15.161:6824/3485236199,v1:172.21.15.161:6825/3485236199] conn(0x7f343006ce80 msgr2=0x7f343006f290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.924+0000 7f3454c93640 1 --2- 172.21.15.6:0/3812146983 >> [v2:172.21.15.161:6824/3485236199,v1:172.21.15.161:6825/3485236199] conn(0x7f343006ce80 0x7f343006f290 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.924+0000 7f3454c93640 1 -- 172.21.15.6:0/3812146983 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f34300663a0 msgr2=0x7f3430068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.924+0000 7f3454c93640 1 --2- 172.21.15.6:0/3812146983 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f34300663a0 0x7f3430068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f34380af000 tx=0x7f34380a7000 comp rx=0 tx=0).stop 2023-07-21T22:58:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.924+0000 7f3454c93640 1 -- 172.21.15.6:0/3812146983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3450069430 msgr2=0x7f345014d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.924+0000 7f3454c93640 1 --2- 172.21.15.6:0/3812146983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3450069430 0x7f345014d2f0 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f344000c700 tx=0x7f344000cbc0 comp rx=0 tx=0).stop 2023-07-21T22:58:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.924+0000 7f344ed9d640 1 -- 172.21.15.6:0/3812146983 reap_dead start 2023-07-21T22:58:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.924+0000 7f3454c93640 1 -- 172.21.15.6:0/3812146983 shutdown_connections 2023-07-21T22:58:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.924+0000 7f3454c93640 1 -- 172.21.15.6:0/3812146983 >> 172.21.15.6:0/3812146983 conn(0x7f34500cde90 msgr2=0x7f3450153ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.924+0000 7f3454c93640 1 -- 172.21.15.6:0/3812146983 shutdown_connections 2023-07-21T22:58:00.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:00.924+0000 7f3454c93640 1 -- 172.21.15.6:0/3812146983 wait complete. 2023-07-21T22:58:00.979 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-07-21T22:58:01.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.088+0000 7f6ee0448640 1 Processor -- start 2023-07-21T22:58:01.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.088+0000 7f6ee0448640 1 -- start start 2023-07-21T22:58:01.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6ee0448640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6ed80c8ad0 0x7f6ed80c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:01.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6ee0448640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed80c99c0 con 0x7f6ed8158ce0 2023-07-21T22:58:01.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6ee0448640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed80cc700 con 0x7f6ed80c9560 2023-07-21T22:58:01.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6ee0448640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed80b0ff0 con 0x7f6ed80c8ad0 2023-07-21T22:58:01.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6ede1e4640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6ed8158ce0 0x7f6ed8070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39942/0 (socket says 172.21.15.6:39942) 2023-07-21T22:58:01.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6ede1e4640 1 -- 172.21.15.6:0/2051222118 learned_addr learned my addr 172.21.15.6:0/2051222118 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:58:01.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6edd9e3640 1 --2- 172.21.15.6:0/2051222118 >> v2:172.21.15.161:3300/0 conn(0x7f6ed80c8ad0 0x7f6ed80c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:01.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6edd1e2640 1 -- 172.21.15.6:0/2051222118 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224149279 0 0) 0x7f6ed80c99c0 con 0x7f6ed8158ce0 2023-07-21T22:58:01.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6edd1e2640 1 -- 172.21.15.6:0/2051222118 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ec4003530 con 0x7f6ed8158ce0 2023-07-21T22:58:01.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6edd1e2640 1 -- 172.21.15.6:0/2051222118 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3598490270 0 0) 0x7f6ec4003530 con 0x7f6ed8158ce0 2023-07-21T22:58:01.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6edd1e2640 1 -- 172.21.15.6:0/2051222118 >> v2:172.21.15.161:3300/0 conn(0x7f6ed80c8ad0 msgr2=0x7f6ed80c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:01.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6edd1e2640 1 --2- 172.21.15.6:0/2051222118 >> v2:172.21.15.161:3300/0 conn(0x7f6ed80c8ad0 0x7f6ed80c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6edd1e2640 1 -- 172.21.15.6:0/2051222118 >> v1:172.21.15.161:6789/0 conn(0x7f6ed80c9560 legacy=0x7f6ed80ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6edd1e2640 1 -- 172.21.15.6:0/2051222118 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed8070c80 con 0x7f6ed8158ce0 2023-07-21T22:58:01.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6edd1e2640 1 -- 172.21.15.6:0/2051222118 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f6ed4001680 con 0x7f6ed8158ce0 2023-07-21T22:58:01.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6edd1e2640 1 -- 172.21.15.6:0/2051222118 >> v1:172.21.15.6:6789/0 conn(0x7f6ed8158ce0 legacy=0x7f6ed8070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6edd1e2640 1 --2- 172.21.15.6:0/2051222118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ec4003980 0x7f6ec4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:01.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6edd1e2640 1 --2- 172.21.15.6:0/2051222118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec40047d0 0x7f6ec4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:01.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6edd1e2640 1 --2- 172.21.15.6:0/2051222118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec40052a0 0x7f6ec400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:01.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6edd1e2640 1 -- 172.21.15.6:0/2051222118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed80b0ff0 con 0x7f6ec40052a0 2023-07-21T22:58:01.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6edd1e2640 1 -- 172.21.15.6:0/2051222118 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec400e3e0 con 0x7f6ec40047d0 2023-07-21T22:58:01.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6edd1e2640 1 -- 172.21.15.6:0/2051222118 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec400e5a0 con 0x7f6ec4003980 2023-07-21T22:58:01.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6ede9e5640 1 --2- 172.21.15.6:0/2051222118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec40052a0 0x7f6ec400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:01.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6edd9e3640 1 --2- 172.21.15.6:0/2051222118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec40047d0 0x7f6ec4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:01.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6ede1e4640 1 --2- 172.21.15.6:0/2051222118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ec4003980 0x7f6ec4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:01.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6ede9e5640 1 -- 172.21.15.6:0/2051222118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ec4003980 msgr2=0x7f6ec4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:01.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6ede9e5640 1 --2- 172.21.15.6:0/2051222118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ec4003980 0x7f6ec4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6ede9e5640 1 -- 172.21.15.6:0/2051222118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec40047d0 msgr2=0x7f6ec4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:01.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6ede9e5640 1 --2- 172.21.15.6:0/2051222118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec40047d0 0x7f6ec4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6ede9e5640 1 -- 172.21.15.6:0/2051222118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec4003530 con 0x7f6ec40052a0 2023-07-21T22:58:01.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.092+0000 7f6ede1e4640 1 --2- 172.21.15.6:0/2051222118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ec4003980 0x7f6ec4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:58:01.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.096+0000 7f6ede9e5640 1 -- 172.21.15.6:0/2051222118 reap_dead start 2023-07-21T22:58:01.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.096+0000 7f6ede9e5640 1 --2- 172.21.15.6:0/2051222118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec40052a0 0x7f6ec400dba0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0001e70 tx=0x7f6ed001c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f4d1c28c1c8670 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:01.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.096+0000 7f6edd1e2640 1 -- 172.21.15.6:0/2051222118 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0003b80 con 0x7f6ec40052a0 2023-07-21T22:58:01.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.096+0000 7f6edd1e2640 1 -- 172.21.15.6:0/2051222118 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed0003d20 con 0x7f6ec40052a0 2023-07-21T22:58:01.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.096+0000 7f6edd1e2640 1 -- 172.21.15.6:0/2051222118 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0005310 con 0x7f6ec40052a0 2023-07-21T22:58:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.096+0000 7f6ee0448640 1 -- 172.21.15.6:0/2051222118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec40052a0 msgr2=0x7f6ec400dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.096+0000 7f6ee0448640 1 --2- 172.21.15.6:0/2051222118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec40052a0 0x7f6ec400dba0 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0001e70 tx=0x7f6ed001c730 comp rx=0 tx=0).stop 2023-07-21T22:58:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.096+0000 7f6ee0448640 1 -- 172.21.15.6:0/2051222118 shutdown_connections 2023-07-21T22:58:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.096+0000 7f6ee0448640 1 --2- 172.21.15.6:0/2051222118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec40052a0 0x7f6ec400dba0 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.096+0000 7f6ee0448640 1 -- 172.21.15.6:0/2051222118 >> 172.21.15.6:0/2051222118 conn(0x7f6ed80afcf0 msgr2=0x7f6ed80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.096+0000 7f6ee0448640 1 -- 172.21.15.6:0/2051222118 shutdown_connections 2023-07-21T22:58:01.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.096+0000 7f6ee0448640 1 -- 172.21.15.6:0/2051222118 wait complete. 2023-07-21T22:58:01.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.096+0000 7f6ee0448640 1 Processor -- start 2023-07-21T22:58:01.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6ee0448640 1 -- start start 2023-07-21T22:58:01.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6ee0448640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec40052a0 0x7f6ed81508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:01.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6ee0448640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ed8159740 0x7f6ed80c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:01.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6ee0448640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ed80c6d60 0x7f6ed80ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:01.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6ee0448640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed8151df0 con 0x7f6ed80c6d60 2023-07-21T22:58:01.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6ee0448640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed8150e00 con 0x7f6ec40052a0 2023-07-21T22:58:01.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6ee0448640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed80c6130 con 0x7f6ed8159740 2023-07-21T22:58:01.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6ede9e5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ed80c6d60 0x7f6ed80ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:01.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6ede9e5640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ed80c6d60 0x7f6ed80ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50712/0 (socket says 172.21.15.6:50712) 2023-07-21T22:58:01.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6ede9e5640 1 -- 172.21.15.6:0/3884615907 learned_addr learned my addr 172.21.15.6:0/3884615907 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:01.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6ede1e4640 1 --2- 172.21.15.6:0/3884615907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec40052a0 0x7f6ed81508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:01.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6edd9e3640 1 --2- 172.21.15.6:0/3884615907 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ed8159740 0x7f6ed80c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:01.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6ede9e5640 1 -- 172.21.15.6:0/3884615907 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ed8159740 msgr2=0x7f6ed80c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6ede9e5640 1 --2- 172.21.15.6:0/3884615907 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ed8159740 0x7f6ed80c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6ede9e5640 1 -- 172.21.15.6:0/3884615907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec40052a0 msgr2=0x7f6ed81508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6ede9e5640 1 --2- 172.21.15.6:0/3884615907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec40052a0 0x7f6ed81508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6ede9e5640 1 -- 172.21.15.6:0/3884615907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed81511e0 con 0x7f6ed80c6d60 2023-07-21T22:58:01.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6ede9e5640 1 --2- 172.21.15.6:0/3884615907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ed80c6d60 0x7f6ed80ca8e0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0000f90 tx=0x7f6ec4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:01.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6eceffd640 1 -- 172.21.15.6:0/3884615907 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0003b80 con 0x7f6ed80c6d60 2023-07-21T22:58:01.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6eceffd640 1 -- 172.21.15.6:0/3884615907 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed0003e90 con 0x7f6ed80c6d60 2023-07-21T22:58:01.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6eceffd640 1 -- 172.21.15.6:0/3884615907 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0006d80 con 0x7f6ed80c6d60 2023-07-21T22:58:01.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6ee0448640 1 -- 172.21.15.6:0/3884615907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed8151df0 con 0x7f6ed80c6d60 2023-07-21T22:58:01.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6ee0448640 1 -- 172.21.15.6:0/3884615907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed81517a0 con 0x7f6ed80c6d60 2023-07-21T22:58:01.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.100+0000 7f6ee0448640 1 -- 172.21.15.6:0/3884615907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed80ca1a0 con 0x7f6ed80c6d60 2023-07-21T22:58:01.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.104+0000 7f6eceffd640 1 -- 172.21.15.6:0/3884615907 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6ed00050d0 con 0x7f6ed80c6d60 2023-07-21T22:58:01.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.104+0000 7f6eceffd640 1 --2- 172.21.15.6:0/3884615907 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f6ebc0663a0 0x7f6ebc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:01.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.104+0000 7f6eceffd640 1 -- 172.21.15.6:0/3884615907 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f6ed011ccb0 con 0x7f6ed80c6d60 2023-07-21T22:58:01.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.104+0000 7f6ede1e4640 1 --2- 172.21.15.6:0/3884615907 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f6ebc0663a0 0x7f6ebc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:01.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.104+0000 7f6ede1e4640 1 --2- 172.21.15.6:0/3884615907 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f6ebc0663a0 0x7f6ebc068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4000c10 tx=0x7f6ed4009040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:01.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.108+0000 7f6eceffd640 1 -- 172.21.15.6:0/3884615907 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ed00e9db0 con 0x7f6ed80c6d60 2023-07-21T22:58:01.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.264+0000 7f6ee0448640 1 -- 172.21.15.6:0/3884615907 --> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ed81590b0 con 0x7f6ebc0663a0 2023-07-21T22:58:01.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.264+0000 7f6eceffd640 1 -- 172.21.15.6:0/3884615907 <== mgr.10231 v2:172.21.15.161:6832/1416042622 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6ed40107d0 con 0x7f6ebc0663a0 2023-07-21T22:58:01.299 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 4 to deep-scrub 2023-07-21T22:58:01.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.264+0000 7f6ee0448640 1 -- 172.21.15.6:0/3884615907 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f6ebc0663a0 msgr2=0x7f6ebc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.264+0000 7f6ee0448640 1 --2- 172.21.15.6:0/3884615907 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f6ebc0663a0 0x7f6ebc068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4000c10 tx=0x7f6ed4009040 comp rx=0 tx=0).stop 2023-07-21T22:58:01.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.264+0000 7f6ee0448640 1 -- 172.21.15.6:0/3884615907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ed80c6d60 msgr2=0x7f6ed80ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.264+0000 7f6ee0448640 1 --2- 172.21.15.6:0/3884615907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ed80c6d60 0x7f6ed80ca8e0 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0000f90 tx=0x7f6ec4005800 comp rx=0 tx=0).stop 2023-07-21T22:58:01.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.264+0000 7f6ee0448640 1 -- 172.21.15.6:0/3884615907 shutdown_connections 2023-07-21T22:58:01.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.264+0000 7f6ee0448640 1 --2- 172.21.15.6:0/3884615907 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f6ebc0663a0 0x7f6ebc068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.264+0000 7f6ee0448640 1 --2- 172.21.15.6:0/3884615907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ed80c6d60 0x7f6ed80ca8e0 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.264+0000 7f6ee0448640 1 --2- 172.21.15.6:0/3884615907 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6ed8159740 0x7f6ed80c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.264+0000 7f6ee0448640 1 --2- 172.21.15.6:0/3884615907 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ec40052a0 0x7f6ed81508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.264+0000 7f6ee0448640 1 -- 172.21.15.6:0/3884615907 >> 172.21.15.6:0/3884615907 conn(0x7f6ed80afcf0 msgr2=0x7f6ed80abdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:01.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.264+0000 7f6ee0448640 1 -- 172.21.15.6:0/3884615907 shutdown_connections 2023-07-21T22:58:01.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.264+0000 7f6ee0448640 1 -- 172.21.15.6:0/3884615907 wait complete. 2023-07-21T22:58:01.319 INFO:tasks.ceph:Scrubbing osd.5 2023-07-21T22:58:01.320 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-07-21T22:58:01.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.432+0000 7fd3457db640 1 Processor -- start 2023-07-21T22:58:01.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.432+0000 7fd3457db640 1 -- start start 2023-07-21T22:58:01.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.436+0000 7fd3457db640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd34015cef0 0x7fd340158d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:01.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.436+0000 7fd3457db640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3401532b0 con 0x7fd340159270 2023-07-21T22:58:01.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.436+0000 7fd3457db640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3400ca6f0 con 0x7fd3400aeb40 2023-07-21T22:58:01.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.436+0000 7fd3457db640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34015d360 con 0x7fd34015cef0 2023-07-21T22:58:01.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.436+0000 7fd33f7fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd340159270 0x7fd3400c88c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39958/0 (socket says 172.21.15.6:39958) 2023-07-21T22:58:01.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.436+0000 7fd33f7fe640 1 -- 172.21.15.6:0/2795887491 learned_addr learned my addr 172.21.15.6:0/2795887491 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:58:01.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.436+0000 7fd337fff640 1 --2- 172.21.15.6:0/2795887491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd34015cef0 0x7fd340158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:01.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.436+0000 7fd33e7fc640 1 -- 172.21.15.6:0/2795887491 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4002993869 0 0) 0x7fd3401532b0 con 0x7fd340159270 2023-07-21T22:58:01.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.436+0000 7fd33e7fc640 1 -- 172.21.15.6:0/2795887491 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd32c003530 con 0x7fd340159270 2023-07-21T22:58:01.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.436+0000 7fd33e7fc640 1 -- 172.21.15.6:0/2795887491 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015876074 0 0) 0x7fd3400ca6f0 con 0x7fd3400aeb40 2023-07-21T22:58:01.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.436+0000 7fd33e7fc640 1 -- 172.21.15.6:0/2795887491 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3401532b0 con 0x7fd3400aeb40 2023-07-21T22:58:01.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.436+0000 7fd33e7fc640 1 -- 172.21.15.6:0/2795887491 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 147966113 0 0) 0x7fd32c003530 con 0x7fd340159270 2023-07-21T22:58:01.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.436+0000 7fd337fff640 1 -- 172.21.15.6:0/2795887491 >> v1:172.21.15.161:6789/0 conn(0x7fd3400aeb40 legacy=0x7fd3400aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.436+0000 7fd337fff640 1 -- 172.21.15.6:0/2795887491 >> v1:172.21.15.6:6789/0 conn(0x7fd340159270 legacy=0x7fd3400c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.436+0000 7fd337fff640 1 -- 172.21.15.6:0/2795887491 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3401599d0 con 0x7fd34015cef0 2023-07-21T22:58:01.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.440+0000 7fd337fff640 1 --2- 172.21.15.6:0/2795887491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd34015cef0 0x7fd340158d30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd3280097f0 tx=0x7fd32801c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8fd6493a3b999ba server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:01.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.440+0000 7fd33e7fc640 1 -- 172.21.15.6:0/2795887491 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd338001a00 con 0x7fd34015cef0 2023-07-21T22:58:01.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.440+0000 7fd33e7fc640 1 -- 172.21.15.6:0/2795887491 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3280a7050 con 0x7fd34015cef0 2023-07-21T22:58:01.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.440+0000 7fd33e7fc640 1 -- 172.21.15.6:0/2795887491 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3280ab620 con 0x7fd34015cef0 2023-07-21T22:58:01.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.440+0000 7fd3457db640 1 -- 172.21.15.6:0/2795887491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd34015cef0 msgr2=0x7fd340158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.440+0000 7fd3457db640 1 --2- 172.21.15.6:0/2795887491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd34015cef0 0x7fd340158d30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd3280097f0 tx=0x7fd32801c3b0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.440+0000 7fd3457db640 1 -- 172.21.15.6:0/2795887491 shutdown_connections 2023-07-21T22:58:01.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.440+0000 7fd3457db640 1 --2- 172.21.15.6:0/2795887491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd34015cef0 0x7fd340158d30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.440+0000 7fd3457db640 1 -- 172.21.15.6:0/2795887491 >> 172.21.15.6:0/2795887491 conn(0x7fd3400cde90 msgr2=0x7fd3400ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:01.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.440+0000 7fd3457db640 1 -- 172.21.15.6:0/2795887491 shutdown_connections 2023-07-21T22:58:01.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.440+0000 7fd3457db640 1 -- 172.21.15.6:0/2795887491 wait complete. 2023-07-21T22:58:01.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.440+0000 7fd3457db640 1 Processor -- start 2023-07-21T22:58:01.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.440+0000 7fd3457db640 1 -- start start 2023-07-21T22:58:01.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd3457db640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd3400aeb40 0x7fd340150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:01.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd3457db640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd340159270 0x7fd3401f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:01.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd3457db640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd34015cef0 0x7fd34014b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:01.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd3457db640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3401f8250 con 0x7fd340159270 2023-07-21T22:58:01.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd3457db640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34014c9e0 con 0x7fd34015cef0 2023-07-21T22:58:01.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd3457db640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34014ccc0 con 0x7fd3400aeb40 2023-07-21T22:58:01.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd337fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd340159270 0x7fd3401f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:01.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd337fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd340159270 0x7fd3401f7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50716/0 (socket says 172.21.15.6:50716) 2023-07-21T22:58:01.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd337fff640 1 -- 172.21.15.6:0/410818128 learned_addr learned my addr 172.21.15.6:0/410818128 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:01.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd33effd640 1 --2- 172.21.15.6:0/410818128 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd3400aeb40 0x7fd340150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:01.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd33f7fe640 1 --2- 172.21.15.6:0/410818128 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd34015cef0 0x7fd34014b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:01.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd337fff640 1 -- 172.21.15.6:0/410818128 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd3400aeb40 msgr2=0x7fd340150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd337fff640 1 --2- 172.21.15.6:0/410818128 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd3400aeb40 0x7fd340150f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd337fff640 1 -- 172.21.15.6:0/410818128 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd34015cef0 msgr2=0x7fd34014b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd337fff640 1 --2- 172.21.15.6:0/410818128 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd34015cef0 0x7fd34014b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd337fff640 1 -- 172.21.15.6:0/410818128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd328009420 con 0x7fd340159270 2023-07-21T22:58:01.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd33effd640 1 --2- 172.21.15.6:0/410818128 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd3400aeb40 0x7fd340150f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:58:01.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd33f7fe640 1 --2- 172.21.15.6:0/410818128 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd34015cef0 0x7fd34014b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:58:01.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd337fff640 1 --2- 172.21.15.6:0/410818128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd340159270 0x7fd3401f7d10 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7fd3280097f0 tx=0x7fd328019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:01.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd3377fe640 1 -- 172.21.15.6:0/410818128 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3280abe30 con 0x7fd340159270 2023-07-21T22:58:01.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd3377fe640 1 -- 172.21.15.6:0/410818128 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3280b5410 con 0x7fd340159270 2023-07-21T22:58:01.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd3377fe640 1 -- 172.21.15.6:0/410818128 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3280b5780 con 0x7fd340159270 2023-07-21T22:58:01.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd3457db640 1 -- 172.21.15.6:0/410818128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34014cfa0 con 0x7fd340159270 2023-07-21T22:58:01.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd3457db640 1 -- 172.21.15.6:0/410818128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34014d560 con 0x7fd340159270 2023-07-21T22:58:01.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd3457db640 1 -- 172.21.15.6:0/410818128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd34015c9d0 con 0x7fd340159270 2023-07-21T22:58:01.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.444+0000 7fd3377fe640 1 -- 172.21.15.6:0/410818128 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd3280b2050 con 0x7fd340159270 2023-07-21T22:58:01.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.448+0000 7fd3377fe640 1 --2- 172.21.15.6:0/410818128 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fd3200663a0 0x7fd320068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:01.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.448+0000 7fd3377fe640 1 -- 172.21.15.6:0/410818128 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7fd32811d750 con 0x7fd340159270 2023-07-21T22:58:01.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.448+0000 7fd3377fe640 1 --2- 172.21.15.6:0/410818128 >> [v2:172.21.15.161:6808/1291367445,v1:172.21.15.161:6809/1291367445] conn(0x7fd32006ce80 0x7fd32006f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:01.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.448+0000 7fd3377fe640 1 -- 172.21.15.6:0/410818128 --> [v2:172.21.15.161:6808/1291367445,v1:172.21.15.161:6809/1291367445] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd32006f960 con 0x7fd32006ce80 2023-07-21T22:58:01.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.448+0000 7fd3377fe640 1 -- 172.21.15.6:0/410818128 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd32811fd30 con 0x7fd340159270 2023-07-21T22:58:01.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.448+0000 7fd33effd640 1 --2- 172.21.15.6:0/410818128 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fd3200663a0 0x7fd320068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:01.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.448+0000 7fd33f7fe640 1 --2- 172.21.15.6:0/410818128 >> [v2:172.21.15.161:6808/1291367445,v1:172.21.15.161:6809/1291367445] conn(0x7fd32006ce80 0x7fd32006f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:01.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.448+0000 7fd33effd640 1 --2- 172.21.15.6:0/410818128 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fd3200663a0 0x7fd320068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd3300011f0 tx=0x7fd330009040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:01.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.448+0000 7fd33f7fe640 1 --2- 172.21.15.6:0/410818128 >> [v2:172.21.15.161:6808/1291367445,v1:172.21.15.161:6809/1291367445] conn(0x7fd32006ce80 0x7fd32006f290 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:01.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.448+0000 7fd3377fe640 1 -- 172.21.15.6:0/410818128 <== osd.5 v2:172.21.15.161:6808/1291367445 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd32006f960 con 0x7fd32006ce80 2023-07-21T22:58:01.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.460+0000 7fd3457db640 1 -- 172.21.15.6:0/410818128 --> [v2:172.21.15.161:6808/1291367445,v1:172.21.15.161:6809/1291367445] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd34015c6f0 con 0x7fd32006ce80 2023-07-21T22:58:01.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.460+0000 7fd3377fe640 1 -- 172.21.15.6:0/410818128 <== osd.5 v2:172.21.15.161:6808/1291367445 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd3380070f0 con 0x7fd32006ce80 2023-07-21T22:58:01.498 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:58:01.498 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-21T22:58:01.498 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:58:01.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.464+0000 7fd3457db640 1 -- 172.21.15.6:0/410818128 >> [v2:172.21.15.161:6808/1291367445,v1:172.21.15.161:6809/1291367445] conn(0x7fd32006ce80 msgr2=0x7fd32006f290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.464+0000 7fd3457db640 1 --2- 172.21.15.6:0/410818128 >> [v2:172.21.15.161:6808/1291367445,v1:172.21.15.161:6809/1291367445] conn(0x7fd32006ce80 0x7fd32006f290 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.464+0000 7fd3457db640 1 -- 172.21.15.6:0/410818128 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fd3200663a0 msgr2=0x7fd320068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.464+0000 7fd3457db640 1 --2- 172.21.15.6:0/410818128 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fd3200663a0 0x7fd320068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd3300011f0 tx=0x7fd330009040 comp rx=0 tx=0).stop 2023-07-21T22:58:01.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.464+0000 7fd3457db640 1 -- 172.21.15.6:0/410818128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd340159270 msgr2=0x7fd3401f7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.464+0000 7fd3457db640 1 --2- 172.21.15.6:0/410818128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd340159270 0x7fd3401f7d10 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7fd3280097f0 tx=0x7fd328019150 comp rx=0 tx=0).stop 2023-07-21T22:58:01.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.464+0000 7fd33f7fe640 1 -- 172.21.15.6:0/410818128 reap_dead start 2023-07-21T22:58:01.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.464+0000 7fd3457db640 1 -- 172.21.15.6:0/410818128 shutdown_connections 2023-07-21T22:58:01.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.464+0000 7fd3457db640 1 -- 172.21.15.6:0/410818128 >> 172.21.15.6:0/410818128 conn(0x7fd3400cde90 msgr2=0x7fd340069430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:01.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.464+0000 7fd3457db640 1 -- 172.21.15.6:0/410818128 shutdown_connections 2023-07-21T22:58:01.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.464+0000 7fd3457db640 1 -- 172.21.15.6:0/410818128 wait complete. 2023-07-21T22:58:01.517 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-07-21T22:58:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.624+0000 7f5580540640 1 Processor -- start 2023-07-21T22:58:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.624+0000 7f5580540640 1 -- start start 2023-07-21T22:58:01.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.628+0000 7f5580540640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f55780c8ad0 0x7f55780c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:01.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.628+0000 7f5580540640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f55780c9560 0x7f55780ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:01.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.628+0000 7f5580540640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55780c99c0 con 0x7f5578158ce0 2023-07-21T22:58:01.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.628+0000 7f5580540640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55780cc700 con 0x7f55780c8ad0 2023-07-21T22:58:01.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.628+0000 7f5580540640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55780b0ff0 con 0x7f55780c9560 2023-07-21T22:58:01.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.628+0000 7f557e2dc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5578158ce0 0x7f5578070450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39962/0 (socket says 172.21.15.6:39962) 2023-07-21T22:58:01.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.628+0000 7f557e2dc640 1 -- 172.21.15.6:0/2807593398 learned_addr learned my addr 172.21.15.6:0/2807593398 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:58:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.628+0000 7f557dadb640 1 --2- 172.21.15.6:0/2807593398 >> v2:172.21.15.6:3300/0 conn(0x7f55780c8ad0 0x7f55780c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.628+0000 7f557eadd640 1 --2- 172.21.15.6:0/2807593398 >> v2:172.21.15.161:3300/0 conn(0x7f55780c9560 0x7f55780ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.628+0000 7f557d2da640 1 -- 172.21.15.6:0/2807593398 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2094317827 0 0) 0x7f55780c99c0 con 0x7f5578158ce0 2023-07-21T22:58:01.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.628+0000 7f557d2da640 1 -- 172.21.15.6:0/2807593398 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5564003530 con 0x7f5578158ce0 2023-07-21T22:58:01.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.628+0000 7f557dadb640 1 -- 172.21.15.6:0/2807593398 >> v2:172.21.15.161:3300/0 conn(0x7f55780c9560 msgr2=0x7f55780ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:01.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.628+0000 7f557dadb640 1 --2- 172.21.15.6:0/2807593398 >> v2:172.21.15.161:3300/0 conn(0x7f55780c9560 0x7f55780ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.628+0000 7f557dadb640 1 -- 172.21.15.6:0/2807593398 >> v1:172.21.15.6:6789/0 conn(0x7f5578158ce0 legacy=0x7f5578070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.628+0000 7f557dadb640 1 -- 172.21.15.6:0/2807593398 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5578070c80 con 0x7f55780c8ad0 2023-07-21T22:58:01.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.628+0000 7f557eadd640 1 --2- 172.21.15.6:0/2807593398 >> v2:172.21.15.161:3300/0 conn(0x7f55780c9560 0x7f55780ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:58:01.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.632+0000 7f557dadb640 1 --2- 172.21.15.6:0/2807593398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55780c8ad0 0x7f55780c9020 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f55780b0d70 tx=0x7f556801c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d142de8cb539a140 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:01.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.632+0000 7f557d2da640 1 -- 172.21.15.6:0/2807593398 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55680ac640 con 0x7f55780c8ad0 2023-07-21T22:58:01.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.632+0000 7f557d2da640 1 -- 172.21.15.6:0/2807593398 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55680ac7a0 con 0x7f55780c8ad0 2023-07-21T22:58:01.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.632+0000 7f557d2da640 1 -- 172.21.15.6:0/2807593398 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55680acb10 con 0x7f55780c8ad0 2023-07-21T22:58:01.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.632+0000 7f5580540640 1 -- 172.21.15.6:0/2807593398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55780c8ad0 msgr2=0x7f55780c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.632+0000 7f5580540640 1 --2- 172.21.15.6:0/2807593398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55780c8ad0 0x7f55780c9020 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f55780b0d70 tx=0x7f556801c310 comp rx=0 tx=0).stop 2023-07-21T22:58:01.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.632+0000 7f5580540640 1 -- 172.21.15.6:0/2807593398 shutdown_connections 2023-07-21T22:58:01.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.632+0000 7f5580540640 1 --2- 172.21.15.6:0/2807593398 >> v2:172.21.15.161:3300/0 conn(0x7f55780c9560 0x7f55780ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.632+0000 7f5580540640 1 --2- 172.21.15.6:0/2807593398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55780c8ad0 0x7f55780c9020 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.632+0000 7f5580540640 1 -- 172.21.15.6:0/2807593398 >> 172.21.15.6:0/2807593398 conn(0x7f55780afcf0 msgr2=0x7f55780b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:01.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.632+0000 7f5580540640 1 -- 172.21.15.6:0/2807593398 shutdown_connections 2023-07-21T22:58:01.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.632+0000 7f5580540640 1 -- 172.21.15.6:0/2807593398 wait complete. 2023-07-21T22:58:01.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.632+0000 7f5580540640 1 Processor -- start 2023-07-21T22:58:01.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.632+0000 7f5580540640 1 -- start start 2023-07-21T22:58:01.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f5580540640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55780c8ad0 0x7f5578149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:01.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f5580540640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55780c9560 0x7f55780b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:01.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f5580540640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5578158ce0 0x7f55780b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:01.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f5580540640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5578159230 con 0x7f55780c8ad0 2023-07-21T22:58:01.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f5580540640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55781498b0 con 0x7f55780c9560 2023-07-21T22:58:01.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f5580540640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5578159440 con 0x7f5578158ce0 2023-07-21T22:58:01.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f557e2dc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55780c8ad0 0x7f5578149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:01.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f557e2dc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55780c8ad0 0x7f5578149370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50726/0 (socket says 172.21.15.6:50726) 2023-07-21T22:58:01.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f557e2dc640 1 -- 172.21.15.6:0/1716270877 learned_addr learned my addr 172.21.15.6:0/1716270877 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:01.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f557dadb640 1 --2- 172.21.15.6:0/1716270877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55780c9560 0x7f55780b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:01.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f557eadd640 1 --2- 172.21.15.6:0/1716270877 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5578158ce0 0x7f55780b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:01.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f557e2dc640 1 -- 172.21.15.6:0/1716270877 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5578158ce0 msgr2=0x7f55780b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f557e2dc640 1 --2- 172.21.15.6:0/1716270877 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5578158ce0 0x7f55780b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f557e2dc640 1 -- 172.21.15.6:0/1716270877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55780c9560 msgr2=0x7f55780b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f557e2dc640 1 --2- 172.21.15.6:0/1716270877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55780c9560 0x7f55780b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f557e2dc640 1 -- 172.21.15.6:0/1716270877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5568009420 con 0x7f55780c8ad0 2023-07-21T22:58:01.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f557e2dc640 1 --2- 172.21.15.6:0/1716270877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55780c8ad0 0x7f5578149370 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f557400c3f0 tx=0x7f557400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:01.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f556effd640 1 -- 172.21.15.6:0/1716270877 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5574005cf0 con 0x7f55780c8ad0 2023-07-21T22:58:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f556effd640 1 -- 172.21.15.6:0/1716270877 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5574005e50 con 0x7f55780c8ad0 2023-07-21T22:58:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f556effd640 1 -- 172.21.15.6:0/1716270877 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55740072f0 con 0x7f55780c8ad0 2023-07-21T22:58:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f5580540640 1 -- 172.21.15.6:0/1716270877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5578159720 con 0x7f55780c8ad0 2023-07-21T22:58:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f5580540640 1 -- 172.21.15.6:0/1716270877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5578159ce0 con 0x7f55780c8ad0 2023-07-21T22:58:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.636+0000 7f5580540640 1 -- 172.21.15.6:0/1716270877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55780ca1a0 con 0x7f55780c8ad0 2023-07-21T22:58:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.640+0000 7f556effd640 1 -- 172.21.15.6:0/1716270877 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5574007450 con 0x7f55780c8ad0 2023-07-21T22:58:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.640+0000 7f556effd640 1 --2- 172.21.15.6:0/1716270877 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f555c0663a0 0x7f555c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.640+0000 7f556effd640 1 -- 172.21.15.6:0/1716270877 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f55740835a0 con 0x7f55780c8ad0 2023-07-21T22:58:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.640+0000 7f557dadb640 1 --2- 172.21.15.6:0/1716270877 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f555c0663a0 0x7f555c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.640+0000 7f557dadb640 1 --2- 172.21.15.6:0/1716270877 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f555c0663a0 0x7f555c068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f55680ae000 tx=0x7f55680a6070 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:01.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.644+0000 7f556effd640 1 -- 172.21.15.6:0/1716270877 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5574050840 con 0x7f55780c8ad0 2023-07-21T22:58:01.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.800+0000 7f5580540640 1 -- 172.21.15.6:0/1716270877 --> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f55781590b0 con 0x7f555c0663a0 2023-07-21T22:58:01.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.800+0000 7f556effd640 1 -- 172.21.15.6:0/1716270877 <== mgr.10231 v2:172.21.15.161:6832/1416042622 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5568004030 con 0x7f555c0663a0 2023-07-21T22:58:01.835 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 5 to deep-scrub 2023-07-21T22:58:01.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.800+0000 7f5580540640 1 -- 172.21.15.6:0/1716270877 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f555c0663a0 msgr2=0x7f555c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.800+0000 7f5580540640 1 --2- 172.21.15.6:0/1716270877 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f555c0663a0 0x7f555c068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f55680ae000 tx=0x7f55680a6070 comp rx=0 tx=0).stop 2023-07-21T22:58:01.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.800+0000 7f5580540640 1 -- 172.21.15.6:0/1716270877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55780c8ad0 msgr2=0x7f5578149370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:01.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.800+0000 7f5580540640 1 --2- 172.21.15.6:0/1716270877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55780c8ad0 0x7f5578149370 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f557400c3f0 tx=0x7f557400c8b0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.800+0000 7f5580540640 1 -- 172.21.15.6:0/1716270877 shutdown_connections 2023-07-21T22:58:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.800+0000 7f5580540640 1 --2- 172.21.15.6:0/1716270877 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f555c0663a0 0x7f555c068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.800+0000 7f5580540640 1 --2- 172.21.15.6:0/1716270877 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5578158ce0 0x7f55780b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.800+0000 7f5580540640 1 --2- 172.21.15.6:0/1716270877 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55780c9560 0x7f55780b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.800+0000 7f5580540640 1 --2- 172.21.15.6:0/1716270877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55780c8ad0 0x7f5578149370 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:01.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.800+0000 7f5580540640 1 -- 172.21.15.6:0/1716270877 >> 172.21.15.6:0/1716270877 conn(0x7f55780afcf0 msgr2=0x7f55780cb140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:01.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.800+0000 7f5580540640 1 -- 172.21.15.6:0/1716270877 shutdown_connections 2023-07-21T22:58:01.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.800+0000 7f5580540640 1 -- 172.21.15.6:0/1716270877 wait complete. 2023-07-21T22:58:01.856 INFO:tasks.ceph:Scrubbing osd.6 2023-07-21T22:58:01.857 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-07-21T22:58:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.968+0000 7fa5b9d82640 1 Processor -- start 2023-07-21T22:58:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.968+0000 7fa5b9d82640 1 -- start start 2023-07-21T22:58:02.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.968+0000 7fa5b9d82640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b40aeb40 0x7fa5b415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.968+0000 7fa5b9d82640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa5b4159440 0x7fa5b40c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.968+0000 7fa5b9d82640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b41532b0 con 0x7fa5b40aef10 2023-07-21T22:58:02.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b9d82640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b40ca6f0 con 0x7fa5b4159440 2023-07-21T22:58:02.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b9d82640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b41599d0 con 0x7fa5b40aeb40 2023-07-21T22:58:02.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b2ffd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa5b40aef10 0x7fa5b4158d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39976/0 (socket says 172.21.15.6:39976) 2023-07-21T22:58:02.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b2ffd640 1 -- 172.21.15.6:0/1193947065 learned_addr learned my addr 172.21.15.6:0/1193947065 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:58:02.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b3fff640 1 --2- 172.21.15.6:0/1193947065 >> v2:172.21.15.161:3300/0 conn(0x7fa5b4159440 0x7fa5b40c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b37fe640 1 --2- 172.21.15.6:0/1193947065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b40aeb40 0x7fa5b415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b27fc640 1 -- 172.21.15.6:0/1193947065 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550330573 0 0) 0x7fa5b41532b0 con 0x7fa5b40aef10 2023-07-21T22:58:02.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b27fc640 1 -- 172.21.15.6:0/1193947065 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa59c005740 con 0x7fa5b40aef10 2023-07-21T22:58:02.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b27fc640 1 -- 172.21.15.6:0/1193947065 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1415753886 0 0) 0x7fa59c005740 con 0x7fa5b40aef10 2023-07-21T22:58:02.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b27fc640 1 -- 172.21.15.6:0/1193947065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b40aeb40 msgr2=0x7fa5b415cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:02.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b27fc640 1 --2- 172.21.15.6:0/1193947065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b40aeb40 0x7fa5b415cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b27fc640 1 -- 172.21.15.6:0/1193947065 >> v2:172.21.15.161:3300/0 conn(0x7fa5b4159440 msgr2=0x7fa5b40c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:02.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b27fc640 1 --2- 172.21.15.6:0/1193947065 >> v2:172.21.15.161:3300/0 conn(0x7fa5b4159440 0x7fa5b40c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b27fc640 1 -- 172.21.15.6:0/1193947065 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b4159cb0 con 0x7fa5b40aef10 2023-07-21T22:58:02.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b27fc640 1 -- 172.21.15.6:0/1193947065 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7fa5a8001680 con 0x7fa5b40aef10 2023-07-21T22:58:02.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b27fc640 1 -- 172.21.15.6:0/1193947065 >> v1:172.21.15.6:6789/0 conn(0x7fa5b40aef10 legacy=0x7fa5b4158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b27fc640 1 --2- 172.21.15.6:0/1193947065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa59c005b90 0x7fa59c005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b27fc640 1 --2- 172.21.15.6:0/1193947065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa59c0064e0 0x7fa59c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b27fc640 1 --2- 172.21.15.6:0/1193947065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b40aeb40 0x7fa59c007040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b27fc640 1 -- 172.21.15.6:0/1193947065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40ca6f0 con 0x7fa59c0064e0 2023-07-21T22:58:02.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b27fc640 1 -- 172.21.15.6:0/1193947065 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b41599d0 con 0x7fa59c005b90 2023-07-21T22:58:02.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b27fc640 1 -- 172.21.15.6:0/1193947065 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c0077c0 con 0x7fa5b40aeb40 2023-07-21T22:58:02.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b2ffd640 1 --2- 172.21.15.6:0/1193947065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa59c0064e0 0x7fa59c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b37fe640 1 --2- 172.21.15.6:0/1193947065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa59c005b90 0x7fa59c005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b3fff640 1 --2- 172.21.15.6:0/1193947065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b40aeb40 0x7fa59c007040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b2ffd640 1 -- 172.21.15.6:0/1193947065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b40aeb40 msgr2=0x7fa59c007040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b2ffd640 1 --2- 172.21.15.6:0/1193947065 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b40aeb40 0x7fa59c007040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b2ffd640 1 -- 172.21.15.6:0/1193947065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa59c005b90 msgr2=0x7fa59c005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b2ffd640 1 --2- 172.21.15.6:0/1193947065 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa59c005b90 0x7fa59c005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.972+0000 7fa5b2ffd640 1 -- 172.21.15.6:0/1193947065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c005740 con 0x7fa59c0064e0 2023-07-21T22:58:02.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.976+0000 7fa5b2ffd640 1 --2- 172.21.15.6:0/1193947065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa59c0064e0 0x7fa59c0069e0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800c240 tx=0x7fa5a801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3152aa199212e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:02.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.976+0000 7fa5b27fc640 1 -- 172.21.15.6:0/1193947065 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80058e0 con 0x7fa59c0064e0 2023-07-21T22:58:02.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.976+0000 7fa5b27fc640 1 -- 172.21.15.6:0/1193947065 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a8005a40 con 0x7fa59c0064e0 2023-07-21T22:58:02.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.976+0000 7fa5b27fc640 1 -- 172.21.15.6:0/1193947065 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8005e10 con 0x7fa59c0064e0 2023-07-21T22:58:02.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.976+0000 7fa5b9d82640 1 -- 172.21.15.6:0/1193947065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa59c0064e0 msgr2=0x7fa59c0069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.976+0000 7fa5b9d82640 1 --2- 172.21.15.6:0/1193947065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa59c0064e0 0x7fa59c0069e0 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800c240 tx=0x7fa5a801cc30 comp rx=0 tx=0).stop 2023-07-21T22:58:02.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.976+0000 7fa5b3fff640 1 -- 172.21.15.6:0/1193947065 reap_dead start 2023-07-21T22:58:02.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.976+0000 7fa5b9d82640 1 -- 172.21.15.6:0/1193947065 shutdown_connections 2023-07-21T22:58:02.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.976+0000 7fa5b9d82640 1 -- 172.21.15.6:0/1193947065 >> 172.21.15.6:0/1193947065 conn(0x7fa5b40cde90 msgr2=0x7fa5b40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:02.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.976+0000 7fa5b9d82640 1 -- 172.21.15.6:0/1193947065 shutdown_connections 2023-07-21T22:58:02.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.976+0000 7fa5b9d82640 1 -- 172.21.15.6:0/1193947065 wait complete. 2023-07-21T22:58:02.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.976+0000 7fa5b9d82640 1 Processor -- start 2023-07-21T22:58:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.976+0000 7fa5b9d82640 1 -- start start 2023-07-21T22:58:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b9d82640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa59c0064e0 0x7fa5b40c7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b9d82640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5b414e4b0 0x7fa5b415aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b9d82640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b415b430 0x7fa5b414f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b9d82640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b415b8d0 con 0x7fa59c0064e0 2023-07-21T22:58:02.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b9d82640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40c66d0 con 0x7fa5b414e4b0 2023-07-21T22:58:02.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b9d82640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b4150340 con 0x7fa5b415b430 2023-07-21T22:58:02.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa59c0064e0 0x7fa5b40c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa59c0064e0 0x7fa5b40c7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50732/0 (socket says 172.21.15.6:50732) 2023-07-21T22:58:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b37fe640 1 -- 172.21.15.6:0/380289425 learned_addr learned my addr 172.21.15.6:0/380289425 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b2ffd640 1 --2- 172.21.15.6:0/380289425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5b414e4b0 0x7fa5b415aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b3fff640 1 --2- 172.21.15.6:0/380289425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b415b430 0x7fa5b414f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b37fe640 1 -- 172.21.15.6:0/380289425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b415b430 msgr2=0x7fa5b414f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b37fe640 1 --2- 172.21.15.6:0/380289425 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5b415b430 0x7fa5b414f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b37fe640 1 -- 172.21.15.6:0/380289425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5b414e4b0 msgr2=0x7fa5b415aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b37fe640 1 --2- 172.21.15.6:0/380289425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5b414e4b0 0x7fa5b415aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b37fe640 1 -- 172.21.15.6:0/380289425 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b40c6920 con 0x7fa59c0064e0 2023-07-21T22:58:02.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b2ffd640 1 --2- 172.21.15.6:0/380289425 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5b414e4b0 0x7fa5b415aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:58:02.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b37fe640 1 --2- 172.21.15.6:0/380289425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa59c0064e0 0x7fa5b40c7400 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4011990 tx=0x7fa5a4011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:02.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa59bfff640 1 -- 172.21.15.6:0/380289425 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a400fad0 con 0x7fa59c0064e0 2023-07-21T22:58:02.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa59bfff640 1 -- 172.21.15.6:0/380289425 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a400fc30 con 0x7fa59c0064e0 2023-07-21T22:58:02.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa59bfff640 1 -- 172.21.15.6:0/380289425 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4014440 con 0x7fa59c0064e0 2023-07-21T22:58:02.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b9d82640 1 -- 172.21.15.6:0/380289425 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b40c6c00 con 0x7fa59c0064e0 2023-07-21T22:58:02.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b9d82640 1 -- 172.21.15.6:0/380289425 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b414e920 con 0x7fa59c0064e0 2023-07-21T22:58:02.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.980+0000 7fa5b9d82640 1 -- 172.21.15.6:0/380289425 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa5b415c9d0 con 0x7fa59c0064e0 2023-07-21T22:58:02.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.984+0000 7fa59bfff640 1 -- 172.21.15.6:0/380289425 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa5a401d400 con 0x7fa59c0064e0 2023-07-21T22:58:02.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.984+0000 7fa59bfff640 1 --2- 172.21.15.6:0/380289425 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa5a00663d0 0x7fa5a0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.984+0000 7fa59bfff640 1 -- 172.21.15.6:0/380289425 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7fa5a4084d90 con 0x7fa59c0064e0 2023-07-21T22:58:02.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.984+0000 7fa59bfff640 1 --2- 172.21.15.6:0/380289425 >> [v2:172.21.15.161:6800/771066506,v1:172.21.15.161:6801/771066506] conn(0x7fa5a006ceb0 0x7fa5a006f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.984+0000 7fa59bfff640 1 -- 172.21.15.6:0/380289425 --> [v2:172.21.15.161:6800/771066506,v1:172.21.15.161:6801/771066506] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5a006f990 con 0x7fa5a006ceb0 2023-07-21T22:58:02.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.984+0000 7fa59bfff640 1 -- 172.21.15.6:0/380289425 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5a4085100 con 0x7fa59c0064e0 2023-07-21T22:58:02.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.984+0000 7fa5b2ffd640 1 --2- 172.21.15.6:0/380289425 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa5a00663d0 0x7fa5a0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.984+0000 7fa5b3fff640 1 --2- 172.21.15.6:0/380289425 >> [v2:172.21.15.161:6800/771066506,v1:172.21.15.161:6801/771066506] conn(0x7fa5a006ceb0 0x7fa5a006f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.984+0000 7fa5b2ffd640 1 --2- 172.21.15.6:0/380289425 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa5a00663d0 0x7fa5a0068880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80aa000 tx=0x7fa5a8001a80 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:02.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.984+0000 7fa5b3fff640 1 --2- 172.21.15.6:0/380289425 >> [v2:172.21.15.161:6800/771066506,v1:172.21.15.161:6801/771066506] conn(0x7fa5a006ceb0 0x7fa5a006f2c0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:02.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.984+0000 7fa59bfff640 1 -- 172.21.15.6:0/380289425 <== osd.6 v2:172.21.15.161:6800/771066506 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa5a006f990 con 0x7fa5a006ceb0 2023-07-21T22:58:02.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:01.996+0000 7fa5b9d82640 1 -- 172.21.15.6:0/380289425 --> [v2:172.21.15.161:6800/771066506,v1:172.21.15.161:6801/771066506] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa5b40c70b0 con 0x7fa5a006ceb0 2023-07-21T22:58:02.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.000+0000 7fa59bfff640 1 -- 172.21.15.6:0/380289425 <== osd.6 v2:172.21.15.161:6800/771066506 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa5ac00f040 con 0x7fa5a006ceb0 2023-07-21T22:58:02.035 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:58:02.036 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-21T22:58:02.036 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:58:02.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.000+0000 7fa5b9d82640 1 -- 172.21.15.6:0/380289425 >> [v2:172.21.15.161:6800/771066506,v1:172.21.15.161:6801/771066506] conn(0x7fa5a006ceb0 msgr2=0x7fa5a006f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.000+0000 7fa5b9d82640 1 --2- 172.21.15.6:0/380289425 >> [v2:172.21.15.161:6800/771066506,v1:172.21.15.161:6801/771066506] conn(0x7fa5a006ceb0 0x7fa5a006f2c0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.000+0000 7fa5b9d82640 1 -- 172.21.15.6:0/380289425 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa5a00663d0 msgr2=0x7fa5a0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.000+0000 7fa5b9d82640 1 --2- 172.21.15.6:0/380289425 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fa5a00663d0 0x7fa5a0068880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80aa000 tx=0x7fa5a8001a80 comp rx=0 tx=0).stop 2023-07-21T22:58:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.000+0000 7fa5b9d82640 1 -- 172.21.15.6:0/380289425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa59c0064e0 msgr2=0x7fa5b40c7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.000+0000 7fa5b9d82640 1 --2- 172.21.15.6:0/380289425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa59c0064e0 0x7fa5b40c7400 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4011990 tx=0x7fa5a4011e50 comp rx=0 tx=0).stop 2023-07-21T22:58:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.000+0000 7fa5b3fff640 1 -- 172.21.15.6:0/380289425 reap_dead start 2023-07-21T22:58:02.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.000+0000 7fa5b9d82640 1 -- 172.21.15.6:0/380289425 shutdown_connections 2023-07-21T22:58:02.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.000+0000 7fa5b9d82640 1 -- 172.21.15.6:0/380289425 >> 172.21.15.6:0/380289425 conn(0x7fa5b40cde90 msgr2=0x7fa5b40ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:02.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.000+0000 7fa5b9d82640 1 -- 172.21.15.6:0/380289425 shutdown_connections 2023-07-21T22:58:02.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.000+0000 7fa5b9d82640 1 -- 172.21.15.6:0/380289425 wait complete. 2023-07-21T22:58:02.053 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-07-21T22:58:02.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.164+0000 7ff21d996640 1 Processor -- start 2023-07-21T22:58:02.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.164+0000 7ff21d996640 1 -- start start 2023-07-21T22:58:02.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.164+0000 7ff21d996640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff2180c8ad0 0x7ff2180c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.164+0000 7ff21d996640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2180c9560 0x7ff2180ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.164+0000 7ff21d996640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2180cc700 con 0x7ff218158ce0 2023-07-21T22:58:02.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.164+0000 7ff21d996640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2180c99e0 con 0x7ff2180c8ad0 2023-07-21T22:58:02.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.164+0000 7ff21d996640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180b0ff0 con 0x7ff2180c9560 2023-07-21T22:58:02.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.164+0000 7ff20ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff2180c8ad0 0x7ff2180c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.164+0000 7ff20ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff2180c8ad0 0x7ff2180c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.6:35260/0 (socket says 172.21.15.6:35260) 2023-07-21T22:58:02.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.164+0000 7ff20ffff640 1 -- 172.21.15.6:0/2437080495 learned_addr learned my addr 172.21.15.6:0/2437080495 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:02.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.164+0000 7ff2177fe640 1 --2- 172.21.15.6:0/2437080495 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2180c9560 0x7ff2180ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.164+0000 7ff20ffff640 1 -- 172.21.15.6:0/2437080495 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2180c9560 msgr2=0x7ff2180ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:02.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.164+0000 7ff20ffff640 1 --2- 172.21.15.6:0/2437080495 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2180c9560 0x7ff2180ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.164+0000 7ff20ffff640 1 -- 172.21.15.6:0/2437080495 >> v1:172.21.15.161:6789/0 conn(0x7ff218158ce0 legacy=0x7ff218070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.164+0000 7ff20ffff640 1 -- 172.21.15.6:0/2437080495 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff218070c80 con 0x7ff2180c8ad0 2023-07-21T22:58:02.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.168+0000 7ff20ffff640 1 --2- 172.21.15.6:0/2437080495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2180c8ad0 0x7ff2180c9020 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7ff20000bb10 tx=0x7ff20001eac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d58bff755e346400 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.168+0000 7ff2167fc640 1 -- 172.21.15.6:0/2437080495 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2000a7b90 con 0x7ff2180c8ad0 2023-07-21T22:58:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.168+0000 7ff2167fc640 1 -- 172.21.15.6:0/2437080495 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2000a7cf0 con 0x7ff2180c8ad0 2023-07-21T22:58:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.168+0000 7ff2167fc640 1 -- 172.21.15.6:0/2437080495 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2000af660 con 0x7ff2180c8ad0 2023-07-21T22:58:02.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.172+0000 7ff21d996640 1 -- 172.21.15.6:0/2437080495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2180c8ad0 msgr2=0x7ff2180c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.172+0000 7ff21d996640 1 --2- 172.21.15.6:0/2437080495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2180c8ad0 0x7ff2180c9020 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7ff20000bb10 tx=0x7ff20001eac0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.172+0000 7ff21d996640 1 -- 172.21.15.6:0/2437080495 shutdown_connections 2023-07-21T22:58:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.172+0000 7ff21d996640 1 --2- 172.21.15.6:0/2437080495 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff2180c9560 0x7ff2180ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.172+0000 7ff21d996640 1 --2- 172.21.15.6:0/2437080495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2180c8ad0 0x7ff2180c9020 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.172+0000 7ff21d996640 1 -- 172.21.15.6:0/2437080495 >> 172.21.15.6:0/2437080495 conn(0x7ff2180afcf0 msgr2=0x7ff2180b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.172+0000 7ff21d996640 1 -- 172.21.15.6:0/2437080495 shutdown_connections 2023-07-21T22:58:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.172+0000 7ff21d996640 1 -- 172.21.15.6:0/2437080495 wait complete. 2023-07-21T22:58:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.172+0000 7ff21d996640 1 Processor -- start 2023-07-21T22:58:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.172+0000 7ff21d996640 1 -- start start 2023-07-21T22:58:02.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.172+0000 7ff21d996640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2180c8ad0 0x7ff2180b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.172+0000 7ff21d996640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2180c9560 0x7ff21814f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.172+0000 7ff21d996640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff218158ce0 0x7ff2180c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.172+0000 7ff21d996640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180c6710 con 0x7ff2180c8ad0 2023-07-21T22:58:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.172+0000 7ff21d996640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180c69f0 con 0x7ff2180c9560 2023-07-21T22:58:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.172+0000 7ff21d996640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180c6cd0 con 0x7ff218158ce0 2023-07-21T22:58:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.172+0000 7ff216ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2180c8ad0 0x7ff2180b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.172+0000 7ff216ffd640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2180c8ad0 0x7ff2180b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50738/0 (socket says 172.21.15.6:50738) 2023-07-21T22:58:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.172+0000 7ff216ffd640 1 -- 172.21.15.6:0/656327346 learned_addr learned my addr 172.21.15.6:0/656327346 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:02.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.176+0000 7ff2177fe640 1 --2- 172.21.15.6:0/656327346 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff218158ce0 0x7ff2180c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.176+0000 7ff20ffff640 1 --2- 172.21.15.6:0/656327346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2180c9560 0x7ff21814f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.176+0000 7ff216ffd640 1 -- 172.21.15.6:0/656327346 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff218158ce0 msgr2=0x7ff2180c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.176+0000 7ff216ffd640 1 --2- 172.21.15.6:0/656327346 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff218158ce0 0x7ff2180c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.176+0000 7ff216ffd640 1 -- 172.21.15.6:0/656327346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2180c9560 msgr2=0x7ff21814f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.176+0000 7ff216ffd640 1 --2- 172.21.15.6:0/656327346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2180c9560 0x7ff21814f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.176+0000 7ff216ffd640 1 -- 172.21.15.6:0/656327346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20000b770 con 0x7ff2180c8ad0 2023-07-21T22:58:02.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.176+0000 7ff216ffd640 1 --2- 172.21.15.6:0/656327346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2180c8ad0 0x7ff2180b1ee0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7ff20800c3c0 tx=0x7ff20800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:02.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.176+0000 7ff214ff9640 1 -- 172.21.15.6:0/656327346 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2080052d0 con 0x7ff2180c8ad0 2023-07-21T22:58:02.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.176+0000 7ff214ff9640 1 -- 172.21.15.6:0/656327346 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff208005430 con 0x7ff2180c8ad0 2023-07-21T22:58:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.176+0000 7ff214ff9640 1 -- 172.21.15.6:0/656327346 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208003840 con 0x7ff2180c8ad0 2023-07-21T22:58:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.176+0000 7ff21d996640 1 -- 172.21.15.6:0/656327346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2180c6fb0 con 0x7ff2180c8ad0 2023-07-21T22:58:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.176+0000 7ff21d996640 1 -- 172.21.15.6:0/656327346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2180c6400 con 0x7ff2180c8ad0 2023-07-21T22:58:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.176+0000 7ff21d996640 1 -- 172.21.15.6:0/656327346 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2180ca1a0 con 0x7ff2180c8ad0 2023-07-21T22:58:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.176+0000 7ff214ff9640 1 -- 172.21.15.6:0/656327346 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff2080039a0 con 0x7ff2180c8ad0 2023-07-21T22:58:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.176+0000 7ff214ff9640 1 --2- 172.21.15.6:0/656327346 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff1f80663a0 0x7ff1f8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.176+0000 7ff214ff9640 1 -- 172.21.15.6:0/656327346 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7ff2080833d0 con 0x7ff2180c8ad0 2023-07-21T22:58:02.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.180+0000 7ff20ffff640 1 --2- 172.21.15.6:0/656327346 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff1f80663a0 0x7ff1f8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.180+0000 7ff20ffff640 1 --2- 172.21.15.6:0/656327346 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff1f80663a0 0x7ff1f8068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff2000b1000 tx=0x7ff200008040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:02.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.184+0000 7ff214ff9640 1 -- 172.21.15.6:0/656327346 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff208050720 con 0x7ff2180c8ad0 2023-07-21T22:58:02.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.336+0000 7ff21d996640 1 -- 172.21.15.6:0/656327346 --> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2180c6b60 con 0x7ff1f80663a0 2023-07-21T22:58:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.336+0000 7ff214ff9640 1 -- 172.21.15.6:0/656327346 <== mgr.10231 v2:172.21.15.161:6832/1416042622 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff2180c6b60 con 0x7ff1f80663a0 2023-07-21T22:58:02.373 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 6 to deep-scrub 2023-07-21T22:58:02.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.340+0000 7ff21d996640 1 -- 172.21.15.6:0/656327346 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff1f80663a0 msgr2=0x7ff1f8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.340+0000 7ff21d996640 1 --2- 172.21.15.6:0/656327346 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff1f80663a0 0x7ff1f8068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff2000b1000 tx=0x7ff200008040 comp rx=0 tx=0).stop 2023-07-21T22:58:02.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.340+0000 7ff21d996640 1 -- 172.21.15.6:0/656327346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2180c8ad0 msgr2=0x7ff2180b1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.340+0000 7ff21d996640 1 --2- 172.21.15.6:0/656327346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2180c8ad0 0x7ff2180b1ee0 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7ff20800c3c0 tx=0x7ff20800c880 comp rx=0 tx=0).stop 2023-07-21T22:58:02.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.340+0000 7ff21d996640 1 -- 172.21.15.6:0/656327346 shutdown_connections 2023-07-21T22:58:02.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.340+0000 7ff21d996640 1 --2- 172.21.15.6:0/656327346 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7ff1f80663a0 0x7ff1f8068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.340+0000 7ff21d996640 1 --2- 172.21.15.6:0/656327346 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff218158ce0 0x7ff2180c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.340+0000 7ff21d996640 1 --2- 172.21.15.6:0/656327346 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2180c9560 0x7ff21814f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.340+0000 7ff21d996640 1 --2- 172.21.15.6:0/656327346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2180c8ad0 0x7ff2180b1ee0 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.340+0000 7ff21d996640 1 -- 172.21.15.6:0/656327346 >> 172.21.15.6:0/656327346 conn(0x7ff2180afcf0 msgr2=0x7ff218070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:02.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.340+0000 7ff21d996640 1 -- 172.21.15.6:0/656327346 shutdown_connections 2023-07-21T22:58:02.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.340+0000 7ff21d996640 1 -- 172.21.15.6:0/656327346 wait complete. 2023-07-21T22:58:02.394 INFO:tasks.ceph:Scrubbing osd.7 2023-07-21T22:58:02.395 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-07-21T22:58:02.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.508+0000 7f5c5a540640 1 Processor -- start 2023-07-21T22:58:02.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.508+0000 7f5c5a540640 1 -- start start 2023-07-21T22:58:02.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.512+0000 7f5c5a540640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c540c3ac0 0x7f5c540c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.512+0000 7f5c5a540640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c540695b0 con 0x7f5c540af2b0 2023-07-21T22:58:02.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.512+0000 7f5c5a540640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c54069890 con 0x7f5c540cd120 2023-07-21T22:58:02.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.512+0000 7f5c5a540640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c54069b70 con 0x7f5c540c3ac0 2023-07-21T22:58:02.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.512+0000 7f5c53fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c540c3ac0 0x7f5c540c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.512+0000 7f5c537fe640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5c540af2b0 0x7f5c540ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:39980/0 (socket says 172.21.15.6:39980) 2023-07-21T22:58:02.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.512+0000 7f5c537fe640 1 -- 172.21.15.6:0/841913947 learned_addr learned my addr 172.21.15.6:0/841913947 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:58:02.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.512+0000 7f5c53fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c540c3ac0 0x7f5c540c2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50754/0 (socket says 172.21.15.6:50754) 2023-07-21T22:58:02.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.512+0000 7f5c53fff640 1 -- 172.21.15.6:0/841913947 >> v1:172.21.15.161:6789/0 conn(0x7f5c540cd120 legacy=0x7f5c540cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.512+0000 7f5c53fff640 1 -- 172.21.15.6:0/841913947 >> v1:172.21.15.6:6789/0 conn(0x7f5c540af2b0 legacy=0x7f5c540ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.512+0000 7f5c52ffd640 1 -- 172.21.15.6:0/841913947 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879350006 0 0) 0x7f5c540695b0 con 0x7f5c540af2b0 2023-07-21T22:58:02.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.512+0000 7f5c53fff640 1 -- 172.21.15.6:0/841913947 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c54069e50 con 0x7f5c540c3ac0 2023-07-21T22:58:02.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.516+0000 7f5c53fff640 1 --2- 172.21.15.6:0/841913947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c540c3ac0 0x7f5c540c2d30 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f5c440097c0 tx=0x7f5c4401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b405f767197002 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:02.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.516+0000 7f5c52ffd640 1 -- 172.21.15.6:0/841913947 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c440a6040 con 0x7f5c540c3ac0 2023-07-21T22:58:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.516+0000 7f5c52ffd640 1 -- 172.21.15.6:0/841913947 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c440aa600 con 0x7f5c540c3ac0 2023-07-21T22:58:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.516+0000 7f5c52ffd640 1 -- 172.21.15.6:0/841913947 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c440aa990 con 0x7f5c540c3ac0 2023-07-21T22:58:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.516+0000 7f5c5a540640 1 -- 172.21.15.6:0/841913947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c540c3ac0 msgr2=0x7f5c540c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.516+0000 7f5c5a540640 1 --2- 172.21.15.6:0/841913947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c540c3ac0 0x7f5c540c2d30 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f5c440097c0 tx=0x7f5c4401c480 comp rx=0 tx=0).stop 2023-07-21T22:58:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.516+0000 7f5c5a540640 1 -- 172.21.15.6:0/841913947 shutdown_connections 2023-07-21T22:58:02.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.516+0000 7f5c5a540640 1 --2- 172.21.15.6:0/841913947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c540c3ac0 0x7f5c540c2d30 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.516+0000 7f5c5a540640 1 -- 172.21.15.6:0/841913947 >> 172.21.15.6:0/841913947 conn(0x7f5c540cde90 msgr2=0x7f5c540ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:02.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.516+0000 7f5c5a540640 1 -- 172.21.15.6:0/841913947 shutdown_connections 2023-07-21T22:58:02.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.516+0000 7f5c5a540640 1 -- 172.21.15.6:0/841913947 wait complete. 2023-07-21T22:58:02.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.516+0000 7f5c5a540640 1 Processor -- start 2023-07-21T22:58:02.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.516+0000 7f5c5a540640 1 -- start start 2023-07-21T22:58:02.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c5a540640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c540af2b0 0x7f5c5415a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c5a540640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c540c3ac0 0x7f5c541496a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c5a540640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c540cd120 0x7f5c54157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c5a540640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c54153b20 con 0x7f5c540cd120 2023-07-21T22:58:02.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c5a540640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c54153840 con 0x7f5c540af2b0 2023-07-21T22:58:02.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c5a540640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c540b0ef0 con 0x7f5c540c3ac0 2023-07-21T22:58:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c58add640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c540cd120 0x7f5c54157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c58add640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c540cd120 0x7f5c54157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50764/0 (socket says 172.21.15.6:50764) 2023-07-21T22:58:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c58add640 1 -- 172.21.15.6:0/774292280 learned_addr learned my addr 172.21.15.6:0/774292280 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:02.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c53fff640 1 --2- 172.21.15.6:0/774292280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c540af2b0 0x7f5c5415a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c537fe640 1 --2- 172.21.15.6:0/774292280 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c540c3ac0 0x7f5c541496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c58add640 1 -- 172.21.15.6:0/774292280 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c540c3ac0 msgr2=0x7f5c541496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c58add640 1 --2- 172.21.15.6:0/774292280 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c540c3ac0 0x7f5c541496a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c58add640 1 -- 172.21.15.6:0/774292280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c540af2b0 msgr2=0x7f5c5415a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c58add640 1 --2- 172.21.15.6:0/774292280 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c540af2b0 0x7f5c5415a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c58add640 1 -- 172.21.15.6:0/774292280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c44009420 con 0x7f5c540cd120 2023-07-21T22:58:02.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c537fe640 1 --2- 172.21.15.6:0/774292280 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5c540c3ac0 0x7f5c541496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:58:02.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c58add640 1 --2- 172.21.15.6:0/774292280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c540cd120 0x7f5c54157e20 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c00c730 tx=0x7f5c4c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:02.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c50ff9640 1 -- 172.21.15.6:0/774292280 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c003b80 con 0x7f5c540cd120 2023-07-21T22:58:02.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c50ff9640 1 -- 172.21.15.6:0/774292280 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4c003ce0 con 0x7f5c540cd120 2023-07-21T22:58:02.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c5a540640 1 -- 172.21.15.6:0/774292280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c540b11d0 con 0x7f5c540cd120 2023-07-21T22:58:02.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c50ff9640 1 -- 172.21.15.6:0/774292280 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c00aa30 con 0x7f5c540cd120 2023-07-21T22:58:02.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c5a540640 1 -- 172.21.15.6:0/774292280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c54149be0 con 0x7f5c540cd120 2023-07-21T22:58:02.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c5a540640 1 -- 172.21.15.6:0/774292280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5c540678d0 con 0x7f5c540cd120 2023-07-21T22:58:02.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.520+0000 7f5c50ff9640 1 -- 172.21.15.6:0/774292280 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5c4c00ab90 con 0x7f5c540cd120 2023-07-21T22:58:02.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.524+0000 7f5c50ff9640 1 --2- 172.21.15.6:0/774292280 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f5c400663d0 0x7f5c40068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.524+0000 7f5c50ff9640 1 -- 172.21.15.6:0/774292280 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f5c4c083ba0 con 0x7f5c540cd120 2023-07-21T22:58:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.524+0000 7f5c50ff9640 1 --2- 172.21.15.6:0/774292280 >> [v2:172.21.15.161:6816/2760284950,v1:172.21.15.161:6817/2760284950] conn(0x7f5c4006ceb0 0x7f5c4006f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.524+0000 7f5c50ff9640 1 -- 172.21.15.6:0/774292280 --> [v2:172.21.15.161:6816/2760284950,v1:172.21.15.161:6817/2760284950] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5c4006f990 con 0x7f5c4006ceb0 2023-07-21T22:58:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.524+0000 7f5c50ff9640 1 -- 172.21.15.6:0/774292280 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=197) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c4c0882a0 con 0x7f5c540cd120 2023-07-21T22:58:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.524+0000 7f5c53fff640 1 --2- 172.21.15.6:0/774292280 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f5c400663d0 0x7f5c40068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.524+0000 7f5c537fe640 1 --2- 172.21.15.6:0/774292280 >> [v2:172.21.15.161:6816/2760284950,v1:172.21.15.161:6817/2760284950] conn(0x7f5c4006ceb0 0x7f5c4006f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.524+0000 7f5c53fff640 1 --2- 172.21.15.6:0/774292280 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f5c400663d0 0x7f5c40068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5c440ae000 tx=0x7f5c440b5040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.524+0000 7f5c537fe640 1 --2- 172.21.15.6:0/774292280 >> [v2:172.21.15.161:6816/2760284950,v1:172.21.15.161:6817/2760284950] conn(0x7f5c4006ceb0 0x7f5c4006f2c0 crc :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:02.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.524+0000 7f5c50ff9640 1 -- 172.21.15.6:0/774292280 <== osd.7 v2:172.21.15.161:6816/2760284950 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5c4006f990 con 0x7f5c4006ceb0 2023-07-21T22:58:02.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.536+0000 7f5c5a540640 1 -- 172.21.15.6:0/774292280 --> [v2:172.21.15.161:6816/2760284950,v1:172.21.15.161:6817/2760284950] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5c541611a0 con 0x7f5c4006ceb0 2023-07-21T22:58:02.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.536+0000 7f5c50ff9640 1 -- 172.21.15.6:0/774292280 <== osd.7 v2:172.21.15.161:6816/2760284950 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5c541611a0 con 0x7f5c4006ceb0 2023-07-21T22:58:02.574 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-21T22:58:02.574 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-21T22:58:02.574 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-21T22:58:02.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.540+0000 7f5c5a540640 1 -- 172.21.15.6:0/774292280 >> [v2:172.21.15.161:6816/2760284950,v1:172.21.15.161:6817/2760284950] conn(0x7f5c4006ceb0 msgr2=0x7f5c4006f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.540+0000 7f5c5a540640 1 --2- 172.21.15.6:0/774292280 >> [v2:172.21.15.161:6816/2760284950,v1:172.21.15.161:6817/2760284950] conn(0x7f5c4006ceb0 0x7f5c4006f2c0 crc :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.540+0000 7f5c5a540640 1 -- 172.21.15.6:0/774292280 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f5c400663d0 msgr2=0x7f5c40068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.540+0000 7f5c5a540640 1 --2- 172.21.15.6:0/774292280 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f5c400663d0 0x7f5c40068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5c440ae000 tx=0x7f5c440b5040 comp rx=0 tx=0).stop 2023-07-21T22:58:02.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.540+0000 7f5c5a540640 1 -- 172.21.15.6:0/774292280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c540cd120 msgr2=0x7f5c54157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.540+0000 7f5c5a540640 1 --2- 172.21.15.6:0/774292280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c540cd120 0x7f5c54157e20 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c00c730 tx=0x7f5c4c00cbf0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.540+0000 7f5c58add640 1 -- 172.21.15.6:0/774292280 reap_dead start 2023-07-21T22:58:02.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.540+0000 7f5c5a540640 1 -- 172.21.15.6:0/774292280 shutdown_connections 2023-07-21T22:58:02.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.540+0000 7f5c5a540640 1 -- 172.21.15.6:0/774292280 >> 172.21.15.6:0/774292280 conn(0x7f5c540cde90 msgr2=0x7f5c5406f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:02.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.540+0000 7f5c5a540640 1 -- 172.21.15.6:0/774292280 shutdown_connections 2023-07-21T22:58:02.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.540+0000 7f5c5a540640 1 -- 172.21.15.6:0/774292280 wait complete. 2023-07-21T22:58:02.592 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-07-21T22:58:02.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.700+0000 7f07eef74640 1 Processor -- start 2023-07-21T22:58:02.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.700+0000 7f07eef74640 1 -- start start 2023-07-21T22:58:02.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.704+0000 7f07eef74640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07e8070b70 0x7f07e8070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.704+0000 7f07eef74640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f07e806b1e0 0x7f07e80c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.704+0000 7f07eef74640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f07e80c21f0 0x7f07e80cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.704+0000 7f07eef74640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e80cac70 con 0x7f07e806b1e0 2023-07-21T22:58:02.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.704+0000 7f07eef74640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e8071480 con 0x7f07e80c21f0 2023-07-21T22:58:02.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.704+0000 7f07eef74640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80ca060 con 0x7f07e8070b70 2023-07-21T22:58:02.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.704+0000 7f07e7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f07e806b1e0 0x7f07e80c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.704+0000 7f07e7fff640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f07e806b1e0 0x7f07e80c1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50768/0 (socket says 172.21.15.6:50768) 2023-07-21T22:58:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.704+0000 7f07e7fff640 1 -- 172.21.15.6:0/1326327607 learned_addr learned my addr 172.21.15.6:0/1326327607 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.704+0000 7f07ecd10640 1 --2- 172.21.15.6:0/1326327607 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07e8070b70 0x7f07e8070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.704+0000 7f07ed511640 1 --2- 172.21.15.6:0/1326327607 >> v2:172.21.15.161:3300/0 conn(0x7f07e80c21f0 0x7f07e80cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.704+0000 7f07e7fff640 1 -- 172.21.15.6:0/1326327607 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07e8070b70 msgr2=0x7f07e8070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:02.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.704+0000 7f07e7fff640 1 --2- 172.21.15.6:0/1326327607 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07e8070b70 0x7f07e8070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.704+0000 7f07e7fff640 1 -- 172.21.15.6:0/1326327607 >> v2:172.21.15.161:3300/0 conn(0x7f07e80c21f0 msgr2=0x7f07e80cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:02.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.704+0000 7f07e7fff640 1 --2- 172.21.15.6:0/1326327607 >> v2:172.21.15.161:3300/0 conn(0x7f07e80c21f0 0x7f07e80cb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.704+0000 7f07e7fff640 1 -- 172.21.15.6:0/1326327607 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e80ca340 con 0x7f07e806b1e0 2023-07-21T22:58:02.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.708+0000 7f07e7fff640 1 --2- 172.21.15.6:0/1326327607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e806b1e0 0x7f07e80c1cb0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f07e806a2c0 tx=0x7f07d401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628b9b28ecc24088 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:02.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.708+0000 7f07e77fe640 1 -- 172.21.15.6:0/1326327607 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40ab620 con 0x7f07e806b1e0 2023-07-21T22:58:02.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.708+0000 7f07e77fe640 1 -- 172.21.15.6:0/1326327607 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d40ab780 con 0x7f07e806b1e0 2023-07-21T22:58:02.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.708+0000 7f07e77fe640 1 -- 172.21.15.6:0/1326327607 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40abb10 con 0x7f07e806b1e0 2023-07-21T22:58:02.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.708+0000 7f07eef74640 1 -- 172.21.15.6:0/1326327607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e806b1e0 msgr2=0x7f07e80c1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.708+0000 7f07eef74640 1 --2- 172.21.15.6:0/1326327607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e806b1e0 0x7f07e80c1cb0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f07e806a2c0 tx=0x7f07d401c440 comp rx=0 tx=0).stop 2023-07-21T22:58:02.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.708+0000 7f07eef74640 1 -- 172.21.15.6:0/1326327607 shutdown_connections 2023-07-21T22:58:02.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.708+0000 7f07eef74640 1 --2- 172.21.15.6:0/1326327607 >> v2:172.21.15.161:3300/0 conn(0x7f07e80c21f0 0x7f07e80cb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.708+0000 7f07eef74640 1 --2- 172.21.15.6:0/1326327607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e806b1e0 0x7f07e80c1cb0 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.708+0000 7f07eef74640 1 --2- 172.21.15.6:0/1326327607 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07e8070b70 0x7f07e8070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.708+0000 7f07eef74640 1 -- 172.21.15.6:0/1326327607 >> 172.21.15.6:0/1326327607 conn(0x7f07e80afcf0 msgr2=0x7f07e80b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:02.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.708+0000 7f07eef74640 1 -- 172.21.15.6:0/1326327607 shutdown_connections 2023-07-21T22:58:02.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.708+0000 7f07eef74640 1 -- 172.21.15.6:0/1326327607 wait complete. 2023-07-21T22:58:02.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.708+0000 7f07eef74640 1 Processor -- start 2023-07-21T22:58:02.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.708+0000 7f07eef74640 1 -- start start 2023-07-21T22:58:02.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07eef74640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07e806b1e0 0x7f07e814b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07eef74640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e8070b70 0x7f07e8158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07eef74640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07e80c21f0 0x7f07e8159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07eef74640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80c2990 con 0x7f07e8070b70 2023-07-21T22:58:02.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07eef74640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e8159570 con 0x7f07e80c21f0 2023-07-21T22:58:02.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07eef74640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80c85f0 con 0x7f07e806b1e0 2023-07-21T22:58:02.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07e7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e8070b70 0x7f07e8158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07e7fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e8070b70 0x7f07e8158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50772/0 (socket says 172.21.15.6:50772) 2023-07-21T22:58:02.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07e7fff640 1 -- 172.21.15.6:0/525978667 learned_addr learned my addr 172.21.15.6:0/525978667 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:02.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07ed511640 1 --2- 172.21.15.6:0/525978667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07e80c21f0 0x7f07e8159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07ecd10640 1 --2- 172.21.15.6:0/525978667 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07e806b1e0 0x7f07e814b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07e7fff640 1 -- 172.21.15.6:0/525978667 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07e806b1e0 msgr2=0x7f07e814b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07e7fff640 1 --2- 172.21.15.6:0/525978667 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07e806b1e0 0x7f07e814b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07e7fff640 1 -- 172.21.15.6:0/525978667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07e80c21f0 msgr2=0x7f07e8159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07e7fff640 1 --2- 172.21.15.6:0/525978667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07e80c21f0 0x7f07e8159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07e7fff640 1 -- 172.21.15.6:0/525978667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d40094d0 con 0x7f07e8070b70 2023-07-21T22:58:02.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07e7fff640 1 --2- 172.21.15.6:0/525978667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e8070b70 0x7f07e8158af0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f07d401c920 tx=0x7f07d401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:02.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07e57fa640 1 -- 172.21.15.6:0/525978667 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40be3f0 con 0x7f07e8070b70 2023-07-21T22:58:02.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07e57fa640 1 -- 172.21.15.6:0/525978667 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d40be550 con 0x7f07e8070b70 2023-07-21T22:58:02.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07e57fa640 1 -- 172.21.15.6:0/525978667 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d40be900 con 0x7f07e8070b70 2023-07-21T22:58:02.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07eef74640 1 -- 172.21.15.6:0/525978667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e814bc90 con 0x7f07e8070b70 2023-07-21T22:58:02.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07eef74640 1 -- 172.21.15.6:0/525978667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e8156d20 con 0x7f07e8070b70 2023-07-21T22:58:02.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07eef74640 1 -- 172.21.15.6:0/525978667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e80c2b40 con 0x7f07e8070b70 2023-07-21T22:58:02.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.712+0000 7f07e57fa640 1 -- 172.21.15.6:0/525978667 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f07d40c7440 con 0x7f07e8070b70 2023-07-21T22:58:02.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.716+0000 7f07e57fa640 1 --2- 172.21.15.6:0/525978667 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f07cc0663a0 0x7f07cc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:02.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.716+0000 7f07e57fa640 1 -- 172.21.15.6:0/525978667 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f07d411e780 con 0x7f07e8070b70 2023-07-21T22:58:02.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.716+0000 7f07ecd10640 1 --2- 172.21.15.6:0/525978667 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f07cc0663a0 0x7f07cc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:02.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.716+0000 7f07ecd10640 1 --2- 172.21.15.6:0/525978667 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f07cc0663a0 0x7f07cc068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f07e814dba0 tx=0x7f07dc008040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:02.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.720+0000 7f07e57fa640 1 -- 172.21.15.6:0/525978667 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f07d40eba50 con 0x7f07e8070b70 2023-07-21T22:58:02.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.872+0000 7f07eef74640 1 -- 172.21.15.6:0/525978667 --> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f07e806f5b0 con 0x7f07cc0663a0 2023-07-21T22:58:02.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.876+0000 7f07e57fa640 1 -- 172.21.15.6:0/525978667 <== mgr.10231 v2:172.21.15.161:6832/1416042622 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f07dc00b720 con 0x7f07cc0663a0 2023-07-21T22:58:02.910 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 7 to deep-scrub 2023-07-21T22:58:02.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.876+0000 7f07eef74640 1 -- 172.21.15.6:0/525978667 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f07cc0663a0 msgr2=0x7f07cc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.876+0000 7f07eef74640 1 --2- 172.21.15.6:0/525978667 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f07cc0663a0 0x7f07cc068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f07e814dba0 tx=0x7f07dc008040 comp rx=0 tx=0).stop 2023-07-21T22:58:02.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.876+0000 7f07eef74640 1 -- 172.21.15.6:0/525978667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e8070b70 msgr2=0x7f07e8158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:02.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.876+0000 7f07eef74640 1 --2- 172.21.15.6:0/525978667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e8070b70 0x7f07e8158af0 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f07d401c920 tx=0x7f07d401ac80 comp rx=0 tx=0).stop 2023-07-21T22:58:02.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.876+0000 7f07eef74640 1 -- 172.21.15.6:0/525978667 shutdown_connections 2023-07-21T22:58:02.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.876+0000 7f07eef74640 1 --2- 172.21.15.6:0/525978667 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f07cc0663a0 0x7f07cc068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.876+0000 7f07eef74640 1 --2- 172.21.15.6:0/525978667 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07e80c21f0 0x7f07e8159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.876+0000 7f07eef74640 1 --2- 172.21.15.6:0/525978667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e8070b70 0x7f07e8158af0 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.876+0000 7f07eef74640 1 --2- 172.21.15.6:0/525978667 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f07e806b1e0 0x7f07e814b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:02.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.876+0000 7f07eef74640 1 -- 172.21.15.6:0/525978667 >> 172.21.15.6:0/525978667 conn(0x7f07e80afcf0 msgr2=0x7f07e80b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:02.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.876+0000 7f07eef74640 1 -- 172.21.15.6:0/525978667 shutdown_connections 2023-07-21T22:58:02.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:02.876+0000 7f07eef74640 1 -- 172.21.15.6:0/525978667 wait complete. 2023-07-21T22:58:02.932 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:58:03.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.040+0000 7f812866d640 1 Processor -- start 2023-07-21T22:58:03.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.040+0000 7f812866d640 1 -- start start 2023-07-21T22:58:03.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.044+0000 7f812866d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8120158ce0 0x7f8120070450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:03.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.044+0000 7f812866d640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81200c8ad0 0x7f81200c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:03.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.044+0000 7f812866d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81200cc700 con 0x7f81200c9560 2023-07-21T22:58:03.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.044+0000 7f812866d640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81200c99e0 con 0x7f81200c8ad0 2023-07-21T22:58:03.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.044+0000 7f812866d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81200b0ff0 con 0x7f8120158ce0 2023-07-21T22:58:03.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.044+0000 7f8125c08640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81200c8ad0 0x7f81200c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:03.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.044+0000 7f8125c08640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f81200c8ad0 0x7f81200c9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50774/0 (socket says 172.21.15.6:50774) 2023-07-21T22:58:03.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.044+0000 7f8125c08640 1 -- 172.21.15.6:0/1420519149 learned_addr learned my addr 172.21.15.6:0/1420519149 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:03.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.044+0000 7f8126409640 1 --2- 172.21.15.6:0/1420519149 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8120158ce0 0x7f8120070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:03.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.044+0000 7f8125c08640 1 -- 172.21.15.6:0/1420519149 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8120158ce0 msgr2=0x7f8120070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:03.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.044+0000 7f8125c08640 1 --2- 172.21.15.6:0/1420519149 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8120158ce0 0x7f8120070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:03.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.044+0000 7f8125c08640 1 -- 172.21.15.6:0/1420519149 >> v1:172.21.15.161:6789/0 conn(0x7f81200c9560 legacy=0x7f81200cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:03.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.044+0000 7f8125c08640 1 -- 172.21.15.6:0/1420519149 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8120070c80 con 0x7f81200c8ad0 2023-07-21T22:58:03.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.048+0000 7f8125c08640 1 --2- 172.21.15.6:0/1420519149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81200c8ad0 0x7f81200c9020 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f811000bb10 tx=0x7f811001eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647ad01863fe1e3f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:03.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.048+0000 7f8125407640 1 -- 172.21.15.6:0/1420519149 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81200cba20 con 0x7f81200c8ad0 2023-07-21T22:58:03.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.048+0000 7f8125407640 1 -- 172.21.15.6:0/1420519149 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81100a7b90 con 0x7f81200c8ad0 2023-07-21T22:58:03.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.048+0000 7f8125407640 1 -- 172.21.15.6:0/1420519149 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81100af440 con 0x7f81200c8ad0 2023-07-21T22:58:03.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.048+0000 7f812866d640 1 -- 172.21.15.6:0/1420519149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81200c8ad0 msgr2=0x7f81200c9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:03.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.048+0000 7f812866d640 1 --2- 172.21.15.6:0/1420519149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81200c8ad0 0x7f81200c9020 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f811000bb10 tx=0x7f811001eac0 comp rx=0 tx=0).stop 2023-07-21T22:58:03.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.048+0000 7f812866d640 1 -- 172.21.15.6:0/1420519149 shutdown_connections 2023-07-21T22:58:03.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.048+0000 7f812866d640 1 --2- 172.21.15.6:0/1420519149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81200c8ad0 0x7f81200c9020 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:03.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.048+0000 7f812866d640 1 --2- 172.21.15.6:0/1420519149 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8120158ce0 0x7f8120070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:03.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.048+0000 7f812866d640 1 -- 172.21.15.6:0/1420519149 >> 172.21.15.6:0/1420519149 conn(0x7f81200afcf0 msgr2=0x7f81200b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:03.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.048+0000 7f812866d640 1 -- 172.21.15.6:0/1420519149 shutdown_connections 2023-07-21T22:58:03.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.048+0000 7f812866d640 1 -- 172.21.15.6:0/1420519149 wait complete. 2023-07-21T22:58:03.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.048+0000 7f812866d640 1 Processor -- start 2023-07-21T22:58:03.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.048+0000 7f812866d640 1 -- start start 2023-07-21T22:58:03.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f812866d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81200c8ad0 0x7f81200c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:03.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f812866d640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81200c9560 0x7f81200c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:03.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f812866d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8120158ce0 0x7f81200c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:03.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f812866d640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81200c4f40 con 0x7f81200c9560 2023-07-21T22:58:03.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f812866d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81200c0fc0 con 0x7f8120158ce0 2023-07-21T22:58:03.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f812866d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81200c12a0 con 0x7f81200c8ad0 2023-07-21T22:58:03.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f8125c08640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81200c9560 0x7f81200c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:03.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f8125c08640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81200c9560 0x7f81200c4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50788/0 (socket says 172.21.15.6:50788) 2023-07-21T22:58:03.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f8125c08640 1 -- 172.21.15.6:0/996242396 learned_addr learned my addr 172.21.15.6:0/996242396 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:03.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f8126409640 1 --2- 172.21.15.6:0/996242396 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81200c8ad0 0x7f81200c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:03.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f8126c0a640 1 --2- 172.21.15.6:0/996242396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8120158ce0 0x7f81200c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:03.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f8125c08640 1 -- 172.21.15.6:0/996242396 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81200c8ad0 msgr2=0x7f81200c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:03.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f8125c08640 1 --2- 172.21.15.6:0/996242396 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81200c8ad0 0x7f81200c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:03.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f8125c08640 1 -- 172.21.15.6:0/996242396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8120158ce0 msgr2=0x7f81200c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:03.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f8125c08640 1 --2- 172.21.15.6:0/996242396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8120158ce0 0x7f81200c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:03.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f8125c08640 1 -- 172.21.15.6:0/996242396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811000b770 con 0x7f81200c9560 2023-07-21T22:58:03.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f8126c0a640 1 --2- 172.21.15.6:0/996242396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8120158ce0 0x7f81200c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:58:03.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f8125c08640 1 --2- 172.21.15.6:0/996242396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81200c9560 0x7f81200c4a00 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f811000b2c0 tx=0x7f811001b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:03.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f8116ffd640 1 -- 172.21.15.6:0/996242396 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81100ba650 con 0x7f81200c9560 2023-07-21T22:58:03.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f8116ffd640 1 -- 172.21.15.6:0/996242396 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81100ba7d0 con 0x7f81200c9560 2023-07-21T22:58:03.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f8116ffd640 1 -- 172.21.15.6:0/996242396 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81100bab80 con 0x7f81200c9560 2023-07-21T22:58:03.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f812866d640 1 -- 172.21.15.6:0/996242396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81200c1c90 con 0x7f81200c9560 2023-07-21T22:58:03.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f812866d640 1 -- 172.21.15.6:0/996242396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81200c2250 con 0x7f81200c9560 2023-07-21T22:58:03.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f812866d640 1 -- 172.21.15.6:0/996242396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81200ca1a0 con 0x7f81200c9560 2023-07-21T22:58:03.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.052+0000 7f8116ffd640 1 -- 172.21.15.6:0/996242396 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f81100b6040 con 0x7f81200c9560 2023-07-21T22:58:03.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.056+0000 7f8116ffd640 1 --2- 172.21.15.6:0/996242396 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f81040663a0 0x7f8104068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:03.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.056+0000 7f8116ffd640 1 -- 172.21.15.6:0/996242396 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f8110121540 con 0x7f81200c9560 2023-07-21T22:58:03.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.056+0000 7f8126409640 1 --2- 172.21.15.6:0/996242396 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f81040663a0 0x7f8104068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:03.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.056+0000 7f8126409640 1 --2- 172.21.15.6:0/996242396 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f81040663a0 0x7f8104068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f811c006aa0 tx=0x7f811c008040 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:03.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.060+0000 7f8116ffd640 1 -- 172.21.15.6:0/996242396 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f81100ee870 con 0x7f81200c9560 2023-07-21T22:58:03.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.212+0000 7f812866d640 1 -- 172.21.15.6:0/996242396 --> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8120070990 con 0x7f81040663a0 2023-07-21T22:58:03.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.216+0000 7f8116ffd640 1 -- 172.21.15.6:0/996242396 <== mgr.10231 v2:172.21.15.161:6832/1416042622 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72431 (secure 0 0 0) 0x7f811c004030 con 0x7f81040663a0 2023-07-21T22:58:03.253 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:58:03.254 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:58:03.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.216+0000 7f812866d640 1 -- 172.21.15.6:0/996242396 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f81040663a0 msgr2=0x7f8104068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:03.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.216+0000 7f812866d640 1 --2- 172.21.15.6:0/996242396 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f81040663a0 0x7f8104068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f811c006aa0 tx=0x7f811c008040 comp rx=0 tx=0).stop 2023-07-21T22:58:03.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.216+0000 7f812866d640 1 -- 172.21.15.6:0/996242396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81200c9560 msgr2=0x7f81200c4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:03.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.216+0000 7f812866d640 1 --2- 172.21.15.6:0/996242396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81200c9560 0x7f81200c4a00 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 crypto rx=0x7f811000b2c0 tx=0x7f811001b860 comp rx=0 tx=0).stop 2023-07-21T22:58:03.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.216+0000 7f812866d640 1 -- 172.21.15.6:0/996242396 shutdown_connections 2023-07-21T22:58:03.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.216+0000 7f812866d640 1 --2- 172.21.15.6:0/996242396 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f81040663a0 0x7f8104068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:03.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.216+0000 7f812866d640 1 --2- 172.21.15.6:0/996242396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8120158ce0 0x7f81200c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:03.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.216+0000 7f812866d640 1 --2- 172.21.15.6:0/996242396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81200c9560 0x7f81200c4a00 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:03.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.216+0000 7f812866d640 1 --2- 172.21.15.6:0/996242396 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f81200c8ad0 0x7f81200c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:03.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.216+0000 7f812866d640 1 -- 172.21.15.6:0/996242396 >> 172.21.15.6:0/996242396 conn(0x7f81200afcf0 msgr2=0x7f8120150970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:03.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.216+0000 7f812866d640 1 -- 172.21.15.6:0/996242396 shutdown_connections 2023-07-21T22:58:03.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:03.216+0000 7f812866d640 1 -- 172.21.15.6:0/996242396 wait complete. 2023-07-21T22:58:03.272 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2023-07-21T22:58:02.854753+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":363880,"kb_used_data":20392,"kb_used_omap":0,"kb_used_meta":343424,"kb_avail":754610840,"statfs":{"total":773094113280,"available":772721500160,"internally_reserved":0,"allocated":20881408,"data_stored":11306432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":351666176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002474"},"pg_stats":[{"pgid":"1.0","version":"194'348","reported_seq":1303,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-07-21T22:57:53.695371+0000","last_change":"2023-07-21T22:18:32.309969+0000","last_active":"2023-07-21T22:57:53.695371+0000","last_peered":"2023-07-21T22:57:53.695371+0000","last_clean":"2023-07-21T22:57:53.695371+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:57:53.695371+0000","last_undegraded":"2023-07-21T22:57:53.695371+0000","last_fullsized":"2023-07-21T22:57:53.695371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:31.102436+0000","last_clean_scrub_stamp":"2023-07-21T22:18:31.102436+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:38:46.154813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":367,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-07-21T22:57:53.157408+0000","last_change":"2023-07-21T22:18:38.279626+0000","last_active":"2023-07-21T22:57:53.157408+0000","last_peered":"2023-07-21T22:57:53.157408+0000","last_clean":"2023-07-21T22:57:53.157408+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:57:53.157408+0000","last_undegraded":"2023-07-21T22:57:53.157408+0000","last_fullsized":"2023-07-21T22:57:53.157408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:10:23.829844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":328,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-07-21T22:57:53.695191+0000","last_change":"2023-07-21T22:18:38.281345+0000","last_active":"2023-07-21T22:57:53.695191+0000","last_peered":"2023-07-21T22:57:53.695191+0000","last_clean":"2023-07-21T22:57:53.695191+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:57:53.695191+0000","last_undegraded":"2023-07-21T22:57:53.695191+0000","last_fullsized":"2023-07-21T22:57:53.695191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:37:20.468178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":341,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-07-21T22:58:00.775752+0000","last_change":"2023-07-21T22:58:00.775752+0000","last_active":"2023-07-21T22:58:00.775752+0000","last_peered":"2023-07-21T22:58:00.775752+0000","last_clean":"2023-07-21T22:58:00.775752+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:58:00.775752+0000","last_undegraded":"2023-07-21T22:58:00.775752+0000","last_fullsized":"2023-07-21T22:58:00.775752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:58:00.775639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:58:00.775639+0000","last_clean_scrub_stamp":"2023-07-21T22:58:00.775639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:24:19.116277+0000","scrub_duration":0.0029924230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":367,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-07-21T22:57:53.157113+0000","last_change":"2023-07-21T22:18:38.279711+0000","last_active":"2023-07-21T22:57:53.157113+0000","last_peered":"2023-07-21T22:57:53.157113+0000","last_clean":"2023-07-21T22:57:53.157113+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:57:53.157113+0000","last_undegraded":"2023-07-21T22:57:53.157113+0000","last_fullsized":"2023-07-21T22:57:53.157113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:04:27.271616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":345,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-07-21T22:57:53.454339+0000","last_change":"2023-07-21T22:18:38.618185+0000","last_active":"2023-07-21T22:57:53.454339+0000","last_peered":"2023-07-21T22:57:53.454339+0000","last_clean":"2023-07-21T22:57:53.454339+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:57:53.454339+0000","last_undegraded":"2023-07-21T22:57:53.454339+0000","last_fullsized":"2023-07-21T22:57:53.454339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:25:51.421921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":327,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-07-21T22:57:53.695257+0000","last_change":"2023-07-21T22:18:38.619490+0000","last_active":"2023-07-21T22:57:53.695257+0000","last_peered":"2023-07-21T22:57:53.695257+0000","last_clean":"2023-07-21T22:57:53.695257+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:57:53.695257+0000","last_undegraded":"2023-07-21T22:57:53.695257+0000","last_fullsized":"2023-07-21T22:57:53.695257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:08:20.970160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":345,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-07-21T22:57:53.455734+0000","last_change":"2023-07-21T22:18:38.280126+0000","last_active":"2023-07-21T22:57:53.455734+0000","last_peered":"2023-07-21T22:57:53.455734+0000","last_clean":"2023-07-21T22:57:53.455734+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:57:53.455734+0000","last_undegraded":"2023-07-21T22:57:53.455734+0000","last_fullsized":"2023-07-21T22:57:53.455734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:59:35.462929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":325,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-07-21T22:57:54.561546+0000","last_change":"2023-07-21T22:18:38.283988+0000","last_active":"2023-07-21T22:57:54.561546+0000","last_peered":"2023-07-21T22:57:54.561546+0000","last_clean":"2023-07-21T22:57:54.561546+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:57:54.561546+0000","last_undegraded":"2023-07-21T22:57:54.561546+0000","last_fullsized":"2023-07-21T22:57:54.561546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:18:37.256848+0000","last_clean_scrub_stamp":"2023-07-21T22:18:37.256848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:32:23.326532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509906,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64368,"kb_used_data":2984,"kb_used_omap":0,"kb_used_meta":61376,"kb_avail":94307472,"statfs":{"total":96636764160,"available":96570851328,"internally_reserved":0,"allocated":3055616,"data_stored":1856080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":62849024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.35999999999999999,"15min":0.34999999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":1.143},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.44500000000000001,"5min":0.39700000000000002,"15min":0.39000000000000001},"max":{"1min":0.84699999999999998,"5min":0.93200000000000005,"15min":1.0349999999999999},"last":0.58199999999999996}]},{"osd":1,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.58499999999999996,"5min":0.48499999999999999,"15min":0.40600000000000003},"max":{"1min":1.0289999999999999,"5min":1.089,"15min":1.089},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.879,"5min":0.94399999999999995,"15min":1.02},"last":0.55400000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.871,"5min":0.95899999999999996,"15min":1.018},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.42299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98899999999999999,"15min":1.0660000000000001},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.77100000000000002},"min":{"1min":0.55100000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97499999999999998,"5min":0.98099999999999998,"15min":1.0980000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.86899999999999999,"5min":0.96599999999999997,"15min":1.026},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.89700000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60999999999999999,"15min":0.60399999999999998},"min":{"1min":0.42999999999999999,"5min":0.40300000000000002,"15min":0.34699999999999998},"max":{"1min":0.89900000000000002,"5min":0.91000000000000003,"15min":1.0940000000000001},"last":0.753}]},{"osd":5,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.99399999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68600000000000005,"15min":0.67100000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.0429999999999999},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68200000000000005,"15min":0.67500000000000004},"min":{"1min":0.56799999999999995,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.97399999999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.46600000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85199999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.53400000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542612,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37548,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334292,"statfs":{"total":96636764160,"available":96598315008,"internally_reserved":0,"allocated":2461696,"data_stored":1265712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.55000000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93700000000000006,"5min":1.022,"15min":1.024},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.56699999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.0780000000000001},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71999999999999997,"15min":0.73199999999999998},"min":{"1min":0.47999999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.89000000000000001,"5min":0.96999999999999997,"15min":1.006},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.754,"15min":0.74299999999999999},"min":{"1min":0.495,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95999999999999996,"5min":1.046,"15min":1.046},"last":0.63400000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.76900000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90500000000000003,"5min":0.97399999999999998,"15min":1.038},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.80200000000000005},"min":{"1min":0.59499999999999997,"5min":0.438,"15min":0.438},"max":{"1min":0.89100000000000001,"5min":0.98799999999999999,"15min":1.0600000000000001},"last":0.58799999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.749,"15min":0.747},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0029999999999999,"5min":1.089,"15min":1.089},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88700000000000001,"5min":0.96199999999999997,"15min":0.96999999999999997},"last":0.52600000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.39500000000000002,"5min":0.378,"15min":0.36099999999999999},"max":{"1min":0.72199999999999998,"5min":0.88400000000000001,"15min":0.92300000000000004},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.622,"15min":0.60899999999999999},"min":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":0.93799999999999994,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.42299999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42299999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.622}]},{"osd":7,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.38700000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66300000000000003,"15min":0.66700000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.432},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.96299999999999997},"last":0.65000000000000002}]}]},{"osd":5,"up_from":15,"seq":64424509905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55596,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316244,"statfs":{"total":96636764160,"available":96579833856,"internally_reserved":0,"allocated":2461696,"data_stored":1265712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.69299999999999995,"15min":0.70199999999999996},"min":{"1min":0.503,"5min":0.46200000000000002,"15min":0.32100000000000001},"max":{"1min":0.90700000000000003,"5min":1.044,"15min":1.044},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.75600000000000001,"15min":0.73599999999999999},"min":{"1min":0.49199999999999999,"5min":0.432,"15min":0.41499999999999998},"max":{"1min":3.2280000000000002,"5min":3.2280000000000002,"15min":3.2280000000000002},"last":0.77300000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.75,"15min":0.73899999999999999},"min":{"1min":0.51300000000000001,"5min":0.439,"15min":0.42399999999999999},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.505,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86299999999999999,"5min":1.038,"15min":1.054},"last":0.82499999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.77100000000000002,"15min":0.75800000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.3159999999999998,"5min":3.3159999999999998,"15min":3.3159999999999998},"last":0.87},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.747,"15min":0.74299999999999999},"min":{"1min":0.56999999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.81799999999999995,"15min":0.79300000000000004},"min":{"1min":0.58899999999999997,"5min":0.55900000000000005,"15min":0.47299999999999998},"max":{"1min":3.3540000000000001,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.65300000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.90900000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57699999999999996,"15min":0.55900000000000005},"min":{"1min":0.443,"5min":0.373,"15min":0.34599999999999997},"max":{"1min":0.86499999999999999,"5min":0.86899999999999999,"15min":0.91300000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.71299999999999997,"15min":0.69099999999999995},"min":{"1min":0.496,"5min":0.47399999999999998,"15min":0.46700000000000003},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.60899999999999999,"15min":0.59299999999999997},"min":{"1min":0.46600000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.61299999999999999,"15min":0.60199999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.39400000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.55100000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.67000000000000004,"15min":0.65000000000000002},"min":{"1min":0.46400000000000002,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":3.3889999999999998,"5min":3.3889999999999998,"15min":3.3889999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.754,"15min":0.72499999999999998},"min":{"1min":0.54800000000000004,"5min":0.496,"15min":0.45900000000000002},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.71799999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37548,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334292,"statfs":{"total":96636764160,"available":96598315008,"internally_reserved":0,"allocated":2461696,"data_stored":1265712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.34599999999999997},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.76900000000000002},"min":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.35299999999999998},"max":{"1min":1.3500000000000001,"5min":1.488,"15min":1.488},"last":0.91200000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.52700000000000002,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":2.7320000000000002,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.88600000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.80300000000000005,"15min":0.78800000000000003},"min":{"1min":0.62,"5min":0.60699999999999998,"15min":0.46899999999999997},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.878,"5min":0.79800000000000004,"15min":0.78600000000000003},"min":{"1min":0.623,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":0.98799999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.78800000000000003,"15min":0.75600000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.0169999999999999,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82299999999999995,"15min":0.81599999999999995},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.95699999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73299999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.627},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.44500000000000001,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.151},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.57899999999999996,"5min":0.45800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94999999999999996,"5min":0.96299999999999997,"15min":1.252},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.44400000000000001,"15min":0.437},"max":{"1min":1.006,"5min":1.006,"15min":1.0609999999999999},"last":0.81599999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68300000000000005,"15min":0.66000000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.39500000000000002},"max":{"1min":1.0189999999999999,"5min":1.526,"15min":1.526},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.53600000000000003,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.99099999999999999,"5min":1.0820000000000001,"15min":1.206},"last":0.67800000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509906,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37548,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334292,"statfs":{"total":96636764160,"available":96598315008,"internally_reserved":0,"allocated":2461696,"data_stored":1265712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.503,"15min":0.496},"min":{"1min":0.29899999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.57899999999999996,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54900000000000004,"15min":0.55300000000000005},"min":{"1min":0.39400000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.65100000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.435}]},{"osd":1,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48599999999999999,"15min":0.48199999999999998},"min":{"1min":0.35299999999999998,"5min":0.317,"15min":0.312},"max":{"1min":0.72999999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55400000000000005,"15min":0.55500000000000005},"min":{"1min":0.36699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.79700000000000004,"5min":0.81799999999999995,"15min":0.88100000000000001},"last":0.497}]},{"osd":2,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.80000000000000004,"5min":0.83199999999999996,"15min":0.84699999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61099999999999999,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.36899999999999999,"15min":0.36299999999999999},"max":{"1min":0.78600000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77600000000000002,"15min":0.77900000000000003},"min":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.441},"max":{"1min":1.046,"5min":1.101,"15min":1.244},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.84099999999999997,"15min":0.84399999999999997},"min":{"1min":0.58099999999999996,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.57099999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.59499999999999997,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.006,"5min":1.087,"15min":1.2230000000000001},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81200000000000006,"15min":0.80600000000000005},"min":{"1min":0.58799999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0820000000000001,"5min":1.127,"15min":1.147},"last":0.747},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78500000000000003,"15min":0.78600000000000003},"min":{"1min":0.56799999999999995,"5min":0.55100000000000005,"15min":0.53000000000000003},"max":{"1min":1.296,"5min":1.296,"15min":1.3660000000000001},"last":0.59399999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:57:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83299999999999996,"15min":0.82999999999999996},"min":{"1min":0.624,"5min":0.55000000000000004,"15min":0.50900000000000001},"max":{"1min":1.175,"5min":1.175,"15min":1.4510000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82799999999999996,"15min":0.84299999999999997},"min":{"1min":0.61499999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.427},"last":0.65500000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509908,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55596,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316244,"statfs":{"total":96636764160,"available":96579833856,"internally_reserved":0,"allocated":2461696,"data_stored":1265712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.32000000000000001,"15min":0.30399999999999999},"max":{"1min":1.2070000000000001,"5min":1.296,"15min":1.296},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.141,"5min":1.52,"15min":1.52},"last":0.38600000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58399999999999996,"15min":0.57599999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3009999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61799999999999999,"15min":0.60999999999999999},"min":{"1min":0.42199999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.383,"5min":1.573,"15min":1.573},"last":0.5}]},{"osd":3,"last update":"Fri Jul 21 22:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.371,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60399999999999998,"15min":0.59299999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40000000000000002},"max":{"1min":1.03,"5min":1.325,"15min":1.325},"last":0.44}]},{"osd":4,"last update":"Fri Jul 21 22:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.81299999999999994,"15min":0.82299999999999995},"min":{"1min":0.52200000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0049999999999999,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80700000000000005,"15min":0.82499999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79200000000000004,"15min":0.81399999999999995},"min":{"1min":0.51700000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1020000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.81399999999999995,"15min":0.82999999999999996},"min":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.93799999999999994,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.87}]},{"osd":6,"last update":"Fri Jul 21 22:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.55800000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.55600000000000005},"max":{"1min":1.163,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.73499999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.82999999999999996,"15min":0.84299999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0509999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.75},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81399999999999995,"15min":0.84199999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.93799999999999994}]}]},{"osd":1,"up_from":15,"seq":64424509906,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37548,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334292,"statfs":{"total":96636764160,"available":96598315008,"internally_reserved":0,"allocated":2461696,"data_stored":1265712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.255,"5min":0.251,"15min":0.251},"max":{"1min":0.77500000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.69399999999999995,"5min":1.149,"15min":1.149},"last":0.42799999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.496,"15min":0.52100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66900000000000004,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":1.21,"15min":1.21},"last":0.47699999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59399999999999997,"15min":0.60899999999999999},"min":{"1min":0.42499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77100000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.505,"15min":0.52000000000000002},"min":{"1min":0.34100000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76600000000000001,"15min":0.79600000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.46500000000000002},"max":{"1min":1.046,"5min":1.222,"15min":1.3819999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.62,"5min":0.58699999999999997,"15min":0.53400000000000003},"max":{"1min":1.2150000000000001,"5min":1.2849999999999999,"15min":1.302},"last":0.93300000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.78200000000000003,"15min":0.80400000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0189999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77900000000000003,"15min":0.80600000000000005},"min":{"1min":0.53900000000000003,"5min":0.52800000000000002,"15min":0.48799999999999999},"max":{"1min":1.107,"5min":1.171,"15min":1.3100000000000001},"last":0.72699999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.81399999999999995,"15min":0.82399999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.149,"5min":1.3300000000000001,"15min":1.3500000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77200000000000002,"15min":0.80700000000000005},"min":{"1min":0.55800000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.169,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.92500000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78400000000000003,"15min":0.82399999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0700000000000001,"5min":1.2569999999999999,"15min":1.4930000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.55000000000000004},"max":{"1min":1.1899999999999999,"5min":1.292,"15min":1.4430000000000001},"last":0.871}]}]},{"osd":0,"up_from":15,"seq":64424509908,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38128,"kb_used_data":2984,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333712,"statfs":{"total":96636764160,"available":96597721088,"internally_reserved":0,"allocated":3055616,"data_stored":1856080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.498,"15min":0.48799999999999999},"min":{"1min":0.317,"5min":0.29999999999999999,"15min":0.28499999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.316},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54300000000000004,"15min":0.54000000000000004},"min":{"1min":0.40000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.51800000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.36499999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33900000000000002},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.36499999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.627,"15min":0.622},"min":{"1min":0.41099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.59299999999999997,"15min":0.58099999999999996},"min":{"1min":0.39400000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.629,"5min":0.51200000000000001,"15min":0.51000000000000001},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.4370000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.82999999999999996,"15min":0.82699999999999996},"min":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.91000000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.83199999999999996,"15min":0.82199999999999995},"min":{"1min":0.63500000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2130000000000001,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.87,"15min":0.84899999999999998},"min":{"1min":0.628,"5min":0.497,"15min":0.497},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.351},"last":0.98699999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.58499999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.627,"5min":0.60699999999999998,"15min":0.60299999999999998},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.877}]},{"osd":7,"last update":"Fri Jul 21 22:57:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.83499999999999996,"15min":0.83199999999999996},"min":{"1min":0.57299999999999995,"5min":0.55500000000000005,"15min":0.54100000000000004},"max":{"1min":1.1699999999999999,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.877,"15min":0.873},"min":{"1min":0.64900000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.411},"last":0.92200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:58:03.280 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-07-21T22:18:31.102436+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=18, tm_sec=31, tm_wday=4, tm_yday=202, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=57, tm_sec=57, tm_wday=4, tm_yday=202, tm_isdst=0) 2023-07-21T22:58:03.281 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-07-21T22:18:37.256848+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=18, tm_sec=37, tm_wday=4, tm_yday=202, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=57, tm_sec=57, tm_wday=4, tm_yday=202, tm_isdst=0) 2023-07-21T22:58:03.281 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-07-21T22:18:37.256848+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=18, tm_sec=37, tm_wday=4, tm_yday=202, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=57, tm_sec=57, tm_wday=4, tm_yday=202, tm_isdst=0) 2023-07-21T22:58:03.281 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-07-21T22:18:37.256848+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=18, tm_sec=37, tm_wday=4, tm_yday=202, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=57, tm_sec=57, tm_wday=4, tm_yday=202, tm_isdst=0) 2023-07-21T22:58:03.282 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-07-21T22:18:37.256848+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=18, tm_sec=37, tm_wday=4, tm_yday=202, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=57, tm_sec=57, tm_wday=4, tm_yday=202, tm_isdst=0) 2023-07-21T22:58:03.282 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-07-21T22:18:37.256848+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=18, tm_sec=37, tm_wday=4, tm_yday=202, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=57, tm_sec=57, tm_wday=4, tm_yday=202, tm_isdst=0) 2023-07-21T22:58:03.282 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-07-21T22:18:37.256848+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=18, tm_sec=37, tm_wday=4, tm_yday=202, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=57, tm_sec=57, tm_wday=4, tm_yday=202, tm_isdst=0) 2023-07-21T22:58:03.283 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-07-21T22:18:37.256848+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=18, tm_sec=37, tm_wday=4, tm_yday=202, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=21, tm_hour=22, tm_min=57, tm_sec=57, tm_wday=4, tm_yday=202, tm_isdst=0) 2023-07-21T22:58:03.283 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-21T22:58:18.827 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:58:18.831 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:58:23.284 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:58:23.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.404+0000 7f0df9574640 1 Processor -- start 2023-07-21T22:58:23.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.404+0000 7f0df9574640 1 -- start start 2023-07-21T22:58:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.408+0000 7f0df9574640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0df4070b70 0x7f0df4070f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.408+0000 7f0df9574640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0df40cb100 0x7f0df40cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.408+0000 7f0df9574640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df40cac70 con 0x7f0df406b1e0 2023-07-21T22:58:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.408+0000 7f0df9574640 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df40cba60 con 0x7f0df4070b70 2023-07-21T22:58:23.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.408+0000 7f0df9574640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df4071480 con 0x7f0df40cb100 2023-07-21T22:58:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.408+0000 7f0df2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0df4070b70 0x7f0df4070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.408+0000 7f0df2ffd640 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0df4070b70 0x7f0df4070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48240/0 (socket says 172.21.15.6:48240) 2023-07-21T22:58:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.408+0000 7f0df2ffd640 1 -- 172.21.15.6:0/2897111303 learned_addr learned my addr 172.21.15.6:0/2897111303 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:23.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.408+0000 7f0df37fe640 1 --2- 172.21.15.6:0/2897111303 >> v2:172.21.15.161:3300/0 conn(0x7f0df40cb100 0x7f0df40cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:23.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.408+0000 7f0df2ffd640 1 -- 172.21.15.6:0/2897111303 >> v2:172.21.15.161:3300/0 conn(0x7f0df40cb100 msgr2=0x7f0df40cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:23.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.408+0000 7f0df2ffd640 1 --2- 172.21.15.6:0/2897111303 >> v2:172.21.15.161:3300/0 conn(0x7f0df40cb100 0x7f0df40cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:23.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.408+0000 7f0df2ffd640 1 -- 172.21.15.6:0/2897111303 >> v1:172.21.15.161:6789/0 conn(0x7f0df406b1e0 legacy=0x7f0df40c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:23.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.408+0000 7f0df2ffd640 1 -- 172.21.15.6:0/2897111303 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df40ca060 con 0x7f0df4070b70 2023-07-21T22:58:23.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.412+0000 7f0df2ffd640 1 --2- 172.21.15.6:0/2897111303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df4070b70 0x7f0df4070f40 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f0df40c19c0 tx=0x7f0de401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb845128c9caf2ec server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:23.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.412+0000 7f0df27fc640 1 -- 172.21.15.6:0/2897111303 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de40aa430 con 0x7f0df4070b70 2023-07-21T22:58:23.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.412+0000 7f0df27fc640 1 -- 172.21.15.6:0/2897111303 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de40aa590 con 0x7f0df4070b70 2023-07-21T22:58:23.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.412+0000 7f0df27fc640 1 -- 172.21.15.6:0/2897111303 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de40aa920 con 0x7f0df4070b70 2023-07-21T22:58:23.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.412+0000 7f0df9574640 1 -- 172.21.15.6:0/2897111303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df4070b70 msgr2=0x7f0df4070f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:23.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.412+0000 7f0df9574640 1 --2- 172.21.15.6:0/2897111303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df4070b70 0x7f0df4070f40 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f0df40c19c0 tx=0x7f0de401c4d0 comp rx=0 tx=0).stop 2023-07-21T22:58:23.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.412+0000 7f0df9574640 1 -- 172.21.15.6:0/2897111303 shutdown_connections 2023-07-21T22:58:23.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.412+0000 7f0df9574640 1 --2- 172.21.15.6:0/2897111303 >> v2:172.21.15.161:3300/0 conn(0x7f0df40cb100 0x7f0df40cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:23.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.412+0000 7f0df9574640 1 --2- 172.21.15.6:0/2897111303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df4070b70 0x7f0df4070f40 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:23.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.412+0000 7f0df9574640 1 -- 172.21.15.6:0/2897111303 >> 172.21.15.6:0/2897111303 conn(0x7f0df40afcf0 msgr2=0x7f0df40b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:23.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.412+0000 7f0df9574640 1 -- 172.21.15.6:0/2897111303 shutdown_connections 2023-07-21T22:58:23.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.412+0000 7f0df9574640 1 -- 172.21.15.6:0/2897111303 wait complete. 2023-07-21T22:58:23.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.412+0000 7f0df9574640 1 Processor -- start 2023-07-21T22:58:23.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.412+0000 7f0df9574640 1 -- start start 2023-07-21T22:58:23.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.412+0000 7f0df9574640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0df406b1e0 0x7f0df4148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:23.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.412+0000 7f0df9574640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0df4070b70 0x7f0df414d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:23.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.412+0000 7f0df9574640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df40cb100 0x7f0df4151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:23.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.412+0000 7f0df9574640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df41489a0 con 0x7f0df40cb100 2023-07-21T22:58:23.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.412+0000 7f0df9574640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df4155ca0 con 0x7f0df4070b70 2023-07-21T22:58:23.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.412+0000 7f0df9574640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df414df10 con 0x7f0df406b1e0 2023-07-21T22:58:23.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.416+0000 7f0df37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df40cb100 0x7f0df4151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:23.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.416+0000 7f0df37fe640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df40cb100 0x7f0df4151660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48248/0 (socket says 172.21.15.6:48248) 2023-07-21T22:58:23.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.416+0000 7f0df37fe640 1 -- 172.21.15.6:0/109462647 learned_addr learned my addr 172.21.15.6:0/109462647 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:23.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.416+0000 7f0debfff640 1 --2- 172.21.15.6:0/109462647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0df4070b70 0x7f0df414d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:23.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.416+0000 7f0df2ffd640 1 --2- 172.21.15.6:0/109462647 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0df406b1e0 0x7f0df4148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:23.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.416+0000 7f0df37fe640 1 -- 172.21.15.6:0/109462647 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0df406b1e0 msgr2=0x7f0df4148460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:23.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.416+0000 7f0df37fe640 1 --2- 172.21.15.6:0/109462647 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0df406b1e0 0x7f0df4148460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:23.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.416+0000 7f0df37fe640 1 -- 172.21.15.6:0/109462647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0df4070b70 msgr2=0x7f0df414d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:23.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.416+0000 7f0df37fe640 1 --2- 172.21.15.6:0/109462647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0df4070b70 0x7f0df414d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:23.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.416+0000 7f0df37fe640 1 -- 172.21.15.6:0/109462647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de40094d0 con 0x7f0df40cb100 2023-07-21T22:58:23.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.416+0000 7f0df37fe640 1 --2- 172.21.15.6:0/109462647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df40cb100 0x7f0df4151660 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f0dec007e90 tx=0x7f0dec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:23.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.416+0000 7f0deb7fe640 1 -- 172.21.15.6:0/109462647 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec014420 con 0x7f0df40cb100 2023-07-21T22:58:23.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.416+0000 7f0deb7fe640 1 -- 172.21.15.6:0/109462647 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec014580 con 0x7f0df40cb100 2023-07-21T22:58:23.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.416+0000 7f0deb7fe640 1 -- 172.21.15.6:0/109462647 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec014930 con 0x7f0df40cb100 2023-07-21T22:58:23.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.416+0000 7f0df9574640 1 -- 172.21.15.6:0/109462647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df4151ba0 con 0x7f0df40cb100 2023-07-21T22:58:23.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.416+0000 7f0df9574640 1 -- 172.21.15.6:0/109462647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df414e440 con 0x7f0df40cb100 2023-07-21T22:58:23.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.416+0000 7f0df9574640 1 -- 172.21.15.6:0/109462647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df4155e30 con 0x7f0df40cb100 2023-07-21T22:58:23.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.416+0000 7f0deb7fe640 1 -- 172.21.15.6:0/109462647 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0dec014a90 con 0x7f0df40cb100 2023-07-21T22:58:23.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.420+0000 7f0deb7fe640 1 --2- 172.21.15.6:0/109462647 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f0dd40663a0 0x7f0dd4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:23.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.420+0000 7f0deb7fe640 1 -- 172.21.15.6:0/109462647 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f0dec084870 con 0x7f0df40cb100 2023-07-21T22:58:23.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.420+0000 7f0df2ffd640 1 --2- 172.21.15.6:0/109462647 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f0dd40663a0 0x7f0dd4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:23.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.420+0000 7f0df2ffd640 1 --2- 172.21.15.6:0/109462647 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f0dd40663a0 0x7f0dd4068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0de40ae000 tx=0x7f0de40a7000 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:23.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.424+0000 7f0deb7fe640 1 -- 172.21.15.6:0/109462647 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0dec0555a0 con 0x7f0df40cb100 2023-07-21T22:58:23.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.572+0000 7f0df9574640 1 -- 172.21.15.6:0/109462647 --> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0df406f5b0 con 0x7f0dd40663a0 2023-07-21T22:58:23.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.576+0000 7f0deb7fe640 1 -- 172.21.15.6:0/109462647 <== mgr.10231 v2:172.21.15.161:6832/1416042622 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72648 (secure 0 0 0) 0x7f0de40aa960 con 0x7f0dd40663a0 2023-07-21T22:58:23.614 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:58:23.614 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-21T22:58:23.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.580+0000 7f0df9574640 1 -- 172.21.15.6:0/109462647 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f0dd40663a0 msgr2=0x7f0dd4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:23.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.580+0000 7f0df9574640 1 --2- 172.21.15.6:0/109462647 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f0dd40663a0 0x7f0dd4068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0de40ae000 tx=0x7f0de40a7000 comp rx=0 tx=0).stop 2023-07-21T22:58:23.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.580+0000 7f0df9574640 1 -- 172.21.15.6:0/109462647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df40cb100 msgr2=0x7f0df4151660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:23.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.580+0000 7f0df9574640 1 --2- 172.21.15.6:0/109462647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df40cb100 0x7f0df4151660 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f0dec007e90 tx=0x7f0dec00e4b0 comp rx=0 tx=0).stop 2023-07-21T22:58:23.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.580+0000 7f0df9574640 1 -- 172.21.15.6:0/109462647 shutdown_connections 2023-07-21T22:58:23.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.580+0000 7f0df9574640 1 --2- 172.21.15.6:0/109462647 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f0dd40663a0 0x7f0dd4068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:23.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.580+0000 7f0df9574640 1 --2- 172.21.15.6:0/109462647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df40cb100 0x7f0df4151660 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:23.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.580+0000 7f0df9574640 1 --2- 172.21.15.6:0/109462647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0df4070b70 0x7f0df414d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:23.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.580+0000 7f0df9574640 1 --2- 172.21.15.6:0/109462647 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0df406b1e0 0x7f0df4148460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:23.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.580+0000 7f0df9574640 1 -- 172.21.15.6:0/109462647 >> 172.21.15.6:0/109462647 conn(0x7f0df40afcf0 msgr2=0x7f0df40ce740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:23.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.580+0000 7f0df9574640 1 -- 172.21.15.6:0/109462647 shutdown_connections 2023-07-21T22:58:23.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.580+0000 7f0df9574640 1 -- 172.21.15.6:0/109462647 wait complete. 2023-07-21T22:58:23.634 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-07-21T22:58:22.859325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":363880,"kb_used_data":20392,"kb_used_omap":0,"kb_used_meta":343424,"kb_avail":754610840,"statfs":{"total":773094113280,"available":772721500160,"internally_reserved":0,"allocated":20881408,"data_stored":11306432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":351666176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002641"},"pg_stats":[{"pgid":"1.0","version":"197'349","reported_seq":1313,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-07-21T22:58:02.952713+0000","last_change":"2023-07-21T22:58:02.952777+0000","last_active":"2023-07-21T22:58:02.952713+0000","last_peered":"2023-07-21T22:58:02.952713+0000","last_clean":"2023-07-21T22:58:02.952713+0000","last_became_active":"2023-07-21T22:18:32.308899+0000","last_became_peered":"2023-07-21T22:18:32.308899+0000","last_unstale":"2023-07-21T22:58:02.952713+0000","last_undegraded":"2023-07-21T22:58:02.952713+0000","last_fullsized":"2023-07-21T22:58:02.952713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"197'349","last_scrub_stamp":"2023-07-21T22:58:02.952612+0000","last_deep_scrub":"197'349","last_deep_scrub_stamp":"2023-07-21T22:58:02.952612+0000","last_clean_scrub_stamp":"2023-07-21T22:58:02.952612+0000","objects_scrubbed":2,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:58:29.461630+0000","scrub_duration":0.0067735800000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":377,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-07-21T22:58:02.138664+0000","last_change":"2023-07-21T22:58:02.138664+0000","last_active":"2023-07-21T22:58:02.138664+0000","last_peered":"2023-07-21T22:58:02.138664+0000","last_clean":"2023-07-21T22:58:02.138664+0000","last_became_active":"2023-07-21T22:18:38.279173+0000","last_became_peered":"2023-07-21T22:18:38.279173+0000","last_unstale":"2023-07-21T22:58:02.138664+0000","last_undegraded":"2023-07-21T22:58:02.138664+0000","last_fullsized":"2023-07-21T22:58:02.138664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:58:02.138470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:58:02.138470+0000","last_clean_scrub_stamp":"2023-07-21T22:58:02.138470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:56:22.056290+0000","scrub_duration":0.0034182230000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":337,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-07-21T22:58:05.915404+0000","last_change":"2023-07-21T22:58:05.915450+0000","last_active":"2023-07-21T22:58:05.915404+0000","last_peered":"2023-07-21T22:58:05.915404+0000","last_clean":"2023-07-21T22:58:05.915404+0000","last_became_active":"2023-07-21T22:18:38.281045+0000","last_became_peered":"2023-07-21T22:18:38.281045+0000","last_unstale":"2023-07-21T22:58:05.915404+0000","last_undegraded":"2023-07-21T22:58:05.915404+0000","last_fullsized":"2023-07-21T22:58:05.915404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:58:05.915288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:58:05.915288+0000","last_clean_scrub_stamp":"2023-07-21T22:58:05.915288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:56:02.676805+0000","scrub_duration":0.0034980150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":341,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-07-21T22:58:00.775752+0000","last_change":"2023-07-21T22:58:00.775752+0000","last_active":"2023-07-21T22:58:00.775752+0000","last_peered":"2023-07-21T22:58:00.775752+0000","last_clean":"2023-07-21T22:58:00.775752+0000","last_became_active":"2023-07-21T22:18:38.474134+0000","last_became_peered":"2023-07-21T22:18:38.474134+0000","last_unstale":"2023-07-21T22:58:00.775752+0000","last_undegraded":"2023-07-21T22:58:00.775752+0000","last_fullsized":"2023-07-21T22:58:00.775752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:58:00.775639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:58:00.775639+0000","last_clean_scrub_stamp":"2023-07-21T22:58:00.775639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:24:19.116277+0000","scrub_duration":0.0029924230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":377,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-07-21T22:58:04.190558+0000","last_change":"2023-07-21T22:58:04.190558+0000","last_active":"2023-07-21T22:58:04.190558+0000","last_peered":"2023-07-21T22:58:04.190558+0000","last_clean":"2023-07-21T22:58:04.190558+0000","last_became_active":"2023-07-21T22:18:38.279125+0000","last_became_peered":"2023-07-21T22:18:38.279125+0000","last_unstale":"2023-07-21T22:58:04.190558+0000","last_undegraded":"2023-07-21T22:58:04.190558+0000","last_fullsized":"2023-07-21T22:58:04.190558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:58:04.190397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:58:04.190397+0000","last_clean_scrub_stamp":"2023-07-21T22:58:04.190397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:33:45.714265+0000","scrub_duration":0.0039674289999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":355,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-07-21T22:58:00.598374+0000","last_change":"2023-07-21T22:58:00.598374+0000","last_active":"2023-07-21T22:58:00.598374+0000","last_peered":"2023-07-21T22:58:00.598374+0000","last_clean":"2023-07-21T22:58:00.598374+0000","last_became_active":"2023-07-21T22:18:38.617789+0000","last_became_peered":"2023-07-21T22:18:38.617789+0000","last_unstale":"2023-07-21T22:58:00.598374+0000","last_undegraded":"2023-07-21T22:58:00.598374+0000","last_fullsized":"2023-07-21T22:58:00.598374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:58:00.598259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:58:00.598259+0000","last_clean_scrub_stamp":"2023-07-21T22:58:00.598259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:51:10.072954+0000","scrub_duration":0.0029684500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":336,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-07-21T22:58:09.905408+0000","last_change":"2023-07-21T22:58:09.905460+0000","last_active":"2023-07-21T22:58:09.905408+0000","last_peered":"2023-07-21T22:58:09.905408+0000","last_clean":"2023-07-21T22:58:09.905408+0000","last_became_active":"2023-07-21T22:18:38.619203+0000","last_became_peered":"2023-07-21T22:18:38.619203+0000","last_unstale":"2023-07-21T22:58:09.905408+0000","last_undegraded":"2023-07-21T22:58:09.905408+0000","last_fullsized":"2023-07-21T22:58:09.905408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:58:09.905303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:58:09.905303+0000","last_clean_scrub_stamp":"2023-07-21T22:58:09.905303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:02:43.760654+0000","scrub_duration":0.0042883629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":354,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-07-21T22:58:01.644283+0000","last_change":"2023-07-21T22:58:01.644344+0000","last_active":"2023-07-21T22:58:01.644283+0000","last_peered":"2023-07-21T22:58:01.644283+0000","last_clean":"2023-07-21T22:58:01.644283+0000","last_became_active":"2023-07-21T22:18:38.279573+0000","last_became_peered":"2023-07-21T22:18:38.279573+0000","last_unstale":"2023-07-21T22:58:01.644283+0000","last_undegraded":"2023-07-21T22:58:01.644283+0000","last_fullsized":"2023-07-21T22:58:01.644283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:58:01.644206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:58:01.644206+0000","last_clean_scrub_stamp":"2023-07-21T22:58:01.644206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:46:36.694969+0000","scrub_duration":0.003562595,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":334,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-07-21T22:58:03.575428+0000","last_change":"2023-07-21T22:58:03.575516+0000","last_active":"2023-07-21T22:58:03.575428+0000","last_peered":"2023-07-21T22:58:03.575428+0000","last_clean":"2023-07-21T22:58:03.575428+0000","last_became_active":"2023-07-21T22:18:38.283598+0000","last_became_peered":"2023-07-21T22:18:38.283598+0000","last_unstale":"2023-07-21T22:58:03.575428+0000","last_undegraded":"2023-07-21T22:58:03.575428+0000","last_fullsized":"2023-07-21T22:58:03.575428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:58:03.575293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:58:03.575293+0000","last_clean_scrub_stamp":"2023-07-21T22:58:03.575293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:20.429440+0000","scrub_duration":0.0036536519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509910,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64368,"kb_used_data":2984,"kb_used_omap":0,"kb_used_meta":61376,"kb_avail":94307472,"statfs":{"total":96636764160,"available":96570851328,"internally_reserved":0,"allocated":3055616,"data_stored":1856080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":62849024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73399999999999999,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.35999999999999999,"15min":0.34999999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":1.143},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.69799999999999995,"15min":0.70899999999999996},"min":{"1min":0.44500000000000001,"5min":0.39700000000000002,"15min":0.39000000000000001},"max":{"1min":0.84699999999999998,"5min":0.93200000000000005,"15min":1.0349999999999999},"last":0.86199999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.754,"15min":0.76000000000000001},"min":{"1min":0.58499999999999996,"5min":0.48499999999999999,"15min":0.40600000000000003},"max":{"1min":1.0289999999999999,"5min":1.089,"15min":1.089},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.70699999999999996,"15min":0.73499999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.879,"5min":0.94399999999999995,"15min":1.02},"last":0.92100000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.871,"5min":0.95899999999999996,"15min":1.018},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.55700000000000005,"5min":0.53000000000000003,"15min":0.42299999999999999},"max":{"1min":0.98499999999999999,"5min":0.98899999999999999,"15min":1.0660000000000001},"last":0.93600000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.754,"15min":0.77100000000000002},"min":{"1min":0.55100000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.97499999999999998,"5min":0.98099999999999998,"15min":1.0980000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.86899999999999999,"5min":0.96599999999999997,"15min":1.026},"last":0.82999999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.89700000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60999999999999999,"15min":0.60399999999999998},"min":{"1min":0.42999999999999999,"5min":0.40300000000000002,"15min":0.34699999999999998},"max":{"1min":0.89900000000000002,"5min":0.91000000000000003,"15min":1.0940000000000001},"last":0.61499999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.61299999999999999,"15min":0.60899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.99399999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68600000000000005,"15min":0.67100000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":1.0429999999999999},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:57:43 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68200000000000005,"15min":0.67500000000000004},"min":{"1min":0.56799999999999995,"5min":0.46300000000000002,"15min":0.45500000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.97399999999999998},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.46600000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85199999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.65200000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542616,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37548,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334292,"statfs":{"total":96636764160,"available":96598315008,"internally_reserved":0,"allocated":2461696,"data_stored":1265712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.55000000000000004,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93700000000000006,"5min":1.022,"15min":1.024},"last":0.748},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.80100000000000005},"min":{"1min":0.56699999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.0780000000000001},"last":0.78100000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71999999999999997,"15min":0.73199999999999998},"min":{"1min":0.47999999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.89000000000000001,"5min":0.96999999999999997,"15min":1.006},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.754,"15min":0.74299999999999999},"min":{"1min":0.495,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95999999999999996,"5min":1.046,"15min":1.046},"last":0.72799999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.74299999999999999,"15min":0.76900000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.90500000000000003,"5min":0.97399999999999998,"15min":1.038},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78900000000000003,"15min":0.80200000000000005},"min":{"1min":0.59499999999999997,"5min":0.438,"15min":0.438},"max":{"1min":0.89100000000000001,"5min":0.98799999999999999,"15min":1.0600000000000001},"last":0.83899999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.749,"15min":0.747},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0029999999999999,"5min":1.089,"15min":1.089},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88700000000000001,"5min":0.96199999999999997,"15min":0.96999999999999997},"last":0.76300000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.39500000000000002,"5min":0.378,"15min":0.36099999999999999},"max":{"1min":0.72199999999999998,"5min":0.88400000000000001,"15min":0.92300000000000004},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.622,"15min":0.60899999999999999},"min":{"1min":0.40699999999999997,"5min":0.39000000000000001,"15min":0.33500000000000002},"max":{"1min":0.93799999999999994,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60999999999999999,"15min":0.60899999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.437,"5min":0.42499999999999999,"15min":0.42299999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63600000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:57:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.38700000000000001},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66300000000000003,"15min":0.66700000000000004},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.432},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.96299999999999997},"last":0.69899999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509909,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55596,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316244,"statfs":{"total":96636764160,"available":96579833856,"internally_reserved":0,"allocated":2461696,"data_stored":1265712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.69299999999999995,"15min":0.70199999999999996},"min":{"1min":0.503,"5min":0.46200000000000002,"15min":0.32100000000000001},"max":{"1min":0.90700000000000003,"5min":1.044,"15min":1.044},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.75600000000000001,"15min":0.73599999999999999},"min":{"1min":0.49199999999999999,"5min":0.432,"15min":0.41499999999999998},"max":{"1min":3.2280000000000002,"5min":3.2280000000000002,"15min":3.2280000000000002},"last":0.63800000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.75,"15min":0.73899999999999999},"min":{"1min":0.51300000000000001,"5min":0.439,"15min":0.42399999999999999},"max":{"1min":1.748,"5min":1.748,"15min":1.748},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.505,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86299999999999999,"5min":1.038,"15min":1.054},"last":0.71599999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.77100000000000002,"15min":0.75800000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.3159999999999998,"5min":3.3159999999999998,"15min":3.3159999999999998},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.747,"15min":0.74299999999999999},"min":{"1min":0.56999999999999995,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.8380000000000001,"5min":1.8380000000000001,"15min":1.8380000000000001},"last":0.94599999999999995}]},{"osd":3,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.81799999999999995,"15min":0.79300000000000004},"min":{"1min":0.58899999999999997,"5min":0.55900000000000005,"15min":0.47299999999999998},"max":{"1min":3.3540000000000001,"5min":3.3540000000000001,"15min":3.3540000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.65300000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.80100000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57699999999999996,"15min":0.55900000000000005},"min":{"1min":0.443,"5min":0.373,"15min":0.34599999999999997},"max":{"1min":0.86499999999999999,"5min":0.86899999999999999,"15min":0.91300000000000003},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.71299999999999997,"15min":0.69099999999999995},"min":{"1min":0.496,"5min":0.47399999999999998,"15min":0.46700000000000003},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":0.88300000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.60899999999999999,"15min":0.59299999999999997},"min":{"1min":0.46600000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.61299999999999999,"15min":0.60199999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.39400000000000002},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.82099999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:57:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.67000000000000004,"15min":0.65000000000000002},"min":{"1min":0.46400000000000002,"5min":0.41999999999999998,"15min":0.39400000000000002},"max":{"1min":3.3889999999999998,"5min":3.3889999999999998,"15min":3.3889999999999998},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.754,"15min":0.72499999999999998},"min":{"1min":0.54800000000000004,"5min":0.496,"15min":0.45900000000000002},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":0.90500000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37548,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334292,"statfs":{"total":96636764160,"available":96598315008,"internally_reserved":0,"allocated":2461696,"data_stored":1265712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73199999999999998,"15min":0.748},"min":{"1min":0.46500000000000002,"5min":0.41299999999999998,"15min":0.34599999999999997},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.76900000000000002},"min":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.35299999999999998},"max":{"1min":1.3500000000000001,"5min":1.488,"15min":1.488},"last":0.748}]},{"osd":1,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.73499999999999999,"15min":0.72499999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.52700000000000002,"5min":0.45300000000000001,"15min":0.433},"max":{"1min":2.7320000000000002,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":0.71399999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.80300000000000005,"15min":0.78800000000000003},"min":{"1min":0.62,"5min":0.60699999999999998,"15min":0.46899999999999997},"max":{"1min":3.1230000000000002,"5min":3.1230000000000002,"15min":3.1230000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.878,"5min":0.79800000000000004,"15min":0.78600000000000003},"min":{"1min":0.623,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":0.77700000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.78800000000000003,"15min":0.75600000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":3.0169999999999999,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82299999999999995,"15min":0.81599999999999995},"min":{"1min":0.57399999999999995,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.76100000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.41199999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.73299999999999998,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.61599999999999999,"15min":0.59999999999999998},"min":{"1min":0.44500000000000001,"5min":0.40300000000000002,"15min":0.379},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":1.151},"last":0.45900000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.66600000000000004,"15min":0.66000000000000003},"min":{"1min":0.57899999999999996,"5min":0.45800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94999999999999996,"5min":0.96299999999999997,"15min":1.252},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.71499999999999997,"15min":0.71399999999999997},"min":{"1min":0.46400000000000002,"5min":0.44400000000000001,"15min":0.437},"max":{"1min":1.006,"5min":1.006,"15min":1.0609999999999999},"last":0.87}]},{"osd":7,"last update":"Fri Jul 21 22:57:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.68300000000000005,"15min":0.66000000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.39500000000000002},"max":{"1min":1.0189999999999999,"5min":1.526,"15min":1.526},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.53600000000000003,"5min":0.46100000000000002,"15min":0.45600000000000002},"max":{"1min":0.99099999999999999,"5min":1.0820000000000001,"15min":1.206},"last":0.58099999999999996}]}]},{"osd":3,"up_from":15,"seq":64424509910,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37548,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334292,"statfs":{"total":96636764160,"available":96598315008,"internally_reserved":0,"allocated":2461696,"data_stored":1265712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.48199999999999998,"15min":0.495},"min":{"1min":0.29699999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.63500000000000001,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.53600000000000003,"15min":0.54900000000000004},"min":{"1min":0.375,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.66100000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.45000000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48699999999999999,"15min":0.48299999999999998},"min":{"1min":0.32500000000000001,"5min":0.317,"15min":0.312},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.378},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54800000000000004,"15min":0.55500000000000005},"min":{"1min":0.29699999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.55900000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.40400000000000003,"5min":0.376,"15min":0.376},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60399999999999998,"15min":0.60699999999999998},"min":{"1min":0.41799999999999998,"5min":0.36899999999999999,"15min":0.36299999999999999},"max":{"1min":0.751,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.47999999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77300000000000002,"15min":0.78000000000000003},"min":{"1min":0.56499999999999995,"5min":0.48499999999999999,"15min":0.441},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.244},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.83199999999999996,"15min":0.84199999999999997},"min":{"1min":0.54700000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.304,"5min":1.335,"15min":1.335},"last":1.0329999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78000000000000003,"15min":0.78800000000000003},"min":{"1min":0.57499999999999996,"5min":0.437,"15min":0.437},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.78000000000000003,"15min":0.79700000000000004},"min":{"1min":0.56999999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.2230000000000001},"last":0.85499999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.61299999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98499999999999999,"5min":1.101,"15min":1.147},"last":1.008},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77200000000000002,"15min":0.78200000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0649999999999999,"5min":1.296,"15min":1.3660000000000001},"last":1.0569999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:58:04 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.81299999999999994,"15min":0.82499999999999996},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0629999999999999,"5min":1.175,"15min":1.4510000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.81799999999999995,"15min":0.83999999999999997},"min":{"1min":0.55700000000000005,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.427},"last":0.90000000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509912,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55596,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316244,"statfs":{"total":96636764160,"available":96579833856,"internally_reserved":0,"allocated":2461696,"data_stored":1265712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.53200000000000003,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.32000000000000001,"15min":0.30399999999999999},"max":{"1min":1.2070000000000001,"5min":1.296,"15min":1.296},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.141,"5min":1.52,"15min":1.52},"last":0.44400000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.58399999999999996,"15min":0.57599999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3009999999999999,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.61799999999999999,"15min":0.60999999999999999},"min":{"1min":0.42199999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.383,"5min":1.573,"15min":1.573},"last":0.5}]},{"osd":3,"last update":"Fri Jul 21 22:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.371,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60399999999999998,"15min":0.59299999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40000000000000002},"max":{"1min":1.03,"5min":1.325,"15min":1.325},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.81299999999999994,"15min":0.82299999999999995},"min":{"1min":0.52200000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0049999999999999,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.876},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.80700000000000005,"15min":0.82499999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.90000000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79200000000000004,"15min":0.81399999999999995},"min":{"1min":0.51700000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.1020000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.81399999999999995,"15min":0.82999999999999996},"min":{"1min":0.55600000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.93799999999999994,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79600000000000004,"15min":0.81699999999999995},"min":{"1min":0.55800000000000005,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.55600000000000005},"max":{"1min":1.163,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:57:56 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.82999999999999996,"15min":0.84299999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0509999999999999,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81399999999999995,"15min":0.84199999999999997},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.94399999999999995}]}]},{"osd":1,"up_from":15,"seq":64424509911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37548,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334292,"statfs":{"total":96636764160,"available":96598315008,"internally_reserved":0,"allocated":2461696,"data_stored":1265712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.48499999999999999,"15min":0.495},"min":{"1min":0.255,"5min":0.251,"15min":0.251},"max":{"1min":0.77500000000000002,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.58299999999999996,"15min":0.59299999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.69399999999999995,"5min":1.149,"15min":1.149},"last":0.67800000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.496,"15min":0.52100000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66900000000000004,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79700000000000004,"5min":1.21,"15min":1.21},"last":0.76400000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59399999999999997,"15min":0.60899999999999999},"min":{"1min":0.42499999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77100000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.505,"15min":0.52000000000000002},"min":{"1min":0.34100000000000003,"5min":0.309,"15min":0.309},"max":{"1min":0.72999999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.40699999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76600000000000001,"15min":0.79600000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.46500000000000002},"max":{"1min":1.046,"5min":1.222,"15min":1.3819999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.62,"5min":0.58699999999999997,"15min":0.53400000000000003},"max":{"1min":1.2150000000000001,"5min":1.2849999999999999,"15min":1.302},"last":0.872}]},{"osd":5,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.78200000000000003,"15min":0.80400000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0189999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77900000000000003,"15min":0.80600000000000005},"min":{"1min":0.53900000000000003,"5min":0.52800000000000002,"15min":0.48799999999999999},"max":{"1min":1.107,"5min":1.171,"15min":1.3100000000000001},"last":0.73899999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.81399999999999995,"15min":0.82399999999999995},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.149,"5min":1.3300000000000001,"15min":1.3500000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.77200000000000002,"15min":0.80700000000000005},"min":{"1min":0.55800000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.169,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78800000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:57:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78400000000000003,"15min":0.82399999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0700000000000001,"5min":1.2569999999999999,"15min":1.4930000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81399999999999995,"15min":0.83099999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.55000000000000004},"max":{"1min":1.1899999999999999,"5min":1.292,"15min":1.4430000000000001},"last":0.65600000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509912,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38128,"kb_used_data":2984,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333712,"statfs":{"total":96636764160,"available":96597721088,"internally_reserved":0,"allocated":3055616,"data_stored":1856080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.49399999999999999,"15min":0.48899999999999999},"min":{"1min":0.316,"5min":0.30099999999999999,"15min":0.29999999999999999},"max":{"1min":0.74199999999999999,"5min":1.53,"15min":1.53},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53900000000000003,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80700000000000005,"5min":1.02,"15min":1.02},"last":0.80700000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68300000000000005,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.33900000000000002},"max":{"1min":0.78100000000000003,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.78100000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.61199999999999999,"15min":0.61699999999999999},"min":{"1min":0.41899999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.71299999999999997,"5min":1.369,"15min":1.369},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.505,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.40999999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.76800000000000002,"5min":1.133,"15min":1.133},"last":0.754}]},{"osd":4,"last update":"Fri Jul 21 22:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.56899999999999995,"5min":0.51200000000000001,"15min":0.51000000000000001},"max":{"1min":1.0489999999999999,"5min":1.2669999999999999,"15min":1.4370000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81699999999999995,"15min":0.82499999999999996},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.204,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.92300000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.81599999999999995,"15min":0.82099999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.1279999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.85299999999999998,"15min":0.84899999999999998},"min":{"1min":0.58099999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.292,"5min":1.3049999999999999,"15min":1.351},"last":0.996}]},{"osd":6,"last update":"Fri Jul 21 22:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.84799999999999998,"15min":0.85599999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.169,"5min":2.056,"15min":2.056},"last":1.083},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.82399999999999995,"15min":0.83799999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0820000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.97899999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:58:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.82599999999999996,"15min":0.83299999999999996},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54100000000000004},"max":{"1min":1.2430000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.86099999999999999,"15min":0.873},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2609999999999999,"5min":1.3440000000000001,"15min":1.411},"last":1.115}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:58:23.638 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-07-21T22:58:23.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.744+0000 7f948d8de640 1 Processor -- start 2023-07-21T22:58:23.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.744+0000 7f948d8de640 1 -- start start 2023-07-21T22:58:23.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f948d8de640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f94881614d0 0x7f94881638b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:23.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f948d8de640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94880703a0 con 0x7f94880af8b0 2023-07-21T22:58:23.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f948d8de640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94880c9dc0 con 0x7f948815c2a0 2023-07-21T22:58:23.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f948d8de640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948815ce20 con 0x7f94881614d0 2023-07-21T22:58:23.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f948c8dc640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f94880af8b0 0x7f94880afc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59502/0 (socket says 172.21.15.6:59502) 2023-07-21T22:58:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f948c8dc640 1 -- 172.21.15.6:0/1334114638 learned_addr learned my addr 172.21.15.6:0/1334114638 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:58:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f948d0dd640 1 --2- 172.21.15.6:0/1334114638 >> v2:172.21.15.161:3300/0 conn(0x7f94881614d0 0x7f94881638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f94877fe640 1 -- 172.21.15.6:0/1334114638 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043169336 0 0) 0x7f947c001120 con 0x7f94880af8b0 2023-07-21T22:58:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f94877fe640 1 -- 172.21.15.6:0/1334114638 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9478003530 con 0x7f94880af8b0 2023-07-21T22:58:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f94877fe640 1 -- 172.21.15.6:0/1334114638 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 28198403 0 0) 0x7f9478003530 con 0x7f94880af8b0 2023-07-21T22:58:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f94877fe640 1 -- 172.21.15.6:0/1334114638 >> v2:172.21.15.161:3300/0 conn(0x7f94881614d0 msgr2=0x7f94881638b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f94877fe640 1 --2- 172.21.15.6:0/1334114638 >> v2:172.21.15.161:3300/0 conn(0x7f94881614d0 0x7f94881638b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f94877fe640 1 -- 172.21.15.6:0/1334114638 >> v1:172.21.15.161:6789/0 conn(0x7f948815c2a0 legacy=0x7f948815c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:23.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f94877fe640 1 -- 172.21.15.6:0/1334114638 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948815d010 con 0x7f94880af8b0 2023-07-21T22:58:23.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f94877fe640 1 -- 172.21.15.6:0/1334114638 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1998184360 0 0) 0x7f947c001810 con 0x7f94880af8b0 2023-07-21T22:58:23.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f94877fe640 1 -- 172.21.15.6:0/1334114638 >> v1:172.21.15.6:6789/0 conn(0x7f94880af8b0 legacy=0x7f94880afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:23.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f94877fe640 1 --2- 172.21.15.6:0/1334114638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9478003980 0x7f9478003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:23.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f94877fe640 1 --2- 172.21.15.6:0/1334114638 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9478004370 0x7f9478004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:23.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f94877fe640 1 --2- 172.21.15.6:0/1334114638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9478005030 0x7f947800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f94877fe640 1 -- 172.21.15.6:0/1334114638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947800e190 con 0x7f9478003980 2023-07-21T22:58:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f94877fe640 1 -- 172.21.15.6:0/1334114638 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947800e2d0 con 0x7f9478005030 2023-07-21T22:58:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f94877fe640 1 -- 172.21.15.6:0/1334114638 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947800e490 con 0x7f9478004370 2023-07-21T22:58:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f948c8dc640 1 --2- 172.21.15.6:0/1334114638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9478003980 0x7f9478003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f948d0dd640 1 --2- 172.21.15.6:0/1334114638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9478005030 0x7f947800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f9487fff640 1 --2- 172.21.15.6:0/1334114638 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9478004370 0x7f9478004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f948c8dc640 1 -- 172.21.15.6:0/1334114638 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9478004370 msgr2=0x7f9478004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:23.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f948c8dc640 1 --2- 172.21.15.6:0/1334114638 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9478004370 0x7f9478004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:23.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f948c8dc640 1 -- 172.21.15.6:0/1334114638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9478005030 msgr2=0x7f947800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:23.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f948c8dc640 1 --2- 172.21.15.6:0/1334114638 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9478005030 0x7f947800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:23.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f948c8dc640 1 -- 172.21.15.6:0/1334114638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9478003530 con 0x7f9478003980 2023-07-21T22:58:23.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.748+0000 7f948d0dd640 1 -- 172.21.15.6:0/1334114638 reap_dead start 2023-07-21T22:58:23.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.752+0000 7f948c8dc640 1 --2- 172.21.15.6:0/1334114638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9478003980 0x7f9478003d50 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f947c00c1c0 tx=0x7f947c01cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eadae281e532045 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:23.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.752+0000 7f94877fe640 1 -- 172.21.15.6:0/1334114638 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c005ae0 con 0x7f9478003980 2023-07-21T22:58:23.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.752+0000 7f94877fe640 1 -- 172.21.15.6:0/1334114638 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c005c60 con 0x7f9478003980 2023-07-21T22:58:23.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.752+0000 7f94877fe640 1 -- 172.21.15.6:0/1334114638 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c0072b0 con 0x7f9478003980 2023-07-21T22:58:23.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.752+0000 7f948d8de640 1 -- 172.21.15.6:0/1334114638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9478003980 msgr2=0x7f9478003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:23.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.752+0000 7f948d8de640 1 --2- 172.21.15.6:0/1334114638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9478003980 0x7f9478003d50 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f947c00c1c0 tx=0x7f947c01cb90 comp rx=0 tx=0).stop 2023-07-21T22:58:23.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.752+0000 7f948d8de640 1 -- 172.21.15.6:0/1334114638 shutdown_connections 2023-07-21T22:58:23.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.752+0000 7f948d8de640 1 --2- 172.21.15.6:0/1334114638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9478003980 0x7f9478003d50 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.752+0000 7f948d8de640 1 -- 172.21.15.6:0/1334114638 >> 172.21.15.6:0/1334114638 conn(0x7f94880ca8b0 msgr2=0x7f94880cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.752+0000 7f948d8de640 1 -- 172.21.15.6:0/1334114638 shutdown_connections 2023-07-21T22:58:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.752+0000 7f948d8de640 1 -- 172.21.15.6:0/1334114638 wait complete. 2023-07-21T22:58:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.752+0000 7f948d8de640 1 Processor -- start 2023-07-21T22:58:23.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.752+0000 7f948d8de640 1 -- start start 2023-07-21T22:58:23.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f948d8de640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9478003980 0x7f948806cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:23.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f948d8de640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f948814f320 0x7f948814d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:23.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f948d8de640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94880c1960 0x7f94880c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:23.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f948d8de640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948814dc10 con 0x7f9478003980 2023-07-21T22:58:23.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f948d8de640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948814ddc0 con 0x7f948814f320 2023-07-21T22:58:23.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f948d8de640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9488160e20 con 0x7f94880c1960 2023-07-21T22:58:23.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f948c8dc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9478003980 0x7f948806cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:23.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f948c8dc640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9478003980 0x7f948806cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48254/0 (socket says 172.21.15.6:48254) 2023-07-21T22:58:23.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f948c8dc640 1 -- 172.21.15.6:0/3478182364 learned_addr learned my addr 172.21.15.6:0/3478182364 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:23.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f9487fff640 1 --2- 172.21.15.6:0/3478182364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f948814f320 0x7f948814d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:23.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f948d0dd640 1 --2- 172.21.15.6:0/3478182364 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94880c1960 0x7f94880c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:23.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f948c8dc640 1 -- 172.21.15.6:0/3478182364 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94880c1960 msgr2=0x7f94880c1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:23.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f948c8dc640 1 --2- 172.21.15.6:0/3478182364 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94880c1960 0x7f94880c1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:23.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f948c8dc640 1 -- 172.21.15.6:0/3478182364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f948814f320 msgr2=0x7f948814d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:23.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f948c8dc640 1 --2- 172.21.15.6:0/3478182364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f948814f320 0x7f948814d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:23.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f948c8dc640 1 -- 172.21.15.6:0/3478182364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9488161100 con 0x7f9478003980 2023-07-21T22:58:23.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f948d0dd640 1 --2- 172.21.15.6:0/3478182364 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94880c1960 0x7f94880c1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:58:23.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f948c8dc640 1 --2- 172.21.15.6:0/3478182364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9478003980 0x7f948806cf80 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f947c00c1c0 tx=0x7f9478005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:23.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f94857fa640 1 -- 172.21.15.6:0/3478182364 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c0b4070 con 0x7f9478003980 2023-07-21T22:58:23.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f94857fa640 1 -- 172.21.15.6:0/3478182364 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c001610 con 0x7f9478003980 2023-07-21T22:58:23.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f94857fa640 1 -- 172.21.15.6:0/3478182364 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c0a5990 con 0x7f9478003980 2023-07-21T22:58:23.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f948d8de640 1 -- 172.21.15.6:0/3478182364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948814e010 con 0x7f9478003980 2023-07-21T22:58:23.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f948d8de640 1 -- 172.21.15.6:0/3478182364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94880c5c40 con 0x7f9478003980 2023-07-21T22:58:23.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.756+0000 7f948d8de640 1 -- 172.21.15.6:0/3478182364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94881612f0 con 0x7f9478003980 2023-07-21T22:58:23.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.760+0000 7f94857fa640 1 -- 172.21.15.6:0/3478182364 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f947c0a5af0 con 0x7f9478003980 2023-07-21T22:58:23.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.760+0000 7f94857fa640 1 --2- 172.21.15.6:0/3478182364 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f946c0663d0 0x7f946c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:23.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.760+0000 7f94857fa640 1 -- 172.21.15.6:0/3478182364 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7f947c11d260 con 0x7f9478003980 2023-07-21T22:58:23.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.760+0000 7f9487fff640 1 --2- 172.21.15.6:0/3478182364 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f946c0663d0 0x7f946c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:23.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.760+0000 7f9487fff640 1 --2- 172.21.15.6:0/3478182364 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f946c0663d0 0x7f946c068880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9474007f70 tx=0x7f9474007f00 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:23.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.764+0000 7f94857fa640 1 -- 172.21.15.6:0/3478182364 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f947c0ea5a0 con 0x7f9478003980 2023-07-21T22:58:23.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:23.920+0000 7f948d8de640 1 -- 172.21.15.6:0/3478182364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f94880703a0 con 0x7f9478003980 2023-07-21T22:58:24.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.112+0000 7f94857fa640 1 -- 172.21.15.6:0/3478182364 <== mon.0 v2:172.21.15.6:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f947c0ea5a0 con 0x7f9478003980 2023-07-21T22:58:24.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.112+0000 7f94857fa640 1 -- 172.21.15.6:0/3478182364 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v70)=0 v70) v1 ==== 123+0+0 (secure 0 0 0) 0x7f94880703a0 con 0x7f9478003980 2023-07-21T22:58:24.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.112+0000 7f948d8de640 1 -- 172.21.15.6:0/3478182364 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f946c0663d0 msgr2=0x7f946c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:24.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.112+0000 7f948d8de640 1 --2- 172.21.15.6:0/3478182364 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f946c0663d0 0x7f946c068880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9474007f70 tx=0x7f9474007f00 comp rx=0 tx=0).stop 2023-07-21T22:58:24.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.112+0000 7f948d8de640 1 -- 172.21.15.6:0/3478182364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9478003980 msgr2=0x7f948806cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:24.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.112+0000 7f948d8de640 1 --2- 172.21.15.6:0/3478182364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9478003980 0x7f948806cf80 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7f947c00c1c0 tx=0x7f9478005800 comp rx=0 tx=0).stop 2023-07-21T22:58:24.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.112+0000 7f948d8de640 1 -- 172.21.15.6:0/3478182364 shutdown_connections 2023-07-21T22:58:24.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.112+0000 7f948d8de640 1 --2- 172.21.15.6:0/3478182364 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7f946c0663d0 0x7f946c068880 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:24.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.112+0000 7f948d8de640 1 --2- 172.21.15.6:0/3478182364 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f94880c1960 0x7f94880c1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:24.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.112+0000 7f948d8de640 1 --2- 172.21.15.6:0/3478182364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f948814f320 0x7f948814d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:24.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.112+0000 7f948d8de640 1 --2- 172.21.15.6:0/3478182364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9478003980 0x7f948806cf80 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:24.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.112+0000 7f948d8de640 1 -- 172.21.15.6:0/3478182364 >> 172.21.15.6:0/3478182364 conn(0x7f94880ca8b0 msgr2=0x7f948815b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:24.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.112+0000 7f948d8de640 1 -- 172.21.15.6:0/3478182364 shutdown_connections 2023-07-21T22:58:24.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.112+0000 7f948d8de640 1 -- 172.21.15.6:0/3478182364 wait complete. 2023-07-21T22:58:24.169 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-21T22:58:24.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:58:24.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.276+0000 7fed71711640 1 Processor -- start 2023-07-21T22:58:24.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.276+0000 7fed71711640 1 -- start start 2023-07-21T22:58:24.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.280+0000 7fed71711640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed6c06b1e0 0x7fed6c06b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.280+0000 7fed71711640 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6c06f900 con 0x7fed6c0cb780 2023-07-21T22:58:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.280+0000 7fed71711640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6c06bb40 con 0x7fed6c15b7c0 2023-07-21T22:58:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.280+0000 7fed71711640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c0cdce0 con 0x7fed6c06b1e0 2023-07-21T22:58:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.280+0000 7fed6affd640 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fed6c0cb780 0x7fed6c0cabe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59504/0 (socket says 172.21.15.6:59504) 2023-07-21T22:58:24.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.280+0000 7fed6affd640 1 -- 172.21.15.6:0/4174536395 learned_addr learned my addr 172.21.15.6:0/4174536395 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-21T22:58:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.280+0000 7fed6b7fe640 1 --2- 172.21.15.6:0/4174536395 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed6c06b1e0 0x7fed6c06b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.280+0000 7fed6a7fc640 1 -- 172.21.15.6:0/4174536395 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261816046 0 0) 0x7fed6c06f900 con 0x7fed6c0cb780 2023-07-21T22:58:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.280+0000 7fed6a7fc640 1 -- 172.21.15.6:0/4174536395 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed58003530 con 0x7fed6c0cb780 2023-07-21T22:58:24.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.280+0000 7fed6a7fc640 1 -- 172.21.15.6:0/4174536395 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2848571108 0 0) 0x7fed6c06bb40 con 0x7fed6c15b7c0 2023-07-21T22:58:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.280+0000 7fed6a7fc640 1 -- 172.21.15.6:0/4174536395 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed6c06f900 con 0x7fed6c15b7c0 2023-07-21T22:58:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.280+0000 7fed6b7fe640 1 -- 172.21.15.6:0/4174536395 >> v1:172.21.15.161:6789/0 conn(0x7fed6c15b7c0 legacy=0x7fed6c0ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.280+0000 7fed6b7fe640 1 -- 172.21.15.6:0/4174536395 >> v1:172.21.15.6:6789/0 conn(0x7fed6c0cb780 legacy=0x7fed6c0cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:24.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.280+0000 7fed6b7fe640 1 -- 172.21.15.6:0/4174536395 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c0cd450 con 0x7fed6c06b1e0 2023-07-21T22:58:24.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.284+0000 7fed6b7fe640 1 --2- 172.21.15.6:0/4174536395 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed6c06b1e0 0x7fed6c06b600 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fed64009dc0 tx=0x7fed6401c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffeaf570b5879e4f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:24.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.284+0000 7fed6a7fc640 1 -- 172.21.15.6:0/4174536395 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed640a57f0 con 0x7fed6c06b1e0 2023-07-21T22:58:24.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.284+0000 7fed6a7fc640 1 -- 172.21.15.6:0/4174536395 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fed640a5950 con 0x7fed6c06b1e0 2023-07-21T22:58:24.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.284+0000 7fed6a7fc640 1 -- 172.21.15.6:0/4174536395 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed640a5d00 con 0x7fed6c06b1e0 2023-07-21T22:58:24.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.284+0000 7fed71711640 1 -- 172.21.15.6:0/4174536395 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed6c06b1e0 msgr2=0x7fed6c06b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:24.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.284+0000 7fed71711640 1 --2- 172.21.15.6:0/4174536395 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed6c06b1e0 0x7fed6c06b600 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fed64009dc0 tx=0x7fed6401c930 comp rx=0 tx=0).stop 2023-07-21T22:58:24.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.284+0000 7fed71711640 1 -- 172.21.15.6:0/4174536395 shutdown_connections 2023-07-21T22:58:24.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.284+0000 7fed71711640 1 --2- 172.21.15.6:0/4174536395 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed6c06b1e0 0x7fed6c06b600 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:24.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.284+0000 7fed71711640 1 -- 172.21.15.6:0/4174536395 >> 172.21.15.6:0/4174536395 conn(0x7fed6c0afcf0 msgr2=0x7fed6c0b00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:24.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.284+0000 7fed71711640 1 -- 172.21.15.6:0/4174536395 shutdown_connections 2023-07-21T22:58:24.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.284+0000 7fed71711640 1 -- 172.21.15.6:0/4174536395 wait complete. 2023-07-21T22:58:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.284+0000 7fed71711640 1 Processor -- start 2023-07-21T22:58:24.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed71711640 1 -- start start 2023-07-21T22:58:24.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed71711640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed6c06b1e0 0x7fed6c0c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:24.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed71711640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed6c15b7c0 0x7fed6c0af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:24.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed71711640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed6c151a10 0x7fed6c1552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:24.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed71711640 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c0c5fe0 con 0x7fed6c15b7c0 2023-07-21T22:58:24.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed71711640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c0c5360 con 0x7fed6c06b1e0 2023-07-21T22:58:24.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed71711640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c0c5640 con 0x7fed6c151a10 2023-07-21T22:58:24.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed63fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed6c15b7c0 0x7fed6c0af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:24.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed63fff640 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed6c15b7c0 0x7fed6c0af170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48270/0 (socket says 172.21.15.6:48270) 2023-07-21T22:58:24.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed63fff640 1 -- 172.21.15.6:0/4104561444 learned_addr learned my addr 172.21.15.6:0/4104561444 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-21T22:58:24.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed6affd640 1 --2- 172.21.15.6:0/4104561444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed6c06b1e0 0x7fed6c0c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:24.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed6b7fe640 1 --2- 172.21.15.6:0/4104561444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed6c151a10 0x7fed6c1552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:24.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed63fff640 1 -- 172.21.15.6:0/4104561444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed6c151a10 msgr2=0x7fed6c1552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:24.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed63fff640 1 --2- 172.21.15.6:0/4104561444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed6c151a10 0x7fed6c1552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:24.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed63fff640 1 -- 172.21.15.6:0/4104561444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed6c06b1e0 msgr2=0x7fed6c0c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:24.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed63fff640 1 --2- 172.21.15.6:0/4104561444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed6c06b1e0 0x7fed6c0c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:24.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed63fff640 1 -- 172.21.15.6:0/4104561444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed64009a70 con 0x7fed6c15b7c0 2023-07-21T22:58:24.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed63fff640 1 --2- 172.21.15.6:0/4104561444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed6c15b7c0 0x7fed6c0af170 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7fed5400c470 tx=0x7fed5400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:24.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed637fe640 1 -- 172.21.15.6:0/4104561444 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54005480 con 0x7fed6c15b7c0 2023-07-21T22:58:24.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed637fe640 1 -- 172.21.15.6:0/4104561444 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fed54003600 con 0x7fed6c15b7c0 2023-07-21T22:58:24.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed637fe640 1 -- 172.21.15.6:0/4104561444 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54003990 con 0x7fed6c15b7c0 2023-07-21T22:58:24.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed71711640 1 -- 172.21.15.6:0/4104561444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6c0c5920 con 0x7fed6c15b7c0 2023-07-21T22:58:24.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed71711640 1 -- 172.21.15.6:0/4104561444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6c0c2620 con 0x7fed6c15b7c0 2023-07-21T22:58:24.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.288+0000 7fed71711640 1 -- 172.21.15.6:0/4104561444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6c0c6120 con 0x7fed6c15b7c0 2023-07-21T22:58:24.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.292+0000 7fed637fe640 1 -- 172.21.15.6:0/4104561444 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fed54003af0 con 0x7fed6c15b7c0 2023-07-21T22:58:24.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.292+0000 7fed637fe640 1 --2- 172.21.15.6:0/4104561444 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fed4c0663a0 0x7fed4c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:24.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.292+0000 7fed637fe640 1 -- 172.21.15.6:0/4104561444 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6099+0+0 (secure 0 0 0) 0x7fed540834b0 con 0x7fed6c15b7c0 2023-07-21T22:58:24.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.292+0000 7fed6affd640 1 --2- 172.21.15.6:0/4104561444 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fed4c0663a0 0x7fed4c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:24.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.292+0000 7fed6affd640 1 --2- 172.21.15.6:0/4104561444 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fed4c0663a0 0x7fed4c068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0011f0 tx=0x7fed5c007d40 comp rx=0 tx=0).ready entity=mgr.10231 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:24.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.296+0000 7fed637fe640 1 -- 172.21.15.6:0/4104561444 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed6c0c6120 con 0x7fed6c15b7c0 2023-07-21T22:58:24.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.484+0000 7fed71711640 1 -- 172.21.15.6:0/4104561444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed6c0c6120 con 0x7fed6c15b7c0 2023-07-21T22:58:24.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.484+0000 7fed637fe640 1 -- 172.21.15.6:0/4104561444 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+3519 (secure 0 0 0) 0x7fed54017dd0 con 0x7fed6c15b7c0 2023-07-21T22:58:24.521 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-21T22:58:24.521 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":88,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8765,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6836/617196146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":617196146},{"type":"v1","addr":"172.21.15.161:6836","nonce":617196146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9976,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6837/618083440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6835","nonce":618083440},{"type":"v1","addr":"172.21.15.161:6837","nonce":618083440}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":10503,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/205515898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":205515898},{"type":"v1","addr":"172.21.15.6:6834","nonce":205515898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":10977,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/505133978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":505133978},{"type":"v1","addr":"172.21.15.6:6835","nonce":505133978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[]} 2023-07-21T22:58:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 88 2023-07-21T22:58:24.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.488+0000 7fed71711640 1 -- 172.21.15.6:0/4104561444 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fed4c0663a0 msgr2=0x7fed4c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.488+0000 7fed71711640 1 --2- 172.21.15.6:0/4104561444 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fed4c0663a0 0x7fed4c068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0011f0 tx=0x7fed5c007d40 comp rx=0 tx=0).stop 2023-07-21T22:58:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.488+0000 7fed71711640 1 -- 172.21.15.6:0/4104561444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed6c15b7c0 msgr2=0x7fed6c0af170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.488+0000 7fed71711640 1 --2- 172.21.15.6:0/4104561444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed6c15b7c0 0x7fed6c0af170 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7fed5400c470 tx=0x7fed5400c930 comp rx=0 tx=0).stop 2023-07-21T22:58:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.488+0000 7fed71711640 1 -- 172.21.15.6:0/4104561444 shutdown_connections 2023-07-21T22:58:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.488+0000 7fed71711640 1 --2- 172.21.15.6:0/4104561444 >> [v2:172.21.15.161:6832/1416042622,v1:172.21.15.161:6833/1416042622] conn(0x7fed4c0663a0 0x7fed4c068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.488+0000 7fed71711640 1 --2- 172.21.15.6:0/4104561444 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fed6c151a10 0x7fed6c1552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.488+0000 7fed71711640 1 --2- 172.21.15.6:0/4104561444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed6c15b7c0 0x7fed6c0af170 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.488+0000 7fed71711640 1 --2- 172.21.15.6:0/4104561444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fed6c06b1e0 0x7fed6c0c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.488+0000 7fed71711640 1 -- 172.21.15.6:0/4104561444 >> 172.21.15.6:0/4104561444 conn(0x7fed6c0afcf0 msgr2=0x7fed6c0ca9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.488+0000 7fed71711640 1 -- 172.21.15.6:0/4104561444 shutdown_connections 2023-07-21T22:58:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-21T22:58:24.488+0000 7fed71711640 1 -- 172.21.15.6:0/4104561444 wait complete. 2023-07-21T22:58:24.542 DEBUG:tasks.cephfs.filesystem:already dead... 2023-07-21T22:58:24.542 INFO:teuthology.misc:Shutting down mds daemons... 2023-07-21T22:58:24.542 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-21T22:58:24.543 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:58:24.554 INFO:tasks.ceph.mds.a:Stopped 2023-07-21T22:58:24.554 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-21T22:58:24.555 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:58:24.608 INFO:tasks.ceph.mds.c:Stopped 2023-07-21T22:58:24.609 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-21T22:58:24.609 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:58:24.623 INFO:tasks.ceph.mds.b:Stopped 2023-07-21T22:58:24.624 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-21T22:58:24.625 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:58:24.681 INFO:tasks.ceph.mds.d:Stopped 2023-07-21T22:58:24.681 INFO:teuthology.misc:Shutting down osd daemons... 2023-07-21T22:58:24.681 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-07-21T22:58:24.682 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:58:24.761 INFO:tasks.ceph.osd.0:Stopped 2023-07-21T22:58:24.761 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-07-21T22:58:24.762 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:58:30.760 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-07-21T22:58:30.864 INFO:tasks.ceph.osd.1:Stopped 2023-07-21T22:58:30.864 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-07-21T22:58:30.865 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:58:30.938 INFO:tasks.ceph.osd.2:Stopped 2023-07-21T22:58:30.939 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-07-21T22:58:30.939 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:58:36.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-07-21T22:58:36.669 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-07-21T22:58:37.040 INFO:tasks.ceph.osd.3:Stopped 2023-07-21T22:58:37.041 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-07-21T22:58:37.041 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:58:37.102 INFO:tasks.ceph.osd.4:Stopped 2023-07-21T22:58:37.103 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-07-21T22:58:37.103 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:58:42.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-07-21T22:58:42.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-07-21T22:58:43.204 INFO:tasks.ceph.osd.5:Stopped 2023-07-21T22:58:43.205 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-07-21T22:58:43.205 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:58:43.279 INFO:tasks.ceph.osd.6:Stopped 2023-07-21T22:58:43.280 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-07-21T22:58:43.281 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:58:47.879 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-07-21T22:58:47.879 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-07-21T22:58:48.902 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:58:48.906 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:58:49.382 INFO:tasks.ceph.osd.7:Stopped 2023-07-21T22:58:49.383 INFO:teuthology.misc:Shutting down mgr daemons... 2023-07-21T22:58:49.384 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-21T22:58:49.384 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:58:49.442 INFO:tasks.ceph.mgr.y:Stopped 2023-07-21T22:58:49.443 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-21T22:58:49.443 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:58:49.504 INFO:tasks.ceph.mgr.x:Stopped 2023-07-21T22:58:49.504 INFO:teuthology.misc:Shutting down mon daemons... 2023-07-21T22:58:49.505 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-07-21T22:58:49.505 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:58:49.533 INFO:tasks.ceph.mon.a:Stopped 2023-07-21T22:58:49.534 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-07-21T22:58:49.534 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:58:49.554 INFO:tasks.ceph.mon.b:Stopped 2023-07-21T22:58:49.555 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-07-21T22:58:49.556 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T22:58:49.621 INFO:tasks.ceph.mon.c:Stopped 2023-07-21T22:58:49.622 INFO:tasks.ceph:Checking cluster log for badness... 2023-07-21T22:58:49.624 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-21T22:58:49.654 INFO:teuthology.orchestra.run.smithi006.stdout:2023-07-21T22:21:04.601015+0000 mon.a (mon.0) 361 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-07-21T22:58:49.655 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-07-21T22:58:49.656 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-21T22:58:49.732 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-21T22:58:49.807 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-21T22:58:49.883 INFO:teuthology.orchestra.run.smithi006.stdout:2023-07-21T22:21:04.601015+0000 mon.a (mon.0) 361 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-07-21T22:58:49.884 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:58:49.884 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-07-21T22:58:50.359 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:58:50.360 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-07-21T22:58:50.695 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:58:50.696 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-07-21T22:58:51.068 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:58:51.068 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-07-21T22:58:51.492 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi161.front.sepia.ceph.com 2023-07-21T22:58:51.493 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-07-21T22:58:51.862 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi161.front.sepia.ceph.com 2023-07-21T22:58:51.863 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-07-21T22:58:52.239 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi161.front.sepia.ceph.com 2023-07-21T22:58:52.239 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-07-21T22:58:52.582 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi161.front.sepia.ceph.com 2023-07-21T22:58:52.583 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-07-21T22:58:52.881 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-07-21T22:58:52.934 INFO:tasks.ceph:Archiving mon data... 2023-07-21T22:58:52.936 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347723/data/mon.a.tgz 2023-07-21T22:58:52.936 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2023-07-21T22:58:52.946 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.In63t4kOvI 2023-07-21T22:58:52.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.In63t4kOvI 2023-07-21T22:58:53.413 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.In63t4kOvI 2023-07-21T22:58:53.490 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.In63t4kOvI is 2MB 2023-07-21T22:58:53.580 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.In63t4kOvI 2023-07-21T22:58:53.590 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347723/data/mon.b.tgz 2023-07-21T22:58:53.591 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2023-07-21T22:58:53.600 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.WNCBlf6ogM 2023-07-21T22:58:53.600 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.WNCBlf6ogM 2023-07-21T22:58:54.083 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.WNCBlf6ogM 2023-07-21T22:58:54.163 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.WNCBlf6ogM is 3MB 2023-07-21T22:58:54.260 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.WNCBlf6ogM 2023-07-21T22:58:54.269 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347723/data/mon.c.tgz 2023-07-21T22:58:54.270 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2023-07-21T22:58:54.323 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.5bt3AyEj3Y 2023-07-21T22:58:54.324 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.5bt3AyEj3Y 2023-07-21T22:58:54.796 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.5bt3AyEj3Y 2023-07-21T22:58:54.872 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.5bt3AyEj3Y is 3MB 2023-07-21T22:58:54.963 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.5bt3AyEj3Y 2023-07-21T22:58:54.973 INFO:tasks.ceph:Cleaning ceph cluster... 2023-07-21T22:58:54.973 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-21T22:58:54.977 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-21T22:58:55.036 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-07-21T22:58:55.036 DEBUG:teuthology.orchestra.run.smithi006:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-21T22:58:55.040 DEBUG:teuthology.orchestra.run.smithi161:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-21T22:58:55.096 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-21T22:58:55.114 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-21T22:58:55.121 INFO:tasks.ceph:Archiving crash dumps... 2023-07-21T22:58:55.122 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347723/remote/smithi006/crash 2023-07-21T22:58:55.123 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-21T22:58:55.146 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347723/remote/smithi161/crash 2023-07-21T22:58:55.147 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-21T22:58:55.187 INFO:tasks.ceph:Shutting down logrotate 2023-07-21T22:58:55.188 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:58:55.196 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-21T22:58:55.280 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-21T22:58:55.303 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-21T22:58:55.343 INFO:tasks.ceph:Compressing logs... 2023-07-21T22:58:55.344 DEBUG:teuthology.orchestra.run.smithi006:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-21T22:58:55.348 DEBUG:teuthology.orchestra.run.smithi161:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-21T22:58:55.373 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64401.log 2023-07-21T22:58:55.373 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51153.log 2023-07-21T22:58:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53735.log 2023-07-21T22:58:55.375 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64401.log.gz 2023-07-21T22:58:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51153.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51153.log.gz 2023-07-21T22:58:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53004.log 2023-07-21T22:58:55.377 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53735.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53735.log.gz 2023-07-21T22:58:55.377 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58388.log 2023-07-21T22:58:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53004.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53004.log.gz 2023-07-21T22:58:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46159.log 2023-07-21T22:58:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58388.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58388.log.gz 2023-07-21T22:58:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60486.log 2023-07-21T22:58:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46159.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46159.log.gz 2023-07-21T22:58:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57157.log 2023-07-21T22:58:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60486.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60486.log.gz 2023-07-21T22:58:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61359.log 2023-07-21T22:58:55.382 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57157.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57157.log.gz 2023-07-21T22:58:55.382 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43087.log 2023-07-21T22:58:55.383 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61359.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61359.log.gz 2023-07-21T22:58:55.384 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48296.log 2023-07-21T22:58:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43087.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43087.log.gz 2023-07-21T22:58:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55724.log 2023-07-21T22:58:55.385 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48296.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.48296.log.gz --verbose 2023-07-21T22:58:55.386 INFO:teuthology.orchestra.run.smithi006.stderr: -- /var/log/ceph/ceph-client.admin.46822.log 2023-07-21T22:58:55.386 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55724.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55724.log.gz 2023-07-21T22:58:55.387 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50312.log 2023-07-21T22:58:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46822.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46822.log.gz 2023-07-21T22:58:55.388 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62638.log 2023-07-21T22:58:55.389 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50312.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50312.log.gz 2023-07-21T22:58:55.389 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61150.log 2023-07-21T22:58:55.390 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66333.log 2023-07-21T22:58:55.390 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62638.log.gz 2023-07-21T22:58:55.391 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61150.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61150.log.gz 2023-07-21T22:58:55.391 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62075.log 2023-07-21T22:58:55.391 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66333.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66333.log.gz -5 2023-07-21T22:58:55.392 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46294.log 2023-07-21T22:58:55.393 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60835.log 2023-07-21T22:58:55.393 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62075.log.gz 2023-07-21T22:58:55.394 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56928.log 2023-07-21T22:58:55.395 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46294.log.gz 2023-07-21T22:58:55.396 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60835.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60835.log.gz 2023-07-21T22:58:55.397 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64217.log 2023-07-21T22:58:55.397 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56928.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56928.log.gz 2023-07-21T22:58:55.398 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45865.log 2023-07-21T22:58:55.399 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64217.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64217.log.gz 2023-07-21T22:58:55.399 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60144.log 2023-07-21T22:58:55.399 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45865.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45865.log.gz 2023-07-21T22:58:55.400 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58520.log 2023-07-21T22:58:55.401 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60144.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60144.log.gz 2023-07-21T22:58:55.402 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53852.log 2023-07-21T22:58:55.402 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58520.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58520.log.gz 2023-07-21T22:58:55.402 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47260.log 2023-07-21T22:58:55.402 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61437.log 87.9% 2023-07-21T22:58:55.403 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53852.log.gz 2023-07-21T22:58:55.404 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47260.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47260.log.gz 2023-07-21T22:58:55.404 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63552.log 2023-07-21T22:58:55.404 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61437.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.61437.log.gz 2023-07-21T22:58:55.405 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52627.log 2023-07-21T22:58:55.406 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63552.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63552.log.gz 2023-07-21T22:58:55.406 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-07-21T22:58:55.406 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52627.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.52627.log.gz 2023-07-21T22:58:55.407 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52978.log 2023-07-21T22:58:55.408 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56107.log 2023-07-21T22:58:55.408 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52978.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52978.log.gz 2023-07-21T22:58:55.409 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61541.log 2023-07-21T22:58:55.410 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56107.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56107.log.gz 2023-07-21T22:58:55.410 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67591.log 2023-07-21T22:58:55.411 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61541.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61541.log.gz 2023-07-21T22:58:55.412 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58869.log 2023-07-21T22:58:55.413 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59882.log 2023-07-21T22:58:55.414 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67591.log.gz 2023-07-21T22:58:55.414 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58869.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58869.log.gz 2023-07-21T22:58:55.414 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45917.log 2023-07-21T22:58:55.414 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58362.log 2023-07-21T22:58:55.415 INFO:teuthology.orchestra.run.smithi006.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59882.log.gz 2023-07-21T22:58:55.417 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61881.log 2023-07-21T22:58:55.417 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45917.log.gz 2023-07-21T22:58:55.417 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58362.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58362.log.gz 2023-07-21T22:58:55.418 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46848.log 2023-07-21T22:58:55.418 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61881.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61881.log.gz 2023-07-21T22:58:55.419 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62846.log 2023-07-21T22:58:55.430 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37740.log 2023-07-21T22:58:55.430 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43145.log 2023-07-21T22:58:55.430 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.37740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43055.log 2023-07-21T22:58:55.430 INFO:teuthology.orchestra.run.smithi161.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37740.log.gz 2023-07-21T22:58:55.430 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.3.43145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43145.log.gz 2023-07-21T22:58:55.431 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-07-21T22:58:55.431 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.1.43055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43055.log.gz 2023-07-21T22:58:55.431 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-07-21T22:58:55.431 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37716.log 2023-07-21T22:58:55.431 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37764.log 2023-07-21T22:58:55.431 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.37716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43064.log 2023-07-21T22:58:55.431 INFO:teuthology.orchestra.run.smithi161.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37716.log.gz 2023-07-21T22:58:55.432 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.37764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37692.log 2023-07-21T22:58:55.432 INFO:teuthology.orchestra.run.smithi161.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37764.log.gz 2023-07-21T22:58:55.432 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.1.43064.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43064.log.gz 2023-07-21T22:58:55.432 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37644.log 2023-07-21T22:58:55.432 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.37692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43140.log 2023-07-21T22:58:55.432 INFO:teuthology.orchestra.run.smithi161.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37692.log.gz 2023-07-21T22:58:55.432 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.37644.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37644.log.gz 2023-07-21T22:58:55.433 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-07-21T22:58:55.433 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.3.43140.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43140.log.gz 2023-07-21T22:58:55.433 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37812.log 2023-07-21T22:58:55.433 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-07-21T22:58:55.435 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46848.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46848.log.gz 2023-07-21T22:58:55.435 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55750.log 2023-07-21T22:58:55.435 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62846.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62846.log.gz 2023-07-21T22:58:55.436 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44240.log 2023-07-21T22:58:55.436 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55750.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55750.log.gz 2023-07-21T22:58:55.436 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67904.log 2023-07-21T22:58:55.436 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44240.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44240.log.gz 2023-07-21T22:58:55.436 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44773.log 2023-07-21T22:58:55.436 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67904.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67904.log.gz 2023-07-21T22:58:55.437 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44642.log 2023-07-21T22:58:55.437 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44773.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44773.log.gz 2023-07-21T22:58:55.437 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52660.log 2023-07-21T22:58:55.437 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65205.log 88.8% 2023-07-21T22:58:55.437 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44642.log.gz 2023-07-21T22:58:55.437 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52660.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.52660.log.gz 2023-07-21T22:58:55.437 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49692.log 2023-07-21T22:58:55.437 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65205.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65205.log.gz 2023-07-21T22:58:55.438 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49054.log 2023-07-21T22:58:55.438 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49692.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49692.log.gz 2023-07-21T22:58:55.438 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50078.log 2023-07-21T22:58:55.438 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49054.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49054.log.gz 2023-07-21T22:58:55.438 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59948.log 2023-07-21T22:58:55.438 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50078.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50078.log.gz 2023-07-21T22:58:55.438 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52398.log 2023-07-21T22:58:55.439 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59948.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59948.log.gz 2023-07-21T22:58:55.439 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59418.log 2023-07-21T22:58:55.439 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52398.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52398.log.gz 2023-07-21T22:58:55.439 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54340.log 2023-07-21T22:58:55.439 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59418.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59418.log.gz 2023-07-21T22:58:55.439 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58442.log 2023-07-21T22:58:55.439 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54340.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54340.log.gz 2023-07-21T22:58:55.439 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46349.log 2023-07-21T22:58:55.440 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58442.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58442.log.gz 2023-07-21T22:58:55.440 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60686.log 2023-07-21T22:58:55.443 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.37812.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37812.log.gz 2023-07-21T22:58:55.444 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-21T22:58:55.445 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37788.log 2023-07-21T22:58:55.445 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-07-21T22:58:55.445 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.37788.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-21T22:58:55.445 INFO:teuthology.orchestra.run.smithi161.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37788.log.gz 2023-07-21T22:58:55.445 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37668.log 2023-07-21T22:58:55.446 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-07-21T22:58:55.446 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.37668.log: 93.6% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-21T22:58:55.446 INFO:teuthology.orchestra.run.smithi161.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37668.log.gz 2023-07-21T22:58:55.446 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-07-21T22:58:55.446 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-07-21T22:58:55.448 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mds.b.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-21T22:58:55.451 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59392.log 2023-07-21T22:58:55.451 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46349.log.gz 2023-07-21T22:58:55.451 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.60686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60686.log.gz 2023-07-21T22:58:55.451 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62285.log 2023-07-21T22:58:55.451 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59392.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59392.log.gz 2023-07-21T22:58:55.452 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54713.log 2023-07-21T22:58:55.452 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62285.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62285.log.gz 2023-07-21T22:58:55.452 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57879.log 2023-07-21T22:58:55.452 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54713.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54713.log.gz 2023-07-21T22:58:55.452 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60226.log 2023-07-21T22:58:55.452 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57879.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57879.log.gz 2023-07-21T22:58:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49905.log 2023-07-21T22:58:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60226.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60226.log.gz 2023-07-21T22:58:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47416.log 2023-07-21T22:58:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49905.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49905.log.gz 2023-07-21T22:58:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62391.log 2023-07-21T22:58:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47416.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47416.log.gz 2023-07-21T22:58:55.453 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55393.log 2023-07-21T22:58:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60304.log 2023-07-21T22:58:55.454 INFO:teuthology.orchestra.run.smithi006.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.62391.log.gz 2023-07-21T22:58:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55393.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55393.log.gz 2023-07-21T22:58:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45527.log 2023-07-21T22:58:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60304.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60304.log.gz 2023-07-21T22:58:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67774.log 2023-07-21T22:58:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45527.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45527.log.gz 2023-07-21T22:58:55.454 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55977.log 2023-07-21T22:58:55.455 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56852.log 2023-07-21T22:58:55.455 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67774.log.gz 2023-07-21T22:58:55.455 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55977.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.55977.log.gz 2023-07-21T22:58:55.455 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50260.log 2023-07-21T22:58:55.457 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-07-21T22:58:55.457 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mon.b.log: 93.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-07-21T22:58:55.458 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56852.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56852.log.gz 2023-07-21T22:58:55.459 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64191.log 2023-07-21T22:58:55.459 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50260.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50260.log.gz 2023-07-21T22:58:55.459 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-07-21T22:58:55.459 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64191.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64191.log.gz 2023-07-21T22:58:55.459 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62337.log 2023-07-21T22:58:55.459 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61033.log 2023-07-21T22:58:55.459 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62337.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62337.log.gz 2023-07-21T22:58:55.460 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66385.log 2023-07-21T22:58:55.460 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56670.log 2023-07-21T22:58:55.460 INFO:teuthology.orchestra.run.smithi006.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61033.log.gz 2023-07-21T22:58:55.460 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62103.log 2023-07-21T22:58:55.460 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66385.log.gz 2023-07-21T22:58:55.462 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56670.log: 92.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-07-21T22:58:55.462 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59007.log 2023-07-21T22:58:55.462 INFO:teuthology.orchestra.run.smithi006.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56670.log.gz 2023-07-21T22:58:55.462 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62103.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62103.log.gz 2023-07-21T22:58:55.462 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57652.log 2023-07-21T22:58:55.462 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44455.log 2023-07-21T22:58:55.463 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59007.log.gz 2023-07-21T22:58:55.463 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57652.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57652.log.gz 2023-07-21T22:58:55.464 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51179.log 2023-07-21T22:58:55.464 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44455.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44455.log.gz -5 2023-07-21T22:58:55.464 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48642.log 2023-07-21T22:58:55.465 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51179.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51179.log.gz 2023-07-21T22:58:55.465 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65178.log 2023-07-21T22:58:55.465 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48642.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48642.log.gz 2023-07-21T22:58:55.466 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47153.log 2023-07-21T22:58:55.466 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65178.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65178.log.gz 2023-07-21T22:58:55.467 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60731.log 2023-07-21T22:58:55.467 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47153.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47153.log.gz 2023-07-21T22:58:55.468 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48944.log 2023-07-21T22:58:55.468 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60731.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.60731.log.gz 2023-07-21T22:58:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46874.log 2023-07-21T22:58:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48944.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48944.log.gz 2023-07-21T22:58:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64950.log 2023-07-21T22:58:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46874.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46874.log.gz 2023-07-21T22:58:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56644.log 2023-07-21T22:58:55.471 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64950.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64950.log.gz 2023-07-21T22:58:55.472 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62441.log 2023-07-21T22:58:55.472 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56644.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56644.log.gz 2023-07-21T22:58:55.473 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54879.log 2023-07-21T22:58:55.474 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61515.log 2023-07-21T22:58:55.474 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62441.log.gz 2023-07-21T22:58:55.474 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54879.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54879.log.gz 2023-07-21T22:58:55.475 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58468.log 2023-07-21T22:58:55.476 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61515.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61515.log.gz 2023-07-21T22:58:55.476 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46401.log 2023-07-21T22:58:55.477 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58468.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58468.log.gz 2023-07-21T22:58:55.477 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61593.log 2023-07-21T22:58:55.477 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60757.log 2023-07-21T22:58:55.478 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46401.log.gz 2023-07-21T22:58:55.479 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61593.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61593.log.gz 2023-07-21T22:58:55.479 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63891.log 2023-07-21T22:58:55.480 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59169.log 2023-07-21T22:58:55.480 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60757.log.gz 2023-07-21T22:58:55.481 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63891.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63891.log.gz 2023-07-21T22:58:55.481 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53624.log 2023-07-21T22:58:55.482 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59169.log: gzip -5 --verbose -- 89.2% /var/log/ceph/ceph-client.admin.65112.log -- replaced with /var/log/ceph/ceph-client.admin.59169.log.gz 2023-07-21T22:58:55.482 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-21T22:58:55.483 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53624.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53624.log.gz 2023-07-21T22:58:55.483 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47638.log 2023-07-21T22:58:55.484 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65112.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65112.log.gz 2023-07-21T22:58:55.484 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54288.log 2023-07-21T22:58:55.485 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47638.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47638.log.gz 2023-07-21T22:58:55.485 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52810.log 2023-07-21T22:58:55.486 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50513.log 2023-07-21T22:58:55.486 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54288.log.gz 2023-07-21T22:58:55.487 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44029.log 2023-07-21T22:58:55.487 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52810.log.gz 2023-07-21T22:58:55.488 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50513.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50513.log.gz -5 2023-07-21T22:58:55.488 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52052.log 2023-07-21T22:58:55.489 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44029.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44029.log.gz 2023-07-21T22:58:55.489 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65851.log 2023-07-21T22:58:55.491 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62487.log 2023-07-21T22:58:55.491 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52052.log.gz 2023-07-21T22:58:55.492 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54550.log 2023-07-21T22:58:55.492 INFO:teuthology.orchestra.run.smithi006.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.65851.log.gz 2023-07-21T22:58:55.492 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.62487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62487.log.gz 2023-07-21T22:58:55.493 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44237.log 2023-07-21T22:58:55.494 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58598.log 2023-07-21T22:58:55.494 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54550.log.gz 2023-07-21T22:58:55.495 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44237.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44237.log.gz 2023-07-21T22:58:55.495 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59496.log 2023-07-21T22:58:55.496 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58598.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.58598.log.gz 2023-07-21T22:58:55.496 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.67514.log 2023-07-21T22:58:55.497 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59496.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59496.log.gz 2023-07-21T22:58:55.497 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58546.log 2023-07-21T22:58:55.498 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67514.log: gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.67514.log.gz 2023-07-21T22:58:55.498 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.67077.log 2023-07-21T22:58:55.499 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58546.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58546.log.gz 2023-07-21T22:58:55.499 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55258.log 2023-07-21T22:58:55.500 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67077.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67077.log.gz 2023-07-21T22:58:55.500 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45995.log 2023-07-21T22:58:55.501 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55258.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55258.log.gz 2023-07-21T22:58:55.501 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59112.log 2023-07-21T22:58:55.502 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45995.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45995.log.gz 2023-07-21T22:58:55.502 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45007.log 2023-07-21T22:58:55.503 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64321.log 2023-07-21T22:58:55.503 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59112.log.gz 2023-07-21T22:58:55.504 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45007.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45007.log.gz 2023-07-21T22:58:55.504 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66487.log 2023-07-21T22:58:55.505 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65666.log 2023-07-21T22:58:55.505 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64321.log.gz 2023-07-21T22:58:55.506 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65439.log 2023-07-21T22:58:55.506 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66487.log.gz 2023-07-21T22:58:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55232.log 2023-07-21T22:58:55.508 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65666.log.gz 2023-07-21T22:58:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65439.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.65439.log.gz 2023-07-21T22:58:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61411.log 2023-07-21T22:58:55.509 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62608.log 2023-07-21T22:58:55.510 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61411.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55232.log.gz 2023-07-21T22:58:55.510 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61411.log.gz 2023-07-21T22:58:55.511 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64347.log 2023-07-21T22:58:55.511 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46640.log 2023-07-21T22:58:55.512 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62608.log.gz 2023-07-21T22:58:55.512 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48562.log 2023-07-21T22:58:55.513 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64347.log.gz 2023-07-21T22:58:55.513 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64023.log 2023-07-21T22:58:55.514 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46640.log.gz 2023-07-21T22:58:55.515 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47586.log 2023-07-21T22:58:55.515 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48562.log.gz 2023-07-21T22:58:55.516 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64023.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64023.log.gz 2023-07-21T22:58:55.516 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49222.log 2023-07-21T22:58:55.517 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47586.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47586.log.gz 2023-07-21T22:58:55.517 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66411.log 2023-07-21T22:58:55.518 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62049.log 2023-07-21T22:58:55.518 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49222.log.gz 2023-07-21T22:58:55.519 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66411.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66411.log.gz 2023-07-21T22:58:55.519 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45683.log 2023-07-21T22:58:55.520 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54905.log 2023-07-21T22:58:55.520 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62049.log.gz 2023-07-21T22:58:55.521 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45683.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45683.log.gz 2023-07-21T22:58:55.521 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53957.log 2023-07-21T22:58:55.522 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54905.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.54905.log.gz 2023-07-21T22:58:55.522 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48212.log 2023-07-21T22:58:55.523 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53957.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53957.log.gz 2023-07-21T22:58:55.523 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56224.log 2023-07-21T22:58:55.524 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48212.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48212.log.gz 2023-07-21T22:58:55.524 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68008.log 2023-07-21T22:58:55.525 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56224.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56224.log.gz 2023-07-21T22:58:55.526 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58220.log 2023-07-21T22:58:55.526 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.68008.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68008.log.gz 2023-07-21T22:58:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49744.log 2023-07-21T22:58:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50208.log 2023-07-21T22:58:55.528 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58220.log.gz 2023-07-21T22:58:55.528 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49744.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49744.log.gz 2023-07-21T22:58:55.529 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52916.log 2023-07-21T22:58:55.529 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58246.log 2023-07-21T22:58:55.530 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50208.log.gz 2023-07-21T22:58:55.530 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52916.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52916.log.gz 2023-07-21T22:58:55.531 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56878.log 2023-07-21T22:58:55.531 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58246.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58246.log.gz -5 2023-07-21T22:58:55.531 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53983.log 2023-07-21T22:58:55.532 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65283.log 2023-07-21T22:58:55.533 INFO:teuthology.orchestra.run.smithi006.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.56878.log.gz 2023-07-21T22:58:55.533 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53983.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53983.log.gz 2023-07-21T22:58:55.534 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67462.log 2023-07-21T22:58:55.534 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66437.log 2023-07-21T22:58:55.535 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65283.log.gz 2023-07-21T22:58:55.535 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60252.log 2023-07-21T22:58:55.536 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67462.log.gz 2023-07-21T22:58:55.536 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53344.log 2023-07-21T22:58:55.537 INFO:teuthology.orchestra.run.smithi006.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.66437.log.gz 2023-07-21T22:58:55.537 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60252.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60252.log.gz 2023-07-21T22:58:55.538 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58624.log 2023-07-21T22:58:55.539 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65877.log 2023-07-21T22:58:55.539 INFO:teuthology.orchestra.run.smithi006.stderr: 90.9%/var/log/ceph/ceph-client.admin.58624.log: -- replaced with /var/log/ceph/ceph-client.admin.53344.log.gz 2023-07-21T22:58:55.540 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.4.log: 93.6% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-07-21T22:58:55.540 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58624.log.gz 2023-07-21T22:58:55.541 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51101.log 2023-07-21T22:58:55.541 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44032.log 2023-07-21T22:58:55.541 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65877.log.gz 2023-07-21T22:58:55.542 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52019.log 2023-07-21T22:58:55.542 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51101.log.gz 2023-07-21T22:58:55.543 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66552.log 2023-07-21T22:58:55.543 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44032.log.gz 2023-07-21T22:58:55.544 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52019.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52019.log.gz 2023-07-21T22:58:55.544 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64269.log 2023-07-21T22:58:55.545 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53707.log 2023-07-21T22:58:55.545 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66552.log.gz 2023-07-21T22:58:55.546 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46588.log 2023-07-21T22:58:55.546 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64269.log.gz 2023-07-21T22:58:55.547 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45605.log 2023-07-21T22:58:55.547 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53707.log.gz 2023-07-21T22:58:55.548 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46588.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46588.log.gz 2023-07-21T22:58:55.548 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64165.log 2023-07-21T22:58:55.549 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43311.log 2023-07-21T22:58:55.549 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45605.log.gz 2023-07-21T22:58:55.550 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64165.log: gzip -5 --verbose 88.8% -- -- replaced with /var/log/ceph/ceph-client.admin.64165.log.gz /var/log/ceph/ceph-client.admin.67722.log 2023-07-21T22:58:55.550 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-21T22:58:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46744.log 2023-07-21T22:58:55.552 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43311.log.gz 2023-07-21T22:58:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67722.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67722.log.gz 2023-07-21T22:58:55.553 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50997.log 2023-07-21T22:58:55.553 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50827.log 2023-07-21T22:58:55.554 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46744.log.gz 2023-07-21T22:58:55.554 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50997.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.50997.log.gz 2023-07-21T22:58:55.555 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51858.log 2023-07-21T22:58:55.555 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57678.log 2023-07-21T22:58:55.555 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50827.log.gz 2023-07-21T22:58:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51858.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51858.log.gz 2023-07-21T22:58:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63153.log 2023-07-21T22:58:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57678.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57678.log.gz 2023-07-21T22:58:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43471.log 2023-07-21T22:58:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63153.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63153.log.gz 2023-07-21T22:58:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56826.log 2023-07-21T22:58:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51452.log 2023-07-21T22:58:55.560 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43471.log.gz 2023-07-21T22:58:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56826.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56826.log.gz 2023-07-21T22:58:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45735.log 2023-07-21T22:58:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46375.log 2023-07-21T22:58:55.562 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51452.log.gz 2023-07-21T22:58:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45735.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45735.log.gz 2023-07-21T22:58:55.563 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42948.log 2023-07-21T22:58:55.563 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46375.log: gzip 87.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.46375.log.gz --verbose 2023-07-21T22:58:55.564 INFO:teuthology.orchestra.run.smithi006.stderr: -- /var/log/ceph/ceph-client.admin.65751.log 2023-07-21T22:58:55.564 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.42948.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42948.log.gz 2023-07-21T22:58:55.565 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50855.log 2023-07-21T22:58:55.565 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50801.log 2023-07-21T22:58:55.566 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65751.log.gz 2023-07-21T22:58:55.566 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50855.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50855.log.gz 2023-07-21T22:58:55.567 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54628.log 2023-07-21T22:58:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55360.log 88.6% 2023-07-21T22:58:55.568 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50801.log.gz 2023-07-21T22:58:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54628.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54628.log.gz 2023-07-21T22:58:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46510.log 2023-07-21T22:58:55.570 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64734.log 2023-07-21T22:58:55.570 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55360.log.gz 2023-07-21T22:58:55.571 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46510.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46510.log.gz 2023-07-21T22:58:55.571 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46453.log 2023-07-21T22:58:55.572 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64734.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-07-21T22:58:55.572 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64734.log.gz 2023-07-21T22:58:55.573 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46453.log: gzip 89.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.46453.log.gz -- 2023-07-21T22:58:55.573 INFO:teuthology.orchestra.run.smithi006.stderr: /var/log/ceph/ceph-client.admin.43029.log 2023-07-21T22:58:55.573 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66907.log 2023-07-21T22:58:55.575 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43204.log 2023-07-21T22:58:55.575 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43029.log.gz 2023-07-21T22:58:55.576 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50130.log 2023-07-21T22:58:55.576 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.66907.log.gz 2023-07-21T22:58:55.577 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43204.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43204.log.gz 2023-07-21T22:58:55.577 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47472.log 2023-07-21T22:58:55.578 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61619.log 2023-07-21T22:58:55.578 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50130.log.gz 2023-07-21T22:58:55.579 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47472.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47472.log.gz 2023-07-21T22:58:55.579 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61933.log 2023-07-21T22:58:55.580 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53459.log 2023-07-21T22:58:55.581 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61619.log.gz 2023-07-21T22:58:55.581 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61933.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61933.log.gz 2023-07-21T22:58:55.582 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60118.log 2023-07-21T22:58:55.583 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58414.log 2023-07-21T22:58:55.583 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53459.log.gz 2023-07-21T22:58:55.584 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60118.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60118.log.gz 2023-07-21T22:58:55.584 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54314.log 2023-07-21T22:58:55.585 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58414.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58414.log.gz 2023-07-21T22:58:55.586 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59522.log 2023-07-21T22:58:55.587 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65562.log 2023-07-21T22:58:55.587 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54314.log.gz 2023-07-21T22:58:55.588 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45761.log 2023-07-21T22:58:55.588 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59522.log.gz 2023-07-21T22:58:55.589 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65562.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65562.log.gz 2023-07-21T22:58:55.589 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57574.log 2023-07-21T22:58:55.590 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45761.log: gzip 88.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.45761.log.gz --verbose 2023-07-21T22:58:55.590 INFO:teuthology.orchestra.run.smithi006.stderr: -- /var/log/ceph/ceph-client.admin.53084.log 2023-07-21T22:58:55.591 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57574.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.57574.log.gz 2023-07-21T22:58:55.591 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60172.log 2023-07-21T22:58:55.592 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65008.log 2023-07-21T22:58:55.593 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53084.log.gz 2023-07-21T22:58:55.593 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60172.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60172.log.gz 2023-07-21T22:58:55.594 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66682.log 2023-07-21T22:58:55.595 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65008.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65008.log.gz -5 2023-07-21T22:58:55.595 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45631.log 2023-07-21T22:58:55.596 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66682.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66682.log.gz 2023-07-21T22:58:55.596 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51824.log 2023-07-21T22:58:55.597 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63273.log 2023-07-21T22:58:55.597 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45631.log.gz 2023-07-21T22:58:55.598 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51824.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51824.log.gz 2023-07-21T22:58:55.598 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62900.log 2023-07-21T22:58:55.599 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51381.log 2023-07-21T22:58:55.600 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63273.log.gz 2023-07-21T22:58:55.600 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62900.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62900.log.gz 2023-07-21T22:58:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64137.log 2023-07-21T22:58:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.51381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51381.log.gz 2023-07-21T22:58:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47062.log 2023-07-21T22:58:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63023.log 2023-07-21T22:58:55.603 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64137.log.gz 2023-07-21T22:58:55.605 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43365.log 2023-07-21T22:58:55.605 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47062.log.gz 2023-07-21T22:58:55.605 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63023.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63023.log.gz 2023-07-21T22:58:55.605 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53589.log 2023-07-21T22:58:55.606 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57548.log 2023-07-21T22:58:55.607 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43365.log.gz 2023-07-21T22:58:55.607 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53589.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53589.log.gz 2023-07-21T22:58:55.608 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46055.log 2023-07-21T22:58:55.609 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57548.log: gzip -5 --verbose -- 89.0% /var/log/ceph/ceph-client.admin.56290.log -- replaced with /var/log/ceph/ceph-client.admin.57548.log.gz 2023-07-21T22:58:55.609 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-21T22:58:55.610 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54392.log 2023-07-21T22:58:55.610 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46055.log.gz 2023-07-21T22:58:55.611 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58778.log 2023-07-21T22:58:55.611 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56290.log.gz 2023-07-21T22:58:55.612 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54392.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54392.log.gz 2023-07-21T22:58:55.613 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63247.log 2023-07-21T22:58:55.614 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46427.log 2023-07-21T22:58:55.614 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58778.log.gz 2023-07-21T22:58:55.614 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63247.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63247.log.gz 2023-07-21T22:58:55.615 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57522.log 2023-07-21T22:58:55.616 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54524.log 2023-07-21T22:58:55.616 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46427.log.gz 2023-07-21T22:58:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57522.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57522.log.gz 2023-07-21T22:58:55.617 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54853.log 2023-07-21T22:58:55.618 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54524.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.61307.log -- replaced with /var/log/ceph/ceph-client.admin.54524.log.gz 2023-07-21T22:58:55.618 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-21T22:58:55.619 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54853.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54853.log.gz 2023-07-21T22:58:55.620 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54654.log 2023-07-21T22:58:55.621 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61307.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-07-21T22:58:55.621 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61307.log.gz 2023-07-21T22:58:55.621 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54654.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54654.log.gz 2023-07-21T22:58:55.622 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49380.log 2023-07-21T22:58:55.623 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53266.log 2023-07-21T22:58:55.624 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49380.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49380.log.gz 2023-07-21T22:58:55.625 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63734.log 2023-07-21T22:58:55.626 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53266.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53266.log.gz 2023-07-21T22:58:55.626 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50723.log 2023-07-21T22:58:55.627 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63734.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63734.log.gz 2023-07-21T22:58:55.628 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50749.log 2023-07-21T22:58:55.629 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43283.log 2023-07-21T22:58:55.629 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50723.log.gz 2023-07-21T22:58:55.630 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67436.log 2023-07-21T22:58:55.631 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50749.log.gz 2023-07-21T22:58:55.632 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43283.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43283.log.gz 2023-07-21T22:58:55.632 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44460.log 2023-07-21T22:58:55.633 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60640.log 2023-07-21T22:58:55.634 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67436.log.gz 2023-07-21T22:58:55.634 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44460.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44460.log.gz 2023-07-21T22:58:55.635 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62129.log 2023-07-21T22:58:55.636 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63429.log 2023-07-21T22:58:55.636 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60640.log.gz 2023-07-21T22:58:55.637 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62129.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62129.log.gz 2023-07-21T22:58:55.637 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48268.log 2023-07-21T22:58:55.638 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44246.log 2023-07-21T22:58:55.639 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63429.log.gz 2023-07-21T22:58:55.639 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48268.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48268.log.gz 2023-07-21T22:58:55.640 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43829.log 2023-07-21T22:58:55.641 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50883.log 2023-07-21T22:58:55.641 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44246.log.gz 2023-07-21T22:58:55.642 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43829.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43829.log.gz 2023-07-21T22:58:55.642 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46536.log 2023-07-21T22:58:55.643 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68138.log 2023-07-21T22:58:55.644 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50883.log.gz 2023-07-21T22:58:55.644 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46536.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46536.log.gz 2023-07-21T22:58:55.645 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43419.log 2023-07-21T22:58:55.646 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.68138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44851.log 2023-07-21T22:58:55.646 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68138.log.gz 2023-07-21T22:58:55.647 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43419.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43419.log.gz 2023-07-21T22:58:55.647 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55802.log 2023-07-21T22:58:55.648 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61463.log 2023-07-21T22:58:55.649 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44851.log.gz 2023-07-21T22:58:55.649 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55802.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55802.log.gz 2023-07-21T22:58:55.650 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60014.log 2023-07-21T22:58:55.651 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67155.log 2023-07-21T22:58:55.651 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61463.log.gz 2023-07-21T22:58:55.652 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60014.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60014.log.gz 2023-07-21T22:58:55.653 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50234.log 2023-07-21T22:58:55.654 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52294.log 2023-07-21T22:58:55.654 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67155.log.gz 2023-07-21T22:58:55.655 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50234.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50234.log.gz 2023-07-21T22:58:55.655 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61803.log 2023-07-21T22:58:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66578.log 2023-07-21T22:58:55.657 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52294.log.gz 2023-07-21T22:58:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61803.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61803.log.gz 2023-07-21T22:58:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47873.log 2023-07-21T22:58:55.659 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45943.log 2023-07-21T22:58:55.659 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66578.log.gz 2023-07-21T22:58:55.660 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47873.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.47873.log.gz 2023-07-21T22:58:55.661 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64595.log 2023-07-21T22:58:55.662 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46614.log 2023-07-21T22:58:55.662 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45943.log.gz 2023-07-21T22:58:55.663 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64595.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64595.log.gz 2023-07-21T22:58:55.663 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52164.log 2023-07-21T22:58:55.664 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47847.log 2023-07-21T22:58:55.665 INFO:teuthology.orchestra.run.smithi006.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46614.log.gz 2023-07-21T22:58:55.665 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52164.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52164.log.gz 2023-07-21T22:58:55.666 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66071.log 2023-07-21T22:58:55.667 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64918.log 2023-07-21T22:58:55.667 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47847.log.gz 2023-07-21T22:58:55.668 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66071.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66071.log.gz 2023-07-21T22:58:55.668 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57299.log 2023-07-21T22:58:55.669 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66768.log 2023-07-21T22:58:55.670 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64918.log.gz 2023-07-21T22:58:55.670 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57299.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57299.log.gz 2023-07-21T22:58:55.671 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52601.log 2023-07-21T22:58:55.672 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44438.log 2023-07-21T22:58:55.673 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66768.log.gz 2023-07-21T22:58:55.673 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52601.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52601.log.gz 2023-07-21T22:58:55.674 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54426.log 2023-07-21T22:58:55.675 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56592.log 2023-07-21T22:58:55.675 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44438.log.gz 2023-07-21T22:58:55.676 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54426.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54426.log.gz 2023-07-21T22:58:55.676 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55698.log 2023-07-21T22:58:55.678 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64051.log 2023-07-21T22:58:55.678 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56592.log.gz 2023-07-21T22:58:55.679 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55698.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55698.log.gz 2023-07-21T22:58:55.679 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66009.log 2023-07-21T22:58:55.680 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56800.log 2023-07-21T22:58:55.681 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64051.log.gz 2023-07-21T22:58:55.681 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66009.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66009.log.gz 2023-07-21T22:58:55.682 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50435.log 2023-07-21T22:58:55.684 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65145.log 2023-07-21T22:58:55.684 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56800.log.gz 2023-07-21T22:58:55.685 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50435.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50435.log.gz 2023-07-21T22:58:55.685 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48040.log 2023-07-21T22:58:55.685 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64453.log 2023-07-21T22:58:55.686 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65145.log.gz 2023-07-21T22:58:55.686 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48040.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48040.log.gz 2023-07-21T22:58:55.687 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44825.log 2023-07-21T22:58:55.688 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53485.log 2023-07-21T22:58:55.689 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44825.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.64453.log.gz 2023-07-21T22:58:55.690 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44825.log.gz 2023-07-21T22:58:55.690 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50025.log 2023-07-21T22:58:55.691 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53030.log 2023-07-21T22:58:55.691 INFO:teuthology.orchestra.run.smithi006.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53485.log.gz 2023-07-21T22:58:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50025.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50025.log.gz 2023-07-21T22:58:55.692 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64555.log 2023-07-21T22:58:55.694 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53030.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53030.log.gz 2023-07-21T22:58:55.694 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59548.log 2023-07-21T22:58:55.695 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.64555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64555.log.gz 2023-07-21T22:58:55.697 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45059.log 2023-07-21T22:58:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59548.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59548.log.gz 2023-07-21T22:58:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67748.log 2023-07-21T22:58:55.698 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45059.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45059.log.gz 2023-07-21T22:58:55.699 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61203.log 2023-07-21T22:58:55.700 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67748.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67748.log.gz 2023-07-21T22:58:55.701 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61672.log 2023-07-21T22:58:55.702 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61203.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61203.log.gz 2023-07-21T22:58:55.702 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45891.log 2023-07-21T22:58:55.703 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61672.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61672.log.gz 2023-07-21T22:58:55.704 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63995.log 2023-07-21T22:58:55.705 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45891.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45891.log.gz 2023-07-21T22:58:55.706 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46796.log 2023-07-21T22:58:55.707 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63995.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63995.log.gz 2023-07-21T22:58:55.707 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43627.log 2023-07-21T22:58:55.708 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46796.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46796.log.gz 2023-07-21T22:58:55.709 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53188.log 2023-07-21T22:58:55.710 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59856.log 2023-07-21T22:58:55.711 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43627.log.gz 2023-07-21T22:58:55.711 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53188.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53188.log.gz 2023-07-21T22:58:55.712 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57429.log 2023-07-21T22:58:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43257.log 2023-07-21T22:58:55.713 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59856.log.gz 2023-07-21T22:58:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57429.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57429.log.gz 2023-07-21T22:58:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54061.log 2023-07-21T22:58:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43257.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43257.log.gz 2023-07-21T22:58:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62181.log 2023-07-21T22:58:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54061.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54061.log.gz 2023-07-21T22:58:55.718 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66959.log 2023-07-21T22:58:55.719 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62181.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62181.log.gz 2023-07-21T22:58:55.720 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43152.log 2023-07-21T22:58:55.721 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66959.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66959.log.gz 2023-07-21T22:58:55.721 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63455.log 2023-07-21T22:58:55.722 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43152.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43152.log.gz 2023-07-21T22:58:55.723 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.32533.log 2023-07-21T22:58:55.724 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63455.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63455.log.gz 2023-07-21T22:58:55.724 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66255.log 2023-07-21T22:58:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.tmp-client.admin.32533.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.32533.log.gz 2023-07-21T22:58:55.726 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47974.log 2023-07-21T22:58:55.727 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66255.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66255.log.gz 2023-07-21T22:58:55.728 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58843.log 2023-07-21T22:58:55.728 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.47974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47974.log.gz 2023-07-21T22:58:55.729 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66538.log 2023-07-21T22:58:55.730 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58843.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58843.log.gz 2023-07-21T22:58:55.731 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46190.log 2023-07-21T22:58:55.732 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.66538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.66538.log.gz 2023-07-21T22:58:55.733 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45553.log 2023-07-21T22:58:55.734 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46190.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46190.log.gz 2023-07-21T22:58:55.734 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65929.log 2023-07-21T22:58:55.832 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45553.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45553.log.gz 2023-07-21T22:58:55.832 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66742.log 2023-07-21T22:58:55.833 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65929.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65929.log.gz 2023-07-21T22:58:55.833 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50697.log 2023-07-21T22:58:55.833 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66742.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66742.log.gz 2023-07-21T22:58:55.833 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65783.log 2023-07-21T22:58:55.833 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50697.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50697.log.gz 2023-07-21T22:58:55.833 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55934.log 2023-07-21T22:58:55.834 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65783.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65783.log.gz 2023-07-21T22:58:55.834 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65614.log 2023-07-21T22:58:55.834 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55934.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.55934.log.gz 2023-07-21T22:58:55.834 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50565.log 2023-07-21T22:58:55.835 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65614.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65614.log.gz 2023-07-21T22:58:55.835 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58676.log 2023-07-21T22:58:55.835 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50565.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50565.log.gz 2023-07-21T22:58:55.835 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51231.log 2023-07-21T22:58:55.835 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58676.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58676.log.gz 2023-07-21T22:58:55.836 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59247.log 2023-07-21T22:58:55.836 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51231.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51231.log.gz 2023-07-21T22:58:55.836 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63578.log 2023-07-21T22:58:55.837 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59247.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59247.log.gz 2023-07-21T22:58:55.837 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54775.log 2023-07-21T22:58:55.837 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63578.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63578.log.gz 2023-07-21T22:58:55.837 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45501.log 2023-07-21T22:58:55.838 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54775.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54775.log.gz 2023-07-21T22:58:55.838 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56420.log 2023-07-21T22:58:55.838 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56316.log 2023-07-21T22:58:55.838 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45501.log.gz 2023-07-21T22:58:55.839 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56420.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56420.log.gz 2023-07-21T22:58:55.839 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48762.log 2023-07-21T22:58:55.839 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48866.log 2023-07-21T22:58:55.840 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56316.log.gz 2023-07-21T22:58:55.840 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48762.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48762.log.gz 2023-07-21T22:58:55.840 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63799.log 2023-07-21T22:58:55.840 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48866.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48866.log.gz 2023-07-21T22:58:55.841 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53292.log 2023-07-21T22:58:55.841 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63799.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63799.log.gz -5 2023-07-21T22:58:55.841 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.64243.log 2023-07-21T22:58:55.842 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53292.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53292.log.gz 2023-07-21T22:58:55.842 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59804.log 2023-07-21T22:58:55.842 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64243.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64243.log.gz 2023-07-21T22:58:55.842 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51283.log 2023-07-21T22:58:55.843 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59804.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59804.log.gz 2023-07-21T22:58:55.843 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63865.log 2023-07-21T22:58:55.843 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45268.log 2023-07-21T22:58:55.843 INFO:teuthology.orchestra.run.smithi006.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51283.log.gz 2023-07-21T22:58:55.844 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63865.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63865.log.gz 2023-07-21T22:58:55.844 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43836.log 2023-07-21T22:58:55.844 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.45268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45268.log.gz 2023-07-21T22:58:55.845 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57020.log 2023-07-21T22:58:55.845 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43836.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43836.log.gz 2023-07-21T22:58:55.845 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65536.log 2023-07-21T22:58:55.846 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57020.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57020.log.gz 2023-07-21T22:58:55.846 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57600.log 2023-07-21T22:58:55.846 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65536.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65536.log.gz 2023-07-21T22:58:55.846 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43575.log 2023-07-21T22:58:55.847 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57600.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57600.log.gz 2023-07-21T22:58:55.847 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61829.log 2023-07-21T22:58:55.847 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43575.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43575.log.gz 2023-07-21T22:58:55.848 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57046.log 2023-07-21T22:58:55.848 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61829.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61829.log.gz 2023-07-21T22:58:55.848 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50156.log 2023-07-21T22:58:55.848 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57046.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57046.log.gz 2023-07-21T22:58:55.848 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47768.log 2023-07-21T22:58:55.849 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50156.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50156.log.gz 2023-07-21T22:58:55.849 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68034.log 2023-07-21T22:58:55.849 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47768.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47768.log.gz 2023-07-21T22:58:55.850 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45657.log 2023-07-21T22:58:55.850 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.68034.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68034.log.gz 2023-07-21T22:58:55.850 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45370.log 2023-07-21T22:58:55.850 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45657.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45657.log.gz 2023-07-21T22:58:55.851 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44248.log 2023-07-21T22:58:55.851 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.2.45370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45370.log.gz 2023-07-21T22:58:55.851 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44955.log 2023-07-21T22:58:55.851 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44248.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44248.log.gz 2023-07-21T22:58:55.852 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60691.log 2023-07-21T22:58:55.852 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44955.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44955.log.gz 2023-07-21T22:58:55.852 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-07-21T22:58:55.853 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.60691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60691.log.gz 2023-07-21T22:58:55.853 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55619.log 2023-07-21T22:58:55.853 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66203.log 2023-07-21T22:58:55.853 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53561.log 2023-07-21T22:58:55.854 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55619.log.gz 2023-07-21T22:58:55.854 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62532.log 2023-07-21T22:58:55.854 INFO:teuthology.orchestra.run.smithi006.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.66203.log.gz 2023-07-21T22:58:55.854 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53561.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53561.log.gz 2023-07-21T22:58:55.855 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51400.log 2023-07-21T22:58:55.855 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62532.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.62532.log.gz -5 2023-07-21T22:58:55.855 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52443.log 2023-07-21T22:58:55.855 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51400.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51400.log.gz 2023-07-21T22:58:55.855 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58945.log 2023-07-21T22:58:55.855 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52443.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52443.log.gz 2023-07-21T22:58:55.855 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50969.log 2023-07-21T22:58:55.856 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58945.log: 87.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.58945.log.gz -5 2023-07-21T22:58:55.856 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62233.log 2023-07-21T22:58:55.856 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50969.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50969.log.gz 2023-07-21T22:58:55.856 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53905.log 2023-07-21T22:58:55.856 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62233.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.62233.log.gz -5 2023-07-21T22:58:55.856 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.67982.log 2023-07-21T22:58:55.856 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53905.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53905.log.gz 2023-07-21T22:58:55.857 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57122.log 2023-07-21T22:58:55.857 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52836.log 2023-07-21T22:58:55.857 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67982.log.gz 2023-07-21T22:58:55.857 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57122.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57122.log.gz 2023-07-21T22:58:55.857 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57495.log 2023-07-21T22:58:55.857 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49985.log 2023-07-21T22:58:55.857 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52836.log.gz 2023-07-21T22:58:55.858 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45475.log 2023-07-21T22:58:55.858 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57495.log.gz 2023-07-21T22:58:55.858 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49985.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.49985.log.gz 2023-07-21T22:58:55.858 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45787.log 2023-07-21T22:58:55.859 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45475.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45475.log.gz 2023-07-21T22:58:55.859 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43337.log 2023-07-21T22:58:55.859 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45787.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45787.log.gz 2023-07-21T22:58:55.860 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55502.log 2023-07-21T22:58:55.860 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43337.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.43337.log.gz 2023-07-21T22:58:55.860 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.62155.log 2023-07-21T22:58:55.860 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52888.log 2023-07-21T22:58:55.861 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55502.log.gz 2023-07-21T22:58:55.861 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62155.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62155.log.gz 2023-07-21T22:58:55.861 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44694.log 2023-07-21T22:58:55.872 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53761.log 2023-07-21T22:58:55.872 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52888.log.gz 2023-07-21T22:58:55.873 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44694.log: gzip -5 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44694.log.gz 2023-07-21T22:58:55.873 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.65086.log 2023-07-21T22:58:55.873 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53761.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53761.log.gz 2023-07-21T22:58:55.873 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52523.log 2023-07-21T22:58:55.874 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65086.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65086.log.gz 2023-07-21T22:58:55.874 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62506.log 2023-07-21T22:58:55.874 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52523.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52523.log.gz -5 2023-07-21T22:58:55.874 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48918.log 2023-07-21T22:58:55.874 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62506.log: gzip -5 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62506.log.gz 2023-07-21T22:58:55.874 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45579.log 2023-07-21T22:58:55.875 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48918.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48918.log.gz 2023-07-21T22:58:55.875 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44458.log 2023-07-21T22:58:55.875 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44799.log 2023-07-21T22:58:55.875 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45579.log.gz 2023-07-21T22:58:55.875 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44458.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44458.log.gz 2023-07-21T22:58:55.875 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45375.log 2023-07-21T22:58:55.876 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44799.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44799.log.gz 2023-07-21T22:58:55.876 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48788.log 2023-07-21T22:58:55.876 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.2.45375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45375.log.gz 2023-07-21T22:58:55.876 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47558.log 2023-07-21T22:58:55.876 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48788.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48788.log.gz 2023-07-21T22:58:55.876 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64621.log 2023-07-21T22:58:55.876 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47558.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59751.log 2023-07-21T22:58:55.877 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47558.log.gz 2023-07-21T22:58:55.877 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64621.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59080.log 2023-07-21T22:58:55.877 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64621.log.gz 2023-07-21T22:58:55.877 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59751.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59751.log.gz 2023-07-21T22:58:55.877 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52784.log 2023-07-21T22:58:55.877 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48736.log 2023-07-21T22:58:55.877 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59080.log.gz 2023-07-21T22:58:55.877 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66881.log 2023-07-21T22:58:55.878 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48736.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52784.log.gz 2023-07-21T22:58:55.878 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51502.log 2023-07-21T22:58:55.878 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48736.log.gz 2023-07-21T22:58:55.878 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66881.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66881.log.gz 2023-07-21T22:58:55.878 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55528.log 2023-07-21T22:58:55.878 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51502.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62672.log 2023-07-21T22:58:55.878 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51502.log.gz 2023-07-21T22:58:55.879 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55528.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63917.log 2023-07-21T22:58:55.879 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55528.log.gz 2023-07-21T22:58:55.879 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62672.log: gzip -5 87.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.62672.log.gz /var/log/ceph/ceph-client.admin.45145.log 2023-07-21T22:58:55.879 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-21T22:58:55.879 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63917.log: 89.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65335.log 2023-07-21T22:58:55.879 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63917.log.gz 2023-07-21T22:58:55.880 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45145.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68060.log 2023-07-21T22:58:55.880 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45145.log.gz 2023-07-21T22:58:55.880 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53394.log 88.3% 2023-07-21T22:58:55.880 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65335.log.gz 2023-07-21T22:58:55.883 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.68060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60330.log 2023-07-21T22:58:55.884 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68060.log.gz 2023-07-21T22:58:55.884 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53394.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53394.log.gz 2023-07-21T22:58:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58973.log 2023-07-21T22:58:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57782.log 2023-07-21T22:58:55.885 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60330.log.gz 2023-07-21T22:58:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60981.log 2023-07-21T22:58:55.886 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58973.log.gz 2023-07-21T22:58:55.886 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57782.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.57782.log.gz 2023-07-21T22:58:55.886 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.62207.log 2023-07-21T22:58:55.886 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44747.log 2023-07-21T22:58:55.886 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60981.log.gz 2023-07-21T22:58:55.886 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62207.log: gzip 89.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.62207.log.gz -- 2023-07-21T22:58:55.886 INFO:teuthology.orchestra.run.smithi006.stderr: /var/log/ceph/ceph-client.admin.48184.log 2023-07-21T22:58:55.888 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44747.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65361.log 2023-07-21T22:58:55.888 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44747.log.gz 2023-07-21T22:58:55.888 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57730.log 2023-07-21T22:58:55.888 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48184.log.gz 2023-07-21T22:58:55.888 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65361.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44929.log 2023-07-21T22:58:55.888 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65361.log.gz 2023-07-21T22:58:55.889 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57730.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57730.log.gz 2023-07-21T22:58:55.889 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43601.log 2023-07-21T22:58:55.891 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63507.log 2023-07-21T22:58:55.892 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44929.log.gz 2023-07-21T22:58:55.892 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47923.log 2023-07-21T22:58:55.894 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3%/var/log/ceph/ceph-client.admin.63507.log: -- replaced with /var/log/ceph/ceph-client.admin.43601.log.gz 2023-07-21T22:58:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50539.log 2023-07-21T22:58:55.895 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63507.log.gz 2023-07-21T22:58:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47923.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47338.log 2023-07-21T22:58:55.896 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47923.log.gz 2023-07-21T22:58:55.897 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50539.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61281.log 2023-07-21T22:58:55.897 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50539.log.gz 2023-07-21T22:58:55.898 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47338.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47338.log.gz 2023-07-21T22:58:55.899 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51426.log 2023-07-21T22:58:55.900 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61281.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49328.log 2023-07-21T22:58:55.900 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61281.log.gz 2023-07-21T22:58:55.902 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51426.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51426.log.gz 2023-07-21T22:58:55.902 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54113.log 2023-07-21T22:58:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56081.log 2023-07-21T22:58:55.904 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49328.log.gz 2023-07-21T22:58:55.905 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54113.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.56536.log 2023-07-21T22:58:55.905 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54113.log.gz 2023-07-21T22:58:55.906 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56081.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56081.log.gz 2023-07-21T22:58:55.907 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56192.log 2023-07-21T22:58:55.908 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56536.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56536.log.gz 2023-07-21T22:58:55.908 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66359.log 2023-07-21T22:58:55.910 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56192.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62790.log 2023-07-21T22:58:55.910 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56192.log.gz 2023-07-21T22:58:55.911 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66359.log: gzip 88.9% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.66359.log.gz -- 2023-07-21T22:58:55.911 INFO:teuthology.orchestra.run.smithi006.stderr: /var/log/ceph/ceph-osd.1.log 2023-07-21T22:58:55.913 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49484.log 2023-07-21T22:58:55.914 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.62790.log.gz 2023-07-21T22:58:55.915 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53511.log 2023-07-21T22:58:55.916 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56342.log 2023-07-21T22:58:55.916 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49484.log.gz 2023-07-21T22:58:55.918 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65231.log 2023-07-21T22:58:55.918 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53511.log.gz 2023-07-21T22:58:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48814.log 2023-07-21T22:58:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65231.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56342.log.gz 2023-07-21T22:58:55.921 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65231.log.gz 2023-07-21T22:58:55.922 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54827.log 2023-07-21T22:58:55.924 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48814.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48814.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48458.log 2023-07-21T22:58:55.924 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-21T22:58:55.925 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44250.log 2023-07-21T22:58:55.926 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54827.log.gz 2023-07-21T22:58:55.928 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48458.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48458.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59652.log 2023-07-21T22:58:55.928 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-21T22:58:55.929 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44250.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43819.log 2023-07-21T22:58:55.929 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44250.log.gz 2023-07-21T22:58:55.931 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43837.log 2023-07-21T22:58:55.932 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43819.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59652.log.gz 2023-07-21T22:58:55.932 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43819.log.gz 2023-07-21T22:58:55.934 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37495.log 2023-07-21T22:58:55.936 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43837.log: gzip -5 --verbose 88.0% -- /var/log/ceph/ceph-client.admin.55554.log -- replaced with /var/log/ceph/ceph-client.admin.43837.log.gz 2023-07-21T22:58:55.936 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-21T22:58:55.937 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58494.log 2023-07-21T22:58:55.938 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55554.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37495.log.gz 2023-07-21T22:58:55.939 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55554.log.gz 2023-07-21T22:58:55.940 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67800.log 2023-07-21T22:58:55.942 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67930.log 2023-07-21T22:58:55.942 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67800.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58494.log.gz 2023-07-21T22:58:55.943 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67800.log.gz 2023-07-21T22:58:55.945 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63299.log 2023-07-21T22:58:55.946 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68164.log 2023-07-21T22:58:55.946 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67930.log.gz 2023-07-21T22:58:55.948 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44903.log 2023-07-21T22:58:55.949 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.68164.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63299.log.gz 2023-07-21T22:58:55.949 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68164.log.gz 2023-07-21T22:58:55.951 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61255.log 2023-07-21T22:58:55.952 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60040.log 2023-07-21T22:58:55.952 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44903.log.gz 2023-07-21T22:58:55.954 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65060.log 2023-07-21T22:58:55.955 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60040.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61255.log.gz 2023-07-21T22:58:55.955 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60040.log.gz 2023-07-21T22:58:55.957 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48014.log 2023-07-21T22:58:55.958 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65060.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66229.log 2023-07-21T22:58:55.958 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65060.log.gz 2023-07-21T22:58:55.960 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44226.log 2023-07-21T22:58:55.962 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66229.log: 88.7% 87.3% -- replaced with /var/log/ceph/ceph-client.admin.66229.log.gz 2023-07-21T22:58:55.962 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48014.log.gz 2023-07-21T22:58:55.963 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43178.log 2023-07-21T22:58:55.965 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44226.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57190.log 2023-07-21T22:58:55.965 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44226.log.gz 2023-07-21T22:58:55.966 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57216.log 2023-07-21T22:58:55.967 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57190.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43178.log.gz 2023-07-21T22:58:55.968 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57190.log.gz 2023-07-21T22:58:55.969 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48432.log 2023-07-21T22:58:55.971 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56979.log 2023-07-21T22:58:55.971 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57216.log.gz 2023-07-21T22:58:55.973 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59365.log 2023-07-21T22:58:55.974 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.56979.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48432.log.gz 0.0% 2023-07-21T22:58:55.974 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.0.56979.log.gz 2023-07-21T22:58:55.974 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65257.log 2023-07-21T22:58:55.976 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49959.log 2023-07-21T22:58:55.976 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59365.log.gz 2023-07-21T22:58:55.977 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65257.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56055.log 2023-07-21T22:58:55.977 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65257.log.gz 2023-07-21T22:58:55.978 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49959.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49959.log.gz 2023-07-21T22:58:55.979 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64427.log 2023-07-21T22:58:55.980 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46320.log 2023-07-21T22:58:55.981 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64427.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56055.log.gz 2023-07-21T22:58:55.982 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64375.log 2023-07-21T22:58:55.982 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64427.log.gz 2023-07-21T22:58:55.983 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46320.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57985.log 2023-07-21T22:58:55.983 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46320.log.gz 2023-07-21T22:58:55.985 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64375.log: gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.64375.log.gz --verbose 2023-07-21T22:58:55.985 INFO:teuthology.orchestra.run.smithi006.stderr: -- /var/log/ceph/ceph-client.admin.58300.log 2023-07-21T22:58:55.986 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57985.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57985.log.gz 2023-07-21T22:58:55.987 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47969.log 2023-07-21T22:58:55.988 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58300.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43393.log 2023-07-21T22:58:55.989 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58300.log.gz 2023-07-21T22:58:55.990 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.47969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47969.log.gz 2023-07-21T22:58:55.990 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54262.log 2023-07-21T22:58:55.993 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53058.log 2023-07-21T22:58:55.993 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54262.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43393.log.gz 2023-07-21T22:58:55.993 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47506.log 2023-07-21T22:58:55.993 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54262.log.gz 2023-07-21T22:58:55.995 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53058.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53058.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67826.log 2023-07-21T22:58:55.995 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-21T22:58:55.996 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44249.log 2023-07-21T22:58:55.997 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47506.log.gz 2023-07-21T22:58:55.997 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67826.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67826.log.gz 2023-07-21T22:58:55.998 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49166.log 2023-07-21T22:58:56.000 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63969.log 2023-07-21T22:58:56.000 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44249.log.gz 2023-07-21T22:58:56.001 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49166.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49166.log.gz 2023-07-21T22:58:56.001 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61085.log 2023-07-21T22:58:56.002 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63969.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63969.log.gz 2023-07-21T22:58:56.003 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54009.log 2023-07-21T22:58:56.004 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61085.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58168.log 2023-07-21T22:58:56.004 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61085.log.gz 2023-07-21T22:58:56.005 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54009.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54009.log.gz 2023-07-21T22:58:56.006 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44877.log 2023-07-21T22:58:56.008 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58168.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58168.log.gz 2023-07-21T22:58:56.008 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59470.log 2023-07-21T22:58:56.010 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43705.log 2023-07-21T22:58:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44877.log: /var/log/ceph/ceph-client.admin.59470.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44877.log.gz 2023-07-21T22:58:56.011 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59470.log.gz 2023-07-21T22:58:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53240.log 2023-07-21T22:58:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43705.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46900.log 2023-07-21T22:58:56.013 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43705.log.gz 2023-07-21T22:58:56.015 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61385.log 88.0% 2023-07-21T22:58:56.015 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53240.log.gz 2023-07-21T22:58:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46900.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46900.log.gz 2023-07-21T22:58:56.016 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53931.log 2023-07-21T22:58:56.018 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61385.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61385.log.gz 2023-07-21T22:58:56.018 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45969.log 2023-07-21T22:58:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56774.log 2023-07-21T22:58:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45969.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.53931.log.gz 2023-07-21T22:58:56.021 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45969.log.gzgzip 2023-07-21T22:58:56.023 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44461.log 2023-07-21T22:58:56.024 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47690.log 2023-07-21T22:58:56.024 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44461.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56774.log.gz 2023-07-21T22:58:56.025 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67878.log 2023-07-21T22:58:56.025 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44461.log.gz 2023-07-21T22:58:56.026 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66177.log 2023-07-21T22:58:56.026 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47690.log.gz 2023-07-21T22:58:56.027 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67878.log: gzip -5 --verbose -- 87.3% /var/log/ceph/ceph-client.admin.67852.log 2023-07-21T22:58:56.027 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67878.log.gz 2023-07-21T22:58:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66177.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66177.log.gz 2023-07-21T22:58:56.029 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58044.log 2023-07-21T22:58:56.030 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67852.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67852.log.gz 2023-07-21T22:58:56.031 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47390.log 2023-07-21T22:58:56.032 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58044.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67956.log 2023-07-21T22:58:56.032 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58044.log.gz 2023-07-21T22:58:56.034 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60356.log 2023-07-21T22:58:56.034 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47390.log.gz 2023-07-21T22:58:56.035 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67956.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49026.log 2023-07-21T22:58:56.035 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67956.log.gz 2023-07-21T22:58:56.037 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50338.log 2023-07-21T22:58:56.037 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60356.log.gz 2023-07-21T22:58:56.038 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49026.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51205.log 2023-07-21T22:58:56.038 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49026.log.gz 2023-07-21T22:58:56.040 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53445.log 2023-07-21T22:58:56.040 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50338.log.gz 2023-07-21T22:58:56.041 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51205.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51205.log.gz 2023-07-21T22:58:56.042 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56368.log 2023-07-21T22:58:56.042 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.53445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53445.log.gz 2023-07-21T22:58:56.043 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46268.log 2023-07-21T22:58:56.044 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56368.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56368.log.gz 2023-07-21T22:58:56.045 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68114.log 2023-07-21T22:58:56.046 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48892.log 2023-07-21T22:58:56.047 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.68114.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46268.log.gz 2023-07-21T22:58:56.048 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44025.log 2023-07-21T22:58:56.048 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68114.log.gz 2023-07-21T22:58:56.049 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48892.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47127.log 2023-07-21T22:58:56.049 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48892.log.gz 2023-07-21T22:58:56.051 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48380.log 2023-07-21T22:58:56.051 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44025.log.gz 2023-07-21T22:58:56.052 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47127.log: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49110.log 2023-07-21T22:58:56.052 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47127.log.gz 2023-07-21T22:58:56.054 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48380.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48380.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49250.log 2023-07-21T22:58:56.054 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-21T22:58:56.056 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49110.log: gzip -5 --verbose 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49110.log.gz 2023-07-21T22:58:56.056 INFO:teuthology.orchestra.run.smithi006.stderr: -- /var/log/ceph/ceph-client.admin.59339.log 2023-07-21T22:58:56.057 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49250.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49250.log.gz 2023-07-21T22:58:56.058 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57325.log 2023-07-21T22:58:56.059 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59339.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59339.log.gz 2023-07-21T22:58:56.060 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59830.log 2023-07-21T22:58:56.062 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57325.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57325.log.gz 2023-07-21T22:58:56.062 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49640.log 2023-07-21T22:58:56.063 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59830.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59830.log.gz 2023-07-21T22:58:56.063 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61489.log 2023-07-21T22:58:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49640.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49640.log.gz 2023-07-21T22:58:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59916.log 2023-07-21T22:58:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61489.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61489.log.gz 2023-07-21T22:58:56.070 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55037.log 2023-07-21T22:58:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59916.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59916.log.gz 2023-07-21T22:58:56.071 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64569.log 2023-07-21T22:58:56.072 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55037.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55037.log.gz 2023-07-21T22:58:56.072 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55334.log 2023-07-21T22:58:56.073 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64569.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64569.log.gz 2023-07-21T22:58:56.073 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61961.log 2023-07-21T22:58:56.075 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55334.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55334.log.gz 2023-07-21T22:58:56.075 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64085.log 2023-07-21T22:58:56.076 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61961.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61961.log.gz 2023-07-21T22:58:56.077 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54576.log 2023-07-21T22:58:56.078 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64085.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64085.log.gz 2023-07-21T22:58:56.079 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53440.log 2023-07-21T22:58:56.080 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54576.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54576.log.gz 2023-07-21T22:58:56.081 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-21T22:58:56.081 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.53440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53440.log.gz 2023-07-21T22:58:56.082 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46666.log 2023-07-21T22:58:56.084 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60460.log 2023-07-21T22:58:56.085 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46666.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46666.log.gz 2023-07-21T22:58:56.085 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57096.log 2023-07-21T22:58:56.087 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61705.log 2023-07-21T22:58:56.088 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57096.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60460.log.gz 2023-07-21T22:58:56.089 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57096.log.gz 2023-07-21T22:58:56.089 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-21T22:58:56.090 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48120.log 2023-07-21T22:58:56.091 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61705.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61705.log.gz 2023-07-21T22:58:56.092 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61177.log 2023-07-21T22:58:56.093 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58824.log 2023-07-21T22:58:56.093 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48120.log.gz 2023-07-21T22:58:56.094 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61177.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61177.log.gz 2023-07-21T22:58:56.095 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63630.log 2023-07-21T22:58:56.096 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.58824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58824.log.gz 2023-07-21T22:58:56.096 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59221.log 2023-07-21T22:58:56.098 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46479.log 2023-07-21T22:58:56.098 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63630.log.gz 2023-07-21T22:58:56.099 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59221.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57704.log 2023-07-21T22:58:56.100 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59221.log.gz 2023-07-21T22:58:56.101 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60869.log 88.2% 2023-07-21T22:58:56.101 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46479.log.gz 2023-07-21T22:58:56.103 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65491.log 2023-07-21T22:58:56.104 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60869.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57704.log.gz 2023-07-21T22:58:56.104 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56394.log 2023-07-21T22:58:56.104 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60869.log.gz 2023-07-21T22:58:56.106 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47206.log 2023-07-21T22:58:56.106 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65491.log.gz 2023-07-21T22:58:56.107 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56394.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.56394.log.gz 2023-07-21T22:58:56.108 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.67410.log 2023-07-21T22:58:56.109 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47206.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52138.log 2023-07-21T22:58:56.109 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47206.log.gz 2023-07-21T22:58:56.110 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67410.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47179.log 2023-07-21T22:58:56.111 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67410.log.gz 2023-07-21T22:58:56.112 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52138.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61989.log 2023-07-21T22:58:56.112 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52138.log.gz 2023-07-21T22:58:56.113 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47444.log 2023-07-21T22:58:56.114 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47179.log.gz 2023-07-21T22:58:56.115 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67339.log 2023-07-21T22:58:56.116 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47444.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61989.log.gz 2023-07-21T22:58:56.117 INFO:teuthology.orchestra.run.smithi006.stderr:gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47444.log.gz -5 2023-07-21T22:58:56.117 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.58572.log 2023-07-21T22:58:56.118 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67339.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67339.log.gz 2023-07-21T22:58:56.119 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52575.log 2023-07-21T22:58:56.120 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58572.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58572.log.gz 2023-07-21T22:58:56.120 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48998.log 2023-07-21T22:58:56.121 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52575.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46718.log 2023-07-21T22:58:56.122 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52575.log.gz 2023-07-21T22:58:56.123 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49796.log 2023-07-21T22:58:56.123 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48998.log.gz 2023-07-21T22:58:56.125 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46718.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58272.log 2023-07-21T22:58:56.125 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46718.log.gz 2023-07-21T22:58:56.126 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57931.log 2023-07-21T22:58:56.127 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49796.log.gz 2023-07-21T22:58:56.128 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58272.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67103.log 2023-07-21T22:58:56.128 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58272.log.gz 2023-07-21T22:58:56.130 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55165.log 2023-07-21T22:58:56.130 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57931.log.gz 2023-07-21T22:58:56.131 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67103.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67103.log.gz 2023-07-21T22:58:56.131 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47286.log 2023-07-21T22:58:56.133 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55165.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55165.log.gz 2023-07-21T22:58:56.133 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51023.log 2023-07-21T22:58:56.134 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47286.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47286.log.gz 2023-07-21T22:58:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47312.log 2023-07-21T22:58:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51023.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51023.log.gz 2023-07-21T22:58:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45395.log 2023-07-21T22:58:56.138 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47312.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47312.log.gz 2023-07-21T22:58:56.139 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47232.log 2023-07-21T22:58:56.140 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45395.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45395.log.gz 2023-07-21T22:58:56.140 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48240.log 2023-07-21T22:58:56.141 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47232.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47232.log.gz 2023-07-21T22:58:56.142 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61645.log 2023-07-21T22:58:56.143 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48240.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48240.log.gz 2023-07-21T22:58:56.144 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58011.log 2023-07-21T22:58:56.145 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61645.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61645.log.gz 2023-07-21T22:58:56.146 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56618.log 2023-07-21T22:58:56.147 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58011.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58011.log.gz 2023-07-21T22:58:56.148 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63194.log 2023-07-21T22:58:56.150 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56618.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56618.log.gz 2023-07-21T22:58:56.150 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61567.log 2023-07-21T22:58:56.151 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63194.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63194.log.gz 2023-07-21T22:58:56.152 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58650.log 2023-07-21T22:58:56.153 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61567.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61567.log.gz 2023-07-21T22:58:56.154 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54165.log 2023-07-21T22:58:56.155 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58650.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58650.log.gz 2023-07-21T22:58:56.156 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65718.log 2023-07-21T22:58:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54165.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54165.log.gz 2023-07-21T22:58:56.157 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51127.log 2023-07-21T22:58:56.158 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65718.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.65718.log.gz 2023-07-21T22:58:56.159 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61907.log 2023-07-21T22:58:56.160 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51127.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51127.log.gz 2023-07-21T22:58:56.161 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63708.log 2023-07-21T22:58:56.162 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61907.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61907.log.gz 2023-07-21T22:58:56.163 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61333.log 2023-07-21T22:58:56.164 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63708.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.63708.log.gz 2023-07-21T22:58:56.165 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45449.log 2023-07-21T22:58:56.166 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61333.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61333.log.gz 2023-07-21T22:58:56.167 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47794.log 2023-07-21T22:58:56.168 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45449.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45449.log.gz 2023-07-21T22:58:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62311.log 2023-07-21T22:58:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47794.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47794.log.gz 2023-07-21T22:58:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63682.log 2023-07-21T22:58:56.172 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52862.log 2023-07-21T22:58:56.173 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63682.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62311.log.gz 2023-07-21T22:58:56.174 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58142.log 2023-07-21T22:58:56.174 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63682.log.gz 2023-07-21T22:58:56.175 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52862.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55854.log 2023-07-21T22:58:56.175 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52862.log.gz 2023-07-21T22:58:56.177 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58142.log: gzip -5 --verbose 88.7% -- /var/log/ceph/ceph-client.admin.47004.log -- replaced with /var/log/ceph/ceph-client.admin.58142.log.gz 2023-07-21T22:58:56.177 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-21T22:58:56.178 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55854.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44038.log 2023-07-21T22:58:56.178 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55854.log.gz 2023-07-21T22:58:56.179 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47004.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47004.log.gz 2023-07-21T22:58:56.180 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67024.log 2023-07-21T22:58:56.182 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46216.log 2023-07-21T22:58:56.182 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67024.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44038.log.gz 2023-07-21T22:58:56.183 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67024.log.gz 2023-07-21T22:58:56.183 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55115.log 2023-07-21T22:58:56.185 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46216.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52346.log 2023-07-21T22:58:56.185 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46216.log.gz 2023-07-21T22:58:56.186 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64671.log 2023-07-21T22:58:56.187 INFO:teuthology.orchestra.run.smithi006.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.55115.log.gz 2023-07-21T22:58:56.188 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56133.log 2023-07-21T22:58:56.189 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64671.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52346.log.gz 2023-07-21T22:58:56.190 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose 87.6% -- /var/log/ceph/ceph-client.0.62492.log -- replaced with /var/log/ceph/ceph-client.admin.64671.log.gz 2023-07-21T22:58:56.190 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-21T22:58:56.191 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56133.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44045.log 2023-07-21T22:58:56.191 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56133.log.gz 2023-07-21T22:58:56.192 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.62492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62492.log.gz 2023-07-21T22:58:56.193 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67050.log 2023-07-21T22:58:56.194 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44045.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44045.log.gz -5 2023-07-21T22:58:56.195 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50631.log 2023-07-21T22:58:56.196 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67050.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60538.log 2023-07-21T22:58:56.196 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67050.log.gz 2023-07-21T22:58:56.197 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57957.log 2023-07-21T22:58:56.197 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50631.log.gz 2023-07-21T22:58:56.199 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46978.log 2023-07-21T22:58:56.200 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57957.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60538.log.gz 2023-07-21T22:58:56.201 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49276.log 2023-07-21T22:58:56.201 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57957.log.gz 2023-07-21T22:58:56.202 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46978.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46978.log.gz 2023-07-21T22:58:56.204 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55646.log 2023-07-21T22:58:56.206 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49276.log: gzip -5 88.1% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.49276.log.gz /var/log/ceph/ceph-client.admin.60408.log 2023-07-21T22:58:56.206 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-21T22:58:56.207 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55646.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65955.log 2023-07-21T22:58:56.207 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55646.log.gz 2023-07-21T22:58:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47030.log 2023-07-21T22:58:56.209 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60408.log.gz 2023-07-21T22:58:56.210 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48090.log 2023-07-21T22:58:56.211 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65955.log.gz 2023-07-21T22:58:56.212 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47030.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67313.log 2023-07-21T22:58:56.212 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47030.log.gz 2023-07-21T22:58:56.213 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48090.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48090.log.gz 2023-07-21T22:58:56.213 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58076.log 2023-07-21T22:58:56.215 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55218.log 2023-07-21T22:58:56.216 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58076.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67313.log.gz 2023-07-21T22:58:56.217 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50598.log 2023-07-21T22:58:56.217 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58076.log.gz 2023-07-21T22:58:56.217 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.55218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55218.log.gz 2023-07-21T22:58:56.218 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59626.log 2023-07-21T22:58:56.220 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50598.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.50598.log.gz --verbose 2023-07-21T22:58:56.220 INFO:teuthology.orchestra.run.smithi006.stderr: -- /var/log/ceph/ceph-client.admin.62764.log 2023-07-21T22:58:56.221 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59626.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59626.log.gz 2023-07-21T22:58:56.222 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56994.log 2023-07-21T22:58:56.223 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62764.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56974.log 2023-07-21T22:58:56.223 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62764.log.gz 2023-07-21T22:58:56.224 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56994.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.56994.log.gz 2023-07-21T22:58:56.225 INFO:teuthology.orchestra.run.smithi006.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68086.log 2023-07-21T22:58:56.226 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.56974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44043.log 2023-07-21T22:58:56.227 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56974.log.gz 2023-07-21T22:58:56.228 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.68086.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66933.log 2023-07-21T22:58:56.228 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68086.log.gz 2023-07-21T22:58:56.229 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67261.log 2023-07-21T22:58:56.230 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44043.log.gz 2023-07-21T22:58:56.231 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47820.log 2023-07-21T22:58:56.232 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67261.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66933.log.gz 2023-07-21T22:58:56.233 INFO:teuthology.orchestra.run.smithi006.stderr:gzip 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.67261.log.gz --verbose 2023-07-21T22:58:56.233 INFO:teuthology.orchestra.run.smithi006.stderr: -- /var/log/ceph/ceph-client.0.51386.log 2023-07-21T22:58:56.234 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47820.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47820.log.gz 2023-07-21T22:58:56.235 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54035.log 2023-07-21T22:58:56.236 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.51386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55880.log 2023-07-21T22:58:56.237 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51386.log.gz 2023-07-21T22:58:56.237 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54035.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54035.log.gz 2023-07-21T22:58:56.238 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66985.log 2023-07-21T22:58:56.239 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55880.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55880.log.gz 2023-07-21T22:58:56.240 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56696.log 2023-07-21T22:58:56.242 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66985.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56722.log 2023-07-21T22:58:56.242 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66985.log.gz 2023-07-21T22:58:56.243 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51257.log 2023-07-21T22:58:56.243 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56696.log.gz 2023-07-21T22:58:56.245 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53878.log 2023-07-21T22:58:56.246 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51257.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56722.log.gz 2023-07-21T22:58:56.247 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50943.log 2023-07-21T22:58:56.247 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51257.log.gz 2023-07-21T22:58:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53878.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53878.log.gz 2023-07-21T22:58:56.248 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44254.log 2023-07-21T22:58:56.249 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50943.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50943.log.gz 2023-07-21T22:58:56.250 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47664.log 2023-07-21T22:58:56.251 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44254.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50409.log 2023-07-21T22:58:56.251 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44254.log.gz 2023-07-21T22:58:56.253 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47664.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47664.log.gz -5 2023-07-21T22:58:56.253 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49853.log 2023-07-21T22:58:56.255 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51993.log 2023-07-21T22:58:56.255 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49853.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50409.log.gz 2023-07-21T22:58:56.256 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48840.log 2023-07-21T22:58:56.256 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49853.log.gz 2023-07-21T22:58:56.258 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51993.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51993.log.gz -5 2023-07-21T22:58:56.258 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.59195.log 2023-07-21T22:58:56.259 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48840.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48840.log.gz 2023-07-21T22:58:56.259 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52372.log 2023-07-21T22:58:56.261 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59195.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59195.log.gz -5 2023-07-21T22:58:56.261 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.66798.log 2023-07-21T22:58:56.263 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52372.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52372.log.gz -5 2023-07-21T22:58:56.263 INFO:teuthology.orchestra.run.smithi006.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52758.log 2023-07-21T22:58:56.264 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60066.log 2023-07-21T22:58:56.264 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66798.log.gz 2023-07-21T22:58:56.265 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52758.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52758.log.gz 2023-07-21T22:58:56.266 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55828.log 2023-07-21T22:58:56.267 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55089.log 2023-07-21T22:58:56.267 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60066.log.gz 2023-07-21T22:58:56.268 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55828.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55828.log.gz 2023-07-21T22:58:56.269 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67129.log 2023-07-21T22:58:56.270 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45813.log 2023-07-21T22:58:56.271 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55089.log.gz 2023-07-21T22:58:56.271 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67129.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67129.log.gz 2023-07-21T22:58:56.272 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44448.log 2023-07-21T22:58:56.273 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45813.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45813.log.gz 2023-07-21T22:58:56.274 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48970.log 2023-07-21T22:58:56.275 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44448.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44448.log.gz 2023-07-21T22:58:56.275 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67617.log 2023-07-21T22:58:56.276 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48970.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48970.log.gz 2023-07-21T22:58:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57853.log 2023-07-21T22:58:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67617.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67617.log.gz 2023-07-21T22:58:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62964.log 2023-07-21T22:58:56.280 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56748.log 2023-07-21T22:58:56.281 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57853.log: /var/log/ceph/ceph-client.admin.62964.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57853.log.gz 2023-07-21T22:58:56.282 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56510.log 2023-07-21T22:58:56.282 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62964.log.gz 2023-07-21T22:58:56.283 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56748.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53813.log 2023-07-21T22:58:56.283 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56748.log.gz 2023-07-21T22:58:56.284 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56510.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-21T22:58:56.285 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56510.log.gz 2023-07-21T22:58:56.286 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53813.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53813.log.gz 2023-07-21T22:58:56.286 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57626.log 2023-07-21T22:58:56.287 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-07-21T22:58:56.289 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48588.log 2023-07-21T22:58:56.290 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57626.log.gz 2023-07-21T22:58:56.292 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52549.log 2023-07-21T22:58:56.293 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48588.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48588.log.gz 2023-07-21T22:58:56.294 INFO:teuthology.orchestra.run.smithi006.stderr: 90.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-21T22:58:56.296 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51333.log 2023-07-21T22:58:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50286.log 2023-07-21T22:58:56.297 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52549.log.gz 2023-07-21T22:58:56.299 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45033.log 2023-07-21T22:58:56.300 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51333.log.gz 2023-07-21T22:58:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50286.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50286.log.gz 2023-07-21T22:58:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48324.log 2023-07-21T22:58:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45033.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57351.log 2023-07-21T22:58:56.303 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45033.log.gz 2023-07-21T22:58:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62023.log 2023-07-21T22:58:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57351.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48324.log.gz 2023-07-21T22:58:56.306 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57351.log.gz 2023-07-21T22:58:56.308 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66097.log 2023-07-21T22:58:56.309 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62023.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.62023.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.63325.log 2023-07-21T22:58:56.309 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-21T22:58:56.311 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59600.log 2023-07-21T22:58:56.312 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63325.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66097.log.gz 2023-07-21T22:58:56.312 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63325.log.gz 2023-07-21T22:58:56.314 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56562.log 2023-07-21T22:58:56.315 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59600.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59600.log.gz 2023-07-21T22:58:56.315 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65387.log 2023-07-21T22:58:56.317 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56562.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-07-21T22:58:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65387.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56562.log.gz 2023-07-21T22:58:56.319 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65387.log.gz 2023-07-21T22:58:56.320 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63075.log 2023-07-21T22:58:56.321 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65309.log 2023-07-21T22:58:56.323 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63075.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63075.log.gz 2023-07-21T22:58:56.325 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54747.log 2023-07-21T22:58:56.327 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65309.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65309.log.gz 2023-07-21T22:58:56.328 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67233.log 2023-07-21T22:58:56.330 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54747.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54747.log.gz 2023-07-21T22:58:56.332 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62874.log 2023-07-21T22:58:56.335 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67233.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67233.log.gz 2023-07-21T22:58:56.336 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49082.log 2023-07-21T22:58:56.337 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62874.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.62874.log.gz 2023-07-21T22:58:56.339 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63049.log 2023-07-21T22:58:56.341 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49082.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49082.log.gz 2023-07-21T22:58:56.343 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54087.log 2023-07-21T22:58:56.345 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63049.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.63049.log.gz 2023-07-21T22:58:56.346 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43653.log 2023-07-21T22:58:56.348 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54087.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54087.log.gz 2023-07-21T22:58:56.350 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63767.log 2023-07-21T22:58:56.352 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43653.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43653.log.gz 2023-07-21T22:58:56.354 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51590.log 2023-07-21T22:58:56.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63767.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63767.log.gz 2023-07-21T22:58:56.357 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43445.log 2023-07-21T22:58:56.359 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51590.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51590.log.gz 2023-07-21T22:58:56.361 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54139.log 2023-07-21T22:58:56.363 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43445.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43445.log.gz 2023-07-21T22:58:56.365 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67384.log 2023-07-21T22:58:56.367 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54139.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54139.log.gz 2023-07-21T22:58:56.369 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48156.log 2023-07-21T22:58:56.371 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67384.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67384.log.gz 2023-07-21T22:58:56.373 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43835.log 2023-07-21T22:58:56.375 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48156.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48156.log.gz 2023-07-21T22:58:56.376 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50461.log 2023-07-21T22:58:56.378 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43835.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43835.log.gz 2023-07-21T22:58:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49138.log 2023-07-21T22:58:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50461.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50461.log.gz 2023-07-21T22:58:56.384 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65981.log 2023-07-21T22:58:56.385 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49138.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49138.log.gz 2023-07-21T22:58:56.387 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48352.log 2023-07-21T22:58:56.389 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65981.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65981.log.gz 2023-07-21T22:58:56.391 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55587.log 2023-07-21T22:58:56.394 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48352.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48352.log.gz 2023-07-21T22:58:56.395 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67207.log 2023-07-21T22:58:56.397 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55587.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55587.log.gz 2023-07-21T22:58:56.399 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50383.log 2023-07-21T22:58:56.401 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67207.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67207.log.gz 2023-07-21T22:58:56.403 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52112.log 2023-07-21T22:58:56.406 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50383.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50383.log.gz 2023-07-21T22:58:56.407 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62363.log 2023-07-21T22:58:56.409 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52112.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52112.log.gz 2023-07-21T22:58:56.411 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56003.log 2023-07-21T22:58:56.413 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62363.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62363.log.gz 2023-07-21T22:58:56.415 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60200.log 2023-07-21T22:58:56.417 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56003.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56003.log.gz 2023-07-21T22:58:56.419 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61007.log 2023-07-21T22:58:56.420 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60200.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60200.log.gz 2023-07-21T22:58:56.423 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52320.log 2023-07-21T22:58:56.424 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61007.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61007.log.gz 2023-07-21T22:58:56.426 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63604.log 2023-07-21T22:58:56.428 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52320.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52320.log.gz 2023-07-21T22:58:56.430 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67488.log 2023-07-21T22:58:56.432 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63604.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63604.log.gz 2023-07-21T22:58:56.434 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46133.log 2023-07-21T22:58:56.436 INFO:teuthology.orchestra.run.smithi161.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-07-21T22:58:56.436 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67488.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67488.log.gz 2023-07-21T22:58:56.438 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55213.log 2023-07-21T22:58:56.440 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46133.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46133.log.gz 2023-07-21T22:58:56.442 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51967.log 2023-07-21T22:58:56.443 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.55213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.55213.log.gz 2023-07-21T22:58:56.445 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54458.log 2023-07-21T22:58:56.447 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51967.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51967.log.gz 2023-07-21T22:58:56.449 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45085.log 2023-07-21T22:58:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54458.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54458.log.gz 2023-07-21T22:58:56.453 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51530.log 2023-07-21T22:58:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45085.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45085.log.gz 2023-07-21T22:58:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43549.log 2023-07-21T22:58:56.459 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51530.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51530.log.gz 2023-07-21T22:58:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54931.log 2023-07-21T22:58:56.466 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43549.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43549.log.gz 2023-07-21T22:58:56.466 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57827.log 2023-07-21T22:58:56.467 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54931.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54931.log.gz 2023-07-21T22:58:56.469 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56448.log 2023-07-21T22:58:56.471 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57827.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57827.log.gz 2023-07-21T22:58:56.473 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66654.log 2023-07-21T22:58:56.475 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56448.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56448.log.gz 2023-07-21T22:58:56.476 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60382.log 2023-07-21T22:58:56.478 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66654.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66654.log.gz 2023-07-21T22:58:56.480 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60922.log 2023-07-21T22:58:56.483 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60382.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60382.log.gz 2023-07-21T22:58:56.484 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62558.log 2023-07-21T22:58:56.486 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60922.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60922.log.gz 2023-07-21T22:58:56.488 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53162.log 2023-07-21T22:58:56.490 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62558.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.62558.log.gz 2023-07-21T22:58:56.492 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57905.log 2023-07-21T22:58:56.494 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53162.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53162.log.gz 2023-07-21T22:58:56.496 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59273.log 2023-07-21T22:58:56.498 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57905.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57905.log.gz 2023-07-21T22:58:56.500 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56159.log 2023-07-21T22:58:56.502 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59273.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59273.log.gz 2023-07-21T22:58:56.504 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49933.log 2023-07-21T22:58:56.506 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56159.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56159.log.gz 2023-07-21T22:58:56.508 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44044.log 2023-07-21T22:58:56.510 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49933.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49933.log.gz 2023-07-21T22:58:56.511 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66533.log 2023-07-21T22:58:56.514 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44044.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44044.log.gz 2023-07-21T22:58:56.514 INFO:teuthology.orchestra.run.smithi161.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-07-21T22:58:56.515 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63220.log 2023-07-21T22:58:56.517 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.66533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.66533.log.gz 2023-07-21T22:58:56.519 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63481.log 2023-07-21T22:58:56.521 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63220.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63220.log.gz 2023-07-21T22:58:56.522 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59697.log 2023-07-21T22:58:56.524 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63481.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63481.log.gz 2023-07-21T22:58:56.526 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61737.log 2023-07-21T22:58:56.528 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59697.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59697.log.gz 2023-07-21T22:58:56.530 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37384.log 2023-07-21T22:58:56.532 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61737.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61737.log.gz 2023-07-21T22:58:56.534 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52268.log 2023-07-21T22:58:56.536 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37384.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37384.log.gz 2023-07-21T22:58:56.538 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56029.log 2023-07-21T22:58:56.540 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52268.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52268.log.gz 2023-07-21T22:58:56.541 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47742.log 2023-07-21T22:58:56.543 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56029.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56029.log.gz 2023-07-21T22:58:56.545 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66151.log 2023-07-21T22:58:56.547 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47742.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47742.log.gz 2023-07-21T22:58:56.549 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67696.log 2023-07-21T22:58:56.551 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66151.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66151.log.gz 2023-07-21T22:58:56.552 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52216.log 2023-07-21T22:58:56.555 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67696.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67696.log.gz 2023-07-21T22:58:56.556 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43523.log 2023-07-21T22:58:56.559 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52216.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52216.log.gz 2023-07-21T22:58:56.560 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47532.log 2023-07-21T22:58:56.562 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43523.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43523.log.gz 2023-07-21T22:58:56.564 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37631.log 2023-07-21T22:58:56.566 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47532.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47532.log.gz 2023-07-21T22:58:56.568 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56476.log 2023-07-21T22:58:56.570 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.37631.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37631.log.gz 2023-07-21T22:58:56.572 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65034.log 2023-07-21T22:58:56.574 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.56476.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56476.log.gz 2023-07-21T22:58:56.576 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60434.log 2023-07-21T22:58:56.578 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65034.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65034.log.gz 2023-07-21T22:58:56.580 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59299.log 2023-07-21T22:58:56.582 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60434.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60434.log.gz 2023-07-21T22:58:56.583 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65413.log 2023-07-21T22:58:56.586 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59299.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59299.log.gz 2023-07-21T22:58:56.588 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52944.log 2023-07-21T22:58:56.589 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65413.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65413.log.gz 2023-07-21T22:58:56.591 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49588.log 2023-07-21T22:58:56.593 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52944.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52944.log.gz 2023-07-21T22:58:56.595 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55476.log 2023-07-21T22:58:56.597 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49588.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49588.log.gz 2023-07-21T22:58:56.599 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53136.log 2023-07-21T22:58:56.601 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55476.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55476.log.gz 2023-07-21T22:58:56.602 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47988.log 2023-07-21T22:58:56.605 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53136.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53136.log.gz 2023-07-21T22:58:56.606 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58728.log 2023-07-21T22:58:56.608 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47988.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47988.log.gz 2023-07-21T22:58:56.610 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55776.log 2023-07-21T22:58:56.612 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58728.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.58728.log.gz 2023-07-21T22:58:56.614 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46081.log 2023-07-21T22:58:56.617 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55776.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55776.log.gz 2023-07-21T22:58:56.618 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60512.log 2023-07-21T22:58:56.622 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46081.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46081.log.gz 2023-07-21T22:58:56.622 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57377.log 2023-07-21T22:58:56.624 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60512.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60512.log.gz 2023-07-21T22:58:56.626 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51564.log 2023-07-21T22:58:56.626 INFO:teuthology.orchestra.run.smithi161.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-07-21T22:58:56.628 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57377.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57377.log.gz 2023-07-21T22:58:56.629 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54983.log 2023-07-21T22:58:56.631 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51564.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51564.log.gz 2023-07-21T22:58:56.633 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57403.log 2023-07-21T22:58:56.635 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54983.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54983.log.gz 2023-07-21T22:58:56.637 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46770.log 2023-07-21T22:58:56.638 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57403.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57403.log.gz 2023-07-21T22:58:56.640 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51941.log 2023-07-21T22:58:56.643 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46770.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46770.log.gz 2023-07-21T22:58:56.644 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59777.log 2023-07-21T22:58:56.646 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51941.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51941.log.gz 2023-07-21T22:58:56.648 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60278.log 2023-07-21T22:58:56.650 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59777.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59777.log.gz 2023-07-21T22:58:56.652 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43004.log 2023-07-21T22:58:56.654 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60278.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60278.log.gz 2023-07-21T22:58:56.656 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63403.log 2023-07-21T22:58:56.658 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43004.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43004.log.gz 2023-07-21T22:58:56.659 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63127.log 2023-07-21T22:58:56.662 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63403.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63403.log.gz 2023-07-21T22:58:56.663 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50104.log 2023-07-21T22:58:56.665 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63127.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63127.log.gz 2023-07-21T22:58:56.667 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53318.log 2023-07-21T22:58:56.669 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50104.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50104.log.gz 2023-07-21T22:58:56.672 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52242.log 2023-07-21T22:58:56.673 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53318.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53318.log.gz 2023-07-21T22:58:56.675 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46107.log 2023-07-21T22:58:56.677 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52242.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52242.log.gz 2023-07-21T22:58:56.679 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54957.log 2023-07-21T22:58:56.681 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46107.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46107.log.gz 2023-07-21T22:58:56.682 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54682.log 2023-07-21T22:58:56.684 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54957.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54957.log.gz 2023-07-21T22:58:56.686 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60895.log 2023-07-21T22:58:56.688 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54682.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54682.log.gz 2023-07-21T22:58:56.690 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66307.log 2023-07-21T22:58:56.692 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60895.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.60895.log.gz 2023-07-21T22:58:56.694 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64699.log 2023-07-21T22:58:56.696 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66307.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66307.log.gz 2023-07-21T22:58:56.697 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53110.log 2023-07-21T22:58:56.699 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64699.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64699.log.gz 2023-07-21T22:58:56.701 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46242.log 2023-07-21T22:58:56.704 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53110.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53110.log.gz 2023-07-21T22:58:56.705 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54366.log 2023-07-21T22:58:56.707 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46242.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46242.log.gz 2023-07-21T22:58:56.709 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53681.log 2023-07-21T22:58:56.711 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54366.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54366.log.gz 2023-07-21T22:58:56.712 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43497.log 2023-07-21T22:58:56.715 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53681.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53681.log.gz 2023-07-21T22:58:56.716 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50182.log 2023-07-21T22:58:56.719 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43497.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43497.log.gz 2023-07-21T22:58:56.720 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52692.log 2023-07-21T22:58:56.722 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50182.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50182.log.gz 2023-07-21T22:58:56.724 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51049.log 2023-07-21T22:58:56.726 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52692.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52692.log.gz 2023-07-21T22:58:56.728 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65903.log 2023-07-21T22:58:56.730 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51049.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51049.log.gz 2023-07-21T22:58:56.732 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65692.log 2023-07-21T22:58:56.734 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65903.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65903.log.gz 2023-07-21T22:58:56.736 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45423.log 2023-07-21T22:58:56.736 INFO:teuthology.orchestra.run.smithi006.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-07-21T22:58:56.738 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57756.log 2023-07-21T22:58:56.738 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65692.log.gz 2023-07-21T22:58:56.739 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45423.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45423.log.gz 2023-07-21T22:58:56.741 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60590.log 2023-07-21T22:58:56.743 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57756.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47612.log 2023-07-21T22:58:56.743 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57756.log.gz 2023-07-21T22:58:56.744 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55906.log 2023-07-21T22:58:56.746 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47612.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47612.log.gz 2023-07-21T22:58:56.746 INFO:teuthology.orchestra.run.smithi006.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.60590.log.gz 2023-07-21T22:58:56.747 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60564.log 2023-07-21T22:58:56.749 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58895.log 2023-07-21T22:58:56.749 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55906.log.gz 2023-07-21T22:58:56.751 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47364.log 2023-07-21T22:58:56.751 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58895.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60564.log.gz 2023-07-21T22:58:56.752 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58895.log.gz 2023-07-21T22:58:56.753 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67287.log 2023-07-21T22:58:56.755 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66604.log 2023-07-21T22:58:56.755 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47364.log.gz 2023-07-21T22:58:56.757 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67287.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43822.log 2023-07-21T22:58:56.757 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67287.log.gz 2023-07-21T22:58:56.758 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66604.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.66604.log.gz 2023-07-21T22:58:56.760 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43679.log 2023-07-21T22:58:56.762 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46692.log 2023-07-21T22:58:56.762 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43822.log.gz 2023-07-21T22:58:56.763 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46926.log 2023-07-21T22:58:56.764 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46692.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43679.log.gz 2023-07-21T22:58:56.765 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46692.log.gz 2023-07-21T22:58:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53787.log 2023-07-21T22:58:56.767 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66281.log 2023-07-21T22:58:56.768 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53787.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46926.log.gz 2023-07-21T22:58:56.769 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53787.log.gz 2023-07-21T22:58:56.769 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55450.log 2023-07-21T22:58:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66037.log 2023-07-21T22:58:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55450.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66281.log.gz 2023-07-21T22:58:56.773 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55450.log.gz 2023-07-21T22:58:56.773 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43783.log 2023-07-21T22:58:56.775 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45839.log 2023-07-21T22:58:56.776 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43783.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66037.log.gz 2023-07-21T22:58:56.777 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43783.log.gz 2023-07-21T22:58:56.777 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65465.log 2023-07-21T22:58:56.779 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46029.log 2023-07-21T22:58:56.780 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65465.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45839.log.gz 2023-07-21T22:58:56.781 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65465.log.gz 2023-07-21T22:58:56.781 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66123.log 2023-07-21T22:58:56.783 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59444.log 2023-07-21T22:58:56.784 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66123.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46029.log.gz 2023-07-21T22:58:56.785 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66123.log.gz 2023-07-21T22:58:56.786 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48484.log 2023-07-21T22:58:56.788 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52469.log 2023-07-21T22:58:56.788 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48484.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59444.log.gz 2023-07-21T22:58:56.789 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48484.log.gz 2023-07-21T22:58:56.790 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51915.log 2023-07-21T22:58:56.792 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64760.log 2023-07-21T22:58:56.793 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51915.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52469.log.gz 2023-07-21T22:58:56.793 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51915.log.gz 2023-07-21T22:58:56.794 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64503.log 2023-07-21T22:58:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55009.log 2023-07-21T22:58:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64503.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64760.log.gz 2023-07-21T22:58:56.798 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64503.log.gz 2023-07-21T22:58:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45288.log 2023-07-21T22:58:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49536.log 2023-07-21T22:58:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45288.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55009.log.gz 2023-07-21T22:58:56.801 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45288.log.gz 2023-07-21T22:58:56.802 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49432.log 2023-07-21T22:58:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63101.log 2023-07-21T22:58:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49432.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49536.log.gz 2023-07-21T22:58:56.806 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49432.log.gz 2023-07-21T22:58:56.807 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62259.log 2023-07-21T22:58:56.808 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61118.log 2023-07-21T22:58:56.810 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.62259.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62259.log.gz 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63101.log.gz 2023-07-21T22:58:56.810 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-21T22:58:56.811 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53214.log 2023-07-21T22:58:56.813 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44668.log 2023-07-21T22:58:56.814 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61118.log.gz 2023-07-21T22:58:56.815 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.53214.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53214.log.gz 2023-07-21T22:58:56.815 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64295.log 2023-07-21T22:58:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63351.log 2023-07-21T22:58:56.818 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.64295.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44668.log.gz 2023-07-21T22:58:56.818 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64295.log.gz 2023-07-21T22:58:56.819 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55063.log 2023-07-21T22:58:56.821 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58702.log 2023-07-21T22:58:56.822 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55063.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63351.log.gz 2023-07-21T22:58:56.822 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55063.log.gz 2023-07-21T22:58:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61855.log 2023-07-21T22:58:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43055.log 2023-07-21T22:58:56.826 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61855.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58702.log.gz 2023-07-21T22:58:56.827 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61855.log.gz 2023-07-21T22:58:56.827 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49194.log 2023-07-21T22:58:56.829 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59574.log 2023-07-21T22:58:56.830 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49194.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43055.log.gz 2023-07-21T22:58:56.831 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49194.log.gz 2023-07-21T22:58:56.832 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65640.log 2023-07-21T22:58:56.833 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64550.log 2023-07-21T22:58:56.834 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65640.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59574.log.gz 2023-07-21T22:58:56.836 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65640.log.gz 2023-07-21T22:58:56.836 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55672.log 2023-07-21T22:58:56.837 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.64550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54602.log 2023-07-21T22:58:56.838 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.64550.log.gz/var/log/ceph/ceph-client.admin.55672.log: 2023-07-21T22:58:56.839 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55672.log.gz 2023-07-21T22:58:56.839 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45709.log 2023-07-21T22:58:56.841 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67644.log 2023-07-21T22:58:56.842 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.45709.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54602.log.gz 2023-07-21T22:58:56.843 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45709.log.gz 2023-07-21T22:58:56.843 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67181.log 2023-07-21T22:58:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50051.log 2023-07-21T22:58:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67181.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67644.log.gz 2023-07-21T22:58:56.848 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67181.log.gz 2023-07-21T22:58:56.848 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67670.log 2023-07-21T22:58:56.849 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66855.log 2023-07-21T22:58:56.850 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4%/var/log/ceph/ceph-client.admin.67670.log: -- replaced with /var/log/ceph/ceph-client.admin.50051.log.gz 2023-07-21T22:58:56.851 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67670.log.gz 2023-07-21T22:58:56.851 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44039.log 2023-07-21T22:58:56.853 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54210.log 2023-07-21T22:58:56.854 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66855.log: /var/log/ceph/ceph-client.admin.44039.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66855.log.gz 2023-07-21T22:58:56.855 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44039.log.gz 2023-07-21T22:58:56.855 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44720.log 2023-07-21T22:58:56.857 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50775.log 2023-07-21T22:58:56.858 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44720.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54210.log.gz 2023-07-21T22:58:56.859 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44720.log.gz 2023-07-21T22:58:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46952.log 2023-07-21T22:58:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52190.log 2023-07-21T22:58:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46952.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50775.log.gz 2023-07-21T22:58:56.863 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46952.log.gz 2023-07-21T22:58:56.864 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54801.log 2023-07-21T22:58:56.866 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63943.log 2023-07-21T22:58:56.867 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.54801.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52190.log.gz 2023-07-21T22:58:56.868 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54801.log.gz 2023-07-21T22:58:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57242.log 2023-07-21T22:58:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60807.log 2023-07-21T22:58:56.871 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57242.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63943.log.gz 2023-07-21T22:58:56.871 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57242.log.gz 2023-07-21T22:58:56.872 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65588.log 2023-07-21T22:58:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60705.log 2023-07-21T22:58:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.65588.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60807.log.gz 2023-07-21T22:58:56.875 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65588.log.gz 2023-07-21T22:58:56.876 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44462.log 2023-07-21T22:58:56.878 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60092.log 2023-07-21T22:58:56.878 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44462.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60705.log.gz 2023-07-21T22:58:56.879 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44462.log.gz 2023-07-21T22:58:56.880 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64111.log 2023-07-21T22:58:56.882 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63656.log 2023-07-21T22:58:56.883 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.60092.log: /var/log/ceph/ceph-client.admin.64111.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60092.log.gz 2023-07-21T22:58:56.884 INFO:teuthology.orchestra.run.smithi006.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.64111.log.gz 2023-07-21T22:58:56.884 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46562.log 2023-07-21T22:58:56.886 INFO:teuthology.orchestra.run.smithi161.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-07-21T22:58:56.886 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58194.log 2023-07-21T22:58:56.887 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.46562.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63656.log.gz 2023-07-21T22:58:56.888 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46562.log.gz 2023-07-21T22:58:56.888 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52497.log 2023-07-21T22:58:56.890 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61229.log 2023-07-21T22:58:56.892 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52497.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58194.log.gz 2023-07-21T22:58:56.892 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52497.log.gz 2023-07-21T22:58:56.893 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61059.log 2023-07-21T22:58:56.894 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59723.log 2023-07-21T22:58:56.895 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.61059.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.61229.log.gz 2023-07-21T22:58:56.896 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61059.log.gz 2023-07-21T22:58:56.896 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67565.log 2023-07-21T22:58:56.898 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.59723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57469.log 2023-07-21T22:58:56.899 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.67565.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59723.log.gz 2023-07-21T22:58:56.900 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67565.log.gz 2023-07-21T22:58:56.900 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48616.log 2023-07-21T22:58:56.902 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.57469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43823.log 2023-07-21T22:58:56.903 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48616.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57469.log.gz 2023-07-21T22:58:56.904 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48616.log.gz 2023-07-21T22:58:56.904 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49879.log 2023-07-21T22:58:56.906 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52085.log 2023-07-21T22:58:56.907 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.49879.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43823.log.gz 2023-07-21T22:58:56.908 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49879.log.gz 2023-07-21T22:58:56.909 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54236.log 2023-07-21T22:58:56.910 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50917.log 2023-07-21T22:58:56.911 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.52085.log: /var/log/ceph/ceph-client.admin.54236.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52085.log.gz 2023-07-21T22:58:56.912 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54236.log.gz 2023-07-21T22:58:56.913 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63377.log 2023-07-21T22:58:56.915 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58829.log 2023-07-21T22:58:56.915 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.63377.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50917.log.gz 2023-07-21T22:58:56.916 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63377.log.gz 2023-07-21T22:58:56.917 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50487.log 2023-07-21T22:58:56.919 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.58829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51075.log 2023-07-21T22:58:56.919 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.58829.log.gz 2023-07-21T22:58:56.920 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.50487.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50487.log.gz 2023-07-21T22:58:56.920 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48510.log 2023-07-21T22:58:56.922 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.51075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55284.log 2023-07-21T22:58:56.923 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48510.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51075.log.gz 2023-07-21T22:58:56.924 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48510.log.gz 2023-07-21T22:58:56.924 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43833.log 2023-07-21T22:58:56.926 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.55284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58328.log 2023-07-21T22:58:56.927 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43833.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55284.log.gz 2023-07-21T22:58:56.928 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43833.log.gz 2023-07-21T22:58:56.929 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43731.log 2023-07-21T22:58:56.930 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.58328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44981.log 2023-07-21T22:58:56.931 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43731.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58328.log.gz 2023-07-21T22:58:56.933 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43731.log.gz 2023-07-21T22:58:56.933 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43231.log 2023-07-21T22:58:56.935 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44434.log 2023-07-21T22:58:56.936 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43231.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44981.log.gz 2023-07-21T22:58:56.937 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43231.log.gz 2023-07-21T22:58:56.937 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47716.log 2023-07-21T22:58:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.44434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48536.log 2023-07-21T22:58:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.47716.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44434.log.gz 2023-07-21T22:58:56.941 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47716.log.gz 2023-07-21T22:58:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48406.log 2023-07-21T22:58:56.943 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66716.log 2023-07-21T22:58:56.944 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.48406.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48536.log.gz 2023-07-21T22:58:56.945 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48406.log.gz 2023-07-21T22:58:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45259.log 2023-07-21T22:58:56.947 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.66716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43757.log 2023-07-21T22:58:56.948 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66716.log.gz 2023-07-21T22:58:56.962 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.45259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45259.log.gz 2023-07-21T22:58:56.963 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.43757.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43757.log.gz 2023-07-21T22:58:57.036 INFO:teuthology.orchestra.run.smithi161.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-07-21T22:58:57.243 INFO:teuthology.orchestra.run.smithi006.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-07-21T22:58:57.279 INFO:teuthology.orchestra.run.smithi006.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-07-21T22:58:57.346 INFO:teuthology.orchestra.run.smithi161.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-07-21T22:58:57.552 INFO:teuthology.orchestra.run.smithi006.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-07-21T22:58:57.617 INFO:teuthology.orchestra.run.smithi161.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-07-21T22:58:57.619 INFO:teuthology.orchestra.run.smithi161.stderr: 2023-07-21T22:58:57.619 INFO:teuthology.orchestra.run.smithi161.stderr:real 0m2.228s 2023-07-21T22:58:57.619 INFO:teuthology.orchestra.run.smithi161.stderr:user 0m9.731s 2023-07-21T22:58:57.619 INFO:teuthology.orchestra.run.smithi161.stderr:sys 0m0.893s 2023-07-21T22:58:57.780 INFO:teuthology.orchestra.run.smithi006.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-07-21T22:58:57.828 INFO:teuthology.orchestra.run.smithi006.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-07-21T22:58:58.457 INFO:teuthology.orchestra.run.smithi006.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-07-21T22:58:58.459 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-21T22:58:58.459 INFO:teuthology.orchestra.run.smithi006.stderr:real 0m3.107s 2023-07-21T22:58:58.459 INFO:teuthology.orchestra.run.smithi006.stderr:user 0m11.914s 2023-07-21T22:58:58.460 INFO:teuthology.orchestra.run.smithi006.stderr:sys 0m2.781s 2023-07-21T22:58:58.461 INFO:tasks.ceph:Archiving logs... 2023-07-21T22:58:58.462 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347723/remote/smithi006/log 2023-07-21T22:58:58.463 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-21T22:59:00.231 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347723/remote/smithi161/log 2023-07-21T22:59:00.232 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-21T22:59:01.091 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-21T22:59:01.101 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-21T22:59:01.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-21T22:59:01.105 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-21T22:59:01.188 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-21T22:59:01.202 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-21T22:59:01.203 DEBUG:teuthology.orchestra.run.smithi006:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-21T22:59:01.207 DEBUG:teuthology.orchestra.run.smithi161:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-21T22:59:01.221 INFO:teuthology.orchestra.run.smithi006.stdout: remote refid st t when poll reach delay offset jitter 2023-07-21T22:59:01.221 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================== 2023-07-21T22:59:01.221 INFO:teuthology.orchestra.run.smithi006.stdout:*hv01.front.sepi 67.205.162.81 3 u 99 128 377 0.193 -1.131 0.782 2023-07-21T22:59:01.222 INFO:teuthology.orchestra.run.smithi006.stdout:+hv02.front.sepi 63.231.80.2 3 u 1 128 377 0.148 +0.350 0.173 2023-07-21T22:59:01.222 INFO:teuthology.orchestra.run.smithi006.stdout:+hv03.front.sepi 74.6.168.72 3 u 12 128 377 0.183 -2.225 0.574 2023-07-21T22:59:01.222 INFO:teuthology.orchestra.run.smithi006.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-07-21T22:59:01.222 INFO:teuthology.orchestra.run.smithi161.stdout: remote refid st t when poll reach delay offset jitter 2023-07-21T22:59:01.223 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================== 2023-07-21T22:59:01.223 INFO:teuthology.orchestra.run.smithi161.stdout:+hv01.front.sepi 67.205.162.81 3 u 7 128 377 0.191 -7.604 2.880 2023-07-21T22:59:01.223 INFO:teuthology.orchestra.run.smithi161.stdout:*hv02.front.sepi 63.231.80.2 3 u 12 128 377 0.167 -6.078 2.147 2023-07-21T22:59:01.223 INFO:teuthology.orchestra.run.smithi161.stdout:+hv03.front.sepi 74.6.168.72 3 u 10 128 377 0.189 -5.155 3.150 2023-07-21T22:59:01.223 INFO:teuthology.orchestra.run.smithi161.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-07-21T22:59:01.224 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-21T22:59:01.233 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-21T22:59:01.234 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-21T22:59:01.243 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-21T22:59:01.253 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-21T22:59:01.266 INFO:teuthology.task.internal:Duration was 3417.403767 seconds 2023-07-21T22:59:01.267 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-21T22:59:01.277 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-21T22:59:01.277 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-21T22:59:01.281 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-21T22:59:01.375 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-21T22:59:01.376 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi006.front.sepia.ceph.com 2023-07-21T22:59:01.376 DEBUG:teuthology.orchestra.run.smithi006:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-21T22:59:01.399 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi161.front.sepia.ceph.com 2023-07-21T22:59:01.400 DEBUG:teuthology.orchestra.run.smithi161:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-21T22:59:01.421 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-21T22:59:01.422 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-21T22:59:01.448 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-21T22:59:01.501 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-21T22:59:01.501 DEBUG:teuthology.orchestra.run.smithi006:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-21T22:59:01.536 DEBUG:teuthology.orchestra.run.smithi161:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-21T22:59:01.623 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-21T22:59:01.635 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-21T22:59:01.636 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-21T22:59:01.658 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-21T22:59:01.680 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-21T22:59:01.775 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-21T22:59:01.779 DEBUG:teuthology.orchestra.run.smithi161:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-21T22:59:01.796 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = core 2023-07-21T22:59:01.799 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = core 2023-07-21T22:59:01.817 DEBUG:teuthology.orchestra.run.smithi006:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-21T22:59:01.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:59:01.865 DEBUG:teuthology.orchestra.run.smithi161:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-21T22:59:01.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:59:01.873 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-21T22:59:01.884 INFO:teuthology.task.internal:Transferring archived files... 2023-07-21T22:59:01.885 DEBUG:teuthology.misc:Transferring archived files from smithi006:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347723/remote/smithi006 2023-07-21T22:59:01.885 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-21T22:59:01.936 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347723/remote/smithi161 2023-07-21T22:59:01.936 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-21T22:59:01.963 INFO:teuthology.task.internal:Removing archive directory... 2023-07-21T22:59:01.964 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-21T22:59:01.977 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-21T22:59:02.008 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-21T22:59:02.019 INFO:teuthology.task.internal:Not uploading archives. 2023-07-21T22:59:02.019 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-21T22:59:02.030 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-21T22:59:02.030 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-21T22:59:02.034 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-21T22:59:02.039 INFO:teuthology.orchestra.run.smithi006.stdout: 657845 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 21 22:59 /home/ubuntu/cephtest 2023-07-21T22:59:02.064 INFO:teuthology.orchestra.run.smithi161.stdout: 657844 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 21 22:59 /home/ubuntu/cephtest 2023-07-21T22:59:02.068 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-21T22:59:02.079 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-21T22:59:02.104 INFO:teuthology.nuke:Checking targets against current locks 2023-07-21T22:59:02.135 DEBUG:teuthology.nuke:shortname: smithi006 2023-07-21T22:59:02.135 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T22:59:02.162 DEBUG:teuthology.nuke:shortname: smithi161 2023-07-21T22:59:02.162 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T22:59:02.165 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347723', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 21:41:45.983887', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOUszSwimgYtFS7cen54X1lzfsN292TP9qlmFs5yWykObaLJVp3uB03mmulOtz7nQBgqRP24rq8z1EUFjDSnTKM='} 2023-07-21T22:59:02.195 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347723', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 21:41:45.987518', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHmz7LX6eLJUvaM/jSQToke5Y4YCbIL+2S4t0PpfaYWE'} 2023-07-21T22:59:02.223 INFO:teuthology.orchestra.console:Power off smithi006 2023-07-21T22:59:02.224 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T22:59:02.249 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:59:02.276 INFO:teuthology.orchestra.console:Power off smithi161 2023-07-21T22:59:02.277 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T22:59:02.299 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:59:06.288 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:59:06.325 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:59:10.404 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:59:10.439 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:59:10.651 INFO:teuthology.orchestra.console:Power off for smithi161 completed 2023-07-21T22:59:14.521 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T22:59:14.732 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2023-07-21T22:59:14.838 INFO:teuthology.run:Summary data: client.0-kernel-sha1: c685da6f56cc77f2cfb9c4221be3960522616caf client.1-kernel-sha1: c685da6f56cc77f2cfb9c4221be3960522616caf description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} duration: 3417.40376663208 failure_reason: '"2023-07-21T22:21:04.601015+0000 mon.a (mon.0) 361 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log' flavor: default owner: scheduled_rishabh@teuthology success: false 2023-07-21T22:59:14.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T22:59:14.989 INFO:teuthology.run:FAIL